2024-09-21T03:08:32.119 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T03:08:32.141 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T03:08:32.237 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913457 branch: wip-pdonnell-testing-20240920.212106-debug description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/client-limits} email: pdonnell@redhat.com first_in_suite: false job_id: '7913457' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240920.212106-debug ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: pid file: '' global: ms die on skipped message: false mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - responding to mclientcaps\(revoke\) - not advance its oldest_client_tid - failing to advance its oldest client/flush tid - Too many inodes in cache - failing to respond to cache pressure - slow requests are blocked - failing to respond to capability release - MDS cache is too large - \(MDS_CLIENT_OLDEST_TID\) - \(MDS_CACHE_OVERSIZED\) sha1: 1843221895adccfb3b692060251dd6a0183bc410 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 1843221895adccfb3b692060251dd6a0183bc410 kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240920.212106-debug sha1: 1843221895adccfb3b692060251dd6a0183bc410 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 7864 sha1: 1843221895adccfb3b692060251dd6a0183bc410 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240920.212106-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1843221895adccfb3b692060251dd6a0183bc410 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi105.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJKffmCTLd3pTSjZK0PulrZznuEUDxGL9Si2fSJOivKzFlKl12p4GbKAVI2MmB/85EWWBn07jkRc9XIk6UuA3JA= smithi162.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEldNB5nTsHAI3Bh3/2zgCpbwLSheRZXtGRs2/qvy1LG46OBLpHlO7wYPD55AjlEpIsssjMI/cmSEyiI5ppW8fY= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_client_limits teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_23:48:22 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T03:08:32.237 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa; will attempt to use it 2024-09-21T03:08:32.238 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks 2024-09-21T03:08:32.238 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T03:08:32.240 INFO:teuthology.task.internal:Checking packages... 2024-09-21T03:08:32.260 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1843221895adccfb3b692060251dd6a0183bc410' 2024-09-21T03:08:32.260 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T03:08:32.261 INFO:teuthology.packaging:ref: None 2024-09-21T03:08:32.261 INFO:teuthology.packaging:tag: None 2024-09-21T03:08:32.261 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240920.212106-debug 2024-09-21T03:08:32.261 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:08:32.261 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240920.212106-debug 2024-09-21T03:08:32.406 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5120.g18432218 2024-09-21T03:08:32.407 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T03:08:32.413 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T03:08:32.413 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T03:08:32.418 INFO:teuthology.task.internal:Saving configuration 2024-09-21T03:08:32.435 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T03:08:32.441 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T03:08:32.460 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi105.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913457', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 03:03:24.354210', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJKffmCTLd3pTSjZK0PulrZznuEUDxGL9Si2fSJOivKzFlKl12p4GbKAVI2MmB/85EWWBn07jkRc9XIk6UuA3JA='} 2024-09-21T03:08:32.483 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913457', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 03:03:24.356178', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEldNB5nTsHAI3Bh3/2zgCpbwLSheRZXtGRs2/qvy1LG46OBLpHlO7wYPD55AjlEpIsssjMI/cmSEyiI5ppW8fY='} 2024-09-21T03:08:32.484 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T03:08:32.488 INFO:teuthology.task.internal:roles: ubuntu@smithi105.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-21T03:08:32.488 INFO:teuthology.task.internal:roles: ubuntu@smithi162.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-21T03:08:32.488 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T03:08:32.544 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f106b2b4160>, signals=[15]) 2024-09-21T03:08:32.544 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T03:08:32.549 INFO:teuthology.task.internal:Opening connections... 2024-09-21T03:08:32.549 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi105.front.sepia.ceph.com 2024-09-21T03:08:32.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:08:32.627 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi162.front.sepia.ceph.com 2024-09-21T03:08:32.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:08:32.699 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T03:08:32.704 DEBUG:teuthology.orchestra.run.smithi105:> uname -m 2024-09-21T03:08:32.722 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2024-09-21T03:08:32.723 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2024-09-21T03:08:32.779 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream" 2024-09-21T03:08:32.779 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="9" 2024-09-21T03:08:32.780 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2024-09-21T03:08:32.780 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2024-09-21T03:08:32.780 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="9" 2024-09-21T03:08:32.780 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el9" 2024-09-21T03:08:32.780 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T03:08:32.780 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2024-09-21T03:08:32.780 INFO:teuthology.orchestra.run.smithi105.stdout:LOGO="fedora-logo-icon" 2024-09-21T03:08:32.780 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T03:08:32.780 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/" 2024-09-21T03:08:32.780 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T03:08:32.780 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T03:08:32.780 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T03:08:32.781 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2024-09-21T03:08:32.800 DEBUG:teuthology.orchestra.run.smithi162:> uname -m 2024-09-21T03:08:32.818 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2024-09-21T03:08:32.819 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2024-09-21T03:08:32.875 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="CentOS Stream" 2024-09-21T03:08:32.875 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="9" 2024-09-21T03:08:32.875 INFO:teuthology.orchestra.run.smithi162.stdout:ID="centos" 2024-09-21T03:08:32.875 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="rhel fedora" 2024-09-21T03:08:32.875 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="9" 2024-09-21T03:08:32.875 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el9" 2024-09-21T03:08:32.876 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T03:08:32.876 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31" 2024-09-21T03:08:32.876 INFO:teuthology.orchestra.run.smithi162.stdout:LOGO="fedora-logo-icon" 2024-09-21T03:08:32.876 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T03:08:32.876 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://centos.org/" 2024-09-21T03:08:32.876 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T03:08:32.876 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T03:08:32.876 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T03:08:32.876 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2024-09-21T03:08:32.899 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T03:08:32.917 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T03:08:32.954 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T03:08:32.954 DEBUG:teuthology.orchestra.run.smithi105:> test '!' -e /home/ubuntu/cephtest 2024-09-21T03:08:32.957 DEBUG:teuthology.orchestra.run.smithi162:> test '!' -e /home/ubuntu/cephtest 2024-09-21T03:08:32.973 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T03:08:32.978 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T03:08:32.978 DEBUG:teuthology.orchestra.run.smithi105:> test -z $(ls -A /var/lib/ceph) 2024-09-21T03:08:33.016 DEBUG:teuthology.orchestra.run.smithi162:> test -z $(ls -A /var/lib/ceph) 2024-09-21T03:08:33.331 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T03:08:33.385 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T03:08:33.399 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-21T03:08:33.399 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-09-21T03:08:33.399 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-09-21T03:08:33.400 DEBUG:teuthology.orchestra.run.smithi105:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T03:08:33.400 DEBUG:teuthology.orchestra.run.smithi162:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T03:08:33.417 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:08:33.417 DEBUG:teuthology.orchestra.run.smithi105:> uname -r 2024-09-21T03:08:33.418 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:08:33.418 DEBUG:teuthology.orchestra.run.smithi162:> uname -r 2024-09-21T03:08:33.475 INFO:teuthology.orchestra.run.smithi105.stdout:5.14.0-503.el9.x86_64 2024-09-21T03:08:33.475 INFO:teuthology.task.kernel:Running kernel on smithi105: 5.14.0-503.el9.x86_64 2024-09-21T03:08:33.475 DEBUG:teuthology.orchestra.run.smithi105:> sudo yum install -y kernel 2024-09-21T03:08:33.476 INFO:teuthology.orchestra.run.smithi162.stdout:5.14.0-503.el9.x86_64 2024-09-21T03:08:33.477 INFO:teuthology.task.kernel:Running kernel on smithi162: 5.14.0-503.el9.x86_64 2024-09-21T03:08:33.477 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum install -y kernel 2024-09-21T03:08:35.720 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.3 MB 00:00 2024-09-21T03:08:36.183 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - BaseOS 8.7 MB/s | 8.3 MB 00:00 2024-09-21T03:08:37.338 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS Stream 9 - AppStream 36 MB/s | 20 MB 00:00 2024-09-21T03:08:37.859 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - AppStream 34 MB/s | 20 MB 00:00 2024-09-21T03:08:41.647 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-21T03:08:43.066 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS Stream 9 - Extras packages 94 kB/s | 19 kB 00:00 2024-09-21T03:08:43.201 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 6.5 MB 00:01 2024-09-21T03:08:44.185 INFO:teuthology.orchestra.run.smithi105.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-21T03:08:44.743 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 19 kB 00:00 2024-09-21T03:08:45.698 INFO:teuthology.orchestra.run.smithi162.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-21T03:08:49.533 INFO:teuthology.orchestra.run.smithi105.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2024-09-21T03:08:51.086 INFO:teuthology.orchestra.run.smithi162.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-21T03:08:51.414 INFO:teuthology.orchestra.run.smithi105.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T03:08:51.414 INFO:teuthology.orchestra.run.smithi105.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T03:08:51.516 INFO:teuthology.orchestra.run.smithi105.stdout:Dependencies resolved. 2024-09-21T03:08:51.523 INFO:teuthology.orchestra.run.smithi105.stdout:================================================================================ 2024-09-21T03:08:51.523 INFO:teuthology.orchestra.run.smithi105.stdout: Package Architecture Version Repository Size 2024-09-21T03:08:51.523 INFO:teuthology.orchestra.run.smithi105.stdout:================================================================================ 2024-09-21T03:08:51.523 INFO:teuthology.orchestra.run.smithi105.stdout:Installing: 2024-09-21T03:08:51.524 INFO:teuthology.orchestra.run.smithi105.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T03:08:51.524 INFO:teuthology.orchestra.run.smithi105.stdout:Installing dependencies: 2024-09-21T03:08:51.524 INFO:teuthology.orchestra.run.smithi105.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T03:08:51.524 INFO:teuthology.orchestra.run.smithi105.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T03:08:51.524 INFO:teuthology.orchestra.run.smithi105.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T03:08:51.524 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:08:51.524 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction Summary 2024-09-21T03:08:51.524 INFO:teuthology.orchestra.run.smithi105.stdout:================================================================================ 2024-09-21T03:08:51.524 INFO:teuthology.orchestra.run.smithi105.stdout:Install 4 Packages 2024-09-21T03:08:51.524 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:08:51.525 INFO:teuthology.orchestra.run.smithi105.stdout:Total download size: 79 M 2024-09-21T03:08:51.525 INFO:teuthology.orchestra.run.smithi105.stdout:Installed size: 126 M 2024-09-21T03:08:51.525 INFO:teuthology.orchestra.run.smithi105.stdout:Downloading Packages: 2024-09-21T03:08:51.817 INFO:teuthology.orchestra.run.smithi105.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 290 kB/s | 36 kB 00:00 2024-09-21T03:08:53.050 INFO:teuthology.orchestra.run.smithi162.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T03:08:53.051 INFO:teuthology.orchestra.run.smithi162.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T03:08:53.137 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T03:08:53.149 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T03:08:53.149 INFO:teuthology.orchestra.run.smithi162.stdout: Package Architecture Version Repository Size 2024-09-21T03:08:53.149 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T03:08:53.149 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-21T03:08:53.149 INFO:teuthology.orchestra.run.smithi162.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T03:08:53.149 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-09-21T03:08:53.149 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T03:08:53.149 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T03:08:53.149 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T03:08:53.149 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:08:53.149 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T03:08:53.149 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-21T03:08:53.149 INFO:teuthology.orchestra.run.smithi162.stdout:Install 4 Packages 2024-09-21T03:08:53.150 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:08:53.150 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 79 M 2024-09-21T03:08:53.150 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 126 M 2024-09-21T03:08:53.150 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-21T03:08:53.295 INFO:teuthology.orchestra.run.smithi162.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 373 kB/s | 36 kB 00:00 2024-09-21T03:08:53.687 INFO:teuthology.orchestra.run.smithi162.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-09-21T03:08:54.062 INFO:teuthology.orchestra.run.smithi162.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 37 MB/s | 29 MB 00:00 2024-09-21T03:08:54.388 INFO:teuthology.orchestra.run.smithi162.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 29 MB/s | 35 MB 00:01 2024-09-21T03:08:54.388 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-21T03:08:54.388 INFO:teuthology.orchestra.run.smithi162.stdout:Total 64 MB/s | 79 MB 00:01 2024-09-21T03:08:55.067 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T03:08:55.465 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T03:08:55.465 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T03:08:56.411 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T03:08:56.411 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T03:08:58.849 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T03:08:58.958 INFO:teuthology.orchestra.run.smithi105.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 2.2 MB/s | 16 MB 00:07 2024-09-21T03:08:59.555 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T03:08:59.645 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T03:09:02.414 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T03:09:02.546 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T03:09:05.300 INFO:teuthology.orchestra.run.smithi105.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 2.1 MB/s | 29 MB 00:13 2024-09-21T03:09:07.378 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T03:09:07.498 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:09:08.316 INFO:teuthology.orchestra.run.smithi105.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 2.1 MB/s | 35 MB 00:16 2024-09-21T03:09:08.316 INFO:teuthology.orchestra.run.smithi105.stdout:-------------------------------------------------------------------------------- 2024-09-21T03:09:08.317 INFO:teuthology.orchestra.run.smithi105.stdout:Total 4.7 MB/s | 79 MB 00:16 2024-09-21T03:09:08.990 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction check 2024-09-21T03:09:09.345 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction check succeeded. 2024-09-21T03:09:09.346 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction test 2024-09-21T03:09:10.324 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction test succeeded. 2024-09-21T03:09:10.325 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction 2024-09-21T03:09:12.346 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:09:12.791 INFO:teuthology.orchestra.run.smithi105.stdout: Preparing : 1/1 2024-09-21T03:09:13.510 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T03:09:13.600 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T03:09:16.361 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T03:09:16.496 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T03:09:21.304 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T03:09:21.438 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:09:26.255 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:09:50.699 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:09:50.738 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:09:51.081 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:09:51.081 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T03:09:51.081 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T03:09:51.082 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T03:09:51.909 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:09:51.910 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:09:51.910 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-21T03:09:51.910 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T03:09:51.910 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T03:09:51.910 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T03:09:51.910 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T03:09:51.910 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:09:51.910 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T03:09:52.299 DEBUG:teuthology.orchestra.run.smithi162:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T03:09:52.390 INFO:teuthology.orchestra.run.smithi162.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T03:09:52.390 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T03:09:52.390 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T03:09:52.390 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T03:09:52.391 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T03:09:52.391 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-09-21T03:09:52.391 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi162.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T03:09:52.391 DEBUG:teuthology.orchestra.run.smithi162:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T03:09:52.449 INFO:teuthology.orchestra.run.smithi162.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T03:09:52.449 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T03:09:52.449 DEBUG:teuthology.orchestra.run.smithi162:> sudo rpm -qi grub2-tools 2024-09-21T03:09:52.482 INFO:teuthology.orchestra.run.smithi162.stdout:Name : grub2-tools 2024-09-21T03:09:52.482 INFO:teuthology.orchestra.run.smithi162.stdout:Epoch : 1 2024-09-21T03:09:52.482 INFO:teuthology.orchestra.run.smithi162.stdout:Version : 2.06 2024-09-21T03:09:52.482 INFO:teuthology.orchestra.run.smithi162.stdout:Release : 82.el9 2024-09-21T03:09:52.482 INFO:teuthology.orchestra.run.smithi162.stdout:Architecture: x86_64 2024-09-21T03:09:52.482 INFO:teuthology.orchestra.run.smithi162.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T03:09:52.482 INFO:teuthology.orchestra.run.smithi162.stdout:Group : Unspecified 2024-09-21T03:09:52.482 INFO:teuthology.orchestra.run.smithi162.stdout:Size : 8274670 2024-09-21T03:09:52.482 INFO:teuthology.orchestra.run.smithi162.stdout:License : GPLv3+ 2024-09-21T03:09:52.482 INFO:teuthology.orchestra.run.smithi162.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T03:09:52.482 INFO:teuthology.orchestra.run.smithi162.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T03:09:52.482 INFO:teuthology.orchestra.run.smithi162.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T03:09:52.483 INFO:teuthology.orchestra.run.smithi162.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T03:09:52.483 INFO:teuthology.orchestra.run.smithi162.stdout:Packager : builder@centos.org 2024-09-21T03:09:52.483 INFO:teuthology.orchestra.run.smithi162.stdout:Vendor : CentOS 2024-09-21T03:09:52.483 INFO:teuthology.orchestra.run.smithi162.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T03:09:52.483 INFO:teuthology.orchestra.run.smithi162.stdout:Summary : Support tools for GRUB. 2024-09-21T03:09:52.483 INFO:teuthology.orchestra.run.smithi162.stdout:Description : 2024-09-21T03:09:52.483 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:09:52.483 INFO:teuthology.orchestra.run.smithi162.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T03:09:52.483 INFO:teuthology.orchestra.run.smithi162.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T03:09:52.483 INFO:teuthology.orchestra.run.smithi162.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T03:09:52.483 INFO:teuthology.orchestra.run.smithi162.stdout:hardware devices. 2024-09-21T03:09:52.483 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:09:52.483 INFO:teuthology.orchestra.run.smithi162.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T03:09:52.484 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T03:09:52.484 INFO:teuthology.task.kernel:Updating grub on smithi162 to boot 5.14.0-508.el9.x86_64 2024-09-21T03:09:52.484 DEBUG:teuthology.orchestra.run.smithi162:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T03:09:53.117 INFO:teuthology.orchestra.run.smithi162.stderr:Generating grub configuration file ... 2024-09-21T03:09:54.394 INFO:teuthology.orchestra.run.smithi162.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T03:09:54.412 INFO:teuthology.orchestra.run.smithi162.stderr:done 2024-09-21T03:09:54.414 DEBUG:teuthology.orchestra.run.smithi162:> mktemp 2024-09-21T03:09:54.429 INFO:teuthology.orchestra.run.smithi162.stdout:/tmp/tmp.ECgBf6MjHB 2024-09-21T03:09:54.429 DEBUG:teuthology.orchestra.run.smithi162:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ECgBf6MjHB 2024-09-21T03:09:54.496 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0666 /tmp/tmp.ECgBf6MjHB 2024-09-21T03:09:54.646 DEBUG:teuthology.orchestra.remote:smithi162:/tmp/tmp.ECgBf6MjHB is 6KB 2024-09-21T03:09:54.694 DEBUG:teuthology.orchestra.run.smithi162:> rm -fr /tmp/tmp.ECgBf6MjHB 2024-09-21T03:09:54.709 DEBUG:teuthology.orchestra.run.smithi162:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T03:09:54.776 INFO:teuthology.orchestra.run.smithi162.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T03:09:54.776 INFO:teuthology.orchestra.run.smithi162.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T03:09:54.776 INFO:teuthology.orchestra.run.smithi162.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T03:09:54.776 INFO:teuthology.orchestra.run.smithi162.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T03:09:54.777 DEBUG:teuthology.orchestra.run.smithi162:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T03:09:54.945 DEBUG:teuthology.orchestra.run.smithi162:> sudo shutdown -r now 2024-09-21T03:10:04.405 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:10:04.445 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:10:04.750 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:10:04.751 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T03:10:04.751 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T03:10:04.751 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T03:10:05.609 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:10:05.609 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:10:05.609 INFO:teuthology.orchestra.run.smithi105.stdout:Installed: 2024-09-21T03:10:05.609 INFO:teuthology.orchestra.run.smithi105.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T03:10:05.609 INFO:teuthology.orchestra.run.smithi105.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T03:10:05.609 INFO:teuthology.orchestra.run.smithi105.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T03:10:05.609 INFO:teuthology.orchestra.run.smithi105.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T03:10:05.609 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:10:05.609 INFO:teuthology.orchestra.run.smithi105.stdout:Complete! 2024-09-21T03:10:05.960 DEBUG:teuthology.orchestra.run.smithi105:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T03:10:06.051 INFO:teuthology.orchestra.run.smithi105.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T03:10:06.051 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T03:10:06.051 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T03:10:06.051 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T03:10:06.051 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T03:10:06.052 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-21T03:10:06.052 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi105.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T03:10:06.052 DEBUG:teuthology.orchestra.run.smithi105:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T03:10:06.109 INFO:teuthology.orchestra.run.smithi105.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T03:10:06.110 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T03:10:06.110 DEBUG:teuthology.orchestra.run.smithi105:> sudo rpm -qi grub2-tools 2024-09-21T03:10:06.150 INFO:teuthology.orchestra.run.smithi105.stdout:Name : grub2-tools 2024-09-21T03:10:06.151 INFO:teuthology.orchestra.run.smithi105.stdout:Epoch : 1 2024-09-21T03:10:06.151 INFO:teuthology.orchestra.run.smithi105.stdout:Version : 2.06 2024-09-21T03:10:06.151 INFO:teuthology.orchestra.run.smithi105.stdout:Release : 82.el9 2024-09-21T03:10:06.151 INFO:teuthology.orchestra.run.smithi105.stdout:Architecture: x86_64 2024-09-21T03:10:06.151 INFO:teuthology.orchestra.run.smithi105.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T03:10:06.151 INFO:teuthology.orchestra.run.smithi105.stdout:Group : Unspecified 2024-09-21T03:10:06.151 INFO:teuthology.orchestra.run.smithi105.stdout:Size : 8274670 2024-09-21T03:10:06.151 INFO:teuthology.orchestra.run.smithi105.stdout:License : GPLv3+ 2024-09-21T03:10:06.151 INFO:teuthology.orchestra.run.smithi105.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T03:10:06.151 INFO:teuthology.orchestra.run.smithi105.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T03:10:06.151 INFO:teuthology.orchestra.run.smithi105.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T03:10:06.151 INFO:teuthology.orchestra.run.smithi105.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T03:10:06.151 INFO:teuthology.orchestra.run.smithi105.stdout:Packager : builder@centos.org 2024-09-21T03:10:06.151 INFO:teuthology.orchestra.run.smithi105.stdout:Vendor : CentOS 2024-09-21T03:10:06.151 INFO:teuthology.orchestra.run.smithi105.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T03:10:06.152 INFO:teuthology.orchestra.run.smithi105.stdout:Summary : Support tools for GRUB. 2024-09-21T03:10:06.152 INFO:teuthology.orchestra.run.smithi105.stdout:Description : 2024-09-21T03:10:06.152 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:10:06.152 INFO:teuthology.orchestra.run.smithi105.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T03:10:06.152 INFO:teuthology.orchestra.run.smithi105.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T03:10:06.152 INFO:teuthology.orchestra.run.smithi105.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T03:10:06.152 INFO:teuthology.orchestra.run.smithi105.stdout:hardware devices. 2024-09-21T03:10:06.152 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:10:06.152 INFO:teuthology.orchestra.run.smithi105.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T03:10:06.153 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T03:10:06.153 INFO:teuthology.task.kernel:Updating grub on smithi105 to boot 5.14.0-508.el9.x86_64 2024-09-21T03:10:06.153 DEBUG:teuthology.orchestra.run.smithi105:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T03:10:06.787 INFO:teuthology.orchestra.run.smithi105.stderr:Generating grub configuration file ... 2024-09-21T03:10:08.136 INFO:teuthology.orchestra.run.smithi105.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T03:10:08.177 INFO:teuthology.orchestra.run.smithi105.stderr:done 2024-09-21T03:10:08.180 DEBUG:teuthology.orchestra.run.smithi105:> mktemp 2024-09-21T03:10:08.218 INFO:teuthology.orchestra.run.smithi105.stdout:/tmp/tmp.syppndaMaU 2024-09-21T03:10:08.218 DEBUG:teuthology.orchestra.run.smithi105:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.syppndaMaU 2024-09-21T03:10:08.284 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 0666 /tmp/tmp.syppndaMaU 2024-09-21T03:10:08.423 DEBUG:teuthology.orchestra.remote:smithi105:/tmp/tmp.syppndaMaU is 6KB 2024-09-21T03:10:08.470 DEBUG:teuthology.orchestra.run.smithi105:> rm -fr /tmp/tmp.syppndaMaU 2024-09-21T03:10:08.485 DEBUG:teuthology.orchestra.run.smithi105:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T03:10:08.548 INFO:teuthology.orchestra.run.smithi105.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T03:10:08.548 INFO:teuthology.orchestra.run.smithi105.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T03:10:08.548 INFO:teuthology.orchestra.run.smithi105.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T03:10:08.548 INFO:teuthology.orchestra.run.smithi105.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T03:10:08.549 DEBUG:teuthology.orchestra.run.smithi105:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T03:10:08.697 DEBUG:teuthology.orchestra.run.smithi105:> sudo shutdown -r now 2024-09-21T03:10:24.962 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-21T03:10:24.963 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-21T03:10:24.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:10:38.710 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-21T03:10:38.711 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-09-21T03:10:38.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:11:24.979 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T03:11:33.986 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-21T03:11:33.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:11:38.718 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T03:11:41.410 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-09-21T03:11:41.851 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-21T03:11:41.851 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-508.el9.x86_64"... 2024-09-21T03:11:41.852 DEBUG:teuthology.orchestra.run.smithi162:> uname -r 2024-09-21T03:11:41.866 INFO:teuthology.orchestra.run.smithi162.stdout:5.14.0-508.el9.x86_64 2024-09-21T03:11:41.866 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T03:11:41.866 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T03:11:41.866 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T03:11:42.868 DEBUG:teuthology.parallel:result is None 2024-09-21T03:11:47.719 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-09-21T03:11:47.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:11:47.973 DEBUG:teuthology.orchestra.run.smithi105:> true 2024-09-21T03:11:48.322 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-09-21T03:11:48.322 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-21T03:11:48.323 DEBUG:teuthology.orchestra.run.smithi105:> uname -r 2024-09-21T03:11:48.339 INFO:teuthology.orchestra.run.smithi105.stdout:5.14.0-508.el9.x86_64 2024-09-21T03:11:48.339 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T03:11:48.339 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T03:11:48.339 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T03:11:49.340 DEBUG:teuthology.parallel:result is None 2024-09-21T03:11:49.341 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T03:11:49.348 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T03:11:49.348 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T03:11:49.351 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T03:11:49.368 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T03:11:49.432 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T03:11:49.443 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T03:11:49.444 DEBUG:teuthology.orchestra.run.smithi105:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T03:11:49.446 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T03:11:49.555 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T03:11:49.562 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T03:11:49.562 DEBUG:teuthology.orchestra.run.smithi105:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T03:11:49.564 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T03:11:49.680 INFO:teuthology.orchestra.run.smithi105.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T03:11:49.705 INFO:teuthology.orchestra.run.smithi105.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T03:11:49.735 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T03:11:49.764 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T03:11:49.766 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T03:11:49.773 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T03:11:49.773 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T03:11:49.775 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T03:11:49.800 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T03:11:49.808 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T03:11:49.808 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T03:11:49.842 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T03:11:49.857 DEBUG:teuthology.orchestra.run.smithi105:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T03:11:49.938 DEBUG:teuthology.orchestra.run.smithi105:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T03:11:49.990 DEBUG:teuthology.orchestra.run.smithi105:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T03:11:50.070 DEBUG:teuthology.orchestra.run.smithi105:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T03:11:50.113 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:11:50.113 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T03:11:50.181 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T03:11:50.221 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T03:11:50.273 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T03:11:50.354 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T03:11:50.395 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:11:50.395 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T03:11:50.460 DEBUG:teuthology.orchestra.run.smithi105:> sudo service rsyslog restart 2024-09-21T03:11:50.462 DEBUG:teuthology.orchestra.run.smithi162:> sudo service rsyslog restart 2024-09-21T03:11:50.518 INFO:teuthology.orchestra.run.smithi105.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T03:11:50.555 INFO:teuthology.orchestra.run.smithi162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T03:11:50.995 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T03:11:51.003 INFO:teuthology.task.internal:Starting timer... 2024-09-21T03:11:51.003 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T03:11:51.016 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T03:11:51.025 DEBUG:teuthology.orchestra.run.smithi105:> sudo service auditd rotate 2024-09-21T03:11:51.115 INFO:teuthology.orchestra.run.smithi105.stdout:Rotating logs: 2024-09-21T03:11:51.117 DEBUG:teuthology.orchestra.run.smithi162:> sudo service auditd rotate 2024-09-21T03:11:51.190 INFO:teuthology.orchestra.run.smithi162.stdout:Rotating logs: 2024-09-21T03:11:51.192 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T03:11:51.192 DEBUG:teuthology.orchestra.run.smithi105:> /usr/sbin/getenforce 2024-09-21T03:11:51.218 INFO:teuthology.orchestra.run.smithi105.stdout:Permissive 2024-09-21T03:11:51.218 DEBUG:teuthology.orchestra.run.smithi162:> /usr/sbin/getenforce 2024-09-21T03:11:51.243 INFO:teuthology.orchestra.run.smithi162.stdout:Permissive 2024-09-21T03:11:51.243 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi105.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi162.front.sepia.ceph.com': 'permissive'} 2024-09-21T03:11:51.243 DEBUG:teuthology.orchestra.run.smithi105:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-21T03:11:51.283 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:11:51.284 DEBUG:teuthology.orchestra.run.smithi162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-21T03:11:51.309 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:11:51.310 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T03:11:51.310 DEBUG:teuthology.orchestra.run.smithi105:> sudo /usr/sbin/setenforce permissive 2024-09-21T03:11:51.351 DEBUG:teuthology.orchestra.run.smithi162:> sudo /usr/sbin/setenforce permissive 2024-09-21T03:11:51.381 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T03:11:51.390 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T03:11:51.400 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T03:11:51.400 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi105.front.sepia.ceph.com,smithi162.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T03:15:30.995 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi105.front.sepia.ceph.com'), Remote(name='ubuntu@smithi162.front.sepia.ceph.com')] 2024-09-21T03:15:30.996 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-09-21T03:15:30.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:15:31.075 DEBUG:teuthology.orchestra.run.smithi105:> true 2024-09-21T03:15:31.153 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-09-21T03:15:31.154 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-21T03:15:31.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:15:31.227 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-09-21T03:15:31.310 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-21T03:15:31.310 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T03:15:31.320 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T03:15:31.320 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T03:15:31.320 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T03:15:31.323 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T03:15:31.323 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T03:15:31.349 INFO:teuthology.orchestra.run.smithi105.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T03:15:31.363 INFO:teuthology.orchestra.run.smithi105.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T03:15:31.379 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T03:15:31.388 INFO:teuthology.orchestra.run.smithi105.stderr:sudo: ntpd: command not found 2024-09-21T03:15:31.396 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T03:15:31.399 INFO:teuthology.orchestra.run.smithi105.stdout:506 Cannot talk to daemon 2024-09-21T03:15:31.413 INFO:teuthology.orchestra.run.smithi105.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T03:15:31.424 INFO:teuthology.orchestra.run.smithi162.stderr:sudo: ntpd: command not found 2024-09-21T03:15:31.427 INFO:teuthology.orchestra.run.smithi105.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T03:15:31.437 INFO:teuthology.orchestra.run.smithi162.stdout:506 Cannot talk to daemon 2024-09-21T03:15:31.451 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T03:15:31.465 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T03:15:31.480 INFO:teuthology.orchestra.run.smithi105.stderr:bash: line 1: ntpq: command not found 2024-09-21T03:15:31.484 INFO:teuthology.orchestra.run.smithi105.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T03:15:31.484 INFO:teuthology.orchestra.run.smithi105.stdout:=============================================================================== 2024-09-21T03:15:31.484 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:15:31.484 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:15:31.484 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:15:31.484 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:15:31.529 INFO:teuthology.orchestra.run.smithi162.stderr:bash: line 1: ntpq: command not found 2024-09-21T03:15:31.532 INFO:teuthology.orchestra.run.smithi162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T03:15:31.532 INFO:teuthology.orchestra.run.smithi162.stdout:=============================================================================== 2024-09-21T03:15:31.533 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:15:31.533 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:15:31.533 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:15:31.533 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:15:31.534 INFO:teuthology.run_tasks:Running task install... 2024-09-21T03:15:31.543 DEBUG:teuthology.task.install:project ceph 2024-09-21T03:15:31.543 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}} 2024-09-21T03:15:31.543 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'} 2024-09-21T03:15:31.544 INFO:teuthology.task.install:Using flavor: default 2024-09-21T03:15:31.551 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T03:15:31.552 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-21T03:15:31.552 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T03:15:31.553 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:15:31.555 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T03:15:31.556 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:15:31.705 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T03:15:31.705 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T03:15:31.709 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T03:15:31.709 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T03:15:31.815 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T03:15:31.815 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:15:31.815 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T03:15:31.822 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T03:15:31.823 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:15:31.823 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T03:15:31.841 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T03:15:31.841 DEBUG:teuthology.orchestra.run.smithi105:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T03:15:31.848 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T03:15:31.848 DEBUG:teuthology.orchestra.run.smithi162:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T03:15:31.907 DEBUG:teuthology.orchestra.run.smithi105:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T03:15:31.913 DEBUG:teuthology.orchestra.run.smithi162:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T03:15:31.982 DEBUG:teuthology.orchestra.run.smithi105:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T03:15:31.988 DEBUG:teuthology.orchestra.run.smithi162:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T03:15:32.046 INFO:teuthology.orchestra.run.smithi105.stdout:check_obsoletes = 1 2024-09-21T03:15:32.048 DEBUG:teuthology.orchestra.run.smithi105:> sudo yum clean all 2024-09-21T03:15:32.052 INFO:teuthology.orchestra.run.smithi162.stdout:check_obsoletes = 1 2024-09-21T03:15:32.054 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum clean all 2024-09-21T03:15:32.279 INFO:teuthology.orchestra.run.smithi105.stdout:45 files removed 2024-09-21T03:15:32.282 INFO:teuthology.orchestra.run.smithi162.stdout:45 files removed 2024-09-21T03:15:32.307 DEBUG:teuthology.orchestra.run.smithi105:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T03:15:32.309 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T03:15:32.864 INFO:teuthology.orchestra.run.smithi105.stdout:ceph packages for x86_64 309 kB/s | 84 kB 00:00 2024-09-21T03:15:32.869 INFO:teuthology.orchestra.run.smithi162.stdout:ceph packages for x86_64 309 kB/s | 84 kB 00:00 2024-09-21T03:15:33.161 INFO:teuthology.orchestra.run.smithi162.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-21T03:15:33.165 INFO:teuthology.orchestra.run.smithi105.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-21T03:15:33.437 INFO:teuthology.orchestra.run.smithi162.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-21T03:15:33.457 INFO:teuthology.orchestra.run.smithi105.stdout:ceph source packages 7.5 kB/s | 1.9 kB 00:00 2024-09-21T03:15:34.070 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.3 MB 00:00 2024-09-21T03:15:34.266 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.3 MB 00:00 2024-09-21T03:15:37.492 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS Stream 9 - AppStream 9.4 MB/s | 20 MB 00:02 2024-09-21T03:15:38.522 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - AppStream 6.0 MB/s | 20 MB 00:03 2024-09-21T03:15:42.780 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-21T03:15:42.910 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS Stream 9 - CRB 4.0 MB/s | 6.5 MB 00:01 2024-09-21T03:15:44.331 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - Extras packages 67 kB/s | 19 kB 00:00 2024-09-21T03:15:44.419 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS Stream 9 - Extras packages 124 kB/s | 19 kB 00:00 2024-09-21T03:15:45.260 INFO:teuthology.orchestra.run.smithi162.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-21T03:15:45.298 INFO:teuthology.orchestra.run.smithi105.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-21T03:15:50.665 INFO:teuthology.orchestra.run.smithi162.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-21T03:15:50.771 INFO:teuthology.orchestra.run.smithi105.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-21T03:15:52.859 INFO:teuthology.orchestra.run.smithi162.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T03:15:52.860 INFO:teuthology.orchestra.run.smithi162.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T03:15:52.871 INFO:teuthology.orchestra.run.smithi162.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T03:15:52.872 INFO:teuthology.orchestra.run.smithi162.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T03:15:52.873 INFO:teuthology.orchestra.run.smithi162.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T03:15:52.874 INFO:teuthology.orchestra.run.smithi162.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T03:15:52.876 INFO:teuthology.orchestra.run.smithi162.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T03:15:52.878 INFO:teuthology.orchestra.run.smithi162.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T03:15:52.879 INFO:teuthology.orchestra.run.smithi162.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T03:15:52.941 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-21T03:15:52.965 INFO:teuthology.orchestra.run.smithi162.stdout:======================================================================================= 2024-09-21T03:15:52.966 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-09-21T03:15:52.966 INFO:teuthology.orchestra.run.smithi162.stdout:======================================================================================= 2024-09-21T03:15:52.966 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-21T03:15:52.966 INFO:teuthology.orchestra.run.smithi162.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T03:15:52.966 INFO:teuthology.orchestra.run.smithi162.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T03:15:52.966 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T03:15:52.966 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T03:15:52.966 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T03:15:52.966 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T03:15:52.966 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T03:15:52.967 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T03:15:52.967 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T03:15:52.967 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T03:15:52.967 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T03:15:52.967 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T03:15:52.967 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T03:15:52.967 INFO:teuthology.orchestra.run.smithi162.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T03:15:52.967 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T03:15:52.967 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T03:15:52.967 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T03:15:52.968 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T03:15:52.968 INFO:teuthology.orchestra.run.smithi162.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T03:15:52.968 INFO:teuthology.orchestra.run.smithi162.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T03:15:52.968 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T03:15:52.968 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T03:15:52.968 INFO:teuthology.orchestra.run.smithi162.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T03:15:52.968 INFO:teuthology.orchestra.run.smithi162.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T03:15:52.968 INFO:teuthology.orchestra.run.smithi162.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T03:15:52.968 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T03:15:52.968 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T03:15:52.968 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T03:15:52.968 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T03:15:52.968 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T03:15:52.969 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T03:15:52.969 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T03:15:52.969 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T03:15:52.969 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T03:15:52.969 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T03:15:52.969 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T03:15:52.969 INFO:teuthology.orchestra.run.smithi162.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T03:15:52.969 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrading: 2024-09-21T03:15:52.969 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T03:15:52.970 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T03:15:52.970 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T03:15:52.970 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T03:15:52.970 INFO:teuthology.orchestra.run.smithi162.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T03:15:52.970 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T03:15:52.970 INFO:teuthology.orchestra.run.smithi162.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T03:15:52.970 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T03:15:52.971 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-09-21T03:15:52.971 INFO:teuthology.orchestra.run.smithi162.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T03:15:52.971 INFO:teuthology.orchestra.run.smithi162.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T03:15:52.971 INFO:teuthology.orchestra.run.smithi162.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T03:15:52.971 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T03:15:52.971 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T03:15:52.971 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T03:15:52.972 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T03:15:52.972 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T03:15:52.972 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T03:15:52.972 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T03:15:52.972 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T03:15:52.972 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T03:15:52.972 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T03:15:52.973 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T03:15:52.973 INFO:teuthology.orchestra.run.smithi162.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T03:15:52.973 INFO:teuthology.orchestra.run.smithi162.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T03:15:52.973 INFO:teuthology.orchestra.run.smithi162.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T03:15:52.973 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T03:15:52.973 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T03:15:52.973 INFO:teuthology.orchestra.run.smithi162.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T03:15:52.973 INFO:teuthology.orchestra.run.smithi162.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T03:15:52.973 INFO:teuthology.orchestra.run.smithi162.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T03:15:52.974 INFO:teuthology.orchestra.run.smithi162.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T03:15:52.974 INFO:teuthology.orchestra.run.smithi162.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T03:15:52.974 INFO:teuthology.orchestra.run.smithi162.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T03:15:52.974 INFO:teuthology.orchestra.run.smithi162.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T03:15:52.974 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T03:15:52.974 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T03:15:52.975 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T03:15:52.975 INFO:teuthology.orchestra.run.smithi162.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T03:15:52.975 INFO:teuthology.orchestra.run.smithi162.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T03:15:52.975 INFO:teuthology.orchestra.run.smithi162.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T03:15:52.975 INFO:teuthology.orchestra.run.smithi162.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T03:15:52.975 INFO:teuthology.orchestra.run.smithi162.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T03:15:52.975 INFO:teuthology.orchestra.run.smithi162.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T03:15:52.976 INFO:teuthology.orchestra.run.smithi162.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T03:15:52.976 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T03:15:52.976 INFO:teuthology.orchestra.run.smithi162.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T03:15:52.976 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T03:15:52.976 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T03:15:52.976 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T03:15:52.976 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T03:15:52.976 INFO:teuthology.orchestra.run.smithi162.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T03:15:52.976 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T03:15:52.977 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T03:15:52.977 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T03:15:52.977 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T03:15:52.977 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T03:15:52.977 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T03:15:52.977 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T03:15:52.977 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T03:15:52.977 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T03:15:52.977 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T03:15:52.977 INFO:teuthology.orchestra.run.smithi162.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T03:15:52.977 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T03:15:52.977 INFO:teuthology.orchestra.run.smithi162.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T03:15:52.977 INFO:teuthology.orchestra.run.smithi162.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T03:15:52.978 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T03:15:52.978 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T03:15:52.978 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T03:15:52.978 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T03:15:52.978 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T03:15:52.978 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T03:15:52.978 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T03:15:52.978 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T03:15:52.978 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T03:15:52.978 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T03:15:52.978 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T03:15:52.978 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T03:15:52.978 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T03:15:52.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T03:15:52.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T03:15:52.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T03:15:52.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T03:15:52.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T03:15:52.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T03:15:52.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T03:15:52.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T03:15:52.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T03:15:52.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T03:15:52.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T03:15:52.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T03:15:52.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T03:15:52.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T03:15:52.980 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T03:15:52.980 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T03:15:52.980 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T03:15:52.980 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T03:15:52.980 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T03:15:52.980 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T03:15:52.980 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T03:15:52.980 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T03:15:52.980 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T03:15:52.980 INFO:teuthology.orchestra.run.smithi162.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T03:15:52.980 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T03:15:52.980 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T03:15:52.980 INFO:teuthology.orchestra.run.smithi162.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T03:15:52.980 INFO:teuthology.orchestra.run.smithi162.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T03:15:52.981 INFO:teuthology.orchestra.run.smithi162.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T03:15:52.981 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T03:15:52.981 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T03:15:52.981 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T03:15:52.981 INFO:teuthology.orchestra.run.smithi162.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T03:15:52.981 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T03:15:52.981 INFO:teuthology.orchestra.run.smithi162.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T03:15:52.981 INFO:teuthology.orchestra.run.smithi162.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T03:15:52.981 INFO:teuthology.orchestra.run.smithi162.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T03:15:52.981 INFO:teuthology.orchestra.run.smithi162.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T03:15:52.981 INFO:teuthology.orchestra.run.smithi162.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T03:15:52.981 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T03:15:52.981 INFO:teuthology.orchestra.run.smithi162.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T03:15:52.981 INFO:teuthology.orchestra.run.smithi162.stdout:Installing weak dependencies: 2024-09-21T03:15:52.982 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T03:15:52.982 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:15:52.982 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-21T03:15:52.982 INFO:teuthology.orchestra.run.smithi162.stdout:======================================================================================= 2024-09-21T03:15:52.982 INFO:teuthology.orchestra.run.smithi162.stdout:Install 149 Packages 2024-09-21T03:15:52.982 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrade 8 Packages 2024-09-21T03:15:52.982 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:15:52.983 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 228 M 2024-09-21T03:15:52.983 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-21T03:15:52.983 INFO:teuthology.orchestra.run.smithi105.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T03:15:52.983 INFO:teuthology.orchestra.run.smithi105.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T03:15:52.984 INFO:teuthology.orchestra.run.smithi105.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T03:15:52.984 INFO:teuthology.orchestra.run.smithi105.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T03:15:52.984 INFO:teuthology.orchestra.run.smithi105.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T03:15:52.984 INFO:teuthology.orchestra.run.smithi105.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T03:15:52.986 INFO:teuthology.orchestra.run.smithi105.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T03:15:52.988 INFO:teuthology.orchestra.run.smithi105.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T03:15:52.989 INFO:teuthology.orchestra.run.smithi105.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T03:15:53.053 INFO:teuthology.orchestra.run.smithi105.stdout:Dependencies resolved. 2024-09-21T03:15:53.087 INFO:teuthology.orchestra.run.smithi105.stdout:======================================================================================= 2024-09-21T03:15:53.087 INFO:teuthology.orchestra.run.smithi105.stdout: Package Arch Version Repository Size 2024-09-21T03:15:53.088 INFO:teuthology.orchestra.run.smithi105.stdout:======================================================================================= 2024-09-21T03:15:53.088 INFO:teuthology.orchestra.run.smithi105.stdout:Installing: 2024-09-21T03:15:53.088 INFO:teuthology.orchestra.run.smithi105.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T03:15:53.088 INFO:teuthology.orchestra.run.smithi105.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T03:15:53.088 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T03:15:53.088 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T03:15:53.088 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T03:15:53.088 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T03:15:53.089 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T03:15:53.089 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T03:15:53.089 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T03:15:53.089 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T03:15:53.089 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T03:15:53.089 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T03:15:53.089 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T03:15:53.089 INFO:teuthology.orchestra.run.smithi105.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T03:15:53.089 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T03:15:53.090 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T03:15:53.090 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T03:15:53.090 INFO:teuthology.orchestra.run.smithi105.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T03:15:53.090 INFO:teuthology.orchestra.run.smithi105.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T03:15:53.090 INFO:teuthology.orchestra.run.smithi105.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T03:15:53.090 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T03:15:53.090 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T03:15:53.090 INFO:teuthology.orchestra.run.smithi105.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T03:15:53.091 INFO:teuthology.orchestra.run.smithi105.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T03:15:53.091 INFO:teuthology.orchestra.run.smithi105.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T03:15:53.091 INFO:teuthology.orchestra.run.smithi105.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T03:15:53.091 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T03:15:53.091 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T03:15:53.091 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T03:15:53.091 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T03:15:53.092 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T03:15:53.092 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T03:15:53.092 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T03:15:53.092 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T03:15:53.092 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T03:15:53.092 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T03:15:53.092 INFO:teuthology.orchestra.run.smithi105.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T03:15:53.092 INFO:teuthology.orchestra.run.smithi105.stdout:Upgrading: 2024-09-21T03:15:53.092 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T03:15:53.093 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T03:15:53.093 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T03:15:53.093 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T03:15:53.093 INFO:teuthology.orchestra.run.smithi105.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T03:15:53.093 INFO:teuthology.orchestra.run.smithi105.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T03:15:53.093 INFO:teuthology.orchestra.run.smithi105.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T03:15:53.093 INFO:teuthology.orchestra.run.smithi105.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T03:15:53.093 INFO:teuthology.orchestra.run.smithi105.stdout:Installing dependencies: 2024-09-21T03:15:53.093 INFO:teuthology.orchestra.run.smithi105.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T03:15:53.094 INFO:teuthology.orchestra.run.smithi105.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T03:15:53.094 INFO:teuthology.orchestra.run.smithi105.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T03:15:53.094 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T03:15:53.094 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T03:15:53.094 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T03:15:53.094 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T03:15:53.094 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T03:15:53.094 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T03:15:53.095 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T03:15:53.095 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T03:15:53.095 INFO:teuthology.orchestra.run.smithi105.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T03:15:53.095 INFO:teuthology.orchestra.run.smithi105.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T03:15:53.095 INFO:teuthology.orchestra.run.smithi105.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T03:15:53.095 INFO:teuthology.orchestra.run.smithi105.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T03:15:53.095 INFO:teuthology.orchestra.run.smithi105.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T03:15:53.095 INFO:teuthology.orchestra.run.smithi105.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T03:15:53.095 INFO:teuthology.orchestra.run.smithi105.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T03:15:53.096 INFO:teuthology.orchestra.run.smithi105.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T03:15:53.096 INFO:teuthology.orchestra.run.smithi105.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T03:15:53.096 INFO:teuthology.orchestra.run.smithi105.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T03:15:53.096 INFO:teuthology.orchestra.run.smithi105.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T03:15:53.096 INFO:teuthology.orchestra.run.smithi105.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T03:15:53.096 INFO:teuthology.orchestra.run.smithi105.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T03:15:53.096 INFO:teuthology.orchestra.run.smithi105.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T03:15:53.096 INFO:teuthology.orchestra.run.smithi105.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T03:15:53.096 INFO:teuthology.orchestra.run.smithi105.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T03:15:53.097 INFO:teuthology.orchestra.run.smithi105.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T03:15:53.097 INFO:teuthology.orchestra.run.smithi105.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T03:15:53.097 INFO:teuthology.orchestra.run.smithi105.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T03:15:53.097 INFO:teuthology.orchestra.run.smithi105.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T03:15:53.097 INFO:teuthology.orchestra.run.smithi105.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T03:15:53.097 INFO:teuthology.orchestra.run.smithi105.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T03:15:53.097 INFO:teuthology.orchestra.run.smithi105.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T03:15:53.097 INFO:teuthology.orchestra.run.smithi105.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T03:15:53.097 INFO:teuthology.orchestra.run.smithi105.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T03:15:53.098 INFO:teuthology.orchestra.run.smithi105.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T03:15:53.098 INFO:teuthology.orchestra.run.smithi105.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T03:15:53.098 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T03:15:53.098 INFO:teuthology.orchestra.run.smithi105.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T03:15:53.098 INFO:teuthology.orchestra.run.smithi105.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T03:15:53.098 INFO:teuthology.orchestra.run.smithi105.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T03:15:53.098 INFO:teuthology.orchestra.run.smithi105.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T03:15:53.098 INFO:teuthology.orchestra.run.smithi105.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T03:15:53.098 INFO:teuthology.orchestra.run.smithi105.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T03:15:53.099 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T03:15:53.099 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T03:15:53.099 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T03:15:53.099 INFO:teuthology.orchestra.run.smithi105.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T03:15:53.099 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T03:15:53.099 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T03:15:53.099 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T03:15:53.099 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T03:15:53.100 INFO:teuthology.orchestra.run.smithi105.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T03:15:53.100 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T03:15:53.100 INFO:teuthology.orchestra.run.smithi105.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T03:15:53.100 INFO:teuthology.orchestra.run.smithi105.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T03:15:53.100 INFO:teuthology.orchestra.run.smithi105.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T03:15:53.100 INFO:teuthology.orchestra.run.smithi105.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T03:15:53.100 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T03:15:53.100 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T03:15:53.100 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T03:15:53.101 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T03:15:53.101 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T03:15:53.101 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T03:15:53.101 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T03:15:53.101 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T03:15:53.101 INFO:teuthology.orchestra.run.smithi105.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T03:15:53.101 INFO:teuthology.orchestra.run.smithi105.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T03:15:53.101 INFO:teuthology.orchestra.run.smithi105.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T03:15:53.101 INFO:teuthology.orchestra.run.smithi105.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T03:15:53.102 INFO:teuthology.orchestra.run.smithi105.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T03:15:53.102 INFO:teuthology.orchestra.run.smithi105.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T03:15:53.102 INFO:teuthology.orchestra.run.smithi105.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T03:15:53.102 INFO:teuthology.orchestra.run.smithi105.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T03:15:53.102 INFO:teuthology.orchestra.run.smithi105.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T03:15:53.102 INFO:teuthology.orchestra.run.smithi105.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T03:15:53.102 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T03:15:53.102 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T03:15:53.102 INFO:teuthology.orchestra.run.smithi105.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T03:15:53.102 INFO:teuthology.orchestra.run.smithi105.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T03:15:53.102 INFO:teuthology.orchestra.run.smithi105.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T03:15:53.102 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T03:15:53.102 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T03:15:53.103 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T03:15:53.103 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T03:15:53.103 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T03:15:53.103 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T03:15:53.103 INFO:teuthology.orchestra.run.smithi105.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T03:15:53.103 INFO:teuthology.orchestra.run.smithi105.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T03:15:53.103 INFO:teuthology.orchestra.run.smithi105.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T03:15:53.103 INFO:teuthology.orchestra.run.smithi105.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T03:15:53.103 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T03:15:53.103 INFO:teuthology.orchestra.run.smithi105.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T03:15:53.103 INFO:teuthology.orchestra.run.smithi105.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T03:15:53.103 INFO:teuthology.orchestra.run.smithi105.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T03:15:53.103 INFO:teuthology.orchestra.run.smithi105.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T03:15:53.104 INFO:teuthology.orchestra.run.smithi105.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T03:15:53.104 INFO:teuthology.orchestra.run.smithi105.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T03:15:53.104 INFO:teuthology.orchestra.run.smithi105.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T03:15:53.104 INFO:teuthology.orchestra.run.smithi105.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T03:15:53.104 INFO:teuthology.orchestra.run.smithi105.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T03:15:53.104 INFO:teuthology.orchestra.run.smithi105.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T03:15:53.104 INFO:teuthology.orchestra.run.smithi105.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T03:15:53.104 INFO:teuthology.orchestra.run.smithi105.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T03:15:53.104 INFO:teuthology.orchestra.run.smithi105.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T03:15:53.104 INFO:teuthology.orchestra.run.smithi105.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T03:15:53.104 INFO:teuthology.orchestra.run.smithi105.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T03:15:53.104 INFO:teuthology.orchestra.run.smithi105.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T03:15:53.104 INFO:teuthology.orchestra.run.smithi105.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T03:15:53.105 INFO:teuthology.orchestra.run.smithi105.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T03:15:53.105 INFO:teuthology.orchestra.run.smithi105.stdout:Installing weak dependencies: 2024-09-21T03:15:53.105 INFO:teuthology.orchestra.run.smithi105.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T03:15:53.105 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:15:53.105 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction Summary 2024-09-21T03:15:53.105 INFO:teuthology.orchestra.run.smithi105.stdout:======================================================================================= 2024-09-21T03:15:53.105 INFO:teuthology.orchestra.run.smithi105.stdout:Install 149 Packages 2024-09-21T03:15:53.105 INFO:teuthology.orchestra.run.smithi105.stdout:Upgrade 8 Packages 2024-09-21T03:15:53.105 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:15:53.105 INFO:teuthology.orchestra.run.smithi105.stdout:Total download size: 228 M 2024-09-21T03:15:53.106 INFO:teuthology.orchestra.run.smithi105.stdout:Downloading Packages: 2024-09-21T03:15:53.492 INFO:teuthology.orchestra.run.smithi162.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 48 kB/s | 6.6 kB 00:00 2024-09-21T03:15:53.709 INFO:teuthology.orchestra.run.smithi162.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 3.9 MB/s | 873 kB 00:00 2024-09-21T03:15:53.722 INFO:teuthology.orchestra.run.smithi105.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 40 kB/s | 6.6 kB 00:00 2024-09-21T03:15:53.817 INFO:teuthology.orchestra.run.smithi162.stdout:(3/157): ceph-base-19.3.0-5120.g18432218.el9.x8 12 MB/s | 5.5 MB 00:00 2024-09-21T03:15:53.843 INFO:teuthology.orchestra.run.smithi162.stdout:(4/157): ceph-immutable-object-cache-19.3.0-512 1.1 MB/s | 148 kB 00:00 2024-09-21T03:15:53.976 INFO:teuthology.orchestra.run.smithi162.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 14 MB/s | 2.3 MB 00:00 2024-09-21T03:15:54.051 INFO:teuthology.orchestra.run.smithi162.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 7.3 MB/s | 1.5 MB 00:00 2024-09-21T03:15:54.310 INFO:teuthology.orchestra.run.smithi162.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 15 MB/s | 5.0 MB 00:00 2024-09-21T03:15:54.322 INFO:teuthology.orchestra.run.smithi105.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 1.4 MB/s | 873 kB 00:00 2024-09-21T03:15:54.397 INFO:teuthology.orchestra.run.smithi105.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.9 MB/s | 148 kB 00:00 2024-09-21T03:15:54.544 INFO:teuthology.orchestra.run.smithi162.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 17 MB/s | 20 MB 00:01 2024-09-21T03:15:54.585 INFO:teuthology.orchestra.run.smithi162.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 607 kB/s | 25 kB 00:00 2024-09-21T03:15:54.906 INFO:teuthology.orchestra.run.smithi105.stdout:(4/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 4.5 MB/s | 2.3 MB 00:00 2024-09-21T03:15:55.256 INFO:teuthology.orchestra.run.smithi105.stdout:(5/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 4.3 MB/s | 1.5 MB 00:00 2024-09-21T03:15:55.294 INFO:teuthology.orchestra.run.smithi162.stdout:(10/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 14 MB/s | 18 MB 00:01 2024-09-21T03:15:55.344 INFO:teuthology.orchestra.run.smithi162.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 4.4 MB/s | 226 kB 00:00 2024-09-21T03:15:55.420 INFO:teuthology.orchestra.run.smithi162.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 361 kB/s | 27 kB 00:00 2024-09-21T03:15:55.536 INFO:teuthology.orchestra.run.smithi162.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 272 kB/s | 32 kB 00:00 2024-09-21T03:15:55.565 INFO:teuthology.orchestra.run.smithi105.stdout:(6/157): ceph-base-19.3.0-5120.g18432218.el9.x8 2.7 MB/s | 5.5 MB 00:02 2024-09-21T03:15:55.628 INFO:teuthology.orchestra.run.smithi162.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 8.2 MB/s | 766 kB 00:00 2024-09-21T03:15:55.745 INFO:teuthology.orchestra.run.smithi162.stdout:(15/157): ceph-radosgw-19.3.0-5120.g18432218.el 7.3 MB/s | 10 MB 00:01 2024-09-21T03:15:55.770 INFO:teuthology.orchestra.run.smithi162.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 1.1 MB/s | 158 kB 00:00 2024-09-21T03:15:55.796 INFO:teuthology.orchestra.run.smithi162.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.5 MB/s | 127 kB 00:00 2024-09-21T03:15:55.807 INFO:teuthology.orchestra.run.smithi105.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 9.0 MB/s | 5.0 MB 00:00 2024-09-21T03:15:55.821 INFO:teuthology.orchestra.run.smithi162.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 9.9 MB/s | 507 kB 00:00 2024-09-21T03:15:55.871 INFO:teuthology.orchestra.run.smithi162.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 904 kB/s | 45 kB 00:00 2024-09-21T03:15:55.955 INFO:teuthology.orchestra.run.smithi162.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 1.7 MB/s | 148 kB 00:00 2024-09-21T03:15:56.039 INFO:teuthology.orchestra.run.smithi162.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 1.9 MB/s | 161 kB 00:00 2024-09-21T03:15:56.131 INFO:teuthology.orchestra.run.smithi162.stdout:(22/157): python3-rados-19.3.0-5120.g18432218.e 3.4 MB/s | 321 kB 00:00 2024-09-21T03:15:56.215 INFO:teuthology.orchestra.run.smithi162.stdout:(23/157): python3-rbd-19.3.0-5120.g18432218.el9 3.6 MB/s | 307 kB 00:00 2024-09-21T03:15:56.298 INFO:teuthology.orchestra.run.smithi162.stdout:(24/157): python3-rgw-19.3.0-5120.g18432218.el9 1.2 MB/s | 99 kB 00:00 2024-09-21T03:15:56.382 INFO:teuthology.orchestra.run.smithi162.stdout:(25/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.0 MB/s | 86 kB 00:00 2024-09-21T03:15:56.624 INFO:teuthology.orchestra.run.smithi105.stdout:(8/157): ceph-radosgw-19.3.0-5120.g18432218.el9 13 MB/s | 10 MB 00:00 2024-09-21T03:15:56.766 INFO:teuthology.orchestra.run.smithi162.stdout:(26/157): ceph-test-19.3.0-5120.g18432218.el9.x 18 MB/s | 40 MB 00:02 2024-09-21T03:15:56.816 INFO:teuthology.orchestra.run.smithi105.stdout:(9/157): ceph-common-19.3.0-5120.g18432218.el9. 6.1 MB/s | 20 MB 00:03 2024-09-21T03:15:56.841 INFO:teuthology.orchestra.run.smithi162.stdout:(27/157): librgw2-19.3.0-5120.g18432218.el9.x86 5.1 MB/s | 5.3 MB 00:01 2024-09-21T03:15:56.841 INFO:teuthology.orchestra.run.smithi105.stdout:(10/157): ceph-selinux-19.3.0-5120.g18432218.el 116 kB/s | 25 kB 00:00 2024-09-21T03:15:56.866 INFO:teuthology.orchestra.run.smithi162.stdout:(28/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 1.7 MB/s | 170 kB 00:00 2024-09-21T03:15:56.891 INFO:teuthology.orchestra.run.smithi105.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 4.4 MB/s | 226 kB 00:00 2024-09-21T03:15:56.892 INFO:teuthology.orchestra.run.smithi162.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 683 kB/s | 34 kB 00:00 2024-09-21T03:15:56.917 INFO:teuthology.orchestra.run.smithi162.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T03:15:56.941 INFO:teuthology.orchestra.run.smithi105.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 542 kB/s | 27 kB 00:00 2024-09-21T03:15:56.983 INFO:teuthology.orchestra.run.smithi105.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 763 kB/s | 32 kB 00:00 2024-09-21T03:15:57.000 INFO:teuthology.orchestra.run.smithi162.stdout:(31/157): rbd-mirror-19.3.0-5120.g18432218.el9. 5.0 MB/s | 3.1 MB 00:00 2024-09-21T03:15:57.075 INFO:teuthology.orchestra.run.smithi105.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 8.2 MB/s | 766 kB 00:00 2024-09-21T03:15:57.086 INFO:teuthology.orchestra.run.smithi162.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 3.4 MB/s | 292 kB 00:00 2024-09-21T03:15:57.134 INFO:teuthology.orchestra.run.smithi105.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 2.7 MB/s | 158 kB 00:00 2024-09-21T03:15:57.159 INFO:teuthology.orchestra.run.smithi162.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 661 kB/s | 49 kB 00:00 2024-09-21T03:15:57.209 INFO:teuthology.orchestra.run.smithi105.stdout:(16/157): librados-devel-19.3.0-5120.g18432218. 1.6 MB/s | 127 kB 00:00 2024-09-21T03:15:57.234 INFO:teuthology.orchestra.run.smithi162.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 219 kB/s | 16 kB 00:00 2024-09-21T03:15:57.268 INFO:teuthology.orchestra.run.smithi105.stdout:(17/157): libradosstriper1-19.3.0-5120.g1843221 8.5 MB/s | 507 kB 00:00 2024-09-21T03:15:57.318 INFO:teuthology.orchestra.run.smithi162.stdout:(35/157): ceph-mgr-diskprediction-local-19.3.0- 18 MB/s | 7.4 MB 00:00 2024-09-21T03:15:57.343 INFO:teuthology.orchestra.run.smithi162.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 2.6 MB/s | 285 kB 00:00 2024-09-21T03:15:57.402 INFO:teuthology.orchestra.run.smithi162.stdout:(37/157): cephadm-19.3.0-5120.g18432218.el9.noa 9.2 MB/s | 784 kB 00:00 2024-09-21T03:15:57.427 INFO:teuthology.orchestra.run.smithi162.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 220 kB/s | 18 kB 00:00 2024-09-21T03:15:57.552 INFO:teuthology.orchestra.run.smithi105.stdout:(18/157): librgw2-19.3.0-5120.g18432218.el9.x86 19 MB/s | 5.3 MB 00:00 2024-09-21T03:15:57.552 INFO:teuthology.orchestra.run.smithi162.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 532 kB/s | 80 kB 00:00 2024-09-21T03:15:57.610 INFO:teuthology.orchestra.run.smithi105.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 776 kB/s | 45 kB 00:00 2024-09-21T03:15:57.619 INFO:teuthology.orchestra.run.smithi162.stdout:(40/157): libgfortran-11.5.0-2.el9.x86_64.rpm 4.1 MB/s | 801 kB 00:00 2024-09-21T03:15:57.645 INFO:teuthology.orchestra.run.smithi162.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 191 kB 00:00 2024-09-21T03:15:57.660 INFO:teuthology.orchestra.run.smithi105.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 2.9 MB/s | 148 kB 00:00 2024-09-21T03:15:57.678 INFO:teuthology.orchestra.run.smithi162.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-09-21T03:15:57.711 INFO:teuthology.orchestra.run.smithi105.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 3.2 MB/s | 161 kB 00:00 2024-09-21T03:15:57.720 INFO:teuthology.orchestra.run.smithi162.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-21T03:15:57.762 INFO:teuthology.orchestra.run.smithi162.stdout:(44/157): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.2 MB 00:00 2024-09-21T03:15:57.769 INFO:teuthology.orchestra.run.smithi105.stdout:(22/157): python3-rados-19.3.0-5120.g18432218.e 5.4 MB/s | 321 kB 00:00 2024-09-21T03:15:57.787 INFO:teuthology.orchestra.run.smithi162.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-09-21T03:15:57.813 INFO:teuthology.orchestra.run.smithi162.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-21T03:15:57.828 INFO:teuthology.orchestra.run.smithi105.stdout:(23/157): python3-rbd-19.3.0-5120.g18432218.el9 5.1 MB/s | 307 kB 00:00 2024-09-21T03:15:57.838 INFO:teuthology.orchestra.run.smithi162.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-21T03:15:57.879 INFO:teuthology.orchestra.run.smithi105.stdout:(24/157): python3-rgw-19.3.0-5120.g18432218.el9 1.9 MB/s | 99 kB 00:00 2024-09-21T03:15:57.929 INFO:teuthology.orchestra.run.smithi105.stdout:(25/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T03:15:58.096 INFO:teuthology.orchestra.run.smithi105.stdout:(26/157): rbd-mirror-19.3.0-5120.g18432218.el9. 19 MB/s | 3.1 MB 00:00 2024-09-21T03:15:58.146 INFO:teuthology.orchestra.run.smithi105.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 3.3 MB/s | 170 kB 00:00 2024-09-21T03:15:58.164 INFO:teuthology.orchestra.run.smithi162.stdout:(48/157): ceph-mgr-dashboard-19.3.0-5120.g18432 11 MB/s | 14 MB 00:01 2024-09-21T03:15:58.196 INFO:teuthology.orchestra.run.smithi105.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 688 kB/s | 34 kB 00:00 2024-09-21T03:15:58.197 INFO:teuthology.orchestra.run.smithi162.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 1.8 MB/s | 689 kB 00:00 2024-09-21T03:15:58.247 INFO:teuthology.orchestra.run.smithi105.stdout:(29/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T03:15:58.281 INFO:teuthology.orchestra.run.smithi162.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 261 kB/s | 22 kB 00:00 2024-09-21T03:15:58.356 INFO:teuthology.orchestra.run.smithi162.stdout:(51/157): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 313 kB 00:00 2024-09-21T03:15:58.389 INFO:teuthology.orchestra.run.smithi162.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 1.7 MB/s | 943 kB 00:00 2024-09-21T03:15:58.409 INFO:teuthology.orchestra.run.smithi162.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 624 kB/s | 33 kB 00:00 2024-09-21T03:15:58.434 INFO:teuthology.orchestra.run.smithi162.stdout:(54/157): boost-program-options-1.75.0-8.el9.x8 396 kB/s | 107 kB 00:00 2024-09-21T03:15:58.468 INFO:teuthology.orchestra.run.smithi162.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 311 kB/s | 18 kB 00:00 2024-09-21T03:15:58.518 INFO:teuthology.orchestra.run.smithi162.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 133 kB/s | 11 kB 00:00 2024-09-21T03:15:58.577 INFO:teuthology.orchestra.run.smithi162.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.5 MB/s | 171 kB 00:00 2024-09-21T03:15:58.627 INFO:teuthology.orchestra.run.smithi162.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-09-21T03:15:58.660 INFO:teuthology.orchestra.run.smithi162.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 543 kB/s | 45 kB 00:00 2024-09-21T03:15:58.730 INFO:teuthology.orchestra.run.smithi105.stdout:(30/157): ceph-mgr-dashboard-19.3.0-5120.g18432 29 MB/s | 14 MB 00:00 2024-09-21T03:15:58.769 INFO:teuthology.orchestra.run.smithi162.stdout:(60/157): libtool-2.4.6-46.el9.x86_64.rpm 5.2 MB/s | 581 kB 00:00 2024-09-21T03:15:58.803 INFO:teuthology.orchestra.run.smithi162.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 3.7 MB/s | 662 kB 00:00 2024-09-21T03:15:58.870 INFO:teuthology.orchestra.run.smithi162.stdout:(62/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.2 MB/s | 3.0 MB 00:00 2024-09-21T03:15:58.895 INFO:teuthology.orchestra.run.smithi162.stdout:(63/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 195 kB/s | 24 kB 00:00 2024-09-21T03:15:58.922 INFO:teuthology.orchestra.run.smithi162.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 405 kB/s | 47 kB 00:00 2024-09-21T03:15:58.962 INFO:teuthology.orchestra.run.smithi162.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2024-09-21T03:15:58.987 INFO:teuthology.orchestra.run.smithi162.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 575 kB/s | 38 kB 00:00 2024-09-21T03:15:58.997 INFO:teuthology.orchestra.run.smithi105.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 28 MB/s | 7.4 MB 00:00 2024-09-21T03:15:59.021 INFO:teuthology.orchestra.run.smithi162.stdout:(67/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.9 MB/s | 292 kB 00:00 2024-09-21T03:15:59.164 INFO:teuthology.orchestra.run.smithi105.stdout:(32/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 5.0 MB/s | 18 MB 00:03 2024-09-21T03:15:59.171 INFO:teuthology.orchestra.run.smithi162.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 24 MB/s | 4.9 MB 00:00 2024-09-21T03:15:59.189 INFO:teuthology.orchestra.run.smithi105.stdout:(33/157): ceph-mgr-modules-core-19.3.0-5120.g18 1.5 MB/s | 292 kB 00:00 2024-09-21T03:15:59.215 INFO:teuthology.orchestra.run.smithi105.stdout:(34/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 989 kB/s | 49 kB 00:00 2024-09-21T03:15:59.230 INFO:teuthology.orchestra.run.smithi162.stdout:(69/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-09-21T03:15:59.240 INFO:teuthology.orchestra.run.smithi105.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 328 kB/s | 16 kB 00:00 2024-09-21T03:15:59.280 INFO:teuthology.orchestra.run.smithi162.stdout:(70/157): postgresql-13.16-1.el9.x86_64.rpm 6.1 MB/s | 1.6 MB 00:00 2024-09-21T03:15:59.290 INFO:teuthology.orchestra.run.smithi105.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 3.7 MB/s | 285 kB 00:00 2024-09-21T03:15:59.314 INFO:teuthology.orchestra.run.smithi162.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 1.6 MB/s | 137 kB 00:00 2024-09-21T03:15:59.333 INFO:teuthology.orchestra.run.smithi105.stdout:(37/157): cephadm-19.3.0-5120.g18432218.el9.noa 8.3 MB/s | 784 kB 00:00 2024-09-21T03:15:59.348 INFO:teuthology.orchestra.run.smithi162.stdout:(72/157): postgresql-contrib-13.16-1.el9.x86_64 5.1 MB/s | 910 kB 00:00 2024-09-21T03:15:59.358 INFO:teuthology.orchestra.run.smithi105.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 275 kB/s | 18 kB 00:00 2024-09-21T03:15:59.389 INFO:teuthology.orchestra.run.smithi162.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-21T03:15:59.415 INFO:teuthology.orchestra.run.smithi162.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-21T03:15:59.499 INFO:teuthology.orchestra.run.smithi162.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 736 kB/s | 61 kB 00:00 2024-09-21T03:15:59.500 INFO:teuthology.orchestra.run.smithi105.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 478 kB/s | 80 kB 00:00 2024-09-21T03:15:59.557 INFO:teuthology.orchestra.run.smithi162.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-09-21T03:15:59.583 INFO:teuthology.orchestra.run.smithi105.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-21T03:15:59.642 INFO:teuthology.orchestra.run.smithi105.stdout:(41/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 801 kB 00:00 2024-09-21T03:15:59.692 INFO:teuthology.orchestra.run.smithi105.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-09-21T03:15:59.724 INFO:teuthology.orchestra.run.smithi162.stdout:(77/157): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 6.0 MB 00:00 2024-09-21T03:15:59.742 INFO:teuthology.orchestra.run.smithi105.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-21T03:15:59.749 INFO:teuthology.orchestra.run.smithi162.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.3 MB/s | 248 kB 00:00 2024-09-21T03:15:59.809 INFO:teuthology.orchestra.run.smithi105.stdout:(44/157): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-09-21T03:15:59.833 INFO:teuthology.orchestra.run.smithi162.stdout:(79/157): postgresql-server-13.16-1.el9.x86_64. 10 MB/s | 5.8 MB 00:00 2024-09-21T03:15:59.867 INFO:teuthology.orchestra.run.smithi162.stdout:(80/157): python3-jsonpatch-1.21-16.el9.noarch. 180 kB/s | 26 kB 00:00 2024-09-21T03:15:59.868 INFO:teuthology.orchestra.run.smithi105.stdout:(45/157): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-21T03:15:59.892 INFO:teuthology.orchestra.run.smithi162.stdout:(81/157): python3-jsonpointer-2.0-4.el9.noarch. 134 kB/s | 19 kB 00:00 2024-09-21T03:15:59.927 INFO:teuthology.orchestra.run.smithi105.stdout:(46/157): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-21T03:15:59.951 INFO:teuthology.orchestra.run.smithi162.stdout:(82/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-21T03:15:59.976 INFO:teuthology.orchestra.run.smithi162.stdout:(83/157): python3-markupsafe-1.1.1-12.el9.x86_6 416 kB/s | 35 kB 00:00 2024-09-21T03:16:00.019 INFO:teuthology.orchestra.run.smithi105.stdout:(47/157): python3-cryptography-36.0.1-4.el9.x86 3.3 MB/s | 1.2 MB 00:00 2024-09-21T03:16:00.035 INFO:teuthology.orchestra.run.smithi162.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-09-21T03:16:00.060 INFO:teuthology.orchestra.run.smithi162.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-09-21T03:16:00.127 INFO:teuthology.orchestra.run.smithi162.stdout:(86/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 22 MB/s | 5.1 MB 00:00 2024-09-21T03:16:00.152 INFO:teuthology.orchestra.run.smithi162.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 459 kB/s | 42 kB 00:00 2024-09-21T03:16:00.178 INFO:teuthology.orchestra.run.smithi162.stdout:(88/157): python3-packaging-20.9-5.el9.noarch.r 541 kB/s | 77 kB 00:00 2024-09-21T03:16:00.211 INFO:teuthology.orchestra.run.smithi162.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-09-21T03:16:00.270 INFO:teuthology.orchestra.run.smithi162.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 3.0 MB/s | 279 kB 00:00 2024-09-21T03:16:00.295 INFO:teuthology.orchestra.run.smithi162.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 609 kB/s | 51 kB 00:00 2024-09-21T03:16:00.320 INFO:teuthology.orchestra.run.smithi162.stdout:(92/157): python3-protobuf-3.14.0-13.el9.noarch 1.4 MB/s | 269 kB 00:00 2024-09-21T03:16:00.362 INFO:teuthology.orchestra.run.smithi162.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 581 kB/s | 54 kB 00:00 2024-09-21T03:16:00.388 INFO:teuthology.orchestra.run.smithi162.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 621 kB/s | 42 kB 00:00 2024-09-21T03:16:00.455 INFO:teuthology.orchestra.run.smithi162.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 481 kB/s | 44 kB 00:00 2024-09-21T03:16:00.488 INFO:teuthology.orchestra.run.smithi162.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 2.2 MB/s | 221 kB 00:00 2024-09-21T03:16:00.530 INFO:teuthology.orchestra.run.smithi162.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 477 kB/s | 36 kB 00:00 2024-09-21T03:16:00.556 INFO:teuthology.orchestra.run.smithi162.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 706 kB/s | 47 kB 00:00 2024-09-21T03:16:00.577 INFO:teuthology.orchestra.run.smithi105.stdout:(48/157): ceph-test-19.3.0-5120.g18432218.el9.x 11 MB/s | 40 MB 00:03 2024-09-21T03:16:00.656 INFO:teuthology.orchestra.run.smithi162.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 2.4 MB/s | 304 kB 00:00 2024-09-21T03:16:00.681 INFO:teuthology.orchestra.run.smithi162.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 462 kB/s | 58 kB 00:00 2024-09-21T03:16:00.786 INFO:teuthology.orchestra.run.smithi105.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 802 kB/s | 689 kB 00:00 2024-09-21T03:16:00.848 INFO:teuthology.orchestra.run.smithi162.stdout:(101/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-09-21T03:16:00.873 INFO:teuthology.orchestra.run.smithi162.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 332 kB/s | 64 kB 00:00 2024-09-21T03:16:00.899 INFO:teuthology.orchestra.run.smithi162.stdout:(103/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 395 kB/s | 96 kB 00:00 2024-09-21T03:16:00.920 INFO:teuthology.orchestra.run.smithi105.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 162 kB/s | 22 kB 00:00 2024-09-21T03:16:00.932 INFO:teuthology.orchestra.run.smithi162.stdout:(104/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 535 kB/s | 45 kB 00:00 2024-09-21T03:16:00.999 INFO:teuthology.orchestra.run.smithi162.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 8.1 MB/s | 548 kB 00:00 2024-09-21T03:16:01.024 INFO:teuthology.orchestra.run.smithi162.stdout:(106/157): lua-devel-5.4.4-4.el9.x86_64.rpm 148 kB/s | 22 kB 00:00 2024-09-21T03:16:01.045 INFO:teuthology.orchestra.run.smithi105.stdout:(51/157): flex-2.6.4-9.el9.x86_64.rpm 2.5 MB/s | 313 kB 00:00 2024-09-21T03:16:01.075 INFO:teuthology.orchestra.run.smithi162.stdout:(107/157): gperftools-libs-2.9.1-3.el9.x86_64.r 4.0 MB/s | 308 kB 00:00 2024-09-21T03:16:01.109 INFO:teuthology.orchestra.run.smithi162.stdout:(108/157): grpc-data-1.46.7-10.el9.noarch.rpm 232 kB/s | 19 kB 00:00 2024-09-21T03:16:01.129 INFO:teuthology.orchestra.run.smithi105.stdout:(52/157): boost-program-options-1.75.0-8.el9.x8 194 kB/s | 107 kB 00:00 2024-09-21T03:16:01.134 INFO:teuthology.orchestra.run.smithi162.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-21T03:16:01.154 INFO:teuthology.orchestra.run.smithi105.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 301 kB/s | 33 kB 00:00 2024-09-21T03:16:01.168 INFO:teuthology.orchestra.run.smithi162.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-21T03:16:01.201 INFO:teuthology.orchestra.run.smithi162.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-21T03:16:01.229 INFO:teuthology.orchestra.run.smithi105.stdout:(54/157): bison-3.7.4-5.el9.x86_64.rpm 779 kB/s | 943 kB 00:01 2024-09-21T03:16:01.235 INFO:teuthology.orchestra.run.smithi162.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-21T03:16:01.263 INFO:teuthology.orchestra.run.smithi105.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 167 kB/s | 18 kB 00:00 2024-09-21T03:16:01.277 INFO:teuthology.orchestra.run.smithi162.stdout:(113/157): protobuf-compiler-3.14.0-13.el9.x86_ 2.2 MB/s | 863 kB 00:00 2024-09-21T03:16:01.327 INFO:teuthology.orchestra.run.smithi162.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-21T03:16:01.338 INFO:teuthology.orchestra.run.smithi105.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 102 kB/s | 11 kB 00:00 2024-09-21T03:16:01.380 INFO:teuthology.orchestra.run.smithi105.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.4 MB/s | 171 kB 00:00 2024-09-21T03:16:01.394 INFO:teuthology.orchestra.run.smithi162.stdout:(115/157): libarrow-9.0.0-11.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-09-21T03:16:01.420 INFO:teuthology.orchestra.run.smithi162.stdout:(116/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 483 kB/s | 43 kB 00:00 2024-09-21T03:16:01.445 INFO:teuthology.orchestra.run.smithi162.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 644 kB/s | 32 kB 00:00 2024-09-21T03:16:01.447 INFO:teuthology.orchestra.run.smithi105.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-09-21T03:16:01.470 INFO:teuthology.orchestra.run.smithi162.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-21T03:16:01.489 INFO:teuthology.orchestra.run.smithi105.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 416 kB/s | 45 kB 00:00 2024-09-21T03:16:01.495 INFO:teuthology.orchestra.run.smithi162.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-21T03:16:01.521 INFO:teuthology.orchestra.run.smithi162.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-21T03:16:01.546 INFO:teuthology.orchestra.run.smithi162.stdout:(121/157): python3-asyncssh-2.13.2-5.el9.noarch 2.0 MB/s | 548 kB 00:00 2024-09-21T03:16:01.572 INFO:teuthology.orchestra.run.smithi162.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-21T03:16:01.572 INFO:teuthology.orchestra.run.smithi105.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-09-21T03:16:01.605 INFO:teuthology.orchestra.run.smithi162.stdout:(123/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.7 MB/s | 303 kB 00:00 2024-09-21T03:16:01.631 INFO:teuthology.orchestra.run.smithi162.stdout:(124/157): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-09-21T03:16:01.656 INFO:teuthology.orchestra.run.smithi162.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2024-09-21T03:16:01.681 INFO:teuthology.orchestra.run.smithi162.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-21T03:16:01.706 INFO:teuthology.orchestra.run.smithi162.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-21T03:16:01.711 INFO:teuthology.orchestra.run.smithi105.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 177 kB/s | 24 kB 00:00 2024-09-21T03:16:01.732 INFO:teuthology.orchestra.run.smithi162.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-21T03:16:01.740 INFO:teuthology.orchestra.run.smithi105.stdout:(62/157): libtool-2.4.6-46.el9.x86_64.rpm 2.3 MB/s | 581 kB 00:00 2024-09-21T03:16:01.757 INFO:teuthology.orchestra.run.smithi162.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-09-21T03:16:01.782 INFO:teuthology.orchestra.run.smithi162.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T03:16:01.807 INFO:teuthology.orchestra.run.smithi105.stdout:(63/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.4 MB/s | 3.0 MB 00:00 2024-09-21T03:16:01.807 INFO:teuthology.orchestra.run.smithi162.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T03:16:01.832 INFO:teuthology.orchestra.run.smithi105.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 392 kB/s | 47 kB 00:00 2024-09-21T03:16:01.833 INFO:teuthology.orchestra.run.smithi162.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T03:16:01.857 INFO:teuthology.orchestra.run.smithi105.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-21T03:16:01.866 INFO:teuthology.orchestra.run.smithi162.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-21T03:16:01.892 INFO:teuthology.orchestra.run.smithi162.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 648 kB/s | 16 kB 00:00 2024-09-21T03:16:01.926 INFO:teuthology.orchestra.run.smithi162.stdout:(135/157): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-09-21T03:16:01.933 INFO:teuthology.orchestra.run.smithi105.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-09-21T03:16:01.951 INFO:teuthology.orchestra.run.smithi162.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-21T03:16:01.958 INFO:teuthology.orchestra.run.smithi105.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 307 kB/s | 38 kB 00:00 2024-09-21T03:16:01.976 INFO:teuthology.orchestra.run.smithi162.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-09-21T03:16:02.002 INFO:teuthology.orchestra.run.smithi162.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-21T03:16:02.027 INFO:teuthology.orchestra.run.smithi162.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T03:16:02.052 INFO:teuthology.orchestra.run.smithi162.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-21T03:16:02.078 INFO:teuthology.orchestra.run.smithi162.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 710 kB/s | 36 kB 00:00 2024-09-21T03:16:02.103 INFO:teuthology.orchestra.run.smithi162.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-21T03:16:02.162 INFO:teuthology.orchestra.run.smithi162.stdout:(143/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.3 MB/s | 2.0 MB 00:00 2024-09-21T03:16:02.192 INFO:teuthology.orchestra.run.smithi105.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 6.8 MB/s | 1.6 MB 00:00 2024-09-21T03:16:02.195 INFO:teuthology.orchestra.run.smithi162.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 977 kB/s | 90 kB 00:00 2024-09-21T03:16:02.220 INFO:teuthology.orchestra.run.smithi162.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.6 MB/s | 230 kB 00:00 2024-09-21T03:16:02.237 INFO:teuthology.orchestra.run.smithi162.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 479 kB/s | 20 kB 00:00 2024-09-21T03:16:02.271 INFO:teuthology.orchestra.run.smithi162.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T03:16:02.296 INFO:teuthology.orchestra.run.smithi162.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-09-21T03:16:02.325 INFO:teuthology.orchestra.run.smithi105.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 6.7 MB/s | 910 kB 00:00 2024-09-21T03:16:02.347 INFO:teuthology.orchestra.run.smithi162.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-21T03:16:02.450 INFO:teuthology.orchestra.run.smithi105.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-09-21T03:16:02.530 INFO:teuthology.orchestra.run.smithi162.stdout:(150/157): NetworkManager-1.51.0-1.el9.x86_64.r 13 MB/s | 2.3 MB 00:00 2024-09-21T03:16:02.597 INFO:teuthology.orchestra.run.smithi162.stdout:(151/157): NetworkManager-libnm-1.51.0-1.el9.x8 27 MB/s | 1.8 MB 00:00 2024-09-21T03:16:02.639 INFO:teuthology.orchestra.run.smithi162.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 983 kB/s | 41 kB 00:00 2024-09-21T03:16:02.681 INFO:teuthology.orchestra.run.smithi162.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 5.8 MB/s | 249 kB 00:00 2024-09-21T03:16:02.740 INFO:teuthology.orchestra.run.smithi162.stdout:(154/157): openssl-3.2.2-6.el9.x86_64.rpm 23 MB/s | 1.4 MB 00:00 2024-09-21T03:16:02.824 INFO:teuthology.orchestra.run.smithi162.stdout:(155/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 29 MB/s | 2.4 MB 00:00 2024-09-21T03:16:02.924 INFO:teuthology.orchestra.run.smithi162.stdout:(156/157): librados2-19.3.0-5120.g18432218.el9. 5.2 MB/s | 3.4 MB 00:00 2024-09-21T03:16:02.999 INFO:teuthology.orchestra.run.smithi162.stdout:(157/157): librbd1-19.3.0-5120.g18432218.el9.x8 4.5 MB/s | 3.2 MB 00:00 2024-09-21T03:16:03.005 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-21T03:16:03.005 INFO:teuthology.orchestra.run.smithi162.stdout:Total 23 MB/s | 228 MB 00:10 2024-09-21T03:16:04.255 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-21T03:16:04.412 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-21T03:16:04.412 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-21T03:16:05.684 INFO:teuthology.orchestra.run.smithi105.stdout:(71/157): openblas-openmp-0.3.26-2.el9.x86_64.r 1.3 MB/s | 4.9 MB 00:03 2024-09-21T03:16:05.926 INFO:teuthology.orchestra.run.smithi105.stdout:(72/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 1.1 MB/s | 4.4 MB 00:03 2024-09-21T03:16:06.117 INFO:teuthology.orchestra.run.smithi105.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 456 kB/s | 87 kB 00:00 2024-09-21T03:16:06.658 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-21T03:16:06.658 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-21T03:16:07.518 INFO:teuthology.orchestra.run.smithi105.stdout:(74/157): protobuf-3.14.0-13.el9.x86_64.rpm 563 kB/s | 1.0 MB 00:01 2024-09-21T03:16:07.643 INFO:teuthology.orchestra.run.smithi105.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 491 kB/s | 61 kB 00:00 2024-09-21T03:16:07.810 INFO:teuthology.orchestra.run.smithi105.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.4 MB/s | 245 kB 00:00 2024-09-21T03:16:07.927 INFO:teuthology.orchestra.run.smithi105.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 2.1 MB/s | 248 kB 00:00 2024-09-21T03:16:08.052 INFO:teuthology.orchestra.run.smithi105.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 205 kB/s | 26 kB 00:00 2024-09-21T03:16:08.203 INFO:teuthology.orchestra.run.smithi105.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 128 kB/s | 19 kB 00:00 2024-09-21T03:16:08.320 INFO:teuthology.orchestra.run.smithi105.stdout:(80/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-21T03:16:08.445 INFO:teuthology.orchestra.run.smithi105.stdout:(81/157): postgresql-server-13.16-1.el9.x86_64. 987 kB/s | 5.8 MB 00:05 2024-09-21T03:16:08.470 INFO:teuthology.orchestra.run.smithi105.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 231 kB/s | 35 kB 00:00 2024-09-21T03:16:08.587 INFO:teuthology.orchestra.run.smithi105.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-09-21T03:16:08.704 INFO:teuthology.orchestra.run.smithi105.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.9 MB/s | 222 kB 00:00 2024-09-21T03:16:08.813 INFO:teuthology.orchestra.run.smithi105.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 711 kB/s | 77 kB 00:00 2024-09-21T03:16:08.922 INFO:teuthology.orchestra.run.smithi105.stdout:(86/157): python3-prettytable-0.7.2-27.el9.noar 390 kB/s | 42 kB 00:00 2024-09-21T03:16:09.038 INFO:teuthology.orchestra.run.smithi105.stdout:(87/157): python3-protobuf-3.14.0-13.el9.noarch 2.3 MB/s | 269 kB 00:00 2024-09-21T03:16:09.155 INFO:teuthology.orchestra.run.smithi105.stdout:(88/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-21T03:16:09.423 INFO:teuthology.orchestra.run.smithi105.stdout:(89/157): python3-pyasn1-modules-0.4.8-6.el9.no 1.0 MB/s | 279 kB 00:00 2024-09-21T03:16:09.531 INFO:teuthology.orchestra.run.smithi105.stdout:(90/157): python3-pytz-2021.1-5.el9.noarch.rpm 471 kB/s | 51 kB 00:00 2024-09-21T03:16:09.640 INFO:teuthology.orchestra.run.smithi105.stdout:(91/157): python3-requests-oauthlib-1.3.0-12.el 495 kB/s | 54 kB 00:00 2024-09-21T03:16:13.055 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-21T03:16:13.194 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T03:16:13.291 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T03:16:13.481 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T03:16:13.520 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T03:16:13.546 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T03:16:13.608 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T03:16:13.964 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T03:16:14.080 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:16:14.212 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:16:14.236 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:16:14.328 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:16:14.358 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T03:16:14.388 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T03:16:14.572 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T03:16:14.631 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T03:16:14.667 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:16:14.779 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:16:14.810 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T03:16:14.868 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T03:16:14.903 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T03:16:14.930 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T03:16:15.056 INFO:teuthology.orchestra.run.smithi105.stdout:(92/157): python3-babel-2.9.1-2.el9.noarch.rpm 683 kB/s | 6.0 MB 00:08 2024-09-21T03:16:15.071 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T03:16:15.165 INFO:teuthology.orchestra.run.smithi105.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 385 kB/s | 42 kB 00:00 2024-09-21T03:16:15.265 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T03:16:15.273 INFO:teuthology.orchestra.run.smithi105.stdout:(94/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 407 kB/s | 44 kB 00:00 2024-09-21T03:16:15.390 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T03:16:15.490 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:16:15.587 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:16:15.657 INFO:teuthology.orchestra.run.smithi105.stdout:(95/157): qatlib-24.02.0-1.el9.x86_64.rpm 576 kB/s | 221 kB 00:00 2024-09-21T03:16:15.766 INFO:teuthology.orchestra.run.smithi105.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 331 kB/s | 36 kB 00:00 2024-09-21T03:16:15.832 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:16:15.833 INFO:teuthology.orchestra.run.smithi105.stdout:(97/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 707 kB/s | 5.1 MB 00:07 2024-09-21T03:16:15.875 INFO:teuthology.orchestra.run.smithi105.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 436 kB/s | 47 kB 00:00 2024-09-21T03:16:15.944 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T03:16:15.983 INFO:teuthology.orchestra.run.smithi105.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 534 kB/s | 58 kB 00:00 2024-09-21T03:16:16.114 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T03:16:16.183 INFO:teuthology.orchestra.run.smithi105.stdout:(100/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 479 kB/s | 96 kB 00:00 2024-09-21T03:16:16.300 INFO:teuthology.orchestra.run.smithi105.stdout:(101/157): socat-1.7.4.1-6.el9.x86_64.rpm 651 kB/s | 304 kB 00:00 2024-09-21T03:16:16.301 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T03:16:16.373 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T03:16:16.417 INFO:teuthology.orchestra.run.smithi105.stdout:(102/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 384 kB/s | 45 kB 00:00 2024-09-21T03:16:16.418 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T03:16:16.442 INFO:teuthology.orchestra.run.smithi105.stdout:(103/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 246 kB/s | 64 kB 00:00 2024-09-21T03:16:16.450 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T03:16:16.502 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T03:16:16.526 INFO:teuthology.orchestra.run.smithi105.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-09-21T03:16:16.544 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T03:16:16.580 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T03:16:16.585 INFO:teuthology.orchestra.run.smithi105.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-21T03:16:16.618 INFO:teuthology.orchestra.run.smithi105.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-21T03:16:16.644 INFO:teuthology.orchestra.run.smithi105.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 780 kB/s | 19 kB 00:00 2024-09-21T03:16:16.648 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T03:16:16.702 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T03:16:16.733 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T03:16:16.752 INFO:teuthology.orchestra.run.smithi105.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-09-21T03:16:16.768 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T03:16:16.769 INFO:teuthology.orchestra.run.smithi105.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.5 MB/s | 26 kB 00:00 2024-09-21T03:16:16.803 INFO:teuthology.orchestra.run.smithi105.stdout:(110/157): protobuf-compiler-3.14.0-13.el9.x86_ 2.3 MB/s | 863 kB 00:00 2024-09-21T03:16:16.820 INFO:teuthology.orchestra.run.smithi105.stdout:(111/157): liboath-2.6.7-2.el9.x86_64.rpm 968 kB/s | 49 kB 00:00 2024-09-21T03:16:16.848 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T03:16:16.862 INFO:teuthology.orchestra.run.smithi105.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.3 MB/s | 151 kB 00:00 2024-09-21T03:16:16.887 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T03:16:16.895 INFO:teuthology.orchestra.run.smithi105.stdout:(113/157): libunwind-1.6.2-1.el9.x86_64.rpm 730 kB/s | 67 kB 00:00 2024-09-21T03:16:16.921 INFO:teuthology.orchestra.run.smithi105.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-21T03:16:16.930 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T03:16:16.946 INFO:teuthology.orchestra.run.smithi105.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T03:16:16.959 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T03:16:16.971 INFO:teuthology.orchestra.run.smithi105.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T03:16:16.996 INFO:teuthology.orchestra.run.smithi105.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 570 kB/s | 14 kB 00:00 2024-09-21T03:16:17.022 INFO:teuthology.orchestra.run.smithi105.stdout:(118/157): python3-asyncssh-2.13.2-5.el9.noarch 4.2 MB/s | 548 kB 00:00 2024-09-21T03:16:17.028 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T03:16:17.047 INFO:teuthology.orchestra.run.smithi105.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-21T03:16:17.072 INFO:teuthology.orchestra.run.smithi105.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-21T03:16:17.083 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T03:16:17.097 INFO:teuthology.orchestra.run.smithi105.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-21T03:16:17.123 INFO:teuthology.orchestra.run.smithi105.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-21T03:16:17.157 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T03:16:17.165 INFO:teuthology.orchestra.run.smithi105.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2024-09-21T03:16:17.190 INFO:teuthology.orchestra.run.smithi105.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-21T03:16:17.215 INFO:teuthology.orchestra.run.smithi105.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 713 kB/s | 18 kB 00:00 2024-09-21T03:16:17.241 INFO:teuthology.orchestra.run.smithi105.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 923 kB/s | 23 kB 00:00 2024-09-21T03:16:17.266 INFO:teuthology.orchestra.run.smithi105.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 780 kB/s | 19 kB 00:00 2024-09-21T03:16:17.288 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T03:16:17.291 INFO:teuthology.orchestra.run.smithi105.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 794 kB/s | 20 kB 00:00 2024-09-21T03:16:17.342 INFO:teuthology.orchestra.run.smithi105.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 8.4 MB/s | 2.0 MB 00:00 2024-09-21T03:16:17.344 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T03:16:17.396 INFO:teuthology.orchestra.run.smithi105.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 856 kB/s | 46 kB 00:00 2024-09-21T03:16:17.426 INFO:teuthology.orchestra.run.smithi105.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 2.6 MB/s | 79 kB 00:00 2024-09-21T03:16:17.451 INFO:teuthology.orchestra.run.smithi105.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T03:16:17.485 INFO:teuthology.orchestra.run.smithi105.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-21T03:16:17.510 INFO:teuthology.orchestra.run.smithi105.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 662 kB/s | 16 kB 00:00 2024-09-21T03:16:17.562 INFO:teuthology.orchestra.run.smithi105.stdout:(135/157): python3-kubernetes-26.1.0-2.el9.noar 3.8 MB/s | 1.0 MB 00:00 2024-09-21T03:16:17.587 INFO:teuthology.orchestra.run.smithi105.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.1 MB/s | 90 kB 00:00 2024-09-21T03:16:17.612 INFO:teuthology.orchestra.run.smithi105.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-21T03:16:17.637 INFO:teuthology.orchestra.run.smithi105.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-21T03:16:17.663 INFO:teuthology.orchestra.run.smithi105.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T03:16:17.688 INFO:teuthology.orchestra.run.smithi105.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-21T03:16:17.713 INFO:teuthology.orchestra.run.smithi105.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-21T03:16:17.738 INFO:teuthology.orchestra.run.smithi105.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-21T03:16:17.764 INFO:teuthology.orchestra.run.smithi105.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-21T03:16:17.798 INFO:teuthology.orchestra.run.smithi105.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-21T03:16:17.814 INFO:teuthology.orchestra.run.smithi105.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-21T03:16:17.840 INFO:teuthology.orchestra.run.smithi105.stdout:(146/157): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-21T03:16:17.865 INFO:teuthology.orchestra.run.smithi105.stdout:(147/157): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-09-21T03:16:17.872 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T03:16:17.915 INFO:teuthology.orchestra.run.smithi105.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-21T03:16:17.956 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T03:16:17.985 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T03:16:18.028 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T03:16:18.066 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T03:16:18.117 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T03:16:18.141 INFO:teuthology.orchestra.run.smithi105.stdout:(149/157): librados2-19.3.0-5120.g18432218.el9. 12 MB/s | 3.4 MB 00:00 2024-09-21T03:16:18.291 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T03:16:18.353 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T03:16:18.374 INFO:teuthology.orchestra.run.smithi105.stdout:(150/157): librbd1-19.3.0-5120.g18432218.el9.x8 6.9 MB/s | 3.2 MB 00:00 2024-09-21T03:16:18.444 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T03:16:18.509 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T03:16:18.758 INFO:teuthology.orchestra.run.smithi105.stdout:(151/157): NetworkManager-libnm-1.51.0-1.el9.x8 4.7 MB/s | 1.8 MB 00:00 2024-09-21T03:16:18.793 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T03:16:18.808 INFO:teuthology.orchestra.run.smithi105.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 824 kB/s | 41 kB 00:00 2024-09-21T03:16:18.831 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T03:16:18.867 INFO:teuthology.orchestra.run.smithi105.stdout:(153/157): NetworkManager-1.51.0-1.el9.x86_64.r 3.2 MB/s | 2.3 MB 00:00 2024-09-21T03:16:18.867 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T03:16:18.914 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T03:16:18.950 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T03:16:18.950 INFO:teuthology.orchestra.run.smithi105.stdout:(154/157): NetworkManager-tui-1.51.0-1.el9.x86_ 1.7 MB/s | 249 kB 00:00 2024-09-21T03:16:18.993 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T03:16:19.036 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T03:16:19.171 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T03:16:19.212 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T03:16:19.261 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T03:16:19.365 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T03:16:19.404 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T03:16:19.445 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T03:16:19.478 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T03:16:19.503 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T03:16:19.567 INFO:teuthology.orchestra.run.smithi105.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 1.9 MB/s | 1.4 MB 00:00 2024-09-21T03:16:19.594 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T03:16:19.721 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T03:16:19.760 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T03:16:19.788 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T03:16:19.822 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T03:16:19.870 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T03:16:19.902 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T03:16:19.932 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T03:16:19.966 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T03:16:20.000 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T03:16:20.045 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T03:16:20.080 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T03:16:20.134 INFO:teuthology.orchestra.run.smithi105.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.0 MB/s | 2.4 MB 00:01 2024-09-21T03:16:20.167 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T03:16:20.210 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T03:16:20.242 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T03:16:20.345 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T03:16:20.401 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T03:16:21.010 INFO:teuthology.orchestra.run.smithi105.stdout:(157/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 1.4 MB/s | 16 MB 00:11 2024-09-21T03:16:21.014 INFO:teuthology.orchestra.run.smithi105.stdout:-------------------------------------------------------------------------------- 2024-09-21T03:16:21.015 INFO:teuthology.orchestra.run.smithi105.stdout:Total 8.2 MB/s | 228 MB 00:27 2024-09-21T03:16:21.132 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T03:16:21.173 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T03:16:21.216 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T03:16:21.314 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T03:16:21.363 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T03:16:21.408 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T03:16:21.503 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T03:16:21.552 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T03:16:21.736 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T03:16:21.766 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T03:16:21.851 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T03:16:22.270 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction check 2024-09-21T03:16:22.424 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction check succeeded. 2024-09-21T03:16:22.424 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction test 2024-09-21T03:16:22.504 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T03:16:22.621 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T03:16:23.893 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T03:16:23.978 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T03:16:24.013 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T03:16:24.055 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T03:16:24.383 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T03:16:24.427 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T03:16:24.511 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T03:16:24.540 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T03:16:24.576 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T03:16:24.682 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction test succeeded. 2024-09-21T03:16:24.682 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction 2024-09-21T03:16:25.078 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T03:16:25.105 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T03:16:25.196 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T03:16:25.223 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T03:16:27.511 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:16:27.545 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:16:28.121 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:16:28.165 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T03:16:28.254 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T03:16:28.254 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T03:16:28.254 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T03:16:28.254 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:16:28.292 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T03:16:31.005 INFO:teuthology.orchestra.run.smithi105.stdout: Preparing : 1/1 2024-09-21T03:16:31.139 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T03:16:31.177 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T03:16:31.240 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T03:16:31.273 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T03:16:31.298 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T03:16:31.347 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T03:16:31.697 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T03:16:31.824 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:16:31.952 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:16:31.975 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:16:32.067 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:16:32.089 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T03:16:32.118 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T03:16:32.286 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T03:16:32.336 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T03:16:32.364 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:16:32.470 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:16:32.498 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T03:16:32.561 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T03:16:32.591 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T03:16:32.613 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T03:16:32.810 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T03:16:32.979 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T03:16:33.106 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T03:16:33.217 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:16:33.291 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:16:33.524 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:16:33.628 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T03:16:33.654 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T03:16:33.679 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T03:16:33.744 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T03:16:33.797 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T03:16:33.830 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T03:16:33.872 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T03:16:33.906 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T03:16:33.933 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T03:16:34.002 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T03:16:34.055 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T03:16:34.087 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T03:16:34.130 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T03:16:34.211 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T03:16:34.240 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T03:16:34.284 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T03:16:34.313 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T03:16:34.381 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T03:16:34.435 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T03:16:34.509 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T03:16:34.641 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T03:16:34.696 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T03:16:35.212 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T03:16:35.299 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T03:16:35.329 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T03:16:35.372 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T03:16:35.410 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T03:16:35.461 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T03:16:35.640 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T03:16:35.705 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T03:16:35.795 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T03:16:35.860 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T03:16:35.941 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T03:16:35.973 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T03:16:36.001 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T03:16:36.047 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T03:16:36.083 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T03:16:36.126 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T03:16:36.169 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T03:16:36.302 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T03:16:36.345 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T03:16:36.397 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T03:16:36.499 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T03:16:36.533 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T03:16:36.574 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T03:16:36.606 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T03:16:36.631 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T03:16:36.720 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T03:16:36.848 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T03:16:36.880 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T03:16:36.908 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T03:16:36.942 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T03:16:36.981 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T03:16:37.013 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T03:16:37.043 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T03:16:37.077 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T03:16:37.111 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T03:16:37.143 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T03:16:37.178 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T03:16:37.265 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T03:16:37.308 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T03:16:37.340 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T03:16:37.442 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T03:16:37.490 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T03:16:38.212 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T03:16:38.256 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T03:16:38.289 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T03:16:38.387 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T03:16:38.436 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T03:16:38.480 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T03:16:38.567 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T03:16:38.609 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T03:16:38.793 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T03:16:38.831 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T03:16:38.909 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T03:16:39.542 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T03:16:39.646 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T03:16:40.136 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T03:16:40.136 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /sys 2024-09-21T03:16:40.136 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /proc 2024-09-21T03:16:40.137 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /mnt 2024-09-21T03:16:40.137 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /var/tmp 2024-09-21T03:16:40.137 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /home 2024-09-21T03:16:40.137 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /root 2024-09-21T03:16:40.137 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /tmp 2024-09-21T03:16:40.137 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:16:40.308 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T03:16:40.325 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T03:16:40.325 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:16:40.325 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T03:16:40.325 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:16:40.897 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T03:16:40.979 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T03:16:41.007 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T03:16:41.040 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T03:16:41.370 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T03:16:41.436 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T03:16:41.528 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T03:16:41.558 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T03:16:41.594 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T03:16:41.912 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T03:16:41.941 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T03:16:41.941 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:16:41.941 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T03:16:41.941 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T03:16:41.941 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T03:16:41.941 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:16:42.096 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T03:16:42.122 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T03:16:42.162 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T03:16:42.186 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T03:16:42.186 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:16:42.186 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T03:16:42.186 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T03:16:42.186 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T03:16:42.186 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:16:42.193 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T03:16:42.216 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T03:16:42.654 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T03:16:42.678 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T03:16:42.678 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:16:42.679 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T03:16:42.679 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T03:16:42.679 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T03:16:42.679 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:16:42.785 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T03:16:42.842 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T03:16:42.898 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T03:16:43.083 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T03:16:43.131 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T03:16:43.209 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T03:16:43.298 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T03:16:43.445 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T03:16:43.481 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T03:16:43.522 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T03:16:43.558 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T03:16:44.009 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T03:16:44.040 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T03:16:44.073 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T03:16:44.167 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T03:16:44.197 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T03:16:44.534 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:16:44.604 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:16:45.186 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:16:45.224 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T03:16:45.315 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T03:16:45.316 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T03:16:45.316 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T03:16:45.316 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:16:45.359 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T03:16:47.407 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T03:16:47.461 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T03:16:48.431 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T03:16:48.462 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T03:16:48.576 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T03:16:48.745 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T03:16:48.772 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T03:16:48.796 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T03:16:48.797 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:16:48.797 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T03:16:48.797 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T03:16:48.797 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T03:16:48.797 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:16:48.848 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T03:16:48.859 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T03:16:48.959 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T03:16:49.011 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T03:16:49.975 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T03:16:50.009 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T03:16:50.033 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T03:16:50.033 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:16:50.033 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T03:16:50.033 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T03:16:50.033 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T03:16:50.034 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:16:50.076 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T03:16:50.099 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T03:16:50.099 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:16:50.099 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T03:16:50.100 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:16:50.152 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T03:16:50.176 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T03:16:50.176 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:16:50.176 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T03:16:50.176 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T03:16:50.176 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T03:16:50.177 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:16:50.494 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T03:16:50.518 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T03:16:50.518 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:16:50.519 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T03:16:50.519 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T03:16:50.519 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T03:16:50.519 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:16:54.557 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T03:16:54.598 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T03:16:54.638 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T03:16:54.671 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T03:16:54.698 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T03:16:54.896 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T03:16:54.937 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T03:16:54.967 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T03:16:54.997 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T03:16:55.043 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T03:16:55.632 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:16:55.667 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:16:55.687 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:16:56.531 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T03:16:56.623 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T03:16:56.667 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T03:16:56.765 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T03:16:56.801 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T03:16:56.826 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T03:16:56.852 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T03:16:56.852 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T03:16:56.937 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T03:16:56.937 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T03:16:57.012 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T03:16:57.037 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T03:16:57.043 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:16:57.043 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:16:57.231 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:16:57.231 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T03:16:57.310 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T03:16:57.310 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /sys 2024-09-21T03:16:57.310 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /proc 2024-09-21T03:16:57.310 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /mnt 2024-09-21T03:16:57.310 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /var/tmp 2024-09-21T03:16:57.310 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /home 2024-09-21T03:16:57.311 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /root 2024-09-21T03:16:57.311 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /tmp 2024-09-21T03:16:57.311 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:16:57.315 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T03:16:57.380 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:16:57.478 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T03:16:57.499 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T03:16:57.499 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:16:57.499 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T03:16:57.499 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:16:59.131 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T03:16:59.159 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T03:16:59.159 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:16:59.159 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T03:16:59.159 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T03:16:59.159 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T03:16:59.159 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:16:59.399 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T03:16:59.423 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T03:16:59.423 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:16:59.423 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T03:16:59.423 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T03:16:59.423 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T03:16:59.423 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:16:59.900 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T03:16:59.923 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T03:16:59.923 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:16:59.923 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T03:16:59.923 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T03:16:59.923 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T03:16:59.924 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:17:00.022 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T03:17:00.070 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T03:17:00.125 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T03:17:00.321 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T03:17:00.417 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T03:17:00.495 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T03:17:00.583 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T03:17:00.732 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T03:17:00.768 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T03:17:00.800 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T03:17:00.827 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T03:17:01.179 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T03:17:01.209 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T03:17:01.242 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T03:17:01.308 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T03:17:01.332 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T03:17:03.627 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:17:03.628 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T03:17:03.628 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T03:17:03.628 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T03:17:03.628 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T03:17:03.628 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T03:17:03.628 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T03:17:03.628 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T03:17:03.628 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:17:03.628 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:17:03.628 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T03:17:03.628 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T03:17:03.629 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T03:17:03.629 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T03:17:03.629 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:17:03.629 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T03:17:03.629 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T03:17:03.629 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T03:17:03.629 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T03:17:03.629 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T03:17:03.629 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T03:17:03.629 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T03:17:03.629 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T03:17:03.629 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T03:17:03.629 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T03:17:03.630 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T03:17:03.630 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T03:17:03.630 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T03:17:03.630 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T03:17:03.630 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T03:17:03.630 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T03:17:03.630 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T03:17:03.630 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T03:17:03.630 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T03:17:03.630 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T03:17:03.630 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T03:17:03.630 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T03:17:03.630 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T03:17:03.631 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T03:17:03.631 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T03:17:03.631 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T03:17:03.631 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T03:17:03.631 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T03:17:03.631 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T03:17:03.631 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T03:17:03.631 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T03:17:03.631 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T03:17:03.631 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T03:17:03.631 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T03:17:03.631 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T03:17:03.631 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T03:17:03.632 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T03:17:03.632 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T03:17:03.632 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T03:17:03.632 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T03:17:03.632 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T03:17:03.632 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T03:17:03.632 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T03:17:03.632 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T03:17:03.632 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T03:17:03.632 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T03:17:03.632 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T03:17:03.632 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T03:17:03.632 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T03:17:03.633 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T03:17:03.633 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T03:17:03.633 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T03:17:03.633 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T03:17:03.633 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T03:17:03.633 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T03:17:03.633 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T03:17:03.633 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T03:17:03.633 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T03:17:03.633 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T03:17:03.633 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T03:17:03.633 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T03:17:03.633 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T03:17:03.634 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T03:17:03.634 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T03:17:03.634 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T03:17:03.634 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T03:17:03.634 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T03:17:03.634 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T03:17:03.634 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T03:17:03.634 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T03:17:03.634 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T03:17:03.634 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T03:17:03.634 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T03:17:03.634 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T03:17:03.634 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T03:17:03.635 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T03:17:03.635 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T03:17:03.635 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T03:17:03.635 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T03:17:03.635 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T03:17:03.635 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T03:17:03.635 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T03:17:03.635 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T03:17:03.635 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T03:17:03.635 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T03:17:03.635 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T03:17:03.635 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T03:17:03.635 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T03:17:03.636 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T03:17:03.636 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T03:17:03.636 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T03:17:03.636 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T03:17:03.636 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T03:17:03.636 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T03:17:03.636 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T03:17:03.636 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T03:17:03.636 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T03:17:03.636 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T03:17:03.636 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T03:17:03.636 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T03:17:03.636 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T03:17:03.636 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T03:17:03.637 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T03:17:03.637 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T03:17:03.637 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T03:17:03.637 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T03:17:03.637 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T03:17:03.637 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T03:17:03.637 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T03:17:03.637 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T03:17:03.637 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T03:17:03.637 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T03:17:03.637 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T03:17:03.637 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T03:17:03.637 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T03:17:03.637 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T03:17:03.638 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T03:17:03.638 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T03:17:03.638 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T03:17:03.638 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T03:17:03.638 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T03:17:03.638 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T03:17:03.638 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T03:17:03.638 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T03:17:03.638 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T03:17:03.638 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T03:17:03.638 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T03:17:03.638 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T03:17:03.639 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T03:17:03.639 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T03:17:03.639 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T03:17:03.639 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T03:17:03.639 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T03:17:03.639 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T03:17:03.639 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T03:17:03.639 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T03:17:03.639 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T03:17:03.639 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T03:17:03.639 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T03:17:03.639 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T03:17:03.640 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T03:17:03.640 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T03:17:03.640 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T03:17:03.640 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T03:17:03.640 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T03:17:03.640 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T03:17:03.640 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T03:17:03.640 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T03:17:03.640 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T03:17:03.640 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T03:17:04.526 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T03:17:04.605 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T03:17:05.571 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T03:17:05.597 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T03:17:05.711 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T03:17:05.898 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T03:17:05.924 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T03:17:05.950 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T03:17:05.950 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:17:05.950 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T03:17:05.950 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T03:17:05.950 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T03:17:05.950 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:17:06.000 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T03:17:06.011 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T03:17:06.111 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T03:17:06.172 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T03:17:06.353 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:17:06.353 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:17:06.354 INFO:teuthology.orchestra.run.smithi162.stdout:Upgraded: 2024-09-21T03:17:06.354 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T03:17:06.354 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T03:17:06.354 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T03:17:06.354 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T03:17:06.354 INFO:teuthology.orchestra.run.smithi162.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:06.354 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:06.354 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T03:17:06.354 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T03:17:06.354 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-21T03:17:06.354 INFO:teuthology.orchestra.run.smithi162.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T03:17:06.354 INFO:teuthology.orchestra.run.smithi162.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T03:17:06.355 INFO:teuthology.orchestra.run.smithi162.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T03:17:06.355 INFO:teuthology.orchestra.run.smithi162.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T03:17:06.355 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:06.355 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:06.355 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:06.355 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:06.355 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:17:06.355 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:06.355 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:06.355 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:06.355 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:17:06.355 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:17:06.355 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:17:06.356 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:17:06.356 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:17:06.356 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:06.356 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:06.356 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:17:06.356 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:06.356 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:06.356 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:06.356 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:17:06.356 INFO:teuthology.orchestra.run.smithi162.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:17:06.356 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:06.356 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:06.356 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:17:06.356 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T03:17:06.357 INFO:teuthology.orchestra.run.smithi162.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T03:17:06.357 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T03:17:06.357 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T03:17:06.357 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T03:17:06.357 INFO:teuthology.orchestra.run.smithi162.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T03:17:06.357 INFO:teuthology.orchestra.run.smithi162.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T03:17:06.357 INFO:teuthology.orchestra.run.smithi162.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T03:17:06.357 INFO:teuthology.orchestra.run.smithi162.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T03:17:06.357 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T03:17:06.357 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T03:17:06.357 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:06.357 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:06.357 INFO:teuthology.orchestra.run.smithi162.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:06.357 INFO:teuthology.orchestra.run.smithi162.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T03:17:06.358 INFO:teuthology.orchestra.run.smithi162.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T03:17:06.358 INFO:teuthology.orchestra.run.smithi162.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T03:17:06.358 INFO:teuthology.orchestra.run.smithi162.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T03:17:06.358 INFO:teuthology.orchestra.run.smithi162.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T03:17:06.358 INFO:teuthology.orchestra.run.smithi162.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T03:17:06.358 INFO:teuthology.orchestra.run.smithi162.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:06.358 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:06.358 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T03:17:06.358 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:06.358 INFO:teuthology.orchestra.run.smithi162.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T03:17:06.358 INFO:teuthology.orchestra.run.smithi162.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T03:17:06.358 INFO:teuthology.orchestra.run.smithi162.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T03:17:06.358 INFO:teuthology.orchestra.run.smithi162.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T03:17:06.359 INFO:teuthology.orchestra.run.smithi162.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T03:17:06.359 INFO:teuthology.orchestra.run.smithi162.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T03:17:06.359 INFO:teuthology.orchestra.run.smithi162.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T03:17:06.359 INFO:teuthology.orchestra.run.smithi162.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T03:17:06.359 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T03:17:06.359 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T03:17:06.359 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T03:17:06.359 INFO:teuthology.orchestra.run.smithi162.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T03:17:06.359 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T03:17:06.359 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T03:17:06.359 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T03:17:06.359 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T03:17:06.359 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T03:17:06.359 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T03:17:06.360 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T03:17:06.360 INFO:teuthology.orchestra.run.smithi162.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T03:17:06.360 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T03:17:06.360 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T03:17:06.360 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T03:17:06.360 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:06.360 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:06.360 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:06.360 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T03:17:06.360 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T03:17:06.360 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T03:17:06.360 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T03:17:06.360 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T03:17:06.360 INFO:teuthology.orchestra.run.smithi162.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T03:17:06.361 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T03:17:06.361 INFO:teuthology.orchestra.run.smithi162.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T03:17:06.361 INFO:teuthology.orchestra.run.smithi162.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T03:17:06.361 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T03:17:06.361 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T03:17:06.361 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T03:17:06.361 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T03:17:06.361 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T03:17:06.361 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T03:17:06.361 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T03:17:06.361 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T03:17:06.361 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T03:17:06.361 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T03:17:06.361 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T03:17:06.362 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T03:17:06.362 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T03:17:06.362 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T03:17:06.362 INFO:teuthology.orchestra.run.smithi162.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T03:17:06.362 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T03:17:06.362 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T03:17:06.362 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T03:17:06.362 INFO:teuthology.orchestra.run.smithi162.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T03:17:06.362 INFO:teuthology.orchestra.run.smithi162.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T03:17:06.362 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T03:17:06.362 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T03:17:06.362 INFO:teuthology.orchestra.run.smithi162.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T03:17:06.362 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T03:17:06.362 INFO:teuthology.orchestra.run.smithi162.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T03:17:06.362 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T03:17:06.362 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T03:17:06.363 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T03:17:06.363 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T03:17:06.363 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T03:17:06.363 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T03:17:06.363 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:06.363 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:06.363 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T03:17:06.363 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T03:17:06.363 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T03:17:06.363 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:06.363 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T03:17:06.363 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T03:17:06.363 INFO:teuthology.orchestra.run.smithi162.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T03:17:06.363 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T03:17:06.363 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T03:17:06.364 INFO:teuthology.orchestra.run.smithi162.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T03:17:06.364 INFO:teuthology.orchestra.run.smithi162.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T03:17:06.364 INFO:teuthology.orchestra.run.smithi162.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T03:17:06.364 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T03:17:06.364 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T03:17:06.364 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T03:17:06.364 INFO:teuthology.orchestra.run.smithi162.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T03:17:06.364 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T03:17:06.364 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T03:17:06.364 INFO:teuthology.orchestra.run.smithi162.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T03:17:06.364 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:06.364 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:06.364 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:06.364 INFO:teuthology.orchestra.run.smithi162.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T03:17:06.364 INFO:teuthology.orchestra.run.smithi162.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T03:17:06.364 INFO:teuthology.orchestra.run.smithi162.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T03:17:06.365 INFO:teuthology.orchestra.run.smithi162.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T03:17:06.365 INFO:teuthology.orchestra.run.smithi162.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T03:17:06.365 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T03:17:06.365 INFO:teuthology.orchestra.run.smithi162.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T03:17:06.365 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:17:06.365 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-21T03:17:06.809 DEBUG:teuthology.parallel:result is None 2024-09-21T03:17:07.139 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T03:17:07.169 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T03:17:07.193 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T03:17:07.193 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:17:07.193 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T03:17:07.193 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T03:17:07.193 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T03:17:07.193 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:17:07.236 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T03:17:07.259 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T03:17:07.260 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:17:07.260 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T03:17:07.260 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:17:07.312 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T03:17:07.335 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T03:17:07.335 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:17:07.335 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T03:17:07.335 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T03:17:07.335 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T03:17:07.336 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:17:07.654 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T03:17:07.677 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T03:17:07.677 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:17:07.677 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T03:17:07.678 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T03:17:07.678 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T03:17:07.678 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:17:11.714 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T03:17:11.758 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T03:17:11.798 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T03:17:11.831 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T03:17:11.858 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T03:17:12.063 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T03:17:12.105 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T03:17:12.135 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T03:17:12.164 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T03:17:12.211 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T03:17:12.832 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:17:12.867 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:17:12.888 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:17:13.726 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T03:17:13.822 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T03:17:13.869 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T03:17:13.966 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T03:17:14.000 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T03:17:14.025 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T03:17:14.051 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T03:17:14.051 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T03:17:14.144 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T03:17:14.144 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T03:17:14.211 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T03:17:14.236 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T03:17:14.242 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:17:14.242 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:17:14.430 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:17:14.430 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T03:17:14.514 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T03:17:14.579 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:17:21.098 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:17:21.098 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T03:17:21.098 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T03:17:21.099 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T03:17:21.099 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T03:17:21.099 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T03:17:21.099 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T03:17:21.099 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T03:17:21.099 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:17:21.099 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:17:21.099 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T03:17:21.099 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T03:17:21.099 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T03:17:21.099 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T03:17:21.099 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:17:21.099 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T03:17:21.100 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T03:17:21.100 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T03:17:21.100 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T03:17:21.100 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T03:17:21.100 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T03:17:21.100 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T03:17:21.100 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T03:17:21.100 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T03:17:21.100 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T03:17:21.100 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T03:17:21.100 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T03:17:21.100 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T03:17:21.111 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T03:17:21.112 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T03:17:21.112 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T03:17:21.112 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T03:17:21.112 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T03:17:21.112 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T03:17:21.112 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T03:17:21.112 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T03:17:21.112 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T03:17:21.112 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T03:17:21.112 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T03:17:21.112 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T03:17:21.112 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T03:17:21.113 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T03:17:21.113 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T03:17:21.113 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T03:17:21.113 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T03:17:21.113 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T03:17:21.113 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T03:17:21.113 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T03:17:21.113 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T03:17:21.113 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T03:17:21.113 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T03:17:21.113 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T03:17:21.113 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T03:17:21.113 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T03:17:21.113 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T03:17:21.114 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T03:17:21.114 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T03:17:21.114 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T03:17:21.114 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T03:17:21.114 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T03:17:21.114 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T03:17:21.114 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T03:17:21.114 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T03:17:21.114 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T03:17:21.114 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T03:17:21.115 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T03:17:21.116 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T03:17:21.116 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T03:17:21.116 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T03:17:21.116 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T03:17:21.116 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T03:17:21.116 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T03:17:21.116 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T03:17:21.116 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T03:17:21.116 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T03:17:21.116 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T03:17:21.116 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T03:17:21.117 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T03:17:21.117 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T03:17:21.117 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T03:17:21.117 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T03:17:21.117 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T03:17:21.117 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T03:17:21.117 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T03:17:21.117 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T03:17:21.117 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T03:17:21.117 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T03:17:21.117 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T03:17:21.117 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T03:17:21.117 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T03:17:21.117 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T03:17:21.118 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T03:17:21.118 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T03:17:21.118 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T03:17:21.118 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T03:17:21.118 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T03:17:21.118 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T03:17:21.118 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T03:17:21.118 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T03:17:21.118 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T03:17:21.118 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T03:17:21.118 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T03:17:21.118 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T03:17:21.118 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T03:17:21.119 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T03:17:21.119 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T03:17:21.119 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T03:17:21.119 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T03:17:21.119 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T03:17:21.119 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T03:17:21.119 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T03:17:21.119 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T03:17:21.119 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T03:17:21.119 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T03:17:21.119 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T03:17:21.119 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T03:17:21.119 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T03:17:21.119 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T03:17:21.119 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T03:17:21.120 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T03:17:21.120 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T03:17:21.120 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T03:17:21.120 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T03:17:21.120 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T03:17:21.120 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T03:17:21.120 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T03:17:21.120 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T03:17:21.120 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T03:17:21.120 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T03:17:21.120 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T03:17:21.120 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T03:17:21.120 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T03:17:21.121 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T03:17:21.121 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T03:17:21.121 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T03:17:21.121 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T03:17:21.121 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T03:17:21.121 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T03:17:21.121 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T03:17:21.121 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T03:17:21.121 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T03:17:21.121 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T03:17:21.121 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T03:17:21.121 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T03:17:21.121 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T03:17:21.121 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T03:17:21.122 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T03:17:21.122 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T03:17:21.122 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T03:17:21.122 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T03:17:21.122 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T03:17:21.122 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T03:17:21.122 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T03:17:21.122 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T03:17:21.122 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T03:17:21.122 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T03:17:21.122 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T03:17:21.122 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T03:17:21.122 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T03:17:21.122 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T03:17:21.123 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T03:17:21.123 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T03:17:21.123 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T03:17:21.123 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T03:17:21.123 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T03:17:23.664 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:17:23.665 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:17:23.665 INFO:teuthology.orchestra.run.smithi105.stdout:Upgraded: 2024-09-21T03:17:23.665 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T03:17:23.665 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T03:17:23.665 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T03:17:23.665 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T03:17:23.665 INFO:teuthology.orchestra.run.smithi105.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:23.665 INFO:teuthology.orchestra.run.smithi105.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:23.665 INFO:teuthology.orchestra.run.smithi105.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T03:17:23.665 INFO:teuthology.orchestra.run.smithi105.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T03:17:23.666 INFO:teuthology.orchestra.run.smithi105.stdout:Installed: 2024-09-21T03:17:23.666 INFO:teuthology.orchestra.run.smithi105.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T03:17:23.666 INFO:teuthology.orchestra.run.smithi105.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T03:17:23.666 INFO:teuthology.orchestra.run.smithi105.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T03:17:23.666 INFO:teuthology.orchestra.run.smithi105.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T03:17:23.666 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:23.666 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:23.666 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:23.666 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:23.666 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:17:23.666 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:23.666 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:23.666 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:23.667 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:17:23.667 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:17:23.667 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:17:23.667 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:17:23.667 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:17:23.667 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:23.667 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:23.667 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:17:23.667 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:23.667 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:23.667 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:23.667 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:17:23.667 INFO:teuthology.orchestra.run.smithi105.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:17:23.668 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:23.668 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:23.668 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:17:23.668 INFO:teuthology.orchestra.run.smithi105.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T03:17:23.668 INFO:teuthology.orchestra.run.smithi105.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T03:17:23.668 INFO:teuthology.orchestra.run.smithi105.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T03:17:23.668 INFO:teuthology.orchestra.run.smithi105.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T03:17:23.668 INFO:teuthology.orchestra.run.smithi105.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T03:17:23.668 INFO:teuthology.orchestra.run.smithi105.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T03:17:23.668 INFO:teuthology.orchestra.run.smithi105.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T03:17:23.668 INFO:teuthology.orchestra.run.smithi105.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T03:17:23.668 INFO:teuthology.orchestra.run.smithi105.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T03:17:23.668 INFO:teuthology.orchestra.run.smithi105.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T03:17:23.668 INFO:teuthology.orchestra.run.smithi105.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T03:17:23.669 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:23.669 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:23.669 INFO:teuthology.orchestra.run.smithi105.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:23.669 INFO:teuthology.orchestra.run.smithi105.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T03:17:23.669 INFO:teuthology.orchestra.run.smithi105.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T03:17:23.669 INFO:teuthology.orchestra.run.smithi105.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T03:17:23.669 INFO:teuthology.orchestra.run.smithi105.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T03:17:23.669 INFO:teuthology.orchestra.run.smithi105.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T03:17:23.669 INFO:teuthology.orchestra.run.smithi105.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T03:17:23.669 INFO:teuthology.orchestra.run.smithi105.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:23.669 INFO:teuthology.orchestra.run.smithi105.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:23.669 INFO:teuthology.orchestra.run.smithi105.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T03:17:23.669 INFO:teuthology.orchestra.run.smithi105.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:23.669 INFO:teuthology.orchestra.run.smithi105.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T03:17:23.669 INFO:teuthology.orchestra.run.smithi105.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T03:17:23.670 INFO:teuthology.orchestra.run.smithi105.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T03:17:23.670 INFO:teuthology.orchestra.run.smithi105.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T03:17:23.670 INFO:teuthology.orchestra.run.smithi105.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T03:17:23.670 INFO:teuthology.orchestra.run.smithi105.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T03:17:23.670 INFO:teuthology.orchestra.run.smithi105.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T03:17:23.670 INFO:teuthology.orchestra.run.smithi105.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T03:17:23.670 INFO:teuthology.orchestra.run.smithi105.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T03:17:23.670 INFO:teuthology.orchestra.run.smithi105.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T03:17:23.670 INFO:teuthology.orchestra.run.smithi105.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T03:17:23.670 INFO:teuthology.orchestra.run.smithi105.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T03:17:23.672 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T03:17:23.672 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T03:17:23.672 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T03:17:23.672 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T03:17:23.672 INFO:teuthology.orchestra.run.smithi105.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T03:17:23.672 INFO:teuthology.orchestra.run.smithi105.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T03:17:23.672 INFO:teuthology.orchestra.run.smithi105.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T03:17:23.672 INFO:teuthology.orchestra.run.smithi105.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T03:17:23.673 INFO:teuthology.orchestra.run.smithi105.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T03:17:23.673 INFO:teuthology.orchestra.run.smithi105.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T03:17:23.673 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T03:17:23.673 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:23.673 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:23.673 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:23.673 INFO:teuthology.orchestra.run.smithi105.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T03:17:23.673 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T03:17:23.673 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T03:17:23.673 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T03:17:23.673 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T03:17:23.673 INFO:teuthology.orchestra.run.smithi105.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T03:17:23.673 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T03:17:23.673 INFO:teuthology.orchestra.run.smithi105.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T03:17:23.673 INFO:teuthology.orchestra.run.smithi105.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T03:17:23.674 INFO:teuthology.orchestra.run.smithi105.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T03:17:23.674 INFO:teuthology.orchestra.run.smithi105.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T03:17:23.674 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T03:17:23.674 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T03:17:23.674 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T03:17:23.674 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T03:17:23.674 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T03:17:23.674 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T03:17:23.674 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T03:17:23.674 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T03:17:23.674 INFO:teuthology.orchestra.run.smithi105.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T03:17:23.674 INFO:teuthology.orchestra.run.smithi105.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T03:17:23.674 INFO:teuthology.orchestra.run.smithi105.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T03:17:23.675 INFO:teuthology.orchestra.run.smithi105.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T03:17:23.675 INFO:teuthology.orchestra.run.smithi105.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T03:17:23.675 INFO:teuthology.orchestra.run.smithi105.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T03:17:23.675 INFO:teuthology.orchestra.run.smithi105.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T03:17:23.675 INFO:teuthology.orchestra.run.smithi105.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T03:17:23.675 INFO:teuthology.orchestra.run.smithi105.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T03:17:23.675 INFO:teuthology.orchestra.run.smithi105.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T03:17:23.675 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T03:17:23.675 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T03:17:23.675 INFO:teuthology.orchestra.run.smithi105.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T03:17:23.675 INFO:teuthology.orchestra.run.smithi105.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T03:17:23.675 INFO:teuthology.orchestra.run.smithi105.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T03:17:23.675 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T03:17:23.675 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T03:17:23.676 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T03:17:23.676 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T03:17:23.676 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T03:17:23.676 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T03:17:23.676 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:23.676 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:23.676 INFO:teuthology.orchestra.run.smithi105.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T03:17:23.676 INFO:teuthology.orchestra.run.smithi105.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T03:17:23.676 INFO:teuthology.orchestra.run.smithi105.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T03:17:23.676 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:23.676 INFO:teuthology.orchestra.run.smithi105.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T03:17:23.676 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T03:17:23.676 INFO:teuthology.orchestra.run.smithi105.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T03:17:23.676 INFO:teuthology.orchestra.run.smithi105.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T03:17:23.677 INFO:teuthology.orchestra.run.smithi105.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T03:17:23.677 INFO:teuthology.orchestra.run.smithi105.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T03:17:23.677 INFO:teuthology.orchestra.run.smithi105.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T03:17:23.677 INFO:teuthology.orchestra.run.smithi105.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T03:17:23.677 INFO:teuthology.orchestra.run.smithi105.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T03:17:23.677 INFO:teuthology.orchestra.run.smithi105.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T03:17:23.677 INFO:teuthology.orchestra.run.smithi105.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T03:17:23.677 INFO:teuthology.orchestra.run.smithi105.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T03:17:23.677 INFO:teuthology.orchestra.run.smithi105.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T03:17:23.677 INFO:teuthology.orchestra.run.smithi105.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T03:17:23.677 INFO:teuthology.orchestra.run.smithi105.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T03:17:23.677 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:23.677 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:23.677 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:17:23.677 INFO:teuthology.orchestra.run.smithi105.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T03:17:23.678 INFO:teuthology.orchestra.run.smithi105.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T03:17:23.678 INFO:teuthology.orchestra.run.smithi105.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T03:17:23.678 INFO:teuthology.orchestra.run.smithi105.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T03:17:23.678 INFO:teuthology.orchestra.run.smithi105.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T03:17:23.678 INFO:teuthology.orchestra.run.smithi105.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T03:17:23.678 INFO:teuthology.orchestra.run.smithi105.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T03:17:23.678 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:17:23.678 INFO:teuthology.orchestra.run.smithi105.stdout:Complete! 2024-09-21T03:17:24.133 DEBUG:teuthology.parallel:result is None 2024-09-21T03:17:24.133 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:17:24.272 DEBUG:teuthology.orchestra.run.smithi105:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T03:17:24.295 INFO:teuthology.orchestra.run.smithi105.stdout:19.3.0-5120.g18432218.el9 2024-09-21T03:17:24.295 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T03:17:24.295 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T03:17:24.297 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:17:24.446 DEBUG:teuthology.orchestra.run.smithi162:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T03:17:24.472 INFO:teuthology.orchestra.run.smithi162.stdout:19.3.0-5120.g18432218.el9 2024-09-21T03:17:24.472 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T03:17:24.472 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T03:17:24.474 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T03:17:24.474 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:17:24.474 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T03:17:24.502 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:17:24.502 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T03:17:24.543 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T03:17:24.543 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:17:24.543 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T03:17:24.568 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T03:17:24.633 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:17:24.633 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T03:17:24.661 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T03:17:24.728 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T03:17:24.728 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:17:24.729 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T03:17:24.753 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T03:17:24.817 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:17:24.817 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T03:17:24.844 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T03:17:24.911 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T03:17:24.912 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:17:24.912 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T03:17:24.936 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T03:17:25.001 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:17:25.001 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T03:17:25.026 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T03:17:25.091 INFO:teuthology.run_tasks:Running task ceph... 2024-09-21T03:17:25.171 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-21T03:17:25.171 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 777 /var/log/ceph 2024-09-21T03:17:25.173 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 777 /var/log/ceph 2024-09-21T03:17:25.197 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-21T03:17:25.198 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-21T03:17:25.238 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-21T03:17:25.263 INFO:tasks.ceph:Creating extra log directories... 2024-09-21T03:17:25.263 DEBUG:teuthology.orchestra.run.smithi105:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-21T03:17:25.302 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-21T03:17:25.337 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-21T03:17:25.338 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-21T03:17:25.338 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-21T03:17:25.338 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:17:25.338 DEBUG:teuthology.orchestra.run.smithi105:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-21T03:17:25.380 DEBUG:teuthology.orchestra.run.smithi105:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-21T03:17:25.487 DEBUG:teuthology.orchestra.run.smithi105:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-21T03:17:25.512 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:17:25.512 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-21T03:17:25.527 DEBUG:teuthology.orchestra.run.smithi162:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-21T03:17:25.638 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-21T03:17:25.667 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-21T03:17:25.667 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'responding to mclientcaps\\(revoke\\)', 'not advance its oldest_client_tid', 'failing to advance its oldest client/flush tid', 'Too many inodes in cache', 'failing to respond to cache pressure', 'slow requests are blocked', 'failing to respond to capability release', 'MDS cache is too large', '\\(MDS_CLIENT_OLDEST_TID\\)', '\\(MDS_CACHE_OVERSIZED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-21T03:17:25.667 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913457', 'branch': 'wip-pdonnell-testing-20240920.212106-debug', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/client-limits}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7913457', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240920.212106-debug'}, 'ceph': {'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'responding to mclientcaps\\(revoke\\)', 'not advance its oldest_client_tid', 'failing to advance its oldest client/flush tid', 'Too many inodes in cache', 'failing to respond to cache pressure', 'slow requests are blocked', 'failing to respond to capability release', 'MDS cache is too large', '\\(MDS_CLIENT_OLDEST_TID\\)', '\\(MDS_CACHE_OVERSIZED\\)'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240920.212106-debug', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 7864, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'sleep_before_teardown': 0, 'subset': '67/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240920.212106-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi105.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJKffmCTLd3pTSjZK0PulrZznuEUDxGL9Si2fSJOivKzFlKl12p4GbKAVI2MmB/85EWWBn07jkRc9XIk6UuA3JA=', 'smithi162.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEldNB5nTsHAI3Bh3/2zgCpbwLSheRZXtGRs2/qvy1LG46OBLpHlO7wYPD55AjlEpIsssjMI/cmSEyiI5ppW8fY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}}, {'ceph': {'create_rbd_pool': False, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'responding to mclientcaps\\(revoke\\)', 'not advance its oldest_client_tid', 'failing to advance its oldest client/flush tid', 'Too many inodes in cache', 'failing to respond to cache pressure', 'slow requests are blocked', 'failing to respond to capability release', 'MDS cache is too large', '\\(MDS_CLIENT_OLDEST_TID\\)', '\\(MDS_CACHE_OVERSIZED\\)'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_client_limits']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-20_23:48:22', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2902'} 2024-09-21T03:17:25.668 DEBUG:teuthology.orchestra.run.smithi105:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-21T03:17:25.670 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-21T03:17:25.717 DEBUG:teuthology.orchestra.run.smithi105:> sudo install -d -m0777 -- /var/run/ceph 2024-09-21T03:17:25.725 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m0777 -- /var/run/ceph 2024-09-21T03:17:25.785 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:17:25.786 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T03:17:25.803 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T03:17:25.803 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_1 2024-09-21T03:17:25.858 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T03:17:25.858 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:17:25.858 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-21T03:17:25.858 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:17:25.858 INFO:teuthology.orchestra.run.smithi105.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:17:25.858 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2024-09-21 03:17:14.953349187 +0000 2024-09-21T03:17:25.858 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2024-09-21 03:15:11.940919126 +0000 2024-09-21T03:17:25.859 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2024-09-21 03:15:11.940919126 +0000 2024-09-21T03:17:25.859 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: 2024-09-21 03:15:11.940919126 +0000 2024-09-21T03:17:25.859 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T03:17:25.921 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2024-09-21T03:17:25.921 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2024-09-21T03:17:25.921 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000179001 s, 2.9 MB/s 2024-09-21T03:17:25.922 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T03:17:25.978 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_2 2024-09-21T03:17:26.033 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T03:17:26.033 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:17:26.033 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-21T03:17:26.033 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:17:26.033 INFO:teuthology.orchestra.run.smithi105.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:17:26.033 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2024-09-21 03:17:14.953349187 +0000 2024-09-21T03:17:26.034 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2024-09-21 03:15:12.257912662 +0000 2024-09-21T03:17:26.034 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2024-09-21 03:15:12.257912662 +0000 2024-09-21T03:17:26.034 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: 2024-09-21 03:15:12.257912662 +0000 2024-09-21T03:17:26.034 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T03:17:26.096 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2024-09-21T03:17:26.096 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2024-09-21T03:17:26.097 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000223876 s, 2.3 MB/s 2024-09-21T03:17:26.098 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T03:17:26.154 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_3 2024-09-21T03:17:26.209 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T03:17:26.209 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:17:26.209 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-21T03:17:26.209 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:17:26.210 INFO:teuthology.orchestra.run.smithi105.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:17:26.210 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2024-09-21 03:17:14.954349167 +0000 2024-09-21T03:17:26.210 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2024-09-21 03:15:12.576906157 +0000 2024-09-21T03:17:26.210 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2024-09-21 03:15:12.576906157 +0000 2024-09-21T03:17:26.210 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: 2024-09-21 03:15:12.576906157 +0000 2024-09-21T03:17:26.210 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T03:17:26.272 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2024-09-21T03:17:26.272 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2024-09-21T03:17:26.272 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000226902 s, 2.3 MB/s 2024-09-21T03:17:26.274 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T03:17:26.330 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_4 2024-09-21T03:17:26.385 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T03:17:26.385 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:17:26.385 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-21T03:17:26.386 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:17:26.386 INFO:teuthology.orchestra.run.smithi105.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:17:26.386 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2024-09-21 03:17:14.954349167 +0000 2024-09-21T03:17:26.386 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2024-09-21 03:15:12.892899713 +0000 2024-09-21T03:17:26.386 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2024-09-21 03:15:12.892899713 +0000 2024-09-21T03:17:26.386 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: 2024-09-21 03:15:12.892899713 +0000 2024-09-21T03:17:26.386 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T03:17:26.448 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2024-09-21T03:17:26.448 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2024-09-21T03:17:26.448 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000183363 s, 2.8 MB/s 2024-09-21T03:17:26.449 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T03:17:26.505 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T03:17:26.505 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:17:26.506 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T03:17:26.522 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T03:17:26.522 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_1 2024-09-21T03:17:26.577 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T03:17:26.578 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:17:26.578 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-21T03:17:26.578 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:17:26.578 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:17:26.578 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-21 03:16:57.749966627 +0000 2024-09-21T03:17:26.578 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-21 03:15:11.950553174 +0000 2024-09-21T03:17:26.578 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-21 03:15:11.950553174 +0000 2024-09-21T03:17:26.578 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-21 03:15:11.950553174 +0000 2024-09-21T03:17:26.578 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T03:17:26.641 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-21T03:17:26.641 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-21T03:17:26.641 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000203858 s, 2.5 MB/s 2024-09-21T03:17:26.642 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T03:17:26.699 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_2 2024-09-21T03:17:26.754 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T03:17:26.754 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:17:26.754 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-21T03:17:26.754 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:17:26.754 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:17:26.755 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-21 03:16:57.750966607 +0000 2024-09-21T03:17:26.755 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-21 03:15:12.274546611 +0000 2024-09-21T03:17:26.755 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-21 03:15:12.274546611 +0000 2024-09-21T03:17:26.755 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-21 03:15:12.274546611 +0000 2024-09-21T03:17:26.755 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T03:17:26.817 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-21T03:17:26.817 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-21T03:17:26.817 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000174898 s, 2.9 MB/s 2024-09-21T03:17:26.818 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T03:17:26.875 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_3 2024-09-21T03:17:26.930 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T03:17:26.931 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:17:26.931 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-21T03:17:26.931 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:17:26.931 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:17:26.931 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-21 03:16:57.750966607 +0000 2024-09-21T03:17:26.931 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-21 03:15:12.598540049 +0000 2024-09-21T03:17:26.931 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-21 03:15:12.598540049 +0000 2024-09-21T03:17:26.931 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-21 03:15:12.598540049 +0000 2024-09-21T03:17:26.931 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T03:17:26.993 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-21T03:17:26.993 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-21T03:17:26.993 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000157424 s, 3.3 MB/s 2024-09-21T03:17:26.995 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T03:17:27.051 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_4 2024-09-21T03:17:27.106 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T03:17:27.107 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:17:27.107 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-21T03:17:27.107 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:17:27.107 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:17:27.107 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-21 03:16:57.751966586 +0000 2024-09-21T03:17:27.107 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-21 03:15:12.919533546 +0000 2024-09-21T03:17:27.107 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-21 03:15:12.919533546 +0000 2024-09-21T03:17:27.107 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-21 03:15:12.919533546 +0000 2024-09-21T03:17:27.107 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T03:17:27.169 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-21T03:17:27.169 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-21T03:17:27.169 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000190165 s, 2.7 MB/s 2024-09-21T03:17:27.170 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T03:17:27.226 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T03:17:27.226 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi105.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi162.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-21T03:17:27.227 INFO:tasks.ceph:Generating config... 2024-09-21T03:17:27.228 INFO:tasks.ceph:[client] pid file = 2024-09-21T03:17:27.228 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-21T03:17:27.228 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-21T03:17:27.228 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-21T03:17:27.228 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-21T03:17:27.228 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-21T03:17:27.228 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-21T03:17:27.228 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-21T03:17:27.228 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-21T03:17:27.228 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-21T03:17:27.229 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-21T03:17:27.229 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-21T03:17:27.229 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-21T03:17:27.229 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-21T03:17:27.229 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-21T03:17:27.229 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-21T03:17:27.229 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-21T03:17:27.229 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-21T03:17:27.229 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-21T03:17:27.229 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-21T03:17:27.229 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-21T03:17:27.229 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-21T03:17:27.229 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-21T03:17:27.229 INFO:tasks.ceph:Setting up mon.a... 2024-09-21T03:17:27.230 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-21T03:17:27.288 INFO:teuthology.orchestra.run.smithi105.stdout:creating /etc/ceph/ceph.keyring 2024-09-21T03:17:27.291 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-21T03:17:27.343 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T03:17:27.368 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.105'), ('mon.b', '172.21.15.162'), ('mon.c', '[v2:172.21.15.162:3301,v1:172.21.15.162:6790]')] 2024-09-21T03:17:27.369 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.105,172.21.15.162,[v2:172.21.15.162:3301,v1:172.21.15.162:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}} 2024-09-21T03:17:27.369 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:17:27.369 DEBUG:teuthology.orchestra.run.smithi105:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-21T03:17:27.423 DEBUG:teuthology.orchestra.run.smithi105:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.105 --add b 172.21.15.162 --addv c '[v2:172.21.15.162:3301,v1:172.21.15.162:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-21T03:17:27.520 INFO:teuthology.orchestra.run.smithi105.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-21T03:17:27.520 INFO:teuthology.orchestra.run.smithi105.stdout:monmaptool: generated fsid 29d80f4f-e5de-4b26-8384-24c2d8019945 2024-09-21T03:17:27.520 INFO:teuthology.orchestra.run.smithi105.stdout:setting min_mon_release = quincy 2024-09-21T03:17:27.520 INFO:teuthology.orchestra.run.smithi105.stdout:epoch 0 2024-09-21T03:17:27.520 INFO:teuthology.orchestra.run.smithi105.stdout:fsid 29d80f4f-e5de-4b26-8384-24c2d8019945 2024-09-21T03:17:27.520 INFO:teuthology.orchestra.run.smithi105.stdout:last_changed 2024-09-21T03:17:27.519459+0000 2024-09-21T03:17:27.520 INFO:teuthology.orchestra.run.smithi105.stdout:created 2024-09-21T03:17:27.519459+0000 2024-09-21T03:17:27.520 INFO:teuthology.orchestra.run.smithi105.stdout:min_mon_release 17 (quincy) 2024-09-21T03:17:27.521 INFO:teuthology.orchestra.run.smithi105.stdout:election_strategy: 1 2024-09-21T03:17:27.521 INFO:teuthology.orchestra.run.smithi105.stdout:0: [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] mon.a 2024-09-21T03:17:27.521 INFO:teuthology.orchestra.run.smithi105.stdout:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-21T03:17:27.521 INFO:teuthology.orchestra.run.smithi105.stdout:2: [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] mon.c 2024-09-21T03:17:27.521 INFO:teuthology.orchestra.run.smithi105.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-21T03:17:27.522 DEBUG:teuthology.orchestra.run.smithi105:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-21T03:17:27.537 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 29d80f4f-e5de-4b26-8384-24c2d8019945... 2024-09-21T03:17:27.538 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-21T03:17:27.580 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-21T03:17:27.619 INFO:teuthology.orchestra.run.smithi105.stdout:[global] 2024-09-21T03:17:27.620 INFO:teuthology.orchestra.run.smithi105.stdout: chdir = "" 2024-09-21T03:17:27.621 INFO:teuthology.orchestra.run.smithi105.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T03:17:27.621 INFO:teuthology.orchestra.run.smithi105.stdout: auth supported = cephx 2024-09-21T03:17:27.621 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:17:27.621 INFO:teuthology.orchestra.run.smithi105.stdout: filestore xattr use omap = true 2024-09-21T03:17:27.621 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:17:27.621 INFO:teuthology.orchestra.run.smithi105.stdout: mon clock drift allowed = 1.000 2024-09-21T03:17:27.622 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:17:27.622 INFO:teuthology.orchestra.run.smithi105.stdout: osd crush chooseleaf type = 0 2024-09-21T03:17:27.622 INFO:teuthology.orchestra.run.smithi105.stdout: auth debug = true 2024-09-21T03:17:27.622 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:17:27.622 INFO:teuthology.orchestra.run.smithi105.stdout: ms die on old message = true 2024-09-21T03:17:27.622 INFO:teuthology.orchestra.run.smithi105.stdout: ms die on bug = true 2024-09-21T03:17:27.622 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:17:27.622 INFO:teuthology.orchestra.run.smithi105.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T03:17:27.622 INFO:teuthology.orchestra.run.smithi105.stdout: mon pg warn max object skew = 0 2024-09-21T03:17:27.622 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:17:27.622 INFO:teuthology.orchestra.run.smithi105.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T03:17:27.622 INFO:teuthology.orchestra.run.smithi105.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T03:17:27.622 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:17:27.623 INFO:teuthology.orchestra.run.smithi105.stdout: osd pool default size = 2 2024-09-21T03:17:27.623 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:17:27.623 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd allow primary affinity = true 2024-09-21T03:17:27.623 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd allow pg remap = true 2024-09-21T03:17:27.623 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on legacy crush tunables = false 2024-09-21T03:17:27.623 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on crush straw calc version zero = false 2024-09-21T03:17:27.623 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on no sortbitwise = false 2024-09-21T03:17:27.623 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on osd down out interval zero = false 2024-09-21T03:17:27.623 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on too few osds = false 2024-09-21T03:17:27.623 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T03:17:27.623 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T03:17:27.623 INFO:teuthology.orchestra.run.smithi105.stdout: mon_allow_pool_size_one = true 2024-09-21T03:17:27.623 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:17:27.623 INFO:teuthology.orchestra.run.smithi105.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T03:17:27.624 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:17:27.624 INFO:teuthology.orchestra.run.smithi105.stdout: osd default data pool replay window = 5 2024-09-21T03:17:27.624 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:17:27.624 INFO:teuthology.orchestra.run.smithi105.stdout: mon allow pool delete = true 2024-09-21T03:17:27.624 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:17:27.624 INFO:teuthology.orchestra.run.smithi105.stdout: mon cluster log file level = debug 2024-09-21T03:17:27.624 INFO:teuthology.orchestra.run.smithi105.stdout: debug asserts on shutdown = true 2024-09-21T03:17:27.624 INFO:teuthology.orchestra.run.smithi105.stdout: mon health detail to clog = false 2024-09-21T03:17:27.624 INFO:teuthology.orchestra.run.smithi105.stdout: mon host = "172.21.15.105,172.21.15.162,[v2:172.21.15.162:3301,v1:172.21.15.162:6790]" 2024-09-21T03:17:27.624 INFO:teuthology.orchestra.run.smithi105.stdout: ms die on skipped message = False 2024-09-21T03:17:27.624 INFO:teuthology.orchestra.run.smithi105.stdout: fsid = 29d80f4f-e5de-4b26-8384-24c2d8019945 2024-09-21T03:17:27.624 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:17:27.624 INFO:teuthology.orchestra.run.smithi105.stdout:[osd] 2024-09-21T03:17:27.624 INFO:teuthology.orchestra.run.smithi105.stdout: osd journal size = 100 2024-09-21T03:17:27.625 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:17:27.625 INFO:teuthology.orchestra.run.smithi105.stdout: osd scrub load threshold = 5.0 2024-09-21T03:17:27.625 INFO:teuthology.orchestra.run.smithi105.stdout: osd scrub max interval = 600 2024-09-21T03:17:27.625 INFO:teuthology.orchestra.run.smithi105.stdout: osd mclock profile = high_recovery_ops 2024-09-21T03:17:27.625 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:17:27.625 INFO:teuthology.orchestra.run.smithi105.stdout: osd recover clone overlap = true 2024-09-21T03:17:27.625 INFO:teuthology.orchestra.run.smithi105.stdout: osd recovery max chunk = 1048576 2024-09-21T03:17:27.625 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:17:27.625 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug shutdown = true 2024-09-21T03:17:27.625 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug op order = true 2024-09-21T03:17:27.625 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug verify stray on activate = true 2024-09-21T03:17:27.625 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug trim objects = true 2024-09-21T03:17:27.625 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:17:27.625 INFO:teuthology.orchestra.run.smithi105.stdout: osd open classes on start = true 2024-09-21T03:17:27.626 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug pg log writeout = true 2024-09-21T03:17:27.626 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:17:27.626 INFO:teuthology.orchestra.run.smithi105.stdout: osd deep scrub update digest min age = 30 2024-09-21T03:17:27.626 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:17:27.626 INFO:teuthology.orchestra.run.smithi105.stdout: osd map max advance = 10 2024-09-21T03:17:27.626 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:17:27.626 INFO:teuthology.orchestra.run.smithi105.stdout: journal zero on create = true 2024-09-21T03:17:27.626 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:17:27.626 INFO:teuthology.orchestra.run.smithi105.stdout: filestore ondisk finisher threads = 3 2024-09-21T03:17:27.626 INFO:teuthology.orchestra.run.smithi105.stdout: filestore apply finisher threads = 3 2024-09-21T03:17:27.626 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:17:27.626 INFO:teuthology.orchestra.run.smithi105.stdout: bdev debug aio = true 2024-09-21T03:17:27.626 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug misdirected ops = true 2024-09-21T03:17:27.626 INFO:teuthology.orchestra.run.smithi105.stdout: bdev async discard = True 2024-09-21T03:17:27.627 INFO:teuthology.orchestra.run.smithi105.stdout: bdev enable discard = True 2024-09-21T03:17:27.627 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore allocator = bitmap 2024-09-21T03:17:27.627 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore block size = 96636764160 2024-09-21T03:17:27.627 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore fsck on mount = True 2024-09-21T03:17:27.627 INFO:teuthology.orchestra.run.smithi105.stdout: debug bluefs = 1/20 2024-09-21T03:17:27.627 INFO:teuthology.orchestra.run.smithi105.stdout: debug bluestore = 1/20 2024-09-21T03:17:27.627 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2024-09-21T03:17:27.627 INFO:teuthology.orchestra.run.smithi105.stdout: debug osd = 20 2024-09-21T03:17:27.627 INFO:teuthology.orchestra.run.smithi105.stdout: debug rocksdb = 4/10 2024-09-21T03:17:27.627 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T03:17:27.627 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd full ratio = 0.9 2024-09-21T03:17:27.627 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd nearfull ratio = 0.8 2024-09-21T03:17:27.627 INFO:teuthology.orchestra.run.smithi105.stdout: osd failsafe full ratio = 0.95 2024-09-21T03:17:27.627 INFO:teuthology.orchestra.run.smithi105.stdout: osd objectstore = bluestore 2024-09-21T03:17:27.628 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:17:27.628 INFO:teuthology.orchestra.run.smithi105.stdout:[mgr] 2024-09-21T03:17:27.628 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2024-09-21T03:17:27.628 INFO:teuthology.orchestra.run.smithi105.stdout: debug mgr = 20 2024-09-21T03:17:27.628 INFO:teuthology.orchestra.run.smithi105.stdout: debug mon = 20 2024-09-21T03:17:27.628 INFO:teuthology.orchestra.run.smithi105.stdout: debug auth = 20 2024-09-21T03:17:27.628 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min pgs per osd = 4 2024-09-21T03:17:27.628 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min bytes per osd = 10 2024-09-21T03:17:27.628 INFO:teuthology.orchestra.run.smithi105.stdout: mgr/telemetry/nag = false 2024-09-21T03:17:27.628 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:17:27.628 INFO:teuthology.orchestra.run.smithi105.stdout:[mon] 2024-09-21T03:17:27.628 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2024-09-21T03:17:27.628 INFO:teuthology.orchestra.run.smithi105.stdout: debug mon = 20 2024-09-21T03:17:27.628 INFO:teuthology.orchestra.run.smithi105.stdout: debug paxos = 20 2024-09-21T03:17:27.629 INFO:teuthology.orchestra.run.smithi105.stdout: debug auth = 20 2024-09-21T03:17:27.629 INFO:teuthology.orchestra.run.smithi105.stdout: mon data avail warn = 5 2024-09-21T03:17:27.629 INFO:teuthology.orchestra.run.smithi105.stdout: mon mgr mkfs grace = 240 2024-09-21T03:17:27.629 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min pgs per osd = 4 2024-09-21T03:17:27.629 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd reporter subtree level = osd 2024-09-21T03:17:27.629 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd prime pg temp = true 2024-09-21T03:17:27.629 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min bytes per osd = 10 2024-09-21T03:17:27.629 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:17:27.629 INFO:teuthology.orchestra.run.smithi105.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T03:17:27.629 INFO:teuthology.orchestra.run.smithi105.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T03:17:27.629 INFO:teuthology.orchestra.run.smithi105.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T03:17:27.629 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:17:27.629 INFO:teuthology.orchestra.run.smithi105.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T03:17:27.629 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T03:17:27.630 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T03:17:27.630 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:17:27.630 INFO:teuthology.orchestra.run.smithi105.stdout: # 1m isn't quite enough 2024-09-21T03:17:27.630 INFO:teuthology.orchestra.run.smithi105.stdout: mon_down_mkfs_grace = 2m 2024-09-21T03:17:27.630 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:17:27.630 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_filestore_osds = false 2024-09-21T03:17:27.630 INFO:teuthology.orchestra.run.smithi105.stdout: mon down mkfs grace = 300 2024-09-21T03:17:27.630 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:17:27.630 INFO:teuthology.orchestra.run.smithi105.stdout:[client] 2024-09-21T03:17:27.630 INFO:teuthology.orchestra.run.smithi105.stdout: rgw cache enabled = true 2024-09-21T03:17:27.630 INFO:teuthology.orchestra.run.smithi105.stdout: rgw enable ops log = true 2024-09-21T03:17:27.630 INFO:teuthology.orchestra.run.smithi105.stdout: rgw enable usage log = true 2024-09-21T03:17:27.630 INFO:teuthology.orchestra.run.smithi105.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T03:17:27.631 INFO:teuthology.orchestra.run.smithi105.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T03:17:27.631 INFO:teuthology.orchestra.run.smithi105.stdout: pid file = "" 2024-09-21T03:17:27.631 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.a] 2024-09-21T03:17:27.631 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.b] 2024-09-21T03:17:27.631 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.c] 2024-09-21T03:17:27.631 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.a] 2024-09-21T03:17:27.631 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.c] 2024-09-21T03:17:27.631 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.b] 2024-09-21T03:17:27.631 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.d] 2024-09-21T03:17:27.632 INFO:teuthology.orchestra.run.smithi162.stdout:[global] 2024-09-21T03:17:27.632 INFO:teuthology.orchestra.run.smithi162.stdout: chdir = "" 2024-09-21T03:17:27.632 INFO:teuthology.orchestra.run.smithi162.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T03:17:27.632 INFO:teuthology.orchestra.run.smithi162.stdout: auth supported = cephx 2024-09-21T03:17:27.632 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:17:27.632 INFO:teuthology.orchestra.run.smithi162.stdout: filestore xattr use omap = true 2024-09-21T03:17:27.632 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:17:27.632 INFO:teuthology.orchestra.run.smithi162.stdout: mon clock drift allowed = 1.000 2024-09-21T03:17:27.632 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:17:27.632 INFO:teuthology.orchestra.run.smithi162.stdout: osd crush chooseleaf type = 0 2024-09-21T03:17:27.632 INFO:teuthology.orchestra.run.smithi162.stdout: auth debug = true 2024-09-21T03:17:27.632 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:17:27.633 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on old message = true 2024-09-21T03:17:27.633 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on bug = true 2024-09-21T03:17:27.633 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:17:27.633 INFO:teuthology.orchestra.run.smithi162.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T03:17:27.633 INFO:teuthology.orchestra.run.smithi162.stdout: mon pg warn max object skew = 0 2024-09-21T03:17:27.633 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:17:27.633 INFO:teuthology.orchestra.run.smithi162.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T03:17:27.633 INFO:teuthology.orchestra.run.smithi162.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T03:17:27.633 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:17:27.633 INFO:teuthology.orchestra.run.smithi162.stdout: osd pool default size = 2 2024-09-21T03:17:27.633 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:17:27.633 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd allow primary affinity = true 2024-09-21T03:17:27.633 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd allow pg remap = true 2024-09-21T03:17:27.633 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on legacy crush tunables = false 2024-09-21T03:17:27.634 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on crush straw calc version zero = false 2024-09-21T03:17:27.634 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on no sortbitwise = false 2024-09-21T03:17:27.634 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on osd down out interval zero = false 2024-09-21T03:17:27.634 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on too few osds = false 2024-09-21T03:17:27.634 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T03:17:27.634 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T03:17:27.634 INFO:teuthology.orchestra.run.smithi162.stdout: mon_allow_pool_size_one = true 2024-09-21T03:17:27.634 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:17:27.634 INFO:teuthology.orchestra.run.smithi162.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T03:17:27.634 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:17:27.634 INFO:teuthology.orchestra.run.smithi162.stdout: osd default data pool replay window = 5 2024-09-21T03:17:27.634 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:17:27.634 INFO:teuthology.orchestra.run.smithi162.stdout: mon allow pool delete = true 2024-09-21T03:17:27.634 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:17:27.635 INFO:teuthology.orchestra.run.smithi162.stdout: mon cluster log file level = debug 2024-09-21T03:17:27.635 INFO:teuthology.orchestra.run.smithi162.stdout: debug asserts on shutdown = true 2024-09-21T03:17:27.635 INFO:teuthology.orchestra.run.smithi162.stdout: mon health detail to clog = false 2024-09-21T03:17:27.635 INFO:teuthology.orchestra.run.smithi162.stdout: mon host = "172.21.15.105,172.21.15.162,[v2:172.21.15.162:3301,v1:172.21.15.162:6790]" 2024-09-21T03:17:27.635 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on skipped message = False 2024-09-21T03:17:27.635 INFO:teuthology.orchestra.run.smithi162.stdout: fsid = 29d80f4f-e5de-4b26-8384-24c2d8019945 2024-09-21T03:17:27.635 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:17:27.635 INFO:teuthology.orchestra.run.smithi162.stdout:[osd] 2024-09-21T03:17:27.635 INFO:teuthology.orchestra.run.smithi162.stdout: osd journal size = 100 2024-09-21T03:17:27.635 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:17:27.635 INFO:teuthology.orchestra.run.smithi162.stdout: osd scrub load threshold = 5.0 2024-09-21T03:17:27.635 INFO:teuthology.orchestra.run.smithi162.stdout: osd scrub max interval = 600 2024-09-21T03:17:27.635 INFO:teuthology.orchestra.run.smithi162.stdout: osd mclock profile = high_recovery_ops 2024-09-21T03:17:27.635 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:17:27.635 INFO:teuthology.orchestra.run.smithi162.stdout: osd recover clone overlap = true 2024-09-21T03:17:27.636 INFO:teuthology.orchestra.run.smithi162.stdout: osd recovery max chunk = 1048576 2024-09-21T03:17:27.636 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:17:27.636 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug shutdown = true 2024-09-21T03:17:27.636 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug op order = true 2024-09-21T03:17:27.636 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug verify stray on activate = true 2024-09-21T03:17:27.636 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug trim objects = true 2024-09-21T03:17:27.636 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:17:27.636 INFO:teuthology.orchestra.run.smithi162.stdout: osd open classes on start = true 2024-09-21T03:17:27.636 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug pg log writeout = true 2024-09-21T03:17:27.636 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:17:27.636 INFO:teuthology.orchestra.run.smithi162.stdout: osd deep scrub update digest min age = 30 2024-09-21T03:17:27.636 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:17:27.636 INFO:teuthology.orchestra.run.smithi162.stdout: osd map max advance = 10 2024-09-21T03:17:27.636 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:17:27.636 INFO:teuthology.orchestra.run.smithi162.stdout: journal zero on create = true 2024-09-21T03:17:27.637 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:17:27.637 INFO:teuthology.orchestra.run.smithi162.stdout: filestore ondisk finisher threads = 3 2024-09-21T03:17:27.637 INFO:teuthology.orchestra.run.smithi162.stdout: filestore apply finisher threads = 3 2024-09-21T03:17:27.637 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:17:27.637 INFO:teuthology.orchestra.run.smithi162.stdout: bdev debug aio = true 2024-09-21T03:17:27.637 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug misdirected ops = true 2024-09-21T03:17:27.637 INFO:teuthology.orchestra.run.smithi162.stdout: bdev async discard = True 2024-09-21T03:17:27.637 INFO:teuthology.orchestra.run.smithi162.stdout: bdev enable discard = True 2024-09-21T03:17:27.637 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore allocator = bitmap 2024-09-21T03:17:27.637 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore block size = 96636764160 2024-09-21T03:17:27.637 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore fsck on mount = True 2024-09-21T03:17:27.637 INFO:teuthology.orchestra.run.smithi162.stdout: debug bluefs = 1/20 2024-09-21T03:17:27.637 INFO:teuthology.orchestra.run.smithi162.stdout: debug bluestore = 1/20 2024-09-21T03:17:27.637 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-09-21T03:17:27.638 INFO:teuthology.orchestra.run.smithi162.stdout: debug osd = 20 2024-09-21T03:17:27.638 INFO:teuthology.orchestra.run.smithi162.stdout: debug rocksdb = 4/10 2024-09-21T03:17:27.638 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T03:17:27.638 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd full ratio = 0.9 2024-09-21T03:17:27.638 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd nearfull ratio = 0.8 2024-09-21T03:17:27.638 INFO:teuthology.orchestra.run.smithi162.stdout: osd failsafe full ratio = 0.95 2024-09-21T03:17:27.638 INFO:teuthology.orchestra.run.smithi162.stdout: osd objectstore = bluestore 2024-09-21T03:17:27.638 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:17:27.638 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr] 2024-09-21T03:17:27.638 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-09-21T03:17:27.638 INFO:teuthology.orchestra.run.smithi162.stdout: debug mgr = 20 2024-09-21T03:17:27.638 INFO:teuthology.orchestra.run.smithi162.stdout: debug mon = 20 2024-09-21T03:17:27.638 INFO:teuthology.orchestra.run.smithi162.stdout: debug auth = 20 2024-09-21T03:17:27.638 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min pgs per osd = 4 2024-09-21T03:17:27.639 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min bytes per osd = 10 2024-09-21T03:17:27.639 INFO:teuthology.orchestra.run.smithi162.stdout: mgr/telemetry/nag = false 2024-09-21T03:17:27.639 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:17:27.639 INFO:teuthology.orchestra.run.smithi162.stdout:[mon] 2024-09-21T03:17:27.639 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-09-21T03:17:27.639 INFO:teuthology.orchestra.run.smithi162.stdout: debug mon = 20 2024-09-21T03:17:27.639 INFO:teuthology.orchestra.run.smithi162.stdout: debug paxos = 20 2024-09-21T03:17:27.639 INFO:teuthology.orchestra.run.smithi162.stdout: debug auth = 20 2024-09-21T03:17:27.639 INFO:teuthology.orchestra.run.smithi162.stdout: mon data avail warn = 5 2024-09-21T03:17:27.639 INFO:teuthology.orchestra.run.smithi162.stdout: mon mgr mkfs grace = 240 2024-09-21T03:17:27.639 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min pgs per osd = 4 2024-09-21T03:17:27.639 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd reporter subtree level = osd 2024-09-21T03:17:27.639 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd prime pg temp = true 2024-09-21T03:17:27.639 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min bytes per osd = 10 2024-09-21T03:17:27.640 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:17:27.640 INFO:teuthology.orchestra.run.smithi162.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T03:17:27.640 INFO:teuthology.orchestra.run.smithi162.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T03:17:27.640 INFO:teuthology.orchestra.run.smithi162.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T03:17:27.640 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:17:27.640 INFO:teuthology.orchestra.run.smithi162.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T03:17:27.640 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T03:17:27.640 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T03:17:27.640 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:17:27.640 INFO:teuthology.orchestra.run.smithi162.stdout: # 1m isn't quite enough 2024-09-21T03:17:27.640 INFO:teuthology.orchestra.run.smithi162.stdout: mon_down_mkfs_grace = 2m 2024-09-21T03:17:27.640 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:17:27.640 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_filestore_osds = false 2024-09-21T03:17:27.640 INFO:teuthology.orchestra.run.smithi162.stdout: mon down mkfs grace = 300 2024-09-21T03:17:27.640 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-21T03:17:27.641 INFO:teuthology.orchestra.run.smithi162.stdout:[client] 2024-09-21T03:17:27.641 INFO:teuthology.orchestra.run.smithi162.stdout: rgw cache enabled = true 2024-09-21T03:17:27.641 INFO:teuthology.orchestra.run.smithi162.stdout: rgw enable ops log = true 2024-09-21T03:17:27.641 INFO:teuthology.orchestra.run.smithi162.stdout: rgw enable usage log = true 2024-09-21T03:17:27.641 INFO:teuthology.orchestra.run.smithi162.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T03:17:27.641 INFO:teuthology.orchestra.run.smithi162.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T03:17:27.641 INFO:teuthology.orchestra.run.smithi162.stdout: pid file = "" 2024-09-21T03:17:27.641 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.a] 2024-09-21T03:17:27.641 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.b] 2024-09-21T03:17:27.641 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.c] 2024-09-21T03:17:27.641 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.a] 2024-09-21T03:17:27.641 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.c] 2024-09-21T03:17:27.641 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.b] 2024-09-21T03:17:27.641 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.d] 2024-09-21T03:17:27.643 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-21T03:17:27.643 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-21T03:17:27.747 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-21T03:17:27.747 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:17:27.748 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-21T03:17:27.763 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:17:27.763 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-21T03:17:27.818 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi105.front.sepia.ceph.com 2024-09-21T03:17:27.819 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:17:27.819 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-21T03:17:27.819 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T03:17:27.892 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:17:27.892 DEBUG:teuthology.orchestra.run.smithi105:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-21T03:17:27.947 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi162.front.sepia.ceph.com 2024-09-21T03:17:27.948 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:17:27.948 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-21T03:17:27.948 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T03:17:27.983 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:17:27.983 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-21T03:17:28.039 INFO:tasks.ceph:Setting up mon nodes... 2024-09-21T03:17:28.039 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-21T03:17:28.039 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-21T03:17:28.098 INFO:teuthology.orchestra.run.smithi105.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-21T03:17:28.101 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-21T03:17:28.173 INFO:teuthology.orchestra.run.smithi162.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-21T03:17:28.176 INFO:tasks.ceph:Setting up mds nodes... 2024-09-21T03:17:28.177 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-21T03:17:28.237 INFO:teuthology.orchestra.run.smithi105.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-21T03:17:28.240 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-21T03:17:28.266 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-21T03:17:28.366 INFO:teuthology.orchestra.run.smithi105.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-21T03:17:28.369 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-21T03:17:28.394 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-21T03:17:28.454 INFO:teuthology.orchestra.run.smithi162.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-21T03:17:28.457 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-21T03:17:28.482 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-21T03:17:28.582 INFO:teuthology.orchestra.run.smithi162.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-21T03:17:28.585 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-21T03:17:28.611 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-21T03:17:28.611 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T03:17:28.661 INFO:teuthology.orchestra.run.smithi105.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-21T03:17:28.675 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-21T03:17:28.724 INFO:teuthology.orchestra.run.smithi105.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-21T03:17:28.737 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-21T03:17:28.788 INFO:teuthology.orchestra.run.smithi162.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-21T03:17:28.801 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-21T03:17:28.851 INFO:teuthology.orchestra.run.smithi162.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-21T03:17:28.865 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-21T03:17:28.865 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi105.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi162.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-21T03:17:28.865 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-21T03:17:28.890 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T03:17:28.890 INFO:tasks.ceph:role: osd.0 2024-09-21T03:17:28.890 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi105.front.sepia.ceph.com 2024-09-21T03:17:28.890 DEBUG:teuthology.orchestra.run.smithi105:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-21T03:17:28.962 INFO:teuthology.orchestra.run.smithi105.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T03:17:28.962 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T03:17:28.962 INFO:teuthology.orchestra.run.smithi105.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T03:17:28.962 INFO:teuthology.orchestra.run.smithi105.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T03:17:28.962 INFO:teuthology.orchestra.run.smithi105.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T03:17:28.963 INFO:teuthology.orchestra.run.smithi105.stdout: = sunit=0 swidth=0 blks 2024-09-21T03:17:28.963 INFO:teuthology.orchestra.run.smithi105.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T03:17:28.963 INFO:teuthology.orchestra.run.smithi105.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T03:17:28.963 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T03:17:28.963 INFO:teuthology.orchestra.run.smithi105.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T03:17:29.478 INFO:teuthology.orchestra.run.smithi105.stdout:Discarding blocks...Done. 2024-09-21T03:17:29.480 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi105.front.sepia.ceph.com -o noatime 2024-09-21T03:17:29.481 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-21T03:17:29.605 DEBUG:teuthology.orchestra.run.smithi105:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-21T03:17:29.637 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-21T03:17:29.704 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T03:17:29.704 INFO:tasks.ceph:role: osd.1 2024-09-21T03:17:29.704 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi105.front.sepia.ceph.com 2024-09-21T03:17:29.704 DEBUG:teuthology.orchestra.run.smithi105:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-21T03:17:29.778 INFO:teuthology.orchestra.run.smithi105.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T03:17:29.778 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T03:17:29.778 INFO:teuthology.orchestra.run.smithi105.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T03:17:29.778 INFO:teuthology.orchestra.run.smithi105.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T03:17:29.778 INFO:teuthology.orchestra.run.smithi105.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T03:17:29.779 INFO:teuthology.orchestra.run.smithi105.stdout: = sunit=0 swidth=0 blks 2024-09-21T03:17:29.779 INFO:teuthology.orchestra.run.smithi105.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T03:17:29.779 INFO:teuthology.orchestra.run.smithi105.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T03:17:29.779 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T03:17:29.779 INFO:teuthology.orchestra.run.smithi105.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T03:17:30.226 INFO:teuthology.orchestra.run.smithi105.stdout:Discarding blocks...Done. 2024-09-21T03:17:30.228 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi105.front.sepia.ceph.com -o noatime 2024-09-21T03:17:30.228 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-21T03:17:30.318 DEBUG:teuthology.orchestra.run.smithi105:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-21T03:17:30.346 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-21T03:17:30.410 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T03:17:30.410 INFO:tasks.ceph:role: osd.2 2024-09-21T03:17:30.410 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi105.front.sepia.ceph.com 2024-09-21T03:17:30.411 DEBUG:teuthology.orchestra.run.smithi105:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-21T03:17:30.483 INFO:teuthology.orchestra.run.smithi105.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T03:17:30.483 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T03:17:30.483 INFO:teuthology.orchestra.run.smithi105.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T03:17:30.484 INFO:teuthology.orchestra.run.smithi105.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T03:17:30.484 INFO:teuthology.orchestra.run.smithi105.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T03:17:30.484 INFO:teuthology.orchestra.run.smithi105.stdout: = sunit=0 swidth=0 blks 2024-09-21T03:17:30.484 INFO:teuthology.orchestra.run.smithi105.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T03:17:30.484 INFO:teuthology.orchestra.run.smithi105.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T03:17:30.484 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T03:17:30.484 INFO:teuthology.orchestra.run.smithi105.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T03:17:30.972 INFO:teuthology.orchestra.run.smithi105.stdout:Discarding blocks...Done. 2024-09-21T03:17:30.974 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi105.front.sepia.ceph.com -o noatime 2024-09-21T03:17:30.974 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-21T03:17:31.114 DEBUG:teuthology.orchestra.run.smithi105:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-21T03:17:31.144 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-21T03:17:31.209 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T03:17:31.209 INFO:tasks.ceph:role: osd.3 2024-09-21T03:17:31.209 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi105.front.sepia.ceph.com 2024-09-21T03:17:31.210 DEBUG:teuthology.orchestra.run.smithi105:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-21T03:17:31.281 INFO:teuthology.orchestra.run.smithi105.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T03:17:31.281 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T03:17:31.281 INFO:teuthology.orchestra.run.smithi105.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T03:17:31.281 INFO:teuthology.orchestra.run.smithi105.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T03:17:31.281 INFO:teuthology.orchestra.run.smithi105.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T03:17:31.281 INFO:teuthology.orchestra.run.smithi105.stdout: = sunit=0 swidth=0 blks 2024-09-21T03:17:31.282 INFO:teuthology.orchestra.run.smithi105.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T03:17:31.282 INFO:teuthology.orchestra.run.smithi105.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T03:17:31.282 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T03:17:31.282 INFO:teuthology.orchestra.run.smithi105.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T03:17:31.805 INFO:teuthology.orchestra.run.smithi105.stdout:Discarding blocks...Done. 2024-09-21T03:17:31.807 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi105.front.sepia.ceph.com -o noatime 2024-09-21T03:17:31.807 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-21T03:17:31.947 DEBUG:teuthology.orchestra.run.smithi105:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-21T03:17:31.981 DEBUG:teuthology.orchestra.run.smithi105:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T03:17:32.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:17:32.085+0000 7f636ae11640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-21T03:17:32.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:17:32.087+0000 7f636ae11640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-21T03:17:32.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:17:32.087+0000 7f636ae11640 -1 bdev(0x5569d74e5900 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-21T03:17:32.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:17:32.087+0000 7f636ae11640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-21T03:17:35.005 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T03:17:35.033 DEBUG:teuthology.orchestra.run.smithi105:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T03:17:35.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:17:35.133+0000 7efcaae87640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-21T03:17:35.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:17:35.134+0000 7efcaae87640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-21T03:17:35.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:17:35.134+0000 7efcaae87640 -1 bdev(0x564c7600d900 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-21T03:17:35.137 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:17:35.134+0000 7efcaae87640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-21T03:17:38.051 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T03:17:38.080 DEBUG:teuthology.orchestra.run.smithi105:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T03:17:38.182 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:17:38.179+0000 7f3122631640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-21T03:17:38.182 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:17:38.179+0000 7f3122631640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-21T03:17:38.182 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:17:38.180+0000 7f3122631640 -1 bdev(0x562b6c4e5900 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-21T03:17:38.182 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:17:38.180+0000 7f3122631640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-21T03:17:41.354 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T03:17:41.380 DEBUG:teuthology.orchestra.run.smithi105:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T03:17:41.476 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:17:41.473+0000 7f418d683640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-21T03:17:41.476 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:17:41.473+0000 7f418d683640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-21T03:17:41.476 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:17:41.473+0000 7f418d683640 -1 bdev(0x5584d77f9900 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-21T03:17:41.476 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:17:41.474+0000 7f418d683640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-21T03:17:44.887 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T03:17:44.916 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-21T03:17:44.946 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T03:17:44.946 INFO:tasks.ceph:role: osd.4 2024-09-21T03:17:44.946 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi162.front.sepia.ceph.com 2024-09-21T03:17:44.946 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-21T03:17:45.022 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T03:17:45.022 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T03:17:45.022 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T03:17:45.022 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T03:17:45.022 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T03:17:45.022 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-09-21T03:17:45.022 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T03:17:45.023 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T03:17:45.023 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T03:17:45.023 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T03:17:45.521 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-09-21T03:17:45.523 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-09-21T03:17:45.523 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-21T03:17:45.649 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-21T03:17:45.686 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-21T03:17:45.754 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T03:17:45.754 INFO:tasks.ceph:role: osd.5 2024-09-21T03:17:45.754 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi162.front.sepia.ceph.com 2024-09-21T03:17:45.755 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-21T03:17:45.829 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T03:17:45.829 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T03:17:45.829 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T03:17:45.829 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T03:17:45.829 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T03:17:45.829 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-09-21T03:17:45.829 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T03:17:45.829 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T03:17:45.829 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T03:17:45.829 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T03:17:46.292 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-09-21T03:17:46.294 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-09-21T03:17:46.294 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-21T03:17:46.387 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-21T03:17:46.419 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-21T03:17:46.486 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T03:17:46.486 INFO:tasks.ceph:role: osd.6 2024-09-21T03:17:46.486 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi162.front.sepia.ceph.com 2024-09-21T03:17:46.486 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-21T03:17:46.559 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T03:17:46.559 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T03:17:46.559 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T03:17:46.559 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T03:17:46.560 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T03:17:46.560 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-09-21T03:17:46.560 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T03:17:46.560 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T03:17:46.560 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T03:17:46.560 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T03:17:47.049 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-09-21T03:17:47.052 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-09-21T03:17:47.052 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-21T03:17:47.204 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-21T03:17:47.236 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-21T03:17:47.303 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T03:17:47.303 INFO:tasks.ceph:role: osd.7 2024-09-21T03:17:47.303 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi162.front.sepia.ceph.com 2024-09-21T03:17:47.303 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-21T03:17:47.377 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T03:17:47.377 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T03:17:47.377 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T03:17:47.377 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T03:17:47.378 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T03:17:47.378 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-09-21T03:17:47.378 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T03:17:47.378 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T03:17:47.378 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T03:17:47.378 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T03:17:47.898 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-09-21T03:17:47.900 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-09-21T03:17:47.901 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-21T03:17:48.021 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-21T03:17:48.056 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T03:17:48.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:17:48.166+0000 7f3ee27a2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-21T03:17:48.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:17:48.166+0000 7f3ee27a2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-21T03:17:48.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:17:48.166+0000 7f3ee27a2640 -1 bdev(0x55728af11900 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-21T03:17:48.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:17:48.166+0000 7f3ee27a2640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-21T03:17:51.567 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-21T03:17:51.594 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T03:17:51.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:17:51.687+0000 7f3257d58640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-21T03:17:51.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:17:51.687+0000 7f3257d58640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-21T03:17:51.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:17:51.687+0000 7f3257d58640 -1 bdev(0x561b4b1dd900 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-21T03:17:51.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:17:51.688+0000 7f3257d58640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-21T03:17:55.345 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-21T03:17:55.373 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T03:17:55.473 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:17:55.471+0000 7f9c6d7c5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-21T03:17:55.473 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:17:55.471+0000 7f9c6d7c5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-21T03:17:55.473 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:17:55.471+0000 7f9c6d7c5640 -1 bdev(0x556789c5d900 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-21T03:17:55.473 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:17:55.472+0000 7f9c6d7c5640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-21T03:17:55.669 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:17:55.672 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:17:58.384 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-21T03:17:58.410 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T03:17:58.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:17:58.504+0000 7f7779f1b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-21T03:17:58.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:17:58.504+0000 7f7779f1b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-21T03:17:58.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:17:58.504+0000 7f7779f1b640 -1 bdev(0x55d97346d900 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-21T03:17:58.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:17:58.505+0000 7f7779f1b640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-21T03:18:01.671 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-21T03:18:01.696 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-21T03:18:01.696 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:18:01.696 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-21T03:18:01.727 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:18:01.727 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-21T03:18:01.796 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:18:01.796 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-21T03:18:01.864 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:18:01.865 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-21T03:18:01.932 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:18:01.932 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-21T03:18:02.000 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:18:02.000 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-21T03:18:02.066 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:18:02.066 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-21T03:18:02.130 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:18:02.131 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-21T03:18:02.157 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:18:02.157 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-21T03:18:02.223 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:18:02.223 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-21T03:18:02.289 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:18:02.289 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-21T03:18:02.354 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:18:02.355 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-21T03:18:02.419 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:18:02.419 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-21T03:18:02.484 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:18:02.484 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-21T03:18:02.549 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:18:02.549 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-21T03:18:02.564 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:18:02.564 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-21T03:18:02.619 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:18:02.619 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-21T03:18:02.634 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:18:02.634 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-21T03:18:02.689 INFO:tasks.ceph:Adding keys to all mons... 2024-09-21T03:18:02.689 DEBUG:teuthology.orchestra.run.smithi105:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-21T03:18:02.692 DEBUG:teuthology.orchestra.run.smithi162:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-21T03:18:02.732 INFO:teuthology.orchestra.run.smithi105.stdout:[mgr.y] 2024-09-21T03:18:02.733 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQDIOu5mh07bBRAAflFF00xr1ew4zttUi5TGng== 2024-09-21T03:18:02.733 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.a] 2024-09-21T03:18:02.733 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQDIOu5mtIIZDhAAJIXLpzTFBOFhnOwLzsdL6w== 2024-09-21T03:18:02.733 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.c] 2024-09-21T03:18:02.733 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQDIOu5mwQzQFRAAElYtgnIdYzzkeg8AtiU+kA== 2024-09-21T03:18:02.733 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.0] 2024-09-21T03:18:02.733 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQDMOu5mrSk2BRAAuEPjuEeUJEI3Sa2fiLaJyw== 2024-09-21T03:18:02.733 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.1] 2024-09-21T03:18:02.733 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQDPOu5mAT4UCBAAase7NV3ARBSu4QloaQdlzA== 2024-09-21T03:18:02.733 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.2] 2024-09-21T03:18:02.733 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQDSOu5ma4LRChAASottrmolMcagbspeyGVzBQ== 2024-09-21T03:18:02.733 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.3] 2024-09-21T03:18:02.733 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQDVOu5mD5RWHBAAKuNr4F3GA0EP566aQ07ZVw== 2024-09-21T03:18:02.734 INFO:teuthology.orchestra.run.smithi105.stdout:[mgr.x] 2024-09-21T03:18:02.734 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQDIOu5m92lTChAAQ61muQmc6uBs7b5mq3Zt8g== 2024-09-21T03:18:02.734 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.b] 2024-09-21T03:18:02.734 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQDIOu5mGKANGxAAeAuUYMtLP7GXKfIELR7qMA== 2024-09-21T03:18:02.734 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.d] 2024-09-21T03:18:02.734 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQDIOu5mZkWyIhAAu4XWptFcbDrYjozzrgMcGQ== 2024-09-21T03:18:02.734 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.4] 2024-09-21T03:18:02.734 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQDcOu5m++UBChAAqmgoPBQ/as4tc+UQPwaflg== 2024-09-21T03:18:02.734 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.5] 2024-09-21T03:18:02.734 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQDfOu5maYYZKRAA1ungglTU3TW1B/XNRjBuZQ== 2024-09-21T03:18:02.734 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.6] 2024-09-21T03:18:02.734 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQDjOu5mmwIqHBAAf6oNdLNkmM9yufP8XA2+og== 2024-09-21T03:18:02.734 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.7] 2024-09-21T03:18:02.734 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQDmOu5mtCciHhAAPTnZubJ+7mGXcXZykCWxHg== 2024-09-21T03:18:02.735 INFO:teuthology.orchestra.run.smithi105.stdout:[client.0] 2024-09-21T03:18:02.735 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQDIOu5mughoJxAAhY0bzJmq+oNyzCdtafkC9w== 2024-09-21T03:18:02.735 INFO:teuthology.orchestra.run.smithi105.stdout:[client.2] 2024-09-21T03:18:02.735 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQDIOu5mKi0mKxAAoetnL61ujgtg2cvscdjCLQ== 2024-09-21T03:18:02.735 INFO:teuthology.orchestra.run.smithi105.stdout:[client.1] 2024-09-21T03:18:02.735 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQDIOu5m4Vn2LhAAnEa/01ql5quuRCVHOVwB7w== 2024-09-21T03:18:02.735 INFO:teuthology.orchestra.run.smithi105.stdout:[client.3] 2024-09-21T03:18:02.735 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQDIOu5mWZDAMhAAs4BuFHMSkJa6+piN/FeeXQ== 2024-09-21T03:18:02.752 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr.y] 2024-09-21T03:18:02.752 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQDIOu5mh07bBRAAflFF00xr1ew4zttUi5TGng== 2024-09-21T03:18:02.752 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.a] 2024-09-21T03:18:02.752 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQDIOu5mtIIZDhAAJIXLpzTFBOFhnOwLzsdL6w== 2024-09-21T03:18:02.753 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.c] 2024-09-21T03:18:02.753 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQDIOu5mwQzQFRAAElYtgnIdYzzkeg8AtiU+kA== 2024-09-21T03:18:02.753 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.0] 2024-09-21T03:18:02.753 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQDMOu5mrSk2BRAAuEPjuEeUJEI3Sa2fiLaJyw== 2024-09-21T03:18:02.753 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.1] 2024-09-21T03:18:02.753 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQDPOu5mAT4UCBAAase7NV3ARBSu4QloaQdlzA== 2024-09-21T03:18:02.753 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.2] 2024-09-21T03:18:02.753 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQDSOu5ma4LRChAASottrmolMcagbspeyGVzBQ== 2024-09-21T03:18:02.753 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.3] 2024-09-21T03:18:02.753 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQDVOu5mD5RWHBAAKuNr4F3GA0EP566aQ07ZVw== 2024-09-21T03:18:02.753 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr.x] 2024-09-21T03:18:02.753 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQDIOu5m92lTChAAQ61muQmc6uBs7b5mq3Zt8g== 2024-09-21T03:18:02.753 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.b] 2024-09-21T03:18:02.753 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQDIOu5mGKANGxAAeAuUYMtLP7GXKfIELR7qMA== 2024-09-21T03:18:02.754 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.d] 2024-09-21T03:18:02.754 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQDIOu5mZkWyIhAAu4XWptFcbDrYjozzrgMcGQ== 2024-09-21T03:18:02.754 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.4] 2024-09-21T03:18:02.754 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQDcOu5m++UBChAAqmgoPBQ/as4tc+UQPwaflg== 2024-09-21T03:18:02.754 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.5] 2024-09-21T03:18:02.754 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQDfOu5maYYZKRAA1ungglTU3TW1B/XNRjBuZQ== 2024-09-21T03:18:02.754 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.6] 2024-09-21T03:18:02.754 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQDjOu5mmwIqHBAAf6oNdLNkmM9yufP8XA2+og== 2024-09-21T03:18:02.754 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.7] 2024-09-21T03:18:02.754 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQDmOu5mtCciHhAAPTnZubJ+7mGXcXZykCWxHg== 2024-09-21T03:18:02.754 INFO:teuthology.orchestra.run.smithi162.stdout:[client.0] 2024-09-21T03:18:02.754 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQDIOu5mughoJxAAhY0bzJmq+oNyzCdtafkC9w== 2024-09-21T03:18:02.754 INFO:teuthology.orchestra.run.smithi162.stdout:[client.2] 2024-09-21T03:18:02.754 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQDIOu5mKi0mKxAAoetnL61ujgtg2cvscdjCLQ== 2024-09-21T03:18:02.754 INFO:teuthology.orchestra.run.smithi162.stdout:[client.1] 2024-09-21T03:18:02.755 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQDIOu5m4Vn2LhAAnEa/01ql5quuRCVHOVwB7w== 2024-09-21T03:18:02.755 INFO:teuthology.orchestra.run.smithi162.stdout:[client.3] 2024-09-21T03:18:02.755 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQDIOu5mWZDAMhAAs4BuFHMSkJa6+piN/FeeXQ== 2024-09-21T03:18:02.756 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T03:18:02.778 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T03:18:02.858 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T03:18:02.860 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T03:18:02.924 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T03:18:02.926 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T03:18:02.990 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T03:18:02.992 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T03:18:03.053 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T03:18:03.056 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T03:18:03.117 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T03:18:03.119 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T03:18:03.180 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T03:18:03.182 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T03:18:03.245 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T03:18:03.247 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T03:18:03.308 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T03:18:03.310 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T03:18:03.374 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T03:18:03.377 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T03:18:03.440 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T03:18:03.443 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T03:18:03.504 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T03:18:03.506 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T03:18:03.568 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T03:18:03.570 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T03:18:03.631 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T03:18:03.633 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T03:18:03.694 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T03:18:03.697 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T03:18:03.762 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T03:18:03.764 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T03:18:03.828 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T03:18:03.831 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T03:18:03.895 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T03:18:03.897 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T03:18:03.961 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-21T03:18:03.961 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-21T03:18:03.986 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T03:18:04.091 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-21T03:18:04.116 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-21T03:18:04.141 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T03:18:04.248 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-21T03:18:04.272 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-21T03:18:04.337 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T03:18:04.447 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-21T03:18:04.471 DEBUG:teuthology.orchestra.run.smithi105:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-21T03:18:04.473 DEBUG:teuthology.orchestra.run.smithi162:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-21T03:18:04.526 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-21T03:18:04.526 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-21T03:18:04.526 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-21T03:18:04.528 INFO:tasks.ceph.mon.a:Started 2024-09-21T03:18:04.529 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-21T03:18:04.529 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-21T03:18:04.568 INFO:tasks.ceph.mon.b:Started 2024-09-21T03:18:04.569 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-21T03:18:04.569 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-21T03:18:04.571 INFO:tasks.ceph.mon.c:Started 2024-09-21T03:18:04.571 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-21T03:18:04.571 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-21T03:18:04.571 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-21T03:18:04.573 INFO:tasks.ceph.mgr.y:Started 2024-09-21T03:18:04.573 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-21T03:18:04.573 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-21T03:18:04.575 INFO:tasks.ceph.mgr.x:Started 2024-09-21T03:18:04.575 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-09-21T03:18:04.575 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-09-21T03:18:04.579 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-09-21T03:18:04.579 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph config set client debug_client 20 2024-09-21T03:18:04.622 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-09-21T03:18:04.622 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph config set client debug_ms 1 2024-09-21T03:18:04.664 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-09-21T03:18:04.664 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-09-21T03:18:04.707 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-09-21T03:18:04.707 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-09-21T03:18:04.750 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-09-21T03:18:04.750 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-09-21T03:18:04.793 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-09-21T03:18:04.793 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-09-21T03:18:04.836 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2024-09-21T03:18:04.836 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph config set mds debug_ms 2 2024-09-21T03:18:04.879 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-09-21T03:18:04.880 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-09-21T03:18:04.924 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-09-21T03:18:04.924 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-09-21T03:18:04.971 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-09-21T03:18:04.971 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-09-21T03:18:05.018 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-09-21T03:18:05.018 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-09-21T03:18:05.045 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.042+0000 7fe8fd7fa640 1 -- 172.21.15.105:0/850130820 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9181f3cf0 msgr2=0x7fe9181f4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.045 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.042+0000 7fe8fd7fa640 1 --2- 172.21.15.105:0/850130820 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9181f3cf0 0x7fe9181f4100 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe9000105f0 tx=0x7fe90c004730 comp rx=0 tx=0).stop 2024-09-21T03:18:05.045 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.043+0000 7fe8fd7fa640 1 -- 172.21.15.105:0/850130820 shutdown_connections 2024-09-21T03:18:05.045 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.043+0000 7fe8fd7fa640 1 --2- 172.21.15.105:0/850130820 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9180b4e50 0x7fe9180b5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.045 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.043+0000 7fe8fd7fa640 1 --2- 172.21.15.105:0/850130820 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9181f3cf0 0x7fe9181f4100 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.045 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.043+0000 7fe8fd7fa640 1 --2- 172.21.15.105:0/850130820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe900004800 0x7fe918157f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.046 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-09-21T03:18:05.046 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-09-21T03:18:05.047 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.043+0000 7fe8fd7fa640 1 -- 172.21.15.105:0/850130820 >> 172.21.15.105:0/850130820 conn(0x7fe9180cd4b0 msgr2=0x7fe9180b05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:05.047 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.044+0000 7fe8fd7fa640 1 -- 172.21.15.105:0/850130820 shutdown_connections 2024-09-21T03:18:05.048 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.044+0000 7fe8fd7fa640 1 -- 172.21.15.105:0/850130820 wait complete. 2024-09-21T03:18:05.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.049+0000 7fd78f606640 1 -- 172.21.15.105:0/2065324453 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7880b6110 con 0x7fd7881f49a0 2024-09-21T03:18:05.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.050+0000 7fd78f606640 1 -- 172.21.15.105:0/2065324453 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7881586e0 con 0x7fd7881f49a0 2024-09-21T03:18:05.052 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T03:18:05.052 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-09-21T03:18:05.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.051+0000 7fd77dffb640 1 -- 172.21.15.105:0/2065324453 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd7780047a0 con 0x7fd7881f49a0 2024-09-21T03:18:05.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.051+0000 7fd77dffb640 1 -- 172.21.15.105:0/2065324453 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd778033610 con 0x7fd7881f49a0 2024-09-21T03:18:05.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.051+0000 7feca4e9b640 1 -- 172.21.15.105:0/3895383600 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7fec78005310 con 0x7feca00c6900 2024-09-21T03:18:05.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.053+0000 7f73ad271640 1 -- 172.21.15.105:0/1184294514 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f7380005310 con 0x7f73a81594f0 2024-09-21T03:18:05.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.053+0000 7fd76b7fe640 1 -- 172.21.15.105:0/2065324453 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd78815ae10 con 0x7fd7881f49a0 2024-09-21T03:18:05.056 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T03:18:05.059 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-09-21T03:18:05.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.058+0000 7fd77dffb640 1 -- 172.21.15.105:0/2065324453 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fd77803f030 con 0x7fd7881f49a0 2024-09-21T03:18:05.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.066+0000 7f61fffff640 1 -- 172.21.15.105:0/2050835559 <== mon.2 v2:172.21.15.162:3301/0 9 ==== config(3 keys) ==== 85+0+0 (secure 0 0 0) 0x7f620c039d60 con 0x7f62180cec40 2024-09-21T03:18:05.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.066+0000 7fc3dbfff640 1 -- 172.21.15.105:0/2334939784 <== mon.2 v2:172.21.15.162:3301/0 9 ==== config(3 keys) ==== 85+0+0 (secure 0 0 0) 0x7fc3ec0108b0 con 0x7fc3f40c6490 2024-09-21T03:18:05.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.069+0000 7fec8effd640 1 -- 172.21.15.105:0/3895383600 <== mon.0 v2:172.21.15.105:3300/0 9 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v4)=0 v4) ==== 123+0+0 (secure 0 0 0) 0x7fec90011730 con 0x7feca00c6900 2024-09-21T03:18:05.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.069+0000 7fec8effd640 1 -- 172.21.15.105:0/3895383600 <== mon.0 v2:172.21.15.105:3300/0 10 ==== config(3 keys) ==== 85+0+0 (secure 0 0 0) 0x7fec90011950 con 0x7feca00c6900 2024-09-21T03:18:05.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.070+0000 7fd77dffb640 1 -- 172.21.15.105:0/2065324453 <== mon.1 v2:172.21.15.162:3300/0 7 ==== config(3 keys) ==== 85+0+0 (secure 0 0 0) 0x7fd7780317a0 con 0x7fd7881f49a0 2024-09-21T03:18:05.076 INFO:tasks.ceph:setting config [mgr] client_mount_timeout = 30 2024-09-21T03:18:05.076 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph config set mgr client_mount_timeout 30 2024-09-21T03:18:05.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.072+0000 7fec8cff9640 1 -- 172.21.15.105:0/3895383600 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feca00c6900 msgr2=0x7feca00ca6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.072+0000 7fec8cff9640 1 --2- 172.21.15.105:0/3895383600 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feca00c6900 0x7feca00ca6f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fec90010a40 tx=0x7fec90010f00 comp rx=0 tx=0).stop 2024-09-21T03:18:05.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.072+0000 7fec8cff9640 1 -- 172.21.15.105:0/3895383600 shutdown_connections 2024-09-21T03:18:05.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.072+0000 7fec8cff9640 1 --2- 172.21.15.105:0/3895383600 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feca0155900 0x7feca01f82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.072+0000 7fec8cff9640 1 --2- 172.21.15.105:0/3895383600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feca00c6d10 0x7feca01f7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.072+0000 7fec8cff9640 1 --2- 172.21.15.105:0/3895383600 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feca00c6900 0x7feca00ca6f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.072+0000 7fec8cff9640 1 -- 172.21.15.105:0/3895383600 >> 172.21.15.105:0/3895383600 conn(0x7feca00cdc60 msgr2=0x7feca0154a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:05.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.072+0000 7fec8cff9640 1 -- 172.21.15.105:0/3895383600 shutdown_connections 2024-09-21T03:18:05.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.072+0000 7fec8cff9640 1 -- 172.21.15.105:0/3895383600 wait complete. 2024-09-21T03:18:05.079 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.077+0000 7f61fffff640 1 -- 172.21.15.105:0/2050835559 <== mon.2 v2:172.21.15.162:3301/0 10 ==== config(4 keys) ==== 116+0+0 (secure 0 0 0) 0x7f620c043440 con 0x7f62180cec40 2024-09-21T03:18:05.079 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.074+0000 7f738f7fe640 1 -- 172.21.15.105:0/1184294514 <== mon.0 v2:172.21.15.105:3300/0 9 ==== config(3 keys) ==== 85+0+0 (secure 0 0 0) 0x7f73a00041c0 con 0x7f73a81594f0 2024-09-21T03:18:05.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.078+0000 7f738f7fe640 1 -- 172.21.15.105:0/1184294514 <== mon.0 v2:172.21.15.105:3300/0 10 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v5)=0 v5) ==== 123+0+0 (secure 0 0 0) 0x7f73a00043f0 con 0x7f73a81594f0 2024-09-21T03:18:05.082 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.078+0000 7f738f7fe640 1 -- 172.21.15.105:0/1184294514 <== mon.0 v2:172.21.15.105:3300/0 11 ==== config(4 keys) ==== 116+0+0 (secure 0 0 0) 0x7f73a0004690 con 0x7f73a81594f0 2024-09-21T03:18:05.082 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.078+0000 7fd77dffb640 1 -- 172.21.15.105:0/2065324453 <== mon.1 v2:172.21.15.162:3300/0 8 ==== config(4 keys) ==== 116+0+0 (secure 0 0 0) 0x7fd778033070 con 0x7fd7881f49a0 2024-09-21T03:18:05.082 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.079+0000 7fc3dbfff640 1 -- 172.21.15.105:0/2334939784 <== mon.2 v2:172.21.15.162:3301/0 10 ==== config(4 keys) ==== 116+0+0 (secure 0 0 0) 0x7fc3ec010b00 con 0x7fc3f40c6490 2024-09-21T03:18:05.085 INFO:tasks.ceph:setting config [mgr] debug_client = 20 2024-09-21T03:18:05.085 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph config set mgr debug_client 20 2024-09-21T03:18:05.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.086+0000 7f73ad271640 1 -- 172.21.15.105:0/1184294514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73a81594f0 msgr2=0x7f73a8159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.086+0000 7f73ad271640 1 --2- 172.21.15.105:0/1184294514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73a81594f0 0x7f73a8159900 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f73a0005fd0 tx=0x7f73a000ca80 comp rx=0 tx=0).stop 2024-09-21T03:18:05.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.087+0000 7f73ad271640 1 -- 172.21.15.105:0/1184294514 shutdown_connections 2024-09-21T03:18:05.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.088+0000 7f73ad271640 1 --2- 172.21.15.105:0/1184294514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73a81594f0 0x7f73a8159900 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.088+0000 7f73ad271640 1 --2- 172.21.15.105:0/1184294514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73a8155ce0 0x7f73a8150610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.088+0000 7f73ad271640 1 --2- 172.21.15.105:0/1184294514 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73a8074420 0x7f73a80c6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.088+0000 7f73ad271640 1 -- 172.21.15.105:0/1184294514 >> 172.21.15.105:0/1184294514 conn(0x7f73a806def0 msgr2=0x7f73a80cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:05.094 INFO:tasks.ceph:setting config [mgr] debug_mgr = 20 2024-09-21T03:18:05.094 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph config set mgr debug_mgr 20 2024-09-21T03:18:05.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.089+0000 7f73ad271640 1 -- 172.21.15.105:0/1184294514 shutdown_connections 2024-09-21T03:18:05.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.089+0000 7f73ad271640 1 -- 172.21.15.105:0/1184294514 wait complete. 2024-09-21T03:18:05.114 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.105+0000 7f0577d9b640 1 -- 172.21.15.105:0/3552085460 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f055c003a30 msgr2=0x7f055c003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.114 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.105+0000 7f0577d9b640 1 --2- 172.21.15.105:0/3552085460 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f055c003a30 0x7f055c003e80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0568010a20 tx=0x7f055c005830 comp rx=0 tx=0).stop 2024-09-21T03:18:05.114 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.106+0000 7f0576338640 1 -- 172.21.15.105:0/3552085460 reap_dead start 2024-09-21T03:18:05.114 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.106+0000 7f0577d9b640 1 -- 172.21.15.105:0/3552085460 shutdown_connections 2024-09-21T03:18:05.114 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.106+0000 7f0577d9b640 1 -- 172.21.15.105:0/3552085460 >> 172.21.15.105:0/3552085460 conn(0x7f05700b1cb0 msgr2=0x7f05700b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:05.115 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.111+0000 7f0577d9b640 1 -- 172.21.15.105:0/3552085460 shutdown_connections 2024-09-21T03:18:05.115 INFO:tasks.ceph:setting config [mgr] debug_ms = 1 2024-09-21T03:18:05.116 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph config set mgr debug_ms 1 2024-09-21T03:18:05.116 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.112+0000 7f0577d9b640 1 -- 172.21.15.105:0/3552085460 wait complete. 2024-09-21T03:18:05.117 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.115+0000 7f0577d9b640 1 Processor -- start 2024-09-21T03:18:05.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.120+0000 7f0577d9b640 1 -- start start 2024-09-21T03:18:05.128 INFO:tasks.ceph:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-21T03:18:05.129 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph config set mgr mon_warn_on_pool_no_app False 2024-09-21T03:18:05.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.135+0000 7f0577d9b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05700c3c50 0x7f05701fd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.136+0000 7f0577d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05701e6330 0x7f05701e6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.136+0000 7f0577d9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0570149cc0 0x7f057014a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.136+0000 7f0575b37640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05700c3c50 0x7f05701fd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:05.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.136+0000 7f0575b37640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05700c3c50 0x7f05701fd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.105:35554/0 (socket says 172.21.15.105:35554) 2024-09-21T03:18:05.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.137+0000 7f0575336640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05701e6330 0x7f05701e6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:05.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.137+0000 7f0575336640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05701e6330 0x7f05701e6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:33710/0 (socket says 172.21.15.105:33710) 2024-09-21T03:18:05.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.139+0000 7f0577d9b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f05700710a0 con 0x7f05701e6330 2024-09-21T03:18:05.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.139+0000 7f0577d9b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0570070f20 con 0x7f0570149cc0 2024-09-21T03:18:05.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.139+0000 7f0576338640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0570149cc0 0x7f057014a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:05.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.139+0000 7f0576338640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0570149cc0 0x7f057014a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.105:57448/0 (socket says 172.21.15.105:57448) 2024-09-21T03:18:05.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.139+0000 7f0576338640 1 -- 172.21.15.105:0/3771647550 learned_addr learned my addr 172.21.15.105:0/3771647550 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:05.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.139+0000 7f0577d9b640 1 -- 172.21.15.105:0/3771647550 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f05700cf010 con 0x7f05700c3c50 2024-09-21T03:18:05.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.142+0000 7f0575336640 1 -- 172.21.15.105:0/3771647550 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05700c3c50 msgr2=0x7f05701fd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.142+0000 7f0575336640 1 --2- 172.21.15.105:0/3771647550 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05700c3c50 0x7f05701fd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.142+0000 7f0575336640 1 -- 172.21.15.105:0/3771647550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0570149cc0 msgr2=0x7f057014a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.142+0000 7f0575336640 1 --2- 172.21.15.105:0/3771647550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0570149cc0 0x7f057014a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.150 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.142+0000 7f0575336640 1 -- 172.21.15.105:0/3771647550 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05701e6c80 con 0x7f05701e6330 2024-09-21T03:18:05.150 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.142+0000 7f0575336640 1 --2- 172.21.15.105:0/3771647550 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05701e6330 0x7f05701e6740 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f056c00c780 tx=0x7f056c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:05.150 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.142+0000 7f05667fc640 1 -- 172.21.15.105:0/3771647550 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f056c018030 con 0x7f05701e6330 2024-09-21T03:18:05.150 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.142+0000 7f05667fc640 1 -- 172.21.15.105:0/3771647550 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(4 keys) ==== 116+0+0 (secure 0 0 0) 0x7f056c00a9b0 con 0x7f05701e6330 2024-09-21T03:18:05.150 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.143+0000 7f05667fc640 1 -- 172.21.15.105:0/3771647550 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f056c00ade0 con 0x7f05701e6330 2024-09-21T03:18:05.150 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.143+0000 7f0575b37640 1 --2- 172.21.15.105:0/3771647550 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05700c3c50 0x7f05701fd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-21T03:18:05.150 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.143+0000 7f0577d9b640 1 -- 172.21.15.105:0/3771647550 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f057014a610 con 0x7f05701e6330 2024-09-21T03:18:05.150 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.143+0000 7f0577d9b640 1 -- 172.21.15.105:0/3771647550 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05701590b0 con 0x7f05701e6330 2024-09-21T03:18:05.158 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-09-21T03:18:05.158 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-09-21T03:18:05.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.148+0000 7f05667fc640 1 -- 172.21.15.105:0/3771647550 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f056c01b070 con 0x7f05701e6330 2024-09-21T03:18:05.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.148+0000 7f05667fc640 1 -- 172.21.15.105:0/3771647550 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f056c01d750 con 0x7f05701e6330 2024-09-21T03:18:05.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.150+0000 7f0577d9b640 1 -- 172.21.15.105:0/3771647550 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f057009e050 con 0x7f05701e6330 2024-09-21T03:18:05.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.155+0000 7f05667fc640 1 -- 172.21.15.105:0/3771647550 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f05701e6c80 con 0x7f05701e6330 2024-09-21T03:18:05.176 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-09-21T03:18:05.176 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-09-21T03:18:05.211 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.197+0000 7fc3f9ef2640 1 -- 172.21.15.105:0/2334939784 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7fc3cc0052f0 con 0x7fc3f40c6490 2024-09-21T03:18:05.218 DEBUG:tasks.ceph:set 22 configs 2024-09-21T03:18:05.218 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi105') 2024-09-21T03:18:05.218 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi105') 2024-09-21T03:18:05.219 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.216+0000 7fc3dbfff640 1 -- 172.21.15.105:0/2334939784 <== mon.2 v2:172.21.15.162:3301/0 11 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v6)=0 v6) ==== 108+0+0 (secure 0 0 0) 0x7fc3ec0196d0 con 0x7fc3f40c6490 2024-09-21T03:18:05.223 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.218+0000 7fe181d20640 1 -- 172.21.15.105:0/3260116777 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe17c15f7a0 msgr2=0x7fe17c06cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.224 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.218+0000 7fe181d20640 1 --2- 172.21.15.105:0/3260116777 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe17c15f7a0 0x7fe17c06cfc0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe17c073900 tx=0x7fe17002a580 comp rx=0 tx=0).stop 2024-09-21T03:18:05.224 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.219+0000 7fe181d20640 1 -- 172.21.15.105:0/3260116777 shutdown_connections 2024-09-21T03:18:05.224 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.219+0000 7fe181d20640 1 --2- 172.21.15.105:0/3260116777 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe17c15f7a0 0x7fe17c06cfc0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.224 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.219+0000 7fe181d20640 1 --2- 172.21.15.105:0/3260116777 >> v2:172.21.15.162:3300/0 conn(0x7fe17c0b50c0 0x7fe17c1625b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.224 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.219+0000 7fe181d20640 1 -- 172.21.15.105:0/3260116777 >> 172.21.15.105:0/3260116777 conn(0x7fe17c0b2e10 msgr2=0x7fe17c0b3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:05.228 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.225+0000 7fc3f9ef2640 1 -- 172.21.15.105:0/2334939784 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3f40c6490 msgr2=0x7fc3f4147ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.228 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.225+0000 7fc3f9ef2640 1 --2- 172.21.15.105:0/2334939784 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3f40c6490 0x7fc3f4147ae0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec00c490 tx=0x7fc3ec00c950 comp rx=0 tx=0).stop 2024-09-21T03:18:05.228 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.225+0000 7fc3f9ef2640 1 -- 172.21.15.105:0/2334939784 shutdown_connections 2024-09-21T03:18:05.228 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.226+0000 7fc3f9ef2640 1 --2- 172.21.15.105:0/2334939784 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3f40c6490 0x7fc3f4147ae0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.226+0000 7fc3f9ef2640 1 --2- 172.21.15.105:0/2334939784 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3f40c58a0 0x7fc3f41433c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.226+0000 7fc3f9ef2640 1 --2- 172.21.15.105:0/2334939784 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3f40afde0 0x7fc3f4159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.226+0000 7fc3f9ef2640 1 -- 172.21.15.105:0/2334939784 >> 172.21.15.105:0/2334939784 conn(0x7fc3f40cd480 msgr2=0x7fc3f406cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:05.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.223+0000 7fe181d20640 1 -- 172.21.15.105:0/3260116777 shutdown_connections 2024-09-21T03:18:05.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.223+0000 7fe181d20640 1 -- 172.21.15.105:0/3260116777 wait complete. 2024-09-21T03:18:05.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.226+0000 7fe181d20640 1 Processor -- start 2024-09-21T03:18:05.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.226+0000 7fe181d20640 1 -- start start 2024-09-21T03:18:05.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.228+0000 7fc3f9ef2640 1 -- 172.21.15.105:0/2334939784 shutdown_connections 2024-09-21T03:18:05.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.230+0000 7fc3f9ef2640 1 -- 172.21.15.105:0/2334939784 wait complete. 2024-09-21T03:18:05.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.231+0000 7fe181d20640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe17c06d500 0x7fe17c146bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.238 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.236+0000 7fe181d20640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe17c0b50c0 0x7fe17c0abc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.239 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.236+0000 7fe17b7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe17c06d500 0x7fe17c146bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:05.239 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.236+0000 7fe17b7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe17c06d500 0x7fe17c146bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.105:57466/0 (socket says 172.21.15.105:57466) 2024-09-21T03:18:05.239 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.236+0000 7fe17affd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe17c0b50c0 0x7fe17c0abc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:05.239 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.236+0000 7fe17affd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe17c0b50c0 0x7fe17c0abc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:33728/0 (socket says 172.21.15.105:33728) 2024-09-21T03:18:05.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.237+0000 7fe17b7fe640 1 -- 172.21.15.105:0/2935308963 learned_addr learned my addr 172.21.15.105:0/2935308963 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:05.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.237+0000 7fe181d20640 1 --2- 172.21.15.105:0/2935308963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe17c0acae0 0x7fe17c0ac140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.237+0000 7fe181d20640 1 -- 172.21.15.105:0/2935308963 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe17c15fd30 con 0x7fe17c0b50c0 2024-09-21T03:18:05.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.237+0000 7fe181d20640 1 -- 172.21.15.105:0/2935308963 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe17c15fbb0 con 0x7fe17c06d500 2024-09-21T03:18:05.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.237+0000 7fe17bfff640 1 --2- 172.21.15.105:0/2935308963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe17c0acae0 0x7fe17c0ac140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:05.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.237+0000 7fe181d20640 1 -- 172.21.15.105:0/2935308963 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe17c15feb0 con 0x7fe17c0acae0 2024-09-21T03:18:05.248 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.246+0000 7fe17bfff640 1 -- 172.21.15.105:0/2935308963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe17c06d500 msgr2=0x7fe17c146bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.246+0000 7fe17bfff640 1 --2- 172.21.15.105:0/2935308963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe17c06d500 0x7fe17c146bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.246+0000 7fe17bfff640 1 -- 172.21.15.105:0/2935308963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe17c0b50c0 msgr2=0x7fe17c0abc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.246+0000 7fe17bfff640 1 --2- 172.21.15.105:0/2935308963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe17c0b50c0 0x7fe17c0abc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.246+0000 7fe17bfff640 1 -- 172.21.15.105:0/2935308963 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe17c154ce0 con 0x7fe17c0acae0 2024-09-21T03:18:05.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.246+0000 7fe17affd640 1 --2- 172.21.15.105:0/2935308963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe17c0b50c0 0x7fe17c0abc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:18:05.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.246+0000 7fe17bfff640 1 --2- 172.21.15.105:0/2935308963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe17c0acae0 0x7fe17c0ac140 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe17400cb00 tx=0x7fe174002180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:05.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.249+0000 7fe163fff640 1 -- 172.21.15.105:0/2935308963 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17400abd0 con 0x7fe17c0acae0 2024-09-21T03:18:05.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.249+0000 7fe163fff640 1 -- 172.21.15.105:0/2935308963 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(4 keys) ==== 116+0+0 (secure 0 0 0) 0x7fe174017070 con 0x7fe17c0acae0 2024-09-21T03:18:05.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.249+0000 7fe163fff640 1 -- 172.21.15.105:0/2935308963 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe174012420 con 0x7fe17c0acae0 2024-09-21T03:18:05.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.249+0000 7fe181d20640 1 -- 172.21.15.105:0/2935308963 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe17c154fc0 con 0x7fe17c0acae0 2024-09-21T03:18:05.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.249+0000 7fe181d20640 1 -- 172.21.15.105:0/2935308963 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe17c155580 con 0x7fe17c0acae0 2024-09-21T03:18:05.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.255+0000 7fe163fff640 1 -- 172.21.15.105:0/2935308963 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe1740125c0 con 0x7fe17c0acae0 2024-09-21T03:18:05.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.255+0000 7fe163fff640 1 -- 172.21.15.105:0/2935308963 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe17401cb60 con 0x7fe17c0acae0 2024-09-21T03:18:05.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.256+0000 7fe161ffb640 1 -- 172.21.15.105:0/2935308963 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe17c06cfc0 con 0x7fe17c0acae0 2024-09-21T03:18:05.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.259+0000 7f61fdffb640 1 -- 172.21.15.105:0/2050835559 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f62180b4ae0 con 0x7f62180cec40 2024-09-21T03:18:05.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.260+0000 7fe163fff640 1 -- 172.21.15.105:0/2935308963 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fe17401cdb0 con 0x7fe17c0acae0 2024-09-21T03:18:05.269 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.267+0000 7f61fffff640 1 -- 172.21.15.105:0/2050835559 <== mon.2 v2:172.21.15.162:3301/0 11 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f620c043760 con 0x7f62180cec40 2024-09-21T03:18:05.269 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.267+0000 7f61fffff640 1 -- 172.21.15.105:0/2050835559 <== mon.2 v2:172.21.15.162:3301/0 12 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v7)=0 v7) ==== 114+0+0 (secure 0 0 0) 0x7f62180b4ae0 con 0x7f62180cec40 2024-09-21T03:18:05.269 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.267+0000 7fd77dffb640 1 -- 172.21.15.105:0/2065324453 <== mon.1 v2:172.21.15.162:3300/0 9 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd778004c20 con 0x7fd7881f49a0 2024-09-21T03:18:05.269 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.267+0000 7fe163fff640 1 -- 172.21.15.105:0/2935308963 <== mon.2 v2:172.21.15.162:3301/0 7 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe17401c550 con 0x7fe17c0acae0 2024-09-21T03:18:05.271 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.268+0000 7f05667fc640 1 -- 172.21.15.105:0/3771647550 <== mon.0 v2:172.21.15.105:3300/0 7 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f056c003830 con 0x7f05701e6330 2024-09-21T03:18:05.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.278+0000 7f61fdffb640 1 -- 172.21.15.105:0/2050835559 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62180cec40 msgr2=0x7f621814ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.278+0000 7f61fdffb640 1 --2- 172.21.15.105:0/2050835559 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62180cec40 0x7f621814ad70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f620c033000 tx=0x7f620c004730 comp rx=0 tx=0).stop 2024-09-21T03:18:05.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.279+0000 7f61fdffb640 1 -- 172.21.15.105:0/2050835559 shutdown_connections 2024-09-21T03:18:05.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.279+0000 7f61fdffb640 1 --2- 172.21.15.105:0/2050835559 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f621815ee60 0x7f621815ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.279+0000 7f61fdffb640 1 --2- 172.21.15.105:0/2050835559 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62180cec40 0x7f621814ad70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.279+0000 7f61fdffb640 1 --2- 172.21.15.105:0/2050835559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62180afa40 0x7f6218157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.279+0000 7f61fdffb640 1 -- 172.21.15.105:0/2050835559 >> 172.21.15.105:0/2050835559 conn(0x7f62180cd4b0 msgr2=0x7f621806d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:05.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.279+0000 7f61fdffb640 1 -- 172.21.15.105:0/2050835559 shutdown_connections 2024-09-21T03:18:05.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.279+0000 7f61fdffb640 1 -- 172.21.15.105:0/2050835559 wait complete. 2024-09-21T03:18:05.331 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi105') 2024-09-21T03:18:05.332 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi105') 2024-09-21T03:18:05.332 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi105') 2024-09-21T03:18:05.332 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi105') 2024-09-21T03:18:05.332 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi105') 2024-09-21T03:18:05.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.365+0000 7f13cc3eb640 1 -- 172.21.15.105:0/1117113144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13c40afde0 msgr2=0x7f13c415ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.365+0000 7f13cc3eb640 1 --2- 172.21.15.105:0/1117113144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13c40afde0 0x7f13c415ae10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f13c4074850 tx=0x7f13bc02a850 comp rx=0 tx=0).stop 2024-09-21T03:18:05.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.373+0000 7f13cc3eb640 1 -- 172.21.15.105:0/1117113144 shutdown_connections 2024-09-21T03:18:05.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.373+0000 7f13cc3eb640 1 --2- 172.21.15.105:0/1117113144 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13c40c6490 0x7f13c40c68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.373+0000 7f13cc3eb640 1 --2- 172.21.15.105:0/1117113144 >> v2:172.21.15.105:3300/0 conn(0x7f13c40c58a0 0x7f13c4075cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.373+0000 7f13cc3eb640 1 --2- 172.21.15.105:0/1117113144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13c40afde0 0x7f13c415ae10 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.373+0000 7f13cc3eb640 1 -- 172.21.15.105:0/1117113144 >> 172.21.15.105:0/1117113144 conn(0x7f13c40cd480 msgr2=0x7f13c40cd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:05.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.379+0000 7f13cc3eb640 1 -- 172.21.15.105:0/1117113144 shutdown_connections 2024-09-21T03:18:05.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.379+0000 7f13cc3eb640 1 -- 172.21.15.105:0/1117113144 wait complete. 2024-09-21T03:18:05.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.382+0000 7f13cc3eb640 1 Processor -- start 2024-09-21T03:18:05.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.382+0000 7f13cc3eb640 1 -- start start 2024-09-21T03:18:05.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.385+0000 7f13cc3eb640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13c40afde0 0x7f13c40c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.385+0000 7f13ca187640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13c40afde0 0x7f13c40c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:05.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.385+0000 7f13ca187640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13c40afde0 0x7f13c40c8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:33752/0 (socket says 172.21.15.105:33752) 2024-09-21T03:18:05.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.385+0000 7f13ca187640 1 -- 172.21.15.105:0/1318972051 learned_addr learned my addr 172.21.15.105:0/1318972051 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:05.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.385+0000 7f13cc3eb640 1 --2- 172.21.15.105:0/1318972051 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13c40c58a0 0x7f13c40b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.385+0000 7f13cc3eb640 1 --2- 172.21.15.105:0/1318972051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13c40c6490 0x7f13c41fd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.386+0000 7f13cc3eb640 1 -- 172.21.15.105:0/1318972051 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f13c415eaf0 con 0x7f13c40afde0 2024-09-21T03:18:05.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.386+0000 7f13cc3eb640 1 -- 172.21.15.105:0/1318972051 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f13c415e970 con 0x7f13c40c6490 2024-09-21T03:18:05.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.386+0000 7f13cc3eb640 1 -- 172.21.15.105:0/1318972051 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f13c415ec70 con 0x7f13c40c58a0 2024-09-21T03:18:05.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.387+0000 7f13ca187640 1 -- 172.21.15.105:0/1318972051 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13c40c58a0 msgr2=0x7f13c40b6120 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T03:18:05.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.387+0000 7f13ca187640 1 --2- 172.21.15.105:0/1318972051 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13c40c58a0 0x7f13c40b6120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.387+0000 7f13ca187640 1 -- 172.21.15.105:0/1318972051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13c40c6490 msgr2=0x7f13c41fd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.387+0000 7f13ca988640 1 --2- 172.21.15.105:0/1318972051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13c40c6490 0x7f13c41fd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:05.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.387+0000 7f13ca187640 1 --2- 172.21.15.105:0/1318972051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13c40c6490 0x7f13c41fd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.387+0000 7f13ca187640 1 -- 172.21.15.105:0/1318972051 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c40c8da0 con 0x7f13c40afde0 2024-09-21T03:18:05.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.387+0000 7f13ca988640 1 --2- 172.21.15.105:0/1318972051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13c40c6490 0x7f13c41fd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:18:05.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.387+0000 7f13ca187640 1 --2- 172.21.15.105:0/1318972051 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13c40afde0 0x7f13c40c8290 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f13bc009ca0 tx=0x7f13bc031980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:05.390 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.388+0000 7f13baffd640 1 -- 172.21.15.105:0/1318972051 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13bc041020 con 0x7f13c40afde0 2024-09-21T03:18:05.390 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.388+0000 7f13baffd640 1 -- 172.21.15.105:0/1318972051 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f13bc031e60 con 0x7f13c40afde0 2024-09-21T03:18:05.390 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.388+0000 7f13cc3eb640 1 -- 172.21.15.105:0/1318972051 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13c40c9080 con 0x7f13c40afde0 2024-09-21T03:18:05.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.395+0000 7f13cc3eb640 1 -- 172.21.15.105:0/1318972051 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13c40c9640 con 0x7f13c40afde0 2024-09-21T03:18:05.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.395+0000 7f13baffd640 1 -- 172.21.15.105:0/1318972051 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13bc037040 con 0x7f13c40afde0 2024-09-21T03:18:05.402 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.396+0000 7f13baffd640 1 -- 172.21.15.105:0/1318972051 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f13bc044020 con 0x7f13c40afde0 2024-09-21T03:18:05.402 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.396+0000 7f13baffd640 1 -- 172.21.15.105:0/1318972051 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f13bc046900 con 0x7f13c40afde0 2024-09-21T03:18:05.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.404+0000 7f13cc3eb640 1 -- 172.21.15.105:0/1318972051 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13ac005290 con 0x7f13c40afde0 2024-09-21T03:18:05.410 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.408+0000 7f13baffd640 1 -- 172.21.15.105:0/1318972051 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f13bc04b030 con 0x7f13c40afde0 2024-09-21T03:18:05.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.426+0000 7fbbf1300640 1 -- 172.21.15.105:0/2170178268 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbe40550e0 msgr2=0x7fbbe4033ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.426+0000 7fbbf1300640 1 --2- 172.21.15.105:0/2170178268 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbe40550e0 0x7fbbe4033ce0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbbec06ad50 tx=0x7fbbec095540 comp rx=0 tx=0).stop 2024-09-21T03:18:05.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.427+0000 7fbbf1300640 1 -- 172.21.15.105:0/2170178268 shutdown_connections 2024-09-21T03:18:05.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.427+0000 7fbbf1300640 1 --2- 172.21.15.105:0/2170178268 >> v2:172.21.15.162:3300/0 conn(0x7fbbe4054130 0x7fbbe4034220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.427+0000 7fbbf1300640 1 --2- 172.21.15.105:0/2170178268 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbe40550e0 0x7fbbe4033ce0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.427+0000 7fbbf1300640 1 -- 172.21.15.105:0/2170178268 >> 172.21.15.105:0/2170178268 conn(0x7fbbe401d9a0 msgr2=0x7fbbe4039660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:05.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.428+0000 7fbbf1300640 1 -- 172.21.15.105:0/2170178268 shutdown_connections 2024-09-21T03:18:05.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.428+0000 7fbbf1300640 1 -- 172.21.15.105:0/2170178268 wait complete. 2024-09-21T03:18:05.442 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.440+0000 7f2a7c81d640 1 -- 172.21.15.105:0/3313278909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a7815ee50 msgr2=0x7f2a780d01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.442 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.440+0000 7f2a7c81d640 1 --2- 172.21.15.105:0/3313278909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a7815ee50 0x7f2a780d01f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2a780731f0 tx=0x7f2a6802a4f0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.431+0000 7fbbf1300640 1 Processor -- start 2024-09-21T03:18:05.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.439+0000 7fbbf1300640 1 -- start start 2024-09-21T03:18:05.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.442+0000 7f2a7c81d640 1 -- 172.21.15.105:0/3313278909 shutdown_connections 2024-09-21T03:18:05.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.442+0000 7f2a7c81d640 1 --2- 172.21.15.105:0/3313278909 >> v2:172.21.15.105:3300/0 conn(0x7f2a7806e500 0x7f2a7806fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.442+0000 7f2a7c81d640 1 --2- 172.21.15.105:0/3313278909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a7815ee50 0x7f2a780d01f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.442+0000 7f2a7c81d640 1 -- 172.21.15.105:0/3313278909 >> 172.21.15.105:0/3313278909 conn(0x7f2a780d1210 msgr2=0x7f2a78073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:05.445 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.441+0000 7fbbf1300640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbe40070b0 0x7fbbe41a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.441+0000 7fbbf1300640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbe4054130 0x7fbbe40330d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.441+0000 7fbbf1300640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbe40550e0 0x7fbbe40fcc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.441+0000 7fbbf1300640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe4006490 con 0x7fbbe40070b0 2024-09-21T03:18:05.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.441+0000 7fbbf1300640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe4006310 con 0x7fbbe40550e0 2024-09-21T03:18:05.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.441+0000 7fbbf1300640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbbe4006610 con 0x7fbbe4054130 2024-09-21T03:18:05.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.442+0000 7fbbeb7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbe4054130 0x7fbbe40330d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:05.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.442+0000 7fbbeb7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbe4054130 0x7fbbe40330d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.105:35602/0 (socket says 172.21.15.105:35602) 2024-09-21T03:18:05.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.442+0000 7fbbeb7fe640 1 -- 172.21.15.105:0/313496542 learned_addr learned my addr 172.21.15.105:0/313496542 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:05.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.442+0000 7fbbf0aff640 1 --2- 172.21.15.105:0/313496542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbe40550e0 0x7fbbe40fcc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:05.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.442+0000 7fbbeb7fe640 1 -- 172.21.15.105:0/313496542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbe40550e0 msgr2=0x7fbbe40fcc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.442+0000 7fbbeb7fe640 1 --2- 172.21.15.105:0/313496542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbe40550e0 0x7fbbe40fcc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.442+0000 7fbbeb7fe640 1 -- 172.21.15.105:0/313496542 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbe40070b0 msgr2=0x7fbbe41a38b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:18:05.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.442+0000 7fbbeb7fe640 1 --2- 172.21.15.105:0/313496542 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbe40070b0 0x7fbbe41a38b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.442+0000 7fbbeb7fe640 1 -- 172.21.15.105:0/313496542 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbe4049560 con 0x7fbbe4054130 2024-09-21T03:18:05.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.442+0000 7fbbeb7fe640 1 --2- 172.21.15.105:0/313496542 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbe4054130 0x7fbbe40330d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbbe000c550 tx=0x7fbbe000ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:05.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.443+0000 7fbbe8ff9640 1 -- 172.21.15.105:0/313496542 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe0017070 con 0x7fbbe4054130 2024-09-21T03:18:05.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.443+0000 7fbbe8ff9640 1 -- 172.21.15.105:0/313496542 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbbe00035f0 con 0x7fbbe4054130 2024-09-21T03:18:05.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.443+0000 7fbbe8ff9640 1 -- 172.21.15.105:0/313496542 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe0003a40 con 0x7fbbe4054130 2024-09-21T03:18:05.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.443+0000 7fbbf1300640 1 -- 172.21.15.105:0/313496542 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbe41a4130 con 0x7fbbe4054130 2024-09-21T03:18:05.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.443+0000 7fbbf1300640 1 -- 172.21.15.105:0/313496542 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbe40497d0 con 0x7fbbe4054130 2024-09-21T03:18:05.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.445+0000 7f2a7c81d640 1 -- 172.21.15.105:0/3313278909 shutdown_connections 2024-09-21T03:18:05.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.445+0000 7fbbe8ff9640 1 -- 172.21.15.105:0/313496542 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbbe001a070 con 0x7fbbe4054130 2024-09-21T03:18:05.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.445+0000 7fbbe8ff9640 1 -- 172.21.15.105:0/313496542 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbbe0012740 con 0x7fbbe4054130 2024-09-21T03:18:05.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.446+0000 7fd76b7fe640 1 -- 172.21.15.105:0/2065324453 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7fd78806fd60 con 0x7fd7881f49a0 2024-09-21T03:18:05.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.449+0000 7f2a7c81d640 1 -- 172.21.15.105:0/3313278909 wait complete. 2024-09-21T03:18:05.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.452+0000 7f2a7c81d640 1 Processor -- start 2024-09-21T03:18:05.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.453+0000 7fbbf1300640 1 -- 172.21.15.105:0/313496542 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbcc005290 con 0x7fbbe4054130 2024-09-21T03:18:05.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.452+0000 7f2a7c81d640 1 -- start start 2024-09-21T03:18:05.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.454+0000 7f2a7c81d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a780743e0 0x7f2a78129980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.454+0000 7f2a7c81d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a7815ee50 0x7f2a78141a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.454+0000 7f2a7c81d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a78156b10 0x7f2a78156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.454+0000 7f2a7c81d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2a78070840 con 0x7f2a7815ee50 2024-09-21T03:18:05.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.454+0000 7f2a7c81d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2a780706c0 con 0x7f2a78156b10 2024-09-21T03:18:05.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.454+0000 7f2a7c81d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2a780709c0 con 0x7f2a780743e0 2024-09-21T03:18:05.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.456+0000 7f0577d9b640 1 -- 172.21.15.105:0/3771647550 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f05700b38f0 con 0x7f05701e6330 2024-09-21T03:18:05.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.456+0000 7f2a76d9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a78156b10 0x7f2a78156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:05.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.456+0000 7f2a7659c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a780743e0 0x7f2a78129980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:05.462 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.457+0000 7fbbe8ff9640 1 -- 172.21.15.105:0/313496542 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fbbe0021020 con 0x7fbbe4054130 2024-09-21T03:18:05.466 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.464+0000 7f72c9c9b640 1 -- 172.21.15.105:0/1042983763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72c408b140 msgr2=0x7f72c40ccde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.466 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.464+0000 7f72c9c9b640 1 --2- 172.21.15.105:0/1042983763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72c408b140 0x7f72c40ccde0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f72c416f130 tx=0x7f72b802ad30 comp rx=0 tx=0).stop 2024-09-21T03:18:05.466 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.464+0000 7f72c9c9b640 1 -- 172.21.15.105:0/1042983763 shutdown_connections 2024-09-21T03:18:05.466 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.464+0000 7f72c9c9b640 1 --2- 172.21.15.105:0/1042983763 >> v2:172.21.15.105:3300/0 conn(0x7f72c40cd320 0x7f72c40cf3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.466 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.464+0000 7f72c9c9b640 1 --2- 172.21.15.105:0/1042983763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72c408b140 0x7f72c40ccde0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.466 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.464+0000 7f72c9c9b640 1 -- 172.21.15.105:0/1042983763 >> 172.21.15.105:0/1042983763 conn(0x7f72c40b20a0 msgr2=0x7f72c40b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:05.466 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.465+0000 7f72c9c9b640 1 -- 172.21.15.105:0/1042983763 shutdown_connections 2024-09-21T03:18:05.467 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.465+0000 7fd77dffb640 1 -- 172.21.15.105:0/2065324453 <== mon.1 v2:172.21.15.162:3300/0 10 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v8)=0 v8) ==== 117+0+0 (secure 0 0 0) 0x7fd7780035f0 con 0x7fd7881f49a0 2024-09-21T03:18:05.470 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.465+0000 7f72c9c9b640 1 -- 172.21.15.105:0/1042983763 wait complete. 2024-09-21T03:18:05.470 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.457+0000 7f2a6ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a7815ee50 0x7f2a78141a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:05.470 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.461+0000 7f2a7659c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a780743e0 0x7f2a78129980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.105:35618/0 (socket says 172.21.15.105:35618) 2024-09-21T03:18:05.470 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.461+0000 7f2a7659c640 1 -- 172.21.15.105:0/2626100514 learned_addr learned my addr 172.21.15.105:0/2626100514 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:05.470 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.463+0000 7f2a7659c640 1 -- 172.21.15.105:0/2626100514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a78156b10 msgr2=0x7f2a78156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.470 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.463+0000 7f2a7659c640 1 --2- 172.21.15.105:0/2626100514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a78156b10 0x7f2a78156f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.470 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.463+0000 7f2a7659c640 1 -- 172.21.15.105:0/2626100514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a7815ee50 msgr2=0x7f2a78141a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.471 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.470+0000 7f05667fc640 1 -- 172.21.15.105:0/3771647550 <== mon.0 v2:172.21.15.105:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v9)=0 v9) ==== 106+0+0 (secure 0 0 0) 0x7f056c01da20 con 0x7f05701e6330 2024-09-21T03:18:05.472 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.470+0000 7f2a7659c640 1 --2- 172.21.15.105:0/2626100514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a7815ee50 0x7f2a78141a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.472 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.470+0000 7f2a7659c640 1 -- 172.21.15.105:0/2626100514 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a7812a970 con 0x7f2a780743e0 2024-09-21T03:18:05.472 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.470+0000 7f2a6ffff640 1 --2- 172.21.15.105:0/2626100514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a7815ee50 0x7f2a78141a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:18:05.472 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.470+0000 7f2a7659c640 1 --2- 172.21.15.105:0/2626100514 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a780743e0 0x7f2a78129980 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2a680099c0 tx=0x7f2a68004f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:05.472 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.471+0000 7f2a6effd640 1 -- 172.21.15.105:0/2626100514 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6803f070 con 0x7f2a780743e0 2024-09-21T03:18:05.475 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.471+0000 7fd76b7fe640 1 -- 172.21.15.105:0/2065324453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7881f49a0 msgr2=0x7fd7881f4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.475 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.471+0000 7fd76b7fe640 1 --2- 172.21.15.105:0/2065324453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7881f49a0 0x7fd7881f4db0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd77802ab70 tx=0x7fd7780046c0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.475 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.471+0000 7f2a7c81d640 1 -- 172.21.15.105:0/2626100514 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a7812a3b0 con 0x7f2a780743e0 2024-09-21T03:18:05.475 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.471+0000 7f0553fff640 1 -- 172.21.15.105:0/3771647550 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05701e6330 msgr2=0x7f05701e6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.476 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.472+0000 7f0553fff640 1 --2- 172.21.15.105:0/3771647550 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05701e6330 0x7f05701e6740 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f056c00c780 tx=0x7f056c00cc40 comp rx=0 tx=0).stop 2024-09-21T03:18:05.476 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.472+0000 7f0553fff640 1 -- 172.21.15.105:0/3771647550 shutdown_connections 2024-09-21T03:18:05.476 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.472+0000 7f0553fff640 1 --2- 172.21.15.105:0/3771647550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0570149cc0 0x7f057014a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.476 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.472+0000 7f0553fff640 1 --2- 172.21.15.105:0/3771647550 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05701e6330 0x7f05701e6740 secure :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f056c00c780 tx=0x7f056c00cc40 comp rx=0 tx=0).stop 2024-09-21T03:18:05.476 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.472+0000 7f0553fff640 1 --2- 172.21.15.105:0/3771647550 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05700c3c50 0x7f05701fd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.476 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.472+0000 7f0553fff640 1 -- 172.21.15.105:0/3771647550 >> 172.21.15.105:0/3771647550 conn(0x7f05700b1cb0 msgr2=0x7f05700afbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:05.476 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.473+0000 7fd76b7fe640 1 -- 172.21.15.105:0/2065324453 shutdown_connections 2024-09-21T03:18:05.476 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.473+0000 7fd76b7fe640 1 --2- 172.21.15.105:0/2065324453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7881f49a0 0x7fd7881f4db0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.476 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.473+0000 7fd76b7fe640 1 --2- 172.21.15.105:0/2065324453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7880c58a0 0x7fd7881f4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.476 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.473+0000 7fd76b7fe640 1 --2- 172.21.15.105:0/2065324453 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7880afde0 0x7fd7880b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.473+0000 7fcee6273640 1 -- 172.21.15.105:0/1060044422 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcecc005270 msgr2=0x7fcecc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.473+0000 7fcee6273640 1 --2- 172.21.15.105:0/1060044422 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcecc005270 0x7fcecc00b9c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcee006bc20 tx=0x7fcecc005830 comp rx=0 tx=0).stop 2024-09-21T03:18:05.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.473+0000 7fcee5a72640 1 -- 172.21.15.105:0/1060044422 reap_dead start 2024-09-21T03:18:05.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.473+0000 7fd76b7fe640 1 -- 172.21.15.105:0/2065324453 >> 172.21.15.105:0/2065324453 conn(0x7fd7880cd480 msgr2=0x7fd7880d0250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:05.478 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.473+0000 7f0553fff640 1 -- 172.21.15.105:0/3771647550 shutdown_connections 2024-09-21T03:18:05.478 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.473+0000 7f0553fff640 1 -- 172.21.15.105:0/3771647550 wait complete. 2024-09-21T03:18:05.478 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.473+0000 7fcee6273640 1 -- 172.21.15.105:0/1060044422 shutdown_connections 2024-09-21T03:18:05.478 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.473+0000 7fcee6273640 1 -- 172.21.15.105:0/1060044422 >> 172.21.15.105:0/1060044422 conn(0x7fced801d9a0 msgr2=0x7fced8039660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:05.479 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.471+0000 7f2a7c81d640 1 -- 172.21.15.105:0/2626100514 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a78156310 con 0x7f2a780743e0 2024-09-21T03:18:05.479 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.474+0000 7f2a6effd640 1 -- 172.21.15.105:0/2626100514 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2a68003af0 con 0x7f2a780743e0 2024-09-21T03:18:05.479 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.474+0000 7f2a6effd640 1 -- 172.21.15.105:0/2626100514 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a68035030 con 0x7f2a780743e0 2024-09-21T03:18:05.479 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.474+0000 7f2a6effd640 1 -- 172.21.15.105:0/2626100514 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2a68042070 con 0x7f2a780743e0 2024-09-21T03:18:05.479 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.474+0000 7f2a6effd640 1 -- 172.21.15.105:0/2626100514 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2a6803bca0 con 0x7f2a780743e0 2024-09-21T03:18:05.479 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.474+0000 7fcee6273640 1 -- 172.21.15.105:0/1060044422 shutdown_connections 2024-09-21T03:18:05.479 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.476+0000 7f2a7c81d640 1 -- 172.21.15.105:0/2626100514 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a78076500 con 0x7f2a780743e0 2024-09-21T03:18:05.480 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.478+0000 7f72c9c9b640 1 Processor -- start 2024-09-21T03:18:05.483 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.478+0000 7f72c9c9b640 1 -- start start 2024-09-21T03:18:05.483 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.481+0000 7fd76b7fe640 1 -- 172.21.15.105:0/2065324453 shutdown_connections 2024-09-21T03:18:05.483 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.481+0000 7fd76b7fe640 1 -- 172.21.15.105:0/2065324453 wait complete. 2024-09-21T03:18:05.483 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.478+0000 7fcee6273640 1 -- 172.21.15.105:0/1060044422 wait complete. 2024-09-21T03:18:05.484 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.482+0000 7f2a6effd640 1 -- 172.21.15.105:0/2626100514 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f2a68005500 con 0x7f2a780743e0 2024-09-21T03:18:05.484 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.482+0000 7fcee6273640 1 Processor -- start 2024-09-21T03:18:05.488 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.485+0000 7fcee6273640 1 -- start start 2024-09-21T03:18:05.489 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.488+0000 7fcee6273640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcecc005270 0x7fced80dbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.489 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.487+0000 7f5a88ffa640 1 -- 172.21.15.105:0/208107234 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a7c005c60 msgr2=0x7f5a7c006660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.489 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.487+0000 7f5a88ffa640 1 --2- 172.21.15.105:0/208107234 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a7c005c60 0x7f5a7c006660 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5a8406af90 tx=0x7f5a840a6630 comp rx=0 tx=0).stop 2024-09-21T03:18:05.491 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.488+0000 7fcee6273640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fced80dca80 0x7fced8032760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.491 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.488+0000 7fcee6273640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fced8032ca0 0x7fced80e3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.491 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.488+0000 7fcee6273640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fced80e6c40 con 0x7fced80dca80 2024-09-21T03:18:05.491 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.488+0000 7fcee6273640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fced80e6ac0 con 0x7fcecc005270 2024-09-21T03:18:05.491 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.488+0000 7fcee6273640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fced80e6dc0 con 0x7fced8032ca0 2024-09-21T03:18:05.491 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.488+0000 7fcee4a70640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fced80dca80 0x7fced8032760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:05.491 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.488+0000 7fcee4a70640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fced80dca80 0x7fced8032760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:33778/0 (socket says 172.21.15.105:33778) 2024-09-21T03:18:05.491 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.489+0000 7fcee4a70640 1 -- 172.21.15.105:0/3730437899 learned_addr learned my addr 172.21.15.105:0/3730437899 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:05.491 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.489+0000 7fcee4a70640 1 -- 172.21.15.105:0/3730437899 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fced8032ca0 msgr2=0x7fced80e3790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:18:05.491 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.489+0000 7fcee4a70640 1 --2- 172.21.15.105:0/3730437899 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fced8032ca0 0x7fced80e3790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.491 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.489+0000 7fcee4a70640 1 -- 172.21.15.105:0/3730437899 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcecc005270 msgr2=0x7fced80dbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.492 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.488+0000 7fcee5271640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcecc005270 0x7fced80dbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:05.492 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.490+0000 7fcee4a70640 1 --2- 172.21.15.105:0/3730437899 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcecc005270 0x7fced80dbe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.492 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.490+0000 7fcee4a70640 1 -- 172.21.15.105:0/3730437899 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced80330b0 con 0x7fced80dca80 2024-09-21T03:18:05.492 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.490+0000 7fcee4a70640 1 --2- 172.21.15.105:0/3730437899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fced80dca80 0x7fced8032760 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fced000c760 tx=0x7fced000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:05.493 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.491+0000 7f5a88ffa640 1 -- 172.21.15.105:0/208107234 shutdown_connections 2024-09-21T03:18:05.493 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.491+0000 7f5a88ffa640 1 --2- 172.21.15.105:0/208107234 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a7c005c60 0x7f5a7c006660 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.493 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.491+0000 7f5a88ffa640 1 --2- 172.21.15.105:0/208107234 >> v2:172.21.15.162:3300/0 conn(0x7f5a7c036b40 0x7f5a7c0df180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.493 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.491+0000 7f5a88ffa640 1 -- 172.21.15.105:0/208107234 >> 172.21.15.105:0/208107234 conn(0x7f5a7c051420 msgr2=0x7f5a7c051860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:05.493 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.491+0000 7fced5ffb640 1 -- 172.21.15.105:0/3730437899 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced000a840 con 0x7fced80dca80 2024-09-21T03:18:05.493 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.491+0000 7fcee5271640 1 --2- 172.21.15.105:0/3730437899 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcecc005270 0x7fced80dbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:18:05.493 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.491+0000 7fced5ffb640 1 -- 172.21.15.105:0/3730437899 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fced0017070 con 0x7fced80dca80 2024-09-21T03:18:05.493 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.491+0000 7fcee6273640 1 -- 172.21.15.105:0/3730437899 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fced80e5540 con 0x7fced80dca80 2024-09-21T03:18:05.494 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.491+0000 7fcee6273640 1 -- 172.21.15.105:0/3730437899 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fced80e5120 con 0x7fced80dca80 2024-09-21T03:18:05.494 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.491+0000 7fced5ffb640 1 -- 172.21.15.105:0/3730437899 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced000ad70 con 0x7fced80dca80 2024-09-21T03:18:05.494 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.492+0000 7fced5ffb640 1 -- 172.21.15.105:0/3730437899 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fced001c460 con 0x7fced80dca80 2024-09-21T03:18:05.494 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.492+0000 7fced5ffb640 1 -- 172.21.15.105:0/3730437899 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fced00126f0 con 0x7fced80dca80 2024-09-21T03:18:05.499 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.496+0000 7fcee6273640 1 -- 172.21.15.105:0/3730437899 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fced804e7d0 con 0x7fced80dca80 2024-09-21T03:18:05.501 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.489+0000 7f72c9c9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72c408b140 0x7f72c4202840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.501 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.489+0000 7f72c9c9b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f72c40cb180 0x7f72c416bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.501 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.489+0000 7f72c9c9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72c40cd320 0x7f72c408a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.501 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.489+0000 7f72c9c9b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f72c408b9d0 con 0x7f72c408b140 2024-09-21T03:18:05.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.489+0000 7f72c9c9b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f72c4075130 con 0x7f72c40cd320 2024-09-21T03:18:05.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.489+0000 7f72c9c9b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f72c40cf930 con 0x7f72c40cb180 2024-09-21T03:18:05.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.496+0000 7f72c3fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72c40cd320 0x7f72c408a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:05.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.496+0000 7f72c3fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72c40cd320 0x7f72c408a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.105:57580/0 (socket says 172.21.15.105:57580) 2024-09-21T03:18:05.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.496+0000 7f72c3fff640 1 -- 172.21.15.105:0/994143169 learned_addr learned my addr 172.21.15.105:0/994143169 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:05.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.500+0000 7f72c3fff640 1 -- 172.21.15.105:0/994143169 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f72c40cb180 msgr2=0x7f72c416bcb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T03:18:05.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.500+0000 7f72c37fe640 1 --2- 172.21.15.105:0/994143169 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72c408b140 0x7f72c4202840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:05.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.500+0000 7f72c3fff640 1 --2- 172.21.15.105:0/994143169 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f72c40cb180 0x7f72c416bcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.503 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.500+0000 7f72c3fff640 1 -- 172.21.15.105:0/994143169 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72c408b140 msgr2=0x7f72c4202840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.503 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.500+0000 7f72c3fff640 1 --2- 172.21.15.105:0/994143169 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72c408b140 0x7f72c4202840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.503 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.500+0000 7f72c3fff640 1 -- 172.21.15.105:0/994143169 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c416df60 con 0x7f72c40cd320 2024-09-21T03:18:05.503 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.501+0000 7f72c37fe640 1 --2- 172.21.15.105:0/994143169 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72c408b140 0x7f72c4202840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:18:05.503 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.501+0000 7f72c3fff640 1 --2- 172.21.15.105:0/994143169 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72c40cd320 0x7f72c408a320 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f72bc00e990 tx=0x7f72bc00ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:05.505 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.501+0000 7f72abfff640 1 -- 172.21.15.105:0/994143169 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72bc004d20 con 0x7f72c40cd320 2024-09-21T03:18:05.506 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.501+0000 7f72abfff640 1 -- 172.21.15.105:0/994143169 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f72bc00cb00 con 0x7f72c40cd320 2024-09-21T03:18:05.506 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.501+0000 7f72c9c9b640 1 -- 172.21.15.105:0/994143169 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72c42030e0 con 0x7f72c40cd320 2024-09-21T03:18:05.506 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.502+0000 7f72c9c9b640 1 -- 172.21.15.105:0/994143169 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72c416c1f0 con 0x7f72c40cd320 2024-09-21T03:18:05.506 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.502+0000 7f72abfff640 1 -- 172.21.15.105:0/994143169 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72bc005020 con 0x7f72c40cd320 2024-09-21T03:18:05.506 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.502+0000 7fced5ffb640 1 -- 172.21.15.105:0/3730437899 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fced80330b0 con 0x7fced80dca80 2024-09-21T03:18:05.506 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.504+0000 7f72abfff640 1 -- 172.21.15.105:0/994143169 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f72bc0051c0 con 0x7f72c40cd320 2024-09-21T03:18:05.507 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi105') 2024-09-21T03:18:05.507 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.505+0000 7f72abfff640 1 -- 172.21.15.105:0/994143169 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f72bc011b40 con 0x7f72c40cd320 2024-09-21T03:18:05.510 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.509+0000 7f5a88ffa640 1 -- 172.21.15.105:0/208107234 shutdown_connections 2024-09-21T03:18:05.510 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.507+0000 7f72a9ffb640 1 -- 172.21.15.105:0/994143169 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72c40cfdf0 con 0x7f72c40cd320 2024-09-21T03:18:05.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.511+0000 7ff78fbc6640 1 -- 172.21.15.105:0/462791453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff788158dd0 msgr2=0x7ff78815ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.511+0000 7ff78fbc6640 1 --2- 172.21.15.105:0/462791453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff788158dd0 0x7ff78815ec80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff78815c8a0 tx=0x7ff78402a4d0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.514 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.513+0000 7fdc99b7b640 1 -- 172.21.15.105:0/3931440503 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc8c055110 msgr2=0x7fdc8c033d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.515 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.513+0000 7f72abfff640 1 -- 172.21.15.105:0/994143169 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f72bc016030 con 0x7f72c40cd320 2024-09-21T03:18:05.515 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.513+0000 7fdc99b7b640 1 --2- 172.21.15.105:0/3931440503 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc8c055110 0x7fdc8c033d10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdc88009780 tx=0x7fdc8802a4d0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.515 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.513+0000 7fdc99b7b640 1 -- 172.21.15.105:0/3931440503 shutdown_connections 2024-09-21T03:18:05.516 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.513+0000 7fdc99b7b640 1 --2- 172.21.15.105:0/3931440503 >> v2:172.21.15.162:3300/0 conn(0x7fdc8c054160 0x7fdc8c034250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.516 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.513+0000 7fdc99b7b640 1 --2- 172.21.15.105:0/3931440503 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc8c055110 0x7fdc8c033d10 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.516 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.513+0000 7fdc99b7b640 1 -- 172.21.15.105:0/3931440503 >> 172.21.15.105:0/3931440503 conn(0x7fdc8c01d9d0 msgr2=0x7fdc8c039690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:05.516 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi105') 2024-09-21T03:18:05.517 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.511+0000 7f5a88ffa640 1 -- 172.21.15.105:0/208107234 wait complete. 2024-09-21T03:18:05.517 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.514+0000 7f5a88ffa640 1 Processor -- start 2024-09-21T03:18:05.518 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.517+0000 7ff78fbc6640 1 -- 172.21.15.105:0/462791453 shutdown_connections 2024-09-21T03:18:05.519 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.517+0000 7ff78fbc6640 1 --2- 172.21.15.105:0/462791453 >> v2:172.21.15.162:3300/0 conn(0x7ff7880ce660 0x7ff7880cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.519 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.517+0000 7ff78fbc6640 1 --2- 172.21.15.105:0/462791453 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7880cb820 0x7ff7880ce120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.519 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.517+0000 7ff78fbc6640 1 --2- 172.21.15.105:0/462791453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff788158dd0 0x7ff78815ec80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.519 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.517+0000 7ff78fbc6640 1 -- 172.21.15.105:0/462791453 >> 172.21.15.105:0/462791453 conn(0x7ff78806d5d0 msgr2=0x7ff78806ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:05.524 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.514+0000 7fdc99b7b640 1 -- 172.21.15.105:0/3931440503 shutdown_connections 2024-09-21T03:18:05.524 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.514+0000 7fdc99b7b640 1 -- 172.21.15.105:0/3931440503 wait complete. 2024-09-21T03:18:05.524 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.521+0000 7fdc99b7b640 1 Processor -- start 2024-09-21T03:18:05.524 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.515+0000 7f5a88ffa640 1 -- start start 2024-09-21T03:18:05.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.517+0000 7f5a88ffa640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a7c005c60 0x7f5a7c02c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.517+0000 7f5a88ffa640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a7c009ba0 0x7f5a7c02cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.520+0000 7f5a837fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a7c005c60 0x7f5a7c02c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:05.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.520+0000 7f5a837fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a7c005c60 0x7f5a7c02c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.105:57596/0 (socket says 172.21.15.105:57596) 2024-09-21T03:18:05.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.523+0000 7f5a88ffa640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a7c032630 0x7f5a7c18a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.523+0000 7f2cab04a640 1 -- 172.21.15.105:0/4259835431 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c9c005c60 msgr2=0x7f2c9c036430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.523+0000 7f2cab04a640 1 --2- 172.21.15.105:0/4259835431 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c9c005c60 0x7f2c9c036430 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c00ca70 tx=0x7f2c9002c860 comp rx=0 tx=0).stop 2024-09-21T03:18:05.526 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.523+0000 7f5a88ffa640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c006f30 con 0x7f5a7c032630 2024-09-21T03:18:05.526 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.523+0000 7f5a88ffa640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c006db0 con 0x7f5a7c005c60 2024-09-21T03:18:05.526 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.523+0000 7f5a88ffa640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5a7c0070b0 con 0x7f5a7c009ba0 2024-09-21T03:18:05.526 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.523+0000 7f2cab04a640 1 -- 172.21.15.105:0/4259835431 shutdown_connections 2024-09-21T03:18:05.526 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.523+0000 7f2cab04a640 1 --2- 172.21.15.105:0/4259835431 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c9c005c60 0x7f2c9c036430 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.526 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.523+0000 7f2cab04a640 1 --2- 172.21.15.105:0/4259835431 >> v2:172.21.15.105:3300/0 conn(0x7f2c9c009ba0 0x7f2c9c0df180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.526 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.523+0000 7f2cab04a640 1 -- 172.21.15.105:0/4259835431 >> 172.21.15.105:0/4259835431 conn(0x7f2c9c051420 msgr2=0x7f2c9c051860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:05.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.523+0000 7fdc99b7b640 1 -- start start 2024-09-21T03:18:05.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.525+0000 7fdc99b7b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc8c0070e0 0x7fdc8c0f2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.525+0000 7fdc99b7b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc8c054160 0x7fdc8c04d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.525+0000 7fdc99b7b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc8c10f810 0x7fdc8c04d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.525+0000 7fdc99b7b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdc8c0064c0 con 0x7fdc8c0070e0 2024-09-21T03:18:05.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.525+0000 7fdc99b7b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdc8c006340 con 0x7fdc8c10f810 2024-09-21T03:18:05.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.525+0000 7fdc99b7b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdc8c006640 con 0x7fdc8c054160 2024-09-21T03:18:05.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.523+0000 7f5a83fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a7c032630 0x7f5a7c18a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:05.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.523+0000 7f5a83fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a7c032630 0x7f5a7c18a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:33802/0 (socket says 172.21.15.105:33802) 2024-09-21T03:18:05.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.523+0000 7f5a83fff640 1 -- 172.21.15.105:0/2755711677 learned_addr learned my addr 172.21.15.105:0/2755711677 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:05.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.524+0000 7f5a83fff640 1 -- 172.21.15.105:0/2755711677 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a7c009ba0 msgr2=0x7f5a7c02cdf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T03:18:05.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.524+0000 7f5a83fff640 1 --2- 172.21.15.105:0/2755711677 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a7c009ba0 0x7f5a7c02cdf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.524+0000 7f5a83fff640 1 -- 172.21.15.105:0/2755711677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a7c005c60 msgr2=0x7f5a7c02c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.524+0000 7f5a83fff640 1 --2- 172.21.15.105:0/2755711677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a7c005c60 0x7f5a7c02c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.524+0000 7f5a83fff640 1 -- 172.21.15.105:0/2755711677 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a7c0deb90 con 0x7f5a7c032630 2024-09-21T03:18:05.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.524+0000 7f5a83fff640 1 --2- 172.21.15.105:0/2755711677 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a7c032630 0x7f5a7c18a9c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5a84052860 tx=0x7f5a840ac660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:05.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.525+0000 7f5a6ffff640 1 -- 172.21.15.105:0/2755711677 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a840bb070 con 0x7f5a7c032630 2024-09-21T03:18:05.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.525+0000 7f5a6ffff640 1 -- 172.21.15.105:0/2755711677 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a840ace10 con 0x7f5a7c032630 2024-09-21T03:18:05.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.525+0000 7f5a88ffa640 1 -- 172.21.15.105:0/2755711677 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a7c02d330 con 0x7f5a7c032630 2024-09-21T03:18:05.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.525+0000 7f5a88ffa640 1 -- 172.21.15.105:0/2755711677 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a7c0202d0 con 0x7f5a7c032630 2024-09-21T03:18:05.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.523+0000 7f2cab04a640 1 -- 172.21.15.105:0/4259835431 shutdown_connections 2024-09-21T03:18:05.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.523+0000 7f2cab04a640 1 -- 172.21.15.105:0/4259835431 wait complete. 2024-09-21T03:18:05.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.526+0000 7f5a6ffff640 1 -- 172.21.15.105:0/2755711677 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a840c06c0 con 0x7f5a7c032630 2024-09-21T03:18:05.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.526+0000 7f2cab04a640 1 Processor -- start 2024-09-21T03:18:05.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.526+0000 7fdc92ffd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc8c054160 0x7fdc8c04d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:05.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.526+0000 7fdc93fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc8c10f810 0x7fdc8c04d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:05.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.526+0000 7fdc92ffd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc8c054160 0x7fdc8c04d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.105:35682/0 (socket says 172.21.15.105:35682) 2024-09-21T03:18:05.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.526+0000 7fdc92ffd640 1 -- 172.21.15.105:0/3539611301 learned_addr learned my addr 172.21.15.105:0/3539611301 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:05.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.527+0000 7fdc937fe640 1 --2- 172.21.15.105:0/3539611301 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc8c0070e0 0x7fdc8c0f2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:05.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.527+0000 7fdc92ffd640 1 -- 172.21.15.105:0/3539611301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc8c10f810 msgr2=0x7fdc8c04d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.527+0000 7fdc92ffd640 1 --2- 172.21.15.105:0/3539611301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc8c10f810 0x7fdc8c04d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.527+0000 7fdc92ffd640 1 -- 172.21.15.105:0/3539611301 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc8c0070e0 msgr2=0x7fdc8c0f2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.527+0000 7fdc92ffd640 1 --2- 172.21.15.105:0/3539611301 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc8c0070e0 0x7fdc8c0f2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.527+0000 7fdc92ffd640 1 -- 172.21.15.105:0/3539611301 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc8c04ecc0 con 0x7fdc8c054160 2024-09-21T03:18:05.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.527+0000 7fdc92ffd640 1 --2- 172.21.15.105:0/3539611301 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc8c054160 0x7fdc8c04d400 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdc94051230 tx=0x7fdc9406a0c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:05.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.527+0000 7f2cab04a640 1 -- start start 2024-09-21T03:18:05.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.521+0000 7ff78fbc6640 1 -- 172.21.15.105:0/462791453 shutdown_connections 2024-09-21T03:18:05.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.528+0000 7fdc7ffff640 1 -- 172.21.15.105:0/3539611301 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc94069450 con 0x7fdc8c054160 2024-09-21T03:18:05.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.528+0000 7fdc99b7b640 1 -- 172.21.15.105:0/3539611301 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc8c031e70 con 0x7fdc8c054160 2024-09-21T03:18:05.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.528+0000 7fdc99b7b640 1 -- 172.21.15.105:0/3539611301 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc8c050500 con 0x7fdc8c054160 2024-09-21T03:18:05.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.528+0000 7fdc7ffff640 1 -- 172.21.15.105:0/3539611301 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc94069700 con 0x7fdc8c054160 2024-09-21T03:18:05.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.530+0000 7fdc7ffff640 1 -- 172.21.15.105:0/3539611301 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc94082400 con 0x7fdc8c054160 2024-09-21T03:18:05.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.530+0000 7f5a6dffb640 1 -- 172.21.15.105:0/2755711677 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a7c007ae0 con 0x7f5a7c032630 2024-09-21T03:18:05.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.531+0000 7fdc7ffff640 1 -- 172.21.15.105:0/3539611301 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdc94082660 con 0x7fdc8c054160 2024-09-21T03:18:05.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.531+0000 7fdc7ffff640 1 -- 172.21.15.105:0/3539611301 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdc9408b9b0 con 0x7fdc8c054160 2024-09-21T03:18:05.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.530+0000 7f2cab04a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c9c005c60 0x7f2c9c01e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.530+0000 7f2cab04a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c9c009ba0 0x7f2c9c183c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.531+0000 7ff78fbc6640 1 -- 172.21.15.105:0/462791453 wait complete. 2024-09-21T03:18:05.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.533+0000 7ff78fbc6640 1 Processor -- start 2024-09-21T03:18:05.536 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.535+0000 7f5a6ffff640 1 -- 172.21.15.105:0/2755711677 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5a840c0860 con 0x7f5a7c032630 2024-09-21T03:18:05.536 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.535+0000 7f5a6ffff640 1 -- 172.21.15.105:0/2755711677 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5a840ad860 con 0x7f5a7c032630 2024-09-21T03:18:05.536 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.535+0000 7f5a6ffff640 1 -- 172.21.15.105:0/2755711677 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f5a840ce020 con 0x7f5a7c032630 2024-09-21T03:18:05.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.530+0000 7f2cab04a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c9c036970 0x7f2c9c184170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.530+0000 7f2cab04a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9c00bdb0 con 0x7f2c9c036970 2024-09-21T03:18:05.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.530+0000 7f2cab04a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9c00bc30 con 0x7f2c9c009ba0 2024-09-21T03:18:05.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.530+0000 7f2cab04a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2c9c01ccc0 con 0x7f2c9c005c60 2024-09-21T03:18:05.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.536+0000 7f2ca3fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c9c009ba0 0x7f2c9c183c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:05.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.536+0000 7f2ca3fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c9c009ba0 0x7f2c9c183c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.105:57636/0 (socket says 172.21.15.105:57636) 2024-09-21T03:18:05.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.536+0000 7f2ca3fff640 1 -- 172.21.15.105:0/1168032658 learned_addr learned my addr 172.21.15.105:0/1168032658 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:05.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.534+0000 7ff78fbc6640 1 -- start start 2024-09-21T03:18:05.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.536+0000 7ff78fbc6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7880cb820 0x7ff7882021f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.540 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.536+0000 7ff78fbc6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7880ce660 0x7ff788157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.540 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.536+0000 7ff78fbc6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff788158dd0 0x7ff7881f5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.540 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.536+0000 7ff78fbc6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff788162800 con 0x7ff788158dd0 2024-09-21T03:18:05.540 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.536+0000 7ff78fbc6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff788162680 con 0x7ff7880ce660 2024-09-21T03:18:05.540 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.536+0000 7ff78e163640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff788158dd0 0x7ff7881f5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:05.540 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.536+0000 7ff78e163640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff788158dd0 0x7ff7881f5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:33836/0 (socket says 172.21.15.105:33836) 2024-09-21T03:18:05.540 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.536+0000 7ff78e163640 1 -- 172.21.15.105:0/3048440326 learned_addr learned my addr 172.21.15.105:0/3048440326 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:05.540 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.536+0000 7ff78fbc6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff788162980 con 0x7ff7880cb820 2024-09-21T03:18:05.540 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.536+0000 7ff78d161640 1 --2- 172.21.15.105:0/3048440326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7880ce660 0x7ff788157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:05.540 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.536+0000 7ff78d962640 1 --2- 172.21.15.105:0/3048440326 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7880cb820 0x7ff7882021f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:05.540 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.537+0000 7ff78d962640 1 -- 172.21.15.105:0/3048440326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7880ce660 msgr2=0x7ff788157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.540 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.537+0000 7ff78d962640 1 --2- 172.21.15.105:0/3048440326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7880ce660 0x7ff788157c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.540 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.537+0000 7ff78d962640 1 -- 172.21.15.105:0/3048440326 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff788158dd0 msgr2=0x7ff7881f5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.541 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.537+0000 7ff78d962640 1 --2- 172.21.15.105:0/3048440326 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff788158dd0 0x7ff7881f5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.541 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.537+0000 7ff78d962640 1 -- 172.21.15.105:0/3048440326 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7880b4600 con 0x7ff7880cb820 2024-09-21T03:18:05.541 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.537+0000 7ff78d161640 1 --2- 172.21.15.105:0/3048440326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7880ce660 0x7ff788157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:18:05.541 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.537+0000 7ff78d962640 1 --2- 172.21.15.105:0/3048440326 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7880cb820 0x7ff7882021f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff784031000 tx=0x7ff784033ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:05.541 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.538+0000 7fa9751c3640 1 -- 172.21.15.105:0/822200582 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9700c9da0 msgr2=0x7fa9700d0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.541 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.538+0000 7fa9751c3640 1 --2- 172.21.15.105:0/822200582 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9700c9da0 0x7fa9700d0000 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa9700d1030 tx=0x7fa96402a560 comp rx=0 tx=0).stop 2024-09-21T03:18:05.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.538+0000 7fa9751c3640 1 -- 172.21.15.105:0/822200582 shutdown_connections 2024-09-21T03:18:05.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.538+0000 7fa9751c3640 1 --2- 172.21.15.105:0/822200582 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9700c9da0 0x7fa9700d0000 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa9700d1030 tx=0x7fa96402a560 comp rx=0 tx=0).stop 2024-09-21T03:18:05.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.538+0000 7fa9751c3640 1 --2- 172.21.15.105:0/822200582 >> v2:172.21.15.162:3300/0 conn(0x7fa97015ecd0 0x7fa9700cb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.538+0000 7fa9751c3640 1 -- 172.21.15.105:0/822200582 >> 172.21.15.105:0/822200582 conn(0x7fa97006d5d0 msgr2=0x7fa97006ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:05.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.538+0000 7f2ca3fff640 1 -- 172.21.15.105:0/1168032658 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c9c005c60 msgr2=0x7f2c9c01e410 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T03:18:05.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.538+0000 7f2ca3fff640 1 --2- 172.21.15.105:0/1168032658 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c9c005c60 0x7f2c9c01e410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.538+0000 7f2ca3fff640 1 -- 172.21.15.105:0/1168032658 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c9c036970 msgr2=0x7f2c9c184170 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:18:05.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.538+0000 7f2ca95e7640 1 --2- 172.21.15.105:0/1168032658 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c9c036970 0x7f2c9c184170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:05.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.539+0000 7f2ca3fff640 1 --2- 172.21.15.105:0/1168032658 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c9c036970 0x7f2c9c184170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.539+0000 7f2ca3fff640 1 -- 172.21.15.105:0/1168032658 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c9c0e07d0 con 0x7f2c9c009ba0 2024-09-21T03:18:05.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.539+0000 7f2ca95e7640 1 --2- 172.21.15.105:0/1168032658 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c9c036970 0x7f2c9c184170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:18:05.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.539+0000 7f2ca3fff640 1 --2- 172.21.15.105:0/1168032658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c9c009ba0 0x7f2c9c183c30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2c90009340 tx=0x7f2c900045c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:05.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.540+0000 7f2ca17fa640 1 -- 172.21.15.105:0/1168032658 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c90041070 con 0x7f2c9c009ba0 2024-09-21T03:18:05.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.540+0000 7f2ca17fa640 1 -- 172.21.15.105:0/1168032658 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c90003900 con 0x7f2c9c009ba0 2024-09-21T03:18:05.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.540+0000 7f2ca17fa640 1 -- 172.21.15.105:0/1168032658 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c90003d30 con 0x7f2c9c009ba0 2024-09-21T03:18:05.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.538+0000 7ff77e7fc640 1 -- 172.21.15.105:0/3048440326 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff784031d60 con 0x7ff7880cb820 2024-09-21T03:18:05.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.538+0000 7ff77e7fc640 1 -- 172.21.15.105:0/3048440326 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff784033e50 con 0x7ff7880cb820 2024-09-21T03:18:05.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.538+0000 7ff78fbc6640 1 -- 172.21.15.105:0/3048440326 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7880b48e0 con 0x7ff7880cb820 2024-09-21T03:18:05.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.538+0000 7ff78e163640 1 --2- 172.21.15.105:0/3048440326 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff788158dd0 0x7ff7881f5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:18:05.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.538+0000 7ff78fbc6640 1 -- 172.21.15.105:0/3048440326 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7880b4ea0 con 0x7ff7880cb820 2024-09-21T03:18:05.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.540+0000 7ff77e7fc640 1 -- 172.21.15.105:0/3048440326 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff784005280 con 0x7ff7880cb820 2024-09-21T03:18:05.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.542+0000 7ff77e7fc640 1 -- 172.21.15.105:0/3048440326 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff784004b30 con 0x7ff7880cb820 2024-09-21T03:18:05.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.541+0000 7f2cab04a640 1 -- 172.21.15.105:0/1168032658 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c9c0e0ab0 con 0x7f2c9c009ba0 2024-09-21T03:18:05.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.541+0000 7f2cab04a640 1 -- 172.21.15.105:0/1168032658 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c9c0e1070 con 0x7f2c9c009ba0 2024-09-21T03:18:05.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.541+0000 7f2ca17fa640 1 -- 172.21.15.105:0/1168032658 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2c90044070 con 0x7f2c9c009ba0 2024-09-21T03:18:05.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.541+0000 7f2ca17fa640 1 -- 172.21.15.105:0/1168032658 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2c90046a90 con 0x7f2c9c009ba0 2024-09-21T03:18:05.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.542+0000 7ff77e7fc640 1 -- 172.21.15.105:0/3048440326 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff784033520 con 0x7ff7880cb820 2024-09-21T03:18:05.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.542+0000 7fa9751c3640 1 -- 172.21.15.105:0/822200582 shutdown_connections 2024-09-21T03:18:05.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.542+0000 7f2c8effd640 1 -- 172.21.15.105:0/1168032658 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c7c005290 con 0x7f2c9c009ba0 2024-09-21T03:18:05.547 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.544+0000 7fdc99b7b640 1 -- 172.21.15.105:0/3539611301 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc74005290 con 0x7fdc8c054160 2024-09-21T03:18:05.547 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.544+0000 7ff773fff640 1 -- 172.21.15.105:0/3048440326 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff768005290 con 0x7ff7880cb820 2024-09-21T03:18:05.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.548+0000 7fdc7ffff640 1 -- 172.21.15.105:0/3539611301 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fdc94091080 con 0x7fdc8c054160 2024-09-21T03:18:05.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.542+0000 7fa9751c3640 1 -- 172.21.15.105:0/822200582 wait complete. 2024-09-21T03:18:05.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.550+0000 7fa9751c3640 1 Processor -- start 2024-09-21T03:18:05.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.550+0000 7fa9751c3640 1 -- start start 2024-09-21T03:18:05.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.550+0000 7ff77e7fc640 1 -- 172.21.15.105:0/3048440326 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ff78403f030 con 0x7ff7880cb820 2024-09-21T03:18:05.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.552+0000 7fa9751c3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9700ca1b0 0x7fa970147b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.553+0000 7fa9751c3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa97015ecd0 0x7fa970201e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.553+0000 7fa9751c3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa97015d9f0 0x7fa97015de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.553+0000 7fa9751c3640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa9700ce040 con 0x7fa9700ca1b0 2024-09-21T03:18:05.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.553+0000 7fa96f59e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa97015d9f0 0x7fa97015de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:05.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.553+0000 7fa96f59e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa97015d9f0 0x7fa97015de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.105:57648/0 (socket says 172.21.15.105:57648) 2024-09-21T03:18:05.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.553+0000 7fa96f59e640 1 -- 172.21.15.105:0/1821462676 learned_addr learned my addr 172.21.15.105:0/1821462676 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:05.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.553+0000 7fa9751c3640 1 -- 172.21.15.105:0/1821462676 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa9700d0890 con 0x7fa97015d9f0 2024-09-21T03:18:05.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.553+0000 7fa9751c3640 1 -- 172.21.15.105:0/1821462676 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa9700ce1c0 con 0x7fa97015ecd0 2024-09-21T03:18:05.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.554+0000 7fa96e59c640 1 --2- 172.21.15.105:0/1821462676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa97015ecd0 0x7fa970201e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:05.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.554+0000 7fa96f59e640 1 -- 172.21.15.105:0/1821462676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa97015ecd0 msgr2=0x7fa970201e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.554+0000 7fa96f59e640 1 --2- 172.21.15.105:0/1821462676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa97015ecd0 0x7fa970201e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.554+0000 7fa96f59e640 1 -- 172.21.15.105:0/1821462676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9700ca1b0 msgr2=0x7fa970147b60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:18:05.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.554+0000 7fa96ed9d640 1 --2- 172.21.15.105:0/1821462676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9700ca1b0 0x7fa970147b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:05.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.554+0000 7fa96f59e640 1 --2- 172.21.15.105:0/1821462676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9700ca1b0 0x7fa970147b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.554+0000 7fa96f59e640 1 -- 172.21.15.105:0/1821462676 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa97015e340 con 0x7fa97015d9f0 2024-09-21T03:18:05.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.555+0000 7fa96ed9d640 1 --2- 172.21.15.105:0/1821462676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9700ca1b0 0x7fa970147b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:18:05.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.555+0000 7fa96f59e640 1 --2- 172.21.15.105:0/1821462676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa97015d9f0 0x7fa97015de00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa96800cb40 tx=0x7fa96800a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:05.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.555+0000 7fa96e59c640 1 --2- 172.21.15.105:0/1821462676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa97015ecd0 0x7fa970201e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:18:05.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.555+0000 7fa9577fe640 1 -- 172.21.15.105:0/1821462676 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa968016020 con 0x7fa97015d9f0 2024-09-21T03:18:05.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.555+0000 7fa9751c3640 1 -- 172.21.15.105:0/1821462676 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa970202820 con 0x7fa97015d9f0 2024-09-21T03:18:05.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.555+0000 7fa9751c3640 1 -- 172.21.15.105:0/1821462676 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa970202da0 con 0x7fa97015d9f0 2024-09-21T03:18:05.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.556+0000 7fa9577fe640 1 -- 172.21.15.105:0/1821462676 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa96800acd0 con 0x7fa97015d9f0 2024-09-21T03:18:05.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.556+0000 7fa9577fe640 1 -- 172.21.15.105:0/1821462676 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa968012680 con 0x7fa97015d9f0 2024-09-21T03:18:05.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.553+0000 7f2ca17fa640 1 -- 172.21.15.105:0/1168032658 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f2c9c006070 con 0x7f2c9c009ba0 2024-09-21T03:18:05.563 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.562+0000 7fa9577fe640 1 -- 172.21.15.105:0/1821462676 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa968019020 con 0x7fa97015d9f0 2024-09-21T03:18:05.563 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.562+0000 7fa9577fe640 1 -- 172.21.15.105:0/1821462676 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa96801a410 con 0x7fa97015d9f0 2024-09-21T03:18:05.563 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.562+0000 7f82f72d7640 1 -- 172.21.15.105:0/1940550835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82e803c1f0 msgr2=0x7f82e8053eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.562+0000 7f82f72d7640 1 --2- 172.21.15.105:0/1940550835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82e803c1f0 0x7f82e8053eb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f82e0009830 tx=0x7f82e002a4a0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.565+0000 7fa9751c3640 1 -- 172.21.15.105:0/1821462676 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa950005290 con 0x7fa97015d9f0 2024-09-21T03:18:05.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.567+0000 7f82f72d7640 1 -- 172.21.15.105:0/1940550835 shutdown_connections 2024-09-21T03:18:05.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.567+0000 7f82f72d7640 1 --2- 172.21.15.105:0/1940550835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82e803c1f0 0x7f82e8053eb0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.567+0000 7f82f72d7640 1 -- 172.21.15.105:0/1940550835 >> 172.21.15.105:0/1940550835 conn(0x7f82e803a5f0 msgr2=0x7f82e803aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:05.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.568+0000 7fa9577fe640 1 -- 172.21.15.105:0/1821462676 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa968020030 con 0x7fa97015d9f0 2024-09-21T03:18:05.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.570+0000 7fe161ffb640 1 -- 172.21.15.105:0/2935308963 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7fe17c0d0f70 con 0x7fe17c0acae0 2024-09-21T03:18:05.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.580+0000 7f82f72d7640 1 -- 172.21.15.105:0/1940550835 shutdown_connections 2024-09-21T03:18:05.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.581+0000 7f82f72d7640 1 -- 172.21.15.105:0/1940550835 wait complete. 2024-09-21T03:18:05.591 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.586+0000 7fe163fff640 1 -- 172.21.15.105:0/2935308963 <== mon.2 v2:172.21.15.162:3301/0 8 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v10)=0 v10) ==== 115+0+0 (secure 0 0 0) 0x7fe1740129f0 con 0x7fe17c0acae0 2024-09-21T03:18:05.591 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.587+0000 7f82f72d7640 1 Processor -- start 2024-09-21T03:18:05.591 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.587+0000 7f82f72d7640 1 -- start start 2024-09-21T03:18:05.591 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.589+0000 7f82f72d7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82e803c1f0 0x7f82e8187890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.591 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.589+0000 7f82f72d7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82e80537b0 0x7f82e80dfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.592 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.590+0000 7fe161ffb640 1 -- 172.21.15.105:0/2935308963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe17c0acae0 msgr2=0x7fe17c0ac140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.592 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.590+0000 7fe161ffb640 1 --2- 172.21.15.105:0/2935308963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe17c0acae0 0x7fe17c0ac140 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe17400cb00 tx=0x7fe174002180 comp rx=0 tx=0).stop 2024-09-21T03:18:05.593 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.592+0000 7f82f5ad4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82e80537b0 0x7f82e80dfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:05.593 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.592+0000 7f82f5ad4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82e80537b0 0x7f82e80dfdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:33858/0 (socket says 172.21.15.105:33858) 2024-09-21T03:18:05.593 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.592+0000 7f82f62d5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82e803c1f0 0x7f82e8187890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:05.594 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.592+0000 7f82f62d5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82e803c1f0 0x7f82e8187890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.105:35716/0 (socket says 172.21.15.105:35716) 2024-09-21T03:18:05.594 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.592+0000 7f82f5ad4640 1 -- 172.21.15.105:0/724864320 learned_addr learned my addr 172.21.15.105:0/724864320 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:05.594 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.592+0000 7fe161ffb640 1 -- 172.21.15.105:0/2935308963 shutdown_connections 2024-09-21T03:18:05.594 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.592+0000 7fe161ffb640 1 --2- 172.21.15.105:0/2935308963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe17c0acae0 0x7fe17c0ac140 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.594 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.592+0000 7fe161ffb640 1 --2- 172.21.15.105:0/2935308963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe17c0b50c0 0x7fe17c0abc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.594 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.592+0000 7fe161ffb640 1 --2- 172.21.15.105:0/2935308963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe17c06d500 0x7fe17c146bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.594 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.592+0000 7fe161ffb640 1 -- 172.21.15.105:0/2935308963 >> 172.21.15.105:0/2935308963 conn(0x7fe17c0b2e10 msgr2=0x7fe17c1617c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:05.595 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.592+0000 7f82f72d7640 1 --2- 172.21.15.105:0/724864320 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82e8056da0 0x7f82e80e02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.595 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.592+0000 7f82f72d7640 1 -- 172.21.15.105:0/724864320 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f82e80e1820 con 0x7f82e80537b0 2024-09-21T03:18:05.595 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.592+0000 7f82f72d7640 1 -- 172.21.15.105:0/724864320 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f82e80e16a0 con 0x7f82e8056da0 2024-09-21T03:18:05.595 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.592+0000 7f82f72d7640 1 -- 172.21.15.105:0/724864320 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f82e80e19a0 con 0x7f82e803c1f0 2024-09-21T03:18:05.595 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.592+0000 7fe161ffb640 1 -- 172.21.15.105:0/2935308963 shutdown_connections 2024-09-21T03:18:05.595 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.592+0000 7fe161ffb640 1 -- 172.21.15.105:0/2935308963 wait complete. 2024-09-21T03:18:05.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.601+0000 7ff230f72640 1 -- 172.21.15.105:0/81324748 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff22c072e30 msgr2=0x7ff22c073240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.601+0000 7ff230f72640 1 --2- 172.21.15.105:0/81324748 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff22c072e30 0x7ff22c073240 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff224005fd0 tx=0x7ff22402a820 comp rx=0 tx=0).stop 2024-09-21T03:18:05.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.601+0000 7f82f5ad4640 1 -- 172.21.15.105:0/724864320 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82e803c1f0 msgr2=0x7f82e8187890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.601+0000 7f82f5ad4640 1 --2- 172.21.15.105:0/724864320 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82e803c1f0 0x7f82e8187890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.601+0000 7f82f5ad4640 1 -- 172.21.15.105:0/724864320 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82e8056da0 msgr2=0x7f82e80e02f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T03:18:05.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.601+0000 7f82f5ad4640 1 --2- 172.21.15.105:0/724864320 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82e8056da0 0x7f82e80e02f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.601+0000 7f82f5ad4640 1 -- 172.21.15.105:0/724864320 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e800d7e0 con 0x7f82e80537b0 2024-09-21T03:18:05.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.602+0000 7f82f5ad4640 1 --2- 172.21.15.105:0/724864320 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82e80537b0 0x7f82e80dfdb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f82ec00c730 tx=0x7f82ec00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:05.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.602+0000 7f82f62d5640 1 --2- 172.21.15.105:0/724864320 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82e803c1f0 0x7f82e8187890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:18:05.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.604+0000 7f82e6ffd640 1 -- 172.21.15.105:0/724864320 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ec016020 con 0x7f82e80537b0 2024-09-21T03:18:05.608 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.604+0000 7f82e6ffd640 1 -- 172.21.15.105:0/724864320 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f82ec00a640 con 0x7f82e80537b0 2024-09-21T03:18:05.608 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.604+0000 7f82e6ffd640 1 -- 172.21.15.105:0/724864320 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ec00aa90 con 0x7f82e80537b0 2024-09-21T03:18:05.609 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.607+0000 7f82f72d7640 1 -- 172.21.15.105:0/724864320 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82e8188120 con 0x7f82e80537b0 2024-09-21T03:18:05.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.611+0000 7f883c2d5640 1 -- 172.21.15.105:0/2200438368 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f882c035210 msgr2=0x7f882c035620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.611+0000 7f883c2d5640 1 --2- 172.21.15.105:0/2200438368 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f882c035210 0x7f882c035620 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f883406af90 tx=0x7f88340a65b0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.611+0000 7f883c2d5640 1 -- 172.21.15.105:0/2200438368 shutdown_connections 2024-09-21T03:18:05.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.611+0000 7f883c2d5640 1 --2- 172.21.15.105:0/2200438368 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f882c035210 0x7f882c035620 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.611+0000 7f883c2d5640 1 --2- 172.21.15.105:0/2200438368 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f882c0dfe60 0x7f882c008d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.611+0000 7f883c2d5640 1 -- 172.21.15.105:0/2200438368 >> 172.21.15.105:0/2200438368 conn(0x7f882c01eb00 msgr2=0x7f882c03a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:05.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.607+0000 7f82f72d7640 1 -- 172.21.15.105:0/724864320 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82e81886e0 con 0x7f82e80537b0 2024-09-21T03:18:05.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.612+0000 7f82e6ffd640 1 -- 172.21.15.105:0/724864320 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f82ec019020 con 0x7f82e80537b0 2024-09-21T03:18:05.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.612+0000 7f82e6ffd640 1 -- 172.21.15.105:0/724864320 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f82ec01b680 con 0x7f82e80537b0 2024-09-21T03:18:05.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.612+0000 7f82f72d7640 1 -- 172.21.15.105:0/724864320 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82e8187f20 con 0x7f82e80537b0 2024-09-21T03:18:05.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.612+0000 7ff230f72640 1 -- 172.21.15.105:0/81324748 shutdown_connections 2024-09-21T03:18:05.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.612+0000 7ff230f72640 1 --2- 172.21.15.105:0/81324748 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff22c072e30 0x7ff22c073240 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.612+0000 7ff230f72640 1 --2- 172.21.15.105:0/81324748 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff22c15f650 0x7ff22c15fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.612+0000 7ff230f72640 1 -- 172.21.15.105:0/81324748 >> 172.21.15.105:0/81324748 conn(0x7ff22c06d410 msgr2=0x7ff22c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:05.617 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.616+0000 7f82e6ffd640 1 -- 172.21.15.105:0/724864320 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f82ec020070 con 0x7f82e80537b0 2024-09-21T03:18:05.619 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.618+0000 7f883c2d5640 1 -- 172.21.15.105:0/2200438368 shutdown_connections 2024-09-21T03:18:05.627 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.623+0000 7f883c2d5640 1 -- 172.21.15.105:0/2200438368 wait complete. 2024-09-21T03:18:05.627 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.626+0000 7ff230f72640 1 -- 172.21.15.105:0/81324748 shutdown_connections 2024-09-21T03:18:05.628 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.626+0000 7f883c2d5640 1 Processor -- start 2024-09-21T03:18:05.628 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.626+0000 7f883c2d5640 1 -- start start 2024-09-21T03:18:05.628 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi105') 2024-09-21T03:18:05.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.626+0000 7ff230f72640 1 -- 172.21.15.105:0/81324748 wait complete. 2024-09-21T03:18:05.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.629+0000 7ff230f72640 1 Processor -- start 2024-09-21T03:18:05.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.629+0000 7f883c2d5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f882c035210 0x7f882c0d0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.629+0000 7f883c2d5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f882c0dfe60 0x7f882c177fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.629+0000 7ff230f72640 1 -- start start 2024-09-21T03:18:05.632 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.630+0000 7f883a071640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f882c035210 0x7f882c0d0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:05.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.630+0000 7f883a071640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f882c035210 0x7f882c0d0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.105:57674/0 (socket says 172.21.15.105:57674) 2024-09-21T03:18:05.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.630+0000 7f883c2d5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f882c04dd70 0x7f882c1784f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.630+0000 7f883a071640 1 -- 172.21.15.105:0/954510491 learned_addr learned my addr 172.21.15.105:0/954510491 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:05.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.630+0000 7f883c2d5640 1 -- 172.21.15.105:0/954510491 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f882c053570 con 0x7f882c0dfe60 2024-09-21T03:18:05.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.630+0000 7f883a872640 1 --2- 172.21.15.105:0/954510491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f882c04dd70 0x7f882c1784f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:05.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.630+0000 7f883c2d5640 1 -- 172.21.15.105:0/954510491 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f882c0533f0 con 0x7f882c035210 2024-09-21T03:18:05.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.630+0000 7f883c2d5640 1 -- 172.21.15.105:0/954510491 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f882c0536f0 con 0x7f882c04dd70 2024-09-21T03:18:05.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.631+0000 7ff230f72640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff22c072e30 0x7ff22c1514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.631+0000 7ff230f72640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff22c15ea80 0x7ff22c151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.631+0000 7ff230f72640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff22c15f650 0x7ff22c09aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:05.634 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.631+0000 7ff230f72640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff22c0cf940 con 0x7ff22c15f650 2024-09-21T03:18:05.634 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.631+0000 7ff230f72640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff22c0cf7c0 con 0x7ff22c072e30 2024-09-21T03:18:05.634 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.631+0000 7ff230f72640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff22c0cfac0 con 0x7ff22c15ea80 2024-09-21T03:18:05.635 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.633+0000 7f883a071640 1 -- 172.21.15.105:0/954510491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f882c04dd70 msgr2=0x7f882c1784f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.635 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.633+0000 7f883a071640 1 --2- 172.21.15.105:0/954510491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f882c04dd70 0x7f882c1784f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.635 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.633+0000 7f883a071640 1 -- 172.21.15.105:0/954510491 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f882c0dfe60 msgr2=0x7f882c177fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.635 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.633+0000 7f883a071640 1 --2- 172.21.15.105:0/954510491 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f882c0dfe60 0x7f882c177fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.635 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.633+0000 7f883a071640 1 -- 172.21.15.105:0/954510491 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f882c04ccd0 con 0x7f882c035210 2024-09-21T03:18:05.635 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.633+0000 7f883a872640 1 --2- 172.21.15.105:0/954510491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f882c04dd70 0x7f882c1784f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:18:05.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.637+0000 7f883a071640 1 --2- 172.21.15.105:0/954510491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f882c035210 0x7f882c0d0000 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8830010c00 tx=0x7f883000c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:05.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.637+0000 7f882affd640 1 -- 172.21.15.105:0/954510491 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883001d070 con 0x7f882c035210 2024-09-21T03:18:05.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.637+0000 7f882affd640 1 -- 172.21.15.105:0/954510491 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8830018720 con 0x7f882c035210 2024-09-21T03:18:05.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.637+0000 7f883c2d5640 1 -- 172.21.15.105:0/954510491 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f882c04cfb0 con 0x7f882c035210 2024-09-21T03:18:05.642 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.637+0000 7f883c2d5640 1 -- 172.21.15.105:0/954510491 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f882c04d570 con 0x7f882c035210 2024-09-21T03:18:05.642 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.639+0000 7f882affd640 1 -- 172.21.15.105:0/954510491 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8830018b50 con 0x7f882c035210 2024-09-21T03:18:05.642 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.640+0000 7f882affd640 1 -- 172.21.15.105:0/954510491 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8830020070 con 0x7f882c035210 2024-09-21T03:18:05.642 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.640+0000 7f882affd640 1 -- 172.21.15.105:0/954510491 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f88300216f0 con 0x7f882c035210 2024-09-21T03:18:05.642 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.640+0000 7f8828ff9640 1 -- 172.21.15.105:0/954510491 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f881c005290 con 0x7f882c035210 2024-09-21T03:18:05.643 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.631+0000 7ff22ad9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff22c15f650 0x7ff22c09aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:05.643 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.631+0000 7ff22ad9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff22c15f650 0x7ff22c09aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:33878/0 (socket says 172.21.15.105:33878) 2024-09-21T03:18:05.643 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.631+0000 7ff22ad9d640 1 -- 172.21.15.105:0/1940808198 learned_addr learned my addr 172.21.15.105:0/1940808198 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:05.643 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.632+0000 7ff22ad9d640 1 -- 172.21.15.105:0/1940808198 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff22c15ea80 msgr2=0x7ff22c151a00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:18:05.643 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.632+0000 7ff22ad9d640 1 --2- 172.21.15.105:0/1940808198 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff22c15ea80 0x7ff22c151a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.643 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.632+0000 7ff22ad9d640 1 -- 172.21.15.105:0/1940808198 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff22c072e30 msgr2=0x7ff22c1514c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:18:05.643 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.632+0000 7ff22ad9d640 1 --2- 172.21.15.105:0/1940808198 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff22c072e30 0x7ff22c1514c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.643 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.632+0000 7ff22ad9d640 1 -- 172.21.15.105:0/1940808198 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff22c1524a0 con 0x7ff22c15f650 2024-09-21T03:18:05.643 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.632+0000 7ff22ad9d640 1 --2- 172.21.15.105:0/1940808198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff22c15f650 0x7ff22c09aec0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff224009cd0 tx=0x7ff224033ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:05.644 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.632+0000 7ff21affd640 1 -- 172.21.15.105:0/1940808198 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff224037050 con 0x7ff22c15f650 2024-09-21T03:18:05.644 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.633+0000 7ff21affd640 1 -- 172.21.15.105:0/1940808198 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff224043070 con 0x7ff22c15f650 2024-09-21T03:18:05.644 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.633+0000 7ff21affd640 1 -- 172.21.15.105:0/1940808198 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff224004440 con 0x7ff22c15f650 2024-09-21T03:18:05.644 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.641+0000 7ff230f72640 1 -- 172.21.15.105:0/1940808198 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff22c153890 con 0x7ff22c15f650 2024-09-21T03:18:05.644 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.641+0000 7ff230f72640 1 -- 172.21.15.105:0/1940808198 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff22c151f40 con 0x7ff22c15f650 2024-09-21T03:18:05.644 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.641+0000 7ff21affd640 1 -- 172.21.15.105:0/1940808198 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff2240045e0 con 0x7ff22c15f650 2024-09-21T03:18:05.644 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.641+0000 7ff21affd640 1 -- 172.21.15.105:0/1940808198 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff22403e580 con 0x7ff22c15f650 2024-09-21T03:18:05.644 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.642+0000 7ff218ff9640 1 -- 172.21.15.105:0/1940808198 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff22c073240 con 0x7ff22c15f650 2024-09-21T03:18:05.649 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.644+0000 7f882affd640 1 -- 172.21.15.105:0/954510491 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f88300219a0 con 0x7f882c035210 2024-09-21T03:18:05.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.649+0000 7f72a9ffb640 1 -- 172.21.15.105:0/994143169 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f72c416b960 con 0x7f72c40cd320 2024-09-21T03:18:05.651 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.649+0000 7ff21affd640 1 -- 172.21.15.105:0/1940808198 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ff224033070 con 0x7ff22c15f650 2024-09-21T03:18:05.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.655+0000 7f13cc3eb640 1 -- 172.21.15.105:0/1318972051 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f13ac005580 con 0x7f13c40afde0 2024-09-21T03:18:05.660 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.659+0000 7f72abfff640 1 -- 172.21.15.105:0/994143169 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v11)=0 v11) ==== 119+0+0 (secure 0 0 0) 0x7f72bc011550 con 0x7f72c40cd320 2024-09-21T03:18:05.664 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.662+0000 7f13baffd640 1 -- 172.21.15.105:0/1318972051 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7f13bc046400 con 0x7f13c40afde0 2024-09-21T03:18:05.670 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.668+0000 7f72c9c9b640 1 -- 172.21.15.105:0/994143169 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72c40cd320 msgr2=0x7f72c408a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.671 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.668+0000 7f72c9c9b640 1 --2- 172.21.15.105:0/994143169 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72c40cd320 0x7f72c408a320 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f72bc00e990 tx=0x7f72bc00ee50 comp rx=0 tx=0).stop 2024-09-21T03:18:05.671 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.668+0000 7f72c9c9b640 1 -- 172.21.15.105:0/994143169 shutdown_connections 2024-09-21T03:18:05.671 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.668+0000 7f72c9c9b640 1 --2- 172.21.15.105:0/994143169 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72c40cd320 0x7f72c408a320 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.671 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.668+0000 7f72c9c9b640 1 --2- 172.21.15.105:0/994143169 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f72c40cb180 0x7f72c416bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.671 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.669+0000 7f72c9c9b640 1 --2- 172.21.15.105:0/994143169 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72c408b140 0x7f72c4202840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.671 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.669+0000 7f72c9c9b640 1 -- 172.21.15.105:0/994143169 >> 172.21.15.105:0/994143169 conn(0x7f72c40b20a0 msgr2=0x7f72c40d09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:05.671 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.669+0000 7f72c9c9b640 1 -- 172.21.15.105:0/994143169 shutdown_connections 2024-09-21T03:18:05.671 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.669+0000 7f72c9c9b640 1 -- 172.21.15.105:0/994143169 wait complete. 2024-09-21T03:18:05.671 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.669+0000 7f13cc3eb640 1 -- 172.21.15.105:0/1318972051 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13c40afde0 msgr2=0x7f13c40c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.671 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.669+0000 7f13cc3eb640 1 --2- 172.21.15.105:0/1318972051 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13c40afde0 0x7f13c40c8290 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f13bc009ca0 tx=0x7f13bc031980 comp rx=0 tx=0).stop 2024-09-21T03:18:05.677 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.676+0000 7f13cc3eb640 1 -- 172.21.15.105:0/1318972051 shutdown_connections 2024-09-21T03:18:05.677 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.676+0000 7f13cc3eb640 1 --2- 172.21.15.105:0/1318972051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13c40c6490 0x7f13c41fd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.677 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.676+0000 7f13cc3eb640 1 --2- 172.21.15.105:0/1318972051 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13c40c58a0 0x7f13c40b6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.678 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.676+0000 7f13cc3eb640 1 --2- 172.21.15.105:0/1318972051 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13c40afde0 0x7f13c40c8290 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.678 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.676+0000 7f13cc3eb640 1 -- 172.21.15.105:0/1318972051 >> 172.21.15.105:0/1318972051 conn(0x7f13c40cd480 msgr2=0x7f13c40b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:05.678 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.676+0000 7f13cc3eb640 1 -- 172.21.15.105:0/1318972051 shutdown_connections 2024-09-21T03:18:05.678 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.676+0000 7f13cc3eb640 1 -- 172.21.15.105:0/1318972051 wait complete. 2024-09-21T03:18:05.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.693+0000 7f2a7c81d640 1 -- 172.21.15.105:0/2626100514 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f2a78070f20 con 0x7f2a780743e0 2024-09-21T03:18:05.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.705+0000 7f2a6effd640 1 -- 172.21.15.105:0/2626100514 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v13)=0 v13) ==== 121+0+0 (secure 0 0 0) 0x7f2a6803b460 con 0x7f2a780743e0 2024-09-21T03:18:05.709 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi105') 2024-09-21T03:18:05.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.711+0000 7f2a7c81d640 1 -- 172.21.15.105:0/2626100514 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a780743e0 msgr2=0x7f2a78129980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.711+0000 7f2a7c81d640 1 --2- 172.21.15.105:0/2626100514 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a780743e0 0x7f2a78129980 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2a680099c0 tx=0x7f2a68004f60 comp rx=0 tx=0).stop 2024-09-21T03:18:05.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.711+0000 7f2a7c81d640 1 -- 172.21.15.105:0/2626100514 shutdown_connections 2024-09-21T03:18:05.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.711+0000 7f2a7c81d640 1 --2- 172.21.15.105:0/2626100514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a78156b10 0x7f2a78156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.711+0000 7f2a7c81d640 1 --2- 172.21.15.105:0/2626100514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a7815ee50 0x7f2a78141a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.711+0000 7f2a7c81d640 1 --2- 172.21.15.105:0/2626100514 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a780743e0 0x7f2a78129980 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.714 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.711+0000 7f2a7c81d640 1 -- 172.21.15.105:0/2626100514 >> 172.21.15.105:0/2626100514 conn(0x7f2a780d1210 msgr2=0x7f2a78161940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:05.714 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.711+0000 7f2a7c81d640 1 -- 172.21.15.105:0/2626100514 shutdown_connections 2024-09-21T03:18:05.714 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.711+0000 7f2a7c81d640 1 -- 172.21.15.105:0/2626100514 wait complete. 2024-09-21T03:18:05.716 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.714+0000 7fbbf1300640 1 -- 172.21.15.105:0/313496542 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7fbbcc005580 con 0x7fbbe4054130 2024-09-21T03:18:05.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.720+0000 7fbbe8ff9640 1 -- 172.21.15.105:0/313496542 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v14)=0 v14) ==== 121+0+0 (secure 0 0 0) 0x7fbbe001ce20 con 0x7fbbe4054130 2024-09-21T03:18:05.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.727+0000 7fbbf1300640 1 -- 172.21.15.105:0/313496542 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbe4054130 msgr2=0x7fbbe40330d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.727+0000 7fbbf1300640 1 --2- 172.21.15.105:0/313496542 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbe4054130 0x7fbbe40330d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbbe000c550 tx=0x7fbbe000ca10 comp rx=0 tx=0).stop 2024-09-21T03:18:05.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.727+0000 7fbbf1300640 1 -- 172.21.15.105:0/313496542 shutdown_connections 2024-09-21T03:18:05.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.727+0000 7fbbf1300640 1 --2- 172.21.15.105:0/313496542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbe40550e0 0x7fbbe40fcc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.727+0000 7fbbf1300640 1 --2- 172.21.15.105:0/313496542 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbe4054130 0x7fbbe40330d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.727+0000 7fbbf1300640 1 --2- 172.21.15.105:0/313496542 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbe40070b0 0x7fbbe41a38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.727+0000 7fbbf1300640 1 -- 172.21.15.105:0/313496542 >> 172.21.15.105:0/313496542 conn(0x7fbbe401d9a0 msgr2=0x7fbbe40f8500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:05.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.729+0000 7fbbf1300640 1 -- 172.21.15.105:0/313496542 shutdown_connections 2024-09-21T03:18:05.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.729+0000 7fbbf1300640 1 -- 172.21.15.105:0/313496542 wait complete. 2024-09-21T03:18:05.745 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi105') 2024-09-21T03:18:05.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.758+0000 7fcee6273640 1 -- 172.21.15.105:0/3730437899 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7fced8005de0 con 0x7fced80dca80 2024-09-21T03:18:05.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.760+0000 7f5a6dffb640 1 -- 172.21.15.105:0/2755711677 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f5a7c0075c0 con 0x7f5a7c032630 2024-09-21T03:18:05.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.757+0000 7ff773fff640 1 -- 172.21.15.105:0/3048440326 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7ff768005580 con 0x7ff7880cb820 2024-09-21T03:18:05.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.764+0000 7fdc99b7b640 1 -- 172.21.15.105:0/3539611301 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fdc74005580 con 0x7fdc8c054160 2024-09-21T03:18:05.767 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.766+0000 7f5a6ffff640 1 -- 172.21.15.105:0/2755711677 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v15)=0 v15) ==== 120+0+0 (secure 0 0 0) 0x7f5a7c006070 con 0x7f5a7c032630 2024-09-21T03:18:05.768 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.767+0000 7f5a6dffb640 1 -- 172.21.15.105:0/2755711677 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a7c032630 msgr2=0x7f5a7c18a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.768 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.767+0000 7f5a6dffb640 1 --2- 172.21.15.105:0/2755711677 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a7c032630 0x7f5a7c18a9c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5a84052860 tx=0x7f5a840ac660 comp rx=0 tx=0).stop 2024-09-21T03:18:05.769 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.767+0000 7f5a6dffb640 1 -- 172.21.15.105:0/2755711677 shutdown_connections 2024-09-21T03:18:05.769 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.767+0000 7f5a6dffb640 1 --2- 172.21.15.105:0/2755711677 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a7c032630 0x7f5a7c18a9c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.769 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.767+0000 7f5a6dffb640 1 --2- 172.21.15.105:0/2755711677 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a7c009ba0 0x7f5a7c02cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.769 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.767+0000 7f5a6dffb640 1 --2- 172.21.15.105:0/2755711677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a7c005c60 0x7f5a7c02c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.769 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.767+0000 7f5a6dffb640 1 -- 172.21.15.105:0/2755711677 >> 172.21.15.105:0/2755711677 conn(0x7f5a7c051420 msgr2=0x7f5a7c038410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:05.769 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.767+0000 7f5a6dffb640 1 -- 172.21.15.105:0/2755711677 shutdown_connections 2024-09-21T03:18:05.769 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.767+0000 7f5a6dffb640 1 -- 172.21.15.105:0/2755711677 wait complete. 2024-09-21T03:18:05.771 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.770+0000 7f2c8effd640 1 -- 172.21.15.105:0/1168032658 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f2c7c005850 con 0x7f2c9c009ba0 2024-09-21T03:18:05.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.772+0000 7fced5ffb640 1 -- 172.21.15.105:0/3730437899 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v16)=0 v16) ==== 119+0+0 (secure 0 0 0) 0x7fced0012940 con 0x7fced80dca80 2024-09-21T03:18:05.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.774+0000 7fcee6273640 1 -- 172.21.15.105:0/3730437899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fced80dca80 msgr2=0x7fced8032760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.774+0000 7fcee6273640 1 --2- 172.21.15.105:0/3730437899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fced80dca80 0x7fced8032760 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fced000c760 tx=0x7fced000cc20 comp rx=0 tx=0).stop 2024-09-21T03:18:05.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.774+0000 7fcee6273640 1 -- 172.21.15.105:0/3730437899 shutdown_connections 2024-09-21T03:18:05.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.774+0000 7fcee6273640 1 --2- 172.21.15.105:0/3730437899 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fced8032ca0 0x7fced80e3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.774+0000 7fcee6273640 1 --2- 172.21.15.105:0/3730437899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fced80dca80 0x7fced8032760 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.774+0000 7fcee6273640 1 --2- 172.21.15.105:0/3730437899 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcecc005270 0x7fced80dbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.775+0000 7fcee6273640 1 -- 172.21.15.105:0/3730437899 >> 172.21.15.105:0/3730437899 conn(0x7fced801d9a0 msgr2=0x7fced8051250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:05.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.775+0000 7fcee6273640 1 -- 172.21.15.105:0/3730437899 shutdown_connections 2024-09-21T03:18:05.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.775+0000 7fcee6273640 1 -- 172.21.15.105:0/3730437899 wait complete. 2024-09-21T03:18:05.780 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.779+0000 7ff77e7fc640 1 -- 172.21.15.105:0/3048440326 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v17)=0 v17) ==== 106+0+0 (secure 0 0 0) 0x7ff784033770 con 0x7ff7880cb820 2024-09-21T03:18:05.783 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.781+0000 7ff773fff640 1 -- 172.21.15.105:0/3048440326 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7880cb820 msgr2=0x7ff7882021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.783 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.781+0000 7ff773fff640 1 --2- 172.21.15.105:0/3048440326 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7880cb820 0x7ff7882021f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff784031000 tx=0x7ff784033ba0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.783 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.781+0000 7ff773fff640 1 -- 172.21.15.105:0/3048440326 shutdown_connections 2024-09-21T03:18:05.783 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.781+0000 7ff773fff640 1 --2- 172.21.15.105:0/3048440326 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff788158dd0 0x7ff7881f5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.783 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.781+0000 7ff773fff640 1 --2- 172.21.15.105:0/3048440326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7880ce660 0x7ff788157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.783 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.781+0000 7ff773fff640 1 --2- 172.21.15.105:0/3048440326 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7880cb820 0x7ff7882021f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.783 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.781+0000 7ff773fff640 1 -- 172.21.15.105:0/3048440326 >> 172.21.15.105:0/3048440326 conn(0x7ff78806d5d0 msgr2=0x7ff788073de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:05.783 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.781+0000 7ff773fff640 1 -- 172.21.15.105:0/3048440326 shutdown_connections 2024-09-21T03:18:05.783 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.781+0000 7ff773fff640 1 -- 172.21.15.105:0/3048440326 wait complete. 2024-09-21T03:18:05.789 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.788+0000 7fdc7ffff640 1 -- 172.21.15.105:0/3539611301 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v18)=0 v18) ==== 120+0+0 (secure 0 0 0) 0x7fdc9407e030 con 0x7fdc8c054160 2024-09-21T03:18:05.791 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.789+0000 7fdc99b7b640 1 -- 172.21.15.105:0/3539611301 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc8c054160 msgr2=0x7fdc8c04d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.791 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.789+0000 7fdc99b7b640 1 --2- 172.21.15.105:0/3539611301 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc8c054160 0x7fdc8c04d400 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdc94051230 tx=0x7fdc9406a0c0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.791 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.790+0000 7fdc99b7b640 1 -- 172.21.15.105:0/3539611301 shutdown_connections 2024-09-21T03:18:05.791 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.790+0000 7fdc99b7b640 1 --2- 172.21.15.105:0/3539611301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc8c10f810 0x7fdc8c04d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.791 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.790+0000 7fdc99b7b640 1 --2- 172.21.15.105:0/3539611301 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc8c054160 0x7fdc8c04d400 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.791 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.790+0000 7fdc99b7b640 1 --2- 172.21.15.105:0/3539611301 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc8c0070e0 0x7fdc8c0f2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.791 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.790+0000 7fdc99b7b640 1 -- 172.21.15.105:0/3539611301 >> 172.21.15.105:0/3539611301 conn(0x7fdc8c01d9d0 msgr2=0x7fdc8c0fd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:05.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.790+0000 7fdc99b7b640 1 -- 172.21.15.105:0/3539611301 shutdown_connections 2024-09-21T03:18:05.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.790+0000 7fdc99b7b640 1 -- 172.21.15.105:0/3539611301 wait complete. 2024-09-21T03:18:05.795 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.793+0000 7f2ca17fa640 1 -- 172.21.15.105:0/1168032658 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v19)=0 v19) ==== 111+0+0 (secure 0 0 0) 0x7f2c90004840 con 0x7f2c9c009ba0 2024-09-21T03:18:05.795 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi105') 2024-09-21T03:18:05.795 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi105') 2024-09-21T03:18:05.795 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi105') 2024-09-21T03:18:05.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.795+0000 7f2c8effd640 1 -- 172.21.15.105:0/1168032658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c9c009ba0 msgr2=0x7f2c9c183c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.795+0000 7f2c8effd640 1 --2- 172.21.15.105:0/1168032658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c9c009ba0 0x7f2c9c183c30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2c90009340 tx=0x7f2c900045c0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.795+0000 7f2c8effd640 1 -- 172.21.15.105:0/1168032658 shutdown_connections 2024-09-21T03:18:05.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.795+0000 7f2c8effd640 1 --2- 172.21.15.105:0/1168032658 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c9c036970 0x7f2c9c184170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.795+0000 7f2c8effd640 1 --2- 172.21.15.105:0/1168032658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c9c009ba0 0x7f2c9c183c30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.795+0000 7f2c8effd640 1 --2- 172.21.15.105:0/1168032658 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c9c005c60 0x7f2c9c01e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.795+0000 7f2c8effd640 1 -- 172.21.15.105:0/1168032658 >> 172.21.15.105:0/1168032658 conn(0x7f2c9c051420 msgr2=0x7f2c9c038410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:05.802 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.799+0000 7f8828ff9640 1 -- 172.21.15.105:0/954510491 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f881c005580 con 0x7f882c035210 2024-09-21T03:18:05.802 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.799+0000 7f2c8effd640 1 -- 172.21.15.105:0/1168032658 shutdown_connections 2024-09-21T03:18:05.802 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.799+0000 7f2c8effd640 1 -- 172.21.15.105:0/1168032658 wait complete. 2024-09-21T03:18:05.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.805+0000 7f882affd640 1 -- 172.21.15.105:0/954510491 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v20)=0 v20) ==== 125+0+0 (secure 0 0 0) 0x7f8830021be0 con 0x7f882c035210 2024-09-21T03:18:05.808 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.806+0000 7f8828ff9640 1 -- 172.21.15.105:0/954510491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f882c035210 msgr2=0x7f882c0d0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.808 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.806+0000 7f8828ff9640 1 --2- 172.21.15.105:0/954510491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f882c035210 0x7f882c0d0000 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8830010c00 tx=0x7f883000c6a0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.808 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.807+0000 7f8828ff9640 1 -- 172.21.15.105:0/954510491 shutdown_connections 2024-09-21T03:18:05.808 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.807+0000 7f8828ff9640 1 --2- 172.21.15.105:0/954510491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f882c04dd70 0x7f882c1784f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.808 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.807+0000 7f8828ff9640 1 --2- 172.21.15.105:0/954510491 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f882c0dfe60 0x7f882c177fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.808 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.807+0000 7f8828ff9640 1 --2- 172.21.15.105:0/954510491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f882c035210 0x7f882c0d0000 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.808 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.807+0000 7f8828ff9640 1 -- 172.21.15.105:0/954510491 >> 172.21.15.105:0/954510491 conn(0x7f882c01eb00 msgr2=0x7f882c032620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:05.809 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi105') 2024-09-21T03:18:05.809 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi105') 2024-09-21T03:18:05.810 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.807+0000 7f8828ff9640 1 -- 172.21.15.105:0/954510491 shutdown_connections 2024-09-21T03:18:05.810 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.807+0000 7f8828ff9640 1 -- 172.21.15.105:0/954510491 wait complete. 2024-09-21T03:18:05.818 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi105') 2024-09-21T03:18:05.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.820+0000 7fa9751c3640 1 -- 172.21.15.105:0/1821462676 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fa950005580 con 0x7fa97015d9f0 2024-09-21T03:18:05.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.826+0000 7fa9577fe640 1 -- 172.21.15.105:0/1821462676 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v21)=0 v21) ==== 121+0+0 (secure 0 0 0) 0x7fa97015e340 con 0x7fa97015d9f0 2024-09-21T03:18:05.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.826+0000 7f82f72d7640 1 -- 172.21.15.105:0/724864320 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7f82e8053eb0 con 0x7f82e80537b0 2024-09-21T03:18:05.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.827+0000 7fa9751c3640 1 -- 172.21.15.105:0/1821462676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa97015d9f0 msgr2=0x7fa97015de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.827+0000 7fa9751c3640 1 --2- 172.21.15.105:0/1821462676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa97015d9f0 0x7fa97015de00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa96800cb40 tx=0x7fa96800a060 comp rx=0 tx=0).stop 2024-09-21T03:18:05.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.827+0000 7fa9751c3640 1 -- 172.21.15.105:0/1821462676 shutdown_connections 2024-09-21T03:18:05.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.827+0000 7fa9751c3640 1 --2- 172.21.15.105:0/1821462676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa97015d9f0 0x7fa97015de00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.827+0000 7fa9751c3640 1 --2- 172.21.15.105:0/1821462676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa97015ecd0 0x7fa970201e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.827+0000 7fa9751c3640 1 --2- 172.21.15.105:0/1821462676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9700ca1b0 0x7fa970147b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.827+0000 7fa9751c3640 1 -- 172.21.15.105:0/1821462676 >> 172.21.15.105:0/1821462676 conn(0x7fa97006d5d0 msgr2=0x7fa970160d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:05.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.827+0000 7fa9751c3640 1 -- 172.21.15.105:0/1821462676 shutdown_connections 2024-09-21T03:18:05.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.827+0000 7fa9751c3640 1 -- 172.21.15.105:0/1821462676 wait complete. 2024-09-21T03:18:05.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.828+0000 7ff218ff9640 1 -- 172.21.15.105:0/1940808198 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7ff22c0701e0 con 0x7ff22c15f650 2024-09-21T03:18:05.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.831+0000 7f82e6ffd640 1 -- 172.21.15.105:0/724864320 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v22)=0 v22) ==== 108+0+0 (secure 0 0 0) 0x7f82ec01bab0 con 0x7f82e80537b0 2024-09-21T03:18:05.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.832+0000 7f82f72d7640 1 -- 172.21.15.105:0/724864320 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82e80537b0 msgr2=0x7f82e80dfdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.832+0000 7f82f72d7640 1 --2- 172.21.15.105:0/724864320 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82e80537b0 0x7f82e80dfdb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f82ec00c730 tx=0x7f82ec00cbf0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.832+0000 7f82f72d7640 1 -- 172.21.15.105:0/724864320 shutdown_connections 2024-09-21T03:18:05.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.832+0000 7f82f72d7640 1 --2- 172.21.15.105:0/724864320 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82e8056da0 0x7f82e80e02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.832+0000 7f82f72d7640 1 --2- 172.21.15.105:0/724864320 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82e80537b0 0x7f82e80dfdb0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.832+0000 7f82f72d7640 1 --2- 172.21.15.105:0/724864320 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82e803c1f0 0x7f82e8187890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.835 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.832+0000 7f82f72d7640 1 -- 172.21.15.105:0/724864320 >> 172.21.15.105:0/724864320 conn(0x7f82e803a5f0 msgr2=0x7f82e80dc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:05.835 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.832+0000 7f82f72d7640 1 -- 172.21.15.105:0/724864320 shutdown_connections 2024-09-21T03:18:05.835 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.832+0000 7f82f72d7640 1 -- 172.21.15.105:0/724864320 wait complete. 2024-09-21T03:18:05.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.837+0000 7ff21affd640 1 -- 172.21.15.105:0/1940808198 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v23)=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7ff224033250 con 0x7ff22c15f650 2024-09-21T03:18:05.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.838+0000 7ff218ff9640 1 -- 172.21.15.105:0/1940808198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff22c15f650 msgr2=0x7ff22c09aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:05.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.838+0000 7ff218ff9640 1 --2- 172.21.15.105:0/1940808198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff22c15f650 0x7ff22c09aec0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff224009cd0 tx=0x7ff224033ca0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.838+0000 7ff218ff9640 1 -- 172.21.15.105:0/1940808198 shutdown_connections 2024-09-21T03:18:05.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.838+0000 7ff218ff9640 1 --2- 172.21.15.105:0/1940808198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff22c15f650 0x7ff22c09aec0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.838+0000 7ff218ff9640 1 --2- 172.21.15.105:0/1940808198 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff22c15ea80 0x7ff22c151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.838+0000 7ff218ff9640 1 --2- 172.21.15.105:0/1940808198 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff22c072e30 0x7ff22c1514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:05.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.838+0000 7ff218ff9640 1 -- 172.21.15.105:0/1940808198 >> 172.21.15.105:0/1940808198 conn(0x7ff22c06d410 msgr2=0x7ff22c074010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:05.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.838+0000 7ff218ff9640 1 -- 172.21.15.105:0/1940808198 shutdown_connections 2024-09-21T03:18:05.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:05.838+0000 7ff218ff9640 1 -- 172.21.15.105:0/1940808198 wait complete. 2024-09-21T03:18:05.847 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi105') 2024-09-21T03:18:05.847 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi105') 2024-09-21T03:18:05.847 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi105') 2024-09-21T03:18:05.851 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi105') 2024-09-21T03:18:05.851 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph config dump 2024-09-21T03:18:06.002 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.000+0000 7fea1a225640 1 -- 172.21.15.105:0/39497789 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea1415b900 msgr2=0x7fea140ae1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:06.002 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.000+0000 7fea1a225640 1 --2- 172.21.15.105:0/39497789 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea1415b900 0x7fea140ae1b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fea04005fd0 tx=0x7fea0402a5d0 comp rx=0 tx=0).stop 2024-09-21T03:18:06.002 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.000+0000 7fea1a225640 1 -- 172.21.15.105:0/39497789 shutdown_connections 2024-09-21T03:18:06.002 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.000+0000 7fea1a225640 1 --2- 172.21.15.105:0/39497789 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea1409aa30 0x7fea140cee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:06.002 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.000+0000 7fea1a225640 1 --2- 172.21.15.105:0/39497789 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea1415b900 0x7fea140ae1b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:06.002 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.000+0000 7fea1a225640 1 -- 172.21.15.105:0/39497789 >> 172.21.15.105:0/39497789 conn(0x7fea14074170 msgr2=0x7fea140b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:06.002 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.000+0000 7fea1a225640 1 -- 172.21.15.105:0/39497789 shutdown_connections 2024-09-21T03:18:06.003 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.000+0000 7fea1a225640 1 -- 172.21.15.105:0/39497789 wait complete. 2024-09-21T03:18:06.003 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.002+0000 7fea1a225640 1 Processor -- start 2024-09-21T03:18:06.003 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.002+0000 7fea1a225640 1 -- start start 2024-09-21T03:18:06.007 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.003+0000 7fea1a225640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea1409aa30 0x7fea1409ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:06.007 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.003+0000 7fea1a225640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea140cdbf0 0x7fea1414ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:06.007 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.003+0000 7fea1a225640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea1415b900 0x7fea1409ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:06.007 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.003+0000 7fea1a225640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fea140cf7a0 con 0x7fea1409aa30 2024-09-21T03:18:06.007 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.003+0000 7fea1a225640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fea140cf620 con 0x7fea1415b900 2024-09-21T03:18:06.007 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.003+0000 7fea1a225640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fea140cd1e0 con 0x7fea140cdbf0 2024-09-21T03:18:06.007 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.003+0000 7fea137fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea1409aa30 0x7fea1409ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:06.007 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.003+0000 7fea137fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea1409aa30 0x7fea1409ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:33886/0 (socket says 172.21.15.105:33886) 2024-09-21T03:18:06.007 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.003+0000 7fea137fe640 1 -- 172.21.15.105:0/154888970 learned_addr learned my addr 172.21.15.105:0/154888970 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:06.007 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.003+0000 7fea0bfff640 1 --2- 172.21.15.105:0/154888970 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea140cdbf0 0x7fea1414ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:06.007 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.003+0000 7fea13fff640 1 --2- 172.21.15.105:0/154888970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea1415b900 0x7fea1409ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:06.007 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.004+0000 7fea137fe640 1 -- 172.21.15.105:0/154888970 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea140cdbf0 msgr2=0x7fea1414ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:06.008 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.004+0000 7fea137fe640 1 --2- 172.21.15.105:0/154888970 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea140cdbf0 0x7fea1414ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:06.008 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.004+0000 7fea137fe640 1 -- 172.21.15.105:0/154888970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea1415b900 msgr2=0x7fea1409ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:06.008 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.004+0000 7fea137fe640 1 --2- 172.21.15.105:0/154888970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea1415b900 0x7fea1409ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:06.008 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.004+0000 7fea137fe640 1 -- 172.21.15.105:0/154888970 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea141f3ad0 con 0x7fea1409aa30 2024-09-21T03:18:06.008 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.004+0000 7fea137fe640 1 --2- 172.21.15.105:0/154888970 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea1409aa30 0x7fea1409ec80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fea04034040 tx=0x7fea040038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:06.008 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.004+0000 7fea10ff9640 1 -- 172.21.15.105:0/154888970 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0403e030 con 0x7fea1409aa30 2024-09-21T03:18:06.008 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.004+0000 7fea10ff9640 1 -- 172.21.15.105:0/154888970 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea04003ca0 con 0x7fea1409aa30 2024-09-21T03:18:06.008 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.004+0000 7fea1a225640 1 -- 172.21.15.105:0/154888970 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea141f3db0 con 0x7fea1409aa30 2024-09-21T03:18:06.008 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.004+0000 7fea10ff9640 1 -- 172.21.15.105:0/154888970 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea04035040 con 0x7fea1409aa30 2024-09-21T03:18:06.008 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.004+0000 7fea1a225640 1 -- 172.21.15.105:0/154888970 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea141f4370 con 0x7fea1409aa30 2024-09-21T03:18:06.008 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.004+0000 7fea10ff9640 1 -- 172.21.15.105:0/154888970 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fea04041030 con 0x7fea1409aa30 2024-09-21T03:18:06.008 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.004+0000 7fea10ff9640 1 -- 172.21.15.105:0/154888970 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fea04043a40 con 0x7fea1409aa30 2024-09-21T03:18:06.008 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.005+0000 7fea1a225640 1 -- 172.21.15.105:0/154888970 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea140cd700 con 0x7fea1409aa30 2024-09-21T03:18:06.009 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.007+0000 7fea10ff9640 1 -- 172.21.15.105:0/154888970 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fea04004f00 con 0x7fea1409aa30 2024-09-21T03:18:06.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.067+0000 7fea1a225640 1 -- 172.21.15.105:0/154888970 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fea14071950 con 0x7fea1409aa30 2024-09-21T03:18:06.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.068+0000 7fea10ff9640 1 -- 172.21.15.105:0/154888970 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v23) ==== 59+0+1472 (secure 0 0 0) 0x7fea0404d480 con 0x7fea1409aa30 2024-09-21T03:18:06.069 INFO:teuthology.orchestra.run.smithi105.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T03:18:06.070 INFO:teuthology.orchestra.run.smithi105.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T03:18:06.070 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced client_mount_timeout 30 2024-09-21T03:18:06.070 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced debug_client 20/20 2024-09-21T03:18:06.070 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced debug_mgr 20/20 2024-09-21T03:18:06.070 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced debug_ms 1/1 2024-09-21T03:18:06.070 INFO:teuthology.orchestra.run.smithi105.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T03:18:06.070 INFO:teuthology.orchestra.run.smithi105.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T03:18:06.070 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced debug_mds 20/20 2024-09-21T03:18:06.070 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T03:18:06.070 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced debug_ms 2/2 2024-09-21T03:18:06.070 INFO:teuthology.orchestra.run.smithi105.stdout:mds dev mds_debug_frag true 2024-09-21T03:18:06.070 INFO:teuthology.orchestra.run.smithi105.stdout:mds dev mds_debug_scatterstat true 2024-09-21T03:18:06.070 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T03:18:06.071 INFO:teuthology.orchestra.run.smithi105.stdout:mds dev mds_verify_scatter true 2024-09-21T03:18:06.071 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T03:18:06.071 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T03:18:06.071 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T03:18:06.071 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced client_mount_timeout 600 2024-09-21T03:18:06.071 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced debug_client 20/20 2024-09-21T03:18:06.071 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced debug_ms 1/1 2024-09-21T03:18:06.071 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T03:18:06.071 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T03:18:06.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.069+0000 7fea1a225640 1 -- 172.21.15.105:0/154888970 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea1409aa30 msgr2=0x7fea1409ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:06.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.069+0000 7fea1a225640 1 --2- 172.21.15.105:0/154888970 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea1409aa30 0x7fea1409ec80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fea04034040 tx=0x7fea040038a0 comp rx=0 tx=0).stop 2024-09-21T03:18:06.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.069+0000 7fea1a225640 1 -- 172.21.15.105:0/154888970 shutdown_connections 2024-09-21T03:18:06.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.069+0000 7fea1a225640 1 --2- 172.21.15.105:0/154888970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea1415b900 0x7fea1409ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:06.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.069+0000 7fea1a225640 1 --2- 172.21.15.105:0/154888970 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea140cdbf0 0x7fea1414ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:06.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.069+0000 7fea1a225640 1 --2- 172.21.15.105:0/154888970 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea1409aa30 0x7fea1409ec80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:06.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.069+0000 7fea1a225640 1 -- 172.21.15.105:0/154888970 >> 172.21.15.105:0/154888970 conn(0x7fea14074170 msgr2=0x7fea140b4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:06.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.069+0000 7fea1a225640 1 -- 172.21.15.105:0/154888970 shutdown_connections 2024-09-21T03:18:06.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.069+0000 7fea1a225640 1 -- 172.21.15.105:0/154888970 wait complete. 2024-09-21T03:18:06.081 INFO:tasks.ceph:Setting crush tunables to default 2024-09-21T03:18:06.081 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd crush tunables default 2024-09-21T03:18:06.193 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.191+0000 7f9f3a169640 1 -- 172.21.15.105:0/1434113151 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f340cf6f0 msgr2=0x7f9f34074530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:06.193 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.191+0000 7f9f3a169640 1 --2- 172.21.15.105:0/1434113151 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f340cf6f0 0x7f9f34074530 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c005fd0 tx=0x7f9f1c02a5d0 comp rx=0 tx=0).stop 2024-09-21T03:18:06.193 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.191+0000 7f9f3a169640 1 -- 172.21.15.105:0/1434113151 shutdown_connections 2024-09-21T03:18:06.193 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.191+0000 7f9f3a169640 1 --2- 172.21.15.105:0/1434113151 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9f34074a70 0x7f9f340cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:06.193 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.191+0000 7f9f3a169640 1 --2- 172.21.15.105:0/1434113151 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f340cf6f0 0x7f9f34074530 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:06.193 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.191+0000 7f9f3a169640 1 -- 172.21.15.105:0/1434113151 >> 172.21.15.105:0/1434113151 conn(0x7f9f340cdc60 msgr2=0x7f9f340ce070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:06.193 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.191+0000 7f9f3a169640 1 -- 172.21.15.105:0/1434113151 shutdown_connections 2024-09-21T03:18:06.193 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.191+0000 7f9f3a169640 1 -- 172.21.15.105:0/1434113151 wait complete. 2024-09-21T03:18:06.194 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.193+0000 7f9f3a169640 1 Processor -- start 2024-09-21T03:18:06.194 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.193+0000 7f9f3a169640 1 -- start start 2024-09-21T03:18:06.197 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.194+0000 7f9f3a169640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9f34074a70 0x7f9f34156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:06.197 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.194+0000 7f9f3a169640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f340cf6f0 0x7f9f341f60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:06.197 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.194+0000 7f9f3a169640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f3415cca0 0x7f9f34154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:06.197 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.194+0000 7f9f3a169640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9f340cc100 con 0x7f9f340cf6f0 2024-09-21T03:18:06.197 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.194+0000 7f9f3a169640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9f340cbf80 con 0x7f9f3415cca0 2024-09-21T03:18:06.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.194+0000 7f9f3a169640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9f3406cde0 con 0x7f9f34074a70 2024-09-21T03:18:06.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.194+0000 7f9f32ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f340cf6f0 0x7f9f341f60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:06.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.194+0000 7f9f32ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f340cf6f0 0x7f9f341f60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:33904/0 (socket says 172.21.15.105:33904) 2024-09-21T03:18:06.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.194+0000 7f9f32ffd640 1 -- 172.21.15.105:0/3752647646 learned_addr learned my addr 172.21.15.105:0/3752647646 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:06.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.194+0000 7f9f33fff640 1 --2- 172.21.15.105:0/3752647646 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f3415cca0 0x7f9f34154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:06.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.194+0000 7f9f337fe640 1 --2- 172.21.15.105:0/3752647646 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9f34074a70 0x7f9f34156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:06.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.194+0000 7f9f32ffd640 1 -- 172.21.15.105:0/3752647646 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9f34074a70 msgr2=0x7f9f34156000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:06.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.194+0000 7f9f32ffd640 1 --2- 172.21.15.105:0/3752647646 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9f34074a70 0x7f9f34156000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:06.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.194+0000 7f9f32ffd640 1 -- 172.21.15.105:0/3752647646 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f3415cca0 msgr2=0x7f9f34154e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:06.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.194+0000 7f9f32ffd640 1 --2- 172.21.15.105:0/3752647646 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f3415cca0 0x7f9f34154e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:06.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.194+0000 7f9f32ffd640 1 -- 172.21.15.105:0/3752647646 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f341f9c70 con 0x7f9f340cf6f0 2024-09-21T03:18:06.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.195+0000 7f9f32ffd640 1 --2- 172.21.15.105:0/3752647646 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f340cf6f0 0x7f9f341f60a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c034040 tx=0x7f9f1c0035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:06.199 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.195+0000 7f9f2bfff640 1 -- 172.21.15.105:0/3752647646 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c03e030 con 0x7f9f340cf6f0 2024-09-21T03:18:06.199 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.195+0000 7f9f2bfff640 1 -- 172.21.15.105:0/3752647646 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f1c003ae0 con 0x7f9f340cf6f0 2024-09-21T03:18:06.199 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.195+0000 7f9f3a169640 1 -- 172.21.15.105:0/3752647646 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f341f58e0 con 0x7f9f340cf6f0 2024-09-21T03:18:06.199 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.195+0000 7f9f2bfff640 1 -- 172.21.15.105:0/3752647646 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c035040 con 0x7f9f340cf6f0 2024-09-21T03:18:06.199 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.195+0000 7f9f3a169640 1 -- 172.21.15.105:0/3752647646 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f340cb1c0 con 0x7f9f340cf6f0 2024-09-21T03:18:06.199 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.195+0000 7f9f2bfff640 1 -- 172.21.15.105:0/3752647646 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9f1c041030 con 0x7f9f340cf6f0 2024-09-21T03:18:06.199 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.195+0000 7f9f2bfff640 1 -- 172.21.15.105:0/3752647646 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9f1c043a40 con 0x7f9f340cf6f0 2024-09-21T03:18:06.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.196+0000 7f9f3a169640 1 -- 172.21.15.105:0/3752647646 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f340cb4a0 con 0x7f9f340cf6f0 2024-09-21T03:18:06.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.198+0000 7f9f2bfff640 1 -- 172.21.15.105:0/3752647646 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f9f1c004d10 con 0x7f9f340cf6f0 2024-09-21T03:18:06.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.273+0000 7f9f3a169640 1 -- 172.21.15.105:0/3752647646 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f9f341f56f0 con 0x7f9f340cf6f0 2024-09-21T03:18:06.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.277+0000 7f9f2bfff640 1 -- 172.21.15.105:0/3752647646 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f9f1c004ef0 con 0x7f9f340cf6f0 2024-09-21T03:18:06.279 INFO:teuthology.orchestra.run.smithi105.stderr:adjusted tunables profile to default 2024-09-21T03:18:06.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.278+0000 7f9f3a169640 1 -- 172.21.15.105:0/3752647646 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f340cf6f0 msgr2=0x7f9f341f60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:06.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.278+0000 7f9f3a169640 1 --2- 172.21.15.105:0/3752647646 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f340cf6f0 0x7f9f341f60a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c034040 tx=0x7f9f1c0035f0 comp rx=0 tx=0).stop 2024-09-21T03:18:06.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.278+0000 7f9f3a169640 1 -- 172.21.15.105:0/3752647646 shutdown_connections 2024-09-21T03:18:06.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.278+0000 7f9f3a169640 1 --2- 172.21.15.105:0/3752647646 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f3415cca0 0x7f9f34154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:06.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.278+0000 7f9f3a169640 1 --2- 172.21.15.105:0/3752647646 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f340cf6f0 0x7f9f341f60a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:06.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.278+0000 7f9f3a169640 1 --2- 172.21.15.105:0/3752647646 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9f34074a70 0x7f9f34156000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:06.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.278+0000 7f9f3a169640 1 -- 172.21.15.105:0/3752647646 >> 172.21.15.105:0/3752647646 conn(0x7f9f340cdc60 msgr2=0x7f9f3415ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:06.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.278+0000 7f9f3a169640 1 -- 172.21.15.105:0/3752647646 shutdown_connections 2024-09-21T03:18:06.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:06.278+0000 7f9f3a169640 1 -- 172.21.15.105:0/3752647646 wait complete. 2024-09-21T03:18:06.291 INFO:tasks.ceph:check_enable_crimson: False 2024-09-21T03:18:06.291 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-21T03:18:06.291 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:18:06.291 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-21T03:18:06.316 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:18:06.316 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-21T03:18:06.381 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:18:06.381 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-21T03:18:06.446 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:18:06.446 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-21T03:18:06.511 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:18:06.511 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-21T03:18:06.536 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:18:06.536 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-21T03:18:06.601 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:18:06.601 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-21T03:18:06.666 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:18:06.666 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-21T03:18:06.731 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 05d8c08a-a4bf-4a6d-af2a-fd89ae829a28 0 2024-09-21T03:18:06.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.884+0000 7fedaa0f2640 1 -- 172.21.15.162:0/918034828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feda406cde0 msgr2=0x7feda406d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:06.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.884+0000 7fedaa0f2640 1 --2- 172.21.15.162:0/918034828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feda406cde0 0x7feda406d1f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fed94005fd0 tx=0x7fed9402a5f0 comp rx=0 tx=0).stop 2024-09-21T03:18:06.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.884+0000 7fedaa0f2640 1 -- 172.21.15.162:0/918034828 shutdown_connections 2024-09-21T03:18:06.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.884+0000 7fedaa0f2640 1 --2- 172.21.15.162:0/918034828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feda406cde0 0x7feda406d1f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:06.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.884+0000 7fedaa0f2640 1 -- 172.21.15.162:0/918034828 >> 172.21.15.162:0/918034828 conn(0x7feda4074170 msgr2=0x7feda40b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:06.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.884+0000 7fedaa0f2640 1 -- 172.21.15.162:0/918034828 shutdown_connections 2024-09-21T03:18:06.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.885+0000 7fedaa0f2640 1 -- 172.21.15.162:0/918034828 wait complete. 2024-09-21T03:18:06.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.886+0000 7fedaa0f2640 1 Processor -- start 2024-09-21T03:18:06.888 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.886+0000 7fedaa0f2640 1 -- start start 2024-09-21T03:18:06.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.888+0000 7fedaa0f2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feda406cde0 0x7feda415f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:06.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.888+0000 7fedaa0f2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feda409aa30 0x7feda415e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:06.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.888+0000 7fedaa0f2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feda40cc4c0 0x7feda41f9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:06.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.888+0000 7fedaa0f2640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7feda40cd370 con 0x7feda406cde0 2024-09-21T03:18:06.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.888+0000 7fedaa0f2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feda40cd1f0 con 0x7feda40cc4c0 2024-09-21T03:18:06.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.888+0000 7fedaa0f2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7feda40cd4f0 con 0x7feda409aa30 2024-09-21T03:18:06.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.888+0000 7feda2ffd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feda409aa30 0x7feda415e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:06.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.888+0000 7feda3fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feda40cc4c0 0x7feda41f9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:06.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.888+0000 7feda2ffd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feda409aa30 0x7feda415e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:54388/0 (socket says 172.21.15.162:54388) 2024-09-21T03:18:06.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.888+0000 7feda2ffd640 1 -- 172.21.15.162:0/1791094911 learned_addr learned my addr 172.21.15.162:0/1791094911 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T03:18:06.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.888+0000 7feda37fe640 1 --2- 172.21.15.162:0/1791094911 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feda406cde0 0x7feda415f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:06.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.888+0000 7feda3fff640 1 -- 172.21.15.162:0/1791094911 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feda409aa30 msgr2=0x7feda415e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:06.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.888+0000 7feda3fff640 1 --2- 172.21.15.162:0/1791094911 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feda409aa30 0x7feda415e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:06.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.888+0000 7feda3fff640 1 -- 172.21.15.162:0/1791094911 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feda406cde0 msgr2=0x7feda415f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:06.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.888+0000 7feda3fff640 1 --2- 172.21.15.162:0/1791094911 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feda406cde0 0x7feda415f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:06.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.888+0000 7feda3fff640 1 -- 172.21.15.162:0/1791094911 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda415e730 con 0x7feda40cc4c0 2024-09-21T03:18:06.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.888+0000 7feda2ffd640 1 --2- 172.21.15.162:0/1791094911 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feda409aa30 0x7feda415e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:18:06.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.888+0000 7feda3fff640 1 --2- 172.21.15.162:0/1791094911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feda40cc4c0 0x7feda41f9c60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fed9c00c700 tx=0x7fed9c00cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:06.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.889+0000 7fed8bfff640 1 -- 172.21.15.162:0/1791094911 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed9c003b70 con 0x7feda40cc4c0 2024-09-21T03:18:06.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.889+0000 7fed8bfff640 1 -- 172.21.15.162:0/1791094911 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed9c003d10 con 0x7feda40cc4c0 2024-09-21T03:18:06.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.889+0000 7fedaa0f2640 1 -- 172.21.15.162:0/1791094911 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feda414ab40 con 0x7feda40cc4c0 2024-09-21T03:18:06.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.889+0000 7fed8bfff640 1 -- 172.21.15.162:0/1791094911 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed9c005330 con 0x7feda40cc4c0 2024-09-21T03:18:06.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.889+0000 7fedaa0f2640 1 -- 172.21.15.162:0/1791094911 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feda40d0a00 con 0x7feda40cc4c0 2024-09-21T03:18:06.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.889+0000 7fed8bfff640 1 -- 172.21.15.162:0/1791094911 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fed9c0054d0 con 0x7feda40cc4c0 2024-09-21T03:18:06.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.889+0000 7fed8bfff640 1 -- 172.21.15.162:0/1791094911 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fed9c012880 con 0x7feda40cc4c0 2024-09-21T03:18:06.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.890+0000 7fedaa0f2640 1 -- 172.21.15.162:0/1791094911 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feda406d1f0 con 0x7feda40cc4c0 2024-09-21T03:18:06.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.892+0000 7fed8bfff640 1 -- 172.21.15.162:0/1791094911 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7feda406d730 con 0x7feda40cc4c0 2024-09-21T03:18:06.965 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.963+0000 7fedaa0f2640 1 -- 172.21.15.162:0/1791094911 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd new", "uuid": "05d8c08a-a4bf-4a6d-af2a-fd89ae829a28", "id": 0} v 0) -- 0x7feda4069450 con 0x7feda40cc4c0 2024-09-21T03:18:06.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.968+0000 7fed8bfff640 1 -- 172.21.15.162:0/1791094911 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "05d8c08a-a4bf-4a6d-af2a-fd89ae829a28", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fed9c012ad0 con 0x7feda40cc4c0 2024-09-21T03:18:06.969 INFO:teuthology.orchestra.run.smithi162.stdout:0 2024-09-21T03:18:06.970 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.968+0000 7fedaa0f2640 1 -- 172.21.15.162:0/1791094911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feda40cc4c0 msgr2=0x7feda41f9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:06.970 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.969+0000 7fedaa0f2640 1 --2- 172.21.15.162:0/1791094911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feda40cc4c0 0x7feda41f9c60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fed9c00c700 tx=0x7fed9c00cbc0 comp rx=0 tx=0).stop 2024-09-21T03:18:06.970 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.969+0000 7fedaa0f2640 1 -- 172.21.15.162:0/1791094911 shutdown_connections 2024-09-21T03:18:06.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.969+0000 7fedaa0f2640 1 --2- 172.21.15.162:0/1791094911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feda40cc4c0 0x7feda41f9c60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:06.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.969+0000 7fedaa0f2640 1 --2- 172.21.15.162:0/1791094911 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feda409aa30 0x7feda415e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:06.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.969+0000 7fedaa0f2640 1 --2- 172.21.15.162:0/1791094911 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feda406cde0 0x7feda415f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:06.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.969+0000 7fedaa0f2640 1 -- 172.21.15.162:0/1791094911 >> 172.21.15.162:0/1791094911 conn(0x7feda4074170 msgr2=0x7feda40cc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:06.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.969+0000 7fedaa0f2640 1 -- 172.21.15.162:0/1791094911 shutdown_connections 2024-09-21T03:18:06.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:06.969+0000 7fedaa0f2640 1 -- 172.21.15.162:0/1791094911 wait complete. 2024-09-21T03:18:06.981 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 0388eb9b-9bec-490a-a3ea-dce96c27b13e 1 2024-09-21T03:18:07.094 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.092+0000 7fcda82f9640 1 -- 172.21.15.162:0/4014067366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcda00d16f0 msgr2=0x7fcda015d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:07.094 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.092+0000 7fcda82f9640 1 --2- 172.21.15.162:0/4014067366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcda00d16f0 0x7fcda015d900 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcda00b4ec0 tx=0x7fcd9002a680 comp rx=0 tx=0).stop 2024-09-21T03:18:07.094 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.092+0000 7fcda82f9640 1 -- 172.21.15.162:0/4014067366 shutdown_connections 2024-09-21T03:18:07.094 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.092+0000 7fcda82f9640 1 --2- 172.21.15.162:0/4014067366 >> v2:172.21.15.105:3300/0 conn(0x7fcda0160550 0x7fcda00cece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:07.094 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.092+0000 7fcda82f9640 1 --2- 172.21.15.162:0/4014067366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcda00d16f0 0x7fcda015d900 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:07.094 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.092+0000 7fcda82f9640 1 -- 172.21.15.162:0/4014067366 >> 172.21.15.162:0/4014067366 conn(0x7fcda006d5d0 msgr2=0x7fcda0071110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:07.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.092+0000 7fcda82f9640 1 -- 172.21.15.162:0/4014067366 shutdown_connections 2024-09-21T03:18:07.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.092+0000 7fcda82f9640 1 -- 172.21.15.162:0/4014067366 wait complete. 2024-09-21T03:18:07.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.094+0000 7fcda82f9640 1 Processor -- start 2024-09-21T03:18:07.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.094+0000 7fcda82f9640 1 -- start start 2024-09-21T03:18:07.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.095+0000 7fcda82f9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcda00d16f0 0x7fcda00ad5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:07.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.095+0000 7fcda82f9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcda0160550 0x7fcda01f71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:07.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.095+0000 7fcda82f9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcda0160960 0x7fcda00cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:07.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.095+0000 7fcda82f9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcda00cf5b0 con 0x7fcda00d16f0 2024-09-21T03:18:07.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.095+0000 7fcda82f9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcda00cf430 con 0x7fcda0160960 2024-09-21T03:18:07.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.095+0000 7fcda82f9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcda00d0650 con 0x7fcda0160550 2024-09-21T03:18:07.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.095+0000 7fcda6896640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcda0160960 0x7fcda00cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:07.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.095+0000 7fcda5894640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcda0160550 0x7fcda01f71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:07.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.095+0000 7fcda5894640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcda0160550 0x7fcda01f71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:54402/0 (socket says 172.21.15.162:54402) 2024-09-21T03:18:07.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.095+0000 7fcda6896640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcda0160960 0x7fcda00cb5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60020/0 (socket says 172.21.15.162:60020) 2024-09-21T03:18:07.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.095+0000 7fcda5894640 1 -- 172.21.15.162:0/4053993265 learned_addr learned my addr 172.21.15.162:0/4053993265 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T03:18:07.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.095+0000 7fcda6095640 1 --2- 172.21.15.162:0/4053993265 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcda00d16f0 0x7fcda00ad5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:07.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.096+0000 7fcda5894640 1 -- 172.21.15.162:0/4053993265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcda0160960 msgr2=0x7fcda00cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:07.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.096+0000 7fcda5894640 1 --2- 172.21.15.162:0/4053993265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcda0160960 0x7fcda00cb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:07.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.096+0000 7fcda5894640 1 -- 172.21.15.162:0/4053993265 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcda00d16f0 msgr2=0x7fcda00ad5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:07.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.096+0000 7fcda5894640 1 --2- 172.21.15.162:0/4053993265 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcda00d16f0 0x7fcda00ad5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:07.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.096+0000 7fcda5894640 1 -- 172.21.15.162:0/4053993265 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcda01f7f60 con 0x7fcda0160550 2024-09-21T03:18:07.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.096+0000 7fcda6896640 1 --2- 172.21.15.162:0/4053993265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcda0160960 0x7fcda00cb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:18:07.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.096+0000 7fcda5894640 1 --2- 172.21.15.162:0/4053993265 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcda0160550 0x7fcda01f71f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c00d750 tx=0x7fcd9c00dc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:07.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.096+0000 7fcd96ffd640 1 -- 172.21.15.162:0/4053993265 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c017070 con 0x7fcda0160550 2024-09-21T03:18:07.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.096+0000 7fcd96ffd640 1 -- 172.21.15.162:0/4053993265 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd9c004310 con 0x7fcda0160550 2024-09-21T03:18:07.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.096+0000 7fcda82f9640 1 -- 172.21.15.162:0/4053993265 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcda014e520 con 0x7fcda0160550 2024-09-21T03:18:07.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.096+0000 7fcd96ffd640 1 -- 172.21.15.162:0/4053993265 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c009c30 con 0x7fcda0160550 2024-09-21T03:18:07.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.096+0000 7fcda82f9640 1 -- 172.21.15.162:0/4053993265 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcda014eae0 con 0x7fcda0160550 2024-09-21T03:18:07.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.096+0000 7fcd96ffd640 1 -- 172.21.15.162:0/4053993265 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcd9c0053b0 con 0x7fcda0160550 2024-09-21T03:18:07.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.096+0000 7fcd96ffd640 1 -- 172.21.15.162:0/4053993265 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fcd9c0039a0 con 0x7fcda0160550 2024-09-21T03:18:07.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.097+0000 7fcda82f9640 1 -- 172.21.15.162:0/4053993265 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcda01f7cd0 con 0x7fcda0160550 2024-09-21T03:18:07.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.100+0000 7fcd96ffd640 1 -- 172.21.15.162:0/4053993265 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fcd9c020020 con 0x7fcda0160550 2024-09-21T03:18:07.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.169+0000 7fcda82f9640 1 -- 172.21.15.162:0/4053993265 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0388eb9b-9bec-490a-a3ea-dce96c27b13e", "id": 1} v 0) -- 0x7fcda00ce3d0 con 0x7fcda0160550 2024-09-21T03:18:07.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.176+0000 7fcd96ffd640 1 -- 172.21.15.162:0/4053993265 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0388eb9b-9bec-490a-a3ea-dce96c27b13e", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fcda00ce3d0 con 0x7fcda0160550 2024-09-21T03:18:07.177 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-09-21T03:18:07.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.177+0000 7fcda82f9640 1 -- 172.21.15.162:0/4053993265 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcda0160550 msgr2=0x7fcda01f71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:07.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.177+0000 7fcda82f9640 1 --2- 172.21.15.162:0/4053993265 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcda0160550 0x7fcda01f71f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c00d750 tx=0x7fcd9c00dc10 comp rx=0 tx=0).stop 2024-09-21T03:18:07.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.177+0000 7fcda82f9640 1 -- 172.21.15.162:0/4053993265 shutdown_connections 2024-09-21T03:18:07.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.177+0000 7fcda82f9640 1 --2- 172.21.15.162:0/4053993265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcda0160960 0x7fcda00cb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:07.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.177+0000 7fcda82f9640 1 --2- 172.21.15.162:0/4053993265 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcda0160550 0x7fcda01f71f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:07.179 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.177+0000 7fcda82f9640 1 --2- 172.21.15.162:0/4053993265 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcda00d16f0 0x7fcda00ad5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:07.179 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.177+0000 7fcda82f9640 1 -- 172.21.15.162:0/4053993265 >> 172.21.15.162:0/4053993265 conn(0x7fcda006d5d0 msgr2=0x7fcda0071110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:07.179 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.177+0000 7fcda82f9640 1 -- 172.21.15.162:0/4053993265 shutdown_connections 2024-09-21T03:18:07.179 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.177+0000 7fcda82f9640 1 -- 172.21.15.162:0/4053993265 wait complete. 2024-09-21T03:18:07.189 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 21a36b84-c832-40c6-8e6d-f075f0f7bcf1 2 2024-09-21T03:18:07.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.298+0000 7fbf03713640 1 -- 172.21.15.162:0/352829634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbefc15c7f0 msgr2=0x7fbefc0b26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:07.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.298+0000 7fbf03713640 1 --2- 172.21.15.162:0/352829634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbefc15c7f0 0x7fbefc0b26c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbefc0b6570 tx=0x7fbeec02a4d0 comp rx=0 tx=0).stop 2024-09-21T03:18:07.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.299+0000 7fbf03713640 1 -- 172.21.15.162:0/352829634 shutdown_connections 2024-09-21T03:18:07.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.299+0000 7fbf03713640 1 --2- 172.21.15.162:0/352829634 >> v2:172.21.15.105:3300/0 conn(0x7fbefc06d4f0 0x7fbefc0b0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:07.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.299+0000 7fbf03713640 1 --2- 172.21.15.162:0/352829634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbefc15c7f0 0x7fbefc0b26c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:07.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.299+0000 7fbf03713640 1 -- 172.21.15.162:0/352829634 >> 172.21.15.162:0/352829634 conn(0x7fbefc06ea80 msgr2=0x7fbefc0b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:07.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.299+0000 7fbf03713640 1 -- 172.21.15.162:0/352829634 shutdown_connections 2024-09-21T03:18:07.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.299+0000 7fbf03713640 1 -- 172.21.15.162:0/352829634 wait complete. 2024-09-21T03:18:07.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.300+0000 7fbf03713640 1 Processor -- start 2024-09-21T03:18:07.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.300+0000 7fbf03713640 1 -- start start 2024-09-21T03:18:07.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.302+0000 7fbf03713640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbefc0ae1b0 0x7fbefc1425b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:07.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.302+0000 7fbf03713640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbefc15c7f0 0x7fbefc142af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:07.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.302+0000 7fbf03713640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbefc148680 0x7fbefc148a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:07.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.302+0000 7fbf03713640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbefc0b2400 con 0x7fbefc0ae1b0 2024-09-21T03:18:07.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.302+0000 7fbf03713640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbefc0b2280 con 0x7fbefc15c7f0 2024-09-21T03:18:07.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.302+0000 7fbf03713640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbefc0b0a90 con 0x7fbefc148680 2024-09-21T03:18:07.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.302+0000 7fbf00cae640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbefc15c7f0 0x7fbefc142af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:07.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.302+0000 7fbf01cb0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbefc148680 0x7fbefc148a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:07.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.302+0000 7fbf00cae640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbefc15c7f0 0x7fbefc142af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60040/0 (socket says 172.21.15.162:60040) 2024-09-21T03:18:07.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.302+0000 7fbf00cae640 1 -- 172.21.15.162:0/4133015795 learned_addr learned my addr 172.21.15.162:0/4133015795 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T03:18:07.307 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.302+0000 7fbf014af640 1 --2- 172.21.15.162:0/4133015795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbefc0ae1b0 0x7fbefc1425b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:07.307 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.302+0000 7fbf01cb0640 1 -- 172.21.15.162:0/4133015795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbefc15c7f0 msgr2=0x7fbefc142af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:07.307 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.302+0000 7fbf01cb0640 1 --2- 172.21.15.162:0/4133015795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbefc15c7f0 0x7fbefc142af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:07.307 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.302+0000 7fbf01cb0640 1 -- 172.21.15.162:0/4133015795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbefc0ae1b0 msgr2=0x7fbefc1425b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:07.307 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.302+0000 7fbf01cb0640 1 --2- 172.21.15.162:0/4133015795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbefc0ae1b0 0x7fbefc1425b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:07.307 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.302+0000 7fbf01cb0640 1 -- 172.21.15.162:0/4133015795 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbefc148fd0 con 0x7fbefc148680 2024-09-21T03:18:07.307 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.302+0000 7fbf00cae640 1 --2- 172.21.15.162:0/4133015795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbefc15c7f0 0x7fbefc142af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:18:07.307 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.302+0000 7fbf01cb0640 1 --2- 172.21.15.162:0/4133015795 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbefc148680 0x7fbefc148a90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbef400e960 tx=0x7fbef400ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:07.307 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.303+0000 7fbef1ffb640 1 -- 172.21.15.162:0/4133015795 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef4004d20 con 0x7fbefc148680 2024-09-21T03:18:07.307 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.303+0000 7fbef1ffb640 1 -- 172.21.15.162:0/4133015795 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbef400ca60 con 0x7fbefc148680 2024-09-21T03:18:07.307 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.303+0000 7fbf03713640 1 -- 172.21.15.162:0/4133015795 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbefc153220 con 0x7fbefc148680 2024-09-21T03:18:07.307 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.303+0000 7fbef1ffb640 1 -- 172.21.15.162:0/4133015795 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef4005020 con 0x7fbefc148680 2024-09-21T03:18:07.308 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.303+0000 7fbf03713640 1 -- 172.21.15.162:0/4133015795 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbefc152460 con 0x7fbefc148680 2024-09-21T03:18:07.308 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.303+0000 7fbef1ffb640 1 -- 172.21.15.162:0/4133015795 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbef40051c0 con 0x7fbefc148680 2024-09-21T03:18:07.308 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.303+0000 7fbef1ffb640 1 -- 172.21.15.162:0/4133015795 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fbef40058d0 con 0x7fbefc148680 2024-09-21T03:18:07.308 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.304+0000 7fbf03713640 1 -- 172.21.15.162:0/4133015795 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbefc151ef0 con 0x7fbefc148680 2024-09-21T03:18:07.309 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.308+0000 7fbef1ffb640 1 -- 172.21.15.162:0/4133015795 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fbef4016030 con 0x7fbefc148680 2024-09-21T03:18:07.378 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.377+0000 7fbf03713640 1 -- 172.21.15.162:0/4133015795 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "21a36b84-c832-40c6-8e6d-f075f0f7bcf1", "id": 2} v 0) -- 0x7fbefc0b0e30 con 0x7fbefc148680 2024-09-21T03:18:07.383 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.381+0000 7fbef1ffb640 1 -- 172.21.15.162:0/4133015795 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "21a36b84-c832-40c6-8e6d-f075f0f7bcf1", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fbef4011470 con 0x7fbefc148680 2024-09-21T03:18:07.383 INFO:teuthology.orchestra.run.smithi162.stdout:2 2024-09-21T03:18:07.384 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.382+0000 7fbf03713640 1 -- 172.21.15.162:0/4133015795 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbefc148680 msgr2=0x7fbefc148a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:07.385 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.382+0000 7fbf03713640 1 --2- 172.21.15.162:0/4133015795 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbefc148680 0x7fbefc148a90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbef400e960 tx=0x7fbef400ed60 comp rx=0 tx=0).stop 2024-09-21T03:18:07.385 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.382+0000 7fbf03713640 1 -- 172.21.15.162:0/4133015795 shutdown_connections 2024-09-21T03:18:07.385 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.383+0000 7fbf03713640 1 --2- 172.21.15.162:0/4133015795 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbefc148680 0x7fbefc148a90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:07.385 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.383+0000 7fbf03713640 1 --2- 172.21.15.162:0/4133015795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbefc15c7f0 0x7fbefc142af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:07.385 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.383+0000 7fbf03713640 1 --2- 172.21.15.162:0/4133015795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbefc0ae1b0 0x7fbefc1425b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:07.385 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.383+0000 7fbf03713640 1 -- 172.21.15.162:0/4133015795 >> 172.21.15.162:0/4133015795 conn(0x7fbefc06ea80 msgr2=0x7fbefc15a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:07.385 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.383+0000 7fbf03713640 1 -- 172.21.15.162:0/4133015795 shutdown_connections 2024-09-21T03:18:07.385 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.383+0000 7fbf03713640 1 -- 172.21.15.162:0/4133015795 wait complete. 2024-09-21T03:18:07.395 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 4d3e1186-f563-496f-a1e9-1db8498fd52d 3 2024-09-21T03:18:07.509 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.507+0000 7f3974fc6640 1 -- 172.21.15.162:0/2188300565 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f397015c9b0 msgr2=0x7f39700ccfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:07.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.507+0000 7f3974fc6640 1 --2- 172.21.15.162:0/2188300565 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f397015c9b0 0x7f39700ccfa0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3958005fd0 tx=0x7f395802a5d0 comp rx=0 tx=0).stop 2024-09-21T03:18:07.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.507+0000 7f3974fc6640 1 -- 172.21.15.162:0/2188300565 shutdown_connections 2024-09-21T03:18:07.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.507+0000 7f3974fc6640 1 --2- 172.21.15.162:0/2188300565 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f397015c9b0 0x7f39700ccfa0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:07.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.507+0000 7f3974fc6640 1 --2- 172.21.15.162:0/2188300565 >> v2:172.21.15.162:3300/0 conn(0x7f397015ff30 0x7f3970155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:07.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.507+0000 7f3974fc6640 1 -- 172.21.15.162:0/2188300565 >> 172.21.15.162:0/2188300565 conn(0x7f39700cdc60 msgr2=0x7f39700ce070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:07.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.508+0000 7f3974fc6640 1 -- 172.21.15.162:0/2188300565 shutdown_connections 2024-09-21T03:18:07.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.508+0000 7f3974fc6640 1 -- 172.21.15.162:0/2188300565 wait complete. 2024-09-21T03:18:07.511 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.509+0000 7f3974fc6640 1 Processor -- start 2024-09-21T03:18:07.511 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.510+0000 7f3974fc6640 1 -- start start 2024-09-21T03:18:07.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.511+0000 7f3974fc6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3970073e70 0x7f39700c6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:07.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.511+0000 7f3974fc6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f397015c9b0 0x7f39701594f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:07.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.511+0000 7f3974fc6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f397015ff30 0x7f3970153440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:07.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.511+0000 7f3974fc6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f39700d0640 con 0x7f397015c9b0 2024-09-21T03:18:07.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.511+0000 7f3974fc6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f39700d04c0 con 0x7f3970073e70 2024-09-21T03:18:07.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.511+0000 7f3974fc6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f39700d07c0 con 0x7f397015ff30 2024-09-21T03:18:07.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.511+0000 7f396e59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3970073e70 0x7f39700c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:07.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.511+0000 7f396ed9d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f397015ff30 0x7f3970153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:07.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.511+0000 7f396e59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3970073e70 0x7f39700c6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60072/0 (socket says 172.21.15.162:60072) 2024-09-21T03:18:07.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.511+0000 7f396e59c640 1 -- 172.21.15.162:0/1961014172 learned_addr learned my addr 172.21.15.162:0/1961014172 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T03:18:07.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.511+0000 7f396dd9b640 1 --2- 172.21.15.162:0/1961014172 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f397015c9b0 0x7f39701594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:07.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.511+0000 7f396e59c640 1 -- 172.21.15.162:0/1961014172 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f397015ff30 msgr2=0x7f3970153440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:07.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.511+0000 7f396e59c640 1 --2- 172.21.15.162:0/1961014172 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f397015ff30 0x7f3970153440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:07.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.511+0000 7f396e59c640 1 -- 172.21.15.162:0/1961014172 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f397015c9b0 msgr2=0x7f39701594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:07.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.511+0000 7f396e59c640 1 --2- 172.21.15.162:0/1961014172 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f397015c9b0 0x7f39701594f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:07.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.511+0000 7f396e59c640 1 -- 172.21.15.162:0/1961014172 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39701f20f0 con 0x7f3970073e70 2024-09-21T03:18:07.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.511+0000 7f396ed9d640 1 --2- 172.21.15.162:0/1961014172 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f397015ff30 0x7f3970153440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:18:07.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.511+0000 7f396e59c640 1 --2- 172.21.15.162:0/1961014172 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3970073e70 0x7f39700c6600 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f396000e910 tx=0x7f396000edd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:07.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.512+0000 7f3966ffd640 1 -- 172.21.15.162:0/1961014172 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f396000cd80 con 0x7f3970073e70 2024-09-21T03:18:07.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.512+0000 7f3966ffd640 1 -- 172.21.15.162:0/1961014172 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3960010430 con 0x7f3970073e70 2024-09-21T03:18:07.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.512+0000 7f3966ffd640 1 -- 172.21.15.162:0/1961014172 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3960010860 con 0x7f3970073e70 2024-09-21T03:18:07.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.512+0000 7f3974fc6640 1 -- 172.21.15.162:0/1961014172 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39701f5ec0 con 0x7f3970073e70 2024-09-21T03:18:07.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.512+0000 7f3974fc6640 1 -- 172.21.15.162:0/1961014172 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39701f6480 con 0x7f3970073e70 2024-09-21T03:18:07.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.512+0000 7f3966ffd640 1 -- 172.21.15.162:0/1961014172 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f396001f020 con 0x7f3970073e70 2024-09-21T03:18:07.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.512+0000 7f3966ffd640 1 -- 172.21.15.162:0/1961014172 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f3960010d90 con 0x7f3970073e70 2024-09-21T03:18:07.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.513+0000 7f3974fc6640 1 -- 172.21.15.162:0/1961014172 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39700d0ce0 con 0x7f3970073e70 2024-09-21T03:18:07.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.515+0000 7f3966ffd640 1 -- 172.21.15.162:0/1961014172 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f3960026070 con 0x7f3970073e70 2024-09-21T03:18:07.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.586+0000 7f3974fc6640 1 -- 172.21.15.162:0/1961014172 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4d3e1186-f563-496f-a1e9-1db8498fd52d", "id": 3} v 0) -- 0x7f39701551e0 con 0x7f3970073e70 2024-09-21T03:18:07.592 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.590+0000 7f3966ffd640 1 -- 172.21.15.162:0/1961014172 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4d3e1186-f563-496f-a1e9-1db8498fd52d", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f39701f20f0 con 0x7f3970073e70 2024-09-21T03:18:07.592 INFO:teuthology.orchestra.run.smithi162.stdout:3 2024-09-21T03:18:07.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.591+0000 7f3974fc6640 1 -- 172.21.15.162:0/1961014172 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3970073e70 msgr2=0x7f39700c6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:07.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.591+0000 7f3974fc6640 1 --2- 172.21.15.162:0/1961014172 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3970073e70 0x7f39700c6600 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f396000e910 tx=0x7f396000edd0 comp rx=0 tx=0).stop 2024-09-21T03:18:07.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.591+0000 7f3974fc6640 1 -- 172.21.15.162:0/1961014172 shutdown_connections 2024-09-21T03:18:07.594 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.591+0000 7f3974fc6640 1 --2- 172.21.15.162:0/1961014172 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f397015ff30 0x7f3970153440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:07.594 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.591+0000 7f3974fc6640 1 --2- 172.21.15.162:0/1961014172 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f397015c9b0 0x7f39701594f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:07.594 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.591+0000 7f3974fc6640 1 --2- 172.21.15.162:0/1961014172 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3970073e70 0x7f39700c6600 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:07.594 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.591+0000 7f3974fc6640 1 -- 172.21.15.162:0/1961014172 >> 172.21.15.162:0/1961014172 conn(0x7f39700cdc60 msgr2=0x7f3970071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:07.594 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.591+0000 7f3974fc6640 1 -- 172.21.15.162:0/1961014172 shutdown_connections 2024-09-21T03:18:07.594 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.591+0000 7f3974fc6640 1 -- 172.21.15.162:0/1961014172 wait complete. 2024-09-21T03:18:07.603 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 27d53ef3-da79-4872-860a-84d51bccbfa3 4 2024-09-21T03:18:07.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.715+0000 7f86d80f4640 1 -- 172.21.15.162:0/1812417509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86bc004800 msgr2=0x7f86bc004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:07.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.715+0000 7f86d80f4640 1 --2- 172.21.15.162:0/1812417509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86bc004800 0x7f86bc004c10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f86c0006f90 tx=0x7f86bc005830 comp rx=0 tx=0).stop 2024-09-21T03:18:07.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.715+0000 7f86d80f4640 1 -- 172.21.15.162:0/1812417509 shutdown_connections 2024-09-21T03:18:07.718 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.715+0000 7f86d80f4640 1 --2- 172.21.15.162:0/1812417509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86bc004800 0x7f86bc004c10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:07.718 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.715+0000 7f86d80f4640 1 -- 172.21.15.162:0/1812417509 >> 172.21.15.162:0/1812417509 conn(0x7f86d0074170 msgr2=0x7f86d00b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:07.718 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.715+0000 7f86d80f4640 1 -- 172.21.15.162:0/1812417509 shutdown_connections 2024-09-21T03:18:07.718 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.715+0000 7f86d80f4640 1 -- 172.21.15.162:0/1812417509 wait complete. 2024-09-21T03:18:07.719 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.717+0000 7f86d80f4640 1 Processor -- start 2024-09-21T03:18:07.719 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.717+0000 7f86d80f4640 1 -- start start 2024-09-21T03:18:07.722 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.718+0000 7f86d80f4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86bc004800 0x7f86d015c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:07.722 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.718+0000 7f86d80f4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86d015e6b0 0x7f86d01500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:07.722 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.718+0000 7f86d80f4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86d01f5850 0x7f86d00ca550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:07.722 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.718+0000 7f86d80f4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f86d00ae1b0 con 0x7f86d01f5850 2024-09-21T03:18:07.722 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.718+0000 7f86d80f4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f86d00ae330 con 0x7f86d015e6b0 2024-09-21T03:18:07.722 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.718+0000 7f86d80f4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f86d00ae4b0 con 0x7f86bc004800 2024-09-21T03:18:07.723 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.719+0000 7f86d5e90640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86bc004800 0x7f86d015c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:07.723 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.719+0000 7f86d568f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86d015e6b0 0x7f86d01500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:07.723 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.719+0000 7f86d5e90640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86bc004800 0x7f86d015c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:54438/0 (socket says 172.21.15.162:54438) 2024-09-21T03:18:07.723 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.719+0000 7f86d5e90640 1 -- 172.21.15.162:0/3378096076 learned_addr learned my addr 172.21.15.162:0/3378096076 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T03:18:07.723 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.719+0000 7f86d568f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86d015e6b0 0x7f86d01500e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60076/0 (socket says 172.21.15.162:60076) 2024-09-21T03:18:07.723 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.719+0000 7f86d6691640 1 --2- 172.21.15.162:0/3378096076 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86d01f5850 0x7f86d00ca550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:07.723 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.719+0000 7f86d568f640 1 -- 172.21.15.162:0/3378096076 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86bc004800 msgr2=0x7f86d015c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:07.723 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.719+0000 7f86d568f640 1 --2- 172.21.15.162:0/3378096076 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86bc004800 0x7f86d015c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:07.723 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.719+0000 7f86d568f640 1 -- 172.21.15.162:0/3378096076 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86d01f5850 msgr2=0x7f86d00ca550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:07.723 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.719+0000 7f86d568f640 1 --2- 172.21.15.162:0/3378096076 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86d01f5850 0x7f86d00ca550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:07.723 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.719+0000 7f86d568f640 1 -- 172.21.15.162:0/3378096076 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86d01f4d90 con 0x7f86d015e6b0 2024-09-21T03:18:07.723 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.719+0000 7f86d5e90640 1 --2- 172.21.15.162:0/3378096076 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86bc004800 0x7f86d015c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:18:07.723 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.719+0000 7f86d568f640 1 --2- 172.21.15.162:0/3378096076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86d015e6b0 0x7f86d01500e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f86c0030000 tx=0x7f86c0006cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:07.724 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.719+0000 7f86c67fc640 1 -- 172.21.15.162:0/3378096076 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c0003a00 con 0x7f86d015e6b0 2024-09-21T03:18:07.724 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.719+0000 7f86c67fc640 1 -- 172.21.15.162:0/3378096076 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f86c0003c90 con 0x7f86d015e6b0 2024-09-21T03:18:07.724 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.719+0000 7f86d80f4640 1 -- 172.21.15.162:0/3378096076 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86d015cbe0 con 0x7f86d015e6b0 2024-09-21T03:18:07.724 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.719+0000 7f86c67fc640 1 -- 172.21.15.162:0/3378096076 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c00376b0 con 0x7f86d015e6b0 2024-09-21T03:18:07.724 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.719+0000 7f86d80f4640 1 -- 172.21.15.162:0/3378096076 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86d01f5050 con 0x7f86d015e6b0 2024-09-21T03:18:07.724 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.720+0000 7f86c67fc640 1 -- 172.21.15.162:0/3378096076 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f86c0035020 con 0x7f86d015e6b0 2024-09-21T03:18:07.724 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.720+0000 7f86c67fc640 1 -- 172.21.15.162:0/3378096076 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f86c002e440 con 0x7f86d015e6b0 2024-09-21T03:18:07.724 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.721+0000 7f86d80f4640 1 -- 172.21.15.162:0/3378096076 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86d00cf100 con 0x7f86d015e6b0 2024-09-21T03:18:07.724 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.723+0000 7f86c67fc640 1 -- 172.21.15.162:0/3378096076 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f86c0047060 con 0x7f86d015e6b0 2024-09-21T03:18:07.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.794+0000 7f86d80f4640 1 -- 172.21.15.162:0/3378096076 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd new", "uuid": "27d53ef3-da79-4872-860a-84d51bccbfa3", "id": 4} v 0) -- 0x7f86d006ef00 con 0x7f86d015e6b0 2024-09-21T03:18:07.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.798+0000 7f86c67fc640 1 -- 172.21.15.162:0/3378096076 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "27d53ef3-da79-4872-860a-84d51bccbfa3", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f86c0042440 con 0x7f86d015e6b0 2024-09-21T03:18:07.800 INFO:teuthology.orchestra.run.smithi162.stdout:4 2024-09-21T03:18:07.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.799+0000 7f86d80f4640 1 -- 172.21.15.162:0/3378096076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86d015e6b0 msgr2=0x7f86d01500e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:07.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.799+0000 7f86d80f4640 1 --2- 172.21.15.162:0/3378096076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86d015e6b0 0x7f86d01500e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f86c0030000 tx=0x7f86c0006cd0 comp rx=0 tx=0).stop 2024-09-21T03:18:07.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.799+0000 7f86d80f4640 1 -- 172.21.15.162:0/3378096076 shutdown_connections 2024-09-21T03:18:07.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.799+0000 7f86d80f4640 1 --2- 172.21.15.162:0/3378096076 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86d01f5850 0x7f86d00ca550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:07.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.799+0000 7f86d80f4640 1 --2- 172.21.15.162:0/3378096076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86d015e6b0 0x7f86d01500e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:07.802 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.799+0000 7f86d80f4640 1 --2- 172.21.15.162:0/3378096076 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86bc004800 0x7f86d015c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:07.802 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.799+0000 7f86d80f4640 1 -- 172.21.15.162:0/3378096076 >> 172.21.15.162:0/3378096076 conn(0x7f86d0074170 msgr2=0x7f86d00d1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:07.802 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.799+0000 7f86d80f4640 1 -- 172.21.15.162:0/3378096076 shutdown_connections 2024-09-21T03:18:07.802 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.799+0000 7f86d80f4640 1 -- 172.21.15.162:0/3378096076 wait complete. 2024-09-21T03:18:07.812 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 8bb3042e-a288-4ab0-bdf9-71938232ca75 5 2024-09-21T03:18:07.926 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.924+0000 7f8f9e151640 1 -- 172.21.15.162:0/1101564876 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f98162f60 msgr2=0x7f8f98165380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:07.926 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.924+0000 7f8f9e151640 1 --2- 172.21.15.162:0/1101564876 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f98162f60 0x7f8f98165380 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8f90005fd0 tx=0x7f8f9002a8b0 comp rx=0 tx=0).stop 2024-09-21T03:18:07.926 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.924+0000 7f8f9e151640 1 -- 172.21.15.162:0/1101564876 shutdown_connections 2024-09-21T03:18:07.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.924+0000 7f8f9e151640 1 --2- 172.21.15.162:0/1101564876 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f980b6100 0x7f8f980b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:07.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.924+0000 7f8f9e151640 1 --2- 172.21.15.162:0/1101564876 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f98162f60 0x7f8f98165380 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:07.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.924+0000 7f8f9e151640 1 -- 172.21.15.162:0/1101564876 >> 172.21.15.162:0/1101564876 conn(0x7f8f980d12a0 msgr2=0x7f8f980d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:07.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.924+0000 7f8f9e151640 1 -- 172.21.15.162:0/1101564876 shutdown_connections 2024-09-21T03:18:07.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.924+0000 7f8f9e151640 1 -- 172.21.15.162:0/1101564876 wait complete. 2024-09-21T03:18:07.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.926+0000 7f8f9e151640 1 Processor -- start 2024-09-21T03:18:07.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.926+0000 7f8f9e151640 1 -- start start 2024-09-21T03:18:07.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.927+0000 7f8f9e151640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f980b6100 0x7f8f981f6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:07.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.927+0000 7f8f9e151640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f980b6680 0x7f8f981f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:07.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.927+0000 7f8f9e151640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f98162f60 0x7f8f9809e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:07.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.928+0000 7f8f9e151640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8f98165a40 con 0x7f8f98162f60 2024-09-21T03:18:07.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.928+0000 7f8f9e151640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8f981658c0 con 0x7f8f980b6100 2024-09-21T03:18:07.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.928+0000 7f8f9e151640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8f98165bc0 con 0x7f8f980b6680 2024-09-21T03:18:07.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.928+0000 7f8f977fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f980b6100 0x7f8f981f6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:07.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.928+0000 7f8f8effd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f980b6680 0x7f8f981f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:07.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.928+0000 7f8f8effd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f980b6680 0x7f8f981f6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:54460/0 (socket says 172.21.15.162:54460) 2024-09-21T03:18:07.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.928+0000 7f8f977fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f980b6100 0x7f8f981f6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60096/0 (socket says 172.21.15.162:60096) 2024-09-21T03:18:07.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.928+0000 7f8f8effd640 1 -- 172.21.15.162:0/3778442881 learned_addr learned my addr 172.21.15.162:0/3778442881 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T03:18:07.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.928+0000 7f8f97fff640 1 --2- 172.21.15.162:0/3778442881 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f98162f60 0x7f8f9809e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:07.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.928+0000 7f8f977fe640 1 -- 172.21.15.162:0/3778442881 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f980b6680 msgr2=0x7f8f981f6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:07.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.928+0000 7f8f977fe640 1 --2- 172.21.15.162:0/3778442881 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f980b6680 0x7f8f981f6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:07.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.928+0000 7f8f977fe640 1 -- 172.21.15.162:0/3778442881 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f98162f60 msgr2=0x7f8f9809e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:07.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.928+0000 7f8f977fe640 1 --2- 172.21.15.162:0/3778442881 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f98162f60 0x7f8f9809e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:07.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.928+0000 7f8f977fe640 1 -- 172.21.15.162:0/3778442881 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f9809cd70 con 0x7f8f980b6100 2024-09-21T03:18:07.933 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.928+0000 7f8f8effd640 1 --2- 172.21.15.162:0/3778442881 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f980b6680 0x7f8f981f6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:18:07.933 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.928+0000 7f8f977fe640 1 --2- 172.21.15.162:0/3778442881 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f980b6100 0x7f8f981f6650 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8f8800c3c0 tx=0x7f8f88007f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:07.933 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.928+0000 7f8f94ff9640 1 -- 172.21.15.162:0/3778442881 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f88017070 con 0x7f8f980b6100 2024-09-21T03:18:07.933 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.928+0000 7f8f94ff9640 1 -- 172.21.15.162:0/3778442881 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f880035f0 con 0x7f8f980b6100 2024-09-21T03:18:07.933 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.928+0000 7f8f94ff9640 1 -- 172.21.15.162:0/3778442881 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f88003a40 con 0x7f8f980b6100 2024-09-21T03:18:07.933 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.928+0000 7f8f9e151640 1 -- 172.21.15.162:0/3778442881 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f9809d010 con 0x7f8f980b6100 2024-09-21T03:18:07.933 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.929+0000 7f8f9e151640 1 -- 172.21.15.162:0/3778442881 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f9809d5d0 con 0x7f8f980b6100 2024-09-21T03:18:07.933 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.929+0000 7f8f94ff9640 1 -- 172.21.15.162:0/3778442881 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8f8801a070 con 0x7f8f980b6100 2024-09-21T03:18:07.933 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.929+0000 7f8f94ff9640 1 -- 172.21.15.162:0/3778442881 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f8f88012980 con 0x7f8f980b6100 2024-09-21T03:18:07.933 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.930+0000 7f8f9e151640 1 -- 172.21.15.162:0/3778442881 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f980b0de0 con 0x7f8f980b6100 2024-09-21T03:18:07.934 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:07.932+0000 7f8f94ff9640 1 -- 172.21.15.162:0/3778442881 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f8f88021020 con 0x7f8f980b6100 2024-09-21T03:18:08.004 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.003+0000 7f8f9e151640 1 -- 172.21.15.162:0/3778442881 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8bb3042e-a288-4ab0-bdf9-71938232ca75", "id": 5} v 0) -- 0x7f8f980cd1d0 con 0x7f8f980b6100 2024-09-21T03:18:08.008 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.006+0000 7f8f94ff9640 1 -- 172.21.15.162:0/3778442881 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8bb3042e-a288-4ab0-bdf9-71938232ca75", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f8f9809cd70 con 0x7f8f980b6100 2024-09-21T03:18:08.008 INFO:teuthology.orchestra.run.smithi162.stdout:5 2024-09-21T03:18:08.009 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.007+0000 7f8f9e151640 1 -- 172.21.15.162:0/3778442881 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f980b6100 msgr2=0x7f8f981f6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:08.009 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.007+0000 7f8f9e151640 1 --2- 172.21.15.162:0/3778442881 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f980b6100 0x7f8f981f6650 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8f8800c3c0 tx=0x7f8f88007f90 comp rx=0 tx=0).stop 2024-09-21T03:18:08.009 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.007+0000 7f8f9e151640 1 -- 172.21.15.162:0/3778442881 shutdown_connections 2024-09-21T03:18:08.009 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.007+0000 7f8f9e151640 1 --2- 172.21.15.162:0/3778442881 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f98162f60 0x7f8f9809e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:08.009 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.007+0000 7f8f9e151640 1 --2- 172.21.15.162:0/3778442881 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f980b6680 0x7f8f981f6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:08.009 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.007+0000 7f8f9e151640 1 --2- 172.21.15.162:0/3778442881 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f980b6100 0x7f8f981f6650 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:08.009 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.007+0000 7f8f9e151640 1 -- 172.21.15.162:0/3778442881 >> 172.21.15.162:0/3778442881 conn(0x7f8f980d12a0 msgr2=0x7f8f980c78c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:08.010 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.007+0000 7f8f9e151640 1 -- 172.21.15.162:0/3778442881 shutdown_connections 2024-09-21T03:18:08.010 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.007+0000 7f8f9e151640 1 -- 172.21.15.162:0/3778442881 wait complete. 2024-09-21T03:18:08.019 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 08df45e8-f2e8-472c-918b-b9bb92c452c1 6 2024-09-21T03:18:08.133 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.131+0000 7fc7e9e30640 1 -- 172.21.15.162:0/2726139009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7e40d16f0 msgr2=0x7fc7e415d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:08.133 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.131+0000 7fc7e9e30640 1 --2- 172.21.15.162:0/2726139009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7e40d16f0 0x7fc7e415d900 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc7e40b4ec0 tx=0x7fc7d402a680 comp rx=0 tx=0).stop 2024-09-21T03:18:08.133 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.131+0000 7fc7e9e30640 1 -- 172.21.15.162:0/2726139009 shutdown_connections 2024-09-21T03:18:08.134 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.131+0000 7fc7e9e30640 1 --2- 172.21.15.162:0/2726139009 >> v2:172.21.15.105:3300/0 conn(0x7fc7e4160550 0x7fc7e40cece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:08.134 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.131+0000 7fc7e9e30640 1 --2- 172.21.15.162:0/2726139009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7e40d16f0 0x7fc7e415d900 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:08.134 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.131+0000 7fc7e9e30640 1 -- 172.21.15.162:0/2726139009 >> 172.21.15.162:0/2726139009 conn(0x7fc7e406d5d0 msgr2=0x7fc7e4071110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:08.134 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.131+0000 7fc7e9e30640 1 -- 172.21.15.162:0/2726139009 shutdown_connections 2024-09-21T03:18:08.134 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.131+0000 7fc7e9e30640 1 -- 172.21.15.162:0/2726139009 wait complete. 2024-09-21T03:18:08.134 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.133+0000 7fc7e9e30640 1 Processor -- start 2024-09-21T03:18:08.134 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.133+0000 7fc7e9e30640 1 -- start start 2024-09-21T03:18:08.137 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.134+0000 7fc7e9e30640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7e40d16f0 0x7fc7e40cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:08.137 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.134+0000 7fc7e9e30640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7e4160550 0x7fc7e40c9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:08.137 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.134+0000 7fc7e9e30640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7e4160960 0x7fc7e40c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:08.137 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.134+0000 7fc7e9e30640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e40cf5b0 con 0x7fc7e4160550 2024-09-21T03:18:08.137 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.134+0000 7fc7e9e30640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e40cf430 con 0x7fc7e40d16f0 2024-09-21T03:18:08.137 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.134+0000 7fc7e9e30640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc7e40d0650 con 0x7fc7e4160960 2024-09-21T03:18:08.137 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.134+0000 7fc7e37fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7e40d16f0 0x7fc7e40cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:08.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.134+0000 7fc7e37fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7e40d16f0 0x7fc7e40cb0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60126/0 (socket says 172.21.15.162:60126) 2024-09-21T03:18:08.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.134+0000 7fc7e37fe640 1 -- 172.21.15.162:0/3792540116 learned_addr learned my addr 172.21.15.162:0/3792540116 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T03:18:08.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.134+0000 7fc7e3fff640 1 --2- 172.21.15.162:0/3792540116 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7e4160960 0x7fc7e40c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:08.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.134+0000 7fc7dbfff640 1 --2- 172.21.15.162:0/3792540116 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7e4160550 0x7fc7e40c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:08.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.134+0000 7fc7e37fe640 1 -- 172.21.15.162:0/3792540116 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7e4160960 msgr2=0x7fc7e40c9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:08.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.134+0000 7fc7e37fe640 1 --2- 172.21.15.162:0/3792540116 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7e4160960 0x7fc7e40c9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:08.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.134+0000 7fc7e37fe640 1 -- 172.21.15.162:0/3792540116 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7e4160550 msgr2=0x7fc7e40c9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:08.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.134+0000 7fc7e37fe640 1 --2- 172.21.15.162:0/3792540116 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7e4160550 0x7fc7e40c9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:08.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.134+0000 7fc7e37fe640 1 -- 172.21.15.162:0/3792540116 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7e4155ec0 con 0x7fc7e40d16f0 2024-09-21T03:18:08.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.135+0000 7fc7e37fe640 1 --2- 172.21.15.162:0/3792540116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7e40d16f0 0x7fc7e40cb0b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc7d402ac70 tx=0x7fc7d40038a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:08.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.135+0000 7fc7e0ff9640 1 -- 172.21.15.162:0/3792540116 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d403e030 con 0x7fc7e40d16f0 2024-09-21T03:18:08.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.135+0000 7fc7e0ff9640 1 -- 172.21.15.162:0/3792540116 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc7d4003db0 con 0x7fc7e40d16f0 2024-09-21T03:18:08.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.135+0000 7fc7e0ff9640 1 -- 172.21.15.162:0/3792540116 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d4035040 con 0x7fc7e40d16f0 2024-09-21T03:18:08.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.135+0000 7fc7e9e30640 1 -- 172.21.15.162:0/3792540116 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7e40cbbe0 con 0x7fc7e40d16f0 2024-09-21T03:18:08.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.135+0000 7fc7e9e30640 1 -- 172.21.15.162:0/3792540116 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7e40cc1a0 con 0x7fc7e40d16f0 2024-09-21T03:18:08.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.135+0000 7fc7e0ff9640 1 -- 172.21.15.162:0/3792540116 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc7d4041030 con 0x7fc7e40d16f0 2024-09-21T03:18:08.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.135+0000 7fc7e0ff9640 1 -- 172.21.15.162:0/3792540116 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fc7d4031400 con 0x7fc7e40d16f0 2024-09-21T03:18:08.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.136+0000 7fc7e9e30640 1 -- 172.21.15.162:0/3792540116 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7e415d900 con 0x7fc7e40d16f0 2024-09-21T03:18:08.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.138+0000 7fc7e0ff9640 1 -- 172.21.15.162:0/3792540116 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fc7d4043410 con 0x7fc7e40d16f0 2024-09-21T03:18:08.211 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.209+0000 7fc7e9e30640 1 -- 172.21.15.162:0/3792540116 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd new", "uuid": "08df45e8-f2e8-472c-918b-b9bb92c452c1", "id": 6} v 0) -- 0x7fc7e40c8a90 con 0x7fc7e40d16f0 2024-09-21T03:18:08.214 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.213+0000 7fc7e0ff9640 1 -- 172.21.15.162:0/3792540116 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "08df45e8-f2e8-472c-918b-b9bb92c452c1", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fc7d4004ed0 con 0x7fc7e40d16f0 2024-09-21T03:18:08.214 INFO:teuthology.orchestra.run.smithi162.stdout:6 2024-09-21T03:18:08.215 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.214+0000 7fc7e9e30640 1 -- 172.21.15.162:0/3792540116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7e40d16f0 msgr2=0x7fc7e40cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:08.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.214+0000 7fc7e9e30640 1 --2- 172.21.15.162:0/3792540116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7e40d16f0 0x7fc7e40cb0b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc7d402ac70 tx=0x7fc7d40038a0 comp rx=0 tx=0).stop 2024-09-21T03:18:08.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.214+0000 7fc7e9e30640 1 -- 172.21.15.162:0/3792540116 shutdown_connections 2024-09-21T03:18:08.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.214+0000 7fc7e9e30640 1 --2- 172.21.15.162:0/3792540116 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7e4160960 0x7fc7e40c9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:08.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.214+0000 7fc7e9e30640 1 --2- 172.21.15.162:0/3792540116 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7e4160550 0x7fc7e40c9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:08.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.214+0000 7fc7e9e30640 1 --2- 172.21.15.162:0/3792540116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7e40d16f0 0x7fc7e40cb0b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:08.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.214+0000 7fc7e9e30640 1 -- 172.21.15.162:0/3792540116 >> 172.21.15.162:0/3792540116 conn(0x7fc7e406d5d0 msgr2=0x7fc7e40d22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:08.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.214+0000 7fc7e9e30640 1 -- 172.21.15.162:0/3792540116 shutdown_connections 2024-09-21T03:18:08.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.214+0000 7fc7e9e30640 1 -- 172.21.15.162:0/3792540116 wait complete. 2024-09-21T03:18:08.226 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 2d2e4926-0722-4d3a-a6b2-90d366e6f421 7 2024-09-21T03:18:08.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.338+0000 7fa903cf9640 1 -- 172.21.15.162:0/2728375812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa8fc0d09c0 msgr2=0x7fa8fc0cdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:08.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.338+0000 7fa903cf9640 1 --2- 172.21.15.162:0/2728375812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa8fc0d09c0 0x7fa8fc0cdc10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa8f4005fd0 tx=0x7fa8f402aa10 comp rx=0 tx=0).stop 2024-09-21T03:18:08.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.338+0000 7fa903cf9640 1 -- 172.21.15.162:0/2728375812 shutdown_connections 2024-09-21T03:18:08.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.338+0000 7fa903cf9640 1 --2- 172.21.15.162:0/2728375812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa8fc0d09c0 0x7fa8fc0cdc10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:08.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.338+0000 7fa903cf9640 1 --2- 172.21.15.162:0/2728375812 >> v2:172.21.15.162:3300/0 conn(0x7fa8fc145f90 0x7fa8fc06cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:08.341 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.338+0000 7fa903cf9640 1 -- 172.21.15.162:0/2728375812 >> 172.21.15.162:0/2728375812 conn(0x7fa8fc0b2e10 msgr2=0x7fa8fc0b3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:08.341 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.338+0000 7fa903cf9640 1 -- 172.21.15.162:0/2728375812 shutdown_connections 2024-09-21T03:18:08.341 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.338+0000 7fa903cf9640 1 -- 172.21.15.162:0/2728375812 wait complete. 2024-09-21T03:18:08.341 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.340+0000 7fa903cf9640 1 Processor -- start 2024-09-21T03:18:08.341 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.340+0000 7fa903cf9640 1 -- start start 2024-09-21T03:18:08.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.341+0000 7fa903cf9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa8fc06d320 0x7fa8fc1f3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:08.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.341+0000 7fa903cf9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8fc0d09c0 0x7fa8fc1588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:08.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.341+0000 7fa903cf9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8fc145f90 0x7fa8fc141a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:08.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.341+0000 7fa903cf9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa8fc0ce4e0 con 0x7fa8fc0d09c0 2024-09-21T03:18:08.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.341+0000 7fa903cf9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa8fc0ce360 con 0x7fa8fc145f90 2024-09-21T03:18:08.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.341+0000 7fa903cf9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa8fc0ce660 con 0x7fa8fc06d320 2024-09-21T03:18:08.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.341+0000 7fa901a95640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa8fc06d320 0x7fa8fc1f3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:08.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.341+0000 7fa902296640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8fc145f90 0x7fa8fc141a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:08.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.341+0000 7fa901a95640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa8fc06d320 0x7fa8fc1f3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:54484/0 (socket says 172.21.15.162:54484) 2024-09-21T03:18:08.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.341+0000 7fa901a95640 1 -- 172.21.15.162:0/2017221983 learned_addr learned my addr 172.21.15.162:0/2017221983 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-21T03:18:08.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.342+0000 7fa901294640 1 --2- 172.21.15.162:0/2017221983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8fc0d09c0 0x7fa8fc1588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:08.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.342+0000 7fa901a95640 1 -- 172.21.15.162:0/2017221983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8fc145f90 msgr2=0x7fa8fc141a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:08.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.342+0000 7fa901a95640 1 --2- 172.21.15.162:0/2017221983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8fc145f90 0x7fa8fc141a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:08.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.342+0000 7fa901a95640 1 -- 172.21.15.162:0/2017221983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8fc0d09c0 msgr2=0x7fa8fc1588a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:08.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.342+0000 7fa901a95640 1 --2- 172.21.15.162:0/2017221983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8fc0d09c0 0x7fa8fc1588a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:08.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.342+0000 7fa901a95640 1 -- 172.21.15.162:0/2017221983 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8fc141fb0 con 0x7fa8fc06d320 2024-09-21T03:18:08.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.342+0000 7fa901294640 1 --2- 172.21.15.162:0/2017221983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8fc0d09c0 0x7fa8fc1588a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:18:08.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.342+0000 7fa901a95640 1 --2- 172.21.15.162:0/2017221983 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa8fc06d320 0x7fa8fc1f3830 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec00ea20 tx=0x7fa8ec00eee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:08.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.342+0000 7fa8f27fc640 1 -- 172.21.15.162:0/2017221983 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec00ce40 con 0x7fa8fc06d320 2024-09-21T03:18:08.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.342+0000 7fa8f27fc640 1 -- 172.21.15.162:0/2017221983 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa8ec004020 con 0x7fa8fc06d320 2024-09-21T03:18:08.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.342+0000 7fa903cf9640 1 -- 172.21.15.162:0/2017221983 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8fc1590d0 con 0x7fa8fc06d320 2024-09-21T03:18:08.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.342+0000 7fa8f27fc640 1 -- 172.21.15.162:0/2017221983 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec004470 con 0x7fa8fc06d320 2024-09-21T03:18:08.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.342+0000 7fa903cf9640 1 -- 172.21.15.162:0/2017221983 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8fc159690 con 0x7fa8fc06d320 2024-09-21T03:18:08.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.342+0000 7fa8f27fc640 1 -- 172.21.15.162:0/2017221983 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa8ec004b50 con 0x7fa8fc06d320 2024-09-21T03:18:08.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.342+0000 7fa8f27fc640 1 -- 172.21.15.162:0/2017221983 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fa8ec003de0 con 0x7fa8fc06d320 2024-09-21T03:18:08.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.343+0000 7fa903cf9640 1 -- 172.21.15.162:0/2017221983 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8fc0ceb80 con 0x7fa8fc06d320 2024-09-21T03:18:08.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.345+0000 7fa8f27fc640 1 -- 172.21.15.162:0/2017221983 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa8ec009490 con 0x7fa8fc06d320 2024-09-21T03:18:08.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.415+0000 7fa903cf9640 1 -- 172.21.15.162:0/2017221983 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2d2e4926-0722-4d3a-a6b2-90d366e6f421", "id": 7} v 0) -- 0x7fa8fc0750a0 con 0x7fa8fc06d320 2024-09-21T03:18:08.420 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.419+0000 7fa8f27fc640 1 -- 172.21.15.162:0/2017221983 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2d2e4926-0722-4d3a-a6b2-90d366e6f421", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fa8ec003850 con 0x7fa8fc06d320 2024-09-21T03:18:08.421 INFO:teuthology.orchestra.run.smithi162.stdout:7 2024-09-21T03:18:08.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.420+0000 7fa903cf9640 1 -- 172.21.15.162:0/2017221983 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa8fc06d320 msgr2=0x7fa8fc1f3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:08.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.420+0000 7fa903cf9640 1 --2- 172.21.15.162:0/2017221983 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa8fc06d320 0x7fa8fc1f3830 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec00ea20 tx=0x7fa8ec00eee0 comp rx=0 tx=0).stop 2024-09-21T03:18:08.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.420+0000 7fa903cf9640 1 -- 172.21.15.162:0/2017221983 shutdown_connections 2024-09-21T03:18:08.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.420+0000 7fa903cf9640 1 --2- 172.21.15.162:0/2017221983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8fc145f90 0x7fa8fc141a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:08.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.420+0000 7fa903cf9640 1 --2- 172.21.15.162:0/2017221983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8fc0d09c0 0x7fa8fc1588a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:08.423 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.420+0000 7fa903cf9640 1 --2- 172.21.15.162:0/2017221983 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa8fc06d320 0x7fa8fc1f3830 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:08.423 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.420+0000 7fa903cf9640 1 -- 172.21.15.162:0/2017221983 >> 172.21.15.162:0/2017221983 conn(0x7fa8fc0b2e10 msgr2=0x7fa8fc0b21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:08.423 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.420+0000 7fa903cf9640 1 -- 172.21.15.162:0/2017221983 shutdown_connections 2024-09-21T03:18:08.423 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:08.420+0000 7fa903cf9640 1 -- 172.21.15.162:0/2017221983 wait complete. 2024-09-21T03:18:08.432 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-21T03:18:08.432 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-21T03:18:08.434 INFO:tasks.ceph.osd.0:Started 2024-09-21T03:18:08.434 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-21T03:18:08.435 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-21T03:18:08.436 INFO:tasks.ceph.osd.1:Started 2024-09-21T03:18:08.436 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-21T03:18:08.437 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-21T03:18:08.438 INFO:tasks.ceph.osd.2:Started 2024-09-21T03:18:08.438 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-21T03:18:08.439 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-21T03:18:08.441 INFO:tasks.ceph.osd.3:Started 2024-09-21T03:18:08.441 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-21T03:18:08.441 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-21T03:18:08.443 INFO:tasks.ceph.osd.4:Started 2024-09-21T03:18:08.443 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-21T03:18:08.443 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-21T03:18:08.445 INFO:tasks.ceph.osd.5:Started 2024-09-21T03:18:08.445 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-21T03:18:08.445 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-21T03:18:08.447 INFO:tasks.ceph.osd.6:Started 2024-09-21T03:18:08.447 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-21T03:18:08.447 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-21T03:18:08.450 INFO:tasks.ceph.osd.7:Started 2024-09-21T03:18:08.450 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:18:08.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.577+0000 7fbaab4ce640 1 -- 172.21.15.105:0/97492143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbaa40d1490 msgr2=0x7fbaa40cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:08.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.577+0000 7fbaab4ce640 1 --2- 172.21.15.105:0/97492143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbaa40d1490 0x7fbaa40cebf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fba9c005fd0 tx=0x7fba9c02a8b0 comp rx=0 tx=0).stop 2024-09-21T03:18:08.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.577+0000 7fbaab4ce640 1 -- 172.21.15.105:0/97492143 shutdown_connections 2024-09-21T03:18:08.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.577+0000 7fbaab4ce640 1 --2- 172.21.15.105:0/97492143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbaa40d1490 0x7fbaa40cebf0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:08.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.577+0000 7fbaab4ce640 1 --2- 172.21.15.105:0/97492143 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbaa40b51c0 0x7fbaa415c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:08.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.577+0000 7fbaab4ce640 1 -- 172.21.15.105:0/97492143 >> 172.21.15.105:0/97492143 conn(0x7fbaa4072ae0 msgr2=0x7fbaa4072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:08.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.578+0000 7fbaab4ce640 1 -- 172.21.15.105:0/97492143 shutdown_connections 2024-09-21T03:18:08.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.578+0000 7fbaab4ce640 1 -- 172.21.15.105:0/97492143 wait complete. 2024-09-21T03:18:08.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.579+0000 7fbaab4ce640 1 Processor -- start 2024-09-21T03:18:08.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.579+0000 7fbaab4ce640 1 -- start start 2024-09-21T03:18:08.584 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.581+0000 7fbaab4ce640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbaa40b51c0 0x7fbaa415db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:08.585 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.581+0000 7fbaab4ce640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbaa40ccbd0 0x7fbaa41586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:08.585 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.581+0000 7fbaab4ce640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbaa40d1490 0x7fbaa41f3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:08.585 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.581+0000 7fbaab4ce640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa40cf2b0 con 0x7fbaa40d1490 2024-09-21T03:18:08.585 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.581+0000 7fbaab4ce640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa40cf130 con 0x7fbaa40ccbd0 2024-09-21T03:18:08.585 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.581+0000 7fbaab4ce640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbaa40cf430 con 0x7fbaa40b51c0 2024-09-21T03:18:08.585 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.581+0000 7fbaa926a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbaa40b51c0 0x7fbaa415db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:08.585 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.581+0000 7fbaa9a6b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbaa40d1490 0x7fbaa41f3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:08.585 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.581+0000 7fbaa926a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbaa40b51c0 0x7fbaa415db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.105:35786/0 (socket says 172.21.15.105:35786) 2024-09-21T03:18:08.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.581+0000 7fbaa9a6b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbaa40d1490 0x7fbaa41f3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:33950/0 (socket says 172.21.15.105:33950) 2024-09-21T03:18:08.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.581+0000 7fbaa8a69640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbaa40ccbd0 0x7fbaa41586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:08.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.581+0000 7fbaa926a640 1 -- 172.21.15.105:0/1169357986 learned_addr learned my addr 172.21.15.105:0/1169357986 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:08.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.581+0000 7fbaa8a69640 1 -- 172.21.15.105:0/1169357986 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbaa40b51c0 msgr2=0x7fbaa415db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:08.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.581+0000 7fbaa8a69640 1 --2- 172.21.15.105:0/1169357986 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbaa40b51c0 0x7fbaa415db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:08.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.581+0000 7fbaa8a69640 1 -- 172.21.15.105:0/1169357986 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbaa40d1490 msgr2=0x7fbaa41f3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:08.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.581+0000 7fbaa8a69640 1 --2- 172.21.15.105:0/1169357986 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbaa40d1490 0x7fbaa41f3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:08.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.581+0000 7fbaa8a69640 1 -- 172.21.15.105:0/1169357986 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa41f4290 con 0x7fbaa40ccbd0 2024-09-21T03:18:08.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.581+0000 7fbaa926a640 1 --2- 172.21.15.105:0/1169357986 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbaa40b51c0 0x7fbaa415db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:18:08.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.582+0000 7fbaa8a69640 1 --2- 172.21.15.105:0/1169357986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbaa40ccbd0 0x7fbaa41586b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbaa000c3c0 tx=0x7fbaa000c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:08.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.582+0000 7fba99ffb640 1 -- 172.21.15.105:0/1169357986 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa0011790 con 0x7fbaa40ccbd0 2024-09-21T03:18:08.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.582+0000 7fba99ffb640 1 -- 172.21.15.105:0/1169357986 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbaa0017070 con 0x7fbaa40ccbd0 2024-09-21T03:18:08.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.582+0000 7fbaab4ce640 1 -- 172.21.15.105:0/1169357986 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaa415d080 con 0x7fbaa40ccbd0 2024-09-21T03:18:08.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.582+0000 7fba99ffb640 1 -- 172.21.15.105:0/1169357986 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa0011cc0 con 0x7fbaa40ccbd0 2024-09-21T03:18:08.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.582+0000 7fba99ffb640 1 -- 172.21.15.105:0/1169357986 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbaa001c460 con 0x7fbaa40ccbd0 2024-09-21T03:18:08.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.582+0000 7fbaab4ce640 1 -- 172.21.15.105:0/1169357986 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaa415d640 con 0x7fbaa40ccbd0 2024-09-21T03:18:08.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.582+0000 7fba99ffb640 1 -- 172.21.15.105:0/1169357986 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fbaa001b3c0 con 0x7fbaa40ccbd0 2024-09-21T03:18:08.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.583+0000 7fbaab4ce640 1 -- 172.21.15.105:0/1169357986 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaa40cf880 con 0x7fbaa40ccbd0 2024-09-21T03:18:08.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.585+0000 7fba99ffb640 1 -- 172.21.15.105:0/1169357986 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fbaa0021020 con 0x7fbaa40ccbd0 2024-09-21T03:18:08.646 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.644+0000 7fbaab4ce640 1 -- 172.21.15.105:0/1169357986 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbaa40b2dc0 con 0x7fbaa40ccbd0 2024-09-21T03:18:08.647 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.645+0000 7fba99ffb640 1 -- 172.21.15.105:0/1169357986 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fbaa0012740 con 0x7fbaa40ccbd0 2024-09-21T03:18:08.647 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:18:08.647 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":10,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:18:08.417548+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:18:08.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.646+0000 7fbaab4ce640 1 -- 172.21.15.105:0/1169357986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbaa40ccbd0 msgr2=0x7fbaa41586b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:08.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.646+0000 7fbaab4ce640 1 --2- 172.21.15.105:0/1169357986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbaa40ccbd0 0x7fbaa41586b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbaa000c3c0 tx=0x7fbaa000c880 comp rx=0 tx=0).stop 2024-09-21T03:18:08.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.646+0000 7fbaab4ce640 1 -- 172.21.15.105:0/1169357986 shutdown_connections 2024-09-21T03:18:08.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.646+0000 7fbaab4ce640 1 --2- 172.21.15.105:0/1169357986 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbaa40d1490 0x7fbaa41f3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:08.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.646+0000 7fbaab4ce640 1 --2- 172.21.15.105:0/1169357986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbaa40ccbd0 0x7fbaa41586b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:08.649 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.646+0000 7fbaab4ce640 1 --2- 172.21.15.105:0/1169357986 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbaa40b51c0 0x7fbaa415db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:08.649 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.646+0000 7fbaab4ce640 1 -- 172.21.15.105:0/1169357986 >> 172.21.15.105:0/1169357986 conn(0x7fbaa4072ae0 msgr2=0x7fbaa415b720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:08.649 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.646+0000 7fbaab4ce640 1 -- 172.21.15.105:0/1169357986 shutdown_connections 2024-09-21T03:18:08.649 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:08.646+0000 7fbaab4ce640 1 -- 172.21.15.105:0/1169357986 wait complete. 2024-09-21T03:18:08.658 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-21T03:18:08.659 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-21T03:18:09.463 DEBUG:teuthology.orchestra.run.smithi105:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T03:18:09.570 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.568+0000 7f86104bd640 1 -- 172.21.15.105:0/1734633822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86080d1150 msgr2=0x7f86080cd0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:09.570 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.568+0000 7f86104bd640 1 --2- 172.21.15.105:0/1734633822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86080d1150 0x7f86080cd0f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8600005fd0 tx=0x7f860002a8b0 comp rx=0 tx=0).stop 2024-09-21T03:18:09.570 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.568+0000 7f86104bd640 1 -- 172.21.15.105:0/1734633822 shutdown_connections 2024-09-21T03:18:09.570 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.568+0000 7f86104bd640 1 --2- 172.21.15.105:0/1734633822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86080d1150 0x7f86080cd0f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:09.570 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.568+0000 7f86104bd640 1 --2- 172.21.15.105:0/1734633822 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86080b1df0 0x7f86080b7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:09.570 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.568+0000 7f86104bd640 1 -- 172.21.15.105:0/1734633822 >> 172.21.15.105:0/1734633822 conn(0x7f86080cefa0 msgr2=0x7f86080cf3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:09.570 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.568+0000 7f86104bd640 1 -- 172.21.15.105:0/1734633822 shutdown_connections 2024-09-21T03:18:09.570 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.568+0000 7f86104bd640 1 -- 172.21.15.105:0/1734633822 wait complete. 2024-09-21T03:18:09.571 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.570+0000 7f86104bd640 1 Processor -- start 2024-09-21T03:18:09.571 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.570+0000 7f86104bd640 1 -- start start 2024-09-21T03:18:09.574 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.571+0000 7f86104bd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86080b1df0 0x7f860814d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:09.574 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.571+0000 7f86104bd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86080b2200 0x7f86080c6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:09.574 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.571+0000 7f86104bd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86080d1150 0x7f860815a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:09.574 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.571+0000 7f86104bd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f86080767f0 con 0x7f86080b2200 2024-09-21T03:18:09.574 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.571+0000 7f86104bd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8608076670 con 0x7f86080d1150 2024-09-21T03:18:09.574 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.571+0000 7f86104bd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f86080b7e70 con 0x7f86080b1df0 2024-09-21T03:18:09.574 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.571+0000 7f860da58640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86080b2200 0x7f86080c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:09.574 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.571+0000 7f860da58640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86080b2200 0x7f86080c6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:33960/0 (socket says 172.21.15.105:33960) 2024-09-21T03:18:09.574 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.571+0000 7f860da58640 1 -- 172.21.15.105:0/3117075247 learned_addr learned my addr 172.21.15.105:0/3117075247 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:09.574 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.571+0000 7f860ea5a640 1 --2- 172.21.15.105:0/3117075247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86080d1150 0x7f860815a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:09.574 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.571+0000 7f860e259640 1 --2- 172.21.15.105:0/3117075247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86080b1df0 0x7f860814d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:09.574 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.572+0000 7f860da58640 1 -- 172.21.15.105:0/3117075247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86080b1df0 msgr2=0x7f860814d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:09.575 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.572+0000 7f860da58640 1 --2- 172.21.15.105:0/3117075247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86080b1df0 0x7f860814d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:09.575 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.572+0000 7f860da58640 1 -- 172.21.15.105:0/3117075247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86080d1150 msgr2=0x7f860815a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:09.575 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.572+0000 7f860da58640 1 --2- 172.21.15.105:0/3117075247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86080d1150 0x7f860815a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:09.575 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.572+0000 7f860da58640 1 -- 172.21.15.105:0/3117075247 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86080c7020 con 0x7f86080b2200 2024-09-21T03:18:09.575 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.572+0000 7f860ea5a640 1 --2- 172.21.15.105:0/3117075247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86080d1150 0x7f860815a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:18:09.575 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.572+0000 7f860da58640 1 --2- 172.21.15.105:0/3117075247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86080b2200 0x7f86080c6050 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f860400c3a0 tx=0x7f860400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:09.575 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.572+0000 7f85feffd640 1 -- 172.21.15.105:0/3117075247 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8604006890 con 0x7f86080b2200 2024-09-21T03:18:09.575 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.572+0000 7f85feffd640 1 -- 172.21.15.105:0/3117075247 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8604006b20 con 0x7f86080b2200 2024-09-21T03:18:09.575 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.572+0000 7f86104bd640 1 -- 172.21.15.105:0/3117075247 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86080c6a60 con 0x7f86080b2200 2024-09-21T03:18:09.575 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.572+0000 7f85feffd640 1 -- 172.21.15.105:0/3117075247 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8604007020 con 0x7f86080b2200 2024-09-21T03:18:09.575 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.572+0000 7f86104bd640 1 -- 172.21.15.105:0/3117075247 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86080c77b0 con 0x7f86080b2200 2024-09-21T03:18:09.576 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.573+0000 7f85feffd640 1 -- 172.21.15.105:0/3117075247 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 2) ==== 50742+0+0 (secure 0 0 0) 0x7f8604019020 con 0x7f86080b2200 2024-09-21T03:18:09.576 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.573+0000 7f85feffd640 1 -- 172.21.15.105:0/3117075247 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f8604051a50 con 0x7f86080b2200 2024-09-21T03:18:09.576 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.573+0000 7f86104bd640 1 -- 172.21.15.105:0/3117075247 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86080b7930 con 0x7f86080b2200 2024-09-21T03:18:09.576 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.575+0000 7f85feffd640 1 -- 172.21.15.105:0/3117075247 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f860401a370 con 0x7f86080b2200 2024-09-21T03:18:09.638 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.636+0000 7f86104bd640 1 -- 172.21.15.105:0/3117075247 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f86080b3600 con 0x7f86080b2200 2024-09-21T03:18:09.638 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.637+0000 7f85feffd640 1 -- 172.21.15.105:0/3117075247 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f8604011910 con 0x7f86080b2200 2024-09-21T03:18:09.638 INFO:teuthology.misc.health.smithi105.stdout: 2024-09-21T03:18:09.639 INFO:teuthology.misc.health.smithi105.stdout:{"epoch":10,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:18:08.417548+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:18:09.639 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.638+0000 7f86104bd640 1 -- 172.21.15.105:0/3117075247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86080b2200 msgr2=0x7f86080c6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:09.640 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.638+0000 7f86104bd640 1 --2- 172.21.15.105:0/3117075247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86080b2200 0x7f86080c6050 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f860400c3a0 tx=0x7f860400c860 comp rx=0 tx=0).stop 2024-09-21T03:18:09.640 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.638+0000 7f86104bd640 1 -- 172.21.15.105:0/3117075247 shutdown_connections 2024-09-21T03:18:09.640 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.638+0000 7f86104bd640 1 --2- 172.21.15.105:0/3117075247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86080d1150 0x7f860815a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:09.640 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.638+0000 7f86104bd640 1 --2- 172.21.15.105:0/3117075247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86080b2200 0x7f86080c6050 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:09.640 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.638+0000 7f86104bd640 1 --2- 172.21.15.105:0/3117075247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86080b1df0 0x7f860814d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:09.640 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.638+0000 7f86104bd640 1 -- 172.21.15.105:0/3117075247 >> 172.21.15.105:0/3117075247 conn(0x7f86080cefa0 msgr2=0x7f86080ce330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:09.640 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.638+0000 7f86104bd640 1 -- 172.21.15.105:0/3117075247 shutdown_connections 2024-09-21T03:18:09.640 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:09.638+0000 7f86104bd640 1 -- 172.21.15.105:0/3117075247 wait complete. 2024-09-21T03:18:09.649 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-21T03:18:09.921 INFO:tasks.ceph.osd.5.smithi162.stderr:2024-09-21T03:18:09.919+0000 7f0149013640 -1 Falling back to public interface 2024-09-21T03:18:09.936 INFO:tasks.ceph.osd.0.smithi105.stderr:2024-09-21T03:18:09.934+0000 7ff36a80b640 -1 Falling back to public interface 2024-09-21T03:18:09.943 INFO:tasks.ceph.osd.4.smithi162.stderr:2024-09-21T03:18:09.942+0000 7f6205ddd640 -1 Falling back to public interface 2024-09-21T03:18:09.956 INFO:tasks.ceph.osd.6.smithi162.stderr:2024-09-21T03:18:09.954+0000 7f72dc42a640 -1 Falling back to public interface 2024-09-21T03:18:09.959 INFO:tasks.ceph.osd.2.smithi105.stderr:2024-09-21T03:18:09.957+0000 7fefb6951640 -1 Falling back to public interface 2024-09-21T03:18:09.960 INFO:tasks.ceph.osd.7.smithi162.stderr:2024-09-21T03:18:09.958+0000 7fd4c440d640 -1 Falling back to public interface 2024-09-21T03:18:09.967 INFO:tasks.ceph.osd.1.smithi105.stderr:2024-09-21T03:18:09.965+0000 7f13b1a17640 -1 Falling back to public interface 2024-09-21T03:18:10.220 INFO:tasks.ceph.osd.3.smithi105.stderr:2024-09-21T03:18:10.218+0000 7f5d30917640 -1 Falling back to public interface 2024-09-21T03:18:10.284 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-09-21T03:18:10.282+0000 7fc0973d7640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-21T03:18:10.284 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-09-21T03:18:10.283+0000 7fc0973d7640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-21T03:18:13.473 INFO:tasks.ceph.osd.0.smithi105.stderr:2024-09-21T03:18:13.472+0000 7ff36a80b640 -1 osd.0 0 log_to_monitors true 2024-09-21T03:18:13.571 INFO:tasks.ceph.osd.1.smithi105.stderr:2024-09-21T03:18:13.570+0000 7f13b1a17640 -1 osd.1 0 log_to_monitors true 2024-09-21T03:18:13.680 INFO:tasks.ceph.osd.5.smithi162.stderr:2024-09-21T03:18:13.678+0000 7f0149013640 -1 osd.5 0 log_to_monitors true 2024-09-21T03:18:13.994 INFO:tasks.ceph.osd.3.smithi105.stderr:2024-09-21T03:18:13.993+0000 7f5d30917640 -1 osd.3 0 log_to_monitors true 2024-09-21T03:18:14.036 INFO:tasks.ceph.osd.2.smithi105.stderr:2024-09-21T03:18:14.034+0000 7fefb6951640 -1 osd.2 0 log_to_monitors true 2024-09-21T03:18:14.038 INFO:tasks.ceph.osd.7.smithi162.stderr:2024-09-21T03:18:14.036+0000 7fd4c440d640 -1 osd.7 0 log_to_monitors true 2024-09-21T03:18:14.057 INFO:tasks.ceph.osd.6.smithi162.stderr:2024-09-21T03:18:14.055+0000 7f72dc42a640 -1 osd.6 0 log_to_monitors true 2024-09-21T03:18:14.243 INFO:tasks.ceph.osd.4.smithi162.stderr:2024-09-21T03:18:14.242+0000 7f6205ddd640 -1 osd.4 0 log_to_monitors true 2024-09-21T03:18:15.420 INFO:tasks.ceph.osd.0.smithi105.stderr:2024-09-21T03:18:15.419+0000 7ff36624a640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T03:18:15.490 INFO:tasks.ceph.osd.0.smithi105.stderr:2024-09-21T03:18:15.437+0000 7ff35e040640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:18:16.454 DEBUG:teuthology.orchestra.run.smithi105:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T03:18:16.592 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:16.591+0000 7f587e0c5640 1 -- 172.21.15.105:0/161016769 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58780cdc50 msgr2=0x7f5878071d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:16.593 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:16.591+0000 7f587e0c5640 1 --2- 172.21.15.105:0/161016769 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58780cdc50 0x7f5878071d60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5870009be0 tx=0x7f587002a920 comp rx=0 tx=0).stop 2024-09-21T03:18:16.593 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:16.591+0000 7f587e0c5640 1 -- 172.21.15.105:0/161016769 shutdown_connections 2024-09-21T03:18:16.593 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:16.591+0000 7f587e0c5640 1 --2- 172.21.15.105:0/161016769 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58780cdc50 0x7f5878071d60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:16.593 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:16.591+0000 7f587e0c5640 1 -- 172.21.15.105:0/161016769 >> 172.21.15.105:0/161016769 conn(0x7f58780d2480 msgr2=0x7f58780d2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:16.593 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:16.591+0000 7f587e0c5640 1 -- 172.21.15.105:0/161016769 shutdown_connections 2024-09-21T03:18:16.593 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:16.591+0000 7f587e0c5640 1 -- 172.21.15.105:0/161016769 wait complete. 2024-09-21T03:18:16.594 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:16.593+0000 7f587e0c5640 1 Processor -- start 2024-09-21T03:18:16.594 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:16.593+0000 7f587e0c5640 1 -- start start 2024-09-21T03:18:16.598 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:16.595+0000 7f587e0c5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58780b77b0 0x7f58781f9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:16.598 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:16.595+0000 7f587e0c5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58780cd840 0x7f5878153910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:16.598 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:16.595+0000 7f587e0c5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58780cdc50 0x7f58781674e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:16.598 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:16.595+0000 7f587e0c5640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f58780726b0 con 0x7f58780cdc50 2024-09-21T03:18:16.598 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:16.595+0000 7f587e0c5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5878072530 con 0x7f58780b77b0 2024-09-21T03:18:16.598 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:16.595+0000 7f587e0c5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5878072830 con 0x7f58780cd840 2024-09-21T03:18:16.598 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:16.595+0000 7f5877fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58780cdc50 0x7f58781674e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:16.598 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:16.595+0000 7f5877fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58780cdc50 0x7f58781674e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:48810/0 (socket says 172.21.15.105:48810) 2024-09-21T03:18:16.598 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:16.595+0000 7f5877fff640 1 -- 172.21.15.105:0/3857265151 learned_addr learned my addr 172.21.15.105:0/3857265151 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:16.598 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:16.595+0000 7f58777fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58780b77b0 0x7f58781f9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:16.598 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:16.595+0000 7f5876ffd640 1 --2- 172.21.15.105:0/3857265151 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58780cd840 0x7f5878153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:16.598 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:16.596+0000 7f58777fe640 1 -- 172.21.15.105:0/3857265151 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58780cd840 msgr2=0x7f5878153910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:16.599 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:16.596+0000 7f58777fe640 1 --2- 172.21.15.105:0/3857265151 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58780cd840 0x7f5878153910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:16.599 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:16.596+0000 7f58777fe640 1 -- 172.21.15.105:0/3857265151 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58780cdc50 msgr2=0x7f58781674e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:16.599 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:16.596+0000 7f58777fe640 1 --2- 172.21.15.105:0/3857265151 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58780cdc50 0x7f58781674e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:16.599 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:16.596+0000 7f58777fe640 1 -- 172.21.15.105:0/3857265151 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58781fa110 con 0x7f58780b77b0 2024-09-21T03:18:16.599 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:16.596+0000 7f5877fff640 1 --2- 172.21.15.105:0/3857265151 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58780cdc50 0x7f58781674e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:18:16.599 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:16.596+0000 7f58777fe640 1 --2- 172.21.15.105:0/3857265151 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58780b77b0 0x7f58781f9bd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f586800c390 tx=0x7f586800c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:16.645 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:16.643+0000 7f585ffff640 1 -- 172.21.15.105:0/3857265151 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5868017070 con 0x7f58780b77b0 2024-09-21T03:18:16.645 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:16.643+0000 7f585ffff640 1 -- 172.21.15.105:0/3857265151 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f58680053c0 con 0x7f58780b77b0 2024-09-21T03:18:16.645 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:16.643+0000 7f585ffff640 1 -- 172.21.15.105:0/3857265151 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58680038a0 con 0x7f58780b77b0 2024-09-21T03:18:16.645 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:16.643+0000 7f587e0c5640 1 -- 172.21.15.105:0/3857265151 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58780cc9c0 con 0x7f58780b77b0 2024-09-21T03:18:16.645 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:16.643+0000 7f587e0c5640 1 -- 172.21.15.105:0/3857265151 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58780caec0 con 0x7f58780b77b0 2024-09-21T03:18:16.647 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:16.645+0000 7f587e0c5640 1 -- 172.21.15.105:0/3857265151 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58780cd130 con 0x7f58780b77b0 2024-09-21T03:18:16.648 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:16.646+0000 7f585ffff640 1 -- 172.21.15.105:0/3857265151 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 4) ==== 101385+0+0 (secure 0 0 0) 0x7f586801a070 con 0x7f58780b77b0 2024-09-21T03:18:16.648 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:16.646+0000 7f585ffff640 1 --2- 172.21.15.105:0/3857265151 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5864078b00 0x7f586407b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:16.648 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:16.647+0000 7f585ffff640 1 -- 172.21.15.105:0/3857265151 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2511+0+0 (secure 0 0 0) 0x7f5868099330 con 0x7f58780b77b0 2024-09-21T03:18:16.648 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:16.647+0000 7f5876ffd640 1 --2- 172.21.15.105:0/3857265151 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5864078b00 0x7f586407b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:16.649 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:16.648+0000 7f5876ffd640 1 --2- 172.21.15.105:0/3857265151 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5864078b00 0x7f586407b010 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f586c007fd0 tx=0x7f586c007b00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:16.803 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:16.802+0000 7f585ffff640 1 -- 172.21.15.105:0/3857265151 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f58781fa110 con 0x7f58780b77b0 2024-09-21T03:18:17.124 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:17.122+0000 7f587e0c5640 1 -- 172.21.15.105:0/3857265151 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f58780d2d80 con 0x7f58780b77b0 2024-09-21T03:18:17.124 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:17.123+0000 7f585ffff640 1 -- 172.21.15.105:0/3857265151 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+7590 (secure 0 0 0) 0x7f5868061e70 con 0x7f58780b77b0 2024-09-21T03:18:17.125 INFO:teuthology.misc.health.smithi105.stdout: 2024-09-21T03:18:17.125 INFO:teuthology.misc.health.smithi105.stdout:{"epoch":14,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:18:16.615231+0000","last_up_change":"2024-09-21T03:18:15.529543+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:18:17.128 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:17.126+0000 7f587e0c5640 1 -- 172.21.15.105:0/3857265151 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5864078b00 msgr2=0x7f586407b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:17.128 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:17.126+0000 7f587e0c5640 1 --2- 172.21.15.105:0/3857265151 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5864078b00 0x7f586407b010 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f586c007fd0 tx=0x7f586c007b00 comp rx=0 tx=0).stop 2024-09-21T03:18:17.128 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:17.126+0000 7f587e0c5640 1 -- 172.21.15.105:0/3857265151 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58780b77b0 msgr2=0x7f58781f9bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:17.128 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:17.126+0000 7f587e0c5640 1 --2- 172.21.15.105:0/3857265151 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58780b77b0 0x7f58781f9bd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f586800c390 tx=0x7f586800c850 comp rx=0 tx=0).stop 2024-09-21T03:18:17.128 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:17.126+0000 7f587e0c5640 1 -- 172.21.15.105:0/3857265151 shutdown_connections 2024-09-21T03:18:17.128 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:17.126+0000 7f587e0c5640 1 --2- 172.21.15.105:0/3857265151 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5864078b00 0x7f586407b010 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:17.128 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:17.126+0000 7f587e0c5640 1 --2- 172.21.15.105:0/3857265151 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58780cdc50 0x7f58781674e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:17.128 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:17.126+0000 7f587e0c5640 1 --2- 172.21.15.105:0/3857265151 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58780cd840 0x7f5878153910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:17.128 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:17.126+0000 7f587e0c5640 1 --2- 172.21.15.105:0/3857265151 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58780b77b0 0x7f58781f9bd0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:17.128 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:17.126+0000 7f587e0c5640 1 -- 172.21.15.105:0/3857265151 >> 172.21.15.105:0/3857265151 conn(0x7f58780d2480 msgr2=0x7f5878160bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:17.128 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:17.126+0000 7f587e0c5640 1 -- 172.21.15.105:0/3857265151 shutdown_connections 2024-09-21T03:18:17.128 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:17.126+0000 7f587e0c5640 1 -- 172.21.15.105:0/3857265151 wait complete. 2024-09-21T03:18:17.142 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-21T03:18:17.255 INFO:tasks.ceph.osd.1.smithi105.stderr:2024-09-21T03:18:17.254+0000 7f13ad400640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T03:18:17.274 INFO:tasks.ceph.osd.1.smithi105.stderr:2024-09-21T03:18:17.273+0000 7f13a51f6640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:18:17.281 INFO:tasks.ceph.osd.2.smithi105.stderr:2024-09-21T03:18:17.280+0000 7fefb28df640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T03:18:17.292 INFO:tasks.ceph.osd.2.smithi105.stderr:2024-09-21T03:18:17.291+0000 7fefaa6d5640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:18:17.294 INFO:tasks.ceph.osd.3.smithi105.stderr:2024-09-21T03:18:17.293+0000 7f5d2d0ba640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T03:18:17.306 INFO:tasks.ceph.osd.3.smithi105.stderr:2024-09-21T03:18:17.305+0000 7f5d2469b640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:18:17.673 INFO:tasks.ceph.osd.7.smithi162.stderr:2024-09-21T03:18:17.671+0000 7fd4bfd1d640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T03:18:17.678 INFO:tasks.ceph.osd.4.smithi162.stderr:2024-09-21T03:18:17.677+0000 7f6201d6b640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T03:18:17.692 INFO:tasks.ceph.osd.4.smithi162.stderr:2024-09-21T03:18:17.691+0000 7f61f9b61640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:18:17.692 INFO:tasks.ceph.osd.7.smithi162.stderr:2024-09-21T03:18:17.691+0000 7fd4b7b13640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:18:17.694 INFO:tasks.ceph.osd.6.smithi162.stderr:2024-09-21T03:18:17.693+0000 7f72d83b8640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T03:18:17.710 INFO:tasks.ceph.osd.6.smithi162.stderr:2024-09-21T03:18:17.709+0000 7f72d01ae640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:18:17.717 INFO:tasks.ceph.osd.5.smithi162.stderr:2024-09-21T03:18:17.715+0000 7f0145109640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T03:18:17.727 INFO:tasks.ceph.osd.5.smithi162.stderr:2024-09-21T03:18:17.726+0000 7f013c6ea640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:18:23.948 DEBUG:teuthology.orchestra.run.smithi105:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T03:18:24.066 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.063+0000 7f0df4b2b640 1 -- 172.21.15.105:0/3426215385 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0df00b1710 msgr2=0x7f0df00b1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:24.066 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.063+0000 7f0df4b2b640 1 --2- 172.21.15.105:0/3426215385 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0df00b1710 0x7f0df00b1b20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0de8009860 tx=0x7f0de802a4b0 comp rx=0 tx=0).stop 2024-09-21T03:18:24.066 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.063+0000 7f0df4b2b640 1 -- 172.21.15.105:0/3426215385 shutdown_connections 2024-09-21T03:18:24.066 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.063+0000 7f0df4b2b640 1 --2- 172.21.15.105:0/3426215385 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0df00b1710 0x7f0df00b1b20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:24.066 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.063+0000 7f0df4b2b640 1 --2- 172.21.15.105:0/3426215385 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0df00b35d0 0x7f0df00b9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:24.066 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.063+0000 7f0df4b2b640 1 -- 172.21.15.105:0/3426215385 >> 172.21.15.105:0/3426215385 conn(0x7f0df00d4660 msgr2=0x7f0df00d4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:24.066 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.063+0000 7f0df4b2b640 1 -- 172.21.15.105:0/3426215385 shutdown_connections 2024-09-21T03:18:24.066 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.063+0000 7f0df4b2b640 1 -- 172.21.15.105:0/3426215385 wait complete. 2024-09-21T03:18:24.068 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.065+0000 7f0df4b2b640 1 Processor -- start 2024-09-21T03:18:24.068 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.065+0000 7f0df4b2b640 1 -- start start 2024-09-21T03:18:24.070 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.066+0000 7f0df4b2b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0df00b1710 0x7f0df01f60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:24.070 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.067+0000 7f0df4b2b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0df00b35d0 0x7f0df015eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:24.070 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.067+0000 7f0df4b2b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0df0162950 0x7f0df00b8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:24.070 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.067+0000 7f0df4b2b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0df00b21e0 con 0x7f0df0162950 2024-09-21T03:18:24.070 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.067+0000 7f0df4b2b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0df00b2060 con 0x7f0df00b1710 2024-09-21T03:18:24.071 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.067+0000 7f0df4b2b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0df00b2360 con 0x7f0df00b35d0 2024-09-21T03:18:24.071 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.067+0000 7f0deed9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0df0162950 0x7f0df00b8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:24.071 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.067+0000 7f0deed9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0df0162950 0x7f0df00b8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41108/0 (socket says 172.21.15.105:41108) 2024-09-21T03:18:24.071 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.067+0000 7f0deed9d640 1 -- 172.21.15.105:0/4015973803 learned_addr learned my addr 172.21.15.105:0/4015973803 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:24.071 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.067+0000 7f0dedd9b640 1 --2- 172.21.15.105:0/4015973803 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0df00b35d0 0x7f0df015eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:24.071 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.067+0000 7f0dee59c640 1 --2- 172.21.15.105:0/4015973803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0df00b1710 0x7f0df01f60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:24.071 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.067+0000 7f0deed9d640 1 -- 172.21.15.105:0/4015973803 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0df00b35d0 msgr2=0x7f0df015eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:24.071 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.067+0000 7f0deed9d640 1 --2- 172.21.15.105:0/4015973803 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0df00b35d0 0x7f0df015eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:24.071 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.067+0000 7f0deed9d640 1 -- 172.21.15.105:0/4015973803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0df00b1710 msgr2=0x7f0df01f60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:24.071 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.067+0000 7f0deed9d640 1 --2- 172.21.15.105:0/4015973803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0df00b1710 0x7f0df01f60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:24.071 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.067+0000 7f0deed9d640 1 -- 172.21.15.105:0/4015973803 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df00a05d0 con 0x7f0df0162950 2024-09-21T03:18:24.071 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.067+0000 7f0dee59c640 1 --2- 172.21.15.105:0/4015973803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0df00b1710 0x7f0df01f60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:18:24.071 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.067+0000 7f0dedd9b640 1 --2- 172.21.15.105:0/4015973803 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0df00b35d0 0x7f0df015eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:18:24.072 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.067+0000 7f0deed9d640 1 --2- 172.21.15.105:0/4015973803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0df0162950 0x7f0df00b8700 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0de8009950 tx=0x7f0de8033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:24.072 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.067+0000 7f0ddeffd640 1 -- 172.21.15.105:0/4015973803 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de8031d60 con 0x7f0df0162950 2024-09-21T03:18:24.072 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.067+0000 7f0ddeffd640 1 -- 172.21.15.105:0/4015973803 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0de8033e10 con 0x7f0df0162950 2024-09-21T03:18:24.072 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.067+0000 7f0df4b2b640 1 -- 172.21.15.105:0/4015973803 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0df00cbc80 con 0x7f0df0162950 2024-09-21T03:18:24.072 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.067+0000 7f0ddeffd640 1 -- 172.21.15.105:0/4015973803 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de8005260 con 0x7f0df0162950 2024-09-21T03:18:24.072 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.068+0000 7f0df4b2b640 1 -- 172.21.15.105:0/4015973803 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0df00cc240 con 0x7f0df0162950 2024-09-21T03:18:24.073 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.068+0000 7f0df4b2b640 1 -- 172.21.15.105:0/4015973803 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0df00b2860 con 0x7f0df0162950 2024-09-21T03:18:24.073 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.069+0000 7f0ddeffd640 1 -- 172.21.15.105:0/4015973803 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0de8005400 con 0x7f0df0162950 2024-09-21T03:18:24.073 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.070+0000 7f0ddeffd640 1 --2- 172.21.15.105:0/4015973803 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0dd0078b90 0x7f0dd007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:24.073 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.070+0000 7f0ddeffd640 1 -- 172.21.15.105:0/4015973803 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f0de80bbc90 con 0x7f0df0162950 2024-09-21T03:18:24.073 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.070+0000 7f0dee59c640 1 --2- 172.21.15.105:0/4015973803 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0dd0078b90 0x7f0dd007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:24.074 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.070+0000 7f0dee59c640 1 --2- 172.21.15.105:0/4015973803 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0dd0078b90 0x7f0dd007b0a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0de0005be0 tx=0x7f0de000a430 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:24.077 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.075+0000 7f0ddeffd640 1 -- 172.21.15.105:0/4015973803 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0de803f030 con 0x7f0df0162950 2024-09-21T03:18:24.254 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.251+0000 7f0df4b2b640 1 -- 172.21.15.105:0/4015973803 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0df00cba10 con 0x7f0df0162950 2024-09-21T03:18:24.254 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.252+0000 7f0ddeffd640 1 -- 172.21.15.105:0/4015973803 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12968 (secure 0 0 0) 0x7f0de8084420 con 0x7f0df0162950 2024-09-21T03:18:24.255 INFO:teuthology.misc.health.smithi105.stdout: 2024-09-21T03:18:24.255 INFO:teuthology.misc.health.smithi105.stdout:{"epoch":19,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:18:22.287133+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:18:24.257 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.254+0000 7f0df4b2b640 1 -- 172.21.15.105:0/4015973803 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0dd0078b90 msgr2=0x7f0dd007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:24.257 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.254+0000 7f0df4b2b640 1 --2- 172.21.15.105:0/4015973803 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0dd0078b90 0x7f0dd007b0a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0de0005be0 tx=0x7f0de000a430 comp rx=0 tx=0).stop 2024-09-21T03:18:24.257 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.254+0000 7f0df4b2b640 1 -- 172.21.15.105:0/4015973803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0df0162950 msgr2=0x7f0df00b8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:24.257 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.254+0000 7f0df4b2b640 1 --2- 172.21.15.105:0/4015973803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0df0162950 0x7f0df00b8700 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0de8009950 tx=0x7f0de8033c20 comp rx=0 tx=0).stop 2024-09-21T03:18:24.257 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.254+0000 7f0df4b2b640 1 -- 172.21.15.105:0/4015973803 shutdown_connections 2024-09-21T03:18:24.257 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.254+0000 7f0df4b2b640 1 --2- 172.21.15.105:0/4015973803 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0dd0078b90 0x7f0dd007b0a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:24.257 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.254+0000 7f0df4b2b640 1 --2- 172.21.15.105:0/4015973803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0df0162950 0x7f0df00b8700 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:24.257 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.254+0000 7f0df4b2b640 1 --2- 172.21.15.105:0/4015973803 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0df00b35d0 0x7f0df015eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:24.258 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.254+0000 7f0df4b2b640 1 --2- 172.21.15.105:0/4015973803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0df00b1710 0x7f0df01f60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:24.258 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.254+0000 7f0df4b2b640 1 -- 172.21.15.105:0/4015973803 >> 172.21.15.105:0/4015973803 conn(0x7f0df00d4660 msgr2=0x7f0df00b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:24.258 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.254+0000 7f0df4b2b640 1 -- 172.21.15.105:0/4015973803 shutdown_connections 2024-09-21T03:18:24.258 INFO:teuthology.misc.health.smithi105.stderr:2024-09-21T03:18:24.254+0000 7f0df4b2b640 1 -- 172.21.15.105:0/4015973803 wait complete. 2024-09-21T03:18:24.267 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-21T03:18:24.267 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-21T03:18:24.268 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T03:18:24.268 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T03:18:24.270 INFO:tasks.ceph.mds.a:Started 2024-09-21T03:18:24.270 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T03:18:24.270 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T03:18:24.272 INFO:tasks.ceph.mds.c:Started 2024-09-21T03:18:24.272 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T03:18:24.272 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T03:18:24.275 INFO:tasks.ceph.mds.b:Started 2024-09-21T03:18:24.275 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T03:18:24.275 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T03:18:24.277 INFO:tasks.ceph.mds.d:Started 2024-09-21T03:18:24.277 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-21T03:18:24.277 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:18:24.356 INFO:tasks.ceph.mds.c.smithi105.stdout:starting mds.c at 2024-09-21T03:18:24.356 INFO:tasks.ceph.mds.a.smithi105.stdout:starting mds.a at 2024-09-21T03:18:24.373 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-09-21T03:18:24.373 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-09-21T03:18:24.373 INFO:tasks.ceph.mds.b.smithi162.stderr:2024-09-21T03:18:24.372+0000 7f434e610640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-21T03:18:24.396 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.394+0000 7fc48b92b640 1 -- 172.21.15.105:0/1554416882 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4840d1ef0 msgr2=0x7fc4840b3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:24.397 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.394+0000 7fc48b92b640 1 --2- 172.21.15.105:0/1554416882 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4840d1ef0 0x7fc4840b3dc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc4840b1d30 tx=0x7fc48002a5f0 comp rx=0 tx=0).stop 2024-09-21T03:18:24.397 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.394+0000 7fc48b92b640 1 -- 172.21.15.105:0/1554416882 shutdown_connections 2024-09-21T03:18:24.397 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.394+0000 7fc48b92b640 1 --2- 172.21.15.105:0/1554416882 >> v2:172.21.15.162:3300/0 conn(0x7fc4840b4300 0x7fc4840b5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:24.397 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.394+0000 7fc48b92b640 1 --2- 172.21.15.105:0/1554416882 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4840d1ef0 0x7fc4840b3dc0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:24.397 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.394+0000 7fc48b92b640 1 -- 172.21.15.105:0/1554416882 >> 172.21.15.105:0/1554416882 conn(0x7fc4840cedc0 msgr2=0x7fc4840cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:24.397 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.394+0000 7fc48b92b640 1 -- 172.21.15.105:0/1554416882 shutdown_connections 2024-09-21T03:18:24.397 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.394+0000 7fc48b92b640 1 -- 172.21.15.105:0/1554416882 wait complete. 2024-09-21T03:18:24.398 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.396+0000 7fc48b92b640 1 Processor -- start 2024-09-21T03:18:24.398 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.396+0000 7fc48b92b640 1 -- start start 2024-09-21T03:18:24.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.397+0000 7fc48b92b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4840b4300 0x7fc484158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:24.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.397+0000 7fc48b92b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4840d1ef0 0x7fc48414e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:24.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.397+0000 7fc48b92b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc48415c880 0x7fc4840cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:24.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.397+0000 7fc48b92b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc4840b6630 con 0x7fc48415c880 2024-09-21T03:18:24.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.397+0000 7fc48b92b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc4840b64b0 con 0x7fc4840b4300 2024-09-21T03:18:24.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.397+0000 7fc48b92b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc4840b67b0 con 0x7fc4840d1ef0 2024-09-21T03:18:24.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.397+0000 7fc489ec8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc48415c880 0x7fc4840cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:24.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.397+0000 7fc489ec8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc48415c880 0x7fc4840cb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41168/0 (socket says 172.21.15.105:41168) 2024-09-21T03:18:24.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.397+0000 7fc489ec8640 1 -- 172.21.15.105:0/2991349643 learned_addr learned my addr 172.21.15.105:0/2991349643 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:24.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.397+0000 7fc4896c7640 1 --2- 172.21.15.105:0/2991349643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4840b4300 0x7fc484158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:24.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.397+0000 7fc488ec6640 1 --2- 172.21.15.105:0/2991349643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4840d1ef0 0x7fc48414e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:24.402 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.397+0000 7fc489ec8640 1 -- 172.21.15.105:0/2991349643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4840d1ef0 msgr2=0x7fc48414e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:24.402 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.397+0000 7fc489ec8640 1 --2- 172.21.15.105:0/2991349643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4840d1ef0 0x7fc48414e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:24.402 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.397+0000 7fc489ec8640 1 -- 172.21.15.105:0/2991349643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4840b4300 msgr2=0x7fc484158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:24.402 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.397+0000 7fc489ec8640 1 --2- 172.21.15.105:0/2991349643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4840b4300 0x7fc484158270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:24.402 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.397+0000 7fc489ec8640 1 -- 172.21.15.105:0/2991349643 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4841f3ab0 con 0x7fc48415c880 2024-09-21T03:18:24.402 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.398+0000 7fc489ec8640 1 --2- 172.21.15.105:0/2991349643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc48415c880 0x7fc4840cb5c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc47c00ea70 tx=0x7fc47c00ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:24.402 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.398+0000 7fc479ffb640 1 -- 172.21.15.105:0/2991349643 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc47c00ce40 con 0x7fc48415c880 2024-09-21T03:18:24.402 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.398+0000 7fc479ffb640 1 -- 172.21.15.105:0/2991349643 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc47c004c10 con 0x7fc48415c880 2024-09-21T03:18:24.402 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.398+0000 7fc479ffb640 1 -- 172.21.15.105:0/2991349643 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc47c005020 con 0x7fc48415c880 2024-09-21T03:18:24.402 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.398+0000 7fc48b92b640 1 -- 172.21.15.105:0/2991349643 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4841f3d90 con 0x7fc48415c880 2024-09-21T03:18:24.402 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.398+0000 7fc48b92b640 1 -- 172.21.15.105:0/2991349643 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4841f4350 con 0x7fc48415c880 2024-09-21T03:18:24.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.399+0000 7fc48b92b640 1 -- 172.21.15.105:0/2991349643 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4840b5970 con 0x7fc48415c880 2024-09-21T03:18:24.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.399+0000 7fc479ffb640 1 -- 172.21.15.105:0/2991349643 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc47c0051c0 con 0x7fc48415c880 2024-09-21T03:18:24.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.400+0000 7fc479ffb640 1 --2- 172.21.15.105:0/2991349643 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc468078b90 0x7fc46807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:24.404 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.400+0000 7fc4896c7640 1 --2- 172.21.15.105:0/2991349643 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc468078b90 0x7fc46807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:24.404 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.400+0000 7fc479ffb640 1 -- 172.21.15.105:0/2991349643 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fc47c09b5d0 con 0x7fc48415c880 2024-09-21T03:18:24.404 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.401+0000 7fc4896c7640 1 --2- 172.21.15.105:0/2991349643 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc468078b90 0x7fc46807b0a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc474001720 tx=0x7fc474009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:24.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.405+0000 7fc479ffb640 1 -- 172.21.15.105:0/2991349643 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc47c063830 con 0x7fc48415c880 2024-09-21T03:18:24.620 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.618+0000 7fc48b92b640 1 -- 172.21.15.105:0/2991349643 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4841587b0 con 0x7fc48415c880 2024-09-21T03:18:24.620 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.618+0000 7fc479ffb640 1 -- 172.21.15.105:0/2991349643 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7fc47c068260 con 0x7fc48415c880 2024-09-21T03:18:24.621 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:18:24.621 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":2,"btime":"2024-09-21T03:18:24:360254+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/950623322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":950623322},{"type":"v1","addr":"172.21.15.105:6833","nonce":950623322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T03:18:24.621 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 2 2024-09-21T03:18:24.624 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.621+0000 7fc48b92b640 1 -- 172.21.15.105:0/2991349643 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc468078b90 msgr2=0x7fc46807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:24.624 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.621+0000 7fc48b92b640 1 --2- 172.21.15.105:0/2991349643 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc468078b90 0x7fc46807b0a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc474001720 tx=0x7fc474009040 comp rx=0 tx=0).stop 2024-09-21T03:18:24.624 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.621+0000 7fc48b92b640 1 -- 172.21.15.105:0/2991349643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc48415c880 msgr2=0x7fc4840cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:24.624 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.621+0000 7fc48b92b640 1 --2- 172.21.15.105:0/2991349643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc48415c880 0x7fc4840cb5c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc47c00ea70 tx=0x7fc47c00ef30 comp rx=0 tx=0).stop 2024-09-21T03:18:24.624 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.621+0000 7fc48b92b640 1 -- 172.21.15.105:0/2991349643 shutdown_connections 2024-09-21T03:18:24.624 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.621+0000 7fc48b92b640 1 --2- 172.21.15.105:0/2991349643 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc468078b90 0x7fc46807b0a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:24.624 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.621+0000 7fc48b92b640 1 --2- 172.21.15.105:0/2991349643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc48415c880 0x7fc4840cb5c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:24.624 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.621+0000 7fc48b92b640 1 --2- 172.21.15.105:0/2991349643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4840d1ef0 0x7fc48414e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:24.624 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.621+0000 7fc48b92b640 1 --2- 172.21.15.105:0/2991349643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4840b4300 0x7fc484158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:24.624 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.621+0000 7fc48b92b640 1 -- 172.21.15.105:0/2991349643 >> 172.21.15.105:0/2991349643 conn(0x7fc4840cedc0 msgr2=0x7fc48415d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:24.624 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.621+0000 7fc48b92b640 1 -- 172.21.15.105:0/2991349643 shutdown_connections 2024-09-21T03:18:24.625 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:24.621+0000 7fc48b92b640 1 -- 172.21.15.105:0/2991349643 wait complete. 2024-09-21T03:18:25.752 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:18:25.756 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:18:26.635 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:18:26.760 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.757+0000 7f4ca6e30640 1 -- 172.21.15.105:0/286619802 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ca00b66b0 msgr2=0x7f4ca006eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:26.760 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.757+0000 7f4ca6e30640 1 --2- 172.21.15.105:0/286619802 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ca00b66b0 0x7f4ca006eab0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4c98005fd0 tx=0x7f4c9802a8e0 comp rx=0 tx=0).stop 2024-09-21T03:18:26.760 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.757+0000 7f4ca6e30640 1 -- 172.21.15.105:0/286619802 shutdown_connections 2024-09-21T03:18:26.760 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.757+0000 7f4ca6e30640 1 --2- 172.21.15.105:0/286619802 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ca00b66b0 0x7f4ca006eab0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:26.760 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.757+0000 7f4ca6e30640 1 --2- 172.21.15.105:0/286619802 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ca00b9b60 0x7f4ca00d4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:26.760 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.757+0000 7f4ca6e30640 1 -- 172.21.15.105:0/286619802 >> 172.21.15.105:0/286619802 conn(0x7f4ca009d7f0 msgr2=0x7f4ca00d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:26.760 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.757+0000 7f4ca6e30640 1 -- 172.21.15.105:0/286619802 shutdown_connections 2024-09-21T03:18:26.760 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.757+0000 7f4ca6e30640 1 -- 172.21.15.105:0/286619802 wait complete. 2024-09-21T03:18:26.761 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.759+0000 7f4ca6e30640 1 Processor -- start 2024-09-21T03:18:26.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.759+0000 7f4ca6e30640 1 -- start start 2024-09-21T03:18:26.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.760+0000 7f4ca6e30640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ca00b9b60 0x7f4ca0157cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:26.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.760+0000 7f4ca6e30640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ca00cf540 0x7f4ca00b7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:26.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.760+0000 7f4ca6e30640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ca015fc80 0x7f4ca00b8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:26.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.760+0000 7f4ca6e30640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca006f5d0 con 0x7f4ca00cf540 2024-09-21T03:18:26.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.760+0000 7f4ca6e30640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca006f450 con 0x7f4ca00b9b60 2024-09-21T03:18:26.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.760+0000 7f4ca6e30640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4ca006f750 con 0x7f4ca015fc80 2024-09-21T03:18:26.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.761+0000 7f4c9ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ca00cf540 0x7f4ca00b7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:26.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.761+0000 7f4c9ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ca00cf540 0x7f4ca00b7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41184/0 (socket says 172.21.15.105:41184) 2024-09-21T03:18:26.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.761+0000 7f4c9ffff640 1 -- 172.21.15.105:0/2800436136 learned_addr learned my addr 172.21.15.105:0/2800436136 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:26.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.761+0000 7f4ca53cd640 1 --2- 172.21.15.105:0/2800436136 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ca015fc80 0x7f4ca00b8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:26.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.761+0000 7f4c9ffff640 1 -- 172.21.15.105:0/2800436136 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ca015fc80 msgr2=0x7f4ca00b8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:26.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.761+0000 7f4ca4bcc640 1 --2- 172.21.15.105:0/2800436136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ca00b9b60 0x7f4ca0157cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:26.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.761+0000 7f4c9ffff640 1 --2- 172.21.15.105:0/2800436136 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ca015fc80 0x7f4ca00b8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:26.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.761+0000 7f4c9ffff640 1 -- 172.21.15.105:0/2800436136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ca00b9b60 msgr2=0x7f4ca0157cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:26.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.761+0000 7f4c9ffff640 1 --2- 172.21.15.105:0/2800436136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ca00b9b60 0x7f4ca0157cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:26.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.761+0000 7f4c9ffff640 1 -- 172.21.15.105:0/2800436136 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca00ce560 con 0x7f4ca00cf540 2024-09-21T03:18:26.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.761+0000 7f4ca4bcc640 1 --2- 172.21.15.105:0/2800436136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ca00b9b60 0x7f4ca0157cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:18:26.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.761+0000 7f4c9ffff640 1 --2- 172.21.15.105:0/2800436136 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ca00cf540 0x7f4ca00b7b30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c00b3f0 tx=0x7f4c8c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:26.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.761+0000 7f4c9d7fa640 1 -- 172.21.15.105:0/2800436136 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c015020 con 0x7f4ca00cf540 2024-09-21T03:18:26.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.761+0000 7f4c9d7fa640 1 -- 172.21.15.105:0/2800436136 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c8c011920 con 0x7f4ca00cf540 2024-09-21T03:18:26.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.761+0000 7f4ca6e30640 1 -- 172.21.15.105:0/2800436136 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ca00ce840 con 0x7f4ca00cf540 2024-09-21T03:18:26.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.761+0000 7f4c9d7fa640 1 -- 172.21.15.105:0/2800436136 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c011d70 con 0x7f4ca00cf540 2024-09-21T03:18:26.766 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.761+0000 7f4ca6e30640 1 -- 172.21.15.105:0/2800436136 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ca01f6240 con 0x7f4ca00cf540 2024-09-21T03:18:26.766 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.762+0000 7f4ca6e30640 1 -- 172.21.15.105:0/2800436136 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ca00761e0 con 0x7f4ca00cf540 2024-09-21T03:18:26.766 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.763+0000 7f4c9d7fa640 1 -- 172.21.15.105:0/2800436136 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4c8c018020 con 0x7f4ca00cf540 2024-09-21T03:18:26.766 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.763+0000 7f4c9d7fa640 1 --2- 172.21.15.105:0/2800436136 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4c84078b90 0x7f4c8407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:26.766 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.764+0000 7f4c9d7fa640 1 -- 172.21.15.105:0/2800436136 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f4c8c09a770 con 0x7f4ca00cf540 2024-09-21T03:18:26.767 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.764+0000 7f4ca4bcc640 1 --2- 172.21.15.105:0/2800436136 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4c84078b90 0x7f4c8407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:26.767 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.764+0000 7f4ca4bcc640 1 --2- 172.21.15.105:0/2800436136 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4c84078b90 0x7f4c8407b0a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4c94005fd0 tx=0x7f4c94005ce0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:26.771 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.768+0000 7f4c9d7fa640 1 -- 172.21.15.105:0/2800436136 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4ca00761e0 con 0x7f4ca00cf540 2024-09-21T03:18:26.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.983+0000 7f4ca6e30640 1 -- 172.21.15.105:0/2800436136 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ca006fc90 con 0x7f4ca00cf540 2024-09-21T03:18:26.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.983+0000 7f4c9d7fa640 1 -- 172.21.15.105:0/2800436136 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3909 (secure 0 0 0) 0x7f4c8c01f030 con 0x7f4ca00cf540 2024-09-21T03:18:26.986 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:18:26.986 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":3,"btime":"2024-09-21T03:18:25:361543+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/950623322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":950623322},{"type":"v1","addr":"172.21.15.105:6833","nonce":950623322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/982475612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":982475612},{"type":"v1","addr":"172.21.15.162:6837","nonce":982475612}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4389,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/940371702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":940371702},{"type":"v1","addr":"172.21.15.105:6835","nonce":940371702}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4401,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/1998709636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1998709636},{"type":"v1","addr":"172.21.15.162:6836","nonce":1998709636}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-21T03:18:26.986 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 3 2024-09-21T03:18:26.988 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.985+0000 7f4ca6e30640 1 -- 172.21.15.105:0/2800436136 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4c84078b90 msgr2=0x7f4c8407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:26.988 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.985+0000 7f4ca6e30640 1 --2- 172.21.15.105:0/2800436136 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4c84078b90 0x7f4c8407b0a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4c94005fd0 tx=0x7f4c94005ce0 comp rx=0 tx=0).stop 2024-09-21T03:18:26.989 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.985+0000 7f4ca6e30640 1 -- 172.21.15.105:0/2800436136 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ca00cf540 msgr2=0x7f4ca00b7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:26.989 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.985+0000 7f4ca6e30640 1 --2- 172.21.15.105:0/2800436136 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ca00cf540 0x7f4ca00b7b30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c00b3f0 tx=0x7f4c8c00b8b0 comp rx=0 tx=0).stop 2024-09-21T03:18:26.989 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.985+0000 7f4ca6e30640 1 -- 172.21.15.105:0/2800436136 shutdown_connections 2024-09-21T03:18:26.989 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.985+0000 7f4ca6e30640 1 --2- 172.21.15.105:0/2800436136 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4c84078b90 0x7f4c8407b0a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:26.989 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.985+0000 7f4ca6e30640 1 --2- 172.21.15.105:0/2800436136 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ca015fc80 0x7f4ca00b8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:26.989 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.985+0000 7f4ca6e30640 1 --2- 172.21.15.105:0/2800436136 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ca00cf540 0x7f4ca00b7b30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:26.989 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.985+0000 7f4ca6e30640 1 --2- 172.21.15.105:0/2800436136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ca00b9b60 0x7f4ca0157cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:26.989 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.985+0000 7f4ca6e30640 1 -- 172.21.15.105:0/2800436136 >> 172.21.15.105:0/2800436136 conn(0x7f4ca009d7f0 msgr2=0x7f4ca00b2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:26.989 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.985+0000 7f4ca6e30640 1 -- 172.21.15.105:0/2800436136 shutdown_connections 2024-09-21T03:18:26.989 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:26.985+0000 7f4ca6e30640 1 -- 172.21.15.105:0/2800436136 wait complete. 2024-09-21T03:18:26.999 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T03:18:27.110 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.108+0000 7fa46e6f9640 1 -- 172.21.15.105:0/1763420511 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa46815bf20 msgr2=0x7fa4680ca9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:27.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.108+0000 7fa46e6f9640 1 --2- 172.21.15.105:0/1763420511 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa46815bf20 0x7fa4680ca9a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa45c009830 tx=0x7fa45c02a510 comp rx=0 tx=0).stop 2024-09-21T03:18:27.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.108+0000 7fa46e6f9640 1 -- 172.21.15.105:0/1763420511 shutdown_connections 2024-09-21T03:18:27.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.108+0000 7fa46e6f9640 1 --2- 172.21.15.105:0/1763420511 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa46815bf20 0x7fa4680ca9a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:27.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.108+0000 7fa46e6f9640 1 -- 172.21.15.105:0/1763420511 >> 172.21.15.105:0/1763420511 conn(0x7fa4680b1cb0 msgr2=0x7fa4680b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:27.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.108+0000 7fa46e6f9640 1 -- 172.21.15.105:0/1763420511 shutdown_connections 2024-09-21T03:18:27.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.108+0000 7fa46e6f9640 1 -- 172.21.15.105:0/1763420511 wait complete. 2024-09-21T03:18:27.112 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.109+0000 7fa46e6f9640 1 Processor -- start 2024-09-21T03:18:27.112 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.110+0000 7fa46e6f9640 1 -- start start 2024-09-21T03:18:27.115 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.111+0000 7fa46e6f9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4680caee0 0x7fa46806ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:27.115 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.111+0000 7fa46e6f9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4680cfb00 0x7fa46806f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:27.115 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.111+0000 7fa46e6f9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa46815bf20 0x7fa4680acf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:27.115 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.111+0000 7fa46e6f9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa468070730 con 0x7fa4680cfb00 2024-09-21T03:18:27.115 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.111+0000 7fa46e6f9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa4680705b0 con 0x7fa4680caee0 2024-09-21T03:18:27.115 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.111+0000 7fa46e6f9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa4680708b0 con 0x7fa46815bf20 2024-09-21T03:18:27.115 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.111+0000 7fa4677fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4680cfb00 0x7fa46806f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:27.115 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.111+0000 7fa4677fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4680cfb00 0x7fa46806f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41204/0 (socket says 172.21.15.105:41204) 2024-09-21T03:18:27.115 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.111+0000 7fa4677fe640 1 -- 172.21.15.105:0/1864605272 learned_addr learned my addr 172.21.15.105:0/1864605272 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:27.116 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.111+0000 7fa46cc96640 1 --2- 172.21.15.105:0/1864605272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa46815bf20 0x7fa4680acf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:27.116 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.111+0000 7fa467fff640 1 --2- 172.21.15.105:0/1864605272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4680caee0 0x7fa46806ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:27.116 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.111+0000 7fa4677fe640 1 -- 172.21.15.105:0/1864605272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa46815bf20 msgr2=0x7fa4680acf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:27.116 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.111+0000 7fa4677fe640 1 --2- 172.21.15.105:0/1864605272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa46815bf20 0x7fa4680acf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:27.116 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.111+0000 7fa4677fe640 1 -- 172.21.15.105:0/1864605272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4680caee0 msgr2=0x7fa46806ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:27.116 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.111+0000 7fa4677fe640 1 --2- 172.21.15.105:0/1864605272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4680caee0 0x7fa46806ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:27.116 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.111+0000 7fa4677fe640 1 -- 172.21.15.105:0/1864605272 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4680ae6d0 con 0x7fa4680cfb00 2024-09-21T03:18:27.116 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.111+0000 7fa467fff640 1 --2- 172.21.15.105:0/1864605272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4680caee0 0x7fa46806ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:18:27.116 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.111+0000 7fa46cc96640 1 --2- 172.21.15.105:0/1864605272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa46815bf20 0x7fa4680acf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:18:27.116 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.111+0000 7fa4677fe640 1 --2- 172.21.15.105:0/1864605272 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4680cfb00 0x7fa46806f3d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa45c000c00 tx=0x7fa45c033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:27.116 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.112+0000 7fa464ff9640 1 -- 172.21.15.105:0/1864605272 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45c031d60 con 0x7fa4680cfb00 2024-09-21T03:18:27.116 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.112+0000 7fa464ff9640 1 -- 172.21.15.105:0/1864605272 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa45c0330d0 con 0x7fa4680cfb00 2024-09-21T03:18:27.116 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.112+0000 7fa464ff9640 1 -- 172.21.15.105:0/1864605272 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45c033520 con 0x7fa4680cfb00 2024-09-21T03:18:27.116 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.112+0000 7fa46e6f9640 1 -- 172.21.15.105:0/1864605272 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4680b1200 con 0x7fa4680cfb00 2024-09-21T03:18:27.117 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.112+0000 7fa46e6f9640 1 -- 172.21.15.105:0/1864605272 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4680c8150 con 0x7fa4680cfb00 2024-09-21T03:18:27.117 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.113+0000 7fa46e6f9640 1 -- 172.21.15.105:0/1864605272 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4680ca9a0 con 0x7fa4680cfb00 2024-09-21T03:18:27.117 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.113+0000 7fa464ff9640 1 -- 172.21.15.105:0/1864605272 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa45c0035f0 con 0x7fa4680cfb00 2024-09-21T03:18:27.117 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.114+0000 7fa464ff9640 1 --2- 172.21.15.105:0/1864605272 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa454078bc0 0x7fa45407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:27.117 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.114+0000 7fa464ff9640 1 -- 172.21.15.105:0/1864605272 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fa45c0bbee0 con 0x7fa4680cfb00 2024-09-21T03:18:27.118 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.114+0000 7fa467fff640 1 --2- 172.21.15.105:0/1864605272 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa454078bc0 0x7fa45407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:27.118 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.114+0000 7fa467fff640 1 --2- 172.21.15.105:0/1864605272 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa454078bc0 0x7fa45407b0d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa458000f60 tx=0x7fa458009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:27.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.118+0000 7fa464ff9640 1 -- 172.21.15.105:0/1864605272 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa45c03f030 con 0x7fa4680cfb00 2024-09-21T03:18:27.298 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.296+0000 7fa46e6f9640 1 -- 172.21.15.105:0/1864605272 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fa4680c9f50 con 0x7fa4680cfb00 2024-09-21T03:18:27.298 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.296+0000 7fa464ff9640 1 -- 172.21.15.105:0/1864605272 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) ==== 84+0+65 (secure 0 0 0) 0x7fa45c0840b0 con 0x7fa4680cfb00 2024-09-21T03:18:27.298 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:18:27.299 INFO:teuthology.orchestra.run.smithi105.stdout:[ 2024-09-21T03:18:27.299 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:18:27.299 INFO:teuthology.orchestra.run.smithi105.stdout: "poolnum": 1, 2024-09-21T03:18:27.299 INFO:teuthology.orchestra.run.smithi105.stdout: "poolname": ".mgr" 2024-09-21T03:18:27.299 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:18:27.299 INFO:teuthology.orchestra.run.smithi105.stdout:] 2024-09-21T03:18:27.301 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.298+0000 7fa46e6f9640 1 -- 172.21.15.105:0/1864605272 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa454078bc0 msgr2=0x7fa45407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:27.301 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.298+0000 7fa46e6f9640 1 --2- 172.21.15.105:0/1864605272 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa454078bc0 0x7fa45407b0d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa458000f60 tx=0x7fa458009040 comp rx=0 tx=0).stop 2024-09-21T03:18:27.301 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.298+0000 7fa46e6f9640 1 -- 172.21.15.105:0/1864605272 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4680cfb00 msgr2=0x7fa46806f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:27.301 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.298+0000 7fa46e6f9640 1 --2- 172.21.15.105:0/1864605272 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4680cfb00 0x7fa46806f3d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa45c000c00 tx=0x7fa45c033d60 comp rx=0 tx=0).stop 2024-09-21T03:18:27.301 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.298+0000 7fa46e6f9640 1 -- 172.21.15.105:0/1864605272 shutdown_connections 2024-09-21T03:18:27.301 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.298+0000 7fa46e6f9640 1 --2- 172.21.15.105:0/1864605272 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa454078bc0 0x7fa45407b0d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:27.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.298+0000 7fa46e6f9640 1 --2- 172.21.15.105:0/1864605272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa46815bf20 0x7fa4680acf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:27.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.298+0000 7fa46e6f9640 1 --2- 172.21.15.105:0/1864605272 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4680cfb00 0x7fa46806f3d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:27.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.298+0000 7fa46e6f9640 1 --2- 172.21.15.105:0/1864605272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4680caee0 0x7fa46806ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:27.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.298+0000 7fa46e6f9640 1 -- 172.21.15.105:0/1864605272 >> 172.21.15.105:0/1864605272 conn(0x7fa4680b1cb0 msgr2=0x7fa4680b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:27.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.298+0000 7fa46e6f9640 1 -- 172.21.15.105:0/1864605272 shutdown_connections 2024-09-21T03:18:27.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.298+0000 7fa46e6f9640 1 -- 172.21.15.105:0/1864605272 wait complete. 2024-09-21T03:18:27.311 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T03:18:27.312 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T03:18:27.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.427+0000 7f0f1b99b640 1 -- 172.21.15.105:0/4180830988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f00003fd0 msgr2=0x7f0f00004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:27.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.427+0000 7f0f1b99b640 1 --2- 172.21.15.105:0/4180830988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f00003fd0 0x7f0f00004800 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0f1408cef0 tx=0x7f0f00005830 comp rx=0 tx=0).stop 2024-09-21T03:18:27.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.427+0000 7f0f19f38640 1 -- 172.21.15.105:0/4180830988 reap_dead start 2024-09-21T03:18:27.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.427+0000 7f0f1b99b640 1 -- 172.21.15.105:0/4180830988 shutdown_connections 2024-09-21T03:18:27.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.427+0000 7f0f1b99b640 1 -- 172.21.15.105:0/4180830988 >> 172.21.15.105:0/4180830988 conn(0x7f0f1409d800 msgr2=0x7f0f1408bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:27.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.427+0000 7f0f1b99b640 1 -- 172.21.15.105:0/4180830988 shutdown_connections 2024-09-21T03:18:27.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.427+0000 7f0f1b99b640 1 -- 172.21.15.105:0/4180830988 wait complete. 2024-09-21T03:18:27.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.429+0000 7f0f1b99b640 1 Processor -- start 2024-09-21T03:18:27.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.429+0000 7f0f1b99b640 1 -- start start 2024-09-21T03:18:27.434 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.430+0000 7f0f1b99b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f00003fd0 0x7f0f141e3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:27.434 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.430+0000 7f0f1b99b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f141f6360 0x7f0f140cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:27.434 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.430+0000 7f0f1b99b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f140cbaf0 0x7f0f141f8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:27.434 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.430+0000 7f0f1b99b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0f140b6c00 con 0x7f0f140cbaf0 2024-09-21T03:18:27.434 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.430+0000 7f0f1b99b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0f140b6a80 con 0x7f0f141f6360 2024-09-21T03:18:27.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.430+0000 7f0f1b99b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0f140b6d80 con 0x7f0f00003fd0 2024-09-21T03:18:27.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.431+0000 7f0f19f38640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f140cbaf0 0x7f0f141f8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:27.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.431+0000 7f0f19f38640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f140cbaf0 0x7f0f141f8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41222/0 (socket says 172.21.15.105:41222) 2024-09-21T03:18:27.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.431+0000 7f0f19f38640 1 -- 172.21.15.105:0/3095558691 learned_addr learned my addr 172.21.15.105:0/3095558691 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:27.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.431+0000 7f0f18f36640 1 --2- 172.21.15.105:0/3095558691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f141f6360 0x7f0f140cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:27.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.431+0000 7f0f19737640 1 --2- 172.21.15.105:0/3095558691 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f00003fd0 0x7f0f141e3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:27.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.431+0000 7f0f19f38640 1 -- 172.21.15.105:0/3095558691 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f00003fd0 msgr2=0x7f0f141e3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:27.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.431+0000 7f0f19f38640 1 --2- 172.21.15.105:0/3095558691 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f00003fd0 0x7f0f141e3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:27.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.431+0000 7f0f19f38640 1 -- 172.21.15.105:0/3095558691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f141f6360 msgr2=0x7f0f140cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:27.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.431+0000 7f0f19f38640 1 --2- 172.21.15.105:0/3095558691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f141f6360 0x7f0f140cb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:27.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.431+0000 7f0f19f38640 1 -- 172.21.15.105:0/3095558691 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f140cbf00 con 0x7f0f140cbaf0 2024-09-21T03:18:27.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.431+0000 7f0f19f38640 1 --2- 172.21.15.105:0/3095558691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f140cbaf0 0x7f0f141f8ed0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0f140d2160 tx=0x7f0f0c0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:27.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.431+0000 7f0f09ffb640 1 -- 172.21.15.105:0/3095558691 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c011900 con 0x7f0f140cbaf0 2024-09-21T03:18:27.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.431+0000 7f0f09ffb640 1 -- 172.21.15.105:0/3095558691 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f0c018070 con 0x7f0f140cbaf0 2024-09-21T03:18:27.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.431+0000 7f0f09ffb640 1 -- 172.21.15.105:0/3095558691 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c011da0 con 0x7f0f140cbaf0 2024-09-21T03:18:27.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.431+0000 7f0f1b99b640 1 -- 172.21.15.105:0/3095558691 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f140cd730 con 0x7f0f140cbaf0 2024-09-21T03:18:27.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.431+0000 7f0f1b99b640 1 -- 172.21.15.105:0/3095558691 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f140cdf40 con 0x7f0f140cbaf0 2024-09-21T03:18:27.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.432+0000 7f0f1b99b640 1 -- 172.21.15.105:0/3095558691 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f140cd9d0 con 0x7f0f140cbaf0 2024-09-21T03:18:27.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.433+0000 7f0f09ffb640 1 -- 172.21.15.105:0/3095558691 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0f0c01d460 con 0x7f0f140cbaf0 2024-09-21T03:18:27.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.433+0000 7f0f09ffb640 1 --2- 172.21.15.105:0/3095558691 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0ef8078b90 0x7f0ef807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:27.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.433+0000 7f0f09ffb640 1 -- 172.21.15.105:0/3095558691 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f0f0c09b040 con 0x7f0f140cbaf0 2024-09-21T03:18:27.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.434+0000 7f0f19737640 1 --2- 172.21.15.105:0/3095558691 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0ef8078b90 0x7f0ef807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:27.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.434+0000 7f0f19737640 1 --2- 172.21.15.105:0/3095558691 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0ef8078b90 0x7f0ef807b0a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0f1408d450 tx=0x7f0f10009500 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:27.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.438+0000 7f0f09ffb640 1 -- 172.21.15.105:0/3095558691 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0f140cbf00 con 0x7f0f140cbaf0 2024-09-21T03:18:27.619 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:27.617+0000 7f0f1b99b640 1 -- 172.21.15.105:0/3095558691 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f0f140d1230 con 0x7f0f140cbaf0 2024-09-21T03:18:28.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.378+0000 7f0f09ffb640 1 -- 172.21.15.105:0/3095558691 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) ==== 138+0+0 (secure 0 0 0) 0x7f0f140d1770 con 0x7f0f140cbaf0 2024-09-21T03:18:28.381 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_metadata' created 2024-09-21T03:18:28.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.382+0000 7f0f1b99b640 1 -- 172.21.15.105:0/3095558691 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0ef8078b90 msgr2=0x7f0ef807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:28.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.382+0000 7f0f1b99b640 1 --2- 172.21.15.105:0/3095558691 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0ef8078b90 0x7f0ef807b0a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0f1408d450 tx=0x7f0f10009500 comp rx=0 tx=0).stop 2024-09-21T03:18:28.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.382+0000 7f0f1b99b640 1 -- 172.21.15.105:0/3095558691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f140cbaf0 msgr2=0x7f0f141f8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:28.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.382+0000 7f0f1b99b640 1 --2- 172.21.15.105:0/3095558691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f140cbaf0 0x7f0f141f8ed0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0f140d2160 tx=0x7f0f0c0039c0 comp rx=0 tx=0).stop 2024-09-21T03:18:28.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.383+0000 7f0f1b99b640 1 -- 172.21.15.105:0/3095558691 shutdown_connections 2024-09-21T03:18:28.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.383+0000 7f0f1b99b640 1 --2- 172.21.15.105:0/3095558691 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0ef8078b90 0x7f0ef807b0a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:28.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.383+0000 7f0f1b99b640 1 --2- 172.21.15.105:0/3095558691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f140cbaf0 0x7f0f141f8ed0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:28.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.383+0000 7f0f1b99b640 1 --2- 172.21.15.105:0/3095558691 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f141f6360 0x7f0f140cb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:28.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.383+0000 7f0f1b99b640 1 --2- 172.21.15.105:0/3095558691 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0f00003fd0 0x7f0f141e3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:28.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.383+0000 7f0f1b99b640 1 -- 172.21.15.105:0/3095558691 >> 172.21.15.105:0/3095558691 conn(0x7f0f1409d800 msgr2=0x7f0f140b45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:28.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.383+0000 7f0f1b99b640 1 -- 172.21.15.105:0/3095558691 shutdown_connections 2024-09-21T03:18:28.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.383+0000 7f0f1b99b640 1 -- 172.21.15.105:0/3095558691 wait complete. 2024-09-21T03:18:28.402 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T03:18:28.526 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.524+0000 7f90ad0ec640 1 -- 172.21.15.105:0/1511964707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90a8161020 msgr2=0x7f90a80ccb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:28.526 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.524+0000 7f90ad0ec640 1 --2- 172.21.15.105:0/1511964707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90a8161020 0x7f90a80ccb70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9098005fd0 tx=0x7f909802a5c0 comp rx=0 tx=0).stop 2024-09-21T03:18:28.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.524+0000 7f90ad0ec640 1 -- 172.21.15.105:0/1511964707 shutdown_connections 2024-09-21T03:18:28.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.524+0000 7f90ad0ec640 1 --2- 172.21.15.105:0/1511964707 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90a8156f10 0x7f90a815d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:28.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.524+0000 7f90ad0ec640 1 --2- 172.21.15.105:0/1511964707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90a8161020 0x7f90a80ccb70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:28.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.524+0000 7f90ad0ec640 1 -- 172.21.15.105:0/1511964707 >> 172.21.15.105:0/1511964707 conn(0x7f90a806d4f0 msgr2=0x7f90a8071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:28.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.524+0000 7f90ad0ec640 1 -- 172.21.15.105:0/1511964707 shutdown_connections 2024-09-21T03:18:28.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.524+0000 7f90ad0ec640 1 -- 172.21.15.105:0/1511964707 wait complete. 2024-09-21T03:18:28.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.526+0000 7f90ad0ec640 1 Processor -- start 2024-09-21T03:18:28.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.526+0000 7f90ad0ec640 1 -- start start 2024-09-21T03:18:28.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.527+0000 7f90ad0ec640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90a80cec50 0x7f90a8158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:28.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.527+0000 7f90ad0ec640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90a8156f10 0x7f90a80b5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:28.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.527+0000 7f90ad0ec640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90a8161020 0x7f90a814e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:28.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.527+0000 7f90ad0ec640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f90a80d08c0 con 0x7f90a8161020 2024-09-21T03:18:28.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.527+0000 7f90ad0ec640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f90a80d0740 con 0x7f90a80cec50 2024-09-21T03:18:28.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.527+0000 7f90ad0ec640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f90a80d0a40 con 0x7f90a8156f10 2024-09-21T03:18:28.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.527+0000 7f90a759e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90a8161020 0x7f90a814e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:28.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.527+0000 7f90a759e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90a8161020 0x7f90a814e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41250/0 (socket says 172.21.15.105:41250) 2024-09-21T03:18:28.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.527+0000 7f90a759e640 1 -- 172.21.15.105:0/468548161 learned_addr learned my addr 172.21.15.105:0/468548161 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:28.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.527+0000 7f90a6d9d640 1 --2- 172.21.15.105:0/468548161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90a80cec50 0x7f90a8158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:28.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.527+0000 7f90a659c640 1 --2- 172.21.15.105:0/468548161 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90a8156f10 0x7f90a80b5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:28.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.527+0000 7f90a759e640 1 -- 172.21.15.105:0/468548161 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90a8156f10 msgr2=0x7f90a80b5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:28.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.527+0000 7f90a759e640 1 --2- 172.21.15.105:0/468548161 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90a8156f10 0x7f90a80b5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:28.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.527+0000 7f90a759e640 1 -- 172.21.15.105:0/468548161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90a80cec50 msgr2=0x7f90a8158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:28.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.527+0000 7f90a759e640 1 --2- 172.21.15.105:0/468548161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90a80cec50 0x7f90a8158750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:28.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.527+0000 7f90a759e640 1 -- 172.21.15.105:0/468548161 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90a80b62c0 con 0x7f90a8161020 2024-09-21T03:18:28.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.528+0000 7f90a759e640 1 --2- 172.21.15.105:0/468548161 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90a8161020 0x7f90a814e290 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f90a000b9a0 tx=0x7f90a000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:28.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.528+0000 7f908f7fe640 1 -- 172.21.15.105:0/468548161 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a0019070 con 0x7f90a8161020 2024-09-21T03:18:28.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.528+0000 7f908f7fe640 1 -- 172.21.15.105:0/468548161 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f90a000cc90 con 0x7f90a8161020 2024-09-21T03:18:28.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.528+0000 7f908f7fe640 1 -- 172.21.15.105:0/468548161 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a00146a0 con 0x7f90a8161020 2024-09-21T03:18:28.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.528+0000 7f90ad0ec640 1 -- 172.21.15.105:0/468548161 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90a8157990 con 0x7f90a8161020 2024-09-21T03:18:28.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.528+0000 7f90ad0ec640 1 -- 172.21.15.105:0/468548161 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90a8157f50 con 0x7f90a8161020 2024-09-21T03:18:28.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.529+0000 7f90ad0ec640 1 -- 172.21.15.105:0/468548161 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90a815a500 con 0x7f90a8161020 2024-09-21T03:18:28.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.530+0000 7f908f7fe640 1 -- 172.21.15.105:0/468548161 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f90a001c070 con 0x7f90a8161020 2024-09-21T03:18:28.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.530+0000 7f908f7fe640 1 --2- 172.21.15.105:0/468548161 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9094078b90 0x7f909407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:28.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.530+0000 7f908f7fe640 1 -- 172.21.15.105:0/468548161 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5227+0+0 (secure 0 0 0) 0x7f90a009a720 con 0x7f90a8161020 2024-09-21T03:18:28.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.531+0000 7f90a6d9d640 1 --2- 172.21.15.105:0/468548161 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9094078b90 0x7f909407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:28.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.531+0000 7f90a6d9d640 1 --2- 172.21.15.105:0/468548161 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9094078b90 0x7f909407b0a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9098033000 tx=0x7f9098004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:28.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.535+0000 7f908f7fe640 1 -- 172.21.15.105:0/468548161 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f90a80b62c0 con 0x7f90a8161020 2024-09-21T03:18:28.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:28.714+0000 7f90ad0ec640 1 -- 172.21.15.105:0/468548161 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f90a80d1000 con 0x7f90a8161020 2024-09-21T03:18:29.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.383+0000 7f908f7fe640 1 -- 172.21.15.105:0/468548161 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) ==== 170+0+0 (secure 0 0 0) 0x7f90a00626f0 con 0x7f90a8161020 2024-09-21T03:18:29.386 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_data' created 2024-09-21T03:18:29.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.386+0000 7f90ad0ec640 1 -- 172.21.15.105:0/468548161 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9094078b90 msgr2=0x7f909407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:29.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.386+0000 7f90ad0ec640 1 --2- 172.21.15.105:0/468548161 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9094078b90 0x7f909407b0a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9098033000 tx=0x7f9098004730 comp rx=0 tx=0).stop 2024-09-21T03:18:29.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.386+0000 7f90ad0ec640 1 -- 172.21.15.105:0/468548161 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90a8161020 msgr2=0x7f90a814e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:29.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.386+0000 7f90ad0ec640 1 --2- 172.21.15.105:0/468548161 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90a8161020 0x7f90a814e290 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f90a000b9a0 tx=0x7f90a000be60 comp rx=0 tx=0).stop 2024-09-21T03:18:29.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.386+0000 7f90ad0ec640 1 -- 172.21.15.105:0/468548161 shutdown_connections 2024-09-21T03:18:29.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.386+0000 7f90ad0ec640 1 --2- 172.21.15.105:0/468548161 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9094078b90 0x7f909407b0a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:29.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.386+0000 7f90ad0ec640 1 --2- 172.21.15.105:0/468548161 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90a8161020 0x7f90a814e290 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:29.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.386+0000 7f90ad0ec640 1 --2- 172.21.15.105:0/468548161 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90a8156f10 0x7f90a80b5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:29.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.386+0000 7f90ad0ec640 1 --2- 172.21.15.105:0/468548161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90a80cec50 0x7f90a8158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:29.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.386+0000 7f90ad0ec640 1 -- 172.21.15.105:0/468548161 >> 172.21.15.105:0/468548161 conn(0x7f90a806d4f0 msgr2=0x7f90a815e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:29.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.386+0000 7f90ad0ec640 1 -- 172.21.15.105:0/468548161 shutdown_connections 2024-09-21T03:18:29.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.386+0000 7f90ad0ec640 1 -- 172.21.15.105:0/468548161 wait complete. 2024-09-21T03:18:29.415 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T03:18:29.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.530+0000 7fc5a79da640 1 -- 172.21.15.105:0/3258062609 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc58c003a30 msgr2=0x7fc58c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:29.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.530+0000 7fc5a79da640 1 --2- 172.21.15.105:0/3258062609 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc58c003a30 0x7fc58c003ea0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc59c0016c0 tx=0x7fc58c005830 comp rx=0 tx=0).stop 2024-09-21T03:18:29.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.530+0000 7fc5a5f77640 1 -- 172.21.15.105:0/3258062609 reap_dead start 2024-09-21T03:18:29.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.530+0000 7fc5a79da640 1 -- 172.21.15.105:0/3258062609 shutdown_connections 2024-09-21T03:18:29.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.530+0000 7fc5a79da640 1 -- 172.21.15.105:0/3258062609 >> 172.21.15.105:0/3258062609 conn(0x7fc5a006d5d0 msgr2=0x7fc5a0071110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:29.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.530+0000 7fc5a79da640 1 -- 172.21.15.105:0/3258062609 shutdown_connections 2024-09-21T03:18:29.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.530+0000 7fc5a79da640 1 -- 172.21.15.105:0/3258062609 wait complete. 2024-09-21T03:18:29.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.532+0000 7fc5a79da640 1 Processor -- start 2024-09-21T03:18:29.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.532+0000 7fc5a79da640 1 -- start start 2024-09-21T03:18:29.536 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.533+0000 7fc5a79da640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc58c003a30 0x7fc5a014c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:29.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.533+0000 7fc5a79da640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5a01555b0 0x7fc5a015eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:29.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.533+0000 7fc5a79da640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5a015f050 0x7fc5a00c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:29.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.533+0000 7fc5a79da640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a00d0ec0 con 0x7fc58c003a30 2024-09-21T03:18:29.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.533+0000 7fc5a79da640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a00d0d40 con 0x7fc5a015f050 2024-09-21T03:18:29.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.533+0000 7fc5a79da640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc5a00d1040 con 0x7fc5a01555b0 2024-09-21T03:18:29.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.533+0000 7fc5a5776640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc58c003a30 0x7fc5a014c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:29.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.533+0000 7fc5a5776640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc58c003a30 0x7fc5a014c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41268/0 (socket says 172.21.15.105:41268) 2024-09-21T03:18:29.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.533+0000 7fc5a5776640 1 -- 172.21.15.105:0/256855396 learned_addr learned my addr 172.21.15.105:0/256855396 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:29.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.533+0000 7fc5a5f77640 1 --2- 172.21.15.105:0/256855396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5a015f050 0x7fc5a00c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:29.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.533+0000 7fc5a4f75640 1 --2- 172.21.15.105:0/256855396 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5a01555b0 0x7fc5a015eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:29.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.533+0000 7fc5a5776640 1 -- 172.21.15.105:0/256855396 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5a01555b0 msgr2=0x7fc5a015eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:29.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.533+0000 7fc5a5776640 1 --2- 172.21.15.105:0/256855396 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5a01555b0 0x7fc5a015eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:29.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.533+0000 7fc5a5776640 1 -- 172.21.15.105:0/256855396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5a015f050 msgr2=0x7fc5a00c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:29.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.533+0000 7fc5a5776640 1 --2- 172.21.15.105:0/256855396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5a015f050 0x7fc5a00c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:29.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.533+0000 7fc5a5776640 1 -- 172.21.15.105:0/256855396 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5a00a97d0 con 0x7fc58c003a30 2024-09-21T03:18:29.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.533+0000 7fc5a5776640 1 --2- 172.21.15.105:0/256855396 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc58c003a30 0x7fc5a014c5f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc59c02a930 tx=0x7fc59c006360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:29.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.534+0000 7fc595ffb640 1 -- 172.21.15.105:0/256855396 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc59c038070 con 0x7fc58c003a30 2024-09-21T03:18:29.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.534+0000 7fc595ffb640 1 -- 172.21.15.105:0/256855396 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc59c003af0 con 0x7fc58c003a30 2024-09-21T03:18:29.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.534+0000 7fc595ffb640 1 -- 172.21.15.105:0/256855396 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc59c033420 con 0x7fc58c003a30 2024-09-21T03:18:29.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.534+0000 7fc5a79da640 1 -- 172.21.15.105:0/256855396 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5a015f460 con 0x7fc58c003a30 2024-09-21T03:18:29.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.534+0000 7fc5a79da640 1 -- 172.21.15.105:0/256855396 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5a01f7b60 con 0x7fc58c003a30 2024-09-21T03:18:29.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.535+0000 7fc5a79da640 1 -- 172.21.15.105:0/256855396 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5a00cf650 con 0x7fc58c003a30 2024-09-21T03:18:29.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.535+0000 7fc595ffb640 1 -- 172.21.15.105:0/256855396 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc59c043020 con 0x7fc58c003a30 2024-09-21T03:18:29.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.536+0000 7fc595ffb640 1 --2- 172.21.15.105:0/256855396 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc584078bc0 0x7fc58407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:29.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.536+0000 7fc595ffb640 1 -- 172.21.15.105:0/256855396 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5609+0+0 (secure 0 0 0) 0x7fc59c0ba600 con 0x7fc58c003a30 2024-09-21T03:18:29.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.536+0000 7fc5a4f75640 1 --2- 172.21.15.105:0/256855396 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc584078bc0 0x7fc58407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:29.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.537+0000 7fc5a4f75640 1 --2- 172.21.15.105:0/256855396 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc584078bc0 0x7fc58407b0d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc5900018c0 tx=0x7fc590001cf0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:29.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.541+0000 7fc595ffb640 1 -- 172.21.15.105:0/256855396 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc5a00cf650 con 0x7fc58c003a30 2024-09-21T03:18:29.756 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:29.754+0000 7fc5a79da640 1 -- 172.21.15.105:0/256855396 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fc5a00d15d0 con 0x7fc58c003a30 2024-09-21T03:18:30.397 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.395+0000 7fc595ffb640 1 -- 172.21.15.105:0/256855396 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fc5a015f460 con 0x7fc58c003a30 2024-09-21T03:18:30.400 INFO:teuthology.orchestra.run.smithi105.stderr:new fs with metadata pool 2 and data pool 3 2024-09-21T03:18:30.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.405+0000 7fc5a79da640 1 -- 172.21.15.105:0/256855396 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc584078bc0 msgr2=0x7fc58407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:30.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.405+0000 7fc5a79da640 1 --2- 172.21.15.105:0/256855396 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc584078bc0 0x7fc58407b0d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc5900018c0 tx=0x7fc590001cf0 comp rx=0 tx=0).stop 2024-09-21T03:18:30.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.405+0000 7fc5a79da640 1 -- 172.21.15.105:0/256855396 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc58c003a30 msgr2=0x7fc5a014c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:30.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.405+0000 7fc5a79da640 1 --2- 172.21.15.105:0/256855396 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc58c003a30 0x7fc5a014c5f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc59c02a930 tx=0x7fc59c006360 comp rx=0 tx=0).stop 2024-09-21T03:18:30.412 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.409+0000 7fc5a79da640 1 -- 172.21.15.105:0/256855396 shutdown_connections 2024-09-21T03:18:30.412 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.409+0000 7fc5a79da640 1 --2- 172.21.15.105:0/256855396 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc584078bc0 0x7fc58407b0d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:30.412 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.409+0000 7fc5a79da640 1 --2- 172.21.15.105:0/256855396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5a015f050 0x7fc5a00c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:30.412 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.409+0000 7fc5a79da640 1 --2- 172.21.15.105:0/256855396 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5a01555b0 0x7fc5a015eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:30.412 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.409+0000 7fc5a79da640 1 --2- 172.21.15.105:0/256855396 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc58c003a30 0x7fc5a014c5f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:30.412 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.409+0000 7fc5a79da640 1 -- 172.21.15.105:0/256855396 >> 172.21.15.105:0/256855396 conn(0x7fc5a006d5d0 msgr2=0x7fc5a015dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:30.415 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.412+0000 7fc5a79da640 1 -- 172.21.15.105:0/256855396 shutdown_connections 2024-09-21T03:18:30.415 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.413+0000 7fc5a79da640 1 -- 172.21.15.105:0/256855396 wait complete. 2024-09-21T03:18:30.432 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:18:30.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.544+0000 7fa57a3ba640 1 -- 172.21.15.105:0/687457208 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5740cf4c0 msgr2=0x7fa5740d4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:30.547 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.544+0000 7fa57a3ba640 1 --2- 172.21.15.105:0/687457208 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5740cf4c0 0x7fa5740d4a50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa5740cfc10 tx=0x7fa56c02a970 comp rx=0 tx=0).stop 2024-09-21T03:18:30.547 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.544+0000 7fa57a3ba640 1 -- 172.21.15.105:0/687457208 shutdown_connections 2024-09-21T03:18:30.547 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.544+0000 7fa57a3ba640 1 --2- 172.21.15.105:0/687457208 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5740cf4c0 0x7fa5740d4a50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:30.547 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.544+0000 7fa57a3ba640 1 --2- 172.21.15.105:0/687457208 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa5740cf0b0 0x7fa5740d4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:30.547 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.544+0000 7fa57a3ba640 1 --2- 172.21.15.105:0/687457208 >> v2:172.21.15.162:3300/0 conn(0x7fa5740d0ce0 0x7fa5740b9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:30.547 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.544+0000 7fa57a3ba640 1 -- 172.21.15.105:0/687457208 >> 172.21.15.105:0/687457208 conn(0x7fa57408bfc0 msgr2=0x7fa57409d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:30.547 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.544+0000 7fa57a3ba640 1 -- 172.21.15.105:0/687457208 shutdown_connections 2024-09-21T03:18:30.547 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.544+0000 7fa57a3ba640 1 -- 172.21.15.105:0/687457208 wait complete. 2024-09-21T03:18:30.548 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.546+0000 7fa57a3ba640 1 Processor -- start 2024-09-21T03:18:30.548 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.546+0000 7fa57a3ba640 1 -- start start 2024-09-21T03:18:30.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.547+0000 7fa57a3ba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5740cf0b0 0x7fa5740b2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:30.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.547+0000 7fa57a3ba640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5740cf4c0 0x7fa5740cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:30.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.547+0000 7fa57a3ba640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa5740d0ce0 0x7fa57406dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:30.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.547+0000 7fa57a3ba640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa5740d2cf0 con 0x7fa5740cf4c0 2024-09-21T03:18:30.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.547+0000 7fa57a3ba640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa5740d2b70 con 0x7fa5740cf0b0 2024-09-21T03:18:30.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.547+0000 7fa57a3ba640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa5740d2e70 con 0x7fa5740d0ce0 2024-09-21T03:18:30.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.547+0000 7fa5737fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5740cf4c0 0x7fa5740cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:30.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.547+0000 7fa5737fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5740cf4c0 0x7fa5740cd0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41294/0 (socket says 172.21.15.105:41294) 2024-09-21T03:18:30.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.547+0000 7fa5737fe640 1 -- 172.21.15.105:0/694214440 learned_addr learned my addr 172.21.15.105:0/694214440 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:30.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.547+0000 7fa573fff640 1 --2- 172.21.15.105:0/694214440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5740cf0b0 0x7fa5740b2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:30.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.547+0000 7fa578957640 1 --2- 172.21.15.105:0/694214440 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa5740d0ce0 0x7fa57406dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:30.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.547+0000 7fa5737fe640 1 -- 172.21.15.105:0/694214440 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa5740d0ce0 msgr2=0x7fa57406dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:30.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.547+0000 7fa5737fe640 1 --2- 172.21.15.105:0/694214440 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa5740d0ce0 0x7fa57406dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:30.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.547+0000 7fa5737fe640 1 -- 172.21.15.105:0/694214440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5740cf0b0 msgr2=0x7fa5740b2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:30.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.547+0000 7fa5737fe640 1 --2- 172.21.15.105:0/694214440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5740cf0b0 0x7fa5740b2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:30.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.547+0000 7fa5737fe640 1 -- 172.21.15.105:0/694214440 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5740b1320 con 0x7fa5740cf4c0 2024-09-21T03:18:30.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.548+0000 7fa5737fe640 1 --2- 172.21.15.105:0/694214440 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5740cf4c0 0x7fa5740cd0b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa56800d660 tx=0x7fa56800db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:30.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.548+0000 7fa570ff9640 1 -- 172.21.15.105:0/694214440 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa568017070 con 0x7fa5740cf4c0 2024-09-21T03:18:30.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.548+0000 7fa570ff9640 1 -- 172.21.15.105:0/694214440 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa568009b10 con 0x7fa5740cf4c0 2024-09-21T03:18:30.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.548+0000 7fa570ff9640 1 -- 172.21.15.105:0/694214440 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa568010460 con 0x7fa5740cf4c0 2024-09-21T03:18:30.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.548+0000 7fa57a3ba640 1 -- 172.21.15.105:0/694214440 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5740b1600 con 0x7fa5740cf4c0 2024-09-21T03:18:30.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.548+0000 7fa57a3ba640 1 -- 172.21.15.105:0/694214440 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5740b1bc0 con 0x7fa5740cf4c0 2024-09-21T03:18:30.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.549+0000 7fa57a3ba640 1 -- 172.21.15.105:0/694214440 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5740b9be0 con 0x7fa5740cf4c0 2024-09-21T03:18:30.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.549+0000 7fa570ff9640 1 -- 172.21.15.105:0/694214440 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa56801a070 con 0x7fa5740cf4c0 2024-09-21T03:18:30.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.550+0000 7fa570ff9640 1 --2- 172.21.15.105:0/694214440 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa560078b90 0x7fa56007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:30.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.550+0000 7fa570ff9640 1 -- 172.21.15.105:0/694214440 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fa56809acb0 con 0x7fa5740cf4c0 2024-09-21T03:18:30.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.550+0000 7fa573fff640 1 --2- 172.21.15.105:0/694214440 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa560078b90 0x7fa56007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:30.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.550+0000 7fa573fff640 1 --2- 172.21.15.105:0/694214440 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa560078b90 0x7fa56007b0a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa564004590 tx=0x7fa56400b390 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:30.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.554+0000 7fa570ff9640 1 -- 172.21.15.105:0/694214440 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa568062b30 con 0x7fa5740cf4c0 2024-09-21T03:18:30.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.733+0000 7fa57a3ba640 1 -- 172.21.15.105:0/694214440 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa5740b3040 con 0x7fa5740cf4c0 2024-09-21T03:18:30.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.734+0000 7fa570ff9640 1 -- 172.21.15.105:0/694214440 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16750 (secure 0 0 0) 0x7fa568067560 con 0x7fa5740cf4c0 2024-09-21T03:18:30.737 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:18:30.737 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":22,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:18:29.756644+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:18:27.622514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:18:28.719849+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:18:30.740 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.738+0000 7fa57a3ba640 1 -- 172.21.15.105:0/694214440 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa560078b90 msgr2=0x7fa56007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:30.740 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.738+0000 7fa57a3ba640 1 --2- 172.21.15.105:0/694214440 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa560078b90 0x7fa56007b0a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa564004590 tx=0x7fa56400b390 comp rx=0 tx=0).stop 2024-09-21T03:18:30.740 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.738+0000 7fa57a3ba640 1 -- 172.21.15.105:0/694214440 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5740cf4c0 msgr2=0x7fa5740cd0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:30.740 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.738+0000 7fa57a3ba640 1 --2- 172.21.15.105:0/694214440 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5740cf4c0 0x7fa5740cd0b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa56800d660 tx=0x7fa56800db20 comp rx=0 tx=0).stop 2024-09-21T03:18:30.740 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.738+0000 7fa57a3ba640 1 -- 172.21.15.105:0/694214440 shutdown_connections 2024-09-21T03:18:30.740 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.738+0000 7fa57a3ba640 1 --2- 172.21.15.105:0/694214440 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa560078b90 0x7fa56007b0a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:30.740 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.738+0000 7fa57a3ba640 1 --2- 172.21.15.105:0/694214440 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa5740d0ce0 0x7fa57406dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:30.740 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.738+0000 7fa57a3ba640 1 --2- 172.21.15.105:0/694214440 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5740cf4c0 0x7fa5740cd0b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:30.741 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.738+0000 7fa57a3ba640 1 --2- 172.21.15.105:0/694214440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5740cf0b0 0x7fa5740b2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:30.741 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.738+0000 7fa57a3ba640 1 -- 172.21.15.105:0/694214440 >> 172.21.15.105:0/694214440 conn(0x7fa57408bfc0 msgr2=0x7fa5740b4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:30.741 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.738+0000 7fa57a3ba640 1 -- 172.21.15.105:0/694214440 shutdown_connections 2024-09-21T03:18:30.741 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.738+0000 7fa57a3ba640 1 -- 172.21.15.105:0/694214440 wait complete. 2024-09-21T03:18:30.751 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:18:30.864 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.862+0000 7f741ffff640 1 -- 172.21.15.105:0/2481083393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f740c003a00 msgr2=0x7f740c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:30.864 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.862+0000 7f741ffff640 1 --2- 172.21.15.105:0/2481083393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f740c003a00 0x7f740c003e70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f741000c290 tx=0x7f740c005830 comp rx=0 tx=0).stop 2024-09-21T03:18:30.864 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.862+0000 7f741f7fe640 1 -- 172.21.15.105:0/2481083393 reap_dead start 2024-09-21T03:18:30.864 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.862+0000 7f741ffff640 1 -- 172.21.15.105:0/2481083393 shutdown_connections 2024-09-21T03:18:30.864 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.862+0000 7f741ffff640 1 -- 172.21.15.105:0/2481083393 >> 172.21.15.105:0/2481083393 conn(0x7f742009d6a0 msgr2=0x7f74200d4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:30.864 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.862+0000 7f741ffff640 1 -- 172.21.15.105:0/2481083393 shutdown_connections 2024-09-21T03:18:30.864 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.862+0000 7f741ffff640 1 -- 172.21.15.105:0/2481083393 wait complete. 2024-09-21T03:18:30.865 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.864+0000 7f741ffff640 1 Processor -- start 2024-09-21T03:18:30.865 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.864+0000 7f741ffff640 1 -- start start 2024-09-21T03:18:30.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.865+0000 7f741ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f740c003a00 0x7f74200ca240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:30.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.865+0000 7f741ffff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f74200cc430 0x7f74200ca780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:30.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.865+0000 7f741ffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74201f4100 0x7f74201f4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:30.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.865+0000 7f741ffff640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f74200d2990 con 0x7f740c003a00 2024-09-21T03:18:30.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.865+0000 7f741ffff640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f74200d2810 con 0x7f74201f4100 2024-09-21T03:18:30.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.865+0000 7f741ffff640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f74200d2b10 con 0x7f74200cc430 2024-09-21T03:18:30.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.865+0000 7f741effd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f740c003a00 0x7f74200ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:30.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.865+0000 7f741effd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f740c003a00 0x7f74200ca240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41312/0 (socket says 172.21.15.105:41312) 2024-09-21T03:18:30.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.866+0000 7f741effd640 1 -- 172.21.15.105:0/582556472 learned_addr learned my addr 172.21.15.105:0/582556472 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:30.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.866+0000 7f74167fc640 1 --2- 172.21.15.105:0/582556472 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f74200cc430 0x7f74200ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:30.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.866+0000 7f741f7fe640 1 --2- 172.21.15.105:0/582556472 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74201f4100 0x7f74201f4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:30.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.866+0000 7f741effd640 1 -- 172.21.15.105:0/582556472 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f74200cc430 msgr2=0x7f74200ca780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:30.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.866+0000 7f741effd640 1 --2- 172.21.15.105:0/582556472 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f74200cc430 0x7f74200ca780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:30.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.866+0000 7f741effd640 1 -- 172.21.15.105:0/582556472 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74201f4100 msgr2=0x7f74201f4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:30.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.866+0000 7f741effd640 1 --2- 172.21.15.105:0/582556472 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74201f4100 0x7f74201f4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:30.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.866+0000 7f741effd640 1 -- 172.21.15.105:0/582556472 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74200cacc0 con 0x7f740c003a00 2024-09-21T03:18:30.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.866+0000 7f741f7fe640 1 --2- 172.21.15.105:0/582556472 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74201f4100 0x7f74201f4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:18:30.870 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.866+0000 7f741effd640 1 --2- 172.21.15.105:0/582556472 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f740c003a00 0x7f74200ca240 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f741000c3b0 tx=0x7f7410006d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:30.870 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.866+0000 7f7417fff640 1 -- 172.21.15.105:0/582556472 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7410031040 con 0x7f740c003a00 2024-09-21T03:18:30.870 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.866+0000 7f7417fff640 1 -- 172.21.15.105:0/582556472 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74100035f0 con 0x7f740c003a00 2024-09-21T03:18:30.870 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.866+0000 7f7417fff640 1 -- 172.21.15.105:0/582556472 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7410003a00 con 0x7f740c003a00 2024-09-21T03:18:30.870 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.866+0000 7f741ffff640 1 -- 172.21.15.105:0/582556472 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74200ccb40 con 0x7f740c003a00 2024-09-21T03:18:30.870 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.866+0000 7f741ffff640 1 -- 172.21.15.105:0/582556472 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74200cd100 con 0x7f740c003a00 2024-09-21T03:18:30.871 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.867+0000 7f741ffff640 1 -- 172.21.15.105:0/582556472 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74200b7870 con 0x7f740c003a00 2024-09-21T03:18:30.871 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.868+0000 7f7417fff640 1 -- 172.21.15.105:0/582556472 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7410034070 con 0x7f740c003a00 2024-09-21T03:18:30.871 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.869+0000 7f7417fff640 1 --2- 172.21.15.105:0/582556472 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7400078bc0 0x7f740007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:30.871 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.869+0000 7f7417fff640 1 -- 172.21.15.105:0/582556472 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f74100bac80 con 0x7f740c003a00 2024-09-21T03:18:30.871 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.869+0000 7f74167fc640 1 --2- 172.21.15.105:0/582556472 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7400078bc0 0x7f740007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:30.871 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.869+0000 7f74167fc640 1 --2- 172.21.15.105:0/582556472 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7400078bc0 0x7f740007b0d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f74200a0be0 tx=0x7f7408005f30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:30.875 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:30.873+0000 7f7417fff640 1 -- 172.21.15.105:0/582556472 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f74100831e0 con 0x7f740c003a00 2024-09-21T03:18:31.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.051+0000 7f741ffff640 1 -- 172.21.15.105:0/582556472 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7420069f50 con 0x7f740c003a00 2024-09-21T03:18:31.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.052+0000 7f7417fff640 1 -- 172.21.15.105:0/582556472 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16750 (secure 0 0 0) 0x7f7410082ae0 con 0x7f740c003a00 2024-09-21T03:18:31.054 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:18:31.054 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":22,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:18:29.756644+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:18:27.622514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:18:28.719849+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:18:31.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.054+0000 7f741ffff640 1 -- 172.21.15.105:0/582556472 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7400078bc0 msgr2=0x7f740007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:31.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.054+0000 7f741ffff640 1 --2- 172.21.15.105:0/582556472 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7400078bc0 0x7f740007b0d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f74200a0be0 tx=0x7f7408005f30 comp rx=0 tx=0).stop 2024-09-21T03:18:31.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.054+0000 7f741ffff640 1 -- 172.21.15.105:0/582556472 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f740c003a00 msgr2=0x7f74200ca240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:31.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.054+0000 7f741ffff640 1 --2- 172.21.15.105:0/582556472 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f740c003a00 0x7f74200ca240 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f741000c3b0 tx=0x7f7410006d70 comp rx=0 tx=0).stop 2024-09-21T03:18:31.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.054+0000 7f741ffff640 1 -- 172.21.15.105:0/582556472 shutdown_connections 2024-09-21T03:18:31.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.054+0000 7f741ffff640 1 --2- 172.21.15.105:0/582556472 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7400078bc0 0x7f740007b0d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:31.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.054+0000 7f741ffff640 1 --2- 172.21.15.105:0/582556472 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74201f4100 0x7f74201f4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:31.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.054+0000 7f741ffff640 1 --2- 172.21.15.105:0/582556472 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f74200cc430 0x7f74200ca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:31.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.054+0000 7f741ffff640 1 --2- 172.21.15.105:0/582556472 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f740c003a00 0x7f74200ca240 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:31.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.054+0000 7f741ffff640 1 -- 172.21.15.105:0/582556472 >> 172.21.15.105:0/582556472 conn(0x7f742009d6a0 msgr2=0x7f74200d1080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:31.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.054+0000 7f741ffff640 1 -- 172.21.15.105:0/582556472 shutdown_connections 2024-09-21T03:18:31.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.054+0000 7f741ffff640 1 -- 172.21.15.105:0/582556472 wait complete. 2024-09-21T03:18:31.068 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T03:18:31.184 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.183+0000 7f84fac0a640 1 -- 172.21.15.105:0/1674576208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84f415c7a0 msgr2=0x7f84f40cf680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:31.185 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.183+0000 7f84fac0a640 1 --2- 172.21.15.105:0/1674576208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84f415c7a0 0x7f84f40cf680 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f84e4009830 tx=0x7f84e402a530 comp rx=0 tx=0).stop 2024-09-21T03:18:31.185 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.183+0000 7f84fac0a640 1 -- 172.21.15.105:0/1674576208 shutdown_connections 2024-09-21T03:18:31.185 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.183+0000 7f84fac0a640 1 --2- 172.21.15.105:0/1674576208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84f415c7a0 0x7f84f40cf680 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:31.185 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.183+0000 7f84fac0a640 1 -- 172.21.15.105:0/1674576208 >> 172.21.15.105:0/1674576208 conn(0x7f84f40b3f10 msgr2=0x7f84f40b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:31.185 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.183+0000 7f84fac0a640 1 -- 172.21.15.105:0/1674576208 shutdown_connections 2024-09-21T03:18:31.185 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.183+0000 7f84fac0a640 1 -- 172.21.15.105:0/1674576208 wait complete. 2024-09-21T03:18:31.186 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.184+0000 7f84fac0a640 1 Processor -- start 2024-09-21T03:18:31.186 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.184+0000 7f84fac0a640 1 -- start start 2024-09-21T03:18:31.188 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.186+0000 7f84fac0a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84f40ccbe0 0x7f84f414a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:31.188 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.186+0000 7f84fac0a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84f40d2310 0x7f84f40cc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:31.189 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.186+0000 7f84fac0a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84f415c7a0 0x7f84f41f5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:31.189 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.186+0000 7f84fac0a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f84f40d19f0 con 0x7f84f40ccbe0 2024-09-21T03:18:31.189 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.186+0000 7f84fac0a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f84f40d1870 con 0x7f84f40d2310 2024-09-21T03:18:31.189 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.186+0000 7f84fac0a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f84f40d1b70 con 0x7f84f415c7a0 2024-09-21T03:18:31.189 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.186+0000 7f84f89a6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84f40ccbe0 0x7f84f414a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:31.189 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.186+0000 7f84f89a6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84f40ccbe0 0x7f84f414a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41326/0 (socket says 172.21.15.105:41326) 2024-09-21T03:18:31.189 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.186+0000 7f84f89a6640 1 -- 172.21.15.105:0/4025068197 learned_addr learned my addr 172.21.15.105:0/4025068197 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:31.189 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.186+0000 7f84ebfff640 1 --2- 172.21.15.105:0/4025068197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84f40d2310 0x7f84f40cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:31.189 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.186+0000 7f84f91a7640 1 --2- 172.21.15.105:0/4025068197 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84f415c7a0 0x7f84f41f5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:31.189 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.186+0000 7f84f89a6640 1 -- 172.21.15.105:0/4025068197 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84f415c7a0 msgr2=0x7f84f41f5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:31.189 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.186+0000 7f84f89a6640 1 --2- 172.21.15.105:0/4025068197 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84f415c7a0 0x7f84f41f5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:31.189 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.186+0000 7f84f89a6640 1 -- 172.21.15.105:0/4025068197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84f40d2310 msgr2=0x7f84f40cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:31.189 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.186+0000 7f84f89a6640 1 --2- 172.21.15.105:0/4025068197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84f40d2310 0x7f84f40cc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:31.189 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.186+0000 7f84f89a6640 1 -- 172.21.15.105:0/4025068197 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84f414a990 con 0x7f84f40ccbe0 2024-09-21T03:18:31.189 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.187+0000 7f84f89a6640 1 --2- 172.21.15.105:0/4025068197 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84f40ccbe0 0x7f84f414a450 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f84f000c3a0 tx=0x7f84f000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:31.190 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.187+0000 7f84e97fa640 1 -- 172.21.15.105:0/4025068197 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f0017070 con 0x7f84f40ccbe0 2024-09-21T03:18:31.190 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.187+0000 7f84fac0a640 1 -- 172.21.15.105:0/4025068197 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84f414aea0 con 0x7f84f40ccbe0 2024-09-21T03:18:31.190 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.187+0000 7f84e97fa640 1 -- 172.21.15.105:0/4025068197 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f84f00053c0 con 0x7f84f40ccbe0 2024-09-21T03:18:31.190 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.187+0000 7f84e97fa640 1 -- 172.21.15.105:0/4025068197 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f0003850 con 0x7f84f40ccbe0 2024-09-21T03:18:31.190 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.187+0000 7f84fac0a640 1 -- 172.21.15.105:0/4025068197 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84f41f55f0 con 0x7f84f40ccbe0 2024-09-21T03:18:31.191 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.188+0000 7f84fac0a640 1 -- 172.21.15.105:0/4025068197 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84f40cf680 con 0x7f84f40ccbe0 2024-09-21T03:18:31.191 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.188+0000 7f84e97fa640 1 -- 172.21.15.105:0/4025068197 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f84f001a070 con 0x7f84f40ccbe0 2024-09-21T03:18:31.191 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.189+0000 7f84e97fa640 1 --2- 172.21.15.105:0/4025068197 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f84e0078b90 0x7f84e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:31.191 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.189+0000 7f84e97fa640 1 -- 172.21.15.105:0/4025068197 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f84f009a0d0 con 0x7f84f40ccbe0 2024-09-21T03:18:31.191 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.189+0000 7f84ebfff640 1 --2- 172.21.15.105:0/4025068197 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f84e0078b90 0x7f84e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:31.191 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.190+0000 7f84ebfff640 1 --2- 172.21.15.105:0/4025068197 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f84e0078b90 0x7f84e007b0a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f84e4034000 tx=0x7f84e4004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:31.195 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.193+0000 7f84e97fa640 1 -- 172.21.15.105:0/4025068197 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f84f0061e40 con 0x7f84f40ccbe0 2024-09-21T03:18:31.409 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:31.407+0000 7f84fac0a640 1 -- 172.21.15.105:0/4025068197 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f84f40cd5e0 con 0x7f84f40ccbe0 2024-09-21T03:18:32.413 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.411+0000 7f84e97fa640 1 -- 172.21.15.105:0/4025068197 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f84f0066870 con 0x7f84f40ccbe0 2024-09-21T03:18:32.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.414+0000 7f84fac0a640 1 -- 172.21.15.105:0/4025068197 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f84e0078b90 msgr2=0x7f84e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:32.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.414+0000 7f84fac0a640 1 --2- 172.21.15.105:0/4025068197 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f84e0078b90 0x7f84e007b0a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f84e4034000 tx=0x7f84e4004730 comp rx=0 tx=0).stop 2024-09-21T03:18:32.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.415+0000 7f84fac0a640 1 -- 172.21.15.105:0/4025068197 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84f40ccbe0 msgr2=0x7f84f414a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:32.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.415+0000 7f84fac0a640 1 --2- 172.21.15.105:0/4025068197 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84f40ccbe0 0x7f84f414a450 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f84f000c3a0 tx=0x7f84f000c860 comp rx=0 tx=0).stop 2024-09-21T03:18:32.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.415+0000 7f84fac0a640 1 -- 172.21.15.105:0/4025068197 shutdown_connections 2024-09-21T03:18:32.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.415+0000 7f84fac0a640 1 --2- 172.21.15.105:0/4025068197 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f84e0078b90 0x7f84e007b0a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:32.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.415+0000 7f84fac0a640 1 --2- 172.21.15.105:0/4025068197 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84f415c7a0 0x7f84f41f5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:32.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.415+0000 7f84fac0a640 1 --2- 172.21.15.105:0/4025068197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84f40d2310 0x7f84f40cc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:32.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.415+0000 7f84fac0a640 1 --2- 172.21.15.105:0/4025068197 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84f40ccbe0 0x7f84f414a450 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:32.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.415+0000 7f84fac0a640 1 -- 172.21.15.105:0/4025068197 >> 172.21.15.105:0/4025068197 conn(0x7f84f40b3f10 msgr2=0x7f84f415ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:32.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.415+0000 7f84fac0a640 1 -- 172.21.15.105:0/4025068197 shutdown_connections 2024-09-21T03:18:32.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.415+0000 7f84fac0a640 1 -- 172.21.15.105:0/4025068197 wait complete. 2024-09-21T03:18:32.428 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T03:18:32.428 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T03:18:32.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.543+0000 7f8cbbf13640 1 -- 172.21.15.105:0/2484729085 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c9c003c10 msgr2=0x7f8c9c004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:32.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.543+0000 7f8cbbf13640 1 --2- 172.21.15.105:0/2484729085 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c9c003c10 0x7f8c9c004060 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4009ec0 tx=0x7f8c9c005830 comp rx=0 tx=0).stop 2024-09-21T03:18:32.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.543+0000 7f8cba4b0640 1 -- 172.21.15.105:0/2484729085 reap_dead start 2024-09-21T03:18:32.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.543+0000 7f8cbbf13640 1 -- 172.21.15.105:0/2484729085 shutdown_connections 2024-09-21T03:18:32.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.543+0000 7f8cbbf13640 1 -- 172.21.15.105:0/2484729085 >> 172.21.15.105:0/2484729085 conn(0x7f8cb409d830 msgr2=0x7f8cb40d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:32.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.543+0000 7f8cbbf13640 1 -- 172.21.15.105:0/2484729085 shutdown_connections 2024-09-21T03:18:32.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.544+0000 7f8cbbf13640 1 -- 172.21.15.105:0/2484729085 wait complete. 2024-09-21T03:18:32.547 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.545+0000 7f8cbbf13640 1 Processor -- start 2024-09-21T03:18:32.547 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.545+0000 7f8cbbf13640 1 -- start start 2024-09-21T03:18:32.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.546+0000 7f8cbbf13640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c9c003c10 0x7f8cb41f5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:32.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.547+0000 7f8cbbf13640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8cb4160010 0x7f8cb40cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:32.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.547+0000 7f8cbbf13640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8cb40cdee0 0x7f8cb415c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:32.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.547+0000 7f8cbbf13640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb406dea0 con 0x7f8c9c003c10 2024-09-21T03:18:32.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.547+0000 7f8cbbf13640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb40cfed0 con 0x7f8cb40cdee0 2024-09-21T03:18:32.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.547+0000 7f8cbbf13640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8cb406e020 con 0x7f8cb4160010 2024-09-21T03:18:32.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.547+0000 7f8cb9caf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c9c003c10 0x7f8cb41f5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:32.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.547+0000 7f8cb9caf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c9c003c10 0x7f8cb41f5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56320/0 (socket says 172.21.15.105:56320) 2024-09-21T03:18:32.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.547+0000 7f8cb9caf640 1 -- 172.21.15.105:0/3725487457 learned_addr learned my addr 172.21.15.105:0/3725487457 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:32.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.547+0000 7f8cb94ae640 1 --2- 172.21.15.105:0/3725487457 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8cb4160010 0x7f8cb40cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:32.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.547+0000 7f8cba4b0640 1 --2- 172.21.15.105:0/3725487457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8cb40cdee0 0x7f8cb415c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:32.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.547+0000 7f8cb9caf640 1 -- 172.21.15.105:0/3725487457 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8cb4160010 msgr2=0x7f8cb40cd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:32.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.547+0000 7f8cb9caf640 1 --2- 172.21.15.105:0/3725487457 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8cb4160010 0x7f8cb40cd9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:32.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.547+0000 7f8cb9caf640 1 -- 172.21.15.105:0/3725487457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8cb40cdee0 msgr2=0x7f8cb415c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:32.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.547+0000 7f8cb9caf640 1 --2- 172.21.15.105:0/3725487457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8cb40cdee0 0x7f8cb415c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:32.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.547+0000 7f8cb9caf640 1 -- 172.21.15.105:0/3725487457 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb40b1330 con 0x7f8c9c003c10 2024-09-21T03:18:32.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.547+0000 7f8cba4b0640 1 --2- 172.21.15.105:0/3725487457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8cb40cdee0 0x7f8cb415c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:18:32.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.547+0000 7f8cb9caf640 1 --2- 172.21.15.105:0/3725487457 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c9c003c10 0x7f8cb41f5f80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4009ec0 tx=0x7f8ca4033cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:32.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.547+0000 7f8cb27fc640 1 -- 172.21.15.105:0/3725487457 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4043070 con 0x7f8c9c003c10 2024-09-21T03:18:32.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.547+0000 7f8cb27fc640 1 -- 172.21.15.105:0/3725487457 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ca4003970 con 0x7f8c9c003c10 2024-09-21T03:18:32.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.547+0000 7f8cbbf13640 1 -- 172.21.15.105:0/3725487457 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cb40b15d0 con 0x7f8c9c003c10 2024-09-21T03:18:32.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.547+0000 7f8cb27fc640 1 -- 172.21.15.105:0/3725487457 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4038040 con 0x7f8c9c003c10 2024-09-21T03:18:32.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.547+0000 7f8cbbf13640 1 -- 172.21.15.105:0/3725487457 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cb4160420 con 0x7f8c9c003c10 2024-09-21T03:18:32.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.548+0000 7f8cbbf13640 1 -- 172.21.15.105:0/3725487457 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cb40b32e0 con 0x7f8c9c003c10 2024-09-21T03:18:32.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.549+0000 7f8cb27fc640 1 -- 172.21.15.105:0/3725487457 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8ca4046070 con 0x7f8c9c003c10 2024-09-21T03:18:32.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.549+0000 7f8cb27fc640 1 --2- 172.21.15.105:0/3725487457 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8ca0078b90 0x7f8ca007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:32.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.550+0000 7f8cb27fc640 1 -- 172.21.15.105:0/3725487457 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f8ca40bb770 con 0x7f8c9c003c10 2024-09-21T03:18:32.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.550+0000 7f8cb94ae640 1 --2- 172.21.15.105:0/3725487457 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8ca0078b90 0x7f8ca007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:32.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.550+0000 7f8cb94ae640 1 --2- 172.21.15.105:0/3725487457 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8ca0078b90 0x7f8ca007b0a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8001860 tx=0x7f8ca8001110 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:32.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.554+0000 7f8cb27fc640 1 -- 172.21.15.105:0/3725487457 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8ca4083560 con 0x7f8c9c003c10 2024-09-21T03:18:32.768 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:32.766+0000 7f8cbbf13640 1 -- 172.21.15.105:0/3725487457 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f8cb40d31e0 con 0x7f8c9c003c10 2024-09-21T03:18:33.418 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.416+0000 7f8cb27fc640 1 -- 172.21.15.105:0/3725487457 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f8ca4087f90 con 0x7f8c9c003c10 2024-09-21T03:18:33.420 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.419+0000 7f8cbbf13640 1 -- 172.21.15.105:0/3725487457 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8ca0078b90 msgr2=0x7f8ca007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:33.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.419+0000 7f8cbbf13640 1 --2- 172.21.15.105:0/3725487457 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8ca0078b90 0x7f8ca007b0a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8001860 tx=0x7f8ca8001110 comp rx=0 tx=0).stop 2024-09-21T03:18:33.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.419+0000 7f8cbbf13640 1 -- 172.21.15.105:0/3725487457 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c9c003c10 msgr2=0x7f8cb41f5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:33.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.419+0000 7f8cbbf13640 1 --2- 172.21.15.105:0/3725487457 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c9c003c10 0x7f8cb41f5f80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4009ec0 tx=0x7f8ca4033cb0 comp rx=0 tx=0).stop 2024-09-21T03:18:33.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.419+0000 7f8cbbf13640 1 -- 172.21.15.105:0/3725487457 shutdown_connections 2024-09-21T03:18:33.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.419+0000 7f8cbbf13640 1 --2- 172.21.15.105:0/3725487457 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8ca0078b90 0x7f8ca007b0a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:33.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.419+0000 7f8cbbf13640 1 --2- 172.21.15.105:0/3725487457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8cb40cdee0 0x7f8cb415c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:33.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.419+0000 7f8cbbf13640 1 --2- 172.21.15.105:0/3725487457 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8cb4160010 0x7f8cb40cd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:33.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.419+0000 7f8cbbf13640 1 --2- 172.21.15.105:0/3725487457 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c9c003c10 0x7f8cb41f5f80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:33.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.419+0000 7f8cbbf13640 1 -- 172.21.15.105:0/3725487457 >> 172.21.15.105:0/3725487457 conn(0x7f8cb409d830 msgr2=0x7f8cb40d0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:33.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.419+0000 7f8cbbf13640 1 -- 172.21.15.105:0/3725487457 shutdown_connections 2024-09-21T03:18:33.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.419+0000 7f8cbbf13640 1 -- 172.21.15.105:0/3725487457 wait complete. 2024-09-21T03:18:33.433 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T03:18:33.433 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:18:33.548 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.546+0000 7fd0545f1640 1 -- 172.21.15.105:0/1858881883 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd04c145f90 msgr2=0x7fd04c06cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:33.548 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.546+0000 7fd0545f1640 1 --2- 172.21.15.105:0/1858881883 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd04c145f90 0x7fd04c06cde0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd03c005fd0 tx=0x7fd03c02a820 comp rx=0 tx=0).stop 2024-09-21T03:18:33.548 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.546+0000 7fd0545f1640 1 -- 172.21.15.105:0/1858881883 shutdown_connections 2024-09-21T03:18:33.548 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.546+0000 7fd0545f1640 1 --2- 172.21.15.105:0/1858881883 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd04c06d320 0x7fd04c0d02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:33.548 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.546+0000 7fd0545f1640 1 --2- 172.21.15.105:0/1858881883 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd04c145f90 0x7fd04c06cde0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:33.548 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.546+0000 7fd0545f1640 1 -- 172.21.15.105:0/1858881883 >> 172.21.15.105:0/1858881883 conn(0x7fd04c0b2e10 msgr2=0x7fd04c0b3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:33.548 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.546+0000 7fd0545f1640 1 -- 172.21.15.105:0/1858881883 shutdown_connections 2024-09-21T03:18:33.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.546+0000 7fd0545f1640 1 -- 172.21.15.105:0/1858881883 wait complete. 2024-09-21T03:18:33.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.548+0000 7fd0545f1640 1 Processor -- start 2024-09-21T03:18:33.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.548+0000 7fd0545f1640 1 -- start start 2024-09-21T03:18:33.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.549+0000 7fd0545f1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd04c06d320 0x7fd04c1e5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:33.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.549+0000 7fd0545f1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd04c0d07f0 0x7fd04c1f4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:33.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.549+0000 7fd0545f1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd04c145f90 0x7fd04c1f0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:33.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.549+0000 7fd0545f1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd04c1609b0 con 0x7fd04c0d07f0 2024-09-21T03:18:33.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.549+0000 7fd0545f1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd04c0d0e10 con 0x7fd04c145f90 2024-09-21T03:18:33.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.549+0000 7fd0545f1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd04c160b30 con 0x7fd04c06d320 2024-09-21T03:18:33.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.549+0000 7fd051b8c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd04c0d07f0 0x7fd04c1f4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:33.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.549+0000 7fd051b8c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd04c0d07f0 0x7fd04c1f4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56336/0 (socket says 172.21.15.105:56336) 2024-09-21T03:18:33.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.549+0000 7fd051b8c640 1 -- 172.21.15.105:0/3199605916 learned_addr learned my addr 172.21.15.105:0/3199605916 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:33.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.550+0000 7fd051b8c640 1 -- 172.21.15.105:0/3199605916 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd04c06d320 msgr2=0x7fd04c1e5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:33.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.550+0000 7fd051b8c640 1 --2- 172.21.15.105:0/3199605916 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd04c06d320 0x7fd04c1e5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:33.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.550+0000 7fd051b8c640 1 -- 172.21.15.105:0/3199605916 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd04c145f90 msgr2=0x7fd04c1f0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:33.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.550+0000 7fd051b8c640 1 --2- 172.21.15.105:0/3199605916 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd04c145f90 0x7fd04c1f0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:33.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.550+0000 7fd051b8c640 1 -- 172.21.15.105:0/3199605916 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd04c1e66d0 con 0x7fd04c0d07f0 2024-09-21T03:18:33.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.550+0000 7fd051b8c640 1 --2- 172.21.15.105:0/3199605916 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd04c0d07f0 0x7fd04c1f4270 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd04000e7c0 tx=0x7fd04000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:33.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.550+0000 7fd04affd640 1 -- 172.21.15.105:0/3199605916 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04000ccc0 con 0x7fd04c0d07f0 2024-09-21T03:18:33.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.550+0000 7fd04affd640 1 -- 172.21.15.105:0/3199605916 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd04000ce60 con 0x7fd04c0d07f0 2024-09-21T03:18:33.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.550+0000 7fd0545f1640 1 -- 172.21.15.105:0/3199605916 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd04c1e69b0 con 0x7fd04c0d07f0 2024-09-21T03:18:33.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.550+0000 7fd04affd640 1 -- 172.21.15.105:0/3199605916 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd040005280 con 0x7fd04c0d07f0 2024-09-21T03:18:33.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.550+0000 7fd0545f1640 1 -- 172.21.15.105:0/3199605916 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd04c1e6f70 con 0x7fd04c0d07f0 2024-09-21T03:18:33.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.551+0000 7fd0545f1640 1 -- 172.21.15.105:0/3199605916 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd04c1e6420 con 0x7fd04c0d07f0 2024-09-21T03:18:33.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.552+0000 7fd04affd640 1 -- 172.21.15.105:0/3199605916 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd040005420 con 0x7fd04c0d07f0 2024-09-21T03:18:33.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.552+0000 7fd04affd640 1 --2- 172.21.15.105:0/3199605916 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd038078b90 0x7fd03807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:33.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.552+0000 7fd04affd640 1 -- 172.21.15.105:0/3199605916 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd04009b6b0 con 0x7fd04c0d07f0 2024-09-21T03:18:33.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.552+0000 7fd05238d640 1 --2- 172.21.15.105:0/3199605916 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd038078b90 0x7fd03807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:33.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.553+0000 7fd05238d640 1 --2- 172.21.15.105:0/3199605916 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd038078b90 0x7fd03807b0a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd03c034000 tx=0x7fd03c004a40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:33.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.557+0000 7fd04affd640 1 -- 172.21.15.105:0/3199605916 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd040063af0 con 0x7fd04c0d07f0 2024-09-21T03:18:33.772 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.771+0000 7fd0545f1640 1 -- 172.21.15.105:0/3199605916 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd04c1f4a20 con 0x7fd04c0d07f0 2024-09-21T03:18:33.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.771+0000 7fd04affd640 1 -- 172.21.15.105:0/3199605916 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5220 (secure 0 0 0) 0x7fd0400633f0 con 0x7fd04c0d07f0 2024-09-21T03:18:33.773 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:18:33.773 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":8,"btime":"2024-09-21T03:18:33:412826+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/950623322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":950623322},{"type":"v1","addr":"172.21.15.105:6833","nonce":950623322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/982475612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":982475612},{"type":"v1","addr":"172.21.15.162:6837","nonce":982475612}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4389,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/940371702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":940371702},{"type":"v1","addr":"172.21.15.105:6835","nonce":940371702}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:18:29.756592+0000","modified":"2024-09-21T03:18:32.767916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4401},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4401":{"gid":4401,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6836/1998709636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1998709636},{"type":"v1","addr":"172.21.15.162:6836","nonce":1998709636}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4401,"qdb_cluster":[4401]},"id":1}]} 2024-09-21T03:18:33.773 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 8 2024-09-21T03:18:33.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.773+0000 7fd0545f1640 1 -- 172.21.15.105:0/3199605916 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd038078b90 msgr2=0x7fd03807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:33.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.773+0000 7fd0545f1640 1 --2- 172.21.15.105:0/3199605916 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd038078b90 0x7fd03807b0a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd03c034000 tx=0x7fd03c004a40 comp rx=0 tx=0).stop 2024-09-21T03:18:33.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.773+0000 7fd0545f1640 1 -- 172.21.15.105:0/3199605916 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd04c0d07f0 msgr2=0x7fd04c1f4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:33.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.773+0000 7fd0545f1640 1 --2- 172.21.15.105:0/3199605916 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd04c0d07f0 0x7fd04c1f4270 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd04000e7c0 tx=0x7fd04000ec80 comp rx=0 tx=0).stop 2024-09-21T03:18:33.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.773+0000 7fd0545f1640 1 -- 172.21.15.105:0/3199605916 shutdown_connections 2024-09-21T03:18:33.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.773+0000 7fd0545f1640 1 --2- 172.21.15.105:0/3199605916 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd038078b90 0x7fd03807b0a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:33.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.773+0000 7fd0545f1640 1 --2- 172.21.15.105:0/3199605916 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd04c145f90 0x7fd04c1f0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:33.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.773+0000 7fd0545f1640 1 --2- 172.21.15.105:0/3199605916 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd04c0d07f0 0x7fd04c1f4270 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:33.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.773+0000 7fd0545f1640 1 --2- 172.21.15.105:0/3199605916 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd04c06d320 0x7fd04c1e5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:33.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.773+0000 7fd0545f1640 1 -- 172.21.15.105:0/3199605916 >> 172.21.15.105:0/3199605916 conn(0x7fd04c0b2e10 msgr2=0x7fd04c0b26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:33.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.773+0000 7fd0545f1640 1 -- 172.21.15.105:0/3199605916 shutdown_connections 2024-09-21T03:18:33.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.773+0000 7fd0545f1640 1 -- 172.21.15.105:0/3199605916 wait complete. 2024-09-21T03:18:33.786 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:18:33.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.897+0000 7f2566552640 1 -- 172.21.15.105:0/213207815 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f256015f5c0 msgr2=0x7f25600c58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:33.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.897+0000 7f2566552640 1 --2- 172.21.15.105:0/213207815 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f256015f5c0 0x7f25600c58a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2558005fd0 tx=0x7f255802aa10 comp rx=0 tx=0).stop 2024-09-21T03:18:33.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.897+0000 7f2566552640 1 -- 172.21.15.105:0/213207815 shutdown_connections 2024-09-21T03:18:33.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.897+0000 7f2566552640 1 --2- 172.21.15.105:0/213207815 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f256015f5c0 0x7f25600c58a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:33.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.897+0000 7f2566552640 1 --2- 172.21.15.105:0/213207815 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25600d0340 0x7f256015f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:33.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.897+0000 7f2566552640 1 -- 172.21.15.105:0/213207815 >> 172.21.15.105:0/213207815 conn(0x7f25600cd480 msgr2=0x7f25600cd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:33.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.897+0000 7f2566552640 1 -- 172.21.15.105:0/213207815 shutdown_connections 2024-09-21T03:18:33.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.897+0000 7f2566552640 1 -- 172.21.15.105:0/213207815 wait complete. 2024-09-21T03:18:33.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.898+0000 7f2566552640 1 Processor -- start 2024-09-21T03:18:33.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.899+0000 7f2566552640 1 -- start start 2024-09-21T03:18:33.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.900+0000 7f2566552640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25600d0340 0x7f256014e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:33.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.900+0000 7f2566552640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2560155aa0 0x7f2560147530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:33.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.900+0000 7f2566552640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f256015f5c0 0x7f25601f6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:33.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.900+0000 7f2566552640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f25600c5de0 con 0x7f256015f5c0 2024-09-21T03:18:33.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.900+0000 7f2566552640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f256006e720 con 0x7f25600d0340 2024-09-21T03:18:33.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.900+0000 7f2566552640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f25600c5f60 con 0x7f2560155aa0 2024-09-21T03:18:33.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.900+0000 7f2564aef640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f256015f5c0 0x7f25601f6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:33.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.900+0000 7f2564aef640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f256015f5c0 0x7f25601f6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56354/0 (socket says 172.21.15.105:56354) 2024-09-21T03:18:33.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.900+0000 7f2564aef640 1 -- 172.21.15.105:0/411287827 learned_addr learned my addr 172.21.15.105:0/411287827 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:33.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.900+0000 7f255f7fe640 1 --2- 172.21.15.105:0/411287827 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2560155aa0 0x7f2560147530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:33.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.900+0000 7f255ffff640 1 --2- 172.21.15.105:0/411287827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25600d0340 0x7f256014e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:33.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.900+0000 7f2564aef640 1 -- 172.21.15.105:0/411287827 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2560155aa0 msgr2=0x7f2560147530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:33.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.900+0000 7f2564aef640 1 --2- 172.21.15.105:0/411287827 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2560155aa0 0x7f2560147530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:33.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.900+0000 7f2564aef640 1 -- 172.21.15.105:0/411287827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25600d0340 msgr2=0x7f256014e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:33.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.900+0000 7f2564aef640 1 --2- 172.21.15.105:0/411287827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25600d0340 0x7f256014e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:33.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.900+0000 7f2564aef640 1 -- 172.21.15.105:0/411287827 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f256014ee70 con 0x7f256015f5c0 2024-09-21T03:18:33.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.900+0000 7f2564aef640 1 --2- 172.21.15.105:0/411287827 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f256015f5c0 0x7f25601f6910 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2558006010 tx=0x7f2558009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:33.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.901+0000 7f255cff9640 1 -- 172.21.15.105:0/411287827 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2558046070 con 0x7f256015f5c0 2024-09-21T03:18:33.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.901+0000 7f255cff9640 1 -- 172.21.15.105:0/411287827 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2558004540 con 0x7f256015f5c0 2024-09-21T03:18:33.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.901+0000 7f2566552640 1 -- 172.21.15.105:0/411287827 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f256014f150 con 0x7f256015f5c0 2024-09-21T03:18:33.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.901+0000 7f255cff9640 1 -- 172.21.15.105:0/411287827 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2558033070 con 0x7f256015f5c0 2024-09-21T03:18:33.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.901+0000 7f2566552640 1 -- 172.21.15.105:0/411287827 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f256014f710 con 0x7f256015f5c0 2024-09-21T03:18:33.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.902+0000 7f2566552640 1 -- 172.21.15.105:0/411287827 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2560147a70 con 0x7f256015f5c0 2024-09-21T03:18:33.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.902+0000 7f255cff9640 1 -- 172.21.15.105:0/411287827 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2558049070 con 0x7f256015f5c0 2024-09-21T03:18:33.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.903+0000 7f255cff9640 1 --2- 172.21.15.105:0/411287827 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f254c078b90 0x7f254c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:33.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.903+0000 7f255cff9640 1 -- 172.21.15.105:0/411287827 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f25580bbe60 con 0x7f256015f5c0 2024-09-21T03:18:33.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.903+0000 7f255ffff640 1 --2- 172.21.15.105:0/411287827 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f254c078b90 0x7f254c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:33.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.904+0000 7f255ffff640 1 --2- 172.21.15.105:0/411287827 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f254c078b90 0x7f254c07b0a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2550007fd0 tx=0x7f2550009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:33.909 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:33.908+0000 7f255cff9640 1 -- 172.21.15.105:0/411287827 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f255803e070 con 0x7f256015f5c0 2024-09-21T03:18:34.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.089+0000 7f2566552640 1 -- 172.21.15.105:0/411287827 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f25600c6900 con 0x7f256015f5c0 2024-09-21T03:18:34.091 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.090+0000 7f255cff9640 1 -- 172.21.15.105:0/411287827 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16737 (secure 0 0 0) 0x7f25580842b0 con 0x7f256015f5c0 2024-09-21T03:18:34.091 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:18:34.092 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":23,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:18:31.396627+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:18:27.622514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:18:28.719849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:18:34.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.092+0000 7f2566552640 1 -- 172.21.15.105:0/411287827 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f254c078b90 msgr2=0x7f254c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:34.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.092+0000 7f2566552640 1 --2- 172.21.15.105:0/411287827 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f254c078b90 0x7f254c07b0a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2550007fd0 tx=0x7f2550009040 comp rx=0 tx=0).stop 2024-09-21T03:18:34.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.092+0000 7f2566552640 1 -- 172.21.15.105:0/411287827 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f256015f5c0 msgr2=0x7f25601f6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:34.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.092+0000 7f2566552640 1 --2- 172.21.15.105:0/411287827 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f256015f5c0 0x7f25601f6910 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2558006010 tx=0x7f2558009360 comp rx=0 tx=0).stop 2024-09-21T03:18:34.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.092+0000 7f2566552640 1 -- 172.21.15.105:0/411287827 shutdown_connections 2024-09-21T03:18:34.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.092+0000 7f2566552640 1 --2- 172.21.15.105:0/411287827 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f254c078b90 0x7f254c07b0a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.092+0000 7f2566552640 1 --2- 172.21.15.105:0/411287827 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f256015f5c0 0x7f25601f6910 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.092+0000 7f2566552640 1 --2- 172.21.15.105:0/411287827 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2560155aa0 0x7f2560147530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.092+0000 7f2566552640 1 --2- 172.21.15.105:0/411287827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25600d0340 0x7f256014e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.092+0000 7f2566552640 1 -- 172.21.15.105:0/411287827 >> 172.21.15.105:0/411287827 conn(0x7f25600cd480 msgr2=0x7f2560075e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:34.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.092+0000 7f2566552640 1 -- 172.21.15.105:0/411287827 shutdown_connections 2024-09-21T03:18:34.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.092+0000 7f2566552640 1 -- 172.21.15.105:0/411287827 wait complete. 2024-09-21T03:18:34.105 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T03:18:34.106 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:18:34.216 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.214+0000 7fb55387e640 1 -- 172.21.15.105:0/3230658158 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb54c160c90 msgr2=0x7fb54c0d0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:34.216 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.214+0000 7fb55387e640 1 --2- 172.21.15.105:0/3230658158 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb54c160c90 0x7fb54c0d0bf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb544005fd0 tx=0x7fb54402a540 comp rx=0 tx=0).stop 2024-09-21T03:18:34.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.214+0000 7fb55387e640 1 -- 172.21.15.105:0/3230658158 shutdown_connections 2024-09-21T03:18:34.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.214+0000 7fb55387e640 1 --2- 172.21.15.105:0/3230658158 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb54c160c90 0x7fb54c0d0bf0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.214+0000 7fb55387e640 1 --2- 172.21.15.105:0/3230658158 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb54c0b4530 0x7fb54c15c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.214+0000 7fb55387e640 1 -- 172.21.15.105:0/3230658158 >> 172.21.15.105:0/3230658158 conn(0x7fb54c0cee20 msgr2=0x7fb54c0cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:34.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.214+0000 7fb55387e640 1 -- 172.21.15.105:0/3230658158 shutdown_connections 2024-09-21T03:18:34.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.215+0000 7fb55387e640 1 -- 172.21.15.105:0/3230658158 wait complete. 2024-09-21T03:18:34.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.216+0000 7fb55387e640 1 Processor -- start 2024-09-21T03:18:34.218 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.216+0000 7fb55387e640 1 -- start start 2024-09-21T03:18:34.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.217+0000 7fb55387e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb54c0cff70 0x7fb54c0b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:34.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.217+0000 7fb55387e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb54c160c90 0x7fb54c0b5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:34.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.217+0000 7fb55387e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb54c0b6410 0x7fb54c0b6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:34.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.217+0000 7fb55387e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb54c0d17d0 con 0x7fb54c160c90 2024-09-21T03:18:34.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.217+0000 7fb55387e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb54c0d1650 con 0x7fb54c0b6410 2024-09-21T03:18:34.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.217+0000 7fb55387e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb54c0d1950 con 0x7fb54c0cff70 2024-09-21T03:18:34.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.218+0000 7fb550e19640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb54c160c90 0x7fb54c0b5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:34.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.218+0000 7fb550e19640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb54c160c90 0x7fb54c0b5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56370/0 (socket says 172.21.15.105:56370) 2024-09-21T03:18:34.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.218+0000 7fb550e19640 1 -- 172.21.15.105:0/2910229639 learned_addr learned my addr 172.21.15.105:0/2910229639 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:34.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.218+0000 7fb55161a640 1 --2- 172.21.15.105:0/2910229639 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb54c0cff70 0x7fb54c0b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:34.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.218+0000 7fb551e1b640 1 --2- 172.21.15.105:0/2910229639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb54c0b6410 0x7fb54c0b6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:34.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.218+0000 7fb550e19640 1 -- 172.21.15.105:0/2910229639 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb54c0cff70 msgr2=0x7fb54c0b7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:34.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.218+0000 7fb550e19640 1 --2- 172.21.15.105:0/2910229639 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb54c0cff70 0x7fb54c0b7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.218+0000 7fb550e19640 1 -- 172.21.15.105:0/2910229639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb54c0b6410 msgr2=0x7fb54c0b6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:34.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.218+0000 7fb550e19640 1 --2- 172.21.15.105:0/2910229639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb54c0b6410 0x7fb54c0b6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.218+0000 7fb550e19640 1 -- 172.21.15.105:0/2910229639 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb54c155400 con 0x7fb54c160c90 2024-09-21T03:18:34.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.218+0000 7fb550e19640 1 --2- 172.21.15.105:0/2910229639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb54c160c90 0x7fb54c0b5ed0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb53c00d6d0 tx=0x7fb53c00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:34.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.218+0000 7fb541ffb640 1 -- 172.21.15.105:0/2910229639 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb53c017070 con 0x7fb54c160c90 2024-09-21T03:18:34.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.218+0000 7fb541ffb640 1 -- 172.21.15.105:0/2910229639 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb53c005330 con 0x7fb54c160c90 2024-09-21T03:18:34.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.218+0000 7fb55387e640 1 -- 172.21.15.105:0/2910229639 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb54c1556a0 con 0x7fb54c160c90 2024-09-21T03:18:34.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.218+0000 7fb541ffb640 1 -- 172.21.15.105:0/2910229639 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb53c009820 con 0x7fb54c160c90 2024-09-21T03:18:34.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.218+0000 7fb55387e640 1 -- 172.21.15.105:0/2910229639 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb54c155c60 con 0x7fb54c160c90 2024-09-21T03:18:34.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.219+0000 7fb55387e640 1 -- 172.21.15.105:0/2910229639 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb54c0c6320 con 0x7fb54c160c90 2024-09-21T03:18:34.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.220+0000 7fb541ffb640 1 -- 172.21.15.105:0/2910229639 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb53c009bd0 con 0x7fb54c160c90 2024-09-21T03:18:34.223 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.220+0000 7fb541ffb640 1 --2- 172.21.15.105:0/2910229639 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb530078b90 0x7fb53007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:34.223 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.221+0000 7fb541ffb640 1 -- 172.21.15.105:0/2910229639 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb53c09afd0 con 0x7fb54c160c90 2024-09-21T03:18:34.223 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.221+0000 7fb55161a640 1 --2- 172.21.15.105:0/2910229639 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb530078b90 0x7fb53007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:34.223 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.221+0000 7fb55161a640 1 --2- 172.21.15.105:0/2910229639 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb530078b90 0x7fb53007b0a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb548001e20 tx=0x7fb548009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:34.226 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.225+0000 7fb541ffb640 1 -- 172.21.15.105:0/2910229639 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb53c062dc0 con 0x7fb54c160c90 2024-09-21T03:18:34.400 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.398+0000 7fb55387e640 1 -- 172.21.15.105:0/2910229639 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb54c0d1e00 con 0x7fb530078b90 2024-09-21T03:18:34.405 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.403+0000 7fb541ffb640 1 -- 172.21.15.105:0/2910229639 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241620 (secure 0 0 0) 0x7fb54c0d1e00 con 0x7fb530078b90 2024-09-21T03:18:34.408 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:18:34.409 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:18:34.410 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.407+0000 7fb55387e640 1 -- 172.21.15.105:0/2910229639 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb530078b90 msgr2=0x7fb53007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:34.411 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.407+0000 7fb55387e640 1 --2- 172.21.15.105:0/2910229639 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb530078b90 0x7fb53007b0a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb548001e20 tx=0x7fb548009040 comp rx=0 tx=0).stop 2024-09-21T03:18:34.411 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.407+0000 7fb55387e640 1 -- 172.21.15.105:0/2910229639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb54c160c90 msgr2=0x7fb54c0b5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:34.411 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.407+0000 7fb55387e640 1 --2- 172.21.15.105:0/2910229639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb54c160c90 0x7fb54c0b5ed0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb53c00d6d0 tx=0x7fb53c00db90 comp rx=0 tx=0).stop 2024-09-21T03:18:34.411 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.407+0000 7fb55387e640 1 -- 172.21.15.105:0/2910229639 shutdown_connections 2024-09-21T03:18:34.411 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.407+0000 7fb55387e640 1 --2- 172.21.15.105:0/2910229639 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb530078b90 0x7fb53007b0a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.411 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.407+0000 7fb55387e640 1 --2- 172.21.15.105:0/2910229639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb54c0b6410 0x7fb54c0b6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.411 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.407+0000 7fb55387e640 1 --2- 172.21.15.105:0/2910229639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb54c160c90 0x7fb54c0b5ed0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.411 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.407+0000 7fb55387e640 1 --2- 172.21.15.105:0/2910229639 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb54c0cff70 0x7fb54c0b7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.411 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.407+0000 7fb55387e640 1 -- 172.21.15.105:0/2910229639 >> 172.21.15.105:0/2910229639 conn(0x7fb54c0cee20 msgr2=0x7fb54c152450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:34.411 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.407+0000 7fb55387e640 1 -- 172.21.15.105:0/2910229639 shutdown_connections 2024-09-21T03:18:34.411 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.407+0000 7fb55387e640 1 -- 172.21.15.105:0/2910229639 wait complete. 2024-09-21T03:18:34.419 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-21T03:18:33.279256+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590984,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":108,"num_write_kb":1636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":86,"acting":86,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219152,"kb_used_data":2660,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755568,"statfs":{"total":773094113280,"available":772869701632,"internally_reserved":0,"allocated":2723840,"data_stored":1654602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.893281"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.416577+0000","last_change":"2024-09-21T03:18:30.406431+0000","last_active":"2024-09-21T03:18:30.416577+0000","last_peered":"2024-09-21T03:18:30.416577+0000","last_clean":"2024-09-21T03:18:30.416577+0000","last_became_active":"2024-09-21T03:18:30.406082+0000","last_became_peered":"2024-09-21T03:18:30.406082+0000","last_unstale":"2024-09-21T03:18:30.416577+0000","last_undegraded":"2024-09-21T03:18:30.416577+0000","last_fullsized":"2024-09-21T03:18:30.416577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:51.365359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.416643+0000","last_change":"2024-09-21T03:18:30.407726+0000","last_active":"2024-09-21T03:18:30.416643+0000","last_peered":"2024-09-21T03:18:30.416643+0000","last_clean":"2024-09-21T03:18:30.416643+0000","last_became_active":"2024-09-21T03:18:30.404823+0000","last_became_peered":"2024-09-21T03:18:30.404823+0000","last_unstale":"2024-09-21T03:18:30.416643+0000","last_undegraded":"2024-09-21T03:18:30.416643+0000","last_fullsized":"2024-09-21T03:18:30.416643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:12:45.656423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.416877+0000","last_change":"2024-09-21T03:18:30.410634+0000","last_active":"2024-09-21T03:18:30.416877+0000","last_peered":"2024-09-21T03:18:30.416877+0000","last_clean":"2024-09-21T03:18:30.416877+0000","last_became_active":"2024-09-21T03:18:30.410352+0000","last_became_peered":"2024-09-21T03:18:30.410352+0000","last_unstale":"2024-09-21T03:18:30.416877+0000","last_undegraded":"2024-09-21T03:18:30.416877+0000","last_fullsized":"2024-09-21T03:18:30.416877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:20.665184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.416852+0000","last_change":"2024-09-21T03:18:30.409071+0000","last_active":"2024-09-21T03:18:30.416852+0000","last_peered":"2024-09-21T03:18:30.416852+0000","last_clean":"2024-09-21T03:18:30.416852+0000","last_became_active":"2024-09-21T03:18:30.408769+0000","last_became_peered":"2024-09-21T03:18:30.408769+0000","last_unstale":"2024-09-21T03:18:30.416852+0000","last_undegraded":"2024-09-21T03:18:30.416852+0000","last_fullsized":"2024-09-21T03:18:30.416852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:34.422427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.386912+0000","last_change":"2024-09-21T03:18:28.386912+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.386912+0000","last_undegraded":"2024-09-21T03:18:28.386912+0000","last_fullsized":"2024-09-21T03:18:28.386912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.416792+0000","last_change":"2024-09-21T03:18:30.406637+0000","last_active":"2024-09-21T03:18:30.416792+0000","last_peered":"2024-09-21T03:18:30.416792+0000","last_clean":"2024-09-21T03:18:30.416792+0000","last_became_active":"2024-09-21T03:18:30.405638+0000","last_became_peered":"2024-09-21T03:18:30.405638+0000","last_unstale":"2024-09-21T03:18:30.416792+0000","last_undegraded":"2024-09-21T03:18:30.416792+0000","last_fullsized":"2024-09-21T03:18:30.416792+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:29:42.558189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.387689+0000","last_change":"2024-09-21T03:18:28.387689+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.387689+0000","last_undegraded":"2024-09-21T03:18:28.387689+0000","last_fullsized":"2024-09-21T03:18:28.387689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.386748+0000","last_change":"2024-09-21T03:18:28.386748+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.386748+0000","last_undegraded":"2024-09-21T03:18:28.386748+0000","last_fullsized":"2024-09-21T03:18:28.386748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.389605+0000","last_change":"2024-09-21T03:18:28.389605+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.389605+0000","last_undegraded":"2024-09-21T03:18:28.389605+0000","last_fullsized":"2024-09-21T03:18:28.389605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.388297+0000","last_change":"2024-09-21T03:18:28.388297+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.388297+0000","last_undegraded":"2024-09-21T03:18:28.388297+0000","last_fullsized":"2024-09-21T03:18:28.388297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.389738+0000","last_change":"2024-09-21T03:18:28.389738+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.389738+0000","last_undegraded":"2024-09-21T03:18:28.389738+0000","last_fullsized":"2024-09-21T03:18:28.389738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.417817+0000","last_change":"2024-09-21T03:18:30.413425+0000","last_active":"2024-09-21T03:18:30.417817+0000","last_peered":"2024-09-21T03:18:30.417817+0000","last_clean":"2024-09-21T03:18:30.417817+0000","last_became_active":"2024-09-21T03:18:30.412694+0000","last_became_peered":"2024-09-21T03:18:30.412694+0000","last_unstale":"2024-09-21T03:18:30.417817+0000","last_undegraded":"2024-09-21T03:18:30.417817+0000","last_fullsized":"2024-09-21T03:18:30.417817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:19.780012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.384851+0000","last_change":"2024-09-21T03:18:28.384851+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.384851+0000","last_undegraded":"2024-09-21T03:18:28.384851+0000","last_fullsized":"2024-09-21T03:18:28.384851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.390364+0000","last_change":"2024-09-21T03:18:28.390364+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.390364+0000","last_undegraded":"2024-09-21T03:18:28.390364+0000","last_fullsized":"2024-09-21T03:18:28.390364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.423785+0000","last_change":"2024-09-21T03:18:29.405416+0000","last_active":"2024-09-21T03:18:30.423785+0000","last_peered":"2024-09-21T03:18:30.423785+0000","last_clean":"2024-09-21T03:18:30.423785+0000","last_became_active":"2024-09-21T03:18:29.405108+0000","last_became_peered":"2024-09-21T03:18:29.405108+0000","last_unstale":"2024-09-21T03:18:30.423785+0000","last_undegraded":"2024-09-21T03:18:30.423785+0000","last_fullsized":"2024-09-21T03:18:30.423785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:53.454590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.416759+0000","last_change":"2024-09-21T03:18:30.409860+0000","last_active":"2024-09-21T03:18:30.416759+0000","last_peered":"2024-09-21T03:18:30.416759+0000","last_clean":"2024-09-21T03:18:30.416759+0000","last_became_active":"2024-09-21T03:18:30.409559+0000","last_became_peered":"2024-09-21T03:18:30.409559+0000","last_unstale":"2024-09-21T03:18:30.416759+0000","last_undegraded":"2024-09-21T03:18:30.416759+0000","last_fullsized":"2024-09-21T03:18:30.416759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:32.549901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.389160+0000","last_change":"2024-09-21T03:18:28.389160+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.389160+0000","last_undegraded":"2024-09-21T03:18:28.389160+0000","last_fullsized":"2024-09-21T03:18:28.389160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.387227+0000","last_change":"2024-09-21T03:18:28.387227+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.387227+0000","last_undegraded":"2024-09-21T03:18:28.387227+0000","last_fullsized":"2024-09-21T03:18:28.387227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.396241+0000","last_change":"2024-09-21T03:18:28.396241+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.396241+0000","last_undegraded":"2024-09-21T03:18:28.396241+0000","last_fullsized":"2024-09-21T03:18:28.396241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.388366+0000","last_change":"2024-09-21T03:18:28.388366+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.388366+0000","last_undegraded":"2024-09-21T03:18:28.388366+0000","last_fullsized":"2024-09-21T03:18:28.388366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.396106+0000","last_change":"2024-09-21T03:18:28.396106+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.396106+0000","last_undegraded":"2024-09-21T03:18:28.396106+0000","last_fullsized":"2024-09-21T03:18:28.396106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.384171+0000","last_change":"2024-09-21T03:18:28.384171+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.384171+0000","last_undegraded":"2024-09-21T03:18:28.384171+0000","last_fullsized":"2024-09-21T03:18:28.384171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.396107+0000","last_change":"2024-09-21T03:18:28.396107+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.396107+0000","last_undegraded":"2024-09-21T03:18:28.396107+0000","last_fullsized":"2024-09-21T03:18:28.396107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":105,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T03:18:28.390694+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:18:28.390694+0000","last_peered":"2024-09-21T03:18:28.390694+0000","last_clean":"2024-09-21T03:18:28.390694+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:18:28.390694+0000","last_undegraded":"2024-09-21T03:18:28.390694+0000","last_fullsized":"2024-09-21T03:18:28.390694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.388093+0000","last_change":"2024-09-21T03:18:28.388093+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.388093+0000","last_undegraded":"2024-09-21T03:18:28.388093+0000","last_fullsized":"2024-09-21T03:18:28.388093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.389331+0000","last_change":"2024-09-21T03:18:28.389331+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.389331+0000","last_undegraded":"2024-09-21T03:18:28.389331+0000","last_fullsized":"2024-09-21T03:18:28.389331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.416893+0000","last_change":"2024-09-21T03:18:30.406884+0000","last_active":"2024-09-21T03:18:30.416893+0000","last_peered":"2024-09-21T03:18:30.416893+0000","last_clean":"2024-09-21T03:18:30.416893+0000","last_became_active":"2024-09-21T03:18:30.406497+0000","last_became_peered":"2024-09-21T03:18:30.406497+0000","last_unstale":"2024-09-21T03:18:30.416893+0000","last_undegraded":"2024-09-21T03:18:30.416893+0000","last_fullsized":"2024-09-21T03:18:30.416893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:12.701313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.396186+0000","last_change":"2024-09-21T03:18:28.396186+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.396186+0000","last_undegraded":"2024-09-21T03:18:28.396186+0000","last_fullsized":"2024-09-21T03:18:28.396186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.388651+0000","last_change":"2024-09-21T03:18:28.388651+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.388651+0000","last_undegraded":"2024-09-21T03:18:28.388651+0000","last_fullsized":"2024-09-21T03:18:28.388651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.383895+0000","last_change":"2024-09-21T03:18:28.383895+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.383895+0000","last_undegraded":"2024-09-21T03:18:28.383895+0000","last_fullsized":"2024-09-21T03:18:28.383895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.387798+0000","last_change":"2024-09-21T03:18:28.387798+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.387798+0000","last_undegraded":"2024-09-21T03:18:28.387798+0000","last_fullsized":"2024-09-21T03:18:28.387798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.383923+0000","last_change":"2024-09-21T03:18:28.383923+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.383923+0000","last_undegraded":"2024-09-21T03:18:28.383923+0000","last_fullsized":"2024-09-21T03:18:28.383923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.387202+0000","last_change":"2024-09-21T03:18:28.387202+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.387202+0000","last_undegraded":"2024-09-21T03:18:28.387202+0000","last_fullsized":"2024-09-21T03:18:28.387202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.416691+0000","last_change":"2024-09-21T03:18:30.404103+0000","last_active":"2024-09-21T03:18:30.416691+0000","last_peered":"2024-09-21T03:18:30.416691+0000","last_clean":"2024-09-21T03:18:30.416691+0000","last_became_active":"2024-09-21T03:18:30.402457+0000","last_became_peered":"2024-09-21T03:18:30.402457+0000","last_unstale":"2024-09-21T03:18:30.416691+0000","last_undegraded":"2024-09-21T03:18:30.416691+0000","last_fullsized":"2024-09-21T03:18:30.416691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:13.113079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.389889+0000","last_change":"2024-09-21T03:18:28.389889+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.389889+0000","last_undegraded":"2024-09-21T03:18:28.389889+0000","last_fullsized":"2024-09-21T03:18:28.389889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.384008+0000","last_change":"2024-09-21T03:18:28.384008+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.384008+0000","last_undegraded":"2024-09-21T03:18:28.384008+0000","last_fullsized":"2024-09-21T03:18:28.384008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.384185+0000","last_change":"2024-09-21T03:18:28.384185+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.384185+0000","last_undegraded":"2024-09-21T03:18:28.384185+0000","last_fullsized":"2024-09-21T03:18:28.384185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.388966+0000","last_change":"2024-09-21T03:18:28.388966+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.388966+0000","last_undegraded":"2024-09-21T03:18:28.388966+0000","last_fullsized":"2024-09-21T03:18:28.388966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.388747+0000","last_change":"2024-09-21T03:18:28.388747+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.388747+0000","last_undegraded":"2024-09-21T03:18:28.388747+0000","last_fullsized":"2024-09-21T03:18:28.388747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.388374+0000","last_change":"2024-09-21T03:18:28.388374+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.388374+0000","last_undegraded":"2024-09-21T03:18:28.388374+0000","last_fullsized":"2024-09-21T03:18:28.388374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.417846+0000","last_change":"2024-09-21T03:18:30.413724+0000","last_active":"2024-09-21T03:18:30.417846+0000","last_peered":"2024-09-21T03:18:30.417846+0000","last_clean":"2024-09-21T03:18:30.417846+0000","last_became_active":"2024-09-21T03:18:30.413106+0000","last_became_peered":"2024-09-21T03:18:30.413106+0000","last_unstale":"2024-09-21T03:18:30.417846+0000","last_undegraded":"2024-09-21T03:18:30.417846+0000","last_fullsized":"2024-09-21T03:18:30.417846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:53.409864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.386799+0000","last_change":"2024-09-21T03:18:28.386799+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.386799+0000","last_undegraded":"2024-09-21T03:18:28.386799+0000","last_fullsized":"2024-09-21T03:18:28.386799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.424469+0000","last_change":"2024-09-21T03:18:29.410309+0000","last_active":"2024-09-21T03:18:30.424469+0000","last_peered":"2024-09-21T03:18:30.424469+0000","last_clean":"2024-09-21T03:18:30.424469+0000","last_became_active":"2024-09-21T03:18:29.409959+0000","last_became_peered":"2024-09-21T03:18:29.409959+0000","last_unstale":"2024-09-21T03:18:30.424469+0000","last_undegraded":"2024-09-21T03:18:30.424469+0000","last_fullsized":"2024-09-21T03:18:30.424469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:52.457819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":20,"acting":20,"num_store_stats":1},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":778240,"data_stored":646436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":827392,"data_stored":665941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:18:34.423 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:18:34.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.569+0000 7f2c0c9c6640 1 -- 172.21.15.105:0/2165343128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2bf4005250 msgr2=0x7f2bf400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:34.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.569+0000 7f2c0c9c6640 1 --2- 172.21.15.105:0/2165343128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2bf4005250 0x7f2bf400b9c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2c080b3bb0 tx=0x7f2bf4005830 comp rx=0 tx=0).stop 2024-09-21T03:18:34.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.569+0000 7f2c0c9c6640 1 -- 172.21.15.105:0/2165343128 shutdown_connections 2024-09-21T03:18:34.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.569+0000 7f2c0c9c6640 1 --2- 172.21.15.105:0/2165343128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2bf4005250 0x7f2bf400b9c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.569+0000 7f2c0c9c6640 1 -- 172.21.15.105:0/2165343128 >> 172.21.15.105:0/2165343128 conn(0x7f2c0809d870 msgr2=0x7f2c080d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:34.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.570+0000 7f2c0c9c6640 1 -- 172.21.15.105:0/2165343128 shutdown_connections 2024-09-21T03:18:34.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.570+0000 7f2c0c9c6640 1 -- 172.21.15.105:0/2165343128 wait complete. 2024-09-21T03:18:34.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.572+0000 7f2c0c9c6640 1 Processor -- start 2024-09-21T03:18:34.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.572+0000 7f2c0c9c6640 1 -- start start 2024-09-21T03:18:34.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.573+0000 7f2c0c9c6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2bf4005250 0x7f2c081613d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:34.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.573+0000 7f2c0c9c6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c081559b0 0x7f2c0815e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:34.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.573+0000 7f2c0c9c6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c08155dc0 0x7f2c0815e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:34.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.573+0000 7f2c0c9c6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2c080b6120 con 0x7f2c08155dc0 2024-09-21T03:18:34.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.573+0000 7f2c0c9c6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2c080b5fa0 con 0x7f2bf4005250 2024-09-21T03:18:34.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.573+0000 7f2c0c9c6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2c080b62a0 con 0x7f2c081559b0 2024-09-21T03:18:34.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.573+0000 7f2c06d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c08155dc0 0x7f2c0815e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:34.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.573+0000 7f2c06d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c08155dc0 0x7f2c0815e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56388/0 (socket says 172.21.15.105:56388) 2024-09-21T03:18:34.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.573+0000 7f2c06d9d640 1 -- 172.21.15.105:0/1253233954 learned_addr learned my addr 172.21.15.105:0/1253233954 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:34.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.573+0000 7f2c0659c640 1 --2- 172.21.15.105:0/1253233954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2bf4005250 0x7f2c081613d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:34.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.573+0000 7f2bfdd9b640 1 --2- 172.21.15.105:0/1253233954 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c081559b0 0x7f2c0815e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:34.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.573+0000 7f2c06d9d640 1 -- 172.21.15.105:0/1253233954 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c081559b0 msgr2=0x7f2c0815e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:34.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.573+0000 7f2c06d9d640 1 --2- 172.21.15.105:0/1253233954 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c081559b0 0x7f2c0815e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.573+0000 7f2c06d9d640 1 -- 172.21.15.105:0/1253233954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2bf4005250 msgr2=0x7f2c081613d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:34.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.573+0000 7f2c06d9d640 1 --2- 172.21.15.105:0/1253233954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2bf4005250 0x7f2c081613d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.573+0000 7f2c06d9d640 1 -- 172.21.15.105:0/1253233954 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c081f9270 con 0x7f2c08155dc0 2024-09-21T03:18:34.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.574+0000 7f2c06d9d640 1 --2- 172.21.15.105:0/1253233954 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c08155dc0 0x7f2c0815e850 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2c00001330 tx=0x7f2c0000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:34.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.574+0000 7f2bff7fe640 1 -- 172.21.15.105:0/1253233954 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c00039070 con 0x7f2c08155dc0 2024-09-21T03:18:34.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.574+0000 7f2bff7fe640 1 -- 172.21.15.105:0/1253233954 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c0002bd80 con 0x7f2c08155dc0 2024-09-21T03:18:34.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.574+0000 7f2c0c9c6640 1 -- 172.21.15.105:0/1253233954 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c081f9550 con 0x7f2c08155dc0 2024-09-21T03:18:34.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.574+0000 7f2bff7fe640 1 -- 172.21.15.105:0/1253233954 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c00006290 con 0x7f2c08155dc0 2024-09-21T03:18:34.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.574+0000 7f2c0c9c6640 1 -- 172.21.15.105:0/1253233954 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c080c8050 con 0x7f2c08155dc0 2024-09-21T03:18:34.578 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.575+0000 7f2c0c9c6640 1 -- 172.21.15.105:0/1253233954 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c080b8c80 con 0x7f2c08155dc0 2024-09-21T03:18:34.578 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.576+0000 7f2bff7fe640 1 -- 172.21.15.105:0/1253233954 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2c00006430 con 0x7f2c08155dc0 2024-09-21T03:18:34.578 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.576+0000 7f2bff7fe640 1 --2- 172.21.15.105:0/1253233954 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2be8078bc0 0x7f2be807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:34.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.576+0000 7f2bff7fe640 1 -- 172.21.15.105:0/1253233954 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2c000ba9e0 con 0x7f2c08155dc0 2024-09-21T03:18:34.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.576+0000 7f2c0659c640 1 --2- 172.21.15.105:0/1253233954 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2be8078bc0 0x7f2be807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:34.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.577+0000 7f2c0659c640 1 --2- 172.21.15.105:0/1253233954 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2be8078bc0 0x7f2be807b0d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2bf80058e0 tx=0x7f2bf8005f30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:34.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.581+0000 7f2bff7fe640 1 -- 172.21.15.105:0/1253233954 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2c080b8c80 con 0x7f2c08155dc0 2024-09-21T03:18:34.755 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.754+0000 7f2c0c9c6640 1 -- 172.21.15.105:0/1253233954 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2c080b6800 con 0x7f2be8078bc0 2024-09-21T03:18:34.760 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.758+0000 7f2bff7fe640 1 -- 172.21.15.105:0/1253233954 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241620 (secure 0 0 0) 0x7f2c080b6800 con 0x7f2be8078bc0 2024-09-21T03:18:34.762 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:18:34.763 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:18:34.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.761+0000 7f2c0c9c6640 1 -- 172.21.15.105:0/1253233954 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2be8078bc0 msgr2=0x7f2be807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:34.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.761+0000 7f2c0c9c6640 1 --2- 172.21.15.105:0/1253233954 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2be8078bc0 0x7f2be807b0d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2bf80058e0 tx=0x7f2bf8005f30 comp rx=0 tx=0).stop 2024-09-21T03:18:34.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.761+0000 7f2c0c9c6640 1 -- 172.21.15.105:0/1253233954 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c08155dc0 msgr2=0x7f2c0815e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:34.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.761+0000 7f2c0c9c6640 1 --2- 172.21.15.105:0/1253233954 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c08155dc0 0x7f2c0815e850 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2c00001330 tx=0x7f2c0000c2d0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.761+0000 7f2c0c9c6640 1 -- 172.21.15.105:0/1253233954 shutdown_connections 2024-09-21T03:18:34.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.761+0000 7f2c0c9c6640 1 --2- 172.21.15.105:0/1253233954 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2be8078bc0 0x7f2be807b0d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.761+0000 7f2c0c9c6640 1 --2- 172.21.15.105:0/1253233954 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c08155dc0 0x7f2c0815e850 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.761+0000 7f2c0c9c6640 1 --2- 172.21.15.105:0/1253233954 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c081559b0 0x7f2c0815e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.761+0000 7f2c0c9c6640 1 --2- 172.21.15.105:0/1253233954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2bf4005250 0x7f2c081613d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.761+0000 7f2c0c9c6640 1 -- 172.21.15.105:0/1253233954 >> 172.21.15.105:0/1253233954 conn(0x7f2c0809d870 msgr2=0x7f2c080b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:34.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.762+0000 7f2c0c9c6640 1 -- 172.21.15.105:0/1253233954 shutdown_connections 2024-09-21T03:18:34.766 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.762+0000 7f2c0c9c6640 1 -- 172.21.15.105:0/1253233954 wait complete. 2024-09-21T03:18:34.774 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-21T03:18:33.279256+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590984,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":108,"num_write_kb":1636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":86,"acting":86,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219152,"kb_used_data":2660,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755568,"statfs":{"total":773094113280,"available":772869701632,"internally_reserved":0,"allocated":2723840,"data_stored":1654602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.893281"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.416577+0000","last_change":"2024-09-21T03:18:30.406431+0000","last_active":"2024-09-21T03:18:30.416577+0000","last_peered":"2024-09-21T03:18:30.416577+0000","last_clean":"2024-09-21T03:18:30.416577+0000","last_became_active":"2024-09-21T03:18:30.406082+0000","last_became_peered":"2024-09-21T03:18:30.406082+0000","last_unstale":"2024-09-21T03:18:30.416577+0000","last_undegraded":"2024-09-21T03:18:30.416577+0000","last_fullsized":"2024-09-21T03:18:30.416577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:51.365359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.416643+0000","last_change":"2024-09-21T03:18:30.407726+0000","last_active":"2024-09-21T03:18:30.416643+0000","last_peered":"2024-09-21T03:18:30.416643+0000","last_clean":"2024-09-21T03:18:30.416643+0000","last_became_active":"2024-09-21T03:18:30.404823+0000","last_became_peered":"2024-09-21T03:18:30.404823+0000","last_unstale":"2024-09-21T03:18:30.416643+0000","last_undegraded":"2024-09-21T03:18:30.416643+0000","last_fullsized":"2024-09-21T03:18:30.416643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:12:45.656423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.416877+0000","last_change":"2024-09-21T03:18:30.410634+0000","last_active":"2024-09-21T03:18:30.416877+0000","last_peered":"2024-09-21T03:18:30.416877+0000","last_clean":"2024-09-21T03:18:30.416877+0000","last_became_active":"2024-09-21T03:18:30.410352+0000","last_became_peered":"2024-09-21T03:18:30.410352+0000","last_unstale":"2024-09-21T03:18:30.416877+0000","last_undegraded":"2024-09-21T03:18:30.416877+0000","last_fullsized":"2024-09-21T03:18:30.416877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:20.665184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.416852+0000","last_change":"2024-09-21T03:18:30.409071+0000","last_active":"2024-09-21T03:18:30.416852+0000","last_peered":"2024-09-21T03:18:30.416852+0000","last_clean":"2024-09-21T03:18:30.416852+0000","last_became_active":"2024-09-21T03:18:30.408769+0000","last_became_peered":"2024-09-21T03:18:30.408769+0000","last_unstale":"2024-09-21T03:18:30.416852+0000","last_undegraded":"2024-09-21T03:18:30.416852+0000","last_fullsized":"2024-09-21T03:18:30.416852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:34.422427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.386912+0000","last_change":"2024-09-21T03:18:28.386912+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.386912+0000","last_undegraded":"2024-09-21T03:18:28.386912+0000","last_fullsized":"2024-09-21T03:18:28.386912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.416792+0000","last_change":"2024-09-21T03:18:30.406637+0000","last_active":"2024-09-21T03:18:30.416792+0000","last_peered":"2024-09-21T03:18:30.416792+0000","last_clean":"2024-09-21T03:18:30.416792+0000","last_became_active":"2024-09-21T03:18:30.405638+0000","last_became_peered":"2024-09-21T03:18:30.405638+0000","last_unstale":"2024-09-21T03:18:30.416792+0000","last_undegraded":"2024-09-21T03:18:30.416792+0000","last_fullsized":"2024-09-21T03:18:30.416792+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:29:42.558189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.387689+0000","last_change":"2024-09-21T03:18:28.387689+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.387689+0000","last_undegraded":"2024-09-21T03:18:28.387689+0000","last_fullsized":"2024-09-21T03:18:28.387689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.386748+0000","last_change":"2024-09-21T03:18:28.386748+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.386748+0000","last_undegraded":"2024-09-21T03:18:28.386748+0000","last_fullsized":"2024-09-21T03:18:28.386748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.389605+0000","last_change":"2024-09-21T03:18:28.389605+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.389605+0000","last_undegraded":"2024-09-21T03:18:28.389605+0000","last_fullsized":"2024-09-21T03:18:28.389605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.388297+0000","last_change":"2024-09-21T03:18:28.388297+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.388297+0000","last_undegraded":"2024-09-21T03:18:28.388297+0000","last_fullsized":"2024-09-21T03:18:28.388297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.389738+0000","last_change":"2024-09-21T03:18:28.389738+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.389738+0000","last_undegraded":"2024-09-21T03:18:28.389738+0000","last_fullsized":"2024-09-21T03:18:28.389738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.417817+0000","last_change":"2024-09-21T03:18:30.413425+0000","last_active":"2024-09-21T03:18:30.417817+0000","last_peered":"2024-09-21T03:18:30.417817+0000","last_clean":"2024-09-21T03:18:30.417817+0000","last_became_active":"2024-09-21T03:18:30.412694+0000","last_became_peered":"2024-09-21T03:18:30.412694+0000","last_unstale":"2024-09-21T03:18:30.417817+0000","last_undegraded":"2024-09-21T03:18:30.417817+0000","last_fullsized":"2024-09-21T03:18:30.417817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:19.780012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.384851+0000","last_change":"2024-09-21T03:18:28.384851+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.384851+0000","last_undegraded":"2024-09-21T03:18:28.384851+0000","last_fullsized":"2024-09-21T03:18:28.384851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.390364+0000","last_change":"2024-09-21T03:18:28.390364+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.390364+0000","last_undegraded":"2024-09-21T03:18:28.390364+0000","last_fullsized":"2024-09-21T03:18:28.390364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.423785+0000","last_change":"2024-09-21T03:18:29.405416+0000","last_active":"2024-09-21T03:18:30.423785+0000","last_peered":"2024-09-21T03:18:30.423785+0000","last_clean":"2024-09-21T03:18:30.423785+0000","last_became_active":"2024-09-21T03:18:29.405108+0000","last_became_peered":"2024-09-21T03:18:29.405108+0000","last_unstale":"2024-09-21T03:18:30.423785+0000","last_undegraded":"2024-09-21T03:18:30.423785+0000","last_fullsized":"2024-09-21T03:18:30.423785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:53.454590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.416759+0000","last_change":"2024-09-21T03:18:30.409860+0000","last_active":"2024-09-21T03:18:30.416759+0000","last_peered":"2024-09-21T03:18:30.416759+0000","last_clean":"2024-09-21T03:18:30.416759+0000","last_became_active":"2024-09-21T03:18:30.409559+0000","last_became_peered":"2024-09-21T03:18:30.409559+0000","last_unstale":"2024-09-21T03:18:30.416759+0000","last_undegraded":"2024-09-21T03:18:30.416759+0000","last_fullsized":"2024-09-21T03:18:30.416759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:32.549901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.389160+0000","last_change":"2024-09-21T03:18:28.389160+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.389160+0000","last_undegraded":"2024-09-21T03:18:28.389160+0000","last_fullsized":"2024-09-21T03:18:28.389160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.387227+0000","last_change":"2024-09-21T03:18:28.387227+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.387227+0000","last_undegraded":"2024-09-21T03:18:28.387227+0000","last_fullsized":"2024-09-21T03:18:28.387227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.396241+0000","last_change":"2024-09-21T03:18:28.396241+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.396241+0000","last_undegraded":"2024-09-21T03:18:28.396241+0000","last_fullsized":"2024-09-21T03:18:28.396241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.388366+0000","last_change":"2024-09-21T03:18:28.388366+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.388366+0000","last_undegraded":"2024-09-21T03:18:28.388366+0000","last_fullsized":"2024-09-21T03:18:28.388366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.396106+0000","last_change":"2024-09-21T03:18:28.396106+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.396106+0000","last_undegraded":"2024-09-21T03:18:28.396106+0000","last_fullsized":"2024-09-21T03:18:28.396106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.384171+0000","last_change":"2024-09-21T03:18:28.384171+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.384171+0000","last_undegraded":"2024-09-21T03:18:28.384171+0000","last_fullsized":"2024-09-21T03:18:28.384171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.396107+0000","last_change":"2024-09-21T03:18:28.396107+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.396107+0000","last_undegraded":"2024-09-21T03:18:28.396107+0000","last_fullsized":"2024-09-21T03:18:28.396107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":105,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T03:18:28.390694+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:18:28.390694+0000","last_peered":"2024-09-21T03:18:28.390694+0000","last_clean":"2024-09-21T03:18:28.390694+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:18:28.390694+0000","last_undegraded":"2024-09-21T03:18:28.390694+0000","last_fullsized":"2024-09-21T03:18:28.390694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.388093+0000","last_change":"2024-09-21T03:18:28.388093+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.388093+0000","last_undegraded":"2024-09-21T03:18:28.388093+0000","last_fullsized":"2024-09-21T03:18:28.388093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.389331+0000","last_change":"2024-09-21T03:18:28.389331+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.389331+0000","last_undegraded":"2024-09-21T03:18:28.389331+0000","last_fullsized":"2024-09-21T03:18:28.389331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.416893+0000","last_change":"2024-09-21T03:18:30.406884+0000","last_active":"2024-09-21T03:18:30.416893+0000","last_peered":"2024-09-21T03:18:30.416893+0000","last_clean":"2024-09-21T03:18:30.416893+0000","last_became_active":"2024-09-21T03:18:30.406497+0000","last_became_peered":"2024-09-21T03:18:30.406497+0000","last_unstale":"2024-09-21T03:18:30.416893+0000","last_undegraded":"2024-09-21T03:18:30.416893+0000","last_fullsized":"2024-09-21T03:18:30.416893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:12.701313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.396186+0000","last_change":"2024-09-21T03:18:28.396186+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.396186+0000","last_undegraded":"2024-09-21T03:18:28.396186+0000","last_fullsized":"2024-09-21T03:18:28.396186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.388651+0000","last_change":"2024-09-21T03:18:28.388651+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.388651+0000","last_undegraded":"2024-09-21T03:18:28.388651+0000","last_fullsized":"2024-09-21T03:18:28.388651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.383895+0000","last_change":"2024-09-21T03:18:28.383895+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.383895+0000","last_undegraded":"2024-09-21T03:18:28.383895+0000","last_fullsized":"2024-09-21T03:18:28.383895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.387798+0000","last_change":"2024-09-21T03:18:28.387798+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.387798+0000","last_undegraded":"2024-09-21T03:18:28.387798+0000","last_fullsized":"2024-09-21T03:18:28.387798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.383923+0000","last_change":"2024-09-21T03:18:28.383923+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.383923+0000","last_undegraded":"2024-09-21T03:18:28.383923+0000","last_fullsized":"2024-09-21T03:18:28.383923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.387202+0000","last_change":"2024-09-21T03:18:28.387202+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.387202+0000","last_undegraded":"2024-09-21T03:18:28.387202+0000","last_fullsized":"2024-09-21T03:18:28.387202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.416691+0000","last_change":"2024-09-21T03:18:30.404103+0000","last_active":"2024-09-21T03:18:30.416691+0000","last_peered":"2024-09-21T03:18:30.416691+0000","last_clean":"2024-09-21T03:18:30.416691+0000","last_became_active":"2024-09-21T03:18:30.402457+0000","last_became_peered":"2024-09-21T03:18:30.402457+0000","last_unstale":"2024-09-21T03:18:30.416691+0000","last_undegraded":"2024-09-21T03:18:30.416691+0000","last_fullsized":"2024-09-21T03:18:30.416691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:13.113079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.389889+0000","last_change":"2024-09-21T03:18:28.389889+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.389889+0000","last_undegraded":"2024-09-21T03:18:28.389889+0000","last_fullsized":"2024-09-21T03:18:28.389889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.384008+0000","last_change":"2024-09-21T03:18:28.384008+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.384008+0000","last_undegraded":"2024-09-21T03:18:28.384008+0000","last_fullsized":"2024-09-21T03:18:28.384008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.384185+0000","last_change":"2024-09-21T03:18:28.384185+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.384185+0000","last_undegraded":"2024-09-21T03:18:28.384185+0000","last_fullsized":"2024-09-21T03:18:28.384185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.388966+0000","last_change":"2024-09-21T03:18:28.388966+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.388966+0000","last_undegraded":"2024-09-21T03:18:28.388966+0000","last_fullsized":"2024-09-21T03:18:28.388966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.388747+0000","last_change":"2024-09-21T03:18:28.388747+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.388747+0000","last_undegraded":"2024-09-21T03:18:28.388747+0000","last_fullsized":"2024-09-21T03:18:28.388747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.388374+0000","last_change":"2024-09-21T03:18:28.388374+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.388374+0000","last_undegraded":"2024-09-21T03:18:28.388374+0000","last_fullsized":"2024-09-21T03:18:28.388374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.417846+0000","last_change":"2024-09-21T03:18:30.413724+0000","last_active":"2024-09-21T03:18:30.417846+0000","last_peered":"2024-09-21T03:18:30.417846+0000","last_clean":"2024-09-21T03:18:30.417846+0000","last_became_active":"2024-09-21T03:18:30.413106+0000","last_became_peered":"2024-09-21T03:18:30.413106+0000","last_unstale":"2024-09-21T03:18:30.417846+0000","last_undegraded":"2024-09-21T03:18:30.417846+0000","last_fullsized":"2024-09-21T03:18:30.417846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:53.409864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.386799+0000","last_change":"2024-09-21T03:18:28.386799+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.386799+0000","last_undegraded":"2024-09-21T03:18:28.386799+0000","last_fullsized":"2024-09-21T03:18:28.386799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.424469+0000","last_change":"2024-09-21T03:18:29.410309+0000","last_active":"2024-09-21T03:18:30.424469+0000","last_peered":"2024-09-21T03:18:30.424469+0000","last_clean":"2024-09-21T03:18:30.424469+0000","last_became_active":"2024-09-21T03:18:29.409959+0000","last_became_peered":"2024-09-21T03:18:29.409959+0000","last_unstale":"2024-09-21T03:18:30.424469+0000","last_undegraded":"2024-09-21T03:18:30.424469+0000","last_fullsized":"2024-09-21T03:18:30.424469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:52.457819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":20,"acting":20,"num_store_stats":1},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":778240,"data_stored":646436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":827392,"data_stored":665941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:18:34.778 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:18:34.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.925+0000 7f41f9d71640 1 -- 172.21.15.105:0/2347446678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41f40ccbd0 msgr2=0x7f41f40d0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:34.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.925+0000 7f41f9d71640 1 --2- 172.21.15.105:0/2347446678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41f40ccbd0 0x7f41f40d0d80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f41e8009830 tx=0x7f41e802a540 comp rx=0 tx=0).stop 2024-09-21T03:18:34.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.925+0000 7f41f9d71640 1 -- 172.21.15.105:0/2347446678 shutdown_connections 2024-09-21T03:18:34.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.925+0000 7f41f9d71640 1 --2- 172.21.15.105:0/2347446678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41f40ccbd0 0x7f41f40d0d80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.925+0000 7f41f9d71640 1 -- 172.21.15.105:0/2347446678 >> 172.21.15.105:0/2347446678 conn(0x7f41f4072ae0 msgr2=0x7f41f4072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:34.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.925+0000 7f41f9d71640 1 -- 172.21.15.105:0/2347446678 shutdown_connections 2024-09-21T03:18:34.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.925+0000 7f41f9d71640 1 -- 172.21.15.105:0/2347446678 wait complete. 2024-09-21T03:18:34.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.927+0000 7f41f9d71640 1 Processor -- start 2024-09-21T03:18:34.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.927+0000 7f41f9d71640 1 -- start start 2024-09-21T03:18:34.931 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.928+0000 7f41f9d71640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41f40b51c0 0x7f41f40aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:34.931 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.928+0000 7f41f9d71640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41f40ccbd0 0x7f41f41f5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:34.931 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.928+0000 7f41f9d71640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41f40d12c0 0x7f41f40a94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:34.931 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.928+0000 7f41f9d71640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f41f40cf480 con 0x7f41f40ccbd0 2024-09-21T03:18:34.931 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.928+0000 7f41f9d71640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f41f40cf300 con 0x7f41f40b51c0 2024-09-21T03:18:34.931 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.928+0000 7f41f9d71640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f41f40cf600 con 0x7f41f40d12c0 2024-09-21T03:18:34.932 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.928+0000 7f41f2ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41f40ccbd0 0x7f41f41f5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:34.932 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.928+0000 7f41f2ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41f40ccbd0 0x7f41f41f5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56396/0 (socket says 172.21.15.105:56396) 2024-09-21T03:18:34.932 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.928+0000 7f41f2ffd640 1 -- 172.21.15.105:0/379273883 learned_addr learned my addr 172.21.15.105:0/379273883 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:34.932 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.928+0000 7f41f3fff640 1 --2- 172.21.15.105:0/379273883 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41f40d12c0 0x7f41f40a94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:34.932 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.928+0000 7f41f37fe640 1 --2- 172.21.15.105:0/379273883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41f40b51c0 0x7f41f40aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:34.932 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.929+0000 7f41f2ffd640 1 -- 172.21.15.105:0/379273883 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41f40d12c0 msgr2=0x7f41f40a94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:34.932 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.929+0000 7f41f2ffd640 1 --2- 172.21.15.105:0/379273883 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41f40d12c0 0x7f41f40a94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.932 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.929+0000 7f41f2ffd640 1 -- 172.21.15.105:0/379273883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41f40b51c0 msgr2=0x7f41f40aa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:34.932 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.929+0000 7f41f2ffd640 1 --2- 172.21.15.105:0/379273883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41f40b51c0 0x7f41f40aa8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:34.932 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.929+0000 7f41f2ffd640 1 -- 172.21.15.105:0/379273883 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f41f5f60 con 0x7f41f40ccbd0 2024-09-21T03:18:34.932 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.929+0000 7f41f2ffd640 1 --2- 172.21.15.105:0/379273883 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41f40ccbd0 0x7f41f41f5300 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f41e8009950 tx=0x7f41e8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:34.932 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.929+0000 7f41dbfff640 1 -- 172.21.15.105:0/379273883 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e8005c90 con 0x7f41f40ccbd0 2024-09-21T03:18:34.932 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.929+0000 7f41dbfff640 1 -- 172.21.15.105:0/379273883 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f41e8005020 con 0x7f41f40ccbd0 2024-09-21T03:18:34.932 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.929+0000 7f41f9d71640 1 -- 172.21.15.105:0/379273883 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41f415d860 con 0x7f41f40ccbd0 2024-09-21T03:18:34.933 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.929+0000 7f41dbfff640 1 -- 172.21.15.105:0/379273883 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e8005450 con 0x7f41f40ccbd0 2024-09-21T03:18:34.933 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.929+0000 7f41f9d71640 1 -- 172.21.15.105:0/379273883 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41f40a9fe0 con 0x7f41f40ccbd0 2024-09-21T03:18:34.933 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.930+0000 7f41f9d71640 1 -- 172.21.15.105:0/379273883 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41f40cfac0 con 0x7f41f40ccbd0 2024-09-21T03:18:34.934 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.931+0000 7f41dbfff640 1 -- 172.21.15.105:0/379273883 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f41e80317c0 con 0x7f41f40ccbd0 2024-09-21T03:18:34.934 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.931+0000 7f41dbfff640 1 --2- 172.21.15.105:0/379273883 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f41e0078b90 0x7f41e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:34.934 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.931+0000 7f41dbfff640 1 -- 172.21.15.105:0/379273883 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f41e80bbc40 con 0x7f41f40ccbd0 2024-09-21T03:18:34.934 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.931+0000 7f41f37fe640 1 --2- 172.21.15.105:0/379273883 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f41e0078b90 0x7f41e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:34.934 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.932+0000 7f41f37fe640 1 --2- 172.21.15.105:0/379273883 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f41e0078b90 0x7f41e007b0a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f41e4000f60 tx=0x7f41e4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:34.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:34.936+0000 7f41dbfff640 1 -- 172.21.15.105:0/379273883 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f41e803f030 con 0x7f41f40ccbd0 2024-09-21T03:18:35.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.109+0000 7f41f9d71640 1 -- 172.21.15.105:0/379273883 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f41f41f6240 con 0x7f41e0078b90 2024-09-21T03:18:35.115 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.114+0000 7f41dbfff640 1 -- 172.21.15.105:0/379273883 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241620 (secure 0 0 0) 0x7f41f41f6240 con 0x7f41e0078b90 2024-09-21T03:18:35.117 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:18:35.118 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:18:35.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.117+0000 7f41f9d71640 1 -- 172.21.15.105:0/379273883 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f41e0078b90 msgr2=0x7f41e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:35.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.117+0000 7f41f9d71640 1 --2- 172.21.15.105:0/379273883 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f41e0078b90 0x7f41e007b0a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f41e4000f60 tx=0x7f41e4009040 comp rx=0 tx=0).stop 2024-09-21T03:18:35.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.117+0000 7f41f9d71640 1 -- 172.21.15.105:0/379273883 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41f40ccbd0 msgr2=0x7f41f41f5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:35.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.117+0000 7f41f9d71640 1 --2- 172.21.15.105:0/379273883 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41f40ccbd0 0x7f41f41f5300 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f41e8009950 tx=0x7f41e8003c10 comp rx=0 tx=0).stop 2024-09-21T03:18:35.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.117+0000 7f41f9d71640 1 -- 172.21.15.105:0/379273883 shutdown_connections 2024-09-21T03:18:35.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.117+0000 7f41f9d71640 1 --2- 172.21.15.105:0/379273883 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f41e0078b90 0x7f41e007b0a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:35.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.117+0000 7f41f9d71640 1 --2- 172.21.15.105:0/379273883 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41f40d12c0 0x7f41f40a94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:35.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.117+0000 7f41f9d71640 1 --2- 172.21.15.105:0/379273883 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41f40ccbd0 0x7f41f41f5300 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:35.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.117+0000 7f41f9d71640 1 --2- 172.21.15.105:0/379273883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41f40b51c0 0x7f41f40aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:35.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.117+0000 7f41f9d71640 1 -- 172.21.15.105:0/379273883 >> 172.21.15.105:0/379273883 conn(0x7f41f4072ae0 msgr2=0x7f41f40b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:35.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.117+0000 7f41f9d71640 1 -- 172.21.15.105:0/379273883 shutdown_connections 2024-09-21T03:18:35.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.117+0000 7f41f9d71640 1 -- 172.21.15.105:0/379273883 wait complete. 2024-09-21T03:18:35.131 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-21T03:18:33.279256+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590984,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":108,"num_write_kb":1636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":86,"acting":86,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219152,"kb_used_data":2660,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755568,"statfs":{"total":773094113280,"available":772869701632,"internally_reserved":0,"allocated":2723840,"data_stored":1654602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.893281"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.416577+0000","last_change":"2024-09-21T03:18:30.406431+0000","last_active":"2024-09-21T03:18:30.416577+0000","last_peered":"2024-09-21T03:18:30.416577+0000","last_clean":"2024-09-21T03:18:30.416577+0000","last_became_active":"2024-09-21T03:18:30.406082+0000","last_became_peered":"2024-09-21T03:18:30.406082+0000","last_unstale":"2024-09-21T03:18:30.416577+0000","last_undegraded":"2024-09-21T03:18:30.416577+0000","last_fullsized":"2024-09-21T03:18:30.416577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:51.365359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.416643+0000","last_change":"2024-09-21T03:18:30.407726+0000","last_active":"2024-09-21T03:18:30.416643+0000","last_peered":"2024-09-21T03:18:30.416643+0000","last_clean":"2024-09-21T03:18:30.416643+0000","last_became_active":"2024-09-21T03:18:30.404823+0000","last_became_peered":"2024-09-21T03:18:30.404823+0000","last_unstale":"2024-09-21T03:18:30.416643+0000","last_undegraded":"2024-09-21T03:18:30.416643+0000","last_fullsized":"2024-09-21T03:18:30.416643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:12:45.656423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.416877+0000","last_change":"2024-09-21T03:18:30.410634+0000","last_active":"2024-09-21T03:18:30.416877+0000","last_peered":"2024-09-21T03:18:30.416877+0000","last_clean":"2024-09-21T03:18:30.416877+0000","last_became_active":"2024-09-21T03:18:30.410352+0000","last_became_peered":"2024-09-21T03:18:30.410352+0000","last_unstale":"2024-09-21T03:18:30.416877+0000","last_undegraded":"2024-09-21T03:18:30.416877+0000","last_fullsized":"2024-09-21T03:18:30.416877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:20.665184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.416852+0000","last_change":"2024-09-21T03:18:30.409071+0000","last_active":"2024-09-21T03:18:30.416852+0000","last_peered":"2024-09-21T03:18:30.416852+0000","last_clean":"2024-09-21T03:18:30.416852+0000","last_became_active":"2024-09-21T03:18:30.408769+0000","last_became_peered":"2024-09-21T03:18:30.408769+0000","last_unstale":"2024-09-21T03:18:30.416852+0000","last_undegraded":"2024-09-21T03:18:30.416852+0000","last_fullsized":"2024-09-21T03:18:30.416852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:34.422427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.386912+0000","last_change":"2024-09-21T03:18:28.386912+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.386912+0000","last_undegraded":"2024-09-21T03:18:28.386912+0000","last_fullsized":"2024-09-21T03:18:28.386912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.416792+0000","last_change":"2024-09-21T03:18:30.406637+0000","last_active":"2024-09-21T03:18:30.416792+0000","last_peered":"2024-09-21T03:18:30.416792+0000","last_clean":"2024-09-21T03:18:30.416792+0000","last_became_active":"2024-09-21T03:18:30.405638+0000","last_became_peered":"2024-09-21T03:18:30.405638+0000","last_unstale":"2024-09-21T03:18:30.416792+0000","last_undegraded":"2024-09-21T03:18:30.416792+0000","last_fullsized":"2024-09-21T03:18:30.416792+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:29:42.558189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.387689+0000","last_change":"2024-09-21T03:18:28.387689+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.387689+0000","last_undegraded":"2024-09-21T03:18:28.387689+0000","last_fullsized":"2024-09-21T03:18:28.387689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.386748+0000","last_change":"2024-09-21T03:18:28.386748+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.386748+0000","last_undegraded":"2024-09-21T03:18:28.386748+0000","last_fullsized":"2024-09-21T03:18:28.386748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.389605+0000","last_change":"2024-09-21T03:18:28.389605+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.389605+0000","last_undegraded":"2024-09-21T03:18:28.389605+0000","last_fullsized":"2024-09-21T03:18:28.389605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.388297+0000","last_change":"2024-09-21T03:18:28.388297+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.388297+0000","last_undegraded":"2024-09-21T03:18:28.388297+0000","last_fullsized":"2024-09-21T03:18:28.388297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.389738+0000","last_change":"2024-09-21T03:18:28.389738+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.389738+0000","last_undegraded":"2024-09-21T03:18:28.389738+0000","last_fullsized":"2024-09-21T03:18:28.389738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.417817+0000","last_change":"2024-09-21T03:18:30.413425+0000","last_active":"2024-09-21T03:18:30.417817+0000","last_peered":"2024-09-21T03:18:30.417817+0000","last_clean":"2024-09-21T03:18:30.417817+0000","last_became_active":"2024-09-21T03:18:30.412694+0000","last_became_peered":"2024-09-21T03:18:30.412694+0000","last_unstale":"2024-09-21T03:18:30.417817+0000","last_undegraded":"2024-09-21T03:18:30.417817+0000","last_fullsized":"2024-09-21T03:18:30.417817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:19.780012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.384851+0000","last_change":"2024-09-21T03:18:28.384851+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.384851+0000","last_undegraded":"2024-09-21T03:18:28.384851+0000","last_fullsized":"2024-09-21T03:18:28.384851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.390364+0000","last_change":"2024-09-21T03:18:28.390364+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.390364+0000","last_undegraded":"2024-09-21T03:18:28.390364+0000","last_fullsized":"2024-09-21T03:18:28.390364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.423785+0000","last_change":"2024-09-21T03:18:29.405416+0000","last_active":"2024-09-21T03:18:30.423785+0000","last_peered":"2024-09-21T03:18:30.423785+0000","last_clean":"2024-09-21T03:18:30.423785+0000","last_became_active":"2024-09-21T03:18:29.405108+0000","last_became_peered":"2024-09-21T03:18:29.405108+0000","last_unstale":"2024-09-21T03:18:30.423785+0000","last_undegraded":"2024-09-21T03:18:30.423785+0000","last_fullsized":"2024-09-21T03:18:30.423785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:53.454590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.416759+0000","last_change":"2024-09-21T03:18:30.409860+0000","last_active":"2024-09-21T03:18:30.416759+0000","last_peered":"2024-09-21T03:18:30.416759+0000","last_clean":"2024-09-21T03:18:30.416759+0000","last_became_active":"2024-09-21T03:18:30.409559+0000","last_became_peered":"2024-09-21T03:18:30.409559+0000","last_unstale":"2024-09-21T03:18:30.416759+0000","last_undegraded":"2024-09-21T03:18:30.416759+0000","last_fullsized":"2024-09-21T03:18:30.416759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:32.549901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.389160+0000","last_change":"2024-09-21T03:18:28.389160+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.389160+0000","last_undegraded":"2024-09-21T03:18:28.389160+0000","last_fullsized":"2024-09-21T03:18:28.389160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.387227+0000","last_change":"2024-09-21T03:18:28.387227+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.387227+0000","last_undegraded":"2024-09-21T03:18:28.387227+0000","last_fullsized":"2024-09-21T03:18:28.387227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.396241+0000","last_change":"2024-09-21T03:18:28.396241+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.396241+0000","last_undegraded":"2024-09-21T03:18:28.396241+0000","last_fullsized":"2024-09-21T03:18:28.396241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.388366+0000","last_change":"2024-09-21T03:18:28.388366+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.388366+0000","last_undegraded":"2024-09-21T03:18:28.388366+0000","last_fullsized":"2024-09-21T03:18:28.388366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.396106+0000","last_change":"2024-09-21T03:18:28.396106+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.396106+0000","last_undegraded":"2024-09-21T03:18:28.396106+0000","last_fullsized":"2024-09-21T03:18:28.396106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.384171+0000","last_change":"2024-09-21T03:18:28.384171+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.384171+0000","last_undegraded":"2024-09-21T03:18:28.384171+0000","last_fullsized":"2024-09-21T03:18:28.384171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.396107+0000","last_change":"2024-09-21T03:18:28.396107+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.396107+0000","last_undegraded":"2024-09-21T03:18:28.396107+0000","last_fullsized":"2024-09-21T03:18:28.396107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":105,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T03:18:28.390694+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:18:28.390694+0000","last_peered":"2024-09-21T03:18:28.390694+0000","last_clean":"2024-09-21T03:18:28.390694+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:18:28.390694+0000","last_undegraded":"2024-09-21T03:18:28.390694+0000","last_fullsized":"2024-09-21T03:18:28.390694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.388093+0000","last_change":"2024-09-21T03:18:28.388093+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.388093+0000","last_undegraded":"2024-09-21T03:18:28.388093+0000","last_fullsized":"2024-09-21T03:18:28.388093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.389331+0000","last_change":"2024-09-21T03:18:28.389331+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.389331+0000","last_undegraded":"2024-09-21T03:18:28.389331+0000","last_fullsized":"2024-09-21T03:18:28.389331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.416893+0000","last_change":"2024-09-21T03:18:30.406884+0000","last_active":"2024-09-21T03:18:30.416893+0000","last_peered":"2024-09-21T03:18:30.416893+0000","last_clean":"2024-09-21T03:18:30.416893+0000","last_became_active":"2024-09-21T03:18:30.406497+0000","last_became_peered":"2024-09-21T03:18:30.406497+0000","last_unstale":"2024-09-21T03:18:30.416893+0000","last_undegraded":"2024-09-21T03:18:30.416893+0000","last_fullsized":"2024-09-21T03:18:30.416893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:12.701313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.396186+0000","last_change":"2024-09-21T03:18:28.396186+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.396186+0000","last_undegraded":"2024-09-21T03:18:28.396186+0000","last_fullsized":"2024-09-21T03:18:28.396186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.388651+0000","last_change":"2024-09-21T03:18:28.388651+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.388651+0000","last_undegraded":"2024-09-21T03:18:28.388651+0000","last_fullsized":"2024-09-21T03:18:28.388651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.383895+0000","last_change":"2024-09-21T03:18:28.383895+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.383895+0000","last_undegraded":"2024-09-21T03:18:28.383895+0000","last_fullsized":"2024-09-21T03:18:28.383895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.387798+0000","last_change":"2024-09-21T03:18:28.387798+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.387798+0000","last_undegraded":"2024-09-21T03:18:28.387798+0000","last_fullsized":"2024-09-21T03:18:28.387798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.383923+0000","last_change":"2024-09-21T03:18:28.383923+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.383923+0000","last_undegraded":"2024-09-21T03:18:28.383923+0000","last_fullsized":"2024-09-21T03:18:28.383923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.387202+0000","last_change":"2024-09-21T03:18:28.387202+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.387202+0000","last_undegraded":"2024-09-21T03:18:28.387202+0000","last_fullsized":"2024-09-21T03:18:28.387202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.416691+0000","last_change":"2024-09-21T03:18:30.404103+0000","last_active":"2024-09-21T03:18:30.416691+0000","last_peered":"2024-09-21T03:18:30.416691+0000","last_clean":"2024-09-21T03:18:30.416691+0000","last_became_active":"2024-09-21T03:18:30.402457+0000","last_became_peered":"2024-09-21T03:18:30.402457+0000","last_unstale":"2024-09-21T03:18:30.416691+0000","last_undegraded":"2024-09-21T03:18:30.416691+0000","last_fullsized":"2024-09-21T03:18:30.416691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:13.113079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.389889+0000","last_change":"2024-09-21T03:18:28.389889+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.389889+0000","last_undegraded":"2024-09-21T03:18:28.389889+0000","last_fullsized":"2024-09-21T03:18:28.389889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.384008+0000","last_change":"2024-09-21T03:18:28.384008+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.384008+0000","last_undegraded":"2024-09-21T03:18:28.384008+0000","last_fullsized":"2024-09-21T03:18:28.384008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.384185+0000","last_change":"2024-09-21T03:18:28.384185+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.384185+0000","last_undegraded":"2024-09-21T03:18:28.384185+0000","last_fullsized":"2024-09-21T03:18:28.384185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.388966+0000","last_change":"2024-09-21T03:18:28.388966+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.388966+0000","last_undegraded":"2024-09-21T03:18:28.388966+0000","last_fullsized":"2024-09-21T03:18:28.388966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.388747+0000","last_change":"2024-09-21T03:18:28.388747+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.388747+0000","last_undegraded":"2024-09-21T03:18:28.388747+0000","last_fullsized":"2024-09-21T03:18:28.388747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.388374+0000","last_change":"2024-09-21T03:18:28.388374+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.388374+0000","last_undegraded":"2024-09-21T03:18:28.388374+0000","last_fullsized":"2024-09-21T03:18:28.388374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.417846+0000","last_change":"2024-09-21T03:18:30.413724+0000","last_active":"2024-09-21T03:18:30.417846+0000","last_peered":"2024-09-21T03:18:30.417846+0000","last_clean":"2024-09-21T03:18:30.417846+0000","last_became_active":"2024-09-21T03:18:30.413106+0000","last_became_peered":"2024-09-21T03:18:30.413106+0000","last_unstale":"2024-09-21T03:18:30.417846+0000","last_undegraded":"2024-09-21T03:18:30.417846+0000","last_fullsized":"2024-09-21T03:18:30.417846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:53.409864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-21T03:18:28.386799+0000","last_change":"2024-09-21T03:18:28.386799+0000","last_active":"2024-09-21T03:18:28.374630+0000","last_peered":"2024-09-21T03:18:28.374630+0000","last_clean":"2024-09-21T03:18:28.374630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:28.386799+0000","last_undegraded":"2024-09-21T03:18:28.386799+0000","last_fullsized":"2024-09-21T03:18:28.386799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:18:29.380433+0000","last_change":"2024-09-21T03:18:29.380433+0000","last_active":"2024-09-21T03:18:29.380433+0000","last_peered":"2024-09-21T03:18:29.380433+0000","last_clean":"2024-09-21T03:18:29.380433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:18:29.380433+0000","last_undegraded":"2024-09-21T03:18:29.380433+0000","last_fullsized":"2024-09-21T03:18:29.380433+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.424469+0000","last_change":"2024-09-21T03:18:29.410309+0000","last_active":"2024-09-21T03:18:30.424469+0000","last_peered":"2024-09-21T03:18:30.424469+0000","last_clean":"2024-09-21T03:18:30.424469+0000","last_became_active":"2024-09-21T03:18:29.409959+0000","last_became_peered":"2024-09-21T03:18:29.409959+0000","last_unstale":"2024-09-21T03:18:30.424469+0000","last_undegraded":"2024-09-21T03:18:30.424469+0000","last_fullsized":"2024-09-21T03:18:30.424469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:52.457819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":20,"acting":20,"num_store_stats":1},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":778240,"data_stored":646436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":827392,"data_stored":665941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:18:35.134 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3f is not active+clean 2024-09-21T03:18:35.134 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.135 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3e is not active+clean 2024-09-21T03:18:35.135 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.135 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3c is not active+clean 2024-09-21T03:18:35.135 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.135 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3b is not active+clean 2024-09-21T03:18:35.135 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.135 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3a is not active+clean 2024-09-21T03:18:35.135 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.135 INFO:tasks.ceph.ceph_manager.ceph:PG 3.39 is not active+clean 2024-09-21T03:18:35.135 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.136 INFO:tasks.ceph.ceph_manager.ceph:PG 3.38 is not active+clean 2024-09-21T03:18:35.136 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.136 INFO:tasks.ceph.ceph_manager.ceph:PG 3.37 is not active+clean 2024-09-21T03:18:35.136 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.136 INFO:tasks.ceph.ceph_manager.ceph:PG 3.36 is not active+clean 2024-09-21T03:18:35.136 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.136 INFO:tasks.ceph.ceph_manager.ceph:PG 3.35 is not active+clean 2024-09-21T03:18:35.136 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.136 INFO:tasks.ceph.ceph_manager.ceph:PG 3.34 is not active+clean 2024-09-21T03:18:35.136 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.136 INFO:tasks.ceph.ceph_manager.ceph:PG 3.33 is not active+clean 2024-09-21T03:18:35.136 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.137 INFO:tasks.ceph.ceph_manager.ceph:PG 3.31 is not active+clean 2024-09-21T03:18:35.137 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.137 INFO:tasks.ceph.ceph_manager.ceph:PG 3.30 is not active+clean 2024-09-21T03:18:35.137 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.137 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2f is not active+clean 2024-09-21T03:18:35.137 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.137 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2e is not active+clean 2024-09-21T03:18:35.137 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.137 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2d is not active+clean 2024-09-21T03:18:35.137 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.137 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2c is not active+clean 2024-09-21T03:18:35.138 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.138 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2a is not active+clean 2024-09-21T03:18:35.138 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.138 INFO:tasks.ceph.ceph_manager.ceph:PG 3.29 is not active+clean 2024-09-21T03:18:35.138 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.138 INFO:tasks.ceph.ceph_manager.ceph:PG 3.28 is not active+clean 2024-09-21T03:18:35.138 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.138 INFO:tasks.ceph.ceph_manager.ceph:PG 3.27 is not active+clean 2024-09-21T03:18:35.138 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.138 INFO:tasks.ceph.ceph_manager.ceph:PG 3.26 is not active+clean 2024-09-21T03:18:35.138 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.139 INFO:tasks.ceph.ceph_manager.ceph:PG 3.25 is not active+clean 2024-09-21T03:18:35.139 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.139 INFO:tasks.ceph.ceph_manager.ceph:PG 3.24 is not active+clean 2024-09-21T03:18:35.139 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.139 INFO:tasks.ceph.ceph_manager.ceph:PG 3.22 is not active+clean 2024-09-21T03:18:35.139 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.139 INFO:tasks.ceph.ceph_manager.ceph:PG 3.21 is not active+clean 2024-09-21T03:18:35.139 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.139 INFO:tasks.ceph.ceph_manager.ceph:PG 3.20 is not active+clean 2024-09-21T03:18:35.139 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.139 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1a is not active+clean 2024-09-21T03:18:35.139 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.140 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1b is not active+clean 2024-09-21T03:18:35.140 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:18:28.386912+0000', 'last_change': '2024-09-21T03:18:28.386912+0000', 'last_active': '2024-09-21T03:18:28.374630+0000', 'last_peered': '2024-09-21T03:18:28.374630+0000', 'last_clean': '2024-09-21T03:18:28.374630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:28.386912+0000', 'last_undegraded': '2024-09-21T03:18:28.386912+0000', 'last_fullsized': '2024-09-21T03:18:28.386912+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T03:18:35.140 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1a is not active+clean 2024-09-21T03:18:35.140 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:18:28.387689+0000', 'last_change': '2024-09-21T03:18:28.387689+0000', 'last_active': '2024-09-21T03:18:28.374630+0000', 'last_peered': '2024-09-21T03:18:28.374630+0000', 'last_clean': '2024-09-21T03:18:28.374630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:28.387689+0000', 'last_undegraded': '2024-09-21T03:18:28.387689+0000', 'last_fullsized': '2024-09-21T03:18:28.387689+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T03:18:35.140 INFO:tasks.ceph.ceph_manager.ceph:PG 2.19 is not active+clean 2024-09-21T03:18:35.140 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:18:28.386748+0000', 'last_change': '2024-09-21T03:18:28.386748+0000', 'last_active': '2024-09-21T03:18:28.374630+0000', 'last_peered': '2024-09-21T03:18:28.374630+0000', 'last_clean': '2024-09-21T03:18:28.374630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:28.386748+0000', 'last_undegraded': '2024-09-21T03:18:28.386748+0000', 'last_fullsized': '2024-09-21T03:18:28.386748+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T03:18:35.140 INFO:tasks.ceph.ceph_manager.ceph:PG 3.18 is not active+clean 2024-09-21T03:18:35.140 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.140 INFO:tasks.ceph.ceph_manager.ceph:PG 2.18 is not active+clean 2024-09-21T03:18:35.140 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:18:28.389605+0000', 'last_change': '2024-09-21T03:18:28.389605+0000', 'last_active': '2024-09-21T03:18:28.374630+0000', 'last_peered': '2024-09-21T03:18:28.374630+0000', 'last_clean': '2024-09-21T03:18:28.374630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:28.389605+0000', 'last_undegraded': '2024-09-21T03:18:28.389605+0000', 'last_fullsized': '2024-09-21T03:18:28.389605+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T03:18:35.140 INFO:tasks.ceph.ceph_manager.ceph:PG 3.19 is not active+clean 2024-09-21T03:18:35.140 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.141 INFO:tasks.ceph.ceph_manager.ceph:PG 2.17 is not active+clean 2024-09-21T03:18:35.141 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:18:28.388297+0000', 'last_change': '2024-09-21T03:18:28.388297+0000', 'last_active': '2024-09-21T03:18:28.374630+0000', 'last_peered': '2024-09-21T03:18:28.374630+0000', 'last_clean': '2024-09-21T03:18:28.374630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:28.388297+0000', 'last_undegraded': '2024-09-21T03:18:28.388297+0000', 'last_fullsized': '2024-09-21T03:18:28.388297+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T03:18:35.141 INFO:tasks.ceph.ceph_manager.ceph:PG 3.16 is not active+clean 2024-09-21T03:18:35.141 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.141 INFO:tasks.ceph.ceph_manager.ceph:PG 2.16 is not active+clean 2024-09-21T03:18:35.141 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:18:28.389738+0000', 'last_change': '2024-09-21T03:18:28.389738+0000', 'last_active': '2024-09-21T03:18:28.374630+0000', 'last_peered': '2024-09-21T03:18:28.374630+0000', 'last_clean': '2024-09-21T03:18:28.374630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:28.389738+0000', 'last_undegraded': '2024-09-21T03:18:28.389738+0000', 'last_fullsized': '2024-09-21T03:18:28.389738+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T03:18:35.141 INFO:tasks.ceph.ceph_manager.ceph:PG 2.15 is not active+clean 2024-09-21T03:18:35.141 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:18:28.384851+0000', 'last_change': '2024-09-21T03:18:28.384851+0000', 'last_active': '2024-09-21T03:18:28.374630+0000', 'last_peered': '2024-09-21T03:18:28.374630+0000', 'last_clean': '2024-09-21T03:18:28.374630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:28.384851+0000', 'last_undegraded': '2024-09-21T03:18:28.384851+0000', 'last_fullsized': '2024-09-21T03:18:28.384851+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T03:18:35.141 INFO:tasks.ceph.ceph_manager.ceph:PG 3.14 is not active+clean 2024-09-21T03:18:35.141 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.142 INFO:tasks.ceph.ceph_manager.ceph:PG 2.14 is not active+clean 2024-09-21T03:18:35.142 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:18:28.390364+0000', 'last_change': '2024-09-21T03:18:28.390364+0000', 'last_active': '2024-09-21T03:18:28.374630+0000', 'last_peered': '2024-09-21T03:18:28.374630+0000', 'last_clean': '2024-09-21T03:18:28.374630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:28.390364+0000', 'last_undegraded': '2024-09-21T03:18:28.390364+0000', 'last_fullsized': '2024-09-21T03:18:28.390364+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T03:18:35.142 INFO:tasks.ceph.ceph_manager.ceph:PG 3.15 is not active+clean 2024-09-21T03:18:35.142 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.142 INFO:tasks.ceph.ceph_manager.ceph:PG 2.12 is not active+clean 2024-09-21T03:18:35.142 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:18:28.389160+0000', 'last_change': '2024-09-21T03:18:28.389160+0000', 'last_active': '2024-09-21T03:18:28.374630+0000', 'last_peered': '2024-09-21T03:18:28.374630+0000', 'last_clean': '2024-09-21T03:18:28.374630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:28.389160+0000', 'last_undegraded': '2024-09-21T03:18:28.389160+0000', 'last_fullsized': '2024-09-21T03:18:28.389160+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T03:18:35.142 INFO:tasks.ceph.ceph_manager.ceph:PG 3.13 is not active+clean 2024-09-21T03:18:35.142 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.142 INFO:tasks.ceph.ceph_manager.ceph:PG 2.11 is not active+clean 2024-09-21T03:18:35.142 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:18:28.387227+0000', 'last_change': '2024-09-21T03:18:28.387227+0000', 'last_active': '2024-09-21T03:18:28.374630+0000', 'last_peered': '2024-09-21T03:18:28.374630+0000', 'last_clean': '2024-09-21T03:18:28.374630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:28.387227+0000', 'last_undegraded': '2024-09-21T03:18:28.387227+0000', 'last_fullsized': '2024-09-21T03:18:28.387227+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T03:18:35.142 INFO:tasks.ceph.ceph_manager.ceph:PG 3.10 is not active+clean 2024-09-21T03:18:35.143 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.143 INFO:tasks.ceph.ceph_manager.ceph:PG 2.10 is not active+clean 2024-09-21T03:18:35.143 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:18:28.396241+0000', 'last_change': '2024-09-21T03:18:28.396241+0000', 'last_active': '2024-09-21T03:18:28.374630+0000', 'last_peered': '2024-09-21T03:18:28.374630+0000', 'last_clean': '2024-09-21T03:18:28.374630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:28.396241+0000', 'last_undegraded': '2024-09-21T03:18:28.396241+0000', 'last_fullsized': '2024-09-21T03:18:28.396241+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T03:18:35.143 INFO:tasks.ceph.ceph_manager.ceph:PG 3.11 is not active+clean 2024-09-21T03:18:35.143 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.143 INFO:tasks.ceph.ceph_manager.ceph:PG 2.f is not active+clean 2024-09-21T03:18:35.143 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:18:28.388366+0000', 'last_change': '2024-09-21T03:18:28.388366+0000', 'last_active': '2024-09-21T03:18:28.374630+0000', 'last_peered': '2024-09-21T03:18:28.374630+0000', 'last_clean': '2024-09-21T03:18:28.374630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:28.388366+0000', 'last_undegraded': '2024-09-21T03:18:28.388366+0000', 'last_fullsized': '2024-09-21T03:18:28.388366+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T03:18:35.143 INFO:tasks.ceph.ceph_manager.ceph:PG 3.e is not active+clean 2024-09-21T03:18:35.143 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.143 INFO:tasks.ceph.ceph_manager.ceph:PG 2.e is not active+clean 2024-09-21T03:18:35.143 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:18:28.396106+0000', 'last_change': '2024-09-21T03:18:28.396106+0000', 'last_active': '2024-09-21T03:18:28.374630+0000', 'last_peered': '2024-09-21T03:18:28.374630+0000', 'last_clean': '2024-09-21T03:18:28.374630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:28.396106+0000', 'last_undegraded': '2024-09-21T03:18:28.396106+0000', 'last_fullsized': '2024-09-21T03:18:28.396106+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T03:18:35.144 INFO:tasks.ceph.ceph_manager.ceph:PG 3.f is not active+clean 2024-09-21T03:18:35.144 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.144 INFO:tasks.ceph.ceph_manager.ceph:PG 2.d is not active+clean 2024-09-21T03:18:35.144 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:18:28.384171+0000', 'last_change': '2024-09-21T03:18:28.384171+0000', 'last_active': '2024-09-21T03:18:28.374630+0000', 'last_peered': '2024-09-21T03:18:28.374630+0000', 'last_clean': '2024-09-21T03:18:28.374630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:28.384171+0000', 'last_undegraded': '2024-09-21T03:18:28.384171+0000', 'last_fullsized': '2024-09-21T03:18:28.384171+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T03:18:35.144 INFO:tasks.ceph.ceph_manager.ceph:PG 3.c is not active+clean 2024-09-21T03:18:35.144 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.144 INFO:tasks.ceph.ceph_manager.ceph:PG 2.c is not active+clean 2024-09-21T03:18:35.144 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:18:28.396107+0000', 'last_change': '2024-09-21T03:18:28.396107+0000', 'last_active': '2024-09-21T03:18:28.374630+0000', 'last_peered': '2024-09-21T03:18:28.374630+0000', 'last_clean': '2024-09-21T03:18:28.374630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:28.396107+0000', 'last_undegraded': '2024-09-21T03:18:28.396107+0000', 'last_fullsized': '2024-09-21T03:18:28.396107+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T03:18:35.144 INFO:tasks.ceph.ceph_manager.ceph:PG 3.d is not active+clean 2024-09-21T03:18:35.144 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.144 INFO:tasks.ceph.ceph_manager.ceph:PG 2.3 is not active+clean 2024-09-21T03:18:35.145 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:18:28.388093+0000', 'last_change': '2024-09-21T03:18:28.388093+0000', 'last_active': '2024-09-21T03:18:28.374630+0000', 'last_peered': '2024-09-21T03:18:28.374630+0000', 'last_clean': '2024-09-21T03:18:28.374630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:28.388093+0000', 'last_undegraded': '2024-09-21T03:18:28.388093+0000', 'last_fullsized': '2024-09-21T03:18:28.388093+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T03:18:35.145 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2 is not active+clean 2024-09-21T03:18:35.145 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.145 INFO:tasks.ceph.ceph_manager.ceph:PG 2.0 is not active+clean 2024-09-21T03:18:35.145 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:18:28.389331+0000', 'last_change': '2024-09-21T03:18:28.389331+0000', 'last_active': '2024-09-21T03:18:28.374630+0000', 'last_peered': '2024-09-21T03:18:28.374630+0000', 'last_clean': '2024-09-21T03:18:28.374630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:28.389331+0000', 'last_undegraded': '2024-09-21T03:18:28.389331+0000', 'last_fullsized': '2024-09-21T03:18:28.389331+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T03:18:35.145 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1 is not active+clean 2024-09-21T03:18:35.145 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:18:28.396186+0000', 'last_change': '2024-09-21T03:18:28.396186+0000', 'last_active': '2024-09-21T03:18:28.374630+0000', 'last_peered': '2024-09-21T03:18:28.374630+0000', 'last_clean': '2024-09-21T03:18:28.374630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:28.396186+0000', 'last_undegraded': '2024-09-21T03:18:28.396186+0000', 'last_fullsized': '2024-09-21T03:18:28.396186+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T03:18:35.145 INFO:tasks.ceph.ceph_manager.ceph:PG 3.0 is not active+clean 2024-09-21T03:18:35.145 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.145 INFO:tasks.ceph.ceph_manager.ceph:PG 2.2 is not active+clean 2024-09-21T03:18:35.145 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:18:28.388651+0000', 'last_change': '2024-09-21T03:18:28.388651+0000', 'last_active': '2024-09-21T03:18:28.374630+0000', 'last_peered': '2024-09-21T03:18:28.374630+0000', 'last_clean': '2024-09-21T03:18:28.374630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:28.388651+0000', 'last_undegraded': '2024-09-21T03:18:28.388651+0000', 'last_fullsized': '2024-09-21T03:18:28.388651+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T03:18:35.146 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3 is not active+clean 2024-09-21T03:18:35.146 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.146 INFO:tasks.ceph.ceph_manager.ceph:PG 2.4 is not active+clean 2024-09-21T03:18:35.146 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:18:28.383895+0000', 'last_change': '2024-09-21T03:18:28.383895+0000', 'last_active': '2024-09-21T03:18:28.374630+0000', 'last_peered': '2024-09-21T03:18:28.374630+0000', 'last_clean': '2024-09-21T03:18:28.374630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:28.383895+0000', 'last_undegraded': '2024-09-21T03:18:28.383895+0000', 'last_fullsized': '2024-09-21T03:18:28.383895+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T03:18:35.146 INFO:tasks.ceph.ceph_manager.ceph:PG 3.5 is not active+clean 2024-09-21T03:18:35.146 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.146 INFO:tasks.ceph.ceph_manager.ceph:PG 2.5 is not active+clean 2024-09-21T03:18:35.146 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:18:28.387798+0000', 'last_change': '2024-09-21T03:18:28.387798+0000', 'last_active': '2024-09-21T03:18:28.374630+0000', 'last_peered': '2024-09-21T03:18:28.374630+0000', 'last_clean': '2024-09-21T03:18:28.374630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:28.387798+0000', 'last_undegraded': '2024-09-21T03:18:28.387798+0000', 'last_fullsized': '2024-09-21T03:18:28.387798+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T03:18:35.146 INFO:tasks.ceph.ceph_manager.ceph:PG 3.4 is not active+clean 2024-09-21T03:18:35.146 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.146 INFO:tasks.ceph.ceph_manager.ceph:PG 2.6 is not active+clean 2024-09-21T03:18:35.147 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:18:28.383923+0000', 'last_change': '2024-09-21T03:18:28.383923+0000', 'last_active': '2024-09-21T03:18:28.374630+0000', 'last_peered': '2024-09-21T03:18:28.374630+0000', 'last_clean': '2024-09-21T03:18:28.374630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:28.383923+0000', 'last_undegraded': '2024-09-21T03:18:28.383923+0000', 'last_fullsized': '2024-09-21T03:18:28.383923+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T03:18:35.147 INFO:tasks.ceph.ceph_manager.ceph:PG 3.7 is not active+clean 2024-09-21T03:18:35.147 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.147 INFO:tasks.ceph.ceph_manager.ceph:PG 2.7 is not active+clean 2024-09-21T03:18:35.147 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:18:28.387202+0000', 'last_change': '2024-09-21T03:18:28.387202+0000', 'last_active': '2024-09-21T03:18:28.374630+0000', 'last_peered': '2024-09-21T03:18:28.374630+0000', 'last_clean': '2024-09-21T03:18:28.374630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:28.387202+0000', 'last_undegraded': '2024-09-21T03:18:28.387202+0000', 'last_fullsized': '2024-09-21T03:18:28.387202+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T03:18:35.147 INFO:tasks.ceph.ceph_manager.ceph:PG 2.8 is not active+clean 2024-09-21T03:18:35.147 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:18:28.389889+0000', 'last_change': '2024-09-21T03:18:28.389889+0000', 'last_active': '2024-09-21T03:18:28.374630+0000', 'last_peered': '2024-09-21T03:18:28.374630+0000', 'last_clean': '2024-09-21T03:18:28.374630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:28.389889+0000', 'last_undegraded': '2024-09-21T03:18:28.389889+0000', 'last_fullsized': '2024-09-21T03:18:28.389889+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T03:18:35.147 INFO:tasks.ceph.ceph_manager.ceph:PG 3.9 is not active+clean 2024-09-21T03:18:35.147 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.147 INFO:tasks.ceph.ceph_manager.ceph:PG 2.9 is not active+clean 2024-09-21T03:18:35.148 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:18:28.384008+0000', 'last_change': '2024-09-21T03:18:28.384008+0000', 'last_active': '2024-09-21T03:18:28.374630+0000', 'last_peered': '2024-09-21T03:18:28.374630+0000', 'last_clean': '2024-09-21T03:18:28.374630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:28.384008+0000', 'last_undegraded': '2024-09-21T03:18:28.384008+0000', 'last_fullsized': '2024-09-21T03:18:28.384008+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T03:18:35.148 INFO:tasks.ceph.ceph_manager.ceph:PG 3.8 is not active+clean 2024-09-21T03:18:35.148 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.148 INFO:tasks.ceph.ceph_manager.ceph:PG 2.a is not active+clean 2024-09-21T03:18:35.148 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:18:28.384185+0000', 'last_change': '2024-09-21T03:18:28.384185+0000', 'last_active': '2024-09-21T03:18:28.374630+0000', 'last_peered': '2024-09-21T03:18:28.374630+0000', 'last_clean': '2024-09-21T03:18:28.374630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:28.384185+0000', 'last_undegraded': '2024-09-21T03:18:28.384185+0000', 'last_fullsized': '2024-09-21T03:18:28.384185+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T03:18:35.148 INFO:tasks.ceph.ceph_manager.ceph:PG 3.b is not active+clean 2024-09-21T03:18:35.148 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.148 INFO:tasks.ceph.ceph_manager.ceph:PG 2.b is not active+clean 2024-09-21T03:18:35.148 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:18:28.388966+0000', 'last_change': '2024-09-21T03:18:28.388966+0000', 'last_active': '2024-09-21T03:18:28.374630+0000', 'last_peered': '2024-09-21T03:18:28.374630+0000', 'last_clean': '2024-09-21T03:18:28.374630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:28.388966+0000', 'last_undegraded': '2024-09-21T03:18:28.388966+0000', 'last_fullsized': '2024-09-21T03:18:28.388966+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T03:18:35.148 INFO:tasks.ceph.ceph_manager.ceph:PG 3.a is not active+clean 2024-09-21T03:18:35.148 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.149 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1d is not active+clean 2024-09-21T03:18:35.149 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.149 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1c is not active+clean 2024-09-21T03:18:35.149 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:18:28.388747+0000', 'last_change': '2024-09-21T03:18:28.388747+0000', 'last_active': '2024-09-21T03:18:28.374630+0000', 'last_peered': '2024-09-21T03:18:28.374630+0000', 'last_clean': '2024-09-21T03:18:28.374630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:28.388747+0000', 'last_undegraded': '2024-09-21T03:18:28.388747+0000', 'last_fullsized': '2024-09-21T03:18:28.388747+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T03:18:35.149 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1c is not active+clean 2024-09-21T03:18:35.149 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.149 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1d is not active+clean 2024-09-21T03:18:35.149 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:18:28.388374+0000', 'last_change': '2024-09-21T03:18:28.388374+0000', 'last_active': '2024-09-21T03:18:28.374630+0000', 'last_peered': '2024-09-21T03:18:28.374630+0000', 'last_clean': '2024-09-21T03:18:28.374630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:28.388374+0000', 'last_undegraded': '2024-09-21T03:18:28.388374+0000', 'last_fullsized': '2024-09-21T03:18:28.388374+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T03:18:35.149 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1e is not active+clean 2024-09-21T03:18:35.149 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:18:28.386799+0000', 'last_change': '2024-09-21T03:18:28.386799+0000', 'last_active': '2024-09-21T03:18:28.374630+0000', 'last_peered': '2024-09-21T03:18:28.374630+0000', 'last_clean': '2024-09-21T03:18:28.374630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:28.386799+0000', 'last_undegraded': '2024-09-21T03:18:28.386799+0000', 'last_fullsized': '2024-09-21T03:18:28.386799+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:28.374630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T03:18:35.150 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1e is not active+clean 2024-09-21T03:18:35.150 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:18:29.380433+0000', 'last_change': '2024-09-21T03:18:29.380433+0000', 'last_active': '2024-09-21T03:18:29.380433+0000', 'last_peered': '2024-09-21T03:18:29.380433+0000', 'last_clean': '2024-09-21T03:18:29.380433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:18:29.380433+0000', 'last_undegraded': '2024-09-21T03:18:29.380433+0000', 'last_fullsized': '2024-09-21T03:18:29.380433+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'last_clean_scrub_stamp': '2024-09-21T03:18:29.380433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:18:35.150 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T03:18:35.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.280+0000 7f92bcb83640 1 -- 172.21.15.105:0/3843336525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92b80b9b60 msgr2=0x7f92b80d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:35.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.280+0000 7f92bcb83640 1 --2- 172.21.15.105:0/3843336525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92b80b9b60 0x7f92b80d0fb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f92a8005fd0 tx=0x7f92a802a540 comp rx=0 tx=0).stop 2024-09-21T03:18:35.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.280+0000 7f92bcb83640 1 -- 172.21.15.105:0/3843336525 shutdown_connections 2024-09-21T03:18:35.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.280+0000 7f92bcb83640 1 --2- 172.21.15.105:0/3843336525 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92b80b3a10 0x7f92b80d14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:35.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.280+0000 7f92bcb83640 1 --2- 172.21.15.105:0/3843336525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92b80b9b60 0x7f92b80d0fb0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:35.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.280+0000 7f92bcb83640 1 -- 172.21.15.105:0/3843336525 >> 172.21.15.105:0/3843336525 conn(0x7f92b809d8f0 msgr2=0x7f92b80d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:35.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.280+0000 7f92bcb83640 1 -- 172.21.15.105:0/3843336525 shutdown_connections 2024-09-21T03:18:35.283 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.280+0000 7f92bcb83640 1 -- 172.21.15.105:0/3843336525 wait complete. 2024-09-21T03:18:35.283 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.282+0000 7f92bcb83640 1 Processor -- start 2024-09-21T03:18:35.283 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.282+0000 7f92bcb83640 1 -- start start 2024-09-21T03:18:35.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.283+0000 7f92bcb83640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92b80b3a10 0x7f92b80cc310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:35.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.283+0000 7f92bcb83640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92b80b9b60 0x7f92b80ca390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:35.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.283+0000 7f92bcb83640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92b8162430 0x7f92b8157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:35.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.283+0000 7f92bcb83640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f92b81630d0 con 0x7f92b8162430 2024-09-21T03:18:35.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.283+0000 7f92bcb83640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f92b8162f50 con 0x7f92b80b3a10 2024-09-21T03:18:35.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.283+0000 7f92bcb83640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f92b8163250 con 0x7f92b80b9b60 2024-09-21T03:18:35.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.283+0000 7f92b6d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92b8162430 0x7f92b8157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:35.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.283+0000 7f92b6d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92b8162430 0x7f92b8157590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56424/0 (socket says 172.21.15.105:56424) 2024-09-21T03:18:35.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.283+0000 7f92b6d9d640 1 -- 172.21.15.105:0/4171453806 learned_addr learned my addr 172.21.15.105:0/4171453806 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:35.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.283+0000 7f92affff640 1 --2- 172.21.15.105:0/4171453806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92b80b9b60 0x7f92b80ca390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:35.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.283+0000 7f92b659c640 1 --2- 172.21.15.105:0/4171453806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92b80b3a10 0x7f92b80cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:35.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.284+0000 7f92b6d9d640 1 -- 172.21.15.105:0/4171453806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92b80b9b60 msgr2=0x7f92b80ca390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:35.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.284+0000 7f92b6d9d640 1 --2- 172.21.15.105:0/4171453806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92b80b9b60 0x7f92b80ca390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:35.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.284+0000 7f92b6d9d640 1 -- 172.21.15.105:0/4171453806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92b80b3a10 msgr2=0x7f92b80cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:35.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.284+0000 7f92b6d9d640 1 --2- 172.21.15.105:0/4171453806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92b80b3a10 0x7f92b80cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:35.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.284+0000 7f92b6d9d640 1 -- 172.21.15.105:0/4171453806 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92b80ca8d0 con 0x7f92b8162430 2024-09-21T03:18:35.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.284+0000 7f92b659c640 1 --2- 172.21.15.105:0/4171453806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92b80b3a10 0x7f92b80cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:18:35.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.284+0000 7f92b6d9d640 1 --2- 172.21.15.105:0/4171453806 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92b8162430 0x7f92b8157590 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f92b000c760 tx=0x7f92b000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:35.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.284+0000 7f92aeffd640 1 -- 172.21.15.105:0/4171453806 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b0003b70 con 0x7f92b8162430 2024-09-21T03:18:35.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.284+0000 7f92aeffd640 1 -- 172.21.15.105:0/4171453806 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92b0003d10 con 0x7f92b8162430 2024-09-21T03:18:35.288 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.284+0000 7f92bcb83640 1 -- 172.21.15.105:0/4171453806 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92b80cade0 con 0x7f92b8162430 2024-09-21T03:18:35.288 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.284+0000 7f92aeffd640 1 -- 172.21.15.105:0/4171453806 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b000aab0 con 0x7f92b8162430 2024-09-21T03:18:35.288 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.284+0000 7f92bcb83640 1 -- 172.21.15.105:0/4171453806 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92b80cb830 con 0x7f92b8162430 2024-09-21T03:18:35.288 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.285+0000 7f92bcb83640 1 -- 172.21.15.105:0/4171453806 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92b80cab30 con 0x7f92b8162430 2024-09-21T03:18:35.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.286+0000 7f92aeffd640 1 -- 172.21.15.105:0/4171453806 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f92b000ac50 con 0x7f92b8162430 2024-09-21T03:18:35.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.286+0000 7f92aeffd640 1 --2- 172.21.15.105:0/4171453806 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9298078bc0 0x7f929807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:35.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.286+0000 7f92aeffd640 1 -- 172.21.15.105:0/4171453806 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f92b009a9e0 con 0x7f92b8162430 2024-09-21T03:18:35.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.287+0000 7f92b659c640 1 --2- 172.21.15.105:0/4171453806 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9298078bc0 0x7f929807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:35.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.287+0000 7f92b659c640 1 --2- 172.21.15.105:0/4171453806 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9298078bc0 0x7f929807b0d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f92a8033000 tx=0x7f92a8004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:35.292 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.291+0000 7f92aeffd640 1 -- 172.21.15.105:0/4171453806 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f92b0062eb0 con 0x7f92b8162430 2024-09-21T03:18:35.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.537+0000 7f92bcb83640 1 -- 172.21.15.105:0/4171453806 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f92b8162840 con 0x7f92b8162430 2024-09-21T03:18:35.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.538+0000 7f92aeffd640 1 -- 172.21.15.105:0/4171453806 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1053 (secure 0 0 0) 0x7f92b00627b0 con 0x7f92b8162430 2024-09-21T03:18:35.540 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:18:35.540 INFO:teuthology.orchestra.run.smithi105.stdout:{"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":30,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":23,"num_osds":8,"num_up_osds":8,"osd_up_since":1726888698,"num_in_osds":8,"osd_in_since":1726888688,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":224542720,"bytes_avail":772869570560,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":8,"btime":"2024-09-21T03:18:33:412826+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"d","status":"up:active","gid":4401}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-21T03:18:04.841857+0000","services":{}},"progress_events":{}} 2024-09-21T03:18:35.542 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.540+0000 7f92bcb83640 1 -- 172.21.15.105:0/4171453806 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9298078bc0 msgr2=0x7f929807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:35.542 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.540+0000 7f92bcb83640 1 --2- 172.21.15.105:0/4171453806 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9298078bc0 0x7f929807b0d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f92a8033000 tx=0x7f92a8004730 comp rx=0 tx=0).stop 2024-09-21T03:18:35.542 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.540+0000 7f92bcb83640 1 -- 172.21.15.105:0/4171453806 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92b8162430 msgr2=0x7f92b8157590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:35.542 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.540+0000 7f92bcb83640 1 --2- 172.21.15.105:0/4171453806 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92b8162430 0x7f92b8157590 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f92b000c760 tx=0x7f92b000cc20 comp rx=0 tx=0).stop 2024-09-21T03:18:35.542 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.540+0000 7f92bcb83640 1 -- 172.21.15.105:0/4171453806 shutdown_connections 2024-09-21T03:18:35.542 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.540+0000 7f92bcb83640 1 --2- 172.21.15.105:0/4171453806 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9298078bc0 0x7f929807b0d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:35.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.540+0000 7f92bcb83640 1 --2- 172.21.15.105:0/4171453806 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92b8162430 0x7f92b8157590 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:35.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.540+0000 7f92bcb83640 1 --2- 172.21.15.105:0/4171453806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92b80b9b60 0x7f92b80ca390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:35.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.540+0000 7f92bcb83640 1 --2- 172.21.15.105:0/4171453806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92b80b3a10 0x7f92b80cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:35.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.540+0000 7f92bcb83640 1 -- 172.21.15.105:0/4171453806 >> 172.21.15.105:0/4171453806 conn(0x7f92b809d8f0 msgr2=0x7f92b80b8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:35.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.540+0000 7f92bcb83640 1 -- 172.21.15.105:0/4171453806 shutdown_connections 2024-09-21T03:18:35.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.540+0000 7f92bcb83640 1 -- 172.21.15.105:0/4171453806 wait complete. 2024-09-21T03:18:35.553 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-21T03:18:35.553 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:18:35.666 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.664+0000 7f06b0e15640 1 -- 172.21.15.105:0/3132139811 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06ac0b4360 msgr2=0x7f06ac0727e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:35.667 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.664+0000 7f06b0e15640 1 --2- 172.21.15.105:0/3132139811 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06ac0b4360 0x7f06ac0727e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f06ac074c90 tx=0x7f06a402a980 comp rx=0 tx=0).stop 2024-09-21T03:18:35.667 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.665+0000 7f06b0e15640 1 -- 172.21.15.105:0/3132139811 shutdown_connections 2024-09-21T03:18:35.667 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.665+0000 7f06b0e15640 1 --2- 172.21.15.105:0/3132139811 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06ac0b4360 0x7f06ac0727e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:35.667 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.665+0000 7f06b0e15640 1 --2- 172.21.15.105:0/3132139811 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06ac160c90 0x7f06ac0b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:35.667 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.665+0000 7f06b0e15640 1 --2- 172.21.15.105:0/3132139811 >> v2:172.21.15.162:3300/0 conn(0x7f06ac0cff70 0x7f06ac15c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:35.667 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.665+0000 7f06b0e15640 1 -- 172.21.15.105:0/3132139811 >> 172.21.15.105:0/3132139811 conn(0x7f06ac0cee20 msgr2=0x7f06ac0cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:35.667 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.665+0000 7f06b0e15640 1 -- 172.21.15.105:0/3132139811 shutdown_connections 2024-09-21T03:18:35.667 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.665+0000 7f06b0e15640 1 -- 172.21.15.105:0/3132139811 wait complete. 2024-09-21T03:18:35.668 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.667+0000 7f06b0e15640 1 Processor -- start 2024-09-21T03:18:35.668 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.667+0000 7f06b0e15640 1 -- start start 2024-09-21T03:18:35.671 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.668+0000 7f06b0e15640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06ac0b4360 0x7f06ac0cc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:35.671 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.668+0000 7f06b0e15640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06ac0cff70 0x7f06ac1f6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:35.671 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.668+0000 7f06b0e15640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06ac160c90 0x7f06ac159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:35.671 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.668+0000 7f06b0e15640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f06ac073160 con 0x7f06ac0cff70 2024-09-21T03:18:35.671 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.668+0000 7f06b0e15640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f06ac072fe0 con 0x7f06ac0b4360 2024-09-21T03:18:35.671 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.668+0000 7f06b0e15640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f06ac0732e0 con 0x7f06ac160c90 2024-09-21T03:18:35.671 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.668+0000 7f06a9d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06ac0cff70 0x7f06ac1f6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:35.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.668+0000 7f06a9d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06ac0cff70 0x7f06ac1f6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56444/0 (socket says 172.21.15.105:56444) 2024-09-21T03:18:35.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.668+0000 7f06a9d9b640 1 -- 172.21.15.105:0/2207879885 learned_addr learned my addr 172.21.15.105:0/2207879885 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:35.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.668+0000 7f06aa59c640 1 --2- 172.21.15.105:0/2207879885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06ac0b4360 0x7f06ac0cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:35.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.668+0000 7f06aad9d640 1 --2- 172.21.15.105:0/2207879885 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06ac160c90 0x7f06ac159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:35.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.668+0000 7f06a9d9b640 1 -- 172.21.15.105:0/2207879885 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06ac160c90 msgr2=0x7f06ac159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:35.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.668+0000 7f06a9d9b640 1 --2- 172.21.15.105:0/2207879885 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06ac160c90 0x7f06ac159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:35.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.668+0000 7f06a9d9b640 1 -- 172.21.15.105:0/2207879885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06ac0b4360 msgr2=0x7f06ac0cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:35.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.668+0000 7f06a9d9b640 1 --2- 172.21.15.105:0/2207879885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06ac0b4360 0x7f06ac0cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:35.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.668+0000 7f06a9d9b640 1 -- 172.21.15.105:0/2207879885 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06ac1494a0 con 0x7f06ac0cff70 2024-09-21T03:18:35.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.668+0000 7f06a9d9b640 1 --2- 172.21.15.105:0/2207879885 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06ac0cff70 0x7f06ac1f6b80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f06a000d750 tx=0x7f06a000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:35.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.669+0000 7f069affd640 1 -- 172.21.15.105:0/2207879885 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a0017070 con 0x7f06ac0cff70 2024-09-21T03:18:35.673 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.669+0000 7f069affd640 1 -- 172.21.15.105:0/2207879885 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06a0004310 con 0x7f06ac0cff70 2024-09-21T03:18:35.673 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.669+0000 7f06b0e15640 1 -- 172.21.15.105:0/2207879885 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06ac0cb3d0 con 0x7f06ac0cff70 2024-09-21T03:18:35.673 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.669+0000 7f069affd640 1 -- 172.21.15.105:0/2207879885 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a000de60 con 0x7f06ac0cff70 2024-09-21T03:18:35.673 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.669+0000 7f06b0e15640 1 -- 172.21.15.105:0/2207879885 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06ac0cb990 con 0x7f06ac0cff70 2024-09-21T03:18:35.673 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.670+0000 7f06b0e15640 1 -- 172.21.15.105:0/2207879885 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06ac0727e0 con 0x7f06ac0cff70 2024-09-21T03:18:35.674 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.670+0000 7f069affd640 1 -- 172.21.15.105:0/2207879885 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f06a0009c30 con 0x7f06ac0cff70 2024-09-21T03:18:35.674 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.671+0000 7f069affd640 1 --2- 172.21.15.105:0/2207879885 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f068c078bc0 0x7f068c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:35.674 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.671+0000 7f069affd640 1 -- 172.21.15.105:0/2207879885 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f06a009b020 con 0x7f06ac0cff70 2024-09-21T03:18:35.674 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.671+0000 7f06aa59c640 1 --2- 172.21.15.105:0/2207879885 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f068c078bc0 0x7f068c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:35.674 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.672+0000 7f06aa59c640 1 --2- 172.21.15.105:0/2207879885 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f068c078bc0 0x7f068c07b0d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f069c009ab0 tx=0x7f069c005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:35.677 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.676+0000 7f069affd640 1 -- 172.21.15.105:0/2207879885 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f06a0020020 con 0x7f06ac0cff70 2024-09-21T03:18:35.850 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.848+0000 7f06b0e15640 1 -- 172.21.15.105:0/2207879885 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f06ac0c8eb0 con 0x7f068c078bc0 2024-09-21T03:18:35.855 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.853+0000 7f069affd640 1 -- 172.21.15.105:0/2207879885 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251935 (secure 0 0 0) 0x7f069c011b80 con 0x7f068c078bc0 2024-09-21T03:18:35.858 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:18:35.859 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:18:35.860 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.857+0000 7f06b0e15640 1 -- 172.21.15.105:0/2207879885 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f068c078bc0 msgr2=0x7f068c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:35.860 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.857+0000 7f06b0e15640 1 --2- 172.21.15.105:0/2207879885 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f068c078bc0 0x7f068c07b0d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f069c009ab0 tx=0x7f069c005f90 comp rx=0 tx=0).stop 2024-09-21T03:18:35.860 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.857+0000 7f06b0e15640 1 -- 172.21.15.105:0/2207879885 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06ac0cff70 msgr2=0x7f06ac1f6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:35.861 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.857+0000 7f06b0e15640 1 --2- 172.21.15.105:0/2207879885 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06ac0cff70 0x7f06ac1f6b80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f06a000d750 tx=0x7f06a000dc10 comp rx=0 tx=0).stop 2024-09-21T03:18:35.861 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.857+0000 7f06b0e15640 1 -- 172.21.15.105:0/2207879885 shutdown_connections 2024-09-21T03:18:35.861 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.857+0000 7f06b0e15640 1 --2- 172.21.15.105:0/2207879885 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f068c078bc0 0x7f068c07b0d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:35.861 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.857+0000 7f06b0e15640 1 --2- 172.21.15.105:0/2207879885 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06ac160c90 0x7f06ac159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:35.861 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.857+0000 7f06b0e15640 1 --2- 172.21.15.105:0/2207879885 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06ac0cff70 0x7f06ac1f6b80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:35.861 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.857+0000 7f06b0e15640 1 --2- 172.21.15.105:0/2207879885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06ac0b4360 0x7f06ac0cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:35.861 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.857+0000 7f06b0e15640 1 -- 172.21.15.105:0/2207879885 >> 172.21.15.105:0/2207879885 conn(0x7f06ac0cee20 msgr2=0x7f06ac156930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:35.861 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.857+0000 7f06b0e15640 1 -- 172.21.15.105:0/2207879885 shutdown_connections 2024-09-21T03:18:35.861 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:35.857+0000 7f06b0e15640 1 -- 172.21.15.105:0/2207879885 wait complete. 2024-09-21T03:18:35.869 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-21T03:18:35.279821+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":147,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219280,"kb_used_data":3036,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755440,"statfs":{"total":773094113280,"available":772869570560,"internally_reserved":0,"allocated":3108864,"data_stored":1829136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001747"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964347+0000","last_change":"2024-09-21T03:18:30.421775+0000","last_active":"2024-09-21T03:18:31.964347+0000","last_peered":"2024-09-21T03:18:31.964347+0000","last_clean":"2024-09-21T03:18:31.964347+0000","last_became_active":"2024-09-21T03:18:30.421134+0000","last_became_peered":"2024-09-21T03:18:30.421134+0000","last_unstale":"2024-09-21T03:18:31.964347+0000","last_undegraded":"2024-09-21T03:18:31.964347+0000","last_fullsized":"2024-09-21T03:18:31.964347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:22:19.398695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963048+0000","last_change":"2024-09-21T03:18:30.413336+0000","last_active":"2024-09-21T03:18:31.963048+0000","last_peered":"2024-09-21T03:18:31.963048+0000","last_clean":"2024-09-21T03:18:31.963048+0000","last_became_active":"2024-09-21T03:18:30.412935+0000","last_became_peered":"2024-09-21T03:18:30.412935+0000","last_unstale":"2024-09-21T03:18:31.963048+0000","last_undegraded":"2024-09-21T03:18:31.963048+0000","last_fullsized":"2024-09-21T03:18:31.963048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:23.469160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.416577+0000","last_change":"2024-09-21T03:18:30.406431+0000","last_active":"2024-09-21T03:18:30.416577+0000","last_peered":"2024-09-21T03:18:30.416577+0000","last_clean":"2024-09-21T03:18:30.416577+0000","last_became_active":"2024-09-21T03:18:30.406082+0000","last_became_peered":"2024-09-21T03:18:30.406082+0000","last_unstale":"2024-09-21T03:18:30.416577+0000","last_undegraded":"2024-09-21T03:18:30.416577+0000","last_fullsized":"2024-09-21T03:18:30.416577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:40:51.365359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964108+0000","last_change":"2024-09-21T03:18:30.420362+0000","last_active":"2024-09-21T03:18:31.964108+0000","last_peered":"2024-09-21T03:18:31.964108+0000","last_clean":"2024-09-21T03:18:31.964108+0000","last_became_active":"2024-09-21T03:18:30.420008+0000","last_became_peered":"2024-09-21T03:18:30.420008+0000","last_unstale":"2024-09-21T03:18:31.964108+0000","last_undegraded":"2024-09-21T03:18:31.964108+0000","last_fullsized":"2024-09-21T03:18:31.964108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:03.282327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964438+0000","last_change":"2024-09-21T03:18:30.418302+0000","last_active":"2024-09-21T03:18:31.964438+0000","last_peered":"2024-09-21T03:18:31.964438+0000","last_clean":"2024-09-21T03:18:31.964438+0000","last_became_active":"2024-09-21T03:18:30.413965+0000","last_became_peered":"2024-09-21T03:18:30.413965+0000","last_unstale":"2024-09-21T03:18:31.964438+0000","last_undegraded":"2024-09-21T03:18:31.964438+0000","last_fullsized":"2024-09-21T03:18:31.964438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:03.282327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963716+0000","last_change":"2024-09-21T03:18:30.417641+0000","last_active":"2024-09-21T03:18:31.963716+0000","last_peered":"2024-09-21T03:18:31.963716+0000","last_clean":"2024-09-21T03:18:31.963716+0000","last_became_active":"2024-09-21T03:18:30.417338+0000","last_became_peered":"2024-09-21T03:18:30.417338+0000","last_unstale":"2024-09-21T03:18:31.963716+0000","last_undegraded":"2024-09-21T03:18:31.963716+0000","last_fullsized":"2024-09-21T03:18:31.963716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:23.551826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963715+0000","last_change":"2024-09-21T03:18:30.420816+0000","last_active":"2024-09-21T03:18:31.963715+0000","last_peered":"2024-09-21T03:18:31.963715+0000","last_clean":"2024-09-21T03:18:31.963715+0000","last_became_active":"2024-09-21T03:18:30.419232+0000","last_became_peered":"2024-09-21T03:18:30.419232+0000","last_unstale":"2024-09-21T03:18:31.963715+0000","last_undegraded":"2024-09-21T03:18:31.963715+0000","last_fullsized":"2024-09-21T03:18:31.963715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:42.098569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406163+0000","last_change":"2024-09-21T03:18:30.412879+0000","last_active":"2024-09-21T03:18:31.406163+0000","last_peered":"2024-09-21T03:18:31.406163+0000","last_clean":"2024-09-21T03:18:31.406163+0000","last_became_active":"2024-09-21T03:18:30.412496+0000","last_became_peered":"2024-09-21T03:18:30.412496+0000","last_unstale":"2024-09-21T03:18:31.406163+0000","last_undegraded":"2024-09-21T03:18:31.406163+0000","last_fullsized":"2024-09-21T03:18:31.406163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:27.777960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964687+0000","last_change":"2024-09-21T03:18:30.421800+0000","last_active":"2024-09-21T03:18:31.964687+0000","last_peered":"2024-09-21T03:18:31.964687+0000","last_clean":"2024-09-21T03:18:31.964687+0000","last_became_active":"2024-09-21T03:18:30.421488+0000","last_became_peered":"2024-09-21T03:18:30.421488+0000","last_unstale":"2024-09-21T03:18:31.964687+0000","last_undegraded":"2024-09-21T03:18:31.964687+0000","last_fullsized":"2024-09-21T03:18:31.964687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:52:00.902253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.410872+0000","last_change":"2024-09-21T03:18:30.412736+0000","last_active":"2024-09-21T03:18:31.410872+0000","last_peered":"2024-09-21T03:18:31.410872+0000","last_clean":"2024-09-21T03:18:31.410872+0000","last_became_active":"2024-09-21T03:18:30.412083+0000","last_became_peered":"2024-09-21T03:18:30.412083+0000","last_unstale":"2024-09-21T03:18:31.410872+0000","last_undegraded":"2024-09-21T03:18:31.410872+0000","last_fullsized":"2024-09-21T03:18:31.410872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:14:17.253259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.409843+0000","last_change":"2024-09-21T03:18:30.413123+0000","last_active":"2024-09-21T03:18:31.409843+0000","last_peered":"2024-09-21T03:18:31.409843+0000","last_clean":"2024-09-21T03:18:31.409843+0000","last_became_active":"2024-09-21T03:18:30.412788+0000","last_became_peered":"2024-09-21T03:18:30.412788+0000","last_unstale":"2024-09-21T03:18:31.409843+0000","last_undegraded":"2024-09-21T03:18:31.409843+0000","last_fullsized":"2024-09-21T03:18:31.409843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:37:21.324892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.409635+0000","last_change":"2024-09-21T03:18:30.396144+0000","last_active":"2024-09-21T03:18:31.409635+0000","last_peered":"2024-09-21T03:18:31.409635+0000","last_clean":"2024-09-21T03:18:31.409635+0000","last_became_active":"2024-09-21T03:18:30.395814+0000","last_became_peered":"2024-09-21T03:18:30.395814+0000","last_unstale":"2024-09-21T03:18:31.409635+0000","last_undegraded":"2024-09-21T03:18:31.409635+0000","last_fullsized":"2024-09-21T03:18:31.409635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:44.020518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406573+0000","last_change":"2024-09-21T03:18:30.402434+0000","last_active":"2024-09-21T03:18:31.406573+0000","last_peered":"2024-09-21T03:18:31.406573+0000","last_clean":"2024-09-21T03:18:31.406573+0000","last_became_active":"2024-09-21T03:18:30.402116+0000","last_became_peered":"2024-09-21T03:18:30.402116+0000","last_unstale":"2024-09-21T03:18:31.406573+0000","last_undegraded":"2024-09-21T03:18:31.406573+0000","last_fullsized":"2024-09-21T03:18:31.406573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:21.239439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.416643+0000","last_change":"2024-09-21T03:18:30.407726+0000","last_active":"2024-09-21T03:18:30.416643+0000","last_peered":"2024-09-21T03:18:30.416643+0000","last_clean":"2024-09-21T03:18:30.416643+0000","last_became_active":"2024-09-21T03:18:30.404823+0000","last_became_peered":"2024-09-21T03:18:30.404823+0000","last_unstale":"2024-09-21T03:18:30.416643+0000","last_undegraded":"2024-09-21T03:18:30.416643+0000","last_fullsized":"2024-09-21T03:18:30.416643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:12:45.656423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963083+0000","last_change":"2024-09-21T03:18:30.400323+0000","last_active":"2024-09-21T03:18:31.963083+0000","last_peered":"2024-09-21T03:18:31.963083+0000","last_clean":"2024-09-21T03:18:31.963083+0000","last_became_active":"2024-09-21T03:18:30.399972+0000","last_became_peered":"2024-09-21T03:18:30.399972+0000","last_unstale":"2024-09-21T03:18:31.963083+0000","last_undegraded":"2024-09-21T03:18:31.963083+0000","last_fullsized":"2024-09-21T03:18:31.963083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:15.659300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963314+0000","last_change":"2024-09-21T03:18:30.418155+0000","last_active":"2024-09-21T03:18:31.963314+0000","last_peered":"2024-09-21T03:18:31.963314+0000","last_clean":"2024-09-21T03:18:31.963314+0000","last_became_active":"2024-09-21T03:18:30.417794+0000","last_became_peered":"2024-09-21T03:18:30.417794+0000","last_unstale":"2024-09-21T03:18:31.963314+0000","last_undegraded":"2024-09-21T03:18:31.963314+0000","last_fullsized":"2024-09-21T03:18:31.963314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:15.659300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963961+0000","last_change":"2024-09-21T03:18:30.411196+0000","last_active":"2024-09-21T03:18:31.963961+0000","last_peered":"2024-09-21T03:18:31.963961+0000","last_clean":"2024-09-21T03:18:31.963961+0000","last_became_active":"2024-09-21T03:18:30.410865+0000","last_became_peered":"2024-09-21T03:18:30.410865+0000","last_unstale":"2024-09-21T03:18:31.963961+0000","last_undegraded":"2024-09-21T03:18:31.963961+0000","last_fullsized":"2024-09-21T03:18:31.963961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:54.882986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963694+0000","last_change":"2024-09-21T03:18:30.400114+0000","last_active":"2024-09-21T03:18:31.963694+0000","last_peered":"2024-09-21T03:18:31.963694+0000","last_clean":"2024-09-21T03:18:31.963694+0000","last_became_active":"2024-09-21T03:18:30.399748+0000","last_became_peered":"2024-09-21T03:18:30.399748+0000","last_unstale":"2024-09-21T03:18:31.963694+0000","last_undegraded":"2024-09-21T03:18:31.963694+0000","last_fullsized":"2024-09-21T03:18:31.963694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:25.808010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964697+0000","last_change":"2024-09-21T03:18:30.409223+0000","last_active":"2024-09-21T03:18:31.964697+0000","last_peered":"2024-09-21T03:18:31.964697+0000","last_clean":"2024-09-21T03:18:31.964697+0000","last_became_active":"2024-09-21T03:18:30.408876+0000","last_became_peered":"2024-09-21T03:18:30.408876+0000","last_unstale":"2024-09-21T03:18:31.964697+0000","last_undegraded":"2024-09-21T03:18:31.964697+0000","last_fullsized":"2024-09-21T03:18:31.964697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:55:03.483520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.410645+0000","last_change":"2024-09-21T03:18:30.398035+0000","last_active":"2024-09-21T03:18:31.410645+0000","last_peered":"2024-09-21T03:18:31.410645+0000","last_clean":"2024-09-21T03:18:31.410645+0000","last_became_active":"2024-09-21T03:18:30.397692+0000","last_became_peered":"2024-09-21T03:18:30.397692+0000","last_unstale":"2024-09-21T03:18:31.410645+0000","last_undegraded":"2024-09-21T03:18:31.410645+0000","last_fullsized":"2024-09-21T03:18:31.410645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:18.166927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.416877+0000","last_change":"2024-09-21T03:18:30.410634+0000","last_active":"2024-09-21T03:18:30.416877+0000","last_peered":"2024-09-21T03:18:30.416877+0000","last_clean":"2024-09-21T03:18:30.416877+0000","last_became_active":"2024-09-21T03:18:30.410352+0000","last_became_peered":"2024-09-21T03:18:30.410352+0000","last_unstale":"2024-09-21T03:18:30.416877+0000","last_undegraded":"2024-09-21T03:18:30.416877+0000","last_fullsized":"2024-09-21T03:18:30.416877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:20.665184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963467+0000","last_change":"2024-09-21T03:18:30.412518+0000","last_active":"2024-09-21T03:18:31.963467+0000","last_peered":"2024-09-21T03:18:31.963467+0000","last_clean":"2024-09-21T03:18:31.963467+0000","last_became_active":"2024-09-21T03:18:30.411784+0000","last_became_peered":"2024-09-21T03:18:30.411784+0000","last_unstale":"2024-09-21T03:18:31.963467+0000","last_undegraded":"2024-09-21T03:18:31.963467+0000","last_fullsized":"2024-09-21T03:18:31.963467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:11.956694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406217+0000","last_change":"2024-09-21T03:18:30.400029+0000","last_active":"2024-09-21T03:18:31.406217+0000","last_peered":"2024-09-21T03:18:31.406217+0000","last_clean":"2024-09-21T03:18:31.406217+0000","last_became_active":"2024-09-21T03:18:30.399708+0000","last_became_peered":"2024-09-21T03:18:30.399708+0000","last_unstale":"2024-09-21T03:18:31.406217+0000","last_undegraded":"2024-09-21T03:18:31.406217+0000","last_fullsized":"2024-09-21T03:18:31.406217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:45.250175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963526+0000","last_change":"2024-09-21T03:18:30.417315+0000","last_active":"2024-09-21T03:18:31.963526+0000","last_peered":"2024-09-21T03:18:31.963526+0000","last_clean":"2024-09-21T03:18:31.963526+0000","last_became_active":"2024-09-21T03:18:30.417005+0000","last_became_peered":"2024-09-21T03:18:30.417005+0000","last_unstale":"2024-09-21T03:18:31.963526+0000","last_undegraded":"2024-09-21T03:18:31.963526+0000","last_fullsized":"2024-09-21T03:18:31.963526+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:21.239439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406541+0000","last_change":"2024-09-21T03:18:30.408987+0000","last_active":"2024-09-21T03:18:31.406541+0000","last_peered":"2024-09-21T03:18:31.406541+0000","last_clean":"2024-09-21T03:18:31.406541+0000","last_became_active":"2024-09-21T03:18:30.408657+0000","last_became_peered":"2024-09-21T03:18:30.408657+0000","last_unstale":"2024-09-21T03:18:31.406541+0000","last_undegraded":"2024-09-21T03:18:31.406541+0000","last_fullsized":"2024-09-21T03:18:31.406541+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:14:17.253259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.410869+0000","last_change":"2024-09-21T03:18:30.409463+0000","last_active":"2024-09-21T03:18:31.410869+0000","last_peered":"2024-09-21T03:18:31.410869+0000","last_clean":"2024-09-21T03:18:31.410869+0000","last_became_active":"2024-09-21T03:18:30.409130+0000","last_became_peered":"2024-09-21T03:18:30.409130+0000","last_unstale":"2024-09-21T03:18:31.410869+0000","last_undegraded":"2024-09-21T03:18:31.410869+0000","last_fullsized":"2024-09-21T03:18:31.410869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:31.370175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963297+0000","last_change":"2024-09-21T03:18:30.415501+0000","last_active":"2024-09-21T03:18:31.963297+0000","last_peered":"2024-09-21T03:18:31.963297+0000","last_clean":"2024-09-21T03:18:31.963297+0000","last_became_active":"2024-09-21T03:18:30.415201+0000","last_became_peered":"2024-09-21T03:18:30.415201+0000","last_unstale":"2024-09-21T03:18:31.963297+0000","last_undegraded":"2024-09-21T03:18:31.963297+0000","last_fullsized":"2024-09-21T03:18:31.963297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:11.956694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406534+0000","last_change":"2024-09-21T03:18:30.409337+0000","last_active":"2024-09-21T03:18:31.406534+0000","last_peered":"2024-09-21T03:18:31.406534+0000","last_clean":"2024-09-21T03:18:31.406534+0000","last_became_active":"2024-09-21T03:18:30.409034+0000","last_became_peered":"2024-09-21T03:18:30.409034+0000","last_unstale":"2024-09-21T03:18:31.406534+0000","last_undegraded":"2024-09-21T03:18:31.406534+0000","last_fullsized":"2024-09-21T03:18:31.406534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:15.659300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.416852+0000","last_change":"2024-09-21T03:18:30.409071+0000","last_active":"2024-09-21T03:18:30.416852+0000","last_peered":"2024-09-21T03:18:30.416852+0000","last_clean":"2024-09-21T03:18:30.416852+0000","last_became_active":"2024-09-21T03:18:30.408769+0000","last_became_peered":"2024-09-21T03:18:30.408769+0000","last_unstale":"2024-09-21T03:18:30.416852+0000","last_undegraded":"2024-09-21T03:18:30.416852+0000","last_fullsized":"2024-09-21T03:18:30.416852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:34.422427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964289+0000","last_change":"2024-09-21T03:18:30.416900+0000","last_active":"2024-09-21T03:18:31.964289+0000","last_peered":"2024-09-21T03:18:31.964289+0000","last_clean":"2024-09-21T03:18:31.964289+0000","last_became_active":"2024-09-21T03:18:30.416566+0000","last_became_peered":"2024-09-21T03:18:30.416566+0000","last_unstale":"2024-09-21T03:18:31.964289+0000","last_undegraded":"2024-09-21T03:18:31.964289+0000","last_fullsized":"2024-09-21T03:18:31.964289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:52:00.902253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963482+0000","last_change":"2024-09-21T03:18:30.409381+0000","last_active":"2024-09-21T03:18:31.963482+0000","last_peered":"2024-09-21T03:18:31.963482+0000","last_clean":"2024-09-21T03:18:31.963482+0000","last_became_active":"2024-09-21T03:18:30.409066+0000","last_became_peered":"2024-09-21T03:18:30.409066+0000","last_unstale":"2024-09-21T03:18:31.963482+0000","last_undegraded":"2024-09-21T03:18:31.963482+0000","last_fullsized":"2024-09-21T03:18:31.963482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:44.039210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.409946+0000","last_change":"2024-09-21T03:18:30.413745+0000","last_active":"2024-09-21T03:18:31.409946+0000","last_peered":"2024-09-21T03:18:31.409946+0000","last_clean":"2024-09-21T03:18:31.409946+0000","last_became_active":"2024-09-21T03:18:30.413434+0000","last_became_peered":"2024-09-21T03:18:30.413434+0000","last_unstale":"2024-09-21T03:18:31.409946+0000","last_undegraded":"2024-09-21T03:18:31.409946+0000","last_fullsized":"2024-09-21T03:18:31.409946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:40.786257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.409337+0000","last_change":"2024-09-21T03:18:30.405133+0000","last_active":"2024-09-21T03:18:31.409337+0000","last_peered":"2024-09-21T03:18:31.409337+0000","last_clean":"2024-09-21T03:18:31.409337+0000","last_became_active":"2024-09-21T03:18:30.404795+0000","last_became_peered":"2024-09-21T03:18:30.404795+0000","last_unstale":"2024-09-21T03:18:31.409337+0000","last_undegraded":"2024-09-21T03:18:31.409337+0000","last_fullsized":"2024-09-21T03:18:31.409337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:26.872806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406704+0000","last_change":"2024-09-21T03:18:29.409241+0000","last_active":"2024-09-21T03:18:31.406704+0000","last_peered":"2024-09-21T03:18:31.406704+0000","last_clean":"2024-09-21T03:18:31.406704+0000","last_became_active":"2024-09-21T03:18:29.408988+0000","last_became_peered":"2024-09-21T03:18:29.408988+0000","last_unstale":"2024-09-21T03:18:31.406704+0000","last_undegraded":"2024-09-21T03:18:31.406704+0000","last_fullsized":"2024-09-21T03:18:31.406704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:52.299913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.416792+0000","last_change":"2024-09-21T03:18:30.406637+0000","last_active":"2024-09-21T03:18:30.416792+0000","last_peered":"2024-09-21T03:18:30.416792+0000","last_clean":"2024-09-21T03:18:30.416792+0000","last_became_active":"2024-09-21T03:18:30.405638+0000","last_became_peered":"2024-09-21T03:18:30.405638+0000","last_unstale":"2024-09-21T03:18:30.416792+0000","last_undegraded":"2024-09-21T03:18:30.416792+0000","last_fullsized":"2024-09-21T03:18:30.416792+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:29:42.558189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.410144+0000","last_change":"2024-09-21T03:18:29.401902+0000","last_active":"2024-09-21T03:18:31.410144+0000","last_peered":"2024-09-21T03:18:31.410144+0000","last_clean":"2024-09-21T03:18:31.410144+0000","last_became_active":"2024-09-21T03:18:29.401056+0000","last_became_peered":"2024-09-21T03:18:29.401056+0000","last_unstale":"2024-09-21T03:18:31.410144+0000","last_undegraded":"2024-09-21T03:18:31.410144+0000","last_fullsized":"2024-09-21T03:18:31.410144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:41.323758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406156+0000","last_change":"2024-09-21T03:18:29.403151+0000","last_active":"2024-09-21T03:18:31.406156+0000","last_peered":"2024-09-21T03:18:31.406156+0000","last_clean":"2024-09-21T03:18:31.406156+0000","last_became_active":"2024-09-21T03:18:29.402799+0000","last_became_peered":"2024-09-21T03:18:29.402799+0000","last_unstale":"2024-09-21T03:18:31.406156+0000","last_undegraded":"2024-09-21T03:18:31.406156+0000","last_fullsized":"2024-09-21T03:18:31.406156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:50.682717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406269+0000","last_change":"2024-09-21T03:18:30.417827+0000","last_active":"2024-09-21T03:18:31.406269+0000","last_peered":"2024-09-21T03:18:31.406269+0000","last_clean":"2024-09-21T03:18:31.406269+0000","last_became_active":"2024-09-21T03:18:30.417509+0000","last_became_peered":"2024-09-21T03:18:30.417509+0000","last_unstale":"2024-09-21T03:18:31.406269+0000","last_undegraded":"2024-09-21T03:18:31.406269+0000","last_fullsized":"2024-09-21T03:18:31.406269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:03.094324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963424+0000","last_change":"2024-09-21T03:18:29.406382+0000","last_active":"2024-09-21T03:18:31.963424+0000","last_peered":"2024-09-21T03:18:31.963424+0000","last_clean":"2024-09-21T03:18:31.963424+0000","last_became_active":"2024-09-21T03:18:29.405616+0000","last_became_peered":"2024-09-21T03:18:29.405616+0000","last_unstale":"2024-09-21T03:18:31.963424+0000","last_undegraded":"2024-09-21T03:18:31.963424+0000","last_fullsized":"2024-09-21T03:18:31.963424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:45.917164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.962705+0000","last_change":"2024-09-21T03:18:30.402277+0000","last_active":"2024-09-21T03:18:31.962705+0000","last_peered":"2024-09-21T03:18:31.962705+0000","last_clean":"2024-09-21T03:18:31.962705+0000","last_became_active":"2024-09-21T03:18:30.401923+0000","last_became_peered":"2024-09-21T03:18:30.401923+0000","last_unstale":"2024-09-21T03:18:31.962705+0000","last_undegraded":"2024-09-21T03:18:31.962705+0000","last_fullsized":"2024-09-21T03:18:31.962705+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:45.250175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.410347+0000","last_change":"2024-09-21T03:18:29.407735+0000","last_active":"2024-09-21T03:18:31.410347+0000","last_peered":"2024-09-21T03:18:31.410347+0000","last_clean":"2024-09-21T03:18:31.410347+0000","last_became_active":"2024-09-21T03:18:29.407377+0000","last_became_peered":"2024-09-21T03:18:29.407377+0000","last_unstale":"2024-09-21T03:18:31.410347+0000","last_undegraded":"2024-09-21T03:18:31.410347+0000","last_fullsized":"2024-09-21T03:18:31.410347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:25.867003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963866+0000","last_change":"2024-09-21T03:18:30.411099+0000","last_active":"2024-09-21T03:18:31.963866+0000","last_peered":"2024-09-21T03:18:31.963866+0000","last_clean":"2024-09-21T03:18:31.963866+0000","last_became_active":"2024-09-21T03:18:30.410755+0000","last_became_peered":"2024-09-21T03:18:30.410755+0000","last_unstale":"2024-09-21T03:18:31.963866+0000","last_undegraded":"2024-09-21T03:18:31.963866+0000","last_fullsized":"2024-09-21T03:18:31.963866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:49.705469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963834+0000","last_change":"2024-09-21T03:18:29.408842+0000","last_active":"2024-09-21T03:18:31.963834+0000","last_peered":"2024-09-21T03:18:31.963834+0000","last_clean":"2024-09-21T03:18:31.963834+0000","last_became_active":"2024-09-21T03:18:29.408345+0000","last_became_peered":"2024-09-21T03:18:29.408345+0000","last_unstale":"2024-09-21T03:18:31.963834+0000","last_undegraded":"2024-09-21T03:18:31.963834+0000","last_fullsized":"2024-09-21T03:18:31.963834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:22.158750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.417817+0000","last_change":"2024-09-21T03:18:30.413425+0000","last_active":"2024-09-21T03:18:30.417817+0000","last_peered":"2024-09-21T03:18:30.417817+0000","last_clean":"2024-09-21T03:18:30.417817+0000","last_became_active":"2024-09-21T03:18:30.412694+0000","last_became_peered":"2024-09-21T03:18:30.412694+0000","last_unstale":"2024-09-21T03:18:30.417817+0000","last_undegraded":"2024-09-21T03:18:30.417817+0000","last_fullsized":"2024-09-21T03:18:30.417817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:02:19.780012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963255+0000","last_change":"2024-09-21T03:18:29.407409+0000","last_active":"2024-09-21T03:18:31.963255+0000","last_peered":"2024-09-21T03:18:31.963255+0000","last_clean":"2024-09-21T03:18:31.963255+0000","last_became_active":"2024-09-21T03:18:29.407071+0000","last_became_peered":"2024-09-21T03:18:29.407071+0000","last_unstale":"2024-09-21T03:18:31.963255+0000","last_undegraded":"2024-09-21T03:18:31.963255+0000","last_fullsized":"2024-09-21T03:18:31.963255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:43.033407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.409859+0000","last_change":"2024-09-21T03:18:30.410735+0000","last_active":"2024-09-21T03:18:31.409859+0000","last_peered":"2024-09-21T03:18:31.409859+0000","last_clean":"2024-09-21T03:18:31.409859+0000","last_became_active":"2024-09-21T03:18:30.409130+0000","last_became_peered":"2024-09-21T03:18:30.409130+0000","last_unstale":"2024-09-21T03:18:31.409859+0000","last_undegraded":"2024-09-21T03:18:31.409859+0000","last_fullsized":"2024-09-21T03:18:31.409859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:28.243325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.410333+0000","last_change":"2024-09-21T03:18:29.402961+0000","last_active":"2024-09-21T03:18:31.410333+0000","last_peered":"2024-09-21T03:18:31.410333+0000","last_clean":"2024-09-21T03:18:31.410333+0000","last_became_active":"2024-09-21T03:18:29.402605+0000","last_became_peered":"2024-09-21T03:18:29.402605+0000","last_unstale":"2024-09-21T03:18:31.410333+0000","last_undegraded":"2024-09-21T03:18:31.410333+0000","last_fullsized":"2024-09-21T03:18:31.410333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:32.360810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964077+0000","last_change":"2024-09-21T03:18:30.416670+0000","last_active":"2024-09-21T03:18:31.964077+0000","last_peered":"2024-09-21T03:18:31.964077+0000","last_clean":"2024-09-21T03:18:31.964077+0000","last_became_active":"2024-09-21T03:18:30.416005+0000","last_became_peered":"2024-09-21T03:18:30.416005+0000","last_unstale":"2024-09-21T03:18:31.964077+0000","last_undegraded":"2024-09-21T03:18:31.964077+0000","last_fullsized":"2024-09-21T03:18:31.964077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:35.898216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.423785+0000","last_change":"2024-09-21T03:18:29.405416+0000","last_active":"2024-09-21T03:18:30.423785+0000","last_peered":"2024-09-21T03:18:30.423785+0000","last_clean":"2024-09-21T03:18:30.423785+0000","last_became_active":"2024-09-21T03:18:29.405108+0000","last_became_peered":"2024-09-21T03:18:29.405108+0000","last_unstale":"2024-09-21T03:18:30.423785+0000","last_undegraded":"2024-09-21T03:18:30.423785+0000","last_fullsized":"2024-09-21T03:18:30.423785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:53.454590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.416759+0000","last_change":"2024-09-21T03:18:30.409860+0000","last_active":"2024-09-21T03:18:30.416759+0000","last_peered":"2024-09-21T03:18:30.416759+0000","last_clean":"2024-09-21T03:18:30.416759+0000","last_became_active":"2024-09-21T03:18:30.409559+0000","last_became_peered":"2024-09-21T03:18:30.409559+0000","last_unstale":"2024-09-21T03:18:30.416759+0000","last_undegraded":"2024-09-21T03:18:30.416759+0000","last_fullsized":"2024-09-21T03:18:30.416759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:32.549901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964301+0000","last_change":"2024-09-21T03:18:29.413878+0000","last_active":"2024-09-21T03:18:31.964301+0000","last_peered":"2024-09-21T03:18:31.964301+0000","last_clean":"2024-09-21T03:18:31.964301+0000","last_became_active":"2024-09-21T03:18:29.413571+0000","last_became_peered":"2024-09-21T03:18:29.413571+0000","last_unstale":"2024-09-21T03:18:31.964301+0000","last_undegraded":"2024-09-21T03:18:31.964301+0000","last_fullsized":"2024-09-21T03:18:31.964301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:21.627091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964666+0000","last_change":"2024-09-21T03:18:30.416945+0000","last_active":"2024-09-21T03:18:31.964666+0000","last_peered":"2024-09-21T03:18:31.964666+0000","last_clean":"2024-09-21T03:18:31.964666+0000","last_became_active":"2024-09-21T03:18:30.416610+0000","last_became_peered":"2024-09-21T03:18:30.416610+0000","last_unstale":"2024-09-21T03:18:31.964666+0000","last_undegraded":"2024-09-21T03:18:31.964666+0000","last_fullsized":"2024-09-21T03:18:31.964666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:22:49.496448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.409505+0000","last_change":"2024-09-21T03:18:29.401191+0000","last_active":"2024-09-21T03:18:31.409505+0000","last_peered":"2024-09-21T03:18:31.409505+0000","last_clean":"2024-09-21T03:18:31.409505+0000","last_became_active":"2024-09-21T03:18:29.400775+0000","last_became_peered":"2024-09-21T03:18:29.400775+0000","last_unstale":"2024-09-21T03:18:31.409505+0000","last_undegraded":"2024-09-21T03:18:31.409505+0000","last_fullsized":"2024-09-21T03:18:31.409505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:03:55.435346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.410129+0000","last_change":"2024-09-21T03:18:30.406919+0000","last_active":"2024-09-21T03:18:31.410129+0000","last_peered":"2024-09-21T03:18:31.410129+0000","last_clean":"2024-09-21T03:18:31.410129+0000","last_became_active":"2024-09-21T03:18:30.406584+0000","last_became_peered":"2024-09-21T03:18:30.406584+0000","last_unstale":"2024-09-21T03:18:31.410129+0000","last_undegraded":"2024-09-21T03:18:31.410129+0000","last_fullsized":"2024-09-21T03:18:31.410129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:46.766926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963384+0000","last_change":"2024-09-21T03:18:29.401326+0000","last_active":"2024-09-21T03:18:31.963384+0000","last_peered":"2024-09-21T03:18:31.963384+0000","last_clean":"2024-09-21T03:18:31.963384+0000","last_became_active":"2024-09-21T03:18:29.400268+0000","last_became_peered":"2024-09-21T03:18:29.400268+0000","last_unstale":"2024-09-21T03:18:31.963384+0000","last_undegraded":"2024-09-21T03:18:31.963384+0000","last_fullsized":"2024-09-21T03:18:31.963384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:53.644507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964135+0000","last_change":"2024-09-21T03:18:30.420964+0000","last_active":"2024-09-21T03:18:31.964135+0000","last_peered":"2024-09-21T03:18:31.964135+0000","last_clean":"2024-09-21T03:18:31.964135+0000","last_became_active":"2024-09-21T03:18:30.420316+0000","last_became_peered":"2024-09-21T03:18:30.420316+0000","last_unstale":"2024-09-21T03:18:31.964135+0000","last_undegraded":"2024-09-21T03:18:31.964135+0000","last_fullsized":"2024-09-21T03:18:31.964135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:59.120847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.410688+0000","last_change":"2024-09-21T03:18:29.405556+0000","last_active":"2024-09-21T03:18:31.410688+0000","last_peered":"2024-09-21T03:18:31.410688+0000","last_clean":"2024-09-21T03:18:31.410688+0000","last_became_active":"2024-09-21T03:18:29.405128+0000","last_became_peered":"2024-09-21T03:18:29.405128+0000","last_unstale":"2024-09-21T03:18:31.410688+0000","last_undegraded":"2024-09-21T03:18:31.410688+0000","last_fullsized":"2024-09-21T03:18:31.410688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:08.606490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964082+0000","last_change":"2024-09-21T03:18:30.416107+0000","last_active":"2024-09-21T03:18:31.964082+0000","last_peered":"2024-09-21T03:18:31.964082+0000","last_clean":"2024-09-21T03:18:31.964082+0000","last_became_active":"2024-09-21T03:18:30.415764+0000","last_became_peered":"2024-09-21T03:18:30.415764+0000","last_unstale":"2024-09-21T03:18:31.964082+0000","last_undegraded":"2024-09-21T03:18:31.964082+0000","last_fullsized":"2024-09-21T03:18:31.964082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:40.961482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963646+0000","last_change":"2024-09-21T03:18:29.402215+0000","last_active":"2024-09-21T03:18:31.963646+0000","last_peered":"2024-09-21T03:18:31.963646+0000","last_clean":"2024-09-21T03:18:31.963646+0000","last_became_active":"2024-09-21T03:18:29.401853+0000","last_became_peered":"2024-09-21T03:18:29.401853+0000","last_unstale":"2024-09-21T03:18:31.963646+0000","last_undegraded":"2024-09-21T03:18:31.963646+0000","last_fullsized":"2024-09-21T03:18:31.963646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:22.158750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964837+0000","last_change":"2024-09-21T03:18:30.421447+0000","last_active":"2024-09-21T03:18:31.964837+0000","last_peered":"2024-09-21T03:18:31.964837+0000","last_clean":"2024-09-21T03:18:31.964837+0000","last_became_active":"2024-09-21T03:18:30.421061+0000","last_became_peered":"2024-09-21T03:18:30.421061+0000","last_unstale":"2024-09-21T03:18:31.964837+0000","last_undegraded":"2024-09-21T03:18:31.964837+0000","last_fullsized":"2024-09-21T03:18:31.964837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:34.616164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963366+0000","last_change":"2024-09-21T03:18:29.404008+0000","last_active":"2024-09-21T03:18:31.963366+0000","last_peered":"2024-09-21T03:18:31.963366+0000","last_clean":"2024-09-21T03:18:31.963366+0000","last_became_active":"2024-09-21T03:18:29.403700+0000","last_became_peered":"2024-09-21T03:18:29.403700+0000","last_unstale":"2024-09-21T03:18:31.963366+0000","last_undegraded":"2024-09-21T03:18:31.963366+0000","last_fullsized":"2024-09-21T03:18:31.963366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:24.802208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964230+0000","last_change":"2024-09-21T03:18:30.420751+0000","last_active":"2024-09-21T03:18:31.964230+0000","last_peered":"2024-09-21T03:18:31.964230+0000","last_clean":"2024-09-21T03:18:31.964230+0000","last_became_active":"2024-09-21T03:18:30.420401+0000","last_became_peered":"2024-09-21T03:18:30.420401+0000","last_unstale":"2024-09-21T03:18:31.964230+0000","last_undegraded":"2024-09-21T03:18:31.964230+0000","last_fullsized":"2024-09-21T03:18:31.964230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:55.226807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963123+0000","last_change":"2024-09-21T03:18:29.410099+0000","last_active":"2024-09-21T03:18:31.963123+0000","last_peered":"2024-09-21T03:18:31.963123+0000","last_clean":"2024-09-21T03:18:31.963123+0000","last_became_active":"2024-09-21T03:18:29.409723+0000","last_became_peered":"2024-09-21T03:18:29.409723+0000","last_unstale":"2024-09-21T03:18:31.963123+0000","last_undegraded":"2024-09-21T03:18:31.963123+0000","last_fullsized":"2024-09-21T03:18:31.963123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:43.447253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964356+0000","last_change":"2024-09-21T03:18:30.416344+0000","last_active":"2024-09-21T03:18:31.964356+0000","last_peered":"2024-09-21T03:18:31.964356+0000","last_clean":"2024-09-21T03:18:31.964356+0000","last_became_active":"2024-09-21T03:18:30.415584+0000","last_became_peered":"2024-09-21T03:18:30.415584+0000","last_unstale":"2024-09-21T03:18:31.964356+0000","last_undegraded":"2024-09-21T03:18:31.964356+0000","last_fullsized":"2024-09-21T03:18:31.964356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:24:42.041578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963862+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:18:31.963862+0000","last_peered":"2024-09-21T03:18:31.963862+0000","last_clean":"2024-09-21T03:18:31.963862+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:18:31.963862+0000","last_undegraded":"2024-09-21T03:18:31.963862+0000","last_fullsized":"2024-09-21T03:18:31.963862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963163+0000","last_change":"2024-09-21T03:18:29.407517+0000","last_active":"2024-09-21T03:18:31.963163+0000","last_peered":"2024-09-21T03:18:31.963163+0000","last_clean":"2024-09-21T03:18:31.963163+0000","last_became_active":"2024-09-21T03:18:29.407174+0000","last_became_peered":"2024-09-21T03:18:29.407174+0000","last_unstale":"2024-09-21T03:18:31.963163+0000","last_undegraded":"2024-09-21T03:18:31.963163+0000","last_fullsized":"2024-09-21T03:18:31.963163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:43.447253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406392+0000","last_change":"2024-09-21T03:18:30.416787+0000","last_active":"2024-09-21T03:18:31.406392+0000","last_peered":"2024-09-21T03:18:31.406392+0000","last_clean":"2024-09-21T03:18:31.406392+0000","last_became_active":"2024-09-21T03:18:30.416468+0000","last_became_peered":"2024-09-21T03:18:30.416468+0000","last_unstale":"2024-09-21T03:18:31.406392+0000","last_undegraded":"2024-09-21T03:18:31.406392+0000","last_fullsized":"2024-09-21T03:18:31.406392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:13.827662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963278+0000","last_change":"2024-09-21T03:18:29.400053+0000","last_active":"2024-09-21T03:18:31.963278+0000","last_peered":"2024-09-21T03:18:31.963278+0000","last_clean":"2024-09-21T03:18:31.963278+0000","last_became_active":"2024-09-21T03:18:29.399616+0000","last_became_peered":"2024-09-21T03:18:29.399616+0000","last_unstale":"2024-09-21T03:18:31.963278+0000","last_undegraded":"2024-09-21T03:18:31.963278+0000","last_fullsized":"2024-09-21T03:18:31.963278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:32.360810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.416893+0000","last_change":"2024-09-21T03:18:30.406884+0000","last_active":"2024-09-21T03:18:30.416893+0000","last_peered":"2024-09-21T03:18:30.416893+0000","last_clean":"2024-09-21T03:18:30.416893+0000","last_became_active":"2024-09-21T03:18:30.406497+0000","last_became_peered":"2024-09-21T03:18:30.406497+0000","last_unstale":"2024-09-21T03:18:30.416893+0000","last_undegraded":"2024-09-21T03:18:30.416893+0000","last_fullsized":"2024-09-21T03:18:30.416893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:12.701313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963522+0000","last_change":"2024-09-21T03:18:29.403123+0000","last_active":"2024-09-21T03:18:31.963522+0000","last_peered":"2024-09-21T03:18:31.963522+0000","last_clean":"2024-09-21T03:18:31.963522+0000","last_became_active":"2024-09-21T03:18:29.402613+0000","last_became_peered":"2024-09-21T03:18:29.402613+0000","last_unstale":"2024-09-21T03:18:31.963522+0000","last_undegraded":"2024-09-21T03:18:31.963522+0000","last_fullsized":"2024-09-21T03:18:31.963522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:45.917164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.962777+0000","last_change":"2024-09-21T03:18:30.401955+0000","last_active":"2024-09-21T03:18:31.962777+0000","last_peered":"2024-09-21T03:18:31.962777+0000","last_clean":"2024-09-21T03:18:31.962777+0000","last_became_active":"2024-09-21T03:18:30.401587+0000","last_became_peered":"2024-09-21T03:18:30.401587+0000","last_unstale":"2024-09-21T03:18:31.962777+0000","last_undegraded":"2024-09-21T03:18:31.962777+0000","last_fullsized":"2024-09-21T03:18:31.962777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:03.094324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964372+0000","last_change":"2024-09-21T03:18:29.407459+0000","last_active":"2024-09-21T03:18:31.964372+0000","last_peered":"2024-09-21T03:18:31.964372+0000","last_clean":"2024-09-21T03:18:31.964372+0000","last_became_active":"2024-09-21T03:18:29.407132+0000","last_became_peered":"2024-09-21T03:18:29.407132+0000","last_unstale":"2024-09-21T03:18:31.964372+0000","last_undegraded":"2024-09-21T03:18:31.964372+0000","last_fullsized":"2024-09-21T03:18:31.964372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:58.516525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.409395+0000","last_change":"2024-09-21T03:18:30.406973+0000","last_active":"2024-09-21T03:18:31.409395+0000","last_peered":"2024-09-21T03:18:31.409395+0000","last_clean":"2024-09-21T03:18:31.409395+0000","last_became_active":"2024-09-21T03:18:30.405992+0000","last_became_peered":"2024-09-21T03:18:30.405992+0000","last_unstale":"2024-09-21T03:18:31.409395+0000","last_undegraded":"2024-09-21T03:18:31.409395+0000","last_fullsized":"2024-09-21T03:18:31.409395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:33.366612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963029+0000","last_change":"2024-09-21T03:18:29.406073+0000","last_active":"2024-09-21T03:18:31.963029+0000","last_peered":"2024-09-21T03:18:31.963029+0000","last_clean":"2024-09-21T03:18:31.963029+0000","last_became_active":"2024-09-21T03:18:29.405786+0000","last_became_peered":"2024-09-21T03:18:29.405786+0000","last_unstale":"2024-09-21T03:18:31.963029+0000","last_undegraded":"2024-09-21T03:18:31.963029+0000","last_fullsized":"2024-09-21T03:18:31.963029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:45.917164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964101+0000","last_change":"2024-09-21T03:18:30.419736+0000","last_active":"2024-09-21T03:18:31.964101+0000","last_peered":"2024-09-21T03:18:31.964101+0000","last_clean":"2024-09-21T03:18:31.964101+0000","last_became_active":"2024-09-21T03:18:30.418805+0000","last_became_peered":"2024-09-21T03:18:30.418805+0000","last_unstale":"2024-09-21T03:18:31.964101+0000","last_undegraded":"2024-09-21T03:18:31.964101+0000","last_fullsized":"2024-09-21T03:18:31.964101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:14.331651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964588+0000","last_change":"2024-09-21T03:18:29.399297+0000","last_active":"2024-09-21T03:18:31.964588+0000","last_peered":"2024-09-21T03:18:31.964588+0000","last_clean":"2024-09-21T03:18:31.964588+0000","last_became_active":"2024-09-21T03:18:29.398956+0000","last_became_peered":"2024-09-21T03:18:29.398956+0000","last_unstale":"2024-09-21T03:18:31.964588+0000","last_undegraded":"2024-09-21T03:18:31.964588+0000","last_fullsized":"2024-09-21T03:18:31.964588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:03.278232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.962949+0000","last_change":"2024-09-21T03:18:30.402564+0000","last_active":"2024-09-21T03:18:31.962949+0000","last_peered":"2024-09-21T03:18:31.962949+0000","last_clean":"2024-09-21T03:18:31.962949+0000","last_became_active":"2024-09-21T03:18:30.401234+0000","last_became_peered":"2024-09-21T03:18:30.401234+0000","last_unstale":"2024-09-21T03:18:31.962949+0000","last_undegraded":"2024-09-21T03:18:31.962949+0000","last_fullsized":"2024-09-21T03:18:31.962949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:13.827662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.962727+0000","last_change":"2024-09-21T03:18:29.403088+0000","last_active":"2024-09-21T03:18:31.962727+0000","last_peered":"2024-09-21T03:18:31.962727+0000","last_clean":"2024-09-21T03:18:31.962727+0000","last_became_active":"2024-09-21T03:18:29.402795+0000","last_became_peered":"2024-09-21T03:18:29.402795+0000","last_unstale":"2024-09-21T03:18:31.962727+0000","last_undegraded":"2024-09-21T03:18:31.962727+0000","last_fullsized":"2024-09-21T03:18:31.962727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:22.158750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406630+0000","last_change":"2024-09-21T03:18:30.414287+0000","last_active":"2024-09-21T03:18:31.406630+0000","last_peered":"2024-09-21T03:18:31.406630+0000","last_clean":"2024-09-21T03:18:31.406630+0000","last_became_active":"2024-09-21T03:18:30.413950+0000","last_became_peered":"2024-09-21T03:18:30.413950+0000","last_unstale":"2024-09-21T03:18:31.406630+0000","last_undegraded":"2024-09-21T03:18:31.406630+0000","last_fullsized":"2024-09-21T03:18:31.406630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:23.551826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.410461+0000","last_change":"2024-09-21T03:18:29.406121+0000","last_active":"2024-09-21T03:18:31.410461+0000","last_peered":"2024-09-21T03:18:31.410461+0000","last_clean":"2024-09-21T03:18:31.410461+0000","last_became_active":"2024-09-21T03:18:29.405509+0000","last_became_peered":"2024-09-21T03:18:29.405509+0000","last_unstale":"2024-09-21T03:18:31.410461+0000","last_undegraded":"2024-09-21T03:18:31.410461+0000","last_fullsized":"2024-09-21T03:18:31.410461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:08.961149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.416691+0000","last_change":"2024-09-21T03:18:30.404103+0000","last_active":"2024-09-21T03:18:30.416691+0000","last_peered":"2024-09-21T03:18:30.416691+0000","last_clean":"2024-09-21T03:18:30.416691+0000","last_became_active":"2024-09-21T03:18:30.402457+0000","last_became_peered":"2024-09-21T03:18:30.402457+0000","last_unstale":"2024-09-21T03:18:30.416691+0000","last_undegraded":"2024-09-21T03:18:30.416691+0000","last_fullsized":"2024-09-21T03:18:30.416691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:13.113079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963050+0000","last_change":"2024-09-21T03:18:29.405727+0000","last_active":"2024-09-21T03:18:31.963050+0000","last_peered":"2024-09-21T03:18:31.963050+0000","last_clean":"2024-09-21T03:18:31.963050+0000","last_became_active":"2024-09-21T03:18:29.405421+0000","last_became_peered":"2024-09-21T03:18:29.405421+0000","last_unstale":"2024-09-21T03:18:31.963050+0000","last_undegraded":"2024-09-21T03:18:31.963050+0000","last_fullsized":"2024-09-21T03:18:31.963050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:08.961149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.409341+0000","last_change":"2024-09-21T03:18:30.399926+0000","last_active":"2024-09-21T03:18:31.409341+0000","last_peered":"2024-09-21T03:18:31.409341+0000","last_clean":"2024-09-21T03:18:31.409341+0000","last_became_active":"2024-09-21T03:18:30.399600+0000","last_became_peered":"2024-09-21T03:18:30.399600+0000","last_unstale":"2024-09-21T03:18:31.409341+0000","last_undegraded":"2024-09-21T03:18:31.409341+0000","last_fullsized":"2024-09-21T03:18:31.409341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:23.164552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.962797+0000","last_change":"2024-09-21T03:18:29.405412+0000","last_active":"2024-09-21T03:18:31.962797+0000","last_peered":"2024-09-21T03:18:31.962797+0000","last_clean":"2024-09-21T03:18:31.962797+0000","last_became_active":"2024-09-21T03:18:29.405094+0000","last_became_peered":"2024-09-21T03:18:29.405094+0000","last_unstale":"2024-09-21T03:18:31.962797+0000","last_undegraded":"2024-09-21T03:18:31.962797+0000","last_fullsized":"2024-09-21T03:18:31.962797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:58.516525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406400+0000","last_change":"2024-09-21T03:18:30.405606+0000","last_active":"2024-09-21T03:18:31.406400+0000","last_peered":"2024-09-21T03:18:31.406400+0000","last_clean":"2024-09-21T03:18:31.406400+0000","last_became_active":"2024-09-21T03:18:30.403297+0000","last_became_peered":"2024-09-21T03:18:30.403297+0000","last_unstale":"2024-09-21T03:18:31.406400+0000","last_undegraded":"2024-09-21T03:18:31.406400+0000","last_fullsized":"2024-09-21T03:18:31.406400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:18.166927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963138+0000","last_change":"2024-09-21T03:18:29.400372+0000","last_active":"2024-09-21T03:18:31.963138+0000","last_peered":"2024-09-21T03:18:31.963138+0000","last_clean":"2024-09-21T03:18:31.963138+0000","last_became_active":"2024-09-21T03:18:29.400005+0000","last_became_peered":"2024-09-21T03:18:29.400005+0000","last_unstale":"2024-09-21T03:18:31.963138+0000","last_undegraded":"2024-09-21T03:18:31.963138+0000","last_fullsized":"2024-09-21T03:18:31.963138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:21.627091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406843+0000","last_change":"2024-09-21T03:18:30.418312+0000","last_active":"2024-09-21T03:18:31.406843+0000","last_peered":"2024-09-21T03:18:31.406843+0000","last_clean":"2024-09-21T03:18:31.406843+0000","last_became_active":"2024-09-21T03:18:30.417984+0000","last_became_peered":"2024-09-21T03:18:30.417984+0000","last_unstale":"2024-09-21T03:18:31.406843+0000","last_undegraded":"2024-09-21T03:18:31.406843+0000","last_fullsized":"2024-09-21T03:18:31.406843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:40.961482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964737+0000","last_change":"2024-09-21T03:18:29.400789+0000","last_active":"2024-09-21T03:18:31.964737+0000","last_peered":"2024-09-21T03:18:31.964737+0000","last_clean":"2024-09-21T03:18:31.964737+0000","last_became_active":"2024-09-21T03:18:29.400487+0000","last_became_peered":"2024-09-21T03:18:29.400487+0000","last_unstale":"2024-09-21T03:18:31.964737+0000","last_undegraded":"2024-09-21T03:18:31.964737+0000","last_fullsized":"2024-09-21T03:18:31.964737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:42.181902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.410214+0000","last_change":"2024-09-21T03:18:30.394333+0000","last_active":"2024-09-21T03:18:31.410214+0000","last_peered":"2024-09-21T03:18:31.410214+0000","last_clean":"2024-09-21T03:18:31.410214+0000","last_became_active":"2024-09-21T03:18:30.393995+0000","last_became_peered":"2024-09-21T03:18:30.393995+0000","last_unstale":"2024-09-21T03:18:31.410214+0000","last_undegraded":"2024-09-21T03:18:31.410214+0000","last_fullsized":"2024-09-21T03:18:31.410214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:10.520052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963771+0000","last_change":"2024-09-21T03:18:30.419098+0000","last_active":"2024-09-21T03:18:31.963771+0000","last_peered":"2024-09-21T03:18:31.963771+0000","last_clean":"2024-09-21T03:18:31.963771+0000","last_became_active":"2024-09-21T03:18:30.416696+0000","last_became_peered":"2024-09-21T03:18:30.416696+0000","last_unstale":"2024-09-21T03:18:31.963771+0000","last_undegraded":"2024-09-21T03:18:31.963771+0000","last_fullsized":"2024-09-21T03:18:31.963771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:40.961482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963622+0000","last_change":"2024-09-21T03:18:29.410284+0000","last_active":"2024-09-21T03:18:31.963622+0000","last_peered":"2024-09-21T03:18:31.963622+0000","last_clean":"2024-09-21T03:18:31.963622+0000","last_became_active":"2024-09-21T03:18:29.409965+0000","last_became_peered":"2024-09-21T03:18:29.409965+0000","last_unstale":"2024-09-21T03:18:31.963622+0000","last_undegraded":"2024-09-21T03:18:31.963622+0000","last_fullsized":"2024-09-21T03:18:31.963622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:43.014716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963980+0000","last_change":"2024-09-21T03:18:30.418184+0000","last_active":"2024-09-21T03:18:31.963980+0000","last_peered":"2024-09-21T03:18:31.963980+0000","last_clean":"2024-09-21T03:18:31.963980+0000","last_became_active":"2024-09-21T03:18:30.417865+0000","last_became_peered":"2024-09-21T03:18:30.417865+0000","last_unstale":"2024-09-21T03:18:31.963980+0000","last_undegraded":"2024-09-21T03:18:31.963980+0000","last_fullsized":"2024-09-21T03:18:31.963980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:24:42.041578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964437+0000","last_change":"2024-09-21T03:18:29.407648+0000","last_active":"2024-09-21T03:18:31.964437+0000","last_peered":"2024-09-21T03:18:31.964437+0000","last_clean":"2024-09-21T03:18:31.964437+0000","last_became_active":"2024-09-21T03:18:29.407300+0000","last_became_peered":"2024-09-21T03:18:29.407300+0000","last_unstale":"2024-09-21T03:18:31.964437+0000","last_undegraded":"2024-09-21T03:18:31.964437+0000","last_fullsized":"2024-09-21T03:18:31.964437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:27.237523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.417846+0000","last_change":"2024-09-21T03:18:30.413724+0000","last_active":"2024-09-21T03:18:30.417846+0000","last_peered":"2024-09-21T03:18:30.417846+0000","last_clean":"2024-09-21T03:18:30.417846+0000","last_became_active":"2024-09-21T03:18:30.413106+0000","last_became_peered":"2024-09-21T03:18:30.413106+0000","last_unstale":"2024-09-21T03:18:30.417846+0000","last_undegraded":"2024-09-21T03:18:30.417846+0000","last_fullsized":"2024-09-21T03:18:30.417846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:53.409864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406866+0000","last_change":"2024-09-21T03:18:29.406529+0000","last_active":"2024-09-21T03:18:31.406866+0000","last_peered":"2024-09-21T03:18:31.406866+0000","last_clean":"2024-09-21T03:18:31.406866+0000","last_became_active":"2024-09-21T03:18:29.406195+0000","last_became_peered":"2024-09-21T03:18:29.406195+0000","last_unstale":"2024-09-21T03:18:31.406866+0000","last_undegraded":"2024-09-21T03:18:31.406866+0000","last_fullsized":"2024-09-21T03:18:31.406866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:03:55.435346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406866+0000","last_change":"2024-09-21T03:18:30.402788+0000","last_active":"2024-09-21T03:18:31.406866+0000","last_peered":"2024-09-21T03:18:31.406866+0000","last_clean":"2024-09-21T03:18:31.406866+0000","last_became_active":"2024-09-21T03:18:30.400506+0000","last_became_peered":"2024-09-21T03:18:30.400506+0000","last_unstale":"2024-09-21T03:18:31.406866+0000","last_undegraded":"2024-09-21T03:18:31.406866+0000","last_fullsized":"2024-09-21T03:18:31.406866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:49.705469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T03:18:30.424469+0000","last_change":"2024-09-21T03:18:29.410309+0000","last_active":"2024-09-21T03:18:30.424469+0000","last_peered":"2024-09-21T03:18:30.424469+0000","last_clean":"2024-09-21T03:18:30.424469+0000","last_became_active":"2024-09-21T03:18:29.409959+0000","last_became_peered":"2024-09-21T03:18:29.409959+0000","last_unstale":"2024-09-21T03:18:30.424469+0000","last_undegraded":"2024-09-21T03:18:30.424469+0000","last_fullsized":"2024-09-21T03:18:30.424469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:52.457819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":831488,"data_stored":672185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":81325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":245760,"data_stored":81361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":81395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":827392,"data_stored":665941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:18:36.372 INFO:tasks.ceph.mds.d.smithi162.stderr:2024-09-21T03:18:36.371+0000 7ff0c11d9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T03:18:38.874 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:18:39.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:38.998+0000 7f07b6825640 1 -- 172.21.15.105:0/3863730956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07b00b51c0 msgr2=0x7f07b015c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:39.001 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:38.998+0000 7f07b6825640 1 --2- 172.21.15.105:0/3863730956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07b00b51c0 0x7f07b015c6e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f07b00cd8d0 tx=0x7f07a002a530 comp rx=0 tx=0).stop 2024-09-21T03:18:39.001 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:38.999+0000 7f07b6825640 1 -- 172.21.15.105:0/3863730956 shutdown_connections 2024-09-21T03:18:39.001 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:38.999+0000 7f07b6825640 1 --2- 172.21.15.105:0/3863730956 >> v2:172.21.15.162:3300/0 conn(0x7f07b00d1490 0x7f07b00cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:39.001 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:38.999+0000 7f07b6825640 1 --2- 172.21.15.105:0/3863730956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07b00b51c0 0x7f07b015c6e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:39.001 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:38.999+0000 7f07b6825640 1 -- 172.21.15.105:0/3863730956 >> 172.21.15.105:0/3863730956 conn(0x7f07b0072ae0 msgr2=0x7f07b0072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:39.001 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:38.999+0000 7f07b6825640 1 -- 172.21.15.105:0/3863730956 shutdown_connections 2024-09-21T03:18:39.001 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:38.999+0000 7f07b6825640 1 -- 172.21.15.105:0/3863730956 wait complete. 2024-09-21T03:18:39.001 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.000+0000 7f07b6825640 1 Processor -- start 2024-09-21T03:18:39.002 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.001+0000 7f07b6825640 1 -- start start 2024-09-21T03:18:39.005 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.002+0000 7f07b6825640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07b00b51c0 0x7f07b00cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:39.005 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.002+0000 7f07b6825640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07b00ccbd0 0x7f07b01f3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:39.005 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.002+0000 7f07b6825640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07b00d1490 0x7f07b00b0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:39.005 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.002+0000 7f07b6825640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f07b00cf2b0 con 0x7f07b00d1490 2024-09-21T03:18:39.005 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.002+0000 7f07b6825640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f07b00cf130 con 0x7f07b00b51c0 2024-09-21T03:18:39.006 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.002+0000 7f07b6825640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f07b00cf430 con 0x7f07b00ccbd0 2024-09-21T03:18:39.006 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.002+0000 7f07b4dc2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07b00d1490 0x7f07b00b0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:39.006 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.002+0000 7f07b4dc2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07b00d1490 0x7f07b00b0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56466/0 (socket says 172.21.15.105:56466) 2024-09-21T03:18:39.006 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.002+0000 7f07b4dc2640 1 -- 172.21.15.105:0/1227598740 learned_addr learned my addr 172.21.15.105:0/1227598740 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:39.006 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.002+0000 7f07affff640 1 --2- 172.21.15.105:0/1227598740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07b00b51c0 0x7f07b00cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:39.006 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.002+0000 7f07af7fe640 1 --2- 172.21.15.105:0/1227598740 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07b00ccbd0 0x7f07b01f3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:39.006 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.002+0000 7f07b4dc2640 1 -- 172.21.15.105:0/1227598740 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07b00ccbd0 msgr2=0x7f07b01f3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:39.006 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.002+0000 7f07b4dc2640 1 --2- 172.21.15.105:0/1227598740 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07b00ccbd0 0x7f07b01f3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:39.006 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.002+0000 7f07b4dc2640 1 -- 172.21.15.105:0/1227598740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07b00b51c0 msgr2=0x7f07b00cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:39.006 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.002+0000 7f07b4dc2640 1 --2- 172.21.15.105:0/1227598740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07b00b51c0 0x7f07b00cb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:39.006 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.002+0000 7f07b4dc2640 1 -- 172.21.15.105:0/1227598740 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07b014dda0 con 0x7f07b00d1490 2024-09-21T03:18:39.007 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.002+0000 7f07b4dc2640 1 --2- 172.21.15.105:0/1227598740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07b00d1490 0x7f07b00b0d00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f07a800eab0 tx=0x7f07a800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:39.007 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.003+0000 7f07acff9640 1 -- 172.21.15.105:0/1227598740 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a800cea0 con 0x7f07b00d1490 2024-09-21T03:18:39.007 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.003+0000 7f07acff9640 1 -- 172.21.15.105:0/1227598740 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f07a8004b20 con 0x7f07b00d1490 2024-09-21T03:18:39.007 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.003+0000 7f07acff9640 1 -- 172.21.15.105:0/1227598740 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a8005020 con 0x7f07b00d1490 2024-09-21T03:18:39.007 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.003+0000 7f07b6825640 1 -- 172.21.15.105:0/1227598740 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07b01f4790 con 0x7f07b00d1490 2024-09-21T03:18:39.007 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.003+0000 7f07b6825640 1 -- 172.21.15.105:0/1227598740 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07b014d2c0 con 0x7f07b00d1490 2024-09-21T03:18:39.008 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.004+0000 7f07b6825640 1 -- 172.21.15.105:0/1227598740 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07b01f4500 con 0x7f07b00d1490 2024-09-21T03:18:39.008 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.004+0000 7f07acff9640 1 -- 172.21.15.105:0/1227598740 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f07a80051c0 con 0x7f07b00d1490 2024-09-21T03:18:39.008 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.005+0000 7f07acff9640 1 --2- 172.21.15.105:0/1227598740 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f079c078b90 0x7f079c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:39.008 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.005+0000 7f07acff9640 1 -- 172.21.15.105:0/1227598740 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f07a809ba00 con 0x7f07b00d1490 2024-09-21T03:18:39.008 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.005+0000 7f07affff640 1 --2- 172.21.15.105:0/1227598740 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f079c078b90 0x7f079c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:39.008 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.006+0000 7f07affff640 1 --2- 172.21.15.105:0/1227598740 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f079c078b90 0x7f079c07b0a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f07a0034000 tx=0x7f07a0004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:39.011 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.010+0000 7f07acff9640 1 -- 172.21.15.105:0/1227598740 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f07a8063ed0 con 0x7f07b00d1490 2024-09-21T03:18:39.189 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.188+0000 7f07b6825640 1 -- 172.21.15.105:0/1227598740 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f07b00cf8e0 con 0x7f079c078b90 2024-09-21T03:18:39.193 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.192+0000 7f07acff9640 1 -- 172.21.15.105:0/1227598740 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251936 (secure 0 0 0) 0x7f07b00cf8e0 con 0x7f079c078b90 2024-09-21T03:18:39.196 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:18:39.198 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:18:39.199 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.195+0000 7f07b6825640 1 -- 172.21.15.105:0/1227598740 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f079c078b90 msgr2=0x7f079c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:39.199 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.195+0000 7f07b6825640 1 --2- 172.21.15.105:0/1227598740 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f079c078b90 0x7f079c07b0a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f07a0034000 tx=0x7f07a0004730 comp rx=0 tx=0).stop 2024-09-21T03:18:39.199 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.195+0000 7f07b6825640 1 -- 172.21.15.105:0/1227598740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07b00d1490 msgr2=0x7f07b00b0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:39.199 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.195+0000 7f07b6825640 1 --2- 172.21.15.105:0/1227598740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07b00d1490 0x7f07b00b0d00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f07a800eab0 tx=0x7f07a800ef70 comp rx=0 tx=0).stop 2024-09-21T03:18:39.199 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.195+0000 7f07b6825640 1 -- 172.21.15.105:0/1227598740 shutdown_connections 2024-09-21T03:18:39.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.195+0000 7f07b6825640 1 --2- 172.21.15.105:0/1227598740 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f079c078b90 0x7f079c07b0a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:39.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.195+0000 7f07b6825640 1 --2- 172.21.15.105:0/1227598740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07b00d1490 0x7f07b00b0d00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:39.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.195+0000 7f07b6825640 1 --2- 172.21.15.105:0/1227598740 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07b00ccbd0 0x7f07b01f3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:39.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.195+0000 7f07b6825640 1 --2- 172.21.15.105:0/1227598740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07b00b51c0 0x7f07b00cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:39.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.195+0000 7f07b6825640 1 -- 172.21.15.105:0/1227598740 >> 172.21.15.105:0/1227598740 conn(0x7f07b0072ae0 msgr2=0x7f07b015ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:39.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.196+0000 7f07b6825640 1 -- 172.21.15.105:0/1227598740 shutdown_connections 2024-09-21T03:18:39.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.196+0000 7f07b6825640 1 -- 172.21.15.105:0/1227598740 wait complete. 2024-09-21T03:18:39.208 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-21T03:18:37.280372+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219288,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755432,"statfs":{"total":773094113280,"available":772869562368,"internally_reserved":0,"allocated":3121152,"data_stored":1835436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.892810"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964347+0000","last_change":"2024-09-21T03:18:30.421775+0000","last_active":"2024-09-21T03:18:31.964347+0000","last_peered":"2024-09-21T03:18:31.964347+0000","last_clean":"2024-09-21T03:18:31.964347+0000","last_became_active":"2024-09-21T03:18:30.421134+0000","last_became_peered":"2024-09-21T03:18:30.421134+0000","last_unstale":"2024-09-21T03:18:31.964347+0000","last_undegraded":"2024-09-21T03:18:31.964347+0000","last_fullsized":"2024-09-21T03:18:31.964347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:22:19.398695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963048+0000","last_change":"2024-09-21T03:18:30.413336+0000","last_active":"2024-09-21T03:18:31.963048+0000","last_peered":"2024-09-21T03:18:31.963048+0000","last_clean":"2024-09-21T03:18:31.963048+0000","last_became_active":"2024-09-21T03:18:30.412935+0000","last_became_peered":"2024-09-21T03:18:30.412935+0000","last_unstale":"2024-09-21T03:18:31.963048+0000","last_undegraded":"2024-09-21T03:18:31.963048+0000","last_fullsized":"2024-09-21T03:18:31.963048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:23.469160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963279+0000","last_change":"2024-09-21T03:18:30.406431+0000","last_active":"2024-09-21T03:18:31.963279+0000","last_peered":"2024-09-21T03:18:31.963279+0000","last_clean":"2024-09-21T03:18:31.963279+0000","last_became_active":"2024-09-21T03:18:30.406082+0000","last_became_peered":"2024-09-21T03:18:30.406082+0000","last_unstale":"2024-09-21T03:18:31.963279+0000","last_undegraded":"2024-09-21T03:18:31.963279+0000","last_fullsized":"2024-09-21T03:18:31.963279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:40.341066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964108+0000","last_change":"2024-09-21T03:18:30.420362+0000","last_active":"2024-09-21T03:18:31.964108+0000","last_peered":"2024-09-21T03:18:31.964108+0000","last_clean":"2024-09-21T03:18:31.964108+0000","last_became_active":"2024-09-21T03:18:30.420008+0000","last_became_peered":"2024-09-21T03:18:30.420008+0000","last_unstale":"2024-09-21T03:18:31.964108+0000","last_undegraded":"2024-09-21T03:18:31.964108+0000","last_fullsized":"2024-09-21T03:18:31.964108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:03.282327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964438+0000","last_change":"2024-09-21T03:18:30.418302+0000","last_active":"2024-09-21T03:18:31.964438+0000","last_peered":"2024-09-21T03:18:31.964438+0000","last_clean":"2024-09-21T03:18:31.964438+0000","last_became_active":"2024-09-21T03:18:30.413965+0000","last_became_peered":"2024-09-21T03:18:30.413965+0000","last_unstale":"2024-09-21T03:18:31.964438+0000","last_undegraded":"2024-09-21T03:18:31.964438+0000","last_fullsized":"2024-09-21T03:18:31.964438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:03.282327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963716+0000","last_change":"2024-09-21T03:18:30.417641+0000","last_active":"2024-09-21T03:18:31.963716+0000","last_peered":"2024-09-21T03:18:31.963716+0000","last_clean":"2024-09-21T03:18:31.963716+0000","last_became_active":"2024-09-21T03:18:30.417338+0000","last_became_peered":"2024-09-21T03:18:30.417338+0000","last_unstale":"2024-09-21T03:18:31.963716+0000","last_undegraded":"2024-09-21T03:18:31.963716+0000","last_fullsized":"2024-09-21T03:18:31.963716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:23.551826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963715+0000","last_change":"2024-09-21T03:18:30.420816+0000","last_active":"2024-09-21T03:18:31.963715+0000","last_peered":"2024-09-21T03:18:31.963715+0000","last_clean":"2024-09-21T03:18:31.963715+0000","last_became_active":"2024-09-21T03:18:30.419232+0000","last_became_peered":"2024-09-21T03:18:30.419232+0000","last_unstale":"2024-09-21T03:18:31.963715+0000","last_undegraded":"2024-09-21T03:18:31.963715+0000","last_fullsized":"2024-09-21T03:18:31.963715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:42.098569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406163+0000","last_change":"2024-09-21T03:18:30.412879+0000","last_active":"2024-09-21T03:18:31.406163+0000","last_peered":"2024-09-21T03:18:31.406163+0000","last_clean":"2024-09-21T03:18:31.406163+0000","last_became_active":"2024-09-21T03:18:30.412496+0000","last_became_peered":"2024-09-21T03:18:30.412496+0000","last_unstale":"2024-09-21T03:18:31.406163+0000","last_undegraded":"2024-09-21T03:18:31.406163+0000","last_fullsized":"2024-09-21T03:18:31.406163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:27.777960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964687+0000","last_change":"2024-09-21T03:18:30.421800+0000","last_active":"2024-09-21T03:18:31.964687+0000","last_peered":"2024-09-21T03:18:31.964687+0000","last_clean":"2024-09-21T03:18:31.964687+0000","last_became_active":"2024-09-21T03:18:30.421488+0000","last_became_peered":"2024-09-21T03:18:30.421488+0000","last_unstale":"2024-09-21T03:18:31.964687+0000","last_undegraded":"2024-09-21T03:18:31.964687+0000","last_fullsized":"2024-09-21T03:18:31.964687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:52:00.902253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.410872+0000","last_change":"2024-09-21T03:18:30.412736+0000","last_active":"2024-09-21T03:18:31.410872+0000","last_peered":"2024-09-21T03:18:31.410872+0000","last_clean":"2024-09-21T03:18:31.410872+0000","last_became_active":"2024-09-21T03:18:30.412083+0000","last_became_peered":"2024-09-21T03:18:30.412083+0000","last_unstale":"2024-09-21T03:18:31.410872+0000","last_undegraded":"2024-09-21T03:18:31.410872+0000","last_fullsized":"2024-09-21T03:18:31.410872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:14:17.253259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.409843+0000","last_change":"2024-09-21T03:18:30.413123+0000","last_active":"2024-09-21T03:18:31.409843+0000","last_peered":"2024-09-21T03:18:31.409843+0000","last_clean":"2024-09-21T03:18:31.409843+0000","last_became_active":"2024-09-21T03:18:30.412788+0000","last_became_peered":"2024-09-21T03:18:30.412788+0000","last_unstale":"2024-09-21T03:18:31.409843+0000","last_undegraded":"2024-09-21T03:18:31.409843+0000","last_fullsized":"2024-09-21T03:18:31.409843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:37:21.324892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.409635+0000","last_change":"2024-09-21T03:18:30.396144+0000","last_active":"2024-09-21T03:18:31.409635+0000","last_peered":"2024-09-21T03:18:31.409635+0000","last_clean":"2024-09-21T03:18:31.409635+0000","last_became_active":"2024-09-21T03:18:30.395814+0000","last_became_peered":"2024-09-21T03:18:30.395814+0000","last_unstale":"2024-09-21T03:18:31.409635+0000","last_undegraded":"2024-09-21T03:18:31.409635+0000","last_fullsized":"2024-09-21T03:18:31.409635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:44.020518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406573+0000","last_change":"2024-09-21T03:18:30.402434+0000","last_active":"2024-09-21T03:18:31.406573+0000","last_peered":"2024-09-21T03:18:31.406573+0000","last_clean":"2024-09-21T03:18:31.406573+0000","last_became_active":"2024-09-21T03:18:30.402116+0000","last_became_peered":"2024-09-21T03:18:30.402116+0000","last_unstale":"2024-09-21T03:18:31.406573+0000","last_undegraded":"2024-09-21T03:18:31.406573+0000","last_fullsized":"2024-09-21T03:18:31.406573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:21.239439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963837+0000","last_change":"2024-09-21T03:18:30.407726+0000","last_active":"2024-09-21T03:18:31.963837+0000","last_peered":"2024-09-21T03:18:31.963837+0000","last_clean":"2024-09-21T03:18:31.963837+0000","last_became_active":"2024-09-21T03:18:30.404823+0000","last_became_peered":"2024-09-21T03:18:30.404823+0000","last_unstale":"2024-09-21T03:18:31.963837+0000","last_undegraded":"2024-09-21T03:18:31.963837+0000","last_fullsized":"2024-09-21T03:18:31.963837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:34.397671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963083+0000","last_change":"2024-09-21T03:18:30.400323+0000","last_active":"2024-09-21T03:18:31.963083+0000","last_peered":"2024-09-21T03:18:31.963083+0000","last_clean":"2024-09-21T03:18:31.963083+0000","last_became_active":"2024-09-21T03:18:30.399972+0000","last_became_peered":"2024-09-21T03:18:30.399972+0000","last_unstale":"2024-09-21T03:18:31.963083+0000","last_undegraded":"2024-09-21T03:18:31.963083+0000","last_fullsized":"2024-09-21T03:18:31.963083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:15.659300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963314+0000","last_change":"2024-09-21T03:18:30.418155+0000","last_active":"2024-09-21T03:18:31.963314+0000","last_peered":"2024-09-21T03:18:31.963314+0000","last_clean":"2024-09-21T03:18:31.963314+0000","last_became_active":"2024-09-21T03:18:30.417794+0000","last_became_peered":"2024-09-21T03:18:30.417794+0000","last_unstale":"2024-09-21T03:18:31.963314+0000","last_undegraded":"2024-09-21T03:18:31.963314+0000","last_fullsized":"2024-09-21T03:18:31.963314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:15.659300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963961+0000","last_change":"2024-09-21T03:18:30.411196+0000","last_active":"2024-09-21T03:18:31.963961+0000","last_peered":"2024-09-21T03:18:31.963961+0000","last_clean":"2024-09-21T03:18:31.963961+0000","last_became_active":"2024-09-21T03:18:30.410865+0000","last_became_peered":"2024-09-21T03:18:30.410865+0000","last_unstale":"2024-09-21T03:18:31.963961+0000","last_undegraded":"2024-09-21T03:18:31.963961+0000","last_fullsized":"2024-09-21T03:18:31.963961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:54.882986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963694+0000","last_change":"2024-09-21T03:18:30.400114+0000","last_active":"2024-09-21T03:18:31.963694+0000","last_peered":"2024-09-21T03:18:31.963694+0000","last_clean":"2024-09-21T03:18:31.963694+0000","last_became_active":"2024-09-21T03:18:30.399748+0000","last_became_peered":"2024-09-21T03:18:30.399748+0000","last_unstale":"2024-09-21T03:18:31.963694+0000","last_undegraded":"2024-09-21T03:18:31.963694+0000","last_fullsized":"2024-09-21T03:18:31.963694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:25.808010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964697+0000","last_change":"2024-09-21T03:18:30.409223+0000","last_active":"2024-09-21T03:18:31.964697+0000","last_peered":"2024-09-21T03:18:31.964697+0000","last_clean":"2024-09-21T03:18:31.964697+0000","last_became_active":"2024-09-21T03:18:30.408876+0000","last_became_peered":"2024-09-21T03:18:30.408876+0000","last_unstale":"2024-09-21T03:18:31.964697+0000","last_undegraded":"2024-09-21T03:18:31.964697+0000","last_fullsized":"2024-09-21T03:18:31.964697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:55:03.483520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.410645+0000","last_change":"2024-09-21T03:18:30.398035+0000","last_active":"2024-09-21T03:18:31.410645+0000","last_peered":"2024-09-21T03:18:31.410645+0000","last_clean":"2024-09-21T03:18:31.410645+0000","last_became_active":"2024-09-21T03:18:30.397692+0000","last_became_peered":"2024-09-21T03:18:30.397692+0000","last_unstale":"2024-09-21T03:18:31.410645+0000","last_undegraded":"2024-09-21T03:18:31.410645+0000","last_fullsized":"2024-09-21T03:18:31.410645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:18.166927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963501+0000","last_change":"2024-09-21T03:18:30.410634+0000","last_active":"2024-09-21T03:18:31.963501+0000","last_peered":"2024-09-21T03:18:31.963501+0000","last_clean":"2024-09-21T03:18:31.963501+0000","last_became_active":"2024-09-21T03:18:30.410352+0000","last_became_peered":"2024-09-21T03:18:30.410352+0000","last_unstale":"2024-09-21T03:18:31.963501+0000","last_undegraded":"2024-09-21T03:18:31.963501+0000","last_fullsized":"2024-09-21T03:18:31.963501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:10.314462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963467+0000","last_change":"2024-09-21T03:18:30.412518+0000","last_active":"2024-09-21T03:18:31.963467+0000","last_peered":"2024-09-21T03:18:31.963467+0000","last_clean":"2024-09-21T03:18:31.963467+0000","last_became_active":"2024-09-21T03:18:30.411784+0000","last_became_peered":"2024-09-21T03:18:30.411784+0000","last_unstale":"2024-09-21T03:18:31.963467+0000","last_undegraded":"2024-09-21T03:18:31.963467+0000","last_fullsized":"2024-09-21T03:18:31.963467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:11.956694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406217+0000","last_change":"2024-09-21T03:18:30.400029+0000","last_active":"2024-09-21T03:18:31.406217+0000","last_peered":"2024-09-21T03:18:31.406217+0000","last_clean":"2024-09-21T03:18:31.406217+0000","last_became_active":"2024-09-21T03:18:30.399708+0000","last_became_peered":"2024-09-21T03:18:30.399708+0000","last_unstale":"2024-09-21T03:18:31.406217+0000","last_undegraded":"2024-09-21T03:18:31.406217+0000","last_fullsized":"2024-09-21T03:18:31.406217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:45.250175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963526+0000","last_change":"2024-09-21T03:18:30.417315+0000","last_active":"2024-09-21T03:18:31.963526+0000","last_peered":"2024-09-21T03:18:31.963526+0000","last_clean":"2024-09-21T03:18:31.963526+0000","last_became_active":"2024-09-21T03:18:30.417005+0000","last_became_peered":"2024-09-21T03:18:30.417005+0000","last_unstale":"2024-09-21T03:18:31.963526+0000","last_undegraded":"2024-09-21T03:18:31.963526+0000","last_fullsized":"2024-09-21T03:18:31.963526+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:21.239439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406541+0000","last_change":"2024-09-21T03:18:30.408987+0000","last_active":"2024-09-21T03:18:31.406541+0000","last_peered":"2024-09-21T03:18:31.406541+0000","last_clean":"2024-09-21T03:18:31.406541+0000","last_became_active":"2024-09-21T03:18:30.408657+0000","last_became_peered":"2024-09-21T03:18:30.408657+0000","last_unstale":"2024-09-21T03:18:31.406541+0000","last_undegraded":"2024-09-21T03:18:31.406541+0000","last_fullsized":"2024-09-21T03:18:31.406541+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:14:17.253259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.410869+0000","last_change":"2024-09-21T03:18:30.409463+0000","last_active":"2024-09-21T03:18:31.410869+0000","last_peered":"2024-09-21T03:18:31.410869+0000","last_clean":"2024-09-21T03:18:31.410869+0000","last_became_active":"2024-09-21T03:18:30.409130+0000","last_became_peered":"2024-09-21T03:18:30.409130+0000","last_unstale":"2024-09-21T03:18:31.410869+0000","last_undegraded":"2024-09-21T03:18:31.410869+0000","last_fullsized":"2024-09-21T03:18:31.410869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:31.370175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963297+0000","last_change":"2024-09-21T03:18:30.415501+0000","last_active":"2024-09-21T03:18:31.963297+0000","last_peered":"2024-09-21T03:18:31.963297+0000","last_clean":"2024-09-21T03:18:31.963297+0000","last_became_active":"2024-09-21T03:18:30.415201+0000","last_became_peered":"2024-09-21T03:18:30.415201+0000","last_unstale":"2024-09-21T03:18:31.963297+0000","last_undegraded":"2024-09-21T03:18:31.963297+0000","last_fullsized":"2024-09-21T03:18:31.963297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:11.956694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406534+0000","last_change":"2024-09-21T03:18:30.409337+0000","last_active":"2024-09-21T03:18:31.406534+0000","last_peered":"2024-09-21T03:18:31.406534+0000","last_clean":"2024-09-21T03:18:31.406534+0000","last_became_active":"2024-09-21T03:18:30.409034+0000","last_became_peered":"2024-09-21T03:18:30.409034+0000","last_unstale":"2024-09-21T03:18:31.406534+0000","last_undegraded":"2024-09-21T03:18:31.406534+0000","last_fullsized":"2024-09-21T03:18:31.406534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:15.659300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963865+0000","last_change":"2024-09-21T03:18:30.409071+0000","last_active":"2024-09-21T03:18:31.963865+0000","last_peered":"2024-09-21T03:18:31.963865+0000","last_clean":"2024-09-21T03:18:31.963865+0000","last_became_active":"2024-09-21T03:18:30.408769+0000","last_became_peered":"2024-09-21T03:18:30.408769+0000","last_unstale":"2024-09-21T03:18:31.963865+0000","last_undegraded":"2024-09-21T03:18:31.963865+0000","last_fullsized":"2024-09-21T03:18:31.963865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:26.009956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964289+0000","last_change":"2024-09-21T03:18:30.416900+0000","last_active":"2024-09-21T03:18:31.964289+0000","last_peered":"2024-09-21T03:18:31.964289+0000","last_clean":"2024-09-21T03:18:31.964289+0000","last_became_active":"2024-09-21T03:18:30.416566+0000","last_became_peered":"2024-09-21T03:18:30.416566+0000","last_unstale":"2024-09-21T03:18:31.964289+0000","last_undegraded":"2024-09-21T03:18:31.964289+0000","last_fullsized":"2024-09-21T03:18:31.964289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:52:00.902253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963482+0000","last_change":"2024-09-21T03:18:30.409381+0000","last_active":"2024-09-21T03:18:31.963482+0000","last_peered":"2024-09-21T03:18:31.963482+0000","last_clean":"2024-09-21T03:18:31.963482+0000","last_became_active":"2024-09-21T03:18:30.409066+0000","last_became_peered":"2024-09-21T03:18:30.409066+0000","last_unstale":"2024-09-21T03:18:31.963482+0000","last_undegraded":"2024-09-21T03:18:31.963482+0000","last_fullsized":"2024-09-21T03:18:31.963482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:44.039210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.409946+0000","last_change":"2024-09-21T03:18:30.413745+0000","last_active":"2024-09-21T03:18:31.409946+0000","last_peered":"2024-09-21T03:18:31.409946+0000","last_clean":"2024-09-21T03:18:31.409946+0000","last_became_active":"2024-09-21T03:18:30.413434+0000","last_became_peered":"2024-09-21T03:18:30.413434+0000","last_unstale":"2024-09-21T03:18:31.409946+0000","last_undegraded":"2024-09-21T03:18:31.409946+0000","last_fullsized":"2024-09-21T03:18:31.409946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:40.786257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.409337+0000","last_change":"2024-09-21T03:18:30.405133+0000","last_active":"2024-09-21T03:18:31.409337+0000","last_peered":"2024-09-21T03:18:31.409337+0000","last_clean":"2024-09-21T03:18:31.409337+0000","last_became_active":"2024-09-21T03:18:30.404795+0000","last_became_peered":"2024-09-21T03:18:30.404795+0000","last_unstale":"2024-09-21T03:18:31.409337+0000","last_undegraded":"2024-09-21T03:18:31.409337+0000","last_fullsized":"2024-09-21T03:18:31.409337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:26.872806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406704+0000","last_change":"2024-09-21T03:18:29.409241+0000","last_active":"2024-09-21T03:18:31.406704+0000","last_peered":"2024-09-21T03:18:31.406704+0000","last_clean":"2024-09-21T03:18:31.406704+0000","last_became_active":"2024-09-21T03:18:29.408988+0000","last_became_peered":"2024-09-21T03:18:29.408988+0000","last_unstale":"2024-09-21T03:18:31.406704+0000","last_undegraded":"2024-09-21T03:18:31.406704+0000","last_fullsized":"2024-09-21T03:18:31.406704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:52.299913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964047+0000","last_change":"2024-09-21T03:18:30.406637+0000","last_active":"2024-09-21T03:18:31.964047+0000","last_peered":"2024-09-21T03:18:31.964047+0000","last_clean":"2024-09-21T03:18:31.964047+0000","last_became_active":"2024-09-21T03:18:30.405638+0000","last_became_peered":"2024-09-21T03:18:30.405638+0000","last_unstale":"2024-09-21T03:18:31.964047+0000","last_undegraded":"2024-09-21T03:18:31.964047+0000","last_fullsized":"2024-09-21T03:18:31.964047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:25.913095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.410144+0000","last_change":"2024-09-21T03:18:29.401902+0000","last_active":"2024-09-21T03:18:31.410144+0000","last_peered":"2024-09-21T03:18:31.410144+0000","last_clean":"2024-09-21T03:18:31.410144+0000","last_became_active":"2024-09-21T03:18:29.401056+0000","last_became_peered":"2024-09-21T03:18:29.401056+0000","last_unstale":"2024-09-21T03:18:31.410144+0000","last_undegraded":"2024-09-21T03:18:31.410144+0000","last_fullsized":"2024-09-21T03:18:31.410144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:41.323758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406156+0000","last_change":"2024-09-21T03:18:29.403151+0000","last_active":"2024-09-21T03:18:31.406156+0000","last_peered":"2024-09-21T03:18:31.406156+0000","last_clean":"2024-09-21T03:18:31.406156+0000","last_became_active":"2024-09-21T03:18:29.402799+0000","last_became_peered":"2024-09-21T03:18:29.402799+0000","last_unstale":"2024-09-21T03:18:31.406156+0000","last_undegraded":"2024-09-21T03:18:31.406156+0000","last_fullsized":"2024-09-21T03:18:31.406156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:50.682717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406269+0000","last_change":"2024-09-21T03:18:30.417827+0000","last_active":"2024-09-21T03:18:31.406269+0000","last_peered":"2024-09-21T03:18:31.406269+0000","last_clean":"2024-09-21T03:18:31.406269+0000","last_became_active":"2024-09-21T03:18:30.417509+0000","last_became_peered":"2024-09-21T03:18:30.417509+0000","last_unstale":"2024-09-21T03:18:31.406269+0000","last_undegraded":"2024-09-21T03:18:31.406269+0000","last_fullsized":"2024-09-21T03:18:31.406269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:03.094324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963424+0000","last_change":"2024-09-21T03:18:29.406382+0000","last_active":"2024-09-21T03:18:31.963424+0000","last_peered":"2024-09-21T03:18:31.963424+0000","last_clean":"2024-09-21T03:18:31.963424+0000","last_became_active":"2024-09-21T03:18:29.405616+0000","last_became_peered":"2024-09-21T03:18:29.405616+0000","last_unstale":"2024-09-21T03:18:31.963424+0000","last_undegraded":"2024-09-21T03:18:31.963424+0000","last_fullsized":"2024-09-21T03:18:31.963424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:45.917164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.962705+0000","last_change":"2024-09-21T03:18:30.402277+0000","last_active":"2024-09-21T03:18:31.962705+0000","last_peered":"2024-09-21T03:18:31.962705+0000","last_clean":"2024-09-21T03:18:31.962705+0000","last_became_active":"2024-09-21T03:18:30.401923+0000","last_became_peered":"2024-09-21T03:18:30.401923+0000","last_unstale":"2024-09-21T03:18:31.962705+0000","last_undegraded":"2024-09-21T03:18:31.962705+0000","last_fullsized":"2024-09-21T03:18:31.962705+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:45.250175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.410347+0000","last_change":"2024-09-21T03:18:29.407735+0000","last_active":"2024-09-21T03:18:31.410347+0000","last_peered":"2024-09-21T03:18:31.410347+0000","last_clean":"2024-09-21T03:18:31.410347+0000","last_became_active":"2024-09-21T03:18:29.407377+0000","last_became_peered":"2024-09-21T03:18:29.407377+0000","last_unstale":"2024-09-21T03:18:31.410347+0000","last_undegraded":"2024-09-21T03:18:31.410347+0000","last_fullsized":"2024-09-21T03:18:31.410347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:25.867003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963866+0000","last_change":"2024-09-21T03:18:30.411099+0000","last_active":"2024-09-21T03:18:31.963866+0000","last_peered":"2024-09-21T03:18:31.963866+0000","last_clean":"2024-09-21T03:18:31.963866+0000","last_became_active":"2024-09-21T03:18:30.410755+0000","last_became_peered":"2024-09-21T03:18:30.410755+0000","last_unstale":"2024-09-21T03:18:31.963866+0000","last_undegraded":"2024-09-21T03:18:31.963866+0000","last_fullsized":"2024-09-21T03:18:31.963866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:49.705469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963834+0000","last_change":"2024-09-21T03:18:29.408842+0000","last_active":"2024-09-21T03:18:31.963834+0000","last_peered":"2024-09-21T03:18:31.963834+0000","last_clean":"2024-09-21T03:18:31.963834+0000","last_became_active":"2024-09-21T03:18:29.408345+0000","last_became_peered":"2024-09-21T03:18:29.408345+0000","last_unstale":"2024-09-21T03:18:31.963834+0000","last_undegraded":"2024-09-21T03:18:31.963834+0000","last_fullsized":"2024-09-21T03:18:31.963834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:22.158750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963990+0000","last_change":"2024-09-21T03:18:30.413425+0000","last_active":"2024-09-21T03:18:31.963990+0000","last_peered":"2024-09-21T03:18:31.963990+0000","last_clean":"2024-09-21T03:18:31.963990+0000","last_became_active":"2024-09-21T03:18:30.412694+0000","last_became_peered":"2024-09-21T03:18:30.412694+0000","last_unstale":"2024-09-21T03:18:31.963990+0000","last_undegraded":"2024-09-21T03:18:31.963990+0000","last_fullsized":"2024-09-21T03:18:31.963990+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:36.512318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963255+0000","last_change":"2024-09-21T03:18:29.407409+0000","last_active":"2024-09-21T03:18:31.963255+0000","last_peered":"2024-09-21T03:18:31.963255+0000","last_clean":"2024-09-21T03:18:31.963255+0000","last_became_active":"2024-09-21T03:18:29.407071+0000","last_became_peered":"2024-09-21T03:18:29.407071+0000","last_unstale":"2024-09-21T03:18:31.963255+0000","last_undegraded":"2024-09-21T03:18:31.963255+0000","last_fullsized":"2024-09-21T03:18:31.963255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:43.033407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.409859+0000","last_change":"2024-09-21T03:18:30.410735+0000","last_active":"2024-09-21T03:18:31.409859+0000","last_peered":"2024-09-21T03:18:31.409859+0000","last_clean":"2024-09-21T03:18:31.409859+0000","last_became_active":"2024-09-21T03:18:30.409130+0000","last_became_peered":"2024-09-21T03:18:30.409130+0000","last_unstale":"2024-09-21T03:18:31.409859+0000","last_undegraded":"2024-09-21T03:18:31.409859+0000","last_fullsized":"2024-09-21T03:18:31.409859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:28.243325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.410333+0000","last_change":"2024-09-21T03:18:29.402961+0000","last_active":"2024-09-21T03:18:31.410333+0000","last_peered":"2024-09-21T03:18:31.410333+0000","last_clean":"2024-09-21T03:18:31.410333+0000","last_became_active":"2024-09-21T03:18:29.402605+0000","last_became_peered":"2024-09-21T03:18:29.402605+0000","last_unstale":"2024-09-21T03:18:31.410333+0000","last_undegraded":"2024-09-21T03:18:31.410333+0000","last_fullsized":"2024-09-21T03:18:31.410333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:32.360810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964077+0000","last_change":"2024-09-21T03:18:30.416670+0000","last_active":"2024-09-21T03:18:31.964077+0000","last_peered":"2024-09-21T03:18:31.964077+0000","last_clean":"2024-09-21T03:18:31.964077+0000","last_became_active":"2024-09-21T03:18:30.416005+0000","last_became_peered":"2024-09-21T03:18:30.416005+0000","last_unstale":"2024-09-21T03:18:31.964077+0000","last_undegraded":"2024-09-21T03:18:31.964077+0000","last_fullsized":"2024-09-21T03:18:31.964077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:35.898216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964144+0000","last_change":"2024-09-21T03:18:29.405416+0000","last_active":"2024-09-21T03:18:31.964144+0000","last_peered":"2024-09-21T03:18:31.964144+0000","last_clean":"2024-09-21T03:18:31.964144+0000","last_became_active":"2024-09-21T03:18:29.405108+0000","last_became_peered":"2024-09-21T03:18:29.405108+0000","last_unstale":"2024-09-21T03:18:31.964144+0000","last_undegraded":"2024-09-21T03:18:31.964144+0000","last_fullsized":"2024-09-21T03:18:31.964144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:53.454590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963602+0000","last_change":"2024-09-21T03:18:30.409860+0000","last_active":"2024-09-21T03:18:31.963602+0000","last_peered":"2024-09-21T03:18:31.963602+0000","last_clean":"2024-09-21T03:18:31.963602+0000","last_became_active":"2024-09-21T03:18:30.409559+0000","last_became_peered":"2024-09-21T03:18:30.409559+0000","last_unstale":"2024-09-21T03:18:31.963602+0000","last_undegraded":"2024-09-21T03:18:31.963602+0000","last_fullsized":"2024-09-21T03:18:31.963602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:57.589254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964301+0000","last_change":"2024-09-21T03:18:29.413878+0000","last_active":"2024-09-21T03:18:31.964301+0000","last_peered":"2024-09-21T03:18:31.964301+0000","last_clean":"2024-09-21T03:18:31.964301+0000","last_became_active":"2024-09-21T03:18:29.413571+0000","last_became_peered":"2024-09-21T03:18:29.413571+0000","last_unstale":"2024-09-21T03:18:31.964301+0000","last_undegraded":"2024-09-21T03:18:31.964301+0000","last_fullsized":"2024-09-21T03:18:31.964301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:21.627091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964666+0000","last_change":"2024-09-21T03:18:30.416945+0000","last_active":"2024-09-21T03:18:31.964666+0000","last_peered":"2024-09-21T03:18:31.964666+0000","last_clean":"2024-09-21T03:18:31.964666+0000","last_became_active":"2024-09-21T03:18:30.416610+0000","last_became_peered":"2024-09-21T03:18:30.416610+0000","last_unstale":"2024-09-21T03:18:31.964666+0000","last_undegraded":"2024-09-21T03:18:31.964666+0000","last_fullsized":"2024-09-21T03:18:31.964666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:22:49.496448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.409505+0000","last_change":"2024-09-21T03:18:29.401191+0000","last_active":"2024-09-21T03:18:31.409505+0000","last_peered":"2024-09-21T03:18:31.409505+0000","last_clean":"2024-09-21T03:18:31.409505+0000","last_became_active":"2024-09-21T03:18:29.400775+0000","last_became_peered":"2024-09-21T03:18:29.400775+0000","last_unstale":"2024-09-21T03:18:31.409505+0000","last_undegraded":"2024-09-21T03:18:31.409505+0000","last_fullsized":"2024-09-21T03:18:31.409505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:03:55.435346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.410129+0000","last_change":"2024-09-21T03:18:30.406919+0000","last_active":"2024-09-21T03:18:31.410129+0000","last_peered":"2024-09-21T03:18:31.410129+0000","last_clean":"2024-09-21T03:18:31.410129+0000","last_became_active":"2024-09-21T03:18:30.406584+0000","last_became_peered":"2024-09-21T03:18:30.406584+0000","last_unstale":"2024-09-21T03:18:31.410129+0000","last_undegraded":"2024-09-21T03:18:31.410129+0000","last_fullsized":"2024-09-21T03:18:31.410129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:46.766926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963384+0000","last_change":"2024-09-21T03:18:29.401326+0000","last_active":"2024-09-21T03:18:31.963384+0000","last_peered":"2024-09-21T03:18:31.963384+0000","last_clean":"2024-09-21T03:18:31.963384+0000","last_became_active":"2024-09-21T03:18:29.400268+0000","last_became_peered":"2024-09-21T03:18:29.400268+0000","last_unstale":"2024-09-21T03:18:31.963384+0000","last_undegraded":"2024-09-21T03:18:31.963384+0000","last_fullsized":"2024-09-21T03:18:31.963384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:53.644507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964135+0000","last_change":"2024-09-21T03:18:30.420964+0000","last_active":"2024-09-21T03:18:31.964135+0000","last_peered":"2024-09-21T03:18:31.964135+0000","last_clean":"2024-09-21T03:18:31.964135+0000","last_became_active":"2024-09-21T03:18:30.420316+0000","last_became_peered":"2024-09-21T03:18:30.420316+0000","last_unstale":"2024-09-21T03:18:31.964135+0000","last_undegraded":"2024-09-21T03:18:31.964135+0000","last_fullsized":"2024-09-21T03:18:31.964135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:59.120847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.410688+0000","last_change":"2024-09-21T03:18:29.405556+0000","last_active":"2024-09-21T03:18:31.410688+0000","last_peered":"2024-09-21T03:18:31.410688+0000","last_clean":"2024-09-21T03:18:31.410688+0000","last_became_active":"2024-09-21T03:18:29.405128+0000","last_became_peered":"2024-09-21T03:18:29.405128+0000","last_unstale":"2024-09-21T03:18:31.410688+0000","last_undegraded":"2024-09-21T03:18:31.410688+0000","last_fullsized":"2024-09-21T03:18:31.410688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:08.606490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964082+0000","last_change":"2024-09-21T03:18:30.416107+0000","last_active":"2024-09-21T03:18:31.964082+0000","last_peered":"2024-09-21T03:18:31.964082+0000","last_clean":"2024-09-21T03:18:31.964082+0000","last_became_active":"2024-09-21T03:18:30.415764+0000","last_became_peered":"2024-09-21T03:18:30.415764+0000","last_unstale":"2024-09-21T03:18:31.964082+0000","last_undegraded":"2024-09-21T03:18:31.964082+0000","last_fullsized":"2024-09-21T03:18:31.964082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:40.961482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963646+0000","last_change":"2024-09-21T03:18:29.402215+0000","last_active":"2024-09-21T03:18:31.963646+0000","last_peered":"2024-09-21T03:18:31.963646+0000","last_clean":"2024-09-21T03:18:31.963646+0000","last_became_active":"2024-09-21T03:18:29.401853+0000","last_became_peered":"2024-09-21T03:18:29.401853+0000","last_unstale":"2024-09-21T03:18:31.963646+0000","last_undegraded":"2024-09-21T03:18:31.963646+0000","last_fullsized":"2024-09-21T03:18:31.963646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:22.158750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964837+0000","last_change":"2024-09-21T03:18:30.421447+0000","last_active":"2024-09-21T03:18:31.964837+0000","last_peered":"2024-09-21T03:18:31.964837+0000","last_clean":"2024-09-21T03:18:31.964837+0000","last_became_active":"2024-09-21T03:18:30.421061+0000","last_became_peered":"2024-09-21T03:18:30.421061+0000","last_unstale":"2024-09-21T03:18:31.964837+0000","last_undegraded":"2024-09-21T03:18:31.964837+0000","last_fullsized":"2024-09-21T03:18:31.964837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:34.616164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963366+0000","last_change":"2024-09-21T03:18:29.404008+0000","last_active":"2024-09-21T03:18:31.963366+0000","last_peered":"2024-09-21T03:18:31.963366+0000","last_clean":"2024-09-21T03:18:31.963366+0000","last_became_active":"2024-09-21T03:18:29.403700+0000","last_became_peered":"2024-09-21T03:18:29.403700+0000","last_unstale":"2024-09-21T03:18:31.963366+0000","last_undegraded":"2024-09-21T03:18:31.963366+0000","last_fullsized":"2024-09-21T03:18:31.963366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:24.802208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964230+0000","last_change":"2024-09-21T03:18:30.420751+0000","last_active":"2024-09-21T03:18:31.964230+0000","last_peered":"2024-09-21T03:18:31.964230+0000","last_clean":"2024-09-21T03:18:31.964230+0000","last_became_active":"2024-09-21T03:18:30.420401+0000","last_became_peered":"2024-09-21T03:18:30.420401+0000","last_unstale":"2024-09-21T03:18:31.964230+0000","last_undegraded":"2024-09-21T03:18:31.964230+0000","last_fullsized":"2024-09-21T03:18:31.964230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:55.226807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963123+0000","last_change":"2024-09-21T03:18:29.410099+0000","last_active":"2024-09-21T03:18:31.963123+0000","last_peered":"2024-09-21T03:18:31.963123+0000","last_clean":"2024-09-21T03:18:31.963123+0000","last_became_active":"2024-09-21T03:18:29.409723+0000","last_became_peered":"2024-09-21T03:18:29.409723+0000","last_unstale":"2024-09-21T03:18:31.963123+0000","last_undegraded":"2024-09-21T03:18:31.963123+0000","last_fullsized":"2024-09-21T03:18:31.963123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:43.447253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964356+0000","last_change":"2024-09-21T03:18:30.416344+0000","last_active":"2024-09-21T03:18:31.964356+0000","last_peered":"2024-09-21T03:18:31.964356+0000","last_clean":"2024-09-21T03:18:31.964356+0000","last_became_active":"2024-09-21T03:18:30.415584+0000","last_became_peered":"2024-09-21T03:18:30.415584+0000","last_unstale":"2024-09-21T03:18:31.964356+0000","last_undegraded":"2024-09-21T03:18:31.964356+0000","last_fullsized":"2024-09-21T03:18:31.964356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:24:42.041578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963862+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:18:31.963862+0000","last_peered":"2024-09-21T03:18:31.963862+0000","last_clean":"2024-09-21T03:18:31.963862+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:18:31.963862+0000","last_undegraded":"2024-09-21T03:18:31.963862+0000","last_fullsized":"2024-09-21T03:18:31.963862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963163+0000","last_change":"2024-09-21T03:18:29.407517+0000","last_active":"2024-09-21T03:18:31.963163+0000","last_peered":"2024-09-21T03:18:31.963163+0000","last_clean":"2024-09-21T03:18:31.963163+0000","last_became_active":"2024-09-21T03:18:29.407174+0000","last_became_peered":"2024-09-21T03:18:29.407174+0000","last_unstale":"2024-09-21T03:18:31.963163+0000","last_undegraded":"2024-09-21T03:18:31.963163+0000","last_fullsized":"2024-09-21T03:18:31.963163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:43.447253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406392+0000","last_change":"2024-09-21T03:18:30.416787+0000","last_active":"2024-09-21T03:18:31.406392+0000","last_peered":"2024-09-21T03:18:31.406392+0000","last_clean":"2024-09-21T03:18:31.406392+0000","last_became_active":"2024-09-21T03:18:30.416468+0000","last_became_peered":"2024-09-21T03:18:30.416468+0000","last_unstale":"2024-09-21T03:18:31.406392+0000","last_undegraded":"2024-09-21T03:18:31.406392+0000","last_fullsized":"2024-09-21T03:18:31.406392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:13.827662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963278+0000","last_change":"2024-09-21T03:18:29.400053+0000","last_active":"2024-09-21T03:18:31.963278+0000","last_peered":"2024-09-21T03:18:31.963278+0000","last_clean":"2024-09-21T03:18:31.963278+0000","last_became_active":"2024-09-21T03:18:29.399616+0000","last_became_peered":"2024-09-21T03:18:29.399616+0000","last_unstale":"2024-09-21T03:18:31.963278+0000","last_undegraded":"2024-09-21T03:18:31.963278+0000","last_fullsized":"2024-09-21T03:18:31.963278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:32.360810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.962934+0000","last_change":"2024-09-21T03:18:30.406884+0000","last_active":"2024-09-21T03:18:31.962934+0000","last_peered":"2024-09-21T03:18:31.962934+0000","last_clean":"2024-09-21T03:18:31.962934+0000","last_became_active":"2024-09-21T03:18:30.406497+0000","last_became_peered":"2024-09-21T03:18:30.406497+0000","last_unstale":"2024-09-21T03:18:31.962934+0000","last_undegraded":"2024-09-21T03:18:31.962934+0000","last_fullsized":"2024-09-21T03:18:31.962934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:25.356077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963522+0000","last_change":"2024-09-21T03:18:29.403123+0000","last_active":"2024-09-21T03:18:31.963522+0000","last_peered":"2024-09-21T03:18:31.963522+0000","last_clean":"2024-09-21T03:18:31.963522+0000","last_became_active":"2024-09-21T03:18:29.402613+0000","last_became_peered":"2024-09-21T03:18:29.402613+0000","last_unstale":"2024-09-21T03:18:31.963522+0000","last_undegraded":"2024-09-21T03:18:31.963522+0000","last_fullsized":"2024-09-21T03:18:31.963522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:45.917164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.962777+0000","last_change":"2024-09-21T03:18:30.401955+0000","last_active":"2024-09-21T03:18:31.962777+0000","last_peered":"2024-09-21T03:18:31.962777+0000","last_clean":"2024-09-21T03:18:31.962777+0000","last_became_active":"2024-09-21T03:18:30.401587+0000","last_became_peered":"2024-09-21T03:18:30.401587+0000","last_unstale":"2024-09-21T03:18:31.962777+0000","last_undegraded":"2024-09-21T03:18:31.962777+0000","last_fullsized":"2024-09-21T03:18:31.962777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:03.094324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964372+0000","last_change":"2024-09-21T03:18:29.407459+0000","last_active":"2024-09-21T03:18:31.964372+0000","last_peered":"2024-09-21T03:18:31.964372+0000","last_clean":"2024-09-21T03:18:31.964372+0000","last_became_active":"2024-09-21T03:18:29.407132+0000","last_became_peered":"2024-09-21T03:18:29.407132+0000","last_unstale":"2024-09-21T03:18:31.964372+0000","last_undegraded":"2024-09-21T03:18:31.964372+0000","last_fullsized":"2024-09-21T03:18:31.964372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:58.516525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.409395+0000","last_change":"2024-09-21T03:18:30.406973+0000","last_active":"2024-09-21T03:18:31.409395+0000","last_peered":"2024-09-21T03:18:31.409395+0000","last_clean":"2024-09-21T03:18:31.409395+0000","last_became_active":"2024-09-21T03:18:30.405992+0000","last_became_peered":"2024-09-21T03:18:30.405992+0000","last_unstale":"2024-09-21T03:18:31.409395+0000","last_undegraded":"2024-09-21T03:18:31.409395+0000","last_fullsized":"2024-09-21T03:18:31.409395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:33.366612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963029+0000","last_change":"2024-09-21T03:18:29.406073+0000","last_active":"2024-09-21T03:18:31.963029+0000","last_peered":"2024-09-21T03:18:31.963029+0000","last_clean":"2024-09-21T03:18:31.963029+0000","last_became_active":"2024-09-21T03:18:29.405786+0000","last_became_peered":"2024-09-21T03:18:29.405786+0000","last_unstale":"2024-09-21T03:18:31.963029+0000","last_undegraded":"2024-09-21T03:18:31.963029+0000","last_fullsized":"2024-09-21T03:18:31.963029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:45.917164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964101+0000","last_change":"2024-09-21T03:18:30.419736+0000","last_active":"2024-09-21T03:18:31.964101+0000","last_peered":"2024-09-21T03:18:31.964101+0000","last_clean":"2024-09-21T03:18:31.964101+0000","last_became_active":"2024-09-21T03:18:30.418805+0000","last_became_peered":"2024-09-21T03:18:30.418805+0000","last_unstale":"2024-09-21T03:18:31.964101+0000","last_undegraded":"2024-09-21T03:18:31.964101+0000","last_fullsized":"2024-09-21T03:18:31.964101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:14.331651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964588+0000","last_change":"2024-09-21T03:18:29.399297+0000","last_active":"2024-09-21T03:18:31.964588+0000","last_peered":"2024-09-21T03:18:31.964588+0000","last_clean":"2024-09-21T03:18:31.964588+0000","last_became_active":"2024-09-21T03:18:29.398956+0000","last_became_peered":"2024-09-21T03:18:29.398956+0000","last_unstale":"2024-09-21T03:18:31.964588+0000","last_undegraded":"2024-09-21T03:18:31.964588+0000","last_fullsized":"2024-09-21T03:18:31.964588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:03.278232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.962949+0000","last_change":"2024-09-21T03:18:30.402564+0000","last_active":"2024-09-21T03:18:31.962949+0000","last_peered":"2024-09-21T03:18:31.962949+0000","last_clean":"2024-09-21T03:18:31.962949+0000","last_became_active":"2024-09-21T03:18:30.401234+0000","last_became_peered":"2024-09-21T03:18:30.401234+0000","last_unstale":"2024-09-21T03:18:31.962949+0000","last_undegraded":"2024-09-21T03:18:31.962949+0000","last_fullsized":"2024-09-21T03:18:31.962949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:13.827662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.962727+0000","last_change":"2024-09-21T03:18:29.403088+0000","last_active":"2024-09-21T03:18:31.962727+0000","last_peered":"2024-09-21T03:18:31.962727+0000","last_clean":"2024-09-21T03:18:31.962727+0000","last_became_active":"2024-09-21T03:18:29.402795+0000","last_became_peered":"2024-09-21T03:18:29.402795+0000","last_unstale":"2024-09-21T03:18:31.962727+0000","last_undegraded":"2024-09-21T03:18:31.962727+0000","last_fullsized":"2024-09-21T03:18:31.962727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:22.158750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406630+0000","last_change":"2024-09-21T03:18:30.414287+0000","last_active":"2024-09-21T03:18:31.406630+0000","last_peered":"2024-09-21T03:18:31.406630+0000","last_clean":"2024-09-21T03:18:31.406630+0000","last_became_active":"2024-09-21T03:18:30.413950+0000","last_became_peered":"2024-09-21T03:18:30.413950+0000","last_unstale":"2024-09-21T03:18:31.406630+0000","last_undegraded":"2024-09-21T03:18:31.406630+0000","last_fullsized":"2024-09-21T03:18:31.406630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:23.551826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.410461+0000","last_change":"2024-09-21T03:18:29.406121+0000","last_active":"2024-09-21T03:18:31.410461+0000","last_peered":"2024-09-21T03:18:31.410461+0000","last_clean":"2024-09-21T03:18:31.410461+0000","last_became_active":"2024-09-21T03:18:29.405509+0000","last_became_peered":"2024-09-21T03:18:29.405509+0000","last_unstale":"2024-09-21T03:18:31.410461+0000","last_undegraded":"2024-09-21T03:18:31.410461+0000","last_fullsized":"2024-09-21T03:18:31.410461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:08.961149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963103+0000","last_change":"2024-09-21T03:18:30.404103+0000","last_active":"2024-09-21T03:18:31.963103+0000","last_peered":"2024-09-21T03:18:31.963103+0000","last_clean":"2024-09-21T03:18:31.963103+0000","last_became_active":"2024-09-21T03:18:30.402457+0000","last_became_peered":"2024-09-21T03:18:30.402457+0000","last_unstale":"2024-09-21T03:18:31.963103+0000","last_undegraded":"2024-09-21T03:18:31.963103+0000","last_fullsized":"2024-09-21T03:18:31.963103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:48.325684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963050+0000","last_change":"2024-09-21T03:18:29.405727+0000","last_active":"2024-09-21T03:18:31.963050+0000","last_peered":"2024-09-21T03:18:31.963050+0000","last_clean":"2024-09-21T03:18:31.963050+0000","last_became_active":"2024-09-21T03:18:29.405421+0000","last_became_peered":"2024-09-21T03:18:29.405421+0000","last_unstale":"2024-09-21T03:18:31.963050+0000","last_undegraded":"2024-09-21T03:18:31.963050+0000","last_fullsized":"2024-09-21T03:18:31.963050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:08.961149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.409341+0000","last_change":"2024-09-21T03:18:30.399926+0000","last_active":"2024-09-21T03:18:31.409341+0000","last_peered":"2024-09-21T03:18:31.409341+0000","last_clean":"2024-09-21T03:18:31.409341+0000","last_became_active":"2024-09-21T03:18:30.399600+0000","last_became_peered":"2024-09-21T03:18:30.399600+0000","last_unstale":"2024-09-21T03:18:31.409341+0000","last_undegraded":"2024-09-21T03:18:31.409341+0000","last_fullsized":"2024-09-21T03:18:31.409341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:23.164552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.962797+0000","last_change":"2024-09-21T03:18:29.405412+0000","last_active":"2024-09-21T03:18:31.962797+0000","last_peered":"2024-09-21T03:18:31.962797+0000","last_clean":"2024-09-21T03:18:31.962797+0000","last_became_active":"2024-09-21T03:18:29.405094+0000","last_became_peered":"2024-09-21T03:18:29.405094+0000","last_unstale":"2024-09-21T03:18:31.962797+0000","last_undegraded":"2024-09-21T03:18:31.962797+0000","last_fullsized":"2024-09-21T03:18:31.962797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:58.516525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406400+0000","last_change":"2024-09-21T03:18:30.405606+0000","last_active":"2024-09-21T03:18:31.406400+0000","last_peered":"2024-09-21T03:18:31.406400+0000","last_clean":"2024-09-21T03:18:31.406400+0000","last_became_active":"2024-09-21T03:18:30.403297+0000","last_became_peered":"2024-09-21T03:18:30.403297+0000","last_unstale":"2024-09-21T03:18:31.406400+0000","last_undegraded":"2024-09-21T03:18:31.406400+0000","last_fullsized":"2024-09-21T03:18:31.406400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:18.166927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963138+0000","last_change":"2024-09-21T03:18:29.400372+0000","last_active":"2024-09-21T03:18:31.963138+0000","last_peered":"2024-09-21T03:18:31.963138+0000","last_clean":"2024-09-21T03:18:31.963138+0000","last_became_active":"2024-09-21T03:18:29.400005+0000","last_became_peered":"2024-09-21T03:18:29.400005+0000","last_unstale":"2024-09-21T03:18:31.963138+0000","last_undegraded":"2024-09-21T03:18:31.963138+0000","last_fullsized":"2024-09-21T03:18:31.963138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:21.627091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406843+0000","last_change":"2024-09-21T03:18:30.418312+0000","last_active":"2024-09-21T03:18:31.406843+0000","last_peered":"2024-09-21T03:18:31.406843+0000","last_clean":"2024-09-21T03:18:31.406843+0000","last_became_active":"2024-09-21T03:18:30.417984+0000","last_became_peered":"2024-09-21T03:18:30.417984+0000","last_unstale":"2024-09-21T03:18:31.406843+0000","last_undegraded":"2024-09-21T03:18:31.406843+0000","last_fullsized":"2024-09-21T03:18:31.406843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:40.961482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964737+0000","last_change":"2024-09-21T03:18:29.400789+0000","last_active":"2024-09-21T03:18:31.964737+0000","last_peered":"2024-09-21T03:18:31.964737+0000","last_clean":"2024-09-21T03:18:31.964737+0000","last_became_active":"2024-09-21T03:18:29.400487+0000","last_became_peered":"2024-09-21T03:18:29.400487+0000","last_unstale":"2024-09-21T03:18:31.964737+0000","last_undegraded":"2024-09-21T03:18:31.964737+0000","last_fullsized":"2024-09-21T03:18:31.964737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:42.181902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.410214+0000","last_change":"2024-09-21T03:18:30.394333+0000","last_active":"2024-09-21T03:18:31.410214+0000","last_peered":"2024-09-21T03:18:31.410214+0000","last_clean":"2024-09-21T03:18:31.410214+0000","last_became_active":"2024-09-21T03:18:30.393995+0000","last_became_peered":"2024-09-21T03:18:30.393995+0000","last_unstale":"2024-09-21T03:18:31.410214+0000","last_undegraded":"2024-09-21T03:18:31.410214+0000","last_fullsized":"2024-09-21T03:18:31.410214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:10.520052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963771+0000","last_change":"2024-09-21T03:18:30.419098+0000","last_active":"2024-09-21T03:18:31.963771+0000","last_peered":"2024-09-21T03:18:31.963771+0000","last_clean":"2024-09-21T03:18:31.963771+0000","last_became_active":"2024-09-21T03:18:30.416696+0000","last_became_peered":"2024-09-21T03:18:30.416696+0000","last_unstale":"2024-09-21T03:18:31.963771+0000","last_undegraded":"2024-09-21T03:18:31.963771+0000","last_fullsized":"2024-09-21T03:18:31.963771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:40.961482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963622+0000","last_change":"2024-09-21T03:18:29.410284+0000","last_active":"2024-09-21T03:18:31.963622+0000","last_peered":"2024-09-21T03:18:31.963622+0000","last_clean":"2024-09-21T03:18:31.963622+0000","last_became_active":"2024-09-21T03:18:29.409965+0000","last_became_peered":"2024-09-21T03:18:29.409965+0000","last_unstale":"2024-09-21T03:18:31.963622+0000","last_undegraded":"2024-09-21T03:18:31.963622+0000","last_fullsized":"2024-09-21T03:18:31.963622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:43.014716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963980+0000","last_change":"2024-09-21T03:18:30.418184+0000","last_active":"2024-09-21T03:18:31.963980+0000","last_peered":"2024-09-21T03:18:31.963980+0000","last_clean":"2024-09-21T03:18:31.963980+0000","last_became_active":"2024-09-21T03:18:30.417865+0000","last_became_peered":"2024-09-21T03:18:30.417865+0000","last_unstale":"2024-09-21T03:18:31.963980+0000","last_undegraded":"2024-09-21T03:18:31.963980+0000","last_fullsized":"2024-09-21T03:18:31.963980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:24:42.041578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964437+0000","last_change":"2024-09-21T03:18:29.407648+0000","last_active":"2024-09-21T03:18:31.964437+0000","last_peered":"2024-09-21T03:18:31.964437+0000","last_clean":"2024-09-21T03:18:31.964437+0000","last_became_active":"2024-09-21T03:18:29.407300+0000","last_became_peered":"2024-09-21T03:18:29.407300+0000","last_unstale":"2024-09-21T03:18:31.964437+0000","last_undegraded":"2024-09-21T03:18:31.964437+0000","last_fullsized":"2024-09-21T03:18:31.964437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:27.237523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963902+0000","last_change":"2024-09-21T03:18:30.413724+0000","last_active":"2024-09-21T03:18:31.963902+0000","last_peered":"2024-09-21T03:18:31.963902+0000","last_clean":"2024-09-21T03:18:31.963902+0000","last_became_active":"2024-09-21T03:18:30.413106+0000","last_became_peered":"2024-09-21T03:18:30.413106+0000","last_unstale":"2024-09-21T03:18:31.963902+0000","last_undegraded":"2024-09-21T03:18:31.963902+0000","last_fullsized":"2024-09-21T03:18:31.963902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:51.420496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406866+0000","last_change":"2024-09-21T03:18:29.406529+0000","last_active":"2024-09-21T03:18:31.406866+0000","last_peered":"2024-09-21T03:18:31.406866+0000","last_clean":"2024-09-21T03:18:31.406866+0000","last_became_active":"2024-09-21T03:18:29.406195+0000","last_became_peered":"2024-09-21T03:18:29.406195+0000","last_unstale":"2024-09-21T03:18:31.406866+0000","last_undegraded":"2024-09-21T03:18:31.406866+0000","last_fullsized":"2024-09-21T03:18:31.406866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:03:55.435346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406866+0000","last_change":"2024-09-21T03:18:30.402788+0000","last_active":"2024-09-21T03:18:31.406866+0000","last_peered":"2024-09-21T03:18:31.406866+0000","last_clean":"2024-09-21T03:18:31.406866+0000","last_became_active":"2024-09-21T03:18:30.400506+0000","last_became_peered":"2024-09-21T03:18:30.400506+0000","last_unstale":"2024-09-21T03:18:31.406866+0000","last_undegraded":"2024-09-21T03:18:31.406866+0000","last_fullsized":"2024-09-21T03:18:31.406866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:49.705469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964074+0000","last_change":"2024-09-21T03:18:29.410309+0000","last_active":"2024-09-21T03:18:31.964074+0000","last_peered":"2024-09-21T03:18:31.964074+0000","last_clean":"2024-09-21T03:18:31.964074+0000","last_became_active":"2024-09-21T03:18:29.409959+0000","last_became_peered":"2024-09-21T03:18:29.409959+0000","last_unstale":"2024-09-21T03:18:31.964074+0000","last_undegraded":"2024-09-21T03:18:31.964074+0000","last_fullsized":"2024-09-21T03:18:31.964074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:52.457819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":831488,"data_stored":672185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":81325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":245760,"data_stored":81361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":81395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":839680,"data_stored":672241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:18:39.212 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T03:18:39.213 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-21T03:18:39.213 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-21T03:18:39.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.360+0000 7f79995f1640 1 -- 172.21.15.105:0/2925933366 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f79940cf130 msgr2=0x7f7994071650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:39.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.360+0000 7f79995f1640 1 --2- 172.21.15.105:0/2925933366 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f79940cf130 0x7f7994071650 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7994072af0 tx=0x7f798802a530 comp rx=0 tx=0).stop 2024-09-21T03:18:39.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.360+0000 7f79995f1640 1 -- 172.21.15.105:0/2925933366 shutdown_connections 2024-09-21T03:18:39.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.360+0000 7f79995f1640 1 --2- 172.21.15.105:0/2925933366 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f79940cf130 0x7f7994071650 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:39.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.360+0000 7f79995f1640 1 --2- 172.21.15.105:0/2925933366 >> v2:172.21.15.162:3300/0 conn(0x7f79940b2cb0 0x7f79940b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:39.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.360+0000 7f79995f1640 1 -- 172.21.15.105:0/2925933366 >> 172.21.15.105:0/2925933366 conn(0x7f79940cdcb0 msgr2=0x7f79940ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:39.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.360+0000 7f79995f1640 1 -- 172.21.15.105:0/2925933366 shutdown_connections 2024-09-21T03:18:39.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.360+0000 7f79995f1640 1 -- 172.21.15.105:0/2925933366 wait complete. 2024-09-21T03:18:39.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.362+0000 7f79995f1640 1 Processor -- start 2024-09-21T03:18:39.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.362+0000 7f79995f1640 1 -- start start 2024-09-21T03:18:39.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.363+0000 7f79995f1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79940b2cb0 0x7f799414c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:39.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.363+0000 7f79995f1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f79940cf130 0x7f79941e7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:39.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.363+0000 7f79995f1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f799415b8f0 0x7f79941f3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:39.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.363+0000 7f79995f1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f79940ae120 con 0x7f79940cf130 2024-09-21T03:18:39.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.363+0000 7f79995f1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f79940adfa0 con 0x7f79940b2cb0 2024-09-21T03:18:39.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.363+0000 7f79995f1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f79940ae2a0 con 0x7f799415b8f0 2024-09-21T03:18:39.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.363+0000 7f79927fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f79940cf130 0x7f79941e7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:39.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.363+0000 7f79927fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f79940cf130 0x7f79941e7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56486/0 (socket says 172.21.15.105:56486) 2024-09-21T03:18:39.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.363+0000 7f79927fc640 1 -- 172.21.15.105:0/1011061318 learned_addr learned my addr 172.21.15.105:0/1011061318 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:39.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.363+0000 7f7992ffd640 1 --2- 172.21.15.105:0/1011061318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79940b2cb0 0x7f799414c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:39.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.363+0000 7f79937fe640 1 --2- 172.21.15.105:0/1011061318 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f799415b8f0 0x7f79941f3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:39.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.363+0000 7f79927fc640 1 -- 172.21.15.105:0/1011061318 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f799415b8f0 msgr2=0x7f79941f3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:39.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.363+0000 7f79927fc640 1 --2- 172.21.15.105:0/1011061318 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f799415b8f0 0x7f79941f3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:39.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.363+0000 7f79927fc640 1 -- 172.21.15.105:0/1011061318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79940b2cb0 msgr2=0x7f799414c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:39.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.363+0000 7f79927fc640 1 --2- 172.21.15.105:0/1011061318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79940b2cb0 0x7f799414c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:39.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.363+0000 7f79927fc640 1 -- 172.21.15.105:0/1011061318 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79941e0e10 con 0x7f79940cf130 2024-09-21T03:18:39.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.363+0000 7f79937fe640 1 --2- 172.21.15.105:0/1011061318 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f799415b8f0 0x7f79941f3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:18:39.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.363+0000 7f7992ffd640 1 --2- 172.21.15.105:0/1011061318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79940b2cb0 0x7f799414c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:18:39.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.364+0000 7f79927fc640 1 --2- 172.21.15.105:0/1011061318 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f79940cf130 0x7f79941e7590 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7988034040 tx=0x7f7988003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:39.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.364+0000 7f797b7fe640 1 -- 172.21.15.105:0/1011061318 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f798803e030 con 0x7f79940cf130 2024-09-21T03:18:39.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.364+0000 7f797b7fe640 1 -- 172.21.15.105:0/1011061318 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7988003e00 con 0x7f79940cf130 2024-09-21T03:18:39.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.364+0000 7f79995f1640 1 -- 172.21.15.105:0/1011061318 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79941e10f0 con 0x7f79940cf130 2024-09-21T03:18:39.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.364+0000 7f797b7fe640 1 -- 172.21.15.105:0/1011061318 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7988035040 con 0x7f79940cf130 2024-09-21T03:18:39.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.364+0000 7f79995f1640 1 -- 172.21.15.105:0/1011061318 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79941e16b0 con 0x7f79940cf130 2024-09-21T03:18:39.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.365+0000 7f79995f1640 1 -- 172.21.15.105:0/1011061318 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79941e0b80 con 0x7f79940cf130 2024-09-21T03:18:39.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.366+0000 7f797b7fe640 1 -- 172.21.15.105:0/1011061318 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7988041030 con 0x7f79940cf130 2024-09-21T03:18:39.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.366+0000 7f797b7fe640 1 --2- 172.21.15.105:0/1011061318 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7980078bc0 0x7f798007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:39.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.366+0000 7f797b7fe640 1 -- 172.21.15.105:0/1011061318 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f79880bb550 con 0x7f79940cf130 2024-09-21T03:18:39.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.366+0000 7f7992ffd640 1 --2- 172.21.15.105:0/1011061318 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7980078bc0 0x7f798007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:39.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.367+0000 7f7992ffd640 1 --2- 172.21.15.105:0/1011061318 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7980078bc0 0x7f798007b0d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7984007e90 tx=0x7f79840073a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:39.372 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.371+0000 7f797b7fe640 1 -- 172.21.15.105:0/1011061318 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f79940b3600 con 0x7f79940cf130 2024-09-21T03:18:39.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.550+0000 7f79995f1640 1 -- 172.21.15.105:0/1011061318 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f79940ae830 con 0x7f79940cf130 2024-09-21T03:18:39.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.550+0000 7f797b7fe640 1 -- 172.21.15.105:0/1011061318 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v31) ==== 86+0+160 (secure 0 0 0) 0x7f7988083990 con 0x7f79940cf130 2024-09-21T03:18:39.552 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:18:39.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.552+0000 7f79995f1640 1 -- 172.21.15.105:0/1011061318 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7980078bc0 msgr2=0x7f798007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:39.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.552+0000 7f79995f1640 1 --2- 172.21.15.105:0/1011061318 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7980078bc0 0x7f798007b0d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7984007e90 tx=0x7f79840073a0 comp rx=0 tx=0).stop 2024-09-21T03:18:39.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.552+0000 7f79995f1640 1 -- 172.21.15.105:0/1011061318 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f79940cf130 msgr2=0x7f79941e7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:39.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.552+0000 7f79995f1640 1 --2- 172.21.15.105:0/1011061318 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f79940cf130 0x7f79941e7590 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7988034040 tx=0x7f7988003910 comp rx=0 tx=0).stop 2024-09-21T03:18:39.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.552+0000 7f79995f1640 1 -- 172.21.15.105:0/1011061318 shutdown_connections 2024-09-21T03:18:39.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.552+0000 7f79995f1640 1 --2- 172.21.15.105:0/1011061318 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7980078bc0 0x7f798007b0d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:39.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.552+0000 7f79995f1640 1 --2- 172.21.15.105:0/1011061318 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f799415b8f0 0x7f79941f3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:39.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.552+0000 7f79995f1640 1 --2- 172.21.15.105:0/1011061318 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f79940cf130 0x7f79941e7590 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:39.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.552+0000 7f79995f1640 1 --2- 172.21.15.105:0/1011061318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79940b2cb0 0x7f799414c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:39.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.552+0000 7f79995f1640 1 -- 172.21.15.105:0/1011061318 >> 172.21.15.105:0/1011061318 conn(0x7f79940cdcb0 msgr2=0x7f79940af150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:39.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.552+0000 7f79995f1640 1 -- 172.21.15.105:0/1011061318 shutdown_connections 2024-09-21T03:18:39.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.552+0000 7f79995f1640 1 -- 172.21.15.105:0/1011061318 wait complete. 2024-09-21T03:18:39.565 INFO:teuthology.orchestra.run.smithi105.stdout:[{"version":31,"timestamp":"2024-09-21T03:18:17.717361+0000","name":"","changes":[{"name":"osd.5/osd_mclock_max_capacity_iops_ssd","new_value":"4701.273858"}]}] 2024-09-21T03:18:39.565 INFO:tasks.ceph_manager:config epoch is 31 2024-09-21T03:18:39.565 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T03:18:39.565 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-21T03:18:39.566 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-21T03:18:39.678 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.677+0000 7f4cf3694640 1 -- 172.21.15.105:0/2549912947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cec0d16c0 msgr2=0x7f4cec0cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:39.679 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.677+0000 7f4cf3694640 1 --2- 172.21.15.105:0/2549912947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cec0d16c0 0x7f4cec0cf310 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4cec0d34f0 tx=0x7f4cdc02a510 comp rx=0 tx=0).stop 2024-09-21T03:18:39.679 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.677+0000 7f4cf3694640 1 -- 172.21.15.105:0/2549912947 shutdown_connections 2024-09-21T03:18:39.679 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.677+0000 7f4cf3694640 1 --2- 172.21.15.105:0/2549912947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cec0d16c0 0x7f4cec0cf310 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:39.679 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.677+0000 7f4cf3694640 1 -- 172.21.15.105:0/2549912947 >> 172.21.15.105:0/2549912947 conn(0x7f4cec09d8f0 msgr2=0x7f4cec0d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:39.679 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.677+0000 7f4cf3694640 1 -- 172.21.15.105:0/2549912947 shutdown_connections 2024-09-21T03:18:39.679 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.677+0000 7f4cf3694640 1 -- 172.21.15.105:0/2549912947 wait complete. 2024-09-21T03:18:39.680 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.678+0000 7f4cf3694640 1 Processor -- start 2024-09-21T03:18:39.680 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.679+0000 7f4cf3694640 1 -- start start 2024-09-21T03:18:39.682 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.680+0000 7f4cf3694640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cec0b3a10 0x7f4cec1530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:39.682 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.680+0000 7f4cf3694640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cec0b9b60 0x7f4cec15b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:39.682 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.680+0000 7f4cf3694640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cec155df0 0x7f4cec15bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:39.683 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.680+0000 7f4cf3694640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4cec0d02f0 con 0x7f4cec155df0 2024-09-21T03:18:39.683 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.680+0000 7f4cf3694640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4cec0d0170 con 0x7f4cec0b3a10 2024-09-21T03:18:39.683 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.680+0000 7f4cf3694640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4cec16a5a0 con 0x7f4cec0b9b60 2024-09-21T03:18:39.683 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.680+0000 7f4cf1c31640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cec155df0 0x7f4cec15bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:39.683 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.680+0000 7f4cf1c31640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cec155df0 0x7f4cec15bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56496/0 (socket says 172.21.15.105:56496) 2024-09-21T03:18:39.683 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.680+0000 7f4cf1c31640 1 -- 172.21.15.105:0/2897338983 learned_addr learned my addr 172.21.15.105:0/2897338983 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:39.683 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.680+0000 7f4cf1430640 1 --2- 172.21.15.105:0/2897338983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cec0b3a10 0x7f4cec1530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:39.683 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.680+0000 7f4cf0c2f640 1 --2- 172.21.15.105:0/2897338983 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cec0b9b60 0x7f4cec15b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:39.683 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.680+0000 7f4cf1c31640 1 -- 172.21.15.105:0/2897338983 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cec0b9b60 msgr2=0x7f4cec15b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:39.683 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.680+0000 7f4cf1c31640 1 --2- 172.21.15.105:0/2897338983 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cec0b9b60 0x7f4cec15b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:39.683 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.680+0000 7f4cf1c31640 1 -- 172.21.15.105:0/2897338983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cec0b3a10 msgr2=0x7f4cec1530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:39.683 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.680+0000 7f4cf1c31640 1 --2- 172.21.15.105:0/2897338983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cec0b3a10 0x7f4cec1530f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:39.683 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.680+0000 7f4cf1c31640 1 -- 172.21.15.105:0/2897338983 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cec15ade0 con 0x7f4cec155df0 2024-09-21T03:18:39.684 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.680+0000 7f4cf1c31640 1 --2- 172.21.15.105:0/2897338983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cec155df0 0x7f4cec15bc50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4ce400c730 tx=0x7f4ce400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:39.684 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.681+0000 7f4ce1ffb640 1 -- 172.21.15.105:0/2897338983 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce4003b70 con 0x7f4cec155df0 2024-09-21T03:18:39.684 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.681+0000 7f4ce1ffb640 1 -- 172.21.15.105:0/2897338983 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ce4003d30 con 0x7f4cec155df0 2024-09-21T03:18:39.684 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.681+0000 7f4cf3694640 1 -- 172.21.15.105:0/2897338983 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cec153630 con 0x7f4cec155df0 2024-09-21T03:18:39.684 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.681+0000 7f4ce1ffb640 1 -- 172.21.15.105:0/2897338983 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce40052d0 con 0x7f4cec155df0 2024-09-21T03:18:39.684 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.681+0000 7f4cf3694640 1 -- 172.21.15.105:0/2897338983 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cec15b380 con 0x7f4cec155df0 2024-09-21T03:18:39.685 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.682+0000 7f4cf3694640 1 -- 172.21.15.105:0/2897338983 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cec0ba0d0 con 0x7f4cec155df0 2024-09-21T03:18:39.685 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.682+0000 7f4ce1ffb640 1 -- 172.21.15.105:0/2897338983 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4ce4005470 con 0x7f4cec155df0 2024-09-21T03:18:39.685 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.683+0000 7f4ce1ffb640 1 --2- 172.21.15.105:0/2897338983 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4cd0078b90 0x7f4cd007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:39.685 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.683+0000 7f4ce1ffb640 1 -- 172.21.15.105:0/2897338983 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f4ce409a920 con 0x7f4cec155df0 2024-09-21T03:18:39.685 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.683+0000 7f4cf1430640 1 --2- 172.21.15.105:0/2897338983 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4cd0078b90 0x7f4cd007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:39.685 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.684+0000 7f4cf1430640 1 --2- 172.21.15.105:0/2897338983 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4cd0078b90 0x7f4cd007b0a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8000f60 tx=0x7f4ce8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:39.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.688+0000 7f4ce1ffb640 1 -- 172.21.15.105:0/2897338983 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4ce40627b0 con 0x7f4cec155df0 2024-09-21T03:18:39.912 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.910+0000 7f4cf3694640 1 -- 172.21.15.105:0/2897338983 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f4cec0b9590 con 0x7f4cec155df0 2024-09-21T03:18:39.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.913+0000 7f4ce1ffb640 1 -- 172.21.15.105:0/2897338983 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+194720 (secure 0 0 0) 0x7f4ce40671e0 con 0x7f4cec155df0 2024-09-21T03:18:39.917 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:18:39.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.916+0000 7f4cf3694640 1 -- 172.21.15.105:0/2897338983 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4cd0078b90 msgr2=0x7f4cd007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:39.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.916+0000 7f4cf3694640 1 --2- 172.21.15.105:0/2897338983 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4cd0078b90 0x7f4cd007b0a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8000f60 tx=0x7f4ce8009040 comp rx=0 tx=0).stop 2024-09-21T03:18:39.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.916+0000 7f4cf3694640 1 -- 172.21.15.105:0/2897338983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cec155df0 msgr2=0x7f4cec15bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:39.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.916+0000 7f4cf3694640 1 --2- 172.21.15.105:0/2897338983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cec155df0 0x7f4cec15bc50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4ce400c730 tx=0x7f4ce400cbf0 comp rx=0 tx=0).stop 2024-09-21T03:18:39.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.916+0000 7f4cf3694640 1 -- 172.21.15.105:0/2897338983 shutdown_connections 2024-09-21T03:18:39.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.916+0000 7f4cf3694640 1 --2- 172.21.15.105:0/2897338983 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4cd0078b90 0x7f4cd007b0a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:39.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.916+0000 7f4cf3694640 1 --2- 172.21.15.105:0/2897338983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cec155df0 0x7f4cec15bc50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:39.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.916+0000 7f4cf3694640 1 --2- 172.21.15.105:0/2897338983 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cec0b9b60 0x7f4cec15b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:39.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.916+0000 7f4cf3694640 1 --2- 172.21.15.105:0/2897338983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cec0b3a10 0x7f4cec1530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:39.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.916+0000 7f4cf3694640 1 -- 172.21.15.105:0/2897338983 >> 172.21.15.105:0/2897338983 conn(0x7f4cec09d8f0 msgr2=0x7f4cec0d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:39.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.916+0000 7f4cf3694640 1 -- 172.21.15.105:0/2897338983 shutdown_connections 2024-09-21T03:18:39.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:39.916+0000 7f4cf3694640 1 -- 172.21.15.105:0/2897338983 wait complete. 2024-09-21T03:18:39.929 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":5,"flags":0,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2934911804},{"type":"v1","addr":"172.21.15.162:6801","nonce":2934911804}]},"active_addr":"172.21.15.162:6801/2934911804","active_change":"2024-09-21T03:18:09.269679+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.162:0","nonce":398730077}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.162:0","nonce":834158504}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.162:0","nonce":4071513150}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.162:0","nonce":2499096036}]}]} 2024-09-21T03:18:39.932 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-21T03:18:39.932 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-21T03:18:39.933 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:18:40.044 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.042+0000 7f822dbdf640 1 -- 172.21.15.105:0/1342566956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8210004800 msgr2=0x7f8210004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.044 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.042+0000 7f822dbdf640 1 --2- 172.21.15.105:0/1342566956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8210004800 0x7f8210004c10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f821c009b20 tx=0x7f8210005830 comp rx=0 tx=0).stop 2024-09-21T03:18:40.044 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.042+0000 7f8227fff640 1 -- 172.21.15.105:0/1342566956 reap_dead start 2024-09-21T03:18:40.044 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.042+0000 7f822dbdf640 1 -- 172.21.15.105:0/1342566956 shutdown_connections 2024-09-21T03:18:40.044 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.042+0000 7f822dbdf640 1 -- 172.21.15.105:0/1342566956 >> 172.21.15.105:0/1342566956 conn(0x7f8228072ae0 msgr2=0x7f8228072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:40.044 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.042+0000 7f822dbdf640 1 -- 172.21.15.105:0/1342566956 shutdown_connections 2024-09-21T03:18:40.044 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.042+0000 7f822dbdf640 1 -- 172.21.15.105:0/1342566956 wait complete. 2024-09-21T03:18:40.045 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.044+0000 7f822dbdf640 1 Processor -- start 2024-09-21T03:18:40.045 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.044+0000 7f822dbdf640 1 -- start start 2024-09-21T03:18:40.048 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.045+0000 7f822dbdf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8210004800 0x7f82280cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.048 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.045+0000 7f822dbdf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82280a94a0 0x7f82281f6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.048 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.045+0000 7f822dbdf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82281f6e50 0x7f82281f7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.049 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.045+0000 7f822dbdf640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f82280ced70 con 0x7f82281f6e50 2024-09-21T03:18:40.049 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.045+0000 7f822dbdf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f82280cebf0 con 0x7f8210004800 2024-09-21T03:18:40.049 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.045+0000 7f822dbdf640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f82280ceef0 con 0x7f82280a94a0 2024-09-21T03:18:40.049 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.045+0000 7f8227fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82281f6e50 0x7f82281f7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.049 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.045+0000 7f8227fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82281f6e50 0x7f82281f7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56512/0 (socket says 172.21.15.105:56512) 2024-09-21T03:18:40.049 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.045+0000 7f8227fff640 1 -- 172.21.15.105:0/3818892703 learned_addr learned my addr 172.21.15.105:0/3818892703 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:40.049 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.045+0000 7f82277fe640 1 --2- 172.21.15.105:0/3818892703 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8210004800 0x7f82280cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.049 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.045+0000 7f8226ffd640 1 --2- 172.21.15.105:0/3818892703 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82280a94a0 0x7f82281f6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.049 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.046+0000 7f8227fff640 1 -- 172.21.15.105:0/3818892703 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82280a94a0 msgr2=0x7f82281f6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.049 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.046+0000 7f8227fff640 1 --2- 172.21.15.105:0/3818892703 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82280a94a0 0x7f82281f6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.049 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.046+0000 7f8227fff640 1 -- 172.21.15.105:0/3818892703 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8210004800 msgr2=0x7f82280cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.049 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.046+0000 7f8227fff640 1 --2- 172.21.15.105:0/3818892703 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8210004800 0x7f82280cb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.050 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.046+0000 7f8227fff640 1 -- 172.21.15.105:0/3818892703 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82281f3f40 con 0x7f82281f6e50 2024-09-21T03:18:40.050 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.046+0000 7f8226ffd640 1 --2- 172.21.15.105:0/3818892703 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82280a94a0 0x7f82281f6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:18:40.050 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.046+0000 7f8227fff640 1 --2- 172.21.15.105:0/3818892703 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82281f6e50 0x7f82281f7260 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8220005fd0 tx=0x7f8220010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:40.050 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.046+0000 7f820ffff640 1 -- 172.21.15.105:0/3818892703 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f822000eea0 con 0x7f82281f6e50 2024-09-21T03:18:40.050 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.046+0000 7f820ffff640 1 -- 172.21.15.105:0/3818892703 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8220015070 con 0x7f82281f6e50 2024-09-21T03:18:40.050 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.046+0000 7f820ffff640 1 -- 172.21.15.105:0/3818892703 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8220003d00 con 0x7f82281f6e50 2024-09-21T03:18:40.050 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.046+0000 7f822dbdf640 1 -- 172.21.15.105:0/3818892703 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82281f4220 con 0x7f82281f6e50 2024-09-21T03:18:40.050 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.046+0000 7f822dbdf640 1 -- 172.21.15.105:0/3818892703 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f822815d3c0 con 0x7f82281f6e50 2024-09-21T03:18:40.050 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.047+0000 7f822dbdf640 1 -- 172.21.15.105:0/3818892703 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82280d16d0 con 0x7f82281f6e50 2024-09-21T03:18:40.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.048+0000 7f820ffff640 1 -- 172.21.15.105:0/3818892703 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8220004030 con 0x7f82281f6e50 2024-09-21T03:18:40.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.048+0000 7f820ffff640 1 --2- 172.21.15.105:0/3818892703 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8214078bc0 0x7f821407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.049+0000 7f820ffff640 1 -- 172.21.15.105:0/3818892703 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f822009bc60 con 0x7f82281f6e50 2024-09-21T03:18:40.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.049+0000 7f82277fe640 1 --2- 172.21.15.105:0/3818892703 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8214078bc0 0x7f821407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.049+0000 7f82277fe640 1 --2- 172.21.15.105:0/3818892703 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8214078bc0 0x7f821407b0d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8218006fd0 tx=0x7f82180067a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:40.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.052+0000 7f820ffff640 1 -- 172.21.15.105:0/3818892703 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8220063b30 con 0x7f82281f6e50 2024-09-21T03:18:40.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.231+0000 7f822dbdf640 1 -- 172.21.15.105:0/3818892703 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8228155090 con 0x7f82281f6e50 2024-09-21T03:18:40.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.232+0000 7f820ffff640 1 -- 172.21.15.105:0/3818892703 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16737 (secure 0 0 0) 0x7f8220068560 con 0x7f82281f6e50 2024-09-21T03:18:40.233 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:18:40.234 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":23,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:18:31.396627+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:18:27.622514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:18:28.719849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:18:40.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.234+0000 7f822dbdf640 1 -- 172.21.15.105:0/3818892703 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8214078bc0 msgr2=0x7f821407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.234+0000 7f822dbdf640 1 --2- 172.21.15.105:0/3818892703 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8214078bc0 0x7f821407b0d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8218006fd0 tx=0x7f82180067a0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.234+0000 7f822dbdf640 1 -- 172.21.15.105:0/3818892703 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82281f6e50 msgr2=0x7f82281f7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.234+0000 7f822dbdf640 1 --2- 172.21.15.105:0/3818892703 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82281f6e50 0x7f82281f7260 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8220005fd0 tx=0x7f8220010f40 comp rx=0 tx=0).stop 2024-09-21T03:18:40.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.234+0000 7f822dbdf640 1 -- 172.21.15.105:0/3818892703 shutdown_connections 2024-09-21T03:18:40.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.234+0000 7f822dbdf640 1 --2- 172.21.15.105:0/3818892703 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8214078bc0 0x7f821407b0d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.234+0000 7f822dbdf640 1 --2- 172.21.15.105:0/3818892703 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82281f6e50 0x7f82281f7260 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.234+0000 7f822dbdf640 1 --2- 172.21.15.105:0/3818892703 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82280a94a0 0x7f82281f6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.234+0000 7f822dbdf640 1 --2- 172.21.15.105:0/3818892703 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8210004800 0x7f82280cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.234+0000 7f822dbdf640 1 -- 172.21.15.105:0/3818892703 >> 172.21.15.105:0/3818892703 conn(0x7f8228072ae0 msgr2=0x7f82280b7390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:40.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.234+0000 7f822dbdf640 1 -- 172.21.15.105:0/3818892703 shutdown_connections 2024-09-21T03:18:40.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.234+0000 7f822dbdf640 1 -- 172.21.15.105:0/3818892703 wait complete. 2024-09-21T03:18:40.247 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-21T03:18:40.247 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:18:40.359 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.358+0000 7f090a470640 1 -- 172.21.15.105:0/20719616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09040cf540 msgr2=0x7f090406eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.358+0000 7f090a470640 1 --2- 172.21.15.105:0/20719616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09040cf540 0x7f090406eab0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f08fc005fd0 tx=0x7f08fc02a9e0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.358+0000 7f090a470640 1 -- 172.21.15.105:0/20719616 shutdown_connections 2024-09-21T03:18:40.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.358+0000 7f090a470640 1 --2- 172.21.15.105:0/20719616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09040cf540 0x7f090406eab0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.358+0000 7f090a470640 1 --2- 172.21.15.105:0/20719616 >> v2:172.21.15.162:3300/0 conn(0x7f09040b66b0 0x7f09040d4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.358+0000 7f090a470640 1 -- 172.21.15.105:0/20719616 >> 172.21.15.105:0/20719616 conn(0x7f090409d7f0 msgr2=0x7f09040d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:40.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.358+0000 7f090a470640 1 -- 172.21.15.105:0/20719616 shutdown_connections 2024-09-21T03:18:40.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.358+0000 7f090a470640 1 -- 172.21.15.105:0/20719616 wait complete. 2024-09-21T03:18:40.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.359+0000 7f090a470640 1 Processor -- start 2024-09-21T03:18:40.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.360+0000 7f090a470640 1 -- start start 2024-09-21T03:18:40.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.361+0000 7f090a470640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09040b9b60 0x7f09041507c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.361+0000 7f090a470640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09040cf540 0x7f09040c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.361+0000 7f090a470640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09040ca030 0x7f09040ca440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.361+0000 7f090a470640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f090406f600 con 0x7f09040b9b60 2024-09-21T03:18:40.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.361+0000 7f090a470640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f090406f480 con 0x7f09040cf540 2024-09-21T03:18:40.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.361+0000 7f090a470640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f090406f780 con 0x7f09040ca030 2024-09-21T03:18:40.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.361+0000 7f0903fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09040b9b60 0x7f09041507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.361+0000 7f0903fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09040b9b60 0x7f09041507c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56526/0 (socket says 172.21.15.105:56526) 2024-09-21T03:18:40.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.361+0000 7f0903fff640 1 -- 172.21.15.105:0/3317782473 learned_addr learned my addr 172.21.15.105:0/3317782473 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:40.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.361+0000 7f09037fe640 1 --2- 172.21.15.105:0/3317782473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09040cf540 0x7f09040c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.361+0000 7f0908a0d640 1 --2- 172.21.15.105:0/3317782473 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09040ca030 0x7f09040ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.361+0000 7f0903fff640 1 -- 172.21.15.105:0/3317782473 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09040ca030 msgr2=0x7f09040ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.361+0000 7f0903fff640 1 --2- 172.21.15.105:0/3317782473 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09040ca030 0x7f09040ca440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.361+0000 7f0903fff640 1 -- 172.21.15.105:0/3317782473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09040cf540 msgr2=0x7f09040c9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.361+0000 7f0903fff640 1 --2- 172.21.15.105:0/3317782473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09040cf540 0x7f09040c9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.361+0000 7f0903fff640 1 -- 172.21.15.105:0/3317782473 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09040ca980 con 0x7f09040b9b60 2024-09-21T03:18:40.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.361+0000 7f0908a0d640 1 --2- 172.21.15.105:0/3317782473 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09040ca030 0x7f09040ca440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:18:40.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.362+0000 7f0903fff640 1 --2- 172.21.15.105:0/3317782473 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09040b9b60 0x7f09041507c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f08f400c390 tx=0x7f08f400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:40.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.362+0000 7f0900ff9640 1 -- 172.21.15.105:0/3317782473 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f4017070 con 0x7f09040b9b60 2024-09-21T03:18:40.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.362+0000 7f0900ff9640 1 -- 172.21.15.105:0/3317782473 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f08f40053c0 con 0x7f09040b9b60 2024-09-21T03:18:40.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.362+0000 7f0900ff9640 1 -- 172.21.15.105:0/3317782473 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f4003880 con 0x7f09040b9b60 2024-09-21T03:18:40.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.362+0000 7f090a470640 1 -- 172.21.15.105:0/3317782473 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0904159460 con 0x7f09040b9b60 2024-09-21T03:18:40.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.362+0000 7f090a470640 1 -- 172.21.15.105:0/3317782473 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09040ce030 con 0x7f09040b9b60 2024-09-21T03:18:40.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.363+0000 7f090a470640 1 -- 172.21.15.105:0/3317782473 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f090406fca0 con 0x7f09040b9b60 2024-09-21T03:18:40.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.363+0000 7f0900ff9640 1 -- 172.21.15.105:0/3317782473 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f08f401a070 con 0x7f09040b9b60 2024-09-21T03:18:40.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.364+0000 7f0900ff9640 1 --2- 172.21.15.105:0/3317782473 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f08f0078b90 0x7f08f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.364+0000 7f0900ff9640 1 -- 172.21.15.105:0/3317782473 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f08f409a0a0 con 0x7f09040b9b60 2024-09-21T03:18:40.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.364+0000 7f09037fe640 1 --2- 172.21.15.105:0/3317782473 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f08f0078b90 0x7f08f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.365+0000 7f09037fe640 1 --2- 172.21.15.105:0/3317782473 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f08f0078b90 0x7f08f007b0a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f090415be50 tx=0x7f08f8005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:40.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.368+0000 7f0900ff9640 1 -- 172.21.15.105:0/3317782473 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f08f4062600 con 0x7f09040b9b60 2024-09-21T03:18:40.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.548+0000 7f090a470640 1 -- 172.21.15.105:0/3317782473 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f09040d3fb0 con 0x7f09040b9b60 2024-09-21T03:18:40.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.549+0000 7f0900ff9640 1 -- 172.21.15.105:0/3317782473 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16737 (secure 0 0 0) 0x7f08f4061f00 con 0x7f09040b9b60 2024-09-21T03:18:40.551 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:18:40.551 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":23,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:18:31.396627+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:18:27.622514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:18:28.719849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:18:40.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.551+0000 7f090a470640 1 -- 172.21.15.105:0/3317782473 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f08f0078b90 msgr2=0x7f08f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.551+0000 7f090a470640 1 --2- 172.21.15.105:0/3317782473 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f08f0078b90 0x7f08f007b0a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f090415be50 tx=0x7f08f8005f90 comp rx=0 tx=0).stop 2024-09-21T03:18:40.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.551+0000 7f090a470640 1 -- 172.21.15.105:0/3317782473 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09040b9b60 msgr2=0x7f09041507c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.551+0000 7f090a470640 1 --2- 172.21.15.105:0/3317782473 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09040b9b60 0x7f09041507c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f08f400c390 tx=0x7f08f400c850 comp rx=0 tx=0).stop 2024-09-21T03:18:40.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.551+0000 7f090a470640 1 -- 172.21.15.105:0/3317782473 shutdown_connections 2024-09-21T03:18:40.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.551+0000 7f090a470640 1 --2- 172.21.15.105:0/3317782473 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f08f0078b90 0x7f08f007b0a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.551+0000 7f090a470640 1 --2- 172.21.15.105:0/3317782473 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09040ca030 0x7f09040ca440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.551+0000 7f090a470640 1 --2- 172.21.15.105:0/3317782473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09040cf540 0x7f09040c9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.551+0000 7f090a470640 1 --2- 172.21.15.105:0/3317782473 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09040b9b60 0x7f09041507c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.551+0000 7f090a470640 1 -- 172.21.15.105:0/3317782473 >> 172.21.15.105:0/3317782473 conn(0x7f090409d7f0 msgr2=0x7f09040d4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:40.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.552+0000 7f090a470640 1 -- 172.21.15.105:0/3317782473 shutdown_connections 2024-09-21T03:18:40.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.552+0000 7f090a470640 1 -- 172.21.15.105:0/3317782473 wait complete. 2024-09-21T03:18:40.565 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-21T03:18:40.565 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-21T03:18:40.565 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-21T03:18:40.566 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-21T03:18:40.566 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-21T03:18:40.566 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-21T03:18:40.567 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-21T03:18:40.567 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-21T03:18:40.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.776+0000 7f0a1f230640 1 -- 172.21.15.105:0/1514683291 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a10005c60 msgr2=0x7f0a10006660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.776+0000 7f0a1f230640 1 --2- 172.21.15.105:0/1514683291 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a10005c60 0x7f0a10006660 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0a1806b4e0 tx=0x7f0a180a7a90 comp rx=0 tx=0).stop 2024-09-21T03:18:40.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.776+0000 7f0a1f230640 1 -- 172.21.15.105:0/1514683291 shutdown_connections 2024-09-21T03:18:40.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.776+0000 7f0a1f230640 1 --2- 172.21.15.105:0/1514683291 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a10005c60 0x7f0a10006660 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.776+0000 7f0a1f230640 1 --2- 172.21.15.105:0/1514683291 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a10036b40 0x7f0a100df180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.776+0000 7f0a1f230640 1 -- 172.21.15.105:0/1514683291 >> 172.21.15.105:0/1514683291 conn(0x7f0a10051420 msgr2=0x7f0a10051860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:40.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.776+0000 7fa85085b640 1 -- 172.21.15.105:0/1034050576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8440df800 msgr2=0x7fa844007c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.776+0000 7f0a1f230640 1 -- 172.21.15.105:0/1514683291 shutdown_connections 2024-09-21T03:18:40.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.776+0000 7fa85085b640 1 --2- 172.21.15.105:0/1034050576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8440df800 0x7fa844007c60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa840013f30 tx=0x7fa840032860 comp rx=0 tx=0).stop 2024-09-21T03:18:40.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.776+0000 7fa85085b640 1 -- 172.21.15.105:0/1034050576 shutdown_connections 2024-09-21T03:18:40.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.776+0000 7fa85085b640 1 --2- 172.21.15.105:0/1034050576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8440df800 0x7fa844007c60 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa840013f30 tx=0x7fa840032860 comp rx=0 tx=0).stop 2024-09-21T03:18:40.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.776+0000 7fa85085b640 1 -- 172.21.15.105:0/1034050576 >> 172.21.15.105:0/1034050576 conn(0x7fa84401e260 msgr2=0x7fa844039e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:40.780 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.776+0000 7f0a1f230640 1 -- 172.21.15.105:0/1514683291 wait complete. 2024-09-21T03:18:40.780 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.777+0000 7fa85085b640 1 -- 172.21.15.105:0/1034050576 shutdown_connections 2024-09-21T03:18:40.780 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.777+0000 7f9179e97640 1 -- 172.21.15.105:0/2814239012 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91740b43e0 msgr2=0x7f917406ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.781 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.777+0000 7f9179e97640 1 --2- 172.21.15.105:0/2814239012 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91740b43e0 0x7f917406ee70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9164013f30 tx=0x7f9164032aa0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.781 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.777+0000 7f9179e97640 1 -- 172.21.15.105:0/2814239012 shutdown_connections 2024-09-21T03:18:40.781 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.777+0000 7f9179e97640 1 --2- 172.21.15.105:0/2814239012 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91740b43e0 0x7f917406ee70 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.781 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.777+0000 7f9179e97640 1 -- 172.21.15.105:0/2814239012 >> 172.21.15.105:0/2814239012 conn(0x7f917406d410 msgr2=0x7f91740b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:40.781 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.777+0000 7f9179e97640 1 -- 172.21.15.105:0/2814239012 shutdown_connections 2024-09-21T03:18:40.781 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.777+0000 7fa85085b640 1 -- 172.21.15.105:0/1034050576 wait complete. 2024-09-21T03:18:40.781 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.778+0000 7f62354c6640 1 -- 172.21.15.105:0/1887207821 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6228052960 msgr2=0x7f6228006a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.782 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.778+0000 7f62354c6640 1 --2- 172.21.15.105:0/1887207821 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6228052960 0x7f6228006a80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6230051230 tx=0x7f62300a6610 comp rx=0 tx=0).stop 2024-09-21T03:18:40.782 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.778+0000 7f9179e97640 1 -- 172.21.15.105:0/2814239012 wait complete. 2024-09-21T03:18:40.782 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.779+0000 7f62354c6640 1 -- 172.21.15.105:0/1887207821 shutdown_connections 2024-09-21T03:18:40.782 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.779+0000 7f62354c6640 1 --2- 172.21.15.105:0/1887207821 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6228052960 0x7f6228006a80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.782 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.779+0000 7f62354c6640 1 --2- 172.21.15.105:0/1887207821 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62280091a0 0x7f6228034b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.782 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.779+0000 7f62354c6640 1 -- 172.21.15.105:0/1887207821 >> 172.21.15.105:0/1887207821 conn(0x7f622801eaf0 msgr2=0x7f622803a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:40.782 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.779+0000 7f62354c6640 1 -- 172.21.15.105:0/1887207821 shutdown_connections 2024-09-21T03:18:40.782 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.779+0000 7f62354c6640 1 -- 172.21.15.105:0/1887207821 wait complete. 2024-09-21T03:18:40.783 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.780+0000 7fa85085b640 1 Processor -- start 2024-09-21T03:18:40.783 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.780+0000 7fa85085b640 1 -- start start 2024-09-21T03:18:40.783 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.780+0000 7f0a1f230640 1 Processor -- start 2024-09-21T03:18:40.784 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.781+0000 7fea94484640 1 -- 172.21.15.105:0/3770760570 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea78004800 msgr2=0x7fea78004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.784 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.781+0000 7f0a1f230640 1 -- start start 2024-09-21T03:18:40.784 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.781+0000 7fea94484640 1 --2- 172.21.15.105:0/3770760570 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea78004800 0x7fea78004c10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fea88001780 tx=0x7fea78005830 comp rx=0 tx=0).stop 2024-09-21T03:18:40.784 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.781+0000 7f9179e97640 1 Processor -- start 2024-09-21T03:18:40.785 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.781+0000 7f9179e97640 1 -- start start 2024-09-21T03:18:40.786 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.781+0000 7fea94484640 1 -- 172.21.15.105:0/3770760570 shutdown_connections 2024-09-21T03:18:40.786 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.781+0000 7fea94484640 1 --2- 172.21.15.105:0/3770760570 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea78004800 0x7fea78004c10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.786 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.781+0000 7fea94484640 1 -- 172.21.15.105:0/3770760570 >> 172.21.15.105:0/3770760570 conn(0x7fea8c0d0000 msgr2=0x7fea8c0d0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:40.786 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.781+0000 7fea94484640 1 -- 172.21.15.105:0/3770760570 shutdown_connections 2024-09-21T03:18:40.786 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.782+0000 7f5fd7470640 1 -- 172.21.15.105:0/4247545723 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5fd015efa0 msgr2=0x7f5fd00b3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.786 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.782+0000 7f5fd7470640 1 --2- 172.21.15.105:0/4247545723 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5fd015efa0 0x7f5fd00b3eb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc00a940 tx=0x7f5fcc02b840 comp rx=0 tx=0).stop 2024-09-21T03:18:40.787 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.782+0000 7fea94484640 1 -- 172.21.15.105:0/3770760570 wait complete. 2024-09-21T03:18:40.787 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.782+0000 7f62354c6640 1 Processor -- start 2024-09-21T03:18:40.787 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.782+0000 7f5fd7470640 1 -- 172.21.15.105:0/4247545723 shutdown_connections 2024-09-21T03:18:40.787 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.782+0000 7f5fd7470640 1 --2- 172.21.15.105:0/4247545723 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5fd015efa0 0x7f5fd00b3eb0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.787 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.782+0000 7f5fd7470640 1 --2- 172.21.15.105:0/4247545723 >> v2:172.21.15.162:3300/0 conn(0x7f5fd013dce0 0x7f5fd00cf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.787 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.782+0000 7f5fd7470640 1 -- 172.21.15.105:0/4247545723 >> 172.21.15.105:0/4247545723 conn(0x7f5fd0073fa0 msgr2=0x7f5fd00743e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:40.788 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.782+0000 7f62354c6640 1 -- start start 2024-09-21T03:18:40.788 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.783+0000 7fa85085b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8440519a0 0x7fa8440e17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.788 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.783+0000 7fa85085b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa844054720 0x7fa844175e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.788 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.783+0000 7fa84b7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8440519a0 0x7fa8440e17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.789 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.783+0000 7fa84b7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8440519a0 0x7fa8440e17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.105:58094/0 (socket says 172.21.15.105:58094) 2024-09-21T03:18:40.789 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.783+0000 7fa84b7fe640 1 -- 172.21.15.105:0/1986588159 learned_addr learned my addr 172.21.15.105:0/1986588159 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:40.789 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.783+0000 7fa84affd640 1 --2- 172.21.15.105:0/1986588159 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa844054720 0x7fa844175e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.789 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.783+0000 7fa85085b640 1 --2- 172.21.15.105:0/1986588159 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa844176380 0x7fa844006540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.789 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.783+0000 7fa85085b640 1 -- 172.21.15.105:0/1986588159 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa8440e42f0 con 0x7fa844176380 2024-09-21T03:18:40.789 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.783+0000 7fa85085b640 1 -- 172.21.15.105:0/1986588159 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa8440e4170 con 0x7fa8440519a0 2024-09-21T03:18:40.789 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.783+0000 7f0a1f230640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a10005c60 0x7f0a10031640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.789 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.783+0000 7fa85085b640 1 -- 172.21.15.105:0/1986588159 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa8440e4470 con 0x7fa844054720 2024-09-21T03:18:40.790 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.783+0000 7f9179e97640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9174070d20 0x7f917415d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.790 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.783+0000 7f9179e97640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91740b43e0 0x7f91741f46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.790 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.784+0000 7f9179e97640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f917415b8c0 0x7f91741f4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.790 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.784+0000 7f9179e97640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f91740cf410 con 0x7f9174070d20 2024-09-21T03:18:40.790 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.784+0000 7f9179e97640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f91740cf290 con 0x7f917415b8c0 2024-09-21T03:18:40.791 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.784+0000 7f0a1f230640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a10009ba0 0x7f0a100dcc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.791 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.784+0000 7f9179e97640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f91740cf590 con 0x7f91740b43e0 2024-09-21T03:18:40.791 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.784+0000 7f0a1f230640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a100dd3b0 0x7f0a10038410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.784+0000 7f9173fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91740b43e0 0x7f91741f46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.784+0000 7f9173fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91740b43e0 0x7f91741f46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.105:60644/0 (socket says 172.21.15.105:60644) 2024-09-21T03:18:40.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.784+0000 7f5fd7470640 1 -- 172.21.15.105:0/4247545723 shutdown_connections 2024-09-21T03:18:40.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.784+0000 7f9173fff640 1 -- 172.21.15.105:0/181319429 learned_addr learned my addr 172.21.15.105:0/181319429 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:40.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.784+0000 7fa84affd640 1 -- 172.21.15.105:0/1986588159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8440519a0 msgr2=0x7fa8440e17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.784+0000 7fa84affd640 1 --2- 172.21.15.105:0/1986588159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8440519a0 0x7fa8440e17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.784+0000 7fa84affd640 1 -- 172.21.15.105:0/1986588159 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa844176380 msgr2=0x7fa844006540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.784+0000 7fa84affd640 1 --2- 172.21.15.105:0/1986588159 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa844176380 0x7fa844006540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.784+0000 7f5fd7470640 1 -- 172.21.15.105:0/4247545723 wait complete. 2024-09-21T03:18:40.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.784+0000 7fa84affd640 1 -- 172.21.15.105:0/1986588159 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8440e0ea0 con 0x7fa844054720 2024-09-21T03:18:40.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.784+0000 7f9179696640 1 --2- 172.21.15.105:0/181319429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f917415b8c0 0x7f91741f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.794 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.784+0000 7f0a1f230640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0a10006ba0 con 0x7f0a10009ba0 2024-09-21T03:18:40.794 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.784+0000 7f0a1f230640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0a1000be40 con 0x7f0a10005c60 2024-09-21T03:18:40.794 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.784+0000 7f0a1f230640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0a10006d20 con 0x7f0a100dd3b0 2024-09-21T03:18:40.794 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.784+0000 7f0a1cfcc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a10005c60 0x7f0a10031640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.794 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.784+0000 7f0a1cfcc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a10005c60 0x7f0a10031640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.105:58104/0 (socket says 172.21.15.105:58104) 2024-09-21T03:18:40.794 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.784+0000 7f0a1cfcc640 1 -- 172.21.15.105:0/733283335 learned_addr learned my addr 172.21.15.105:0/733283335 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:40.795 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.784+0000 7f41c27e6640 1 -- 172.21.15.105:0/2874830179 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41bc0cd080 msgr2=0x7f41bc06ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.795 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.784+0000 7f41c27e6640 1 --2- 172.21.15.105:0/2874830179 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41bc0cd080 0x7f41bc06ee90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f41ac005fd0 tx=0x7f41ac02a6c0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.795 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.784+0000 7f41c27e6640 1 -- 172.21.15.105:0/2874830179 shutdown_connections 2024-09-21T03:18:40.795 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.784+0000 7f41c27e6640 1 --2- 172.21.15.105:0/2874830179 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41bc0cd080 0x7f41bc06ee90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.795 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.784+0000 7f41c27e6640 1 --2- 172.21.15.105:0/2874830179 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41bc15a9b0 0x7f41bc0cfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.795 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.784+0000 7f41c27e6640 1 -- 172.21.15.105:0/2874830179 >> 172.21.15.105:0/2874830179 conn(0x7f41bc06d7d0 msgr2=0x7f41bc0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:40.795 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.784+0000 7fea94484640 1 Processor -- start 2024-09-21T03:18:40.796 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.784+0000 7f41c27e6640 1 -- 172.21.15.105:0/2874830179 shutdown_connections 2024-09-21T03:18:40.796 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.784+0000 7f0a1cfcc640 1 -- 172.21.15.105:0/733283335 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a100dd3b0 msgr2=0x7f0a10038410 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T03:18:40.796 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.785+0000 7f0a1cfcc640 1 --2- 172.21.15.105:0/733283335 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a100dd3b0 0x7f0a10038410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.796 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.785+0000 7f0a1cfcc640 1 -- 172.21.15.105:0/733283335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a10009ba0 msgr2=0x7f0a100dcc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.796 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.785+0000 7f0a1cfcc640 1 --2- 172.21.15.105:0/733283335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a10009ba0 0x7f0a100dcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.796 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.785+0000 7f0a1cfcc640 1 -- 172.21.15.105:0/733283335 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a1017e370 con 0x7f0a10005c60 2024-09-21T03:18:40.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.785+0000 7fea94484640 1 -- start start 2024-09-21T03:18:40.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.785+0000 7f41c27e6640 1 -- 172.21.15.105:0/2874830179 wait complete. 2024-09-21T03:18:40.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.785+0000 7f62354c6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62280091a0 0x7f622817e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.785+0000 7f62354c6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62280e4090 0x7f62280da660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.798 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.785+0000 7f62354c6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6228050470 0x7f6228050880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.798 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.785+0000 7f62354c6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6228007350 con 0x7f62280091a0 2024-09-21T03:18:40.798 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.785+0000 7f0a1cfcc640 1 --2- 172.21.15.105:0/733283335 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a10005c60 0x7f0a10031640 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c00c310 tx=0x7f0a0c00c7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:40.798 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.785+0000 7f62354c6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f62280071d0 con 0x7f6228050470 2024-09-21T03:18:40.799 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.785+0000 7f62354c6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f62280074d0 con 0x7f62280e4090 2024-09-21T03:18:40.799 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.785+0000 7f6234cc5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6228050470 0x7f6228050880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.799 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.785+0000 7f0a157fa640 1 -- 172.21.15.105:0/733283335 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c0052d0 con 0x7f0a10005c60 2024-09-21T03:18:40.799 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.785+0000 7f622f7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62280e4090 0x7f62280da660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.799 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.784+0000 7f9173fff640 1 -- 172.21.15.105:0/181319429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f917415b8c0 msgr2=0x7f91741f4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.800 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.784+0000 7f9173fff640 1 --2- 172.21.15.105:0/181319429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f917415b8c0 0x7f91741f4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.800 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.784+0000 7f9173fff640 1 -- 172.21.15.105:0/181319429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9174070d20 msgr2=0x7f917415d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.800 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.785+0000 7f622f7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62280e4090 0x7f62280da660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.105:60664/0 (socket says 172.21.15.105:60664) 2024-09-21T03:18:40.800 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.785+0000 7f6234cc5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6228050470 0x7f6228050880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.105:58146/0 (socket says 172.21.15.105:58146) 2024-09-21T03:18:40.800 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.785+0000 7f6234cc5640 1 -- 172.21.15.105:0/2366655113 learned_addr learned my addr 172.21.15.105:0/2366655113 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:40.800 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.784+0000 7f9173fff640 1 --2- 172.21.15.105:0/181319429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9174070d20 0x7f917415d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.800 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.784+0000 7f9173fff640 1 -- 172.21.15.105:0/181319429 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91741f2810 con 0x7f91740b43e0 2024-09-21T03:18:40.800 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.785+0000 7f9173fff640 1 --2- 172.21.15.105:0/181319429 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91740b43e0 0x7f91741f46f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f916800c430 tx=0x7f916800c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:40.801 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.785+0000 7f91717fa640 1 -- 172.21.15.105:0/181319429 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9168011790 con 0x7f91740b43e0 2024-09-21T03:18:40.801 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.785+0000 7f91717fa640 1 -- 172.21.15.105:0/181319429 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9168017070 con 0x7f91740b43e0 2024-09-21T03:18:40.801 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.785+0000 7f0a157fa640 1 -- 172.21.15.105:0/733283335 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a0c007020 con 0x7f0a10005c60 2024-09-21T03:18:40.801 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.785+0000 7f91717fa640 1 -- 172.21.15.105:0/181319429 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9168011ca0 con 0x7f91740b43e0 2024-09-21T03:18:40.802 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.785+0000 7f0a1f230640 1 -- 172.21.15.105:0/733283335 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a1017a0d0 con 0x7f0a10005c60 2024-09-21T03:18:40.802 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.785+0000 7f0a1f230640 1 -- 172.21.15.105:0/733283335 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a1017a690 con 0x7f0a10005c60 2024-09-21T03:18:40.802 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.786+0000 7f622f7fe640 1 -- 172.21.15.105:0/2366655113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6228050470 msgr2=0x7f6228050880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.802 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.786+0000 7f622f7fe640 1 --2- 172.21.15.105:0/2366655113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6228050470 0x7f6228050880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.802 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.786+0000 7f622f7fe640 1 -- 172.21.15.105:0/2366655113 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62280091a0 msgr2=0x7f622817e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.802 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.786+0000 7f622f7fe640 1 --2- 172.21.15.105:0/2366655113 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62280091a0 0x7f622817e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.802 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.786+0000 7f622f7fe640 1 -- 172.21.15.105:0/2366655113 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f622817edb0 con 0x7f62280e4090 2024-09-21T03:18:40.802 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.786+0000 7f622f7fe640 1 --2- 172.21.15.105:0/2366655113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62280e4090 0x7f62280da660 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f621c00c3f0 tx=0x7f621c00c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:40.802 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.786+0000 7f622cff9640 1 -- 172.21.15.105:0/2366655113 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621c017070 con 0x7f62280e4090 2024-09-21T03:18:40.803 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.786+0000 7f622cff9640 1 -- 172.21.15.105:0/2366655113 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f621c0053c0 con 0x7f62280e4090 2024-09-21T03:18:40.803 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.786+0000 7f622cff9640 1 -- 172.21.15.105:0/2366655113 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621c003850 con 0x7f62280e4090 2024-09-21T03:18:40.803 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.786+0000 7f0a157fa640 1 -- 172.21.15.105:0/733283335 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c007470 con 0x7f0a10005c60 2024-09-21T03:18:40.803 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.786+0000 7f62354c6640 1 -- 172.21.15.105:0/2366655113 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6228050dc0 con 0x7f62280e4090 2024-09-21T03:18:40.803 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.787+0000 7fea94484640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea78004800 0x7fea8c15c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.787+0000 7f62354c6640 1 -- 172.21.15.105:0/2366655113 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6228049ac0 con 0x7f62280e4090 2024-09-21T03:18:40.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.787+0000 7fea94484640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea8c148a20 0x7fea8c1f37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.787+0000 7fea94484640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea8c1f3d30 0x7fea8c0c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.787+0000 7fea92220640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea78004800 0x7fea8c15c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.787+0000 7f0a1f230640 1 -- 172.21.15.105:0/733283335 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f09f8001030 con 0x7f0a10005c60 2024-09-21T03:18:40.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.787+0000 7fea92220640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea78004800 0x7fea8c15c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.105:60666/0 (socket says 172.21.15.105:60666) 2024-09-21T03:18:40.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.787+0000 7fea92220640 1 -- 172.21.15.105:0/3944288870 learned_addr learned my addr 172.21.15.105:0/3944288870 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:40.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.787+0000 7fea94484640 1 -- 172.21.15.105:0/3944288870 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fea8c0d0b20 con 0x7fea8c148a20 2024-09-21T03:18:40.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.787+0000 7fea94484640 1 -- 172.21.15.105:0/3944288870 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fea8c0b3280 con 0x7fea8c1f3d30 2024-09-21T03:18:40.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.787+0000 7fea94484640 1 -- 172.21.15.105:0/3944288870 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fea8c0d0ca0 con 0x7fea78004800 2024-09-21T03:18:40.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.787+0000 7f5fd7470640 1 Processor -- start 2024-09-21T03:18:40.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.787+0000 7fea91a1f640 1 --2- 172.21.15.105:0/3944288870 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea8c148a20 0x7fea8c1f37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.787+0000 7fa84affd640 1 --2- 172.21.15.105:0/1986588159 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa844054720 0x7fa844175e40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa84c066830 tx=0x7fa84c0690d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:40.807 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.787+0000 7fea92220640 1 -- 172.21.15.105:0/3944288870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea8c1f3d30 msgr2=0x7fea8c0c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.807 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.787+0000 7fea92a21640 1 --2- 172.21.15.105:0/3944288870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea8c1f3d30 0x7fea8c0c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.807 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.787+0000 7fea92220640 1 --2- 172.21.15.105:0/3944288870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea8c1f3d30 0x7fea8c0c6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.807 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.787+0000 7fea92220640 1 -- 172.21.15.105:0/3944288870 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea8c148a20 msgr2=0x7fea8c1f37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.807 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.787+0000 7fea92220640 1 --2- 172.21.15.105:0/3944288870 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea8c148a20 0x7fea8c1f37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.807 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.787+0000 7fea92220640 1 -- 172.21.15.105:0/3944288870 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea8c1f4140 con 0x7fea78004800 2024-09-21T03:18:40.808 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.787+0000 7f41c27e6640 1 Processor -- start 2024-09-21T03:18:40.808 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.787+0000 7f5fd7470640 1 -- start start 2024-09-21T03:18:40.808 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.788+0000 7fea91a1f640 1 --2- 172.21.15.105:0/3944288870 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea8c148a20 0x7fea8c1f37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:18:40.808 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.788+0000 7fea92a21640 1 --2- 172.21.15.105:0/3944288870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea8c1f3d30 0x7fea8c0c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:18:40.808 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.788+0000 7f41c27e6640 1 -- start start 2024-09-21T03:18:40.809 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.788+0000 7fea92220640 1 --2- 172.21.15.105:0/3944288870 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea78004800 0x7fea8c15c3e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fea7c003670 tx=0x7fea7c003b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:40.809 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.788+0000 7f9179e97640 1 -- 172.21.15.105:0/181319429 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91741f2af0 con 0x7f91740b43e0 2024-09-21T03:18:40.809 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.788+0000 7f62354c6640 1 -- 172.21.15.105:0/2366655113 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6228049320 con 0x7f62280e4090 2024-09-21T03:18:40.809 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.788+0000 7f9179e97640 1 -- 172.21.15.105:0/181319429 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f91741f30b0 con 0x7f91740b43e0 2024-09-21T03:18:40.810 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.789+0000 7fea82ffd640 1 -- 172.21.15.105:0/3944288870 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7c015070 con 0x7fea78004800 2024-09-21T03:18:40.810 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.789+0000 7fa837fff640 1 -- 172.21.15.105:0/1986588159 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84c069750 con 0x7fa844054720 2024-09-21T03:18:40.810 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.789+0000 7fa837fff640 1 -- 172.21.15.105:0/1986588159 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa84c0699e0 con 0x7fa844054720 2024-09-21T03:18:40.810 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.789+0000 7fa837fff640 1 -- 172.21.15.105:0/1986588159 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84c093660 con 0x7fa844054720 2024-09-21T03:18:40.810 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.789+0000 7fa85085b640 1 -- 172.21.15.105:0/1986588159 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8440dfe00 con 0x7fa844054720 2024-09-21T03:18:40.810 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.789+0000 7fa85085b640 1 -- 172.21.15.105:0/1986588159 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8440e03c0 con 0x7fa844054720 2024-09-21T03:18:40.811 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.789+0000 7f6dee3ac640 1 -- 172.21.15.105:0/1569084632 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6dd4003b90 msgr2=0x7f6dd4003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.811 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.790+0000 7f41c27e6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41bc15a9b0 0x7f41bc14f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.811 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.790+0000 7f5fd7470640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5fd00cf6f0 0x7f5fd013cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.811 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.790+0000 7f0a157fa640 1 -- 172.21.15.105:0/733283335 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0a0c0067d0 con 0x7f0a10005c60 2024-09-21T03:18:40.812 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.789+0000 7f622cff9640 1 -- 172.21.15.105:0/2366655113 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f621c01a070 con 0x7f62280e4090 2024-09-21T03:18:40.812 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.790+0000 7f6dee3ac640 1 --2- 172.21.15.105:0/1569084632 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6dd4003b90 0x7f6dd4003fe0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6de808d2d0 tx=0x7f6dd4005830 comp rx=0 tx=0).stop 2024-09-21T03:18:40.812 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.790+0000 7f622cff9640 1 --2- 172.21.15.105:0/2366655113 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6214078c90 0x7f621407b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.812 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.790+0000 7f622cff9640 1 -- 172.21.15.105:0/2366655113 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f621c09a030 con 0x7f62280e4090 2024-09-21T03:18:40.812 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.789+0000 7fea82ffd640 1 -- 172.21.15.105:0/3944288870 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea7c00fad0 con 0x7fea78004800 2024-09-21T03:18:40.812 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.789+0000 7fea82ffd640 1 -- 172.21.15.105:0/3944288870 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7c011430 con 0x7fea78004800 2024-09-21T03:18:40.813 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.789+0000 7fea94484640 1 -- 172.21.15.105:0/3944288870 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea8c151d80 con 0x7fea78004800 2024-09-21T03:18:40.813 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.789+0000 7fea94484640 1 -- 172.21.15.105:0/3944288870 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fea8c15b900 con 0x7fea78004800 2024-09-21T03:18:40.813 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.790+0000 7fea94484640 1 -- 172.21.15.105:0/3944288870 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fea8c15bfc0 con 0x7fea78004800 2024-09-21T03:18:40.813 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.790+0000 7f41c27e6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41bc15ef10 0x7f41bc0b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.813 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.790+0000 7f41c27e6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41bc14ff40 0x7f41bc0b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.813 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.790+0000 7f41c27e6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f41bc0cc760 con 0x7f41bc14ff40 2024-09-21T03:18:40.813 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.790+0000 7f41c27e6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f41bc0cc5e0 con 0x7f41bc15ef10 2024-09-21T03:18:40.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.790+0000 7f41c27e6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f41bc070f20 con 0x7f41bc15a9b0 2024-09-21T03:18:40.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.790+0000 7f41bbfff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41bc15a9b0 0x7f41bc14f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.790+0000 7f41bbfff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41bc15a9b0 0x7f41bc14f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.105:60676/0 (socket says 172.21.15.105:60676) 2024-09-21T03:18:40.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.790+0000 7f41bbfff640 1 -- 172.21.15.105:0/3515170378 learned_addr learned my addr 172.21.15.105:0/3515170378 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:40.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.790+0000 7f41bb7fe640 1 --2- 172.21.15.105:0/3515170378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41bc15ef10 0x7f41bc0b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.789+0000 7f9179e97640 1 -- 172.21.15.105:0/181319429 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f91740cfa80 con 0x7f91740b43e0 2024-09-21T03:18:40.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.790+0000 7f622cff9640 1 --2- 172.21.15.105:0/2366655113 >> [v2:172.21.15.105:6808/2783810296,v1:172.21.15.105:6809/2783810296] conn(0x7f6214080f60 0x7f62140833b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.791+0000 7f622cff9640 1 -- 172.21.15.105:0/2366655113 --> [v2:172.21.15.105:6808/2783810296,v1:172.21.15.105:6809/2783810296] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6214083a80 con 0x7f6214080f60 2024-09-21T03:18:40.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.791+0000 7f622cff9640 1 -- 172.21.15.105:0/2366655113 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f621c0a1050 con 0x7f62280e4090 2024-09-21T03:18:40.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.791+0000 7f0a157fa640 1 --2- 172.21.15.105:0/733283335 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f09fc078c60 0x7f09fc07b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.791+0000 7f41c0d83640 1 --2- 172.21.15.105:0/3515170378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41bc14ff40 0x7f41bc0b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.791+0000 7f41bbfff640 1 -- 172.21.15.105:0/3515170378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41bc15ef10 msgr2=0x7f41bc0b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.791+0000 7f41bbfff640 1 --2- 172.21.15.105:0/3515170378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41bc15ef10 0x7f41bc0b0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.791+0000 7f41bbfff640 1 -- 172.21.15.105:0/3515170378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41bc14ff40 msgr2=0x7f41bc0b11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.791+0000 7f41bbfff640 1 --2- 172.21.15.105:0/3515170378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41bc14ff40 0x7f41bc0b11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.791+0000 7f41bbfff640 1 -- 172.21.15.105:0/3515170378 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41bc157d80 con 0x7f41bc15a9b0 2024-09-21T03:18:40.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.791+0000 7f6234cc5640 1 --2- 172.21.15.105:0/2366655113 >> [v2:172.21.15.105:6808/2783810296,v1:172.21.15.105:6809/2783810296] conn(0x7f6214080f60 0x7f62140833b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.791+0000 7f622ffff640 1 --2- 172.21.15.105:0/2366655113 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6214078c90 0x7f621407b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.791+0000 7fa835ffb640 1 -- 172.21.15.105:0/1986588159 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa844007c60 con 0x7fa844054720 2024-09-21T03:18:40.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.791+0000 7f0a157fa640 1 -- 172.21.15.105:0/733283335 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0a0c09a210 con 0x7f0a10005c60 2024-09-21T03:18:40.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.791+0000 7f0a157fa640 1 --2- 172.21.15.105:0/733283335 >> [v2:172.21.15.162:6802/2576522891,v1:172.21.15.162:6803/2576522891] conn(0x7f09fc080f30 0x7f09fc083380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.791+0000 7f0a157fa640 1 -- 172.21.15.105:0/733283335 --> [v2:172.21.15.162:6802/2576522891,v1:172.21.15.162:6803/2576522891] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f09fc083a50 con 0x7f09fc080f30 2024-09-21T03:18:40.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.791+0000 7f0a157fa640 1 -- 172.21.15.105:0/733283335 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f0a0c09a600 con 0x7f0a10005c60 2024-09-21T03:18:40.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.791+0000 7f5fd7470640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5fd013dce0 0x7f5fd0140980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.791+0000 7f5fd7470640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5fd0158ff0 0x7f5fd015b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.791+0000 7f5fd7470640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd00763e0 con 0x7f5fd013dce0 2024-09-21T03:18:40.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.791+0000 7f5fd7470640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd0076260 con 0x7f5fd0158ff0 2024-09-21T03:18:40.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.791+0000 7f5fd7470640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5fd00b43f0 con 0x7f5fd00cf6f0 2024-09-21T03:18:40.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.791+0000 7f0a1d7cd640 1 --2- 172.21.15.105:0/733283335 >> [v2:172.21.15.162:6802/2576522891,v1:172.21.15.162:6803/2576522891] conn(0x7f09fc080f30 0x7f09fc083380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.791+0000 7f91717fa640 1 -- 172.21.15.105:0/181319429 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f916801c460 con 0x7f91740b43e0 2024-09-21T03:18:40.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.791+0000 7f41bbfff640 1 --2- 172.21.15.105:0/3515170378 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41bc15a9b0 0x7f41bc14f900 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f41b40095d0 tx=0x7f41b4009a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:40.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.791+0000 7f41b8ff9640 1 -- 172.21.15.105:0/3515170378 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b4018020 con 0x7f41bc15a9b0 2024-09-21T03:18:40.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.791+0000 7f6dedbab640 1 -- 172.21.15.105:0/1569084632 reap_dead start 2024-09-21T03:18:40.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.791+0000 7f41b8ff9640 1 -- 172.21.15.105:0/3515170378 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f41b4014910 con 0x7f41bc15a9b0 2024-09-21T03:18:40.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.791+0000 7f41b8ff9640 1 -- 172.21.15.105:0/3515170378 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b4014d40 con 0x7f41bc15a9b0 2024-09-21T03:18:40.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.791+0000 7f5fd4a0b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5fd013dce0 0x7f5fd0140980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.791+0000 7f5fd4a0b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5fd013dce0 0x7f5fd0140980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56656/0 (socket says 172.21.15.105:56656) 2024-09-21T03:18:40.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.791+0000 7f5fd4a0b640 1 -- 172.21.15.105:0/497079176 learned_addr learned my addr 172.21.15.105:0/497079176 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:40.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.792+0000 7f41c27e6640 1 -- 172.21.15.105:0/3515170378 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41bc158ef0 con 0x7f41bc15a9b0 2024-09-21T03:18:40.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.791+0000 7f6dee3ac640 1 -- 172.21.15.105:0/1569084632 shutdown_connections 2024-09-21T03:18:40.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.791+0000 7f6dee3ac640 1 -- 172.21.15.105:0/1569084632 >> 172.21.15.105:0/1569084632 conn(0x7f6de809d680 msgr2=0x7f6de80d4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:40.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.792+0000 7f41c27e6640 1 -- 172.21.15.105:0/3515170378 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f41bc1594b0 con 0x7f41bc15a9b0 2024-09-21T03:18:40.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.792+0000 7f0a17fff640 1 --2- 172.21.15.105:0/733283335 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f09fc078c60 0x7f09fc07b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.792+0000 7f91717fa640 1 --2- 172.21.15.105:0/181319429 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9160078b90 0x7f916007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.791+0000 7fa837fff640 1 -- 172.21.15.105:0/1986588159 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa84c093800 con 0x7fa844054720 2024-09-21T03:18:40.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.792+0000 7fa837fff640 1 --2- 172.21.15.105:0/1986588159 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa830078b90 0x7fa83007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.792+0000 7fa837fff640 1 -- 172.21.15.105:0/1986588159 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa84c1162a0 con 0x7fa844054720 2024-09-21T03:18:40.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.792+0000 7fa837fff640 1 --2- 172.21.15.105:0/1986588159 >> [v2:172.21.15.105:6800/4283875833,v1:172.21.15.105:6801/4283875833] conn(0x7fa830080de0 0x7fa830083230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.792+0000 7fa837fff640 1 -- 172.21.15.105:0/1986588159 --> [v2:172.21.15.105:6800/4283875833,v1:172.21.15.105:6801/4283875833] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa84c070e50 con 0x7fa830080de0 2024-09-21T03:18:40.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.792+0000 7fa837fff640 1 -- 172.21.15.105:0/1986588159 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fa84c11d050 con 0x7fa844054720 2024-09-21T03:18:40.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.792+0000 7f6234cc5640 1 --2- 172.21.15.105:0/2366655113 >> [v2:172.21.15.105:6808/2783810296,v1:172.21.15.105:6809/2783810296] conn(0x7f6214080f60 0x7f62140833b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:40.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.792+0000 7f91717fa640 1 -- 172.21.15.105:0/181319429 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f916809b480 con 0x7f91740b43e0 2024-09-21T03:18:40.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.792+0000 7f91717fa640 1 --2- 172.21.15.105:0/181319429 >> [v2:172.21.15.162:6818/2201319593,v1:172.21.15.162:6819/2201319593] conn(0x7f9160080de0 0x7f9160083230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.792+0000 7f9178e95640 1 --2- 172.21.15.105:0/181319429 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9160078b90 0x7f916007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.792+0000 7f5fd520c640 1 --2- 172.21.15.105:0/497079176 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5fd00cf6f0 0x7f5fd013cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.792+0000 7f5fd4a0b640 1 -- 172.21.15.105:0/497079176 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5fd00cf6f0 msgr2=0x7f5fd013cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.792+0000 7f5fd4a0b640 1 --2- 172.21.15.105:0/497079176 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5fd00cf6f0 0x7f5fd013cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.792+0000 7f5fd4a0b640 1 -- 172.21.15.105:0/497079176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5fd0158ff0 msgr2=0x7f5fd015b2e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T03:18:40.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.792+0000 7f5fd4a0b640 1 --2- 172.21.15.105:0/497079176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5fd0158ff0 0x7f5fd015b2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.792+0000 7f5fd4a0b640 1 -- 172.21.15.105:0/497079176 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd013b420 con 0x7f5fd013dce0 2024-09-21T03:18:40.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.793+0000 7f622ffff640 1 --2- 172.21.15.105:0/2366655113 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6214078c90 0x7f621407b1a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f622800f780 tx=0x7f622400b370 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:40.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.793+0000 7f91717fa640 1 -- 172.21.15.105:0/181319429 --> [v2:172.21.15.162:6818/2201319593,v1:172.21.15.162:6819/2201319593] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f916800ae50 con 0x7f9160080de0 2024-09-21T03:18:40.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.793+0000 7fa84b7fe640 1 --2- 172.21.15.105:0/1986588159 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa830078b90 0x7fa83007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.793+0000 7f91717fa640 1 -- 172.21.15.105:0/181319429 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f916809b910 con 0x7f91740b43e0 2024-09-21T03:18:40.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.793+0000 7fa84bfff640 1 --2- 172.21.15.105:0/1986588159 >> [v2:172.21.15.105:6800/4283875833,v1:172.21.15.105:6801/4283875833] conn(0x7fa830080de0 0x7fa830083230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.792+0000 7f0a17fff640 1 --2- 172.21.15.105:0/733283335 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f09fc078c60 0x7f09fc07b170 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0a1017d3d0 tx=0x7f0a04006ba0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:40.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.793+0000 7f5fd4a0b640 1 --2- 172.21.15.105:0/497079176 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5fd013dce0 0x7f5fd0140980 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5fc000c370 tx=0x7f5fc000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:40.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.793+0000 7f9179696640 1 --2- 172.21.15.105:0/181319429 >> [v2:172.21.15.162:6818/2201319593,v1:172.21.15.162:6819/2201319593] conn(0x7f9160080de0 0x7f9160083230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.793+0000 7f0a1d7cd640 1 --2- 172.21.15.105:0/733283335 >> [v2:172.21.15.162:6802/2576522891,v1:172.21.15.162:6803/2576522891] conn(0x7f09fc080f30 0x7f09fc083380 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:40.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.793+0000 7f622cff9640 1 -- 172.21.15.105:0/2366655113 <== osd.2 v2:172.21.15.105:6808/2783810296 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6214083a80 con 0x7f6214080f60 2024-09-21T03:18:40.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.793+0000 7f6dee3ac640 1 -- 172.21.15.105:0/1569084632 shutdown_connections 2024-09-21T03:18:40.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.793+0000 7f5fc5ffb640 1 -- 172.21.15.105:0/497079176 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0017070 con 0x7f5fd013dce0 2024-09-21T03:18:40.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.793+0000 7fa84b7fe640 1 --2- 172.21.15.105:0/1986588159 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa830078b90 0x7fa83007b0a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa840032dd0 tx=0x7fa840004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:40.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.793+0000 7f41c27e6640 1 -- 172.21.15.105:0/3515170378 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f41bc1f9b40 con 0x7f41bc15a9b0 2024-09-21T03:18:40.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.793+0000 7f9178e95640 1 --2- 172.21.15.105:0/181319429 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9160078b90 0x7f916007b0a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f916c00abb0 tx=0x7f916c009250 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:40.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.794+0000 7fa84bfff640 1 --2- 172.21.15.105:0/1986588159 >> [v2:172.21.15.105:6800/4283875833,v1:172.21.15.105:6801/4283875833] conn(0x7fa830080de0 0x7fa830083230 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:40.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.794+0000 7f41b8ff9640 1 -- 172.21.15.105:0/3515170378 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f41b401b020 con 0x7f41bc15a9b0 2024-09-21T03:18:40.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.793+0000 7f5fc5ffb640 1 -- 172.21.15.105:0/497079176 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5fc00035f0 con 0x7f5fd013dce0 2024-09-21T03:18:40.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.794+0000 7fea82ffd640 1 -- 172.21.15.105:0/3944288870 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fea7c0115d0 con 0x7fea78004800 2024-09-21T03:18:40.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.794+0000 7fea82ffd640 1 --2- 172.21.15.105:0/3944288870 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fea70078c90 0x7fea7007b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.794+0000 7fea82ffd640 1 -- 172.21.15.105:0/3944288870 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fea7c09c2d0 con 0x7fea78004800 2024-09-21T03:18:40.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.795+0000 7fea82ffd640 1 --2- 172.21.15.105:0/3944288870 >> [v2:172.21.15.105:6824/1202131294,v1:172.21.15.105:6825/1202131294] conn(0x7fea70080f00 0x7fea70083350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.795+0000 7fea82ffd640 1 -- 172.21.15.105:0/3944288870 --> [v2:172.21.15.105:6824/1202131294,v1:172.21.15.105:6825/1202131294] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fea70083a20 con 0x7fea70080f00 2024-09-21T03:18:40.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.795+0000 7fea82ffd640 1 -- 172.21.15.105:0/3944288870 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fea7c09c6c0 con 0x7fea78004800 2024-09-21T03:18:40.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.795+0000 7f41b8ff9640 1 --2- 172.21.15.105:0/3515170378 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f419c078b90 0x7f419c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.794+0000 7f0a157fa640 1 -- 172.21.15.105:0/733283335 <== osd.5 v2:172.21.15.162:6802/2576522891 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f09fc083a50 con 0x7f09fc080f30 2024-09-21T03:18:40.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.795+0000 7fa837fff640 1 -- 172.21.15.105:0/1986588159 <== osd.0 v2:172.21.15.105:6800/4283875833 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa84c070e50 con 0x7fa830080de0 2024-09-21T03:18:40.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.795+0000 7f9179696640 1 --2- 172.21.15.105:0/181319429 >> [v2:172.21.15.162:6818/2201319593,v1:172.21.15.162:6819/2201319593] conn(0x7f9160080de0 0x7f9160083230 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:40.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.793+0000 7f6dee3ac640 1 -- 172.21.15.105:0/1569084632 wait complete. 2024-09-21T03:18:40.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.795+0000 7f41b8ff9640 1 -- 172.21.15.105:0/3515170378 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f41b409b1a0 con 0x7f41bc15a9b0 2024-09-21T03:18:40.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.795+0000 7f41b8ff9640 1 --2- 172.21.15.105:0/3515170378 >> [v2:172.21.15.162:6810/1660148918,v1:172.21.15.162:6811/1660148918] conn(0x7f419c080de0 0x7f419c083230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.795+0000 7f41b8ff9640 1 -- 172.21.15.105:0/3515170378 --> [v2:172.21.15.162:6810/1660148918,v1:172.21.15.162:6811/1660148918] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f419c083900 con 0x7f419c080de0 2024-09-21T03:18:40.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.795+0000 7f41b8ff9640 1 -- 172.21.15.105:0/3515170378 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f41b40a2050 con 0x7f41bc15a9b0 2024-09-21T03:18:40.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.795+0000 7f41bb7fe640 1 --2- 172.21.15.105:0/3515170378 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f419c078b90 0x7f419c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.796+0000 7f91717fa640 1 -- 172.21.15.105:0/181319429 <== osd.6 v2:172.21.15.162:6818/2201319593 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f916800ae50 con 0x7f9160080de0 2024-09-21T03:18:40.835 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.794+0000 7f5fd7470640 1 -- 172.21.15.105:0/497079176 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fd01f4a00 con 0x7f5fd013dce0 2024-09-21T03:18:40.835 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.794+0000 7f5fd7470640 1 -- 172.21.15.105:0/497079176 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fd01f4fa0 con 0x7f5fd013dce0 2024-09-21T03:18:40.835 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.795+0000 7f5fc5ffb640 1 -- 172.21.15.105:0/497079176 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0017070 con 0x7f5fd013dce0 2024-09-21T03:18:40.835 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.796+0000 7f5fd7470640 1 -- 172.21.15.105:0/497079176 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5fd00cf1b0 con 0x7f5fd013dce0 2024-09-21T03:18:40.835 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.795+0000 7fea91a1f640 1 --2- 172.21.15.105:0/3944288870 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fea70078c90 0x7fea7007b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.835 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.795+0000 7fea92a21640 1 --2- 172.21.15.105:0/3944288870 >> [v2:172.21.15.105:6824/1202131294,v1:172.21.15.105:6825/1202131294] conn(0x7fea70080f00 0x7fea70083350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.835 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.796+0000 7fea91a1f640 1 --2- 172.21.15.105:0/3944288870 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fea70078c90 0x7fea7007b1a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fea88033000 tx=0x7fea88001190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:40.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.796+0000 7fea92a21640 1 --2- 172.21.15.105:0/3944288870 >> [v2:172.21.15.105:6824/1202131294,v1:172.21.15.105:6825/1202131294] conn(0x7fea70080f00 0x7fea70083350 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:40.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.797+0000 7f41bb7fe640 1 --2- 172.21.15.105:0/3515170378 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f419c078b90 0x7f419c07b0a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f41bc0cf080 tx=0x7f41a4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:40.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.797+0000 7f41c0d83640 1 --2- 172.21.15.105:0/3515170378 >> [v2:172.21.15.162:6810/1660148918,v1:172.21.15.162:6811/1660148918] conn(0x7f419c080de0 0x7f419c083230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.797+0000 7f6dee3ac640 1 Processor -- start 2024-09-21T03:18:40.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.797+0000 7fea82ffd640 1 -- 172.21.15.105:0/3944288870 <== osd.3 v2:172.21.15.105:6824/1202131294 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fea70083a20 con 0x7fea70080f00 2024-09-21T03:18:40.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.798+0000 7f6dee3ac640 1 -- start start 2024-09-21T03:18:40.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.798+0000 7f5fc5ffb640 1 -- 172.21.15.105:0/497079176 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5fc001a070 con 0x7f5fd013dce0 2024-09-21T03:18:40.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.799+0000 7f41c0d83640 1 --2- 172.21.15.105:0/3515170378 >> [v2:172.21.15.162:6810/1660148918,v1:172.21.15.162:6811/1660148918] conn(0x7f419c080de0 0x7f419c083230 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:40.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.799+0000 7f5fc5ffb640 1 --2- 172.21.15.105:0/497079176 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5fb4078d90 0x7f5fb407b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.799+0000 7f5fc5ffb640 1 -- 172.21.15.105:0/497079176 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5fc009a220 con 0x7f5fd013dce0 2024-09-21T03:18:40.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.799+0000 7f5fd520c640 1 --2- 172.21.15.105:0/497079176 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5fb4078d90 0x7f5fb407b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.799+0000 7f5fc5ffb640 1 --2- 172.21.15.105:0/497079176 >> [v2:172.21.15.162:6826/3787313702,v1:172.21.15.162:6827/3787313702] conn(0x7f5fb4080fe0 0x7f5fb4083430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.799+0000 7f5fc5ffb640 1 -- 172.21.15.105:0/497079176 --> [v2:172.21.15.162:6826/3787313702,v1:172.21.15.162:6827/3787313702] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5fc0004e50 con 0x7f5fb4080fe0 2024-09-21T03:18:40.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.799+0000 7f5fc5ffb640 1 -- 172.21.15.105:0/497079176 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f5fc009a680 con 0x7f5fd013dce0 2024-09-21T03:18:40.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.800+0000 7f5fd5a0d640 1 --2- 172.21.15.105:0/497079176 >> [v2:172.21.15.162:6826/3787313702,v1:172.21.15.162:6827/3787313702] conn(0x7f5fb4080fe0 0x7f5fb4083430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.800+0000 7f41b8ff9640 1 -- 172.21.15.105:0/3515170378 <== osd.4 v2:172.21.15.162:6810/1660148918 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f419c083900 con 0x7f419c080de0 2024-09-21T03:18:40.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.800+0000 7f6dee3ac640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6de8157e90 0x7f6de81584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.800+0000 7f5fd5a0d640 1 --2- 172.21.15.105:0/497079176 >> [v2:172.21.15.162:6826/3787313702,v1:172.21.15.162:6827/3787313702] conn(0x7f5fb4080fe0 0x7f5fb4083430 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:40.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.800+0000 7f5fd520c640 1 --2- 172.21.15.105:0/497079176 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5fb4078d90 0x7f5fb407b2a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8005fd0 tx=0x7f5fc8009500 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:40.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.800+0000 7f6dee3ac640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6de8158a10 0x7f6de815d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.800+0000 7f6ded3aa640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6de8157e90 0x7f6de81584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.801+0000 7f6ded3aa640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6de8157e90 0x7f6de81584d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56664/0 (socket says 172.21.15.105:56664) 2024-09-21T03:18:40.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.801+0000 7f6ded3aa640 1 -- 172.21.15.105:0/3536517263 learned_addr learned my addr 172.21.15.105:0/3536517263 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:40.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.801+0000 7f6dee3ac640 1 --2- 172.21.15.105:0/3536517263 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6de815dc80 0x7f6de815f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.842 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.801+0000 7f6decba9640 1 --2- 172.21.15.105:0/3536517263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6de8158a10 0x7f6de815d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.842 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.801+0000 7f6dee3ac640 1 -- 172.21.15.105:0/3536517263 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6de80d5270 con 0x7f6de8157e90 2024-09-21T03:18:40.842 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.801+0000 7f6dedbab640 1 --2- 172.21.15.105:0/3536517263 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6de815dc80 0x7f6de815f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.842 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.801+0000 7f6dee3ac640 1 -- 172.21.15.105:0/3536517263 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6de80d50f0 con 0x7f6de8158a10 2024-09-21T03:18:40.842 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.801+0000 7f6dee3ac640 1 -- 172.21.15.105:0/3536517263 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6de80d3530 con 0x7f6de815dc80 2024-09-21T03:18:40.842 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.801+0000 7f5fc5ffb640 1 -- 172.21.15.105:0/497079176 <== osd.7 v2:172.21.15.162:6826/3787313702 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5fc0004e50 con 0x7f5fb4080fe0 2024-09-21T03:18:40.844 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.802+0000 7f6decba9640 1 -- 172.21.15.105:0/3536517263 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6de815dc80 msgr2=0x7f6de815f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.802+0000 7f6decba9640 1 --2- 172.21.15.105:0/3536517263 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6de815dc80 0x7f6de815f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.802+0000 7f6decba9640 1 -- 172.21.15.105:0/3536517263 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6de8157e90 msgr2=0x7f6de81584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.802+0000 7f6decba9640 1 --2- 172.21.15.105:0/3536517263 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6de8157e90 0x7f6de81584d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.802+0000 7f6decba9640 1 -- 172.21.15.105:0/3536517263 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6de815e090 con 0x7f6de8158a10 2024-09-21T03:18:40.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.802+0000 7f6dedbab640 1 --2- 172.21.15.105:0/3536517263 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6de815dc80 0x7f6de815f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:18:40.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.803+0000 7f6ded3aa640 1 --2- 172.21.15.105:0/3536517263 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6de8157e90 0x7f6de81584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:18:40.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.803+0000 7f6decba9640 1 --2- 172.21.15.105:0/3536517263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6de8158a10 0x7f6de815d740 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6de400c4d0 tx=0x7f6de400c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:40.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.803+0000 7f6dddffb640 1 -- 172.21.15.105:0/3536517263 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de4017070 con 0x7f6de8158a10 2024-09-21T03:18:40.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.803+0000 7f6dee3ac640 1 -- 172.21.15.105:0/3536517263 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6de81582a0 con 0x7f6de8158a10 2024-09-21T03:18:40.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.804+0000 7f6dee3ac640 1 -- 172.21.15.105:0/3536517263 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6de81597a0 con 0x7f6de8158a10 2024-09-21T03:18:40.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.804+0000 7f6dddffb640 1 -- 172.21.15.105:0/3536517263 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6de40053c0 con 0x7f6de8158a10 2024-09-21T03:18:40.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.805+0000 7f6dddffb640 1 -- 172.21.15.105:0/3536517263 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de4017070 con 0x7f6de8158a10 2024-09-21T03:18:40.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.806+0000 7f6dee3ac640 1 -- 172.21.15.105:0/3536517263 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6dc8001030 con 0x7f6de8158a10 2024-09-21T03:18:40.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.808+0000 7f6dddffb640 1 -- 172.21.15.105:0/3536517263 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6de401a070 con 0x7f6de8158a10 2024-09-21T03:18:40.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.809+0000 7f6dddffb640 1 --2- 172.21.15.105:0/3536517263 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6dcc078f90 0x7f6dcc07b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.809+0000 7f6dddffb640 1 -- 172.21.15.105:0/3536517263 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f6de40050d0 con 0x7f6de8158a10 2024-09-21T03:18:40.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.809+0000 7f6dddffb640 1 --2- 172.21.15.105:0/3536517263 >> [v2:172.21.15.105:6816/3314074789,v1:172.21.15.105:6817/3314074789] conn(0x7f6dcc081d10 0x7f6dcc084200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:40.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.809+0000 7f6dddffb640 1 -- 172.21.15.105:0/3536517263 --> [v2:172.21.15.105:6816/3314074789,v1:172.21.15.105:6817/3314074789] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6dcc0848d0 con 0x7f6dcc081d10 2024-09-21T03:18:40.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.810+0000 7f6dedbab640 1 --2- 172.21.15.105:0/3536517263 >> [v2:172.21.15.105:6816/3314074789,v1:172.21.15.105:6817/3314074789] conn(0x7f6dcc081d10 0x7f6dcc084200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.810+0000 7f6dedbab640 1 --2- 172.21.15.105:0/3536517263 >> [v2:172.21.15.105:6816/3314074789,v1:172.21.15.105:6817/3314074789] conn(0x7f6dcc081d10 0x7f6dcc084200 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:40.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.811+0000 7f6ded3aa640 1 --2- 172.21.15.105:0/3536517263 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6dcc078f90 0x7f6dcc07b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:40.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.812+0000 7f6dddffb640 1 -- 172.21.15.105:0/3536517263 <== osd.1 v2:172.21.15.105:6816/3314074789 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6dcc0848d0 con 0x7f6dcc081d10 2024-09-21T03:18:40.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.817+0000 7f6dddffb640 1 -- 172.21.15.105:0/3536517263 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f6de405deb0 con 0x7f6de8158a10 2024-09-21T03:18:40.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.822+0000 7f62354c6640 1 -- 172.21.15.105:0/2366655113 --> [v2:172.21.15.105:6808/2783810296,v1:172.21.15.105:6809/2783810296] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6228049590 con 0x7f6214080f60 2024-09-21T03:18:40.847 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.822+0000 7fa835ffb640 1 -- 172.21.15.105:0/1986588159 --> [v2:172.21.15.105:6800/4283875833,v1:172.21.15.105:6801/4283875833] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa8440dc820 con 0x7fa830080de0 2024-09-21T03:18:40.847 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.823+0000 7f622cff9640 1 -- 172.21.15.105:0/2366655113 <== osd.2 v2:172.21.15.105:6808/2783810296 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6228049590 con 0x7f6214080f60 2024-09-21T03:18:40.847 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.823+0000 7fa837fff640 1 -- 172.21.15.105:0/1986588159 <== osd.0 v2:172.21.15.105:6800/4283875833 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa8440dc820 con 0x7fa830080de0 2024-09-21T03:18:40.848 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.823+0000 7f6ded3aa640 1 --2- 172.21.15.105:0/3536517263 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6dcc078f90 0x7f6dcc07b4a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6de80744e0 tx=0x7f6dd802d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:40.848 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.823+0000 7fa85085b640 1 -- 172.21.15.105:0/1986588159 >> [v2:172.21.15.105:6800/4283875833,v1:172.21.15.105:6801/4283875833] conn(0x7fa830080de0 msgr2=0x7fa830083230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.848 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.823+0000 7fa85085b640 1 --2- 172.21.15.105:0/1986588159 >> [v2:172.21.15.105:6800/4283875833,v1:172.21.15.105:6801/4283875833] conn(0x7fa830080de0 0x7fa830083230 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.849 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.824+0000 7f621a7fc640 1 -- 172.21.15.105:0/2366655113 >> [v2:172.21.15.105:6808/2783810296,v1:172.21.15.105:6809/2783810296] conn(0x7f6214080f60 msgr2=0x7f62140833b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.849 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.824+0000 7f621a7fc640 1 --2- 172.21.15.105:0/2366655113 >> [v2:172.21.15.105:6808/2783810296,v1:172.21.15.105:6809/2783810296] conn(0x7f6214080f60 0x7f62140833b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.849 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.824+0000 7f621a7fc640 1 -- 172.21.15.105:0/2366655113 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6214078c90 msgr2=0x7f621407b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.850 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.824+0000 7f621a7fc640 1 --2- 172.21.15.105:0/2366655113 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6214078c90 0x7f621407b1a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f622800f780 tx=0x7f622400b370 comp rx=0 tx=0).stop 2024-09-21T03:18:40.850 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.824+0000 7f621a7fc640 1 -- 172.21.15.105:0/2366655113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62280e4090 msgr2=0x7f62280da660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.850 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.824+0000 7f621a7fc640 1 --2- 172.21.15.105:0/2366655113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62280e4090 0x7f62280da660 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f621c00c3f0 tx=0x7f621c00c8b0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.850 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.824+0000 7f6234cc5640 1 -- 172.21.15.105:0/2366655113 reap_dead start 2024-09-21T03:18:40.850 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.824+0000 7f0a1f230640 1 -- 172.21.15.105:0/733283335 --> [v2:172.21.15.162:6802/2576522891,v1:172.21.15.162:6803/2576522891] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f09f8002dd0 con 0x7f09fc080f30 2024-09-21T03:18:40.850 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.824+0000 7fa85085b640 1 -- 172.21.15.105:0/1986588159 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa830078b90 msgr2=0x7fa83007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.851 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.824+0000 7f9179e97640 1 -- 172.21.15.105:0/181319429 --> [v2:172.21.15.162:6818/2201319593,v1:172.21.15.162:6819/2201319593] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f91740cfa80 con 0x7f9160080de0 2024-09-21T03:18:40.851 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.824+0000 7f621a7fc640 1 -- 172.21.15.105:0/2366655113 shutdown_connections 2024-09-21T03:18:40.851 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.824+0000 7f621a7fc640 1 -- 172.21.15.105:0/2366655113 >> 172.21.15.105:0/2366655113 conn(0x7f622801eaf0 msgr2=0x7f6228052150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:40.852 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.824+0000 7fa85085b640 1 --2- 172.21.15.105:0/1986588159 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa830078b90 0x7fa83007b0a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa840032dd0 tx=0x7fa840004730 comp rx=0 tx=0).stop 2024-09-21T03:18:40.852 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.824+0000 7fa85085b640 1 -- 172.21.15.105:0/1986588159 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa844054720 msgr2=0x7fa844175e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.852 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.824+0000 7fa85085b640 1 --2- 172.21.15.105:0/1986588159 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa844054720 0x7fa844175e40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa84c066830 tx=0x7fa84c0690d0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.852 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.824+0000 7fa84bfff640 1 -- 172.21.15.105:0/1986588159 reap_dead start 2024-09-21T03:18:40.852 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.825+0000 7f621a7fc640 1 -- 172.21.15.105:0/2366655113 shutdown_connections 2024-09-21T03:18:40.852 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.824+0000 7fa85085b640 1 -- 172.21.15.105:0/1986588159 shutdown_connections 2024-09-21T03:18:40.853 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.825+0000 7f621a7fc640 1 -- 172.21.15.105:0/2366655113 wait complete. 2024-09-21T03:18:40.853 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.824+0000 7fa85085b640 1 -- 172.21.15.105:0/1986588159 >> 172.21.15.105:0/1986588159 conn(0x7fa84401e260 msgr2=0x7fa8440dad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:40.853 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.825+0000 7fa85085b640 1 -- 172.21.15.105:0/1986588159 shutdown_connections 2024-09-21T03:18:40.853 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.825+0000 7fa85085b640 1 -- 172.21.15.105:0/1986588159 wait complete. 2024-09-21T03:18:40.854 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.825+0000 7f0a157fa640 1 -- 172.21.15.105:0/733283335 <== osd.5 v2:172.21.15.162:6802/2576522891 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f09f8002dd0 con 0x7f09fc080f30 2024-09-21T03:18:40.854 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.825+0000 7f91717fa640 1 -- 172.21.15.105:0/181319429 <== osd.6 v2:172.21.15.162:6818/2201319593 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f91740cfa80 con 0x7f9160080de0 2024-09-21T03:18:40.854 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.825+0000 7f9179e97640 1 -- 172.21.15.105:0/181319429 >> [v2:172.21.15.162:6818/2201319593,v1:172.21.15.162:6819/2201319593] conn(0x7f9160080de0 msgr2=0x7f9160083230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.855 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.825+0000 7f0a1f230640 1 -- 172.21.15.105:0/733283335 >> [v2:172.21.15.162:6802/2576522891,v1:172.21.15.162:6803/2576522891] conn(0x7f09fc080f30 msgr2=0x7f09fc083380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.855 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.825+0000 7f0a1f230640 1 --2- 172.21.15.105:0/733283335 >> [v2:172.21.15.162:6802/2576522891,v1:172.21.15.162:6803/2576522891] conn(0x7f09fc080f30 0x7f09fc083380 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.855 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.826+0000 7f0a1f230640 1 -- 172.21.15.105:0/733283335 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f09fc078c60 msgr2=0x7f09fc07b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.855 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.826+0000 7f0a1f230640 1 --2- 172.21.15.105:0/733283335 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f09fc078c60 0x7f09fc07b170 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0a1017d3d0 tx=0x7f0a04006ba0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.855 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.826+0000 7f0a1f230640 1 -- 172.21.15.105:0/733283335 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a10005c60 msgr2=0x7f0a10031640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.855 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.826+0000 7f0a1f230640 1 --2- 172.21.15.105:0/733283335 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a10005c60 0x7f0a10031640 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c00c310 tx=0x7f0a0c00c7d0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.855 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.826+0000 7f0a1d7cd640 1 -- 172.21.15.105:0/733283335 reap_dead start 2024-09-21T03:18:40.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.826+0000 7f9179e97640 1 --2- 172.21.15.105:0/181319429 >> [v2:172.21.15.162:6818/2201319593,v1:172.21.15.162:6819/2201319593] conn(0x7f9160080de0 0x7f9160083230 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.826+0000 7f0a1f230640 1 -- 172.21.15.105:0/733283335 shutdown_connections 2024-09-21T03:18:40.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.826+0000 7f0a1f230640 1 -- 172.21.15.105:0/733283335 >> 172.21.15.105:0/733283335 conn(0x7f0a10051420 msgr2=0x7f0a100538f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:40.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.826+0000 7f9179e97640 1 -- 172.21.15.105:0/181319429 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9160078b90 msgr2=0x7f916007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.826+0000 7f9179e97640 1 --2- 172.21.15.105:0/181319429 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9160078b90 0x7f916007b0a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f916c00abb0 tx=0x7f916c009250 comp rx=0 tx=0).stop 2024-09-21T03:18:40.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.826+0000 7f9179e97640 1 -- 172.21.15.105:0/181319429 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91740b43e0 msgr2=0x7f91741f46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.826+0000 7f9179e97640 1 --2- 172.21.15.105:0/181319429 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91740b43e0 0x7f91741f46f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f916800c430 tx=0x7f916800c8f0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.826+0000 7f9179696640 1 -- 172.21.15.105:0/181319429 reap_dead start 2024-09-21T03:18:40.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.826+0000 7f9179e97640 1 -- 172.21.15.105:0/181319429 shutdown_connections 2024-09-21T03:18:40.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.826+0000 7f9179e97640 1 -- 172.21.15.105:0/181319429 >> 172.21.15.105:0/181319429 conn(0x7f917406d410 msgr2=0x7f917415e230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:40.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.826+0000 7f0a1f230640 1 -- 172.21.15.105:0/733283335 shutdown_connections 2024-09-21T03:18:40.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.826+0000 7f0a1f230640 1 -- 172.21.15.105:0/733283335 wait complete. 2024-09-21T03:18:40.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.827+0000 7f9179e97640 1 -- 172.21.15.105:0/181319429 shutdown_connections 2024-09-21T03:18:40.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.827+0000 7f9179e97640 1 -- 172.21.15.105:0/181319429 wait complete. 2024-09-21T03:18:40.858 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.827+0000 7fea94484640 1 -- 172.21.15.105:0/3944288870 --> [v2:172.21.15.105:6824/1202131294,v1:172.21.15.105:6825/1202131294] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fea8c0b4f40 con 0x7fea70080f00 2024-09-21T03:18:40.858 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.828+0000 7fea82ffd640 1 -- 172.21.15.105:0/3944288870 <== osd.3 v2:172.21.15.105:6824/1202131294 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fea8c0b4f40 con 0x7fea70080f00 2024-09-21T03:18:40.859 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.828+0000 7fea94484640 1 -- 172.21.15.105:0/3944288870 >> [v2:172.21.15.105:6824/1202131294,v1:172.21.15.105:6825/1202131294] conn(0x7fea70080f00 msgr2=0x7fea70083350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.859 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.828+0000 7fea94484640 1 --2- 172.21.15.105:0/3944288870 >> [v2:172.21.15.105:6824/1202131294,v1:172.21.15.105:6825/1202131294] conn(0x7fea70080f00 0x7fea70083350 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.859 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.829+0000 7fea94484640 1 -- 172.21.15.105:0/3944288870 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fea70078c90 msgr2=0x7fea7007b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.859 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.829+0000 7fea94484640 1 --2- 172.21.15.105:0/3944288870 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fea70078c90 0x7fea7007b1a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fea88033000 tx=0x7fea88001190 comp rx=0 tx=0).stop 2024-09-21T03:18:40.859 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.829+0000 7fea94484640 1 -- 172.21.15.105:0/3944288870 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea78004800 msgr2=0x7fea8c15c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.859 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.829+0000 7fea94484640 1 --2- 172.21.15.105:0/3944288870 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea78004800 0x7fea8c15c3e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fea7c003670 tx=0x7fea7c003b30 comp rx=0 tx=0).stop 2024-09-21T03:18:40.859 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.829+0000 7fea92a21640 1 -- 172.21.15.105:0/3944288870 reap_dead start 2024-09-21T03:18:40.859 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.829+0000 7fea94484640 1 -- 172.21.15.105:0/3944288870 shutdown_connections 2024-09-21T03:18:40.859 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.829+0000 7fea94484640 1 -- 172.21.15.105:0/3944288870 >> 172.21.15.105:0/3944288870 conn(0x7fea8c0d0000 msgr2=0x7fea8c159af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:40.860 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.829+0000 7fea94484640 1 -- 172.21.15.105:0/3944288870 shutdown_connections 2024-09-21T03:18:40.860 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.829+0000 7fea94484640 1 -- 172.21.15.105:0/3944288870 wait complete. 2024-09-21T03:18:40.860 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.829+0000 7f41c27e6640 1 -- 172.21.15.105:0/3515170378 --> [v2:172.21.15.162:6810/1660148918,v1:172.21.15.162:6811/1660148918] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f41bc0ae420 con 0x7f419c080de0 2024-09-21T03:18:40.860 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.830+0000 7f41b8ff9640 1 -- 172.21.15.105:0/3515170378 <== osd.4 v2:172.21.15.162:6810/1660148918 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f41bc0ae420 con 0x7f419c080de0 2024-09-21T03:18:40.860 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.830+0000 7f5fd7470640 1 -- 172.21.15.105:0/497079176 --> [v2:172.21.15.162:6826/3787313702,v1:172.21.15.162:6827/3787313702] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5fd013d200 con 0x7f5fb4080fe0 2024-09-21T03:18:40.861 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.831+0000 7f41b27fc640 1 -- 172.21.15.105:0/3515170378 >> [v2:172.21.15.162:6810/1660148918,v1:172.21.15.162:6811/1660148918] conn(0x7f419c080de0 msgr2=0x7f419c083230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.861 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.831+0000 7f41b27fc640 1 --2- 172.21.15.105:0/3515170378 >> [v2:172.21.15.162:6810/1660148918,v1:172.21.15.162:6811/1660148918] conn(0x7f419c080de0 0x7f419c083230 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.861 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.831+0000 7f41b27fc640 1 -- 172.21.15.105:0/3515170378 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f419c078b90 msgr2=0x7f419c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.861 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.831+0000 7f41b27fc640 1 --2- 172.21.15.105:0/3515170378 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f419c078b90 0x7f419c07b0a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f41bc0cf080 tx=0x7f41a4009040 comp rx=0 tx=0).stop 2024-09-21T03:18:40.861 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.831+0000 7f41b27fc640 1 -- 172.21.15.105:0/3515170378 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41bc15a9b0 msgr2=0x7f41bc14f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.861 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.831+0000 7f41b27fc640 1 --2- 172.21.15.105:0/3515170378 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41bc15a9b0 0x7f41bc14f900 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f41b40095d0 tx=0x7f41b4009a90 comp rx=0 tx=0).stop 2024-09-21T03:18:40.861 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.831+0000 7f5fc5ffb640 1 -- 172.21.15.105:0/497079176 <== osd.7 v2:172.21.15.162:6826/3787313702 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5fd013d200 con 0x7f5fb4080fe0 2024-09-21T03:18:40.862 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.831+0000 7f41c0d83640 1 -- 172.21.15.105:0/3515170378 reap_dead start 2024-09-21T03:18:40.862 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.831+0000 7f41b27fc640 1 -- 172.21.15.105:0/3515170378 shutdown_connections 2024-09-21T03:18:40.862 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.831+0000 7f41b27fc640 1 -- 172.21.15.105:0/3515170378 >> 172.21.15.105:0/3515170378 conn(0x7f41bc06d7d0 msgr2=0x7f41bc0ae940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:40.862 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.831+0000 7f41b27fc640 1 -- 172.21.15.105:0/3515170378 shutdown_connections 2024-09-21T03:18:40.862 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.831+0000 7f41b27fc640 1 -- 172.21.15.105:0/3515170378 wait complete. 2024-09-21T03:18:40.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.832+0000 7f5fb37fe640 1 -- 172.21.15.105:0/497079176 >> [v2:172.21.15.162:6826/3787313702,v1:172.21.15.162:6827/3787313702] conn(0x7f5fb4080fe0 msgr2=0x7f5fb4083430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.832+0000 7f5fb37fe640 1 --2- 172.21.15.105:0/497079176 >> [v2:172.21.15.162:6826/3787313702,v1:172.21.15.162:6827/3787313702] conn(0x7f5fb4080fe0 0x7f5fb4083430 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.832+0000 7f5fb37fe640 1 -- 172.21.15.105:0/497079176 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5fb4078d90 msgr2=0x7f5fb407b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.832+0000 7f5fb37fe640 1 --2- 172.21.15.105:0/497079176 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5fb4078d90 0x7f5fb407b2a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8005fd0 tx=0x7f5fc8009500 comp rx=0 tx=0).stop 2024-09-21T03:18:40.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.832+0000 7f5fb37fe640 1 -- 172.21.15.105:0/497079176 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5fd013dce0 msgr2=0x7f5fd0140980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.864 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.832+0000 7f5fb37fe640 1 --2- 172.21.15.105:0/497079176 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5fd013dce0 0x7f5fd0140980 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5fc000c370 tx=0x7f5fc000c830 comp rx=0 tx=0).stop 2024-09-21T03:18:40.864 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.832+0000 7f5fd5a0d640 1 -- 172.21.15.105:0/497079176 reap_dead start 2024-09-21T03:18:40.864 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.832+0000 7f5fb37fe640 1 -- 172.21.15.105:0/497079176 shutdown_connections 2024-09-21T03:18:40.864 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.832+0000 7f5fb37fe640 1 -- 172.21.15.105:0/497079176 >> 172.21.15.105:0/497079176 conn(0x7f5fd0073fa0 msgr2=0x7f5fd0137b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:40.864 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.833+0000 7f5fb37fe640 1 -- 172.21.15.105:0/497079176 shutdown_connections 2024-09-21T03:18:40.864 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.833+0000 7f5fb37fe640 1 -- 172.21.15.105:0/497079176 wait complete. 2024-09-21T03:18:40.864 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.839+0000 7f6dee3ac640 1 -- 172.21.15.105:0/3536517263 --> [v2:172.21.15.105:6816/3314074789,v1:172.21.15.105:6817/3314074789] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6dc8002dd0 con 0x7f6dcc081d10 2024-09-21T03:18:40.865 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.840+0000 7f6dddffb640 1 -- 172.21.15.105:0/3536517263 <== osd.1 v2:172.21.15.105:6816/3314074789 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6dc8002dd0 con 0x7f6dcc081d10 2024-09-21T03:18:40.865 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.841+0000 7f6dee3ac640 1 -- 172.21.15.105:0/3536517263 >> [v2:172.21.15.105:6816/3314074789,v1:172.21.15.105:6817/3314074789] conn(0x7f6dcc081d10 msgr2=0x7f6dcc084200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.865 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.841+0000 7f6dee3ac640 1 --2- 172.21.15.105:0/3536517263 >> [v2:172.21.15.105:6816/3314074789,v1:172.21.15.105:6817/3314074789] conn(0x7f6dcc081d10 0x7f6dcc084200 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.865 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.845+0000 7f6dee3ac640 1 -- 172.21.15.105:0/3536517263 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6dcc078f90 msgr2=0x7f6dcc07b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.865 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.845+0000 7f6dee3ac640 1 --2- 172.21.15.105:0/3536517263 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6dcc078f90 0x7f6dcc07b4a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6de80744e0 tx=0x7f6dd802d040 comp rx=0 tx=0).stop 2024-09-21T03:18:40.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.846+0000 7f6dee3ac640 1 -- 172.21.15.105:0/3536517263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6de8158a10 msgr2=0x7f6de815d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:40.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.846+0000 7f6dee3ac640 1 --2- 172.21.15.105:0/3536517263 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6de8158a10 0x7f6de815d740 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6de400c4d0 tx=0x7f6de400c8d0 comp rx=0 tx=0).stop 2024-09-21T03:18:40.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.846+0000 7f6dedbab640 1 -- 172.21.15.105:0/3536517263 reap_dead start 2024-09-21T03:18:40.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.846+0000 7f6dee3ac640 1 -- 172.21.15.105:0/3536517263 shutdown_connections 2024-09-21T03:18:40.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.846+0000 7f6dee3ac640 1 -- 172.21.15.105:0/3536517263 >> 172.21.15.105:0/3536517263 conn(0x7f6de809d680 msgr2=0x7f6de806eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:40.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.846+0000 7f6dee3ac640 1 -- 172.21.15.105:0/3536517263 shutdown_connections 2024-09-21T03:18:40.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:40.846+0000 7f6dee3ac640 1 -- 172.21.15.105:0/3536517263 wait complete. 2024-09-21T03:18:40.867 INFO:teuthology.orchestra.run.smithi105.stdout:55834574855 2024-09-21T03:18:40.867 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-21T03:18:40.868 INFO:teuthology.orchestra.run.smithi105.stdout:64424509448 2024-09-21T03:18:40.868 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-21T03:18:40.869 INFO:teuthology.orchestra.run.smithi105.stdout:64424509448 2024-09-21T03:18:40.869 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-21T03:18:40.870 INFO:teuthology.orchestra.run.smithi105.stdout:64424509447 2024-09-21T03:18:40.870 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-21T03:18:40.871 INFO:teuthology.orchestra.run.smithi105.stdout:64424509448 2024-09-21T03:18:40.871 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-21T03:18:40.872 INFO:teuthology.orchestra.run.smithi105.stdout:64424509447 2024-09-21T03:18:40.872 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-21T03:18:40.872 INFO:teuthology.orchestra.run.smithi105.stdout:64424509449 2024-09-21T03:18:40.873 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-21T03:18:40.873 INFO:teuthology.orchestra.run.smithi105.stdout:64424509448 2024-09-21T03:18:40.874 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-21T03:18:41.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.119+0000 7f9d2e732640 1 -- 172.21.15.105:0/2050122457 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d10005150 msgr2=0x7f9d1000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.119+0000 7f9d2e732640 1 --2- 172.21.15.105:0/2050122457 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d10005150 0x7f9d1000b9c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9d28074980 tx=0x7f9d10005830 comp rx=0 tx=0).stop 2024-09-21T03:18:41.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.119+0000 7f9d2cccf640 1 -- 172.21.15.105:0/2050122457 reap_dead start 2024-09-21T03:18:41.122 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.120+0000 7f9d2e732640 1 -- 172.21.15.105:0/2050122457 shutdown_connections 2024-09-21T03:18:41.122 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.120+0000 7f9d2e732640 1 -- 172.21.15.105:0/2050122457 >> 172.21.15.105:0/2050122457 conn(0x7f9d28074170 msgr2=0x7f9d280b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:41.122 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.120+0000 7f9d2e732640 1 -- 172.21.15.105:0/2050122457 shutdown_connections 2024-09-21T03:18:41.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.123+0000 7f98cecc9640 1 -- 172.21.15.105:0/4074300833 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98c0053710 msgr2=0x7f98c0053b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.123+0000 7f98cecc9640 1 --2- 172.21.15.105:0/4074300833 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98c0053710 0x7f98c0053b20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f98c806ad50 tx=0x7f98c80a7890 comp rx=0 tx=0).stop 2024-09-21T03:18:41.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.123+0000 7f98cecc9640 1 -- 172.21.15.105:0/4074300833 shutdown_connections 2024-09-21T03:18:41.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.123+0000 7f98cecc9640 1 --2- 172.21.15.105:0/4074300833 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98c0053710 0x7f98c0053b20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.123+0000 7f98cecc9640 1 --2- 172.21.15.105:0/4074300833 >> v2:172.21.15.162:3300/0 conn(0x7f98c00520b0 0x7f98c0007c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.123+0000 7f98cecc9640 1 -- 172.21.15.105:0/4074300833 >> 172.21.15.105:0/4074300833 conn(0x7f98c001e260 msgr2=0x7f98c0039e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:41.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.120+0000 7f9d2e732640 1 -- 172.21.15.105:0/2050122457 wait complete. 2024-09-21T03:18:41.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.123+0000 7f9d2e732640 1 Processor -- start 2024-09-21T03:18:41.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.123+0000 7f98cecc9640 1 -- 172.21.15.105:0/4074300833 shutdown_connections 2024-09-21T03:18:41.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.124+0000 7f9d2e732640 1 -- start start 2024-09-21T03:18:41.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.124+0000 7f98cecc9640 1 -- 172.21.15.105:0/4074300833 wait complete. 2024-09-21T03:18:41.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.125+0000 7f52e9035640 1 -- 172.21.15.105:0/722284979 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e0006ba0 con 0x7f52d0004800 2024-09-21T03:18:41.127 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.125+0000 7f52ec29b640 1 -- 172.21.15.105:0/722284979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52d0004800 msgr2=0x7f52d0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.127 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.125+0000 7f52ec29b640 1 --2- 172.21.15.105:0/722284979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52d0004800 0x7f52d0004c10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f52e0006f50 tx=0x7f52d0005830 comp rx=0 tx=0).stop 2024-09-21T03:18:41.128 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.126+0000 7f52ec29b640 1 -- 172.21.15.105:0/722284979 shutdown_connections 2024-09-21T03:18:41.128 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.126+0000 7f52ec29b640 1 --2- 172.21.15.105:0/722284979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52d0004800 0x7f52d0004c10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.128 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.126+0000 7f52ec29b640 1 -- 172.21.15.105:0/722284979 >> 172.21.15.105:0/722284979 conn(0x7f52e406d4a0 msgr2=0x7f52e406ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:41.128 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.126+0000 7f52ec29b640 1 -- 172.21.15.105:0/722284979 shutdown_connections 2024-09-21T03:18:41.128 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.126+0000 7f9d2e732640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d10005150 0x7f9d280b32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:41.128 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.126+0000 7f9d2e732640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d28148e80 0x7f9d2815d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:41.129 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.126+0000 7f9d2e732640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d28149290 0x7f9d2815dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:41.129 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.126+0000 7f8c3ae22640 1 -- 172.21.15.105:0/2643854658 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c200051a0 msgr2=0x7f8c2000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.129 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.126+0000 7f8c3ae22640 1 --2- 172.21.15.105:0/2643854658 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c200051a0 0x7f8c2000b9c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8c30005fd0 tx=0x7f8c20005830 comp rx=0 tx=0).stop 2024-09-21T03:18:41.129 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.126+0000 7f8c3a621640 1 -- 172.21.15.105:0/2643854658 reap_dead start 2024-09-21T03:18:41.129 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.127+0000 7f9d27fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d10005150 0x7f9d280b32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:41.130 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.127+0000 7f52ec29b640 1 -- 172.21.15.105:0/722284979 wait complete. 2024-09-21T03:18:41.130 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.127+0000 7f8c3ae22640 1 -- 172.21.15.105:0/2643854658 shutdown_connections 2024-09-21T03:18:41.130 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.127+0000 7f8c3ae22640 1 -- 172.21.15.105:0/2643854658 >> 172.21.15.105:0/2643854658 conn(0x7f8c3406d410 msgr2=0x7f8c340b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:41.130 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.127+0000 7f9d277fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d28148e80 0x7f9d2815d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:41.130 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.127+0000 7f9d27fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d10005150 0x7f9d280b32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.105:60774/0 (socket says 172.21.15.105:60774) 2024-09-21T03:18:41.131 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.127+0000 7f8c3ae22640 1 -- 172.21.15.105:0/2643854658 shutdown_connections 2024-09-21T03:18:41.131 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.127+0000 7f8c3ae22640 1 -- 172.21.15.105:0/2643854658 wait complete. 2024-09-21T03:18:41.131 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.127+0000 7f9d277fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d28148e80 0x7f9d2815d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.105:58278/0 (socket says 172.21.15.105:58278) 2024-09-21T03:18:41.131 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.127+0000 7f05683eb640 1 -- 172.21.15.105:0/921984982 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05600caee0 msgr2=0x7f056006ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.132 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.127+0000 7f98cecc9640 1 Processor -- start 2024-09-21T03:18:41.132 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.127+0000 7f05683eb640 1 --2- 172.21.15.105:0/921984982 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05600caee0 0x7f056006ee90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0560071270 tx=0x7f055802aa30 comp rx=0 tx=0).stop 2024-09-21T03:18:41.132 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.127+0000 7f9d2cccf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d28149290 0x7f9d2815dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:41.133 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.127+0000 7f9d2cccf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d28149290 0x7f9d2815dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56780/0 (socket says 172.21.15.105:56780) 2024-09-21T03:18:41.133 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.127+0000 7f05683eb640 1 -- 172.21.15.105:0/921984982 shutdown_connections 2024-09-21T03:18:41.133 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.127+0000 7f9d27fff640 1 -- 172.21.15.105:0/321150838 learned_addr learned my addr 172.21.15.105:0/321150838 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:41.133 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.127+0000 7f9d2e732640 1 -- 172.21.15.105:0/321150838 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9d280ae540 con 0x7f9d28149290 2024-09-21T03:18:41.134 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.127+0000 7f9d2e732640 1 -- 172.21.15.105:0/321150838 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9d280ae3c0 con 0x7f9d28148e80 2024-09-21T03:18:41.134 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.127+0000 7f9d2e732640 1 -- 172.21.15.105:0/321150838 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9d280cf350 con 0x7f9d10005150 2024-09-21T03:18:41.134 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.127+0000 7f05683eb640 1 --2- 172.21.15.105:0/921984982 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05600caee0 0x7f056006ee90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.134 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.127+0000 7f05683eb640 1 --2- 172.21.15.105:0/921984982 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f056015bf20 0x7f05600ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.134 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.127+0000 7f05683eb640 1 -- 172.21.15.105:0/921984982 >> 172.21.15.105:0/921984982 conn(0x7f05600b1cb0 msgr2=0x7f05600b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:41.134 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.127+0000 7f98cecc9640 1 -- start start 2024-09-21T03:18:41.135 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.128+0000 7f05683eb640 1 -- 172.21.15.105:0/921984982 shutdown_connections 2024-09-21T03:18:41.135 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.128+0000 7f05683eb640 1 -- 172.21.15.105:0/921984982 wait complete. 2024-09-21T03:18:41.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.128+0000 7ff8a63eb640 1 -- 172.21.15.105:0/3738163472 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff888005350 msgr2=0x7ff88800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.128+0000 7ff8a63eb640 1 --2- 172.21.15.105:0/3738163472 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff888005350 0x7ff88800b9c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff890009b20 tx=0x7ff888005830 comp rx=0 tx=0).stop 2024-09-21T03:18:41.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.128+0000 7ff8a63eb640 1 -- 172.21.15.105:0/3738163472 shutdown_connections 2024-09-21T03:18:41.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.128+0000 7ff8a63eb640 1 --2- 172.21.15.105:0/3738163472 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff888005350 0x7ff88800b9c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.128+0000 7ff8a63eb640 1 -- 172.21.15.105:0/3738163472 >> 172.21.15.105:0/3738163472 conn(0x7ff8a00b20a0 msgr2=0x7ff8a00b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:41.137 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.128+0000 7f9d2cccf640 1 -- 172.21.15.105:0/321150838 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d10005150 msgr2=0x7f9d280b32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.137 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.128+0000 7f9d2cccf640 1 --2- 172.21.15.105:0/321150838 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d10005150 0x7f9d280b32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.137 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.128+0000 7f9d2cccf640 1 -- 172.21.15.105:0/321150838 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d28148e80 msgr2=0x7f9d2815d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.137 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.128+0000 7f9d2cccf640 1 --2- 172.21.15.105:0/321150838 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d28148e80 0x7f9d2815d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.137 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.128+0000 7f9d2cccf640 1 -- 172.21.15.105:0/321150838 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d280b2030 con 0x7f9d28149290 2024-09-21T03:18:41.137 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.129+0000 7f9d2cccf640 1 --2- 172.21.15.105:0/321150838 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d28149290 0x7f9d2815dd30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9d1000c1b0 tx=0x7f9d20004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:41.138 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.129+0000 7f9d24ff9640 1 -- 172.21.15.105:0/321150838 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c009700 con 0x7f9d28149290 2024-09-21T03:18:41.138 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.129+0000 7f52ec29b640 1 Processor -- start 2024-09-21T03:18:41.138 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.129+0000 7f47a7dcc640 1 -- 172.21.15.105:0/3793561519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47a00ce530 msgr2=0x7f47a00ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.138 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.129+0000 7f47a7dcc640 1 --2- 172.21.15.105:0/3793561519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47a00ce530 0x7f47a00ce940 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4790009830 tx=0x7f479002a4d0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.138 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.129+0000 7f9d2e732640 1 -- 172.21.15.105:0/321150838 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d280b22e0 con 0x7f9d28149290 2024-09-21T03:18:41.139 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.129+0000 7f52ec29b640 1 -- start start 2024-09-21T03:18:41.139 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.129+0000 7f98cecc9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98c0053710 0x7f98c0176160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:41.139 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.129+0000 7f98cecc9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98c00df800 0x7f98c00d9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:41.139 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.129+0000 7f98cecc9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f98c00dcd60 0x7f98c00dd170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:41.139 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.129+0000 7f98cdcc7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98c0053710 0x7f98c0176160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:41.139 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.129+0000 7f8c3ae22640 1 Processor -- start 2024-09-21T03:18:41.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.129+0000 7f9d2e732640 1 -- 172.21.15.105:0/321150838 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d280b28a0 con 0x7f9d28149290 2024-09-21T03:18:41.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.129+0000 7ff8a63eb640 1 -- 172.21.15.105:0/3738163472 shutdown_connections 2024-09-21T03:18:41.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.129+0000 7f47a7dcc640 1 -- 172.21.15.105:0/3793561519 shutdown_connections 2024-09-21T03:18:41.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.129+0000 7f47a7dcc640 1 --2- 172.21.15.105:0/3793561519 >> v2:172.21.15.105:3300/0 conn(0x7f47a0162940 0x7f47a00cba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.129+0000 7f47a7dcc640 1 --2- 172.21.15.105:0/3793561519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47a00ce530 0x7f47a00ce940 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.129+0000 7f47a7dcc640 1 -- 172.21.15.105:0/3793561519 >> 172.21.15.105:0/3793561519 conn(0x7f47a006d870 msgr2=0x7f47a006ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:41.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.129+0000 7ff8a63eb640 1 -- 172.21.15.105:0/3738163472 wait complete. 2024-09-21T03:18:41.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.129+0000 7f98cdcc7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98c0053710 0x7f98c0176160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.105:60782/0 (socket says 172.21.15.105:60782) 2024-09-21T03:18:41.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.129+0000 7f98cd4c6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98c00df800 0x7f98c00d9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:41.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.129+0000 7f98cd4c6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98c00df800 0x7f98c00d9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.105:58286/0 (socket says 172.21.15.105:58286) 2024-09-21T03:18:41.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.130+0000 7f98cdcc7640 1 -- 172.21.15.105:0/653645573 learned_addr learned my addr 172.21.15.105:0/653645573 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:41.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.130+0000 7f98cecc9640 1 -- 172.21.15.105:0/653645573 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f98c0006110 con 0x7f98c00dcd60 2024-09-21T03:18:41.142 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.130+0000 7f98cecc9640 1 -- 172.21.15.105:0/653645573 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f98c0005f90 con 0x7f98c00df800 2024-09-21T03:18:41.142 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.130+0000 7f98cecc9640 1 -- 172.21.15.105:0/653645573 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f98c0006290 con 0x7f98c0053710 2024-09-21T03:18:41.142 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.130+0000 7f47a7dcc640 1 -- 172.21.15.105:0/3793561519 shutdown_connections 2024-09-21T03:18:41.142 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.130+0000 7f47a7dcc640 1 -- 172.21.15.105:0/3793561519 wait complete. 2024-09-21T03:18:41.142 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.130+0000 7f5a52be6640 1 -- 172.21.15.105:0/3950448635 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a34004800 msgr2=0x7f5a34004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.142 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.130+0000 7f5a52be6640 1 --2- 172.21.15.105:0/3950448635 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a34004800 0x7f5a34004c10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5a4400d330 tx=0x7f5a34005830 comp rx=0 tx=0).stop 2024-09-21T03:18:41.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.130+0000 7f98cd4c6640 1 -- 172.21.15.105:0/653645573 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98c0053710 msgr2=0x7f98c0176160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.130+0000 7f98cd4c6640 1 --2- 172.21.15.105:0/653645573 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98c0053710 0x7f98c0176160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.130+0000 7f98cd4c6640 1 -- 172.21.15.105:0/653645573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f98c00dcd60 msgr2=0x7f98c00dd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.130+0000 7f98cd4c6640 1 --2- 172.21.15.105:0/653645573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f98c00dcd60 0x7f98c00dd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.131+0000 7f8c3ae22640 1 -- start start 2024-09-21T03:18:41.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.130+0000 7f98cd4c6640 1 -- 172.21.15.105:0/653645573 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98c00dd6b0 con 0x7f98c00df800 2024-09-21T03:18:41.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.130+0000 7f98cdcc7640 1 --2- 172.21.15.105:0/653645573 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98c0053710 0x7f98c0176160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:18:41.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.131+0000 7f9d24ff9640 1 -- 172.21.15.105:0/321150838 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d2002bc60 con 0x7f9d28149290 2024-09-21T03:18:41.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.131+0000 7f5a51183640 1 -- 172.21.15.105:0/3950448635 reap_dead start 2024-09-21T03:18:41.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.131+0000 7f5a52be6640 1 -- 172.21.15.105:0/3950448635 shutdown_connections 2024-09-21T03:18:41.145 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.131+0000 7f5a52be6640 1 -- 172.21.15.105:0/3950448635 >> 172.21.15.105:0/3950448635 conn(0x7f5a4401e260 msgr2=0x7f5a44039e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:41.145 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.131+0000 7f9d0e7fc640 1 -- 172.21.15.105:0/321150838 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d08005290 con 0x7f9d28149290 2024-09-21T03:18:41.145 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.131+0000 7f05683eb640 1 Processor -- start 2024-09-21T03:18:41.145 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.131+0000 7f05683eb640 1 -- start start 2024-09-21T03:18:41.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.131+0000 7f52ec29b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52d0004800 0x7f52e413e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:41.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.131+0000 7f52ec29b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52e413c580 0x7f52e40b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:41.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.131+0000 7f52ec29b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52e40b16e0 0x7f52e40b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:41.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.131+0000 7f52ec29b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f52e4144ee0 con 0x7f52e413c580 2024-09-21T03:18:41.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.131+0000 7f52ec29b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f52e4144d60 con 0x7f52d0004800 2024-09-21T03:18:41.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.131+0000 7f52ea037640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52d0004800 0x7f52e413e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:41.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.132+0000 7f52ec29b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f52e40ce800 con 0x7f52e40b16e0 2024-09-21T03:18:41.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.132+0000 7f52e9836640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52e413c580 0x7f52e40b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:41.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.132+0000 7f52ea037640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52d0004800 0x7f52e413e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.105:58296/0 (socket says 172.21.15.105:58296) 2024-09-21T03:18:41.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.132+0000 7f52ea037640 1 -- 172.21.15.105:0/3689107593 learned_addr learned my addr 172.21.15.105:0/3689107593 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:41.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.132+0000 7f52ea838640 1 --2- 172.21.15.105:0/3689107593 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52e40b16e0 0x7f52e40b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:41.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.132+0000 7f52ea037640 1 -- 172.21.15.105:0/3689107593 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52e40b16e0 msgr2=0x7f52e40b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.132+0000 7f52ea037640 1 --2- 172.21.15.105:0/3689107593 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52e40b16e0 0x7f52e40b2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.132+0000 7f52ea037640 1 -- 172.21.15.105:0/3689107593 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52e413c580 msgr2=0x7f52e40b11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.132+0000 7f52ea037640 1 --2- 172.21.15.105:0/3689107593 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52e413c580 0x7f52e40b11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.148 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.132+0000 7f9d24ff9640 1 -- 172.21.15.105:0/321150838 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2000c280 con 0x7f9d28149290 2024-09-21T03:18:41.148 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.132+0000 7f52ea037640 1 -- 172.21.15.105:0/3689107593 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e413cdf0 con 0x7f52d0004800 2024-09-21T03:18:41.148 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.132+0000 7f9d24ff9640 1 -- 172.21.15.105:0/321150838 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9d20006290 con 0x7f9d28149290 2024-09-21T03:18:41.148 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.132+0000 7ff8a63eb640 1 Processor -- start 2024-09-21T03:18:41.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.133+0000 7f52e9836640 1 --2- 172.21.15.105:0/3689107593 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52e413c580 0x7f52e40b11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:18:41.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.133+0000 7ff8a63eb640 1 -- start start 2024-09-21T03:18:41.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.133+0000 7f52ea037640 1 --2- 172.21.15.105:0/3689107593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52d0004800 0x7f52e413e9e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f52d400e620 tx=0x7f52d400eae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:41.150 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.133+0000 7f8c3ae22640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c200051a0 0x7f8c3415cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:41.150 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.132+0000 7f47a7dcc640 1 Processor -- start 2024-09-21T03:18:41.150 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.132+0000 7f47a7dcc640 1 -- start start 2024-09-21T03:18:41.150 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.133+0000 7f52daffd640 1 -- 172.21.15.105:0/3689107593 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d400ca10 con 0x7f52d0004800 2024-09-21T03:18:41.150 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.133+0000 7f52ec29b640 1 -- 172.21.15.105:0/3689107593 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52e40b1af0 con 0x7f52d0004800 2024-09-21T03:18:41.151 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.133+0000 7f9d24ff9640 1 --2- 172.21.15.105:0/321150838 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9d14078c90 0x7f9d1407b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:41.151 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.133+0000 7f52ec29b640 1 -- 172.21.15.105:0/3689107593 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52e41fd410 con 0x7f52d0004800 2024-09-21T03:18:41.151 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.133+0000 7f8c3ae22640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c341479a0 0x7f8c3415d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:41.151 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.133+0000 7f8c39e20640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c200051a0 0x7f8c3415cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:41.151 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.133+0000 7f8c3ae22640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c3414b330 0x7f8c3414dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:41.151 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.133+0000 7f8c39e20640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c200051a0 0x7f8c3415cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56820/0 (socket says 172.21.15.105:56820) 2024-09-21T03:18:41.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.133+0000 7f05683eb640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05600caee0 0x7f05600c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:41.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.133+0000 7f9d27fff640 1 --2- 172.21.15.105:0/321150838 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9d14078c90 0x7f9d1407b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:41.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.134+0000 7f05683eb640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05600cfb00 0x7f0560157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:41.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.134+0000 7f9d24ff9640 1 -- 172.21.15.105:0/321150838 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f9d200bade0 con 0x7f9d28149290 2024-09-21T03:18:41.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.134+0000 7f05683eb640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f056015bf20 0x7f056015ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:41.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.134+0000 7f8c3961f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c341479a0 0x7f8c3415d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:41.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.134+0000 7f8c3961f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c341479a0 0x7f8c3415d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.105:58310/0 (socket says 172.21.15.105:58310) 2024-09-21T03:18:41.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.134+0000 7f8c3a621640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c3414b330 0x7f8c3414dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:41.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.134+0000 7f8c3a621640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c3414b330 0x7f8c3414dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.105:60792/0 (socket says 172.21.15.105:60792) 2024-09-21T03:18:41.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.134+0000 7f8c3a621640 1 -- 172.21.15.105:0/3066850217 learned_addr learned my addr 172.21.15.105:0/3066850217 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:41.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.134+0000 7f8c3ae22640 1 -- 172.21.15.105:0/3066850217 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8c340cfce0 con 0x7f8c200051a0 2024-09-21T03:18:41.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.134+0000 7f8c3ae22640 1 -- 172.21.15.105:0/3066850217 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8c340cfb60 con 0x7f8c341479a0 2024-09-21T03:18:41.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.134+0000 7f8c3ae22640 1 -- 172.21.15.105:0/3066850217 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8c3406ee70 con 0x7f8c3414b330 2024-09-21T03:18:41.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.133+0000 7f5a52be6640 1 -- 172.21.15.105:0/3950448635 shutdown_connections 2024-09-21T03:18:41.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.133+0000 7f52daffd640 1 -- 172.21.15.105:0/3689107593 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f52d400cbd0 con 0x7f52d0004800 2024-09-21T03:18:41.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.134+0000 7f05683eb640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f05600ccba0 con 0x7f05600caee0 2024-09-21T03:18:41.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.134+0000 7f05683eb640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f056015c3b0 con 0x7f05600cfb00 2024-09-21T03:18:41.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.134+0000 7f05683eb640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f05600ccd20 con 0x7f056015bf20 2024-09-21T03:18:41.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.134+0000 7f9d27fff640 1 --2- 172.21.15.105:0/321150838 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9d14078c90 0x7f9d1407b1a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9d18004650 tx=0x7f9d18005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:41.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.134+0000 7f52daffd640 1 -- 172.21.15.105:0/3689107593 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d4010430 con 0x7f52d0004800 2024-09-21T03:18:41.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.135+0000 7f47a7dcc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47a00cb630 0x7f47a01446b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:41.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.135+0000 7ff8a63eb640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff888005350 0x7ff8a0153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:41.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.131+0000 7f98cd4c6640 1 --2- 172.21.15.105:0/653645573 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98c00df800 0x7f98c00d9250 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f98c000e3b0 tx=0x7f98c400b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:41.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.134+0000 7f98be7fc640 1 -- 172.21.15.105:0/653645573 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c4015020 con 0x7f98c00df800 2024-09-21T03:18:41.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.134+0000 7f98be7fc640 1 -- 172.21.15.105:0/653645573 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f98c4011940 con 0x7f98c00df800 2024-09-21T03:18:41.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.135+0000 7f98be7fc640 1 -- 172.21.15.105:0/653645573 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c4011d90 con 0x7f98c00df800 2024-09-21T03:18:41.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.135+0000 7f98cecc9640 1 -- 172.21.15.105:0/653645573 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98c0048660 con 0x7f98c00df800 2024-09-21T03:18:41.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.136+0000 7f98cecc9640 1 -- 172.21.15.105:0/653645573 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98c0032fe0 con 0x7f98c00df800 2024-09-21T03:18:41.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.135+0000 7ff8a63eb640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8a01544f0 0x7ff8a01f3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:41.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.135+0000 7ff89ffff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff888005350 0x7ff8a0153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:41.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.135+0000 7ff89ffff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff888005350 0x7ff8a0153ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.105:60824/0 (socket says 172.21.15.105:60824) 2024-09-21T03:18:41.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.135+0000 7ff89ffff640 1 -- 172.21.15.105:0/3507745959 learned_addr learned my addr 172.21.15.105:0/3507745959 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:41.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.135+0000 7ff8a63eb640 1 --2- 172.21.15.105:0/3507745959 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8a01f4360 0x7ff8a01f4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:41.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.135+0000 7f47a7dcc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47a00ce530 0x7f47a02059a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:41.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.135+0000 7f47a5367640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47a00ce530 0x7f47a02059a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:41.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.135+0000 7f47a5367640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47a00ce530 0x7f47a02059a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.105:60814/0 (socket says 172.21.15.105:60814) 2024-09-21T03:18:41.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.135+0000 7f47a5b68640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47a00cb630 0x7f47a01446b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:41.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.135+0000 7f47a5b68640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47a00cb630 0x7f47a01446b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56846/0 (socket says 172.21.15.105:56846) 2024-09-21T03:18:41.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.135+0000 7f47a7dcc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47a0162940 0x7f47a0205ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:41.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.135+0000 7f47a7dcc640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f47a00cfac0 con 0x7f47a00cb630 2024-09-21T03:18:41.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.135+0000 7f47a7dcc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f47a00cf940 con 0x7f47a0162940 2024-09-21T03:18:41.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.135+0000 7f47a5367640 1 -- 172.21.15.105:0/1162727985 learned_addr learned my addr 172.21.15.105:0/1162727985 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:41.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.135+0000 7f47a7dcc640 1 -- 172.21.15.105:0/1162727985 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f47a00cfc40 con 0x7f47a00ce530 2024-09-21T03:18:41.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.135+0000 7f47a6369640 1 --2- 172.21.15.105:0/1162727985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47a0162940 0x7f47a0205ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:41.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.136+0000 7ff8a63eb640 1 -- 172.21.15.105:0/3507745959 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a00af450 con 0x7ff8a01544f0 2024-09-21T03:18:41.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.136+0000 7ff8a4988640 1 --2- 172.21.15.105:0/3507745959 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8a01f4360 0x7ff8a01f4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:41.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.135+0000 7f8c39e20640 1 -- 172.21.15.105:0/3066850217 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c3414b330 msgr2=0x7f8c3414dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.135+0000 7f8c39e20640 1 --2- 172.21.15.105:0/3066850217 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c3414b330 0x7f8c3414dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.136+0000 7ff8a63eb640 1 -- 172.21.15.105:0/3507745959 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a0162c00 con 0x7ff8a01f4360 2024-09-21T03:18:41.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.135+0000 7f8c39e20640 1 -- 172.21.15.105:0/3066850217 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c341479a0 msgr2=0x7f8c3415d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.135+0000 7f8c39e20640 1 --2- 172.21.15.105:0/3066850217 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c341479a0 0x7f8c3415d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.135+0000 7f8c39e20640 1 -- 172.21.15.105:0/3066850217 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c340cc460 con 0x7f8c200051a0 2024-09-21T03:18:41.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.136+0000 7ff8a63eb640 1 -- 172.21.15.105:0/3507745959 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff8a00af5d0 con 0x7ff888005350 2024-09-21T03:18:41.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.136+0000 7f8c3961f640 1 --2- 172.21.15.105:0/3066850217 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c341479a0 0x7f8c3415d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:18:41.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.136+0000 7f52daffd640 1 -- 172.21.15.105:0/3689107593 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f52d4010690 con 0x7f52d0004800 2024-09-21T03:18:41.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.136+0000 7f47a6369640 1 -- 172.21.15.105:0/1162727985 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47a00ce530 msgr2=0x7f47a02059a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.136+0000 7ff89f7fe640 1 --2- 172.21.15.105:0/3507745959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8a01544f0 0x7ff8a01f3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:41.162 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.136+0000 7f47a6369640 1 --2- 172.21.15.105:0/1162727985 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47a00ce530 0x7f47a02059a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.162 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.136+0000 7f47a6369640 1 -- 172.21.15.105:0/1162727985 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47a00cb630 msgr2=0x7f47a01446b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.162 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.136+0000 7f47a6369640 1 --2- 172.21.15.105:0/1162727985 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47a00cb630 0x7f47a01446b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.162 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.136+0000 7f8c39e20640 1 --2- 172.21.15.105:0/3066850217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c200051a0 0x7f8c3415cb20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8c2400b410 tx=0x7f8c2400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:41.163 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.136+0000 7f47a6369640 1 -- 172.21.15.105:0/1162727985 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47a0206770 con 0x7f47a0162940 2024-09-21T03:18:41.163 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.136+0000 7f52ec29b640 1 -- 172.21.15.105:0/3689107593 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52cc005290 con 0x7f52d0004800 2024-09-21T03:18:41.163 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.136+0000 7ff8a4988640 1 -- 172.21.15.105:0/3507745959 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff888005350 msgr2=0x7ff8a0153ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.163 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.134+0000 7f0566187640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05600caee0 0x7f05600c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:41.164 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.136+0000 7ff8a4988640 1 --2- 172.21.15.105:0/3507745959 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff888005350 0x7ff8a0153ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.164 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.136+0000 7ff8a4988640 1 -- 172.21.15.105:0/3507745959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8a01544f0 msgr2=0x7ff8a01f3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.164 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.136+0000 7ff8a4988640 1 --2- 172.21.15.105:0/3507745959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8a01544f0 0x7ff8a01f3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.164 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.136+0000 7ff8a4988640 1 -- 172.21.15.105:0/3507745959 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8a00737c0 con 0x7ff8a01f4360 2024-09-21T03:18:41.164 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.136+0000 7ff89f7fe640 1 --2- 172.21.15.105:0/3507745959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8a01544f0 0x7ff8a01f3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:18:41.165 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.134+0000 7f0566187640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05600caee0 0x7f05600c93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56832/0 (socket says 172.21.15.105:56832) 2024-09-21T03:18:41.165 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.134+0000 7f0566187640 1 -- 172.21.15.105:0/105252640 learned_addr learned my addr 172.21.15.105:0/105252640 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:41.165 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.135+0000 7f0565986640 1 --2- 172.21.15.105:0/105252640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05600cfb00 0x7f0560157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:41.165 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.135+0000 7f0566988640 1 --2- 172.21.15.105:0/105252640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f056015bf20 0x7f056015ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:41.165 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.137+0000 7ff8a4988640 1 --2- 172.21.15.105:0/3507745959 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8a01f4360 0x7ff8a01f4770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff8a00cb980 tx=0x7ff890005f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:41.165 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.137+0000 7f52daffd640 1 --2- 172.21.15.105:0/3689107593 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f52c8078b90 0x7f52c807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:41.166 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.137+0000 7f0566187640 1 -- 172.21.15.105:0/105252640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f056015bf20 msgr2=0x7f056015ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.166 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.137+0000 7f0566187640 1 --2- 172.21.15.105:0/105252640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f056015bf20 0x7f056015ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.166 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.137+0000 7f0566187640 1 -- 172.21.15.105:0/105252640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05600cfb00 msgr2=0x7f0560157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.166 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.137+0000 7f0566187640 1 --2- 172.21.15.105:0/105252640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05600cfb00 0x7f0560157a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.166 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.137+0000 7f0566187640 1 -- 172.21.15.105:0/105252640 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05600c98f0 con 0x7f05600caee0 2024-09-21T03:18:41.166 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.137+0000 7f47a6369640 1 --2- 172.21.15.105:0/1162727985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47a0162940 0x7f47a0205ee0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4790031000 tx=0x7f4790033bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:41.167 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.134+0000 7f5a52be6640 1 -- 172.21.15.105:0/3950448635 wait complete. 2024-09-21T03:18:41.167 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.137+0000 7f5a52be6640 1 Processor -- start 2024-09-21T03:18:41.167 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.137+0000 7f52e9836640 1 --2- 172.21.15.105:0/3689107593 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f52c8078b90 0x7f52c807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:41.167 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.137+0000 7f5a52be6640 1 -- start start 2024-09-21T03:18:41.168 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.137+0000 7f52daffd640 1 -- 172.21.15.105:0/3689107593 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f52d409b480 con 0x7f52d0004800 2024-09-21T03:18:41.168 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.137+0000 7f98abfff640 1 -- 172.21.15.105:0/653645573 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98a4005290 con 0x7f98c00df800 2024-09-21T03:18:41.168 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.137+0000 7f0566187640 1 --2- 172.21.15.105:0/105252640 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05600caee0 0x7f05600c93b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f055c0087b0 tx=0x7f055c008c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:41.169 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.138+0000 7f52e9836640 1 --2- 172.21.15.105:0/3689107593 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f52c8078b90 0x7f52c807b0a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f52e0001eb0 tx=0x7f52e003a040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:41.169 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.138+0000 7f98be7fc640 1 -- 172.21.15.105:0/653645573 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f98c4018020 con 0x7f98c00df800 2024-09-21T03:18:41.169 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.138+0000 7f98be7fc640 1 --2- 172.21.15.105:0/653645573 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f98ac078be0 0x7f98ac07b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:41.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.139+0000 7f5a52be6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a440d3770 0x7f5a440d2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:41.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.139+0000 7f5a52be6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a4404a3c0 0x7f5a440e0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:41.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.139+0000 7f5a52be6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a440e0c90 0x7f5a44033d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:41.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.139+0000 7f5a52be6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5a44007ff0 con 0x7f5a440e0c90 2024-09-21T03:18:41.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.139+0000 7f5a52be6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5a44007e70 con 0x7f5a440d3770 2024-09-21T03:18:41.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.139+0000 7f5a52be6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5a44008170 con 0x7f5a4404a3c0 2024-09-21T03:18:41.171 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.139+0000 7f98be7fc640 1 -- 172.21.15.105:0/653645573 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f98c409aa90 con 0x7f98c00df800 2024-09-21T03:18:41.171 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.139+0000 7f98cdcc7640 1 --2- 172.21.15.105:0/653645573 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f98ac078be0 0x7f98ac07b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:41.171 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.139+0000 7f5a50982640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a440d3770 0x7f5a440d2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:41.171 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.139+0000 7f5a4bfff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a4404a3c0 0x7f5a440e0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:41.171 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.139+0000 7f5a51183640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a440e0c90 0x7f5a44033d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:41.171 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.139+0000 7f5a50982640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a440d3770 0x7f5a440d2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.105:58354/0 (socket says 172.21.15.105:58354) 2024-09-21T03:18:41.171 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.139+0000 7f5a50982640 1 -- 172.21.15.105:0/805020669 learned_addr learned my addr 172.21.15.105:0/805020669 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:41.171 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.139+0000 7f5a51183640 1 -- 172.21.15.105:0/805020669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a4404a3c0 msgr2=0x7f5a440e0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.171 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.139+0000 7f5a51183640 1 --2- 172.21.15.105:0/805020669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a4404a3c0 0x7f5a440e0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.172 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.139+0000 7f5a51183640 1 -- 172.21.15.105:0/805020669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a440d3770 msgr2=0x7f5a440d2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.172 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.139+0000 7f5a51183640 1 --2- 172.21.15.105:0/805020669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a440d3770 0x7f5a440d2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.172 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.139+0000 7f5a51183640 1 -- 172.21.15.105:0/805020669 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a440dfcb0 con 0x7f5a440e0c90 2024-09-21T03:18:41.172 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.139+0000 7f98cdcc7640 1 --2- 172.21.15.105:0/653645573 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f98ac078be0 0x7f98ac07b0f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f98b8007fd0 tx=0x7f98b8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:41.172 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.139+0000 7f5a51183640 1 --2- 172.21.15.105:0/805020669 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a440e0c90 0x7f5a44033d20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c06ad50 tx=0x7f5a4c051660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:41.172 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.140+0000 7f9d24ff9640 1 -- 172.21.15.105:0/321150838 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9d20043060 con 0x7f9d28149290 2024-09-21T03:18:41.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.140+0000 7f5a497fa640 1 -- 172.21.15.105:0/805020669 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c063bd0 con 0x7f5a440e0c90 2024-09-21T03:18:41.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.140+0000 7f8c2a7fc640 1 -- 172.21.15.105:0/3066850217 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c24015020 con 0x7f8c200051a0 2024-09-21T03:18:41.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.140+0000 7f0556ffd640 1 -- 172.21.15.105:0/105252640 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c0098a0 con 0x7f05600caee0 2024-09-21T03:18:41.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.140+0000 7f8c3ae22640 1 -- 172.21.15.105:0/3066850217 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c341530a0 con 0x7f8c200051a0 2024-09-21T03:18:41.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.140+0000 7f8c3ae22640 1 -- 172.21.15.105:0/3066850217 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c34148030 con 0x7f8c200051a0 2024-09-21T03:18:41.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.140+0000 7f8c2a7fc640 1 -- 172.21.15.105:0/3066850217 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c24011920 con 0x7f8c200051a0 2024-09-21T03:18:41.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.140+0000 7f5a52be6640 1 -- 172.21.15.105:0/805020669 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a4404ad30 con 0x7f5a440e0c90 2024-09-21T03:18:41.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.141+0000 7f5a52be6640 1 -- 172.21.15.105:0/805020669 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a440e0230 con 0x7f5a440e0c90 2024-09-21T03:18:41.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.141+0000 7f5a497fa640 1 -- 172.21.15.105:0/805020669 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a4c063d70 con 0x7f5a440e0c90 2024-09-21T03:18:41.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.140+0000 7f05683eb640 1 -- 172.21.15.105:0/105252640 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0560157fa0 con 0x7f05600caee0 2024-09-21T03:18:41.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.140+0000 7f0556ffd640 1 -- 172.21.15.105:0/105252640 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f055c009a40 con 0x7f05600caee0 2024-09-21T03:18:41.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.140+0000 7f0556ffd640 1 -- 172.21.15.105:0/105252640 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c016450 con 0x7f05600caee0 2024-09-21T03:18:41.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.141+0000 7f05683eb640 1 -- 172.21.15.105:0/105252640 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05600c6240 con 0x7f05600caee0 2024-09-21T03:18:41.175 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.142+0000 7f05683eb640 1 -- 172.21.15.105:0/105252640 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05600ca9a0 con 0x7f05600caee0 2024-09-21T03:18:41.175 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.142+0000 7f5a497fa640 1 -- 172.21.15.105:0/805020669 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c0642a0 con 0x7f5a440e0c90 2024-09-21T03:18:41.175 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.142+0000 7f8c2a7fc640 1 -- 172.21.15.105:0/3066850217 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c24011d50 con 0x7f8c200051a0 2024-09-21T03:18:41.175 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.142+0000 7f8c17fff640 1 -- 172.21.15.105:0/3066850217 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c34148280 con 0x7f8c200051a0 2024-09-21T03:18:41.175 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.142+0000 7ff89cff9640 1 -- 172.21.15.105:0/3507745959 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8900035f0 con 0x7ff8a01f4360 2024-09-21T03:18:41.176 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.142+0000 7f52daffd640 1 -- 172.21.15.105:0/3689107593 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f52e40b1af0 con 0x7f52d0004800 2024-09-21T03:18:41.176 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.143+0000 7ff8a63eb640 1 -- 172.21.15.105:0/3507745959 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8a0073aa0 con 0x7ff8a01f4360 2024-09-21T03:18:41.176 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.143+0000 7ff8a63eb640 1 -- 172.21.15.105:0/3507745959 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8a0154c10 con 0x7ff8a01f4360 2024-09-21T03:18:41.176 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.143+0000 7f5a497fa640 1 -- 172.21.15.105:0/805020669 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5a4c064440 con 0x7f5a440e0c90 2024-09-21T03:18:41.176 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.143+0000 7f5a52be6640 1 -- 172.21.15.105:0/805020669 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a2c005290 con 0x7f5a440e0c90 2024-09-21T03:18:41.177 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.143+0000 7f8c2a7fc640 1 -- 172.21.15.105:0/3066850217 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8c24018020 con 0x7f8c200051a0 2024-09-21T03:18:41.177 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.144+0000 7f0556ffd640 1 -- 172.21.15.105:0/105252640 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f055c0165f0 con 0x7f05600caee0 2024-09-21T03:18:41.177 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.144+0000 7f8c2a7fc640 1 --2- 172.21.15.105:0/3066850217 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c18078b90 0x7f8c1807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:41.177 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.144+0000 7f5a497fa640 1 --2- 172.21.15.105:0/805020669 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5a38078b90 0x7f5a3807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:41.177 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.144+0000 7f5a497fa640 1 -- 172.21.15.105:0/805020669 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5a4c116650 con 0x7f5a440e0c90 2024-09-21T03:18:41.178 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.144+0000 7ff8a63eb640 1 -- 172.21.15.105:0/3507745959 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8a01f4cb0 con 0x7ff8a01f4360 2024-09-21T03:18:41.178 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.144+0000 7f8c2a7fc640 1 -- 172.21.15.105:0/3066850217 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f8c2409aa80 con 0x7f8c200051a0 2024-09-21T03:18:41.178 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.144+0000 7f0556ffd640 1 --2- 172.21.15.105:0/105252640 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0544078bc0 0x7f054407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:41.178 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.144+0000 7f8c3961f640 1 --2- 172.21.15.105:0/3066850217 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c18078b90 0x7f8c1807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:41.179 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.145+0000 7f0556ffd640 1 -- 172.21.15.105:0/105252640 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f055c09a6e0 con 0x7f05600caee0 2024-09-21T03:18:41.179 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.145+0000 7f0565986640 1 --2- 172.21.15.105:0/105252640 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0544078bc0 0x7f054407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:41.179 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.145+0000 7f5a50982640 1 --2- 172.21.15.105:0/805020669 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5a38078b90 0x7f5a3807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:41.179 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.145+0000 7f8c3961f640 1 --2- 172.21.15.105:0/3066850217 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c18078b90 0x7f8c1807b0a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c004fd0 tx=0x7f8c2c006040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:41.180 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.145+0000 7f5a50982640 1 --2- 172.21.15.105:0/805020669 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5a38078b90 0x7f5a3807b0a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5a400058c0 tx=0x7f5a4000b260 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:41.180 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.145+0000 7f0565986640 1 --2- 172.21.15.105:0/105252640 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0544078bc0 0x7f054407b0d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0550006fd0 tx=0x7f0550008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:41.180 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.147+0000 7ff89cff9640 1 -- 172.21.15.105:0/3507745959 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff890004240 con 0x7ff8a01f4360 2024-09-21T03:18:41.180 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.147+0000 7ff89cff9640 1 -- 172.21.15.105:0/3507745959 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff89004c060 con 0x7ff8a01f4360 2024-09-21T03:18:41.180 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.147+0000 7f47967fc640 1 -- 172.21.15.105:0/1162727985 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4790031d60 con 0x7f47a0162940 2024-09-21T03:18:41.181 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.147+0000 7f98be7fc640 1 -- 172.21.15.105:0/653645573 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f98c401f020 con 0x7f98c00df800 2024-09-21T03:18:41.181 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.148+0000 7f47967fc640 1 -- 172.21.15.105:0/1162727985 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4790033e20 con 0x7f47a0162940 2024-09-21T03:18:41.181 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.148+0000 7f47967fc640 1 -- 172.21.15.105:0/1162727985 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4790005260 con 0x7f47a0162940 2024-09-21T03:18:41.181 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.148+0000 7f47a7dcc640 1 -- 172.21.15.105:0/1162727985 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47a0147060 con 0x7f47a0162940 2024-09-21T03:18:41.181 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.148+0000 7f47a7dcc640 1 -- 172.21.15.105:0/1162727985 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47a0147620 con 0x7f47a0162940 2024-09-21T03:18:41.182 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.149+0000 7f47a7dcc640 1 -- 172.21.15.105:0/1162727985 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47a00ce940 con 0x7f47a0162940 2024-09-21T03:18:41.182 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.149+0000 7f0556ffd640 1 -- 172.21.15.105:0/105252640 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f055c062b00 con 0x7f05600caee0 2024-09-21T03:18:41.182 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.150+0000 7ff89cff9640 1 -- 172.21.15.105:0/3507745959 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff890003790 con 0x7ff8a01f4360 2024-09-21T03:18:41.182 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.150+0000 7ff89cff9640 1 --2- 172.21.15.105:0/3507745959 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff88c078b90 0x7ff88c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:41.182 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.150+0000 7ff89cff9640 1 -- 172.21.15.105:0/3507745959 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff8900bbc00 con 0x7ff8a01f4360 2024-09-21T03:18:41.182 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.151+0000 7ff89ffff640 1 --2- 172.21.15.105:0/3507745959 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff88c078b90 0x7ff88c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:41.182 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.151+0000 7ff89ffff640 1 --2- 172.21.15.105:0/3507745959 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff88c078b90 0x7ff88c07b0a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff898006670 tx=0x7ff898006ef0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:41.183 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.153+0000 7ff89cff9640 1 -- 172.21.15.105:0/3507745959 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff8a01f4cb0 con 0x7ff8a01f4360 2024-09-21T03:18:41.183 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.155+0000 7f8c2a7fc640 1 -- 172.21.15.105:0/3066850217 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8c2401f020 con 0x7f8c200051a0 2024-09-21T03:18:41.183 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.157+0000 7f47967fc640 1 -- 172.21.15.105:0/1162727985 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4790005400 con 0x7f47a0162940 2024-09-21T03:18:41.183 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.158+0000 7f47967fc640 1 --2- 172.21.15.105:0/1162727985 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4784078c90 0x7f478407b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:41.183 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.158+0000 7f47967fc640 1 -- 172.21.15.105:0/1162727985 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f47900bc160 con 0x7f47a0162940 2024-09-21T03:18:41.183 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.159+0000 7f47967fc640 1 -- 172.21.15.105:0/1162727985 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f479003f030 con 0x7f47a0162940 2024-09-21T03:18:41.183 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.161+0000 7f47a5b68640 1 --2- 172.21.15.105:0/1162727985 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4784078c90 0x7f478407b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:41.184 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.161+0000 7f5a497fa640 1 -- 172.21.15.105:0/805020669 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5a4c09c060 con 0x7f5a440e0c90 2024-09-21T03:18:41.184 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.169+0000 7f47a5b68640 1 --2- 172.21.15.105:0/1162727985 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4784078c90 0x7f478407b1a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f47a0072750 tx=0x7f4798009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:41.562 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.560+0000 7f9d0e7fc640 1 -- 172.21.15.105:0/321150838 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f9d08005580 con 0x7f9d28149290 2024-09-21T03:18:41.562 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.561+0000 7f9d24ff9640 1 -- 172.21.15.105:0/321150838 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9d20082c40 con 0x7f9d28149290 2024-09-21T03:18:41.563 INFO:teuthology.orchestra.run.smithi105.stdout:64424509448 2024-09-21T03:18:41.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.565+0000 7f9d0e7fc640 1 -- 172.21.15.105:0/321150838 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9d14078c90 msgr2=0x7f9d1407b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.565+0000 7f9d0e7fc640 1 --2- 172.21.15.105:0/321150838 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9d14078c90 0x7f9d1407b1a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9d18004650 tx=0x7f9d18005f90 comp rx=0 tx=0).stop 2024-09-21T03:18:41.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.565+0000 7f9d0e7fc640 1 -- 172.21.15.105:0/321150838 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d28149290 msgr2=0x7f9d2815dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.565+0000 7f52ec29b640 1 -- 172.21.15.105:0/3689107593 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f52cc005580 con 0x7f52d0004800 2024-09-21T03:18:41.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.565+0000 7f9d0e7fc640 1 --2- 172.21.15.105:0/321150838 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d28149290 0x7f9d2815dd30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9d1000c1b0 tx=0x7f9d20004bb0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.565+0000 7f9d0e7fc640 1 -- 172.21.15.105:0/321150838 shutdown_connections 2024-09-21T03:18:41.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.565+0000 7f9d0e7fc640 1 --2- 172.21.15.105:0/321150838 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9d14078c90 0x7f9d1407b1a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.565+0000 7f9d0e7fc640 1 --2- 172.21.15.105:0/321150838 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d28149290 0x7f9d2815dd30 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.565+0000 7f9d0e7fc640 1 --2- 172.21.15.105:0/321150838 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d28148e80 0x7f9d2815d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.565+0000 7f9d0e7fc640 1 --2- 172.21.15.105:0/321150838 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d10005150 0x7f9d280b32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.565+0000 7f9d0e7fc640 1 -- 172.21.15.105:0/321150838 >> 172.21.15.105:0/321150838 conn(0x7f9d28074170 msgr2=0x7f9d280b41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:41.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.565+0000 7f52daffd640 1 -- 172.21.15.105:0/3689107593 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f52d4068e20 con 0x7f52d0004800 2024-09-21T03:18:41.569 INFO:teuthology.orchestra.run.smithi105.stdout:64424509447 2024-09-21T03:18:41.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.565+0000 7f9d0e7fc640 1 -- 172.21.15.105:0/321150838 shutdown_connections 2024-09-21T03:18:41.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.565+0000 7f9d0e7fc640 1 -- 172.21.15.105:0/321150838 wait complete. 2024-09-21T03:18:41.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.569+0000 7f52d8f39640 1 -- 172.21.15.105:0/3689107593 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f52c8078b90 msgr2=0x7f52c807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.570+0000 7f52d8f39640 1 --2- 172.21.15.105:0/3689107593 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f52c8078b90 0x7f52c807b0a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f52e0001eb0 tx=0x7f52e003a040 comp rx=0 tx=0).stop 2024-09-21T03:18:41.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.570+0000 7f52d8f39640 1 -- 172.21.15.105:0/3689107593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52d0004800 msgr2=0x7f52e413e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.570+0000 7f52d8f39640 1 --2- 172.21.15.105:0/3689107593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52d0004800 0x7f52e413e9e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f52d400e620 tx=0x7f52d400eae0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.570+0000 7f52d8f39640 1 -- 172.21.15.105:0/3689107593 shutdown_connections 2024-09-21T03:18:41.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.570+0000 7f52d8f39640 1 --2- 172.21.15.105:0/3689107593 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f52c8078b90 0x7f52c807b0a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.570+0000 7f52d8f39640 1 --2- 172.21.15.105:0/3689107593 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52e40b16e0 0x7f52e40b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.570+0000 7f52d8f39640 1 --2- 172.21.15.105:0/3689107593 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52e413c580 0x7f52e40b11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.570+0000 7f52d8f39640 1 --2- 172.21.15.105:0/3689107593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52d0004800 0x7f52e413e9e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.570+0000 7f52d8f39640 1 -- 172.21.15.105:0/3689107593 >> 172.21.15.105:0/3689107593 conn(0x7f52e406d4a0 msgr2=0x7f52e4144120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:41.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.570+0000 7f52d8f39640 1 -- 172.21.15.105:0/3689107593 shutdown_connections 2024-09-21T03:18:41.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.571+0000 7f52d8f39640 1 -- 172.21.15.105:0/3689107593 wait complete. 2024-09-21T03:18:41.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.575+0000 7f98abfff640 1 -- 172.21.15.105:0/653645573 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f98a4005850 con 0x7f98c00df800 2024-09-21T03:18:41.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.575+0000 7ff8a63eb640 1 -- 172.21.15.105:0/3507745959 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7ff8a009dda0 con 0x7ff8a01f4360 2024-09-21T03:18:41.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.576+0000 7f98be7fc640 1 -- 172.21.15.105:0/653645573 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f98c00dd6b0 con 0x7f98c00df800 2024-09-21T03:18:41.578 INFO:teuthology.orchestra.run.smithi105.stdout:64424509447 2024-09-21T03:18:41.578 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.576+0000 7ff89cff9640 1 -- 172.21.15.105:0/3507745959 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff890083930 con 0x7ff8a01f4360 2024-09-21T03:18:41.579 INFO:teuthology.orchestra.run.smithi105.stdout:64424509449 2024-09-21T03:18:41.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.580+0000 7f98abfff640 1 -- 172.21.15.105:0/653645573 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f98ac078be0 msgr2=0x7f98ac07b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.580+0000 7f98abfff640 1 --2- 172.21.15.105:0/653645573 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f98ac078be0 0x7f98ac07b0f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f98b8007fd0 tx=0x7f98b8009040 comp rx=0 tx=0).stop 2024-09-21T03:18:41.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.580+0000 7f98abfff640 1 -- 172.21.15.105:0/653645573 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98c00df800 msgr2=0x7f98c00d9250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.580+0000 7f98abfff640 1 --2- 172.21.15.105:0/653645573 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98c00df800 0x7f98c00d9250 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f98c000e3b0 tx=0x7f98c400b870 comp rx=0 tx=0).stop 2024-09-21T03:18:41.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.580+0000 7f98abfff640 1 -- 172.21.15.105:0/653645573 shutdown_connections 2024-09-21T03:18:41.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.580+0000 7f98abfff640 1 --2- 172.21.15.105:0/653645573 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f98ac078be0 0x7f98ac07b0f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.580+0000 7f98abfff640 1 --2- 172.21.15.105:0/653645573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f98c00dcd60 0x7f98c00dd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.580+0000 7f98abfff640 1 --2- 172.21.15.105:0/653645573 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98c00df800 0x7f98c00d9250 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.580+0000 7f98abfff640 1 --2- 172.21.15.105:0/653645573 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98c0053710 0x7f98c0176160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.580+0000 7f98abfff640 1 -- 172.21.15.105:0/653645573 >> 172.21.15.105:0/653645573 conn(0x7f98c001e260 msgr2=0x7f98c0051bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:41.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.580+0000 7f98abfff640 1 -- 172.21.15.105:0/653645573 shutdown_connections 2024-09-21T03:18:41.583 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.580+0000 7ff8a63eb640 1 -- 172.21.15.105:0/3507745959 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff88c078b90 msgr2=0x7ff88c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.583 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.580+0000 7ff8a63eb640 1 --2- 172.21.15.105:0/3507745959 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff88c078b90 0x7ff88c07b0a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff898006670 tx=0x7ff898006ef0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.583 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.580+0000 7ff8a63eb640 1 -- 172.21.15.105:0/3507745959 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8a01f4360 msgr2=0x7ff8a01f4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.583 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.580+0000 7ff8a63eb640 1 --2- 172.21.15.105:0/3507745959 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8a01f4360 0x7ff8a01f4770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff8a00cb980 tx=0x7ff890005f10 comp rx=0 tx=0).stop 2024-09-21T03:18:41.583 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.580+0000 7ff8a63eb640 1 -- 172.21.15.105:0/3507745959 shutdown_connections 2024-09-21T03:18:41.583 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.580+0000 7f98abfff640 1 -- 172.21.15.105:0/653645573 wait complete. 2024-09-21T03:18:41.584 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.580+0000 7ff8a63eb640 1 --2- 172.21.15.105:0/3507745959 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff88c078b90 0x7ff88c07b0a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.584 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.580+0000 7ff8a63eb640 1 --2- 172.21.15.105:0/3507745959 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8a01f4360 0x7ff8a01f4770 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.584 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.580+0000 7ff8a63eb640 1 --2- 172.21.15.105:0/3507745959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8a01544f0 0x7ff8a01f3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.584 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.580+0000 7ff8a63eb640 1 --2- 172.21.15.105:0/3507745959 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff888005350 0x7ff8a0153ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.584 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.580+0000 7ff8a63eb640 1 -- 172.21.15.105:0/3507745959 >> 172.21.15.105:0/3507745959 conn(0x7ff8a00b20a0 msgr2=0x7ff8a00b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:41.584 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.580+0000 7ff8a63eb640 1 -- 172.21.15.105:0/3507745959 shutdown_connections 2024-09-21T03:18:41.584 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.580+0000 7ff8a63eb640 1 -- 172.21.15.105:0/3507745959 wait complete. 2024-09-21T03:18:41.585 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.581+0000 7f8c17fff640 1 -- 172.21.15.105:0/3066850217 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f8c3415b8c0 con 0x7f8c200051a0 2024-09-21T03:18:41.586 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.6 2024-09-21T03:18:41.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.582+0000 7f8c2a7fc640 1 -- 172.21.15.105:0/3066850217 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8c240628f0 con 0x7f8c200051a0 2024-09-21T03:18:41.586 INFO:teuthology.orchestra.run.smithi105.stdout:55834574855 2024-09-21T03:18:41.586 DEBUG:teuthology.parallel:result is None 2024-09-21T03:18:41.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.586+0000 7f8c17fff640 1 -- 172.21.15.105:0/3066850217 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c18078b90 msgr2=0x7f8c1807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.586+0000 7f8c17fff640 1 --2- 172.21.15.105:0/3066850217 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c18078b90 0x7f8c1807b0a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c004fd0 tx=0x7f8c2c006040 comp rx=0 tx=0).stop 2024-09-21T03:18:41.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.586+0000 7f8c17fff640 1 -- 172.21.15.105:0/3066850217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c200051a0 msgr2=0x7f8c3415cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.586+0000 7f8c17fff640 1 --2- 172.21.15.105:0/3066850217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c200051a0 0x7f8c3415cb20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8c2400b410 tx=0x7f8c2400b8d0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.586+0000 7f8c17fff640 1 -- 172.21.15.105:0/3066850217 shutdown_connections 2024-09-21T03:18:41.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.586+0000 7f8c17fff640 1 --2- 172.21.15.105:0/3066850217 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c18078b90 0x7f8c1807b0a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.586+0000 7f8c17fff640 1 --2- 172.21.15.105:0/3066850217 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c3414b330 0x7f8c3414dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.586+0000 7f8c17fff640 1 --2- 172.21.15.105:0/3066850217 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c341479a0 0x7f8c3415d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.586+0000 7f8c17fff640 1 --2- 172.21.15.105:0/3066850217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c200051a0 0x7f8c3415cb20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.586+0000 7f8c17fff640 1 -- 172.21.15.105:0/3066850217 >> 172.21.15.105:0/3066850217 conn(0x7f8c3406d410 msgr2=0x7f8c3406f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:41.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.586+0000 7f5a52be6640 1 -- 172.21.15.105:0/805020669 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f5a2c005580 con 0x7f5a440e0c90 2024-09-21T03:18:41.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.586+0000 7f8c17fff640 1 -- 172.21.15.105:0/3066850217 shutdown_connections 2024-09-21T03:18:41.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.587+0000 7f8c17fff640 1 -- 172.21.15.105:0/3066850217 wait complete. 2024-09-21T03:18:41.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.587+0000 7f5a497fa640 1 -- 172.21.15.105:0/805020669 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5a4c0de430 con 0x7f5a440e0c90 2024-09-21T03:18:41.591 INFO:teuthology.orchestra.run.smithi105.stdout:64424509448 2024-09-21T03:18:41.591 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.588+0000 7f47a7dcc640 1 -- 172.21.15.105:0/1162727985 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f47a0162680 con 0x7f47a0162940 2024-09-21T03:18:41.591 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.588+0000 7f47967fc640 1 -- 172.21.15.105:0/1162727985 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4790083fc0 con 0x7f47a0162940 2024-09-21T03:18:41.591 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.589+0000 7f05683eb640 1 -- 172.21.15.105:0/105252640 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f0560074c10 con 0x7f05600caee0 2024-09-21T03:18:41.592 INFO:teuthology.orchestra.run.smithi105.stdout:64424509448 2024-09-21T03:18:41.592 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.590+0000 7f0556ffd640 1 -- 172.21.15.105:0/105252640 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f055c062400 con 0x7f05600caee0 2024-09-21T03:18:41.592 INFO:teuthology.orchestra.run.smithi105.stdout:64424509448 2024-09-21T03:18:41.593 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.590+0000 7f5a52be6640 1 -- 172.21.15.105:0/805020669 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5a38078b90 msgr2=0x7f5a3807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.593 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.590+0000 7f5a52be6640 1 --2- 172.21.15.105:0/805020669 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5a38078b90 0x7f5a3807b0a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5a400058c0 tx=0x7f5a4000b260 comp rx=0 tx=0).stop 2024-09-21T03:18:41.593 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.590+0000 7f5a52be6640 1 -- 172.21.15.105:0/805020669 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a440e0c90 msgr2=0x7f5a44033d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.593 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.590+0000 7f5a52be6640 1 --2- 172.21.15.105:0/805020669 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a440e0c90 0x7f5a44033d20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c06ad50 tx=0x7f5a4c051660 comp rx=0 tx=0).stop 2024-09-21T03:18:41.594 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.5 2024-09-21T03:18:41.594 DEBUG:teuthology.parallel:result is None 2024-09-21T03:18:41.595 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.592+0000 7f5a52be6640 1 -- 172.21.15.105:0/805020669 shutdown_connections 2024-09-21T03:18:41.595 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.592+0000 7f5a52be6640 1 --2- 172.21.15.105:0/805020669 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5a38078b90 0x7f5a3807b0a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.595 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.592+0000 7f5a52be6640 1 --2- 172.21.15.105:0/805020669 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a440e0c90 0x7f5a44033d20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.595 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.592+0000 7f5a52be6640 1 --2- 172.21.15.105:0/805020669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a4404a3c0 0x7f5a440e0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.595 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.592+0000 7f5a52be6640 1 --2- 172.21.15.105:0/805020669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a440d3770 0x7f5a440d2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.595 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.592+0000 7f5a52be6640 1 -- 172.21.15.105:0/805020669 >> 172.21.15.105:0/805020669 conn(0x7f5a4401e260 msgr2=0x7f5a44050f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:41.595 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.592+0000 7f5a52be6640 1 -- 172.21.15.105:0/805020669 shutdown_connections 2024-09-21T03:18:41.595 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.592+0000 7f5a52be6640 1 -- 172.21.15.105:0/805020669 wait complete. 2024-09-21T03:18:41.597 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.592+0000 7f47a7dcc640 1 -- 172.21.15.105:0/1162727985 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4784078c90 msgr2=0x7f478407b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.597 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.592+0000 7f47a7dcc640 1 --2- 172.21.15.105:0/1162727985 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4784078c90 0x7f478407b1a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f47a0072750 tx=0x7f4798009040 comp rx=0 tx=0).stop 2024-09-21T03:18:41.597 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.593+0000 7f47a7dcc640 1 -- 172.21.15.105:0/1162727985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47a0162940 msgr2=0x7f47a0205ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.597 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.593+0000 7f47a7dcc640 1 --2- 172.21.15.105:0/1162727985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47a0162940 0x7f47a0205ee0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4790031000 tx=0x7f4790033bf0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.597 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.593+0000 7f47a7dcc640 1 -- 172.21.15.105:0/1162727985 shutdown_connections 2024-09-21T03:18:41.597 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.593+0000 7f47a7dcc640 1 --2- 172.21.15.105:0/1162727985 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4784078c90 0x7f478407b1a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.597 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.593+0000 7f47a7dcc640 1 --2- 172.21.15.105:0/1162727985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47a0162940 0x7f47a0205ee0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.597 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.593+0000 7f47a7dcc640 1 --2- 172.21.15.105:0/1162727985 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47a00ce530 0x7f47a02059a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.597 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.593+0000 7f47a7dcc640 1 --2- 172.21.15.105:0/1162727985 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47a00cb630 0x7f47a01446b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.597 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.593+0000 7f47a7dcc640 1 -- 172.21.15.105:0/1162727985 >> 172.21.15.105:0/1162727985 conn(0x7f47a006d870 msgr2=0x7f47a0073cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:41.597 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.593+0000 7f47a7dcc640 1 -- 172.21.15.105:0/1162727985 shutdown_connections 2024-09-21T03:18:41.597 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.593+0000 7f47a7dcc640 1 -- 172.21.15.105:0/1162727985 wait complete. 2024-09-21T03:18:41.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.593+0000 7f05683eb640 1 -- 172.21.15.105:0/105252640 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0544078bc0 msgr2=0x7f054407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.593+0000 7f05683eb640 1 --2- 172.21.15.105:0/105252640 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0544078bc0 0x7f054407b0d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0550006fd0 tx=0x7f0550008040 comp rx=0 tx=0).stop 2024-09-21T03:18:41.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.593+0000 7f05683eb640 1 -- 172.21.15.105:0/105252640 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05600caee0 msgr2=0x7f05600c93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.593+0000 7f05683eb640 1 --2- 172.21.15.105:0/105252640 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05600caee0 0x7f05600c93b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f055c0087b0 tx=0x7f055c008c70 comp rx=0 tx=0).stop 2024-09-21T03:18:41.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.594+0000 7f05683eb640 1 -- 172.21.15.105:0/105252640 shutdown_connections 2024-09-21T03:18:41.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.594+0000 7f05683eb640 1 --2- 172.21.15.105:0/105252640 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0544078bc0 0x7f054407b0d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.594+0000 7f05683eb640 1 --2- 172.21.15.105:0/105252640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f056015bf20 0x7f056015ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.594+0000 7f05683eb640 1 --2- 172.21.15.105:0/105252640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05600cfb00 0x7f0560157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.594+0000 7f05683eb640 1 --2- 172.21.15.105:0/105252640 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05600caee0 0x7f05600c93b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.594+0000 7f05683eb640 1 -- 172.21.15.105:0/105252640 >> 172.21.15.105:0/105252640 conn(0x7f05600b1cb0 msgr2=0x7f05600adc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:41.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.594+0000 7f05683eb640 1 -- 172.21.15.105:0/105252640 shutdown_connections 2024-09-21T03:18:41.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.594+0000 7f05683eb640 1 -- 172.21.15.105:0/105252640 wait complete. 2024-09-21T03:18:41.601 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.7 2024-09-21T03:18:41.602 DEBUG:teuthology.parallel:result is None 2024-09-21T03:18:41.602 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.4 2024-09-21T03:18:41.602 DEBUG:teuthology.parallel:result is None 2024-09-21T03:18:41.610 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.2 2024-09-21T03:18:41.611 DEBUG:teuthology.parallel:result is None 2024-09-21T03:18:41.611 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2024-09-21T03:18:41.612 DEBUG:teuthology.parallel:result is None 2024-09-21T03:18:41.612 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.1 2024-09-21T03:18:41.612 DEBUG:teuthology.parallel:result is None 2024-09-21T03:18:41.613 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.3 2024-09-21T03:18:41.613 DEBUG:teuthology.parallel:result is None 2024-09-21T03:18:41.613 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T03:18:41.613 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:18:41.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.763+0000 7f64ce85c640 1 -- 172.21.15.105:0/1807009595 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64c806e3c0 msgr2=0x7f64c80cfb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.763+0000 7f64ce85c640 1 --2- 172.21.15.105:0/1807009595 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64c806e3c0 0x7f64c80cfb70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f64bc009830 tx=0x7f64bc02a510 comp rx=0 tx=0).stop 2024-09-21T03:18:41.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.763+0000 7f64ce85c640 1 -- 172.21.15.105:0/1807009595 shutdown_connections 2024-09-21T03:18:41.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.763+0000 7f64ce85c640 1 --2- 172.21.15.105:0/1807009595 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64c806e3c0 0x7f64c80cfb70 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.763+0000 7f64ce85c640 1 -- 172.21.15.105:0/1807009595 >> 172.21.15.105:0/1807009595 conn(0x7f64c808bfc0 msgr2=0x7f64c809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:41.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.763+0000 7f64ce85c640 1 -- 172.21.15.105:0/1807009595 shutdown_connections 2024-09-21T03:18:41.766 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.763+0000 7f64ce85c640 1 -- 172.21.15.105:0/1807009595 wait complete. 2024-09-21T03:18:41.766 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.765+0000 7f64ce85c640 1 Processor -- start 2024-09-21T03:18:41.766 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.765+0000 7f64ce85c640 1 -- start start 2024-09-21T03:18:41.769 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.766+0000 7f64ce85c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64c806e3c0 0x7f64c806f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:41.769 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.766+0000 7f64ce85c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64c80b3a60 0x7f64c815bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:41.769 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.766+0000 7f64ce85c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64c80d0e10 0x7f64c80b57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:41.769 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.766+0000 7f64ce85c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f64c80d2e60 con 0x7f64c80b3a60 2024-09-21T03:18:41.769 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.766+0000 7f64ce85c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f64c80d2ce0 con 0x7f64c806e3c0 2024-09-21T03:18:41.769 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.766+0000 7f64ce85c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f64c80d2fe0 con 0x7f64c80d0e10 2024-09-21T03:18:41.770 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.766+0000 7f64c77fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64c80b3a60 0x7f64c815bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:41.770 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.766+0000 7f64c77fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64c80b3a60 0x7f64c815bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40684/0 (socket says 172.21.15.105:40684) 2024-09-21T03:18:41.770 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.766+0000 7f64c77fe640 1 -- 172.21.15.105:0/3042173257 learned_addr learned my addr 172.21.15.105:0/3042173257 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:41.770 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.767+0000 7f64ccdf9640 1 --2- 172.21.15.105:0/3042173257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64c80d0e10 0x7f64c80b57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:41.770 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.767+0000 7f64c7fff640 1 --2- 172.21.15.105:0/3042173257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64c806e3c0 0x7f64c806f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:41.770 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.767+0000 7f64c77fe640 1 -- 172.21.15.105:0/3042173257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64c80d0e10 msgr2=0x7f64c80b57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.770 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.767+0000 7f64c77fe640 1 --2- 172.21.15.105:0/3042173257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64c80d0e10 0x7f64c80b57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.770 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.767+0000 7f64c77fe640 1 -- 172.21.15.105:0/3042173257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64c806e3c0 msgr2=0x7f64c806f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.770 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.767+0000 7f64c77fe640 1 --2- 172.21.15.105:0/3042173257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64c806e3c0 0x7f64c806f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.770 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.767+0000 7f64c77fe640 1 -- 172.21.15.105:0/3042173257 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64c80b3f60 con 0x7f64c80b3a60 2024-09-21T03:18:41.770 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.767+0000 7f64ccdf9640 1 --2- 172.21.15.105:0/3042173257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64c80d0e10 0x7f64c80b57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:18:41.770 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.767+0000 7f64c77fe640 1 --2- 172.21.15.105:0/3042173257 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64c80b3a60 0x7f64c815bf80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f64bc009950 tx=0x7f64bc033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:41.771 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.767+0000 7f64c4ff9640 1 -- 172.21.15.105:0/3042173257 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64bc031d60 con 0x7f64c80b3a60 2024-09-21T03:18:41.771 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.767+0000 7f64c4ff9640 1 -- 172.21.15.105:0/3042173257 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f64bc0330d0 con 0x7f64c80b3a60 2024-09-21T03:18:41.771 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.767+0000 7f64ce85c640 1 -- 172.21.15.105:0/3042173257 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64c815c4c0 con 0x7f64c80b3a60 2024-09-21T03:18:41.771 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.767+0000 7f64c4ff9640 1 -- 172.21.15.105:0/3042173257 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64bc033520 con 0x7f64c80b3a60 2024-09-21T03:18:41.771 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.767+0000 7f64ce85c640 1 -- 172.21.15.105:0/3042173257 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64c80b4220 con 0x7f64c80b3a60 2024-09-21T03:18:41.772 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.768+0000 7f64ce85c640 1 -- 172.21.15.105:0/3042173257 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64c80cfb70 con 0x7f64c80b3a60 2024-09-21T03:18:41.772 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.769+0000 7f64c4ff9640 1 -- 172.21.15.105:0/3042173257 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f64bc0035f0 con 0x7f64c80b3a60 2024-09-21T03:18:41.772 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.769+0000 7f64c4ff9640 1 --2- 172.21.15.105:0/3042173257 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f64b4078b90 0x7f64b407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:41.772 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.769+0000 7f64c4ff9640 1 -- 172.21.15.105:0/3042173257 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f64bc0bc2f0 con 0x7f64c80b3a60 2024-09-21T03:18:41.772 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.770+0000 7f64c7fff640 1 --2- 172.21.15.105:0/3042173257 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f64b4078b90 0x7f64b407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:41.772 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.770+0000 7f64c7fff640 1 --2- 172.21.15.105:0/3042173257 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f64b4078b90 0x7f64b407b0a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f64b8006fd0 tx=0x7f64b8009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:41.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.774+0000 7f64c4ff9640 1 -- 172.21.15.105:0/3042173257 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f64bc03f030 con 0x7f64c80b3a60 2024-09-21T03:18:41.948 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.947+0000 7f64ce85c640 1 -- 172.21.15.105:0/3042173257 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f64c815edb0 con 0x7f64b4078b90 2024-09-21T03:18:41.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.951+0000 7f64c4ff9640 1 -- 172.21.15.105:0/3042173257 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251826 (secure 0 0 0) 0x7f64c815edb0 con 0x7f64b4078b90 2024-09-21T03:18:41.956 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:18:41.958 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:18:41.960 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.954+0000 7f64ce85c640 1 -- 172.21.15.105:0/3042173257 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f64b4078b90 msgr2=0x7f64b407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.960 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.954+0000 7f64ce85c640 1 --2- 172.21.15.105:0/3042173257 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f64b4078b90 0x7f64b407b0a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f64b8006fd0 tx=0x7f64b8009060 comp rx=0 tx=0).stop 2024-09-21T03:18:41.960 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.955+0000 7f64ce85c640 1 -- 172.21.15.105:0/3042173257 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64c80b3a60 msgr2=0x7f64c815bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:41.960 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.955+0000 7f64ce85c640 1 --2- 172.21.15.105:0/3042173257 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64c80b3a60 0x7f64c815bf80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f64bc009950 tx=0x7f64bc033d60 comp rx=0 tx=0).stop 2024-09-21T03:18:41.960 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.955+0000 7f64ce85c640 1 -- 172.21.15.105:0/3042173257 shutdown_connections 2024-09-21T03:18:41.960 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.955+0000 7f64ce85c640 1 --2- 172.21.15.105:0/3042173257 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f64b4078b90 0x7f64b407b0a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.961 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.955+0000 7f64ce85c640 1 --2- 172.21.15.105:0/3042173257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64c80d0e10 0x7f64c80b57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.961 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.955+0000 7f64ce85c640 1 --2- 172.21.15.105:0/3042173257 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64c80b3a60 0x7f64c815bf80 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.961 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.955+0000 7f64ce85c640 1 --2- 172.21.15.105:0/3042173257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64c806e3c0 0x7f64c806f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:41.961 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.955+0000 7f64ce85c640 1 -- 172.21.15.105:0/3042173257 >> 172.21.15.105:0/3042173257 conn(0x7f64c808bfc0 msgr2=0x7f64c80d4b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:41.961 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.955+0000 7f64ce85c640 1 -- 172.21.15.105:0/3042173257 shutdown_connections 2024-09-21T03:18:41.961 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:41.955+0000 7f64ce85c640 1 -- 172.21.15.105:0/3042173257 wait complete. 2024-09-21T03:18:41.967 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-09-21T03:18:41.281526+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219288,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755432,"statfs":{"total":773094113280,"available":772869562368,"internally_reserved":0,"allocated":3121152,"data_stored":1835436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002774"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964347+0000","last_change":"2024-09-21T03:18:30.421775+0000","last_active":"2024-09-21T03:18:31.964347+0000","last_peered":"2024-09-21T03:18:31.964347+0000","last_clean":"2024-09-21T03:18:31.964347+0000","last_became_active":"2024-09-21T03:18:30.421134+0000","last_became_peered":"2024-09-21T03:18:30.421134+0000","last_unstale":"2024-09-21T03:18:31.964347+0000","last_undegraded":"2024-09-21T03:18:31.964347+0000","last_fullsized":"2024-09-21T03:18:31.964347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:22:19.398695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963048+0000","last_change":"2024-09-21T03:18:30.413336+0000","last_active":"2024-09-21T03:18:31.963048+0000","last_peered":"2024-09-21T03:18:31.963048+0000","last_clean":"2024-09-21T03:18:31.963048+0000","last_became_active":"2024-09-21T03:18:30.412935+0000","last_became_peered":"2024-09-21T03:18:30.412935+0000","last_unstale":"2024-09-21T03:18:31.963048+0000","last_undegraded":"2024-09-21T03:18:31.963048+0000","last_fullsized":"2024-09-21T03:18:31.963048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:23.469160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963279+0000","last_change":"2024-09-21T03:18:30.406431+0000","last_active":"2024-09-21T03:18:31.963279+0000","last_peered":"2024-09-21T03:18:31.963279+0000","last_clean":"2024-09-21T03:18:31.963279+0000","last_became_active":"2024-09-21T03:18:30.406082+0000","last_became_peered":"2024-09-21T03:18:30.406082+0000","last_unstale":"2024-09-21T03:18:31.963279+0000","last_undegraded":"2024-09-21T03:18:31.963279+0000","last_fullsized":"2024-09-21T03:18:31.963279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:40.341066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964108+0000","last_change":"2024-09-21T03:18:30.420362+0000","last_active":"2024-09-21T03:18:31.964108+0000","last_peered":"2024-09-21T03:18:31.964108+0000","last_clean":"2024-09-21T03:18:31.964108+0000","last_became_active":"2024-09-21T03:18:30.420008+0000","last_became_peered":"2024-09-21T03:18:30.420008+0000","last_unstale":"2024-09-21T03:18:31.964108+0000","last_undegraded":"2024-09-21T03:18:31.964108+0000","last_fullsized":"2024-09-21T03:18:31.964108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:03.282327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964438+0000","last_change":"2024-09-21T03:18:30.418302+0000","last_active":"2024-09-21T03:18:31.964438+0000","last_peered":"2024-09-21T03:18:31.964438+0000","last_clean":"2024-09-21T03:18:31.964438+0000","last_became_active":"2024-09-21T03:18:30.413965+0000","last_became_peered":"2024-09-21T03:18:30.413965+0000","last_unstale":"2024-09-21T03:18:31.964438+0000","last_undegraded":"2024-09-21T03:18:31.964438+0000","last_fullsized":"2024-09-21T03:18:31.964438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:03.282327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963716+0000","last_change":"2024-09-21T03:18:30.417641+0000","last_active":"2024-09-21T03:18:31.963716+0000","last_peered":"2024-09-21T03:18:31.963716+0000","last_clean":"2024-09-21T03:18:31.963716+0000","last_became_active":"2024-09-21T03:18:30.417338+0000","last_became_peered":"2024-09-21T03:18:30.417338+0000","last_unstale":"2024-09-21T03:18:31.963716+0000","last_undegraded":"2024-09-21T03:18:31.963716+0000","last_fullsized":"2024-09-21T03:18:31.963716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:23.551826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963715+0000","last_change":"2024-09-21T03:18:30.420816+0000","last_active":"2024-09-21T03:18:31.963715+0000","last_peered":"2024-09-21T03:18:31.963715+0000","last_clean":"2024-09-21T03:18:31.963715+0000","last_became_active":"2024-09-21T03:18:30.419232+0000","last_became_peered":"2024-09-21T03:18:30.419232+0000","last_unstale":"2024-09-21T03:18:31.963715+0000","last_undegraded":"2024-09-21T03:18:31.963715+0000","last_fullsized":"2024-09-21T03:18:31.963715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:42.098569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406163+0000","last_change":"2024-09-21T03:18:30.412879+0000","last_active":"2024-09-21T03:18:31.406163+0000","last_peered":"2024-09-21T03:18:31.406163+0000","last_clean":"2024-09-21T03:18:31.406163+0000","last_became_active":"2024-09-21T03:18:30.412496+0000","last_became_peered":"2024-09-21T03:18:30.412496+0000","last_unstale":"2024-09-21T03:18:31.406163+0000","last_undegraded":"2024-09-21T03:18:31.406163+0000","last_fullsized":"2024-09-21T03:18:31.406163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:27.777960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964687+0000","last_change":"2024-09-21T03:18:30.421800+0000","last_active":"2024-09-21T03:18:31.964687+0000","last_peered":"2024-09-21T03:18:31.964687+0000","last_clean":"2024-09-21T03:18:31.964687+0000","last_became_active":"2024-09-21T03:18:30.421488+0000","last_became_peered":"2024-09-21T03:18:30.421488+0000","last_unstale":"2024-09-21T03:18:31.964687+0000","last_undegraded":"2024-09-21T03:18:31.964687+0000","last_fullsized":"2024-09-21T03:18:31.964687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:52:00.902253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.410872+0000","last_change":"2024-09-21T03:18:30.412736+0000","last_active":"2024-09-21T03:18:31.410872+0000","last_peered":"2024-09-21T03:18:31.410872+0000","last_clean":"2024-09-21T03:18:31.410872+0000","last_became_active":"2024-09-21T03:18:30.412083+0000","last_became_peered":"2024-09-21T03:18:30.412083+0000","last_unstale":"2024-09-21T03:18:31.410872+0000","last_undegraded":"2024-09-21T03:18:31.410872+0000","last_fullsized":"2024-09-21T03:18:31.410872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:14:17.253259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.409843+0000","last_change":"2024-09-21T03:18:30.413123+0000","last_active":"2024-09-21T03:18:31.409843+0000","last_peered":"2024-09-21T03:18:31.409843+0000","last_clean":"2024-09-21T03:18:31.409843+0000","last_became_active":"2024-09-21T03:18:30.412788+0000","last_became_peered":"2024-09-21T03:18:30.412788+0000","last_unstale":"2024-09-21T03:18:31.409843+0000","last_undegraded":"2024-09-21T03:18:31.409843+0000","last_fullsized":"2024-09-21T03:18:31.409843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:37:21.324892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.409635+0000","last_change":"2024-09-21T03:18:30.396144+0000","last_active":"2024-09-21T03:18:31.409635+0000","last_peered":"2024-09-21T03:18:31.409635+0000","last_clean":"2024-09-21T03:18:31.409635+0000","last_became_active":"2024-09-21T03:18:30.395814+0000","last_became_peered":"2024-09-21T03:18:30.395814+0000","last_unstale":"2024-09-21T03:18:31.409635+0000","last_undegraded":"2024-09-21T03:18:31.409635+0000","last_fullsized":"2024-09-21T03:18:31.409635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:44.020518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406573+0000","last_change":"2024-09-21T03:18:30.402434+0000","last_active":"2024-09-21T03:18:31.406573+0000","last_peered":"2024-09-21T03:18:31.406573+0000","last_clean":"2024-09-21T03:18:31.406573+0000","last_became_active":"2024-09-21T03:18:30.402116+0000","last_became_peered":"2024-09-21T03:18:30.402116+0000","last_unstale":"2024-09-21T03:18:31.406573+0000","last_undegraded":"2024-09-21T03:18:31.406573+0000","last_fullsized":"2024-09-21T03:18:31.406573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:21.239439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963837+0000","last_change":"2024-09-21T03:18:30.407726+0000","last_active":"2024-09-21T03:18:31.963837+0000","last_peered":"2024-09-21T03:18:31.963837+0000","last_clean":"2024-09-21T03:18:31.963837+0000","last_became_active":"2024-09-21T03:18:30.404823+0000","last_became_peered":"2024-09-21T03:18:30.404823+0000","last_unstale":"2024-09-21T03:18:31.963837+0000","last_undegraded":"2024-09-21T03:18:31.963837+0000","last_fullsized":"2024-09-21T03:18:31.963837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:34.397671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963083+0000","last_change":"2024-09-21T03:18:30.400323+0000","last_active":"2024-09-21T03:18:31.963083+0000","last_peered":"2024-09-21T03:18:31.963083+0000","last_clean":"2024-09-21T03:18:31.963083+0000","last_became_active":"2024-09-21T03:18:30.399972+0000","last_became_peered":"2024-09-21T03:18:30.399972+0000","last_unstale":"2024-09-21T03:18:31.963083+0000","last_undegraded":"2024-09-21T03:18:31.963083+0000","last_fullsized":"2024-09-21T03:18:31.963083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:15.659300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963314+0000","last_change":"2024-09-21T03:18:30.418155+0000","last_active":"2024-09-21T03:18:31.963314+0000","last_peered":"2024-09-21T03:18:31.963314+0000","last_clean":"2024-09-21T03:18:31.963314+0000","last_became_active":"2024-09-21T03:18:30.417794+0000","last_became_peered":"2024-09-21T03:18:30.417794+0000","last_unstale":"2024-09-21T03:18:31.963314+0000","last_undegraded":"2024-09-21T03:18:31.963314+0000","last_fullsized":"2024-09-21T03:18:31.963314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:15.659300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963961+0000","last_change":"2024-09-21T03:18:30.411196+0000","last_active":"2024-09-21T03:18:31.963961+0000","last_peered":"2024-09-21T03:18:31.963961+0000","last_clean":"2024-09-21T03:18:31.963961+0000","last_became_active":"2024-09-21T03:18:30.410865+0000","last_became_peered":"2024-09-21T03:18:30.410865+0000","last_unstale":"2024-09-21T03:18:31.963961+0000","last_undegraded":"2024-09-21T03:18:31.963961+0000","last_fullsized":"2024-09-21T03:18:31.963961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:54.882986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963694+0000","last_change":"2024-09-21T03:18:30.400114+0000","last_active":"2024-09-21T03:18:31.963694+0000","last_peered":"2024-09-21T03:18:31.963694+0000","last_clean":"2024-09-21T03:18:31.963694+0000","last_became_active":"2024-09-21T03:18:30.399748+0000","last_became_peered":"2024-09-21T03:18:30.399748+0000","last_unstale":"2024-09-21T03:18:31.963694+0000","last_undegraded":"2024-09-21T03:18:31.963694+0000","last_fullsized":"2024-09-21T03:18:31.963694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:25.808010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964697+0000","last_change":"2024-09-21T03:18:30.409223+0000","last_active":"2024-09-21T03:18:31.964697+0000","last_peered":"2024-09-21T03:18:31.964697+0000","last_clean":"2024-09-21T03:18:31.964697+0000","last_became_active":"2024-09-21T03:18:30.408876+0000","last_became_peered":"2024-09-21T03:18:30.408876+0000","last_unstale":"2024-09-21T03:18:31.964697+0000","last_undegraded":"2024-09-21T03:18:31.964697+0000","last_fullsized":"2024-09-21T03:18:31.964697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:55:03.483520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.410645+0000","last_change":"2024-09-21T03:18:30.398035+0000","last_active":"2024-09-21T03:18:31.410645+0000","last_peered":"2024-09-21T03:18:31.410645+0000","last_clean":"2024-09-21T03:18:31.410645+0000","last_became_active":"2024-09-21T03:18:30.397692+0000","last_became_peered":"2024-09-21T03:18:30.397692+0000","last_unstale":"2024-09-21T03:18:31.410645+0000","last_undegraded":"2024-09-21T03:18:31.410645+0000","last_fullsized":"2024-09-21T03:18:31.410645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:18.166927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963501+0000","last_change":"2024-09-21T03:18:30.410634+0000","last_active":"2024-09-21T03:18:31.963501+0000","last_peered":"2024-09-21T03:18:31.963501+0000","last_clean":"2024-09-21T03:18:31.963501+0000","last_became_active":"2024-09-21T03:18:30.410352+0000","last_became_peered":"2024-09-21T03:18:30.410352+0000","last_unstale":"2024-09-21T03:18:31.963501+0000","last_undegraded":"2024-09-21T03:18:31.963501+0000","last_fullsized":"2024-09-21T03:18:31.963501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:10.314462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963467+0000","last_change":"2024-09-21T03:18:30.412518+0000","last_active":"2024-09-21T03:18:31.963467+0000","last_peered":"2024-09-21T03:18:31.963467+0000","last_clean":"2024-09-21T03:18:31.963467+0000","last_became_active":"2024-09-21T03:18:30.411784+0000","last_became_peered":"2024-09-21T03:18:30.411784+0000","last_unstale":"2024-09-21T03:18:31.963467+0000","last_undegraded":"2024-09-21T03:18:31.963467+0000","last_fullsized":"2024-09-21T03:18:31.963467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:11.956694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406217+0000","last_change":"2024-09-21T03:18:30.400029+0000","last_active":"2024-09-21T03:18:31.406217+0000","last_peered":"2024-09-21T03:18:31.406217+0000","last_clean":"2024-09-21T03:18:31.406217+0000","last_became_active":"2024-09-21T03:18:30.399708+0000","last_became_peered":"2024-09-21T03:18:30.399708+0000","last_unstale":"2024-09-21T03:18:31.406217+0000","last_undegraded":"2024-09-21T03:18:31.406217+0000","last_fullsized":"2024-09-21T03:18:31.406217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:45.250175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963526+0000","last_change":"2024-09-21T03:18:30.417315+0000","last_active":"2024-09-21T03:18:31.963526+0000","last_peered":"2024-09-21T03:18:31.963526+0000","last_clean":"2024-09-21T03:18:31.963526+0000","last_became_active":"2024-09-21T03:18:30.417005+0000","last_became_peered":"2024-09-21T03:18:30.417005+0000","last_unstale":"2024-09-21T03:18:31.963526+0000","last_undegraded":"2024-09-21T03:18:31.963526+0000","last_fullsized":"2024-09-21T03:18:31.963526+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:21.239439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406541+0000","last_change":"2024-09-21T03:18:30.408987+0000","last_active":"2024-09-21T03:18:31.406541+0000","last_peered":"2024-09-21T03:18:31.406541+0000","last_clean":"2024-09-21T03:18:31.406541+0000","last_became_active":"2024-09-21T03:18:30.408657+0000","last_became_peered":"2024-09-21T03:18:30.408657+0000","last_unstale":"2024-09-21T03:18:31.406541+0000","last_undegraded":"2024-09-21T03:18:31.406541+0000","last_fullsized":"2024-09-21T03:18:31.406541+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:14:17.253259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.410869+0000","last_change":"2024-09-21T03:18:30.409463+0000","last_active":"2024-09-21T03:18:31.410869+0000","last_peered":"2024-09-21T03:18:31.410869+0000","last_clean":"2024-09-21T03:18:31.410869+0000","last_became_active":"2024-09-21T03:18:30.409130+0000","last_became_peered":"2024-09-21T03:18:30.409130+0000","last_unstale":"2024-09-21T03:18:31.410869+0000","last_undegraded":"2024-09-21T03:18:31.410869+0000","last_fullsized":"2024-09-21T03:18:31.410869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:31.370175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963297+0000","last_change":"2024-09-21T03:18:30.415501+0000","last_active":"2024-09-21T03:18:31.963297+0000","last_peered":"2024-09-21T03:18:31.963297+0000","last_clean":"2024-09-21T03:18:31.963297+0000","last_became_active":"2024-09-21T03:18:30.415201+0000","last_became_peered":"2024-09-21T03:18:30.415201+0000","last_unstale":"2024-09-21T03:18:31.963297+0000","last_undegraded":"2024-09-21T03:18:31.963297+0000","last_fullsized":"2024-09-21T03:18:31.963297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:11.956694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406534+0000","last_change":"2024-09-21T03:18:30.409337+0000","last_active":"2024-09-21T03:18:31.406534+0000","last_peered":"2024-09-21T03:18:31.406534+0000","last_clean":"2024-09-21T03:18:31.406534+0000","last_became_active":"2024-09-21T03:18:30.409034+0000","last_became_peered":"2024-09-21T03:18:30.409034+0000","last_unstale":"2024-09-21T03:18:31.406534+0000","last_undegraded":"2024-09-21T03:18:31.406534+0000","last_fullsized":"2024-09-21T03:18:31.406534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:15.659300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963865+0000","last_change":"2024-09-21T03:18:30.409071+0000","last_active":"2024-09-21T03:18:31.963865+0000","last_peered":"2024-09-21T03:18:31.963865+0000","last_clean":"2024-09-21T03:18:31.963865+0000","last_became_active":"2024-09-21T03:18:30.408769+0000","last_became_peered":"2024-09-21T03:18:30.408769+0000","last_unstale":"2024-09-21T03:18:31.963865+0000","last_undegraded":"2024-09-21T03:18:31.963865+0000","last_fullsized":"2024-09-21T03:18:31.963865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:26.009956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964289+0000","last_change":"2024-09-21T03:18:30.416900+0000","last_active":"2024-09-21T03:18:31.964289+0000","last_peered":"2024-09-21T03:18:31.964289+0000","last_clean":"2024-09-21T03:18:31.964289+0000","last_became_active":"2024-09-21T03:18:30.416566+0000","last_became_peered":"2024-09-21T03:18:30.416566+0000","last_unstale":"2024-09-21T03:18:31.964289+0000","last_undegraded":"2024-09-21T03:18:31.964289+0000","last_fullsized":"2024-09-21T03:18:31.964289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:52:00.902253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963482+0000","last_change":"2024-09-21T03:18:30.409381+0000","last_active":"2024-09-21T03:18:31.963482+0000","last_peered":"2024-09-21T03:18:31.963482+0000","last_clean":"2024-09-21T03:18:31.963482+0000","last_became_active":"2024-09-21T03:18:30.409066+0000","last_became_peered":"2024-09-21T03:18:30.409066+0000","last_unstale":"2024-09-21T03:18:31.963482+0000","last_undegraded":"2024-09-21T03:18:31.963482+0000","last_fullsized":"2024-09-21T03:18:31.963482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:44.039210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.409946+0000","last_change":"2024-09-21T03:18:30.413745+0000","last_active":"2024-09-21T03:18:31.409946+0000","last_peered":"2024-09-21T03:18:31.409946+0000","last_clean":"2024-09-21T03:18:31.409946+0000","last_became_active":"2024-09-21T03:18:30.413434+0000","last_became_peered":"2024-09-21T03:18:30.413434+0000","last_unstale":"2024-09-21T03:18:31.409946+0000","last_undegraded":"2024-09-21T03:18:31.409946+0000","last_fullsized":"2024-09-21T03:18:31.409946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:40.786257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.409337+0000","last_change":"2024-09-21T03:18:30.405133+0000","last_active":"2024-09-21T03:18:31.409337+0000","last_peered":"2024-09-21T03:18:31.409337+0000","last_clean":"2024-09-21T03:18:31.409337+0000","last_became_active":"2024-09-21T03:18:30.404795+0000","last_became_peered":"2024-09-21T03:18:30.404795+0000","last_unstale":"2024-09-21T03:18:31.409337+0000","last_undegraded":"2024-09-21T03:18:31.409337+0000","last_fullsized":"2024-09-21T03:18:31.409337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:26.872806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406704+0000","last_change":"2024-09-21T03:18:29.409241+0000","last_active":"2024-09-21T03:18:31.406704+0000","last_peered":"2024-09-21T03:18:31.406704+0000","last_clean":"2024-09-21T03:18:31.406704+0000","last_became_active":"2024-09-21T03:18:29.408988+0000","last_became_peered":"2024-09-21T03:18:29.408988+0000","last_unstale":"2024-09-21T03:18:31.406704+0000","last_undegraded":"2024-09-21T03:18:31.406704+0000","last_fullsized":"2024-09-21T03:18:31.406704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:52.299913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964047+0000","last_change":"2024-09-21T03:18:30.406637+0000","last_active":"2024-09-21T03:18:31.964047+0000","last_peered":"2024-09-21T03:18:31.964047+0000","last_clean":"2024-09-21T03:18:31.964047+0000","last_became_active":"2024-09-21T03:18:30.405638+0000","last_became_peered":"2024-09-21T03:18:30.405638+0000","last_unstale":"2024-09-21T03:18:31.964047+0000","last_undegraded":"2024-09-21T03:18:31.964047+0000","last_fullsized":"2024-09-21T03:18:31.964047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:25.913095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.410144+0000","last_change":"2024-09-21T03:18:29.401902+0000","last_active":"2024-09-21T03:18:31.410144+0000","last_peered":"2024-09-21T03:18:31.410144+0000","last_clean":"2024-09-21T03:18:31.410144+0000","last_became_active":"2024-09-21T03:18:29.401056+0000","last_became_peered":"2024-09-21T03:18:29.401056+0000","last_unstale":"2024-09-21T03:18:31.410144+0000","last_undegraded":"2024-09-21T03:18:31.410144+0000","last_fullsized":"2024-09-21T03:18:31.410144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:41.323758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406156+0000","last_change":"2024-09-21T03:18:29.403151+0000","last_active":"2024-09-21T03:18:31.406156+0000","last_peered":"2024-09-21T03:18:31.406156+0000","last_clean":"2024-09-21T03:18:31.406156+0000","last_became_active":"2024-09-21T03:18:29.402799+0000","last_became_peered":"2024-09-21T03:18:29.402799+0000","last_unstale":"2024-09-21T03:18:31.406156+0000","last_undegraded":"2024-09-21T03:18:31.406156+0000","last_fullsized":"2024-09-21T03:18:31.406156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:50.682717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406269+0000","last_change":"2024-09-21T03:18:30.417827+0000","last_active":"2024-09-21T03:18:31.406269+0000","last_peered":"2024-09-21T03:18:31.406269+0000","last_clean":"2024-09-21T03:18:31.406269+0000","last_became_active":"2024-09-21T03:18:30.417509+0000","last_became_peered":"2024-09-21T03:18:30.417509+0000","last_unstale":"2024-09-21T03:18:31.406269+0000","last_undegraded":"2024-09-21T03:18:31.406269+0000","last_fullsized":"2024-09-21T03:18:31.406269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:03.094324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963424+0000","last_change":"2024-09-21T03:18:29.406382+0000","last_active":"2024-09-21T03:18:31.963424+0000","last_peered":"2024-09-21T03:18:31.963424+0000","last_clean":"2024-09-21T03:18:31.963424+0000","last_became_active":"2024-09-21T03:18:29.405616+0000","last_became_peered":"2024-09-21T03:18:29.405616+0000","last_unstale":"2024-09-21T03:18:31.963424+0000","last_undegraded":"2024-09-21T03:18:31.963424+0000","last_fullsized":"2024-09-21T03:18:31.963424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:45.917164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.962705+0000","last_change":"2024-09-21T03:18:30.402277+0000","last_active":"2024-09-21T03:18:31.962705+0000","last_peered":"2024-09-21T03:18:31.962705+0000","last_clean":"2024-09-21T03:18:31.962705+0000","last_became_active":"2024-09-21T03:18:30.401923+0000","last_became_peered":"2024-09-21T03:18:30.401923+0000","last_unstale":"2024-09-21T03:18:31.962705+0000","last_undegraded":"2024-09-21T03:18:31.962705+0000","last_fullsized":"2024-09-21T03:18:31.962705+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:45.250175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.410347+0000","last_change":"2024-09-21T03:18:29.407735+0000","last_active":"2024-09-21T03:18:31.410347+0000","last_peered":"2024-09-21T03:18:31.410347+0000","last_clean":"2024-09-21T03:18:31.410347+0000","last_became_active":"2024-09-21T03:18:29.407377+0000","last_became_peered":"2024-09-21T03:18:29.407377+0000","last_unstale":"2024-09-21T03:18:31.410347+0000","last_undegraded":"2024-09-21T03:18:31.410347+0000","last_fullsized":"2024-09-21T03:18:31.410347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:25.867003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963866+0000","last_change":"2024-09-21T03:18:30.411099+0000","last_active":"2024-09-21T03:18:31.963866+0000","last_peered":"2024-09-21T03:18:31.963866+0000","last_clean":"2024-09-21T03:18:31.963866+0000","last_became_active":"2024-09-21T03:18:30.410755+0000","last_became_peered":"2024-09-21T03:18:30.410755+0000","last_unstale":"2024-09-21T03:18:31.963866+0000","last_undegraded":"2024-09-21T03:18:31.963866+0000","last_fullsized":"2024-09-21T03:18:31.963866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:49.705469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963834+0000","last_change":"2024-09-21T03:18:29.408842+0000","last_active":"2024-09-21T03:18:31.963834+0000","last_peered":"2024-09-21T03:18:31.963834+0000","last_clean":"2024-09-21T03:18:31.963834+0000","last_became_active":"2024-09-21T03:18:29.408345+0000","last_became_peered":"2024-09-21T03:18:29.408345+0000","last_unstale":"2024-09-21T03:18:31.963834+0000","last_undegraded":"2024-09-21T03:18:31.963834+0000","last_fullsized":"2024-09-21T03:18:31.963834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:22.158750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963990+0000","last_change":"2024-09-21T03:18:30.413425+0000","last_active":"2024-09-21T03:18:31.963990+0000","last_peered":"2024-09-21T03:18:31.963990+0000","last_clean":"2024-09-21T03:18:31.963990+0000","last_became_active":"2024-09-21T03:18:30.412694+0000","last_became_peered":"2024-09-21T03:18:30.412694+0000","last_unstale":"2024-09-21T03:18:31.963990+0000","last_undegraded":"2024-09-21T03:18:31.963990+0000","last_fullsized":"2024-09-21T03:18:31.963990+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:36.512318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963255+0000","last_change":"2024-09-21T03:18:29.407409+0000","last_active":"2024-09-21T03:18:31.963255+0000","last_peered":"2024-09-21T03:18:31.963255+0000","last_clean":"2024-09-21T03:18:31.963255+0000","last_became_active":"2024-09-21T03:18:29.407071+0000","last_became_peered":"2024-09-21T03:18:29.407071+0000","last_unstale":"2024-09-21T03:18:31.963255+0000","last_undegraded":"2024-09-21T03:18:31.963255+0000","last_fullsized":"2024-09-21T03:18:31.963255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:43.033407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.409859+0000","last_change":"2024-09-21T03:18:30.410735+0000","last_active":"2024-09-21T03:18:31.409859+0000","last_peered":"2024-09-21T03:18:31.409859+0000","last_clean":"2024-09-21T03:18:31.409859+0000","last_became_active":"2024-09-21T03:18:30.409130+0000","last_became_peered":"2024-09-21T03:18:30.409130+0000","last_unstale":"2024-09-21T03:18:31.409859+0000","last_undegraded":"2024-09-21T03:18:31.409859+0000","last_fullsized":"2024-09-21T03:18:31.409859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:28.243325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.410333+0000","last_change":"2024-09-21T03:18:29.402961+0000","last_active":"2024-09-21T03:18:31.410333+0000","last_peered":"2024-09-21T03:18:31.410333+0000","last_clean":"2024-09-21T03:18:31.410333+0000","last_became_active":"2024-09-21T03:18:29.402605+0000","last_became_peered":"2024-09-21T03:18:29.402605+0000","last_unstale":"2024-09-21T03:18:31.410333+0000","last_undegraded":"2024-09-21T03:18:31.410333+0000","last_fullsized":"2024-09-21T03:18:31.410333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:32.360810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964077+0000","last_change":"2024-09-21T03:18:30.416670+0000","last_active":"2024-09-21T03:18:31.964077+0000","last_peered":"2024-09-21T03:18:31.964077+0000","last_clean":"2024-09-21T03:18:31.964077+0000","last_became_active":"2024-09-21T03:18:30.416005+0000","last_became_peered":"2024-09-21T03:18:30.416005+0000","last_unstale":"2024-09-21T03:18:31.964077+0000","last_undegraded":"2024-09-21T03:18:31.964077+0000","last_fullsized":"2024-09-21T03:18:31.964077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:35.898216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964144+0000","last_change":"2024-09-21T03:18:29.405416+0000","last_active":"2024-09-21T03:18:31.964144+0000","last_peered":"2024-09-21T03:18:31.964144+0000","last_clean":"2024-09-21T03:18:31.964144+0000","last_became_active":"2024-09-21T03:18:29.405108+0000","last_became_peered":"2024-09-21T03:18:29.405108+0000","last_unstale":"2024-09-21T03:18:31.964144+0000","last_undegraded":"2024-09-21T03:18:31.964144+0000","last_fullsized":"2024-09-21T03:18:31.964144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:53.454590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963602+0000","last_change":"2024-09-21T03:18:30.409860+0000","last_active":"2024-09-21T03:18:31.963602+0000","last_peered":"2024-09-21T03:18:31.963602+0000","last_clean":"2024-09-21T03:18:31.963602+0000","last_became_active":"2024-09-21T03:18:30.409559+0000","last_became_peered":"2024-09-21T03:18:30.409559+0000","last_unstale":"2024-09-21T03:18:31.963602+0000","last_undegraded":"2024-09-21T03:18:31.963602+0000","last_fullsized":"2024-09-21T03:18:31.963602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:57.589254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964301+0000","last_change":"2024-09-21T03:18:29.413878+0000","last_active":"2024-09-21T03:18:31.964301+0000","last_peered":"2024-09-21T03:18:31.964301+0000","last_clean":"2024-09-21T03:18:31.964301+0000","last_became_active":"2024-09-21T03:18:29.413571+0000","last_became_peered":"2024-09-21T03:18:29.413571+0000","last_unstale":"2024-09-21T03:18:31.964301+0000","last_undegraded":"2024-09-21T03:18:31.964301+0000","last_fullsized":"2024-09-21T03:18:31.964301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:21.627091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964666+0000","last_change":"2024-09-21T03:18:30.416945+0000","last_active":"2024-09-21T03:18:31.964666+0000","last_peered":"2024-09-21T03:18:31.964666+0000","last_clean":"2024-09-21T03:18:31.964666+0000","last_became_active":"2024-09-21T03:18:30.416610+0000","last_became_peered":"2024-09-21T03:18:30.416610+0000","last_unstale":"2024-09-21T03:18:31.964666+0000","last_undegraded":"2024-09-21T03:18:31.964666+0000","last_fullsized":"2024-09-21T03:18:31.964666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:22:49.496448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.409505+0000","last_change":"2024-09-21T03:18:29.401191+0000","last_active":"2024-09-21T03:18:31.409505+0000","last_peered":"2024-09-21T03:18:31.409505+0000","last_clean":"2024-09-21T03:18:31.409505+0000","last_became_active":"2024-09-21T03:18:29.400775+0000","last_became_peered":"2024-09-21T03:18:29.400775+0000","last_unstale":"2024-09-21T03:18:31.409505+0000","last_undegraded":"2024-09-21T03:18:31.409505+0000","last_fullsized":"2024-09-21T03:18:31.409505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:03:55.435346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.410129+0000","last_change":"2024-09-21T03:18:30.406919+0000","last_active":"2024-09-21T03:18:31.410129+0000","last_peered":"2024-09-21T03:18:31.410129+0000","last_clean":"2024-09-21T03:18:31.410129+0000","last_became_active":"2024-09-21T03:18:30.406584+0000","last_became_peered":"2024-09-21T03:18:30.406584+0000","last_unstale":"2024-09-21T03:18:31.410129+0000","last_undegraded":"2024-09-21T03:18:31.410129+0000","last_fullsized":"2024-09-21T03:18:31.410129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:46.766926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963384+0000","last_change":"2024-09-21T03:18:29.401326+0000","last_active":"2024-09-21T03:18:31.963384+0000","last_peered":"2024-09-21T03:18:31.963384+0000","last_clean":"2024-09-21T03:18:31.963384+0000","last_became_active":"2024-09-21T03:18:29.400268+0000","last_became_peered":"2024-09-21T03:18:29.400268+0000","last_unstale":"2024-09-21T03:18:31.963384+0000","last_undegraded":"2024-09-21T03:18:31.963384+0000","last_fullsized":"2024-09-21T03:18:31.963384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:53.644507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964135+0000","last_change":"2024-09-21T03:18:30.420964+0000","last_active":"2024-09-21T03:18:31.964135+0000","last_peered":"2024-09-21T03:18:31.964135+0000","last_clean":"2024-09-21T03:18:31.964135+0000","last_became_active":"2024-09-21T03:18:30.420316+0000","last_became_peered":"2024-09-21T03:18:30.420316+0000","last_unstale":"2024-09-21T03:18:31.964135+0000","last_undegraded":"2024-09-21T03:18:31.964135+0000","last_fullsized":"2024-09-21T03:18:31.964135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:59.120847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.410688+0000","last_change":"2024-09-21T03:18:29.405556+0000","last_active":"2024-09-21T03:18:31.410688+0000","last_peered":"2024-09-21T03:18:31.410688+0000","last_clean":"2024-09-21T03:18:31.410688+0000","last_became_active":"2024-09-21T03:18:29.405128+0000","last_became_peered":"2024-09-21T03:18:29.405128+0000","last_unstale":"2024-09-21T03:18:31.410688+0000","last_undegraded":"2024-09-21T03:18:31.410688+0000","last_fullsized":"2024-09-21T03:18:31.410688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:08.606490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964082+0000","last_change":"2024-09-21T03:18:30.416107+0000","last_active":"2024-09-21T03:18:31.964082+0000","last_peered":"2024-09-21T03:18:31.964082+0000","last_clean":"2024-09-21T03:18:31.964082+0000","last_became_active":"2024-09-21T03:18:30.415764+0000","last_became_peered":"2024-09-21T03:18:30.415764+0000","last_unstale":"2024-09-21T03:18:31.964082+0000","last_undegraded":"2024-09-21T03:18:31.964082+0000","last_fullsized":"2024-09-21T03:18:31.964082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:40.961482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963646+0000","last_change":"2024-09-21T03:18:29.402215+0000","last_active":"2024-09-21T03:18:31.963646+0000","last_peered":"2024-09-21T03:18:31.963646+0000","last_clean":"2024-09-21T03:18:31.963646+0000","last_became_active":"2024-09-21T03:18:29.401853+0000","last_became_peered":"2024-09-21T03:18:29.401853+0000","last_unstale":"2024-09-21T03:18:31.963646+0000","last_undegraded":"2024-09-21T03:18:31.963646+0000","last_fullsized":"2024-09-21T03:18:31.963646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:22.158750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964837+0000","last_change":"2024-09-21T03:18:30.421447+0000","last_active":"2024-09-21T03:18:31.964837+0000","last_peered":"2024-09-21T03:18:31.964837+0000","last_clean":"2024-09-21T03:18:31.964837+0000","last_became_active":"2024-09-21T03:18:30.421061+0000","last_became_peered":"2024-09-21T03:18:30.421061+0000","last_unstale":"2024-09-21T03:18:31.964837+0000","last_undegraded":"2024-09-21T03:18:31.964837+0000","last_fullsized":"2024-09-21T03:18:31.964837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:34.616164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963366+0000","last_change":"2024-09-21T03:18:29.404008+0000","last_active":"2024-09-21T03:18:31.963366+0000","last_peered":"2024-09-21T03:18:31.963366+0000","last_clean":"2024-09-21T03:18:31.963366+0000","last_became_active":"2024-09-21T03:18:29.403700+0000","last_became_peered":"2024-09-21T03:18:29.403700+0000","last_unstale":"2024-09-21T03:18:31.963366+0000","last_undegraded":"2024-09-21T03:18:31.963366+0000","last_fullsized":"2024-09-21T03:18:31.963366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:24.802208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964230+0000","last_change":"2024-09-21T03:18:30.420751+0000","last_active":"2024-09-21T03:18:31.964230+0000","last_peered":"2024-09-21T03:18:31.964230+0000","last_clean":"2024-09-21T03:18:31.964230+0000","last_became_active":"2024-09-21T03:18:30.420401+0000","last_became_peered":"2024-09-21T03:18:30.420401+0000","last_unstale":"2024-09-21T03:18:31.964230+0000","last_undegraded":"2024-09-21T03:18:31.964230+0000","last_fullsized":"2024-09-21T03:18:31.964230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:55.226807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963123+0000","last_change":"2024-09-21T03:18:29.410099+0000","last_active":"2024-09-21T03:18:31.963123+0000","last_peered":"2024-09-21T03:18:31.963123+0000","last_clean":"2024-09-21T03:18:31.963123+0000","last_became_active":"2024-09-21T03:18:29.409723+0000","last_became_peered":"2024-09-21T03:18:29.409723+0000","last_unstale":"2024-09-21T03:18:31.963123+0000","last_undegraded":"2024-09-21T03:18:31.963123+0000","last_fullsized":"2024-09-21T03:18:31.963123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:43.447253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964356+0000","last_change":"2024-09-21T03:18:30.416344+0000","last_active":"2024-09-21T03:18:31.964356+0000","last_peered":"2024-09-21T03:18:31.964356+0000","last_clean":"2024-09-21T03:18:31.964356+0000","last_became_active":"2024-09-21T03:18:30.415584+0000","last_became_peered":"2024-09-21T03:18:30.415584+0000","last_unstale":"2024-09-21T03:18:31.964356+0000","last_undegraded":"2024-09-21T03:18:31.964356+0000","last_fullsized":"2024-09-21T03:18:31.964356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:24:42.041578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963862+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:18:31.963862+0000","last_peered":"2024-09-21T03:18:31.963862+0000","last_clean":"2024-09-21T03:18:31.963862+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:18:31.963862+0000","last_undegraded":"2024-09-21T03:18:31.963862+0000","last_fullsized":"2024-09-21T03:18:31.963862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963163+0000","last_change":"2024-09-21T03:18:29.407517+0000","last_active":"2024-09-21T03:18:31.963163+0000","last_peered":"2024-09-21T03:18:31.963163+0000","last_clean":"2024-09-21T03:18:31.963163+0000","last_became_active":"2024-09-21T03:18:29.407174+0000","last_became_peered":"2024-09-21T03:18:29.407174+0000","last_unstale":"2024-09-21T03:18:31.963163+0000","last_undegraded":"2024-09-21T03:18:31.963163+0000","last_fullsized":"2024-09-21T03:18:31.963163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:43.447253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406392+0000","last_change":"2024-09-21T03:18:30.416787+0000","last_active":"2024-09-21T03:18:31.406392+0000","last_peered":"2024-09-21T03:18:31.406392+0000","last_clean":"2024-09-21T03:18:31.406392+0000","last_became_active":"2024-09-21T03:18:30.416468+0000","last_became_peered":"2024-09-21T03:18:30.416468+0000","last_unstale":"2024-09-21T03:18:31.406392+0000","last_undegraded":"2024-09-21T03:18:31.406392+0000","last_fullsized":"2024-09-21T03:18:31.406392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:13.827662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963278+0000","last_change":"2024-09-21T03:18:29.400053+0000","last_active":"2024-09-21T03:18:31.963278+0000","last_peered":"2024-09-21T03:18:31.963278+0000","last_clean":"2024-09-21T03:18:31.963278+0000","last_became_active":"2024-09-21T03:18:29.399616+0000","last_became_peered":"2024-09-21T03:18:29.399616+0000","last_unstale":"2024-09-21T03:18:31.963278+0000","last_undegraded":"2024-09-21T03:18:31.963278+0000","last_fullsized":"2024-09-21T03:18:31.963278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:32.360810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.962934+0000","last_change":"2024-09-21T03:18:30.406884+0000","last_active":"2024-09-21T03:18:31.962934+0000","last_peered":"2024-09-21T03:18:31.962934+0000","last_clean":"2024-09-21T03:18:31.962934+0000","last_became_active":"2024-09-21T03:18:30.406497+0000","last_became_peered":"2024-09-21T03:18:30.406497+0000","last_unstale":"2024-09-21T03:18:31.962934+0000","last_undegraded":"2024-09-21T03:18:31.962934+0000","last_fullsized":"2024-09-21T03:18:31.962934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:25.356077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963522+0000","last_change":"2024-09-21T03:18:29.403123+0000","last_active":"2024-09-21T03:18:31.963522+0000","last_peered":"2024-09-21T03:18:31.963522+0000","last_clean":"2024-09-21T03:18:31.963522+0000","last_became_active":"2024-09-21T03:18:29.402613+0000","last_became_peered":"2024-09-21T03:18:29.402613+0000","last_unstale":"2024-09-21T03:18:31.963522+0000","last_undegraded":"2024-09-21T03:18:31.963522+0000","last_fullsized":"2024-09-21T03:18:31.963522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:45.917164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.962777+0000","last_change":"2024-09-21T03:18:30.401955+0000","last_active":"2024-09-21T03:18:31.962777+0000","last_peered":"2024-09-21T03:18:31.962777+0000","last_clean":"2024-09-21T03:18:31.962777+0000","last_became_active":"2024-09-21T03:18:30.401587+0000","last_became_peered":"2024-09-21T03:18:30.401587+0000","last_unstale":"2024-09-21T03:18:31.962777+0000","last_undegraded":"2024-09-21T03:18:31.962777+0000","last_fullsized":"2024-09-21T03:18:31.962777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:03.094324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964372+0000","last_change":"2024-09-21T03:18:29.407459+0000","last_active":"2024-09-21T03:18:31.964372+0000","last_peered":"2024-09-21T03:18:31.964372+0000","last_clean":"2024-09-21T03:18:31.964372+0000","last_became_active":"2024-09-21T03:18:29.407132+0000","last_became_peered":"2024-09-21T03:18:29.407132+0000","last_unstale":"2024-09-21T03:18:31.964372+0000","last_undegraded":"2024-09-21T03:18:31.964372+0000","last_fullsized":"2024-09-21T03:18:31.964372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:58.516525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.409395+0000","last_change":"2024-09-21T03:18:30.406973+0000","last_active":"2024-09-21T03:18:31.409395+0000","last_peered":"2024-09-21T03:18:31.409395+0000","last_clean":"2024-09-21T03:18:31.409395+0000","last_became_active":"2024-09-21T03:18:30.405992+0000","last_became_peered":"2024-09-21T03:18:30.405992+0000","last_unstale":"2024-09-21T03:18:31.409395+0000","last_undegraded":"2024-09-21T03:18:31.409395+0000","last_fullsized":"2024-09-21T03:18:31.409395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:33.366612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963029+0000","last_change":"2024-09-21T03:18:29.406073+0000","last_active":"2024-09-21T03:18:31.963029+0000","last_peered":"2024-09-21T03:18:31.963029+0000","last_clean":"2024-09-21T03:18:31.963029+0000","last_became_active":"2024-09-21T03:18:29.405786+0000","last_became_peered":"2024-09-21T03:18:29.405786+0000","last_unstale":"2024-09-21T03:18:31.963029+0000","last_undegraded":"2024-09-21T03:18:31.963029+0000","last_fullsized":"2024-09-21T03:18:31.963029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:45.917164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964101+0000","last_change":"2024-09-21T03:18:30.419736+0000","last_active":"2024-09-21T03:18:31.964101+0000","last_peered":"2024-09-21T03:18:31.964101+0000","last_clean":"2024-09-21T03:18:31.964101+0000","last_became_active":"2024-09-21T03:18:30.418805+0000","last_became_peered":"2024-09-21T03:18:30.418805+0000","last_unstale":"2024-09-21T03:18:31.964101+0000","last_undegraded":"2024-09-21T03:18:31.964101+0000","last_fullsized":"2024-09-21T03:18:31.964101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:14.331651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964588+0000","last_change":"2024-09-21T03:18:29.399297+0000","last_active":"2024-09-21T03:18:31.964588+0000","last_peered":"2024-09-21T03:18:31.964588+0000","last_clean":"2024-09-21T03:18:31.964588+0000","last_became_active":"2024-09-21T03:18:29.398956+0000","last_became_peered":"2024-09-21T03:18:29.398956+0000","last_unstale":"2024-09-21T03:18:31.964588+0000","last_undegraded":"2024-09-21T03:18:31.964588+0000","last_fullsized":"2024-09-21T03:18:31.964588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:03.278232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.962949+0000","last_change":"2024-09-21T03:18:30.402564+0000","last_active":"2024-09-21T03:18:31.962949+0000","last_peered":"2024-09-21T03:18:31.962949+0000","last_clean":"2024-09-21T03:18:31.962949+0000","last_became_active":"2024-09-21T03:18:30.401234+0000","last_became_peered":"2024-09-21T03:18:30.401234+0000","last_unstale":"2024-09-21T03:18:31.962949+0000","last_undegraded":"2024-09-21T03:18:31.962949+0000","last_fullsized":"2024-09-21T03:18:31.962949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:13.827662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.962727+0000","last_change":"2024-09-21T03:18:29.403088+0000","last_active":"2024-09-21T03:18:31.962727+0000","last_peered":"2024-09-21T03:18:31.962727+0000","last_clean":"2024-09-21T03:18:31.962727+0000","last_became_active":"2024-09-21T03:18:29.402795+0000","last_became_peered":"2024-09-21T03:18:29.402795+0000","last_unstale":"2024-09-21T03:18:31.962727+0000","last_undegraded":"2024-09-21T03:18:31.962727+0000","last_fullsized":"2024-09-21T03:18:31.962727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:22.158750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406630+0000","last_change":"2024-09-21T03:18:30.414287+0000","last_active":"2024-09-21T03:18:31.406630+0000","last_peered":"2024-09-21T03:18:31.406630+0000","last_clean":"2024-09-21T03:18:31.406630+0000","last_became_active":"2024-09-21T03:18:30.413950+0000","last_became_peered":"2024-09-21T03:18:30.413950+0000","last_unstale":"2024-09-21T03:18:31.406630+0000","last_undegraded":"2024-09-21T03:18:31.406630+0000","last_fullsized":"2024-09-21T03:18:31.406630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:23.551826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.410461+0000","last_change":"2024-09-21T03:18:29.406121+0000","last_active":"2024-09-21T03:18:31.410461+0000","last_peered":"2024-09-21T03:18:31.410461+0000","last_clean":"2024-09-21T03:18:31.410461+0000","last_became_active":"2024-09-21T03:18:29.405509+0000","last_became_peered":"2024-09-21T03:18:29.405509+0000","last_unstale":"2024-09-21T03:18:31.410461+0000","last_undegraded":"2024-09-21T03:18:31.410461+0000","last_fullsized":"2024-09-21T03:18:31.410461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:08.961149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963103+0000","last_change":"2024-09-21T03:18:30.404103+0000","last_active":"2024-09-21T03:18:31.963103+0000","last_peered":"2024-09-21T03:18:31.963103+0000","last_clean":"2024-09-21T03:18:31.963103+0000","last_became_active":"2024-09-21T03:18:30.402457+0000","last_became_peered":"2024-09-21T03:18:30.402457+0000","last_unstale":"2024-09-21T03:18:31.963103+0000","last_undegraded":"2024-09-21T03:18:31.963103+0000","last_fullsized":"2024-09-21T03:18:31.963103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:48.325684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963050+0000","last_change":"2024-09-21T03:18:29.405727+0000","last_active":"2024-09-21T03:18:31.963050+0000","last_peered":"2024-09-21T03:18:31.963050+0000","last_clean":"2024-09-21T03:18:31.963050+0000","last_became_active":"2024-09-21T03:18:29.405421+0000","last_became_peered":"2024-09-21T03:18:29.405421+0000","last_unstale":"2024-09-21T03:18:31.963050+0000","last_undegraded":"2024-09-21T03:18:31.963050+0000","last_fullsized":"2024-09-21T03:18:31.963050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:08.961149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.409341+0000","last_change":"2024-09-21T03:18:30.399926+0000","last_active":"2024-09-21T03:18:31.409341+0000","last_peered":"2024-09-21T03:18:31.409341+0000","last_clean":"2024-09-21T03:18:31.409341+0000","last_became_active":"2024-09-21T03:18:30.399600+0000","last_became_peered":"2024-09-21T03:18:30.399600+0000","last_unstale":"2024-09-21T03:18:31.409341+0000","last_undegraded":"2024-09-21T03:18:31.409341+0000","last_fullsized":"2024-09-21T03:18:31.409341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:23.164552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.962797+0000","last_change":"2024-09-21T03:18:29.405412+0000","last_active":"2024-09-21T03:18:31.962797+0000","last_peered":"2024-09-21T03:18:31.962797+0000","last_clean":"2024-09-21T03:18:31.962797+0000","last_became_active":"2024-09-21T03:18:29.405094+0000","last_became_peered":"2024-09-21T03:18:29.405094+0000","last_unstale":"2024-09-21T03:18:31.962797+0000","last_undegraded":"2024-09-21T03:18:31.962797+0000","last_fullsized":"2024-09-21T03:18:31.962797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:58.516525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406400+0000","last_change":"2024-09-21T03:18:30.405606+0000","last_active":"2024-09-21T03:18:31.406400+0000","last_peered":"2024-09-21T03:18:31.406400+0000","last_clean":"2024-09-21T03:18:31.406400+0000","last_became_active":"2024-09-21T03:18:30.403297+0000","last_became_peered":"2024-09-21T03:18:30.403297+0000","last_unstale":"2024-09-21T03:18:31.406400+0000","last_undegraded":"2024-09-21T03:18:31.406400+0000","last_fullsized":"2024-09-21T03:18:31.406400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:18.166927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963138+0000","last_change":"2024-09-21T03:18:29.400372+0000","last_active":"2024-09-21T03:18:31.963138+0000","last_peered":"2024-09-21T03:18:31.963138+0000","last_clean":"2024-09-21T03:18:31.963138+0000","last_became_active":"2024-09-21T03:18:29.400005+0000","last_became_peered":"2024-09-21T03:18:29.400005+0000","last_unstale":"2024-09-21T03:18:31.963138+0000","last_undegraded":"2024-09-21T03:18:31.963138+0000","last_fullsized":"2024-09-21T03:18:31.963138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:21.627091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406843+0000","last_change":"2024-09-21T03:18:30.418312+0000","last_active":"2024-09-21T03:18:31.406843+0000","last_peered":"2024-09-21T03:18:31.406843+0000","last_clean":"2024-09-21T03:18:31.406843+0000","last_became_active":"2024-09-21T03:18:30.417984+0000","last_became_peered":"2024-09-21T03:18:30.417984+0000","last_unstale":"2024-09-21T03:18:31.406843+0000","last_undegraded":"2024-09-21T03:18:31.406843+0000","last_fullsized":"2024-09-21T03:18:31.406843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:40.961482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964737+0000","last_change":"2024-09-21T03:18:29.400789+0000","last_active":"2024-09-21T03:18:31.964737+0000","last_peered":"2024-09-21T03:18:31.964737+0000","last_clean":"2024-09-21T03:18:31.964737+0000","last_became_active":"2024-09-21T03:18:29.400487+0000","last_became_peered":"2024-09-21T03:18:29.400487+0000","last_unstale":"2024-09-21T03:18:31.964737+0000","last_undegraded":"2024-09-21T03:18:31.964737+0000","last_fullsized":"2024-09-21T03:18:31.964737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:42.181902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.410214+0000","last_change":"2024-09-21T03:18:30.394333+0000","last_active":"2024-09-21T03:18:31.410214+0000","last_peered":"2024-09-21T03:18:31.410214+0000","last_clean":"2024-09-21T03:18:31.410214+0000","last_became_active":"2024-09-21T03:18:30.393995+0000","last_became_peered":"2024-09-21T03:18:30.393995+0000","last_unstale":"2024-09-21T03:18:31.410214+0000","last_undegraded":"2024-09-21T03:18:31.410214+0000","last_fullsized":"2024-09-21T03:18:31.410214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:10.520052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963771+0000","last_change":"2024-09-21T03:18:30.419098+0000","last_active":"2024-09-21T03:18:31.963771+0000","last_peered":"2024-09-21T03:18:31.963771+0000","last_clean":"2024-09-21T03:18:31.963771+0000","last_became_active":"2024-09-21T03:18:30.416696+0000","last_became_peered":"2024-09-21T03:18:30.416696+0000","last_unstale":"2024-09-21T03:18:31.963771+0000","last_undegraded":"2024-09-21T03:18:31.963771+0000","last_fullsized":"2024-09-21T03:18:31.963771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:40.961482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963622+0000","last_change":"2024-09-21T03:18:29.410284+0000","last_active":"2024-09-21T03:18:31.963622+0000","last_peered":"2024-09-21T03:18:31.963622+0000","last_clean":"2024-09-21T03:18:31.963622+0000","last_became_active":"2024-09-21T03:18:29.409965+0000","last_became_peered":"2024-09-21T03:18:29.409965+0000","last_unstale":"2024-09-21T03:18:31.963622+0000","last_undegraded":"2024-09-21T03:18:31.963622+0000","last_fullsized":"2024-09-21T03:18:31.963622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:43.014716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963980+0000","last_change":"2024-09-21T03:18:30.418184+0000","last_active":"2024-09-21T03:18:31.963980+0000","last_peered":"2024-09-21T03:18:31.963980+0000","last_clean":"2024-09-21T03:18:31.963980+0000","last_became_active":"2024-09-21T03:18:30.417865+0000","last_became_peered":"2024-09-21T03:18:30.417865+0000","last_unstale":"2024-09-21T03:18:31.963980+0000","last_undegraded":"2024-09-21T03:18:31.963980+0000","last_fullsized":"2024-09-21T03:18:31.963980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:24:42.041578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964437+0000","last_change":"2024-09-21T03:18:29.407648+0000","last_active":"2024-09-21T03:18:31.964437+0000","last_peered":"2024-09-21T03:18:31.964437+0000","last_clean":"2024-09-21T03:18:31.964437+0000","last_became_active":"2024-09-21T03:18:29.407300+0000","last_became_peered":"2024-09-21T03:18:29.407300+0000","last_unstale":"2024-09-21T03:18:31.964437+0000","last_undegraded":"2024-09-21T03:18:31.964437+0000","last_fullsized":"2024-09-21T03:18:31.964437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:27.237523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963902+0000","last_change":"2024-09-21T03:18:30.413724+0000","last_active":"2024-09-21T03:18:31.963902+0000","last_peered":"2024-09-21T03:18:31.963902+0000","last_clean":"2024-09-21T03:18:31.963902+0000","last_became_active":"2024-09-21T03:18:30.413106+0000","last_became_peered":"2024-09-21T03:18:30.413106+0000","last_unstale":"2024-09-21T03:18:31.963902+0000","last_undegraded":"2024-09-21T03:18:31.963902+0000","last_fullsized":"2024-09-21T03:18:31.963902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:51.420496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406866+0000","last_change":"2024-09-21T03:18:29.406529+0000","last_active":"2024-09-21T03:18:31.406866+0000","last_peered":"2024-09-21T03:18:31.406866+0000","last_clean":"2024-09-21T03:18:31.406866+0000","last_became_active":"2024-09-21T03:18:29.406195+0000","last_became_peered":"2024-09-21T03:18:29.406195+0000","last_unstale":"2024-09-21T03:18:31.406866+0000","last_undegraded":"2024-09-21T03:18:31.406866+0000","last_fullsized":"2024-09-21T03:18:31.406866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:03:55.435346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406866+0000","last_change":"2024-09-21T03:18:30.402788+0000","last_active":"2024-09-21T03:18:31.406866+0000","last_peered":"2024-09-21T03:18:31.406866+0000","last_clean":"2024-09-21T03:18:31.406866+0000","last_became_active":"2024-09-21T03:18:30.400506+0000","last_became_peered":"2024-09-21T03:18:30.400506+0000","last_unstale":"2024-09-21T03:18:31.406866+0000","last_undegraded":"2024-09-21T03:18:31.406866+0000","last_fullsized":"2024-09-21T03:18:31.406866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:49.705469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964074+0000","last_change":"2024-09-21T03:18:29.410309+0000","last_active":"2024-09-21T03:18:31.964074+0000","last_peered":"2024-09-21T03:18:31.964074+0000","last_clean":"2024-09-21T03:18:31.964074+0000","last_became_active":"2024-09-21T03:18:29.409959+0000","last_became_peered":"2024-09-21T03:18:29.409959+0000","last_unstale":"2024-09-21T03:18:31.964074+0000","last_undegraded":"2024-09-21T03:18:31.964074+0000","last_fullsized":"2024-09-21T03:18:31.964074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:52.457819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":831488,"data_stored":672185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":81325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":245760,"data_stored":81361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":81395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":839680,"data_stored":672241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:18:41.971 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:18:42.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.117+0000 7f80fc24d640 1 -- 172.21.15.105:0/2698943492 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80f415c6f0 msgr2=0x7f80f40ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:42.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.117+0000 7f80fc24d640 1 --2- 172.21.15.105:0/2698943492 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80f415c6f0 0x7f80f40ceb50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f80e8009830 tx=0x7f80e802a510 comp rx=0 tx=0).stop 2024-09-21T03:18:42.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.117+0000 7f80fc24d640 1 -- 172.21.15.105:0/2698943492 shutdown_connections 2024-09-21T03:18:42.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.117+0000 7f80fc24d640 1 --2- 172.21.15.105:0/2698943492 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80f415c6f0 0x7f80f40ceb50 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:42.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.117+0000 7f80fc24d640 1 --2- 172.21.15.105:0/2698943492 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80f40d1d40 0x7f80f40b5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:42.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.117+0000 7f80fc24d640 1 -- 172.21.15.105:0/2698943492 >> 172.21.15.105:0/2698943492 conn(0x7f80f40b3f10 msgr2=0x7f80f40b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:42.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.117+0000 7f80fc24d640 1 -- 172.21.15.105:0/2698943492 shutdown_connections 2024-09-21T03:18:42.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.117+0000 7f80fc24d640 1 -- 172.21.15.105:0/2698943492 wait complete. 2024-09-21T03:18:42.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.119+0000 7f80fc24d640 1 Processor -- start 2024-09-21T03:18:42.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.119+0000 7f80fc24d640 1 -- start start 2024-09-21T03:18:42.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.120+0000 7f80fc24d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80f40ccba0 0x7f80f41f6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:42.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.120+0000 7f80fc24d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80f40d1d40 0x7f80f40b0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:42.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.120+0000 7f80fc24d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80f415c6f0 0x7f80f40cb630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:42.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.120+0000 7f80fc24d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f80f40d12d0 con 0x7f80f40d1d40 2024-09-21T03:18:42.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.120+0000 7f80fc24d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f80f40d1150 con 0x7f80f415c6f0 2024-09-21T03:18:42.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.120+0000 7f80fc24d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f80f40d1450 con 0x7f80f40ccba0 2024-09-21T03:18:42.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.120+0000 7f80f97e8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80f40d1d40 0x7f80f40b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:42.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.120+0000 7f80f97e8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80f40d1d40 0x7f80f40b0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40706/0 (socket says 172.21.15.105:40706) 2024-09-21T03:18:42.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.120+0000 7f80f97e8640 1 -- 172.21.15.105:0/1175080588 learned_addr learned my addr 172.21.15.105:0/1175080588 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:42.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.121+0000 7f80f9fe9640 1 --2- 172.21.15.105:0/1175080588 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80f40ccba0 0x7f80f41f6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:42.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.121+0000 7f80fa7ea640 1 --2- 172.21.15.105:0/1175080588 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80f415c6f0 0x7f80f40cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:42.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.121+0000 7f80f97e8640 1 -- 172.21.15.105:0/1175080588 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80f40ccba0 msgr2=0x7f80f41f6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:42.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.121+0000 7f80f97e8640 1 --2- 172.21.15.105:0/1175080588 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80f40ccba0 0x7f80f41f6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:42.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.121+0000 7f80f97e8640 1 -- 172.21.15.105:0/1175080588 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80f415c6f0 msgr2=0x7f80f40cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:42.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.121+0000 7f80f97e8640 1 --2- 172.21.15.105:0/1175080588 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80f415c6f0 0x7f80f40cb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:42.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.121+0000 7f80f97e8640 1 -- 172.21.15.105:0/1175080588 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80f41f7140 con 0x7f80f40d1d40 2024-09-21T03:18:42.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.121+0000 7f80f97e8640 1 --2- 172.21.15.105:0/1175080588 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80f40d1d40 0x7f80f40b0760 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f80e8000c00 tx=0x7f80e8033c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:42.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.121+0000 7f80f27fc640 1 -- 172.21.15.105:0/1175080588 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e8005c90 con 0x7f80f40d1d40 2024-09-21T03:18:42.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.121+0000 7f80f27fc640 1 -- 172.21.15.105:0/1175080588 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f80e8031e50 con 0x7f80f40d1d40 2024-09-21T03:18:42.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.121+0000 7f80fc24d640 1 -- 172.21.15.105:0/1175080588 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80f41f75c0 con 0x7f80f40d1d40 2024-09-21T03:18:42.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.121+0000 7f80f27fc640 1 -- 172.21.15.105:0/1175080588 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e8033310 con 0x7f80f40d1d40 2024-09-21T03:18:42.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.121+0000 7f80fc24d640 1 -- 172.21.15.105:0/1175080588 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80f41562d0 con 0x7f80f40d1d40 2024-09-21T03:18:42.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.122+0000 7f80fc24d640 1 -- 172.21.15.105:0/1175080588 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80f40d0120 con 0x7f80f40d1d40 2024-09-21T03:18:42.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.123+0000 7f80f27fc640 1 -- 172.21.15.105:0/1175080588 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f80e80334b0 con 0x7f80f40d1d40 2024-09-21T03:18:42.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.123+0000 7f80f27fc640 1 --2- 172.21.15.105:0/1175080588 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f80e0078bc0 0x7f80e007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:42.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.123+0000 7f80f27fc640 1 -- 172.21.15.105:0/1175080588 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f80e80bbf80 con 0x7f80f40d1d40 2024-09-21T03:18:42.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.123+0000 7f80f9fe9640 1 --2- 172.21.15.105:0/1175080588 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f80e0078bc0 0x7f80e007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:42.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.124+0000 7f80f9fe9640 1 --2- 172.21.15.105:0/1175080588 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f80e0078bc0 0x7f80e007b0d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f80e4005fd0 tx=0x7f80e40095e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:42.129 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.128+0000 7f80f27fc640 1 -- 172.21.15.105:0/1175080588 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f80f40d0120 con 0x7f80f40d1d40 2024-09-21T03:18:42.303 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.301+0000 7f80fc24d640 1 -- 172.21.15.105:0/1175080588 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f80f40d1970 con 0x7f80e0078bc0 2024-09-21T03:18:42.307 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.306+0000 7f80f27fc640 1 -- 172.21.15.105:0/1175080588 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251826 (secure 0 0 0) 0x7f80f40d1970 con 0x7f80e0078bc0 2024-09-21T03:18:42.310 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:18:42.311 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:18:42.312 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.309+0000 7f80fc24d640 1 -- 172.21.15.105:0/1175080588 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f80e0078bc0 msgr2=0x7f80e007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:42.312 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.309+0000 7f80fc24d640 1 --2- 172.21.15.105:0/1175080588 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f80e0078bc0 0x7f80e007b0d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f80e4005fd0 tx=0x7f80e40095e0 comp rx=0 tx=0).stop 2024-09-21T03:18:42.312 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.309+0000 7f80fc24d640 1 -- 172.21.15.105:0/1175080588 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80f40d1d40 msgr2=0x7f80f40b0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:42.312 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.309+0000 7f80fc24d640 1 --2- 172.21.15.105:0/1175080588 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80f40d1d40 0x7f80f40b0760 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f80e8000c00 tx=0x7f80e8033c90 comp rx=0 tx=0).stop 2024-09-21T03:18:42.312 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.309+0000 7f80fc24d640 1 -- 172.21.15.105:0/1175080588 shutdown_connections 2024-09-21T03:18:42.313 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.309+0000 7f80fc24d640 1 --2- 172.21.15.105:0/1175080588 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f80e0078bc0 0x7f80e007b0d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:42.313 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.309+0000 7f80fc24d640 1 --2- 172.21.15.105:0/1175080588 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80f415c6f0 0x7f80f40cb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:42.313 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.309+0000 7f80fc24d640 1 --2- 172.21.15.105:0/1175080588 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80f40d1d40 0x7f80f40b0760 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:42.313 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.309+0000 7f80fc24d640 1 --2- 172.21.15.105:0/1175080588 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80f40ccba0 0x7f80f41f6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:42.313 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.309+0000 7f80fc24d640 1 -- 172.21.15.105:0/1175080588 >> 172.21.15.105:0/1175080588 conn(0x7f80f40b3f10 msgr2=0x7f80f40b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:42.313 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.309+0000 7f80fc24d640 1 -- 172.21.15.105:0/1175080588 shutdown_connections 2024-09-21T03:18:42.313 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.309+0000 7f80fc24d640 1 -- 172.21.15.105:0/1175080588 wait complete. 2024-09-21T03:18:42.321 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-09-21T03:18:41.281526+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219288,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755432,"statfs":{"total":773094113280,"available":772869562368,"internally_reserved":0,"allocated":3121152,"data_stored":1835436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002774"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964347+0000","last_change":"2024-09-21T03:18:30.421775+0000","last_active":"2024-09-21T03:18:31.964347+0000","last_peered":"2024-09-21T03:18:31.964347+0000","last_clean":"2024-09-21T03:18:31.964347+0000","last_became_active":"2024-09-21T03:18:30.421134+0000","last_became_peered":"2024-09-21T03:18:30.421134+0000","last_unstale":"2024-09-21T03:18:31.964347+0000","last_undegraded":"2024-09-21T03:18:31.964347+0000","last_fullsized":"2024-09-21T03:18:31.964347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:22:19.398695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963048+0000","last_change":"2024-09-21T03:18:30.413336+0000","last_active":"2024-09-21T03:18:31.963048+0000","last_peered":"2024-09-21T03:18:31.963048+0000","last_clean":"2024-09-21T03:18:31.963048+0000","last_became_active":"2024-09-21T03:18:30.412935+0000","last_became_peered":"2024-09-21T03:18:30.412935+0000","last_unstale":"2024-09-21T03:18:31.963048+0000","last_undegraded":"2024-09-21T03:18:31.963048+0000","last_fullsized":"2024-09-21T03:18:31.963048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:23.469160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963279+0000","last_change":"2024-09-21T03:18:30.406431+0000","last_active":"2024-09-21T03:18:31.963279+0000","last_peered":"2024-09-21T03:18:31.963279+0000","last_clean":"2024-09-21T03:18:31.963279+0000","last_became_active":"2024-09-21T03:18:30.406082+0000","last_became_peered":"2024-09-21T03:18:30.406082+0000","last_unstale":"2024-09-21T03:18:31.963279+0000","last_undegraded":"2024-09-21T03:18:31.963279+0000","last_fullsized":"2024-09-21T03:18:31.963279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:23:40.341066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964108+0000","last_change":"2024-09-21T03:18:30.420362+0000","last_active":"2024-09-21T03:18:31.964108+0000","last_peered":"2024-09-21T03:18:31.964108+0000","last_clean":"2024-09-21T03:18:31.964108+0000","last_became_active":"2024-09-21T03:18:30.420008+0000","last_became_peered":"2024-09-21T03:18:30.420008+0000","last_unstale":"2024-09-21T03:18:31.964108+0000","last_undegraded":"2024-09-21T03:18:31.964108+0000","last_fullsized":"2024-09-21T03:18:31.964108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:03.282327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964438+0000","last_change":"2024-09-21T03:18:30.418302+0000","last_active":"2024-09-21T03:18:31.964438+0000","last_peered":"2024-09-21T03:18:31.964438+0000","last_clean":"2024-09-21T03:18:31.964438+0000","last_became_active":"2024-09-21T03:18:30.413965+0000","last_became_peered":"2024-09-21T03:18:30.413965+0000","last_unstale":"2024-09-21T03:18:31.964438+0000","last_undegraded":"2024-09-21T03:18:31.964438+0000","last_fullsized":"2024-09-21T03:18:31.964438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:03.282327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963716+0000","last_change":"2024-09-21T03:18:30.417641+0000","last_active":"2024-09-21T03:18:31.963716+0000","last_peered":"2024-09-21T03:18:31.963716+0000","last_clean":"2024-09-21T03:18:31.963716+0000","last_became_active":"2024-09-21T03:18:30.417338+0000","last_became_peered":"2024-09-21T03:18:30.417338+0000","last_unstale":"2024-09-21T03:18:31.963716+0000","last_undegraded":"2024-09-21T03:18:31.963716+0000","last_fullsized":"2024-09-21T03:18:31.963716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:23.551826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963715+0000","last_change":"2024-09-21T03:18:30.420816+0000","last_active":"2024-09-21T03:18:31.963715+0000","last_peered":"2024-09-21T03:18:31.963715+0000","last_clean":"2024-09-21T03:18:31.963715+0000","last_became_active":"2024-09-21T03:18:30.419232+0000","last_became_peered":"2024-09-21T03:18:30.419232+0000","last_unstale":"2024-09-21T03:18:31.963715+0000","last_undegraded":"2024-09-21T03:18:31.963715+0000","last_fullsized":"2024-09-21T03:18:31.963715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:42.098569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406163+0000","last_change":"2024-09-21T03:18:30.412879+0000","last_active":"2024-09-21T03:18:31.406163+0000","last_peered":"2024-09-21T03:18:31.406163+0000","last_clean":"2024-09-21T03:18:31.406163+0000","last_became_active":"2024-09-21T03:18:30.412496+0000","last_became_peered":"2024-09-21T03:18:30.412496+0000","last_unstale":"2024-09-21T03:18:31.406163+0000","last_undegraded":"2024-09-21T03:18:31.406163+0000","last_fullsized":"2024-09-21T03:18:31.406163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:27.777960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964687+0000","last_change":"2024-09-21T03:18:30.421800+0000","last_active":"2024-09-21T03:18:31.964687+0000","last_peered":"2024-09-21T03:18:31.964687+0000","last_clean":"2024-09-21T03:18:31.964687+0000","last_became_active":"2024-09-21T03:18:30.421488+0000","last_became_peered":"2024-09-21T03:18:30.421488+0000","last_unstale":"2024-09-21T03:18:31.964687+0000","last_undegraded":"2024-09-21T03:18:31.964687+0000","last_fullsized":"2024-09-21T03:18:31.964687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:52:00.902253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.410872+0000","last_change":"2024-09-21T03:18:30.412736+0000","last_active":"2024-09-21T03:18:31.410872+0000","last_peered":"2024-09-21T03:18:31.410872+0000","last_clean":"2024-09-21T03:18:31.410872+0000","last_became_active":"2024-09-21T03:18:30.412083+0000","last_became_peered":"2024-09-21T03:18:30.412083+0000","last_unstale":"2024-09-21T03:18:31.410872+0000","last_undegraded":"2024-09-21T03:18:31.410872+0000","last_fullsized":"2024-09-21T03:18:31.410872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:14:17.253259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.409843+0000","last_change":"2024-09-21T03:18:30.413123+0000","last_active":"2024-09-21T03:18:31.409843+0000","last_peered":"2024-09-21T03:18:31.409843+0000","last_clean":"2024-09-21T03:18:31.409843+0000","last_became_active":"2024-09-21T03:18:30.412788+0000","last_became_peered":"2024-09-21T03:18:30.412788+0000","last_unstale":"2024-09-21T03:18:31.409843+0000","last_undegraded":"2024-09-21T03:18:31.409843+0000","last_fullsized":"2024-09-21T03:18:31.409843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:37:21.324892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.409635+0000","last_change":"2024-09-21T03:18:30.396144+0000","last_active":"2024-09-21T03:18:31.409635+0000","last_peered":"2024-09-21T03:18:31.409635+0000","last_clean":"2024-09-21T03:18:31.409635+0000","last_became_active":"2024-09-21T03:18:30.395814+0000","last_became_peered":"2024-09-21T03:18:30.395814+0000","last_unstale":"2024-09-21T03:18:31.409635+0000","last_undegraded":"2024-09-21T03:18:31.409635+0000","last_fullsized":"2024-09-21T03:18:31.409635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:44.020518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406573+0000","last_change":"2024-09-21T03:18:30.402434+0000","last_active":"2024-09-21T03:18:31.406573+0000","last_peered":"2024-09-21T03:18:31.406573+0000","last_clean":"2024-09-21T03:18:31.406573+0000","last_became_active":"2024-09-21T03:18:30.402116+0000","last_became_peered":"2024-09-21T03:18:30.402116+0000","last_unstale":"2024-09-21T03:18:31.406573+0000","last_undegraded":"2024-09-21T03:18:31.406573+0000","last_fullsized":"2024-09-21T03:18:31.406573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:21.239439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963837+0000","last_change":"2024-09-21T03:18:30.407726+0000","last_active":"2024-09-21T03:18:31.963837+0000","last_peered":"2024-09-21T03:18:31.963837+0000","last_clean":"2024-09-21T03:18:31.963837+0000","last_became_active":"2024-09-21T03:18:30.404823+0000","last_became_peered":"2024-09-21T03:18:30.404823+0000","last_unstale":"2024-09-21T03:18:31.963837+0000","last_undegraded":"2024-09-21T03:18:31.963837+0000","last_fullsized":"2024-09-21T03:18:31.963837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:08:34.397671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963083+0000","last_change":"2024-09-21T03:18:30.400323+0000","last_active":"2024-09-21T03:18:31.963083+0000","last_peered":"2024-09-21T03:18:31.963083+0000","last_clean":"2024-09-21T03:18:31.963083+0000","last_became_active":"2024-09-21T03:18:30.399972+0000","last_became_peered":"2024-09-21T03:18:30.399972+0000","last_unstale":"2024-09-21T03:18:31.963083+0000","last_undegraded":"2024-09-21T03:18:31.963083+0000","last_fullsized":"2024-09-21T03:18:31.963083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:15.659300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963314+0000","last_change":"2024-09-21T03:18:30.418155+0000","last_active":"2024-09-21T03:18:31.963314+0000","last_peered":"2024-09-21T03:18:31.963314+0000","last_clean":"2024-09-21T03:18:31.963314+0000","last_became_active":"2024-09-21T03:18:30.417794+0000","last_became_peered":"2024-09-21T03:18:30.417794+0000","last_unstale":"2024-09-21T03:18:31.963314+0000","last_undegraded":"2024-09-21T03:18:31.963314+0000","last_fullsized":"2024-09-21T03:18:31.963314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:15.659300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963961+0000","last_change":"2024-09-21T03:18:30.411196+0000","last_active":"2024-09-21T03:18:31.963961+0000","last_peered":"2024-09-21T03:18:31.963961+0000","last_clean":"2024-09-21T03:18:31.963961+0000","last_became_active":"2024-09-21T03:18:30.410865+0000","last_became_peered":"2024-09-21T03:18:30.410865+0000","last_unstale":"2024-09-21T03:18:31.963961+0000","last_undegraded":"2024-09-21T03:18:31.963961+0000","last_fullsized":"2024-09-21T03:18:31.963961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:54.882986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963694+0000","last_change":"2024-09-21T03:18:30.400114+0000","last_active":"2024-09-21T03:18:31.963694+0000","last_peered":"2024-09-21T03:18:31.963694+0000","last_clean":"2024-09-21T03:18:31.963694+0000","last_became_active":"2024-09-21T03:18:30.399748+0000","last_became_peered":"2024-09-21T03:18:30.399748+0000","last_unstale":"2024-09-21T03:18:31.963694+0000","last_undegraded":"2024-09-21T03:18:31.963694+0000","last_fullsized":"2024-09-21T03:18:31.963694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:25.808010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964697+0000","last_change":"2024-09-21T03:18:30.409223+0000","last_active":"2024-09-21T03:18:31.964697+0000","last_peered":"2024-09-21T03:18:31.964697+0000","last_clean":"2024-09-21T03:18:31.964697+0000","last_became_active":"2024-09-21T03:18:30.408876+0000","last_became_peered":"2024-09-21T03:18:30.408876+0000","last_unstale":"2024-09-21T03:18:31.964697+0000","last_undegraded":"2024-09-21T03:18:31.964697+0000","last_fullsized":"2024-09-21T03:18:31.964697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:55:03.483520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.410645+0000","last_change":"2024-09-21T03:18:30.398035+0000","last_active":"2024-09-21T03:18:31.410645+0000","last_peered":"2024-09-21T03:18:31.410645+0000","last_clean":"2024-09-21T03:18:31.410645+0000","last_became_active":"2024-09-21T03:18:30.397692+0000","last_became_peered":"2024-09-21T03:18:30.397692+0000","last_unstale":"2024-09-21T03:18:31.410645+0000","last_undegraded":"2024-09-21T03:18:31.410645+0000","last_fullsized":"2024-09-21T03:18:31.410645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:18.166927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963501+0000","last_change":"2024-09-21T03:18:30.410634+0000","last_active":"2024-09-21T03:18:31.963501+0000","last_peered":"2024-09-21T03:18:31.963501+0000","last_clean":"2024-09-21T03:18:31.963501+0000","last_became_active":"2024-09-21T03:18:30.410352+0000","last_became_peered":"2024-09-21T03:18:30.410352+0000","last_unstale":"2024-09-21T03:18:31.963501+0000","last_undegraded":"2024-09-21T03:18:31.963501+0000","last_fullsized":"2024-09-21T03:18:31.963501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:21:10.314462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963467+0000","last_change":"2024-09-21T03:18:30.412518+0000","last_active":"2024-09-21T03:18:31.963467+0000","last_peered":"2024-09-21T03:18:31.963467+0000","last_clean":"2024-09-21T03:18:31.963467+0000","last_became_active":"2024-09-21T03:18:30.411784+0000","last_became_peered":"2024-09-21T03:18:30.411784+0000","last_unstale":"2024-09-21T03:18:31.963467+0000","last_undegraded":"2024-09-21T03:18:31.963467+0000","last_fullsized":"2024-09-21T03:18:31.963467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:11.956694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406217+0000","last_change":"2024-09-21T03:18:30.400029+0000","last_active":"2024-09-21T03:18:31.406217+0000","last_peered":"2024-09-21T03:18:31.406217+0000","last_clean":"2024-09-21T03:18:31.406217+0000","last_became_active":"2024-09-21T03:18:30.399708+0000","last_became_peered":"2024-09-21T03:18:30.399708+0000","last_unstale":"2024-09-21T03:18:31.406217+0000","last_undegraded":"2024-09-21T03:18:31.406217+0000","last_fullsized":"2024-09-21T03:18:31.406217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:45.250175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963526+0000","last_change":"2024-09-21T03:18:30.417315+0000","last_active":"2024-09-21T03:18:31.963526+0000","last_peered":"2024-09-21T03:18:31.963526+0000","last_clean":"2024-09-21T03:18:31.963526+0000","last_became_active":"2024-09-21T03:18:30.417005+0000","last_became_peered":"2024-09-21T03:18:30.417005+0000","last_unstale":"2024-09-21T03:18:31.963526+0000","last_undegraded":"2024-09-21T03:18:31.963526+0000","last_fullsized":"2024-09-21T03:18:31.963526+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:21.239439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406541+0000","last_change":"2024-09-21T03:18:30.408987+0000","last_active":"2024-09-21T03:18:31.406541+0000","last_peered":"2024-09-21T03:18:31.406541+0000","last_clean":"2024-09-21T03:18:31.406541+0000","last_became_active":"2024-09-21T03:18:30.408657+0000","last_became_peered":"2024-09-21T03:18:30.408657+0000","last_unstale":"2024-09-21T03:18:31.406541+0000","last_undegraded":"2024-09-21T03:18:31.406541+0000","last_fullsized":"2024-09-21T03:18:31.406541+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:14:17.253259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.410869+0000","last_change":"2024-09-21T03:18:30.409463+0000","last_active":"2024-09-21T03:18:31.410869+0000","last_peered":"2024-09-21T03:18:31.410869+0000","last_clean":"2024-09-21T03:18:31.410869+0000","last_became_active":"2024-09-21T03:18:30.409130+0000","last_became_peered":"2024-09-21T03:18:30.409130+0000","last_unstale":"2024-09-21T03:18:31.410869+0000","last_undegraded":"2024-09-21T03:18:31.410869+0000","last_fullsized":"2024-09-21T03:18:31.410869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:31.370175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963297+0000","last_change":"2024-09-21T03:18:30.415501+0000","last_active":"2024-09-21T03:18:31.963297+0000","last_peered":"2024-09-21T03:18:31.963297+0000","last_clean":"2024-09-21T03:18:31.963297+0000","last_became_active":"2024-09-21T03:18:30.415201+0000","last_became_peered":"2024-09-21T03:18:30.415201+0000","last_unstale":"2024-09-21T03:18:31.963297+0000","last_undegraded":"2024-09-21T03:18:31.963297+0000","last_fullsized":"2024-09-21T03:18:31.963297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:41:11.956694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406534+0000","last_change":"2024-09-21T03:18:30.409337+0000","last_active":"2024-09-21T03:18:31.406534+0000","last_peered":"2024-09-21T03:18:31.406534+0000","last_clean":"2024-09-21T03:18:31.406534+0000","last_became_active":"2024-09-21T03:18:30.409034+0000","last_became_peered":"2024-09-21T03:18:30.409034+0000","last_unstale":"2024-09-21T03:18:31.406534+0000","last_undegraded":"2024-09-21T03:18:31.406534+0000","last_fullsized":"2024-09-21T03:18:31.406534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:15.659300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963865+0000","last_change":"2024-09-21T03:18:30.409071+0000","last_active":"2024-09-21T03:18:31.963865+0000","last_peered":"2024-09-21T03:18:31.963865+0000","last_clean":"2024-09-21T03:18:31.963865+0000","last_became_active":"2024-09-21T03:18:30.408769+0000","last_became_peered":"2024-09-21T03:18:30.408769+0000","last_unstale":"2024-09-21T03:18:31.963865+0000","last_undegraded":"2024-09-21T03:18:31.963865+0000","last_fullsized":"2024-09-21T03:18:31.963865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:26.009956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964289+0000","last_change":"2024-09-21T03:18:30.416900+0000","last_active":"2024-09-21T03:18:31.964289+0000","last_peered":"2024-09-21T03:18:31.964289+0000","last_clean":"2024-09-21T03:18:31.964289+0000","last_became_active":"2024-09-21T03:18:30.416566+0000","last_became_peered":"2024-09-21T03:18:30.416566+0000","last_unstale":"2024-09-21T03:18:31.964289+0000","last_undegraded":"2024-09-21T03:18:31.964289+0000","last_fullsized":"2024-09-21T03:18:31.964289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:52:00.902253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963482+0000","last_change":"2024-09-21T03:18:30.409381+0000","last_active":"2024-09-21T03:18:31.963482+0000","last_peered":"2024-09-21T03:18:31.963482+0000","last_clean":"2024-09-21T03:18:31.963482+0000","last_became_active":"2024-09-21T03:18:30.409066+0000","last_became_peered":"2024-09-21T03:18:30.409066+0000","last_unstale":"2024-09-21T03:18:31.963482+0000","last_undegraded":"2024-09-21T03:18:31.963482+0000","last_fullsized":"2024-09-21T03:18:31.963482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:44.039210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.409946+0000","last_change":"2024-09-21T03:18:30.413745+0000","last_active":"2024-09-21T03:18:31.409946+0000","last_peered":"2024-09-21T03:18:31.409946+0000","last_clean":"2024-09-21T03:18:31.409946+0000","last_became_active":"2024-09-21T03:18:30.413434+0000","last_became_peered":"2024-09-21T03:18:30.413434+0000","last_unstale":"2024-09-21T03:18:31.409946+0000","last_undegraded":"2024-09-21T03:18:31.409946+0000","last_fullsized":"2024-09-21T03:18:31.409946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:40.786257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.409337+0000","last_change":"2024-09-21T03:18:30.405133+0000","last_active":"2024-09-21T03:18:31.409337+0000","last_peered":"2024-09-21T03:18:31.409337+0000","last_clean":"2024-09-21T03:18:31.409337+0000","last_became_active":"2024-09-21T03:18:30.404795+0000","last_became_peered":"2024-09-21T03:18:30.404795+0000","last_unstale":"2024-09-21T03:18:31.409337+0000","last_undegraded":"2024-09-21T03:18:31.409337+0000","last_fullsized":"2024-09-21T03:18:31.409337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:26.872806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406704+0000","last_change":"2024-09-21T03:18:29.409241+0000","last_active":"2024-09-21T03:18:31.406704+0000","last_peered":"2024-09-21T03:18:31.406704+0000","last_clean":"2024-09-21T03:18:31.406704+0000","last_became_active":"2024-09-21T03:18:29.408988+0000","last_became_peered":"2024-09-21T03:18:29.408988+0000","last_unstale":"2024-09-21T03:18:31.406704+0000","last_undegraded":"2024-09-21T03:18:31.406704+0000","last_fullsized":"2024-09-21T03:18:31.406704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:52.299913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964047+0000","last_change":"2024-09-21T03:18:30.406637+0000","last_active":"2024-09-21T03:18:31.964047+0000","last_peered":"2024-09-21T03:18:31.964047+0000","last_clean":"2024-09-21T03:18:31.964047+0000","last_became_active":"2024-09-21T03:18:30.405638+0000","last_became_peered":"2024-09-21T03:18:30.405638+0000","last_unstale":"2024-09-21T03:18:31.964047+0000","last_undegraded":"2024-09-21T03:18:31.964047+0000","last_fullsized":"2024-09-21T03:18:31.964047+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:25.913095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.410144+0000","last_change":"2024-09-21T03:18:29.401902+0000","last_active":"2024-09-21T03:18:31.410144+0000","last_peered":"2024-09-21T03:18:31.410144+0000","last_clean":"2024-09-21T03:18:31.410144+0000","last_became_active":"2024-09-21T03:18:29.401056+0000","last_became_peered":"2024-09-21T03:18:29.401056+0000","last_unstale":"2024-09-21T03:18:31.410144+0000","last_undegraded":"2024-09-21T03:18:31.410144+0000","last_fullsized":"2024-09-21T03:18:31.410144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:41.323758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406156+0000","last_change":"2024-09-21T03:18:29.403151+0000","last_active":"2024-09-21T03:18:31.406156+0000","last_peered":"2024-09-21T03:18:31.406156+0000","last_clean":"2024-09-21T03:18:31.406156+0000","last_became_active":"2024-09-21T03:18:29.402799+0000","last_became_peered":"2024-09-21T03:18:29.402799+0000","last_unstale":"2024-09-21T03:18:31.406156+0000","last_undegraded":"2024-09-21T03:18:31.406156+0000","last_fullsized":"2024-09-21T03:18:31.406156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:50.682717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406269+0000","last_change":"2024-09-21T03:18:30.417827+0000","last_active":"2024-09-21T03:18:31.406269+0000","last_peered":"2024-09-21T03:18:31.406269+0000","last_clean":"2024-09-21T03:18:31.406269+0000","last_became_active":"2024-09-21T03:18:30.417509+0000","last_became_peered":"2024-09-21T03:18:30.417509+0000","last_unstale":"2024-09-21T03:18:31.406269+0000","last_undegraded":"2024-09-21T03:18:31.406269+0000","last_fullsized":"2024-09-21T03:18:31.406269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:03.094324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963424+0000","last_change":"2024-09-21T03:18:29.406382+0000","last_active":"2024-09-21T03:18:31.963424+0000","last_peered":"2024-09-21T03:18:31.963424+0000","last_clean":"2024-09-21T03:18:31.963424+0000","last_became_active":"2024-09-21T03:18:29.405616+0000","last_became_peered":"2024-09-21T03:18:29.405616+0000","last_unstale":"2024-09-21T03:18:31.963424+0000","last_undegraded":"2024-09-21T03:18:31.963424+0000","last_fullsized":"2024-09-21T03:18:31.963424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:45.917164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.962705+0000","last_change":"2024-09-21T03:18:30.402277+0000","last_active":"2024-09-21T03:18:31.962705+0000","last_peered":"2024-09-21T03:18:31.962705+0000","last_clean":"2024-09-21T03:18:31.962705+0000","last_became_active":"2024-09-21T03:18:30.401923+0000","last_became_peered":"2024-09-21T03:18:30.401923+0000","last_unstale":"2024-09-21T03:18:31.962705+0000","last_undegraded":"2024-09-21T03:18:31.962705+0000","last_fullsized":"2024-09-21T03:18:31.962705+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:45.250175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.410347+0000","last_change":"2024-09-21T03:18:29.407735+0000","last_active":"2024-09-21T03:18:31.410347+0000","last_peered":"2024-09-21T03:18:31.410347+0000","last_clean":"2024-09-21T03:18:31.410347+0000","last_became_active":"2024-09-21T03:18:29.407377+0000","last_became_peered":"2024-09-21T03:18:29.407377+0000","last_unstale":"2024-09-21T03:18:31.410347+0000","last_undegraded":"2024-09-21T03:18:31.410347+0000","last_fullsized":"2024-09-21T03:18:31.410347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:25.867003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963866+0000","last_change":"2024-09-21T03:18:30.411099+0000","last_active":"2024-09-21T03:18:31.963866+0000","last_peered":"2024-09-21T03:18:31.963866+0000","last_clean":"2024-09-21T03:18:31.963866+0000","last_became_active":"2024-09-21T03:18:30.410755+0000","last_became_peered":"2024-09-21T03:18:30.410755+0000","last_unstale":"2024-09-21T03:18:31.963866+0000","last_undegraded":"2024-09-21T03:18:31.963866+0000","last_fullsized":"2024-09-21T03:18:31.963866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:49.705469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963834+0000","last_change":"2024-09-21T03:18:29.408842+0000","last_active":"2024-09-21T03:18:31.963834+0000","last_peered":"2024-09-21T03:18:31.963834+0000","last_clean":"2024-09-21T03:18:31.963834+0000","last_became_active":"2024-09-21T03:18:29.408345+0000","last_became_peered":"2024-09-21T03:18:29.408345+0000","last_unstale":"2024-09-21T03:18:31.963834+0000","last_undegraded":"2024-09-21T03:18:31.963834+0000","last_fullsized":"2024-09-21T03:18:31.963834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:22.158750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963990+0000","last_change":"2024-09-21T03:18:30.413425+0000","last_active":"2024-09-21T03:18:31.963990+0000","last_peered":"2024-09-21T03:18:31.963990+0000","last_clean":"2024-09-21T03:18:31.963990+0000","last_became_active":"2024-09-21T03:18:30.412694+0000","last_became_peered":"2024-09-21T03:18:30.412694+0000","last_unstale":"2024-09-21T03:18:31.963990+0000","last_undegraded":"2024-09-21T03:18:31.963990+0000","last_fullsized":"2024-09-21T03:18:31.963990+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:36.512318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963255+0000","last_change":"2024-09-21T03:18:29.407409+0000","last_active":"2024-09-21T03:18:31.963255+0000","last_peered":"2024-09-21T03:18:31.963255+0000","last_clean":"2024-09-21T03:18:31.963255+0000","last_became_active":"2024-09-21T03:18:29.407071+0000","last_became_peered":"2024-09-21T03:18:29.407071+0000","last_unstale":"2024-09-21T03:18:31.963255+0000","last_undegraded":"2024-09-21T03:18:31.963255+0000","last_fullsized":"2024-09-21T03:18:31.963255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:43.033407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.409859+0000","last_change":"2024-09-21T03:18:30.410735+0000","last_active":"2024-09-21T03:18:31.409859+0000","last_peered":"2024-09-21T03:18:31.409859+0000","last_clean":"2024-09-21T03:18:31.409859+0000","last_became_active":"2024-09-21T03:18:30.409130+0000","last_became_peered":"2024-09-21T03:18:30.409130+0000","last_unstale":"2024-09-21T03:18:31.409859+0000","last_undegraded":"2024-09-21T03:18:31.409859+0000","last_fullsized":"2024-09-21T03:18:31.409859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:28.243325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.410333+0000","last_change":"2024-09-21T03:18:29.402961+0000","last_active":"2024-09-21T03:18:31.410333+0000","last_peered":"2024-09-21T03:18:31.410333+0000","last_clean":"2024-09-21T03:18:31.410333+0000","last_became_active":"2024-09-21T03:18:29.402605+0000","last_became_peered":"2024-09-21T03:18:29.402605+0000","last_unstale":"2024-09-21T03:18:31.410333+0000","last_undegraded":"2024-09-21T03:18:31.410333+0000","last_fullsized":"2024-09-21T03:18:31.410333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:32.360810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964077+0000","last_change":"2024-09-21T03:18:30.416670+0000","last_active":"2024-09-21T03:18:31.964077+0000","last_peered":"2024-09-21T03:18:31.964077+0000","last_clean":"2024-09-21T03:18:31.964077+0000","last_became_active":"2024-09-21T03:18:30.416005+0000","last_became_peered":"2024-09-21T03:18:30.416005+0000","last_unstale":"2024-09-21T03:18:31.964077+0000","last_undegraded":"2024-09-21T03:18:31.964077+0000","last_fullsized":"2024-09-21T03:18:31.964077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:35.898216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964144+0000","last_change":"2024-09-21T03:18:29.405416+0000","last_active":"2024-09-21T03:18:31.964144+0000","last_peered":"2024-09-21T03:18:31.964144+0000","last_clean":"2024-09-21T03:18:31.964144+0000","last_became_active":"2024-09-21T03:18:29.405108+0000","last_became_peered":"2024-09-21T03:18:29.405108+0000","last_unstale":"2024-09-21T03:18:31.964144+0000","last_undegraded":"2024-09-21T03:18:31.964144+0000","last_fullsized":"2024-09-21T03:18:31.964144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:53.454590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963602+0000","last_change":"2024-09-21T03:18:30.409860+0000","last_active":"2024-09-21T03:18:31.963602+0000","last_peered":"2024-09-21T03:18:31.963602+0000","last_clean":"2024-09-21T03:18:31.963602+0000","last_became_active":"2024-09-21T03:18:30.409559+0000","last_became_peered":"2024-09-21T03:18:30.409559+0000","last_unstale":"2024-09-21T03:18:31.963602+0000","last_undegraded":"2024-09-21T03:18:31.963602+0000","last_fullsized":"2024-09-21T03:18:31.963602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:57.589254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964301+0000","last_change":"2024-09-21T03:18:29.413878+0000","last_active":"2024-09-21T03:18:31.964301+0000","last_peered":"2024-09-21T03:18:31.964301+0000","last_clean":"2024-09-21T03:18:31.964301+0000","last_became_active":"2024-09-21T03:18:29.413571+0000","last_became_peered":"2024-09-21T03:18:29.413571+0000","last_unstale":"2024-09-21T03:18:31.964301+0000","last_undegraded":"2024-09-21T03:18:31.964301+0000","last_fullsized":"2024-09-21T03:18:31.964301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:21.627091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964666+0000","last_change":"2024-09-21T03:18:30.416945+0000","last_active":"2024-09-21T03:18:31.964666+0000","last_peered":"2024-09-21T03:18:31.964666+0000","last_clean":"2024-09-21T03:18:31.964666+0000","last_became_active":"2024-09-21T03:18:30.416610+0000","last_became_peered":"2024-09-21T03:18:30.416610+0000","last_unstale":"2024-09-21T03:18:31.964666+0000","last_undegraded":"2024-09-21T03:18:31.964666+0000","last_fullsized":"2024-09-21T03:18:31.964666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:22:49.496448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.409505+0000","last_change":"2024-09-21T03:18:29.401191+0000","last_active":"2024-09-21T03:18:31.409505+0000","last_peered":"2024-09-21T03:18:31.409505+0000","last_clean":"2024-09-21T03:18:31.409505+0000","last_became_active":"2024-09-21T03:18:29.400775+0000","last_became_peered":"2024-09-21T03:18:29.400775+0000","last_unstale":"2024-09-21T03:18:31.409505+0000","last_undegraded":"2024-09-21T03:18:31.409505+0000","last_fullsized":"2024-09-21T03:18:31.409505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:03:55.435346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.410129+0000","last_change":"2024-09-21T03:18:30.406919+0000","last_active":"2024-09-21T03:18:31.410129+0000","last_peered":"2024-09-21T03:18:31.410129+0000","last_clean":"2024-09-21T03:18:31.410129+0000","last_became_active":"2024-09-21T03:18:30.406584+0000","last_became_peered":"2024-09-21T03:18:30.406584+0000","last_unstale":"2024-09-21T03:18:31.410129+0000","last_undegraded":"2024-09-21T03:18:31.410129+0000","last_fullsized":"2024-09-21T03:18:31.410129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:46.766926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963384+0000","last_change":"2024-09-21T03:18:29.401326+0000","last_active":"2024-09-21T03:18:31.963384+0000","last_peered":"2024-09-21T03:18:31.963384+0000","last_clean":"2024-09-21T03:18:31.963384+0000","last_became_active":"2024-09-21T03:18:29.400268+0000","last_became_peered":"2024-09-21T03:18:29.400268+0000","last_unstale":"2024-09-21T03:18:31.963384+0000","last_undegraded":"2024-09-21T03:18:31.963384+0000","last_fullsized":"2024-09-21T03:18:31.963384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:53:53.644507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964135+0000","last_change":"2024-09-21T03:18:30.420964+0000","last_active":"2024-09-21T03:18:31.964135+0000","last_peered":"2024-09-21T03:18:31.964135+0000","last_clean":"2024-09-21T03:18:31.964135+0000","last_became_active":"2024-09-21T03:18:30.420316+0000","last_became_peered":"2024-09-21T03:18:30.420316+0000","last_unstale":"2024-09-21T03:18:31.964135+0000","last_undegraded":"2024-09-21T03:18:31.964135+0000","last_fullsized":"2024-09-21T03:18:31.964135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:59.120847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.410688+0000","last_change":"2024-09-21T03:18:29.405556+0000","last_active":"2024-09-21T03:18:31.410688+0000","last_peered":"2024-09-21T03:18:31.410688+0000","last_clean":"2024-09-21T03:18:31.410688+0000","last_became_active":"2024-09-21T03:18:29.405128+0000","last_became_peered":"2024-09-21T03:18:29.405128+0000","last_unstale":"2024-09-21T03:18:31.410688+0000","last_undegraded":"2024-09-21T03:18:31.410688+0000","last_fullsized":"2024-09-21T03:18:31.410688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:08.606490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964082+0000","last_change":"2024-09-21T03:18:30.416107+0000","last_active":"2024-09-21T03:18:31.964082+0000","last_peered":"2024-09-21T03:18:31.964082+0000","last_clean":"2024-09-21T03:18:31.964082+0000","last_became_active":"2024-09-21T03:18:30.415764+0000","last_became_peered":"2024-09-21T03:18:30.415764+0000","last_unstale":"2024-09-21T03:18:31.964082+0000","last_undegraded":"2024-09-21T03:18:31.964082+0000","last_fullsized":"2024-09-21T03:18:31.964082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:40.961482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963646+0000","last_change":"2024-09-21T03:18:29.402215+0000","last_active":"2024-09-21T03:18:31.963646+0000","last_peered":"2024-09-21T03:18:31.963646+0000","last_clean":"2024-09-21T03:18:31.963646+0000","last_became_active":"2024-09-21T03:18:29.401853+0000","last_became_peered":"2024-09-21T03:18:29.401853+0000","last_unstale":"2024-09-21T03:18:31.963646+0000","last_undegraded":"2024-09-21T03:18:31.963646+0000","last_fullsized":"2024-09-21T03:18:31.963646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:22.158750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964837+0000","last_change":"2024-09-21T03:18:30.421447+0000","last_active":"2024-09-21T03:18:31.964837+0000","last_peered":"2024-09-21T03:18:31.964837+0000","last_clean":"2024-09-21T03:18:31.964837+0000","last_became_active":"2024-09-21T03:18:30.421061+0000","last_became_peered":"2024-09-21T03:18:30.421061+0000","last_unstale":"2024-09-21T03:18:31.964837+0000","last_undegraded":"2024-09-21T03:18:31.964837+0000","last_fullsized":"2024-09-21T03:18:31.964837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:04:34.616164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963366+0000","last_change":"2024-09-21T03:18:29.404008+0000","last_active":"2024-09-21T03:18:31.963366+0000","last_peered":"2024-09-21T03:18:31.963366+0000","last_clean":"2024-09-21T03:18:31.963366+0000","last_became_active":"2024-09-21T03:18:29.403700+0000","last_became_peered":"2024-09-21T03:18:29.403700+0000","last_unstale":"2024-09-21T03:18:31.963366+0000","last_undegraded":"2024-09-21T03:18:31.963366+0000","last_fullsized":"2024-09-21T03:18:31.963366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:24.802208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964230+0000","last_change":"2024-09-21T03:18:30.420751+0000","last_active":"2024-09-21T03:18:31.964230+0000","last_peered":"2024-09-21T03:18:31.964230+0000","last_clean":"2024-09-21T03:18:31.964230+0000","last_became_active":"2024-09-21T03:18:30.420401+0000","last_became_peered":"2024-09-21T03:18:30.420401+0000","last_unstale":"2024-09-21T03:18:31.964230+0000","last_undegraded":"2024-09-21T03:18:31.964230+0000","last_fullsized":"2024-09-21T03:18:31.964230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:55.226807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963123+0000","last_change":"2024-09-21T03:18:29.410099+0000","last_active":"2024-09-21T03:18:31.963123+0000","last_peered":"2024-09-21T03:18:31.963123+0000","last_clean":"2024-09-21T03:18:31.963123+0000","last_became_active":"2024-09-21T03:18:29.409723+0000","last_became_peered":"2024-09-21T03:18:29.409723+0000","last_unstale":"2024-09-21T03:18:31.963123+0000","last_undegraded":"2024-09-21T03:18:31.963123+0000","last_fullsized":"2024-09-21T03:18:31.963123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:43.447253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964356+0000","last_change":"2024-09-21T03:18:30.416344+0000","last_active":"2024-09-21T03:18:31.964356+0000","last_peered":"2024-09-21T03:18:31.964356+0000","last_clean":"2024-09-21T03:18:31.964356+0000","last_became_active":"2024-09-21T03:18:30.415584+0000","last_became_peered":"2024-09-21T03:18:30.415584+0000","last_unstale":"2024-09-21T03:18:31.964356+0000","last_undegraded":"2024-09-21T03:18:31.964356+0000","last_fullsized":"2024-09-21T03:18:31.964356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:24:42.041578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963862+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:18:31.963862+0000","last_peered":"2024-09-21T03:18:31.963862+0000","last_clean":"2024-09-21T03:18:31.963862+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:18:31.963862+0000","last_undegraded":"2024-09-21T03:18:31.963862+0000","last_fullsized":"2024-09-21T03:18:31.963862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963163+0000","last_change":"2024-09-21T03:18:29.407517+0000","last_active":"2024-09-21T03:18:31.963163+0000","last_peered":"2024-09-21T03:18:31.963163+0000","last_clean":"2024-09-21T03:18:31.963163+0000","last_became_active":"2024-09-21T03:18:29.407174+0000","last_became_peered":"2024-09-21T03:18:29.407174+0000","last_unstale":"2024-09-21T03:18:31.963163+0000","last_undegraded":"2024-09-21T03:18:31.963163+0000","last_fullsized":"2024-09-21T03:18:31.963163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:01:43.447253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406392+0000","last_change":"2024-09-21T03:18:30.416787+0000","last_active":"2024-09-21T03:18:31.406392+0000","last_peered":"2024-09-21T03:18:31.406392+0000","last_clean":"2024-09-21T03:18:31.406392+0000","last_became_active":"2024-09-21T03:18:30.416468+0000","last_became_peered":"2024-09-21T03:18:30.416468+0000","last_unstale":"2024-09-21T03:18:31.406392+0000","last_undegraded":"2024-09-21T03:18:31.406392+0000","last_fullsized":"2024-09-21T03:18:31.406392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:13.827662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963278+0000","last_change":"2024-09-21T03:18:29.400053+0000","last_active":"2024-09-21T03:18:31.963278+0000","last_peered":"2024-09-21T03:18:31.963278+0000","last_clean":"2024-09-21T03:18:31.963278+0000","last_became_active":"2024-09-21T03:18:29.399616+0000","last_became_peered":"2024-09-21T03:18:29.399616+0000","last_unstale":"2024-09-21T03:18:31.963278+0000","last_undegraded":"2024-09-21T03:18:31.963278+0000","last_fullsized":"2024-09-21T03:18:31.963278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:32.360810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.962934+0000","last_change":"2024-09-21T03:18:30.406884+0000","last_active":"2024-09-21T03:18:31.962934+0000","last_peered":"2024-09-21T03:18:31.962934+0000","last_clean":"2024-09-21T03:18:31.962934+0000","last_became_active":"2024-09-21T03:18:30.406497+0000","last_became_peered":"2024-09-21T03:18:30.406497+0000","last_unstale":"2024-09-21T03:18:31.962934+0000","last_undegraded":"2024-09-21T03:18:31.962934+0000","last_fullsized":"2024-09-21T03:18:31.962934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:25.356077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963522+0000","last_change":"2024-09-21T03:18:29.403123+0000","last_active":"2024-09-21T03:18:31.963522+0000","last_peered":"2024-09-21T03:18:31.963522+0000","last_clean":"2024-09-21T03:18:31.963522+0000","last_became_active":"2024-09-21T03:18:29.402613+0000","last_became_peered":"2024-09-21T03:18:29.402613+0000","last_unstale":"2024-09-21T03:18:31.963522+0000","last_undegraded":"2024-09-21T03:18:31.963522+0000","last_fullsized":"2024-09-21T03:18:31.963522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:45.917164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.962777+0000","last_change":"2024-09-21T03:18:30.401955+0000","last_active":"2024-09-21T03:18:31.962777+0000","last_peered":"2024-09-21T03:18:31.962777+0000","last_clean":"2024-09-21T03:18:31.962777+0000","last_became_active":"2024-09-21T03:18:30.401587+0000","last_became_peered":"2024-09-21T03:18:30.401587+0000","last_unstale":"2024-09-21T03:18:31.962777+0000","last_undegraded":"2024-09-21T03:18:31.962777+0000","last_fullsized":"2024-09-21T03:18:31.962777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:03.094324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964372+0000","last_change":"2024-09-21T03:18:29.407459+0000","last_active":"2024-09-21T03:18:31.964372+0000","last_peered":"2024-09-21T03:18:31.964372+0000","last_clean":"2024-09-21T03:18:31.964372+0000","last_became_active":"2024-09-21T03:18:29.407132+0000","last_became_peered":"2024-09-21T03:18:29.407132+0000","last_unstale":"2024-09-21T03:18:31.964372+0000","last_undegraded":"2024-09-21T03:18:31.964372+0000","last_fullsized":"2024-09-21T03:18:31.964372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:58.516525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.409395+0000","last_change":"2024-09-21T03:18:30.406973+0000","last_active":"2024-09-21T03:18:31.409395+0000","last_peered":"2024-09-21T03:18:31.409395+0000","last_clean":"2024-09-21T03:18:31.409395+0000","last_became_active":"2024-09-21T03:18:30.405992+0000","last_became_peered":"2024-09-21T03:18:30.405992+0000","last_unstale":"2024-09-21T03:18:31.409395+0000","last_undegraded":"2024-09-21T03:18:31.409395+0000","last_fullsized":"2024-09-21T03:18:31.409395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:33.366612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963029+0000","last_change":"2024-09-21T03:18:29.406073+0000","last_active":"2024-09-21T03:18:31.963029+0000","last_peered":"2024-09-21T03:18:31.963029+0000","last_clean":"2024-09-21T03:18:31.963029+0000","last_became_active":"2024-09-21T03:18:29.405786+0000","last_became_peered":"2024-09-21T03:18:29.405786+0000","last_unstale":"2024-09-21T03:18:31.963029+0000","last_undegraded":"2024-09-21T03:18:31.963029+0000","last_fullsized":"2024-09-21T03:18:31.963029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:45.917164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964101+0000","last_change":"2024-09-21T03:18:30.419736+0000","last_active":"2024-09-21T03:18:31.964101+0000","last_peered":"2024-09-21T03:18:31.964101+0000","last_clean":"2024-09-21T03:18:31.964101+0000","last_became_active":"2024-09-21T03:18:30.418805+0000","last_became_peered":"2024-09-21T03:18:30.418805+0000","last_unstale":"2024-09-21T03:18:31.964101+0000","last_undegraded":"2024-09-21T03:18:31.964101+0000","last_fullsized":"2024-09-21T03:18:31.964101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:14.331651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964588+0000","last_change":"2024-09-21T03:18:29.399297+0000","last_active":"2024-09-21T03:18:31.964588+0000","last_peered":"2024-09-21T03:18:31.964588+0000","last_clean":"2024-09-21T03:18:31.964588+0000","last_became_active":"2024-09-21T03:18:29.398956+0000","last_became_peered":"2024-09-21T03:18:29.398956+0000","last_unstale":"2024-09-21T03:18:31.964588+0000","last_undegraded":"2024-09-21T03:18:31.964588+0000","last_fullsized":"2024-09-21T03:18:31.964588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:03.278232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.962949+0000","last_change":"2024-09-21T03:18:30.402564+0000","last_active":"2024-09-21T03:18:31.962949+0000","last_peered":"2024-09-21T03:18:31.962949+0000","last_clean":"2024-09-21T03:18:31.962949+0000","last_became_active":"2024-09-21T03:18:30.401234+0000","last_became_peered":"2024-09-21T03:18:30.401234+0000","last_unstale":"2024-09-21T03:18:31.962949+0000","last_undegraded":"2024-09-21T03:18:31.962949+0000","last_fullsized":"2024-09-21T03:18:31.962949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:09:13.827662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.962727+0000","last_change":"2024-09-21T03:18:29.403088+0000","last_active":"2024-09-21T03:18:31.962727+0000","last_peered":"2024-09-21T03:18:31.962727+0000","last_clean":"2024-09-21T03:18:31.962727+0000","last_became_active":"2024-09-21T03:18:29.402795+0000","last_became_peered":"2024-09-21T03:18:29.402795+0000","last_unstale":"2024-09-21T03:18:31.962727+0000","last_undegraded":"2024-09-21T03:18:31.962727+0000","last_fullsized":"2024-09-21T03:18:31.962727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:22.158750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406630+0000","last_change":"2024-09-21T03:18:30.414287+0000","last_active":"2024-09-21T03:18:31.406630+0000","last_peered":"2024-09-21T03:18:31.406630+0000","last_clean":"2024-09-21T03:18:31.406630+0000","last_became_active":"2024-09-21T03:18:30.413950+0000","last_became_peered":"2024-09-21T03:18:30.413950+0000","last_unstale":"2024-09-21T03:18:31.406630+0000","last_undegraded":"2024-09-21T03:18:31.406630+0000","last_fullsized":"2024-09-21T03:18:31.406630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:23.551826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.410461+0000","last_change":"2024-09-21T03:18:29.406121+0000","last_active":"2024-09-21T03:18:31.410461+0000","last_peered":"2024-09-21T03:18:31.410461+0000","last_clean":"2024-09-21T03:18:31.410461+0000","last_became_active":"2024-09-21T03:18:29.405509+0000","last_became_peered":"2024-09-21T03:18:29.405509+0000","last_unstale":"2024-09-21T03:18:31.410461+0000","last_undegraded":"2024-09-21T03:18:31.410461+0000","last_fullsized":"2024-09-21T03:18:31.410461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:08.961149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963103+0000","last_change":"2024-09-21T03:18:30.404103+0000","last_active":"2024-09-21T03:18:31.963103+0000","last_peered":"2024-09-21T03:18:31.963103+0000","last_clean":"2024-09-21T03:18:31.963103+0000","last_became_active":"2024-09-21T03:18:30.402457+0000","last_became_peered":"2024-09-21T03:18:30.402457+0000","last_unstale":"2024-09-21T03:18:31.963103+0000","last_undegraded":"2024-09-21T03:18:31.963103+0000","last_fullsized":"2024-09-21T03:18:31.963103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:48.325684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963050+0000","last_change":"2024-09-21T03:18:29.405727+0000","last_active":"2024-09-21T03:18:31.963050+0000","last_peered":"2024-09-21T03:18:31.963050+0000","last_clean":"2024-09-21T03:18:31.963050+0000","last_became_active":"2024-09-21T03:18:29.405421+0000","last_became_peered":"2024-09-21T03:18:29.405421+0000","last_unstale":"2024-09-21T03:18:31.963050+0000","last_undegraded":"2024-09-21T03:18:31.963050+0000","last_fullsized":"2024-09-21T03:18:31.963050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:08.961149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.409341+0000","last_change":"2024-09-21T03:18:30.399926+0000","last_active":"2024-09-21T03:18:31.409341+0000","last_peered":"2024-09-21T03:18:31.409341+0000","last_clean":"2024-09-21T03:18:31.409341+0000","last_became_active":"2024-09-21T03:18:30.399600+0000","last_became_peered":"2024-09-21T03:18:30.399600+0000","last_unstale":"2024-09-21T03:18:31.409341+0000","last_undegraded":"2024-09-21T03:18:31.409341+0000","last_fullsized":"2024-09-21T03:18:31.409341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:23.164552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.962797+0000","last_change":"2024-09-21T03:18:29.405412+0000","last_active":"2024-09-21T03:18:31.962797+0000","last_peered":"2024-09-21T03:18:31.962797+0000","last_clean":"2024-09-21T03:18:31.962797+0000","last_became_active":"2024-09-21T03:18:29.405094+0000","last_became_peered":"2024-09-21T03:18:29.405094+0000","last_unstale":"2024-09-21T03:18:31.962797+0000","last_undegraded":"2024-09-21T03:18:31.962797+0000","last_fullsized":"2024-09-21T03:18:31.962797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:58.516525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406400+0000","last_change":"2024-09-21T03:18:30.405606+0000","last_active":"2024-09-21T03:18:31.406400+0000","last_peered":"2024-09-21T03:18:31.406400+0000","last_clean":"2024-09-21T03:18:31.406400+0000","last_became_active":"2024-09-21T03:18:30.403297+0000","last_became_peered":"2024-09-21T03:18:30.403297+0000","last_unstale":"2024-09-21T03:18:31.406400+0000","last_undegraded":"2024-09-21T03:18:31.406400+0000","last_fullsized":"2024-09-21T03:18:31.406400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:18.166927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963138+0000","last_change":"2024-09-21T03:18:29.400372+0000","last_active":"2024-09-21T03:18:31.963138+0000","last_peered":"2024-09-21T03:18:31.963138+0000","last_clean":"2024-09-21T03:18:31.963138+0000","last_became_active":"2024-09-21T03:18:29.400005+0000","last_became_peered":"2024-09-21T03:18:29.400005+0000","last_unstale":"2024-09-21T03:18:31.963138+0000","last_undegraded":"2024-09-21T03:18:31.963138+0000","last_fullsized":"2024-09-21T03:18:31.963138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:21.627091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406843+0000","last_change":"2024-09-21T03:18:30.418312+0000","last_active":"2024-09-21T03:18:31.406843+0000","last_peered":"2024-09-21T03:18:31.406843+0000","last_clean":"2024-09-21T03:18:31.406843+0000","last_became_active":"2024-09-21T03:18:30.417984+0000","last_became_peered":"2024-09-21T03:18:30.417984+0000","last_unstale":"2024-09-21T03:18:31.406843+0000","last_undegraded":"2024-09-21T03:18:31.406843+0000","last_fullsized":"2024-09-21T03:18:31.406843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:40.961482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964737+0000","last_change":"2024-09-21T03:18:29.400789+0000","last_active":"2024-09-21T03:18:31.964737+0000","last_peered":"2024-09-21T03:18:31.964737+0000","last_clean":"2024-09-21T03:18:31.964737+0000","last_became_active":"2024-09-21T03:18:29.400487+0000","last_became_peered":"2024-09-21T03:18:29.400487+0000","last_unstale":"2024-09-21T03:18:31.964737+0000","last_undegraded":"2024-09-21T03:18:31.964737+0000","last_fullsized":"2024-09-21T03:18:31.964737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:42.181902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.410214+0000","last_change":"2024-09-21T03:18:30.394333+0000","last_active":"2024-09-21T03:18:31.410214+0000","last_peered":"2024-09-21T03:18:31.410214+0000","last_clean":"2024-09-21T03:18:31.410214+0000","last_became_active":"2024-09-21T03:18:30.393995+0000","last_became_peered":"2024-09-21T03:18:30.393995+0000","last_unstale":"2024-09-21T03:18:31.410214+0000","last_undegraded":"2024-09-21T03:18:31.410214+0000","last_fullsized":"2024-09-21T03:18:31.410214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:10.520052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963771+0000","last_change":"2024-09-21T03:18:30.419098+0000","last_active":"2024-09-21T03:18:31.963771+0000","last_peered":"2024-09-21T03:18:31.963771+0000","last_clean":"2024-09-21T03:18:31.963771+0000","last_became_active":"2024-09-21T03:18:30.416696+0000","last_became_peered":"2024-09-21T03:18:30.416696+0000","last_unstale":"2024-09-21T03:18:31.963771+0000","last_undegraded":"2024-09-21T03:18:31.963771+0000","last_fullsized":"2024-09-21T03:18:31.963771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:33:40.961482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963622+0000","last_change":"2024-09-21T03:18:29.410284+0000","last_active":"2024-09-21T03:18:31.963622+0000","last_peered":"2024-09-21T03:18:31.963622+0000","last_clean":"2024-09-21T03:18:31.963622+0000","last_became_active":"2024-09-21T03:18:29.409965+0000","last_became_peered":"2024-09-21T03:18:29.409965+0000","last_unstale":"2024-09-21T03:18:31.963622+0000","last_undegraded":"2024-09-21T03:18:31.963622+0000","last_fullsized":"2024-09-21T03:18:31.963622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:43.014716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963980+0000","last_change":"2024-09-21T03:18:30.418184+0000","last_active":"2024-09-21T03:18:31.963980+0000","last_peered":"2024-09-21T03:18:31.963980+0000","last_clean":"2024-09-21T03:18:31.963980+0000","last_became_active":"2024-09-21T03:18:30.417865+0000","last_became_peered":"2024-09-21T03:18:30.417865+0000","last_unstale":"2024-09-21T03:18:31.963980+0000","last_undegraded":"2024-09-21T03:18:31.963980+0000","last_fullsized":"2024-09-21T03:18:31.963980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:24:42.041578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964437+0000","last_change":"2024-09-21T03:18:29.407648+0000","last_active":"2024-09-21T03:18:31.964437+0000","last_peered":"2024-09-21T03:18:31.964437+0000","last_clean":"2024-09-21T03:18:31.964437+0000","last_became_active":"2024-09-21T03:18:29.407300+0000","last_became_peered":"2024-09-21T03:18:29.407300+0000","last_unstale":"2024-09-21T03:18:31.964437+0000","last_undegraded":"2024-09-21T03:18:31.964437+0000","last_fullsized":"2024-09-21T03:18:31.964437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:27.237523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.963902+0000","last_change":"2024-09-21T03:18:30.413724+0000","last_active":"2024-09-21T03:18:31.963902+0000","last_peered":"2024-09-21T03:18:31.963902+0000","last_clean":"2024-09-21T03:18:31.963902+0000","last_became_active":"2024-09-21T03:18:30.413106+0000","last_became_peered":"2024-09-21T03:18:30.413106+0000","last_unstale":"2024-09-21T03:18:31.963902+0000","last_undegraded":"2024-09-21T03:18:31.963902+0000","last_fullsized":"2024-09-21T03:18:31.963902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:51.420496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406866+0000","last_change":"2024-09-21T03:18:29.406529+0000","last_active":"2024-09-21T03:18:31.406866+0000","last_peered":"2024-09-21T03:18:31.406866+0000","last_clean":"2024-09-21T03:18:31.406866+0000","last_became_active":"2024-09-21T03:18:29.406195+0000","last_became_peered":"2024-09-21T03:18:29.406195+0000","last_unstale":"2024-09-21T03:18:31.406866+0000","last_undegraded":"2024-09-21T03:18:31.406866+0000","last_fullsized":"2024-09-21T03:18:31.406866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:03:55.435346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.406866+0000","last_change":"2024-09-21T03:18:30.402788+0000","last_active":"2024-09-21T03:18:31.406866+0000","last_peered":"2024-09-21T03:18:31.406866+0000","last_clean":"2024-09-21T03:18:31.406866+0000","last_became_active":"2024-09-21T03:18:30.400506+0000","last_became_peered":"2024-09-21T03:18:30.400506+0000","last_unstale":"2024-09-21T03:18:31.406866+0000","last_undegraded":"2024-09-21T03:18:31.406866+0000","last_fullsized":"2024-09-21T03:18:31.406866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:29.380433+0000","last_clean_scrub_stamp":"2024-09-21T03:18:29.380433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:49.705469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-21T03:18:31.964074+0000","last_change":"2024-09-21T03:18:29.410309+0000","last_active":"2024-09-21T03:18:31.964074+0000","last_peered":"2024-09-21T03:18:31.964074+0000","last_clean":"2024-09-21T03:18:31.964074+0000","last_became_active":"2024-09-21T03:18:29.409959+0000","last_became_peered":"2024-09-21T03:18:29.409959+0000","last_unstale":"2024-09-21T03:18:31.964074+0000","last_undegraded":"2024-09-21T03:18:31.964074+0000","last_fullsized":"2024-09-21T03:18:31.964074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:28.374630+0000","last_clean_scrub_stamp":"2024-09-21T03:18:28.374630+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:52.457819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":831488,"data_stored":672185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":81325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":245760,"data_stored":81361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":81395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":839680,"data_stored":672241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:18:42.325 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T03:18:42.325 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T03:18:42.325 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-21T03:18:42.325 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T03:18:42.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.472+0000 7feb5e1a1640 1 -- 172.21.15.105:0/2170323690 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb58160c90 msgr2=0x7feb580b3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:42.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.472+0000 7feb5e1a1640 1 --2- 172.21.15.105:0/2170323690 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb58160c90 0x7feb580b3e20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7feb58074c90 tx=0x7feb4002a4d0 comp rx=0 tx=0).stop 2024-09-21T03:18:42.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.472+0000 7feb5e1a1640 1 -- 172.21.15.105:0/2170323690 shutdown_connections 2024-09-21T03:18:42.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.472+0000 7feb5e1a1640 1 --2- 172.21.15.105:0/2170323690 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb580b4360 0x7feb580727e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:42.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.472+0000 7feb5e1a1640 1 --2- 172.21.15.105:0/2170323690 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb58160c90 0x7feb580b3e20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:42.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.472+0000 7feb5e1a1640 1 --2- 172.21.15.105:0/2170323690 >> v2:172.21.15.162:3300/0 conn(0x7feb580cff70 0x7feb5815c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:42.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.472+0000 7feb5e1a1640 1 -- 172.21.15.105:0/2170323690 >> 172.21.15.105:0/2170323690 conn(0x7feb580cee20 msgr2=0x7feb580cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:42.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.472+0000 7feb5e1a1640 1 -- 172.21.15.105:0/2170323690 shutdown_connections 2024-09-21T03:18:42.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.472+0000 7feb5e1a1640 1 -- 172.21.15.105:0/2170323690 wait complete. 2024-09-21T03:18:42.475 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.473+0000 7feb5e1a1640 1 Processor -- start 2024-09-21T03:18:42.475 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.474+0000 7feb5e1a1640 1 -- start start 2024-09-21T03:18:42.478 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.475+0000 7feb5e1a1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb580b4360 0x7feb580b6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:42.478 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.475+0000 7feb5e1a1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb580cff70 0x7feb580b7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:42.478 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.475+0000 7feb5e1a1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb58160c90 0x7feb580b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:42.478 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.475+0000 7feb5e1a1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7feb580730b0 con 0x7feb58160c90 2024-09-21T03:18:42.478 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.475+0000 7feb5e1a1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feb58072f30 con 0x7feb580b4360 2024-09-21T03:18:42.478 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.475+0000 7feb5e1a1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7feb58073230 con 0x7feb580cff70 2024-09-21T03:18:42.478 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.475+0000 7feb57fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb58160c90 0x7feb580b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:42.478 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.475+0000 7feb57fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb58160c90 0x7feb580b51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40732/0 (socket says 172.21.15.105:40732) 2024-09-21T03:18:42.478 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.475+0000 7feb57fff640 1 -- 172.21.15.105:0/3781130643 learned_addr learned my addr 172.21.15.105:0/3781130643 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:42.478 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.475+0000 7feb56ffd640 1 --2- 172.21.15.105:0/3781130643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb580cff70 0x7feb580b7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:42.478 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.475+0000 7feb577fe640 1 --2- 172.21.15.105:0/3781130643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb580b4360 0x7feb580b6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:42.479 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.475+0000 7feb57fff640 1 -- 172.21.15.105:0/3781130643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb580cff70 msgr2=0x7feb580b7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:42.479 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.475+0000 7feb57fff640 1 --2- 172.21.15.105:0/3781130643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb580cff70 0x7feb580b7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:42.479 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.475+0000 7feb57fff640 1 -- 172.21.15.105:0/3781130643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb580b4360 msgr2=0x7feb580b6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:42.479 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.475+0000 7feb57fff640 1 --2- 172.21.15.105:0/3781130643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb580b4360 0x7feb580b6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:42.479 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.475+0000 7feb57fff640 1 -- 172.21.15.105:0/3781130643 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb580c8a80 con 0x7feb58160c90 2024-09-21T03:18:42.479 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.475+0000 7feb57fff640 1 --2- 172.21.15.105:0/3781130643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb58160c90 0x7feb580b51d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7feb5000e990 tx=0x7feb5000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:42.479 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.476+0000 7feb4ffff640 1 -- 172.21.15.105:0/3781130643 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb50004d20 con 0x7feb58160c90 2024-09-21T03:18:42.479 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.476+0000 7feb4ffff640 1 -- 172.21.15.105:0/3781130643 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb5000ca40 con 0x7feb58160c90 2024-09-21T03:18:42.479 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.476+0000 7feb5e1a1640 1 -- 172.21.15.105:0/3781130643 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb580c8330 con 0x7feb58160c90 2024-09-21T03:18:42.479 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.476+0000 7feb4ffff640 1 -- 172.21.15.105:0/3781130643 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb50005020 con 0x7feb58160c90 2024-09-21T03:18:42.479 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.476+0000 7feb5e1a1640 1 -- 172.21.15.105:0/3781130643 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb580c87a0 con 0x7feb58160c90 2024-09-21T03:18:42.480 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.477+0000 7feb5e1a1640 1 -- 172.21.15.105:0/3781130643 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb580c8500 con 0x7feb58160c90 2024-09-21T03:18:42.480 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.477+0000 7feb4ffff640 1 -- 172.21.15.105:0/3781130643 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feb500051c0 con 0x7feb58160c90 2024-09-21T03:18:42.480 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.478+0000 7feb4ffff640 1 --2- 172.21.15.105:0/3781130643 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7feb38078bc0 0x7feb3807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:42.480 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.478+0000 7feb4ffff640 1 -- 172.21.15.105:0/3781130643 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7feb5009b480 con 0x7feb58160c90 2024-09-21T03:18:42.480 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.478+0000 7feb577fe640 1 --2- 172.21.15.105:0/3781130643 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7feb38078bc0 0x7feb3807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:42.480 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.479+0000 7feb577fe640 1 --2- 172.21.15.105:0/3781130643 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7feb38078bc0 0x7feb3807b0d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7feb4800bb50 tx=0x7feb4800b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:42.484 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.482+0000 7feb4ffff640 1 -- 172.21.15.105:0/3781130643 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7feb580c8500 con 0x7feb58160c90 2024-09-21T03:18:42.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.696+0000 7feb5e1a1640 1 -- 172.21.15.105:0/3781130643 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7feb580d1b70 con 0x7feb58160c90 2024-09-21T03:18:42.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.696+0000 7feb4ffff640 1 -- 172.21.15.105:0/3781130643 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7feb50016030 con 0x7feb58160c90 2024-09-21T03:18:42.698 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:18:42.698 INFO:teuthology.orchestra.run.smithi105.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T03:18:42.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.698+0000 7feb5e1a1640 1 -- 172.21.15.105:0/3781130643 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7feb38078bc0 msgr2=0x7feb3807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:42.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.698+0000 7feb5e1a1640 1 --2- 172.21.15.105:0/3781130643 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7feb38078bc0 0x7feb3807b0d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7feb4800bb50 tx=0x7feb4800b2e0 comp rx=0 tx=0).stop 2024-09-21T03:18:42.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.698+0000 7feb5e1a1640 1 -- 172.21.15.105:0/3781130643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb58160c90 msgr2=0x7feb580b51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:42.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.698+0000 7feb5e1a1640 1 --2- 172.21.15.105:0/3781130643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb58160c90 0x7feb580b51d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7feb5000e990 tx=0x7feb5000ee50 comp rx=0 tx=0).stop 2024-09-21T03:18:42.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.698+0000 7feb5e1a1640 1 -- 172.21.15.105:0/3781130643 shutdown_connections 2024-09-21T03:18:42.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.698+0000 7feb5e1a1640 1 --2- 172.21.15.105:0/3781130643 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7feb38078bc0 0x7feb3807b0d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:42.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.698+0000 7feb5e1a1640 1 --2- 172.21.15.105:0/3781130643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb58160c90 0x7feb580b51d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:42.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.698+0000 7feb5e1a1640 1 --2- 172.21.15.105:0/3781130643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb580cff70 0x7feb580b7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:42.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.698+0000 7feb5e1a1640 1 --2- 172.21.15.105:0/3781130643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb580b4360 0x7feb580b6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:42.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.698+0000 7feb5e1a1640 1 -- 172.21.15.105:0/3781130643 >> 172.21.15.105:0/3781130643 conn(0x7feb580cee20 msgr2=0x7feb58157a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:42.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.698+0000 7feb5e1a1640 1 -- 172.21.15.105:0/3781130643 shutdown_connections 2024-09-21T03:18:42.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.698+0000 7feb5e1a1640 1 -- 172.21.15.105:0/3781130643 wait complete. 2024-09-21T03:18:42.711 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-21T03:18:42.711 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:18:42.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.821+0000 7f60d9ed3640 1 -- 172.21.15.105:0/3564101540 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60d40ccbd0 msgr2=0x7f60d40d0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:42.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.821+0000 7f60d9ed3640 1 --2- 172.21.15.105:0/3564101540 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60d40ccbd0 0x7f60d40d0d80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f60bc009830 tx=0x7f60bc02a5c0 comp rx=0 tx=0).stop 2024-09-21T03:18:42.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.821+0000 7f60d9ed3640 1 -- 172.21.15.105:0/3564101540 shutdown_connections 2024-09-21T03:18:42.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.821+0000 7f60d9ed3640 1 --2- 172.21.15.105:0/3564101540 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60d40ccbd0 0x7f60d40d0d80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:42.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.821+0000 7f60d9ed3640 1 -- 172.21.15.105:0/3564101540 >> 172.21.15.105:0/3564101540 conn(0x7f60d4072ae0 msgr2=0x7f60d4072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:42.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.821+0000 7f60d9ed3640 1 -- 172.21.15.105:0/3564101540 shutdown_connections 2024-09-21T03:18:42.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.821+0000 7f60d9ed3640 1 -- 172.21.15.105:0/3564101540 wait complete. 2024-09-21T03:18:42.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.823+0000 7f60d9ed3640 1 Processor -- start 2024-09-21T03:18:42.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.823+0000 7f60d9ed3640 1 -- start start 2024-09-21T03:18:42.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.824+0000 7f60d9ed3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60d40b51c0 0x7f60d41526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:42.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.824+0000 7f60d9ed3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60d40ccbd0 0x7f60d40a9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:42.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.824+0000 7f60d9ed3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60d40d12c0 0x7f60d40c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:42.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.824+0000 7f60d9ed3640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f60d40cf480 con 0x7f60d40ccbd0 2024-09-21T03:18:42.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.824+0000 7f60d9ed3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f60d40cf300 con 0x7f60d40b51c0 2024-09-21T03:18:42.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.824+0000 7f60d9ed3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f60d40cf600 con 0x7f60d40d12c0 2024-09-21T03:18:42.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.824+0000 7f60cbfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60d40ccbd0 0x7f60d40a9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:42.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.825+0000 7f60cbfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60d40ccbd0 0x7f60d40a9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40748/0 (socket says 172.21.15.105:40748) 2024-09-21T03:18:42.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.825+0000 7f60cbfff640 1 -- 172.21.15.105:0/844153773 learned_addr learned my addr 172.21.15.105:0/844153773 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:42.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.825+0000 7f60d37fe640 1 --2- 172.21.15.105:0/844153773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60d40b51c0 0x7f60d41526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:42.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.825+0000 7f60d3fff640 1 --2- 172.21.15.105:0/844153773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60d40d12c0 0x7f60d40c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:42.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.825+0000 7f60cbfff640 1 -- 172.21.15.105:0/844153773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60d40d12c0 msgr2=0x7f60d40c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:42.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.825+0000 7f60cbfff640 1 --2- 172.21.15.105:0/844153773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60d40d12c0 0x7f60d40c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:42.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.825+0000 7f60cbfff640 1 -- 172.21.15.105:0/844153773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60d40b51c0 msgr2=0x7f60d41526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:42.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.825+0000 7f60cbfff640 1 --2- 172.21.15.105:0/844153773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60d40b51c0 0x7f60d41526f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:42.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.825+0000 7f60cbfff640 1 -- 172.21.15.105:0/844153773 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60d415abf0 con 0x7f60d40ccbd0 2024-09-21T03:18:42.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.825+0000 7f60d3fff640 1 --2- 172.21.15.105:0/844153773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60d40d12c0 0x7f60d40c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:18:42.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.825+0000 7f60cbfff640 1 --2- 172.21.15.105:0/844153773 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60d40ccbd0 0x7f60d40a9cb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f60bc009950 tx=0x7f60bc033ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:42.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.825+0000 7f60d0ff9640 1 -- 172.21.15.105:0/844153773 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60bc031d60 con 0x7f60d40ccbd0 2024-09-21T03:18:42.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.825+0000 7f60d0ff9640 1 -- 172.21.15.105:0/844153773 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f60bc005020 con 0x7f60d40ccbd0 2024-09-21T03:18:42.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.825+0000 7f60d0ff9640 1 -- 172.21.15.105:0/844153773 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60bc005470 con 0x7f60d40ccbd0 2024-09-21T03:18:42.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.825+0000 7f60d9ed3640 1 -- 172.21.15.105:0/844153773 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60d41f5ff0 con 0x7f60d40ccbd0 2024-09-21T03:18:42.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.825+0000 7f60d9ed3640 1 -- 172.21.15.105:0/844153773 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60d41f65b0 con 0x7f60d40ccbd0 2024-09-21T03:18:42.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.826+0000 7f60d9ed3640 1 -- 172.21.15.105:0/844153773 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60d41f5d60 con 0x7f60d40ccbd0 2024-09-21T03:18:42.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.827+0000 7f60d0ff9640 1 -- 172.21.15.105:0/844153773 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f60bc0047a0 con 0x7f60d40ccbd0 2024-09-21T03:18:42.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.827+0000 7f60d0ff9640 1 --2- 172.21.15.105:0/844153773 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f60b4078bc0 0x7f60b407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:42.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.827+0000 7f60d0ff9640 1 -- 172.21.15.105:0/844153773 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f60bc0bbe50 con 0x7f60d40ccbd0 2024-09-21T03:18:42.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.827+0000 7f60d37fe640 1 --2- 172.21.15.105:0/844153773 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f60b4078bc0 0x7f60b407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:42.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.828+0000 7f60d37fe640 1 --2- 172.21.15.105:0/844153773 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f60b4078bc0 0x7f60b407b0d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f60c40046b0 tx=0x7f60c4007e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:42.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:42.832+0000 7f60d0ff9640 1 -- 172.21.15.105:0/844153773 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f60d415abf0 con 0x7f60d40ccbd0 2024-09-21T03:18:43.047 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.045+0000 7f60d9ed3640 1 -- 172.21.15.105:0/844153773 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60d4075330 con 0x7f60d40ccbd0 2024-09-21T03:18:43.047 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.046+0000 7f60d0ff9640 1 -- 172.21.15.105:0/844153773 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5220 (secure 0 0 0) 0x7f60d4075330 con 0x7f60d40ccbd0 2024-09-21T03:18:43.047 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:18:43.048 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":8,"btime":"2024-09-21T03:18:33:412826+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/950623322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":950623322},{"type":"v1","addr":"172.21.15.105:6833","nonce":950623322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/982475612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":982475612},{"type":"v1","addr":"172.21.15.162:6837","nonce":982475612}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4389,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/940371702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":940371702},{"type":"v1","addr":"172.21.15.105:6835","nonce":940371702}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:18:29.756592+0000","modified":"2024-09-21T03:18:32.767916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4401},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4401":{"gid":4401,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6836/1998709636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1998709636},{"type":"v1","addr":"172.21.15.162:6836","nonce":1998709636}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4401,"qdb_cluster":[4401]},"id":1}]} 2024-09-21T03:18:43.048 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 8 2024-09-21T03:18:43.050 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.048+0000 7f60d9ed3640 1 -- 172.21.15.105:0/844153773 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f60b4078bc0 msgr2=0x7f60b407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:43.050 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.048+0000 7f60d9ed3640 1 --2- 172.21.15.105:0/844153773 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f60b4078bc0 0x7f60b407b0d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f60c40046b0 tx=0x7f60c4007e90 comp rx=0 tx=0).stop 2024-09-21T03:18:43.050 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.048+0000 7f60d9ed3640 1 -- 172.21.15.105:0/844153773 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60d40ccbd0 msgr2=0x7f60d40a9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:43.050 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.048+0000 7f60d9ed3640 1 --2- 172.21.15.105:0/844153773 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60d40ccbd0 0x7f60d40a9cb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f60bc009950 tx=0x7f60bc033ce0 comp rx=0 tx=0).stop 2024-09-21T03:18:43.050 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.048+0000 7f60d9ed3640 1 -- 172.21.15.105:0/844153773 shutdown_connections 2024-09-21T03:18:43.050 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.048+0000 7f60d9ed3640 1 --2- 172.21.15.105:0/844153773 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f60b4078bc0 0x7f60b407b0d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:43.050 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.048+0000 7f60d9ed3640 1 --2- 172.21.15.105:0/844153773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60d40d12c0 0x7f60d40c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:43.050 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.048+0000 7f60d9ed3640 1 --2- 172.21.15.105:0/844153773 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60d40ccbd0 0x7f60d40a9cb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:43.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.048+0000 7f60d9ed3640 1 --2- 172.21.15.105:0/844153773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60d40b51c0 0x7f60d41526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:43.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.048+0000 7f60d9ed3640 1 -- 172.21.15.105:0/844153773 >> 172.21.15.105:0/844153773 conn(0x7f60d4072ae0 msgr2=0x7f60d40b6100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:43.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.048+0000 7f60d9ed3640 1 -- 172.21.15.105:0/844153773 shutdown_connections 2024-09-21T03:18:43.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.048+0000 7f60d9ed3640 1 -- 172.21.15.105:0/844153773 wait complete. 2024-09-21T03:18:43.061 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:18:43.172 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.171+0000 7fa5a19f1640 1 -- 172.21.15.105:0/1653153643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa59c0b4090 msgr2=0x7fa59c0b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:43.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.171+0000 7fa5a19f1640 1 --2- 172.21.15.105:0/1653153643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa59c0b4090 0x7fa59c0b3550 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa58c009830 tx=0x7fa58c02a510 comp rx=0 tx=0).stop 2024-09-21T03:18:43.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.171+0000 7fa5a19f1640 1 -- 172.21.15.105:0/1653153643 shutdown_connections 2024-09-21T03:18:43.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.171+0000 7fa5a19f1640 1 --2- 172.21.15.105:0/1653153643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa59c0b4090 0x7fa59c0b3550 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:43.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.171+0000 7fa5a19f1640 1 -- 172.21.15.105:0/1653153643 >> 172.21.15.105:0/1653153643 conn(0x7fa59c0cdcc0 msgr2=0x7fa59c0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:43.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.171+0000 7fa5a19f1640 1 -- 172.21.15.105:0/1653153643 shutdown_connections 2024-09-21T03:18:43.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.171+0000 7fa5a19f1640 1 -- 172.21.15.105:0/1653153643 wait complete. 2024-09-21T03:18:43.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.173+0000 7fa5a19f1640 1 Processor -- start 2024-09-21T03:18:43.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.173+0000 7fa5a19f1640 1 -- start start 2024-09-21T03:18:43.177 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.174+0000 7fa5a19f1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa59c06fec0 0x7fa59c14e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:43.177 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.174+0000 7fa5a19f1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa59c0b4090 0x7fa59c158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:43.177 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.174+0000 7fa5a19f1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa59c0cfeb0 0x7fa59c159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:43.177 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.174+0000 7fa5a19f1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa59c0b4bd0 con 0x7fa59c0cfeb0 2024-09-21T03:18:43.177 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.174+0000 7fa5a19f1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa59c0b4a50 con 0x7fa59c06fec0 2024-09-21T03:18:43.177 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.174+0000 7fa5a19f1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa59c0b4d50 con 0x7fa59c0b4090 2024-09-21T03:18:43.177 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.174+0000 7fa59b7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa59c0cfeb0 0x7fa59c159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:43.177 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.174+0000 7fa59b7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa59c0cfeb0 0x7fa59c159160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40772/0 (socket says 172.21.15.105:40772) 2024-09-21T03:18:43.177 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.174+0000 7fa59b7fe640 1 -- 172.21.15.105:0/3223060958 learned_addr learned my addr 172.21.15.105:0/3223060958 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:43.178 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.174+0000 7fa59affd640 1 --2- 172.21.15.105:0/3223060958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa59c06fec0 0x7fa59c14e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:43.178 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.174+0000 7fa59a7fc640 1 --2- 172.21.15.105:0/3223060958 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa59c0b4090 0x7fa59c158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:43.178 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.174+0000 7fa59b7fe640 1 -- 172.21.15.105:0/3223060958 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa59c0b4090 msgr2=0x7fa59c158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:43.178 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.174+0000 7fa59b7fe640 1 --2- 172.21.15.105:0/3223060958 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa59c0b4090 0x7fa59c158c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:43.178 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.174+0000 7fa59b7fe640 1 -- 172.21.15.105:0/3223060958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa59c06fec0 msgr2=0x7fa59c14e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:43.178 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.174+0000 7fa59b7fe640 1 --2- 172.21.15.105:0/3223060958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa59c06fec0 0x7fa59c14e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:43.178 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.174+0000 7fa59b7fe640 1 -- 172.21.15.105:0/3223060958 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa59c1f4400 con 0x7fa59c0cfeb0 2024-09-21T03:18:43.178 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.174+0000 7fa59a7fc640 1 --2- 172.21.15.105:0/3223060958 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa59c0b4090 0x7fa59c158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:18:43.178 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.175+0000 7fa59b7fe640 1 --2- 172.21.15.105:0/3223060958 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa59c0cfeb0 0x7fa59c159160 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa59400b9e0 tx=0x7fa59400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:43.178 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.175+0000 7fa583fff640 1 -- 172.21.15.105:0/3223060958 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa594019070 con 0x7fa59c0cfeb0 2024-09-21T03:18:43.178 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.175+0000 7fa583fff640 1 -- 172.21.15.105:0/3223060958 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa59400cc10 con 0x7fa59c0cfeb0 2024-09-21T03:18:43.178 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.175+0000 7fa5a19f1640 1 -- 172.21.15.105:0/3223060958 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa59c1f46e0 con 0x7fa59c0cfeb0 2024-09-21T03:18:43.178 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.175+0000 7fa583fff640 1 -- 172.21.15.105:0/3223060958 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa594014440 con 0x7fa59c0cfeb0 2024-09-21T03:18:43.178 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.175+0000 7fa5a19f1640 1 -- 172.21.15.105:0/3223060958 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa59c1f4fa0 con 0x7fa59c0cfeb0 2024-09-21T03:18:43.179 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.176+0000 7fa5a19f1640 1 -- 172.21.15.105:0/3223060958 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa59c0d1c00 con 0x7fa59c0cfeb0 2024-09-21T03:18:43.179 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.177+0000 7fa583fff640 1 -- 172.21.15.105:0/3223060958 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa59401c070 con 0x7fa59c0cfeb0 2024-09-21T03:18:43.179 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.177+0000 7fa583fff640 1 --2- 172.21.15.105:0/3223060958 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa588078b90 0x7fa58807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:43.180 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.177+0000 7fa583fff640 1 -- 172.21.15.105:0/3223060958 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa59409a9f0 con 0x7fa59c0cfeb0 2024-09-21T03:18:43.180 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.177+0000 7fa59affd640 1 --2- 172.21.15.105:0/3223060958 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa588078b90 0x7fa58807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:43.180 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.178+0000 7fa59affd640 1 --2- 172.21.15.105:0/3223060958 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa588078b90 0x7fa58807b0a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa58c034000 tx=0x7fa58c004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:43.183 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.182+0000 7fa583fff640 1 -- 172.21.15.105:0/3223060958 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa59c0d1c00 con 0x7fa59c0cfeb0 2024-09-21T03:18:43.394 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.393+0000 7fa5a19f1640 1 -- 172.21.15.105:0/3223060958 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa59c1f4190 con 0x7fa59c0cfeb0 2024-09-21T03:18:43.395 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.393+0000 7fa583fff640 1 -- 172.21.15.105:0/3223060958 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5220 (secure 0 0 0) 0x7fa5940627e0 con 0x7fa59c0cfeb0 2024-09-21T03:18:43.395 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:18:43.395 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":8,"btime":"2024-09-21T03:18:33:412826+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/950623322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":950623322},{"type":"v1","addr":"172.21.15.105:6833","nonce":950623322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/982475612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":982475612},{"type":"v1","addr":"172.21.15.162:6837","nonce":982475612}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4389,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/940371702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":940371702},{"type":"v1","addr":"172.21.15.105:6835","nonce":940371702}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:18:29.756592+0000","modified":"2024-09-21T03:18:32.767916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4401},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4401":{"gid":4401,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6836/1998709636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1998709636},{"type":"v1","addr":"172.21.15.162:6836","nonce":1998709636}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4401,"qdb_cluster":[4401]},"id":1}]} 2024-09-21T03:18:43.396 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 8 2024-09-21T03:18:43.398 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.396+0000 7fa5a19f1640 1 -- 172.21.15.105:0/3223060958 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa588078b90 msgr2=0x7fa58807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:43.398 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.396+0000 7fa5a19f1640 1 --2- 172.21.15.105:0/3223060958 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa588078b90 0x7fa58807b0a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa58c034000 tx=0x7fa58c004730 comp rx=0 tx=0).stop 2024-09-21T03:18:43.398 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.396+0000 7fa5a19f1640 1 -- 172.21.15.105:0/3223060958 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa59c0cfeb0 msgr2=0x7fa59c159160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:43.398 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.396+0000 7fa5a19f1640 1 --2- 172.21.15.105:0/3223060958 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa59c0cfeb0 0x7fa59c159160 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa59400b9e0 tx=0x7fa59400bea0 comp rx=0 tx=0).stop 2024-09-21T03:18:43.398 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.396+0000 7fa5a19f1640 1 -- 172.21.15.105:0/3223060958 shutdown_connections 2024-09-21T03:18:43.398 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.396+0000 7fa5a19f1640 1 --2- 172.21.15.105:0/3223060958 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa588078b90 0x7fa58807b0a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:43.398 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.396+0000 7fa5a19f1640 1 --2- 172.21.15.105:0/3223060958 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa59c0cfeb0 0x7fa59c159160 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:43.398 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.396+0000 7fa5a19f1640 1 --2- 172.21.15.105:0/3223060958 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa59c0b4090 0x7fa59c158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:43.398 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.396+0000 7fa5a19f1640 1 --2- 172.21.15.105:0/3223060958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa59c06fec0 0x7fa59c14e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:43.398 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.396+0000 7fa5a19f1640 1 -- 172.21.15.105:0/3223060958 >> 172.21.15.105:0/3223060958 conn(0x7fa59c0cdcc0 msgr2=0x7fa59c0d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:43.398 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.396+0000 7fa5a19f1640 1 -- 172.21.15.105:0/3223060958 shutdown_connections 2024-09-21T03:18:43.398 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.396+0000 7fa5a19f1640 1 -- 172.21.15.105:0/3223060958 wait complete. 2024-09-21T03:18:43.409 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:18:43.521 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.519+0000 7fc9e178a640 1 -- 172.21.15.105:0/2489564416 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9dc15c7f0 msgr2=0x7fc9dc0b26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:43.521 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.519+0000 7fc9e178a640 1 --2- 172.21.15.105:0/2489564416 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9dc15c7f0 0x7fc9dc0b26c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc0aef10 tx=0x7fc9cc02a440 comp rx=0 tx=0).stop 2024-09-21T03:18:43.521 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.519+0000 7fc9e178a640 1 -- 172.21.15.105:0/2489564416 shutdown_connections 2024-09-21T03:18:43.521 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.519+0000 7fc9e178a640 1 --2- 172.21.15.105:0/2489564416 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9dc0b2070 0x7fc9dc06d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:43.521 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.519+0000 7fc9e178a640 1 --2- 172.21.15.105:0/2489564416 >> v2:172.21.15.162:3300/0 conn(0x7fc9dc0ae1b0 0x7fc9dc06cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:43.521 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.519+0000 7fc9e178a640 1 --2- 172.21.15.105:0/2489564416 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9dc15c7f0 0x7fc9dc0b26c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:43.521 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.519+0000 7fc9e178a640 1 -- 172.21.15.105:0/2489564416 >> 172.21.15.105:0/2489564416 conn(0x7fc9dc06ea80 msgr2=0x7fc9dc0b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:43.521 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.519+0000 7fc9e178a640 1 -- 172.21.15.105:0/2489564416 shutdown_connections 2024-09-21T03:18:43.522 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.519+0000 7fc9e178a640 1 -- 172.21.15.105:0/2489564416 wait complete. 2024-09-21T03:18:43.522 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.521+0000 7fc9e178a640 1 Processor -- start 2024-09-21T03:18:43.522 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.521+0000 7fc9e178a640 1 -- start start 2024-09-21T03:18:43.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.522+0000 7fc9e178a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9dc0ae1b0 0x7fc9dc09b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:43.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.522+0000 7fc9e178a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9dc0b2070 0x7fc9dc1566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:43.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.522+0000 7fc9e178a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9dc15c7f0 0x7fc9dc09bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:43.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.522+0000 7fc9e178a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc0b06d0 con 0x7fc9dc0b2070 2024-09-21T03:18:43.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.522+0000 7fc9e178a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc0b0550 con 0x7fc9dc0ae1b0 2024-09-21T03:18:43.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.522+0000 7fc9e178a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc9dc0b0850 con 0x7fc9dc15c7f0 2024-09-21T03:18:43.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.523+0000 7fc9d27fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9dc0b2070 0x7fc9dc1566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:43.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.523+0000 7fc9d27fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9dc0b2070 0x7fc9dc1566a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40786/0 (socket says 172.21.15.105:40786) 2024-09-21T03:18:43.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.523+0000 7fc9d27fc640 1 -- 172.21.15.105:0/2359000540 learned_addr learned my addr 172.21.15.105:0/2359000540 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:43.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.523+0000 7fc9daffd640 1 --2- 172.21.15.105:0/2359000540 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9dc0ae1b0 0x7fc9dc09b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:43.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.523+0000 7fc9db7fe640 1 --2- 172.21.15.105:0/2359000540 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9dc15c7f0 0x7fc9dc09bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:43.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.523+0000 7fc9d27fc640 1 -- 172.21.15.105:0/2359000540 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9dc15c7f0 msgr2=0x7fc9dc09bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:43.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.523+0000 7fc9d27fc640 1 --2- 172.21.15.105:0/2359000540 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9dc15c7f0 0x7fc9dc09bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:43.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.523+0000 7fc9d27fc640 1 -- 172.21.15.105:0/2359000540 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9dc0ae1b0 msgr2=0x7fc9dc09b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:43.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.523+0000 7fc9d27fc640 1 --2- 172.21.15.105:0/2359000540 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9dc0ae1b0 0x7fc9dc09b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:43.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.523+0000 7fc9d27fc640 1 -- 172.21.15.105:0/2359000540 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9dc156be0 con 0x7fc9dc0b2070 2024-09-21T03:18:43.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.523+0000 7fc9db7fe640 1 --2- 172.21.15.105:0/2359000540 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9dc15c7f0 0x7fc9dc09bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:18:43.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.523+0000 7fc9d27fc640 1 --2- 172.21.15.105:0/2359000540 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9dc0b2070 0x7fc9dc1566a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc9c400c970 tx=0x7fc9c400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:43.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.523+0000 7fc9d3fff640 1 -- 172.21.15.105:0/2359000540 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c4004230 con 0x7fc9dc0b2070 2024-09-21T03:18:43.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.523+0000 7fc9d3fff640 1 -- 172.21.15.105:0/2359000540 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9c40043d0 con 0x7fc9dc0b2070 2024-09-21T03:18:43.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.523+0000 7fc9d3fff640 1 -- 172.21.15.105:0/2359000540 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c4007c10 con 0x7fc9dc0b2070 2024-09-21T03:18:43.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.523+0000 7fc9e178a640 1 -- 172.21.15.105:0/2359000540 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9dc09e750 con 0x7fc9dc0b2070 2024-09-21T03:18:43.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.523+0000 7fc9e178a640 1 -- 172.21.15.105:0/2359000540 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9dc09ebc0 con 0x7fc9dc0b2070 2024-09-21T03:18:43.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.524+0000 7fc9e178a640 1 -- 172.21.15.105:0/2359000540 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9dc0b3290 con 0x7fc9dc0b2070 2024-09-21T03:18:43.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.525+0000 7fc9d3fff640 1 -- 172.21.15.105:0/2359000540 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc9c40035f0 con 0x7fc9dc0b2070 2024-09-21T03:18:43.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.525+0000 7fc9d3fff640 1 --2- 172.21.15.105:0/2359000540 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc9bc078b90 0x7fc9bc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:43.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.525+0000 7fc9d3fff640 1 -- 172.21.15.105:0/2359000540 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc9c409b0a0 con 0x7fc9dc0b2070 2024-09-21T03:18:43.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.525+0000 7fc9daffd640 1 --2- 172.21.15.105:0/2359000540 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc9bc078b90 0x7fc9bc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:43.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.526+0000 7fc9daffd640 1 --2- 172.21.15.105:0/2359000540 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc9bc078b90 0x7fc9bc07b0a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc033000 tx=0x7fc9cc004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:43.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.530+0000 7fc9d3fff640 1 -- 172.21.15.105:0/2359000540 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc9dc0b3290 con 0x7fc9dc0b2070 2024-09-21T03:18:43.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.707+0000 7fc9e178a640 1 -- 172.21.15.105:0/2359000540 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc9dc09e920 con 0x7fc9dc0b2070 2024-09-21T03:18:43.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.708+0000 7fc9d3fff640 1 -- 172.21.15.105:0/2359000540 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16737 (secure 0 0 0) 0x7fc9c4014070 con 0x7fc9dc0b2070 2024-09-21T03:18:43.710 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:18:43.710 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":23,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:18:31.396627+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:18:27.622514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:18:28.719849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:18:43.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.711+0000 7fc9e178a640 1 -- 172.21.15.105:0/2359000540 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc9bc078b90 msgr2=0x7fc9bc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:43.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.711+0000 7fc9e178a640 1 --2- 172.21.15.105:0/2359000540 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc9bc078b90 0x7fc9bc07b0a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc033000 tx=0x7fc9cc004730 comp rx=0 tx=0).stop 2024-09-21T03:18:43.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.711+0000 7fc9e178a640 1 -- 172.21.15.105:0/2359000540 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9dc0b2070 msgr2=0x7fc9dc1566a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:43.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.711+0000 7fc9e178a640 1 --2- 172.21.15.105:0/2359000540 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9dc0b2070 0x7fc9dc1566a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc9c400c970 tx=0x7fc9c400ce30 comp rx=0 tx=0).stop 2024-09-21T03:18:43.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.711+0000 7fc9e178a640 1 -- 172.21.15.105:0/2359000540 shutdown_connections 2024-09-21T03:18:43.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.711+0000 7fc9e178a640 1 --2- 172.21.15.105:0/2359000540 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc9bc078b90 0x7fc9bc07b0a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:43.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.711+0000 7fc9e178a640 1 --2- 172.21.15.105:0/2359000540 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9dc15c7f0 0x7fc9dc09bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:43.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.711+0000 7fc9e178a640 1 --2- 172.21.15.105:0/2359000540 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9dc0b2070 0x7fc9dc1566a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:43.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.711+0000 7fc9e178a640 1 --2- 172.21.15.105:0/2359000540 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9dc0ae1b0 0x7fc9dc09b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:43.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.711+0000 7fc9e178a640 1 -- 172.21.15.105:0/2359000540 >> 172.21.15.105:0/2359000540 conn(0x7fc9dc06ea80 msgr2=0x7fc9dc15ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:43.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.711+0000 7fc9e178a640 1 -- 172.21.15.105:0/2359000540 shutdown_connections 2024-09-21T03:18:43.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.711+0000 7fc9e178a640 1 -- 172.21.15.105:0/2359000540 wait complete. 2024-09-21T03:18:43.724 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:18:43.835 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.834+0000 7f9f282f9640 1 -- 172.21.15.105:0/133197140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f200b40a0 msgr2=0x7f9f20167450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:43.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.834+0000 7f9f282f9640 1 --2- 172.21.15.105:0/133197140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f200b40a0 0x7f9f20167450 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9f18005fd0 tx=0x7f9f1802a940 comp rx=0 tx=0).stop 2024-09-21T03:18:43.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.834+0000 7f9f282f9640 1 -- 172.21.15.105:0/133197140 shutdown_connections 2024-09-21T03:18:43.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.834+0000 7f9f282f9640 1 --2- 172.21.15.105:0/133197140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f200b40a0 0x7f9f20167450 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:43.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.834+0000 7f9f282f9640 1 -- 172.21.15.105:0/133197140 >> 172.21.15.105:0/133197140 conn(0x7f9f200b1cb0 msgr2=0x7f9f200b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:43.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.834+0000 7f9f282f9640 1 -- 172.21.15.105:0/133197140 shutdown_connections 2024-09-21T03:18:43.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.834+0000 7f9f282f9640 1 -- 172.21.15.105:0/133197140 wait complete. 2024-09-21T03:18:43.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.836+0000 7f9f282f9640 1 Processor -- start 2024-09-21T03:18:43.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.836+0000 7f9f282f9640 1 -- start start 2024-09-21T03:18:43.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.837+0000 7f9f282f9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9f20070030 0x7f9f20151380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:43.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.837+0000 7f9f282f9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f20073170 0x7f9f2015e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:43.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.837+0000 7f9f282f9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f200b40a0 0x7f9f2015ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:43.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.837+0000 7f9f282f9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9f20167ba0 con 0x7f9f20073170 2024-09-21T03:18:43.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.837+0000 7f9f282f9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9f20075090 con 0x7f9f200b40a0 2024-09-21T03:18:43.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.837+0000 7f9f282f9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9f20167d20 con 0x7f9f20070030 2024-09-21T03:18:43.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.837+0000 7f9f25894640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f20073170 0x7f9f2015e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:43.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.837+0000 7f9f25894640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f20073170 0x7f9f2015e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40818/0 (socket says 172.21.15.105:40818) 2024-09-21T03:18:43.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.837+0000 7f9f25894640 1 -- 172.21.15.105:0/706744876 learned_addr learned my addr 172.21.15.105:0/706744876 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:43.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.837+0000 7f9f26896640 1 --2- 172.21.15.105:0/706744876 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f200b40a0 0x7f9f2015ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:43.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.837+0000 7f9f26095640 1 --2- 172.21.15.105:0/706744876 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9f20070030 0x7f9f20151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:43.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.837+0000 7f9f25894640 1 -- 172.21.15.105:0/706744876 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9f20070030 msgr2=0x7f9f20151380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:43.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.837+0000 7f9f25894640 1 --2- 172.21.15.105:0/706744876 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9f20070030 0x7f9f20151380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:43.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.837+0000 7f9f25894640 1 -- 172.21.15.105:0/706744876 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f200b40a0 msgr2=0x7f9f2015ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:43.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.837+0000 7f9f25894640 1 --2- 172.21.15.105:0/706744876 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f200b40a0 0x7f9f2015ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:43.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.837+0000 7f9f25894640 1 -- 172.21.15.105:0/706744876 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f2015db70 con 0x7f9f20073170 2024-09-21T03:18:43.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.837+0000 7f9f26896640 1 --2- 172.21.15.105:0/706744876 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f200b40a0 0x7f9f2015ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:18:43.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.837+0000 7f9f25894640 1 --2- 172.21.15.105:0/706744876 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f20073170 0x7f9f2015e930 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9f10001eb0 tx=0x7f9f1000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:43.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.837+0000 7f9f16ffd640 1 -- 172.21.15.105:0/706744876 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f10017070 con 0x7f9f20073170 2024-09-21T03:18:43.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.838+0000 7f9f16ffd640 1 -- 172.21.15.105:0/706744876 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f100053c0 con 0x7f9f20073170 2024-09-21T03:18:43.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.838+0000 7f9f282f9640 1 -- 172.21.15.105:0/706744876 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f2015de50 con 0x7f9f20073170 2024-09-21T03:18:43.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.838+0000 7f9f16ffd640 1 -- 172.21.15.105:0/706744876 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f10003830 con 0x7f9f20073170 2024-09-21T03:18:43.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.838+0000 7f9f282f9640 1 -- 172.21.15.105:0/706744876 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f2015e410 con 0x7f9f20073170 2024-09-21T03:18:43.842 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.839+0000 7f9f282f9640 1 -- 172.21.15.105:0/706744876 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f200cfad0 con 0x7f9f20073170 2024-09-21T03:18:43.842 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.839+0000 7f9f16ffd640 1 -- 172.21.15.105:0/706744876 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9f1001a070 con 0x7f9f20073170 2024-09-21T03:18:43.842 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.840+0000 7f9f16ffd640 1 --2- 172.21.15.105:0/706744876 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9f04078bc0 0x7f9f0407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:43.842 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.840+0000 7f9f16ffd640 1 -- 172.21.15.105:0/706744876 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f9f1009a0c0 con 0x7f9f20073170 2024-09-21T03:18:43.842 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.840+0000 7f9f26095640 1 --2- 172.21.15.105:0/706744876 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9f04078bc0 0x7f9f0407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:43.842 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.840+0000 7f9f26095640 1 --2- 172.21.15.105:0/706744876 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9f04078bc0 0x7f9f0407b0d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c0046b0 tx=0x7f9f1c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:43.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:43.844+0000 7f9f16ffd640 1 -- 172.21.15.105:0/706744876 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9f10062590 con 0x7f9f20073170 2024-09-21T03:18:44.061 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.059+0000 7f9f282f9640 1 -- 172.21.15.105:0/706744876 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f20074640 con 0x7f9f20073170 2024-09-21T03:18:44.061 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.060+0000 7f9f16ffd640 1 -- 172.21.15.105:0/706744876 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5220 (secure 0 0 0) 0x7f9f10061e90 con 0x7f9f20073170 2024-09-21T03:18:44.062 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:18:44.062 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":8,"btime":"2024-09-21T03:18:33:412826+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/950623322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":950623322},{"type":"v1","addr":"172.21.15.105:6833","nonce":950623322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/982475612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":982475612},{"type":"v1","addr":"172.21.15.162:6837","nonce":982475612}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4389,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/940371702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":940371702},{"type":"v1","addr":"172.21.15.105:6835","nonce":940371702}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:18:29.756592+0000","modified":"2024-09-21T03:18:32.767916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4401},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4401":{"gid":4401,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6836/1998709636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1998709636},{"type":"v1","addr":"172.21.15.162:6836","nonce":1998709636}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4401,"qdb_cluster":[4401]},"id":1}]} 2024-09-21T03:18:44.062 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 8 2024-09-21T03:18:44.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.062+0000 7f9f282f9640 1 -- 172.21.15.105:0/706744876 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9f04078bc0 msgr2=0x7f9f0407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:44.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.062+0000 7f9f282f9640 1 --2- 172.21.15.105:0/706744876 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9f04078bc0 0x7f9f0407b0d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c0046b0 tx=0x7f9f1c009040 comp rx=0 tx=0).stop 2024-09-21T03:18:44.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.062+0000 7f9f282f9640 1 -- 172.21.15.105:0/706744876 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f20073170 msgr2=0x7f9f2015e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:44.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.062+0000 7f9f282f9640 1 --2- 172.21.15.105:0/706744876 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f20073170 0x7f9f2015e930 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9f10001eb0 tx=0x7f9f1000c890 comp rx=0 tx=0).stop 2024-09-21T03:18:44.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.062+0000 7f9f282f9640 1 -- 172.21.15.105:0/706744876 shutdown_connections 2024-09-21T03:18:44.065 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.062+0000 7f9f282f9640 1 --2- 172.21.15.105:0/706744876 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9f04078bc0 0x7f9f0407b0d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:44.065 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.062+0000 7f9f282f9640 1 --2- 172.21.15.105:0/706744876 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f200b40a0 0x7f9f2015ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:44.065 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.062+0000 7f9f282f9640 1 --2- 172.21.15.105:0/706744876 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f20073170 0x7f9f2015e930 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:44.065 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.062+0000 7f9f282f9640 1 --2- 172.21.15.105:0/706744876 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9f20070030 0x7f9f20151380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:44.065 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.062+0000 7f9f282f9640 1 -- 172.21.15.105:0/706744876 >> 172.21.15.105:0/706744876 conn(0x7f9f200b1cb0 msgr2=0x7f9f200ad0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:44.065 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.062+0000 7f9f282f9640 1 -- 172.21.15.105:0/706744876 shutdown_connections 2024-09-21T03:18:44.065 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.062+0000 7f9f282f9640 1 -- 172.21.15.105:0/706744876 wait complete. 2024-09-21T03:18:44.477 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T03:18:29.756592+0000', 'modified': '2024-09-21T03:18:32.767916+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4401}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4401': {'gid': 4401, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.162:6836/1998709636', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6834', 'nonce': 1998709636}, {'type': 'v1', 'addr': '172.21.15.162:6836', 'nonce': 1998709636}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4401, 'qdb_cluster': [4401]} 2024-09-21T03:18:44.477 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T03:18:44.477 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-21T03:18:44.593 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.591+0000 7f069cede640 1 -- 172.21.15.105:0/2851432867 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06980cfeb0 msgr2=0x7f06980d02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:44.593 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.591+0000 7f069cede640 1 --2- 172.21.15.105:0/2851432867 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06980cfeb0 0x7f06980d02c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f069815f310 tx=0x7f069002a560 comp rx=0 tx=0).stop 2024-09-21T03:18:44.593 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.591+0000 7f069cede640 1 -- 172.21.15.105:0/2851432867 shutdown_connections 2024-09-21T03:18:44.593 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.591+0000 7f069cede640 1 --2- 172.21.15.105:0/2851432867 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06980cfeb0 0x7f06980d02c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:44.593 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.591+0000 7f069cede640 1 --2- 172.21.15.105:0/2851432867 >> v2:172.21.15.162:3300/0 conn(0x7f06980705d0 0x7f06980b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:44.593 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.591+0000 7f069cede640 1 -- 172.21.15.105:0/2851432867 >> 172.21.15.105:0/2851432867 conn(0x7f06980cdcc0 msgr2=0x7f06980ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:44.593 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.591+0000 7f069cede640 1 -- 172.21.15.105:0/2851432867 shutdown_connections 2024-09-21T03:18:44.593 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.591+0000 7f069cede640 1 -- 172.21.15.105:0/2851432867 wait complete. 2024-09-21T03:18:44.594 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.593+0000 7f069cede640 1 Processor -- start 2024-09-21T03:18:44.594 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.593+0000 7f069cede640 1 -- start start 2024-09-21T03:18:44.597 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.594+0000 7f069cede640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06980b4090 0x7f06981f5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:44.597 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.594+0000 7f069cede640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06980cfeb0 0x7f069814c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:44.597 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.594+0000 7f069cede640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f069806cde0 0x7f069806d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:44.597 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.594+0000 7f069cede640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f06980b4a30 con 0x7f069806cde0 2024-09-21T03:18:44.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.594+0000 7f069cede640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f06980b48b0 con 0x7f06980b4090 2024-09-21T03:18:44.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.594+0000 7f069cede640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f06980b4bb0 con 0x7f06980cfeb0 2024-09-21T03:18:44.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.594+0000 7f0696d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f069806cde0 0x7f069806d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:44.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.594+0000 7f0696d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f069806cde0 0x7f069806d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40834/0 (socket says 172.21.15.105:40834) 2024-09-21T03:18:44.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.594+0000 7f0696d9d640 1 -- 172.21.15.105:0/2452855301 learned_addr learned my addr 172.21.15.105:0/2452855301 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:44.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.595+0000 7f069659c640 1 --2- 172.21.15.105:0/2452855301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06980b4090 0x7f06981f5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:44.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.595+0000 7f0695d9b640 1 --2- 172.21.15.105:0/2452855301 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06980cfeb0 0x7f069814c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:44.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.595+0000 7f0696d9d640 1 -- 172.21.15.105:0/2452855301 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06980cfeb0 msgr2=0x7f069814c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:44.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.595+0000 7f0696d9d640 1 --2- 172.21.15.105:0/2452855301 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06980cfeb0 0x7f069814c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:44.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.595+0000 7f0696d9d640 1 -- 172.21.15.105:0/2452855301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06980b4090 msgr2=0x7f06981f5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:44.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.595+0000 7f0696d9d640 1 --2- 172.21.15.105:0/2452855301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06980b4090 0x7f06981f5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:44.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.595+0000 7f0696d9d640 1 -- 172.21.15.105:0/2452855301 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06980c5500 con 0x7f069806cde0 2024-09-21T03:18:44.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.595+0000 7f0695d9b640 1 --2- 172.21.15.105:0/2452855301 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06980cfeb0 0x7f069814c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:18:44.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.595+0000 7f069659c640 1 --2- 172.21.15.105:0/2452855301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06980b4090 0x7f06981f5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:18:44.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.595+0000 7f0696d9d640 1 --2- 172.21.15.105:0/2452855301 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f069806cde0 0x7f069806d1f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0690009230 tx=0x7f0690003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:44.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.595+0000 7f0686ffd640 1 -- 172.21.15.105:0/2452855301 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f069003e030 con 0x7f069806cde0 2024-09-21T03:18:44.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.595+0000 7f0686ffd640 1 -- 172.21.15.105:0/2452855301 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0690003e50 con 0x7f069806cde0 2024-09-21T03:18:44.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.595+0000 7f069cede640 1 -- 172.21.15.105:0/2452855301 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06981f64d0 con 0x7f069806cde0 2024-09-21T03:18:44.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.595+0000 7f0686ffd640 1 -- 172.21.15.105:0/2452855301 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0690035040 con 0x7f069806cde0 2024-09-21T03:18:44.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.595+0000 7f069cede640 1 -- 172.21.15.105:0/2452855301 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0698156830 con 0x7f069806cde0 2024-09-21T03:18:44.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.597+0000 7f0686ffd640 1 -- 172.21.15.105:0/2452855301 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0690041030 con 0x7f069806cde0 2024-09-21T03:18:44.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.597+0000 7f0686ffd640 1 --2- 172.21.15.105:0/2452855301 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0678078b90 0x7f067807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:44.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.597+0000 7f0686ffd640 1 -- 172.21.15.105:0/2452855301 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f06900bb550 con 0x7f069806cde0 2024-09-21T03:18:44.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.598+0000 7f069659c640 1 --2- 172.21.15.105:0/2452855301 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0678078b90 0x7f067807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:44.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.598+0000 7f06a3e4c740 1 Processor -- start 2024-09-21T03:18:44.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.598+0000 7f069659c640 1 --2- 172.21.15.105:0/2452855301 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0678078b90 0x7f067807b0a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0688007e90 tx=0x7f06880073a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:44.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.598+0000 7f06a3e4c740 1 -- start start 2024-09-21T03:18:44.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.599+0000 7f06a3e4c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5642dbb7e270 0x5642dbf4ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:44.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.599+0000 7f06a3e4c740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642dbb553b0 0x5642dbf504e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:44.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.599+0000 7f06a3e4c740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5642dbb5d590 0x5642dbf6d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:44.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.600+0000 7f06a3e4c740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5642dbe98820 con 0x5642dbb553b0 2024-09-21T03:18:44.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.600+0000 7f06a3e4c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5642dbe87c50 con 0x5642dbb7e270 2024-09-21T03:18:44.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.600+0000 7f06a3e4c740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5642dbe8ba60 con 0x5642dbb5d590 2024-09-21T03:18:44.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.600+0000 7f0695d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642dbb553b0 0x5642dbf504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:44.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.600+0000 7f0695d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642dbb553b0 0x5642dbf504e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40850/0 (socket says 172.21.15.105:40850) 2024-09-21T03:18:44.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.600+0000 7f0695d9b640 1 -- 172.21.15.105:0/3260679013 learned_addr learned my addr 172.21.15.105:0/3260679013 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:44.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.600+0000 7f069659c640 1 --2- 172.21.15.105:0/3260679013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5642dbb7e270 0x5642dbf4ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:44.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.600+0000 7f0696d9d640 1 --2- 172.21.15.105:0/3260679013 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5642dbb5d590 0x5642dbf6d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:44.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.600+0000 7f0695d9b640 1 -- 172.21.15.105:0/3260679013 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5642dbb5d590 msgr2=0x5642dbf6d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:18:44.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.600+0000 7f0695d9b640 1 --2- 172.21.15.105:0/3260679013 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5642dbb5d590 0x5642dbf6d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:44.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.600+0000 7f0695d9b640 1 -- 172.21.15.105:0/3260679013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5642dbb7e270 msgr2=0x5642dbf4ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:18:44.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.600+0000 7f0695d9b640 1 --2- 172.21.15.105:0/3260679013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5642dbb7e270 0x5642dbf4ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:44.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.600+0000 7f0695d9b640 1 -- 172.21.15.105:0/3260679013 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642dbbe9850 con 0x5642dbb553b0 2024-09-21T03:18:44.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.600+0000 7f0695d9b640 1 --2- 172.21.15.105:0/3260679013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642dbb553b0 0x5642dbf504e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f068c00ba50 tx=0x7f068c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cd325a5a14e9c45 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:44.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.600+0000 7f0677fff640 1 -- 172.21.15.105:0/3260679013 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068c017420 con 0x5642dbb553b0 2024-09-21T03:18:44.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.600+0000 7f0677fff640 1 -- 172.21.15.105:0/3260679013 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f068c0176b0 con 0x5642dbb553b0 2024-09-21T03:18:44.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.600+0000 7f0677fff640 1 -- 172.21.15.105:0/3260679013 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068c017b00 con 0x5642dbb553b0 2024-09-21T03:18:44.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.601+0000 7f06a3e4c740 1 -- 172.21.15.105:0/3260679013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642dbb553b0 msgr2=0x5642dbf504e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:44.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.601+0000 7f06a3e4c740 1 --2- 172.21.15.105:0/3260679013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642dbb553b0 0x5642dbf504e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f068c00ba50 tx=0x7f068c00bf10 comp rx=0 tx=0).stop 2024-09-21T03:18:44.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.601+0000 7f06a3e4c740 1 -- 172.21.15.105:0/3260679013 shutdown_connections 2024-09-21T03:18:44.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.601+0000 7f06a3e4c740 1 --2- 172.21.15.105:0/3260679013 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5642dbb5d590 0x5642dbf6d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:44.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.601+0000 7f06a3e4c740 1 --2- 172.21.15.105:0/3260679013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642dbb553b0 0x5642dbf504e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:44.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.601+0000 7f06a3e4c740 1 --2- 172.21.15.105:0/3260679013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5642dbb7e270 0x5642dbf4ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:44.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.601+0000 7f06a3e4c740 1 -- 172.21.15.105:0/3260679013 >> 172.21.15.105:0/3260679013 conn(0x5642dbb723c0 msgr2=0x5642dbf26260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:44.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.601+0000 7f06a3e4c740 1 -- 172.21.15.105:0/3260679013 shutdown_connections 2024-09-21T03:18:44.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.601+0000 7f06a3e4c740 1 -- 172.21.15.105:0/3260679013 wait complete. 2024-09-21T03:18:44.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.602+0000 7f06a3e4c740 1 -- start start 2024-09-21T03:18:44.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.602+0000 7f06a3e4c740 1 Processor -- start 2024-09-21T03:18:44.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.604+0000 7f06a3e4c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5642dbb553b0 0x5642dbf6b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:44.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.604+0000 7f06a3e4c740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642dbb5d590 0x5642dbf3b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:44.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.604+0000 7f06a3e4c740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5642dbb7e270 0x5642dbf1f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:44.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.604+0000 7f06a3e4c740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5642dbbf8620 con 0x5642dbb5d590 2024-09-21T03:18:44.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.604+0000 7f06a3e4c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5642dbe2d5f0 con 0x5642dbb553b0 2024-09-21T03:18:44.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.604+0000 7f06a3e4c740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5642dbf50a20 con 0x5642dbb7e270 2024-09-21T03:18:44.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.604+0000 7f06a3e4c740 10 client.0 _ll_register_callbacks cb 0x5642dbe310a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:18:44.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.604+0000 7f0695d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642dbb5d590 0x5642dbf3b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:44.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.604+0000 7f0695d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642dbb5d590 0x5642dbf3b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40852/0 (socket says 172.21.15.105:40852) 2024-09-21T03:18:44.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.604+0000 7f0695d9b640 1 -- 172.21.15.105:0/220681399 learned_addr learned my addr 172.21.15.105:0/220681399 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:44.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.604+0000 7f069659c640 1 --2- 172.21.15.105:0/220681399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5642dbb553b0 0x5642dbf6b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:44.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.604+0000 7f0696d9d640 1 --2- 172.21.15.105:0/220681399 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5642dbb7e270 0x5642dbf1f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:44.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.604+0000 7f0695d9b640 1 -- 172.21.15.105:0/220681399 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5642dbb7e270 msgr2=0x5642dbf1f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:18:44.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.604+0000 7f0695d9b640 1 --2- 172.21.15.105:0/220681399 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5642dbb7e270 0x5642dbf1f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:44.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.604+0000 7f0695d9b640 1 -- 172.21.15.105:0/220681399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5642dbb553b0 msgr2=0x5642dbf6b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:18:44.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.604+0000 7f0695d9b640 1 --2- 172.21.15.105:0/220681399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5642dbb553b0 0x5642dbf6b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:44.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.604+0000 7f0695d9b640 1 -- 172.21.15.105:0/220681399 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642dbc606b0 con 0x5642dbb5d590 2024-09-21T03:18:44.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.604+0000 7f0695d9b640 1 --2- 172.21.15.105:0/220681399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642dbb5d590 0x5642dbf3b660 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f068c0058c0 tx=0x7f068c00b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e4ec81dd32efc7a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:44.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.604+0000 7f06757fa640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-21T03:18:44.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.604+0000 7f06757fa640 1 -- 172.21.15.105:0/220681399 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068c026070 con 0x5642dbb5d590 2024-09-21T03:18:44.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.604+0000 7f06757fa640 1 -- 172.21.15.105:0/220681399 <== mon.0 v2:172.21.15.105:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f068c017cf0 con 0x5642dbb5d590 2024-09-21T03:18:44.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.604+0000 7f06a3e4c740 1 -- 172.21.15.105:0/220681399 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f068c0176b0 con 0x5642dbb5d590 2024-09-21T03:18:44.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.604+0000 7f06757fa640 1 -- 172.21.15.105:0/220681399 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f068c031050 con 0x5642dbb5d590 2024-09-21T03:18:44.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.604+0000 7f06a3e4c740 10 client.4707 fetch_fsmap learned FSMap version 8 2024-09-21T03:18:44.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.604+0000 7f06a3e4c740 1 -- 172.21.15.105:0/220681399 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5642dbf66020 con 0x5642dbb5d590 2024-09-21T03:18:44.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.605+0000 7f06757fa640 1 -- 172.21.15.105:0/220681399 <== mon.0 v2:172.21.15.105:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f068c0176b0 con 0x5642dbb5d590 2024-09-21T03:18:44.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.605+0000 7f06757fa640 1 -- 172.21.15.105:0/220681399 <== mon.0 v2:172.21.15.105:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7f068c034020 con 0x5642dbb5d590 2024-09-21T03:18:44.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.605+0000 7f06a3e4c740 10 client.4707 fetch_fsmap finished waiting for FSMap version 8 2024-09-21T03:18:44.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.605+0000 7f06a3e4c740 10 client.4707 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-21T03:18:44.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.605+0000 7f06a3e4c740 20 client.4707 populate_metadata read hostname 'smithi105' 2024-09-21T03:18:44.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.605+0000 7f06a3e4c740 1 --2- 172.21.15.105:0/220681399 >> [v2:172.21.15.162:6834/1998709636,v1:172.21.15.162:6836/1998709636] conn(0x5642dbb3ce40 0x5642dbf7b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:44.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.605+0000 7f06a3e4c740 4 client.4707 mds_command: new command op to 4401 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:18:44.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.605+0000 7f06a3e4c740 1 -- 172.21.15.105:0/220681399 --> [v2:172.21.15.162:6834/1998709636,v1:172.21.15.162:6836/1998709636] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5642dbe9a770 con 0x5642dbb3ce40 2024-09-21T03:18:44.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.605+0000 7f069659c640 1 --2- 172.21.15.105:0/220681399 >> [v2:172.21.15.162:6834/1998709636,v1:172.21.15.162:6836/1998709636] conn(0x5642dbb3ce40 0x5642dbf7b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:44.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.605+0000 7f06757fa640 10 client.4707 ms_handle_connect on v2:172.21.15.162:6834/1998709636 2024-09-21T03:18:44.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.605+0000 7f069659c640 1 --2- 172.21.15.105:0/220681399 >> [v2:172.21.15.162:6834/1998709636,v1:172.21.15.162:6836/1998709636] conn(0x5642dbb3ce40 0x5642dbf7b570 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d1413c42decaa60 server_cookie=1ec53829d0c01b5b in_seq=0 out_seq=0 2024-09-21T03:18:44.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.606+0000 7f06757fa640 1 -- 172.21.15.105:0/220681399 <== mds.0 v2:172.21.15.162:6834/1998709636 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5642dbe9a770 con 0x5642dbb3ce40 2024-09-21T03:18:44.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.606+0000 7f06757fa640 10 client.4707 handle_command_reply: tid=0 2024-09-21T03:18:44.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.606+0000 7f06a3e4c740 1 client.4707 shutdown 2024-09-21T03:18:44.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.606+0000 7f06a3e4c740 1 -- 172.21.15.105:0/220681399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642dbb5d590 msgr2=0x5642dbf3b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:44.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.606+0000 7f06a3e4c740 1 --2- 172.21.15.105:0/220681399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642dbb5d590 0x5642dbf3b660 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f068c0058c0 tx=0x7f068c00b7c0 comp rx=0 tx=0).stop 2024-09-21T03:18:44.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.607+0000 7f06a3e4c740 1 -- 172.21.15.105:0/220681399 shutdown_connections 2024-09-21T03:18:44.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.607+0000 7f06a3e4c740 1 --2- 172.21.15.105:0/220681399 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5642dbb7e270 0x5642dbf1f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:44.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.607+0000 7f06a3e4c740 1 --2- 172.21.15.105:0/220681399 >> [v2:172.21.15.162:6834/1998709636,v1:172.21.15.162:6836/1998709636] conn(0x5642dbb3ce40 0x5642dbf7b570 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:44.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.607+0000 7f06a3e4c740 1 --2- 172.21.15.105:0/220681399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642dbb5d590 0x5642dbf3b660 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:44.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.607+0000 7f06a3e4c740 1 --2- 172.21.15.105:0/220681399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5642dbb553b0 0x5642dbf6b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:44.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.607+0000 7f06757fa640 0 client.4707 ms_handle_reset on v2:172.21.15.162:6834/1998709636 2024-09-21T03:18:44.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.607+0000 7f06a3e4c740 1 -- 172.21.15.105:0/220681399 >> 172.21.15.105:0/220681399 conn(0x5642dbb723c0 msgr2=0x5642dbf26110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:44.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.607+0000 7f06a3e4c740 1 -- 172.21.15.105:0/220681399 shutdown_connections 2024-09-21T03:18:44.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.607+0000 7f06a3e4c740 1 -- 172.21.15.105:0/220681399 wait complete. 2024-09-21T03:18:44.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.607+0000 7f06a3e4c740 20 client.4707 trim_cache size 0 max 16384 2024-09-21T03:18:44.626 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.625+0000 7f06a3e4c740 1 Processor -- start 2024-09-21T03:18:44.626 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.625+0000 7f06a3e4c740 1 -- start start 2024-09-21T03:18:44.629 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.626+0000 7f06a3e4c740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5642dbb553b0 0x5642dbf260f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:44.629 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.626+0000 7f06a3e4c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5642dbb5d590 0x5642dbf26630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:44.629 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.626+0000 7f06a3e4c740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642dbb7e270 0x5642dbf8d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:44.629 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.626+0000 7f06a3e4c740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0698201160 con 0x5642dbb7e270 2024-09-21T03:18:44.629 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.626+0000 7f06a3e4c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f06980c7a00 con 0x5642dbb5d590 2024-09-21T03:18:44.629 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.626+0000 7f06a3e4c740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f06980c8050 con 0x5642dbb553b0 2024-09-21T03:18:44.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.626+0000 7f0696d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642dbb7e270 0x5642dbf8d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:44.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.626+0000 7f0696d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642dbb7e270 0x5642dbf8d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40868/0 (socket says 172.21.15.105:40868) 2024-09-21T03:18:44.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.626+0000 7f0696d9d640 1 -- 172.21.15.105:0/129308045 learned_addr learned my addr 172.21.15.105:0/129308045 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:44.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.626+0000 7f069659c640 1 --2- 172.21.15.105:0/129308045 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5642dbb553b0 0x5642dbf260f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:44.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.626+0000 7f0695d9b640 1 --2- 172.21.15.105:0/129308045 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5642dbb5d590 0x5642dbf26630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:44.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.626+0000 7f0696d9d640 1 -- 172.21.15.105:0/129308045 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5642dbb553b0 msgr2=0x5642dbf260f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:18:44.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.626+0000 7f0696d9d640 1 --2- 172.21.15.105:0/129308045 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5642dbb553b0 0x5642dbf260f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:44.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.626+0000 7f0696d9d640 1 -- 172.21.15.105:0/129308045 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5642dbb5d590 msgr2=0x5642dbf26630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:18:44.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.626+0000 7f0696d9d640 1 --2- 172.21.15.105:0/129308045 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5642dbb5d590 0x5642dbf26630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:44.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.626+0000 7f0696d9d640 1 -- 172.21.15.105:0/129308045 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642dbf1aea0 con 0x5642dbb7e270 2024-09-21T03:18:44.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.626+0000 7f069659c640 1 --2- 172.21.15.105:0/129308045 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5642dbb553b0 0x5642dbf260f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:18:44.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.627+0000 7f0695d9b640 1 --2- 172.21.15.105:0/129308045 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5642dbb5d590 0x5642dbf26630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:18:44.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.627+0000 7f0696d9d640 1 --2- 172.21.15.105:0/129308045 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642dbb7e270 0x5642dbf8d7c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f06900b99f0 tx=0x7f06900bb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b85b663c13b064 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:44.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.627+0000 7f06777fe640 1 -- 172.21.15.105:0/129308045 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0690048040 con 0x5642dbb7e270 2024-09-21T03:18:44.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.627+0000 7f06777fe640 1 -- 172.21.15.105:0/129308045 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06900a9030 con 0x5642dbb7e270 2024-09-21T03:18:44.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.627+0000 7f06777fe640 1 -- 172.21.15.105:0/129308045 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0690087e90 con 0x5642dbb7e270 2024-09-21T03:18:44.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.627+0000 7f06a3e4c740 1 -- 172.21.15.105:0/129308045 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642dbb7e270 msgr2=0x5642dbf8d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:44.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.627+0000 7f06a3e4c740 1 --2- 172.21.15.105:0/129308045 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642dbb7e270 0x5642dbf8d7c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f06900b99f0 tx=0x7f06900bb040 comp rx=0 tx=0).stop 2024-09-21T03:18:44.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.628+0000 7f06a3e4c740 1 -- 172.21.15.105:0/129308045 shutdown_connections 2024-09-21T03:18:44.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.628+0000 7f06a3e4c740 1 --2- 172.21.15.105:0/129308045 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642dbb7e270 0x5642dbf8d7c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:44.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.628+0000 7f06a3e4c740 1 --2- 172.21.15.105:0/129308045 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5642dbb5d590 0x5642dbf26630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:44.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.628+0000 7f06a3e4c740 1 --2- 172.21.15.105:0/129308045 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5642dbb553b0 0x5642dbf260f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:44.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.628+0000 7f06a3e4c740 1 -- 172.21.15.105:0/129308045 >> 172.21.15.105:0/129308045 conn(0x5642dbb723c0 msgr2=0x5642dbf27180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:44.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.628+0000 7f06a3e4c740 1 -- 172.21.15.105:0/129308045 shutdown_connections 2024-09-21T03:18:44.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.628+0000 7f06a3e4c740 1 -- 172.21.15.105:0/129308045 wait complete. 2024-09-21T03:18:44.635 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.628+0000 7f06a3e4c740 1 -- start start 2024-09-21T03:18:44.635 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.628+0000 7f06a3e4c740 1 Processor -- start 2024-09-21T03:18:44.635 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.630+0000 7f06a3e4c740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642dbb553b0 0x5642dbf3ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:44.635 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.630+0000 7f06a3e4c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5642dbb5d590 0x5642dbf648d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:44.635 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.630+0000 7f06a3e4c740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5642dbb7e270 0x5642dbfe0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:44.635 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.630+0000 7f06a3e4c740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5642dbf3bc40 con 0x5642dbb553b0 2024-09-21T03:18:44.635 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.630+0000 7f06a3e4c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5642dbf7c5f0 con 0x5642dbb5d590 2024-09-21T03:18:44.636 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.630+0000 7f06a3e4c740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5642dbf7d5b0 con 0x5642dbb7e270 2024-09-21T03:18:44.636 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.630+0000 7f06a3e4c740 10 client.0 _ll_register_callbacks cb 0x7f0688007670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:18:44.636 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.630+0000 7f069659c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642dbb553b0 0x5642dbf3ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:44.636 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.630+0000 7f069659c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642dbb553b0 0x5642dbf3ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40872/0 (socket says 172.21.15.105:40872) 2024-09-21T03:18:44.636 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.630+0000 7f069659c640 1 -- 172.21.15.105:0/2957194987 learned_addr learned my addr 172.21.15.105:0/2957194987 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:44.636 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.630+0000 7f0695d9b640 1 --2- 172.21.15.105:0/2957194987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5642dbb5d590 0x5642dbf648d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:44.636 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.630+0000 7f0696d9d640 1 --2- 172.21.15.105:0/2957194987 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5642dbb7e270 0x5642dbfe0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:44.636 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.630+0000 7f069659c640 1 -- 172.21.15.105:0/2957194987 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5642dbb7e270 msgr2=0x5642dbfe0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:18:44.636 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.630+0000 7f069659c640 1 --2- 172.21.15.105:0/2957194987 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5642dbb7e270 0x5642dbfe0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:44.636 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.630+0000 7f069659c640 1 -- 172.21.15.105:0/2957194987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5642dbb5d590 msgr2=0x5642dbf648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:18:44.636 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.630+0000 7f069659c640 1 --2- 172.21.15.105:0/2957194987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5642dbb5d590 0x5642dbf648d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:44.636 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.630+0000 7f069659c640 1 -- 172.21.15.105:0/2957194987 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642dbf64f40 con 0x5642dbb553b0 2024-09-21T03:18:44.636 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.630+0000 7f069659c640 1 --2- 172.21.15.105:0/2957194987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642dbb553b0 0x5642dbf3ebd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x5642dbf403c0 tx=0x7f0688004a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=518edc6dae191a68 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:44.636 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.630+0000 7f06757fa640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-21T03:18:44.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.631+0000 7f06757fa640 1 -- 172.21.15.105:0/2957194987 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068802a070 con 0x5642dbb553b0 2024-09-21T03:18:44.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.631+0000 7f06757fa640 1 -- 172.21.15.105:0/2957194987 <== mon.0 v2:172.21.15.105:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f068802f460 con 0x5642dbb553b0 2024-09-21T03:18:44.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.631+0000 7f06a3e4c740 1 -- 172.21.15.105:0/2957194987 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06900a9030 con 0x5642dbb553b0 2024-09-21T03:18:44.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.631+0000 7f06757fa640 1 -- 172.21.15.105:0/2957194987 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f0688037050 con 0x5642dbb553b0 2024-09-21T03:18:44.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.631+0000 7f06a3e4c740 10 client.4713 fetch_fsmap learned FSMap version 8 2024-09-21T03:18:44.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.631+0000 7f06a3e4c740 1 -- 172.21.15.105:0/2957194987 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5642dbf3e6b0 con 0x5642dbb553b0 2024-09-21T03:18:44.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.631+0000 7f06757fa640 1 -- 172.21.15.105:0/2957194987 <== mon.0 v2:172.21.15.105:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06900a9030 con 0x5642dbb553b0 2024-09-21T03:18:44.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.631+0000 7f06757fa640 1 -- 172.21.15.105:0/2957194987 <== mon.0 v2:172.21.15.105:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7f068802f6a0 con 0x5642dbb553b0 2024-09-21T03:18:44.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.631+0000 7f06a3e4c740 10 client.4713 fetch_fsmap finished waiting for FSMap version 8 2024-09-21T03:18:44.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.631+0000 7f06a3e4c740 10 client.4713 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-21T03:18:44.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.631+0000 7f06a3e4c740 20 client.4713 populate_metadata read hostname 'smithi105' 2024-09-21T03:18:44.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.631+0000 7f06a3e4c740 1 --2- 172.21.15.105:0/2957194987 >> [v2:172.21.15.162:6834/1998709636,v1:172.21.15.162:6836/1998709636] conn(0x5642dbf26560 0x5642dbf4ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:44.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.631+0000 7f06a3e4c740 4 client.4713 mds_command: new command op to 4401 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T03:18:44.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.631+0000 7f06a3e4c740 1 -- 172.21.15.105:0/2957194987 --> [v2:172.21.15.162:6834/1998709636,v1:172.21.15.162:6836/1998709636] -- command(tid 0: {"prefix": "status"}) -- 0x5642dbe96220 con 0x5642dbf26560 2024-09-21T03:18:44.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.631+0000 7f0695d9b640 1 --2- 172.21.15.105:0/2957194987 >> [v2:172.21.15.162:6834/1998709636,v1:172.21.15.162:6836/1998709636] conn(0x5642dbf26560 0x5642dbf4ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:44.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.632+0000 7f06757fa640 10 client.4713 ms_handle_connect on v2:172.21.15.162:6834/1998709636 2024-09-21T03:18:44.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.632+0000 7f0695d9b640 1 --2- 172.21.15.105:0/2957194987 >> [v2:172.21.15.162:6834/1998709636,v1:172.21.15.162:6836/1998709636] conn(0x5642dbf26560 0x5642dbf4ca70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9de94ed288c92f84 server_cookie=48abba9ce2241ce in_seq=0 out_seq=0 2024-09-21T03:18:44.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.632+0000 7f06757fa640 1 -- 172.21.15.105:0/2957194987 <== mds.0 v2:172.21.15.162:6834/1998709636 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x5642dbe96220 con 0x5642dbf26560 2024-09-21T03:18:44.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.632+0000 7f06757fa640 10 client.4713 handle_command_reply: tid=0 2024-09-21T03:18:44.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.632+0000 7f06a3e4c740 1 client.4713 shutdown 2024-09-21T03:18:44.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.632+0000 7f06a3e4c740 1 -- 172.21.15.105:0/2957194987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642dbb553b0 msgr2=0x5642dbf3ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:44.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.632+0000 7f06a3e4c740 1 --2- 172.21.15.105:0/2957194987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642dbb553b0 0x5642dbf3ebd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x5642dbf403c0 tx=0x7f0688004a00 comp rx=0 tx=0).stop 2024-09-21T03:18:44.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.632+0000 7f06a3e4c740 1 -- 172.21.15.105:0/2957194987 shutdown_connections 2024-09-21T03:18:44.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.632+0000 7f06a3e4c740 1 --2- 172.21.15.105:0/2957194987 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5642dbb7e270 0x5642dbfe0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:44.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.632+0000 7f06a3e4c740 1 --2- 172.21.15.105:0/2957194987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5642dbb5d590 0x5642dbf648d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:44.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.632+0000 7f06a3e4c740 1 --2- 172.21.15.105:0/2957194987 >> [v2:172.21.15.162:6834/1998709636,v1:172.21.15.162:6836/1998709636] conn(0x5642dbf26560 0x5642dbf4ca70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:44.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.632+0000 7f06a3e4c740 1 --2- 172.21.15.105:0/2957194987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5642dbb553b0 0x5642dbf3ebd0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:44.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.632+0000 7f06a3e4c740 1 -- 172.21.15.105:0/2957194987 >> 172.21.15.105:0/2957194987 conn(0x5642dbb723c0 msgr2=0x5642dbf27180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:44.639 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.632+0000 7f06757fa640 0 client.4713 ms_handle_reset on v2:172.21.15.162:6834/1998709636 2024-09-21T03:18:44.639 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.632+0000 7f06a3e4c740 1 -- 172.21.15.105:0/2957194987 shutdown_connections 2024-09-21T03:18:44.639 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.632+0000 7f06a3e4c740 1 -- 172.21.15.105:0/2957194987 wait complete. 2024-09-21T03:18:44.639 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.632+0000 7f06a3e4c740 20 client.4713 trim_cache size 0 max 16384 2024-09-21T03:18:44.639 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-21T03:18:44.639 INFO:teuthology.orchestra.run.smithi105.stdout: "cluster_fsid": "29d80f4f-e5de-4b26-8384-24c2d8019945", 2024-09-21T03:18:44.639 INFO:teuthology.orchestra.run.smithi105.stdout: "whoami": 0, 2024-09-21T03:18:44.639 INFO:teuthology.orchestra.run.smithi105.stdout: "id": 4401, 2024-09-21T03:18:44.639 INFO:teuthology.orchestra.run.smithi105.stdout: "want_state": "up:active", 2024-09-21T03:18:44.639 INFO:teuthology.orchestra.run.smithi105.stdout: "state": "up:active", 2024-09-21T03:18:44.639 INFO:teuthology.orchestra.run.smithi105.stdout: "fs_name": "cephfs", 2024-09-21T03:18:44.640 INFO:teuthology.orchestra.run.smithi105.stdout: "rank_uptime": 14.235278628, 2024-09-21T03:18:44.640 INFO:teuthology.orchestra.run.smithi105.stdout: "mdsmap_epoch": 8, 2024-09-21T03:18:44.640 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_epoch": 23, 2024-09-21T03:18:44.640 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_epoch_barrier": 23, 2024-09-21T03:18:44.640 INFO:teuthology.orchestra.run.smithi105.stdout: "uptime": 20.259125832999999 2024-09-21T03:18:44.640 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-21T03:18:44.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.633+0000 7f069cede640 1 -- 172.21.15.105:0/2452855301 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0678078b90 msgr2=0x7f067807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:44.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.633+0000 7f069cede640 1 --2- 172.21.15.105:0/2452855301 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0678078b90 0x7f067807b0a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0688007e90 tx=0x7f06880073a0 comp rx=0 tx=0).stop 2024-09-21T03:18:44.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.633+0000 7f069cede640 1 -- 172.21.15.105:0/2452855301 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f069806cde0 msgr2=0x7f069806d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:44.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.633+0000 7f069cede640 1 --2- 172.21.15.105:0/2452855301 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f069806cde0 0x7f069806d1f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0690009230 tx=0x7f0690003960 comp rx=0 tx=0).stop 2024-09-21T03:18:44.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.633+0000 7f069cede640 1 -- 172.21.15.105:0/2452855301 shutdown_connections 2024-09-21T03:18:44.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.633+0000 7f069cede640 1 --2- 172.21.15.105:0/2452855301 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0678078b90 0x7f067807b0a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:44.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.633+0000 7f069cede640 1 --2- 172.21.15.105:0/2452855301 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f069806cde0 0x7f069806d1f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:44.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.633+0000 7f069cede640 1 --2- 172.21.15.105:0/2452855301 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06980cfeb0 0x7f069814c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:44.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.633+0000 7f069cede640 1 --2- 172.21.15.105:0/2452855301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06980b4090 0x7f06981f5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:44.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.633+0000 7f069cede640 1 -- 172.21.15.105:0/2452855301 >> 172.21.15.105:0/2452855301 conn(0x7f06980cdcc0 msgr2=0x7f06980b0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:44.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.633+0000 7f069cede640 1 -- 172.21.15.105:0/2452855301 shutdown_connections 2024-09-21T03:18:44.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:44.633+0000 7f069cede640 1 -- 172.21.15.105:0/2452855301 wait complete. 2024-09-21T03:18:44.645 INFO:teuthology.run_tasks:Running task kclient... 2024-09-21T03:18:44.668 INFO:tasks.kclient:Mounting kernel clients... 2024-09-21T03:18:44.668 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-21T03:18:44.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:44.668 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-09-21T03:18:44.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:44.684 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link delete ceph-brx 2024-09-21T03:18:44.751 INFO:teuthology.orchestra.run.smithi105.stderr:Cannot find device "ceph-brx" 2024-09-21T03:18:44.752 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:18:44.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:44.753 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-09-21T03:18:44.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:44.809 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link delete ceph-brx 2024-09-21T03:18:44.875 INFO:teuthology.orchestra.run.smithi105.stderr:Cannot find device "ceph-brx" 2024-09-21T03:18:44.876 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:18:44.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:44.876 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-09-21T03:18:44.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:44.896 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link delete ceph-brx 2024-09-21T03:18:44.969 INFO:teuthology.orchestra.run.smithi162.stderr:Cannot find device "ceph-brx" 2024-09-21T03:18:44.970 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:18:44.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:44.971 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-09-21T03:18:45.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:45.029 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link delete ceph-brx 2024-09-21T03:18:45.098 INFO:teuthology.orchestra.run.smithi162.stderr:Cannot find device "ceph-brx" 2024-09-21T03:18:45.099 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:18:45.100 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-21T03:18:45.100 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T03:18:45.100 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T03:18:45.100 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T03:18:45.214 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.212+0000 7f922efa1640 1 -- 172.21.15.105:0/3439478514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9228070030 msgr2=0x7f9228074640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:45.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.212+0000 7f922efa1640 1 --2- 172.21.15.105:0/3439478514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9228070030 0x7f9228074640 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9228070e70 tx=0x7f921402a560 comp rx=0 tx=0).stop 2024-09-21T03:18:45.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.213+0000 7f922efa1640 1 -- 172.21.15.105:0/3439478514 shutdown_connections 2024-09-21T03:18:45.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.213+0000 7f922efa1640 1 --2- 172.21.15.105:0/3439478514 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9228070440 0x7f9228074b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:45.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.213+0000 7f922efa1640 1 --2- 172.21.15.105:0/3439478514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9228070030 0x7f9228074640 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:45.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.213+0000 7f922efa1640 1 --2- 172.21.15.105:0/3439478514 >> v2:172.21.15.162:3300/0 conn(0x7f9228073170 0x7f922815c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:45.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.213+0000 7f922efa1640 1 -- 172.21.15.105:0/3439478514 >> 172.21.15.105:0/3439478514 conn(0x7f92280b1cb0 msgr2=0x7f92280b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:45.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.213+0000 7f922efa1640 1 -- 172.21.15.105:0/3439478514 shutdown_connections 2024-09-21T03:18:45.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.213+0000 7f922efa1640 1 -- 172.21.15.105:0/3439478514 wait complete. 2024-09-21T03:18:45.216 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.214+0000 7f922efa1640 1 Processor -- start 2024-09-21T03:18:45.216 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.214+0000 7f922efa1640 1 -- start start 2024-09-21T03:18:45.219 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.216+0000 7f922efa1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9228070030 0x7f922809d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:45.219 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.216+0000 7f922efa1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9228070440 0x7f9228147e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:45.219 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.216+0000 7f922efa1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9228073170 0x7f92281487f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:45.219 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.216+0000 7f922efa1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f922806f630 con 0x7f9228070440 2024-09-21T03:18:45.219 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.216+0000 7f922efa1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f922806f4b0 con 0x7f9228073170 2024-09-21T03:18:45.219 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.216+0000 7f922efa1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f922806f7b0 con 0x7f9228070030 2024-09-21T03:18:45.219 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.216+0000 7f9227fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9228070440 0x7f9228147e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:45.219 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.216+0000 7f9227fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9228070440 0x7f9228147e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40892/0 (socket says 172.21.15.105:40892) 2024-09-21T03:18:45.219 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.216+0000 7f9227fff640 1 -- 172.21.15.105:0/1032773381 learned_addr learned my addr 172.21.15.105:0/1032773381 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:45.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.216+0000 7f922cd3d640 1 --2- 172.21.15.105:0/1032773381 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9228070030 0x7f922809d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:45.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.216+0000 7f922d53e640 1 --2- 172.21.15.105:0/1032773381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9228073170 0x7f92281487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:45.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.216+0000 7f9227fff640 1 -- 172.21.15.105:0/1032773381 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9228070030 msgr2=0x7f922809d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:45.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.216+0000 7f9227fff640 1 --2- 172.21.15.105:0/1032773381 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9228070030 0x7f922809d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:45.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.216+0000 7f9227fff640 1 -- 172.21.15.105:0/1032773381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9228073170 msgr2=0x7f92281487f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:45.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.216+0000 7f9227fff640 1 --2- 172.21.15.105:0/1032773381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9228073170 0x7f92281487f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:45.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.216+0000 7f9227fff640 1 -- 172.21.15.105:0/1032773381 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f922814e6a0 con 0x7f9228070440 2024-09-21T03:18:45.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.216+0000 7f9227fff640 1 --2- 172.21.15.105:0/1032773381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9228070440 0x7f9228147e30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9214034040 tx=0x7f92140039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:45.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.217+0000 7f92257fa640 1 -- 172.21.15.105:0/1032773381 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f921403e030 con 0x7f9228070440 2024-09-21T03:18:45.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.217+0000 7f92257fa640 1 -- 172.21.15.105:0/1032773381 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92140047a0 con 0x7f9228070440 2024-09-21T03:18:45.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.217+0000 7f922efa1640 1 -- 172.21.15.105:0/1032773381 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92281e50b0 con 0x7f9228070440 2024-09-21T03:18:45.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.217+0000 7f92257fa640 1 -- 172.21.15.105:0/1032773381 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9214035040 con 0x7f9228070440 2024-09-21T03:18:45.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.217+0000 7f922efa1640 1 -- 172.21.15.105:0/1032773381 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92281e5800 con 0x7f9228070440 2024-09-21T03:18:45.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.218+0000 7f922efa1640 1 -- 172.21.15.105:0/1032773381 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92281e5280 con 0x7f9228070440 2024-09-21T03:18:45.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.218+0000 7f92257fa640 1 -- 172.21.15.105:0/1032773381 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9214041030 con 0x7f9228070440 2024-09-21T03:18:45.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.219+0000 7f92257fa640 1 --2- 172.21.15.105:0/1032773381 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f920c078b90 0x7f920c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:45.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.219+0000 7f92257fa640 1 -- 172.21.15.105:0/1032773381 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f92140bb5f0 con 0x7f9228070440 2024-09-21T03:18:45.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.219+0000 7f922cd3d640 1 --2- 172.21.15.105:0/1032773381 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f920c078b90 0x7f920c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:45.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.220+0000 7f922cd3d640 1 --2- 172.21.15.105:0/1032773381 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f920c078b90 0x7f920c07b0a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f921c00a490 tx=0x7f921c00a420 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:45.225 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.224+0000 7f92257fa640 1 -- 172.21.15.105:0/1032773381 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f92281e5280 con 0x7f9228070440 2024-09-21T03:18:45.441 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.440+0000 7f922efa1640 1 -- 172.21.15.105:0/1032773381 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f922815c780 con 0x7f9228070440 2024-09-21T03:18:45.442 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.440+0000 7f92257fa640 1 -- 172.21.15.105:0/1032773381 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f92140833e0 con 0x7f9228070440 2024-09-21T03:18:45.442 INFO:teuthology.orchestra.run.smithi105.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T03:18:45.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.442+0000 7f922efa1640 1 -- 172.21.15.105:0/1032773381 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f920c078b90 msgr2=0x7f920c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:45.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.443+0000 7f922efa1640 1 --2- 172.21.15.105:0/1032773381 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f920c078b90 0x7f920c07b0a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f921c00a490 tx=0x7f921c00a420 comp rx=0 tx=0).stop 2024-09-21T03:18:45.445 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.443+0000 7f922efa1640 1 -- 172.21.15.105:0/1032773381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9228070440 msgr2=0x7f9228147e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:45.445 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.443+0000 7f922efa1640 1 --2- 172.21.15.105:0/1032773381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9228070440 0x7f9228147e30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9214034040 tx=0x7f92140039e0 comp rx=0 tx=0).stop 2024-09-21T03:18:45.445 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.443+0000 7f922efa1640 1 -- 172.21.15.105:0/1032773381 shutdown_connections 2024-09-21T03:18:45.445 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.443+0000 7f922efa1640 1 --2- 172.21.15.105:0/1032773381 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f920c078b90 0x7f920c07b0a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:45.445 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.443+0000 7f922efa1640 1 --2- 172.21.15.105:0/1032773381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9228073170 0x7f92281487f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:45.445 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.443+0000 7f922efa1640 1 --2- 172.21.15.105:0/1032773381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9228070440 0x7f9228147e30 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:45.445 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.443+0000 7f922efa1640 1 --2- 172.21.15.105:0/1032773381 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9228070030 0x7f922809d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:45.445 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.443+0000 7f922efa1640 1 -- 172.21.15.105:0/1032773381 >> 172.21.15.105:0/1032773381 conn(0x7f92280b1cb0 msgr2=0x7f92280afb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:45.445 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.443+0000 7f922efa1640 1 -- 172.21.15.105:0/1032773381 shutdown_connections 2024-09-21T03:18:45.445 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45.443+0000 7f922efa1640 1 -- 172.21.15.105:0/1032773381 wait complete. 2024-09-21T03:18:45.456 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T03:18:45.456 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T03:18:45.456 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi105.front.sepia.ceph.com 2024-09-21T03:18:45.456 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T03:18:45.456 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T03:18:45.456 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T03:18:45.456 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T03:18:45.456 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T03:18:45.456 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:18:45.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:45.456 DEBUG:teuthology.orchestra.run.smithi105:> ip addr 2024-09-21T03:18:45.471 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T03:18:45.472 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T03:18:45.472 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T03:18:45.472 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:18:45.472 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2024-09-21T03:18:45.472 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:18:45.472 INFO:teuthology.orchestra.run.smithi105.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:18:45.472 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b8 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:18:45.472 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f0 2024-09-21T03:18:45.472 INFO:teuthology.orchestra.run.smithi105.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:18:45.472 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b9 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:18:45.472 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f1 2024-09-21T03:18:45.472 INFO:teuthology.orchestra.run.smithi105.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:18:45.473 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:28 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:18:45.473 INFO:teuthology.orchestra.run.smithi105.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T03:18:45.473 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:29 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:18:45.473 INFO:teuthology.orchestra.run.smithi105.stdout: inet 172.21.15.105/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T03:18:45.473 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft 42782sec preferred_lft 42782sec 2024-09-21T03:18:45.473 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::ec4:7aff:fe8f:d429/64 scope link noprefixroute 2024-09-21T03:18:45.473 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:18:45.473 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T03:18:45.473 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:18:45.474 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-21T03:18:45.474 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link add name ceph-brx type bridge 2024-09-21T03:18:45.474 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip addr flush dev ceph-brx 2024-09-21T03:18:45.474 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set ceph-brx up 2024-09-21T03:18:45.474 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T03:18:45.474 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-21T03:18:45.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:18:45.675 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:18:45.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:45.682 DEBUG:teuthology.orchestra.run.smithi105:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T03:18:45.705 INFO:teuthology.orchestra.run.smithi105.stdout:1 2024-09-21T03:18:45.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:45.707 DEBUG:teuthology.orchestra.run.smithi105:> route 2024-09-21T03:18:45.777 INFO:teuthology.orchestra.run.smithi105.stdout:Kernel IP routing table 2024-09-21T03:18:45.777 INFO:teuthology.orchestra.run.smithi105.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T03:18:45.777 INFO:teuthology.orchestra.run.smithi105.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T03:18:45.777 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T03:18:45.777 INFO:teuthology.orchestra.run.smithi105.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T03:18:45.778 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:18:45.778 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-21T03:18:45.778 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T03:18:45.778 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T03:18:45.778 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T03:18:45.778 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-21T03:18:45.864 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:18:46.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:18:46.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:46.046 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-09-21T03:18:46.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:46.061 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list-id 2024-09-21T03:18:46.116 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:18:46.116 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-21T03:18:46.116 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T03:18:46.116 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-21T03:18:46.116 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-21T03:18:46.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:18:46.227 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:18:46.233 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-21T03:18:46.233 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:18:46.233 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-21T03:18:46.233 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-21T03:18:46.233 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T03:18:46.233 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-21T03:18:46.234 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-21T03:18:46.234 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-21T03:18:46.234 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-21T03:18:46.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:18:46.542 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:18:46.542 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:18:46.542 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-21T03:18:46.542 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set brx.0 up 2024-09-21T03:18:46.542 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T03:18:46.542 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-21T03:18:46.596 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:18:46.618 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:18:46.624 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:18:46.625 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T03:18:46.641 INFO:teuthology.orchestra.run.smithi105.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:18:46.641 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:18:46.641 DEBUG:teuthology.orchestra.run.smithi105:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T03:18:46.702 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-21T03:18:46.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:46.702 DEBUG:teuthology.orchestra.run.smithi105:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:18:46.813 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:18:46.813 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T03:18:46.814 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2024-09-21T03:18:46.935 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:18:46.935 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T03:18:46.936 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2024-09-21T03:18:46.936 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:18:46.936 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:18:46.942 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:18:46.942 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T03:18:46.942 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2024-09-21T03:18:46.942 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:18:46.943 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:18:46.943 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-21T03:18:46.943 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-21T03:18:46.943 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=29d80f4f-e5de-4b26-8384-24c2d8019945" will pass to kernel 2024-09-21T03:18:46.944 INFO:teuthology.orchestra.run.smithi105.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T03:18:46.944 INFO:teuthology.orchestra.run.smithi105.stdout: You just mounted a file system that supports labels which does not 2024-09-21T03:18:46.944 INFO:teuthology.orchestra.run.smithi105.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T03:18:46.944 INFO:teuthology.orchestra.run.smithi105.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T03:18:46.944 INFO:teuthology.orchestra.run.smithi105.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T03:18:46.945 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T03:18:46.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:46.945 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T03:18:46.971 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:18:47.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:18:47.068 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:18:47.074 INFO:teuthology.orchestra.run.smithi105.stdout:client4624 2024-09-21T03:18:47.074 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:18:47.074 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:18:47.091 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:18:47.184 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:18:47.190 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:18:47.196 INFO:teuthology.orchestra.run.smithi105.stdout:client4624 2024-09-21T03:18:47.196 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:18:47.248 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:18:47.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:18:47.261 INFO:teuthology.orchestra.run.smithi105.stdout:client4624 2024-09-21T03:18:47.261 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/29d80f4f-e5de-4b26-8384-24c2d8019945.client4624/status') 2024-09-21T03:18:47.313 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:18:47.326 INFO:teuthology.orchestra.run.smithi105.stdout:instance: client.4624 (3)172.21.15.105:0/3580820644 2024-09-21T03:18:47.326 INFO:teuthology.orchestra.run.smithi105.stdout:blocklisted: false 2024-09-21T03:18:47.326 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records in 2024-09-21T03:18:47.326 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records out 2024-09-21T03:18:47.326 INFO:teuthology.orchestra.run.smithi105.stderr:71 bytes copied, 2.3464e-05 s, 3.0 MB/s 2024-09-21T03:18:47.327 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:18:47.333 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-09-21T03:18:47.333 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T03:18:47.333 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-21T03:18:47.334 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T03:18:47.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.445+0000 7fc81fe27640 1 -- 172.21.15.105:0/222036406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc804003a30 msgr2=0x7fc804003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:47.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.445+0000 7fc81fe27640 1 --2- 172.21.15.105:0/222036406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc804003a30 0x7fc804003ea0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc81400c310 tx=0x7fc804005830 comp rx=0 tx=0).stop 2024-09-21T03:18:47.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.445+0000 7fc81e3c4640 1 -- 172.21.15.105:0/222036406 reap_dead start 2024-09-21T03:18:47.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.445+0000 7fc81fe27640 1 -- 172.21.15.105:0/222036406 shutdown_connections 2024-09-21T03:18:47.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.445+0000 7fc81fe27640 1 -- 172.21.15.105:0/222036406 >> 172.21.15.105:0/222036406 conn(0x7fc81809d8f0 msgr2=0x7fc8180d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:47.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.445+0000 7fc81fe27640 1 -- 172.21.15.105:0/222036406 shutdown_connections 2024-09-21T03:18:47.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.445+0000 7fc81fe27640 1 -- 172.21.15.105:0/222036406 wait complete. 2024-09-21T03:18:47.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.447+0000 7fc81fe27640 1 Processor -- start 2024-09-21T03:18:47.449 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.447+0000 7fc81fe27640 1 -- start start 2024-09-21T03:18:47.451 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.448+0000 7fc81fe27640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc804003a30 0x7fc8180b6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:47.451 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.448+0000 7fc81fe27640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8180b6850 0x7fc818160a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:47.451 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.448+0000 7fc81fe27640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8180c89d0 0x7fc818160fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:47.451 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.448+0000 7fc81fe27640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc8180cf310 con 0x7fc8180c89d0 2024-09-21T03:18:47.451 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.448+0000 7fc81fe27640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc8180cf490 con 0x7fc804003a30 2024-09-21T03:18:47.451 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.448+0000 7fc81fe27640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc8180cf610 con 0x7fc8180b6850 2024-09-21T03:18:47.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.449+0000 7fc81e3c4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8180c89d0 0x7fc818160fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:47.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.449+0000 7fc81e3c4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8180c89d0 0x7fc818160fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40910/0 (socket says 172.21.15.105:40910) 2024-09-21T03:18:47.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.449+0000 7fc81e3c4640 1 -- 172.21.15.105:0/3304126909 learned_addr learned my addr 172.21.15.105:0/3304126909 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:47.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.449+0000 7fc81d3c2640 1 --2- 172.21.15.105:0/3304126909 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8180b6850 0x7fc818160a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:47.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.449+0000 7fc81dbc3640 1 --2- 172.21.15.105:0/3304126909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc804003a30 0x7fc8180b6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:47.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.449+0000 7fc81e3c4640 1 -- 172.21.15.105:0/3304126909 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8180b6850 msgr2=0x7fc818160a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:47.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.449+0000 7fc81e3c4640 1 --2- 172.21.15.105:0/3304126909 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8180b6850 0x7fc818160a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:47.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.449+0000 7fc81e3c4640 1 -- 172.21.15.105:0/3304126909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc804003a30 msgr2=0x7fc8180b6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:47.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.449+0000 7fc81e3c4640 1 --2- 172.21.15.105:0/3304126909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc804003a30 0x7fc8180b6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:47.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.449+0000 7fc81e3c4640 1 -- 172.21.15.105:0/3304126909 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8181f9b70 con 0x7fc8180c89d0 2024-09-21T03:18:47.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.449+0000 7fc81dbc3640 1 --2- 172.21.15.105:0/3304126909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc804003a30 0x7fc8180b6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:18:47.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.449+0000 7fc81d3c2640 1 --2- 172.21.15.105:0/3304126909 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8180b6850 0x7fc818160a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:18:47.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.449+0000 7fc81e3c4640 1 --2- 172.21.15.105:0/3304126909 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8180c89d0 0x7fc818160fd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc8180d3e00 tx=0x7fc8100019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:47.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.449+0000 7fc80e7fc640 1 -- 172.21.15.105:0/3304126909 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc810011870 con 0x7fc8180c89d0 2024-09-21T03:18:47.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.449+0000 7fc80e7fc640 1 -- 172.21.15.105:0/3304126909 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc810017070 con 0x7fc8180c89d0 2024-09-21T03:18:47.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.449+0000 7fc80e7fc640 1 -- 172.21.15.105:0/3304126909 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc810011da0 con 0x7fc8180c89d0 2024-09-21T03:18:47.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.449+0000 7fc81fe27640 1 -- 172.21.15.105:0/3304126909 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8181f9fe0 con 0x7fc8180c89d0 2024-09-21T03:18:47.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.449+0000 7fc81fe27640 1 -- 172.21.15.105:0/3304126909 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8180b4620 con 0x7fc8180c89d0 2024-09-21T03:18:47.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.450+0000 7fc81fe27640 1 -- 172.21.15.105:0/3304126909 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8181f9d40 con 0x7fc8180c89d0 2024-09-21T03:18:47.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.451+0000 7fc80e7fc640 1 -- 172.21.15.105:0/3304126909 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc81001c460 con 0x7fc8180c89d0 2024-09-21T03:18:47.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.452+0000 7fc80e7fc640 1 --2- 172.21.15.105:0/3304126909 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc7fc078b90 0x7fc7fc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:47.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.452+0000 7fc80e7fc640 1 -- 172.21.15.105:0/3304126909 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc81009b610 con 0x7fc8180c89d0 2024-09-21T03:18:47.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.452+0000 7fc81dbc3640 1 --2- 172.21.15.105:0/3304126909 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc7fc078b90 0x7fc7fc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:47.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.452+0000 7fc81dbc3640 1 --2- 172.21.15.105:0/3304126909 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc7fc078b90 0x7fc7fc07b0a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc814033000 tx=0x7fc8140019f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:47.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.457+0000 7fc80e7fc640 1 -- 172.21.15.105:0/3304126909 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc8181f9d40 con 0x7fc8180c89d0 2024-09-21T03:18:47.669 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.667+0000 7fc81fe27640 1 -- 172.21.15.105:0/3304126909 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc8180d0250 con 0x7fc8180c89d0 2024-09-21T03:18:47.669 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.667+0000 7fc80e7fc640 1 -- 172.21.15.105:0/3304126909 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7fc81006c020 con 0x7fc8180c89d0 2024-09-21T03:18:47.669 INFO:teuthology.orchestra.run.smithi105.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T03:18:47.671 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.670+0000 7fc81fe27640 1 -- 172.21.15.105:0/3304126909 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc7fc078b90 msgr2=0x7fc7fc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:47.671 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.670+0000 7fc81fe27640 1 --2- 172.21.15.105:0/3304126909 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc7fc078b90 0x7fc7fc07b0a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc814033000 tx=0x7fc8140019f0 comp rx=0 tx=0).stop 2024-09-21T03:18:47.671 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.670+0000 7fc81fe27640 1 -- 172.21.15.105:0/3304126909 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8180c89d0 msgr2=0x7fc818160fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:47.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.670+0000 7fc81fe27640 1 --2- 172.21.15.105:0/3304126909 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8180c89d0 0x7fc818160fd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc8180d3e00 tx=0x7fc8100019b0 comp rx=0 tx=0).stop 2024-09-21T03:18:47.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.670+0000 7fc81fe27640 1 -- 172.21.15.105:0/3304126909 shutdown_connections 2024-09-21T03:18:47.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.670+0000 7fc81fe27640 1 --2- 172.21.15.105:0/3304126909 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc7fc078b90 0x7fc7fc07b0a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:47.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.670+0000 7fc81fe27640 1 --2- 172.21.15.105:0/3304126909 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8180c89d0 0x7fc818160fd0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:47.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.670+0000 7fc81fe27640 1 --2- 172.21.15.105:0/3304126909 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8180b6850 0x7fc818160a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:47.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.670+0000 7fc81fe27640 1 --2- 172.21.15.105:0/3304126909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc804003a30 0x7fc8180b6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:47.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.670+0000 7fc81fe27640 1 -- 172.21.15.105:0/3304126909 >> 172.21.15.105:0/3304126909 conn(0x7fc81809d8f0 msgr2=0x7fc81815c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:47.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.670+0000 7fc81fe27640 1 -- 172.21.15.105:0/3304126909 shutdown_connections 2024-09-21T03:18:47.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47.670+0000 7fc81fe27640 1 -- 172.21.15.105:0/3304126909 wait complete. 2024-09-21T03:18:47.682 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T03:18:47.682 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T03:18:47.682 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi105.front.sepia.ceph.com 2024-09-21T03:18:47.682 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-21T03:18:47.683 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-21T03:18:47.683 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T03:18:47.683 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T03:18:47.683 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T03:18:47.683 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-21T03:18:47.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:47.683 DEBUG:teuthology.orchestra.run.smithi105:> ip addr 2024-09-21T03:18:47.699 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T03:18:47.699 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T03:18:47.699 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T03:18:47.699 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:18:47.699 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2024-09-21T03:18:47.699 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:18:47.699 INFO:teuthology.orchestra.run.smithi105.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:18:47.699 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b8 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:18:47.699 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f0 2024-09-21T03:18:47.699 INFO:teuthology.orchestra.run.smithi105.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:18:47.699 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b9 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:18:47.699 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f1 2024-09-21T03:18:47.700 INFO:teuthology.orchestra.run.smithi105.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:18:47.700 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:28 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:18:47.700 INFO:teuthology.orchestra.run.smithi105.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T03:18:47.700 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:29 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:18:47.700 INFO:teuthology.orchestra.run.smithi105.stdout: inet 172.21.15.105/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T03:18:47.700 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft 42780sec preferred_lft 42780sec 2024-09-21T03:18:47.700 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::ec4:7aff:fe8f:d429/64 scope link noprefixroute 2024-09-21T03:18:47.700 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:18:47.700 INFO:teuthology.orchestra.run.smithi105.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T03:18:47.700 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 86:15:ed:f2:4e:d8 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:18:47.700 INFO:teuthology.orchestra.run.smithi105.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T03:18:47.700 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:18:47.700 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::80db:6aff:fece:44c2/64 scope link 2024-09-21T03:18:47.700 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:18:47.701 INFO:teuthology.orchestra.run.smithi105.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:18:47.701 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 86:15:ed:f2:4e:d8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T03:18:47.701 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::8415:edff:fef2:4ed8/64 scope link tentative 2024-09-21T03:18:47.701 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:18:47.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:47.701 DEBUG:teuthology.orchestra.run.smithi105:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T03:18:47.762 INFO:teuthology.orchestra.run.smithi105.stdout:1 2024-09-21T03:18:47.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:47.764 DEBUG:teuthology.orchestra.run.smithi105:> route 2024-09-21T03:18:47.820 INFO:teuthology.orchestra.run.smithi105.stdout:Kernel IP routing table 2024-09-21T03:18:47.821 INFO:teuthology.orchestra.run.smithi105.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T03:18:47.821 INFO:teuthology.orchestra.run.smithi105.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T03:18:47.821 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T03:18:47.821 INFO:teuthology.orchestra.run.smithi105.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T03:18:47.821 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:18:47.821 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-21T03:18:47.821 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T03:18:47.821 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T03:18:47.821 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T03:18:47.822 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-21T03:18:47.909 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:18:47.940 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:18:47.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:47.946 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-09-21T03:18:47.961 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T03:18:47.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:47.962 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list-id 2024-09-21T03:18:48.017 INFO:teuthology.orchestra.run.smithi105.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-21T03:18:48.017 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:18:48.018 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-21T03:18:48.018 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T03:18:48.018 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-21T03:18:48.018 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-21T03:18:48.105 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:18:48.128 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:18:48.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:48.134 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-21T03:18:48.158 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T03:18:48.159 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T03:18:48.159 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T03:18:48.159 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:18:48.159 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2024-09-21T03:18:48.159 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:18:48.159 INFO:teuthology.orchestra.run.smithi105.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T03:18:48.159 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 8a:85:59:7e:09:f6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-21T03:18:48.159 INFO:teuthology.orchestra.run.smithi105.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-21T03:18:48.159 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:18:48.159 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::8885:59ff:fe7e:9f6/64 scope link tentative 2024-09-21T03:18:48.159 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:18:48.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:48.160 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-21T03:18:48.225 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T03:18:48.225 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T03:18:48.226 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T03:18:48.226 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:18:48.226 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2024-09-21T03:18:48.226 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:18:48.226 INFO:teuthology.orchestra.run.smithi105.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T03:18:48.226 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 8a:85:59:7e:09:f6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-21T03:18:48.226 INFO:teuthology.orchestra.run.smithi105.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-21T03:18:48.226 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:18:48.226 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::8885:59ff:fe7e:9f6/64 scope link tentative 2024-09-21T03:18:48.226 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:18:48.227 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-21T03:18:48.227 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:18:48.227 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-21T03:18:48.228 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-21T03:18:48.228 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-21T03:18:48.228 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-21T03:18:48.228 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-21T03:18:48.228 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-21T03:18:48.228 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-21T03:18:48.315 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:18:48.372 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:18:48.378 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:18:48.378 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-21T03:18:48.378 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set brx.1 up 2024-09-21T03:18:48.378 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set dev brx.1 master ceph-brx 2024-09-21T03:18:48.378 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-21T03:18:48.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:18:48.450 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:18:48.457 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:18:48.457 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-21T03:18:48.471 INFO:teuthology.orchestra.run.smithi105.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-21T03:18:48.471 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:18:48.472 DEBUG:teuthology.orchestra.run.smithi105:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-21T03:18:48.526 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-21T03:18:48.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:48.526 DEBUG:teuthology.orchestra.run.smithi105:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-21T03:18:48.620 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-21T03:18:48.620 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-21T03:18:48.620 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2024-09-21T03:18:48.631 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-21T03:18:48.631 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-21T03:18:48.631 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2024-09-21T03:18:48.631 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:18:48.631 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:18:48.637 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-21T03:18:48.637 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-21T03:18:48.637 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2024-09-21T03:18:48.638 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:18:48.638 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:18:48.638 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-21T03:18:48.638 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-21T03:18:48.638 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=29d80f4f-e5de-4b26-8384-24c2d8019945" will pass to kernel 2024-09-21T03:18:48.638 INFO:teuthology.orchestra.run.smithi105.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-09-21T03:18:48.638 INFO:teuthology.orchestra.run.smithi105.stdout: You just mounted a file system that supports labels which does not 2024-09-21T03:18:48.638 INFO:teuthology.orchestra.run.smithi105.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T03:18:48.639 INFO:teuthology.orchestra.run.smithi105.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T03:18:48.639 INFO:teuthology.orchestra.run.smithi105.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T03:18:48.640 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T03:18:48.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:48.640 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-21T03:18:48.664 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:18:48.753 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:18:48.755 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:18:48.760 INFO:teuthology.orchestra.run.smithi105.stdout:client4728 2024-09-21T03:18:48.761 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:18:48.761 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:18:48.776 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:18:48.864 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:18:48.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:18:48.872 INFO:teuthology.orchestra.run.smithi105.stdout:client4728 2024-09-21T03:18:48.872 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:18:48.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:18:48.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:18:48.928 INFO:teuthology.orchestra.run.smithi105.stdout:client4728 2024-09-21T03:18:48.928 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/29d80f4f-e5de-4b26-8384-24c2d8019945.client4728/status') 2024-09-21T03:18:48.975 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:18:48.986 INFO:teuthology.orchestra.run.smithi105.stdout:instance: client.4728 (3)192.168.0.2:0/3158861462 2024-09-21T03:18:48.986 INFO:teuthology.orchestra.run.smithi105.stdout:blocklisted: false 2024-09-21T03:18:48.986 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records in 2024-09-21T03:18:48.986 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records out 2024-09-21T03:18:48.986 INFO:teuthology.orchestra.run.smithi105.stderr:69 bytes copied, 2.0787e-05 s, 3.3 MB/s 2024-09-21T03:18:48.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:18:48.993 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-21T03:18:48.993 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T03:18:48.993 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T03:18:48.993 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T03:18:49.105 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.103+0000 7f10a47cf640 1 -- 172.21.15.105:0/312659128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f109c15d840 msgr2=0x7f109c0b7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:49.105 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.103+0000 7f10a47cf640 1 --2- 172.21.15.105:0/312659128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f109c15d840 0x7f109c0b7490 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1094005fd0 tx=0x7f109402aa00 comp rx=0 tx=0).stop 2024-09-21T03:18:49.105 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.103+0000 7f10a47cf640 1 -- 172.21.15.105:0/312659128 shutdown_connections 2024-09-21T03:18:49.106 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.103+0000 7f10a47cf640 1 --2- 172.21.15.105:0/312659128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f109c15d840 0x7f109c0b7490 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:49.106 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.103+0000 7f10a47cf640 1 --2- 172.21.15.105:0/312659128 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f109c1570e0 0x7f109c0d1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:49.106 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.103+0000 7f10a47cf640 1 -- 172.21.15.105:0/312659128 >> 172.21.15.105:0/312659128 conn(0x7f109c06d550 msgr2=0x7f109c071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:49.106 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.103+0000 7f10a47cf640 1 -- 172.21.15.105:0/312659128 shutdown_connections 2024-09-21T03:18:49.106 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.103+0000 7f10a47cf640 1 -- 172.21.15.105:0/312659128 wait complete. 2024-09-21T03:18:49.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.105+0000 7f10a47cf640 1 Processor -- start 2024-09-21T03:18:49.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.105+0000 7f10a47cf640 1 -- start start 2024-09-21T03:18:49.110 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.106+0000 7f10a47cf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f109c0d2460 0x7f109c15b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:49.110 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.106+0000 7f10a47cf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f109c1570e0 0x7f109c15bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:49.110 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.106+0000 7f10a47cf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f109c15d840 0x7f109c1f71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:49.110 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.106+0000 7f10a47cf640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f109c0b7d60 con 0x7f109c0d2460 2024-09-21T03:18:49.110 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.106+0000 7f10a47cf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f109c0b7be0 con 0x7f109c15d840 2024-09-21T03:18:49.110 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.106+0000 7f10a47cf640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f109c0b7ee0 con 0x7f109c1570e0 2024-09-21T03:18:49.110 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.107+0000 7f10a256b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f109c0d2460 0x7f109c15b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:49.110 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.107+0000 7f10a256b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f109c0d2460 0x7f109c15b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40926/0 (socket says 172.21.15.105:40926) 2024-09-21T03:18:49.110 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.107+0000 7f10a256b640 1 -- 172.21.15.105:0/2300246797 learned_addr learned my addr 172.21.15.105:0/2300246797 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:49.110 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.107+0000 7f10a1d6a640 1 --2- 172.21.15.105:0/2300246797 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f109c1570e0 0x7f109c15bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:49.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.107+0000 7f10a2d6c640 1 --2- 172.21.15.105:0/2300246797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f109c15d840 0x7f109c1f71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:49.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.107+0000 7f10a256b640 1 -- 172.21.15.105:0/2300246797 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f109c1570e0 msgr2=0x7f109c15bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:49.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.107+0000 7f10a256b640 1 --2- 172.21.15.105:0/2300246797 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f109c1570e0 0x7f109c15bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:49.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.107+0000 7f10a256b640 1 -- 172.21.15.105:0/2300246797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f109c15d840 msgr2=0x7f109c1f71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:49.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.107+0000 7f10a256b640 1 --2- 172.21.15.105:0/2300246797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f109c15d840 0x7f109c1f71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:49.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.107+0000 7f10a256b640 1 -- 172.21.15.105:0/2300246797 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f109c154e70 con 0x7f109c0d2460 2024-09-21T03:18:49.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.107+0000 7f10a1d6a640 1 --2- 172.21.15.105:0/2300246797 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f109c1570e0 0x7f109c15bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:18:49.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.107+0000 7f10a256b640 1 --2- 172.21.15.105:0/2300246797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f109c0d2460 0x7f109c15b9f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f109800d700 tx=0x7f109800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:49.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.107+0000 7f1092ffd640 1 -- 172.21.15.105:0/2300246797 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1098017070 con 0x7f109c0d2460 2024-09-21T03:18:49.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.107+0000 7f1092ffd640 1 -- 172.21.15.105:0/2300246797 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1098005310 con 0x7f109c0d2460 2024-09-21T03:18:49.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.107+0000 7f10a47cf640 1 -- 172.21.15.105:0/2300246797 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f109c0b43e0 con 0x7f109c0d2460 2024-09-21T03:18:49.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.107+0000 7f1092ffd640 1 -- 172.21.15.105:0/2300246797 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1098009820 con 0x7f109c0d2460 2024-09-21T03:18:49.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.107+0000 7f10a47cf640 1 -- 172.21.15.105:0/2300246797 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f109c0c95b0 con 0x7f109c0d2460 2024-09-21T03:18:49.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.108+0000 7f10a47cf640 1 -- 172.21.15.105:0/2300246797 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f109c0b17d0 con 0x7f109c0d2460 2024-09-21T03:18:49.112 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.109+0000 7f1092ffd640 1 -- 172.21.15.105:0/2300246797 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f10980099c0 con 0x7f109c0d2460 2024-09-21T03:18:49.113 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.110+0000 7f1092ffd640 1 --2- 172.21.15.105:0/2300246797 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1080078b90 0x7f108007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:49.113 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.110+0000 7f1092ffd640 1 -- 172.21.15.105:0/2300246797 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f109809ad40 con 0x7f109c0d2460 2024-09-21T03:18:49.113 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.110+0000 7f10a1d6a640 1 --2- 172.21.15.105:0/2300246797 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1080078b90 0x7f108007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:49.113 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.110+0000 7f10a1d6a640 1 --2- 172.21.15.105:0/2300246797 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1080078b90 0x7f108007b0a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f108c006fd0 tx=0x7f108c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:49.116 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.114+0000 7f1092ffd640 1 -- 172.21.15.105:0/2300246797 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1098062bc0 con 0x7f109c0d2460 2024-09-21T03:18:49.327 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.325+0000 7f10a47cf640 1 -- 172.21.15.105:0/2300246797 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f109c0c9360 con 0x7f109c0d2460 2024-09-21T03:18:49.327 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.325+0000 7f1092ffd640 1 -- 172.21.15.105:0/2300246797 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f10980675f0 con 0x7f109c0d2460 2024-09-21T03:18:49.327 INFO:teuthology.orchestra.run.smithi105.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T03:18:49.329 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.327+0000 7f10a47cf640 1 -- 172.21.15.105:0/2300246797 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1080078b90 msgr2=0x7f108007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:49.329 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.327+0000 7f10a47cf640 1 --2- 172.21.15.105:0/2300246797 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1080078b90 0x7f108007b0a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f108c006fd0 tx=0x7f108c008040 comp rx=0 tx=0).stop 2024-09-21T03:18:49.329 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.327+0000 7f10a47cf640 1 -- 172.21.15.105:0/2300246797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f109c0d2460 msgr2=0x7f109c15b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:49.329 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.327+0000 7f10a47cf640 1 --2- 172.21.15.105:0/2300246797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f109c0d2460 0x7f109c15b9f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f109800d700 tx=0x7f109800dbc0 comp rx=0 tx=0).stop 2024-09-21T03:18:49.330 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.327+0000 7f10a47cf640 1 -- 172.21.15.105:0/2300246797 shutdown_connections 2024-09-21T03:18:49.330 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.327+0000 7f10a47cf640 1 --2- 172.21.15.105:0/2300246797 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1080078b90 0x7f108007b0a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:49.330 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.327+0000 7f10a47cf640 1 --2- 172.21.15.105:0/2300246797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f109c15d840 0x7f109c1f71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:49.330 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.327+0000 7f10a47cf640 1 --2- 172.21.15.105:0/2300246797 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f109c1570e0 0x7f109c15bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:49.330 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.327+0000 7f10a47cf640 1 --2- 172.21.15.105:0/2300246797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f109c0d2460 0x7f109c15b9f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:49.330 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.327+0000 7f10a47cf640 1 -- 172.21.15.105:0/2300246797 >> 172.21.15.105:0/2300246797 conn(0x7f109c06d550 msgr2=0x7f109c0d1380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:49.330 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.327+0000 7f10a47cf640 1 -- 172.21.15.105:0/2300246797 shutdown_connections 2024-09-21T03:18:49.330 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:49.328+0000 7f10a47cf640 1 -- 172.21.15.105:0/2300246797 wait complete. 2024-09-21T03:18:49.340 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T03:18:49.340 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T03:18:49.340 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2024-09-21T03:18:49.340 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-21T03:18:49.340 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T03:18:49.340 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T03:18:49.340 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T03:18:49.340 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T03:18:49.341 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T03:18:49.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:49.341 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2024-09-21T03:18:49.360 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T03:18:49.360 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T03:18:49.360 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T03:18:49.360 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:18:49.360 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-09-21T03:18:49.360 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:18:49.360 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:18:49.360 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:18:49.360 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f0 2024-09-21T03:18:49.360 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:18:49.360 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:18:49.361 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f1 2024-09-21T03:18:49.361 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:18:49.361 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:18:49.361 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T03:18:49.361 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:18:49.361 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T03:18:49.361 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42771sec preferred_lft 42771sec 2024-09-21T03:18:49.361 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::ec4:7aff:fe88:7f41/64 scope link noprefixroute 2024-09-21T03:18:49.361 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:18:49.361 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T03:18:49.361 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:18:49.362 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-09-21T03:18:49.362 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link add name ceph-brx type bridge 2024-09-21T03:18:49.362 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip addr flush dev ceph-brx 2024-09-21T03:18:49.362 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set ceph-brx up 2024-09-21T03:18:49.362 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T03:18:49.362 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-09-21T03:18:49.454 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:18:49.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:18:49.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:49.570 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T03:18:49.594 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-09-21T03:18:49.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:49.596 DEBUG:teuthology.orchestra.run.smithi162:> route 2024-09-21T03:18:49.660 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2024-09-21T03:18:49.660 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T03:18:49.661 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T03:18:49.661 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T03:18:49.661 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T03:18:49.661 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:18:49.661 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-09-21T03:18:49.661 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T03:18:49.661 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T03:18:49.661 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T03:18:49.661 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-09-21T03:18:49.748 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:18:49.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:18:49.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:49.994 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-09-21T03:18:50.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:50.009 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list-id 2024-09-21T03:18:50.065 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:18:50.065 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-09-21T03:18:50.065 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T03:18:50.065 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-21T03:18:50.066 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-09-21T03:18:50.154 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:18:50.179 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:18:50.185 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-21T03:18:50.186 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:18:50.186 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-09-21T03:18:50.186 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-21T03:18:50.186 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T03:18:50.186 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-21T03:18:50.186 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-21T03:18:50.186 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-21T03:18:50.186 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-09-21T03:18:50.235 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:18:50.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:18:50.337 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:18:50.337 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-09-21T03:18:50.337 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.0 up 2024-09-21T03:18:50.337 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T03:18:50.337 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-09-21T03:18:50.386 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:18:50.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:18:50.415 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:18:50.415 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-21T03:18:50.439 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-21T03:18:50.439 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:18:50.439 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-21T03:18:50.496 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-21T03:18:50.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:50.496 DEBUG:teuthology.orchestra.run.smithi162:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:18:50.642 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:18:50.642 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T03:18:50.642 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-21T03:18:50.774 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:18:50.775 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T03:18:50.775 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-21T03:18:50.775 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:18:50.775 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:18:50.780 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:18:50.780 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T03:18:50.780 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-21T03:18:50.780 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:18:50.780 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:18:50.780 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-21T03:18:50.780 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-21T03:18:50.780 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=29d80f4f-e5de-4b26-8384-24c2d8019945" will pass to kernel 2024-09-21T03:18:50.781 INFO:teuthology.orchestra.run.smithi162.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-21T03:18:50.781 INFO:teuthology.orchestra.run.smithi162.stdout: You just mounted a file system that supports labels which does not 2024-09-21T03:18:50.781 INFO:teuthology.orchestra.run.smithi162.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T03:18:50.781 INFO:teuthology.orchestra.run.smithi162.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T03:18:50.781 INFO:teuthology.orchestra.run.smithi162.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T03:18:50.783 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T03:18:50.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:50.783 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-21T03:18:50.813 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:18:50.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:18:50.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:18:50.908 INFO:teuthology.orchestra.run.smithi162.stdout:client4529 2024-09-21T03:18:50.908 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:18:50.908 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:18:50.925 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:18:51.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:18:51.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:18:51.020 INFO:teuthology.orchestra.run.smithi162.stdout:client4529 2024-09-21T03:18:51.021 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:18:51.069 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:18:51.071 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:18:51.077 INFO:teuthology.orchestra.run.smithi162.stdout:client4529 2024-09-21T03:18:51.077 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/29d80f4f-e5de-4b26-8384-24c2d8019945.client4529/status') 2024-09-21T03:18:51.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:18:51.136 INFO:teuthology.orchestra.run.smithi162.stdout:instance: client.4529 (3)192.168.0.1:0/891635290 2024-09-21T03:18:51.136 INFO:teuthology.orchestra.run.smithi162.stdout:blocklisted: false 2024-09-21T03:18:51.136 INFO:teuthology.orchestra.run.smithi162.stderr:0+1 records in 2024-09-21T03:18:51.136 INFO:teuthology.orchestra.run.smithi162.stderr:0+1 records out 2024-09-21T03:18:51.137 INFO:teuthology.orchestra.run.smithi162.stderr:68 bytes copied, 2.5423e-05 s, 2.7 MB/s 2024-09-21T03:18:51.137 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:18:51.143 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-09-21T03:18:51.143 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T03:18:51.144 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-21T03:18:51.144 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T03:18:51.271 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.268+0000 7fd216f2b640 1 -- 172.21.15.105:0/1037971402 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd21006e0e0 msgr2=0x7fd21006e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:51.271 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.268+0000 7fd216f2b640 1 --2- 172.21.15.105:0/1037971402 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd21006e0e0 0x7fd21006e4f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd2100d3de0 tx=0x7fd20802a560 comp rx=0 tx=0).stop 2024-09-21T03:18:51.271 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.268+0000 7fd216f2b640 1 -- 172.21.15.105:0/1037971402 shutdown_connections 2024-09-21T03:18:51.271 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.268+0000 7fd216f2b640 1 --2- 172.21.15.105:0/1037971402 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd21006e0e0 0x7fd21006e4f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:51.271 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.268+0000 7fd216f2b640 1 --2- 172.21.15.105:0/1037971402 >> v2:172.21.15.162:3300/0 conn(0x7fd2100b66b0 0x7fd2100b3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:51.272 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.268+0000 7fd216f2b640 1 -- 172.21.15.105:0/1037971402 >> 172.21.15.105:0/1037971402 conn(0x7fd21009d7f0 msgr2=0x7fd2100d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:51.272 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.268+0000 7fd216f2b640 1 -- 172.21.15.105:0/1037971402 shutdown_connections 2024-09-21T03:18:51.272 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.268+0000 7fd216f2b640 1 -- 172.21.15.105:0/1037971402 wait complete. 2024-09-21T03:18:51.273 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.270+0000 7fd216f2b640 1 Processor -- start 2024-09-21T03:18:51.273 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.270+0000 7fd216f2b640 1 -- start start 2024-09-21T03:18:51.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.272+0000 7fd216f2b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd21006e0e0 0x7fd2100caa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:51.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.272+0000 7fd216f2b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2100b9970 0x7fd210156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:51.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.272+0000 7fd216f2b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd210069220 0x7fd2100b86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:51.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.272+0000 7fd216f2b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd21006ea30 con 0x7fd21006e0e0 2024-09-21T03:18:51.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.272+0000 7fd216f2b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd2100d5010 con 0x7fd210069220 2024-09-21T03:18:51.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.272+0000 7fd216f2b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd21006ebb0 con 0x7fd2100b9970 2024-09-21T03:18:51.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.272+0000 7fd214cc7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd21006e0e0 0x7fd2100caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:51.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.272+0000 7fd214cc7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd21006e0e0 0x7fd2100caa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40948/0 (socket says 172.21.15.105:40948) 2024-09-21T03:18:51.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.272+0000 7fd214cc7640 1 -- 172.21.15.105:0/2798945413 learned_addr learned my addr 172.21.15.105:0/2798945413 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:51.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.272+0000 7fd2154c8640 1 --2- 172.21.15.105:0/2798945413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd210069220 0x7fd2100b86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:51.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.272+0000 7fd20ffff640 1 --2- 172.21.15.105:0/2798945413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2100b9970 0x7fd210156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:51.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.272+0000 7fd214cc7640 1 -- 172.21.15.105:0/2798945413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2100b9970 msgr2=0x7fd210156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:51.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.272+0000 7fd214cc7640 1 --2- 172.21.15.105:0/2798945413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2100b9970 0x7fd210156950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:51.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.272+0000 7fd214cc7640 1 -- 172.21.15.105:0/2798945413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd210069220 msgr2=0x7fd2100b86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:51.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.272+0000 7fd214cc7640 1 --2- 172.21.15.105:0/2798945413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd210069220 0x7fd2100b86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:51.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.272+0000 7fd214cc7640 1 -- 172.21.15.105:0/2798945413 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2101f95b0 con 0x7fd21006e0e0 2024-09-21T03:18:51.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.272+0000 7fd214cc7640 1 --2- 172.21.15.105:0/2798945413 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd21006e0e0 0x7fd2100caa40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd20000b410 tx=0x7fd20000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:51.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.273+0000 7fd20d7fa640 1 -- 172.21.15.105:0/2798945413 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd200015020 con 0x7fd21006e0e0 2024-09-21T03:18:51.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.273+0000 7fd20d7fa640 1 -- 172.21.15.105:0/2798945413 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd200011920 con 0x7fd21006e0e0 2024-09-21T03:18:51.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.273+0000 7fd216f2b640 1 -- 172.21.15.105:0/2798945413 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2101e40a0 con 0x7fd21006e0e0 2024-09-21T03:18:51.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.273+0000 7fd20d7fa640 1 -- 172.21.15.105:0/2798945413 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd200011d70 con 0x7fd21006e0e0 2024-09-21T03:18:51.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.273+0000 7fd216f2b640 1 -- 172.21.15.105:0/2798945413 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2101e4660 con 0x7fd21006e0e0 2024-09-21T03:18:51.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.274+0000 7fd216f2b640 1 -- 172.21.15.105:0/2798945413 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd21006e4f0 con 0x7fd21006e0e0 2024-09-21T03:18:51.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.274+0000 7fd20d7fa640 1 -- 172.21.15.105:0/2798945413 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd200018020 con 0x7fd21006e0e0 2024-09-21T03:18:51.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.275+0000 7fd20d7fa640 1 --2- 172.21.15.105:0/2798945413 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd1fc078b90 0x7fd1fc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:51.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.275+0000 7fd20d7fa640 1 -- 172.21.15.105:0/2798945413 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd20009a830 con 0x7fd21006e0e0 2024-09-21T03:18:51.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.275+0000 7fd20ffff640 1 --2- 172.21.15.105:0/2798945413 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd1fc078b90 0x7fd1fc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:51.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.275+0000 7fd20ffff640 1 --2- 172.21.15.105:0/2798945413 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd1fc078b90 0x7fd1fc07b0a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd2100a2350 tx=0x7fd20400a550 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:51.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.280+0000 7fd20d7fa640 1 -- 172.21.15.105:0/2798945413 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd200062740 con 0x7fd21006e0e0 2024-09-21T03:18:51.494 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.492+0000 7fd216f2b640 1 -- 172.21.15.105:0/2798945413 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd2100b94e0 con 0x7fd21006e0e0 2024-09-21T03:18:51.494 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.492+0000 7fd20d7fa640 1 -- 172.21.15.105:0/2798945413 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7fd200067170 con 0x7fd21006e0e0 2024-09-21T03:18:51.494 INFO:teuthology.orchestra.run.smithi105.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T03:18:51.497 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.494+0000 7fd216f2b640 1 -- 172.21.15.105:0/2798945413 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd1fc078b90 msgr2=0x7fd1fc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:51.497 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.494+0000 7fd216f2b640 1 --2- 172.21.15.105:0/2798945413 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd1fc078b90 0x7fd1fc07b0a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd2100a2350 tx=0x7fd20400a550 comp rx=0 tx=0).stop 2024-09-21T03:18:51.497 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.494+0000 7fd216f2b640 1 -- 172.21.15.105:0/2798945413 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd21006e0e0 msgr2=0x7fd2100caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:51.497 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.494+0000 7fd216f2b640 1 --2- 172.21.15.105:0/2798945413 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd21006e0e0 0x7fd2100caa40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd20000b410 tx=0x7fd20000b8d0 comp rx=0 tx=0).stop 2024-09-21T03:18:51.497 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.494+0000 7fd216f2b640 1 -- 172.21.15.105:0/2798945413 shutdown_connections 2024-09-21T03:18:51.497 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.494+0000 7fd216f2b640 1 --2- 172.21.15.105:0/2798945413 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd1fc078b90 0x7fd1fc07b0a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:51.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.494+0000 7fd216f2b640 1 --2- 172.21.15.105:0/2798945413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd210069220 0x7fd2100b86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:51.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.494+0000 7fd216f2b640 1 --2- 172.21.15.105:0/2798945413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2100b9970 0x7fd210156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:51.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.494+0000 7fd216f2b640 1 --2- 172.21.15.105:0/2798945413 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd21006e0e0 0x7fd2100caa40 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:51.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.494+0000 7fd216f2b640 1 -- 172.21.15.105:0/2798945413 >> 172.21.15.105:0/2798945413 conn(0x7fd21009d7f0 msgr2=0x7fd2100b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:51.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.495+0000 7fd216f2b640 1 -- 172.21.15.105:0/2798945413 shutdown_connections 2024-09-21T03:18:51.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:51.495+0000 7fd216f2b640 1 -- 172.21.15.105:0/2798945413 wait complete. 2024-09-21T03:18:51.507 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T03:18:51.508 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T03:18:51.508 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2024-09-21T03:18:51.508 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-21T03:18:51.508 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-21T03:18:51.508 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T03:18:51.508 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T03:18:51.509 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T03:18:51.509 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-21T03:18:51.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:51.509 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2024-09-21T03:18:51.527 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T03:18:51.527 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T03:18:51.528 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T03:18:51.528 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:18:51.528 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-09-21T03:18:51.528 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:18:51.529 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:18:51.529 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:18:51.529 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f0 2024-09-21T03:18:51.529 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:18:51.529 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:18:51.530 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f1 2024-09-21T03:18:51.530 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:18:51.530 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:18:51.530 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T03:18:51.530 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:18:51.531 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T03:18:51.531 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42769sec preferred_lft 42769sec 2024-09-21T03:18:51.531 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::ec4:7aff:fe88:7f41/64 scope link noprefixroute 2024-09-21T03:18:51.531 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:18:51.532 INFO:teuthology.orchestra.run.smithi162.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T03:18:51.532 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 32:ad:10:1b:86:54 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:18:51.532 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T03:18:51.532 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:18:51.532 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::c03a:6bff:febf:f5a9/64 scope link 2024-09-21T03:18:51.533 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:18:51.533 INFO:teuthology.orchestra.run.smithi162.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:18:51.533 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 32:ad:10:1b:86:54 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T03:18:51.533 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::30ad:10ff:fe1b:8654/64 scope link 2024-09-21T03:18:51.533 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:18:51.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:51.534 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T03:18:51.591 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-09-21T03:18:51.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:51.593 DEBUG:teuthology.orchestra.run.smithi162:> route 2024-09-21T03:18:51.650 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2024-09-21T03:18:51.651 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T03:18:51.651 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T03:18:51.651 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T03:18:51.651 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T03:18:51.652 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:18:51.652 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-09-21T03:18:51.652 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T03:18:51.653 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T03:18:51.653 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T03:18:51.653 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-09-21T03:18:51.738 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:18:51.771 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:18:51.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:51.777 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-09-21T03:18:51.792 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-21T03:18:51.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:51.793 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list-id 2024-09-21T03:18:51.848 INFO:teuthology.orchestra.run.smithi162.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-21T03:18:51.848 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:18:51.848 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-09-21T03:18:51.848 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-21T03:18:51.848 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-21T03:18:51.848 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-09-21T03:18:51.937 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:18:51.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:18:51.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:51.966 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-21T03:18:51.990 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T03:18:51.990 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T03:18:51.990 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T03:18:51.990 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:18:51.991 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-09-21T03:18:51.991 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:18:51.991 INFO:teuthology.orchestra.run.smithi162.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T03:18:51.991 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether d2:e2:5b:18:e9:6b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-21T03:18:51.991 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-21T03:18:51.991 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:18:51.991 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::d0e2:5bff:fe18:e96b/64 scope link 2024-09-21T03:18:51.991 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:18:51.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:51.992 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-21T03:18:52.057 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T03:18:52.057 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T03:18:52.057 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T03:18:52.057 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:18:52.057 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-09-21T03:18:52.058 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:18:52.058 INFO:teuthology.orchestra.run.smithi162.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T03:18:52.058 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether d2:e2:5b:18:e9:6b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-21T03:18:52.058 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-21T03:18:52.058 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:18:52.058 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::d0e2:5bff:fe18:e96b/64 scope link 2024-09-21T03:18:52.058 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:18:52.059 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-21T03:18:52.059 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:18:52.059 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-09-21T03:18:52.059 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-21T03:18:52.059 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-21T03:18:52.059 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-21T03:18:52.059 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-21T03:18:52.060 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-21T03:18:52.060 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-09-21T03:18:52.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:18:52.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:18:52.211 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:18:52.211 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-09-21T03:18:52.211 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.1 up 2024-09-21T03:18:52.211 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set dev brx.1 master ceph-brx 2024-09-21T03:18:52.211 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-09-21T03:18:52.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:18:52.282 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:18:52.288 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:18:52.288 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-21T03:18:52.303 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-21T03:18:52.303 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:18:52.303 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-21T03:18:52.358 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-21T03:18:52.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:52.358 DEBUG:teuthology.orchestra.run.smithi162:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-21T03:18:52.453 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-21T03:18:52.453 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-21T03:18:52.453 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-21T03:18:52.464 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-21T03:18:52.464 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-21T03:18:52.464 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-21T03:18:52.464 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:18:52.464 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:18:52.470 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-21T03:18:52.470 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-21T03:18:52.470 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-21T03:18:52.470 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:18:52.470 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:18:52.470 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-21T03:18:52.470 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-21T03:18:52.470 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=29d80f4f-e5de-4b26-8384-24c2d8019945" will pass to kernel 2024-09-21T03:18:52.471 INFO:teuthology.orchestra.run.smithi162.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-09-21T03:18:52.471 INFO:teuthology.orchestra.run.smithi162.stdout: You just mounted a file system that supports labels which does not 2024-09-21T03:18:52.471 INFO:teuthology.orchestra.run.smithi162.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T03:18:52.471 INFO:teuthology.orchestra.run.smithi162.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T03:18:52.471 INFO:teuthology.orchestra.run.smithi162.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T03:18:52.472 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T03:18:52.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:52.472 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-21T03:18:52.497 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:18:52.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:18:52.587 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:18:52.593 INFO:teuthology.orchestra.run.smithi162.stdout:client4639 2024-09-21T03:18:52.593 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:18:52.593 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:18:52.610 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:18:52.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:18:52.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:18:52.705 INFO:teuthology.orchestra.run.smithi162.stdout:client4639 2024-09-21T03:18:52.705 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:18:52.753 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:18:52.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:18:52.761 INFO:teuthology.orchestra.run.smithi162.stdout:client4639 2024-09-21T03:18:52.761 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/29d80f4f-e5de-4b26-8384-24c2d8019945.client4639/status') 2024-09-21T03:18:52.809 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:18:52.819 INFO:teuthology.orchestra.run.smithi162.stdout:instance: client.4639 (3)192.168.0.2:0/631160452 2024-09-21T03:18:52.819 INFO:teuthology.orchestra.run.smithi162.stdout:blocklisted: false 2024-09-21T03:18:52.820 INFO:teuthology.orchestra.run.smithi162.stderr:0+1 records in 2024-09-21T03:18:52.820 INFO:teuthology.orchestra.run.smithi162.stderr:0+1 records out 2024-09-21T03:18:52.820 INFO:teuthology.orchestra.run.smithi162.stderr:68 bytes copied, 2.0537e-05 s, 3.3 MB/s 2024-09-21T03:18:52.820 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:18:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:18:52.828 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-21T03:18:54.804 INFO:tasks.cephfs_test_runner:Starting test: test_cap_acquisition_throttle_readdir (tasks.cephfs.test_client_limits.TestClientLimits) Mostly readdir acquires caps faster than the mds recalls, so the cap 2024-09-21T03:18:54.804 INFO:tasks.cephfs_test_runner:test_cap_acquisition_throttle_readdir (tasks.cephfs.test_client_limits.TestClientLimits) 2024-09-21T03:18:54.804 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:18:54.932 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:54.930+0000 7faa7ca94640 1 -- 172.21.15.105:0/3703344439 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa60004800 msgr2=0x7faa60004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:54.932 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:54.930+0000 7faa7ca94640 1 --2- 172.21.15.105:0/3703344439 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa60004800 0x7faa60004c10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7faa780ccae0 tx=0x7faa60005830 comp rx=0 tx=0).stop 2024-09-21T03:18:54.932 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:54.930+0000 7faa76d9d640 1 -- 172.21.15.105:0/3703344439 reap_dead start 2024-09-21T03:18:54.932 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:54.930+0000 7faa7ca94640 1 -- 172.21.15.105:0/3703344439 shutdown_connections 2024-09-21T03:18:54.932 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:54.930+0000 7faa7ca94640 1 -- 172.21.15.105:0/3703344439 >> 172.21.15.105:0/3703344439 conn(0x7faa7806d7d0 msgr2=0x7faa780b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:54.932 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:54.930+0000 7faa7ca94640 1 -- 172.21.15.105:0/3703344439 shutdown_connections 2024-09-21T03:18:54.933 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:54.930+0000 7faa7ca94640 1 -- 172.21.15.105:0/3703344439 wait complete. 2024-09-21T03:18:54.933 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:54.932+0000 7faa7ca94640 1 Processor -- start 2024-09-21T03:18:54.934 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:54.932+0000 7faa7ca94640 1 -- start start 2024-09-21T03:18:54.936 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:54.933+0000 7faa7ca94640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa60004800 0x7faa781465d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:54.936 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:54.933+0000 7faa7ca94640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa7809c440 0x7faa78145a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:54.936 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:54.933+0000 7faa7ca94640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa78145f50 0x7faa7815b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:54.936 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:54.933+0000 7faa7ca94640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7faa78070750 con 0x7faa78145f50 2024-09-21T03:18:54.936 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:54.933+0000 7faa7ca94640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faa780705d0 con 0x7faa60004800 2024-09-21T03:18:54.936 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:54.933+0000 7faa7ca94640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faa780708d0 con 0x7faa7809c440 2024-09-21T03:18:54.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:54.934+0000 7faa76d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa78145f50 0x7faa7815b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:54.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:54.934+0000 7faa76d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa78145f50 0x7faa7815b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58504/0 (socket says 172.21.15.105:58504) 2024-09-21T03:18:54.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:54.934+0000 7faa76d9d640 1 -- 172.21.15.105:0/2115136098 learned_addr learned my addr 172.21.15.105:0/2115136098 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:54.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:54.934+0000 7faa7659c640 1 --2- 172.21.15.105:0/2115136098 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa60004800 0x7faa781465d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:54.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:54.934+0000 7faa75d9b640 1 --2- 172.21.15.105:0/2115136098 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa7809c440 0x7faa78145a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:54.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:54.934+0000 7faa76d9d640 1 -- 172.21.15.105:0/2115136098 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa7809c440 msgr2=0x7faa78145a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:54.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:54.934+0000 7faa76d9d640 1 --2- 172.21.15.105:0/2115136098 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa7809c440 0x7faa78145a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:54.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:54.934+0000 7faa76d9d640 1 -- 172.21.15.105:0/2115136098 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa60004800 msgr2=0x7faa781465d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:54.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:54.934+0000 7faa76d9d640 1 --2- 172.21.15.105:0/2115136098 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa60004800 0x7faa781465d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:54.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:54.934+0000 7faa76d9d640 1 -- 172.21.15.105:0/2115136098 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa78146360 con 0x7faa78145f50 2024-09-21T03:18:54.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:54.934+0000 7faa7659c640 1 --2- 172.21.15.105:0/2115136098 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa60004800 0x7faa781465d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:18:54.938 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:54.934+0000 7faa75d9b640 1 --2- 172.21.15.105:0/2115136098 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa7809c440 0x7faa78145a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:18:54.938 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:54.934+0000 7faa76d9d640 1 --2- 172.21.15.105:0/2115136098 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa78145f50 0x7faa7815b010 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7faa780b2b60 tx=0x7faa70001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:54.938 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:54.934+0000 7faa66ffd640 1 -- 172.21.15.105:0/2115136098 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa700107d0 con 0x7faa78145f50 2024-09-21T03:18:54.938 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:54.934+0000 7faa66ffd640 1 -- 172.21.15.105:0/2115136098 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa70016070 con 0x7faa78145f50 2024-09-21T03:18:54.938 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:54.934+0000 7faa7ca94640 1 -- 172.21.15.105:0/2115136098 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa7809cce0 con 0x7faa78145f50 2024-09-21T03:18:54.938 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:54.934+0000 7faa66ffd640 1 -- 172.21.15.105:0/2115136098 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa70010d00 con 0x7faa78145f50 2024-09-21T03:18:54.938 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:54.934+0000 7faa7ca94640 1 -- 172.21.15.105:0/2115136098 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa7809d2a0 con 0x7faa78145f50 2024-09-21T03:18:54.939 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:54.935+0000 7faa7ca94640 1 -- 172.21.15.105:0/2115136098 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa7809ca50 con 0x7faa78145f50 2024-09-21T03:18:54.939 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:54.936+0000 7faa66ffd640 1 -- 172.21.15.105:0/2115136098 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faa7001b460 con 0x7faa78145f50 2024-09-21T03:18:54.939 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:54.937+0000 7faa66ffd640 1 --2- 172.21.15.105:0/2115136098 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7faa58078b90 0x7faa5807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:54.939 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:54.937+0000 7faa66ffd640 1 -- 172.21.15.105:0/2115136098 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7faa7009b610 con 0x7faa78145f50 2024-09-21T03:18:54.939 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:54.937+0000 7faa7659c640 1 --2- 172.21.15.105:0/2115136098 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7faa58078b90 0x7faa5807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:54.939 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:54.937+0000 7faa7659c640 1 --2- 172.21.15.105:0/2115136098 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7faa58078b90 0x7faa5807b0a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7faa68000fb0 tx=0x7faa68006970 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:54.943 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:54.941+0000 7faa66ffd640 1 -- 172.21.15.105:0/2115136098 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7faa78146360 con 0x7faa78145f50 2024-09-21T03:18:55.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.118+0000 7faa7ca94640 1 -- 172.21.15.105:0/2115136098 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faa780b4d90 con 0x7faa78145f50 2024-09-21T03:18:55.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.119+0000 7faa66ffd640 1 -- 172.21.15.105:0/2115136098 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16737 (secure 0 0 0) 0x7faa7006c020 con 0x7faa78145f50 2024-09-21T03:18:55.120 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:18:55.121 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":23,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:18:31.396627+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:18:27.622514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:18:28.719849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:18:55.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.121+0000 7faa7ca94640 1 -- 172.21.15.105:0/2115136098 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7faa58078b90 msgr2=0x7faa5807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:55.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.121+0000 7faa7ca94640 1 --2- 172.21.15.105:0/2115136098 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7faa58078b90 0x7faa5807b0a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7faa68000fb0 tx=0x7faa68006970 comp rx=0 tx=0).stop 2024-09-21T03:18:55.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.121+0000 7faa7ca94640 1 -- 172.21.15.105:0/2115136098 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa78145f50 msgr2=0x7faa7815b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:55.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.121+0000 7faa7ca94640 1 --2- 172.21.15.105:0/2115136098 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa78145f50 0x7faa7815b010 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7faa780b2b60 tx=0x7faa70001630 comp rx=0 tx=0).stop 2024-09-21T03:18:55.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.121+0000 7faa7ca94640 1 -- 172.21.15.105:0/2115136098 shutdown_connections 2024-09-21T03:18:55.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.121+0000 7faa7ca94640 1 --2- 172.21.15.105:0/2115136098 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7faa58078b90 0x7faa5807b0a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.121+0000 7faa7ca94640 1 --2- 172.21.15.105:0/2115136098 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa78145f50 0x7faa7815b010 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.121+0000 7faa7ca94640 1 --2- 172.21.15.105:0/2115136098 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa7809c440 0x7faa78145a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.121+0000 7faa7ca94640 1 --2- 172.21.15.105:0/2115136098 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa60004800 0x7faa781465d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.121+0000 7faa7ca94640 1 -- 172.21.15.105:0/2115136098 >> 172.21.15.105:0/2115136098 conn(0x7faa7806d7d0 msgr2=0x7faa780b1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:55.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.121+0000 7faa7ca94640 1 -- 172.21.15.105:0/2115136098 shutdown_connections 2024-09-21T03:18:55.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.121+0000 7faa7ca94640 1 -- 172.21.15.105:0/2115136098 wait complete. 2024-09-21T03:18:55.134 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T03:18:19.296947+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T03:18:27.622514+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T03:18:28.719849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T03:18:55.135 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T03:18:55.251 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.250+0000 7f95bbd72640 1 -- 172.21.15.105:0/1472249185 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95a0003a00 msgr2=0x7f95a0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:55.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.250+0000 7f95bbd72640 1 --2- 172.21.15.105:0/1472249185 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95a0003a00 0x7f95a0003e70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f95b000c2e0 tx=0x7f95a0005830 comp rx=0 tx=0).stop 2024-09-21T03:18:55.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.250+0000 7f95ba30f640 1 -- 172.21.15.105:0/1472249185 reap_dead start 2024-09-21T03:18:55.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.250+0000 7f95bbd72640 1 -- 172.21.15.105:0/1472249185 shutdown_connections 2024-09-21T03:18:55.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.250+0000 7f95bbd72640 1 -- 172.21.15.105:0/1472249185 >> 172.21.15.105:0/1472249185 conn(0x7f95b406d230 msgr2=0x7f95b406d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:55.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.250+0000 7f95bbd72640 1 -- 172.21.15.105:0/1472249185 shutdown_connections 2024-09-21T03:18:55.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.250+0000 7f95bbd72640 1 -- 172.21.15.105:0/1472249185 wait complete. 2024-09-21T03:18:55.253 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.252+0000 7f95bbd72640 1 Processor -- start 2024-09-21T03:18:55.253 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.252+0000 7f95bbd72640 1 -- start start 2024-09-21T03:18:55.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.253+0000 7f95bbd72640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95a0003a00 0x7f95b41f4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:55.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.253+0000 7f95bbd72640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95b406f280 0x7f95b40b7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:55.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.253+0000 7f95bbd72640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95b40b52c0 0x7f95b41f8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:55.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.253+0000 7f95bbd72640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f95b415e550 con 0x7f95a0003a00 2024-09-21T03:18:55.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.253+0000 7f95bbd72640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f95b415e3d0 con 0x7f95b40b52c0 2024-09-21T03:18:55.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.253+0000 7f95bbd72640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f95b415e6d0 con 0x7f95b406f280 2024-09-21T03:18:55.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.253+0000 7f95b9b0e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95a0003a00 0x7f95b41f4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:55.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.253+0000 7f95b9b0e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95a0003a00 0x7f95b41f4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58514/0 (socket says 172.21.15.105:58514) 2024-09-21T03:18:55.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.253+0000 7f95b9b0e640 1 -- 172.21.15.105:0/2635492568 learned_addr learned my addr 172.21.15.105:0/2635492568 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:55.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.253+0000 7f95b930d640 1 --2- 172.21.15.105:0/2635492568 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95b406f280 0x7f95b40b7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:55.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.253+0000 7f95ba30f640 1 --2- 172.21.15.105:0/2635492568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95b40b52c0 0x7f95b41f8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:55.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.253+0000 7f95b9b0e640 1 -- 172.21.15.105:0/2635492568 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95b406f280 msgr2=0x7f95b40b7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:55.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.253+0000 7f95b9b0e640 1 --2- 172.21.15.105:0/2635492568 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95b406f280 0x7f95b40b7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.253+0000 7f95b9b0e640 1 -- 172.21.15.105:0/2635492568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95b40b52c0 msgr2=0x7f95b41f8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:55.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.253+0000 7f95b9b0e640 1 --2- 172.21.15.105:0/2635492568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95b40b52c0 0x7f95b41f8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.253+0000 7f95b9b0e640 1 -- 172.21.15.105:0/2635492568 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b41f5330 con 0x7f95a0003a00 2024-09-21T03:18:55.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.253+0000 7f95b930d640 1 --2- 172.21.15.105:0/2635492568 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95b406f280 0x7f95b40b7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:18:55.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.254+0000 7f95b9b0e640 1 --2- 172.21.15.105:0/2635492568 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95a0003a00 0x7f95b41f4df0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f95b000c400 tx=0x7f95b0006d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:55.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.254+0000 7f95aa7fc640 1 -- 172.21.15.105:0/2635492568 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b0031040 con 0x7f95a0003a00 2024-09-21T03:18:55.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.254+0000 7f95aa7fc640 1 -- 172.21.15.105:0/2635492568 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95b0003820 con 0x7f95a0003a00 2024-09-21T03:18:55.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.254+0000 7f95aa7fc640 1 -- 172.21.15.105:0/2635492568 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b0006600 con 0x7f95a0003a00 2024-09-21T03:18:55.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.254+0000 7f95bbd72640 1 -- 172.21.15.105:0/2635492568 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95b40b4770 con 0x7f95a0003a00 2024-09-21T03:18:55.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.254+0000 7f95bbd72640 1 -- 172.21.15.105:0/2635492568 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95b406ea80 con 0x7f95a0003a00 2024-09-21T03:18:55.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.255+0000 7f95bbd72640 1 -- 172.21.15.105:0/2635492568 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95b406e8b0 con 0x7f95a0003a00 2024-09-21T03:18:55.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.255+0000 7f95aa7fc640 1 -- 172.21.15.105:0/2635492568 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f95b003e030 con 0x7f95a0003a00 2024-09-21T03:18:55.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.256+0000 7f95aa7fc640 1 --2- 172.21.15.105:0/2635492568 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9598078b90 0x7f959807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:55.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.256+0000 7f95aa7fc640 1 -- 172.21.15.105:0/2635492568 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f95b00bac20 con 0x7f95a0003a00 2024-09-21T03:18:55.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.256+0000 7f95b930d640 1 --2- 172.21.15.105:0/2635492568 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9598078b90 0x7f959807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:55.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.257+0000 7f95b930d640 1 --2- 172.21.15.105:0/2635492568 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9598078b90 0x7f959807b0a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f95b40d2b40 tx=0x7f95a4005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:55.262 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.260+0000 7f95aa7fc640 1 -- 172.21.15.105:0/2635492568 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f95b00830f0 con 0x7f95a0003a00 2024-09-21T03:18:55.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.435+0000 7f95bbd72640 1 -- 172.21.15.105:0/2635492568 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f95b415d7d0 con 0x7f95a0003a00 2024-09-21T03:18:55.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.435+0000 7f95aa7fc640 1 -- 172.21.15.105:0/2635492568 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f95b00829f0 con 0x7f95a0003a00 2024-09-21T03:18:55.437 INFO:teuthology.orchestra.run.smithi105.stdout:pg_num: 1 2024-09-21T03:18:55.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.437+0000 7f95bbd72640 1 -- 172.21.15.105:0/2635492568 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9598078b90 msgr2=0x7f959807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:55.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.437+0000 7f95bbd72640 1 --2- 172.21.15.105:0/2635492568 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9598078b90 0x7f959807b0a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f95b40d2b40 tx=0x7f95a4005f90 comp rx=0 tx=0).stop 2024-09-21T03:18:55.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.437+0000 7f95bbd72640 1 -- 172.21.15.105:0/2635492568 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95a0003a00 msgr2=0x7f95b41f4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:55.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.437+0000 7f95bbd72640 1 --2- 172.21.15.105:0/2635492568 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95a0003a00 0x7f95b41f4df0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f95b000c400 tx=0x7f95b0006d00 comp rx=0 tx=0).stop 2024-09-21T03:18:55.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.437+0000 7f95bbd72640 1 -- 172.21.15.105:0/2635492568 shutdown_connections 2024-09-21T03:18:55.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.437+0000 7f95bbd72640 1 --2- 172.21.15.105:0/2635492568 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9598078b90 0x7f959807b0a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.437+0000 7f95bbd72640 1 --2- 172.21.15.105:0/2635492568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95b40b52c0 0x7f95b41f8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.437+0000 7f95bbd72640 1 --2- 172.21.15.105:0/2635492568 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95b406f280 0x7f95b40b7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.437+0000 7f95bbd72640 1 --2- 172.21.15.105:0/2635492568 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95a0003a00 0x7f95b41f4df0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.437+0000 7f95bbd72640 1 -- 172.21.15.105:0/2635492568 >> 172.21.15.105:0/2635492568 conn(0x7f95b406d230 msgr2=0x7f95b4068e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:55.442 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.438+0000 7f95bbd72640 1 -- 172.21.15.105:0/2635492568 shutdown_connections 2024-09-21T03:18:55.442 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.438+0000 7f95bbd72640 1 -- 172.21.15.105:0/2635492568 wait complete. 2024-09-21T03:18:55.450 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T03:18:55.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.565+0000 7fe33df57640 1 -- 172.21.15.105:0/2902486254 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe338162f60 msgr2=0x7fe338165380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:55.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.565+0000 7fe33df57640 1 --2- 172.21.15.105:0/2902486254 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe338162f60 0x7fe338165380 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe3380739d0 tx=0x7fe33002aa30 comp rx=0 tx=0).stop 2024-09-21T03:18:55.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.565+0000 7fe33df57640 1 -- 172.21.15.105:0/2902486254 shutdown_connections 2024-09-21T03:18:55.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.565+0000 7fe33df57640 1 --2- 172.21.15.105:0/2902486254 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe338162f60 0x7fe338165380 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.565+0000 7fe33df57640 1 --2- 172.21.15.105:0/2902486254 >> v2:172.21.15.162:3300/0 conn(0x7fe3380b6680 0x7fe3380b0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.565+0000 7fe33df57640 1 -- 172.21.15.105:0/2902486254 >> 172.21.15.105:0/2902486254 conn(0x7fe3380d12a0 msgr2=0x7fe3380d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:55.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.565+0000 7fe33df57640 1 -- 172.21.15.105:0/2902486254 shutdown_connections 2024-09-21T03:18:55.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.565+0000 7fe33df57640 1 -- 172.21.15.105:0/2902486254 wait complete. 2024-09-21T03:18:55.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.567+0000 7fe33df57640 1 Processor -- start 2024-09-21T03:18:55.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.567+0000 7fe33df57640 1 -- start start 2024-09-21T03:18:55.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.568+0000 7fe33df57640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3380b6100 0x7fe33815b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:55.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.568+0000 7fe33df57640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3380b6680 0x7fe3380cb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:55.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.568+0000 7fe33df57640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe338162f60 0x7fe33806cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:55.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.568+0000 7fe33df57640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe338165a40 con 0x7fe338162f60 2024-09-21T03:18:55.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.568+0000 7fe33df57640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe3381658c0 con 0x7fe3380b6100 2024-09-21T03:18:55.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.568+0000 7fe33df57640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe338165bc0 con 0x7fe3380b6680 2024-09-21T03:18:55.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.568+0000 7fe337fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe338162f60 0x7fe33806cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:55.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.568+0000 7fe337fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe338162f60 0x7fe33806cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58528/0 (socket says 172.21.15.105:58528) 2024-09-21T03:18:55.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.568+0000 7fe337fff640 1 -- 172.21.15.105:0/1784747448 learned_addr learned my addr 172.21.15.105:0/1784747448 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:55.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.569+0000 7fe3377fe640 1 --2- 172.21.15.105:0/1784747448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3380b6100 0x7fe33815b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:55.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.569+0000 7fe336ffd640 1 --2- 172.21.15.105:0/1784747448 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3380b6680 0x7fe3380cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:55.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.569+0000 7fe337fff640 1 -- 172.21.15.105:0/1784747448 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3380b6680 msgr2=0x7fe3380cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:55.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.569+0000 7fe337fff640 1 --2- 172.21.15.105:0/1784747448 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3380b6680 0x7fe3380cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.569+0000 7fe337fff640 1 -- 172.21.15.105:0/1784747448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3380b6100 msgr2=0x7fe33815b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:55.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.569+0000 7fe337fff640 1 --2- 172.21.15.105:0/1784747448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3380b6100 0x7fe33815b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.569+0000 7fe337fff640 1 -- 172.21.15.105:0/1784747448 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3380cb580 con 0x7fe338162f60 2024-09-21T03:18:55.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.569+0000 7fe337fff640 1 --2- 172.21.15.105:0/1784747448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe338162f60 0x7fe33806cde0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe330009d60 tx=0x7fe330003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:55.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.569+0000 7fe31ffff640 1 -- 172.21.15.105:0/1784747448 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe330033050 con 0x7fe338162f60 2024-09-21T03:18:55.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.569+0000 7fe31ffff640 1 -- 172.21.15.105:0/1784747448 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe330004450 con 0x7fe338162f60 2024-09-21T03:18:55.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.569+0000 7fe33df57640 1 -- 172.21.15.105:0/1784747448 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe338164ca0 con 0x7fe338162f60 2024-09-21T03:18:55.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.569+0000 7fe31ffff640 1 -- 172.21.15.105:0/1784747448 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe330038450 con 0x7fe338162f60 2024-09-21T03:18:55.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.569+0000 7fe33df57640 1 -- 172.21.15.105:0/1784747448 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3381f3ac0 con 0x7fe338162f60 2024-09-21T03:18:55.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.570+0000 7fe33df57640 1 -- 172.21.15.105:0/1784747448 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3380b0de0 con 0x7fe338162f60 2024-09-21T03:18:55.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.571+0000 7fe31ffff640 1 -- 172.21.15.105:0/1784747448 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe330036070 con 0x7fe338162f60 2024-09-21T03:18:55.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.571+0000 7fe31ffff640 1 --2- 172.21.15.105:0/1784747448 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe324078bc0 0x7fe32407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:55.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.572+0000 7fe31ffff640 1 -- 172.21.15.105:0/1784747448 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe3300bc230 con 0x7fe338162f60 2024-09-21T03:18:55.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.572+0000 7fe3377fe640 1 --2- 172.21.15.105:0/1784747448 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe324078bc0 0x7fe32407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:55.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.572+0000 7fe3377fe640 1 --2- 172.21.15.105:0/1784747448 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe324078bc0 0x7fe32407b0d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe3380ceda0 tx=0x7fe32800b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:55.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.576+0000 7fe31ffff640 1 -- 172.21.15.105:0/1784747448 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe330084670 con 0x7fe338162f60 2024-09-21T03:18:55.755 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.754+0000 7fe33df57640 1 -- 172.21.15.105:0/1784747448 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe3380c80b0 con 0x7fe338162f60 2024-09-21T03:18:55.755 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.754+0000 7fe31ffff640 1 -- 172.21.15.105:0/1784747448 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7fe330083f70 con 0x7fe338162f60 2024-09-21T03:18:55.756 INFO:teuthology.orchestra.run.smithi105.stdout:pg_num: 32 2024-09-21T03:18:55.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.756+0000 7fe33df57640 1 -- 172.21.15.105:0/1784747448 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe324078bc0 msgr2=0x7fe32407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:55.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.756+0000 7fe33df57640 1 --2- 172.21.15.105:0/1784747448 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe324078bc0 0x7fe32407b0d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe3380ceda0 tx=0x7fe32800b2e0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.756+0000 7fe33df57640 1 -- 172.21.15.105:0/1784747448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe338162f60 msgr2=0x7fe33806cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:55.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.756+0000 7fe33df57640 1 --2- 172.21.15.105:0/1784747448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe338162f60 0x7fe33806cde0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe330009d60 tx=0x7fe330003f10 comp rx=0 tx=0).stop 2024-09-21T03:18:55.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.756+0000 7fe33df57640 1 -- 172.21.15.105:0/1784747448 shutdown_connections 2024-09-21T03:18:55.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.756+0000 7fe33df57640 1 --2- 172.21.15.105:0/1784747448 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe324078bc0 0x7fe32407b0d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.756+0000 7fe33df57640 1 --2- 172.21.15.105:0/1784747448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe338162f60 0x7fe33806cde0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.756+0000 7fe33df57640 1 --2- 172.21.15.105:0/1784747448 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3380b6680 0x7fe3380cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.756+0000 7fe33df57640 1 --2- 172.21.15.105:0/1784747448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3380b6100 0x7fe33815b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.756+0000 7fe33df57640 1 -- 172.21.15.105:0/1784747448 >> 172.21.15.105:0/1784747448 conn(0x7fe3380d12a0 msgr2=0x7fe3380cf830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:55.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.756+0000 7fe33df57640 1 -- 172.21.15.105:0/1784747448 shutdown_connections 2024-09-21T03:18:55.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.756+0000 7fe33df57640 1 -- 172.21.15.105:0/1784747448 wait complete. 2024-09-21T03:18:55.769 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T03:18:55.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.883+0000 7f8e995b0640 1 -- 172.21.15.105:0/4273686073 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e80003a00 msgr2=0x7f8e80003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:55.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.883+0000 7f8e995b0640 1 --2- 172.21.15.105:0/4273686073 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e80003a00 0x7f8e80003e70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8e8400c290 tx=0x7f8e80005830 comp rx=0 tx=0).stop 2024-09-21T03:18:55.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.883+0000 7f8e937fe640 1 -- 172.21.15.105:0/4273686073 reap_dead start 2024-09-21T03:18:55.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.883+0000 7f8e995b0640 1 -- 172.21.15.105:0/4273686073 shutdown_connections 2024-09-21T03:18:55.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.883+0000 7f8e995b0640 1 -- 172.21.15.105:0/4273686073 >> 172.21.15.105:0/4273686073 conn(0x7f8e940b1cb0 msgr2=0x7f8e940b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:55.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.883+0000 7f8e995b0640 1 -- 172.21.15.105:0/4273686073 shutdown_connections 2024-09-21T03:18:55.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.883+0000 7f8e995b0640 1 -- 172.21.15.105:0/4273686073 wait complete. 2024-09-21T03:18:55.886 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.885+0000 7f8e995b0640 1 Processor -- start 2024-09-21T03:18:55.886 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.885+0000 7f8e995b0640 1 -- start start 2024-09-21T03:18:55.889 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.886+0000 7f8e995b0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e80003a00 0x7f8e94157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:55.889 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.886+0000 7f8e995b0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e9409cf60 0x7f8e94159790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:55.889 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.886+0000 7f8e995b0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e941f3dc0 0x7f8e941f41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:55.889 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.886+0000 7f8e995b0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8e940b34a0 con 0x7f8e9409cf60 2024-09-21T03:18:55.889 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.886+0000 7f8e995b0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8e940b3320 con 0x7f8e80003a00 2024-09-21T03:18:55.889 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.886+0000 7f8e995b0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8e940b3620 con 0x7f8e941f3dc0 2024-09-21T03:18:55.889 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.886+0000 7f8e8a7fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e9409cf60 0x7f8e94159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:55.890 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.886+0000 7f8e8a7fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e9409cf60 0x7f8e94159790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58544/0 (socket says 172.21.15.105:58544) 2024-09-21T03:18:55.890 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.887+0000 7f8e8a7fc640 1 -- 172.21.15.105:0/1895745584 learned_addr learned my addr 172.21.15.105:0/1895745584 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:55.890 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.887+0000 7f8e92ffd640 1 --2- 172.21.15.105:0/1895745584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e80003a00 0x7f8e94157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:55.890 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.887+0000 7f8e937fe640 1 --2- 172.21.15.105:0/1895745584 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e941f3dc0 0x7f8e941f41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:55.890 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.887+0000 7f8e8a7fc640 1 -- 172.21.15.105:0/1895745584 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e941f3dc0 msgr2=0x7f8e941f41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:55.890 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.887+0000 7f8e8a7fc640 1 --2- 172.21.15.105:0/1895745584 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e941f3dc0 0x7f8e941f41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.890 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.887+0000 7f8e8a7fc640 1 -- 172.21.15.105:0/1895745584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e80003a00 msgr2=0x7f8e94157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:55.890 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.887+0000 7f8e8a7fc640 1 --2- 172.21.15.105:0/1895745584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e80003a00 0x7f8e94157fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:55.890 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.887+0000 7f8e8a7fc640 1 -- 172.21.15.105:0/1895745584 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e941f72f0 con 0x7f8e9409cf60 2024-09-21T03:18:55.890 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.887+0000 7f8e92ffd640 1 --2- 172.21.15.105:0/1895745584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e80003a00 0x7f8e94157fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:18:55.890 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.887+0000 7f8e8a7fc640 1 --2- 172.21.15.105:0/1895745584 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e9409cf60 0x7f8e94159790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c011780 tx=0x7f8e7c011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:55.890 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.887+0000 7f8e8bfff640 1 -- 172.21.15.105:0/1895745584 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c00fd50 con 0x7f8e9409cf60 2024-09-21T03:18:55.890 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.887+0000 7f8e8bfff640 1 -- 172.21.15.105:0/1895745584 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e7c005020 con 0x7f8e9409cf60 2024-09-21T03:18:55.890 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.887+0000 7f8e995b0640 1 -- 172.21.15.105:0/1895745584 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e941f75d0 con 0x7f8e9409cf60 2024-09-21T03:18:55.891 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.887+0000 7f8e8bfff640 1 -- 172.21.15.105:0/1895745584 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c005470 con 0x7f8e9409cf60 2024-09-21T03:18:55.891 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.887+0000 7f8e995b0640 1 -- 172.21.15.105:0/1895745584 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e941f7b90 con 0x7f8e9409cf60 2024-09-21T03:18:55.891 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.888+0000 7f8e995b0640 1 -- 172.21.15.105:0/1895745584 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e94074b60 con 0x7f8e9409cf60 2024-09-21T03:18:55.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.889+0000 7f8e8bfff640 1 -- 172.21.15.105:0/1895745584 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8e7c0047a0 con 0x7f8e9409cf60 2024-09-21T03:18:55.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.889+0000 7f8e8bfff640 1 --2- 172.21.15.105:0/1895745584 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8e74078b90 0x7f8e7407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:55.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.890+0000 7f8e8bfff640 1 -- 172.21.15.105:0/1895745584 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f8e7c09b9a0 con 0x7f8e9409cf60 2024-09-21T03:18:55.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.890+0000 7f8e92ffd640 1 --2- 172.21.15.105:0/1895745584 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8e74078b90 0x7f8e7407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:55.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.890+0000 7f8e92ffd640 1 --2- 172.21.15.105:0/1895745584 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8e74078b90 0x7f8e7407b0a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8e84033000 tx=0x7f8e8402d000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:55.895 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:55.894+0000 7f8e8bfff640 1 -- 172.21.15.105:0/1895745584 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8e7c063de0 con 0x7f8e9409cf60 2024-09-21T03:18:55.907 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:18:55.909 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:18:56.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.075+0000 7f8e995b0640 1 -- 172.21.15.105:0/1895745584 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8e940c3860 con 0x7f8e9409cf60 2024-09-21T03:18:56.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.075+0000 7f8e8bfff640 1 -- 172.21.15.105:0/1895745584 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f8e7c0636e0 con 0x7f8e9409cf60 2024-09-21T03:18:56.077 INFO:teuthology.orchestra.run.smithi105.stdout:pg_num: 64 2024-09-21T03:18:56.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.078+0000 7f8e995b0640 1 -- 172.21.15.105:0/1895745584 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8e74078b90 msgr2=0x7f8e7407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:56.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.078+0000 7f8e995b0640 1 --2- 172.21.15.105:0/1895745584 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8e74078b90 0x7f8e7407b0a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8e84033000 tx=0x7f8e8402d000 comp rx=0 tx=0).stop 2024-09-21T03:18:56.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.078+0000 7f8e995b0640 1 -- 172.21.15.105:0/1895745584 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e9409cf60 msgr2=0x7f8e94159790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:56.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.078+0000 7f8e995b0640 1 --2- 172.21.15.105:0/1895745584 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e9409cf60 0x7f8e94159790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c011780 tx=0x7f8e7c011c40 comp rx=0 tx=0).stop 2024-09-21T03:18:56.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.078+0000 7f8e995b0640 1 -- 172.21.15.105:0/1895745584 shutdown_connections 2024-09-21T03:18:56.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.078+0000 7f8e995b0640 1 --2- 172.21.15.105:0/1895745584 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8e74078b90 0x7f8e7407b0a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:56.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.078+0000 7f8e995b0640 1 --2- 172.21.15.105:0/1895745584 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e941f3dc0 0x7f8e941f41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:56.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.078+0000 7f8e995b0640 1 --2- 172.21.15.105:0/1895745584 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e9409cf60 0x7f8e94159790 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:56.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.078+0000 7f8e995b0640 1 --2- 172.21.15.105:0/1895745584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e80003a00 0x7f8e94157fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:56.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.078+0000 7f8e995b0640 1 -- 172.21.15.105:0/1895745584 >> 172.21.15.105:0/1895745584 conn(0x7f8e940b1cb0 msgr2=0x7f8e940ae8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:56.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.078+0000 7f8e995b0640 1 -- 172.21.15.105:0/1895745584 shutdown_connections 2024-09-21T03:18:56.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.078+0000 7f8e995b0640 1 -- 172.21.15.105:0/1895745584 wait complete. 2024-09-21T03:18:56.091 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_cap_acquisition_throttle_readdir' 2024-09-21T03:18:56.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.201+0000 7f14f1ec5640 1 -- 172.21.15.105:0/4044826773 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14ec0d0c20 msgr2=0x7f14ec0d1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:56.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.201+0000 7f14f1ec5640 1 --2- 172.21.15.105:0/4044826773 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14ec0d0c20 0x7f14ec0d1030 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f14ec0d3f30 tx=0x7f14e402a8b0 comp rx=0 tx=0).stop 2024-09-21T03:18:56.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.201+0000 7f14f1ec5640 1 -- 172.21.15.105:0/4044826773 shutdown_connections 2024-09-21T03:18:56.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.201+0000 7f14f1ec5640 1 --2- 172.21.15.105:0/4044826773 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14ec0d0c20 0x7f14ec0d1030 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:56.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.201+0000 7f14f1ec5640 1 --2- 172.21.15.105:0/4044826773 >> v2:172.21.15.162:3300/0 conn(0x7f14ec06eee0 0x7f14ec06f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:56.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.201+0000 7f14f1ec5640 1 -- 172.21.15.105:0/4044826773 >> 172.21.15.105:0/4044826773 conn(0x7f14ec09d8c0 msgr2=0x7f14ec08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:56.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.201+0000 7f14f1ec5640 1 -- 172.21.15.105:0/4044826773 shutdown_connections 2024-09-21T03:18:56.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.201+0000 7f14f1ec5640 1 -- 172.21.15.105:0/4044826773 wait complete. 2024-09-21T03:18:56.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.203+0000 7f14f1ec5640 1 Processor -- start 2024-09-21T03:18:56.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.203+0000 7f14f1ec5640 1 -- start start 2024-09-21T03:18:56.207 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.204+0000 7f14f1ec5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14ec06eee0 0x7f14ec1514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:56.207 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.204+0000 7f14f1ec5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14ec0b96c0 0x7f14ec0cc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:56.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.204+0000 7f14f1ec5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14ec0d0c20 0x7f14ec0ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:56.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.204+0000 7f14f1ec5640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f14ec0b3d80 con 0x7f14ec0d0c20 2024-09-21T03:18:56.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.204+0000 7f14f1ec5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f14ec0b3c00 con 0x7f14ec06eee0 2024-09-21T03:18:56.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.204+0000 7f14f1ec5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f14ec0d1570 con 0x7f14ec0b96c0 2024-09-21T03:18:56.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.205+0000 7f14ebfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14ec0d0c20 0x7f14ec0ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:56.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.205+0000 7f14ebfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14ec0d0c20 0x7f14ec0ccb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58556/0 (socket says 172.21.15.105:58556) 2024-09-21T03:18:56.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.205+0000 7f14ebfff640 1 -- 172.21.15.105:0/2127982246 learned_addr learned my addr 172.21.15.105:0/2127982246 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:56.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.205+0000 7f14eb7fe640 1 --2- 172.21.15.105:0/2127982246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14ec06eee0 0x7f14ec1514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:56.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.205+0000 7f14eaffd640 1 --2- 172.21.15.105:0/2127982246 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14ec0b96c0 0x7f14ec0cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:56.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.205+0000 7f14ebfff640 1 -- 172.21.15.105:0/2127982246 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14ec0b96c0 msgr2=0x7f14ec0cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:56.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.205+0000 7f14ebfff640 1 --2- 172.21.15.105:0/2127982246 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14ec0b96c0 0x7f14ec0cc650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:56.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.205+0000 7f14ebfff640 1 -- 172.21.15.105:0/2127982246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14ec06eee0 msgr2=0x7f14ec1514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:56.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.205+0000 7f14ebfff640 1 --2- 172.21.15.105:0/2127982246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14ec06eee0 0x7f14ec1514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:56.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.205+0000 7f14ebfff640 1 -- 172.21.15.105:0/2127982246 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14ec151d00 con 0x7f14ec0d0c20 2024-09-21T03:18:56.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.205+0000 7f14eaffd640 1 --2- 172.21.15.105:0/2127982246 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14ec0b96c0 0x7f14ec0cc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:18:56.209 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.205+0000 7f14eb7fe640 1 --2- 172.21.15.105:0/2127982246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14ec06eee0 0x7f14ec1514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:18:56.209 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.205+0000 7f14ebfff640 1 --2- 172.21.15.105:0/2127982246 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14ec0d0c20 0x7f14ec0ccb90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f14e4005fd0 tx=0x7f14e40039f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:56.209 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.205+0000 7f14d3fff640 1 -- 172.21.15.105:0/2127982246 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e4031990 con 0x7f14ec0d0c20 2024-09-21T03:18:56.209 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.205+0000 7f14d3fff640 1 -- 172.21.15.105:0/2127982246 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14e4031c20 con 0x7f14ec0d0c20 2024-09-21T03:18:56.209 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.205+0000 7f14f1ec5640 1 -- 172.21.15.105:0/2127982246 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14ec151fe0 con 0x7f14ec0d0c20 2024-09-21T03:18:56.209 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.205+0000 7f14d3fff640 1 -- 172.21.15.105:0/2127982246 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e40330d0 con 0x7f14ec0d0c20 2024-09-21T03:18:56.209 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.205+0000 7f14f1ec5640 1 -- 172.21.15.105:0/2127982246 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14ec1525a0 con 0x7f14ec0d0c20 2024-09-21T03:18:56.209 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.206+0000 7f14f1ec5640 1 -- 172.21.15.105:0/2127982246 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14ec09e440 con 0x7f14ec0d0c20 2024-09-21T03:18:56.210 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.207+0000 7f14d3fff640 1 -- 172.21.15.105:0/2127982246 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f14e4033290 con 0x7f14ec0d0c20 2024-09-21T03:18:56.210 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.207+0000 7f14d3fff640 1 --2- 172.21.15.105:0/2127982246 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f14d8078bc0 0x7f14d807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:56.210 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.207+0000 7f14d3fff640 1 -- 172.21.15.105:0/2127982246 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f14e40bc310 con 0x7f14ec0d0c20 2024-09-21T03:18:56.210 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.208+0000 7f14eb7fe640 1 --2- 172.21.15.105:0/2127982246 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f14d8078bc0 0x7f14d807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:56.210 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.208+0000 7f14eb7fe640 1 --2- 172.21.15.105:0/2127982246 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f14d8078bc0 0x7f14d807b0d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f14dc007fd0 tx=0x7f14dc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:56.214 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.212+0000 7f14d3fff640 1 -- 172.21.15.105:0/2127982246 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f14e403f030 con 0x7f14ec0d0c20 2024-09-21T03:18:56.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.458+0000 7f14f1ec5640 1 -- 172.21.15.105:0/2127982246 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_cap_acquisition_throttle_readdir"]} v 0) -- 0x7f14ec0d19a0 con 0x7f14ec0d0c20 2024-09-21T03:18:56.471 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.470+0000 7f14d3fff640 1 -- 172.21.15.105:0/2127982246 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_cap_acquisition_throttle_readdir"]}]=0 v47) ==== 168+0+0 (secure 0 0 0) 0x7f14e4084750 con 0x7f14ec0d0c20 2024-09-21T03:18:56.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.472+0000 7f14f1ec5640 1 -- 172.21.15.105:0/2127982246 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f14d8078bc0 msgr2=0x7f14d807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:56.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.472+0000 7f14f1ec5640 1 --2- 172.21.15.105:0/2127982246 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f14d8078bc0 0x7f14d807b0d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f14dc007fd0 tx=0x7f14dc009040 comp rx=0 tx=0).stop 2024-09-21T03:18:56.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.472+0000 7f14f1ec5640 1 -- 172.21.15.105:0/2127982246 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14ec0d0c20 msgr2=0x7f14ec0ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:56.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.472+0000 7f14f1ec5640 1 --2- 172.21.15.105:0/2127982246 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14ec0d0c20 0x7f14ec0ccb90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f14e4005fd0 tx=0x7f14e40039f0 comp rx=0 tx=0).stop 2024-09-21T03:18:56.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.472+0000 7f14f1ec5640 1 -- 172.21.15.105:0/2127982246 shutdown_connections 2024-09-21T03:18:56.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.472+0000 7f14f1ec5640 1 --2- 172.21.15.105:0/2127982246 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f14d8078bc0 0x7f14d807b0d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:56.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.472+0000 7f14f1ec5640 1 --2- 172.21.15.105:0/2127982246 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14ec0d0c20 0x7f14ec0ccb90 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:56.475 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.472+0000 7f14f1ec5640 1 --2- 172.21.15.105:0/2127982246 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14ec0b96c0 0x7f14ec0cc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:56.475 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.472+0000 7f14f1ec5640 1 --2- 172.21.15.105:0/2127982246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14ec06eee0 0x7f14ec1514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:56.475 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.472+0000 7f14f1ec5640 1 -- 172.21.15.105:0/2127982246 >> 172.21.15.105:0/2127982246 conn(0x7f14ec09d8c0 msgr2=0x7f14ec068e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:56.475 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.472+0000 7f14f1ec5640 1 -- 172.21.15.105:0/2127982246 shutdown_connections 2024-09-21T03:18:56.475 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.472+0000 7f14f1ec5640 1 -- 172.21.15.105:0/2127982246 wait complete. 2024-09-21T03:18:56.485 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T03:18:56.597 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.596+0000 7f29bbd0b640 1 -- 172.21.15.105:0/543619670 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29a0005150 msgr2=0x7f29a000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:56.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.596+0000 7f29bbd0b640 1 --2- 172.21.15.105:0/543619670 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29a0005150 0x7f29a000b9c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f29b4073940 tx=0x7f29a0005830 comp rx=0 tx=0).stop 2024-09-21T03:18:56.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.596+0000 7f29ba2a8640 1 -- 172.21.15.105:0/543619670 reap_dead start 2024-09-21T03:18:56.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.596+0000 7f29bbd0b640 1 -- 172.21.15.105:0/543619670 shutdown_connections 2024-09-21T03:18:56.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.596+0000 7f29bbd0b640 1 -- 172.21.15.105:0/543619670 >> 172.21.15.105:0/543619670 conn(0x7f29b406def0 msgr2=0x7f29b406e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:56.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.596+0000 7f29bbd0b640 1 -- 172.21.15.105:0/543619670 shutdown_connections 2024-09-21T03:18:56.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.596+0000 7f29bbd0b640 1 -- 172.21.15.105:0/543619670 wait complete. 2024-09-21T03:18:56.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.598+0000 7f29bbd0b640 1 Processor -- start 2024-09-21T03:18:56.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.598+0000 7f29bbd0b640 1 -- start start 2024-09-21T03:18:56.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.599+0000 7f29bbd0b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29b4144620 0x7f29b415a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:56.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.599+0000 7f29bbd0b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29b415a7d0 0x7f29b40d0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:56.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.599+0000 7f29bbd0b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29b40d0fc0 0x7f29b41f5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:56.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.599+0000 7f29bbd0b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f29b4070b00 con 0x7f29b40d0fc0 2024-09-21T03:18:56.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.599+0000 7f29bbd0b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f29b4070980 con 0x7f29b4144620 2024-09-21T03:18:56.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.599+0000 7f29bbd0b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f29b4070c80 con 0x7f29b415a7d0 2024-09-21T03:18:56.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.599+0000 7f29ba2a8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29b40d0fc0 0x7f29b41f5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:56.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.599+0000 7f29ba2a8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29b40d0fc0 0x7f29b41f5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58572/0 (socket says 172.21.15.105:58572) 2024-09-21T03:18:56.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.599+0000 7f29ba2a8640 1 -- 172.21.15.105:0/314181842 learned_addr learned my addr 172.21.15.105:0/314181842 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:56.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.599+0000 7f29b9aa7640 1 --2- 172.21.15.105:0/314181842 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29b4144620 0x7f29b415a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:56.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.599+0000 7f29b92a6640 1 --2- 172.21.15.105:0/314181842 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29b415a7d0 0x7f29b40d0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:56.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.599+0000 7f29ba2a8640 1 -- 172.21.15.105:0/314181842 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29b415a7d0 msgr2=0x7f29b40d0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:56.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.599+0000 7f29ba2a8640 1 --2- 172.21.15.105:0/314181842 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29b415a7d0 0x7f29b40d0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:56.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.599+0000 7f29ba2a8640 1 -- 172.21.15.105:0/314181842 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29b4144620 msgr2=0x7f29b415a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:56.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.599+0000 7f29ba2a8640 1 --2- 172.21.15.105:0/314181842 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29b4144620 0x7f29b415a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:56.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.599+0000 7f29ba2a8640 1 -- 172.21.15.105:0/314181842 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b40d13d0 con 0x7f29b40d0fc0 2024-09-21T03:18:56.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.600+0000 7f29ba2a8640 1 --2- 172.21.15.105:0/314181842 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29b40d0fc0 0x7f29b41f5550 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f29ac02b410 tx=0x7f29ac003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:56.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.600+0000 7f29aa7fc640 1 -- 172.21.15.105:0/314181842 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ac002030 con 0x7f29b40d0fc0 2024-09-21T03:18:56.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.600+0000 7f29aa7fc640 1 -- 172.21.15.105:0/314181842 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f29ac02b960 con 0x7f29b40d0fc0 2024-09-21T03:18:56.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.600+0000 7f29bbd0b640 1 -- 172.21.15.105:0/314181842 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29b4144d60 con 0x7f29b40d0fc0 2024-09-21T03:18:56.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.600+0000 7f29aa7fc640 1 -- 172.21.15.105:0/314181842 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ac02bdb0 con 0x7f29b40d0fc0 2024-09-21T03:18:56.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.600+0000 7f29bbd0b640 1 -- 172.21.15.105:0/314181842 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29b4145320 con 0x7f29b40d0fc0 2024-09-21T03:18:56.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.601+0000 7f29bbd0b640 1 -- 172.21.15.105:0/314181842 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29b406fe30 con 0x7f29b40d0fc0 2024-09-21T03:18:56.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.601+0000 7f29aa7fc640 1 -- 172.21.15.105:0/314181842 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f29ac006250 con 0x7f29b40d0fc0 2024-09-21T03:18:56.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.602+0000 7f29aa7fc640 1 --2- 172.21.15.105:0/314181842 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2998078bc0 0x7f299807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:56.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.602+0000 7f29aa7fc640 1 -- 172.21.15.105:0/314181842 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f29ac0bcbb0 con 0x7f29b40d0fc0 2024-09-21T03:18:56.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.602+0000 7f29b9aa7640 1 --2- 172.21.15.105:0/314181842 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2998078bc0 0x7f299807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:56.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.603+0000 7f29b9aa7640 1 --2- 172.21.15.105:0/314181842 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2998078bc0 0x7f299807b0d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f29b40d1a10 tx=0x7f29b0006d70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:56.608 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.607+0000 7f29aa7fc640 1 -- 172.21.15.105:0/314181842 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f29b40d13d0 con 0x7f29b40d0fc0 2024-09-21T03:18:56.784 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.782+0000 7f29bbd0b640 1 -- 172.21.15.105:0/314181842 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f29b40b34a0 con 0x7f29b40d0fc0 2024-09-21T03:18:56.784 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.783+0000 7f29aa7fc640 1 -- 172.21.15.105:0/314181842 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v31) ==== 59+0+2294 (secure 0 0 0) 0x7f29ac0c0080 con 0x7f29b40d0fc0 2024-09-21T03:18:56.784 INFO:teuthology.orchestra.run.smithi105.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T03:18:56.785 INFO:teuthology.orchestra.run.smithi105.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T03:18:56.785 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced client_mount_timeout 30 2024-09-21T03:18:56.785 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced debug_client 20/20 2024-09-21T03:18:56.785 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced debug_mgr 20/20 2024-09-21T03:18:56.785 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced debug_ms 1/1 2024-09-21T03:18:56.785 INFO:teuthology.orchestra.run.smithi105.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T03:18:56.785 INFO:teuthology.orchestra.run.smithi105.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T03:18:56.785 INFO:teuthology.orchestra.run.smithi105.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 7291.545169 2024-09-21T03:18:56.785 INFO:teuthology.orchestra.run.smithi105.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5080.142035 2024-09-21T03:18:56.785 INFO:teuthology.orchestra.run.smithi105.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5120.988640 2024-09-21T03:18:56.785 INFO:teuthology.orchestra.run.smithi105.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4938.196268 2024-09-21T03:18:56.785 INFO:teuthology.orchestra.run.smithi105.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4906.316728 2024-09-21T03:18:56.786 INFO:teuthology.orchestra.run.smithi105.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4701.273858 2024-09-21T03:18:56.786 INFO:teuthology.orchestra.run.smithi105.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4947.710044 2024-09-21T03:18:56.786 INFO:teuthology.orchestra.run.smithi105.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5174.949063 2024-09-21T03:18:56.786 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced debug_mds 20/20 2024-09-21T03:18:56.786 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T03:18:56.786 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced debug_ms 2/2 2024-09-21T03:18:56.786 INFO:teuthology.orchestra.run.smithi105.stdout:mds dev mds_debug_frag true 2024-09-21T03:18:56.786 INFO:teuthology.orchestra.run.smithi105.stdout:mds dev mds_debug_scatterstat true 2024-09-21T03:18:56.786 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T03:18:56.786 INFO:teuthology.orchestra.run.smithi105.stdout:mds dev mds_verify_scatter true 2024-09-21T03:18:56.786 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T03:18:56.786 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T03:18:56.786 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T03:18:56.787 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced client_mount_timeout 600 2024-09-21T03:18:56.787 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced debug_client 20/20 2024-09-21T03:18:56.787 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced debug_ms 1/1 2024-09-21T03:18:56.787 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T03:18:56.787 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T03:18:56.788 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.785+0000 7f29bbd0b640 1 -- 172.21.15.105:0/314181842 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2998078bc0 msgr2=0x7f299807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:56.788 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.785+0000 7f29bbd0b640 1 --2- 172.21.15.105:0/314181842 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2998078bc0 0x7f299807b0d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f29b40d1a10 tx=0x7f29b0006d70 comp rx=0 tx=0).stop 2024-09-21T03:18:56.788 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.785+0000 7f29bbd0b640 1 -- 172.21.15.105:0/314181842 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29b40d0fc0 msgr2=0x7f29b41f5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:56.788 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.785+0000 7f29bbd0b640 1 --2- 172.21.15.105:0/314181842 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29b40d0fc0 0x7f29b41f5550 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f29ac02b410 tx=0x7f29ac003ba0 comp rx=0 tx=0).stop 2024-09-21T03:18:56.788 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.785+0000 7f29bbd0b640 1 -- 172.21.15.105:0/314181842 shutdown_connections 2024-09-21T03:18:56.788 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.785+0000 7f29bbd0b640 1 --2- 172.21.15.105:0/314181842 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2998078bc0 0x7f299807b0d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:56.788 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.785+0000 7f29bbd0b640 1 --2- 172.21.15.105:0/314181842 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29b40d0fc0 0x7f29b41f5550 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:56.788 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.785+0000 7f29bbd0b640 1 --2- 172.21.15.105:0/314181842 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29b415a7d0 0x7f29b40d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:56.789 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.785+0000 7f29bbd0b640 1 --2- 172.21.15.105:0/314181842 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29b4144620 0x7f29b415a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:56.789 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.785+0000 7f29bbd0b640 1 -- 172.21.15.105:0/314181842 >> 172.21.15.105:0/314181842 conn(0x7f29b406def0 msgr2=0x7f29b40b2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:56.789 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.785+0000 7f29bbd0b640 1 -- 172.21.15.105:0/314181842 shutdown_connections 2024-09-21T03:18:56.789 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.785+0000 7f29bbd0b640 1 -- 172.21.15.105:0/314181842 wait complete. 2024-09-21T03:18:56.798 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T03:18:56.914 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.912+0000 7f15db5a8640 1 -- 172.21.15.105:0/702565292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15d40ccbd0 msgr2=0x7f15d40d0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:56.914 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.912+0000 7f15db5a8640 1 --2- 172.21.15.105:0/702565292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15d40ccbd0 0x7f15d40d0d80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f15c8009830 tx=0x7f15c802a510 comp rx=0 tx=0).stop 2024-09-21T03:18:56.914 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.912+0000 7f15db5a8640 1 -- 172.21.15.105:0/702565292 shutdown_connections 2024-09-21T03:18:56.914 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.912+0000 7f15db5a8640 1 --2- 172.21.15.105:0/702565292 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15d40d12c0 0x7f15d40d16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:56.914 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.912+0000 7f15db5a8640 1 --2- 172.21.15.105:0/702565292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15d40ccbd0 0x7f15d40d0d80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:56.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.912+0000 7f15db5a8640 1 -- 172.21.15.105:0/702565292 >> 172.21.15.105:0/702565292 conn(0x7f15d4072ae0 msgr2=0x7f15d4072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:56.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.912+0000 7f15db5a8640 1 -- 172.21.15.105:0/702565292 shutdown_connections 2024-09-21T03:18:56.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.912+0000 7f15db5a8640 1 -- 172.21.15.105:0/702565292 wait complete. 2024-09-21T03:18:56.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.914+0000 7f15db5a8640 1 Processor -- start 2024-09-21T03:18:56.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.914+0000 7f15db5a8640 1 -- start start 2024-09-21T03:18:56.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.915+0000 7f15db5a8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15d40b51c0 0x7f15d414ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:56.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.915+0000 7f15db5a8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15d40ccbd0 0x7f15d41f70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:56.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.915+0000 7f15db5a8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15d40d12c0 0x7f15d40cb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:56.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.915+0000 7f15db5a8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f15d40cf220 con 0x7f15d40ccbd0 2024-09-21T03:18:56.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.915+0000 7f15db5a8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f15d40cf0a0 con 0x7f15d40d12c0 2024-09-21T03:18:56.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.915+0000 7f15db5a8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f15d40cf3a0 con 0x7f15d40b51c0 2024-09-21T03:18:56.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.915+0000 7f15d8b43640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15d40ccbd0 0x7f15d41f70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:56.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.915+0000 7f15d8b43640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15d40ccbd0 0x7f15d41f70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58592/0 (socket says 172.21.15.105:58592) 2024-09-21T03:18:56.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.915+0000 7f15d8b43640 1 -- 172.21.15.105:0/2409932536 learned_addr learned my addr 172.21.15.105:0/2409932536 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:56.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.916+0000 7f15d9b45640 1 --2- 172.21.15.105:0/2409932536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15d40d12c0 0x7f15d40cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:56.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.916+0000 7f15d9344640 1 --2- 172.21.15.105:0/2409932536 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15d40b51c0 0x7f15d414ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:56.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.916+0000 7f15d8b43640 1 -- 172.21.15.105:0/2409932536 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15d40b51c0 msgr2=0x7f15d414ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:56.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.916+0000 7f15d8b43640 1 --2- 172.21.15.105:0/2409932536 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15d40b51c0 0x7f15d414ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:56.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.916+0000 7f15d8b43640 1 -- 172.21.15.105:0/2409932536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15d40d12c0 msgr2=0x7f15d40cb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:56.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.916+0000 7f15d8b43640 1 --2- 172.21.15.105:0/2409932536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15d40d12c0 0x7f15d40cb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:56.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.916+0000 7f15d8b43640 1 -- 172.21.15.105:0/2409932536 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d41f75f0 con 0x7f15d40ccbd0 2024-09-21T03:18:56.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.916+0000 7f15d9344640 1 --2- 172.21.15.105:0/2409932536 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15d40b51c0 0x7f15d414ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:18:56.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.916+0000 7f15d8b43640 1 --2- 172.21.15.105:0/2409932536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15d40ccbd0 0x7f15d41f70b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f15c8009950 tx=0x7f15c8033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:56.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.916+0000 7f15d1ffb640 1 -- 172.21.15.105:0/2409932536 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c8031d60 con 0x7f15d40ccbd0 2024-09-21T03:18:56.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.916+0000 7f15d1ffb640 1 -- 172.21.15.105:0/2409932536 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f15c8033e10 con 0x7f15d40ccbd0 2024-09-21T03:18:56.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.916+0000 7f15db5a8640 1 -- 172.21.15.105:0/2409932536 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15d414de20 con 0x7f15d40ccbd0 2024-09-21T03:18:56.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.916+0000 7f15d1ffb640 1 -- 172.21.15.105:0/2409932536 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c8005260 con 0x7f15d40ccbd0 2024-09-21T03:18:56.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.916+0000 7f15db5a8640 1 -- 172.21.15.105:0/2409932536 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15d414e3e0 con 0x7f15d40ccbd0 2024-09-21T03:18:56.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.917+0000 7f15db5a8640 1 -- 172.21.15.105:0/2409932536 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15d40cf850 con 0x7f15d40ccbd0 2024-09-21T03:18:56.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.918+0000 7f15d1ffb640 1 -- 172.21.15.105:0/2409932536 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f15c8005400 con 0x7f15d40ccbd0 2024-09-21T03:18:56.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.918+0000 7f15d1ffb640 1 --2- 172.21.15.105:0/2409932536 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f15c0078b90 0x7f15c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:56.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.919+0000 7f15d1ffb640 1 -- 172.21.15.105:0/2409932536 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f15c80bbfd0 con 0x7f15d40ccbd0 2024-09-21T03:18:56.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.919+0000 7f15d9344640 1 --2- 172.21.15.105:0/2409932536 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f15c0078b90 0x7f15c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:56.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.919+0000 7f15d9344640 1 --2- 172.21.15.105:0/2409932536 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f15c0078b90 0x7f15c007b0a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f15c4000f60 tx=0x7f15c4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:56.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:56.923+0000 7f15d1ffb640 1 -- 172.21.15.105:0/2409932536 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f15d41f75f0 con 0x7f15d40ccbd0 2024-09-21T03:18:57.103 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.102+0000 7f15db5a8640 1 -- 172.21.15.105:0/2409932536 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f15d4070100 con 0x7f15d40ccbd0 2024-09-21T03:18:57.108 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.107+0000 7f15d1ffb640 1 -- 172.21.15.105:0/2409932536 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v32)=0 v32) ==== 122+0+0 (secure 0 0 0) 0x7f15c803f030 con 0x7f15d40ccbd0 2024-09-21T03:18:57.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.109+0000 7f15db5a8640 1 -- 172.21.15.105:0/2409932536 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f15c0078b90 msgr2=0x7f15c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:57.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.109+0000 7f15db5a8640 1 --2- 172.21.15.105:0/2409932536 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f15c0078b90 0x7f15c007b0a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f15c4000f60 tx=0x7f15c4009040 comp rx=0 tx=0).stop 2024-09-21T03:18:57.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.109+0000 7f15db5a8640 1 -- 172.21.15.105:0/2409932536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15d40ccbd0 msgr2=0x7f15d41f70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:57.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.109+0000 7f15db5a8640 1 --2- 172.21.15.105:0/2409932536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15d40ccbd0 0x7f15d41f70b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f15c8009950 tx=0x7f15c8033c20 comp rx=0 tx=0).stop 2024-09-21T03:18:57.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.109+0000 7f15db5a8640 1 -- 172.21.15.105:0/2409932536 shutdown_connections 2024-09-21T03:18:57.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.109+0000 7f15db5a8640 1 --2- 172.21.15.105:0/2409932536 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f15c0078b90 0x7f15c007b0a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:57.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.109+0000 7f15db5a8640 1 --2- 172.21.15.105:0/2409932536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15d40d12c0 0x7f15d40cb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:57.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.109+0000 7f15db5a8640 1 --2- 172.21.15.105:0/2409932536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f15d40ccbd0 0x7f15d41f70b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:57.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.109+0000 7f15db5a8640 1 --2- 172.21.15.105:0/2409932536 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15d40b51c0 0x7f15d414ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:57.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.109+0000 7f15db5a8640 1 -- 172.21.15.105:0/2409932536 >> 172.21.15.105:0/2409932536 conn(0x7f15d4072ae0 msgr2=0x7f15d4068ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:57.112 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.109+0000 7f15db5a8640 1 -- 172.21.15.105:0/2409932536 shutdown_connections 2024-09-21T03:18:57.112 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.109+0000 7f15db5a8640 1 -- 172.21.15.105:0/2409932536 wait complete. 2024-09-21T03:18:57.122 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T03:18:57.122 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T03:18:57.166 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T03:18:57.223 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T03:18:57.223 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:18:57.224 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:18:57.239 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:18:57.240 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:18:57.296 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:18:57.297 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:18:57.352 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T03:18:57.506 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.503+0000 7f005c58b640 1 -- 172.21.15.105:0/1791635970 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0040003a00 msgr2=0x7f0040003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:57.506 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.503+0000 7f005c58b640 1 --2- 172.21.15.105:0/1791635970 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0040003a00 0x7f0040003e70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0050009b70 tx=0x7f0040005830 comp rx=0 tx=0).stop 2024-09-21T03:18:57.506 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.503+0000 7f005ab28640 1 -- 172.21.15.105:0/1791635970 reap_dead start 2024-09-21T03:18:57.506 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.504+0000 7f005c58b640 1 -- 172.21.15.105:0/1791635970 shutdown_connections 2024-09-21T03:18:57.506 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.504+0000 7f005c58b640 1 -- 172.21.15.105:0/1791635970 >> 172.21.15.105:0/1791635970 conn(0x7f005409d7f0 msgr2=0x7f00540d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:57.506 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.504+0000 7f005c58b640 1 -- 172.21.15.105:0/1791635970 shutdown_connections 2024-09-21T03:18:57.506 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.504+0000 7f005c58b640 1 -- 172.21.15.105:0/1791635970 wait complete. 2024-09-21T03:18:57.507 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.505+0000 7f005c58b640 1 Processor -- start 2024-09-21T03:18:57.507 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.505+0000 7f005c58b640 1 -- start start 2024-09-21T03:18:57.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.507+0000 7f005c58b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0040003a00 0x7f005415e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:57.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.507+0000 7f005c58b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00540cb5f0 0x7f00541f5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:57.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.507+0000 7f005c58b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00541612f0 0x7f0054161700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:57.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.507+0000 7f005c58b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f005406f170 con 0x7f0040003a00 2024-09-21T03:18:57.510 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.507+0000 7f005c58b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f005406eff0 con 0x7f00540cb5f0 2024-09-21T03:18:57.510 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.507+0000 7f005c58b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f005406f2f0 con 0x7f00541612f0 2024-09-21T03:18:57.510 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.507+0000 7f005a327640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0040003a00 0x7f005415e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:57.510 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.507+0000 7f005a327640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0040003a00 0x7f005415e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58622/0 (socket says 172.21.15.105:58622) 2024-09-21T03:18:57.510 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.507+0000 7f005a327640 1 -- 172.21.15.105:0/121123114 learned_addr learned my addr 172.21.15.105:0/121123114 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:57.510 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.507+0000 7f0059b26640 1 --2- 172.21.15.105:0/121123114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00540cb5f0 0x7f00541f5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:57.510 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.507+0000 7f005a327640 1 -- 172.21.15.105:0/121123114 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00541612f0 msgr2=0x7f0054161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:57.510 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.507+0000 7f005a327640 1 --2- 172.21.15.105:0/121123114 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00541612f0 0x7f0054161700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:57.510 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.507+0000 7f005a327640 1 -- 172.21.15.105:0/121123114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00540cb5f0 msgr2=0x7f00541f5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:57.510 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.507+0000 7f005a327640 1 --2- 172.21.15.105:0/121123114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00540cb5f0 0x7f00541f5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:57.510 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.507+0000 7f005a327640 1 -- 172.21.15.105:0/121123114 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0054161c40 con 0x7f0040003a00 2024-09-21T03:18:57.510 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.507+0000 7f005a327640 1 --2- 172.21.15.105:0/121123114 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0040003a00 0x7f005415e580 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0050036040 tx=0x7f0050033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:57.511 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.507+0000 7f004affd640 1 -- 172.21.15.105:0/121123114 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0050038040 con 0x7f0040003a00 2024-09-21T03:18:57.511 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.507+0000 7f004affd640 1 -- 172.21.15.105:0/121123114 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0050004020 con 0x7f0040003a00 2024-09-21T03:18:57.511 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.507+0000 7f004affd640 1 -- 172.21.15.105:0/121123114 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0050004470 con 0x7f0040003a00 2024-09-21T03:18:57.511 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.507+0000 7f005c58b640 1 -- 172.21.15.105:0/121123114 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00541f6080 con 0x7f0040003a00 2024-09-21T03:18:57.511 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.507+0000 7f005c58b640 1 -- 172.21.15.105:0/121123114 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00540c9e00 con 0x7f0040003a00 2024-09-21T03:18:57.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.509+0000 7f005c58b640 1 -- 172.21.15.105:0/121123114 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f005415efc0 con 0x7f0040003a00 2024-09-21T03:18:57.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.509+0000 7f004affd640 1 -- 172.21.15.105:0/121123114 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0050045020 con 0x7f0040003a00 2024-09-21T03:18:57.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.509+0000 7f004affd640 1 --2- 172.21.15.105:0/121123114 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0038078b90 0x7f003807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:57.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.510+0000 7f004affd640 1 -- 172.21.15.105:0/121123114 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f00500bb710 con 0x7f0040003a00 2024-09-21T03:18:57.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.510+0000 7f0059b26640 1 --2- 172.21.15.105:0/121123114 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0038078b90 0x7f003807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:57.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.510+0000 7f0059b26640 1 --2- 172.21.15.105:0/121123114 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0038078b90 0x7f003807b0a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0044001eb0 tx=0x7f0044000f70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:57.515 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.514+0000 7f004affd640 1 -- 172.21.15.105:0/121123114 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0054161c40 con 0x7f0040003a00 2024-09-21T03:18:57.702 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.701+0000 7f005c58b640 1 -- 172.21.15.105:0/121123114 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f005406eab0 con 0x7f0040003a00 2024-09-21T03:18:57.703 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.701+0000 7f004affd640 1 -- 172.21.15.105:0/121123114 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f0050083c70 con 0x7f0040003a00 2024-09-21T03:18:57.703 INFO:teuthology.orchestra.run.smithi105.stderr:listed 0 entries 2024-09-21T03:18:57.705 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.703+0000 7f005c58b640 1 -- 172.21.15.105:0/121123114 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0038078b90 msgr2=0x7f003807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:57.705 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.703+0000 7f005c58b640 1 --2- 172.21.15.105:0/121123114 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0038078b90 0x7f003807b0a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0044001eb0 tx=0x7f0044000f70 comp rx=0 tx=0).stop 2024-09-21T03:18:57.705 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.703+0000 7f005c58b640 1 -- 172.21.15.105:0/121123114 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0040003a00 msgr2=0x7f005415e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:57.705 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.703+0000 7f005c58b640 1 --2- 172.21.15.105:0/121123114 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0040003a00 0x7f005415e580 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0050036040 tx=0x7f0050033670 comp rx=0 tx=0).stop 2024-09-21T03:18:57.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.703+0000 7f005c58b640 1 -- 172.21.15.105:0/121123114 shutdown_connections 2024-09-21T03:18:57.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.703+0000 7f005c58b640 1 --2- 172.21.15.105:0/121123114 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0038078b90 0x7f003807b0a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:57.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.703+0000 7f005c58b640 1 --2- 172.21.15.105:0/121123114 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00541612f0 0x7f0054161700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:57.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.703+0000 7f005c58b640 1 --2- 172.21.15.105:0/121123114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00540cb5f0 0x7f00541f5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:57.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.703+0000 7f005c58b640 1 --2- 172.21.15.105:0/121123114 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0040003a00 0x7f005415e580 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:57.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.703+0000 7f005c58b640 1 -- 172.21.15.105:0/121123114 >> 172.21.15.105:0/121123114 conn(0x7f005409d7f0 msgr2=0x7f005415f310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:57.707 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.703+0000 7f005c58b640 1 -- 172.21.15.105:0/121123114 shutdown_connections 2024-09-21T03:18:57.707 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:57.703+0000 7f005c58b640 1 -- 172.21.15.105:0/121123114 wait complete. 2024-09-21T03:18:57.716 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T03:18:57.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:57.716 DEBUG:teuthology.orchestra.run.smithi105:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-21T03:18:57.741 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi105.front.sepia.ceph.com 2024-09-21T03:18:57.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:57.742 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T03:18:57.801 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:18:57.802 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:18:57.822 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:18:57.822 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:18:57.881 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:18:57.881 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:18:57.940 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T03:18:58.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.051+0000 7f097ae7e640 1 -- 172.21.15.105:0/3809389280 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09740b0520 msgr2=0x7f0974071650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:58.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.051+0000 7f097ae7e640 1 --2- 172.21.15.105:0/3809389280 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09740b0520 0x7f0974071650 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0968005fd0 tx=0x7f096802a8b0 comp rx=0 tx=0).stop 2024-09-21T03:18:58.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.051+0000 7f097ae7e640 1 -- 172.21.15.105:0/3809389280 shutdown_connections 2024-09-21T03:18:58.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.051+0000 7f097ae7e640 1 --2- 172.21.15.105:0/3809389280 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09740b0520 0x7f0974071650 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:58.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.051+0000 7f097ae7e640 1 --2- 172.21.15.105:0/3809389280 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f097415b8f0 0x7f09740cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:58.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.051+0000 7f097ae7e640 1 -- 172.21.15.105:0/3809389280 >> 172.21.15.105:0/3809389280 conn(0x7f09740cdcb0 msgr2=0x7f09740ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:58.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.051+0000 7f097ae7e640 1 -- 172.21.15.105:0/3809389280 shutdown_connections 2024-09-21T03:18:58.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.051+0000 7f097ae7e640 1 -- 172.21.15.105:0/3809389280 wait complete. 2024-09-21T03:18:58.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.053+0000 7f097ae7e640 1 Processor -- start 2024-09-21T03:18:58.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.053+0000 7f097ae7e640 1 -- start start 2024-09-21T03:18:58.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.055+0000 7f097ae7e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09740b0520 0x7f09741f7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:58.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.055+0000 7f097ae7e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09740b2cb0 0x7f097415a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:58.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.055+0000 7f097ae7e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f097415b8f0 0x7f097406cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:58.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.055+0000 7f097ae7e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f09740ae330 con 0x7f09740b0520 2024-09-21T03:18:58.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.055+0000 7f097ae7e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f09740ae1b0 con 0x7f09740b2cb0 2024-09-21T03:18:58.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.055+0000 7f097ae7e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f09740ae4b0 con 0x7f097415b8f0 2024-09-21T03:18:58.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.055+0000 7f0978c1a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09740b0520 0x7f09741f7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:58.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.055+0000 7f0978c1a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09740b0520 0x7f09741f7920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58636/0 (socket says 172.21.15.105:58636) 2024-09-21T03:18:58.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.055+0000 7f0978c1a640 1 -- 172.21.15.105:0/458362738 learned_addr learned my addr 172.21.15.105:0/458362738 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:58.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.055+0000 7f0973fff640 1 --2- 172.21.15.105:0/458362738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09740b2cb0 0x7f097415a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:58.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.055+0000 7f097941b640 1 --2- 172.21.15.105:0/458362738 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f097415b8f0 0x7f097406cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:58.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.055+0000 7f0978c1a640 1 -- 172.21.15.105:0/458362738 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f097415b8f0 msgr2=0x7f097406cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:58.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.055+0000 7f0978c1a640 1 --2- 172.21.15.105:0/458362738 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f097415b8f0 0x7f097406cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:58.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.055+0000 7f0978c1a640 1 -- 172.21.15.105:0/458362738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09740b2cb0 msgr2=0x7f097415a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:58.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.055+0000 7f0978c1a640 1 --2- 172.21.15.105:0/458362738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09740b2cb0 0x7f097415a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:58.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.055+0000 7f0978c1a640 1 -- 172.21.15.105:0/458362738 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f097409d510 con 0x7f09740b0520 2024-09-21T03:18:58.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.055+0000 7f0978c1a640 1 --2- 172.21.15.105:0/458362738 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09740b0520 0x7f09741f7920 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f096400e9f0 tx=0x7f096400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:58.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.055+0000 7f09717fa640 1 -- 172.21.15.105:0/458362738 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f096400cd80 con 0x7f09740b0520 2024-09-21T03:18:58.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.056+0000 7f09717fa640 1 -- 172.21.15.105:0/458362738 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0964004020 con 0x7f09740b0520 2024-09-21T03:18:58.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.056+0000 7f097ae7e640 1 -- 172.21.15.105:0/458362738 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f097409d7f0 con 0x7f09740b0520 2024-09-21T03:18:58.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.056+0000 7f09717fa640 1 -- 172.21.15.105:0/458362738 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0964004450 con 0x7f09740b0520 2024-09-21T03:18:58.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.056+0000 7f097ae7e640 1 -- 172.21.15.105:0/458362738 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f097415aeb0 con 0x7f09740b0520 2024-09-21T03:18:58.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.056+0000 7f097ae7e640 1 -- 172.21.15.105:0/458362738 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0974071650 con 0x7f09740b0520 2024-09-21T03:18:58.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.057+0000 7f09717fa640 1 -- 172.21.15.105:0/458362738 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f09640035f0 con 0x7f09740b0520 2024-09-21T03:18:58.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.058+0000 7f09717fa640 1 --2- 172.21.15.105:0/458362738 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0960078bc0 0x7f096007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:58.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.058+0000 7f09717fa640 1 -- 172.21.15.105:0/458362738 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f096409b4b0 con 0x7f09740b0520 2024-09-21T03:18:58.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.058+0000 7f0973fff640 1 --2- 172.21.15.105:0/458362738 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0960078bc0 0x7f096007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:58.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.059+0000 7f0973fff640 1 --2- 172.21.15.105:0/458362738 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0960078bc0 0x7f096007b0d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0968034000 tx=0x7f0968004ab0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:58.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.062+0000 7f09717fa640 1 -- 172.21.15.105:0/458362738 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0964063330 con 0x7f09740b0520 2024-09-21T03:18:58.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.250+0000 7f097ae7e640 1 -- 172.21.15.105:0/458362738 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f09740d1d70 con 0x7f09740b0520 2024-09-21T03:18:58.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.250+0000 7f09717fa640 1 -- 172.21.15.105:0/458362738 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f0964067d60 con 0x7f09740b0520 2024-09-21T03:18:58.252 INFO:teuthology.orchestra.run.smithi105.stderr:listed 0 entries 2024-09-21T03:18:58.254 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.252+0000 7f097ae7e640 1 -- 172.21.15.105:0/458362738 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0960078bc0 msgr2=0x7f096007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:58.254 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.252+0000 7f097ae7e640 1 --2- 172.21.15.105:0/458362738 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0960078bc0 0x7f096007b0d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0968034000 tx=0x7f0968004ab0 comp rx=0 tx=0).stop 2024-09-21T03:18:58.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.252+0000 7f097ae7e640 1 -- 172.21.15.105:0/458362738 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09740b0520 msgr2=0x7f09741f7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:58.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.252+0000 7f097ae7e640 1 --2- 172.21.15.105:0/458362738 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09740b0520 0x7f09741f7920 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f096400e9f0 tx=0x7f096400eeb0 comp rx=0 tx=0).stop 2024-09-21T03:18:58.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.253+0000 7f097ae7e640 1 -- 172.21.15.105:0/458362738 shutdown_connections 2024-09-21T03:18:58.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.253+0000 7f097ae7e640 1 --2- 172.21.15.105:0/458362738 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0960078bc0 0x7f096007b0d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:58.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.253+0000 7f097ae7e640 1 --2- 172.21.15.105:0/458362738 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f097415b8f0 0x7f097406cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:58.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.253+0000 7f097ae7e640 1 --2- 172.21.15.105:0/458362738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09740b2cb0 0x7f097415a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:58.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.253+0000 7f097ae7e640 1 --2- 172.21.15.105:0/458362738 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09740b0520 0x7f09741f7920 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:58.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.253+0000 7f097ae7e640 1 -- 172.21.15.105:0/458362738 >> 172.21.15.105:0/458362738 conn(0x7f09740cdcb0 msgr2=0x7f09740ae980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:58.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.253+0000 7f097ae7e640 1 -- 172.21.15.105:0/458362738 shutdown_connections 2024-09-21T03:18:58.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.253+0000 7f097ae7e640 1 -- 172.21.15.105:0/458362738 wait complete. 2024-09-21T03:18:58.266 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-21T03:18:58.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:58.266 DEBUG:teuthology.orchestra.run.smithi162:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-21T03:18:58.298 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2024-09-21T03:18:58.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:58.299 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-21T03:18:58.370 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:18:58.371 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:18:58.386 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:18:58.386 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:18:58.442 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:18:58.442 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:18:58.498 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T03:18:58.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.650+0000 7f44f3e86640 1 -- 172.21.15.105:0/1795970541 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44d8003a30 msgr2=0x7f44d8003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:58.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.650+0000 7f44f3e86640 1 --2- 172.21.15.105:0/1795970541 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44d8003a30 0x7f44d8003e40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f44e8006fd0 tx=0x7f44d8005830 comp rx=0 tx=0).stop 2024-09-21T03:18:58.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.650+0000 7f44f2423640 1 -- 172.21.15.105:0/1795970541 reap_dead start 2024-09-21T03:18:58.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.650+0000 7f44f3e86640 1 -- 172.21.15.105:0/1795970541 shutdown_connections 2024-09-21T03:18:58.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.650+0000 7f44f3e86640 1 -- 172.21.15.105:0/1795970541 >> 172.21.15.105:0/1795970541 conn(0x7f44ec09d840 msgr2=0x7f44ec08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:58.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.650+0000 7f44f3e86640 1 -- 172.21.15.105:0/1795970541 shutdown_connections 2024-09-21T03:18:58.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.650+0000 7f44f3e86640 1 -- 172.21.15.105:0/1795970541 wait complete. 2024-09-21T03:18:58.653 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.652+0000 7f44f3e86640 1 Processor -- start 2024-09-21T03:18:58.653 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.652+0000 7f44f3e86640 1 -- start start 2024-09-21T03:18:58.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.653+0000 7f44f3e86640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44d8003a30 0x7f44ec0a00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:58.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.653+0000 7f44f3e86640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44ec09e1b0 0x7f44ec0cc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:58.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.653+0000 7f44f3e86640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44ec0ccb90 0x7f44ec1f8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:58.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.653+0000 7f44f3e86640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f44ec06f6e0 con 0x7f44d8003a30 2024-09-21T03:18:58.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.653+0000 7f44f3e86640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f44ec06f860 con 0x7f44ec09e1b0 2024-09-21T03:18:58.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.653+0000 7f44f3e86640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f44ec06f9e0 con 0x7f44ec0ccb90 2024-09-21T03:18:58.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.653+0000 7f44f1c22640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44d8003a30 0x7f44ec0a00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:58.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.653+0000 7f44f1c22640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44d8003a30 0x7f44ec0a00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58652/0 (socket says 172.21.15.105:58652) 2024-09-21T03:18:58.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.653+0000 7f44f1c22640 1 -- 172.21.15.105:0/2455578139 learned_addr learned my addr 172.21.15.105:0/2455578139 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:58.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.653+0000 7f44f1c22640 1 -- 172.21.15.105:0/2455578139 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44ec0ccb90 msgr2=0x7f44ec1f8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:58.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.653+0000 7f44f1c22640 1 --2- 172.21.15.105:0/2455578139 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44ec0ccb90 0x7f44ec1f8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:58.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.653+0000 7f44f1c22640 1 -- 172.21.15.105:0/2455578139 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44ec09e1b0 msgr2=0x7f44ec0cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:58.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.653+0000 7f44f1c22640 1 --2- 172.21.15.105:0/2455578139 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44ec09e1b0 0x7f44ec0cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:58.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.653+0000 7f44f1c22640 1 -- 172.21.15.105:0/2455578139 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44ec09e9a0 con 0x7f44d8003a30 2024-09-21T03:18:58.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.654+0000 7f44f1c22640 1 --2- 172.21.15.105:0/2455578139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44d8003a30 0x7f44ec0a00c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f44e8001ef0 tx=0x7f44e8003a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:58.657 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.654+0000 7f44e27fc640 1 -- 172.21.15.105:0/2455578139 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e8006250 con 0x7f44d8003a30 2024-09-21T03:18:58.657 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.654+0000 7f44e27fc640 1 -- 172.21.15.105:0/2455578139 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f44e8006500 con 0x7f44d8003a30 2024-09-21T03:18:58.657 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.654+0000 7f44f3e86640 1 -- 172.21.15.105:0/2455578139 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44ec09e6c0 con 0x7f44d8003a30 2024-09-21T03:18:58.657 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.654+0000 7f44e27fc640 1 -- 172.21.15.105:0/2455578139 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e8033480 con 0x7f44d8003a30 2024-09-21T03:18:58.657 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.654+0000 7f44f3e86640 1 -- 172.21.15.105:0/2455578139 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44ec0a0d70 con 0x7f44d8003a30 2024-09-21T03:18:58.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.655+0000 7f44f3e86640 1 -- 172.21.15.105:0/2455578139 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44ec0d0e50 con 0x7f44d8003a30 2024-09-21T03:18:58.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.655+0000 7f44e27fc640 1 -- 172.21.15.105:0/2455578139 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f44e8033620 con 0x7f44d8003a30 2024-09-21T03:18:58.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.656+0000 7f44e27fc640 1 --2- 172.21.15.105:0/2455578139 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f44d0078bc0 0x7f44d007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:58.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.656+0000 7f44e27fc640 1 -- 172.21.15.105:0/2455578139 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f44e80bb410 con 0x7f44d8003a30 2024-09-21T03:18:58.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.656+0000 7f44f1421640 1 --2- 172.21.15.105:0/2455578139 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f44d0078bc0 0x7f44d007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:58.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.657+0000 7f44f1421640 1 --2- 172.21.15.105:0/2455578139 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f44d0078bc0 0x7f44d007b0d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f44ec1f30a0 tx=0x7f44dc0011a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:58.662 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.661+0000 7f44e27fc640 1 -- 172.21.15.105:0/2455578139 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f44ec09e9a0 con 0x7f44d8003a30 2024-09-21T03:18:58.850 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.848+0000 7f44f3e86640 1 -- 172.21.15.105:0/2455578139 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f44ec0c8800 con 0x7f44d8003a30 2024-09-21T03:18:58.850 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.849+0000 7f44e27fc640 1 -- 172.21.15.105:0/2455578139 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f44e8083970 con 0x7f44d8003a30 2024-09-21T03:18:58.850 INFO:teuthology.orchestra.run.smithi105.stderr:listed 0 entries 2024-09-21T03:18:58.853 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.851+0000 7f44f3e86640 1 -- 172.21.15.105:0/2455578139 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f44d0078bc0 msgr2=0x7f44d007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:58.853 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.851+0000 7f44f3e86640 1 --2- 172.21.15.105:0/2455578139 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f44d0078bc0 0x7f44d007b0d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f44ec1f30a0 tx=0x7f44dc0011a0 comp rx=0 tx=0).stop 2024-09-21T03:18:58.853 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.851+0000 7f44f3e86640 1 -- 172.21.15.105:0/2455578139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44d8003a30 msgr2=0x7f44ec0a00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:58.853 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.851+0000 7f44f3e86640 1 --2- 172.21.15.105:0/2455578139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44d8003a30 0x7f44ec0a00c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f44e8001ef0 tx=0x7f44e8003a40 comp rx=0 tx=0).stop 2024-09-21T03:18:58.853 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.851+0000 7f44f3e86640 1 -- 172.21.15.105:0/2455578139 shutdown_connections 2024-09-21T03:18:58.853 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.851+0000 7f44f3e86640 1 --2- 172.21.15.105:0/2455578139 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f44d0078bc0 0x7f44d007b0d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:58.853 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.851+0000 7f44f3e86640 1 --2- 172.21.15.105:0/2455578139 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44ec0ccb90 0x7f44ec1f8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:58.853 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.851+0000 7f44f3e86640 1 --2- 172.21.15.105:0/2455578139 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44ec09e1b0 0x7f44ec0cc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:58.853 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.851+0000 7f44f3e86640 1 --2- 172.21.15.105:0/2455578139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44d8003a30 0x7f44ec0a00c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:58.853 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.851+0000 7f44f3e86640 1 -- 172.21.15.105:0/2455578139 >> 172.21.15.105:0/2455578139 conn(0x7f44ec09d840 msgr2=0x7f44ec0c8a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:58.853 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.851+0000 7f44f3e86640 1 -- 172.21.15.105:0/2455578139 shutdown_connections 2024-09-21T03:18:58.853 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:58.851+0000 7f44f3e86640 1 -- 172.21.15.105:0/2455578139 wait complete. 2024-09-21T03:18:58.863 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-21T03:18:58.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:58.864 DEBUG:teuthology.orchestra.run.smithi105:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-21T03:18:58.889 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi105.front.sepia.ceph.com 2024-09-21T03:18:58.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:58.890 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-21T03:18:58.945 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:18:58.945 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:18:58.964 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:18:58.964 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:18:59.023 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:18:59.023 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:18:59.081 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T03:18:59.195 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.194+0000 7f056ac4d640 1 -- 172.21.15.105:0/3948696787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f056406e170 msgr2=0x7f05640b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:59.196 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.194+0000 7f056ac4d640 1 --2- 172.21.15.105:0/3948696787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f056406e170 0x7f05640b3540 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0554009830 tx=0x7f055402a480 comp rx=0 tx=0).stop 2024-09-21T03:18:59.196 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.194+0000 7f056ac4d640 1 -- 172.21.15.105:0/3948696787 shutdown_connections 2024-09-21T03:18:59.196 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.194+0000 7f056ac4d640 1 --2- 172.21.15.105:0/3948696787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f056406e170 0x7f05640b3540 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:59.196 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.194+0000 7f056ac4d640 1 -- 172.21.15.105:0/3948696787 >> 172.21.15.105:0/3948696787 conn(0x7f056408bfc0 msgr2=0x7f056409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:59.196 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.194+0000 7f056ac4d640 1 -- 172.21.15.105:0/3948696787 shutdown_connections 2024-09-21T03:18:59.196 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.194+0000 7f056ac4d640 1 -- 172.21.15.105:0/3948696787 wait complete. 2024-09-21T03:18:59.197 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.195+0000 7f056ac4d640 1 Processor -- start 2024-09-21T03:18:59.197 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.196+0000 7f056ac4d640 1 -- start start 2024-09-21T03:18:59.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.197+0000 7f056ac4d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f056406f4b0 0x7f05640a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:59.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.197+0000 7f056ac4d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05640ceb40 0x7f05641541b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:59.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.197+0000 7f056ac4d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05641f8aa0 0x7f05641f8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:59.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.197+0000 7f056ac4d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f05640d10b0 con 0x7f05640ceb40 2024-09-21T03:18:59.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.197+0000 7f056ac4d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f05640d0f30 con 0x7f056406f4b0 2024-09-21T03:18:59.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.197+0000 7f056ac4d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f05640d1230 con 0x7f05641f8aa0 2024-09-21T03:18:59.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.197+0000 7f0563fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05640ceb40 0x7f05641541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:59.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.197+0000 7f0563fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05640ceb40 0x7f05641541b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58658/0 (socket says 172.21.15.105:58658) 2024-09-21T03:18:59.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.197+0000 7f0563fff640 1 -- 172.21.15.105:0/1985055783 learned_addr learned my addr 172.21.15.105:0/1985055783 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:59.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.197+0000 7f0563fff640 1 -- 172.21.15.105:0/1985055783 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05641f8aa0 msgr2=0x7f05641f8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:59.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.197+0000 7f0563fff640 1 --2- 172.21.15.105:0/1985055783 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05641f8aa0 0x7f05641f8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:59.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.197+0000 7f05689e9640 1 --2- 172.21.15.105:0/1985055783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f056406f4b0 0x7f05640a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:59.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.197+0000 7f0563fff640 1 -- 172.21.15.105:0/1985055783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f056406f4b0 msgr2=0x7f05640a1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:59.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.197+0000 7f0563fff640 1 --2- 172.21.15.105:0/1985055783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f056406f4b0 0x7f05640a1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:59.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.197+0000 7f0563fff640 1 -- 172.21.15.105:0/1985055783 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05641f93f0 con 0x7f05640ceb40 2024-09-21T03:18:59.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.197+0000 7f05689e9640 1 --2- 172.21.15.105:0/1985055783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f056406f4b0 0x7f05640a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:18:59.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.198+0000 7f0563fff640 1 --2- 172.21.15.105:0/1985055783 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05640ceb40 0x7f05641541b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f055800b3e0 tx=0x7f055800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:59.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.198+0000 7f05617fa640 1 -- 172.21.15.105:0/1985055783 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0558015020 con 0x7f05640ceb40 2024-09-21T03:18:59.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.198+0000 7f05617fa640 1 -- 172.21.15.105:0/1985055783 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0558011920 con 0x7f05640ceb40 2024-09-21T03:18:59.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.198+0000 7f056ac4d640 1 -- 172.21.15.105:0/1985055783 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05641546f0 con 0x7f05640ceb40 2024-09-21T03:18:59.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.198+0000 7f05617fa640 1 -- 172.21.15.105:0/1985055783 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0558011d70 con 0x7f05640ceb40 2024-09-21T03:18:59.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.198+0000 7f056ac4d640 1 -- 172.21.15.105:0/1985055783 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05640b41a0 con 0x7f05640ceb40 2024-09-21T03:18:59.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.199+0000 7f056ac4d640 1 -- 172.21.15.105:0/1985055783 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05640d0200 con 0x7f05640ceb40 2024-09-21T03:18:59.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.200+0000 7f05617fa640 1 -- 172.21.15.105:0/1985055783 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0558018020 con 0x7f05640ceb40 2024-09-21T03:18:59.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.200+0000 7f05617fa640 1 --2- 172.21.15.105:0/1985055783 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0550078bc0 0x7f055007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:59.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.200+0000 7f05617fa640 1 -- 172.21.15.105:0/1985055783 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f055809ac30 con 0x7f05640ceb40 2024-09-21T03:18:59.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.200+0000 7f05689e9640 1 --2- 172.21.15.105:0/1985055783 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0550078bc0 0x7f055007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:59.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.201+0000 7f05689e9640 1 --2- 172.21.15.105:0/1985055783 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0550078bc0 0x7f055007b0d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0554034000 tx=0x7f0554004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:59.206 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.205+0000 7f05617fa640 1 -- 172.21.15.105:0/1985055783 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f05640d0200 con 0x7f05640ceb40 2024-09-21T03:18:59.393 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.392+0000 7f056ac4d640 1 -- 172.21.15.105:0/1985055783 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f05640cafc0 con 0x7f05640ceb40 2024-09-21T03:18:59.393 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.392+0000 7f05617fa640 1 -- 172.21.15.105:0/1985055783 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f055801f020 con 0x7f05640ceb40 2024-09-21T03:18:59.394 INFO:teuthology.orchestra.run.smithi105.stderr:listed 0 entries 2024-09-21T03:18:59.396 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.394+0000 7f056ac4d640 1 -- 172.21.15.105:0/1985055783 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0550078bc0 msgr2=0x7f055007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:59.396 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.394+0000 7f056ac4d640 1 --2- 172.21.15.105:0/1985055783 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0550078bc0 0x7f055007b0d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0554034000 tx=0x7f0554004730 comp rx=0 tx=0).stop 2024-09-21T03:18:59.396 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.394+0000 7f056ac4d640 1 -- 172.21.15.105:0/1985055783 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05640ceb40 msgr2=0x7f05641541b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:59.396 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.394+0000 7f056ac4d640 1 --2- 172.21.15.105:0/1985055783 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05640ceb40 0x7f05641541b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f055800b3e0 tx=0x7f055800b8a0 comp rx=0 tx=0).stop 2024-09-21T03:18:59.396 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.394+0000 7f056ac4d640 1 -- 172.21.15.105:0/1985055783 shutdown_connections 2024-09-21T03:18:59.396 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.394+0000 7f056ac4d640 1 --2- 172.21.15.105:0/1985055783 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0550078bc0 0x7f055007b0d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:59.396 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.394+0000 7f056ac4d640 1 --2- 172.21.15.105:0/1985055783 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05641f8aa0 0x7f05641f8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:59.396 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.394+0000 7f056ac4d640 1 --2- 172.21.15.105:0/1985055783 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05640ceb40 0x7f05641541b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:59.396 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.394+0000 7f056ac4d640 1 --2- 172.21.15.105:0/1985055783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f056406f4b0 0x7f05640a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:59.397 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.394+0000 7f056ac4d640 1 -- 172.21.15.105:0/1985055783 >> 172.21.15.105:0/1985055783 conn(0x7f056408bfc0 msgr2=0x7f05640b8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:59.397 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.394+0000 7f056ac4d640 1 -- 172.21.15.105:0/1985055783 shutdown_connections 2024-09-21T03:18:59.397 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.394+0000 7f056ac4d640 1 -- 172.21.15.105:0/1985055783 wait complete. 2024-09-21T03:18:59.407 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-21T03:18:59.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:59.407 DEBUG:teuthology.orchestra.run.smithi162:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-21T03:18:59.439 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2024-09-21T03:18:59.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:18:59.439 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-21T03:18:59.497 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T03:18:59.497 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:18:59.609 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.608+0000 7f21414a4640 1 -- 172.21.15.105:0/4036448076 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f213c0cd360 msgr2=0x7f213c15c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:59.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.608+0000 7f21414a4640 1 --2- 172.21.15.105:0/4036448076 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f213c0cd360 0x7f213c15c6a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f213c0d22c0 tx=0x7f212c02a820 comp rx=0 tx=0).stop 2024-09-21T03:18:59.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.608+0000 7f21414a4640 1 -- 172.21.15.105:0/4036448076 shutdown_connections 2024-09-21T03:18:59.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.608+0000 7f21414a4640 1 --2- 172.21.15.105:0/4036448076 >> v2:172.21.15.162:3300/0 conn(0x7f213c0b7fe0 0x7f213c0ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:59.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.608+0000 7f21414a4640 1 --2- 172.21.15.105:0/4036448076 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f213c0cd360 0x7f213c15c6a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:59.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.608+0000 7f21414a4640 1 -- 172.21.15.105:0/4036448076 >> 172.21.15.105:0/4036448076 conn(0x7f213c0710b0 msgr2=0x7f213c0714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:59.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.608+0000 7f21414a4640 1 -- 172.21.15.105:0/4036448076 shutdown_connections 2024-09-21T03:18:59.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.608+0000 7f21414a4640 1 -- 172.21.15.105:0/4036448076 wait complete. 2024-09-21T03:18:59.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.610+0000 7f21414a4640 1 Processor -- start 2024-09-21T03:18:59.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.610+0000 7f21414a4640 1 -- start start 2024-09-21T03:18:59.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.611+0000 7f21414a4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f213c0b7fe0 0x7f213c1f7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:59.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.611+0000 7f21414a4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f213c0cd360 0x7f213c151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:59.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.611+0000 7f21414a4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f213c0cf270 0x7f213c0b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:59.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.611+0000 7f21414a4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f213c072f60 con 0x7f213c0cf270 2024-09-21T03:18:59.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.611+0000 7f21414a4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f213c0d13b0 con 0x7f213c0b7fe0 2024-09-21T03:18:59.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.611+0000 7f21414a4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f213c0730e0 con 0x7f213c0cd360 2024-09-21T03:18:59.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.611+0000 7f213b7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f213c0cf270 0x7f213c0b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:59.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.611+0000 7f213b7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f213c0cf270 0x7f213c0b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58682/0 (socket says 172.21.15.105:58682) 2024-09-21T03:18:59.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.611+0000 7f213b7fe640 1 -- 172.21.15.105:0/1455657679 learned_addr learned my addr 172.21.15.105:0/1455657679 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:59.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.611+0000 7f213affd640 1 --2- 172.21.15.105:0/1455657679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f213c0b7fe0 0x7f213c1f7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:59.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.611+0000 7f213a7fc640 1 --2- 172.21.15.105:0/1455657679 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f213c0cd360 0x7f213c151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:59.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.611+0000 7f213b7fe640 1 -- 172.21.15.105:0/1455657679 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f213c0cd360 msgr2=0x7f213c151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:59.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.611+0000 7f213b7fe640 1 --2- 172.21.15.105:0/1455657679 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f213c0cd360 0x7f213c151480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:59.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.611+0000 7f213b7fe640 1 -- 172.21.15.105:0/1455657679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f213c0b7fe0 msgr2=0x7f213c1f7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:59.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.611+0000 7f213b7fe640 1 --2- 172.21.15.105:0/1455657679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f213c0b7fe0 0x7f213c1f7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:59.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.611+0000 7f213b7fe640 1 -- 172.21.15.105:0/1455657679 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f213c0c8380 con 0x7f213c0cf270 2024-09-21T03:18:59.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.611+0000 7f213b7fe640 1 --2- 172.21.15.105:0/1455657679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f213c0cf270 0x7f213c0b2fd0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f213400c3c0 tx=0x7f213400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:59.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.612+0000 7f21237fe640 1 -- 172.21.15.105:0/1455657679 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2134017070 con 0x7f213c0cf270 2024-09-21T03:18:59.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.612+0000 7f21237fe640 1 -- 172.21.15.105:0/1455657679 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21340035f0 con 0x7f213c0cf270 2024-09-21T03:18:59.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.612+0000 7f21414a4640 1 -- 172.21.15.105:0/1455657679 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f213c0c8660 con 0x7f213c0cf270 2024-09-21T03:18:59.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.612+0000 7f21237fe640 1 -- 172.21.15.105:0/1455657679 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2134003a40 con 0x7f213c0cf270 2024-09-21T03:18:59.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.612+0000 7f21414a4640 1 -- 172.21.15.105:0/1455657679 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f213c0c8c20 con 0x7f213c0cf270 2024-09-21T03:18:59.616 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.613+0000 7f21414a4640 1 -- 172.21.15.105:0/1455657679 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f213c06a5e0 con 0x7f213c0cf270 2024-09-21T03:18:59.616 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.613+0000 7f21237fe640 1 -- 172.21.15.105:0/1455657679 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f213401a070 con 0x7f213c0cf270 2024-09-21T03:18:59.616 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.614+0000 7f21237fe640 1 --2- 172.21.15.105:0/1455657679 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2128078b90 0x7f212807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:59.616 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.614+0000 7f21237fe640 1 -- 172.21.15.105:0/1455657679 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2134099e40 con 0x7f213c0cf270 2024-09-21T03:18:59.617 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.614+0000 7f213affd640 1 --2- 172.21.15.105:0/1455657679 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2128078b90 0x7f212807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:59.617 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.615+0000 7f213affd640 1 --2- 172.21.15.105:0/1455657679 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2128078b90 0x7f212807b0a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f212c034000 tx=0x7f212c004ab0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:59.620 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.618+0000 7f21237fe640 1 -- 172.21.15.105:0/1455657679 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f213c0cf680 con 0x7f213c0cf270 2024-09-21T03:18:59.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.831+0000 7f21414a4640 1 -- 172.21.15.105:0/1455657679 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f213c160910 con 0x7f213c0cf270 2024-09-21T03:18:59.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.831+0000 7f21237fe640 1 -- 172.21.15.105:0/1455657679 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5220 (secure 0 0 0) 0x7f2134061cc0 con 0x7f213c0cf270 2024-09-21T03:18:59.833 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:18:59.833 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":8,"btime":"2024-09-21T03:18:33:412826+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/950623322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":950623322},{"type":"v1","addr":"172.21.15.105:6833","nonce":950623322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/982475612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":982475612},{"type":"v1","addr":"172.21.15.162:6837","nonce":982475612}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4389,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/940371702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":940371702},{"type":"v1","addr":"172.21.15.105:6835","nonce":940371702}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:18:29.756592+0000","modified":"2024-09-21T03:18:32.767916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4401},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4401":{"gid":4401,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6836/1998709636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1998709636},{"type":"v1","addr":"172.21.15.162:6836","nonce":1998709636}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4401,"qdb_cluster":[4401]},"id":1}]} 2024-09-21T03:18:59.833 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 8 2024-09-21T03:18:59.835 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.833+0000 7f21414a4640 1 -- 172.21.15.105:0/1455657679 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2128078b90 msgr2=0x7f212807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:59.835 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.833+0000 7f21414a4640 1 --2- 172.21.15.105:0/1455657679 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2128078b90 0x7f212807b0a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f212c034000 tx=0x7f212c004ab0 comp rx=0 tx=0).stop 2024-09-21T03:18:59.835 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.833+0000 7f21414a4640 1 -- 172.21.15.105:0/1455657679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f213c0cf270 msgr2=0x7f213c0b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:59.835 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.833+0000 7f21414a4640 1 --2- 172.21.15.105:0/1455657679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f213c0cf270 0x7f213c0b2fd0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f213400c3c0 tx=0x7f213400c880 comp rx=0 tx=0).stop 2024-09-21T03:18:59.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.833+0000 7f21414a4640 1 -- 172.21.15.105:0/1455657679 shutdown_connections 2024-09-21T03:18:59.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.834+0000 7f21414a4640 1 --2- 172.21.15.105:0/1455657679 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2128078b90 0x7f212807b0a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:59.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.834+0000 7f21414a4640 1 --2- 172.21.15.105:0/1455657679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f213c0cf270 0x7f213c0b2fd0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:59.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.834+0000 7f21414a4640 1 --2- 172.21.15.105:0/1455657679 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f213c0cd360 0x7f213c151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:59.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.834+0000 7f21414a4640 1 --2- 172.21.15.105:0/1455657679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f213c0b7fe0 0x7f213c1f7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:59.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.834+0000 7f21414a4640 1 -- 172.21.15.105:0/1455657679 >> 172.21.15.105:0/1455657679 conn(0x7f213c0710b0 msgr2=0x7f213c15bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:59.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.834+0000 7f21414a4640 1 -- 172.21.15.105:0/1455657679 shutdown_connections 2024-09-21T03:18:59.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.834+0000 7f21414a4640 1 -- 172.21.15.105:0/1455657679 wait complete. 2024-09-21T03:18:59.847 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:18:59.958 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.956+0000 7f0da1989640 1 -- 172.21.15.105:0/1135080878 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d9c0b9b60 msgr2=0x7f0d9c0d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:59.958 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.956+0000 7f0da1989640 1 --2- 172.21.15.105:0/1135080878 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d9c0b9b60 0x7f0d9c0d0fb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c0d4470 tx=0x7f0d8c02a4d0 comp rx=0 tx=0).stop 2024-09-21T03:18:59.958 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.956+0000 7f0da1989640 1 -- 172.21.15.105:0/1135080878 shutdown_connections 2024-09-21T03:18:59.958 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.956+0000 7f0da1989640 1 --2- 172.21.15.105:0/1135080878 >> v2:172.21.15.162:3300/0 conn(0x7f0d9c162430 0x7f0d9c162840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:59.959 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.956+0000 7f0da1989640 1 --2- 172.21.15.105:0/1135080878 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d9c0b3a10 0x7f0d9c0d14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:59.959 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.956+0000 7f0da1989640 1 --2- 172.21.15.105:0/1135080878 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d9c0b9b60 0x7f0d9c0d0fb0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:59.959 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.956+0000 7f0da1989640 1 -- 172.21.15.105:0/1135080878 >> 172.21.15.105:0/1135080878 conn(0x7f0d9c09d8f0 msgr2=0x7f0d9c0d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:18:59.959 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.956+0000 7f0da1989640 1 -- 172.21.15.105:0/1135080878 shutdown_connections 2024-09-21T03:18:59.959 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.956+0000 7f0da1989640 1 -- 172.21.15.105:0/1135080878 wait complete. 2024-09-21T03:18:59.959 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.958+0000 7f0da1989640 1 Processor -- start 2024-09-21T03:18:59.960 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.958+0000 7f0da1989640 1 -- start start 2024-09-21T03:18:59.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.960+0000 7f0da1989640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d9c0b3a10 0x7f0d9c0caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:59.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.960+0000 7f0da1989640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d9c0b9b60 0x7f0d9c1f9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:59.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.960+0000 7f0da1989640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d9c162430 0x7f0d9c15cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:59.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.960+0000 7f0da1989640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c163110 con 0x7f0d9c0b3a10 2024-09-21T03:18:59.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.960+0000 7f0da1989640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c162f90 con 0x7f0d9c162430 2024-09-21T03:18:59.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.960+0000 7f0da1989640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0d9c163290 con 0x7f0d9c0b9b60 2024-09-21T03:18:59.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.960+0000 7f0d9affd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d9c0b3a10 0x7f0d9c0caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:59.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.960+0000 7f0d9affd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d9c0b3a10 0x7f0d9c0caaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58696/0 (socket says 172.21.15.105:58696) 2024-09-21T03:18:59.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.960+0000 7f0d9affd640 1 -- 172.21.15.105:0/439227773 learned_addr learned my addr 172.21.15.105:0/439227773 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:18:59.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.960+0000 7f0d9b7fe640 1 --2- 172.21.15.105:0/439227773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d9c162430 0x7f0d9c15cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:59.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.960+0000 7f0d927fc640 1 --2- 172.21.15.105:0/439227773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d9c0b9b60 0x7f0d9c1f9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:59.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.960+0000 7f0d9affd640 1 -- 172.21.15.105:0/439227773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d9c0b9b60 msgr2=0x7f0d9c1f9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:59.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.960+0000 7f0d9affd640 1 --2- 172.21.15.105:0/439227773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d9c0b9b60 0x7f0d9c1f9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:59.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.960+0000 7f0d9affd640 1 -- 172.21.15.105:0/439227773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d9c162430 msgr2=0x7f0d9c15cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:18:59.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.960+0000 7f0d9affd640 1 --2- 172.21.15.105:0/439227773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d9c162430 0x7f0d9c15cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:18:59.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.960+0000 7f0d9affd640 1 -- 172.21.15.105:0/439227773 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d9c1fa3d0 con 0x7f0d9c0b3a10 2024-09-21T03:18:59.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.960+0000 7f0d9affd640 1 --2- 172.21.15.105:0/439227773 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d9c0b3a10 0x7f0d9c0caaa0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c034040 tx=0x7f0d8c0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:59.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.960+0000 7f0d98ff9640 1 -- 172.21.15.105:0/439227773 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c03e030 con 0x7f0d9c0b3a10 2024-09-21T03:18:59.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.960+0000 7f0d98ff9640 1 -- 172.21.15.105:0/439227773 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0d8c0047a0 con 0x7f0d9c0b3a10 2024-09-21T03:18:59.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.960+0000 7f0da1989640 1 -- 172.21.15.105:0/439227773 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d9c0b5aa0 con 0x7f0d9c0b3a10 2024-09-21T03:18:59.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.960+0000 7f0d98ff9640 1 -- 172.21.15.105:0/439227773 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c035040 con 0x7f0d9c0b3a10 2024-09-21T03:18:59.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.960+0000 7f0da1989640 1 -- 172.21.15.105:0/439227773 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d9c1f69c0 con 0x7f0d9c0b3a10 2024-09-21T03:18:59.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.961+0000 7f0da1989640 1 -- 172.21.15.105:0/439227773 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d9c162840 con 0x7f0d9c0b3a10 2024-09-21T03:18:59.965 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.962+0000 7f0d98ff9640 1 -- 172.21.15.105:0/439227773 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0d8c041030 con 0x7f0d9c0b3a10 2024-09-21T03:18:59.965 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.962+0000 7f0d98ff9640 1 --2- 172.21.15.105:0/439227773 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0d7c078bc0 0x7f0d7c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:18:59.965 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.963+0000 7f0d98ff9640 1 -- 172.21.15.105:0/439227773 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0d8c0bb620 con 0x7f0d9c0b3a10 2024-09-21T03:18:59.965 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.963+0000 7f0d927fc640 1 --2- 172.21.15.105:0/439227773 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0d7c078bc0 0x7f0d7c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:18:59.965 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.963+0000 7f0d927fc640 1 --2- 172.21.15.105:0/439227773 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0d7c078bc0 0x7f0d7c07b0d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c1ec210 tx=0x7f0d84005d70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:18:59.968 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:18:59.967+0000 7f0d98ff9640 1 -- 172.21.15.105:0/439227773 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0d8c0839e0 con 0x7f0d9c0b3a10 2024-09-21T03:19:00.182 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.181+0000 7f0da1989640 1 -- 172.21.15.105:0/439227773 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d9c0ba0d0 con 0x7f0d9c0b3a10 2024-09-21T03:19:00.183 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.181+0000 7f0d98ff9640 1 -- 172.21.15.105:0/439227773 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5220 (secure 0 0 0) 0x7f0d8c0832e0 con 0x7f0d9c0b3a10 2024-09-21T03:19:00.183 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:19:00.184 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":8,"btime":"2024-09-21T03:18:33:412826+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/950623322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":950623322},{"type":"v1","addr":"172.21.15.105:6833","nonce":950623322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/982475612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":982475612},{"type":"v1","addr":"172.21.15.162:6837","nonce":982475612}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4389,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/940371702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":940371702},{"type":"v1","addr":"172.21.15.105:6835","nonce":940371702}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:18:29.756592+0000","modified":"2024-09-21T03:18:32.767916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4401},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4401":{"gid":4401,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6836/1998709636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1998709636},{"type":"v1","addr":"172.21.15.162:6836","nonce":1998709636}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4401,"qdb_cluster":[4401]},"id":1}]} 2024-09-21T03:19:00.184 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 8 2024-09-21T03:19:00.185 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.184+0000 7f0da1989640 1 -- 172.21.15.105:0/439227773 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0d7c078bc0 msgr2=0x7f0d7c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:00.185 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.184+0000 7f0da1989640 1 --2- 172.21.15.105:0/439227773 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0d7c078bc0 0x7f0d7c07b0d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c1ec210 tx=0x7f0d84005d70 comp rx=0 tx=0).stop 2024-09-21T03:19:00.186 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.184+0000 7f0da1989640 1 -- 172.21.15.105:0/439227773 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d9c0b3a10 msgr2=0x7f0d9c0caaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:00.186 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.184+0000 7f0da1989640 1 --2- 172.21.15.105:0/439227773 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d9c0b3a10 0x7f0d9c0caaa0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c034040 tx=0x7f0d8c0039e0 comp rx=0 tx=0).stop 2024-09-21T03:19:00.186 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.184+0000 7f0da1989640 1 -- 172.21.15.105:0/439227773 shutdown_connections 2024-09-21T03:19:00.186 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.184+0000 7f0da1989640 1 --2- 172.21.15.105:0/439227773 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0d7c078bc0 0x7f0d7c07b0d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:00.186 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.184+0000 7f0da1989640 1 --2- 172.21.15.105:0/439227773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d9c162430 0x7f0d9c15cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:00.186 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.184+0000 7f0da1989640 1 --2- 172.21.15.105:0/439227773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d9c0b9b60 0x7f0d9c1f9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:00.186 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.184+0000 7f0da1989640 1 --2- 172.21.15.105:0/439227773 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d9c0b3a10 0x7f0d9c0caaa0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:00.186 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.184+0000 7f0da1989640 1 -- 172.21.15.105:0/439227773 >> 172.21.15.105:0/439227773 conn(0x7f0d9c09d8f0 msgr2=0x7f0d9c0b7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:00.186 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.184+0000 7f0da1989640 1 -- 172.21.15.105:0/439227773 shutdown_connections 2024-09-21T03:19:00.186 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.184+0000 7f0da1989640 1 -- 172.21.15.105:0/439227773 wait complete. 2024-09-21T03:19:00.196 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:19:00.309 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.307+0000 7f3ad2a0a640 1 -- 172.21.15.105:0/3108608565 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3acc0d2630 msgr2=0x7f3acc15d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:00.309 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.307+0000 7f3ad2a0a640 1 --2- 172.21.15.105:0/3108608565 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3acc0d2630 0x7f3acc15d130 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3acc074e30 tx=0x7f3ac002a530 comp rx=0 tx=0).stop 2024-09-21T03:19:00.310 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.307+0000 7f3ad2a0a640 1 -- 172.21.15.105:0/3108608565 shutdown_connections 2024-09-21T03:19:00.310 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.307+0000 7f3ad2a0a640 1 --2- 172.21.15.105:0/3108608565 >> v2:172.21.15.162:3300/0 conn(0x7f3acc15d670 0x7f3acc0b7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:00.310 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.307+0000 7f3ad2a0a640 1 --2- 172.21.15.105:0/3108608565 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3acc0d2630 0x7f3acc15d130 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:00.310 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.307+0000 7f3ad2a0a640 1 -- 172.21.15.105:0/3108608565 >> 172.21.15.105:0/3108608565 conn(0x7f3acc06d550 msgr2=0x7f3acc071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:00.310 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.307+0000 7f3ad2a0a640 1 -- 172.21.15.105:0/3108608565 shutdown_connections 2024-09-21T03:19:00.310 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.307+0000 7f3ad2a0a640 1 -- 172.21.15.105:0/3108608565 wait complete. 2024-09-21T03:19:00.311 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.309+0000 7f3ad2a0a640 1 Processor -- start 2024-09-21T03:19:00.311 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.309+0000 7f3ad2a0a640 1 -- start start 2024-09-21T03:19:00.315 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.310+0000 7f3ad2a0a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3acc1570e0 0x7f3acc14ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:00.315 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.310+0000 7f3ad2a0a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3acc15d670 0x7f3acc154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:00.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.310+0000 7f3ad2a0a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3acc14f340 0x7f3acc155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:00.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.310+0000 7f3ad2a0a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3acc0b7d60 con 0x7f3acc1570e0 2024-09-21T03:19:00.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.310+0000 7f3ad2a0a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3acc0b7be0 con 0x7f3acc14f340 2024-09-21T03:19:00.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.310+0000 7f3ad2a0a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3acc0b7ee0 con 0x7f3acc15d670 2024-09-21T03:19:00.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.310+0000 7f3acbfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3acc1570e0 0x7f3acc14ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:00.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.310+0000 7f3acbfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3acc1570e0 0x7f3acc14ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58706/0 (socket says 172.21.15.105:58706) 2024-09-21T03:19:00.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.310+0000 7f3acbfff640 1 -- 172.21.15.105:0/3881362419 learned_addr learned my addr 172.21.15.105:0/3881362419 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:00.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.310+0000 7f3acb7fe640 1 --2- 172.21.15.105:0/3881362419 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3acc15d670 0x7f3acc154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:00.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.311+0000 7f3ad0fa7640 1 --2- 172.21.15.105:0/3881362419 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3acc14f340 0x7f3acc155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:00.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.311+0000 7f3acbfff640 1 -- 172.21.15.105:0/3881362419 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3acc15d670 msgr2=0x7f3acc154de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:00.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.311+0000 7f3acbfff640 1 --2- 172.21.15.105:0/3881362419 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3acc15d670 0x7f3acc154de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:00.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.311+0000 7f3acbfff640 1 -- 172.21.15.105:0/3881362419 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3acc14f340 msgr2=0x7f3acc155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:00.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.311+0000 7f3acbfff640 1 --2- 172.21.15.105:0/3881362419 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3acc14f340 0x7f3acc155320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:00.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.311+0000 7f3acbfff640 1 -- 172.21.15.105:0/3881362419 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3acc14f0f0 con 0x7f3acc1570e0 2024-09-21T03:19:00.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.311+0000 7f3ad0fa7640 1 --2- 172.21.15.105:0/3881362419 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3acc14f340 0x7f3acc155320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:19:00.318 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.311+0000 7f3acbfff640 1 --2- 172.21.15.105:0/3881362419 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3acc1570e0 0x7f3acc14ebb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3abc00c3c0 tx=0x7f3abc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:00.318 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.311+0000 7f3ac8ff9640 1 -- 172.21.15.105:0/3881362419 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3abc017070 con 0x7f3acc1570e0 2024-09-21T03:19:00.318 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.311+0000 7f3ac8ff9640 1 -- 172.21.15.105:0/3881362419 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3abc0035f0 con 0x7f3acc1570e0 2024-09-21T03:19:00.318 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.311+0000 7f3ac8ff9640 1 -- 172.21.15.105:0/3881362419 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3abc003a40 con 0x7f3acc1570e0 2024-09-21T03:19:00.318 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.311+0000 7f3ad2a0a640 1 -- 172.21.15.105:0/3881362419 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3acc0b2d20 con 0x7f3acc1570e0 2024-09-21T03:19:00.318 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.311+0000 7f3ad2a0a640 1 -- 172.21.15.105:0/3881362419 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3acc0b3c90 con 0x7f3acc1570e0 2024-09-21T03:19:00.318 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.312+0000 7f3ad2a0a640 1 -- 172.21.15.105:0/3881362419 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3acc15ff20 con 0x7f3acc1570e0 2024-09-21T03:19:00.318 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.313+0000 7f3ac8ff9640 1 -- 172.21.15.105:0/3881362419 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3abc01a070 con 0x7f3acc1570e0 2024-09-21T03:19:00.319 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.313+0000 7f3ac8ff9640 1 --2- 172.21.15.105:0/3881362419 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3ab8078b90 0x7f3ab807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:00.319 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.313+0000 7f3ac8ff9640 1 -- 172.21.15.105:0/3881362419 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f3abc09a0b0 con 0x7f3acc1570e0 2024-09-21T03:19:00.319 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.313+0000 7f3acb7fe640 1 --2- 172.21.15.105:0/3881362419 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3ab8078b90 0x7f3ab807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:00.319 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.314+0000 7f3acb7fe640 1 --2- 172.21.15.105:0/3881362419 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3ab8078b90 0x7f3ab807b0a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0034000 tx=0x7f3ac0004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:00.320 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.317+0000 7f3ac8ff9640 1 -- 172.21.15.105:0/3881362419 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3acc15ff20 con 0x7f3acc1570e0 2024-09-21T03:19:00.495 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.494+0000 7f3ad2a0a640 1 -- 172.21.15.105:0/3881362419 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3acc0cff60 con 0x7f3acc1570e0 2024-09-21T03:19:00.496 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.495+0000 7f3ac8ff9640 1 -- 172.21.15.105:0/3881362419 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16737 (secure 0 0 0) 0x7f3abc0624f0 con 0x7f3acc1570e0 2024-09-21T03:19:00.497 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:19:00.497 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":23,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:18:31.396627+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:18:27.622514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:18:28.719849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:19:00.499 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.497+0000 7f3ad2a0a640 1 -- 172.21.15.105:0/3881362419 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3ab8078b90 msgr2=0x7f3ab807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:00.499 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.497+0000 7f3ad2a0a640 1 --2- 172.21.15.105:0/3881362419 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3ab8078b90 0x7f3ab807b0a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0034000 tx=0x7f3ac0004730 comp rx=0 tx=0).stop 2024-09-21T03:19:00.499 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.497+0000 7f3ad2a0a640 1 -- 172.21.15.105:0/3881362419 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3acc1570e0 msgr2=0x7f3acc14ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:00.499 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.497+0000 7f3ad2a0a640 1 --2- 172.21.15.105:0/3881362419 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3acc1570e0 0x7f3acc14ebb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3abc00c3c0 tx=0x7f3abc00c880 comp rx=0 tx=0).stop 2024-09-21T03:19:00.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.497+0000 7f3ad2a0a640 1 -- 172.21.15.105:0/3881362419 shutdown_connections 2024-09-21T03:19:00.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.497+0000 7f3ad2a0a640 1 --2- 172.21.15.105:0/3881362419 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3ab8078b90 0x7f3ab807b0a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:00.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.497+0000 7f3ad2a0a640 1 --2- 172.21.15.105:0/3881362419 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3acc14f340 0x7f3acc155320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:00.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.497+0000 7f3ad2a0a640 1 --2- 172.21.15.105:0/3881362419 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3acc15d670 0x7f3acc154de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:00.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.497+0000 7f3ad2a0a640 1 --2- 172.21.15.105:0/3881362419 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3acc1570e0 0x7f3acc14ebb0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:00.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.497+0000 7f3ad2a0a640 1 -- 172.21.15.105:0/3881362419 >> 172.21.15.105:0/3881362419 conn(0x7f3acc06d550 msgr2=0x7f3acc15f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:00.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.497+0000 7f3ad2a0a640 1 -- 172.21.15.105:0/3881362419 shutdown_connections 2024-09-21T03:19:00.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.497+0000 7f3ad2a0a640 1 -- 172.21.15.105:0/3881362419 wait complete. 2024-09-21T03:19:00.511 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T03:19:00.511 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:19:00.623 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.622+0000 7fc81aec4640 1 -- 172.21.15.105:0/3908394128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8140ca770 msgr2=0x7fc8140caca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:00.624 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.622+0000 7fc81aec4640 1 --2- 172.21.15.105:0/3908394128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8140ca770 0x7fc8140caca0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc8140d1130 tx=0x7fc80402a560 comp rx=0 tx=0).stop 2024-09-21T03:19:00.624 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.622+0000 7fc81aec4640 1 -- 172.21.15.105:0/3908394128 shutdown_connections 2024-09-21T03:19:00.624 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.622+0000 7fc81aec4640 1 --2- 172.21.15.105:0/3908394128 >> v2:172.21.15.162:3300/0 conn(0x7fc8140cb970 0x7fc81406ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:00.624 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.622+0000 7fc81aec4640 1 --2- 172.21.15.105:0/3908394128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8140ca770 0x7fc8140caca0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:00.624 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.622+0000 7fc81aec4640 1 -- 172.21.15.105:0/3908394128 >> 172.21.15.105:0/3908394128 conn(0x7fc8140b1cb0 msgr2=0x7fc8140b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:00.624 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.622+0000 7fc81aec4640 1 -- 172.21.15.105:0/3908394128 shutdown_connections 2024-09-21T03:19:00.624 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.622+0000 7fc81aec4640 1 -- 172.21.15.105:0/3908394128 wait complete. 2024-09-21T03:19:00.625 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.623+0000 7fc81aec4640 1 Processor -- start 2024-09-21T03:19:00.625 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.624+0000 7fc81aec4640 1 -- start start 2024-09-21T03:19:00.627 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.625+0000 7fc81aec4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8140704e0 0x7fc8141f96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:00.628 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.625+0000 7fc81aec4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8140ca770 0x7fc8141f5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:00.628 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.625+0000 7fc81aec4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8140cb970 0x7fc8140ae910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:00.628 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.625+0000 7fc81aec4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc8140ccf40 con 0x7fc8140704e0 2024-09-21T03:19:00.628 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.625+0000 7fc81aec4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc8140cbe90 con 0x7fc8140ca770 2024-09-21T03:19:00.628 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.625+0000 7fc81aec4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc8140cd0c0 con 0x7fc8140cb970 2024-09-21T03:19:00.628 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.625+0000 7fc818c60640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8140704e0 0x7fc8141f96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:00.628 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.625+0000 7fc818c60640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8140704e0 0x7fc8141f96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58718/0 (socket says 172.21.15.105:58718) 2024-09-21T03:19:00.628 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.625+0000 7fc818c60640 1 -- 172.21.15.105:0/2331737684 learned_addr learned my addr 172.21.15.105:0/2331737684 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:00.628 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.625+0000 7fc818c60640 1 -- 172.21.15.105:0/2331737684 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8140cb970 msgr2=0x7fc8140ae910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:00.629 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.625+0000 7fc818c60640 1 --2- 172.21.15.105:0/2331737684 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8140cb970 0x7fc8140ae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:00.629 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.625+0000 7fc818c60640 1 -- 172.21.15.105:0/2331737684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8140ca770 msgr2=0x7fc8141f5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:00.629 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.625+0000 7fc818c60640 1 --2- 172.21.15.105:0/2331737684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8140ca770 0x7fc8141f5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:00.629 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.625+0000 7fc818c60640 1 -- 172.21.15.105:0/2331737684 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8141f61e0 con 0x7fc8140704e0 2024-09-21T03:19:00.629 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.626+0000 7fc818c60640 1 --2- 172.21.15.105:0/2331737684 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8140704e0 0x7fc8141f96e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc804034040 tx=0x7fc8040039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:00.629 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.626+0000 7fc8117fa640 1 -- 172.21.15.105:0/2331737684 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80403e030 con 0x7fc8140704e0 2024-09-21T03:19:00.629 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.626+0000 7fc8117fa640 1 -- 172.21.15.105:0/2331737684 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc8040047a0 con 0x7fc8140704e0 2024-09-21T03:19:00.629 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.626+0000 7fc81aec4640 1 -- 172.21.15.105:0/2331737684 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8141f64c0 con 0x7fc8140704e0 2024-09-21T03:19:00.629 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.626+0000 7fc8117fa640 1 -- 172.21.15.105:0/2331737684 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc804035040 con 0x7fc8140704e0 2024-09-21T03:19:00.629 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.626+0000 7fc81aec4640 1 -- 172.21.15.105:0/2331737684 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8141f91c0 con 0x7fc8140704e0 2024-09-21T03:19:00.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.627+0000 7fc81aec4640 1 -- 172.21.15.105:0/2331737684 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8140cd640 con 0x7fc8140704e0 2024-09-21T03:19:00.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.628+0000 7fc8117fa640 1 -- 172.21.15.105:0/2331737684 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc804041030 con 0x7fc8140704e0 2024-09-21T03:19:00.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.628+0000 7fc8117fa640 1 --2- 172.21.15.105:0/2331737684 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc800078bc0 0x7fc80007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:00.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.628+0000 7fc8117fa640 1 -- 172.21.15.105:0/2331737684 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc8040bb600 con 0x7fc8140704e0 2024-09-21T03:19:00.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.629+0000 7fc813fff640 1 --2- 172.21.15.105:0/2331737684 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc800078bc0 0x7fc80007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:00.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.629+0000 7fc813fff640 1 --2- 172.21.15.105:0/2331737684 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc800078bc0 0x7fc80007b0d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc81415f100 tx=0x7fc808009250 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:00.634 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.633+0000 7fc8117fa640 1 -- 172.21.15.105:0/2331737684 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc804083a40 con 0x7fc8140704e0 2024-09-21T03:19:00.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.844+0000 7fc81aec4640 1 -- 172.21.15.105:0/2331737684 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc8140d0e30 con 0x7fc8140704e0 2024-09-21T03:19:00.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.844+0000 7fc8117fa640 1 -- 172.21.15.105:0/2331737684 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5220 (secure 0 0 0) 0x7fc804083340 con 0x7fc8140704e0 2024-09-21T03:19:00.846 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:19:00.846 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":8,"btime":"2024-09-21T03:18:33:412826+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/950623322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":950623322},{"type":"v1","addr":"172.21.15.105:6833","nonce":950623322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/982475612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":982475612},{"type":"v1","addr":"172.21.15.162:6837","nonce":982475612}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4389,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/940371702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":940371702},{"type":"v1","addr":"172.21.15.105:6835","nonce":940371702}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:18:29.756592+0000","modified":"2024-09-21T03:18:32.767916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4401},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4401":{"gid":4401,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6836/1998709636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1998709636},{"type":"v1","addr":"172.21.15.162:6836","nonce":1998709636}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4401,"qdb_cluster":[4401]},"id":1}]} 2024-09-21T03:19:00.846 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 8 2024-09-21T03:19:00.848 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.846+0000 7fc81aec4640 1 -- 172.21.15.105:0/2331737684 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc800078bc0 msgr2=0x7fc80007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:00.848 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.846+0000 7fc81aec4640 1 --2- 172.21.15.105:0/2331737684 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc800078bc0 0x7fc80007b0d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc81415f100 tx=0x7fc808009250 comp rx=0 tx=0).stop 2024-09-21T03:19:00.848 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.846+0000 7fc81aec4640 1 -- 172.21.15.105:0/2331737684 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8140704e0 msgr2=0x7fc8141f96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:00.848 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.846+0000 7fc81aec4640 1 --2- 172.21.15.105:0/2331737684 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8140704e0 0x7fc8141f96e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc804034040 tx=0x7fc8040039e0 comp rx=0 tx=0).stop 2024-09-21T03:19:00.848 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.846+0000 7fc81aec4640 1 -- 172.21.15.105:0/2331737684 shutdown_connections 2024-09-21T03:19:00.849 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.846+0000 7fc81aec4640 1 --2- 172.21.15.105:0/2331737684 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc800078bc0 0x7fc80007b0d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:00.849 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.846+0000 7fc81aec4640 1 --2- 172.21.15.105:0/2331737684 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8140cb970 0x7fc8140ae910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:00.849 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.846+0000 7fc81aec4640 1 --2- 172.21.15.105:0/2331737684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8140ca770 0x7fc8141f5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:00.849 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.846+0000 7fc81aec4640 1 --2- 172.21.15.105:0/2331737684 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8140704e0 0x7fc8141f96e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:00.849 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.846+0000 7fc81aec4640 1 -- 172.21.15.105:0/2331737684 >> 172.21.15.105:0/2331737684 conn(0x7fc8140b1cb0 msgr2=0x7fc8140b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:00.849 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.847+0000 7fc81aec4640 1 -- 172.21.15.105:0/2331737684 shutdown_connections 2024-09-21T03:19:00.849 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.847+0000 7fc81aec4640 1 -- 172.21.15.105:0/2331737684 wait complete. 2024-09-21T03:19:00.859 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:19:00.971 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.969+0000 7f2a7164d640 1 -- 172.21.15.105:0/2708983787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a6c0ce660 msgr2=0x7f2a6c0b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:00.971 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.969+0000 7f2a7164d640 1 --2- 172.21.15.105:0/2708983787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a6c0ce660 0x7f2a6c0b40f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c005fd0 tx=0x7f2a5c02a820 comp rx=0 tx=0).stop 2024-09-21T03:19:00.971 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.969+0000 7f2a7164d640 1 -- 172.21.15.105:0/2708983787 shutdown_connections 2024-09-21T03:19:00.971 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.969+0000 7f2a7164d640 1 --2- 172.21.15.105:0/2708983787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a6c0ce660 0x7f2a6c0b40f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:00.971 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.969+0000 7f2a7164d640 1 -- 172.21.15.105:0/2708983787 >> 172.21.15.105:0/2708983787 conn(0x7f2a6c0d12a0 msgr2=0x7f2a6c0d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:00.972 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.969+0000 7f2a7164d640 1 -- 172.21.15.105:0/2708983787 shutdown_connections 2024-09-21T03:19:00.972 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.969+0000 7f2a7164d640 1 -- 172.21.15.105:0/2708983787 wait complete. 2024-09-21T03:19:00.972 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.971+0000 7f2a7164d640 1 Processor -- start 2024-09-21T03:19:00.972 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.971+0000 7f2a7164d640 1 -- start start 2024-09-21T03:19:00.975 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.972+0000 7f2a7164d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a6c0b60b0 0x7f2a6c0cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:00.975 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.972+0000 7f2a7164d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a6c0b66f0 0x7f2a6c152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:00.975 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.972+0000 7f2a7164d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a6c0ce660 0x7f2a6c1f5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:00.975 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.972+0000 7f2a7164d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6c06d670 con 0x7f2a6c0b60b0 2024-09-21T03:19:00.975 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.972+0000 7f2a7164d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6c06d4f0 con 0x7f2a6c0b66f0 2024-09-21T03:19:00.975 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.972+0000 7f2a7164d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2a6c06d7f0 con 0x7f2a6c0ce660 2024-09-21T03:19:00.975 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.972+0000 7f2a6affd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a6c0b60b0 0x7f2a6c0cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:00.976 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.973+0000 7f2a6affd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a6c0b60b0 0x7f2a6c0cb0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58738/0 (socket says 172.21.15.105:58738) 2024-09-21T03:19:00.976 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.973+0000 7f2a6affd640 1 -- 172.21.15.105:0/3524456698 learned_addr learned my addr 172.21.15.105:0/3524456698 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:00.976 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.973+0000 7f2a6b7fe640 1 --2- 172.21.15.105:0/3524456698 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a6c0ce660 0x7f2a6c1f5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:00.976 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.973+0000 7f2a6a7fc640 1 --2- 172.21.15.105:0/3524456698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a6c0b66f0 0x7f2a6c152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:00.976 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.973+0000 7f2a6affd640 1 -- 172.21.15.105:0/3524456698 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a6c0ce660 msgr2=0x7f2a6c1f5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:00.976 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.973+0000 7f2a6affd640 1 --2- 172.21.15.105:0/3524456698 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a6c0ce660 0x7f2a6c1f5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:00.976 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.973+0000 7f2a6affd640 1 -- 172.21.15.105:0/3524456698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a6c0b66f0 msgr2=0x7f2a6c152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:00.976 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.973+0000 7f2a6affd640 1 --2- 172.21.15.105:0/3524456698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a6c0b66f0 0x7f2a6c152750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:00.976 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.973+0000 7f2a6affd640 1 -- 172.21.15.105:0/3524456698 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a6c152c90 con 0x7f2a6c0b60b0 2024-09-21T03:19:00.976 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.973+0000 7f2a6b7fe640 1 --2- 172.21.15.105:0/3524456698 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a6c0ce660 0x7f2a6c1f5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:19:00.976 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.973+0000 7f2a6a7fc640 1 --2- 172.21.15.105:0/3524456698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a6c0b66f0 0x7f2a6c152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:19:00.976 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.973+0000 7f2a6affd640 1 --2- 172.21.15.105:0/3524456698 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a6c0b60b0 0x7f2a6c0cb0a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2a6400b3e0 tx=0x7f2a6400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:00.976 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.973+0000 7f2a537fe640 1 -- 172.21.15.105:0/3524456698 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a64015020 con 0x7f2a6c0b60b0 2024-09-21T03:19:00.976 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.973+0000 7f2a537fe640 1 -- 172.21.15.105:0/3524456698 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2a64011940 con 0x7f2a6c0b60b0 2024-09-21T03:19:00.977 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.973+0000 7f2a537fe640 1 -- 172.21.15.105:0/3524456698 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a64011d90 con 0x7f2a6c0b60b0 2024-09-21T03:19:00.977 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.973+0000 7f2a7164d640 1 -- 172.21.15.105:0/3524456698 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a6c0cf6c0 con 0x7f2a6c0b60b0 2024-09-21T03:19:00.977 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.973+0000 7f2a7164d640 1 -- 172.21.15.105:0/3524456698 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a6c0cfc80 con 0x7f2a6c0b60b0 2024-09-21T03:19:00.977 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.974+0000 7f2a7164d640 1 -- 172.21.15.105:0/3524456698 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a6c0b40f0 con 0x7f2a6c0b60b0 2024-09-21T03:19:00.978 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.975+0000 7f2a537fe640 1 -- 172.21.15.105:0/3524456698 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2a64018020 con 0x7f2a6c0b60b0 2024-09-21T03:19:00.978 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.975+0000 7f2a537fe640 1 --2- 172.21.15.105:0/3524456698 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2a58078b90 0x7f2a5807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:00.978 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.976+0000 7f2a537fe640 1 -- 172.21.15.105:0/3524456698 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2a6409aab0 con 0x7f2a6c0b60b0 2024-09-21T03:19:00.978 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.976+0000 7f2a6a7fc640 1 --2- 172.21.15.105:0/3524456698 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2a58078b90 0x7f2a5807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:00.978 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.976+0000 7f2a6a7fc640 1 --2- 172.21.15.105:0/3524456698 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2a58078b90 0x7f2a5807b0a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c0c7940 tx=0x7f2a60009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:00.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:00.980+0000 7f2a537fe640 1 -- 172.21.15.105:0/3524456698 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2a6c152c90 con 0x7f2a6c0b60b0 2024-09-21T03:19:01.194 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.192+0000 7f2a7164d640 1 -- 172.21.15.105:0/3524456698 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a6c06d030 con 0x7f2a6c0b60b0 2024-09-21T03:19:01.195 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.193+0000 7f2a537fe640 1 -- 172.21.15.105:0/3524456698 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5220 (secure 0 0 0) 0x7f2a64062f80 con 0x7f2a6c0b60b0 2024-09-21T03:19:01.195 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:19:01.195 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":8,"btime":"2024-09-21T03:18:33:412826+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/950623322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":950623322},{"type":"v1","addr":"172.21.15.105:6833","nonce":950623322}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/982475612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":982475612},{"type":"v1","addr":"172.21.15.162:6837","nonce":982475612}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4389,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/940371702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":940371702},{"type":"v1","addr":"172.21.15.105:6835","nonce":940371702}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:18:29.756592+0000","modified":"2024-09-21T03:18:32.767916+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4401},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4401":{"gid":4401,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6836/1998709636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1998709636},{"type":"v1","addr":"172.21.15.162:6836","nonce":1998709636}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4401,"qdb_cluster":[4401]},"id":1}]} 2024-09-21T03:19:01.195 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 8 2024-09-21T03:19:01.197 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.195+0000 7f2a7164d640 1 -- 172.21.15.105:0/3524456698 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2a58078b90 msgr2=0x7f2a5807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:01.197 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.195+0000 7f2a7164d640 1 --2- 172.21.15.105:0/3524456698 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2a58078b90 0x7f2a5807b0a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c0c7940 tx=0x7f2a60009040 comp rx=0 tx=0).stop 2024-09-21T03:19:01.197 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.195+0000 7f2a7164d640 1 -- 172.21.15.105:0/3524456698 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a6c0b60b0 msgr2=0x7f2a6c0cb0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:01.197 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.195+0000 7f2a7164d640 1 --2- 172.21.15.105:0/3524456698 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a6c0b60b0 0x7f2a6c0cb0a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2a6400b3e0 tx=0x7f2a6400b8a0 comp rx=0 tx=0).stop 2024-09-21T03:19:01.197 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.195+0000 7f2a7164d640 1 -- 172.21.15.105:0/3524456698 shutdown_connections 2024-09-21T03:19:01.197 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.195+0000 7f2a7164d640 1 --2- 172.21.15.105:0/3524456698 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2a58078b90 0x7f2a5807b0a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:01.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.195+0000 7f2a7164d640 1 --2- 172.21.15.105:0/3524456698 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a6c0ce660 0x7f2a6c1f5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:01.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.195+0000 7f2a7164d640 1 --2- 172.21.15.105:0/3524456698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a6c0b66f0 0x7f2a6c152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:01.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.195+0000 7f2a7164d640 1 --2- 172.21.15.105:0/3524456698 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a6c0b60b0 0x7f2a6c0cb0a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:01.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.195+0000 7f2a7164d640 1 -- 172.21.15.105:0/3524456698 >> 172.21.15.105:0/3524456698 conn(0x7f2a6c0d12a0 msgr2=0x7f2a6c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:01.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.195+0000 7f2a7164d640 1 -- 172.21.15.105:0/3524456698 shutdown_connections 2024-09-21T03:19:01.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.195+0000 7f2a7164d640 1 -- 172.21.15.105:0/3524456698 wait complete. 2024-09-21T03:19:01.209 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:19:01.324 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.322+0000 7f50c3162640 1 -- 172.21.15.105:0/2562150122 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50bc0cf2d0 msgr2=0x7f50bc0b40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:01.324 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.322+0000 7f50c3162640 1 --2- 172.21.15.105:0/2562150122 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50bc0cf2d0 0x7f50bc0b40b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f50bc075140 tx=0x7f50a802a5f0 comp rx=0 tx=0).stop 2024-09-21T03:19:01.324 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.322+0000 7f50c3162640 1 -- 172.21.15.105:0/2562150122 shutdown_connections 2024-09-21T03:19:01.325 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.322+0000 7f50c3162640 1 --2- 172.21.15.105:0/2562150122 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50bc0cf2d0 0x7f50bc0b40b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:01.325 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.322+0000 7f50c3162640 1 --2- 172.21.15.105:0/2562150122 >> v2:172.21.15.162:3300/0 conn(0x7f50bc160e00 0x7f50bc1537b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:01.325 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.322+0000 7f50c3162640 1 -- 172.21.15.105:0/2562150122 >> 172.21.15.105:0/2562150122 conn(0x7f50bc06d7d0 msgr2=0x7f50bc0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:01.325 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.322+0000 7f50c3162640 1 -- 172.21.15.105:0/2562150122 shutdown_connections 2024-09-21T03:19:01.325 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.322+0000 7f50c3162640 1 -- 172.21.15.105:0/2562150122 wait complete. 2024-09-21T03:19:01.327 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.325+0000 7f50c3162640 1 Processor -- start 2024-09-21T03:19:01.327 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.325+0000 7f50c3162640 1 -- start start 2024-09-21T03:19:01.330 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.328+0000 7f50c3162640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50bc0cf2d0 0x7f50bc1e6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:01.331 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.328+0000 7f50c3162640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50bc0cf6e0 0x7f50bc09cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:01.331 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.328+0000 7f50c3162640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50bc160e00 0x7f50bc15ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:01.331 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.328+0000 7f50c3162640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f50bc0b4770 con 0x7f50bc0cf2d0 2024-09-21T03:19:01.331 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.328+0000 7f50c3162640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f50bc0b45f0 con 0x7f50bc0cf6e0 2024-09-21T03:19:01.331 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.328+0000 7f50c3162640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f50bc0b48f0 con 0x7f50bc160e00 2024-09-21T03:19:01.331 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.328+0000 7f50c0efe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50bc0cf2d0 0x7f50bc1e6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:01.331 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.328+0000 7f50c0efe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50bc0cf2d0 0x7f50bc1e6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58754/0 (socket says 172.21.15.105:58754) 2024-09-21T03:19:01.331 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.328+0000 7f50c0efe640 1 -- 172.21.15.105:0/1015228740 learned_addr learned my addr 172.21.15.105:0/1015228740 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:01.331 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.328+0000 7f50bbfff640 1 --2- 172.21.15.105:0/1015228740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50bc0cf6e0 0x7f50bc09cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:01.331 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.328+0000 7f50c16ff640 1 --2- 172.21.15.105:0/1015228740 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50bc160e00 0x7f50bc15ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:01.331 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.328+0000 7f50c0efe640 1 -- 172.21.15.105:0/1015228740 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50bc160e00 msgr2=0x7f50bc15ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:01.331 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.328+0000 7f50c0efe640 1 --2- 172.21.15.105:0/1015228740 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50bc160e00 0x7f50bc15ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:01.332 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.328+0000 7f50c0efe640 1 -- 172.21.15.105:0/1015228740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50bc0cf6e0 msgr2=0x7f50bc09cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:01.332 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.328+0000 7f50c0efe640 1 --2- 172.21.15.105:0/1015228740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50bc0cf6e0 0x7f50bc09cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:01.332 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.328+0000 7f50c0efe640 1 -- 172.21.15.105:0/1015228740 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50bc148290 con 0x7f50bc0cf2d0 2024-09-21T03:19:01.332 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.328+0000 7f50bbfff640 1 --2- 172.21.15.105:0/1015228740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50bc0cf6e0 0x7f50bc09cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:19:01.332 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.328+0000 7f50c0efe640 1 --2- 172.21.15.105:0/1015228740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50bc0cf2d0 0x7f50bc1e6b20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f50b000e7c0 tx=0x7f50b000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:01.332 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.328+0000 7f50b97fa640 1 -- 172.21.15.105:0/1015228740 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b000ccc0 con 0x7f50bc0cf2d0 2024-09-21T03:19:01.332 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.329+0000 7f50b97fa640 1 -- 172.21.15.105:0/1015228740 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50b000ce80 con 0x7f50bc0cf2d0 2024-09-21T03:19:01.332 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.329+0000 7f50c3162640 1 -- 172.21.15.105:0/1015228740 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50bc154230 con 0x7f50bc0cf2d0 2024-09-21T03:19:01.332 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.329+0000 7f50b97fa640 1 -- 172.21.15.105:0/1015228740 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b0005280 con 0x7f50bc0cf2d0 2024-09-21T03:19:01.332 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.329+0000 7f50c3162640 1 -- 172.21.15.105:0/1015228740 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50bc1458b0 con 0x7f50bc0cf2d0 2024-09-21T03:19:01.333 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.330+0000 7f50c3162640 1 -- 172.21.15.105:0/1015228740 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50bc1453c0 con 0x7f50bc0cf2d0 2024-09-21T03:19:01.333 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.331+0000 7f50b97fa640 1 -- 172.21.15.105:0/1015228740 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f50b0005420 con 0x7f50bc0cf2d0 2024-09-21T03:19:01.333 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.331+0000 7f50b97fa640 1 --2- 172.21.15.105:0/1015228740 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f50a0078b90 0x7f50a007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:01.333 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.331+0000 7f50b97fa640 1 -- 172.21.15.105:0/1015228740 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f50b009bb40 con 0x7f50bc0cf2d0 2024-09-21T03:19:01.333 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.331+0000 7f50bbfff640 1 --2- 172.21.15.105:0/1015228740 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f50a0078b90 0x7f50a007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:01.333 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.332+0000 7f50bbfff640 1 --2- 172.21.15.105:0/1015228740 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f50a0078b90 0x7f50a007b0a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f50a8033000 tx=0x7f50a8004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:01.337 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.335+0000 7f50b97fa640 1 -- 172.21.15.105:0/1015228740 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f50b0064010 con 0x7f50bc0cf2d0 2024-09-21T03:19:01.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.523+0000 7f50c3162640 1 -- 172.21.15.105:0/1015228740 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f50bc0b40b0 con 0x7f50bc0cf2d0 2024-09-21T03:19:01.526 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.524+0000 7f50b97fa640 1 -- 172.21.15.105:0/1015228740 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16737 (secure 0 0 0) 0x7f50b0063910 con 0x7f50bc0cf2d0 2024-09-21T03:19:01.527 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:19:01.527 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":23,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:18:31.396627+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:18:27.622514+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:18:28.719849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:19:01.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.526+0000 7f50c3162640 1 -- 172.21.15.105:0/1015228740 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f50a0078b90 msgr2=0x7f50a007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:01.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.526+0000 7f50c3162640 1 --2- 172.21.15.105:0/1015228740 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f50a0078b90 0x7f50a007b0a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f50a8033000 tx=0x7f50a8004730 comp rx=0 tx=0).stop 2024-09-21T03:19:01.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.526+0000 7f50c3162640 1 -- 172.21.15.105:0/1015228740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50bc0cf2d0 msgr2=0x7f50bc1e6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:01.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.526+0000 7f50c3162640 1 --2- 172.21.15.105:0/1015228740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50bc0cf2d0 0x7f50bc1e6b20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f50b000e7c0 tx=0x7f50b000ec80 comp rx=0 tx=0).stop 2024-09-21T03:19:01.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.527+0000 7f50c3162640 1 -- 172.21.15.105:0/1015228740 shutdown_connections 2024-09-21T03:19:01.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.527+0000 7f50c3162640 1 --2- 172.21.15.105:0/1015228740 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f50a0078b90 0x7f50a007b0a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:01.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.527+0000 7f50c3162640 1 --2- 172.21.15.105:0/1015228740 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50bc160e00 0x7f50bc15ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:01.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.527+0000 7f50c3162640 1 --2- 172.21.15.105:0/1015228740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50bc0cf6e0 0x7f50bc09cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:01.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.527+0000 7f50c3162640 1 --2- 172.21.15.105:0/1015228740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50bc0cf2d0 0x7f50bc1e6b20 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:01.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.527+0000 7f50c3162640 1 -- 172.21.15.105:0/1015228740 >> 172.21.15.105:0/1015228740 conn(0x7f50bc06d7d0 msgr2=0x7f50bc0ad250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:01.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.527+0000 7f50c3162640 1 -- 172.21.15.105:0/1015228740 shutdown_connections 2024-09-21T03:19:01.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.527+0000 7f50c3162640 1 -- 172.21.15.105:0/1015228740 wait complete. 2024-09-21T03:19:01.540 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T03:19:01.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.656+0000 7f18322cc640 1 -- 172.21.15.105:0/2950744599 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f182c15c7f0 msgr2=0x7f182c0b26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:01.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.656+0000 7f18322cc640 1 --2- 172.21.15.105:0/2950744599 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f182c15c7f0 0x7f182c0b26c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f182c0aef10 tx=0x7f181c02a410 comp rx=0 tx=0).stop 2024-09-21T03:19:01.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.656+0000 7f18322cc640 1 -- 172.21.15.105:0/2950744599 shutdown_connections 2024-09-21T03:19:01.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.656+0000 7f18322cc640 1 --2- 172.21.15.105:0/2950744599 >> v2:172.21.15.162:3300/0 conn(0x7f182c0ae1b0 0x7f182c06cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:01.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.656+0000 7f18322cc640 1 --2- 172.21.15.105:0/2950744599 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f182c15c7f0 0x7f182c0b26c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:01.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.656+0000 7f18322cc640 1 -- 172.21.15.105:0/2950744599 >> 172.21.15.105:0/2950744599 conn(0x7f182c06ea80 msgr2=0x7f182c0b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:01.659 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.656+0000 7f18322cc640 1 -- 172.21.15.105:0/2950744599 shutdown_connections 2024-09-21T03:19:01.659 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.656+0000 7f18322cc640 1 -- 172.21.15.105:0/2950744599 wait complete. 2024-09-21T03:19:01.659 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.658+0000 7f18322cc640 1 Processor -- start 2024-09-21T03:19:01.660 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.658+0000 7f18322cc640 1 -- start start 2024-09-21T03:19:01.662 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.660+0000 7f18322cc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f182c0ae1b0 0x7f182c1549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:01.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.660+0000 7f18322cc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f182c0b2070 0x7f182c09b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:01.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.660+0000 7f18322cc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f182c15c7f0 0x7f182c09bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:01.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.660+0000 7f18322cc640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f182c0b0ff0 con 0x7f182c0ae1b0 2024-09-21T03:19:01.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.660+0000 7f18322cc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f182c0b0e70 con 0x7f182c15c7f0 2024-09-21T03:19:01.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.660+0000 7f18322cc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f182c06d320 con 0x7f182c0b2070 2024-09-21T03:19:01.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.660+0000 7f182bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f182c0ae1b0 0x7f182c1549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:01.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.660+0000 7f182bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f182c0ae1b0 0x7f182c1549a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:43892/0 (socket says 172.21.15.105:43892) 2024-09-21T03:19:01.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.660+0000 7f182bfff640 1 -- 172.21.15.105:0/2476933127 learned_addr learned my addr 172.21.15.105:0/2476933127 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:01.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.660+0000 7f182b7fe640 1 --2- 172.21.15.105:0/2476933127 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f182c0b2070 0x7f182c09b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:01.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.660+0000 7f1830869640 1 --2- 172.21.15.105:0/2476933127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f182c15c7f0 0x7f182c09bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:01.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.660+0000 7f182bfff640 1 -- 172.21.15.105:0/2476933127 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f182c0b2070 msgr2=0x7f182c09b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:01.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.660+0000 7f182bfff640 1 --2- 172.21.15.105:0/2476933127 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f182c0b2070 0x7f182c09b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:01.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.660+0000 7f182bfff640 1 -- 172.21.15.105:0/2476933127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f182c15c7f0 msgr2=0x7f182c09bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:01.664 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.660+0000 7f182bfff640 1 --2- 172.21.15.105:0/2476933127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f182c15c7f0 0x7f182c09bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:01.664 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.660+0000 7f182bfff640 1 -- 172.21.15.105:0/2476933127 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f182c1552d0 con 0x7f182c0ae1b0 2024-09-21T03:19:01.664 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.660+0000 7f1830869640 1 --2- 172.21.15.105:0/2476933127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f182c15c7f0 0x7f182c09bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:19:01.664 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.660+0000 7f182bfff640 1 --2- 172.21.15.105:0/2476933127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f182c0ae1b0 0x7f182c1549a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f181c02aa00 tx=0x7f181c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:01.664 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.661+0000 7f1828ff9640 1 -- 172.21.15.105:0/2476933127 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f181c031d60 con 0x7f182c0ae1b0 2024-09-21T03:19:01.664 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.661+0000 7f1828ff9640 1 -- 172.21.15.105:0/2476933127 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f181c033e10 con 0x7f182c0ae1b0 2024-09-21T03:19:01.664 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.661+0000 7f18322cc640 1 -- 172.21.15.105:0/2476933127 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f182c1555b0 con 0x7f182c0ae1b0 2024-09-21T03:19:01.664 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.661+0000 7f1828ff9640 1 -- 172.21.15.105:0/2476933127 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f181c005260 con 0x7f182c0ae1b0 2024-09-21T03:19:01.665 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.661+0000 7f18322cc640 1 -- 172.21.15.105:0/2476933127 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f182c155b70 con 0x7f182c0ae1b0 2024-09-21T03:19:01.665 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.662+0000 7f18322cc640 1 -- 172.21.15.105:0/2476933127 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f182c0b72c0 con 0x7f182c0ae1b0 2024-09-21T03:19:01.665 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.662+0000 7f1828ff9640 1 -- 172.21.15.105:0/2476933127 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f181c005400 con 0x7f182c0ae1b0 2024-09-21T03:19:01.666 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.663+0000 7f1828ff9640 1 --2- 172.21.15.105:0/2476933127 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1818078bc0 0x7f181807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:01.666 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.663+0000 7f1828ff9640 1 -- 172.21.15.105:0/2476933127 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f181c0bbe50 con 0x7f182c0ae1b0 2024-09-21T03:19:01.666 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.663+0000 7f182b7fe640 1 --2- 172.21.15.105:0/2476933127 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1818078bc0 0x7f181807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:01.666 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.664+0000 7f182b7fe640 1 --2- 172.21.15.105:0/2476933127 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1818078bc0 0x7f181807b0d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f182c14bcf0 tx=0x7f1820005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:01.669 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.667+0000 7f1828ff9640 1 -- 172.21.15.105:0/2476933127 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f182c0b72c0 con 0x7f182c0ae1b0 2024-09-21T03:19:01.891 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.889+0000 7f18322cc640 1 -- 172.21.15.105:0/2476933127 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f182c0d23b0 con 0x7f182c0ae1b0 2024-09-21T03:19:01.891 INFO:tasks.ceph.mon.a.smithi105.stderr:2024-09-21T03:19:01.890+0000 7f25819ea640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T03:19:01.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.891+0000 7f1828ff9640 1 -- 172.21.15.105:0/2476933127 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f182c0d23b0 con 0x7f182c0ae1b0 2024-09-21T03:19:01.893 INFO:teuthology.orchestra.run.smithi105.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T03:19:01.896 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.894+0000 7f18322cc640 1 -- 172.21.15.105:0/2476933127 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1818078bc0 msgr2=0x7f181807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:01.896 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.894+0000 7f18322cc640 1 --2- 172.21.15.105:0/2476933127 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1818078bc0 0x7f181807b0d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f182c14bcf0 tx=0x7f1820005f90 comp rx=0 tx=0).stop 2024-09-21T03:19:01.896 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.894+0000 7f18322cc640 1 -- 172.21.15.105:0/2476933127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f182c0ae1b0 msgr2=0x7f182c1549a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:01.896 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.894+0000 7f18322cc640 1 --2- 172.21.15.105:0/2476933127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f182c0ae1b0 0x7f182c1549a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f181c02aa00 tx=0x7f181c033c20 comp rx=0 tx=0).stop 2024-09-21T03:19:01.896 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.894+0000 7f18322cc640 1 -- 172.21.15.105:0/2476933127 shutdown_connections 2024-09-21T03:19:01.896 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.894+0000 7f18322cc640 1 --2- 172.21.15.105:0/2476933127 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1818078bc0 0x7f181807b0d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:01.896 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.894+0000 7f18322cc640 1 --2- 172.21.15.105:0/2476933127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f182c15c7f0 0x7f182c09bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:01.896 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.894+0000 7f18322cc640 1 --2- 172.21.15.105:0/2476933127 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f182c0b2070 0x7f182c09b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:01.896 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.894+0000 7f18322cc640 1 --2- 172.21.15.105:0/2476933127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f182c0ae1b0 0x7f182c1549a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:01.896 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.894+0000 7f18322cc640 1 -- 172.21.15.105:0/2476933127 >> 172.21.15.105:0/2476933127 conn(0x7f182c06ea80 msgr2=0x7f182c0b11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:01.896 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.894+0000 7f18322cc640 1 -- 172.21.15.105:0/2476933127 shutdown_connections 2024-09-21T03:19:01.896 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:01.894+0000 7f18322cc640 1 -- 172.21.15.105:0/2476933127 wait complete. 2024-09-21T03:19:01.900 INFO:tasks.ceph.mds.d.smithi162.stderr: -6947> 2024-09-21T03:18:36.371+0000 7ff0c11d9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T03:19:01.908 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T03:19:01.957 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-09-21T03:19:02.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.023+0000 7f1a015c2640 1 -- 172.21.15.105:0/3459163631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19fc0b6680 msgr2=0x7f19fc0b0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:02.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.023+0000 7f1a015c2640 1 --2- 172.21.15.105:0/3459163631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19fc0b6680 0x7f19fc0b0de0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f19fc0739d0 tx=0x7f19ec02a4d0 comp rx=0 tx=0).stop 2024-09-21T03:19:02.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.023+0000 7f1a015c2640 1 -- 172.21.15.105:0/3459163631 shutdown_connections 2024-09-21T03:19:02.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.023+0000 7f1a015c2640 1 --2- 172.21.15.105:0/3459163631 >> v2:172.21.15.162:3300/0 conn(0x7f19fc0b6100 0x7f19fc0b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:02.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.023+0000 7f1a015c2640 1 --2- 172.21.15.105:0/3459163631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19fc0b6680 0x7f19fc0b0de0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:02.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.023+0000 7f1a015c2640 1 -- 172.21.15.105:0/3459163631 >> 172.21.15.105:0/3459163631 conn(0x7f19fc0d12a0 msgr2=0x7f19fc0d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:02.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.023+0000 7f1a015c2640 1 -- 172.21.15.105:0/3459163631 shutdown_connections 2024-09-21T03:19:02.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.023+0000 7f1a015c2640 1 -- 172.21.15.105:0/3459163631 wait complete. 2024-09-21T03:19:02.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.025+0000 7f1a015c2640 1 Processor -- start 2024-09-21T03:19:02.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.025+0000 7f1a015c2640 1 -- start start 2024-09-21T03:19:02.029 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.026+0000 7f1a015c2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19fc0b6100 0x7f19fc14d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:02.029 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.026+0000 7f1a015c2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19fc0b6680 0x7f19fc0cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:02.029 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.026+0000 7f1a015c2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19fc161f50 0x7f19fc0ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:02.029 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.026+0000 7f1a015c2640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f19fc165a90 con 0x7f19fc0b6100 2024-09-21T03:19:02.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.026+0000 7f1a015c2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f19fc0b20d0 con 0x7f19fc0b6680 2024-09-21T03:19:02.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.026+0000 7f1a015c2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f19fc165c10 con 0x7f19fc161f50 2024-09-21T03:19:02.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.026+0000 7f19faffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19fc0b6100 0x7f19fc14d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:02.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.026+0000 7f19faffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19fc0b6100 0x7f19fc14d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:43910/0 (socket says 172.21.15.105:43910) 2024-09-21T03:19:02.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.026+0000 7f19faffd640 1 -- 172.21.15.105:0/673127410 learned_addr learned my addr 172.21.15.105:0/673127410 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:02.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.026+0000 7f19fb7fe640 1 --2- 172.21.15.105:0/673127410 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19fc161f50 0x7f19fc0ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:02.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.026+0000 7f19fa7fc640 1 --2- 172.21.15.105:0/673127410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19fc0b6680 0x7f19fc0cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:02.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.027+0000 7f19faffd640 1 -- 172.21.15.105:0/673127410 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19fc161f50 msgr2=0x7f19fc0ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:02.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.027+0000 7f19faffd640 1 --2- 172.21.15.105:0/673127410 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19fc161f50 0x7f19fc0ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:02.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.027+0000 7f19faffd640 1 -- 172.21.15.105:0/673127410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19fc0b6680 msgr2=0x7f19fc0cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:02.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.027+0000 7f19faffd640 1 --2- 172.21.15.105:0/673127410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19fc0b6680 0x7f19fc0cca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:02.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.027+0000 7f19faffd640 1 -- 172.21.15.105:0/673127410 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19fc1644b0 con 0x7f19fc0b6100 2024-09-21T03:19:02.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.027+0000 7f19faffd640 1 --2- 172.21.15.105:0/673127410 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19fc0b6100 0x7f19fc14d770 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f19fc074f60 tx=0x7f19ec004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:02.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.027+0000 7f19f37fe640 1 -- 172.21.15.105:0/673127410 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ec031d60 con 0x7f19fc0b6100 2024-09-21T03:19:02.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.027+0000 7f19f37fe640 1 -- 172.21.15.105:0/673127410 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f19ec033070 con 0x7f19fc0b6100 2024-09-21T03:19:02.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.027+0000 7f1a015c2640 1 -- 172.21.15.105:0/673127410 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19fc164790 con 0x7f19fc0b6100 2024-09-21T03:19:02.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.027+0000 7f19f37fe640 1 -- 172.21.15.105:0/673127410 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ec0334a0 con 0x7f19fc0b6100 2024-09-21T03:19:02.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.027+0000 7f1a015c2640 1 -- 172.21.15.105:0/673127410 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19fc164d50 con 0x7f19fc0b6100 2024-09-21T03:19:02.032 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.028+0000 7f1a015c2640 1 -- 172.21.15.105:0/673127410 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19fc0b3b90 con 0x7f19fc0b6100 2024-09-21T03:19:02.032 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.029+0000 7f19f37fe640 1 -- 172.21.15.105:0/673127410 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f19ec033640 con 0x7f19fc0b6100 2024-09-21T03:19:02.032 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.029+0000 7f19f37fe640 1 --2- 172.21.15.105:0/673127410 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f19dc078bc0 0x7f19dc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:02.032 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.029+0000 7f19f37fe640 1 -- 172.21.15.105:0/673127410 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5795+0+0 (secure 0 0 0) 0x7f19ec0bc030 con 0x7f19fc0b6100 2024-09-21T03:19:02.032 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.029+0000 7f19fa7fc640 1 --2- 172.21.15.105:0/673127410 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f19dc078bc0 0x7f19dc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:02.032 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.030+0000 7f19fa7fc640 1 --2- 172.21.15.105:0/673127410 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f19dc078bc0 0x7f19dc07b0d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f19fc071c20 tx=0x7f19e4009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:02.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.034+0000 7f19f37fe640 1 -- 172.21.15.105:0/673127410 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f19fc0b3b90 con 0x7f19fc0b6100 2024-09-21T03:19:02.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.251+0000 7f1a015c2640 1 -- 172.21.15.105:0/673127410 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f19fc0b0de0 con 0x7f19fc0b6100 2024-09-21T03:19:02.894 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.893+0000 7f19f37fe640 1 -- 172.21.15.105:0/673127410 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f19ec03f030 con 0x7f19fc0b6100 2024-09-21T03:19:02.897 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.895+0000 7f1a015c2640 1 -- 172.21.15.105:0/673127410 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f19dc078bc0 msgr2=0x7f19dc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:02.897 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.895+0000 7f1a015c2640 1 --2- 172.21.15.105:0/673127410 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f19dc078bc0 0x7f19dc07b0d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f19fc071c20 tx=0x7f19e4009060 comp rx=0 tx=0).stop 2024-09-21T03:19:02.897 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.895+0000 7f1a015c2640 1 -- 172.21.15.105:0/673127410 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19fc0b6100 msgr2=0x7f19fc14d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:02.897 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.895+0000 7f1a015c2640 1 --2- 172.21.15.105:0/673127410 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19fc0b6100 0x7f19fc14d770 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f19fc074f60 tx=0x7f19ec004ac0 comp rx=0 tx=0).stop 2024-09-21T03:19:02.897 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.895+0000 7f1a015c2640 1 -- 172.21.15.105:0/673127410 shutdown_connections 2024-09-21T03:19:02.897 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.895+0000 7f1a015c2640 1 --2- 172.21.15.105:0/673127410 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f19dc078bc0 0x7f19dc07b0d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:02.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.895+0000 7f1a015c2640 1 --2- 172.21.15.105:0/673127410 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19fc161f50 0x7f19fc0ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:02.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.895+0000 7f1a015c2640 1 --2- 172.21.15.105:0/673127410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19fc0b6680 0x7f19fc0cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:02.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.895+0000 7f1a015c2640 1 --2- 172.21.15.105:0/673127410 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19fc0b6100 0x7f19fc14d770 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:02.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.895+0000 7f1a015c2640 1 -- 172.21.15.105:0/673127410 >> 172.21.15.105:0/673127410 conn(0x7f19fc0d12a0 msgr2=0x7f19fc0ce1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:02.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.895+0000 7f1a015c2640 1 -- 172.21.15.105:0/673127410 shutdown_connections 2024-09-21T03:19:02.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:02.895+0000 7f1a015c2640 1 -- 172.21.15.105:0/673127410 wait complete. 2024-09-21T03:19:02.909 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T03:19:03.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.024+0000 7f7d514bd640 1 -- 172.21.15.105:0/3138683726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d4c0b38a0 msgr2=0x7f7d4c06eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:03.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.024+0000 7f7d514bd640 1 --2- 172.21.15.105:0/3138683726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d4c0b38a0 0x7f7d4c06eec0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7d44005fd0 tx=0x7f7d4402a820 comp rx=0 tx=0).stop 2024-09-21T03:19:03.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.024+0000 7f7d514bd640 1 -- 172.21.15.105:0/3138683726 shutdown_connections 2024-09-21T03:19:03.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.024+0000 7f7d514bd640 1 --2- 172.21.15.105:0/3138683726 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d4c0d1640 0x7f7d4c06e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:03.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.024+0000 7f7d514bd640 1 --2- 172.21.15.105:0/3138683726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d4c0b38a0 0x7f7d4c06eec0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:03.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.024+0000 7f7d514bd640 1 -- 172.21.15.105:0/3138683726 >> 172.21.15.105:0/3138683726 conn(0x7f7d4c09d820 msgr2=0x7f7d4c08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:03.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.024+0000 7f7d514bd640 1 -- 172.21.15.105:0/3138683726 shutdown_connections 2024-09-21T03:19:03.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.024+0000 7f7d514bd640 1 -- 172.21.15.105:0/3138683726 wait complete. 2024-09-21T03:19:03.032 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.026+0000 7f7d514bd640 1 Processor -- start 2024-09-21T03:19:03.032 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.026+0000 7f7d514bd640 1 -- start start 2024-09-21T03:19:03.032 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.027+0000 7f7d514bd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d4c06ded0 0x7f7d4c1f8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:03.032 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.027+0000 7f7d514bd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d4c0b38a0 0x7f7d4c152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:03.032 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.027+0000 7f7d514bd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d4c0b79b0 0x7f7d4c0b7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:03.032 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.027+0000 7f7d514bd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7d4c06f580 con 0x7f7d4c0b79b0 2024-09-21T03:19:03.033 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.028+0000 7f7d514bd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7d4c06f400 con 0x7f7d4c06ded0 2024-09-21T03:19:03.033 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.028+0000 7f7d514bd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7d4c06f700 con 0x7f7d4c0b38a0 2024-09-21T03:19:03.033 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.028+0000 7f7d4b7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d4c0b79b0 0x7f7d4c0b7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:03.033 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.028+0000 7f7d4b7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d4c0b79b0 0x7f7d4c0b7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:43920/0 (socket says 172.21.15.105:43920) 2024-09-21T03:19:03.033 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.028+0000 7f7d4b7fe640 1 -- 172.21.15.105:0/3738508860 learned_addr learned my addr 172.21.15.105:0/3738508860 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:03.033 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.028+0000 7f7d4affd640 1 --2- 172.21.15.105:0/3738508860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d4c06ded0 0x7f7d4c1f8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:03.033 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.028+0000 7f7d4a7fc640 1 --2- 172.21.15.105:0/3738508860 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d4c0b38a0 0x7f7d4c152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:03.033 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.028+0000 7f7d4b7fe640 1 -- 172.21.15.105:0/3738508860 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d4c0b38a0 msgr2=0x7f7d4c152ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:03.033 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.028+0000 7f7d4b7fe640 1 --2- 172.21.15.105:0/3738508860 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d4c0b38a0 0x7f7d4c152ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:03.034 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.028+0000 7f7d4b7fe640 1 -- 172.21.15.105:0/3738508860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d4c06ded0 msgr2=0x7f7d4c1f8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:03.034 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.028+0000 7f7d4b7fe640 1 --2- 172.21.15.105:0/3738508860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d4c06ded0 0x7f7d4c1f8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:03.034 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.028+0000 7f7d4b7fe640 1 -- 172.21.15.105:0/3738508860 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d4c0ce820 con 0x7f7d4c0b79b0 2024-09-21T03:19:03.034 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.028+0000 7f7d4b7fe640 1 --2- 172.21.15.105:0/3738508860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d4c0b79b0 0x7f7d4c0b7dc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7d44035040 tx=0x7f7d44032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:03.034 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.028+0000 7f7d337fe640 1 -- 172.21.15.105:0/3738508860 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d44037040 con 0x7f7d4c0b79b0 2024-09-21T03:19:03.034 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.028+0000 7f7d337fe640 1 -- 172.21.15.105:0/3738508860 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d44042070 con 0x7f7d4c0b79b0 2024-09-21T03:19:03.034 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.028+0000 7f7d514bd640 1 -- 172.21.15.105:0/3738508860 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d4c0b8300 con 0x7f7d4c0b79b0 2024-09-21T03:19:03.034 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.028+0000 7f7d337fe640 1 -- 172.21.15.105:0/3738508860 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d44003e60 con 0x7f7d4c0b79b0 2024-09-21T03:19:03.034 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.028+0000 7f7d514bd640 1 -- 172.21.15.105:0/3738508860 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d4c1f5860 con 0x7f7d4c0b79b0 2024-09-21T03:19:03.034 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.030+0000 7f7d514bd640 1 -- 172.21.15.105:0/3738508860 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d4c06fbc0 con 0x7f7d4c0b79b0 2024-09-21T03:19:03.034 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.030+0000 7f7d337fe640 1 -- 172.21.15.105:0/3738508860 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7d44004260 con 0x7f7d4c0b79b0 2024-09-21T03:19:03.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.031+0000 7f7d337fe640 1 --2- 172.21.15.105:0/3738508860 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7d38078b90 0x7f7d3807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:03.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.031+0000 7f7d337fe640 1 -- 172.21.15.105:0/3738508860 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5795+0+0 (secure 0 0 0) 0x7f7d440bba50 con 0x7f7d4c0b79b0 2024-09-21T03:19:03.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.031+0000 7f7d4affd640 1 --2- 172.21.15.105:0/3738508860 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7d38078b90 0x7f7d3807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:03.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.031+0000 7f7d4affd640 1 --2- 172.21.15.105:0/3738508860 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7d38078b90 0x7f7d3807b0a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c007fd0 tx=0x7f7d3c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:03.037 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.035+0000 7f7d337fe640 1 -- 172.21.15.105:0/3738508860 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7d4c0b8300 con 0x7f7d4c0b79b0 2024-09-21T03:19:03.214 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.212+0000 7f7d514bd640 1 -- 172.21.15.105:0/3738508860 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7d4c0b1fa0 con 0x7f7d4c0b79b0 2024-09-21T03:19:03.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.897+0000 7f7d337fe640 1 -- 172.21.15.105:0/3738508860 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) ==== 181+0+0 (secure 0 0 0) 0x7f7d4c0ce820 con 0x7f7d4c0b79b0 2024-09-21T03:19:03.899 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_metadata' removed 2024-09-21T03:19:03.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.901+0000 7f7d514bd640 1 -- 172.21.15.105:0/3738508860 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7d38078b90 msgr2=0x7f7d3807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:03.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.901+0000 7f7d514bd640 1 --2- 172.21.15.105:0/3738508860 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7d38078b90 0x7f7d3807b0a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c007fd0 tx=0x7f7d3c009040 comp rx=0 tx=0).stop 2024-09-21T03:19:03.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.901+0000 7f7d514bd640 1 -- 172.21.15.105:0/3738508860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d4c0b79b0 msgr2=0x7f7d4c0b7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:03.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.901+0000 7f7d514bd640 1 --2- 172.21.15.105:0/3738508860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d4c0b79b0 0x7f7d4c0b7dc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7d44035040 tx=0x7f7d44032c60 comp rx=0 tx=0).stop 2024-09-21T03:19:03.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.901+0000 7f7d514bd640 1 -- 172.21.15.105:0/3738508860 shutdown_connections 2024-09-21T03:19:03.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.901+0000 7f7d514bd640 1 --2- 172.21.15.105:0/3738508860 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7d38078b90 0x7f7d3807b0a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:03.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.901+0000 7f7d514bd640 1 --2- 172.21.15.105:0/3738508860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d4c0b79b0 0x7f7d4c0b7dc0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:03.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.901+0000 7f7d514bd640 1 --2- 172.21.15.105:0/3738508860 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d4c0b38a0 0x7f7d4c152ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:03.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.901+0000 7f7d514bd640 1 --2- 172.21.15.105:0/3738508860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d4c06ded0 0x7f7d4c1f8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:03.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.901+0000 7f7d514bd640 1 -- 172.21.15.105:0/3738508860 >> 172.21.15.105:0/3738508860 conn(0x7f7d4c09d820 msgr2=0x7f7d4c0cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:03.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.902+0000 7f7d514bd640 1 -- 172.21.15.105:0/3738508860 shutdown_connections 2024-09-21T03:19:03.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:03.902+0000 7f7d514bd640 1 -- 172.21.15.105:0/3738508860 wait complete. 2024-09-21T03:19:03.915 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T03:19:04.034 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.032+0000 7f799acd3640 1 -- 172.21.15.105:0/415496119 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f797c004d40 msgr2=0x7f797c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:04.034 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.032+0000 7f799acd3640 1 --2- 172.21.15.105:0/415496119 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f797c004d40 0x7f797c005190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f79940d1ca0 tx=0x7f797c005830 comp rx=0 tx=0).stop 2024-09-21T03:19:04.034 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.032+0000 7f7999270640 1 -- 172.21.15.105:0/415496119 reap_dead start 2024-09-21T03:19:04.034 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.032+0000 7f799acd3640 1 -- 172.21.15.105:0/415496119 shutdown_connections 2024-09-21T03:19:04.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.032+0000 7f799acd3640 1 -- 172.21.15.105:0/415496119 >> 172.21.15.105:0/415496119 conn(0x7f799409d800 msgr2=0x7f799408bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:04.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.032+0000 7f799acd3640 1 -- 172.21.15.105:0/415496119 shutdown_connections 2024-09-21T03:19:04.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.032+0000 7f799acd3640 1 -- 172.21.15.105:0/415496119 wait complete. 2024-09-21T03:19:04.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.034+0000 7f799acd3640 1 Processor -- start 2024-09-21T03:19:04.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.034+0000 7f799acd3640 1 -- start start 2024-09-21T03:19:04.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.035+0000 7f799acd3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f79940ce370 0x7f79941e7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:04.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.035+0000 7f799acd3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79941d3630 0x7f79941e4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:04.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.035+0000 7f799acd3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79941d3a40 0x7f79941e49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:04.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.035+0000 7f799acd3640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f79940d3790 con 0x7f79940ce370 2024-09-21T03:19:04.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.035+0000 7f799acd3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f799406fa30 con 0x7f79941d3630 2024-09-21T03:19:04.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.035+0000 7f799acd3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f79940d3910 con 0x7f79941d3a40 2024-09-21T03:19:04.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.035+0000 7f7998a6f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f79940ce370 0x7f79941e7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:04.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.035+0000 7f7998a6f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f79940ce370 0x7f79941e7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:43944/0 (socket says 172.21.15.105:43944) 2024-09-21T03:19:04.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.035+0000 7f7998a6f640 1 -- 172.21.15.105:0/2816913675 learned_addr learned my addr 172.21.15.105:0/2816913675 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:04.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.035+0000 7f7999270640 1 --2- 172.21.15.105:0/2816913675 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79941d3a40 0x7f79941e49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:04.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.035+0000 7f7993fff640 1 --2- 172.21.15.105:0/2816913675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79941d3630 0x7f79941e4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:04.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.035+0000 7f7998a6f640 1 -- 172.21.15.105:0/2816913675 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79941d3a40 msgr2=0x7f79941e49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:04.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.035+0000 7f7998a6f640 1 --2- 172.21.15.105:0/2816913675 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79941d3a40 0x7f79941e49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:04.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.035+0000 7f7998a6f640 1 -- 172.21.15.105:0/2816913675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79941d3630 msgr2=0x7f79941e4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:04.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.035+0000 7f7998a6f640 1 --2- 172.21.15.105:0/2816913675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79941d3630 0x7f79941e4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:04.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.035+0000 7f7998a6f640 1 -- 172.21.15.105:0/2816913675 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79941d4010 con 0x7f79940ce370 2024-09-21T03:19:04.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.036+0000 7f7998a6f640 1 --2- 172.21.15.105:0/2816913675 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f79940ce370 0x7f79941e7f00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7984011ae0 tx=0x7f7984009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:04.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.036+0000 7f79917fa640 1 -- 172.21.15.105:0/2816913675 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f798401e070 con 0x7f79940ce370 2024-09-21T03:19:04.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.036+0000 7f79917fa640 1 -- 172.21.15.105:0/2816913675 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f798400fc10 con 0x7f79940ce370 2024-09-21T03:19:04.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.036+0000 7f799acd3640 1 -- 172.21.15.105:0/2816913675 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79941d42f0 con 0x7f79940ce370 2024-09-21T03:19:04.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.036+0000 7f79917fa640 1 -- 172.21.15.105:0/2816913675 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7984019410 con 0x7f79940ce370 2024-09-21T03:19:04.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.036+0000 7f799acd3640 1 -- 172.21.15.105:0/2816913675 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79941e8440 con 0x7f79940ce370 2024-09-21T03:19:04.040 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.037+0000 7f799acd3640 1 -- 172.21.15.105:0/2816913675 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79940d3ea0 con 0x7f79940ce370 2024-09-21T03:19:04.040 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.038+0000 7f79917fa640 1 -- 172.21.15.105:0/2816913675 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7984021070 con 0x7f79940ce370 2024-09-21T03:19:04.040 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.038+0000 7f79917fa640 1 --2- 172.21.15.105:0/2816913675 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7980078b90 0x7f798007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:04.041 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.038+0000 7f79917fa640 1 -- 172.21.15.105:0/2816913675 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5357+0+0 (secure 0 0 0) 0x7f798409b430 con 0x7f79940ce370 2024-09-21T03:19:04.041 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.039+0000 7f7993fff640 1 --2- 172.21.15.105:0/2816913675 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7980078b90 0x7f798007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:04.041 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.039+0000 7f7993fff640 1 --2- 172.21.15.105:0/2816913675 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7980078b90 0x7f798007b0a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7988006fd0 tx=0x7f7988006f20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:04.045 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.044+0000 7f79917fa640 1 -- 172.21.15.105:0/2816913675 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7984063410 con 0x7f79940ce370 2024-09-21T03:19:04.224 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.222+0000 7f799acd3640 1 -- 172.21.15.105:0/2816913675 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f79940d1440 con 0x7f79940ce370 2024-09-21T03:19:04.901 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.899+0000 7f79917fa640 1 -- 172.21.15.105:0/2816913675 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) ==== 169+0+0 (secure 0 0 0) 0x7f7984067e40 con 0x7f79940ce370 2024-09-21T03:19:04.901 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_data' removed 2024-09-21T03:19:04.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.903+0000 7f799acd3640 1 -- 172.21.15.105:0/2816913675 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7980078b90 msgr2=0x7f798007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:04.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.903+0000 7f799acd3640 1 --2- 172.21.15.105:0/2816913675 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7980078b90 0x7f798007b0a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7988006fd0 tx=0x7f7988006f20 comp rx=0 tx=0).stop 2024-09-21T03:19:04.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.903+0000 7f799acd3640 1 -- 172.21.15.105:0/2816913675 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f79940ce370 msgr2=0x7f79941e7f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:04.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.903+0000 7f799acd3640 1 --2- 172.21.15.105:0/2816913675 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f79940ce370 0x7f79941e7f00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7984011ae0 tx=0x7f7984009e60 comp rx=0 tx=0).stop 2024-09-21T03:19:04.906 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.904+0000 7f799acd3640 1 -- 172.21.15.105:0/2816913675 shutdown_connections 2024-09-21T03:19:04.906 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.904+0000 7f799acd3640 1 --2- 172.21.15.105:0/2816913675 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7980078b90 0x7f798007b0a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:04.906 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.904+0000 7f799acd3640 1 --2- 172.21.15.105:0/2816913675 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79941d3a40 0x7f79941e49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:04.906 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.904+0000 7f799acd3640 1 --2- 172.21.15.105:0/2816913675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79941d3630 0x7f79941e4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:04.906 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.904+0000 7f799acd3640 1 --2- 172.21.15.105:0/2816913675 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f79940ce370 0x7f79941e7f00 secure :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7984011ae0 tx=0x7f7984009e60 comp rx=0 tx=0).stop 2024-09-21T03:19:04.906 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.904+0000 7f799acd3640 1 -- 172.21.15.105:0/2816913675 >> 172.21.15.105:0/2816913675 conn(0x7f799409d800 msgr2=0x7f79940b7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:04.906 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.904+0000 7f799acd3640 1 -- 172.21.15.105:0/2816913675 shutdown_connections 2024-09-21T03:19:04.906 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:04.904+0000 7f799acd3640 1 -- 172.21.15.105:0/2816913675 wait complete. 2024-09-21T03:19:04.921 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T03:19:04.921 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-21T03:19:04.921 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T03:19:04.921 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:19:04.921 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T03:19:04.922 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T03:19:04.922 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T03:19:04.922 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:19:04.922 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T03:19:04.922 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T03:19:04.922 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T03:19:04.922 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:19:04.923 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T03:19:04.923 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T03:19:04.923 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T03:19:04.923 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:19:04.932 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T03:19:04.932 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T03:19:04.933 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T03:19:04.933 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T03:19:04.934 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T03:19:04.934 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T03:19:04.937 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T03:19:04.937 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T03:19:04.975 INFO:tasks.ceph.mds.a:Started 2024-09-21T03:19:04.975 DEBUG:teuthology.parallel:result is None 2024-09-21T03:19:04.976 INFO:tasks.ceph.mds.c:Started 2024-09-21T03:19:04.976 DEBUG:teuthology.parallel:result is None 2024-09-21T03:19:04.979 INFO:tasks.ceph.mds.b:Started 2024-09-21T03:19:04.979 DEBUG:teuthology.parallel:result is None 2024-09-21T03:19:04.981 INFO:tasks.ceph.mds.d:Started 2024-09-21T03:19:04.981 DEBUG:teuthology.parallel:result is None 2024-09-21T03:19:04.981 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T03:19:05.068 INFO:tasks.ceph.mds.a.smithi105.stdout:starting mds.a at 2024-09-21T03:19:05.069 INFO:tasks.ceph.mds.c.smithi105.stdout:starting mds.c at 2024-09-21T03:19:05.074 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-09-21T03:19:05.074 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-09-21T03:19:05.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.104+0000 7f99d7a70640 1 -- 172.21.15.105:0/1083472068 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99d0155ce0 msgr2=0x7f99d00b45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:05.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.104+0000 7f99d7a70640 1 --2- 172.21.15.105:0/1083472068 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99d0155ce0 0x7f99d00b45a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f99c8005fd0 tx=0x7f99c802a5d0 comp rx=0 tx=0).stop 2024-09-21T03:19:05.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.105+0000 7f99d7a70640 1 -- 172.21.15.105:0/1083472068 shutdown_connections 2024-09-21T03:19:05.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.105+0000 7f99d7a70640 1 --2- 172.21.15.105:0/1083472068 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99d0155ce0 0x7f99d00b45a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:05.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.105+0000 7f99d7a70640 1 --2- 172.21.15.105:0/1083472068 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99d0074420 0x7f99d006fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:05.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.105+0000 7f99d7a70640 1 -- 172.21.15.105:0/1083472068 >> 172.21.15.105:0/1083472068 conn(0x7f99d006def0 msgr2=0x7f99d006e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:05.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.105+0000 7f99d7a70640 1 -- 172.21.15.105:0/1083472068 shutdown_connections 2024-09-21T03:19:05.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.105+0000 7f99d7a70640 1 -- 172.21.15.105:0/1083472068 wait complete. 2024-09-21T03:19:05.108 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.106+0000 7f99d7a70640 1 Processor -- start 2024-09-21T03:19:05.108 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.106+0000 7f99d7a70640 1 -- start start 2024-09-21T03:19:05.110 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.108+0000 7f99d7a70640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99d0074420 0x7f99d01f6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:05.110 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.108+0000 7f99d7a70640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99d0155ce0 0x7f99d0147380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:05.110 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.108+0000 7f99d7a70640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99d01595d0 0x7f99d01599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:05.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.108+0000 7f99d7a70640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f99d00b5060 con 0x7f99d0155ce0 2024-09-21T03:19:05.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.108+0000 7f99d7a70640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f99d00b4ee0 con 0x7f99d0074420 2024-09-21T03:19:05.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.108+0000 7f99d7a70640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f99d00b51e0 con 0x7f99d01595d0 2024-09-21T03:19:05.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.108+0000 7f99d500b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99d0155ce0 0x7f99d0147380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:05.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.108+0000 7f99d500b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99d0155ce0 0x7f99d0147380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:43994/0 (socket says 172.21.15.105:43994) 2024-09-21T03:19:05.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.108+0000 7f99d580c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99d0074420 0x7f99d01f6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:05.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.108+0000 7f99d500b640 1 -- 172.21.15.105:0/3166262205 learned_addr learned my addr 172.21.15.105:0/3166262205 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:05.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.108+0000 7f99d600d640 1 --2- 172.21.15.105:0/3166262205 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99d01595d0 0x7f99d01599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:05.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.108+0000 7f99d500b640 1 -- 172.21.15.105:0/3166262205 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99d01595d0 msgr2=0x7f99d01599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:05.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.108+0000 7f99d500b640 1 --2- 172.21.15.105:0/3166262205 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99d01595d0 0x7f99d01599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:05.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.108+0000 7f99d500b640 1 -- 172.21.15.105:0/3166262205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99d0074420 msgr2=0x7f99d01f6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:05.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.108+0000 7f99d500b640 1 --2- 172.21.15.105:0/3166262205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99d0074420 0x7f99d01f6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:05.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.108+0000 7f99d500b640 1 -- 172.21.15.105:0/3166262205 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99d014b670 con 0x7f99d0155ce0 2024-09-21T03:19:05.112 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.108+0000 7f99d500b640 1 --2- 172.21.15.105:0/3166262205 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99d0155ce0 0x7f99d0147380 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f99c000c3a0 tx=0x7f99c000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:05.112 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.108+0000 7f99c67fc640 1 -- 172.21.15.105:0/3166262205 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c0017070 con 0x7f99d0155ce0 2024-09-21T03:19:05.112 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.109+0000 7f99c67fc640 1 -- 172.21.15.105:0/3166262205 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99c00053c0 con 0x7f99d0155ce0 2024-09-21T03:19:05.112 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.109+0000 7f99d7a70640 1 -- 172.21.15.105:0/3166262205 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99d01f63e0 con 0x7f99d0155ce0 2024-09-21T03:19:05.112 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.109+0000 7f99c67fc640 1 -- 172.21.15.105:0/3166262205 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c0003850 con 0x7f99d0155ce0 2024-09-21T03:19:05.112 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.109+0000 7f99d7a70640 1 -- 172.21.15.105:0/3166262205 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99d01481b0 con 0x7f99d0155ce0 2024-09-21T03:19:05.112 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.110+0000 7f99d7a70640 1 -- 172.21.15.105:0/3166262205 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99d00b4780 con 0x7f99d0155ce0 2024-09-21T03:19:05.112 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.110+0000 7f99c67fc640 1 -- 172.21.15.105:0/3166262205 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f99c001a070 con 0x7f99d0155ce0 2024-09-21T03:19:05.113 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.111+0000 7f99c67fc640 1 --2- 172.21.15.105:0/3166262205 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f99b4078bc0 0x7f99b407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:05.113 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.112+0000 7f99c67fc640 1 -- 172.21.15.105:0/3166262205 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 4943+0+0 (secure 0 0 0) 0x7f99c009a050 con 0x7f99d0155ce0 2024-09-21T03:19:05.113 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.112+0000 7f99d580c640 1 --2- 172.21.15.105:0/3166262205 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f99b4078bc0 0x7f99b407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:05.113 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.112+0000 7f99d580c640 1 --2- 172.21.15.105:0/3166262205 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f99b4078bc0 0x7f99b407b0d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f99cc005fd0 tx=0x7f99cc009500 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:05.117 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.115+0000 7f99c67fc640 1 -- 172.21.15.105:0/3166262205 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f99d00b4780 con 0x7f99d0155ce0 2024-09-21T03:19:05.306 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.304+0000 7f99d7a70640 1 -- 172.21.15.105:0/3166262205 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f99d00b5700 con 0x7f99d0155ce0 2024-09-21T03:19:05.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.917+0000 7f99c67fc640 1 -- 172.21.15.105:0/3166262205 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v28) ==== 97+0+0 (secure 0 0 0) 0x7f99c0021020 con 0x7f99d0155ce0 2024-09-21T03:19:05.919 INFO:teuthology.orchestra.run.smithi105.stderr: removed all blocklist entries 2024-09-21T03:19:05.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.919+0000 7f99d7a70640 1 -- 172.21.15.105:0/3166262205 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f99b4078bc0 msgr2=0x7f99b407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:05.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.919+0000 7f99d7a70640 1 --2- 172.21.15.105:0/3166262205 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f99b4078bc0 0x7f99b407b0d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f99cc005fd0 tx=0x7f99cc009500 comp rx=0 tx=0).stop 2024-09-21T03:19:05.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.919+0000 7f99d7a70640 1 -- 172.21.15.105:0/3166262205 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99d0155ce0 msgr2=0x7f99d0147380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:05.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.919+0000 7f99d7a70640 1 --2- 172.21.15.105:0/3166262205 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99d0155ce0 0x7f99d0147380 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f99c000c3a0 tx=0x7f99c000c860 comp rx=0 tx=0).stop 2024-09-21T03:19:05.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.919+0000 7f99d7a70640 1 -- 172.21.15.105:0/3166262205 shutdown_connections 2024-09-21T03:19:05.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.919+0000 7f99d7a70640 1 --2- 172.21.15.105:0/3166262205 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f99b4078bc0 0x7f99b407b0d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:05.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.919+0000 7f99d7a70640 1 --2- 172.21.15.105:0/3166262205 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99d01595d0 0x7f99d01599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:05.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.919+0000 7f99d7a70640 1 --2- 172.21.15.105:0/3166262205 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99d0155ce0 0x7f99d0147380 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:05.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.919+0000 7f99d7a70640 1 --2- 172.21.15.105:0/3166262205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99d0074420 0x7f99d01f6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:05.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.919+0000 7f99d7a70640 1 -- 172.21.15.105:0/3166262205 >> 172.21.15.105:0/3166262205 conn(0x7f99d006def0 msgr2=0x7f99d015a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:05.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.919+0000 7f99d7a70640 1 -- 172.21.15.105:0/3166262205 shutdown_connections 2024-09-21T03:19:05.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:05.919+0000 7f99d7a70640 1 -- 172.21.15.105:0/3166262205 wait complete. 2024-09-21T03:19:05.933 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T03:19:06.049 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.047+0000 7f10e9962640 1 -- 172.21.15.105:0/2022262184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10cc005330 msgr2=0x7f10cc00b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:06.049 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.047+0000 7f10e9962640 1 --2- 172.21.15.105:0/2022262184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10cc005330 0x7f10cc00b9e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f10dc00c2e0 tx=0x7f10cc005830 comp rx=0 tx=0).stop 2024-09-21T03:19:06.049 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.047+0000 7f10e9962640 1 -- 172.21.15.105:0/2022262184 shutdown_connections 2024-09-21T03:19:06.049 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.047+0000 7f10e9962640 1 --2- 172.21.15.105:0/2022262184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10cc005330 0x7f10cc00b9e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:06.049 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.047+0000 7f10e9962640 1 -- 172.21.15.105:0/2022262184 >> 172.21.15.105:0/2022262184 conn(0x7f10e40b1cb0 msgr2=0x7f10e40b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:06.049 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.047+0000 7f10e9962640 1 -- 172.21.15.105:0/2022262184 shutdown_connections 2024-09-21T03:19:06.050 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.047+0000 7f10e9962640 1 -- 172.21.15.105:0/2022262184 wait complete. 2024-09-21T03:19:06.050 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.049+0000 7f10e9962640 1 Processor -- start 2024-09-21T03:19:06.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.049+0000 7f10e9962640 1 -- start start 2024-09-21T03:19:06.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.050+0000 7f10e9962640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10cc005330 0x7f10e40d0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:06.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.051+0000 7f10e9962640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10e41f74a0 0x7f10e4153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:06.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.051+0000 7f10e9962640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10e4153dc0 0x7f10e41f6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:06.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.051+0000 7f10e9962640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f10e4074a20 con 0x7f10cc005330 2024-09-21T03:19:06.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.051+0000 7f10e9962640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f10e40748a0 con 0x7f10e4153dc0 2024-09-21T03:19:06.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.051+0000 7f10e9962640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f10e4074ba0 con 0x7f10e41f74a0 2024-09-21T03:19:06.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.051+0000 7f10e2ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10cc005330 0x7f10e40d0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:06.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.051+0000 7f10e2ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10cc005330 0x7f10e40d0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:44004/0 (socket says 172.21.15.105:44004) 2024-09-21T03:19:06.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.051+0000 7f10e2ffd640 1 -- 172.21.15.105:0/58508970 learned_addr learned my addr 172.21.15.105:0/58508970 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:06.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.051+0000 7f10e27fc640 1 --2- 172.21.15.105:0/58508970 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10e41f74a0 0x7f10e4153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:06.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.051+0000 7f10e37fe640 1 --2- 172.21.15.105:0/58508970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10e4153dc0 0x7f10e41f6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:06.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.051+0000 7f10e2ffd640 1 -- 172.21.15.105:0/58508970 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10e41f74a0 msgr2=0x7f10e4153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:06.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.051+0000 7f10e2ffd640 1 --2- 172.21.15.105:0/58508970 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10e41f74a0 0x7f10e4153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:06.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.051+0000 7f10e2ffd640 1 -- 172.21.15.105:0/58508970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10e4153dc0 msgr2=0x7f10e41f6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:06.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.051+0000 7f10e2ffd640 1 --2- 172.21.15.105:0/58508970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10e4153dc0 0x7f10e41f6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:06.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.051+0000 7f10e2ffd640 1 -- 172.21.15.105:0/58508970 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10e41550c0 con 0x7f10cc005330 2024-09-21T03:19:06.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.051+0000 7f10e27fc640 1 --2- 172.21.15.105:0/58508970 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10e41f74a0 0x7f10e4153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:19:06.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.051+0000 7f10e37fe640 1 --2- 172.21.15.105:0/58508970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10e4153dc0 0x7f10e41f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:19:06.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.051+0000 7f10e2ffd640 1 --2- 172.21.15.105:0/58508970 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10cc005330 0x7f10e40d0750 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f10d4010bf0 tx=0x7f10d400e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:06.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.051+0000 7f10cbfff640 1 -- 172.21.15.105:0/58508970 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d4016070 con 0x7f10cc005330 2024-09-21T03:19:06.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.051+0000 7f10cbfff640 1 -- 172.21.15.105:0/58508970 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10d4003b70 con 0x7f10cc005330 2024-09-21T03:19:06.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.051+0000 7f10e9962640 1 -- 172.21.15.105:0/58508970 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10e4154300 con 0x7f10cc005330 2024-09-21T03:19:06.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.051+0000 7f10cbfff640 1 -- 172.21.15.105:0/58508970 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d4004050 con 0x7f10cc005330 2024-09-21T03:19:06.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.051+0000 7f10e9962640 1 -- 172.21.15.105:0/58508970 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10e41548c0 con 0x7f10cc005330 2024-09-21T03:19:06.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.053+0000 7f10e9962640 1 -- 172.21.15.105:0/58508970 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10e40c3860 con 0x7f10cc005330 2024-09-21T03:19:06.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.053+0000 7f10cbfff640 1 -- 172.21.15.105:0/58508970 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f10d40041f0 con 0x7f10cc005330 2024-09-21T03:19:06.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.053+0000 7f10cbfff640 1 --2- 172.21.15.105:0/58508970 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f10d0078b90 0x7f10d007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:06.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.054+0000 7f10cbfff640 1 -- 172.21.15.105:0/58508970 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f10d409bbc0 con 0x7f10cc005330 2024-09-21T03:19:06.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.054+0000 7f10e27fc640 1 --2- 172.21.15.105:0/58508970 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f10d0078b90 0x7f10d007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:06.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.054+0000 7f10e27fc640 1 --2- 172.21.15.105:0/58508970 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f10d0078b90 0x7f10d007b0a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f10e409db30 tx=0x7f10d8006b70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:06.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.058+0000 7f10cbfff640 1 -- 172.21.15.105:0/58508970 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f10d4064470 con 0x7f10cc005330 2024-09-21T03:19:06.303 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.301+0000 7f10e9962640 1 -- 172.21.15.105:0/58508970 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f10e40afcc0 con 0x7f10cc005330 2024-09-21T03:19:06.303 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.302+0000 7f10cbfff640 1 -- 172.21.15.105:0/58508970 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) ==== 80+0+6645 (secure 0 0 0) 0x7f10d4063d70 con 0x7f10cc005330 2024-09-21T03:19:06.303 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:19:06.304 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-21T03:19:06.304 INFO:teuthology.orchestra.run.smithi105.stdout: "auth_dump": [ 2024-09-21T03:19:06.304 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:19:06.304 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mds.a", 2024-09-21T03:19:06.304 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mtIIZDhAAJIXLpzTFBOFhnOwLzsdL6w==", 2024-09-21T03:19:06.304 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:19:06.304 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:19:06.304 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:19:06.304 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:19:06.304 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:19:06.304 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:19:06.304 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:19:06.305 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:19:06.305 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mds.b", 2024-09-21T03:19:06.305 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mGKANGxAAeAuUYMtLP7GXKfIELR7qMA==", 2024-09-21T03:19:06.305 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:19:06.305 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:19:06.305 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:19:06.305 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:19:06.305 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:19:06.305 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:19:06.306 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:19:06.306 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:19:06.306 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mds.c", 2024-09-21T03:19:06.306 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mwQzQFRAAElYtgnIdYzzkeg8AtiU+kA==", 2024-09-21T03:19:06.306 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:19:06.306 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:19:06.306 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:19:06.306 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:19:06.306 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:19:06.306 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:19:06.306 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:19:06.306 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:19:06.306 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mds.d", 2024-09-21T03:19:06.307 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mZkWyIhAAu4XWptFcbDrYjozzrgMcGQ==", 2024-09-21T03:19:06.307 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:19:06.307 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:19:06.307 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:19:06.307 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:19:06.307 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:19:06.307 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:19:06.307 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:19:06.307 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:19:06.307 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.0", 2024-09-21T03:19:06.307 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDMOu5mrSk2BRAAuEPjuEeUJEI3Sa2fiLaJyw==", 2024-09-21T03:19:06.307 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:19:06.307 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:19:06.308 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:19:06.308 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:19:06.308 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:19:06.308 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:19:06.308 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:19:06.308 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.1", 2024-09-21T03:19:06.308 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDPOu5mAT4UCBAAase7NV3ARBSu4QloaQdlzA==", 2024-09-21T03:19:06.308 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:19:06.308 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:19:06.308 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:19:06.308 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:19:06.308 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:19:06.308 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:19:06.308 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:19:06.309 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.2", 2024-09-21T03:19:06.309 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDSOu5ma4LRChAASottrmolMcagbspeyGVzBQ==", 2024-09-21T03:19:06.309 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:19:06.309 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:19:06.309 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:19:06.309 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:19:06.309 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:19:06.309 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:19:06.309 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:19:06.309 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.3", 2024-09-21T03:19:06.309 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDVOu5mD5RWHBAAKuNr4F3GA0EP566aQ07ZVw==", 2024-09-21T03:19:06.310 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:19:06.310 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:19:06.310 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:19:06.310 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:19:06.310 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:19:06.310 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:19:06.310 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:19:06.310 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.4", 2024-09-21T03:19:06.310 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDcOu5m++UBChAAqmgoPBQ/as4tc+UQPwaflg==", 2024-09-21T03:19:06.310 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:19:06.310 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:19:06.310 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:19:06.311 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:19:06.311 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:19:06.311 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:19:06.311 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:19:06.311 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.5", 2024-09-21T03:19:06.311 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDfOu5maYYZKRAA1ungglTU3TW1B/XNRjBuZQ==", 2024-09-21T03:19:06.311 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:19:06.311 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:19:06.311 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:19:06.311 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:19:06.311 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:19:06.311 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:19:06.311 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:19:06.311 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.6", 2024-09-21T03:19:06.312 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDjOu5mmwIqHBAAf6oNdLNkmM9yufP8XA2+og==", 2024-09-21T03:19:06.312 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:19:06.312 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:19:06.312 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:19:06.312 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:19:06.312 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:19:06.312 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:19:06.312 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:19:06.312 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.7", 2024-09-21T03:19:06.312 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDmOu5mtCciHhAAPTnZubJ+7mGXcXZykCWxHg==", 2024-09-21T03:19:06.312 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:19:06.312 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:19:06.312 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:19:06.312 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:19:06.313 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:19:06.313 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:19:06.313 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:19:06.313 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.0", 2024-09-21T03:19:06.313 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mughoJxAAhY0bzJmq+oNyzCdtafkC9w==", 2024-09-21T03:19:06.313 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:19:06.313 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:19:06.313 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow r", 2024-09-21T03:19:06.313 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow rw", 2024-09-21T03:19:06.313 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow rwx" 2024-09-21T03:19:06.313 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:19:06.313 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:19:06.313 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:19:06.314 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.1", 2024-09-21T03:19:06.314 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5m4Vn2LhAAnEa/01ql5quuRCVHOVwB7w==", 2024-09-21T03:19:06.314 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:19:06.314 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:19:06.314 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow r", 2024-09-21T03:19:06.314 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow rw", 2024-09-21T03:19:06.314 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow rwx" 2024-09-21T03:19:06.314 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:19:06.314 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:19:06.314 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:19:06.314 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.2", 2024-09-21T03:19:06.314 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mKi0mKxAAoetnL61ujgtg2cvscdjCLQ==", 2024-09-21T03:19:06.314 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:19:06.315 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:19:06.315 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow r", 2024-09-21T03:19:06.315 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow rw", 2024-09-21T03:19:06.315 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow rwx" 2024-09-21T03:19:06.315 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:19:06.315 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:19:06.315 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:19:06.315 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.3", 2024-09-21T03:19:06.315 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mWZDAMhAAs4BuFHMSkJa6+piN/FeeXQ==", 2024-09-21T03:19:06.315 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:19:06.315 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:19:06.315 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow r", 2024-09-21T03:19:06.315 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow rw", 2024-09-21T03:19:06.315 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow rwx" 2024-09-21T03:19:06.316 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:19:06.316 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:19:06.316 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:19:06.316 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.admin", 2024-09-21T03:19:06.316 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDHOu5m4JRYLBAAgZ8nh5VIiWhuZ4+vrnmngw==", 2024-09-21T03:19:06.316 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:19:06.316 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow *", 2024-09-21T03:19:06.316 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:19:06.316 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:19:06.316 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:19:06.316 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:19:06.316 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:19:06.316 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:19:06.316 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.bootstrap-mds", 2024-09-21T03:19:06.317 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDsOu5mYGMRMhAA0gtkbftQ8cCcJZrWy25hMw==", 2024-09-21T03:19:06.317 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:19:06.317 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile bootstrap-mds" 2024-09-21T03:19:06.317 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:19:06.317 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:19:06.317 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:19:06.317 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.bootstrap-mgr", 2024-09-21T03:19:06.317 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDsOu5mfnMRMhAA7TgvQdWXTol+AWtvtnun2Q==", 2024-09-21T03:19:06.317 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:19:06.317 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-21T03:19:06.317 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:19:06.317 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:19:06.317 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:19:06.317 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.bootstrap-osd", 2024-09-21T03:19:06.318 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDsOu5mSIERMhAA+I4A8/xMFY65UBFbHecCFw==", 2024-09-21T03:19:06.318 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:19:06.318 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile bootstrap-osd" 2024-09-21T03:19:06.318 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:19:06.318 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:19:06.318 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:19:06.318 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.bootstrap-rbd", 2024-09-21T03:19:06.318 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDsOu5mOI0RMhAAo3KaCvqA/NZ3UfyeEuVx5Q==", 2024-09-21T03:19:06.319 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:19:06.319 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-21T03:19:06.319 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:19:06.319 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:19:06.319 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:19:06.319 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-21T03:19:06.319 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDsOu5mc54RMhAACAAFAbhU1ve3Si1uhR4Xrg==", 2024-09-21T03:19:06.319 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:19:06.319 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-21T03:19:06.319 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:19:06.319 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:19:06.320 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:19:06.320 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.bootstrap-rgw", 2024-09-21T03:19:06.320 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDsOu5mdqsRMhAA9KGsHQQfHn0WjjzXSyRLZg==", 2024-09-21T03:19:06.320 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:19:06.320 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-21T03:19:06.320 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:19:06.320 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:19:06.320 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:19:06.320 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mgr.x", 2024-09-21T03:19:06.320 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5m92lTChAAQ61muQmc6uBs7b5mq3Zt8g==", 2024-09-21T03:19:06.320 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:19:06.320 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow *", 2024-09-21T03:19:06.320 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile mgr", 2024-09-21T03:19:06.320 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:19:06.321 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:19:06.321 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:19:06.321 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:19:06.321 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mgr.y", 2024-09-21T03:19:06.321 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mh07bBRAAflFF00xr1ew4zttUi5TGng==", 2024-09-21T03:19:06.321 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:19:06.321 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow *", 2024-09-21T03:19:06.321 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile mgr", 2024-09-21T03:19:06.321 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:19:06.321 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:19:06.321 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:19:06.322 INFO:teuthology.orchestra.run.smithi105.stdout: ] 2024-09-21T03:19:06.322 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-21T03:19:06.324 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.304+0000 7f10e9962640 1 -- 172.21.15.105:0/58508970 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f10d0078b90 msgr2=0x7f10d007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:06.324 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.304+0000 7f10e9962640 1 --2- 172.21.15.105:0/58508970 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f10d0078b90 0x7f10d007b0a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f10e409db30 tx=0x7f10d8006b70 comp rx=0 tx=0).stop 2024-09-21T03:19:06.324 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.304+0000 7f10e9962640 1 -- 172.21.15.105:0/58508970 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10cc005330 msgr2=0x7f10e40d0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:06.324 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.304+0000 7f10e9962640 1 --2- 172.21.15.105:0/58508970 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10cc005330 0x7f10e40d0750 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f10d4010bf0 tx=0x7f10d400e6c0 comp rx=0 tx=0).stop 2024-09-21T03:19:06.324 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.304+0000 7f10e9962640 1 -- 172.21.15.105:0/58508970 shutdown_connections 2024-09-21T03:19:06.324 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.304+0000 7f10e9962640 1 --2- 172.21.15.105:0/58508970 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f10d0078b90 0x7f10d007b0a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:06.324 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.304+0000 7f10e9962640 1 --2- 172.21.15.105:0/58508970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10e4153dc0 0x7f10e41f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:06.324 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.304+0000 7f10e9962640 1 --2- 172.21.15.105:0/58508970 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10e41f74a0 0x7f10e4153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:06.324 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.304+0000 7f10e9962640 1 --2- 172.21.15.105:0/58508970 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10cc005330 0x7f10e40d0750 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:06.324 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.304+0000 7f10e9962640 1 -- 172.21.15.105:0/58508970 >> 172.21.15.105:0/58508970 conn(0x7f10e40b1cb0 msgr2=0x7f10e415eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:06.324 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.304+0000 7f10e9962640 1 -- 172.21.15.105:0/58508970 shutdown_connections 2024-09-21T03:19:06.325 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.304+0000 7f10e9962640 1 -- 172.21.15.105:0/58508970 wait complete. 2024-09-21T03:19:06.325 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-21T03:19:06.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.436+0000 7f69d0eda640 1 -- 172.21.15.105:0/3069034828 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69b4005250 msgr2=0x7f69b400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:06.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.436+0000 7f69d0eda640 1 --2- 172.21.15.105:0/3069034828 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69b4005250 0x7f69b400b9c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f69c4001d90 tx=0x7f69b4005830 comp rx=0 tx=0).stop 2024-09-21T03:19:06.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.436+0000 7f69d0eda640 1 -- 172.21.15.105:0/3069034828 shutdown_connections 2024-09-21T03:19:06.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.436+0000 7f69d0eda640 1 --2- 172.21.15.105:0/3069034828 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69b4005250 0x7f69b400b9c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:06.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.436+0000 7f69d0eda640 1 -- 172.21.15.105:0/3069034828 >> 172.21.15.105:0/3069034828 conn(0x7f69cc0cdcc0 msgr2=0x7f69cc0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:06.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.436+0000 7f69d0eda640 1 -- 172.21.15.105:0/3069034828 shutdown_connections 2024-09-21T03:19:06.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.436+0000 7f69d0eda640 1 -- 172.21.15.105:0/3069034828 wait complete. 2024-09-21T03:19:06.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.438+0000 7f69d0eda640 1 Processor -- start 2024-09-21T03:19:06.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.438+0000 7f69d0eda640 1 -- start start 2024-09-21T03:19:06.442 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.440+0000 7f69d0eda640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69b4005250 0x7f69cc1f7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:06.442 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.440+0000 7f69d0eda640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69cc158550 0x7f69cc158960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:06.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.440+0000 7f69d0eda640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69cc0af1e0 0x7f69cc0af5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:06.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.440+0000 7f69d0eda640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f69cc0d02c0 con 0x7f69b4005250 2024-09-21T03:19:06.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.440+0000 7f69d0eda640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f69cc0b3a30 con 0x7f69cc158550 2024-09-21T03:19:06.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.440+0000 7f69d0eda640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f69cc0d0440 con 0x7f69cc0af1e0 2024-09-21T03:19:06.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.440+0000 7f69ca59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69b4005250 0x7f69cc1f7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:06.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.440+0000 7f69ca59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69b4005250 0x7f69cc1f7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:44032/0 (socket says 172.21.15.105:44032) 2024-09-21T03:19:06.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.440+0000 7f69ca59c640 1 -- 172.21.15.105:0/227464202 learned_addr learned my addr 172.21.15.105:0/227464202 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:06.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.440+0000 7f69c9d9b640 1 --2- 172.21.15.105:0/227464202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69cc158550 0x7f69cc158960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:06.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.440+0000 7f69cad9d640 1 --2- 172.21.15.105:0/227464202 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69cc0af1e0 0x7f69cc0af5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:06.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.440+0000 7f69ca59c640 1 -- 172.21.15.105:0/227464202 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69cc0af1e0 msgr2=0x7f69cc0af5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:06.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.440+0000 7f69ca59c640 1 --2- 172.21.15.105:0/227464202 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69cc0af1e0 0x7f69cc0af5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:06.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.440+0000 7f69ca59c640 1 -- 172.21.15.105:0/227464202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69cc158550 msgr2=0x7f69cc158960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:06.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.440+0000 7f69ca59c640 1 --2- 172.21.15.105:0/227464202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69cc158550 0x7f69cc158960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:06.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.440+0000 7f69ca59c640 1 -- 172.21.15.105:0/227464202 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69cc0afb30 con 0x7f69b4005250 2024-09-21T03:19:06.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.440+0000 7f69ca59c640 1 --2- 172.21.15.105:0/227464202 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69b4005250 0x7f69cc1f7cd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f69bc001ba0 tx=0x7f69bc0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:06.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.440+0000 7f69baffd640 1 -- 172.21.15.105:0/227464202 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69bc015070 con 0x7f69b4005250 2024-09-21T03:19:06.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.440+0000 7f69baffd640 1 -- 172.21.15.105:0/227464202 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69bc011900 con 0x7f69b4005250 2024-09-21T03:19:06.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.440+0000 7f69d0eda640 1 -- 172.21.15.105:0/227464202 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69cc1f5f20 con 0x7f69b4005250 2024-09-21T03:19:06.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.440+0000 7f69baffd640 1 -- 172.21.15.105:0/227464202 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69bc011d50 con 0x7f69b4005250 2024-09-21T03:19:06.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.440+0000 7f69d0eda640 1 -- 172.21.15.105:0/227464202 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69cc1f5540 con 0x7f69b4005250 2024-09-21T03:19:06.445 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.442+0000 7f69d0eda640 1 -- 172.21.15.105:0/227464202 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69cc1e40d0 con 0x7f69b4005250 2024-09-21T03:19:06.445 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.442+0000 7f69baffd640 1 -- 172.21.15.105:0/227464202 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f69bc018070 con 0x7f69b4005250 2024-09-21T03:19:06.445 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.443+0000 7f69baffd640 1 --2- 172.21.15.105:0/227464202 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f69ac078b90 0x7f69ac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:06.445 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.443+0000 7f69baffd640 1 -- 172.21.15.105:0/227464202 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f69bc09b670 con 0x7f69b4005250 2024-09-21T03:19:06.445 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.443+0000 7f69c9d9b640 1 --2- 172.21.15.105:0/227464202 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f69ac078b90 0x7f69ac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:06.445 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.444+0000 7f69c9d9b640 1 --2- 172.21.15.105:0/227464202 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f69ac078b90 0x7f69ac07b0a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f69cc1ef3d0 tx=0x7f69c0005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:06.449 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.447+0000 7f69baffd640 1 -- 172.21.15.105:0/227464202 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f69cc0afb30 con 0x7f69b4005250 2024-09-21T03:19:06.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.691+0000 7f69d0eda640 1 -- 172.21.15.105:0/227464202 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f69cc06fec0 con 0x7f69b4005250 2024-09-21T03:19:06.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.694+0000 7f69baffd640 1 -- 172.21.15.105:0/227464202 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7f69bc0637c0 con 0x7f69b4005250 2024-09-21T03:19:06.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.697+0000 7f69d0eda640 1 -- 172.21.15.105:0/227464202 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f69ac078b90 msgr2=0x7f69ac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:06.699 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.697+0000 7f69d0eda640 1 --2- 172.21.15.105:0/227464202 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f69ac078b90 0x7f69ac07b0a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f69cc1ef3d0 tx=0x7f69c0005f90 comp rx=0 tx=0).stop 2024-09-21T03:19:06.699 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.697+0000 7f69d0eda640 1 -- 172.21.15.105:0/227464202 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69b4005250 msgr2=0x7f69cc1f7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:06.699 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.697+0000 7f69d0eda640 1 --2- 172.21.15.105:0/227464202 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69b4005250 0x7f69cc1f7cd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f69bc001ba0 tx=0x7f69bc0039c0 comp rx=0 tx=0).stop 2024-09-21T03:19:06.699 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.697+0000 7f69d0eda640 1 -- 172.21.15.105:0/227464202 shutdown_connections 2024-09-21T03:19:06.699 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.697+0000 7f69d0eda640 1 --2- 172.21.15.105:0/227464202 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f69ac078b90 0x7f69ac07b0a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:06.699 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.697+0000 7f69d0eda640 1 --2- 172.21.15.105:0/227464202 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69cc0af1e0 0x7f69cc0af5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:06.699 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.697+0000 7f69d0eda640 1 --2- 172.21.15.105:0/227464202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69cc158550 0x7f69cc158960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:06.699 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.697+0000 7f69d0eda640 1 --2- 172.21.15.105:0/227464202 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69b4005250 0x7f69cc1f7cd0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:06.699 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.697+0000 7f69d0eda640 1 -- 172.21.15.105:0/227464202 >> 172.21.15.105:0/227464202 conn(0x7f69cc0cdcc0 msgr2=0x7f69cc0b1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:06.699 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.697+0000 7f69d0eda640 1 -- 172.21.15.105:0/227464202 shutdown_connections 2024-09-21T03:19:06.699 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.697+0000 7f69d0eda640 1 -- 172.21.15.105:0/227464202 wait complete. 2024-09-21T03:19:06.709 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-21T03:19:06.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.821+0000 7f7c73ef2640 1 -- 172.21.15.105:0/3600918632 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c58003fd0 msgr2=0x7f7c58004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:06.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.821+0000 7f7c73ef2640 1 --2- 172.21.15.105:0/3600918632 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c58003fd0 0x7f7c58004800 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c009b20 tx=0x7f7c58005830 comp rx=0 tx=0).stop 2024-09-21T03:19:06.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.821+0000 7f7c7248f640 1 -- 172.21.15.105:0/3600918632 reap_dead start 2024-09-21T03:19:06.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.821+0000 7f7c73ef2640 1 -- 172.21.15.105:0/3600918632 shutdown_connections 2024-09-21T03:19:06.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.821+0000 7f7c73ef2640 1 -- 172.21.15.105:0/3600918632 >> 172.21.15.105:0/3600918632 conn(0x7f7c6c0710b0 msgr2=0x7f7c6c0714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:06.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.821+0000 7f7c73ef2640 1 -- 172.21.15.105:0/3600918632 shutdown_connections 2024-09-21T03:19:06.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.821+0000 7f7c73ef2640 1 -- 172.21.15.105:0/3600918632 wait complete. 2024-09-21T03:19:06.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.823+0000 7f7c73ef2640 1 Processor -- start 2024-09-21T03:19:06.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.823+0000 7f7c73ef2640 1 -- start start 2024-09-21T03:19:06.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.824+0000 7f7c73ef2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c58003fd0 0x7f7c6c14ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:06.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.824+0000 7f7c73ef2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c6c15d090 0x7f7c6c14b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:06.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.824+0000 7f7c73ef2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c6c15e860 0x7f7c6c14bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:06.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.824+0000 7f7c73ef2640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6c15c6a0 con 0x7f7c58003fd0 2024-09-21T03:19:06.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.824+0000 7f7c73ef2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6c0d13b0 con 0x7f7c6c15e860 2024-09-21T03:19:06.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.824+0000 7f7c73ef2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7c6c15c820 con 0x7f7c6c15d090 2024-09-21T03:19:06.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.824+0000 7f7c71c8e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c58003fd0 0x7f7c6c14ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:06.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.824+0000 7f7c71c8e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c58003fd0 0x7f7c6c14ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:44048/0 (socket says 172.21.15.105:44048) 2024-09-21T03:19:06.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.824+0000 7f7c71c8e640 1 -- 172.21.15.105:0/1854657768 learned_addr learned my addr 172.21.15.105:0/1854657768 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:06.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.824+0000 7f7c7148d640 1 --2- 172.21.15.105:0/1854657768 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c6c15d090 0x7f7c6c14b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:06.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.824+0000 7f7c71c8e640 1 -- 172.21.15.105:0/1854657768 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c6c15d090 msgr2=0x7f7c6c14b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:06.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.824+0000 7f7c7248f640 1 --2- 172.21.15.105:0/1854657768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c6c15e860 0x7f7c6c14bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:06.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.824+0000 7f7c71c8e640 1 --2- 172.21.15.105:0/1854657768 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c6c15d090 0x7f7c6c14b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:06.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.824+0000 7f7c71c8e640 1 -- 172.21.15.105:0/1854657768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c6c15e860 msgr2=0x7f7c6c14bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:06.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.824+0000 7f7c71c8e640 1 --2- 172.21.15.105:0/1854657768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c6c15e860 0x7f7c6c14bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:06.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.824+0000 7f7c71c8e640 1 -- 172.21.15.105:0/1854657768 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c6c15d7c0 con 0x7f7c58003fd0 2024-09-21T03:19:06.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.824+0000 7f7c7148d640 1 --2- 172.21.15.105:0/1854657768 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c6c15d090 0x7f7c6c14b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:19:06.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.825+0000 7f7c71c8e640 1 --2- 172.21.15.105:0/1854657768 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c58003fd0 0x7f7c6c14ae60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7c68011a80 tx=0x7f7c68011f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:06.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.825+0000 7f7c627fc640 1 -- 172.21.15.105:0/1854657768 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6800fd50 con 0x7f7c58003fd0 2024-09-21T03:19:06.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.825+0000 7f7c627fc640 1 -- 172.21.15.105:0/1854657768 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c68016070 con 0x7f7c58003fd0 2024-09-21T03:19:06.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.825+0000 7f7c627fc640 1 -- 172.21.15.105:0/1854657768 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c680126b0 con 0x7f7c58003fd0 2024-09-21T03:19:06.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.825+0000 7f7c73ef2640 1 -- 172.21.15.105:0/1854657768 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c6c15daa0 con 0x7f7c58003fd0 2024-09-21T03:19:06.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.825+0000 7f7c73ef2640 1 -- 172.21.15.105:0/1854657768 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c6c15e060 con 0x7f7c58003fd0 2024-09-21T03:19:06.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.826+0000 7f7c73ef2640 1 -- 172.21.15.105:0/1854657768 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c6c06a5e0 con 0x7f7c58003fd0 2024-09-21T03:19:06.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.827+0000 7f7c627fc640 1 -- 172.21.15.105:0/1854657768 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7c68018030 con 0x7f7c58003fd0 2024-09-21T03:19:06.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.827+0000 7f7c627fc640 1 --2- 172.21.15.105:0/1854657768 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7c50078bc0 0x7f7c5007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:06.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.827+0000 7f7c627fc640 1 -- 172.21.15.105:0/1854657768 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f7c6809b1b0 con 0x7f7c58003fd0 2024-09-21T03:19:06.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.827+0000 7f7c7148d640 1 --2- 172.21.15.105:0/1854657768 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7c50078bc0 0x7f7c5007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:06.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.828+0000 7f7c7148d640 1 --2- 172.21.15.105:0/1854657768 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7c50078bc0 0x7f7c5007b0d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c035000 tx=0x7f7c5c0046c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:06.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:06.832+0000 7f7c627fc640 1 -- 172.21.15.105:0/1854657768 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7c6c06a5e0 con 0x7f7c58003fd0 2024-09-21T03:19:07.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.076+0000 7f7c73ef2640 1 -- 172.21.15.105:0/1854657768 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f7c6c0b5e90 con 0x7f7c58003fd0 2024-09-21T03:19:07.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.078+0000 7f7c627fc640 1 -- 172.21.15.105:0/1854657768 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f7c68063940 con 0x7f7c58003fd0 2024-09-21T03:19:07.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.080+0000 7f7c73ef2640 1 -- 172.21.15.105:0/1854657768 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7c50078bc0 msgr2=0x7f7c5007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:07.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.080+0000 7f7c73ef2640 1 --2- 172.21.15.105:0/1854657768 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7c50078bc0 0x7f7c5007b0d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c035000 tx=0x7f7c5c0046c0 comp rx=0 tx=0).stop 2024-09-21T03:19:07.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.081+0000 7f7c73ef2640 1 -- 172.21.15.105:0/1854657768 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c58003fd0 msgr2=0x7f7c6c14ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:07.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.081+0000 7f7c73ef2640 1 --2- 172.21.15.105:0/1854657768 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c58003fd0 0x7f7c6c14ae60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7c68011a80 tx=0x7f7c68011f40 comp rx=0 tx=0).stop 2024-09-21T03:19:07.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.081+0000 7f7c73ef2640 1 -- 172.21.15.105:0/1854657768 shutdown_connections 2024-09-21T03:19:07.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.081+0000 7f7c73ef2640 1 --2- 172.21.15.105:0/1854657768 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7c50078bc0 0x7f7c5007b0d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:07.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.081+0000 7f7c73ef2640 1 --2- 172.21.15.105:0/1854657768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c6c15e860 0x7f7c6c14bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:07.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.081+0000 7f7c73ef2640 1 --2- 172.21.15.105:0/1854657768 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c6c15d090 0x7f7c6c14b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:07.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.081+0000 7f7c73ef2640 1 --2- 172.21.15.105:0/1854657768 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c58003fd0 0x7f7c6c14ae60 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:07.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.081+0000 7f7c73ef2640 1 -- 172.21.15.105:0/1854657768 >> 172.21.15.105:0/1854657768 conn(0x7f7c6c0710b0 msgr2=0x7f7c6c0725c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:07.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.081+0000 7f7c73ef2640 1 -- 172.21.15.105:0/1854657768 shutdown_connections 2024-09-21T03:19:07.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.081+0000 7f7c73ef2640 1 -- 172.21.15.105:0/1854657768 wait complete. 2024-09-21T03:19:07.094 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-21T03:19:07.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.214+0000 7fddb5da9640 1 -- 172.21.15.105:0/1068739415 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddb00b7cc0 msgr2=0x7fddb00cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:07.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.214+0000 7fddb5da9640 1 --2- 172.21.15.105:0/1068739415 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddb00b7cc0 0x7fddb00cec10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fddb0074fd0 tx=0x7fdda402a560 comp rx=0 tx=0).stop 2024-09-21T03:19:07.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.215+0000 7fddb5da9640 1 -- 172.21.15.105:0/1068739415 shutdown_connections 2024-09-21T03:19:07.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.215+0000 7fddb5da9640 1 --2- 172.21.15.105:0/1068739415 >> v2:172.21.15.162:3300/0 conn(0x7fddb00cf150 0x7fddb00b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:07.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.215+0000 7fddb5da9640 1 --2- 172.21.15.105:0/1068739415 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddb00b7cc0 0x7fddb00cec10 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:07.218 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.215+0000 7fddb5da9640 1 --2- 172.21.15.105:0/1068739415 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fddb01600b0 0x7fddb00ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:07.218 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.215+0000 7fddb5da9640 1 -- 172.21.15.105:0/1068739415 >> 172.21.15.105:0/1068739415 conn(0x7fddb006d4f0 msgr2=0x7fddb0071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:07.218 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.215+0000 7fddb5da9640 1 -- 172.21.15.105:0/1068739415 shutdown_connections 2024-09-21T03:19:07.218 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.215+0000 7fddb5da9640 1 -- 172.21.15.105:0/1068739415 wait complete. 2024-09-21T03:19:07.218 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.216+0000 7fddb5da9640 1 Processor -- start 2024-09-21T03:19:07.218 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.216+0000 7fddb5da9640 1 -- start start 2024-09-21T03:19:07.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.218+0000 7fddb5da9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fddb00b7cc0 0x7fddb00a94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:07.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.218+0000 7fddb5da9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddb00cf150 0x7fddb01f3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:07.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.218+0000 7fddb5da9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fddb01600b0 0x7fddb0158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:07.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.218+0000 7fddb5da9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fddb00b4620 con 0x7fddb00cf150 2024-09-21T03:19:07.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.218+0000 7fddb5da9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fddb00b44a0 con 0x7fddb01600b0 2024-09-21T03:19:07.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.218+0000 7fddb5da9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fddb00b47a0 con 0x7fddb00b7cc0 2024-09-21T03:19:07.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.218+0000 7fddaeffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddb00cf150 0x7fddb01f3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:07.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.218+0000 7fddaeffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddb00cf150 0x7fddb01f3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:44062/0 (socket says 172.21.15.105:44062) 2024-09-21T03:19:07.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.218+0000 7fddaeffd640 1 -- 172.21.15.105:0/3178220819 learned_addr learned my addr 172.21.15.105:0/3178220819 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:07.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.218+0000 7fddaffff640 1 --2- 172.21.15.105:0/3178220819 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fddb01600b0 0x7fddb0158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:07.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.218+0000 7fddaf7fe640 1 --2- 172.21.15.105:0/3178220819 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fddb00b7cc0 0x7fddb00a94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:07.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.218+0000 7fddaeffd640 1 -- 172.21.15.105:0/3178220819 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fddb00b7cc0 msgr2=0x7fddb00a94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:07.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.218+0000 7fddaeffd640 1 --2- 172.21.15.105:0/3178220819 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fddb00b7cc0 0x7fddb00a94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:07.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.218+0000 7fddaeffd640 1 -- 172.21.15.105:0/3178220819 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fddb01600b0 msgr2=0x7fddb0158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:07.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.218+0000 7fddaeffd640 1 --2- 172.21.15.105:0/3178220819 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fddb01600b0 0x7fddb0158580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:07.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.218+0000 7fddaeffd640 1 -- 172.21.15.105:0/3178220819 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddb01f4b60 con 0x7fddb00cf150 2024-09-21T03:19:07.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.218+0000 7fddaf7fe640 1 --2- 172.21.15.105:0/3178220819 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fddb00b7cc0 0x7fddb00a94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:19:07.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.218+0000 7fddaeffd640 1 --2- 172.21.15.105:0/3178220819 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddb00cf150 0x7fddb01f3b80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdda4034040 tx=0x7fdda4003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:07.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.219+0000 7fdd97fff640 1 -- 172.21.15.105:0/3178220819 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda403e030 con 0x7fddb00cf150 2024-09-21T03:19:07.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.219+0000 7fdd97fff640 1 -- 172.21.15.105:0/3178220819 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdda4003e00 con 0x7fddb00cf150 2024-09-21T03:19:07.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.219+0000 7fddb5da9640 1 -- 172.21.15.105:0/3178220819 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddb01f45a0 con 0x7fddb00cf150 2024-09-21T03:19:07.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.219+0000 7fdd97fff640 1 -- 172.21.15.105:0/3178220819 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda4035040 con 0x7fddb00cf150 2024-09-21T03:19:07.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.219+0000 7fddb5da9640 1 -- 172.21.15.105:0/3178220819 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddb00c9420 con 0x7fddb00cf150 2024-09-21T03:19:07.223 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.220+0000 7fddb5da9640 1 -- 172.21.15.105:0/3178220819 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddb00b3d50 con 0x7fddb00cf150 2024-09-21T03:19:07.223 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.220+0000 7fdd97fff640 1 -- 172.21.15.105:0/3178220819 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdda4041030 con 0x7fddb00cf150 2024-09-21T03:19:07.223 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.221+0000 7fdd97fff640 1 --2- 172.21.15.105:0/3178220819 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdd9c078b90 0x7fdd9c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:07.223 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.221+0000 7fdd97fff640 1 -- 172.21.15.105:0/3178220819 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7fdda40bb1f0 con 0x7fddb00cf150 2024-09-21T03:19:07.223 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.221+0000 7fddaf7fe640 1 --2- 172.21.15.105:0/3178220819 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdd9c078b90 0x7fdd9c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:07.223 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.221+0000 7fddaf7fe640 1 --2- 172.21.15.105:0/3178220819 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdd9c078b90 0x7fdd9c07b0a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdda000ab40 tx=0x7fdda000a520 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:07.227 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.225+0000 7fdd97fff640 1 -- 172.21.15.105:0/3178220819 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fdda40832b0 con 0x7fddb00cf150 2024-09-21T03:19:07.471 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.470+0000 7fddb5da9640 1 -- 172.21.15.105:0/3178220819 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7fddb00711d0 con 0x7fddb00cf150 2024-09-21T03:19:07.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.473+0000 7fdd97fff640 1 -- 172.21.15.105:0/3178220819 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7fdda4087ce0 con 0x7fddb00cf150 2024-09-21T03:19:07.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.475+0000 7fddb5da9640 1 -- 172.21.15.105:0/3178220819 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdd9c078b90 msgr2=0x7fdd9c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:07.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.475+0000 7fddb5da9640 1 --2- 172.21.15.105:0/3178220819 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdd9c078b90 0x7fdd9c07b0a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdda000ab40 tx=0x7fdda000a520 comp rx=0 tx=0).stop 2024-09-21T03:19:07.478 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.475+0000 7fddb5da9640 1 -- 172.21.15.105:0/3178220819 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddb00cf150 msgr2=0x7fddb01f3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:07.478 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.475+0000 7fddb5da9640 1 --2- 172.21.15.105:0/3178220819 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddb00cf150 0x7fddb01f3b80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdda4034040 tx=0x7fdda4003910 comp rx=0 tx=0).stop 2024-09-21T03:19:07.478 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.475+0000 7fddb5da9640 1 -- 172.21.15.105:0/3178220819 shutdown_connections 2024-09-21T03:19:07.478 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.475+0000 7fddb5da9640 1 --2- 172.21.15.105:0/3178220819 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdd9c078b90 0x7fdd9c07b0a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:07.478 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.475+0000 7fddb5da9640 1 --2- 172.21.15.105:0/3178220819 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fddb01600b0 0x7fddb0158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:07.478 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.475+0000 7fddb5da9640 1 --2- 172.21.15.105:0/3178220819 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddb00cf150 0x7fddb01f3b80 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:07.478 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.475+0000 7fddb5da9640 1 --2- 172.21.15.105:0/3178220819 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fddb00b7cc0 0x7fddb00a94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:07.478 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.475+0000 7fddb5da9640 1 -- 172.21.15.105:0/3178220819 >> 172.21.15.105:0/3178220819 conn(0x7fddb006d4f0 msgr2=0x7fddb00b24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:07.478 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.475+0000 7fddb5da9640 1 -- 172.21.15.105:0/3178220819 shutdown_connections 2024-09-21T03:19:07.479 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.475+0000 7fddb5da9640 1 -- 172.21.15.105:0/3178220819 wait complete. 2024-09-21T03:19:07.488 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-21T03:19:07.606 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.604+0000 7f409600e640 1 -- 172.21.15.105:0/2819145636 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f409015c580 msgr2=0x7f4090070540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:07.607 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.604+0000 7f409600e640 1 --2- 172.21.15.105:0/2819145636 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f409015c580 0x7f4090070540 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4078005fd0 tx=0x7f407802a670 comp rx=0 tx=0).stop 2024-09-21T03:19:07.607 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.604+0000 7f409600e640 1 -- 172.21.15.105:0/2819145636 shutdown_connections 2024-09-21T03:19:07.607 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.604+0000 7f409600e640 1 --2- 172.21.15.105:0/2819145636 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f409015c580 0x7f4090070540 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:07.607 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.604+0000 7f409600e640 1 -- 172.21.15.105:0/2819145636 >> 172.21.15.105:0/2819145636 conn(0x7f409006def0 msgr2=0x7f409006e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:07.607 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.604+0000 7f409600e640 1 -- 172.21.15.105:0/2819145636 shutdown_connections 2024-09-21T03:19:07.607 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.604+0000 7f409600e640 1 -- 172.21.15.105:0/2819145636 wait complete. 2024-09-21T03:19:07.608 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.606+0000 7f409600e640 1 Processor -- start 2024-09-21T03:19:07.608 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.606+0000 7f409600e640 1 -- start start 2024-09-21T03:19:07.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.607+0000 7f409600e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4090074420 0x7f40900b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:07.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.607+0000 7f409600e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4090155ce0 0x7f4090146ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:07.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.607+0000 7f409600e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f40900b1280 0x7f409015a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:07.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.607+0000 7f409600e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f40900b5280 con 0x7f4090074420 2024-09-21T03:19:07.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.607+0000 7f409600e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f40900b5100 con 0x7f4090155ce0 2024-09-21T03:19:07.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.607+0000 7f409600e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f40900b5400 con 0x7f40900b1280 2024-09-21T03:19:07.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.608+0000 7f408f7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4090074420 0x7f40900b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:07.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.608+0000 7f408f7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4090074420 0x7f40900b2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:44084/0 (socket says 172.21.15.105:44084) 2024-09-21T03:19:07.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.608+0000 7f408f7fe640 1 -- 172.21.15.105:0/1250008516 learned_addr learned my addr 172.21.15.105:0/1250008516 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:07.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.608+0000 7f4087fff640 1 --2- 172.21.15.105:0/1250008516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4090155ce0 0x7f4090146ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:07.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.608+0000 7f408ffff640 1 --2- 172.21.15.105:0/1250008516 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f40900b1280 0x7f409015a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:07.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.608+0000 7f408f7fe640 1 -- 172.21.15.105:0/1250008516 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f40900b1280 msgr2=0x7f409015a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:07.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.608+0000 7f408f7fe640 1 --2- 172.21.15.105:0/1250008516 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f40900b1280 0x7f409015a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:07.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.608+0000 7f408f7fe640 1 -- 172.21.15.105:0/1250008516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4090155ce0 msgr2=0x7f4090146ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:07.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.608+0000 7f408f7fe640 1 --2- 172.21.15.105:0/1250008516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4090155ce0 0x7f4090146ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:07.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.608+0000 7f408f7fe640 1 -- 172.21.15.105:0/1250008516 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40900b1a60 con 0x7f4090074420 2024-09-21T03:19:07.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.608+0000 7f408ffff640 1 --2- 172.21.15.105:0/1250008516 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f40900b1280 0x7f409015a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:19:07.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.608+0000 7f408f7fe640 1 --2- 172.21.15.105:0/1250008516 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4090074420 0x7f40900b2b00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f408000c370 tx=0x7f408000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:07.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.608+0000 7f408cff9640 1 -- 172.21.15.105:0/1250008516 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4080017070 con 0x7f4090074420 2024-09-21T03:19:07.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.608+0000 7f408cff9640 1 -- 172.21.15.105:0/1250008516 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f40800035f0 con 0x7f4090074420 2024-09-21T03:19:07.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.608+0000 7f409600e640 1 -- 172.21.15.105:0/1250008516 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40900b1d40 con 0x7f4090074420 2024-09-21T03:19:07.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.608+0000 7f408cff9640 1 -- 172.21.15.105:0/1250008516 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4080003a40 con 0x7f4090074420 2024-09-21T03:19:07.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.608+0000 7f409600e640 1 -- 172.21.15.105:0/1250008516 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40900b2300 con 0x7f4090074420 2024-09-21T03:19:07.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.609+0000 7f409600e640 1 -- 172.21.15.105:0/1250008516 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40900b0b20 con 0x7f4090074420 2024-09-21T03:19:07.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.610+0000 7f408cff9640 1 -- 172.21.15.105:0/1250008516 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f408001a070 con 0x7f4090074420 2024-09-21T03:19:07.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.610+0000 7f408cff9640 1 --2- 172.21.15.105:0/1250008516 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4070078b90 0x7f407007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:07.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.611+0000 7f408cff9640 1 -- 172.21.15.105:0/1250008516 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f4080099ce0 con 0x7f4090074420 2024-09-21T03:19:07.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.611+0000 7f4087fff640 1 --2- 172.21.15.105:0/1250008516 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4070078b90 0x7f407007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:07.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.611+0000 7f4087fff640 1 --2- 172.21.15.105:0/1250008516 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4070078b90 0x7f407007b0a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4078033000 tx=0x7f4078004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:07.616 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.615+0000 7f408cff9640 1 -- 172.21.15.105:0/1250008516 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f40900b0b20 con 0x7f4090074420 2024-09-21T03:19:07.862 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.861+0000 7f409600e640 1 -- 172.21.15.105:0/1250008516 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f409015c580 con 0x7f4090074420 2024-09-21T03:19:07.865 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.863+0000 7f408cff9640 1 -- 172.21.15.105:0/1250008516 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f4080062470 con 0x7f4090074420 2024-09-21T03:19:07.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.866+0000 7f409600e640 1 -- 172.21.15.105:0/1250008516 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4070078b90 msgr2=0x7f407007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:07.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.866+0000 7f409600e640 1 --2- 172.21.15.105:0/1250008516 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4070078b90 0x7f407007b0a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4078033000 tx=0x7f4078004730 comp rx=0 tx=0).stop 2024-09-21T03:19:07.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.866+0000 7f409600e640 1 -- 172.21.15.105:0/1250008516 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4090074420 msgr2=0x7f40900b2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:07.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.866+0000 7f409600e640 1 --2- 172.21.15.105:0/1250008516 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4090074420 0x7f40900b2b00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f408000c370 tx=0x7f408000c830 comp rx=0 tx=0).stop 2024-09-21T03:19:07.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.866+0000 7f409600e640 1 -- 172.21.15.105:0/1250008516 shutdown_connections 2024-09-21T03:19:07.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.866+0000 7f409600e640 1 --2- 172.21.15.105:0/1250008516 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4070078b90 0x7f407007b0a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:07.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.866+0000 7f409600e640 1 --2- 172.21.15.105:0/1250008516 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f40900b1280 0x7f409015a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:07.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.866+0000 7f409600e640 1 --2- 172.21.15.105:0/1250008516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4090155ce0 0x7f4090146ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:07.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.866+0000 7f409600e640 1 --2- 172.21.15.105:0/1250008516 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4090074420 0x7f40900b2b00 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:07.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.866+0000 7f409600e640 1 -- 172.21.15.105:0/1250008516 >> 172.21.15.105:0/1250008516 conn(0x7f409006def0 msgr2=0x7f40900cfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:07.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.866+0000 7f409600e640 1 -- 172.21.15.105:0/1250008516 shutdown_connections 2024-09-21T03:19:07.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.866+0000 7f409600e640 1 -- 172.21.15.105:0/1250008516 wait complete. 2024-09-21T03:19:07.879 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-21T03:19:07.994 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.992+0000 7ffa8b18b640 1 -- 172.21.15.105:0/1001938619 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa841600b0 msgr2=0x7ffa840ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:07.994 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.992+0000 7ffa8b18b640 1 --2- 172.21.15.105:0/1001938619 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa841600b0 0x7ffa840ccbc0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ffa840b7c50 tx=0x7ffa7402a5f0 comp rx=0 tx=0).stop 2024-09-21T03:19:07.994 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.992+0000 7ffa8b18b640 1 -- 172.21.15.105:0/1001938619 shutdown_connections 2024-09-21T03:19:07.994 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.992+0000 7ffa8b18b640 1 --2- 172.21.15.105:0/1001938619 >> v2:172.21.15.162:3300/0 conn(0x7ffa840cf320 0x7ffa840d0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:07.994 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.992+0000 7ffa8b18b640 1 --2- 172.21.15.105:0/1001938619 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa841600b0 0x7ffa840ccbc0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:07.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.992+0000 7ffa8b18b640 1 -- 172.21.15.105:0/1001938619 >> 172.21.15.105:0/1001938619 conn(0x7ffa8406d4f0 msgr2=0x7ffa84071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:07.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.992+0000 7ffa8b18b640 1 -- 172.21.15.105:0/1001938619 shutdown_connections 2024-09-21T03:19:07.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.992+0000 7ffa8b18b640 1 -- 172.21.15.105:0/1001938619 wait complete. 2024-09-21T03:19:07.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.994+0000 7ffa8b18b640 1 Processor -- start 2024-09-21T03:19:07.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.994+0000 7ffa8b18b640 1 -- start start 2024-09-21T03:19:07.998 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.995+0000 7ffa8b18b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa840b7cc0 0x7ffa840cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:07.998 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.995+0000 7ffa8b18b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa840cf320 0x7ffa841f71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:07.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.995+0000 7ffa8b18b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa841600b0 0x7ffa84156420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:07.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.995+0000 7ffa8b18b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ffa840d13c0 con 0x7ffa841600b0 2024-09-21T03:19:07.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.995+0000 7ffa8b18b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ffa840d1240 con 0x7ffa840cf320 2024-09-21T03:19:07.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.995+0000 7ffa8b18b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ffa840d1540 con 0x7ffa840b7cc0 2024-09-21T03:19:07.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.996+0000 7ffa89728640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa841600b0 0x7ffa84156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:07.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.996+0000 7ffa89728640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa841600b0 0x7ffa84156420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:44092/0 (socket says 172.21.15.105:44092) 2024-09-21T03:19:07.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.996+0000 7ffa89728640 1 -- 172.21.15.105:0/2383031257 learned_addr learned my addr 172.21.15.105:0/2383031257 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:07.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.996+0000 7ffa83fff640 1 --2- 172.21.15.105:0/2383031257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa840cf320 0x7ffa841f71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:07.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.996+0000 7ffa88f27640 1 --2- 172.21.15.105:0/2383031257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa840b7cc0 0x7ffa840cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:07.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.996+0000 7ffa89728640 1 -- 172.21.15.105:0/2383031257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa840b7cc0 msgr2=0x7ffa840cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:07.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.996+0000 7ffa89728640 1 --2- 172.21.15.105:0/2383031257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa840b7cc0 0x7ffa840cbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:07.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.996+0000 7ffa89728640 1 -- 172.21.15.105:0/2383031257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa840cf320 msgr2=0x7ffa841f71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:08.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.996+0000 7ffa89728640 1 --2- 172.21.15.105:0/2383031257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa840cf320 0x7ffa841f71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:08.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.996+0000 7ffa89728640 1 -- 172.21.15.105:0/2383031257 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa840cc210 con 0x7ffa841600b0 2024-09-21T03:19:08.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.996+0000 7ffa83fff640 1 --2- 172.21.15.105:0/2383031257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa840cf320 0x7ffa841f71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:19:08.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.996+0000 7ffa89728640 1 --2- 172.21.15.105:0/2383031257 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa841600b0 0x7ffa84156420 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c00d650 tx=0x7ffa7c00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:08.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.996+0000 7ffa817fa640 1 -- 172.21.15.105:0/2383031257 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c017070 con 0x7ffa841600b0 2024-09-21T03:19:08.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.996+0000 7ffa817fa640 1 -- 172.21.15.105:0/2383031257 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa7c005310 con 0x7ffa841600b0 2024-09-21T03:19:08.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.996+0000 7ffa8b18b640 1 -- 172.21.15.105:0/2383031257 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa841f3a20 con 0x7ffa841600b0 2024-09-21T03:19:08.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.996+0000 7ffa817fa640 1 -- 172.21.15.105:0/2383031257 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c009820 con 0x7ffa841600b0 2024-09-21T03:19:08.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.996+0000 7ffa8b18b640 1 -- 172.21.15.105:0/2383031257 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa840c94b0 con 0x7ffa841600b0 2024-09-21T03:19:08.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.997+0000 7ffa8b18b640 1 -- 172.21.15.105:0/2383031257 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa840d1a60 con 0x7ffa841600b0 2024-09-21T03:19:08.001 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.998+0000 7ffa817fa640 1 -- 172.21.15.105:0/2383031257 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ffa7c0099c0 con 0x7ffa841600b0 2024-09-21T03:19:08.001 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.998+0000 7ffa817fa640 1 --2- 172.21.15.105:0/2383031257 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ffa64078b90 0x7ffa6407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:08.001 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.999+0000 7ffa817fa640 1 -- 172.21.15.105:0/2383031257 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7ffa7c09a910 con 0x7ffa841600b0 2024-09-21T03:19:08.001 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.999+0000 7ffa88f27640 1 --2- 172.21.15.105:0/2383031257 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ffa64078b90 0x7ffa6407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:08.001 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:07.999+0000 7ffa88f27640 1 --2- 172.21.15.105:0/2383031257 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ffa64078b90 0x7ffa6407b0a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ffa74033000 tx=0x7ffa74004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:08.004 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.003+0000 7ffa817fa640 1 -- 172.21.15.105:0/2383031257 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ffa7c0631c0 con 0x7ffa841600b0 2024-09-21T03:19:08.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.250+0000 7ffa8b18b640 1 -- 172.21.15.105:0/2383031257 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7ffa840d2f30 con 0x7ffa841600b0 2024-09-21T03:19:08.254 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.253+0000 7ffa817fa640 1 -- 172.21.15.105:0/2383031257 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) ==== 97+0+0 (secure 0 0 0) 0x7ffa7c062ac0 con 0x7ffa841600b0 2024-09-21T03:19:08.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.255+0000 7ffa8b18b640 1 -- 172.21.15.105:0/2383031257 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ffa64078b90 msgr2=0x7ffa6407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:08.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.255+0000 7ffa8b18b640 1 --2- 172.21.15.105:0/2383031257 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ffa64078b90 0x7ffa6407b0a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ffa74033000 tx=0x7ffa74004730 comp rx=0 tx=0).stop 2024-09-21T03:19:08.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.255+0000 7ffa8b18b640 1 -- 172.21.15.105:0/2383031257 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa841600b0 msgr2=0x7ffa84156420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:08.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.255+0000 7ffa8b18b640 1 --2- 172.21.15.105:0/2383031257 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa841600b0 0x7ffa84156420 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c00d650 tx=0x7ffa7c00db10 comp rx=0 tx=0).stop 2024-09-21T03:19:08.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.255+0000 7ffa8b18b640 1 -- 172.21.15.105:0/2383031257 shutdown_connections 2024-09-21T03:19:08.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.255+0000 7ffa8b18b640 1 --2- 172.21.15.105:0/2383031257 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ffa64078b90 0x7ffa6407b0a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:08.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.255+0000 7ffa8b18b640 1 --2- 172.21.15.105:0/2383031257 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa841600b0 0x7ffa84156420 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:08.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.255+0000 7ffa8b18b640 1 --2- 172.21.15.105:0/2383031257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa840cf320 0x7ffa841f71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:08.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.255+0000 7ffa8b18b640 1 --2- 172.21.15.105:0/2383031257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa840b7cc0 0x7ffa840cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:08.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.255+0000 7ffa8b18b640 1 -- 172.21.15.105:0/2383031257 >> 172.21.15.105:0/2383031257 conn(0x7ffa8406d4f0 msgr2=0x7ffa8415f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:08.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.255+0000 7ffa8b18b640 1 -- 172.21.15.105:0/2383031257 shutdown_connections 2024-09-21T03:19:08.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.255+0000 7ffa8b18b640 1 -- 172.21.15.105:0/2383031257 wait complete. 2024-09-21T03:19:08.268 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-21T03:19:08.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.379+0000 7f3e52470640 1 -- 172.21.15.105:0/1644691891 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e34003a50 msgr2=0x7f3e34003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:08.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.380+0000 7f3e52470640 1 --2- 172.21.15.105:0/1644691891 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e34003a50 0x7f3e34003ec0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c00c4a0 tx=0x7f3e34005830 comp rx=0 tx=0).stop 2024-09-21T03:19:08.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.380+0000 7f3e52470640 1 -- 172.21.15.105:0/1644691891 shutdown_connections 2024-09-21T03:19:08.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.380+0000 7f3e52470640 1 --2- 172.21.15.105:0/1644691891 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e34003a50 0x7f3e34003ec0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:08.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.380+0000 7f3e52470640 1 -- 172.21.15.105:0/1644691891 >> 172.21.15.105:0/1644691891 conn(0x7f3e4c06d7d0 msgr2=0x7f3e4c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:08.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.380+0000 7f3e52470640 1 -- 172.21.15.105:0/1644691891 shutdown_connections 2024-09-21T03:19:08.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.380+0000 7f3e52470640 1 -- 172.21.15.105:0/1644691891 wait complete. 2024-09-21T03:19:08.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.381+0000 7f3e52470640 1 Processor -- start 2024-09-21T03:19:08.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.382+0000 7f3e52470640 1 -- start start 2024-09-21T03:19:08.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.383+0000 7f3e52470640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e34003a50 0x7f3e4c0c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:08.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.383+0000 7f3e52470640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e4c14f230 0x7f3e4c0cb630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:08.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.383+0000 7f3e52470640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e4c14f640 0x7f3e4c0cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:08.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.383+0000 7f3e52470640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4c0cd0e0 con 0x7f3e4c14f230 2024-09-21T03:19:08.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.383+0000 7f3e52470640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4c0ccf60 con 0x7f3e34003a50 2024-09-21T03:19:08.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.383+0000 7f3e52470640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3e4c0cd260 con 0x7f3e4c14f640 2024-09-21T03:19:08.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.383+0000 7f3e4b7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e4c14f230 0x7f3e4c0cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:08.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.383+0000 7f3e4b7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e4c14f230 0x7f3e4c0cb630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:44114/0 (socket says 172.21.15.105:44114) 2024-09-21T03:19:08.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.383+0000 7f3e4b7fe640 1 -- 172.21.15.105:0/1930491016 learned_addr learned my addr 172.21.15.105:0/1930491016 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:08.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.383+0000 7f3e4bfff640 1 --2- 172.21.15.105:0/1930491016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e34003a50 0x7f3e4c0c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:08.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.383+0000 7f3e50a0d640 1 --2- 172.21.15.105:0/1930491016 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e4c14f640 0x7f3e4c0cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:08.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.383+0000 7f3e4b7fe640 1 -- 172.21.15.105:0/1930491016 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e4c14f640 msgr2=0x7f3e4c0cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:08.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.383+0000 7f3e4b7fe640 1 --2- 172.21.15.105:0/1930491016 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e4c14f640 0x7f3e4c0cbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:08.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.383+0000 7f3e4b7fe640 1 -- 172.21.15.105:0/1930491016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e34003a50 msgr2=0x7f3e4c0c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:08.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.383+0000 7f3e4b7fe640 1 --2- 172.21.15.105:0/1930491016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e34003a50 0x7f3e4c0c9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:08.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.383+0000 7f3e4b7fe640 1 -- 172.21.15.105:0/1930491016 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e4c0c97a0 con 0x7f3e4c14f230 2024-09-21T03:19:08.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.383+0000 7f3e50a0d640 1 --2- 172.21.15.105:0/1930491016 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e4c14f640 0x7f3e4c0cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:19:08.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.383+0000 7f3e4b7fe640 1 --2- 172.21.15.105:0/1930491016 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e4c14f230 0x7f3e4c0cb630 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3e40004d60 tx=0x7f3e40001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:08.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.383+0000 7f3e48ff9640 1 -- 172.21.15.105:0/1930491016 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e400107d0 con 0x7f3e4c14f230 2024-09-21T03:19:08.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.384+0000 7f3e48ff9640 1 -- 172.21.15.105:0/1930491016 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e40016070 con 0x7f3e4c14f230 2024-09-21T03:19:08.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.384+0000 7f3e48ff9640 1 -- 172.21.15.105:0/1930491016 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e40010d00 con 0x7f3e4c14f230 2024-09-21T03:19:08.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.384+0000 7f3e52470640 1 -- 172.21.15.105:0/1930491016 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e4c073080 con 0x7f3e4c14f230 2024-09-21T03:19:08.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.384+0000 7f3e52470640 1 -- 172.21.15.105:0/1930491016 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e4c073640 con 0x7f3e4c14f230 2024-09-21T03:19:08.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.385+0000 7f3e52470640 1 -- 172.21.15.105:0/1930491016 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e4c0b43a0 con 0x7f3e4c14f230 2024-09-21T03:19:08.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.385+0000 7f3e48ff9640 1 -- 172.21.15.105:0/1930491016 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3e4001b460 con 0x7f3e4c14f230 2024-09-21T03:19:08.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.386+0000 7f3e48ff9640 1 --2- 172.21.15.105:0/1930491016 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3e38078b90 0x7f3e3807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:08.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.386+0000 7f3e48ff9640 1 -- 172.21.15.105:0/1930491016 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f3e4009b040 con 0x7f3e4c14f230 2024-09-21T03:19:08.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.386+0000 7f3e4bfff640 1 --2- 172.21.15.105:0/1930491016 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3e38078b90 0x7f3e3807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:08.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.387+0000 7f3e4bfff640 1 --2- 172.21.15.105:0/1930491016 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3e38078b90 0x7f3e3807b0a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c033000 tx=0x7f3e3c02d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:08.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.390+0000 7f3e48ff9640 1 -- 172.21.15.105:0/1930491016 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3e40063860 con 0x7f3e4c14f230 2024-09-21T03:19:08.635 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.633+0000 7f3e52470640 1 -- 172.21.15.105:0/1930491016 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f3e4c06fe20 con 0x7f3e4c14f230 2024-09-21T03:19:08.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.636+0000 7f3e48ff9640 1 -- 172.21.15.105:0/1930491016 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f3e40063160 con 0x7f3e4c14f230 2024-09-21T03:19:08.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.639+0000 7f3e52470640 1 -- 172.21.15.105:0/1930491016 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3e38078b90 msgr2=0x7f3e3807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:08.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.639+0000 7f3e52470640 1 --2- 172.21.15.105:0/1930491016 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3e38078b90 0x7f3e3807b0a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c033000 tx=0x7f3e3c02d040 comp rx=0 tx=0).stop 2024-09-21T03:19:08.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.639+0000 7f3e52470640 1 -- 172.21.15.105:0/1930491016 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e4c14f230 msgr2=0x7f3e4c0cb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:08.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.639+0000 7f3e52470640 1 --2- 172.21.15.105:0/1930491016 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e4c14f230 0x7f3e4c0cb630 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3e40004d60 tx=0x7f3e40001630 comp rx=0 tx=0).stop 2024-09-21T03:19:08.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.639+0000 7f3e52470640 1 -- 172.21.15.105:0/1930491016 shutdown_connections 2024-09-21T03:19:08.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.639+0000 7f3e52470640 1 --2- 172.21.15.105:0/1930491016 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3e38078b90 0x7f3e3807b0a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:08.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.639+0000 7f3e52470640 1 --2- 172.21.15.105:0/1930491016 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e4c14f640 0x7f3e4c0cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:08.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.639+0000 7f3e52470640 1 --2- 172.21.15.105:0/1930491016 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e4c14f230 0x7f3e4c0cb630 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:08.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.639+0000 7f3e52470640 1 --2- 172.21.15.105:0/1930491016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e34003a50 0x7f3e4c0c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:08.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.639+0000 7f3e52470640 1 -- 172.21.15.105:0/1930491016 >> 172.21.15.105:0/1930491016 conn(0x7f3e4c06d7d0 msgr2=0x7f3e4c0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:08.642 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.639+0000 7f3e52470640 1 -- 172.21.15.105:0/1930491016 shutdown_connections 2024-09-21T03:19:08.642 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.639+0000 7f3e52470640 1 -- 172.21.15.105:0/1930491016 wait complete. 2024-09-21T03:19:08.652 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T03:19:08.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.762+0000 7f943c42e640 1 -- 172.21.15.105:0/1795725344 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f94340cf320 msgr2=0x7f94340ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:08.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.762+0000 7f943c42e640 1 --2- 172.21.15.105:0/1795725344 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f94340cf320 0x7f94340ccbc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9428005fd0 tx=0x7f942802a5d0 comp rx=0 tx=0).stop 2024-09-21T03:19:08.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.762+0000 7f943c42e640 1 -- 172.21.15.105:0/1795725344 shutdown_connections 2024-09-21T03:19:08.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.762+0000 7f943c42e640 1 --2- 172.21.15.105:0/1795725344 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f94340cf320 0x7f94340ccbc0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:08.766 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.762+0000 7f943c42e640 1 --2- 172.21.15.105:0/1795725344 >> v2:172.21.15.162:3300/0 conn(0x7f94340b7cc0 0x7f94340d0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:08.766 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.762+0000 7f943c42e640 1 -- 172.21.15.105:0/1795725344 >> 172.21.15.105:0/1795725344 conn(0x7f943406d4f0 msgr2=0x7f9434071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:08.766 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.762+0000 7f943c42e640 1 -- 172.21.15.105:0/1795725344 shutdown_connections 2024-09-21T03:19:08.766 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.762+0000 7f943c42e640 1 -- 172.21.15.105:0/1795725344 wait complete. 2024-09-21T03:19:08.770 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.764+0000 7f943c42e640 1 Processor -- start 2024-09-21T03:19:08.770 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.764+0000 7f943c42e640 1 -- start start 2024-09-21T03:19:08.771 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.765+0000 7f943c42e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94340b7cc0 0x7f943414a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:08.771 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.765+0000 7f943c42e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f94340cf320 0x7f94340b3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:08.771 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.765+0000 7f943c42e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94341600b0 0x7f94340caff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:08.771 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.765+0000 7f943c42e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f94340d1410 con 0x7f94341600b0 2024-09-21T03:19:08.771 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.765+0000 7f943c42e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f94340d1290 con 0x7f94340b7cc0 2024-09-21T03:19:08.771 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.765+0000 7f943c42e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f94340d1590 con 0x7f94340cf320 2024-09-21T03:19:08.771 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.766+0000 7f943a9cb640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94341600b0 0x7f94340caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:08.772 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.766+0000 7f943a9cb640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94341600b0 0x7f94340caff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:44126/0 (socket says 172.21.15.105:44126) 2024-09-21T03:19:08.772 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.766+0000 7f943a9cb640 1 -- 172.21.15.105:0/3421531890 learned_addr learned my addr 172.21.15.105:0/3421531890 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:08.772 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.766+0000 7f94399c9640 1 --2- 172.21.15.105:0/3421531890 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f94340cf320 0x7f94340b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:08.772 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.766+0000 7f943a1ca640 1 --2- 172.21.15.105:0/3421531890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94340b7cc0 0x7f943414a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:08.772 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.766+0000 7f943a9cb640 1 -- 172.21.15.105:0/3421531890 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f94340cf320 msgr2=0x7f94340b3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:08.772 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.766+0000 7f943a9cb640 1 --2- 172.21.15.105:0/3421531890 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f94340cf320 0x7f94340b3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:08.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.766+0000 7f943a9cb640 1 -- 172.21.15.105:0/3421531890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94340b7cc0 msgr2=0x7f943414a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:08.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.766+0000 7f943a9cb640 1 --2- 172.21.15.105:0/3421531890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94340b7cc0 0x7f943414a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:08.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.766+0000 7f943a9cb640 1 -- 172.21.15.105:0/3421531890 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94340b3940 con 0x7f94341600b0 2024-09-21T03:19:08.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.766+0000 7f943a9cb640 1 --2- 172.21.15.105:0/3421531890 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94341600b0 0x7f94340caff0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f942c00e970 tx=0x7f942c00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:08.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.766+0000 7f9432ffd640 1 -- 172.21.15.105:0/3421531890 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f942c00cd80 con 0x7f94341600b0 2024-09-21T03:19:08.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.766+0000 7f9432ffd640 1 -- 172.21.15.105:0/3421531890 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f942c004020 con 0x7f94341600b0 2024-09-21T03:19:08.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.766+0000 7f9432ffd640 1 -- 172.21.15.105:0/3421531890 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f942c004470 con 0x7f94341600b0 2024-09-21T03:19:08.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.766+0000 7f943c42e640 1 -- 172.21.15.105:0/3421531890 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94340ca650 con 0x7f94341600b0 2024-09-21T03:19:08.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.766+0000 7f943c42e640 1 -- 172.21.15.105:0/3421531890 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94340b2c00 con 0x7f94341600b0 2024-09-21T03:19:08.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.767+0000 7f943c42e640 1 -- 172.21.15.105:0/3421531890 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94340b2740 con 0x7f94341600b0 2024-09-21T03:19:08.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.768+0000 7f9432ffd640 1 -- 172.21.15.105:0/3421531890 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f942c0035f0 con 0x7f94341600b0 2024-09-21T03:19:08.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.768+0000 7f9432ffd640 1 --2- 172.21.15.105:0/3421531890 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9420078bc0 0x7f942007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:08.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.769+0000 7f9432ffd640 1 -- 172.21.15.105:0/3421531890 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f942c09b280 con 0x7f94341600b0 2024-09-21T03:19:08.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.769+0000 7f943a1ca640 1 --2- 172.21.15.105:0/3421531890 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9420078bc0 0x7f942007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:08.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.769+0000 7f943a1ca640 1 --2- 172.21.15.105:0/3421531890 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9420078bc0 0x7f942007b0d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9424001e00 tx=0x7f9424009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:08.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.773+0000 7f9432ffd640 1 -- 172.21.15.105:0/3421531890 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f94340b2740 con 0x7f94341600b0 2024-09-21T03:19:08.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.951+0000 7f943c42e640 1 -- 172.21.15.105:0/3421531890 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f94340d1b20 con 0x7f94341600b0 2024-09-21T03:19:08.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.952+0000 7f9432ffd640 1 -- 172.21.15.105:0/3421531890 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) ==== 84+0+65 (secure 0 0 0) 0x7f942c0633d0 con 0x7f94341600b0 2024-09-21T03:19:08.953 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:19:08.953 INFO:teuthology.orchestra.run.smithi105.stdout:[ 2024-09-21T03:19:08.954 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:19:08.954 INFO:teuthology.orchestra.run.smithi105.stdout: "poolnum": 1, 2024-09-21T03:19:08.954 INFO:teuthology.orchestra.run.smithi105.stdout: "poolname": ".mgr" 2024-09-21T03:19:08.954 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:19:08.954 INFO:teuthology.orchestra.run.smithi105.stdout:] 2024-09-21T03:19:08.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.954+0000 7f943c42e640 1 -- 172.21.15.105:0/3421531890 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9420078bc0 msgr2=0x7f942007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:08.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.954+0000 7f943c42e640 1 --2- 172.21.15.105:0/3421531890 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9420078bc0 0x7f942007b0d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9424001e00 tx=0x7f9424009040 comp rx=0 tx=0).stop 2024-09-21T03:19:08.956 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.954+0000 7f943c42e640 1 -- 172.21.15.105:0/3421531890 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94341600b0 msgr2=0x7f94340caff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:08.956 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.954+0000 7f943c42e640 1 --2- 172.21.15.105:0/3421531890 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94341600b0 0x7f94340caff0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f942c00e970 tx=0x7f942c00ee30 comp rx=0 tx=0).stop 2024-09-21T03:19:08.956 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.954+0000 7f943c42e640 1 -- 172.21.15.105:0/3421531890 shutdown_connections 2024-09-21T03:19:08.956 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.954+0000 7f943c42e640 1 --2- 172.21.15.105:0/3421531890 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9420078bc0 0x7f942007b0d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:08.956 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.954+0000 7f943c42e640 1 --2- 172.21.15.105:0/3421531890 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94341600b0 0x7f94340caff0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:08.956 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.954+0000 7f943c42e640 1 --2- 172.21.15.105:0/3421531890 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f94340cf320 0x7f94340b3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:08.956 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.954+0000 7f943c42e640 1 --2- 172.21.15.105:0/3421531890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f94340b7cc0 0x7f943414a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:08.956 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.954+0000 7f943c42e640 1 -- 172.21.15.105:0/3421531890 >> 172.21.15.105:0/3421531890 conn(0x7f943406d4f0 msgr2=0x7f943415bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:08.956 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.954+0000 7f943c42e640 1 -- 172.21.15.105:0/3421531890 shutdown_connections 2024-09-21T03:19:08.956 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:08.954+0000 7f943c42e640 1 -- 172.21.15.105:0/3421531890 wait complete. 2024-09-21T03:19:08.967 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T03:19:08.967 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T03:19:09.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:09.086+0000 7f6411de4640 1 -- 172.21.15.105:0/4188483087 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f640c0d18f0 msgr2=0x7f640c06e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:09.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:09.086+0000 7f6411de4640 1 --2- 172.21.15.105:0/4188483087 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f640c0d18f0 0x7f640c06e610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f63fc009830 tx=0x7f63fc02a510 comp rx=0 tx=0).stop 2024-09-21T03:19:09.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:09.086+0000 7f6411de4640 1 -- 172.21.15.105:0/4188483087 shutdown_connections 2024-09-21T03:19:09.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:09.086+0000 7f6411de4640 1 --2- 172.21.15.105:0/4188483087 >> v2:172.21.15.162:3300/0 conn(0x7f640c0cfa70 0x7f640c0d23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:09.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:09.086+0000 7f6411de4640 1 --2- 172.21.15.105:0/4188483087 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f640c0d18f0 0x7f640c06e610 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:09.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:09.086+0000 7f6411de4640 1 -- 172.21.15.105:0/4188483087 >> 172.21.15.105:0/4188483087 conn(0x7f640c09d8a0 msgr2=0x7f640c08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:09.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:09.086+0000 7f6411de4640 1 -- 172.21.15.105:0/4188483087 shutdown_connections 2024-09-21T03:19:09.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:09.086+0000 7f6411de4640 1 -- 172.21.15.105:0/4188483087 wait complete. 2024-09-21T03:19:09.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:09.088+0000 7f6411de4640 1 Processor -- start 2024-09-21T03:19:09.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:09.088+0000 7f6411de4640 1 -- start start 2024-09-21T03:19:09.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:09.089+0000 7f6411de4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f640c0b96c0 0x7f640c0ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:09.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:09.089+0000 7f6411de4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f640c0d18f0 0x7f640c156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:09.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:09.089+0000 7f6411de4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f640c159630 0x7f640c159a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:09.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:09.089+0000 7f6411de4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f640c0d2e60 con 0x7f640c0d18f0 2024-09-21T03:19:09.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:09.089+0000 7f6411de4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f640c0d2ce0 con 0x7f640c0b96c0 2024-09-21T03:19:09.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:09.089+0000 7f6411de4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f640c0d2fe0 con 0x7f640c159630 2024-09-21T03:19:09.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:09.089+0000 7f640affd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f640c0d18f0 0x7f640c156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:09.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:09.089+0000 7f640affd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f640c0d18f0 0x7f640c156350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:44130/0 (socket says 172.21.15.105:44130) 2024-09-21T03:19:09.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:09.089+0000 7f640affd640 1 -- 172.21.15.105:0/369034620 learned_addr learned my addr 172.21.15.105:0/369034620 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:09.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:09.089+0000 7f640bfff640 1 --2- 172.21.15.105:0/369034620 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f640c159630 0x7f640c159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:09.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:09.089+0000 7f640b7fe640 1 --2- 172.21.15.105:0/369034620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f640c0b96c0 0x7f640c0ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:09.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:09.089+0000 7f640affd640 1 -- 172.21.15.105:0/369034620 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f640c159630 msgr2=0x7f640c159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:09.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:09.089+0000 7f640affd640 1 --2- 172.21.15.105:0/369034620 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f640c159630 0x7f640c159a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:09.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:09.089+0000 7f640affd640 1 -- 172.21.15.105:0/369034620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f640c0b96c0 msgr2=0x7f640c0ce1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:09.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:09.089+0000 7f640affd640 1 --2- 172.21.15.105:0/369034620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f640c0b96c0 0x7f640c0ce1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:09.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:09.089+0000 7f640affd640 1 -- 172.21.15.105:0/369034620 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f640c0ce730 con 0x7f640c0d18f0 2024-09-21T03:19:09.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:09.090+0000 7f640affd640 1 --2- 172.21.15.105:0/369034620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f640c0d18f0 0x7f640c156350 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f640000c400 tx=0x7f640000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:09.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:09.090+0000 7f63f3fff640 1 -- 172.21.15.105:0/369034620 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6400011790 con 0x7f640c0d18f0 2024-09-21T03:19:09.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:09.090+0000 7f63f3fff640 1 -- 172.21.15.105:0/369034620 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6400017070 con 0x7f640c0d18f0 2024-09-21T03:19:09.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:09.090+0000 7f6411de4640 1 -- 172.21.15.105:0/369034620 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f640c159f80 con 0x7f640c0d18f0 2024-09-21T03:19:09.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:09.090+0000 7f63f3fff640 1 -- 172.21.15.105:0/369034620 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6400011d00 con 0x7f640c0d18f0 2024-09-21T03:19:09.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:09.090+0000 7f6411de4640 1 -- 172.21.15.105:0/369034620 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f640c0b45f0 con 0x7f640c0d18f0 2024-09-21T03:19:09.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:09.091+0000 7f6411de4640 1 -- 172.21.15.105:0/369034620 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f640c0b4070 con 0x7f640c0d18f0 2024-09-21T03:19:09.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:09.092+0000 7f63f3fff640 1 -- 172.21.15.105:0/369034620 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f640001c460 con 0x7f640c0d18f0 2024-09-21T03:19:09.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:09.092+0000 7f63f3fff640 1 --2- 172.21.15.105:0/369034620 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f63f8078bc0 0x7f63f807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:09.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:09.092+0000 7f63f3fff640 1 -- 172.21.15.105:0/369034620 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f640009a670 con 0x7f640c0d18f0 2024-09-21T03:19:09.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:09.092+0000 7f640b7fe640 1 --2- 172.21.15.105:0/369034620 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f63f8078bc0 0x7f63f807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:09.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:09.093+0000 7f640b7fe640 1 --2- 172.21.15.105:0/369034620 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f63f8078bc0 0x7f63f807b0d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f63fc034000 tx=0x7f63fc004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:09.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:09.097+0000 7f63f3fff640 1 -- 172.21.15.105:0/369034620 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f640c0b4070 con 0x7f640c0d18f0 2024-09-21T03:19:09.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:09.272+0000 7f6411de4640 1 -- 172.21.15.105:0/369034620 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f640c0d3500 con 0x7f640c0d18f0 2024-09-21T03:19:10.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.086+0000 7f63f3fff640 1 -- 172.21.15.105:0/369034620 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) ==== 138+0+0 (secure 0 0 0) 0x7f640c159f80 con 0x7f640c0d18f0 2024-09-21T03:19:10.089 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_metadata' created 2024-09-21T03:19:10.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.089+0000 7f6411de4640 1 -- 172.21.15.105:0/369034620 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f63f8078bc0 msgr2=0x7f63f807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:10.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.089+0000 7f6411de4640 1 --2- 172.21.15.105:0/369034620 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f63f8078bc0 0x7f63f807b0d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f63fc034000 tx=0x7f63fc004730 comp rx=0 tx=0).stop 2024-09-21T03:19:10.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.089+0000 7f6411de4640 1 -- 172.21.15.105:0/369034620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f640c0d18f0 msgr2=0x7f640c156350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:10.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.089+0000 7f6411de4640 1 --2- 172.21.15.105:0/369034620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f640c0d18f0 0x7f640c156350 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f640000c400 tx=0x7f640000c8c0 comp rx=0 tx=0).stop 2024-09-21T03:19:10.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.089+0000 7f6411de4640 1 -- 172.21.15.105:0/369034620 shutdown_connections 2024-09-21T03:19:10.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.089+0000 7f6411de4640 1 --2- 172.21.15.105:0/369034620 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f63f8078bc0 0x7f63f807b0d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:10.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.089+0000 7f6411de4640 1 --2- 172.21.15.105:0/369034620 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f640c159630 0x7f640c159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:10.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.089+0000 7f6411de4640 1 --2- 172.21.15.105:0/369034620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f640c0d18f0 0x7f640c156350 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:10.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.089+0000 7f6411de4640 1 --2- 172.21.15.105:0/369034620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f640c0b96c0 0x7f640c0ce1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:10.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.089+0000 7f6411de4640 1 -- 172.21.15.105:0/369034620 >> 172.21.15.105:0/369034620 conn(0x7f640c09d8a0 msgr2=0x7f640c15bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:10.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.089+0000 7f6411de4640 1 -- 172.21.15.105:0/369034620 shutdown_connections 2024-09-21T03:19:10.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.089+0000 7f6411de4640 1 -- 172.21.15.105:0/369034620 wait complete. 2024-09-21T03:19:10.111 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T03:19:10.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.233+0000 7f26c53e4640 1 -- 172.21.15.105:0/3808451002 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26a8003a50 msgr2=0x7f26a8003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:10.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.233+0000 7f26c53e4640 1 --2- 172.21.15.105:0/3808451002 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26a8003a50 0x7f26a8003ec0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f26b0009e20 tx=0x7f26a8005830 comp rx=0 tx=0).stop 2024-09-21T03:19:10.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.233+0000 7f26c53e4640 1 -- 172.21.15.105:0/3808451002 shutdown_connections 2024-09-21T03:19:10.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.233+0000 7f26c53e4640 1 --2- 172.21.15.105:0/3808451002 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26a8003a50 0x7f26a8003ec0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:10.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.233+0000 7f26c53e4640 1 -- 172.21.15.105:0/3808451002 >> 172.21.15.105:0/3808451002 conn(0x7f26c008bfc0 msgr2=0x7f26c009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:10.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.233+0000 7f26c53e4640 1 -- 172.21.15.105:0/3808451002 shutdown_connections 2024-09-21T03:19:10.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.233+0000 7f26c53e4640 1 -- 172.21.15.105:0/3808451002 wait complete. 2024-09-21T03:19:10.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.235+0000 7f26c53e4640 1 Processor -- start 2024-09-21T03:19:10.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.235+0000 7f26c53e4640 1 -- start start 2024-09-21T03:19:10.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.236+0000 7f26c53e4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26a8003a50 0x7f26c00cd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:10.241 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.236+0000 7f26c53e4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f26c00cd9a0 0x7f26c01e9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:10.241 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.236+0000 7f26c53e4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26c01e9c80 0x7f26c00cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:10.241 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.236+0000 7f26c53e4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f26c00b36c0 con 0x7f26c01e9c80 2024-09-21T03:19:10.241 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.236+0000 7f26c53e4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f26c00b3540 con 0x7f26a8003a50 2024-09-21T03:19:10.241 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.236+0000 7f26c53e4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f26c00b3840 con 0x7f26c00cd9a0 2024-09-21T03:19:10.241 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.236+0000 7f26bf7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26c01e9c80 0x7f26c00cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:10.241 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.236+0000 7f26bf7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26c01e9c80 0x7f26c00cb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:44148/0 (socket says 172.21.15.105:44148) 2024-09-21T03:19:10.241 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.237+0000 7f26bf7fe640 1 -- 172.21.15.105:0/827564088 learned_addr learned my addr 172.21.15.105:0/827564088 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:10.241 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.237+0000 7f26be7fc640 1 --2- 172.21.15.105:0/827564088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f26c00cd9a0 0x7f26c01e9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:10.241 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.237+0000 7f26beffd640 1 --2- 172.21.15.105:0/827564088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26a8003a50 0x7f26c00cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:10.241 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.237+0000 7f26bf7fe640 1 -- 172.21.15.105:0/827564088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f26c00cd9a0 msgr2=0x7f26c01e9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:10.241 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.237+0000 7f26bf7fe640 1 --2- 172.21.15.105:0/827564088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f26c00cd9a0 0x7f26c01e9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:10.242 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.237+0000 7f26bf7fe640 1 -- 172.21.15.105:0/827564088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26a8003a50 msgr2=0x7f26c00cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:10.242 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.237+0000 7f26bf7fe640 1 --2- 172.21.15.105:0/827564088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26a8003a50 0x7f26c00cd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:10.242 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.237+0000 7f26bf7fe640 1 -- 172.21.15.105:0/827564088 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26c01e7dc0 con 0x7f26c01e9c80 2024-09-21T03:19:10.242 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.237+0000 7f26bf7fe640 1 --2- 172.21.15.105:0/827564088 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26c01e9c80 0x7f26c00cb5c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f26b8000c00 tx=0x7f26b800e770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:10.242 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.237+0000 7f26a77fe640 1 -- 172.21.15.105:0/827564088 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b8011870 con 0x7f26c01e9c80 2024-09-21T03:19:10.242 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.237+0000 7f26a77fe640 1 -- 172.21.15.105:0/827564088 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f26b8016070 con 0x7f26c01e9c80 2024-09-21T03:19:10.242 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.237+0000 7f26c53e4640 1 -- 172.21.15.105:0/827564088 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26c01e8060 con 0x7f26c01e9c80 2024-09-21T03:19:10.242 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.237+0000 7f26a77fe640 1 -- 172.21.15.105:0/827564088 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b8011d80 con 0x7f26c01e9c80 2024-09-21T03:19:10.242 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.237+0000 7f26c53e4640 1 -- 172.21.15.105:0/827564088 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26c01e8620 con 0x7f26c01e9c80 2024-09-21T03:19:10.242 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.238+0000 7f26c53e4640 1 -- 172.21.15.105:0/827564088 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26c00cf110 con 0x7f26c01e9c80 2024-09-21T03:19:10.243 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.239+0000 7f26a77fe640 1 -- 172.21.15.105:0/827564088 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f26b801b460 con 0x7f26c01e9c80 2024-09-21T03:19:10.243 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.239+0000 7f26a77fe640 1 --2- 172.21.15.105:0/827564088 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f26ac078b90 0x7f26ac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:10.243 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.240+0000 7f26a77fe640 1 -- 172.21.15.105:0/827564088 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5227+0+0 (secure 0 0 0) 0x7f26b809ad00 con 0x7f26c01e9c80 2024-09-21T03:19:10.243 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.240+0000 7f26beffd640 1 --2- 172.21.15.105:0/827564088 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f26ac078b90 0x7f26ac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:10.243 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.240+0000 7f26beffd640 1 --2- 172.21.15.105:0/827564088 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f26ac078b90 0x7f26ac07b0a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f26b0035000 tx=0x7f26b0004a40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:10.246 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.244+0000 7f26a77fe640 1 -- 172.21.15.105:0/827564088 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f26b8001430 con 0x7f26c01e9c80 2024-09-21T03:19:10.426 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:10.423+0000 7f26c53e4640 1 -- 172.21.15.105:0/827564088 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f26c00b26c0 con 0x7f26c01e9c80 2024-09-21T03:19:11.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.092+0000 7f26a77fe640 1 -- 172.21.15.105:0/827564088 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) ==== 170+0+0 (secure 0 0 0) 0x7f26b8062cd0 con 0x7f26c01e9c80 2024-09-21T03:19:11.095 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_data' created 2024-09-21T03:19:11.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.095+0000 7f26c53e4640 1 -- 172.21.15.105:0/827564088 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f26ac078b90 msgr2=0x7f26ac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:11.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.095+0000 7f26c53e4640 1 --2- 172.21.15.105:0/827564088 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f26ac078b90 0x7f26ac07b0a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f26b0035000 tx=0x7f26b0004a40 comp rx=0 tx=0).stop 2024-09-21T03:19:11.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.095+0000 7f26c53e4640 1 -- 172.21.15.105:0/827564088 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26c01e9c80 msgr2=0x7f26c00cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:11.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.095+0000 7f26c53e4640 1 --2- 172.21.15.105:0/827564088 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26c01e9c80 0x7f26c00cb5c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f26b8000c00 tx=0x7f26b800e770 comp rx=0 tx=0).stop 2024-09-21T03:19:11.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.095+0000 7f26c53e4640 1 -- 172.21.15.105:0/827564088 shutdown_connections 2024-09-21T03:19:11.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.095+0000 7f26c53e4640 1 --2- 172.21.15.105:0/827564088 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f26ac078b90 0x7f26ac07b0a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:11.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.095+0000 7f26c53e4640 1 --2- 172.21.15.105:0/827564088 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26c01e9c80 0x7f26c00cb5c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:11.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.095+0000 7f26c53e4640 1 --2- 172.21.15.105:0/827564088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f26c00cd9a0 0x7f26c01e9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:11.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.095+0000 7f26c53e4640 1 --2- 172.21.15.105:0/827564088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26a8003a50 0x7f26c00cd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:11.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.095+0000 7f26c53e4640 1 -- 172.21.15.105:0/827564088 >> 172.21.15.105:0/827564088 conn(0x7f26c008bfc0 msgr2=0x7f26c0068f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:11.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.095+0000 7f26c53e4640 1 -- 172.21.15.105:0/827564088 shutdown_connections 2024-09-21T03:19:11.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.095+0000 7f26c53e4640 1 -- 172.21.15.105:0/827564088 wait complete. 2024-09-21T03:19:11.119 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T03:19:11.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.233+0000 7f55ef40e640 1 -- 172.21.15.105:0/1477764166 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55e8073e70 msgr2=0x7f55e8074280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:11.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.233+0000 7f55ef40e640 1 --2- 172.21.15.105:0/1477764166 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55e8073e70 0x7f55e8074280 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f55e0009830 tx=0x7f55e002a510 comp rx=0 tx=0).stop 2024-09-21T03:19:11.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.234+0000 7f55ef40e640 1 -- 172.21.15.105:0/1477764166 shutdown_connections 2024-09-21T03:19:11.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.234+0000 7f55ef40e640 1 --2- 172.21.15.105:0/1477764166 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55e815c9b0 0x7f55e80ccfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:11.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.234+0000 7f55ef40e640 1 --2- 172.21.15.105:0/1477764166 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55e8073e70 0x7f55e8074280 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:11.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.234+0000 7f55ef40e640 1 -- 172.21.15.105:0/1477764166 >> 172.21.15.105:0/1477764166 conn(0x7f55e80cdc60 msgr2=0x7f55e80ce070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:11.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.234+0000 7f55ef40e640 1 -- 172.21.15.105:0/1477764166 shutdown_connections 2024-09-21T03:19:11.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.234+0000 7f55ef40e640 1 -- 172.21.15.105:0/1477764166 wait complete. 2024-09-21T03:19:11.238 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.235+0000 7f55ef40e640 1 Processor -- start 2024-09-21T03:19:11.238 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.235+0000 7f55ef40e640 1 -- start start 2024-09-21T03:19:11.241 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.237+0000 7f55ef40e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55e8073e70 0x7f55e8153e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:11.241 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.237+0000 7f55ef40e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55e815c9b0 0x7f55e80c6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:11.241 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.237+0000 7f55ef40e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55e815ff30 0x7f55e80c6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:11.241 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.237+0000 7f55ef40e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f55e80d0640 con 0x7f55e815ff30 2024-09-21T03:19:11.241 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.237+0000 7f55ef40e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f55e80d04c0 con 0x7f55e8073e70 2024-09-21T03:19:11.241 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.237+0000 7f55ef40e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f55e80d07c0 con 0x7f55e815c9b0 2024-09-21T03:19:11.241 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.237+0000 7f55ed9ab640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55e815ff30 0x7f55e80c6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:11.241 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.237+0000 7f55ed9ab640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55e815ff30 0x7f55e80c6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:44150/0 (socket says 172.21.15.105:44150) 2024-09-21T03:19:11.241 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.237+0000 7f55ed9ab640 1 -- 172.21.15.105:0/1051123059 learned_addr learned my addr 172.21.15.105:0/1051123059 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:11.241 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.237+0000 7f55ec9a9640 1 --2- 172.21.15.105:0/1051123059 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55e815c9b0 0x7f55e80c6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:11.241 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.237+0000 7f55ed9ab640 1 -- 172.21.15.105:0/1051123059 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55e815c9b0 msgr2=0x7f55e80c6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:11.241 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.237+0000 7f55ed9ab640 1 --2- 172.21.15.105:0/1051123059 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55e815c9b0 0x7f55e80c6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:11.242 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.237+0000 7f55ed9ab640 1 -- 172.21.15.105:0/1051123059 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55e8073e70 msgr2=0x7f55e8153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:11.242 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.237+0000 7f55ed9ab640 1 --2- 172.21.15.105:0/1051123059 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55e8073e70 0x7f55e8153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:11.242 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.237+0000 7f55ed9ab640 1 -- 172.21.15.105:0/1051123059 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e81584e0 con 0x7f55e815ff30 2024-09-21T03:19:11.242 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.237+0000 7f55ec9a9640 1 --2- 172.21.15.105:0/1051123059 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55e815c9b0 0x7f55e80c6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:19:11.242 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.237+0000 7f55ed9ab640 1 --2- 172.21.15.105:0/1051123059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55e815ff30 0x7f55e80c6c90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f55e002ab00 tx=0x7f55e0033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:11.242 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.238+0000 7f55e5ffb640 1 -- 172.21.15.105:0/1051123059 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e0005c90 con 0x7f55e815ff30 2024-09-21T03:19:11.242 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.238+0000 7f55e5ffb640 1 -- 172.21.15.105:0/1051123059 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55e0031e50 con 0x7f55e815ff30 2024-09-21T03:19:11.242 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.238+0000 7f55ef40e640 1 -- 172.21.15.105:0/1051123059 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55e8158780 con 0x7f55e815ff30 2024-09-21T03:19:11.242 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.238+0000 7f55e5ffb640 1 -- 172.21.15.105:0/1051123059 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e0033330 con 0x7f55e815ff30 2024-09-21T03:19:11.242 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.238+0000 7f55ef40e640 1 -- 172.21.15.105:0/1051123059 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55e8158d40 con 0x7f55e815ff30 2024-09-21T03:19:11.243 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.239+0000 7f55ef40e640 1 -- 172.21.15.105:0/1051123059 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55e80d0ce0 con 0x7f55e815ff30 2024-09-21T03:19:11.243 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.240+0000 7f55e5ffb640 1 -- 172.21.15.105:0/1051123059 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f55e00334d0 con 0x7f55e815ff30 2024-09-21T03:19:11.243 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.240+0000 7f55e5ffb640 1 --2- 172.21.15.105:0/1051123059 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f55d4078b90 0x7f55d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:11.243 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.241+0000 7f55e5ffb640 1 -- 172.21.15.105:0/1051123059 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5609+0+0 (secure 0 0 0) 0x7f55e00bc080 con 0x7f55e815ff30 2024-09-21T03:19:11.243 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.241+0000 7f55ed1aa640 1 --2- 172.21.15.105:0/1051123059 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f55d4078b90 0x7f55d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:11.244 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.241+0000 7f55ed1aa640 1 --2- 172.21.15.105:0/1051123059 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f55d4078b90 0x7f55d407b0a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f55d80012e0 tx=0x7f55d8007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:11.247 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.245+0000 7f55e5ffb640 1 -- 172.21.15.105:0/1051123059 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f55e003f030 con 0x7f55e815ff30 2024-09-21T03:19:11.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:11.457+0000 7f55ef40e640 1 -- 172.21.15.105:0/1051123059 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f55e806d9d0 con 0x7f55e815ff30 2024-09-21T03:19:12.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.108+0000 7f55e5ffb640 1 -- 172.21.15.105:0/1051123059 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) ==== 172+0+0 (secure 0 0 0) 0x7f55e0084530 con 0x7f55e815ff30 2024-09-21T03:19:12.111 INFO:teuthology.orchestra.run.smithi105.stderr:new fs with metadata pool 4 and data pool 5 2024-09-21T03:19:12.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.116+0000 7f55ef40e640 1 -- 172.21.15.105:0/1051123059 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f55d4078b90 msgr2=0x7f55d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:12.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.116+0000 7f55ef40e640 1 --2- 172.21.15.105:0/1051123059 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f55d4078b90 0x7f55d407b0a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f55d80012e0 tx=0x7f55d8007d30 comp rx=0 tx=0).stop 2024-09-21T03:19:12.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.117+0000 7f55ef40e640 1 -- 172.21.15.105:0/1051123059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55e815ff30 msgr2=0x7f55e80c6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:12.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.117+0000 7f55ef40e640 1 --2- 172.21.15.105:0/1051123059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55e815ff30 0x7f55e80c6c90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f55e002ab00 tx=0x7f55e0033c20 comp rx=0 tx=0).stop 2024-09-21T03:19:12.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.117+0000 7f55ef40e640 1 -- 172.21.15.105:0/1051123059 shutdown_connections 2024-09-21T03:19:12.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.117+0000 7f55ef40e640 1 --2- 172.21.15.105:0/1051123059 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f55d4078b90 0x7f55d407b0a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:12.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.117+0000 7f55ef40e640 1 --2- 172.21.15.105:0/1051123059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55e815ff30 0x7f55e80c6c90 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:12.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.117+0000 7f55ef40e640 1 --2- 172.21.15.105:0/1051123059 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55e815c9b0 0x7f55e80c6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:12.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.117+0000 7f55ef40e640 1 --2- 172.21.15.105:0/1051123059 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55e8073e70 0x7f55e8153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:12.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.117+0000 7f55ef40e640 1 -- 172.21.15.105:0/1051123059 >> 172.21.15.105:0/1051123059 conn(0x7f55e80cdc60 msgr2=0x7f55e80b0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:12.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.117+0000 7f55ef40e640 1 -- 172.21.15.105:0/1051123059 shutdown_connections 2024-09-21T03:19:12.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.117+0000 7f55ef40e640 1 -- 172.21.15.105:0/1051123059 wait complete. 2024-09-21T03:19:12.141 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:19:12.254 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.251+0000 7fa4e60bd640 1 -- 172.21.15.105:0/1432458874 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4e00ca800 msgr2=0x7fa4e00cba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:12.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.251+0000 7fa4e60bd640 1 --2- 172.21.15.105:0/1432458874 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4e00ca800 0x7fa4e00cba00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa4e009e2e0 tx=0x7fa4d002a560 comp rx=0 tx=0).stop 2024-09-21T03:19:12.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.252+0000 7fa4e60bd640 1 -- 172.21.15.105:0/1432458874 shutdown_connections 2024-09-21T03:19:12.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.252+0000 7fa4e60bd640 1 --2- 172.21.15.105:0/1432458874 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4e00704e0 0x7fa4e00cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:12.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.252+0000 7fa4e60bd640 1 --2- 172.21.15.105:0/1432458874 >> v2:172.21.15.162:3300/0 conn(0x7fa4e00cad30 0x7fa4e006ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:12.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.252+0000 7fa4e60bd640 1 --2- 172.21.15.105:0/1432458874 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4e00ca800 0x7fa4e00cba00 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:12.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.252+0000 7fa4e60bd640 1 -- 172.21.15.105:0/1432458874 >> 172.21.15.105:0/1432458874 conn(0x7fa4e00b1cb0 msgr2=0x7fa4e00b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:12.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.252+0000 7fa4e60bd640 1 -- 172.21.15.105:0/1432458874 shutdown_connections 2024-09-21T03:19:12.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.252+0000 7fa4e60bd640 1 -- 172.21.15.105:0/1432458874 wait complete. 2024-09-21T03:19:12.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.253+0000 7fa4e60bd640 1 Processor -- start 2024-09-21T03:19:12.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.254+0000 7fa4e60bd640 1 -- start start 2024-09-21T03:19:12.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.255+0000 7fa4e60bd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4e00704e0 0x7fa4e00c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:12.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.255+0000 7fa4e60bd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4e00ca800 0x7fa4e00c9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:12.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.255+0000 7fa4e60bd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4e00cad30 0x7fa4e00c9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:12.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.255+0000 7fa4e60bd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e00cd140 con 0x7fa4e00704e0 2024-09-21T03:19:12.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.255+0000 7fa4e60bd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e00ccfc0 con 0x7fa4e00ca800 2024-09-21T03:19:12.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.255+0000 7fa4e60bd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa4e00cd2c0 con 0x7fa4e00cad30 2024-09-21T03:19:12.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.255+0000 7fa4df7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4e00704e0 0x7fa4e00c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:12.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.255+0000 7fa4df7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4e00704e0 0x7fa4e00c8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51144/0 (socket says 172.21.15.105:51144) 2024-09-21T03:19:12.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.255+0000 7fa4df7fe640 1 -- 172.21.15.105:0/315866902 learned_addr learned my addr 172.21.15.105:0/315866902 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:12.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.255+0000 7fa4dffff640 1 --2- 172.21.15.105:0/315866902 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4e00cad30 0x7fa4e00c9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:12.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.255+0000 7fa4deffd640 1 --2- 172.21.15.105:0/315866902 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4e00ca800 0x7fa4e00c9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:12.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.255+0000 7fa4df7fe640 1 -- 172.21.15.105:0/315866902 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4e00cad30 msgr2=0x7fa4e00c9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:12.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.255+0000 7fa4df7fe640 1 --2- 172.21.15.105:0/315866902 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4e00cad30 0x7fa4e00c9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:12.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.255+0000 7fa4df7fe640 1 -- 172.21.15.105:0/315866902 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4e00ca800 msgr2=0x7fa4e00c9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:12.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.255+0000 7fa4df7fe640 1 --2- 172.21.15.105:0/315866902 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4e00ca800 0x7fa4e00c9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:12.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.255+0000 7fa4df7fe640 1 -- 172.21.15.105:0/315866902 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4e00c71d0 con 0x7fa4e00704e0 2024-09-21T03:19:12.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.255+0000 7fa4deffd640 1 --2- 172.21.15.105:0/315866902 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4e00ca800 0x7fa4e00c9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:19:12.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.255+0000 7fa4df7fe640 1 --2- 172.21.15.105:0/315866902 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4e00704e0 0x7fa4e00c8bc0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0034040 tx=0x7fa4d0003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:12.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.255+0000 7fa4c7fff640 1 -- 172.21.15.105:0/315866902 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d003e030 con 0x7fa4e00704e0 2024-09-21T03:19:12.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.255+0000 7fa4c7fff640 1 -- 172.21.15.105:0/315866902 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa4d0003e00 con 0x7fa4e00704e0 2024-09-21T03:19:12.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.256+0000 7fa4e60bd640 1 -- 172.21.15.105:0/315866902 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4e0168430 con 0x7fa4e00704e0 2024-09-21T03:19:12.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.256+0000 7fa4c7fff640 1 -- 172.21.15.105:0/315866902 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0035040 con 0x7fa4e00704e0 2024-09-21T03:19:12.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.256+0000 7fa4e60bd640 1 -- 172.21.15.105:0/315866902 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4e0153710 con 0x7fa4e00704e0 2024-09-21T03:19:12.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.256+0000 7fa4e60bd640 1 -- 172.21.15.105:0/315866902 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4e00c73a0 con 0x7fa4e00704e0 2024-09-21T03:19:12.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.257+0000 7fa4c7fff640 1 -- 172.21.15.105:0/315866902 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa4d0041030 con 0x7fa4e00704e0 2024-09-21T03:19:12.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.258+0000 7fa4c7fff640 1 --2- 172.21.15.105:0/315866902 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa4cc078b90 0x7fa4cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:12.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.258+0000 7fa4c7fff640 1 -- 172.21.15.105:0/315866902 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fa4d00bb400 con 0x7fa4e00704e0 2024-09-21T03:19:12.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.258+0000 7fa4deffd640 1 --2- 172.21.15.105:0/315866902 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa4cc078b90 0x7fa4cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:12.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.259+0000 7fa4deffd640 1 --2- 172.21.15.105:0/315866902 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa4cc078b90 0x7fa4cc07b0a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4005d70 tx=0x7fa4d4005d00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:12.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.263+0000 7fa4c7fff640 1 -- 172.21.15.105:0/315866902 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa4d0083310 con 0x7fa4e00704e0 2024-09-21T03:19:12.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.441+0000 7fa4e60bd640 1 -- 172.21.15.105:0/315866902 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa4e00ca410 con 0x7fa4e00704e0 2024-09-21T03:19:12.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.442+0000 7fa4c7fff640 1 -- 172.21.15.105:0/315866902 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16814 (secure 0 0 0) 0x7fa4d0087d40 con 0x7fa4e00704e0 2024-09-21T03:19:12.445 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:19:12.445 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":33,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:19:11.459474+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:19:09.277161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-21T03:19:10.428993+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:19:12.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.444+0000 7fa4e60bd640 1 -- 172.21.15.105:0/315866902 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa4cc078b90 msgr2=0x7fa4cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:12.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.444+0000 7fa4e60bd640 1 --2- 172.21.15.105:0/315866902 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa4cc078b90 0x7fa4cc07b0a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4005d70 tx=0x7fa4d4005d00 comp rx=0 tx=0).stop 2024-09-21T03:19:12.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.444+0000 7fa4e60bd640 1 -- 172.21.15.105:0/315866902 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4e00704e0 msgr2=0x7fa4e00c8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:12.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.444+0000 7fa4e60bd640 1 --2- 172.21.15.105:0/315866902 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4e00704e0 0x7fa4e00c8bc0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0034040 tx=0x7fa4d0003910 comp rx=0 tx=0).stop 2024-09-21T03:19:12.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.444+0000 7fa4e60bd640 1 -- 172.21.15.105:0/315866902 shutdown_connections 2024-09-21T03:19:12.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.444+0000 7fa4e60bd640 1 --2- 172.21.15.105:0/315866902 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa4cc078b90 0x7fa4cc07b0a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:12.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.444+0000 7fa4e60bd640 1 --2- 172.21.15.105:0/315866902 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4e00cad30 0x7fa4e00c9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:12.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.444+0000 7fa4e60bd640 1 --2- 172.21.15.105:0/315866902 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4e00ca800 0x7fa4e00c9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:12.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.444+0000 7fa4e60bd640 1 --2- 172.21.15.105:0/315866902 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4e00704e0 0x7fa4e00c8bc0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:12.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.444+0000 7fa4e60bd640 1 -- 172.21.15.105:0/315866902 >> 172.21.15.105:0/315866902 conn(0x7fa4e00b1cb0 msgr2=0x7fa4e00af9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:12.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.444+0000 7fa4e60bd640 1 -- 172.21.15.105:0/315866902 shutdown_connections 2024-09-21T03:19:12.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.444+0000 7fa4e60bd640 1 -- 172.21.15.105:0/315866902 wait complete. 2024-09-21T03:19:12.458 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:19:12.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.572+0000 7f4e62720640 1 -- 172.21.15.105:0/187205083 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e44003c60 msgr2=0x7f4e440040b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:12.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.572+0000 7f4e62720640 1 --2- 172.21.15.105:0/187205083 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e44003c60 0x7f4e440040b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c006ea0 tx=0x7f4e44005830 comp rx=0 tx=0).stop 2024-09-21T03:19:12.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.572+0000 7f4e60cbd640 1 -- 172.21.15.105:0/187205083 reap_dead start 2024-09-21T03:19:12.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.572+0000 7f4e62720640 1 -- 172.21.15.105:0/187205083 shutdown_connections 2024-09-21T03:19:12.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.572+0000 7f4e62720640 1 -- 172.21.15.105:0/187205083 >> 172.21.15.105:0/187205083 conn(0x7f4e5c0cd530 msgr2=0x7f4e5c0cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:12.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.572+0000 7f4e62720640 1 -- 172.21.15.105:0/187205083 shutdown_connections 2024-09-21T03:19:12.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.572+0000 7f4e62720640 1 -- 172.21.15.105:0/187205083 wait complete. 2024-09-21T03:19:12.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.573+0000 7f4e62720640 1 Processor -- start 2024-09-21T03:19:12.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.574+0000 7f4e62720640 1 -- start start 2024-09-21T03:19:12.578 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.575+0000 7f4e62720640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e44003c60 0x7f4e5c14ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:12.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.575+0000 7f4e62720640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e5c14cb20 0x7f4e5c14d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:12.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.575+0000 7f4e62720640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e5c15cde0 0x7f4e5c15d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:12.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.575+0000 7f4e62720640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4e5c0cf850 con 0x7f4e44003c60 2024-09-21T03:19:12.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.575+0000 7f4e62720640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4e5c0cf6d0 con 0x7f4e5c15cde0 2024-09-21T03:19:12.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.575+0000 7f4e62720640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4e5c0cf9d0 con 0x7f4e5c14cb20 2024-09-21T03:19:12.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.575+0000 7f4e5bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e44003c60 0x7f4e5c14ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:12.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.575+0000 7f4e5bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e44003c60 0x7f4e5c14ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51166/0 (socket says 172.21.15.105:51166) 2024-09-21T03:19:12.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.575+0000 7f4e5bfff640 1 -- 172.21.15.105:0/505924949 learned_addr learned my addr 172.21.15.105:0/505924949 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:12.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.575+0000 7f4e5b7fe640 1 --2- 172.21.15.105:0/505924949 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e5c14cb20 0x7f4e5c14d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:12.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.575+0000 7f4e60cbd640 1 --2- 172.21.15.105:0/505924949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e5c15cde0 0x7f4e5c15d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:12.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.575+0000 7f4e5bfff640 1 -- 172.21.15.105:0/505924949 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e5c14cb20 msgr2=0x7f4e5c14d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:12.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.575+0000 7f4e5bfff640 1 --2- 172.21.15.105:0/505924949 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e5c14cb20 0x7f4e5c14d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:12.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.575+0000 7f4e5bfff640 1 -- 172.21.15.105:0/505924949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e5c15cde0 msgr2=0x7f4e5c15d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:12.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.575+0000 7f4e5bfff640 1 --2- 172.21.15.105:0/505924949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e5c15cde0 0x7f4e5c15d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:12.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.575+0000 7f4e5bfff640 1 -- 172.21.15.105:0/505924949 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e5c15d730 con 0x7f4e44003c60 2024-09-21T03:19:12.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.575+0000 7f4e5bfff640 1 --2- 172.21.15.105:0/505924949 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e44003c60 0x7f4e5c14ef90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c006f00 tx=0x7f4e4c006290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:12.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.576+0000 7f4e58ff9640 1 -- 172.21.15.105:0/505924949 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c041020 con 0x7f4e44003c60 2024-09-21T03:19:12.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.576+0000 7f4e58ff9640 1 -- 172.21.15.105:0/505924949 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e4c0036e0 con 0x7f4e44003c60 2024-09-21T03:19:12.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.576+0000 7f4e58ff9640 1 -- 172.21.15.105:0/505924949 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c036030 con 0x7f4e44003c60 2024-09-21T03:19:12.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.576+0000 7f4e62720640 1 -- 172.21.15.105:0/505924949 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e5c14f900 con 0x7f4e44003c60 2024-09-21T03:19:12.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.576+0000 7f4e62720640 1 -- 172.21.15.105:0/505924949 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e5c1f9000 con 0x7f4e44003c60 2024-09-21T03:19:12.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.577+0000 7f4e62720640 1 -- 172.21.15.105:0/505924949 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e5c0b5a50 con 0x7f4e44003c60 2024-09-21T03:19:12.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.577+0000 7f4e58ff9640 1 -- 172.21.15.105:0/505924949 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4e4c044020 con 0x7f4e44003c60 2024-09-21T03:19:12.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.578+0000 7f4e58ff9640 1 --2- 172.21.15.105:0/505924949 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4e48078b90 0x7f4e4807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:12.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.578+0000 7f4e58ff9640 1 -- 172.21.15.105:0/505924949 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f4e4c0bb180 con 0x7f4e44003c60 2024-09-21T03:19:12.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.578+0000 7f4e5b7fe640 1 --2- 172.21.15.105:0/505924949 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4e48078b90 0x7f4e4807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:12.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.579+0000 7f4e5b7fe640 1 --2- 172.21.15.105:0/505924949 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4e48078b90 0x7f4e4807b0a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c0b3c20 tx=0x7f4e50006c00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:12.585 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.583+0000 7f4e58ff9640 1 -- 172.21.15.105:0/505924949 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4e5c15d730 con 0x7f4e44003c60 2024-09-21T03:19:12.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.760+0000 7f4e62720640 1 -- 172.21.15.105:0/505924949 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4e5c073c90 con 0x7f4e44003c60 2024-09-21T03:19:12.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.761+0000 7f4e58ff9640 1 -- 172.21.15.105:0/505924949 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16814 (secure 0 0 0) 0x7f4e4c083000 con 0x7f4e44003c60 2024-09-21T03:19:12.764 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:19:12.764 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":33,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:19:11.459474+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:19:09.277161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-21T03:19:10.428993+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:19:12.766 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.763+0000 7f4e62720640 1 -- 172.21.15.105:0/505924949 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4e48078b90 msgr2=0x7f4e4807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:12.766 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.763+0000 7f4e62720640 1 --2- 172.21.15.105:0/505924949 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4e48078b90 0x7f4e4807b0a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c0b3c20 tx=0x7f4e50006c00 comp rx=0 tx=0).stop 2024-09-21T03:19:12.767 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.763+0000 7f4e62720640 1 -- 172.21.15.105:0/505924949 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e44003c60 msgr2=0x7f4e5c14ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:12.767 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.763+0000 7f4e62720640 1 --2- 172.21.15.105:0/505924949 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e44003c60 0x7f4e5c14ef90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c006f00 tx=0x7f4e4c006290 comp rx=0 tx=0).stop 2024-09-21T03:19:12.767 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.763+0000 7f4e62720640 1 -- 172.21.15.105:0/505924949 shutdown_connections 2024-09-21T03:19:12.767 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.763+0000 7f4e62720640 1 --2- 172.21.15.105:0/505924949 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4e48078b90 0x7f4e4807b0a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:12.767 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.763+0000 7f4e62720640 1 --2- 172.21.15.105:0/505924949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e5c15cde0 0x7f4e5c15d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:12.767 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.763+0000 7f4e62720640 1 --2- 172.21.15.105:0/505924949 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e5c14cb20 0x7f4e5c14d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:12.767 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.763+0000 7f4e62720640 1 --2- 172.21.15.105:0/505924949 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e44003c60 0x7f4e5c14ef90 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:12.767 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.763+0000 7f4e62720640 1 -- 172.21.15.105:0/505924949 >> 172.21.15.105:0/505924949 conn(0x7f4e5c0cd530 msgr2=0x7f4e5c06fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:12.768 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.763+0000 7f4e62720640 1 -- 172.21.15.105:0/505924949 shutdown_connections 2024-09-21T03:19:12.768 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.763+0000 7f4e62720640 1 -- 172.21.15.105:0/505924949 wait complete. 2024-09-21T03:19:12.777 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T03:19:12.894 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.891+0000 7f6cab58b640 1 -- 172.21.15.105:0/823284355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ca40b3eb0 msgr2=0x7f6ca40b42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:12.894 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.891+0000 7f6cab58b640 1 --2- 172.21.15.105:0/823284355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ca40b3eb0 0x7f6ca40b42c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4144a00 tx=0x7f6c9c02b9a0 comp rx=0 tx=0).stop 2024-09-21T03:19:12.894 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.891+0000 7f6cab58b640 1 -- 172.21.15.105:0/823284355 shutdown_connections 2024-09-21T03:19:12.894 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.891+0000 7f6cab58b640 1 --2- 172.21.15.105:0/823284355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ca40b3eb0 0x7f6ca40b42c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:12.894 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.891+0000 7f6cab58b640 1 --2- 172.21.15.105:0/823284355 >> v2:172.21.15.162:3300/0 conn(0x7f6ca415e890 0x7f6ca415eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:12.894 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.891+0000 7f6cab58b640 1 -- 172.21.15.105:0/823284355 >> 172.21.15.105:0/823284355 conn(0x7f6ca4073fa0 msgr2=0x7f6ca40743e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:12.895 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.891+0000 7f6cab58b640 1 -- 172.21.15.105:0/823284355 shutdown_connections 2024-09-21T03:19:12.895 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.891+0000 7f6cab58b640 1 -- 172.21.15.105:0/823284355 wait complete. 2024-09-21T03:19:12.895 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.893+0000 7f6cab58b640 1 Processor -- start 2024-09-21T03:19:12.895 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.893+0000 7f6cab58b640 1 -- start start 2024-09-21T03:19:12.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.894+0000 7f6cab58b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6ca40b3eb0 0x7f6ca41f7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:12.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.894+0000 7f6cab58b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ca413dce0 0x7f6ca4137590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:12.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.894+0000 7f6cab58b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ca415e890 0x7f6ca4141490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:12.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.894+0000 7f6cab58b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca4076080 con 0x7f6ca413dce0 2024-09-21T03:19:12.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.894+0000 7f6cab58b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca4075f00 con 0x7f6ca415e890 2024-09-21T03:19:12.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.894+0000 7f6cab58b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6ca4076200 con 0x7f6ca40b3eb0 2024-09-21T03:19:12.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.894+0000 7f6ca8b26640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ca413dce0 0x7f6ca4137590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:12.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.894+0000 7f6ca8b26640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ca413dce0 0x7f6ca4137590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51184/0 (socket says 172.21.15.105:51184) 2024-09-21T03:19:12.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.894+0000 7f6ca8b26640 1 -- 172.21.15.105:0/3783548139 learned_addr learned my addr 172.21.15.105:0/3783548139 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:12.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.894+0000 7f6ca9b28640 1 --2- 172.21.15.105:0/3783548139 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ca415e890 0x7f6ca4141490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:12.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.894+0000 7f6ca9327640 1 --2- 172.21.15.105:0/3783548139 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6ca40b3eb0 0x7f6ca41f7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:12.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.894+0000 7f6ca8b26640 1 -- 172.21.15.105:0/3783548139 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6ca40b3eb0 msgr2=0x7f6ca41f7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:12.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.894+0000 7f6ca8b26640 1 --2- 172.21.15.105:0/3783548139 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6ca40b3eb0 0x7f6ca41f7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:12.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.894+0000 7f6ca8b26640 1 -- 172.21.15.105:0/3783548139 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ca415e890 msgr2=0x7f6ca4141490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:12.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.894+0000 7f6ca8b26640 1 --2- 172.21.15.105:0/3783548139 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ca415e890 0x7f6ca4141490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:12.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.894+0000 7f6ca8b26640 1 -- 172.21.15.105:0/3783548139 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca4138200 con 0x7f6ca413dce0 2024-09-21T03:19:12.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.894+0000 7f6ca9b28640 1 --2- 172.21.15.105:0/3783548139 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ca415e890 0x7f6ca4141490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:19:12.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.894+0000 7f6ca8b26640 1 --2- 172.21.15.105:0/3783548139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ca413dce0 0x7f6ca4137590 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6c9400e7c0 tx=0x7f6c9400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:12.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.895+0000 7f6c99ffb640 1 -- 172.21.15.105:0/3783548139 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9400ccc0 con 0x7f6ca413dce0 2024-09-21T03:19:12.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.895+0000 7f6c99ffb640 1 -- 172.21.15.105:0/3783548139 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c94010430 con 0x7f6ca413dce0 2024-09-21T03:19:12.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.895+0000 7f6c99ffb640 1 -- 172.21.15.105:0/3783548139 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c94010860 con 0x7f6ca413dce0 2024-09-21T03:19:12.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.895+0000 7f6cab58b640 1 -- 172.21.15.105:0/3783548139 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ca4137f90 con 0x7f6ca413dce0 2024-09-21T03:19:12.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.895+0000 7f6cab58b640 1 -- 172.21.15.105:0/3783548139 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ca41f6e70 con 0x7f6ca413dce0 2024-09-21T03:19:12.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.896+0000 7f6cab58b640 1 -- 172.21.15.105:0/3783548139 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ca4138470 con 0x7f6ca413dce0 2024-09-21T03:19:12.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.897+0000 7f6c99ffb640 1 -- 172.21.15.105:0/3783548139 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6c94010a00 con 0x7f6ca413dce0 2024-09-21T03:19:12.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.897+0000 7f6c99ffb640 1 --2- 172.21.15.105:0/3783548139 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6c88078bc0 0x7f6c8807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:12.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.897+0000 7f6c99ffb640 1 -- 172.21.15.105:0/3783548139 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f6c9409b660 con 0x7f6ca413dce0 2024-09-21T03:19:12.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.897+0000 7f6ca9327640 1 --2- 172.21.15.105:0/3783548139 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6c88078bc0 0x7f6c8807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:12.901 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.898+0000 7f6ca9327640 1 --2- 172.21.15.105:0/3783548139 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6c88078bc0 0x7f6c8807b0d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6ca00015e0 tx=0x7f6ca0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:12.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:12.901+0000 7f6c99ffb640 1 -- 172.21.15.105:0/3783548139 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6c94063bc0 con 0x7f6ca413dce0 2024-09-21T03:19:13.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:13.122+0000 7f6cab58b640 1 -- 172.21.15.105:0/3783548139 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f6ca40b4a80 con 0x7f6ca413dce0 2024-09-21T03:19:14.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.119+0000 7f6c99ffb640 1 -- 172.21.15.105:0/3783548139 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f6c940634c0 con 0x7f6ca413dce0 2024-09-21T03:19:14.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.122+0000 7f6cab58b640 1 -- 172.21.15.105:0/3783548139 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6c88078bc0 msgr2=0x7f6c8807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:14.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.122+0000 7f6cab58b640 1 --2- 172.21.15.105:0/3783548139 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6c88078bc0 0x7f6c8807b0d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6ca00015e0 tx=0x7f6ca0009040 comp rx=0 tx=0).stop 2024-09-21T03:19:14.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.122+0000 7f6cab58b640 1 -- 172.21.15.105:0/3783548139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ca413dce0 msgr2=0x7f6ca4137590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:14.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.122+0000 7f6cab58b640 1 --2- 172.21.15.105:0/3783548139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ca413dce0 0x7f6ca4137590 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6c9400e7c0 tx=0x7f6c9400ec80 comp rx=0 tx=0).stop 2024-09-21T03:19:14.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.122+0000 7f6cab58b640 1 -- 172.21.15.105:0/3783548139 shutdown_connections 2024-09-21T03:19:14.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.122+0000 7f6cab58b640 1 --2- 172.21.15.105:0/3783548139 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6c88078bc0 0x7f6c8807b0d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:14.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.122+0000 7f6cab58b640 1 --2- 172.21.15.105:0/3783548139 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ca415e890 0x7f6ca4141490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:14.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.122+0000 7f6cab58b640 1 --2- 172.21.15.105:0/3783548139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ca413dce0 0x7f6ca4137590 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:14.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.122+0000 7f6cab58b640 1 --2- 172.21.15.105:0/3783548139 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6ca40b3eb0 0x7f6ca41f7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:14.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.122+0000 7f6cab58b640 1 -- 172.21.15.105:0/3783548139 >> 172.21.15.105:0/3783548139 conn(0x7f6ca4073fa0 msgr2=0x7f6ca40b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:14.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.122+0000 7f6cab58b640 1 -- 172.21.15.105:0/3783548139 shutdown_connections 2024-09-21T03:19:14.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.122+0000 7f6cab58b640 1 -- 172.21.15.105:0/3783548139 wait complete. 2024-09-21T03:19:14.138 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T03:19:14.138 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T03:19:14.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.258+0000 7f69ff38b640 1 -- 172.21.15.105:0/2301085457 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69e4004d40 msgr2=0x7f69e4005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:14.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.258+0000 7f69ff38b640 1 --2- 172.21.15.105:0/2301085457 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69e4004d40 0x7f69e4005150 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f69f0006fd0 tx=0x7f69e4005830 comp rx=0 tx=0).stop 2024-09-21T03:19:14.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.258+0000 7f69fd928640 1 -- 172.21.15.105:0/2301085457 reap_dead start 2024-09-21T03:19:14.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.258+0000 7f69ff38b640 1 -- 172.21.15.105:0/2301085457 shutdown_connections 2024-09-21T03:19:14.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.258+0000 7f69ff38b640 1 -- 172.21.15.105:0/2301085457 >> 172.21.15.105:0/2301085457 conn(0x7f69f806d550 msgr2=0x7f69f8071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:14.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.258+0000 7f69ff38b640 1 -- 172.21.15.105:0/2301085457 shutdown_connections 2024-09-21T03:19:14.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.258+0000 7f69ff38b640 1 -- 172.21.15.105:0/2301085457 wait complete. 2024-09-21T03:19:14.262 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.259+0000 7f69ff38b640 1 Processor -- start 2024-09-21T03:19:14.262 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.259+0000 7f69ff38b640 1 -- start start 2024-09-21T03:19:14.264 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.261+0000 7f69ff38b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69e4004d40 0x7f69f81536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:14.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.261+0000 7f69ff38b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69f814d2e0 0x7f69f80b3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:14.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.261+0000 7f69ff38b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69f814c780 0x7f69f81f7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:14.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.261+0000 7f69ff38b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f69f81612c0 con 0x7f69f814d2e0 2024-09-21T03:19:14.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.261+0000 7f69ff38b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f69f8161140 con 0x7f69f814c780 2024-09-21T03:19:14.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.261+0000 7f69ff38b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f69f80d05d0 con 0x7f69e4004d40 2024-09-21T03:19:14.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.261+0000 7f69fc926640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69f814d2e0 0x7f69f80b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:14.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.261+0000 7f69fc926640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69f814d2e0 0x7f69f80b3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51202/0 (socket says 172.21.15.105:51202) 2024-09-21T03:19:14.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.261+0000 7f69fc926640 1 -- 172.21.15.105:0/527933615 learned_addr learned my addr 172.21.15.105:0/527933615 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:14.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.261+0000 7f69fd127640 1 --2- 172.21.15.105:0/527933615 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69e4004d40 0x7f69f81536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:14.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.261+0000 7f69fd928640 1 --2- 172.21.15.105:0/527933615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69f814c780 0x7f69f81f7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:14.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.261+0000 7f69fc926640 1 -- 172.21.15.105:0/527933615 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69e4004d40 msgr2=0x7f69f81536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:14.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.261+0000 7f69fc926640 1 --2- 172.21.15.105:0/527933615 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69e4004d40 0x7f69f81536b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:14.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.261+0000 7f69fc926640 1 -- 172.21.15.105:0/527933615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69f814c780 msgr2=0x7f69f81f7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:14.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.261+0000 7f69fc926640 1 --2- 172.21.15.105:0/527933615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69f814c780 0x7f69f81f7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:14.266 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.261+0000 7f69fc926640 1 -- 172.21.15.105:0/527933615 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f80b3570 con 0x7f69f814d2e0 2024-09-21T03:19:14.266 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.261+0000 7f69fc926640 1 --2- 172.21.15.105:0/527933615 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69f814d2e0 0x7f69f80b3030 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f69e8011ab0 tx=0x7f69e8011eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:14.266 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.261+0000 7f69edffb640 1 -- 172.21.15.105:0/527933615 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e801e070 con 0x7f69f814d2e0 2024-09-21T03:19:14.266 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.262+0000 7f69edffb640 1 -- 172.21.15.105:0/527933615 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69e800fbb0 con 0x7f69f814d2e0 2024-09-21T03:19:14.266 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.262+0000 7f69ff38b640 1 -- 172.21.15.105:0/527933615 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69f814df60 con 0x7f69f814d2e0 2024-09-21T03:19:14.266 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.262+0000 7f69edffb640 1 -- 172.21.15.105:0/527933615 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e8019410 con 0x7f69f814d2e0 2024-09-21T03:19:14.266 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.262+0000 7f69ff38b640 1 -- 172.21.15.105:0/527933615 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69f814e520 con 0x7f69f814d2e0 2024-09-21T03:19:14.267 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.263+0000 7f69ff38b640 1 -- 172.21.15.105:0/527933615 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69f815d8f0 con 0x7f69f814d2e0 2024-09-21T03:19:14.267 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.264+0000 7f69edffb640 1 -- 172.21.15.105:0/527933615 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f69e8021070 con 0x7f69f814d2e0 2024-09-21T03:19:14.267 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.264+0000 7f69edffb640 1 --2- 172.21.15.105:0/527933615 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f69dc078b90 0x7f69dc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:14.267 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.264+0000 7f69edffb640 1 -- 172.21.15.105:0/527933615 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f69e809bd20 con 0x7f69f814d2e0 2024-09-21T03:19:14.267 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.264+0000 7f69fd127640 1 --2- 172.21.15.105:0/527933615 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f69dc078b90 0x7f69dc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:14.267 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.265+0000 7f69fd127640 1 --2- 172.21.15.105:0/527933615 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f69dc078b90 0x7f69dc07b0a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009c50 tx=0x7f69f4005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:14.270 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.268+0000 7f69edffb640 1 -- 172.21.15.105:0/527933615 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f69e8063c80 con 0x7f69f814d2e0 2024-09-21T03:19:14.487 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:14.485+0000 7f69ff38b640 1 -- 172.21.15.105:0/527933615 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f69f80cc7e0 con 0x7f69f814d2e0 2024-09-21T03:19:15.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.120+0000 7f69edffb640 1 -- 172.21.15.105:0/527933615 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7f69e80686b0 con 0x7f69f814d2e0 2024-09-21T03:19:15.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.123+0000 7f69ff38b640 1 -- 172.21.15.105:0/527933615 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f69dc078b90 msgr2=0x7f69dc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:15.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.123+0000 7f69ff38b640 1 --2- 172.21.15.105:0/527933615 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f69dc078b90 0x7f69dc07b0a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009c50 tx=0x7f69f4005f90 comp rx=0 tx=0).stop 2024-09-21T03:19:15.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.123+0000 7f69ff38b640 1 -- 172.21.15.105:0/527933615 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69f814d2e0 msgr2=0x7f69f80b3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:15.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.123+0000 7f69ff38b640 1 --2- 172.21.15.105:0/527933615 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69f814d2e0 0x7f69f80b3030 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f69e8011ab0 tx=0x7f69e8011eb0 comp rx=0 tx=0).stop 2024-09-21T03:19:15.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.123+0000 7f69ff38b640 1 -- 172.21.15.105:0/527933615 shutdown_connections 2024-09-21T03:19:15.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.123+0000 7f69ff38b640 1 --2- 172.21.15.105:0/527933615 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f69dc078b90 0x7f69dc07b0a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:15.127 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.123+0000 7f69ff38b640 1 --2- 172.21.15.105:0/527933615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69f814c780 0x7f69f81f7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:15.127 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.123+0000 7f69ff38b640 1 --2- 172.21.15.105:0/527933615 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69f814d2e0 0x7f69f80b3030 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:15.127 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.123+0000 7f69ff38b640 1 --2- 172.21.15.105:0/527933615 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69e4004d40 0x7f69f81536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:15.127 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.123+0000 7f69ff38b640 1 -- 172.21.15.105:0/527933615 >> 172.21.15.105:0/527933615 conn(0x7f69f806d550 msgr2=0x7f69f8160090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:15.127 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.123+0000 7f69ff38b640 1 -- 172.21.15.105:0/527933615 shutdown_connections 2024-09-21T03:19:15.127 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.123+0000 7f69ff38b640 1 -- 172.21.15.105:0/527933615 wait complete. 2024-09-21T03:19:15.139 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T03:19:15.139 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:19:15.254 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.251+0000 7f6e0fded640 1 -- 172.21.15.105:0/1018532896 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6df4004e60 msgr2=0x7f6df4005290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:15.254 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.251+0000 7f6e0fded640 1 --2- 172.21.15.105:0/1018532896 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6df4004e60 0x7f6df4005290 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6e00009b50 tx=0x7f6df4005830 comp rx=0 tx=0).stop 2024-09-21T03:19:15.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.251+0000 7f6e0e38a640 1 -- 172.21.15.105:0/1018532896 reap_dead start 2024-09-21T03:19:15.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.251+0000 7f6e0fded640 1 -- 172.21.15.105:0/1018532896 shutdown_connections 2024-09-21T03:19:15.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.251+0000 7f6e0fded640 1 -- 172.21.15.105:0/1018532896 >> 172.21.15.105:0/1018532896 conn(0x7f6e0809d7f0 msgr2=0x7f6e080d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:15.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.252+0000 7f6e0fded640 1 -- 172.21.15.105:0/1018532896 shutdown_connections 2024-09-21T03:19:15.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.252+0000 7f6e0fded640 1 -- 172.21.15.105:0/1018532896 wait complete. 2024-09-21T03:19:15.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.253+0000 7f6e0fded640 1 Processor -- start 2024-09-21T03:19:15.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.253+0000 7f6e0fded640 1 -- start start 2024-09-21T03:19:15.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.254+0000 7f6e0fded640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6df4004e60 0x7f6e0815daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:15.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.254+0000 7f6e0fded640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e0815e930 0x7f6e080ca220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:15.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.254+0000 7f6e0fded640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e0815e3e0 0x7f6e080ca760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:15.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.255+0000 7f6e0fded640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6e0806f340 con 0x7f6e0815e930 2024-09-21T03:19:15.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.255+0000 7f6e0fded640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6e0806f1c0 con 0x7f6e0815e3e0 2024-09-21T03:19:15.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.255+0000 7f6e0fded640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6e0806f4c0 con 0x7f6df4004e60 2024-09-21T03:19:15.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.255+0000 7f6e0d388640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e0815e930 0x7f6e080ca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:15.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.255+0000 7f6e0d388640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e0815e930 0x7f6e080ca220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51230/0 (socket says 172.21.15.105:51230) 2024-09-21T03:19:15.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.255+0000 7f6e0d388640 1 -- 172.21.15.105:0/532301867 learned_addr learned my addr 172.21.15.105:0/532301867 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:15.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.255+0000 7f6e0db89640 1 --2- 172.21.15.105:0/532301867 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6df4004e60 0x7f6e0815daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:15.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.255+0000 7f6e0e38a640 1 --2- 172.21.15.105:0/532301867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e0815e3e0 0x7f6e080ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:15.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.255+0000 7f6e0d388640 1 -- 172.21.15.105:0/532301867 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6df4004e60 msgr2=0x7f6e0815daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:15.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.255+0000 7f6e0d388640 1 --2- 172.21.15.105:0/532301867 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6df4004e60 0x7f6e0815daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:15.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.255+0000 7f6e0d388640 1 -- 172.21.15.105:0/532301867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e0815e3e0 msgr2=0x7f6e080ca760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:15.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.255+0000 7f6e0d388640 1 --2- 172.21.15.105:0/532301867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e0815e3e0 0x7f6e080ca760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:15.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.255+0000 7f6e0d388640 1 -- 172.21.15.105:0/532301867 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e080b6130 con 0x7f6e0815e930 2024-09-21T03:19:15.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.255+0000 7f6e0d388640 1 --2- 172.21.15.105:0/532301867 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e0815e930 0x7f6e080ca220 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6df8003f80 tx=0x7f6df800f7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:15.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.255+0000 7f6dfe7fc640 1 -- 172.21.15.105:0/532301867 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df8015070 con 0x7f6e0815e930 2024-09-21T03:19:15.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.255+0000 7f6dfe7fc640 1 -- 172.21.15.105:0/532301867 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6df8011840 con 0x7f6e0815e930 2024-09-21T03:19:15.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.255+0000 7f6e0fded640 1 -- 172.21.15.105:0/532301867 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e080b6410 con 0x7f6e0815e930 2024-09-21T03:19:15.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.255+0000 7f6dfe7fc640 1 -- 172.21.15.105:0/532301867 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df8011c70 con 0x7f6e0815e930 2024-09-21T03:19:15.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.255+0000 7f6e0fded640 1 -- 172.21.15.105:0/532301867 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e081e8cc0 con 0x7f6e0815e930 2024-09-21T03:19:15.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.256+0000 7f6e0fded640 1 -- 172.21.15.105:0/532301867 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e080b4970 con 0x7f6e0815e930 2024-09-21T03:19:15.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.258+0000 7f6dfe7fc640 1 -- 172.21.15.105:0/532301867 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6df80103c0 con 0x7f6e0815e930 2024-09-21T03:19:15.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.258+0000 7f6dfe7fc640 1 --2- 172.21.15.105:0/532301867 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6dec078bc0 0x7f6dec07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:15.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.258+0000 7f6dfe7fc640 1 -- 172.21.15.105:0/532301867 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f6df809bb60 con 0x7f6e0815e930 2024-09-21T03:19:15.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.259+0000 7f6e0db89640 1 --2- 172.21.15.105:0/532301867 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6dec078bc0 0x7f6dec07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:15.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.259+0000 7f6e0db89640 1 --2- 172.21.15.105:0/532301867 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6dec078bc0 0x7f6dec07b0d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6e04001500 tx=0x7f6e04006ac0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:15.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.262+0000 7f6dfe7fc640 1 -- 172.21.15.105:0/532301867 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6df8063a30 con 0x7f6e0815e930 2024-09-21T03:19:15.478 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.476+0000 7f6e0fded640 1 -- 172.21.15.105:0/532301867 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e080b65e0 con 0x7f6e0815e930 2024-09-21T03:19:15.479 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.477+0000 7f6dfe7fc640 1 -- 172.21.15.105:0/532301867 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5232 (secure 0 0 0) 0x7f6df8068460 con 0x7f6e0815e930 2024-09-21T03:19:15.479 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:19:15.480 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":17,"btime":"2024-09-21T03:19:15:120921+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4634,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/517240834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":517240834},{"type":"v1","addr":"172.21.15.162:6837","nonce":517240834}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4774,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3241953393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3241953393},{"type":"v1","addr":"172.21.15.162:6836","nonce":3241953393}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4899,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/2101702562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2101702562},{"type":"v1","addr":"172.21.15.105:6834","nonce":2101702562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:19:11.459432+0000","modified":"2024-09-21T03:19:14.487254+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4902},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4902":{"gid":4902,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1732564681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":1732564681},{"type":"v1","addr":"172.21.15.105:6835","nonce":1732564681}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4902,"qdb_cluster":[4902]},"id":2}]} 2024-09-21T03:19:15.480 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 17 2024-09-21T03:19:15.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.479+0000 7f6e0fded640 1 -- 172.21.15.105:0/532301867 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6dec078bc0 msgr2=0x7f6dec07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:15.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.479+0000 7f6e0fded640 1 --2- 172.21.15.105:0/532301867 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6dec078bc0 0x7f6dec07b0d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6e04001500 tx=0x7f6e04006ac0 comp rx=0 tx=0).stop 2024-09-21T03:19:15.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.479+0000 7f6e0fded640 1 -- 172.21.15.105:0/532301867 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e0815e930 msgr2=0x7f6e080ca220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:15.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.479+0000 7f6e0fded640 1 --2- 172.21.15.105:0/532301867 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e0815e930 0x7f6e080ca220 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6df8003f80 tx=0x7f6df800f7e0 comp rx=0 tx=0).stop 2024-09-21T03:19:15.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.479+0000 7f6e0fded640 1 -- 172.21.15.105:0/532301867 shutdown_connections 2024-09-21T03:19:15.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.479+0000 7f6e0fded640 1 --2- 172.21.15.105:0/532301867 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6dec078bc0 0x7f6dec07b0d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:15.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.479+0000 7f6e0fded640 1 --2- 172.21.15.105:0/532301867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e0815e3e0 0x7f6e080ca760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:15.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.479+0000 7f6e0fded640 1 --2- 172.21.15.105:0/532301867 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e0815e930 0x7f6e080ca220 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:15.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.479+0000 7f6e0fded640 1 --2- 172.21.15.105:0/532301867 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6df4004e60 0x7f6e0815daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:15.483 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.479+0000 7f6e0fded640 1 -- 172.21.15.105:0/532301867 >> 172.21.15.105:0/532301867 conn(0x7f6e0809d7f0 msgr2=0x7f6e080b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:15.483 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.479+0000 7f6e0fded640 1 -- 172.21.15.105:0/532301867 shutdown_connections 2024-09-21T03:19:15.483 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.479+0000 7f6e0fded640 1 -- 172.21.15.105:0/532301867 wait complete. 2024-09-21T03:19:15.493 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:19:15.606 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.603+0000 7f61e393a640 1 -- 172.21.15.105:0/3979409984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61dc15a9b0 msgr2=0x7f61dc0cfae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:15.606 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.603+0000 7f61e393a640 1 --2- 172.21.15.105:0/3979409984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61dc15a9b0 0x7f61dc0cfae0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f61d8005fd0 tx=0x7f61d802a4b0 comp rx=0 tx=0).stop 2024-09-21T03:19:15.606 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.603+0000 7f61e393a640 1 -- 172.21.15.105:0/3979409984 shutdown_connections 2024-09-21T03:19:15.606 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.603+0000 7f61e393a640 1 --2- 172.21.15.105:0/3979409984 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61dc15ef10 0x7f61dc0cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:15.606 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.603+0000 7f61e393a640 1 --2- 172.21.15.105:0/3979409984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61dc15a9b0 0x7f61dc0cfae0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:15.607 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.603+0000 7f61e393a640 1 -- 172.21.15.105:0/3979409984 >> 172.21.15.105:0/3979409984 conn(0x7f61dc06d7d0 msgr2=0x7f61dc0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:15.607 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.603+0000 7f61e393a640 1 -- 172.21.15.105:0/3979409984 shutdown_connections 2024-09-21T03:19:15.607 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.603+0000 7f61e393a640 1 -- 172.21.15.105:0/3979409984 wait complete. 2024-09-21T03:19:15.607 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.605+0000 7f61e393a640 1 Processor -- start 2024-09-21T03:19:15.607 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.605+0000 7f61e393a640 1 -- start start 2024-09-21T03:19:15.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.606+0000 7f61e393a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61dc0cceb0 0x7f61dc09c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:15.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.606+0000 7f61e393a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61dc15a9b0 0x7f61dc1537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:15.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.606+0000 7f61e393a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61dc15ef10 0x7f61dc15d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:15.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.606+0000 7f61e393a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f61dc0cc760 con 0x7f61dc15ef10 2024-09-21T03:19:15.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.606+0000 7f61e393a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f61dc0cc5e0 con 0x7f61dc15a9b0 2024-09-21T03:19:15.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.606+0000 7f61e393a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f61dc070f20 con 0x7f61dc0cceb0 2024-09-21T03:19:15.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.606+0000 7f61e1ed7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61dc15ef10 0x7f61dc15d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:15.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.606+0000 7f61e1ed7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61dc15ef10 0x7f61dc15d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51232/0 (socket says 172.21.15.105:51232) 2024-09-21T03:19:15.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.606+0000 7f61e1ed7640 1 -- 172.21.15.105:0/3806140298 learned_addr learned my addr 172.21.15.105:0/3806140298 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:15.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.606+0000 7f61e16d6640 1 --2- 172.21.15.105:0/3806140298 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61dc0cceb0 0x7f61dc09c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:15.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.606+0000 7f61e0ed5640 1 --2- 172.21.15.105:0/3806140298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61dc15a9b0 0x7f61dc1537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:15.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.607+0000 7f61e1ed7640 1 -- 172.21.15.105:0/3806140298 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61dc0cceb0 msgr2=0x7f61dc09c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:15.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.607+0000 7f61e1ed7640 1 --2- 172.21.15.105:0/3806140298 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61dc0cceb0 0x7f61dc09c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:15.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.607+0000 7f61e1ed7640 1 -- 172.21.15.105:0/3806140298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61dc15a9b0 msgr2=0x7f61dc1537b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:15.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.607+0000 7f61e1ed7640 1 --2- 172.21.15.105:0/3806140298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61dc15a9b0 0x7f61dc1537b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:15.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.607+0000 7f61e1ed7640 1 -- 172.21.15.105:0/3806140298 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61dc166630 con 0x7f61dc15ef10 2024-09-21T03:19:15.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.607+0000 7f61e1ed7640 1 --2- 172.21.15.105:0/3806140298 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61dc15ef10 0x7f61dc15d200 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f61d4002230 tx=0x7f61d400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:15.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.607+0000 7f61d1ffb640 1 -- 172.21.15.105:0/3806140298 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d4003b70 con 0x7f61dc15ef10 2024-09-21T03:19:15.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.607+0000 7f61d1ffb640 1 -- 172.21.15.105:0/3806140298 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61d4003d10 con 0x7f61dc15ef10 2024-09-21T03:19:15.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.607+0000 7f61e393a640 1 -- 172.21.15.105:0/3806140298 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61dc166350 con 0x7f61dc15ef10 2024-09-21T03:19:15.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.607+0000 7f61d1ffb640 1 -- 172.21.15.105:0/3806140298 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d4005330 con 0x7f61dc15ef10 2024-09-21T03:19:15.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.607+0000 7f61e393a640 1 -- 172.21.15.105:0/3806140298 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61dc1f6f80 con 0x7f61dc15ef10 2024-09-21T03:19:15.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.608+0000 7f61e393a640 1 -- 172.21.15.105:0/3806140298 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61dc1660c0 con 0x7f61dc15ef10 2024-09-21T03:19:15.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.609+0000 7f61d1ffb640 1 -- 172.21.15.105:0/3806140298 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f61d40056e0 con 0x7f61dc15ef10 2024-09-21T03:19:15.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.609+0000 7f61d1ffb640 1 --2- 172.21.15.105:0/3806140298 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f61c0078bc0 0x7f61c007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:15.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.609+0000 7f61d1ffb640 1 -- 172.21.15.105:0/3806140298 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f61d409aa90 con 0x7f61dc15ef10 2024-09-21T03:19:15.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.610+0000 7f61e16d6640 1 --2- 172.21.15.105:0/3806140298 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f61c0078bc0 0x7f61c007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:15.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.610+0000 7f61e16d6640 1 --2- 172.21.15.105:0/3806140298 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f61c0078bc0 0x7f61c007b0d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f61d8033000 tx=0x7f61d8004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:15.616 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.614+0000 7f61d1ffb640 1 -- 172.21.15.105:0/3806140298 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f61dc0b4780 con 0x7f61dc15ef10 2024-09-21T03:19:15.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.791+0000 7f61e393a640 1 -- 172.21.15.105:0/3806140298 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f61dc0cfae0 con 0x7f61dc15ef10 2024-09-21T03:19:15.794 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.792+0000 7f61d1ffb640 1 -- 172.21.15.105:0/3806140298 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16801 (secure 0 0 0) 0x7f61d40629a0 con 0x7f61dc15ef10 2024-09-21T03:19:15.795 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:19:15.795 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":34,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:19:13.095557+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:19:09.277161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-21T03:19:10.428993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:19:15.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.794+0000 7f61e393a640 1 -- 172.21.15.105:0/3806140298 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f61c0078bc0 msgr2=0x7f61c007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:15.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.794+0000 7f61e393a640 1 --2- 172.21.15.105:0/3806140298 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f61c0078bc0 0x7f61c007b0d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f61d8033000 tx=0x7f61d8004730 comp rx=0 tx=0).stop 2024-09-21T03:19:15.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.794+0000 7f61e393a640 1 -- 172.21.15.105:0/3806140298 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61dc15ef10 msgr2=0x7f61dc15d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:15.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.794+0000 7f61e393a640 1 --2- 172.21.15.105:0/3806140298 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61dc15ef10 0x7f61dc15d200 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f61d4002230 tx=0x7f61d400cb90 comp rx=0 tx=0).stop 2024-09-21T03:19:15.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.794+0000 7f61e393a640 1 -- 172.21.15.105:0/3806140298 shutdown_connections 2024-09-21T03:19:15.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.794+0000 7f61e393a640 1 --2- 172.21.15.105:0/3806140298 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f61c0078bc0 0x7f61c007b0d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:15.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.794+0000 7f61e393a640 1 --2- 172.21.15.105:0/3806140298 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61dc15ef10 0x7f61dc15d200 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:15.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.794+0000 7f61e393a640 1 --2- 172.21.15.105:0/3806140298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61dc15a9b0 0x7f61dc1537b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:15.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.794+0000 7f61e393a640 1 --2- 172.21.15.105:0/3806140298 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61dc0cceb0 0x7f61dc09c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:15.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.794+0000 7f61e393a640 1 -- 172.21.15.105:0/3806140298 >> 172.21.15.105:0/3806140298 conn(0x7f61dc06d7d0 msgr2=0x7f61dc0ae440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:15.798 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.794+0000 7f61e393a640 1 -- 172.21.15.105:0/3806140298 shutdown_connections 2024-09-21T03:19:15.798 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.794+0000 7f61e393a640 1 -- 172.21.15.105:0/3806140298 wait complete. 2024-09-21T03:19:15.808 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T03:19:15.809 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:19:15.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.918+0000 7f65944de640 1 -- 172.21.15.105:0/1020851444 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6578004d40 msgr2=0x7f6578005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:15.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.918+0000 7f65944de640 1 --2- 172.21.15.105:0/1020851444 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6578004d40 0x7f6578005190 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f658400c780 tx=0x7f6578005830 comp rx=0 tx=0).stop 2024-09-21T03:19:15.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.918+0000 7f6592a7b640 1 -- 172.21.15.105:0/1020851444 reap_dead start 2024-09-21T03:19:15.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.918+0000 7f65944de640 1 -- 172.21.15.105:0/1020851444 shutdown_connections 2024-09-21T03:19:15.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.918+0000 7f65944de640 1 -- 172.21.15.105:0/1020851444 >> 172.21.15.105:0/1020851444 conn(0x7f658c0710b0 msgr2=0x7f658c0714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:15.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.918+0000 7f65944de640 1 -- 172.21.15.105:0/1020851444 shutdown_connections 2024-09-21T03:19:15.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.918+0000 7f65944de640 1 -- 172.21.15.105:0/1020851444 wait complete. 2024-09-21T03:19:15.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.920+0000 7f65944de640 1 Processor -- start 2024-09-21T03:19:15.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.920+0000 7f65944de640 1 -- start start 2024-09-21T03:19:15.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.921+0000 7f65944de640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6578004d40 0x7f658c15a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:15.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.921+0000 7f65944de640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f658c14b220 0x7f658c14d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:15.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.921+0000 7f65944de640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f658c14d770 0x7f658c1f6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:15.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.921+0000 7f65944de640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f658c15c6a0 con 0x7f658c14b220 2024-09-21T03:19:15.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.921+0000 7f65944de640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f658c0d13b0 con 0x7f658c14d770 2024-09-21T03:19:15.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.921+0000 7f65944de640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f658c15c820 con 0x7f6578004d40 2024-09-21T03:19:15.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.921+0000 7f6591a79640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f658c14b220 0x7f658c14d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:15.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.921+0000 7f6591a79640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f658c14b220 0x7f658c14d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51248/0 (socket says 172.21.15.105:51248) 2024-09-21T03:19:15.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.921+0000 7f6591a79640 1 -- 172.21.15.105:0/363703102 learned_addr learned my addr 172.21.15.105:0/363703102 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:15.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.921+0000 7f6592a7b640 1 --2- 172.21.15.105:0/363703102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f658c14d770 0x7f658c1f6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:15.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.921+0000 7f659227a640 1 --2- 172.21.15.105:0/363703102 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6578004d40 0x7f658c15a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:15.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.921+0000 7f6591a79640 1 -- 172.21.15.105:0/363703102 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6578004d40 msgr2=0x7f658c15a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:15.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.921+0000 7f6591a79640 1 --2- 172.21.15.105:0/363703102 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6578004d40 0x7f658c15a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:15.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.921+0000 7f6591a79640 1 -- 172.21.15.105:0/363703102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f658c14d770 msgr2=0x7f658c1f6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:15.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.921+0000 7f6591a79640 1 --2- 172.21.15.105:0/363703102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f658c14d770 0x7f658c1f6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:15.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.922+0000 7f6591a79640 1 -- 172.21.15.105:0/363703102 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f658c15ef10 con 0x7f658c14b220 2024-09-21T03:19:15.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.922+0000 7f659227a640 1 --2- 172.21.15.105:0/363703102 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6578004d40 0x7f658c15a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:19:15.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.922+0000 7f6591a79640 1 --2- 172.21.15.105:0/363703102 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f658c14b220 0x7f658c14d230 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f657c00f9d0 tx=0x7f657c00fe90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:15.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.922+0000 7f6582ffd640 1 -- 172.21.15.105:0/363703102 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657c00bc30 con 0x7f658c14b220 2024-09-21T03:19:15.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.922+0000 7f6582ffd640 1 -- 172.21.15.105:0/363703102 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f657c011440 con 0x7f658c14b220 2024-09-21T03:19:15.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.922+0000 7f65944de640 1 -- 172.21.15.105:0/363703102 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f658c14dfe0 con 0x7f658c14b220 2024-09-21T03:19:15.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.922+0000 7f6582ffd640 1 -- 172.21.15.105:0/363703102 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657c011890 con 0x7f658c14b220 2024-09-21T03:19:15.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.922+0000 7f65944de640 1 -- 172.21.15.105:0/363703102 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f658c15a540 con 0x7f658c14b220 2024-09-21T03:19:15.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.923+0000 7f65944de640 1 -- 172.21.15.105:0/363703102 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f658c14dd50 con 0x7f658c14b220 2024-09-21T03:19:15.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.923+0000 7f6582ffd640 1 -- 172.21.15.105:0/363703102 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f657c019020 con 0x7f658c14b220 2024-09-21T03:19:15.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.924+0000 7f6582ffd640 1 --2- 172.21.15.105:0/363703102 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6570078b90 0x7f657007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:15.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.924+0000 7f6582ffd640 1 -- 172.21.15.105:0/363703102 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f657c09b590 con 0x7f658c14b220 2024-09-21T03:19:15.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.924+0000 7f659227a640 1 --2- 172.21.15.105:0/363703102 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6570078b90 0x7f657007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:15.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.925+0000 7f659227a640 1 --2- 172.21.15.105:0/363703102 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6570078b90 0x7f657007b0a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6588003700 tx=0x7f658800b260 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:15.931 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:15.928+0000 7f6582ffd640 1 -- 172.21.15.105:0/363703102 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f657c063410 con 0x7f658c14b220 2024-09-21T03:19:16.104 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.102+0000 7f65944de640 1 -- 172.21.15.105:0/363703102 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f658c14af60 con 0x7f6570078b90 2024-09-21T03:19:16.109 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.106+0000 7f6582ffd640 1 -- 172.21.15.105:0/363703102 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251611 (secure 0 0 0) 0x7f658800b8f0 con 0x7f6570078b90 2024-09-21T03:19:16.112 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:19:16.113 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:19:16.114 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.110+0000 7f65944de640 1 -- 172.21.15.105:0/363703102 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6570078b90 msgr2=0x7f657007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:16.114 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.110+0000 7f65944de640 1 --2- 172.21.15.105:0/363703102 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6570078b90 0x7f657007b0a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6588003700 tx=0x7f658800b260 comp rx=0 tx=0).stop 2024-09-21T03:19:16.114 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.110+0000 7f65944de640 1 -- 172.21.15.105:0/363703102 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f658c14b220 msgr2=0x7f658c14d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:16.114 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.110+0000 7f65944de640 1 --2- 172.21.15.105:0/363703102 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f658c14b220 0x7f658c14d230 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f657c00f9d0 tx=0x7f657c00fe90 comp rx=0 tx=0).stop 2024-09-21T03:19:16.114 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.110+0000 7f65944de640 1 -- 172.21.15.105:0/363703102 shutdown_connections 2024-09-21T03:19:16.115 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.110+0000 7f65944de640 1 --2- 172.21.15.105:0/363703102 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6570078b90 0x7f657007b0a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:16.115 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.110+0000 7f65944de640 1 --2- 172.21.15.105:0/363703102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f658c14d770 0x7f658c1f6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:16.115 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.110+0000 7f65944de640 1 --2- 172.21.15.105:0/363703102 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f658c14b220 0x7f658c14d230 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:16.115 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.110+0000 7f65944de640 1 --2- 172.21.15.105:0/363703102 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6578004d40 0x7f658c15a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:16.115 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.110+0000 7f65944de640 1 -- 172.21.15.105:0/363703102 >> 172.21.15.105:0/363703102 conn(0x7f658c0710b0 msgr2=0x7f658c0cb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:16.115 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.110+0000 7f65944de640 1 -- 172.21.15.105:0/363703102 shutdown_connections 2024-09-21T03:19:16.115 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.110+0000 7f65944de640 1 -- 172.21.15.105:0/363703102 wait complete. 2024-09-21T03:19:16.123 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-09-21T03:19:15.289777+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":144,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":107,"ondisk_log_size":107,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":147,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220340,"kb_used_data":4084,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754380,"statfs":{"total":773094113280,"available":772868485120,"internally_reserved":0,"allocated":4182016,"data_stored":2296430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.200803"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104116+0000","last_change":"2024-09-21T03:19:12.125859+0000","last_active":"2024-09-21T03:19:13.104116+0000","last_peered":"2024-09-21T03:19:13.104116+0000","last_clean":"2024-09-21T03:19:13.104116+0000","last_became_active":"2024-09-21T03:19:12.125455+0000","last_became_peered":"2024-09-21T03:19:12.125455+0000","last_unstale":"2024-09-21T03:19:13.104116+0000","last_undegraded":"2024-09-21T03:19:13.104116+0000","last_fullsized":"2024-09-21T03:19:13.104116+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:34.607404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382017+0000","last_change":"2024-09-21T03:19:12.109132+0000","last_active":"2024-09-21T03:19:13.382017+0000","last_peered":"2024-09-21T03:19:13.382017+0000","last_clean":"2024-09-21T03:19:13.382017+0000","last_became_active":"2024-09-21T03:19:12.108829+0000","last_became_peered":"2024-09-21T03:19:12.108829+0000","last_unstale":"2024-09-21T03:19:13.382017+0000","last_undegraded":"2024-09-21T03:19:13.382017+0000","last_fullsized":"2024-09-21T03:19:13.382017+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:00.596447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382502+0000","last_change":"2024-09-21T03:19:12.131941+0000","last_active":"2024-09-21T03:19:13.382502+0000","last_peered":"2024-09-21T03:19:13.382502+0000","last_clean":"2024-09-21T03:19:13.382502+0000","last_became_active":"2024-09-21T03:19:12.131458+0000","last_became_peered":"2024-09-21T03:19:12.131458+0000","last_unstale":"2024-09-21T03:19:13.382502+0000","last_undegraded":"2024-09-21T03:19:13.382502+0000","last_fullsized":"2024-09-21T03:19:13.382502+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:09:21.244381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.121028+0000","last_change":"2024-09-21T03:19:12.122867+0000","last_active":"2024-09-21T03:19:13.121028+0000","last_peered":"2024-09-21T03:19:13.121028+0000","last_clean":"2024-09-21T03:19:13.121028+0000","last_became_active":"2024-09-21T03:19:12.122533+0000","last_became_peered":"2024-09-21T03:19:12.122533+0000","last_unstale":"2024-09-21T03:19:13.121028+0000","last_undegraded":"2024-09-21T03:19:13.121028+0000","last_fullsized":"2024-09-21T03:19:13.121028+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:59.601871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382009+0000","last_change":"2024-09-21T03:19:12.111226+0000","last_active":"2024-09-21T03:19:13.382009+0000","last_peered":"2024-09-21T03:19:13.382009+0000","last_clean":"2024-09-21T03:19:13.382009+0000","last_became_active":"2024-09-21T03:19:12.110915+0000","last_became_peered":"2024-09-21T03:19:12.110915+0000","last_unstale":"2024-09-21T03:19:13.382009+0000","last_undegraded":"2024-09-21T03:19:13.382009+0000","last_fullsized":"2024-09-21T03:19:13.382009+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:52:42.610167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382578+0000","last_change":"2024-09-21T03:19:12.121447+0000","last_active":"2024-09-21T03:19:13.382578+0000","last_peered":"2024-09-21T03:19:13.382578+0000","last_clean":"2024-09-21T03:19:13.382578+0000","last_became_active":"2024-09-21T03:19:12.121157+0000","last_became_peered":"2024-09-21T03:19:12.121157+0000","last_unstale":"2024-09-21T03:19:13.382578+0000","last_undegraded":"2024-09-21T03:19:13.382578+0000","last_fullsized":"2024-09-21T03:19:13.382578+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:09.757925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102313+0000","last_change":"2024-09-21T03:19:12.115833+0000","last_active":"2024-09-21T03:19:13.102313+0000","last_peered":"2024-09-21T03:19:13.102313+0000","last_clean":"2024-09-21T03:19:13.102313+0000","last_became_active":"2024-09-21T03:19:12.115528+0000","last_became_peered":"2024-09-21T03:19:12.115528+0000","last_unstale":"2024-09-21T03:19:13.102313+0000","last_undegraded":"2024-09-21T03:19:13.102313+0000","last_fullsized":"2024-09-21T03:19:13.102313+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:27.762838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102363+0000","last_change":"2024-09-21T03:19:12.116051+0000","last_active":"2024-09-21T03:19:13.102363+0000","last_peered":"2024-09-21T03:19:13.102363+0000","last_clean":"2024-09-21T03:19:13.102363+0000","last_became_active":"2024-09-21T03:19:12.115701+0000","last_became_peered":"2024-09-21T03:19:12.115701+0000","last_unstale":"2024-09-21T03:19:13.102363+0000","last_undegraded":"2024-09-21T03:19:13.102363+0000","last_fullsized":"2024-09-21T03:19:13.102363+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:07:30.596468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104945+0000","last_change":"2024-09-21T03:19:12.119289+0000","last_active":"2024-09-21T03:19:13.104945+0000","last_peered":"2024-09-21T03:19:13.104945+0000","last_clean":"2024-09-21T03:19:13.104945+0000","last_became_active":"2024-09-21T03:19:12.118634+0000","last_became_peered":"2024-09-21T03:19:12.118634+0000","last_unstale":"2024-09-21T03:19:13.104945+0000","last_undegraded":"2024-09-21T03:19:13.104945+0000","last_fullsized":"2024-09-21T03:19:13.104945+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:23.665081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.121392+0000","last_change":"2024-09-21T03:19:12.116146+0000","last_active":"2024-09-21T03:19:13.121392+0000","last_peered":"2024-09-21T03:19:13.121392+0000","last_clean":"2024-09-21T03:19:13.121392+0000","last_became_active":"2024-09-21T03:19:12.115742+0000","last_became_peered":"2024-09-21T03:19:12.115742+0000","last_unstale":"2024-09-21T03:19:13.121392+0000","last_undegraded":"2024-09-21T03:19:13.121392+0000","last_fullsized":"2024-09-21T03:19:13.121392+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:58.031199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102384+0000","last_change":"2024-09-21T03:19:12.118702+0000","last_active":"2024-09-21T03:19:13.102384+0000","last_peered":"2024-09-21T03:19:13.102384+0000","last_clean":"2024-09-21T03:19:13.102384+0000","last_became_active":"2024-09-21T03:19:12.118391+0000","last_became_peered":"2024-09-21T03:19:12.118391+0000","last_unstale":"2024-09-21T03:19:13.102384+0000","last_undegraded":"2024-09-21T03:19:13.102384+0000","last_fullsized":"2024-09-21T03:19:13.102384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:57.800009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382162+0000","last_change":"2024-09-21T03:19:12.127366+0000","last_active":"2024-09-21T03:19:13.382162+0000","last_peered":"2024-09-21T03:19:13.382162+0000","last_clean":"2024-09-21T03:19:13.382162+0000","last_became_active":"2024-09-21T03:19:12.127036+0000","last_became_peered":"2024-09-21T03:19:12.127036+0000","last_unstale":"2024-09-21T03:19:13.382162+0000","last_undegraded":"2024-09-21T03:19:13.382162+0000","last_fullsized":"2024-09-21T03:19:13.382162+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:49.317940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382211+0000","last_change":"2024-09-21T03:19:12.108265+0000","last_active":"2024-09-21T03:19:13.382211+0000","last_peered":"2024-09-21T03:19:13.382211+0000","last_clean":"2024-09-21T03:19:13.382211+0000","last_became_active":"2024-09-21T03:19:12.107908+0000","last_became_peered":"2024-09-21T03:19:12.107908+0000","last_unstale":"2024-09-21T03:19:13.382211+0000","last_undegraded":"2024-09-21T03:19:13.382211+0000","last_fullsized":"2024-09-21T03:19:13.382211+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:02.577948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382498+0000","last_change":"2024-09-21T03:19:12.110175+0000","last_active":"2024-09-21T03:19:13.382498+0000","last_peered":"2024-09-21T03:19:13.382498+0000","last_clean":"2024-09-21T03:19:13.382498+0000","last_became_active":"2024-09-21T03:19:12.109849+0000","last_became_peered":"2024-09-21T03:19:12.109849+0000","last_unstale":"2024-09-21T03:19:13.382498+0000","last_undegraded":"2024-09-21T03:19:13.382498+0000","last_fullsized":"2024-09-21T03:19:13.382498+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:34.525061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382239+0000","last_change":"2024-09-21T03:19:12.128786+0000","last_active":"2024-09-21T03:19:13.382239+0000","last_peered":"2024-09-21T03:19:13.382239+0000","last_clean":"2024-09-21T03:19:13.382239+0000","last_became_active":"2024-09-21T03:19:12.128433+0000","last_became_peered":"2024-09-21T03:19:12.128433+0000","last_unstale":"2024-09-21T03:19:13.382239+0000","last_undegraded":"2024-09-21T03:19:13.382239+0000","last_fullsized":"2024-09-21T03:19:13.382239+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:57.800009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.103044+0000","last_change":"2024-09-21T03:19:12.114204+0000","last_active":"2024-09-21T03:19:13.103044+0000","last_peered":"2024-09-21T03:19:13.103044+0000","last_clean":"2024-09-21T03:19:13.103044+0000","last_became_active":"2024-09-21T03:19:12.113864+0000","last_became_peered":"2024-09-21T03:19:12.113864+0000","last_unstale":"2024-09-21T03:19:13.103044+0000","last_undegraded":"2024-09-21T03:19:13.103044+0000","last_fullsized":"2024-09-21T03:19:13.103044+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:06.048604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102949+0000","last_change":"2024-09-21T03:19:12.123129+0000","last_active":"2024-09-21T03:19:13.102949+0000","last_peered":"2024-09-21T03:19:13.102949+0000","last_clean":"2024-09-21T03:19:13.102949+0000","last_became_active":"2024-09-21T03:19:12.122781+0000","last_became_peered":"2024-09-21T03:19:12.122781+0000","last_unstale":"2024-09-21T03:19:13.102949+0000","last_undegraded":"2024-09-21T03:19:13.102949+0000","last_fullsized":"2024-09-21T03:19:13.102949+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:48.519582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382143+0000","last_change":"2024-09-21T03:19:12.118599+0000","last_active":"2024-09-21T03:19:13.382143+0000","last_peered":"2024-09-21T03:19:13.382143+0000","last_clean":"2024-09-21T03:19:13.382143+0000","last_became_active":"2024-09-21T03:19:12.118319+0000","last_became_peered":"2024-09-21T03:19:12.118319+0000","last_unstale":"2024-09-21T03:19:13.382143+0000","last_undegraded":"2024-09-21T03:19:13.382143+0000","last_fullsized":"2024-09-21T03:19:13.382143+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:58.905425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381899+0000","last_change":"2024-09-21T03:19:12.121041+0000","last_active":"2024-09-21T03:19:13.381899+0000","last_peered":"2024-09-21T03:19:13.381899+0000","last_clean":"2024-09-21T03:19:13.381899+0000","last_became_active":"2024-09-21T03:19:12.119726+0000","last_became_peered":"2024-09-21T03:19:12.119726+0000","last_unstale":"2024-09-21T03:19:13.381899+0000","last_undegraded":"2024-09-21T03:19:13.381899+0000","last_fullsized":"2024-09-21T03:19:13.381899+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:45:41.300137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381977+0000","last_change":"2024-09-21T03:19:12.120864+0000","last_active":"2024-09-21T03:19:13.381977+0000","last_peered":"2024-09-21T03:19:13.381977+0000","last_clean":"2024-09-21T03:19:13.381977+0000","last_became_active":"2024-09-21T03:19:12.120558+0000","last_became_peered":"2024-09-21T03:19:12.120558+0000","last_unstale":"2024-09-21T03:19:13.381977+0000","last_undegraded":"2024-09-21T03:19:13.381977+0000","last_fullsized":"2024-09-21T03:19:13.381977+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:36.934721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104275+0000","last_change":"2024-09-21T03:19:12.119909+0000","last_active":"2024-09-21T03:19:13.104275+0000","last_peered":"2024-09-21T03:19:13.104275+0000","last_clean":"2024-09-21T03:19:13.104275+0000","last_became_active":"2024-09-21T03:19:12.119529+0000","last_became_peered":"2024-09-21T03:19:12.119529+0000","last_unstale":"2024-09-21T03:19:13.104275+0000","last_undegraded":"2024-09-21T03:19:13.104275+0000","last_fullsized":"2024-09-21T03:19:13.104275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:38.291868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104702+0000","last_change":"2024-09-21T03:19:12.119190+0000","last_active":"2024-09-21T03:19:13.104702+0000","last_peered":"2024-09-21T03:19:13.104702+0000","last_clean":"2024-09-21T03:19:13.104702+0000","last_became_active":"2024-09-21T03:19:12.118617+0000","last_became_peered":"2024-09-21T03:19:12.118617+0000","last_unstale":"2024-09-21T03:19:13.104702+0000","last_undegraded":"2024-09-21T03:19:13.104702+0000","last_fullsized":"2024-09-21T03:19:13.104702+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:38.040137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-21T03:19:11.107024+0000","last_change":"2024-09-21T03:19:11.107024+0000","last_active":"2024-09-21T03:19:11.088347+0000","last_peered":"2024-09-21T03:19:11.088347+0000","last_clean":"2024-09-21T03:19:11.088347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:19:11.107024+0000","last_undegraded":"2024-09-21T03:19:11.107024+0000","last_fullsized":"2024-09-21T03:19:11.107024+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382111+0000","last_change":"2024-09-21T03:19:12.123887+0000","last_active":"2024-09-21T03:19:13.382111+0000","last_peered":"2024-09-21T03:19:13.382111+0000","last_clean":"2024-09-21T03:19:13.382111+0000","last_became_active":"2024-09-21T03:19:12.123560+0000","last_became_peered":"2024-09-21T03:19:12.123560+0000","last_unstale":"2024-09-21T03:19:13.382111+0000","last_undegraded":"2024-09-21T03:19:13.382111+0000","last_fullsized":"2024-09-21T03:19:13.382111+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:27.762838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.121436+0000","last_change":"2024-09-21T03:19:12.116939+0000","last_active":"2024-09-21T03:19:13.121436+0000","last_peered":"2024-09-21T03:19:13.121436+0000","last_clean":"2024-09-21T03:19:13.121436+0000","last_became_active":"2024-09-21T03:19:12.116637+0000","last_became_peered":"2024-09-21T03:19:12.116637+0000","last_unstale":"2024-09-21T03:19:13.121436+0000","last_undegraded":"2024-09-21T03:19:13.121436+0000","last_fullsized":"2024-09-21T03:19:13.121436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:01.049780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382264+0000","last_change":"2024-09-21T03:19:12.117324+0000","last_active":"2024-09-21T03:19:13.382264+0000","last_peered":"2024-09-21T03:19:13.382264+0000","last_clean":"2024-09-21T03:19:13.382264+0000","last_became_active":"2024-09-21T03:19:12.117003+0000","last_became_peered":"2024-09-21T03:19:12.117003+0000","last_unstale":"2024-09-21T03:19:13.382264+0000","last_undegraded":"2024-09-21T03:19:13.382264+0000","last_fullsized":"2024-09-21T03:19:13.382264+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:58.393209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.121300+0000","last_change":"2024-09-21T03:19:12.121597+0000","last_active":"2024-09-21T03:19:13.121300+0000","last_peered":"2024-09-21T03:19:13.121300+0000","last_clean":"2024-09-21T03:19:13.121300+0000","last_became_active":"2024-09-21T03:19:12.121311+0000","last_became_peered":"2024-09-21T03:19:12.121311+0000","last_unstale":"2024-09-21T03:19:13.121300+0000","last_undegraded":"2024-09-21T03:19:13.121300+0000","last_fullsized":"2024-09-21T03:19:13.121300+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:59.556293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382433+0000","last_change":"2024-09-21T03:19:12.121332+0000","last_active":"2024-09-21T03:19:13.382433+0000","last_peered":"2024-09-21T03:19:13.382433+0000","last_clean":"2024-09-21T03:19:13.382433+0000","last_became_active":"2024-09-21T03:19:12.120078+0000","last_became_peered":"2024-09-21T03:19:12.120078+0000","last_unstale":"2024-09-21T03:19:13.382433+0000","last_undegraded":"2024-09-21T03:19:13.382433+0000","last_fullsized":"2024-09-21T03:19:13.382433+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:18:47.580493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104544+0000","last_change":"2024-09-21T03:19:12.124510+0000","last_active":"2024-09-21T03:19:13.104544+0000","last_peered":"2024-09-21T03:19:13.104544+0000","last_clean":"2024-09-21T03:19:13.104544+0000","last_became_active":"2024-09-21T03:19:12.124166+0000","last_became_peered":"2024-09-21T03:19:12.124166+0000","last_unstale":"2024-09-21T03:19:13.104544+0000","last_undegraded":"2024-09-21T03:19:13.104544+0000","last_fullsized":"2024-09-21T03:19:13.104544+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:03:09.576885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102626+0000","last_change":"2024-09-21T03:19:12.125359+0000","last_active":"2024-09-21T03:19:13.102626+0000","last_peered":"2024-09-21T03:19:13.102626+0000","last_clean":"2024-09-21T03:19:13.102626+0000","last_became_active":"2024-09-21T03:19:12.125040+0000","last_became_peered":"2024-09-21T03:19:12.125040+0000","last_unstale":"2024-09-21T03:19:13.102626+0000","last_undegraded":"2024-09-21T03:19:13.102626+0000","last_fullsized":"2024-09-21T03:19:13.102626+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:18:47.580493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.103621+0000","last_change":"2024-09-21T03:19:12.113525+0000","last_active":"2024-09-21T03:19:13.103621+0000","last_peered":"2024-09-21T03:19:13.103621+0000","last_clean":"2024-09-21T03:19:13.103621+0000","last_became_active":"2024-09-21T03:19:12.113179+0000","last_became_peered":"2024-09-21T03:19:12.113179+0000","last_unstale":"2024-09-21T03:19:13.103621+0000","last_undegraded":"2024-09-21T03:19:13.103621+0000","last_fullsized":"2024-09-21T03:19:13.103621+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:25.092143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102677+0000","last_change":"2024-09-21T03:19:12.124045+0000","last_active":"2024-09-21T03:19:13.102677+0000","last_peered":"2024-09-21T03:19:13.102677+0000","last_clean":"2024-09-21T03:19:13.102677+0000","last_became_active":"2024-09-21T03:19:12.123675+0000","last_became_peered":"2024-09-21T03:19:12.123675+0000","last_unstale":"2024-09-21T03:19:13.102677+0000","last_undegraded":"2024-09-21T03:19:13.102677+0000","last_fullsized":"2024-09-21T03:19:13.102677+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:47:14.609891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-21T03:19:11.108357+0000","last_change":"2024-09-21T03:19:11.108357+0000","last_active":"2024-09-21T03:19:11.088347+0000","last_peered":"2024-09-21T03:19:11.088347+0000","last_clean":"2024-09-21T03:19:11.088347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:19:11.108357+0000","last_undegraded":"2024-09-21T03:19:11.108357+0000","last_fullsized":"2024-09-21T03:19:11.108357+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104252+0000","last_change":"2024-09-21T03:19:11.114158+0000","last_active":"2024-09-21T03:19:13.104252+0000","last_peered":"2024-09-21T03:19:13.104252+0000","last_clean":"2024-09-21T03:19:13.104252+0000","last_became_active":"2024-09-21T03:19:11.113815+0000","last_became_peered":"2024-09-21T03:19:11.113815+0000","last_unstale":"2024-09-21T03:19:13.104252+0000","last_undegraded":"2024-09-21T03:19:13.104252+0000","last_fullsized":"2024-09-21T03:19:13.104252+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:55:44.185439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104156+0000","last_change":"2024-09-21T03:19:12.121035+0000","last_active":"2024-09-21T03:19:13.104156+0000","last_peered":"2024-09-21T03:19:13.104156+0000","last_clean":"2024-09-21T03:19:13.104156+0000","last_became_active":"2024-09-21T03:19:12.120664+0000","last_became_peered":"2024-09-21T03:19:12.120664+0000","last_unstale":"2024-09-21T03:19:13.104156+0000","last_undegraded":"2024-09-21T03:19:13.104156+0000","last_fullsized":"2024-09-21T03:19:13.104156+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:41.193668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T03:19:11.120114+0000","last_change":"2024-09-21T03:19:11.118983+0000","last_active":"2024-09-21T03:19:11.120114+0000","last_peered":"2024-09-21T03:19:11.120114+0000","last_clean":"2024-09-21T03:19:11.120114+0000","last_became_active":"2024-09-21T03:19:11.118703+0000","last_became_peered":"2024-09-21T03:19:11.118703+0000","last_unstale":"2024-09-21T03:19:11.120114+0000","last_undegraded":"2024-09-21T03:19:11.120114+0000","last_fullsized":"2024-09-21T03:19:11.120114+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:16.597589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104999+0000","last_change":"2024-09-21T03:19:12.121175+0000","last_active":"2024-09-21T03:19:13.104999+0000","last_peered":"2024-09-21T03:19:13.104999+0000","last_clean":"2024-09-21T03:19:13.104999+0000","last_became_active":"2024-09-21T03:19:12.120612+0000","last_became_peered":"2024-09-21T03:19:12.120612+0000","last_unstale":"2024-09-21T03:19:13.104999+0000","last_undegraded":"2024-09-21T03:19:13.104999+0000","last_fullsized":"2024-09-21T03:19:13.104999+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:42.611910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381723+0000","last_change":"2024-09-21T03:19:11.108839+0000","last_active":"2024-09-21T03:19:13.381723+0000","last_peered":"2024-09-21T03:19:13.381723+0000","last_clean":"2024-09-21T03:19:13.381723+0000","last_became_active":"2024-09-21T03:19:11.108247+0000","last_became_peered":"2024-09-21T03:19:11.108247+0000","last_unstale":"2024-09-21T03:19:13.381723+0000","last_undegraded":"2024-09-21T03:19:13.381723+0000","last_fullsized":"2024-09-21T03:19:13.381723+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:23.619672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.121337+0000","last_change":"2024-09-21T03:19:12.120865+0000","last_active":"2024-09-21T03:19:13.121337+0000","last_peered":"2024-09-21T03:19:13.121337+0000","last_clean":"2024-09-21T03:19:13.121337+0000","last_became_active":"2024-09-21T03:19:12.120573+0000","last_became_peered":"2024-09-21T03:19:12.120573+0000","last_unstale":"2024-09-21T03:19:13.121337+0000","last_undegraded":"2024-09-21T03:19:13.121337+0000","last_fullsized":"2024-09-21T03:19:13.121337+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:40.773712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382105+0000","last_change":"2024-09-21T03:19:11.112313+0000","last_active":"2024-09-21T03:19:13.382105+0000","last_peered":"2024-09-21T03:19:13.382105+0000","last_clean":"2024-09-21T03:19:13.382105+0000","last_became_active":"2024-09-21T03:19:11.110122+0000","last_became_peered":"2024-09-21T03:19:11.110122+0000","last_unstale":"2024-09-21T03:19:13.382105+0000","last_undegraded":"2024-09-21T03:19:13.382105+0000","last_fullsized":"2024-09-21T03:19:13.382105+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:43.796244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102942+0000","last_change":"2024-09-21T03:19:12.123179+0000","last_active":"2024-09-21T03:19:13.102942+0000","last_peered":"2024-09-21T03:19:13.102942+0000","last_clean":"2024-09-21T03:19:13.102942+0000","last_became_active":"2024-09-21T03:19:12.122875+0000","last_became_peered":"2024-09-21T03:19:12.122875+0000","last_unstale":"2024-09-21T03:19:13.102942+0000","last_undegraded":"2024-09-21T03:19:13.102942+0000","last_fullsized":"2024-09-21T03:19:13.102942+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:34.525061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104724+0000","last_change":"2024-09-21T03:19:11.117022+0000","last_active":"2024-09-21T03:19:13.104724+0000","last_peered":"2024-09-21T03:19:13.104724+0000","last_clean":"2024-09-21T03:19:13.104724+0000","last_became_active":"2024-09-21T03:19:11.116690+0000","last_became_peered":"2024-09-21T03:19:11.116690+0000","last_unstale":"2024-09-21T03:19:13.104724+0000","last_undegraded":"2024-09-21T03:19:13.104724+0000","last_fullsized":"2024-09-21T03:19:13.104724+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:51.255559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382486+0000","last_change":"2024-09-21T03:19:12.119159+0000","last_active":"2024-09-21T03:19:13.382486+0000","last_peered":"2024-09-21T03:19:13.382486+0000","last_clean":"2024-09-21T03:19:13.382486+0000","last_became_active":"2024-09-21T03:19:12.118808+0000","last_became_peered":"2024-09-21T03:19:12.118808+0000","last_unstale":"2024-09-21T03:19:13.382486+0000","last_undegraded":"2024-09-21T03:19:13.382486+0000","last_fullsized":"2024-09-21T03:19:13.382486+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:48.519582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104682+0000","last_change":"2024-09-21T03:19:11.116558+0000","last_active":"2024-09-21T03:19:13.104682+0000","last_peered":"2024-09-21T03:19:13.104682+0000","last_clean":"2024-09-21T03:19:13.104682+0000","last_became_active":"2024-09-21T03:19:11.116169+0000","last_became_peered":"2024-09-21T03:19:11.116169+0000","last_unstale":"2024-09-21T03:19:13.104682+0000","last_undegraded":"2024-09-21T03:19:13.104682+0000","last_fullsized":"2024-09-21T03:19:13.104682+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:23:00.100615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104262+0000","last_change":"2024-09-21T03:19:12.115624+0000","last_active":"2024-09-21T03:19:13.104262+0000","last_peered":"2024-09-21T03:19:13.104262+0000","last_clean":"2024-09-21T03:19:13.104262+0000","last_became_active":"2024-09-21T03:19:12.115275+0000","last_became_peered":"2024-09-21T03:19:12.115275+0000","last_unstale":"2024-09-21T03:19:13.104262+0000","last_undegraded":"2024-09-21T03:19:13.104262+0000","last_fullsized":"2024-09-21T03:19:13.104262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:41.193668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381827+0000","last_change":"2024-09-21T03:19:11.103165+0000","last_active":"2024-09-21T03:19:13.381827+0000","last_peered":"2024-09-21T03:19:13.381827+0000","last_clean":"2024-09-21T03:19:13.381827+0000","last_became_active":"2024-09-21T03:19:11.102872+0000","last_became_peered":"2024-09-21T03:19:11.102872+0000","last_unstale":"2024-09-21T03:19:13.381827+0000","last_undegraded":"2024-09-21T03:19:13.381827+0000","last_fullsized":"2024-09-21T03:19:13.381827+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:56:43.303284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.120728+0000","last_change":"2024-09-21T03:19:12.127448+0000","last_active":"2024-09-21T03:19:13.120728+0000","last_peered":"2024-09-21T03:19:13.120728+0000","last_clean":"2024-09-21T03:19:13.120728+0000","last_became_active":"2024-09-21T03:19:12.127007+0000","last_became_peered":"2024-09-21T03:19:12.127007+0000","last_unstale":"2024-09-21T03:19:13.120728+0000","last_undegraded":"2024-09-21T03:19:13.120728+0000","last_fullsized":"2024-09-21T03:19:13.120728+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:32.175500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104894+0000","last_change":"2024-09-21T03:19:11.112403+0000","last_active":"2024-09-21T03:19:13.104894+0000","last_peered":"2024-09-21T03:19:13.104894+0000","last_clean":"2024-09-21T03:19:13.104894+0000","last_became_active":"2024-09-21T03:19:11.110380+0000","last_became_peered":"2024-09-21T03:19:11.110380+0000","last_unstale":"2024-09-21T03:19:13.104894+0000","last_undegraded":"2024-09-21T03:19:13.104894+0000","last_fullsized":"2024-09-21T03:19:13.104894+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:51.798449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382430+0000","last_change":"2024-09-21T03:19:12.120648+0000","last_active":"2024-09-21T03:19:13.382430+0000","last_peered":"2024-09-21T03:19:13.382430+0000","last_clean":"2024-09-21T03:19:13.382430+0000","last_became_active":"2024-09-21T03:19:12.119981+0000","last_became_peered":"2024-09-21T03:19:12.119981+0000","last_unstale":"2024-09-21T03:19:13.382430+0000","last_undegraded":"2024-09-21T03:19:13.382430+0000","last_fullsized":"2024-09-21T03:19:13.382430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:11:25.857215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381960+0000","last_change":"2024-09-21T03:19:11.116104+0000","last_active":"2024-09-21T03:19:13.381960+0000","last_peered":"2024-09-21T03:19:13.381960+0000","last_clean":"2024-09-21T03:19:13.381960+0000","last_became_active":"2024-09-21T03:19:11.114896+0000","last_became_peered":"2024-09-21T03:19:11.114896+0000","last_unstale":"2024-09-21T03:19:13.381960+0000","last_undegraded":"2024-09-21T03:19:13.381960+0000","last_fullsized":"2024-09-21T03:19:13.381960+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:13.276373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381838+0000","last_change":"2024-09-21T03:19:12.115277+0000","last_active":"2024-09-21T03:19:13.381838+0000","last_peered":"2024-09-21T03:19:13.381838+0000","last_clean":"2024-09-21T03:19:13.381838+0000","last_became_active":"2024-09-21T03:19:12.114969+0000","last_became_peered":"2024-09-21T03:19:12.114969+0000","last_unstale":"2024-09-21T03:19:13.381838+0000","last_undegraded":"2024-09-21T03:19:13.381838+0000","last_fullsized":"2024-09-21T03:19:13.381838+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:07:30.596468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T03:19:11.120871+0000","last_change":"2024-09-21T03:19:11.119888+0000","last_active":"2024-09-21T03:19:11.120871+0000","last_peered":"2024-09-21T03:19:11.120871+0000","last_clean":"2024-09-21T03:19:11.120871+0000","last_became_active":"2024-09-21T03:19:11.119545+0000","last_became_peered":"2024-09-21T03:19:11.119545+0000","last_unstale":"2024-09-21T03:19:11.120871+0000","last_undegraded":"2024-09-21T03:19:11.120871+0000","last_fullsized":"2024-09-21T03:19:11.120871+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:08:16.943494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382322+0000","last_change":"2024-09-21T03:19:12.114882+0000","last_active":"2024-09-21T03:19:13.382322+0000","last_peered":"2024-09-21T03:19:13.382322+0000","last_clean":"2024-09-21T03:19:13.382322+0000","last_became_active":"2024-09-21T03:19:12.114561+0000","last_became_peered":"2024-09-21T03:19:12.114561+0000","last_unstale":"2024-09-21T03:19:13.382322+0000","last_undegraded":"2024-09-21T03:19:13.382322+0000","last_fullsized":"2024-09-21T03:19:13.382322+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:08.667667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382464+0000","last_change":"2024-09-21T03:19:11.111184+0000","last_active":"2024-09-21T03:19:13.382464+0000","last_peered":"2024-09-21T03:19:13.382464+0000","last_clean":"2024-09-21T03:19:13.382464+0000","last_became_active":"2024-09-21T03:19:11.110861+0000","last_became_peered":"2024-09-21T03:19:11.110861+0000","last_unstale":"2024-09-21T03:19:13.382464+0000","last_undegraded":"2024-09-21T03:19:13.382464+0000","last_fullsized":"2024-09-21T03:19:13.382464+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:57.066419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382293+0000","last_change":"2024-09-21T03:19:12.131237+0000","last_active":"2024-09-21T03:19:13.382293+0000","last_peered":"2024-09-21T03:19:13.382293+0000","last_clean":"2024-09-21T03:19:13.382293+0000","last_became_active":"2024-09-21T03:19:12.130867+0000","last_became_peered":"2024-09-21T03:19:12.130867+0000","last_unstale":"2024-09-21T03:19:13.382293+0000","last_undegraded":"2024-09-21T03:19:13.382293+0000","last_fullsized":"2024-09-21T03:19:13.382293+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:29:39.788655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382367+0000","last_change":"2024-09-21T03:19:11.109747+0000","last_active":"2024-09-21T03:19:13.382367+0000","last_peered":"2024-09-21T03:19:13.382367+0000","last_clean":"2024-09-21T03:19:13.382367+0000","last_became_active":"2024-09-21T03:19:11.109471+0000","last_became_peered":"2024-09-21T03:19:11.109471+0000","last_unstale":"2024-09-21T03:19:13.382367+0000","last_undegraded":"2024-09-21T03:19:13.382367+0000","last_fullsized":"2024-09-21T03:19:13.382367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:11.187788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.120806+0000","last_change":"2024-09-21T03:19:12.128068+0000","last_active":"2024-09-21T03:19:13.120806+0000","last_peered":"2024-09-21T03:19:13.120806+0000","last_clean":"2024-09-21T03:19:13.120806+0000","last_became_active":"2024-09-21T03:19:12.127594+0000","last_became_peered":"2024-09-21T03:19:12.127594+0000","last_unstale":"2024-09-21T03:19:13.120806+0000","last_undegraded":"2024-09-21T03:19:13.120806+0000","last_fullsized":"2024-09-21T03:19:13.120806+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:19.756214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104891+0000","last_change":"2024-09-21T03:19:11.108994+0000","last_active":"2024-09-21T03:19:13.104891+0000","last_peered":"2024-09-21T03:19:13.104891+0000","last_clean":"2024-09-21T03:19:13.104891+0000","last_became_active":"2024-09-21T03:19:11.108092+0000","last_became_peered":"2024-09-21T03:19:11.108092+0000","last_unstale":"2024-09-21T03:19:13.104891+0000","last_undegraded":"2024-09-21T03:19:13.104891+0000","last_fullsized":"2024-09-21T03:19:13.104891+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:15.318084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382516+0000","last_change":"2024-09-21T03:19:12.111240+0000","last_active":"2024-09-21T03:19:13.382516+0000","last_peered":"2024-09-21T03:19:13.382516+0000","last_clean":"2024-09-21T03:19:13.382516+0000","last_became_active":"2024-09-21T03:19:12.110483+0000","last_became_peered":"2024-09-21T03:19:12.110483+0000","last_unstale":"2024-09-21T03:19:13.382516+0000","last_undegraded":"2024-09-21T03:19:13.382516+0000","last_fullsized":"2024-09-21T03:19:13.382516+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:43.881668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.120663+0000","last_change":"2024-09-21T03:19:11.112700+0000","last_active":"2024-09-21T03:19:13.120663+0000","last_peered":"2024-09-21T03:19:13.120663+0000","last_clean":"2024-09-21T03:19:13.120663+0000","last_became_active":"2024-09-21T03:19:11.112398+0000","last_became_peered":"2024-09-21T03:19:11.112398+0000","last_unstale":"2024-09-21T03:19:13.120663+0000","last_undegraded":"2024-09-21T03:19:13.120663+0000","last_fullsized":"2024-09-21T03:19:13.120663+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:14.899603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102654+0000","last_change":"2024-09-21T03:19:12.124045+0000","last_active":"2024-09-21T03:19:13.102654+0000","last_peered":"2024-09-21T03:19:13.102654+0000","last_clean":"2024-09-21T03:19:13.102654+0000","last_became_active":"2024-09-21T03:19:12.123703+0000","last_became_peered":"2024-09-21T03:19:12.123703+0000","last_unstale":"2024-09-21T03:19:13.102654+0000","last_undegraded":"2024-09-21T03:19:13.102654+0000","last_fullsized":"2024-09-21T03:19:13.102654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:11:25.857215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381941+0000","last_change":"2024-09-21T03:19:11.113832+0000","last_active":"2024-09-21T03:19:13.381941+0000","last_peered":"2024-09-21T03:19:13.381941+0000","last_clean":"2024-09-21T03:19:13.381941+0000","last_became_active":"2024-09-21T03:19:11.113490+0000","last_became_peered":"2024-09-21T03:19:11.113490+0000","last_unstale":"2024-09-21T03:19:13.381941+0000","last_undegraded":"2024-09-21T03:19:13.381941+0000","last_fullsized":"2024-09-21T03:19:13.381941+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:21.360860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.103679+0000","last_change":"2024-09-21T03:19:12.112692+0000","last_active":"2024-09-21T03:19:13.103679+0000","last_peered":"2024-09-21T03:19:13.103679+0000","last_clean":"2024-09-21T03:19:13.103679+0000","last_became_active":"2024-09-21T03:19:12.112358+0000","last_became_peered":"2024-09-21T03:19:12.112358+0000","last_unstale":"2024-09-21T03:19:13.103679+0000","last_undegraded":"2024-09-21T03:19:13.103679+0000","last_fullsized":"2024-09-21T03:19:13.103679+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:55.890328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381835+0000","last_change":"2024-09-21T03:19:11.113112+0000","last_active":"2024-09-21T03:19:13.381835+0000","last_peered":"2024-09-21T03:19:13.381835+0000","last_clean":"2024-09-21T03:19:13.381835+0000","last_became_active":"2024-09-21T03:19:11.112471+0000","last_became_peered":"2024-09-21T03:19:11.112471+0000","last_unstale":"2024-09-21T03:19:13.381835+0000","last_undegraded":"2024-09-21T03:19:13.381835+0000","last_fullsized":"2024-09-21T03:19:13.381835+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:14.685100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104597+0000","last_change":"2024-09-21T03:19:12.123489+0000","last_active":"2024-09-21T03:19:13.104597+0000","last_peered":"2024-09-21T03:19:13.104597+0000","last_clean":"2024-09-21T03:19:13.104597+0000","last_became_active":"2024-09-21T03:19:12.123128+0000","last_became_peered":"2024-09-21T03:19:12.123128+0000","last_unstale":"2024-09-21T03:19:13.104597+0000","last_undegraded":"2024-09-21T03:19:13.104597+0000","last_fullsized":"2024-09-21T03:19:13.104597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:58.072413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.121464+0000","last_change":"2024-09-21T03:19:11.116551+0000","last_active":"2024-09-21T03:19:13.121464+0000","last_peered":"2024-09-21T03:19:13.121464+0000","last_clean":"2024-09-21T03:19:13.121464+0000","last_became_active":"2024-09-21T03:19:11.116223+0000","last_became_peered":"2024-09-21T03:19:11.116223+0000","last_unstale":"2024-09-21T03:19:13.121464+0000","last_undegraded":"2024-09-21T03:19:13.121464+0000","last_fullsized":"2024-09-21T03:19:13.121464+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:15.318084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382586+0000","last_change":"2024-09-21T03:19:12.128395+0000","last_active":"2024-09-21T03:19:13.382586+0000","last_peered":"2024-09-21T03:19:13.382586+0000","last_clean":"2024-09-21T03:19:13.382586+0000","last_became_active":"2024-09-21T03:19:12.128076+0000","last_became_peered":"2024-09-21T03:19:12.128076+0000","last_unstale":"2024-09-21T03:19:13.382586+0000","last_undegraded":"2024-09-21T03:19:13.382586+0000","last_fullsized":"2024-09-21T03:19:13.382586+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:06.048604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104542+0000","last_change":"2024-09-21T03:19:11.111848+0000","last_active":"2024-09-21T03:19:13.104542+0000","last_peered":"2024-09-21T03:19:13.104542+0000","last_clean":"2024-09-21T03:19:13.104542+0000","last_became_active":"2024-09-21T03:19:11.111129+0000","last_became_peered":"2024-09-21T03:19:11.111129+0000","last_unstale":"2024-09-21T03:19:13.104542+0000","last_undegraded":"2024-09-21T03:19:13.104542+0000","last_fullsized":"2024-09-21T03:19:13.104542+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:39.822767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.120953+0000","last_change":"2024-09-21T03:19:12.129108+0000","last_active":"2024-09-21T03:19:13.120953+0000","last_peered":"2024-09-21T03:19:13.120953+0000","last_clean":"2024-09-21T03:19:13.120953+0000","last_became_active":"2024-09-21T03:19:12.128830+0000","last_became_peered":"2024-09-21T03:19:12.128830+0000","last_unstale":"2024-09-21T03:19:13.120953+0000","last_undegraded":"2024-09-21T03:19:13.120953+0000","last_fullsized":"2024-09-21T03:19:13.120953+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:06.450432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104733+0000","last_change":"2024-09-21T03:19:11.108248+0000","last_active":"2024-09-21T03:19:13.104733+0000","last_peered":"2024-09-21T03:19:13.104733+0000","last_clean":"2024-09-21T03:19:13.104733+0000","last_became_active":"2024-09-21T03:19:11.107839+0000","last_became_peered":"2024-09-21T03:19:11.107839+0000","last_unstale":"2024-09-21T03:19:13.104733+0000","last_undegraded":"2024-09-21T03:19:13.104733+0000","last_fullsized":"2024-09-21T03:19:13.104733+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:43.984247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381830+0000","last_change":"2024-09-21T03:19:12.106769+0000","last_active":"2024-09-21T03:19:13.381830+0000","last_peered":"2024-09-21T03:19:13.381830+0000","last_clean":"2024-09-21T03:19:13.381830+0000","last_became_active":"2024-09-21T03:19:12.106423+0000","last_became_peered":"2024-09-21T03:19:12.106423+0000","last_unstale":"2024-09-21T03:19:13.381830+0000","last_undegraded":"2024-09-21T03:19:13.381830+0000","last_fullsized":"2024-09-21T03:19:13.381830+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:46.793926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104977+0000","last_change":"2024-09-21T03:19:11.117034+0000","last_active":"2024-09-21T03:19:13.104977+0000","last_peered":"2024-09-21T03:19:13.104977+0000","last_clean":"2024-09-21T03:19:13.104977+0000","last_became_active":"2024-09-21T03:19:11.116729+0000","last_became_peered":"2024-09-21T03:19:11.116729+0000","last_unstale":"2024-09-21T03:19:13.104977+0000","last_undegraded":"2024-09-21T03:19:13.104977+0000","last_fullsized":"2024-09-21T03:19:13.104977+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:10:00.681324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381579+0000","last_change":"2024-09-21T03:19:12.119850+0000","last_active":"2024-09-21T03:19:13.381579+0000","last_peered":"2024-09-21T03:19:13.381579+0000","last_clean":"2024-09-21T03:19:13.381579+0000","last_became_active":"2024-09-21T03:19:12.119239+0000","last_became_peered":"2024-09-21T03:19:12.119239+0000","last_unstale":"2024-09-21T03:19:13.381579+0000","last_undegraded":"2024-09-21T03:19:13.381579+0000","last_fullsized":"2024-09-21T03:19:13.381579+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:25:23.749492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T03:19:11.119204+0000","last_change":"2024-09-21T03:19:11.114966+0000","last_active":"2024-09-21T03:19:11.119204+0000","last_peered":"2024-09-21T03:19:11.119204+0000","last_clean":"2024-09-21T03:19:11.119204+0000","last_became_active":"2024-09-21T03:19:11.114605+0000","last_became_peered":"2024-09-21T03:19:11.114605+0000","last_unstale":"2024-09-21T03:19:11.119204+0000","last_undegraded":"2024-09-21T03:19:11.119204+0000","last_fullsized":"2024-09-21T03:19:11.119204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.793226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382249+0000","last_change":"2024-09-21T03:19:12.109364+0000","last_active":"2024-09-21T03:19:13.382249+0000","last_peered":"2024-09-21T03:19:13.382249+0000","last_clean":"2024-09-21T03:19:13.382249+0000","last_became_active":"2024-09-21T03:19:12.109039+0000","last_became_peered":"2024-09-21T03:19:12.109039+0000","last_unstale":"2024-09-21T03:19:13.382249+0000","last_undegraded":"2024-09-21T03:19:13.382249+0000","last_fullsized":"2024-09-21T03:19:13.382249+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:33.944043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.103590+0000","last_change":"2024-09-21T03:19:11.109672+0000","last_active":"2024-09-21T03:19:13.103590+0000","last_peered":"2024-09-21T03:19:13.103590+0000","last_clean":"2024-09-21T03:19:13.103590+0000","last_became_active":"2024-09-21T03:19:11.109093+0000","last_became_peered":"2024-09-21T03:19:11.109093+0000","last_unstale":"2024-09-21T03:19:13.103590+0000","last_undegraded":"2024-09-21T03:19:13.103590+0000","last_fullsized":"2024-09-21T03:19:13.103590+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:51.798449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381560+0000","last_change":"2024-09-21T03:19:12.106248+0000","last_active":"2024-09-21T03:19:13.381560+0000","last_peered":"2024-09-21T03:19:13.381560+0000","last_clean":"2024-09-21T03:19:13.381560+0000","last_became_active":"2024-09-21T03:19:12.105920+0000","last_became_peered":"2024-09-21T03:19:12.105920+0000","last_unstale":"2024-09-21T03:19:13.381560+0000","last_undegraded":"2024-09-21T03:19:13.381560+0000","last_fullsized":"2024-09-21T03:19:13.381560+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:36.590900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104635+0000","last_change":"2024-09-21T03:19:11.110445+0000","last_active":"2024-09-21T03:19:13.104635+0000","last_peered":"2024-09-21T03:19:13.104635+0000","last_clean":"2024-09-21T03:19:13.104635+0000","last_became_active":"2024-09-21T03:19:11.109764+0000","last_became_peered":"2024-09-21T03:19:11.109764+0000","last_unstale":"2024-09-21T03:19:13.104635+0000","last_undegraded":"2024-09-21T03:19:13.104635+0000","last_fullsized":"2024-09-21T03:19:13.104635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:55:44.185439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.101998+0000","last_change":"2024-09-21T03:19:12.115049+0000","last_active":"2024-09-21T03:19:13.101998+0000","last_peered":"2024-09-21T03:19:13.101998+0000","last_clean":"2024-09-21T03:19:13.101998+0000","last_became_active":"2024-09-21T03:19:12.114717+0000","last_became_peered":"2024-09-21T03:19:12.114717+0000","last_unstale":"2024-09-21T03:19:13.101998+0000","last_undegraded":"2024-09-21T03:19:13.101998+0000","last_fullsized":"2024-09-21T03:19:13.101998+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:04.243781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381893+0000","last_change":"2024-09-21T03:19:11.111243+0000","last_active":"2024-09-21T03:19:13.381893+0000","last_peered":"2024-09-21T03:19:13.381893+0000","last_clean":"2024-09-21T03:19:13.381893+0000","last_became_active":"2024-09-21T03:19:11.110915+0000","last_became_peered":"2024-09-21T03:19:11.110915+0000","last_unstale":"2024-09-21T03:19:13.381893+0000","last_undegraded":"2024-09-21T03:19:13.381893+0000","last_fullsized":"2024-09-21T03:19:13.381893+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:03:08.570891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381599+0000","last_change":"2024-09-21T03:19:12.124361+0000","last_active":"2024-09-21T03:19:13.381599+0000","last_peered":"2024-09-21T03:19:13.381599+0000","last_clean":"2024-09-21T03:19:13.381599+0000","last_became_active":"2024-09-21T03:19:12.124007+0000","last_became_peered":"2024-09-21T03:19:12.124007+0000","last_unstale":"2024-09-21T03:19:13.381599+0000","last_undegraded":"2024-09-21T03:19:13.381599+0000","last_fullsized":"2024-09-21T03:19:13.381599+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:56.039566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.121525+0000","last_change":"2024-09-21T03:19:11.109955+0000","last_active":"2024-09-21T03:19:13.121525+0000","last_peered":"2024-09-21T03:19:13.121525+0000","last_clean":"2024-09-21T03:19:13.121525+0000","last_became_active":"2024-09-21T03:19:11.109654+0000","last_became_peered":"2024-09-21T03:19:11.109654+0000","last_unstale":"2024-09-21T03:19:13.121525+0000","last_undegraded":"2024-09-21T03:19:13.121525+0000","last_fullsized":"2024-09-21T03:19:13.121525+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:46.019163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382620+0000","last_change":"2024-09-21T03:19:12.120031+0000","last_active":"2024-09-21T03:19:13.382620+0000","last_peered":"2024-09-21T03:19:13.382620+0000","last_clean":"2024-09-21T03:19:13.382620+0000","last_became_active":"2024-09-21T03:19:12.119600+0000","last_became_peered":"2024-09-21T03:19:12.119600+0000","last_unstale":"2024-09-21T03:19:13.382620+0000","last_undegraded":"2024-09-21T03:19:13.382620+0000","last_fullsized":"2024-09-21T03:19:13.382620+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:37:33.265939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T03:19:11.119254+0000","last_change":"2024-09-21T03:19:11.115218+0000","last_active":"2024-09-21T03:19:11.119254+0000","last_peered":"2024-09-21T03:19:11.119254+0000","last_clean":"2024-09-21T03:19:11.119254+0000","last_became_active":"2024-09-21T03:19:11.114683+0000","last_became_peered":"2024-09-21T03:19:11.114683+0000","last_unstale":"2024-09-21T03:19:11.119254+0000","last_undegraded":"2024-09-21T03:19:11.119254+0000","last_fullsized":"2024-09-21T03:19:11.119254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:05.460161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-21T03:19:11.106577+0000","last_change":"2024-09-21T03:19:11.106577+0000","last_active":"2024-09-21T03:19:11.088347+0000","last_peered":"2024-09-21T03:19:11.088347+0000","last_clean":"2024-09-21T03:19:11.088347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:19:11.106577+0000","last_undegraded":"2024-09-21T03:19:11.106577+0000","last_fullsized":"2024-09-21T03:19:11.106577+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.121131+0000","last_change":"2024-09-21T03:19:11.113832+0000","last_active":"2024-09-21T03:19:13.121131+0000","last_peered":"2024-09-21T03:19:13.121131+0000","last_clean":"2024-09-21T03:19:13.121131+0000","last_became_active":"2024-09-21T03:19:11.113316+0000","last_became_peered":"2024-09-21T03:19:11.113316+0000","last_unstale":"2024-09-21T03:19:13.121131+0000","last_undegraded":"2024-09-21T03:19:13.121131+0000","last_fullsized":"2024-09-21T03:19:13.121131+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:27.026756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.103465+0000","last_change":"2024-09-21T03:19:12.112077+0000","last_active":"2024-09-21T03:19:13.103465+0000","last_peered":"2024-09-21T03:19:13.103465+0000","last_clean":"2024-09-21T03:19:13.103465+0000","last_became_active":"2024-09-21T03:19:12.111703+0000","last_became_peered":"2024-09-21T03:19:12.111703+0000","last_unstale":"2024-09-21T03:19:13.103465+0000","last_undegraded":"2024-09-21T03:19:13.103465+0000","last_fullsized":"2024-09-21T03:19:13.103465+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:07.764584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T03:19:11.117568+0000","last_change":"2024-09-21T03:19:11.113950+0000","last_active":"2024-09-21T03:19:11.117568+0000","last_peered":"2024-09-21T03:19:11.117568+0000","last_clean":"2024-09-21T03:19:11.117568+0000","last_became_active":"2024-09-21T03:19:11.113642+0000","last_became_peered":"2024-09-21T03:19:11.113642+0000","last_unstale":"2024-09-21T03:19:11.117568+0000","last_undegraded":"2024-09-21T03:19:11.117568+0000","last_fullsized":"2024-09-21T03:19:11.117568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:30.646321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-21T03:19:11.107540+0000","last_change":"2024-09-21T03:19:11.107540+0000","last_active":"2024-09-21T03:19:11.088347+0000","last_peered":"2024-09-21T03:19:11.088347+0000","last_clean":"2024-09-21T03:19:11.088347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:19:11.107540+0000","last_undegraded":"2024-09-21T03:19:11.107540+0000","last_fullsized":"2024-09-21T03:19:11.107540+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.120766+0000","last_change":"2024-09-21T03:19:11.109571+0000","last_active":"2024-09-21T03:19:13.120766+0000","last_peered":"2024-09-21T03:19:13.120766+0000","last_clean":"2024-09-21T03:19:13.120766+0000","last_became_active":"2024-09-21T03:19:11.108784+0000","last_became_peered":"2024-09-21T03:19:11.108784+0000","last_unstale":"2024-09-21T03:19:13.120766+0000","last_undegraded":"2024-09-21T03:19:13.120766+0000","last_fullsized":"2024-09-21T03:19:13.120766+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:54:50.383426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381710+0000","last_change":"2024-09-21T03:19:12.108714+0000","last_active":"2024-09-21T03:19:13.381710+0000","last_peered":"2024-09-21T03:19:13.381710+0000","last_clean":"2024-09-21T03:19:13.381710+0000","last_became_active":"2024-09-21T03:19:12.108316+0000","last_became_peered":"2024-09-21T03:19:12.108316+0000","last_unstale":"2024-09-21T03:19:13.381710+0000","last_undegraded":"2024-09-21T03:19:13.381710+0000","last_fullsized":"2024-09-21T03:19:13.381710+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:19.212639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104747+0000","last_change":"2024-09-21T03:19:11.110080+0000","last_active":"2024-09-21T03:19:13.104747+0000","last_peered":"2024-09-21T03:19:13.104747+0000","last_clean":"2024-09-21T03:19:13.104747+0000","last_became_active":"2024-09-21T03:19:11.109409+0000","last_became_peered":"2024-09-21T03:19:11.109409+0000","last_unstale":"2024-09-21T03:19:13.104747+0000","last_undegraded":"2024-09-21T03:19:13.104747+0000","last_fullsized":"2024-09-21T03:19:13.104747+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:23:30.198368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104778+0000","last_change":"2024-09-21T03:19:12.120376+0000","last_active":"2024-09-21T03:19:13.104778+0000","last_peered":"2024-09-21T03:19:13.104778+0000","last_clean":"2024-09-21T03:19:13.104778+0000","last_became_active":"2024-09-21T03:19:12.118878+0000","last_became_peered":"2024-09-21T03:19:12.118878+0000","last_unstale":"2024-09-21T03:19:13.104778+0000","last_undegraded":"2024-09-21T03:19:13.104778+0000","last_fullsized":"2024-09-21T03:19:13.104778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:01.214721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381935+0000","last_change":"2024-09-21T03:19:11.115198+0000","last_active":"2024-09-21T03:19:13.381935+0000","last_peered":"2024-09-21T03:19:13.381935+0000","last_clean":"2024-09-21T03:19:13.381935+0000","last_became_active":"2024-09-21T03:19:11.114861+0000","last_became_peered":"2024-09-21T03:19:11.114861+0000","last_unstale":"2024-09-21T03:19:13.381935+0000","last_undegraded":"2024-09-21T03:19:13.381935+0000","last_fullsized":"2024-09-21T03:19:13.381935+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:10:24.624728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102385+0000","last_change":"2024-09-21T03:19:12.118074+0000","last_active":"2024-09-21T03:19:13.102385+0000","last_peered":"2024-09-21T03:19:13.102385+0000","last_clean":"2024-09-21T03:19:13.102385+0000","last_became_active":"2024-09-21T03:19:12.117752+0000","last_became_peered":"2024-09-21T03:19:12.117752+0000","last_unstale":"2024-09-21T03:19:13.102385+0000","last_undegraded":"2024-09-21T03:19:13.102385+0000","last_fullsized":"2024-09-21T03:19:13.102385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:00.596447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.103718+0000","last_change":"2024-09-21T03:19:11.109722+0000","last_active":"2024-09-21T03:19:13.103718+0000","last_peered":"2024-09-21T03:19:13.103718+0000","last_clean":"2024-09-21T03:19:13.103718+0000","last_became_active":"2024-09-21T03:19:11.109400+0000","last_became_peered":"2024-09-21T03:19:11.109400+0000","last_unstale":"2024-09-21T03:19:13.103718+0000","last_undegraded":"2024-09-21T03:19:13.103718+0000","last_fullsized":"2024-09-21T03:19:13.103718+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:23:30.198368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":132,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102882+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:19:13.102882+0000","last_peered":"2024-09-21T03:19:13.102882+0000","last_clean":"2024-09-21T03:19:13.102882+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:19:13.102882+0000","last_undegraded":"2024-09-21T03:19:13.102882+0000","last_fullsized":"2024-09-21T03:19:13.102882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509456,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":962560,"data_stored":728585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":385024,"data_stored":145043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":372736,"data_stored":138799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":385024,"data_stored":144531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":139761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":368640,"data_stored":138197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":393216,"data_stored":146061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":933888,"data_stored":715453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:19:16.127 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:19:16.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.272+0000 7ff4d2533640 1 -- 172.21.15.105:0/2277623093 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4cc075170 msgr2=0x7ff4cc0b51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:16.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.272+0000 7ff4d2533640 1 --2- 172.21.15.105:0/2277623093 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4cc075170 0x7ff4cc0b51d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc005fd0 tx=0x7ff4bc02a540 comp rx=0 tx=0).stop 2024-09-21T03:19:16.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.272+0000 7ff4d2533640 1 -- 172.21.15.105:0/2277623093 shutdown_connections 2024-09-21T03:19:16.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.272+0000 7ff4d2533640 1 --2- 172.21.15.105:0/2277623093 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4cc075170 0x7ff4cc0b51d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:16.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.272+0000 7ff4d2533640 1 -- 172.21.15.105:0/2277623093 >> 172.21.15.105:0/2277623093 conn(0x7ff4cc0cdcc0 msgr2=0x7ff4cc0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:16.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.273+0000 7ff4d2533640 1 -- 172.21.15.105:0/2277623093 shutdown_connections 2024-09-21T03:19:16.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.273+0000 7ff4d2533640 1 -- 172.21.15.105:0/2277623093 wait complete. 2024-09-21T03:19:16.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.274+0000 7ff4d2533640 1 Processor -- start 2024-09-21T03:19:16.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.274+0000 7ff4d2533640 1 -- start start 2024-09-21T03:19:16.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.276+0000 7ff4d2533640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4cc070af0 0x7ff4cc0bd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:16.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.276+0000 7ff4d2533640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4cc0b5710 0x7ff4cc14e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:16.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.276+0000 7ff4d2533640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4cc155be0 0x7ff4cc155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:16.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.276+0000 7ff4d2533640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff4cc167dc0 con 0x7ff4cc155be0 2024-09-21T03:19:16.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.276+0000 7ff4d2533640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff4cc0719c0 con 0x7ff4cc070af0 2024-09-21T03:19:16.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.276+0000 7ff4d2533640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff4cc167f40 con 0x7ff4cc0b5710 2024-09-21T03:19:16.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.276+0000 7ff4d0ad0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4cc155be0 0x7ff4cc155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:16.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.276+0000 7ff4d0ad0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4cc155be0 0x7ff4cc155ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51268/0 (socket says 172.21.15.105:51268) 2024-09-21T03:19:16.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.276+0000 7ff4d0ad0640 1 -- 172.21.15.105:0/3106632781 learned_addr learned my addr 172.21.15.105:0/3106632781 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:16.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.276+0000 7ff4cbfff640 1 --2- 172.21.15.105:0/3106632781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4cc070af0 0x7ff4cc0bd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:16.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.276+0000 7ff4cb7fe640 1 --2- 172.21.15.105:0/3106632781 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4cc0b5710 0x7ff4cc14e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:16.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.276+0000 7ff4d0ad0640 1 -- 172.21.15.105:0/3106632781 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4cc0b5710 msgr2=0x7ff4cc14e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:16.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.276+0000 7ff4d0ad0640 1 --2- 172.21.15.105:0/3106632781 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4cc0b5710 0x7ff4cc14e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:16.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.276+0000 7ff4d0ad0640 1 -- 172.21.15.105:0/3106632781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4cc070af0 msgr2=0x7ff4cc0bd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:16.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.276+0000 7ff4d0ad0640 1 --2- 172.21.15.105:0/3106632781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4cc070af0 0x7ff4cc0bd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:16.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.276+0000 7ff4d0ad0640 1 -- 172.21.15.105:0/3106632781 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4cc156530 con 0x7ff4cc155be0 2024-09-21T03:19:16.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.276+0000 7ff4cb7fe640 1 --2- 172.21.15.105:0/3106632781 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4cc0b5710 0x7ff4cc14e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:19:16.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.276+0000 7ff4d0ad0640 1 --2- 172.21.15.105:0/3106632781 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4cc155be0 0x7ff4cc155ff0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff4c400ba10 tx=0x7ff4c400bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:16.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.276+0000 7ff4c8ff9640 1 -- 172.21.15.105:0/3106632781 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c4019070 con 0x7ff4cc155be0 2024-09-21T03:19:16.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.276+0000 7ff4c8ff9640 1 -- 172.21.15.105:0/3106632781 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4c400cc30 con 0x7ff4cc155be0 2024-09-21T03:19:16.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.276+0000 7ff4d2533640 1 -- 172.21.15.105:0/3106632781 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4cc14c210 con 0x7ff4cc155be0 2024-09-21T03:19:16.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.276+0000 7ff4c8ff9640 1 -- 172.21.15.105:0/3106632781 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c400ce60 con 0x7ff4cc155be0 2024-09-21T03:19:16.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.276+0000 7ff4d2533640 1 -- 172.21.15.105:0/3106632781 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4cc1f6bf0 con 0x7ff4cc155be0 2024-09-21T03:19:16.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.277+0000 7ff4d2533640 1 -- 172.21.15.105:0/3106632781 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4cc075170 con 0x7ff4cc155be0 2024-09-21T03:19:16.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.278+0000 7ff4c8ff9640 1 -- 172.21.15.105:0/3106632781 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff4c401c070 con 0x7ff4cc155be0 2024-09-21T03:19:16.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.278+0000 7ff4c8ff9640 1 --2- 172.21.15.105:0/3106632781 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff4ac078bc0 0x7ff4ac07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:16.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.279+0000 7ff4c8ff9640 1 -- 172.21.15.105:0/3106632781 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7ff4c409a760 con 0x7ff4cc155be0 2024-09-21T03:19:16.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.279+0000 7ff4cbfff640 1 --2- 172.21.15.105:0/3106632781 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff4ac078bc0 0x7ff4ac07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:16.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.279+0000 7ff4cbfff640 1 --2- 172.21.15.105:0/3106632781 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff4ac078bc0 0x7ff4ac07b0d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc033000 tx=0x7ff4bc004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:16.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.283+0000 7ff4c8ff9640 1 -- 172.21.15.105:0/3106632781 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff4cc156530 con 0x7ff4cc155be0 2024-09-21T03:19:16.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.457+0000 7ff4d2533640 1 -- 172.21.15.105:0/3106632781 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff4cc069230 con 0x7ff4ac078bc0 2024-09-21T03:19:16.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.463+0000 7ff4c8ff9640 1 -- 172.21.15.105:0/3106632781 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251611 (secure 0 0 0) 0x7ff4cc069230 con 0x7ff4ac078bc0 2024-09-21T03:19:16.468 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:19:16.469 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:19:16.471 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.466+0000 7ff4d2533640 1 -- 172.21.15.105:0/3106632781 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff4ac078bc0 msgr2=0x7ff4ac07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:16.471 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.466+0000 7ff4d2533640 1 --2- 172.21.15.105:0/3106632781 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff4ac078bc0 0x7ff4ac07b0d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc033000 tx=0x7ff4bc004730 comp rx=0 tx=0).stop 2024-09-21T03:19:16.471 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.466+0000 7ff4d2533640 1 -- 172.21.15.105:0/3106632781 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4cc155be0 msgr2=0x7ff4cc155ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:16.471 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.466+0000 7ff4d2533640 1 --2- 172.21.15.105:0/3106632781 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4cc155be0 0x7ff4cc155ff0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff4c400ba10 tx=0x7ff4c400bed0 comp rx=0 tx=0).stop 2024-09-21T03:19:16.471 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.466+0000 7ff4d2533640 1 -- 172.21.15.105:0/3106632781 shutdown_connections 2024-09-21T03:19:16.471 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.466+0000 7ff4d2533640 1 --2- 172.21.15.105:0/3106632781 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff4ac078bc0 0x7ff4ac07b0d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:16.471 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.466+0000 7ff4d2533640 1 --2- 172.21.15.105:0/3106632781 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4cc155be0 0x7ff4cc155ff0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:16.471 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.466+0000 7ff4d2533640 1 --2- 172.21.15.105:0/3106632781 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4cc0b5710 0x7ff4cc14e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:16.471 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.466+0000 7ff4d2533640 1 --2- 172.21.15.105:0/3106632781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4cc070af0 0x7ff4cc0bd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:16.472 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.466+0000 7ff4d2533640 1 -- 172.21.15.105:0/3106632781 >> 172.21.15.105:0/3106632781 conn(0x7ff4cc0cdcc0 msgr2=0x7ff4cc0b3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:16.472 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.466+0000 7ff4d2533640 1 -- 172.21.15.105:0/3106632781 shutdown_connections 2024-09-21T03:19:16.472 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.466+0000 7ff4d2533640 1 -- 172.21.15.105:0/3106632781 wait complete. 2024-09-21T03:19:16.480 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-09-21T03:19:15.289777+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":144,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":107,"ondisk_log_size":107,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":147,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220340,"kb_used_data":4084,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754380,"statfs":{"total":773094113280,"available":772868485120,"internally_reserved":0,"allocated":4182016,"data_stored":2296430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.200803"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104116+0000","last_change":"2024-09-21T03:19:12.125859+0000","last_active":"2024-09-21T03:19:13.104116+0000","last_peered":"2024-09-21T03:19:13.104116+0000","last_clean":"2024-09-21T03:19:13.104116+0000","last_became_active":"2024-09-21T03:19:12.125455+0000","last_became_peered":"2024-09-21T03:19:12.125455+0000","last_unstale":"2024-09-21T03:19:13.104116+0000","last_undegraded":"2024-09-21T03:19:13.104116+0000","last_fullsized":"2024-09-21T03:19:13.104116+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:34.607404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382017+0000","last_change":"2024-09-21T03:19:12.109132+0000","last_active":"2024-09-21T03:19:13.382017+0000","last_peered":"2024-09-21T03:19:13.382017+0000","last_clean":"2024-09-21T03:19:13.382017+0000","last_became_active":"2024-09-21T03:19:12.108829+0000","last_became_peered":"2024-09-21T03:19:12.108829+0000","last_unstale":"2024-09-21T03:19:13.382017+0000","last_undegraded":"2024-09-21T03:19:13.382017+0000","last_fullsized":"2024-09-21T03:19:13.382017+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:00.596447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382502+0000","last_change":"2024-09-21T03:19:12.131941+0000","last_active":"2024-09-21T03:19:13.382502+0000","last_peered":"2024-09-21T03:19:13.382502+0000","last_clean":"2024-09-21T03:19:13.382502+0000","last_became_active":"2024-09-21T03:19:12.131458+0000","last_became_peered":"2024-09-21T03:19:12.131458+0000","last_unstale":"2024-09-21T03:19:13.382502+0000","last_undegraded":"2024-09-21T03:19:13.382502+0000","last_fullsized":"2024-09-21T03:19:13.382502+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:09:21.244381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.121028+0000","last_change":"2024-09-21T03:19:12.122867+0000","last_active":"2024-09-21T03:19:13.121028+0000","last_peered":"2024-09-21T03:19:13.121028+0000","last_clean":"2024-09-21T03:19:13.121028+0000","last_became_active":"2024-09-21T03:19:12.122533+0000","last_became_peered":"2024-09-21T03:19:12.122533+0000","last_unstale":"2024-09-21T03:19:13.121028+0000","last_undegraded":"2024-09-21T03:19:13.121028+0000","last_fullsized":"2024-09-21T03:19:13.121028+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:59.601871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382009+0000","last_change":"2024-09-21T03:19:12.111226+0000","last_active":"2024-09-21T03:19:13.382009+0000","last_peered":"2024-09-21T03:19:13.382009+0000","last_clean":"2024-09-21T03:19:13.382009+0000","last_became_active":"2024-09-21T03:19:12.110915+0000","last_became_peered":"2024-09-21T03:19:12.110915+0000","last_unstale":"2024-09-21T03:19:13.382009+0000","last_undegraded":"2024-09-21T03:19:13.382009+0000","last_fullsized":"2024-09-21T03:19:13.382009+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:52:42.610167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382578+0000","last_change":"2024-09-21T03:19:12.121447+0000","last_active":"2024-09-21T03:19:13.382578+0000","last_peered":"2024-09-21T03:19:13.382578+0000","last_clean":"2024-09-21T03:19:13.382578+0000","last_became_active":"2024-09-21T03:19:12.121157+0000","last_became_peered":"2024-09-21T03:19:12.121157+0000","last_unstale":"2024-09-21T03:19:13.382578+0000","last_undegraded":"2024-09-21T03:19:13.382578+0000","last_fullsized":"2024-09-21T03:19:13.382578+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:09.757925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102313+0000","last_change":"2024-09-21T03:19:12.115833+0000","last_active":"2024-09-21T03:19:13.102313+0000","last_peered":"2024-09-21T03:19:13.102313+0000","last_clean":"2024-09-21T03:19:13.102313+0000","last_became_active":"2024-09-21T03:19:12.115528+0000","last_became_peered":"2024-09-21T03:19:12.115528+0000","last_unstale":"2024-09-21T03:19:13.102313+0000","last_undegraded":"2024-09-21T03:19:13.102313+0000","last_fullsized":"2024-09-21T03:19:13.102313+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:27.762838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102363+0000","last_change":"2024-09-21T03:19:12.116051+0000","last_active":"2024-09-21T03:19:13.102363+0000","last_peered":"2024-09-21T03:19:13.102363+0000","last_clean":"2024-09-21T03:19:13.102363+0000","last_became_active":"2024-09-21T03:19:12.115701+0000","last_became_peered":"2024-09-21T03:19:12.115701+0000","last_unstale":"2024-09-21T03:19:13.102363+0000","last_undegraded":"2024-09-21T03:19:13.102363+0000","last_fullsized":"2024-09-21T03:19:13.102363+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:07:30.596468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104945+0000","last_change":"2024-09-21T03:19:12.119289+0000","last_active":"2024-09-21T03:19:13.104945+0000","last_peered":"2024-09-21T03:19:13.104945+0000","last_clean":"2024-09-21T03:19:13.104945+0000","last_became_active":"2024-09-21T03:19:12.118634+0000","last_became_peered":"2024-09-21T03:19:12.118634+0000","last_unstale":"2024-09-21T03:19:13.104945+0000","last_undegraded":"2024-09-21T03:19:13.104945+0000","last_fullsized":"2024-09-21T03:19:13.104945+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:23.665081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.121392+0000","last_change":"2024-09-21T03:19:12.116146+0000","last_active":"2024-09-21T03:19:13.121392+0000","last_peered":"2024-09-21T03:19:13.121392+0000","last_clean":"2024-09-21T03:19:13.121392+0000","last_became_active":"2024-09-21T03:19:12.115742+0000","last_became_peered":"2024-09-21T03:19:12.115742+0000","last_unstale":"2024-09-21T03:19:13.121392+0000","last_undegraded":"2024-09-21T03:19:13.121392+0000","last_fullsized":"2024-09-21T03:19:13.121392+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:58.031199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102384+0000","last_change":"2024-09-21T03:19:12.118702+0000","last_active":"2024-09-21T03:19:13.102384+0000","last_peered":"2024-09-21T03:19:13.102384+0000","last_clean":"2024-09-21T03:19:13.102384+0000","last_became_active":"2024-09-21T03:19:12.118391+0000","last_became_peered":"2024-09-21T03:19:12.118391+0000","last_unstale":"2024-09-21T03:19:13.102384+0000","last_undegraded":"2024-09-21T03:19:13.102384+0000","last_fullsized":"2024-09-21T03:19:13.102384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:57.800009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382162+0000","last_change":"2024-09-21T03:19:12.127366+0000","last_active":"2024-09-21T03:19:13.382162+0000","last_peered":"2024-09-21T03:19:13.382162+0000","last_clean":"2024-09-21T03:19:13.382162+0000","last_became_active":"2024-09-21T03:19:12.127036+0000","last_became_peered":"2024-09-21T03:19:12.127036+0000","last_unstale":"2024-09-21T03:19:13.382162+0000","last_undegraded":"2024-09-21T03:19:13.382162+0000","last_fullsized":"2024-09-21T03:19:13.382162+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:49.317940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382211+0000","last_change":"2024-09-21T03:19:12.108265+0000","last_active":"2024-09-21T03:19:13.382211+0000","last_peered":"2024-09-21T03:19:13.382211+0000","last_clean":"2024-09-21T03:19:13.382211+0000","last_became_active":"2024-09-21T03:19:12.107908+0000","last_became_peered":"2024-09-21T03:19:12.107908+0000","last_unstale":"2024-09-21T03:19:13.382211+0000","last_undegraded":"2024-09-21T03:19:13.382211+0000","last_fullsized":"2024-09-21T03:19:13.382211+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:02.577948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382498+0000","last_change":"2024-09-21T03:19:12.110175+0000","last_active":"2024-09-21T03:19:13.382498+0000","last_peered":"2024-09-21T03:19:13.382498+0000","last_clean":"2024-09-21T03:19:13.382498+0000","last_became_active":"2024-09-21T03:19:12.109849+0000","last_became_peered":"2024-09-21T03:19:12.109849+0000","last_unstale":"2024-09-21T03:19:13.382498+0000","last_undegraded":"2024-09-21T03:19:13.382498+0000","last_fullsized":"2024-09-21T03:19:13.382498+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:34.525061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382239+0000","last_change":"2024-09-21T03:19:12.128786+0000","last_active":"2024-09-21T03:19:13.382239+0000","last_peered":"2024-09-21T03:19:13.382239+0000","last_clean":"2024-09-21T03:19:13.382239+0000","last_became_active":"2024-09-21T03:19:12.128433+0000","last_became_peered":"2024-09-21T03:19:12.128433+0000","last_unstale":"2024-09-21T03:19:13.382239+0000","last_undegraded":"2024-09-21T03:19:13.382239+0000","last_fullsized":"2024-09-21T03:19:13.382239+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:57.800009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.103044+0000","last_change":"2024-09-21T03:19:12.114204+0000","last_active":"2024-09-21T03:19:13.103044+0000","last_peered":"2024-09-21T03:19:13.103044+0000","last_clean":"2024-09-21T03:19:13.103044+0000","last_became_active":"2024-09-21T03:19:12.113864+0000","last_became_peered":"2024-09-21T03:19:12.113864+0000","last_unstale":"2024-09-21T03:19:13.103044+0000","last_undegraded":"2024-09-21T03:19:13.103044+0000","last_fullsized":"2024-09-21T03:19:13.103044+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:06.048604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102949+0000","last_change":"2024-09-21T03:19:12.123129+0000","last_active":"2024-09-21T03:19:13.102949+0000","last_peered":"2024-09-21T03:19:13.102949+0000","last_clean":"2024-09-21T03:19:13.102949+0000","last_became_active":"2024-09-21T03:19:12.122781+0000","last_became_peered":"2024-09-21T03:19:12.122781+0000","last_unstale":"2024-09-21T03:19:13.102949+0000","last_undegraded":"2024-09-21T03:19:13.102949+0000","last_fullsized":"2024-09-21T03:19:13.102949+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:48.519582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382143+0000","last_change":"2024-09-21T03:19:12.118599+0000","last_active":"2024-09-21T03:19:13.382143+0000","last_peered":"2024-09-21T03:19:13.382143+0000","last_clean":"2024-09-21T03:19:13.382143+0000","last_became_active":"2024-09-21T03:19:12.118319+0000","last_became_peered":"2024-09-21T03:19:12.118319+0000","last_unstale":"2024-09-21T03:19:13.382143+0000","last_undegraded":"2024-09-21T03:19:13.382143+0000","last_fullsized":"2024-09-21T03:19:13.382143+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:58.905425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381899+0000","last_change":"2024-09-21T03:19:12.121041+0000","last_active":"2024-09-21T03:19:13.381899+0000","last_peered":"2024-09-21T03:19:13.381899+0000","last_clean":"2024-09-21T03:19:13.381899+0000","last_became_active":"2024-09-21T03:19:12.119726+0000","last_became_peered":"2024-09-21T03:19:12.119726+0000","last_unstale":"2024-09-21T03:19:13.381899+0000","last_undegraded":"2024-09-21T03:19:13.381899+0000","last_fullsized":"2024-09-21T03:19:13.381899+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:45:41.300137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381977+0000","last_change":"2024-09-21T03:19:12.120864+0000","last_active":"2024-09-21T03:19:13.381977+0000","last_peered":"2024-09-21T03:19:13.381977+0000","last_clean":"2024-09-21T03:19:13.381977+0000","last_became_active":"2024-09-21T03:19:12.120558+0000","last_became_peered":"2024-09-21T03:19:12.120558+0000","last_unstale":"2024-09-21T03:19:13.381977+0000","last_undegraded":"2024-09-21T03:19:13.381977+0000","last_fullsized":"2024-09-21T03:19:13.381977+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:36.934721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104275+0000","last_change":"2024-09-21T03:19:12.119909+0000","last_active":"2024-09-21T03:19:13.104275+0000","last_peered":"2024-09-21T03:19:13.104275+0000","last_clean":"2024-09-21T03:19:13.104275+0000","last_became_active":"2024-09-21T03:19:12.119529+0000","last_became_peered":"2024-09-21T03:19:12.119529+0000","last_unstale":"2024-09-21T03:19:13.104275+0000","last_undegraded":"2024-09-21T03:19:13.104275+0000","last_fullsized":"2024-09-21T03:19:13.104275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:38.291868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104702+0000","last_change":"2024-09-21T03:19:12.119190+0000","last_active":"2024-09-21T03:19:13.104702+0000","last_peered":"2024-09-21T03:19:13.104702+0000","last_clean":"2024-09-21T03:19:13.104702+0000","last_became_active":"2024-09-21T03:19:12.118617+0000","last_became_peered":"2024-09-21T03:19:12.118617+0000","last_unstale":"2024-09-21T03:19:13.104702+0000","last_undegraded":"2024-09-21T03:19:13.104702+0000","last_fullsized":"2024-09-21T03:19:13.104702+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:38.040137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-21T03:19:11.107024+0000","last_change":"2024-09-21T03:19:11.107024+0000","last_active":"2024-09-21T03:19:11.088347+0000","last_peered":"2024-09-21T03:19:11.088347+0000","last_clean":"2024-09-21T03:19:11.088347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:19:11.107024+0000","last_undegraded":"2024-09-21T03:19:11.107024+0000","last_fullsized":"2024-09-21T03:19:11.107024+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382111+0000","last_change":"2024-09-21T03:19:12.123887+0000","last_active":"2024-09-21T03:19:13.382111+0000","last_peered":"2024-09-21T03:19:13.382111+0000","last_clean":"2024-09-21T03:19:13.382111+0000","last_became_active":"2024-09-21T03:19:12.123560+0000","last_became_peered":"2024-09-21T03:19:12.123560+0000","last_unstale":"2024-09-21T03:19:13.382111+0000","last_undegraded":"2024-09-21T03:19:13.382111+0000","last_fullsized":"2024-09-21T03:19:13.382111+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:27.762838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.121436+0000","last_change":"2024-09-21T03:19:12.116939+0000","last_active":"2024-09-21T03:19:13.121436+0000","last_peered":"2024-09-21T03:19:13.121436+0000","last_clean":"2024-09-21T03:19:13.121436+0000","last_became_active":"2024-09-21T03:19:12.116637+0000","last_became_peered":"2024-09-21T03:19:12.116637+0000","last_unstale":"2024-09-21T03:19:13.121436+0000","last_undegraded":"2024-09-21T03:19:13.121436+0000","last_fullsized":"2024-09-21T03:19:13.121436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:01.049780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382264+0000","last_change":"2024-09-21T03:19:12.117324+0000","last_active":"2024-09-21T03:19:13.382264+0000","last_peered":"2024-09-21T03:19:13.382264+0000","last_clean":"2024-09-21T03:19:13.382264+0000","last_became_active":"2024-09-21T03:19:12.117003+0000","last_became_peered":"2024-09-21T03:19:12.117003+0000","last_unstale":"2024-09-21T03:19:13.382264+0000","last_undegraded":"2024-09-21T03:19:13.382264+0000","last_fullsized":"2024-09-21T03:19:13.382264+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:58.393209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.121300+0000","last_change":"2024-09-21T03:19:12.121597+0000","last_active":"2024-09-21T03:19:13.121300+0000","last_peered":"2024-09-21T03:19:13.121300+0000","last_clean":"2024-09-21T03:19:13.121300+0000","last_became_active":"2024-09-21T03:19:12.121311+0000","last_became_peered":"2024-09-21T03:19:12.121311+0000","last_unstale":"2024-09-21T03:19:13.121300+0000","last_undegraded":"2024-09-21T03:19:13.121300+0000","last_fullsized":"2024-09-21T03:19:13.121300+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:59.556293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382433+0000","last_change":"2024-09-21T03:19:12.121332+0000","last_active":"2024-09-21T03:19:13.382433+0000","last_peered":"2024-09-21T03:19:13.382433+0000","last_clean":"2024-09-21T03:19:13.382433+0000","last_became_active":"2024-09-21T03:19:12.120078+0000","last_became_peered":"2024-09-21T03:19:12.120078+0000","last_unstale":"2024-09-21T03:19:13.382433+0000","last_undegraded":"2024-09-21T03:19:13.382433+0000","last_fullsized":"2024-09-21T03:19:13.382433+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:18:47.580493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104544+0000","last_change":"2024-09-21T03:19:12.124510+0000","last_active":"2024-09-21T03:19:13.104544+0000","last_peered":"2024-09-21T03:19:13.104544+0000","last_clean":"2024-09-21T03:19:13.104544+0000","last_became_active":"2024-09-21T03:19:12.124166+0000","last_became_peered":"2024-09-21T03:19:12.124166+0000","last_unstale":"2024-09-21T03:19:13.104544+0000","last_undegraded":"2024-09-21T03:19:13.104544+0000","last_fullsized":"2024-09-21T03:19:13.104544+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:03:09.576885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102626+0000","last_change":"2024-09-21T03:19:12.125359+0000","last_active":"2024-09-21T03:19:13.102626+0000","last_peered":"2024-09-21T03:19:13.102626+0000","last_clean":"2024-09-21T03:19:13.102626+0000","last_became_active":"2024-09-21T03:19:12.125040+0000","last_became_peered":"2024-09-21T03:19:12.125040+0000","last_unstale":"2024-09-21T03:19:13.102626+0000","last_undegraded":"2024-09-21T03:19:13.102626+0000","last_fullsized":"2024-09-21T03:19:13.102626+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:18:47.580493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.103621+0000","last_change":"2024-09-21T03:19:12.113525+0000","last_active":"2024-09-21T03:19:13.103621+0000","last_peered":"2024-09-21T03:19:13.103621+0000","last_clean":"2024-09-21T03:19:13.103621+0000","last_became_active":"2024-09-21T03:19:12.113179+0000","last_became_peered":"2024-09-21T03:19:12.113179+0000","last_unstale":"2024-09-21T03:19:13.103621+0000","last_undegraded":"2024-09-21T03:19:13.103621+0000","last_fullsized":"2024-09-21T03:19:13.103621+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:25.092143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102677+0000","last_change":"2024-09-21T03:19:12.124045+0000","last_active":"2024-09-21T03:19:13.102677+0000","last_peered":"2024-09-21T03:19:13.102677+0000","last_clean":"2024-09-21T03:19:13.102677+0000","last_became_active":"2024-09-21T03:19:12.123675+0000","last_became_peered":"2024-09-21T03:19:12.123675+0000","last_unstale":"2024-09-21T03:19:13.102677+0000","last_undegraded":"2024-09-21T03:19:13.102677+0000","last_fullsized":"2024-09-21T03:19:13.102677+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:47:14.609891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-21T03:19:11.108357+0000","last_change":"2024-09-21T03:19:11.108357+0000","last_active":"2024-09-21T03:19:11.088347+0000","last_peered":"2024-09-21T03:19:11.088347+0000","last_clean":"2024-09-21T03:19:11.088347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:19:11.108357+0000","last_undegraded":"2024-09-21T03:19:11.108357+0000","last_fullsized":"2024-09-21T03:19:11.108357+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104252+0000","last_change":"2024-09-21T03:19:11.114158+0000","last_active":"2024-09-21T03:19:13.104252+0000","last_peered":"2024-09-21T03:19:13.104252+0000","last_clean":"2024-09-21T03:19:13.104252+0000","last_became_active":"2024-09-21T03:19:11.113815+0000","last_became_peered":"2024-09-21T03:19:11.113815+0000","last_unstale":"2024-09-21T03:19:13.104252+0000","last_undegraded":"2024-09-21T03:19:13.104252+0000","last_fullsized":"2024-09-21T03:19:13.104252+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:55:44.185439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104156+0000","last_change":"2024-09-21T03:19:12.121035+0000","last_active":"2024-09-21T03:19:13.104156+0000","last_peered":"2024-09-21T03:19:13.104156+0000","last_clean":"2024-09-21T03:19:13.104156+0000","last_became_active":"2024-09-21T03:19:12.120664+0000","last_became_peered":"2024-09-21T03:19:12.120664+0000","last_unstale":"2024-09-21T03:19:13.104156+0000","last_undegraded":"2024-09-21T03:19:13.104156+0000","last_fullsized":"2024-09-21T03:19:13.104156+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:41.193668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T03:19:11.120114+0000","last_change":"2024-09-21T03:19:11.118983+0000","last_active":"2024-09-21T03:19:11.120114+0000","last_peered":"2024-09-21T03:19:11.120114+0000","last_clean":"2024-09-21T03:19:11.120114+0000","last_became_active":"2024-09-21T03:19:11.118703+0000","last_became_peered":"2024-09-21T03:19:11.118703+0000","last_unstale":"2024-09-21T03:19:11.120114+0000","last_undegraded":"2024-09-21T03:19:11.120114+0000","last_fullsized":"2024-09-21T03:19:11.120114+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:16.597589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104999+0000","last_change":"2024-09-21T03:19:12.121175+0000","last_active":"2024-09-21T03:19:13.104999+0000","last_peered":"2024-09-21T03:19:13.104999+0000","last_clean":"2024-09-21T03:19:13.104999+0000","last_became_active":"2024-09-21T03:19:12.120612+0000","last_became_peered":"2024-09-21T03:19:12.120612+0000","last_unstale":"2024-09-21T03:19:13.104999+0000","last_undegraded":"2024-09-21T03:19:13.104999+0000","last_fullsized":"2024-09-21T03:19:13.104999+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:42.611910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381723+0000","last_change":"2024-09-21T03:19:11.108839+0000","last_active":"2024-09-21T03:19:13.381723+0000","last_peered":"2024-09-21T03:19:13.381723+0000","last_clean":"2024-09-21T03:19:13.381723+0000","last_became_active":"2024-09-21T03:19:11.108247+0000","last_became_peered":"2024-09-21T03:19:11.108247+0000","last_unstale":"2024-09-21T03:19:13.381723+0000","last_undegraded":"2024-09-21T03:19:13.381723+0000","last_fullsized":"2024-09-21T03:19:13.381723+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:23.619672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.121337+0000","last_change":"2024-09-21T03:19:12.120865+0000","last_active":"2024-09-21T03:19:13.121337+0000","last_peered":"2024-09-21T03:19:13.121337+0000","last_clean":"2024-09-21T03:19:13.121337+0000","last_became_active":"2024-09-21T03:19:12.120573+0000","last_became_peered":"2024-09-21T03:19:12.120573+0000","last_unstale":"2024-09-21T03:19:13.121337+0000","last_undegraded":"2024-09-21T03:19:13.121337+0000","last_fullsized":"2024-09-21T03:19:13.121337+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:40.773712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382105+0000","last_change":"2024-09-21T03:19:11.112313+0000","last_active":"2024-09-21T03:19:13.382105+0000","last_peered":"2024-09-21T03:19:13.382105+0000","last_clean":"2024-09-21T03:19:13.382105+0000","last_became_active":"2024-09-21T03:19:11.110122+0000","last_became_peered":"2024-09-21T03:19:11.110122+0000","last_unstale":"2024-09-21T03:19:13.382105+0000","last_undegraded":"2024-09-21T03:19:13.382105+0000","last_fullsized":"2024-09-21T03:19:13.382105+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:43.796244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102942+0000","last_change":"2024-09-21T03:19:12.123179+0000","last_active":"2024-09-21T03:19:13.102942+0000","last_peered":"2024-09-21T03:19:13.102942+0000","last_clean":"2024-09-21T03:19:13.102942+0000","last_became_active":"2024-09-21T03:19:12.122875+0000","last_became_peered":"2024-09-21T03:19:12.122875+0000","last_unstale":"2024-09-21T03:19:13.102942+0000","last_undegraded":"2024-09-21T03:19:13.102942+0000","last_fullsized":"2024-09-21T03:19:13.102942+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:34.525061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104724+0000","last_change":"2024-09-21T03:19:11.117022+0000","last_active":"2024-09-21T03:19:13.104724+0000","last_peered":"2024-09-21T03:19:13.104724+0000","last_clean":"2024-09-21T03:19:13.104724+0000","last_became_active":"2024-09-21T03:19:11.116690+0000","last_became_peered":"2024-09-21T03:19:11.116690+0000","last_unstale":"2024-09-21T03:19:13.104724+0000","last_undegraded":"2024-09-21T03:19:13.104724+0000","last_fullsized":"2024-09-21T03:19:13.104724+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:51.255559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382486+0000","last_change":"2024-09-21T03:19:12.119159+0000","last_active":"2024-09-21T03:19:13.382486+0000","last_peered":"2024-09-21T03:19:13.382486+0000","last_clean":"2024-09-21T03:19:13.382486+0000","last_became_active":"2024-09-21T03:19:12.118808+0000","last_became_peered":"2024-09-21T03:19:12.118808+0000","last_unstale":"2024-09-21T03:19:13.382486+0000","last_undegraded":"2024-09-21T03:19:13.382486+0000","last_fullsized":"2024-09-21T03:19:13.382486+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:48.519582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104682+0000","last_change":"2024-09-21T03:19:11.116558+0000","last_active":"2024-09-21T03:19:13.104682+0000","last_peered":"2024-09-21T03:19:13.104682+0000","last_clean":"2024-09-21T03:19:13.104682+0000","last_became_active":"2024-09-21T03:19:11.116169+0000","last_became_peered":"2024-09-21T03:19:11.116169+0000","last_unstale":"2024-09-21T03:19:13.104682+0000","last_undegraded":"2024-09-21T03:19:13.104682+0000","last_fullsized":"2024-09-21T03:19:13.104682+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:23:00.100615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104262+0000","last_change":"2024-09-21T03:19:12.115624+0000","last_active":"2024-09-21T03:19:13.104262+0000","last_peered":"2024-09-21T03:19:13.104262+0000","last_clean":"2024-09-21T03:19:13.104262+0000","last_became_active":"2024-09-21T03:19:12.115275+0000","last_became_peered":"2024-09-21T03:19:12.115275+0000","last_unstale":"2024-09-21T03:19:13.104262+0000","last_undegraded":"2024-09-21T03:19:13.104262+0000","last_fullsized":"2024-09-21T03:19:13.104262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:41.193668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381827+0000","last_change":"2024-09-21T03:19:11.103165+0000","last_active":"2024-09-21T03:19:13.381827+0000","last_peered":"2024-09-21T03:19:13.381827+0000","last_clean":"2024-09-21T03:19:13.381827+0000","last_became_active":"2024-09-21T03:19:11.102872+0000","last_became_peered":"2024-09-21T03:19:11.102872+0000","last_unstale":"2024-09-21T03:19:13.381827+0000","last_undegraded":"2024-09-21T03:19:13.381827+0000","last_fullsized":"2024-09-21T03:19:13.381827+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:56:43.303284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.120728+0000","last_change":"2024-09-21T03:19:12.127448+0000","last_active":"2024-09-21T03:19:13.120728+0000","last_peered":"2024-09-21T03:19:13.120728+0000","last_clean":"2024-09-21T03:19:13.120728+0000","last_became_active":"2024-09-21T03:19:12.127007+0000","last_became_peered":"2024-09-21T03:19:12.127007+0000","last_unstale":"2024-09-21T03:19:13.120728+0000","last_undegraded":"2024-09-21T03:19:13.120728+0000","last_fullsized":"2024-09-21T03:19:13.120728+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:32.175500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104894+0000","last_change":"2024-09-21T03:19:11.112403+0000","last_active":"2024-09-21T03:19:13.104894+0000","last_peered":"2024-09-21T03:19:13.104894+0000","last_clean":"2024-09-21T03:19:13.104894+0000","last_became_active":"2024-09-21T03:19:11.110380+0000","last_became_peered":"2024-09-21T03:19:11.110380+0000","last_unstale":"2024-09-21T03:19:13.104894+0000","last_undegraded":"2024-09-21T03:19:13.104894+0000","last_fullsized":"2024-09-21T03:19:13.104894+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:51.798449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382430+0000","last_change":"2024-09-21T03:19:12.120648+0000","last_active":"2024-09-21T03:19:13.382430+0000","last_peered":"2024-09-21T03:19:13.382430+0000","last_clean":"2024-09-21T03:19:13.382430+0000","last_became_active":"2024-09-21T03:19:12.119981+0000","last_became_peered":"2024-09-21T03:19:12.119981+0000","last_unstale":"2024-09-21T03:19:13.382430+0000","last_undegraded":"2024-09-21T03:19:13.382430+0000","last_fullsized":"2024-09-21T03:19:13.382430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:11:25.857215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381960+0000","last_change":"2024-09-21T03:19:11.116104+0000","last_active":"2024-09-21T03:19:13.381960+0000","last_peered":"2024-09-21T03:19:13.381960+0000","last_clean":"2024-09-21T03:19:13.381960+0000","last_became_active":"2024-09-21T03:19:11.114896+0000","last_became_peered":"2024-09-21T03:19:11.114896+0000","last_unstale":"2024-09-21T03:19:13.381960+0000","last_undegraded":"2024-09-21T03:19:13.381960+0000","last_fullsized":"2024-09-21T03:19:13.381960+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:13.276373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381838+0000","last_change":"2024-09-21T03:19:12.115277+0000","last_active":"2024-09-21T03:19:13.381838+0000","last_peered":"2024-09-21T03:19:13.381838+0000","last_clean":"2024-09-21T03:19:13.381838+0000","last_became_active":"2024-09-21T03:19:12.114969+0000","last_became_peered":"2024-09-21T03:19:12.114969+0000","last_unstale":"2024-09-21T03:19:13.381838+0000","last_undegraded":"2024-09-21T03:19:13.381838+0000","last_fullsized":"2024-09-21T03:19:13.381838+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:07:30.596468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T03:19:11.120871+0000","last_change":"2024-09-21T03:19:11.119888+0000","last_active":"2024-09-21T03:19:11.120871+0000","last_peered":"2024-09-21T03:19:11.120871+0000","last_clean":"2024-09-21T03:19:11.120871+0000","last_became_active":"2024-09-21T03:19:11.119545+0000","last_became_peered":"2024-09-21T03:19:11.119545+0000","last_unstale":"2024-09-21T03:19:11.120871+0000","last_undegraded":"2024-09-21T03:19:11.120871+0000","last_fullsized":"2024-09-21T03:19:11.120871+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:08:16.943494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382322+0000","last_change":"2024-09-21T03:19:12.114882+0000","last_active":"2024-09-21T03:19:13.382322+0000","last_peered":"2024-09-21T03:19:13.382322+0000","last_clean":"2024-09-21T03:19:13.382322+0000","last_became_active":"2024-09-21T03:19:12.114561+0000","last_became_peered":"2024-09-21T03:19:12.114561+0000","last_unstale":"2024-09-21T03:19:13.382322+0000","last_undegraded":"2024-09-21T03:19:13.382322+0000","last_fullsized":"2024-09-21T03:19:13.382322+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:08.667667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382464+0000","last_change":"2024-09-21T03:19:11.111184+0000","last_active":"2024-09-21T03:19:13.382464+0000","last_peered":"2024-09-21T03:19:13.382464+0000","last_clean":"2024-09-21T03:19:13.382464+0000","last_became_active":"2024-09-21T03:19:11.110861+0000","last_became_peered":"2024-09-21T03:19:11.110861+0000","last_unstale":"2024-09-21T03:19:13.382464+0000","last_undegraded":"2024-09-21T03:19:13.382464+0000","last_fullsized":"2024-09-21T03:19:13.382464+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:57.066419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382293+0000","last_change":"2024-09-21T03:19:12.131237+0000","last_active":"2024-09-21T03:19:13.382293+0000","last_peered":"2024-09-21T03:19:13.382293+0000","last_clean":"2024-09-21T03:19:13.382293+0000","last_became_active":"2024-09-21T03:19:12.130867+0000","last_became_peered":"2024-09-21T03:19:12.130867+0000","last_unstale":"2024-09-21T03:19:13.382293+0000","last_undegraded":"2024-09-21T03:19:13.382293+0000","last_fullsized":"2024-09-21T03:19:13.382293+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:29:39.788655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382367+0000","last_change":"2024-09-21T03:19:11.109747+0000","last_active":"2024-09-21T03:19:13.382367+0000","last_peered":"2024-09-21T03:19:13.382367+0000","last_clean":"2024-09-21T03:19:13.382367+0000","last_became_active":"2024-09-21T03:19:11.109471+0000","last_became_peered":"2024-09-21T03:19:11.109471+0000","last_unstale":"2024-09-21T03:19:13.382367+0000","last_undegraded":"2024-09-21T03:19:13.382367+0000","last_fullsized":"2024-09-21T03:19:13.382367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:11.187788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.120806+0000","last_change":"2024-09-21T03:19:12.128068+0000","last_active":"2024-09-21T03:19:13.120806+0000","last_peered":"2024-09-21T03:19:13.120806+0000","last_clean":"2024-09-21T03:19:13.120806+0000","last_became_active":"2024-09-21T03:19:12.127594+0000","last_became_peered":"2024-09-21T03:19:12.127594+0000","last_unstale":"2024-09-21T03:19:13.120806+0000","last_undegraded":"2024-09-21T03:19:13.120806+0000","last_fullsized":"2024-09-21T03:19:13.120806+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:19.756214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104891+0000","last_change":"2024-09-21T03:19:11.108994+0000","last_active":"2024-09-21T03:19:13.104891+0000","last_peered":"2024-09-21T03:19:13.104891+0000","last_clean":"2024-09-21T03:19:13.104891+0000","last_became_active":"2024-09-21T03:19:11.108092+0000","last_became_peered":"2024-09-21T03:19:11.108092+0000","last_unstale":"2024-09-21T03:19:13.104891+0000","last_undegraded":"2024-09-21T03:19:13.104891+0000","last_fullsized":"2024-09-21T03:19:13.104891+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:15.318084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382516+0000","last_change":"2024-09-21T03:19:12.111240+0000","last_active":"2024-09-21T03:19:13.382516+0000","last_peered":"2024-09-21T03:19:13.382516+0000","last_clean":"2024-09-21T03:19:13.382516+0000","last_became_active":"2024-09-21T03:19:12.110483+0000","last_became_peered":"2024-09-21T03:19:12.110483+0000","last_unstale":"2024-09-21T03:19:13.382516+0000","last_undegraded":"2024-09-21T03:19:13.382516+0000","last_fullsized":"2024-09-21T03:19:13.382516+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:43.881668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.120663+0000","last_change":"2024-09-21T03:19:11.112700+0000","last_active":"2024-09-21T03:19:13.120663+0000","last_peered":"2024-09-21T03:19:13.120663+0000","last_clean":"2024-09-21T03:19:13.120663+0000","last_became_active":"2024-09-21T03:19:11.112398+0000","last_became_peered":"2024-09-21T03:19:11.112398+0000","last_unstale":"2024-09-21T03:19:13.120663+0000","last_undegraded":"2024-09-21T03:19:13.120663+0000","last_fullsized":"2024-09-21T03:19:13.120663+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:14.899603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102654+0000","last_change":"2024-09-21T03:19:12.124045+0000","last_active":"2024-09-21T03:19:13.102654+0000","last_peered":"2024-09-21T03:19:13.102654+0000","last_clean":"2024-09-21T03:19:13.102654+0000","last_became_active":"2024-09-21T03:19:12.123703+0000","last_became_peered":"2024-09-21T03:19:12.123703+0000","last_unstale":"2024-09-21T03:19:13.102654+0000","last_undegraded":"2024-09-21T03:19:13.102654+0000","last_fullsized":"2024-09-21T03:19:13.102654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:11:25.857215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381941+0000","last_change":"2024-09-21T03:19:11.113832+0000","last_active":"2024-09-21T03:19:13.381941+0000","last_peered":"2024-09-21T03:19:13.381941+0000","last_clean":"2024-09-21T03:19:13.381941+0000","last_became_active":"2024-09-21T03:19:11.113490+0000","last_became_peered":"2024-09-21T03:19:11.113490+0000","last_unstale":"2024-09-21T03:19:13.381941+0000","last_undegraded":"2024-09-21T03:19:13.381941+0000","last_fullsized":"2024-09-21T03:19:13.381941+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:21.360860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.103679+0000","last_change":"2024-09-21T03:19:12.112692+0000","last_active":"2024-09-21T03:19:13.103679+0000","last_peered":"2024-09-21T03:19:13.103679+0000","last_clean":"2024-09-21T03:19:13.103679+0000","last_became_active":"2024-09-21T03:19:12.112358+0000","last_became_peered":"2024-09-21T03:19:12.112358+0000","last_unstale":"2024-09-21T03:19:13.103679+0000","last_undegraded":"2024-09-21T03:19:13.103679+0000","last_fullsized":"2024-09-21T03:19:13.103679+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:55.890328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381835+0000","last_change":"2024-09-21T03:19:11.113112+0000","last_active":"2024-09-21T03:19:13.381835+0000","last_peered":"2024-09-21T03:19:13.381835+0000","last_clean":"2024-09-21T03:19:13.381835+0000","last_became_active":"2024-09-21T03:19:11.112471+0000","last_became_peered":"2024-09-21T03:19:11.112471+0000","last_unstale":"2024-09-21T03:19:13.381835+0000","last_undegraded":"2024-09-21T03:19:13.381835+0000","last_fullsized":"2024-09-21T03:19:13.381835+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:14.685100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104597+0000","last_change":"2024-09-21T03:19:12.123489+0000","last_active":"2024-09-21T03:19:13.104597+0000","last_peered":"2024-09-21T03:19:13.104597+0000","last_clean":"2024-09-21T03:19:13.104597+0000","last_became_active":"2024-09-21T03:19:12.123128+0000","last_became_peered":"2024-09-21T03:19:12.123128+0000","last_unstale":"2024-09-21T03:19:13.104597+0000","last_undegraded":"2024-09-21T03:19:13.104597+0000","last_fullsized":"2024-09-21T03:19:13.104597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:58.072413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.121464+0000","last_change":"2024-09-21T03:19:11.116551+0000","last_active":"2024-09-21T03:19:13.121464+0000","last_peered":"2024-09-21T03:19:13.121464+0000","last_clean":"2024-09-21T03:19:13.121464+0000","last_became_active":"2024-09-21T03:19:11.116223+0000","last_became_peered":"2024-09-21T03:19:11.116223+0000","last_unstale":"2024-09-21T03:19:13.121464+0000","last_undegraded":"2024-09-21T03:19:13.121464+0000","last_fullsized":"2024-09-21T03:19:13.121464+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:15.318084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382586+0000","last_change":"2024-09-21T03:19:12.128395+0000","last_active":"2024-09-21T03:19:13.382586+0000","last_peered":"2024-09-21T03:19:13.382586+0000","last_clean":"2024-09-21T03:19:13.382586+0000","last_became_active":"2024-09-21T03:19:12.128076+0000","last_became_peered":"2024-09-21T03:19:12.128076+0000","last_unstale":"2024-09-21T03:19:13.382586+0000","last_undegraded":"2024-09-21T03:19:13.382586+0000","last_fullsized":"2024-09-21T03:19:13.382586+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:06.048604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104542+0000","last_change":"2024-09-21T03:19:11.111848+0000","last_active":"2024-09-21T03:19:13.104542+0000","last_peered":"2024-09-21T03:19:13.104542+0000","last_clean":"2024-09-21T03:19:13.104542+0000","last_became_active":"2024-09-21T03:19:11.111129+0000","last_became_peered":"2024-09-21T03:19:11.111129+0000","last_unstale":"2024-09-21T03:19:13.104542+0000","last_undegraded":"2024-09-21T03:19:13.104542+0000","last_fullsized":"2024-09-21T03:19:13.104542+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:39.822767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.120953+0000","last_change":"2024-09-21T03:19:12.129108+0000","last_active":"2024-09-21T03:19:13.120953+0000","last_peered":"2024-09-21T03:19:13.120953+0000","last_clean":"2024-09-21T03:19:13.120953+0000","last_became_active":"2024-09-21T03:19:12.128830+0000","last_became_peered":"2024-09-21T03:19:12.128830+0000","last_unstale":"2024-09-21T03:19:13.120953+0000","last_undegraded":"2024-09-21T03:19:13.120953+0000","last_fullsized":"2024-09-21T03:19:13.120953+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:06.450432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104733+0000","last_change":"2024-09-21T03:19:11.108248+0000","last_active":"2024-09-21T03:19:13.104733+0000","last_peered":"2024-09-21T03:19:13.104733+0000","last_clean":"2024-09-21T03:19:13.104733+0000","last_became_active":"2024-09-21T03:19:11.107839+0000","last_became_peered":"2024-09-21T03:19:11.107839+0000","last_unstale":"2024-09-21T03:19:13.104733+0000","last_undegraded":"2024-09-21T03:19:13.104733+0000","last_fullsized":"2024-09-21T03:19:13.104733+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:43.984247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381830+0000","last_change":"2024-09-21T03:19:12.106769+0000","last_active":"2024-09-21T03:19:13.381830+0000","last_peered":"2024-09-21T03:19:13.381830+0000","last_clean":"2024-09-21T03:19:13.381830+0000","last_became_active":"2024-09-21T03:19:12.106423+0000","last_became_peered":"2024-09-21T03:19:12.106423+0000","last_unstale":"2024-09-21T03:19:13.381830+0000","last_undegraded":"2024-09-21T03:19:13.381830+0000","last_fullsized":"2024-09-21T03:19:13.381830+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:46.793926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104977+0000","last_change":"2024-09-21T03:19:11.117034+0000","last_active":"2024-09-21T03:19:13.104977+0000","last_peered":"2024-09-21T03:19:13.104977+0000","last_clean":"2024-09-21T03:19:13.104977+0000","last_became_active":"2024-09-21T03:19:11.116729+0000","last_became_peered":"2024-09-21T03:19:11.116729+0000","last_unstale":"2024-09-21T03:19:13.104977+0000","last_undegraded":"2024-09-21T03:19:13.104977+0000","last_fullsized":"2024-09-21T03:19:13.104977+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:10:00.681324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381579+0000","last_change":"2024-09-21T03:19:12.119850+0000","last_active":"2024-09-21T03:19:13.381579+0000","last_peered":"2024-09-21T03:19:13.381579+0000","last_clean":"2024-09-21T03:19:13.381579+0000","last_became_active":"2024-09-21T03:19:12.119239+0000","last_became_peered":"2024-09-21T03:19:12.119239+0000","last_unstale":"2024-09-21T03:19:13.381579+0000","last_undegraded":"2024-09-21T03:19:13.381579+0000","last_fullsized":"2024-09-21T03:19:13.381579+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:25:23.749492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T03:19:11.119204+0000","last_change":"2024-09-21T03:19:11.114966+0000","last_active":"2024-09-21T03:19:11.119204+0000","last_peered":"2024-09-21T03:19:11.119204+0000","last_clean":"2024-09-21T03:19:11.119204+0000","last_became_active":"2024-09-21T03:19:11.114605+0000","last_became_peered":"2024-09-21T03:19:11.114605+0000","last_unstale":"2024-09-21T03:19:11.119204+0000","last_undegraded":"2024-09-21T03:19:11.119204+0000","last_fullsized":"2024-09-21T03:19:11.119204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.793226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382249+0000","last_change":"2024-09-21T03:19:12.109364+0000","last_active":"2024-09-21T03:19:13.382249+0000","last_peered":"2024-09-21T03:19:13.382249+0000","last_clean":"2024-09-21T03:19:13.382249+0000","last_became_active":"2024-09-21T03:19:12.109039+0000","last_became_peered":"2024-09-21T03:19:12.109039+0000","last_unstale":"2024-09-21T03:19:13.382249+0000","last_undegraded":"2024-09-21T03:19:13.382249+0000","last_fullsized":"2024-09-21T03:19:13.382249+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:33.944043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.103590+0000","last_change":"2024-09-21T03:19:11.109672+0000","last_active":"2024-09-21T03:19:13.103590+0000","last_peered":"2024-09-21T03:19:13.103590+0000","last_clean":"2024-09-21T03:19:13.103590+0000","last_became_active":"2024-09-21T03:19:11.109093+0000","last_became_peered":"2024-09-21T03:19:11.109093+0000","last_unstale":"2024-09-21T03:19:13.103590+0000","last_undegraded":"2024-09-21T03:19:13.103590+0000","last_fullsized":"2024-09-21T03:19:13.103590+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:51.798449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381560+0000","last_change":"2024-09-21T03:19:12.106248+0000","last_active":"2024-09-21T03:19:13.381560+0000","last_peered":"2024-09-21T03:19:13.381560+0000","last_clean":"2024-09-21T03:19:13.381560+0000","last_became_active":"2024-09-21T03:19:12.105920+0000","last_became_peered":"2024-09-21T03:19:12.105920+0000","last_unstale":"2024-09-21T03:19:13.381560+0000","last_undegraded":"2024-09-21T03:19:13.381560+0000","last_fullsized":"2024-09-21T03:19:13.381560+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:36.590900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104635+0000","last_change":"2024-09-21T03:19:11.110445+0000","last_active":"2024-09-21T03:19:13.104635+0000","last_peered":"2024-09-21T03:19:13.104635+0000","last_clean":"2024-09-21T03:19:13.104635+0000","last_became_active":"2024-09-21T03:19:11.109764+0000","last_became_peered":"2024-09-21T03:19:11.109764+0000","last_unstale":"2024-09-21T03:19:13.104635+0000","last_undegraded":"2024-09-21T03:19:13.104635+0000","last_fullsized":"2024-09-21T03:19:13.104635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:55:44.185439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.101998+0000","last_change":"2024-09-21T03:19:12.115049+0000","last_active":"2024-09-21T03:19:13.101998+0000","last_peered":"2024-09-21T03:19:13.101998+0000","last_clean":"2024-09-21T03:19:13.101998+0000","last_became_active":"2024-09-21T03:19:12.114717+0000","last_became_peered":"2024-09-21T03:19:12.114717+0000","last_unstale":"2024-09-21T03:19:13.101998+0000","last_undegraded":"2024-09-21T03:19:13.101998+0000","last_fullsized":"2024-09-21T03:19:13.101998+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:04.243781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381893+0000","last_change":"2024-09-21T03:19:11.111243+0000","last_active":"2024-09-21T03:19:13.381893+0000","last_peered":"2024-09-21T03:19:13.381893+0000","last_clean":"2024-09-21T03:19:13.381893+0000","last_became_active":"2024-09-21T03:19:11.110915+0000","last_became_peered":"2024-09-21T03:19:11.110915+0000","last_unstale":"2024-09-21T03:19:13.381893+0000","last_undegraded":"2024-09-21T03:19:13.381893+0000","last_fullsized":"2024-09-21T03:19:13.381893+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:03:08.570891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381599+0000","last_change":"2024-09-21T03:19:12.124361+0000","last_active":"2024-09-21T03:19:13.381599+0000","last_peered":"2024-09-21T03:19:13.381599+0000","last_clean":"2024-09-21T03:19:13.381599+0000","last_became_active":"2024-09-21T03:19:12.124007+0000","last_became_peered":"2024-09-21T03:19:12.124007+0000","last_unstale":"2024-09-21T03:19:13.381599+0000","last_undegraded":"2024-09-21T03:19:13.381599+0000","last_fullsized":"2024-09-21T03:19:13.381599+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:56.039566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.121525+0000","last_change":"2024-09-21T03:19:11.109955+0000","last_active":"2024-09-21T03:19:13.121525+0000","last_peered":"2024-09-21T03:19:13.121525+0000","last_clean":"2024-09-21T03:19:13.121525+0000","last_became_active":"2024-09-21T03:19:11.109654+0000","last_became_peered":"2024-09-21T03:19:11.109654+0000","last_unstale":"2024-09-21T03:19:13.121525+0000","last_undegraded":"2024-09-21T03:19:13.121525+0000","last_fullsized":"2024-09-21T03:19:13.121525+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:46.019163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382620+0000","last_change":"2024-09-21T03:19:12.120031+0000","last_active":"2024-09-21T03:19:13.382620+0000","last_peered":"2024-09-21T03:19:13.382620+0000","last_clean":"2024-09-21T03:19:13.382620+0000","last_became_active":"2024-09-21T03:19:12.119600+0000","last_became_peered":"2024-09-21T03:19:12.119600+0000","last_unstale":"2024-09-21T03:19:13.382620+0000","last_undegraded":"2024-09-21T03:19:13.382620+0000","last_fullsized":"2024-09-21T03:19:13.382620+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:37:33.265939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T03:19:11.119254+0000","last_change":"2024-09-21T03:19:11.115218+0000","last_active":"2024-09-21T03:19:11.119254+0000","last_peered":"2024-09-21T03:19:11.119254+0000","last_clean":"2024-09-21T03:19:11.119254+0000","last_became_active":"2024-09-21T03:19:11.114683+0000","last_became_peered":"2024-09-21T03:19:11.114683+0000","last_unstale":"2024-09-21T03:19:11.119254+0000","last_undegraded":"2024-09-21T03:19:11.119254+0000","last_fullsized":"2024-09-21T03:19:11.119254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:05.460161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-21T03:19:11.106577+0000","last_change":"2024-09-21T03:19:11.106577+0000","last_active":"2024-09-21T03:19:11.088347+0000","last_peered":"2024-09-21T03:19:11.088347+0000","last_clean":"2024-09-21T03:19:11.088347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:19:11.106577+0000","last_undegraded":"2024-09-21T03:19:11.106577+0000","last_fullsized":"2024-09-21T03:19:11.106577+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.121131+0000","last_change":"2024-09-21T03:19:11.113832+0000","last_active":"2024-09-21T03:19:13.121131+0000","last_peered":"2024-09-21T03:19:13.121131+0000","last_clean":"2024-09-21T03:19:13.121131+0000","last_became_active":"2024-09-21T03:19:11.113316+0000","last_became_peered":"2024-09-21T03:19:11.113316+0000","last_unstale":"2024-09-21T03:19:13.121131+0000","last_undegraded":"2024-09-21T03:19:13.121131+0000","last_fullsized":"2024-09-21T03:19:13.121131+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:27.026756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.103465+0000","last_change":"2024-09-21T03:19:12.112077+0000","last_active":"2024-09-21T03:19:13.103465+0000","last_peered":"2024-09-21T03:19:13.103465+0000","last_clean":"2024-09-21T03:19:13.103465+0000","last_became_active":"2024-09-21T03:19:12.111703+0000","last_became_peered":"2024-09-21T03:19:12.111703+0000","last_unstale":"2024-09-21T03:19:13.103465+0000","last_undegraded":"2024-09-21T03:19:13.103465+0000","last_fullsized":"2024-09-21T03:19:13.103465+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:07.764584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T03:19:11.117568+0000","last_change":"2024-09-21T03:19:11.113950+0000","last_active":"2024-09-21T03:19:11.117568+0000","last_peered":"2024-09-21T03:19:11.117568+0000","last_clean":"2024-09-21T03:19:11.117568+0000","last_became_active":"2024-09-21T03:19:11.113642+0000","last_became_peered":"2024-09-21T03:19:11.113642+0000","last_unstale":"2024-09-21T03:19:11.117568+0000","last_undegraded":"2024-09-21T03:19:11.117568+0000","last_fullsized":"2024-09-21T03:19:11.117568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:30.646321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-21T03:19:11.107540+0000","last_change":"2024-09-21T03:19:11.107540+0000","last_active":"2024-09-21T03:19:11.088347+0000","last_peered":"2024-09-21T03:19:11.088347+0000","last_clean":"2024-09-21T03:19:11.088347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:19:11.107540+0000","last_undegraded":"2024-09-21T03:19:11.107540+0000","last_fullsized":"2024-09-21T03:19:11.107540+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.120766+0000","last_change":"2024-09-21T03:19:11.109571+0000","last_active":"2024-09-21T03:19:13.120766+0000","last_peered":"2024-09-21T03:19:13.120766+0000","last_clean":"2024-09-21T03:19:13.120766+0000","last_became_active":"2024-09-21T03:19:11.108784+0000","last_became_peered":"2024-09-21T03:19:11.108784+0000","last_unstale":"2024-09-21T03:19:13.120766+0000","last_undegraded":"2024-09-21T03:19:13.120766+0000","last_fullsized":"2024-09-21T03:19:13.120766+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:54:50.383426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381710+0000","last_change":"2024-09-21T03:19:12.108714+0000","last_active":"2024-09-21T03:19:13.381710+0000","last_peered":"2024-09-21T03:19:13.381710+0000","last_clean":"2024-09-21T03:19:13.381710+0000","last_became_active":"2024-09-21T03:19:12.108316+0000","last_became_peered":"2024-09-21T03:19:12.108316+0000","last_unstale":"2024-09-21T03:19:13.381710+0000","last_undegraded":"2024-09-21T03:19:13.381710+0000","last_fullsized":"2024-09-21T03:19:13.381710+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:19.212639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104747+0000","last_change":"2024-09-21T03:19:11.110080+0000","last_active":"2024-09-21T03:19:13.104747+0000","last_peered":"2024-09-21T03:19:13.104747+0000","last_clean":"2024-09-21T03:19:13.104747+0000","last_became_active":"2024-09-21T03:19:11.109409+0000","last_became_peered":"2024-09-21T03:19:11.109409+0000","last_unstale":"2024-09-21T03:19:13.104747+0000","last_undegraded":"2024-09-21T03:19:13.104747+0000","last_fullsized":"2024-09-21T03:19:13.104747+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:23:30.198368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104778+0000","last_change":"2024-09-21T03:19:12.120376+0000","last_active":"2024-09-21T03:19:13.104778+0000","last_peered":"2024-09-21T03:19:13.104778+0000","last_clean":"2024-09-21T03:19:13.104778+0000","last_became_active":"2024-09-21T03:19:12.118878+0000","last_became_peered":"2024-09-21T03:19:12.118878+0000","last_unstale":"2024-09-21T03:19:13.104778+0000","last_undegraded":"2024-09-21T03:19:13.104778+0000","last_fullsized":"2024-09-21T03:19:13.104778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:01.214721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381935+0000","last_change":"2024-09-21T03:19:11.115198+0000","last_active":"2024-09-21T03:19:13.381935+0000","last_peered":"2024-09-21T03:19:13.381935+0000","last_clean":"2024-09-21T03:19:13.381935+0000","last_became_active":"2024-09-21T03:19:11.114861+0000","last_became_peered":"2024-09-21T03:19:11.114861+0000","last_unstale":"2024-09-21T03:19:13.381935+0000","last_undegraded":"2024-09-21T03:19:13.381935+0000","last_fullsized":"2024-09-21T03:19:13.381935+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:10:24.624728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102385+0000","last_change":"2024-09-21T03:19:12.118074+0000","last_active":"2024-09-21T03:19:13.102385+0000","last_peered":"2024-09-21T03:19:13.102385+0000","last_clean":"2024-09-21T03:19:13.102385+0000","last_became_active":"2024-09-21T03:19:12.117752+0000","last_became_peered":"2024-09-21T03:19:12.117752+0000","last_unstale":"2024-09-21T03:19:13.102385+0000","last_undegraded":"2024-09-21T03:19:13.102385+0000","last_fullsized":"2024-09-21T03:19:13.102385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:00.596447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.103718+0000","last_change":"2024-09-21T03:19:11.109722+0000","last_active":"2024-09-21T03:19:13.103718+0000","last_peered":"2024-09-21T03:19:13.103718+0000","last_clean":"2024-09-21T03:19:13.103718+0000","last_became_active":"2024-09-21T03:19:11.109400+0000","last_became_peered":"2024-09-21T03:19:11.109400+0000","last_unstale":"2024-09-21T03:19:13.103718+0000","last_undegraded":"2024-09-21T03:19:13.103718+0000","last_fullsized":"2024-09-21T03:19:13.103718+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:23:30.198368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":132,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102882+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:19:13.102882+0000","last_peered":"2024-09-21T03:19:13.102882+0000","last_clean":"2024-09-21T03:19:13.102882+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:19:13.102882+0000","last_undegraded":"2024-09-21T03:19:13.102882+0000","last_fullsized":"2024-09-21T03:19:13.102882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509456,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":962560,"data_stored":728585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":385024,"data_stored":145043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":372736,"data_stored":138799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":385024,"data_stored":144531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":139761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":368640,"data_stored":138197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":393216,"data_stored":146061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":933888,"data_stored":715453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:19:16.484 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:19:16.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.630+0000 7ff8d3207640 1 -- 172.21.15.105:0/768774384 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8cc070390 msgr2=0x7ff8cc164b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:16.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.630+0000 7ff8d3207640 1 --2- 172.21.15.105:0/768774384 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8cc070390 0x7ff8cc164b60 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc070fe0 tx=0x7ff8c402a8b0 comp rx=0 tx=0).stop 2024-09-21T03:19:16.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.630+0000 7ff8d3207640 1 -- 172.21.15.105:0/768774384 shutdown_connections 2024-09-21T03:19:16.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.630+0000 7ff8d3207640 1 --2- 172.21.15.105:0/768774384 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8cc070390 0x7ff8cc164b60 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:16.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.630+0000 7ff8d3207640 1 --2- 172.21.15.105:0/768774384 >> v2:172.21.15.162:3300/0 conn(0x7ff8cc0b4d90 0x7ff8cc072e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:16.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.630+0000 7ff8d3207640 1 -- 172.21.15.105:0/768774384 >> 172.21.15.105:0/768774384 conn(0x7ff8cc06d7d0 msgr2=0x7ff8cc0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:16.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.630+0000 7ff8d3207640 1 -- 172.21.15.105:0/768774384 shutdown_connections 2024-09-21T03:19:16.634 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.630+0000 7ff8d3207640 1 -- 172.21.15.105:0/768774384 wait complete. 2024-09-21T03:19:16.634 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.632+0000 7ff8d3207640 1 Processor -- start 2024-09-21T03:19:16.634 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.632+0000 7ff8d3207640 1 -- start start 2024-09-21T03:19:16.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.633+0000 7ff8d3207640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8cc070390 0x7ff8cc144c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:16.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.633+0000 7ff8d3207640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8cc0cf940 0x7ff8cc0d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:16.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.633+0000 7ff8d3207640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8cc151fa0 0x7ff8cc0d0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:16.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.633+0000 7ff8d3207640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff8cc1650a0 con 0x7ff8cc0cf940 2024-09-21T03:19:16.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.633+0000 7ff8d3207640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff8cc0709b0 con 0x7ff8cc070390 2024-09-21T03:19:16.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.633+0000 7ff8d3207640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff8cc165220 con 0x7ff8cc151fa0 2024-09-21T03:19:16.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.633+0000 7ff8c3fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8cc0cf940 0x7ff8cc0d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:16.639 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.633+0000 7ff8c3fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8cc0cf940 0x7ff8cc0d00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51284/0 (socket says 172.21.15.105:51284) 2024-09-21T03:19:16.639 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.633+0000 7ff8c3fff640 1 -- 172.21.15.105:0/3305264433 learned_addr learned my addr 172.21.15.105:0/3305264433 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:16.639 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.634+0000 7ff8d0fa3640 1 --2- 172.21.15.105:0/3305264433 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8cc070390 0x7ff8cc144c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:16.639 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.634+0000 7ff8d17a4640 1 --2- 172.21.15.105:0/3305264433 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8cc151fa0 0x7ff8cc0d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:16.639 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.634+0000 7ff8c3fff640 1 -- 172.21.15.105:0/3305264433 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8cc151fa0 msgr2=0x7ff8cc0d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:16.639 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.634+0000 7ff8c3fff640 1 --2- 172.21.15.105:0/3305264433 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8cc151fa0 0x7ff8cc0d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:16.639 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.634+0000 7ff8c3fff640 1 -- 172.21.15.105:0/3305264433 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8cc070390 msgr2=0x7ff8cc144c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:16.639 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.634+0000 7ff8c3fff640 1 --2- 172.21.15.105:0/3305264433 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8cc070390 0x7ff8cc144c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:16.639 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.634+0000 7ff8c3fff640 1 -- 172.21.15.105:0/3305264433 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8cc1f75b0 con 0x7ff8cc0cf940 2024-09-21T03:19:16.639 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.634+0000 7ff8d0fa3640 1 --2- 172.21.15.105:0/3305264433 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8cc070390 0x7ff8cc144c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:19:16.639 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.634+0000 7ff8c3fff640 1 --2- 172.21.15.105:0/3305264433 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8cc0cf940 0x7ff8cc0d00d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc00c3c0 tx=0x7ff8bc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:16.639 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.634+0000 7ff8c17fa640 1 -- 172.21.15.105:0/3305264433 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc017070 con 0x7ff8cc0cf940 2024-09-21T03:19:16.640 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.634+0000 7ff8c17fa640 1 -- 172.21.15.105:0/3305264433 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8bc0035f0 con 0x7ff8cc0cf940 2024-09-21T03:19:16.640 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.634+0000 7ff8c17fa640 1 -- 172.21.15.105:0/3305264433 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc003a20 con 0x7ff8cc0cf940 2024-09-21T03:19:16.640 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.634+0000 7ff8d3207640 1 -- 172.21.15.105:0/3305264433 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8cc0b18e0 con 0x7ff8cc0cf940 2024-09-21T03:19:16.640 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.634+0000 7ff8d3207640 1 -- 172.21.15.105:0/3305264433 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8cc0af900 con 0x7ff8cc0cf940 2024-09-21T03:19:16.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.635+0000 7ff8d3207640 1 -- 172.21.15.105:0/3305264433 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8cc0b4d90 con 0x7ff8cc0cf940 2024-09-21T03:19:16.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.636+0000 7ff8c17fa640 1 -- 172.21.15.105:0/3305264433 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff8bc01a070 con 0x7ff8cc0cf940 2024-09-21T03:19:16.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.636+0000 7ff8c17fa640 1 --2- 172.21.15.105:0/3305264433 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff8b8078b90 0x7ff8b807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:16.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.637+0000 7ff8c17fa640 1 -- 172.21.15.105:0/3305264433 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7ff8bc099ed0 con 0x7ff8cc0cf940 2024-09-21T03:19:16.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.637+0000 7ff8d0fa3640 1 --2- 172.21.15.105:0/3305264433 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff8b8078b90 0x7ff8b807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:16.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.637+0000 7ff8d0fa3640 1 --2- 172.21.15.105:0/3305264433 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff8b8078b90 0x7ff8b807b0a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8009890 tx=0x7ff8c8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:16.643 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.641+0000 7ff8c17fa640 1 -- 172.21.15.105:0/3305264433 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff8cc0b3710 con 0x7ff8cc0cf940 2024-09-21T03:19:16.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.812+0000 7ff8d3207640 1 -- 172.21.15.105:0/3305264433 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff8cc0b1690 con 0x7ff8b8078b90 2024-09-21T03:19:16.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.817+0000 7ff8c17fa640 1 -- 172.21.15.105:0/3305264433 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251611 (secure 0 0 0) 0x7ff8cc0b1690 con 0x7ff8b8078b90 2024-09-21T03:19:16.822 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:19:16.823 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:19:16.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.820+0000 7ff8d3207640 1 -- 172.21.15.105:0/3305264433 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff8b8078b90 msgr2=0x7ff8b807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:16.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.820+0000 7ff8d3207640 1 --2- 172.21.15.105:0/3305264433 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff8b8078b90 0x7ff8b807b0a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8009890 tx=0x7ff8c8008040 comp rx=0 tx=0).stop 2024-09-21T03:19:16.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.820+0000 7ff8d3207640 1 -- 172.21.15.105:0/3305264433 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8cc0cf940 msgr2=0x7ff8cc0d00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:16.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.820+0000 7ff8d3207640 1 --2- 172.21.15.105:0/3305264433 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8cc0cf940 0x7ff8cc0d00d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc00c3c0 tx=0x7ff8bc00c880 comp rx=0 tx=0).stop 2024-09-21T03:19:16.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.820+0000 7ff8d3207640 1 -- 172.21.15.105:0/3305264433 shutdown_connections 2024-09-21T03:19:16.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.820+0000 7ff8d3207640 1 --2- 172.21.15.105:0/3305264433 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff8b8078b90 0x7ff8b807b0a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:16.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.820+0000 7ff8d3207640 1 --2- 172.21.15.105:0/3305264433 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8cc151fa0 0x7ff8cc0d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:16.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.820+0000 7ff8d3207640 1 --2- 172.21.15.105:0/3305264433 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8cc0cf940 0x7ff8cc0d00d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:16.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.820+0000 7ff8d3207640 1 --2- 172.21.15.105:0/3305264433 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8cc070390 0x7ff8cc144c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:16.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.820+0000 7ff8d3207640 1 -- 172.21.15.105:0/3305264433 >> 172.21.15.105:0/3305264433 conn(0x7ff8cc06d7d0 msgr2=0x7ff8cc15a160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:16.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.820+0000 7ff8d3207640 1 -- 172.21.15.105:0/3305264433 shutdown_connections 2024-09-21T03:19:16.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.820+0000 7ff8d3207640 1 -- 172.21.15.105:0/3305264433 wait complete. 2024-09-21T03:19:16.834 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-09-21T03:19:15.289777+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":144,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":107,"ondisk_log_size":107,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":147,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220340,"kb_used_data":4084,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754380,"statfs":{"total":773094113280,"available":772868485120,"internally_reserved":0,"allocated":4182016,"data_stored":2296430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.200803"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104116+0000","last_change":"2024-09-21T03:19:12.125859+0000","last_active":"2024-09-21T03:19:13.104116+0000","last_peered":"2024-09-21T03:19:13.104116+0000","last_clean":"2024-09-21T03:19:13.104116+0000","last_became_active":"2024-09-21T03:19:12.125455+0000","last_became_peered":"2024-09-21T03:19:12.125455+0000","last_unstale":"2024-09-21T03:19:13.104116+0000","last_undegraded":"2024-09-21T03:19:13.104116+0000","last_fullsized":"2024-09-21T03:19:13.104116+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:34.607404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382017+0000","last_change":"2024-09-21T03:19:12.109132+0000","last_active":"2024-09-21T03:19:13.382017+0000","last_peered":"2024-09-21T03:19:13.382017+0000","last_clean":"2024-09-21T03:19:13.382017+0000","last_became_active":"2024-09-21T03:19:12.108829+0000","last_became_peered":"2024-09-21T03:19:12.108829+0000","last_unstale":"2024-09-21T03:19:13.382017+0000","last_undegraded":"2024-09-21T03:19:13.382017+0000","last_fullsized":"2024-09-21T03:19:13.382017+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:00.596447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382502+0000","last_change":"2024-09-21T03:19:12.131941+0000","last_active":"2024-09-21T03:19:13.382502+0000","last_peered":"2024-09-21T03:19:13.382502+0000","last_clean":"2024-09-21T03:19:13.382502+0000","last_became_active":"2024-09-21T03:19:12.131458+0000","last_became_peered":"2024-09-21T03:19:12.131458+0000","last_unstale":"2024-09-21T03:19:13.382502+0000","last_undegraded":"2024-09-21T03:19:13.382502+0000","last_fullsized":"2024-09-21T03:19:13.382502+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:09:21.244381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.121028+0000","last_change":"2024-09-21T03:19:12.122867+0000","last_active":"2024-09-21T03:19:13.121028+0000","last_peered":"2024-09-21T03:19:13.121028+0000","last_clean":"2024-09-21T03:19:13.121028+0000","last_became_active":"2024-09-21T03:19:12.122533+0000","last_became_peered":"2024-09-21T03:19:12.122533+0000","last_unstale":"2024-09-21T03:19:13.121028+0000","last_undegraded":"2024-09-21T03:19:13.121028+0000","last_fullsized":"2024-09-21T03:19:13.121028+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:59.601871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382009+0000","last_change":"2024-09-21T03:19:12.111226+0000","last_active":"2024-09-21T03:19:13.382009+0000","last_peered":"2024-09-21T03:19:13.382009+0000","last_clean":"2024-09-21T03:19:13.382009+0000","last_became_active":"2024-09-21T03:19:12.110915+0000","last_became_peered":"2024-09-21T03:19:12.110915+0000","last_unstale":"2024-09-21T03:19:13.382009+0000","last_undegraded":"2024-09-21T03:19:13.382009+0000","last_fullsized":"2024-09-21T03:19:13.382009+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:52:42.610167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382578+0000","last_change":"2024-09-21T03:19:12.121447+0000","last_active":"2024-09-21T03:19:13.382578+0000","last_peered":"2024-09-21T03:19:13.382578+0000","last_clean":"2024-09-21T03:19:13.382578+0000","last_became_active":"2024-09-21T03:19:12.121157+0000","last_became_peered":"2024-09-21T03:19:12.121157+0000","last_unstale":"2024-09-21T03:19:13.382578+0000","last_undegraded":"2024-09-21T03:19:13.382578+0000","last_fullsized":"2024-09-21T03:19:13.382578+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:09.757925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102313+0000","last_change":"2024-09-21T03:19:12.115833+0000","last_active":"2024-09-21T03:19:13.102313+0000","last_peered":"2024-09-21T03:19:13.102313+0000","last_clean":"2024-09-21T03:19:13.102313+0000","last_became_active":"2024-09-21T03:19:12.115528+0000","last_became_peered":"2024-09-21T03:19:12.115528+0000","last_unstale":"2024-09-21T03:19:13.102313+0000","last_undegraded":"2024-09-21T03:19:13.102313+0000","last_fullsized":"2024-09-21T03:19:13.102313+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:27.762838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102363+0000","last_change":"2024-09-21T03:19:12.116051+0000","last_active":"2024-09-21T03:19:13.102363+0000","last_peered":"2024-09-21T03:19:13.102363+0000","last_clean":"2024-09-21T03:19:13.102363+0000","last_became_active":"2024-09-21T03:19:12.115701+0000","last_became_peered":"2024-09-21T03:19:12.115701+0000","last_unstale":"2024-09-21T03:19:13.102363+0000","last_undegraded":"2024-09-21T03:19:13.102363+0000","last_fullsized":"2024-09-21T03:19:13.102363+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:07:30.596468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104945+0000","last_change":"2024-09-21T03:19:12.119289+0000","last_active":"2024-09-21T03:19:13.104945+0000","last_peered":"2024-09-21T03:19:13.104945+0000","last_clean":"2024-09-21T03:19:13.104945+0000","last_became_active":"2024-09-21T03:19:12.118634+0000","last_became_peered":"2024-09-21T03:19:12.118634+0000","last_unstale":"2024-09-21T03:19:13.104945+0000","last_undegraded":"2024-09-21T03:19:13.104945+0000","last_fullsized":"2024-09-21T03:19:13.104945+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:23.665081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.121392+0000","last_change":"2024-09-21T03:19:12.116146+0000","last_active":"2024-09-21T03:19:13.121392+0000","last_peered":"2024-09-21T03:19:13.121392+0000","last_clean":"2024-09-21T03:19:13.121392+0000","last_became_active":"2024-09-21T03:19:12.115742+0000","last_became_peered":"2024-09-21T03:19:12.115742+0000","last_unstale":"2024-09-21T03:19:13.121392+0000","last_undegraded":"2024-09-21T03:19:13.121392+0000","last_fullsized":"2024-09-21T03:19:13.121392+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:58.031199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102384+0000","last_change":"2024-09-21T03:19:12.118702+0000","last_active":"2024-09-21T03:19:13.102384+0000","last_peered":"2024-09-21T03:19:13.102384+0000","last_clean":"2024-09-21T03:19:13.102384+0000","last_became_active":"2024-09-21T03:19:12.118391+0000","last_became_peered":"2024-09-21T03:19:12.118391+0000","last_unstale":"2024-09-21T03:19:13.102384+0000","last_undegraded":"2024-09-21T03:19:13.102384+0000","last_fullsized":"2024-09-21T03:19:13.102384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:57.800009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382162+0000","last_change":"2024-09-21T03:19:12.127366+0000","last_active":"2024-09-21T03:19:13.382162+0000","last_peered":"2024-09-21T03:19:13.382162+0000","last_clean":"2024-09-21T03:19:13.382162+0000","last_became_active":"2024-09-21T03:19:12.127036+0000","last_became_peered":"2024-09-21T03:19:12.127036+0000","last_unstale":"2024-09-21T03:19:13.382162+0000","last_undegraded":"2024-09-21T03:19:13.382162+0000","last_fullsized":"2024-09-21T03:19:13.382162+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:49.317940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382211+0000","last_change":"2024-09-21T03:19:12.108265+0000","last_active":"2024-09-21T03:19:13.382211+0000","last_peered":"2024-09-21T03:19:13.382211+0000","last_clean":"2024-09-21T03:19:13.382211+0000","last_became_active":"2024-09-21T03:19:12.107908+0000","last_became_peered":"2024-09-21T03:19:12.107908+0000","last_unstale":"2024-09-21T03:19:13.382211+0000","last_undegraded":"2024-09-21T03:19:13.382211+0000","last_fullsized":"2024-09-21T03:19:13.382211+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:02.577948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382498+0000","last_change":"2024-09-21T03:19:12.110175+0000","last_active":"2024-09-21T03:19:13.382498+0000","last_peered":"2024-09-21T03:19:13.382498+0000","last_clean":"2024-09-21T03:19:13.382498+0000","last_became_active":"2024-09-21T03:19:12.109849+0000","last_became_peered":"2024-09-21T03:19:12.109849+0000","last_unstale":"2024-09-21T03:19:13.382498+0000","last_undegraded":"2024-09-21T03:19:13.382498+0000","last_fullsized":"2024-09-21T03:19:13.382498+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:34.525061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382239+0000","last_change":"2024-09-21T03:19:12.128786+0000","last_active":"2024-09-21T03:19:13.382239+0000","last_peered":"2024-09-21T03:19:13.382239+0000","last_clean":"2024-09-21T03:19:13.382239+0000","last_became_active":"2024-09-21T03:19:12.128433+0000","last_became_peered":"2024-09-21T03:19:12.128433+0000","last_unstale":"2024-09-21T03:19:13.382239+0000","last_undegraded":"2024-09-21T03:19:13.382239+0000","last_fullsized":"2024-09-21T03:19:13.382239+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:57.800009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.103044+0000","last_change":"2024-09-21T03:19:12.114204+0000","last_active":"2024-09-21T03:19:13.103044+0000","last_peered":"2024-09-21T03:19:13.103044+0000","last_clean":"2024-09-21T03:19:13.103044+0000","last_became_active":"2024-09-21T03:19:12.113864+0000","last_became_peered":"2024-09-21T03:19:12.113864+0000","last_unstale":"2024-09-21T03:19:13.103044+0000","last_undegraded":"2024-09-21T03:19:13.103044+0000","last_fullsized":"2024-09-21T03:19:13.103044+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:06.048604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102949+0000","last_change":"2024-09-21T03:19:12.123129+0000","last_active":"2024-09-21T03:19:13.102949+0000","last_peered":"2024-09-21T03:19:13.102949+0000","last_clean":"2024-09-21T03:19:13.102949+0000","last_became_active":"2024-09-21T03:19:12.122781+0000","last_became_peered":"2024-09-21T03:19:12.122781+0000","last_unstale":"2024-09-21T03:19:13.102949+0000","last_undegraded":"2024-09-21T03:19:13.102949+0000","last_fullsized":"2024-09-21T03:19:13.102949+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:48.519582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382143+0000","last_change":"2024-09-21T03:19:12.118599+0000","last_active":"2024-09-21T03:19:13.382143+0000","last_peered":"2024-09-21T03:19:13.382143+0000","last_clean":"2024-09-21T03:19:13.382143+0000","last_became_active":"2024-09-21T03:19:12.118319+0000","last_became_peered":"2024-09-21T03:19:12.118319+0000","last_unstale":"2024-09-21T03:19:13.382143+0000","last_undegraded":"2024-09-21T03:19:13.382143+0000","last_fullsized":"2024-09-21T03:19:13.382143+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:58.905425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381899+0000","last_change":"2024-09-21T03:19:12.121041+0000","last_active":"2024-09-21T03:19:13.381899+0000","last_peered":"2024-09-21T03:19:13.381899+0000","last_clean":"2024-09-21T03:19:13.381899+0000","last_became_active":"2024-09-21T03:19:12.119726+0000","last_became_peered":"2024-09-21T03:19:12.119726+0000","last_unstale":"2024-09-21T03:19:13.381899+0000","last_undegraded":"2024-09-21T03:19:13.381899+0000","last_fullsized":"2024-09-21T03:19:13.381899+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:45:41.300137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381977+0000","last_change":"2024-09-21T03:19:12.120864+0000","last_active":"2024-09-21T03:19:13.381977+0000","last_peered":"2024-09-21T03:19:13.381977+0000","last_clean":"2024-09-21T03:19:13.381977+0000","last_became_active":"2024-09-21T03:19:12.120558+0000","last_became_peered":"2024-09-21T03:19:12.120558+0000","last_unstale":"2024-09-21T03:19:13.381977+0000","last_undegraded":"2024-09-21T03:19:13.381977+0000","last_fullsized":"2024-09-21T03:19:13.381977+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:36.934721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104275+0000","last_change":"2024-09-21T03:19:12.119909+0000","last_active":"2024-09-21T03:19:13.104275+0000","last_peered":"2024-09-21T03:19:13.104275+0000","last_clean":"2024-09-21T03:19:13.104275+0000","last_became_active":"2024-09-21T03:19:12.119529+0000","last_became_peered":"2024-09-21T03:19:12.119529+0000","last_unstale":"2024-09-21T03:19:13.104275+0000","last_undegraded":"2024-09-21T03:19:13.104275+0000","last_fullsized":"2024-09-21T03:19:13.104275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:38.291868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104702+0000","last_change":"2024-09-21T03:19:12.119190+0000","last_active":"2024-09-21T03:19:13.104702+0000","last_peered":"2024-09-21T03:19:13.104702+0000","last_clean":"2024-09-21T03:19:13.104702+0000","last_became_active":"2024-09-21T03:19:12.118617+0000","last_became_peered":"2024-09-21T03:19:12.118617+0000","last_unstale":"2024-09-21T03:19:13.104702+0000","last_undegraded":"2024-09-21T03:19:13.104702+0000","last_fullsized":"2024-09-21T03:19:13.104702+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:38.040137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-21T03:19:11.107024+0000","last_change":"2024-09-21T03:19:11.107024+0000","last_active":"2024-09-21T03:19:11.088347+0000","last_peered":"2024-09-21T03:19:11.088347+0000","last_clean":"2024-09-21T03:19:11.088347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:19:11.107024+0000","last_undegraded":"2024-09-21T03:19:11.107024+0000","last_fullsized":"2024-09-21T03:19:11.107024+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382111+0000","last_change":"2024-09-21T03:19:12.123887+0000","last_active":"2024-09-21T03:19:13.382111+0000","last_peered":"2024-09-21T03:19:13.382111+0000","last_clean":"2024-09-21T03:19:13.382111+0000","last_became_active":"2024-09-21T03:19:12.123560+0000","last_became_peered":"2024-09-21T03:19:12.123560+0000","last_unstale":"2024-09-21T03:19:13.382111+0000","last_undegraded":"2024-09-21T03:19:13.382111+0000","last_fullsized":"2024-09-21T03:19:13.382111+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:27.762838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.121436+0000","last_change":"2024-09-21T03:19:12.116939+0000","last_active":"2024-09-21T03:19:13.121436+0000","last_peered":"2024-09-21T03:19:13.121436+0000","last_clean":"2024-09-21T03:19:13.121436+0000","last_became_active":"2024-09-21T03:19:12.116637+0000","last_became_peered":"2024-09-21T03:19:12.116637+0000","last_unstale":"2024-09-21T03:19:13.121436+0000","last_undegraded":"2024-09-21T03:19:13.121436+0000","last_fullsized":"2024-09-21T03:19:13.121436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:01.049780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382264+0000","last_change":"2024-09-21T03:19:12.117324+0000","last_active":"2024-09-21T03:19:13.382264+0000","last_peered":"2024-09-21T03:19:13.382264+0000","last_clean":"2024-09-21T03:19:13.382264+0000","last_became_active":"2024-09-21T03:19:12.117003+0000","last_became_peered":"2024-09-21T03:19:12.117003+0000","last_unstale":"2024-09-21T03:19:13.382264+0000","last_undegraded":"2024-09-21T03:19:13.382264+0000","last_fullsized":"2024-09-21T03:19:13.382264+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:58.393209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.121300+0000","last_change":"2024-09-21T03:19:12.121597+0000","last_active":"2024-09-21T03:19:13.121300+0000","last_peered":"2024-09-21T03:19:13.121300+0000","last_clean":"2024-09-21T03:19:13.121300+0000","last_became_active":"2024-09-21T03:19:12.121311+0000","last_became_peered":"2024-09-21T03:19:12.121311+0000","last_unstale":"2024-09-21T03:19:13.121300+0000","last_undegraded":"2024-09-21T03:19:13.121300+0000","last_fullsized":"2024-09-21T03:19:13.121300+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:59.556293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382433+0000","last_change":"2024-09-21T03:19:12.121332+0000","last_active":"2024-09-21T03:19:13.382433+0000","last_peered":"2024-09-21T03:19:13.382433+0000","last_clean":"2024-09-21T03:19:13.382433+0000","last_became_active":"2024-09-21T03:19:12.120078+0000","last_became_peered":"2024-09-21T03:19:12.120078+0000","last_unstale":"2024-09-21T03:19:13.382433+0000","last_undegraded":"2024-09-21T03:19:13.382433+0000","last_fullsized":"2024-09-21T03:19:13.382433+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:18:47.580493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104544+0000","last_change":"2024-09-21T03:19:12.124510+0000","last_active":"2024-09-21T03:19:13.104544+0000","last_peered":"2024-09-21T03:19:13.104544+0000","last_clean":"2024-09-21T03:19:13.104544+0000","last_became_active":"2024-09-21T03:19:12.124166+0000","last_became_peered":"2024-09-21T03:19:12.124166+0000","last_unstale":"2024-09-21T03:19:13.104544+0000","last_undegraded":"2024-09-21T03:19:13.104544+0000","last_fullsized":"2024-09-21T03:19:13.104544+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:03:09.576885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102626+0000","last_change":"2024-09-21T03:19:12.125359+0000","last_active":"2024-09-21T03:19:13.102626+0000","last_peered":"2024-09-21T03:19:13.102626+0000","last_clean":"2024-09-21T03:19:13.102626+0000","last_became_active":"2024-09-21T03:19:12.125040+0000","last_became_peered":"2024-09-21T03:19:12.125040+0000","last_unstale":"2024-09-21T03:19:13.102626+0000","last_undegraded":"2024-09-21T03:19:13.102626+0000","last_fullsized":"2024-09-21T03:19:13.102626+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:18:47.580493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.103621+0000","last_change":"2024-09-21T03:19:12.113525+0000","last_active":"2024-09-21T03:19:13.103621+0000","last_peered":"2024-09-21T03:19:13.103621+0000","last_clean":"2024-09-21T03:19:13.103621+0000","last_became_active":"2024-09-21T03:19:12.113179+0000","last_became_peered":"2024-09-21T03:19:12.113179+0000","last_unstale":"2024-09-21T03:19:13.103621+0000","last_undegraded":"2024-09-21T03:19:13.103621+0000","last_fullsized":"2024-09-21T03:19:13.103621+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:25.092143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102677+0000","last_change":"2024-09-21T03:19:12.124045+0000","last_active":"2024-09-21T03:19:13.102677+0000","last_peered":"2024-09-21T03:19:13.102677+0000","last_clean":"2024-09-21T03:19:13.102677+0000","last_became_active":"2024-09-21T03:19:12.123675+0000","last_became_peered":"2024-09-21T03:19:12.123675+0000","last_unstale":"2024-09-21T03:19:13.102677+0000","last_undegraded":"2024-09-21T03:19:13.102677+0000","last_fullsized":"2024-09-21T03:19:13.102677+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:47:14.609891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-21T03:19:11.108357+0000","last_change":"2024-09-21T03:19:11.108357+0000","last_active":"2024-09-21T03:19:11.088347+0000","last_peered":"2024-09-21T03:19:11.088347+0000","last_clean":"2024-09-21T03:19:11.088347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:19:11.108357+0000","last_undegraded":"2024-09-21T03:19:11.108357+0000","last_fullsized":"2024-09-21T03:19:11.108357+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104252+0000","last_change":"2024-09-21T03:19:11.114158+0000","last_active":"2024-09-21T03:19:13.104252+0000","last_peered":"2024-09-21T03:19:13.104252+0000","last_clean":"2024-09-21T03:19:13.104252+0000","last_became_active":"2024-09-21T03:19:11.113815+0000","last_became_peered":"2024-09-21T03:19:11.113815+0000","last_unstale":"2024-09-21T03:19:13.104252+0000","last_undegraded":"2024-09-21T03:19:13.104252+0000","last_fullsized":"2024-09-21T03:19:13.104252+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:55:44.185439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104156+0000","last_change":"2024-09-21T03:19:12.121035+0000","last_active":"2024-09-21T03:19:13.104156+0000","last_peered":"2024-09-21T03:19:13.104156+0000","last_clean":"2024-09-21T03:19:13.104156+0000","last_became_active":"2024-09-21T03:19:12.120664+0000","last_became_peered":"2024-09-21T03:19:12.120664+0000","last_unstale":"2024-09-21T03:19:13.104156+0000","last_undegraded":"2024-09-21T03:19:13.104156+0000","last_fullsized":"2024-09-21T03:19:13.104156+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:41.193668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T03:19:11.120114+0000","last_change":"2024-09-21T03:19:11.118983+0000","last_active":"2024-09-21T03:19:11.120114+0000","last_peered":"2024-09-21T03:19:11.120114+0000","last_clean":"2024-09-21T03:19:11.120114+0000","last_became_active":"2024-09-21T03:19:11.118703+0000","last_became_peered":"2024-09-21T03:19:11.118703+0000","last_unstale":"2024-09-21T03:19:11.120114+0000","last_undegraded":"2024-09-21T03:19:11.120114+0000","last_fullsized":"2024-09-21T03:19:11.120114+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:16.597589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104999+0000","last_change":"2024-09-21T03:19:12.121175+0000","last_active":"2024-09-21T03:19:13.104999+0000","last_peered":"2024-09-21T03:19:13.104999+0000","last_clean":"2024-09-21T03:19:13.104999+0000","last_became_active":"2024-09-21T03:19:12.120612+0000","last_became_peered":"2024-09-21T03:19:12.120612+0000","last_unstale":"2024-09-21T03:19:13.104999+0000","last_undegraded":"2024-09-21T03:19:13.104999+0000","last_fullsized":"2024-09-21T03:19:13.104999+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:42.611910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381723+0000","last_change":"2024-09-21T03:19:11.108839+0000","last_active":"2024-09-21T03:19:13.381723+0000","last_peered":"2024-09-21T03:19:13.381723+0000","last_clean":"2024-09-21T03:19:13.381723+0000","last_became_active":"2024-09-21T03:19:11.108247+0000","last_became_peered":"2024-09-21T03:19:11.108247+0000","last_unstale":"2024-09-21T03:19:13.381723+0000","last_undegraded":"2024-09-21T03:19:13.381723+0000","last_fullsized":"2024-09-21T03:19:13.381723+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:23.619672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.121337+0000","last_change":"2024-09-21T03:19:12.120865+0000","last_active":"2024-09-21T03:19:13.121337+0000","last_peered":"2024-09-21T03:19:13.121337+0000","last_clean":"2024-09-21T03:19:13.121337+0000","last_became_active":"2024-09-21T03:19:12.120573+0000","last_became_peered":"2024-09-21T03:19:12.120573+0000","last_unstale":"2024-09-21T03:19:13.121337+0000","last_undegraded":"2024-09-21T03:19:13.121337+0000","last_fullsized":"2024-09-21T03:19:13.121337+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:40.773712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382105+0000","last_change":"2024-09-21T03:19:11.112313+0000","last_active":"2024-09-21T03:19:13.382105+0000","last_peered":"2024-09-21T03:19:13.382105+0000","last_clean":"2024-09-21T03:19:13.382105+0000","last_became_active":"2024-09-21T03:19:11.110122+0000","last_became_peered":"2024-09-21T03:19:11.110122+0000","last_unstale":"2024-09-21T03:19:13.382105+0000","last_undegraded":"2024-09-21T03:19:13.382105+0000","last_fullsized":"2024-09-21T03:19:13.382105+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:43.796244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102942+0000","last_change":"2024-09-21T03:19:12.123179+0000","last_active":"2024-09-21T03:19:13.102942+0000","last_peered":"2024-09-21T03:19:13.102942+0000","last_clean":"2024-09-21T03:19:13.102942+0000","last_became_active":"2024-09-21T03:19:12.122875+0000","last_became_peered":"2024-09-21T03:19:12.122875+0000","last_unstale":"2024-09-21T03:19:13.102942+0000","last_undegraded":"2024-09-21T03:19:13.102942+0000","last_fullsized":"2024-09-21T03:19:13.102942+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:34.525061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104724+0000","last_change":"2024-09-21T03:19:11.117022+0000","last_active":"2024-09-21T03:19:13.104724+0000","last_peered":"2024-09-21T03:19:13.104724+0000","last_clean":"2024-09-21T03:19:13.104724+0000","last_became_active":"2024-09-21T03:19:11.116690+0000","last_became_peered":"2024-09-21T03:19:11.116690+0000","last_unstale":"2024-09-21T03:19:13.104724+0000","last_undegraded":"2024-09-21T03:19:13.104724+0000","last_fullsized":"2024-09-21T03:19:13.104724+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:51.255559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382486+0000","last_change":"2024-09-21T03:19:12.119159+0000","last_active":"2024-09-21T03:19:13.382486+0000","last_peered":"2024-09-21T03:19:13.382486+0000","last_clean":"2024-09-21T03:19:13.382486+0000","last_became_active":"2024-09-21T03:19:12.118808+0000","last_became_peered":"2024-09-21T03:19:12.118808+0000","last_unstale":"2024-09-21T03:19:13.382486+0000","last_undegraded":"2024-09-21T03:19:13.382486+0000","last_fullsized":"2024-09-21T03:19:13.382486+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:48.519582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104682+0000","last_change":"2024-09-21T03:19:11.116558+0000","last_active":"2024-09-21T03:19:13.104682+0000","last_peered":"2024-09-21T03:19:13.104682+0000","last_clean":"2024-09-21T03:19:13.104682+0000","last_became_active":"2024-09-21T03:19:11.116169+0000","last_became_peered":"2024-09-21T03:19:11.116169+0000","last_unstale":"2024-09-21T03:19:13.104682+0000","last_undegraded":"2024-09-21T03:19:13.104682+0000","last_fullsized":"2024-09-21T03:19:13.104682+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:23:00.100615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104262+0000","last_change":"2024-09-21T03:19:12.115624+0000","last_active":"2024-09-21T03:19:13.104262+0000","last_peered":"2024-09-21T03:19:13.104262+0000","last_clean":"2024-09-21T03:19:13.104262+0000","last_became_active":"2024-09-21T03:19:12.115275+0000","last_became_peered":"2024-09-21T03:19:12.115275+0000","last_unstale":"2024-09-21T03:19:13.104262+0000","last_undegraded":"2024-09-21T03:19:13.104262+0000","last_fullsized":"2024-09-21T03:19:13.104262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:41.193668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381827+0000","last_change":"2024-09-21T03:19:11.103165+0000","last_active":"2024-09-21T03:19:13.381827+0000","last_peered":"2024-09-21T03:19:13.381827+0000","last_clean":"2024-09-21T03:19:13.381827+0000","last_became_active":"2024-09-21T03:19:11.102872+0000","last_became_peered":"2024-09-21T03:19:11.102872+0000","last_unstale":"2024-09-21T03:19:13.381827+0000","last_undegraded":"2024-09-21T03:19:13.381827+0000","last_fullsized":"2024-09-21T03:19:13.381827+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:56:43.303284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.120728+0000","last_change":"2024-09-21T03:19:12.127448+0000","last_active":"2024-09-21T03:19:13.120728+0000","last_peered":"2024-09-21T03:19:13.120728+0000","last_clean":"2024-09-21T03:19:13.120728+0000","last_became_active":"2024-09-21T03:19:12.127007+0000","last_became_peered":"2024-09-21T03:19:12.127007+0000","last_unstale":"2024-09-21T03:19:13.120728+0000","last_undegraded":"2024-09-21T03:19:13.120728+0000","last_fullsized":"2024-09-21T03:19:13.120728+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:32.175500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104894+0000","last_change":"2024-09-21T03:19:11.112403+0000","last_active":"2024-09-21T03:19:13.104894+0000","last_peered":"2024-09-21T03:19:13.104894+0000","last_clean":"2024-09-21T03:19:13.104894+0000","last_became_active":"2024-09-21T03:19:11.110380+0000","last_became_peered":"2024-09-21T03:19:11.110380+0000","last_unstale":"2024-09-21T03:19:13.104894+0000","last_undegraded":"2024-09-21T03:19:13.104894+0000","last_fullsized":"2024-09-21T03:19:13.104894+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:51.798449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382430+0000","last_change":"2024-09-21T03:19:12.120648+0000","last_active":"2024-09-21T03:19:13.382430+0000","last_peered":"2024-09-21T03:19:13.382430+0000","last_clean":"2024-09-21T03:19:13.382430+0000","last_became_active":"2024-09-21T03:19:12.119981+0000","last_became_peered":"2024-09-21T03:19:12.119981+0000","last_unstale":"2024-09-21T03:19:13.382430+0000","last_undegraded":"2024-09-21T03:19:13.382430+0000","last_fullsized":"2024-09-21T03:19:13.382430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:11:25.857215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381960+0000","last_change":"2024-09-21T03:19:11.116104+0000","last_active":"2024-09-21T03:19:13.381960+0000","last_peered":"2024-09-21T03:19:13.381960+0000","last_clean":"2024-09-21T03:19:13.381960+0000","last_became_active":"2024-09-21T03:19:11.114896+0000","last_became_peered":"2024-09-21T03:19:11.114896+0000","last_unstale":"2024-09-21T03:19:13.381960+0000","last_undegraded":"2024-09-21T03:19:13.381960+0000","last_fullsized":"2024-09-21T03:19:13.381960+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:13.276373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381838+0000","last_change":"2024-09-21T03:19:12.115277+0000","last_active":"2024-09-21T03:19:13.381838+0000","last_peered":"2024-09-21T03:19:13.381838+0000","last_clean":"2024-09-21T03:19:13.381838+0000","last_became_active":"2024-09-21T03:19:12.114969+0000","last_became_peered":"2024-09-21T03:19:12.114969+0000","last_unstale":"2024-09-21T03:19:13.381838+0000","last_undegraded":"2024-09-21T03:19:13.381838+0000","last_fullsized":"2024-09-21T03:19:13.381838+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:07:30.596468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T03:19:11.120871+0000","last_change":"2024-09-21T03:19:11.119888+0000","last_active":"2024-09-21T03:19:11.120871+0000","last_peered":"2024-09-21T03:19:11.120871+0000","last_clean":"2024-09-21T03:19:11.120871+0000","last_became_active":"2024-09-21T03:19:11.119545+0000","last_became_peered":"2024-09-21T03:19:11.119545+0000","last_unstale":"2024-09-21T03:19:11.120871+0000","last_undegraded":"2024-09-21T03:19:11.120871+0000","last_fullsized":"2024-09-21T03:19:11.120871+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:08:16.943494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382322+0000","last_change":"2024-09-21T03:19:12.114882+0000","last_active":"2024-09-21T03:19:13.382322+0000","last_peered":"2024-09-21T03:19:13.382322+0000","last_clean":"2024-09-21T03:19:13.382322+0000","last_became_active":"2024-09-21T03:19:12.114561+0000","last_became_peered":"2024-09-21T03:19:12.114561+0000","last_unstale":"2024-09-21T03:19:13.382322+0000","last_undegraded":"2024-09-21T03:19:13.382322+0000","last_fullsized":"2024-09-21T03:19:13.382322+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:08.667667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382464+0000","last_change":"2024-09-21T03:19:11.111184+0000","last_active":"2024-09-21T03:19:13.382464+0000","last_peered":"2024-09-21T03:19:13.382464+0000","last_clean":"2024-09-21T03:19:13.382464+0000","last_became_active":"2024-09-21T03:19:11.110861+0000","last_became_peered":"2024-09-21T03:19:11.110861+0000","last_unstale":"2024-09-21T03:19:13.382464+0000","last_undegraded":"2024-09-21T03:19:13.382464+0000","last_fullsized":"2024-09-21T03:19:13.382464+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:57.066419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382293+0000","last_change":"2024-09-21T03:19:12.131237+0000","last_active":"2024-09-21T03:19:13.382293+0000","last_peered":"2024-09-21T03:19:13.382293+0000","last_clean":"2024-09-21T03:19:13.382293+0000","last_became_active":"2024-09-21T03:19:12.130867+0000","last_became_peered":"2024-09-21T03:19:12.130867+0000","last_unstale":"2024-09-21T03:19:13.382293+0000","last_undegraded":"2024-09-21T03:19:13.382293+0000","last_fullsized":"2024-09-21T03:19:13.382293+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:29:39.788655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382367+0000","last_change":"2024-09-21T03:19:11.109747+0000","last_active":"2024-09-21T03:19:13.382367+0000","last_peered":"2024-09-21T03:19:13.382367+0000","last_clean":"2024-09-21T03:19:13.382367+0000","last_became_active":"2024-09-21T03:19:11.109471+0000","last_became_peered":"2024-09-21T03:19:11.109471+0000","last_unstale":"2024-09-21T03:19:13.382367+0000","last_undegraded":"2024-09-21T03:19:13.382367+0000","last_fullsized":"2024-09-21T03:19:13.382367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:11.187788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.120806+0000","last_change":"2024-09-21T03:19:12.128068+0000","last_active":"2024-09-21T03:19:13.120806+0000","last_peered":"2024-09-21T03:19:13.120806+0000","last_clean":"2024-09-21T03:19:13.120806+0000","last_became_active":"2024-09-21T03:19:12.127594+0000","last_became_peered":"2024-09-21T03:19:12.127594+0000","last_unstale":"2024-09-21T03:19:13.120806+0000","last_undegraded":"2024-09-21T03:19:13.120806+0000","last_fullsized":"2024-09-21T03:19:13.120806+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:19.756214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104891+0000","last_change":"2024-09-21T03:19:11.108994+0000","last_active":"2024-09-21T03:19:13.104891+0000","last_peered":"2024-09-21T03:19:13.104891+0000","last_clean":"2024-09-21T03:19:13.104891+0000","last_became_active":"2024-09-21T03:19:11.108092+0000","last_became_peered":"2024-09-21T03:19:11.108092+0000","last_unstale":"2024-09-21T03:19:13.104891+0000","last_undegraded":"2024-09-21T03:19:13.104891+0000","last_fullsized":"2024-09-21T03:19:13.104891+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:15.318084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382516+0000","last_change":"2024-09-21T03:19:12.111240+0000","last_active":"2024-09-21T03:19:13.382516+0000","last_peered":"2024-09-21T03:19:13.382516+0000","last_clean":"2024-09-21T03:19:13.382516+0000","last_became_active":"2024-09-21T03:19:12.110483+0000","last_became_peered":"2024-09-21T03:19:12.110483+0000","last_unstale":"2024-09-21T03:19:13.382516+0000","last_undegraded":"2024-09-21T03:19:13.382516+0000","last_fullsized":"2024-09-21T03:19:13.382516+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:43.881668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.120663+0000","last_change":"2024-09-21T03:19:11.112700+0000","last_active":"2024-09-21T03:19:13.120663+0000","last_peered":"2024-09-21T03:19:13.120663+0000","last_clean":"2024-09-21T03:19:13.120663+0000","last_became_active":"2024-09-21T03:19:11.112398+0000","last_became_peered":"2024-09-21T03:19:11.112398+0000","last_unstale":"2024-09-21T03:19:13.120663+0000","last_undegraded":"2024-09-21T03:19:13.120663+0000","last_fullsized":"2024-09-21T03:19:13.120663+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:14.899603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102654+0000","last_change":"2024-09-21T03:19:12.124045+0000","last_active":"2024-09-21T03:19:13.102654+0000","last_peered":"2024-09-21T03:19:13.102654+0000","last_clean":"2024-09-21T03:19:13.102654+0000","last_became_active":"2024-09-21T03:19:12.123703+0000","last_became_peered":"2024-09-21T03:19:12.123703+0000","last_unstale":"2024-09-21T03:19:13.102654+0000","last_undegraded":"2024-09-21T03:19:13.102654+0000","last_fullsized":"2024-09-21T03:19:13.102654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:11:25.857215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381941+0000","last_change":"2024-09-21T03:19:11.113832+0000","last_active":"2024-09-21T03:19:13.381941+0000","last_peered":"2024-09-21T03:19:13.381941+0000","last_clean":"2024-09-21T03:19:13.381941+0000","last_became_active":"2024-09-21T03:19:11.113490+0000","last_became_peered":"2024-09-21T03:19:11.113490+0000","last_unstale":"2024-09-21T03:19:13.381941+0000","last_undegraded":"2024-09-21T03:19:13.381941+0000","last_fullsized":"2024-09-21T03:19:13.381941+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:21.360860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.103679+0000","last_change":"2024-09-21T03:19:12.112692+0000","last_active":"2024-09-21T03:19:13.103679+0000","last_peered":"2024-09-21T03:19:13.103679+0000","last_clean":"2024-09-21T03:19:13.103679+0000","last_became_active":"2024-09-21T03:19:12.112358+0000","last_became_peered":"2024-09-21T03:19:12.112358+0000","last_unstale":"2024-09-21T03:19:13.103679+0000","last_undegraded":"2024-09-21T03:19:13.103679+0000","last_fullsized":"2024-09-21T03:19:13.103679+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:55.890328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381835+0000","last_change":"2024-09-21T03:19:11.113112+0000","last_active":"2024-09-21T03:19:13.381835+0000","last_peered":"2024-09-21T03:19:13.381835+0000","last_clean":"2024-09-21T03:19:13.381835+0000","last_became_active":"2024-09-21T03:19:11.112471+0000","last_became_peered":"2024-09-21T03:19:11.112471+0000","last_unstale":"2024-09-21T03:19:13.381835+0000","last_undegraded":"2024-09-21T03:19:13.381835+0000","last_fullsized":"2024-09-21T03:19:13.381835+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:14.685100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104597+0000","last_change":"2024-09-21T03:19:12.123489+0000","last_active":"2024-09-21T03:19:13.104597+0000","last_peered":"2024-09-21T03:19:13.104597+0000","last_clean":"2024-09-21T03:19:13.104597+0000","last_became_active":"2024-09-21T03:19:12.123128+0000","last_became_peered":"2024-09-21T03:19:12.123128+0000","last_unstale":"2024-09-21T03:19:13.104597+0000","last_undegraded":"2024-09-21T03:19:13.104597+0000","last_fullsized":"2024-09-21T03:19:13.104597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:58.072413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.121464+0000","last_change":"2024-09-21T03:19:11.116551+0000","last_active":"2024-09-21T03:19:13.121464+0000","last_peered":"2024-09-21T03:19:13.121464+0000","last_clean":"2024-09-21T03:19:13.121464+0000","last_became_active":"2024-09-21T03:19:11.116223+0000","last_became_peered":"2024-09-21T03:19:11.116223+0000","last_unstale":"2024-09-21T03:19:13.121464+0000","last_undegraded":"2024-09-21T03:19:13.121464+0000","last_fullsized":"2024-09-21T03:19:13.121464+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:15.318084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382586+0000","last_change":"2024-09-21T03:19:12.128395+0000","last_active":"2024-09-21T03:19:13.382586+0000","last_peered":"2024-09-21T03:19:13.382586+0000","last_clean":"2024-09-21T03:19:13.382586+0000","last_became_active":"2024-09-21T03:19:12.128076+0000","last_became_peered":"2024-09-21T03:19:12.128076+0000","last_unstale":"2024-09-21T03:19:13.382586+0000","last_undegraded":"2024-09-21T03:19:13.382586+0000","last_fullsized":"2024-09-21T03:19:13.382586+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:06.048604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104542+0000","last_change":"2024-09-21T03:19:11.111848+0000","last_active":"2024-09-21T03:19:13.104542+0000","last_peered":"2024-09-21T03:19:13.104542+0000","last_clean":"2024-09-21T03:19:13.104542+0000","last_became_active":"2024-09-21T03:19:11.111129+0000","last_became_peered":"2024-09-21T03:19:11.111129+0000","last_unstale":"2024-09-21T03:19:13.104542+0000","last_undegraded":"2024-09-21T03:19:13.104542+0000","last_fullsized":"2024-09-21T03:19:13.104542+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:39.822767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.120953+0000","last_change":"2024-09-21T03:19:12.129108+0000","last_active":"2024-09-21T03:19:13.120953+0000","last_peered":"2024-09-21T03:19:13.120953+0000","last_clean":"2024-09-21T03:19:13.120953+0000","last_became_active":"2024-09-21T03:19:12.128830+0000","last_became_peered":"2024-09-21T03:19:12.128830+0000","last_unstale":"2024-09-21T03:19:13.120953+0000","last_undegraded":"2024-09-21T03:19:13.120953+0000","last_fullsized":"2024-09-21T03:19:13.120953+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:06.450432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104733+0000","last_change":"2024-09-21T03:19:11.108248+0000","last_active":"2024-09-21T03:19:13.104733+0000","last_peered":"2024-09-21T03:19:13.104733+0000","last_clean":"2024-09-21T03:19:13.104733+0000","last_became_active":"2024-09-21T03:19:11.107839+0000","last_became_peered":"2024-09-21T03:19:11.107839+0000","last_unstale":"2024-09-21T03:19:13.104733+0000","last_undegraded":"2024-09-21T03:19:13.104733+0000","last_fullsized":"2024-09-21T03:19:13.104733+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:43.984247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381830+0000","last_change":"2024-09-21T03:19:12.106769+0000","last_active":"2024-09-21T03:19:13.381830+0000","last_peered":"2024-09-21T03:19:13.381830+0000","last_clean":"2024-09-21T03:19:13.381830+0000","last_became_active":"2024-09-21T03:19:12.106423+0000","last_became_peered":"2024-09-21T03:19:12.106423+0000","last_unstale":"2024-09-21T03:19:13.381830+0000","last_undegraded":"2024-09-21T03:19:13.381830+0000","last_fullsized":"2024-09-21T03:19:13.381830+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:46.793926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104977+0000","last_change":"2024-09-21T03:19:11.117034+0000","last_active":"2024-09-21T03:19:13.104977+0000","last_peered":"2024-09-21T03:19:13.104977+0000","last_clean":"2024-09-21T03:19:13.104977+0000","last_became_active":"2024-09-21T03:19:11.116729+0000","last_became_peered":"2024-09-21T03:19:11.116729+0000","last_unstale":"2024-09-21T03:19:13.104977+0000","last_undegraded":"2024-09-21T03:19:13.104977+0000","last_fullsized":"2024-09-21T03:19:13.104977+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:10:00.681324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381579+0000","last_change":"2024-09-21T03:19:12.119850+0000","last_active":"2024-09-21T03:19:13.381579+0000","last_peered":"2024-09-21T03:19:13.381579+0000","last_clean":"2024-09-21T03:19:13.381579+0000","last_became_active":"2024-09-21T03:19:12.119239+0000","last_became_peered":"2024-09-21T03:19:12.119239+0000","last_unstale":"2024-09-21T03:19:13.381579+0000","last_undegraded":"2024-09-21T03:19:13.381579+0000","last_fullsized":"2024-09-21T03:19:13.381579+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:25:23.749492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T03:19:11.119204+0000","last_change":"2024-09-21T03:19:11.114966+0000","last_active":"2024-09-21T03:19:11.119204+0000","last_peered":"2024-09-21T03:19:11.119204+0000","last_clean":"2024-09-21T03:19:11.119204+0000","last_became_active":"2024-09-21T03:19:11.114605+0000","last_became_peered":"2024-09-21T03:19:11.114605+0000","last_unstale":"2024-09-21T03:19:11.119204+0000","last_undegraded":"2024-09-21T03:19:11.119204+0000","last_fullsized":"2024-09-21T03:19:11.119204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:36.793226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382249+0000","last_change":"2024-09-21T03:19:12.109364+0000","last_active":"2024-09-21T03:19:13.382249+0000","last_peered":"2024-09-21T03:19:13.382249+0000","last_clean":"2024-09-21T03:19:13.382249+0000","last_became_active":"2024-09-21T03:19:12.109039+0000","last_became_peered":"2024-09-21T03:19:12.109039+0000","last_unstale":"2024-09-21T03:19:13.382249+0000","last_undegraded":"2024-09-21T03:19:13.382249+0000","last_fullsized":"2024-09-21T03:19:13.382249+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:33.944043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.103590+0000","last_change":"2024-09-21T03:19:11.109672+0000","last_active":"2024-09-21T03:19:13.103590+0000","last_peered":"2024-09-21T03:19:13.103590+0000","last_clean":"2024-09-21T03:19:13.103590+0000","last_became_active":"2024-09-21T03:19:11.109093+0000","last_became_peered":"2024-09-21T03:19:11.109093+0000","last_unstale":"2024-09-21T03:19:13.103590+0000","last_undegraded":"2024-09-21T03:19:13.103590+0000","last_fullsized":"2024-09-21T03:19:13.103590+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:51.798449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381560+0000","last_change":"2024-09-21T03:19:12.106248+0000","last_active":"2024-09-21T03:19:13.381560+0000","last_peered":"2024-09-21T03:19:13.381560+0000","last_clean":"2024-09-21T03:19:13.381560+0000","last_became_active":"2024-09-21T03:19:12.105920+0000","last_became_peered":"2024-09-21T03:19:12.105920+0000","last_unstale":"2024-09-21T03:19:13.381560+0000","last_undegraded":"2024-09-21T03:19:13.381560+0000","last_fullsized":"2024-09-21T03:19:13.381560+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:36.590900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104635+0000","last_change":"2024-09-21T03:19:11.110445+0000","last_active":"2024-09-21T03:19:13.104635+0000","last_peered":"2024-09-21T03:19:13.104635+0000","last_clean":"2024-09-21T03:19:13.104635+0000","last_became_active":"2024-09-21T03:19:11.109764+0000","last_became_peered":"2024-09-21T03:19:11.109764+0000","last_unstale":"2024-09-21T03:19:13.104635+0000","last_undegraded":"2024-09-21T03:19:13.104635+0000","last_fullsized":"2024-09-21T03:19:13.104635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:55:44.185439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.101998+0000","last_change":"2024-09-21T03:19:12.115049+0000","last_active":"2024-09-21T03:19:13.101998+0000","last_peered":"2024-09-21T03:19:13.101998+0000","last_clean":"2024-09-21T03:19:13.101998+0000","last_became_active":"2024-09-21T03:19:12.114717+0000","last_became_peered":"2024-09-21T03:19:12.114717+0000","last_unstale":"2024-09-21T03:19:13.101998+0000","last_undegraded":"2024-09-21T03:19:13.101998+0000","last_fullsized":"2024-09-21T03:19:13.101998+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:04.243781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381893+0000","last_change":"2024-09-21T03:19:11.111243+0000","last_active":"2024-09-21T03:19:13.381893+0000","last_peered":"2024-09-21T03:19:13.381893+0000","last_clean":"2024-09-21T03:19:13.381893+0000","last_became_active":"2024-09-21T03:19:11.110915+0000","last_became_peered":"2024-09-21T03:19:11.110915+0000","last_unstale":"2024-09-21T03:19:13.381893+0000","last_undegraded":"2024-09-21T03:19:13.381893+0000","last_fullsized":"2024-09-21T03:19:13.381893+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:03:08.570891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381599+0000","last_change":"2024-09-21T03:19:12.124361+0000","last_active":"2024-09-21T03:19:13.381599+0000","last_peered":"2024-09-21T03:19:13.381599+0000","last_clean":"2024-09-21T03:19:13.381599+0000","last_became_active":"2024-09-21T03:19:12.124007+0000","last_became_peered":"2024-09-21T03:19:12.124007+0000","last_unstale":"2024-09-21T03:19:13.381599+0000","last_undegraded":"2024-09-21T03:19:13.381599+0000","last_fullsized":"2024-09-21T03:19:13.381599+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:56.039566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.121525+0000","last_change":"2024-09-21T03:19:11.109955+0000","last_active":"2024-09-21T03:19:13.121525+0000","last_peered":"2024-09-21T03:19:13.121525+0000","last_clean":"2024-09-21T03:19:13.121525+0000","last_became_active":"2024-09-21T03:19:11.109654+0000","last_became_peered":"2024-09-21T03:19:11.109654+0000","last_unstale":"2024-09-21T03:19:13.121525+0000","last_undegraded":"2024-09-21T03:19:13.121525+0000","last_fullsized":"2024-09-21T03:19:13.121525+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:46.019163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382620+0000","last_change":"2024-09-21T03:19:12.120031+0000","last_active":"2024-09-21T03:19:13.382620+0000","last_peered":"2024-09-21T03:19:13.382620+0000","last_clean":"2024-09-21T03:19:13.382620+0000","last_became_active":"2024-09-21T03:19:12.119600+0000","last_became_peered":"2024-09-21T03:19:12.119600+0000","last_unstale":"2024-09-21T03:19:13.382620+0000","last_undegraded":"2024-09-21T03:19:13.382620+0000","last_fullsized":"2024-09-21T03:19:13.382620+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:37:33.265939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T03:19:11.119254+0000","last_change":"2024-09-21T03:19:11.115218+0000","last_active":"2024-09-21T03:19:11.119254+0000","last_peered":"2024-09-21T03:19:11.119254+0000","last_clean":"2024-09-21T03:19:11.119254+0000","last_became_active":"2024-09-21T03:19:11.114683+0000","last_became_peered":"2024-09-21T03:19:11.114683+0000","last_unstale":"2024-09-21T03:19:11.119254+0000","last_undegraded":"2024-09-21T03:19:11.119254+0000","last_fullsized":"2024-09-21T03:19:11.119254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:05.460161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-21T03:19:11.106577+0000","last_change":"2024-09-21T03:19:11.106577+0000","last_active":"2024-09-21T03:19:11.088347+0000","last_peered":"2024-09-21T03:19:11.088347+0000","last_clean":"2024-09-21T03:19:11.088347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:19:11.106577+0000","last_undegraded":"2024-09-21T03:19:11.106577+0000","last_fullsized":"2024-09-21T03:19:11.106577+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.121131+0000","last_change":"2024-09-21T03:19:11.113832+0000","last_active":"2024-09-21T03:19:13.121131+0000","last_peered":"2024-09-21T03:19:13.121131+0000","last_clean":"2024-09-21T03:19:13.121131+0000","last_became_active":"2024-09-21T03:19:11.113316+0000","last_became_peered":"2024-09-21T03:19:11.113316+0000","last_unstale":"2024-09-21T03:19:13.121131+0000","last_undegraded":"2024-09-21T03:19:13.121131+0000","last_fullsized":"2024-09-21T03:19:13.121131+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:27.026756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.103465+0000","last_change":"2024-09-21T03:19:12.112077+0000","last_active":"2024-09-21T03:19:13.103465+0000","last_peered":"2024-09-21T03:19:13.103465+0000","last_clean":"2024-09-21T03:19:13.103465+0000","last_became_active":"2024-09-21T03:19:12.111703+0000","last_became_peered":"2024-09-21T03:19:12.111703+0000","last_unstale":"2024-09-21T03:19:13.103465+0000","last_undegraded":"2024-09-21T03:19:13.103465+0000","last_fullsized":"2024-09-21T03:19:13.103465+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:07.764584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-21T03:19:11.117568+0000","last_change":"2024-09-21T03:19:11.113950+0000","last_active":"2024-09-21T03:19:11.117568+0000","last_peered":"2024-09-21T03:19:11.117568+0000","last_clean":"2024-09-21T03:19:11.117568+0000","last_became_active":"2024-09-21T03:19:11.113642+0000","last_became_peered":"2024-09-21T03:19:11.113642+0000","last_unstale":"2024-09-21T03:19:11.117568+0000","last_undegraded":"2024-09-21T03:19:11.117568+0000","last_fullsized":"2024-09-21T03:19:11.117568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:30.646321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-21T03:19:11.107540+0000","last_change":"2024-09-21T03:19:11.107540+0000","last_active":"2024-09-21T03:19:11.088347+0000","last_peered":"2024-09-21T03:19:11.088347+0000","last_clean":"2024-09-21T03:19:11.088347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:19:11.107540+0000","last_undegraded":"2024-09-21T03:19:11.107540+0000","last_fullsized":"2024-09-21T03:19:11.107540+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.120766+0000","last_change":"2024-09-21T03:19:11.109571+0000","last_active":"2024-09-21T03:19:13.120766+0000","last_peered":"2024-09-21T03:19:13.120766+0000","last_clean":"2024-09-21T03:19:13.120766+0000","last_became_active":"2024-09-21T03:19:11.108784+0000","last_became_peered":"2024-09-21T03:19:11.108784+0000","last_unstale":"2024-09-21T03:19:13.120766+0000","last_undegraded":"2024-09-21T03:19:13.120766+0000","last_fullsized":"2024-09-21T03:19:13.120766+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:54:50.383426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381710+0000","last_change":"2024-09-21T03:19:12.108714+0000","last_active":"2024-09-21T03:19:13.381710+0000","last_peered":"2024-09-21T03:19:13.381710+0000","last_clean":"2024-09-21T03:19:13.381710+0000","last_became_active":"2024-09-21T03:19:12.108316+0000","last_became_peered":"2024-09-21T03:19:12.108316+0000","last_unstale":"2024-09-21T03:19:13.381710+0000","last_undegraded":"2024-09-21T03:19:13.381710+0000","last_fullsized":"2024-09-21T03:19:13.381710+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:19.212639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104747+0000","last_change":"2024-09-21T03:19:11.110080+0000","last_active":"2024-09-21T03:19:13.104747+0000","last_peered":"2024-09-21T03:19:13.104747+0000","last_clean":"2024-09-21T03:19:13.104747+0000","last_became_active":"2024-09-21T03:19:11.109409+0000","last_became_peered":"2024-09-21T03:19:11.109409+0000","last_unstale":"2024-09-21T03:19:13.104747+0000","last_undegraded":"2024-09-21T03:19:13.104747+0000","last_fullsized":"2024-09-21T03:19:13.104747+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:23:30.198368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104778+0000","last_change":"2024-09-21T03:19:12.120376+0000","last_active":"2024-09-21T03:19:13.104778+0000","last_peered":"2024-09-21T03:19:13.104778+0000","last_clean":"2024-09-21T03:19:13.104778+0000","last_became_active":"2024-09-21T03:19:12.118878+0000","last_became_peered":"2024-09-21T03:19:12.118878+0000","last_unstale":"2024-09-21T03:19:13.104778+0000","last_undegraded":"2024-09-21T03:19:13.104778+0000","last_fullsized":"2024-09-21T03:19:13.104778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:01.214721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381935+0000","last_change":"2024-09-21T03:19:11.115198+0000","last_active":"2024-09-21T03:19:13.381935+0000","last_peered":"2024-09-21T03:19:13.381935+0000","last_clean":"2024-09-21T03:19:13.381935+0000","last_became_active":"2024-09-21T03:19:11.114861+0000","last_became_peered":"2024-09-21T03:19:11.114861+0000","last_unstale":"2024-09-21T03:19:13.381935+0000","last_undegraded":"2024-09-21T03:19:13.381935+0000","last_fullsized":"2024-09-21T03:19:13.381935+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:10:24.624728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102385+0000","last_change":"2024-09-21T03:19:12.118074+0000","last_active":"2024-09-21T03:19:13.102385+0000","last_peered":"2024-09-21T03:19:13.102385+0000","last_clean":"2024-09-21T03:19:13.102385+0000","last_became_active":"2024-09-21T03:19:12.117752+0000","last_became_peered":"2024-09-21T03:19:12.117752+0000","last_unstale":"2024-09-21T03:19:13.102385+0000","last_undegraded":"2024-09-21T03:19:13.102385+0000","last_fullsized":"2024-09-21T03:19:13.102385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:00.596447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.103718+0000","last_change":"2024-09-21T03:19:11.109722+0000","last_active":"2024-09-21T03:19:13.103718+0000","last_peered":"2024-09-21T03:19:13.103718+0000","last_clean":"2024-09-21T03:19:13.103718+0000","last_became_active":"2024-09-21T03:19:11.109400+0000","last_became_peered":"2024-09-21T03:19:11.109400+0000","last_unstale":"2024-09-21T03:19:13.103718+0000","last_undegraded":"2024-09-21T03:19:13.103718+0000","last_fullsized":"2024-09-21T03:19:13.103718+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:23:30.198368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":132,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102882+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:19:13.102882+0000","last_peered":"2024-09-21T03:19:13.102882+0000","last_clean":"2024-09-21T03:19:13.102882+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:19:13.102882+0000","last_undegraded":"2024-09-21T03:19:13.102882+0000","last_fullsized":"2024-09-21T03:19:13.102882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509456,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":962560,"data_stored":728585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":385024,"data_stored":145043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":372736,"data_stored":138799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":385024,"data_stored":144531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":139761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":368640,"data_stored":138197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":393216,"data_stored":146061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":933888,"data_stored":715453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:19:16.837 INFO:tasks.ceph.ceph_manager.ceph:PG 5.29 is not active+clean 2024-09-21T03:19:16.837 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:19:11.107024+0000', 'last_change': '2024-09-21T03:19:11.107024+0000', 'last_active': '2024-09-21T03:19:11.088347+0000', 'last_peered': '2024-09-21T03:19:11.088347+0000', 'last_clean': '2024-09-21T03:19:11.088347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:19:11.107024+0000', 'last_undegraded': '2024-09-21T03:19:11.107024+0000', 'last_fullsized': '2024-09-21T03:19:11.107024+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:19:11.088347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:19:11.088347+0000', 'last_clean_scrub_stamp': '2024-09-21T03:19:11.088347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:19:16.837 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1e is not active+clean 2024-09-21T03:19:16.837 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:19:11.108357+0000', 'last_change': '2024-09-21T03:19:11.108357+0000', 'last_active': '2024-09-21T03:19:11.088347+0000', 'last_peered': '2024-09-21T03:19:11.088347+0000', 'last_clean': '2024-09-21T03:19:11.088347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:19:11.108357+0000', 'last_undegraded': '2024-09-21T03:19:11.108357+0000', 'last_fullsized': '2024-09-21T03:19:11.108357+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:19:11.088347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:19:11.088347+0000', 'last_clean_scrub_stamp': '2024-09-21T03:19:11.088347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:19:16.838 INFO:tasks.ceph.ceph_manager.ceph:PG 5.5 is not active+clean 2024-09-21T03:19:16.838 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:19:11.106577+0000', 'last_change': '2024-09-21T03:19:11.106577+0000', 'last_active': '2024-09-21T03:19:11.088347+0000', 'last_peered': '2024-09-21T03:19:11.088347+0000', 'last_clean': '2024-09-21T03:19:11.088347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:19:11.106577+0000', 'last_undegraded': '2024-09-21T03:19:11.106577+0000', 'last_fullsized': '2024-09-21T03:19:11.106577+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:19:11.088347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:19:11.088347+0000', 'last_clean_scrub_stamp': '2024-09-21T03:19:11.088347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:19:16.838 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3 is not active+clean 2024-09-21T03:19:16.838 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:19:11.107540+0000', 'last_change': '2024-09-21T03:19:11.107540+0000', 'last_active': '2024-09-21T03:19:11.088347+0000', 'last_peered': '2024-09-21T03:19:11.088347+0000', 'last_clean': '2024-09-21T03:19:11.088347+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:19:11.107540+0000', 'last_undegraded': '2024-09-21T03:19:11.107540+0000', 'last_fullsized': '2024-09-21T03:19:11.107540+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:19:11.088347+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:19:11.088347+0000', 'last_clean_scrub_stamp': '2024-09-21T03:19:11.088347+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:19:16.838 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T03:19:16.921 INFO:tasks.ceph.mds.a.smithi105.stderr:2024-09-21T03:19:16.918+0000 7f666b26f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T03:19:16.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.983+0000 7f492f1c3640 1 -- 172.21.15.105:0/3925304323 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4928074560 msgr2=0x7f49280cfe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:16.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.983+0000 7f492f1c3640 1 --2- 172.21.15.105:0/3925304323 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4928074560 0x7f49280cfe60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f49280749e0 tx=0x7f492002a8b0 comp rx=0 tx=0).stop 2024-09-21T03:19:16.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.983+0000 7f492f1c3640 1 -- 172.21.15.105:0/3925304323 shutdown_connections 2024-09-21T03:19:16.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.983+0000 7f492f1c3640 1 --2- 172.21.15.105:0/3925304323 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4928074560 0x7f49280cfe60 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:16.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.983+0000 7f492f1c3640 1 --2- 172.21.15.105:0/3925304323 >> v2:172.21.15.162:3300/0 conn(0x7f4928144270 0x7f49280b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:16.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.983+0000 7f492f1c3640 1 -- 172.21.15.105:0/3925304323 >> 172.21.15.105:0/3925304323 conn(0x7f49280d15f0 msgr2=0x7f4928073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:16.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.983+0000 7f492f1c3640 1 -- 172.21.15.105:0/3925304323 shutdown_connections 2024-09-21T03:19:16.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.983+0000 7f492f1c3640 1 -- 172.21.15.105:0/3925304323 wait complete. 2024-09-21T03:19:16.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.985+0000 7f492f1c3640 1 Processor -- start 2024-09-21T03:19:16.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.985+0000 7f492f1c3640 1 -- start start 2024-09-21T03:19:16.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.986+0000 7f492f1c3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4928142270 0x7f4928140d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:16.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.986+0000 7f492f1c3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4928144270 0x7f492815e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:16.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.986+0000 7f492f1c3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f492815e5d0 0x7f492815a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:16.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.986+0000 7f492f1c3640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4928142800 con 0x7f4928144270 2024-09-21T03:19:16.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.986+0000 7f492f1c3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4928142680 con 0x7f492815e5d0 2024-09-21T03:19:16.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.986+0000 7f492f1c3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4928142980 con 0x7f4928142270 2024-09-21T03:19:16.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.986+0000 7f491ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4928144270 0x7f492815e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:16.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.986+0000 7f491ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4928144270 0x7f492815e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51306/0 (socket says 172.21.15.105:51306) 2024-09-21T03:19:16.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.986+0000 7f491ffff640 1 -- 172.21.15.105:0/1379713955 learned_addr learned my addr 172.21.15.105:0/1379713955 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:16.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.986+0000 7f492cf5f640 1 --2- 172.21.15.105:0/1379713955 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4928142270 0x7f4928140d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:16.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.986+0000 7f492d760640 1 --2- 172.21.15.105:0/1379713955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f492815e5d0 0x7f492815a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:16.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.987+0000 7f491ffff640 1 -- 172.21.15.105:0/1379713955 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4928142270 msgr2=0x7f4928140d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:16.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.987+0000 7f491ffff640 1 --2- 172.21.15.105:0/1379713955 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4928142270 0x7f4928140d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:16.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.987+0000 7f491ffff640 1 -- 172.21.15.105:0/1379713955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f492815e5d0 msgr2=0x7f492815a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:16.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.987+0000 7f491ffff640 1 --2- 172.21.15.105:0/1379713955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f492815e5d0 0x7f492815a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:16.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.987+0000 7f491ffff640 1 -- 172.21.15.105:0/1379713955 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f492813ee60 con 0x7f4928144270 2024-09-21T03:19:16.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.987+0000 7f491ffff640 1 --2- 172.21.15.105:0/1379713955 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4928144270 0x7f492815e090 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f491800e660 tx=0x7f491800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:16.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.987+0000 7f491d7fa640 1 -- 172.21.15.105:0/1379713955 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4918015070 con 0x7f4928144270 2024-09-21T03:19:16.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.987+0000 7f491d7fa640 1 -- 172.21.15.105:0/1379713955 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4918005360 con 0x7f4928144270 2024-09-21T03:19:16.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.987+0000 7f491d7fa640 1 -- 172.21.15.105:0/1379713955 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4918001920 con 0x7f4928144270 2024-09-21T03:19:16.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.987+0000 7f492f1c3640 1 -- 172.21.15.105:0/1379713955 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f492813f140 con 0x7f4928144270 2024-09-21T03:19:16.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.987+0000 7f492f1c3640 1 -- 172.21.15.105:0/1379713955 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f492813f700 con 0x7f4928144270 2024-09-21T03:19:16.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.988+0000 7f492f1c3640 1 -- 172.21.15.105:0/1379713955 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49280cdd40 con 0x7f4928144270 2024-09-21T03:19:16.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.989+0000 7f491d7fa640 1 -- 172.21.15.105:0/1379713955 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4918018070 con 0x7f4928144270 2024-09-21T03:19:16.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.989+0000 7f491d7fa640 1 --2- 172.21.15.105:0/1379713955 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4914078b90 0x7f491407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:16.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.989+0000 7f491d7fa640 1 -- 172.21.15.105:0/1379713955 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f491809cfe0 con 0x7f4928144270 2024-09-21T03:19:16.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.990+0000 7f492cf5f640 1 --2- 172.21.15.105:0/1379713955 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4914078b90 0x7f491407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:16.993 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.990+0000 7f492cf5f640 1 --2- 172.21.15.105:0/1379713955 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4914078b90 0x7f491407b0a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4924005fd0 tx=0x7f4924005850 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:16.996 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:16.994+0000 7f491d7fa640 1 -- 172.21.15.105:0/1379713955 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f49280cdd40 con 0x7f4928144270 2024-09-21T03:19:17.244 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.242+0000 7f492f1c3640 1 -- 172.21.15.105:0/1379713955 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f49280d0640 con 0x7f4928144270 2024-09-21T03:19:17.245 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.242+0000 7f491d7fa640 1 -- 172.21.15.105:0/1379713955 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2753 (secure 0 0 0) 0x7f4918065400 con 0x7f4928144270 2024-09-21T03:19:17.245 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:19:17.245 INFO:teuthology.orchestra.run.smithi105.stdout:{"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":72,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":34,"num_osds":8,"num_up_osds":8,"osd_up_since":1726888698,"num_in_osds":8,"osd_in_since":1726888688,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":93},{"state_name":"creating+peering","count":4}],"num_pgs":97,"num_pools":3,"num_objects":22,"data_bytes":592778,"bytes_used":225628160,"bytes_avail":772868485120,"bytes_total":773094113280,"inactive_pgs_ratio":0.041237112134695053,"write_bytes_sec":2756,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":17,"btime":"2024-09-21T03:19:15:120921+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4902}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-21T03:19:11.289044+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T03:19:17.247 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.244+0000 7f492f1c3640 1 -- 172.21.15.105:0/1379713955 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4914078b90 msgr2=0x7f491407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:17.247 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.244+0000 7f492f1c3640 1 --2- 172.21.15.105:0/1379713955 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4914078b90 0x7f491407b0a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4924005fd0 tx=0x7f4924005850 comp rx=0 tx=0).stop 2024-09-21T03:19:17.247 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.244+0000 7f492f1c3640 1 -- 172.21.15.105:0/1379713955 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4928144270 msgr2=0x7f492815e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:17.247 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.244+0000 7f492f1c3640 1 --2- 172.21.15.105:0/1379713955 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4928144270 0x7f492815e090 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f491800e660 tx=0x7f491800eb20 comp rx=0 tx=0).stop 2024-09-21T03:19:17.247 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.244+0000 7f492f1c3640 1 -- 172.21.15.105:0/1379713955 shutdown_connections 2024-09-21T03:19:17.247 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.244+0000 7f492f1c3640 1 --2- 172.21.15.105:0/1379713955 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4914078b90 0x7f491407b0a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:17.247 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.244+0000 7f492f1c3640 1 --2- 172.21.15.105:0/1379713955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f492815e5d0 0x7f492815a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:17.248 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.244+0000 7f492f1c3640 1 --2- 172.21.15.105:0/1379713955 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4928144270 0x7f492815e090 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:17.248 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.244+0000 7f492f1c3640 1 --2- 172.21.15.105:0/1379713955 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4928142270 0x7f4928140d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:17.248 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.245+0000 7f492f1c3640 1 -- 172.21.15.105:0/1379713955 >> 172.21.15.105:0/1379713955 conn(0x7f49280d15f0 msgr2=0x7f4928143790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:17.248 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.245+0000 7f492f1c3640 1 -- 172.21.15.105:0/1379713955 shutdown_connections 2024-09-21T03:19:17.248 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.245+0000 7f492f1c3640 1 -- 172.21.15.105:0/1379713955 wait complete. 2024-09-21T03:19:17.258 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-21T03:19:17.259 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:19:17.371 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.368+0000 7f8e2dd8a640 1 -- 172.21.15.105:0/260043429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e281620e0 msgr2=0x7f8e280b5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:17.371 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.368+0000 7f8e2dd8a640 1 --2- 172.21.15.105:0/260043429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e281620e0 0x7f8e280b5fa0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8e2808c7c0 tx=0x7f8e1802a5f0 comp rx=0 tx=0).stop 2024-09-21T03:19:17.371 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.368+0000 7f8e2dd8a640 1 -- 172.21.15.105:0/260043429 shutdown_connections 2024-09-21T03:19:17.371 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.368+0000 7f8e2dd8a640 1 --2- 172.21.15.105:0/260043429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e281620e0 0x7f8e280b5fa0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:17.371 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.368+0000 7f8e2dd8a640 1 --2- 172.21.15.105:0/260043429 >> v2:172.21.15.162:3300/0 conn(0x7f8e280b9d00 0x7f8e280cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:17.371 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.368+0000 7f8e2dd8a640 1 -- 172.21.15.105:0/260043429 >> 172.21.15.105:0/260043429 conn(0x7f8e2809d870 msgr2=0x7f8e280d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:17.371 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.368+0000 7f8e2dd8a640 1 -- 172.21.15.105:0/260043429 shutdown_connections 2024-09-21T03:19:17.371 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.368+0000 7f8e2dd8a640 1 -- 172.21.15.105:0/260043429 wait complete. 2024-09-21T03:19:17.372 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.370+0000 7f8e2dd8a640 1 Processor -- start 2024-09-21T03:19:17.372 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.370+0000 7f8e2dd8a640 1 -- start start 2024-09-21T03:19:17.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.371+0000 7f8e2dd8a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e280b64e0 0x7f8e281508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:17.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.371+0000 7f8e2dd8a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e280b9d00 0x7f8e280ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:17.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.371+0000 7f8e2dd8a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e281620e0 0x7f8e280cd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:17.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.371+0000 7f8e2dd8a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8e280d38c0 con 0x7f8e280b9d00 2024-09-21T03:19:17.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.371+0000 7f8e2dd8a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8e280d3740 con 0x7f8e281620e0 2024-09-21T03:19:17.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.371+0000 7f8e2dd8a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8e2806e5b0 con 0x7f8e280b64e0 2024-09-21T03:19:17.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.371+0000 7f8e26ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e280b9d00 0x7f8e280ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:17.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.371+0000 7f8e26ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e280b9d00 0x7f8e280ccbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51328/0 (socket says 172.21.15.105:51328) 2024-09-21T03:19:17.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.371+0000 7f8e26ffd640 1 -- 172.21.15.105:0/951411714 learned_addr learned my addr 172.21.15.105:0/951411714 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:17.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.371+0000 7f8e27fff640 1 --2- 172.21.15.105:0/951411714 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e281620e0 0x7f8e280cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:17.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.372+0000 7f8e277fe640 1 --2- 172.21.15.105:0/951411714 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e280b64e0 0x7f8e281508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:17.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.372+0000 7f8e26ffd640 1 -- 172.21.15.105:0/951411714 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e280b64e0 msgr2=0x7f8e281508d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:17.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.372+0000 7f8e26ffd640 1 --2- 172.21.15.105:0/951411714 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e280b64e0 0x7f8e281508d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:17.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.372+0000 7f8e26ffd640 1 -- 172.21.15.105:0/951411714 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e281620e0 msgr2=0x7f8e280cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:17.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.372+0000 7f8e26ffd640 1 --2- 172.21.15.105:0/951411714 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e281620e0 0x7f8e280cd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:17.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.372+0000 7f8e26ffd640 1 -- 172.21.15.105:0/951411714 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e280cada0 con 0x7f8e280b9d00 2024-09-21T03:19:17.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.372+0000 7f8e26ffd640 1 --2- 172.21.15.105:0/951411714 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e280b9d00 0x7f8e280ccbf0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8e18034040 tx=0x7f8e18003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:17.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.372+0000 7f8e1ffff640 1 -- 172.21.15.105:0/951411714 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1803e030 con 0x7f8e280b9d00 2024-09-21T03:19:17.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.372+0000 7f8e1ffff640 1 -- 172.21.15.105:0/951411714 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e18003e00 con 0x7f8e280b9d00 2024-09-21T03:19:17.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.372+0000 7f8e2dd8a640 1 -- 172.21.15.105:0/951411714 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e280cd9e0 con 0x7f8e280b9d00 2024-09-21T03:19:17.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.372+0000 7f8e1ffff640 1 -- 172.21.15.105:0/951411714 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e18035040 con 0x7f8e280b9d00 2024-09-21T03:19:17.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.372+0000 7f8e2dd8a640 1 -- 172.21.15.105:0/951411714 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e280c90d0 con 0x7f8e280b9d00 2024-09-21T03:19:17.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.373+0000 7f8e2dd8a640 1 -- 172.21.15.105:0/951411714 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e280cab10 con 0x7f8e280b9d00 2024-09-21T03:19:17.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.374+0000 7f8e1ffff640 1 -- 172.21.15.105:0/951411714 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8e18041030 con 0x7f8e280b9d00 2024-09-21T03:19:17.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.374+0000 7f8e1ffff640 1 --2- 172.21.15.105:0/951411714 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8e08078b90 0x7f8e0807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:17.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.375+0000 7f8e1ffff640 1 -- 172.21.15.105:0/951411714 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f8e180bb5c0 con 0x7f8e280b9d00 2024-09-21T03:19:17.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.375+0000 7f8e277fe640 1 --2- 172.21.15.105:0/951411714 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8e08078b90 0x7f8e0807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:17.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.375+0000 7f8e277fe640 1 --2- 172.21.15.105:0/951411714 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8e08078b90 0x7f8e0807b0a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8e1000bb30 tx=0x7f8e1000b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:17.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.379+0000 7f8e1ffff640 1 -- 172.21.15.105:0/951411714 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8e180833b0 con 0x7f8e280b9d00 2024-09-21T03:19:17.556 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.554+0000 7f8e2dd8a640 1 -- 172.21.15.105:0/951411714 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8e2806eb40 con 0x7f8e08078b90 2024-09-21T03:19:17.561 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.559+0000 7f8e1ffff640 1 -- 172.21.15.105:0/951411714 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251939 (secure 0 0 0) 0x7f8e2806eb40 con 0x7f8e08078b90 2024-09-21T03:19:17.564 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:19:17.565 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:19:17.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.562+0000 7f8e2dd8a640 1 -- 172.21.15.105:0/951411714 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8e08078b90 msgr2=0x7f8e0807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:17.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.562+0000 7f8e2dd8a640 1 --2- 172.21.15.105:0/951411714 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8e08078b90 0x7f8e0807b0a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8e1000bb30 tx=0x7f8e1000b2e0 comp rx=0 tx=0).stop 2024-09-21T03:19:17.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.562+0000 7f8e2dd8a640 1 -- 172.21.15.105:0/951411714 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e280b9d00 msgr2=0x7f8e280ccbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:17.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.562+0000 7f8e2dd8a640 1 --2- 172.21.15.105:0/951411714 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e280b9d00 0x7f8e280ccbf0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8e18034040 tx=0x7f8e18003910 comp rx=0 tx=0).stop 2024-09-21T03:19:17.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.562+0000 7f8e2dd8a640 1 -- 172.21.15.105:0/951411714 shutdown_connections 2024-09-21T03:19:17.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.562+0000 7f8e2dd8a640 1 --2- 172.21.15.105:0/951411714 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8e08078b90 0x7f8e0807b0a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:17.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.562+0000 7f8e2dd8a640 1 --2- 172.21.15.105:0/951411714 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e281620e0 0x7f8e280cd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:17.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.562+0000 7f8e2dd8a640 1 --2- 172.21.15.105:0/951411714 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e280b9d00 0x7f8e280ccbf0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:17.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.562+0000 7f8e2dd8a640 1 --2- 172.21.15.105:0/951411714 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e280b64e0 0x7f8e281508d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:17.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.562+0000 7f8e2dd8a640 1 -- 172.21.15.105:0/951411714 >> 172.21.15.105:0/951411714 conn(0x7f8e2809d870 msgr2=0x7f8e2806dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:17.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.562+0000 7f8e2dd8a640 1 -- 172.21.15.105:0/951411714 shutdown_connections 2024-09-21T03:19:17.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:17.562+0000 7f8e2dd8a640 1 -- 172.21.15.105:0/951411714 wait complete. 2024-09-21T03:19:17.576 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2024-09-21T03:19:17.290312+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224544,"kb_used_data":4120,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750176,"statfs":{"total":773094113280,"available":772864180224,"internally_reserved":0,"allocated":4218880,"data_stored":2315772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.195387"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104116+0000","last_change":"2024-09-21T03:19:12.125859+0000","last_active":"2024-09-21T03:19:13.104116+0000","last_peered":"2024-09-21T03:19:13.104116+0000","last_clean":"2024-09-21T03:19:13.104116+0000","last_became_active":"2024-09-21T03:19:12.125455+0000","last_became_peered":"2024-09-21T03:19:12.125455+0000","last_unstale":"2024-09-21T03:19:13.104116+0000","last_undegraded":"2024-09-21T03:19:13.104116+0000","last_fullsized":"2024-09-21T03:19:13.104116+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:34.607404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382017+0000","last_change":"2024-09-21T03:19:12.109132+0000","last_active":"2024-09-21T03:19:13.382017+0000","last_peered":"2024-09-21T03:19:13.382017+0000","last_clean":"2024-09-21T03:19:13.382017+0000","last_became_active":"2024-09-21T03:19:12.108829+0000","last_became_peered":"2024-09-21T03:19:12.108829+0000","last_unstale":"2024-09-21T03:19:13.382017+0000","last_undegraded":"2024-09-21T03:19:13.382017+0000","last_fullsized":"2024-09-21T03:19:13.382017+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:00.596447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382502+0000","last_change":"2024-09-21T03:19:12.131941+0000","last_active":"2024-09-21T03:19:13.382502+0000","last_peered":"2024-09-21T03:19:13.382502+0000","last_clean":"2024-09-21T03:19:13.382502+0000","last_became_active":"2024-09-21T03:19:12.131458+0000","last_became_peered":"2024-09-21T03:19:12.131458+0000","last_unstale":"2024-09-21T03:19:13.382502+0000","last_undegraded":"2024-09-21T03:19:13.382502+0000","last_fullsized":"2024-09-21T03:19:13.382502+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:09:21.244381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.121028+0000","last_change":"2024-09-21T03:19:12.122867+0000","last_active":"2024-09-21T03:19:13.121028+0000","last_peered":"2024-09-21T03:19:13.121028+0000","last_clean":"2024-09-21T03:19:13.121028+0000","last_became_active":"2024-09-21T03:19:12.122533+0000","last_became_peered":"2024-09-21T03:19:12.122533+0000","last_unstale":"2024-09-21T03:19:13.121028+0000","last_undegraded":"2024-09-21T03:19:13.121028+0000","last_fullsized":"2024-09-21T03:19:13.121028+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:59.601871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382009+0000","last_change":"2024-09-21T03:19:12.111226+0000","last_active":"2024-09-21T03:19:13.382009+0000","last_peered":"2024-09-21T03:19:13.382009+0000","last_clean":"2024-09-21T03:19:13.382009+0000","last_became_active":"2024-09-21T03:19:12.110915+0000","last_became_peered":"2024-09-21T03:19:12.110915+0000","last_unstale":"2024-09-21T03:19:13.382009+0000","last_undegraded":"2024-09-21T03:19:13.382009+0000","last_fullsized":"2024-09-21T03:19:13.382009+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:52:42.610167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382578+0000","last_change":"2024-09-21T03:19:12.121447+0000","last_active":"2024-09-21T03:19:13.382578+0000","last_peered":"2024-09-21T03:19:13.382578+0000","last_clean":"2024-09-21T03:19:13.382578+0000","last_became_active":"2024-09-21T03:19:12.121157+0000","last_became_peered":"2024-09-21T03:19:12.121157+0000","last_unstale":"2024-09-21T03:19:13.382578+0000","last_undegraded":"2024-09-21T03:19:13.382578+0000","last_fullsized":"2024-09-21T03:19:13.382578+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:09.757925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102313+0000","last_change":"2024-09-21T03:19:12.115833+0000","last_active":"2024-09-21T03:19:13.102313+0000","last_peered":"2024-09-21T03:19:13.102313+0000","last_clean":"2024-09-21T03:19:13.102313+0000","last_became_active":"2024-09-21T03:19:12.115528+0000","last_became_peered":"2024-09-21T03:19:12.115528+0000","last_unstale":"2024-09-21T03:19:13.102313+0000","last_undegraded":"2024-09-21T03:19:13.102313+0000","last_fullsized":"2024-09-21T03:19:13.102313+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:27.762838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102363+0000","last_change":"2024-09-21T03:19:12.116051+0000","last_active":"2024-09-21T03:19:13.102363+0000","last_peered":"2024-09-21T03:19:13.102363+0000","last_clean":"2024-09-21T03:19:13.102363+0000","last_became_active":"2024-09-21T03:19:12.115701+0000","last_became_peered":"2024-09-21T03:19:12.115701+0000","last_unstale":"2024-09-21T03:19:13.102363+0000","last_undegraded":"2024-09-21T03:19:13.102363+0000","last_fullsized":"2024-09-21T03:19:13.102363+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:07:30.596468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104945+0000","last_change":"2024-09-21T03:19:12.119289+0000","last_active":"2024-09-21T03:19:13.104945+0000","last_peered":"2024-09-21T03:19:13.104945+0000","last_clean":"2024-09-21T03:19:13.104945+0000","last_became_active":"2024-09-21T03:19:12.118634+0000","last_became_peered":"2024-09-21T03:19:12.118634+0000","last_unstale":"2024-09-21T03:19:13.104945+0000","last_undegraded":"2024-09-21T03:19:13.104945+0000","last_fullsized":"2024-09-21T03:19:13.104945+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:23.665081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.121392+0000","last_change":"2024-09-21T03:19:12.116146+0000","last_active":"2024-09-21T03:19:13.121392+0000","last_peered":"2024-09-21T03:19:13.121392+0000","last_clean":"2024-09-21T03:19:13.121392+0000","last_became_active":"2024-09-21T03:19:12.115742+0000","last_became_peered":"2024-09-21T03:19:12.115742+0000","last_unstale":"2024-09-21T03:19:13.121392+0000","last_undegraded":"2024-09-21T03:19:13.121392+0000","last_fullsized":"2024-09-21T03:19:13.121392+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:58.031199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102384+0000","last_change":"2024-09-21T03:19:12.118702+0000","last_active":"2024-09-21T03:19:13.102384+0000","last_peered":"2024-09-21T03:19:13.102384+0000","last_clean":"2024-09-21T03:19:13.102384+0000","last_became_active":"2024-09-21T03:19:12.118391+0000","last_became_peered":"2024-09-21T03:19:12.118391+0000","last_unstale":"2024-09-21T03:19:13.102384+0000","last_undegraded":"2024-09-21T03:19:13.102384+0000","last_fullsized":"2024-09-21T03:19:13.102384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:57.800009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382162+0000","last_change":"2024-09-21T03:19:12.127366+0000","last_active":"2024-09-21T03:19:13.382162+0000","last_peered":"2024-09-21T03:19:13.382162+0000","last_clean":"2024-09-21T03:19:13.382162+0000","last_became_active":"2024-09-21T03:19:12.127036+0000","last_became_peered":"2024-09-21T03:19:12.127036+0000","last_unstale":"2024-09-21T03:19:13.382162+0000","last_undegraded":"2024-09-21T03:19:13.382162+0000","last_fullsized":"2024-09-21T03:19:13.382162+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:49.317940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382211+0000","last_change":"2024-09-21T03:19:12.108265+0000","last_active":"2024-09-21T03:19:13.382211+0000","last_peered":"2024-09-21T03:19:13.382211+0000","last_clean":"2024-09-21T03:19:13.382211+0000","last_became_active":"2024-09-21T03:19:12.107908+0000","last_became_peered":"2024-09-21T03:19:12.107908+0000","last_unstale":"2024-09-21T03:19:13.382211+0000","last_undegraded":"2024-09-21T03:19:13.382211+0000","last_fullsized":"2024-09-21T03:19:13.382211+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:02.577948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382498+0000","last_change":"2024-09-21T03:19:12.110175+0000","last_active":"2024-09-21T03:19:13.382498+0000","last_peered":"2024-09-21T03:19:13.382498+0000","last_clean":"2024-09-21T03:19:13.382498+0000","last_became_active":"2024-09-21T03:19:12.109849+0000","last_became_peered":"2024-09-21T03:19:12.109849+0000","last_unstale":"2024-09-21T03:19:13.382498+0000","last_undegraded":"2024-09-21T03:19:13.382498+0000","last_fullsized":"2024-09-21T03:19:13.382498+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:34.525061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382239+0000","last_change":"2024-09-21T03:19:12.128786+0000","last_active":"2024-09-21T03:19:13.382239+0000","last_peered":"2024-09-21T03:19:13.382239+0000","last_clean":"2024-09-21T03:19:13.382239+0000","last_became_active":"2024-09-21T03:19:12.128433+0000","last_became_peered":"2024-09-21T03:19:12.128433+0000","last_unstale":"2024-09-21T03:19:13.382239+0000","last_undegraded":"2024-09-21T03:19:13.382239+0000","last_fullsized":"2024-09-21T03:19:13.382239+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:57.800009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.103044+0000","last_change":"2024-09-21T03:19:12.114204+0000","last_active":"2024-09-21T03:19:13.103044+0000","last_peered":"2024-09-21T03:19:13.103044+0000","last_clean":"2024-09-21T03:19:13.103044+0000","last_became_active":"2024-09-21T03:19:12.113864+0000","last_became_peered":"2024-09-21T03:19:12.113864+0000","last_unstale":"2024-09-21T03:19:13.103044+0000","last_undegraded":"2024-09-21T03:19:13.103044+0000","last_fullsized":"2024-09-21T03:19:13.103044+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:06.048604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102949+0000","last_change":"2024-09-21T03:19:12.123129+0000","last_active":"2024-09-21T03:19:13.102949+0000","last_peered":"2024-09-21T03:19:13.102949+0000","last_clean":"2024-09-21T03:19:13.102949+0000","last_became_active":"2024-09-21T03:19:12.122781+0000","last_became_peered":"2024-09-21T03:19:12.122781+0000","last_unstale":"2024-09-21T03:19:13.102949+0000","last_undegraded":"2024-09-21T03:19:13.102949+0000","last_fullsized":"2024-09-21T03:19:13.102949+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:48.519582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382143+0000","last_change":"2024-09-21T03:19:12.118599+0000","last_active":"2024-09-21T03:19:13.382143+0000","last_peered":"2024-09-21T03:19:13.382143+0000","last_clean":"2024-09-21T03:19:13.382143+0000","last_became_active":"2024-09-21T03:19:12.118319+0000","last_became_peered":"2024-09-21T03:19:12.118319+0000","last_unstale":"2024-09-21T03:19:13.382143+0000","last_undegraded":"2024-09-21T03:19:13.382143+0000","last_fullsized":"2024-09-21T03:19:13.382143+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:58.905425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381899+0000","last_change":"2024-09-21T03:19:12.121041+0000","last_active":"2024-09-21T03:19:13.381899+0000","last_peered":"2024-09-21T03:19:13.381899+0000","last_clean":"2024-09-21T03:19:13.381899+0000","last_became_active":"2024-09-21T03:19:12.119726+0000","last_became_peered":"2024-09-21T03:19:12.119726+0000","last_unstale":"2024-09-21T03:19:13.381899+0000","last_undegraded":"2024-09-21T03:19:13.381899+0000","last_fullsized":"2024-09-21T03:19:13.381899+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:45:41.300137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381977+0000","last_change":"2024-09-21T03:19:12.120864+0000","last_active":"2024-09-21T03:19:13.381977+0000","last_peered":"2024-09-21T03:19:13.381977+0000","last_clean":"2024-09-21T03:19:13.381977+0000","last_became_active":"2024-09-21T03:19:12.120558+0000","last_became_peered":"2024-09-21T03:19:12.120558+0000","last_unstale":"2024-09-21T03:19:13.381977+0000","last_undegraded":"2024-09-21T03:19:13.381977+0000","last_fullsized":"2024-09-21T03:19:13.381977+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:36.934721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104275+0000","last_change":"2024-09-21T03:19:12.119909+0000","last_active":"2024-09-21T03:19:13.104275+0000","last_peered":"2024-09-21T03:19:13.104275+0000","last_clean":"2024-09-21T03:19:13.104275+0000","last_became_active":"2024-09-21T03:19:12.119529+0000","last_became_peered":"2024-09-21T03:19:12.119529+0000","last_unstale":"2024-09-21T03:19:13.104275+0000","last_undegraded":"2024-09-21T03:19:13.104275+0000","last_fullsized":"2024-09-21T03:19:13.104275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:38.291868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104702+0000","last_change":"2024-09-21T03:19:12.119190+0000","last_active":"2024-09-21T03:19:13.104702+0000","last_peered":"2024-09-21T03:19:13.104702+0000","last_clean":"2024-09-21T03:19:13.104702+0000","last_became_active":"2024-09-21T03:19:12.118617+0000","last_became_peered":"2024-09-21T03:19:12.118617+0000","last_unstale":"2024-09-21T03:19:13.104702+0000","last_undegraded":"2024-09-21T03:19:13.104702+0000","last_fullsized":"2024-09-21T03:19:13.104702+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:38.040137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.118240+0000","last_change":"2024-09-21T03:19:12.117381+0000","last_active":"2024-09-21T03:19:13.118240+0000","last_peered":"2024-09-21T03:19:13.118240+0000","last_clean":"2024-09-21T03:19:13.118240+0000","last_became_active":"2024-09-21T03:19:12.116767+0000","last_became_peered":"2024-09-21T03:19:12.116767+0000","last_unstale":"2024-09-21T03:19:13.118240+0000","last_undegraded":"2024-09-21T03:19:13.118240+0000","last_fullsized":"2024-09-21T03:19:13.118240+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:00.003593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382111+0000","last_change":"2024-09-21T03:19:12.123887+0000","last_active":"2024-09-21T03:19:13.382111+0000","last_peered":"2024-09-21T03:19:13.382111+0000","last_clean":"2024-09-21T03:19:13.382111+0000","last_became_active":"2024-09-21T03:19:12.123560+0000","last_became_peered":"2024-09-21T03:19:12.123560+0000","last_unstale":"2024-09-21T03:19:13.382111+0000","last_undegraded":"2024-09-21T03:19:13.382111+0000","last_fullsized":"2024-09-21T03:19:13.382111+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:27.762838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.121436+0000","last_change":"2024-09-21T03:19:12.116939+0000","last_active":"2024-09-21T03:19:13.121436+0000","last_peered":"2024-09-21T03:19:13.121436+0000","last_clean":"2024-09-21T03:19:13.121436+0000","last_became_active":"2024-09-21T03:19:12.116637+0000","last_became_peered":"2024-09-21T03:19:12.116637+0000","last_unstale":"2024-09-21T03:19:13.121436+0000","last_undegraded":"2024-09-21T03:19:13.121436+0000","last_fullsized":"2024-09-21T03:19:13.121436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:01.049780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382264+0000","last_change":"2024-09-21T03:19:12.117324+0000","last_active":"2024-09-21T03:19:13.382264+0000","last_peered":"2024-09-21T03:19:13.382264+0000","last_clean":"2024-09-21T03:19:13.382264+0000","last_became_active":"2024-09-21T03:19:12.117003+0000","last_became_peered":"2024-09-21T03:19:12.117003+0000","last_unstale":"2024-09-21T03:19:13.382264+0000","last_undegraded":"2024-09-21T03:19:13.382264+0000","last_fullsized":"2024-09-21T03:19:13.382264+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:58.393209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.121300+0000","last_change":"2024-09-21T03:19:12.121597+0000","last_active":"2024-09-21T03:19:13.121300+0000","last_peered":"2024-09-21T03:19:13.121300+0000","last_clean":"2024-09-21T03:19:13.121300+0000","last_became_active":"2024-09-21T03:19:12.121311+0000","last_became_peered":"2024-09-21T03:19:12.121311+0000","last_unstale":"2024-09-21T03:19:13.121300+0000","last_undegraded":"2024-09-21T03:19:13.121300+0000","last_fullsized":"2024-09-21T03:19:13.121300+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:59.556293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382433+0000","last_change":"2024-09-21T03:19:12.121332+0000","last_active":"2024-09-21T03:19:13.382433+0000","last_peered":"2024-09-21T03:19:13.382433+0000","last_clean":"2024-09-21T03:19:13.382433+0000","last_became_active":"2024-09-21T03:19:12.120078+0000","last_became_peered":"2024-09-21T03:19:12.120078+0000","last_unstale":"2024-09-21T03:19:13.382433+0000","last_undegraded":"2024-09-21T03:19:13.382433+0000","last_fullsized":"2024-09-21T03:19:13.382433+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:18:47.580493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104544+0000","last_change":"2024-09-21T03:19:12.124510+0000","last_active":"2024-09-21T03:19:13.104544+0000","last_peered":"2024-09-21T03:19:13.104544+0000","last_clean":"2024-09-21T03:19:13.104544+0000","last_became_active":"2024-09-21T03:19:12.124166+0000","last_became_peered":"2024-09-21T03:19:12.124166+0000","last_unstale":"2024-09-21T03:19:13.104544+0000","last_undegraded":"2024-09-21T03:19:13.104544+0000","last_fullsized":"2024-09-21T03:19:13.104544+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:03:09.576885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102626+0000","last_change":"2024-09-21T03:19:12.125359+0000","last_active":"2024-09-21T03:19:13.102626+0000","last_peered":"2024-09-21T03:19:13.102626+0000","last_clean":"2024-09-21T03:19:13.102626+0000","last_became_active":"2024-09-21T03:19:12.125040+0000","last_became_peered":"2024-09-21T03:19:12.125040+0000","last_unstale":"2024-09-21T03:19:13.102626+0000","last_undegraded":"2024-09-21T03:19:13.102626+0000","last_fullsized":"2024-09-21T03:19:13.102626+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:18:47.580493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.103621+0000","last_change":"2024-09-21T03:19:12.113525+0000","last_active":"2024-09-21T03:19:13.103621+0000","last_peered":"2024-09-21T03:19:13.103621+0000","last_clean":"2024-09-21T03:19:13.103621+0000","last_became_active":"2024-09-21T03:19:12.113179+0000","last_became_peered":"2024-09-21T03:19:12.113179+0000","last_unstale":"2024-09-21T03:19:13.103621+0000","last_undegraded":"2024-09-21T03:19:13.103621+0000","last_fullsized":"2024-09-21T03:19:13.103621+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:25.092143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102677+0000","last_change":"2024-09-21T03:19:12.124045+0000","last_active":"2024-09-21T03:19:13.102677+0000","last_peered":"2024-09-21T03:19:13.102677+0000","last_clean":"2024-09-21T03:19:13.102677+0000","last_became_active":"2024-09-21T03:19:12.123675+0000","last_became_peered":"2024-09-21T03:19:12.123675+0000","last_unstale":"2024-09-21T03:19:13.102677+0000","last_undegraded":"2024-09-21T03:19:13.102677+0000","last_fullsized":"2024-09-21T03:19:13.102677+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:47:14.609891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.118449+0000","last_change":"2024-09-21T03:19:12.107896+0000","last_active":"2024-09-21T03:19:13.118449+0000","last_peered":"2024-09-21T03:19:13.118449+0000","last_clean":"2024-09-21T03:19:13.118449+0000","last_became_active":"2024-09-21T03:19:12.107202+0000","last_became_peered":"2024-09-21T03:19:12.107202+0000","last_unstale":"2024-09-21T03:19:13.118449+0000","last_undegraded":"2024-09-21T03:19:13.118449+0000","last_fullsized":"2024-09-21T03:19:13.118449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:03:22.065540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104252+0000","last_change":"2024-09-21T03:19:11.114158+0000","last_active":"2024-09-21T03:19:13.104252+0000","last_peered":"2024-09-21T03:19:13.104252+0000","last_clean":"2024-09-21T03:19:13.104252+0000","last_became_active":"2024-09-21T03:19:11.113815+0000","last_became_peered":"2024-09-21T03:19:11.113815+0000","last_unstale":"2024-09-21T03:19:13.104252+0000","last_undegraded":"2024-09-21T03:19:13.104252+0000","last_fullsized":"2024-09-21T03:19:13.104252+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:55:44.185439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104156+0000","last_change":"2024-09-21T03:19:12.121035+0000","last_active":"2024-09-21T03:19:13.104156+0000","last_peered":"2024-09-21T03:19:13.104156+0000","last_clean":"2024-09-21T03:19:13.104156+0000","last_became_active":"2024-09-21T03:19:12.120664+0000","last_became_peered":"2024-09-21T03:19:12.120664+0000","last_unstale":"2024-09-21T03:19:13.104156+0000","last_undegraded":"2024-09-21T03:19:13.104156+0000","last_fullsized":"2024-09-21T03:19:13.104156+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:41.193668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.118414+0000","last_change":"2024-09-21T03:19:11.118983+0000","last_active":"2024-09-21T03:19:13.118414+0000","last_peered":"2024-09-21T03:19:13.118414+0000","last_clean":"2024-09-21T03:19:13.118414+0000","last_became_active":"2024-09-21T03:19:11.118703+0000","last_became_peered":"2024-09-21T03:19:11.118703+0000","last_unstale":"2024-09-21T03:19:13.118414+0000","last_undegraded":"2024-09-21T03:19:13.118414+0000","last_fullsized":"2024-09-21T03:19:13.118414+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:39.807640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104999+0000","last_change":"2024-09-21T03:19:12.121175+0000","last_active":"2024-09-21T03:19:13.104999+0000","last_peered":"2024-09-21T03:19:13.104999+0000","last_clean":"2024-09-21T03:19:13.104999+0000","last_became_active":"2024-09-21T03:19:12.120612+0000","last_became_peered":"2024-09-21T03:19:12.120612+0000","last_unstale":"2024-09-21T03:19:13.104999+0000","last_undegraded":"2024-09-21T03:19:13.104999+0000","last_fullsized":"2024-09-21T03:19:13.104999+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:42.611910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381723+0000","last_change":"2024-09-21T03:19:11.108839+0000","last_active":"2024-09-21T03:19:13.381723+0000","last_peered":"2024-09-21T03:19:13.381723+0000","last_clean":"2024-09-21T03:19:13.381723+0000","last_became_active":"2024-09-21T03:19:11.108247+0000","last_became_peered":"2024-09-21T03:19:11.108247+0000","last_unstale":"2024-09-21T03:19:13.381723+0000","last_undegraded":"2024-09-21T03:19:13.381723+0000","last_fullsized":"2024-09-21T03:19:13.381723+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:23.619672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.121337+0000","last_change":"2024-09-21T03:19:12.120865+0000","last_active":"2024-09-21T03:19:13.121337+0000","last_peered":"2024-09-21T03:19:13.121337+0000","last_clean":"2024-09-21T03:19:13.121337+0000","last_became_active":"2024-09-21T03:19:12.120573+0000","last_became_peered":"2024-09-21T03:19:12.120573+0000","last_unstale":"2024-09-21T03:19:13.121337+0000","last_undegraded":"2024-09-21T03:19:13.121337+0000","last_fullsized":"2024-09-21T03:19:13.121337+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:40.773712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382105+0000","last_change":"2024-09-21T03:19:11.112313+0000","last_active":"2024-09-21T03:19:13.382105+0000","last_peered":"2024-09-21T03:19:13.382105+0000","last_clean":"2024-09-21T03:19:13.382105+0000","last_became_active":"2024-09-21T03:19:11.110122+0000","last_became_peered":"2024-09-21T03:19:11.110122+0000","last_unstale":"2024-09-21T03:19:13.382105+0000","last_undegraded":"2024-09-21T03:19:13.382105+0000","last_fullsized":"2024-09-21T03:19:13.382105+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:43.796244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102942+0000","last_change":"2024-09-21T03:19:12.123179+0000","last_active":"2024-09-21T03:19:13.102942+0000","last_peered":"2024-09-21T03:19:13.102942+0000","last_clean":"2024-09-21T03:19:13.102942+0000","last_became_active":"2024-09-21T03:19:12.122875+0000","last_became_peered":"2024-09-21T03:19:12.122875+0000","last_unstale":"2024-09-21T03:19:13.102942+0000","last_undegraded":"2024-09-21T03:19:13.102942+0000","last_fullsized":"2024-09-21T03:19:13.102942+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:34.525061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104724+0000","last_change":"2024-09-21T03:19:11.117022+0000","last_active":"2024-09-21T03:19:13.104724+0000","last_peered":"2024-09-21T03:19:13.104724+0000","last_clean":"2024-09-21T03:19:13.104724+0000","last_became_active":"2024-09-21T03:19:11.116690+0000","last_became_peered":"2024-09-21T03:19:11.116690+0000","last_unstale":"2024-09-21T03:19:13.104724+0000","last_undegraded":"2024-09-21T03:19:13.104724+0000","last_fullsized":"2024-09-21T03:19:13.104724+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:51.255559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382486+0000","last_change":"2024-09-21T03:19:12.119159+0000","last_active":"2024-09-21T03:19:13.382486+0000","last_peered":"2024-09-21T03:19:13.382486+0000","last_clean":"2024-09-21T03:19:13.382486+0000","last_became_active":"2024-09-21T03:19:12.118808+0000","last_became_peered":"2024-09-21T03:19:12.118808+0000","last_unstale":"2024-09-21T03:19:13.382486+0000","last_undegraded":"2024-09-21T03:19:13.382486+0000","last_fullsized":"2024-09-21T03:19:13.382486+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:48.519582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104682+0000","last_change":"2024-09-21T03:19:11.116558+0000","last_active":"2024-09-21T03:19:13.104682+0000","last_peered":"2024-09-21T03:19:13.104682+0000","last_clean":"2024-09-21T03:19:13.104682+0000","last_became_active":"2024-09-21T03:19:11.116169+0000","last_became_peered":"2024-09-21T03:19:11.116169+0000","last_unstale":"2024-09-21T03:19:13.104682+0000","last_undegraded":"2024-09-21T03:19:13.104682+0000","last_fullsized":"2024-09-21T03:19:13.104682+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:23:00.100615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104262+0000","last_change":"2024-09-21T03:19:12.115624+0000","last_active":"2024-09-21T03:19:13.104262+0000","last_peered":"2024-09-21T03:19:13.104262+0000","last_clean":"2024-09-21T03:19:13.104262+0000","last_became_active":"2024-09-21T03:19:12.115275+0000","last_became_peered":"2024-09-21T03:19:12.115275+0000","last_unstale":"2024-09-21T03:19:13.104262+0000","last_undegraded":"2024-09-21T03:19:13.104262+0000","last_fullsized":"2024-09-21T03:19:13.104262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:41.193668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381827+0000","last_change":"2024-09-21T03:19:11.103165+0000","last_active":"2024-09-21T03:19:13.381827+0000","last_peered":"2024-09-21T03:19:13.381827+0000","last_clean":"2024-09-21T03:19:13.381827+0000","last_became_active":"2024-09-21T03:19:11.102872+0000","last_became_peered":"2024-09-21T03:19:11.102872+0000","last_unstale":"2024-09-21T03:19:13.381827+0000","last_undegraded":"2024-09-21T03:19:13.381827+0000","last_fullsized":"2024-09-21T03:19:13.381827+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:56:43.303284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.120728+0000","last_change":"2024-09-21T03:19:12.127448+0000","last_active":"2024-09-21T03:19:13.120728+0000","last_peered":"2024-09-21T03:19:13.120728+0000","last_clean":"2024-09-21T03:19:13.120728+0000","last_became_active":"2024-09-21T03:19:12.127007+0000","last_became_peered":"2024-09-21T03:19:12.127007+0000","last_unstale":"2024-09-21T03:19:13.120728+0000","last_undegraded":"2024-09-21T03:19:13.120728+0000","last_fullsized":"2024-09-21T03:19:13.120728+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:32.175500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104894+0000","last_change":"2024-09-21T03:19:11.112403+0000","last_active":"2024-09-21T03:19:13.104894+0000","last_peered":"2024-09-21T03:19:13.104894+0000","last_clean":"2024-09-21T03:19:13.104894+0000","last_became_active":"2024-09-21T03:19:11.110380+0000","last_became_peered":"2024-09-21T03:19:11.110380+0000","last_unstale":"2024-09-21T03:19:13.104894+0000","last_undegraded":"2024-09-21T03:19:13.104894+0000","last_fullsized":"2024-09-21T03:19:13.104894+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:51.798449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382430+0000","last_change":"2024-09-21T03:19:12.120648+0000","last_active":"2024-09-21T03:19:13.382430+0000","last_peered":"2024-09-21T03:19:13.382430+0000","last_clean":"2024-09-21T03:19:13.382430+0000","last_became_active":"2024-09-21T03:19:12.119981+0000","last_became_peered":"2024-09-21T03:19:12.119981+0000","last_unstale":"2024-09-21T03:19:13.382430+0000","last_undegraded":"2024-09-21T03:19:13.382430+0000","last_fullsized":"2024-09-21T03:19:13.382430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:11:25.857215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381960+0000","last_change":"2024-09-21T03:19:11.116104+0000","last_active":"2024-09-21T03:19:13.381960+0000","last_peered":"2024-09-21T03:19:13.381960+0000","last_clean":"2024-09-21T03:19:13.381960+0000","last_became_active":"2024-09-21T03:19:11.114896+0000","last_became_peered":"2024-09-21T03:19:11.114896+0000","last_unstale":"2024-09-21T03:19:13.381960+0000","last_undegraded":"2024-09-21T03:19:13.381960+0000","last_fullsized":"2024-09-21T03:19:13.381960+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:13.276373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381838+0000","last_change":"2024-09-21T03:19:12.115277+0000","last_active":"2024-09-21T03:19:13.381838+0000","last_peered":"2024-09-21T03:19:13.381838+0000","last_clean":"2024-09-21T03:19:13.381838+0000","last_became_active":"2024-09-21T03:19:12.114969+0000","last_became_peered":"2024-09-21T03:19:12.114969+0000","last_unstale":"2024-09-21T03:19:13.381838+0000","last_undegraded":"2024-09-21T03:19:13.381838+0000","last_fullsized":"2024-09-21T03:19:13.381838+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:07:30.596468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.118524+0000","last_change":"2024-09-21T03:19:11.119888+0000","last_active":"2024-09-21T03:19:13.118524+0000","last_peered":"2024-09-21T03:19:13.118524+0000","last_clean":"2024-09-21T03:19:13.118524+0000","last_became_active":"2024-09-21T03:19:11.119545+0000","last_became_peered":"2024-09-21T03:19:11.119545+0000","last_unstale":"2024-09-21T03:19:13.118524+0000","last_undegraded":"2024-09-21T03:19:13.118524+0000","last_fullsized":"2024-09-21T03:19:13.118524+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:51.243856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382322+0000","last_change":"2024-09-21T03:19:12.114882+0000","last_active":"2024-09-21T03:19:13.382322+0000","last_peered":"2024-09-21T03:19:13.382322+0000","last_clean":"2024-09-21T03:19:13.382322+0000","last_became_active":"2024-09-21T03:19:12.114561+0000","last_became_peered":"2024-09-21T03:19:12.114561+0000","last_unstale":"2024-09-21T03:19:13.382322+0000","last_undegraded":"2024-09-21T03:19:13.382322+0000","last_fullsized":"2024-09-21T03:19:13.382322+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:08.667667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382464+0000","last_change":"2024-09-21T03:19:11.111184+0000","last_active":"2024-09-21T03:19:13.382464+0000","last_peered":"2024-09-21T03:19:13.382464+0000","last_clean":"2024-09-21T03:19:13.382464+0000","last_became_active":"2024-09-21T03:19:11.110861+0000","last_became_peered":"2024-09-21T03:19:11.110861+0000","last_unstale":"2024-09-21T03:19:13.382464+0000","last_undegraded":"2024-09-21T03:19:13.382464+0000","last_fullsized":"2024-09-21T03:19:13.382464+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:57.066419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382293+0000","last_change":"2024-09-21T03:19:12.131237+0000","last_active":"2024-09-21T03:19:13.382293+0000","last_peered":"2024-09-21T03:19:13.382293+0000","last_clean":"2024-09-21T03:19:13.382293+0000","last_became_active":"2024-09-21T03:19:12.130867+0000","last_became_peered":"2024-09-21T03:19:12.130867+0000","last_unstale":"2024-09-21T03:19:13.382293+0000","last_undegraded":"2024-09-21T03:19:13.382293+0000","last_fullsized":"2024-09-21T03:19:13.382293+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:29:39.788655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382367+0000","last_change":"2024-09-21T03:19:11.109747+0000","last_active":"2024-09-21T03:19:13.382367+0000","last_peered":"2024-09-21T03:19:13.382367+0000","last_clean":"2024-09-21T03:19:13.382367+0000","last_became_active":"2024-09-21T03:19:11.109471+0000","last_became_peered":"2024-09-21T03:19:11.109471+0000","last_unstale":"2024-09-21T03:19:13.382367+0000","last_undegraded":"2024-09-21T03:19:13.382367+0000","last_fullsized":"2024-09-21T03:19:13.382367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:11.187788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.120806+0000","last_change":"2024-09-21T03:19:12.128068+0000","last_active":"2024-09-21T03:19:13.120806+0000","last_peered":"2024-09-21T03:19:13.120806+0000","last_clean":"2024-09-21T03:19:13.120806+0000","last_became_active":"2024-09-21T03:19:12.127594+0000","last_became_peered":"2024-09-21T03:19:12.127594+0000","last_unstale":"2024-09-21T03:19:13.120806+0000","last_undegraded":"2024-09-21T03:19:13.120806+0000","last_fullsized":"2024-09-21T03:19:13.120806+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:19.756214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104891+0000","last_change":"2024-09-21T03:19:11.108994+0000","last_active":"2024-09-21T03:19:13.104891+0000","last_peered":"2024-09-21T03:19:13.104891+0000","last_clean":"2024-09-21T03:19:13.104891+0000","last_became_active":"2024-09-21T03:19:11.108092+0000","last_became_peered":"2024-09-21T03:19:11.108092+0000","last_unstale":"2024-09-21T03:19:13.104891+0000","last_undegraded":"2024-09-21T03:19:13.104891+0000","last_fullsized":"2024-09-21T03:19:13.104891+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:15.318084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382516+0000","last_change":"2024-09-21T03:19:12.111240+0000","last_active":"2024-09-21T03:19:13.382516+0000","last_peered":"2024-09-21T03:19:13.382516+0000","last_clean":"2024-09-21T03:19:13.382516+0000","last_became_active":"2024-09-21T03:19:12.110483+0000","last_became_peered":"2024-09-21T03:19:12.110483+0000","last_unstale":"2024-09-21T03:19:13.382516+0000","last_undegraded":"2024-09-21T03:19:13.382516+0000","last_fullsized":"2024-09-21T03:19:13.382516+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:43.881668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.120663+0000","last_change":"2024-09-21T03:19:11.112700+0000","last_active":"2024-09-21T03:19:13.120663+0000","last_peered":"2024-09-21T03:19:13.120663+0000","last_clean":"2024-09-21T03:19:13.120663+0000","last_became_active":"2024-09-21T03:19:11.112398+0000","last_became_peered":"2024-09-21T03:19:11.112398+0000","last_unstale":"2024-09-21T03:19:13.120663+0000","last_undegraded":"2024-09-21T03:19:13.120663+0000","last_fullsized":"2024-09-21T03:19:13.120663+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:14.899603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102654+0000","last_change":"2024-09-21T03:19:12.124045+0000","last_active":"2024-09-21T03:19:13.102654+0000","last_peered":"2024-09-21T03:19:13.102654+0000","last_clean":"2024-09-21T03:19:13.102654+0000","last_became_active":"2024-09-21T03:19:12.123703+0000","last_became_peered":"2024-09-21T03:19:12.123703+0000","last_unstale":"2024-09-21T03:19:13.102654+0000","last_undegraded":"2024-09-21T03:19:13.102654+0000","last_fullsized":"2024-09-21T03:19:13.102654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:11:25.857215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381941+0000","last_change":"2024-09-21T03:19:11.113832+0000","last_active":"2024-09-21T03:19:13.381941+0000","last_peered":"2024-09-21T03:19:13.381941+0000","last_clean":"2024-09-21T03:19:13.381941+0000","last_became_active":"2024-09-21T03:19:11.113490+0000","last_became_peered":"2024-09-21T03:19:11.113490+0000","last_unstale":"2024-09-21T03:19:13.381941+0000","last_undegraded":"2024-09-21T03:19:13.381941+0000","last_fullsized":"2024-09-21T03:19:13.381941+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:21.360860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.103679+0000","last_change":"2024-09-21T03:19:12.112692+0000","last_active":"2024-09-21T03:19:13.103679+0000","last_peered":"2024-09-21T03:19:13.103679+0000","last_clean":"2024-09-21T03:19:13.103679+0000","last_became_active":"2024-09-21T03:19:12.112358+0000","last_became_peered":"2024-09-21T03:19:12.112358+0000","last_unstale":"2024-09-21T03:19:13.103679+0000","last_undegraded":"2024-09-21T03:19:13.103679+0000","last_fullsized":"2024-09-21T03:19:13.103679+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:55.890328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381835+0000","last_change":"2024-09-21T03:19:11.113112+0000","last_active":"2024-09-21T03:19:13.381835+0000","last_peered":"2024-09-21T03:19:13.381835+0000","last_clean":"2024-09-21T03:19:13.381835+0000","last_became_active":"2024-09-21T03:19:11.112471+0000","last_became_peered":"2024-09-21T03:19:11.112471+0000","last_unstale":"2024-09-21T03:19:13.381835+0000","last_undegraded":"2024-09-21T03:19:13.381835+0000","last_fullsized":"2024-09-21T03:19:13.381835+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:14.685100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104597+0000","last_change":"2024-09-21T03:19:12.123489+0000","last_active":"2024-09-21T03:19:13.104597+0000","last_peered":"2024-09-21T03:19:13.104597+0000","last_clean":"2024-09-21T03:19:13.104597+0000","last_became_active":"2024-09-21T03:19:12.123128+0000","last_became_peered":"2024-09-21T03:19:12.123128+0000","last_unstale":"2024-09-21T03:19:13.104597+0000","last_undegraded":"2024-09-21T03:19:13.104597+0000","last_fullsized":"2024-09-21T03:19:13.104597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:58.072413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.121464+0000","last_change":"2024-09-21T03:19:11.116551+0000","last_active":"2024-09-21T03:19:13.121464+0000","last_peered":"2024-09-21T03:19:13.121464+0000","last_clean":"2024-09-21T03:19:13.121464+0000","last_became_active":"2024-09-21T03:19:11.116223+0000","last_became_peered":"2024-09-21T03:19:11.116223+0000","last_unstale":"2024-09-21T03:19:13.121464+0000","last_undegraded":"2024-09-21T03:19:13.121464+0000","last_fullsized":"2024-09-21T03:19:13.121464+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:15.318084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382586+0000","last_change":"2024-09-21T03:19:12.128395+0000","last_active":"2024-09-21T03:19:13.382586+0000","last_peered":"2024-09-21T03:19:13.382586+0000","last_clean":"2024-09-21T03:19:13.382586+0000","last_became_active":"2024-09-21T03:19:12.128076+0000","last_became_peered":"2024-09-21T03:19:12.128076+0000","last_unstale":"2024-09-21T03:19:13.382586+0000","last_undegraded":"2024-09-21T03:19:13.382586+0000","last_fullsized":"2024-09-21T03:19:13.382586+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:06.048604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104542+0000","last_change":"2024-09-21T03:19:11.111848+0000","last_active":"2024-09-21T03:19:13.104542+0000","last_peered":"2024-09-21T03:19:13.104542+0000","last_clean":"2024-09-21T03:19:13.104542+0000","last_became_active":"2024-09-21T03:19:11.111129+0000","last_became_peered":"2024-09-21T03:19:11.111129+0000","last_unstale":"2024-09-21T03:19:13.104542+0000","last_undegraded":"2024-09-21T03:19:13.104542+0000","last_fullsized":"2024-09-21T03:19:13.104542+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:39.822767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.120953+0000","last_change":"2024-09-21T03:19:12.129108+0000","last_active":"2024-09-21T03:19:13.120953+0000","last_peered":"2024-09-21T03:19:13.120953+0000","last_clean":"2024-09-21T03:19:13.120953+0000","last_became_active":"2024-09-21T03:19:12.128830+0000","last_became_peered":"2024-09-21T03:19:12.128830+0000","last_unstale":"2024-09-21T03:19:13.120953+0000","last_undegraded":"2024-09-21T03:19:13.120953+0000","last_fullsized":"2024-09-21T03:19:13.120953+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:06.450432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104733+0000","last_change":"2024-09-21T03:19:11.108248+0000","last_active":"2024-09-21T03:19:13.104733+0000","last_peered":"2024-09-21T03:19:13.104733+0000","last_clean":"2024-09-21T03:19:13.104733+0000","last_became_active":"2024-09-21T03:19:11.107839+0000","last_became_peered":"2024-09-21T03:19:11.107839+0000","last_unstale":"2024-09-21T03:19:13.104733+0000","last_undegraded":"2024-09-21T03:19:13.104733+0000","last_fullsized":"2024-09-21T03:19:13.104733+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:43.984247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381830+0000","last_change":"2024-09-21T03:19:12.106769+0000","last_active":"2024-09-21T03:19:13.381830+0000","last_peered":"2024-09-21T03:19:13.381830+0000","last_clean":"2024-09-21T03:19:13.381830+0000","last_became_active":"2024-09-21T03:19:12.106423+0000","last_became_peered":"2024-09-21T03:19:12.106423+0000","last_unstale":"2024-09-21T03:19:13.381830+0000","last_undegraded":"2024-09-21T03:19:13.381830+0000","last_fullsized":"2024-09-21T03:19:13.381830+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:46.793926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104977+0000","last_change":"2024-09-21T03:19:11.117034+0000","last_active":"2024-09-21T03:19:13.104977+0000","last_peered":"2024-09-21T03:19:13.104977+0000","last_clean":"2024-09-21T03:19:13.104977+0000","last_became_active":"2024-09-21T03:19:11.116729+0000","last_became_peered":"2024-09-21T03:19:11.116729+0000","last_unstale":"2024-09-21T03:19:13.104977+0000","last_undegraded":"2024-09-21T03:19:13.104977+0000","last_fullsized":"2024-09-21T03:19:13.104977+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:10:00.681324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381579+0000","last_change":"2024-09-21T03:19:12.119850+0000","last_active":"2024-09-21T03:19:13.381579+0000","last_peered":"2024-09-21T03:19:13.381579+0000","last_clean":"2024-09-21T03:19:13.381579+0000","last_became_active":"2024-09-21T03:19:12.119239+0000","last_became_peered":"2024-09-21T03:19:12.119239+0000","last_unstale":"2024-09-21T03:19:13.381579+0000","last_undegraded":"2024-09-21T03:19:13.381579+0000","last_fullsized":"2024-09-21T03:19:13.381579+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:25:23.749492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.118371+0000","last_change":"2024-09-21T03:19:11.114966+0000","last_active":"2024-09-21T03:19:13.118371+0000","last_peered":"2024-09-21T03:19:13.118371+0000","last_clean":"2024-09-21T03:19:13.118371+0000","last_became_active":"2024-09-21T03:19:11.114605+0000","last_became_peered":"2024-09-21T03:19:11.114605+0000","last_unstale":"2024-09-21T03:19:13.118371+0000","last_undegraded":"2024-09-21T03:19:13.118371+0000","last_fullsized":"2024-09-21T03:19:13.118371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:20.704135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382249+0000","last_change":"2024-09-21T03:19:12.109364+0000","last_active":"2024-09-21T03:19:13.382249+0000","last_peered":"2024-09-21T03:19:13.382249+0000","last_clean":"2024-09-21T03:19:13.382249+0000","last_became_active":"2024-09-21T03:19:12.109039+0000","last_became_peered":"2024-09-21T03:19:12.109039+0000","last_unstale":"2024-09-21T03:19:13.382249+0000","last_undegraded":"2024-09-21T03:19:13.382249+0000","last_fullsized":"2024-09-21T03:19:13.382249+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:33.944043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.103590+0000","last_change":"2024-09-21T03:19:11.109672+0000","last_active":"2024-09-21T03:19:13.103590+0000","last_peered":"2024-09-21T03:19:13.103590+0000","last_clean":"2024-09-21T03:19:13.103590+0000","last_became_active":"2024-09-21T03:19:11.109093+0000","last_became_peered":"2024-09-21T03:19:11.109093+0000","last_unstale":"2024-09-21T03:19:13.103590+0000","last_undegraded":"2024-09-21T03:19:13.103590+0000","last_fullsized":"2024-09-21T03:19:13.103590+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:51.798449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381560+0000","last_change":"2024-09-21T03:19:12.106248+0000","last_active":"2024-09-21T03:19:13.381560+0000","last_peered":"2024-09-21T03:19:13.381560+0000","last_clean":"2024-09-21T03:19:13.381560+0000","last_became_active":"2024-09-21T03:19:12.105920+0000","last_became_peered":"2024-09-21T03:19:12.105920+0000","last_unstale":"2024-09-21T03:19:13.381560+0000","last_undegraded":"2024-09-21T03:19:13.381560+0000","last_fullsized":"2024-09-21T03:19:13.381560+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:36.590900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104635+0000","last_change":"2024-09-21T03:19:11.110445+0000","last_active":"2024-09-21T03:19:13.104635+0000","last_peered":"2024-09-21T03:19:13.104635+0000","last_clean":"2024-09-21T03:19:13.104635+0000","last_became_active":"2024-09-21T03:19:11.109764+0000","last_became_peered":"2024-09-21T03:19:11.109764+0000","last_unstale":"2024-09-21T03:19:13.104635+0000","last_undegraded":"2024-09-21T03:19:13.104635+0000","last_fullsized":"2024-09-21T03:19:13.104635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:55:44.185439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.101998+0000","last_change":"2024-09-21T03:19:12.115049+0000","last_active":"2024-09-21T03:19:13.101998+0000","last_peered":"2024-09-21T03:19:13.101998+0000","last_clean":"2024-09-21T03:19:13.101998+0000","last_became_active":"2024-09-21T03:19:12.114717+0000","last_became_peered":"2024-09-21T03:19:12.114717+0000","last_unstale":"2024-09-21T03:19:13.101998+0000","last_undegraded":"2024-09-21T03:19:13.101998+0000","last_fullsized":"2024-09-21T03:19:13.101998+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:04.243781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381893+0000","last_change":"2024-09-21T03:19:11.111243+0000","last_active":"2024-09-21T03:19:13.381893+0000","last_peered":"2024-09-21T03:19:13.381893+0000","last_clean":"2024-09-21T03:19:13.381893+0000","last_became_active":"2024-09-21T03:19:11.110915+0000","last_became_peered":"2024-09-21T03:19:11.110915+0000","last_unstale":"2024-09-21T03:19:13.381893+0000","last_undegraded":"2024-09-21T03:19:13.381893+0000","last_fullsized":"2024-09-21T03:19:13.381893+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:03:08.570891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381599+0000","last_change":"2024-09-21T03:19:12.124361+0000","last_active":"2024-09-21T03:19:13.381599+0000","last_peered":"2024-09-21T03:19:13.381599+0000","last_clean":"2024-09-21T03:19:13.381599+0000","last_became_active":"2024-09-21T03:19:12.124007+0000","last_became_peered":"2024-09-21T03:19:12.124007+0000","last_unstale":"2024-09-21T03:19:13.381599+0000","last_undegraded":"2024-09-21T03:19:13.381599+0000","last_fullsized":"2024-09-21T03:19:13.381599+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:56.039566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.121525+0000","last_change":"2024-09-21T03:19:11.109955+0000","last_active":"2024-09-21T03:19:13.121525+0000","last_peered":"2024-09-21T03:19:13.121525+0000","last_clean":"2024-09-21T03:19:13.121525+0000","last_became_active":"2024-09-21T03:19:11.109654+0000","last_became_peered":"2024-09-21T03:19:11.109654+0000","last_unstale":"2024-09-21T03:19:13.121525+0000","last_undegraded":"2024-09-21T03:19:13.121525+0000","last_fullsized":"2024-09-21T03:19:13.121525+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:46.019163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382620+0000","last_change":"2024-09-21T03:19:12.120031+0000","last_active":"2024-09-21T03:19:13.382620+0000","last_peered":"2024-09-21T03:19:13.382620+0000","last_clean":"2024-09-21T03:19:13.382620+0000","last_became_active":"2024-09-21T03:19:12.119600+0000","last_became_peered":"2024-09-21T03:19:12.119600+0000","last_unstale":"2024-09-21T03:19:13.382620+0000","last_undegraded":"2024-09-21T03:19:13.382620+0000","last_fullsized":"2024-09-21T03:19:13.382620+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:37:33.265939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.118629+0000","last_change":"2024-09-21T03:19:11.115218+0000","last_active":"2024-09-21T03:19:13.118629+0000","last_peered":"2024-09-21T03:19:13.118629+0000","last_clean":"2024-09-21T03:19:13.118629+0000","last_became_active":"2024-09-21T03:19:11.114683+0000","last_became_peered":"2024-09-21T03:19:11.114683+0000","last_unstale":"2024-09-21T03:19:13.118629+0000","last_undegraded":"2024-09-21T03:19:13.118629+0000","last_fullsized":"2024-09-21T03:19:13.118629+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:35:37.914920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.118350+0000","last_change":"2024-09-21T03:19:12.117295+0000","last_active":"2024-09-21T03:19:13.118350+0000","last_peered":"2024-09-21T03:19:13.118350+0000","last_clean":"2024-09-21T03:19:13.118350+0000","last_became_active":"2024-09-21T03:19:12.116926+0000","last_became_peered":"2024-09-21T03:19:12.116926+0000","last_unstale":"2024-09-21T03:19:13.118350+0000","last_undegraded":"2024-09-21T03:19:13.118350+0000","last_fullsized":"2024-09-21T03:19:13.118350+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:48.682741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.121131+0000","last_change":"2024-09-21T03:19:11.113832+0000","last_active":"2024-09-21T03:19:13.121131+0000","last_peered":"2024-09-21T03:19:13.121131+0000","last_clean":"2024-09-21T03:19:13.121131+0000","last_became_active":"2024-09-21T03:19:11.113316+0000","last_became_peered":"2024-09-21T03:19:11.113316+0000","last_unstale":"2024-09-21T03:19:13.121131+0000","last_undegraded":"2024-09-21T03:19:13.121131+0000","last_fullsized":"2024-09-21T03:19:13.121131+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:27.026756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.103465+0000","last_change":"2024-09-21T03:19:12.112077+0000","last_active":"2024-09-21T03:19:13.103465+0000","last_peered":"2024-09-21T03:19:13.103465+0000","last_clean":"2024-09-21T03:19:13.103465+0000","last_became_active":"2024-09-21T03:19:12.111703+0000","last_became_peered":"2024-09-21T03:19:12.111703+0000","last_unstale":"2024-09-21T03:19:13.103465+0000","last_undegraded":"2024-09-21T03:19:13.103465+0000","last_fullsized":"2024-09-21T03:19:13.103465+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:07.764584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.118540+0000","last_change":"2024-09-21T03:19:11.113950+0000","last_active":"2024-09-21T03:19:13.118540+0000","last_peered":"2024-09-21T03:19:13.118540+0000","last_clean":"2024-09-21T03:19:13.118540+0000","last_became_active":"2024-09-21T03:19:11.113642+0000","last_became_peered":"2024-09-21T03:19:11.113642+0000","last_unstale":"2024-09-21T03:19:13.118540+0000","last_undegraded":"2024-09-21T03:19:13.118540+0000","last_fullsized":"2024-09-21T03:19:13.118540+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:44.344501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.118399+0000","last_change":"2024-09-21T03:19:12.111958+0000","last_active":"2024-09-21T03:19:13.118399+0000","last_peered":"2024-09-21T03:19:13.118399+0000","last_clean":"2024-09-21T03:19:13.118399+0000","last_became_active":"2024-09-21T03:19:12.111651+0000","last_became_peered":"2024-09-21T03:19:12.111651+0000","last_unstale":"2024-09-21T03:19:13.118399+0000","last_undegraded":"2024-09-21T03:19:13.118399+0000","last_fullsized":"2024-09-21T03:19:13.118399+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:07.910902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.120766+0000","last_change":"2024-09-21T03:19:11.109571+0000","last_active":"2024-09-21T03:19:13.120766+0000","last_peered":"2024-09-21T03:19:13.120766+0000","last_clean":"2024-09-21T03:19:13.120766+0000","last_became_active":"2024-09-21T03:19:11.108784+0000","last_became_peered":"2024-09-21T03:19:11.108784+0000","last_unstale":"2024-09-21T03:19:13.120766+0000","last_undegraded":"2024-09-21T03:19:13.120766+0000","last_fullsized":"2024-09-21T03:19:13.120766+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:54:50.383426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381710+0000","last_change":"2024-09-21T03:19:12.108714+0000","last_active":"2024-09-21T03:19:13.381710+0000","last_peered":"2024-09-21T03:19:13.381710+0000","last_clean":"2024-09-21T03:19:13.381710+0000","last_became_active":"2024-09-21T03:19:12.108316+0000","last_became_peered":"2024-09-21T03:19:12.108316+0000","last_unstale":"2024-09-21T03:19:13.381710+0000","last_undegraded":"2024-09-21T03:19:13.381710+0000","last_fullsized":"2024-09-21T03:19:13.381710+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:19.212639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104747+0000","last_change":"2024-09-21T03:19:11.110080+0000","last_active":"2024-09-21T03:19:13.104747+0000","last_peered":"2024-09-21T03:19:13.104747+0000","last_clean":"2024-09-21T03:19:13.104747+0000","last_became_active":"2024-09-21T03:19:11.109409+0000","last_became_peered":"2024-09-21T03:19:11.109409+0000","last_unstale":"2024-09-21T03:19:13.104747+0000","last_undegraded":"2024-09-21T03:19:13.104747+0000","last_fullsized":"2024-09-21T03:19:13.104747+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:23:30.198368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104778+0000","last_change":"2024-09-21T03:19:12.120376+0000","last_active":"2024-09-21T03:19:13.104778+0000","last_peered":"2024-09-21T03:19:13.104778+0000","last_clean":"2024-09-21T03:19:13.104778+0000","last_became_active":"2024-09-21T03:19:12.118878+0000","last_became_peered":"2024-09-21T03:19:12.118878+0000","last_unstale":"2024-09-21T03:19:13.104778+0000","last_undegraded":"2024-09-21T03:19:13.104778+0000","last_fullsized":"2024-09-21T03:19:13.104778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:01.214721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381935+0000","last_change":"2024-09-21T03:19:11.115198+0000","last_active":"2024-09-21T03:19:13.381935+0000","last_peered":"2024-09-21T03:19:13.381935+0000","last_clean":"2024-09-21T03:19:13.381935+0000","last_became_active":"2024-09-21T03:19:11.114861+0000","last_became_peered":"2024-09-21T03:19:11.114861+0000","last_unstale":"2024-09-21T03:19:13.381935+0000","last_undegraded":"2024-09-21T03:19:13.381935+0000","last_fullsized":"2024-09-21T03:19:13.381935+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:10:24.624728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102385+0000","last_change":"2024-09-21T03:19:12.118074+0000","last_active":"2024-09-21T03:19:13.102385+0000","last_peered":"2024-09-21T03:19:13.102385+0000","last_clean":"2024-09-21T03:19:13.102385+0000","last_became_active":"2024-09-21T03:19:12.117752+0000","last_became_peered":"2024-09-21T03:19:12.117752+0000","last_unstale":"2024-09-21T03:19:13.102385+0000","last_undegraded":"2024-09-21T03:19:13.102385+0000","last_fullsized":"2024-09-21T03:19:13.102385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:00.596447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.103718+0000","last_change":"2024-09-21T03:19:11.109722+0000","last_active":"2024-09-21T03:19:13.103718+0000","last_peered":"2024-09-21T03:19:13.103718+0000","last_clean":"2024-09-21T03:19:13.103718+0000","last_became_active":"2024-09-21T03:19:11.109400+0000","last_became_peered":"2024-09-21T03:19:11.109400+0000","last_unstale":"2024-09-21T03:19:13.103718+0000","last_undegraded":"2024-09-21T03:19:13.103718+0000","last_fullsized":"2024-09-21T03:19:13.103718+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:23:30.198368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":132,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102882+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:19:13.102882+0000","last_peered":"2024-09-21T03:19:13.102882+0000","last_clean":"2024-09-21T03:19:13.102882+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:19:13.102882+0000","last_undegraded":"2024-09-21T03:19:13.102882+0000","last_fullsized":"2024-09-21T03:19:13.102882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509456,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":962560,"data_stored":728585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":385024,"data_stored":145043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":372736,"data_stored":138799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":385024,"data_stored":144531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":139761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":368640,"data_stored":138197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":393216,"data_stored":146061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":970752,"data_stored":734795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:19:20.580 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:19:20.705 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.704+0000 7fe39a58b640 1 -- 172.21.15.105:0/4214065177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3940b66b0 msgr2=0x7fe3940d4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:20.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.704+0000 7fe39a58b640 1 --2- 172.21.15.105:0/4214065177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3940b66b0 0x7fe3940d4d80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe3940d00e0 tx=0x7fe38802a410 comp rx=0 tx=0).stop 2024-09-21T03:19:20.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.704+0000 7fe39a58b640 1 -- 172.21.15.105:0/4214065177 shutdown_connections 2024-09-21T03:19:20.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.704+0000 7fe39a58b640 1 --2- 172.21.15.105:0/4214065177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3940b66b0 0x7fe3940d4d80 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:20.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.704+0000 7fe39a58b640 1 -- 172.21.15.105:0/4214065177 >> 172.21.15.105:0/4214065177 conn(0x7fe39409d7f0 msgr2=0x7fe3940d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:20.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.704+0000 7fe39a58b640 1 -- 172.21.15.105:0/4214065177 shutdown_connections 2024-09-21T03:19:20.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.704+0000 7fe39a58b640 1 -- 172.21.15.105:0/4214065177 wait complete. 2024-09-21T03:19:20.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.705+0000 7fe39a58b640 1 Processor -- start 2024-09-21T03:19:20.707 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.706+0000 7fe39a58b640 1 -- start start 2024-09-21T03:19:20.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.707+0000 7fe39a58b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3940b9b60 0x7fe3940b7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:20.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.707+0000 7fe39a58b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3940cf540 0x7fe3941f56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:20.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.707+0000 7fe39a58b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3940b84a0 0x7fe3941e97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:20.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.707+0000 7fe39a58b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe39406f810 con 0x7fe3940b84a0 2024-09-21T03:19:20.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.707+0000 7fe39a58b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe39406f690 con 0x7fe3940b9b60 2024-09-21T03:19:20.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.707+0000 7fe39a58b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe39406f990 con 0x7fe3940cf540 2024-09-21T03:19:20.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.707+0000 7fe398b28640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3940b84a0 0x7fe3941e97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:20.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.707+0000 7fe398b28640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3940b84a0 0x7fe3941e97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51350/0 (socket says 172.21.15.105:51350) 2024-09-21T03:19:20.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.707+0000 7fe398b28640 1 -- 172.21.15.105:0/3331045133 learned_addr learned my addr 172.21.15.105:0/3331045133 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:20.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.707+0000 7fe3937fe640 1 --2- 172.21.15.105:0/3331045133 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3940cf540 0x7fe3941f56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:20.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.707+0000 7fe398b28640 1 -- 172.21.15.105:0/3331045133 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3940cf540 msgr2=0x7fe3941f56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:20.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.707+0000 7fe398b28640 1 --2- 172.21.15.105:0/3331045133 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3940cf540 0x7fe3941f56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:20.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.707+0000 7fe398b28640 1 -- 172.21.15.105:0/3331045133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3940b9b60 msgr2=0x7fe3940b7f60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T03:19:20.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.707+0000 7fe398b28640 1 --2- 172.21.15.105:0/3331045133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3940b9b60 0x7fe3940b7f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:20.711 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.707+0000 7fe398b28640 1 -- 172.21.15.105:0/3331045133 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3941f6360 con 0x7fe3940b84a0 2024-09-21T03:19:20.711 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.707+0000 7fe3937fe640 1 --2- 172.21.15.105:0/3331045133 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3940cf540 0x7fe3941f56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:19:20.711 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.707+0000 7fe398b28640 1 --2- 172.21.15.105:0/3331045133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3940b84a0 0x7fe3941e97b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00b9e0 tx=0x7fe38c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:20.711 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.708+0000 7fe390ff9640 1 -- 172.21.15.105:0/3331045133 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c019070 con 0x7fe3940b84a0 2024-09-21T03:19:20.711 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.708+0000 7fe390ff9640 1 -- 172.21.15.105:0/3331045133 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe38c00cc10 con 0x7fe3940b84a0 2024-09-21T03:19:20.711 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.708+0000 7fe39a58b640 1 -- 172.21.15.105:0/3331045133 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3941e73e0 con 0x7fe3940b84a0 2024-09-21T03:19:20.711 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.708+0000 7fe390ff9640 1 -- 172.21.15.105:0/3331045133 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c0146a0 con 0x7fe3940b84a0 2024-09-21T03:19:20.711 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.708+0000 7fe39a58b640 1 -- 172.21.15.105:0/3331045133 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3941e79a0 con 0x7fe3940b84a0 2024-09-21T03:19:20.712 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.709+0000 7fe39a58b640 1 -- 172.21.15.105:0/3331045133 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3940d4d80 con 0x7fe3940b84a0 2024-09-21T03:19:20.712 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.709+0000 7fe390ff9640 1 -- 172.21.15.105:0/3331045133 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe38c01c070 con 0x7fe3940b84a0 2024-09-21T03:19:20.712 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.710+0000 7fe390ff9640 1 --2- 172.21.15.105:0/3331045133 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe380078b90 0x7fe38007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:20.712 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.710+0000 7fe390ff9640 1 -- 172.21.15.105:0/3331045133 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fe38c09aae0 con 0x7fe3940b84a0 2024-09-21T03:19:20.712 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.710+0000 7fe393fff640 1 --2- 172.21.15.105:0/3331045133 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe380078b90 0x7fe38007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:20.712 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.711+0000 7fe393fff640 1 --2- 172.21.15.105:0/3331045133 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe380078b90 0x7fe38007b0a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe384001430 tx=0x7fe384007890 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:20.716 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.715+0000 7fe390ff9640 1 -- 172.21.15.105:0/3331045133 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe38c062f20 con 0x7fe3940b84a0 2024-09-21T03:19:20.889 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.888+0000 7fe39a58b640 1 -- 172.21.15.105:0/3331045133 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe3941f60f0 con 0x7fe380078b90 2024-09-21T03:19:20.894 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.892+0000 7fe390ff9640 1 -- 172.21.15.105:0/3331045133 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251852 (secure 0 0 0) 0x7fe3941f60f0 con 0x7fe380078b90 2024-09-21T03:19:20.897 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:19:20.898 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:19:20.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.896+0000 7fe39a58b640 1 -- 172.21.15.105:0/3331045133 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe380078b90 msgr2=0x7fe38007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:20.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.896+0000 7fe39a58b640 1 --2- 172.21.15.105:0/3331045133 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe380078b90 0x7fe38007b0a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe384001430 tx=0x7fe384007890 comp rx=0 tx=0).stop 2024-09-21T03:19:20.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.896+0000 7fe39a58b640 1 -- 172.21.15.105:0/3331045133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3940b84a0 msgr2=0x7fe3941e97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:20.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.896+0000 7fe39a58b640 1 --2- 172.21.15.105:0/3331045133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3940b84a0 0x7fe3941e97b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00b9e0 tx=0x7fe38c00bea0 comp rx=0 tx=0).stop 2024-09-21T03:19:20.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.896+0000 7fe39a58b640 1 -- 172.21.15.105:0/3331045133 shutdown_connections 2024-09-21T03:19:20.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.896+0000 7fe39a58b640 1 --2- 172.21.15.105:0/3331045133 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe380078b90 0x7fe38007b0a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:20.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.896+0000 7fe39a58b640 1 --2- 172.21.15.105:0/3331045133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3940b84a0 0x7fe3941e97b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:20.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.896+0000 7fe39a58b640 1 --2- 172.21.15.105:0/3331045133 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3940cf540 0x7fe3941f56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:20.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.896+0000 7fe39a58b640 1 --2- 172.21.15.105:0/3331045133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3940b9b60 0x7fe3940b7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:20.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.896+0000 7fe39a58b640 1 -- 172.21.15.105:0/3331045133 >> 172.21.15.105:0/3331045133 conn(0x7fe39409d7f0 msgr2=0x7fe3940b12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:20.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.896+0000 7fe39a58b640 1 -- 172.21.15.105:0/3331045133 shutdown_connections 2024-09-21T03:19:20.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:20.896+0000 7fe39a58b640 1 -- 172.21.15.105:0/3331045133 wait complete. 2024-09-21T03:19:20.909 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-09-21T03:19:19.290724+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224600,"kb_used_data":4168,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750120,"statfs":{"total":773094113280,"available":772864122880,"internally_reserved":0,"allocated":4268032,"data_stored":2340972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001726"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104116+0000","last_change":"2024-09-21T03:19:12.125859+0000","last_active":"2024-09-21T03:19:13.104116+0000","last_peered":"2024-09-21T03:19:13.104116+0000","last_clean":"2024-09-21T03:19:13.104116+0000","last_became_active":"2024-09-21T03:19:12.125455+0000","last_became_peered":"2024-09-21T03:19:12.125455+0000","last_unstale":"2024-09-21T03:19:13.104116+0000","last_undegraded":"2024-09-21T03:19:13.104116+0000","last_fullsized":"2024-09-21T03:19:13.104116+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:34.607404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382017+0000","last_change":"2024-09-21T03:19:12.109132+0000","last_active":"2024-09-21T03:19:13.382017+0000","last_peered":"2024-09-21T03:19:13.382017+0000","last_clean":"2024-09-21T03:19:13.382017+0000","last_became_active":"2024-09-21T03:19:12.108829+0000","last_became_peered":"2024-09-21T03:19:12.108829+0000","last_unstale":"2024-09-21T03:19:13.382017+0000","last_undegraded":"2024-09-21T03:19:13.382017+0000","last_fullsized":"2024-09-21T03:19:13.382017+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:00.596447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382502+0000","last_change":"2024-09-21T03:19:12.131941+0000","last_active":"2024-09-21T03:19:13.382502+0000","last_peered":"2024-09-21T03:19:13.382502+0000","last_clean":"2024-09-21T03:19:13.382502+0000","last_became_active":"2024-09-21T03:19:12.131458+0000","last_became_peered":"2024-09-21T03:19:12.131458+0000","last_unstale":"2024-09-21T03:19:13.382502+0000","last_undegraded":"2024-09-21T03:19:13.382502+0000","last_fullsized":"2024-09-21T03:19:13.382502+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:09:21.244381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.121028+0000","last_change":"2024-09-21T03:19:12.122867+0000","last_active":"2024-09-21T03:19:13.121028+0000","last_peered":"2024-09-21T03:19:13.121028+0000","last_clean":"2024-09-21T03:19:13.121028+0000","last_became_active":"2024-09-21T03:19:12.122533+0000","last_became_peered":"2024-09-21T03:19:12.122533+0000","last_unstale":"2024-09-21T03:19:13.121028+0000","last_undegraded":"2024-09-21T03:19:13.121028+0000","last_fullsized":"2024-09-21T03:19:13.121028+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:59.601871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382009+0000","last_change":"2024-09-21T03:19:12.111226+0000","last_active":"2024-09-21T03:19:13.382009+0000","last_peered":"2024-09-21T03:19:13.382009+0000","last_clean":"2024-09-21T03:19:13.382009+0000","last_became_active":"2024-09-21T03:19:12.110915+0000","last_became_peered":"2024-09-21T03:19:12.110915+0000","last_unstale":"2024-09-21T03:19:13.382009+0000","last_undegraded":"2024-09-21T03:19:13.382009+0000","last_fullsized":"2024-09-21T03:19:13.382009+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:52:42.610167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382578+0000","last_change":"2024-09-21T03:19:12.121447+0000","last_active":"2024-09-21T03:19:13.382578+0000","last_peered":"2024-09-21T03:19:13.382578+0000","last_clean":"2024-09-21T03:19:13.382578+0000","last_became_active":"2024-09-21T03:19:12.121157+0000","last_became_peered":"2024-09-21T03:19:12.121157+0000","last_unstale":"2024-09-21T03:19:13.382578+0000","last_undegraded":"2024-09-21T03:19:13.382578+0000","last_fullsized":"2024-09-21T03:19:13.382578+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:09.757925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102313+0000","last_change":"2024-09-21T03:19:12.115833+0000","last_active":"2024-09-21T03:19:13.102313+0000","last_peered":"2024-09-21T03:19:13.102313+0000","last_clean":"2024-09-21T03:19:13.102313+0000","last_became_active":"2024-09-21T03:19:12.115528+0000","last_became_peered":"2024-09-21T03:19:12.115528+0000","last_unstale":"2024-09-21T03:19:13.102313+0000","last_undegraded":"2024-09-21T03:19:13.102313+0000","last_fullsized":"2024-09-21T03:19:13.102313+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:27.762838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102363+0000","last_change":"2024-09-21T03:19:12.116051+0000","last_active":"2024-09-21T03:19:13.102363+0000","last_peered":"2024-09-21T03:19:13.102363+0000","last_clean":"2024-09-21T03:19:13.102363+0000","last_became_active":"2024-09-21T03:19:12.115701+0000","last_became_peered":"2024-09-21T03:19:12.115701+0000","last_unstale":"2024-09-21T03:19:13.102363+0000","last_undegraded":"2024-09-21T03:19:13.102363+0000","last_fullsized":"2024-09-21T03:19:13.102363+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:07:30.596468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104945+0000","last_change":"2024-09-21T03:19:12.119289+0000","last_active":"2024-09-21T03:19:13.104945+0000","last_peered":"2024-09-21T03:19:13.104945+0000","last_clean":"2024-09-21T03:19:13.104945+0000","last_became_active":"2024-09-21T03:19:12.118634+0000","last_became_peered":"2024-09-21T03:19:12.118634+0000","last_unstale":"2024-09-21T03:19:13.104945+0000","last_undegraded":"2024-09-21T03:19:13.104945+0000","last_fullsized":"2024-09-21T03:19:13.104945+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:23.665081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.121392+0000","last_change":"2024-09-21T03:19:12.116146+0000","last_active":"2024-09-21T03:19:13.121392+0000","last_peered":"2024-09-21T03:19:13.121392+0000","last_clean":"2024-09-21T03:19:13.121392+0000","last_became_active":"2024-09-21T03:19:12.115742+0000","last_became_peered":"2024-09-21T03:19:12.115742+0000","last_unstale":"2024-09-21T03:19:13.121392+0000","last_undegraded":"2024-09-21T03:19:13.121392+0000","last_fullsized":"2024-09-21T03:19:13.121392+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:58.031199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102384+0000","last_change":"2024-09-21T03:19:12.118702+0000","last_active":"2024-09-21T03:19:13.102384+0000","last_peered":"2024-09-21T03:19:13.102384+0000","last_clean":"2024-09-21T03:19:13.102384+0000","last_became_active":"2024-09-21T03:19:12.118391+0000","last_became_peered":"2024-09-21T03:19:12.118391+0000","last_unstale":"2024-09-21T03:19:13.102384+0000","last_undegraded":"2024-09-21T03:19:13.102384+0000","last_fullsized":"2024-09-21T03:19:13.102384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:57.800009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382162+0000","last_change":"2024-09-21T03:19:12.127366+0000","last_active":"2024-09-21T03:19:13.382162+0000","last_peered":"2024-09-21T03:19:13.382162+0000","last_clean":"2024-09-21T03:19:13.382162+0000","last_became_active":"2024-09-21T03:19:12.127036+0000","last_became_peered":"2024-09-21T03:19:12.127036+0000","last_unstale":"2024-09-21T03:19:13.382162+0000","last_undegraded":"2024-09-21T03:19:13.382162+0000","last_fullsized":"2024-09-21T03:19:13.382162+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:49.317940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382211+0000","last_change":"2024-09-21T03:19:12.108265+0000","last_active":"2024-09-21T03:19:13.382211+0000","last_peered":"2024-09-21T03:19:13.382211+0000","last_clean":"2024-09-21T03:19:13.382211+0000","last_became_active":"2024-09-21T03:19:12.107908+0000","last_became_peered":"2024-09-21T03:19:12.107908+0000","last_unstale":"2024-09-21T03:19:13.382211+0000","last_undegraded":"2024-09-21T03:19:13.382211+0000","last_fullsized":"2024-09-21T03:19:13.382211+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:02.577948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382498+0000","last_change":"2024-09-21T03:19:12.110175+0000","last_active":"2024-09-21T03:19:13.382498+0000","last_peered":"2024-09-21T03:19:13.382498+0000","last_clean":"2024-09-21T03:19:13.382498+0000","last_became_active":"2024-09-21T03:19:12.109849+0000","last_became_peered":"2024-09-21T03:19:12.109849+0000","last_unstale":"2024-09-21T03:19:13.382498+0000","last_undegraded":"2024-09-21T03:19:13.382498+0000","last_fullsized":"2024-09-21T03:19:13.382498+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:34.525061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382239+0000","last_change":"2024-09-21T03:19:12.128786+0000","last_active":"2024-09-21T03:19:13.382239+0000","last_peered":"2024-09-21T03:19:13.382239+0000","last_clean":"2024-09-21T03:19:13.382239+0000","last_became_active":"2024-09-21T03:19:12.128433+0000","last_became_peered":"2024-09-21T03:19:12.128433+0000","last_unstale":"2024-09-21T03:19:13.382239+0000","last_undegraded":"2024-09-21T03:19:13.382239+0000","last_fullsized":"2024-09-21T03:19:13.382239+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:57.800009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.103044+0000","last_change":"2024-09-21T03:19:12.114204+0000","last_active":"2024-09-21T03:19:13.103044+0000","last_peered":"2024-09-21T03:19:13.103044+0000","last_clean":"2024-09-21T03:19:13.103044+0000","last_became_active":"2024-09-21T03:19:12.113864+0000","last_became_peered":"2024-09-21T03:19:12.113864+0000","last_unstale":"2024-09-21T03:19:13.103044+0000","last_undegraded":"2024-09-21T03:19:13.103044+0000","last_fullsized":"2024-09-21T03:19:13.103044+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:06.048604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102949+0000","last_change":"2024-09-21T03:19:12.123129+0000","last_active":"2024-09-21T03:19:13.102949+0000","last_peered":"2024-09-21T03:19:13.102949+0000","last_clean":"2024-09-21T03:19:13.102949+0000","last_became_active":"2024-09-21T03:19:12.122781+0000","last_became_peered":"2024-09-21T03:19:12.122781+0000","last_unstale":"2024-09-21T03:19:13.102949+0000","last_undegraded":"2024-09-21T03:19:13.102949+0000","last_fullsized":"2024-09-21T03:19:13.102949+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:48.519582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382143+0000","last_change":"2024-09-21T03:19:12.118599+0000","last_active":"2024-09-21T03:19:13.382143+0000","last_peered":"2024-09-21T03:19:13.382143+0000","last_clean":"2024-09-21T03:19:13.382143+0000","last_became_active":"2024-09-21T03:19:12.118319+0000","last_became_peered":"2024-09-21T03:19:12.118319+0000","last_unstale":"2024-09-21T03:19:13.382143+0000","last_undegraded":"2024-09-21T03:19:13.382143+0000","last_fullsized":"2024-09-21T03:19:13.382143+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:58.905425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381899+0000","last_change":"2024-09-21T03:19:12.121041+0000","last_active":"2024-09-21T03:19:13.381899+0000","last_peered":"2024-09-21T03:19:13.381899+0000","last_clean":"2024-09-21T03:19:13.381899+0000","last_became_active":"2024-09-21T03:19:12.119726+0000","last_became_peered":"2024-09-21T03:19:12.119726+0000","last_unstale":"2024-09-21T03:19:13.381899+0000","last_undegraded":"2024-09-21T03:19:13.381899+0000","last_fullsized":"2024-09-21T03:19:13.381899+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:45:41.300137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381977+0000","last_change":"2024-09-21T03:19:12.120864+0000","last_active":"2024-09-21T03:19:13.381977+0000","last_peered":"2024-09-21T03:19:13.381977+0000","last_clean":"2024-09-21T03:19:13.381977+0000","last_became_active":"2024-09-21T03:19:12.120558+0000","last_became_peered":"2024-09-21T03:19:12.120558+0000","last_unstale":"2024-09-21T03:19:13.381977+0000","last_undegraded":"2024-09-21T03:19:13.381977+0000","last_fullsized":"2024-09-21T03:19:13.381977+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:36.934721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104275+0000","last_change":"2024-09-21T03:19:12.119909+0000","last_active":"2024-09-21T03:19:13.104275+0000","last_peered":"2024-09-21T03:19:13.104275+0000","last_clean":"2024-09-21T03:19:13.104275+0000","last_became_active":"2024-09-21T03:19:12.119529+0000","last_became_peered":"2024-09-21T03:19:12.119529+0000","last_unstale":"2024-09-21T03:19:13.104275+0000","last_undegraded":"2024-09-21T03:19:13.104275+0000","last_fullsized":"2024-09-21T03:19:13.104275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:38.291868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104702+0000","last_change":"2024-09-21T03:19:12.119190+0000","last_active":"2024-09-21T03:19:13.104702+0000","last_peered":"2024-09-21T03:19:13.104702+0000","last_clean":"2024-09-21T03:19:13.104702+0000","last_became_active":"2024-09-21T03:19:12.118617+0000","last_became_peered":"2024-09-21T03:19:12.118617+0000","last_unstale":"2024-09-21T03:19:13.104702+0000","last_undegraded":"2024-09-21T03:19:13.104702+0000","last_fullsized":"2024-09-21T03:19:13.104702+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:38.040137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.118240+0000","last_change":"2024-09-21T03:19:12.117381+0000","last_active":"2024-09-21T03:19:13.118240+0000","last_peered":"2024-09-21T03:19:13.118240+0000","last_clean":"2024-09-21T03:19:13.118240+0000","last_became_active":"2024-09-21T03:19:12.116767+0000","last_became_peered":"2024-09-21T03:19:12.116767+0000","last_unstale":"2024-09-21T03:19:13.118240+0000","last_undegraded":"2024-09-21T03:19:13.118240+0000","last_fullsized":"2024-09-21T03:19:13.118240+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:00.003593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382111+0000","last_change":"2024-09-21T03:19:12.123887+0000","last_active":"2024-09-21T03:19:13.382111+0000","last_peered":"2024-09-21T03:19:13.382111+0000","last_clean":"2024-09-21T03:19:13.382111+0000","last_became_active":"2024-09-21T03:19:12.123560+0000","last_became_peered":"2024-09-21T03:19:12.123560+0000","last_unstale":"2024-09-21T03:19:13.382111+0000","last_undegraded":"2024-09-21T03:19:13.382111+0000","last_fullsized":"2024-09-21T03:19:13.382111+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:27.762838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.121436+0000","last_change":"2024-09-21T03:19:12.116939+0000","last_active":"2024-09-21T03:19:13.121436+0000","last_peered":"2024-09-21T03:19:13.121436+0000","last_clean":"2024-09-21T03:19:13.121436+0000","last_became_active":"2024-09-21T03:19:12.116637+0000","last_became_peered":"2024-09-21T03:19:12.116637+0000","last_unstale":"2024-09-21T03:19:13.121436+0000","last_undegraded":"2024-09-21T03:19:13.121436+0000","last_fullsized":"2024-09-21T03:19:13.121436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:01.049780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382264+0000","last_change":"2024-09-21T03:19:12.117324+0000","last_active":"2024-09-21T03:19:13.382264+0000","last_peered":"2024-09-21T03:19:13.382264+0000","last_clean":"2024-09-21T03:19:13.382264+0000","last_became_active":"2024-09-21T03:19:12.117003+0000","last_became_peered":"2024-09-21T03:19:12.117003+0000","last_unstale":"2024-09-21T03:19:13.382264+0000","last_undegraded":"2024-09-21T03:19:13.382264+0000","last_fullsized":"2024-09-21T03:19:13.382264+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:58.393209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.121300+0000","last_change":"2024-09-21T03:19:12.121597+0000","last_active":"2024-09-21T03:19:13.121300+0000","last_peered":"2024-09-21T03:19:13.121300+0000","last_clean":"2024-09-21T03:19:13.121300+0000","last_became_active":"2024-09-21T03:19:12.121311+0000","last_became_peered":"2024-09-21T03:19:12.121311+0000","last_unstale":"2024-09-21T03:19:13.121300+0000","last_undegraded":"2024-09-21T03:19:13.121300+0000","last_fullsized":"2024-09-21T03:19:13.121300+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:59.556293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382433+0000","last_change":"2024-09-21T03:19:12.121332+0000","last_active":"2024-09-21T03:19:13.382433+0000","last_peered":"2024-09-21T03:19:13.382433+0000","last_clean":"2024-09-21T03:19:13.382433+0000","last_became_active":"2024-09-21T03:19:12.120078+0000","last_became_peered":"2024-09-21T03:19:12.120078+0000","last_unstale":"2024-09-21T03:19:13.382433+0000","last_undegraded":"2024-09-21T03:19:13.382433+0000","last_fullsized":"2024-09-21T03:19:13.382433+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:18:47.580493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104544+0000","last_change":"2024-09-21T03:19:12.124510+0000","last_active":"2024-09-21T03:19:13.104544+0000","last_peered":"2024-09-21T03:19:13.104544+0000","last_clean":"2024-09-21T03:19:13.104544+0000","last_became_active":"2024-09-21T03:19:12.124166+0000","last_became_peered":"2024-09-21T03:19:12.124166+0000","last_unstale":"2024-09-21T03:19:13.104544+0000","last_undegraded":"2024-09-21T03:19:13.104544+0000","last_fullsized":"2024-09-21T03:19:13.104544+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:03:09.576885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102626+0000","last_change":"2024-09-21T03:19:12.125359+0000","last_active":"2024-09-21T03:19:13.102626+0000","last_peered":"2024-09-21T03:19:13.102626+0000","last_clean":"2024-09-21T03:19:13.102626+0000","last_became_active":"2024-09-21T03:19:12.125040+0000","last_became_peered":"2024-09-21T03:19:12.125040+0000","last_unstale":"2024-09-21T03:19:13.102626+0000","last_undegraded":"2024-09-21T03:19:13.102626+0000","last_fullsized":"2024-09-21T03:19:13.102626+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:18:47.580493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.103621+0000","last_change":"2024-09-21T03:19:12.113525+0000","last_active":"2024-09-21T03:19:13.103621+0000","last_peered":"2024-09-21T03:19:13.103621+0000","last_clean":"2024-09-21T03:19:13.103621+0000","last_became_active":"2024-09-21T03:19:12.113179+0000","last_became_peered":"2024-09-21T03:19:12.113179+0000","last_unstale":"2024-09-21T03:19:13.103621+0000","last_undegraded":"2024-09-21T03:19:13.103621+0000","last_fullsized":"2024-09-21T03:19:13.103621+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:25.092143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102677+0000","last_change":"2024-09-21T03:19:12.124045+0000","last_active":"2024-09-21T03:19:13.102677+0000","last_peered":"2024-09-21T03:19:13.102677+0000","last_clean":"2024-09-21T03:19:13.102677+0000","last_became_active":"2024-09-21T03:19:12.123675+0000","last_became_peered":"2024-09-21T03:19:12.123675+0000","last_unstale":"2024-09-21T03:19:13.102677+0000","last_undegraded":"2024-09-21T03:19:13.102677+0000","last_fullsized":"2024-09-21T03:19:13.102677+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:47:14.609891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.118449+0000","last_change":"2024-09-21T03:19:12.107896+0000","last_active":"2024-09-21T03:19:13.118449+0000","last_peered":"2024-09-21T03:19:13.118449+0000","last_clean":"2024-09-21T03:19:13.118449+0000","last_became_active":"2024-09-21T03:19:12.107202+0000","last_became_peered":"2024-09-21T03:19:12.107202+0000","last_unstale":"2024-09-21T03:19:13.118449+0000","last_undegraded":"2024-09-21T03:19:13.118449+0000","last_fullsized":"2024-09-21T03:19:13.118449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:03:22.065540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104252+0000","last_change":"2024-09-21T03:19:11.114158+0000","last_active":"2024-09-21T03:19:13.104252+0000","last_peered":"2024-09-21T03:19:13.104252+0000","last_clean":"2024-09-21T03:19:13.104252+0000","last_became_active":"2024-09-21T03:19:11.113815+0000","last_became_peered":"2024-09-21T03:19:11.113815+0000","last_unstale":"2024-09-21T03:19:13.104252+0000","last_undegraded":"2024-09-21T03:19:13.104252+0000","last_fullsized":"2024-09-21T03:19:13.104252+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:55:44.185439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104156+0000","last_change":"2024-09-21T03:19:12.121035+0000","last_active":"2024-09-21T03:19:13.104156+0000","last_peered":"2024-09-21T03:19:13.104156+0000","last_clean":"2024-09-21T03:19:13.104156+0000","last_became_active":"2024-09-21T03:19:12.120664+0000","last_became_peered":"2024-09-21T03:19:12.120664+0000","last_unstale":"2024-09-21T03:19:13.104156+0000","last_undegraded":"2024-09-21T03:19:13.104156+0000","last_fullsized":"2024-09-21T03:19:13.104156+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:41.193668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.118414+0000","last_change":"2024-09-21T03:19:11.118983+0000","last_active":"2024-09-21T03:19:13.118414+0000","last_peered":"2024-09-21T03:19:13.118414+0000","last_clean":"2024-09-21T03:19:13.118414+0000","last_became_active":"2024-09-21T03:19:11.118703+0000","last_became_peered":"2024-09-21T03:19:11.118703+0000","last_unstale":"2024-09-21T03:19:13.118414+0000","last_undegraded":"2024-09-21T03:19:13.118414+0000","last_fullsized":"2024-09-21T03:19:13.118414+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:39.807640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104999+0000","last_change":"2024-09-21T03:19:12.121175+0000","last_active":"2024-09-21T03:19:13.104999+0000","last_peered":"2024-09-21T03:19:13.104999+0000","last_clean":"2024-09-21T03:19:13.104999+0000","last_became_active":"2024-09-21T03:19:12.120612+0000","last_became_peered":"2024-09-21T03:19:12.120612+0000","last_unstale":"2024-09-21T03:19:13.104999+0000","last_undegraded":"2024-09-21T03:19:13.104999+0000","last_fullsized":"2024-09-21T03:19:13.104999+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:42.611910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381723+0000","last_change":"2024-09-21T03:19:11.108839+0000","last_active":"2024-09-21T03:19:13.381723+0000","last_peered":"2024-09-21T03:19:13.381723+0000","last_clean":"2024-09-21T03:19:13.381723+0000","last_became_active":"2024-09-21T03:19:11.108247+0000","last_became_peered":"2024-09-21T03:19:11.108247+0000","last_unstale":"2024-09-21T03:19:13.381723+0000","last_undegraded":"2024-09-21T03:19:13.381723+0000","last_fullsized":"2024-09-21T03:19:13.381723+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:23.619672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.121337+0000","last_change":"2024-09-21T03:19:12.120865+0000","last_active":"2024-09-21T03:19:13.121337+0000","last_peered":"2024-09-21T03:19:13.121337+0000","last_clean":"2024-09-21T03:19:13.121337+0000","last_became_active":"2024-09-21T03:19:12.120573+0000","last_became_peered":"2024-09-21T03:19:12.120573+0000","last_unstale":"2024-09-21T03:19:13.121337+0000","last_undegraded":"2024-09-21T03:19:13.121337+0000","last_fullsized":"2024-09-21T03:19:13.121337+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:40.773712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382105+0000","last_change":"2024-09-21T03:19:11.112313+0000","last_active":"2024-09-21T03:19:13.382105+0000","last_peered":"2024-09-21T03:19:13.382105+0000","last_clean":"2024-09-21T03:19:13.382105+0000","last_became_active":"2024-09-21T03:19:11.110122+0000","last_became_peered":"2024-09-21T03:19:11.110122+0000","last_unstale":"2024-09-21T03:19:13.382105+0000","last_undegraded":"2024-09-21T03:19:13.382105+0000","last_fullsized":"2024-09-21T03:19:13.382105+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:43.796244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102942+0000","last_change":"2024-09-21T03:19:12.123179+0000","last_active":"2024-09-21T03:19:13.102942+0000","last_peered":"2024-09-21T03:19:13.102942+0000","last_clean":"2024-09-21T03:19:13.102942+0000","last_became_active":"2024-09-21T03:19:12.122875+0000","last_became_peered":"2024-09-21T03:19:12.122875+0000","last_unstale":"2024-09-21T03:19:13.102942+0000","last_undegraded":"2024-09-21T03:19:13.102942+0000","last_fullsized":"2024-09-21T03:19:13.102942+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:34.525061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104724+0000","last_change":"2024-09-21T03:19:11.117022+0000","last_active":"2024-09-21T03:19:13.104724+0000","last_peered":"2024-09-21T03:19:13.104724+0000","last_clean":"2024-09-21T03:19:13.104724+0000","last_became_active":"2024-09-21T03:19:11.116690+0000","last_became_peered":"2024-09-21T03:19:11.116690+0000","last_unstale":"2024-09-21T03:19:13.104724+0000","last_undegraded":"2024-09-21T03:19:13.104724+0000","last_fullsized":"2024-09-21T03:19:13.104724+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:51.255559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382486+0000","last_change":"2024-09-21T03:19:12.119159+0000","last_active":"2024-09-21T03:19:13.382486+0000","last_peered":"2024-09-21T03:19:13.382486+0000","last_clean":"2024-09-21T03:19:13.382486+0000","last_became_active":"2024-09-21T03:19:12.118808+0000","last_became_peered":"2024-09-21T03:19:12.118808+0000","last_unstale":"2024-09-21T03:19:13.382486+0000","last_undegraded":"2024-09-21T03:19:13.382486+0000","last_fullsized":"2024-09-21T03:19:13.382486+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:48.519582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104682+0000","last_change":"2024-09-21T03:19:11.116558+0000","last_active":"2024-09-21T03:19:13.104682+0000","last_peered":"2024-09-21T03:19:13.104682+0000","last_clean":"2024-09-21T03:19:13.104682+0000","last_became_active":"2024-09-21T03:19:11.116169+0000","last_became_peered":"2024-09-21T03:19:11.116169+0000","last_unstale":"2024-09-21T03:19:13.104682+0000","last_undegraded":"2024-09-21T03:19:13.104682+0000","last_fullsized":"2024-09-21T03:19:13.104682+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:23:00.100615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104262+0000","last_change":"2024-09-21T03:19:12.115624+0000","last_active":"2024-09-21T03:19:13.104262+0000","last_peered":"2024-09-21T03:19:13.104262+0000","last_clean":"2024-09-21T03:19:13.104262+0000","last_became_active":"2024-09-21T03:19:12.115275+0000","last_became_peered":"2024-09-21T03:19:12.115275+0000","last_unstale":"2024-09-21T03:19:13.104262+0000","last_undegraded":"2024-09-21T03:19:13.104262+0000","last_fullsized":"2024-09-21T03:19:13.104262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:41.193668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381827+0000","last_change":"2024-09-21T03:19:11.103165+0000","last_active":"2024-09-21T03:19:13.381827+0000","last_peered":"2024-09-21T03:19:13.381827+0000","last_clean":"2024-09-21T03:19:13.381827+0000","last_became_active":"2024-09-21T03:19:11.102872+0000","last_became_peered":"2024-09-21T03:19:11.102872+0000","last_unstale":"2024-09-21T03:19:13.381827+0000","last_undegraded":"2024-09-21T03:19:13.381827+0000","last_fullsized":"2024-09-21T03:19:13.381827+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:56:43.303284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.120728+0000","last_change":"2024-09-21T03:19:12.127448+0000","last_active":"2024-09-21T03:19:13.120728+0000","last_peered":"2024-09-21T03:19:13.120728+0000","last_clean":"2024-09-21T03:19:13.120728+0000","last_became_active":"2024-09-21T03:19:12.127007+0000","last_became_peered":"2024-09-21T03:19:12.127007+0000","last_unstale":"2024-09-21T03:19:13.120728+0000","last_undegraded":"2024-09-21T03:19:13.120728+0000","last_fullsized":"2024-09-21T03:19:13.120728+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:53:32.175500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104894+0000","last_change":"2024-09-21T03:19:11.112403+0000","last_active":"2024-09-21T03:19:13.104894+0000","last_peered":"2024-09-21T03:19:13.104894+0000","last_clean":"2024-09-21T03:19:13.104894+0000","last_became_active":"2024-09-21T03:19:11.110380+0000","last_became_peered":"2024-09-21T03:19:11.110380+0000","last_unstale":"2024-09-21T03:19:13.104894+0000","last_undegraded":"2024-09-21T03:19:13.104894+0000","last_fullsized":"2024-09-21T03:19:13.104894+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:51.798449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382430+0000","last_change":"2024-09-21T03:19:12.120648+0000","last_active":"2024-09-21T03:19:13.382430+0000","last_peered":"2024-09-21T03:19:13.382430+0000","last_clean":"2024-09-21T03:19:13.382430+0000","last_became_active":"2024-09-21T03:19:12.119981+0000","last_became_peered":"2024-09-21T03:19:12.119981+0000","last_unstale":"2024-09-21T03:19:13.382430+0000","last_undegraded":"2024-09-21T03:19:13.382430+0000","last_fullsized":"2024-09-21T03:19:13.382430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:11:25.857215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381960+0000","last_change":"2024-09-21T03:19:11.116104+0000","last_active":"2024-09-21T03:19:13.381960+0000","last_peered":"2024-09-21T03:19:13.381960+0000","last_clean":"2024-09-21T03:19:13.381960+0000","last_became_active":"2024-09-21T03:19:11.114896+0000","last_became_peered":"2024-09-21T03:19:11.114896+0000","last_unstale":"2024-09-21T03:19:13.381960+0000","last_undegraded":"2024-09-21T03:19:13.381960+0000","last_fullsized":"2024-09-21T03:19:13.381960+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:13.276373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381838+0000","last_change":"2024-09-21T03:19:12.115277+0000","last_active":"2024-09-21T03:19:13.381838+0000","last_peered":"2024-09-21T03:19:13.381838+0000","last_clean":"2024-09-21T03:19:13.381838+0000","last_became_active":"2024-09-21T03:19:12.114969+0000","last_became_peered":"2024-09-21T03:19:12.114969+0000","last_unstale":"2024-09-21T03:19:13.381838+0000","last_undegraded":"2024-09-21T03:19:13.381838+0000","last_fullsized":"2024-09-21T03:19:13.381838+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:07:30.596468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.118524+0000","last_change":"2024-09-21T03:19:11.119888+0000","last_active":"2024-09-21T03:19:13.118524+0000","last_peered":"2024-09-21T03:19:13.118524+0000","last_clean":"2024-09-21T03:19:13.118524+0000","last_became_active":"2024-09-21T03:19:11.119545+0000","last_became_peered":"2024-09-21T03:19:11.119545+0000","last_unstale":"2024-09-21T03:19:13.118524+0000","last_undegraded":"2024-09-21T03:19:13.118524+0000","last_fullsized":"2024-09-21T03:19:13.118524+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:51.243856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382322+0000","last_change":"2024-09-21T03:19:12.114882+0000","last_active":"2024-09-21T03:19:13.382322+0000","last_peered":"2024-09-21T03:19:13.382322+0000","last_clean":"2024-09-21T03:19:13.382322+0000","last_became_active":"2024-09-21T03:19:12.114561+0000","last_became_peered":"2024-09-21T03:19:12.114561+0000","last_unstale":"2024-09-21T03:19:13.382322+0000","last_undegraded":"2024-09-21T03:19:13.382322+0000","last_fullsized":"2024-09-21T03:19:13.382322+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:08.667667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382464+0000","last_change":"2024-09-21T03:19:11.111184+0000","last_active":"2024-09-21T03:19:13.382464+0000","last_peered":"2024-09-21T03:19:13.382464+0000","last_clean":"2024-09-21T03:19:13.382464+0000","last_became_active":"2024-09-21T03:19:11.110861+0000","last_became_peered":"2024-09-21T03:19:11.110861+0000","last_unstale":"2024-09-21T03:19:13.382464+0000","last_undegraded":"2024-09-21T03:19:13.382464+0000","last_fullsized":"2024-09-21T03:19:13.382464+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:57.066419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382293+0000","last_change":"2024-09-21T03:19:12.131237+0000","last_active":"2024-09-21T03:19:13.382293+0000","last_peered":"2024-09-21T03:19:13.382293+0000","last_clean":"2024-09-21T03:19:13.382293+0000","last_became_active":"2024-09-21T03:19:12.130867+0000","last_became_peered":"2024-09-21T03:19:12.130867+0000","last_unstale":"2024-09-21T03:19:13.382293+0000","last_undegraded":"2024-09-21T03:19:13.382293+0000","last_fullsized":"2024-09-21T03:19:13.382293+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:29:39.788655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382367+0000","last_change":"2024-09-21T03:19:11.109747+0000","last_active":"2024-09-21T03:19:13.382367+0000","last_peered":"2024-09-21T03:19:13.382367+0000","last_clean":"2024-09-21T03:19:13.382367+0000","last_became_active":"2024-09-21T03:19:11.109471+0000","last_became_peered":"2024-09-21T03:19:11.109471+0000","last_unstale":"2024-09-21T03:19:13.382367+0000","last_undegraded":"2024-09-21T03:19:13.382367+0000","last_fullsized":"2024-09-21T03:19:13.382367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:11.187788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.120806+0000","last_change":"2024-09-21T03:19:12.128068+0000","last_active":"2024-09-21T03:19:13.120806+0000","last_peered":"2024-09-21T03:19:13.120806+0000","last_clean":"2024-09-21T03:19:13.120806+0000","last_became_active":"2024-09-21T03:19:12.127594+0000","last_became_peered":"2024-09-21T03:19:12.127594+0000","last_unstale":"2024-09-21T03:19:13.120806+0000","last_undegraded":"2024-09-21T03:19:13.120806+0000","last_fullsized":"2024-09-21T03:19:13.120806+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:19.756214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104891+0000","last_change":"2024-09-21T03:19:11.108994+0000","last_active":"2024-09-21T03:19:13.104891+0000","last_peered":"2024-09-21T03:19:13.104891+0000","last_clean":"2024-09-21T03:19:13.104891+0000","last_became_active":"2024-09-21T03:19:11.108092+0000","last_became_peered":"2024-09-21T03:19:11.108092+0000","last_unstale":"2024-09-21T03:19:13.104891+0000","last_undegraded":"2024-09-21T03:19:13.104891+0000","last_fullsized":"2024-09-21T03:19:13.104891+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:15.318084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382516+0000","last_change":"2024-09-21T03:19:12.111240+0000","last_active":"2024-09-21T03:19:13.382516+0000","last_peered":"2024-09-21T03:19:13.382516+0000","last_clean":"2024-09-21T03:19:13.382516+0000","last_became_active":"2024-09-21T03:19:12.110483+0000","last_became_peered":"2024-09-21T03:19:12.110483+0000","last_unstale":"2024-09-21T03:19:13.382516+0000","last_undegraded":"2024-09-21T03:19:13.382516+0000","last_fullsized":"2024-09-21T03:19:13.382516+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:43.881668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.120663+0000","last_change":"2024-09-21T03:19:11.112700+0000","last_active":"2024-09-21T03:19:13.120663+0000","last_peered":"2024-09-21T03:19:13.120663+0000","last_clean":"2024-09-21T03:19:13.120663+0000","last_became_active":"2024-09-21T03:19:11.112398+0000","last_became_peered":"2024-09-21T03:19:11.112398+0000","last_unstale":"2024-09-21T03:19:13.120663+0000","last_undegraded":"2024-09-21T03:19:13.120663+0000","last_fullsized":"2024-09-21T03:19:13.120663+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:14.899603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102654+0000","last_change":"2024-09-21T03:19:12.124045+0000","last_active":"2024-09-21T03:19:13.102654+0000","last_peered":"2024-09-21T03:19:13.102654+0000","last_clean":"2024-09-21T03:19:13.102654+0000","last_became_active":"2024-09-21T03:19:12.123703+0000","last_became_peered":"2024-09-21T03:19:12.123703+0000","last_unstale":"2024-09-21T03:19:13.102654+0000","last_undegraded":"2024-09-21T03:19:13.102654+0000","last_fullsized":"2024-09-21T03:19:13.102654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:11:25.857215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381941+0000","last_change":"2024-09-21T03:19:11.113832+0000","last_active":"2024-09-21T03:19:13.381941+0000","last_peered":"2024-09-21T03:19:13.381941+0000","last_clean":"2024-09-21T03:19:13.381941+0000","last_became_active":"2024-09-21T03:19:11.113490+0000","last_became_peered":"2024-09-21T03:19:11.113490+0000","last_unstale":"2024-09-21T03:19:13.381941+0000","last_undegraded":"2024-09-21T03:19:13.381941+0000","last_fullsized":"2024-09-21T03:19:13.381941+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:14:21.360860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.103679+0000","last_change":"2024-09-21T03:19:12.112692+0000","last_active":"2024-09-21T03:19:13.103679+0000","last_peered":"2024-09-21T03:19:13.103679+0000","last_clean":"2024-09-21T03:19:13.103679+0000","last_became_active":"2024-09-21T03:19:12.112358+0000","last_became_peered":"2024-09-21T03:19:12.112358+0000","last_unstale":"2024-09-21T03:19:13.103679+0000","last_undegraded":"2024-09-21T03:19:13.103679+0000","last_fullsized":"2024-09-21T03:19:13.103679+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:55.890328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381835+0000","last_change":"2024-09-21T03:19:11.113112+0000","last_active":"2024-09-21T03:19:13.381835+0000","last_peered":"2024-09-21T03:19:13.381835+0000","last_clean":"2024-09-21T03:19:13.381835+0000","last_became_active":"2024-09-21T03:19:11.112471+0000","last_became_peered":"2024-09-21T03:19:11.112471+0000","last_unstale":"2024-09-21T03:19:13.381835+0000","last_undegraded":"2024-09-21T03:19:13.381835+0000","last_fullsized":"2024-09-21T03:19:13.381835+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:14.685100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104597+0000","last_change":"2024-09-21T03:19:12.123489+0000","last_active":"2024-09-21T03:19:13.104597+0000","last_peered":"2024-09-21T03:19:13.104597+0000","last_clean":"2024-09-21T03:19:13.104597+0000","last_became_active":"2024-09-21T03:19:12.123128+0000","last_became_peered":"2024-09-21T03:19:12.123128+0000","last_unstale":"2024-09-21T03:19:13.104597+0000","last_undegraded":"2024-09-21T03:19:13.104597+0000","last_fullsized":"2024-09-21T03:19:13.104597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:16:58.072413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.121464+0000","last_change":"2024-09-21T03:19:11.116551+0000","last_active":"2024-09-21T03:19:13.121464+0000","last_peered":"2024-09-21T03:19:13.121464+0000","last_clean":"2024-09-21T03:19:13.121464+0000","last_became_active":"2024-09-21T03:19:11.116223+0000","last_became_peered":"2024-09-21T03:19:11.116223+0000","last_unstale":"2024-09-21T03:19:13.121464+0000","last_undegraded":"2024-09-21T03:19:13.121464+0000","last_fullsized":"2024-09-21T03:19:13.121464+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:15.318084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382586+0000","last_change":"2024-09-21T03:19:12.128395+0000","last_active":"2024-09-21T03:19:13.382586+0000","last_peered":"2024-09-21T03:19:13.382586+0000","last_clean":"2024-09-21T03:19:13.382586+0000","last_became_active":"2024-09-21T03:19:12.128076+0000","last_became_peered":"2024-09-21T03:19:12.128076+0000","last_unstale":"2024-09-21T03:19:13.382586+0000","last_undegraded":"2024-09-21T03:19:13.382586+0000","last_fullsized":"2024-09-21T03:19:13.382586+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:06.048604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104542+0000","last_change":"2024-09-21T03:19:11.111848+0000","last_active":"2024-09-21T03:19:13.104542+0000","last_peered":"2024-09-21T03:19:13.104542+0000","last_clean":"2024-09-21T03:19:13.104542+0000","last_became_active":"2024-09-21T03:19:11.111129+0000","last_became_peered":"2024-09-21T03:19:11.111129+0000","last_unstale":"2024-09-21T03:19:13.104542+0000","last_undegraded":"2024-09-21T03:19:13.104542+0000","last_fullsized":"2024-09-21T03:19:13.104542+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:39.822767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.120953+0000","last_change":"2024-09-21T03:19:12.129108+0000","last_active":"2024-09-21T03:19:13.120953+0000","last_peered":"2024-09-21T03:19:13.120953+0000","last_clean":"2024-09-21T03:19:13.120953+0000","last_became_active":"2024-09-21T03:19:12.128830+0000","last_became_peered":"2024-09-21T03:19:12.128830+0000","last_unstale":"2024-09-21T03:19:13.120953+0000","last_undegraded":"2024-09-21T03:19:13.120953+0000","last_fullsized":"2024-09-21T03:19:13.120953+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:06.450432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104733+0000","last_change":"2024-09-21T03:19:11.108248+0000","last_active":"2024-09-21T03:19:13.104733+0000","last_peered":"2024-09-21T03:19:13.104733+0000","last_clean":"2024-09-21T03:19:13.104733+0000","last_became_active":"2024-09-21T03:19:11.107839+0000","last_became_peered":"2024-09-21T03:19:11.107839+0000","last_unstale":"2024-09-21T03:19:13.104733+0000","last_undegraded":"2024-09-21T03:19:13.104733+0000","last_fullsized":"2024-09-21T03:19:13.104733+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:43.984247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381830+0000","last_change":"2024-09-21T03:19:12.106769+0000","last_active":"2024-09-21T03:19:13.381830+0000","last_peered":"2024-09-21T03:19:13.381830+0000","last_clean":"2024-09-21T03:19:13.381830+0000","last_became_active":"2024-09-21T03:19:12.106423+0000","last_became_peered":"2024-09-21T03:19:12.106423+0000","last_unstale":"2024-09-21T03:19:13.381830+0000","last_undegraded":"2024-09-21T03:19:13.381830+0000","last_fullsized":"2024-09-21T03:19:13.381830+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:46.793926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104977+0000","last_change":"2024-09-21T03:19:11.117034+0000","last_active":"2024-09-21T03:19:13.104977+0000","last_peered":"2024-09-21T03:19:13.104977+0000","last_clean":"2024-09-21T03:19:13.104977+0000","last_became_active":"2024-09-21T03:19:11.116729+0000","last_became_peered":"2024-09-21T03:19:11.116729+0000","last_unstale":"2024-09-21T03:19:13.104977+0000","last_undegraded":"2024-09-21T03:19:13.104977+0000","last_fullsized":"2024-09-21T03:19:13.104977+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:10:00.681324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381579+0000","last_change":"2024-09-21T03:19:12.119850+0000","last_active":"2024-09-21T03:19:13.381579+0000","last_peered":"2024-09-21T03:19:13.381579+0000","last_clean":"2024-09-21T03:19:13.381579+0000","last_became_active":"2024-09-21T03:19:12.119239+0000","last_became_peered":"2024-09-21T03:19:12.119239+0000","last_unstale":"2024-09-21T03:19:13.381579+0000","last_undegraded":"2024-09-21T03:19:13.381579+0000","last_fullsized":"2024-09-21T03:19:13.381579+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:25:23.749492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.118371+0000","last_change":"2024-09-21T03:19:11.114966+0000","last_active":"2024-09-21T03:19:13.118371+0000","last_peered":"2024-09-21T03:19:13.118371+0000","last_clean":"2024-09-21T03:19:13.118371+0000","last_became_active":"2024-09-21T03:19:11.114605+0000","last_became_peered":"2024-09-21T03:19:11.114605+0000","last_unstale":"2024-09-21T03:19:13.118371+0000","last_undegraded":"2024-09-21T03:19:13.118371+0000","last_fullsized":"2024-09-21T03:19:13.118371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:20.704135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382249+0000","last_change":"2024-09-21T03:19:12.109364+0000","last_active":"2024-09-21T03:19:13.382249+0000","last_peered":"2024-09-21T03:19:13.382249+0000","last_clean":"2024-09-21T03:19:13.382249+0000","last_became_active":"2024-09-21T03:19:12.109039+0000","last_became_peered":"2024-09-21T03:19:12.109039+0000","last_unstale":"2024-09-21T03:19:13.382249+0000","last_undegraded":"2024-09-21T03:19:13.382249+0000","last_fullsized":"2024-09-21T03:19:13.382249+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:33.944043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.103590+0000","last_change":"2024-09-21T03:19:11.109672+0000","last_active":"2024-09-21T03:19:13.103590+0000","last_peered":"2024-09-21T03:19:13.103590+0000","last_clean":"2024-09-21T03:19:13.103590+0000","last_became_active":"2024-09-21T03:19:11.109093+0000","last_became_peered":"2024-09-21T03:19:11.109093+0000","last_unstale":"2024-09-21T03:19:13.103590+0000","last_undegraded":"2024-09-21T03:19:13.103590+0000","last_fullsized":"2024-09-21T03:19:13.103590+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:51.798449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381560+0000","last_change":"2024-09-21T03:19:12.106248+0000","last_active":"2024-09-21T03:19:13.381560+0000","last_peered":"2024-09-21T03:19:13.381560+0000","last_clean":"2024-09-21T03:19:13.381560+0000","last_became_active":"2024-09-21T03:19:12.105920+0000","last_became_peered":"2024-09-21T03:19:12.105920+0000","last_unstale":"2024-09-21T03:19:13.381560+0000","last_undegraded":"2024-09-21T03:19:13.381560+0000","last_fullsized":"2024-09-21T03:19:13.381560+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:36.590900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104635+0000","last_change":"2024-09-21T03:19:11.110445+0000","last_active":"2024-09-21T03:19:13.104635+0000","last_peered":"2024-09-21T03:19:13.104635+0000","last_clean":"2024-09-21T03:19:13.104635+0000","last_became_active":"2024-09-21T03:19:11.109764+0000","last_became_peered":"2024-09-21T03:19:11.109764+0000","last_unstale":"2024-09-21T03:19:13.104635+0000","last_undegraded":"2024-09-21T03:19:13.104635+0000","last_fullsized":"2024-09-21T03:19:13.104635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:55:44.185439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.101998+0000","last_change":"2024-09-21T03:19:12.115049+0000","last_active":"2024-09-21T03:19:13.101998+0000","last_peered":"2024-09-21T03:19:13.101998+0000","last_clean":"2024-09-21T03:19:13.101998+0000","last_became_active":"2024-09-21T03:19:12.114717+0000","last_became_peered":"2024-09-21T03:19:12.114717+0000","last_unstale":"2024-09-21T03:19:13.101998+0000","last_undegraded":"2024-09-21T03:19:13.101998+0000","last_fullsized":"2024-09-21T03:19:13.101998+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:23:04.243781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381893+0000","last_change":"2024-09-21T03:19:11.111243+0000","last_active":"2024-09-21T03:19:13.381893+0000","last_peered":"2024-09-21T03:19:13.381893+0000","last_clean":"2024-09-21T03:19:13.381893+0000","last_became_active":"2024-09-21T03:19:11.110915+0000","last_became_peered":"2024-09-21T03:19:11.110915+0000","last_unstale":"2024-09-21T03:19:13.381893+0000","last_undegraded":"2024-09-21T03:19:13.381893+0000","last_fullsized":"2024-09-21T03:19:13.381893+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:03:08.570891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381599+0000","last_change":"2024-09-21T03:19:12.124361+0000","last_active":"2024-09-21T03:19:13.381599+0000","last_peered":"2024-09-21T03:19:13.381599+0000","last_clean":"2024-09-21T03:19:13.381599+0000","last_became_active":"2024-09-21T03:19:12.124007+0000","last_became_peered":"2024-09-21T03:19:12.124007+0000","last_unstale":"2024-09-21T03:19:13.381599+0000","last_undegraded":"2024-09-21T03:19:13.381599+0000","last_fullsized":"2024-09-21T03:19:13.381599+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:56.039566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.121525+0000","last_change":"2024-09-21T03:19:11.109955+0000","last_active":"2024-09-21T03:19:13.121525+0000","last_peered":"2024-09-21T03:19:13.121525+0000","last_clean":"2024-09-21T03:19:13.121525+0000","last_became_active":"2024-09-21T03:19:11.109654+0000","last_became_peered":"2024-09-21T03:19:11.109654+0000","last_unstale":"2024-09-21T03:19:13.121525+0000","last_undegraded":"2024-09-21T03:19:13.121525+0000","last_fullsized":"2024-09-21T03:19:13.121525+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:46.019163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.382620+0000","last_change":"2024-09-21T03:19:12.120031+0000","last_active":"2024-09-21T03:19:13.382620+0000","last_peered":"2024-09-21T03:19:13.382620+0000","last_clean":"2024-09-21T03:19:13.382620+0000","last_became_active":"2024-09-21T03:19:12.119600+0000","last_became_peered":"2024-09-21T03:19:12.119600+0000","last_unstale":"2024-09-21T03:19:13.382620+0000","last_undegraded":"2024-09-21T03:19:13.382620+0000","last_fullsized":"2024-09-21T03:19:13.382620+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:37:33.265939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.118629+0000","last_change":"2024-09-21T03:19:11.115218+0000","last_active":"2024-09-21T03:19:13.118629+0000","last_peered":"2024-09-21T03:19:13.118629+0000","last_clean":"2024-09-21T03:19:13.118629+0000","last_became_active":"2024-09-21T03:19:11.114683+0000","last_became_peered":"2024-09-21T03:19:11.114683+0000","last_unstale":"2024-09-21T03:19:13.118629+0000","last_undegraded":"2024-09-21T03:19:13.118629+0000","last_fullsized":"2024-09-21T03:19:13.118629+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:35:37.914920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.118350+0000","last_change":"2024-09-21T03:19:12.117295+0000","last_active":"2024-09-21T03:19:13.118350+0000","last_peered":"2024-09-21T03:19:13.118350+0000","last_clean":"2024-09-21T03:19:13.118350+0000","last_became_active":"2024-09-21T03:19:12.116926+0000","last_became_peered":"2024-09-21T03:19:12.116926+0000","last_unstale":"2024-09-21T03:19:13.118350+0000","last_undegraded":"2024-09-21T03:19:13.118350+0000","last_fullsized":"2024-09-21T03:19:13.118350+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:48.682741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.121131+0000","last_change":"2024-09-21T03:19:11.113832+0000","last_active":"2024-09-21T03:19:13.121131+0000","last_peered":"2024-09-21T03:19:13.121131+0000","last_clean":"2024-09-21T03:19:13.121131+0000","last_became_active":"2024-09-21T03:19:11.113316+0000","last_became_peered":"2024-09-21T03:19:11.113316+0000","last_unstale":"2024-09-21T03:19:13.121131+0000","last_undegraded":"2024-09-21T03:19:13.121131+0000","last_fullsized":"2024-09-21T03:19:13.121131+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:27.026756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.103465+0000","last_change":"2024-09-21T03:19:12.112077+0000","last_active":"2024-09-21T03:19:13.103465+0000","last_peered":"2024-09-21T03:19:13.103465+0000","last_clean":"2024-09-21T03:19:13.103465+0000","last_became_active":"2024-09-21T03:19:12.111703+0000","last_became_peered":"2024-09-21T03:19:12.111703+0000","last_unstale":"2024-09-21T03:19:13.103465+0000","last_undegraded":"2024-09-21T03:19:13.103465+0000","last_fullsized":"2024-09-21T03:19:13.103465+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:07.764584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.118540+0000","last_change":"2024-09-21T03:19:11.113950+0000","last_active":"2024-09-21T03:19:13.118540+0000","last_peered":"2024-09-21T03:19:13.118540+0000","last_clean":"2024-09-21T03:19:13.118540+0000","last_became_active":"2024-09-21T03:19:11.113642+0000","last_became_peered":"2024-09-21T03:19:11.113642+0000","last_unstale":"2024-09-21T03:19:13.118540+0000","last_undegraded":"2024-09-21T03:19:13.118540+0000","last_fullsized":"2024-09-21T03:19:13.118540+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:15:44.344501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.118399+0000","last_change":"2024-09-21T03:19:12.111958+0000","last_active":"2024-09-21T03:19:13.118399+0000","last_peered":"2024-09-21T03:19:13.118399+0000","last_clean":"2024-09-21T03:19:13.118399+0000","last_became_active":"2024-09-21T03:19:12.111651+0000","last_became_peered":"2024-09-21T03:19:12.111651+0000","last_unstale":"2024-09-21T03:19:13.118399+0000","last_undegraded":"2024-09-21T03:19:13.118399+0000","last_fullsized":"2024-09-21T03:19:13.118399+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:07.910902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.120766+0000","last_change":"2024-09-21T03:19:11.109571+0000","last_active":"2024-09-21T03:19:13.120766+0000","last_peered":"2024-09-21T03:19:13.120766+0000","last_clean":"2024-09-21T03:19:13.120766+0000","last_became_active":"2024-09-21T03:19:11.108784+0000","last_became_peered":"2024-09-21T03:19:11.108784+0000","last_unstale":"2024-09-21T03:19:13.120766+0000","last_undegraded":"2024-09-21T03:19:13.120766+0000","last_fullsized":"2024-09-21T03:19:13.120766+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:54:50.383426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381710+0000","last_change":"2024-09-21T03:19:12.108714+0000","last_active":"2024-09-21T03:19:13.381710+0000","last_peered":"2024-09-21T03:19:13.381710+0000","last_clean":"2024-09-21T03:19:13.381710+0000","last_became_active":"2024-09-21T03:19:12.108316+0000","last_became_peered":"2024-09-21T03:19:12.108316+0000","last_unstale":"2024-09-21T03:19:13.381710+0000","last_undegraded":"2024-09-21T03:19:13.381710+0000","last_fullsized":"2024-09-21T03:19:13.381710+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:13:19.212639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104747+0000","last_change":"2024-09-21T03:19:11.110080+0000","last_active":"2024-09-21T03:19:13.104747+0000","last_peered":"2024-09-21T03:19:13.104747+0000","last_clean":"2024-09-21T03:19:13.104747+0000","last_became_active":"2024-09-21T03:19:11.109409+0000","last_became_peered":"2024-09-21T03:19:11.109409+0000","last_unstale":"2024-09-21T03:19:13.104747+0000","last_undegraded":"2024-09-21T03:19:13.104747+0000","last_fullsized":"2024-09-21T03:19:13.104747+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:23:30.198368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.104778+0000","last_change":"2024-09-21T03:19:12.120376+0000","last_active":"2024-09-21T03:19:13.104778+0000","last_peered":"2024-09-21T03:19:13.104778+0000","last_clean":"2024-09-21T03:19:13.104778+0000","last_became_active":"2024-09-21T03:19:12.118878+0000","last_became_peered":"2024-09-21T03:19:12.118878+0000","last_unstale":"2024-09-21T03:19:13.104778+0000","last_undegraded":"2024-09-21T03:19:13.104778+0000","last_fullsized":"2024-09-21T03:19:13.104778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:01.214721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.381935+0000","last_change":"2024-09-21T03:19:11.115198+0000","last_active":"2024-09-21T03:19:13.381935+0000","last_peered":"2024-09-21T03:19:13.381935+0000","last_clean":"2024-09-21T03:19:13.381935+0000","last_became_active":"2024-09-21T03:19:11.114861+0000","last_became_peered":"2024-09-21T03:19:11.114861+0000","last_unstale":"2024-09-21T03:19:13.381935+0000","last_undegraded":"2024-09-21T03:19:13.381935+0000","last_fullsized":"2024-09-21T03:19:13.381935+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:10:24.624728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102385+0000","last_change":"2024-09-21T03:19:12.118074+0000","last_active":"2024-09-21T03:19:13.102385+0000","last_peered":"2024-09-21T03:19:13.102385+0000","last_clean":"2024-09-21T03:19:13.102385+0000","last_became_active":"2024-09-21T03:19:12.117752+0000","last_became_peered":"2024-09-21T03:19:12.117752+0000","last_unstale":"2024-09-21T03:19:13.102385+0000","last_undegraded":"2024-09-21T03:19:13.102385+0000","last_fullsized":"2024-09-21T03:19:13.102385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:11.088347+0000","last_clean_scrub_stamp":"2024-09-21T03:19:11.088347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:00.596447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.103718+0000","last_change":"2024-09-21T03:19:11.109722+0000","last_active":"2024-09-21T03:19:13.103718+0000","last_peered":"2024-09-21T03:19:13.103718+0000","last_clean":"2024-09-21T03:19:13.103718+0000","last_became_active":"2024-09-21T03:19:11.109400+0000","last_became_peered":"2024-09-21T03:19:11.109400+0000","last_unstale":"2024-09-21T03:19:13.103718+0000","last_undegraded":"2024-09-21T03:19:13.103718+0000","last_fullsized":"2024-09-21T03:19:13.103718+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:19:10.082352+0000","last_clean_scrub_stamp":"2024-09-21T03:19:10.082352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:23:30.198368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":132,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-21T03:19:13.102882+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:19:13.102882+0000","last_peered":"2024-09-21T03:19:13.102882+0000","last_clean":"2024-09-21T03:19:13.102882+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:19:13.102882+0000","last_undegraded":"2024-09-21T03:19:13.102882+0000","last_fullsized":"2024-09-21T03:19:13.102882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":974848,"data_stored":734885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":385024,"data_stored":145043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509455,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":385024,"data_stored":145099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":385024,"data_stored":144531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":393216,"data_stored":146061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":144497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":393216,"data_stored":146061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":970752,"data_stored":734795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:19:20.913 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T03:19:20.913 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T03:19:21.070 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.068+0000 7f1272798640 1 -- 172.21.15.105:0/1756962952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1254003a00 msgr2=0x7f1254003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:21.070 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.068+0000 7f1272798640 1 --2- 172.21.15.105:0/1756962952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1254003a00 0x7f1254003e70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f125c009b50 tx=0x7f1254005830 comp rx=0 tx=0).stop 2024-09-21T03:19:21.070 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.068+0000 7f1270d35640 1 -- 172.21.15.105:0/1756962952 reap_dead start 2024-09-21T03:19:21.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.068+0000 7f1272798640 1 -- 172.21.15.105:0/1756962952 shutdown_connections 2024-09-21T03:19:21.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.068+0000 7f1272798640 1 -- 172.21.15.105:0/1756962952 >> 172.21.15.105:0/1756962952 conn(0x7f126c09d880 msgr2=0x7f126c08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:21.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.068+0000 7f1272798640 1 -- 172.21.15.105:0/1756962952 shutdown_connections 2024-09-21T03:19:21.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.068+0000 7f1272798640 1 -- 172.21.15.105:0/1756962952 wait complete. 2024-09-21T03:19:21.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.070+0000 7f1272798640 1 Processor -- start 2024-09-21T03:19:21.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.070+0000 7f1272798640 1 -- start start 2024-09-21T03:19:21.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.071+0000 7f1272798640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1254003a00 0x7f126c0b92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:21.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.071+0000 7f1272798640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f126c14db70 0x7f126c0cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:21.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.071+0000 7f1272798640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f126c0cce30 0x7f126c0c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:21.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.071+0000 7f1272798640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f126c162410 con 0x7f126c14db70 2024-09-21T03:19:21.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.071+0000 7f1272798640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f126c162290 con 0x7f126c0cce30 2024-09-21T03:19:21.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.071+0000 7f1272798640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f126c0b6b40 con 0x7f1254003a00 2024-09-21T03:19:21.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.071+0000 7f126b7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f126c14db70 0x7f126c0cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:21.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.071+0000 7f126b7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f126c14db70 0x7f126c0cc8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51368/0 (socket says 172.21.15.105:51368) 2024-09-21T03:19:21.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.071+0000 7f126b7fe640 1 -- 172.21.15.105:0/1974581267 learned_addr learned my addr 172.21.15.105:0/1974581267 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:21.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.072+0000 7f126bfff640 1 --2- 172.21.15.105:0/1974581267 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1254003a00 0x7f126c0b92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:21.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.072+0000 7f1270d35640 1 --2- 172.21.15.105:0/1974581267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f126c0cce30 0x7f126c0c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:21.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.072+0000 7f126b7fe640 1 -- 172.21.15.105:0/1974581267 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1254003a00 msgr2=0x7f126c0b92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:21.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.072+0000 7f126b7fe640 1 --2- 172.21.15.105:0/1974581267 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1254003a00 0x7f126c0b92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:21.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.072+0000 7f126b7fe640 1 -- 172.21.15.105:0/1974581267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f126c0cce30 msgr2=0x7f126c0c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:21.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.072+0000 7f126b7fe640 1 --2- 172.21.15.105:0/1974581267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f126c0cce30 0x7f126c0c8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:21.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.072+0000 7f126b7fe640 1 -- 172.21.15.105:0/1974581267 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f126c0cd240 con 0x7f126c14db70 2024-09-21T03:19:21.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.072+0000 7f1270d35640 1 --2- 172.21.15.105:0/1974581267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f126c0cce30 0x7f126c0c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:19:21.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.072+0000 7f126b7fe640 1 --2- 172.21.15.105:0/1974581267 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f126c14db70 0x7f126c0cc8f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1260011890 tx=0x7f1260011d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:21.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.072+0000 7f1268ff9640 1 -- 172.21.15.105:0/1974581267 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126001e070 con 0x7f126c14db70 2024-09-21T03:19:21.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.072+0000 7f1268ff9640 1 -- 172.21.15.105:0/1974581267 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f126000fbb0 con 0x7f126c14db70 2024-09-21T03:19:21.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.072+0000 7f1272798640 1 -- 172.21.15.105:0/1974581267 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f126c159380 con 0x7f126c14db70 2024-09-21T03:19:21.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.072+0000 7f1268ff9640 1 -- 172.21.15.105:0/1974581267 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1260019410 con 0x7f126c14db70 2024-09-21T03:19:21.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.072+0000 7f1272798640 1 -- 172.21.15.105:0/1974581267 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f126c159940 con 0x7f126c14db70 2024-09-21T03:19:21.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.073+0000 7f1272798640 1 -- 172.21.15.105:0/1974581267 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f126c1590f0 con 0x7f126c14db70 2024-09-21T03:19:21.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.074+0000 7f1268ff9640 1 -- 172.21.15.105:0/1974581267 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1260021070 con 0x7f126c14db70 2024-09-21T03:19:21.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.074+0000 7f1268ff9640 1 --2- 172.21.15.105:0/1974581267 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1258078b90 0x7f125807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:21.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.074+0000 7f1268ff9640 1 -- 172.21.15.105:0/1974581267 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f126009b520 con 0x7f126c14db70 2024-09-21T03:19:21.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.075+0000 7f126bfff640 1 --2- 172.21.15.105:0/1974581267 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1258078b90 0x7f125807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:21.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.075+0000 7f126bfff640 1 --2- 172.21.15.105:0/1974581267 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1258078b90 0x7f125807b0a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f125c035000 tx=0x7f125c02d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:21.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.079+0000 7f1268ff9640 1 -- 172.21.15.105:0/1974581267 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f126c0cd240 con 0x7f126c14db70 2024-09-21T03:19:21.329 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.327+0000 7f1272798640 1 -- 172.21.15.105:0/1974581267 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f126c0cf040 con 0x7f126c14db70 2024-09-21T03:19:21.331 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.330+0000 7f1268ff9640 1 -- 172.21.15.105:0/1974581267 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7f1260063310 con 0x7f126c14db70 2024-09-21T03:19:21.332 INFO:teuthology.orchestra.run.smithi105.stdout:[client.0] 2024-09-21T03:19:21.332 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQDIOu5mughoJxAAhY0bzJmq+oNyzCdtafkC9w== 2024-09-21T03:19:21.332 INFO:teuthology.orchestra.run.smithi105.stdout: caps mds = "allow" 2024-09-21T03:19:21.332 INFO:teuthology.orchestra.run.smithi105.stdout: caps mon = "allow r" 2024-09-21T03:19:21.332 INFO:teuthology.orchestra.run.smithi105.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T03:19:21.332 INFO:teuthology.orchestra.run.smithi105.stderr:updated caps for client.0 2024-09-21T03:19:21.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.332+0000 7f1272798640 1 -- 172.21.15.105:0/1974581267 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1258078b90 msgr2=0x7f125807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:21.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.332+0000 7f1272798640 1 --2- 172.21.15.105:0/1974581267 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1258078b90 0x7f125807b0a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f125c035000 tx=0x7f125c02d040 comp rx=0 tx=0).stop 2024-09-21T03:19:21.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.332+0000 7f1272798640 1 -- 172.21.15.105:0/1974581267 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f126c14db70 msgr2=0x7f126c0cc8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:21.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.332+0000 7f1272798640 1 --2- 172.21.15.105:0/1974581267 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f126c14db70 0x7f126c0cc8f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1260011890 tx=0x7f1260011d50 comp rx=0 tx=0).stop 2024-09-21T03:19:21.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.332+0000 7f1272798640 1 -- 172.21.15.105:0/1974581267 shutdown_connections 2024-09-21T03:19:21.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.332+0000 7f1272798640 1 --2- 172.21.15.105:0/1974581267 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1258078b90 0x7f125807b0a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:21.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.332+0000 7f1272798640 1 --2- 172.21.15.105:0/1974581267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f126c0cce30 0x7f126c0c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:21.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.332+0000 7f1272798640 1 --2- 172.21.15.105:0/1974581267 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f126c14db70 0x7f126c0cc8f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:21.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.332+0000 7f1272798640 1 --2- 172.21.15.105:0/1974581267 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1254003a00 0x7f126c0b92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:21.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.332+0000 7f1272798640 1 -- 172.21.15.105:0/1974581267 >> 172.21.15.105:0/1974581267 conn(0x7f126c09d880 msgr2=0x7f126c160650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:21.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.332+0000 7f1272798640 1 -- 172.21.15.105:0/1974581267 shutdown_connections 2024-09-21T03:19:21.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.332+0000 7f1272798640 1 -- 172.21.15.105:0/1974581267 wait complete. 2024-09-21T03:19:21.345 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:19:21.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.456+0000 7f8b48c9b640 1 -- 172.21.15.105:0/2613180152 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b30003c10 msgr2=0x7f8b30004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:21.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.456+0000 7f8b48c9b640 1 --2- 172.21.15.105:0/2613180152 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b30003c10 0x7f8b30004060 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8b3400c2e0 tx=0x7f8b30005830 comp rx=0 tx=0).stop 2024-09-21T03:19:21.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.456+0000 7f8b42d9d640 1 -- 172.21.15.105:0/2613180152 reap_dead start 2024-09-21T03:19:21.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.456+0000 7f8b48c9b640 1 -- 172.21.15.105:0/2613180152 shutdown_connections 2024-09-21T03:19:21.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.456+0000 7f8b48c9b640 1 -- 172.21.15.105:0/2613180152 >> 172.21.15.105:0/2613180152 conn(0x7f8b4406d230 msgr2=0x7f8b4406d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:21.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.456+0000 7f8b48c9b640 1 -- 172.21.15.105:0/2613180152 shutdown_connections 2024-09-21T03:19:21.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.456+0000 7f8b48c9b640 1 -- 172.21.15.105:0/2613180152 wait complete. 2024-09-21T03:19:21.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.458+0000 7f8b48c9b640 1 Processor -- start 2024-09-21T03:19:21.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.458+0000 7f8b48c9b640 1 -- start start 2024-09-21T03:19:21.462 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.459+0000 7f8b48c9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b30003c10 0x7f8b4414ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:21.462 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.459+0000 7f8b48c9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b441505d0 0x7f8b441e7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:21.462 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.459+0000 7f8b48c9b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b44150b20 0x7f8b441e79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:21.462 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.459+0000 7f8b48c9b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8b4415e860 con 0x7f8b441505d0 2024-09-21T03:19:21.462 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.459+0000 7f8b48c9b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8b4415e6e0 con 0x7f8b30003c10 2024-09-21T03:19:21.462 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.459+0000 7f8b48c9b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8b4415e9e0 con 0x7f8b44150b20 2024-09-21T03:19:21.462 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.459+0000 7f8b39d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b441505d0 0x7f8b441e7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:21.462 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.459+0000 7f8b39d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b441505d0 0x7f8b441e7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:49702/0 (socket says 172.21.15.105:49702) 2024-09-21T03:19:21.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.459+0000 7f8b39d9b640 1 -- 172.21.15.105:0/369354241 learned_addr learned my addr 172.21.15.105:0/369354241 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:21.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.459+0000 7f8b42d9d640 1 --2- 172.21.15.105:0/369354241 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b44150b20 0x7f8b441e79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:21.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.459+0000 7f8b4259c640 1 --2- 172.21.15.105:0/369354241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b30003c10 0x7f8b4414ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:21.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.460+0000 7f8b39d9b640 1 -- 172.21.15.105:0/369354241 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b44150b20 msgr2=0x7f8b441e79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:21.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.460+0000 7f8b39d9b640 1 --2- 172.21.15.105:0/369354241 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b44150b20 0x7f8b441e79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:21.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.460+0000 7f8b39d9b640 1 -- 172.21.15.105:0/369354241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b30003c10 msgr2=0x7f8b4414ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:21.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.460+0000 7f8b39d9b640 1 --2- 172.21.15.105:0/369354241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b30003c10 0x7f8b4414ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:21.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.460+0000 7f8b39d9b640 1 -- 172.21.15.105:0/369354241 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b441e8200 con 0x7f8b441505d0 2024-09-21T03:19:21.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.460+0000 7f8b4259c640 1 --2- 172.21.15.105:0/369354241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b30003c10 0x7f8b4414ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:19:21.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.460+0000 7f8b39d9b640 1 --2- 172.21.15.105:0/369354241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b441505d0 0x7f8b441e7480 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c003d80 tx=0x7f8b2c001800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:21.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.460+0000 7f8b3b7fe640 1 -- 172.21.15.105:0/369354241 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c011640 con 0x7f8b441505d0 2024-09-21T03:19:21.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.460+0000 7f8b3b7fe640 1 -- 172.21.15.105:0/369354241 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b2c016020 con 0x7f8b441505d0 2024-09-21T03:19:21.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.460+0000 7f8b48c9b640 1 -- 172.21.15.105:0/369354241 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b441e84e0 con 0x7f8b441505d0 2024-09-21T03:19:21.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.460+0000 7f8b3b7fe640 1 -- 172.21.15.105:0/369354241 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c011a80 con 0x7f8b441505d0 2024-09-21T03:19:21.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.460+0000 7f8b48c9b640 1 -- 172.21.15.105:0/369354241 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b440b2200 con 0x7f8b441505d0 2024-09-21T03:19:21.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.461+0000 7f8b48c9b640 1 -- 172.21.15.105:0/369354241 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b441e8720 con 0x7f8b441505d0 2024-09-21T03:19:21.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.462+0000 7f8b3b7fe640 1 -- 172.21.15.105:0/369354241 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8b2c011c20 con 0x7f8b441505d0 2024-09-21T03:19:21.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.462+0000 7f8b3b7fe640 1 --2- 172.21.15.105:0/369354241 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8b24078bc0 0x7f8b2407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:21.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.462+0000 7f8b3b7fe640 1 -- 172.21.15.105:0/369354241 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f8b2c09bd80 con 0x7f8b441505d0 2024-09-21T03:19:21.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.463+0000 7f8b4259c640 1 --2- 172.21.15.105:0/369354241 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8b24078bc0 0x7f8b2407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:21.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.463+0000 7f8b4259c640 1 --2- 172.21.15.105:0/369354241 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8b24078bc0 0x7f8b2407b0d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8b34033000 tx=0x7f8b3402d000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:21.467 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.466+0000 7f8b3b7fe640 1 -- 172.21.15.105:0/369354241 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8b441e8720 con 0x7f8b441505d0 2024-09-21T03:19:21.678 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.677+0000 7f8b48c9b640 1 -- 172.21.15.105:0/369354241 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b440cde30 con 0x7f8b441505d0 2024-09-21T03:19:21.679 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.677+0000 7f8b3b7fe640 1 -- 172.21.15.105:0/369354241 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5232 (secure 0 0 0) 0x7f8b440cde30 con 0x7f8b441505d0 2024-09-21T03:19:21.679 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:19:21.679 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":17,"btime":"2024-09-21T03:19:15:120921+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4634,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/517240834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":517240834},{"type":"v1","addr":"172.21.15.162:6837","nonce":517240834}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4774,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3241953393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3241953393},{"type":"v1","addr":"172.21.15.162:6836","nonce":3241953393}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4899,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/2101702562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2101702562},{"type":"v1","addr":"172.21.15.105:6834","nonce":2101702562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:19:11.459432+0000","modified":"2024-09-21T03:19:14.487254+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4902},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4902":{"gid":4902,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1732564681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":1732564681},{"type":"v1","addr":"172.21.15.105:6835","nonce":1732564681}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4902,"qdb_cluster":[4902]},"id":2}]} 2024-09-21T03:19:21.679 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 17 2024-09-21T03:19:21.681 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.679+0000 7f8b48c9b640 1 -- 172.21.15.105:0/369354241 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8b24078bc0 msgr2=0x7f8b2407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:21.681 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.679+0000 7f8b48c9b640 1 --2- 172.21.15.105:0/369354241 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8b24078bc0 0x7f8b2407b0d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8b34033000 tx=0x7f8b3402d000 comp rx=0 tx=0).stop 2024-09-21T03:19:21.681 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.679+0000 7f8b48c9b640 1 -- 172.21.15.105:0/369354241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b441505d0 msgr2=0x7f8b441e7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:21.681 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.679+0000 7f8b48c9b640 1 --2- 172.21.15.105:0/369354241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b441505d0 0x7f8b441e7480 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c003d80 tx=0x7f8b2c001800 comp rx=0 tx=0).stop 2024-09-21T03:19:21.682 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.679+0000 7f8b48c9b640 1 -- 172.21.15.105:0/369354241 shutdown_connections 2024-09-21T03:19:21.682 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.679+0000 7f8b48c9b640 1 --2- 172.21.15.105:0/369354241 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8b24078bc0 0x7f8b2407b0d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:21.682 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.679+0000 7f8b48c9b640 1 --2- 172.21.15.105:0/369354241 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b44150b20 0x7f8b441e79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:21.682 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.679+0000 7f8b48c9b640 1 --2- 172.21.15.105:0/369354241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b441505d0 0x7f8b441e7480 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:21.682 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.679+0000 7f8b48c9b640 1 --2- 172.21.15.105:0/369354241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b30003c10 0x7f8b4414ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:21.682 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.679+0000 7f8b48c9b640 1 -- 172.21.15.105:0/369354241 >> 172.21.15.105:0/369354241 conn(0x7f8b4406d230 msgr2=0x7f8b44151360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:21.682 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.679+0000 7f8b48c9b640 1 -- 172.21.15.105:0/369354241 shutdown_connections 2024-09-21T03:19:21.682 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:21.680+0000 7f8b48c9b640 1 -- 172.21.15.105:0/369354241 wait complete. 2024-09-21T03:19:22.095 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T03:19:11.459432+0000', 'modified': '2024-09-21T03:19:14.487254+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4902}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4902': {'gid': 4902, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.105:6835/1732564681', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6833', 'nonce': 1732564681}, {'type': 'v1', 'addr': '172.21.15.105:6835', 'nonce': 1732564681}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4902, 'qdb_cluster': [4902]} 2024-09-21T03:19:22.096 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T03:19:22.096 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-21T03:19:22.213 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.211+0000 7fd8b35c6640 1 -- 172.21.15.105:0/3049841939 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd894004800 msgr2=0x7fd894004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:22.213 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.211+0000 7fd8b35c6640 1 --2- 172.21.15.105:0/3049841939 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd894004800 0x7fd894004c10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd8a000bb20 tx=0x7fd894005830 comp rx=0 tx=0).stop 2024-09-21T03:19:22.213 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.211+0000 7fd8b1b63640 1 -- 172.21.15.105:0/3049841939 reap_dead start 2024-09-21T03:19:22.213 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.211+0000 7fd8b35c6640 1 -- 172.21.15.105:0/3049841939 shutdown_connections 2024-09-21T03:19:22.213 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.211+0000 7fd8b35c6640 1 -- 172.21.15.105:0/3049841939 >> 172.21.15.105:0/3049841939 conn(0x7fd8ac0710b0 msgr2=0x7fd8ac0714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:22.213 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.211+0000 7fd8b35c6640 1 -- 172.21.15.105:0/3049841939 shutdown_connections 2024-09-21T03:19:22.213 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.211+0000 7fd8b35c6640 1 -- 172.21.15.105:0/3049841939 wait complete. 2024-09-21T03:19:22.214 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.213+0000 7fd8b35c6640 1 Processor -- start 2024-09-21T03:19:22.214 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.213+0000 7fd8b35c6640 1 -- start start 2024-09-21T03:19:22.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.214+0000 7fd8b35c6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd894004800 0x7fd8ac15e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:22.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.214+0000 7fd8b35c6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8ac154c90 0x7fd8ac1f6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:22.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.214+0000 7fd8b35c6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8ac1550a0 0x7fd8ac15b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:22.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.214+0000 7fd8b35c6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ac15c820 con 0x7fd8ac1550a0 2024-09-21T03:19:22.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.214+0000 7fd8b35c6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ac15c6a0 con 0x7fd8ac154c90 2024-09-21T03:19:22.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.214+0000 7fd8b35c6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd8ac15c9a0 con 0x7fd894004800 2024-09-21T03:19:22.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.214+0000 7fd8b1b63640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8ac1550a0 0x7fd8ac15b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:22.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.214+0000 7fd8b1b63640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8ac1550a0 0x7fd8ac15b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:49730/0 (socket says 172.21.15.105:49730) 2024-09-21T03:19:22.218 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.214+0000 7fd8b1b63640 1 -- 172.21.15.105:0/3544123983 learned_addr learned my addr 172.21.15.105:0/3544123983 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:22.218 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.214+0000 7fd8b1362640 1 --2- 172.21.15.105:0/3544123983 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd894004800 0x7fd8ac15e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:22.218 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.214+0000 7fd8b0b61640 1 --2- 172.21.15.105:0/3544123983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8ac154c90 0x7fd8ac1f6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:22.218 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.214+0000 7fd8b1b63640 1 -- 172.21.15.105:0/3544123983 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd894004800 msgr2=0x7fd8ac15e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:22.218 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.214+0000 7fd8b1b63640 1 --2- 172.21.15.105:0/3544123983 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd894004800 0x7fd8ac15e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.218 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.214+0000 7fd8b1b63640 1 -- 172.21.15.105:0/3544123983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8ac154c90 msgr2=0x7fd8ac1f6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:22.218 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.214+0000 7fd8b1b63640 1 --2- 172.21.15.105:0/3544123983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8ac154c90 0x7fd8ac1f6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.218 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.214+0000 7fd8b1b63640 1 -- 172.21.15.105:0/3544123983 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8ac0c9b10 con 0x7fd8ac1550a0 2024-09-21T03:19:22.218 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.215+0000 7fd8b1b63640 1 --2- 172.21.15.105:0/3544123983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8ac1550a0 0x7fd8ac15b100 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac0b7f90 tx=0x7fd8a40039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:22.218 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.215+0000 7fd8a9ffb640 1 -- 172.21.15.105:0/3544123983 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a4011840 con 0x7fd8ac1550a0 2024-09-21T03:19:22.218 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.215+0000 7fd8a9ffb640 1 -- 172.21.15.105:0/3544123983 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd8a4018070 con 0x7fd8ac1550a0 2024-09-21T03:19:22.218 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.215+0000 7fd8b35c6640 1 -- 172.21.15.105:0/3544123983 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8ac0c9df0 con 0x7fd8ac1550a0 2024-09-21T03:19:22.219 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.215+0000 7fd8a9ffb640 1 -- 172.21.15.105:0/3544123983 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a4011c60 con 0x7fd8ac1550a0 2024-09-21T03:19:22.219 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.215+0000 7fd8b35c6640 1 -- 172.21.15.105:0/3544123983 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8ac1f6440 con 0x7fd8ac1550a0 2024-09-21T03:19:22.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.217+0000 7fd8a9ffb640 1 -- 172.21.15.105:0/3544123983 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd8a401d460 con 0x7fd8ac1550a0 2024-09-21T03:19:22.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.217+0000 7fd8a9ffb640 1 --2- 172.21.15.105:0/3544123983 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd898078b90 0x7fd89807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:22.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.218+0000 7fd8a9ffb640 1 -- 172.21.15.105:0/3544123983 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fd8a409b430 con 0x7fd8ac1550a0 2024-09-21T03:19:22.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.218+0000 7fd8b1362640 1 --2- 172.21.15.105:0/3544123983 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd898078b90 0x7fd89807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:22.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.218+0000 7fd8b1362640 1 --2- 172.21.15.105:0/3544123983 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd898078b90 0x7fd89807b0a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd89c000f80 tx=0x7fd89c006ef0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:22.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.218+0000 7fd8ba61c740 1 Processor -- start 2024-09-21T03:19:22.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.218+0000 7fd8ba61c740 1 -- start start 2024-09-21T03:19:22.223 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.219+0000 7fd8ba61c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d002d06270 0x55d0030dc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:22.223 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.219+0000 7fd8ba61c740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d002cdd3b0 0x55d0030dc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:22.223 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.219+0000 7fd8ba61c740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d002ce5590 0x55d0030f9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:22.223 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.220+0000 7fd8ba61c740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55d003020820 con 0x55d002ce5590 2024-09-21T03:19:22.223 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.220+0000 7fd8ba61c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d00300fc50 con 0x55d002d06270 2024-09-21T03:19:22.223 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.220+0000 7fd8ba61c740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55d003013a60 con 0x55d002cdd3b0 2024-09-21T03:19:22.223 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.220+0000 7fd8b1b63640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d002ce5590 0x55d0030f9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:22.223 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.220+0000 7fd8b1b63640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d002ce5590 0x55d0030f9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:49742/0 (socket says 172.21.15.105:49742) 2024-09-21T03:19:22.224 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.220+0000 7fd8b1b63640 1 -- 172.21.15.105:0/1278518848 learned_addr learned my addr 172.21.15.105:0/1278518848 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:22.224 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.220+0000 7fd8b1362640 1 --2- 172.21.15.105:0/1278518848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d002d06270 0x55d0030dc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:22.224 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.220+0000 7fd8b0b61640 1 --2- 172.21.15.105:0/1278518848 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d002cdd3b0 0x55d0030dc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:22.224 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.220+0000 7fd8b1b63640 1 -- 172.21.15.105:0/1278518848 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d002cdd3b0 msgr2=0x55d0030dc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:19:22.224 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.220+0000 7fd8b1b63640 1 --2- 172.21.15.105:0/1278518848 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d002cdd3b0 0x55d0030dc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.224 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.220+0000 7fd8b1b63640 1 -- 172.21.15.105:0/1278518848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d002d06270 msgr2=0x55d0030dc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:19:22.224 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.220+0000 7fd8b1b63640 1 --2- 172.21.15.105:0/1278518848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d002d06270 0x55d0030dc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.224 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.220+0000 7fd8b1b63640 1 -- 172.21.15.105:0/1278518848 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d002d71850 con 0x55d002ce5590 2024-09-21T03:19:22.224 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.220+0000 7fd8b0b61640 1 --2- 172.21.15.105:0/1278518848 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d002cdd3b0 0x55d0030dc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:19:22.224 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.220+0000 7fd8b1b63640 1 --2- 172.21.15.105:0/1278518848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d002ce5590 0x55d0030f9810 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd8a40998d0 tx=0x7fd8a4062ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c57965e43449403 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:22.224 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.220+0000 7fd892ffd640 1 -- 172.21.15.105:0/1278518848 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a4067ce0 con 0x55d002ce5590 2024-09-21T03:19:22.224 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.220+0000 7fd892ffd640 1 -- 172.21.15.105:0/1278518848 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd8a405f520 con 0x55d002ce5590 2024-09-21T03:19:22.225 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.220+0000 7fd892ffd640 1 -- 172.21.15.105:0/1278518848 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a4062510 con 0x55d002ce5590 2024-09-21T03:19:22.225 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.221+0000 7fd8ba61c740 1 -- 172.21.15.105:0/1278518848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d002ce5590 msgr2=0x55d0030f9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:22.225 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.221+0000 7fd8ba61c740 1 --2- 172.21.15.105:0/1278518848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d002ce5590 0x55d0030f9810 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd8a40998d0 tx=0x7fd8a4062ae0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.225 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.221+0000 7fd8ba61c740 1 -- 172.21.15.105:0/1278518848 shutdown_connections 2024-09-21T03:19:22.225 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.221+0000 7fd8ba61c740 1 --2- 172.21.15.105:0/1278518848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d002ce5590 0x55d0030f9810 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.225 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.221+0000 7fd8ba61c740 1 --2- 172.21.15.105:0/1278518848 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d002cdd3b0 0x55d0030dc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.225 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.221+0000 7fd8ba61c740 1 --2- 172.21.15.105:0/1278518848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d002d06270 0x55d0030dc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.225 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.221+0000 7fd8ba61c740 1 -- 172.21.15.105:0/1278518848 >> 172.21.15.105:0/1278518848 conn(0x55d002cfa3c0 msgr2=0x55d0030b2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:22.225 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.221+0000 7fd8ba61c740 1 -- 172.21.15.105:0/1278518848 shutdown_connections 2024-09-21T03:19:22.225 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.221+0000 7fd8ba61c740 1 -- 172.21.15.105:0/1278518848 wait complete. 2024-09-21T03:19:22.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.222+0000 7fd8ba61c740 1 -- start start 2024-09-21T03:19:22.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.222+0000 7fd8ba61c740 1 Processor -- start 2024-09-21T03:19:22.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.223+0000 7fd8ba61c740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d002cdd3b0 0x55d003109ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:22.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.223+0000 7fd8ba61c740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d002ce5590 0x55d0030cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:22.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.223+0000 7fd8ba61c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d002d06270 0x55d0030cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:22.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.223+0000 7fd8ba61c740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55d002d80620 con 0x55d002ce5590 2024-09-21T03:19:22.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.223+0000 7fd8ba61c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d002fb55f0 con 0x55d002d06270 2024-09-21T03:19:22.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.223+0000 7fd8ba61c740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55d0030f7d80 con 0x55d002cdd3b0 2024-09-21T03:19:22.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.224+0000 7fd8ba61c740 10 client.0 _ll_register_callbacks cb 0x55d002fb90a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:19:22.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.224+0000 7fd8b0b61640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d002ce5590 0x55d0030cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:22.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.224+0000 7fd8b0b61640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d002ce5590 0x55d0030cbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:49744/0 (socket says 172.21.15.105:49744) 2024-09-21T03:19:22.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.224+0000 7fd8b0b61640 1 -- 172.21.15.105:0/3356118852 learned_addr learned my addr 172.21.15.105:0/3356118852 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:22.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.224+0000 7fd8b1362640 1 --2- 172.21.15.105:0/3356118852 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d002cdd3b0 0x55d003109ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:22.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.224+0000 7fd8b1b63640 1 --2- 172.21.15.105:0/3356118852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d002d06270 0x55d0030cc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:22.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.224+0000 7fd8b0b61640 1 -- 172.21.15.105:0/3356118852 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d002cdd3b0 msgr2=0x55d003109ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:19:22.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.224+0000 7fd8b0b61640 1 --2- 172.21.15.105:0/3356118852 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d002cdd3b0 0x55d003109ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.224+0000 7fd8b0b61640 1 -- 172.21.15.105:0/3356118852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d002d06270 msgr2=0x55d0030cc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:19:22.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.224+0000 7fd8b0b61640 1 --2- 172.21.15.105:0/3356118852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d002d06270 0x55d0030cc1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.224+0000 7fd8b0b61640 1 -- 172.21.15.105:0/3356118852 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d002de86b0 con 0x55d002ce5590 2024-09-21T03:19:22.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.224+0000 7fd8b0b61640 1 --2- 172.21.15.105:0/3356118852 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d002ce5590 0x55d0030cbcb0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd8a000ba40 tx=0x7fd8a000b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0c9b9243410a91e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:22.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.224+0000 7fd88bfff640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-21T03:19:22.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.224+0000 7fd88bfff640 1 -- 172.21.15.105:0/3356118852 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a0035040 con 0x55d002ce5590 2024-09-21T03:19:22.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.224+0000 7fd88bfff640 1 -- 172.21.15.105:0/3356118852 <== mon.0 v2:172.21.15.105:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fd8a003a9b0 con 0x55d002ce5590 2024-09-21T03:19:22.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.224+0000 7fd8ba61c740 1 -- 172.21.15.105:0/3356118852 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8a405f520 con 0x55d002ce5590 2024-09-21T03:19:22.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.224+0000 7fd88bfff640 1 -- 172.21.15.105:0/3356118852 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fd8a0050050 con 0x55d002ce5590 2024-09-21T03:19:22.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.224+0000 7fd8ba61c740 10 client.5085 fetch_fsmap learned FSMap version 17 2024-09-21T03:19:22.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.224+0000 7fd8ba61c740 1 -- 172.21.15.105:0/3356118852 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55d003105ea0 con 0x55d002ce5590 2024-09-21T03:19:22.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.224+0000 7fd88bfff640 1 -- 172.21.15.105:0/3356118852 <== mon.0 v2:172.21.15.105:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd8a405f520 con 0x55d002ce5590 2024-09-21T03:19:22.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.225+0000 7fd88bfff640 1 -- 172.21.15.105:0/3356118852 <== mon.0 v2:172.21.15.105:3300/0 5 ==== fsmap(e 17) ==== 3502+0+0 (secure 0 0 0) 0x7fd8a0053020 con 0x55d002ce5590 2024-09-21T03:19:22.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.225+0000 7fd8ba61c740 10 client.5085 fetch_fsmap finished waiting for FSMap version 17 2024-09-21T03:19:22.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.225+0000 7fd8ba61c740 10 client.5085 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T03:19:22.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.225+0000 7fd8ba61c740 20 client.5085 populate_metadata read hostname 'smithi105' 2024-09-21T03:19:22.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.225+0000 7fd8ba61c740 1 --2- 172.21.15.105:0/3356118852 >> [v2:172.21.15.105:6833/1732564681,v1:172.21.15.105:6835/1732564681] conn(0x55d002cc4e40 0x55d0030f0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:22.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.225+0000 7fd8ba61c740 4 client.5085 mds_command: new command op to 4902 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:19:22.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.225+0000 7fd8ba61c740 1 -- 172.21.15.105:0/3356118852 --> [v2:172.21.15.105:6833/1732564681,v1:172.21.15.105:6835/1732564681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d003022770 con 0x55d002cc4e40 2024-09-21T03:19:22.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.225+0000 7fd8b1362640 1 --2- 172.21.15.105:0/3356118852 >> [v2:172.21.15.105:6833/1732564681,v1:172.21.15.105:6835/1732564681] conn(0x55d002cc4e40 0x55d0030f0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:22.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.225+0000 7fd88bfff640 10 client.5085 ms_handle_connect on v2:172.21.15.105:6833/1732564681 2024-09-21T03:19:22.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.225+0000 7fd8b1362640 1 --2- 172.21.15.105:0/3356118852 >> [v2:172.21.15.105:6833/1732564681,v1:172.21.15.105:6835/1732564681] conn(0x55d002cc4e40 0x55d0030f0160 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b074d7cb4c364584 server_cookie=51cdc9e9f3d07626 in_seq=0 out_seq=0 2024-09-21T03:19:22.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.226+0000 7fd88bfff640 1 -- 172.21.15.105:0/3356118852 <== mds.0 v2:172.21.15.105:6833/1732564681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d003022770 con 0x55d002cc4e40 2024-09-21T03:19:22.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.226+0000 7fd88bfff640 10 client.5085 handle_command_reply: tid=0 2024-09-21T03:19:22.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.226+0000 7fd8ba61c740 1 client.5085 shutdown 2024-09-21T03:19:22.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.226+0000 7fd8ba61c740 1 -- 172.21.15.105:0/3356118852 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d002ce5590 msgr2=0x55d0030cbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:22.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.226+0000 7fd8ba61c740 1 --2- 172.21.15.105:0/3356118852 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d002ce5590 0x55d0030cbcb0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd8a000ba40 tx=0x7fd8a000b7b0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.226+0000 7fd8ba61c740 1 -- 172.21.15.105:0/3356118852 shutdown_connections 2024-09-21T03:19:22.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.226+0000 7fd8ba61c740 1 --2- 172.21.15.105:0/3356118852 >> [v2:172.21.15.105:6833/1732564681,v1:172.21.15.105:6835/1732564681] conn(0x55d002cc4e40 0x55d0030f0160 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.226+0000 7fd8ba61c740 1 --2- 172.21.15.105:0/3356118852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d002d06270 0x55d0030cc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.226+0000 7fd8ba61c740 1 --2- 172.21.15.105:0/3356118852 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d002ce5590 0x55d0030cbcb0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.226+0000 7fd88bfff640 0 client.5085 ms_handle_reset on v2:172.21.15.105:6833/1732564681 2024-09-21T03:19:22.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.226+0000 7fd8ba61c740 1 --2- 172.21.15.105:0/3356118852 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d002cdd3b0 0x55d003109ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.226+0000 7fd8ba61c740 1 -- 172.21.15.105:0/3356118852 >> 172.21.15.105:0/3356118852 conn(0x55d002cfa3c0 msgr2=0x55d0030b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:22.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.226+0000 7fd8ba61c740 1 -- 172.21.15.105:0/3356118852 shutdown_connections 2024-09-21T03:19:22.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.226+0000 7fd8ba61c740 1 -- 172.21.15.105:0/3356118852 wait complete. 2024-09-21T03:19:22.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.226+0000 7fd8ba61c740 20 client.5085 trim_cache size 0 max 16384 2024-09-21T03:19:22.246 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.244+0000 7fd8ba61c740 1 Processor -- start 2024-09-21T03:19:22.246 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.244+0000 7fd8ba61c740 1 -- start start 2024-09-21T03:19:22.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.246+0000 7fd8ba61c740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d002cdd3b0 0x55d0030b2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:22.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.246+0000 7fd8ba61c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d002ce5590 0x55d0030b2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:22.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.246+0000 7fd8ba61c740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d002d06270 0x55d003109300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:22.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.246+0000 7fd8ba61c740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ac1e79a0 con 0x55d002d06270 2024-09-21T03:19:22.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.246+0000 7fd8ba61c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ac151970 con 0x55d002ce5590 2024-09-21T03:19:22.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.246+0000 7fd8ba61c740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd8ac1e7350 con 0x55d002cdd3b0 2024-09-21T03:19:22.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.246+0000 7fd8b1b63640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d002d06270 0x55d003109300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:22.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.246+0000 7fd8b1b63640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d002d06270 0x55d003109300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:49756/0 (socket says 172.21.15.105:49756) 2024-09-21T03:19:22.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.246+0000 7fd8b1b63640 1 -- 172.21.15.105:0/3007765345 learned_addr learned my addr 172.21.15.105:0/3007765345 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:22.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.246+0000 7fd8b1362640 1 --2- 172.21.15.105:0/3007765345 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d002cdd3b0 0x55d0030b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:22.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.246+0000 7fd8b1b63640 1 -- 172.21.15.105:0/3007765345 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d002cdd3b0 msgr2=0x55d0030b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:19:22.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.246+0000 7fd8b0b61640 1 --2- 172.21.15.105:0/3007765345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d002ce5590 0x55d0030b2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:22.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.246+0000 7fd8b1b63640 1 --2- 172.21.15.105:0/3007765345 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d002cdd3b0 0x55d0030b2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.246+0000 7fd8b1b63640 1 -- 172.21.15.105:0/3007765345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d002ce5590 msgr2=0x55d0030b2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:19:22.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.246+0000 7fd8b1b63640 1 --2- 172.21.15.105:0/3007765345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d002ce5590 0x55d0030b2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.246+0000 7fd8b1b63640 1 -- 172.21.15.105:0/3007765345 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0030ad6c0 con 0x55d002d06270 2024-09-21T03:19:22.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.246+0000 7fd8b1b63640 1 --2- 172.21.15.105:0/3007765345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d002d06270 0x55d003109300 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4062fb0 tx=0x7fd8a4005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=864edc1ead7191a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:22.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.246+0000 7fd8927fc640 1 -- 172.21.15.105:0/3007765345 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a405f520 con 0x55d002d06270 2024-09-21T03:19:22.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.246+0000 7fd8927fc640 1 -- 172.21.15.105:0/3007765345 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd8a409b0b0 con 0x55d002d06270 2024-09-21T03:19:22.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.246+0000 7fd8927fc640 1 -- 172.21.15.105:0/3007765345 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a4062770 con 0x55d002d06270 2024-09-21T03:19:22.251 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.247+0000 7fd8ba61c740 1 -- 172.21.15.105:0/3007765345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d002d06270 msgr2=0x55d003109300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:22.251 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.247+0000 7fd8ba61c740 1 --2- 172.21.15.105:0/3007765345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d002d06270 0x55d003109300 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4062fb0 tx=0x7fd8a4005040 comp rx=0 tx=0).stop 2024-09-21T03:19:22.251 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.247+0000 7fd8ba61c740 1 -- 172.21.15.105:0/3007765345 shutdown_connections 2024-09-21T03:19:22.251 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.247+0000 7fd8ba61c740 1 --2- 172.21.15.105:0/3007765345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d002d06270 0x55d003109300 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.251 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.247+0000 7fd8ba61c740 1 --2- 172.21.15.105:0/3007765345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d002ce5590 0x55d0030b2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.251 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.247+0000 7fd8ba61c740 1 --2- 172.21.15.105:0/3007765345 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d002cdd3b0 0x55d0030b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.251 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.247+0000 7fd8ba61c740 1 -- 172.21.15.105:0/3007765345 >> 172.21.15.105:0/3007765345 conn(0x55d002cfa3c0 msgr2=0x55d0030cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:22.251 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.247+0000 7fd8ba61c740 1 -- 172.21.15.105:0/3007765345 shutdown_connections 2024-09-21T03:19:22.251 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.247+0000 7fd8ba61c740 1 -- 172.21.15.105:0/3007765345 wait complete. 2024-09-21T03:19:22.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.248+0000 7fd8ba61c740 1 -- start start 2024-09-21T03:19:22.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.248+0000 7fd8ba61c740 1 Processor -- start 2024-09-21T03:19:22.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.249+0000 7fd8ba61c740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d002cdd3b0 0x55d00316d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:22.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.249+0000 7fd8ba61c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d002ce5590 0x55d0030f0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:22.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.249+0000 7fd8ba61c740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d002d06270 0x55d0030f0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:22.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.249+0000 7fd8ba61c740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55d0030caff0 con 0x55d002cdd3b0 2024-09-21T03:19:22.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.249+0000 7fd8ba61c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d0030f10e0 con 0x55d002ce5590 2024-09-21T03:19:22.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.250+0000 7fd8ba61c740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55d0030ee490 con 0x55d002d06270 2024-09-21T03:19:22.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.250+0000 7fd8ba61c740 10 client.0 _ll_register_callbacks cb 0x7fd89400c030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:19:22.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.250+0000 7fd8b1362640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d002cdd3b0 0x55d00316d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:22.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.250+0000 7fd8b1362640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d002cdd3b0 0x55d00316d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:49762/0 (socket says 172.21.15.105:49762) 2024-09-21T03:19:22.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.250+0000 7fd8b1362640 1 -- 172.21.15.105:0/3330613343 learned_addr learned my addr 172.21.15.105:0/3330613343 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:22.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.250+0000 7fd8b1b63640 1 --2- 172.21.15.105:0/3330613343 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d002d06270 0x55d0030f0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:22.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.250+0000 7fd8b0b61640 1 --2- 172.21.15.105:0/3330613343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d002ce5590 0x55d0030f0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:22.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.250+0000 7fd8b1362640 1 -- 172.21.15.105:0/3330613343 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d002d06270 msgr2=0x55d0030f0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:19:22.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.250+0000 7fd8b1362640 1 --2- 172.21.15.105:0/3330613343 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d002d06270 0x55d0030f0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.250+0000 7fd8b1362640 1 -- 172.21.15.105:0/3330613343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d002ce5590 msgr2=0x55d0030f0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:19:22.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.250+0000 7fd8b1362640 1 --2- 172.21.15.105:0/3330613343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d002ce5590 0x55d0030f0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.250+0000 7fd8b1362640 1 -- 172.21.15.105:0/3330613343 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0030f7e80 con 0x55d002cdd3b0 2024-09-21T03:19:22.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.250+0000 7fd8b0b61640 1 --2- 172.21.15.105:0/3330613343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d002ce5590 0x55d0030f0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:19:22.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.250+0000 7fd8b1362640 1 --2- 172.21.15.105:0/3330613343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d002cdd3b0 0x55d00316d4c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd89c003ef0 tx=0x7fd89c014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28f4f60130e69cf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:22.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.250+0000 7fd88bfff640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-21T03:19:22.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.250+0000 7fd88bfff640 1 -- 172.21.15.105:0/3330613343 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89c012e60 con 0x55d002cdd3b0 2024-09-21T03:19:22.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.250+0000 7fd88bfff640 1 -- 172.21.15.105:0/3330613343 <== mon.0 v2:172.21.15.105:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fd89c02d840 con 0x55d002cdd3b0 2024-09-21T03:19:22.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.250+0000 7fd8ba61c740 1 -- 172.21.15.105:0/3330613343 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8a409b0b0 con 0x55d002cdd3b0 2024-09-21T03:19:22.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.250+0000 7fd88bfff640 1 -- 172.21.15.105:0/3330613343 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fd89c02da40 con 0x55d002cdd3b0 2024-09-21T03:19:22.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.250+0000 7fd8ba61c740 10 client.5091 fetch_fsmap learned FSMap version 17 2024-09-21T03:19:22.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.250+0000 7fd8ba61c740 1 -- 172.21.15.105:0/3330613343 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55d003110170 con 0x55d002cdd3b0 2024-09-21T03:19:22.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.251+0000 7fd88bfff640 1 -- 172.21.15.105:0/3330613343 <== mon.0 v2:172.21.15.105:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd8a409b0b0 con 0x55d002cdd3b0 2024-09-21T03:19:22.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.251+0000 7fd88bfff640 1 -- 172.21.15.105:0/3330613343 <== mon.0 v2:172.21.15.105:3300/0 5 ==== fsmap(e 17) ==== 3502+0+0 (secure 0 0 0) 0x7fd89c031020 con 0x55d002cdd3b0 2024-09-21T03:19:22.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.251+0000 7fd8ba61c740 10 client.5091 fetch_fsmap finished waiting for FSMap version 17 2024-09-21T03:19:22.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.251+0000 7fd8ba61c740 10 client.5091 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T03:19:22.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.251+0000 7fd8ba61c740 20 client.5091 populate_metadata read hostname 'smithi105' 2024-09-21T03:19:22.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.251+0000 7fd8ba61c740 1 --2- 172.21.15.105:0/3330613343 >> [v2:172.21.15.105:6833/1732564681,v1:172.21.15.105:6835/1732564681] conn(0x55d003176be0 0x55d003176ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:22.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.251+0000 7fd8ba61c740 4 client.5091 mds_command: new command op to 4902 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T03:19:22.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.251+0000 7fd8ba61c740 1 -- 172.21.15.105:0/3330613343 --> [v2:172.21.15.105:6833/1732564681,v1:172.21.15.105:6835/1732564681] -- command(tid 0: {"prefix": "status"}) -- 0x55d0030eda90 con 0x55d003176be0 2024-09-21T03:19:22.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.251+0000 7fd8b0b61640 1 --2- 172.21.15.105:0/3330613343 >> [v2:172.21.15.105:6833/1732564681,v1:172.21.15.105:6835/1732564681] conn(0x55d003176be0 0x55d003176ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:22.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.251+0000 7fd88bfff640 10 client.5091 ms_handle_connect on v2:172.21.15.105:6833/1732564681 2024-09-21T03:19:22.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.251+0000 7fd8b0b61640 1 --2- 172.21.15.105:0/3330613343 >> [v2:172.21.15.105:6833/1732564681,v1:172.21.15.105:6835/1732564681] conn(0x55d003176be0 0x55d003176ff0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69ea30fd74c596aa server_cookie=e7995724e9eedf65 in_seq=0 out_seq=0 2024-09-21T03:19:22.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.252+0000 7fd88bfff640 1 -- 172.21.15.105:0/3330613343 <== mds.0 v2:172.21.15.105:6833/1732564681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55d0030eda90 con 0x55d003176be0 2024-09-21T03:19:22.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.252+0000 7fd88bfff640 10 client.5091 handle_command_reply: tid=0 2024-09-21T03:19:22.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.252+0000 7fd8ba61c740 1 client.5091 shutdown 2024-09-21T03:19:22.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.252+0000 7fd8ba61c740 1 -- 172.21.15.105:0/3330613343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d002cdd3b0 msgr2=0x55d00316d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:22.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.252+0000 7fd8ba61c740 1 --2- 172.21.15.105:0/3330613343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d002cdd3b0 0x55d00316d4c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd89c003ef0 tx=0x7fd89c014040 comp rx=0 tx=0).stop 2024-09-21T03:19:22.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.252+0000 7fd8ba61c740 1 -- 172.21.15.105:0/3330613343 shutdown_connections 2024-09-21T03:19:22.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.252+0000 7fd8ba61c740 1 --2- 172.21.15.105:0/3330613343 >> [v2:172.21.15.105:6833/1732564681,v1:172.21.15.105:6835/1732564681] conn(0x55d003176be0 0x55d003176ff0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.252+0000 7fd8ba61c740 1 --2- 172.21.15.105:0/3330613343 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d002d06270 0x55d0030f0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.252+0000 7fd8ba61c740 1 --2- 172.21.15.105:0/3330613343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d002ce5590 0x55d0030f0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.252+0000 7fd88bfff640 0 client.5091 ms_handle_reset on v2:172.21.15.105:6833/1732564681 2024-09-21T03:19:22.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.252+0000 7fd8ba61c740 1 --2- 172.21.15.105:0/3330613343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d002cdd3b0 0x55d00316d4c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.252+0000 7fd8ba61c740 1 -- 172.21.15.105:0/3330613343 >> 172.21.15.105:0/3330613343 conn(0x55d002cfa3c0 msgr2=0x55d0030ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:22.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.252+0000 7fd8ba61c740 1 -- 172.21.15.105:0/3330613343 shutdown_connections 2024-09-21T03:19:22.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.252+0000 7fd8ba61c740 1 -- 172.21.15.105:0/3330613343 wait complete. 2024-09-21T03:19:22.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.252+0000 7fd8ba61c740 20 client.5091 trim_cache size 0 max 16384 2024-09-21T03:19:22.260 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-21T03:19:22.260 INFO:teuthology.orchestra.run.smithi105.stdout: "cluster_fsid": "29d80f4f-e5de-4b26-8384-24c2d8019945", 2024-09-21T03:19:22.260 INFO:teuthology.orchestra.run.smithi105.stdout: "whoami": 0, 2024-09-21T03:19:22.260 INFO:teuthology.orchestra.run.smithi105.stdout: "id": 4902, 2024-09-21T03:19:22.261 INFO:teuthology.orchestra.run.smithi105.stdout: "want_state": "up:active", 2024-09-21T03:19:22.261 INFO:teuthology.orchestra.run.smithi105.stdout: "state": "up:active", 2024-09-21T03:19:22.261 INFO:teuthology.orchestra.run.smithi105.stdout: "fs_name": "cephfs", 2024-09-21T03:19:22.261 INFO:teuthology.orchestra.run.smithi105.stdout: "rank_uptime": 10.141529329999999, 2024-09-21T03:19:22.261 INFO:teuthology.orchestra.run.smithi105.stdout: "mdsmap_epoch": 17, 2024-09-21T03:19:22.261 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_epoch": 34, 2024-09-21T03:19:22.261 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_epoch_barrier": 34, 2024-09-21T03:19:22.261 INFO:teuthology.orchestra.run.smithi105.stdout: "uptime": 17.182618506000001 2024-09-21T03:19:22.261 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-21T03:19:22.262 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.252+0000 7fd8b35c6640 1 -- 172.21.15.105:0/3544123983 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd898078b90 msgr2=0x7fd89807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:22.262 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.252+0000 7fd8b35c6640 1 --2- 172.21.15.105:0/3544123983 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd898078b90 0x7fd89807b0a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd89c000f80 tx=0x7fd89c006ef0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.262 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.252+0000 7fd8b35c6640 1 -- 172.21.15.105:0/3544123983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8ac1550a0 msgr2=0x7fd8ac15b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:22.263 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.252+0000 7fd8b35c6640 1 --2- 172.21.15.105:0/3544123983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8ac1550a0 0x7fd8ac15b100 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac0b7f90 tx=0x7fd8a40039c0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.263 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.253+0000 7fd8b35c6640 1 -- 172.21.15.105:0/3544123983 shutdown_connections 2024-09-21T03:19:22.263 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.253+0000 7fd8b35c6640 1 --2- 172.21.15.105:0/3544123983 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd898078b90 0x7fd89807b0a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.263 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.253+0000 7fd8b35c6640 1 --2- 172.21.15.105:0/3544123983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8ac1550a0 0x7fd8ac15b100 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.263 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.253+0000 7fd8b35c6640 1 --2- 172.21.15.105:0/3544123983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8ac154c90 0x7fd8ac1f6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.263 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.253+0000 7fd8b35c6640 1 --2- 172.21.15.105:0/3544123983 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd894004800 0x7fd8ac15e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.263 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.253+0000 7fd8b35c6640 1 -- 172.21.15.105:0/3544123983 >> 172.21.15.105:0/3544123983 conn(0x7fd8ac0710b0 msgr2=0x7fd8ac0b3670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:22.263 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.253+0000 7fd8b35c6640 1 -- 172.21.15.105:0/3544123983 shutdown_connections 2024-09-21T03:19:22.263 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.253+0000 7fd8b35c6640 1 -- 172.21.15.105:0/3544123983 wait complete. 2024-09-21T03:19:22.265 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T03:19:22.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.376+0000 7fe7b3943640 1 -- 172.21.15.105:0/1442864318 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe798004800 msgr2=0x7fe798004c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:22.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.376+0000 7fe7b3943640 1 --2- 172.21.15.105:0/1442864318 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe798004800 0x7fe798004c70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe79c009b50 tx=0x7fe798005830 comp rx=0 tx=0).stop 2024-09-21T03:19:22.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.376+0000 7fe7b3943640 1 -- 172.21.15.105:0/1442864318 shutdown_connections 2024-09-21T03:19:22.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.376+0000 7fe7b3943640 1 --2- 172.21.15.105:0/1442864318 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe798004800 0x7fe798004c70 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.376+0000 7fe7b3943640 1 -- 172.21.15.105:0/1442864318 >> 172.21.15.105:0/1442864318 conn(0x7fe7ac0cee20 msgr2=0x7fe7ac0cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:22.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.376+0000 7fe7b3943640 1 -- 172.21.15.105:0/1442864318 shutdown_connections 2024-09-21T03:19:22.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.376+0000 7fe7b3943640 1 -- 172.21.15.105:0/1442864318 wait complete. 2024-09-21T03:19:22.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.378+0000 7fe7b3943640 1 Processor -- start 2024-09-21T03:19:22.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.378+0000 7fe7b3943640 1 -- start start 2024-09-21T03:19:22.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.379+0000 7fe7b3943640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe798004800 0x7fe7ac14cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:22.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.379+0000 7fe7b3943640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7ac1e6620 0x7fe7ac1e6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:22.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.379+0000 7fe7b3943640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7ac0caaa0 0x7fe7ac0caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:22.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.379+0000 7fe7b3943640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ac0b3fa0 con 0x7fe798004800 2024-09-21T03:19:22.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.379+0000 7fe7b3943640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ac0b3e20 con 0x7fe7ac1e6620 2024-09-21T03:19:22.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.379+0000 7fe7b3943640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe7ac0b4120 con 0x7fe7ac0caaa0 2024-09-21T03:19:22.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.380+0000 7fe7b16df640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe798004800 0x7fe7ac14cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:22.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.380+0000 7fe7b16df640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe798004800 0x7fe7ac14cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:49794/0 (socket says 172.21.15.105:49794) 2024-09-21T03:19:22.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.380+0000 7fe7b16df640 1 -- 172.21.15.105:0/3477400763 learned_addr learned my addr 172.21.15.105:0/3477400763 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:22.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.380+0000 7fe7b0ede640 1 --2- 172.21.15.105:0/3477400763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7ac1e6620 0x7fe7ac1e6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:22.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.380+0000 7fe7b1ee0640 1 --2- 172.21.15.105:0/3477400763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7ac0caaa0 0x7fe7ac0caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:22.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.380+0000 7fe7b16df640 1 -- 172.21.15.105:0/3477400763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7ac0caaa0 msgr2=0x7fe7ac0caeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:22.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.380+0000 7fe7b16df640 1 --2- 172.21.15.105:0/3477400763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7ac0caaa0 0x7fe7ac0caeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.380+0000 7fe7b16df640 1 -- 172.21.15.105:0/3477400763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7ac1e6620 msgr2=0x7fe7ac1e6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:22.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.380+0000 7fe7b16df640 1 --2- 172.21.15.105:0/3477400763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7ac1e6620 0x7fe7ac1e6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.380+0000 7fe7b16df640 1 -- 172.21.15.105:0/3477400763 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7ac14d660 con 0x7fe798004800 2024-09-21T03:19:22.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.380+0000 7fe7b1ee0640 1 --2- 172.21.15.105:0/3477400763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7ac0caaa0 0x7fe7ac0caeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:19:22.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.380+0000 7fe7b16df640 1 --2- 172.21.15.105:0/3477400763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe798004800 0x7fe7ac14cba0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8003f80 tx=0x7fe7a80018c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:22.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.380+0000 7fe7a1ffb640 1 -- 172.21.15.105:0/3477400763 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a800f720 con 0x7fe798004800 2024-09-21T03:19:22.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.380+0000 7fe7a1ffb640 1 -- 172.21.15.105:0/3477400763 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe7a8016020 con 0x7fe798004800 2024-09-21T03:19:22.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.380+0000 7fe7b3943640 1 -- 172.21.15.105:0/3477400763 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7ac0cb3f0 con 0x7fe798004800 2024-09-21T03:19:22.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.380+0000 7fe7a1ffb640 1 -- 172.21.15.105:0/3477400763 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a800fb80 con 0x7fe798004800 2024-09-21T03:19:22.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.380+0000 7fe7b3943640 1 -- 172.21.15.105:0/3477400763 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7ac1f6990 con 0x7fe798004800 2024-09-21T03:19:22.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.381+0000 7fe7b3943640 1 -- 172.21.15.105:0/3477400763 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7ac1e7190 con 0x7fe798004800 2024-09-21T03:19:22.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.382+0000 7fe7a1ffb640 1 -- 172.21.15.105:0/3477400763 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe7a800fd20 con 0x7fe798004800 2024-09-21T03:19:22.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.382+0000 7fe7a1ffb640 1 --2- 172.21.15.105:0/3477400763 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe790078bc0 0x7fe79007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:22.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.383+0000 7fe7a1ffb640 1 -- 172.21.15.105:0/3477400763 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fe7a809b750 con 0x7fe798004800 2024-09-21T03:19:22.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.383+0000 7fe7b0ede640 1 --2- 172.21.15.105:0/3477400763 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe790078bc0 0x7fe79007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:22.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.383+0000 7fe7b0ede640 1 --2- 172.21.15.105:0/3477400763 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe790078bc0 0x7fe79007b0d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe79c035000 tx=0x7fe79c0046c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:22.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.387+0000 7fe7a1ffb640 1 -- 172.21.15.105:0/3477400763 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe7a8020020 con 0x7fe798004800 2024-09-21T03:19:22.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.599+0000 7fe7b3943640 1 -- 172.21.15.105:0/3477400763 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe7ac0b4680 con 0x7fe798004800 2024-09-21T03:19:22.601 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.599+0000 7fe7a1ffb640 1 -- 172.21.15.105:0/3477400763 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7fe7ac0cb3f0 con 0x7fe798004800 2024-09-21T03:19:22.601 INFO:teuthology.orchestra.run.smithi105.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T03:19:22.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.601+0000 7fe7b3943640 1 -- 172.21.15.105:0/3477400763 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe790078bc0 msgr2=0x7fe79007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:22.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.601+0000 7fe7b3943640 1 --2- 172.21.15.105:0/3477400763 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe790078bc0 0x7fe79007b0d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe79c035000 tx=0x7fe79c0046c0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.601+0000 7fe7b3943640 1 -- 172.21.15.105:0/3477400763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe798004800 msgr2=0x7fe7ac14cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:22.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.601+0000 7fe7b3943640 1 --2- 172.21.15.105:0/3477400763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe798004800 0x7fe7ac14cba0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8003f80 tx=0x7fe7a80018c0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.601+0000 7fe7b3943640 1 -- 172.21.15.105:0/3477400763 shutdown_connections 2024-09-21T03:19:22.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.601+0000 7fe7b3943640 1 --2- 172.21.15.105:0/3477400763 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe790078bc0 0x7fe79007b0d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.601+0000 7fe7b3943640 1 --2- 172.21.15.105:0/3477400763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7ac0caaa0 0x7fe7ac0caeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.601+0000 7fe7b3943640 1 --2- 172.21.15.105:0/3477400763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7ac1e6620 0x7fe7ac1e6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.601+0000 7fe7b3943640 1 --2- 172.21.15.105:0/3477400763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe798004800 0x7fe7ac14cba0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:22.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.601+0000 7fe7b3943640 1 -- 172.21.15.105:0/3477400763 >> 172.21.15.105:0/3477400763 conn(0x7fe7ac0cee20 msgr2=0x7fe7ac0d0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:22.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.602+0000 7fe7b3943640 1 -- 172.21.15.105:0/3477400763 shutdown_connections 2024-09-21T03:19:22.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22.602+0000 7fe7b3943640 1 -- 172.21.15.105:0/3477400763 wait complete. 2024-09-21T03:19:22.614 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T03:19:22.614 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T03:19:22.614 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi105.front.sepia.ceph.com 2024-09-21T03:19:22.615 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T03:19:22.615 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T03:19:22.615 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T03:19:22.615 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T03:19:22.615 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T03:19:22.615 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:19:22.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:19:22.615 DEBUG:teuthology.orchestra.run.smithi105:> ip addr 2024-09-21T03:19:22.632 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T03:19:22.632 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T03:19:22.632 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T03:19:22.632 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:19:22.632 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2024-09-21T03:19:22.632 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:19:22.632 INFO:teuthology.orchestra.run.smithi105.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:19:22.632 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b8 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:19:22.632 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f0 2024-09-21T03:19:22.633 INFO:teuthology.orchestra.run.smithi105.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:19:22.633 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b9 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:19:22.633 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f1 2024-09-21T03:19:22.633 INFO:teuthology.orchestra.run.smithi105.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:19:22.633 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:28 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:19:22.633 INFO:teuthology.orchestra.run.smithi105.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T03:19:22.633 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:29 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:19:22.633 INFO:teuthology.orchestra.run.smithi105.stdout: inet 172.21.15.105/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T03:19:22.633 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft 42745sec preferred_lft 42745sec 2024-09-21T03:19:22.633 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::ec4:7aff:fe8f:d429/64 scope link noprefixroute 2024-09-21T03:19:22.634 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:19:22.634 INFO:teuthology.orchestra.run.smithi105.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T03:19:22.634 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 86:15:ed:f2:4e:d8 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:19:22.634 INFO:teuthology.orchestra.run.smithi105.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T03:19:22.634 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:19:22.634 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::80db:6aff:fece:44c2/64 scope link 2024-09-21T03:19:22.634 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:19:22.634 INFO:teuthology.orchestra.run.smithi105.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:19:22.634 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 86:15:ed:f2:4e:d8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T03:19:22.634 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::8415:edff:fef2:4ed8/64 scope link 2024-09-21T03:19:22.634 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:19:22.634 INFO:teuthology.orchestra.run.smithi105.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:19:22.635 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether a2:e9:7c:d4:c7:c7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T03:19:22.635 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::a0e9:7cff:fed4:c7c7/64 scope link 2024-09-21T03:19:22.635 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:19:22.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:19:22.635 DEBUG:teuthology.orchestra.run.smithi105:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T03:19:22.696 INFO:teuthology.orchestra.run.smithi105.stdout:1 2024-09-21T03:19:22.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:19:22.697 DEBUG:teuthology.orchestra.run.smithi105:> route 2024-09-21T03:19:22.755 INFO:teuthology.orchestra.run.smithi105.stdout:Kernel IP routing table 2024-09-21T03:19:22.755 INFO:teuthology.orchestra.run.smithi105.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T03:19:22.755 INFO:teuthology.orchestra.run.smithi105.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T03:19:22.755 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T03:19:22.755 INFO:teuthology.orchestra.run.smithi105.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T03:19:22.756 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:19:22.756 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-21T03:19:22.756 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T03:19:22.756 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T03:19:22.756 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T03:19:22.756 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-21T03:19:22.848 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:19:22.880 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:19:22.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:19:22.886 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-09-21T03:19:22.902 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T03:19:22.902 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T03:19:22.902 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:19:22.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:19:22.903 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set brx.0 up 2024-09-21T03:19:22.968 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:19:22.968 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T03:19:23.024 INFO:teuthology.orchestra.run.smithi105.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:19:23.024 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:19:23.024 DEBUG:teuthology.orchestra.run.smithi105:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T03:19:23.080 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-21T03:19:23.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:19:23.080 DEBUG:teuthology.orchestra.run.smithi105:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:19:23.176 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:19:23.177 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T03:19:23.177 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2024-09-21T03:19:23.187 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:19:23.188 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T03:19:23.188 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2024-09-21T03:19:23.188 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:19:23.188 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:19:23.194 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:19:23.194 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T03:19:23.194 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2024-09-21T03:19:23.194 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:19:23.194 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:19:23.194 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-21T03:19:23.194 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-21T03:19:23.194 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=29d80f4f-e5de-4b26-8384-24c2d8019945" will pass to kernel 2024-09-21T03:19:23.195 INFO:teuthology.orchestra.run.smithi105.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T03:19:23.195 INFO:teuthology.orchestra.run.smithi105.stdout: You just mounted a file system that supports labels which does not 2024-09-21T03:19:23.195 INFO:teuthology.orchestra.run.smithi105.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T03:19:23.195 INFO:teuthology.orchestra.run.smithi105.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T03:19:23.195 INFO:teuthology.orchestra.run.smithi105.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T03:19:23.196 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T03:19:23.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:19:23.196 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T03:19:23.221 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:19:23.311 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:19:23.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:19:23.323 INFO:teuthology.orchestra.run.smithi105.stdout:client4948 2024-09-21T03:19:23.323 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:19:23.323 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:19:23.340 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T03:19:23.494 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.492+0000 7fd6d7427640 1 -- 172.21.15.105:0/514200065 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6d00b0520 msgr2=0x7fd6d0071650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:23.494 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.492+0000 7fd6d7427640 1 --2- 172.21.15.105:0/514200065 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6d00b0520 0x7fd6d0071650 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0075320 tx=0x7fd6c002a560 comp rx=0 tx=0).stop 2024-09-21T03:19:23.494 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.492+0000 7fd6d7427640 1 -- 172.21.15.105:0/514200065 shutdown_connections 2024-09-21T03:19:23.494 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.492+0000 7fd6d7427640 1 --2- 172.21.15.105:0/514200065 >> v2:172.21.15.162:3300/0 conn(0x7fd6d00b2cb0 0x7fd6d00b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:23.494 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.492+0000 7fd6d7427640 1 --2- 172.21.15.105:0/514200065 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6d00b0520 0x7fd6d0071650 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:23.494 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.492+0000 7fd6d7427640 1 --2- 172.21.15.105:0/514200065 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6d015b8f0 0x7fd6d00cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:23.494 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.492+0000 7fd6d7427640 1 -- 172.21.15.105:0/514200065 >> 172.21.15.105:0/514200065 conn(0x7fd6d00cdcb0 msgr2=0x7fd6d00ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:23.494 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.492+0000 7fd6d7427640 1 -- 172.21.15.105:0/514200065 shutdown_connections 2024-09-21T03:19:23.495 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.492+0000 7fd6d7427640 1 -- 172.21.15.105:0/514200065 wait complete. 2024-09-21T03:19:23.495 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.494+0000 7fd6d7427640 1 Processor -- start 2024-09-21T03:19:23.495 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.494+0000 7fd6d7427640 1 -- start start 2024-09-21T03:19:23.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.495+0000 7fd6d7427640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6d00b0520 0x7fd6d009eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:23.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.495+0000 7fd6d7427640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6d00b2cb0 0x7fd6d0146f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:23.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.495+0000 7fd6d7427640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6d015b8f0 0x7fd6d014ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:23.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.495+0000 7fd6d7427640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d00adfa0 con 0x7fd6d00b2cb0 2024-09-21T03:19:23.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.495+0000 7fd6d7427640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d0071da0 con 0x7fd6d015b8f0 2024-09-21T03:19:23.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.495+0000 7fd6d7427640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd6d00ae120 con 0x7fd6d00b0520 2024-09-21T03:19:23.499 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.495+0000 7fd6d49c2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6d00b2cb0 0x7fd6d0146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:23.499 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.495+0000 7fd6d49c2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6d00b2cb0 0x7fd6d0146f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:49810/0 (socket says 172.21.15.105:49810) 2024-09-21T03:19:23.499 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.495+0000 7fd6d49c2640 1 -- 172.21.15.105:0/2269383837 learned_addr learned my addr 172.21.15.105:0/2269383837 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:23.499 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.495+0000 7fd6d51c3640 1 --2- 172.21.15.105:0/2269383837 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6d00b0520 0x7fd6d009eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:23.499 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.495+0000 7fd6d59c4640 1 --2- 172.21.15.105:0/2269383837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6d015b8f0 0x7fd6d014ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:23.499 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.495+0000 7fd6d49c2640 1 -- 172.21.15.105:0/2269383837 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6d00b0520 msgr2=0x7fd6d009eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:23.499 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.495+0000 7fd6d49c2640 1 --2- 172.21.15.105:0/2269383837 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6d00b0520 0x7fd6d009eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:23.499 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.495+0000 7fd6d49c2640 1 -- 172.21.15.105:0/2269383837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6d015b8f0 msgr2=0x7fd6d014ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:23.499 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.496+0000 7fd6d49c2640 1 --2- 172.21.15.105:0/2269383837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6d015b8f0 0x7fd6d014ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:23.499 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.496+0000 7fd6d49c2640 1 -- 172.21.15.105:0/2269383837 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6d0147490 con 0x7fd6d00b2cb0 2024-09-21T03:19:23.499 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.496+0000 7fd6d59c4640 1 --2- 172.21.15.105:0/2269383837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6d015b8f0 0x7fd6d014ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:19:23.499 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.496+0000 7fd6d49c2640 1 --2- 172.21.15.105:0/2269383837 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6d00b2cb0 0x7fd6d0146f50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0034040 tx=0x7fd6c00039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:23.499 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.496+0000 7fd6c5ffb640 1 -- 172.21.15.105:0/2269383837 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c003e030 con 0x7fd6d00b2cb0 2024-09-21T03:19:23.499 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.496+0000 7fd6c5ffb640 1 -- 172.21.15.105:0/2269383837 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd6c00047a0 con 0x7fd6d00b2cb0 2024-09-21T03:19:23.499 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.496+0000 7fd6d7427640 1 -- 172.21.15.105:0/2269383837 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6d014a570 con 0x7fd6d00b2cb0 2024-09-21T03:19:23.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.496+0000 7fd6c5ffb640 1 -- 172.21.15.105:0/2269383837 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c0035040 con 0x7fd6d00b2cb0 2024-09-21T03:19:23.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.496+0000 7fd6d7427640 1 -- 172.21.15.105:0/2269383837 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6d0148380 con 0x7fd6d00b2cb0 2024-09-21T03:19:23.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.497+0000 7fd6d7427640 1 -- 172.21.15.105:0/2269383837 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6d00b30c0 con 0x7fd6d00b2cb0 2024-09-21T03:19:23.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.498+0000 7fd6c5ffb640 1 -- 172.21.15.105:0/2269383837 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd6c0041030 con 0x7fd6d00b2cb0 2024-09-21T03:19:23.501 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.498+0000 7fd6c5ffb640 1 --2- 172.21.15.105:0/2269383837 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd6b4078bc0 0x7fd6b407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:23.501 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.498+0000 7fd6c5ffb640 1 -- 172.21.15.105:0/2269383837 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fd6c00bb4f0 con 0x7fd6d00b2cb0 2024-09-21T03:19:23.501 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.498+0000 7fd6d51c3640 1 --2- 172.21.15.105:0/2269383837 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd6b4078bc0 0x7fd6b407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:23.501 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.499+0000 7fd6d51c3640 1 --2- 172.21.15.105:0/2269383837 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd6b4078bc0 0x7fd6b407b0d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc005960 tx=0x7fd6cc0058f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:23.504 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.503+0000 7fd6c5ffb640 1 -- 172.21.15.105:0/2269383837 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd6c00839c0 con 0x7fd6d00b2cb0 2024-09-21T03:19:23.719 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.718+0000 7fd6d7427640 1 -- 172.21.15.105:0/2269383837 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd6d00cf400 con 0x7fd6d00b2cb0 2024-09-21T03:19:23.720 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.718+0000 7fd6c5ffb640 1 -- 172.21.15.105:0/2269383837 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7fd6c00832c0 con 0x7fd6d00b2cb0 2024-09-21T03:19:23.720 INFO:teuthology.orchestra.run.smithi105.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T03:19:23.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.720+0000 7fd6d7427640 1 -- 172.21.15.105:0/2269383837 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd6b4078bc0 msgr2=0x7fd6b407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:23.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.720+0000 7fd6d7427640 1 --2- 172.21.15.105:0/2269383837 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd6b4078bc0 0x7fd6b407b0d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc005960 tx=0x7fd6cc0058f0 comp rx=0 tx=0).stop 2024-09-21T03:19:23.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.720+0000 7fd6d7427640 1 -- 172.21.15.105:0/2269383837 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6d00b2cb0 msgr2=0x7fd6d0146f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:23.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.720+0000 7fd6d7427640 1 --2- 172.21.15.105:0/2269383837 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6d00b2cb0 0x7fd6d0146f50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0034040 tx=0x7fd6c00039e0 comp rx=0 tx=0).stop 2024-09-21T03:19:23.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.721+0000 7fd6d7427640 1 -- 172.21.15.105:0/2269383837 shutdown_connections 2024-09-21T03:19:23.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.721+0000 7fd6d7427640 1 --2- 172.21.15.105:0/2269383837 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd6b4078bc0 0x7fd6b407b0d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:23.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.721+0000 7fd6d7427640 1 --2- 172.21.15.105:0/2269383837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6d015b8f0 0x7fd6d014ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:23.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.721+0000 7fd6d7427640 1 --2- 172.21.15.105:0/2269383837 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6d00b2cb0 0x7fd6d0146f50 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:23.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.721+0000 7fd6d7427640 1 --2- 172.21.15.105:0/2269383837 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6d00b0520 0x7fd6d009eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:23.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.721+0000 7fd6d7427640 1 -- 172.21.15.105:0/2269383837 >> 172.21.15.105:0/2269383837 conn(0x7fd6d00cdcb0 msgr2=0x7fd6d00b4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:23.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.721+0000 7fd6d7427640 1 -- 172.21.15.105:0/2269383837 shutdown_connections 2024-09-21T03:19:23.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:23.721+0000 7fd6d7427640 1 -- 172.21.15.105:0/2269383837 wait complete. 2024-09-21T03:19:23.734 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T03:19:23.734 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T03:19:23.734 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2024-09-21T03:19:23.734 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-21T03:19:23.734 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T03:19:23.734 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T03:19:23.734 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T03:19:23.734 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T03:19:23.734 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T03:19:23.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:19:23.734 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2024-09-21T03:19:23.754 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T03:19:23.754 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T03:19:23.755 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T03:19:23.755 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:19:23.755 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-09-21T03:19:23.755 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:19:23.755 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:19:23.755 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:19:23.755 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f0 2024-09-21T03:19:23.755 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:19:23.755 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:19:23.755 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f1 2024-09-21T03:19:23.755 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:19:23.756 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:19:23.756 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T03:19:23.756 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:19:23.756 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T03:19:23.756 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42737sec preferred_lft 42737sec 2024-09-21T03:19:23.756 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::ec4:7aff:fe88:7f41/64 scope link noprefixroute 2024-09-21T03:19:23.756 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:19:23.756 INFO:teuthology.orchestra.run.smithi162.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T03:19:23.756 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 32:ad:10:1b:86:54 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:19:23.756 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T03:19:23.756 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:19:23.756 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::c03a:6bff:febf:f5a9/64 scope link 2024-09-21T03:19:23.756 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:19:23.756 INFO:teuthology.orchestra.run.smithi162.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:19:23.757 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 32:ad:10:1b:86:54 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T03:19:23.757 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::30ad:10ff:fe1b:8654/64 scope link 2024-09-21T03:19:23.757 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:19:23.757 INFO:teuthology.orchestra.run.smithi162.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:19:23.757 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 6a:62:2d:53:ae:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-21T03:19:23.757 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::6862:2dff:fe53:aec0/64 scope link 2024-09-21T03:19:23.757 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:19:23.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:19:23.757 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T03:19:23.823 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-09-21T03:19:23.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:19:23.824 DEBUG:teuthology.orchestra.run.smithi162:> route 2024-09-21T03:19:23.883 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2024-09-21T03:19:23.884 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T03:19:23.884 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T03:19:23.884 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T03:19:23.884 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T03:19:23.884 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:19:23.884 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-09-21T03:19:23.884 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T03:19:23.884 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T03:19:23.884 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T03:19:23.885 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-09-21T03:19:23.978 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:19:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:19:24.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:19:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:19:24.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:19:24.018 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-09-21T03:19:24.035 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-21T03:19:24.035 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-21T03:19:24.035 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T03:19:24.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:19:24.036 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.0 up 2024-09-21T03:19:24.102 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:19:24.103 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-21T03:19:24.158 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-21T03:19:24.158 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:19:24.159 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-21T03:19:24.213 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-21T03:19:24.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:19:24.213 DEBUG:teuthology.orchestra.run.smithi162:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:19:24.309 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:19:24.309 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T03:19:24.309 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-21T03:19:24.319 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:19:24.320 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T03:19:24.320 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-21T03:19:24.320 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:19:24.320 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:19:24.325 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:19:24.325 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T03:19:24.325 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-21T03:19:24.325 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:19:24.326 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:19:24.326 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-21T03:19:24.326 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-21T03:19:24.326 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=29d80f4f-e5de-4b26-8384-24c2d8019945" will pass to kernel 2024-09-21T03:19:24.326 INFO:teuthology.orchestra.run.smithi162.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-21T03:19:24.326 INFO:teuthology.orchestra.run.smithi162.stdout: You just mounted a file system that supports labels which does not 2024-09-21T03:19:24.326 INFO:teuthology.orchestra.run.smithi162.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T03:19:24.326 INFO:teuthology.orchestra.run.smithi162.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T03:19:24.327 INFO:teuthology.orchestra.run.smithi162.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T03:19:24.328 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T03:19:24.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:19:24.328 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-21T03:19:24.352 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:19:24.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:19:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:19:24.443 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:19:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:19:24.449 INFO:teuthology.orchestra.run.smithi162.stdout:client4766 2024-09-21T03:19:24.450 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:19:24.450 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:19:24.465 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_max_caps_per_client 1 2024-09-21T03:19:24.594 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.592+0000 7f278dbe4640 1 -- 172.21.15.105:0/2739065866 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27880d3870 msgr2=0x7f27880ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:24.594 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.592+0000 7f278dbe4640 1 --2- 172.21.15.105:0/2739065866 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27880d3870 0x7f27880ceb40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f278808d9b0 tx=0x7f278002a4a0 comp rx=0 tx=0).stop 2024-09-21T03:19:24.594 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.592+0000 7f278dbe4640 1 -- 172.21.15.105:0/2739065866 shutdown_connections 2024-09-21T03:19:24.595 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.592+0000 7f278dbe4640 1 --2- 172.21.15.105:0/2739065866 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27880d3870 0x7f27880ceb40 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:24.595 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.592+0000 7f278dbe4640 1 --2- 172.21.15.105:0/2739065866 >> v2:172.21.15.162:3300/0 conn(0x7f27880b3540 0x7f27880d3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:24.595 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.592+0000 7f278dbe4640 1 -- 172.21.15.105:0/2739065866 >> 172.21.15.105:0/2739065866 conn(0x7f278808bfc0 msgr2=0x7f278809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:24.595 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.592+0000 7f278dbe4640 1 -- 172.21.15.105:0/2739065866 shutdown_connections 2024-09-21T03:19:24.595 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.592+0000 7f278dbe4640 1 -- 172.21.15.105:0/2739065866 wait complete. 2024-09-21T03:19:24.596 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.594+0000 7f278dbe4640 1 Processor -- start 2024-09-21T03:19:24.596 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.594+0000 7f278dbe4640 1 -- start start 2024-09-21T03:19:24.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.596+0000 7f278dbe4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27880b3540 0x7f27880c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:24.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.596+0000 7f278dbe4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27880d3870 0x7f27880ca030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:24.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.596+0000 7f278dbe4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27881f6dc0 0x7f27881f71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:24.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.596+0000 7f278dbe4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f27880d0ce0 con 0x7f27880d3870 2024-09-21T03:19:24.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.596+0000 7f278dbe4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f27880cf490 con 0x7f27880b3540 2024-09-21T03:19:24.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.596+0000 7f278dbe4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f27880d0e60 con 0x7f27881f6dc0 2024-09-21T03:19:24.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.596+0000 7f2786ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27880d3870 0x7f27880ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:24.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.596+0000 7f2786ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27880d3870 0x7f27880ca030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:49826/0 (socket says 172.21.15.105:49826) 2024-09-21T03:19:24.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.596+0000 7f2786ffd640 1 -- 172.21.15.105:0/4135047936 learned_addr learned my addr 172.21.15.105:0/4135047936 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:24.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.596+0000 7f27877fe640 1 --2- 172.21.15.105:0/4135047936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27880b3540 0x7f27880c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:24.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.596+0000 7f2787fff640 1 --2- 172.21.15.105:0/4135047936 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27881f6dc0 0x7f27881f71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:24.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.596+0000 7f2786ffd640 1 -- 172.21.15.105:0/4135047936 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27881f6dc0 msgr2=0x7f27881f71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:24.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.596+0000 7f2786ffd640 1 --2- 172.21.15.105:0/4135047936 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27881f6dc0 0x7f27881f71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:24.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.596+0000 7f2786ffd640 1 -- 172.21.15.105:0/4135047936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27880b3540 msgr2=0x7f27880c9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:24.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.596+0000 7f2786ffd640 1 --2- 172.21.15.105:0/4135047936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27880b3540 0x7f27880c9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:24.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.596+0000 7f2786ffd640 1 -- 172.21.15.105:0/4135047936 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27880cace0 con 0x7f27880d3870 2024-09-21T03:19:24.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.596+0000 7f2786ffd640 1 --2- 172.21.15.105:0/4135047936 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27880d3870 0x7f27880ca030 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f277000e710 tx=0x7f277000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:24.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.596+0000 7f277ffff640 1 -- 172.21.15.105:0/4135047936 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2770004230 con 0x7f27880d3870 2024-09-21T03:19:24.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.596+0000 7f277ffff640 1 -- 172.21.15.105:0/4135047936 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f27700043f0 con 0x7f27880d3870 2024-09-21T03:19:24.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.596+0000 7f278dbe4640 1 -- 172.21.15.105:0/4135047936 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27880ca570 con 0x7f27880d3870 2024-09-21T03:19:24.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.596+0000 7f277ffff640 1 -- 172.21.15.105:0/4135047936 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277000cab0 con 0x7f27880d3870 2024-09-21T03:19:24.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.597+0000 7f278dbe4640 1 -- 172.21.15.105:0/4135047936 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27881f62e0 con 0x7f27880d3870 2024-09-21T03:19:24.601 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.598+0000 7f278dbe4640 1 -- 172.21.15.105:0/4135047936 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27880ca740 con 0x7f27880d3870 2024-09-21T03:19:24.601 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.598+0000 7f277ffff640 1 -- 172.21.15.105:0/4135047936 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f27700035f0 con 0x7f27880d3870 2024-09-21T03:19:24.601 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.599+0000 7f277ffff640 1 --2- 172.21.15.105:0/4135047936 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2768078b90 0x7f276807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:24.601 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.599+0000 7f277ffff640 1 -- 172.21.15.105:0/4135047936 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f277009b860 con 0x7f27880d3870 2024-09-21T03:19:24.601 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.599+0000 7f27877fe640 1 --2- 172.21.15.105:0/4135047936 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2768078b90 0x7f276807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:24.601 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.599+0000 7f27877fe640 1 --2- 172.21.15.105:0/4135047936 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2768078b90 0x7f276807b0a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f27780012e0 tx=0x7f2778009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:24.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.603+0000 7f277ffff640 1 -- 172.21.15.105:0/4135047936 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f27700635d0 con 0x7f27880d3870 2024-09-21T03:19:24.781 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.780+0000 7f278dbe4640 1 -- 172.21.15.105:0/4135047936 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command([{prefix=config set, name=mds_max_caps_per_client}] v 0) -- 0x7f278806e170 con 0x7f27880d3870 2024-09-21T03:19:24.785 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.783+0000 7f277ffff640 1 -- 172.21.15.105:0/4135047936 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_max_caps_per_client}]=0 v33)=0 v33) ==== 121+0+0 (secure 0 0 0) 0x7f277009b070 con 0x7f27880d3870 2024-09-21T03:19:24.788 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.786+0000 7f278dbe4640 1 -- 172.21.15.105:0/4135047936 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2768078b90 msgr2=0x7f276807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:24.788 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.786+0000 7f278dbe4640 1 --2- 172.21.15.105:0/4135047936 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2768078b90 0x7f276807b0a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f27780012e0 tx=0x7f2778009040 comp rx=0 tx=0).stop 2024-09-21T03:19:24.788 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.786+0000 7f278dbe4640 1 -- 172.21.15.105:0/4135047936 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27880d3870 msgr2=0x7f27880ca030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:24.788 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.786+0000 7f278dbe4640 1 --2- 172.21.15.105:0/4135047936 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27880d3870 0x7f27880ca030 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f277000e710 tx=0x7f277000ebd0 comp rx=0 tx=0).stop 2024-09-21T03:19:24.788 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.786+0000 7f278dbe4640 1 -- 172.21.15.105:0/4135047936 shutdown_connections 2024-09-21T03:19:24.788 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.786+0000 7f278dbe4640 1 --2- 172.21.15.105:0/4135047936 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2768078b90 0x7f276807b0a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:24.788 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.786+0000 7f278dbe4640 1 --2- 172.21.15.105:0/4135047936 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27881f6dc0 0x7f27881f71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:24.788 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.786+0000 7f278dbe4640 1 --2- 172.21.15.105:0/4135047936 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27880d3870 0x7f27880ca030 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:24.789 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.786+0000 7f278dbe4640 1 --2- 172.21.15.105:0/4135047936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27880b3540 0x7f27880c9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:24.789 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.786+0000 7f278dbe4640 1 -- 172.21.15.105:0/4135047936 >> 172.21.15.105:0/4135047936 conn(0x7f278808bfc0 msgr2=0x7f27881619e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:24.789 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.786+0000 7f278dbe4640 1 -- 172.21.15.105:0/4135047936 shutdown_connections 2024-09-21T03:19:24.789 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.786+0000 7f278dbe4640 1 -- 172.21.15.105:0/4135047936 wait complete. 2024-09-21T03:19:24.799 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_session_cap_acquisition_throttle 37 2024-09-21T03:19:24.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.913+0000 7fc725f6e640 1 -- 172.21.15.105:0/3304796171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7200d3870 msgr2=0x7fc7200ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:24.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.913+0000 7fc725f6e640 1 --2- 172.21.15.105:0/3304796171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7200d3870 0x7fc7200ceb40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc72008d9b0 tx=0x7fc71802a820 comp rx=0 tx=0).stop 2024-09-21T03:19:24.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.913+0000 7fc725f6e640 1 -- 172.21.15.105:0/3304796171 shutdown_connections 2024-09-21T03:19:24.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.913+0000 7fc725f6e640 1 --2- 172.21.15.105:0/3304796171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7200d3870 0x7fc7200ceb40 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:24.916 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.913+0000 7fc725f6e640 1 --2- 172.21.15.105:0/3304796171 >> v2:172.21.15.162:3300/0 conn(0x7fc7200b3540 0x7fc7200d3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:24.916 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.913+0000 7fc725f6e640 1 -- 172.21.15.105:0/3304796171 >> 172.21.15.105:0/3304796171 conn(0x7fc72008bfc0 msgr2=0x7fc72009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:24.916 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.913+0000 7fc725f6e640 1 -- 172.21.15.105:0/3304796171 shutdown_connections 2024-09-21T03:19:24.916 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.913+0000 7fc725f6e640 1 -- 172.21.15.105:0/3304796171 wait complete. 2024-09-21T03:19:24.916 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.915+0000 7fc725f6e640 1 Processor -- start 2024-09-21T03:19:24.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.915+0000 7fc725f6e640 1 -- start start 2024-09-21T03:19:24.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.916+0000 7fc725f6e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7200b3540 0x7fc7200cca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:24.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.917+0000 7fc725f6e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7200d3870 0x7fc7201f8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:24.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.917+0000 7fc725f6e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7201f9150 0x7fc7200b89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:24.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.917+0000 7fc725f6e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc7200d0ce0 con 0x7fc7200d3870 2024-09-21T03:19:24.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.917+0000 7fc725f6e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc7200cf480 con 0x7fc7200b3540 2024-09-21T03:19:24.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.917+0000 7fc725f6e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc7200d0e60 con 0x7fc7201f9150 2024-09-21T03:19:24.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.917+0000 7fc71effd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7200d3870 0x7fc7201f8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:24.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.917+0000 7fc71effd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7200d3870 0x7fc7201f8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:49842/0 (socket says 172.21.15.105:49842) 2024-09-21T03:19:24.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.917+0000 7fc71effd640 1 -- 172.21.15.105:0/2766237835 learned_addr learned my addr 172.21.15.105:0/2766237835 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:19:24.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.917+0000 7fc71f7fe640 1 --2- 172.21.15.105:0/2766237835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7200b3540 0x7fc7200cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:24.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.917+0000 7fc71ffff640 1 --2- 172.21.15.105:0/2766237835 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7201f9150 0x7fc7200b89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:24.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.917+0000 7fc71effd640 1 -- 172.21.15.105:0/2766237835 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7201f9150 msgr2=0x7fc7200b89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:24.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.917+0000 7fc71effd640 1 --2- 172.21.15.105:0/2766237835 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7201f9150 0x7fc7200b89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:24.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.917+0000 7fc71effd640 1 -- 172.21.15.105:0/2766237835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7200b3540 msgr2=0x7fc7200cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:24.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.917+0000 7fc71effd640 1 --2- 172.21.15.105:0/2766237835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7200b3540 0x7fc7200cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:24.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.917+0000 7fc71effd640 1 -- 172.21.15.105:0/2766237835 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7201f52d0 con 0x7fc7200d3870 2024-09-21T03:19:24.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.917+0000 7fc71effd640 1 --2- 172.21.15.105:0/2766237835 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7200d3870 0x7fc7201f8c10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc71400d750 tx=0x7fc71400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:24.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.917+0000 7fc707fff640 1 -- 172.21.15.105:0/2766237835 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc714017070 con 0x7fc7200d3870 2024-09-21T03:19:24.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.917+0000 7fc707fff640 1 -- 172.21.15.105:0/2766237835 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc714009d20 con 0x7fc7200d3870 2024-09-21T03:19:24.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.917+0000 7fc725f6e640 1 -- 172.21.15.105:0/2766237835 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7201f55b0 con 0x7fc7200d3870 2024-09-21T03:19:24.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.917+0000 7fc707fff640 1 -- 172.21.15.105:0/2766237835 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7140106c0 con 0x7fc7200d3870 2024-09-21T03:19:24.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.917+0000 7fc725f6e640 1 -- 172.21.15.105:0/2766237835 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7200ccf70 con 0x7fc7200d3870 2024-09-21T03:19:24.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.918+0000 7fc725f6e640 1 -- 172.21.15.105:0/2766237835 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc72006e170 con 0x7fc7200d3870 2024-09-21T03:19:24.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.919+0000 7fc707fff640 1 -- 172.21.15.105:0/2766237835 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc71401a070 con 0x7fc7200d3870 2024-09-21T03:19:24.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.920+0000 7fc707fff640 1 --2- 172.21.15.105:0/2766237835 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc70c078bc0 0x7fc70c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:19:24.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.920+0000 7fc707fff640 1 -- 172.21.15.105:0/2766237835 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fc71409acc0 con 0x7fc7200d3870 2024-09-21T03:19:24.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.920+0000 7fc71f7fe640 1 --2- 172.21.15.105:0/2766237835 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc70c078bc0 0x7fc70c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:19:24.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.921+0000 7fc71f7fe640 1 --2- 172.21.15.105:0/2766237835 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc70c078bc0 0x7fc70c07b0d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc710000f60 tx=0x7fc710009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:19:24.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:24.925+0000 7fc707fff640 1 -- 172.21.15.105:0/2766237835 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc71400de60 con 0x7fc7200d3870 2024-09-21T03:19:25.103 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:25.102+0000 7fc725f6e640 1 -- 172.21.15.105:0/2766237835 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command([{prefix=config set, name=mds_session_cap_acquisition_throttle}] v 0) -- 0x7fc7200cd1d0 con 0x7fc7200d3870 2024-09-21T03:19:25.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:25.105+0000 7fc707fff640 1 -- 172.21.15.105:0/2766237835 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_session_cap_acquisition_throttle}]=0 v34)=0 v34) ==== 135+0+0 (secure 0 0 0) 0x7fc714062b40 con 0x7fc7200d3870 2024-09-21T03:19:25.109 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:25.107+0000 7fc725f6e640 1 -- 172.21.15.105:0/2766237835 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc70c078bc0 msgr2=0x7fc70c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:25.109 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:25.107+0000 7fc725f6e640 1 --2- 172.21.15.105:0/2766237835 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc70c078bc0 0x7fc70c07b0d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc710000f60 tx=0x7fc710009040 comp rx=0 tx=0).stop 2024-09-21T03:19:25.109 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:25.107+0000 7fc725f6e640 1 -- 172.21.15.105:0/2766237835 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7200d3870 msgr2=0x7fc7201f8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:19:25.109 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:25.107+0000 7fc725f6e640 1 --2- 172.21.15.105:0/2766237835 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7200d3870 0x7fc7201f8c10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc71400d750 tx=0x7fc71400dc10 comp rx=0 tx=0).stop 2024-09-21T03:19:25.109 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:25.107+0000 7fc725f6e640 1 -- 172.21.15.105:0/2766237835 shutdown_connections 2024-09-21T03:19:25.110 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:25.107+0000 7fc725f6e640 1 --2- 172.21.15.105:0/2766237835 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc70c078bc0 0x7fc70c07b0d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:25.110 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:25.107+0000 7fc725f6e640 1 --2- 172.21.15.105:0/2766237835 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7201f9150 0x7fc7200b89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:25.110 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:25.107+0000 7fc725f6e640 1 --2- 172.21.15.105:0/2766237835 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7200d3870 0x7fc7201f8c10 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:25.110 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:25.107+0000 7fc725f6e640 1 --2- 172.21.15.105:0/2766237835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7200b3540 0x7fc7200cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:19:25.110 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:25.108+0000 7fc725f6e640 1 -- 172.21.15.105:0/2766237835 >> 172.21.15.105:0/2766237835 conn(0x7fc72008bfc0 msgr2=0x7fc720068f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:19:25.110 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:25.108+0000 7fc725f6e640 1 -- 172.21.15.105:0/2766237835 shutdown_connections 2024-09-21T03:19:25.110 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:25.108+0000 7fc725f6e640 1 -- 172.21.15.105:0/2766237835 wait complete. 2024-09-21T03:19:25.121 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:19:25.121 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:19:25.136 DEBUG:teuthology.orchestra.run.smithi105:> stdin-killer -- python3 -c ' 2024-09-21T03:19:25.136 DEBUG:teuthology.orchestra.run.smithi105:> import os 2024-09-21T03:19:25.137 DEBUG:teuthology.orchestra.run.smithi105:> import uuid 2024-09-21T03:19:25.137 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-21T03:19:25.137 DEBUG:teuthology.orchestra.run.smithi105:> n = 25 2024-09-21T03:19:25.137 DEBUG:teuthology.orchestra.run.smithi105:> create_hard_links = False 2024-09-21T03:19:25.137 DEBUG:teuthology.orchestra.run.smithi105:> if 0 > 0: 2024-09-21T03:19:25.137 DEBUG:teuthology.orchestra.run.smithi105:> create_hard_links = True 2024-09-21T03:19:25.137 DEBUG:teuthology.orchestra.run.smithi105:> path = "/home/ubuntu/cephtest/mnt.0/dir1/file" 2024-09-21T03:19:25.137 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-21T03:19:25.137 DEBUG:teuthology.orchestra.run.smithi105:> dpath = os.path.dirname(path) 2024-09-21T03:19:25.137 DEBUG:teuthology.orchestra.run.smithi105:> fnameprefix = os.path.basename(path) 2024-09-21T03:19:25.137 DEBUG:teuthology.orchestra.run.smithi105:> os.makedirs(dpath, exist_ok=True) 2024-09-21T03:19:25.137 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-21T03:19:25.137 DEBUG:teuthology.orchestra.run.smithi105:> try: 2024-09-21T03:19:25.137 DEBUG:teuthology.orchestra.run.smithi105:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-21T03:19:25.138 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-21T03:19:25.138 DEBUG:teuthology.orchestra.run.smithi105:> for i in range(n): 2024-09-21T03:19:25.138 DEBUG:teuthology.orchestra.run.smithi105:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-21T03:19:25.138 DEBUG:teuthology.orchestra.run.smithi105:> with open(fpath, '"'"'w'"'"') as f: 2024-09-21T03:19:25.138 DEBUG:teuthology.orchestra.run.smithi105:> f.write(f"{i}") 2024-09-21T03:19:25.138 DEBUG:teuthology.orchestra.run.smithi105:> if True: 2024-09-21T03:19:25.138 DEBUG:teuthology.orchestra.run.smithi105:> f.flush() 2024-09-21T03:19:25.138 DEBUG:teuthology.orchestra.run.smithi105:> os.fsync(f.fileno()) 2024-09-21T03:19:25.138 DEBUG:teuthology.orchestra.run.smithi105:> if False: 2024-09-21T03:19:25.138 DEBUG:teuthology.orchestra.run.smithi105:> os.unlink(fpath) 2024-09-21T03:19:25.138 DEBUG:teuthology.orchestra.run.smithi105:> if False: 2024-09-21T03:19:25.138 DEBUG:teuthology.orchestra.run.smithi105:> os.fsync(dirfd) 2024-09-21T03:19:25.138 DEBUG:teuthology.orchestra.run.smithi105:> if create_hard_links: 2024-09-21T03:19:25.139 DEBUG:teuthology.orchestra.run.smithi105:> for j in range(0): 2024-09-21T03:19:25.139 DEBUG:teuthology.orchestra.run.smithi105:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-21T03:19:25.139 DEBUG:teuthology.orchestra.run.smithi105:> if False: 2024-09-21T03:19:25.139 DEBUG:teuthology.orchestra.run.smithi105:> os.fsync(dirfd) 2024-09-21T03:19:25.139 DEBUG:teuthology.orchestra.run.smithi105:> finally: 2024-09-21T03:19:25.139 DEBUG:teuthology.orchestra.run.smithi105:> os.close(dirfd) 2024-09-21T03:19:25.139 DEBUG:teuthology.orchestra.run.smithi105:> ' 2024-09-21T03:19:25.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:19:25.386 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:19:25.386 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:19:25.442 DEBUG:teuthology.orchestra.run.smithi105:> stdin-killer -- python3 -c ' 2024-09-21T03:19:25.443 DEBUG:teuthology.orchestra.run.smithi105:> import os 2024-09-21T03:19:25.443 DEBUG:teuthology.orchestra.run.smithi105:> import uuid 2024-09-21T03:19:25.443 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-21T03:19:25.443 DEBUG:teuthology.orchestra.run.smithi105:> n = 25 2024-09-21T03:19:25.443 DEBUG:teuthology.orchestra.run.smithi105:> create_hard_links = False 2024-09-21T03:19:25.443 DEBUG:teuthology.orchestra.run.smithi105:> if 0 > 0: 2024-09-21T03:19:25.443 DEBUG:teuthology.orchestra.run.smithi105:> create_hard_links = True 2024-09-21T03:19:25.443 DEBUG:teuthology.orchestra.run.smithi105:> path = "/home/ubuntu/cephtest/mnt.0/dir2/file" 2024-09-21T03:19:25.443 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-21T03:19:25.443 DEBUG:teuthology.orchestra.run.smithi105:> dpath = os.path.dirname(path) 2024-09-21T03:19:25.443 DEBUG:teuthology.orchestra.run.smithi105:> fnameprefix = os.path.basename(path) 2024-09-21T03:19:25.443 DEBUG:teuthology.orchestra.run.smithi105:> os.makedirs(dpath, exist_ok=True) 2024-09-21T03:19:25.443 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-21T03:19:25.444 DEBUG:teuthology.orchestra.run.smithi105:> try: 2024-09-21T03:19:25.444 DEBUG:teuthology.orchestra.run.smithi105:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-21T03:19:25.444 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-21T03:19:25.444 DEBUG:teuthology.orchestra.run.smithi105:> for i in range(n): 2024-09-21T03:19:25.444 DEBUG:teuthology.orchestra.run.smithi105:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-21T03:19:25.444 DEBUG:teuthology.orchestra.run.smithi105:> with open(fpath, '"'"'w'"'"') as f: 2024-09-21T03:19:25.444 DEBUG:teuthology.orchestra.run.smithi105:> f.write(f"{i}") 2024-09-21T03:19:25.444 DEBUG:teuthology.orchestra.run.smithi105:> if True: 2024-09-21T03:19:25.444 DEBUG:teuthology.orchestra.run.smithi105:> f.flush() 2024-09-21T03:19:25.444 DEBUG:teuthology.orchestra.run.smithi105:> os.fsync(f.fileno()) 2024-09-21T03:19:25.444 DEBUG:teuthology.orchestra.run.smithi105:> if False: 2024-09-21T03:19:25.444 DEBUG:teuthology.orchestra.run.smithi105:> os.unlink(fpath) 2024-09-21T03:19:25.444 DEBUG:teuthology.orchestra.run.smithi105:> if False: 2024-09-21T03:19:25.444 DEBUG:teuthology.orchestra.run.smithi105:> os.fsync(dirfd) 2024-09-21T03:19:25.444 DEBUG:teuthology.orchestra.run.smithi105:> if create_hard_links: 2024-09-21T03:19:25.444 DEBUG:teuthology.orchestra.run.smithi105:> for j in range(0): 2024-09-21T03:19:25.445 DEBUG:teuthology.orchestra.run.smithi105:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-21T03:19:25.445 DEBUG:teuthology.orchestra.run.smithi105:> if False: 2024-09-21T03:19:25.445 DEBUG:teuthology.orchestra.run.smithi105:> os.fsync(dirfd) 2024-09-21T03:19:25.445 DEBUG:teuthology.orchestra.run.smithi105:> finally: 2024-09-21T03:19:25.445 DEBUG:teuthology.orchestra.run.smithi105:> os.close(dirfd) 2024-09-21T03:19:25.445 DEBUG:teuthology.orchestra.run.smithi105:> ' 2024-09-21T03:19:25.678 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:19:25.684 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:19:25.684 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:19:25.740 DEBUG:teuthology.orchestra.run.smithi105:> stdin-killer -- python3 -c ' 2024-09-21T03:19:25.740 DEBUG:teuthology.orchestra.run.smithi105:> import os 2024-09-21T03:19:25.741 DEBUG:teuthology.orchestra.run.smithi105:> import uuid 2024-09-21T03:19:25.741 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-21T03:19:25.741 DEBUG:teuthology.orchestra.run.smithi105:> n = 25 2024-09-21T03:19:25.741 DEBUG:teuthology.orchestra.run.smithi105:> create_hard_links = False 2024-09-21T03:19:25.741 DEBUG:teuthology.orchestra.run.smithi105:> if 0 > 0: 2024-09-21T03:19:25.741 DEBUG:teuthology.orchestra.run.smithi105:> create_hard_links = True 2024-09-21T03:19:25.741 DEBUG:teuthology.orchestra.run.smithi105:> path = "/home/ubuntu/cephtest/mnt.0/dir3/file" 2024-09-21T03:19:25.741 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-21T03:19:25.741 DEBUG:teuthology.orchestra.run.smithi105:> dpath = os.path.dirname(path) 2024-09-21T03:19:25.741 DEBUG:teuthology.orchestra.run.smithi105:> fnameprefix = os.path.basename(path) 2024-09-21T03:19:25.741 DEBUG:teuthology.orchestra.run.smithi105:> os.makedirs(dpath, exist_ok=True) 2024-09-21T03:19:25.741 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-21T03:19:25.741 DEBUG:teuthology.orchestra.run.smithi105:> try: 2024-09-21T03:19:25.741 DEBUG:teuthology.orchestra.run.smithi105:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-21T03:19:25.741 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-21T03:19:25.741 DEBUG:teuthology.orchestra.run.smithi105:> for i in range(n): 2024-09-21T03:19:25.742 DEBUG:teuthology.orchestra.run.smithi105:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-21T03:19:25.742 DEBUG:teuthology.orchestra.run.smithi105:> with open(fpath, '"'"'w'"'"') as f: 2024-09-21T03:19:25.742 DEBUG:teuthology.orchestra.run.smithi105:> f.write(f"{i}") 2024-09-21T03:19:25.742 DEBUG:teuthology.orchestra.run.smithi105:> if True: 2024-09-21T03:19:25.742 DEBUG:teuthology.orchestra.run.smithi105:> f.flush() 2024-09-21T03:19:25.742 DEBUG:teuthology.orchestra.run.smithi105:> os.fsync(f.fileno()) 2024-09-21T03:19:25.742 DEBUG:teuthology.orchestra.run.smithi105:> if False: 2024-09-21T03:19:25.742 DEBUG:teuthology.orchestra.run.smithi105:> os.unlink(fpath) 2024-09-21T03:19:25.742 DEBUG:teuthology.orchestra.run.smithi105:> if False: 2024-09-21T03:19:25.742 DEBUG:teuthology.orchestra.run.smithi105:> os.fsync(dirfd) 2024-09-21T03:19:25.742 DEBUG:teuthology.orchestra.run.smithi105:> if create_hard_links: 2024-09-21T03:19:25.742 DEBUG:teuthology.orchestra.run.smithi105:> for j in range(0): 2024-09-21T03:19:25.742 DEBUG:teuthology.orchestra.run.smithi105:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-21T03:19:25.742 DEBUG:teuthology.orchestra.run.smithi105:> if False: 2024-09-21T03:19:25.742 DEBUG:teuthology.orchestra.run.smithi105:> os.fsync(dirfd) 2024-09-21T03:19:25.743 DEBUG:teuthology.orchestra.run.smithi105:> finally: 2024-09-21T03:19:25.743 DEBUG:teuthology.orchestra.run.smithi105:> os.close(dirfd) 2024-09-21T03:19:25.743 DEBUG:teuthology.orchestra.run.smithi105:> ' 2024-09-21T03:19:25.973 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:19:25.979 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:19:25.980 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:19:25.981 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:19:26.023 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:19:26.036 DEBUG:teuthology.orchestra.run.smithi105:> stdin-killer -- python3 -c ' 2024-09-21T03:19:26.036 DEBUG:teuthology.orchestra.run.smithi105:> import os 2024-09-21T03:19:26.036 DEBUG:teuthology.orchestra.run.smithi105:> import uuid 2024-09-21T03:19:26.036 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-21T03:19:26.036 DEBUG:teuthology.orchestra.run.smithi105:> n = 25 2024-09-21T03:19:26.036 DEBUG:teuthology.orchestra.run.smithi105:> create_hard_links = False 2024-09-21T03:19:26.037 DEBUG:teuthology.orchestra.run.smithi105:> if 0 > 0: 2024-09-21T03:19:26.037 DEBUG:teuthology.orchestra.run.smithi105:> create_hard_links = True 2024-09-21T03:19:26.037 DEBUG:teuthology.orchestra.run.smithi105:> path = "/home/ubuntu/cephtest/mnt.0/dir4/file" 2024-09-21T03:19:26.037 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-21T03:19:26.037 DEBUG:teuthology.orchestra.run.smithi105:> dpath = os.path.dirname(path) 2024-09-21T03:19:26.037 DEBUG:teuthology.orchestra.run.smithi105:> fnameprefix = os.path.basename(path) 2024-09-21T03:19:26.037 DEBUG:teuthology.orchestra.run.smithi105:> os.makedirs(dpath, exist_ok=True) 2024-09-21T03:19:26.037 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-21T03:19:26.037 DEBUG:teuthology.orchestra.run.smithi105:> try: 2024-09-21T03:19:26.037 DEBUG:teuthology.orchestra.run.smithi105:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-21T03:19:26.037 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-21T03:19:26.037 DEBUG:teuthology.orchestra.run.smithi105:> for i in range(n): 2024-09-21T03:19:26.037 DEBUG:teuthology.orchestra.run.smithi105:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-21T03:19:26.037 DEBUG:teuthology.orchestra.run.smithi105:> with open(fpath, '"'"'w'"'"') as f: 2024-09-21T03:19:26.038 DEBUG:teuthology.orchestra.run.smithi105:> f.write(f"{i}") 2024-09-21T03:19:26.038 DEBUG:teuthology.orchestra.run.smithi105:> if True: 2024-09-21T03:19:26.038 DEBUG:teuthology.orchestra.run.smithi105:> f.flush() 2024-09-21T03:19:26.038 DEBUG:teuthology.orchestra.run.smithi105:> os.fsync(f.fileno()) 2024-09-21T03:19:26.038 DEBUG:teuthology.orchestra.run.smithi105:> if False: 2024-09-21T03:19:26.038 DEBUG:teuthology.orchestra.run.smithi105:> os.unlink(fpath) 2024-09-21T03:19:26.038 DEBUG:teuthology.orchestra.run.smithi105:> if False: 2024-09-21T03:19:26.038 DEBUG:teuthology.orchestra.run.smithi105:> os.fsync(dirfd) 2024-09-21T03:19:26.038 DEBUG:teuthology.orchestra.run.smithi105:> if create_hard_links: 2024-09-21T03:19:26.038 DEBUG:teuthology.orchestra.run.smithi105:> for j in range(0): 2024-09-21T03:19:26.038 DEBUG:teuthology.orchestra.run.smithi105:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-21T03:19:26.038 DEBUG:teuthology.orchestra.run.smithi105:> if False: 2024-09-21T03:19:26.038 DEBUG:teuthology.orchestra.run.smithi105:> os.fsync(dirfd) 2024-09-21T03:19:26.038 DEBUG:teuthology.orchestra.run.smithi105:> finally: 2024-09-21T03:19:26.039 DEBUG:teuthology.orchestra.run.smithi105:> os.close(dirfd) 2024-09-21T03:19:26.039 DEBUG:teuthology.orchestra.run.smithi105:> ' 2024-09-21T03:19:26.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:19:26.288 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:19:26.288 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:19:26.303 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:19:26.391 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:19:26.393 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:19:26.399 INFO:teuthology.orchestra.run.smithi105.stdout:client4948 2024-09-21T03:19:26.399 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'find . | wc') 2024-09-21T03:19:26.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:19:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:19:56.080 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:19:56.084 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:20:05.467 INFO:teuthology.orchestra.run.smithi105.stdout: 105 105 1490 2024-09-21T03:20:05.467 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:20:05.476 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:20:05.607 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.604+0000 7f5ed27a1640 1 -- 172.21.15.105:0/4133129933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ecc0b4d90 msgr2=0x7f5ecc072e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:05.607 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.604+0000 7f5ed27a1640 1 --2- 172.21.15.105:0/4133129933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ecc0b4d90 0x7f5ecc072e30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc0b2bb0 tx=0x7f5ebc02b700 comp rx=0 tx=0).stop 2024-09-21T03:20:05.607 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.604+0000 7f5ed27a1640 1 -- 172.21.15.105:0/4133129933 shutdown_connections 2024-09-21T03:20:05.607 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.604+0000 7f5ed27a1640 1 --2- 172.21.15.105:0/4133129933 >> v2:172.21.15.162:3300/0 conn(0x7f5ecc070390 0x7f5ecc164b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:05.607 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.604+0000 7f5ed27a1640 1 --2- 172.21.15.105:0/4133129933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ecc0b4d90 0x7f5ecc072e30 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:05.607 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.604+0000 7f5ed27a1640 1 -- 172.21.15.105:0/4133129933 >> 172.21.15.105:0/4133129933 conn(0x7f5ecc06d7d0 msgr2=0x7f5ecc0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:05.607 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.604+0000 7f5ed27a1640 1 -- 172.21.15.105:0/4133129933 shutdown_connections 2024-09-21T03:20:05.607 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.604+0000 7f5ed27a1640 1 -- 172.21.15.105:0/4133129933 wait complete. 2024-09-21T03:20:05.608 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.606+0000 7f5ed27a1640 1 Processor -- start 2024-09-21T03:20:05.609 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.606+0000 7f5ed27a1640 1 -- start start 2024-09-21T03:20:05.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.607+0000 7f5ed27a1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ecc070390 0x7f5ecc1e74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:05.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.607+0000 7f5ed27a1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ecc0cf940 0x7f5ecc1464b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:05.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.607+0000 7f5ed27a1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ecc073c90 0x7f5ecc0740a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:05.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.607+0000 7f5ed27a1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5ecc0ccbc0 con 0x7f5ecc073c90 2024-09-21T03:20:05.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.607+0000 7f5ed27a1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5ecc0709b0 con 0x7f5ecc070390 2024-09-21T03:20:05.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.607+0000 7f5ed27a1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5ecc0ccd40 con 0x7f5ecc0cf940 2024-09-21T03:20:05.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.608+0000 7f5ed0d3e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ecc073c90 0x7f5ecc0740a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:05.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.608+0000 7f5ed0d3e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ecc073c90 0x7f5ecc0740a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58334/0 (socket says 172.21.15.105:58334) 2024-09-21T03:20:05.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.608+0000 7f5ed0d3e640 1 -- 172.21.15.105:0/1451655589 learned_addr learned my addr 172.21.15.105:0/1451655589 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:05.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.608+0000 7f5ecbfff640 1 --2- 172.21.15.105:0/1451655589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ecc070390 0x7f5ecc1e74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:05.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.608+0000 7f5ecb7fe640 1 --2- 172.21.15.105:0/1451655589 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ecc0cf940 0x7f5ecc1464b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:05.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.608+0000 7f5ed0d3e640 1 -- 172.21.15.105:0/1451655589 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ecc0cf940 msgr2=0x7f5ecc1464b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:05.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.608+0000 7f5ed0d3e640 1 --2- 172.21.15.105:0/1451655589 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ecc0cf940 0x7f5ecc1464b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:05.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.608+0000 7f5ed0d3e640 1 -- 172.21.15.105:0/1451655589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ecc070390 msgr2=0x7f5ecc1e74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:05.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.608+0000 7f5ed0d3e640 1 --2- 172.21.15.105:0/1451655589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ecc070390 0x7f5ecc1e74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:05.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.608+0000 7f5ed0d3e640 1 -- 172.21.15.105:0/1451655589 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ecc0745e0 con 0x7f5ecc073c90 2024-09-21T03:20:05.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.608+0000 7f5ecb7fe640 1 --2- 172.21.15.105:0/1451655589 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ecc0cf940 0x7f5ecc1464b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:20:05.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.608+0000 7f5ed0d3e640 1 --2- 172.21.15.105:0/1451655589 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ecc073c90 0x7f5ecc0740a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5ec400ba10 tx=0x7f5ec400bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:05.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.608+0000 7f5ec8ff9640 1 -- 172.21.15.105:0/1451655589 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4019070 con 0x7f5ecc073c90 2024-09-21T03:20:05.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.608+0000 7f5ec8ff9640 1 -- 172.21.15.105:0/1451655589 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ec400cc50 con 0x7f5ecc073c90 2024-09-21T03:20:05.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.608+0000 7f5ed27a1640 1 -- 172.21.15.105:0/1451655589 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ecc1f3700 con 0x7f5ecc073c90 2024-09-21T03:20:05.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.609+0000 7f5ec8ff9640 1 -- 172.21.15.105:0/1451655589 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec40146a0 con 0x7f5ecc073c90 2024-09-21T03:20:05.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.609+0000 7f5ed27a1640 1 -- 172.21.15.105:0/1451655589 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ecc1f3cc0 con 0x7f5ecc073c90 2024-09-21T03:20:05.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.610+0000 7f5ed27a1640 1 -- 172.21.15.105:0/1451655589 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ecc0b4d90 con 0x7f5ecc073c90 2024-09-21T03:20:05.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.610+0000 7f5ec8ff9640 1 -- 172.21.15.105:0/1451655589 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5ec401c070 con 0x7f5ecc073c90 2024-09-21T03:20:05.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.611+0000 7f5ec8ff9640 1 --2- 172.21.15.105:0/1451655589 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5eb8078b90 0x7f5eb807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:05.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.611+0000 7f5ec8ff9640 1 -- 172.21.15.105:0/1451655589 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f5ec409a960 con 0x7f5ecc073c90 2024-09-21T03:20:05.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.611+0000 7f5ecbfff640 1 --2- 172.21.15.105:0/1451655589 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5eb8078b90 0x7f5eb807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:05.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.612+0000 7f5ecbfff640 1 --2- 172.21.15.105:0/1451655589 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5eb8078b90 0x7f5eb807b0a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc034000 tx=0x7f5ebc004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:05.618 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.616+0000 7f5ec8ff9640 1 -- 172.21.15.105:0/1451655589 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5ecc0745e0 con 0x7f5ecc073c90 2024-09-21T03:20:05.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.839+0000 7f5ed27a1640 1 -- 172.21.15.105:0/1451655589 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ecc1e7ba0 con 0x7f5ecc073c90 2024-09-21T03:20:05.842 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.839+0000 7f5ec8ff9640 1 -- 172.21.15.105:0/1451655589 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5232 (secure 0 0 0) 0x7f5ec40627e0 con 0x7f5ecc073c90 2024-09-21T03:20:05.842 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:20:05.842 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":17,"btime":"2024-09-21T03:19:15:120921+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4634,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/517240834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":517240834},{"type":"v1","addr":"172.21.15.162:6837","nonce":517240834}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4774,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3241953393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3241953393},{"type":"v1","addr":"172.21.15.162:6836","nonce":3241953393}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4899,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/2101702562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2101702562},{"type":"v1","addr":"172.21.15.105:6834","nonce":2101702562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:19:11.459432+0000","modified":"2024-09-21T03:19:14.487254+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4902},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4902":{"gid":4902,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1732564681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":1732564681},{"type":"v1","addr":"172.21.15.105:6835","nonce":1732564681}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4902,"qdb_cluster":[4902]},"id":2}]} 2024-09-21T03:20:05.842 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 17 2024-09-21T03:20:05.844 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.841+0000 7f5ed27a1640 1 -- 172.21.15.105:0/1451655589 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5eb8078b90 msgr2=0x7f5eb807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:05.844 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.841+0000 7f5ed27a1640 1 --2- 172.21.15.105:0/1451655589 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5eb8078b90 0x7f5eb807b0a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc034000 tx=0x7f5ebc004730 comp rx=0 tx=0).stop 2024-09-21T03:20:05.844 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.841+0000 7f5ed27a1640 1 -- 172.21.15.105:0/1451655589 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ecc073c90 msgr2=0x7f5ecc0740a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:05.844 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.841+0000 7f5ed27a1640 1 --2- 172.21.15.105:0/1451655589 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ecc073c90 0x7f5ecc0740a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5ec400ba10 tx=0x7f5ec400bed0 comp rx=0 tx=0).stop 2024-09-21T03:20:05.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.841+0000 7f5ed27a1640 1 -- 172.21.15.105:0/1451655589 shutdown_connections 2024-09-21T03:20:05.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.841+0000 7f5ed27a1640 1 --2- 172.21.15.105:0/1451655589 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5eb8078b90 0x7f5eb807b0a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:05.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.841+0000 7f5ed27a1640 1 --2- 172.21.15.105:0/1451655589 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ecc073c90 0x7f5ecc0740a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:05.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.841+0000 7f5ed27a1640 1 --2- 172.21.15.105:0/1451655589 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ecc0cf940 0x7f5ecc1464b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:05.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.841+0000 7f5ed27a1640 1 --2- 172.21.15.105:0/1451655589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ecc070390 0x7f5ecc1e74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:05.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.841+0000 7f5ed27a1640 1 -- 172.21.15.105:0/1451655589 >> 172.21.15.105:0/1451655589 conn(0x7f5ecc06d7d0 msgr2=0x7f5ecc15d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:05.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.841+0000 7f5ed27a1640 1 -- 172.21.15.105:0/1451655589 shutdown_connections 2024-09-21T03:20:05.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:05.842+0000 7f5ed27a1640 1 -- 172.21.15.105:0/1451655589 wait complete. 2024-09-21T03:20:05.855 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-09-21T03:20:05.978 INFO:teuthology.orchestra.run.smithi105.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":135,"msgr_send_messages":137,"msgr_recv_bytes":33989,"msgr_send_bytes":499226,"msgr_created_connections":7,"msgr_active_connections":3,"msgr_running_total_time":0.014774454,"msgr_running_send_time":0.005516404,"msgr_running_recv_time":0.004165077,"msgr_running_fast_dispatch_time":0.002957158,"msgr_send_messages_queue_lat":{"avgcount":135,"sum":0.049671608,"avgtime":0.000367937},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"AsyncMessenger::Worker-1":{"msgr_recv_messages":467,"msgr_send_messages":534,"msgr_recv_bytes":236349,"msgr_send_bytes":282360,"msgr_created_connections":7,"msgr_active_connections":6,"msgr_running_total_time":0.041863626,"msgr_running_send_time":0.024325202,"msgr_running_recv_time":0.024313004,"msgr_running_fast_dispatch_time":0.002630252,"msgr_send_messages_queue_lat":{"avgcount":534,"sum":0.058213281,"avgtime":0.000109013},"msgr_handle_ack_lat":{"avgcount":466,"sum":0.000104036,"avgtime":0.000000223},"msgr_recv_encrypted_bytes":128560,"msgr_send_encrypted_bytes":18128},"AsyncMessenger::Worker-2":{"msgr_recv_messages":68,"msgr_send_messages":43,"msgr_recv_bytes":24211,"msgr_send_bytes":126916,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.013239108,"msgr_running_send_time":0.002912507,"msgr_running_recv_time":0.007162771,"msgr_running_fast_dispatch_time":0.002787281,"msgr_send_messages_queue_lat":{"avgcount":42,"sum":0.082322549,"avgtime":0.001960060},"msgr_handle_ack_lat":{"avgcount":15,"sum":0.000007072,"avgtime":0.000000471},"msgr_recv_encrypted_bytes":2032,"msgr_send_encrypted_bytes":111296},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":261,"sum":0.064607367,"avgtime":0.000247537}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000019474,"avgtime":0.000009737}},"mds":{"request":148,"reply":148,"reply_latency":{"avgcount":148,"sum":39.104481524,"avgtime":0.264219469},"slow_reply":0,"forward":0,"dir_fetch_complete":0,"dir_fetch_keys":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":114,"inodes_top":0,"inodes_bottom":114,"inodes_pin_tail":0,"inodes_pinned":114,"inodes_expired":0,"inodes_with_caps":105,"caps":106,"subtrees":2,"traverse":188,"traverse_hit":174,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":100,"root_rbytes":160,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":4,"ceph_cap_op_grant":112,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":104,"handle_client_caps_dirty":100,"handle_client_cap_release":1,"process_request_cap_release":14},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0,"uninline_started":0,"uninline_succeeded":0,"uninline_write_failed":0},"mds_log":{"evlrg":0,"evadd":219,"evex":0,"evtrm":0,"ev":219,"evexg":0,"evexd":0,"segadd":2,"segex":0,"segtrm":0,"seg":2,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4639770,"rdpos":0,"jlat":{"avgcount":109,"sum":0.185413686,"avgtime":0.001701042},"replayed":0},"mds_mem":{"ino":117,"ino+":117,"ino-":0,"dir":16,"dir+":16,"dir-":0,"dn":114,"dn+":115,"dn-":1,"cap":101,"cap+":106,"cap-":5,"rss":118956,"heap":333275136},"mds_server":{"dispatch_client_request":230,"dispatch_server_request":0,"handle_client_request":148,"handle_client_session":106,"handle_peer_request":0,"req_create_latency":{"avgcount":100,"sum":0.075694260,"avgtime":0.000756942},"req_getattr_latency":{"avgcount":32,"sum":0.006012108,"avgtime":0.000187878},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":4,"sum":0.000453363,"avgtime":0.000113340},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":4,"sum":0.005587990,"avgtime":0.001396997},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":2,"sum":0.000376217,"avgtime":0.000188108},"req_readdir_latency":{"avgcount":5,"sum":39.016044961,"avgtime":7.803208992},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000312625,"avgtime":0.000312625},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":78,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":2,"session_add":2,"session_remove":0,"sessions_open":2,"sessions_stale":0,"total_load":93,"average_load":46,"avg_session_uptime":41,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":239765,"buffer_anon_items":213,"buffer_meta_bytes":1584,"buffer_meta_items":18,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5312,"osdmap_items":75,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":417352,"mds_co_items":4385,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":151,"op_send_bytes":463245,"op_resend":37,"op_reply":151,"op_latency":{"avgcount":151,"sum":0.686985985,"avgtime":0.004549576},"op_inflight":0,"oplen_avg":{"avgcount":151,"sum":178},"op":151,"op_r":0,"op_w":151,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":109,"osdop_writefull":8,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":34,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":20,"omap_rd":0,"omap_del":2},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":666,"get_sum":236522,"get_or_fail_fail":0,"get_or_fail_success":666,"take":0,"take_sum":0,"put":666,"put_sum":236522,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":151,"take_sum":463245,"put":151,"put_sum":463245,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":151,"take_sum":151,"put":151,"put_sum":151,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x559ff02d35f0":{"val":0,"max":3758096384,"get_started":0,"get":219,"get_sum":445466,"get_or_fail_fail":0,"get_or_fail_success":219,"take":0,"take_sum":0,"put":109,"put_sum":445466,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"trackedop":{"slow_ops_count":2}} 2024-09-21T03:20:05.980 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 3, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 33989, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 135, "msgr_running_fast_dispatch_time": 0.002957158, "msgr_running_recv_time": 0.004165077, "msgr_running_send_time": 0.005516404, "msgr_running_total_time": 0.014774454, "msgr_send_bytes": 499226, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 137, "msgr_send_messages_queue_lat": { "avgcount": 135, "avgtime": 0.000367937, "sum": 0.049671608 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 6, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 466, "avgtime": 2.23e-07, "sum": 0.000104036 }, "msgr_recv_bytes": 236349, "msgr_recv_encrypted_bytes": 128560, "msgr_recv_messages": 467, "msgr_running_fast_dispatch_time": 0.002630252, "msgr_running_recv_time": 0.024313004, "msgr_running_send_time": 0.024325202, "msgr_running_total_time": 0.041863626, "msgr_send_bytes": 282360, "msgr_send_encrypted_bytes": 18128, "msgr_send_messages": 534, "msgr_send_messages_queue_lat": { "avgcount": 534, "avgtime": 0.000109013, "sum": 0.058213281 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 15, "avgtime": 4.71e-07, "sum": 7.072e-06 }, "msgr_recv_bytes": 24211, "msgr_recv_encrypted_bytes": 2032, "msgr_recv_messages": 68, "msgr_running_fast_dispatch_time": 0.002787281, "msgr_running_recv_time": 0.007162771, "msgr_running_send_time": 0.002912507, "msgr_running_total_time": 0.013239108, "msgr_send_bytes": 126916, "msgr_send_encrypted_bytes": 111296, "msgr_send_messages": 43, "msgr_send_messages_queue_lat": { "avgcount": 42, "avgtime": 0.00196006, "sum": 0.082322549 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 261, "avgtime": 0.000247537, "sum": 0.064607367 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 9.737e-06, "sum": 1.9474e-05 }, "queue_len": 0 }, "mds": { "caps": 106, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 112, "ceph_cap_op_revoke": 4, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 0, "dir_fetch_keys": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 1, "handle_client_caps": 104, "handle_client_caps_dirty": 100, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 114, "inodes_bottom": 114, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 114, "inodes_top": 0, "inodes_with_caps": 105, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 14, "q": 0, "reply": 148, "reply_latency": { "avgcount": 148, "avgtime": 0.264219469, "sum": 39.104481524 }, "request": 148, "root_rbytes": 160, "root_rfiles": 100, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 188, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 174, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0, "uninline_started": 0, "uninline_succeeded": 0, "uninline_write_failed": 0 }, "mds_log": { "ev": 219, "evadd": 219, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 109, "avgtime": 0.001701042, "sum": 0.185413686 }, "rdpos": 0, "replayed": 0, "seg": 2, "segadd": 2, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 4639770 }, "mds_mem": { "cap": 101, "cap+": 106, "cap-": 5, "dir": 16, "dir+": 16, "dir-": 0, "dn": 114, "dn+": 115, "dn-": 1, "heap": 333275136, "ino": 117, "ino+": 117, "ino-": 0, "rss": 118956 }, "mds_server": { "cap_acquisition_throttle": 78, "cap_revoke_eviction": 0, "dispatch_client_request": 230, "dispatch_server_request": 0, "handle_client_request": 148, "handle_client_session": 106, "handle_peer_request": 0, "req_create_latency": { "avgcount": 100, "avgtime": 0.000756942, "sum": 0.07569426 }, "req_getattr_latency": { "avgcount": 32, "avgtime": 0.000187878, "sum": 0.006012108 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 4, "avgtime": 0.00011334, "sum": 0.000453363 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 4, "avgtime": 0.001396997, "sum": 0.00558799 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 2, "avgtime": 0.000188108, "sum": 0.000376217 }, "req_readdir_latency": { "avgcount": 5, "avgtime": 7.803208992, "sum": 39.016044961 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000312625, "sum": 0.000312625 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 46, "avg_session_uptime": 41, "mdthresh_evicted": 0, "session_add": 2, "session_count": 2, "session_remove": 0, "sessions_open": 2, "sessions_stale": 0, "total_load": 93 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 239765, "buffer_anon_items": 213, "buffer_meta_bytes": 1584, "buffer_meta_items": 18, "mds_co_bytes": 417352, "mds_co_items": 4385, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5312, "osdmap_items": 75, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 34, "map_full": 0, "map_inc": 1, "omap_del": 2, "omap_rd": 0, "omap_wr": 20, "op": 151, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 151, "avgtime": 0.004549576, "sum": 0.686985985 }, "op_pg": 0, "op_r": 0, "op_reply": 151, "op_resend": 37, "op_rmw": 0, "op_send": 151, "op_send_bytes": 463245, "op_w": 151, "oplen_avg": { "avgcount": 151, "sum": 178 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 109, "osdop_writefull": 8, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 666, "get_or_fail_fail": 0, "get_or_fail_success": 666, "get_started": 0, "get_sum": 236522, "max": 104857600, "put": 666, "put_sum": 236522, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 151, "put_sum": 463245, "take": 151, "take_sum": 463245, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 151, "put_sum": 151, "take": 151, "take_sum": 151, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x559ff02d35f0": { "get": 219, "get_or_fail_fail": 0, "get_or_fail_success": 219, "get_started": 0, "get_sum": 445466, "max": 3758096384, "put": 109, "put_sum": 445466, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "trackedop": { "slow_ops_count": 2 } } 2024-09-21T03:20:05.980 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:20:06.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.089+0000 7f243a507640 1 -- 172.21.15.105:0/1329180427 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f243415c8b0 msgr2=0x7f243415dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:06.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.089+0000 7f243a507640 1 --2- 172.21.15.105:0/1329180427 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f243415c8b0 0x7f243415dfd0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f242c005fd0 tx=0x7f242c02a8b0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.089+0000 7f243a507640 1 -- 172.21.15.105:0/1329180427 shutdown_connections 2024-09-21T03:20:06.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.089+0000 7f243a507640 1 --2- 172.21.15.105:0/1329180427 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f243415c8b0 0x7f243415dfd0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.089+0000 7f243a507640 1 --2- 172.21.15.105:0/1329180427 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24340cd370 0x7f243415d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.089+0000 7f243a507640 1 -- 172.21.15.105:0/1329180427 >> 172.21.15.105:0/1329180427 conn(0x7f243406d230 msgr2=0x7f243406d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:06.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.089+0000 7f243a507640 1 -- 172.21.15.105:0/1329180427 shutdown_connections 2024-09-21T03:20:06.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.089+0000 7f243a507640 1 -- 172.21.15.105:0/1329180427 wait complete. 2024-09-21T03:20:06.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.091+0000 7f243a507640 1 Processor -- start 2024-09-21T03:20:06.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.091+0000 7f243a507640 1 -- start start 2024-09-21T03:20:06.096 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.093+0000 7f243a507640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24340cff40 0x7f243414f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:06.096 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.093+0000 7f243a507640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f243415c8b0 0x7f24340d1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:06.096 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.093+0000 7f243a507640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24340b1d80 0x7f24340d1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:06.096 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.093+0000 7f243a507640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f243415eb10 con 0x7f24340cff40 2024-09-21T03:20:06.097 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.093+0000 7f243a507640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f243415e990 con 0x7f24340b1d80 2024-09-21T03:20:06.097 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.093+0000 7f243a507640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f243415ec90 con 0x7f243415c8b0 2024-09-21T03:20:06.097 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.093+0000 7f2433fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24340cff40 0x7f243414f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:06.097 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.093+0000 7f2433fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24340cff40 0x7f243414f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58354/0 (socket says 172.21.15.105:58354) 2024-09-21T03:20:06.097 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.093+0000 7f2433fff640 1 -- 172.21.15.105:0/617307490 learned_addr learned my addr 172.21.15.105:0/617307490 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:06.097 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.093+0000 7f24337fe640 1 --2- 172.21.15.105:0/617307490 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f243415c8b0 0x7f24340d1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:06.097 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.093+0000 7f2438aa4640 1 --2- 172.21.15.105:0/617307490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24340b1d80 0x7f24340d1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:06.097 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.093+0000 7f2433fff640 1 -- 172.21.15.105:0/617307490 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f243415c8b0 msgr2=0x7f24340d1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:06.097 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.093+0000 7f2433fff640 1 --2- 172.21.15.105:0/617307490 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f243415c8b0 0x7f24340d1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.097 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.093+0000 7f2433fff640 1 -- 172.21.15.105:0/617307490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24340b1d80 msgr2=0x7f24340d1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:06.097 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.093+0000 7f2433fff640 1 --2- 172.21.15.105:0/617307490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24340b1d80 0x7f24340d1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.097 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.093+0000 7f2433fff640 1 -- 172.21.15.105:0/617307490 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24340b3b70 con 0x7f24340cff40 2024-09-21T03:20:06.097 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.093+0000 7f2438aa4640 1 --2- 172.21.15.105:0/617307490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24340b1d80 0x7f24340d1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:20:06.097 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.093+0000 7f2433fff640 1 --2- 172.21.15.105:0/617307490 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24340cff40 0x7f243414f7c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f242400c3d0 tx=0x7f242400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:06.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.093+0000 7f2430ff9640 1 -- 172.21.15.105:0/617307490 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2424011790 con 0x7f24340cff40 2024-09-21T03:20:06.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.093+0000 7f2430ff9640 1 -- 172.21.15.105:0/617307490 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2424017070 con 0x7f24340cff40 2024-09-21T03:20:06.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.093+0000 7f243a507640 1 -- 172.21.15.105:0/617307490 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24340b3e50 con 0x7f24340cff40 2024-09-21T03:20:06.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.093+0000 7f2430ff9640 1 -- 172.21.15.105:0/617307490 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2424011ce0 con 0x7f24340cff40 2024-09-21T03:20:06.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.093+0000 7f243a507640 1 -- 172.21.15.105:0/617307490 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24340b4410 con 0x7f24340cff40 2024-09-21T03:20:06.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.094+0000 7f243a507640 1 -- 172.21.15.105:0/617307490 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f243415f220 con 0x7f24340cff40 2024-09-21T03:20:06.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.095+0000 7f2430ff9640 1 -- 172.21.15.105:0/617307490 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f242401c460 con 0x7f24340cff40 2024-09-21T03:20:06.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.095+0000 7f2430ff9640 1 --2- 172.21.15.105:0/617307490 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2420078b90 0x7f242007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:06.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.096+0000 7f2430ff9640 1 -- 172.21.15.105:0/617307490 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f242409a9f0 con 0x7f24340cff40 2024-09-21T03:20:06.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.096+0000 7f24337fe640 1 --2- 172.21.15.105:0/617307490 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2420078b90 0x7f242007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:06.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.096+0000 7f24337fe640 1 --2- 172.21.15.105:0/617307490 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2420078b90 0x7f242007b0a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f24340c6800 tx=0x7f242800b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:06.102 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.100+0000 7f2430ff9640 1 -- 172.21.15.105:0/617307490 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2424062ec0 con 0x7f24340cff40 2024-09-21T03:20:06.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.314+0000 7f243a507640 1 -- 172.21.15.105:0/617307490 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f24340c6b10 con 0x7f24340cff40 2024-09-21T03:20:06.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.315+0000 7f2430ff9640 1 -- 172.21.15.105:0/617307490 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5232 (secure 0 0 0) 0x7f24240627c0 con 0x7f24340cff40 2024-09-21T03:20:06.317 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:20:06.317 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":17,"btime":"2024-09-21T03:19:15:120921+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4634,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/517240834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":517240834},{"type":"v1","addr":"172.21.15.162:6837","nonce":517240834}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4774,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3241953393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3241953393},{"type":"v1","addr":"172.21.15.162:6836","nonce":3241953393}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4899,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/2101702562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2101702562},{"type":"v1","addr":"172.21.15.105:6834","nonce":2101702562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:19:11.459432+0000","modified":"2024-09-21T03:19:14.487254+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4902},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4902":{"gid":4902,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1732564681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":1732564681},{"type":"v1","addr":"172.21.15.105:6835","nonce":1732564681}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4902,"qdb_cluster":[4902]},"id":2}]} 2024-09-21T03:20:06.318 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 17 2024-09-21T03:20:06.320 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.317+0000 7f243a507640 1 -- 172.21.15.105:0/617307490 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2420078b90 msgr2=0x7f242007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:06.320 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.317+0000 7f243a507640 1 --2- 172.21.15.105:0/617307490 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2420078b90 0x7f242007b0a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f24340c6800 tx=0x7f242800b2e0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.320 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.317+0000 7f243a507640 1 -- 172.21.15.105:0/617307490 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24340cff40 msgr2=0x7f243414f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:06.320 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.317+0000 7f243a507640 1 --2- 172.21.15.105:0/617307490 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24340cff40 0x7f243414f7c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f242400c3d0 tx=0x7f242400c890 comp rx=0 tx=0).stop 2024-09-21T03:20:06.320 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.317+0000 7f243a507640 1 -- 172.21.15.105:0/617307490 shutdown_connections 2024-09-21T03:20:06.320 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.317+0000 7f243a507640 1 --2- 172.21.15.105:0/617307490 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2420078b90 0x7f242007b0a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.320 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.317+0000 7f243a507640 1 --2- 172.21.15.105:0/617307490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24340b1d80 0x7f24340d1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.320 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.317+0000 7f243a507640 1 --2- 172.21.15.105:0/617307490 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f243415c8b0 0x7f24340d1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.317+0000 7f243a507640 1 --2- 172.21.15.105:0/617307490 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24340cff40 0x7f243414f7c0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.317+0000 7f243a507640 1 -- 172.21.15.105:0/617307490 >> 172.21.15.105:0/617307490 conn(0x7f243406d230 msgr2=0x7f24340c8680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:06.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.317+0000 7f243a507640 1 -- 172.21.15.105:0/617307490 shutdown_connections 2024-09-21T03:20:06.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.317+0000 7f243a507640 1 -- 172.21.15.105:0/617307490 wait complete. 2024-09-21T03:20:06.331 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-21T03:20:06.455 INFO:teuthology.orchestra.run.smithi105.stdout:[{"id":4766,"entity":{"name":{"type":"client","num":4766},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":57272936}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":2,"uptime":42.122140272000003,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":8.1885171673004766,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.4766 v1:192.168.0.1:0/57272936","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi162","kernel_version":"5.14.0-508.el9.x86_64","root":"/"}},{"id":4948,"entity":{"name":{"type":"client","num":4948},"addr":{"type":"v1","addr":"172.21.15.105:0","nonce":3533721268}},"state":"open","num_leases":1,"num_caps":100,"request_load_avg":90,"uptime":43.254117176000001,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":12.920815277397535,"halflife":60},"release_caps":{"value":8.3072465793886412,"halflife":60},"recall_caps_throttle":{"value":4.3387083503226274,"halflife":1.5},"recall_caps_throttle2o":{"value":3.2669415491955363,"halflife":0.5},"session_cache_liveness":{"value":199.78156222293623,"halflife":300},"cap_acquisition":{"value":60.403611960196194,"halflife":30},"last_trim_completed_requests_tid":144,"last_trim_completed_flushes_tid":101,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.4948 v1:172.21.15.105:0/3533721268","completed_requests":[],"prealloc_inos":[{"start":"0x10000000002","length":500},{"start":"0x1000000025c","length":899}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi105","kernel_version":"5.14.0-508.el9.x86_64","root":"/"}}] 2024-09-21T03:20:06.455 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi162", "kernel_version": "5.14.0-508.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 57272936, "type": "v1" }, "name": { "num": 4766, "type": "client" } }, "id": 4766, "inst": "client.4766 v1:192.168.0.1:0/57272936", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 2, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 8.188517167300477 }, "state": "open", "uptime": 42.122140272 }, { "cap_acquisition": { "halflife": 30, "value": 60.403611960196194 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi105", "kernel_version": "5.14.0-508.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "172.21.15.105:0", "nonce": 3533721268, "type": "v1" }, "name": { "num": 4948, "type": "client" } }, "id": 4948, "inst": "client.4948 v1:172.21.15.105:0/3533721268", "last_trim_completed_flushes_tid": 101, "last_trim_completed_requests_tid": 144, "num_caps": 100, "num_completed_flushes": 1, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000002" }, { "length": 899, "start": "0x1000000025c" } ], "recall_caps": { "halflife": 60, "value": 12.920815277397535 }, "recall_caps_throttle": { "halflife": 1.5, "value": 4.338708350322627 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 3.2669415491955363 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 8.307246579388641 }, "request_load_avg": 90, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 199.78156222293623 }, "state": "open", "uptime": 43.254117176 } ] 2024-09-21T03:20:06.456 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump_historic_ops 2024-09-21T03:20:06.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.567+0000 7f324ffed640 1 -- 172.21.15.105:0/1359699795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3234004800 msgr2=0x7f3234004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:06.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.567+0000 7f324ffed640 1 --2- 172.21.15.105:0/1359699795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3234004800 0x7f3234004c10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3248070050 tx=0x7f3234005830 comp rx=0 tx=0).stop 2024-09-21T03:20:06.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.567+0000 7f324ffed640 1 -- 172.21.15.105:0/1359699795 shutdown_connections 2024-09-21T03:20:06.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.567+0000 7f324ffed640 1 --2- 172.21.15.105:0/1359699795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3234004800 0x7f3234004c10 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.567+0000 7f324ffed640 1 -- 172.21.15.105:0/1359699795 >> 172.21.15.105:0/1359699795 conn(0x7f324809d7f0 msgr2=0x7f32480d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:06.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.567+0000 7f324ffed640 1 -- 172.21.15.105:0/1359699795 shutdown_connections 2024-09-21T03:20:06.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.567+0000 7f324ffed640 1 -- 172.21.15.105:0/1359699795 wait complete. 2024-09-21T03:20:06.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.568+0000 7f324ffed640 1 Processor -- start 2024-09-21T03:20:06.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.568+0000 7f324ffed640 1 -- start start 2024-09-21T03:20:06.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.570+0000 7f324ffed640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3234004800 0x7f32480c9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:06.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.570+0000 7f324ffed640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32480c9870 0x7f324815c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:06.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.570+0000 7f324ffed640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f324815c690 0x7f324815fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:06.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.570+0000 7f324ffed640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f32480b6120 con 0x7f32480c9870 2024-09-21T03:20:06.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.570+0000 7f324ffed640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f32480b5fa0 con 0x7f324815c690 2024-09-21T03:20:06.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.570+0000 7f324ffed640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f32480b62a0 con 0x7f3234004800 2024-09-21T03:20:06.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.570+0000 7f324d588640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32480c9870 0x7f324815c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:06.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.570+0000 7f324d588640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32480c9870 0x7f324815c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58372/0 (socket says 172.21.15.105:58372) 2024-09-21T03:20:06.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.570+0000 7f324d588640 1 -- 172.21.15.105:0/1909215465 learned_addr learned my addr 172.21.15.105:0/1909215465 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:06.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.570+0000 7f324dd89640 1 --2- 172.21.15.105:0/1909215465 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3234004800 0x7f32480c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:06.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.570+0000 7f324e58a640 1 --2- 172.21.15.105:0/1909215465 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f324815c690 0x7f324815fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:06.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.570+0000 7f324d588640 1 -- 172.21.15.105:0/1909215465 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3234004800 msgr2=0x7f32480c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:06.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.570+0000 7f324d588640 1 --2- 172.21.15.105:0/1909215465 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3234004800 0x7f32480c9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.570+0000 7f324d588640 1 -- 172.21.15.105:0/1909215465 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f324815c690 msgr2=0x7f324815fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:06.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.570+0000 7f324d588640 1 --2- 172.21.15.105:0/1909215465 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f324815c690 0x7f324815fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.570+0000 7f324d588640 1 -- 172.21.15.105:0/1909215465 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32480c80f0 con 0x7f32480c9870 2024-09-21T03:20:06.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.570+0000 7f324e58a640 1 --2- 172.21.15.105:0/1909215465 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f324815c690 0x7f324815fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:20:06.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.570+0000 7f324d588640 1 --2- 172.21.15.105:0/1909215465 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32480c9870 0x7f324815c150 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3238034040 tx=0x7f3238032760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:06.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.570+0000 7f323e7fc640 1 -- 172.21.15.105:0/1909215465 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3238041070 con 0x7f32480c9870 2024-09-21T03:20:06.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.570+0000 7f323e7fc640 1 -- 172.21.15.105:0/1909215465 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3238032d60 con 0x7f32480c9870 2024-09-21T03:20:06.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.570+0000 7f324ffed640 1 -- 172.21.15.105:0/1909215465 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32480ca200 con 0x7f32480c9870 2024-09-21T03:20:06.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.570+0000 7f323e7fc640 1 -- 172.21.15.105:0/1909215465 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3238004290 con 0x7f32480c9870 2024-09-21T03:20:06.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.571+0000 7f324ffed640 1 -- 172.21.15.105:0/1909215465 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32480c8990 con 0x7f32480c9870 2024-09-21T03:20:06.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.572+0000 7f323e7fc640 1 -- 172.21.15.105:0/1909215465 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f32380035f0 con 0x7f32480c9870 2024-09-21T03:20:06.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.573+0000 7f323e7fc640 1 --2- 172.21.15.105:0/1909215465 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f322c078b90 0x7f322c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:06.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.573+0000 7f323e7fc640 1 -- 172.21.15.105:0/1909215465 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f32380bbc50 con 0x7f32480c9870 2024-09-21T03:20:06.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.573+0000 7f324dd89640 1 --2- 172.21.15.105:0/1909215465 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f322c078b90 0x7f322c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:06.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.574+0000 7f3257037740 1 Processor -- start 2024-09-21T03:20:06.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.574+0000 7f324dd89640 1 --2- 172.21.15.105:0/1909215465 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f322c078b90 0x7f322c07b0a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3244001450 tx=0x7f3244006a70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:06.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.574+0000 7f3257037740 1 -- start start 2024-09-21T03:20:06.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.575+0000 7f3257037740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557296c0e390 0x557296fe0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:06.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.575+0000 7f3257037740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557296be54d0 0x557296fe0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:06.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.575+0000 7f3257037740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557296bed6b0 0x557296ffdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:06.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.575+0000 7f3257037740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x557296f28820 con 0x557296be54d0 2024-09-21T03:20:06.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.575+0000 7f3257037740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557296f17c50 con 0x557296c0e390 2024-09-21T03:20:06.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.575+0000 7f3257037740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x557296f1ba60 con 0x557296bed6b0 2024-09-21T03:20:06.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.575+0000 7f324d588640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557296be54d0 0x557296fe0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:06.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.575+0000 7f324d588640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557296be54d0 0x557296fe0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58374/0 (socket says 172.21.15.105:58374) 2024-09-21T03:20:06.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.575+0000 7f324d588640 1 -- 172.21.15.105:0/3858551359 learned_addr learned my addr 172.21.15.105:0/3858551359 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:06.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.575+0000 7f324e58a640 1 --2- 172.21.15.105:0/3858551359 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557296bed6b0 0x557296ffdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:06.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.575+0000 7f324dd89640 1 --2- 172.21.15.105:0/3858551359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557296c0e390 0x557296fe0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:06.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.576+0000 7f324d588640 1 -- 172.21.15.105:0/3858551359 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557296bed6b0 msgr2=0x557296ffdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:20:06.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.576+0000 7f324d588640 1 --2- 172.21.15.105:0/3858551359 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557296bed6b0 0x557296ffdcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.576+0000 7f324d588640 1 -- 172.21.15.105:0/3858551359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557296c0e390 msgr2=0x557296fe0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:20:06.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.576+0000 7f324d588640 1 --2- 172.21.15.105:0/3858551359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557296c0e390 0x557296fe0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.576+0000 7f324d588640 1 -- 172.21.15.105:0/3858551359 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557296ed3250 con 0x557296be54d0 2024-09-21T03:20:06.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.576+0000 7f324d588640 1 --2- 172.21.15.105:0/3858551359 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557296be54d0 0x557296fe0dc0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f32380ba1a0 tx=0x7f32380834a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a23475753b478664 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:06.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.576+0000 7f322b7fe640 1 -- 172.21.15.105:0/3858551359 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3238083990 con 0x557296be54d0 2024-09-21T03:20:06.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.576+0000 7f322b7fe640 1 -- 172.21.15.105:0/3858551359 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3238037030 con 0x557296be54d0 2024-09-21T03:20:06.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.576+0000 7f322b7fe640 1 -- 172.21.15.105:0/3858551359 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3238088470 con 0x557296be54d0 2024-09-21T03:20:06.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.577+0000 7f3257037740 1 -- 172.21.15.105:0/3858551359 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557296be54d0 msgr2=0x557296fe0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:06.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.577+0000 7f3257037740 1 --2- 172.21.15.105:0/3858551359 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557296be54d0 0x557296fe0dc0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f32380ba1a0 tx=0x7f32380834a0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.577+0000 7f3257037740 1 -- 172.21.15.105:0/3858551359 shutdown_connections 2024-09-21T03:20:06.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.577+0000 7f3257037740 1 --2- 172.21.15.105:0/3858551359 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557296bed6b0 0x557296ffdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.577+0000 7f3257037740 1 --2- 172.21.15.105:0/3858551359 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557296be54d0 0x557296fe0dc0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.577+0000 7f3257037740 1 --2- 172.21.15.105:0/3858551359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557296c0e390 0x557296fe0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.577+0000 7f3257037740 1 -- 172.21.15.105:0/3858551359 >> 172.21.15.105:0/3858551359 conn(0x557296c024e0 msgr2=0x557296fb6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:06.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.577+0000 7f3257037740 1 -- 172.21.15.105:0/3858551359 shutdown_connections 2024-09-21T03:20:06.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.577+0000 7f3257037740 1 -- 172.21.15.105:0/3858551359 wait complete. 2024-09-21T03:20:06.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.578+0000 7f3257037740 1 -- start start 2024-09-21T03:20:06.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.578+0000 7f3257037740 1 Processor -- start 2024-09-21T03:20:06.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.579+0000 7f3257037740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557296be54d0 0x557296fcd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:06.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.579+0000 7f3257037740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557296bed6b0 0x557296ff26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:06.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.579+0000 7f3257037740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557296c0e390 0x557296fd0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:06.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.579+0000 7f3257037740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x557296c88740 con 0x557296c0e390 2024-09-21T03:20:06.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.579+0000 7f3257037740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557296ebd6b0 con 0x557296bed6b0 2024-09-21T03:20:06.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.579+0000 7f3257037740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x557296f17c50 con 0x557296be54d0 2024-09-21T03:20:06.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.579+0000 7f3257037740 10 client.0 _ll_register_callbacks cb 0x557296eccad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:20:06.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.579+0000 7f324e58a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557296c0e390 0x557296fd0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:06.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.579+0000 7f324e58a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557296c0e390 0x557296fd0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58376/0 (socket says 172.21.15.105:58376) 2024-09-21T03:20:06.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.579+0000 7f324e58a640 1 -- 172.21.15.105:0/3198029409 learned_addr learned my addr 172.21.15.105:0/3198029409 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:06.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.580+0000 7f324dd89640 1 --2- 172.21.15.105:0/3198029409 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557296be54d0 0x557296fcd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:06.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.580+0000 7f324d588640 1 --2- 172.21.15.105:0/3198029409 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557296bed6b0 0x557296ff26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:06.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.580+0000 7f324e58a640 1 -- 172.21.15.105:0/3198029409 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557296be54d0 msgr2=0x557296fcd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:20:06.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.580+0000 7f324e58a640 1 --2- 172.21.15.105:0/3198029409 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557296be54d0 0x557296fcd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.580+0000 7f324e58a640 1 -- 172.21.15.105:0/3198029409 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557296bed6b0 msgr2=0x557296ff26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:20:06.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.580+0000 7f324e58a640 1 --2- 172.21.15.105:0/3198029409 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557296bed6b0 0x557296ff26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.580+0000 7f324e58a640 1 -- 172.21.15.105:0/3198029409 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557296c79970 con 0x557296c0e390 2024-09-21T03:20:06.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.580+0000 7f324d588640 1 --2- 172.21.15.105:0/3198029409 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557296bed6b0 0x557296ff26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:20:06.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.580+0000 7f324e58a640 1 --2- 172.21.15.105:0/3198029409 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557296c0e390 0x557296fd0390 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f32480b3e10 tx=0x7f3240005cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=626cac3e8f8f72c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:06.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.580+0000 7f3228ff9640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-21T03:20:06.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.580+0000 7f3228ff9640 1 -- 172.21.15.105:0/3198029409 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3240005310 con 0x557296c0e390 2024-09-21T03:20:06.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.580+0000 7f3228ff9640 1 -- 172.21.15.105:0/3198029409 <== mon.0 v2:172.21.15.105:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f3240012990 con 0x557296c0e390 2024-09-21T03:20:06.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.580+0000 7f3257037740 1 -- 172.21.15.105:0/3198029409 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557296ec5c10 con 0x557296c0e390 2024-09-21T03:20:06.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.580+0000 7f3228ff9640 1 -- 172.21.15.105:0/3198029409 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f3240023050 con 0x557296c0e390 2024-09-21T03:20:06.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.580+0000 7f3257037740 10 client.5151 fetch_fsmap learned FSMap version 17 2024-09-21T03:20:06.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.580+0000 7f3257037740 1 -- 172.21.15.105:0/3198029409 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x557296cee760 con 0x557296c0e390 2024-09-21T03:20:06.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.580+0000 7f3228ff9640 1 -- 172.21.15.105:0/3198029409 <== mon.0 v2:172.21.15.105:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x557296ec5c10 con 0x557296c0e390 2024-09-21T03:20:06.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.580+0000 7f3228ff9640 1 -- 172.21.15.105:0/3198029409 <== mon.0 v2:172.21.15.105:3300/0 5 ==== fsmap(e 17) ==== 3502+0+0 (secure 0 0 0) 0x7f3240012bb0 con 0x557296c0e390 2024-09-21T03:20:06.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.580+0000 7f3257037740 10 client.5151 fetch_fsmap finished waiting for FSMap version 17 2024-09-21T03:20:06.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.580+0000 7f3257037740 10 client.5151 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-21T03:20:06.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.580+0000 7f3257037740 20 client.5151 populate_metadata read hostname 'smithi105' 2024-09-21T03:20:06.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.581+0000 7f3257037740 1 --2- 172.21.15.105:0/3198029409 >> [v2:172.21.15.105:6833/1732564681,v1:172.21.15.105:6835/1732564681] conn(0x557296bccf60 0x557296fd08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:06.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.581+0000 7f3257037740 4 client.5151 mds_command: new command op to 4902 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:20:06.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.581+0000 7f3257037740 1 -- 172.21.15.105:0/3198029409 --> [v2:172.21.15.105:6833/1732564681,v1:172.21.15.105:6835/1732564681] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557296f2a770 con 0x557296bccf60 2024-09-21T03:20:06.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.581+0000 7f324dd89640 1 --2- 172.21.15.105:0/3198029409 >> [v2:172.21.15.105:6833/1732564681,v1:172.21.15.105:6835/1732564681] conn(0x557296bccf60 0x557296fd08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:06.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.581+0000 7f3228ff9640 10 client.5151 ms_handle_connect on v2:172.21.15.105:6833/1732564681 2024-09-21T03:20:06.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.581+0000 7f324dd89640 1 --2- 172.21.15.105:0/3198029409 >> [v2:172.21.15.105:6833/1732564681,v1:172.21.15.105:6835/1732564681] conn(0x557296bccf60 0x557296fd08d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=577bc78620e29f11 server_cookie=1105d99d6a0cd324 in_seq=0 out_seq=0 2024-09-21T03:20:06.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.582+0000 7f3228ff9640 1 -- 172.21.15.105:0/3198029409 <== mds.0 v2:172.21.15.105:6833/1732564681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557296f2a770 con 0x557296bccf60 2024-09-21T03:20:06.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.582+0000 7f3228ff9640 10 client.5151 handle_command_reply: tid=0 2024-09-21T03:20:06.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.582+0000 7f3257037740 1 client.5151 shutdown 2024-09-21T03:20:06.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.582+0000 7f3257037740 1 -- 172.21.15.105:0/3198029409 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557296c0e390 msgr2=0x557296fd0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:06.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.582+0000 7f3257037740 1 --2- 172.21.15.105:0/3198029409 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557296c0e390 0x557296fd0390 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f32480b3e10 tx=0x7f3240005cd0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.582+0000 7f3257037740 1 -- 172.21.15.105:0/3198029409 shutdown_connections 2024-09-21T03:20:06.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.582+0000 7f3257037740 1 --2- 172.21.15.105:0/3198029409 >> [v2:172.21.15.105:6833/1732564681,v1:172.21.15.105:6835/1732564681] conn(0x557296bccf60 0x557296fd08d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.582+0000 7f3257037740 1 --2- 172.21.15.105:0/3198029409 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557296c0e390 0x557296fd0390 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.582+0000 7f3257037740 1 --2- 172.21.15.105:0/3198029409 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557296bed6b0 0x557296ff26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.582+0000 7f3228ff9640 0 client.5151 ms_handle_reset on v2:172.21.15.105:6833/1732564681 2024-09-21T03:20:06.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.582+0000 7f3257037740 1 --2- 172.21.15.105:0/3198029409 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557296be54d0 0x557296fcd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.582+0000 7f3257037740 1 -- 172.21.15.105:0/3198029409 >> 172.21.15.105:0/3198029409 conn(0x557296c024e0 msgr2=0x557296fb69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:06.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.582+0000 7f3257037740 1 -- 172.21.15.105:0/3198029409 shutdown_connections 2024-09-21T03:20:06.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.582+0000 7f3257037740 1 -- 172.21.15.105:0/3198029409 wait complete. 2024-09-21T03:20:06.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.582+0000 7f3257037740 20 client.5151 trim_cache size 0 max 16384 2024-09-21T03:20:06.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.596+0000 7f3257037740 1 Processor -- start 2024-09-21T03:20:06.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.597+0000 7f3257037740 1 -- start start 2024-09-21T03:20:06.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.598+0000 7f3257037740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557296be54d0 0x557296fb69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:06.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.598+0000 7f3257037740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557296bed6b0 0x557296fb6f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:06.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.598+0000 7f3257037740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557296c0e390 0x557296fcc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:06.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.598+0000 7f3257037740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3248202530 con 0x557296be54d0 2024-09-21T03:20:06.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.598+0000 7f3257037740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3248201540 con 0x557296c0e390 2024-09-21T03:20:06.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.598+0000 7f3257037740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f32481f9610 con 0x557296bed6b0 2024-09-21T03:20:06.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.598+0000 7f324dd89640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557296be54d0 0x557296fb69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:06.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.598+0000 7f324dd89640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557296be54d0 0x557296fb69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58382/0 (socket says 172.21.15.105:58382) 2024-09-21T03:20:06.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.598+0000 7f324dd89640 1 -- 172.21.15.105:0/1476179063 learned_addr learned my addr 172.21.15.105:0/1476179063 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:06.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.598+0000 7f324dd89640 1 -- 172.21.15.105:0/1476179063 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557296bed6b0 msgr2=0x557296fb6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:20:06.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.598+0000 7f324d588640 1 --2- 172.21.15.105:0/1476179063 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557296bed6b0 0x557296fb6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:06.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.598+0000 7f324e58a640 1 --2- 172.21.15.105:0/1476179063 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557296c0e390 0x557296fcc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:06.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.598+0000 7f324dd89640 1 --2- 172.21.15.105:0/1476179063 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557296bed6b0 0x557296fb6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.598+0000 7f324dd89640 1 -- 172.21.15.105:0/1476179063 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557296c0e390 msgr2=0x557296fcc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:20:06.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.598+0000 7f324dd89640 1 --2- 172.21.15.105:0/1476179063 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557296c0e390 0x557296fcc7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.598+0000 7f324dd89640 1 -- 172.21.15.105:0/1476179063 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557296fb8540 con 0x557296be54d0 2024-09-21T03:20:06.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.598+0000 7f324d588640 1 --2- 172.21.15.105:0/1476179063 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557296bed6b0 0x557296fb6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:20:06.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.598+0000 7f324dd89640 1 --2- 172.21.15.105:0/1476179063 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557296be54d0 0x557296fb69d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x557296ff7150 tx=0x7f3244015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4edf7544a59b4acd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:06.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.598+0000 7f322affd640 1 -- 172.21.15.105:0/1476179063 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f324401f400 con 0x557296be54d0 2024-09-21T03:20:06.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.598+0000 7f322affd640 1 -- 172.21.15.105:0/1476179063 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f324401f5a0 con 0x557296be54d0 2024-09-21T03:20:06.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.598+0000 7f322affd640 1 -- 172.21.15.105:0/1476179063 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f324401f950 con 0x557296be54d0 2024-09-21T03:20:06.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.599+0000 7f3257037740 1 -- 172.21.15.105:0/1476179063 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557296be54d0 msgr2=0x557296fb69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:06.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.599+0000 7f3257037740 1 --2- 172.21.15.105:0/1476179063 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557296be54d0 0x557296fb69d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x557296ff7150 tx=0x7f3244015000 comp rx=0 tx=0).stop 2024-09-21T03:20:06.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.599+0000 7f3257037740 1 -- 172.21.15.105:0/1476179063 shutdown_connections 2024-09-21T03:20:06.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.599+0000 7f3257037740 1 --2- 172.21.15.105:0/1476179063 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557296c0e390 0x557296fcc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.599+0000 7f3257037740 1 --2- 172.21.15.105:0/1476179063 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557296bed6b0 0x557296fb6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.599+0000 7f3257037740 1 --2- 172.21.15.105:0/1476179063 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557296be54d0 0x557296fb69d0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.599+0000 7f3257037740 1 -- 172.21.15.105:0/1476179063 >> 172.21.15.105:0/1476179063 conn(0x557296c024e0 msgr2=0x557296fb7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:06.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.599+0000 7f3257037740 1 -- 172.21.15.105:0/1476179063 shutdown_connections 2024-09-21T03:20:06.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.599+0000 7f3257037740 1 -- 172.21.15.105:0/1476179063 wait complete. 2024-09-21T03:20:06.608 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.600+0000 7f3257037740 1 -- start start 2024-09-21T03:20:06.608 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.600+0000 7f3257037740 1 Processor -- start 2024-09-21T03:20:06.608 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.602+0000 7f3257037740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557296be54d0 0x55729707a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:06.608 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.602+0000 7f3257037740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557296bed6b0 0x557296fb69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:06.608 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.602+0000 7f3257037740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557296c0e390 0x557296fb6f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:06.608 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.602+0000 7f3257037740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x557296f28820 con 0x557296c0e390 2024-09-21T03:20:06.609 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.602+0000 7f3257037740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3248201090 con 0x557296be54d0 2024-09-21T03:20:06.609 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.602+0000 7f3257037740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x557296ff1800 con 0x557296bed6b0 2024-09-21T03:20:06.609 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.602+0000 7f3257037740 10 client.0 _ll_register_callbacks cb 0x7f3240006040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:20:06.609 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.602+0000 7f324e58a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557296c0e390 0x557296fb6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:06.609 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.602+0000 7f324e58a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557296c0e390 0x557296fb6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58388/0 (socket says 172.21.15.105:58388) 2024-09-21T03:20:06.609 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.602+0000 7f324e58a640 1 -- 172.21.15.105:0/3275533987 learned_addr learned my addr 172.21.15.105:0/3275533987 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:06.609 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.602+0000 7f324dd89640 1 --2- 172.21.15.105:0/3275533987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557296be54d0 0x55729707a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:06.609 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.602+0000 7f324d588640 1 --2- 172.21.15.105:0/3275533987 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557296bed6b0 0x557296fb69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:06.609 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.602+0000 7f324e58a640 1 -- 172.21.15.105:0/3275533987 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557296bed6b0 msgr2=0x557296fb69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:20:06.609 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.602+0000 7f324e58a640 1 --2- 172.21.15.105:0/3275533987 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557296bed6b0 0x557296fb69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.609 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.602+0000 7f324e58a640 1 -- 172.21.15.105:0/3275533987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557296be54d0 msgr2=0x55729707a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:20:06.609 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.602+0000 7f324e58a640 1 --2- 172.21.15.105:0/3275533987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557296be54d0 0x55729707a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.609 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.602+0000 7f324e58a640 1 -- 172.21.15.105:0/3275533987 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55729707a900 con 0x557296c0e390 2024-09-21T03:20:06.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.602+0000 7f324e58a640 1 --2- 172.21.15.105:0/3275533987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557296c0e390 0x557296fb6f10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3240003710 tx=0x7f32400062e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaa8f7c44ba3a6e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:06.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.602+0000 7f3228ff9640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-21T03:20:06.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.602+0000 7f3228ff9640 1 -- 172.21.15.105:0/3275533987 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3240005030 con 0x557296c0e390 2024-09-21T03:20:06.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.602+0000 7f3228ff9640 1 -- 172.21.15.105:0/3275533987 <== mon.0 v2:172.21.15.105:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f32400051d0 con 0x557296c0e390 2024-09-21T03:20:06.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.602+0000 7f3257037740 1 -- 172.21.15.105:0/3275533987 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f324401f5a0 con 0x557296c0e390 2024-09-21T03:20:06.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.602+0000 7f3228ff9640 1 -- 172.21.15.105:0/3275533987 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f3240035050 con 0x557296c0e390 2024-09-21T03:20:06.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.602+0000 7f3257037740 10 client.5157 fetch_fsmap learned FSMap version 17 2024-09-21T03:20:06.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.602+0000 7f3257037740 1 -- 172.21.15.105:0/3275533987 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55729700e1a0 con 0x557296c0e390 2024-09-21T03:20:06.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.603+0000 7f3228ff9640 1 -- 172.21.15.105:0/3275533987 <== mon.0 v2:172.21.15.105:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f324401f5a0 con 0x557296c0e390 2024-09-21T03:20:06.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.603+0000 7f3228ff9640 1 -- 172.21.15.105:0/3275533987 <== mon.0 v2:172.21.15.105:3300/0 5 ==== fsmap(e 17) ==== 3502+0+0 (secure 0 0 0) 0x7f3240038020 con 0x557296c0e390 2024-09-21T03:20:06.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.603+0000 7f3257037740 10 client.5157 fetch_fsmap finished waiting for FSMap version 17 2024-09-21T03:20:06.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.603+0000 7f3257037740 10 client.5157 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-21T03:20:06.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.603+0000 7f3257037740 20 client.5157 populate_metadata read hostname 'smithi105' 2024-09-21T03:20:06.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.603+0000 7f3257037740 1 --2- 172.21.15.105:0/3275533987 >> [v2:172.21.15.105:6833/1732564681,v1:172.21.15.105:6835/1732564681] conn(0x55729700dd60 0x55729707e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:06.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.603+0000 7f3257037740 4 client.5157 mds_command: new command op to 4902 tid=0 multi_id=0 [{"prefix": "dump_historic_ops"}] 2024-09-21T03:20:06.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.603+0000 7f3257037740 1 -- 172.21.15.105:0/3275533987 --> [v2:172.21.15.105:6833/1732564681,v1:172.21.15.105:6835/1732564681] -- command(tid 0: {"prefix": "dump_historic_ops"}) -- 0x557296fcf820 con 0x55729700dd60 2024-09-21T03:20:06.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.603+0000 7f324dd89640 1 --2- 172.21.15.105:0/3275533987 >> [v2:172.21.15.105:6833/1732564681,v1:172.21.15.105:6835/1732564681] conn(0x55729700dd60 0x55729707e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:06.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.603+0000 7f3228ff9640 10 client.5157 ms_handle_connect on v2:172.21.15.105:6833/1732564681 2024-09-21T03:20:06.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.603+0000 7f324dd89640 1 --2- 172.21.15.105:0/3275533987 >> [v2:172.21.15.105:6833/1732564681,v1:172.21.15.105:6835/1732564681] conn(0x55729700dd60 0x55729707e530 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf340cade78b859d server_cookie=b8fa6f789f71eee9 in_seq=0 out_seq=0 2024-09-21T03:20:06.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.605+0000 7f3228ff9640 1 -- 172.21.15.105:0/3275533987 <== mds.0 v2:172.21.15.105:6833/1732564681 1 ==== command_reply(tid 0: 0 ) ==== 8+0+71424 (crc 0 0 0) 0x557296fcf820 con 0x55729700dd60 2024-09-21T03:20:06.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.605+0000 7f3228ff9640 10 client.5157 handle_command_reply: tid=0 2024-09-21T03:20:06.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.605+0000 7f3257037740 1 client.5157 shutdown 2024-09-21T03:20:06.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.605+0000 7f3257037740 1 -- 172.21.15.105:0/3275533987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557296c0e390 msgr2=0x557296fb6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:06.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.605+0000 7f3257037740 1 --2- 172.21.15.105:0/3275533987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557296c0e390 0x557296fb6f10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3240003710 tx=0x7f32400062e0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.605+0000 7f3257037740 1 -- 172.21.15.105:0/3275533987 shutdown_connections 2024-09-21T03:20:06.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.605+0000 7f3257037740 1 --2- 172.21.15.105:0/3275533987 >> [v2:172.21.15.105:6833/1732564681,v1:172.21.15.105:6835/1732564681] conn(0x55729700dd60 0x55729707e530 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.605+0000 7f3257037740 1 --2- 172.21.15.105:0/3275533987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x557296c0e390 0x557296fb6f10 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.605+0000 7f3257037740 1 --2- 172.21.15.105:0/3275533987 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557296bed6b0 0x557296fb69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.605+0000 7f3228ff9640 0 client.5157 ms_handle_reset on v2:172.21.15.105:6833/1732564681 2024-09-21T03:20:06.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.605+0000 7f3257037740 1 --2- 172.21.15.105:0/3275533987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557296be54d0 0x55729707a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.605+0000 7f3257037740 1 -- 172.21.15.105:0/3275533987 >> 172.21.15.105:0/3275533987 conn(0x557296c024e0 msgr2=0x557296ffde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:06.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.605+0000 7f3257037740 1 -- 172.21.15.105:0/3275533987 shutdown_connections 2024-09-21T03:20:06.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.605+0000 7f3257037740 1 -- 172.21.15.105:0/3275533987 wait complete. 2024-09-21T03:20:06.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.605+0000 7f3257037740 20 client.5157 trim_cache size 0 max 16384 2024-09-21T03:20:06.613 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-21T03:20:06.614 INFO:teuthology.orchestra.run.smithi105.stdout: "size": 20, 2024-09-21T03:20:06.614 INFO:teuthology.orchestra.run.smithi105.stdout: "duration": 600, 2024-09-21T03:20:06.614 INFO:teuthology.orchestra.run.smithi105.stdout: "ops": [ 2024-09-21T03:20:06.614 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.614 INFO:teuthology.orchestra.run.smithi105.stdout: "description": "client_request(client.4948:2 setattr mode=041777 #0x1 2024-09-21T03:19:23.218729+0000 caller_uid=0, caller_gid=0{0,})", 2024-09-21T03:20:06.614 INFO:teuthology.orchestra.run.smithi105.stdout: "initiated_at": "2024-09-21T03:19:23.219222+0000", 2024-09-21T03:20:06.614 INFO:teuthology.orchestra.run.smithi105.stdout: "age": 43.386522722999999, 2024-09-21T03:20:06.614 INFO:teuthology.orchestra.run.smithi105.stdout: "duration": 1.1047145060000001, 2024-09-21T03:20:06.614 INFO:teuthology.orchestra.run.smithi105.stdout: "continuous": false, 2024-09-21T03:20:06.614 INFO:teuthology.orchestra.run.smithi105.stdout: "type_data": { 2024-09-21T03:20:06.614 INFO:teuthology.orchestra.run.smithi105.stdout: "result": 0, 2024-09-21T03:20:06.615 INFO:teuthology.orchestra.run.smithi105.stdout: "flag_point": "done", 2024-09-21T03:20:06.615 INFO:teuthology.orchestra.run.smithi105.stdout: "reqid": { 2024-09-21T03:20:06.615 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": { 2024-09-21T03:20:06.615 INFO:teuthology.orchestra.run.smithi105.stdout: "type": "client", 2024-09-21T03:20:06.615 INFO:teuthology.orchestra.run.smithi105.stdout: "num": 4948 2024-09-21T03:20:06.615 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.615 INFO:teuthology.orchestra.run.smithi105.stdout: "tid": 2 2024-09-21T03:20:06.615 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.615 INFO:teuthology.orchestra.run.smithi105.stdout: "op_type": "client_request", 2024-09-21T03:20:06.615 INFO:teuthology.orchestra.run.smithi105.stdout: "events": [ 2024-09-21T03:20:06.615 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.615 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:23.219222+0000", 2024-09-21T03:20:06.615 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "initiated" 2024-09-21T03:20:06.615 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.616 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.616 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:23.219222+0000", 2024-09-21T03:20:06.616 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "header_read" 2024-09-21T03:20:06.616 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.616 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.616 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:23.219224+0000", 2024-09-21T03:20:06.616 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "throttled" 2024-09-21T03:20:06.616 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.616 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.616 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:23.219236+0000", 2024-09-21T03:20:06.616 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "all_read" 2024-09-21T03:20:06.616 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.616 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.616 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:23.219275+0000", 2024-09-21T03:20:06.617 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "dispatched" 2024-09-21T03:20:06.617 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.617 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.617 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:23.219463+0000", 2024-09-21T03:20:06.617 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "acquired locks" 2024-09-21T03:20:06.617 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.617 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.617 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:23.219540+0000", 2024-09-21T03:20:06.617 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "early_replied" 2024-09-21T03:20:06.617 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.617 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.617 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:23.219541+0000", 2024-09-21T03:20:06.617 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "submit entry: journal_and_reply" 2024-09-21T03:20:06.617 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.617 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.618 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:24.323777+0000", 2024-09-21T03:20:06.618 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "journal_committed: " 2024-09-21T03:20:06.618 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.618 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.618 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:24.323828+0000", 2024-09-21T03:20:06.618 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "replying" 2024-09-21T03:20:06.618 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.618 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.618 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:24.323913+0000", 2024-09-21T03:20:06.618 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "finishing request" 2024-09-21T03:20:06.618 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.618 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.618 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:24.323936+0000", 2024-09-21T03:20:06.618 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cleaned up request" 2024-09-21T03:20:06.618 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.619 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.619 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:24.323936+0000", 2024-09-21T03:20:06.619 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "done" 2024-09-21T03:20:06.619 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.619 INFO:teuthology.orchestra.run.smithi105.stdout: ], 2024-09-21T03:20:06.619 INFO:teuthology.orchestra.run.smithi105.stdout: "locks": null 2024-09-21T03:20:06.619 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.619 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.619 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.619 INFO:teuthology.orchestra.run.smithi105.stdout: "description": "client_request(client.4948:27 create owner_uid=1000, owner_gid=1333 #0x10000000000/file_0 2024-09-21T03:19:25.248688+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-21T03:20:06.619 INFO:teuthology.orchestra.run.smithi105.stdout: "initiated_at": "2024-09-21T03:19:25.249795+0000", 2024-09-21T03:20:06.619 INFO:teuthology.orchestra.run.smithi105.stdout: "age": 41.355949692000003, 2024-09-21T03:20:06.619 INFO:teuthology.orchestra.run.smithi105.stdout: "duration": 0.0065199819999999997, 2024-09-21T03:20:06.619 INFO:teuthology.orchestra.run.smithi105.stdout: "continuous": false, 2024-09-21T03:20:06.620 INFO:teuthology.orchestra.run.smithi105.stdout: "type_data": { 2024-09-21T03:20:06.620 INFO:teuthology.orchestra.run.smithi105.stdout: "result": 0, 2024-09-21T03:20:06.620 INFO:teuthology.orchestra.run.smithi105.stdout: "flag_point": "done", 2024-09-21T03:20:06.620 INFO:teuthology.orchestra.run.smithi105.stdout: "reqid": { 2024-09-21T03:20:06.620 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": { 2024-09-21T03:20:06.620 INFO:teuthology.orchestra.run.smithi105.stdout: "type": "client", 2024-09-21T03:20:06.620 INFO:teuthology.orchestra.run.smithi105.stdout: "num": 4948 2024-09-21T03:20:06.620 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.620 INFO:teuthology.orchestra.run.smithi105.stdout: "tid": 27 2024-09-21T03:20:06.620 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.620 INFO:teuthology.orchestra.run.smithi105.stdout: "op_type": "client_request", 2024-09-21T03:20:06.620 INFO:teuthology.orchestra.run.smithi105.stdout: "events": [ 2024-09-21T03:20:06.620 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.620 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.249795+0000", 2024-09-21T03:20:06.621 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "initiated" 2024-09-21T03:20:06.621 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.621 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.621 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.249795+0000", 2024-09-21T03:20:06.621 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "header_read" 2024-09-21T03:20:06.621 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.621 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.621 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.249796+0000", 2024-09-21T03:20:06.621 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "throttled" 2024-09-21T03:20:06.621 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.621 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.621 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.249808+0000", 2024-09-21T03:20:06.621 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "all_read" 2024-09-21T03:20:06.621 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.621 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.622 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.249825+0000", 2024-09-21T03:20:06.622 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "dispatched" 2024-09-21T03:20:06.622 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.622 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.622 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.250012+0000", 2024-09-21T03:20:06.622 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "acquired locks" 2024-09-21T03:20:06.622 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.622 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.622 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.250317+0000", 2024-09-21T03:20:06.622 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "early_replied" 2024-09-21T03:20:06.622 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.622 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.622 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.250317+0000", 2024-09-21T03:20:06.622 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "submit entry: journal_and_reply" 2024-09-21T03:20:06.623 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.623 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.623 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.256008+0000", 2024-09-21T03:20:06.623 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "journal_committed: " 2024-09-21T03:20:06.623 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.623 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.623 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.256147+0000", 2024-09-21T03:20:06.623 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "replying" 2024-09-21T03:20:06.623 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.623 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.623 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.256229+0000", 2024-09-21T03:20:06.623 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "finishing request" 2024-09-21T03:20:06.623 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.623 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.624 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.256314+0000", 2024-09-21T03:20:06.624 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cleaned up request" 2024-09-21T03:20:06.624 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.624 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.624 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.256315+0000", 2024-09-21T03:20:06.624 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "done" 2024-09-21T03:20:06.624 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.624 INFO:teuthology.orchestra.run.smithi105.stdout: ], 2024-09-21T03:20:06.624 INFO:teuthology.orchestra.run.smithi105.stdout: "locks": null 2024-09-21T03:20:06.624 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.624 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.624 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.624 INFO:teuthology.orchestra.run.smithi105.stdout: "description": "client_request(client.4948:29 create owner_uid=1000, owner_gid=1333 #0x10000000000/file_2 2024-09-21T03:19:25.260688+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-21T03:20:06.624 INFO:teuthology.orchestra.run.smithi105.stdout: "initiated_at": "2024-09-21T03:19:25.261676+0000", 2024-09-21T03:20:06.624 INFO:teuthology.orchestra.run.smithi105.stdout: "age": 41.344068581000002, 2024-09-21T03:20:06.624 INFO:teuthology.orchestra.run.smithi105.stdout: "duration": 0.0067353669999999999, 2024-09-21T03:20:06.625 INFO:teuthology.orchestra.run.smithi105.stdout: "continuous": false, 2024-09-21T03:20:06.625 INFO:teuthology.orchestra.run.smithi105.stdout: "type_data": { 2024-09-21T03:20:06.625 INFO:teuthology.orchestra.run.smithi105.stdout: "result": 0, 2024-09-21T03:20:06.625 INFO:teuthology.orchestra.run.smithi105.stdout: "flag_point": "done", 2024-09-21T03:20:06.625 INFO:teuthology.orchestra.run.smithi105.stdout: "reqid": { 2024-09-21T03:20:06.625 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": { 2024-09-21T03:20:06.625 INFO:teuthology.orchestra.run.smithi105.stdout: "type": "client", 2024-09-21T03:20:06.625 INFO:teuthology.orchestra.run.smithi105.stdout: "num": 4948 2024-09-21T03:20:06.625 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.625 INFO:teuthology.orchestra.run.smithi105.stdout: "tid": 29 2024-09-21T03:20:06.625 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.625 INFO:teuthology.orchestra.run.smithi105.stdout: "op_type": "client_request", 2024-09-21T03:20:06.625 INFO:teuthology.orchestra.run.smithi105.stdout: "events": [ 2024-09-21T03:20:06.625 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.625 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.261676+0000", 2024-09-21T03:20:06.626 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "initiated" 2024-09-21T03:20:06.626 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.626 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.626 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.261676+0000", 2024-09-21T03:20:06.626 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "header_read" 2024-09-21T03:20:06.626 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.626 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.626 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.261677+0000", 2024-09-21T03:20:06.626 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "throttled" 2024-09-21T03:20:06.626 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.626 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.626 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.261684+0000", 2024-09-21T03:20:06.626 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "all_read" 2024-09-21T03:20:06.626 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.626 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.627 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.261706+0000", 2024-09-21T03:20:06.627 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "dispatched" 2024-09-21T03:20:06.627 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.627 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.627 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.261977+0000", 2024-09-21T03:20:06.627 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "acquired locks" 2024-09-21T03:20:06.627 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.627 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.627 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.262314+0000", 2024-09-21T03:20:06.627 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "early_replied" 2024-09-21T03:20:06.627 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.627 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.627 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.262315+0000", 2024-09-21T03:20:06.627 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "submit entry: journal_and_reply" 2024-09-21T03:20:06.627 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.628 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.628 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.268112+0000", 2024-09-21T03:20:06.628 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "journal_committed: " 2024-09-21T03:20:06.628 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.628 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.628 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.268248+0000", 2024-09-21T03:20:06.628 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "replying" 2024-09-21T03:20:06.628 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.628 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.628 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.268328+0000", 2024-09-21T03:20:06.628 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "finishing request" 2024-09-21T03:20:06.628 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.628 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.628 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.268411+0000", 2024-09-21T03:20:06.629 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cleaned up request" 2024-09-21T03:20:06.629 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.629 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.629 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.268411+0000", 2024-09-21T03:20:06.629 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "done" 2024-09-21T03:20:06.629 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.629 INFO:teuthology.orchestra.run.smithi105.stdout: ], 2024-09-21T03:20:06.629 INFO:teuthology.orchestra.run.smithi105.stdout: "locks": null 2024-09-21T03:20:06.629 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.629 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.629 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.629 INFO:teuthology.orchestra.run.smithi105.stdout: "description": "client_request(client.4948:33 create owner_uid=1000, owner_gid=1333 #0x10000000000/file_6 2024-09-21T03:19:25.281687+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-21T03:20:06.629 INFO:teuthology.orchestra.run.smithi105.stdout: "initiated_at": "2024-09-21T03:19:25.282148+0000", 2024-09-21T03:20:06.630 INFO:teuthology.orchestra.run.smithi105.stdout: "age": 41.323596125999998, 2024-09-21T03:20:06.630 INFO:teuthology.orchestra.run.smithi105.stdout: "duration": 0.0055613750000000003, 2024-09-21T03:20:06.630 INFO:teuthology.orchestra.run.smithi105.stdout: "continuous": false, 2024-09-21T03:20:06.630 INFO:teuthology.orchestra.run.smithi105.stdout: "type_data": { 2024-09-21T03:20:06.630 INFO:teuthology.orchestra.run.smithi105.stdout: "result": 0, 2024-09-21T03:20:06.630 INFO:teuthology.orchestra.run.smithi105.stdout: "flag_point": "done", 2024-09-21T03:20:06.630 INFO:teuthology.orchestra.run.smithi105.stdout: "reqid": { 2024-09-21T03:20:06.630 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": { 2024-09-21T03:20:06.630 INFO:teuthology.orchestra.run.smithi105.stdout: "type": "client", 2024-09-21T03:20:06.630 INFO:teuthology.orchestra.run.smithi105.stdout: "num": 4948 2024-09-21T03:20:06.630 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.630 INFO:teuthology.orchestra.run.smithi105.stdout: "tid": 33 2024-09-21T03:20:06.630 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.630 INFO:teuthology.orchestra.run.smithi105.stdout: "op_type": "client_request", 2024-09-21T03:20:06.631 INFO:teuthology.orchestra.run.smithi105.stdout: "events": [ 2024-09-21T03:20:06.631 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.631 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.282148+0000", 2024-09-21T03:20:06.631 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "initiated" 2024-09-21T03:20:06.631 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.631 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.631 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.282148+0000", 2024-09-21T03:20:06.631 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "header_read" 2024-09-21T03:20:06.631 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.631 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.631 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.282149+0000", 2024-09-21T03:20:06.631 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "throttled" 2024-09-21T03:20:06.631 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.631 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.632 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.282155+0000", 2024-09-21T03:20:06.632 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "all_read" 2024-09-21T03:20:06.632 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.632 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.632 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.282187+0000", 2024-09-21T03:20:06.632 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "dispatched" 2024-09-21T03:20:06.632 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.632 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.632 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.282515+0000", 2024-09-21T03:20:06.632 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "acquired locks" 2024-09-21T03:20:06.632 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.632 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.632 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.282869+0000", 2024-09-21T03:20:06.632 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "early_replied" 2024-09-21T03:20:06.633 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.633 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.633 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.282870+0000", 2024-09-21T03:20:06.633 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "submit entry: journal_and_reply" 2024-09-21T03:20:06.633 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.633 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.633 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.287380+0000", 2024-09-21T03:20:06.633 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "journal_committed: " 2024-09-21T03:20:06.633 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.633 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.633 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.287539+0000", 2024-09-21T03:20:06.633 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "replying" 2024-09-21T03:20:06.633 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.633 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.634 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.287621+0000", 2024-09-21T03:20:06.634 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "finishing request" 2024-09-21T03:20:06.634 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.634 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.634 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.287709+0000", 2024-09-21T03:20:06.634 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cleaned up request" 2024-09-21T03:20:06.634 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.634 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.634 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.287710+0000", 2024-09-21T03:20:06.634 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "done" 2024-09-21T03:20:06.634 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.634 INFO:teuthology.orchestra.run.smithi105.stdout: ], 2024-09-21T03:20:06.634 INFO:teuthology.orchestra.run.smithi105.stdout: "locks": null 2024-09-21T03:20:06.634 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.635 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.635 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.635 INFO:teuthology.orchestra.run.smithi105.stdout: "description": "client_request(client.4948:43 create owner_uid=1000, owner_gid=1333 #0x10000000000/file_16 2024-09-21T03:19:25.325686+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-21T03:20:06.635 INFO:teuthology.orchestra.run.smithi105.stdout: "initiated_at": "2024-09-21T03:19:25.326521+0000", 2024-09-21T03:20:06.635 INFO:teuthology.orchestra.run.smithi105.stdout: "age": 41.279223213000002, 2024-09-21T03:20:06.635 INFO:teuthology.orchestra.run.smithi105.stdout: "duration": 0.0055555459999999997, 2024-09-21T03:20:06.635 INFO:teuthology.orchestra.run.smithi105.stdout: "continuous": false, 2024-09-21T03:20:06.635 INFO:teuthology.orchestra.run.smithi105.stdout: "type_data": { 2024-09-21T03:20:06.635 INFO:teuthology.orchestra.run.smithi105.stdout: "result": 0, 2024-09-21T03:20:06.635 INFO:teuthology.orchestra.run.smithi105.stdout: "flag_point": "done", 2024-09-21T03:20:06.635 INFO:teuthology.orchestra.run.smithi105.stdout: "reqid": { 2024-09-21T03:20:06.635 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": { 2024-09-21T03:20:06.635 INFO:teuthology.orchestra.run.smithi105.stdout: "type": "client", 2024-09-21T03:20:06.635 INFO:teuthology.orchestra.run.smithi105.stdout: "num": 4948 2024-09-21T03:20:06.635 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.636 INFO:teuthology.orchestra.run.smithi105.stdout: "tid": 43 2024-09-21T03:20:06.636 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.636 INFO:teuthology.orchestra.run.smithi105.stdout: "op_type": "client_request", 2024-09-21T03:20:06.636 INFO:teuthology.orchestra.run.smithi105.stdout: "events": [ 2024-09-21T03:20:06.636 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.636 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.326521+0000", 2024-09-21T03:20:06.636 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "initiated" 2024-09-21T03:20:06.636 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.636 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.636 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.326521+0000", 2024-09-21T03:20:06.636 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "header_read" 2024-09-21T03:20:06.636 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.636 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.636 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.326522+0000", 2024-09-21T03:20:06.636 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "throttled" 2024-09-21T03:20:06.637 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.637 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.637 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.326527+0000", 2024-09-21T03:20:06.637 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "all_read" 2024-09-21T03:20:06.637 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.637 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.637 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.326552+0000", 2024-09-21T03:20:06.637 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "dispatched" 2024-09-21T03:20:06.637 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.637 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.637 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.326841+0000", 2024-09-21T03:20:06.637 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "acquired locks" 2024-09-21T03:20:06.637 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.637 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.638 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.327207+0000", 2024-09-21T03:20:06.638 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "early_replied" 2024-09-21T03:20:06.638 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.638 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.638 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.327208+0000", 2024-09-21T03:20:06.638 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "submit entry: journal_and_reply" 2024-09-21T03:20:06.638 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.638 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.638 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.331764+0000", 2024-09-21T03:20:06.638 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "journal_committed: " 2024-09-21T03:20:06.638 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.638 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.638 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.331904+0000", 2024-09-21T03:20:06.638 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "replying" 2024-09-21T03:20:06.639 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.639 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.639 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.331987+0000", 2024-09-21T03:20:06.639 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "finishing request" 2024-09-21T03:20:06.639 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.639 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.639 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.332076+0000", 2024-09-21T03:20:06.639 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cleaned up request" 2024-09-21T03:20:06.639 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.639 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.639 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.332077+0000", 2024-09-21T03:20:06.639 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "done" 2024-09-21T03:20:06.640 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.640 INFO:teuthology.orchestra.run.smithi105.stdout: ], 2024-09-21T03:20:06.640 INFO:teuthology.orchestra.run.smithi105.stdout: "locks": null 2024-09-21T03:20:06.640 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.640 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.640 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.640 INFO:teuthology.orchestra.run.smithi105.stdout: "description": "client_request(client.4948:44 create owner_uid=1000, owner_gid=1333 #0x10000000000/file_17 2024-09-21T03:19:25.331686+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-21T03:20:06.640 INFO:teuthology.orchestra.run.smithi105.stdout: "initiated_at": "2024-09-21T03:19:25.332085+0000", 2024-09-21T03:20:06.640 INFO:teuthology.orchestra.run.smithi105.stdout: "age": 41.273659522999999, 2024-09-21T03:20:06.640 INFO:teuthology.orchestra.run.smithi105.stdout: "duration": 0.0057432050000000004, 2024-09-21T03:20:06.640 INFO:teuthology.orchestra.run.smithi105.stdout: "continuous": false, 2024-09-21T03:20:06.640 INFO:teuthology.orchestra.run.smithi105.stdout: "type_data": { 2024-09-21T03:20:06.640 INFO:teuthology.orchestra.run.smithi105.stdout: "result": 0, 2024-09-21T03:20:06.640 INFO:teuthology.orchestra.run.smithi105.stdout: "flag_point": "done", 2024-09-21T03:20:06.640 INFO:teuthology.orchestra.run.smithi105.stdout: "reqid": { 2024-09-21T03:20:06.640 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": { 2024-09-21T03:20:06.641 INFO:teuthology.orchestra.run.smithi105.stdout: "type": "client", 2024-09-21T03:20:06.641 INFO:teuthology.orchestra.run.smithi105.stdout: "num": 4948 2024-09-21T03:20:06.641 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.641 INFO:teuthology.orchestra.run.smithi105.stdout: "tid": 44 2024-09-21T03:20:06.641 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.641 INFO:teuthology.orchestra.run.smithi105.stdout: "op_type": "client_request", 2024-09-21T03:20:06.641 INFO:teuthology.orchestra.run.smithi105.stdout: "events": [ 2024-09-21T03:20:06.641 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.641 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.332085+0000", 2024-09-21T03:20:06.642 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "initiated" 2024-09-21T03:20:06.642 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.642 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.642 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.332085+0000", 2024-09-21T03:20:06.642 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "header_read" 2024-09-21T03:20:06.642 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.642 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.642 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.332086+0000", 2024-09-21T03:20:06.642 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "throttled" 2024-09-21T03:20:06.643 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.643 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.643 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.332091+0000", 2024-09-21T03:20:06.643 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "all_read" 2024-09-21T03:20:06.643 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.643 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.643 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.332117+0000", 2024-09-21T03:20:06.643 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "dispatched" 2024-09-21T03:20:06.643 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.643 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.644 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.332414+0000", 2024-09-21T03:20:06.644 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "acquired locks" 2024-09-21T03:20:06.644 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.644 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.644 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.332762+0000", 2024-09-21T03:20:06.644 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "early_replied" 2024-09-21T03:20:06.644 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.644 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.645 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.332762+0000", 2024-09-21T03:20:06.645 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "submit entry: journal_and_reply" 2024-09-21T03:20:06.645 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.645 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.645 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.337515+0000", 2024-09-21T03:20:06.645 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "journal_committed: " 2024-09-21T03:20:06.645 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.645 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.645 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.337650+0000", 2024-09-21T03:20:06.645 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "replying" 2024-09-21T03:20:06.646 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.646 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.646 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.337736+0000", 2024-09-21T03:20:06.646 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "finishing request" 2024-09-21T03:20:06.646 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.646 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.646 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.337828+0000", 2024-09-21T03:20:06.646 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cleaned up request" 2024-09-21T03:20:06.646 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.646 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.647 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.337828+0000", 2024-09-21T03:20:06.647 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "done" 2024-09-21T03:20:06.647 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.647 INFO:teuthology.orchestra.run.smithi105.stdout: ], 2024-09-21T03:20:06.647 INFO:teuthology.orchestra.run.smithi105.stdout: "locks": null 2024-09-21T03:20:06.647 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.647 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.647 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.648 INFO:teuthology.orchestra.run.smithi105.stdout: "description": "client_request(client.4948:46 create owner_uid=1000, owner_gid=1333 #0x10000000000/file_19 2024-09-21T03:19:25.341686+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-21T03:20:06.648 INFO:teuthology.orchestra.run.smithi105.stdout: "initiated_at": "2024-09-21T03:19:25.342509+0000", 2024-09-21T03:20:06.648 INFO:teuthology.orchestra.run.smithi105.stdout: "age": 41.263235401000003, 2024-09-21T03:20:06.648 INFO:teuthology.orchestra.run.smithi105.stdout: "duration": 0.0058212330000000003, 2024-09-21T03:20:06.648 INFO:teuthology.orchestra.run.smithi105.stdout: "continuous": false, 2024-09-21T03:20:06.648 INFO:teuthology.orchestra.run.smithi105.stdout: "type_data": { 2024-09-21T03:20:06.648 INFO:teuthology.orchestra.run.smithi105.stdout: "result": 0, 2024-09-21T03:20:06.648 INFO:teuthology.orchestra.run.smithi105.stdout: "flag_point": "done", 2024-09-21T03:20:06.649 INFO:teuthology.orchestra.run.smithi105.stdout: "reqid": { 2024-09-21T03:20:06.649 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": { 2024-09-21T03:20:06.649 INFO:teuthology.orchestra.run.smithi105.stdout: "type": "client", 2024-09-21T03:20:06.649 INFO:teuthology.orchestra.run.smithi105.stdout: "num": 4948 2024-09-21T03:20:06.649 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.649 INFO:teuthology.orchestra.run.smithi105.stdout: "tid": 46 2024-09-21T03:20:06.649 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.649 INFO:teuthology.orchestra.run.smithi105.stdout: "op_type": "client_request", 2024-09-21T03:20:06.649 INFO:teuthology.orchestra.run.smithi105.stdout: "events": [ 2024-09-21T03:20:06.649 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.650 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.342509+0000", 2024-09-21T03:20:06.650 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "initiated" 2024-09-21T03:20:06.650 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.650 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.650 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.342509+0000", 2024-09-21T03:20:06.650 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "header_read" 2024-09-21T03:20:06.650 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.650 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.650 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.342510+0000", 2024-09-21T03:20:06.651 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "throttled" 2024-09-21T03:20:06.651 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.651 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.651 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.342515+0000", 2024-09-21T03:20:06.651 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "all_read" 2024-09-21T03:20:06.653 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.654 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.654 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.342536+0000", 2024-09-21T03:20:06.654 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "dispatched" 2024-09-21T03:20:06.654 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.654 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.654 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.342959+0000", 2024-09-21T03:20:06.654 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "acquired locks" 2024-09-21T03:20:06.654 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.654 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.654 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.343524+0000", 2024-09-21T03:20:06.654 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "early_replied" 2024-09-21T03:20:06.654 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.655 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.655 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.343525+0000", 2024-09-21T03:20:06.655 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "submit entry: journal_and_reply" 2024-09-21T03:20:06.655 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.655 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.655 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.348020+0000", 2024-09-21T03:20:06.655 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "journal_committed: " 2024-09-21T03:20:06.655 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.655 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.655 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.348155+0000", 2024-09-21T03:20:06.655 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "replying" 2024-09-21T03:20:06.655 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.655 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.655 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.348241+0000", 2024-09-21T03:20:06.656 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "finishing request" 2024-09-21T03:20:06.656 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.656 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.656 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.348330+0000", 2024-09-21T03:20:06.656 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cleaned up request" 2024-09-21T03:20:06.656 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.656 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.656 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.348330+0000", 2024-09-21T03:20:06.656 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "done" 2024-09-21T03:20:06.656 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.656 INFO:teuthology.orchestra.run.smithi105.stdout: ], 2024-09-21T03:20:06.656 INFO:teuthology.orchestra.run.smithi105.stdout: "locks": null 2024-09-21T03:20:06.656 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.656 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.657 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.657 INFO:teuthology.orchestra.run.smithi105.stdout: "description": "client_request(client.4948:48 create owner_uid=1000, owner_gid=1333 #0x10000000000/file_21 2024-09-21T03:19:25.352686+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-21T03:20:06.657 INFO:teuthology.orchestra.run.smithi105.stdout: "initiated_at": "2024-09-21T03:19:25.353423+0000", 2024-09-21T03:20:06.657 INFO:teuthology.orchestra.run.smithi105.stdout: "age": 41.252321756000001, 2024-09-21T03:20:06.657 INFO:teuthology.orchestra.run.smithi105.stdout: "duration": 0.0055900070000000001, 2024-09-21T03:20:06.657 INFO:teuthology.orchestra.run.smithi105.stdout: "continuous": false, 2024-09-21T03:20:06.657 INFO:teuthology.orchestra.run.smithi105.stdout: "type_data": { 2024-09-21T03:20:06.657 INFO:teuthology.orchestra.run.smithi105.stdout: "result": 0, 2024-09-21T03:20:06.657 INFO:teuthology.orchestra.run.smithi105.stdout: "flag_point": "done", 2024-09-21T03:20:06.657 INFO:teuthology.orchestra.run.smithi105.stdout: "reqid": { 2024-09-21T03:20:06.657 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": { 2024-09-21T03:20:06.657 INFO:teuthology.orchestra.run.smithi105.stdout: "type": "client", 2024-09-21T03:20:06.657 INFO:teuthology.orchestra.run.smithi105.stdout: "num": 4948 2024-09-21T03:20:06.657 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.658 INFO:teuthology.orchestra.run.smithi105.stdout: "tid": 48 2024-09-21T03:20:06.658 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.658 INFO:teuthology.orchestra.run.smithi105.stdout: "op_type": "client_request", 2024-09-21T03:20:06.658 INFO:teuthology.orchestra.run.smithi105.stdout: "events": [ 2024-09-21T03:20:06.658 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.658 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.353423+0000", 2024-09-21T03:20:06.658 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "initiated" 2024-09-21T03:20:06.658 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.658 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.658 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.353423+0000", 2024-09-21T03:20:06.658 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "header_read" 2024-09-21T03:20:06.658 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.658 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.658 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.353423+0000", 2024-09-21T03:20:06.658 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "throttled" 2024-09-21T03:20:06.659 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.659 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.659 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.353429+0000", 2024-09-21T03:20:06.659 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "all_read" 2024-09-21T03:20:06.659 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.659 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.659 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.353452+0000", 2024-09-21T03:20:06.659 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "dispatched" 2024-09-21T03:20:06.659 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.659 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.659 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.353736+0000", 2024-09-21T03:20:06.659 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "acquired locks" 2024-09-21T03:20:06.659 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.659 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.660 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.354100+0000", 2024-09-21T03:20:06.660 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "early_replied" 2024-09-21T03:20:06.660 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.660 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.660 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.354101+0000", 2024-09-21T03:20:06.660 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "submit entry: journal_and_reply" 2024-09-21T03:20:06.660 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.660 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.660 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.358685+0000", 2024-09-21T03:20:06.660 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "journal_committed: " 2024-09-21T03:20:06.660 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.660 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.660 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.358842+0000", 2024-09-21T03:20:06.660 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "replying" 2024-09-21T03:20:06.660 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.661 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.661 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.358927+0000", 2024-09-21T03:20:06.661 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "finishing request" 2024-09-21T03:20:06.661 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.661 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.661 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.359012+0000", 2024-09-21T03:20:06.661 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cleaned up request" 2024-09-21T03:20:06.661 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.661 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.661 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.359013+0000", 2024-09-21T03:20:06.661 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "done" 2024-09-21T03:20:06.661 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.661 INFO:teuthology.orchestra.run.smithi105.stdout: ], 2024-09-21T03:20:06.661 INFO:teuthology.orchestra.run.smithi105.stdout: "locks": null 2024-09-21T03:20:06.662 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.662 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.662 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.662 INFO:teuthology.orchestra.run.smithi105.stdout: "description": "client_request(client.4948:50 create owner_uid=1000, owner_gid=1333 #0x10000000000/file_23 2024-09-21T03:19:25.362686+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-21T03:20:06.662 INFO:teuthology.orchestra.run.smithi105.stdout: "initiated_at": "2024-09-21T03:19:25.363286+0000", 2024-09-21T03:20:06.662 INFO:teuthology.orchestra.run.smithi105.stdout: "age": 41.242458382000002, 2024-09-21T03:20:06.662 INFO:teuthology.orchestra.run.smithi105.stdout: "duration": 0.0066830400000000003, 2024-09-21T03:20:06.662 INFO:teuthology.orchestra.run.smithi105.stdout: "continuous": false, 2024-09-21T03:20:06.662 INFO:teuthology.orchestra.run.smithi105.stdout: "type_data": { 2024-09-21T03:20:06.662 INFO:teuthology.orchestra.run.smithi105.stdout: "result": 0, 2024-09-21T03:20:06.662 INFO:teuthology.orchestra.run.smithi105.stdout: "flag_point": "done", 2024-09-21T03:20:06.662 INFO:teuthology.orchestra.run.smithi105.stdout: "reqid": { 2024-09-21T03:20:06.662 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": { 2024-09-21T03:20:06.662 INFO:teuthology.orchestra.run.smithi105.stdout: "type": "client", 2024-09-21T03:20:06.663 INFO:teuthology.orchestra.run.smithi105.stdout: "num": 4948 2024-09-21T03:20:06.663 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.663 INFO:teuthology.orchestra.run.smithi105.stdout: "tid": 50 2024-09-21T03:20:06.663 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.663 INFO:teuthology.orchestra.run.smithi105.stdout: "op_type": "client_request", 2024-09-21T03:20:06.663 INFO:teuthology.orchestra.run.smithi105.stdout: "events": [ 2024-09-21T03:20:06.663 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.663 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.363286+0000", 2024-09-21T03:20:06.663 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "initiated" 2024-09-21T03:20:06.663 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.663 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.663 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.363286+0000", 2024-09-21T03:20:06.663 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "header_read" 2024-09-21T03:20:06.663 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.664 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.664 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.363287+0000", 2024-09-21T03:20:06.664 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "throttled" 2024-09-21T03:20:06.664 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.664 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.664 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.363292+0000", 2024-09-21T03:20:06.664 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "all_read" 2024-09-21T03:20:06.664 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.664 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.664 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.363311+0000", 2024-09-21T03:20:06.664 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "dispatched" 2024-09-21T03:20:06.664 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.664 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.664 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.363604+0000", 2024-09-21T03:20:06.665 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "acquired locks" 2024-09-21T03:20:06.665 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.665 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.665 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.363951+0000", 2024-09-21T03:20:06.665 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "early_replied" 2024-09-21T03:20:06.665 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.665 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.665 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.363951+0000", 2024-09-21T03:20:06.665 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "submit entry: journal_and_reply" 2024-09-21T03:20:06.665 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.665 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.665 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.369651+0000", 2024-09-21T03:20:06.665 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "journal_committed: " 2024-09-21T03:20:06.666 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.666 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.666 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.369783+0000", 2024-09-21T03:20:06.666 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "replying" 2024-09-21T03:20:06.666 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.666 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.666 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.369878+0000", 2024-09-21T03:20:06.666 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "finishing request" 2024-09-21T03:20:06.666 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.666 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.666 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.369969+0000", 2024-09-21T03:20:06.666 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cleaned up request" 2024-09-21T03:20:06.666 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.666 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.667 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.369969+0000", 2024-09-21T03:20:06.667 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "done" 2024-09-21T03:20:06.667 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.667 INFO:teuthology.orchestra.run.smithi105.stdout: ], 2024-09-21T03:20:06.667 INFO:teuthology.orchestra.run.smithi105.stdout: "locks": null 2024-09-21T03:20:06.667 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.667 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.667 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.667 INFO:teuthology.orchestra.run.smithi105.stdout: "description": "client_request(client.4948:54 mkdir owner_uid=1000, owner_gid=1333 #0x1/dir2 2024-09-21T03:19:25.552682+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-21T03:20:06.667 INFO:teuthology.orchestra.run.smithi105.stdout: "initiated_at": "2024-09-21T03:19:25.552939+0000", 2024-09-21T03:20:06.667 INFO:teuthology.orchestra.run.smithi105.stdout: "age": 41.052805042999999, 2024-09-21T03:20:06.667 INFO:teuthology.orchestra.run.smithi105.stdout: "duration": 0.0055198269999999997, 2024-09-21T03:20:06.667 INFO:teuthology.orchestra.run.smithi105.stdout: "continuous": false, 2024-09-21T03:20:06.668 INFO:teuthology.orchestra.run.smithi105.stdout: "type_data": { 2024-09-21T03:20:06.668 INFO:teuthology.orchestra.run.smithi105.stdout: "result": 0, 2024-09-21T03:20:06.668 INFO:teuthology.orchestra.run.smithi105.stdout: "flag_point": "done", 2024-09-21T03:20:06.668 INFO:teuthology.orchestra.run.smithi105.stdout: "reqid": { 2024-09-21T03:20:06.668 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": { 2024-09-21T03:20:06.668 INFO:teuthology.orchestra.run.smithi105.stdout: "type": "client", 2024-09-21T03:20:06.668 INFO:teuthology.orchestra.run.smithi105.stdout: "num": 4948 2024-09-21T03:20:06.668 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.668 INFO:teuthology.orchestra.run.smithi105.stdout: "tid": 54 2024-09-21T03:20:06.668 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.668 INFO:teuthology.orchestra.run.smithi105.stdout: "op_type": "client_request", 2024-09-21T03:20:06.668 INFO:teuthology.orchestra.run.smithi105.stdout: "events": [ 2024-09-21T03:20:06.668 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.668 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.552939+0000", 2024-09-21T03:20:06.669 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "initiated" 2024-09-21T03:20:06.669 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.669 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.669 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.552939+0000", 2024-09-21T03:20:06.669 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "header_read" 2024-09-21T03:20:06.669 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.669 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.669 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.552940+0000", 2024-09-21T03:20:06.669 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "throttled" 2024-09-21T03:20:06.669 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.669 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.669 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.552946+0000", 2024-09-21T03:20:06.669 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "all_read" 2024-09-21T03:20:06.669 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.670 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.670 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.552960+0000", 2024-09-21T03:20:06.670 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "dispatched" 2024-09-21T03:20:06.670 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.670 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.670 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.553182+0000", 2024-09-21T03:20:06.670 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "failed to wrlock, waiting" 2024-09-21T03:20:06.670 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.670 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.670 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.553637+0000", 2024-09-21T03:20:06.670 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "acquired locks" 2024-09-21T03:20:06.670 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.671 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.671 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.553951+0000", 2024-09-21T03:20:06.671 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "early_replied" 2024-09-21T03:20:06.671 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.671 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.671 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.553952+0000", 2024-09-21T03:20:06.671 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "submit entry: journal_and_reply" 2024-09-21T03:20:06.671 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.671 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.671 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.558227+0000", 2024-09-21T03:20:06.671 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "journal_committed: " 2024-09-21T03:20:06.671 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.671 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.671 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.558342+0000", 2024-09-21T03:20:06.672 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "replying" 2024-09-21T03:20:06.672 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.672 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.672 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.558426+0000", 2024-09-21T03:20:06.672 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "finishing request" 2024-09-21T03:20:06.672 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.672 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.672 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.558459+0000", 2024-09-21T03:20:06.672 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cleaned up request" 2024-09-21T03:20:06.672 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.672 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.672 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.558459+0000", 2024-09-21T03:20:06.672 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "done" 2024-09-21T03:20:06.672 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.673 INFO:teuthology.orchestra.run.smithi105.stdout: ], 2024-09-21T03:20:06.673 INFO:teuthology.orchestra.run.smithi105.stdout: "locks": null 2024-09-21T03:20:06.673 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.673 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.673 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.673 INFO:teuthology.orchestra.run.smithi105.stdout: "description": "client_request(client.4948:56 create owner_uid=1000, owner_gid=1333 #0x1000000020e/file_1 2024-09-21T03:19:25.557682+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-21T03:20:06.673 INFO:teuthology.orchestra.run.smithi105.stdout: "initiated_at": "2024-09-21T03:19:25.558822+0000", 2024-09-21T03:20:06.673 INFO:teuthology.orchestra.run.smithi105.stdout: "age": 41.046922160999998, 2024-09-21T03:20:06.673 INFO:teuthology.orchestra.run.smithi105.stdout: "duration": 0.0077129080000000001, 2024-09-21T03:20:06.673 INFO:teuthology.orchestra.run.smithi105.stdout: "continuous": false, 2024-09-21T03:20:06.673 INFO:teuthology.orchestra.run.smithi105.stdout: "type_data": { 2024-09-21T03:20:06.673 INFO:teuthology.orchestra.run.smithi105.stdout: "result": 0, 2024-09-21T03:20:06.673 INFO:teuthology.orchestra.run.smithi105.stdout: "flag_point": "done", 2024-09-21T03:20:06.673 INFO:teuthology.orchestra.run.smithi105.stdout: "reqid": { 2024-09-21T03:20:06.674 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": { 2024-09-21T03:20:06.674 INFO:teuthology.orchestra.run.smithi105.stdout: "type": "client", 2024-09-21T03:20:06.674 INFO:teuthology.orchestra.run.smithi105.stdout: "num": 4948 2024-09-21T03:20:06.674 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.674 INFO:teuthology.orchestra.run.smithi105.stdout: "tid": 56 2024-09-21T03:20:06.674 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.674 INFO:teuthology.orchestra.run.smithi105.stdout: "op_type": "client_request", 2024-09-21T03:20:06.674 INFO:teuthology.orchestra.run.smithi105.stdout: "events": [ 2024-09-21T03:20:06.674 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.674 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.558822+0000", 2024-09-21T03:20:06.674 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "initiated" 2024-09-21T03:20:06.674 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.674 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.674 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.558822+0000", 2024-09-21T03:20:06.675 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "header_read" 2024-09-21T03:20:06.675 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.675 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.675 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.558823+0000", 2024-09-21T03:20:06.675 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "throttled" 2024-09-21T03:20:06.675 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.675 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.675 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.558830+0000", 2024-09-21T03:20:06.675 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "all_read" 2024-09-21T03:20:06.675 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.675 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.675 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.558855+0000", 2024-09-21T03:20:06.675 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "dispatched" 2024-09-21T03:20:06.675 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.675 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.676 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.559346+0000", 2024-09-21T03:20:06.676 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "acquired locks" 2024-09-21T03:20:06.676 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.676 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.676 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.559858+0000", 2024-09-21T03:20:06.676 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "early_replied" 2024-09-21T03:20:06.676 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.676 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.676 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.559859+0000", 2024-09-21T03:20:06.676 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "submit entry: journal_and_reply" 2024-09-21T03:20:06.676 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.676 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.676 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.566204+0000", 2024-09-21T03:20:06.676 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "journal_committed: " 2024-09-21T03:20:06.677 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.677 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.677 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.566366+0000", 2024-09-21T03:20:06.677 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "replying" 2024-09-21T03:20:06.677 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.677 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.677 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.566446+0000", 2024-09-21T03:20:06.677 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "finishing request" 2024-09-21T03:20:06.677 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.677 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.677 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.566535+0000", 2024-09-21T03:20:06.677 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cleaned up request" 2024-09-21T03:20:06.677 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.677 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.677 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.566535+0000", 2024-09-21T03:20:06.678 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "done" 2024-09-21T03:20:06.678 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.678 INFO:teuthology.orchestra.run.smithi105.stdout: ], 2024-09-21T03:20:06.678 INFO:teuthology.orchestra.run.smithi105.stdout: "locks": null 2024-09-21T03:20:06.678 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.678 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.678 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.678 INFO:teuthology.orchestra.run.smithi105.stdout: "description": "client_request(client.4948:78 create owner_uid=1000, owner_gid=1333 #0x1000000020e/file_23 2024-09-21T03:19:25.663680+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-21T03:20:06.678 INFO:teuthology.orchestra.run.smithi105.stdout: "initiated_at": "2024-09-21T03:19:25.664043+0000", 2024-09-21T03:20:06.678 INFO:teuthology.orchestra.run.smithi105.stdout: "age": 40.941701119000001, 2024-09-21T03:20:06.678 INFO:teuthology.orchestra.run.smithi105.stdout: "duration": 0.0055383419999999999, 2024-09-21T03:20:06.678 INFO:teuthology.orchestra.run.smithi105.stdout: "continuous": false, 2024-09-21T03:20:06.678 INFO:teuthology.orchestra.run.smithi105.stdout: "type_data": { 2024-09-21T03:20:06.678 INFO:teuthology.orchestra.run.smithi105.stdout: "result": 0, 2024-09-21T03:20:06.679 INFO:teuthology.orchestra.run.smithi105.stdout: "flag_point": "done", 2024-09-21T03:20:06.679 INFO:teuthology.orchestra.run.smithi105.stdout: "reqid": { 2024-09-21T03:20:06.679 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": { 2024-09-21T03:20:06.679 INFO:teuthology.orchestra.run.smithi105.stdout: "type": "client", 2024-09-21T03:20:06.679 INFO:teuthology.orchestra.run.smithi105.stdout: "num": 4948 2024-09-21T03:20:06.679 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.679 INFO:teuthology.orchestra.run.smithi105.stdout: "tid": 78 2024-09-21T03:20:06.679 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.679 INFO:teuthology.orchestra.run.smithi105.stdout: "op_type": "client_request", 2024-09-21T03:20:06.679 INFO:teuthology.orchestra.run.smithi105.stdout: "events": [ 2024-09-21T03:20:06.679 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.679 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.664043+0000", 2024-09-21T03:20:06.679 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "initiated" 2024-09-21T03:20:06.679 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.680 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.680 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.664043+0000", 2024-09-21T03:20:06.680 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "header_read" 2024-09-21T03:20:06.680 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.680 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.680 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.664044+0000", 2024-09-21T03:20:06.680 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "throttled" 2024-09-21T03:20:06.680 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.680 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.680 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.664050+0000", 2024-09-21T03:20:06.680 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "all_read" 2024-09-21T03:20:06.680 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.680 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.680 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.664070+0000", 2024-09-21T03:20:06.680 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "dispatched" 2024-09-21T03:20:06.681 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.681 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.681 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.664379+0000", 2024-09-21T03:20:06.681 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "acquired locks" 2024-09-21T03:20:06.681 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.681 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.681 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.664731+0000", 2024-09-21T03:20:06.681 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "early_replied" 2024-09-21T03:20:06.681 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.681 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.681 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.664732+0000", 2024-09-21T03:20:06.681 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "submit entry: journal_and_reply" 2024-09-21T03:20:06.681 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.682 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.682 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.669272+0000", 2024-09-21T03:20:06.682 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "journal_committed: " 2024-09-21T03:20:06.682 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.682 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.682 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.669408+0000", 2024-09-21T03:20:06.682 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "replying" 2024-09-21T03:20:06.682 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.682 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.682 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.669493+0000", 2024-09-21T03:20:06.682 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "finishing request" 2024-09-21T03:20:06.682 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.682 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.682 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.669581+0000", 2024-09-21T03:20:06.682 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cleaned up request" 2024-09-21T03:20:06.683 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.683 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.683 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:25.669582+0000", 2024-09-21T03:20:06.683 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "done" 2024-09-21T03:20:06.683 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.683 INFO:teuthology.orchestra.run.smithi105.stdout: ], 2024-09-21T03:20:06.683 INFO:teuthology.orchestra.run.smithi105.stdout: "locks": null 2024-09-21T03:20:06.683 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.683 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.683 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.683 INFO:teuthology.orchestra.run.smithi105.stdout: "description": "client_request(client.4948:110 mkdir owner_uid=1000, owner_gid=1333 #0x1/dir4 2024-09-21T03:19:26.147670+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-21T03:20:06.683 INFO:teuthology.orchestra.run.smithi105.stdout: "initiated_at": "2024-09-21T03:19:26.148399+0000", 2024-09-21T03:20:06.683 INFO:teuthology.orchestra.run.smithi105.stdout: "age": 40.457345599, 2024-09-21T03:20:06.683 INFO:teuthology.orchestra.run.smithi105.stdout: "duration": 0.0065757960000000001, 2024-09-21T03:20:06.683 INFO:teuthology.orchestra.run.smithi105.stdout: "continuous": false, 2024-09-21T03:20:06.684 INFO:teuthology.orchestra.run.smithi105.stdout: "type_data": { 2024-09-21T03:20:06.684 INFO:teuthology.orchestra.run.smithi105.stdout: "result": 0, 2024-09-21T03:20:06.684 INFO:teuthology.orchestra.run.smithi105.stdout: "flag_point": "done", 2024-09-21T03:20:06.684 INFO:teuthology.orchestra.run.smithi105.stdout: "reqid": { 2024-09-21T03:20:06.684 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": { 2024-09-21T03:20:06.684 INFO:teuthology.orchestra.run.smithi105.stdout: "type": "client", 2024-09-21T03:20:06.684 INFO:teuthology.orchestra.run.smithi105.stdout: "num": 4948 2024-09-21T03:20:06.684 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.684 INFO:teuthology.orchestra.run.smithi105.stdout: "tid": 110 2024-09-21T03:20:06.684 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.684 INFO:teuthology.orchestra.run.smithi105.stdout: "op_type": "client_request", 2024-09-21T03:20:06.684 INFO:teuthology.orchestra.run.smithi105.stdout: "events": [ 2024-09-21T03:20:06.684 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.684 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.148399+0000", 2024-09-21T03:20:06.685 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "initiated" 2024-09-21T03:20:06.685 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.685 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.685 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.148399+0000", 2024-09-21T03:20:06.685 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "header_read" 2024-09-21T03:20:06.685 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.685 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.685 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.148400+0000", 2024-09-21T03:20:06.685 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "throttled" 2024-09-21T03:20:06.685 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.685 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.685 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.148406+0000", 2024-09-21T03:20:06.685 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "all_read" 2024-09-21T03:20:06.685 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.685 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.686 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.148419+0000", 2024-09-21T03:20:06.686 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "dispatched" 2024-09-21T03:20:06.686 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.686 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.686 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.148649+0000", 2024-09-21T03:20:06.686 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "failed to wrlock, waiting" 2024-09-21T03:20:06.686 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.686 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.686 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.149120+0000", 2024-09-21T03:20:06.686 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "acquired locks" 2024-09-21T03:20:06.686 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.686 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.686 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.149420+0000", 2024-09-21T03:20:06.686 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "early_replied" 2024-09-21T03:20:06.687 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.687 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.687 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.149421+0000", 2024-09-21T03:20:06.687 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "submit entry: journal_and_reply" 2024-09-21T03:20:06.687 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.687 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.687 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.154735+0000", 2024-09-21T03:20:06.687 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "journal_committed: " 2024-09-21T03:20:06.687 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.687 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.687 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.154863+0000", 2024-09-21T03:20:06.687 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "replying" 2024-09-21T03:20:06.687 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.687 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.687 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.154940+0000", 2024-09-21T03:20:06.688 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "finishing request" 2024-09-21T03:20:06.688 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.688 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.688 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.154974+0000", 2024-09-21T03:20:06.688 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cleaned up request" 2024-09-21T03:20:06.688 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.688 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.688 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.154975+0000", 2024-09-21T03:20:06.688 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "done" 2024-09-21T03:20:06.688 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.688 INFO:teuthology.orchestra.run.smithi105.stdout: ], 2024-09-21T03:20:06.688 INFO:teuthology.orchestra.run.smithi105.stdout: "locks": null 2024-09-21T03:20:06.688 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.688 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.688 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.689 INFO:teuthology.orchestra.run.smithi105.stdout: "description": "client_request(client.4948:111 create owner_uid=1000, owner_gid=1333 #0x10000000242/file_0 2024-09-21T03:19:26.148670+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-21T03:20:06.689 INFO:teuthology.orchestra.run.smithi105.stdout: "initiated_at": "2024-09-21T03:19:26.149605+0000", 2024-09-21T03:20:06.689 INFO:teuthology.orchestra.run.smithi105.stdout: "age": 40.456139100000001, 2024-09-21T03:20:06.689 INFO:teuthology.orchestra.run.smithi105.stdout: "duration": 0.0057109450000000003, 2024-09-21T03:20:06.689 INFO:teuthology.orchestra.run.smithi105.stdout: "continuous": false, 2024-09-21T03:20:06.689 INFO:teuthology.orchestra.run.smithi105.stdout: "type_data": { 2024-09-21T03:20:06.689 INFO:teuthology.orchestra.run.smithi105.stdout: "result": 0, 2024-09-21T03:20:06.689 INFO:teuthology.orchestra.run.smithi105.stdout: "flag_point": "done", 2024-09-21T03:20:06.689 INFO:teuthology.orchestra.run.smithi105.stdout: "reqid": { 2024-09-21T03:20:06.689 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": { 2024-09-21T03:20:06.689 INFO:teuthology.orchestra.run.smithi105.stdout: "type": "client", 2024-09-21T03:20:06.689 INFO:teuthology.orchestra.run.smithi105.stdout: "num": 4948 2024-09-21T03:20:06.689 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.689 INFO:teuthology.orchestra.run.smithi105.stdout: "tid": 111 2024-09-21T03:20:06.689 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.690 INFO:teuthology.orchestra.run.smithi105.stdout: "op_type": "client_request", 2024-09-21T03:20:06.690 INFO:teuthology.orchestra.run.smithi105.stdout: "events": [ 2024-09-21T03:20:06.690 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.690 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.149605+0000", 2024-09-21T03:20:06.690 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "initiated" 2024-09-21T03:20:06.690 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.690 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.690 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.149605+0000", 2024-09-21T03:20:06.690 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "header_read" 2024-09-21T03:20:06.690 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.690 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.690 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.149606+0000", 2024-09-21T03:20:06.690 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "throttled" 2024-09-21T03:20:06.690 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.690 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.691 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.149612+0000", 2024-09-21T03:20:06.691 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "all_read" 2024-09-21T03:20:06.691 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.691 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.691 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.149627+0000", 2024-09-21T03:20:06.691 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "dispatched" 2024-09-21T03:20:06.691 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.691 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.691 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.149952+0000", 2024-09-21T03:20:06.691 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "acquired locks" 2024-09-21T03:20:06.691 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.691 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.691 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.150470+0000", 2024-09-21T03:20:06.691 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "early_replied" 2024-09-21T03:20:06.691 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.692 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.692 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.150488+0000", 2024-09-21T03:20:06.692 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "submit entry: journal_and_reply" 2024-09-21T03:20:06.692 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.692 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.692 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.154977+0000", 2024-09-21T03:20:06.692 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "journal_committed: " 2024-09-21T03:20:06.692 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.692 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.692 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.155101+0000", 2024-09-21T03:20:06.692 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "replying" 2024-09-21T03:20:06.692 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.692 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.692 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.155184+0000", 2024-09-21T03:20:06.692 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "finishing request" 2024-09-21T03:20:06.692 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.693 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.693 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.155315+0000", 2024-09-21T03:20:06.693 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cleaned up request" 2024-09-21T03:20:06.693 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.693 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.693 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.155316+0000", 2024-09-21T03:20:06.693 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "done" 2024-09-21T03:20:06.693 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.693 INFO:teuthology.orchestra.run.smithi105.stdout: ], 2024-09-21T03:20:06.693 INFO:teuthology.orchestra.run.smithi105.stdout: "locks": null 2024-09-21T03:20:06.693 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.693 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.693 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.693 INFO:teuthology.orchestra.run.smithi105.stdout: "description": "client_request(client.4948:113 create owner_uid=1000, owner_gid=1333 #0x10000000242/file_2 2024-09-21T03:19:26.159669+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-21T03:20:06.694 INFO:teuthology.orchestra.run.smithi105.stdout: "initiated_at": "2024-09-21T03:19:26.160296+0000", 2024-09-21T03:20:06.694 INFO:teuthology.orchestra.run.smithi105.stdout: "age": 40.445448069000001, 2024-09-21T03:20:06.694 INFO:teuthology.orchestra.run.smithi105.stdout: "duration": 0.0082749030000000001, 2024-09-21T03:20:06.694 INFO:teuthology.orchestra.run.smithi105.stdout: "continuous": false, 2024-09-21T03:20:06.694 INFO:teuthology.orchestra.run.smithi105.stdout: "type_data": { 2024-09-21T03:20:06.694 INFO:teuthology.orchestra.run.smithi105.stdout: "result": 0, 2024-09-21T03:20:06.694 INFO:teuthology.orchestra.run.smithi105.stdout: "flag_point": "done", 2024-09-21T03:20:06.694 INFO:teuthology.orchestra.run.smithi105.stdout: "reqid": { 2024-09-21T03:20:06.694 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": { 2024-09-21T03:20:06.694 INFO:teuthology.orchestra.run.smithi105.stdout: "type": "client", 2024-09-21T03:20:06.694 INFO:teuthology.orchestra.run.smithi105.stdout: "num": 4948 2024-09-21T03:20:06.694 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.694 INFO:teuthology.orchestra.run.smithi105.stdout: "tid": 113 2024-09-21T03:20:06.694 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.695 INFO:teuthology.orchestra.run.smithi105.stdout: "op_type": "client_request", 2024-09-21T03:20:06.695 INFO:teuthology.orchestra.run.smithi105.stdout: "events": [ 2024-09-21T03:20:06.695 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.695 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.160296+0000", 2024-09-21T03:20:06.695 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "initiated" 2024-09-21T03:20:06.695 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.695 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.695 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.160296+0000", 2024-09-21T03:20:06.695 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "header_read" 2024-09-21T03:20:06.695 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.695 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.695 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.160297+0000", 2024-09-21T03:20:06.695 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "throttled" 2024-09-21T03:20:06.695 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.696 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.696 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.160304+0000", 2024-09-21T03:20:06.696 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "all_read" 2024-09-21T03:20:06.696 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.696 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.696 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.160326+0000", 2024-09-21T03:20:06.696 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "dispatched" 2024-09-21T03:20:06.696 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.696 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.696 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.160830+0000", 2024-09-21T03:20:06.696 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "acquired locks" 2024-09-21T03:20:06.696 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.696 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.696 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.161397+0000", 2024-09-21T03:20:06.697 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "early_replied" 2024-09-21T03:20:06.697 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.697 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.697 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.161398+0000", 2024-09-21T03:20:06.697 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "submit entry: journal_and_reply" 2024-09-21T03:20:06.697 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.697 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.697 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.168181+0000", 2024-09-21T03:20:06.697 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "journal_committed: " 2024-09-21T03:20:06.697 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.697 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.697 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.168327+0000", 2024-09-21T03:20:06.697 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "replying" 2024-09-21T03:20:06.697 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.698 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.698 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.168444+0000", 2024-09-21T03:20:06.698 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "finishing request" 2024-09-21T03:20:06.698 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.698 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.698 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.168568+0000", 2024-09-21T03:20:06.698 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cleaned up request" 2024-09-21T03:20:06.698 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.698 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.698 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.168571+0000", 2024-09-21T03:20:06.698 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "done" 2024-09-21T03:20:06.698 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.698 INFO:teuthology.orchestra.run.smithi105.stdout: ], 2024-09-21T03:20:06.698 INFO:teuthology.orchestra.run.smithi105.stdout: "locks": null 2024-09-21T03:20:06.699 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.699 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.699 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.699 INFO:teuthology.orchestra.run.smithi105.stdout: "description": "client_request(client.4948:116 create owner_uid=1000, owner_gid=1333 #0x10000000242/file_5 2024-09-21T03:19:26.177669+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-21T03:20:06.699 INFO:teuthology.orchestra.run.smithi105.stdout: "initiated_at": "2024-09-21T03:19:26.178766+0000", 2024-09-21T03:20:06.699 INFO:teuthology.orchestra.run.smithi105.stdout: "age": 40.426978908999999, 2024-09-21T03:20:06.699 INFO:teuthology.orchestra.run.smithi105.stdout: "duration": 0.0057709099999999998, 2024-09-21T03:20:06.699 INFO:teuthology.orchestra.run.smithi105.stdout: "continuous": false, 2024-09-21T03:20:06.699 INFO:teuthology.orchestra.run.smithi105.stdout: "type_data": { 2024-09-21T03:20:06.699 INFO:teuthology.orchestra.run.smithi105.stdout: "result": 0, 2024-09-21T03:20:06.699 INFO:teuthology.orchestra.run.smithi105.stdout: "flag_point": "done", 2024-09-21T03:20:06.699 INFO:teuthology.orchestra.run.smithi105.stdout: "reqid": { 2024-09-21T03:20:06.699 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": { 2024-09-21T03:20:06.699 INFO:teuthology.orchestra.run.smithi105.stdout: "type": "client", 2024-09-21T03:20:06.699 INFO:teuthology.orchestra.run.smithi105.stdout: "num": 4948 2024-09-21T03:20:06.700 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.700 INFO:teuthology.orchestra.run.smithi105.stdout: "tid": 116 2024-09-21T03:20:06.700 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.700 INFO:teuthology.orchestra.run.smithi105.stdout: "op_type": "client_request", 2024-09-21T03:20:06.700 INFO:teuthology.orchestra.run.smithi105.stdout: "events": [ 2024-09-21T03:20:06.700 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.700 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.178766+0000", 2024-09-21T03:20:06.700 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "initiated" 2024-09-21T03:20:06.700 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.700 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.700 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.178766+0000", 2024-09-21T03:20:06.700 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "header_read" 2024-09-21T03:20:06.700 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.700 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.700 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.178767+0000", 2024-09-21T03:20:06.701 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "throttled" 2024-09-21T03:20:06.701 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.701 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.701 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.178773+0000", 2024-09-21T03:20:06.701 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "all_read" 2024-09-21T03:20:06.701 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.701 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.701 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.178795+0000", 2024-09-21T03:20:06.701 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "dispatched" 2024-09-21T03:20:06.701 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.701 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.701 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.179307+0000", 2024-09-21T03:20:06.701 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "acquired locks" 2024-09-21T03:20:06.701 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.701 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.702 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.179880+0000", 2024-09-21T03:20:06.702 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "early_replied" 2024-09-21T03:20:06.702 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.702 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.702 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.179881+0000", 2024-09-21T03:20:06.702 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "submit entry: journal_and_reply" 2024-09-21T03:20:06.702 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.702 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.702 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.184219+0000", 2024-09-21T03:20:06.702 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "journal_committed: " 2024-09-21T03:20:06.702 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.702 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.702 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.184352+0000", 2024-09-21T03:20:06.702 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "replying" 2024-09-21T03:20:06.703 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.703 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.703 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.184439+0000", 2024-09-21T03:20:06.703 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "finishing request" 2024-09-21T03:20:06.703 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.703 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.703 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.184536+0000", 2024-09-21T03:20:06.703 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cleaned up request" 2024-09-21T03:20:06.703 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.703 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.703 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.184537+0000", 2024-09-21T03:20:06.703 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "done" 2024-09-21T03:20:06.703 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.703 INFO:teuthology.orchestra.run.smithi105.stdout: ], 2024-09-21T03:20:06.703 INFO:teuthology.orchestra.run.smithi105.stdout: "locks": null 2024-09-21T03:20:06.704 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.704 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.704 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.704 INFO:teuthology.orchestra.run.smithi105.stdout: "description": "client_request(client.4948:121 create owner_uid=1000, owner_gid=1333 #0x10000000242/file_10 2024-09-21T03:19:26.203669+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-21T03:20:06.704 INFO:teuthology.orchestra.run.smithi105.stdout: "initiated_at": "2024-09-21T03:19:26.204472+0000", 2024-09-21T03:20:06.704 INFO:teuthology.orchestra.run.smithi105.stdout: "age": 40.401272624999997, 2024-09-21T03:20:06.704 INFO:teuthology.orchestra.run.smithi105.stdout: "duration": 0.007505439, 2024-09-21T03:20:06.704 INFO:teuthology.orchestra.run.smithi105.stdout: "continuous": false, 2024-09-21T03:20:06.704 INFO:teuthology.orchestra.run.smithi105.stdout: "type_data": { 2024-09-21T03:20:06.704 INFO:teuthology.orchestra.run.smithi105.stdout: "result": 0, 2024-09-21T03:20:06.704 INFO:teuthology.orchestra.run.smithi105.stdout: "flag_point": "done", 2024-09-21T03:20:06.704 INFO:teuthology.orchestra.run.smithi105.stdout: "reqid": { 2024-09-21T03:20:06.704 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": { 2024-09-21T03:20:06.704 INFO:teuthology.orchestra.run.smithi105.stdout: "type": "client", 2024-09-21T03:20:06.704 INFO:teuthology.orchestra.run.smithi105.stdout: "num": 4948 2024-09-21T03:20:06.705 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.705 INFO:teuthology.orchestra.run.smithi105.stdout: "tid": 121 2024-09-21T03:20:06.705 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.705 INFO:teuthology.orchestra.run.smithi105.stdout: "op_type": "client_request", 2024-09-21T03:20:06.705 INFO:teuthology.orchestra.run.smithi105.stdout: "events": [ 2024-09-21T03:20:06.705 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.705 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.204472+0000", 2024-09-21T03:20:06.705 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "initiated" 2024-09-21T03:20:06.705 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.705 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.705 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.204472+0000", 2024-09-21T03:20:06.705 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "header_read" 2024-09-21T03:20:06.705 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.705 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.705 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.204473+0000", 2024-09-21T03:20:06.706 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "throttled" 2024-09-21T03:20:06.706 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.706 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.706 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.204481+0000", 2024-09-21T03:20:06.706 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "all_read" 2024-09-21T03:20:06.706 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.706 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.706 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.204523+0000", 2024-09-21T03:20:06.706 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "dispatched" 2024-09-21T03:20:06.706 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.706 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.706 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.204874+0000", 2024-09-21T03:20:06.706 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "acquired locks" 2024-09-21T03:20:06.706 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.706 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.707 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.205215+0000", 2024-09-21T03:20:06.707 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "early_replied" 2024-09-21T03:20:06.707 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.707 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.707 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.205215+0000", 2024-09-21T03:20:06.707 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "submit entry: journal_and_reply" 2024-09-21T03:20:06.707 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.707 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.707 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.211577+0000", 2024-09-21T03:20:06.707 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "journal_committed: " 2024-09-21T03:20:06.707 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.707 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.707 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.211721+0000", 2024-09-21T03:20:06.707 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "replying" 2024-09-21T03:20:06.708 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.708 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.708 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.211845+0000", 2024-09-21T03:20:06.708 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "finishing request" 2024-09-21T03:20:06.708 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.708 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.708 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.211976+0000", 2024-09-21T03:20:06.708 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cleaned up request" 2024-09-21T03:20:06.708 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.708 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.708 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.211977+0000", 2024-09-21T03:20:06.708 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "done" 2024-09-21T03:20:06.708 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.708 INFO:teuthology.orchestra.run.smithi105.stdout: ], 2024-09-21T03:20:06.708 INFO:teuthology.orchestra.run.smithi105.stdout: "locks": null 2024-09-21T03:20:06.709 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.709 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.709 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.709 INFO:teuthology.orchestra.run.smithi105.stdout: "description": "client_request(client.4948:134 create owner_uid=1000, owner_gid=1333 #0x10000000242/file_23 2024-09-21T03:19:26.265667+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-21T03:20:06.709 INFO:teuthology.orchestra.run.smithi105.stdout: "initiated_at": "2024-09-21T03:19:26.266700+0000", 2024-09-21T03:20:06.709 INFO:teuthology.orchestra.run.smithi105.stdout: "age": 40.339044676999997, 2024-09-21T03:20:06.709 INFO:teuthology.orchestra.run.smithi105.stdout: "duration": 0.0055517789999999997, 2024-09-21T03:20:06.709 INFO:teuthology.orchestra.run.smithi105.stdout: "continuous": false, 2024-09-21T03:20:06.709 INFO:teuthology.orchestra.run.smithi105.stdout: "type_data": { 2024-09-21T03:20:06.709 INFO:teuthology.orchestra.run.smithi105.stdout: "result": 0, 2024-09-21T03:20:06.709 INFO:teuthology.orchestra.run.smithi105.stdout: "flag_point": "done", 2024-09-21T03:20:06.709 INFO:teuthology.orchestra.run.smithi105.stdout: "reqid": { 2024-09-21T03:20:06.709 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": { 2024-09-21T03:20:06.709 INFO:teuthology.orchestra.run.smithi105.stdout: "type": "client", 2024-09-21T03:20:06.710 INFO:teuthology.orchestra.run.smithi105.stdout: "num": 4948 2024-09-21T03:20:06.710 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.710 INFO:teuthology.orchestra.run.smithi105.stdout: "tid": 134 2024-09-21T03:20:06.710 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.710 INFO:teuthology.orchestra.run.smithi105.stdout: "op_type": "client_request", 2024-09-21T03:20:06.710 INFO:teuthology.orchestra.run.smithi105.stdout: "events": [ 2024-09-21T03:20:06.710 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.710 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.266700+0000", 2024-09-21T03:20:06.710 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "initiated" 2024-09-21T03:20:06.710 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.710 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.710 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.266700+0000", 2024-09-21T03:20:06.710 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "header_read" 2024-09-21T03:20:06.710 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.710 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.711 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.266701+0000", 2024-09-21T03:20:06.711 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "throttled" 2024-09-21T03:20:06.711 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.711 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.711 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.266708+0000", 2024-09-21T03:20:06.711 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "all_read" 2024-09-21T03:20:06.711 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.711 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.711 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.266728+0000", 2024-09-21T03:20:06.711 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "dispatched" 2024-09-21T03:20:06.711 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.711 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.711 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.267113+0000", 2024-09-21T03:20:06.711 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "acquired locks" 2024-09-21T03:20:06.711 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.712 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.712 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.267462+0000", 2024-09-21T03:20:06.712 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "early_replied" 2024-09-21T03:20:06.712 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.712 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.712 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.267462+0000", 2024-09-21T03:20:06.712 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "submit entry: journal_and_reply" 2024-09-21T03:20:06.712 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.712 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.712 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.271868+0000", 2024-09-21T03:20:06.712 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "journal_committed: " 2024-09-21T03:20:06.712 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.712 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.712 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.272012+0000", 2024-09-21T03:20:06.712 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "replying" 2024-09-21T03:20:06.713 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.713 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.713 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.272123+0000", 2024-09-21T03:20:06.713 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "finishing request" 2024-09-21T03:20:06.713 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.713 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.713 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.272250+0000", 2024-09-21T03:20:06.713 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cleaned up request" 2024-09-21T03:20:06.713 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.713 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.713 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.272252+0000", 2024-09-21T03:20:06.713 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "done" 2024-09-21T03:20:06.713 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.713 INFO:teuthology.orchestra.run.smithi105.stdout: ], 2024-09-21T03:20:06.713 INFO:teuthology.orchestra.run.smithi105.stdout: "locks": null 2024-09-21T03:20:06.714 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.714 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.714 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.714 INFO:teuthology.orchestra.run.smithi105.stdout: "description": "client_request(client.4948:143 readdir #0x10000000242 2024-09-21T03:19:26.450664+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-21T03:20:06.714 INFO:teuthology.orchestra.run.smithi105.stdout: "initiated_at": "2024-09-21T03:19:26.451294+0000", 2024-09-21T03:20:06.714 INFO:teuthology.orchestra.run.smithi105.stdout: "age": 40.154450167999997, 2024-09-21T03:20:06.714 INFO:teuthology.orchestra.run.smithi105.stdout: "duration": 16.506313317, 2024-09-21T03:20:06.714 INFO:teuthology.orchestra.run.smithi105.stdout: "continuous": false, 2024-09-21T03:20:06.714 INFO:teuthology.orchestra.run.smithi105.stdout: "type_data": { 2024-09-21T03:20:06.714 INFO:teuthology.orchestra.run.smithi105.stdout: "result": 0, 2024-09-21T03:20:06.714 INFO:teuthology.orchestra.run.smithi105.stdout: "flag_point": "done", 2024-09-21T03:20:06.714 INFO:teuthology.orchestra.run.smithi105.stdout: "reqid": { 2024-09-21T03:20:06.714 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": { 2024-09-21T03:20:06.714 INFO:teuthology.orchestra.run.smithi105.stdout: "type": "client", 2024-09-21T03:20:06.714 INFO:teuthology.orchestra.run.smithi105.stdout: "num": 4948 2024-09-21T03:20:06.715 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.715 INFO:teuthology.orchestra.run.smithi105.stdout: "tid": 143 2024-09-21T03:20:06.715 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.715 INFO:teuthology.orchestra.run.smithi105.stdout: "op_type": "client_request", 2024-09-21T03:20:06.715 INFO:teuthology.orchestra.run.smithi105.stdout: "events": [ 2024-09-21T03:20:06.715 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.715 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.451294+0000", 2024-09-21T03:20:06.715 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "initiated" 2024-09-21T03:20:06.715 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.715 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.715 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.451294+0000", 2024-09-21T03:20:06.715 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "header_read" 2024-09-21T03:20:06.715 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.715 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.715 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.451295+0000", 2024-09-21T03:20:06.716 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "throttled" 2024-09-21T03:20:06.716 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.716 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.716 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.451298+0000", 2024-09-21T03:20:06.716 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "all_read" 2024-09-21T03:20:06.716 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.716 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.716 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.451312+0000", 2024-09-21T03:20:06.716 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "dispatched" 2024-09-21T03:20:06.716 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.716 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.716 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.451393+0000", 2024-09-21T03:20:06.716 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.716 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.717 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.717 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:26.951537+0000", 2024-09-21T03:20:06.717 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.717 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.717 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.717 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:27.451710+0000", 2024-09-21T03:20:06.717 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.717 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.717 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.717 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:27.951895+0000", 2024-09-21T03:20:06.717 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.717 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.717 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.717 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:28.452016+0000", 2024-09-21T03:20:06.717 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.718 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.718 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.718 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:28.952174+0000", 2024-09-21T03:20:06.718 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.718 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.718 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.718 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:29.452345+0000", 2024-09-21T03:20:06.718 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.718 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.718 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.718 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:29.952524+0000", 2024-09-21T03:20:06.718 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.718 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.718 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.718 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:30.452650+0000", 2024-09-21T03:20:06.719 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.719 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.719 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.719 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:30.952783+0000", 2024-09-21T03:20:06.719 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.719 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.719 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.719 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:31.452901+0000", 2024-09-21T03:20:06.719 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.719 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.719 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.719 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:31.953039+0000", 2024-09-21T03:20:06.719 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.719 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.719 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.720 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:32.453181+0000", 2024-09-21T03:20:06.720 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.720 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.720 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.720 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:32.953348+0000", 2024-09-21T03:20:06.720 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.720 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.720 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.720 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:33.453535+0000", 2024-09-21T03:20:06.720 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.720 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.720 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.720 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:33.953719+0000", 2024-09-21T03:20:06.720 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.721 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.721 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.721 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:34.453861+0000", 2024-09-21T03:20:06.721 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.721 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.721 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.721 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:34.954039+0000", 2024-09-21T03:20:06.721 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.721 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.721 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.721 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:35.454171+0000", 2024-09-21T03:20:06.721 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.721 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.721 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.722 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:35.954348+0000", 2024-09-21T03:20:06.722 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.722 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.722 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.722 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:36.454514+0000", 2024-09-21T03:20:06.722 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.722 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.722 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.722 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:36.954703+0000", 2024-09-21T03:20:06.722 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.722 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.722 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.722 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:37.454863+0000", 2024-09-21T03:20:06.722 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.722 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.723 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.723 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:37.955037+0000", 2024-09-21T03:20:06.723 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.723 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.723 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.723 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:38.455174+0000", 2024-09-21T03:20:06.723 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.723 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.723 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.723 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:38.955295+0000", 2024-09-21T03:20:06.723 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.723 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.723 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.723 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:39.455452+0000", 2024-09-21T03:20:06.724 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.724 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.724 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.724 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:39.955662+0000", 2024-09-21T03:20:06.724 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.724 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.724 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.724 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:40.455778+0000", 2024-09-21T03:20:06.724 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.724 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.724 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.724 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:40.955951+0000", 2024-09-21T03:20:06.724 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.724 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.724 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.725 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:41.456082+0000", 2024-09-21T03:20:06.725 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.725 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.725 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.725 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:41.956270+0000", 2024-09-21T03:20:06.725 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.725 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.725 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.725 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:42.456432+0000", 2024-09-21T03:20:06.725 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.725 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.725 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.725 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:42.956850+0000", 2024-09-21T03:20:06.726 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "acquired locks" 2024-09-21T03:20:06.726 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.726 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.726 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:42.957422+0000", 2024-09-21T03:20:06.726 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "replying" 2024-09-21T03:20:06.726 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.726 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.726 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:42.957471+0000", 2024-09-21T03:20:06.726 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "finishing request" 2024-09-21T03:20:06.726 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.726 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.726 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:42.957605+0000", 2024-09-21T03:20:06.726 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cleaned up request" 2024-09-21T03:20:06.726 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.727 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.727 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:42.957608+0000", 2024-09-21T03:20:06.727 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "done" 2024-09-21T03:20:06.727 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.727 INFO:teuthology.orchestra.run.smithi105.stdout: ], 2024-09-21T03:20:06.727 INFO:teuthology.orchestra.run.smithi105.stdout: "locks": null 2024-09-21T03:20:06.727 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.727 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.727 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.727 INFO:teuthology.orchestra.run.smithi105.stdout: "description": "client_request(client.4948:144 readdir #0x10000000228 2024-09-21T03:19:42.956327+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-21T03:20:06.727 INFO:teuthology.orchestra.run.smithi105.stdout: "initiated_at": "2024-09-21T03:19:42.957877+0000", 2024-09-21T03:20:06.727 INFO:teuthology.orchestra.run.smithi105.stdout: "age": 23.647867335000001, 2024-09-21T03:20:06.727 INFO:teuthology.orchestra.run.smithi105.stdout: "duration": 22.508397180999999, 2024-09-21T03:20:06.728 INFO:teuthology.orchestra.run.smithi105.stdout: "continuous": false, 2024-09-21T03:20:06.728 INFO:teuthology.orchestra.run.smithi105.stdout: "type_data": { 2024-09-21T03:20:06.728 INFO:teuthology.orchestra.run.smithi105.stdout: "result": 0, 2024-09-21T03:20:06.728 INFO:teuthology.orchestra.run.smithi105.stdout: "flag_point": "done", 2024-09-21T03:20:06.728 INFO:teuthology.orchestra.run.smithi105.stdout: "reqid": { 2024-09-21T03:20:06.728 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": { 2024-09-21T03:20:06.728 INFO:teuthology.orchestra.run.smithi105.stdout: "type": "client", 2024-09-21T03:20:06.728 INFO:teuthology.orchestra.run.smithi105.stdout: "num": 4948 2024-09-21T03:20:06.728 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.728 INFO:teuthology.orchestra.run.smithi105.stdout: "tid": 144 2024-09-21T03:20:06.728 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.728 INFO:teuthology.orchestra.run.smithi105.stdout: "op_type": "client_request", 2024-09-21T03:20:06.728 INFO:teuthology.orchestra.run.smithi105.stdout: "events": [ 2024-09-21T03:20:06.728 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.729 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:42.957877+0000", 2024-09-21T03:20:06.729 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "initiated" 2024-09-21T03:20:06.729 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.729 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.729 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:42.957877+0000", 2024-09-21T03:20:06.729 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "header_read" 2024-09-21T03:20:06.729 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.729 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.729 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:42.957877+0000", 2024-09-21T03:20:06.729 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "throttled" 2024-09-21T03:20:06.729 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.729 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.729 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:42.957883+0000", 2024-09-21T03:20:06.729 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "all_read" 2024-09-21T03:20:06.730 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.730 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.730 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:42.957955+0000", 2024-09-21T03:20:06.730 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "dispatched" 2024-09-21T03:20:06.730 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.730 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.730 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:42.958077+0000", 2024-09-21T03:20:06.730 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.730 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.730 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.730 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:43.458218+0000", 2024-09-21T03:20:06.730 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.730 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.730 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.731 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:43.958380+0000", 2024-09-21T03:20:06.731 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.731 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.731 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.731 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:44.458568+0000", 2024-09-21T03:20:06.731 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.731 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.731 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.731 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:44.958737+0000", 2024-09-21T03:20:06.731 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.731 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.731 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.731 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:45.458905+0000", 2024-09-21T03:20:06.731 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.731 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.732 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.732 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:45.959051+0000", 2024-09-21T03:20:06.732 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.732 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.732 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.732 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:46.459191+0000", 2024-09-21T03:20:06.732 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.732 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.732 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.732 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:46.959314+0000", 2024-09-21T03:20:06.732 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.732 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.732 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.732 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:47.459503+0000", 2024-09-21T03:20:06.732 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.733 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.733 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.733 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:47.959651+0000", 2024-09-21T03:20:06.733 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.733 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.733 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.733 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:48.459841+0000", 2024-09-21T03:20:06.733 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.733 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.733 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.733 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:48.960019+0000", 2024-09-21T03:20:06.733 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.733 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.733 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.733 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:49.460194+0000", 2024-09-21T03:20:06.734 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.734 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.734 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.734 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:49.960372+0000", 2024-09-21T03:20:06.734 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.734 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.734 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.734 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:50.460538+0000", 2024-09-21T03:20:06.734 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.734 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.734 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.734 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:50.960686+0000", 2024-09-21T03:20:06.734 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.734 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.735 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.735 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:51.460868+0000", 2024-09-21T03:20:06.735 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.735 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.735 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.735 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:51.961040+0000", 2024-09-21T03:20:06.735 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.735 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.735 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.735 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:52.461211+0000", 2024-09-21T03:20:06.735 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.735 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.735 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.735 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:52.961385+0000", 2024-09-21T03:20:06.735 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.736 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.736 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.736 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:53.461504+0000", 2024-09-21T03:20:06.736 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.736 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.736 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.736 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:53.961682+0000", 2024-09-21T03:20:06.736 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.736 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.736 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.736 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:54.461864+0000", 2024-09-21T03:20:06.736 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.736 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.736 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.736 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:54.962026+0000", 2024-09-21T03:20:06.737 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.737 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.737 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.737 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:55.462194+0000", 2024-09-21T03:20:06.737 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.737 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.737 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.737 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:55.962376+0000", 2024-09-21T03:20:06.737 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.737 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.737 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.737 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:56.462553+0000", 2024-09-21T03:20:06.737 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.737 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.738 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.738 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:56.962724+0000", 2024-09-21T03:20:06.738 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.738 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.738 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.738 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:57.462887+0000", 2024-09-21T03:20:06.738 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.738 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.738 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.738 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:57.963066+0000", 2024-09-21T03:20:06.738 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.738 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.738 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.738 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:58.463267+0000", 2024-09-21T03:20:06.738 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.739 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.739 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.739 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:58.963470+0000", 2024-09-21T03:20:06.739 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.739 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.739 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.739 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:59.463641+0000", 2024-09-21T03:20:06.739 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.739 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.739 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.739 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:19:59.963858+0000", 2024-09-21T03:20:06.739 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.739 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.739 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.739 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:20:00.463983+0000", 2024-09-21T03:20:06.740 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.740 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.740 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.740 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:20:00.964096+0000", 2024-09-21T03:20:06.740 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.740 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.740 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.740 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:20:01.464282+0000", 2024-09-21T03:20:06.740 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.740 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.740 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.740 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:20:01.964390+0000", 2024-09-21T03:20:06.740 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.740 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.741 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.741 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:20:02.464556+0000", 2024-09-21T03:20:06.741 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.741 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.741 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.741 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:20:02.964681+0000", 2024-09-21T03:20:06.741 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.741 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.741 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.741 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:20:03.464795+0000", 2024-09-21T03:20:06.741 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.741 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.741 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.741 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:20:03.964961+0000", 2024-09-21T03:20:06.741 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.742 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.742 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.742 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:20:04.465127+0000", 2024-09-21T03:20:06.742 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.742 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.742 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.742 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:20:04.965262+0000", 2024-09-21T03:20:06.742 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cap_acquisition_throttle" 2024-09-21T03:20:06.742 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.742 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.742 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:20:05.465477+0000", 2024-09-21T03:20:06.742 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "acquired locks" 2024-09-21T03:20:06.742 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.742 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.742 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:20:05.466007+0000", 2024-09-21T03:20:06.743 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "replying" 2024-09-21T03:20:06.743 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.743 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.743 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:20:05.466075+0000", 2024-09-21T03:20:06.743 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "finishing request" 2024-09-21T03:20:06.743 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.743 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.743 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:20:05.466271+0000", 2024-09-21T03:20:06.743 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "cleaned up request" 2024-09-21T03:20:06.743 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:06.743 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:06.743 INFO:teuthology.orchestra.run.smithi105.stdout: "time": "2024-09-21T03:20:05.466274+0000", 2024-09-21T03:20:06.743 INFO:teuthology.orchestra.run.smithi105.stdout: "event": "done" 2024-09-21T03:20:06.743 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.743 INFO:teuthology.orchestra.run.smithi105.stdout: ], 2024-09-21T03:20:06.744 INFO:teuthology.orchestra.run.smithi105.stdout: "locks": null 2024-09-21T03:20:06.744 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.744 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:06.744 INFO:teuthology.orchestra.run.smithi105.stdout: ] 2024-09-21T03:20:06.744 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-21T03:20:06.745 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.606+0000 7f324ffed640 1 -- 172.21.15.105:0/1909215465 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f322c078b90 msgr2=0x7f322c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:06.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.606+0000 7f324ffed640 1 --2- 172.21.15.105:0/1909215465 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f322c078b90 0x7f322c07b0a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3244001450 tx=0x7f3244006a70 comp rx=0 tx=0).stop 2024-09-21T03:20:06.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.606+0000 7f324ffed640 1 -- 172.21.15.105:0/1909215465 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32480c9870 msgr2=0x7f324815c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:06.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.606+0000 7f324ffed640 1 --2- 172.21.15.105:0/1909215465 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32480c9870 0x7f324815c150 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3238034040 tx=0x7f3238032760 comp rx=0 tx=0).stop 2024-09-21T03:20:06.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.606+0000 7f324ffed640 1 -- 172.21.15.105:0/1909215465 shutdown_connections 2024-09-21T03:20:06.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.606+0000 7f324ffed640 1 --2- 172.21.15.105:0/1909215465 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f322c078b90 0x7f322c07b0a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.606+0000 7f324ffed640 1 --2- 172.21.15.105:0/1909215465 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f324815c690 0x7f324815fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.606+0000 7f324ffed640 1 --2- 172.21.15.105:0/1909215465 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32480c9870 0x7f324815c150 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.606+0000 7f324ffed640 1 --2- 172.21.15.105:0/1909215465 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3234004800 0x7f32480c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:06.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.606+0000 7f324ffed640 1 -- 172.21.15.105:0/1909215465 >> 172.21.15.105:0/1909215465 conn(0x7f324809d7f0 msgr2=0x7f32480d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:06.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.606+0000 7f324ffed640 1 -- 172.21.15.105:0/1909215465 shutdown_connections 2024-09-21T03:20:06.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:06.606+0000 7f324ffed640 1 -- 172.21.15.105:0/1909215465 wait complete. 2024-09-21T03:20:06.747 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T03:20:06.747 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T03:20:06.782 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T03:20:06.824 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T03:20:06.824 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T03:20:06.825 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:20:06.825 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:20:06.840 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:20:06.841 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:20:06.896 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T03:20:07.049 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.047+0000 7f0217113640 1 -- 172.21.15.105:0/2815984938 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02100ca800 msgr2=0x7f02100cba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:07.050 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.047+0000 7f0217113640 1 --2- 172.21.15.105:0/2815984938 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02100ca800 0x7f02100cba00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f021009e2e0 tx=0x7f020002a560 comp rx=0 tx=0).stop 2024-09-21T03:20:07.050 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.047+0000 7f0217113640 1 -- 172.21.15.105:0/2815984938 shutdown_connections 2024-09-21T03:20:07.050 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.047+0000 7f0217113640 1 --2- 172.21.15.105:0/2815984938 >> v2:172.21.15.162:3300/0 conn(0x7f02100cad30 0x7f021006ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:07.050 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.047+0000 7f0217113640 1 --2- 172.21.15.105:0/2815984938 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02100ca800 0x7f02100cba00 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:07.050 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.047+0000 7f0217113640 1 -- 172.21.15.105:0/2815984938 >> 172.21.15.105:0/2815984938 conn(0x7f02100b1cb0 msgr2=0x7f02100b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:07.050 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.047+0000 7f0217113640 1 -- 172.21.15.105:0/2815984938 shutdown_connections 2024-09-21T03:20:07.050 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.047+0000 7f0217113640 1 -- 172.21.15.105:0/2815984938 wait complete. 2024-09-21T03:20:07.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.049+0000 7f0217113640 1 Processor -- start 2024-09-21T03:20:07.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.049+0000 7f0217113640 1 -- start start 2024-09-21T03:20:07.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.050+0000 7f0217113640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02100704e0 0x7f02101e6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:07.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.050+0000 7f0217113640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02100ca800 0x7f021009bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:07.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.050+0000 7f0217113640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02100cad30 0x7f021009c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:07.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.050+0000 7f0217113640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f02100ccf40 con 0x7f02100ca800 2024-09-21T03:20:07.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.050+0000 7f0217113640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0210074810 con 0x7f02100cad30 2024-09-21T03:20:07.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.050+0000 7f0217113640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f02100cd0c0 con 0x7f02100704e0 2024-09-21T03:20:07.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.050+0000 7f020ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02100ca800 0x7f021009bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:07.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.050+0000 7f020ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02100ca800 0x7f021009bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58396/0 (socket says 172.21.15.105:58396) 2024-09-21T03:20:07.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.050+0000 7f020ffff640 1 -- 172.21.15.105:0/181705925 learned_addr learned my addr 172.21.15.105:0/181705925 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:07.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.050+0000 7f0214eaf640 1 --2- 172.21.15.105:0/181705925 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02100704e0 0x7f02101e6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:07.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.050+0000 7f02156b0640 1 --2- 172.21.15.105:0/181705925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02100cad30 0x7f021009c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:07.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.050+0000 7f020ffff640 1 -- 172.21.15.105:0/181705925 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02100704e0 msgr2=0x7f02101e6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:07.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.050+0000 7f020ffff640 1 --2- 172.21.15.105:0/181705925 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02100704e0 0x7f02101e6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:07.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.050+0000 7f020ffff640 1 -- 172.21.15.105:0/181705925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02100cad30 msgr2=0x7f021009c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:07.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.050+0000 7f020ffff640 1 --2- 172.21.15.105:0/181705925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02100cad30 0x7f021009c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:07.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.050+0000 7f020ffff640 1 -- 172.21.15.105:0/181705925 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f021009d960 con 0x7f02100ca800 2024-09-21T03:20:07.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.051+0000 7f020ffff640 1 --2- 172.21.15.105:0/181705925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02100ca800 0x7f021009bbb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f020400b410 tx=0x7f020400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:07.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.051+0000 7f020d7fa640 1 -- 172.21.15.105:0/181705925 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0204015020 con 0x7f02100ca800 2024-09-21T03:20:07.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.051+0000 7f020d7fa640 1 -- 172.21.15.105:0/181705925 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0204011940 con 0x7f02100ca800 2024-09-21T03:20:07.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.051+0000 7f0217113640 1 -- 172.21.15.105:0/181705925 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f021009c8c0 con 0x7f02100ca800 2024-09-21T03:20:07.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.051+0000 7f020d7fa640 1 -- 172.21.15.105:0/181705925 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0204011d90 con 0x7f02100ca800 2024-09-21T03:20:07.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.051+0000 7f0217113640 1 -- 172.21.15.105:0/181705925 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f021009ce80 con 0x7f02100ca800 2024-09-21T03:20:07.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.052+0000 7f0217113640 1 -- 172.21.15.105:0/181705925 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02100cd5e0 con 0x7f02100ca800 2024-09-21T03:20:07.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.052+0000 7f020d7fa640 1 -- 172.21.15.105:0/181705925 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0204018020 con 0x7f02100ca800 2024-09-21T03:20:07.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.053+0000 7f020d7fa640 1 --2- 172.21.15.105:0/181705925 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f01fc078b90 0x7f01fc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:07.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.053+0000 7f020d7fa640 1 -- 172.21.15.105:0/181705925 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f020409aac0 con 0x7f02100ca800 2024-09-21T03:20:07.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.053+0000 7f0214eaf640 1 --2- 172.21.15.105:0/181705925 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f01fc078b90 0x7f01fc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:07.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.054+0000 7f0214eaf640 1 --2- 172.21.15.105:0/181705925 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f01fc078b90 0x7f01fc07b0a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0200033000 tx=0x7f0200004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:07.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.057+0000 7f020d7fa640 1 -- 172.21.15.105:0/181705925 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f020401f020 con 0x7f02100ca800 2024-09-21T03:20:07.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.246+0000 7f0217113640 1 -- 172.21.15.105:0/181705925 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f021009c650 con 0x7f02100ca800 2024-09-21T03:20:07.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.247+0000 7f020d7fa640 1 -- 172.21.15.105:0/181705925 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) ==== 80+0+0 (secure 0 0 0) 0x7f0204062940 con 0x7f02100ca800 2024-09-21T03:20:07.249 INFO:teuthology.orchestra.run.smithi105.stderr:listed 0 entries 2024-09-21T03:20:07.251 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.249+0000 7f0217113640 1 -- 172.21.15.105:0/181705925 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f01fc078b90 msgr2=0x7f01fc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:07.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.249+0000 7f0217113640 1 --2- 172.21.15.105:0/181705925 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f01fc078b90 0x7f01fc07b0a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0200033000 tx=0x7f0200004730 comp rx=0 tx=0).stop 2024-09-21T03:20:07.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.249+0000 7f0217113640 1 -- 172.21.15.105:0/181705925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02100ca800 msgr2=0x7f021009bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:07.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.249+0000 7f0217113640 1 --2- 172.21.15.105:0/181705925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02100ca800 0x7f021009bbb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f020400b410 tx=0x7f020400b8d0 comp rx=0 tx=0).stop 2024-09-21T03:20:07.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.249+0000 7f0217113640 1 -- 172.21.15.105:0/181705925 shutdown_connections 2024-09-21T03:20:07.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.249+0000 7f0217113640 1 --2- 172.21.15.105:0/181705925 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f01fc078b90 0x7f01fc07b0a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:07.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.249+0000 7f0217113640 1 --2- 172.21.15.105:0/181705925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02100cad30 0x7f021009c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:07.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.249+0000 7f0217113640 1 --2- 172.21.15.105:0/181705925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02100ca800 0x7f021009bbb0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:07.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.249+0000 7f0217113640 1 --2- 172.21.15.105:0/181705925 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02100704e0 0x7f02101e6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:07.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.249+0000 7f0217113640 1 -- 172.21.15.105:0/181705925 >> 172.21.15.105:0/181705925 conn(0x7f02100b1cb0 msgr2=0x7f02100afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:07.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.249+0000 7f0217113640 1 -- 172.21.15.105:0/181705925 shutdown_connections 2024-09-21T03:20:07.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.249+0000 7f0217113640 1 -- 172.21.15.105:0/181705925 wait complete. 2024-09-21T03:20:07.262 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T03:20:07.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:20:07.263 DEBUG:teuthology.orchestra.run.smithi105:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T03:20:07.353 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi105.front.sepia.ceph.com 2024-09-21T03:20:07.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:20:07.353 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T03:20:07.368 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T03:20:07.368 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:20:07.368 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:20:07.384 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:20:07.384 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:20:07.440 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T03:20:07.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.551+0000 7f4d20a70640 1 -- 172.21.15.105:0/4099872724 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d1c15d840 msgr2=0x7f4d1c0b7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:07.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.551+0000 7f4d20a70640 1 --2- 172.21.15.105:0/4099872724 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d1c15d840 0x7f4d1c0b7490 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4d14005fd0 tx=0x7f4d1402ab40 comp rx=0 tx=0).stop 2024-09-21T03:20:07.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.551+0000 7f4d20a70640 1 -- 172.21.15.105:0/4099872724 shutdown_connections 2024-09-21T03:20:07.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.551+0000 7f4d20a70640 1 --2- 172.21.15.105:0/4099872724 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d1c15d840 0x7f4d1c0b7490 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:07.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.551+0000 7f4d20a70640 1 -- 172.21.15.105:0/4099872724 >> 172.21.15.105:0/4099872724 conn(0x7f4d1c06d550 msgr2=0x7f4d1c071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:07.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.551+0000 7f4d20a70640 1 -- 172.21.15.105:0/4099872724 shutdown_connections 2024-09-21T03:20:07.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.551+0000 7f4d20a70640 1 -- 172.21.15.105:0/4099872724 wait complete. 2024-09-21T03:20:07.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.553+0000 7f4d20a70640 1 Processor -- start 2024-09-21T03:20:07.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.553+0000 7f4d20a70640 1 -- start start 2024-09-21T03:20:07.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.554+0000 7f4d20a70640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d1c1570e0 0x7f4d1c1f4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:07.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.554+0000 7f4d20a70640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d1c15d840 0x7f4d1c1552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:07.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.554+0000 7f4d20a70640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d1c0ca9d0 0x7f4d1c0c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:07.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.554+0000 7f4d20a70640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1c0b7d60 con 0x7f4d1c1570e0 2024-09-21T03:20:07.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.554+0000 7f4d20a70640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1c0b7be0 con 0x7f4d1c15d840 2024-09-21T03:20:07.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.554+0000 7f4d20a70640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4d1c0b7ee0 con 0x7f4d1c0ca9d0 2024-09-21T03:20:07.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.554+0000 7f4d1a59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d1c1570e0 0x7f4d1c1f4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:07.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.554+0000 7f4d1a59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d1c1570e0 0x7f4d1c1f4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58418/0 (socket says 172.21.15.105:58418) 2024-09-21T03:20:07.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.554+0000 7f4d1a59c640 1 -- 172.21.15.105:0/2512975012 learned_addr learned my addr 172.21.15.105:0/2512975012 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:07.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.554+0000 7f4d1ad9d640 1 --2- 172.21.15.105:0/2512975012 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d1c0ca9d0 0x7f4d1c0c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:07.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.554+0000 7f4d19d9b640 1 --2- 172.21.15.105:0/2512975012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d1c15d840 0x7f4d1c1552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:07.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.554+0000 7f4d1a59c640 1 -- 172.21.15.105:0/2512975012 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d1c0ca9d0 msgr2=0x7f4d1c0c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:07.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.554+0000 7f4d1a59c640 1 --2- 172.21.15.105:0/2512975012 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d1c0ca9d0 0x7f4d1c0c8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:07.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.554+0000 7f4d1a59c640 1 -- 172.21.15.105:0/2512975012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d1c15d840 msgr2=0x7f4d1c1552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:07.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.554+0000 7f4d1a59c640 1 --2- 172.21.15.105:0/2512975012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d1c15d840 0x7f4d1c1552f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:07.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.554+0000 7f4d1a59c640 1 -- 172.21.15.105:0/2512975012 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d1c0c9ad0 con 0x7f4d1c1570e0 2024-09-21T03:20:07.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.554+0000 7f4d19d9b640 1 --2- 172.21.15.105:0/2512975012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d1c15d840 0x7f4d1c1552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:20:07.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.555+0000 7f4d1a59c640 1 --2- 172.21.15.105:0/2512975012 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d1c1570e0 0x7f4d1c1f4750 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00c430 tx=0x7f4d0c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:07.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.555+0000 7f4d0affd640 1 -- 172.21.15.105:0/2512975012 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c017070 con 0x7f4d1c1570e0 2024-09-21T03:20:07.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.555+0000 7f4d0affd640 1 -- 172.21.15.105:0/2512975012 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d0c0053c0 con 0x7f4d1c1570e0 2024-09-21T03:20:07.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.555+0000 7f4d20a70640 1 -- 172.21.15.105:0/2512975012 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d1c0c9db0 con 0x7f4d1c1570e0 2024-09-21T03:20:07.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.555+0000 7f4d0affd640 1 -- 172.21.15.105:0/2512975012 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c003850 con 0x7f4d1c1570e0 2024-09-21T03:20:07.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.555+0000 7f4d20a70640 1 -- 172.21.15.105:0/2512975012 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d1c0cae10 con 0x7f4d1c1570e0 2024-09-21T03:20:07.561 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.556+0000 7f4d20a70640 1 -- 172.21.15.105:0/2512975012 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d1c0ca2d0 con 0x7f4d1c1570e0 2024-09-21T03:20:07.561 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.557+0000 7f4d0affd640 1 -- 172.21.15.105:0/2512975012 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4d0c01a070 con 0x7f4d1c1570e0 2024-09-21T03:20:07.561 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.557+0000 7f4d0affd640 1 --2- 172.21.15.105:0/2512975012 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4cfc078b90 0x7f4cfc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:07.561 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.557+0000 7f4d0affd640 1 -- 172.21.15.105:0/2512975012 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f4d0c09a0a0 con 0x7f4d1c1570e0 2024-09-21T03:20:07.561 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.558+0000 7f4d19d9b640 1 --2- 172.21.15.105:0/2512975012 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4cfc078b90 0x7f4cfc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:07.561 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.558+0000 7f4d19d9b640 1 --2- 172.21.15.105:0/2512975012 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4cfc078b90 0x7f4cfc07b0a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0b7400 tx=0x7f4d10009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:07.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.562+0000 7f4d0affd640 1 -- 172.21.15.105:0/2512975012 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4d1c0ca2d0 con 0x7f4d1c1570e0 2024-09-21T03:20:07.751 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.748+0000 7f4d20a70640 1 -- 172.21.15.105:0/2512975012 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4d1c0b7490 con 0x7f4d1c1570e0 2024-09-21T03:20:07.751 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.749+0000 7f4d0affd640 1 -- 172.21.15.105:0/2512975012 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) ==== 80+0+0 (secure 0 0 0) 0x7f4d0c061e80 con 0x7f4d1c1570e0 2024-09-21T03:20:07.751 INFO:teuthology.orchestra.run.smithi105.stderr:listed 0 entries 2024-09-21T03:20:07.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.751+0000 7f4d20a70640 1 -- 172.21.15.105:0/2512975012 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4cfc078b90 msgr2=0x7f4cfc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:07.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.751+0000 7f4d20a70640 1 --2- 172.21.15.105:0/2512975012 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4cfc078b90 0x7f4cfc07b0a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0b7400 tx=0x7f4d10009040 comp rx=0 tx=0).stop 2024-09-21T03:20:07.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.751+0000 7f4d20a70640 1 -- 172.21.15.105:0/2512975012 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d1c1570e0 msgr2=0x7f4d1c1f4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:07.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.751+0000 7f4d20a70640 1 --2- 172.21.15.105:0/2512975012 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d1c1570e0 0x7f4d1c1f4750 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00c430 tx=0x7f4d0c00c8f0 comp rx=0 tx=0).stop 2024-09-21T03:20:07.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.751+0000 7f4d20a70640 1 -- 172.21.15.105:0/2512975012 shutdown_connections 2024-09-21T03:20:07.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.751+0000 7f4d20a70640 1 --2- 172.21.15.105:0/2512975012 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4cfc078b90 0x7f4cfc07b0a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:07.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.751+0000 7f4d20a70640 1 --2- 172.21.15.105:0/2512975012 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d1c0ca9d0 0x7f4d1c0c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:07.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.751+0000 7f4d20a70640 1 --2- 172.21.15.105:0/2512975012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d1c15d840 0x7f4d1c1552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:07.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.751+0000 7f4d20a70640 1 --2- 172.21.15.105:0/2512975012 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d1c1570e0 0x7f4d1c1f4750 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:07.755 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.751+0000 7f4d20a70640 1 -- 172.21.15.105:0/2512975012 >> 172.21.15.105:0/2512975012 conn(0x7f4d1c06d550 msgr2=0x7f4d1c0d1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:07.755 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.751+0000 7f4d20a70640 1 -- 172.21.15.105:0/2512975012 shutdown_connections 2024-09-21T03:20:07.755 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:07.751+0000 7f4d20a70640 1 -- 172.21.15.105:0/2512975012 wait complete. 2024-09-21T03:20:07.764 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-21T03:20:07.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:20:07.765 DEBUG:teuthology.orchestra.run.smithi162:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-21T03:20:07.794 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2024-09-21T03:20:07.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:20:07.794 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-21T03:20:07.850 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T03:20:07.850 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:20:07.850 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:20:07.866 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T03:20:07.866 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T03:20:07.866 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:20:07.867 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:20:07.906 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=452 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T03:20:07.906 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:20:08.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.015+0000 7fb6897a1640 1 -- 172.21.15.105:0/2989182185 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6840ca800 msgr2=0x7fb6840cba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:08.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.015+0000 7fb6897a1640 1 --2- 172.21.15.105:0/2989182185 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6840ca800 0x7fb6840cba00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb674009830 tx=0x7fb67402a510 comp rx=0 tx=0).stop 2024-09-21T03:20:08.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.015+0000 7fb6897a1640 1 -- 172.21.15.105:0/2989182185 shutdown_connections 2024-09-21T03:20:08.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.015+0000 7fb6897a1640 1 --2- 172.21.15.105:0/2989182185 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6840706b0 0x7fb6840735b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:08.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.015+0000 7fb6897a1640 1 --2- 172.21.15.105:0/2989182185 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6840ca800 0x7fb6840cba00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:08.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.015+0000 7fb6897a1640 1 -- 172.21.15.105:0/2989182185 >> 172.21.15.105:0/2989182185 conn(0x7fb6840b1cb0 msgr2=0x7fb6840b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:08.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.016+0000 7fb6897a1640 1 -- 172.21.15.105:0/2989182185 shutdown_connections 2024-09-21T03:20:08.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.016+0000 7fb6897a1640 1 -- 172.21.15.105:0/2989182185 wait complete. 2024-09-21T03:20:08.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.017+0000 7fb6897a1640 1 Processor -- start 2024-09-21T03:20:08.020 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.017+0000 7fb6897a1640 1 -- start start 2024-09-21T03:20:08.023 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.019+0000 7fb6897a1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6840ca800 0x7fb68409d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:08.023 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.019+0000 7fb6897a1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6840cad30 0x7fb684156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:08.023 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.019+0000 7fb6897a1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6840c87c0 0x7fb6840c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:08.023 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.019+0000 7fb6897a1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb684073f00 con 0x7fb6840cad30 2024-09-21T03:20:08.023 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.019+0000 7fb6897a1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb684073d80 con 0x7fb6840ca800 2024-09-21T03:20:08.023 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.019+0000 7fb6897a1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb684074080 con 0x7fb6840c87c0 2024-09-21T03:20:08.023 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.019+0000 7fb67a7fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6840cad30 0x7fb684156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:08.023 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.019+0000 7fb67a7fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6840cad30 0x7fb684156ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58420/0 (socket says 172.21.15.105:58420) 2024-09-21T03:20:08.023 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.019+0000 7fb67a7fc640 1 -- 172.21.15.105:0/1470854236 learned_addr learned my addr 172.21.15.105:0/1470854236 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:08.023 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.019+0000 7fb682ffd640 1 --2- 172.21.15.105:0/1470854236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6840ca800 0x7fb68409d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:08.023 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.019+0000 7fb6837fe640 1 --2- 172.21.15.105:0/1470854236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6840c87c0 0x7fb6840c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:08.023 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.019+0000 7fb67a7fc640 1 -- 172.21.15.105:0/1470854236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6840c87c0 msgr2=0x7fb6840c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:08.023 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.019+0000 7fb67a7fc640 1 --2- 172.21.15.105:0/1470854236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6840c87c0 0x7fb6840c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:08.024 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.019+0000 7fb67a7fc640 1 -- 172.21.15.105:0/1470854236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6840ca800 msgr2=0x7fb68409d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:08.024 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.019+0000 7fb67a7fc640 1 --2- 172.21.15.105:0/1470854236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6840ca800 0x7fb68409d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:08.024 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.019+0000 7fb67a7fc640 1 -- 172.21.15.105:0/1470854236 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6840c9110 con 0x7fb6840cad30 2024-09-21T03:20:08.024 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.019+0000 7fb67a7fc640 1 --2- 172.21.15.105:0/1470854236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6840cad30 0x7fb684156ed0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb66c00c3a0 tx=0x7fb66c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:08.024 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.019+0000 7fb67bfff640 1 -- 172.21.15.105:0/1470854236 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66c0052d0 con 0x7fb6840cad30 2024-09-21T03:20:08.024 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.020+0000 7fb67bfff640 1 -- 172.21.15.105:0/1470854236 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb66c007020 con 0x7fb6840cad30 2024-09-21T03:20:08.024 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.020+0000 7fb67bfff640 1 -- 172.21.15.105:0/1470854236 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66c007470 con 0x7fb6840cad30 2024-09-21T03:20:08.024 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.020+0000 7fb6897a1640 1 -- 172.21.15.105:0/1470854236 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb684154110 con 0x7fb6840cad30 2024-09-21T03:20:08.024 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.020+0000 7fb6897a1640 1 -- 172.21.15.105:0/1470854236 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6841546d0 con 0x7fb6840cad30 2024-09-21T03:20:08.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.021+0000 7fb6897a1640 1 -- 172.21.15.105:0/1470854236 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6840745e0 con 0x7fb6840cad30 2024-09-21T03:20:08.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.021+0000 7fb67bfff640 1 -- 172.21.15.105:0/1470854236 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb66c0067d0 con 0x7fb6840cad30 2024-09-21T03:20:08.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.022+0000 7fb67bfff640 1 --2- 172.21.15.105:0/1470854236 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb664078b90 0x7fb66407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:08.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.022+0000 7fb67bfff640 1 -- 172.21.15.105:0/1470854236 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fb66c09a1f0 con 0x7fb6840cad30 2024-09-21T03:20:08.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.022+0000 7fb682ffd640 1 --2- 172.21.15.105:0/1470854236 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb664078b90 0x7fb66407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:08.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.022+0000 7fb682ffd640 1 --2- 172.21.15.105:0/1470854236 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb664078b90 0x7fb66407b0a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb674034000 tx=0x7fb674004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:08.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.027+0000 7fb67bfff640 1 -- 172.21.15.105:0/1470854236 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb6840c9110 con 0x7fb6840cad30 2024-09-21T03:20:08.246 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.244+0000 7fb6897a1640 1 -- 172.21.15.105:0/1470854236 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb6840b16e0 con 0x7fb6840cad30 2024-09-21T03:20:08.247 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.244+0000 7fb67bfff640 1 -- 172.21.15.105:0/1470854236 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5232 (secure 0 0 0) 0x7fb66c061f60 con 0x7fb6840cad30 2024-09-21T03:20:08.247 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:20:08.247 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":17,"btime":"2024-09-21T03:19:15:120921+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4634,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/517240834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":517240834},{"type":"v1","addr":"172.21.15.162:6837","nonce":517240834}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4774,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3241953393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3241953393},{"type":"v1","addr":"172.21.15.162:6836","nonce":3241953393}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4899,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/2101702562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2101702562},{"type":"v1","addr":"172.21.15.105:6834","nonce":2101702562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:19:11.459432+0000","modified":"2024-09-21T03:19:14.487254+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4902},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4902":{"gid":4902,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1732564681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":1732564681},{"type":"v1","addr":"172.21.15.105:6835","nonce":1732564681}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4902,"qdb_cluster":[4902]},"id":2}]} 2024-09-21T03:20:08.247 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 17 2024-09-21T03:20:08.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.246+0000 7fb6897a1640 1 -- 172.21.15.105:0/1470854236 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb664078b90 msgr2=0x7fb66407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:08.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.246+0000 7fb6897a1640 1 --2- 172.21.15.105:0/1470854236 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb664078b90 0x7fb66407b0a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb674034000 tx=0x7fb674004730 comp rx=0 tx=0).stop 2024-09-21T03:20:08.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.246+0000 7fb6897a1640 1 -- 172.21.15.105:0/1470854236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6840cad30 msgr2=0x7fb684156ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:08.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.246+0000 7fb6897a1640 1 --2- 172.21.15.105:0/1470854236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6840cad30 0x7fb684156ed0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb66c00c3a0 tx=0x7fb66c00c860 comp rx=0 tx=0).stop 2024-09-21T03:20:08.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.247+0000 7fb6897a1640 1 -- 172.21.15.105:0/1470854236 shutdown_connections 2024-09-21T03:20:08.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.247+0000 7fb6897a1640 1 --2- 172.21.15.105:0/1470854236 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb664078b90 0x7fb66407b0a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:08.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.247+0000 7fb6897a1640 1 --2- 172.21.15.105:0/1470854236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6840c87c0 0x7fb6840c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:08.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.247+0000 7fb6897a1640 1 --2- 172.21.15.105:0/1470854236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6840cad30 0x7fb684156ed0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:08.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.247+0000 7fb6897a1640 1 --2- 172.21.15.105:0/1470854236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6840ca800 0x7fb68409d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:08.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.247+0000 7fb6897a1640 1 -- 172.21.15.105:0/1470854236 >> 172.21.15.105:0/1470854236 conn(0x7fb6840b1cb0 msgr2=0x7fb6840aefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:08.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.247+0000 7fb6897a1640 1 -- 172.21.15.105:0/1470854236 shutdown_connections 2024-09-21T03:20:08.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.247+0000 7fb6897a1640 1 -- 172.21.15.105:0/1470854236 wait complete. 2024-09-21T03:20:08.260 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:20:08.372 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.369+0000 7f21f0a38640 1 -- 172.21.15.105:0/2289492560 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21ec070390 msgr2=0x7f21ec165b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:08.372 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.369+0000 7f21f0a38640 1 --2- 172.21.15.105:0/2289492560 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21ec070390 0x7f21ec165b70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f21e4009be0 tx=0x7f21e402a8b0 comp rx=0 tx=0).stop 2024-09-21T03:20:08.372 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.369+0000 7f21f0a38640 1 -- 172.21.15.105:0/2289492560 shutdown_connections 2024-09-21T03:20:08.372 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.369+0000 7f21f0a38640 1 --2- 172.21.15.105:0/2289492560 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21ec070390 0x7f21ec165b70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:08.373 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.369+0000 7f21f0a38640 1 -- 172.21.15.105:0/2289492560 >> 172.21.15.105:0/2289492560 conn(0x7f21ec06d7d0 msgr2=0x7f21ec0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:08.373 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.369+0000 7f21f0a38640 1 -- 172.21.15.105:0/2289492560 shutdown_connections 2024-09-21T03:20:08.373 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.369+0000 7f21f0a38640 1 -- 172.21.15.105:0/2289492560 wait complete. 2024-09-21T03:20:08.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.371+0000 7f21f0a38640 1 Processor -- start 2024-09-21T03:20:08.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.371+0000 7f21f0a38640 1 -- start start 2024-09-21T03:20:08.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.372+0000 7f21f0a38640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21ec070390 0x7f21ec161170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:08.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.372+0000 7f21f0a38640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21ec072e30 0x7f21ec165360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:08.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.372+0000 7f21f0a38640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21ec158a50 0x7f21ec0cc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:08.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.373+0000 7f21f0a38640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f21ec1662c0 con 0x7f21ec070390 2024-09-21T03:20:08.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.373+0000 7f21f0a38640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f21ec0709a0 con 0x7f21ec072e30 2024-09-21T03:20:08.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.373+0000 7f21f0a38640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f21ec166440 con 0x7f21ec158a50 2024-09-21T03:20:08.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.373+0000 7f21ea59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21ec070390 0x7f21ec161170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:08.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.373+0000 7f21ea59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21ec070390 0x7f21ec161170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58434/0 (socket says 172.21.15.105:58434) 2024-09-21T03:20:08.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.373+0000 7f21ea59c640 1 -- 172.21.15.105:0/847542176 learned_addr learned my addr 172.21.15.105:0/847542176 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:08.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.373+0000 7f21ead9d640 1 --2- 172.21.15.105:0/847542176 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21ec158a50 0x7f21ec0cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:08.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.373+0000 7f21e3fff640 1 --2- 172.21.15.105:0/847542176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21ec072e30 0x7f21ec165360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:08.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.373+0000 7f21ea59c640 1 -- 172.21.15.105:0/847542176 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21ec158a50 msgr2=0x7f21ec0cc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:08.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.373+0000 7f21ea59c640 1 --2- 172.21.15.105:0/847542176 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21ec158a50 0x7f21ec0cc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:08.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.373+0000 7f21ea59c640 1 -- 172.21.15.105:0/847542176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21ec072e30 msgr2=0x7f21ec165360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:08.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.373+0000 7f21ea59c640 1 --2- 172.21.15.105:0/847542176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21ec072e30 0x7f21ec165360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:08.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.373+0000 7f21ea59c640 1 -- 172.21.15.105:0/847542176 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21ec1f6be0 con 0x7f21ec070390 2024-09-21T03:20:08.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.373+0000 7f21ea59c640 1 --2- 172.21.15.105:0/847542176 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21ec070390 0x7f21ec161170 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f21dc00c680 tx=0x7f21dc00cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:08.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.373+0000 7f21e2ffd640 1 -- 172.21.15.105:0/847542176 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21dc016020 con 0x7f21ec070390 2024-09-21T03:20:08.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.373+0000 7f21e2ffd640 1 -- 172.21.15.105:0/847542176 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21dc00a930 con 0x7f21ec070390 2024-09-21T03:20:08.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.373+0000 7f21e2ffd640 1 -- 172.21.15.105:0/847542176 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21dc00ad40 con 0x7f21ec070390 2024-09-21T03:20:08.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.373+0000 7f21f0a38640 1 -- 172.21.15.105:0/847542176 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21ec1f6ec0 con 0x7f21ec070390 2024-09-21T03:20:08.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.373+0000 7f21f0a38640 1 -- 172.21.15.105:0/847542176 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21ec15fcb0 con 0x7f21ec070390 2024-09-21T03:20:08.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.374+0000 7f21f0a38640 1 -- 172.21.15.105:0/847542176 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21ec1f73e0 con 0x7f21ec070390 2024-09-21T03:20:08.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.375+0000 7f21e2ffd640 1 -- 172.21.15.105:0/847542176 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f21dc019020 con 0x7f21ec070390 2024-09-21T03:20:08.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.376+0000 7f21e2ffd640 1 --2- 172.21.15.105:0/847542176 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f21cc078b90 0x7f21cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:08.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.376+0000 7f21e2ffd640 1 -- 172.21.15.105:0/847542176 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f21dc09ac30 con 0x7f21ec070390 2024-09-21T03:20:08.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.376+0000 7f21e3fff640 1 --2- 172.21.15.105:0/847542176 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f21cc078b90 0x7f21cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:08.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.376+0000 7f21e3fff640 1 --2- 172.21.15.105:0/847542176 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f21cc078b90 0x7f21cc07b0a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f21ec0cc0a0 tx=0x7f21d4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:08.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.380+0000 7f21e2ffd640 1 -- 172.21.15.105:0/847542176 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f21dc020030 con 0x7f21ec070390 2024-09-21T03:20:08.596 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.594+0000 7f21f0a38640 1 -- 172.21.15.105:0/847542176 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f21ec0b4d90 con 0x7f21ec070390 2024-09-21T03:20:08.597 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.594+0000 7f21e2ffd640 1 -- 172.21.15.105:0/847542176 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5232 (secure 0 0 0) 0x7f21ec0b3710 con 0x7f21ec070390 2024-09-21T03:20:08.597 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:20:08.597 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":17,"btime":"2024-09-21T03:19:15:120921+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4634,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/517240834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":517240834},{"type":"v1","addr":"172.21.15.162:6837","nonce":517240834}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4774,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3241953393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3241953393},{"type":"v1","addr":"172.21.15.162:6836","nonce":3241953393}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4899,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/2101702562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2101702562},{"type":"v1","addr":"172.21.15.105:6834","nonce":2101702562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:19:11.459432+0000","modified":"2024-09-21T03:19:14.487254+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4902},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4902":{"gid":4902,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1732564681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":1732564681},{"type":"v1","addr":"172.21.15.105:6835","nonce":1732564681}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4902,"qdb_cluster":[4902]},"id":2}]} 2024-09-21T03:20:08.597 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 17 2024-09-21T03:20:08.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.597+0000 7f21f0a38640 1 -- 172.21.15.105:0/847542176 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f21cc078b90 msgr2=0x7f21cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:08.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.597+0000 7f21f0a38640 1 --2- 172.21.15.105:0/847542176 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f21cc078b90 0x7f21cc07b0a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f21ec0cc0a0 tx=0x7f21d4009040 comp rx=0 tx=0).stop 2024-09-21T03:20:08.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.597+0000 7f21f0a38640 1 -- 172.21.15.105:0/847542176 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21ec070390 msgr2=0x7f21ec161170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:08.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.597+0000 7f21f0a38640 1 --2- 172.21.15.105:0/847542176 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21ec070390 0x7f21ec161170 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f21dc00c680 tx=0x7f21dc00cb40 comp rx=0 tx=0).stop 2024-09-21T03:20:08.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.597+0000 7f21f0a38640 1 -- 172.21.15.105:0/847542176 shutdown_connections 2024-09-21T03:20:08.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.597+0000 7f21f0a38640 1 --2- 172.21.15.105:0/847542176 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f21cc078b90 0x7f21cc07b0a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:08.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.597+0000 7f21f0a38640 1 --2- 172.21.15.105:0/847542176 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21ec158a50 0x7f21ec0cc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:08.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.597+0000 7f21f0a38640 1 --2- 172.21.15.105:0/847542176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21ec072e30 0x7f21ec165360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:08.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.597+0000 7f21f0a38640 1 --2- 172.21.15.105:0/847542176 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21ec070390 0x7f21ec161170 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:08.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.597+0000 7f21f0a38640 1 -- 172.21.15.105:0/847542176 >> 172.21.15.105:0/847542176 conn(0x7f21ec06d7d0 msgr2=0x7f21ec0ce040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:08.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.597+0000 7f21f0a38640 1 -- 172.21.15.105:0/847542176 shutdown_connections 2024-09-21T03:20:08.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.597+0000 7f21f0a38640 1 -- 172.21.15.105:0/847542176 wait complete. 2024-09-21T03:20:08.610 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:20:08.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.720+0000 7ff6a0562640 1 -- 172.21.15.105:0/2939035177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff69806f6e0 msgr2=0x7ff69806e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:08.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.720+0000 7ff6a0562640 1 --2- 172.21.15.105:0/2939035177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff69806f6e0 0x7ff69806e610 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff69808d490 tx=0x7ff68c02a410 comp rx=0 tx=0).stop 2024-09-21T03:20:08.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.720+0000 7ff6a0562640 1 -- 172.21.15.105:0/2939035177 shutdown_connections 2024-09-21T03:20:08.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.720+0000 7ff6a0562640 1 --2- 172.21.15.105:0/2939035177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff69806f6e0 0x7ff69806e610 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:08.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.720+0000 7ff6a0562640 1 --2- 172.21.15.105:0/2939035177 >> v2:172.21.15.162:3300/0 conn(0x7ff69806e0a0 0x7ff6980b97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:08.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.720+0000 7ff6a0562640 1 -- 172.21.15.105:0/2939035177 >> 172.21.15.105:0/2939035177 conn(0x7ff69809d840 msgr2=0x7ff69808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:08.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.720+0000 7ff6a0562640 1 -- 172.21.15.105:0/2939035177 shutdown_connections 2024-09-21T03:20:08.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.720+0000 7ff6a0562640 1 -- 172.21.15.105:0/2939035177 wait complete. 2024-09-21T03:20:08.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.721+0000 7ff6a0562640 1 Processor -- start 2024-09-21T03:20:08.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.721+0000 7ff6a0562640 1 -- start start 2024-09-21T03:20:08.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.723+0000 7ff6a0562640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff69806e0a0 0x7ff6980ce440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:08.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.723+0000 7ff6a0562640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff69806f6e0 0x7ff6981f2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:08.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.723+0000 7ff6a0562640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff6980d0e50 0x7ff6981f5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:08.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.723+0000 7ff6a0562640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff6980cfea0 con 0x7ff69806e0a0 2024-09-21T03:20:08.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.723+0000 7ff6a0562640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff6980cfd20 con 0x7ff69806f6e0 2024-09-21T03:20:08.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.723+0000 7ff6a0562640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff6980d0020 con 0x7ff6980d0e50 2024-09-21T03:20:08.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.723+0000 7ff69e2fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff69806e0a0 0x7ff6980ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:08.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.723+0000 7ff69e2fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff69806e0a0 0x7ff6980ce440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58456/0 (socket says 172.21.15.105:58456) 2024-09-21T03:20:08.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.723+0000 7ff69e2fe640 1 -- 172.21.15.105:0/1224890861 learned_addr learned my addr 172.21.15.105:0/1224890861 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:08.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.723+0000 7ff69dafd640 1 --2- 172.21.15.105:0/1224890861 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff69806f6e0 0x7ff6981f2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:08.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.723+0000 7ff69eaff640 1 --2- 172.21.15.105:0/1224890861 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff6980d0e50 0x7ff6981f5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:08.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.723+0000 7ff69e2fe640 1 -- 172.21.15.105:0/1224890861 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff6980d0e50 msgr2=0x7ff6981f5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:08.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.723+0000 7ff69e2fe640 1 --2- 172.21.15.105:0/1224890861 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff6980d0e50 0x7ff6981f5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:08.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.723+0000 7ff69e2fe640 1 -- 172.21.15.105:0/1224890861 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff69806f6e0 msgr2=0x7ff6981f2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:08.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.723+0000 7ff69e2fe640 1 --2- 172.21.15.105:0/1224890861 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff69806f6e0 0x7ff6981f2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:08.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.723+0000 7ff69e2fe640 1 -- 172.21.15.105:0/1224890861 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6980cb950 con 0x7ff69806e0a0 2024-09-21T03:20:08.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.724+0000 7ff69e2fe640 1 --2- 172.21.15.105:0/1224890861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff69806e0a0 0x7ff6980ce440 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff68800e7c0 tx=0x7ff68800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:08.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.724+0000 7ff696ffd640 1 -- 172.21.15.105:0/1224890861 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68800ccc0 con 0x7ff69806e0a0 2024-09-21T03:20:08.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.724+0000 7ff696ffd640 1 -- 172.21.15.105:0/1224890861 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff688010430 con 0x7ff69806e0a0 2024-09-21T03:20:08.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.724+0000 7ff6a0562640 1 -- 172.21.15.105:0/1224890861 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6981f6480 con 0x7ff69806e0a0 2024-09-21T03:20:08.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.724+0000 7ff696ffd640 1 -- 172.21.15.105:0/1224890861 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff688010840 con 0x7ff69806e0a0 2024-09-21T03:20:08.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.724+0000 7ff6a0562640 1 -- 172.21.15.105:0/1224890861 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6980cd680 con 0x7ff69806e0a0 2024-09-21T03:20:08.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.725+0000 7ff6a0562640 1 -- 172.21.15.105:0/1224890861 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6980d0420 con 0x7ff69806e0a0 2024-09-21T03:20:08.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.726+0000 7ff696ffd640 1 -- 172.21.15.105:0/1224890861 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff6880109e0 con 0x7ff69806e0a0 2024-09-21T03:20:08.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.726+0000 7ff696ffd640 1 --2- 172.21.15.105:0/1224890861 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff684078b90 0x7ff68407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:08.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.726+0000 7ff696ffd640 1 -- 172.21.15.105:0/1224890861 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7ff68809b820 con 0x7ff69806e0a0 2024-09-21T03:20:08.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.726+0000 7ff69dafd640 1 --2- 172.21.15.105:0/1224890861 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff684078b90 0x7ff68407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:08.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.727+0000 7ff69dafd640 1 --2- 172.21.15.105:0/1224890861 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff684078b90 0x7ff68407b0a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff68c034000 tx=0x7ff68c004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:08.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.731+0000 7ff696ffd640 1 -- 172.21.15.105:0/1224890861 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff688063c60 con 0x7ff69806e0a0 2024-09-21T03:20:08.914 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.910+0000 7ff6a0562640 1 -- 172.21.15.105:0/1224890861 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff6980d14b0 con 0x7ff69806e0a0 2024-09-21T03:20:08.914 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.911+0000 7ff696ffd640 1 -- 172.21.15.105:0/1224890861 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16801 (secure 0 0 0) 0x7ff688063560 con 0x7ff69806e0a0 2024-09-21T03:20:08.915 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:20:08.915 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":34,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:19:13.095557+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:19:09.277161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-21T03:19:10.428993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:20:08.916 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.913+0000 7ff6a0562640 1 -- 172.21.15.105:0/1224890861 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff684078b90 msgr2=0x7ff68407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:08.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.913+0000 7ff6a0562640 1 --2- 172.21.15.105:0/1224890861 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff684078b90 0x7ff68407b0a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff68c034000 tx=0x7ff68c004730 comp rx=0 tx=0).stop 2024-09-21T03:20:08.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.913+0000 7ff6a0562640 1 -- 172.21.15.105:0/1224890861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff69806e0a0 msgr2=0x7ff6980ce440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:08.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.913+0000 7ff6a0562640 1 --2- 172.21.15.105:0/1224890861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff69806e0a0 0x7ff6980ce440 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff68800e7c0 tx=0x7ff68800ec80 comp rx=0 tx=0).stop 2024-09-21T03:20:08.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.913+0000 7ff6a0562640 1 -- 172.21.15.105:0/1224890861 shutdown_connections 2024-09-21T03:20:08.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.913+0000 7ff6a0562640 1 --2- 172.21.15.105:0/1224890861 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff684078b90 0x7ff68407b0a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:08.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.913+0000 7ff6a0562640 1 --2- 172.21.15.105:0/1224890861 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff6980d0e50 0x7ff6981f5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:08.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.913+0000 7ff6a0562640 1 --2- 172.21.15.105:0/1224890861 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff69806f6e0 0x7ff6981f2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:08.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.913+0000 7ff6a0562640 1 --2- 172.21.15.105:0/1224890861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff69806e0a0 0x7ff6980ce440 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:08.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.913+0000 7ff6a0562640 1 -- 172.21.15.105:0/1224890861 >> 172.21.15.105:0/1224890861 conn(0x7ff69809d840 msgr2=0x7ff6980b7360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:08.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.913+0000 7ff6a0562640 1 -- 172.21.15.105:0/1224890861 shutdown_connections 2024-09-21T03:20:08.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:08.913+0000 7ff6a0562640 1 -- 172.21.15.105:0/1224890861 wait complete. 2024-09-21T03:20:08.926 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T03:20:08.926 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:20:09.037 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.036+0000 7f4fc7e8b640 1 -- 172.21.15.105:0/3707918258 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fc01600b0 msgr2=0x7f4fc00ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:09.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.036+0000 7f4fc7e8b640 1 --2- 172.21.15.105:0/3707918258 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fc01600b0 0x7f4fc00ccbc0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc009830 tx=0x7f4fbc02a510 comp rx=0 tx=0).stop 2024-09-21T03:20:09.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.036+0000 7f4fc7e8b640 1 -- 172.21.15.105:0/3707918258 shutdown_connections 2024-09-21T03:20:09.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.036+0000 7f4fc7e8b640 1 --2- 172.21.15.105:0/3707918258 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fc01600b0 0x7f4fc00ccbc0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:09.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.036+0000 7f4fc7e8b640 1 -- 172.21.15.105:0/3707918258 >> 172.21.15.105:0/3707918258 conn(0x7f4fc006d4f0 msgr2=0x7f4fc0071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:09.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.036+0000 7f4fc7e8b640 1 -- 172.21.15.105:0/3707918258 shutdown_connections 2024-09-21T03:20:09.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.036+0000 7f4fc7e8b640 1 -- 172.21.15.105:0/3707918258 wait complete. 2024-09-21T03:20:09.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.038+0000 7f4fc7e8b640 1 Processor -- start 2024-09-21T03:20:09.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.038+0000 7f4fc7e8b640 1 -- start start 2024-09-21T03:20:09.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.039+0000 7f4fc7e8b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4fc00b7cc0 0x7f4fc01f5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:09.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.039+0000 7f4fc7e8b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fc00cf320 0x7f4fc00cb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:09.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.039+0000 7f4fc7e8b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4fc01600b0 0x7f4fc00b0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:09.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.039+0000 7f4fc7e8b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc00d15b0 con 0x7f4fc00cf320 2024-09-21T03:20:09.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.039+0000 7f4fc7e8b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc00d1430 con 0x7f4fc00b7cc0 2024-09-21T03:20:09.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.039+0000 7f4fc7e8b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4fc00d1730 con 0x7f4fc01600b0 2024-09-21T03:20:09.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.039+0000 7f4fc5426640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fc00cf320 0x7f4fc00cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:09.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.039+0000 7f4fc5426640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fc00cf320 0x7f4fc00cb110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58474/0 (socket says 172.21.15.105:58474) 2024-09-21T03:20:09.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.039+0000 7f4fc5426640 1 -- 172.21.15.105:0/3741175020 learned_addr learned my addr 172.21.15.105:0/3741175020 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:09.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.039+0000 7f4fc5c27640 1 --2- 172.21.15.105:0/3741175020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4fc00b7cc0 0x7f4fc01f5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:09.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.039+0000 7f4fc6428640 1 --2- 172.21.15.105:0/3741175020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4fc01600b0 0x7f4fc00b0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:09.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.039+0000 7f4fc5426640 1 -- 172.21.15.105:0/3741175020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4fc01600b0 msgr2=0x7f4fc00b0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:09.043 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.039+0000 7f4fc5426640 1 --2- 172.21.15.105:0/3741175020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4fc01600b0 0x7f4fc00b0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:09.043 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.039+0000 7f4fc5426640 1 -- 172.21.15.105:0/3741175020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4fc00b7cc0 msgr2=0x7f4fc01f5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:09.043 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.039+0000 7f4fc5426640 1 --2- 172.21.15.105:0/3741175020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4fc00b7cc0 0x7f4fc01f5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:09.043 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.039+0000 7f4fc5426640 1 -- 172.21.15.105:0/3741175020 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc00b3ca0 con 0x7f4fc00cf320 2024-09-21T03:20:09.043 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.040+0000 7f4fc5426640 1 --2- 172.21.15.105:0/3741175020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fc00cf320 0x7f4fc00cb110 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4fb000c3c0 tx=0x7f4fb000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:09.043 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.040+0000 7f4fb67fc640 1 -- 172.21.15.105:0/3741175020 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb0017070 con 0x7f4fc00cf320 2024-09-21T03:20:09.043 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.040+0000 7f4fb67fc640 1 -- 172.21.15.105:0/3741175020 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4fb00035f0 con 0x7f4fc00cf320 2024-09-21T03:20:09.043 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.040+0000 7f4fb67fc640 1 -- 172.21.15.105:0/3741175020 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb0003a40 con 0x7f4fc00cf320 2024-09-21T03:20:09.043 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.040+0000 7f4fc7e8b640 1 -- 172.21.15.105:0/3741175020 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fc00b4110 con 0x7f4fc00cf320 2024-09-21T03:20:09.043 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.040+0000 7f4fc7e8b640 1 -- 172.21.15.105:0/3741175020 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fc00b46d0 con 0x7f4fc00cf320 2024-09-21T03:20:09.044 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.041+0000 7f4fc7e8b640 1 -- 172.21.15.105:0/3741175020 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fc00b3e70 con 0x7f4fc00cf320 2024-09-21T03:20:09.044 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.041+0000 7f4fb67fc640 1 -- 172.21.15.105:0/3741175020 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4fb001a070 con 0x7f4fc00cf320 2024-09-21T03:20:09.044 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.042+0000 7f4fb67fc640 1 --2- 172.21.15.105:0/3741175020 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4fa4078b90 0x7f4fa407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:09.044 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.042+0000 7f4fb67fc640 1 -- 172.21.15.105:0/3741175020 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f4fb0099f80 con 0x7f4fc00cf320 2024-09-21T03:20:09.044 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.042+0000 7f4fc5c27640 1 --2- 172.21.15.105:0/3741175020 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4fa4078b90 0x7f4fa407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:09.045 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.043+0000 7f4fc5c27640 1 --2- 172.21.15.105:0/3741175020 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4fa4078b90 0x7f4fa407b0a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc034000 tx=0x7f4fbc004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:09.048 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.047+0000 7f4fb67fc640 1 -- 172.21.15.105:0/3741175020 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4fc00b3e70 con 0x7f4fc00cf320 2024-09-21T03:20:09.262 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.260+0000 7f4fc7e8b640 1 -- 172.21.15.105:0/3741175020 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4fc00ccbc0 con 0x7f4fc00cf320 2024-09-21T03:20:09.262 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.261+0000 7f4fb67fc640 1 -- 172.21.15.105:0/3741175020 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5232 (secure 0 0 0) 0x7f4fb0062450 con 0x7f4fc00cf320 2024-09-21T03:20:09.262 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:20:09.263 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":17,"btime":"2024-09-21T03:19:15:120921+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4634,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/517240834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":517240834},{"type":"v1","addr":"172.21.15.162:6837","nonce":517240834}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4774,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3241953393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3241953393},{"type":"v1","addr":"172.21.15.162:6836","nonce":3241953393}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4899,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/2101702562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2101702562},{"type":"v1","addr":"172.21.15.105:6834","nonce":2101702562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:19:11.459432+0000","modified":"2024-09-21T03:19:14.487254+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4902},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4902":{"gid":4902,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1732564681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":1732564681},{"type":"v1","addr":"172.21.15.105:6835","nonce":1732564681}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4902,"qdb_cluster":[4902]},"id":2}]} 2024-09-21T03:20:09.263 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 17 2024-09-21T03:20:09.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.263+0000 7f4fc7e8b640 1 -- 172.21.15.105:0/3741175020 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4fa4078b90 msgr2=0x7f4fa407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:09.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.263+0000 7f4fc7e8b640 1 --2- 172.21.15.105:0/3741175020 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4fa4078b90 0x7f4fa407b0a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc034000 tx=0x7f4fbc004730 comp rx=0 tx=0).stop 2024-09-21T03:20:09.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.263+0000 7f4fc7e8b640 1 -- 172.21.15.105:0/3741175020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fc00cf320 msgr2=0x7f4fc00cb110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:09.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.263+0000 7f4fc7e8b640 1 --2- 172.21.15.105:0/3741175020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fc00cf320 0x7f4fc00cb110 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4fb000c3c0 tx=0x7f4fb000c880 comp rx=0 tx=0).stop 2024-09-21T03:20:09.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.263+0000 7f4fc7e8b640 1 -- 172.21.15.105:0/3741175020 shutdown_connections 2024-09-21T03:20:09.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.263+0000 7f4fc7e8b640 1 --2- 172.21.15.105:0/3741175020 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4fa4078b90 0x7f4fa407b0a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:09.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.263+0000 7f4fc7e8b640 1 --2- 172.21.15.105:0/3741175020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4fc01600b0 0x7f4fc00b0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:09.266 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.263+0000 7f4fc7e8b640 1 --2- 172.21.15.105:0/3741175020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fc00cf320 0x7f4fc00cb110 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:09.266 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.263+0000 7f4fc7e8b640 1 --2- 172.21.15.105:0/3741175020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4fc00b7cc0 0x7f4fc01f5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:09.266 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.263+0000 7f4fc7e8b640 1 -- 172.21.15.105:0/3741175020 >> 172.21.15.105:0/3741175020 conn(0x7f4fc006d4f0 msgr2=0x7f4fc006f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:09.266 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.263+0000 7f4fc7e8b640 1 -- 172.21.15.105:0/3741175020 shutdown_connections 2024-09-21T03:20:09.266 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.263+0000 7f4fc7e8b640 1 -- 172.21.15.105:0/3741175020 wait complete. 2024-09-21T03:20:09.276 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:20:09.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.386+0000 7f0885ddf640 1 -- 172.21.15.105:0/3017128228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08800d1490 msgr2=0x7f08800cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:09.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.386+0000 7f0885ddf640 1 --2- 172.21.15.105:0/3017128228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08800d1490 0x7f08800cebf0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0880073f50 tx=0x7f087802aa30 comp rx=0 tx=0).stop 2024-09-21T03:20:09.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.386+0000 7f0885ddf640 1 -- 172.21.15.105:0/3017128228 shutdown_connections 2024-09-21T03:20:09.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.386+0000 7f0885ddf640 1 --2- 172.21.15.105:0/3017128228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08800d1490 0x7f08800cebf0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:09.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.386+0000 7f0885ddf640 1 --2- 172.21.15.105:0/3017128228 >> v2:172.21.15.162:3300/0 conn(0x7f08800b51c0 0x7f088015c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:09.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.386+0000 7f0885ddf640 1 -- 172.21.15.105:0/3017128228 >> 172.21.15.105:0/3017128228 conn(0x7f0880072ae0 msgr2=0x7f0880072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:09.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.386+0000 7f0885ddf640 1 -- 172.21.15.105:0/3017128228 shutdown_connections 2024-09-21T03:20:09.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.386+0000 7f0885ddf640 1 -- 172.21.15.105:0/3017128228 wait complete. 2024-09-21T03:20:09.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.388+0000 7f0885ddf640 1 Processor -- start 2024-09-21T03:20:09.390 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.388+0000 7f0885ddf640 1 -- start start 2024-09-21T03:20:09.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.389+0000 7f0885ddf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08800b51c0 0x7f0880159f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:09.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.389+0000 7f0885ddf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08800ccbd0 0x7f0880158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:09.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.389+0000 7f0885ddf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08800d1490 0x7f08801426c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:09.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.390+0000 7f0885ddf640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f08800cf2b0 con 0x7f08800d1490 2024-09-21T03:20:09.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.390+0000 7f0885ddf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f08800cf130 con 0x7f08800ccbd0 2024-09-21T03:20:09.393 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.390+0000 7f0885ddf640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f08800cf430 con 0x7f08800b51c0 2024-09-21T03:20:09.393 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.390+0000 7f087ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08800d1490 0x7f08801426c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:09.393 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.390+0000 7f087ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08800d1490 0x7f08801426c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58492/0 (socket says 172.21.15.105:58492) 2024-09-21T03:20:09.393 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.390+0000 7f087ffff640 1 -- 172.21.15.105:0/3342830127 learned_addr learned my addr 172.21.15.105:0/3342830127 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:09.393 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.390+0000 7f087effd640 1 --2- 172.21.15.105:0/3342830127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08800ccbd0 0x7f0880158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:09.393 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.390+0000 7f087f7fe640 1 --2- 172.21.15.105:0/3342830127 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08800b51c0 0x7f0880159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:09.393 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.390+0000 7f087ffff640 1 -- 172.21.15.105:0/3342830127 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08800b51c0 msgr2=0x7f0880159f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:09.393 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.390+0000 7f087ffff640 1 --2- 172.21.15.105:0/3342830127 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08800b51c0 0x7f0880159f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:09.393 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.390+0000 7f087ffff640 1 -- 172.21.15.105:0/3342830127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08800ccbd0 msgr2=0x7f0880158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:09.393 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.390+0000 7f087ffff640 1 --2- 172.21.15.105:0/3342830127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08800ccbd0 0x7f0880158ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:09.393 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.390+0000 7f087ffff640 1 -- 172.21.15.105:0/3342830127 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08801f34a0 con 0x7f08800d1490 2024-09-21T03:20:09.393 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.390+0000 7f087effd640 1 --2- 172.21.15.105:0/3342830127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08800ccbd0 0x7f0880158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:20:09.393 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.390+0000 7f087ffff640 1 --2- 172.21.15.105:0/3342830127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08800d1490 0x7f08801426c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0878005fd0 tx=0x7f0878003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:09.393 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.390+0000 7f0867fff640 1 -- 172.21.15.105:0/3342830127 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0878033050 con 0x7f08800d1490 2024-09-21T03:20:09.394 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.390+0000 7f0867fff640 1 -- 172.21.15.105:0/3342830127 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f08780045f0 con 0x7f08800d1490 2024-09-21T03:20:09.394 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.390+0000 7f0885ddf640 1 -- 172.21.15.105:0/3342830127 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08801e5140 con 0x7f08800d1490 2024-09-21T03:20:09.394 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.390+0000 7f0867fff640 1 -- 172.21.15.105:0/3342830127 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0878038450 con 0x7f08800d1490 2024-09-21T03:20:09.394 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.390+0000 7f0885ddf640 1 -- 172.21.15.105:0/3342830127 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0880159740 con 0x7f08800d1490 2024-09-21T03:20:09.395 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.391+0000 7f0885ddf640 1 -- 172.21.15.105:0/3342830127 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08800cf900 con 0x7f08800d1490 2024-09-21T03:20:09.395 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.392+0000 7f0867fff640 1 -- 172.21.15.105:0/3342830127 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0878036070 con 0x7f08800d1490 2024-09-21T03:20:09.395 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.393+0000 7f0867fff640 1 --2- 172.21.15.105:0/3342830127 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f086c078b90 0x7f086c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:09.395 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.393+0000 7f0867fff640 1 -- 172.21.15.105:0/3342830127 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f08780bc360 con 0x7f08800d1490 2024-09-21T03:20:09.395 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.393+0000 7f087f7fe640 1 --2- 172.21.15.105:0/3342830127 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f086c078b90 0x7f086c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:09.395 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.393+0000 7f087f7fe640 1 --2- 172.21.15.105:0/3342830127 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f086c078b90 0x7f086c07b0a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f08700058c0 tx=0x7f087000c440 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:09.399 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.397+0000 7f0867fff640 1 -- 172.21.15.105:0/3342830127 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0878084830 con 0x7f08800d1490 2024-09-21T03:20:09.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.610+0000 7f0885ddf640 1 -- 172.21.15.105:0/3342830127 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f08800b7d60 con 0x7f08800d1490 2024-09-21T03:20:09.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.610+0000 7f0867fff640 1 -- 172.21.15.105:0/3342830127 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5232 (secure 0 0 0) 0x7f0878084130 con 0x7f08800d1490 2024-09-21T03:20:09.612 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:20:09.612 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":17,"btime":"2024-09-21T03:19:15:120921+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4634,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/517240834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":517240834},{"type":"v1","addr":"172.21.15.162:6837","nonce":517240834}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4774,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3241953393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3241953393},{"type":"v1","addr":"172.21.15.162:6836","nonce":3241953393}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4899,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/2101702562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2101702562},{"type":"v1","addr":"172.21.15.105:6834","nonce":2101702562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:19:11.459432+0000","modified":"2024-09-21T03:19:14.487254+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4902},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4902":{"gid":4902,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1732564681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":1732564681},{"type":"v1","addr":"172.21.15.105:6835","nonce":1732564681}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4902,"qdb_cluster":[4902]},"id":2}]} 2024-09-21T03:20:09.612 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 17 2024-09-21T03:20:09.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.613+0000 7f0885ddf640 1 -- 172.21.15.105:0/3342830127 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f086c078b90 msgr2=0x7f086c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:09.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.613+0000 7f0885ddf640 1 --2- 172.21.15.105:0/3342830127 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f086c078b90 0x7f086c07b0a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f08700058c0 tx=0x7f087000c440 comp rx=0 tx=0).stop 2024-09-21T03:20:09.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.613+0000 7f0885ddf640 1 -- 172.21.15.105:0/3342830127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08800d1490 msgr2=0x7f08801426c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:09.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.613+0000 7f0885ddf640 1 --2- 172.21.15.105:0/3342830127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08800d1490 0x7f08801426c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0878005fd0 tx=0x7f0878003f90 comp rx=0 tx=0).stop 2024-09-21T03:20:09.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.613+0000 7f0885ddf640 1 -- 172.21.15.105:0/3342830127 shutdown_connections 2024-09-21T03:20:09.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.613+0000 7f0885ddf640 1 --2- 172.21.15.105:0/3342830127 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f086c078b90 0x7f086c07b0a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:09.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.613+0000 7f0885ddf640 1 --2- 172.21.15.105:0/3342830127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08800d1490 0x7f08801426c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:09.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.613+0000 7f0885ddf640 1 --2- 172.21.15.105:0/3342830127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08800ccbd0 0x7f0880158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:09.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.613+0000 7f0885ddf640 1 --2- 172.21.15.105:0/3342830127 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08800b51c0 0x7f0880159f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:09.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.613+0000 7f0885ddf640 1 -- 172.21.15.105:0/3342830127 >> 172.21.15.105:0/3342830127 conn(0x7f0880072ae0 msgr2=0x7f08800d1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:09.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.613+0000 7f0885ddf640 1 -- 172.21.15.105:0/3342830127 shutdown_connections 2024-09-21T03:20:09.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.613+0000 7f0885ddf640 1 -- 172.21.15.105:0/3342830127 wait complete. 2024-09-21T03:20:09.625 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:20:09.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.735+0000 7fa63c7ba640 1 -- 172.21.15.105:0/1099825546 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa63406f4b0 msgr2=0x7fa6340d3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:09.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.735+0000 7fa63c7ba640 1 --2- 172.21.15.105:0/1099825546 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa63406f4b0 0x7fa6340d3330 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa624009900 tx=0x7fa62402a580 comp rx=0 tx=0).stop 2024-09-21T03:20:09.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.735+0000 7fa63c7ba640 1 -- 172.21.15.105:0/1099825546 shutdown_connections 2024-09-21T03:20:09.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.735+0000 7fa63c7ba640 1 --2- 172.21.15.105:0/1099825546 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa63406f4b0 0x7fa6340d3330 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:09.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.735+0000 7fa63c7ba640 1 --2- 172.21.15.105:0/1099825546 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa63406e170 0x7fa6340b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:09.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.735+0000 7fa63c7ba640 1 -- 172.21.15.105:0/1099825546 >> 172.21.15.105:0/1099825546 conn(0x7fa63408bfc0 msgr2=0x7fa63409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:09.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.736+0000 7fa63c7ba640 1 -- 172.21.15.105:0/1099825546 shutdown_connections 2024-09-21T03:20:09.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.736+0000 7fa63c7ba640 1 -- 172.21.15.105:0/1099825546 wait complete. 2024-09-21T03:20:09.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.737+0000 7fa63c7ba640 1 Processor -- start 2024-09-21T03:20:09.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.737+0000 7fa63c7ba640 1 -- start start 2024-09-21T03:20:09.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.738+0000 7fa63c7ba640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa63406f4b0 0x7fa6340c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:09.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.739+0000 7fa63c7ba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6340d3870 0x7fa634156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:09.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.739+0000 7fa63c7ba640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6341554c0 0x7fa6340b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:09.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.739+0000 7fa63c7ba640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa6340d0e60 con 0x7fa6341554c0 2024-09-21T03:20:09.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.739+0000 7fa63c7ba640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa6340d0ce0 con 0x7fa6340d3870 2024-09-21T03:20:09.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.739+0000 7fa63c7ba640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa6340d0fe0 con 0x7fa63406f4b0 2024-09-21T03:20:09.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.739+0000 7fa63ad57640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6341554c0 0x7fa6340b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:09.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.739+0000 7fa63ad57640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6341554c0 0x7fa6340b4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58510/0 (socket says 172.21.15.105:58510) 2024-09-21T03:20:09.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.739+0000 7fa63ad57640 1 -- 172.21.15.105:0/522290448 learned_addr learned my addr 172.21.15.105:0/522290448 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:09.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.739+0000 7fa63a556640 1 --2- 172.21.15.105:0/522290448 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa63406f4b0 0x7fa6340c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:09.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.739+0000 7fa639d55640 1 --2- 172.21.15.105:0/522290448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6340d3870 0x7fa634156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:09.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.739+0000 7fa63ad57640 1 -- 172.21.15.105:0/522290448 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa63406f4b0 msgr2=0x7fa6340c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:09.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.739+0000 7fa63ad57640 1 --2- 172.21.15.105:0/522290448 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa63406f4b0 0x7fa6340c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:09.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.739+0000 7fa63ad57640 1 -- 172.21.15.105:0/522290448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6340d3870 msgr2=0x7fa634156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:09.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.739+0000 7fa63ad57640 1 --2- 172.21.15.105:0/522290448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6340d3870 0x7fa634156490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:09.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.739+0000 7fa63ad57640 1 -- 172.21.15.105:0/522290448 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6341f8f20 con 0x7fa6341554c0 2024-09-21T03:20:09.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.739+0000 7fa639d55640 1 --2- 172.21.15.105:0/522290448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6340d3870 0x7fa634156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:20:09.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.739+0000 7fa63a556640 1 --2- 172.21.15.105:0/522290448 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa63406f4b0 0x7fa6340c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:20:09.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.739+0000 7fa63ad57640 1 --2- 172.21.15.105:0/522290448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6341554c0 0x7fa6340b4fa0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa62c00c760 tx=0x7fa62c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:09.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.739+0000 7fa62affd640 1 -- 172.21.15.105:0/522290448 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa62c003b90 con 0x7fa6341554c0 2024-09-21T03:20:09.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.739+0000 7fa62affd640 1 -- 172.21.15.105:0/522290448 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa62c003d50 con 0x7fa6341554c0 2024-09-21T03:20:09.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.739+0000 7fa63c7ba640 1 -- 172.21.15.105:0/522290448 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6341f9200 con 0x7fa6341554c0 2024-09-21T03:20:09.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.739+0000 7fa62affd640 1 -- 172.21.15.105:0/522290448 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa62c00aab0 con 0x7fa6341554c0 2024-09-21T03:20:09.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.739+0000 7fa63c7ba640 1 -- 172.21.15.105:0/522290448 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa634155c90 con 0x7fa6341554c0 2024-09-21T03:20:09.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.740+0000 7fa63c7ba640 1 -- 172.21.15.105:0/522290448 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6340d1500 con 0x7fa6341554c0 2024-09-21T03:20:09.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.741+0000 7fa62affd640 1 -- 172.21.15.105:0/522290448 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa62c00ac50 con 0x7fa6341554c0 2024-09-21T03:20:09.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.742+0000 7fa62affd640 1 --2- 172.21.15.105:0/522290448 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa618078b90 0x7fa61807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:09.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.742+0000 7fa62affd640 1 -- 172.21.15.105:0/522290448 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fa62c09aa40 con 0x7fa6341554c0 2024-09-21T03:20:09.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.742+0000 7fa63a556640 1 --2- 172.21.15.105:0/522290448 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa618078b90 0x7fa61807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:09.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.742+0000 7fa63a556640 1 --2- 172.21.15.105:0/522290448 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa618078b90 0x7fa61807b0a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa630009aa0 tx=0x7fa630005db0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:09.747 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.746+0000 7fa62affd640 1 -- 172.21.15.105:0/522290448 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa62c062f10 con 0x7fa6341554c0 2024-09-21T03:20:09.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.926+0000 7fa63c7ba640 1 -- 172.21.15.105:0/522290448 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa63406cde0 con 0x7fa6341554c0 2024-09-21T03:20:09.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.927+0000 7fa62affd640 1 -- 172.21.15.105:0/522290448 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16801 (secure 0 0 0) 0x7fa62c062810 con 0x7fa6341554c0 2024-09-21T03:20:09.928 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:20:09.929 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":34,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:19:13.095557+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:19:09.277161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-21T03:19:10.428993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:20:09.931 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.929+0000 7fa63c7ba640 1 -- 172.21.15.105:0/522290448 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa618078b90 msgr2=0x7fa61807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:09.931 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.929+0000 7fa63c7ba640 1 --2- 172.21.15.105:0/522290448 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa618078b90 0x7fa61807b0a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa630009aa0 tx=0x7fa630005db0 comp rx=0 tx=0).stop 2024-09-21T03:20:09.931 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.929+0000 7fa63c7ba640 1 -- 172.21.15.105:0/522290448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6341554c0 msgr2=0x7fa6340b4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:09.931 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.929+0000 7fa63c7ba640 1 --2- 172.21.15.105:0/522290448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6341554c0 0x7fa6340b4fa0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa62c00c760 tx=0x7fa62c00cc20 comp rx=0 tx=0).stop 2024-09-21T03:20:09.931 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.929+0000 7fa63c7ba640 1 -- 172.21.15.105:0/522290448 shutdown_connections 2024-09-21T03:20:09.931 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.929+0000 7fa63c7ba640 1 --2- 172.21.15.105:0/522290448 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa618078b90 0x7fa61807b0a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:09.931 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.929+0000 7fa63c7ba640 1 --2- 172.21.15.105:0/522290448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6341554c0 0x7fa6340b4fa0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:09.931 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.929+0000 7fa63c7ba640 1 --2- 172.21.15.105:0/522290448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6340d3870 0x7fa634156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:09.931 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.929+0000 7fa63c7ba640 1 --2- 172.21.15.105:0/522290448 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa63406f4b0 0x7fa6340c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:09.931 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.929+0000 7fa63c7ba640 1 -- 172.21.15.105:0/522290448 >> 172.21.15.105:0/522290448 conn(0x7fa63408bfc0 msgr2=0x7fa6340b1810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:09.931 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.929+0000 7fa63c7ba640 1 -- 172.21.15.105:0/522290448 shutdown_connections 2024-09-21T03:20:09.931 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:09.929+0000 7fa63c7ba640 1 -- 172.21.15.105:0/522290448 wait complete. 2024-09-21T03:20:09.942 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T03:20:10.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.054+0000 7fded6c4d640 1 -- 172.21.15.105:0/1722803367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdeb8004800 msgr2=0x7fdeb8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:10.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.054+0000 7fded6c4d640 1 --2- 172.21.15.105:0/1722803367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdeb8004800 0x7fdeb8004c10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fdec0009b20 tx=0x7fdeb8005830 comp rx=0 tx=0).stop 2024-09-21T03:20:10.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.054+0000 7fded51ea640 1 -- 172.21.15.105:0/1722803367 reap_dead start 2024-09-21T03:20:10.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.054+0000 7fded6c4d640 1 -- 172.21.15.105:0/1722803367 shutdown_connections 2024-09-21T03:20:10.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.054+0000 7fded6c4d640 1 -- 172.21.15.105:0/1722803367 >> 172.21.15.105:0/1722803367 conn(0x7fded006d4f0 msgr2=0x7fded0071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:10.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.054+0000 7fded6c4d640 1 -- 172.21.15.105:0/1722803367 shutdown_connections 2024-09-21T03:20:10.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.054+0000 7fded6c4d640 1 -- 172.21.15.105:0/1722803367 wait complete. 2024-09-21T03:20:10.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.056+0000 7fded6c4d640 1 Processor -- start 2024-09-21T03:20:10.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.056+0000 7fded6c4d640 1 -- start start 2024-09-21T03:20:10.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.058+0000 7fded6c4d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdeb8004800 0x7fded01f9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:10.061 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.058+0000 7fded6c4d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fded006fc70 0x7fded01589d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:10.061 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.058+0000 7fded6c4d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fded00b6d00 0x7fded00b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:10.061 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.058+0000 7fded6c4d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fded00cec10 con 0x7fdeb8004800 2024-09-21T03:20:10.061 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.058+0000 7fded6c4d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fded00d1ba0 con 0x7fded00b6d00 2024-09-21T03:20:10.061 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.058+0000 7fded6c4d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fded00ced90 con 0x7fded006fc70 2024-09-21T03:20:10.061 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.058+0000 7fded49e9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdeb8004800 0x7fded01f9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:10.061 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.058+0000 7fded49e9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdeb8004800 0x7fded01f9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58516/0 (socket says 172.21.15.105:58516) 2024-09-21T03:20:10.061 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.058+0000 7fded49e9640 1 -- 172.21.15.105:0/1528155460 learned_addr learned my addr 172.21.15.105:0/1528155460 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:10.061 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.058+0000 7fdec7fff640 1 --2- 172.21.15.105:0/1528155460 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fded006fc70 0x7fded01589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:10.061 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.058+0000 7fded51ea640 1 --2- 172.21.15.105:0/1528155460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fded00b6d00 0x7fded00b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:10.061 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.058+0000 7fded49e9640 1 -- 172.21.15.105:0/1528155460 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fded006fc70 msgr2=0x7fded01589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:10.061 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.058+0000 7fded49e9640 1 --2- 172.21.15.105:0/1528155460 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fded006fc70 0x7fded01589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:10.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.058+0000 7fded49e9640 1 -- 172.21.15.105:0/1528155460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fded00b6d00 msgr2=0x7fded00b7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:10.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.058+0000 7fded49e9640 1 --2- 172.21.15.105:0/1528155460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fded00b6d00 0x7fded00b7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:10.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.058+0000 7fded49e9640 1 -- 172.21.15.105:0/1528155460 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fded00b7650 con 0x7fdeb8004800 2024-09-21T03:20:10.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.058+0000 7fded49e9640 1 --2- 172.21.15.105:0/1528155460 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdeb8004800 0x7fded01f9ae0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdecc011a80 tx=0x7fdecc011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:10.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.058+0000 7fdec57fa640 1 -- 172.21.15.105:0/1528155460 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdecc00fe10 con 0x7fdeb8004800 2024-09-21T03:20:10.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.058+0000 7fdec57fa640 1 -- 172.21.15.105:0/1528155460 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdecc016070 con 0x7fdeb8004800 2024-09-21T03:20:10.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.058+0000 7fded6c4d640 1 -- 172.21.15.105:0/1528155460 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fded015d6b0 con 0x7fdeb8004800 2024-09-21T03:20:10.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.058+0000 7fdec57fa640 1 -- 172.21.15.105:0/1528155460 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdecc0127a0 con 0x7fdeb8004800 2024-09-21T03:20:10.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.058+0000 7fded6c4d640 1 -- 172.21.15.105:0/1528155460 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fded015dc70 con 0x7fdeb8004800 2024-09-21T03:20:10.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.060+0000 7fded6c4d640 1 -- 172.21.15.105:0/1528155460 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fded00ccbc0 con 0x7fdeb8004800 2024-09-21T03:20:10.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.060+0000 7fdec57fa640 1 -- 172.21.15.105:0/1528155460 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdecc018030 con 0x7fdeb8004800 2024-09-21T03:20:10.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.061+0000 7fdec57fa640 1 --2- 172.21.15.105:0/1528155460 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdebc078b90 0x7fdebc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:10.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.061+0000 7fdec57fa640 1 -- 172.21.15.105:0/1528155460 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fdecc09b4f0 con 0x7fdeb8004800 2024-09-21T03:20:10.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.061+0000 7fdec7fff640 1 --2- 172.21.15.105:0/1528155460 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdebc078b90 0x7fdebc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:10.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.062+0000 7fdec7fff640 1 --2- 172.21.15.105:0/1528155460 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdebc078b90 0x7fdebc07b0a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdec0035000 tx=0x7fdec00046c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:10.066 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.065+0000 7fdec57fa640 1 -- 172.21.15.105:0/1528155460 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fded00b7650 con 0x7fdeb8004800 2024-09-21T03:20:10.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.276+0000 7fded6c4d640 1 -- 172.21.15.105:0/1528155460 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fded00b5dd0 con 0x7fdeb8004800 2024-09-21T03:20:10.278 INFO:tasks.ceph.mon.a.smithi105.stderr:2024-09-21T03:20:10.277+0000 7f25819ea640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T03:20:10.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.278+0000 7fdec57fa640 1 -- 172.21.15.105:0/1528155460 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) ==== 161+0+0 (secure 0 0 0) 0x7fdecc063370 con 0x7fdeb8004800 2024-09-21T03:20:10.280 INFO:teuthology.orchestra.run.smithi105.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T03:20:10.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.280+0000 7fded6c4d640 1 -- 172.21.15.105:0/1528155460 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdebc078b90 msgr2=0x7fdebc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:10.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.280+0000 7fded6c4d640 1 --2- 172.21.15.105:0/1528155460 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdebc078b90 0x7fdebc07b0a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdec0035000 tx=0x7fdec00046c0 comp rx=0 tx=0).stop 2024-09-21T03:20:10.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.280+0000 7fded6c4d640 1 -- 172.21.15.105:0/1528155460 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdeb8004800 msgr2=0x7fded01f9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:10.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.280+0000 7fded6c4d640 1 --2- 172.21.15.105:0/1528155460 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdeb8004800 0x7fded01f9ae0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdecc011a80 tx=0x7fdecc011e80 comp rx=0 tx=0).stop 2024-09-21T03:20:10.283 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.280+0000 7fded6c4d640 1 -- 172.21.15.105:0/1528155460 shutdown_connections 2024-09-21T03:20:10.283 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.280+0000 7fded6c4d640 1 --2- 172.21.15.105:0/1528155460 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdebc078b90 0x7fdebc07b0a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:10.283 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.280+0000 7fded6c4d640 1 --2- 172.21.15.105:0/1528155460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fded00b6d00 0x7fded00b7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:10.283 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.280+0000 7fded6c4d640 1 --2- 172.21.15.105:0/1528155460 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fded006fc70 0x7fded01589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:10.283 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.280+0000 7fded6c4d640 1 --2- 172.21.15.105:0/1528155460 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdeb8004800 0x7fded01f9ae0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:10.283 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.280+0000 7fded6c4d640 1 -- 172.21.15.105:0/1528155460 >> 172.21.15.105:0/1528155460 conn(0x7fded006d4f0 msgr2=0x7fded00b5320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:10.283 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.281+0000 7fded6c4d640 1 -- 172.21.15.105:0/1528155460 shutdown_connections 2024-09-21T03:20:10.283 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.281+0000 7fded6c4d640 1 -- 172.21.15.105:0/1528155460 wait complete. 2024-09-21T03:20:10.293 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T03:20:10.344 INFO:tasks.ceph.mds.a.smithi105.stdout:starting mds.a at 2024-09-21T03:20:10.410 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.409+0000 7f7a548e5640 1 -- 172.21.15.105:0/1961340521 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a500b0520 msgr2=0x7f7a50071650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:10.411 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.409+0000 7f7a548e5640 1 --2- 172.21.15.105:0/1961340521 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a500b0520 0x7f7a50071650 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7a50075570 tx=0x7f7a3802a5f0 comp rx=0 tx=0).stop 2024-09-21T03:20:10.411 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.409+0000 7f7a548e5640 1 -- 172.21.15.105:0/1961340521 shutdown_connections 2024-09-21T03:20:10.411 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.409+0000 7f7a548e5640 1 --2- 172.21.15.105:0/1961340521 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a500b0520 0x7f7a50071650 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:10.411 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.409+0000 7f7a548e5640 1 --2- 172.21.15.105:0/1961340521 >> v2:172.21.15.162:3300/0 conn(0x7f7a5015b8f0 0x7f7a500cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:10.411 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.409+0000 7f7a548e5640 1 -- 172.21.15.105:0/1961340521 >> 172.21.15.105:0/1961340521 conn(0x7f7a500cdcb0 msgr2=0x7f7a500ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:10.411 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.409+0000 7f7a548e5640 1 -- 172.21.15.105:0/1961340521 shutdown_connections 2024-09-21T03:20:10.411 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.409+0000 7f7a548e5640 1 -- 172.21.15.105:0/1961340521 wait complete. 2024-09-21T03:20:10.412 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.411+0000 7f7a548e5640 1 Processor -- start 2024-09-21T03:20:10.412 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.411+0000 7f7a548e5640 1 -- start start 2024-09-21T03:20:10.415 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.412+0000 7f7a548e5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a500b0520 0x7f7a500b4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:10.415 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.412+0000 7f7a548e5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a500b2cb0 0x7f7a501f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:10.415 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.412+0000 7f7a548e5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a5015b8f0 0x7f7a501f72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:10.415 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.412+0000 7f7a548e5640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7a500ae120 con 0x7f7a5015b8f0 2024-09-21T03:20:10.415 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.412+0000 7f7a548e5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7a500adfa0 con 0x7f7a500b2cb0 2024-09-21T03:20:10.415 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.412+0000 7f7a548e5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7a500ae2a0 con 0x7f7a500b0520 2024-09-21T03:20:10.415 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.412+0000 7f7a4ed9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a5015b8f0 0x7f7a501f72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:10.415 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.412+0000 7f7a4ed9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a5015b8f0 0x7f7a501f72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58552/0 (socket says 172.21.15.105:58552) 2024-09-21T03:20:10.415 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.412+0000 7f7a4ed9d640 1 -- 172.21.15.105:0/3802651093 learned_addr learned my addr 172.21.15.105:0/3802651093 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:10.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.412+0000 7f7a4e59c640 1 --2- 172.21.15.105:0/3802651093 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a500b0520 0x7f7a500b4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:10.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.412+0000 7f7a4ed9d640 1 -- 172.21.15.105:0/3802651093 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a500b0520 msgr2=0x7f7a500b4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:10.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.412+0000 7f7a4ed9d640 1 --2- 172.21.15.105:0/3802651093 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a500b0520 0x7f7a500b4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:10.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.412+0000 7f7a4ed9d640 1 -- 172.21.15.105:0/3802651093 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a500b2cb0 msgr2=0x7f7a501f6da0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T03:20:10.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.412+0000 7f7a4ed9d640 1 --2- 172.21.15.105:0/3802651093 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a500b2cb0 0x7f7a501f6da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:10.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.413+0000 7f7a4ed9d640 1 -- 172.21.15.105:0/3802651093 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a5015b370 con 0x7f7a5015b8f0 2024-09-21T03:20:10.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.413+0000 7f7a4ed9d640 1 --2- 172.21.15.105:0/3802651093 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a5015b8f0 0x7f7a501f72e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7a4800c6c0 tx=0x7f7a4800cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:10.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.413+0000 7f7a46ffd640 1 -- 172.21.15.105:0/3802651093 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a48003b70 con 0x7f7a5015b8f0 2024-09-21T03:20:10.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.413+0000 7f7a46ffd640 1 -- 172.21.15.105:0/3802651093 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7a48003d30 con 0x7f7a5015b8f0 2024-09-21T03:20:10.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.413+0000 7f7a548e5640 1 -- 172.21.15.105:0/3802651093 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a500b5650 con 0x7f7a5015b8f0 2024-09-21T03:20:10.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.413+0000 7f7a46ffd640 1 -- 172.21.15.105:0/3802651093 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a48005330 con 0x7f7a5015b8f0 2024-09-21T03:20:10.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.413+0000 7f7a548e5640 1 -- 172.21.15.105:0/3802651093 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a500c9c00 con 0x7f7a5015b8f0 2024-09-21T03:20:10.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.414+0000 7f7a548e5640 1 -- 172.21.15.105:0/3802651093 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a500aef80 con 0x7f7a5015b8f0 2024-09-21T03:20:10.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.414+0000 7f7a46ffd640 1 -- 172.21.15.105:0/3802651093 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7a480054d0 con 0x7f7a5015b8f0 2024-09-21T03:20:10.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.415+0000 7f7a46ffd640 1 --2- 172.21.15.105:0/3802651093 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7a30078bc0 0x7f7a3007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:10.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.415+0000 7f7a46ffd640 1 -- 172.21.15.105:0/3802651093 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7f7a4809abb0 con 0x7f7a5015b8f0 2024-09-21T03:20:10.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.415+0000 7f7a4e59c640 1 --2- 172.21.15.105:0/3802651093 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7a30078bc0 0x7f7a3007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:10.418 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.416+0000 7f7a4e59c640 1 --2- 172.21.15.105:0/3802651093 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7a30078bc0 0x7f7a3007b0d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7a40005fd0 tx=0x7f7a40005850 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:10.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.420+0000 7f7a46ffd640 1 -- 172.21.15.105:0/3802651093 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7a5015b370 con 0x7f7a5015b8f0 2024-09-21T03:20:10.636 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:10.635+0000 7f7a548e5640 1 -- 172.21.15.105:0/3802651093 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f7a500b53c0 con 0x7f7a5015b8f0 2024-09-21T03:20:11.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.280+0000 7f7a46ffd640 1 -- 172.21.15.105:0/3802651093 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7f7a48062f90 con 0x7f7a5015b8f0 2024-09-21T03:20:11.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.282+0000 7f7a548e5640 1 -- 172.21.15.105:0/3802651093 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7a30078bc0 msgr2=0x7f7a3007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:11.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.282+0000 7f7a548e5640 1 --2- 172.21.15.105:0/3802651093 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7a30078bc0 0x7f7a3007b0d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7a40005fd0 tx=0x7f7a40005850 comp rx=0 tx=0).stop 2024-09-21T03:20:11.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.282+0000 7f7a548e5640 1 -- 172.21.15.105:0/3802651093 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a5015b8f0 msgr2=0x7f7a501f72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:11.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.282+0000 7f7a548e5640 1 --2- 172.21.15.105:0/3802651093 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a5015b8f0 0x7f7a501f72e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7a4800c6c0 tx=0x7f7a4800cb80 comp rx=0 tx=0).stop 2024-09-21T03:20:11.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.282+0000 7f7a548e5640 1 -- 172.21.15.105:0/3802651093 shutdown_connections 2024-09-21T03:20:11.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.282+0000 7f7a548e5640 1 --2- 172.21.15.105:0/3802651093 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7a30078bc0 0x7f7a3007b0d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:11.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.282+0000 7f7a548e5640 1 --2- 172.21.15.105:0/3802651093 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a5015b8f0 0x7f7a501f72e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:11.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.282+0000 7f7a548e5640 1 --2- 172.21.15.105:0/3802651093 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a500b2cb0 0x7f7a501f6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:11.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.282+0000 7f7a548e5640 1 --2- 172.21.15.105:0/3802651093 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a500b0520 0x7f7a500b4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:11.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.282+0000 7f7a548e5640 1 -- 172.21.15.105:0/3802651093 >> 172.21.15.105:0/3802651093 conn(0x7f7a500cdcb0 msgr2=0x7f7a500b0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:11.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.282+0000 7f7a548e5640 1 -- 172.21.15.105:0/3802651093 shutdown_connections 2024-09-21T03:20:11.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.282+0000 7f7a548e5640 1 -- 172.21.15.105:0/3802651093 wait complete. 2024-09-21T03:20:11.295 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T03:20:11.411 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.409+0000 7fe3bb27e640 1 -- 172.21.15.105:0/3741046374 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3b40ca990 msgr2=0x7fe3b40cada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:11.411 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.409+0000 7fe3bb27e640 1 --2- 172.21.15.105:0/3741046374 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3b40ca990 0x7fe3b40cada0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe3b40b2cc0 tx=0x7fe3a402a4d0 comp rx=0 tx=0).stop 2024-09-21T03:20:11.412 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.409+0000 7fe3bb27e640 1 -- 172.21.15.105:0/3741046374 shutdown_connections 2024-09-21T03:20:11.412 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.409+0000 7fe3bb27e640 1 --2- 172.21.15.105:0/3741046374 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3b40ca990 0x7fe3b40cada0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:11.412 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.409+0000 7fe3bb27e640 1 --2- 172.21.15.105:0/3741046374 >> v2:172.21.15.162:3300/0 conn(0x7fe3b40ce2b0 0x7fe3b40af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:11.412 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.409+0000 7fe3bb27e640 1 -- 172.21.15.105:0/3741046374 >> 172.21.15.105:0/3741046374 conn(0x7fe3b40d0130 msgr2=0x7fe3b40d0540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:11.412 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.409+0000 7fe3bb27e640 1 -- 172.21.15.105:0/3741046374 shutdown_connections 2024-09-21T03:20:11.412 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.409+0000 7fe3bb27e640 1 -- 172.21.15.105:0/3741046374 wait complete. 2024-09-21T03:20:11.413 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.411+0000 7fe3bb27e640 1 Processor -- start 2024-09-21T03:20:11.413 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.411+0000 7fe3bb27e640 1 -- start start 2024-09-21T03:20:11.415 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.412+0000 7fe3bb27e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3b40ca990 0x7fe3b415c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:11.415 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.413+0000 7fe3bb27e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3b40ce2b0 0x7fe3b41f92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:11.415 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.413+0000 7fe3bb27e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3b415dd00 0x7fe3b41f59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:11.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.413+0000 7fe3bb27e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b4074420 con 0x7fe3b40ce2b0 2024-09-21T03:20:11.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.413+0000 7fe3bb27e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b40742a0 con 0x7fe3b40ca990 2024-09-21T03:20:11.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.413+0000 7fe3bb27e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe3b40745a0 con 0x7fe3b415dd00 2024-09-21T03:20:11.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.413+0000 7fe3b8819640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3b40ce2b0 0x7fe3b41f92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:11.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.413+0000 7fe3b8819640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3b40ce2b0 0x7fe3b41f92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40744/0 (socket says 172.21.15.105:40744) 2024-09-21T03:20:11.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.413+0000 7fe3b8819640 1 -- 172.21.15.105:0/3662677048 learned_addr learned my addr 172.21.15.105:0/3662677048 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:11.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.413+0000 7fe3b901a640 1 --2- 172.21.15.105:0/3662677048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3b40ca990 0x7fe3b415c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:11.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.413+0000 7fe3b981b640 1 --2- 172.21.15.105:0/3662677048 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3b415dd00 0x7fe3b41f59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:11.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.413+0000 7fe3b8819640 1 -- 172.21.15.105:0/3662677048 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3b415dd00 msgr2=0x7fe3b41f59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:11.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.413+0000 7fe3b8819640 1 --2- 172.21.15.105:0/3662677048 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3b415dd00 0x7fe3b41f59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:11.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.413+0000 7fe3b8819640 1 -- 172.21.15.105:0/3662677048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3b40ca990 msgr2=0x7fe3b415c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:11.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.413+0000 7fe3b8819640 1 --2- 172.21.15.105:0/3662677048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3b40ca990 0x7fe3b415c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:11.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.413+0000 7fe3b8819640 1 -- 172.21.15.105:0/3662677048 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3b40b5f20 con 0x7fe3b40ce2b0 2024-09-21T03:20:11.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.413+0000 7fe3b981b640 1 --2- 172.21.15.105:0/3662677048 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3b415dd00 0x7fe3b41f59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:20:11.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.413+0000 7fe3b8819640 1 --2- 172.21.15.105:0/3662677048 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3b40ce2b0 0x7fe3b41f92c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4034040 tx=0x7fe3a40039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:11.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.413+0000 7fe3a9ffb640 1 -- 172.21.15.105:0/3662677048 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a403e030 con 0x7fe3b40ce2b0 2024-09-21T03:20:11.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.413+0000 7fe3a9ffb640 1 -- 172.21.15.105:0/3662677048 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3a40047a0 con 0x7fe3b40ce2b0 2024-09-21T03:20:11.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.413+0000 7fe3bb27e640 1 -- 172.21.15.105:0/3662677048 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3b40b3950 con 0x7fe3b40ce2b0 2024-09-21T03:20:11.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.413+0000 7fe3a9ffb640 1 -- 172.21.15.105:0/3662677048 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a4035040 con 0x7fe3b40ce2b0 2024-09-21T03:20:11.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.414+0000 7fe3bb27e640 1 -- 172.21.15.105:0/3662677048 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3b40b3df0 con 0x7fe3b40ce2b0 2024-09-21T03:20:11.418 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.415+0000 7fe3bb27e640 1 -- 172.21.15.105:0/3662677048 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3b40af580 con 0x7fe3b40ce2b0 2024-09-21T03:20:11.418 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.415+0000 7fe3a9ffb640 1 -- 172.21.15.105:0/3662677048 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe3a4041030 con 0x7fe3b40ce2b0 2024-09-21T03:20:11.418 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.416+0000 7fe3a9ffb640 1 --2- 172.21.15.105:0/3662677048 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe398078b90 0x7fe39807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:11.418 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.416+0000 7fe3a9ffb640 1 -- 172.21.15.105:0/3662677048 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7fe3a40bb630 con 0x7fe3b40ce2b0 2024-09-21T03:20:11.418 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.416+0000 7fe3b901a640 1 --2- 172.21.15.105:0/3662677048 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe398078b90 0x7fe39807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:11.418 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.417+0000 7fe3b901a640 1 --2- 172.21.15.105:0/3662677048 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe398078b90 0x7fe39807b0a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0005fd0 tx=0x7fe3b0005850 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:11.422 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.420+0000 7fe3a9ffb640 1 -- 172.21.15.105:0/3662677048 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe3a4083a10 con 0x7fe3b40ce2b0 2024-09-21T03:20:11.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:11.599+0000 7fe3bb27e640 1 -- 172.21.15.105:0/3662677048 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe3b40ca740 con 0x7fe3b40ce2b0 2024-09-21T03:20:12.290 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.288+0000 7fe3a9ffb640 1 -- 172.21.15.105:0/3662677048 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v36) ==== 181+0+0 (secure 0 0 0) 0x7fe3a4083310 con 0x7fe3b40ce2b0 2024-09-21T03:20:12.290 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_metadata' removed 2024-09-21T03:20:12.293 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.291+0000 7fe3bb27e640 1 -- 172.21.15.105:0/3662677048 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe398078b90 msgr2=0x7fe39807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:12.293 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.291+0000 7fe3bb27e640 1 --2- 172.21.15.105:0/3662677048 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe398078b90 0x7fe39807b0a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0005fd0 tx=0x7fe3b0005850 comp rx=0 tx=0).stop 2024-09-21T03:20:12.293 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.291+0000 7fe3bb27e640 1 -- 172.21.15.105:0/3662677048 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3b40ce2b0 msgr2=0x7fe3b41f92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:12.293 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.291+0000 7fe3bb27e640 1 --2- 172.21.15.105:0/3662677048 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3b40ce2b0 0x7fe3b41f92c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4034040 tx=0x7fe3a40039e0 comp rx=0 tx=0).stop 2024-09-21T03:20:12.293 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.291+0000 7fe3bb27e640 1 -- 172.21.15.105:0/3662677048 shutdown_connections 2024-09-21T03:20:12.293 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.291+0000 7fe3bb27e640 1 --2- 172.21.15.105:0/3662677048 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe398078b90 0x7fe39807b0a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:12.293 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.291+0000 7fe3bb27e640 1 --2- 172.21.15.105:0/3662677048 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3b415dd00 0x7fe3b41f59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:12.294 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.291+0000 7fe3bb27e640 1 --2- 172.21.15.105:0/3662677048 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3b40ce2b0 0x7fe3b41f92c0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:12.294 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.291+0000 7fe3bb27e640 1 --2- 172.21.15.105:0/3662677048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3b40ca990 0x7fe3b415c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:12.294 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.291+0000 7fe3bb27e640 1 -- 172.21.15.105:0/3662677048 >> 172.21.15.105:0/3662677048 conn(0x7fe3b40d0130 msgr2=0x7fe3b4068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:12.294 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.291+0000 7fe3bb27e640 1 -- 172.21.15.105:0/3662677048 shutdown_connections 2024-09-21T03:20:12.294 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.291+0000 7fe3bb27e640 1 -- 172.21.15.105:0/3662677048 wait complete. 2024-09-21T03:20:12.305 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T03:20:12.423 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.421+0000 7fe0620de640 1 -- 172.21.15.105:0/3082188834 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe05c0b2270 msgr2=0x7fe05c0ccf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:12.423 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.421+0000 7fe0620de640 1 --2- 172.21.15.105:0/3082188834 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe05c0b2270 0x7fe05c0ccf10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe054005fd0 tx=0x7fe05402aa90 comp rx=0 tx=0).stop 2024-09-21T03:20:12.423 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.421+0000 7fe0620de640 1 -- 172.21.15.105:0/3082188834 shutdown_connections 2024-09-21T03:20:12.423 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.421+0000 7fe0620de640 1 --2- 172.21.15.105:0/3082188834 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe05c0b2270 0x7fe05c0ccf10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:12.423 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.421+0000 7fe0620de640 1 --2- 172.21.15.105:0/3082188834 >> v2:172.21.15.162:3300/0 conn(0x7fe05c0b7a00 0x7fe05c0d0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:12.423 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.421+0000 7fe0620de640 1 -- 172.21.15.105:0/3082188834 >> 172.21.15.105:0/3082188834 conn(0x7fe05c0ced80 msgr2=0x7fe05c0cf190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:12.423 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.421+0000 7fe0620de640 1 -- 172.21.15.105:0/3082188834 shutdown_connections 2024-09-21T03:20:12.423 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.421+0000 7fe0620de640 1 -- 172.21.15.105:0/3082188834 wait complete. 2024-09-21T03:20:12.424 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.422+0000 7fe0620de640 1 Processor -- start 2024-09-21T03:20:12.424 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.423+0000 7fe0620de640 1 -- start start 2024-09-21T03:20:12.427 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.424+0000 7fe0620de640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe05c0b2270 0x7fe05c1f37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:12.427 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.424+0000 7fe0620de640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe05c0b7a00 0x7fe05c154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:12.427 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.424+0000 7fe0620de640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe05c0d0e90 0x7fe05c0c67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:12.427 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.424+0000 7fe0620de640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe05c0b18b0 con 0x7fe05c0b7a00 2024-09-21T03:20:12.427 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.424+0000 7fe0620de640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe05c0b1730 con 0x7fe05c0d0e90 2024-09-21T03:20:12.427 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.424+0000 7fe0620de640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe05c0b2680 con 0x7fe05c0b2270 2024-09-21T03:20:12.427 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.424+0000 7fe05affd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe05c0b7a00 0x7fe05c154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:12.427 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.424+0000 7fe05affd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe05c0b7a00 0x7fe05c154710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40756/0 (socket says 172.21.15.105:40756) 2024-09-21T03:20:12.427 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.424+0000 7fe05affd640 1 -- 172.21.15.105:0/2170412608 learned_addr learned my addr 172.21.15.105:0/2170412608 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:12.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.424+0000 7fe05b7fe640 1 --2- 172.21.15.105:0/2170412608 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe05c0b2270 0x7fe05c1f37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:12.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.424+0000 7fe05affd640 1 -- 172.21.15.105:0/2170412608 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe05c0b2270 msgr2=0x7fe05c1f37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:12.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.424+0000 7fe05affd640 1 --2- 172.21.15.105:0/2170412608 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe05c0b2270 0x7fe05c1f37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:12.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.424+0000 7fe05affd640 1 -- 172.21.15.105:0/2170412608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe05c0d0e90 msgr2=0x7fe05c0c67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:12.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.424+0000 7fe05affd640 1 --2- 172.21.15.105:0/2170412608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe05c0d0e90 0x7fe05c0c67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:12.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.424+0000 7fe05affd640 1 -- 172.21.15.105:0/2170412608 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe05c09eef0 con 0x7fe05c0b7a00 2024-09-21T03:20:12.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.424+0000 7fe05b7fe640 1 --2- 172.21.15.105:0/2170412608 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe05c0b2270 0x7fe05c1f37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:20:12.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.425+0000 7fe05affd640 1 --2- 172.21.15.105:0/2170412608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe05c0b7a00 0x7fe05c154710 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe05000c390 tx=0x7fe05000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:12.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.425+0000 7fe043fff640 1 -- 172.21.15.105:0/2170412608 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe050017070 con 0x7fe05c0b7a00 2024-09-21T03:20:12.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.425+0000 7fe043fff640 1 -- 172.21.15.105:0/2170412608 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe0500053c0 con 0x7fe05c0b7a00 2024-09-21T03:20:12.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.425+0000 7fe0620de640 1 -- 172.21.15.105:0/2170412608 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe05c09f1d0 con 0x7fe05c0b7a00 2024-09-21T03:20:12.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.425+0000 7fe0620de640 1 -- 172.21.15.105:0/2170412608 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe05c09f790 con 0x7fe05c0b7a00 2024-09-21T03:20:12.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.425+0000 7fe043fff640 1 -- 172.21.15.105:0/2170412608 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe050003850 con 0x7fe05c0b7a00 2024-09-21T03:20:12.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.426+0000 7fe0620de640 1 -- 172.21.15.105:0/2170412608 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe05c09ec60 con 0x7fe05c0b7a00 2024-09-21T03:20:12.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.427+0000 7fe043fff640 1 -- 172.21.15.105:0/2170412608 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe05001a070 con 0x7fe05c0b7a00 2024-09-21T03:20:12.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.427+0000 7fe043fff640 1 --2- 172.21.15.105:0/2170412608 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe048078b90 0x7fe04807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:12.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.427+0000 7fe043fff640 1 -- 172.21.15.105:0/2170412608 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5357+0+0 (secure 0 0 0) 0x7fe050099fb0 con 0x7fe05c0b7a00 2024-09-21T03:20:12.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.427+0000 7fe05b7fe640 1 --2- 172.21.15.105:0/2170412608 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe048078b90 0x7fe04807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:12.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.428+0000 7fe05b7fe640 1 --2- 172.21.15.105:0/2170412608 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe048078b90 0x7fe04807b0a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe04c009b80 tx=0x7fe04c005f30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:12.433 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.432+0000 7fe043fff640 1 -- 172.21.15.105:0/2170412608 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe0500624c0 con 0x7fe05c0b7a00 2024-09-21T03:20:12.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:12.608+0000 7fe0620de640 1 -- 172.21.15.105:0/2170412608 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe05c06a710 con 0x7fe05c0b7a00 2024-09-21T03:20:13.292 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.290+0000 7fe043fff640 1 -- 172.21.15.105:0/2170412608 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v37) ==== 169+0+0 (secure 0 0 0) 0x7fe05c06a710 con 0x7fe05c0b7a00 2024-09-21T03:20:13.292 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_data' removed 2024-09-21T03:20:13.297 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.294+0000 7fe0620de640 1 -- 172.21.15.105:0/2170412608 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe048078b90 msgr2=0x7fe04807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:13.297 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.294+0000 7fe0620de640 1 --2- 172.21.15.105:0/2170412608 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe048078b90 0x7fe04807b0a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe04c009b80 tx=0x7fe04c005f30 comp rx=0 tx=0).stop 2024-09-21T03:20:13.297 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.294+0000 7fe0620de640 1 -- 172.21.15.105:0/2170412608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe05c0b7a00 msgr2=0x7fe05c154710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:13.297 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.294+0000 7fe0620de640 1 --2- 172.21.15.105:0/2170412608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe05c0b7a00 0x7fe05c154710 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe05000c390 tx=0x7fe05000c850 comp rx=0 tx=0).stop 2024-09-21T03:20:13.298 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.294+0000 7fe0620de640 1 -- 172.21.15.105:0/2170412608 shutdown_connections 2024-09-21T03:20:13.298 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.294+0000 7fe0620de640 1 --2- 172.21.15.105:0/2170412608 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe048078b90 0x7fe04807b0a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:13.298 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.294+0000 7fe0620de640 1 --2- 172.21.15.105:0/2170412608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe05c0d0e90 0x7fe05c0c67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:13.298 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.294+0000 7fe0620de640 1 --2- 172.21.15.105:0/2170412608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe05c0b7a00 0x7fe05c154710 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:13.298 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.294+0000 7fe0620de640 1 --2- 172.21.15.105:0/2170412608 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe05c0b2270 0x7fe05c1f37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:13.298 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.294+0000 7fe0620de640 1 -- 172.21.15.105:0/2170412608 >> 172.21.15.105:0/2170412608 conn(0x7fe05c0ced80 msgr2=0x7fe05c0b70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:13.299 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.295+0000 7fe0620de640 1 -- 172.21.15.105:0/2170412608 shutdown_connections 2024-09-21T03:20:13.299 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.295+0000 7fe0620de640 1 -- 172.21.15.105:0/2170412608 wait complete. 2024-09-21T03:20:13.311 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-21T03:20:13.427 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.425+0000 7fd95ff82640 1 -- 172.21.15.105:0/744121094 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9580cf440 msgr2=0x7fd95815c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:13.427 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.425+0000 7fd95ff82640 1 --2- 172.21.15.105:0/744121094 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9580cf440 0x7fd95815c6a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd948009830 tx=0x7fd94802a480 comp rx=0 tx=0).stop 2024-09-21T03:20:13.427 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.425+0000 7fd95ff82640 1 -- 172.21.15.105:0/744121094 shutdown_connections 2024-09-21T03:20:13.427 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.425+0000 7fd95ff82640 1 --2- 172.21.15.105:0/744121094 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9580b7fe0 0x7fd9580d0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:13.427 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.425+0000 7fd95ff82640 1 --2- 172.21.15.105:0/744121094 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9580cf440 0x7fd95815c6a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:13.427 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.425+0000 7fd95ff82640 1 -- 172.21.15.105:0/744121094 >> 172.21.15.105:0/744121094 conn(0x7fd9580710b0 msgr2=0x7fd9580714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:13.427 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.425+0000 7fd95ff82640 1 -- 172.21.15.105:0/744121094 shutdown_connections 2024-09-21T03:20:13.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.425+0000 7fd95ff82640 1 -- 172.21.15.105:0/744121094 wait complete. 2024-09-21T03:20:13.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.427+0000 7fd95ff82640 1 Processor -- start 2024-09-21T03:20:13.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.427+0000 7fd95ff82640 1 -- start start 2024-09-21T03:20:13.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.428+0000 7fd95ff82640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9580b7fe0 0x7fd958156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:13.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.428+0000 7fd95ff82640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9580cd360 0x7fd9581558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:13.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.428+0000 7fd95ff82640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd958156130 0x7fd9580cae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:13.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.428+0000 7fd95ff82640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd9580d0c50 con 0x7fd9580cd360 2024-09-21T03:20:13.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.428+0000 7fd95ff82640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd9580d0ad0 con 0x7fd958156130 2024-09-21T03:20:13.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.428+0000 7fd95ff82640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd9580d0dd0 con 0x7fd9580b7fe0 2024-09-21T03:20:13.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.428+0000 7fd95d51d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9580cd360 0x7fd9581558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:13.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.428+0000 7fd95d51d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9580cd360 0x7fd9581558f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40768/0 (socket says 172.21.15.105:40768) 2024-09-21T03:20:13.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.428+0000 7fd95d51d640 1 -- 172.21.15.105:0/3018322835 learned_addr learned my addr 172.21.15.105:0/3018322835 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:13.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.428+0000 7fd95e51f640 1 --2- 172.21.15.105:0/3018322835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd958156130 0x7fd9580cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:13.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.428+0000 7fd95dd1e640 1 --2- 172.21.15.105:0/3018322835 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9580b7fe0 0x7fd958156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:13.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.429+0000 7fd95d51d640 1 -- 172.21.15.105:0/3018322835 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9580b7fe0 msgr2=0x7fd958156fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:13.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.429+0000 7fd95d51d640 1 --2- 172.21.15.105:0/3018322835 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9580b7fe0 0x7fd958156fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:13.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.429+0000 7fd95d51d640 1 -- 172.21.15.105:0/3018322835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd958156130 msgr2=0x7fd9580cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:13.433 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.429+0000 7fd95d51d640 1 --2- 172.21.15.105:0/3018322835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd958156130 0x7fd9580cae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:13.433 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.429+0000 7fd95d51d640 1 -- 172.21.15.105:0/3018322835 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9581f7a50 con 0x7fd9580cd360 2024-09-21T03:20:13.433 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.429+0000 7fd95d51d640 1 --2- 172.21.15.105:0/3018322835 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9580cd360 0x7fd9581558f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd948009950 tx=0x7fd948033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:13.433 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.429+0000 7fd94e7fc640 1 -- 172.21.15.105:0/3018322835 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd948031d60 con 0x7fd9580cd360 2024-09-21T03:20:13.433 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.429+0000 7fd94e7fc640 1 -- 172.21.15.105:0/3018322835 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd948033e10 con 0x7fd9580cd360 2024-09-21T03:20:13.433 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.429+0000 7fd95ff82640 1 -- 172.21.15.105:0/3018322835 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd958159c60 con 0x7fd9580cd360 2024-09-21T03:20:13.433 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.429+0000 7fd94e7fc640 1 -- 172.21.15.105:0/3018322835 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd948005260 con 0x7fd9580cd360 2024-09-21T03:20:13.433 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.429+0000 7fd95ff82640 1 -- 172.21.15.105:0/3018322835 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd95815a220 con 0x7fd9580cd360 2024-09-21T03:20:13.433 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.430+0000 7fd95ff82640 1 -- 172.21.15.105:0/3018322835 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9580d12f0 con 0x7fd9580cd360 2024-09-21T03:20:13.434 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.431+0000 7fd94e7fc640 1 -- 172.21.15.105:0/3018322835 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd948005400 con 0x7fd9580cd360 2024-09-21T03:20:13.434 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.431+0000 7fd94e7fc640 1 --2- 172.21.15.105:0/3018322835 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd93c078b90 0x7fd93c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:13.434 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.431+0000 7fd94e7fc640 1 -- 172.21.15.105:0/3018322835 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fd9480bba60 con 0x7fd9580cd360 2024-09-21T03:20:13.434 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.431+0000 7fd95dd1e640 1 --2- 172.21.15.105:0/3018322835 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd93c078b90 0x7fd93c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:13.434 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.432+0000 7fd95dd1e640 1 --2- 172.21.15.105:0/3018322835 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd93c078b90 0x7fd93c07b0a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd9540015e0 tx=0x7fd954009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:13.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.436+0000 7fd94e7fc640 1 -- 172.21.15.105:0/3018322835 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd94803f030 con 0x7fd9580cd360 2024-09-21T03:20:13.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.612+0000 7fd95ff82640 1 -- 172.21.15.105:0/3018322835 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7fd958160480 con 0x7fd9580cd360 2024-09-21T03:20:13.617 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.616+0000 7fd94e7fc640 1 -- 172.21.15.105:0/3018322835 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v35) ==== 71+0+0 (secure 0 0 0) 0x7fd9480842c0 con 0x7fd9580cd360 2024-09-21T03:20:13.620 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.618+0000 7fd95ff82640 1 -- 172.21.15.105:0/3018322835 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd93c078b90 msgr2=0x7fd93c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:13.620 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.618+0000 7fd95ff82640 1 --2- 172.21.15.105:0/3018322835 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd93c078b90 0x7fd93c07b0a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd9540015e0 tx=0x7fd954009040 comp rx=0 tx=0).stop 2024-09-21T03:20:13.621 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.618+0000 7fd95ff82640 1 -- 172.21.15.105:0/3018322835 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9580cd360 msgr2=0x7fd9581558f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:13.621 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.618+0000 7fd95ff82640 1 --2- 172.21.15.105:0/3018322835 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9580cd360 0x7fd9581558f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd948009950 tx=0x7fd948033c20 comp rx=0 tx=0).stop 2024-09-21T03:20:13.621 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.618+0000 7fd95ff82640 1 -- 172.21.15.105:0/3018322835 shutdown_connections 2024-09-21T03:20:13.621 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.618+0000 7fd95ff82640 1 --2- 172.21.15.105:0/3018322835 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd93c078b90 0x7fd93c07b0a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:13.621 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.618+0000 7fd95ff82640 1 --2- 172.21.15.105:0/3018322835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd958156130 0x7fd9580cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:13.621 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.618+0000 7fd95ff82640 1 --2- 172.21.15.105:0/3018322835 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9580cd360 0x7fd9581558f0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:13.621 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.618+0000 7fd95ff82640 1 --2- 172.21.15.105:0/3018322835 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9580b7fe0 0x7fd958156fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:13.621 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.618+0000 7fd95ff82640 1 -- 172.21.15.105:0/3018322835 >> 172.21.15.105:0/3018322835 conn(0x7fd9580710b0 msgr2=0x7fd9580714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:13.622 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.618+0000 7fd95ff82640 1 -- 172.21.15.105:0/3018322835 shutdown_connections 2024-09-21T03:20:13.622 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.618+0000 7fd95ff82640 1 -- 172.21.15.105:0/3018322835 wait complete. 2024-09-21T03:20:13.631 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_cap_acquisition_throttle_readdir' 2024-09-21T03:20:13.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.752+0000 7fa2f28bd640 1 -- 172.21.15.105:0/2393566721 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2ec0ceef0 msgr2=0x7fa2ec0cf300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:13.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.752+0000 7fa2f28bd640 1 --2- 172.21.15.105:0/2393566721 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2ec0ceef0 0x7fa2ec0cf300 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0009830 tx=0x7fa2e002a3f0 comp rx=0 tx=0).stop 2024-09-21T03:20:13.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.752+0000 7fa2f28bd640 1 -- 172.21.15.105:0/2393566721 shutdown_connections 2024-09-21T03:20:13.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.752+0000 7fa2f28bd640 1 --2- 172.21.15.105:0/2393566721 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2ec0ceef0 0x7fa2ec0cf300 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:13.755 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.752+0000 7fa2f28bd640 1 --2- 172.21.15.105:0/2393566721 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2ec0ca760 0x7fa2ec15ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:13.755 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.752+0000 7fa2f28bd640 1 -- 172.21.15.105:0/2393566721 >> 172.21.15.105:0/2393566721 conn(0x7fa2ec0cd670 msgr2=0x7fa2ec0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:13.755 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.752+0000 7fa2f28bd640 1 -- 172.21.15.105:0/2393566721 shutdown_connections 2024-09-21T03:20:13.755 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.752+0000 7fa2f28bd640 1 -- 172.21.15.105:0/2393566721 wait complete. 2024-09-21T03:20:13.755 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.754+0000 7fa2f28bd640 1 Processor -- start 2024-09-21T03:20:13.756 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.754+0000 7fa2f28bd640 1 -- start start 2024-09-21T03:20:13.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.755+0000 7fa2f28bd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2ec0ca760 0x7fa2ec156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:13.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.755+0000 7fa2f28bd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2ec0ceef0 0x7fa2ec15a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:13.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.755+0000 7fa2f28bd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2ec0cf840 0x7fa2ec15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:13.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.755+0000 7fa2f28bd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa2ec06f9a0 con 0x7fa2ec0ca760 2024-09-21T03:20:13.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.755+0000 7fa2f28bd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa2ec06f820 con 0x7fa2ec0cf840 2024-09-21T03:20:13.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.755+0000 7fa2f28bd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa2ec165cf0 con 0x7fa2ec0ceef0 2024-09-21T03:20:13.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.756+0000 7fa2ebfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2ec0ca760 0x7fa2ec156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:13.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.756+0000 7fa2ebfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2ec0ca760 0x7fa2ec156f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40788/0 (socket says 172.21.15.105:40788) 2024-09-21T03:20:13.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.756+0000 7fa2ebfff640 1 -- 172.21.15.105:0/321474523 learned_addr learned my addr 172.21.15.105:0/321474523 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:13.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.756+0000 7fa2f0e5a640 1 --2- 172.21.15.105:0/321474523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2ec0cf840 0x7fa2ec15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:13.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.756+0000 7fa2eb7fe640 1 --2- 172.21.15.105:0/321474523 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2ec0ceef0 0x7fa2ec15a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:13.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.756+0000 7fa2ebfff640 1 -- 172.21.15.105:0/321474523 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2ec0ceef0 msgr2=0x7fa2ec15a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:13.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.756+0000 7fa2ebfff640 1 --2- 172.21.15.105:0/321474523 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2ec0ceef0 0x7fa2ec15a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:13.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.756+0000 7fa2ebfff640 1 -- 172.21.15.105:0/321474523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2ec0cf840 msgr2=0x7fa2ec15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:13.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.756+0000 7fa2ebfff640 1 --2- 172.21.15.105:0/321474523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2ec0cf840 0x7fa2ec15a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:13.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.756+0000 7fa2ebfff640 1 -- 172.21.15.105:0/321474523 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2ec0c7c90 con 0x7fa2ec0ca760 2024-09-21T03:20:13.760 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.756+0000 7fa2f0e5a640 1 --2- 172.21.15.105:0/321474523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2ec0cf840 0x7fa2ec15a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:20:13.760 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.756+0000 7fa2eb7fe640 1 --2- 172.21.15.105:0/321474523 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2ec0ceef0 0x7fa2ec15a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:20:13.760 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.756+0000 7fa2ebfff640 1 --2- 172.21.15.105:0/321474523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2ec0ca760 0x7fa2ec156f10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc00d740 tx=0x7fa2dc00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:13.760 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.756+0000 7fa2e8ff9640 1 -- 172.21.15.105:0/321474523 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc017070 con 0x7fa2ec0ca760 2024-09-21T03:20:13.760 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.756+0000 7fa2e8ff9640 1 -- 172.21.15.105:0/321474523 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa2dc009d20 con 0x7fa2ec0ca760 2024-09-21T03:20:13.760 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.756+0000 7fa2f28bd640 1 -- 172.21.15.105:0/321474523 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2ec0b30c0 con 0x7fa2ec0ca760 2024-09-21T03:20:13.760 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.756+0000 7fa2e8ff9640 1 -- 172.21.15.105:0/321474523 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc0106c0 con 0x7fa2ec0ca760 2024-09-21T03:20:13.760 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.756+0000 7fa2f28bd640 1 -- 172.21.15.105:0/321474523 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2ec0b3680 con 0x7fa2ec0ca760 2024-09-21T03:20:13.761 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.757+0000 7fa2f28bd640 1 -- 172.21.15.105:0/321474523 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2ec15ad70 con 0x7fa2ec0ca760 2024-09-21T03:20:13.761 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.758+0000 7fa2e8ff9640 1 -- 172.21.15.105:0/321474523 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa2dc01a070 con 0x7fa2ec0ca760 2024-09-21T03:20:13.761 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.758+0000 7fa2e8ff9640 1 --2- 172.21.15.105:0/321474523 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa2d8078b90 0x7fa2d807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:13.761 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.759+0000 7fa2e8ff9640 1 -- 172.21.15.105:0/321474523 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fa2dc09ac80 con 0x7fa2ec0ca760 2024-09-21T03:20:13.761 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.759+0000 7fa2eb7fe640 1 --2- 172.21.15.105:0/321474523 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa2d8078b90 0x7fa2d807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:13.761 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.760+0000 7fa2eb7fe640 1 --2- 172.21.15.105:0/321474523 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa2d8078b90 0x7fa2d807b0a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0034000 tx=0x7fa2e0004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:13.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:13.763+0000 7fa2e8ff9640 1 -- 172.21.15.105:0/321474523 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa2dc063340 con 0x7fa2ec0ca760 2024-09-21T03:20:14.011 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.010+0000 7fa2f28bd640 1 -- 172.21.15.105:0/321474523 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_cap_acquisition_throttle_readdir"]} v 0) -- 0x7fa2ec0b6090 con 0x7fa2ec0ca760 2024-09-21T03:20:14.298 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.296+0000 7fa2e8ff9640 1 -- 172.21.15.105:0/321474523 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_cap_acquisition_throttle_readdir"]}]=0 v103) ==== 165+0+0 (secure 0 0 0) 0x7fa2dc062c40 con 0x7fa2ec0ca760 2024-09-21T03:20:14.301 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.299+0000 7fa2f28bd640 1 -- 172.21.15.105:0/321474523 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa2d8078b90 msgr2=0x7fa2d807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:14.301 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.299+0000 7fa2f28bd640 1 --2- 172.21.15.105:0/321474523 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa2d8078b90 0x7fa2d807b0a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0034000 tx=0x7fa2e0004730 comp rx=0 tx=0).stop 2024-09-21T03:20:14.301 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.299+0000 7fa2f28bd640 1 -- 172.21.15.105:0/321474523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2ec0ca760 msgr2=0x7fa2ec156f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:14.301 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.299+0000 7fa2f28bd640 1 --2- 172.21.15.105:0/321474523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2ec0ca760 0x7fa2ec156f10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc00d740 tx=0x7fa2dc00dc00 comp rx=0 tx=0).stop 2024-09-21T03:20:14.301 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.299+0000 7fa2f28bd640 1 -- 172.21.15.105:0/321474523 shutdown_connections 2024-09-21T03:20:14.301 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.299+0000 7fa2f28bd640 1 --2- 172.21.15.105:0/321474523 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa2d8078b90 0x7fa2d807b0a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:14.301 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.299+0000 7fa2f28bd640 1 --2- 172.21.15.105:0/321474523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2ec0cf840 0x7fa2ec15a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:14.301 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.299+0000 7fa2f28bd640 1 --2- 172.21.15.105:0/321474523 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2ec0ceef0 0x7fa2ec15a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:14.301 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.299+0000 7fa2f28bd640 1 --2- 172.21.15.105:0/321474523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2ec0ca760 0x7fa2ec156f10 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:14.301 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.299+0000 7fa2f28bd640 1 -- 172.21.15.105:0/321474523 >> 172.21.15.105:0/321474523 conn(0x7fa2ec0cd670 msgr2=0x7fa2ec06ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:14.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.299+0000 7fa2f28bd640 1 -- 172.21.15.105:0/321474523 shutdown_connections 2024-09-21T03:20:14.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.299+0000 7fa2f28bd640 1 -- 172.21.15.105:0/321474523 wait complete. 2024-09-21T03:20:14.312 INFO:tasks.cephfs_test_runner:Mostly readdir acquires caps faster than the mds recalls, so the cap ... ok 2024-09-21T03:20:14.312 INFO:tasks.cephfs_test_runner:Starting test: test_client_blocklisted_oldest_tid (tasks.cephfs.test_client_limits.TestClientLimits) that a client is blocklisted when its encoded session metadata exceeds the 2024-09-21T03:20:14.312 INFO:tasks.cephfs_test_runner:test_client_blocklisted_oldest_tid (tasks.cephfs.test_client_limits.TestClientLimits) 2024-09-21T03:20:14.312 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:20:14.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.423+0000 7f87fe007640 1 -- 172.21.15.105:0/632803928 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87f80b4090 msgr2=0x7f87f80b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:14.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.423+0000 7f87fe007640 1 --2- 172.21.15.105:0/632803928 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87f80b4090 0x7f87f80b3550 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f87f815f310 tx=0x7f87e802a580 comp rx=0 tx=0).stop 2024-09-21T03:20:14.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.423+0000 7f87fe007640 1 -- 172.21.15.105:0/632803928 shutdown_connections 2024-09-21T03:20:14.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.423+0000 7f87fe007640 1 --2- 172.21.15.105:0/632803928 >> v2:172.21.15.162:3300/0 conn(0x7f87f806fec0 0x7f87f80702d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:14.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.423+0000 7f87fe007640 1 --2- 172.21.15.105:0/632803928 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87f80b4090 0x7f87f80b3550 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:14.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.423+0000 7f87fe007640 1 -- 172.21.15.105:0/632803928 >> 172.21.15.105:0/632803928 conn(0x7f87f80cdcc0 msgr2=0x7f87f80ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:14.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.423+0000 7f87fe007640 1 -- 172.21.15.105:0/632803928 shutdown_connections 2024-09-21T03:20:14.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.423+0000 7f87fe007640 1 -- 172.21.15.105:0/632803928 wait complete. 2024-09-21T03:20:14.426 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.425+0000 7f87fe007640 1 Processor -- start 2024-09-21T03:20:14.426 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.425+0000 7f87fe007640 1 -- start start 2024-09-21T03:20:14.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.426+0000 7f87fe007640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87f806fec0 0x7f87f80cce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:14.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.426+0000 7f87fe007640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87f80b4090 0x7f87f80ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:14.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.426+0000 7f87fe007640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87f80cfeb0 0x7f87f80c9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:14.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.426+0000 7f87fe007640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f87f80b4a30 con 0x7f87f80b4090 2024-09-21T03:20:14.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.426+0000 7f87fe007640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f87f80b48b0 con 0x7f87f80cfeb0 2024-09-21T03:20:14.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.426+0000 7f87fe007640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f87f80b4bb0 con 0x7f87f806fec0 2024-09-21T03:20:14.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.426+0000 7f87f6ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87f80b4090 0x7f87f80ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:14.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.426+0000 7f87f6ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87f80b4090 0x7f87f80ca7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40802/0 (socket says 172.21.15.105:40802) 2024-09-21T03:20:14.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.426+0000 7f87f6ffd640 1 -- 172.21.15.105:0/2988249194 learned_addr learned my addr 172.21.15.105:0/2988249194 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:14.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.427+0000 7f87f7fff640 1 --2- 172.21.15.105:0/2988249194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87f80cfeb0 0x7f87f80c9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:14.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.427+0000 7f87f77fe640 1 --2- 172.21.15.105:0/2988249194 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87f806fec0 0x7f87f80cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:14.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.427+0000 7f87f6ffd640 1 -- 172.21.15.105:0/2988249194 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87f806fec0 msgr2=0x7f87f80cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:14.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.427+0000 7f87f6ffd640 1 --2- 172.21.15.105:0/2988249194 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87f806fec0 0x7f87f80cce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:14.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.427+0000 7f87f6ffd640 1 -- 172.21.15.105:0/2988249194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87f80cfeb0 msgr2=0x7f87f80c9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:14.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.427+0000 7f87f6ffd640 1 --2- 172.21.15.105:0/2988249194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87f80cfeb0 0x7f87f80c9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:14.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.427+0000 7f87f6ffd640 1 -- 172.21.15.105:0/2988249194 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f80cbd70 con 0x7f87f80b4090 2024-09-21T03:20:14.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.427+0000 7f87f6ffd640 1 --2- 172.21.15.105:0/2988249194 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87f80b4090 0x7f87f80ca7d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f87ec00b440 tx=0x7f87ec009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:14.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.427+0000 7f87dffff640 1 -- 172.21.15.105:0/2988249194 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ec015020 con 0x7f87f80b4090 2024-09-21T03:20:14.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.427+0000 7f87dffff640 1 -- 172.21.15.105:0/2988249194 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f87ec011920 con 0x7f87f80b4090 2024-09-21T03:20:14.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.427+0000 7f87fe007640 1 -- 172.21.15.105:0/2988249194 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87f80cc050 con 0x7f87f80b4090 2024-09-21T03:20:14.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.427+0000 7f87dffff640 1 -- 172.21.15.105:0/2988249194 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ec011d70 con 0x7f87f80b4090 2024-09-21T03:20:14.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.427+0000 7f87fe007640 1 -- 172.21.15.105:0/2988249194 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87f80cc610 con 0x7f87f80b4090 2024-09-21T03:20:14.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.428+0000 7f87fe007640 1 -- 172.21.15.105:0/2988249194 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87f80b5130 con 0x7f87f80b4090 2024-09-21T03:20:14.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.429+0000 7f87dffff640 1 -- 172.21.15.105:0/2988249194 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f87ec018020 con 0x7f87f80b4090 2024-09-21T03:20:14.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.429+0000 7f87dffff640 1 --2- 172.21.15.105:0/2988249194 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f87e4078b90 0x7f87e407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:14.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.429+0000 7f87dffff640 1 -- 172.21.15.105:0/2988249194 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f87ec09a910 con 0x7f87f80b4090 2024-09-21T03:20:14.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.429+0000 7f87f77fe640 1 --2- 172.21.15.105:0/2988249194 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f87e4078b90 0x7f87e407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:14.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.430+0000 7f87f77fe640 1 --2- 172.21.15.105:0/2988249194 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f87e4078b90 0x7f87e407b0a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f87e8033000 tx=0x7f87e8004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:14.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.434+0000 7f87dffff640 1 -- 172.21.15.105:0/2988249194 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f87ec01f020 con 0x7f87f80b4090 2024-09-21T03:20:14.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.612+0000 7f87fe007640 1 -- 172.21.15.105:0/2988249194 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f87f80b16a0 con 0x7f87f80b4090 2024-09-21T03:20:14.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.612+0000 7f87dffff640 1 -- 172.21.15.105:0/2988249194 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+13106 (secure 0 0 0) 0x7f87ec0630e0 con 0x7f87f80b4090 2024-09-21T03:20:14.614 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:20:14.614 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":37,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:20:13.289600+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.105:6835/1732564681":"2024-09-22T03:20:10.277618+0000","172.21.15.105:6833/1732564681":"2024-09-22T03:20:10.277618+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:20:14.617 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.615+0000 7f87fe007640 1 -- 172.21.15.105:0/2988249194 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f87e4078b90 msgr2=0x7f87e407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:14.617 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.615+0000 7f87fe007640 1 --2- 172.21.15.105:0/2988249194 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f87e4078b90 0x7f87e407b0a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f87e8033000 tx=0x7f87e8004730 comp rx=0 tx=0).stop 2024-09-21T03:20:14.617 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.615+0000 7f87fe007640 1 -- 172.21.15.105:0/2988249194 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87f80b4090 msgr2=0x7f87f80ca7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:14.617 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.615+0000 7f87fe007640 1 --2- 172.21.15.105:0/2988249194 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87f80b4090 0x7f87f80ca7d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f87ec00b440 tx=0x7f87ec009f90 comp rx=0 tx=0).stop 2024-09-21T03:20:14.617 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.615+0000 7f87fe007640 1 -- 172.21.15.105:0/2988249194 shutdown_connections 2024-09-21T03:20:14.617 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.615+0000 7f87fe007640 1 --2- 172.21.15.105:0/2988249194 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f87e4078b90 0x7f87e407b0a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:14.617 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.615+0000 7f87fe007640 1 --2- 172.21.15.105:0/2988249194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87f80cfeb0 0x7f87f80c9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:14.617 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.615+0000 7f87fe007640 1 --2- 172.21.15.105:0/2988249194 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87f80b4090 0x7f87f80ca7d0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:14.617 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.615+0000 7f87fe007640 1 --2- 172.21.15.105:0/2988249194 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87f806fec0 0x7f87f80cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:14.617 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.615+0000 7f87fe007640 1 -- 172.21.15.105:0/2988249194 >> 172.21.15.105:0/2988249194 conn(0x7f87f80cdcc0 msgr2=0x7f87f80ae3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:14.617 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.615+0000 7f87fe007640 1 -- 172.21.15.105:0/2988249194 shutdown_connections 2024-09-21T03:20:14.617 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.615+0000 7f87fe007640 1 -- 172.21.15.105:0/2988249194 wait complete. 2024-09-21T03:20:14.631 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T03:18:19.296947+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T03:20:14.631 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T03:20:14.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.752+0000 7fa509752640 1 -- 172.21.15.105:0/1683450499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5040ceb40 msgr2=0x7fa5040cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:14.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.752+0000 7fa509752640 1 --2- 172.21.15.105:0/1683450499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5040ceb40 0x7fa5040cef50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc005fd0 tx=0x7fa4fc02a820 comp rx=0 tx=0).stop 2024-09-21T03:20:14.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.752+0000 7fa509752640 1 -- 172.21.15.105:0/1683450499 shutdown_connections 2024-09-21T03:20:14.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.752+0000 7fa509752640 1 --2- 172.21.15.105:0/1683450499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5040ceb40 0x7fa5040cef50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:14.760 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.752+0000 7fa509752640 1 --2- 172.21.15.105:0/1683450499 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa50406e170 0x7fa5040b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:14.760 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.752+0000 7fa509752640 1 -- 172.21.15.105:0/1683450499 >> 172.21.15.105:0/1683450499 conn(0x7fa50408bfc0 msgr2=0x7fa50409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:14.760 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.752+0000 7fa509752640 1 -- 172.21.15.105:0/1683450499 shutdown_connections 2024-09-21T03:20:14.760 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.752+0000 7fa509752640 1 -- 172.21.15.105:0/1683450499 wait complete. 2024-09-21T03:20:14.761 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.754+0000 7fa509752640 1 Processor -- start 2024-09-21T03:20:14.761 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.754+0000 7fa509752640 1 -- start start 2024-09-21T03:20:14.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.755+0000 7fa509752640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa50406f4b0 0x7fa50414dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:14.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.755+0000 7fa509752640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5040ceb40 0x7fa5041e8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:14.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.755+0000 7fa509752640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa50415f480 0x7fa5041e92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:14.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.755+0000 7fa509752640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa5040d0e60 con 0x7fa5040ceb40 2024-09-21T03:20:14.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.755+0000 7fa509752640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa5040d0ce0 con 0x7fa50406f4b0 2024-09-21T03:20:14.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.756+0000 7fa509752640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa5040d0fe0 con 0x7fa50415f480 2024-09-21T03:20:14.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.756+0000 7fa4fa7fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5040ceb40 0x7fa5041e8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:14.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.756+0000 7fa4fa7fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5040ceb40 0x7fa5041e8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40808/0 (socket says 172.21.15.105:40808) 2024-09-21T03:20:14.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.756+0000 7fa4fa7fc640 1 -- 172.21.15.105:0/3021610868 learned_addr learned my addr 172.21.15.105:0/3021610868 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:14.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.756+0000 7fa5037fe640 1 --2- 172.21.15.105:0/3021610868 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa50415f480 0x7fa5041e92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:14.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.756+0000 7fa4fa7fc640 1 -- 172.21.15.105:0/3021610868 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa50415f480 msgr2=0x7fa5041e92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:14.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.756+0000 7fa4fa7fc640 1 --2- 172.21.15.105:0/3021610868 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa50415f480 0x7fa5041e92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:14.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.756+0000 7fa4fa7fc640 1 -- 172.21.15.105:0/3021610868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa50406f4b0 msgr2=0x7fa50414dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:14.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.756+0000 7fa4fa7fc640 1 --2- 172.21.15.105:0/3021610868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa50406f4b0 0x7fa50414dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:14.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.756+0000 7fa4fa7fc640 1 -- 172.21.15.105:0/3021610868 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5041e8300 con 0x7fa5040ceb40 2024-09-21T03:20:14.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.756+0000 7fa4fa7fc640 1 --2- 172.21.15.105:0/3021610868 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5040ceb40 0x7fa5041e8da0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec00c310 tx=0x7fa4ec00c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:14.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.756+0000 7fa4fbfff640 1 -- 172.21.15.105:0/3021610868 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec011790 con 0x7fa5040ceb40 2024-09-21T03:20:14.766 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.756+0000 7fa4fbfff640 1 -- 172.21.15.105:0/3021610868 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa4ec017070 con 0x7fa5040ceb40 2024-09-21T03:20:14.766 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.756+0000 7fa509752640 1 -- 172.21.15.105:0/3021610868 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa504151120 con 0x7fa5040ceb40 2024-09-21T03:20:14.766 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.756+0000 7fa4fbfff640 1 -- 172.21.15.105:0/3021610868 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec011cc0 con 0x7fa5040ceb40 2024-09-21T03:20:14.766 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.756+0000 7fa509752640 1 -- 172.21.15.105:0/3021610868 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5041e8880 con 0x7fa5040ceb40 2024-09-21T03:20:14.766 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.757+0000 7fa509752640 1 -- 172.21.15.105:0/3021610868 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5040d0aa0 con 0x7fa5040ceb40 2024-09-21T03:20:14.767 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.758+0000 7fa4fbfff640 1 -- 172.21.15.105:0/3021610868 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa4ec01c460 con 0x7fa5040ceb40 2024-09-21T03:20:14.767 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.759+0000 7fa4fbfff640 1 --2- 172.21.15.105:0/3021610868 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa4e4078b90 0x7fa4e407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:14.767 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.759+0000 7fa4fbfff640 1 -- 172.21.15.105:0/3021610868 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fa4ec09a6d0 con 0x7fa5040ceb40 2024-09-21T03:20:14.767 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.759+0000 7fa502ffd640 1 --2- 172.21.15.105:0/3021610868 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa4e4078b90 0x7fa4e407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:14.767 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.760+0000 7fa502ffd640 1 --2- 172.21.15.105:0/3021610868 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa4e4078b90 0x7fa4e407b0a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4005d00 tx=0x7fa4f4005c50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:14.769 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.764+0000 7fa4fbfff640 1 -- 172.21.15.105:0/3021610868 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa5040d0aa0 con 0x7fa5040ceb40 2024-09-21T03:20:14.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.940+0000 7fa509752640 1 -- 172.21.15.105:0/3021610868 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa5040d1510 con 0x7fa5040ceb40 2024-09-21T03:20:14.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.940+0000 7fa4fbfff640 1 -- 172.21.15.105:0/3021610868 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) ==== 93+0+10 (secure 0 0 0) 0x7fa4ec062ea0 con 0x7fa5040ceb40 2024-09-21T03:20:14.942 INFO:teuthology.orchestra.run.smithi105.stdout:pg_num: 1 2024-09-21T03:20:14.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.942+0000 7fa509752640 1 -- 172.21.15.105:0/3021610868 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa4e4078b90 msgr2=0x7fa4e407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:14.948 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.942+0000 7fa509752640 1 --2- 172.21.15.105:0/3021610868 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa4e4078b90 0x7fa4e407b0a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4005d00 tx=0x7fa4f4005c50 comp rx=0 tx=0).stop 2024-09-21T03:20:14.948 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.942+0000 7fa509752640 1 -- 172.21.15.105:0/3021610868 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5040ceb40 msgr2=0x7fa5041e8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:14.948 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.942+0000 7fa509752640 1 --2- 172.21.15.105:0/3021610868 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5040ceb40 0x7fa5041e8da0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec00c310 tx=0x7fa4ec00c7d0 comp rx=0 tx=0).stop 2024-09-21T03:20:14.948 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.942+0000 7fa509752640 1 -- 172.21.15.105:0/3021610868 shutdown_connections 2024-09-21T03:20:14.948 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.942+0000 7fa509752640 1 --2- 172.21.15.105:0/3021610868 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa4e4078b90 0x7fa4e407b0a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:14.948 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.942+0000 7fa509752640 1 --2- 172.21.15.105:0/3021610868 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa50415f480 0x7fa5041e92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:14.948 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.942+0000 7fa509752640 1 --2- 172.21.15.105:0/3021610868 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5040ceb40 0x7fa5041e8da0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:14.948 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.942+0000 7fa509752640 1 --2- 172.21.15.105:0/3021610868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa50406f4b0 0x7fa50414dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:14.948 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.942+0000 7fa509752640 1 -- 172.21.15.105:0/3021610868 >> 172.21.15.105:0/3021610868 conn(0x7fa50408bfc0 msgr2=0x7fa504161950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:14.948 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.943+0000 7fa509752640 1 -- 172.21.15.105:0/3021610868 shutdown_connections 2024-09-21T03:20:14.948 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:14.943+0000 7fa509752640 1 -- 172.21.15.105:0/3021610868 wait complete. 2024-09-21T03:20:14.956 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_blocklisted_oldest_tid' 2024-09-21T03:20:15.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:15.077+0000 7f267d87e640 1 -- 172.21.15.105:0/2988802228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2660003c10 msgr2=0x7f2660004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:15.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:15.077+0000 7f267d87e640 1 --2- 172.21.15.105:0/2988802228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2660003c10 0x7f2660004060 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2668009ed0 tx=0x7f2660005830 comp rx=0 tx=0).stop 2024-09-21T03:20:15.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:15.077+0000 7f26777fe640 1 -- 172.21.15.105:0/2988802228 reap_dead start 2024-09-21T03:20:15.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:15.077+0000 7f267d87e640 1 -- 172.21.15.105:0/2988802228 shutdown_connections 2024-09-21T03:20:15.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:15.077+0000 7f267d87e640 1 -- 172.21.15.105:0/2988802228 >> 172.21.15.105:0/2988802228 conn(0x7f26780710b0 msgr2=0x7f26780714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:15.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:15.077+0000 7f267d87e640 1 -- 172.21.15.105:0/2988802228 shutdown_connections 2024-09-21T03:20:15.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:15.077+0000 7f267d87e640 1 -- 172.21.15.105:0/2988802228 wait complete. 2024-09-21T03:20:15.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:15.078+0000 7f267d87e640 1 Processor -- start 2024-09-21T03:20:15.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:15.079+0000 7f267d87e640 1 -- start start 2024-09-21T03:20:15.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:15.080+0000 7f267d87e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2660003c10 0x7f267806f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:15.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:15.080+0000 7f267d87e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2678159870 0x7f2678159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:15.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:15.080+0000 7f267d87e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f26781513a0 0x7f26781517b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:15.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:15.080+0000 7f267d87e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f26780d08a0 con 0x7f2660003c10 2024-09-21T03:20:15.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:15.080+0000 7f267d87e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f26780d0a20 con 0x7f2678159870 2024-09-21T03:20:15.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:15.080+0000 7f267d87e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f26780d0ba0 con 0x7f26781513a0 2024-09-21T03:20:15.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:15.080+0000 7f2676ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2660003c10 0x7f267806f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:15.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:15.080+0000 7f2676ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2660003c10 0x7f267806f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40828/0 (socket says 172.21.15.105:40828) 2024-09-21T03:20:15.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:15.080+0000 7f2676ffd640 1 -- 172.21.15.105:0/4147953214 learned_addr learned my addr 172.21.15.105:0/4147953214 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:15.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:15.080+0000 7f26777fe640 1 --2- 172.21.15.105:0/4147953214 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f26781513a0 0x7f26781517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:15.086 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:15.080+0000 7f26767fc640 1 --2- 172.21.15.105:0/4147953214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2678159870 0x7f2678159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:15.086 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:15.080+0000 7f2676ffd640 1 -- 172.21.15.105:0/4147953214 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f26781513a0 msgr2=0x7f26781517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:15.086 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:15.080+0000 7f2676ffd640 1 --2- 172.21.15.105:0/4147953214 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f26781513a0 0x7f26781517b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:15.086 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:15.080+0000 7f2676ffd640 1 -- 172.21.15.105:0/4147953214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2678159870 msgr2=0x7f2678159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:15.086 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:15.080+0000 7f2676ffd640 1 --2- 172.21.15.105:0/4147953214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2678159870 0x7f2678159c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:15.086 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:15.080+0000 7f2676ffd640 1 -- 172.21.15.105:0/4147953214 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2678151cf0 con 0x7f2660003c10 2024-09-21T03:20:15.086 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:15.080+0000 7f26767fc640 1 --2- 172.21.15.105:0/4147953214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2678159870 0x7f2678159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:20:15.086 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:15.080+0000 7f2676ffd640 1 --2- 172.21.15.105:0/4147953214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2660003c10 0x7f267806f140 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2668009ed0 tx=0x7f2668033c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:15.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:15.081+0000 7f265ffff640 1 -- 172.21.15.105:0/4147953214 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2668043070 con 0x7f2660003c10 2024-09-21T03:20:15.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:15.081+0000 7f265ffff640 1 -- 172.21.15.105:0/4147953214 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2668033e30 con 0x7f2660003c10 2024-09-21T03:20:15.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:15.081+0000 7f267d87e640 1 -- 172.21.15.105:0/4147953214 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26780ae9f0 con 0x7f2660003c10 2024-09-21T03:20:15.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:15.081+0000 7f265ffff640 1 -- 172.21.15.105:0/4147953214 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2668038040 con 0x7f2660003c10 2024-09-21T03:20:15.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:15.081+0000 7f267d87e640 1 -- 172.21.15.105:0/4147953214 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f267806e740 con 0x7f2660003c10 2024-09-21T03:20:15.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:15.082+0000 7f267d87e640 1 -- 172.21.15.105:0/4147953214 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26780d1130 con 0x7f2660003c10 2024-09-21T03:20:15.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:15.082+0000 7f265ffff640 1 -- 172.21.15.105:0/4147953214 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2668046070 con 0x7f2660003c10 2024-09-21T03:20:15.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:15.083+0000 7f265ffff640 1 --2- 172.21.15.105:0/4147953214 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2664078bc0 0x7f266407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:15.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:15.083+0000 7f265ffff640 1 -- 172.21.15.105:0/4147953214 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f26680bb480 con 0x7f2660003c10 2024-09-21T03:20:15.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:15.083+0000 7f26767fc640 1 --2- 172.21.15.105:0/4147953214 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2664078bc0 0x7f266407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:15.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:15.083+0000 7f26767fc640 1 --2- 172.21.15.105:0/4147953214 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2664078bc0 0x7f266407b0d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f266c006fd0 tx=0x7f266c000ed0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:15.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:15.087+0000 7f265ffff640 1 -- 172.21.15.105:0/4147953214 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2678151cf0 con 0x7f2660003c10 2024-09-21T03:20:15.337 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:15.335+0000 7f267d87e640 1 -- 172.21.15.105:0/4147953214 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_blocklisted_oldest_tid"]} v 0) -- 0x7f26780b6970 con 0x7f2660003c10 2024-09-21T03:20:16.305 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.303+0000 7f265ffff640 1 -- 172.21.15.105:0/4147953214 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_blocklisted_oldest_tid"]}]=0 v105) ==== 165+0+0 (secure 0 0 0) 0x7f2668083570 con 0x7f2660003c10 2024-09-21T03:20:16.308 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.306+0000 7f267d87e640 1 -- 172.21.15.105:0/4147953214 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2664078bc0 msgr2=0x7f266407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:16.308 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.306+0000 7f267d87e640 1 --2- 172.21.15.105:0/4147953214 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2664078bc0 0x7f266407b0d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f266c006fd0 tx=0x7f266c000ed0 comp rx=0 tx=0).stop 2024-09-21T03:20:16.308 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.306+0000 7f267d87e640 1 -- 172.21.15.105:0/4147953214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2660003c10 msgr2=0x7f267806f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:16.308 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.306+0000 7f267d87e640 1 --2- 172.21.15.105:0/4147953214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2660003c10 0x7f267806f140 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2668009ed0 tx=0x7f2668033c40 comp rx=0 tx=0).stop 2024-09-21T03:20:16.308 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.306+0000 7f267d87e640 1 -- 172.21.15.105:0/4147953214 shutdown_connections 2024-09-21T03:20:16.308 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.306+0000 7f267d87e640 1 --2- 172.21.15.105:0/4147953214 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2664078bc0 0x7f266407b0d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:16.308 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.306+0000 7f267d87e640 1 --2- 172.21.15.105:0/4147953214 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f26781513a0 0x7f26781517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:16.309 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.306+0000 7f267d87e640 1 --2- 172.21.15.105:0/4147953214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2678159870 0x7f2678159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:16.309 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.306+0000 7f267d87e640 1 --2- 172.21.15.105:0/4147953214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2660003c10 0x7f267806f140 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:16.309 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.306+0000 7f267d87e640 1 -- 172.21.15.105:0/4147953214 >> 172.21.15.105:0/4147953214 conn(0x7f26780710b0 msgr2=0x7f26780b6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:16.309 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.306+0000 7f267d87e640 1 -- 172.21.15.105:0/4147953214 shutdown_connections 2024-09-21T03:20:16.309 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.307+0000 7f267d87e640 1 -- 172.21.15.105:0/4147953214 wait complete. 2024-09-21T03:20:16.321 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T03:20:16.441 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.439+0000 7f67a3150640 1 -- 172.21.15.105:0/4091263814 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6784004800 msgr2=0x7f6784004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:16.441 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.439+0000 7f67a3150640 1 --2- 172.21.15.105:0/4091263814 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6784004800 0x7f6784004c10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f679c0ced00 tx=0x7f6784005830 comp rx=0 tx=0).stop 2024-09-21T03:20:16.441 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.439+0000 7f67a3150640 1 -- 172.21.15.105:0/4091263814 shutdown_connections 2024-09-21T03:20:16.441 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.439+0000 7f67a3150640 1 --2- 172.21.15.105:0/4091263814 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6784004800 0x7f6784004c10 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:16.442 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.439+0000 7f67a3150640 1 -- 172.21.15.105:0/4091263814 >> 172.21.15.105:0/4091263814 conn(0x7f679c0cdcc0 msgr2=0x7f679c0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:16.442 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.439+0000 7f67a3150640 1 -- 172.21.15.105:0/4091263814 shutdown_connections 2024-09-21T03:20:16.442 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.439+0000 7f67a3150640 1 -- 172.21.15.105:0/4091263814 wait complete. 2024-09-21T03:20:16.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.441+0000 7f67a3150640 1 Processor -- start 2024-09-21T03:20:16.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.441+0000 7f67a3150640 1 -- start start 2024-09-21T03:20:16.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.443+0000 7f67a3150640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6784004800 0x7f679c158840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:16.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.443+0000 7f67a3150640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f679c1f2410 0x7f679c09e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:16.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.443+0000 7f67a3150640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f679c1e62c0 0x7f679c1e66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:16.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.443+0000 7f67a3150640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f679c0cfeb0 con 0x7f679c1f2410 2024-09-21T03:20:16.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.443+0000 7f67a3150640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f679c0b3970 con 0x7f679c1e62c0 2024-09-21T03:20:16.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.443+0000 7f67a3150640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f679c0d0030 con 0x7f6784004800 2024-09-21T03:20:16.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.443+0000 7f6793fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f679c1f2410 0x7f679c09e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:16.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.443+0000 7f6793fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f679c1f2410 0x7f679c09e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40854/0 (socket says 172.21.15.105:40854) 2024-09-21T03:20:16.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.443+0000 7f6793fff640 1 -- 172.21.15.105:0/633693719 learned_addr learned my addr 172.21.15.105:0/633693719 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:16.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.443+0000 7f67a0eec640 1 --2- 172.21.15.105:0/633693719 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6784004800 0x7f679c158840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:16.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.443+0000 7f67a16ed640 1 --2- 172.21.15.105:0/633693719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f679c1e62c0 0x7f679c1e66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:16.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.443+0000 7f6793fff640 1 -- 172.21.15.105:0/633693719 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6784004800 msgr2=0x7f679c158840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:16.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.443+0000 7f6793fff640 1 --2- 172.21.15.105:0/633693719 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6784004800 0x7f679c158840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:16.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.443+0000 7f6793fff640 1 -- 172.21.15.105:0/633693719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f679c1e62c0 msgr2=0x7f679c1e66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:16.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.443+0000 7f6793fff640 1 --2- 172.21.15.105:0/633693719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f679c1e62c0 0x7f679c1e66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:16.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.443+0000 7f6793fff640 1 -- 172.21.15.105:0/633693719 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f679c1e5220 con 0x7f679c1f2410 2024-09-21T03:20:16.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.443+0000 7f67a16ed640 1 --2- 172.21.15.105:0/633693719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f679c1e62c0 0x7f679c1e66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:20:16.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.443+0000 7f6793fff640 1 --2- 172.21.15.105:0/633693719 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f679c1f2410 0x7f679c09e510 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f678c00c350 tx=0x7f678c006d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:16.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.443+0000 7f67917fa640 1 -- 172.21.15.105:0/633693719 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678c032030 con 0x7f679c1f2410 2024-09-21T03:20:16.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.443+0000 7f67917fa640 1 -- 172.21.15.105:0/633693719 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f678c0038e0 con 0x7f679c1f2410 2024-09-21T03:20:16.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.443+0000 7f67a3150640 1 -- 172.21.15.105:0/633693719 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f679c1e5500 con 0x7f679c1f2410 2024-09-21T03:20:16.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.443+0000 7f67917fa640 1 -- 172.21.15.105:0/633693719 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678c003cb0 con 0x7f679c1f2410 2024-09-21T03:20:16.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.443+0000 7f67a3150640 1 -- 172.21.15.105:0/633693719 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f679c1e5ac0 con 0x7f679c1f2410 2024-09-21T03:20:16.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.445+0000 7f67a3150640 1 -- 172.21.15.105:0/633693719 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f679c06fec0 con 0x7f679c1f2410 2024-09-21T03:20:16.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.445+0000 7f67917fa640 1 -- 172.21.15.105:0/633693719 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f678c035020 con 0x7f679c1f2410 2024-09-21T03:20:16.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.445+0000 7f67917fa640 1 --2- 172.21.15.105:0/633693719 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6788078bc0 0x7f678807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:16.449 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.446+0000 7f67917fa640 1 -- 172.21.15.105:0/633693719 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f678c0bb140 con 0x7f679c1f2410 2024-09-21T03:20:16.449 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.446+0000 7f67a0eec640 1 --2- 172.21.15.105:0/633693719 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6788078bc0 0x7f678807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:16.449 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.446+0000 7f67a0eec640 1 --2- 172.21.15.105:0/633693719 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6788078bc0 0x7f678807b0d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6798000c00 tx=0x7f6798006b10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:16.451 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.450+0000 7f67917fa640 1 -- 172.21.15.105:0/633693719 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f678c047020 con 0x7f679c1f2410 2024-09-21T03:20:16.629 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.627+0000 7f67a3150640 1 -- 172.21.15.105:0/633693719 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f679c0b5f90 con 0x7f679c1f2410 2024-09-21T03:20:16.629 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.628+0000 7f67917fa640 1 -- 172.21.15.105:0/633693719 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v35) ==== 59+0+2294 (secure 0 0 0) 0x7f678c0839a0 con 0x7f679c1f2410 2024-09-21T03:20:16.630 INFO:teuthology.orchestra.run.smithi105.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T03:20:16.630 INFO:teuthology.orchestra.run.smithi105.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T03:20:16.630 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced client_mount_timeout 30 2024-09-21T03:20:16.630 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced debug_client 20/20 2024-09-21T03:20:16.630 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced debug_mgr 20/20 2024-09-21T03:20:16.630 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced debug_ms 1/1 2024-09-21T03:20:16.630 INFO:teuthology.orchestra.run.smithi105.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T03:20:16.630 INFO:teuthology.orchestra.run.smithi105.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T03:20:16.630 INFO:teuthology.orchestra.run.smithi105.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 7291.545169 2024-09-21T03:20:16.630 INFO:teuthology.orchestra.run.smithi105.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5080.142035 2024-09-21T03:20:16.630 INFO:teuthology.orchestra.run.smithi105.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5120.988640 2024-09-21T03:20:16.631 INFO:teuthology.orchestra.run.smithi105.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4938.196268 2024-09-21T03:20:16.631 INFO:teuthology.orchestra.run.smithi105.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4906.316728 2024-09-21T03:20:16.631 INFO:teuthology.orchestra.run.smithi105.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4701.273858 2024-09-21T03:20:16.631 INFO:teuthology.orchestra.run.smithi105.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4947.710044 2024-09-21T03:20:16.631 INFO:teuthology.orchestra.run.smithi105.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5174.949063 2024-09-21T03:20:16.631 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced debug_mds 20/20 2024-09-21T03:20:16.631 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T03:20:16.631 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced debug_ms 2/2 2024-09-21T03:20:16.631 INFO:teuthology.orchestra.run.smithi105.stdout:mds dev mds_debug_frag true 2024-09-21T03:20:16.631 INFO:teuthology.orchestra.run.smithi105.stdout:mds dev mds_debug_scatterstat true 2024-09-21T03:20:16.631 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T03:20:16.631 INFO:teuthology.orchestra.run.smithi105.stdout:mds dev mds_verify_scatter true 2024-09-21T03:20:16.631 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T03:20:16.632 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T03:20:16.632 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T03:20:16.632 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced client_mount_timeout 600 2024-09-21T03:20:16.632 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced debug_client 20/20 2024-09-21T03:20:16.632 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced debug_ms 1/1 2024-09-21T03:20:16.632 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T03:20:16.632 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T03:20:16.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.630+0000 7f67a3150640 1 -- 172.21.15.105:0/633693719 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6788078bc0 msgr2=0x7f678807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:16.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.630+0000 7f67a3150640 1 --2- 172.21.15.105:0/633693719 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6788078bc0 0x7f678807b0d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6798000c00 tx=0x7f6798006b10 comp rx=0 tx=0).stop 2024-09-21T03:20:16.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.630+0000 7f67a3150640 1 -- 172.21.15.105:0/633693719 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f679c1f2410 msgr2=0x7f679c09e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:16.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.630+0000 7f67a3150640 1 --2- 172.21.15.105:0/633693719 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f679c1f2410 0x7f679c09e510 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f678c00c350 tx=0x7f678c006d40 comp rx=0 tx=0).stop 2024-09-21T03:20:16.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.630+0000 7f67a3150640 1 -- 172.21.15.105:0/633693719 shutdown_connections 2024-09-21T03:20:16.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.630+0000 7f67a3150640 1 --2- 172.21.15.105:0/633693719 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6788078bc0 0x7f678807b0d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:16.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.630+0000 7f67a3150640 1 --2- 172.21.15.105:0/633693719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f679c1e62c0 0x7f679c1e66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:16.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.630+0000 7f67a3150640 1 --2- 172.21.15.105:0/633693719 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f679c1f2410 0x7f679c09e510 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:16.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.630+0000 7f67a3150640 1 --2- 172.21.15.105:0/633693719 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6784004800 0x7f679c158840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:16.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.630+0000 7f67a3150640 1 -- 172.21.15.105:0/633693719 >> 172.21.15.105:0/633693719 conn(0x7f679c0cdcc0 msgr2=0x7f679c0c7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:16.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.630+0000 7f67a3150640 1 -- 172.21.15.105:0/633693719 shutdown_connections 2024-09-21T03:20:16.634 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.630+0000 7f67a3150640 1 -- 172.21.15.105:0/633693719 wait complete. 2024-09-21T03:20:16.643 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T03:20:16.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.756+0000 7f2df77da640 1 -- 172.21.15.105:0/3823305104 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2df00d3870 msgr2=0x7f2df00ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:16.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.756+0000 7f2df77da640 1 --2- 172.21.15.105:0/3823305104 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2df00d3870 0x7f2df00ceb40 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2df00ba570 tx=0x7f2de802a9c0 comp rx=0 tx=0).stop 2024-09-21T03:20:16.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.756+0000 7f2df77da640 1 -- 172.21.15.105:0/3823305104 shutdown_connections 2024-09-21T03:20:16.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.756+0000 7f2df77da640 1 --2- 172.21.15.105:0/3823305104 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2df00d3870 0x7f2df00ceb40 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:16.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.756+0000 7f2df77da640 1 --2- 172.21.15.105:0/3823305104 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2df006f4b0 0x7f2df00d3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:16.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.756+0000 7f2df77da640 1 --2- 172.21.15.105:0/3823305104 >> v2:172.21.15.162:3300/0 conn(0x7f2df006e170 0x7f2df00b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:16.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.756+0000 7f2df77da640 1 -- 172.21.15.105:0/3823305104 >> 172.21.15.105:0/3823305104 conn(0x7f2df008bfc0 msgr2=0x7f2df009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:16.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.756+0000 7f2df77da640 1 -- 172.21.15.105:0/3823305104 shutdown_connections 2024-09-21T03:20:16.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.756+0000 7f2df77da640 1 -- 172.21.15.105:0/3823305104 wait complete. 2024-09-21T03:20:16.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.758+0000 7f2df77da640 1 Processor -- start 2024-09-21T03:20:16.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.758+0000 7f2df77da640 1 -- start start 2024-09-21T03:20:16.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.759+0000 7f2df77da640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2df006f4b0 0x7f2df015df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:16.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.759+0000 7f2df77da640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2df00d3870 0x7f2df01e7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:16.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.759+0000 7f2df77da640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2df015ec10 0x7f2df01e8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:16.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.759+0000 7f2df77da640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2df00cf490 con 0x7f2df006f4b0 2024-09-21T03:20:16.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.759+0000 7f2df77da640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2df00cf310 con 0x7f2df00d3870 2024-09-21T03:20:16.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.759+0000 7f2df77da640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2df00d0ce0 con 0x7f2df015ec10 2024-09-21T03:20:16.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.759+0000 7f2df5576640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2df006f4b0 0x7f2df015df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:16.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.759+0000 7f2df5576640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2df006f4b0 0x7f2df015df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40884/0 (socket says 172.21.15.105:40884) 2024-09-21T03:20:16.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.759+0000 7f2df5576640 1 -- 172.21.15.105:0/3486987728 learned_addr learned my addr 172.21.15.105:0/3486987728 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:16.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.759+0000 7f2df4d75640 1 --2- 172.21.15.105:0/3486987728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2df00d3870 0x7f2df01e7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:16.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.759+0000 7f2df5d77640 1 --2- 172.21.15.105:0/3486987728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2df015ec10 0x7f2df01e8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:16.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.759+0000 7f2df5576640 1 -- 172.21.15.105:0/3486987728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2df015ec10 msgr2=0x7f2df01e8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:16.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.759+0000 7f2df5576640 1 --2- 172.21.15.105:0/3486987728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2df015ec10 0x7f2df01e8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:16.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.759+0000 7f2df5576640 1 -- 172.21.15.105:0/3486987728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2df00d3870 msgr2=0x7f2df01e7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:16.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.759+0000 7f2df5576640 1 --2- 172.21.15.105:0/3486987728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2df00d3870 0x7f2df01e7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:16.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.759+0000 7f2df5576640 1 -- 172.21.15.105:0/3486987728 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2df015e490 con 0x7f2df006f4b0 2024-09-21T03:20:16.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.759+0000 7f2df5d77640 1 --2- 172.21.15.105:0/3486987728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2df015ec10 0x7f2df01e8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:20:16.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.759+0000 7f2df4d75640 1 --2- 172.21.15.105:0/3486987728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2df00d3870 0x7f2df01e7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:20:16.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.760+0000 7f2df5576640 1 --2- 172.21.15.105:0/3486987728 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2df006f4b0 0x7f2df015df50 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2de000d770 tx=0x7f2de000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:16.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.760+0000 7f2dedffb640 1 -- 172.21.15.105:0/3486987728 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de0017070 con 0x7f2df006f4b0 2024-09-21T03:20:16.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.760+0000 7f2dedffb640 1 -- 172.21.15.105:0/3486987728 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2de0009d20 con 0x7f2df006f4b0 2024-09-21T03:20:16.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.760+0000 7f2dedffb640 1 -- 172.21.15.105:0/3486987728 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de00106c0 con 0x7f2df006f4b0 2024-09-21T03:20:16.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.760+0000 7f2df77da640 1 -- 172.21.15.105:0/3486987728 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2df01f5940 con 0x7f2df006f4b0 2024-09-21T03:20:16.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.760+0000 7f2df77da640 1 -- 172.21.15.105:0/3486987728 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2df01f5f00 con 0x7f2df006f4b0 2024-09-21T03:20:16.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.761+0000 7f2df77da640 1 -- 172.21.15.105:0/3486987728 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2df006e170 con 0x7f2df006f4b0 2024-09-21T03:20:16.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.762+0000 7f2dedffb640 1 -- 172.21.15.105:0/3486987728 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2de001a070 con 0x7f2df006f4b0 2024-09-21T03:20:16.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.762+0000 7f2dedffb640 1 --2- 172.21.15.105:0/3486987728 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2ddc078b90 0x7f2ddc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:16.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.762+0000 7f2dedffb640 1 -- 172.21.15.105:0/3486987728 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f2de009ac40 con 0x7f2df006f4b0 2024-09-21T03:20:16.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.762+0000 7f2df4d75640 1 --2- 172.21.15.105:0/3486987728 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2ddc078b90 0x7f2ddc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:16.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.763+0000 7f2df4d75640 1 --2- 172.21.15.105:0/3486987728 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2ddc078b90 0x7f2ddc07b0a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2de4005fd0 tx=0x7f2de4005d10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:16.768 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.767+0000 7f2dedffb640 1 -- 172.21.15.105:0/3486987728 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2de0063380 con 0x7f2df006f4b0 2024-09-21T03:20:16.946 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.945+0000 7f2df77da640 1 -- 172.21.15.105:0/3486987728 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f2df00b7df0 con 0x7f2df006f4b0 2024-09-21T03:20:16.950 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.948+0000 7f2dedffb640 1 -- 172.21.15.105:0/3486987728 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v36)=0 v36) ==== 122+0+0 (secure 0 0 0) 0x7f2de0062c80 con 0x7f2df006f4b0 2024-09-21T03:20:16.952 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.951+0000 7f2df77da640 1 -- 172.21.15.105:0/3486987728 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2ddc078b90 msgr2=0x7f2ddc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:16.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.951+0000 7f2df77da640 1 --2- 172.21.15.105:0/3486987728 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2ddc078b90 0x7f2ddc07b0a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2de4005fd0 tx=0x7f2de4005d10 comp rx=0 tx=0).stop 2024-09-21T03:20:16.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.951+0000 7f2df77da640 1 -- 172.21.15.105:0/3486987728 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2df006f4b0 msgr2=0x7f2df015df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:16.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.951+0000 7f2df77da640 1 --2- 172.21.15.105:0/3486987728 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2df006f4b0 0x7f2df015df50 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2de000d770 tx=0x7f2de000dc30 comp rx=0 tx=0).stop 2024-09-21T03:20:16.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.951+0000 7f2df77da640 1 -- 172.21.15.105:0/3486987728 shutdown_connections 2024-09-21T03:20:16.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.951+0000 7f2df77da640 1 --2- 172.21.15.105:0/3486987728 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2ddc078b90 0x7f2ddc07b0a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:16.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.951+0000 7f2df77da640 1 --2- 172.21.15.105:0/3486987728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2df015ec10 0x7f2df01e8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:16.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.951+0000 7f2df77da640 1 --2- 172.21.15.105:0/3486987728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2df00d3870 0x7f2df01e7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:16.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.951+0000 7f2df77da640 1 --2- 172.21.15.105:0/3486987728 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2df006f4b0 0x7f2df015df50 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:16.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.951+0000 7f2df77da640 1 -- 172.21.15.105:0/3486987728 >> 172.21.15.105:0/3486987728 conn(0x7f2df008bfc0 msgr2=0x7f2df00b7340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:16.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.951+0000 7f2df77da640 1 -- 172.21.15.105:0/3486987728 shutdown_connections 2024-09-21T03:20:16.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:16.951+0000 7f2df77da640 1 -- 172.21.15.105:0/3486987728 wait complete. 2024-09-21T03:20:16.964 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T03:20:16.964 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T03:20:16.999 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T03:20:17.051 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T03:20:17.051 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:20:17.051 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:20:17.067 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T03:20:17.067 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:20:17.067 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:20:17.085 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=452 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T03:20:17.085 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:20:17.085 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:20:17.122 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T03:20:17.123 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:20:17.123 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:20:17.143 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=452 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T03:20:17.143 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T03:20:17.143 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:20:17.273 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.272+0000 7fe4c8eec640 1 -- 172.21.15.105:0/2226533743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4c40cfc00 msgr2=0x7fe4c40ce1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:17.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.272+0000 7fe4c8eec640 1 --2- 172.21.15.105:0/2226533743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4c40cfc00 0x7fe4c40ce1c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac005fd0 tx=0x7fe4ac02a530 comp rx=0 tx=0).stop 2024-09-21T03:20:17.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.272+0000 7fe4c8eec640 1 -- 172.21.15.105:0/2226533743 shutdown_connections 2024-09-21T03:20:17.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.272+0000 7fe4c8eec640 1 --2- 172.21.15.105:0/2226533743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4c40cfc00 0x7fe4c40ce1c0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:17.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.272+0000 7fe4c8eec640 1 --2- 172.21.15.105:0/2226533743 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4c4153970 0x7fe4c415d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:17.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.272+0000 7fe4c8eec640 1 -- 172.21.15.105:0/2226533743 >> 172.21.15.105:0/2226533743 conn(0x7fe4c40d15f0 msgr2=0x7fe4c4073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:17.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.272+0000 7fe4c8eec640 1 -- 172.21.15.105:0/2226533743 shutdown_connections 2024-09-21T03:20:17.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.272+0000 7fe4c8eec640 1 -- 172.21.15.105:0/2226533743 wait complete. 2024-09-21T03:20:17.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.274+0000 7fe4c8eec640 1 Processor -- start 2024-09-21T03:20:17.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.274+0000 7fe4c8eec640 1 -- start start 2024-09-21T03:20:17.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.275+0000 7fe4c8eec640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4c4073e50 0x7fe4c4141aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:17.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.275+0000 7fe4c8eec640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4c40cfc00 0x7fe4c41f37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:17.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.275+0000 7fe4c8eec640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4c4153970 0x7fe4c415b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:17.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.275+0000 7fe4c8eec640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c415e2e0 con 0x7fe4c4073e50 2024-09-21T03:20:17.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.275+0000 7fe4c8eec640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c415e160 con 0x7fe4c4153970 2024-09-21T03:20:17.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.275+0000 7fe4c8eec640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe4c415e460 con 0x7fe4c40cfc00 2024-09-21T03:20:17.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.275+0000 7fe4c259c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4c4073e50 0x7fe4c4141aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:17.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.275+0000 7fe4c259c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4c4073e50 0x7fe4c4141aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40898/0 (socket says 172.21.15.105:40898) 2024-09-21T03:20:17.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.275+0000 7fe4c259c640 1 -- 172.21.15.105:0/2508138834 learned_addr learned my addr 172.21.15.105:0/2508138834 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:17.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.275+0000 7fe4b9d9b640 1 --2- 172.21.15.105:0/2508138834 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4c40cfc00 0x7fe4c41f37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:17.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.275+0000 7fe4c2d9d640 1 --2- 172.21.15.105:0/2508138834 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4c4153970 0x7fe4c415b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:17.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.275+0000 7fe4c259c640 1 -- 172.21.15.105:0/2508138834 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4c40cfc00 msgr2=0x7fe4c41f37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:17.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.275+0000 7fe4c259c640 1 --2- 172.21.15.105:0/2508138834 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4c40cfc00 0x7fe4c41f37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:17.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.275+0000 7fe4c259c640 1 -- 172.21.15.105:0/2508138834 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4c4153970 msgr2=0x7fe4c415b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:17.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.275+0000 7fe4c259c640 1 --2- 172.21.15.105:0/2508138834 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4c4153970 0x7fe4c415b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:17.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.275+0000 7fe4c259c640 1 -- 172.21.15.105:0/2508138834 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c4141fe0 con 0x7fe4c4073e50 2024-09-21T03:20:17.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.276+0000 7fe4c259c640 1 --2- 172.21.15.105:0/2508138834 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4c4073e50 0x7fe4c4141aa0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe4b400d700 tx=0x7fe4b400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:17.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.276+0000 7fe4bb7fe640 1 -- 172.21.15.105:0/2508138834 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4017070 con 0x7fe4c4073e50 2024-09-21T03:20:17.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.276+0000 7fe4bb7fe640 1 -- 172.21.15.105:0/2508138834 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe4b4005310 con 0x7fe4c4073e50 2024-09-21T03:20:17.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.276+0000 7fe4c8eec640 1 -- 172.21.15.105:0/2508138834 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4c41422b0 con 0x7fe4c4073e50 2024-09-21T03:20:17.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.276+0000 7fe4bb7fe640 1 -- 172.21.15.105:0/2508138834 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4009820 con 0x7fe4c4073e50 2024-09-21T03:20:17.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.276+0000 7fe4c8eec640 1 -- 172.21.15.105:0/2508138834 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4c4142870 con 0x7fe4c4073e50 2024-09-21T03:20:17.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.277+0000 7fe4c8eec640 1 -- 172.21.15.105:0/2508138834 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4c4140060 con 0x7fe4c4073e50 2024-09-21T03:20:17.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.278+0000 7fe4bb7fe640 1 -- 172.21.15.105:0/2508138834 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe4b40099c0 con 0x7fe4c4073e50 2024-09-21T03:20:17.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.278+0000 7fe4bb7fe640 1 --2- 172.21.15.105:0/2508138834 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe4a4078b90 0x7fe4a407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:17.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.278+0000 7fe4bb7fe640 1 -- 172.21.15.105:0/2508138834 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fe4b409aad0 con 0x7fe4c4073e50 2024-09-21T03:20:17.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.278+0000 7fe4b9d9b640 1 --2- 172.21.15.105:0/2508138834 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe4a4078b90 0x7fe4a407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:17.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.279+0000 7fe4b9d9b640 1 --2- 172.21.15.105:0/2508138834 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe4a4078b90 0x7fe4a407b0a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac033000 tx=0x7fe4ac004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:17.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.283+0000 7fe4bb7fe640 1 -- 172.21.15.105:0/2508138834 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe4b4062bc0 con 0x7fe4c4073e50 2024-09-21T03:20:17.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.496+0000 7fe4c8eec640 1 -- 172.21.15.105:0/2508138834 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe4c40744b0 con 0x7fe4c4073e50 2024-09-21T03:20:17.499 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.497+0000 7fe4bb7fe640 1 -- 172.21.15.105:0/2508138834 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+3920 (secure 0 0 0) 0x7fe4b40675f0 con 0x7fe4c4073e50 2024-09-21T03:20:17.499 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:20:17.499 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":19,"btime":"2024-09-21T03:20:11:279281+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4634,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/517240834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":517240834},{"type":"v1","addr":"172.21.15.162:6837","nonce":517240834}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4774,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3241953393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3241953393},{"type":"v1","addr":"172.21.15.162:6836","nonce":3241953393}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4899,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/2101702562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2101702562},{"type":"v1","addr":"172.21.15.105:6834","nonce":2101702562}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2359469629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2359469629},{"type":"v1","addr":"172.21.15.105:6835","nonce":2359469629}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[]} 2024-09-21T03:20:17.499 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 19 2024-09-21T03:20:17.501 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.499+0000 7fe4c8eec640 1 -- 172.21.15.105:0/2508138834 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe4a4078b90 msgr2=0x7fe4a407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:17.501 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.499+0000 7fe4c8eec640 1 --2- 172.21.15.105:0/2508138834 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe4a4078b90 0x7fe4a407b0a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac033000 tx=0x7fe4ac004730 comp rx=0 tx=0).stop 2024-09-21T03:20:17.501 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.499+0000 7fe4c8eec640 1 -- 172.21.15.105:0/2508138834 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4c4073e50 msgr2=0x7fe4c4141aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:17.501 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.499+0000 7fe4c8eec640 1 --2- 172.21.15.105:0/2508138834 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4c4073e50 0x7fe4c4141aa0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe4b400d700 tx=0x7fe4b400dbc0 comp rx=0 tx=0).stop 2024-09-21T03:20:17.501 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.499+0000 7fe4c8eec640 1 -- 172.21.15.105:0/2508138834 shutdown_connections 2024-09-21T03:20:17.501 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.499+0000 7fe4c8eec640 1 --2- 172.21.15.105:0/2508138834 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe4a4078b90 0x7fe4a407b0a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:17.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.499+0000 7fe4c8eec640 1 --2- 172.21.15.105:0/2508138834 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4c4153970 0x7fe4c415b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:17.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.499+0000 7fe4c8eec640 1 --2- 172.21.15.105:0/2508138834 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4c40cfc00 0x7fe4c41f37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:17.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.499+0000 7fe4c8eec640 1 --2- 172.21.15.105:0/2508138834 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4c4073e50 0x7fe4c4141aa0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:17.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.499+0000 7fe4c8eec640 1 -- 172.21.15.105:0/2508138834 >> 172.21.15.105:0/2508138834 conn(0x7fe4c40d15f0 msgr2=0x7fe4c4152cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:17.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.499+0000 7fe4c8eec640 1 -- 172.21.15.105:0/2508138834 shutdown_connections 2024-09-21T03:20:17.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.499+0000 7fe4c8eec640 1 -- 172.21.15.105:0/2508138834 wait complete. 2024-09-21T03:20:17.512 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T03:20:17.512 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-21T03:20:17.513 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T03:20:17.513 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:20:17.513 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T03:20:17.513 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T03:20:17.513 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T03:20:17.513 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:20:17.513 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T03:20:17.514 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T03:20:17.514 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T03:20:17.514 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:20:17.514 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T03:20:17.514 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T03:20:17.514 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T03:20:17.514 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:20:17.523 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T03:20:17.523 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T03:20:17.525 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T03:20:17.525 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T03:20:17.526 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T03:20:17.526 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T03:20:17.527 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T03:20:17.527 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T03:20:17.566 INFO:tasks.ceph.mds.c:Started 2024-09-21T03:20:17.567 DEBUG:teuthology.parallel:result is None 2024-09-21T03:20:17.568 INFO:tasks.ceph.mds.a:Started 2024-09-21T03:20:17.568 DEBUG:teuthology.parallel:result is None 2024-09-21T03:20:17.569 INFO:tasks.ceph.mds.b:Started 2024-09-21T03:20:17.569 DEBUG:teuthology.parallel:result is None 2024-09-21T03:20:17.569 INFO:tasks.ceph.mds.d:Started 2024-09-21T03:20:17.569 DEBUG:teuthology.parallel:result is None 2024-09-21T03:20:17.570 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T03:20:17.651 INFO:tasks.ceph.mds.c.smithi105.stdout:starting mds.c at 2024-09-21T03:20:17.652 INFO:tasks.ceph.mds.a.smithi105.stdout:starting mds.a at 2024-09-21T03:20:17.665 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-09-21T03:20:17.665 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-09-21T03:20:17.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.688+0000 7fa6adb4a640 1 -- 172.21.15.105:0/2335195453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6a806f4b0 msgr2=0x7fa6a80d3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:17.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.688+0000 7fa6adb4a640 1 --2- 172.21.15.105:0/2335195453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6a806f4b0 0x7fa6a80d3330 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa6a80b70e0 tx=0x7fa69c02a4d0 comp rx=0 tx=0).stop 2024-09-21T03:20:17.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.688+0000 7fa6adb4a640 1 -- 172.21.15.105:0/2335195453 shutdown_connections 2024-09-21T03:20:17.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.688+0000 7fa6adb4a640 1 --2- 172.21.15.105:0/2335195453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6a806f4b0 0x7fa6a80d3330 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:17.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.688+0000 7fa6adb4a640 1 --2- 172.21.15.105:0/2335195453 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6a806e170 0x7fa6a80b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:17.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.688+0000 7fa6adb4a640 1 -- 172.21.15.105:0/2335195453 >> 172.21.15.105:0/2335195453 conn(0x7fa6a808bfc0 msgr2=0x7fa6a809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:17.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.688+0000 7fa6adb4a640 1 -- 172.21.15.105:0/2335195453 shutdown_connections 2024-09-21T03:20:17.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.688+0000 7fa6adb4a640 1 -- 172.21.15.105:0/2335195453 wait complete. 2024-09-21T03:20:17.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.690+0000 7fa6adb4a640 1 Processor -- start 2024-09-21T03:20:17.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.690+0000 7fa6adb4a640 1 -- start start 2024-09-21T03:20:17.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.691+0000 7fa6adb4a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6a806f4b0 0x7fa6a815fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:17.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.691+0000 7fa6adb4a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6a80d3870 0x7fa6a815ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:17.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.691+0000 7fa6adb4a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6a815f390 0x7fa6a815cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:17.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.691+0000 7fa6adb4a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a80d0e60 con 0x7fa6a815f390 2024-09-21T03:20:17.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.691+0000 7fa6adb4a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a80d0ce0 con 0x7fa6a80d3870 2024-09-21T03:20:17.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.691+0000 7fa6adb4a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa6a80d0fe0 con 0x7fa6a806f4b0 2024-09-21T03:20:17.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.691+0000 7fa6a7fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6a815f390 0x7fa6a815cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:17.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.691+0000 7fa6a7fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6a815f390 0x7fa6a815cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40930/0 (socket says 172.21.15.105:40930) 2024-09-21T03:20:17.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.691+0000 7fa6a7fff640 1 -- 172.21.15.105:0/2450774756 learned_addr learned my addr 172.21.15.105:0/2450774756 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:17.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.691+0000 7fa6a6ffd640 1 --2- 172.21.15.105:0/2450774756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6a80d3870 0x7fa6a815ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:17.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.691+0000 7fa6a77fe640 1 --2- 172.21.15.105:0/2450774756 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6a806f4b0 0x7fa6a815fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:17.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.691+0000 7fa6a7fff640 1 -- 172.21.15.105:0/2450774756 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6a806f4b0 msgr2=0x7fa6a815fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:17.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.691+0000 7fa6a7fff640 1 --2- 172.21.15.105:0/2450774756 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6a806f4b0 0x7fa6a815fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:17.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.691+0000 7fa6a7fff640 1 -- 172.21.15.105:0/2450774756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6a80d3870 msgr2=0x7fa6a815ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:17.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.691+0000 7fa6a7fff640 1 --2- 172.21.15.105:0/2450774756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6a80d3870 0x7fa6a815ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:17.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.691+0000 7fa6a7fff640 1 -- 172.21.15.105:0/2450774756 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a80caa90 con 0x7fa6a815f390 2024-09-21T03:20:17.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.692+0000 7fa6a6ffd640 1 --2- 172.21.15.105:0/2450774756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6a80d3870 0x7fa6a815ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:20:17.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.692+0000 7fa6a77fe640 1 --2- 172.21.15.105:0/2450774756 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6a806f4b0 0x7fa6a815fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:20:17.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.692+0000 7fa6a7fff640 1 --2- 172.21.15.105:0/2450774756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6a815f390 0x7fa6a815cdc0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa6a000b990 tx=0x7fa6a000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:17.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.692+0000 7fa68ffff640 1 -- 172.21.15.105:0/2450774756 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a0019070 con 0x7fa6a815f390 2024-09-21T03:20:17.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.692+0000 7fa68ffff640 1 -- 172.21.15.105:0/2450774756 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa6a000cc90 con 0x7fa6a815f390 2024-09-21T03:20:17.696 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.692+0000 7fa6adb4a640 1 -- 172.21.15.105:0/2450774756 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6a80cad70 con 0x7fa6a815f390 2024-09-21T03:20:17.696 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.692+0000 7fa68ffff640 1 -- 172.21.15.105:0/2450774756 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a00146a0 con 0x7fa6a815f390 2024-09-21T03:20:17.696 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.692+0000 7fa6adb4a640 1 -- 172.21.15.105:0/2450774756 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6a80cc450 con 0x7fa6a815f390 2024-09-21T03:20:17.696 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.693+0000 7fa6adb4a640 1 -- 172.21.15.105:0/2450774756 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6a80ca800 con 0x7fa6a815f390 2024-09-21T03:20:17.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.694+0000 7fa68ffff640 1 -- 172.21.15.105:0/2450774756 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa6a001c070 con 0x7fa6a815f390 2024-09-21T03:20:17.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.694+0000 7fa68ffff640 1 --2- 172.21.15.105:0/2450774756 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa694078bc0 0x7fa69407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:17.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.694+0000 7fa68ffff640 1 -- 172.21.15.105:0/2450774756 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fa6a009a810 con 0x7fa6a815f390 2024-09-21T03:20:17.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.694+0000 7fa6a77fe640 1 --2- 172.21.15.105:0/2450774756 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa694078bc0 0x7fa69407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:17.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.695+0000 7fa6a77fe640 1 --2- 172.21.15.105:0/2450774756 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa694078bc0 0x7fa69407b0d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa69800a870 tx=0x7fa698008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:17.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.699+0000 7fa68ffff640 1 -- 172.21.15.105:0/2450774756 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa6a0062f50 con 0x7fa6a815f390 2024-09-21T03:20:17.886 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:17.885+0000 7fa6adb4a640 1 -- 172.21.15.105:0/2450774756 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fa6a80b27c0 con 0x7fa6a815f390 2024-09-21T03:20:18.319 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.317+0000 7fa68ffff640 1 -- 172.21.15.105:0/2450774756 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v39) ==== 97+0+0 (secure 0 0 0) 0x7fa6a80b27c0 con 0x7fa6a815f390 2024-09-21T03:20:18.319 INFO:teuthology.orchestra.run.smithi105.stderr: removed all blocklist entries 2024-09-21T03:20:18.322 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.321+0000 7fa6adb4a640 1 -- 172.21.15.105:0/2450774756 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa694078bc0 msgr2=0x7fa69407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:18.323 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.321+0000 7fa6adb4a640 1 --2- 172.21.15.105:0/2450774756 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa694078bc0 0x7fa69407b0d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa69800a870 tx=0x7fa698008040 comp rx=0 tx=0).stop 2024-09-21T03:20:18.323 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.321+0000 7fa6adb4a640 1 -- 172.21.15.105:0/2450774756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6a815f390 msgr2=0x7fa6a815cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:18.323 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.321+0000 7fa6adb4a640 1 --2- 172.21.15.105:0/2450774756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6a815f390 0x7fa6a815cdc0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa6a000b990 tx=0x7fa6a000be50 comp rx=0 tx=0).stop 2024-09-21T03:20:18.323 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.321+0000 7fa6adb4a640 1 -- 172.21.15.105:0/2450774756 shutdown_connections 2024-09-21T03:20:18.323 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.321+0000 7fa6adb4a640 1 --2- 172.21.15.105:0/2450774756 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa694078bc0 0x7fa69407b0d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:18.323 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.321+0000 7fa6adb4a640 1 --2- 172.21.15.105:0/2450774756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6a815f390 0x7fa6a815cdc0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:18.323 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.321+0000 7fa6adb4a640 1 --2- 172.21.15.105:0/2450774756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6a80d3870 0x7fa6a815ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:18.323 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.321+0000 7fa6adb4a640 1 --2- 172.21.15.105:0/2450774756 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6a806f4b0 0x7fa6a815fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:18.323 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.321+0000 7fa6adb4a640 1 -- 172.21.15.105:0/2450774756 >> 172.21.15.105:0/2450774756 conn(0x7fa6a808bfc0 msgr2=0x7fa6a8161950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:18.323 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.321+0000 7fa6adb4a640 1 -- 172.21.15.105:0/2450774756 shutdown_connections 2024-09-21T03:20:18.323 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.321+0000 7fa6adb4a640 1 -- 172.21.15.105:0/2450774756 wait complete. 2024-09-21T03:20:18.335 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T03:20:18.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.446+0000 7f8a74c63640 1 -- 172.21.15.105:0/46742511 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a700d3870 msgr2=0x7f8a700ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:18.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.446+0000 7f8a74c63640 1 --2- 172.21.15.105:0/46742511 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a700d3870 0x7f8a700ceb40 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8a7008d9b0 tx=0x7f8a6802a560 comp rx=0 tx=0).stop 2024-09-21T03:20:18.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.446+0000 7f8a74c63640 1 -- 172.21.15.105:0/46742511 shutdown_connections 2024-09-21T03:20:18.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.446+0000 7f8a74c63640 1 --2- 172.21.15.105:0/46742511 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a700d3870 0x7f8a700ceb40 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:18.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.446+0000 7f8a74c63640 1 --2- 172.21.15.105:0/46742511 >> v2:172.21.15.162:3300/0 conn(0x7f8a700b3540 0x7f8a700d3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:18.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.446+0000 7f8a74c63640 1 -- 172.21.15.105:0/46742511 >> 172.21.15.105:0/46742511 conn(0x7f8a7008bfc0 msgr2=0x7f8a7009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:18.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.446+0000 7f8a74c63640 1 -- 172.21.15.105:0/46742511 shutdown_connections 2024-09-21T03:20:18.449 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.446+0000 7f8a74c63640 1 -- 172.21.15.105:0/46742511 wait complete. 2024-09-21T03:20:18.449 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.448+0000 7f8a74c63640 1 Processor -- start 2024-09-21T03:20:18.450 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.448+0000 7f8a74c63640 1 -- start start 2024-09-21T03:20:18.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.449+0000 7f8a74c63640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a700b3540 0x7f8a700ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:18.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.449+0000 7f8a74c63640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a700d3870 0x7f8a70155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:18.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.449+0000 7f8a74c63640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a701f88e0 0x7f8a701f8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:18.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.449+0000 7f8a74c63640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8a700d0ce0 con 0x7f8a701f88e0 2024-09-21T03:20:18.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.449+0000 7f8a74c63640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8a700cf490 con 0x7f8a700d3870 2024-09-21T03:20:18.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.449+0000 7f8a74c63640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8a700d0e60 con 0x7f8a700b3540 2024-09-21T03:20:18.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.450+0000 7f8a6ed9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a701f88e0 0x7f8a701f8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:18.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.450+0000 7f8a6ed9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a701f88e0 0x7f8a701f8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40954/0 (socket says 172.21.15.105:40954) 2024-09-21T03:20:18.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.450+0000 7f8a6ed9d640 1 -- 172.21.15.105:0/705995049 learned_addr learned my addr 172.21.15.105:0/705995049 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:18.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.450+0000 7f8a6dd9b640 1 --2- 172.21.15.105:0/705995049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a700d3870 0x7f8a70155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:18.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.450+0000 7f8a6e59c640 1 --2- 172.21.15.105:0/705995049 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a700b3540 0x7f8a700ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:18.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.450+0000 7f8a6ed9d640 1 -- 172.21.15.105:0/705995049 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a700b3540 msgr2=0x7f8a700ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:18.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.450+0000 7f8a6ed9d640 1 --2- 172.21.15.105:0/705995049 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a700b3540 0x7f8a700ca1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:18.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.450+0000 7f8a6ed9d640 1 -- 172.21.15.105:0/705995049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a700d3870 msgr2=0x7f8a70155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:18.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.450+0000 7f8a6ed9d640 1 --2- 172.21.15.105:0/705995049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a700d3870 0x7f8a70155b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:18.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.450+0000 7f8a6ed9d640 1 -- 172.21.15.105:0/705995049 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a701f9230 con 0x7f8a701f88e0 2024-09-21T03:20:18.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.450+0000 7f8a6e59c640 1 --2- 172.21.15.105:0/705995049 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a700b3540 0x7f8a700ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:20:18.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.450+0000 7f8a6dd9b640 1 --2- 172.21.15.105:0/705995049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a700d3870 0x7f8a70155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:20:18.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.450+0000 7f8a6ed9d640 1 --2- 172.21.15.105:0/705995049 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a701f88e0 0x7f8a701f8cf0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8a68034040 tx=0x7f8a68003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:18.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.450+0000 7f8a66ffd640 1 -- 172.21.15.105:0/705995049 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6803e030 con 0x7f8a701f88e0 2024-09-21T03:20:18.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.450+0000 7f8a66ffd640 1 -- 172.21.15.105:0/705995049 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a68003d10 con 0x7f8a701f88e0 2024-09-21T03:20:18.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.450+0000 7f8a66ffd640 1 -- 172.21.15.105:0/705995049 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a68035040 con 0x7f8a701f88e0 2024-09-21T03:20:18.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.450+0000 7f8a74c63640 1 -- 172.21.15.105:0/705995049 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a700cb5c0 con 0x7f8a701f88e0 2024-09-21T03:20:18.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.450+0000 7f8a74c63640 1 -- 172.21.15.105:0/705995049 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a700cbb80 con 0x7f8a701f88e0 2024-09-21T03:20:18.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.451+0000 7f8a74c63640 1 -- 172.21.15.105:0/705995049 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a7006e170 con 0x7f8a701f88e0 2024-09-21T03:20:18.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.452+0000 7f8a66ffd640 1 -- 172.21.15.105:0/705995049 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8a68041030 con 0x7f8a701f88e0 2024-09-21T03:20:18.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.452+0000 7f8a66ffd640 1 --2- 172.21.15.105:0/705995049 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8a50078bc0 0x7f8a5007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:18.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.452+0000 7f8a66ffd640 1 -- 172.21.15.105:0/705995049 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7f8a680bb4d0 con 0x7f8a701f88e0 2024-09-21T03:20:18.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.453+0000 7f8a6e59c640 1 --2- 172.21.15.105:0/705995049 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8a50078bc0 0x7f8a5007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:18.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.453+0000 7f8a6e59c640 1 --2- 172.21.15.105:0/705995049 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8a50078bc0 0x7f8a5007b0d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8a60001da0 tx=0x7f8a60009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:18.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.457+0000 7f8a66ffd640 1 -- 172.21.15.105:0/705995049 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8a701f9230 con 0x7f8a701f88e0 2024-09-21T03:20:18.704 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.703+0000 7f8a74c63640 1 -- 172.21.15.105:0/705995049 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f8a700ca8a0 con 0x7f8a701f88e0 2024-09-21T03:20:18.704 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.703+0000 7f8a66ffd640 1 -- 172.21.15.105:0/705995049 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) ==== 80+0+5304 (secure 0 0 0) 0x7f8a68083c60 con 0x7f8a701f88e0 2024-09-21T03:20:18.705 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:20:18.705 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-21T03:20:18.705 INFO:teuthology.orchestra.run.smithi105.stdout: "auth_dump": [ 2024-09-21T03:20:18.705 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:18.705 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mds.a", 2024-09-21T03:20:18.705 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mtIIZDhAAJIXLpzTFBOFhnOwLzsdL6w==", 2024-09-21T03:20:18.705 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:20:18.705 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:20:18.705 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:20:18.705 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:20:18.705 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:20:18.706 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:18.706 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:18.706 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:18.706 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mds.b", 2024-09-21T03:20:18.706 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mGKANGxAAeAuUYMtLP7GXKfIELR7qMA==", 2024-09-21T03:20:18.706 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:20:18.706 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:20:18.706 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:20:18.706 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:20:18.706 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:20:18.706 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:18.706 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:18.706 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:18.706 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mds.c", 2024-09-21T03:20:18.707 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mwQzQFRAAElYtgnIdYzzkeg8AtiU+kA==", 2024-09-21T03:20:18.707 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:20:18.707 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:20:18.707 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:20:18.707 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:20:18.707 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:20:18.707 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:18.707 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:18.707 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:18.707 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mds.d", 2024-09-21T03:20:18.707 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mZkWyIhAAu4XWptFcbDrYjozzrgMcGQ==", 2024-09-21T03:20:18.707 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:20:18.707 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:20:18.707 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:20:18.708 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:20:18.708 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:20:18.708 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:18.708 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:18.708 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:18.708 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.0", 2024-09-21T03:20:18.708 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDMOu5mrSk2BRAAuEPjuEeUJEI3Sa2fiLaJyw==", 2024-09-21T03:20:18.708 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:20:18.708 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:20:18.708 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:20:18.708 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:20:18.708 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:18.708 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:18.708 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:18.709 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.1", 2024-09-21T03:20:18.709 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDPOu5mAT4UCBAAase7NV3ARBSu4QloaQdlzA==", 2024-09-21T03:20:18.709 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:20:18.709 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:20:18.709 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:20:18.709 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:20:18.709 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:18.709 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:18.709 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:18.709 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.2", 2024-09-21T03:20:18.709 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDSOu5ma4LRChAASottrmolMcagbspeyGVzBQ==", 2024-09-21T03:20:18.709 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:20:18.709 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:20:18.709 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:20:18.710 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:20:18.710 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:18.710 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:18.710 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:18.710 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.3", 2024-09-21T03:20:18.710 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDVOu5mD5RWHBAAKuNr4F3GA0EP566aQ07ZVw==", 2024-09-21T03:20:18.710 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:20:18.710 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:20:18.710 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:20:18.710 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:20:18.710 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:18.710 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:18.710 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:18.710 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.4", 2024-09-21T03:20:18.711 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDcOu5m++UBChAAqmgoPBQ/as4tc+UQPwaflg==", 2024-09-21T03:20:18.711 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:20:18.711 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:20:18.711 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:20:18.711 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:20:18.711 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:18.711 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:18.711 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:18.711 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.5", 2024-09-21T03:20:18.711 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDfOu5maYYZKRAA1ungglTU3TW1B/XNRjBuZQ==", 2024-09-21T03:20:18.711 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:20:18.711 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:20:18.711 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:20:18.711 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:20:18.711 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:18.711 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:18.712 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:18.712 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.6", 2024-09-21T03:20:18.712 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDjOu5mmwIqHBAAf6oNdLNkmM9yufP8XA2+og==", 2024-09-21T03:20:18.712 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:20:18.712 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:20:18.712 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:20:18.712 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:20:18.712 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:18.712 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:18.712 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:18.712 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.7", 2024-09-21T03:20:18.712 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDmOu5mtCciHhAAPTnZubJ+7mGXcXZykCWxHg==", 2024-09-21T03:20:18.712 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:20:18.712 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:20:18.712 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:20:18.712 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:20:18.713 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:18.713 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:18.713 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:18.713 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.0", 2024-09-21T03:20:18.713 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mughoJxAAhY0bzJmq+oNyzCdtafkC9w==", 2024-09-21T03:20:18.713 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:20:18.713 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:20:18.713 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow r", 2024-09-21T03:20:18.713 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-21T03:20:18.713 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:18.713 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:18.713 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:18.713 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.1", 2024-09-21T03:20:18.713 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5m4Vn2LhAAnEa/01ql5quuRCVHOVwB7w==", 2024-09-21T03:20:18.713 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:20:18.714 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:20:18.714 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow r", 2024-09-21T03:20:18.714 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow rw", 2024-09-21T03:20:18.714 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow rwx" 2024-09-21T03:20:18.714 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:18.714 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:18.714 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:18.714 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.2", 2024-09-21T03:20:18.714 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mKi0mKxAAoetnL61ujgtg2cvscdjCLQ==", 2024-09-21T03:20:18.714 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:20:18.714 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:20:18.714 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow r", 2024-09-21T03:20:18.714 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow rw", 2024-09-21T03:20:18.714 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow rwx" 2024-09-21T03:20:18.715 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:18.715 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:18.715 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:18.715 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.3", 2024-09-21T03:20:18.715 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mWZDAMhAAs4BuFHMSkJa6+piN/FeeXQ==", 2024-09-21T03:20:18.715 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:20:18.715 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:20:18.715 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow r", 2024-09-21T03:20:18.715 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow rw", 2024-09-21T03:20:18.715 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow rwx" 2024-09-21T03:20:18.715 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:18.715 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:18.715 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:18.715 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.admin", 2024-09-21T03:20:18.716 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDHOu5m4JRYLBAAgZ8nh5VIiWhuZ4+vrnmngw==", 2024-09-21T03:20:18.716 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:20:18.716 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow *", 2024-09-21T03:20:18.716 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:20:18.716 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:20:18.716 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:20:18.716 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:18.716 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:18.716 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:18.716 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mgr.x", 2024-09-21T03:20:18.716 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5m92lTChAAQ61muQmc6uBs7b5mq3Zt8g==", 2024-09-21T03:20:18.716 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:20:18.716 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow *", 2024-09-21T03:20:18.716 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile mgr", 2024-09-21T03:20:18.717 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:20:18.717 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:18.717 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:18.717 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:18.717 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mgr.y", 2024-09-21T03:20:18.717 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mh07bBRAAflFF00xr1ew4zttUi5TGng==", 2024-09-21T03:20:18.717 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:20:18.717 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow *", 2024-09-21T03:20:18.717 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile mgr", 2024-09-21T03:20:18.717 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:20:18.717 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:18.717 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:18.717 INFO:teuthology.orchestra.run.smithi105.stdout: ] 2024-09-21T03:20:18.717 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-21T03:20:18.719 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.705+0000 7f8a74c63640 1 -- 172.21.15.105:0/705995049 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8a50078bc0 msgr2=0x7f8a5007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:18.719 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.705+0000 7f8a74c63640 1 --2- 172.21.15.105:0/705995049 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8a50078bc0 0x7f8a5007b0d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8a60001da0 tx=0x7f8a60009040 comp rx=0 tx=0).stop 2024-09-21T03:20:18.719 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.705+0000 7f8a74c63640 1 -- 172.21.15.105:0/705995049 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a701f88e0 msgr2=0x7f8a701f8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:18.719 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.705+0000 7f8a74c63640 1 --2- 172.21.15.105:0/705995049 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a701f88e0 0x7f8a701f8cf0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8a68034040 tx=0x7f8a68003820 comp rx=0 tx=0).stop 2024-09-21T03:20:18.719 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.705+0000 7f8a74c63640 1 -- 172.21.15.105:0/705995049 shutdown_connections 2024-09-21T03:20:18.719 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.705+0000 7f8a74c63640 1 --2- 172.21.15.105:0/705995049 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8a50078bc0 0x7f8a5007b0d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:18.719 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.705+0000 7f8a74c63640 1 --2- 172.21.15.105:0/705995049 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a701f88e0 0x7f8a701f8cf0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:18.719 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.705+0000 7f8a74c63640 1 --2- 172.21.15.105:0/705995049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a700d3870 0x7f8a70155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:18.719 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.705+0000 7f8a74c63640 1 --2- 172.21.15.105:0/705995049 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a700b3540 0x7f8a700ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:18.719 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.705+0000 7f8a74c63640 1 -- 172.21.15.105:0/705995049 >> 172.21.15.105:0/705995049 conn(0x7f8a7008bfc0 msgr2=0x7f8a7006eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:18.719 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.706+0000 7f8a74c63640 1 -- 172.21.15.105:0/705995049 shutdown_connections 2024-09-21T03:20:18.720 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.706+0000 7f8a74c63640 1 -- 172.21.15.105:0/705995049 wait complete. 2024-09-21T03:20:18.720 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T03:20:18.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.831+0000 7fa074b20640 1 -- 172.21.15.105:0/2889404666 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa05c003a00 msgr2=0x7fa05c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:18.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.831+0000 7fa074b20640 1 --2- 172.21.15.105:0/2889404666 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa05c003a00 0x7fa05c003e70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa060005fd0 tx=0x7fa05c005830 comp rx=0 tx=0).stop 2024-09-21T03:20:18.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.831+0000 7fa06ed9d640 1 -- 172.21.15.105:0/2889404666 reap_dead start 2024-09-21T03:20:18.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.831+0000 7fa074b20640 1 -- 172.21.15.105:0/2889404666 shutdown_connections 2024-09-21T03:20:18.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.831+0000 7fa074b20640 1 -- 172.21.15.105:0/2889404666 >> 172.21.15.105:0/2889404666 conn(0x7fa07009d7f0 msgr2=0x7fa0700d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:18.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.831+0000 7fa074b20640 1 -- 172.21.15.105:0/2889404666 shutdown_connections 2024-09-21T03:20:18.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.831+0000 7fa074b20640 1 -- 172.21.15.105:0/2889404666 wait complete. 2024-09-21T03:20:18.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.833+0000 7fa074b20640 1 Processor -- start 2024-09-21T03:20:18.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.833+0000 7fa074b20640 1 -- start start 2024-09-21T03:20:18.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.834+0000 7fa074b20640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa05c003a00 0x7fa0700ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:18.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.834+0000 7fa074b20640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0700cc320 0x7fa0700c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:18.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.834+0000 7fa074b20640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0701f8c30 0x7fa0701f9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:18.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.834+0000 7fa074b20640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa07006ee40 con 0x7fa0701f8c30 2024-09-21T03:20:18.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.834+0000 7fa074b20640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa07006ecc0 con 0x7fa05c003a00 2024-09-21T03:20:18.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.834+0000 7fa074b20640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa07006efc0 con 0x7fa0700cc320 2024-09-21T03:20:18.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.834+0000 7fa06ed9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0701f8c30 0x7fa0701f9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:18.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.834+0000 7fa06ed9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0701f8c30 0x7fa0701f9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40978/0 (socket says 172.21.15.105:40978) 2024-09-21T03:20:18.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.834+0000 7fa06ed9d640 1 -- 172.21.15.105:0/3301752907 learned_addr learned my addr 172.21.15.105:0/3301752907 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:18.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.834+0000 7fa06dd9b640 1 --2- 172.21.15.105:0/3301752907 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0700cc320 0x7fa0700c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:18.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.834+0000 7fa06e59c640 1 --2- 172.21.15.105:0/3301752907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa05c003a00 0x7fa0700ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:18.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.835+0000 7fa06ed9d640 1 -- 172.21.15.105:0/3301752907 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0700cc320 msgr2=0x7fa0700c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:18.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.835+0000 7fa06ed9d640 1 --2- 172.21.15.105:0/3301752907 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0700cc320 0x7fa0700c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:18.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.835+0000 7fa06ed9d640 1 -- 172.21.15.105:0/3301752907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa05c003a00 msgr2=0x7fa0700ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:18.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.835+0000 7fa06ed9d640 1 --2- 172.21.15.105:0/3301752907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa05c003a00 0x7fa0700ca980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:18.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.835+0000 7fa06ed9d640 1 -- 172.21.15.105:0/3301752907 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0700caec0 con 0x7fa0701f8c30 2024-09-21T03:20:18.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.835+0000 7fa06e59c640 1 --2- 172.21.15.105:0/3301752907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa05c003a00 0x7fa0700ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:20:18.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.835+0000 7fa06ed9d640 1 --2- 172.21.15.105:0/3301752907 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0701f8c30 0x7fa0701f9040 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa0700cb530 tx=0x7fa068011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:18.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.835+0000 7fa066ffd640 1 -- 172.21.15.105:0/3301752907 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa068004440 con 0x7fa0701f8c30 2024-09-21T03:20:18.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.835+0000 7fa066ffd640 1 -- 172.21.15.105:0/3301752907 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa06800f890 con 0x7fa0701f8c30 2024-09-21T03:20:18.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.835+0000 7fa074b20640 1 -- 172.21.15.105:0/3301752907 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0700cda50 con 0x7fa0701f8c30 2024-09-21T03:20:18.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.835+0000 7fa066ffd640 1 -- 172.21.15.105:0/3301752907 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06800fce0 con 0x7fa0701f8c30 2024-09-21T03:20:18.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.835+0000 7fa074b20640 1 -- 172.21.15.105:0/3301752907 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0700cb840 con 0x7fa0701f8c30 2024-09-21T03:20:18.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.836+0000 7fa074b20640 1 -- 172.21.15.105:0/3301752907 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0700cdcf0 con 0x7fa0701f8c30 2024-09-21T03:20:18.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.837+0000 7fa066ffd640 1 -- 172.21.15.105:0/3301752907 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa0680035f0 con 0x7fa0701f8c30 2024-09-21T03:20:18.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.837+0000 7fa066ffd640 1 --2- 172.21.15.105:0/3301752907 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa050078bf0 0x7fa05007b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:18.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.837+0000 7fa066ffd640 1 -- 172.21.15.105:0/3301752907 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7fa06809b520 con 0x7fa0701f8c30 2024-09-21T03:20:18.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.837+0000 7fa06e59c640 1 --2- 172.21.15.105:0/3301752907 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa050078bf0 0x7fa05007b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:18.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.838+0000 7fa06e59c640 1 --2- 172.21.15.105:0/3301752907 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa050078bf0 0x7fa05007b100 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa060035000 tx=0x7fa06002d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:18.843 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:18.842+0000 7fa066ffd640 1 -- 172.21.15.105:0/3301752907 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa0700caec0 con 0x7fa0701f8c30 2024-09-21T03:20:19.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.020+0000 7fa074b20640 1 -- 172.21.15.105:0/3301752907 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fa0700d4d80 con 0x7fa0701f8c30 2024-09-21T03:20:19.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.020+0000 7fa066ffd640 1 -- 172.21.15.105:0/3301752907 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v41) ==== 84+0+65 (secure 0 0 0) 0x7fa068063dd0 con 0x7fa0701f8c30 2024-09-21T03:20:19.022 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:20:19.022 INFO:teuthology.orchestra.run.smithi105.stdout:[ 2024-09-21T03:20:19.022 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:19.022 INFO:teuthology.orchestra.run.smithi105.stdout: "poolnum": 1, 2024-09-21T03:20:19.022 INFO:teuthology.orchestra.run.smithi105.stdout: "poolname": ".mgr" 2024-09-21T03:20:19.022 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:19.022 INFO:teuthology.orchestra.run.smithi105.stdout:] 2024-09-21T03:20:19.024 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.022+0000 7fa074b20640 1 -- 172.21.15.105:0/3301752907 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa050078bf0 msgr2=0x7fa05007b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:19.024 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.022+0000 7fa074b20640 1 --2- 172.21.15.105:0/3301752907 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa050078bf0 0x7fa05007b100 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa060035000 tx=0x7fa06002d040 comp rx=0 tx=0).stop 2024-09-21T03:20:19.024 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.022+0000 7fa074b20640 1 -- 172.21.15.105:0/3301752907 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0701f8c30 msgr2=0x7fa0701f9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:19.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.022+0000 7fa074b20640 1 --2- 172.21.15.105:0/3301752907 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0701f8c30 0x7fa0701f9040 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa0700cb530 tx=0x7fa068011b50 comp rx=0 tx=0).stop 2024-09-21T03:20:19.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.022+0000 7fa074b20640 1 -- 172.21.15.105:0/3301752907 shutdown_connections 2024-09-21T03:20:19.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.022+0000 7fa074b20640 1 --2- 172.21.15.105:0/3301752907 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa050078bf0 0x7fa05007b100 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:19.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.022+0000 7fa074b20640 1 --2- 172.21.15.105:0/3301752907 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0701f8c30 0x7fa0701f9040 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:19.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.022+0000 7fa074b20640 1 --2- 172.21.15.105:0/3301752907 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0700cc320 0x7fa0700c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:19.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.022+0000 7fa074b20640 1 --2- 172.21.15.105:0/3301752907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa05c003a00 0x7fa0700ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:19.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.022+0000 7fa074b20640 1 -- 172.21.15.105:0/3301752907 >> 172.21.15.105:0/3301752907 conn(0x7fa07009d7f0 msgr2=0x7fa0700b8630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:19.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.022+0000 7fa074b20640 1 -- 172.21.15.105:0/3301752907 shutdown_connections 2024-09-21T03:20:19.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.023+0000 7fa074b20640 1 -- 172.21.15.105:0/3301752907 wait complete. 2024-09-21T03:20:19.036 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T03:20:19.036 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T03:20:19.151 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.149+0000 7f9f51207640 1 -- 172.21.15.105:0/3004053703 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f4c15cc50 msgr2=0x7f9f4c15d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:19.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.149+0000 7f9f51207640 1 --2- 172.21.15.105:0/3004053703 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f4c15cc50 0x7f9f4c15d820 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c0d2fc0 tx=0x7f9f3c02a4d0 comp rx=0 tx=0).stop 2024-09-21T03:20:19.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.150+0000 7f9f51207640 1 -- 172.21.15.105:0/3004053703 shutdown_connections 2024-09-21T03:20:19.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.150+0000 7f9f51207640 1 --2- 172.21.15.105:0/3004053703 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9f4c0cef20 0x7f9f4c0ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:19.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.150+0000 7f9f51207640 1 --2- 172.21.15.105:0/3004053703 >> v2:172.21.15.162:3300/0 conn(0x7f9f4c0ceb10 0x7f9f4c0cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:19.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.150+0000 7f9f51207640 1 --2- 172.21.15.105:0/3004053703 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f4c15cc50 0x7f9f4c15d820 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:19.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.150+0000 7f9f51207640 1 -- 172.21.15.105:0/3004053703 >> 172.21.15.105:0/3004053703 conn(0x7f9f4c0b3ea0 msgr2=0x7f9f4c0b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:19.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.150+0000 7f9f51207640 1 -- 172.21.15.105:0/3004053703 shutdown_connections 2024-09-21T03:20:19.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.150+0000 7f9f51207640 1 -- 172.21.15.105:0/3004053703 wait complete. 2024-09-21T03:20:19.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.151+0000 7f9f51207640 1 Processor -- start 2024-09-21T03:20:19.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.152+0000 7f9f51207640 1 -- start start 2024-09-21T03:20:19.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.153+0000 7f9f51207640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9f4c0ceb10 0x7f9f4c15a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:19.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.153+0000 7f9f51207640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f4c0cef20 0x7f9f4c14c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:19.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.153+0000 7f9f51207640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f4c15cc50 0x7f9f4c0b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:19.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.153+0000 7f9f51207640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4c160b80 con 0x7f9f4c0cef20 2024-09-21T03:20:19.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.153+0000 7f9f51207640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4c160a00 con 0x7f9f4c15cc50 2024-09-21T03:20:19.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.153+0000 7f9f51207640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9f4c160d00 con 0x7f9f4c0ceb10 2024-09-21T03:20:19.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.153+0000 7f9f4259c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f4c0cef20 0x7f9f4c14c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:19.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.153+0000 7f9f4259c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f4c0cef20 0x7f9f4c14c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40994/0 (socket says 172.21.15.105:40994) 2024-09-21T03:20:19.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.153+0000 7f9f4259c640 1 -- 172.21.15.105:0/1792803346 learned_addr learned my addr 172.21.15.105:0/1792803346 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:19.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.153+0000 7f9f4b59e640 1 --2- 172.21.15.105:0/1792803346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f4c15cc50 0x7f9f4c0b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:19.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.153+0000 7f9f4ad9d640 1 --2- 172.21.15.105:0/1792803346 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9f4c0ceb10 0x7f9f4c15a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:19.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.153+0000 7f9f4259c640 1 -- 172.21.15.105:0/1792803346 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9f4c0ceb10 msgr2=0x7f9f4c15a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:19.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.153+0000 7f9f4259c640 1 --2- 172.21.15.105:0/1792803346 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9f4c0ceb10 0x7f9f4c15a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:19.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.153+0000 7f9f4259c640 1 -- 172.21.15.105:0/1792803346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f4c15cc50 msgr2=0x7f9f4c0b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:19.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.153+0000 7f9f4259c640 1 --2- 172.21.15.105:0/1792803346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f4c15cc50 0x7f9f4c0b1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:19.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.153+0000 7f9f4259c640 1 -- 172.21.15.105:0/1792803346 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f4c1f4560 con 0x7f9f4c0cef20 2024-09-21T03:20:19.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.154+0000 7f9f4259c640 1 --2- 172.21.15.105:0/1792803346 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f4c0cef20 0x7f9f4c14c720 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9f340058c0 tx=0x7f9f3400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:19.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.154+0000 7f9f43fff640 1 -- 172.21.15.105:0/1792803346 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f34017070 con 0x7f9f4c0cef20 2024-09-21T03:20:19.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.154+0000 7f9f43fff640 1 -- 172.21.15.105:0/1792803346 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f34009a10 con 0x7f9f4c0cef20 2024-09-21T03:20:19.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.154+0000 7f9f51207640 1 -- 172.21.15.105:0/1792803346 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f4c1f6dc0 con 0x7f9f4c0cef20 2024-09-21T03:20:19.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.154+0000 7f9f43fff640 1 -- 172.21.15.105:0/1792803346 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f34009e40 con 0x7f9f4c0cef20 2024-09-21T03:20:19.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.154+0000 7f9f51207640 1 -- 172.21.15.105:0/1792803346 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f4c1f7380 con 0x7f9f4c0cef20 2024-09-21T03:20:19.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.155+0000 7f9f51207640 1 -- 172.21.15.105:0/1792803346 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f4c050f60 con 0x7f9f4c0cef20 2024-09-21T03:20:19.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.155+0000 7f9f43fff640 1 -- 172.21.15.105:0/1792803346 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9f3401a070 con 0x7f9f4c0cef20 2024-09-21T03:20:19.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.156+0000 7f9f43fff640 1 --2- 172.21.15.105:0/1792803346 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9f2c078b90 0x7f9f2c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:19.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.156+0000 7f9f43fff640 1 -- 172.21.15.105:0/1792803346 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7f9f3409a970 con 0x7f9f4c0cef20 2024-09-21T03:20:19.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.156+0000 7f9f4ad9d640 1 --2- 172.21.15.105:0/1792803346 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9f2c078b90 0x7f9f2c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:19.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.157+0000 7f9f4ad9d640 1 --2- 172.21.15.105:0/1792803346 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9f2c078b90 0x7f9f2c07b0a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c033000 tx=0x7f9f3c004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:19.162 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.160+0000 7f9f43fff640 1 -- 172.21.15.105:0/1792803346 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9f4c050f60 con 0x7f9f4c0cef20 2024-09-21T03:20:19.342 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:19.341+0000 7f9f51207640 1 -- 172.21.15.105:0/1792803346 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f9f4c15d820 con 0x7f9f4c0cef20 2024-09-21T03:20:20.332 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.330+0000 7f9f43fff640 1 -- 172.21.15.105:0/1792803346 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v42) ==== 138+0+0 (secure 0 0 0) 0x7f9f34062ab0 con 0x7f9f4c0cef20 2024-09-21T03:20:20.332 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_metadata' created 2024-09-21T03:20:20.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.333+0000 7f9f51207640 1 -- 172.21.15.105:0/1792803346 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9f2c078b90 msgr2=0x7f9f2c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:20.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.333+0000 7f9f51207640 1 --2- 172.21.15.105:0/1792803346 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9f2c078b90 0x7f9f2c07b0a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c033000 tx=0x7f9f3c004730 comp rx=0 tx=0).stop 2024-09-21T03:20:20.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.333+0000 7f9f51207640 1 -- 172.21.15.105:0/1792803346 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f4c0cef20 msgr2=0x7f9f4c14c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:20.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.333+0000 7f9f51207640 1 --2- 172.21.15.105:0/1792803346 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f4c0cef20 0x7f9f4c14c720 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9f340058c0 tx=0x7f9f3400dae0 comp rx=0 tx=0).stop 2024-09-21T03:20:20.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.333+0000 7f9f51207640 1 -- 172.21.15.105:0/1792803346 shutdown_connections 2024-09-21T03:20:20.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.333+0000 7f9f51207640 1 --2- 172.21.15.105:0/1792803346 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9f2c078b90 0x7f9f2c07b0a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:20.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.333+0000 7f9f51207640 1 --2- 172.21.15.105:0/1792803346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f4c15cc50 0x7f9f4c0b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:20.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.333+0000 7f9f51207640 1 --2- 172.21.15.105:0/1792803346 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f4c0cef20 0x7f9f4c14c720 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:20.336 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.333+0000 7f9f51207640 1 --2- 172.21.15.105:0/1792803346 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9f4c0ceb10 0x7f9f4c15a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:20.336 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.333+0000 7f9f51207640 1 -- 172.21.15.105:0/1792803346 >> 172.21.15.105:0/1792803346 conn(0x7f9f4c0b3ea0 msgr2=0x7f9f4c0d2580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:20.336 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.333+0000 7f9f51207640 1 -- 172.21.15.105:0/1792803346 shutdown_connections 2024-09-21T03:20:20.336 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.333+0000 7f9f51207640 1 -- 172.21.15.105:0/1792803346 wait complete. 2024-09-21T03:20:20.352 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T03:20:20.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.475+0000 7ff1bf582640 1 -- 172.21.15.105:0/2893496921 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff1b80d24d0 msgr2=0x7ff1b80d28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:20.478 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.475+0000 7ff1bf582640 1 --2- 172.21.15.105:0/2893496921 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff1b80d24d0 0x7ff1b80d28e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8009830 tx=0x7ff1a802a510 comp rx=0 tx=0).stop 2024-09-21T03:20:20.478 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.476+0000 7ff1bf582640 1 -- 172.21.15.105:0/2893496921 shutdown_connections 2024-09-21T03:20:20.478 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.476+0000 7ff1bf582640 1 --2- 172.21.15.105:0/2893496921 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff1b80d24d0 0x7ff1b80d28e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:20.478 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.476+0000 7ff1bf582640 1 --2- 172.21.15.105:0/2893496921 >> v2:172.21.15.162:3300/0 conn(0x7ff1b80d12b0 0x7ff1b80d16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:20.478 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.476+0000 7ff1bf582640 1 -- 172.21.15.105:0/2893496921 >> 172.21.15.105:0/2893496921 conn(0x7ff1b809d6e0 msgr2=0x7ff1b80d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:20.478 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.476+0000 7ff1bf582640 1 -- 172.21.15.105:0/2893496921 shutdown_connections 2024-09-21T03:20:20.478 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.476+0000 7ff1bf582640 1 -- 172.21.15.105:0/2893496921 wait complete. 2024-09-21T03:20:20.479 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.477+0000 7ff1bf582640 1 Processor -- start 2024-09-21T03:20:20.479 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.477+0000 7ff1bf582640 1 -- start start 2024-09-21T03:20:20.481 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.479+0000 7ff1bf582640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1b80b96a0 0x7ff1b815c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:20.481 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.479+0000 7ff1bf582640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff1b80d12b0 0x7ff1b8161d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:20.481 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.479+0000 7ff1bf582640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1b80d24d0 0x7ff1b806e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:20.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.479+0000 7ff1bf582640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b80d4e50 con 0x7ff1b80b96a0 2024-09-21T03:20:20.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.479+0000 7ff1bf582640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b80b5100 con 0x7ff1b80d24d0 2024-09-21T03:20:20.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.479+0000 7ff1bf582640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff1b80d4fd0 con 0x7ff1b80d12b0 2024-09-21T03:20:20.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.479+0000 7ff1be580640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1b80b96a0 0x7ff1b815c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:20.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.479+0000 7ff1be580640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1b80b96a0 0x7ff1b815c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41010/0 (socket says 172.21.15.105:41010) 2024-09-21T03:20:20.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.479+0000 7ff1be580640 1 -- 172.21.15.105:0/2201403606 learned_addr learned my addr 172.21.15.105:0/2201403606 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:20.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.479+0000 7ff1bdd7f640 1 --2- 172.21.15.105:0/2201403606 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff1b80d12b0 0x7ff1b8161d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:20.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.479+0000 7ff1bed81640 1 --2- 172.21.15.105:0/2201403606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1b80d24d0 0x7ff1b806e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:20.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.479+0000 7ff1be580640 1 -- 172.21.15.105:0/2201403606 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff1b80d12b0 msgr2=0x7ff1b8161d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:20.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.479+0000 7ff1be580640 1 --2- 172.21.15.105:0/2201403606 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff1b80d12b0 0x7ff1b8161d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:20.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.479+0000 7ff1be580640 1 -- 172.21.15.105:0/2201403606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1b80d24d0 msgr2=0x7ff1b806e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:20.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.479+0000 7ff1be580640 1 --2- 172.21.15.105:0/2201403606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1b80d24d0 0x7ff1b806e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:20.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.479+0000 7ff1be580640 1 -- 172.21.15.105:0/2201403606 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1b8168320 con 0x7ff1b80b96a0 2024-09-21T03:20:20.483 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.479+0000 7ff1be580640 1 --2- 172.21.15.105:0/2201403606 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1b80b96a0 0x7ff1b815c5c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff1b400c730 tx=0x7ff1b400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:20.483 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.479+0000 7ff1aeffd640 1 -- 172.21.15.105:0/2201403606 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4006ae0 con 0x7ff1b80b96a0 2024-09-21T03:20:20.483 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.479+0000 7ff1bf582640 1 -- 172.21.15.105:0/2201403606 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1b80ce280 con 0x7ff1b80b96a0 2024-09-21T03:20:20.483 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.479+0000 7ff1aeffd640 1 -- 172.21.15.105:0/2201403606 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1b4006c80 con 0x7ff1b80b96a0 2024-09-21T03:20:20.483 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.479+0000 7ff1aeffd640 1 -- 172.21.15.105:0/2201403606 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4007290 con 0x7ff1b80b96a0 2024-09-21T03:20:20.483 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.479+0000 7ff1bf582640 1 -- 172.21.15.105:0/2201403606 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1b81688a0 con 0x7ff1b80b96a0 2024-09-21T03:20:20.484 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.480+0000 7ff1bf582640 1 -- 172.21.15.105:0/2201403606 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1b80d0590 con 0x7ff1b80b96a0 2024-09-21T03:20:20.484 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.481+0000 7ff1aeffd640 1 -- 172.21.15.105:0/2201403606 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff1b4007430 con 0x7ff1b80b96a0 2024-09-21T03:20:20.484 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.482+0000 7ff1aeffd640 1 --2- 172.21.15.105:0/2201403606 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff19c078b90 0x7ff19c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:20.484 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.482+0000 7ff1aeffd640 1 -- 172.21.15.105:0/2201403606 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5227+0+0 (secure 0 0 0) 0x7ff1b409a5f0 con 0x7ff1b80b96a0 2024-09-21T03:20:20.484 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.482+0000 7ff1bdd7f640 1 --2- 172.21.15.105:0/2201403606 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff19c078b90 0x7ff19c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:20.484 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.482+0000 7ff1bdd7f640 1 --2- 172.21.15.105:0/2201403606 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff19c078b90 0x7ff19c07b0a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8034000 tx=0x7ff1a8004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:20.488 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.486+0000 7ff1aeffd640 1 -- 172.21.15.105:0/2201403606 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff1b80d0590 con 0x7ff1b80b96a0 2024-09-21T03:20:20.666 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:20.664+0000 7ff1bf582640 1 -- 172.21.15.105:0/2201403606 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff1b80d16c0 con 0x7ff1b80b96a0 2024-09-21T03:20:21.340 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.338+0000 7ff1aeffd640 1 -- 172.21.15.105:0/2201403606 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v43) ==== 170+0+0 (secure 0 0 0) 0x7ff1b80cf6d0 con 0x7ff1b80b96a0 2024-09-21T03:20:21.340 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_data' created 2024-09-21T03:20:21.343 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.341+0000 7ff1bf582640 1 -- 172.21.15.105:0/2201403606 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff19c078b90 msgr2=0x7ff19c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:21.343 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.341+0000 7ff1bf582640 1 --2- 172.21.15.105:0/2201403606 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff19c078b90 0x7ff19c07b0a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8034000 tx=0x7ff1a8004730 comp rx=0 tx=0).stop 2024-09-21T03:20:21.343 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.341+0000 7ff1bf582640 1 -- 172.21.15.105:0/2201403606 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1b80b96a0 msgr2=0x7ff1b815c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:21.343 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.341+0000 7ff1bf582640 1 --2- 172.21.15.105:0/2201403606 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1b80b96a0 0x7ff1b815c5c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff1b400c730 tx=0x7ff1b400cbf0 comp rx=0 tx=0).stop 2024-09-21T03:20:21.343 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.341+0000 7ff1bf582640 1 -- 172.21.15.105:0/2201403606 shutdown_connections 2024-09-21T03:20:21.343 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.341+0000 7ff1bf582640 1 --2- 172.21.15.105:0/2201403606 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff19c078b90 0x7ff19c07b0a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:21.344 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.341+0000 7ff1bf582640 1 --2- 172.21.15.105:0/2201403606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1b80d24d0 0x7ff1b806e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:21.344 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.341+0000 7ff1bf582640 1 --2- 172.21.15.105:0/2201403606 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff1b80d12b0 0x7ff1b8161d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:21.344 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.341+0000 7ff1bf582640 1 --2- 172.21.15.105:0/2201403606 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1b80b96a0 0x7ff1b815c5c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:21.344 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.341+0000 7ff1bf582640 1 -- 172.21.15.105:0/2201403606 >> 172.21.15.105:0/2201403606 conn(0x7ff1b809d6e0 msgr2=0x7ff1b80b8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:21.344 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.341+0000 7ff1bf582640 1 -- 172.21.15.105:0/2201403606 shutdown_connections 2024-09-21T03:20:21.344 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.341+0000 7ff1bf582640 1 -- 172.21.15.105:0/2201403606 wait complete. 2024-09-21T03:20:21.364 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T03:20:21.480 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.478+0000 7f3bf8e4d640 1 -- 172.21.15.105:0/2512997013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3bf40cec50 msgr2=0x7f3bf40cf060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:21.480 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.478+0000 7f3bf8e4d640 1 --2- 172.21.15.105:0/2512997013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3bf40cec50 0x7f3bf40cf060 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3bf40b4ea0 tx=0x7f3bec02ab40 comp rx=0 tx=0).stop 2024-09-21T03:20:21.480 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.478+0000 7f3bf8e4d640 1 -- 172.21.15.105:0/2512997013 shutdown_connections 2024-09-21T03:20:21.480 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.478+0000 7f3bf8e4d640 1 --2- 172.21.15.105:0/2512997013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3bf40cec50 0x7f3bf40cf060 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:21.480 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.478+0000 7f3bf8e4d640 1 --2- 172.21.15.105:0/2512997013 >> v2:172.21.15.162:3300/0 conn(0x7f3bf4161020 0x7f3bf40ccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:21.480 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.478+0000 7f3bf8e4d640 1 -- 172.21.15.105:0/2512997013 >> 172.21.15.105:0/2512997013 conn(0x7f3bf406d4f0 msgr2=0x7f3bf4071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:21.481 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.478+0000 7f3bf8e4d640 1 -- 172.21.15.105:0/2512997013 shutdown_connections 2024-09-21T03:20:21.481 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.478+0000 7f3bf8e4d640 1 -- 172.21.15.105:0/2512997013 wait complete. 2024-09-21T03:20:21.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.480+0000 7f3bf8e4d640 1 Processor -- start 2024-09-21T03:20:21.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.480+0000 7f3bf8e4d640 1 -- start start 2024-09-21T03:20:21.485 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.482+0000 7f3bf8e4d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bf40cec50 0x7f3bf40b4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:21.485 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.482+0000 7f3bf8e4d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3bf4156f10 0x7f3bf41558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:21.485 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.482+0000 7f3bf8e4d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bf4161020 0x7f3bf40cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:21.485 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.482+0000 7f3bf8e4d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf40d08c0 con 0x7f3bf4156f10 2024-09-21T03:20:21.485 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.482+0000 7f3bf8e4d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf40d0740 con 0x7f3bf4161020 2024-09-21T03:20:21.485 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.482+0000 7f3bf8e4d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3bf40d0a40 con 0x7f3bf40cec50 2024-09-21T03:20:21.485 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.482+0000 7f3be9d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3bf4156f10 0x7f3bf41558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:21.485 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.482+0000 7f3be9d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3bf4156f10 0x7f3bf41558e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:57750/0 (socket says 172.21.15.105:57750) 2024-09-21T03:20:21.486 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.482+0000 7f3be9d9b640 1 -- 172.21.15.105:0/1370477963 learned_addr learned my addr 172.21.15.105:0/1370477963 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:21.486 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.482+0000 7f3bf2d9d640 1 --2- 172.21.15.105:0/1370477963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bf4161020 0x7f3bf40cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:21.486 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.482+0000 7f3bf259c640 1 --2- 172.21.15.105:0/1370477963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bf40cec50 0x7f3bf40b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:21.486 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.482+0000 7f3be9d9b640 1 -- 172.21.15.105:0/1370477963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bf40cec50 msgr2=0x7f3bf40b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:21.486 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.482+0000 7f3be9d9b640 1 --2- 172.21.15.105:0/1370477963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bf40cec50 0x7f3bf40b4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:21.486 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.482+0000 7f3be9d9b640 1 -- 172.21.15.105:0/1370477963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bf4161020 msgr2=0x7f3bf40cbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:21.486 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.482+0000 7f3be9d9b640 1 --2- 172.21.15.105:0/1370477963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bf4161020 0x7f3bf40cbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:21.486 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.482+0000 7f3be9d9b640 1 -- 172.21.15.105:0/1370477963 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bf40c9540 con 0x7f3bf4156f10 2024-09-21T03:20:21.486 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.482+0000 7f3be9d9b640 1 --2- 172.21.15.105:0/1370477963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3bf4156f10 0x7f3bf41558e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc00c400 tx=0x7f3bdc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:21.486 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.482+0000 7f3beb7fe640 1 -- 172.21.15.105:0/1370477963 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc017070 con 0x7f3bf4156f10 2024-09-21T03:20:21.486 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.482+0000 7f3beb7fe640 1 -- 172.21.15.105:0/1370477963 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3bdc0053c0 con 0x7f3bf4156f10 2024-09-21T03:20:21.486 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.482+0000 7f3bf8e4d640 1 -- 172.21.15.105:0/1370477963 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bf40c9820 con 0x7f3bf4156f10 2024-09-21T03:20:21.486 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.482+0000 7f3beb7fe640 1 -- 172.21.15.105:0/1370477963 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc003850 con 0x7f3bf4156f10 2024-09-21T03:20:21.487 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.482+0000 7f3bf8e4d640 1 -- 172.21.15.105:0/1370477963 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bf40cb860 con 0x7f3bf4156f10 2024-09-21T03:20:21.487 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.484+0000 7f3bf8e4d640 1 -- 172.21.15.105:0/1370477963 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bf40d0f60 con 0x7f3bf4156f10 2024-09-21T03:20:21.487 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.484+0000 7f3beb7fe640 1 -- 172.21.15.105:0/1370477963 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3bdc01a070 con 0x7f3bf4156f10 2024-09-21T03:20:21.487 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.485+0000 7f3beb7fe640 1 --2- 172.21.15.105:0/1370477963 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3bd4078b90 0x7f3bd407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:21.488 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.485+0000 7f3beb7fe640 1 -- 172.21.15.105:0/1370477963 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5609+0+0 (secure 0 0 0) 0x7f3bdc09a120 con 0x7f3bf4156f10 2024-09-21T03:20:21.488 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.485+0000 7f3bf259c640 1 --2- 172.21.15.105:0/1370477963 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3bd4078b90 0x7f3bd407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:21.488 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.486+0000 7f3bf259c640 1 --2- 172.21.15.105:0/1370477963 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3bd4078b90 0x7f3bd407b0a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3be4009b30 tx=0x7f3be4005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:21.491 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.490+0000 7f3beb7fe640 1 -- 172.21.15.105:0/1370477963 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3bdc061ef0 con 0x7f3bf4156f10 2024-09-21T03:20:21.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:21.705+0000 7f3bf8e4d640 1 -- 172.21.15.105:0/1370477963 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f3bf40cf380 con 0x7f3bf4156f10 2024-09-21T03:20:22.341 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.340+0000 7f3beb7fe640 1 -- 172.21.15.105:0/1370477963 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v22) ==== 172+0+0 (secure 0 0 0) 0x7f3bdc066920 con 0x7f3bf4156f10 2024-09-21T03:20:22.341 INFO:teuthology.orchestra.run.smithi105.stderr:new fs with metadata pool 6 and data pool 7 2024-09-21T03:20:22.344 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.342+0000 7f3bf8e4d640 1 -- 172.21.15.105:0/1370477963 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3bd4078b90 msgr2=0x7f3bd407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:22.344 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.342+0000 7f3bf8e4d640 1 --2- 172.21.15.105:0/1370477963 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3bd4078b90 0x7f3bd407b0a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3be4009b30 tx=0x7f3be4005f90 comp rx=0 tx=0).stop 2024-09-21T03:20:22.344 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.342+0000 7f3bf8e4d640 1 -- 172.21.15.105:0/1370477963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3bf4156f10 msgr2=0x7f3bf41558e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:22.344 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.342+0000 7f3bf8e4d640 1 --2- 172.21.15.105:0/1370477963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3bf4156f10 0x7f3bf41558e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc00c400 tx=0x7f3bdc00c8c0 comp rx=0 tx=0).stop 2024-09-21T03:20:22.344 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.342+0000 7f3bf8e4d640 1 -- 172.21.15.105:0/1370477963 shutdown_connections 2024-09-21T03:20:22.344 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.342+0000 7f3bf8e4d640 1 --2- 172.21.15.105:0/1370477963 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3bd4078b90 0x7f3bd407b0a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:22.344 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.342+0000 7f3bf8e4d640 1 --2- 172.21.15.105:0/1370477963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bf4161020 0x7f3bf40cbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:22.344 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.342+0000 7f3bf8e4d640 1 --2- 172.21.15.105:0/1370477963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3bf4156f10 0x7f3bf41558e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:22.344 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.342+0000 7f3bf8e4d640 1 --2- 172.21.15.105:0/1370477963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bf40cec50 0x7f3bf40b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:22.345 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.342+0000 7f3bf8e4d640 1 -- 172.21.15.105:0/1370477963 >> 172.21.15.105:0/1370477963 conn(0x7f3bf406d4f0 msgr2=0x7f3bf4156700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:22.345 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.342+0000 7f3bf8e4d640 1 -- 172.21.15.105:0/1370477963 shutdown_connections 2024-09-21T03:20:22.345 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.342+0000 7f3bf8e4d640 1 -- 172.21.15.105:0/1370477963 wait complete. 2024-09-21T03:20:22.379 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:20:22.491 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.489+0000 7f052d7eb640 1 -- 172.21.15.105:0/21345467 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05280cf540 msgr2=0x7f052806eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:22.491 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.489+0000 7f052d7eb640 1 --2- 172.21.15.105:0/21345467 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05280cf540 0x7f052806eab0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0520005fd0 tx=0x7f052002a8e0 comp rx=0 tx=0).stop 2024-09-21T03:20:22.491 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.489+0000 7f052d7eb640 1 -- 172.21.15.105:0/21345467 shutdown_connections 2024-09-21T03:20:22.491 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.489+0000 7f052d7eb640 1 --2- 172.21.15.105:0/21345467 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05280cf540 0x7f052806eab0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:22.491 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.489+0000 7f052d7eb640 1 --2- 172.21.15.105:0/21345467 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05280b66b0 0x7f05280d4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:22.491 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.489+0000 7f052d7eb640 1 -- 172.21.15.105:0/21345467 >> 172.21.15.105:0/21345467 conn(0x7f052809d7f0 msgr2=0x7f05280d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:22.492 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.489+0000 7f052d7eb640 1 -- 172.21.15.105:0/21345467 shutdown_connections 2024-09-21T03:20:22.492 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.489+0000 7f052d7eb640 1 -- 172.21.15.105:0/21345467 wait complete. 2024-09-21T03:20:22.492 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.491+0000 7f052d7eb640 1 Processor -- start 2024-09-21T03:20:22.492 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.491+0000 7f052d7eb640 1 -- start start 2024-09-21T03:20:22.495 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.492+0000 7f052d7eb640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05280b9b60 0x7f05280b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:22.495 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.492+0000 7f052d7eb640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05280cf540 0x7f05281f4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:22.496 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.492+0000 7f052d7eb640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05280b7370 0x7f05280b7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:22.496 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.492+0000 7f052d7eb640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f052806f5d0 con 0x7f05280cf540 2024-09-21T03:20:22.496 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.492+0000 7f052d7eb640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f052806f450 con 0x7f05280b9b60 2024-09-21T03:20:22.496 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.492+0000 7f052d7eb640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f052806f750 con 0x7f05280b7370 2024-09-21T03:20:22.496 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.492+0000 7f051e7fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05280cf540 0x7f05281f4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:22.496 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.492+0000 7f051e7fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05280cf540 0x7f05281f4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:57782/0 (socket says 172.21.15.105:57782) 2024-09-21T03:20:22.496 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.493+0000 7f051e7fc640 1 -- 172.21.15.105:0/1389570659 learned_addr learned my addr 172.21.15.105:0/1389570659 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:22.496 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.493+0000 7f05277fe640 1 --2- 172.21.15.105:0/1389570659 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05280b7370 0x7f05280b7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:22.496 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.493+0000 7f0526ffd640 1 --2- 172.21.15.105:0/1389570659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05280b9b60 0x7f05280b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:22.496 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.493+0000 7f051e7fc640 1 -- 172.21.15.105:0/1389570659 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05280b7370 msgr2=0x7f05280b7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:22.496 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.493+0000 7f051e7fc640 1 --2- 172.21.15.105:0/1389570659 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05280b7370 0x7f05280b7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:22.496 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.493+0000 7f051e7fc640 1 -- 172.21.15.105:0/1389570659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05280b9b60 msgr2=0x7f05280b4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:22.496 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.493+0000 7f051e7fc640 1 --2- 172.21.15.105:0/1389570659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05280b9b60 0x7f05280b4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:22.497 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.493+0000 7f051e7fc640 1 -- 172.21.15.105:0/1389570659 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05280b7cc0 con 0x7f05280cf540 2024-09-21T03:20:22.497 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.493+0000 7f05277fe640 1 --2- 172.21.15.105:0/1389570659 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05280b7370 0x7f05280b7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:20:22.497 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.493+0000 7f0526ffd640 1 --2- 172.21.15.105:0/1389570659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05280b9b60 0x7f05280b4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:20:22.497 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.493+0000 7f051e7fc640 1 --2- 172.21.15.105:0/1389570659 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05280cf540 0x7f05281f4bb0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f051000d6d0 tx=0x7f051000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:22.497 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.493+0000 7f051ffff640 1 -- 172.21.15.105:0/1389570659 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0510017070 con 0x7f05280cf540 2024-09-21T03:20:22.497 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.493+0000 7f051ffff640 1 -- 172.21.15.105:0/1389570659 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0510005330 con 0x7f05280cf540 2024-09-21T03:20:22.497 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.493+0000 7f052d7eb640 1 -- 172.21.15.105:0/1389570659 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f052815d370 con 0x7f05280cf540 2024-09-21T03:20:22.497 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.493+0000 7f051ffff640 1 -- 172.21.15.105:0/1389570659 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0510009820 con 0x7f05280cf540 2024-09-21T03:20:22.497 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.493+0000 7f052d7eb640 1 -- 172.21.15.105:0/1389570659 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f052815d930 con 0x7f05280cf540 2024-09-21T03:20:22.497 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.494+0000 7f052d7eb640 1 -- 172.21.15.105:0/1389570659 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f052806fcd0 con 0x7f05280cf540 2024-09-21T03:20:22.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.495+0000 7f051ffff640 1 -- 172.21.15.105:0/1389570659 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f05100099c0 con 0x7f05280cf540 2024-09-21T03:20:22.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.495+0000 7f051ffff640 1 --2- 172.21.15.105:0/1389570659 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0508078bc0 0x7f050807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:22.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.495+0000 7f051ffff640 1 -- 172.21.15.105:0/1389570659 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f051009ae10 con 0x7f05280cf540 2024-09-21T03:20:22.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.496+0000 7f0526ffd640 1 --2- 172.21.15.105:0/1389570659 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0508078bc0 0x7f050807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:22.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.496+0000 7f0526ffd640 1 --2- 172.21.15.105:0/1389570659 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0508078bc0 0x7f050807b0d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f051800a810 tx=0x7f0518008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:22.501 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.500+0000 7f051ffff640 1 -- 172.21.15.105:0/1389570659 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f05280b7cc0 con 0x7f05280cf540 2024-09-21T03:20:22.683 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.681+0000 7f052d7eb640 1 -- 172.21.15.105:0/1389570659 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f05280d3fb0 con 0x7f05280cf540 2024-09-21T03:20:22.684 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.682+0000 7f051ffff640 1 -- 172.21.15.105:0/1389570659 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+16758 (secure 0 0 0) 0x7f0510063260 con 0x7f05280cf540 2024-09-21T03:20:22.684 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:20:22.684 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":44,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:20:21.706642+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:20:19.345425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-21T03:20:20.668938+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:20:22.686 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.684+0000 7f052d7eb640 1 -- 172.21.15.105:0/1389570659 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0508078bc0 msgr2=0x7f050807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:22.686 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.684+0000 7f052d7eb640 1 --2- 172.21.15.105:0/1389570659 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0508078bc0 0x7f050807b0d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f051800a810 tx=0x7f0518008040 comp rx=0 tx=0).stop 2024-09-21T03:20:22.686 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.684+0000 7f052d7eb640 1 -- 172.21.15.105:0/1389570659 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05280cf540 msgr2=0x7f05281f4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:22.687 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.684+0000 7f052d7eb640 1 --2- 172.21.15.105:0/1389570659 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05280cf540 0x7f05281f4bb0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f051000d6d0 tx=0x7f051000db90 comp rx=0 tx=0).stop 2024-09-21T03:20:22.687 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.684+0000 7f052d7eb640 1 -- 172.21.15.105:0/1389570659 shutdown_connections 2024-09-21T03:20:22.687 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.684+0000 7f052d7eb640 1 --2- 172.21.15.105:0/1389570659 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0508078bc0 0x7f050807b0d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:22.687 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.684+0000 7f052d7eb640 1 --2- 172.21.15.105:0/1389570659 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05280b7370 0x7f05280b7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:22.687 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.684+0000 7f052d7eb640 1 --2- 172.21.15.105:0/1389570659 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05280cf540 0x7f05281f4bb0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:22.687 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.684+0000 7f052d7eb640 1 --2- 172.21.15.105:0/1389570659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05280b9b60 0x7f05280b4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:22.687 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.684+0000 7f052d7eb640 1 -- 172.21.15.105:0/1389570659 >> 172.21.15.105:0/1389570659 conn(0x7f052809d7f0 msgr2=0x7f05280b14f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:22.687 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.685+0000 7f052d7eb640 1 -- 172.21.15.105:0/1389570659 shutdown_connections 2024-09-21T03:20:22.687 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.685+0000 7f052d7eb640 1 -- 172.21.15.105:0/1389570659 wait complete. 2024-09-21T03:20:22.698 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:20:22.810 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.808+0000 7f95c49eb640 1 -- 172.21.15.105:0/3400306058 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95c00b51c0 msgr2=0x7f95c015c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:22.810 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.808+0000 7f95c49eb640 1 --2- 172.21.15.105:0/3400306058 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95c00b51c0 0x7f95c015c6e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f95b0009830 tx=0x7f95b002a510 comp rx=0 tx=0).stop 2024-09-21T03:20:22.810 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.808+0000 7f95c49eb640 1 -- 172.21.15.105:0/3400306058 shutdown_connections 2024-09-21T03:20:22.810 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.808+0000 7f95c49eb640 1 --2- 172.21.15.105:0/3400306058 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95c00ccbd0 0x7f95c00d0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:22.810 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.808+0000 7f95c49eb640 1 --2- 172.21.15.105:0/3400306058 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95c00b51c0 0x7f95c015c6e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:22.810 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.808+0000 7f95c49eb640 1 -- 172.21.15.105:0/3400306058 >> 172.21.15.105:0/3400306058 conn(0x7f95c0072ae0 msgr2=0x7f95c0072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:22.811 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.808+0000 7f95c49eb640 1 -- 172.21.15.105:0/3400306058 shutdown_connections 2024-09-21T03:20:22.811 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.808+0000 7f95c49eb640 1 -- 172.21.15.105:0/3400306058 wait complete. 2024-09-21T03:20:22.811 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.810+0000 7f95c49eb640 1 Processor -- start 2024-09-21T03:20:22.812 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.810+0000 7f95c49eb640 1 -- start start 2024-09-21T03:20:22.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.811+0000 7f95c49eb640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95c00b51c0 0x7f95c00cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:22.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.811+0000 7f95c49eb640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95c00ccbd0 0x7f95c00ae530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:22.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.811+0000 7f95c49eb640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95c00d12c0 0x7f95c00aea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:22.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.811+0000 7f95c49eb640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f95c0160a60 con 0x7f95c00b51c0 2024-09-21T03:20:22.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.811+0000 7f95c49eb640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f95c00d1a20 con 0x7f95c00d12c0 2024-09-21T03:20:22.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.811+0000 7f95c49eb640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f95c0160be0 con 0x7f95c00ccbd0 2024-09-21T03:20:22.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.811+0000 7f95be59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95c00b51c0 0x7f95c00cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:22.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.812+0000 7f95be59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95c00b51c0 0x7f95c00cb850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:57792/0 (socket says 172.21.15.105:57792) 2024-09-21T03:20:22.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.812+0000 7f95be59c640 1 -- 172.21.15.105:0/2588050226 learned_addr learned my addr 172.21.15.105:0/2588050226 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:22.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.812+0000 7f95bdd9b640 1 --2- 172.21.15.105:0/2588050226 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95c00ccbd0 0x7f95c00ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:22.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.812+0000 7f95bed9d640 1 --2- 172.21.15.105:0/2588050226 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95c00d12c0 0x7f95c00aea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:22.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.812+0000 7f95be59c640 1 -- 172.21.15.105:0/2588050226 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95c00ccbd0 msgr2=0x7f95c00ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:22.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.812+0000 7f95be59c640 1 --2- 172.21.15.105:0/2588050226 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95c00ccbd0 0x7f95c00ae530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:22.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.812+0000 7f95be59c640 1 -- 172.21.15.105:0/2588050226 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95c00d12c0 msgr2=0x7f95c00aea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:22.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.812+0000 7f95be59c640 1 --2- 172.21.15.105:0/2588050226 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95c00d12c0 0x7f95c00aea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:22.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.812+0000 7f95be59c640 1 -- 172.21.15.105:0/2588050226 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95c00b16d0 con 0x7f95c00b51c0 2024-09-21T03:20:22.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.812+0000 7f95bed9d640 1 --2- 172.21.15.105:0/2588050226 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95c00d12c0 0x7f95c00aea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:20:22.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.812+0000 7f95bdd9b640 1 --2- 172.21.15.105:0/2588050226 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95c00ccbd0 0x7f95c00ae530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:20:22.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.812+0000 7f95be59c640 1 --2- 172.21.15.105:0/2588050226 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95c00b51c0 0x7f95c00cb850 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f95b002ab00 tx=0x7f95b0033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:22.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.812+0000 7f95b6ffd640 1 -- 172.21.15.105:0/2588050226 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b0031d60 con 0x7f95c00b51c0 2024-09-21T03:20:22.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.812+0000 7f95b6ffd640 1 -- 172.21.15.105:0/2588050226 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95b0033e10 con 0x7f95c00b51c0 2024-09-21T03:20:22.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.812+0000 7f95c49eb640 1 -- 172.21.15.105:0/2588050226 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95c014aa00 con 0x7f95c00b51c0 2024-09-21T03:20:22.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.812+0000 7f95b6ffd640 1 -- 172.21.15.105:0/2588050226 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b0005260 con 0x7f95c00b51c0 2024-09-21T03:20:22.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.812+0000 7f95c49eb640 1 -- 172.21.15.105:0/2588050226 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95c014afc0 con 0x7f95c00b51c0 2024-09-21T03:20:22.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.813+0000 7f95c49eb640 1 -- 172.21.15.105:0/2588050226 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95c0161090 con 0x7f95c00b51c0 2024-09-21T03:20:22.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.814+0000 7f95b6ffd640 1 -- 172.21.15.105:0/2588050226 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f95b0005400 con 0x7f95c00b51c0 2024-09-21T03:20:22.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.814+0000 7f95b6ffd640 1 --2- 172.21.15.105:0/2588050226 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f95a0078bc0 0x7f95a007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:22.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.814+0000 7f95b6ffd640 1 -- 172.21.15.105:0/2588050226 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f95b00bbe70 con 0x7f95c00b51c0 2024-09-21T03:20:22.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.815+0000 7f95bdd9b640 1 --2- 172.21.15.105:0/2588050226 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f95a0078bc0 0x7f95a007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:22.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.815+0000 7f95bdd9b640 1 --2- 172.21.15.105:0/2588050226 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f95a0078bc0 0x7f95a007b0d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f95c00b5b60 tx=0x7f95a8009480 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:22.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.819+0000 7f95b6ffd640 1 -- 172.21.15.105:0/2588050226 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f95b003f030 con 0x7f95c00b51c0 2024-09-21T03:20:22.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.997+0000 7f95c49eb640 1 -- 172.21.15.105:0/2588050226 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f95c00008d0 con 0x7f95c00b51c0 2024-09-21T03:20:23.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:22.998+0000 7f95b6ffd640 1 -- 172.21.15.105:0/2588050226 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+16758 (secure 0 0 0) 0x7f95b0084340 con 0x7f95c00b51c0 2024-09-21T03:20:23.000 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:20:23.001 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":44,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:20:21.706642+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:20:19.345425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-21T03:20:20.668938+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:20:23.002 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.001+0000 7f95c49eb640 1 -- 172.21.15.105:0/2588050226 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f95a0078bc0 msgr2=0x7f95a007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:23.003 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.001+0000 7f95c49eb640 1 --2- 172.21.15.105:0/2588050226 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f95a0078bc0 0x7f95a007b0d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f95c00b5b60 tx=0x7f95a8009480 comp rx=0 tx=0).stop 2024-09-21T03:20:23.003 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.001+0000 7f95c49eb640 1 -- 172.21.15.105:0/2588050226 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95c00b51c0 msgr2=0x7f95c00cb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:23.003 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.001+0000 7f95c49eb640 1 --2- 172.21.15.105:0/2588050226 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95c00b51c0 0x7f95c00cb850 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f95b002ab00 tx=0x7f95b0033c20 comp rx=0 tx=0).stop 2024-09-21T03:20:23.003 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.001+0000 7f95c49eb640 1 -- 172.21.15.105:0/2588050226 shutdown_connections 2024-09-21T03:20:23.003 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.001+0000 7f95c49eb640 1 --2- 172.21.15.105:0/2588050226 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f95a0078bc0 0x7f95a007b0d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:23.003 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.001+0000 7f95c49eb640 1 --2- 172.21.15.105:0/2588050226 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95c00d12c0 0x7f95c00aea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:23.003 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.001+0000 7f95c49eb640 1 --2- 172.21.15.105:0/2588050226 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95c00ccbd0 0x7f95c00ae530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:23.003 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.001+0000 7f95c49eb640 1 --2- 172.21.15.105:0/2588050226 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95c00b51c0 0x7f95c00cb850 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:23.003 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.001+0000 7f95c49eb640 1 -- 172.21.15.105:0/2588050226 >> 172.21.15.105:0/2588050226 conn(0x7f95c0072ae0 msgr2=0x7f95c00cebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:23.003 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.001+0000 7f95c49eb640 1 -- 172.21.15.105:0/2588050226 shutdown_connections 2024-09-21T03:20:23.003 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.001+0000 7f95c49eb640 1 -- 172.21.15.105:0/2588050226 wait complete. 2024-09-21T03:20:23.014 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T03:20:23.130 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.128+0000 7fcdc8150640 1 -- 172.21.15.105:0/2129394713 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdc00d2310 msgr2=0x7fcdc00d2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:23.130 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.128+0000 7fcdc8150640 1 --2- 172.21.15.105:0/2129394713 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdc00d2310 0x7fcdc00d2720 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8009830 tx=0x7fcdb802a530 comp rx=0 tx=0).stop 2024-09-21T03:20:23.130 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.128+0000 7fcdc8150640 1 -- 172.21.15.105:0/2129394713 shutdown_connections 2024-09-21T03:20:23.130 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.128+0000 7fcdc8150640 1 --2- 172.21.15.105:0/2129394713 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdc00d2310 0x7fcdc00d2720 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:23.130 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.128+0000 7fcdc8150640 1 -- 172.21.15.105:0/2129394713 >> 172.21.15.105:0/2129394713 conn(0x7fcdc00b3f10 msgr2=0x7fcdc00b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:23.131 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.128+0000 7fcdc8150640 1 -- 172.21.15.105:0/2129394713 shutdown_connections 2024-09-21T03:20:23.131 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.128+0000 7fcdc8150640 1 -- 172.21.15.105:0/2129394713 wait complete. 2024-09-21T03:20:23.131 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.130+0000 7fcdc8150640 1 Processor -- start 2024-09-21T03:20:23.131 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.130+0000 7fcdc8150640 1 -- start start 2024-09-21T03:20:23.134 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.131+0000 7fcdc8150640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcdc00ccbe0 0x7fcdc0156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:23.134 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.131+0000 7fcdc8150640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdc00d2310 0x7fcdc00c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:23.135 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.131+0000 7fcdc8150640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdc015c7a0 0x7fcdc00caef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:23.135 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.131+0000 7fcdc8150640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc00d1a40 con 0x7fcdc015c7a0 2024-09-21T03:20:23.135 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.131+0000 7fcdc8150640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc00d18c0 con 0x7fcdc00d2310 2024-09-21T03:20:23.135 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.131+0000 7fcdc8150640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcdc00d1bc0 con 0x7fcdc00ccbe0 2024-09-21T03:20:23.135 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.131+0000 7fcdc66ed640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdc015c7a0 0x7fcdc00caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:23.135 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.131+0000 7fcdc66ed640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdc015c7a0 0x7fcdc00caef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:57804/0 (socket says 172.21.15.105:57804) 2024-09-21T03:20:23.135 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.131+0000 7fcdc66ed640 1 -- 172.21.15.105:0/3306168041 learned_addr learned my addr 172.21.15.105:0/3306168041 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:23.135 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.131+0000 7fcdc5eec640 1 --2- 172.21.15.105:0/3306168041 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcdc00ccbe0 0x7fcdc0156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:23.135 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.131+0000 7fcdc56eb640 1 --2- 172.21.15.105:0/3306168041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdc00d2310 0x7fcdc00c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:23.135 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.132+0000 7fcdc66ed640 1 -- 172.21.15.105:0/3306168041 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcdc00ccbe0 msgr2=0x7fcdc0156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:23.135 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.132+0000 7fcdc66ed640 1 --2- 172.21.15.105:0/3306168041 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcdc00ccbe0 0x7fcdc0156e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:23.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.132+0000 7fcdc66ed640 1 -- 172.21.15.105:0/3306168041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdc00d2310 msgr2=0x7fcdc00c9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:23.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.132+0000 7fcdc66ed640 1 --2- 172.21.15.105:0/3306168041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdc00d2310 0x7fcdc00c9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:23.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.132+0000 7fcdc66ed640 1 -- 172.21.15.105:0/3306168041 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdc0157360 con 0x7fcdc015c7a0 2024-09-21T03:20:23.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.132+0000 7fcdc66ed640 1 --2- 172.21.15.105:0/3306168041 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdc015c7a0 0x7fcdc00caef0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fcdb802ab20 tx=0x7fcdb8033ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:23.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.132+0000 7fcdb67fc640 1 -- 172.21.15.105:0/3306168041 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb8031d60 con 0x7fcdc015c7a0 2024-09-21T03:20:23.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.132+0000 7fcdb67fc640 1 -- 172.21.15.105:0/3306168041 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcdb8005020 con 0x7fcdc015c7a0 2024-09-21T03:20:23.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.132+0000 7fcdc8150640 1 -- 172.21.15.105:0/3306168041 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdc00c95b0 con 0x7fcdc015c7a0 2024-09-21T03:20:23.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.132+0000 7fcdb67fc640 1 -- 172.21.15.105:0/3306168041 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb8005450 con 0x7fcdc015c7a0 2024-09-21T03:20:23.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.132+0000 7fcdc8150640 1 -- 172.21.15.105:0/3306168041 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdc00c8f50 con 0x7fcdc015c7a0 2024-09-21T03:20:23.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.133+0000 7fcdc8150640 1 -- 172.21.15.105:0/3306168041 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdc00d2720 con 0x7fcdc015c7a0 2024-09-21T03:20:23.137 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.134+0000 7fcdb67fc640 1 -- 172.21.15.105:0/3306168041 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcdb80047a0 con 0x7fcdc015c7a0 2024-09-21T03:20:23.137 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.134+0000 7fcdb67fc640 1 --2- 172.21.15.105:0/3306168041 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcda4078b90 0x7fcda407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:23.137 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.134+0000 7fcdb67fc640 1 -- 172.21.15.105:0/3306168041 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7fcdb80bbf60 con 0x7fcdc015c7a0 2024-09-21T03:20:23.137 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.134+0000 7fcdc5eec640 1 --2- 172.21.15.105:0/3306168041 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcda4078b90 0x7fcda407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:23.138 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.135+0000 7fcdc5eec640 1 --2- 172.21.15.105:0/3306168041 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcda4078b90 0x7fcda407b0a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc0012e0 tx=0x7fcdbc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:23.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.139+0000 7fcdb67fc640 1 -- 172.21.15.105:0/3306168041 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fcdb803f030 con 0x7fcdc015c7a0 2024-09-21T03:20:23.354 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:23.353+0000 7fcdc8150640 1 -- 172.21.15.105:0/3306168041 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fcdc00cd5e0 con 0x7fcdc015c7a0 2024-09-21T03:20:24.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.359+0000 7fcdb67fc640 1 -- 172.21.15.105:0/3306168041 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v24) ==== 118+0+0 (secure 0 0 0) 0x7fcdb8083d50 con 0x7fcdc015c7a0 2024-09-21T03:20:24.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.362+0000 7fcdc8150640 1 -- 172.21.15.105:0/3306168041 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcda4078b90 msgr2=0x7fcda407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:24.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.362+0000 7fcdc8150640 1 --2- 172.21.15.105:0/3306168041 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcda4078b90 0x7fcda407b0a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc0012e0 tx=0x7fcdbc009040 comp rx=0 tx=0).stop 2024-09-21T03:20:24.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.362+0000 7fcdc8150640 1 -- 172.21.15.105:0/3306168041 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdc015c7a0 msgr2=0x7fcdc00caef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:24.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.362+0000 7fcdc8150640 1 --2- 172.21.15.105:0/3306168041 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdc015c7a0 0x7fcdc00caef0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fcdb802ab20 tx=0x7fcdb8033ce0 comp rx=0 tx=0).stop 2024-09-21T03:20:24.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.362+0000 7fcdc8150640 1 -- 172.21.15.105:0/3306168041 shutdown_connections 2024-09-21T03:20:24.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.362+0000 7fcdc8150640 1 --2- 172.21.15.105:0/3306168041 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcda4078b90 0x7fcda407b0a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:24.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.362+0000 7fcdc8150640 1 --2- 172.21.15.105:0/3306168041 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdc015c7a0 0x7fcdc00caef0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:24.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.362+0000 7fcdc8150640 1 --2- 172.21.15.105:0/3306168041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdc00d2310 0x7fcdc00c9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:24.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.362+0000 7fcdc8150640 1 --2- 172.21.15.105:0/3306168041 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcdc00ccbe0 0x7fcdc0156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:24.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.362+0000 7fcdc8150640 1 -- 172.21.15.105:0/3306168041 >> 172.21.15.105:0/3306168041 conn(0x7fcdc00b3f10 msgr2=0x7fcdc00b34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:24.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.362+0000 7fcdc8150640 1 -- 172.21.15.105:0/3306168041 shutdown_connections 2024-09-21T03:20:24.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.362+0000 7fcdc8150640 1 -- 172.21.15.105:0/3306168041 wait complete. 2024-09-21T03:20:24.377 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T03:20:24.377 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T03:20:24.497 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.495+0000 7feaebb58640 1 -- 172.21.15.105:0/1256923905 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feae4142270 msgr2=0x7feae4073e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:24.497 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.495+0000 7feaebb58640 1 --2- 172.21.15.105:0/1256923905 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feae4142270 0x7feae4073e50 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7feae40cdd10 tx=0x7fead402a530 comp rx=0 tx=0).stop 2024-09-21T03:20:24.497 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.495+0000 7feaebb58640 1 -- 172.21.15.105:0/1256923905 shutdown_connections 2024-09-21T03:20:24.497 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.495+0000 7feaebb58640 1 --2- 172.21.15.105:0/1256923905 >> v2:172.21.15.162:3300/0 conn(0x7feae4142680 0x7feae4074390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:24.497 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.495+0000 7feaebb58640 1 --2- 172.21.15.105:0/1256923905 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feae4142270 0x7feae4073e50 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:24.497 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.495+0000 7feaebb58640 1 -- 172.21.15.105:0/1256923905 >> 172.21.15.105:0/1256923905 conn(0x7feae40d15f0 msgr2=0x7feae4073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:24.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.495+0000 7feaebb58640 1 -- 172.21.15.105:0/1256923905 shutdown_connections 2024-09-21T03:20:24.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.495+0000 7feaebb58640 1 -- 172.21.15.105:0/1256923905 wait complete. 2024-09-21T03:20:24.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.497+0000 7feaebb58640 1 Processor -- start 2024-09-21T03:20:24.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.497+0000 7feaebb58640 1 -- start start 2024-09-21T03:20:24.501 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.498+0000 7feaebb58640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feae4142270 0x7feae41596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:24.501 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.498+0000 7feaebb58640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feae4142680 0x7feae41f3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:24.501 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.498+0000 7feaebb58640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feae4144270 0x7feae4140f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:24.501 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.498+0000 7feaebb58640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7feae40d01f0 con 0x7feae4144270 2024-09-21T03:20:24.501 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.498+0000 7feaebb58640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feae40d0070 con 0x7feae4142270 2024-09-21T03:20:24.501 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.498+0000 7feaebb58640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7feae40d0370 con 0x7feae4142680 2024-09-21T03:20:24.501 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.498+0000 7feaea0f5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feae4144270 0x7feae4140f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:24.501 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.498+0000 7feaea0f5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feae4144270 0x7feae4140f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:57824/0 (socket says 172.21.15.105:57824) 2024-09-21T03:20:24.501 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.498+0000 7feaea0f5640 1 -- 172.21.15.105:0/3952077823 learned_addr learned my addr 172.21.15.105:0/3952077823 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:24.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.498+0000 7feae90f3640 1 --2- 172.21.15.105:0/3952077823 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feae4142680 0x7feae41f3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:24.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.498+0000 7feae98f4640 1 --2- 172.21.15.105:0/3952077823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feae4142270 0x7feae41596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:24.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.499+0000 7feaea0f5640 1 -- 172.21.15.105:0/3952077823 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feae4142680 msgr2=0x7feae41f3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:24.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.499+0000 7feaea0f5640 1 --2- 172.21.15.105:0/3952077823 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feae4142680 0x7feae41f3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:24.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.499+0000 7feaea0f5640 1 -- 172.21.15.105:0/3952077823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feae4142270 msgr2=0x7feae41596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:24.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.499+0000 7feaea0f5640 1 --2- 172.21.15.105:0/3952077823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feae4142270 0x7feae41596c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:24.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.499+0000 7feaea0f5640 1 -- 172.21.15.105:0/3952077823 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feae4158620 con 0x7feae4144270 2024-09-21T03:20:24.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.499+0000 7feae90f3640 1 --2- 172.21.15.105:0/3952077823 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feae4142680 0x7feae41f3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:20:24.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.499+0000 7feae98f4640 1 --2- 172.21.15.105:0/3952077823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feae4142270 0x7feae41596c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:20:24.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.499+0000 7feaea0f5640 1 --2- 172.21.15.105:0/3952077823 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feae4144270 0x7feae4140f90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7feadc00cad0 tx=0x7feadc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:24.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.499+0000 7feada7fc640 1 -- 172.21.15.105:0/3952077823 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feadc00adc0 con 0x7feae4144270 2024-09-21T03:20:24.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.499+0000 7feada7fc640 1 -- 172.21.15.105:0/3952077823 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feadc00f540 con 0x7feae4144270 2024-09-21T03:20:24.503 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.499+0000 7feaebb58640 1 -- 172.21.15.105:0/3952077823 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feae4158900 con 0x7feae4144270 2024-09-21T03:20:24.503 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.499+0000 7feada7fc640 1 -- 172.21.15.105:0/3952077823 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feadc00f990 con 0x7feae4144270 2024-09-21T03:20:24.503 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.499+0000 7feaebb58640 1 -- 172.21.15.105:0/3952077823 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feae4158ec0 con 0x7feae4144270 2024-09-21T03:20:24.503 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.500+0000 7feaebb58640 1 -- 172.21.15.105:0/3952077823 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feae40696c0 con 0x7feae4144270 2024-09-21T03:20:24.504 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.501+0000 7feada7fc640 1 -- 172.21.15.105:0/3952077823 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feadc00fb30 con 0x7feae4144270 2024-09-21T03:20:24.504 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.501+0000 7feada7fc640 1 --2- 172.21.15.105:0/3952077823 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7feac8078bc0 0x7feac807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:24.504 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.501+0000 7feada7fc640 1 -- 172.21.15.105:0/3952077823 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7feadc09b7c0 con 0x7feae4144270 2024-09-21T03:20:24.504 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.501+0000 7feae98f4640 1 --2- 172.21.15.105:0/3952077823 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7feac8078bc0 0x7feac807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:24.504 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.502+0000 7feae98f4640 1 --2- 172.21.15.105:0/3952077823 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7feac8078bc0 0x7feac807b0d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7feae0000f60 tx=0x7feae0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:24.507 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.506+0000 7feada7fc640 1 -- 172.21.15.105:0/3952077823 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7feae40696c0 con 0x7feae4144270 2024-09-21T03:20:24.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:24.720+0000 7feaebb58640 1 -- 172.21.15.105:0/3952077823 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7feae40c5db0 con 0x7feae4144270 2024-09-21T03:20:25.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.368+0000 7feada7fc640 1 -- 172.21.15.105:0/3952077823 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v25) ==== 122+0+0 (secure 0 0 0) 0x7feadc00fe20 con 0x7feae4144270 2024-09-21T03:20:25.373 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.372+0000 7feaebb58640 1 -- 172.21.15.105:0/3952077823 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7feac8078bc0 msgr2=0x7feac807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:25.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.372+0000 7feaebb58640 1 --2- 172.21.15.105:0/3952077823 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7feac8078bc0 0x7feac807b0d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7feae0000f60 tx=0x7feae0009040 comp rx=0 tx=0).stop 2024-09-21T03:20:25.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.372+0000 7feaebb58640 1 -- 172.21.15.105:0/3952077823 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feae4144270 msgr2=0x7feae4140f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:25.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.372+0000 7feaebb58640 1 --2- 172.21.15.105:0/3952077823 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feae4144270 0x7feae4140f90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7feadc00cad0 tx=0x7feadc00cf90 comp rx=0 tx=0).stop 2024-09-21T03:20:25.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.372+0000 7feaebb58640 1 -- 172.21.15.105:0/3952077823 shutdown_connections 2024-09-21T03:20:25.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.372+0000 7feaebb58640 1 --2- 172.21.15.105:0/3952077823 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7feac8078bc0 0x7feac807b0d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:25.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.372+0000 7feaebb58640 1 --2- 172.21.15.105:0/3952077823 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feae4144270 0x7feae4140f90 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:25.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.372+0000 7feaebb58640 1 --2- 172.21.15.105:0/3952077823 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feae4142680 0x7feae41f3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:25.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.372+0000 7feaebb58640 1 --2- 172.21.15.105:0/3952077823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feae4142270 0x7feae41596c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:25.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.372+0000 7feaebb58640 1 -- 172.21.15.105:0/3952077823 >> 172.21.15.105:0/3952077823 conn(0x7feae40d15f0 msgr2=0x7feae4073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:25.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.372+0000 7feaebb58640 1 -- 172.21.15.105:0/3952077823 shutdown_connections 2024-09-21T03:20:25.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.372+0000 7feaebb58640 1 -- 172.21.15.105:0/3952077823 wait complete. 2024-09-21T03:20:25.385 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T03:20:25.385 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:20:25.497 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.495+0000 7f7fe9e8b640 1 -- 172.21.15.105:0/1938894250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fe4073170 msgr2=0x7f7fe415c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:25.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.496+0000 7f7fe9e8b640 1 --2- 172.21.15.105:0/1938894250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fe4073170 0x7f7fe415c780 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4005fd0 tx=0x7f7fd402a540 comp rx=0 tx=0).stop 2024-09-21T03:20:25.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.496+0000 7f7fe9e8b640 1 -- 172.21.15.105:0/1938894250 shutdown_connections 2024-09-21T03:20:25.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.496+0000 7f7fe9e8b640 1 --2- 172.21.15.105:0/1938894250 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fe4070030 0x7f7fe4074640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:25.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.496+0000 7f7fe9e8b640 1 --2- 172.21.15.105:0/1938894250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fe4073170 0x7f7fe415c780 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:25.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.496+0000 7f7fe9e8b640 1 -- 172.21.15.105:0/1938894250 >> 172.21.15.105:0/1938894250 conn(0x7f7fe40b1cb0 msgr2=0x7f7fe40b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:25.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.496+0000 7f7fe9e8b640 1 -- 172.21.15.105:0/1938894250 shutdown_connections 2024-09-21T03:20:25.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.496+0000 7f7fe9e8b640 1 -- 172.21.15.105:0/1938894250 wait complete. 2024-09-21T03:20:25.499 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.497+0000 7f7fe9e8b640 1 Processor -- start 2024-09-21T03:20:25.499 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.498+0000 7f7fe9e8b640 1 -- start start 2024-09-21T03:20:25.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.499+0000 7f7fe9e8b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fe4070030 0x7f7fe41ed540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:25.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.499+0000 7f7fe9e8b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fe4070440 0x7f7fe41f6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:25.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.499+0000 7f7fe9e8b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fe4073170 0x7f7fe41f7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:25.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.499+0000 7f7fe9e8b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe406f5a0 con 0x7f7fe4070030 2024-09-21T03:20:25.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.499+0000 7f7fe9e8b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe4074f80 con 0x7f7fe4070440 2024-09-21T03:20:25.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.499+0000 7f7fe9e8b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7fe406f720 con 0x7f7fe4073170 2024-09-21T03:20:25.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.499+0000 7f7fe37fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fe4070030 0x7f7fe41ed540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:25.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.499+0000 7f7fe37fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fe4070030 0x7f7fe41ed540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:57846/0 (socket says 172.21.15.105:57846) 2024-09-21T03:20:25.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.499+0000 7f7fe37fe640 1 -- 172.21.15.105:0/3009221072 learned_addr learned my addr 172.21.15.105:0/3009221072 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:25.503 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.499+0000 7f7fe2ffd640 1 --2- 172.21.15.105:0/3009221072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fe4070440 0x7f7fe41f6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:25.503 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.499+0000 7f7fe3fff640 1 --2- 172.21.15.105:0/3009221072 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fe4073170 0x7f7fe41f7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:25.503 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.499+0000 7f7fe37fe640 1 -- 172.21.15.105:0/3009221072 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fe4073170 msgr2=0x7f7fe41f7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:25.503 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.499+0000 7f7fe37fe640 1 --2- 172.21.15.105:0/3009221072 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fe4073170 0x7f7fe41f7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:25.503 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.499+0000 7f7fe37fe640 1 -- 172.21.15.105:0/3009221072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fe4070440 msgr2=0x7f7fe41f6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:25.503 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.499+0000 7f7fe37fe640 1 --2- 172.21.15.105:0/3009221072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fe4070440 0x7f7fe41f6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:25.503 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.499+0000 7f7fe37fe640 1 -- 172.21.15.105:0/3009221072 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe409b570 con 0x7f7fe4070030 2024-09-21T03:20:25.503 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.499+0000 7f7fe2ffd640 1 --2- 172.21.15.105:0/3009221072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fe4070440 0x7f7fe41f6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:20:25.503 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.499+0000 7f7fe3fff640 1 --2- 172.21.15.105:0/3009221072 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fe4073170 0x7f7fe41f7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:20:25.503 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.499+0000 7f7fe37fe640 1 --2- 172.21.15.105:0/3009221072 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fe4070030 0x7f7fe41ed540 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4034040 tx=0x7f7fd40038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:25.503 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.500+0000 7f7fdbfff640 1 -- 172.21.15.105:0/3009221072 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd403e030 con 0x7f7fe4070030 2024-09-21T03:20:25.503 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.500+0000 7f7fdbfff640 1 -- 172.21.15.105:0/3009221072 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7fd4003d90 con 0x7f7fe4070030 2024-09-21T03:20:25.503 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.500+0000 7f7fe9e8b640 1 -- 172.21.15.105:0/3009221072 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fe409b850 con 0x7f7fe4070030 2024-09-21T03:20:25.504 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.500+0000 7f7fdbfff640 1 -- 172.21.15.105:0/3009221072 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd4035040 con 0x7f7fe4070030 2024-09-21T03:20:25.504 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.500+0000 7f7fe9e8b640 1 -- 172.21.15.105:0/3009221072 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fe409be10 con 0x7f7fe4070030 2024-09-21T03:20:25.504 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.501+0000 7f7fe9e8b640 1 -- 172.21.15.105:0/3009221072 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fe406fc40 con 0x7f7fe4070030 2024-09-21T03:20:25.505 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.501+0000 7f7fdbfff640 1 -- 172.21.15.105:0/3009221072 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7fd4041030 con 0x7f7fe4070030 2024-09-21T03:20:25.505 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.502+0000 7f7fdbfff640 1 --2- 172.21.15.105:0/3009221072 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7fcc078b90 0x7f7fcc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:25.505 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.502+0000 7f7fdbfff640 1 -- 172.21.15.105:0/3009221072 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f7fd40bb850 con 0x7f7fe4070030 2024-09-21T03:20:25.505 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.502+0000 7f7fe2ffd640 1 --2- 172.21.15.105:0/3009221072 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7fcc078b90 0x7f7fcc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:25.505 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.503+0000 7f7fe2ffd640 1 --2- 172.21.15.105:0/3009221072 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7fcc078b90 0x7f7fcc07b0a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7fe40ad040 tx=0x7f7fd0005db0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:25.508 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.507+0000 7f7fdbfff640 1 -- 172.21.15.105:0/3009221072 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7fd4083d20 con 0x7f7fe4070030 2024-09-21T03:20:25.719 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.717+0000 7f7fe9e8b640 1 -- 172.21.15.105:0/3009221072 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7fe415bc00 con 0x7f7fe4070030 2024-09-21T03:20:25.719 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.718+0000 7f7fdbfff640 1 -- 172.21.15.105:0/3009221072 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5235 (secure 0 0 0) 0x7f7fd4083620 con 0x7f7fe4070030 2024-09-21T03:20:25.720 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:20:25.720 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":25,"btime":"2024-09-21T03:20:25:364985+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4889,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/2075944521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2075944521},{"type":"v1","addr":"172.21.15.162:6837","nonce":2075944521}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5086,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/4008776831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":4008776831},{"type":"v1","addr":"172.21.15.105:6835","nonce":4008776831}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2322902258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2322902258},{"type":"v1","addr":"172.21.15.162:6836","nonce":2322902258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:20:21.706604+0000","modified":"2024-09-21T03:20:24.721756+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5301},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5301":{"gid":5301,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6833/2865219898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2865219898},{"type":"v1","addr":"172.21.15.105:6833","nonce":2865219898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5301,"qdb_cluster":[5301]},"id":3}]} 2024-09-21T03:20:25.720 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 25 2024-09-21T03:20:25.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.720+0000 7f7fe9e8b640 1 -- 172.21.15.105:0/3009221072 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7fcc078b90 msgr2=0x7f7fcc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:25.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.720+0000 7f7fe9e8b640 1 --2- 172.21.15.105:0/3009221072 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7fcc078b90 0x7f7fcc07b0a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7fe40ad040 tx=0x7f7fd0005db0 comp rx=0 tx=0).stop 2024-09-21T03:20:25.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.720+0000 7f7fe9e8b640 1 -- 172.21.15.105:0/3009221072 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fe4070030 msgr2=0x7f7fe41ed540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:25.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.720+0000 7f7fe9e8b640 1 --2- 172.21.15.105:0/3009221072 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fe4070030 0x7f7fe41ed540 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4034040 tx=0x7f7fd40038a0 comp rx=0 tx=0).stop 2024-09-21T03:20:25.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.720+0000 7f7fe9e8b640 1 -- 172.21.15.105:0/3009221072 shutdown_connections 2024-09-21T03:20:25.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.720+0000 7f7fe9e8b640 1 --2- 172.21.15.105:0/3009221072 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7fcc078b90 0x7f7fcc07b0a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:25.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.720+0000 7f7fe9e8b640 1 --2- 172.21.15.105:0/3009221072 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fe4073170 0x7f7fe41f7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:25.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.720+0000 7f7fe9e8b640 1 --2- 172.21.15.105:0/3009221072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fe4070440 0x7f7fe41f6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:25.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.720+0000 7f7fe9e8b640 1 --2- 172.21.15.105:0/3009221072 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fe4070030 0x7f7fe41ed540 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:25.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.720+0000 7f7fe9e8b640 1 -- 172.21.15.105:0/3009221072 >> 172.21.15.105:0/3009221072 conn(0x7f7fe40b1cb0 msgr2=0x7f7fe415f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:25.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.720+0000 7f7fe9e8b640 1 -- 172.21.15.105:0/3009221072 shutdown_connections 2024-09-21T03:20:25.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.720+0000 7f7fe9e8b640 1 -- 172.21.15.105:0/3009221072 wait complete. 2024-09-21T03:20:25.733 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:20:25.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.844+0000 7fd91f807640 1 -- 172.21.15.105:0/170509402 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd904004800 msgr2=0x7fd904004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:25.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.844+0000 7fd91f807640 1 --2- 172.21.15.105:0/170509402 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd904004800 0x7fd904004c10 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd9080016c0 tx=0x7fd904005830 comp rx=0 tx=0).stop 2024-09-21T03:20:25.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.844+0000 7fd91f807640 1 -- 172.21.15.105:0/170509402 shutdown_connections 2024-09-21T03:20:25.847 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.844+0000 7fd91f807640 1 --2- 172.21.15.105:0/170509402 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd904004800 0x7fd904004c10 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:25.847 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.844+0000 7fd91f807640 1 -- 172.21.15.105:0/170509402 >> 172.21.15.105:0/170509402 conn(0x7fd91806d550 msgr2=0x7fd918071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:25.847 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.844+0000 7fd91f807640 1 -- 172.21.15.105:0/170509402 shutdown_connections 2024-09-21T03:20:25.847 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.844+0000 7fd91f807640 1 -- 172.21.15.105:0/170509402 wait complete. 2024-09-21T03:20:25.847 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.846+0000 7fd91f807640 1 Processor -- start 2024-09-21T03:20:25.848 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.846+0000 7fd91f807640 1 -- start start 2024-09-21T03:20:25.850 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.847+0000 7fd91f807640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd904004800 0x7fd9180c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:25.850 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.847+0000 7fd91f807640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd918149760 0x7fd918155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:25.850 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.847+0000 7fd91f807640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd918155680 0x7fd9181f4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:25.850 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.847+0000 7fd91f807640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd9180d22b0 con 0x7fd918155680 2024-09-21T03:20:25.851 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.847+0000 7fd91f807640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd9180d2130 con 0x7fd904004800 2024-09-21T03:20:25.851 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.847+0000 7fd91f807640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd91815d130 con 0x7fd918149760 2024-09-21T03:20:25.851 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.848+0000 7fd91dda4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd918155680 0x7fd9181f4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:25.851 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.848+0000 7fd91dda4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd918155680 0x7fd9181f4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:57858/0 (socket says 172.21.15.105:57858) 2024-09-21T03:20:25.851 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.848+0000 7fd91dda4640 1 -- 172.21.15.105:0/4037026857 learned_addr learned my addr 172.21.15.105:0/4037026857 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:25.851 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.848+0000 7fd91cda2640 1 --2- 172.21.15.105:0/4037026857 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd918149760 0x7fd918155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:25.851 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.848+0000 7fd91d5a3640 1 --2- 172.21.15.105:0/4037026857 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd904004800 0x7fd9180c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:25.851 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.848+0000 7fd91dda4640 1 -- 172.21.15.105:0/4037026857 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd918149760 msgr2=0x7fd918155140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:25.851 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.848+0000 7fd91dda4640 1 --2- 172.21.15.105:0/4037026857 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd918149760 0x7fd918155140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:25.851 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.848+0000 7fd91dda4640 1 -- 172.21.15.105:0/4037026857 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd904004800 msgr2=0x7fd9180c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:25.851 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.848+0000 7fd91dda4640 1 --2- 172.21.15.105:0/4037026857 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd904004800 0x7fd9180c5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:25.851 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.848+0000 7fd91dda4640 1 -- 172.21.15.105:0/4037026857 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd918155a90 con 0x7fd918155680 2024-09-21T03:20:25.851 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.848+0000 7fd91dda4640 1 --2- 172.21.15.105:0/4037026857 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd918155680 0x7fd9181f4050 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd9180d2de0 tx=0x7fd910006420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:25.852 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.848+0000 7fd90dffb640 1 -- 172.21.15.105:0/4037026857 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd910010890 con 0x7fd918155680 2024-09-21T03:20:25.852 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.848+0000 7fd90dffb640 1 -- 172.21.15.105:0/4037026857 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd910017070 con 0x7fd918155680 2024-09-21T03:20:25.852 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.848+0000 7fd91f807640 1 -- 172.21.15.105:0/4037026857 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd918153bc0 con 0x7fd918155680 2024-09-21T03:20:25.852 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.848+0000 7fd90dffb640 1 -- 172.21.15.105:0/4037026857 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd910010de0 con 0x7fd918155680 2024-09-21T03:20:25.852 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.848+0000 7fd91f807640 1 -- 172.21.15.105:0/4037026857 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9181f7660 con 0x7fd918155680 2024-09-21T03:20:25.853 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.849+0000 7fd91f807640 1 -- 172.21.15.105:0/4037026857 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd918076820 con 0x7fd918155680 2024-09-21T03:20:25.853 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.850+0000 7fd90dffb640 1 -- 172.21.15.105:0/4037026857 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd91001c460 con 0x7fd918155680 2024-09-21T03:20:25.853 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.851+0000 7fd90dffb640 1 --2- 172.21.15.105:0/4037026857 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd8fc078b90 0x7fd8fc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:25.853 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.851+0000 7fd90dffb640 1 -- 172.21.15.105:0/4037026857 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fd91009b570 con 0x7fd918155680 2024-09-21T03:20:25.853 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.851+0000 7fd91d5a3640 1 --2- 172.21.15.105:0/4037026857 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd8fc078b90 0x7fd8fc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:25.853 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.851+0000 7fd91d5a3640 1 --2- 172.21.15.105:0/4037026857 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd8fc078b90 0x7fd8fc07b0a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd914009cd0 tx=0x7fd914005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:25.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:25.855+0000 7fd90dffb640 1 -- 172.21.15.105:0/4037026857 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd918155a90 con 0x7fd918155680 2024-09-21T03:20:26.034 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.032+0000 7fd91f807640 1 -- 172.21.15.105:0/4037026857 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd91815d620 con 0x7fd918155680 2024-09-21T03:20:26.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.033+0000 7fd90dffb640 1 -- 172.21.15.105:0/4037026857 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+16745 (secure 0 0 0) 0x7fd9180d2870 con 0x7fd918155680 2024-09-21T03:20:26.035 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:20:26.036 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":45,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:20:23.351123+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:20:19.345425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-21T03:20:20.668938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:20:26.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.035+0000 7fd91f807640 1 -- 172.21.15.105:0/4037026857 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd8fc078b90 msgr2=0x7fd8fc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:26.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.035+0000 7fd91f807640 1 --2- 172.21.15.105:0/4037026857 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd8fc078b90 0x7fd8fc07b0a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd914009cd0 tx=0x7fd914005f90 comp rx=0 tx=0).stop 2024-09-21T03:20:26.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.035+0000 7fd91f807640 1 -- 172.21.15.105:0/4037026857 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd918155680 msgr2=0x7fd9181f4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:26.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.035+0000 7fd91f807640 1 --2- 172.21.15.105:0/4037026857 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd918155680 0x7fd9181f4050 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd9180d2de0 tx=0x7fd910006420 comp rx=0 tx=0).stop 2024-09-21T03:20:26.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.035+0000 7fd91f807640 1 -- 172.21.15.105:0/4037026857 shutdown_connections 2024-09-21T03:20:26.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.035+0000 7fd91f807640 1 --2- 172.21.15.105:0/4037026857 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd8fc078b90 0x7fd8fc07b0a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:26.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.035+0000 7fd91f807640 1 --2- 172.21.15.105:0/4037026857 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd918155680 0x7fd9181f4050 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:26.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.035+0000 7fd91f807640 1 --2- 172.21.15.105:0/4037026857 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd918149760 0x7fd918155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:26.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.035+0000 7fd91f807640 1 --2- 172.21.15.105:0/4037026857 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd904004800 0x7fd9180c5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:26.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.035+0000 7fd91f807640 1 -- 172.21.15.105:0/4037026857 >> 172.21.15.105:0/4037026857 conn(0x7fd91806d550 msgr2=0x7fd9180b6880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:26.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.035+0000 7fd91f807640 1 -- 172.21.15.105:0/4037026857 shutdown_connections 2024-09-21T03:20:26.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.035+0000 7fd91f807640 1 -- 172.21.15.105:0/4037026857 wait complete. 2024-09-21T03:20:26.048 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T03:20:26.049 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:20:26.163 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.161+0000 7f5c6b207640 1 -- 172.21.15.105:0/4198816895 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c6406e170 msgr2=0x7f5c640b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:26.164 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.161+0000 7f5c6b207640 1 --2- 172.21.15.105:0/4198816895 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c6406e170 0x7f5c640b3540 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5c58009860 tx=0x7f5c5802a4b0 comp rx=0 tx=0).stop 2024-09-21T03:20:26.164 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.161+0000 7f5c6b207640 1 -- 172.21.15.105:0/4198816895 shutdown_connections 2024-09-21T03:20:26.164 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.161+0000 7f5c6b207640 1 --2- 172.21.15.105:0/4198816895 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5c6406f4b0 0x7f5c640d3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:26.164 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.161+0000 7f5c6b207640 1 --2- 172.21.15.105:0/4198816895 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c6406e170 0x7f5c640b3540 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:26.164 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.161+0000 7f5c6b207640 1 -- 172.21.15.105:0/4198816895 >> 172.21.15.105:0/4198816895 conn(0x7f5c6408bfc0 msgr2=0x7f5c6409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:26.164 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.161+0000 7f5c6b207640 1 -- 172.21.15.105:0/4198816895 shutdown_connections 2024-09-21T03:20:26.164 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.161+0000 7f5c6b207640 1 -- 172.21.15.105:0/4198816895 wait complete. 2024-09-21T03:20:26.166 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.164+0000 7f5c6b207640 1 Processor -- start 2024-09-21T03:20:26.166 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.164+0000 7f5c6b207640 1 -- start start 2024-09-21T03:20:26.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.167+0000 7f5c6b207640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c6406f4b0 0x7f5c641f5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:26.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.167+0000 7f5c6b207640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5c640d3870 0x7f5c641f5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:26.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.167+0000 7f5c6b207640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c640b4fa0 0x7f5c640b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:26.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.167+0000 7f5c6b207640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5c640d0e60 con 0x7f5c640b4fa0 2024-09-21T03:20:26.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.167+0000 7f5c6b207640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5c640d0ce0 con 0x7f5c6406f4b0 2024-09-21T03:20:26.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.167+0000 7f5c6b207640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5c640d0fe0 con 0x7f5c640d3870 2024-09-21T03:20:26.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.167+0000 7f5c697a4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c640b4fa0 0x7f5c640b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:26.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.167+0000 7f5c697a4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c640b4fa0 0x7f5c640b53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:57874/0 (socket says 172.21.15.105:57874) 2024-09-21T03:20:26.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.167+0000 7f5c697a4640 1 -- 172.21.15.105:0/1491940313 learned_addr learned my addr 172.21.15.105:0/1491940313 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:26.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.167+0000 7f5c63fff640 1 --2- 172.21.15.105:0/1491940313 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5c640d3870 0x7f5c641f5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:26.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.167+0000 7f5c68fa3640 1 --2- 172.21.15.105:0/1491940313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c6406f4b0 0x7f5c641f5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:26.171 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.167+0000 7f5c697a4640 1 -- 172.21.15.105:0/1491940313 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5c640d3870 msgr2=0x7f5c641f5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:26.171 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.167+0000 7f5c697a4640 1 --2- 172.21.15.105:0/1491940313 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5c640d3870 0x7f5c641f5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:26.171 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.167+0000 7f5c697a4640 1 -- 172.21.15.105:0/1491940313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c6406f4b0 msgr2=0x7f5c641f5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:26.171 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.167+0000 7f5c697a4640 1 --2- 172.21.15.105:0/1491940313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c6406f4b0 0x7f5c641f5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:26.171 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.167+0000 7f5c697a4640 1 -- 172.21.15.105:0/1491940313 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c640b58f0 con 0x7f5c640b4fa0 2024-09-21T03:20:26.171 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.168+0000 7f5c697a4640 1 --2- 172.21.15.105:0/1491940313 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c640b4fa0 0x7f5c640b53b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c00ca80 tx=0x7f5c5c00cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:26.171 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.168+0000 7f5c617fa640 1 -- 172.21.15.105:0/1491940313 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c016020 con 0x7f5c640b4fa0 2024-09-21T03:20:26.171 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.168+0000 7f5c617fa640 1 -- 172.21.15.105:0/1491940313 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c5c00ad20 con 0x7f5c640b4fa0 2024-09-21T03:20:26.171 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.168+0000 7f5c617fa640 1 -- 172.21.15.105:0/1491940313 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c012680 con 0x7f5c640b4fa0 2024-09-21T03:20:26.171 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.168+0000 7f5c6b207640 1 -- 172.21.15.105:0/1491940313 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c640c9410 con 0x7f5c640b4fa0 2024-09-21T03:20:26.171 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.168+0000 7f5c6b207640 1 -- 172.21.15.105:0/1491940313 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c640cdfd0 con 0x7f5c640b4fa0 2024-09-21T03:20:26.172 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:20:26.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.169+0000 7f5c6b207640 1 -- 172.21.15.105:0/1491940313 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c640d1500 con 0x7f5c640b4fa0 2024-09-21T03:20:26.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.170+0000 7f5c617fa640 1 -- 172.21.15.105:0/1491940313 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5c5c019020 con 0x7f5c640b4fa0 2024-09-21T03:20:26.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.170+0000 7f5c617fa640 1 --2- 172.21.15.105:0/1491940313 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5c48078bc0 0x7f5c4807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:26.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.170+0000 7f5c617fa640 1 -- 172.21.15.105:0/1491940313 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f5c5c09af10 con 0x7f5c640b4fa0 2024-09-21T03:20:26.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.171+0000 7f5c68fa3640 1 --2- 172.21.15.105:0/1491940313 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5c48078bc0 0x7f5c4807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:26.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.171+0000 7f5c68fa3640 1 --2- 172.21.15.105:0/1491940313 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5c48078bc0 0x7f5c4807b0d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5c58034000 tx=0x7f5c58004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:26.175 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:20:26.176 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.175+0000 7f5c617fa640 1 -- 172.21.15.105:0/1491940313 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5c5c020030 con 0x7f5c640b4fa0 2024-09-21T03:20:26.357 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.356+0000 7f5c6b207640 1 -- 172.21.15.105:0/1491940313 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5c640c9720 con 0x7f5c48078bc0 2024-09-21T03:20:26.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.361+0000 7f5c617fa640 1 -- 172.21.15.105:0/1491940313 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250801 (secure 0 0 0) 0x7f5c640c9720 con 0x7f5c48078bc0 2024-09-21T03:20:26.365 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:20:26.366 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:20:26.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.364+0000 7f5c6b207640 1 -- 172.21.15.105:0/1491940313 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5c48078bc0 msgr2=0x7f5c4807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:26.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.364+0000 7f5c6b207640 1 --2- 172.21.15.105:0/1491940313 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5c48078bc0 0x7f5c4807b0d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5c58034000 tx=0x7f5c58004730 comp rx=0 tx=0).stop 2024-09-21T03:20:26.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.364+0000 7f5c6b207640 1 -- 172.21.15.105:0/1491940313 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c640b4fa0 msgr2=0x7f5c640b53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:26.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.364+0000 7f5c6b207640 1 --2- 172.21.15.105:0/1491940313 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c640b4fa0 0x7f5c640b53b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c00ca80 tx=0x7f5c5c00cf40 comp rx=0 tx=0).stop 2024-09-21T03:20:26.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.364+0000 7f5c6b207640 1 -- 172.21.15.105:0/1491940313 shutdown_connections 2024-09-21T03:20:26.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.364+0000 7f5c6b207640 1 --2- 172.21.15.105:0/1491940313 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5c48078bc0 0x7f5c4807b0d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:26.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.364+0000 7f5c6b207640 1 --2- 172.21.15.105:0/1491940313 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c640b4fa0 0x7f5c640b53b0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:26.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.364+0000 7f5c6b207640 1 --2- 172.21.15.105:0/1491940313 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5c640d3870 0x7f5c641f5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:26.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.364+0000 7f5c6b207640 1 --2- 172.21.15.105:0/1491940313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c6406f4b0 0x7f5c641f5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:26.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.364+0000 7f5c6b207640 1 -- 172.21.15.105:0/1491940313 >> 172.21.15.105:0/1491940313 conn(0x7f5c6408bfc0 msgr2=0x7f5c640b1810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:26.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.364+0000 7f5c6b207640 1 -- 172.21.15.105:0/1491940313 shutdown_connections 2024-09-21T03:20:26.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.364+0000 7f5c6b207640 1 -- 172.21.15.105:0/1491940313 wait complete. 2024-09-21T03:20:26.377 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":103,"stamp":"2024-09-21T03:20:25.308943+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":133,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":117,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229748,"kb_used_data":5188,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744972,"statfs":{"total":773094113280,"available":772858851328,"internally_reserved":0,"allocated":5312512,"data_stored":2795632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.974040"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.360568+0000","last_change":"2024-09-21T03:20:22.354648+0000","last_active":"2024-09-21T03:20:22.360568+0000","last_peered":"2024-09-21T03:20:22.360568+0000","last_clean":"2024-09-21T03:20:22.360568+0000","last_became_active":"2024-09-21T03:20:22.354279+0000","last_became_peered":"2024-09-21T03:20:22.354279+0000","last_unstale":"2024-09-21T03:20:22.360568+0000","last_undegraded":"2024-09-21T03:20:22.360568+0000","last_fullsized":"2024-09-21T03:20:22.360568+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:22.864214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.365953+0000","last_change":"2024-09-21T03:20:22.363925+0000","last_active":"2024-09-21T03:20:22.365953+0000","last_peered":"2024-09-21T03:20:22.365953+0000","last_clean":"2024-09-21T03:20:22.365953+0000","last_became_active":"2024-09-21T03:20:22.363588+0000","last_became_peered":"2024-09-21T03:20:22.363588+0000","last_unstale":"2024-09-21T03:20:22.365953+0000","last_undegraded":"2024-09-21T03:20:22.365953+0000","last_fullsized":"2024-09-21T03:20:22.365953+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:15.584346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362247+0000","last_change":"2024-09-21T03:20:22.356946+0000","last_active":"2024-09-21T03:20:23.362247+0000","last_peered":"2024-09-21T03:20:23.362247+0000","last_clean":"2024-09-21T03:20:23.362247+0000","last_became_active":"2024-09-21T03:20:22.356625+0000","last_became_peered":"2024-09-21T03:20:22.356625+0000","last_unstale":"2024-09-21T03:20:23.362247+0000","last_undegraded":"2024-09-21T03:20:23.362247+0000","last_fullsized":"2024-09-21T03:20:23.362247+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:24.993031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.348358+0000","last_change":"2024-09-21T03:20:21.348358+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.348358+0000","last_undegraded":"2024-09-21T03:20:21.348358+0000","last_fullsized":"2024-09-21T03:20:21.348358+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.371612+0000","last_change":"2024-09-21T03:20:22.368074+0000","last_active":"2024-09-21T03:20:22.371612+0000","last_peered":"2024-09-21T03:20:22.371612+0000","last_clean":"2024-09-21T03:20:22.371612+0000","last_became_active":"2024-09-21T03:20:22.367712+0000","last_became_peered":"2024-09-21T03:20:22.367712+0000","last_unstale":"2024-09-21T03:20:22.371612+0000","last_undegraded":"2024-09-21T03:20:22.371612+0000","last_fullsized":"2024-09-21T03:20:22.371612+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:19.648403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.358636+0000","last_change":"2024-09-21T03:20:22.357312+0000","last_active":"2024-09-21T03:20:22.358636+0000","last_peered":"2024-09-21T03:20:22.358636+0000","last_clean":"2024-09-21T03:20:22.358636+0000","last_became_active":"2024-09-21T03:20:22.356723+0000","last_became_peered":"2024-09-21T03:20:22.356723+0000","last_unstale":"2024-09-21T03:20:22.358636+0000","last_undegraded":"2024-09-21T03:20:22.358636+0000","last_fullsized":"2024-09-21T03:20:22.358636+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:11.740501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.360735+0000","last_change":"2024-09-21T03:20:22.354451+0000","last_active":"2024-09-21T03:20:22.360735+0000","last_peered":"2024-09-21T03:20:22.360735+0000","last_clean":"2024-09-21T03:20:22.360735+0000","last_became_active":"2024-09-21T03:20:22.354036+0000","last_became_peered":"2024-09-21T03:20:22.354036+0000","last_unstale":"2024-09-21T03:20:22.360735+0000","last_undegraded":"2024-09-21T03:20:22.360735+0000","last_fullsized":"2024-09-21T03:20:22.360735+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:19.648403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.351127+0000","last_change":"2024-09-21T03:20:21.351127+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.351127+0000","last_undegraded":"2024-09-21T03:20:21.351127+0000","last_fullsized":"2024-09-21T03:20:21.351127+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.351434+0000","last_change":"2024-09-21T03:20:21.351434+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.351434+0000","last_undegraded":"2024-09-21T03:20:21.351434+0000","last_fullsized":"2024-09-21T03:20:21.351434+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.353175+0000","last_change":"2024-09-21T03:20:21.353175+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.353175+0000","last_undegraded":"2024-09-21T03:20:21.353175+0000","last_fullsized":"2024-09-21T03:20:21.353175+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.349066+0000","last_change":"2024-09-21T03:20:21.349066+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.349066+0000","last_undegraded":"2024-09-21T03:20:21.349066+0000","last_fullsized":"2024-09-21T03:20:21.349066+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.362804+0000","last_change":"2024-09-21T03:20:22.361976+0000","last_active":"2024-09-21T03:20:22.362804+0000","last_peered":"2024-09-21T03:20:22.362804+0000","last_clean":"2024-09-21T03:20:22.362804+0000","last_became_active":"2024-09-21T03:20:22.361662+0000","last_became_peered":"2024-09-21T03:20:22.361662+0000","last_unstale":"2024-09-21T03:20:22.362804+0000","last_undegraded":"2024-09-21T03:20:22.362804+0000","last_fullsized":"2024-09-21T03:20:22.362804+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:08.243558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.361094+0000","last_change":"2024-09-21T03:20:22.370554+0000","last_active":"2024-09-21T03:20:23.361094+0000","last_peered":"2024-09-21T03:20:23.361094+0000","last_clean":"2024-09-21T03:20:23.361094+0000","last_became_active":"2024-09-21T03:20:22.370255+0000","last_became_peered":"2024-09-21T03:20:22.370255+0000","last_unstale":"2024-09-21T03:20:23.361094+0000","last_undegraded":"2024-09-21T03:20:23.361094+0000","last_fullsized":"2024-09-21T03:20:23.361094+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:10:31.487754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.347383+0000","last_change":"2024-09-21T03:20:21.347383+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.347383+0000","last_undegraded":"2024-09-21T03:20:21.347383+0000","last_fullsized":"2024-09-21T03:20:21.347383+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.368579+0000","last_change":"2024-09-21T03:20:22.364458+0000","last_active":"2024-09-21T03:20:22.368579+0000","last_peered":"2024-09-21T03:20:22.368579+0000","last_clean":"2024-09-21T03:20:22.368579+0000","last_became_active":"2024-09-21T03:20:22.363602+0000","last_became_peered":"2024-09-21T03:20:22.363602+0000","last_unstale":"2024-09-21T03:20:22.368579+0000","last_undegraded":"2024-09-21T03:20:22.368579+0000","last_fullsized":"2024-09-21T03:20:22.368579+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:28.932663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362357+0000","last_change":"2024-09-21T03:20:22.364557+0000","last_active":"2024-09-21T03:20:23.362357+0000","last_peered":"2024-09-21T03:20:23.362357+0000","last_clean":"2024-09-21T03:20:23.362357+0000","last_became_active":"2024-09-21T03:20:22.364229+0000","last_became_peered":"2024-09-21T03:20:22.364229+0000","last_unstale":"2024-09-21T03:20:23.362357+0000","last_undegraded":"2024-09-21T03:20:23.362357+0000","last_fullsized":"2024-09-21T03:20:23.362357+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:04.759943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363685+0000","last_change":"2024-09-21T03:20:22.362778+0000","last_active":"2024-09-21T03:20:23.363685+0000","last_peered":"2024-09-21T03:20:23.363685+0000","last_clean":"2024-09-21T03:20:23.363685+0000","last_became_active":"2024-09-21T03:20:22.362478+0000","last_became_peered":"2024-09-21T03:20:22.362478+0000","last_unstale":"2024-09-21T03:20:23.363685+0000","last_undegraded":"2024-09-21T03:20:23.363685+0000","last_fullsized":"2024-09-21T03:20:23.363685+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:11.553421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362843+0000","last_change":"2024-09-21T03:20:22.363582+0000","last_active":"2024-09-21T03:20:23.362843+0000","last_peered":"2024-09-21T03:20:23.362843+0000","last_clean":"2024-09-21T03:20:23.362843+0000","last_became_active":"2024-09-21T03:20:22.363282+0000","last_became_peered":"2024-09-21T03:20:22.363282+0000","last_unstale":"2024-09-21T03:20:23.362843+0000","last_undegraded":"2024-09-21T03:20:23.362843+0000","last_fullsized":"2024-09-21T03:20:23.362843+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:23:12.532832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363362+0000","last_change":"2024-09-21T03:20:22.363482+0000","last_active":"2024-09-21T03:20:23.363362+0000","last_peered":"2024-09-21T03:20:23.363362+0000","last_clean":"2024-09-21T03:20:23.363362+0000","last_became_active":"2024-09-21T03:20:22.363129+0000","last_became_peered":"2024-09-21T03:20:22.363129+0000","last_unstale":"2024-09-21T03:20:23.363362+0000","last_undegraded":"2024-09-21T03:20:23.363362+0000","last_fullsized":"2024-09-21T03:20:23.363362+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:12:18.021857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.360949+0000","last_change":"2024-09-21T03:20:22.370285+0000","last_active":"2024-09-21T03:20:23.360949+0000","last_peered":"2024-09-21T03:20:23.360949+0000","last_clean":"2024-09-21T03:20:23.360949+0000","last_became_active":"2024-09-21T03:20:22.369715+0000","last_became_peered":"2024-09-21T03:20:22.369715+0000","last_unstale":"2024-09-21T03:20:23.360949+0000","last_undegraded":"2024-09-21T03:20:23.360949+0000","last_fullsized":"2024-09-21T03:20:23.360949+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:08.636582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.364809+0000","last_change":"2024-09-21T03:20:22.361197+0000","last_active":"2024-09-21T03:20:22.364809+0000","last_peered":"2024-09-21T03:20:22.364809+0000","last_clean":"2024-09-21T03:20:22.364809+0000","last_became_active":"2024-09-21T03:20:22.360584+0000","last_became_peered":"2024-09-21T03:20:22.360584+0000","last_unstale":"2024-09-21T03:20:22.364809+0000","last_undegraded":"2024-09-21T03:20:22.364809+0000","last_fullsized":"2024-09-21T03:20:22.364809+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:20.393544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.346857+0000","last_change":"2024-09-21T03:20:21.346857+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.346857+0000","last_undegraded":"2024-09-21T03:20:21.346857+0000","last_fullsized":"2024-09-21T03:20:21.346857+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362495+0000","last_change":"2024-09-21T03:20:22.359184+0000","last_active":"2024-09-21T03:20:23.362495+0000","last_peered":"2024-09-21T03:20:23.362495+0000","last_clean":"2024-09-21T03:20:23.362495+0000","last_became_active":"2024-09-21T03:20:22.357185+0000","last_became_peered":"2024-09-21T03:20:22.357185+0000","last_unstale":"2024-09-21T03:20:23.362495+0000","last_undegraded":"2024-09-21T03:20:23.362495+0000","last_fullsized":"2024-09-21T03:20:23.362495+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:13.194698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363072+0000","last_change":"2024-09-21T03:20:22.357204+0000","last_active":"2024-09-21T03:20:23.363072+0000","last_peered":"2024-09-21T03:20:23.363072+0000","last_clean":"2024-09-21T03:20:23.363072+0000","last_became_active":"2024-09-21T03:20:22.356888+0000","last_became_peered":"2024-09-21T03:20:22.356888+0000","last_unstale":"2024-09-21T03:20:23.363072+0000","last_undegraded":"2024-09-21T03:20:23.363072+0000","last_fullsized":"2024-09-21T03:20:23.363072+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:23:58.513737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363507+0000","last_change":"2024-09-21T03:20:22.366679+0000","last_active":"2024-09-21T03:20:23.363507+0000","last_peered":"2024-09-21T03:20:23.363507+0000","last_clean":"2024-09-21T03:20:23.363507+0000","last_became_active":"2024-09-21T03:20:22.366295+0000","last_became_peered":"2024-09-21T03:20:22.366295+0000","last_unstale":"2024-09-21T03:20:23.363507+0000","last_undegraded":"2024-09-21T03:20:23.363507+0000","last_fullsized":"2024-09-21T03:20:23.363507+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:56.748578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.360927+0000","last_change":"2024-09-21T03:20:22.363184+0000","last_active":"2024-09-21T03:20:23.360927+0000","last_peered":"2024-09-21T03:20:23.360927+0000","last_clean":"2024-09-21T03:20:23.360927+0000","last_became_active":"2024-09-21T03:20:22.362501+0000","last_became_peered":"2024-09-21T03:20:22.362501+0000","last_unstale":"2024-09-21T03:20:23.360927+0000","last_undegraded":"2024-09-21T03:20:23.360927+0000","last_fullsized":"2024-09-21T03:20:23.360927+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:21:09.148798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362478+0000","last_change":"2024-09-21T03:20:22.362032+0000","last_active":"2024-09-21T03:20:23.362478+0000","last_peered":"2024-09-21T03:20:23.362478+0000","last_clean":"2024-09-21T03:20:23.362478+0000","last_became_active":"2024-09-21T03:20:22.361748+0000","last_became_peered":"2024-09-21T03:20:22.361748+0000","last_unstale":"2024-09-21T03:20:23.362478+0000","last_undegraded":"2024-09-21T03:20:23.362478+0000","last_fullsized":"2024-09-21T03:20:23.362478+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:08.318524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.362382+0000","last_change":"2024-09-21T03:20:22.361207+0000","last_active":"2024-09-21T03:20:22.362382+0000","last_peered":"2024-09-21T03:20:22.362382+0000","last_clean":"2024-09-21T03:20:22.362382+0000","last_became_active":"2024-09-21T03:20:22.360879+0000","last_became_peered":"2024-09-21T03:20:22.360879+0000","last_unstale":"2024-09-21T03:20:22.362382+0000","last_undegraded":"2024-09-21T03:20:22.362382+0000","last_fullsized":"2024-09-21T03:20:22.362382+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:27.628018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362977+0000","last_change":"2024-09-21T03:20:22.358441+0000","last_active":"2024-09-21T03:20:23.362977+0000","last_peered":"2024-09-21T03:20:23.362977+0000","last_clean":"2024-09-21T03:20:23.362977+0000","last_became_active":"2024-09-21T03:20:22.358130+0000","last_became_peered":"2024-09-21T03:20:22.358130+0000","last_unstale":"2024-09-21T03:20:23.362977+0000","last_undegraded":"2024-09-21T03:20:23.362977+0000","last_fullsized":"2024-09-21T03:20:23.362977+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:06.233989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362070+0000","last_change":"2024-09-21T03:20:22.356052+0000","last_active":"2024-09-21T03:20:23.362070+0000","last_peered":"2024-09-21T03:20:23.362070+0000","last_clean":"2024-09-21T03:20:23.362070+0000","last_became_active":"2024-09-21T03:20:22.355703+0000","last_became_peered":"2024-09-21T03:20:22.355703+0000","last_unstale":"2024-09-21T03:20:23.362070+0000","last_undegraded":"2024-09-21T03:20:23.362070+0000","last_fullsized":"2024-09-21T03:20:23.362070+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:54.277955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.368552+0000","last_change":"2024-09-21T03:20:22.364133+0000","last_active":"2024-09-21T03:20:22.368552+0000","last_peered":"2024-09-21T03:20:22.368552+0000","last_clean":"2024-09-21T03:20:22.368552+0000","last_became_active":"2024-09-21T03:20:22.363162+0000","last_became_peered":"2024-09-21T03:20:22.363162+0000","last_unstale":"2024-09-21T03:20:22.368552+0000","last_undegraded":"2024-09-21T03:20:22.368552+0000","last_fullsized":"2024-09-21T03:20:22.368552+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:10.473935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.361087+0000","last_change":"2024-09-21T03:20:22.358222+0000","last_active":"2024-09-21T03:20:23.361087+0000","last_peered":"2024-09-21T03:20:23.361087+0000","last_clean":"2024-09-21T03:20:23.361087+0000","last_became_active":"2024-09-21T03:20:22.357933+0000","last_became_peered":"2024-09-21T03:20:22.357933+0000","last_unstale":"2024-09-21T03:20:23.361087+0000","last_undegraded":"2024-09-21T03:20:23.361087+0000","last_fullsized":"2024-09-21T03:20:23.361087+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:18.911040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.356962+0000","last_change":"2024-09-21T03:20:22.353413+0000","last_active":"2024-09-21T03:20:22.356962+0000","last_peered":"2024-09-21T03:20:22.356962+0000","last_clean":"2024-09-21T03:20:22.356962+0000","last_became_active":"2024-09-21T03:20:22.353091+0000","last_became_peered":"2024-09-21T03:20:22.353091+0000","last_unstale":"2024-09-21T03:20:22.356962+0000","last_undegraded":"2024-09-21T03:20:22.356962+0000","last_fullsized":"2024-09-21T03:20:22.356962+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:19:14.358260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.377306+0000","last_change":"2024-09-21T03:20:21.353455+0000","last_active":"2024-09-21T03:20:22.377306+0000","last_peered":"2024-09-21T03:20:22.377306+0000","last_clean":"2024-09-21T03:20:22.377306+0000","last_became_active":"2024-09-21T03:20:21.353167+0000","last_became_peered":"2024-09-21T03:20:21.353167+0000","last_unstale":"2024-09-21T03:20:22.377306+0000","last_undegraded":"2024-09-21T03:20:22.377306+0000","last_fullsized":"2024-09-21T03:20:22.377306+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:10.549273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363625+0000","last_change":"2024-09-21T03:20:22.360284+0000","last_active":"2024-09-21T03:20:23.363625+0000","last_peered":"2024-09-21T03:20:23.363625+0000","last_clean":"2024-09-21T03:20:23.363625+0000","last_became_active":"2024-09-21T03:20:22.359131+0000","last_became_peered":"2024-09-21T03:20:22.359131+0000","last_unstale":"2024-09-21T03:20:23.363625+0000","last_undegraded":"2024-09-21T03:20:23.363625+0000","last_fullsized":"2024-09-21T03:20:23.363625+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:27:18.588119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362999+0000","last_change":"2024-09-21T03:20:21.358490+0000","last_active":"2024-09-21T03:20:23.362999+0000","last_peered":"2024-09-21T03:20:23.362999+0000","last_clean":"2024-09-21T03:20:23.362999+0000","last_became_active":"2024-09-21T03:20:21.357991+0000","last_became_peered":"2024-09-21T03:20:21.357991+0000","last_unstale":"2024-09-21T03:20:23.362999+0000","last_undegraded":"2024-09-21T03:20:23.362999+0000","last_fullsized":"2024-09-21T03:20:23.362999+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:52.543844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.374252+0000","last_change":"2024-09-21T03:20:22.370492+0000","last_active":"2024-09-21T03:20:22.374252+0000","last_peered":"2024-09-21T03:20:22.374252+0000","last_clean":"2024-09-21T03:20:22.374252+0000","last_became_active":"2024-09-21T03:20:22.370117+0000","last_became_peered":"2024-09-21T03:20:22.370117+0000","last_unstale":"2024-09-21T03:20:22.374252+0000","last_undegraded":"2024-09-21T03:20:22.374252+0000","last_fullsized":"2024-09-21T03:20:22.374252+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:22.864214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.372898+0000","last_change":"2024-09-21T03:20:21.363908+0000","last_active":"2024-09-21T03:20:22.372898+0000","last_peered":"2024-09-21T03:20:22.372898+0000","last_clean":"2024-09-21T03:20:22.372898+0000","last_became_active":"2024-09-21T03:20:21.363494+0000","last_became_peered":"2024-09-21T03:20:21.363494+0000","last_unstale":"2024-09-21T03:20:22.372898+0000","last_undegraded":"2024-09-21T03:20:22.372898+0000","last_fullsized":"2024-09-21T03:20:22.372898+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:40.157840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.358596+0000","last_change":"2024-09-21T03:20:22.357615+0000","last_active":"2024-09-21T03:20:22.358596+0000","last_peered":"2024-09-21T03:20:22.358596+0000","last_clean":"2024-09-21T03:20:22.358596+0000","last_became_active":"2024-09-21T03:20:22.357317+0000","last_became_peered":"2024-09-21T03:20:22.357317+0000","last_unstale":"2024-09-21T03:20:22.358596+0000","last_undegraded":"2024-09-21T03:20:22.358596+0000","last_fullsized":"2024-09-21T03:20:22.358596+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:12:18.021857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.374621+0000","last_change":"2024-09-21T03:20:21.361902+0000","last_active":"2024-09-21T03:20:22.374621+0000","last_peered":"2024-09-21T03:20:22.374621+0000","last_clean":"2024-09-21T03:20:22.374621+0000","last_became_active":"2024-09-21T03:20:21.361549+0000","last_became_peered":"2024-09-21T03:20:21.361549+0000","last_unstale":"2024-09-21T03:20:22.374621+0000","last_undegraded":"2024-09-21T03:20:22.374621+0000","last_fullsized":"2024-09-21T03:20:22.374621+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:26.623870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362338+0000","last_change":"2024-09-21T03:20:22.353213+0000","last_active":"2024-09-21T03:20:23.362338+0000","last_peered":"2024-09-21T03:20:23.362338+0000","last_clean":"2024-09-21T03:20:23.362338+0000","last_became_active":"2024-09-21T03:20:22.352809+0000","last_became_peered":"2024-09-21T03:20:22.352809+0000","last_unstale":"2024-09-21T03:20:23.362338+0000","last_undegraded":"2024-09-21T03:20:23.362338+0000","last_fullsized":"2024-09-21T03:20:23.362338+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:51:09.144620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.371958+0000","last_change":"2024-09-21T03:20:21.360479+0000","last_active":"2024-09-21T03:20:22.371958+0000","last_peered":"2024-09-21T03:20:22.371958+0000","last_clean":"2024-09-21T03:20:22.371958+0000","last_became_active":"2024-09-21T03:20:21.360179+0000","last_became_peered":"2024-09-21T03:20:21.360179+0000","last_unstale":"2024-09-21T03:20:22.371958+0000","last_undegraded":"2024-09-21T03:20:22.371958+0000","last_fullsized":"2024-09-21T03:20:22.371958+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:31.358952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.350317+0000","last_change":"2024-09-21T03:20:21.350317+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.350317+0000","last_undegraded":"2024-09-21T03:20:21.350317+0000","last_fullsized":"2024-09-21T03:20:21.350317+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362478+0000","last_change":"2024-09-21T03:20:21.360913+0000","last_active":"2024-09-21T03:20:23.362478+0000","last_peered":"2024-09-21T03:20:23.362478+0000","last_clean":"2024-09-21T03:20:23.362478+0000","last_became_active":"2024-09-21T03:20:21.360581+0000","last_became_peered":"2024-09-21T03:20:21.360581+0000","last_unstale":"2024-09-21T03:20:23.362478+0000","last_undegraded":"2024-09-21T03:20:23.362478+0000","last_fullsized":"2024-09-21T03:20:23.362478+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:57.040972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.350681+0000","last_change":"2024-09-21T03:20:21.350681+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.350681+0000","last_undegraded":"2024-09-21T03:20:21.350681+0000","last_fullsized":"2024-09-21T03:20:21.350681+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.353738+0000","last_change":"2024-09-21T03:20:21.363512+0000","last_active":"2024-09-21T03:20:22.353738+0000","last_peered":"2024-09-21T03:20:22.353738+0000","last_clean":"2024-09-21T03:20:22.353738+0000","last_became_active":"2024-09-21T03:20:21.363215+0000","last_became_peered":"2024-09-21T03:20:21.363215+0000","last_unstale":"2024-09-21T03:20:22.353738+0000","last_undegraded":"2024-09-21T03:20:22.353738+0000","last_fullsized":"2024-09-21T03:20:22.353738+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:48.695082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362814+0000","last_change":"2024-09-21T03:20:22.359160+0000","last_active":"2024-09-21T03:20:23.362814+0000","last_peered":"2024-09-21T03:20:23.362814+0000","last_clean":"2024-09-21T03:20:23.362814+0000","last_became_active":"2024-09-21T03:20:22.356795+0000","last_became_peered":"2024-09-21T03:20:22.356795+0000","last_unstale":"2024-09-21T03:20:23.362814+0000","last_undegraded":"2024-09-21T03:20:23.362814+0000","last_fullsized":"2024-09-21T03:20:23.362814+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:48.006533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T03:20:21.364295+0000","last_change":"2024-09-21T03:20:21.359300+0000","last_active":"2024-09-21T03:20:21.364295+0000","last_peered":"2024-09-21T03:20:21.364295+0000","last_clean":"2024-09-21T03:20:21.364295+0000","last_became_active":"2024-09-21T03:20:21.358998+0000","last_became_peered":"2024-09-21T03:20:21.358998+0000","last_unstale":"2024-09-21T03:20:21.364295+0000","last_undegraded":"2024-09-21T03:20:21.364295+0000","last_fullsized":"2024-09-21T03:20:21.364295+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:35:49.970928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362865+0000","last_change":"2024-09-21T03:20:22.361977+0000","last_active":"2024-09-21T03:20:23.362865+0000","last_peered":"2024-09-21T03:20:23.362865+0000","last_clean":"2024-09-21T03:20:23.362865+0000","last_became_active":"2024-09-21T03:20:22.361641+0000","last_became_peered":"2024-09-21T03:20:22.361641+0000","last_unstale":"2024-09-21T03:20:23.362865+0000","last_undegraded":"2024-09-21T03:20:23.362865+0000","last_fullsized":"2024-09-21T03:20:23.362865+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:34.601478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363827+0000","last_change":"2024-09-21T03:20:21.358364+0000","last_active":"2024-09-21T03:20:23.363827+0000","last_peered":"2024-09-21T03:20:23.363827+0000","last_clean":"2024-09-21T03:20:23.363827+0000","last_became_active":"2024-09-21T03:20:21.357818+0000","last_became_peered":"2024-09-21T03:20:21.357818+0000","last_unstale":"2024-09-21T03:20:23.363827+0000","last_undegraded":"2024-09-21T03:20:23.363827+0000","last_fullsized":"2024-09-21T03:20:23.363827+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:40.157840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.368225+0000","last_change":"2024-09-21T03:20:22.365443+0000","last_active":"2024-09-21T03:20:22.368225+0000","last_peered":"2024-09-21T03:20:22.368225+0000","last_clean":"2024-09-21T03:20:22.368225+0000","last_became_active":"2024-09-21T03:20:22.365081+0000","last_became_peered":"2024-09-21T03:20:22.365081+0000","last_unstale":"2024-09-21T03:20:22.368225+0000","last_undegraded":"2024-09-21T03:20:22.368225+0000","last_fullsized":"2024-09-21T03:20:22.368225+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:13:18.276359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T03:20:21.364445+0000","last_change":"2024-09-21T03:20:21.360629+0000","last_active":"2024-09-21T03:20:21.364445+0000","last_peered":"2024-09-21T03:20:21.364445+0000","last_clean":"2024-09-21T03:20:21.364445+0000","last_became_active":"2024-09-21T03:20:21.360357+0000","last_became_peered":"2024-09-21T03:20:21.360357+0000","last_unstale":"2024-09-21T03:20:21.364445+0000","last_undegraded":"2024-09-21T03:20:21.364445+0000","last_fullsized":"2024-09-21T03:20:21.364445+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:41.136243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.369350+0000","last_change":"2024-09-21T03:20:22.368659+0000","last_active":"2024-09-21T03:20:22.369350+0000","last_peered":"2024-09-21T03:20:22.369350+0000","last_clean":"2024-09-21T03:20:22.369350+0000","last_became_active":"2024-09-21T03:20:22.359839+0000","last_became_peered":"2024-09-21T03:20:22.359839+0000","last_unstale":"2024-09-21T03:20:22.369350+0000","last_undegraded":"2024-09-21T03:20:22.369350+0000","last_fullsized":"2024-09-21T03:20:22.369350+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:29.987903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.377624+0000","last_change":"2024-09-21T03:20:21.360749+0000","last_active":"2024-09-21T03:20:22.377624+0000","last_peered":"2024-09-21T03:20:22.377624+0000","last_clean":"2024-09-21T03:20:22.377624+0000","last_became_active":"2024-09-21T03:20:21.359582+0000","last_became_peered":"2024-09-21T03:20:21.359582+0000","last_unstale":"2024-09-21T03:20:22.377624+0000","last_undegraded":"2024-09-21T03:20:22.377624+0000","last_fullsized":"2024-09-21T03:20:22.377624+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:33.367277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.360774+0000","last_change":"2024-09-21T03:20:22.354530+0000","last_active":"2024-09-21T03:20:22.360774+0000","last_peered":"2024-09-21T03:20:22.360774+0000","last_clean":"2024-09-21T03:20:22.360774+0000","last_became_active":"2024-09-21T03:20:22.354017+0000","last_became_peered":"2024-09-21T03:20:22.354017+0000","last_unstale":"2024-09-21T03:20:22.360774+0000","last_undegraded":"2024-09-21T03:20:22.360774+0000","last_fullsized":"2024-09-21T03:20:22.360774+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:13.722902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":21,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.360948+0000","last_change":"2024-09-21T03:20:21.359485+0000","last_active":"2024-09-21T03:20:23.360948+0000","last_peered":"2024-09-21T03:20:23.360948+0000","last_clean":"2024-09-21T03:20:23.360948+0000","last_became_active":"2024-09-21T03:20:21.359182+0000","last_became_peered":"2024-09-21T03:20:21.359182+0000","last_unstale":"2024-09-21T03:20:23.360948+0000","last_undegraded":"2024-09-21T03:20:23.360948+0000","last_fullsized":"2024-09-21T03:20:23.360948+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:06:13.612749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363374+0000","last_change":"2024-09-21T03:20:22.363602+0000","last_active":"2024-09-21T03:20:23.363374+0000","last_peered":"2024-09-21T03:20:23.363374+0000","last_clean":"2024-09-21T03:20:23.363374+0000","last_became_active":"2024-09-21T03:20:22.363245+0000","last_became_peered":"2024-09-21T03:20:22.363245+0000","last_unstale":"2024-09-21T03:20:23.363374+0000","last_undegraded":"2024-09-21T03:20:23.363374+0000","last_fullsized":"2024-09-21T03:20:23.363374+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:58:04.733519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.375839+0000","last_change":"2024-09-21T03:20:21.362428+0000","last_active":"2024-09-21T03:20:22.375839+0000","last_peered":"2024-09-21T03:20:22.375839+0000","last_clean":"2024-09-21T03:20:22.375839+0000","last_became_active":"2024-09-21T03:20:21.362120+0000","last_became_peered":"2024-09-21T03:20:21.362120+0000","last_unstale":"2024-09-21T03:20:22.375839+0000","last_undegraded":"2024-09-21T03:20:22.375839+0000","last_fullsized":"2024-09-21T03:20:22.375839+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:07.239411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.349866+0000","last_change":"2024-09-21T03:20:21.349866+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.349866+0000","last_undegraded":"2024-09-21T03:20:21.349866+0000","last_fullsized":"2024-09-21T03:20:21.349866+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.346757+0000","last_change":"2024-09-21T03:20:21.357809+0000","last_active":"2024-09-21T03:20:22.346757+0000","last_peered":"2024-09-21T03:20:22.346757+0000","last_clean":"2024-09-21T03:20:22.346757+0000","last_became_active":"2024-09-21T03:20:21.357478+0000","last_became_peered":"2024-09-21T03:20:21.357478+0000","last_unstale":"2024-09-21T03:20:22.346757+0000","last_undegraded":"2024-09-21T03:20:22.346757+0000","last_fullsized":"2024-09-21T03:20:22.346757+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:31.358952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.359974+0000","last_change":"2024-09-21T03:20:22.358128+0000","last_active":"2024-09-21T03:20:22.359974+0000","last_peered":"2024-09-21T03:20:22.359974+0000","last_clean":"2024-09-21T03:20:22.359974+0000","last_became_active":"2024-09-21T03:20:22.357840+0000","last_became_peered":"2024-09-21T03:20:22.357840+0000","last_unstale":"2024-09-21T03:20:22.359974+0000","last_undegraded":"2024-09-21T03:20:22.359974+0000","last_fullsized":"2024-09-21T03:20:22.359974+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:13:18.276359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.348394+0000","last_change":"2024-09-21T03:20:21.362378+0000","last_active":"2024-09-21T03:20:22.348394+0000","last_peered":"2024-09-21T03:20:22.348394+0000","last_clean":"2024-09-21T03:20:22.348394+0000","last_became_active":"2024-09-21T03:20:21.362053+0000","last_became_peered":"2024-09-21T03:20:21.362053+0000","last_unstale":"2024-09-21T03:20:22.348394+0000","last_undegraded":"2024-09-21T03:20:22.348394+0000","last_fullsized":"2024-09-21T03:20:22.348394+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:48.695082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.354711+0000","last_change":"2024-09-21T03:20:22.352414+0000","last_active":"2024-09-21T03:20:22.354711+0000","last_peered":"2024-09-21T03:20:22.354711+0000","last_clean":"2024-09-21T03:20:22.354711+0000","last_became_active":"2024-09-21T03:20:22.352087+0000","last_became_peered":"2024-09-21T03:20:22.352087+0000","last_unstale":"2024-09-21T03:20:22.354711+0000","last_undegraded":"2024-09-21T03:20:22.354711+0000","last_fullsized":"2024-09-21T03:20:22.354711+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:15.584346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T03:20:21.364479+0000","last_change":"2024-09-21T03:20:21.361289+0000","last_active":"2024-09-21T03:20:21.364479+0000","last_peered":"2024-09-21T03:20:21.364479+0000","last_clean":"2024-09-21T03:20:21.364479+0000","last_became_active":"2024-09-21T03:20:21.360579+0000","last_became_peered":"2024-09-21T03:20:21.360579+0000","last_unstale":"2024-09-21T03:20:21.364479+0000","last_undegraded":"2024-09-21T03:20:21.364479+0000","last_fullsized":"2024-09-21T03:20:21.364479+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:48.365369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.361092+0000","last_change":"2024-09-21T03:20:22.363513+0000","last_active":"2024-09-21T03:20:23.361092+0000","last_peered":"2024-09-21T03:20:23.361092+0000","last_clean":"2024-09-21T03:20:23.361092+0000","last_became_active":"2024-09-21T03:20:22.362889+0000","last_became_peered":"2024-09-21T03:20:22.362889+0000","last_unstale":"2024-09-21T03:20:23.361092+0000","last_undegraded":"2024-09-21T03:20:23.361092+0000","last_fullsized":"2024-09-21T03:20:23.361092+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:44.768435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.360918+0000","last_change":"2024-09-21T03:20:21.354915+0000","last_active":"2024-09-21T03:20:23.360918+0000","last_peered":"2024-09-21T03:20:23.360918+0000","last_clean":"2024-09-21T03:20:23.360918+0000","last_became_active":"2024-09-21T03:20:21.354531+0000","last_became_peered":"2024-09-21T03:20:21.354531+0000","last_unstale":"2024-09-21T03:20:23.360918+0000","last_undegraded":"2024-09-21T03:20:23.360918+0000","last_fullsized":"2024-09-21T03:20:23.360918+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:46.767630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.349499+0000","last_change":"2024-09-21T03:20:21.349499+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.349499+0000","last_undegraded":"2024-09-21T03:20:21.349499+0000","last_fullsized":"2024-09-21T03:20:21.349499+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362997+0000","last_change":"2024-09-21T03:20:21.358123+0000","last_active":"2024-09-21T03:20:23.362997+0000","last_peered":"2024-09-21T03:20:23.362997+0000","last_clean":"2024-09-21T03:20:23.362997+0000","last_became_active":"2024-09-21T03:20:21.357694+0000","last_became_peered":"2024-09-21T03:20:21.357694+0000","last_unstale":"2024-09-21T03:20:23.362997+0000","last_undegraded":"2024-09-21T03:20:23.362997+0000","last_fullsized":"2024-09-21T03:20:23.362997+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:45.437208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362804+0000","last_change":"2024-09-21T03:20:22.354537+0000","last_active":"2024-09-21T03:20:23.362804+0000","last_peered":"2024-09-21T03:20:23.362804+0000","last_clean":"2024-09-21T03:20:23.362804+0000","last_became_active":"2024-09-21T03:20:22.354221+0000","last_became_peered":"2024-09-21T03:20:22.354221+0000","last_unstale":"2024-09-21T03:20:23.362804+0000","last_undegraded":"2024-09-21T03:20:23.362804+0000","last_fullsized":"2024-09-21T03:20:23.362804+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:33.384208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.373213+0000","last_change":"2024-09-21T03:20:21.360136+0000","last_active":"2024-09-21T03:20:22.373213+0000","last_peered":"2024-09-21T03:20:22.373213+0000","last_clean":"2024-09-21T03:20:22.373213+0000","last_became_active":"2024-09-21T03:20:21.359678+0000","last_became_peered":"2024-09-21T03:20:21.359678+0000","last_unstale":"2024-09-21T03:20:22.373213+0000","last_undegraded":"2024-09-21T03:20:22.373213+0000","last_fullsized":"2024-09-21T03:20:22.373213+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:44.853872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363330+0000","last_change":"2024-09-21T03:20:22.352124+0000","last_active":"2024-09-21T03:20:23.363330+0000","last_peered":"2024-09-21T03:20:23.363330+0000","last_clean":"2024-09-21T03:20:23.363330+0000","last_became_active":"2024-09-21T03:20:22.351748+0000","last_became_peered":"2024-09-21T03:20:22.351748+0000","last_unstale":"2024-09-21T03:20:23.363330+0000","last_undegraded":"2024-09-21T03:20:23.363330+0000","last_fullsized":"2024-09-21T03:20:23.363330+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:57.836459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.349625+0000","last_change":"2024-09-21T03:20:21.357025+0000","last_active":"2024-09-21T03:20:22.349625+0000","last_peered":"2024-09-21T03:20:22.349625+0000","last_clean":"2024-09-21T03:20:22.349625+0000","last_became_active":"2024-09-21T03:20:21.356647+0000","last_became_peered":"2024-09-21T03:20:21.356647+0000","last_unstale":"2024-09-21T03:20:22.349625+0000","last_undegraded":"2024-09-21T03:20:22.349625+0000","last_fullsized":"2024-09-21T03:20:22.349625+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:14.580199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.358586+0000","last_change":"2024-09-21T03:20:22.356328+0000","last_active":"2024-09-21T03:20:22.358586+0000","last_peered":"2024-09-21T03:20:22.358586+0000","last_clean":"2024-09-21T03:20:22.358586+0000","last_became_active":"2024-09-21T03:20:22.355690+0000","last_became_peered":"2024-09-21T03:20:22.355690+0000","last_unstale":"2024-09-21T03:20:22.358586+0000","last_undegraded":"2024-09-21T03:20:22.358586+0000","last_fullsized":"2024-09-21T03:20:22.358586+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:22.864214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.372211+0000","last_change":"2024-09-21T03:20:21.360457+0000","last_active":"2024-09-21T03:20:22.372211+0000","last_peered":"2024-09-21T03:20:22.372211+0000","last_clean":"2024-09-21T03:20:22.372211+0000","last_became_active":"2024-09-21T03:20:21.360158+0000","last_became_peered":"2024-09-21T03:20:21.360158+0000","last_unstale":"2024-09-21T03:20:22.372211+0000","last_undegraded":"2024-09-21T03:20:22.372211+0000","last_fullsized":"2024-09-21T03:20:22.372211+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:18.644256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.372779+0000","last_change":"2024-09-21T03:20:22.363703+0000","last_active":"2024-09-21T03:20:22.372779+0000","last_peered":"2024-09-21T03:20:22.372779+0000","last_clean":"2024-09-21T03:20:22.372779+0000","last_became_active":"2024-09-21T03:20:22.363365+0000","last_became_peered":"2024-09-21T03:20:22.363365+0000","last_unstale":"2024-09-21T03:20:22.372779+0000","last_undegraded":"2024-09-21T03:20:22.372779+0000","last_fullsized":"2024-09-21T03:20:22.372779+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:28.048269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.352743+0000","last_change":"2024-09-21T03:20:21.362530+0000","last_active":"2024-09-21T03:20:22.352743+0000","last_peered":"2024-09-21T03:20:22.352743+0000","last_clean":"2024-09-21T03:20:22.352743+0000","last_became_active":"2024-09-21T03:20:21.362236+0000","last_became_peered":"2024-09-21T03:20:21.362236+0000","last_unstale":"2024-09-21T03:20:22.352743+0000","last_undegraded":"2024-09-21T03:20:22.352743+0000","last_fullsized":"2024-09-21T03:20:22.352743+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:49.098519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.360903+0000","last_change":"2024-09-21T03:20:22.364758+0000","last_active":"2024-09-21T03:20:23.360903+0000","last_peered":"2024-09-21T03:20:23.360903+0000","last_clean":"2024-09-21T03:20:23.360903+0000","last_became_active":"2024-09-21T03:20:22.364448+0000","last_became_peered":"2024-09-21T03:20:22.364448+0000","last_unstale":"2024-09-21T03:20:23.360903+0000","last_undegraded":"2024-09-21T03:20:23.360903+0000","last_fullsized":"2024-09-21T03:20:23.360903+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:10.839820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T03:20:21.364449+0000","last_change":"2024-09-21T03:20:21.360800+0000","last_active":"2024-09-21T03:20:21.364449+0000","last_peered":"2024-09-21T03:20:21.364449+0000","last_clean":"2024-09-21T03:20:21.364449+0000","last_became_active":"2024-09-21T03:20:21.360480+0000","last_became_peered":"2024-09-21T03:20:21.360480+0000","last_unstale":"2024-09-21T03:20:21.364449+0000","last_undegraded":"2024-09-21T03:20:21.364449+0000","last_fullsized":"2024-09-21T03:20:21.364449+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:02.028522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.349234+0000","last_change":"2024-09-21T03:20:21.349234+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.349234+0000","last_undegraded":"2024-09-21T03:20:21.349234+0000","last_fullsized":"2024-09-21T03:20:21.349234+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.346096+0000","last_change":"2024-09-21T03:20:21.358799+0000","last_active":"2024-09-21T03:20:22.346096+0000","last_peered":"2024-09-21T03:20:22.346096+0000","last_clean":"2024-09-21T03:20:22.346096+0000","last_became_active":"2024-09-21T03:20:21.358305+0000","last_became_peered":"2024-09-21T03:20:21.358305+0000","last_unstale":"2024-09-21T03:20:22.346096+0000","last_undegraded":"2024-09-21T03:20:22.346096+0000","last_fullsized":"2024-09-21T03:20:22.346096+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:44.853872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363756+0000","last_change":"2024-09-21T03:20:22.365742+0000","last_active":"2024-09-21T03:20:23.363756+0000","last_peered":"2024-09-21T03:20:23.363756+0000","last_clean":"2024-09-21T03:20:23.363756+0000","last_became_active":"2024-09-21T03:20:22.365343+0000","last_became_peered":"2024-09-21T03:20:22.365343+0000","last_unstale":"2024-09-21T03:20:23.363756+0000","last_undegraded":"2024-09-21T03:20:23.363756+0000","last_fullsized":"2024-09-21T03:20:23.363756+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:07.319445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.349100+0000","last_change":"2024-09-21T03:20:21.361559+0000","last_active":"2024-09-21T03:20:22.349100+0000","last_peered":"2024-09-21T03:20:22.349100+0000","last_clean":"2024-09-21T03:20:22.349100+0000","last_became_active":"2024-09-21T03:20:21.361176+0000","last_became_peered":"2024-09-21T03:20:21.361176+0000","last_unstale":"2024-09-21T03:20:22.349100+0000","last_undegraded":"2024-09-21T03:20:22.349100+0000","last_fullsized":"2024-09-21T03:20:22.349100+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:33.367277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.347887+0000","last_change":"2024-09-21T03:20:21.347887+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.347887+0000","last_undegraded":"2024-09-21T03:20:21.347887+0000","last_fullsized":"2024-09-21T03:20:21.347887+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.347088+0000","last_change":"2024-09-21T03:20:21.361458+0000","last_active":"2024-09-21T03:20:22.347088+0000","last_peered":"2024-09-21T03:20:22.347088+0000","last_clean":"2024-09-21T03:20:22.347088+0000","last_became_active":"2024-09-21T03:20:21.360423+0000","last_became_peered":"2024-09-21T03:20:21.360423+0000","last_unstale":"2024-09-21T03:20:22.347088+0000","last_undegraded":"2024-09-21T03:20:22.347088+0000","last_fullsized":"2024-09-21T03:20:22.347088+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:07.239411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.360804+0000","last_change":"2024-09-21T03:20:22.357464+0000","last_active":"2024-09-21T03:20:22.360804+0000","last_peered":"2024-09-21T03:20:22.360804+0000","last_clean":"2024-09-21T03:20:22.360804+0000","last_became_active":"2024-09-21T03:20:22.356980+0000","last_became_peered":"2024-09-21T03:20:22.356980+0000","last_unstale":"2024-09-21T03:20:22.360804+0000","last_undegraded":"2024-09-21T03:20:22.360804+0000","last_fullsized":"2024-09-21T03:20:22.360804+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:11.740501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.348448+0000","last_change":"2024-09-21T03:20:21.363637+0000","last_active":"2024-09-21T03:20:22.348448+0000","last_peered":"2024-09-21T03:20:22.348448+0000","last_clean":"2024-09-21T03:20:22.348448+0000","last_became_active":"2024-09-21T03:20:21.363270+0000","last_became_peered":"2024-09-21T03:20:21.363270+0000","last_unstale":"2024-09-21T03:20:22.348448+0000","last_undegraded":"2024-09-21T03:20:22.348448+0000","last_fullsized":"2024-09-21T03:20:22.348448+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:52.543844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.358613+0000","last_change":"2024-09-21T03:20:22.357010+0000","last_active":"2024-09-21T03:20:22.358613+0000","last_peered":"2024-09-21T03:20:22.358613+0000","last_clean":"2024-09-21T03:20:22.358613+0000","last_became_active":"2024-09-21T03:20:22.356058+0000","last_became_peered":"2024-09-21T03:20:22.356058+0000","last_unstale":"2024-09-21T03:20:22.358613+0000","last_undegraded":"2024-09-21T03:20:22.358613+0000","last_fullsized":"2024-09-21T03:20:22.358613+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:13.722902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.346608+0000","last_change":"2024-09-21T03:20:21.363605+0000","last_active":"2024-09-21T03:20:22.346608+0000","last_peered":"2024-09-21T03:20:22.346608+0000","last_clean":"2024-09-21T03:20:22.346608+0000","last_became_active":"2024-09-21T03:20:21.361291+0000","last_became_peered":"2024-09-21T03:20:21.361291+0000","last_unstale":"2024-09-21T03:20:22.346608+0000","last_undegraded":"2024-09-21T03:20:22.346608+0000","last_fullsized":"2024-09-21T03:20:22.346608+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:48.695082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.364776+0000","last_change":"2024-09-21T03:20:22.360870+0000","last_active":"2024-09-21T03:20:22.364776+0000","last_peered":"2024-09-21T03:20:22.364776+0000","last_clean":"2024-09-21T03:20:22.364776+0000","last_became_active":"2024-09-21T03:20:22.360189+0000","last_became_peered":"2024-09-21T03:20:22.360189+0000","last_unstale":"2024-09-21T03:20:22.364776+0000","last_undegraded":"2024-09-21T03:20:22.364776+0000","last_fullsized":"2024-09-21T03:20:22.364776+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:37:46.822052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363116+0000","last_change":"2024-09-21T03:20:21.358394+0000","last_active":"2024-09-21T03:20:23.363116+0000","last_peered":"2024-09-21T03:20:23.363116+0000","last_clean":"2024-09-21T03:20:23.363116+0000","last_became_active":"2024-09-21T03:20:21.358059+0000","last_became_peered":"2024-09-21T03:20:21.358059+0000","last_unstale":"2024-09-21T03:20:23.363116+0000","last_undegraded":"2024-09-21T03:20:23.363116+0000","last_fullsized":"2024-09-21T03:20:23.363116+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:01.708297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.361245+0000","last_change":"2024-09-21T03:20:22.359249+0000","last_active":"2024-09-21T03:20:22.361245+0000","last_peered":"2024-09-21T03:20:22.361245+0000","last_clean":"2024-09-21T03:20:22.361245+0000","last_became_active":"2024-09-21T03:20:22.358932+0000","last_became_peered":"2024-09-21T03:20:22.358932+0000","last_unstale":"2024-09-21T03:20:22.361245+0000","last_undegraded":"2024-09-21T03:20:22.361245+0000","last_fullsized":"2024-09-21T03:20:22.361245+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:32.363099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.347743+0000","last_change":"2024-09-21T03:20:21.358386+0000","last_active":"2024-09-21T03:20:22.347743+0000","last_peered":"2024-09-21T03:20:22.347743+0000","last_clean":"2024-09-21T03:20:22.347743+0000","last_became_active":"2024-09-21T03:20:21.358025+0000","last_became_peered":"2024-09-21T03:20:21.358025+0000","last_unstale":"2024-09-21T03:20:22.347743+0000","last_undegraded":"2024-09-21T03:20:22.347743+0000","last_fullsized":"2024-09-21T03:20:22.347743+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:01.708297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362559+0000","last_change":"2024-09-21T03:20:22.356071+0000","last_active":"2024-09-21T03:20:23.362559+0000","last_peered":"2024-09-21T03:20:23.362559+0000","last_clean":"2024-09-21T03:20:23.362559+0000","last_became_active":"2024-09-21T03:20:22.355762+0000","last_became_peered":"2024-09-21T03:20:22.355762+0000","last_unstale":"2024-09-21T03:20:23.362559+0000","last_undegraded":"2024-09-21T03:20:23.362559+0000","last_fullsized":"2024-09-21T03:20:23.362559+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:02.155154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T03:20:21.366858+0000","last_change":"2024-09-21T03:20:21.362237+0000","last_active":"2024-09-21T03:20:21.366858+0000","last_peered":"2024-09-21T03:20:21.366858+0000","last_clean":"2024-09-21T03:20:21.366858+0000","last_became_active":"2024-09-21T03:20:21.361975+0000","last_became_peered":"2024-09-21T03:20:21.361975+0000","last_unstale":"2024-09-21T03:20:21.366858+0000","last_undegraded":"2024-09-21T03:20:21.366858+0000","last_fullsized":"2024-09-21T03:20:21.366858+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:23.035864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.351895+0000","last_change":"2024-09-21T03:20:21.351895+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.351895+0000","last_undegraded":"2024-09-21T03:20:21.351895+0000","last_fullsized":"2024-09-21T03:20:21.351895+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.374031+0000","last_change":"2024-09-21T03:20:21.361255+0000","last_active":"2024-09-21T03:20:22.374031+0000","last_peered":"2024-09-21T03:20:22.374031+0000","last_clean":"2024-09-21T03:20:22.374031+0000","last_became_active":"2024-09-21T03:20:21.360928+0000","last_became_peered":"2024-09-21T03:20:21.360928+0000","last_unstale":"2024-09-21T03:20:22.374031+0000","last_undegraded":"2024-09-21T03:20:22.374031+0000","last_fullsized":"2024-09-21T03:20:22.374031+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:33.367277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":151,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.346239+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:20:22.346239+0000","last_peered":"2024-09-21T03:20:22.346239+0000","last_clean":"2024-09-21T03:20:22.346239+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:20:22.346239+0000","last_undegraded":"2024-09-21T03:20:22.346239+0000","last_fullsized":"2024-09-21T03:20:22.346239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509470,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28112,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343728,"statfs":{"total":96636764160,"available":96607977472,"internally_reserved":0,"allocated":1105920,"data_stored":791777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509469,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27544,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":528384,"data_stored":208291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509468,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":512000,"data_stored":201389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509468,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":532480,"data_stored":209231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509469,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31700,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340140,"statfs":{"total":96636764160,"available":96604303360,"internally_reserved":0,"allocated":520192,"data_stored":201957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":524288,"data_stored":202953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509469,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":512000,"data_stored":201389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1077248,"data_stored":778645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:20:26.381 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:20:26.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.532+0000 7f865c00a640 1 -- 172.21.15.105:0/1225291993 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8640003a30 msgr2=0x7f8640003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:26.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.532+0000 7f865c00a640 1 --2- 172.21.15.105:0/1225291993 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8640003a30 0x7f8640003ea0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f865000bb20 tx=0x7f8640005830 comp rx=0 tx=0).stop 2024-09-21T03:20:26.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.532+0000 7f865a5a7640 1 -- 172.21.15.105:0/1225291993 reap_dead start 2024-09-21T03:20:26.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.532+0000 7f865c00a640 1 -- 172.21.15.105:0/1225291993 shutdown_connections 2024-09-21T03:20:26.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.532+0000 7f865c00a640 1 -- 172.21.15.105:0/1225291993 >> 172.21.15.105:0/1225291993 conn(0x7f865408bfc0 msgr2=0x7f865409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:26.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.532+0000 7f865c00a640 1 -- 172.21.15.105:0/1225291993 shutdown_connections 2024-09-21T03:20:26.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.532+0000 7f865c00a640 1 -- 172.21.15.105:0/1225291993 wait complete. 2024-09-21T03:20:26.536 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.534+0000 7f865c00a640 1 Processor -- start 2024-09-21T03:20:26.536 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.534+0000 7f865c00a640 1 -- start start 2024-09-21T03:20:26.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.535+0000 7f865c00a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8640003a30 0x7f86540b68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:26.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.535+0000 7f865c00a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86541f8b70 0x7f86541f8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:26.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.536+0000 7f865c00a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86540b4620 0x7f86540b4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:26.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.536+0000 7f865c00a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f86540d2ad0 con 0x7f86541f8b70 2024-09-21T03:20:26.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.536+0000 7f865c00a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f86540d2950 con 0x7f86540b4620 2024-09-21T03:20:26.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.536+0000 7f865c00a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f86540d2c50 con 0x7f8640003a30 2024-09-21T03:20:26.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.536+0000 7f86595a5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86541f8b70 0x7f86541f8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:26.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.536+0000 7f86595a5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86541f8b70 0x7f86541f8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:57900/0 (socket says 172.21.15.105:57900) 2024-09-21T03:20:26.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.536+0000 7f86595a5640 1 -- 172.21.15.105:0/296280325 learned_addr learned my addr 172.21.15.105:0/296280325 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:26.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.536+0000 7f8659da6640 1 --2- 172.21.15.105:0/296280325 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8640003a30 0x7f86540b68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:26.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.536+0000 7f865a5a7640 1 --2- 172.21.15.105:0/296280325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86540b4620 0x7f86540b4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:26.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.536+0000 7f86595a5640 1 -- 172.21.15.105:0/296280325 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8640003a30 msgr2=0x7f86540b68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:26.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.536+0000 7f86595a5640 1 --2- 172.21.15.105:0/296280325 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8640003a30 0x7f86540b68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:26.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.536+0000 7f86595a5640 1 -- 172.21.15.105:0/296280325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86540b4620 msgr2=0x7f86540b4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:26.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.536+0000 7f86595a5640 1 --2- 172.21.15.105:0/296280325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86540b4620 0x7f86540b4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:26.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.536+0000 7f86595a5640 1 -- 172.21.15.105:0/296280325 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86541f94c0 con 0x7f86541f8b70 2024-09-21T03:20:26.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.536+0000 7f865a5a7640 1 --2- 172.21.15.105:0/296280325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86540b4620 0x7f86540b4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:20:26.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.536+0000 7f86595a5640 1 --2- 172.21.15.105:0/296280325 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86541f8b70 0x7f86541f8f80 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f864400e590 tx=0x7f864400ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:26.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.536+0000 7f864a7fc640 1 -- 172.21.15.105:0/296280325 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8644015070 con 0x7f86541f8b70 2024-09-21T03:20:26.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.536+0000 7f864a7fc640 1 -- 172.21.15.105:0/296280325 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f864400c9e0 con 0x7f86541f8b70 2024-09-21T03:20:26.540 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.536+0000 7f865c00a640 1 -- 172.21.15.105:0/296280325 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86540b6e10 con 0x7f86541f8b70 2024-09-21T03:20:26.540 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.536+0000 7f864a7fc640 1 -- 172.21.15.105:0/296280325 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f864400ce30 con 0x7f86541f8b70 2024-09-21T03:20:26.540 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.536+0000 7f865c00a640 1 -- 172.21.15.105:0/296280325 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86540ca040 con 0x7f86541f8b70 2024-09-21T03:20:26.540 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.538+0000 7f865c00a640 1 -- 172.21.15.105:0/296280325 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86540c9ad0 con 0x7f86541f8b70 2024-09-21T03:20:26.541 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.538+0000 7f864a7fc640 1 -- 172.21.15.105:0/296280325 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8644018070 con 0x7f86541f8b70 2024-09-21T03:20:26.541 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.539+0000 7f864a7fc640 1 --2- 172.21.15.105:0/296280325 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8638078b90 0x7f863807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:26.541 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.539+0000 7f864a7fc640 1 -- 172.21.15.105:0/296280325 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f864409b010 con 0x7f86541f8b70 2024-09-21T03:20:26.541 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.539+0000 7f8659da6640 1 --2- 172.21.15.105:0/296280325 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8638078b90 0x7f863807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:26.541 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.540+0000 7f8659da6640 1 --2- 172.21.15.105:0/296280325 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8638078b90 0x7f863807b0a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8650036000 tx=0x7f865003c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:26.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.543+0000 7f864a7fc640 1 -- 172.21.15.105:0/296280325 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f86541f94c0 con 0x7f86541f8b70 2024-09-21T03:20:26.725 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.723+0000 7f865c00a640 1 -- 172.21.15.105:0/296280325 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f86540d31e0 con 0x7f8638078b90 2024-09-21T03:20:26.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.728+0000 7f864a7fc640 1 -- 172.21.15.105:0/296280325 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250801 (secure 0 0 0) 0x7f86540d31e0 con 0x7f8638078b90 2024-09-21T03:20:26.732 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:20:26.733 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:20:26.735 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.731+0000 7f865c00a640 1 -- 172.21.15.105:0/296280325 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8638078b90 msgr2=0x7f863807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:26.735 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.731+0000 7f865c00a640 1 --2- 172.21.15.105:0/296280325 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8638078b90 0x7f863807b0a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8650036000 tx=0x7f865003c040 comp rx=0 tx=0).stop 2024-09-21T03:20:26.735 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.731+0000 7f865c00a640 1 -- 172.21.15.105:0/296280325 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86541f8b70 msgr2=0x7f86541f8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:26.735 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.731+0000 7f865c00a640 1 --2- 172.21.15.105:0/296280325 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86541f8b70 0x7f86541f8f80 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f864400e590 tx=0x7f864400ea50 comp rx=0 tx=0).stop 2024-09-21T03:20:26.735 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.731+0000 7f865c00a640 1 -- 172.21.15.105:0/296280325 shutdown_connections 2024-09-21T03:20:26.735 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.731+0000 7f865c00a640 1 --2- 172.21.15.105:0/296280325 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8638078b90 0x7f863807b0a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:26.735 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.731+0000 7f865c00a640 1 --2- 172.21.15.105:0/296280325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86540b4620 0x7f86540b4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:26.735 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.731+0000 7f865c00a640 1 --2- 172.21.15.105:0/296280325 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86541f8b70 0x7f86541f8f80 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:26.735 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.731+0000 7f865c00a640 1 --2- 172.21.15.105:0/296280325 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8640003a30 0x7f86540b68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:26.735 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.731+0000 7f865c00a640 1 -- 172.21.15.105:0/296280325 >> 172.21.15.105:0/296280325 conn(0x7f865408bfc0 msgr2=0x7f865406ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:26.735 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.731+0000 7f865c00a640 1 -- 172.21.15.105:0/296280325 shutdown_connections 2024-09-21T03:20:26.735 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.731+0000 7f865c00a640 1 -- 172.21.15.105:0/296280325 wait complete. 2024-09-21T03:20:26.744 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":103,"stamp":"2024-09-21T03:20:25.308943+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":133,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":117,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229748,"kb_used_data":5188,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744972,"statfs":{"total":773094113280,"available":772858851328,"internally_reserved":0,"allocated":5312512,"data_stored":2795632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.974040"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.360568+0000","last_change":"2024-09-21T03:20:22.354648+0000","last_active":"2024-09-21T03:20:22.360568+0000","last_peered":"2024-09-21T03:20:22.360568+0000","last_clean":"2024-09-21T03:20:22.360568+0000","last_became_active":"2024-09-21T03:20:22.354279+0000","last_became_peered":"2024-09-21T03:20:22.354279+0000","last_unstale":"2024-09-21T03:20:22.360568+0000","last_undegraded":"2024-09-21T03:20:22.360568+0000","last_fullsized":"2024-09-21T03:20:22.360568+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:22.864214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.365953+0000","last_change":"2024-09-21T03:20:22.363925+0000","last_active":"2024-09-21T03:20:22.365953+0000","last_peered":"2024-09-21T03:20:22.365953+0000","last_clean":"2024-09-21T03:20:22.365953+0000","last_became_active":"2024-09-21T03:20:22.363588+0000","last_became_peered":"2024-09-21T03:20:22.363588+0000","last_unstale":"2024-09-21T03:20:22.365953+0000","last_undegraded":"2024-09-21T03:20:22.365953+0000","last_fullsized":"2024-09-21T03:20:22.365953+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:15.584346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362247+0000","last_change":"2024-09-21T03:20:22.356946+0000","last_active":"2024-09-21T03:20:23.362247+0000","last_peered":"2024-09-21T03:20:23.362247+0000","last_clean":"2024-09-21T03:20:23.362247+0000","last_became_active":"2024-09-21T03:20:22.356625+0000","last_became_peered":"2024-09-21T03:20:22.356625+0000","last_unstale":"2024-09-21T03:20:23.362247+0000","last_undegraded":"2024-09-21T03:20:23.362247+0000","last_fullsized":"2024-09-21T03:20:23.362247+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:24.993031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.348358+0000","last_change":"2024-09-21T03:20:21.348358+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.348358+0000","last_undegraded":"2024-09-21T03:20:21.348358+0000","last_fullsized":"2024-09-21T03:20:21.348358+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.371612+0000","last_change":"2024-09-21T03:20:22.368074+0000","last_active":"2024-09-21T03:20:22.371612+0000","last_peered":"2024-09-21T03:20:22.371612+0000","last_clean":"2024-09-21T03:20:22.371612+0000","last_became_active":"2024-09-21T03:20:22.367712+0000","last_became_peered":"2024-09-21T03:20:22.367712+0000","last_unstale":"2024-09-21T03:20:22.371612+0000","last_undegraded":"2024-09-21T03:20:22.371612+0000","last_fullsized":"2024-09-21T03:20:22.371612+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:19.648403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.358636+0000","last_change":"2024-09-21T03:20:22.357312+0000","last_active":"2024-09-21T03:20:22.358636+0000","last_peered":"2024-09-21T03:20:22.358636+0000","last_clean":"2024-09-21T03:20:22.358636+0000","last_became_active":"2024-09-21T03:20:22.356723+0000","last_became_peered":"2024-09-21T03:20:22.356723+0000","last_unstale":"2024-09-21T03:20:22.358636+0000","last_undegraded":"2024-09-21T03:20:22.358636+0000","last_fullsized":"2024-09-21T03:20:22.358636+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:11.740501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.360735+0000","last_change":"2024-09-21T03:20:22.354451+0000","last_active":"2024-09-21T03:20:22.360735+0000","last_peered":"2024-09-21T03:20:22.360735+0000","last_clean":"2024-09-21T03:20:22.360735+0000","last_became_active":"2024-09-21T03:20:22.354036+0000","last_became_peered":"2024-09-21T03:20:22.354036+0000","last_unstale":"2024-09-21T03:20:22.360735+0000","last_undegraded":"2024-09-21T03:20:22.360735+0000","last_fullsized":"2024-09-21T03:20:22.360735+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:19.648403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.351127+0000","last_change":"2024-09-21T03:20:21.351127+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.351127+0000","last_undegraded":"2024-09-21T03:20:21.351127+0000","last_fullsized":"2024-09-21T03:20:21.351127+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.351434+0000","last_change":"2024-09-21T03:20:21.351434+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.351434+0000","last_undegraded":"2024-09-21T03:20:21.351434+0000","last_fullsized":"2024-09-21T03:20:21.351434+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.353175+0000","last_change":"2024-09-21T03:20:21.353175+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.353175+0000","last_undegraded":"2024-09-21T03:20:21.353175+0000","last_fullsized":"2024-09-21T03:20:21.353175+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.349066+0000","last_change":"2024-09-21T03:20:21.349066+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.349066+0000","last_undegraded":"2024-09-21T03:20:21.349066+0000","last_fullsized":"2024-09-21T03:20:21.349066+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.362804+0000","last_change":"2024-09-21T03:20:22.361976+0000","last_active":"2024-09-21T03:20:22.362804+0000","last_peered":"2024-09-21T03:20:22.362804+0000","last_clean":"2024-09-21T03:20:22.362804+0000","last_became_active":"2024-09-21T03:20:22.361662+0000","last_became_peered":"2024-09-21T03:20:22.361662+0000","last_unstale":"2024-09-21T03:20:22.362804+0000","last_undegraded":"2024-09-21T03:20:22.362804+0000","last_fullsized":"2024-09-21T03:20:22.362804+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:08.243558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.361094+0000","last_change":"2024-09-21T03:20:22.370554+0000","last_active":"2024-09-21T03:20:23.361094+0000","last_peered":"2024-09-21T03:20:23.361094+0000","last_clean":"2024-09-21T03:20:23.361094+0000","last_became_active":"2024-09-21T03:20:22.370255+0000","last_became_peered":"2024-09-21T03:20:22.370255+0000","last_unstale":"2024-09-21T03:20:23.361094+0000","last_undegraded":"2024-09-21T03:20:23.361094+0000","last_fullsized":"2024-09-21T03:20:23.361094+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:10:31.487754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.347383+0000","last_change":"2024-09-21T03:20:21.347383+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.347383+0000","last_undegraded":"2024-09-21T03:20:21.347383+0000","last_fullsized":"2024-09-21T03:20:21.347383+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.368579+0000","last_change":"2024-09-21T03:20:22.364458+0000","last_active":"2024-09-21T03:20:22.368579+0000","last_peered":"2024-09-21T03:20:22.368579+0000","last_clean":"2024-09-21T03:20:22.368579+0000","last_became_active":"2024-09-21T03:20:22.363602+0000","last_became_peered":"2024-09-21T03:20:22.363602+0000","last_unstale":"2024-09-21T03:20:22.368579+0000","last_undegraded":"2024-09-21T03:20:22.368579+0000","last_fullsized":"2024-09-21T03:20:22.368579+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:28.932663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362357+0000","last_change":"2024-09-21T03:20:22.364557+0000","last_active":"2024-09-21T03:20:23.362357+0000","last_peered":"2024-09-21T03:20:23.362357+0000","last_clean":"2024-09-21T03:20:23.362357+0000","last_became_active":"2024-09-21T03:20:22.364229+0000","last_became_peered":"2024-09-21T03:20:22.364229+0000","last_unstale":"2024-09-21T03:20:23.362357+0000","last_undegraded":"2024-09-21T03:20:23.362357+0000","last_fullsized":"2024-09-21T03:20:23.362357+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:04.759943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363685+0000","last_change":"2024-09-21T03:20:22.362778+0000","last_active":"2024-09-21T03:20:23.363685+0000","last_peered":"2024-09-21T03:20:23.363685+0000","last_clean":"2024-09-21T03:20:23.363685+0000","last_became_active":"2024-09-21T03:20:22.362478+0000","last_became_peered":"2024-09-21T03:20:22.362478+0000","last_unstale":"2024-09-21T03:20:23.363685+0000","last_undegraded":"2024-09-21T03:20:23.363685+0000","last_fullsized":"2024-09-21T03:20:23.363685+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:11.553421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362843+0000","last_change":"2024-09-21T03:20:22.363582+0000","last_active":"2024-09-21T03:20:23.362843+0000","last_peered":"2024-09-21T03:20:23.362843+0000","last_clean":"2024-09-21T03:20:23.362843+0000","last_became_active":"2024-09-21T03:20:22.363282+0000","last_became_peered":"2024-09-21T03:20:22.363282+0000","last_unstale":"2024-09-21T03:20:23.362843+0000","last_undegraded":"2024-09-21T03:20:23.362843+0000","last_fullsized":"2024-09-21T03:20:23.362843+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:23:12.532832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363362+0000","last_change":"2024-09-21T03:20:22.363482+0000","last_active":"2024-09-21T03:20:23.363362+0000","last_peered":"2024-09-21T03:20:23.363362+0000","last_clean":"2024-09-21T03:20:23.363362+0000","last_became_active":"2024-09-21T03:20:22.363129+0000","last_became_peered":"2024-09-21T03:20:22.363129+0000","last_unstale":"2024-09-21T03:20:23.363362+0000","last_undegraded":"2024-09-21T03:20:23.363362+0000","last_fullsized":"2024-09-21T03:20:23.363362+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:12:18.021857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.360949+0000","last_change":"2024-09-21T03:20:22.370285+0000","last_active":"2024-09-21T03:20:23.360949+0000","last_peered":"2024-09-21T03:20:23.360949+0000","last_clean":"2024-09-21T03:20:23.360949+0000","last_became_active":"2024-09-21T03:20:22.369715+0000","last_became_peered":"2024-09-21T03:20:22.369715+0000","last_unstale":"2024-09-21T03:20:23.360949+0000","last_undegraded":"2024-09-21T03:20:23.360949+0000","last_fullsized":"2024-09-21T03:20:23.360949+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:08.636582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.364809+0000","last_change":"2024-09-21T03:20:22.361197+0000","last_active":"2024-09-21T03:20:22.364809+0000","last_peered":"2024-09-21T03:20:22.364809+0000","last_clean":"2024-09-21T03:20:22.364809+0000","last_became_active":"2024-09-21T03:20:22.360584+0000","last_became_peered":"2024-09-21T03:20:22.360584+0000","last_unstale":"2024-09-21T03:20:22.364809+0000","last_undegraded":"2024-09-21T03:20:22.364809+0000","last_fullsized":"2024-09-21T03:20:22.364809+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:20.393544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.346857+0000","last_change":"2024-09-21T03:20:21.346857+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.346857+0000","last_undegraded":"2024-09-21T03:20:21.346857+0000","last_fullsized":"2024-09-21T03:20:21.346857+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362495+0000","last_change":"2024-09-21T03:20:22.359184+0000","last_active":"2024-09-21T03:20:23.362495+0000","last_peered":"2024-09-21T03:20:23.362495+0000","last_clean":"2024-09-21T03:20:23.362495+0000","last_became_active":"2024-09-21T03:20:22.357185+0000","last_became_peered":"2024-09-21T03:20:22.357185+0000","last_unstale":"2024-09-21T03:20:23.362495+0000","last_undegraded":"2024-09-21T03:20:23.362495+0000","last_fullsized":"2024-09-21T03:20:23.362495+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:13.194698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363072+0000","last_change":"2024-09-21T03:20:22.357204+0000","last_active":"2024-09-21T03:20:23.363072+0000","last_peered":"2024-09-21T03:20:23.363072+0000","last_clean":"2024-09-21T03:20:23.363072+0000","last_became_active":"2024-09-21T03:20:22.356888+0000","last_became_peered":"2024-09-21T03:20:22.356888+0000","last_unstale":"2024-09-21T03:20:23.363072+0000","last_undegraded":"2024-09-21T03:20:23.363072+0000","last_fullsized":"2024-09-21T03:20:23.363072+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:23:58.513737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363507+0000","last_change":"2024-09-21T03:20:22.366679+0000","last_active":"2024-09-21T03:20:23.363507+0000","last_peered":"2024-09-21T03:20:23.363507+0000","last_clean":"2024-09-21T03:20:23.363507+0000","last_became_active":"2024-09-21T03:20:22.366295+0000","last_became_peered":"2024-09-21T03:20:22.366295+0000","last_unstale":"2024-09-21T03:20:23.363507+0000","last_undegraded":"2024-09-21T03:20:23.363507+0000","last_fullsized":"2024-09-21T03:20:23.363507+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:56.748578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.360927+0000","last_change":"2024-09-21T03:20:22.363184+0000","last_active":"2024-09-21T03:20:23.360927+0000","last_peered":"2024-09-21T03:20:23.360927+0000","last_clean":"2024-09-21T03:20:23.360927+0000","last_became_active":"2024-09-21T03:20:22.362501+0000","last_became_peered":"2024-09-21T03:20:22.362501+0000","last_unstale":"2024-09-21T03:20:23.360927+0000","last_undegraded":"2024-09-21T03:20:23.360927+0000","last_fullsized":"2024-09-21T03:20:23.360927+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:21:09.148798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362478+0000","last_change":"2024-09-21T03:20:22.362032+0000","last_active":"2024-09-21T03:20:23.362478+0000","last_peered":"2024-09-21T03:20:23.362478+0000","last_clean":"2024-09-21T03:20:23.362478+0000","last_became_active":"2024-09-21T03:20:22.361748+0000","last_became_peered":"2024-09-21T03:20:22.361748+0000","last_unstale":"2024-09-21T03:20:23.362478+0000","last_undegraded":"2024-09-21T03:20:23.362478+0000","last_fullsized":"2024-09-21T03:20:23.362478+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:08.318524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.362382+0000","last_change":"2024-09-21T03:20:22.361207+0000","last_active":"2024-09-21T03:20:22.362382+0000","last_peered":"2024-09-21T03:20:22.362382+0000","last_clean":"2024-09-21T03:20:22.362382+0000","last_became_active":"2024-09-21T03:20:22.360879+0000","last_became_peered":"2024-09-21T03:20:22.360879+0000","last_unstale":"2024-09-21T03:20:22.362382+0000","last_undegraded":"2024-09-21T03:20:22.362382+0000","last_fullsized":"2024-09-21T03:20:22.362382+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:27.628018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362977+0000","last_change":"2024-09-21T03:20:22.358441+0000","last_active":"2024-09-21T03:20:23.362977+0000","last_peered":"2024-09-21T03:20:23.362977+0000","last_clean":"2024-09-21T03:20:23.362977+0000","last_became_active":"2024-09-21T03:20:22.358130+0000","last_became_peered":"2024-09-21T03:20:22.358130+0000","last_unstale":"2024-09-21T03:20:23.362977+0000","last_undegraded":"2024-09-21T03:20:23.362977+0000","last_fullsized":"2024-09-21T03:20:23.362977+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:06.233989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362070+0000","last_change":"2024-09-21T03:20:22.356052+0000","last_active":"2024-09-21T03:20:23.362070+0000","last_peered":"2024-09-21T03:20:23.362070+0000","last_clean":"2024-09-21T03:20:23.362070+0000","last_became_active":"2024-09-21T03:20:22.355703+0000","last_became_peered":"2024-09-21T03:20:22.355703+0000","last_unstale":"2024-09-21T03:20:23.362070+0000","last_undegraded":"2024-09-21T03:20:23.362070+0000","last_fullsized":"2024-09-21T03:20:23.362070+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:54.277955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.368552+0000","last_change":"2024-09-21T03:20:22.364133+0000","last_active":"2024-09-21T03:20:22.368552+0000","last_peered":"2024-09-21T03:20:22.368552+0000","last_clean":"2024-09-21T03:20:22.368552+0000","last_became_active":"2024-09-21T03:20:22.363162+0000","last_became_peered":"2024-09-21T03:20:22.363162+0000","last_unstale":"2024-09-21T03:20:22.368552+0000","last_undegraded":"2024-09-21T03:20:22.368552+0000","last_fullsized":"2024-09-21T03:20:22.368552+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:10.473935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.361087+0000","last_change":"2024-09-21T03:20:22.358222+0000","last_active":"2024-09-21T03:20:23.361087+0000","last_peered":"2024-09-21T03:20:23.361087+0000","last_clean":"2024-09-21T03:20:23.361087+0000","last_became_active":"2024-09-21T03:20:22.357933+0000","last_became_peered":"2024-09-21T03:20:22.357933+0000","last_unstale":"2024-09-21T03:20:23.361087+0000","last_undegraded":"2024-09-21T03:20:23.361087+0000","last_fullsized":"2024-09-21T03:20:23.361087+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:18.911040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.356962+0000","last_change":"2024-09-21T03:20:22.353413+0000","last_active":"2024-09-21T03:20:22.356962+0000","last_peered":"2024-09-21T03:20:22.356962+0000","last_clean":"2024-09-21T03:20:22.356962+0000","last_became_active":"2024-09-21T03:20:22.353091+0000","last_became_peered":"2024-09-21T03:20:22.353091+0000","last_unstale":"2024-09-21T03:20:22.356962+0000","last_undegraded":"2024-09-21T03:20:22.356962+0000","last_fullsized":"2024-09-21T03:20:22.356962+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:19:14.358260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.377306+0000","last_change":"2024-09-21T03:20:21.353455+0000","last_active":"2024-09-21T03:20:22.377306+0000","last_peered":"2024-09-21T03:20:22.377306+0000","last_clean":"2024-09-21T03:20:22.377306+0000","last_became_active":"2024-09-21T03:20:21.353167+0000","last_became_peered":"2024-09-21T03:20:21.353167+0000","last_unstale":"2024-09-21T03:20:22.377306+0000","last_undegraded":"2024-09-21T03:20:22.377306+0000","last_fullsized":"2024-09-21T03:20:22.377306+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:10.549273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363625+0000","last_change":"2024-09-21T03:20:22.360284+0000","last_active":"2024-09-21T03:20:23.363625+0000","last_peered":"2024-09-21T03:20:23.363625+0000","last_clean":"2024-09-21T03:20:23.363625+0000","last_became_active":"2024-09-21T03:20:22.359131+0000","last_became_peered":"2024-09-21T03:20:22.359131+0000","last_unstale":"2024-09-21T03:20:23.363625+0000","last_undegraded":"2024-09-21T03:20:23.363625+0000","last_fullsized":"2024-09-21T03:20:23.363625+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:27:18.588119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362999+0000","last_change":"2024-09-21T03:20:21.358490+0000","last_active":"2024-09-21T03:20:23.362999+0000","last_peered":"2024-09-21T03:20:23.362999+0000","last_clean":"2024-09-21T03:20:23.362999+0000","last_became_active":"2024-09-21T03:20:21.357991+0000","last_became_peered":"2024-09-21T03:20:21.357991+0000","last_unstale":"2024-09-21T03:20:23.362999+0000","last_undegraded":"2024-09-21T03:20:23.362999+0000","last_fullsized":"2024-09-21T03:20:23.362999+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:52.543844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.374252+0000","last_change":"2024-09-21T03:20:22.370492+0000","last_active":"2024-09-21T03:20:22.374252+0000","last_peered":"2024-09-21T03:20:22.374252+0000","last_clean":"2024-09-21T03:20:22.374252+0000","last_became_active":"2024-09-21T03:20:22.370117+0000","last_became_peered":"2024-09-21T03:20:22.370117+0000","last_unstale":"2024-09-21T03:20:22.374252+0000","last_undegraded":"2024-09-21T03:20:22.374252+0000","last_fullsized":"2024-09-21T03:20:22.374252+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:22.864214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.372898+0000","last_change":"2024-09-21T03:20:21.363908+0000","last_active":"2024-09-21T03:20:22.372898+0000","last_peered":"2024-09-21T03:20:22.372898+0000","last_clean":"2024-09-21T03:20:22.372898+0000","last_became_active":"2024-09-21T03:20:21.363494+0000","last_became_peered":"2024-09-21T03:20:21.363494+0000","last_unstale":"2024-09-21T03:20:22.372898+0000","last_undegraded":"2024-09-21T03:20:22.372898+0000","last_fullsized":"2024-09-21T03:20:22.372898+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:40.157840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.358596+0000","last_change":"2024-09-21T03:20:22.357615+0000","last_active":"2024-09-21T03:20:22.358596+0000","last_peered":"2024-09-21T03:20:22.358596+0000","last_clean":"2024-09-21T03:20:22.358596+0000","last_became_active":"2024-09-21T03:20:22.357317+0000","last_became_peered":"2024-09-21T03:20:22.357317+0000","last_unstale":"2024-09-21T03:20:22.358596+0000","last_undegraded":"2024-09-21T03:20:22.358596+0000","last_fullsized":"2024-09-21T03:20:22.358596+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:12:18.021857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.374621+0000","last_change":"2024-09-21T03:20:21.361902+0000","last_active":"2024-09-21T03:20:22.374621+0000","last_peered":"2024-09-21T03:20:22.374621+0000","last_clean":"2024-09-21T03:20:22.374621+0000","last_became_active":"2024-09-21T03:20:21.361549+0000","last_became_peered":"2024-09-21T03:20:21.361549+0000","last_unstale":"2024-09-21T03:20:22.374621+0000","last_undegraded":"2024-09-21T03:20:22.374621+0000","last_fullsized":"2024-09-21T03:20:22.374621+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:26.623870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362338+0000","last_change":"2024-09-21T03:20:22.353213+0000","last_active":"2024-09-21T03:20:23.362338+0000","last_peered":"2024-09-21T03:20:23.362338+0000","last_clean":"2024-09-21T03:20:23.362338+0000","last_became_active":"2024-09-21T03:20:22.352809+0000","last_became_peered":"2024-09-21T03:20:22.352809+0000","last_unstale":"2024-09-21T03:20:23.362338+0000","last_undegraded":"2024-09-21T03:20:23.362338+0000","last_fullsized":"2024-09-21T03:20:23.362338+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:51:09.144620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.371958+0000","last_change":"2024-09-21T03:20:21.360479+0000","last_active":"2024-09-21T03:20:22.371958+0000","last_peered":"2024-09-21T03:20:22.371958+0000","last_clean":"2024-09-21T03:20:22.371958+0000","last_became_active":"2024-09-21T03:20:21.360179+0000","last_became_peered":"2024-09-21T03:20:21.360179+0000","last_unstale":"2024-09-21T03:20:22.371958+0000","last_undegraded":"2024-09-21T03:20:22.371958+0000","last_fullsized":"2024-09-21T03:20:22.371958+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:31.358952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.350317+0000","last_change":"2024-09-21T03:20:21.350317+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.350317+0000","last_undegraded":"2024-09-21T03:20:21.350317+0000","last_fullsized":"2024-09-21T03:20:21.350317+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362478+0000","last_change":"2024-09-21T03:20:21.360913+0000","last_active":"2024-09-21T03:20:23.362478+0000","last_peered":"2024-09-21T03:20:23.362478+0000","last_clean":"2024-09-21T03:20:23.362478+0000","last_became_active":"2024-09-21T03:20:21.360581+0000","last_became_peered":"2024-09-21T03:20:21.360581+0000","last_unstale":"2024-09-21T03:20:23.362478+0000","last_undegraded":"2024-09-21T03:20:23.362478+0000","last_fullsized":"2024-09-21T03:20:23.362478+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:57.040972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.350681+0000","last_change":"2024-09-21T03:20:21.350681+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.350681+0000","last_undegraded":"2024-09-21T03:20:21.350681+0000","last_fullsized":"2024-09-21T03:20:21.350681+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.353738+0000","last_change":"2024-09-21T03:20:21.363512+0000","last_active":"2024-09-21T03:20:22.353738+0000","last_peered":"2024-09-21T03:20:22.353738+0000","last_clean":"2024-09-21T03:20:22.353738+0000","last_became_active":"2024-09-21T03:20:21.363215+0000","last_became_peered":"2024-09-21T03:20:21.363215+0000","last_unstale":"2024-09-21T03:20:22.353738+0000","last_undegraded":"2024-09-21T03:20:22.353738+0000","last_fullsized":"2024-09-21T03:20:22.353738+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:48.695082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362814+0000","last_change":"2024-09-21T03:20:22.359160+0000","last_active":"2024-09-21T03:20:23.362814+0000","last_peered":"2024-09-21T03:20:23.362814+0000","last_clean":"2024-09-21T03:20:23.362814+0000","last_became_active":"2024-09-21T03:20:22.356795+0000","last_became_peered":"2024-09-21T03:20:22.356795+0000","last_unstale":"2024-09-21T03:20:23.362814+0000","last_undegraded":"2024-09-21T03:20:23.362814+0000","last_fullsized":"2024-09-21T03:20:23.362814+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:48.006533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T03:20:21.364295+0000","last_change":"2024-09-21T03:20:21.359300+0000","last_active":"2024-09-21T03:20:21.364295+0000","last_peered":"2024-09-21T03:20:21.364295+0000","last_clean":"2024-09-21T03:20:21.364295+0000","last_became_active":"2024-09-21T03:20:21.358998+0000","last_became_peered":"2024-09-21T03:20:21.358998+0000","last_unstale":"2024-09-21T03:20:21.364295+0000","last_undegraded":"2024-09-21T03:20:21.364295+0000","last_fullsized":"2024-09-21T03:20:21.364295+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:35:49.970928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362865+0000","last_change":"2024-09-21T03:20:22.361977+0000","last_active":"2024-09-21T03:20:23.362865+0000","last_peered":"2024-09-21T03:20:23.362865+0000","last_clean":"2024-09-21T03:20:23.362865+0000","last_became_active":"2024-09-21T03:20:22.361641+0000","last_became_peered":"2024-09-21T03:20:22.361641+0000","last_unstale":"2024-09-21T03:20:23.362865+0000","last_undegraded":"2024-09-21T03:20:23.362865+0000","last_fullsized":"2024-09-21T03:20:23.362865+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:34.601478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363827+0000","last_change":"2024-09-21T03:20:21.358364+0000","last_active":"2024-09-21T03:20:23.363827+0000","last_peered":"2024-09-21T03:20:23.363827+0000","last_clean":"2024-09-21T03:20:23.363827+0000","last_became_active":"2024-09-21T03:20:21.357818+0000","last_became_peered":"2024-09-21T03:20:21.357818+0000","last_unstale":"2024-09-21T03:20:23.363827+0000","last_undegraded":"2024-09-21T03:20:23.363827+0000","last_fullsized":"2024-09-21T03:20:23.363827+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:40.157840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.368225+0000","last_change":"2024-09-21T03:20:22.365443+0000","last_active":"2024-09-21T03:20:22.368225+0000","last_peered":"2024-09-21T03:20:22.368225+0000","last_clean":"2024-09-21T03:20:22.368225+0000","last_became_active":"2024-09-21T03:20:22.365081+0000","last_became_peered":"2024-09-21T03:20:22.365081+0000","last_unstale":"2024-09-21T03:20:22.368225+0000","last_undegraded":"2024-09-21T03:20:22.368225+0000","last_fullsized":"2024-09-21T03:20:22.368225+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:13:18.276359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T03:20:21.364445+0000","last_change":"2024-09-21T03:20:21.360629+0000","last_active":"2024-09-21T03:20:21.364445+0000","last_peered":"2024-09-21T03:20:21.364445+0000","last_clean":"2024-09-21T03:20:21.364445+0000","last_became_active":"2024-09-21T03:20:21.360357+0000","last_became_peered":"2024-09-21T03:20:21.360357+0000","last_unstale":"2024-09-21T03:20:21.364445+0000","last_undegraded":"2024-09-21T03:20:21.364445+0000","last_fullsized":"2024-09-21T03:20:21.364445+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:41.136243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.369350+0000","last_change":"2024-09-21T03:20:22.368659+0000","last_active":"2024-09-21T03:20:22.369350+0000","last_peered":"2024-09-21T03:20:22.369350+0000","last_clean":"2024-09-21T03:20:22.369350+0000","last_became_active":"2024-09-21T03:20:22.359839+0000","last_became_peered":"2024-09-21T03:20:22.359839+0000","last_unstale":"2024-09-21T03:20:22.369350+0000","last_undegraded":"2024-09-21T03:20:22.369350+0000","last_fullsized":"2024-09-21T03:20:22.369350+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:29.987903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.377624+0000","last_change":"2024-09-21T03:20:21.360749+0000","last_active":"2024-09-21T03:20:22.377624+0000","last_peered":"2024-09-21T03:20:22.377624+0000","last_clean":"2024-09-21T03:20:22.377624+0000","last_became_active":"2024-09-21T03:20:21.359582+0000","last_became_peered":"2024-09-21T03:20:21.359582+0000","last_unstale":"2024-09-21T03:20:22.377624+0000","last_undegraded":"2024-09-21T03:20:22.377624+0000","last_fullsized":"2024-09-21T03:20:22.377624+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:33.367277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.360774+0000","last_change":"2024-09-21T03:20:22.354530+0000","last_active":"2024-09-21T03:20:22.360774+0000","last_peered":"2024-09-21T03:20:22.360774+0000","last_clean":"2024-09-21T03:20:22.360774+0000","last_became_active":"2024-09-21T03:20:22.354017+0000","last_became_peered":"2024-09-21T03:20:22.354017+0000","last_unstale":"2024-09-21T03:20:22.360774+0000","last_undegraded":"2024-09-21T03:20:22.360774+0000","last_fullsized":"2024-09-21T03:20:22.360774+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:13.722902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":21,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.360948+0000","last_change":"2024-09-21T03:20:21.359485+0000","last_active":"2024-09-21T03:20:23.360948+0000","last_peered":"2024-09-21T03:20:23.360948+0000","last_clean":"2024-09-21T03:20:23.360948+0000","last_became_active":"2024-09-21T03:20:21.359182+0000","last_became_peered":"2024-09-21T03:20:21.359182+0000","last_unstale":"2024-09-21T03:20:23.360948+0000","last_undegraded":"2024-09-21T03:20:23.360948+0000","last_fullsized":"2024-09-21T03:20:23.360948+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:06:13.612749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363374+0000","last_change":"2024-09-21T03:20:22.363602+0000","last_active":"2024-09-21T03:20:23.363374+0000","last_peered":"2024-09-21T03:20:23.363374+0000","last_clean":"2024-09-21T03:20:23.363374+0000","last_became_active":"2024-09-21T03:20:22.363245+0000","last_became_peered":"2024-09-21T03:20:22.363245+0000","last_unstale":"2024-09-21T03:20:23.363374+0000","last_undegraded":"2024-09-21T03:20:23.363374+0000","last_fullsized":"2024-09-21T03:20:23.363374+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:58:04.733519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.375839+0000","last_change":"2024-09-21T03:20:21.362428+0000","last_active":"2024-09-21T03:20:22.375839+0000","last_peered":"2024-09-21T03:20:22.375839+0000","last_clean":"2024-09-21T03:20:22.375839+0000","last_became_active":"2024-09-21T03:20:21.362120+0000","last_became_peered":"2024-09-21T03:20:21.362120+0000","last_unstale":"2024-09-21T03:20:22.375839+0000","last_undegraded":"2024-09-21T03:20:22.375839+0000","last_fullsized":"2024-09-21T03:20:22.375839+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:07.239411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.349866+0000","last_change":"2024-09-21T03:20:21.349866+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.349866+0000","last_undegraded":"2024-09-21T03:20:21.349866+0000","last_fullsized":"2024-09-21T03:20:21.349866+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.346757+0000","last_change":"2024-09-21T03:20:21.357809+0000","last_active":"2024-09-21T03:20:22.346757+0000","last_peered":"2024-09-21T03:20:22.346757+0000","last_clean":"2024-09-21T03:20:22.346757+0000","last_became_active":"2024-09-21T03:20:21.357478+0000","last_became_peered":"2024-09-21T03:20:21.357478+0000","last_unstale":"2024-09-21T03:20:22.346757+0000","last_undegraded":"2024-09-21T03:20:22.346757+0000","last_fullsized":"2024-09-21T03:20:22.346757+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:31.358952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.359974+0000","last_change":"2024-09-21T03:20:22.358128+0000","last_active":"2024-09-21T03:20:22.359974+0000","last_peered":"2024-09-21T03:20:22.359974+0000","last_clean":"2024-09-21T03:20:22.359974+0000","last_became_active":"2024-09-21T03:20:22.357840+0000","last_became_peered":"2024-09-21T03:20:22.357840+0000","last_unstale":"2024-09-21T03:20:22.359974+0000","last_undegraded":"2024-09-21T03:20:22.359974+0000","last_fullsized":"2024-09-21T03:20:22.359974+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:13:18.276359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.348394+0000","last_change":"2024-09-21T03:20:21.362378+0000","last_active":"2024-09-21T03:20:22.348394+0000","last_peered":"2024-09-21T03:20:22.348394+0000","last_clean":"2024-09-21T03:20:22.348394+0000","last_became_active":"2024-09-21T03:20:21.362053+0000","last_became_peered":"2024-09-21T03:20:21.362053+0000","last_unstale":"2024-09-21T03:20:22.348394+0000","last_undegraded":"2024-09-21T03:20:22.348394+0000","last_fullsized":"2024-09-21T03:20:22.348394+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:48.695082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.354711+0000","last_change":"2024-09-21T03:20:22.352414+0000","last_active":"2024-09-21T03:20:22.354711+0000","last_peered":"2024-09-21T03:20:22.354711+0000","last_clean":"2024-09-21T03:20:22.354711+0000","last_became_active":"2024-09-21T03:20:22.352087+0000","last_became_peered":"2024-09-21T03:20:22.352087+0000","last_unstale":"2024-09-21T03:20:22.354711+0000","last_undegraded":"2024-09-21T03:20:22.354711+0000","last_fullsized":"2024-09-21T03:20:22.354711+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:15.584346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T03:20:21.364479+0000","last_change":"2024-09-21T03:20:21.361289+0000","last_active":"2024-09-21T03:20:21.364479+0000","last_peered":"2024-09-21T03:20:21.364479+0000","last_clean":"2024-09-21T03:20:21.364479+0000","last_became_active":"2024-09-21T03:20:21.360579+0000","last_became_peered":"2024-09-21T03:20:21.360579+0000","last_unstale":"2024-09-21T03:20:21.364479+0000","last_undegraded":"2024-09-21T03:20:21.364479+0000","last_fullsized":"2024-09-21T03:20:21.364479+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:48.365369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.361092+0000","last_change":"2024-09-21T03:20:22.363513+0000","last_active":"2024-09-21T03:20:23.361092+0000","last_peered":"2024-09-21T03:20:23.361092+0000","last_clean":"2024-09-21T03:20:23.361092+0000","last_became_active":"2024-09-21T03:20:22.362889+0000","last_became_peered":"2024-09-21T03:20:22.362889+0000","last_unstale":"2024-09-21T03:20:23.361092+0000","last_undegraded":"2024-09-21T03:20:23.361092+0000","last_fullsized":"2024-09-21T03:20:23.361092+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:44.768435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.360918+0000","last_change":"2024-09-21T03:20:21.354915+0000","last_active":"2024-09-21T03:20:23.360918+0000","last_peered":"2024-09-21T03:20:23.360918+0000","last_clean":"2024-09-21T03:20:23.360918+0000","last_became_active":"2024-09-21T03:20:21.354531+0000","last_became_peered":"2024-09-21T03:20:21.354531+0000","last_unstale":"2024-09-21T03:20:23.360918+0000","last_undegraded":"2024-09-21T03:20:23.360918+0000","last_fullsized":"2024-09-21T03:20:23.360918+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:46.767630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.349499+0000","last_change":"2024-09-21T03:20:21.349499+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.349499+0000","last_undegraded":"2024-09-21T03:20:21.349499+0000","last_fullsized":"2024-09-21T03:20:21.349499+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362997+0000","last_change":"2024-09-21T03:20:21.358123+0000","last_active":"2024-09-21T03:20:23.362997+0000","last_peered":"2024-09-21T03:20:23.362997+0000","last_clean":"2024-09-21T03:20:23.362997+0000","last_became_active":"2024-09-21T03:20:21.357694+0000","last_became_peered":"2024-09-21T03:20:21.357694+0000","last_unstale":"2024-09-21T03:20:23.362997+0000","last_undegraded":"2024-09-21T03:20:23.362997+0000","last_fullsized":"2024-09-21T03:20:23.362997+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:45.437208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362804+0000","last_change":"2024-09-21T03:20:22.354537+0000","last_active":"2024-09-21T03:20:23.362804+0000","last_peered":"2024-09-21T03:20:23.362804+0000","last_clean":"2024-09-21T03:20:23.362804+0000","last_became_active":"2024-09-21T03:20:22.354221+0000","last_became_peered":"2024-09-21T03:20:22.354221+0000","last_unstale":"2024-09-21T03:20:23.362804+0000","last_undegraded":"2024-09-21T03:20:23.362804+0000","last_fullsized":"2024-09-21T03:20:23.362804+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:33.384208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.373213+0000","last_change":"2024-09-21T03:20:21.360136+0000","last_active":"2024-09-21T03:20:22.373213+0000","last_peered":"2024-09-21T03:20:22.373213+0000","last_clean":"2024-09-21T03:20:22.373213+0000","last_became_active":"2024-09-21T03:20:21.359678+0000","last_became_peered":"2024-09-21T03:20:21.359678+0000","last_unstale":"2024-09-21T03:20:22.373213+0000","last_undegraded":"2024-09-21T03:20:22.373213+0000","last_fullsized":"2024-09-21T03:20:22.373213+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:44.853872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363330+0000","last_change":"2024-09-21T03:20:22.352124+0000","last_active":"2024-09-21T03:20:23.363330+0000","last_peered":"2024-09-21T03:20:23.363330+0000","last_clean":"2024-09-21T03:20:23.363330+0000","last_became_active":"2024-09-21T03:20:22.351748+0000","last_became_peered":"2024-09-21T03:20:22.351748+0000","last_unstale":"2024-09-21T03:20:23.363330+0000","last_undegraded":"2024-09-21T03:20:23.363330+0000","last_fullsized":"2024-09-21T03:20:23.363330+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:57.836459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.349625+0000","last_change":"2024-09-21T03:20:21.357025+0000","last_active":"2024-09-21T03:20:22.349625+0000","last_peered":"2024-09-21T03:20:22.349625+0000","last_clean":"2024-09-21T03:20:22.349625+0000","last_became_active":"2024-09-21T03:20:21.356647+0000","last_became_peered":"2024-09-21T03:20:21.356647+0000","last_unstale":"2024-09-21T03:20:22.349625+0000","last_undegraded":"2024-09-21T03:20:22.349625+0000","last_fullsized":"2024-09-21T03:20:22.349625+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:14.580199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.358586+0000","last_change":"2024-09-21T03:20:22.356328+0000","last_active":"2024-09-21T03:20:22.358586+0000","last_peered":"2024-09-21T03:20:22.358586+0000","last_clean":"2024-09-21T03:20:22.358586+0000","last_became_active":"2024-09-21T03:20:22.355690+0000","last_became_peered":"2024-09-21T03:20:22.355690+0000","last_unstale":"2024-09-21T03:20:22.358586+0000","last_undegraded":"2024-09-21T03:20:22.358586+0000","last_fullsized":"2024-09-21T03:20:22.358586+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:22.864214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.372211+0000","last_change":"2024-09-21T03:20:21.360457+0000","last_active":"2024-09-21T03:20:22.372211+0000","last_peered":"2024-09-21T03:20:22.372211+0000","last_clean":"2024-09-21T03:20:22.372211+0000","last_became_active":"2024-09-21T03:20:21.360158+0000","last_became_peered":"2024-09-21T03:20:21.360158+0000","last_unstale":"2024-09-21T03:20:22.372211+0000","last_undegraded":"2024-09-21T03:20:22.372211+0000","last_fullsized":"2024-09-21T03:20:22.372211+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:18.644256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.372779+0000","last_change":"2024-09-21T03:20:22.363703+0000","last_active":"2024-09-21T03:20:22.372779+0000","last_peered":"2024-09-21T03:20:22.372779+0000","last_clean":"2024-09-21T03:20:22.372779+0000","last_became_active":"2024-09-21T03:20:22.363365+0000","last_became_peered":"2024-09-21T03:20:22.363365+0000","last_unstale":"2024-09-21T03:20:22.372779+0000","last_undegraded":"2024-09-21T03:20:22.372779+0000","last_fullsized":"2024-09-21T03:20:22.372779+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:28.048269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.352743+0000","last_change":"2024-09-21T03:20:21.362530+0000","last_active":"2024-09-21T03:20:22.352743+0000","last_peered":"2024-09-21T03:20:22.352743+0000","last_clean":"2024-09-21T03:20:22.352743+0000","last_became_active":"2024-09-21T03:20:21.362236+0000","last_became_peered":"2024-09-21T03:20:21.362236+0000","last_unstale":"2024-09-21T03:20:22.352743+0000","last_undegraded":"2024-09-21T03:20:22.352743+0000","last_fullsized":"2024-09-21T03:20:22.352743+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:49.098519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.360903+0000","last_change":"2024-09-21T03:20:22.364758+0000","last_active":"2024-09-21T03:20:23.360903+0000","last_peered":"2024-09-21T03:20:23.360903+0000","last_clean":"2024-09-21T03:20:23.360903+0000","last_became_active":"2024-09-21T03:20:22.364448+0000","last_became_peered":"2024-09-21T03:20:22.364448+0000","last_unstale":"2024-09-21T03:20:23.360903+0000","last_undegraded":"2024-09-21T03:20:23.360903+0000","last_fullsized":"2024-09-21T03:20:23.360903+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:10.839820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T03:20:21.364449+0000","last_change":"2024-09-21T03:20:21.360800+0000","last_active":"2024-09-21T03:20:21.364449+0000","last_peered":"2024-09-21T03:20:21.364449+0000","last_clean":"2024-09-21T03:20:21.364449+0000","last_became_active":"2024-09-21T03:20:21.360480+0000","last_became_peered":"2024-09-21T03:20:21.360480+0000","last_unstale":"2024-09-21T03:20:21.364449+0000","last_undegraded":"2024-09-21T03:20:21.364449+0000","last_fullsized":"2024-09-21T03:20:21.364449+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:02.028522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.349234+0000","last_change":"2024-09-21T03:20:21.349234+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.349234+0000","last_undegraded":"2024-09-21T03:20:21.349234+0000","last_fullsized":"2024-09-21T03:20:21.349234+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.346096+0000","last_change":"2024-09-21T03:20:21.358799+0000","last_active":"2024-09-21T03:20:22.346096+0000","last_peered":"2024-09-21T03:20:22.346096+0000","last_clean":"2024-09-21T03:20:22.346096+0000","last_became_active":"2024-09-21T03:20:21.358305+0000","last_became_peered":"2024-09-21T03:20:21.358305+0000","last_unstale":"2024-09-21T03:20:22.346096+0000","last_undegraded":"2024-09-21T03:20:22.346096+0000","last_fullsized":"2024-09-21T03:20:22.346096+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:44.853872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363756+0000","last_change":"2024-09-21T03:20:22.365742+0000","last_active":"2024-09-21T03:20:23.363756+0000","last_peered":"2024-09-21T03:20:23.363756+0000","last_clean":"2024-09-21T03:20:23.363756+0000","last_became_active":"2024-09-21T03:20:22.365343+0000","last_became_peered":"2024-09-21T03:20:22.365343+0000","last_unstale":"2024-09-21T03:20:23.363756+0000","last_undegraded":"2024-09-21T03:20:23.363756+0000","last_fullsized":"2024-09-21T03:20:23.363756+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:07.319445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.349100+0000","last_change":"2024-09-21T03:20:21.361559+0000","last_active":"2024-09-21T03:20:22.349100+0000","last_peered":"2024-09-21T03:20:22.349100+0000","last_clean":"2024-09-21T03:20:22.349100+0000","last_became_active":"2024-09-21T03:20:21.361176+0000","last_became_peered":"2024-09-21T03:20:21.361176+0000","last_unstale":"2024-09-21T03:20:22.349100+0000","last_undegraded":"2024-09-21T03:20:22.349100+0000","last_fullsized":"2024-09-21T03:20:22.349100+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:33.367277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.347887+0000","last_change":"2024-09-21T03:20:21.347887+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.347887+0000","last_undegraded":"2024-09-21T03:20:21.347887+0000","last_fullsized":"2024-09-21T03:20:21.347887+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.347088+0000","last_change":"2024-09-21T03:20:21.361458+0000","last_active":"2024-09-21T03:20:22.347088+0000","last_peered":"2024-09-21T03:20:22.347088+0000","last_clean":"2024-09-21T03:20:22.347088+0000","last_became_active":"2024-09-21T03:20:21.360423+0000","last_became_peered":"2024-09-21T03:20:21.360423+0000","last_unstale":"2024-09-21T03:20:22.347088+0000","last_undegraded":"2024-09-21T03:20:22.347088+0000","last_fullsized":"2024-09-21T03:20:22.347088+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:07.239411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.360804+0000","last_change":"2024-09-21T03:20:22.357464+0000","last_active":"2024-09-21T03:20:22.360804+0000","last_peered":"2024-09-21T03:20:22.360804+0000","last_clean":"2024-09-21T03:20:22.360804+0000","last_became_active":"2024-09-21T03:20:22.356980+0000","last_became_peered":"2024-09-21T03:20:22.356980+0000","last_unstale":"2024-09-21T03:20:22.360804+0000","last_undegraded":"2024-09-21T03:20:22.360804+0000","last_fullsized":"2024-09-21T03:20:22.360804+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:11.740501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.348448+0000","last_change":"2024-09-21T03:20:21.363637+0000","last_active":"2024-09-21T03:20:22.348448+0000","last_peered":"2024-09-21T03:20:22.348448+0000","last_clean":"2024-09-21T03:20:22.348448+0000","last_became_active":"2024-09-21T03:20:21.363270+0000","last_became_peered":"2024-09-21T03:20:21.363270+0000","last_unstale":"2024-09-21T03:20:22.348448+0000","last_undegraded":"2024-09-21T03:20:22.348448+0000","last_fullsized":"2024-09-21T03:20:22.348448+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:52.543844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.358613+0000","last_change":"2024-09-21T03:20:22.357010+0000","last_active":"2024-09-21T03:20:22.358613+0000","last_peered":"2024-09-21T03:20:22.358613+0000","last_clean":"2024-09-21T03:20:22.358613+0000","last_became_active":"2024-09-21T03:20:22.356058+0000","last_became_peered":"2024-09-21T03:20:22.356058+0000","last_unstale":"2024-09-21T03:20:22.358613+0000","last_undegraded":"2024-09-21T03:20:22.358613+0000","last_fullsized":"2024-09-21T03:20:22.358613+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:13.722902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.346608+0000","last_change":"2024-09-21T03:20:21.363605+0000","last_active":"2024-09-21T03:20:22.346608+0000","last_peered":"2024-09-21T03:20:22.346608+0000","last_clean":"2024-09-21T03:20:22.346608+0000","last_became_active":"2024-09-21T03:20:21.361291+0000","last_became_peered":"2024-09-21T03:20:21.361291+0000","last_unstale":"2024-09-21T03:20:22.346608+0000","last_undegraded":"2024-09-21T03:20:22.346608+0000","last_fullsized":"2024-09-21T03:20:22.346608+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:48.695082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.364776+0000","last_change":"2024-09-21T03:20:22.360870+0000","last_active":"2024-09-21T03:20:22.364776+0000","last_peered":"2024-09-21T03:20:22.364776+0000","last_clean":"2024-09-21T03:20:22.364776+0000","last_became_active":"2024-09-21T03:20:22.360189+0000","last_became_peered":"2024-09-21T03:20:22.360189+0000","last_unstale":"2024-09-21T03:20:22.364776+0000","last_undegraded":"2024-09-21T03:20:22.364776+0000","last_fullsized":"2024-09-21T03:20:22.364776+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:37:46.822052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363116+0000","last_change":"2024-09-21T03:20:21.358394+0000","last_active":"2024-09-21T03:20:23.363116+0000","last_peered":"2024-09-21T03:20:23.363116+0000","last_clean":"2024-09-21T03:20:23.363116+0000","last_became_active":"2024-09-21T03:20:21.358059+0000","last_became_peered":"2024-09-21T03:20:21.358059+0000","last_unstale":"2024-09-21T03:20:23.363116+0000","last_undegraded":"2024-09-21T03:20:23.363116+0000","last_fullsized":"2024-09-21T03:20:23.363116+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:01.708297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.361245+0000","last_change":"2024-09-21T03:20:22.359249+0000","last_active":"2024-09-21T03:20:22.361245+0000","last_peered":"2024-09-21T03:20:22.361245+0000","last_clean":"2024-09-21T03:20:22.361245+0000","last_became_active":"2024-09-21T03:20:22.358932+0000","last_became_peered":"2024-09-21T03:20:22.358932+0000","last_unstale":"2024-09-21T03:20:22.361245+0000","last_undegraded":"2024-09-21T03:20:22.361245+0000","last_fullsized":"2024-09-21T03:20:22.361245+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:32.363099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.347743+0000","last_change":"2024-09-21T03:20:21.358386+0000","last_active":"2024-09-21T03:20:22.347743+0000","last_peered":"2024-09-21T03:20:22.347743+0000","last_clean":"2024-09-21T03:20:22.347743+0000","last_became_active":"2024-09-21T03:20:21.358025+0000","last_became_peered":"2024-09-21T03:20:21.358025+0000","last_unstale":"2024-09-21T03:20:22.347743+0000","last_undegraded":"2024-09-21T03:20:22.347743+0000","last_fullsized":"2024-09-21T03:20:22.347743+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:01.708297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362559+0000","last_change":"2024-09-21T03:20:22.356071+0000","last_active":"2024-09-21T03:20:23.362559+0000","last_peered":"2024-09-21T03:20:23.362559+0000","last_clean":"2024-09-21T03:20:23.362559+0000","last_became_active":"2024-09-21T03:20:22.355762+0000","last_became_peered":"2024-09-21T03:20:22.355762+0000","last_unstale":"2024-09-21T03:20:23.362559+0000","last_undegraded":"2024-09-21T03:20:23.362559+0000","last_fullsized":"2024-09-21T03:20:23.362559+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:02.155154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T03:20:21.366858+0000","last_change":"2024-09-21T03:20:21.362237+0000","last_active":"2024-09-21T03:20:21.366858+0000","last_peered":"2024-09-21T03:20:21.366858+0000","last_clean":"2024-09-21T03:20:21.366858+0000","last_became_active":"2024-09-21T03:20:21.361975+0000","last_became_peered":"2024-09-21T03:20:21.361975+0000","last_unstale":"2024-09-21T03:20:21.366858+0000","last_undegraded":"2024-09-21T03:20:21.366858+0000","last_fullsized":"2024-09-21T03:20:21.366858+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:23.035864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.351895+0000","last_change":"2024-09-21T03:20:21.351895+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.351895+0000","last_undegraded":"2024-09-21T03:20:21.351895+0000","last_fullsized":"2024-09-21T03:20:21.351895+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.374031+0000","last_change":"2024-09-21T03:20:21.361255+0000","last_active":"2024-09-21T03:20:22.374031+0000","last_peered":"2024-09-21T03:20:22.374031+0000","last_clean":"2024-09-21T03:20:22.374031+0000","last_became_active":"2024-09-21T03:20:21.360928+0000","last_became_peered":"2024-09-21T03:20:21.360928+0000","last_unstale":"2024-09-21T03:20:22.374031+0000","last_undegraded":"2024-09-21T03:20:22.374031+0000","last_fullsized":"2024-09-21T03:20:22.374031+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:33.367277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":151,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.346239+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:20:22.346239+0000","last_peered":"2024-09-21T03:20:22.346239+0000","last_clean":"2024-09-21T03:20:22.346239+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:20:22.346239+0000","last_undegraded":"2024-09-21T03:20:22.346239+0000","last_fullsized":"2024-09-21T03:20:22.346239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509470,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28112,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343728,"statfs":{"total":96636764160,"available":96607977472,"internally_reserved":0,"allocated":1105920,"data_stored":791777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509469,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27544,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":528384,"data_stored":208291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509468,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":512000,"data_stored":201389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509468,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":532480,"data_stored":209231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509469,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31700,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340140,"statfs":{"total":96636764160,"available":96604303360,"internally_reserved":0,"allocated":520192,"data_stored":201957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":524288,"data_stored":202953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509469,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":512000,"data_stored":201389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1077248,"data_stored":778645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:20:26.747 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:20:26.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.896+0000 7f922b0d3640 1 -- 172.21.15.105:0/1321214441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f922406f4b0 msgr2=0x7f92240d3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:26.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.896+0000 7f922b0d3640 1 --2- 172.21.15.105:0/1321214441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f922406f4b0 0x7f92240d3330 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f92240ba570 tx=0x7f921002a4d0 comp rx=0 tx=0).stop 2024-09-21T03:20:26.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.896+0000 7f922b0d3640 1 -- 172.21.15.105:0/1321214441 shutdown_connections 2024-09-21T03:20:26.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.896+0000 7f922b0d3640 1 --2- 172.21.15.105:0/1321214441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f922406f4b0 0x7f92240d3330 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:26.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.896+0000 7f922b0d3640 1 --2- 172.21.15.105:0/1321214441 >> v2:172.21.15.162:3300/0 conn(0x7f922406e170 0x7f92240b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:26.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.896+0000 7f922b0d3640 1 -- 172.21.15.105:0/1321214441 >> 172.21.15.105:0/1321214441 conn(0x7f922408bfc0 msgr2=0x7f922409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:26.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.896+0000 7f922b0d3640 1 -- 172.21.15.105:0/1321214441 shutdown_connections 2024-09-21T03:20:26.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.896+0000 7f922b0d3640 1 -- 172.21.15.105:0/1321214441 wait complete. 2024-09-21T03:20:26.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.898+0000 7f922b0d3640 1 Processor -- start 2024-09-21T03:20:26.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.898+0000 7f922b0d3640 1 -- start start 2024-09-21T03:20:26.902 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.899+0000 7f922b0d3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f922406f4b0 0x7f92240cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:26.902 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.899+0000 7f922b0d3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92240d3870 0x7f92241e9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:26.902 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.899+0000 7f922b0d3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92241f9b00 0x7f92241f8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:26.902 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.899+0000 7f922b0d3640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f92240d0ce0 con 0x7f922406f4b0 2024-09-21T03:20:26.902 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.899+0000 7f922b0d3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f92240cf4e0 con 0x7f92240d3870 2024-09-21T03:20:26.902 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.899+0000 7f922b0d3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f92240d0e60 con 0x7f92241f9b00 2024-09-21T03:20:26.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.899+0000 7f9228e6f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f922406f4b0 0x7f92240cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:26.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.899+0000 7f9228e6f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f922406f4b0 0x7f92240cb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:57918/0 (socket says 172.21.15.105:57918) 2024-09-21T03:20:26.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.899+0000 7f9228e6f640 1 -- 172.21.15.105:0/3393212766 learned_addr learned my addr 172.21.15.105:0/3393212766 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:26.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.900+0000 7f9229670640 1 --2- 172.21.15.105:0/3393212766 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92241f9b00 0x7f92241f8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:26.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.900+0000 7f9223fff640 1 --2- 172.21.15.105:0/3393212766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92240d3870 0x7f92241e9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:26.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.900+0000 7f9228e6f640 1 -- 172.21.15.105:0/3393212766 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92241f9b00 msgr2=0x7f92241f8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:26.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.900+0000 7f9228e6f640 1 --2- 172.21.15.105:0/3393212766 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92241f9b00 0x7f92241f8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:26.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.900+0000 7f9228e6f640 1 -- 172.21.15.105:0/3393212766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92240d3870 msgr2=0x7f92241e9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:26.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.900+0000 7f9228e6f640 1 --2- 172.21.15.105:0/3393212766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92240d3870 0x7f92241e9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:26.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.900+0000 7f9228e6f640 1 -- 172.21.15.105:0/3393212766 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92241ea290 con 0x7f922406f4b0 2024-09-21T03:20:26.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.900+0000 7f9228e6f640 1 --2- 172.21.15.105:0/3393212766 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f922406f4b0 0x7f92240cb5c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f921800d770 tx=0x7f921800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:26.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.900+0000 7f92217fa640 1 -- 172.21.15.105:0/3393212766 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9218017070 con 0x7f922406f4b0 2024-09-21T03:20:26.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.900+0000 7f92217fa640 1 -- 172.21.15.105:0/3393212766 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9218009d20 con 0x7f922406f4b0 2024-09-21T03:20:26.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.900+0000 7f922b0d3640 1 -- 172.21.15.105:0/3393212766 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92240cdc20 con 0x7f922406f4b0 2024-09-21T03:20:26.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.900+0000 7f92217fa640 1 -- 172.21.15.105:0/3393212766 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92180106c0 con 0x7f922406f4b0 2024-09-21T03:20:26.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.900+0000 7f922b0d3640 1 -- 172.21.15.105:0/3393212766 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92240ce1e0 con 0x7f922406f4b0 2024-09-21T03:20:26.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.901+0000 7f922b0d3640 1 -- 172.21.15.105:0/3393212766 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92240b9d60 con 0x7f922406f4b0 2024-09-21T03:20:26.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.902+0000 7f92217fa640 1 -- 172.21.15.105:0/3393212766 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f921801a070 con 0x7f922406f4b0 2024-09-21T03:20:26.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.902+0000 7f92217fa640 1 --2- 172.21.15.105:0/3393212766 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9208078bc0 0x7f920807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:26.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.902+0000 7f92217fa640 1 -- 172.21.15.105:0/3393212766 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f921809adf0 con 0x7f922406f4b0 2024-09-21T03:20:26.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.903+0000 7f9223fff640 1 --2- 172.21.15.105:0/3393212766 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9208078bc0 0x7f920807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:26.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.903+0000 7f9223fff640 1 --2- 172.21.15.105:0/3393212766 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9208078bc0 0x7f920807b0d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9210034000 tx=0x7f9210004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:26.908 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:26.907+0000 7f92217fa640 1 -- 172.21.15.105:0/3393212766 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f92240b9d60 con 0x7f922406f4b0 2024-09-21T03:20:27.129 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.128+0000 7f922b0d3640 1 -- 172.21.15.105:0/3393212766 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f922406e170 con 0x7f9208078bc0 2024-09-21T03:20:27.134 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.133+0000 7f92217fa640 1 -- 172.21.15.105:0/3393212766 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250801 (secure 0 0 0) 0x7f922406e170 con 0x7f9208078bc0 2024-09-21T03:20:27.137 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:20:27.138 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:20:27.139 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.136+0000 7f922b0d3640 1 -- 172.21.15.105:0/3393212766 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9208078bc0 msgr2=0x7f920807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:27.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.136+0000 7f922b0d3640 1 --2- 172.21.15.105:0/3393212766 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9208078bc0 0x7f920807b0d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9210034000 tx=0x7f9210004730 comp rx=0 tx=0).stop 2024-09-21T03:20:27.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.136+0000 7f922b0d3640 1 -- 172.21.15.105:0/3393212766 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f922406f4b0 msgr2=0x7f92240cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:27.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.136+0000 7f922b0d3640 1 --2- 172.21.15.105:0/3393212766 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f922406f4b0 0x7f92240cb5c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f921800d770 tx=0x7f921800dc30 comp rx=0 tx=0).stop 2024-09-21T03:20:27.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.136+0000 7f922b0d3640 1 -- 172.21.15.105:0/3393212766 shutdown_connections 2024-09-21T03:20:27.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.136+0000 7f922b0d3640 1 --2- 172.21.15.105:0/3393212766 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9208078bc0 0x7f920807b0d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:27.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.136+0000 7f922b0d3640 1 --2- 172.21.15.105:0/3393212766 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92241f9b00 0x7f92241f8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:27.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.136+0000 7f922b0d3640 1 --2- 172.21.15.105:0/3393212766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92240d3870 0x7f92241e9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:27.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.136+0000 7f922b0d3640 1 --2- 172.21.15.105:0/3393212766 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f922406f4b0 0x7f92240cb5c0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:27.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.136+0000 7f922b0d3640 1 -- 172.21.15.105:0/3393212766 >> 172.21.15.105:0/3393212766 conn(0x7f922408bfc0 msgr2=0x7f9224161aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:27.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.136+0000 7f922b0d3640 1 -- 172.21.15.105:0/3393212766 shutdown_connections 2024-09-21T03:20:27.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.136+0000 7f922b0d3640 1 -- 172.21.15.105:0/3393212766 wait complete. 2024-09-21T03:20:27.148 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":103,"stamp":"2024-09-21T03:20:25.308943+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":133,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":117,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229748,"kb_used_data":5188,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744972,"statfs":{"total":773094113280,"available":772858851328,"internally_reserved":0,"allocated":5312512,"data_stored":2795632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.974040"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.360568+0000","last_change":"2024-09-21T03:20:22.354648+0000","last_active":"2024-09-21T03:20:22.360568+0000","last_peered":"2024-09-21T03:20:22.360568+0000","last_clean":"2024-09-21T03:20:22.360568+0000","last_became_active":"2024-09-21T03:20:22.354279+0000","last_became_peered":"2024-09-21T03:20:22.354279+0000","last_unstale":"2024-09-21T03:20:22.360568+0000","last_undegraded":"2024-09-21T03:20:22.360568+0000","last_fullsized":"2024-09-21T03:20:22.360568+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:22.864214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.365953+0000","last_change":"2024-09-21T03:20:22.363925+0000","last_active":"2024-09-21T03:20:22.365953+0000","last_peered":"2024-09-21T03:20:22.365953+0000","last_clean":"2024-09-21T03:20:22.365953+0000","last_became_active":"2024-09-21T03:20:22.363588+0000","last_became_peered":"2024-09-21T03:20:22.363588+0000","last_unstale":"2024-09-21T03:20:22.365953+0000","last_undegraded":"2024-09-21T03:20:22.365953+0000","last_fullsized":"2024-09-21T03:20:22.365953+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:15.584346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362247+0000","last_change":"2024-09-21T03:20:22.356946+0000","last_active":"2024-09-21T03:20:23.362247+0000","last_peered":"2024-09-21T03:20:23.362247+0000","last_clean":"2024-09-21T03:20:23.362247+0000","last_became_active":"2024-09-21T03:20:22.356625+0000","last_became_peered":"2024-09-21T03:20:22.356625+0000","last_unstale":"2024-09-21T03:20:23.362247+0000","last_undegraded":"2024-09-21T03:20:23.362247+0000","last_fullsized":"2024-09-21T03:20:23.362247+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:24.993031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.348358+0000","last_change":"2024-09-21T03:20:21.348358+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.348358+0000","last_undegraded":"2024-09-21T03:20:21.348358+0000","last_fullsized":"2024-09-21T03:20:21.348358+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.371612+0000","last_change":"2024-09-21T03:20:22.368074+0000","last_active":"2024-09-21T03:20:22.371612+0000","last_peered":"2024-09-21T03:20:22.371612+0000","last_clean":"2024-09-21T03:20:22.371612+0000","last_became_active":"2024-09-21T03:20:22.367712+0000","last_became_peered":"2024-09-21T03:20:22.367712+0000","last_unstale":"2024-09-21T03:20:22.371612+0000","last_undegraded":"2024-09-21T03:20:22.371612+0000","last_fullsized":"2024-09-21T03:20:22.371612+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:19.648403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.358636+0000","last_change":"2024-09-21T03:20:22.357312+0000","last_active":"2024-09-21T03:20:22.358636+0000","last_peered":"2024-09-21T03:20:22.358636+0000","last_clean":"2024-09-21T03:20:22.358636+0000","last_became_active":"2024-09-21T03:20:22.356723+0000","last_became_peered":"2024-09-21T03:20:22.356723+0000","last_unstale":"2024-09-21T03:20:22.358636+0000","last_undegraded":"2024-09-21T03:20:22.358636+0000","last_fullsized":"2024-09-21T03:20:22.358636+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:11.740501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.360735+0000","last_change":"2024-09-21T03:20:22.354451+0000","last_active":"2024-09-21T03:20:22.360735+0000","last_peered":"2024-09-21T03:20:22.360735+0000","last_clean":"2024-09-21T03:20:22.360735+0000","last_became_active":"2024-09-21T03:20:22.354036+0000","last_became_peered":"2024-09-21T03:20:22.354036+0000","last_unstale":"2024-09-21T03:20:22.360735+0000","last_undegraded":"2024-09-21T03:20:22.360735+0000","last_fullsized":"2024-09-21T03:20:22.360735+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:19.648403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.351127+0000","last_change":"2024-09-21T03:20:21.351127+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.351127+0000","last_undegraded":"2024-09-21T03:20:21.351127+0000","last_fullsized":"2024-09-21T03:20:21.351127+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.351434+0000","last_change":"2024-09-21T03:20:21.351434+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.351434+0000","last_undegraded":"2024-09-21T03:20:21.351434+0000","last_fullsized":"2024-09-21T03:20:21.351434+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.353175+0000","last_change":"2024-09-21T03:20:21.353175+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.353175+0000","last_undegraded":"2024-09-21T03:20:21.353175+0000","last_fullsized":"2024-09-21T03:20:21.353175+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.349066+0000","last_change":"2024-09-21T03:20:21.349066+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.349066+0000","last_undegraded":"2024-09-21T03:20:21.349066+0000","last_fullsized":"2024-09-21T03:20:21.349066+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.362804+0000","last_change":"2024-09-21T03:20:22.361976+0000","last_active":"2024-09-21T03:20:22.362804+0000","last_peered":"2024-09-21T03:20:22.362804+0000","last_clean":"2024-09-21T03:20:22.362804+0000","last_became_active":"2024-09-21T03:20:22.361662+0000","last_became_peered":"2024-09-21T03:20:22.361662+0000","last_unstale":"2024-09-21T03:20:22.362804+0000","last_undegraded":"2024-09-21T03:20:22.362804+0000","last_fullsized":"2024-09-21T03:20:22.362804+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:08.243558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.361094+0000","last_change":"2024-09-21T03:20:22.370554+0000","last_active":"2024-09-21T03:20:23.361094+0000","last_peered":"2024-09-21T03:20:23.361094+0000","last_clean":"2024-09-21T03:20:23.361094+0000","last_became_active":"2024-09-21T03:20:22.370255+0000","last_became_peered":"2024-09-21T03:20:22.370255+0000","last_unstale":"2024-09-21T03:20:23.361094+0000","last_undegraded":"2024-09-21T03:20:23.361094+0000","last_fullsized":"2024-09-21T03:20:23.361094+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:10:31.487754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.347383+0000","last_change":"2024-09-21T03:20:21.347383+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.347383+0000","last_undegraded":"2024-09-21T03:20:21.347383+0000","last_fullsized":"2024-09-21T03:20:21.347383+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.368579+0000","last_change":"2024-09-21T03:20:22.364458+0000","last_active":"2024-09-21T03:20:22.368579+0000","last_peered":"2024-09-21T03:20:22.368579+0000","last_clean":"2024-09-21T03:20:22.368579+0000","last_became_active":"2024-09-21T03:20:22.363602+0000","last_became_peered":"2024-09-21T03:20:22.363602+0000","last_unstale":"2024-09-21T03:20:22.368579+0000","last_undegraded":"2024-09-21T03:20:22.368579+0000","last_fullsized":"2024-09-21T03:20:22.368579+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:28.932663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362357+0000","last_change":"2024-09-21T03:20:22.364557+0000","last_active":"2024-09-21T03:20:23.362357+0000","last_peered":"2024-09-21T03:20:23.362357+0000","last_clean":"2024-09-21T03:20:23.362357+0000","last_became_active":"2024-09-21T03:20:22.364229+0000","last_became_peered":"2024-09-21T03:20:22.364229+0000","last_unstale":"2024-09-21T03:20:23.362357+0000","last_undegraded":"2024-09-21T03:20:23.362357+0000","last_fullsized":"2024-09-21T03:20:23.362357+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:04.759943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363685+0000","last_change":"2024-09-21T03:20:22.362778+0000","last_active":"2024-09-21T03:20:23.363685+0000","last_peered":"2024-09-21T03:20:23.363685+0000","last_clean":"2024-09-21T03:20:23.363685+0000","last_became_active":"2024-09-21T03:20:22.362478+0000","last_became_peered":"2024-09-21T03:20:22.362478+0000","last_unstale":"2024-09-21T03:20:23.363685+0000","last_undegraded":"2024-09-21T03:20:23.363685+0000","last_fullsized":"2024-09-21T03:20:23.363685+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:11.553421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362843+0000","last_change":"2024-09-21T03:20:22.363582+0000","last_active":"2024-09-21T03:20:23.362843+0000","last_peered":"2024-09-21T03:20:23.362843+0000","last_clean":"2024-09-21T03:20:23.362843+0000","last_became_active":"2024-09-21T03:20:22.363282+0000","last_became_peered":"2024-09-21T03:20:22.363282+0000","last_unstale":"2024-09-21T03:20:23.362843+0000","last_undegraded":"2024-09-21T03:20:23.362843+0000","last_fullsized":"2024-09-21T03:20:23.362843+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:23:12.532832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363362+0000","last_change":"2024-09-21T03:20:22.363482+0000","last_active":"2024-09-21T03:20:23.363362+0000","last_peered":"2024-09-21T03:20:23.363362+0000","last_clean":"2024-09-21T03:20:23.363362+0000","last_became_active":"2024-09-21T03:20:22.363129+0000","last_became_peered":"2024-09-21T03:20:22.363129+0000","last_unstale":"2024-09-21T03:20:23.363362+0000","last_undegraded":"2024-09-21T03:20:23.363362+0000","last_fullsized":"2024-09-21T03:20:23.363362+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:12:18.021857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.360949+0000","last_change":"2024-09-21T03:20:22.370285+0000","last_active":"2024-09-21T03:20:23.360949+0000","last_peered":"2024-09-21T03:20:23.360949+0000","last_clean":"2024-09-21T03:20:23.360949+0000","last_became_active":"2024-09-21T03:20:22.369715+0000","last_became_peered":"2024-09-21T03:20:22.369715+0000","last_unstale":"2024-09-21T03:20:23.360949+0000","last_undegraded":"2024-09-21T03:20:23.360949+0000","last_fullsized":"2024-09-21T03:20:23.360949+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:08.636582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.364809+0000","last_change":"2024-09-21T03:20:22.361197+0000","last_active":"2024-09-21T03:20:22.364809+0000","last_peered":"2024-09-21T03:20:22.364809+0000","last_clean":"2024-09-21T03:20:22.364809+0000","last_became_active":"2024-09-21T03:20:22.360584+0000","last_became_peered":"2024-09-21T03:20:22.360584+0000","last_unstale":"2024-09-21T03:20:22.364809+0000","last_undegraded":"2024-09-21T03:20:22.364809+0000","last_fullsized":"2024-09-21T03:20:22.364809+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:20.393544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.346857+0000","last_change":"2024-09-21T03:20:21.346857+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.346857+0000","last_undegraded":"2024-09-21T03:20:21.346857+0000","last_fullsized":"2024-09-21T03:20:21.346857+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362495+0000","last_change":"2024-09-21T03:20:22.359184+0000","last_active":"2024-09-21T03:20:23.362495+0000","last_peered":"2024-09-21T03:20:23.362495+0000","last_clean":"2024-09-21T03:20:23.362495+0000","last_became_active":"2024-09-21T03:20:22.357185+0000","last_became_peered":"2024-09-21T03:20:22.357185+0000","last_unstale":"2024-09-21T03:20:23.362495+0000","last_undegraded":"2024-09-21T03:20:23.362495+0000","last_fullsized":"2024-09-21T03:20:23.362495+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:13.194698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363072+0000","last_change":"2024-09-21T03:20:22.357204+0000","last_active":"2024-09-21T03:20:23.363072+0000","last_peered":"2024-09-21T03:20:23.363072+0000","last_clean":"2024-09-21T03:20:23.363072+0000","last_became_active":"2024-09-21T03:20:22.356888+0000","last_became_peered":"2024-09-21T03:20:22.356888+0000","last_unstale":"2024-09-21T03:20:23.363072+0000","last_undegraded":"2024-09-21T03:20:23.363072+0000","last_fullsized":"2024-09-21T03:20:23.363072+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:23:58.513737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363507+0000","last_change":"2024-09-21T03:20:22.366679+0000","last_active":"2024-09-21T03:20:23.363507+0000","last_peered":"2024-09-21T03:20:23.363507+0000","last_clean":"2024-09-21T03:20:23.363507+0000","last_became_active":"2024-09-21T03:20:22.366295+0000","last_became_peered":"2024-09-21T03:20:22.366295+0000","last_unstale":"2024-09-21T03:20:23.363507+0000","last_undegraded":"2024-09-21T03:20:23.363507+0000","last_fullsized":"2024-09-21T03:20:23.363507+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:56.748578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.360927+0000","last_change":"2024-09-21T03:20:22.363184+0000","last_active":"2024-09-21T03:20:23.360927+0000","last_peered":"2024-09-21T03:20:23.360927+0000","last_clean":"2024-09-21T03:20:23.360927+0000","last_became_active":"2024-09-21T03:20:22.362501+0000","last_became_peered":"2024-09-21T03:20:22.362501+0000","last_unstale":"2024-09-21T03:20:23.360927+0000","last_undegraded":"2024-09-21T03:20:23.360927+0000","last_fullsized":"2024-09-21T03:20:23.360927+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:21:09.148798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362478+0000","last_change":"2024-09-21T03:20:22.362032+0000","last_active":"2024-09-21T03:20:23.362478+0000","last_peered":"2024-09-21T03:20:23.362478+0000","last_clean":"2024-09-21T03:20:23.362478+0000","last_became_active":"2024-09-21T03:20:22.361748+0000","last_became_peered":"2024-09-21T03:20:22.361748+0000","last_unstale":"2024-09-21T03:20:23.362478+0000","last_undegraded":"2024-09-21T03:20:23.362478+0000","last_fullsized":"2024-09-21T03:20:23.362478+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:08.318524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.362382+0000","last_change":"2024-09-21T03:20:22.361207+0000","last_active":"2024-09-21T03:20:22.362382+0000","last_peered":"2024-09-21T03:20:22.362382+0000","last_clean":"2024-09-21T03:20:22.362382+0000","last_became_active":"2024-09-21T03:20:22.360879+0000","last_became_peered":"2024-09-21T03:20:22.360879+0000","last_unstale":"2024-09-21T03:20:22.362382+0000","last_undegraded":"2024-09-21T03:20:22.362382+0000","last_fullsized":"2024-09-21T03:20:22.362382+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:27.628018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362977+0000","last_change":"2024-09-21T03:20:22.358441+0000","last_active":"2024-09-21T03:20:23.362977+0000","last_peered":"2024-09-21T03:20:23.362977+0000","last_clean":"2024-09-21T03:20:23.362977+0000","last_became_active":"2024-09-21T03:20:22.358130+0000","last_became_peered":"2024-09-21T03:20:22.358130+0000","last_unstale":"2024-09-21T03:20:23.362977+0000","last_undegraded":"2024-09-21T03:20:23.362977+0000","last_fullsized":"2024-09-21T03:20:23.362977+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:06.233989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362070+0000","last_change":"2024-09-21T03:20:22.356052+0000","last_active":"2024-09-21T03:20:23.362070+0000","last_peered":"2024-09-21T03:20:23.362070+0000","last_clean":"2024-09-21T03:20:23.362070+0000","last_became_active":"2024-09-21T03:20:22.355703+0000","last_became_peered":"2024-09-21T03:20:22.355703+0000","last_unstale":"2024-09-21T03:20:23.362070+0000","last_undegraded":"2024-09-21T03:20:23.362070+0000","last_fullsized":"2024-09-21T03:20:23.362070+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:54.277955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.368552+0000","last_change":"2024-09-21T03:20:22.364133+0000","last_active":"2024-09-21T03:20:22.368552+0000","last_peered":"2024-09-21T03:20:22.368552+0000","last_clean":"2024-09-21T03:20:22.368552+0000","last_became_active":"2024-09-21T03:20:22.363162+0000","last_became_peered":"2024-09-21T03:20:22.363162+0000","last_unstale":"2024-09-21T03:20:22.368552+0000","last_undegraded":"2024-09-21T03:20:22.368552+0000","last_fullsized":"2024-09-21T03:20:22.368552+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:10.473935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.361087+0000","last_change":"2024-09-21T03:20:22.358222+0000","last_active":"2024-09-21T03:20:23.361087+0000","last_peered":"2024-09-21T03:20:23.361087+0000","last_clean":"2024-09-21T03:20:23.361087+0000","last_became_active":"2024-09-21T03:20:22.357933+0000","last_became_peered":"2024-09-21T03:20:22.357933+0000","last_unstale":"2024-09-21T03:20:23.361087+0000","last_undegraded":"2024-09-21T03:20:23.361087+0000","last_fullsized":"2024-09-21T03:20:23.361087+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:18.911040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.356962+0000","last_change":"2024-09-21T03:20:22.353413+0000","last_active":"2024-09-21T03:20:22.356962+0000","last_peered":"2024-09-21T03:20:22.356962+0000","last_clean":"2024-09-21T03:20:22.356962+0000","last_became_active":"2024-09-21T03:20:22.353091+0000","last_became_peered":"2024-09-21T03:20:22.353091+0000","last_unstale":"2024-09-21T03:20:22.356962+0000","last_undegraded":"2024-09-21T03:20:22.356962+0000","last_fullsized":"2024-09-21T03:20:22.356962+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:19:14.358260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.377306+0000","last_change":"2024-09-21T03:20:21.353455+0000","last_active":"2024-09-21T03:20:22.377306+0000","last_peered":"2024-09-21T03:20:22.377306+0000","last_clean":"2024-09-21T03:20:22.377306+0000","last_became_active":"2024-09-21T03:20:21.353167+0000","last_became_peered":"2024-09-21T03:20:21.353167+0000","last_unstale":"2024-09-21T03:20:22.377306+0000","last_undegraded":"2024-09-21T03:20:22.377306+0000","last_fullsized":"2024-09-21T03:20:22.377306+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:10.549273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363625+0000","last_change":"2024-09-21T03:20:22.360284+0000","last_active":"2024-09-21T03:20:23.363625+0000","last_peered":"2024-09-21T03:20:23.363625+0000","last_clean":"2024-09-21T03:20:23.363625+0000","last_became_active":"2024-09-21T03:20:22.359131+0000","last_became_peered":"2024-09-21T03:20:22.359131+0000","last_unstale":"2024-09-21T03:20:23.363625+0000","last_undegraded":"2024-09-21T03:20:23.363625+0000","last_fullsized":"2024-09-21T03:20:23.363625+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:27:18.588119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362999+0000","last_change":"2024-09-21T03:20:21.358490+0000","last_active":"2024-09-21T03:20:23.362999+0000","last_peered":"2024-09-21T03:20:23.362999+0000","last_clean":"2024-09-21T03:20:23.362999+0000","last_became_active":"2024-09-21T03:20:21.357991+0000","last_became_peered":"2024-09-21T03:20:21.357991+0000","last_unstale":"2024-09-21T03:20:23.362999+0000","last_undegraded":"2024-09-21T03:20:23.362999+0000","last_fullsized":"2024-09-21T03:20:23.362999+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:52.543844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.374252+0000","last_change":"2024-09-21T03:20:22.370492+0000","last_active":"2024-09-21T03:20:22.374252+0000","last_peered":"2024-09-21T03:20:22.374252+0000","last_clean":"2024-09-21T03:20:22.374252+0000","last_became_active":"2024-09-21T03:20:22.370117+0000","last_became_peered":"2024-09-21T03:20:22.370117+0000","last_unstale":"2024-09-21T03:20:22.374252+0000","last_undegraded":"2024-09-21T03:20:22.374252+0000","last_fullsized":"2024-09-21T03:20:22.374252+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:22.864214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.372898+0000","last_change":"2024-09-21T03:20:21.363908+0000","last_active":"2024-09-21T03:20:22.372898+0000","last_peered":"2024-09-21T03:20:22.372898+0000","last_clean":"2024-09-21T03:20:22.372898+0000","last_became_active":"2024-09-21T03:20:21.363494+0000","last_became_peered":"2024-09-21T03:20:21.363494+0000","last_unstale":"2024-09-21T03:20:22.372898+0000","last_undegraded":"2024-09-21T03:20:22.372898+0000","last_fullsized":"2024-09-21T03:20:22.372898+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:40.157840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.358596+0000","last_change":"2024-09-21T03:20:22.357615+0000","last_active":"2024-09-21T03:20:22.358596+0000","last_peered":"2024-09-21T03:20:22.358596+0000","last_clean":"2024-09-21T03:20:22.358596+0000","last_became_active":"2024-09-21T03:20:22.357317+0000","last_became_peered":"2024-09-21T03:20:22.357317+0000","last_unstale":"2024-09-21T03:20:22.358596+0000","last_undegraded":"2024-09-21T03:20:22.358596+0000","last_fullsized":"2024-09-21T03:20:22.358596+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:12:18.021857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.374621+0000","last_change":"2024-09-21T03:20:21.361902+0000","last_active":"2024-09-21T03:20:22.374621+0000","last_peered":"2024-09-21T03:20:22.374621+0000","last_clean":"2024-09-21T03:20:22.374621+0000","last_became_active":"2024-09-21T03:20:21.361549+0000","last_became_peered":"2024-09-21T03:20:21.361549+0000","last_unstale":"2024-09-21T03:20:22.374621+0000","last_undegraded":"2024-09-21T03:20:22.374621+0000","last_fullsized":"2024-09-21T03:20:22.374621+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:26.623870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362338+0000","last_change":"2024-09-21T03:20:22.353213+0000","last_active":"2024-09-21T03:20:23.362338+0000","last_peered":"2024-09-21T03:20:23.362338+0000","last_clean":"2024-09-21T03:20:23.362338+0000","last_became_active":"2024-09-21T03:20:22.352809+0000","last_became_peered":"2024-09-21T03:20:22.352809+0000","last_unstale":"2024-09-21T03:20:23.362338+0000","last_undegraded":"2024-09-21T03:20:23.362338+0000","last_fullsized":"2024-09-21T03:20:23.362338+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:51:09.144620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.371958+0000","last_change":"2024-09-21T03:20:21.360479+0000","last_active":"2024-09-21T03:20:22.371958+0000","last_peered":"2024-09-21T03:20:22.371958+0000","last_clean":"2024-09-21T03:20:22.371958+0000","last_became_active":"2024-09-21T03:20:21.360179+0000","last_became_peered":"2024-09-21T03:20:21.360179+0000","last_unstale":"2024-09-21T03:20:22.371958+0000","last_undegraded":"2024-09-21T03:20:22.371958+0000","last_fullsized":"2024-09-21T03:20:22.371958+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:31.358952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.350317+0000","last_change":"2024-09-21T03:20:21.350317+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.350317+0000","last_undegraded":"2024-09-21T03:20:21.350317+0000","last_fullsized":"2024-09-21T03:20:21.350317+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362478+0000","last_change":"2024-09-21T03:20:21.360913+0000","last_active":"2024-09-21T03:20:23.362478+0000","last_peered":"2024-09-21T03:20:23.362478+0000","last_clean":"2024-09-21T03:20:23.362478+0000","last_became_active":"2024-09-21T03:20:21.360581+0000","last_became_peered":"2024-09-21T03:20:21.360581+0000","last_unstale":"2024-09-21T03:20:23.362478+0000","last_undegraded":"2024-09-21T03:20:23.362478+0000","last_fullsized":"2024-09-21T03:20:23.362478+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:57.040972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.350681+0000","last_change":"2024-09-21T03:20:21.350681+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.350681+0000","last_undegraded":"2024-09-21T03:20:21.350681+0000","last_fullsized":"2024-09-21T03:20:21.350681+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.353738+0000","last_change":"2024-09-21T03:20:21.363512+0000","last_active":"2024-09-21T03:20:22.353738+0000","last_peered":"2024-09-21T03:20:22.353738+0000","last_clean":"2024-09-21T03:20:22.353738+0000","last_became_active":"2024-09-21T03:20:21.363215+0000","last_became_peered":"2024-09-21T03:20:21.363215+0000","last_unstale":"2024-09-21T03:20:22.353738+0000","last_undegraded":"2024-09-21T03:20:22.353738+0000","last_fullsized":"2024-09-21T03:20:22.353738+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:48.695082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362814+0000","last_change":"2024-09-21T03:20:22.359160+0000","last_active":"2024-09-21T03:20:23.362814+0000","last_peered":"2024-09-21T03:20:23.362814+0000","last_clean":"2024-09-21T03:20:23.362814+0000","last_became_active":"2024-09-21T03:20:22.356795+0000","last_became_peered":"2024-09-21T03:20:22.356795+0000","last_unstale":"2024-09-21T03:20:23.362814+0000","last_undegraded":"2024-09-21T03:20:23.362814+0000","last_fullsized":"2024-09-21T03:20:23.362814+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:48.006533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T03:20:21.364295+0000","last_change":"2024-09-21T03:20:21.359300+0000","last_active":"2024-09-21T03:20:21.364295+0000","last_peered":"2024-09-21T03:20:21.364295+0000","last_clean":"2024-09-21T03:20:21.364295+0000","last_became_active":"2024-09-21T03:20:21.358998+0000","last_became_peered":"2024-09-21T03:20:21.358998+0000","last_unstale":"2024-09-21T03:20:21.364295+0000","last_undegraded":"2024-09-21T03:20:21.364295+0000","last_fullsized":"2024-09-21T03:20:21.364295+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:35:49.970928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362865+0000","last_change":"2024-09-21T03:20:22.361977+0000","last_active":"2024-09-21T03:20:23.362865+0000","last_peered":"2024-09-21T03:20:23.362865+0000","last_clean":"2024-09-21T03:20:23.362865+0000","last_became_active":"2024-09-21T03:20:22.361641+0000","last_became_peered":"2024-09-21T03:20:22.361641+0000","last_unstale":"2024-09-21T03:20:23.362865+0000","last_undegraded":"2024-09-21T03:20:23.362865+0000","last_fullsized":"2024-09-21T03:20:23.362865+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:34.601478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363827+0000","last_change":"2024-09-21T03:20:21.358364+0000","last_active":"2024-09-21T03:20:23.363827+0000","last_peered":"2024-09-21T03:20:23.363827+0000","last_clean":"2024-09-21T03:20:23.363827+0000","last_became_active":"2024-09-21T03:20:21.357818+0000","last_became_peered":"2024-09-21T03:20:21.357818+0000","last_unstale":"2024-09-21T03:20:23.363827+0000","last_undegraded":"2024-09-21T03:20:23.363827+0000","last_fullsized":"2024-09-21T03:20:23.363827+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:40.157840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.368225+0000","last_change":"2024-09-21T03:20:22.365443+0000","last_active":"2024-09-21T03:20:22.368225+0000","last_peered":"2024-09-21T03:20:22.368225+0000","last_clean":"2024-09-21T03:20:22.368225+0000","last_became_active":"2024-09-21T03:20:22.365081+0000","last_became_peered":"2024-09-21T03:20:22.365081+0000","last_unstale":"2024-09-21T03:20:22.368225+0000","last_undegraded":"2024-09-21T03:20:22.368225+0000","last_fullsized":"2024-09-21T03:20:22.368225+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:13:18.276359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T03:20:21.364445+0000","last_change":"2024-09-21T03:20:21.360629+0000","last_active":"2024-09-21T03:20:21.364445+0000","last_peered":"2024-09-21T03:20:21.364445+0000","last_clean":"2024-09-21T03:20:21.364445+0000","last_became_active":"2024-09-21T03:20:21.360357+0000","last_became_peered":"2024-09-21T03:20:21.360357+0000","last_unstale":"2024-09-21T03:20:21.364445+0000","last_undegraded":"2024-09-21T03:20:21.364445+0000","last_fullsized":"2024-09-21T03:20:21.364445+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:41.136243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.369350+0000","last_change":"2024-09-21T03:20:22.368659+0000","last_active":"2024-09-21T03:20:22.369350+0000","last_peered":"2024-09-21T03:20:22.369350+0000","last_clean":"2024-09-21T03:20:22.369350+0000","last_became_active":"2024-09-21T03:20:22.359839+0000","last_became_peered":"2024-09-21T03:20:22.359839+0000","last_unstale":"2024-09-21T03:20:22.369350+0000","last_undegraded":"2024-09-21T03:20:22.369350+0000","last_fullsized":"2024-09-21T03:20:22.369350+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:29.987903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.377624+0000","last_change":"2024-09-21T03:20:21.360749+0000","last_active":"2024-09-21T03:20:22.377624+0000","last_peered":"2024-09-21T03:20:22.377624+0000","last_clean":"2024-09-21T03:20:22.377624+0000","last_became_active":"2024-09-21T03:20:21.359582+0000","last_became_peered":"2024-09-21T03:20:21.359582+0000","last_unstale":"2024-09-21T03:20:22.377624+0000","last_undegraded":"2024-09-21T03:20:22.377624+0000","last_fullsized":"2024-09-21T03:20:22.377624+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:33.367277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.360774+0000","last_change":"2024-09-21T03:20:22.354530+0000","last_active":"2024-09-21T03:20:22.360774+0000","last_peered":"2024-09-21T03:20:22.360774+0000","last_clean":"2024-09-21T03:20:22.360774+0000","last_became_active":"2024-09-21T03:20:22.354017+0000","last_became_peered":"2024-09-21T03:20:22.354017+0000","last_unstale":"2024-09-21T03:20:22.360774+0000","last_undegraded":"2024-09-21T03:20:22.360774+0000","last_fullsized":"2024-09-21T03:20:22.360774+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:13.722902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":21,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.360948+0000","last_change":"2024-09-21T03:20:21.359485+0000","last_active":"2024-09-21T03:20:23.360948+0000","last_peered":"2024-09-21T03:20:23.360948+0000","last_clean":"2024-09-21T03:20:23.360948+0000","last_became_active":"2024-09-21T03:20:21.359182+0000","last_became_peered":"2024-09-21T03:20:21.359182+0000","last_unstale":"2024-09-21T03:20:23.360948+0000","last_undegraded":"2024-09-21T03:20:23.360948+0000","last_fullsized":"2024-09-21T03:20:23.360948+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:06:13.612749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363374+0000","last_change":"2024-09-21T03:20:22.363602+0000","last_active":"2024-09-21T03:20:23.363374+0000","last_peered":"2024-09-21T03:20:23.363374+0000","last_clean":"2024-09-21T03:20:23.363374+0000","last_became_active":"2024-09-21T03:20:22.363245+0000","last_became_peered":"2024-09-21T03:20:22.363245+0000","last_unstale":"2024-09-21T03:20:23.363374+0000","last_undegraded":"2024-09-21T03:20:23.363374+0000","last_fullsized":"2024-09-21T03:20:23.363374+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:58:04.733519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.375839+0000","last_change":"2024-09-21T03:20:21.362428+0000","last_active":"2024-09-21T03:20:22.375839+0000","last_peered":"2024-09-21T03:20:22.375839+0000","last_clean":"2024-09-21T03:20:22.375839+0000","last_became_active":"2024-09-21T03:20:21.362120+0000","last_became_peered":"2024-09-21T03:20:21.362120+0000","last_unstale":"2024-09-21T03:20:22.375839+0000","last_undegraded":"2024-09-21T03:20:22.375839+0000","last_fullsized":"2024-09-21T03:20:22.375839+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:07.239411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.349866+0000","last_change":"2024-09-21T03:20:21.349866+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.349866+0000","last_undegraded":"2024-09-21T03:20:21.349866+0000","last_fullsized":"2024-09-21T03:20:21.349866+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.346757+0000","last_change":"2024-09-21T03:20:21.357809+0000","last_active":"2024-09-21T03:20:22.346757+0000","last_peered":"2024-09-21T03:20:22.346757+0000","last_clean":"2024-09-21T03:20:22.346757+0000","last_became_active":"2024-09-21T03:20:21.357478+0000","last_became_peered":"2024-09-21T03:20:21.357478+0000","last_unstale":"2024-09-21T03:20:22.346757+0000","last_undegraded":"2024-09-21T03:20:22.346757+0000","last_fullsized":"2024-09-21T03:20:22.346757+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:31.358952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.359974+0000","last_change":"2024-09-21T03:20:22.358128+0000","last_active":"2024-09-21T03:20:22.359974+0000","last_peered":"2024-09-21T03:20:22.359974+0000","last_clean":"2024-09-21T03:20:22.359974+0000","last_became_active":"2024-09-21T03:20:22.357840+0000","last_became_peered":"2024-09-21T03:20:22.357840+0000","last_unstale":"2024-09-21T03:20:22.359974+0000","last_undegraded":"2024-09-21T03:20:22.359974+0000","last_fullsized":"2024-09-21T03:20:22.359974+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:13:18.276359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.348394+0000","last_change":"2024-09-21T03:20:21.362378+0000","last_active":"2024-09-21T03:20:22.348394+0000","last_peered":"2024-09-21T03:20:22.348394+0000","last_clean":"2024-09-21T03:20:22.348394+0000","last_became_active":"2024-09-21T03:20:21.362053+0000","last_became_peered":"2024-09-21T03:20:21.362053+0000","last_unstale":"2024-09-21T03:20:22.348394+0000","last_undegraded":"2024-09-21T03:20:22.348394+0000","last_fullsized":"2024-09-21T03:20:22.348394+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:48.695082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.354711+0000","last_change":"2024-09-21T03:20:22.352414+0000","last_active":"2024-09-21T03:20:22.354711+0000","last_peered":"2024-09-21T03:20:22.354711+0000","last_clean":"2024-09-21T03:20:22.354711+0000","last_became_active":"2024-09-21T03:20:22.352087+0000","last_became_peered":"2024-09-21T03:20:22.352087+0000","last_unstale":"2024-09-21T03:20:22.354711+0000","last_undegraded":"2024-09-21T03:20:22.354711+0000","last_fullsized":"2024-09-21T03:20:22.354711+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:15.584346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T03:20:21.364479+0000","last_change":"2024-09-21T03:20:21.361289+0000","last_active":"2024-09-21T03:20:21.364479+0000","last_peered":"2024-09-21T03:20:21.364479+0000","last_clean":"2024-09-21T03:20:21.364479+0000","last_became_active":"2024-09-21T03:20:21.360579+0000","last_became_peered":"2024-09-21T03:20:21.360579+0000","last_unstale":"2024-09-21T03:20:21.364479+0000","last_undegraded":"2024-09-21T03:20:21.364479+0000","last_fullsized":"2024-09-21T03:20:21.364479+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:48.365369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.361092+0000","last_change":"2024-09-21T03:20:22.363513+0000","last_active":"2024-09-21T03:20:23.361092+0000","last_peered":"2024-09-21T03:20:23.361092+0000","last_clean":"2024-09-21T03:20:23.361092+0000","last_became_active":"2024-09-21T03:20:22.362889+0000","last_became_peered":"2024-09-21T03:20:22.362889+0000","last_unstale":"2024-09-21T03:20:23.361092+0000","last_undegraded":"2024-09-21T03:20:23.361092+0000","last_fullsized":"2024-09-21T03:20:23.361092+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:44.768435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.360918+0000","last_change":"2024-09-21T03:20:21.354915+0000","last_active":"2024-09-21T03:20:23.360918+0000","last_peered":"2024-09-21T03:20:23.360918+0000","last_clean":"2024-09-21T03:20:23.360918+0000","last_became_active":"2024-09-21T03:20:21.354531+0000","last_became_peered":"2024-09-21T03:20:21.354531+0000","last_unstale":"2024-09-21T03:20:23.360918+0000","last_undegraded":"2024-09-21T03:20:23.360918+0000","last_fullsized":"2024-09-21T03:20:23.360918+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:46.767630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.349499+0000","last_change":"2024-09-21T03:20:21.349499+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.349499+0000","last_undegraded":"2024-09-21T03:20:21.349499+0000","last_fullsized":"2024-09-21T03:20:21.349499+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362997+0000","last_change":"2024-09-21T03:20:21.358123+0000","last_active":"2024-09-21T03:20:23.362997+0000","last_peered":"2024-09-21T03:20:23.362997+0000","last_clean":"2024-09-21T03:20:23.362997+0000","last_became_active":"2024-09-21T03:20:21.357694+0000","last_became_peered":"2024-09-21T03:20:21.357694+0000","last_unstale":"2024-09-21T03:20:23.362997+0000","last_undegraded":"2024-09-21T03:20:23.362997+0000","last_fullsized":"2024-09-21T03:20:23.362997+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:45.437208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362804+0000","last_change":"2024-09-21T03:20:22.354537+0000","last_active":"2024-09-21T03:20:23.362804+0000","last_peered":"2024-09-21T03:20:23.362804+0000","last_clean":"2024-09-21T03:20:23.362804+0000","last_became_active":"2024-09-21T03:20:22.354221+0000","last_became_peered":"2024-09-21T03:20:22.354221+0000","last_unstale":"2024-09-21T03:20:23.362804+0000","last_undegraded":"2024-09-21T03:20:23.362804+0000","last_fullsized":"2024-09-21T03:20:23.362804+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:33.384208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.373213+0000","last_change":"2024-09-21T03:20:21.360136+0000","last_active":"2024-09-21T03:20:22.373213+0000","last_peered":"2024-09-21T03:20:22.373213+0000","last_clean":"2024-09-21T03:20:22.373213+0000","last_became_active":"2024-09-21T03:20:21.359678+0000","last_became_peered":"2024-09-21T03:20:21.359678+0000","last_unstale":"2024-09-21T03:20:22.373213+0000","last_undegraded":"2024-09-21T03:20:22.373213+0000","last_fullsized":"2024-09-21T03:20:22.373213+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:44.853872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363330+0000","last_change":"2024-09-21T03:20:22.352124+0000","last_active":"2024-09-21T03:20:23.363330+0000","last_peered":"2024-09-21T03:20:23.363330+0000","last_clean":"2024-09-21T03:20:23.363330+0000","last_became_active":"2024-09-21T03:20:22.351748+0000","last_became_peered":"2024-09-21T03:20:22.351748+0000","last_unstale":"2024-09-21T03:20:23.363330+0000","last_undegraded":"2024-09-21T03:20:23.363330+0000","last_fullsized":"2024-09-21T03:20:23.363330+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:57.836459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.349625+0000","last_change":"2024-09-21T03:20:21.357025+0000","last_active":"2024-09-21T03:20:22.349625+0000","last_peered":"2024-09-21T03:20:22.349625+0000","last_clean":"2024-09-21T03:20:22.349625+0000","last_became_active":"2024-09-21T03:20:21.356647+0000","last_became_peered":"2024-09-21T03:20:21.356647+0000","last_unstale":"2024-09-21T03:20:22.349625+0000","last_undegraded":"2024-09-21T03:20:22.349625+0000","last_fullsized":"2024-09-21T03:20:22.349625+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:14.580199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.358586+0000","last_change":"2024-09-21T03:20:22.356328+0000","last_active":"2024-09-21T03:20:22.358586+0000","last_peered":"2024-09-21T03:20:22.358586+0000","last_clean":"2024-09-21T03:20:22.358586+0000","last_became_active":"2024-09-21T03:20:22.355690+0000","last_became_peered":"2024-09-21T03:20:22.355690+0000","last_unstale":"2024-09-21T03:20:22.358586+0000","last_undegraded":"2024-09-21T03:20:22.358586+0000","last_fullsized":"2024-09-21T03:20:22.358586+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:22.864214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.372211+0000","last_change":"2024-09-21T03:20:21.360457+0000","last_active":"2024-09-21T03:20:22.372211+0000","last_peered":"2024-09-21T03:20:22.372211+0000","last_clean":"2024-09-21T03:20:22.372211+0000","last_became_active":"2024-09-21T03:20:21.360158+0000","last_became_peered":"2024-09-21T03:20:21.360158+0000","last_unstale":"2024-09-21T03:20:22.372211+0000","last_undegraded":"2024-09-21T03:20:22.372211+0000","last_fullsized":"2024-09-21T03:20:22.372211+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:18.644256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.372779+0000","last_change":"2024-09-21T03:20:22.363703+0000","last_active":"2024-09-21T03:20:22.372779+0000","last_peered":"2024-09-21T03:20:22.372779+0000","last_clean":"2024-09-21T03:20:22.372779+0000","last_became_active":"2024-09-21T03:20:22.363365+0000","last_became_peered":"2024-09-21T03:20:22.363365+0000","last_unstale":"2024-09-21T03:20:22.372779+0000","last_undegraded":"2024-09-21T03:20:22.372779+0000","last_fullsized":"2024-09-21T03:20:22.372779+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:28.048269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.352743+0000","last_change":"2024-09-21T03:20:21.362530+0000","last_active":"2024-09-21T03:20:22.352743+0000","last_peered":"2024-09-21T03:20:22.352743+0000","last_clean":"2024-09-21T03:20:22.352743+0000","last_became_active":"2024-09-21T03:20:21.362236+0000","last_became_peered":"2024-09-21T03:20:21.362236+0000","last_unstale":"2024-09-21T03:20:22.352743+0000","last_undegraded":"2024-09-21T03:20:22.352743+0000","last_fullsized":"2024-09-21T03:20:22.352743+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:49.098519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.360903+0000","last_change":"2024-09-21T03:20:22.364758+0000","last_active":"2024-09-21T03:20:23.360903+0000","last_peered":"2024-09-21T03:20:23.360903+0000","last_clean":"2024-09-21T03:20:23.360903+0000","last_became_active":"2024-09-21T03:20:22.364448+0000","last_became_peered":"2024-09-21T03:20:22.364448+0000","last_unstale":"2024-09-21T03:20:23.360903+0000","last_undegraded":"2024-09-21T03:20:23.360903+0000","last_fullsized":"2024-09-21T03:20:23.360903+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:10.839820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T03:20:21.364449+0000","last_change":"2024-09-21T03:20:21.360800+0000","last_active":"2024-09-21T03:20:21.364449+0000","last_peered":"2024-09-21T03:20:21.364449+0000","last_clean":"2024-09-21T03:20:21.364449+0000","last_became_active":"2024-09-21T03:20:21.360480+0000","last_became_peered":"2024-09-21T03:20:21.360480+0000","last_unstale":"2024-09-21T03:20:21.364449+0000","last_undegraded":"2024-09-21T03:20:21.364449+0000","last_fullsized":"2024-09-21T03:20:21.364449+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:02.028522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.349234+0000","last_change":"2024-09-21T03:20:21.349234+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.349234+0000","last_undegraded":"2024-09-21T03:20:21.349234+0000","last_fullsized":"2024-09-21T03:20:21.349234+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.346096+0000","last_change":"2024-09-21T03:20:21.358799+0000","last_active":"2024-09-21T03:20:22.346096+0000","last_peered":"2024-09-21T03:20:22.346096+0000","last_clean":"2024-09-21T03:20:22.346096+0000","last_became_active":"2024-09-21T03:20:21.358305+0000","last_became_peered":"2024-09-21T03:20:21.358305+0000","last_unstale":"2024-09-21T03:20:22.346096+0000","last_undegraded":"2024-09-21T03:20:22.346096+0000","last_fullsized":"2024-09-21T03:20:22.346096+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:44.853872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363756+0000","last_change":"2024-09-21T03:20:22.365742+0000","last_active":"2024-09-21T03:20:23.363756+0000","last_peered":"2024-09-21T03:20:23.363756+0000","last_clean":"2024-09-21T03:20:23.363756+0000","last_became_active":"2024-09-21T03:20:22.365343+0000","last_became_peered":"2024-09-21T03:20:22.365343+0000","last_unstale":"2024-09-21T03:20:23.363756+0000","last_undegraded":"2024-09-21T03:20:23.363756+0000","last_fullsized":"2024-09-21T03:20:23.363756+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:07.319445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.349100+0000","last_change":"2024-09-21T03:20:21.361559+0000","last_active":"2024-09-21T03:20:22.349100+0000","last_peered":"2024-09-21T03:20:22.349100+0000","last_clean":"2024-09-21T03:20:22.349100+0000","last_became_active":"2024-09-21T03:20:21.361176+0000","last_became_peered":"2024-09-21T03:20:21.361176+0000","last_unstale":"2024-09-21T03:20:22.349100+0000","last_undegraded":"2024-09-21T03:20:22.349100+0000","last_fullsized":"2024-09-21T03:20:22.349100+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:33.367277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.347887+0000","last_change":"2024-09-21T03:20:21.347887+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.347887+0000","last_undegraded":"2024-09-21T03:20:21.347887+0000","last_fullsized":"2024-09-21T03:20:21.347887+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.347088+0000","last_change":"2024-09-21T03:20:21.361458+0000","last_active":"2024-09-21T03:20:22.347088+0000","last_peered":"2024-09-21T03:20:22.347088+0000","last_clean":"2024-09-21T03:20:22.347088+0000","last_became_active":"2024-09-21T03:20:21.360423+0000","last_became_peered":"2024-09-21T03:20:21.360423+0000","last_unstale":"2024-09-21T03:20:22.347088+0000","last_undegraded":"2024-09-21T03:20:22.347088+0000","last_fullsized":"2024-09-21T03:20:22.347088+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:07.239411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.360804+0000","last_change":"2024-09-21T03:20:22.357464+0000","last_active":"2024-09-21T03:20:22.360804+0000","last_peered":"2024-09-21T03:20:22.360804+0000","last_clean":"2024-09-21T03:20:22.360804+0000","last_became_active":"2024-09-21T03:20:22.356980+0000","last_became_peered":"2024-09-21T03:20:22.356980+0000","last_unstale":"2024-09-21T03:20:22.360804+0000","last_undegraded":"2024-09-21T03:20:22.360804+0000","last_fullsized":"2024-09-21T03:20:22.360804+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:11.740501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.348448+0000","last_change":"2024-09-21T03:20:21.363637+0000","last_active":"2024-09-21T03:20:22.348448+0000","last_peered":"2024-09-21T03:20:22.348448+0000","last_clean":"2024-09-21T03:20:22.348448+0000","last_became_active":"2024-09-21T03:20:21.363270+0000","last_became_peered":"2024-09-21T03:20:21.363270+0000","last_unstale":"2024-09-21T03:20:22.348448+0000","last_undegraded":"2024-09-21T03:20:22.348448+0000","last_fullsized":"2024-09-21T03:20:22.348448+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:52.543844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.358613+0000","last_change":"2024-09-21T03:20:22.357010+0000","last_active":"2024-09-21T03:20:22.358613+0000","last_peered":"2024-09-21T03:20:22.358613+0000","last_clean":"2024-09-21T03:20:22.358613+0000","last_became_active":"2024-09-21T03:20:22.356058+0000","last_became_peered":"2024-09-21T03:20:22.356058+0000","last_unstale":"2024-09-21T03:20:22.358613+0000","last_undegraded":"2024-09-21T03:20:22.358613+0000","last_fullsized":"2024-09-21T03:20:22.358613+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:13.722902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.346608+0000","last_change":"2024-09-21T03:20:21.363605+0000","last_active":"2024-09-21T03:20:22.346608+0000","last_peered":"2024-09-21T03:20:22.346608+0000","last_clean":"2024-09-21T03:20:22.346608+0000","last_became_active":"2024-09-21T03:20:21.361291+0000","last_became_peered":"2024-09-21T03:20:21.361291+0000","last_unstale":"2024-09-21T03:20:22.346608+0000","last_undegraded":"2024-09-21T03:20:22.346608+0000","last_fullsized":"2024-09-21T03:20:22.346608+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:48.695082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.364776+0000","last_change":"2024-09-21T03:20:22.360870+0000","last_active":"2024-09-21T03:20:22.364776+0000","last_peered":"2024-09-21T03:20:22.364776+0000","last_clean":"2024-09-21T03:20:22.364776+0000","last_became_active":"2024-09-21T03:20:22.360189+0000","last_became_peered":"2024-09-21T03:20:22.360189+0000","last_unstale":"2024-09-21T03:20:22.364776+0000","last_undegraded":"2024-09-21T03:20:22.364776+0000","last_fullsized":"2024-09-21T03:20:22.364776+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:37:46.822052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363116+0000","last_change":"2024-09-21T03:20:21.358394+0000","last_active":"2024-09-21T03:20:23.363116+0000","last_peered":"2024-09-21T03:20:23.363116+0000","last_clean":"2024-09-21T03:20:23.363116+0000","last_became_active":"2024-09-21T03:20:21.358059+0000","last_became_peered":"2024-09-21T03:20:21.358059+0000","last_unstale":"2024-09-21T03:20:23.363116+0000","last_undegraded":"2024-09-21T03:20:23.363116+0000","last_fullsized":"2024-09-21T03:20:23.363116+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:01.708297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.361245+0000","last_change":"2024-09-21T03:20:22.359249+0000","last_active":"2024-09-21T03:20:22.361245+0000","last_peered":"2024-09-21T03:20:22.361245+0000","last_clean":"2024-09-21T03:20:22.361245+0000","last_became_active":"2024-09-21T03:20:22.358932+0000","last_became_peered":"2024-09-21T03:20:22.358932+0000","last_unstale":"2024-09-21T03:20:22.361245+0000","last_undegraded":"2024-09-21T03:20:22.361245+0000","last_fullsized":"2024-09-21T03:20:22.361245+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:32.363099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.347743+0000","last_change":"2024-09-21T03:20:21.358386+0000","last_active":"2024-09-21T03:20:22.347743+0000","last_peered":"2024-09-21T03:20:22.347743+0000","last_clean":"2024-09-21T03:20:22.347743+0000","last_became_active":"2024-09-21T03:20:21.358025+0000","last_became_peered":"2024-09-21T03:20:21.358025+0000","last_unstale":"2024-09-21T03:20:22.347743+0000","last_undegraded":"2024-09-21T03:20:22.347743+0000","last_fullsized":"2024-09-21T03:20:22.347743+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:01.708297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362559+0000","last_change":"2024-09-21T03:20:22.356071+0000","last_active":"2024-09-21T03:20:23.362559+0000","last_peered":"2024-09-21T03:20:23.362559+0000","last_clean":"2024-09-21T03:20:23.362559+0000","last_became_active":"2024-09-21T03:20:22.355762+0000","last_became_peered":"2024-09-21T03:20:22.355762+0000","last_unstale":"2024-09-21T03:20:23.362559+0000","last_undegraded":"2024-09-21T03:20:23.362559+0000","last_fullsized":"2024-09-21T03:20:23.362559+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:02.155154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-21T03:20:21.366858+0000","last_change":"2024-09-21T03:20:21.362237+0000","last_active":"2024-09-21T03:20:21.366858+0000","last_peered":"2024-09-21T03:20:21.366858+0000","last_clean":"2024-09-21T03:20:21.366858+0000","last_became_active":"2024-09-21T03:20:21.361975+0000","last_became_peered":"2024-09-21T03:20:21.361975+0000","last_unstale":"2024-09-21T03:20:21.366858+0000","last_undegraded":"2024-09-21T03:20:21.366858+0000","last_fullsized":"2024-09-21T03:20:21.366858+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:23.035864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-21T03:20:21.351895+0000","last_change":"2024-09-21T03:20:21.351895+0000","last_active":"2024-09-21T03:20:21.331720+0000","last_peered":"2024-09-21T03:20:21.331720+0000","last_clean":"2024-09-21T03:20:21.331720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:21.351895+0000","last_undegraded":"2024-09-21T03:20:21.351895+0000","last_fullsized":"2024-09-21T03:20:21.351895+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.374031+0000","last_change":"2024-09-21T03:20:21.361255+0000","last_active":"2024-09-21T03:20:22.374031+0000","last_peered":"2024-09-21T03:20:22.374031+0000","last_clean":"2024-09-21T03:20:22.374031+0000","last_became_active":"2024-09-21T03:20:21.360928+0000","last_became_peered":"2024-09-21T03:20:21.360928+0000","last_unstale":"2024-09-21T03:20:22.374031+0000","last_undegraded":"2024-09-21T03:20:22.374031+0000","last_fullsized":"2024-09-21T03:20:22.374031+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:33.367277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":151,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.346239+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:20:22.346239+0000","last_peered":"2024-09-21T03:20:22.346239+0000","last_clean":"2024-09-21T03:20:22.346239+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:20:22.346239+0000","last_undegraded":"2024-09-21T03:20:22.346239+0000","last_fullsized":"2024-09-21T03:20:22.346239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509470,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28112,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343728,"statfs":{"total":96636764160,"available":96607977472,"internally_reserved":0,"allocated":1105920,"data_stored":791777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509469,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27544,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":528384,"data_stored":208291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509468,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":512000,"data_stored":201389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509468,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":532480,"data_stored":209231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509469,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31700,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340140,"statfs":{"total":96636764160,"available":96604303360,"internally_reserved":0,"allocated":520192,"data_stored":201957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":524288,"data_stored":202953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509469,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":512000,"data_stored":201389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1077248,"data_stored":778645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:20:27.152 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3c is not active+clean 2024-09-21T03:20:27.152 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:20:21.348358+0000', 'last_change': '2024-09-21T03:20:21.348358+0000', 'last_active': '2024-09-21T03:20:21.331720+0000', 'last_peered': '2024-09-21T03:20:21.331720+0000', 'last_clean': '2024-09-21T03:20:21.331720+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:20:21.348358+0000', 'last_undegraded': '2024-09-21T03:20:21.348358+0000', 'last_fullsized': '2024-09-21T03:20:21.348358+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'last_clean_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:20:27.152 INFO:tasks.ceph.ceph_manager.ceph:PG 7.38 is not active+clean 2024-09-21T03:20:27.152 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:20:21.351127+0000', 'last_change': '2024-09-21T03:20:21.351127+0000', 'last_active': '2024-09-21T03:20:21.331720+0000', 'last_peered': '2024-09-21T03:20:21.331720+0000', 'last_clean': '2024-09-21T03:20:21.331720+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:20:21.351127+0000', 'last_undegraded': '2024-09-21T03:20:21.351127+0000', 'last_fullsized': '2024-09-21T03:20:21.351127+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'last_clean_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:20:27.152 INFO:tasks.ceph.ceph_manager.ceph:PG 7.37 is not active+clean 2024-09-21T03:20:27.152 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:20:21.351434+0000', 'last_change': '2024-09-21T03:20:21.351434+0000', 'last_active': '2024-09-21T03:20:21.331720+0000', 'last_peered': '2024-09-21T03:20:21.331720+0000', 'last_clean': '2024-09-21T03:20:21.331720+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:20:21.351434+0000', 'last_undegraded': '2024-09-21T03:20:21.351434+0000', 'last_fullsized': '2024-09-21T03:20:21.351434+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'last_clean_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:20:27.153 INFO:tasks.ceph.ceph_manager.ceph:PG 7.36 is not active+clean 2024-09-21T03:20:27.153 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:20:21.353175+0000', 'last_change': '2024-09-21T03:20:21.353175+0000', 'last_active': '2024-09-21T03:20:21.331720+0000', 'last_peered': '2024-09-21T03:20:21.331720+0000', 'last_clean': '2024-09-21T03:20:21.331720+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:20:21.353175+0000', 'last_undegraded': '2024-09-21T03:20:21.353175+0000', 'last_fullsized': '2024-09-21T03:20:21.353175+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'last_clean_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:20:27.153 INFO:tasks.ceph.ceph_manager.ceph:PG 7.35 is not active+clean 2024-09-21T03:20:27.153 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:20:21.349066+0000', 'last_change': '2024-09-21T03:20:21.349066+0000', 'last_active': '2024-09-21T03:20:21.331720+0000', 'last_peered': '2024-09-21T03:20:21.331720+0000', 'last_clean': '2024-09-21T03:20:21.331720+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:20:21.349066+0000', 'last_undegraded': '2024-09-21T03:20:21.349066+0000', 'last_fullsized': '2024-09-21T03:20:21.349066+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'last_clean_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:20:27.153 INFO:tasks.ceph.ceph_manager.ceph:PG 7.32 is not active+clean 2024-09-21T03:20:27.153 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:20:21.347383+0000', 'last_change': '2024-09-21T03:20:21.347383+0000', 'last_active': '2024-09-21T03:20:21.331720+0000', 'last_peered': '2024-09-21T03:20:21.331720+0000', 'last_clean': '2024-09-21T03:20:21.331720+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:20:21.347383+0000', 'last_undegraded': '2024-09-21T03:20:21.347383+0000', 'last_fullsized': '2024-09-21T03:20:21.347383+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'last_clean_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:20:27.153 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2a is not active+clean 2024-09-21T03:20:27.153 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:20:21.346857+0000', 'last_change': '2024-09-21T03:20:21.346857+0000', 'last_active': '2024-09-21T03:20:21.331720+0000', 'last_peered': '2024-09-21T03:20:21.331720+0000', 'last_clean': '2024-09-21T03:20:21.331720+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:20:21.346857+0000', 'last_undegraded': '2024-09-21T03:20:21.346857+0000', 'last_fullsized': '2024-09-21T03:20:21.346857+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'last_clean_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:20:27.153 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1b is not active+clean 2024-09-21T03:20:27.153 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:20:21.350317+0000', 'last_change': '2024-09-21T03:20:21.350317+0000', 'last_active': '2024-09-21T03:20:21.331720+0000', 'last_peered': '2024-09-21T03:20:21.331720+0000', 'last_clean': '2024-09-21T03:20:21.331720+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:20:21.350317+0000', 'last_undegraded': '2024-09-21T03:20:21.350317+0000', 'last_fullsized': '2024-09-21T03:20:21.350317+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'last_clean_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:20:27.153 INFO:tasks.ceph.ceph_manager.ceph:PG 7.18 is not active+clean 2024-09-21T03:20:27.154 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:20:21.350681+0000', 'last_change': '2024-09-21T03:20:21.350681+0000', 'last_active': '2024-09-21T03:20:21.331720+0000', 'last_peered': '2024-09-21T03:20:21.331720+0000', 'last_clean': '2024-09-21T03:20:21.331720+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:20:21.350681+0000', 'last_undegraded': '2024-09-21T03:20:21.350681+0000', 'last_fullsized': '2024-09-21T03:20:21.350681+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'last_clean_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:20:27.154 INFO:tasks.ceph.ceph_manager.ceph:PG 7.13 is not active+clean 2024-09-21T03:20:27.154 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:20:21.349866+0000', 'last_change': '2024-09-21T03:20:21.349866+0000', 'last_active': '2024-09-21T03:20:21.331720+0000', 'last_peered': '2024-09-21T03:20:21.331720+0000', 'last_clean': '2024-09-21T03:20:21.331720+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:20:21.349866+0000', 'last_undegraded': '2024-09-21T03:20:21.349866+0000', 'last_fullsized': '2024-09-21T03:20:21.349866+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'last_clean_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:20:27.154 INFO:tasks.ceph.ceph_manager.ceph:PG 7.f is not active+clean 2024-09-21T03:20:27.154 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:20:21.349499+0000', 'last_change': '2024-09-21T03:20:21.349499+0000', 'last_active': '2024-09-21T03:20:21.331720+0000', 'last_peered': '2024-09-21T03:20:21.331720+0000', 'last_clean': '2024-09-21T03:20:21.331720+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:20:21.349499+0000', 'last_undegraded': '2024-09-21T03:20:21.349499+0000', 'last_fullsized': '2024-09-21T03:20:21.349499+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'last_clean_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:20:27.154 INFO:tasks.ceph.ceph_manager.ceph:PG 7.9 is not active+clean 2024-09-21T03:20:27.154 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:20:21.349234+0000', 'last_change': '2024-09-21T03:20:21.349234+0000', 'last_active': '2024-09-21T03:20:21.331720+0000', 'last_peered': '2024-09-21T03:20:21.331720+0000', 'last_clean': '2024-09-21T03:20:21.331720+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:20:21.349234+0000', 'last_undegraded': '2024-09-21T03:20:21.349234+0000', 'last_fullsized': '2024-09-21T03:20:21.349234+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'last_clean_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:20:27.154 INFO:tasks.ceph.ceph_manager.ceph:PG 7.4 is not active+clean 2024-09-21T03:20:27.154 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:20:21.347887+0000', 'last_change': '2024-09-21T03:20:21.347887+0000', 'last_active': '2024-09-21T03:20:21.331720+0000', 'last_peered': '2024-09-21T03:20:21.331720+0000', 'last_clean': '2024-09-21T03:20:21.331720+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:20:21.347887+0000', 'last_undegraded': '2024-09-21T03:20:21.347887+0000', 'last_fullsized': '2024-09-21T03:20:21.347887+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'last_clean_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:20:27.154 INFO:tasks.ceph.ceph_manager.ceph:PG 7.6 is not active+clean 2024-09-21T03:20:27.154 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:20:21.351895+0000', 'last_change': '2024-09-21T03:20:21.351895+0000', 'last_active': '2024-09-21T03:20:21.331720+0000', 'last_peered': '2024-09-21T03:20:21.331720+0000', 'last_clean': '2024-09-21T03:20:21.331720+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:20:21.351895+0000', 'last_undegraded': '2024-09-21T03:20:21.351895+0000', 'last_fullsized': '2024-09-21T03:20:21.351895+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'last_clean_scrub_stamp': '2024-09-21T03:20:21.331720+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:20:27.155 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T03:20:27.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.300+0000 7f3d4b30b640 1 -- 172.21.15.105:0/1108607813 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d30003a30 msgr2=0x7f3d30003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:27.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.300+0000 7f3d4b30b640 1 --2- 172.21.15.105:0/1108607813 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d30003a30 0x7f3d30003ea0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f3d4000c290 tx=0x7f3d30005830 comp rx=0 tx=0).stop 2024-09-21T03:20:27.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.300+0000 7f3d498a8640 1 -- 172.21.15.105:0/1108607813 reap_dead start 2024-09-21T03:20:27.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.300+0000 7f3d4b30b640 1 -- 172.21.15.105:0/1108607813 shutdown_connections 2024-09-21T03:20:27.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.300+0000 7f3d4b30b640 1 -- 172.21.15.105:0/1108607813 >> 172.21.15.105:0/1108607813 conn(0x7f3d44072ae0 msgr2=0x7f3d44072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:27.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.300+0000 7f3d4b30b640 1 -- 172.21.15.105:0/1108607813 shutdown_connections 2024-09-21T03:20:27.303 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.300+0000 7f3d4b30b640 1 -- 172.21.15.105:0/1108607813 wait complete. 2024-09-21T03:20:27.303 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.302+0000 7f3d4b30b640 1 Processor -- start 2024-09-21T03:20:27.304 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.302+0000 7f3d4b30b640 1 -- start start 2024-09-21T03:20:27.309 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.303+0000 7f3d4b30b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d30003a30 0x7f3d441505c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:27.309 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.303+0000 7f3d4b30b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d4415ad20 0x7f3d44164530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:27.309 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.303+0000 7f3d4b30b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d44164a70 0x7f3d441f5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:27.309 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.303+0000 7f3d4b30b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3d441656d0 con 0x7f3d4415ad20 2024-09-21T03:20:27.309 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.303+0000 7f3d4b30b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3d440d1b40 con 0x7f3d30003a30 2024-09-21T03:20:27.309 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.303+0000 7f3d4b30b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3d44165850 con 0x7f3d44164a70 2024-09-21T03:20:27.310 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.303+0000 7f3d488a6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d4415ad20 0x7f3d44164530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:27.310 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.303+0000 7f3d488a6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d4415ad20 0x7f3d44164530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:57946/0 (socket says 172.21.15.105:57946) 2024-09-21T03:20:27.310 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.303+0000 7f3d488a6640 1 -- 172.21.15.105:0/2520593744 learned_addr learned my addr 172.21.15.105:0/2520593744 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:27.310 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.303+0000 7f3d490a7640 1 --2- 172.21.15.105:0/2520593744 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d30003a30 0x7f3d441505c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:27.310 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.303+0000 7f3d498a8640 1 --2- 172.21.15.105:0/2520593744 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d44164a70 0x7f3d441f5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:27.310 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.304+0000 7f3d488a6640 1 -- 172.21.15.105:0/2520593744 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d44164a70 msgr2=0x7f3d441f5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:27.310 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.304+0000 7f3d488a6640 1 --2- 172.21.15.105:0/2520593744 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d44164a70 0x7f3d441f5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:27.310 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.304+0000 7f3d488a6640 1 -- 172.21.15.105:0/2520593744 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d30003a30 msgr2=0x7f3d441505c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:27.310 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.304+0000 7f3d488a6640 1 --2- 172.21.15.105:0/2520593744 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d30003a30 0x7f3d441505c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:27.310 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.304+0000 7f3d488a6640 1 -- 172.21.15.105:0/2520593744 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d44164e80 con 0x7f3d4415ad20 2024-09-21T03:20:27.310 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.304+0000 7f3d488a6640 1 --2- 172.21.15.105:0/2520593744 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d4415ad20 0x7f3d44164530 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3d34004e20 tx=0x7f3d34001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:27.310 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.304+0000 7f3d39ffb640 1 -- 172.21.15.105:0/2520593744 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d340107d0 con 0x7f3d4415ad20 2024-09-21T03:20:27.310 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.304+0000 7f3d39ffb640 1 -- 172.21.15.105:0/2520593744 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d34016070 con 0x7f3d4415ad20 2024-09-21T03:20:27.311 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.304+0000 7f3d39ffb640 1 -- 172.21.15.105:0/2520593744 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d34010c60 con 0x7f3d4415ad20 2024-09-21T03:20:27.311 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.304+0000 7f3d4b30b640 1 -- 172.21.15.105:0/2520593744 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d441f9a20 con 0x7f3d4415ad20 2024-09-21T03:20:27.311 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.304+0000 7f3d4b30b640 1 -- 172.21.15.105:0/2520593744 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d441f8f40 con 0x7f3d4415ad20 2024-09-21T03:20:27.311 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.305+0000 7f3d4b30b640 1 -- 172.21.15.105:0/2520593744 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d44151e70 con 0x7f3d4415ad20 2024-09-21T03:20:27.311 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.306+0000 7f3d39ffb640 1 -- 172.21.15.105:0/2520593744 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3d3401b460 con 0x7f3d4415ad20 2024-09-21T03:20:27.311 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.306+0000 7f3d39ffb640 1 --2- 172.21.15.105:0/2520593744 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3d28078b90 0x7f3d2807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:27.311 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.306+0000 7f3d39ffb640 1 -- 172.21.15.105:0/2520593744 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f3d3409b480 con 0x7f3d4415ad20 2024-09-21T03:20:27.311 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.306+0000 7f3d490a7640 1 --2- 172.21.15.105:0/2520593744 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3d28078b90 0x7f3d2807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:27.311 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.307+0000 7f3d490a7640 1 --2- 172.21.15.105:0/2520593744 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3d28078b90 0x7f3d2807b0a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3d40033000 tx=0x7f3d40038040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:27.312 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.311+0000 7f3d39ffb640 1 -- 172.21.15.105:0/2520593744 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3d44164e80 con 0x7f3d4415ad20 2024-09-21T03:20:27.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.559+0000 7f3d4b30b640 1 -- 172.21.15.105:0/2520593744 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f3d4415c6e0 con 0x7f3d4415ad20 2024-09-21T03:20:27.561 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.559+0000 7f3d39ffb640 1 -- 172.21.15.105:0/2520593744 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1216 (secure 0 0 0) 0x7f3d340638c0 con 0x7f3d4415ad20 2024-09-21T03:20:27.561 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:20:27.561 INFO:teuthology.orchestra.run.smithi105.stdout:{"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":142,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":45,"num_osds":8,"num_up_osds":8,"osd_up_since":1726888698,"num_in_osds":8,"osd_in_since":1726888688,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":235302912,"bytes_avail":772858810368,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":25,"btime":"2024-09-21T03:20:25:364985+0000","id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5301}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-09-21T03:20:07.304558+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T03:20:27.563 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.561+0000 7f3d4b30b640 1 -- 172.21.15.105:0/2520593744 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3d28078b90 msgr2=0x7f3d2807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:27.563 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.561+0000 7f3d4b30b640 1 --2- 172.21.15.105:0/2520593744 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3d28078b90 0x7f3d2807b0a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3d40033000 tx=0x7f3d40038040 comp rx=0 tx=0).stop 2024-09-21T03:20:27.563 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.561+0000 7f3d4b30b640 1 -- 172.21.15.105:0/2520593744 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d4415ad20 msgr2=0x7f3d44164530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:27.563 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.561+0000 7f3d4b30b640 1 --2- 172.21.15.105:0/2520593744 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d4415ad20 0x7f3d44164530 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3d34004e20 tx=0x7f3d34001630 comp rx=0 tx=0).stop 2024-09-21T03:20:27.563 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.561+0000 7f3d4b30b640 1 -- 172.21.15.105:0/2520593744 shutdown_connections 2024-09-21T03:20:27.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.561+0000 7f3d4b30b640 1 --2- 172.21.15.105:0/2520593744 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3d28078b90 0x7f3d2807b0a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:27.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.561+0000 7f3d4b30b640 1 --2- 172.21.15.105:0/2520593744 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d44164a70 0x7f3d441f5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:27.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.561+0000 7f3d4b30b640 1 --2- 172.21.15.105:0/2520593744 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d4415ad20 0x7f3d44164530 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:27.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.561+0000 7f3d4b30b640 1 --2- 172.21.15.105:0/2520593744 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d30003a30 0x7f3d441505c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:27.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.561+0000 7f3d4b30b640 1 -- 172.21.15.105:0/2520593744 >> 172.21.15.105:0/2520593744 conn(0x7f3d44072ae0 msgr2=0x7f3d440b6100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:27.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.562+0000 7f3d4b30b640 1 -- 172.21.15.105:0/2520593744 shutdown_connections 2024-09-21T03:20:27.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.562+0000 7f3d4b30b640 1 -- 172.21.15.105:0/2520593744 wait complete. 2024-09-21T03:20:27.574 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-21T03:20:27.574 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:20:27.686 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.684+0000 7fe11201f640 1 -- 172.21.15.105:0/2750417751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe10c0d16c0 msgr2=0x7fe10c0cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:27.686 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.684+0000 7fe11201f640 1 --2- 172.21.15.105:0/2750417751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe10c0d16c0 0x7fe10c0cf310 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fe100005fd0 tx=0x7fe10002a4a0 comp rx=0 tx=0).stop 2024-09-21T03:20:27.686 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.684+0000 7fe11201f640 1 -- 172.21.15.105:0/2750417751 shutdown_connections 2024-09-21T03:20:27.686 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.684+0000 7fe11201f640 1 --2- 172.21.15.105:0/2750417751 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe10c0b3a10 0x7fe10c0cf850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:27.686 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.684+0000 7fe11201f640 1 --2- 172.21.15.105:0/2750417751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe10c0d16c0 0x7fe10c0cf310 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:27.686 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.684+0000 7fe11201f640 1 -- 172.21.15.105:0/2750417751 >> 172.21.15.105:0/2750417751 conn(0x7fe10c09d8f0 msgr2=0x7fe10c0d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:27.687 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.684+0000 7fe11201f640 1 -- 172.21.15.105:0/2750417751 shutdown_connections 2024-09-21T03:20:27.687 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.684+0000 7fe11201f640 1 -- 172.21.15.105:0/2750417751 wait complete. 2024-09-21T03:20:27.687 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.686+0000 7fe11201f640 1 Processor -- start 2024-09-21T03:20:27.687 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.686+0000 7fe11201f640 1 -- start start 2024-09-21T03:20:27.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.687+0000 7fe11201f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe10c0b3a10 0x7fe10c0c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:27.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.687+0000 7fe11201f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe10c0b9b60 0x7fe10c143040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:27.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.687+0000 7fe11201f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe10c143580 0x7fe10c143990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:27.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.687+0000 7fe11201f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe10c0d0120 con 0x7fe10c0b9b60 2024-09-21T03:20:27.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.687+0000 7fe11201f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe10c0cffa0 con 0x7fe10c0b3a10 2024-09-21T03:20:27.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.687+0000 7fe11201f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe10c0d02a0 con 0x7fe10c143580 2024-09-21T03:20:27.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.687+0000 7fe10affd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe10c0b9b60 0x7fe10c143040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:27.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.687+0000 7fe10affd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe10c0b9b60 0x7fe10c143040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:57962/0 (socket says 172.21.15.105:57962) 2024-09-21T03:20:27.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.687+0000 7fe10affd640 1 -- 172.21.15.105:0/1011293443 learned_addr learned my addr 172.21.15.105:0/1011293443 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:27.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.688+0000 7fe10bfff640 1 --2- 172.21.15.105:0/1011293443 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe10c143580 0x7fe10c143990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:27.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.688+0000 7fe10b7fe640 1 --2- 172.21.15.105:0/1011293443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe10c0b3a10 0x7fe10c0c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:27.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.688+0000 7fe10affd640 1 -- 172.21.15.105:0/1011293443 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe10c143580 msgr2=0x7fe10c143990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:27.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.688+0000 7fe10affd640 1 --2- 172.21.15.105:0/1011293443 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe10c143580 0x7fe10c143990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:27.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.688+0000 7fe10affd640 1 -- 172.21.15.105:0/1011293443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe10c0b3a10 msgr2=0x7fe10c0c8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:27.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.688+0000 7fe10affd640 1 --2- 172.21.15.105:0/1011293443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe10c0b3a10 0x7fe10c0c8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:27.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.688+0000 7fe10affd640 1 -- 172.21.15.105:0/1011293443 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe10c152020 con 0x7fe10c0b9b60 2024-09-21T03:20:27.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.688+0000 7fe10bfff640 1 --2- 172.21.15.105:0/1011293443 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe10c143580 0x7fe10c143990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:20:27.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.688+0000 7fe10b7fe640 1 --2- 172.21.15.105:0/1011293443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe10c0b3a10 0x7fe10c0c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:20:27.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.688+0000 7fe10affd640 1 --2- 172.21.15.105:0/1011293443 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe10c0b9b60 0x7fe10c143040 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe100034040 tx=0x7fe1000039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:27.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.688+0000 7fe0f3fff640 1 -- 172.21.15.105:0/1011293443 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10003e030 con 0x7fe10c0b9b60 2024-09-21T03:20:27.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.688+0000 7fe0f3fff640 1 -- 172.21.15.105:0/1011293443 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1000047a0 con 0x7fe10c0b9b60 2024-09-21T03:20:27.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.688+0000 7fe11201f640 1 -- 172.21.15.105:0/1011293443 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe10c152300 con 0x7fe10c0b9b60 2024-09-21T03:20:27.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.688+0000 7fe0f3fff640 1 -- 172.21.15.105:0/1011293443 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe100035040 con 0x7fe10c0b9b60 2024-09-21T03:20:27.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.688+0000 7fe11201f640 1 -- 172.21.15.105:0/1011293443 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe10c1528c0 con 0x7fe10c0b9b60 2024-09-21T03:20:27.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.689+0000 7fe11201f640 1 -- 172.21.15.105:0/1011293443 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe10c151d90 con 0x7fe10c0b9b60 2024-09-21T03:20:27.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.690+0000 7fe0f3fff640 1 -- 172.21.15.105:0/1011293443 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe100041030 con 0x7fe10c0b9b60 2024-09-21T03:20:27.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.690+0000 7fe0f3fff640 1 --2- 172.21.15.105:0/1011293443 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe0f8078b90 0x7fe0f807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:27.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.691+0000 7fe0f3fff640 1 -- 172.21.15.105:0/1011293443 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fe1000bb680 con 0x7fe10c0b9b60 2024-09-21T03:20:27.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.691+0000 7fe10b7fe640 1 --2- 172.21.15.105:0/1011293443 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe0f8078b90 0x7fe0f807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:27.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.691+0000 7fe10b7fe640 1 --2- 172.21.15.105:0/1011293443 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe0f8078b90 0x7fe0f807b0a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc00a810 tx=0x7fe0fc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:27.696 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.695+0000 7fe0f3fff640 1 -- 172.21.15.105:0/1011293443 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe100083ac0 con 0x7fe10c0b9b60 2024-09-21T03:20:27.870 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.869+0000 7fe11201f640 1 -- 172.21.15.105:0/1011293443 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe10c0cf310 con 0x7fe0f8078b90 2024-09-21T03:20:27.875 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.874+0000 7fe0f3fff640 1 -- 172.21.15.105:0/1011293443 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251945 (secure 0 0 0) 0x7fe10c0cf310 con 0x7fe0f8078b90 2024-09-21T03:20:27.878 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:20:27.879 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:20:27.880 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.877+0000 7fe11201f640 1 -- 172.21.15.105:0/1011293443 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe0f8078b90 msgr2=0x7fe0f807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:27.881 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.877+0000 7fe11201f640 1 --2- 172.21.15.105:0/1011293443 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe0f8078b90 0x7fe0f807b0a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc00a810 tx=0x7fe0fc008040 comp rx=0 tx=0).stop 2024-09-21T03:20:27.881 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.877+0000 7fe11201f640 1 -- 172.21.15.105:0/1011293443 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe10c0b9b60 msgr2=0x7fe10c143040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:27.881 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.877+0000 7fe11201f640 1 --2- 172.21.15.105:0/1011293443 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe10c0b9b60 0x7fe10c143040 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe100034040 tx=0x7fe1000039e0 comp rx=0 tx=0).stop 2024-09-21T03:20:27.881 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.877+0000 7fe11201f640 1 -- 172.21.15.105:0/1011293443 shutdown_connections 2024-09-21T03:20:27.881 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.877+0000 7fe11201f640 1 --2- 172.21.15.105:0/1011293443 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe0f8078b90 0x7fe0f807b0a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:27.881 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.877+0000 7fe11201f640 1 --2- 172.21.15.105:0/1011293443 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe10c143580 0x7fe10c143990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:27.881 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.877+0000 7fe11201f640 1 --2- 172.21.15.105:0/1011293443 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe10c0b9b60 0x7fe10c143040 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:27.881 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.877+0000 7fe11201f640 1 --2- 172.21.15.105:0/1011293443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe10c0b3a10 0x7fe10c0c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:27.881 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.877+0000 7fe11201f640 1 -- 172.21.15.105:0/1011293443 >> 172.21.15.105:0/1011293443 conn(0x7fe10c09d8f0 msgr2=0x7fe10c0d2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:27.881 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.877+0000 7fe11201f640 1 -- 172.21.15.105:0/1011293443 shutdown_connections 2024-09-21T03:20:27.881 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:27.877+0000 7fe11201f640 1 -- 172.21.15.105:0/1011293443 wait complete. 2024-09-21T03:20:27.890 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2024-09-21T03:20:27.309468+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":142,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229788,"kb_used_data":5228,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744932,"statfs":{"total":773094113280,"available":772858810368,"internally_reserved":0,"allocated":5353472,"data_stored":2815008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001485"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.360568+0000","last_change":"2024-09-21T03:20:22.354648+0000","last_active":"2024-09-21T03:20:22.360568+0000","last_peered":"2024-09-21T03:20:22.360568+0000","last_clean":"2024-09-21T03:20:22.360568+0000","last_became_active":"2024-09-21T03:20:22.354279+0000","last_became_peered":"2024-09-21T03:20:22.354279+0000","last_unstale":"2024-09-21T03:20:22.360568+0000","last_undegraded":"2024-09-21T03:20:22.360568+0000","last_fullsized":"2024-09-21T03:20:22.360568+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:22.864214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.365953+0000","last_change":"2024-09-21T03:20:22.363925+0000","last_active":"2024-09-21T03:20:22.365953+0000","last_peered":"2024-09-21T03:20:22.365953+0000","last_clean":"2024-09-21T03:20:22.365953+0000","last_became_active":"2024-09-21T03:20:22.363588+0000","last_became_peered":"2024-09-21T03:20:22.363588+0000","last_unstale":"2024-09-21T03:20:22.365953+0000","last_undegraded":"2024-09-21T03:20:22.365953+0000","last_fullsized":"2024-09-21T03:20:22.365953+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:15.584346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362247+0000","last_change":"2024-09-21T03:20:22.356946+0000","last_active":"2024-09-21T03:20:23.362247+0000","last_peered":"2024-09-21T03:20:23.362247+0000","last_clean":"2024-09-21T03:20:23.362247+0000","last_became_active":"2024-09-21T03:20:22.356625+0000","last_became_peered":"2024-09-21T03:20:22.356625+0000","last_unstale":"2024-09-21T03:20:23.362247+0000","last_undegraded":"2024-09-21T03:20:23.362247+0000","last_fullsized":"2024-09-21T03:20:23.362247+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:24.993031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.791950+0000","last_change":"2024-09-21T03:20:22.370209+0000","last_active":"2024-09-21T03:20:23.791950+0000","last_peered":"2024-09-21T03:20:23.791950+0000","last_clean":"2024-09-21T03:20:23.791950+0000","last_became_active":"2024-09-21T03:20:22.369891+0000","last_became_peered":"2024-09-21T03:20:22.369891+0000","last_unstale":"2024-09-21T03:20:23.791950+0000","last_undegraded":"2024-09-21T03:20:23.791950+0000","last_fullsized":"2024-09-21T03:20:23.791950+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:31:34.747739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.371612+0000","last_change":"2024-09-21T03:20:22.368074+0000","last_active":"2024-09-21T03:20:22.371612+0000","last_peered":"2024-09-21T03:20:22.371612+0000","last_clean":"2024-09-21T03:20:22.371612+0000","last_became_active":"2024-09-21T03:20:22.367712+0000","last_became_peered":"2024-09-21T03:20:22.367712+0000","last_unstale":"2024-09-21T03:20:22.371612+0000","last_undegraded":"2024-09-21T03:20:22.371612+0000","last_fullsized":"2024-09-21T03:20:22.371612+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:19.648403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.358636+0000","last_change":"2024-09-21T03:20:22.357312+0000","last_active":"2024-09-21T03:20:22.358636+0000","last_peered":"2024-09-21T03:20:22.358636+0000","last_clean":"2024-09-21T03:20:22.358636+0000","last_became_active":"2024-09-21T03:20:22.356723+0000","last_became_peered":"2024-09-21T03:20:22.356723+0000","last_unstale":"2024-09-21T03:20:22.358636+0000","last_undegraded":"2024-09-21T03:20:22.358636+0000","last_fullsized":"2024-09-21T03:20:22.358636+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:11.740501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.360735+0000","last_change":"2024-09-21T03:20:22.354451+0000","last_active":"2024-09-21T03:20:22.360735+0000","last_peered":"2024-09-21T03:20:22.360735+0000","last_clean":"2024-09-21T03:20:22.360735+0000","last_became_active":"2024-09-21T03:20:22.354036+0000","last_became_peered":"2024-09-21T03:20:22.354036+0000","last_unstale":"2024-09-21T03:20:22.360735+0000","last_undegraded":"2024-09-21T03:20:22.360735+0000","last_fullsized":"2024-09-21T03:20:22.360735+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:19.648403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.792056+0000","last_change":"2024-09-21T03:20:22.370356+0000","last_active":"2024-09-21T03:20:23.792056+0000","last_peered":"2024-09-21T03:20:23.792056+0000","last_clean":"2024-09-21T03:20:23.792056+0000","last_became_active":"2024-09-21T03:20:22.370057+0000","last_became_peered":"2024-09-21T03:20:22.370057+0000","last_unstale":"2024-09-21T03:20:23.792056+0000","last_undegraded":"2024-09-21T03:20:23.792056+0000","last_fullsized":"2024-09-21T03:20:23.792056+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:19:16.451895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.791932+0000","last_change":"2024-09-21T03:20:22.375061+0000","last_active":"2024-09-21T03:20:23.791932+0000","last_peered":"2024-09-21T03:20:23.791932+0000","last_clean":"2024-09-21T03:20:23.791932+0000","last_became_active":"2024-09-21T03:20:22.374755+0000","last_became_peered":"2024-09-21T03:20:22.374755+0000","last_unstale":"2024-09-21T03:20:23.791932+0000","last_undegraded":"2024-09-21T03:20:23.791932+0000","last_fullsized":"2024-09-21T03:20:23.791932+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:42.265030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.792274+0000","last_change":"2024-09-21T03:20:22.374096+0000","last_active":"2024-09-21T03:20:23.792274+0000","last_peered":"2024-09-21T03:20:23.792274+0000","last_clean":"2024-09-21T03:20:23.792274+0000","last_became_active":"2024-09-21T03:20:22.373513+0000","last_became_peered":"2024-09-21T03:20:22.373513+0000","last_unstale":"2024-09-21T03:20:23.792274+0000","last_undegraded":"2024-09-21T03:20:23.792274+0000","last_fullsized":"2024-09-21T03:20:23.792274+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:12.559413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.792003+0000","last_change":"2024-09-21T03:20:22.366527+0000","last_active":"2024-09-21T03:20:23.792003+0000","last_peered":"2024-09-21T03:20:23.792003+0000","last_clean":"2024-09-21T03:20:23.792003+0000","last_became_active":"2024-09-21T03:20:22.366208+0000","last_became_peered":"2024-09-21T03:20:22.366208+0000","last_unstale":"2024-09-21T03:20:23.792003+0000","last_undegraded":"2024-09-21T03:20:23.792003+0000","last_fullsized":"2024-09-21T03:20:23.792003+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:26.097239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.362804+0000","last_change":"2024-09-21T03:20:22.361976+0000","last_active":"2024-09-21T03:20:22.362804+0000","last_peered":"2024-09-21T03:20:22.362804+0000","last_clean":"2024-09-21T03:20:22.362804+0000","last_became_active":"2024-09-21T03:20:22.361662+0000","last_became_peered":"2024-09-21T03:20:22.361662+0000","last_unstale":"2024-09-21T03:20:22.362804+0000","last_undegraded":"2024-09-21T03:20:22.362804+0000","last_fullsized":"2024-09-21T03:20:22.362804+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:08.243558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.361094+0000","last_change":"2024-09-21T03:20:22.370554+0000","last_active":"2024-09-21T03:20:23.361094+0000","last_peered":"2024-09-21T03:20:23.361094+0000","last_clean":"2024-09-21T03:20:23.361094+0000","last_became_active":"2024-09-21T03:20:22.370255+0000","last_became_peered":"2024-09-21T03:20:22.370255+0000","last_unstale":"2024-09-21T03:20:23.361094+0000","last_undegraded":"2024-09-21T03:20:23.361094+0000","last_fullsized":"2024-09-21T03:20:23.361094+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:10:31.487754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.791740+0000","last_change":"2024-09-21T03:20:22.374994+0000","last_active":"2024-09-21T03:20:23.791740+0000","last_peered":"2024-09-21T03:20:23.791740+0000","last_clean":"2024-09-21T03:20:23.791740+0000","last_became_active":"2024-09-21T03:20:22.374691+0000","last_became_peered":"2024-09-21T03:20:22.374691+0000","last_unstale":"2024-09-21T03:20:23.791740+0000","last_undegraded":"2024-09-21T03:20:23.791740+0000","last_fullsized":"2024-09-21T03:20:23.791740+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:16:58.258239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.368579+0000","last_change":"2024-09-21T03:20:22.364458+0000","last_active":"2024-09-21T03:20:22.368579+0000","last_peered":"2024-09-21T03:20:22.368579+0000","last_clean":"2024-09-21T03:20:22.368579+0000","last_became_active":"2024-09-21T03:20:22.363602+0000","last_became_peered":"2024-09-21T03:20:22.363602+0000","last_unstale":"2024-09-21T03:20:22.368579+0000","last_undegraded":"2024-09-21T03:20:22.368579+0000","last_fullsized":"2024-09-21T03:20:22.368579+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:28.932663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362357+0000","last_change":"2024-09-21T03:20:22.364557+0000","last_active":"2024-09-21T03:20:23.362357+0000","last_peered":"2024-09-21T03:20:23.362357+0000","last_clean":"2024-09-21T03:20:23.362357+0000","last_became_active":"2024-09-21T03:20:22.364229+0000","last_became_peered":"2024-09-21T03:20:22.364229+0000","last_unstale":"2024-09-21T03:20:23.362357+0000","last_undegraded":"2024-09-21T03:20:23.362357+0000","last_fullsized":"2024-09-21T03:20:23.362357+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:04.759943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363685+0000","last_change":"2024-09-21T03:20:22.362778+0000","last_active":"2024-09-21T03:20:23.363685+0000","last_peered":"2024-09-21T03:20:23.363685+0000","last_clean":"2024-09-21T03:20:23.363685+0000","last_became_active":"2024-09-21T03:20:22.362478+0000","last_became_peered":"2024-09-21T03:20:22.362478+0000","last_unstale":"2024-09-21T03:20:23.363685+0000","last_undegraded":"2024-09-21T03:20:23.363685+0000","last_fullsized":"2024-09-21T03:20:23.363685+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:11.553421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362843+0000","last_change":"2024-09-21T03:20:22.363582+0000","last_active":"2024-09-21T03:20:23.362843+0000","last_peered":"2024-09-21T03:20:23.362843+0000","last_clean":"2024-09-21T03:20:23.362843+0000","last_became_active":"2024-09-21T03:20:22.363282+0000","last_became_peered":"2024-09-21T03:20:22.363282+0000","last_unstale":"2024-09-21T03:20:23.362843+0000","last_undegraded":"2024-09-21T03:20:23.362843+0000","last_fullsized":"2024-09-21T03:20:23.362843+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:23:12.532832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363362+0000","last_change":"2024-09-21T03:20:22.363482+0000","last_active":"2024-09-21T03:20:23.363362+0000","last_peered":"2024-09-21T03:20:23.363362+0000","last_clean":"2024-09-21T03:20:23.363362+0000","last_became_active":"2024-09-21T03:20:22.363129+0000","last_became_peered":"2024-09-21T03:20:22.363129+0000","last_unstale":"2024-09-21T03:20:23.363362+0000","last_undegraded":"2024-09-21T03:20:23.363362+0000","last_fullsized":"2024-09-21T03:20:23.363362+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:12:18.021857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.360949+0000","last_change":"2024-09-21T03:20:22.370285+0000","last_active":"2024-09-21T03:20:23.360949+0000","last_peered":"2024-09-21T03:20:23.360949+0000","last_clean":"2024-09-21T03:20:23.360949+0000","last_became_active":"2024-09-21T03:20:22.369715+0000","last_became_peered":"2024-09-21T03:20:22.369715+0000","last_unstale":"2024-09-21T03:20:23.360949+0000","last_undegraded":"2024-09-21T03:20:23.360949+0000","last_fullsized":"2024-09-21T03:20:23.360949+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:08.636582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.364809+0000","last_change":"2024-09-21T03:20:22.361197+0000","last_active":"2024-09-21T03:20:22.364809+0000","last_peered":"2024-09-21T03:20:22.364809+0000","last_clean":"2024-09-21T03:20:22.364809+0000","last_became_active":"2024-09-21T03:20:22.360584+0000","last_became_peered":"2024-09-21T03:20:22.360584+0000","last_unstale":"2024-09-21T03:20:22.364809+0000","last_undegraded":"2024-09-21T03:20:22.364809+0000","last_fullsized":"2024-09-21T03:20:22.364809+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:20.393544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.791825+0000","last_change":"2024-09-21T03:20:22.370778+0000","last_active":"2024-09-21T03:20:23.791825+0000","last_peered":"2024-09-21T03:20:23.791825+0000","last_clean":"2024-09-21T03:20:23.791825+0000","last_became_active":"2024-09-21T03:20:22.370449+0000","last_became_peered":"2024-09-21T03:20:22.370449+0000","last_unstale":"2024-09-21T03:20:23.791825+0000","last_undegraded":"2024-09-21T03:20:23.791825+0000","last_fullsized":"2024-09-21T03:20:23.791825+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:14.346939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362495+0000","last_change":"2024-09-21T03:20:22.359184+0000","last_active":"2024-09-21T03:20:23.362495+0000","last_peered":"2024-09-21T03:20:23.362495+0000","last_clean":"2024-09-21T03:20:23.362495+0000","last_became_active":"2024-09-21T03:20:22.357185+0000","last_became_peered":"2024-09-21T03:20:22.357185+0000","last_unstale":"2024-09-21T03:20:23.362495+0000","last_undegraded":"2024-09-21T03:20:23.362495+0000","last_fullsized":"2024-09-21T03:20:23.362495+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:13.194698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363072+0000","last_change":"2024-09-21T03:20:22.357204+0000","last_active":"2024-09-21T03:20:23.363072+0000","last_peered":"2024-09-21T03:20:23.363072+0000","last_clean":"2024-09-21T03:20:23.363072+0000","last_became_active":"2024-09-21T03:20:22.356888+0000","last_became_peered":"2024-09-21T03:20:22.356888+0000","last_unstale":"2024-09-21T03:20:23.363072+0000","last_undegraded":"2024-09-21T03:20:23.363072+0000","last_fullsized":"2024-09-21T03:20:23.363072+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:23:58.513737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363507+0000","last_change":"2024-09-21T03:20:22.366679+0000","last_active":"2024-09-21T03:20:23.363507+0000","last_peered":"2024-09-21T03:20:23.363507+0000","last_clean":"2024-09-21T03:20:23.363507+0000","last_became_active":"2024-09-21T03:20:22.366295+0000","last_became_peered":"2024-09-21T03:20:22.366295+0000","last_unstale":"2024-09-21T03:20:23.363507+0000","last_undegraded":"2024-09-21T03:20:23.363507+0000","last_fullsized":"2024-09-21T03:20:23.363507+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:56.748578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.360927+0000","last_change":"2024-09-21T03:20:22.363184+0000","last_active":"2024-09-21T03:20:23.360927+0000","last_peered":"2024-09-21T03:20:23.360927+0000","last_clean":"2024-09-21T03:20:23.360927+0000","last_became_active":"2024-09-21T03:20:22.362501+0000","last_became_peered":"2024-09-21T03:20:22.362501+0000","last_unstale":"2024-09-21T03:20:23.360927+0000","last_undegraded":"2024-09-21T03:20:23.360927+0000","last_fullsized":"2024-09-21T03:20:23.360927+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:21:09.148798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362478+0000","last_change":"2024-09-21T03:20:22.362032+0000","last_active":"2024-09-21T03:20:23.362478+0000","last_peered":"2024-09-21T03:20:23.362478+0000","last_clean":"2024-09-21T03:20:23.362478+0000","last_became_active":"2024-09-21T03:20:22.361748+0000","last_became_peered":"2024-09-21T03:20:22.361748+0000","last_unstale":"2024-09-21T03:20:23.362478+0000","last_undegraded":"2024-09-21T03:20:23.362478+0000","last_fullsized":"2024-09-21T03:20:23.362478+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:08.318524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.362382+0000","last_change":"2024-09-21T03:20:22.361207+0000","last_active":"2024-09-21T03:20:22.362382+0000","last_peered":"2024-09-21T03:20:22.362382+0000","last_clean":"2024-09-21T03:20:22.362382+0000","last_became_active":"2024-09-21T03:20:22.360879+0000","last_became_peered":"2024-09-21T03:20:22.360879+0000","last_unstale":"2024-09-21T03:20:22.362382+0000","last_undegraded":"2024-09-21T03:20:22.362382+0000","last_fullsized":"2024-09-21T03:20:22.362382+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:27.628018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362977+0000","last_change":"2024-09-21T03:20:22.358441+0000","last_active":"2024-09-21T03:20:23.362977+0000","last_peered":"2024-09-21T03:20:23.362977+0000","last_clean":"2024-09-21T03:20:23.362977+0000","last_became_active":"2024-09-21T03:20:22.358130+0000","last_became_peered":"2024-09-21T03:20:22.358130+0000","last_unstale":"2024-09-21T03:20:23.362977+0000","last_undegraded":"2024-09-21T03:20:23.362977+0000","last_fullsized":"2024-09-21T03:20:23.362977+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:06.233989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362070+0000","last_change":"2024-09-21T03:20:22.356052+0000","last_active":"2024-09-21T03:20:23.362070+0000","last_peered":"2024-09-21T03:20:23.362070+0000","last_clean":"2024-09-21T03:20:23.362070+0000","last_became_active":"2024-09-21T03:20:22.355703+0000","last_became_peered":"2024-09-21T03:20:22.355703+0000","last_unstale":"2024-09-21T03:20:23.362070+0000","last_undegraded":"2024-09-21T03:20:23.362070+0000","last_fullsized":"2024-09-21T03:20:23.362070+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:54.277955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.368552+0000","last_change":"2024-09-21T03:20:22.364133+0000","last_active":"2024-09-21T03:20:22.368552+0000","last_peered":"2024-09-21T03:20:22.368552+0000","last_clean":"2024-09-21T03:20:22.368552+0000","last_became_active":"2024-09-21T03:20:22.363162+0000","last_became_peered":"2024-09-21T03:20:22.363162+0000","last_unstale":"2024-09-21T03:20:22.368552+0000","last_undegraded":"2024-09-21T03:20:22.368552+0000","last_fullsized":"2024-09-21T03:20:22.368552+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:10.473935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.361087+0000","last_change":"2024-09-21T03:20:22.358222+0000","last_active":"2024-09-21T03:20:23.361087+0000","last_peered":"2024-09-21T03:20:23.361087+0000","last_clean":"2024-09-21T03:20:23.361087+0000","last_became_active":"2024-09-21T03:20:22.357933+0000","last_became_peered":"2024-09-21T03:20:22.357933+0000","last_unstale":"2024-09-21T03:20:23.361087+0000","last_undegraded":"2024-09-21T03:20:23.361087+0000","last_fullsized":"2024-09-21T03:20:23.361087+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:18.911040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.356962+0000","last_change":"2024-09-21T03:20:22.353413+0000","last_active":"2024-09-21T03:20:22.356962+0000","last_peered":"2024-09-21T03:20:22.356962+0000","last_clean":"2024-09-21T03:20:22.356962+0000","last_became_active":"2024-09-21T03:20:22.353091+0000","last_became_peered":"2024-09-21T03:20:22.353091+0000","last_unstale":"2024-09-21T03:20:22.356962+0000","last_undegraded":"2024-09-21T03:20:22.356962+0000","last_fullsized":"2024-09-21T03:20:22.356962+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:19:14.358260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.377306+0000","last_change":"2024-09-21T03:20:21.353455+0000","last_active":"2024-09-21T03:20:22.377306+0000","last_peered":"2024-09-21T03:20:22.377306+0000","last_clean":"2024-09-21T03:20:22.377306+0000","last_became_active":"2024-09-21T03:20:21.353167+0000","last_became_peered":"2024-09-21T03:20:21.353167+0000","last_unstale":"2024-09-21T03:20:22.377306+0000","last_undegraded":"2024-09-21T03:20:22.377306+0000","last_fullsized":"2024-09-21T03:20:22.377306+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:10.549273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363625+0000","last_change":"2024-09-21T03:20:22.360284+0000","last_active":"2024-09-21T03:20:23.363625+0000","last_peered":"2024-09-21T03:20:23.363625+0000","last_clean":"2024-09-21T03:20:23.363625+0000","last_became_active":"2024-09-21T03:20:22.359131+0000","last_became_peered":"2024-09-21T03:20:22.359131+0000","last_unstale":"2024-09-21T03:20:23.363625+0000","last_undegraded":"2024-09-21T03:20:23.363625+0000","last_fullsized":"2024-09-21T03:20:23.363625+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:27:18.588119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362999+0000","last_change":"2024-09-21T03:20:21.358490+0000","last_active":"2024-09-21T03:20:23.362999+0000","last_peered":"2024-09-21T03:20:23.362999+0000","last_clean":"2024-09-21T03:20:23.362999+0000","last_became_active":"2024-09-21T03:20:21.357991+0000","last_became_peered":"2024-09-21T03:20:21.357991+0000","last_unstale":"2024-09-21T03:20:23.362999+0000","last_undegraded":"2024-09-21T03:20:23.362999+0000","last_fullsized":"2024-09-21T03:20:23.362999+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:52.543844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.374252+0000","last_change":"2024-09-21T03:20:22.370492+0000","last_active":"2024-09-21T03:20:22.374252+0000","last_peered":"2024-09-21T03:20:22.374252+0000","last_clean":"2024-09-21T03:20:22.374252+0000","last_became_active":"2024-09-21T03:20:22.370117+0000","last_became_peered":"2024-09-21T03:20:22.370117+0000","last_unstale":"2024-09-21T03:20:22.374252+0000","last_undegraded":"2024-09-21T03:20:22.374252+0000","last_fullsized":"2024-09-21T03:20:22.374252+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:22.864214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.372898+0000","last_change":"2024-09-21T03:20:21.363908+0000","last_active":"2024-09-21T03:20:22.372898+0000","last_peered":"2024-09-21T03:20:22.372898+0000","last_clean":"2024-09-21T03:20:22.372898+0000","last_became_active":"2024-09-21T03:20:21.363494+0000","last_became_peered":"2024-09-21T03:20:21.363494+0000","last_unstale":"2024-09-21T03:20:22.372898+0000","last_undegraded":"2024-09-21T03:20:22.372898+0000","last_fullsized":"2024-09-21T03:20:22.372898+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:40.157840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.358596+0000","last_change":"2024-09-21T03:20:22.357615+0000","last_active":"2024-09-21T03:20:22.358596+0000","last_peered":"2024-09-21T03:20:22.358596+0000","last_clean":"2024-09-21T03:20:22.358596+0000","last_became_active":"2024-09-21T03:20:22.357317+0000","last_became_peered":"2024-09-21T03:20:22.357317+0000","last_unstale":"2024-09-21T03:20:22.358596+0000","last_undegraded":"2024-09-21T03:20:22.358596+0000","last_fullsized":"2024-09-21T03:20:22.358596+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:12:18.021857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.374621+0000","last_change":"2024-09-21T03:20:21.361902+0000","last_active":"2024-09-21T03:20:22.374621+0000","last_peered":"2024-09-21T03:20:22.374621+0000","last_clean":"2024-09-21T03:20:22.374621+0000","last_became_active":"2024-09-21T03:20:21.361549+0000","last_became_peered":"2024-09-21T03:20:21.361549+0000","last_unstale":"2024-09-21T03:20:22.374621+0000","last_undegraded":"2024-09-21T03:20:22.374621+0000","last_fullsized":"2024-09-21T03:20:22.374621+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:26.623870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362338+0000","last_change":"2024-09-21T03:20:22.353213+0000","last_active":"2024-09-21T03:20:23.362338+0000","last_peered":"2024-09-21T03:20:23.362338+0000","last_clean":"2024-09-21T03:20:23.362338+0000","last_became_active":"2024-09-21T03:20:22.352809+0000","last_became_peered":"2024-09-21T03:20:22.352809+0000","last_unstale":"2024-09-21T03:20:23.362338+0000","last_undegraded":"2024-09-21T03:20:23.362338+0000","last_fullsized":"2024-09-21T03:20:23.362338+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:51:09.144620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.371958+0000","last_change":"2024-09-21T03:20:21.360479+0000","last_active":"2024-09-21T03:20:22.371958+0000","last_peered":"2024-09-21T03:20:22.371958+0000","last_clean":"2024-09-21T03:20:22.371958+0000","last_became_active":"2024-09-21T03:20:21.360179+0000","last_became_peered":"2024-09-21T03:20:21.360179+0000","last_unstale":"2024-09-21T03:20:22.371958+0000","last_undegraded":"2024-09-21T03:20:22.371958+0000","last_fullsized":"2024-09-21T03:20:22.371958+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:31.358952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.791964+0000","last_change":"2024-09-21T03:20:22.373116+0000","last_active":"2024-09-21T03:20:23.791964+0000","last_peered":"2024-09-21T03:20:23.791964+0000","last_clean":"2024-09-21T03:20:23.791964+0000","last_became_active":"2024-09-21T03:20:22.372787+0000","last_became_peered":"2024-09-21T03:20:22.372787+0000","last_unstale":"2024-09-21T03:20:23.791964+0000","last_undegraded":"2024-09-21T03:20:23.791964+0000","last_fullsized":"2024-09-21T03:20:23.791964+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:20.930083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362478+0000","last_change":"2024-09-21T03:20:21.360913+0000","last_active":"2024-09-21T03:20:23.362478+0000","last_peered":"2024-09-21T03:20:23.362478+0000","last_clean":"2024-09-21T03:20:23.362478+0000","last_became_active":"2024-09-21T03:20:21.360581+0000","last_became_peered":"2024-09-21T03:20:21.360581+0000","last_unstale":"2024-09-21T03:20:23.362478+0000","last_undegraded":"2024-09-21T03:20:23.362478+0000","last_fullsized":"2024-09-21T03:20:23.362478+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:57.040972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.792193+0000","last_change":"2024-09-21T03:20:22.371286+0000","last_active":"2024-09-21T03:20:23.792193+0000","last_peered":"2024-09-21T03:20:23.792193+0000","last_clean":"2024-09-21T03:20:23.792193+0000","last_became_active":"2024-09-21T03:20:22.370947+0000","last_became_peered":"2024-09-21T03:20:22.370947+0000","last_unstale":"2024-09-21T03:20:23.792193+0000","last_undegraded":"2024-09-21T03:20:23.792193+0000","last_fullsized":"2024-09-21T03:20:23.792193+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:57:43.539037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.353738+0000","last_change":"2024-09-21T03:20:21.363512+0000","last_active":"2024-09-21T03:20:22.353738+0000","last_peered":"2024-09-21T03:20:22.353738+0000","last_clean":"2024-09-21T03:20:22.353738+0000","last_became_active":"2024-09-21T03:20:21.363215+0000","last_became_peered":"2024-09-21T03:20:21.363215+0000","last_unstale":"2024-09-21T03:20:22.353738+0000","last_undegraded":"2024-09-21T03:20:22.353738+0000","last_fullsized":"2024-09-21T03:20:22.353738+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:48.695082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362814+0000","last_change":"2024-09-21T03:20:22.359160+0000","last_active":"2024-09-21T03:20:23.362814+0000","last_peered":"2024-09-21T03:20:23.362814+0000","last_clean":"2024-09-21T03:20:23.362814+0000","last_became_active":"2024-09-21T03:20:22.356795+0000","last_became_peered":"2024-09-21T03:20:22.356795+0000","last_unstale":"2024-09-21T03:20:23.362814+0000","last_undegraded":"2024-09-21T03:20:23.362814+0000","last_fullsized":"2024-09-21T03:20:23.362814+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:48.006533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.792351+0000","last_change":"2024-09-21T03:20:21.359300+0000","last_active":"2024-09-21T03:20:23.792351+0000","last_peered":"2024-09-21T03:20:23.792351+0000","last_clean":"2024-09-21T03:20:23.792351+0000","last_became_active":"2024-09-21T03:20:21.358998+0000","last_became_peered":"2024-09-21T03:20:21.358998+0000","last_unstale":"2024-09-21T03:20:23.792351+0000","last_undegraded":"2024-09-21T03:20:23.792351+0000","last_fullsized":"2024-09-21T03:20:23.792351+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:51.051421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362865+0000","last_change":"2024-09-21T03:20:22.361977+0000","last_active":"2024-09-21T03:20:23.362865+0000","last_peered":"2024-09-21T03:20:23.362865+0000","last_clean":"2024-09-21T03:20:23.362865+0000","last_became_active":"2024-09-21T03:20:22.361641+0000","last_became_peered":"2024-09-21T03:20:22.361641+0000","last_unstale":"2024-09-21T03:20:23.362865+0000","last_undegraded":"2024-09-21T03:20:23.362865+0000","last_fullsized":"2024-09-21T03:20:23.362865+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:34.601478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363827+0000","last_change":"2024-09-21T03:20:21.358364+0000","last_active":"2024-09-21T03:20:23.363827+0000","last_peered":"2024-09-21T03:20:23.363827+0000","last_clean":"2024-09-21T03:20:23.363827+0000","last_became_active":"2024-09-21T03:20:21.357818+0000","last_became_peered":"2024-09-21T03:20:21.357818+0000","last_unstale":"2024-09-21T03:20:23.363827+0000","last_undegraded":"2024-09-21T03:20:23.363827+0000","last_fullsized":"2024-09-21T03:20:23.363827+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:40.157840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.368225+0000","last_change":"2024-09-21T03:20:22.365443+0000","last_active":"2024-09-21T03:20:22.368225+0000","last_peered":"2024-09-21T03:20:22.368225+0000","last_clean":"2024-09-21T03:20:22.368225+0000","last_became_active":"2024-09-21T03:20:22.365081+0000","last_became_peered":"2024-09-21T03:20:22.365081+0000","last_unstale":"2024-09-21T03:20:22.368225+0000","last_undegraded":"2024-09-21T03:20:22.368225+0000","last_fullsized":"2024-09-21T03:20:22.368225+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:13:18.276359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.792406+0000","last_change":"2024-09-21T03:20:21.360629+0000","last_active":"2024-09-21T03:20:23.792406+0000","last_peered":"2024-09-21T03:20:23.792406+0000","last_clean":"2024-09-21T03:20:23.792406+0000","last_became_active":"2024-09-21T03:20:21.360357+0000","last_became_peered":"2024-09-21T03:20:21.360357+0000","last_unstale":"2024-09-21T03:20:23.792406+0000","last_undegraded":"2024-09-21T03:20:23.792406+0000","last_fullsized":"2024-09-21T03:20:23.792406+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:00:30.088576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.369350+0000","last_change":"2024-09-21T03:20:22.368659+0000","last_active":"2024-09-21T03:20:22.369350+0000","last_peered":"2024-09-21T03:20:22.369350+0000","last_clean":"2024-09-21T03:20:22.369350+0000","last_became_active":"2024-09-21T03:20:22.359839+0000","last_became_peered":"2024-09-21T03:20:22.359839+0000","last_unstale":"2024-09-21T03:20:22.369350+0000","last_undegraded":"2024-09-21T03:20:22.369350+0000","last_fullsized":"2024-09-21T03:20:22.369350+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:29.987903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.377624+0000","last_change":"2024-09-21T03:20:21.360749+0000","last_active":"2024-09-21T03:20:22.377624+0000","last_peered":"2024-09-21T03:20:22.377624+0000","last_clean":"2024-09-21T03:20:22.377624+0000","last_became_active":"2024-09-21T03:20:21.359582+0000","last_became_peered":"2024-09-21T03:20:21.359582+0000","last_unstale":"2024-09-21T03:20:22.377624+0000","last_undegraded":"2024-09-21T03:20:22.377624+0000","last_fullsized":"2024-09-21T03:20:22.377624+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:33.367277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.360774+0000","last_change":"2024-09-21T03:20:22.354530+0000","last_active":"2024-09-21T03:20:22.360774+0000","last_peered":"2024-09-21T03:20:22.360774+0000","last_clean":"2024-09-21T03:20:22.360774+0000","last_became_active":"2024-09-21T03:20:22.354017+0000","last_became_peered":"2024-09-21T03:20:22.354017+0000","last_unstale":"2024-09-21T03:20:22.360774+0000","last_undegraded":"2024-09-21T03:20:22.360774+0000","last_fullsized":"2024-09-21T03:20:22.360774+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:13.722902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":21,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.360948+0000","last_change":"2024-09-21T03:20:21.359485+0000","last_active":"2024-09-21T03:20:23.360948+0000","last_peered":"2024-09-21T03:20:23.360948+0000","last_clean":"2024-09-21T03:20:23.360948+0000","last_became_active":"2024-09-21T03:20:21.359182+0000","last_became_peered":"2024-09-21T03:20:21.359182+0000","last_unstale":"2024-09-21T03:20:23.360948+0000","last_undegraded":"2024-09-21T03:20:23.360948+0000","last_fullsized":"2024-09-21T03:20:23.360948+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:06:13.612749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363374+0000","last_change":"2024-09-21T03:20:22.363602+0000","last_active":"2024-09-21T03:20:23.363374+0000","last_peered":"2024-09-21T03:20:23.363374+0000","last_clean":"2024-09-21T03:20:23.363374+0000","last_became_active":"2024-09-21T03:20:22.363245+0000","last_became_peered":"2024-09-21T03:20:22.363245+0000","last_unstale":"2024-09-21T03:20:23.363374+0000","last_undegraded":"2024-09-21T03:20:23.363374+0000","last_fullsized":"2024-09-21T03:20:23.363374+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:58:04.733519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.375839+0000","last_change":"2024-09-21T03:20:21.362428+0000","last_active":"2024-09-21T03:20:22.375839+0000","last_peered":"2024-09-21T03:20:22.375839+0000","last_clean":"2024-09-21T03:20:22.375839+0000","last_became_active":"2024-09-21T03:20:21.362120+0000","last_became_peered":"2024-09-21T03:20:21.362120+0000","last_unstale":"2024-09-21T03:20:22.375839+0000","last_undegraded":"2024-09-21T03:20:22.375839+0000","last_fullsized":"2024-09-21T03:20:22.375839+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:07.239411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.792028+0000","last_change":"2024-09-21T03:20:22.369474+0000","last_active":"2024-09-21T03:20:23.792028+0000","last_peered":"2024-09-21T03:20:23.792028+0000","last_clean":"2024-09-21T03:20:23.792028+0000","last_became_active":"2024-09-21T03:20:22.368848+0000","last_became_peered":"2024-09-21T03:20:22.368848+0000","last_unstale":"2024-09-21T03:20:23.792028+0000","last_undegraded":"2024-09-21T03:20:23.792028+0000","last_fullsized":"2024-09-21T03:20:23.792028+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:32:28.415345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.346757+0000","last_change":"2024-09-21T03:20:21.357809+0000","last_active":"2024-09-21T03:20:22.346757+0000","last_peered":"2024-09-21T03:20:22.346757+0000","last_clean":"2024-09-21T03:20:22.346757+0000","last_became_active":"2024-09-21T03:20:21.357478+0000","last_became_peered":"2024-09-21T03:20:21.357478+0000","last_unstale":"2024-09-21T03:20:22.346757+0000","last_undegraded":"2024-09-21T03:20:22.346757+0000","last_fullsized":"2024-09-21T03:20:22.346757+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:31.358952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.359974+0000","last_change":"2024-09-21T03:20:22.358128+0000","last_active":"2024-09-21T03:20:22.359974+0000","last_peered":"2024-09-21T03:20:22.359974+0000","last_clean":"2024-09-21T03:20:22.359974+0000","last_became_active":"2024-09-21T03:20:22.357840+0000","last_became_peered":"2024-09-21T03:20:22.357840+0000","last_unstale":"2024-09-21T03:20:22.359974+0000","last_undegraded":"2024-09-21T03:20:22.359974+0000","last_fullsized":"2024-09-21T03:20:22.359974+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:13:18.276359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.348394+0000","last_change":"2024-09-21T03:20:21.362378+0000","last_active":"2024-09-21T03:20:22.348394+0000","last_peered":"2024-09-21T03:20:22.348394+0000","last_clean":"2024-09-21T03:20:22.348394+0000","last_became_active":"2024-09-21T03:20:21.362053+0000","last_became_peered":"2024-09-21T03:20:21.362053+0000","last_unstale":"2024-09-21T03:20:22.348394+0000","last_undegraded":"2024-09-21T03:20:22.348394+0000","last_fullsized":"2024-09-21T03:20:22.348394+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:48.695082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.354711+0000","last_change":"2024-09-21T03:20:22.352414+0000","last_active":"2024-09-21T03:20:22.354711+0000","last_peered":"2024-09-21T03:20:22.354711+0000","last_clean":"2024-09-21T03:20:22.354711+0000","last_became_active":"2024-09-21T03:20:22.352087+0000","last_became_peered":"2024-09-21T03:20:22.352087+0000","last_unstale":"2024-09-21T03:20:22.354711+0000","last_undegraded":"2024-09-21T03:20:22.354711+0000","last_fullsized":"2024-09-21T03:20:22.354711+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:15.584346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":23,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.792357+0000","last_change":"2024-09-21T03:20:21.361289+0000","last_active":"2024-09-21T03:20:23.792357+0000","last_peered":"2024-09-21T03:20:23.792357+0000","last_clean":"2024-09-21T03:20:23.792357+0000","last_became_active":"2024-09-21T03:20:21.360579+0000","last_became_peered":"2024-09-21T03:20:21.360579+0000","last_unstale":"2024-09-21T03:20:23.792357+0000","last_undegraded":"2024-09-21T03:20:23.792357+0000","last_fullsized":"2024-09-21T03:20:23.792357+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:16.835012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.361092+0000","last_change":"2024-09-21T03:20:22.363513+0000","last_active":"2024-09-21T03:20:23.361092+0000","last_peered":"2024-09-21T03:20:23.361092+0000","last_clean":"2024-09-21T03:20:23.361092+0000","last_became_active":"2024-09-21T03:20:22.362889+0000","last_became_peered":"2024-09-21T03:20:22.362889+0000","last_unstale":"2024-09-21T03:20:23.361092+0000","last_undegraded":"2024-09-21T03:20:23.361092+0000","last_fullsized":"2024-09-21T03:20:23.361092+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:44.768435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.360918+0000","last_change":"2024-09-21T03:20:21.354915+0000","last_active":"2024-09-21T03:20:23.360918+0000","last_peered":"2024-09-21T03:20:23.360918+0000","last_clean":"2024-09-21T03:20:23.360918+0000","last_became_active":"2024-09-21T03:20:21.354531+0000","last_became_peered":"2024-09-21T03:20:21.354531+0000","last_unstale":"2024-09-21T03:20:23.360918+0000","last_undegraded":"2024-09-21T03:20:23.360918+0000","last_fullsized":"2024-09-21T03:20:23.360918+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:46.767630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.792178+0000","last_change":"2024-09-21T03:20:22.371172+0000","last_active":"2024-09-21T03:20:23.792178+0000","last_peered":"2024-09-21T03:20:23.792178+0000","last_clean":"2024-09-21T03:20:23.792178+0000","last_became_active":"2024-09-21T03:20:22.370853+0000","last_became_peered":"2024-09-21T03:20:22.370853+0000","last_unstale":"2024-09-21T03:20:23.792178+0000","last_undegraded":"2024-09-21T03:20:23.792178+0000","last_fullsized":"2024-09-21T03:20:23.792178+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:58.607336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362997+0000","last_change":"2024-09-21T03:20:21.358123+0000","last_active":"2024-09-21T03:20:23.362997+0000","last_peered":"2024-09-21T03:20:23.362997+0000","last_clean":"2024-09-21T03:20:23.362997+0000","last_became_active":"2024-09-21T03:20:21.357694+0000","last_became_peered":"2024-09-21T03:20:21.357694+0000","last_unstale":"2024-09-21T03:20:23.362997+0000","last_undegraded":"2024-09-21T03:20:23.362997+0000","last_fullsized":"2024-09-21T03:20:23.362997+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:45.437208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362804+0000","last_change":"2024-09-21T03:20:22.354537+0000","last_active":"2024-09-21T03:20:23.362804+0000","last_peered":"2024-09-21T03:20:23.362804+0000","last_clean":"2024-09-21T03:20:23.362804+0000","last_became_active":"2024-09-21T03:20:22.354221+0000","last_became_peered":"2024-09-21T03:20:22.354221+0000","last_unstale":"2024-09-21T03:20:23.362804+0000","last_undegraded":"2024-09-21T03:20:23.362804+0000","last_fullsized":"2024-09-21T03:20:23.362804+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:33.384208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.373213+0000","last_change":"2024-09-21T03:20:21.360136+0000","last_active":"2024-09-21T03:20:22.373213+0000","last_peered":"2024-09-21T03:20:22.373213+0000","last_clean":"2024-09-21T03:20:22.373213+0000","last_became_active":"2024-09-21T03:20:21.359678+0000","last_became_peered":"2024-09-21T03:20:21.359678+0000","last_unstale":"2024-09-21T03:20:22.373213+0000","last_undegraded":"2024-09-21T03:20:22.373213+0000","last_fullsized":"2024-09-21T03:20:22.373213+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:44.853872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363330+0000","last_change":"2024-09-21T03:20:22.352124+0000","last_active":"2024-09-21T03:20:23.363330+0000","last_peered":"2024-09-21T03:20:23.363330+0000","last_clean":"2024-09-21T03:20:23.363330+0000","last_became_active":"2024-09-21T03:20:22.351748+0000","last_became_peered":"2024-09-21T03:20:22.351748+0000","last_unstale":"2024-09-21T03:20:23.363330+0000","last_undegraded":"2024-09-21T03:20:23.363330+0000","last_fullsized":"2024-09-21T03:20:23.363330+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:57.836459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.349625+0000","last_change":"2024-09-21T03:20:21.357025+0000","last_active":"2024-09-21T03:20:22.349625+0000","last_peered":"2024-09-21T03:20:22.349625+0000","last_clean":"2024-09-21T03:20:22.349625+0000","last_became_active":"2024-09-21T03:20:21.356647+0000","last_became_peered":"2024-09-21T03:20:21.356647+0000","last_unstale":"2024-09-21T03:20:22.349625+0000","last_undegraded":"2024-09-21T03:20:22.349625+0000","last_fullsized":"2024-09-21T03:20:22.349625+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:14.580199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.358586+0000","last_change":"2024-09-21T03:20:22.356328+0000","last_active":"2024-09-21T03:20:22.358586+0000","last_peered":"2024-09-21T03:20:22.358586+0000","last_clean":"2024-09-21T03:20:22.358586+0000","last_became_active":"2024-09-21T03:20:22.355690+0000","last_became_peered":"2024-09-21T03:20:22.355690+0000","last_unstale":"2024-09-21T03:20:22.358586+0000","last_undegraded":"2024-09-21T03:20:22.358586+0000","last_fullsized":"2024-09-21T03:20:22.358586+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:26:22.864214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.372211+0000","last_change":"2024-09-21T03:20:21.360457+0000","last_active":"2024-09-21T03:20:22.372211+0000","last_peered":"2024-09-21T03:20:22.372211+0000","last_clean":"2024-09-21T03:20:22.372211+0000","last_became_active":"2024-09-21T03:20:21.360158+0000","last_became_peered":"2024-09-21T03:20:21.360158+0000","last_unstale":"2024-09-21T03:20:22.372211+0000","last_undegraded":"2024-09-21T03:20:22.372211+0000","last_fullsized":"2024-09-21T03:20:22.372211+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:18.644256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.372779+0000","last_change":"2024-09-21T03:20:22.363703+0000","last_active":"2024-09-21T03:20:22.372779+0000","last_peered":"2024-09-21T03:20:22.372779+0000","last_clean":"2024-09-21T03:20:22.372779+0000","last_became_active":"2024-09-21T03:20:22.363365+0000","last_became_peered":"2024-09-21T03:20:22.363365+0000","last_unstale":"2024-09-21T03:20:22.372779+0000","last_undegraded":"2024-09-21T03:20:22.372779+0000","last_fullsized":"2024-09-21T03:20:22.372779+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:16:28.048269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.352743+0000","last_change":"2024-09-21T03:20:21.362530+0000","last_active":"2024-09-21T03:20:22.352743+0000","last_peered":"2024-09-21T03:20:22.352743+0000","last_clean":"2024-09-21T03:20:22.352743+0000","last_became_active":"2024-09-21T03:20:21.362236+0000","last_became_peered":"2024-09-21T03:20:21.362236+0000","last_unstale":"2024-09-21T03:20:22.352743+0000","last_undegraded":"2024-09-21T03:20:22.352743+0000","last_fullsized":"2024-09-21T03:20:22.352743+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:49.098519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.360903+0000","last_change":"2024-09-21T03:20:22.364758+0000","last_active":"2024-09-21T03:20:23.360903+0000","last_peered":"2024-09-21T03:20:23.360903+0000","last_clean":"2024-09-21T03:20:23.360903+0000","last_became_active":"2024-09-21T03:20:22.364448+0000","last_became_peered":"2024-09-21T03:20:22.364448+0000","last_unstale":"2024-09-21T03:20:23.360903+0000","last_undegraded":"2024-09-21T03:20:23.360903+0000","last_fullsized":"2024-09-21T03:20:23.360903+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:10.839820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.791688+0000","last_change":"2024-09-21T03:20:21.360800+0000","last_active":"2024-09-21T03:20:23.791688+0000","last_peered":"2024-09-21T03:20:23.791688+0000","last_clean":"2024-09-21T03:20:23.791688+0000","last_became_active":"2024-09-21T03:20:21.360480+0000","last_became_peered":"2024-09-21T03:20:21.360480+0000","last_unstale":"2024-09-21T03:20:23.791688+0000","last_undegraded":"2024-09-21T03:20:23.791688+0000","last_fullsized":"2024-09-21T03:20:23.791688+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:44.607927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.791705+0000","last_change":"2024-09-21T03:20:22.376273+0000","last_active":"2024-09-21T03:20:23.791705+0000","last_peered":"2024-09-21T03:20:23.791705+0000","last_clean":"2024-09-21T03:20:23.791705+0000","last_became_active":"2024-09-21T03:20:22.375651+0000","last_became_peered":"2024-09-21T03:20:22.375651+0000","last_unstale":"2024-09-21T03:20:23.791705+0000","last_undegraded":"2024-09-21T03:20:23.791705+0000","last_fullsized":"2024-09-21T03:20:23.791705+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:30:10.850700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.346096+0000","last_change":"2024-09-21T03:20:21.358799+0000","last_active":"2024-09-21T03:20:22.346096+0000","last_peered":"2024-09-21T03:20:22.346096+0000","last_clean":"2024-09-21T03:20:22.346096+0000","last_became_active":"2024-09-21T03:20:21.358305+0000","last_became_peered":"2024-09-21T03:20:21.358305+0000","last_unstale":"2024-09-21T03:20:22.346096+0000","last_undegraded":"2024-09-21T03:20:22.346096+0000","last_fullsized":"2024-09-21T03:20:22.346096+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:44.853872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363756+0000","last_change":"2024-09-21T03:20:22.365742+0000","last_active":"2024-09-21T03:20:23.363756+0000","last_peered":"2024-09-21T03:20:23.363756+0000","last_clean":"2024-09-21T03:20:23.363756+0000","last_became_active":"2024-09-21T03:20:22.365343+0000","last_became_peered":"2024-09-21T03:20:22.365343+0000","last_unstale":"2024-09-21T03:20:23.363756+0000","last_undegraded":"2024-09-21T03:20:23.363756+0000","last_fullsized":"2024-09-21T03:20:23.363756+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:07.319445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.349100+0000","last_change":"2024-09-21T03:20:21.361559+0000","last_active":"2024-09-21T03:20:22.349100+0000","last_peered":"2024-09-21T03:20:22.349100+0000","last_clean":"2024-09-21T03:20:22.349100+0000","last_became_active":"2024-09-21T03:20:21.361176+0000","last_became_peered":"2024-09-21T03:20:21.361176+0000","last_unstale":"2024-09-21T03:20:22.349100+0000","last_undegraded":"2024-09-21T03:20:22.349100+0000","last_fullsized":"2024-09-21T03:20:22.349100+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:33.367277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.792009+0000","last_change":"2024-09-21T03:20:22.361086+0000","last_active":"2024-09-21T03:20:23.792009+0000","last_peered":"2024-09-21T03:20:23.792009+0000","last_clean":"2024-09-21T03:20:23.792009+0000","last_became_active":"2024-09-21T03:20:22.360785+0000","last_became_peered":"2024-09-21T03:20:22.360785+0000","last_unstale":"2024-09-21T03:20:23.792009+0000","last_undegraded":"2024-09-21T03:20:23.792009+0000","last_fullsized":"2024-09-21T03:20:23.792009+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:49:34.422333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.347088+0000","last_change":"2024-09-21T03:20:21.361458+0000","last_active":"2024-09-21T03:20:22.347088+0000","last_peered":"2024-09-21T03:20:22.347088+0000","last_clean":"2024-09-21T03:20:22.347088+0000","last_became_active":"2024-09-21T03:20:21.360423+0000","last_became_peered":"2024-09-21T03:20:21.360423+0000","last_unstale":"2024-09-21T03:20:22.347088+0000","last_undegraded":"2024-09-21T03:20:22.347088+0000","last_fullsized":"2024-09-21T03:20:22.347088+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:07.239411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.360804+0000","last_change":"2024-09-21T03:20:22.357464+0000","last_active":"2024-09-21T03:20:22.360804+0000","last_peered":"2024-09-21T03:20:22.360804+0000","last_clean":"2024-09-21T03:20:22.360804+0000","last_became_active":"2024-09-21T03:20:22.356980+0000","last_became_peered":"2024-09-21T03:20:22.356980+0000","last_unstale":"2024-09-21T03:20:22.360804+0000","last_undegraded":"2024-09-21T03:20:22.360804+0000","last_fullsized":"2024-09-21T03:20:22.360804+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:11.740501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.348448+0000","last_change":"2024-09-21T03:20:21.363637+0000","last_active":"2024-09-21T03:20:22.348448+0000","last_peered":"2024-09-21T03:20:22.348448+0000","last_clean":"2024-09-21T03:20:22.348448+0000","last_became_active":"2024-09-21T03:20:21.363270+0000","last_became_peered":"2024-09-21T03:20:21.363270+0000","last_unstale":"2024-09-21T03:20:22.348448+0000","last_undegraded":"2024-09-21T03:20:22.348448+0000","last_fullsized":"2024-09-21T03:20:22.348448+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:52.543844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.358613+0000","last_change":"2024-09-21T03:20:22.357010+0000","last_active":"2024-09-21T03:20:22.358613+0000","last_peered":"2024-09-21T03:20:22.358613+0000","last_clean":"2024-09-21T03:20:22.358613+0000","last_became_active":"2024-09-21T03:20:22.356058+0000","last_became_peered":"2024-09-21T03:20:22.356058+0000","last_unstale":"2024-09-21T03:20:22.358613+0000","last_undegraded":"2024-09-21T03:20:22.358613+0000","last_fullsized":"2024-09-21T03:20:22.358613+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:13.722902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.346608+0000","last_change":"2024-09-21T03:20:21.363605+0000","last_active":"2024-09-21T03:20:22.346608+0000","last_peered":"2024-09-21T03:20:22.346608+0000","last_clean":"2024-09-21T03:20:22.346608+0000","last_became_active":"2024-09-21T03:20:21.361291+0000","last_became_peered":"2024-09-21T03:20:21.361291+0000","last_unstale":"2024-09-21T03:20:22.346608+0000","last_undegraded":"2024-09-21T03:20:22.346608+0000","last_fullsized":"2024-09-21T03:20:22.346608+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:48.695082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.364776+0000","last_change":"2024-09-21T03:20:22.360870+0000","last_active":"2024-09-21T03:20:22.364776+0000","last_peered":"2024-09-21T03:20:22.364776+0000","last_clean":"2024-09-21T03:20:22.364776+0000","last_became_active":"2024-09-21T03:20:22.360189+0000","last_became_peered":"2024-09-21T03:20:22.360189+0000","last_unstale":"2024-09-21T03:20:22.364776+0000","last_undegraded":"2024-09-21T03:20:22.364776+0000","last_fullsized":"2024-09-21T03:20:22.364776+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:37:46.822052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363116+0000","last_change":"2024-09-21T03:20:21.358394+0000","last_active":"2024-09-21T03:20:23.363116+0000","last_peered":"2024-09-21T03:20:23.363116+0000","last_clean":"2024-09-21T03:20:23.363116+0000","last_became_active":"2024-09-21T03:20:21.358059+0000","last_became_peered":"2024-09-21T03:20:21.358059+0000","last_unstale":"2024-09-21T03:20:23.363116+0000","last_undegraded":"2024-09-21T03:20:23.363116+0000","last_fullsized":"2024-09-21T03:20:23.363116+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:01.708297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.361245+0000","last_change":"2024-09-21T03:20:22.359249+0000","last_active":"2024-09-21T03:20:22.361245+0000","last_peered":"2024-09-21T03:20:22.361245+0000","last_clean":"2024-09-21T03:20:22.361245+0000","last_became_active":"2024-09-21T03:20:22.358932+0000","last_became_peered":"2024-09-21T03:20:22.358932+0000","last_unstale":"2024-09-21T03:20:22.361245+0000","last_undegraded":"2024-09-21T03:20:22.361245+0000","last_fullsized":"2024-09-21T03:20:22.361245+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:32.363099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.347743+0000","last_change":"2024-09-21T03:20:21.358386+0000","last_active":"2024-09-21T03:20:22.347743+0000","last_peered":"2024-09-21T03:20:22.347743+0000","last_clean":"2024-09-21T03:20:22.347743+0000","last_became_active":"2024-09-21T03:20:21.358025+0000","last_became_peered":"2024-09-21T03:20:21.358025+0000","last_unstale":"2024-09-21T03:20:22.347743+0000","last_undegraded":"2024-09-21T03:20:22.347743+0000","last_fullsized":"2024-09-21T03:20:22.347743+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:01.708297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362559+0000","last_change":"2024-09-21T03:20:22.356071+0000","last_active":"2024-09-21T03:20:23.362559+0000","last_peered":"2024-09-21T03:20:23.362559+0000","last_clean":"2024-09-21T03:20:23.362559+0000","last_became_active":"2024-09-21T03:20:22.355762+0000","last_became_peered":"2024-09-21T03:20:22.355762+0000","last_unstale":"2024-09-21T03:20:23.362559+0000","last_undegraded":"2024-09-21T03:20:23.362559+0000","last_fullsized":"2024-09-21T03:20:23.362559+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:02.155154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.792460+0000","last_change":"2024-09-21T03:20:21.362237+0000","last_active":"2024-09-21T03:20:23.792460+0000","last_peered":"2024-09-21T03:20:23.792460+0000","last_clean":"2024-09-21T03:20:23.792460+0000","last_became_active":"2024-09-21T03:20:21.361975+0000","last_became_peered":"2024-09-21T03:20:21.361975+0000","last_unstale":"2024-09-21T03:20:23.792460+0000","last_undegraded":"2024-09-21T03:20:23.792460+0000","last_fullsized":"2024-09-21T03:20:23.792460+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:28.346869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.792297+0000","last_change":"2024-09-21T03:20:22.370673+0000","last_active":"2024-09-21T03:20:23.792297+0000","last_peered":"2024-09-21T03:20:23.792297+0000","last_clean":"2024-09-21T03:20:23.792297+0000","last_became_active":"2024-09-21T03:20:22.370359+0000","last_became_peered":"2024-09-21T03:20:22.370359+0000","last_unstale":"2024-09-21T03:20:23.792297+0000","last_undegraded":"2024-09-21T03:20:23.792297+0000","last_fullsized":"2024-09-21T03:20:23.792297+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:22.935292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.374031+0000","last_change":"2024-09-21T03:20:21.361255+0000","last_active":"2024-09-21T03:20:22.374031+0000","last_peered":"2024-09-21T03:20:22.374031+0000","last_clean":"2024-09-21T03:20:22.374031+0000","last_became_active":"2024-09-21T03:20:21.360928+0000","last_became_peered":"2024-09-21T03:20:21.360928+0000","last_unstale":"2024-09-21T03:20:22.374031+0000","last_undegraded":"2024-09-21T03:20:22.374031+0000","last_fullsized":"2024-09-21T03:20:22.374031+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:33.367277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":151,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-21T03:20:22.346239+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:20:22.346239+0000","last_peered":"2024-09-21T03:20:22.346239+0000","last_clean":"2024-09-21T03:20:22.346239+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:20:22.346239+0000","last_undegraded":"2024-09-21T03:20:22.346239+0000","last_fullsized":"2024-09-21T03:20:22.346239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509470,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28112,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343728,"statfs":{"total":96636764160,"available":96607977472,"internally_reserved":0,"allocated":1105920,"data_stored":791777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509469,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27544,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":528384,"data_stored":208291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509468,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":512000,"data_stored":201389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509468,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":532480,"data_stored":209231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509469,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31700,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340140,"statfs":{"total":96636764160,"available":96604303360,"internally_reserved":0,"allocated":520192,"data_stored":201957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":524288,"data_stored":202953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509469,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":512000,"data_stored":201389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1118208,"data_stored":798021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:20:28.323 INFO:tasks.ceph.mds.c.smithi105.stderr:2024-09-21T03:20:28.321+0000 7fb469598640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T03:20:30.894 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:20:31.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.019+0000 7f6891920640 1 -- 172.21.15.105:0/1378606488 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f688c0d4ad0 msgr2=0x7f688c0b3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:31.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.019+0000 7f6891920640 1 --2- 172.21.15.105:0/1378606488 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f688c0d4ad0 0x7f688c0b3db0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f6880009830 tx=0x7f688002a510 comp rx=0 tx=0).stop 2024-09-21T03:20:31.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.019+0000 7f6891920640 1 -- 172.21.15.105:0/1378606488 shutdown_connections 2024-09-21T03:20:31.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.019+0000 7f6891920640 1 --2- 172.21.15.105:0/1378606488 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f688c0d4ad0 0x7f688c0b3db0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:31.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.019+0000 7f6891920640 1 -- 172.21.15.105:0/1378606488 >> 172.21.15.105:0/1378606488 conn(0x7f688c08bfc0 msgr2=0x7f688c09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:31.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.019+0000 7f6891920640 1 -- 172.21.15.105:0/1378606488 shutdown_connections 2024-09-21T03:20:31.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.019+0000 7f6891920640 1 -- 172.21.15.105:0/1378606488 wait complete. 2024-09-21T03:20:31.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.021+0000 7f6891920640 1 Processor -- start 2024-09-21T03:20:31.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.021+0000 7f6891920640 1 -- start start 2024-09-21T03:20:31.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.022+0000 7f6891920640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f688c0b39a0 0x7f688c168bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:31.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.022+0000 7f6891920640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f688c0b8500 0x7f688c15aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:31.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.022+0000 7f6891920640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f688c0d4ad0 0x7f688c15f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:31.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.022+0000 7f6891920640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f688c0b9450 con 0x7f688c0b8500 2024-09-21T03:20:31.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.022+0000 7f6891920640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f688c0b92d0 con 0x7f688c0d4ad0 2024-09-21T03:20:31.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.022+0000 7f6891920640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f688c0b95d0 con 0x7f688c0b39a0 2024-09-21T03:20:31.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.022+0000 7f688a7fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f688c0b8500 0x7f688c15aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:31.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.022+0000 7f688a7fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f688c0b8500 0x7f688c15aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:57980/0 (socket says 172.21.15.105:57980) 2024-09-21T03:20:31.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.022+0000 7f688a7fc640 1 -- 172.21.15.105:0/3699113655 learned_addr learned my addr 172.21.15.105:0/3699113655 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:31.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.023+0000 7f688affd640 1 --2- 172.21.15.105:0/3699113655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f688c0b39a0 0x7f688c168bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:31.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.023+0000 7f688b7fe640 1 --2- 172.21.15.105:0/3699113655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f688c0d4ad0 0x7f688c15f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:31.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.023+0000 7f688a7fc640 1 -- 172.21.15.105:0/3699113655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f688c0b39a0 msgr2=0x7f688c168bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:31.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.023+0000 7f688a7fc640 1 --2- 172.21.15.105:0/3699113655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f688c0b39a0 0x7f688c168bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:31.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.023+0000 7f688a7fc640 1 -- 172.21.15.105:0/3699113655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f688c0d4ad0 msgr2=0x7f688c15f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:31.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.023+0000 7f688a7fc640 1 --2- 172.21.15.105:0/3699113655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f688c0d4ad0 0x7f688c15f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:31.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.023+0000 7f688a7fc640 1 -- 172.21.15.105:0/3699113655 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f688c160790 con 0x7f688c0b8500 2024-09-21T03:20:31.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.023+0000 7f688a7fc640 1 --2- 172.21.15.105:0/3699113655 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f688c0b8500 0x7f688c15aef0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6880009950 tx=0x7f6880033d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:31.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.023+0000 7f6873fff640 1 -- 172.21.15.105:0/3699113655 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6880031d60 con 0x7f688c0b8500 2024-09-21T03:20:31.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.023+0000 7f6873fff640 1 -- 172.21.15.105:0/3699113655 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f68800330d0 con 0x7f688c0b8500 2024-09-21T03:20:31.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.023+0000 7f6891920640 1 -- 172.21.15.105:0/3699113655 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f688c160a70 con 0x7f688c0b8500 2024-09-21T03:20:31.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.023+0000 7f6873fff640 1 -- 172.21.15.105:0/3699113655 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6880033520 con 0x7f688c0b8500 2024-09-21T03:20:31.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.023+0000 7f6891920640 1 -- 172.21.15.105:0/3699113655 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f688c161030 con 0x7f688c0b8500 2024-09-21T03:20:31.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.024+0000 7f6891920640 1 -- 172.21.15.105:0/3699113655 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f688c169400 con 0x7f688c0b8500 2024-09-21T03:20:31.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.025+0000 7f6873fff640 1 -- 172.21.15.105:0/3699113655 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f68800035f0 con 0x7f688c0b8500 2024-09-21T03:20:31.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.025+0000 7f6873fff640 1 --2- 172.21.15.105:0/3699113655 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6878078bc0 0x7f687807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:31.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.026+0000 7f6873fff640 1 -- 172.21.15.105:0/3699113655 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f68800bc430 con 0x7f688c0b8500 2024-09-21T03:20:31.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.026+0000 7f688affd640 1 --2- 172.21.15.105:0/3699113655 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6878078bc0 0x7f687807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:31.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.026+0000 7f688affd640 1 --2- 172.21.15.105:0/3699113655 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6878078bc0 0x7f687807b0d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f688c0a24d0 tx=0x7f687c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:31.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.030+0000 7f6873fff640 1 -- 172.21.15.105:0/3699113655 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6880048060 con 0x7f688c0b8500 2024-09-21T03:20:31.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.203+0000 7f6891920640 1 -- 172.21.15.105:0/3699113655 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f688c0b3db0 con 0x7f6878078bc0 2024-09-21T03:20:31.209 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.208+0000 7f6873fff640 1 -- 172.21.15.105:0/3699113655 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251885 (secure 0 0 0) 0x7f688c0b3db0 con 0x7f6878078bc0 2024-09-21T03:20:31.212 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:20:31.213 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:20:31.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.211+0000 7f6891920640 1 -- 172.21.15.105:0/3699113655 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6878078bc0 msgr2=0x7f687807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:31.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.211+0000 7f6891920640 1 --2- 172.21.15.105:0/3699113655 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6878078bc0 0x7f687807b0d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f688c0a24d0 tx=0x7f687c008040 comp rx=0 tx=0).stop 2024-09-21T03:20:31.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.211+0000 7f6891920640 1 -- 172.21.15.105:0/3699113655 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f688c0b8500 msgr2=0x7f688c15aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:31.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.211+0000 7f6891920640 1 --2- 172.21.15.105:0/3699113655 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f688c0b8500 0x7f688c15aef0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6880009950 tx=0x7f6880033d40 comp rx=0 tx=0).stop 2024-09-21T03:20:31.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.211+0000 7f6891920640 1 -- 172.21.15.105:0/3699113655 shutdown_connections 2024-09-21T03:20:31.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.211+0000 7f6891920640 1 --2- 172.21.15.105:0/3699113655 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6878078bc0 0x7f687807b0d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:31.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.211+0000 7f6891920640 1 --2- 172.21.15.105:0/3699113655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f688c0d4ad0 0x7f688c15f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:31.216 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.211+0000 7f6891920640 1 --2- 172.21.15.105:0/3699113655 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f688c0b8500 0x7f688c15aef0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:31.216 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.211+0000 7f6891920640 1 --2- 172.21.15.105:0/3699113655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f688c0b39a0 0x7f688c168bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:31.216 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.211+0000 7f6891920640 1 -- 172.21.15.105:0/3699113655 >> 172.21.15.105:0/3699113655 conn(0x7f688c08bfc0 msgr2=0x7f688c0b5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:31.216 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.211+0000 7f6891920640 1 -- 172.21.15.105:0/3699113655 shutdown_connections 2024-09-21T03:20:31.216 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.211+0000 7f6891920640 1 -- 172.21.15.105:0/3699113655 wait complete. 2024-09-21T03:20:31.224 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2024-09-21T03:20:29.309949+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229832,"kb_used_data":5288,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744888,"statfs":{"total":773094113280,"available":772858765312,"internally_reserved":0,"allocated":5414912,"data_stored":2846508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.965604"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.760515+0000","last_change":"2024-09-21T03:20:22.354648+0000","last_active":"2024-09-21T03:20:24.760515+0000","last_peered":"2024-09-21T03:20:24.760515+0000","last_clean":"2024-09-21T03:20:24.760515+0000","last_became_active":"2024-09-21T03:20:22.354279+0000","last_became_peered":"2024-09-21T03:20:22.354279+0000","last_unstale":"2024-09-21T03:20:24.760515+0000","last_undegraded":"2024-09-21T03:20:24.760515+0000","last_fullsized":"2024-09-21T03:20:24.760515+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:10.473935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.760861+0000","last_change":"2024-09-21T03:20:22.363925+0000","last_active":"2024-09-21T03:20:24.760861+0000","last_peered":"2024-09-21T03:20:24.760861+0000","last_clean":"2024-09-21T03:20:24.760861+0000","last_became_active":"2024-09-21T03:20:22.363588+0000","last_became_peered":"2024-09-21T03:20:22.363588+0000","last_unstale":"2024-09-21T03:20:24.760861+0000","last_undegraded":"2024-09-21T03:20:24.760861+0000","last_fullsized":"2024-09-21T03:20:24.760861+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:49.164489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362247+0000","last_change":"2024-09-21T03:20:22.356946+0000","last_active":"2024-09-21T03:20:23.362247+0000","last_peered":"2024-09-21T03:20:23.362247+0000","last_clean":"2024-09-21T03:20:23.362247+0000","last_became_active":"2024-09-21T03:20:22.356625+0000","last_became_peered":"2024-09-21T03:20:22.356625+0000","last_unstale":"2024-09-21T03:20:23.362247+0000","last_undegraded":"2024-09-21T03:20:23.362247+0000","last_fullsized":"2024-09-21T03:20:23.362247+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:24.993031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.791950+0000","last_change":"2024-09-21T03:20:22.370209+0000","last_active":"2024-09-21T03:20:23.791950+0000","last_peered":"2024-09-21T03:20:23.791950+0000","last_clean":"2024-09-21T03:20:23.791950+0000","last_became_active":"2024-09-21T03:20:22.369891+0000","last_became_peered":"2024-09-21T03:20:22.369891+0000","last_unstale":"2024-09-21T03:20:23.791950+0000","last_undegraded":"2024-09-21T03:20:23.791950+0000","last_fullsized":"2024-09-21T03:20:23.791950+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:31:34.747739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.760067+0000","last_change":"2024-09-21T03:20:22.368074+0000","last_active":"2024-09-21T03:20:24.760067+0000","last_peered":"2024-09-21T03:20:24.760067+0000","last_clean":"2024-09-21T03:20:24.760067+0000","last_became_active":"2024-09-21T03:20:22.367712+0000","last_became_peered":"2024-09-21T03:20:22.367712+0000","last_unstale":"2024-09-21T03:20:24.760067+0000","last_undegraded":"2024-09-21T03:20:24.760067+0000","last_fullsized":"2024-09-21T03:20:24.760067+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:13.875837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.346788+0000","last_change":"2024-09-21T03:20:22.357312+0000","last_active":"2024-09-21T03:20:24.346788+0000","last_peered":"2024-09-21T03:20:24.346788+0000","last_clean":"2024-09-21T03:20:24.346788+0000","last_became_active":"2024-09-21T03:20:22.356723+0000","last_became_peered":"2024-09-21T03:20:22.356723+0000","last_unstale":"2024-09-21T03:20:24.346788+0000","last_undegraded":"2024-09-21T03:20:24.346788+0000","last_fullsized":"2024-09-21T03:20:24.346788+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:36:16.866206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.760488+0000","last_change":"2024-09-21T03:20:22.354451+0000","last_active":"2024-09-21T03:20:24.760488+0000","last_peered":"2024-09-21T03:20:24.760488+0000","last_clean":"2024-09-21T03:20:24.760488+0000","last_became_active":"2024-09-21T03:20:22.354036+0000","last_became_peered":"2024-09-21T03:20:22.354036+0000","last_unstale":"2024-09-21T03:20:24.760488+0000","last_undegraded":"2024-09-21T03:20:24.760488+0000","last_fullsized":"2024-09-21T03:20:24.760488+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:37:46.822052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.792056+0000","last_change":"2024-09-21T03:20:22.370356+0000","last_active":"2024-09-21T03:20:23.792056+0000","last_peered":"2024-09-21T03:20:23.792056+0000","last_clean":"2024-09-21T03:20:23.792056+0000","last_became_active":"2024-09-21T03:20:22.370057+0000","last_became_peered":"2024-09-21T03:20:22.370057+0000","last_unstale":"2024-09-21T03:20:23.792056+0000","last_undegraded":"2024-09-21T03:20:23.792056+0000","last_fullsized":"2024-09-21T03:20:23.792056+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:19:16.451895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.791932+0000","last_change":"2024-09-21T03:20:22.375061+0000","last_active":"2024-09-21T03:20:23.791932+0000","last_peered":"2024-09-21T03:20:23.791932+0000","last_clean":"2024-09-21T03:20:23.791932+0000","last_became_active":"2024-09-21T03:20:22.374755+0000","last_became_peered":"2024-09-21T03:20:22.374755+0000","last_unstale":"2024-09-21T03:20:23.791932+0000","last_undegraded":"2024-09-21T03:20:23.791932+0000","last_fullsized":"2024-09-21T03:20:23.791932+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:42.265030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.792274+0000","last_change":"2024-09-21T03:20:22.374096+0000","last_active":"2024-09-21T03:20:23.792274+0000","last_peered":"2024-09-21T03:20:23.792274+0000","last_clean":"2024-09-21T03:20:23.792274+0000","last_became_active":"2024-09-21T03:20:22.373513+0000","last_became_peered":"2024-09-21T03:20:22.373513+0000","last_unstale":"2024-09-21T03:20:23.792274+0000","last_undegraded":"2024-09-21T03:20:23.792274+0000","last_fullsized":"2024-09-21T03:20:23.792274+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:12.559413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.792003+0000","last_change":"2024-09-21T03:20:22.366527+0000","last_active":"2024-09-21T03:20:23.792003+0000","last_peered":"2024-09-21T03:20:23.792003+0000","last_clean":"2024-09-21T03:20:23.792003+0000","last_became_active":"2024-09-21T03:20:22.366208+0000","last_became_peered":"2024-09-21T03:20:22.366208+0000","last_unstale":"2024-09-21T03:20:23.792003+0000","last_undegraded":"2024-09-21T03:20:23.792003+0000","last_fullsized":"2024-09-21T03:20:23.792003+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:26.097239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.760248+0000","last_change":"2024-09-21T03:20:22.361976+0000","last_active":"2024-09-21T03:20:24.760248+0000","last_peered":"2024-09-21T03:20:24.760248+0000","last_clean":"2024-09-21T03:20:24.760248+0000","last_became_active":"2024-09-21T03:20:22.361662+0000","last_became_peered":"2024-09-21T03:20:22.361662+0000","last_unstale":"2024-09-21T03:20:24.760248+0000","last_undegraded":"2024-09-21T03:20:24.760248+0000","last_fullsized":"2024-09-21T03:20:24.760248+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:10:22.661035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.361094+0000","last_change":"2024-09-21T03:20:22.370554+0000","last_active":"2024-09-21T03:20:23.361094+0000","last_peered":"2024-09-21T03:20:23.361094+0000","last_clean":"2024-09-21T03:20:23.361094+0000","last_became_active":"2024-09-21T03:20:22.370255+0000","last_became_peered":"2024-09-21T03:20:22.370255+0000","last_unstale":"2024-09-21T03:20:23.361094+0000","last_undegraded":"2024-09-21T03:20:23.361094+0000","last_fullsized":"2024-09-21T03:20:23.361094+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:10:31.487754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.791740+0000","last_change":"2024-09-21T03:20:22.374994+0000","last_active":"2024-09-21T03:20:23.791740+0000","last_peered":"2024-09-21T03:20:23.791740+0000","last_clean":"2024-09-21T03:20:23.791740+0000","last_became_active":"2024-09-21T03:20:22.374691+0000","last_became_peered":"2024-09-21T03:20:22.374691+0000","last_unstale":"2024-09-21T03:20:23.791740+0000","last_undegraded":"2024-09-21T03:20:23.791740+0000","last_fullsized":"2024-09-21T03:20:23.791740+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:16:58.258239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.346735+0000","last_change":"2024-09-21T03:20:22.364458+0000","last_active":"2024-09-21T03:20:24.346735+0000","last_peered":"2024-09-21T03:20:24.346735+0000","last_clean":"2024-09-21T03:20:24.346735+0000","last_became_active":"2024-09-21T03:20:22.363602+0000","last_became_peered":"2024-09-21T03:20:22.363602+0000","last_unstale":"2024-09-21T03:20:24.346735+0000","last_undegraded":"2024-09-21T03:20:24.346735+0000","last_fullsized":"2024-09-21T03:20:24.346735+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:53:37.232684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362357+0000","last_change":"2024-09-21T03:20:22.364557+0000","last_active":"2024-09-21T03:20:23.362357+0000","last_peered":"2024-09-21T03:20:23.362357+0000","last_clean":"2024-09-21T03:20:23.362357+0000","last_became_active":"2024-09-21T03:20:22.364229+0000","last_became_peered":"2024-09-21T03:20:22.364229+0000","last_unstale":"2024-09-21T03:20:23.362357+0000","last_undegraded":"2024-09-21T03:20:23.362357+0000","last_fullsized":"2024-09-21T03:20:23.362357+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:04.759943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363685+0000","last_change":"2024-09-21T03:20:22.362778+0000","last_active":"2024-09-21T03:20:23.363685+0000","last_peered":"2024-09-21T03:20:23.363685+0000","last_clean":"2024-09-21T03:20:23.363685+0000","last_became_active":"2024-09-21T03:20:22.362478+0000","last_became_peered":"2024-09-21T03:20:22.362478+0000","last_unstale":"2024-09-21T03:20:23.363685+0000","last_undegraded":"2024-09-21T03:20:23.363685+0000","last_fullsized":"2024-09-21T03:20:23.363685+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:11.553421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362843+0000","last_change":"2024-09-21T03:20:22.363582+0000","last_active":"2024-09-21T03:20:23.362843+0000","last_peered":"2024-09-21T03:20:23.362843+0000","last_clean":"2024-09-21T03:20:23.362843+0000","last_became_active":"2024-09-21T03:20:22.363282+0000","last_became_peered":"2024-09-21T03:20:22.363282+0000","last_unstale":"2024-09-21T03:20:23.362843+0000","last_undegraded":"2024-09-21T03:20:23.362843+0000","last_fullsized":"2024-09-21T03:20:23.362843+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:23:12.532832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363362+0000","last_change":"2024-09-21T03:20:22.363482+0000","last_active":"2024-09-21T03:20:23.363362+0000","last_peered":"2024-09-21T03:20:23.363362+0000","last_clean":"2024-09-21T03:20:23.363362+0000","last_became_active":"2024-09-21T03:20:22.363129+0000","last_became_peered":"2024-09-21T03:20:22.363129+0000","last_unstale":"2024-09-21T03:20:23.363362+0000","last_undegraded":"2024-09-21T03:20:23.363362+0000","last_fullsized":"2024-09-21T03:20:23.363362+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:12:18.021857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.360949+0000","last_change":"2024-09-21T03:20:22.370285+0000","last_active":"2024-09-21T03:20:23.360949+0000","last_peered":"2024-09-21T03:20:23.360949+0000","last_clean":"2024-09-21T03:20:23.360949+0000","last_became_active":"2024-09-21T03:20:22.369715+0000","last_became_peered":"2024-09-21T03:20:22.369715+0000","last_unstale":"2024-09-21T03:20:23.360949+0000","last_undegraded":"2024-09-21T03:20:23.360949+0000","last_fullsized":"2024-09-21T03:20:23.360949+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:19:08.636582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.346848+0000","last_change":"2024-09-21T03:20:22.361197+0000","last_active":"2024-09-21T03:20:24.346848+0000","last_peered":"2024-09-21T03:20:24.346848+0000","last_clean":"2024-09-21T03:20:24.346848+0000","last_became_active":"2024-09-21T03:20:22.360584+0000","last_became_peered":"2024-09-21T03:20:22.360584+0000","last_unstale":"2024-09-21T03:20:24.346848+0000","last_undegraded":"2024-09-21T03:20:24.346848+0000","last_fullsized":"2024-09-21T03:20:24.346848+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:19.021427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.791825+0000","last_change":"2024-09-21T03:20:22.370778+0000","last_active":"2024-09-21T03:20:23.791825+0000","last_peered":"2024-09-21T03:20:23.791825+0000","last_clean":"2024-09-21T03:20:23.791825+0000","last_became_active":"2024-09-21T03:20:22.370449+0000","last_became_peered":"2024-09-21T03:20:22.370449+0000","last_unstale":"2024-09-21T03:20:23.791825+0000","last_undegraded":"2024-09-21T03:20:23.791825+0000","last_fullsized":"2024-09-21T03:20:23.791825+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:14.346939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362495+0000","last_change":"2024-09-21T03:20:22.359184+0000","last_active":"2024-09-21T03:20:23.362495+0000","last_peered":"2024-09-21T03:20:23.362495+0000","last_clean":"2024-09-21T03:20:23.362495+0000","last_became_active":"2024-09-21T03:20:22.357185+0000","last_became_peered":"2024-09-21T03:20:22.357185+0000","last_unstale":"2024-09-21T03:20:23.362495+0000","last_undegraded":"2024-09-21T03:20:23.362495+0000","last_fullsized":"2024-09-21T03:20:23.362495+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:13.194698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363072+0000","last_change":"2024-09-21T03:20:22.357204+0000","last_active":"2024-09-21T03:20:23.363072+0000","last_peered":"2024-09-21T03:20:23.363072+0000","last_clean":"2024-09-21T03:20:23.363072+0000","last_became_active":"2024-09-21T03:20:22.356888+0000","last_became_peered":"2024-09-21T03:20:22.356888+0000","last_unstale":"2024-09-21T03:20:23.363072+0000","last_undegraded":"2024-09-21T03:20:23.363072+0000","last_fullsized":"2024-09-21T03:20:23.363072+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:23:58.513737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363507+0000","last_change":"2024-09-21T03:20:22.366679+0000","last_active":"2024-09-21T03:20:23.363507+0000","last_peered":"2024-09-21T03:20:23.363507+0000","last_clean":"2024-09-21T03:20:23.363507+0000","last_became_active":"2024-09-21T03:20:22.366295+0000","last_became_peered":"2024-09-21T03:20:22.366295+0000","last_unstale":"2024-09-21T03:20:23.363507+0000","last_undegraded":"2024-09-21T03:20:23.363507+0000","last_fullsized":"2024-09-21T03:20:23.363507+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:56.748578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.360927+0000","last_change":"2024-09-21T03:20:22.363184+0000","last_active":"2024-09-21T03:20:23.360927+0000","last_peered":"2024-09-21T03:20:23.360927+0000","last_clean":"2024-09-21T03:20:23.360927+0000","last_became_active":"2024-09-21T03:20:22.362501+0000","last_became_peered":"2024-09-21T03:20:22.362501+0000","last_unstale":"2024-09-21T03:20:23.360927+0000","last_undegraded":"2024-09-21T03:20:23.360927+0000","last_fullsized":"2024-09-21T03:20:23.360927+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:21:09.148798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362478+0000","last_change":"2024-09-21T03:20:22.362032+0000","last_active":"2024-09-21T03:20:23.362478+0000","last_peered":"2024-09-21T03:20:23.362478+0000","last_clean":"2024-09-21T03:20:23.362478+0000","last_became_active":"2024-09-21T03:20:22.361748+0000","last_became_peered":"2024-09-21T03:20:22.361748+0000","last_unstale":"2024-09-21T03:20:23.362478+0000","last_undegraded":"2024-09-21T03:20:23.362478+0000","last_fullsized":"2024-09-21T03:20:23.362478+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:08.318524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.760220+0000","last_change":"2024-09-21T03:20:22.361207+0000","last_active":"2024-09-21T03:20:24.760220+0000","last_peered":"2024-09-21T03:20:24.760220+0000","last_clean":"2024-09-21T03:20:24.760220+0000","last_became_active":"2024-09-21T03:20:22.360879+0000","last_became_peered":"2024-09-21T03:20:22.360879+0000","last_unstale":"2024-09-21T03:20:24.760220+0000","last_undegraded":"2024-09-21T03:20:24.760220+0000","last_fullsized":"2024-09-21T03:20:24.760220+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:29:16.732213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362977+0000","last_change":"2024-09-21T03:20:22.358441+0000","last_active":"2024-09-21T03:20:23.362977+0000","last_peered":"2024-09-21T03:20:23.362977+0000","last_clean":"2024-09-21T03:20:23.362977+0000","last_became_active":"2024-09-21T03:20:22.358130+0000","last_became_peered":"2024-09-21T03:20:22.358130+0000","last_unstale":"2024-09-21T03:20:23.362977+0000","last_undegraded":"2024-09-21T03:20:23.362977+0000","last_fullsized":"2024-09-21T03:20:23.362977+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:06.233989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362070+0000","last_change":"2024-09-21T03:20:22.356052+0000","last_active":"2024-09-21T03:20:23.362070+0000","last_peered":"2024-09-21T03:20:23.362070+0000","last_clean":"2024-09-21T03:20:23.362070+0000","last_became_active":"2024-09-21T03:20:22.355703+0000","last_became_peered":"2024-09-21T03:20:22.355703+0000","last_unstale":"2024-09-21T03:20:23.362070+0000","last_undegraded":"2024-09-21T03:20:23.362070+0000","last_fullsized":"2024-09-21T03:20:23.362070+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:54.277955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.346794+0000","last_change":"2024-09-21T03:20:22.364133+0000","last_active":"2024-09-21T03:20:24.346794+0000","last_peered":"2024-09-21T03:20:24.346794+0000","last_clean":"2024-09-21T03:20:24.346794+0000","last_became_active":"2024-09-21T03:20:22.363162+0000","last_became_peered":"2024-09-21T03:20:22.363162+0000","last_unstale":"2024-09-21T03:20:24.346794+0000","last_undegraded":"2024-09-21T03:20:24.346794+0000","last_fullsized":"2024-09-21T03:20:24.346794+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:24.768801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.361087+0000","last_change":"2024-09-21T03:20:22.358222+0000","last_active":"2024-09-21T03:20:23.361087+0000","last_peered":"2024-09-21T03:20:23.361087+0000","last_clean":"2024-09-21T03:20:23.361087+0000","last_became_active":"2024-09-21T03:20:22.357933+0000","last_became_peered":"2024-09-21T03:20:22.357933+0000","last_unstale":"2024-09-21T03:20:23.361087+0000","last_undegraded":"2024-09-21T03:20:23.361087+0000","last_fullsized":"2024-09-21T03:20:23.361087+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:18.911040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.759404+0000","last_change":"2024-09-21T03:20:22.353413+0000","last_active":"2024-09-21T03:20:24.759404+0000","last_peered":"2024-09-21T03:20:24.759404+0000","last_clean":"2024-09-21T03:20:24.759404+0000","last_became_active":"2024-09-21T03:20:22.353091+0000","last_became_peered":"2024-09-21T03:20:22.353091+0000","last_unstale":"2024-09-21T03:20:24.759404+0000","last_undegraded":"2024-09-21T03:20:24.759404+0000","last_fullsized":"2024-09-21T03:20:24.759404+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:25:44.053419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":19,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.347207+0000","last_change":"2024-09-21T03:20:21.353455+0000","last_active":"2024-09-21T03:20:24.347207+0000","last_peered":"2024-09-21T03:20:24.347207+0000","last_clean":"2024-09-21T03:20:24.347207+0000","last_became_active":"2024-09-21T03:20:21.353167+0000","last_became_peered":"2024-09-21T03:20:21.353167+0000","last_unstale":"2024-09-21T03:20:24.347207+0000","last_undegraded":"2024-09-21T03:20:24.347207+0000","last_fullsized":"2024-09-21T03:20:24.347207+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:10.549273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363625+0000","last_change":"2024-09-21T03:20:22.360284+0000","last_active":"2024-09-21T03:20:23.363625+0000","last_peered":"2024-09-21T03:20:23.363625+0000","last_clean":"2024-09-21T03:20:23.363625+0000","last_became_active":"2024-09-21T03:20:22.359131+0000","last_became_peered":"2024-09-21T03:20:22.359131+0000","last_unstale":"2024-09-21T03:20:23.363625+0000","last_undegraded":"2024-09-21T03:20:23.363625+0000","last_fullsized":"2024-09-21T03:20:23.363625+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:27:18.588119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362999+0000","last_change":"2024-09-21T03:20:21.358490+0000","last_active":"2024-09-21T03:20:23.362999+0000","last_peered":"2024-09-21T03:20:23.362999+0000","last_clean":"2024-09-21T03:20:23.362999+0000","last_became_active":"2024-09-21T03:20:21.357991+0000","last_became_peered":"2024-09-21T03:20:21.357991+0000","last_unstale":"2024-09-21T03:20:23.362999+0000","last_undegraded":"2024-09-21T03:20:23.362999+0000","last_fullsized":"2024-09-21T03:20:23.362999+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:52.543844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.760514+0000","last_change":"2024-09-21T03:20:22.370492+0000","last_active":"2024-09-21T03:20:24.760514+0000","last_peered":"2024-09-21T03:20:24.760514+0000","last_clean":"2024-09-21T03:20:24.760514+0000","last_became_active":"2024-09-21T03:20:22.370117+0000","last_became_peered":"2024-09-21T03:20:22.370117+0000","last_unstale":"2024-09-21T03:20:24.760514+0000","last_undegraded":"2024-09-21T03:20:24.760514+0000","last_fullsized":"2024-09-21T03:20:24.760514+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:41.945879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.759525+0000","last_change":"2024-09-21T03:20:21.363908+0000","last_active":"2024-09-21T03:20:24.759525+0000","last_peered":"2024-09-21T03:20:24.759525+0000","last_clean":"2024-09-21T03:20:24.759525+0000","last_became_active":"2024-09-21T03:20:21.363494+0000","last_became_peered":"2024-09-21T03:20:21.363494+0000","last_unstale":"2024-09-21T03:20:24.759525+0000","last_undegraded":"2024-09-21T03:20:24.759525+0000","last_fullsized":"2024-09-21T03:20:24.759525+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:40.157840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.759548+0000","last_change":"2024-09-21T03:20:22.357615+0000","last_active":"2024-09-21T03:20:24.759548+0000","last_peered":"2024-09-21T03:20:24.759548+0000","last_clean":"2024-09-21T03:20:24.759548+0000","last_became_active":"2024-09-21T03:20:22.357317+0000","last_became_peered":"2024-09-21T03:20:22.357317+0000","last_unstale":"2024-09-21T03:20:24.759548+0000","last_undegraded":"2024-09-21T03:20:24.759548+0000","last_fullsized":"2024-09-21T03:20:24.759548+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:01:16.167419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.760564+0000","last_change":"2024-09-21T03:20:21.361902+0000","last_active":"2024-09-21T03:20:24.760564+0000","last_peered":"2024-09-21T03:20:24.760564+0000","last_clean":"2024-09-21T03:20:24.760564+0000","last_became_active":"2024-09-21T03:20:21.361549+0000","last_became_peered":"2024-09-21T03:20:21.361549+0000","last_unstale":"2024-09-21T03:20:24.760564+0000","last_undegraded":"2024-09-21T03:20:24.760564+0000","last_fullsized":"2024-09-21T03:20:24.760564+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:26.623870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362338+0000","last_change":"2024-09-21T03:20:22.353213+0000","last_active":"2024-09-21T03:20:23.362338+0000","last_peered":"2024-09-21T03:20:23.362338+0000","last_clean":"2024-09-21T03:20:23.362338+0000","last_became_active":"2024-09-21T03:20:22.352809+0000","last_became_peered":"2024-09-21T03:20:22.352809+0000","last_unstale":"2024-09-21T03:20:23.362338+0000","last_undegraded":"2024-09-21T03:20:23.362338+0000","last_fullsized":"2024-09-21T03:20:23.362338+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:51:09.144620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.347124+0000","last_change":"2024-09-21T03:20:21.360479+0000","last_active":"2024-09-21T03:20:24.347124+0000","last_peered":"2024-09-21T03:20:24.347124+0000","last_clean":"2024-09-21T03:20:24.347124+0000","last_became_active":"2024-09-21T03:20:21.360179+0000","last_became_peered":"2024-09-21T03:20:21.360179+0000","last_unstale":"2024-09-21T03:20:24.347124+0000","last_undegraded":"2024-09-21T03:20:24.347124+0000","last_fullsized":"2024-09-21T03:20:24.347124+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:31.358952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.791964+0000","last_change":"2024-09-21T03:20:22.373116+0000","last_active":"2024-09-21T03:20:23.791964+0000","last_peered":"2024-09-21T03:20:23.791964+0000","last_clean":"2024-09-21T03:20:23.791964+0000","last_became_active":"2024-09-21T03:20:22.372787+0000","last_became_peered":"2024-09-21T03:20:22.372787+0000","last_unstale":"2024-09-21T03:20:23.791964+0000","last_undegraded":"2024-09-21T03:20:23.791964+0000","last_fullsized":"2024-09-21T03:20:23.791964+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:20.930083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362478+0000","last_change":"2024-09-21T03:20:21.360913+0000","last_active":"2024-09-21T03:20:23.362478+0000","last_peered":"2024-09-21T03:20:23.362478+0000","last_clean":"2024-09-21T03:20:23.362478+0000","last_became_active":"2024-09-21T03:20:21.360581+0000","last_became_peered":"2024-09-21T03:20:21.360581+0000","last_unstale":"2024-09-21T03:20:23.362478+0000","last_undegraded":"2024-09-21T03:20:23.362478+0000","last_fullsized":"2024-09-21T03:20:23.362478+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:57.040972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.792193+0000","last_change":"2024-09-21T03:20:22.371286+0000","last_active":"2024-09-21T03:20:23.792193+0000","last_peered":"2024-09-21T03:20:23.792193+0000","last_clean":"2024-09-21T03:20:23.792193+0000","last_became_active":"2024-09-21T03:20:22.370947+0000","last_became_peered":"2024-09-21T03:20:22.370947+0000","last_unstale":"2024-09-21T03:20:23.792193+0000","last_undegraded":"2024-09-21T03:20:23.792193+0000","last_fullsized":"2024-09-21T03:20:23.792193+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:57:43.539037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.759974+0000","last_change":"2024-09-21T03:20:21.363512+0000","last_active":"2024-09-21T03:20:24.759974+0000","last_peered":"2024-09-21T03:20:24.759974+0000","last_clean":"2024-09-21T03:20:24.759974+0000","last_became_active":"2024-09-21T03:20:21.363215+0000","last_became_peered":"2024-09-21T03:20:21.363215+0000","last_unstale":"2024-09-21T03:20:24.759974+0000","last_undegraded":"2024-09-21T03:20:24.759974+0000","last_fullsized":"2024-09-21T03:20:24.759974+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:48.695082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362814+0000","last_change":"2024-09-21T03:20:22.359160+0000","last_active":"2024-09-21T03:20:23.362814+0000","last_peered":"2024-09-21T03:20:23.362814+0000","last_clean":"2024-09-21T03:20:23.362814+0000","last_became_active":"2024-09-21T03:20:22.356795+0000","last_became_peered":"2024-09-21T03:20:22.356795+0000","last_unstale":"2024-09-21T03:20:23.362814+0000","last_undegraded":"2024-09-21T03:20:23.362814+0000","last_fullsized":"2024-09-21T03:20:23.362814+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:48.006533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.792351+0000","last_change":"2024-09-21T03:20:21.359300+0000","last_active":"2024-09-21T03:20:23.792351+0000","last_peered":"2024-09-21T03:20:23.792351+0000","last_clean":"2024-09-21T03:20:23.792351+0000","last_became_active":"2024-09-21T03:20:21.358998+0000","last_became_peered":"2024-09-21T03:20:21.358998+0000","last_unstale":"2024-09-21T03:20:23.792351+0000","last_undegraded":"2024-09-21T03:20:23.792351+0000","last_fullsized":"2024-09-21T03:20:23.792351+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:51.051421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362865+0000","last_change":"2024-09-21T03:20:22.361977+0000","last_active":"2024-09-21T03:20:23.362865+0000","last_peered":"2024-09-21T03:20:23.362865+0000","last_clean":"2024-09-21T03:20:23.362865+0000","last_became_active":"2024-09-21T03:20:22.361641+0000","last_became_peered":"2024-09-21T03:20:22.361641+0000","last_unstale":"2024-09-21T03:20:23.362865+0000","last_undegraded":"2024-09-21T03:20:23.362865+0000","last_fullsized":"2024-09-21T03:20:23.362865+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:34.601478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363827+0000","last_change":"2024-09-21T03:20:21.358364+0000","last_active":"2024-09-21T03:20:23.363827+0000","last_peered":"2024-09-21T03:20:23.363827+0000","last_clean":"2024-09-21T03:20:23.363827+0000","last_became_active":"2024-09-21T03:20:21.357818+0000","last_became_peered":"2024-09-21T03:20:21.357818+0000","last_unstale":"2024-09-21T03:20:23.363827+0000","last_undegraded":"2024-09-21T03:20:23.363827+0000","last_fullsized":"2024-09-21T03:20:23.363827+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:40.157840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.760869+0000","last_change":"2024-09-21T03:20:22.365443+0000","last_active":"2024-09-21T03:20:24.760869+0000","last_peered":"2024-09-21T03:20:24.760869+0000","last_clean":"2024-09-21T03:20:24.760869+0000","last_became_active":"2024-09-21T03:20:22.365081+0000","last_became_peered":"2024-09-21T03:20:22.365081+0000","last_unstale":"2024-09-21T03:20:24.760869+0000","last_undegraded":"2024-09-21T03:20:24.760869+0000","last_fullsized":"2024-09-21T03:20:24.760869+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:29.987903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.792406+0000","last_change":"2024-09-21T03:20:21.360629+0000","last_active":"2024-09-21T03:20:23.792406+0000","last_peered":"2024-09-21T03:20:23.792406+0000","last_clean":"2024-09-21T03:20:23.792406+0000","last_became_active":"2024-09-21T03:20:21.360357+0000","last_became_peered":"2024-09-21T03:20:21.360357+0000","last_unstale":"2024-09-21T03:20:23.792406+0000","last_undegraded":"2024-09-21T03:20:23.792406+0000","last_fullsized":"2024-09-21T03:20:23.792406+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:00:30.088576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.347307+0000","last_change":"2024-09-21T03:20:22.368659+0000","last_active":"2024-09-21T03:20:24.347307+0000","last_peered":"2024-09-21T03:20:24.347307+0000","last_clean":"2024-09-21T03:20:24.347307+0000","last_became_active":"2024-09-21T03:20:22.359839+0000","last_became_peered":"2024-09-21T03:20:22.359839+0000","last_unstale":"2024-09-21T03:20:24.347307+0000","last_undegraded":"2024-09-21T03:20:24.347307+0000","last_fullsized":"2024-09-21T03:20:24.347307+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:43:38.717121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":18,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.760830+0000","last_change":"2024-09-21T03:20:21.360749+0000","last_active":"2024-09-21T03:20:24.760830+0000","last_peered":"2024-09-21T03:20:24.760830+0000","last_clean":"2024-09-21T03:20:24.760830+0000","last_became_active":"2024-09-21T03:20:21.359582+0000","last_became_peered":"2024-09-21T03:20:21.359582+0000","last_unstale":"2024-09-21T03:20:24.760830+0000","last_undegraded":"2024-09-21T03:20:24.760830+0000","last_fullsized":"2024-09-21T03:20:24.760830+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:33.367277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.760609+0000","last_change":"2024-09-21T03:20:22.354530+0000","last_active":"2024-09-21T03:20:24.760609+0000","last_peered":"2024-09-21T03:20:24.760609+0000","last_clean":"2024-09-21T03:20:24.760609+0000","last_became_active":"2024-09-21T03:20:22.354017+0000","last_became_peered":"2024-09-21T03:20:22.354017+0000","last_unstale":"2024-09-21T03:20:24.760609+0000","last_undegraded":"2024-09-21T03:20:24.760609+0000","last_fullsized":"2024-09-21T03:20:24.760609+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:20.393544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":21,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.360948+0000","last_change":"2024-09-21T03:20:21.359485+0000","last_active":"2024-09-21T03:20:23.360948+0000","last_peered":"2024-09-21T03:20:23.360948+0000","last_clean":"2024-09-21T03:20:23.360948+0000","last_became_active":"2024-09-21T03:20:21.359182+0000","last_became_peered":"2024-09-21T03:20:21.359182+0000","last_unstale":"2024-09-21T03:20:23.360948+0000","last_undegraded":"2024-09-21T03:20:23.360948+0000","last_fullsized":"2024-09-21T03:20:23.360948+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:06:13.612749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363374+0000","last_change":"2024-09-21T03:20:22.363602+0000","last_active":"2024-09-21T03:20:23.363374+0000","last_peered":"2024-09-21T03:20:23.363374+0000","last_clean":"2024-09-21T03:20:23.363374+0000","last_became_active":"2024-09-21T03:20:22.363245+0000","last_became_peered":"2024-09-21T03:20:22.363245+0000","last_unstale":"2024-09-21T03:20:23.363374+0000","last_undegraded":"2024-09-21T03:20:23.363374+0000","last_fullsized":"2024-09-21T03:20:23.363374+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:58:04.733519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.347239+0000","last_change":"2024-09-21T03:20:21.362428+0000","last_active":"2024-09-21T03:20:24.347239+0000","last_peered":"2024-09-21T03:20:24.347239+0000","last_clean":"2024-09-21T03:20:24.347239+0000","last_became_active":"2024-09-21T03:20:21.362120+0000","last_became_peered":"2024-09-21T03:20:21.362120+0000","last_unstale":"2024-09-21T03:20:24.347239+0000","last_undegraded":"2024-09-21T03:20:24.347239+0000","last_fullsized":"2024-09-21T03:20:24.347239+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:07.239411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.792028+0000","last_change":"2024-09-21T03:20:22.369474+0000","last_active":"2024-09-21T03:20:23.792028+0000","last_peered":"2024-09-21T03:20:23.792028+0000","last_clean":"2024-09-21T03:20:23.792028+0000","last_became_active":"2024-09-21T03:20:22.368848+0000","last_became_peered":"2024-09-21T03:20:22.368848+0000","last_unstale":"2024-09-21T03:20:23.792028+0000","last_undegraded":"2024-09-21T03:20:23.792028+0000","last_fullsized":"2024-09-21T03:20:23.792028+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:32:28.415345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.760282+0000","last_change":"2024-09-21T03:20:21.357809+0000","last_active":"2024-09-21T03:20:24.760282+0000","last_peered":"2024-09-21T03:20:24.760282+0000","last_clean":"2024-09-21T03:20:24.760282+0000","last_became_active":"2024-09-21T03:20:21.357478+0000","last_became_peered":"2024-09-21T03:20:21.357478+0000","last_unstale":"2024-09-21T03:20:24.760282+0000","last_undegraded":"2024-09-21T03:20:24.760282+0000","last_fullsized":"2024-09-21T03:20:24.760282+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:31.358952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.346698+0000","last_change":"2024-09-21T03:20:22.358128+0000","last_active":"2024-09-21T03:20:24.346698+0000","last_peered":"2024-09-21T03:20:24.346698+0000","last_clean":"2024-09-21T03:20:24.346698+0000","last_became_active":"2024-09-21T03:20:22.357840+0000","last_became_peered":"2024-09-21T03:20:22.357840+0000","last_unstale":"2024-09-21T03:20:24.346698+0000","last_undegraded":"2024-09-21T03:20:24.346698+0000","last_fullsized":"2024-09-21T03:20:24.346698+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:43.027587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.346961+0000","last_change":"2024-09-21T03:20:21.362378+0000","last_active":"2024-09-21T03:20:24.346961+0000","last_peered":"2024-09-21T03:20:24.346961+0000","last_clean":"2024-09-21T03:20:24.346961+0000","last_became_active":"2024-09-21T03:20:21.362053+0000","last_became_peered":"2024-09-21T03:20:21.362053+0000","last_unstale":"2024-09-21T03:20:24.346961+0000","last_undegraded":"2024-09-21T03:20:24.346961+0000","last_fullsized":"2024-09-21T03:20:24.346961+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:48.695082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.760834+0000","last_change":"2024-09-21T03:20:22.352414+0000","last_active":"2024-09-21T03:20:24.760834+0000","last_peered":"2024-09-21T03:20:24.760834+0000","last_clean":"2024-09-21T03:20:24.760834+0000","last_became_active":"2024-09-21T03:20:22.352087+0000","last_became_peered":"2024-09-21T03:20:22.352087+0000","last_unstale":"2024-09-21T03:20:24.760834+0000","last_undegraded":"2024-09-21T03:20:24.760834+0000","last_fullsized":"2024-09-21T03:20:24.760834+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:28.932663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":23,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.792357+0000","last_change":"2024-09-21T03:20:21.361289+0000","last_active":"2024-09-21T03:20:23.792357+0000","last_peered":"2024-09-21T03:20:23.792357+0000","last_clean":"2024-09-21T03:20:23.792357+0000","last_became_active":"2024-09-21T03:20:21.360579+0000","last_became_peered":"2024-09-21T03:20:21.360579+0000","last_unstale":"2024-09-21T03:20:23.792357+0000","last_undegraded":"2024-09-21T03:20:23.792357+0000","last_fullsized":"2024-09-21T03:20:23.792357+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:16.835012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.361092+0000","last_change":"2024-09-21T03:20:22.363513+0000","last_active":"2024-09-21T03:20:23.361092+0000","last_peered":"2024-09-21T03:20:23.361092+0000","last_clean":"2024-09-21T03:20:23.361092+0000","last_became_active":"2024-09-21T03:20:22.362889+0000","last_became_peered":"2024-09-21T03:20:22.362889+0000","last_unstale":"2024-09-21T03:20:23.361092+0000","last_undegraded":"2024-09-21T03:20:23.361092+0000","last_fullsized":"2024-09-21T03:20:23.361092+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:44.768435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.360918+0000","last_change":"2024-09-21T03:20:21.354915+0000","last_active":"2024-09-21T03:20:23.360918+0000","last_peered":"2024-09-21T03:20:23.360918+0000","last_clean":"2024-09-21T03:20:23.360918+0000","last_became_active":"2024-09-21T03:20:21.354531+0000","last_became_peered":"2024-09-21T03:20:21.354531+0000","last_unstale":"2024-09-21T03:20:23.360918+0000","last_undegraded":"2024-09-21T03:20:23.360918+0000","last_fullsized":"2024-09-21T03:20:23.360918+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:46.767630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.792178+0000","last_change":"2024-09-21T03:20:22.371172+0000","last_active":"2024-09-21T03:20:23.792178+0000","last_peered":"2024-09-21T03:20:23.792178+0000","last_clean":"2024-09-21T03:20:23.792178+0000","last_became_active":"2024-09-21T03:20:22.370853+0000","last_became_peered":"2024-09-21T03:20:22.370853+0000","last_unstale":"2024-09-21T03:20:23.792178+0000","last_undegraded":"2024-09-21T03:20:23.792178+0000","last_fullsized":"2024-09-21T03:20:23.792178+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:58.607336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362997+0000","last_change":"2024-09-21T03:20:21.358123+0000","last_active":"2024-09-21T03:20:23.362997+0000","last_peered":"2024-09-21T03:20:23.362997+0000","last_clean":"2024-09-21T03:20:23.362997+0000","last_became_active":"2024-09-21T03:20:21.357694+0000","last_became_peered":"2024-09-21T03:20:21.357694+0000","last_unstale":"2024-09-21T03:20:23.362997+0000","last_undegraded":"2024-09-21T03:20:23.362997+0000","last_fullsized":"2024-09-21T03:20:23.362997+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:55:45.437208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362804+0000","last_change":"2024-09-21T03:20:22.354537+0000","last_active":"2024-09-21T03:20:23.362804+0000","last_peered":"2024-09-21T03:20:23.362804+0000","last_clean":"2024-09-21T03:20:23.362804+0000","last_became_active":"2024-09-21T03:20:22.354221+0000","last_became_peered":"2024-09-21T03:20:22.354221+0000","last_unstale":"2024-09-21T03:20:23.362804+0000","last_undegraded":"2024-09-21T03:20:23.362804+0000","last_fullsized":"2024-09-21T03:20:23.362804+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:33.384208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.760211+0000","last_change":"2024-09-21T03:20:21.360136+0000","last_active":"2024-09-21T03:20:24.760211+0000","last_peered":"2024-09-21T03:20:24.760211+0000","last_clean":"2024-09-21T03:20:24.760211+0000","last_became_active":"2024-09-21T03:20:21.359678+0000","last_became_peered":"2024-09-21T03:20:21.359678+0000","last_unstale":"2024-09-21T03:20:24.760211+0000","last_undegraded":"2024-09-21T03:20:24.760211+0000","last_fullsized":"2024-09-21T03:20:24.760211+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:44.853872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363330+0000","last_change":"2024-09-21T03:20:22.352124+0000","last_active":"2024-09-21T03:20:23.363330+0000","last_peered":"2024-09-21T03:20:23.363330+0000","last_clean":"2024-09-21T03:20:23.363330+0000","last_became_active":"2024-09-21T03:20:22.351748+0000","last_became_peered":"2024-09-21T03:20:22.351748+0000","last_unstale":"2024-09-21T03:20:23.363330+0000","last_undegraded":"2024-09-21T03:20:23.363330+0000","last_fullsized":"2024-09-21T03:20:23.363330+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:57.836459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.347258+0000","last_change":"2024-09-21T03:20:21.357025+0000","last_active":"2024-09-21T03:20:24.347258+0000","last_peered":"2024-09-21T03:20:24.347258+0000","last_clean":"2024-09-21T03:20:24.347258+0000","last_became_active":"2024-09-21T03:20:21.356647+0000","last_became_peered":"2024-09-21T03:20:21.356647+0000","last_unstale":"2024-09-21T03:20:24.347258+0000","last_undegraded":"2024-09-21T03:20:24.347258+0000","last_fullsized":"2024-09-21T03:20:24.347258+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:14.580199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.346879+0000","last_change":"2024-09-21T03:20:22.356328+0000","last_active":"2024-09-21T03:20:24.346879+0000","last_peered":"2024-09-21T03:20:24.346879+0000","last_clean":"2024-09-21T03:20:24.346879+0000","last_became_active":"2024-09-21T03:20:22.355690+0000","last_became_peered":"2024-09-21T03:20:22.355690+0000","last_unstale":"2024-09-21T03:20:24.346879+0000","last_undegraded":"2024-09-21T03:20:24.346879+0000","last_fullsized":"2024-09-21T03:20:24.346879+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:50.474742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.347371+0000","last_change":"2024-09-21T03:20:21.360457+0000","last_active":"2024-09-21T03:20:24.347371+0000","last_peered":"2024-09-21T03:20:24.347371+0000","last_clean":"2024-09-21T03:20:24.347371+0000","last_became_active":"2024-09-21T03:20:21.360158+0000","last_became_peered":"2024-09-21T03:20:21.360158+0000","last_unstale":"2024-09-21T03:20:24.347371+0000","last_undegraded":"2024-09-21T03:20:24.347371+0000","last_fullsized":"2024-09-21T03:20:24.347371+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:18.644256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.759335+0000","last_change":"2024-09-21T03:20:22.363703+0000","last_active":"2024-09-21T03:20:24.759335+0000","last_peered":"2024-09-21T03:20:24.759335+0000","last_clean":"2024-09-21T03:20:24.759335+0000","last_became_active":"2024-09-21T03:20:22.363365+0000","last_became_peered":"2024-09-21T03:20:22.363365+0000","last_unstale":"2024-09-21T03:20:24.759335+0000","last_undegraded":"2024-09-21T03:20:24.759335+0000","last_fullsized":"2024-09-21T03:20:24.759335+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:58:52.550597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.760003+0000","last_change":"2024-09-21T03:20:21.362530+0000","last_active":"2024-09-21T03:20:24.760003+0000","last_peered":"2024-09-21T03:20:24.760003+0000","last_clean":"2024-09-21T03:20:24.760003+0000","last_became_active":"2024-09-21T03:20:21.362236+0000","last_became_peered":"2024-09-21T03:20:21.362236+0000","last_unstale":"2024-09-21T03:20:24.760003+0000","last_undegraded":"2024-09-21T03:20:24.760003+0000","last_fullsized":"2024-09-21T03:20:24.760003+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:49.098519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.360903+0000","last_change":"2024-09-21T03:20:22.364758+0000","last_active":"2024-09-21T03:20:23.360903+0000","last_peered":"2024-09-21T03:20:23.360903+0000","last_clean":"2024-09-21T03:20:23.360903+0000","last_became_active":"2024-09-21T03:20:22.364448+0000","last_became_peered":"2024-09-21T03:20:22.364448+0000","last_unstale":"2024-09-21T03:20:23.360903+0000","last_undegraded":"2024-09-21T03:20:23.360903+0000","last_fullsized":"2024-09-21T03:20:23.360903+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:10.839820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.791688+0000","last_change":"2024-09-21T03:20:21.360800+0000","last_active":"2024-09-21T03:20:23.791688+0000","last_peered":"2024-09-21T03:20:23.791688+0000","last_clean":"2024-09-21T03:20:23.791688+0000","last_became_active":"2024-09-21T03:20:21.360480+0000","last_became_peered":"2024-09-21T03:20:21.360480+0000","last_unstale":"2024-09-21T03:20:23.791688+0000","last_undegraded":"2024-09-21T03:20:23.791688+0000","last_fullsized":"2024-09-21T03:20:23.791688+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:05:44.607927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.791705+0000","last_change":"2024-09-21T03:20:22.376273+0000","last_active":"2024-09-21T03:20:23.791705+0000","last_peered":"2024-09-21T03:20:23.791705+0000","last_clean":"2024-09-21T03:20:23.791705+0000","last_became_active":"2024-09-21T03:20:22.375651+0000","last_became_peered":"2024-09-21T03:20:22.375651+0000","last_unstale":"2024-09-21T03:20:23.791705+0000","last_undegraded":"2024-09-21T03:20:23.791705+0000","last_fullsized":"2024-09-21T03:20:23.791705+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:30:10.850700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.760647+0000","last_change":"2024-09-21T03:20:21.358799+0000","last_active":"2024-09-21T03:20:24.760647+0000","last_peered":"2024-09-21T03:20:24.760647+0000","last_clean":"2024-09-21T03:20:24.760647+0000","last_became_active":"2024-09-21T03:20:21.358305+0000","last_became_peered":"2024-09-21T03:20:21.358305+0000","last_unstale":"2024-09-21T03:20:24.760647+0000","last_undegraded":"2024-09-21T03:20:24.760647+0000","last_fullsized":"2024-09-21T03:20:24.760647+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:44.853872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363756+0000","last_change":"2024-09-21T03:20:22.365742+0000","last_active":"2024-09-21T03:20:23.363756+0000","last_peered":"2024-09-21T03:20:23.363756+0000","last_clean":"2024-09-21T03:20:23.363756+0000","last_became_active":"2024-09-21T03:20:22.365343+0000","last_became_peered":"2024-09-21T03:20:22.365343+0000","last_unstale":"2024-09-21T03:20:23.363756+0000","last_undegraded":"2024-09-21T03:20:23.363756+0000","last_fullsized":"2024-09-21T03:20:23.363756+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:07.319445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"45'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.347267+0000","last_change":"2024-09-21T03:20:21.361559+0000","last_active":"2024-09-21T03:20:24.347267+0000","last_peered":"2024-09-21T03:20:24.347267+0000","last_clean":"2024-09-21T03:20:24.347267+0000","last_became_active":"2024-09-21T03:20:21.361176+0000","last_became_peered":"2024-09-21T03:20:21.361176+0000","last_unstale":"2024-09-21T03:20:24.347267+0000","last_undegraded":"2024-09-21T03:20:24.347267+0000","last_fullsized":"2024-09-21T03:20:24.347267+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:33.367277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.792009+0000","last_change":"2024-09-21T03:20:22.361086+0000","last_active":"2024-09-21T03:20:23.792009+0000","last_peered":"2024-09-21T03:20:23.792009+0000","last_clean":"2024-09-21T03:20:23.792009+0000","last_became_active":"2024-09-21T03:20:22.360785+0000","last_became_peered":"2024-09-21T03:20:22.360785+0000","last_unstale":"2024-09-21T03:20:23.792009+0000","last_undegraded":"2024-09-21T03:20:23.792009+0000","last_fullsized":"2024-09-21T03:20:23.792009+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:49:34.422333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.761015+0000","last_change":"2024-09-21T03:20:21.361458+0000","last_active":"2024-09-21T03:20:24.761015+0000","last_peered":"2024-09-21T03:20:24.761015+0000","last_clean":"2024-09-21T03:20:24.761015+0000","last_became_active":"2024-09-21T03:20:21.360423+0000","last_became_peered":"2024-09-21T03:20:21.360423+0000","last_unstale":"2024-09-21T03:20:24.761015+0000","last_undegraded":"2024-09-21T03:20:24.761015+0000","last_fullsized":"2024-09-21T03:20:24.761015+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:07.239411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.761034+0000","last_change":"2024-09-21T03:20:22.357464+0000","last_active":"2024-09-21T03:20:24.761034+0000","last_peered":"2024-09-21T03:20:24.761034+0000","last_clean":"2024-09-21T03:20:24.761034+0000","last_became_active":"2024-09-21T03:20:22.356980+0000","last_became_peered":"2024-09-21T03:20:22.356980+0000","last_unstale":"2024-09-21T03:20:24.761034+0000","last_undegraded":"2024-09-21T03:20:24.761034+0000","last_fullsized":"2024-09-21T03:20:24.761034+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:34:26.201325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.759244+0000","last_change":"2024-09-21T03:20:21.363637+0000","last_active":"2024-09-21T03:20:24.759244+0000","last_peered":"2024-09-21T03:20:24.759244+0000","last_clean":"2024-09-21T03:20:24.759244+0000","last_became_active":"2024-09-21T03:20:21.363270+0000","last_became_peered":"2024-09-21T03:20:21.363270+0000","last_unstale":"2024-09-21T03:20:24.759244+0000","last_undegraded":"2024-09-21T03:20:24.759244+0000","last_fullsized":"2024-09-21T03:20:24.759244+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:52.543844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.347095+0000","last_change":"2024-09-21T03:20:22.357010+0000","last_active":"2024-09-21T03:20:24.347095+0000","last_peered":"2024-09-21T03:20:24.347095+0000","last_clean":"2024-09-21T03:20:24.347095+0000","last_became_active":"2024-09-21T03:20:22.356058+0000","last_became_peered":"2024-09-21T03:20:22.356058+0000","last_unstale":"2024-09-21T03:20:24.347095+0000","last_undegraded":"2024-09-21T03:20:24.347095+0000","last_fullsized":"2024-09-21T03:20:24.347095+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:52.007216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.760719+0000","last_change":"2024-09-21T03:20:21.363605+0000","last_active":"2024-09-21T03:20:24.760719+0000","last_peered":"2024-09-21T03:20:24.760719+0000","last_clean":"2024-09-21T03:20:24.760719+0000","last_became_active":"2024-09-21T03:20:21.361291+0000","last_became_peered":"2024-09-21T03:20:21.361291+0000","last_unstale":"2024-09-21T03:20:24.760719+0000","last_undegraded":"2024-09-21T03:20:24.760719+0000","last_fullsized":"2024-09-21T03:20:24.760719+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:48.695082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.347044+0000","last_change":"2024-09-21T03:20:22.360870+0000","last_active":"2024-09-21T03:20:24.347044+0000","last_peered":"2024-09-21T03:20:24.347044+0000","last_clean":"2024-09-21T03:20:24.347044+0000","last_became_active":"2024-09-21T03:20:22.360189+0000","last_became_peered":"2024-09-21T03:20:22.360189+0000","last_unstale":"2024-09-21T03:20:24.347044+0000","last_undegraded":"2024-09-21T03:20:24.347044+0000","last_fullsized":"2024-09-21T03:20:24.347044+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:15:41.082092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.363116+0000","last_change":"2024-09-21T03:20:21.358394+0000","last_active":"2024-09-21T03:20:23.363116+0000","last_peered":"2024-09-21T03:20:23.363116+0000","last_clean":"2024-09-21T03:20:23.363116+0000","last_became_active":"2024-09-21T03:20:21.358059+0000","last_became_peered":"2024-09-21T03:20:21.358059+0000","last_unstale":"2024-09-21T03:20:23.363116+0000","last_undegraded":"2024-09-21T03:20:23.363116+0000","last_fullsized":"2024-09-21T03:20:23.363116+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:01.708297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.759931+0000","last_change":"2024-09-21T03:20:22.359249+0000","last_active":"2024-09-21T03:20:24.759931+0000","last_peered":"2024-09-21T03:20:24.759931+0000","last_clean":"2024-09-21T03:20:24.759931+0000","last_became_active":"2024-09-21T03:20:22.358932+0000","last_became_peered":"2024-09-21T03:20:22.358932+0000","last_unstale":"2024-09-21T03:20:24.759931+0000","last_undegraded":"2024-09-21T03:20:24.759931+0000","last_fullsized":"2024-09-21T03:20:24.759931+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:57:08.851919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.759244+0000","last_change":"2024-09-21T03:20:21.358386+0000","last_active":"2024-09-21T03:20:24.759244+0000","last_peered":"2024-09-21T03:20:24.759244+0000","last_clean":"2024-09-21T03:20:24.759244+0000","last_became_active":"2024-09-21T03:20:21.358025+0000","last_became_peered":"2024-09-21T03:20:21.358025+0000","last_unstale":"2024-09-21T03:20:24.759244+0000","last_undegraded":"2024-09-21T03:20:24.759244+0000","last_fullsized":"2024-09-21T03:20:24.759244+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:01.708297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.362559+0000","last_change":"2024-09-21T03:20:22.356071+0000","last_active":"2024-09-21T03:20:23.362559+0000","last_peered":"2024-09-21T03:20:23.362559+0000","last_clean":"2024-09-21T03:20:23.362559+0000","last_became_active":"2024-09-21T03:20:22.355762+0000","last_became_peered":"2024-09-21T03:20:22.355762+0000","last_unstale":"2024-09-21T03:20:23.362559+0000","last_undegraded":"2024-09-21T03:20:23.362559+0000","last_fullsized":"2024-09-21T03:20:23.362559+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:02.155154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.792460+0000","last_change":"2024-09-21T03:20:21.362237+0000","last_active":"2024-09-21T03:20:23.792460+0000","last_peered":"2024-09-21T03:20:23.792460+0000","last_clean":"2024-09-21T03:20:23.792460+0000","last_became_active":"2024-09-21T03:20:21.361975+0000","last_became_peered":"2024-09-21T03:20:21.361975+0000","last_unstale":"2024-09-21T03:20:23.792460+0000","last_undegraded":"2024-09-21T03:20:23.792460+0000","last_fullsized":"2024-09-21T03:20:23.792460+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:28.346869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:23.792297+0000","last_change":"2024-09-21T03:20:22.370673+0000","last_active":"2024-09-21T03:20:23.792297+0000","last_peered":"2024-09-21T03:20:23.792297+0000","last_clean":"2024-09-21T03:20:23.792297+0000","last_became_active":"2024-09-21T03:20:22.370359+0000","last_became_peered":"2024-09-21T03:20:22.370359+0000","last_unstale":"2024-09-21T03:20:23.792297+0000","last_undegraded":"2024-09-21T03:20:23.792297+0000","last_fullsized":"2024-09-21T03:20:23.792297+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:21.331720+0000","last_clean_scrub_stamp":"2024-09-21T03:20:21.331720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:22.935292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.760643+0000","last_change":"2024-09-21T03:20:21.361255+0000","last_active":"2024-09-21T03:20:24.760643+0000","last_peered":"2024-09-21T03:20:24.760643+0000","last_clean":"2024-09-21T03:20:24.760643+0000","last_became_active":"2024-09-21T03:20:21.360928+0000","last_became_peered":"2024-09-21T03:20:21.360928+0000","last_unstale":"2024-09-21T03:20:24.760643+0000","last_undegraded":"2024-09-21T03:20:24.760643+0000","last_fullsized":"2024-09-21T03:20:24.760643+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:20.327573+0000","last_clean_scrub_stamp":"2024-09-21T03:20:20.327573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:33.367277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":153,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-21T03:20:24.760914+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:20:24.760914+0000","last_peered":"2024-09-21T03:20:24.760914+0000","last_clean":"2024-09-21T03:20:24.760914+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:20:24.760914+0000","last_undegraded":"2024-09-21T03:20:24.760914+0000","last_fullsized":"2024-09-21T03:20:24.760914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509471,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28120,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343720,"statfs":{"total":96636764160,"available":96607969280,"internally_reserved":0,"allocated":1118208,"data_stored":798077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509470,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27544,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":528384,"data_stored":208291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509469,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":524288,"data_stored":207689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509469,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":532480,"data_stored":209231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509470,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31708,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340132,"statfs":{"total":96636764160,"available":96604295168,"internally_reserved":0,"allocated":532480,"data_stored":208257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509470,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":536576,"data_stored":209253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509470,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":524288,"data_stored":207689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1118208,"data_stored":798021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:20:31.227 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T03:20:31.228 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T03:20:31.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.384+0000 7f6a417e4640 1 -- 172.21.15.105:0/1935564012 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a3c0d1a80 msgr2=0x7f6a3c0cf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:31.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.384+0000 7f6a417e4640 1 --2- 172.21.15.105:0/1935564012 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a3c0d1a80 0x7f6a3c0cf090 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6a24005fd0 tx=0x7f6a2402a520 comp rx=0 tx=0).stop 2024-09-21T03:20:31.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.385+0000 7f6a417e4640 1 -- 172.21.15.105:0/1935564012 shutdown_connections 2024-09-21T03:20:31.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.385+0000 7f6a417e4640 1 --2- 172.21.15.105:0/1935564012 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a3c0cf5d0 0x7f6a3c0cf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:31.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.385+0000 7f6a417e4640 1 --2- 172.21.15.105:0/1935564012 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a3c0d1a80 0x7f6a3c0cf090 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:31.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.385+0000 7f6a417e4640 1 -- 172.21.15.105:0/1935564012 >> 172.21.15.105:0/1935564012 conn(0x7f6a3c08bfc0 msgr2=0x7f6a3c09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:31.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.385+0000 7f6a417e4640 1 -- 172.21.15.105:0/1935564012 shutdown_connections 2024-09-21T03:20:31.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.385+0000 7f6a417e4640 1 -- 172.21.15.105:0/1935564012 wait complete. 2024-09-21T03:20:31.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.386+0000 7f6a417e4640 1 Processor -- start 2024-09-21T03:20:31.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.387+0000 7f6a417e4640 1 -- start start 2024-09-21T03:20:31.391 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.388+0000 7f6a417e4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a3c0cf5d0 0x7f6a3c1f9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:31.391 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.388+0000 7f6a417e4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a3c0d1a80 0x7f6a3c14f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:31.391 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.388+0000 7f6a417e4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a3c0d2ed0 0x7f6a3c0b8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:31.391 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.388+0000 7f6a417e4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6a3c162c60 con 0x7f6a3c0d2ed0 2024-09-21T03:20:31.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.388+0000 7f6a417e4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6a3c162ae0 con 0x7f6a3c0cf5d0 2024-09-21T03:20:31.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.388+0000 7f6a417e4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6a3c162de0 con 0x7f6a3c0d1a80 2024-09-21T03:20:31.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.388+0000 7f6a3b7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a3c0d2ed0 0x7f6a3c0b8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:31.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.388+0000 7f6a3b7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a3c0d2ed0 0x7f6a3c0b8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:52080/0 (socket says 172.21.15.105:52080) 2024-09-21T03:20:31.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.388+0000 7f6a3b7fe640 1 -- 172.21.15.105:0/3397944751 learned_addr learned my addr 172.21.15.105:0/3397944751 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:31.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.388+0000 7f6a327fc640 1 --2- 172.21.15.105:0/3397944751 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a3c0d1a80 0x7f6a3c14f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:31.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.388+0000 7f6a3affd640 1 --2- 172.21.15.105:0/3397944751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a3c0cf5d0 0x7f6a3c1f9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:31.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.388+0000 7f6a3b7fe640 1 -- 172.21.15.105:0/3397944751 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a3c0d1a80 msgr2=0x7f6a3c14f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:31.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.388+0000 7f6a3b7fe640 1 --2- 172.21.15.105:0/3397944751 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a3c0d1a80 0x7f6a3c14f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:31.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.388+0000 7f6a3b7fe640 1 -- 172.21.15.105:0/3397944751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a3c0cf5d0 msgr2=0x7f6a3c1f9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:31.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.388+0000 7f6a3b7fe640 1 --2- 172.21.15.105:0/3397944751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a3c0cf5d0 0x7f6a3c1f9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:31.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.388+0000 7f6a3b7fe640 1 -- 172.21.15.105:0/3397944751 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a3c0cb350 con 0x7f6a3c0d2ed0 2024-09-21T03:20:31.393 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.388+0000 7f6a3b7fe640 1 --2- 172.21.15.105:0/3397944751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a3c0d2ed0 0x7f6a3c0b8a00 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f6a3400e960 tx=0x7f6a3400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:31.393 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.389+0000 7f6a33fff640 1 -- 172.21.15.105:0/3397944751 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a34004d20 con 0x7f6a3c0d2ed0 2024-09-21T03:20:31.393 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.389+0000 7f6a33fff640 1 -- 172.21.15.105:0/3397944751 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a3400cac0 con 0x7f6a3c0d2ed0 2024-09-21T03:20:31.393 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.389+0000 7f6a33fff640 1 -- 172.21.15.105:0/3397944751 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a34005020 con 0x7f6a3c0d2ed0 2024-09-21T03:20:31.393 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.389+0000 7f6a417e4640 1 -- 172.21.15.105:0/3397944751 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a3c0c8820 con 0x7f6a3c0d2ed0 2024-09-21T03:20:31.393 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.389+0000 7f6a417e4640 1 -- 172.21.15.105:0/3397944751 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a3c0c8de0 con 0x7f6a3c0d2ed0 2024-09-21T03:20:31.393 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.390+0000 7f6a417e4640 1 -- 172.21.15.105:0/3397944751 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a3c0c8570 con 0x7f6a3c0d2ed0 2024-09-21T03:20:31.394 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.390+0000 7f6a33fff640 1 -- 172.21.15.105:0/3397944751 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6a340051c0 con 0x7f6a3c0d2ed0 2024-09-21T03:20:31.394 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.391+0000 7f6a33fff640 1 --2- 172.21.15.105:0/3397944751 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6a1c078b90 0x7f6a1c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:31.394 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.391+0000 7f6a33fff640 1 -- 172.21.15.105:0/3397944751 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f6a3409b420 con 0x7f6a3c0d2ed0 2024-09-21T03:20:31.394 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.391+0000 7f6a3affd640 1 --2- 172.21.15.105:0/3397944751 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6a1c078b90 0x7f6a1c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:31.394 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.392+0000 7f6a3affd640 1 --2- 172.21.15.105:0/3397944751 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6a1c078b90 0x7f6a1c07b0a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c0098c0 tx=0x7f6a2c009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:31.397 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.395+0000 7f6a33fff640 1 -- 172.21.15.105:0/3397944751 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6a34016030 con 0x7f6a3c0d2ed0 2024-09-21T03:20:31.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.639+0000 7f6a417e4640 1 -- 172.21.15.105:0/3397944751 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f6a3c163390 con 0x7f6a3c0d2ed0 2024-09-21T03:20:31.645 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.644+0000 7f6a33fff640 1 -- 172.21.15.105:0/3397944751 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) ==== 190+0+147 (secure 0 0 0) 0x7f6a340632a0 con 0x7f6a3c0d2ed0 2024-09-21T03:20:31.645 INFO:teuthology.orchestra.run.smithi105.stdout:[client.0] 2024-09-21T03:20:31.645 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQDIOu5mughoJxAAhY0bzJmq+oNyzCdtafkC9w== 2024-09-21T03:20:31.646 INFO:teuthology.orchestra.run.smithi105.stdout: caps mds = "allow" 2024-09-21T03:20:31.646 INFO:teuthology.orchestra.run.smithi105.stdout: caps mon = "allow r" 2024-09-21T03:20:31.646 INFO:teuthology.orchestra.run.smithi105.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T03:20:31.646 INFO:teuthology.orchestra.run.smithi105.stderr:updated caps for client.0 2024-09-21T03:20:31.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.646+0000 7f6a417e4640 1 -- 172.21.15.105:0/3397944751 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6a1c078b90 msgr2=0x7f6a1c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:31.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.646+0000 7f6a417e4640 1 --2- 172.21.15.105:0/3397944751 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6a1c078b90 0x7f6a1c07b0a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c0098c0 tx=0x7f6a2c009060 comp rx=0 tx=0).stop 2024-09-21T03:20:31.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.646+0000 7f6a417e4640 1 -- 172.21.15.105:0/3397944751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a3c0d2ed0 msgr2=0x7f6a3c0b8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:31.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.646+0000 7f6a417e4640 1 --2- 172.21.15.105:0/3397944751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a3c0d2ed0 0x7f6a3c0b8a00 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f6a3400e960 tx=0x7f6a3400ee20 comp rx=0 tx=0).stop 2024-09-21T03:20:31.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.646+0000 7f6a417e4640 1 -- 172.21.15.105:0/3397944751 shutdown_connections 2024-09-21T03:20:31.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.646+0000 7f6a417e4640 1 --2- 172.21.15.105:0/3397944751 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6a1c078b90 0x7f6a1c07b0a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:31.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.646+0000 7f6a417e4640 1 --2- 172.21.15.105:0/3397944751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a3c0d2ed0 0x7f6a3c0b8a00 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:31.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.646+0000 7f6a417e4640 1 --2- 172.21.15.105:0/3397944751 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a3c0d1a80 0x7f6a3c14f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:31.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.646+0000 7f6a417e4640 1 --2- 172.21.15.105:0/3397944751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a3c0cf5d0 0x7f6a3c1f9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:31.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.646+0000 7f6a417e4640 1 -- 172.21.15.105:0/3397944751 >> 172.21.15.105:0/3397944751 conn(0x7f6a3c08bfc0 msgr2=0x7f6a3c0b5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:31.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.646+0000 7f6a417e4640 1 -- 172.21.15.105:0/3397944751 shutdown_connections 2024-09-21T03:20:31.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.646+0000 7f6a417e4640 1 -- 172.21.15.105:0/3397944751 wait complete. 2024-09-21T03:20:31.659 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:20:31.772 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.770+0000 7f58a63e4640 1 -- 172.21.15.105:0/2392176401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5888004800 msgr2=0x7f5888004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:31.772 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.770+0000 7f58a63e4640 1 --2- 172.21.15.105:0/2392176401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5888004800 0x7f5888004c10 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f589400c260 tx=0x7f5888005830 comp rx=0 tx=0).stop 2024-09-21T03:20:31.772 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.770+0000 7f58a4981640 1 -- 172.21.15.105:0/2392176401 reap_dead start 2024-09-21T03:20:31.772 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.770+0000 7f58a63e4640 1 -- 172.21.15.105:0/2392176401 shutdown_connections 2024-09-21T03:20:31.772 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.770+0000 7f58a63e4640 1 -- 172.21.15.105:0/2392176401 >> 172.21.15.105:0/2392176401 conn(0x7f58a006def0 msgr2=0x7f58a006e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:31.772 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.770+0000 7f58a63e4640 1 -- 172.21.15.105:0/2392176401 shutdown_connections 2024-09-21T03:20:31.772 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.770+0000 7f58a63e4640 1 -- 172.21.15.105:0/2392176401 wait complete. 2024-09-21T03:20:31.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.772+0000 7f58a63e4640 1 Processor -- start 2024-09-21T03:20:31.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.772+0000 7f58a63e4640 1 -- start start 2024-09-21T03:20:31.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.773+0000 7f58a63e4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5888004800 0x7f58a01f5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:31.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.773+0000 7f58a63e4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58a01484f0 0x7f58a00cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:31.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.773+0000 7f58a63e4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58a015d290 0x7f58a015d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:31.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.773+0000 7f58a63e4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f58a00b4ac0 con 0x7f58a01484f0 2024-09-21T03:20:31.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.773+0000 7f58a63e4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f58a00b4940 con 0x7f5888004800 2024-09-21T03:20:31.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.773+0000 7f58a63e4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f58a00b4c40 con 0x7f58a015d290 2024-09-21T03:20:31.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.773+0000 7f589f7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58a01484f0 0x7f58a00cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:31.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.773+0000 7f589f7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58a01484f0 0x7f58a00cc8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:52094/0 (socket says 172.21.15.105:52094) 2024-09-21T03:20:31.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.773+0000 7f589f7fe640 1 -- 172.21.15.105:0/4156932967 learned_addr learned my addr 172.21.15.105:0/4156932967 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:31.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.773+0000 7f589ffff640 1 --2- 172.21.15.105:0/4156932967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5888004800 0x7f58a01f5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:31.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.773+0000 7f58a4981640 1 --2- 172.21.15.105:0/4156932967 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58a015d290 0x7f58a015d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:31.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.773+0000 7f589f7fe640 1 -- 172.21.15.105:0/4156932967 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58a015d290 msgr2=0x7f58a015d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:31.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.773+0000 7f589f7fe640 1 --2- 172.21.15.105:0/4156932967 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58a015d290 0x7f58a015d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:31.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.773+0000 7f589f7fe640 1 -- 172.21.15.105:0/4156932967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5888004800 msgr2=0x7f58a01f5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:31.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.773+0000 7f589f7fe640 1 --2- 172.21.15.105:0/4156932967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5888004800 0x7f58a01f5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:31.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.774+0000 7f589f7fe640 1 -- 172.21.15.105:0/4156932967 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58a015dbe0 con 0x7f58a01484f0 2024-09-21T03:20:31.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.774+0000 7f589f7fe640 1 --2- 172.21.15.105:0/4156932967 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58a01484f0 0x7f58a00cc8b0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f589402b110 tx=0x7f5894006ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:31.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.774+0000 7f589cff9640 1 -- 172.21.15.105:0/4156932967 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5894031040 con 0x7f58a01484f0 2024-09-21T03:20:31.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.774+0000 7f589cff9640 1 -- 172.21.15.105:0/4156932967 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f589402f660 con 0x7f58a01484f0 2024-09-21T03:20:31.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.774+0000 7f58a63e4640 1 -- 172.21.15.105:0/4156932967 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58a01f2150 con 0x7f58a01484f0 2024-09-21T03:20:31.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.774+0000 7f589cff9640 1 -- 172.21.15.105:0/4156932967 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f589402fa90 con 0x7f58a01484f0 2024-09-21T03:20:31.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.774+0000 7f58a63e4640 1 -- 172.21.15.105:0/4156932967 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58a01f2710 con 0x7f58a01484f0 2024-09-21T03:20:31.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.775+0000 7f58a63e4640 1 -- 172.21.15.105:0/4156932967 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58a006a700 con 0x7f58a01484f0 2024-09-21T03:20:31.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.776+0000 7f589cff9640 1 -- 172.21.15.105:0/4156932967 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5894034070 con 0x7f58a01484f0 2024-09-21T03:20:31.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.776+0000 7f589cff9640 1 --2- 172.21.15.105:0/4156932967 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f588c078bc0 0x7f588c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:31.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.776+0000 7f589cff9640 1 -- 172.21.15.105:0/4156932967 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f58940bcde0 con 0x7f58a01484f0 2024-09-21T03:20:31.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.777+0000 7f589ffff640 1 --2- 172.21.15.105:0/4156932967 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f588c078bc0 0x7f588c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:31.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.777+0000 7f589ffff640 1 --2- 172.21.15.105:0/4156932967 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f588c078bc0 0x7f588c07b0d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5890009c50 tx=0x7f5890005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:31.782 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.781+0000 7f589cff9640 1 -- 172.21.15.105:0/4156932967 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f58a006a700 con 0x7f58a01484f0 2024-09-21T03:20:31.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.993+0000 7f58a63e4640 1 -- 172.21.15.105:0/4156932967 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58a015c580 con 0x7f58a01484f0 2024-09-21T03:20:31.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.994+0000 7f589cff9640 1 -- 172.21.15.105:0/4156932967 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5235 (secure 0 0 0) 0x7f58a015dbe0 con 0x7f58a01484f0 2024-09-21T03:20:31.996 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:20:31.996 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":25,"btime":"2024-09-21T03:20:25:364985+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4889,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/2075944521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2075944521},{"type":"v1","addr":"172.21.15.162:6837","nonce":2075944521}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5086,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/4008776831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":4008776831},{"type":"v1","addr":"172.21.15.105:6835","nonce":4008776831}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2322902258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2322902258},{"type":"v1","addr":"172.21.15.162:6836","nonce":2322902258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:20:21.706604+0000","modified":"2024-09-21T03:20:24.721756+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5301},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5301":{"gid":5301,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6833/2865219898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2865219898},{"type":"v1","addr":"172.21.15.105:6833","nonce":2865219898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5301,"qdb_cluster":[5301]},"id":3}]} 2024-09-21T03:20:31.996 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 25 2024-09-21T03:20:31.998 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.996+0000 7f58a63e4640 1 -- 172.21.15.105:0/4156932967 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f588c078bc0 msgr2=0x7f588c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:31.998 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.996+0000 7f58a63e4640 1 --2- 172.21.15.105:0/4156932967 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f588c078bc0 0x7f588c07b0d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5890009c50 tx=0x7f5890005f90 comp rx=0 tx=0).stop 2024-09-21T03:20:31.998 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.996+0000 7f58a63e4640 1 -- 172.21.15.105:0/4156932967 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58a01484f0 msgr2=0x7f58a00cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:31.998 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.996+0000 7f58a63e4640 1 --2- 172.21.15.105:0/4156932967 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58a01484f0 0x7f58a00cc8b0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f589402b110 tx=0x7f5894006ce0 comp rx=0 tx=0).stop 2024-09-21T03:20:31.998 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.996+0000 7f58a63e4640 1 -- 172.21.15.105:0/4156932967 shutdown_connections 2024-09-21T03:20:31.998 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.996+0000 7f58a63e4640 1 --2- 172.21.15.105:0/4156932967 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f588c078bc0 0x7f588c07b0d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:31.998 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.996+0000 7f58a63e4640 1 --2- 172.21.15.105:0/4156932967 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58a015d290 0x7f58a015d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:31.998 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.996+0000 7f58a63e4640 1 --2- 172.21.15.105:0/4156932967 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58a01484f0 0x7f58a00cc8b0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:31.998 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.996+0000 7f58a63e4640 1 --2- 172.21.15.105:0/4156932967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5888004800 0x7f58a01f5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:31.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.996+0000 7f58a63e4640 1 -- 172.21.15.105:0/4156932967 >> 172.21.15.105:0/4156932967 conn(0x7f58a006def0 msgr2=0x7f58a00b5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:31.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.996+0000 7f58a63e4640 1 -- 172.21.15.105:0/4156932967 shutdown_connections 2024-09-21T03:20:31.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:31.996+0000 7f58a63e4640 1 -- 172.21.15.105:0/4156932967 wait complete. 2024-09-21T03:20:32.411 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T03:20:21.706604+0000', 'modified': '2024-09-21T03:20:24.721756+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5301}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5301': {'gid': 5301, 'name': 'c', 'rank': 0, 'incarnation': 22, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.105:6833/2865219898', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6832', 'nonce': 2865219898}, {'type': 'v1', 'addr': '172.21.15.105:6833', 'nonce': 2865219898}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5301, 'qdb_cluster': [5301]} 2024-09-21T03:20:32.411 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T03:20:32.412 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-21T03:20:32.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.523+0000 7f7323520640 1 -- 172.21.15.105:0/598581297 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f731c0af780 msgr2=0x7f731c0b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:32.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.523+0000 7f7323520640 1 --2- 172.21.15.105:0/598581297 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f731c0af780 0x7f731c0b39c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f730c005fd0 tx=0x7f730c02a530 comp rx=0 tx=0).stop 2024-09-21T03:20:32.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.523+0000 7f7323520640 1 -- 172.21.15.105:0/598581297 shutdown_connections 2024-09-21T03:20:32.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.523+0000 7f7323520640 1 --2- 172.21.15.105:0/598581297 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f731c0cd3e0 0x7f731c070180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.523+0000 7f7323520640 1 --2- 172.21.15.105:0/598581297 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f731c0af780 0x7f731c0b39c0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.523+0000 7f7323520640 1 -- 172.21.15.105:0/598581297 >> 172.21.15.105:0/598581297 conn(0x7f731c06d7d0 msgr2=0x7f731c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:32.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.523+0000 7f7323520640 1 -- 172.21.15.105:0/598581297 shutdown_connections 2024-09-21T03:20:32.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.523+0000 7f7323520640 1 -- 172.21.15.105:0/598581297 wait complete. 2024-09-21T03:20:32.526 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.525+0000 7f7323520640 1 Processor -- start 2024-09-21T03:20:32.526 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.525+0000 7f7323520640 1 -- start start 2024-09-21T03:20:32.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.526+0000 7f7323520640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f731c0706c0 0x7f731c1e54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:32.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.526+0000 7f7323520640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f731c0af780 0x7f731c1f21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:32.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.526+0000 7f7323520640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f731c0cd3e0 0x7f731c14c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:32.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.526+0000 7f7323520640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f731c073b80 con 0x7f731c0706c0 2024-09-21T03:20:32.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.526+0000 7f7323520640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f731c073a00 con 0x7f731c0cd3e0 2024-09-21T03:20:32.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.526+0000 7f7323520640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f731c1e59e0 con 0x7f731c0af780 2024-09-21T03:20:32.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.526+0000 7f73212bc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f731c0706c0 0x7f731c1e54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:32.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.526+0000 7f73212bc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f731c0706c0 0x7f731c1e54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:52114/0 (socket says 172.21.15.105:52114) 2024-09-21T03:20:32.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.526+0000 7f73212bc640 1 -- 172.21.15.105:0/2803426068 learned_addr learned my addr 172.21.15.105:0/2803426068 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:32.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.526+0000 7f7320abb640 1 --2- 172.21.15.105:0/2803426068 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f731c0af780 0x7f731c1f21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:32.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.526+0000 7f7321abd640 1 --2- 172.21.15.105:0/2803426068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f731c0cd3e0 0x7f731c14c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:32.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.526+0000 7f73212bc640 1 -- 172.21.15.105:0/2803426068 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f731c0af780 msgr2=0x7f731c1f21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:32.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.526+0000 7f73212bc640 1 --2- 172.21.15.105:0/2803426068 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f731c0af780 0x7f731c1f21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.526+0000 7f73212bc640 1 -- 172.21.15.105:0/2803426068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f731c0cd3e0 msgr2=0x7f731c14c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:32.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.526+0000 7f73212bc640 1 --2- 172.21.15.105:0/2803426068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f731c0cd3e0 0x7f731c14c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.526+0000 7f73212bc640 1 -- 172.21.15.105:0/2803426068 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f731c1f2d60 con 0x7f731c0706c0 2024-09-21T03:20:32.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.526+0000 7f7320abb640 1 --2- 172.21.15.105:0/2803426068 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f731c0af780 0x7f731c1f21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:20:32.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.527+0000 7f73212bc640 1 --2- 172.21.15.105:0/2803426068 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f731c0706c0 0x7f731c1e54a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f730c034040 tx=0x7f730c0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:32.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.527+0000 7f7319ffb640 1 -- 172.21.15.105:0/2803426068 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f730c035040 con 0x7f731c0706c0 2024-09-21T03:20:32.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.527+0000 7f7319ffb640 1 -- 172.21.15.105:0/2803426068 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f730c0047a0 con 0x7f731c0706c0 2024-09-21T03:20:32.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.527+0000 7f7319ffb640 1 -- 172.21.15.105:0/2803426068 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f730c004b90 con 0x7f731c0706c0 2024-09-21T03:20:32.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.527+0000 7f7323520640 1 -- 172.21.15.105:0/2803426068 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f731c1e49c0 con 0x7f731c0706c0 2024-09-21T03:20:32.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.527+0000 7f7323520640 1 -- 172.21.15.105:0/2803426068 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f731c1e4f80 con 0x7f731c0706c0 2024-09-21T03:20:32.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.529+0000 7f7319ffb640 1 -- 172.21.15.105:0/2803426068 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f730c004d30 con 0x7f731c0706c0 2024-09-21T03:20:32.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.530+0000 7f7319ffb640 1 --2- 172.21.15.105:0/2803426068 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7308078b90 0x7f730807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:32.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.530+0000 7f7319ffb640 1 -- 172.21.15.105:0/2803426068 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f730c0bd7b0 con 0x7f731c0706c0 2024-09-21T03:20:32.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.530+0000 7f7320abb640 1 --2- 172.21.15.105:0/2803426068 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7308078b90 0x7f730807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:32.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.530+0000 7f732a490740 1 Processor -- start 2024-09-21T03:20:32.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.530+0000 7f732a490740 1 -- start start 2024-09-21T03:20:32.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.530+0000 7f7320abb640 1 --2- 172.21.15.105:0/2803426068 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7308078b90 0x7f730807b0a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7310005fd0 tx=0x7f7310005ea0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:32.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.532+0000 7f732a490740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e985641270 0x55e985a12fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:32.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.532+0000 7f732a490740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e9856183b0 0x55e985a134e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:32.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.532+0000 7f732a490740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e985620590 0x55e985a303e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:32.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.532+0000 7f732a490740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55e98595b820 con 0x55e985620590 2024-09-21T03:20:32.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.532+0000 7f732a490740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e98594ac50 con 0x55e985641270 2024-09-21T03:20:32.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.532+0000 7f732a490740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55e98594ea60 con 0x55e9856183b0 2024-09-21T03:20:32.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.532+0000 7f7321abd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e985620590 0x55e985a303e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:32.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.532+0000 7f7321abd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e985620590 0x55e985a303e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:52120/0 (socket says 172.21.15.105:52120) 2024-09-21T03:20:32.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.532+0000 7f7321abd640 1 -- 172.21.15.105:0/764631778 learned_addr learned my addr 172.21.15.105:0/764631778 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:32.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.532+0000 7f7320abb640 1 --2- 172.21.15.105:0/764631778 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e9856183b0 0x55e985a134e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:32.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.532+0000 7f73212bc640 1 --2- 172.21.15.105:0/764631778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e985641270 0x55e985a12fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:32.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.532+0000 7f7321abd640 1 -- 172.21.15.105:0/764631778 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e9856183b0 msgr2=0x55e985a134e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:20:32.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.532+0000 7f7321abd640 1 --2- 172.21.15.105:0/764631778 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e9856183b0 0x55e985a134e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.532+0000 7f7321abd640 1 -- 172.21.15.105:0/764631778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e985641270 msgr2=0x55e985a12fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:20:32.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.532+0000 7f7321abd640 1 --2- 172.21.15.105:0/764631778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e985641270 0x55e985a12fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.532+0000 7f7321abd640 1 -- 172.21.15.105:0/764631778 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9856ac850 con 0x55e985620590 2024-09-21T03:20:32.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.532+0000 7f7321abd640 1 --2- 172.21.15.105:0/764631778 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e985620590 0x55e985a303e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7314009f00 tx=0x7f731400c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49f127fdc72d9a38 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:32.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.532+0000 7f7302ffd640 1 -- 172.21.15.105:0/764631778 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f731401a070 con 0x55e985620590 2024-09-21T03:20:32.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.532+0000 7f7302ffd640 1 -- 172.21.15.105:0/764631778 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f731400a5f0 con 0x55e985620590 2024-09-21T03:20:32.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.532+0000 7f7302ffd640 1 -- 172.21.15.105:0/764631778 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f731400aa00 con 0x55e985620590 2024-09-21T03:20:32.536 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.533+0000 7f732a490740 1 -- 172.21.15.105:0/764631778 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e985620590 msgr2=0x55e985a303e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:32.536 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.533+0000 7f732a490740 1 --2- 172.21.15.105:0/764631778 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e985620590 0x55e985a303e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7314009f00 tx=0x7f731400c7d0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.536 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.533+0000 7f732a490740 1 -- 172.21.15.105:0/764631778 shutdown_connections 2024-09-21T03:20:32.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.533+0000 7f732a490740 1 --2- 172.21.15.105:0/764631778 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e985620590 0x55e985a303e0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.533+0000 7f732a490740 1 --2- 172.21.15.105:0/764631778 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e9856183b0 0x55e985a134e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.533+0000 7f732a490740 1 --2- 172.21.15.105:0/764631778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e985641270 0x55e985a12fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.533+0000 7f732a490740 1 -- 172.21.15.105:0/764631778 >> 172.21.15.105:0/764631778 conn(0x55e9856353c0 msgr2=0x55e9859e9260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:32.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.533+0000 7f732a490740 1 -- 172.21.15.105:0/764631778 shutdown_connections 2024-09-21T03:20:32.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.533+0000 7f732a490740 1 -- 172.21.15.105:0/764631778 wait complete. 2024-09-21T03:20:32.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.534+0000 7f732a490740 1 -- start start 2024-09-21T03:20:32.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.534+0000 7f732a490740 1 Processor -- start 2024-09-21T03:20:32.541 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.536+0000 7f732a490740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e9856183b0 0x55e985a3c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:32.541 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.536+0000 7f732a490740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e985620590 0x55e985a2d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:32.541 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.536+0000 7f732a490740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e985641270 0x55e9859f3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:32.541 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.536+0000 7f732a490740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55e9856bb620 con 0x55e985620590 2024-09-21T03:20:32.541 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.536+0000 7f732a490740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e9858f05f0 con 0x55e985641270 2024-09-21T03:20:32.541 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.536+0000 7f732a490740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55e985a13a20 con 0x55e9856183b0 2024-09-21T03:20:32.541 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.536+0000 7f732a490740 10 client.0 _ll_register_callbacks cb 0x55e9858f40a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:20:32.541 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.536+0000 7f7320abb640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e985620590 0x55e985a2d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:32.541 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.536+0000 7f7320abb640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e985620590 0x55e985a2d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:52132/0 (socket says 172.21.15.105:52132) 2024-09-21T03:20:32.541 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.536+0000 7f7320abb640 1 -- 172.21.15.105:0/1008990547 learned_addr learned my addr 172.21.15.105:0/1008990547 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:32.542 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.536+0000 7f73212bc640 1 --2- 172.21.15.105:0/1008990547 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e9856183b0 0x55e985a3c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:32.542 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.536+0000 7f7321abd640 1 --2- 172.21.15.105:0/1008990547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e985641270 0x55e9859f3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:32.542 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.536+0000 7f7320abb640 1 -- 172.21.15.105:0/1008990547 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e9856183b0 msgr2=0x55e985a3c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:20:32.542 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.536+0000 7f7320abb640 1 --2- 172.21.15.105:0/1008990547 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e9856183b0 0x55e985a3c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.542 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.536+0000 7f7320abb640 1 -- 172.21.15.105:0/1008990547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e985641270 msgr2=0x55e9859f3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:20:32.542 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.536+0000 7f7320abb640 1 --2- 172.21.15.105:0/1008990547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e985641270 0x55e9859f3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.542 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.536+0000 7f7320abb640 1 -- 172.21.15.105:0/1008990547 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9857236b0 con 0x55e985620590 2024-09-21T03:20:32.542 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.536+0000 7f73212bc640 1 --2- 172.21.15.105:0/1008990547 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e9856183b0 0x55e985a3c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:20:32.542 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.536+0000 7f7320abb640 1 --2- 172.21.15.105:0/1008990547 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e985620590 0x55e985a2d490 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f73100109b0 tx=0x7f73100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb316c5a66c454d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:32.542 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.536+0000 7f72f7fff640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-21T03:20:32.542 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.537+0000 7f72f7fff640 1 -- 172.21.15.105:0/1008990547 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f731001dcd0 con 0x55e985620590 2024-09-21T03:20:32.542 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.537+0000 7f72f7fff640 1 -- 172.21.15.105:0/1008990547 <== mon.0 v2:172.21.15.105:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f7310027ab0 con 0x55e985620590 2024-09-21T03:20:32.542 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.537+0000 7f732a490740 1 -- 172.21.15.105:0/1008990547 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f731400a5f0 con 0x55e985620590 2024-09-21T03:20:32.542 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.537+0000 7f72f7fff640 1 -- 172.21.15.105:0/1008990547 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f731001de70 con 0x55e985620590 2024-09-21T03:20:32.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.537+0000 7f732a490740 10 client.5469 fetch_fsmap learned FSMap version 25 2024-09-21T03:20:32.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.537+0000 7f732a490740 1 -- 172.21.15.105:0/1008990547 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x55e985a3cb60 con 0x55e985620590 2024-09-21T03:20:32.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.537+0000 7f72f7fff640 1 -- 172.21.15.105:0/1008990547 <== mon.0 v2:172.21.15.105:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f731400a5f0 con 0x55e985620590 2024-09-21T03:20:32.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.537+0000 7f72f7fff640 1 -- 172.21.15.105:0/1008990547 <== mon.0 v2:172.21.15.105:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7f731002e050 con 0x55e985620590 2024-09-21T03:20:32.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.537+0000 7f732a490740 10 client.5469 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:20:32.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.537+0000 7f732a490740 10 client.5469 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T03:20:32.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.537+0000 7f732a490740 20 client.5469 populate_metadata read hostname 'smithi105' 2024-09-21T03:20:32.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.537+0000 7f732a490740 1 --2- 172.21.15.105:0/1008990547 >> [v2:172.21.15.105:6832/2865219898,v1:172.21.15.105:6833/2865219898] conn(0x55e9855ffe40 0x55e985a26320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:32.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.537+0000 7f732a490740 4 client.5469 mds_command: new command op to 5301 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:20:32.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.537+0000 7f732a490740 1 -- 172.21.15.105:0/1008990547 --> [v2:172.21.15.105:6832/2865219898,v1:172.21.15.105:6833/2865219898] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e98595d770 con 0x55e9855ffe40 2024-09-21T03:20:32.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.537+0000 7f73212bc640 1 --2- 172.21.15.105:0/1008990547 >> [v2:172.21.15.105:6832/2865219898,v1:172.21.15.105:6833/2865219898] conn(0x55e9855ffe40 0x55e985a26320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:32.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.537+0000 7f72f7fff640 10 client.5469 ms_handle_connect on v2:172.21.15.105:6832/2865219898 2024-09-21T03:20:32.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.538+0000 7f73212bc640 1 --2- 172.21.15.105:0/1008990547 >> [v2:172.21.15.105:6832/2865219898,v1:172.21.15.105:6833/2865219898] conn(0x55e9855ffe40 0x55e985a26320 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee940e2e3a116a27 server_cookie=25a44b4df407dbd in_seq=0 out_seq=0 2024-09-21T03:20:32.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.538+0000 7f72f7fff640 1 -- 172.21.15.105:0/1008990547 <== mds.0 v2:172.21.15.105:6832/2865219898 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e98595d770 con 0x55e9855ffe40 2024-09-21T03:20:32.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.538+0000 7f72f7fff640 10 client.5469 handle_command_reply: tid=0 2024-09-21T03:20:32.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.538+0000 7f732a490740 1 client.5469 shutdown 2024-09-21T03:20:32.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.539+0000 7f732a490740 1 -- 172.21.15.105:0/1008990547 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e985620590 msgr2=0x55e985a2d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:32.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.539+0000 7f732a490740 1 --2- 172.21.15.105:0/1008990547 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e985620590 0x55e985a2d490 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f73100109b0 tx=0x7f73100046c0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.539+0000 7f732a490740 1 -- 172.21.15.105:0/1008990547 shutdown_connections 2024-09-21T03:20:32.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.539+0000 7f732a490740 1 --2- 172.21.15.105:0/1008990547 >> [v2:172.21.15.105:6832/2865219898,v1:172.21.15.105:6833/2865219898] conn(0x55e9855ffe40 0x55e985a26320 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.539+0000 7f732a490740 1 --2- 172.21.15.105:0/1008990547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e985641270 0x55e9859f3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.539+0000 7f732a490740 1 --2- 172.21.15.105:0/1008990547 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e985620590 0x55e985a2d490 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.539+0000 7f72f7fff640 0 client.5469 ms_handle_reset on v2:172.21.15.105:6832/2865219898 2024-09-21T03:20:32.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.539+0000 7f732a490740 1 --2- 172.21.15.105:0/1008990547 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e9856183b0 0x55e985a3c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.539+0000 7f732a490740 1 -- 172.21.15.105:0/1008990547 >> 172.21.15.105:0/1008990547 conn(0x55e9856353c0 msgr2=0x55e9859e3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:32.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.539+0000 7f732a490740 1 -- 172.21.15.105:0/1008990547 shutdown_connections 2024-09-21T03:20:32.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.539+0000 7f732a490740 1 -- 172.21.15.105:0/1008990547 wait complete. 2024-09-21T03:20:32.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.539+0000 7f732a490740 20 client.5469 trim_cache size 0 max 16384 2024-09-21T03:20:32.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.557+0000 7f732a490740 1 Processor -- start 2024-09-21T03:20:32.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.557+0000 7f732a490740 1 -- start start 2024-09-21T03:20:32.563 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.558+0000 7f732a490740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e9856183b0 0x55e985a512e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:32.563 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.558+0000 7f732a490740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e985620590 0x55e985a00c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:32.563 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.558+0000 7f732a490740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e985641270 0x55e985a01170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:32.563 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.558+0000 7f732a490740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f731c1fce80 con 0x55e985620590 2024-09-21T03:20:32.563 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.558+0000 7f732a490740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f731c15d490 con 0x55e985641270 2024-09-21T03:20:32.563 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.558+0000 7f732a490740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f731c1fc960 con 0x55e9856183b0 2024-09-21T03:20:32.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.558+0000 7f7320abb640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e985620590 0x55e985a00c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:32.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.558+0000 7f7320abb640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e985620590 0x55e985a00c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:52140/0 (socket says 172.21.15.105:52140) 2024-09-21T03:20:32.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.558+0000 7f7320abb640 1 -- 172.21.15.105:0/1721475713 learned_addr learned my addr 172.21.15.105:0/1721475713 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:32.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.559+0000 7f73212bc640 1 --2- 172.21.15.105:0/1721475713 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e9856183b0 0x55e985a512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:32.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.559+0000 7f7321abd640 1 --2- 172.21.15.105:0/1721475713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e985641270 0x55e985a01170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:32.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.559+0000 7f7320abb640 1 -- 172.21.15.105:0/1721475713 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e9856183b0 msgr2=0x55e985a512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:20:32.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.559+0000 7f7320abb640 1 --2- 172.21.15.105:0/1721475713 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e9856183b0 0x55e985a512e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.559+0000 7f7320abb640 1 -- 172.21.15.105:0/1721475713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e985641270 msgr2=0x55e985a01170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:20:32.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.559+0000 7f7320abb640 1 --2- 172.21.15.105:0/1721475713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e985641270 0x55e985a01170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.559+0000 7f7320abb640 1 -- 172.21.15.105:0/1721475713 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e985909aa0 con 0x55e985620590 2024-09-21T03:20:32.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.559+0000 7f7321abd640 1 --2- 172.21.15.105:0/1721475713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e985641270 0x55e985a01170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:20:32.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.559+0000 7f7320abb640 1 --2- 172.21.15.105:0/1721475713 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e985620590 0x55e985a00c30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7310000c00 tx=0x7f7310013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68dbf74d5f23d8b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:32.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.559+0000 7f73027fc640 1 -- 172.21.15.105:0/1721475713 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f731001dcd0 con 0x55e985620590 2024-09-21T03:20:32.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.559+0000 7f73027fc640 1 -- 172.21.15.105:0/1721475713 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7310004160 con 0x55e985620590 2024-09-21T03:20:32.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.559+0000 7f73027fc640 1 -- 172.21.15.105:0/1721475713 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7310005030 con 0x55e985620590 2024-09-21T03:20:32.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.560+0000 7f732a490740 1 -- 172.21.15.105:0/1721475713 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e985620590 msgr2=0x55e985a00c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:32.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.560+0000 7f732a490740 1 --2- 172.21.15.105:0/1721475713 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e985620590 0x55e985a00c30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7310000c00 tx=0x7f7310013000 comp rx=0 tx=0).stop 2024-09-21T03:20:32.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.560+0000 7f732a490740 1 -- 172.21.15.105:0/1721475713 shutdown_connections 2024-09-21T03:20:32.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.560+0000 7f732a490740 1 --2- 172.21.15.105:0/1721475713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e985641270 0x55e985a01170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.560+0000 7f732a490740 1 --2- 172.21.15.105:0/1721475713 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e985620590 0x55e985a00c30 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.560+0000 7f732a490740 1 --2- 172.21.15.105:0/1721475713 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e9856183b0 0x55e985a512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.560+0000 7f732a490740 1 -- 172.21.15.105:0/1721475713 >> 172.21.15.105:0/1721475713 conn(0x55e9856353c0 msgr2=0x55e985a2be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:32.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.560+0000 7f732a490740 1 -- 172.21.15.105:0/1721475713 shutdown_connections 2024-09-21T03:20:32.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.560+0000 7f732a490740 1 -- 172.21.15.105:0/1721475713 wait complete. 2024-09-21T03:20:32.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.561+0000 7f732a490740 1 -- start start 2024-09-21T03:20:32.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.561+0000 7f732a490740 1 Processor -- start 2024-09-21T03:20:32.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.562+0000 7f732a490740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e9856183b0 0x55e985aac4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:32.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.562+0000 7f732a490740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e985620590 0x55e985a00c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:32.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.562+0000 7f732a490740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e985641270 0x55e985a01170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:32.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.562+0000 7f732a490740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55e985a404c0 con 0x55e985620590 2024-09-21T03:20:32.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.562+0000 7f732a490740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e9859f3fe0 con 0x55e9856183b0 2024-09-21T03:20:32.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.562+0000 7f732a490740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55e985a40b10 con 0x55e985641270 2024-09-21T03:20:32.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.562+0000 7f732a490740 10 client.0 _ll_register_callbacks cb 0x7f731000ea60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:20:32.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.562+0000 7f7320abb640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e985620590 0x55e985a00c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:32.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.562+0000 7f7320abb640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e985620590 0x55e985a00c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:52146/0 (socket says 172.21.15.105:52146) 2024-09-21T03:20:32.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.562+0000 7f7320abb640 1 -- 172.21.15.105:0/2135163412 learned_addr learned my addr 172.21.15.105:0/2135163412 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:32.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.562+0000 7f73212bc640 1 --2- 172.21.15.105:0/2135163412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e9856183b0 0x55e985aac4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:32.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.562+0000 7f7321abd640 1 --2- 172.21.15.105:0/2135163412 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e985641270 0x55e985a01170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:32.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.563+0000 7f7320abb640 1 -- 172.21.15.105:0/2135163412 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e985641270 msgr2=0x55e985a01170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:20:32.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.563+0000 7f7320abb640 1 --2- 172.21.15.105:0/2135163412 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e985641270 0x55e985a01170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.563+0000 7f7320abb640 1 -- 172.21.15.105:0/2135163412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e9856183b0 msgr2=0x55e985aac4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:20:32.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.563+0000 7f7320abb640 1 --2- 172.21.15.105:0/2135163412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e9856183b0 0x55e985aac4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.563+0000 7f7320abb640 1 -- 172.21.15.105:0/2135163412 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e985a50320 con 0x55e985620590 2024-09-21T03:20:32.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.563+0000 7f7320abb640 1 --2- 172.21.15.105:0/2135163412 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e985620590 0x55e985a00c30 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7310005940 tx=0x7f731001dad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f491222ef6788dc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:32.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.563+0000 7f72f7fff640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-21T03:20:32.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.563+0000 7f72f7fff640 1 -- 172.21.15.105:0/2135163412 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7310003a00 con 0x55e985620590 2024-09-21T03:20:32.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.563+0000 7f72f7fff640 1 -- 172.21.15.105:0/2135163412 <== mon.0 v2:172.21.15.105:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f7310003ba0 con 0x55e985620590 2024-09-21T03:20:32.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.563+0000 7f732a490740 1 -- 172.21.15.105:0/2135163412 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7310004160 con 0x55e985620590 2024-09-21T03:20:32.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.563+0000 7f72f7fff640 1 -- 172.21.15.105:0/2135163412 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7310003de0 con 0x55e985620590 2024-09-21T03:20:32.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.563+0000 7f732a490740 10 client.5475 fetch_fsmap learned FSMap version 25 2024-09-21T03:20:32.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.563+0000 7f732a490740 1 -- 172.21.15.105:0/2135163412 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x55e985ab0f60 con 0x55e985620590 2024-09-21T03:20:32.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.563+0000 7f72f7fff640 1 -- 172.21.15.105:0/2135163412 <== mon.0 v2:172.21.15.105:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7310004160 con 0x55e985620590 2024-09-21T03:20:32.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.563+0000 7f72f7fff640 1 -- 172.21.15.105:0/2135163412 <== mon.0 v2:172.21.15.105:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7f731002e070 con 0x55e985620590 2024-09-21T03:20:32.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.563+0000 7f732a490740 10 client.5475 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:20:32.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.564+0000 7f732a490740 10 client.5475 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T03:20:32.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.564+0000 7f732a490740 20 client.5475 populate_metadata read hostname 'smithi105' 2024-09-21T03:20:32.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.564+0000 7f732a490740 1 --2- 172.21.15.105:0/2135163412 >> [v2:172.21.15.105:6832/2865219898,v1:172.21.15.105:6833/2865219898] conn(0x55e985ab08c0 0x55e985a3b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:32.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.564+0000 7f732a490740 4 client.5475 mds_command: new command op to 5301 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T03:20:32.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.564+0000 7f732a490740 1 -- 172.21.15.105:0/2135163412 --> [v2:172.21.15.105:6832/2865219898,v1:172.21.15.105:6833/2865219898] -- command(tid 0: {"prefix": "status"}) -- 0x55e985a2cd60 con 0x55e985ab08c0 2024-09-21T03:20:32.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.564+0000 7f73212bc640 1 --2- 172.21.15.105:0/2135163412 >> [v2:172.21.15.105:6832/2865219898,v1:172.21.15.105:6833/2865219898] conn(0x55e985ab08c0 0x55e985a3b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:32.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.564+0000 7f72f7fff640 10 client.5475 ms_handle_connect on v2:172.21.15.105:6832/2865219898 2024-09-21T03:20:32.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.564+0000 7f73212bc640 1 --2- 172.21.15.105:0/2135163412 >> [v2:172.21.15.105:6832/2865219898,v1:172.21.15.105:6833/2865219898] conn(0x55e985ab08c0 0x55e985a3b8f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3351d0c5b3a3e11 server_cookie=e3d7ed295aca44b2 in_seq=0 out_seq=0 2024-09-21T03:20:32.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.564+0000 7f72f7fff640 1 -- 172.21.15.105:0/2135163412 <== mds.0 v2:172.21.15.105:6832/2865219898 1 ==== command_reply(tid 0: 0 ) ==== 8+0+319 (crc 0 0 0) 0x55e985a2cd60 con 0x55e985ab08c0 2024-09-21T03:20:32.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.564+0000 7f72f7fff640 10 client.5475 handle_command_reply: tid=0 2024-09-21T03:20:32.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.564+0000 7f732a490740 1 client.5475 shutdown 2024-09-21T03:20:32.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.564+0000 7f732a490740 1 -- 172.21.15.105:0/2135163412 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e985620590 msgr2=0x55e985a00c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:32.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.564+0000 7f732a490740 1 --2- 172.21.15.105:0/2135163412 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e985620590 0x55e985a00c30 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7310005940 tx=0x7f731001dad0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.565+0000 7f732a490740 1 -- 172.21.15.105:0/2135163412 shutdown_connections 2024-09-21T03:20:32.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.565+0000 7f732a490740 1 --2- 172.21.15.105:0/2135163412 >> [v2:172.21.15.105:6832/2865219898,v1:172.21.15.105:6833/2865219898] conn(0x55e985ab08c0 0x55e985a3b8f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.565+0000 7f732a490740 1 --2- 172.21.15.105:0/2135163412 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e985641270 0x55e985a01170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.565+0000 7f732a490740 1 --2- 172.21.15.105:0/2135163412 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e985620590 0x55e985a00c30 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.565+0000 7f72f7fff640 0 client.5475 ms_handle_reset on v2:172.21.15.105:6832/2865219898 2024-09-21T03:20:32.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.565+0000 7f732a490740 1 --2- 172.21.15.105:0/2135163412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e9856183b0 0x55e985aac4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.565+0000 7f732a490740 1 -- 172.21.15.105:0/2135163412 >> 172.21.15.105:0/2135163412 conn(0x55e9856353c0 msgr2=0x55e985a2be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:32.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.565+0000 7f732a490740 1 -- 172.21.15.105:0/2135163412 shutdown_connections 2024-09-21T03:20:32.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.565+0000 7f732a490740 1 -- 172.21.15.105:0/2135163412 wait complete. 2024-09-21T03:20:32.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.565+0000 7f732a490740 20 client.5475 trim_cache size 0 max 16384 2024-09-21T03:20:32.573 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-21T03:20:32.573 INFO:teuthology.orchestra.run.smithi105.stdout: "cluster_fsid": "29d80f4f-e5de-4b26-8384-24c2d8019945", 2024-09-21T03:20:32.573 INFO:teuthology.orchestra.run.smithi105.stdout: "whoami": 0, 2024-09-21T03:20:32.573 INFO:teuthology.orchestra.run.smithi105.stdout: "id": 5301, 2024-09-21T03:20:32.574 INFO:teuthology.orchestra.run.smithi105.stdout: "want_state": "up:active", 2024-09-21T03:20:32.574 INFO:teuthology.orchestra.run.smithi105.stdout: "state": "up:active", 2024-09-21T03:20:32.574 INFO:teuthology.orchestra.run.smithi105.stdout: "fs_name": "cephfs", 2024-09-21T03:20:32.574 INFO:teuthology.orchestra.run.smithi105.stdout: "rank_uptime": 10.224117149, 2024-09-21T03:20:32.574 INFO:teuthology.orchestra.run.smithi105.stdout: "mdsmap_epoch": 25, 2024-09-21T03:20:32.574 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_epoch": 45, 2024-09-21T03:20:32.574 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_epoch_barrier": 45, 2024-09-21T03:20:32.574 INFO:teuthology.orchestra.run.smithi105.stdout: "uptime": 14.913088341 2024-09-21T03:20:32.574 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-21T03:20:32.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.565+0000 7f7323520640 1 -- 172.21.15.105:0/2803426068 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7308078b90 msgr2=0x7f730807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:32.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.565+0000 7f7323520640 1 --2- 172.21.15.105:0/2803426068 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7308078b90 0x7f730807b0a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7310005fd0 tx=0x7f7310005ea0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.565+0000 7f7323520640 1 -- 172.21.15.105:0/2803426068 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f731c0706c0 msgr2=0x7f731c1e54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:32.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.565+0000 7f7323520640 1 --2- 172.21.15.105:0/2803426068 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f731c0706c0 0x7f731c1e54a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f730c034040 tx=0x7f730c0039e0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.565+0000 7f7323520640 1 -- 172.21.15.105:0/2803426068 shutdown_connections 2024-09-21T03:20:32.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.565+0000 7f7323520640 1 --2- 172.21.15.105:0/2803426068 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7308078b90 0x7f730807b0a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.565+0000 7f7323520640 1 --2- 172.21.15.105:0/2803426068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f731c0cd3e0 0x7f731c14c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.565+0000 7f7323520640 1 --2- 172.21.15.105:0/2803426068 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f731c0af780 0x7f731c1f21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.565+0000 7f7323520640 1 --2- 172.21.15.105:0/2803426068 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f731c0706c0 0x7f731c1e54a0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.565+0000 7f7323520640 1 -- 172.21.15.105:0/2803426068 >> 172.21.15.105:0/2803426068 conn(0x7f731c06d7d0 msgr2=0x7f731c0ad790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:32.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.565+0000 7f7323520640 1 -- 172.21.15.105:0/2803426068 shutdown_connections 2024-09-21T03:20:32.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.566+0000 7f7323520640 1 -- 172.21.15.105:0/2803426068 wait complete. 2024-09-21T03:20:32.578 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T03:20:32.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.688+0000 7f06685c3640 1 -- 172.21.15.105:0/867060605 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f064c004f40 msgr2=0x7f064c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:32.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.688+0000 7f06685c3640 1 --2- 172.21.15.105:0/867060605 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f064c004f40 0x7f064c00b9c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0660070de0 tx=0x7f064c005830 comp rx=0 tx=0).stop 2024-09-21T03:20:32.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.688+0000 7f0666b60640 1 -- 172.21.15.105:0/867060605 reap_dead start 2024-09-21T03:20:32.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.689+0000 7f06685c3640 1 -- 172.21.15.105:0/867060605 shutdown_connections 2024-09-21T03:20:32.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.689+0000 7f06685c3640 1 -- 172.21.15.105:0/867060605 >> 172.21.15.105:0/867060605 conn(0x7f06600b1cb0 msgr2=0x7f06600b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:32.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.689+0000 7f06685c3640 1 -- 172.21.15.105:0/867060605 shutdown_connections 2024-09-21T03:20:32.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.689+0000 7f06685c3640 1 -- 172.21.15.105:0/867060605 wait complete. 2024-09-21T03:20:32.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.690+0000 7f06685c3640 1 Processor -- start 2024-09-21T03:20:32.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.690+0000 7f06685c3640 1 -- start start 2024-09-21T03:20:32.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.692+0000 7f06685c3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f064c004f40 0x7f06600c5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:32.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.692+0000 7f06685c3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06601f5d70 0x7f066009d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:32.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.692+0000 7f06685c3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06600b0110 0x7f06600b0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:32.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.692+0000 7f06685c3640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f06600cba00 con 0x7f064c004f40 2024-09-21T03:20:32.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.692+0000 7f06685c3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f06600747d0 con 0x7f06600b0110 2024-09-21T03:20:32.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.692+0000 7f06685c3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f06600cbb80 con 0x7f06601f5d70 2024-09-21T03:20:32.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.692+0000 7f066635f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f064c004f40 0x7f06600c5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:32.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.692+0000 7f066635f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f064c004f40 0x7f06600c5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:52150/0 (socket says 172.21.15.105:52150) 2024-09-21T03:20:32.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.692+0000 7f066635f640 1 -- 172.21.15.105:0/2154350315 learned_addr learned my addr 172.21.15.105:0/2154350315 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:32.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.692+0000 7f0665b5e640 1 --2- 172.21.15.105:0/2154350315 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06601f5d70 0x7f066009d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:32.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.692+0000 7f0666b60640 1 --2- 172.21.15.105:0/2154350315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06600b0110 0x7f06600b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:32.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.692+0000 7f066635f640 1 -- 172.21.15.105:0/2154350315 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06601f5d70 msgr2=0x7f066009d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:32.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.692+0000 7f066635f640 1 --2- 172.21.15.105:0/2154350315 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06601f5d70 0x7f066009d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.696 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.692+0000 7f066635f640 1 -- 172.21.15.105:0/2154350315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06600b0110 msgr2=0x7f06600b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:32.696 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.692+0000 7f066635f640 1 --2- 172.21.15.105:0/2154350315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06600b0110 0x7f06600b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.696 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.692+0000 7f066635f640 1 -- 172.21.15.105:0/2154350315 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06600b0a60 con 0x7f064c004f40 2024-09-21T03:20:32.696 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.692+0000 7f066635f640 1 --2- 172.21.15.105:0/2154350315 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f064c004f40 0x7f06600c5150 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f065c0099f0 tx=0x7f065c009eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:32.696 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.692+0000 7f0656ffd640 1 -- 172.21.15.105:0/2154350315 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f065c01c070 con 0x7f064c004f40 2024-09-21T03:20:32.696 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.692+0000 7f0656ffd640 1 -- 172.21.15.105:0/2154350315 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f065c00ba50 con 0x7f064c004f40 2024-09-21T03:20:32.696 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.692+0000 7f06685c3640 1 -- 172.21.15.105:0/2154350315 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06601f62a0 con 0x7f064c004f40 2024-09-21T03:20:32.696 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.692+0000 7f0656ffd640 1 -- 172.21.15.105:0/2154350315 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f065c017410 con 0x7f064c004f40 2024-09-21T03:20:32.696 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.693+0000 7f06685c3640 1 -- 172.21.15.105:0/2154350315 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06601f6860 con 0x7f064c004f40 2024-09-21T03:20:32.696 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.693+0000 7f06685c3640 1 -- 172.21.15.105:0/2154350315 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06600aeb30 con 0x7f064c004f40 2024-09-21T03:20:32.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.694+0000 7f0656ffd640 1 -- 172.21.15.105:0/2154350315 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f065c01f070 con 0x7f064c004f40 2024-09-21T03:20:32.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.695+0000 7f0656ffd640 1 --2- 172.21.15.105:0/2154350315 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0644078b90 0x7f064407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:32.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.695+0000 7f0656ffd640 1 -- 172.21.15.105:0/2154350315 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f065c09c6d0 con 0x7f064c004f40 2024-09-21T03:20:32.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.695+0000 7f0665b5e640 1 --2- 172.21.15.105:0/2154350315 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0644078b90 0x7f064407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:32.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.696+0000 7f0665b5e640 1 --2- 172.21.15.105:0/2154350315 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0644078b90 0x7f064407b0a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f06600c7020 tx=0x7f065000b260 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:32.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.699+0000 7f0656ffd640 1 -- 172.21.15.105:0/2154350315 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f06600b0a60 con 0x7f064c004f40 2024-09-21T03:20:32.913 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.911+0000 7f06685c3640 1 -- 172.21.15.105:0/2154350315 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f066009baf0 con 0x7f064c004f40 2024-09-21T03:20:32.913 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.911+0000 7f0656ffd640 1 -- 172.21.15.105:0/2154350315 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) ==== 53+0+73 (secure 0 0 0) 0x7f065c064550 con 0x7f064c004f40 2024-09-21T03:20:32.913 INFO:teuthology.orchestra.run.smithi105.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T03:20:32.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.913+0000 7f06685c3640 1 -- 172.21.15.105:0/2154350315 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0644078b90 msgr2=0x7f064407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:32.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.913+0000 7f06685c3640 1 --2- 172.21.15.105:0/2154350315 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0644078b90 0x7f064407b0a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f06600c7020 tx=0x7f065000b260 comp rx=0 tx=0).stop 2024-09-21T03:20:32.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.913+0000 7f06685c3640 1 -- 172.21.15.105:0/2154350315 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f064c004f40 msgr2=0x7f06600c5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:32.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.913+0000 7f06685c3640 1 --2- 172.21.15.105:0/2154350315 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f064c004f40 0x7f06600c5150 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f065c0099f0 tx=0x7f065c009eb0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.913+0000 7f06685c3640 1 -- 172.21.15.105:0/2154350315 shutdown_connections 2024-09-21T03:20:32.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.913+0000 7f06685c3640 1 --2- 172.21.15.105:0/2154350315 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0644078b90 0x7f064407b0a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.913+0000 7f06685c3640 1 --2- 172.21.15.105:0/2154350315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06600b0110 0x7f06600b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.916 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.913+0000 7f06685c3640 1 --2- 172.21.15.105:0/2154350315 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06601f5d70 0x7f066009d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.916 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.913+0000 7f06685c3640 1 --2- 172.21.15.105:0/2154350315 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f064c004f40 0x7f06600c5150 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:32.916 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.913+0000 7f06685c3640 1 -- 172.21.15.105:0/2154350315 >> 172.21.15.105:0/2154350315 conn(0x7f06600b1cb0 msgr2=0x7f06600b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:32.916 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.913+0000 7f06685c3640 1 -- 172.21.15.105:0/2154350315 shutdown_connections 2024-09-21T03:20:32.916 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:32.913+0000 7f06685c3640 1 -- 172.21.15.105:0/2154350315 wait complete. 2024-09-21T03:20:32.926 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T03:20:32.926 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T03:20:32.926 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi105.front.sepia.ceph.com 2024-09-21T03:20:32.926 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T03:20:32.926 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T03:20:32.926 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T03:20:32.927 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T03:20:32.927 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T03:20:32.927 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:20:32.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:20:32.927 DEBUG:teuthology.orchestra.run.smithi105:> ip addr 2024-09-21T03:20:32.943 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T03:20:32.943 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T03:20:32.943 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T03:20:32.943 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:20:32.943 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2024-09-21T03:20:32.943 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:20:32.943 INFO:teuthology.orchestra.run.smithi105.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:20:32.943 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b8 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:20:32.943 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f0 2024-09-21T03:20:32.943 INFO:teuthology.orchestra.run.smithi105.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:20:32.943 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b9 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:20:32.943 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f1 2024-09-21T03:20:32.944 INFO:teuthology.orchestra.run.smithi105.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:20:32.944 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:28 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:20:32.944 INFO:teuthology.orchestra.run.smithi105.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T03:20:32.944 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:29 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:20:32.944 INFO:teuthology.orchestra.run.smithi105.stdout: inet 172.21.15.105/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T03:20:32.944 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft 42675sec preferred_lft 42675sec 2024-09-21T03:20:32.944 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::ec4:7aff:fe8f:d429/64 scope link noprefixroute 2024-09-21T03:20:32.944 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:20:32.944 INFO:teuthology.orchestra.run.smithi105.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T03:20:32.944 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 86:15:ed:f2:4e:d8 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:20:32.944 INFO:teuthology.orchestra.run.smithi105.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T03:20:32.944 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:20:32.944 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::80db:6aff:fece:44c2/64 scope link 2024-09-21T03:20:32.944 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:20:32.944 INFO:teuthology.orchestra.run.smithi105.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:20:32.945 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 86:15:ed:f2:4e:d8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T03:20:32.945 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::8415:edff:fef2:4ed8/64 scope link 2024-09-21T03:20:32.945 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:20:32.945 INFO:teuthology.orchestra.run.smithi105.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:20:32.945 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether a2:e9:7c:d4:c7:c7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T03:20:32.945 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::a0e9:7cff:fed4:c7c7/64 scope link 2024-09-21T03:20:32.945 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:20:32.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:20:32.945 DEBUG:teuthology.orchestra.run.smithi105:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T03:20:33.006 INFO:teuthology.orchestra.run.smithi105.stdout:1 2024-09-21T03:20:33.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:20:33.008 DEBUG:teuthology.orchestra.run.smithi105:> route 2024-09-21T03:20:33.064 INFO:teuthology.orchestra.run.smithi105.stdout:Kernel IP routing table 2024-09-21T03:20:33.064 INFO:teuthology.orchestra.run.smithi105.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T03:20:33.064 INFO:teuthology.orchestra.run.smithi105.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T03:20:33.065 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T03:20:33.065 INFO:teuthology.orchestra.run.smithi105.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T03:20:33.065 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:20:33.065 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-21T03:20:33.065 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T03:20:33.065 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T03:20:33.065 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T03:20:33.065 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-21T03:20:33.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:20:33.183 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:20:33.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:20:33.190 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-09-21T03:20:33.204 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T03:20:33.205 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T03:20:33.205 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:20:33.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:20:33.205 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set brx.0 up 2024-09-21T03:20:33.269 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:20:33.269 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T03:20:33.325 INFO:teuthology.orchestra.run.smithi105.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:20:33.325 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:20:33.325 DEBUG:teuthology.orchestra.run.smithi105:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T03:20:33.381 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-21T03:20:33.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:20:33.381 DEBUG:teuthology.orchestra.run.smithi105:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:20:33.478 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:20:33.478 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T03:20:33.478 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2024-09-21T03:20:33.486 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:20:33.487 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T03:20:33.487 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2024-09-21T03:20:33.487 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:20:33.487 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:20:33.493 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:20:33.493 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T03:20:33.493 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2024-09-21T03:20:33.493 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:20:33.493 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:20:33.493 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-21T03:20:33.494 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-21T03:20:33.494 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=29d80f4f-e5de-4b26-8384-24c2d8019945" will pass to kernel 2024-09-21T03:20:33.494 INFO:teuthology.orchestra.run.smithi105.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T03:20:33.494 INFO:teuthology.orchestra.run.smithi105.stdout: You just mounted a file system that supports labels which does not 2024-09-21T03:20:33.494 INFO:teuthology.orchestra.run.smithi105.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T03:20:33.494 INFO:teuthology.orchestra.run.smithi105.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T03:20:33.494 INFO:teuthology.orchestra.run.smithi105.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T03:20:33.495 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T03:20:33.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:20:33.495 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T03:20:33.520 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:20:33.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:20:33.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:20:33.621 INFO:teuthology.orchestra.run.smithi105.stdout:client5484 2024-09-21T03:20:33.621 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:20:33.621 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:20:33.637 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T03:20:33.787 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33.786+0000 7f1f811a1640 1 -- 172.21.15.105:0/3734268620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f7c0cc1e0 msgr2=0x7f1f7c0af3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:33.788 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33.786+0000 7f1f811a1640 1 --2- 172.21.15.105:0/3734268620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f7c0cc1e0 0x7f1f7c0af3c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c072dc0 tx=0x7f1f6c02a5f0 comp rx=0 tx=0).stop 2024-09-21T03:20:33.788 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33.786+0000 7f1f811a1640 1 -- 172.21.15.105:0/3734268620 shutdown_connections 2024-09-21T03:20:33.788 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33.786+0000 7f1f811a1640 1 --2- 172.21.15.105:0/3734268620 >> v2:172.21.15.162:3300/0 conn(0x7f1f7c0ccb50 0x7f1f7c0ccf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:33.788 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33.786+0000 7f1f811a1640 1 --2- 172.21.15.105:0/3734268620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f7c0cc1e0 0x7f1f7c0af3c0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:33.788 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33.786+0000 7f1f811a1640 1 -- 172.21.15.105:0/3734268620 >> 172.21.15.105:0/3734268620 conn(0x7f1f7c06d7d0 msgr2=0x7f1f7c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:33.788 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33.786+0000 7f1f811a1640 1 -- 172.21.15.105:0/3734268620 shutdown_connections 2024-09-21T03:20:33.788 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33.786+0000 7f1f811a1640 1 -- 172.21.15.105:0/3734268620 wait complete. 2024-09-21T03:20:33.789 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33.788+0000 7f1f811a1640 1 Processor -- start 2024-09-21T03:20:33.789 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33.788+0000 7f1f811a1640 1 -- start start 2024-09-21T03:20:33.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33.789+0000 7f1f811a1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f7c0cc1e0 0x7f1f7c0ae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:33.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33.789+0000 7f1f811a1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f7c0ccb50 0x7f1f7c09cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:33.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33.789+0000 7f1f811a1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1f7c15d8a0 0x7f1f7c09d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:33.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33.789+0000 7f1f811a1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7c1533a0 con 0x7f1f7c0cc1e0 2024-09-21T03:20:33.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33.789+0000 7f1f811a1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7c15d3e0 con 0x7f1f7c0ccb50 2024-09-21T03:20:33.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33.789+0000 7f1f811a1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1f7c153520 con 0x7f1f7c15d8a0 2024-09-21T03:20:33.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33.789+0000 7f1f7ad9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f7c0cc1e0 0x7f1f7c0ae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:33.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33.789+0000 7f1f7ad9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f7c0cc1e0 0x7f1f7c0ae2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:52180/0 (socket says 172.21.15.105:52180) 2024-09-21T03:20:33.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33.789+0000 7f1f7ad9d640 1 -- 172.21.15.105:0/953101071 learned_addr learned my addr 172.21.15.105:0/953101071 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:33.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33.789+0000 7f1f7259c640 1 --2- 172.21.15.105:0/953101071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f7c0ccb50 0x7f1f7c09cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:33.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33.789+0000 7f1f7b59e640 1 --2- 172.21.15.105:0/953101071 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1f7c15d8a0 0x7f1f7c09d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:33.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33.790+0000 7f1f7ad9d640 1 -- 172.21.15.105:0/953101071 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1f7c15d8a0 msgr2=0x7f1f7c09d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:33.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33.790+0000 7f1f7ad9d640 1 --2- 172.21.15.105:0/953101071 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1f7c15d8a0 0x7f1f7c09d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:33.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33.790+0000 7f1f7ad9d640 1 -- 172.21.15.105:0/953101071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f7c0ccb50 msgr2=0x7f1f7c09cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:33.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33.790+0000 7f1f7ad9d640 1 --2- 172.21.15.105:0/953101071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f7c0ccb50 0x7f1f7c09cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:33.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33.790+0000 7f1f7ad9d640 1 -- 172.21.15.105:0/953101071 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f7c158770 con 0x7f1f7c0cc1e0 2024-09-21T03:20:33.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33.790+0000 7f1f7ad9d640 1 --2- 172.21.15.105:0/953101071 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f7c0cc1e0 0x7f1f7c0ae2f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c034040 tx=0x7f1f6c003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:33.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33.790+0000 7f1f73fff640 1 -- 172.21.15.105:0/953101071 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c03e030 con 0x7f1f7c0cc1e0 2024-09-21T03:20:33.794 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33.790+0000 7f1f73fff640 1 -- 172.21.15.105:0/953101071 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f6c003d10 con 0x7f1f7c0cc1e0 2024-09-21T03:20:33.794 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33.790+0000 7f1f811a1640 1 -- 172.21.15.105:0/953101071 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f7c1f3530 con 0x7f1f7c0cc1e0 2024-09-21T03:20:33.794 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33.790+0000 7f1f73fff640 1 -- 172.21.15.105:0/953101071 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c035040 con 0x7f1f7c0cc1e0 2024-09-21T03:20:33.794 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33.790+0000 7f1f811a1640 1 -- 172.21.15.105:0/953101071 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f7c1f3ad0 con 0x7f1f7c0cc1e0 2024-09-21T03:20:33.795 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33.791+0000 7f1f811a1640 1 -- 172.21.15.105:0/953101071 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f7c158940 con 0x7f1f7c0cc1e0 2024-09-21T03:20:33.795 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33.792+0000 7f1f73fff640 1 -- 172.21.15.105:0/953101071 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1f6c041030 con 0x7f1f7c0cc1e0 2024-09-21T03:20:33.795 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33.792+0000 7f1f73fff640 1 --2- 172.21.15.105:0/953101071 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1f5c078b90 0x7f1f5c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:33.795 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33.793+0000 7f1f73fff640 1 -- 172.21.15.105:0/953101071 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f1f6c0bb420 con 0x7f1f7c0cc1e0 2024-09-21T03:20:33.795 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33.793+0000 7f1f7259c640 1 --2- 172.21.15.105:0/953101071 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1f5c078b90 0x7f1f5c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:33.795 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33.793+0000 7f1f7259c640 1 --2- 172.21.15.105:0/953101071 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1f5c078b90 0x7f1f5c07b0a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c09cf80 tx=0x7f1f64009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:33.799 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:33.797+0000 7f1f73fff640 1 -- 172.21.15.105:0/953101071 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1f6c083220 con 0x7f1f7c0cc1e0 2024-09-21T03:20:34.012 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:34.010+0000 7f1f811a1640 1 -- 172.21.15.105:0/953101071 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1f7c0ccf60 con 0x7f1f7c0cc1e0 2024-09-21T03:20:34.012 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:34.011+0000 7f1f73fff640 1 -- 172.21.15.105:0/953101071 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) ==== 53+0+73 (secure 0 0 0) 0x7f1f6c087c50 con 0x7f1f7c0cc1e0 2024-09-21T03:20:34.013 INFO:teuthology.orchestra.run.smithi105.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T03:20:34.015 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:34.013+0000 7f1f811a1640 1 -- 172.21.15.105:0/953101071 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1f5c078b90 msgr2=0x7f1f5c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:34.015 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:34.013+0000 7f1f811a1640 1 --2- 172.21.15.105:0/953101071 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1f5c078b90 0x7f1f5c07b0a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c09cf80 tx=0x7f1f64009040 comp rx=0 tx=0).stop 2024-09-21T03:20:34.015 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:34.013+0000 7f1f811a1640 1 -- 172.21.15.105:0/953101071 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f7c0cc1e0 msgr2=0x7f1f7c0ae2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:34.015 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:34.013+0000 7f1f811a1640 1 --2- 172.21.15.105:0/953101071 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f7c0cc1e0 0x7f1f7c0ae2f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c034040 tx=0x7f1f6c003820 comp rx=0 tx=0).stop 2024-09-21T03:20:34.015 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:34.013+0000 7f1f811a1640 1 -- 172.21.15.105:0/953101071 shutdown_connections 2024-09-21T03:20:34.015 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:34.013+0000 7f1f811a1640 1 --2- 172.21.15.105:0/953101071 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1f5c078b90 0x7f1f5c07b0a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:34.015 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:34.013+0000 7f1f811a1640 1 --2- 172.21.15.105:0/953101071 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1f7c15d8a0 0x7f1f7c09d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:34.016 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:34.013+0000 7f1f811a1640 1 --2- 172.21.15.105:0/953101071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f7c0ccb50 0x7f1f7c09cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:34.016 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:34.013+0000 7f1f811a1640 1 --2- 172.21.15.105:0/953101071 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f7c0cc1e0 0x7f1f7c0ae2f0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:34.016 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:34.013+0000 7f1f811a1640 1 -- 172.21.15.105:0/953101071 >> 172.21.15.105:0/953101071 conn(0x7f1f7c06d7d0 msgr2=0x7f1f7c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:34.016 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:34.013+0000 7f1f811a1640 1 -- 172.21.15.105:0/953101071 shutdown_connections 2024-09-21T03:20:34.016 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:34.013+0000 7f1f811a1640 1 -- 172.21.15.105:0/953101071 wait complete. 2024-09-21T03:20:34.026 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T03:20:34.026 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T03:20:34.026 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2024-09-21T03:20:34.026 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-21T03:20:34.026 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T03:20:34.026 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T03:20:34.026 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T03:20:34.026 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T03:20:34.026 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T03:20:34.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:20:34.027 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2024-09-21T03:20:34.046 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T03:20:34.046 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T03:20:34.047 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T03:20:34.047 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:20:34.047 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-09-21T03:20:34.047 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:20:34.047 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:20:34.047 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:20:34.047 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f0 2024-09-21T03:20:34.047 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:20:34.047 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:20:34.047 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f1 2024-09-21T03:20:34.047 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:20:34.047 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:20:34.047 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T03:20:34.047 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:20:34.048 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T03:20:34.048 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42666sec preferred_lft 42666sec 2024-09-21T03:20:34.048 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::ec4:7aff:fe88:7f41/64 scope link noprefixroute 2024-09-21T03:20:34.048 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:20:34.048 INFO:teuthology.orchestra.run.smithi162.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T03:20:34.048 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 32:ad:10:1b:86:54 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:20:34.048 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T03:20:34.048 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:20:34.048 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::c03a:6bff:febf:f5a9/64 scope link 2024-09-21T03:20:34.048 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:20:34.048 INFO:teuthology.orchestra.run.smithi162.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:20:34.048 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 32:ad:10:1b:86:54 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T03:20:34.048 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::30ad:10ff:fe1b:8654/64 scope link 2024-09-21T03:20:34.048 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:20:34.049 INFO:teuthology.orchestra.run.smithi162.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:20:34.049 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 6a:62:2d:53:ae:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-21T03:20:34.049 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::6862:2dff:fe53:aec0/64 scope link 2024-09-21T03:20:34.049 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:20:34.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:20:34.049 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T03:20:34.116 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-09-21T03:20:34.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:20:34.118 DEBUG:teuthology.orchestra.run.smithi162:> route 2024-09-21T03:20:34.177 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2024-09-21T03:20:34.177 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T03:20:34.177 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T03:20:34.177 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T03:20:34.177 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T03:20:34.178 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:20:34.178 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-09-21T03:20:34.178 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T03:20:34.178 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T03:20:34.178 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T03:20:34.178 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-09-21T03:20:34.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:20:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:20:34.303 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:20:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:20:34.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:20:34.309 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-09-21T03:20:34.325 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-21T03:20:34.325 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-21T03:20:34.325 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T03:20:34.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:20:34.326 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.0 up 2024-09-21T03:20:34.391 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:20:34.391 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-21T03:20:34.446 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-21T03:20:34.447 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:20:34.447 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-21T03:20:34.501 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-21T03:20:34.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:20:34.501 DEBUG:teuthology.orchestra.run.smithi162:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:20:34.595 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:20:34.595 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T03:20:34.595 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-21T03:20:34.606 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:20:34.606 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T03:20:34.606 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-21T03:20:34.607 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:20:34.607 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:20:34.612 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:20:34.613 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T03:20:34.613 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-21T03:20:34.613 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:20:34.613 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:20:34.613 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-21T03:20:34.613 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-21T03:20:34.613 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=29d80f4f-e5de-4b26-8384-24c2d8019945" will pass to kernel 2024-09-21T03:20:34.614 INFO:teuthology.orchestra.run.smithi162.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-21T03:20:34.614 INFO:teuthology.orchestra.run.smithi162.stdout: You just mounted a file system that supports labels which does not 2024-09-21T03:20:34.614 INFO:teuthology.orchestra.run.smithi162.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T03:20:34.614 INFO:teuthology.orchestra.run.smithi162.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T03:20:34.614 INFO:teuthology.orchestra.run.smithi162.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T03:20:34.615 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T03:20:34.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:20:34.615 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-21T03:20:34.640 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:20:34.729 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:20:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:20:34.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:20:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:20:34.737 INFO:teuthology.orchestra.run.smithi162.stdout:client5493 2024-09-21T03:20:34.737 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:20:34.737 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:20:34.753 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T03:20:34.753 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T03:20:34.803 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T03:20:34.842 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T03:20:34.842 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T03:20:34.842 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:20:34.842 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:20:34.859 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:20:34.859 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:20:34.917 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T03:20:35.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.072+0000 7f06766dc640 1 -- 172.21.15.105:0/4179425291 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0670153970 msgr2=0x7f067015d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:35.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.072+0000 7f06766dc640 1 --2- 172.21.15.105:0/4179425291 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0670153970 0x7f067015d810 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0660005fd0 tx=0x7f066002a5d0 comp rx=0 tx=0).stop 2024-09-21T03:20:35.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.072+0000 7f06766dc640 1 -- 172.21.15.105:0/4179425291 shutdown_connections 2024-09-21T03:20:35.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.072+0000 7f06766dc640 1 --2- 172.21.15.105:0/4179425291 >> v2:172.21.15.162:3300/0 conn(0x7f06700cfc00 0x7f06700ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:35.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.072+0000 7f06766dc640 1 --2- 172.21.15.105:0/4179425291 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0670153970 0x7f067015d810 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:35.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.072+0000 7f06766dc640 1 -- 172.21.15.105:0/4179425291 >> 172.21.15.105:0/4179425291 conn(0x7f06700d15f0 msgr2=0x7f0670073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:35.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.072+0000 7f06766dc640 1 -- 172.21.15.105:0/4179425291 shutdown_connections 2024-09-21T03:20:35.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.072+0000 7f06766dc640 1 -- 172.21.15.105:0/4179425291 wait complete. 2024-09-21T03:20:35.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.074+0000 7f06766dc640 1 Processor -- start 2024-09-21T03:20:35.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.074+0000 7f06766dc640 1 -- start start 2024-09-21T03:20:35.078 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.075+0000 7f06766dc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0670073e50 0x7f0670160b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:35.079 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.076+0000 7f06766dc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06700cfc00 0x7f06700cc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:35.079 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.076+0000 7f06766dc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0670153970 0x7f0670157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:35.079 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.076+0000 7f06766dc640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f067015e2e0 con 0x7f0670153970 2024-09-21T03:20:35.079 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.076+0000 7f06766dc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f067015e160 con 0x7f06700cfc00 2024-09-21T03:20:35.079 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.076+0000 7f06766dc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f067015e460 con 0x7f0670073e50 2024-09-21T03:20:35.079 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.076+0000 7f0674c79640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0670153970 0x7f0670157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:35.079 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.076+0000 7f0674c79640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0670153970 0x7f0670157450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:52190/0 (socket says 172.21.15.105:52190) 2024-09-21T03:20:35.079 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.076+0000 7f0674c79640 1 -- 172.21.15.105:0/1087572378 learned_addr learned my addr 172.21.15.105:0/1087572378 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:35.079 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.076+0000 7f066ffff640 1 --2- 172.21.15.105:0/1087572378 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0670073e50 0x7f0670160b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:35.079 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.076+0000 7f066f7fe640 1 --2- 172.21.15.105:0/1087572378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06700cfc00 0x7f06700cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:35.079 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.076+0000 7f066ffff640 1 -- 172.21.15.105:0/1087572378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06700cfc00 msgr2=0x7f06700cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:35.079 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.076+0000 7f066ffff640 1 --2- 172.21.15.105:0/1087572378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06700cfc00 0x7f06700cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:35.079 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.076+0000 7f066ffff640 1 -- 172.21.15.105:0/1087572378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0670153970 msgr2=0x7f0670157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:35.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.076+0000 7f066ffff640 1 --2- 172.21.15.105:0/1087572378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0670153970 0x7f0670157450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:35.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.076+0000 7f066ffff640 1 -- 172.21.15.105:0/1087572378 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06700cc6d0 con 0x7f0670073e50 2024-09-21T03:20:35.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.076+0000 7f0674c79640 1 --2- 172.21.15.105:0/1087572378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0670153970 0x7f0670157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:20:35.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.076+0000 7f066ffff640 1 --2- 172.21.15.105:0/1087572378 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0670073e50 0x7f0670160b70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f06700d0580 tx=0x7f0660005750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:35.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.076+0000 7f066cff9640 1 -- 172.21.15.105:0/1087572378 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f066003e030 con 0x7f0670073e50 2024-09-21T03:20:35.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.077+0000 7f066cff9640 1 -- 172.21.15.105:0/1087572378 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0660003a70 con 0x7f0670073e50 2024-09-21T03:20:35.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.077+0000 7f06766dc640 1 -- 172.21.15.105:0/1087572378 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0670159720 con 0x7f0670073e50 2024-09-21T03:20:35.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.077+0000 7f066cff9640 1 -- 172.21.15.105:0/1087572378 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0660035040 con 0x7f0670073e50 2024-09-21T03:20:35.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.077+0000 7f06766dc640 1 -- 172.21.15.105:0/1087572378 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0670159ce0 con 0x7f0670073e50 2024-09-21T03:20:35.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.077+0000 7f06766dc640 1 -- 172.21.15.105:0/1087572378 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0670161240 con 0x7f0670073e50 2024-09-21T03:20:35.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.078+0000 7f066cff9640 1 -- 172.21.15.105:0/1087572378 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0660041030 con 0x7f0670073e50 2024-09-21T03:20:35.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.079+0000 7f066cff9640 1 --2- 172.21.15.105:0/1087572378 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f065c078b90 0x7f065c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:35.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.079+0000 7f066cff9640 1 -- 172.21.15.105:0/1087572378 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f06600bb910 con 0x7f0670073e50 2024-09-21T03:20:35.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.079+0000 7f066f7fe640 1 --2- 172.21.15.105:0/1087572378 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f065c078b90 0x7f065c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:35.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.079+0000 7f066f7fe640 1 --2- 172.21.15.105:0/1087572378 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f065c078b90 0x7f065c07b0a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f06640095f0 tx=0x7f0664005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:35.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.083+0000 7f066cff9640 1 -- 172.21.15.105:0/1087572378 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0670161240 con 0x7f0670073e50 2024-09-21T03:20:35.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.272+0000 7f06766dc640 1 -- 172.21.15.105:0/1087572378 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f06701594a0 con 0x7f0670073e50 2024-09-21T03:20:35.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.273+0000 7f066cff9640 1 -- 172.21.15.105:0/1087572378 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v45) ==== 80+0+0 (secure 0 0 0) 0x7f06701594a0 con 0x7f0670073e50 2024-09-21T03:20:35.274 INFO:teuthology.orchestra.run.smithi105.stderr:listed 0 entries 2024-09-21T03:20:35.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.275+0000 7f06766dc640 1 -- 172.21.15.105:0/1087572378 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f065c078b90 msgr2=0x7f065c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:35.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.275+0000 7f06766dc640 1 --2- 172.21.15.105:0/1087572378 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f065c078b90 0x7f065c07b0a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f06640095f0 tx=0x7f0664005f90 comp rx=0 tx=0).stop 2024-09-21T03:20:35.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.275+0000 7f06766dc640 1 -- 172.21.15.105:0/1087572378 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0670073e50 msgr2=0x7f0670160b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:35.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.275+0000 7f06766dc640 1 --2- 172.21.15.105:0/1087572378 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0670073e50 0x7f0670160b70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f06700d0580 tx=0x7f0660005750 comp rx=0 tx=0).stop 2024-09-21T03:20:35.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.275+0000 7f06766dc640 1 -- 172.21.15.105:0/1087572378 shutdown_connections 2024-09-21T03:20:35.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.275+0000 7f06766dc640 1 --2- 172.21.15.105:0/1087572378 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f065c078b90 0x7f065c07b0a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:35.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.275+0000 7f06766dc640 1 --2- 172.21.15.105:0/1087572378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0670153970 0x7f0670157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:35.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.275+0000 7f06766dc640 1 --2- 172.21.15.105:0/1087572378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06700cfc00 0x7f06700cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:35.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.275+0000 7f06766dc640 1 --2- 172.21.15.105:0/1087572378 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0670073e50 0x7f0670160b70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:35.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.275+0000 7f06766dc640 1 -- 172.21.15.105:0/1087572378 >> 172.21.15.105:0/1087572378 conn(0x7f06700d15f0 msgr2=0x7f067015c230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:35.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.275+0000 7f06766dc640 1 -- 172.21.15.105:0/1087572378 shutdown_connections 2024-09-21T03:20:35.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.275+0000 7f06766dc640 1 -- 172.21.15.105:0/1087572378 wait complete. 2024-09-21T03:20:35.288 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T03:20:35.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:20:35.288 DEBUG:teuthology.orchestra.run.smithi105:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T03:20:35.317 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi105.front.sepia.ceph.com 2024-09-21T03:20:35.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:20:35.317 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T03:20:35.376 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T03:20:35.377 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:20:35.377 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:20:35.394 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:20:35.394 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:20:35.457 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T03:20:35.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.578+0000 7fa4e86e5640 1 -- 172.21.15.105:0/3656327179 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4c8004800 msgr2=0x7fa4c8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:35.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.578+0000 7fa4e86e5640 1 --2- 172.21.15.105:0/3656327179 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4c8004800 0x7fa4c8004c50 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa4d400c3c0 tx=0x7fa4c8005830 comp rx=0 tx=0).stop 2024-09-21T03:20:35.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.578+0000 7fa4e6c82640 1 -- 172.21.15.105:0/3656327179 reap_dead start 2024-09-21T03:20:35.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.578+0000 7fa4e86e5640 1 -- 172.21.15.105:0/3656327179 shutdown_connections 2024-09-21T03:20:35.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.578+0000 7fa4e86e5640 1 -- 172.21.15.105:0/3656327179 >> 172.21.15.105:0/3656327179 conn(0x7fa4e00b2160 msgr2=0x7fa4e00b2570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:35.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.578+0000 7fa4e86e5640 1 -- 172.21.15.105:0/3656327179 shutdown_connections 2024-09-21T03:20:35.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.578+0000 7fa4e86e5640 1 -- 172.21.15.105:0/3656327179 wait complete. 2024-09-21T03:20:35.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.580+0000 7fa4e86e5640 1 Processor -- start 2024-09-21T03:20:35.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.580+0000 7fa4e86e5640 1 -- start start 2024-09-21T03:20:35.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.581+0000 7fa4e86e5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4c8004800 0x7fa4e0151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:35.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.581+0000 7fa4e86e5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4e015ad60 0x7fa4e01f39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:35.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.581+0000 7fa4e86e5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4e01f3ef0 0x7fa4e00b3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:35.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.581+0000 7fa4e86e5640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e00b4f00 con 0x7fa4c8004800 2024-09-21T03:20:35.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.581+0000 7fa4e86e5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e00b4d80 con 0x7fa4e015ad60 2024-09-21T03:20:35.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.581+0000 7fa4e86e5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa4e006f6e0 con 0x7fa4e01f3ef0 2024-09-21T03:20:35.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.581+0000 7fa4e6481640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4c8004800 0x7fa4e0151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:35.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.581+0000 7fa4e6481640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4c8004800 0x7fa4e0151090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:52218/0 (socket says 172.21.15.105:52218) 2024-09-21T03:20:35.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.581+0000 7fa4e6481640 1 -- 172.21.15.105:0/201668799 learned_addr learned my addr 172.21.15.105:0/201668799 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:35.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.581+0000 7fa4e6c82640 1 --2- 172.21.15.105:0/201668799 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4e01f3ef0 0x7fa4e00b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:35.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.581+0000 7fa4e5c80640 1 --2- 172.21.15.105:0/201668799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4e015ad60 0x7fa4e01f39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:35.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.581+0000 7fa4e6481640 1 -- 172.21.15.105:0/201668799 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4e01f3ef0 msgr2=0x7fa4e00b3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:35.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.581+0000 7fa4e6481640 1 --2- 172.21.15.105:0/201668799 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4e01f3ef0 0x7fa4e00b3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:35.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.581+0000 7fa4e6481640 1 -- 172.21.15.105:0/201668799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4e015ad60 msgr2=0x7fa4e01f39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:35.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.581+0000 7fa4e6481640 1 --2- 172.21.15.105:0/201668799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4e015ad60 0x7fa4e01f39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:35.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.581+0000 7fa4e6481640 1 -- 172.21.15.105:0/201668799 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4e0159fa0 con 0x7fa4c8004800 2024-09-21T03:20:35.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.581+0000 7fa4e6481640 1 --2- 172.21.15.105:0/201668799 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4c8004800 0x7fa4e0151090 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0003f90 tx=0x7fa4d0006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:35.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.582+0000 7fa4deffd640 1 -- 172.21.15.105:0/201668799 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0015070 con 0x7fa4c8004800 2024-09-21T03:20:35.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.582+0000 7fa4deffd640 1 -- 172.21.15.105:0/201668799 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa4d000f9e0 con 0x7fa4c8004800 2024-09-21T03:20:35.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.582+0000 7fa4deffd640 1 -- 172.21.15.105:0/201668799 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d000fe10 con 0x7fa4c8004800 2024-09-21T03:20:35.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.582+0000 7fa4e86e5640 1 -- 172.21.15.105:0/201668799 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4e015a280 con 0x7fa4c8004800 2024-09-21T03:20:35.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.582+0000 7fa4e86e5640 1 -- 172.21.15.105:0/201668799 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4e015a840 con 0x7fa4c8004800 2024-09-21T03:20:35.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.583+0000 7fa4e86e5640 1 -- 172.21.15.105:0/201668799 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4e0070dc0 con 0x7fa4c8004800 2024-09-21T03:20:35.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.583+0000 7fa4deffd640 1 -- 172.21.15.105:0/201668799 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa4d0011430 con 0x7fa4c8004800 2024-09-21T03:20:35.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.584+0000 7fa4deffd640 1 --2- 172.21.15.105:0/201668799 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa4cc078b90 0x7fa4cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:35.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.584+0000 7fa4deffd640 1 -- 172.21.15.105:0/201668799 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fa4d009bb40 con 0x7fa4c8004800 2024-09-21T03:20:35.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.584+0000 7fa4e5c80640 1 --2- 172.21.15.105:0/201668799 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa4cc078b90 0x7fa4cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:35.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.585+0000 7fa4e5c80640 1 --2- 172.21.15.105:0/201668799 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa4cc078b90 0x7fa4cc07b0a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4033000 tx=0x7fa4e00cebb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:35.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.588+0000 7fa4deffd640 1 -- 172.21.15.105:0/201668799 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa4d0063930 con 0x7fa4c8004800 2024-09-21T03:20:35.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.776+0000 7fa4e86e5640 1 -- 172.21.15.105:0/201668799 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa4e0073910 con 0x7fa4c8004800 2024-09-21T03:20:35.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.777+0000 7fa4deffd640 1 -- 172.21.15.105:0/201668799 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v45) ==== 80+0+0 (secure 0 0 0) 0x7fa4d0068360 con 0x7fa4c8004800 2024-09-21T03:20:35.779 INFO:teuthology.orchestra.run.smithi105.stderr:listed 0 entries 2024-09-21T03:20:35.781 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.779+0000 7fa4e86e5640 1 -- 172.21.15.105:0/201668799 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa4cc078b90 msgr2=0x7fa4cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:35.781 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.779+0000 7fa4e86e5640 1 --2- 172.21.15.105:0/201668799 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa4cc078b90 0x7fa4cc07b0a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4033000 tx=0x7fa4e00cebb0 comp rx=0 tx=0).stop 2024-09-21T03:20:35.782 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.779+0000 7fa4e86e5640 1 -- 172.21.15.105:0/201668799 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4c8004800 msgr2=0x7fa4e0151090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:35.782 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.779+0000 7fa4e86e5640 1 --2- 172.21.15.105:0/201668799 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4c8004800 0x7fa4e0151090 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0003f90 tx=0x7fa4d0006430 comp rx=0 tx=0).stop 2024-09-21T03:20:35.782 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.779+0000 7fa4e86e5640 1 -- 172.21.15.105:0/201668799 shutdown_connections 2024-09-21T03:20:35.782 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.779+0000 7fa4e86e5640 1 --2- 172.21.15.105:0/201668799 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa4cc078b90 0x7fa4cc07b0a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:35.782 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.779+0000 7fa4e86e5640 1 --2- 172.21.15.105:0/201668799 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4e01f3ef0 0x7fa4e00b3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:35.782 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.779+0000 7fa4e86e5640 1 --2- 172.21.15.105:0/201668799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4e015ad60 0x7fa4e01f39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:35.782 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.779+0000 7fa4e86e5640 1 --2- 172.21.15.105:0/201668799 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4c8004800 0x7fa4e0151090 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:35.782 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.779+0000 7fa4e86e5640 1 -- 172.21.15.105:0/201668799 >> 172.21.15.105:0/201668799 conn(0x7fa4e00b2160 msgr2=0x7fa4e00b19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:35.782 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.779+0000 7fa4e86e5640 1 -- 172.21.15.105:0/201668799 shutdown_connections 2024-09-21T03:20:35.782 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:35.779+0000 7fa4e86e5640 1 -- 172.21.15.105:0/201668799 wait complete. 2024-09-21T03:20:35.792 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-21T03:20:35.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:20:35.792 DEBUG:teuthology.orchestra.run.smithi162:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-21T03:20:35.821 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2024-09-21T03:20:35.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:20:35.822 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-21T03:20:35.879 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T03:20:35.879 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:20:35.879 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:20:35.897 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T03:20:35.897 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T03:20:35.897 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:20:35.897 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:20:35.939 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=452 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T03:20:35.939 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:20:36.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.050+0000 7f1a0cc4a640 1 -- 172.21.15.105:0/970921305 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a080b66b0 msgr2=0x7f1a0806eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:36.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.050+0000 7f1a0cc4a640 1 --2- 172.21.15.105:0/970921305 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a080b66b0 0x7f1a0806eab0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1a00005fd0 tx=0x7f1a0002a780 comp rx=0 tx=0).stop 2024-09-21T03:20:36.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.050+0000 7f1a0cc4a640 1 -- 172.21.15.105:0/970921305 shutdown_connections 2024-09-21T03:20:36.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.050+0000 7f1a0cc4a640 1 --2- 172.21.15.105:0/970921305 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a080b66b0 0x7f1a0806eab0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:36.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.050+0000 7f1a0cc4a640 1 --2- 172.21.15.105:0/970921305 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1a080b9b60 0x7f1a080d4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:36.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.050+0000 7f1a0cc4a640 1 -- 172.21.15.105:0/970921305 >> 172.21.15.105:0/970921305 conn(0x7f1a0809d7f0 msgr2=0x7f1a080d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:36.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.050+0000 7f1a0cc4a640 1 -- 172.21.15.105:0/970921305 shutdown_connections 2024-09-21T03:20:36.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.050+0000 7f1a0cc4a640 1 -- 172.21.15.105:0/970921305 wait complete. 2024-09-21T03:20:36.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.052+0000 7f1a0cc4a640 1 Processor -- start 2024-09-21T03:20:36.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.052+0000 7f1a0cc4a640 1 -- start start 2024-09-21T03:20:36.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.053+0000 7f1a0cc4a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a080b9b60 0x7f1a080cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:36.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.053+0000 7f1a0cc4a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a080cf540 0x7f1a0815be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:36.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.053+0000 7f1a0cc4a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1a081e8fb0 0x7f1a080b2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:36.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.053+0000 7f1a0cc4a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0806f5d0 con 0x7f1a080cf540 2024-09-21T03:20:36.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.053+0000 7f1a0cc4a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0806f450 con 0x7f1a080b9b60 2024-09-21T03:20:36.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.053+0000 7f1a0cc4a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1a0806f750 con 0x7f1a081e8fb0 2024-09-21T03:20:36.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.054+0000 7f1a05d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a080cf540 0x7f1a0815be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:36.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.054+0000 7f1a05d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a080cf540 0x7f1a0815be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:52234/0 (socket says 172.21.15.105:52234) 2024-09-21T03:20:36.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.054+0000 7f1a05d9b640 1 -- 172.21.15.105:0/2103109084 learned_addr learned my addr 172.21.15.105:0/2103109084 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:36.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.054+0000 7f1a0659c640 1 --2- 172.21.15.105:0/2103109084 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a080b9b60 0x7f1a080cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:36.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.054+0000 7f1a06d9d640 1 --2- 172.21.15.105:0/2103109084 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1a081e8fb0 0x7f1a080b2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:36.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.054+0000 7f1a05d9b640 1 -- 172.21.15.105:0/2103109084 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1a081e8fb0 msgr2=0x7f1a080b2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:36.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.054+0000 7f1a05d9b640 1 --2- 172.21.15.105:0/2103109084 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1a081e8fb0 0x7f1a080b2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:36.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.054+0000 7f1a05d9b640 1 -- 172.21.15.105:0/2103109084 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a080b9b60 msgr2=0x7f1a080cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:36.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.054+0000 7f1a05d9b640 1 --2- 172.21.15.105:0/2103109084 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a080b9b60 0x7f1a080cb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:36.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.054+0000 7f1a05d9b640 1 -- 172.21.15.105:0/2103109084 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a080cbdb0 con 0x7f1a080cf540 2024-09-21T03:20:36.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.054+0000 7f1a05d9b640 1 --2- 172.21.15.105:0/2103109084 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a080cf540 0x7f1a0815be80 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f19fc00c430 tx=0x7f19fc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:36.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.054+0000 7f19f6ffd640 1 -- 172.21.15.105:0/2103109084 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19fc011790 con 0x7f1a080cf540 2024-09-21T03:20:36.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.054+0000 7f19f6ffd640 1 -- 172.21.15.105:0/2103109084 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f19fc017070 con 0x7f1a080cf540 2024-09-21T03:20:36.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.054+0000 7f19f6ffd640 1 -- 172.21.15.105:0/2103109084 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19fc011ce0 con 0x7f1a080cf540 2024-09-21T03:20:36.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.054+0000 7f1a0cc4a640 1 -- 172.21.15.105:0/2103109084 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a080cc090 con 0x7f1a080cf540 2024-09-21T03:20:36.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.054+0000 7f1a0cc4a640 1 -- 172.21.15.105:0/2103109084 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a080cc650 con 0x7f1a080cf540 2024-09-21T03:20:36.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.055+0000 7f1a0cc4a640 1 -- 172.21.15.105:0/2103109084 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a0806fc70 con 0x7f1a080cf540 2024-09-21T03:20:36.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.056+0000 7f19f6ffd640 1 -- 172.21.15.105:0/2103109084 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f19fc01c460 con 0x7f1a080cf540 2024-09-21T03:20:36.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.057+0000 7f19f6ffd640 1 --2- 172.21.15.105:0/2103109084 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f19e8078b90 0x7f19e807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:36.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.057+0000 7f19f6ffd640 1 -- 172.21.15.105:0/2103109084 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f19fc09a970 con 0x7f1a080cf540 2024-09-21T03:20:36.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.057+0000 7f1a0659c640 1 --2- 172.21.15.105:0/2103109084 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f19e8078b90 0x7f19e807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:36.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.057+0000 7f1a0659c640 1 --2- 172.21.15.105:0/2103109084 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f19e8078b90 0x7f19e807b0a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f19f8009c00 tx=0x7f19f8005f30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:36.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.061+0000 7f19f6ffd640 1 -- 172.21.15.105:0/2103109084 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f19fc0627f0 con 0x7f1a080cf540 2024-09-21T03:20:36.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.274+0000 7f1a0cc4a640 1 -- 172.21.15.105:0/2103109084 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1a080cbb40 con 0x7f1a080cf540 2024-09-21T03:20:36.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.274+0000 7f19f6ffd640 1 -- 172.21.15.105:0/2103109084 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5235 (secure 0 0 0) 0x7f19fc067220 con 0x7f1a080cf540 2024-09-21T03:20:36.276 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:20:36.276 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":25,"btime":"2024-09-21T03:20:25:364985+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4889,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/2075944521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2075944521},{"type":"v1","addr":"172.21.15.162:6837","nonce":2075944521}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5086,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/4008776831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":4008776831},{"type":"v1","addr":"172.21.15.105:6835","nonce":4008776831}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2322902258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2322902258},{"type":"v1","addr":"172.21.15.162:6836","nonce":2322902258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:20:21.706604+0000","modified":"2024-09-21T03:20:24.721756+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5301},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5301":{"gid":5301,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6833/2865219898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2865219898},{"type":"v1","addr":"172.21.15.105:6833","nonce":2865219898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5301,"qdb_cluster":[5301]},"id":3}]} 2024-09-21T03:20:36.277 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 25 2024-09-21T03:20:36.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.276+0000 7f1a0cc4a640 1 -- 172.21.15.105:0/2103109084 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f19e8078b90 msgr2=0x7f19e807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:36.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.276+0000 7f1a0cc4a640 1 --2- 172.21.15.105:0/2103109084 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f19e8078b90 0x7f19e807b0a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f19f8009c00 tx=0x7f19f8005f30 comp rx=0 tx=0).stop 2024-09-21T03:20:36.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.276+0000 7f1a0cc4a640 1 -- 172.21.15.105:0/2103109084 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a080cf540 msgr2=0x7f1a0815be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:36.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.276+0000 7f1a0cc4a640 1 --2- 172.21.15.105:0/2103109084 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a080cf540 0x7f1a0815be80 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f19fc00c430 tx=0x7f19fc00c8f0 comp rx=0 tx=0).stop 2024-09-21T03:20:36.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.276+0000 7f1a0cc4a640 1 -- 172.21.15.105:0/2103109084 shutdown_connections 2024-09-21T03:20:36.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.276+0000 7f1a0cc4a640 1 --2- 172.21.15.105:0/2103109084 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f19e8078b90 0x7f19e807b0a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:36.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.276+0000 7f1a0cc4a640 1 --2- 172.21.15.105:0/2103109084 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1a081e8fb0 0x7f1a080b2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:36.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.276+0000 7f1a0cc4a640 1 --2- 172.21.15.105:0/2103109084 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a080cf540 0x7f1a0815be80 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:36.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.276+0000 7f1a0cc4a640 1 --2- 172.21.15.105:0/2103109084 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a080b9b60 0x7f1a080cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:36.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.276+0000 7f1a0cc4a640 1 -- 172.21.15.105:0/2103109084 >> 172.21.15.105:0/2103109084 conn(0x7f1a0809d7f0 msgr2=0x7f1a080d2cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:36.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.276+0000 7f1a0cc4a640 1 -- 172.21.15.105:0/2103109084 shutdown_connections 2024-09-21T03:20:36.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.276+0000 7f1a0cc4a640 1 -- 172.21.15.105:0/2103109084 wait complete. 2024-09-21T03:20:36.290 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:20:36.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.401+0000 7fb941430640 1 -- 172.21.15.105:0/945555343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb93c0cff70 msgr2=0x7fb93c15c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:36.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.401+0000 7fb941430640 1 --2- 172.21.15.105:0/945555343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb93c0cff70 0x7fb93c15c830 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb934005fd0 tx=0x7fb93402a540 comp rx=0 tx=0).stop 2024-09-21T03:20:36.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.401+0000 7fb941430640 1 -- 172.21.15.105:0/945555343 shutdown_connections 2024-09-21T03:20:36.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.401+0000 7fb941430640 1 --2- 172.21.15.105:0/945555343 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb93c0b4530 0x7fb93c0d0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:36.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.401+0000 7fb941430640 1 --2- 172.21.15.105:0/945555343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb93c0cff70 0x7fb93c15c830 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:36.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.401+0000 7fb941430640 1 -- 172.21.15.105:0/945555343 >> 172.21.15.105:0/945555343 conn(0x7fb93c0cee20 msgr2=0x7fb93c0cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:36.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.401+0000 7fb941430640 1 -- 172.21.15.105:0/945555343 shutdown_connections 2024-09-21T03:20:36.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.401+0000 7fb941430640 1 -- 172.21.15.105:0/945555343 wait complete. 2024-09-21T03:20:36.404 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.403+0000 7fb941430640 1 Processor -- start 2024-09-21T03:20:36.404 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.403+0000 7fb941430640 1 -- start start 2024-09-21T03:20:36.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.404+0000 7fb941430640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb93c0cff70 0x7fb93c1441b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:36.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.404+0000 7fb941430640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb93c160c90 0x7fb93c142160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:36.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.404+0000 7fb941430640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb93c1f39e0 0x7fb93c152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:36.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.404+0000 7fb941430640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb93c0d17c0 con 0x7fb93c0cff70 2024-09-21T03:20:36.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.404+0000 7fb941430640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb93c0d1640 con 0x7fb93c1f39e0 2024-09-21T03:20:36.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.404+0000 7fb941430640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb93c0d1940 con 0x7fb93c160c90 2024-09-21T03:20:36.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.404+0000 7fb93affd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb93c0cff70 0x7fb93c1441b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:36.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.404+0000 7fb93affd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb93c0cff70 0x7fb93c1441b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:52256/0 (socket says 172.21.15.105:52256) 2024-09-21T03:20:36.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.404+0000 7fb93affd640 1 -- 172.21.15.105:0/3759268125 learned_addr learned my addr 172.21.15.105:0/3759268125 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:36.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.404+0000 7fb93b7fe640 1 --2- 172.21.15.105:0/3759268125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb93c1f39e0 0x7fb93c152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:36.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.404+0000 7fb93a7fc640 1 --2- 172.21.15.105:0/3759268125 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb93c160c90 0x7fb93c142160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:36.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.405+0000 7fb93affd640 1 -- 172.21.15.105:0/3759268125 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb93c160c90 msgr2=0x7fb93c142160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:36.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.405+0000 7fb93affd640 1 --2- 172.21.15.105:0/3759268125 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb93c160c90 0x7fb93c142160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:36.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.405+0000 7fb93affd640 1 -- 172.21.15.105:0/3759268125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb93c1f39e0 msgr2=0x7fb93c152330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:36.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.405+0000 7fb93affd640 1 --2- 172.21.15.105:0/3759268125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb93c1f39e0 0x7fb93c152330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:36.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.405+0000 7fb93affd640 1 -- 172.21.15.105:0/3759268125 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb93c1426a0 con 0x7fb93c0cff70 2024-09-21T03:20:36.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.405+0000 7fb93b7fe640 1 --2- 172.21.15.105:0/3759268125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb93c1f39e0 0x7fb93c152330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:20:36.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.405+0000 7fb93a7fc640 1 --2- 172.21.15.105:0/3759268125 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb93c160c90 0x7fb93c142160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:20:36.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.405+0000 7fb93affd640 1 --2- 172.21.15.105:0/3759268125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb93c0cff70 0x7fb93c1441b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb934034040 tx=0x7fb9340038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:36.409 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.405+0000 7fb9337fe640 1 -- 172.21.15.105:0/3759268125 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93403e030 con 0x7fb93c0cff70 2024-09-21T03:20:36.409 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.405+0000 7fb9337fe640 1 -- 172.21.15.105:0/3759268125 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb934003d90 con 0x7fb93c0cff70 2024-09-21T03:20:36.409 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.405+0000 7fb941430640 1 -- 172.21.15.105:0/3759268125 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb93c144a20 con 0x7fb93c0cff70 2024-09-21T03:20:36.409 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.405+0000 7fb9337fe640 1 -- 172.21.15.105:0/3759268125 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb934035040 con 0x7fb93c0cff70 2024-09-21T03:20:36.409 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.405+0000 7fb941430640 1 -- 172.21.15.105:0/3759268125 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb93c144fe0 con 0x7fb93c0cff70 2024-09-21T03:20:36.410 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.406+0000 7fb941430640 1 -- 172.21.15.105:0/3759268125 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb93c0d1e60 con 0x7fb93c0cff70 2024-09-21T03:20:36.410 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.407+0000 7fb9337fe640 1 -- 172.21.15.105:0/3759268125 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb934041030 con 0x7fb93c0cff70 2024-09-21T03:20:36.410 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.407+0000 7fb9337fe640 1 --2- 172.21.15.105:0/3759268125 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb91c078bc0 0x7fb91c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:36.410 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.407+0000 7fb9337fe640 1 -- 172.21.15.105:0/3759268125 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fb9340bb6d0 con 0x7fb93c0cff70 2024-09-21T03:20:36.410 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.407+0000 7fb93a7fc640 1 --2- 172.21.15.105:0/3759268125 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb91c078bc0 0x7fb91c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:36.410 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.408+0000 7fb93a7fc640 1 --2- 172.21.15.105:0/3759268125 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb91c078bc0 0x7fb91c07b0d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb93c160710 tx=0x7fb924009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:36.413 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.412+0000 7fb9337fe640 1 -- 172.21.15.105:0/3759268125 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb934083ba0 con 0x7fb93c0cff70 2024-09-21T03:20:36.626 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.624+0000 7fb941430640 1 -- 172.21.15.105:0/3759268125 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb93c15b6a0 con 0x7fb93c0cff70 2024-09-21T03:20:36.626 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.625+0000 7fb9337fe640 1 -- 172.21.15.105:0/3759268125 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5235 (secure 0 0 0) 0x7fb9340834a0 con 0x7fb93c0cff70 2024-09-21T03:20:36.627 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:20:36.627 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":25,"btime":"2024-09-21T03:20:25:364985+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4889,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/2075944521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2075944521},{"type":"v1","addr":"172.21.15.162:6837","nonce":2075944521}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5086,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/4008776831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":4008776831},{"type":"v1","addr":"172.21.15.105:6835","nonce":4008776831}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2322902258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2322902258},{"type":"v1","addr":"172.21.15.162:6836","nonce":2322902258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:20:21.706604+0000","modified":"2024-09-21T03:20:24.721756+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5301},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5301":{"gid":5301,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6833/2865219898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2865219898},{"type":"v1","addr":"172.21.15.105:6833","nonce":2865219898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5301,"qdb_cluster":[5301]},"id":3}]} 2024-09-21T03:20:36.627 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 25 2024-09-21T03:20:36.629 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.627+0000 7fb941430640 1 -- 172.21.15.105:0/3759268125 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb91c078bc0 msgr2=0x7fb91c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:36.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.627+0000 7fb941430640 1 --2- 172.21.15.105:0/3759268125 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb91c078bc0 0x7fb91c07b0d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb93c160710 tx=0x7fb924009040 comp rx=0 tx=0).stop 2024-09-21T03:20:36.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.627+0000 7fb941430640 1 -- 172.21.15.105:0/3759268125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb93c0cff70 msgr2=0x7fb93c1441b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:36.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.627+0000 7fb941430640 1 --2- 172.21.15.105:0/3759268125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb93c0cff70 0x7fb93c1441b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb934034040 tx=0x7fb9340038a0 comp rx=0 tx=0).stop 2024-09-21T03:20:36.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.627+0000 7fb941430640 1 -- 172.21.15.105:0/3759268125 shutdown_connections 2024-09-21T03:20:36.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.627+0000 7fb941430640 1 --2- 172.21.15.105:0/3759268125 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb91c078bc0 0x7fb91c07b0d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:36.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.627+0000 7fb941430640 1 --2- 172.21.15.105:0/3759268125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb93c1f39e0 0x7fb93c152330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:36.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.627+0000 7fb941430640 1 --2- 172.21.15.105:0/3759268125 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb93c160c90 0x7fb93c142160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:36.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.627+0000 7fb941430640 1 --2- 172.21.15.105:0/3759268125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb93c0cff70 0x7fb93c1441b0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:36.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.627+0000 7fb941430640 1 -- 172.21.15.105:0/3759268125 >> 172.21.15.105:0/3759268125 conn(0x7fb93c0cee20 msgr2=0x7fb93c15b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:36.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.627+0000 7fb941430640 1 -- 172.21.15.105:0/3759268125 shutdown_connections 2024-09-21T03:20:36.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.627+0000 7fb941430640 1 -- 172.21.15.105:0/3759268125 wait complete. 2024-09-21T03:20:36.640 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:20:36.753 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.751+0000 7f293ea5c640 1 -- 172.21.15.105:0/3353450445 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29380af780 msgr2=0x7f29380b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:36.753 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.751+0000 7f293ea5c640 1 --2- 172.21.15.105:0/3353450445 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29380af780 0x7f29380b39c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f29380ce0e0 tx=0x7f292802a5f0 comp rx=0 tx=0).stop 2024-09-21T03:20:36.753 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.751+0000 7f293ea5c640 1 -- 172.21.15.105:0/3353450445 shutdown_connections 2024-09-21T03:20:36.753 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.751+0000 7f293ea5c640 1 --2- 172.21.15.105:0/3353450445 >> v2:172.21.15.162:3300/0 conn(0x7f2938072ff0 0x7f2938073400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:36.753 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.751+0000 7f293ea5c640 1 --2- 172.21.15.105:0/3353450445 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29380af780 0x7f29380b39c0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:36.753 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.751+0000 7f293ea5c640 1 -- 172.21.15.105:0/3353450445 >> 172.21.15.105:0/3353450445 conn(0x7f293806d7d0 msgr2=0x7f29380b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:36.753 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.751+0000 7f293ea5c640 1 -- 172.21.15.105:0/3353450445 shutdown_connections 2024-09-21T03:20:36.753 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.751+0000 7f293ea5c640 1 -- 172.21.15.105:0/3353450445 wait complete. 2024-09-21T03:20:36.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.752+0000 7f293ea5c640 1 Processor -- start 2024-09-21T03:20:36.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.753+0000 7f293ea5c640 1 -- start start 2024-09-21T03:20:36.757 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.754+0000 7f293ea5c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2938072ff0 0x7f29381e7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:36.757 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.754+0000 7f293ea5c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29380af780 0x7f29381f7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:36.757 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.754+0000 7f293ea5c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29380cd3e0 0x7f29381f7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:36.757 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.754+0000 7f293ea5c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2938073cd0 con 0x7f29380af780 2024-09-21T03:20:36.757 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.754+0000 7f293ea5c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2938073b50 con 0x7f2938072ff0 2024-09-21T03:20:36.757 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.754+0000 7f293ea5c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f29380cd9e0 con 0x7f29380cd3e0 2024-09-21T03:20:36.757 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.754+0000 7f29377fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29380af780 0x7f29381f7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:36.757 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.754+0000 7f29377fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29380af780 0x7f29381f7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:52272/0 (socket says 172.21.15.105:52272) 2024-09-21T03:20:36.757 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.754+0000 7f29377fe640 1 -- 172.21.15.105:0/914120709 learned_addr learned my addr 172.21.15.105:0/914120709 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:36.757 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.754+0000 7f2937fff640 1 --2- 172.21.15.105:0/914120709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2938072ff0 0x7f29381e7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:36.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.754+0000 7f293cff9640 1 --2- 172.21.15.105:0/914120709 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29380cd3e0 0x7f29381f7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:36.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.754+0000 7f29377fe640 1 -- 172.21.15.105:0/914120709 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29380cd3e0 msgr2=0x7f29381f7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:36.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.754+0000 7f29377fe640 1 --2- 172.21.15.105:0/914120709 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29380cd3e0 0x7f29381f7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:36.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.754+0000 7f29377fe640 1 -- 172.21.15.105:0/914120709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2938072ff0 msgr2=0x7f29381e7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:36.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.754+0000 7f29377fe640 1 --2- 172.21.15.105:0/914120709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2938072ff0 0x7f29381e7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:36.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.754+0000 7f29377fe640 1 -- 172.21.15.105:0/914120709 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29381f4970 con 0x7f29380af780 2024-09-21T03:20:36.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.754+0000 7f29377fe640 1 --2- 172.21.15.105:0/914120709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29380af780 0x7f29381f7230 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f292c00c3a0 tx=0x7f292c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:36.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.755+0000 7f2934ff9640 1 -- 172.21.15.105:0/914120709 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f292c017070 con 0x7f29380af780 2024-09-21T03:20:36.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.755+0000 7f2934ff9640 1 -- 172.21.15.105:0/914120709 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f292c0053c0 con 0x7f29380af780 2024-09-21T03:20:36.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.755+0000 7f293ea5c640 1 -- 172.21.15.105:0/914120709 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29381f3bb0 con 0x7f29380af780 2024-09-21T03:20:36.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.755+0000 7f2934ff9640 1 -- 172.21.15.105:0/914120709 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f292c003850 con 0x7f29380af780 2024-09-21T03:20:36.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.755+0000 7f293ea5c640 1 -- 172.21.15.105:0/914120709 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29381f4170 con 0x7f29380af780 2024-09-21T03:20:36.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.756+0000 7f293ea5c640 1 -- 172.21.15.105:0/914120709 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2938073400 con 0x7f29380af780 2024-09-21T03:20:36.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.757+0000 7f2934ff9640 1 -- 172.21.15.105:0/914120709 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f292c01a070 con 0x7f29380af780 2024-09-21T03:20:36.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.757+0000 7f2934ff9640 1 --2- 172.21.15.105:0/914120709 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2924078bc0 0x7f292407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:36.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.757+0000 7f2934ff9640 1 -- 172.21.15.105:0/914120709 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f292c099fe0 con 0x7f29380af780 2024-09-21T03:20:36.760 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.757+0000 7f2937fff640 1 --2- 172.21.15.105:0/914120709 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2924078bc0 0x7f292407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:36.760 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.758+0000 7f2937fff640 1 --2- 172.21.15.105:0/914120709 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2924078bc0 0x7f292407b0d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2928033000 tx=0x7f2928004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:36.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.762+0000 7f2934ff9640 1 -- 172.21.15.105:0/914120709 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f292c061dd0 con 0x7f29380af780 2024-09-21T03:20:36.943 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.941+0000 7f293ea5c640 1 -- 172.21.15.105:0/914120709 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f293815ecd0 con 0x7f29380af780 2024-09-21T03:20:36.944 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.942+0000 7f2934ff9640 1 -- 172.21.15.105:0/914120709 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+16745 (secure 0 0 0) 0x7f292c066800 con 0x7f29380af780 2024-09-21T03:20:36.945 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:20:36.945 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":45,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:20:23.351123+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:20:19.345425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-21T03:20:20.668938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:20:36.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.945+0000 7f293ea5c640 1 -- 172.21.15.105:0/914120709 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2924078bc0 msgr2=0x7f292407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:36.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.945+0000 7f293ea5c640 1 --2- 172.21.15.105:0/914120709 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2924078bc0 0x7f292407b0d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2928033000 tx=0x7f2928004730 comp rx=0 tx=0).stop 2024-09-21T03:20:36.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.945+0000 7f293ea5c640 1 -- 172.21.15.105:0/914120709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29380af780 msgr2=0x7f29381f7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:36.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.945+0000 7f293ea5c640 1 --2- 172.21.15.105:0/914120709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29380af780 0x7f29381f7230 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f292c00c3a0 tx=0x7f292c00c860 comp rx=0 tx=0).stop 2024-09-21T03:20:36.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.945+0000 7f293ea5c640 1 -- 172.21.15.105:0/914120709 shutdown_connections 2024-09-21T03:20:36.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.945+0000 7f293ea5c640 1 --2- 172.21.15.105:0/914120709 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2924078bc0 0x7f292407b0d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:36.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.945+0000 7f293ea5c640 1 --2- 172.21.15.105:0/914120709 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29380cd3e0 0x7f29381f7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:36.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.945+0000 7f293ea5c640 1 --2- 172.21.15.105:0/914120709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29380af780 0x7f29381f7230 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:36.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.945+0000 7f293ea5c640 1 --2- 172.21.15.105:0/914120709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2938072ff0 0x7f29381e7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:36.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.945+0000 7f293ea5c640 1 -- 172.21.15.105:0/914120709 >> 172.21.15.105:0/914120709 conn(0x7f293806d7d0 msgr2=0x7f29380ad6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:36.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.945+0000 7f293ea5c640 1 -- 172.21.15.105:0/914120709 shutdown_connections 2024-09-21T03:20:36.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:36.945+0000 7f293ea5c640 1 -- 172.21.15.105:0/914120709 wait complete. 2024-09-21T03:20:36.958 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T03:20:36.958 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:20:37.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.069+0000 7f9040e8b640 1 -- 172.21.15.105:0/2127555783 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9024003a50 msgr2=0x7f9024003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:37.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.069+0000 7f9040e8b640 1 --2- 172.21.15.105:0/2127555783 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9024003a50 0x7f9024003ec0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f902c009b50 tx=0x7f9024005830 comp rx=0 tx=0).stop 2024-09-21T03:20:37.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.069+0000 7f9040e8b640 1 -- 172.21.15.105:0/2127555783 shutdown_connections 2024-09-21T03:20:37.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.069+0000 7f9040e8b640 1 --2- 172.21.15.105:0/2127555783 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9024003a50 0x7f9024003ec0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:37.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.069+0000 7f9040e8b640 1 -- 172.21.15.105:0/2127555783 >> 172.21.15.105:0/2127555783 conn(0x7f903c06d7d0 msgr2=0x7f903c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:37.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.069+0000 7f9040e8b640 1 -- 172.21.15.105:0/2127555783 shutdown_connections 2024-09-21T03:20:37.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.069+0000 7f9040e8b640 1 -- 172.21.15.105:0/2127555783 wait complete. 2024-09-21T03:20:37.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.071+0000 7f9040e8b640 1 Processor -- start 2024-09-21T03:20:37.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.071+0000 7f9040e8b640 1 -- start start 2024-09-21T03:20:37.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.072+0000 7f9040e8b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9024003a50 0x7f903c09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:37.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.072+0000 7f9040e8b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f903c149af0 0x7f903c1f7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:37.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.072+0000 7f9040e8b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f903c149f00 0x7f903c1f76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:37.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.072+0000 7f9040e8b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f903c0af750 con 0x7f903c149af0 2024-09-21T03:20:37.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.072+0000 7f9040e8b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f903c0af5d0 con 0x7f9024003a50 2024-09-21T03:20:37.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.072+0000 7f9040e8b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f903c0af8d0 con 0x7f903c149f00 2024-09-21T03:20:37.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.072+0000 7f9039d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f903c149af0 0x7f903c1f7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:37.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.072+0000 7f9039d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f903c149af0 0x7f903c1f7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:52282/0 (socket says 172.21.15.105:52282) 2024-09-21T03:20:37.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.072+0000 7f9039d9b640 1 -- 172.21.15.105:0/2937734584 learned_addr learned my addr 172.21.15.105:0/2937734584 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:37.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.072+0000 7f903a59c640 1 --2- 172.21.15.105:0/2937734584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9024003a50 0x7f903c09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:37.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.072+0000 7f903ad9d640 1 --2- 172.21.15.105:0/2937734584 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f903c149f00 0x7f903c1f76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:37.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.072+0000 7f9039d9b640 1 -- 172.21.15.105:0/2937734584 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f903c149f00 msgr2=0x7f903c1f76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:37.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.072+0000 7f9039d9b640 1 --2- 172.21.15.105:0/2937734584 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f903c149f00 0x7f903c1f76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:37.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.072+0000 7f9039d9b640 1 -- 172.21.15.105:0/2937734584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9024003a50 msgr2=0x7f903c09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:37.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.072+0000 7f9039d9b640 1 --2- 172.21.15.105:0/2937734584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9024003a50 0x7f903c09aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:37.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.072+0000 7f9039d9b640 1 -- 172.21.15.105:0/2937734584 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f903c09af70 con 0x7f903c149af0 2024-09-21T03:20:37.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.072+0000 7f9039d9b640 1 --2- 172.21.15.105:0/2937734584 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f903c149af0 0x7f903c1f7170 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f9030003fb0 tx=0x7f90300016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:37.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.073+0000 7f902affd640 1 -- 172.21.15.105:0/2937734584 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9030015070 con 0x7f903c149af0 2024-09-21T03:20:37.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.073+0000 7f902affd640 1 -- 172.21.15.105:0/2937734584 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9030011900 con 0x7f903c149af0 2024-09-21T03:20:37.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.073+0000 7f902affd640 1 -- 172.21.15.105:0/2937734584 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9030011d50 con 0x7f903c149af0 2024-09-21T03:20:37.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.073+0000 7f9040e8b640 1 -- 172.21.15.105:0/2937734584 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f903c09b3f0 con 0x7f903c149af0 2024-09-21T03:20:37.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.073+0000 7f9040e8b640 1 -- 172.21.15.105:0/2937734584 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f903c09b9b0 con 0x7f903c149af0 2024-09-21T03:20:37.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.074+0000 7f9040e8b640 1 -- 172.21.15.105:0/2937734584 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f903c09b140 con 0x7f903c149af0 2024-09-21T03:20:37.078 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.075+0000 7f902affd640 1 -- 172.21.15.105:0/2937734584 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9030018070 con 0x7f903c149af0 2024-09-21T03:20:37.078 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.075+0000 7f902affd640 1 --2- 172.21.15.105:0/2937734584 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f901c078bc0 0x7f901c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:37.078 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.075+0000 7f902affd640 1 -- 172.21.15.105:0/2937734584 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f903009b890 con 0x7f903c149af0 2024-09-21T03:20:37.078 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.076+0000 7f903a59c640 1 --2- 172.21.15.105:0/2937734584 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f901c078bc0 0x7f901c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:37.078 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.076+0000 7f903a59c640 1 --2- 172.21.15.105:0/2937734584 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f901c078bc0 0x7f901c07b0d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f902c035000 tx=0x7f902c0046c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:37.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.080+0000 7f902affd640 1 -- 172.21.15.105:0/2937734584 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9030063710 con 0x7f903c149af0 2024-09-21T03:20:37.292 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.291+0000 7f9040e8b640 1 -- 172.21.15.105:0/2937734584 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f903c0b4290 con 0x7f903c149af0 2024-09-21T03:20:37.293 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.291+0000 7f902affd640 1 -- 172.21.15.105:0/2937734584 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5235 (secure 0 0 0) 0x7f9030068140 con 0x7f903c149af0 2024-09-21T03:20:37.293 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:20:37.293 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":25,"btime":"2024-09-21T03:20:25:364985+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4889,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/2075944521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2075944521},{"type":"v1","addr":"172.21.15.162:6837","nonce":2075944521}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5086,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/4008776831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":4008776831},{"type":"v1","addr":"172.21.15.105:6835","nonce":4008776831}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2322902258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2322902258},{"type":"v1","addr":"172.21.15.162:6836","nonce":2322902258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:20:21.706604+0000","modified":"2024-09-21T03:20:24.721756+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5301},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5301":{"gid":5301,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6833/2865219898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2865219898},{"type":"v1","addr":"172.21.15.105:6833","nonce":2865219898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5301,"qdb_cluster":[5301]},"id":3}]} 2024-09-21T03:20:37.294 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 25 2024-09-21T03:20:37.295 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.293+0000 7f9040e8b640 1 -- 172.21.15.105:0/2937734584 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f901c078bc0 msgr2=0x7f901c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:37.295 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.293+0000 7f9040e8b640 1 --2- 172.21.15.105:0/2937734584 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f901c078bc0 0x7f901c07b0d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f902c035000 tx=0x7f902c0046c0 comp rx=0 tx=0).stop 2024-09-21T03:20:37.295 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.293+0000 7f9040e8b640 1 -- 172.21.15.105:0/2937734584 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f903c149af0 msgr2=0x7f903c1f7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:37.296 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.293+0000 7f9040e8b640 1 --2- 172.21.15.105:0/2937734584 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f903c149af0 0x7f903c1f7170 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f9030003fb0 tx=0x7f90300016f0 comp rx=0 tx=0).stop 2024-09-21T03:20:37.296 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.294+0000 7f9040e8b640 1 -- 172.21.15.105:0/2937734584 shutdown_connections 2024-09-21T03:20:37.296 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.294+0000 7f9040e8b640 1 --2- 172.21.15.105:0/2937734584 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f901c078bc0 0x7f901c07b0d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:37.296 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.294+0000 7f9040e8b640 1 --2- 172.21.15.105:0/2937734584 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f903c149f00 0x7f903c1f76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:37.296 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.294+0000 7f9040e8b640 1 --2- 172.21.15.105:0/2937734584 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f903c149af0 0x7f903c1f7170 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:37.296 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.294+0000 7f9040e8b640 1 --2- 172.21.15.105:0/2937734584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9024003a50 0x7f903c09aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:37.296 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.294+0000 7f9040e8b640 1 -- 172.21.15.105:0/2937734584 >> 172.21.15.105:0/2937734584 conn(0x7f903c06d7d0 msgr2=0x7f903c15f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:37.296 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.294+0000 7f9040e8b640 1 -- 172.21.15.105:0/2937734584 shutdown_connections 2024-09-21T03:20:37.296 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.294+0000 7f9040e8b640 1 -- 172.21.15.105:0/2937734584 wait complete. 2024-09-21T03:20:37.306 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:20:37.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.423+0000 7fb4d8b90640 1 -- 172.21.15.105:0/3495965916 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4d40b3710 msgr2=0x7fb4d406e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:37.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.423+0000 7fb4d8b90640 1 --2- 172.21.15.105:0/3495965916 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4d40b3710 0x7fb4d406e7f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc005fd0 tx=0x7fb4cc02a8b0 comp rx=0 tx=0).stop 2024-09-21T03:20:37.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.423+0000 7fb4d8b90640 1 -- 172.21.15.105:0/3495965916 shutdown_connections 2024-09-21T03:20:37.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.423+0000 7fb4d8b90640 1 --2- 172.21.15.105:0/3495965916 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4d40b3710 0x7fb4d406e7f0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:37.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.423+0000 7fb4d8b90640 1 -- 172.21.15.105:0/3495965916 >> 172.21.15.105:0/3495965916 conn(0x7fb4d409d7f0 msgr2=0x7fb4d40d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:37.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.423+0000 7fb4d8b90640 1 -- 172.21.15.105:0/3495965916 shutdown_connections 2024-09-21T03:20:37.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.423+0000 7fb4d8b90640 1 -- 172.21.15.105:0/3495965916 wait complete. 2024-09-21T03:20:37.426 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.425+0000 7fb4d8b90640 1 Processor -- start 2024-09-21T03:20:37.426 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.425+0000 7fb4d8b90640 1 -- start start 2024-09-21T03:20:37.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.426+0000 7fb4d8b90640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4d40b3710 0x7fb4d40cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:37.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.426+0000 7fb4d8b90640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4d40b9970 0x7fb4d4153890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:37.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.426+0000 7fb4d8b90640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4d40cd360 0x7fb4d40cd770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:37.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.426+0000 7fb4d8b90640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d406ed30 con 0x7fb4d40cd360 2024-09-21T03:20:37.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.426+0000 7fb4d8b90640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d40d5010 con 0x7fb4d40b9970 2024-09-21T03:20:37.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.426+0000 7fb4d8b90640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb4d406eeb0 con 0x7fb4d40b3710 2024-09-21T03:20:37.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.426+0000 7fb4d2d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4d40cd360 0x7fb4d40cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:37.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.426+0000 7fb4d2d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4d40cd360 0x7fb4d40cd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:52304/0 (socket says 172.21.15.105:52304) 2024-09-21T03:20:37.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.426+0000 7fb4d2d9d640 1 -- 172.21.15.105:0/3787216174 learned_addr learned my addr 172.21.15.105:0/3787216174 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:37.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.426+0000 7fb4d1d9b640 1 --2- 172.21.15.105:0/3787216174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4d40b9970 0x7fb4d4153890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:37.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.426+0000 7fb4d259c640 1 --2- 172.21.15.105:0/3787216174 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4d40b3710 0x7fb4d40cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:37.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.426+0000 7fb4d2d9d640 1 -- 172.21.15.105:0/3787216174 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4d40b3710 msgr2=0x7fb4d40cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:37.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.426+0000 7fb4d2d9d640 1 --2- 172.21.15.105:0/3787216174 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4d40b3710 0x7fb4d40cb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:37.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.426+0000 7fb4d2d9d640 1 -- 172.21.15.105:0/3787216174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4d40b9970 msgr2=0x7fb4d4153890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:37.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.426+0000 7fb4d2d9d640 1 --2- 172.21.15.105:0/3787216174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4d40b9970 0x7fb4d4153890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:37.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.426+0000 7fb4d2d9d640 1 -- 172.21.15.105:0/3787216174 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4d40cdcb0 con 0x7fb4d40cd360 2024-09-21T03:20:37.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.427+0000 7fb4d2d9d640 1 --2- 172.21.15.105:0/3787216174 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4d40cd360 0x7fb4d40cd770 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc006010 tx=0x7fb4cc003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:37.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.427+0000 7fb4c2ffd640 1 -- 172.21.15.105:0/3787216174 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4cc031b90 con 0x7fb4d40cd360 2024-09-21T03:20:37.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.427+0000 7fb4c2ffd640 1 -- 172.21.15.105:0/3787216174 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb4cc031e20 con 0x7fb4d40cd360 2024-09-21T03:20:37.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.427+0000 7fb4c2ffd640 1 -- 172.21.15.105:0/3787216174 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4cc0332f0 con 0x7fb4d40cd360 2024-09-21T03:20:37.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.427+0000 7fb4d8b90640 1 -- 172.21.15.105:0/3787216174 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4d40cbb30 con 0x7fb4d40cd360 2024-09-21T03:20:37.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.427+0000 7fb4d8b90640 1 -- 172.21.15.105:0/3787216174 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4d40cc320 con 0x7fb4d40cd360 2024-09-21T03:20:37.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.428+0000 7fb4d8b90640 1 -- 172.21.15.105:0/3787216174 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4d40cbdb0 con 0x7fb4d40cd360 2024-09-21T03:20:37.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.429+0000 7fb4c2ffd640 1 -- 172.21.15.105:0/3787216174 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb4cc031660 con 0x7fb4d40cd360 2024-09-21T03:20:37.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.429+0000 7fb4c2ffd640 1 --2- 172.21.15.105:0/3787216174 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb4b4078bc0 0x7fb4b407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:37.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.429+0000 7fb4c2ffd640 1 -- 172.21.15.105:0/3787216174 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fb4cc0bc170 con 0x7fb4d40cd360 2024-09-21T03:20:37.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.429+0000 7fb4d259c640 1 --2- 172.21.15.105:0/3787216174 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb4b4078bc0 0x7fb4b407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:37.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.430+0000 7fb4d259c640 1 --2- 172.21.15.105:0/3787216174 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb4b4078bc0 0x7fb4b407b0d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb4c40016f0 tx=0x7fb4c4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:37.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.434+0000 7fb4c2ffd640 1 -- 172.21.15.105:0/3787216174 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb4d40cdcb0 con 0x7fb4d40cd360 2024-09-21T03:20:37.646 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.645+0000 7fb4d8b90640 1 -- 172.21.15.105:0/3787216174 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb4d406f380 con 0x7fb4d40cd360 2024-09-21T03:20:37.647 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.645+0000 7fb4c2ffd640 1 -- 172.21.15.105:0/3787216174 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5235 (secure 0 0 0) 0x7fb4cc03f030 con 0x7fb4d40cd360 2024-09-21T03:20:37.647 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:20:37.647 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":25,"btime":"2024-09-21T03:20:25:364985+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4889,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/2075944521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2075944521},{"type":"v1","addr":"172.21.15.162:6837","nonce":2075944521}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5086,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/4008776831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":4008776831},{"type":"v1","addr":"172.21.15.105:6835","nonce":4008776831}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2322902258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2322902258},{"type":"v1","addr":"172.21.15.162:6836","nonce":2322902258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:20:21.706604+0000","modified":"2024-09-21T03:20:24.721756+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5301},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5301":{"gid":5301,"name":"c","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6833/2865219898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2865219898},{"type":"v1","addr":"172.21.15.105:6833","nonce":2865219898}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5301,"qdb_cluster":[5301]},"id":3}]} 2024-09-21T03:20:37.647 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 25 2024-09-21T03:20:37.649 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.647+0000 7fb4d8b90640 1 -- 172.21.15.105:0/3787216174 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb4b4078bc0 msgr2=0x7fb4b407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:37.649 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.647+0000 7fb4d8b90640 1 --2- 172.21.15.105:0/3787216174 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb4b4078bc0 0x7fb4b407b0d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb4c40016f0 tx=0x7fb4c4009040 comp rx=0 tx=0).stop 2024-09-21T03:20:37.649 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.647+0000 7fb4d8b90640 1 -- 172.21.15.105:0/3787216174 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4d40cd360 msgr2=0x7fb4d40cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:37.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.647+0000 7fb4d8b90640 1 --2- 172.21.15.105:0/3787216174 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4d40cd360 0x7fb4d40cd770 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc006010 tx=0x7fb4cc003ba0 comp rx=0 tx=0).stop 2024-09-21T03:20:37.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.647+0000 7fb4d8b90640 1 -- 172.21.15.105:0/3787216174 shutdown_connections 2024-09-21T03:20:37.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.647+0000 7fb4d8b90640 1 --2- 172.21.15.105:0/3787216174 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb4b4078bc0 0x7fb4b407b0d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:37.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.647+0000 7fb4d8b90640 1 --2- 172.21.15.105:0/3787216174 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4d40cd360 0x7fb4d40cd770 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:37.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.647+0000 7fb4d8b90640 1 --2- 172.21.15.105:0/3787216174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4d40b9970 0x7fb4d4153890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:37.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.647+0000 7fb4d8b90640 1 --2- 172.21.15.105:0/3787216174 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4d40b3710 0x7fb4d40cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:37.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.647+0000 7fb4d8b90640 1 -- 172.21.15.105:0/3787216174 >> 172.21.15.105:0/3787216174 conn(0x7fb4d409d7f0 msgr2=0x7fb4d40b7400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:37.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.647+0000 7fb4d8b90640 1 -- 172.21.15.105:0/3787216174 shutdown_connections 2024-09-21T03:20:37.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.647+0000 7fb4d8b90640 1 -- 172.21.15.105:0/3787216174 wait complete. 2024-09-21T03:20:37.660 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:20:37.772 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.770+0000 7fd23bd13640 1 -- 172.21.15.105:0/2592824392 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2340b9970 msgr2=0x7fd2340b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:37.772 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.770+0000 7fd23bd13640 1 --2- 172.21.15.105:0/2592824392 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2340b9970 0x7fd2340b3710 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd2340ceb00 tx=0x7fd22402a570 comp rx=0 tx=0).stop 2024-09-21T03:20:37.772 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.770+0000 7fd23bd13640 1 -- 172.21.15.105:0/2592824392 shutdown_connections 2024-09-21T03:20:37.772 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.770+0000 7fd23bd13640 1 --2- 172.21.15.105:0/2592824392 >> v2:172.21.15.162:3300/0 conn(0x7fd2340ced80 0x7fd2340cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:37.772 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.770+0000 7fd23bd13640 1 --2- 172.21.15.105:0/2592824392 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2340b5fa0 0x7fd2340b63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:37.772 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.770+0000 7fd23bd13640 1 --2- 172.21.15.105:0/2592824392 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2340b9970 0x7fd2340b3710 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:37.772 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.770+0000 7fd23bd13640 1 -- 172.21.15.105:0/2592824392 >> 172.21.15.105:0/2592824392 conn(0x7fd23409d7f0 msgr2=0x7fd2340d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:37.772 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.770+0000 7fd23bd13640 1 -- 172.21.15.105:0/2592824392 shutdown_connections 2024-09-21T03:20:37.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.770+0000 7fd23bd13640 1 -- 172.21.15.105:0/2592824392 wait complete. 2024-09-21T03:20:37.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.772+0000 7fd23bd13640 1 Processor -- start 2024-09-21T03:20:37.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.772+0000 7fd23bd13640 1 -- start start 2024-09-21T03:20:37.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.773+0000 7fd23bd13640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2340b5fa0 0x7fd23415f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:37.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.773+0000 7fd23bd13640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2340b9970 0x7fd2341f2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:37.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.773+0000 7fd23bd13640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2340ced80 0x7fd2341f8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:37.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.773+0000 7fd23bd13640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd2340cf850 con 0x7fd2340b5fa0 2024-09-21T03:20:37.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.773+0000 7fd23bd13640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd2340cf6d0 con 0x7fd2340b9970 2024-09-21T03:20:37.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.773+0000 7fd23bd13640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd2340cf9d0 con 0x7fd2340ced80 2024-09-21T03:20:37.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.773+0000 7fd239aaf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2340b5fa0 0x7fd23415f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:37.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.773+0000 7fd239aaf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2340b5fa0 0x7fd23415f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:52334/0 (socket says 172.21.15.105:52334) 2024-09-21T03:20:37.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.773+0000 7fd239aaf640 1 -- 172.21.15.105:0/3963149230 learned_addr learned my addr 172.21.15.105:0/3963149230 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:37.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.774+0000 7fd239aaf640 1 -- 172.21.15.105:0/3963149230 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2340ced80 msgr2=0x7fd2341f8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:37.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.774+0000 7fd23a2b0640 1 --2- 172.21.15.105:0/3963149230 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2340ced80 0x7fd2341f8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:37.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.774+0000 7fd2392ae640 1 --2- 172.21.15.105:0/3963149230 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2340b9970 0x7fd2341f2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:37.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.774+0000 7fd239aaf640 1 --2- 172.21.15.105:0/3963149230 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2340ced80 0x7fd2341f8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:37.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.774+0000 7fd239aaf640 1 -- 172.21.15.105:0/3963149230 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2340b9970 msgr2=0x7fd2341f2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:37.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.774+0000 7fd239aaf640 1 --2- 172.21.15.105:0/3963149230 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2340b9970 0x7fd2341f2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:37.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.774+0000 7fd239aaf640 1 -- 172.21.15.105:0/3963149230 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd234151540 con 0x7fd2340b5fa0 2024-09-21T03:20:37.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.774+0000 7fd23a2b0640 1 --2- 172.21.15.105:0/3963149230 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2340ced80 0x7fd2341f8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:20:37.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.774+0000 7fd2392ae640 1 --2- 172.21.15.105:0/3963149230 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2340b9970 0x7fd2341f2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:20:37.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.774+0000 7fd239aaf640 1 --2- 172.21.15.105:0/3963149230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2340b5fa0 0x7fd23415f280 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd22402ab60 tx=0x7fd2240049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:37.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.774+0000 7fd2327fc640 1 -- 172.21.15.105:0/3963149230 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd224033e60 con 0x7fd2340b5fa0 2024-09-21T03:20:37.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.774+0000 7fd2327fc640 1 -- 172.21.15.105:0/3963149230 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd2240330d0 con 0x7fd2340b5fa0 2024-09-21T03:20:37.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.774+0000 7fd2327fc640 1 -- 172.21.15.105:0/3963149230 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd224033520 con 0x7fd2340b5fa0 2024-09-21T03:20:37.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.774+0000 7fd23bd13640 1 -- 172.21.15.105:0/3963149230 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2340c92b0 con 0x7fd2340b5fa0 2024-09-21T03:20:37.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.774+0000 7fd23bd13640 1 -- 172.21.15.105:0/3963149230 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2340c9870 con 0x7fd2340b5fa0 2024-09-21T03:20:37.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.775+0000 7fd23bd13640 1 -- 172.21.15.105:0/3963149230 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2340cfe80 con 0x7fd2340b5fa0 2024-09-21T03:20:37.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.776+0000 7fd2327fc640 1 -- 172.21.15.105:0/3963149230 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd22403b410 con 0x7fd2340b5fa0 2024-09-21T03:20:37.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.777+0000 7fd2327fc640 1 --2- 172.21.15.105:0/3963149230 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd220078b90 0x7fd22007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:37.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.777+0000 7fd2327fc640 1 -- 172.21.15.105:0/3963149230 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fd2240bbed0 con 0x7fd2340b5fa0 2024-09-21T03:20:37.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.777+0000 7fd2392ae640 1 --2- 172.21.15.105:0/3963149230 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd220078b90 0x7fd22007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:37.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.777+0000 7fd2392ae640 1 --2- 172.21.15.105:0/3963149230 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd220078b90 0x7fd22007b0a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd2340ce660 tx=0x7fd228005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:37.783 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.781+0000 7fd2327fc640 1 -- 172.21.15.105:0/3963149230 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd22403f030 con 0x7fd2340b5fa0 2024-09-21T03:20:37.961 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.959+0000 7fd23bd13640 1 -- 172.21.15.105:0/3963149230 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd23406f370 con 0x7fd2340b5fa0 2024-09-21T03:20:37.962 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.960+0000 7fd2327fc640 1 -- 172.21.15.105:0/3963149230 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+16745 (secure 0 0 0) 0x7fd224031770 con 0x7fd2340b5fa0 2024-09-21T03:20:37.962 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:20:37.962 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":45,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:20:23.351123+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:20:19.345425+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-21T03:20:20.668938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:20:37.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.963+0000 7fd23bd13640 1 -- 172.21.15.105:0/3963149230 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd220078b90 msgr2=0x7fd22007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:37.965 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.963+0000 7fd23bd13640 1 --2- 172.21.15.105:0/3963149230 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd220078b90 0x7fd22007b0a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd2340ce660 tx=0x7fd228005f90 comp rx=0 tx=0).stop 2024-09-21T03:20:37.965 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.963+0000 7fd23bd13640 1 -- 172.21.15.105:0/3963149230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2340b5fa0 msgr2=0x7fd23415f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:37.965 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.963+0000 7fd23bd13640 1 --2- 172.21.15.105:0/3963149230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2340b5fa0 0x7fd23415f280 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd22402ab60 tx=0x7fd2240049d0 comp rx=0 tx=0).stop 2024-09-21T03:20:37.965 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.963+0000 7fd23bd13640 1 -- 172.21.15.105:0/3963149230 shutdown_connections 2024-09-21T03:20:37.965 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.963+0000 7fd23bd13640 1 --2- 172.21.15.105:0/3963149230 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd220078b90 0x7fd22007b0a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:37.965 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.963+0000 7fd23bd13640 1 --2- 172.21.15.105:0/3963149230 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2340ced80 0x7fd2341f8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:37.965 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.963+0000 7fd23bd13640 1 --2- 172.21.15.105:0/3963149230 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2340b9970 0x7fd2341f2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:37.965 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.963+0000 7fd23bd13640 1 --2- 172.21.15.105:0/3963149230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2340b5fa0 0x7fd23415f280 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:37.965 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.963+0000 7fd23bd13640 1 -- 172.21.15.105:0/3963149230 >> 172.21.15.105:0/3963149230 conn(0x7fd23409d7f0 msgr2=0x7fd2340b5680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:37.965 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.963+0000 7fd23bd13640 1 -- 172.21.15.105:0/3963149230 shutdown_connections 2024-09-21T03:20:37.965 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:37.963+0000 7fd23bd13640 1 -- 172.21.15.105:0/3963149230 wait complete. 2024-09-21T03:20:37.976 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T03:20:38.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.087+0000 7f18b864d640 1 -- 172.21.15.105:0/138980419 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18b006e170 msgr2=0x7f18b00b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:38.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.087+0000 7f18b864d640 1 --2- 172.21.15.105:0/138980419 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18b006e170 0x7f18b00b3540 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f18ac009830 tx=0x7f18ac02a4b0 comp rx=0 tx=0).stop 2024-09-21T03:20:38.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.088+0000 7f18b864d640 1 -- 172.21.15.105:0/138980419 shutdown_connections 2024-09-21T03:20:38.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.088+0000 7f18b864d640 1 --2- 172.21.15.105:0/138980419 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18b006e170 0x7f18b00b3540 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:38.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.088+0000 7f18b864d640 1 -- 172.21.15.105:0/138980419 >> 172.21.15.105:0/138980419 conn(0x7f18b008bfc0 msgr2=0x7f18b009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:38.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.088+0000 7f18b864d640 1 -- 172.21.15.105:0/138980419 shutdown_connections 2024-09-21T03:20:38.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.088+0000 7f18b864d640 1 -- 172.21.15.105:0/138980419 wait complete. 2024-09-21T03:20:38.091 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.089+0000 7f18b864d640 1 Processor -- start 2024-09-21T03:20:38.091 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.089+0000 7f18b864d640 1 -- start start 2024-09-21T03:20:38.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.091+0000 7f18b864d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18b006f4b0 0x7f18b01f5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:38.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.091+0000 7f18b864d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18b00ceb40 0x7f18b00b57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:38.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.091+0000 7f18b864d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18b00b6720 0x7f18b00cd240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:38.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.091+0000 7f18b864d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f18b00d1070 con 0x7f18b00ceb40 2024-09-21T03:20:38.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.091+0000 7f18b864d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f18b00d0ef0 con 0x7f18b006f4b0 2024-09-21T03:20:38.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.091+0000 7f18b864d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f18b00d11f0 con 0x7f18b00b6720 2024-09-21T03:20:38.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.091+0000 7f18b5be8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18b00ceb40 0x7f18b00b57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:38.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.091+0000 7f18b5be8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18b00ceb40 0x7f18b00b57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:52348/0 (socket says 172.21.15.105:52348) 2024-09-21T03:20:38.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.091+0000 7f18b5be8640 1 -- 172.21.15.105:0/3792638829 learned_addr learned my addr 172.21.15.105:0/3792638829 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:38.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.091+0000 7f18b63e9640 1 --2- 172.21.15.105:0/3792638829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18b006f4b0 0x7f18b01f5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:38.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.091+0000 7f18b6bea640 1 --2- 172.21.15.105:0/3792638829 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18b00b6720 0x7f18b00cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:38.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.091+0000 7f18b5be8640 1 -- 172.21.15.105:0/3792638829 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18b00b6720 msgr2=0x7f18b00cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:38.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.091+0000 7f18b5be8640 1 --2- 172.21.15.105:0/3792638829 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18b00b6720 0x7f18b00cd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:38.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.091+0000 7f18b5be8640 1 -- 172.21.15.105:0/3792638829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18b006f4b0 msgr2=0x7f18b01f5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:38.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.091+0000 7f18b5be8640 1 --2- 172.21.15.105:0/3792638829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18b006f4b0 0x7f18b01f5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:38.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.091+0000 7f18b5be8640 1 -- 172.21.15.105:0/3792638829 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18b00cb7a0 con 0x7f18b00ceb40 2024-09-21T03:20:38.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.091+0000 7f18b5be8640 1 --2- 172.21.15.105:0/3792638829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18b00ceb40 0x7f18b00b57b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f18a000c680 tx=0x7f18a000cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:38.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.091+0000 7f18a6ffd640 1 -- 172.21.15.105:0/3792638829 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a0016020 con 0x7f18b00ceb40 2024-09-21T03:20:38.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.092+0000 7f18b864d640 1 -- 172.21.15.105:0/3792638829 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18b00cba80 con 0x7f18b00ceb40 2024-09-21T03:20:38.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.092+0000 7f18a6ffd640 1 -- 172.21.15.105:0/3792638829 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f18a000a930 con 0x7f18b00ceb40 2024-09-21T03:20:38.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.092+0000 7f18a6ffd640 1 -- 172.21.15.105:0/3792638829 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a000ad60 con 0x7f18b00ceb40 2024-09-21T03:20:38.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.092+0000 7f18b864d640 1 -- 172.21.15.105:0/3792638829 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18b00cc040 con 0x7f18b00ceb40 2024-09-21T03:20:38.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.092+0000 7f18b864d640 1 -- 172.21.15.105:0/3792638829 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18b006e170 con 0x7f18b00ceb40 2024-09-21T03:20:38.096 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.093+0000 7f18a6ffd640 1 -- 172.21.15.105:0/3792638829 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f18a0019020 con 0x7f18b00ceb40 2024-09-21T03:20:38.096 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.094+0000 7f18a6ffd640 1 --2- 172.21.15.105:0/3792638829 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1894078b90 0x7f189407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:38.096 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.094+0000 7f18a6ffd640 1 -- 172.21.15.105:0/3792638829 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f18a009ad80 con 0x7f18b00ceb40 2024-09-21T03:20:38.096 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.094+0000 7f18b63e9640 1 --2- 172.21.15.105:0/3792638829 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1894078b90 0x7f189407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:38.096 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.094+0000 7f18b63e9640 1 --2- 172.21.15.105:0/3792638829 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1894078b90 0x7f189407b0a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f18ac034000 tx=0x7f18ac004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:38.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.098+0000 7f18a6ffd640 1 -- 172.21.15.105:0/3792638829 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f18a0020020 con 0x7f18b00ceb40 2024-09-21T03:20:38.313 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.311+0000 7f18b864d640 1 -- 172.21.15.105:0/3792638829 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f18b00b14b0 con 0x7f18b00ceb40 2024-09-21T03:20:38.313 INFO:tasks.ceph.mon.a.smithi105.stderr:2024-09-21T03:20:38.312+0000 7f25819ea640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T03:20:38.315 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.313+0000 7f18a6ffd640 1 -- 172.21.15.105:0/3792638829 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) ==== 161+0+0 (secure 0 0 0) 0x7f18a0062af0 con 0x7f18b00ceb40 2024-09-21T03:20:38.315 INFO:teuthology.orchestra.run.smithi105.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T03:20:38.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.316+0000 7f18b864d640 1 -- 172.21.15.105:0/3792638829 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1894078b90 msgr2=0x7f189407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:38.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.316+0000 7f18b864d640 1 --2- 172.21.15.105:0/3792638829 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1894078b90 0x7f189407b0a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f18ac034000 tx=0x7f18ac004730 comp rx=0 tx=0).stop 2024-09-21T03:20:38.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.316+0000 7f18b864d640 1 -- 172.21.15.105:0/3792638829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18b00ceb40 msgr2=0x7f18b00b57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:38.318 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.316+0000 7f18b864d640 1 --2- 172.21.15.105:0/3792638829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18b00ceb40 0x7f18b00b57b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f18a000c680 tx=0x7f18a000cb40 comp rx=0 tx=0).stop 2024-09-21T03:20:38.318 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.316+0000 7f18b864d640 1 -- 172.21.15.105:0/3792638829 shutdown_connections 2024-09-21T03:20:38.318 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.316+0000 7f18b864d640 1 --2- 172.21.15.105:0/3792638829 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1894078b90 0x7f189407b0a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:38.318 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.316+0000 7f18b864d640 1 --2- 172.21.15.105:0/3792638829 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18b00b6720 0x7f18b00cd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:38.318 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.316+0000 7f18b864d640 1 --2- 172.21.15.105:0/3792638829 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18b00ceb40 0x7f18b00b57b0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:38.318 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.316+0000 7f18b864d640 1 --2- 172.21.15.105:0/3792638829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18b006f4b0 0x7f18b01f5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:38.318 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.316+0000 7f18b864d640 1 -- 172.21.15.105:0/3792638829 >> 172.21.15.105:0/3792638829 conn(0x7f18b008bfc0 msgr2=0x7f18b015bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:38.318 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.316+0000 7f18b864d640 1 -- 172.21.15.105:0/3792638829 shutdown_connections 2024-09-21T03:20:38.318 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.316+0000 7f18b864d640 1 -- 172.21.15.105:0/3792638829 wait complete. 2024-09-21T03:20:38.319 INFO:tasks.ceph.mds.c.smithi105.stderr: -2081> 2024-09-21T03:20:28.321+0000 7fb469598640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T03:20:38.329 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T03:20:38.372 INFO:tasks.ceph.mds.c.smithi105.stdout:starting mds.c at 2024-09-21T03:20:38.451 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.449+0000 7f7fcb1ad640 1 -- 172.21.15.105:0/2364269586 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fac004800 msgr2=0x7f7fac004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:38.451 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.449+0000 7f7fcb1ad640 1 --2- 172.21.15.105:0/2364269586 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fac004800 0x7f7fac004c10 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8009ed0 tx=0x7f7fac005830 comp rx=0 tx=0).stop 2024-09-21T03:20:38.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.449+0000 7f7fc974a640 1 -- 172.21.15.105:0/2364269586 reap_dead start 2024-09-21T03:20:38.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.449+0000 7f7fcb1ad640 1 -- 172.21.15.105:0/2364269586 shutdown_connections 2024-09-21T03:20:38.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.449+0000 7f7fcb1ad640 1 -- 172.21.15.105:0/2364269586 >> 172.21.15.105:0/2364269586 conn(0x7f7fc40b1cb0 msgr2=0x7f7fc40b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:38.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.449+0000 7f7fcb1ad640 1 -- 172.21.15.105:0/2364269586 shutdown_connections 2024-09-21T03:20:38.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.449+0000 7f7fcb1ad640 1 -- 172.21.15.105:0/2364269586 wait complete. 2024-09-21T03:20:38.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.451+0000 7f7fcb1ad640 1 Processor -- start 2024-09-21T03:20:38.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.451+0000 7f7fcb1ad640 1 -- start start 2024-09-21T03:20:38.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.453+0000 7f7fcb1ad640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fac004800 0x7f7fc4154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:38.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.453+0000 7f7fcb1ad640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fc40b01e0 0x7f7fc40b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:38.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.453+0000 7f7fcb1ad640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fc415bee0 0x7f7fc415c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:38.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.453+0000 7f7fcb1ad640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc4073940 con 0x7f7fc415bee0 2024-09-21T03:20:38.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.453+0000 7f7fcb1ad640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc40737c0 con 0x7f7fc40b01e0 2024-09-21T03:20:38.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.453+0000 7f7fcb1ad640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7fc4073ac0 con 0x7f7fac004800 2024-09-21T03:20:38.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.453+0000 7f7fc974a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fc415bee0 0x7f7fc415c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:38.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.453+0000 7f7fc974a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fc415bee0 0x7f7fc415c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:52382/0 (socket says 172.21.15.105:52382) 2024-09-21T03:20:38.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.453+0000 7f7fc974a640 1 -- 172.21.15.105:0/1662661678 learned_addr learned my addr 172.21.15.105:0/1662661678 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:38.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.453+0000 7f7fc3fff640 1 --2- 172.21.15.105:0/1662661678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fc40b01e0 0x7f7fc40b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:38.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.453+0000 7f7fc8f49640 1 --2- 172.21.15.105:0/1662661678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fac004800 0x7f7fc4154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:38.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.453+0000 7f7fc974a640 1 -- 172.21.15.105:0/1662661678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fac004800 msgr2=0x7f7fc4154510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:38.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.453+0000 7f7fc974a640 1 --2- 172.21.15.105:0/1662661678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fac004800 0x7f7fc4154510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:38.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.453+0000 7f7fc974a640 1 -- 172.21.15.105:0/1662661678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fc40b01e0 msgr2=0x7f7fc40b05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:38.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.453+0000 7f7fc974a640 1 --2- 172.21.15.105:0/1662661678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fc40b01e0 0x7f7fc40b05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:38.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.453+0000 7f7fc974a640 1 -- 172.21.15.105:0/1662661678 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc41f2b20 con 0x7f7fc415bee0 2024-09-21T03:20:38.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.453+0000 7f7fc974a640 1 --2- 172.21.15.105:0/1662661678 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fc415bee0 0x7f7fc415c2f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4072dc0 tx=0x7f7fbc009c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:38.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.453+0000 7f7fc17fa640 1 -- 172.21.15.105:0/1662661678 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc0112e0 con 0x7f7fc415bee0 2024-09-21T03:20:38.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.453+0000 7f7fc17fa640 1 -- 172.21.15.105:0/1662661678 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7fbc00c780 con 0x7f7fc415bee0 2024-09-21T03:20:38.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.453+0000 7f7fcb1ad640 1 -- 172.21.15.105:0/1662661678 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fc4153a30 con 0x7f7fc415bee0 2024-09-21T03:20:38.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.453+0000 7f7fc17fa640 1 -- 172.21.15.105:0/1662661678 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc00cbd0 con 0x7f7fc415bee0 2024-09-21T03:20:38.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.453+0000 7f7fcb1ad640 1 -- 172.21.15.105:0/1662661678 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fc4153ff0 con 0x7f7fc415bee0 2024-09-21T03:20:38.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.455+0000 7f7fcb1ad640 1 -- 172.21.15.105:0/1662661678 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fc41f2890 con 0x7f7fc415bee0 2024-09-21T03:20:38.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.455+0000 7f7fc17fa640 1 -- 172.21.15.105:0/1662661678 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7fbc00f550 con 0x7f7fc415bee0 2024-09-21T03:20:38.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.456+0000 7f7fc17fa640 1 --2- 172.21.15.105:0/1662661678 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7fb0078b90 0x7f7fb007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:38.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.456+0000 7f7fc17fa640 1 -- 172.21.15.105:0/1662661678 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5795+0+0 (secure 0 0 0) 0x7f7fbc09cfd0 con 0x7f7fc415bee0 2024-09-21T03:20:38.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.456+0000 7f7fc8f49640 1 --2- 172.21.15.105:0/1662661678 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7fb0078b90 0x7f7fb007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:38.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.457+0000 7f7fc8f49640 1 --2- 172.21.15.105:0/1662661678 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7fb0078b90 0x7f7fb007b0a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4000fd0 tx=0x7f7fb4001200 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:38.462 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.461+0000 7f7fc17fa640 1 -- 172.21.15.105:0/1662661678 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7fbc021060 con 0x7f7fc415bee0 2024-09-21T03:20:38.677 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:38.675+0000 7f7fcb1ad640 1 -- 172.21.15.105:0/1662661678 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f7fc40cba00 con 0x7f7fc415bee0 2024-09-21T03:20:39.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.315+0000 7f7fc17fa640 1 -- 172.21.15.105:0/1662661678 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v27) ==== 104+0+0 (secure 0 0 0) 0x7f7fbc064df0 con 0x7f7fc415bee0 2024-09-21T03:20:39.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.319+0000 7f7fcb1ad640 1 -- 172.21.15.105:0/1662661678 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7fb0078b90 msgr2=0x7f7fb007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:39.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.319+0000 7f7fcb1ad640 1 --2- 172.21.15.105:0/1662661678 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7fb0078b90 0x7f7fb007b0a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4000fd0 tx=0x7f7fb4001200 comp rx=0 tx=0).stop 2024-09-21T03:20:39.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.319+0000 7f7fcb1ad640 1 -- 172.21.15.105:0/1662661678 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fc415bee0 msgr2=0x7f7fc415c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:39.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.319+0000 7f7fcb1ad640 1 --2- 172.21.15.105:0/1662661678 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fc415bee0 0x7f7fc415c2f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4072dc0 tx=0x7f7fbc009c40 comp rx=0 tx=0).stop 2024-09-21T03:20:39.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.319+0000 7f7fcb1ad640 1 -- 172.21.15.105:0/1662661678 shutdown_connections 2024-09-21T03:20:39.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.319+0000 7f7fcb1ad640 1 --2- 172.21.15.105:0/1662661678 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7fb0078b90 0x7f7fb007b0a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:39.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.319+0000 7f7fcb1ad640 1 --2- 172.21.15.105:0/1662661678 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fc415bee0 0x7f7fc415c2f0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:39.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.319+0000 7f7fcb1ad640 1 --2- 172.21.15.105:0/1662661678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fc40b01e0 0x7f7fc40b05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:39.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.319+0000 7f7fcb1ad640 1 --2- 172.21.15.105:0/1662661678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fac004800 0x7f7fc4154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:39.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.319+0000 7f7fcb1ad640 1 -- 172.21.15.105:0/1662661678 >> 172.21.15.105:0/1662661678 conn(0x7f7fc40b1cb0 msgr2=0x7f7fc40aefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:39.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.319+0000 7f7fcb1ad640 1 -- 172.21.15.105:0/1662661678 shutdown_connections 2024-09-21T03:20:39.322 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.319+0000 7f7fcb1ad640 1 -- 172.21.15.105:0/1662661678 wait complete. 2024-09-21T03:20:39.334 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T03:20:39.495 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.494+0000 7f8c3b5e6640 1 -- 172.21.15.105:0/1964443741 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c20003a00 msgr2=0x7f8c20003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:39.496 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.494+0000 7f8c3b5e6640 1 --2- 172.21.15.105:0/1964443741 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c20003a00 0x7f8c20003e30 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f8c30009b50 tx=0x7f8c20005830 comp rx=0 tx=0).stop 2024-09-21T03:20:39.496 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.494+0000 7f8c3b5e6640 1 -- 172.21.15.105:0/1964443741 shutdown_connections 2024-09-21T03:20:39.496 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.494+0000 7f8c3b5e6640 1 --2- 172.21.15.105:0/1964443741 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c20003a00 0x7f8c20003e30 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:39.496 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.494+0000 7f8c3b5e6640 1 -- 172.21.15.105:0/1964443741 >> 172.21.15.105:0/1964443741 conn(0x7f8c34072a90 msgr2=0x7f8c34072ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:39.496 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.494+0000 7f8c3b5e6640 1 -- 172.21.15.105:0/1964443741 shutdown_connections 2024-09-21T03:20:39.496 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.494+0000 7f8c3b5e6640 1 -- 172.21.15.105:0/1964443741 wait complete. 2024-09-21T03:20:39.497 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.495+0000 7f8c3b5e6640 1 Processor -- start 2024-09-21T03:20:39.497 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.496+0000 7f8c3b5e6640 1 -- start start 2024-09-21T03:20:39.499 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.497+0000 7f8c3b5e6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c20003a00 0x7f8c341588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:39.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.497+0000 7f8c3b5e6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c340cc010 0x7f8c340b4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:39.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.497+0000 7f8c3b5e6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c341f6d20 0x7f8c341f7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:39.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.497+0000 7f8c3b5e6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8c3415c7e0 con 0x7f8c20003a00 2024-09-21T03:20:39.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.497+0000 7f8c3b5e6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8c3415c660 con 0x7f8c341f6d20 2024-09-21T03:20:39.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.497+0000 7f8c3b5e6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8c3415c960 con 0x7f8c340cc010 2024-09-21T03:20:39.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.497+0000 7f8c39382640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c20003a00 0x7f8c341588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:39.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.497+0000 7f8c39382640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c20003a00 0x7f8c341588f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:52398/0 (socket says 172.21.15.105:52398) 2024-09-21T03:20:39.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.497+0000 7f8c39382640 1 -- 172.21.15.105:0/588081736 learned_addr learned my addr 172.21.15.105:0/588081736 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:39.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.497+0000 7f8c39b83640 1 --2- 172.21.15.105:0/588081736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c341f6d20 0x7f8c341f7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:39.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.497+0000 7f8c38b81640 1 --2- 172.21.15.105:0/588081736 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c340cc010 0x7f8c340b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:39.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.497+0000 7f8c39382640 1 -- 172.21.15.105:0/588081736 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c340cc010 msgr2=0x7f8c340b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:39.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.497+0000 7f8c39382640 1 --2- 172.21.15.105:0/588081736 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c340cc010 0x7f8c340b4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:39.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.497+0000 7f8c39382640 1 -- 172.21.15.105:0/588081736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c341f6d20 msgr2=0x7f8c341f7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:39.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.497+0000 7f8c39382640 1 --2- 172.21.15.105:0/588081736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c341f6d20 0x7f8c341f7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:39.501 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.497+0000 7f8c39382640 1 -- 172.21.15.105:0/588081736 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c34158fa0 con 0x7f8c20003a00 2024-09-21T03:20:39.501 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.497+0000 7f8c39b83640 1 --2- 172.21.15.105:0/588081736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c341f6d20 0x7f8c341f7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:20:39.501 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.497+0000 7f8c39382640 1 --2- 172.21.15.105:0/588081736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c20003a00 0x7f8c341588f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f8c30036040 tx=0x7f8c300336f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:39.501 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.498+0000 7f8c29ffb640 1 -- 172.21.15.105:0/588081736 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c30038040 con 0x7f8c20003a00 2024-09-21T03:20:39.501 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.498+0000 7f8c29ffb640 1 -- 172.21.15.105:0/588081736 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c30041070 con 0x7f8c20003a00 2024-09-21T03:20:39.501 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.498+0000 7f8c29ffb640 1 -- 172.21.15.105:0/588081736 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c3003c430 con 0x7f8c20003a00 2024-09-21T03:20:39.501 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.498+0000 7f8c3b5e6640 1 -- 172.21.15.105:0/588081736 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c341f7670 con 0x7f8c20003a00 2024-09-21T03:20:39.501 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.498+0000 7f8c3b5e6640 1 -- 172.21.15.105:0/588081736 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c3415b030 con 0x7f8c20003a00 2024-09-21T03:20:39.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.499+0000 7f8c3b5e6640 1 -- 172.21.15.105:0/588081736 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c340ccd30 con 0x7f8c20003a00 2024-09-21T03:20:39.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.500+0000 7f8c29ffb640 1 -- 172.21.15.105:0/588081736 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8c3003c5d0 con 0x7f8c20003a00 2024-09-21T03:20:39.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.500+0000 7f8c29ffb640 1 --2- 172.21.15.105:0/588081736 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c18078b90 0x7f8c1807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:39.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.500+0000 7f8c29ffb640 1 -- 172.21.15.105:0/588081736 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5795+0+0 (secure 0 0 0) 0x7f8c300bb8f0 con 0x7f8c20003a00 2024-09-21T03:20:39.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.500+0000 7f8c38b81640 1 --2- 172.21.15.105:0/588081736 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c18078b90 0x7f8c1807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:39.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.501+0000 7f8c38b81640 1 --2- 172.21.15.105:0/588081736 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c18078b90 0x7f8c1807b0a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8c24001860 tx=0x7f8c24001c10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:39.506 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.505+0000 7f8c29ffb640 1 -- 172.21.15.105:0/588081736 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8c341f7670 con 0x7f8c20003a00 2024-09-21T03:20:39.683 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:39.681+0000 7f8c3b5e6640 1 -- 172.21.15.105:0/588081736 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8c3415e5d0 con 0x7f8c20003a00 2024-09-21T03:20:40.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.423+0000 7f8c29ffb640 1 -- 172.21.15.105:0/588081736 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v47) ==== 181+0+0 (secure 0 0 0) 0x7f8c30083cd0 con 0x7f8c20003a00 2024-09-21T03:20:40.425 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_metadata' removed 2024-09-21T03:20:40.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.427+0000 7f8c3b5e6640 1 -- 172.21.15.105:0/588081736 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c18078b90 msgr2=0x7f8c1807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:40.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.427+0000 7f8c3b5e6640 1 --2- 172.21.15.105:0/588081736 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c18078b90 0x7f8c1807b0a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8c24001860 tx=0x7f8c24001c10 comp rx=0 tx=0).stop 2024-09-21T03:20:40.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.427+0000 7f8c3b5e6640 1 -- 172.21.15.105:0/588081736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c20003a00 msgr2=0x7f8c341588f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:40.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.427+0000 7f8c3b5e6640 1 --2- 172.21.15.105:0/588081736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c20003a00 0x7f8c341588f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f8c30036040 tx=0x7f8c300336f0 comp rx=0 tx=0).stop 2024-09-21T03:20:40.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.427+0000 7f8c3b5e6640 1 -- 172.21.15.105:0/588081736 shutdown_connections 2024-09-21T03:20:40.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.427+0000 7f8c3b5e6640 1 --2- 172.21.15.105:0/588081736 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c18078b90 0x7f8c1807b0a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:40.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.427+0000 7f8c3b5e6640 1 --2- 172.21.15.105:0/588081736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c341f6d20 0x7f8c341f7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:40.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.427+0000 7f8c3b5e6640 1 --2- 172.21.15.105:0/588081736 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c340cc010 0x7f8c340b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:40.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.427+0000 7f8c3b5e6640 1 --2- 172.21.15.105:0/588081736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c20003a00 0x7f8c341588f0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:40.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.427+0000 7f8c3b5e6640 1 -- 172.21.15.105:0/588081736 >> 172.21.15.105:0/588081736 conn(0x7f8c34072a90 msgr2=0x7f8c34158050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:40.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.427+0000 7f8c3b5e6640 1 -- 172.21.15.105:0/588081736 shutdown_connections 2024-09-21T03:20:40.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.427+0000 7f8c3b5e6640 1 -- 172.21.15.105:0/588081736 wait complete. 2024-09-21T03:20:40.443 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T03:20:40.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.569+0000 7f97d9962640 1 -- 172.21.15.105:0/2920038742 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97bc004080 msgr2=0x7f97bc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:40.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.569+0000 7f97d9962640 1 --2- 172.21.15.105:0/2920038742 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97bc004080 0x7f97bc004800 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f97d40d1ea0 tx=0x7f97bc005830 comp rx=0 tx=0).stop 2024-09-21T03:20:40.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.569+0000 7f97d37fe640 1 -- 172.21.15.105:0/2920038742 reap_dead start 2024-09-21T03:20:40.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.569+0000 7f97d9962640 1 -- 172.21.15.105:0/2920038742 shutdown_connections 2024-09-21T03:20:40.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.569+0000 7f97d9962640 1 -- 172.21.15.105:0/2920038742 >> 172.21.15.105:0/2920038742 conn(0x7f97d408dc50 msgr2=0x7f97d409d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:40.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.569+0000 7f97d9962640 1 -- 172.21.15.105:0/2920038742 shutdown_connections 2024-09-21T03:20:40.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.569+0000 7f97d9962640 1 -- 172.21.15.105:0/2920038742 wait complete. 2024-09-21T03:20:40.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.571+0000 7f97d9962640 1 Processor -- start 2024-09-21T03:20:40.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.571+0000 7f97d9962640 1 -- start start 2024-09-21T03:20:40.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.573+0000 7f97d9962640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97bc004080 0x7f97d40caef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:40.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.573+0000 7f97d9962640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97d40c8970 0x7f97d41f5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:40.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.573+0000 7f97d9962640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97d40a0ef0 0x7f97d4161670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:40.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.573+0000 7f97d9962640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f97d40d1690 con 0x7f97bc004080 2024-09-21T03:20:40.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.573+0000 7f97d9962640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f97d40d1510 con 0x7f97d40a0ef0 2024-09-21T03:20:40.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.573+0000 7f97d9962640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f97d4162790 con 0x7f97d40c8970 2024-09-21T03:20:40.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.573+0000 7f97d2ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97bc004080 0x7f97d40caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:40.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.573+0000 7f97d2ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97bc004080 0x7f97d40caef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:52418/0 (socket says 172.21.15.105:52418) 2024-09-21T03:20:40.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.573+0000 7f97d2ffd640 1 -- 172.21.15.105:0/4160228956 learned_addr learned my addr 172.21.15.105:0/4160228956 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:40.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.573+0000 7f97d27fc640 1 --2- 172.21.15.105:0/4160228956 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97d40c8970 0x7f97d41f5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:40.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.573+0000 7f97d37fe640 1 --2- 172.21.15.105:0/4160228956 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97d40a0ef0 0x7f97d4161670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:40.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.573+0000 7f97d2ffd640 1 -- 172.21.15.105:0/4160228956 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97d40c8970 msgr2=0x7f97d41f5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:40.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.573+0000 7f97d2ffd640 1 --2- 172.21.15.105:0/4160228956 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97d40c8970 0x7f97d41f5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:40.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.573+0000 7f97d2ffd640 1 -- 172.21.15.105:0/4160228956 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97d40a0ef0 msgr2=0x7f97d4161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:40.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.573+0000 7f97d2ffd640 1 --2- 172.21.15.105:0/4160228956 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97d40a0ef0 0x7f97d4161670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:40.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.573+0000 7f97d2ffd640 1 -- 172.21.15.105:0/4160228956 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97d41f5fc0 con 0x7f97bc004080 2024-09-21T03:20:40.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.573+0000 7f97d27fc640 1 --2- 172.21.15.105:0/4160228956 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97d40c8970 0x7f97d41f5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:20:40.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.573+0000 7f97d2ffd640 1 --2- 172.21.15.105:0/4160228956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97bc004080 0x7f97d40caef0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f97c40043e0 tx=0x7f97c40048a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:40.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.573+0000 7f97bbfff640 1 -- 172.21.15.105:0/4160228956 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c4016070 con 0x7f97bc004080 2024-09-21T03:20:40.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.573+0000 7f97bbfff640 1 -- 172.21.15.105:0/4160228956 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f97c4010d90 con 0x7f97bc004080 2024-09-21T03:20:40.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.573+0000 7f97d9962640 1 -- 172.21.15.105:0/4160228956 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97d41f62a0 con 0x7f97bc004080 2024-09-21T03:20:40.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.573+0000 7f97bbfff640 1 -- 172.21.15.105:0/4160228956 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c40126b0 con 0x7f97bc004080 2024-09-21T03:20:40.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.573+0000 7f97d9962640 1 -- 172.21.15.105:0/4160228956 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97d40a17d0 con 0x7f97bc004080 2024-09-21T03:20:40.578 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.574+0000 7f97d9962640 1 -- 172.21.15.105:0/4160228956 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97d41f64e0 con 0x7f97bc004080 2024-09-21T03:20:40.578 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.575+0000 7f97bbfff640 1 -- 172.21.15.105:0/4160228956 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f97c4012850 con 0x7f97bc004080 2024-09-21T03:20:40.578 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.576+0000 7f97bbfff640 1 --2- 172.21.15.105:0/4160228956 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f97c0078bc0 0x7f97c007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:40.578 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.576+0000 7f97bbfff640 1 -- 172.21.15.105:0/4160228956 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5357+0+0 (secure 0 0 0) 0x7f97c409be30 con 0x7f97bc004080 2024-09-21T03:20:40.578 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.576+0000 7f97d27fc640 1 --2- 172.21.15.105:0/4160228956 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f97c0078bc0 0x7f97c007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:40.578 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.576+0000 7f97d27fc640 1 --2- 172.21.15.105:0/4160228956 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f97c0078bc0 0x7f97c007b0d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f97c8033000 tx=0x7f97d415f100 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:40.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.580+0000 7f97bbfff640 1 -- 172.21.15.105:0/4160228956 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f97d41f64e0 con 0x7f97bc004080 2024-09-21T03:20:40.766 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:40.764+0000 7f97d9962640 1 -- 172.21.15.105:0/4160228956 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f97d406e160 con 0x7f97bc004080 2024-09-21T03:20:41.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.431+0000 7f97bbfff640 1 -- 172.21.15.105:0/4160228956 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v48) ==== 169+0+0 (secure 0 0 0) 0x7f97c4063e10 con 0x7f97bc004080 2024-09-21T03:20:41.433 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_data' removed 2024-09-21T03:20:41.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.433+0000 7f97d9962640 1 -- 172.21.15.105:0/4160228956 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f97c0078bc0 msgr2=0x7f97c007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:41.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.433+0000 7f97d9962640 1 --2- 172.21.15.105:0/4160228956 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f97c0078bc0 0x7f97c007b0d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f97c8033000 tx=0x7f97d415f100 comp rx=0 tx=0).stop 2024-09-21T03:20:41.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.433+0000 7f97d9962640 1 -- 172.21.15.105:0/4160228956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97bc004080 msgr2=0x7f97d40caef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:41.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.433+0000 7f97d9962640 1 --2- 172.21.15.105:0/4160228956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97bc004080 0x7f97d40caef0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f97c40043e0 tx=0x7f97c40048a0 comp rx=0 tx=0).stop 2024-09-21T03:20:41.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.433+0000 7f97d9962640 1 -- 172.21.15.105:0/4160228956 shutdown_connections 2024-09-21T03:20:41.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.433+0000 7f97d9962640 1 --2- 172.21.15.105:0/4160228956 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f97c0078bc0 0x7f97c007b0d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:41.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.433+0000 7f97d9962640 1 --2- 172.21.15.105:0/4160228956 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97d40a0ef0 0x7f97d4161670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:41.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.433+0000 7f97d9962640 1 --2- 172.21.15.105:0/4160228956 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97d40c8970 0x7f97d41f5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:41.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.433+0000 7f97d9962640 1 --2- 172.21.15.105:0/4160228956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97bc004080 0x7f97d40caef0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:41.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.433+0000 7f97d9962640 1 -- 172.21.15.105:0/4160228956 >> 172.21.15.105:0/4160228956 conn(0x7f97d408dc50 msgr2=0x7f97d40d4d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:41.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.434+0000 7f97d9962640 1 -- 172.21.15.105:0/4160228956 shutdown_connections 2024-09-21T03:20:41.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.434+0000 7f97d9962640 1 -- 172.21.15.105:0/4160228956 wait complete. 2024-09-21T03:20:41.450 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-21T03:20:41.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.564+0000 7f02a82d5640 1 -- 172.21.15.105:0/611498062 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f028c003a30 msgr2=0x7f028c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:41.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.564+0000 7f02a82d5640 1 --2- 172.21.15.105:0/611498062 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f028c003a30 0x7f028c003ea0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f02a0074ad0 tx=0x7f028c005830 comp rx=0 tx=0).stop 2024-09-21T03:20:41.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.564+0000 7f02a6872640 1 -- 172.21.15.105:0/611498062 reap_dead start 2024-09-21T03:20:41.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.564+0000 7f02a82d5640 1 -- 172.21.15.105:0/611498062 shutdown_connections 2024-09-21T03:20:41.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.564+0000 7f02a82d5640 1 -- 172.21.15.105:0/611498062 >> 172.21.15.105:0/611498062 conn(0x7f02a0072ae0 msgr2=0x7f02a0072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:41.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.564+0000 7f02a82d5640 1 -- 172.21.15.105:0/611498062 shutdown_connections 2024-09-21T03:20:41.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.564+0000 7f02a82d5640 1 -- 172.21.15.105:0/611498062 wait complete. 2024-09-21T03:20:41.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.566+0000 7f02a82d5640 1 Processor -- start 2024-09-21T03:20:41.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.566+0000 7f02a82d5640 1 -- start start 2024-09-21T03:20:41.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.567+0000 7f02a82d5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f028c003a30 0x7f02a00cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:41.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.567+0000 7f02a82d5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02a01f67c0 0x7f02a01f6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:41.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.567+0000 7f02a82d5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02a01f7110 0x7f02a0158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:41.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.567+0000 7f02a82d5640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f02a015c860 con 0x7f02a01f67c0 2024-09-21T03:20:41.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.567+0000 7f02a82d5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f02a015c6e0 con 0x7f028c003a30 2024-09-21T03:20:41.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.567+0000 7f02a82d5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f02a015c9e0 con 0x7f02a01f7110 2024-09-21T03:20:41.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.567+0000 7f02a5870640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02a01f67c0 0x7f02a01f6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:41.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.567+0000 7f02a5870640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02a01f67c0 0x7f02a01f6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:54244/0 (socket says 172.21.15.105:54244) 2024-09-21T03:20:41.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.567+0000 7f02a5870640 1 -- 172.21.15.105:0/3442620699 learned_addr learned my addr 172.21.15.105:0/3442620699 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:41.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.567+0000 7f02a6872640 1 --2- 172.21.15.105:0/3442620699 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02a01f7110 0x7f02a0158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:41.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.567+0000 7f02a6071640 1 --2- 172.21.15.105:0/3442620699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f028c003a30 0x7f02a00cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:41.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.567+0000 7f02a5870640 1 -- 172.21.15.105:0/3442620699 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02a01f7110 msgr2=0x7f02a0158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:41.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.567+0000 7f02a5870640 1 --2- 172.21.15.105:0/3442620699 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02a01f7110 0x7f02a0158ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:41.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.567+0000 7f02a5870640 1 -- 172.21.15.105:0/3442620699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f028c003a30 msgr2=0x7f02a00cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:41.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.567+0000 7f02a5870640 1 --2- 172.21.15.105:0/3442620699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f028c003a30 0x7f02a00cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:41.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.567+0000 7f02a5870640 1 -- 172.21.15.105:0/3442620699 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02a01465e0 con 0x7f02a01f67c0 2024-09-21T03:20:41.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.568+0000 7f02a5870640 1 --2- 172.21.15.105:0/3442620699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02a01f67c0 0x7f02a01f6bd0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f0290003f50 tx=0x7f0290001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:41.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.568+0000 7f0296ffd640 1 -- 172.21.15.105:0/3442620699 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0290011640 con 0x7f02a01f67c0 2024-09-21T03:20:41.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.568+0000 7f0296ffd640 1 -- 172.21.15.105:0/3442620699 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0290016020 con 0x7f02a01f67c0 2024-09-21T03:20:41.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.568+0000 7f02a82d5640 1 -- 172.21.15.105:0/3442620699 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02a0145d40 con 0x7f02a01f67c0 2024-09-21T03:20:41.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.568+0000 7f0296ffd640 1 -- 172.21.15.105:0/3442620699 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0290011a80 con 0x7f02a01f67c0 2024-09-21T03:20:41.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.568+0000 7f02a82d5640 1 -- 172.21.15.105:0/3442620699 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02a0146300 con 0x7f02a01f67c0 2024-09-21T03:20:41.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.569+0000 7f02a82d5640 1 -- 172.21.15.105:0/3442620699 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02a0145ab0 con 0x7f02a01f67c0 2024-09-21T03:20:41.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.569+0000 7f0296ffd640 1 -- 172.21.15.105:0/3442620699 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0290011c20 con 0x7f02a01f67c0 2024-09-21T03:20:41.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.570+0000 7f0296ffd640 1 --2- 172.21.15.105:0/3442620699 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0284078bc0 0x7f028407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:41.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.570+0000 7f0296ffd640 1 -- 172.21.15.105:0/3442620699 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 4943+0+0 (secure 0 0 0) 0x7f029009b540 con 0x7f02a01f67c0 2024-09-21T03:20:41.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.570+0000 7f02a6071640 1 --2- 172.21.15.105:0/3442620699 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0284078bc0 0x7f028407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:41.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.571+0000 7f02a6071640 1 --2- 172.21.15.105:0/3442620699 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0284078bc0 0x7f028407b0d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f029c036000 tx=0x7f029c0046c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:41.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.574+0000 7f0296ffd640 1 -- 172.21.15.105:0/3442620699 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0290020020 con 0x7f02a01f67c0 2024-09-21T03:20:41.755 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.753+0000 7f02a82d5640 1 -- 172.21.15.105:0/3442620699 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f02a00cebf0 con 0x7f02a01f67c0 2024-09-21T03:20:41.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.757+0000 7f0296ffd640 1 -- 172.21.15.105:0/3442620699 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v37) ==== 71+0+0 (secure 0 0 0) 0x7f0290063d10 con 0x7f02a01f67c0 2024-09-21T03:20:41.761 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.759+0000 7f02a82d5640 1 -- 172.21.15.105:0/3442620699 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0284078bc0 msgr2=0x7f028407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:41.761 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.759+0000 7f02a82d5640 1 --2- 172.21.15.105:0/3442620699 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0284078bc0 0x7f028407b0d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f029c036000 tx=0x7f029c0046c0 comp rx=0 tx=0).stop 2024-09-21T03:20:41.761 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.759+0000 7f02a82d5640 1 -- 172.21.15.105:0/3442620699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02a01f67c0 msgr2=0x7f02a01f6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:41.761 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.759+0000 7f02a82d5640 1 --2- 172.21.15.105:0/3442620699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02a01f67c0 0x7f02a01f6bd0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f0290003f50 tx=0x7f0290001630 comp rx=0 tx=0).stop 2024-09-21T03:20:41.761 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.759+0000 7f02a82d5640 1 -- 172.21.15.105:0/3442620699 shutdown_connections 2024-09-21T03:20:41.761 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.759+0000 7f02a82d5640 1 --2- 172.21.15.105:0/3442620699 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0284078bc0 0x7f028407b0d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:41.761 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.759+0000 7f02a82d5640 1 --2- 172.21.15.105:0/3442620699 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02a01f7110 0x7f02a0158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:41.761 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.759+0000 7f02a82d5640 1 --2- 172.21.15.105:0/3442620699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02a01f67c0 0x7f02a01f6bd0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:41.761 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.759+0000 7f02a82d5640 1 --2- 172.21.15.105:0/3442620699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f028c003a30 0x7f02a00cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:41.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.759+0000 7f02a82d5640 1 -- 172.21.15.105:0/3442620699 >> 172.21.15.105:0/3442620699 conn(0x7f02a0072ae0 msgr2=0x7f02a00d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:41.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.759+0000 7f02a82d5640 1 -- 172.21.15.105:0/3442620699 shutdown_connections 2024-09-21T03:20:41.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.759+0000 7f02a82d5640 1 -- 172.21.15.105:0/3442620699 wait complete. 2024-09-21T03:20:41.772 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_blocklisted_oldest_tid' 2024-09-21T03:20:41.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.890+0000 7f4dd34b4640 1 -- 172.21.15.105:0/2964574024 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4db8004800 msgr2=0x7f4db8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:41.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.890+0000 7f4dd34b4640 1 --2- 172.21.15.105:0/2964574024 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4db8004800 0x7f4db8004c10 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc00c310 tx=0x7f4db8005830 comp rx=0 tx=0).stop 2024-09-21T03:20:41.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.890+0000 7f4dd1a51640 1 -- 172.21.15.105:0/2964574024 reap_dead start 2024-09-21T03:20:41.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.890+0000 7f4dd34b4640 1 -- 172.21.15.105:0/2964574024 shutdown_connections 2024-09-21T03:20:41.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.890+0000 7f4dd34b4640 1 -- 172.21.15.105:0/2964574024 >> 172.21.15.105:0/2964574024 conn(0x7f4dcc0d11f0 msgr2=0x7f4dcc0d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:41.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.890+0000 7f4dd34b4640 1 -- 172.21.15.105:0/2964574024 shutdown_connections 2024-09-21T03:20:41.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.890+0000 7f4dd34b4640 1 -- 172.21.15.105:0/2964574024 wait complete. 2024-09-21T03:20:41.897 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.892+0000 7f4dd34b4640 1 Processor -- start 2024-09-21T03:20:41.897 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.892+0000 7f4dd34b4640 1 -- start start 2024-09-21T03:20:41.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.893+0000 7f4dd34b4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4db8004800 0x7f4dcc0b1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:41.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.893+0000 7f4dd34b4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4dcc0c7390 0x7f4dcc0b5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:41.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.893+0000 7f4dd34b4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4dcc0b6490 0x7f4dcc1f6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:41.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.893+0000 7f4dd34b4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4dcc165860 con 0x7f4db8004800 2024-09-21T03:20:41.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.893+0000 7f4dd34b4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4dcc1656e0 con 0x7f4dcc0c7390 2024-09-21T03:20:41.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.893+0000 7f4dd34b4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4dcc1659e0 con 0x7f4dcc0b6490 2024-09-21T03:20:41.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.893+0000 7f4dd1250640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4db8004800 0x7f4dcc0b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:41.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.893+0000 7f4dd1250640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4db8004800 0x7f4dcc0b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:54252/0 (socket says 172.21.15.105:54252) 2024-09-21T03:20:41.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.893+0000 7f4dd1250640 1 -- 172.21.15.105:0/2731719762 learned_addr learned my addr 172.21.15.105:0/2731719762 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:41.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.893+0000 7f4dd0a4f640 1 --2- 172.21.15.105:0/2731719762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4dcc0c7390 0x7f4dcc0b5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:41.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.893+0000 7f4dd1a51640 1 --2- 172.21.15.105:0/2731719762 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4dcc0b6490 0x7f4dcc1f6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:41.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.893+0000 7f4dd1250640 1 -- 172.21.15.105:0/2731719762 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4dcc0b6490 msgr2=0x7f4dcc1f6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:41.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.893+0000 7f4dd1250640 1 --2- 172.21.15.105:0/2731719762 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4dcc0b6490 0x7f4dcc1f6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:41.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.893+0000 7f4dd1250640 1 -- 172.21.15.105:0/2731719762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4dcc0c7390 msgr2=0x7f4dcc0b5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:41.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.893+0000 7f4dd1250640 1 --2- 172.21.15.105:0/2731719762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4dcc0c7390 0x7f4dcc0b5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:41.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.893+0000 7f4dd1250640 1 -- 172.21.15.105:0/2731719762 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dcc0b68a0 con 0x7f4db8004800 2024-09-21T03:20:41.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.893+0000 7f4dd0a4f640 1 --2- 172.21.15.105:0/2731719762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4dcc0c7390 0x7f4dcc0b5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:20:41.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.893+0000 7f4dd1250640 1 --2- 172.21.15.105:0/2731719762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4db8004800 0x7f4dcc0b1710 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8003f80 tx=0x7f4dc80016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:41.901 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.894+0000 7f4dc1ffb640 1 -- 172.21.15.105:0/2731719762 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc8015070 con 0x7f4db8004800 2024-09-21T03:20:41.901 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.894+0000 7f4dc1ffb640 1 -- 172.21.15.105:0/2731719762 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4dc8011900 con 0x7f4db8004800 2024-09-21T03:20:41.901 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.894+0000 7f4dd34b4640 1 -- 172.21.15.105:0/2731719762 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dcc0b2730 con 0x7f4db8004800 2024-09-21T03:20:41.901 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.894+0000 7f4dc1ffb640 1 -- 172.21.15.105:0/2731719762 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc8011d10 con 0x7f4db8004800 2024-09-21T03:20:41.901 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.894+0000 7f4dd34b4640 1 -- 172.21.15.105:0/2731719762 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dcc0b29f0 con 0x7f4db8004800 2024-09-21T03:20:41.901 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.895+0000 7f4dd34b4640 1 -- 172.21.15.105:0/2731719762 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dcc15e640 con 0x7f4db8004800 2024-09-21T03:20:41.902 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.896+0000 7f4dc1ffb640 1 -- 172.21.15.105:0/2731719762 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4dc8018070 con 0x7f4db8004800 2024-09-21T03:20:41.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.896+0000 7f4dc1ffb640 1 --2- 172.21.15.105:0/2731719762 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4db0078bc0 0x7f4db007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:41.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.897+0000 7f4dc1ffb640 1 -- 172.21.15.105:0/2731719762 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 4943+0+0 (secure 0 0 0) 0x7f4dc809b7c0 con 0x7f4db8004800 2024-09-21T03:20:41.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.897+0000 7f4dd0a4f640 1 --2- 172.21.15.105:0/2731719762 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4db0078bc0 0x7f4db007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:41.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.897+0000 7f4dd0a4f640 1 --2- 172.21.15.105:0/2731719762 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4db0078bc0 0x7f4db007b0d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc033000 tx=0x7f4dcc15cdb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:41.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:41.901+0000 7f4dc1ffb640 1 -- 172.21.15.105:0/2731719762 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4dcc15e640 con 0x7f4db8004800 2024-09-21T03:20:42.148 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.147+0000 7f4dd34b4640 1 -- 172.21.15.105:0/2731719762 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_blocklisted_oldest_tid"]} v 0) -- 0x7f4dcc15d730 con 0x7f4db8004800 2024-09-21T03:20:42.434 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.432+0000 7f4dc1ffb640 1 -- 172.21.15.105:0/2731719762 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_blocklisted_oldest_tid"]}]=0 v129) ==== 162+0+0 (secure 0 0 0) 0x7f4dcc0b68a0 con 0x7f4db8004800 2024-09-21T03:20:42.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.435+0000 7f4dd34b4640 1 -- 172.21.15.105:0/2731719762 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4db0078bc0 msgr2=0x7f4db007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:42.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.435+0000 7f4dd34b4640 1 --2- 172.21.15.105:0/2731719762 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4db0078bc0 0x7f4db007b0d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc033000 tx=0x7f4dcc15cdb0 comp rx=0 tx=0).stop 2024-09-21T03:20:42.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.435+0000 7f4dd34b4640 1 -- 172.21.15.105:0/2731719762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4db8004800 msgr2=0x7f4dcc0b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:42.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.435+0000 7f4dd34b4640 1 --2- 172.21.15.105:0/2731719762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4db8004800 0x7f4dcc0b1710 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8003f80 tx=0x7f4dc80016f0 comp rx=0 tx=0).stop 2024-09-21T03:20:42.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.435+0000 7f4dd34b4640 1 -- 172.21.15.105:0/2731719762 shutdown_connections 2024-09-21T03:20:42.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.435+0000 7f4dd34b4640 1 --2- 172.21.15.105:0/2731719762 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4db0078bc0 0x7f4db007b0d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:42.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.435+0000 7f4dd34b4640 1 --2- 172.21.15.105:0/2731719762 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4dcc0b6490 0x7f4dcc1f6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:42.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.435+0000 7f4dd34b4640 1 --2- 172.21.15.105:0/2731719762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4dcc0c7390 0x7f4dcc0b5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:42.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.435+0000 7f4dd34b4640 1 --2- 172.21.15.105:0/2731719762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4db8004800 0x7f4dcc0b1710 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:42.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.435+0000 7f4dd34b4640 1 -- 172.21.15.105:0/2731719762 >> 172.21.15.105:0/2731719762 conn(0x7f4dcc0d11f0 msgr2=0x7f4dcc15df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:42.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.435+0000 7f4dd34b4640 1 -- 172.21.15.105:0/2731719762 shutdown_connections 2024-09-21T03:20:42.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.435+0000 7f4dd34b4640 1 -- 172.21.15.105:0/2731719762 wait complete. 2024-09-21T03:20:42.448 INFO:tasks.cephfs_test_runner:that a client is blocklisted when its encoded session metadata exceeds the ... skipped 'Require FUSE client to inject client release failure' 2024-09-21T03:20:42.448 INFO:tasks.cephfs_test_runner:Starting test: test_client_cache_size (tasks.cephfs.test_client_limits.TestClientLimits) 2024-09-21T03:20:42.449 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:20:42.563 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.561+0000 7f8c66694640 1 -- 172.21.15.105:0/1448559607 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c48003a50 msgr2=0x7f8c48003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:42.563 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.561+0000 7f8c66694640 1 --2- 172.21.15.105:0/1448559607 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c48003a50 0x7f8c48003ec0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f8c5000bb20 tx=0x7f8c48005830 comp rx=0 tx=0).stop 2024-09-21T03:20:42.563 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.561+0000 7f8c66694640 1 -- 172.21.15.105:0/1448559607 shutdown_connections 2024-09-21T03:20:42.563 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.561+0000 7f8c66694640 1 --2- 172.21.15.105:0/1448559607 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c48003a50 0x7f8c48003ec0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:42.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.561+0000 7f8c66694640 1 -- 172.21.15.105:0/1448559607 >> 172.21.15.105:0/1448559607 conn(0x7f8c6006d4f0 msgr2=0x7f8c60071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:42.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.561+0000 7f8c66694640 1 -- 172.21.15.105:0/1448559607 shutdown_connections 2024-09-21T03:20:42.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.561+0000 7f8c66694640 1 -- 172.21.15.105:0/1448559607 wait complete. 2024-09-21T03:20:42.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.562+0000 7f8c66694640 1 Processor -- start 2024-09-21T03:20:42.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.563+0000 7f8c66694640 1 -- start start 2024-09-21T03:20:42.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.564+0000 7f8c66694640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c48003a50 0x7f8c6015eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:42.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.564+0000 7f8c66694640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c600aadc0 0x7f8c601f3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:42.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.564+0000 7f8c66694640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c601f41c0 0x7f8c600a94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:42.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.564+0000 7f8c66694640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8c600cec10 con 0x7f8c600aadc0 2024-09-21T03:20:42.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.564+0000 7f8c66694640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8c600cd040 con 0x7f8c48003a50 2024-09-21T03:20:42.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.564+0000 7f8c66694640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8c600ced90 con 0x7f8c601f41c0 2024-09-21T03:20:42.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.564+0000 7f8c5f7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c600aadc0 0x7f8c601f3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:42.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.564+0000 7f8c5f7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c600aadc0 0x7f8c601f3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:54272/0 (socket says 172.21.15.105:54272) 2024-09-21T03:20:42.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.564+0000 7f8c5f7fe640 1 -- 172.21.15.105:0/1740192744 learned_addr learned my addr 172.21.15.105:0/1740192744 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:42.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.564+0000 7f8c64c31640 1 --2- 172.21.15.105:0/1740192744 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c601f41c0 0x7f8c600a94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:42.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.564+0000 7f8c5ffff640 1 --2- 172.21.15.105:0/1740192744 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c48003a50 0x7f8c6015eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:42.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.564+0000 7f8c5f7fe640 1 -- 172.21.15.105:0/1740192744 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c601f41c0 msgr2=0x7f8c600a94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:42.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.564+0000 7f8c5f7fe640 1 --2- 172.21.15.105:0/1740192744 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c601f41c0 0x7f8c600a94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:42.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.564+0000 7f8c5f7fe640 1 -- 172.21.15.105:0/1740192744 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c48003a50 msgr2=0x7f8c6015eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:42.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.564+0000 7f8c5f7fe640 1 --2- 172.21.15.105:0/1740192744 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c48003a50 0x7f8c6015eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:42.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.564+0000 7f8c5f7fe640 1 -- 172.21.15.105:0/1740192744 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c6015d140 con 0x7f8c600aadc0 2024-09-21T03:20:42.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.564+0000 7f8c5ffff640 1 --2- 172.21.15.105:0/1740192744 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c48003a50 0x7f8c6015eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:20:42.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.565+0000 7f8c5f7fe640 1 --2- 172.21.15.105:0/1740192744 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c600aadc0 0x7f8c601f3c80 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f8c54006690 tx=0x7f8c540016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:42.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.565+0000 7f8c5cff9640 1 -- 172.21.15.105:0/1740192744 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c54015070 con 0x7f8c600aadc0 2024-09-21T03:20:42.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.565+0000 7f8c66694640 1 -- 172.21.15.105:0/1740192744 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c6015d420 con 0x7f8c600aadc0 2024-09-21T03:20:42.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.565+0000 7f8c5cff9640 1 -- 172.21.15.105:0/1740192744 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c54011900 con 0x7f8c600aadc0 2024-09-21T03:20:42.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.565+0000 7f8c5cff9640 1 -- 172.21.15.105:0/1740192744 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c54011d30 con 0x7f8c600aadc0 2024-09-21T03:20:42.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.565+0000 7f8c66694640 1 -- 172.21.15.105:0/1740192744 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c600aa210 con 0x7f8c600aadc0 2024-09-21T03:20:42.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.566+0000 7f8c66694640 1 -- 172.21.15.105:0/1740192744 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c600d0050 con 0x7f8c600aadc0 2024-09-21T03:20:42.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.566+0000 7f8c5cff9640 1 -- 172.21.15.105:0/1740192744 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8c54018070 con 0x7f8c600aadc0 2024-09-21T03:20:42.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.567+0000 7f8c5cff9640 1 --2- 172.21.15.105:0/1740192744 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c4c078b90 0x7f8c4c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:42.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.567+0000 7f8c5cff9640 1 -- 172.21.15.105:0/1740192744 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 4943+0+0 (secure 0 0 0) 0x7f8c5409b5c0 con 0x7f8c600aadc0 2024-09-21T03:20:42.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.567+0000 7f8c5ffff640 1 --2- 172.21.15.105:0/1740192744 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c4c078b90 0x7f8c4c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:42.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.568+0000 7f8c5ffff640 1 --2- 172.21.15.105:0/1740192744 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c4c078b90 0x7f8c4c07b0a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8c50036000 tx=0x7f8c500046c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:42.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.571+0000 7f8c5cff9640 1 -- 172.21.15.105:0/1740192744 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8c600d0050 con 0x7f8c600aadc0 2024-09-21T03:20:42.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.749+0000 7f8c66694640 1 -- 172.21.15.105:0/1740192744 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8c600b3d50 con 0x7f8c600aadc0 2024-09-21T03:20:42.751 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.750+0000 7f8c5cff9640 1 -- 172.21.15.105:0/1740192744 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+13106 (secure 0 0 0) 0x7f8c54063750 con 0x7f8c600aadc0 2024-09-21T03:20:42.751 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:20:42.751 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":48,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:20:41.424948+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.105:6833/2865219898":"2024-09-22T03:20:38.312998+0000","172.21.15.105:6832/2865219898":"2024-09-22T03:20:38.312998+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:20:42.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.752+0000 7f8c66694640 1 -- 172.21.15.105:0/1740192744 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c4c078b90 msgr2=0x7f8c4c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:42.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.752+0000 7f8c66694640 1 --2- 172.21.15.105:0/1740192744 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c4c078b90 0x7f8c4c07b0a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8c50036000 tx=0x7f8c500046c0 comp rx=0 tx=0).stop 2024-09-21T03:20:42.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.752+0000 7f8c66694640 1 -- 172.21.15.105:0/1740192744 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c600aadc0 msgr2=0x7f8c601f3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:42.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.752+0000 7f8c66694640 1 --2- 172.21.15.105:0/1740192744 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c600aadc0 0x7f8c601f3c80 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f8c54006690 tx=0x7f8c540016f0 comp rx=0 tx=0).stop 2024-09-21T03:20:42.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.752+0000 7f8c66694640 1 -- 172.21.15.105:0/1740192744 shutdown_connections 2024-09-21T03:20:42.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.752+0000 7f8c66694640 1 --2- 172.21.15.105:0/1740192744 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c4c078b90 0x7f8c4c07b0a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:42.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.752+0000 7f8c66694640 1 --2- 172.21.15.105:0/1740192744 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c601f41c0 0x7f8c600a94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:42.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.752+0000 7f8c66694640 1 --2- 172.21.15.105:0/1740192744 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c600aadc0 0x7f8c601f3c80 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:42.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.752+0000 7f8c66694640 1 --2- 172.21.15.105:0/1740192744 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c48003a50 0x7f8c6015eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:42.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.752+0000 7f8c66694640 1 -- 172.21.15.105:0/1740192744 >> 172.21.15.105:0/1740192744 conn(0x7f8c6006d4f0 msgr2=0x7f8c600b6130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:42.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.752+0000 7f8c66694640 1 -- 172.21.15.105:0/1740192744 shutdown_connections 2024-09-21T03:20:42.755 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.752+0000 7f8c66694640 1 -- 172.21.15.105:0/1740192744 wait complete. 2024-09-21T03:20:42.765 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T03:18:19.296947+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T03:20:42.765 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T03:20:42.882 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.879+0000 7f093d198640 1 -- 172.21.15.105:0/3923681189 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09380b66f0 msgr2=0x7f09380b60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:42.882 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.879+0000 7f093d198640 1 --2- 172.21.15.105:0/3923681189 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09380b66f0 0x7f09380b60b0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0928009820 tx=0x7f092802a510 comp rx=0 tx=0).stop 2024-09-21T03:20:42.882 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.879+0000 7f093d198640 1 -- 172.21.15.105:0/3923681189 shutdown_connections 2024-09-21T03:20:42.882 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.879+0000 7f093d198640 1 --2- 172.21.15.105:0/3923681189 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09380b66f0 0x7f09380b60b0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:42.883 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.879+0000 7f093d198640 1 -- 172.21.15.105:0/3923681189 >> 172.21.15.105:0/3923681189 conn(0x7f09380d12a0 msgr2=0x7f09380d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:42.883 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.879+0000 7f093d198640 1 -- 172.21.15.105:0/3923681189 shutdown_connections 2024-09-21T03:20:42.883 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.879+0000 7f093d198640 1 -- 172.21.15.105:0/3923681189 wait complete. 2024-09-21T03:20:42.890 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.881+0000 7f093d198640 1 Processor -- start 2024-09-21T03:20:42.890 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.881+0000 7f093d198640 1 -- start start 2024-09-21T03:20:42.890 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.882+0000 7f093d198640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09380b40f0 0x7f093809ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:42.890 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.882+0000 7f093d198640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09380b66f0 0x7f09380d0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:42.891 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.882+0000 7f093d198640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09380ce660 0x7f09380cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:42.891 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.882+0000 7f093d198640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f093806d670 con 0x7f09380b66f0 2024-09-21T03:20:42.891 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.882+0000 7f093d198640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f093806d4f0 con 0x7f09380ce660 2024-09-21T03:20:42.891 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.882+0000 7f093d198640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f093806d7f0 con 0x7f09380b40f0 2024-09-21T03:20:42.891 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.883+0000 7f092e59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09380b66f0 0x7f09380d0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:42.891 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.883+0000 7f092e59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09380b66f0 0x7f09380d0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:54296/0 (socket says 172.21.15.105:54296) 2024-09-21T03:20:42.891 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.883+0000 7f092e59c640 1 -- 172.21.15.105:0/1965486363 learned_addr learned my addr 172.21.15.105:0/1965486363 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:42.891 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.883+0000 7f0936d9d640 1 --2- 172.21.15.105:0/1965486363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09380b40f0 0x7f093809ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:42.891 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.883+0000 7f093759e640 1 --2- 172.21.15.105:0/1965486363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09380ce660 0x7f09380cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:42.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.883+0000 7f092e59c640 1 -- 172.21.15.105:0/1965486363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09380b40f0 msgr2=0x7f093809ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:42.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.883+0000 7f092e59c640 1 --2- 172.21.15.105:0/1965486363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09380b40f0 0x7f093809ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:42.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.883+0000 7f092e59c640 1 -- 172.21.15.105:0/1965486363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09380ce660 msgr2=0x7f09380cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:42.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.883+0000 7f092e59c640 1 --2- 172.21.15.105:0/1965486363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09380ce660 0x7f09380cae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:42.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.883+0000 7f092e59c640 1 -- 172.21.15.105:0/1965486363 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09380d0bd0 con 0x7f09380b66f0 2024-09-21T03:20:42.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.883+0000 7f092e59c640 1 --2- 172.21.15.105:0/1965486363 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09380b66f0 0x7f09380d0690 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f092000c3a0 tx=0x7f092000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:42.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.883+0000 7f092ffff640 1 -- 172.21.15.105:0/1965486363 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0920017070 con 0x7f09380b66f0 2024-09-21T03:20:42.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.883+0000 7f092ffff640 1 -- 172.21.15.105:0/1965486363 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f09200053c0 con 0x7f09380b66f0 2024-09-21T03:20:42.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.883+0000 7f093d198640 1 -- 172.21.15.105:0/1965486363 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09380c89a0 con 0x7f09380b66f0 2024-09-21T03:20:42.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.883+0000 7f092ffff640 1 -- 172.21.15.105:0/1965486363 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0920003850 con 0x7f09380b66f0 2024-09-21T03:20:42.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.883+0000 7f093d198640 1 -- 172.21.15.105:0/1965486363 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09380ca3b0 con 0x7f09380b66f0 2024-09-21T03:20:42.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.884+0000 7f093d198640 1 -- 172.21.15.105:0/1965486363 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09380c8710 con 0x7f09380b66f0 2024-09-21T03:20:42.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.885+0000 7f092ffff640 1 -- 172.21.15.105:0/1965486363 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f092001a070 con 0x7f09380b66f0 2024-09-21T03:20:42.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.886+0000 7f092ffff640 1 --2- 172.21.15.105:0/1965486363 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0918078bc0 0x7f091807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:42.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.886+0000 7f092ffff640 1 -- 172.21.15.105:0/1965486363 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 4943+0+0 (secure 0 0 0) 0x7f0920099d20 con 0x7f09380b66f0 2024-09-21T03:20:42.894 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.886+0000 7f0936d9d640 1 --2- 172.21.15.105:0/1965486363 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0918078bc0 0x7f091807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:42.894 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.886+0000 7f0936d9d640 1 --2- 172.21.15.105:0/1965486363 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0918078bc0 0x7f091807b0d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0928034000 tx=0x7f0928004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:42.894 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:42.890+0000 7f092ffff640 1 -- 172.21.15.105:0/1965486363 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f09200624f0 con 0x7f09380b66f0 2024-09-21T03:20:43.068 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.067+0000 7f093d198640 1 -- 172.21.15.105:0/1965486363 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f09380b60b0 con 0x7f09380b66f0 2024-09-21T03:20:43.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.067+0000 7f092ffff640 1 -- 172.21.15.105:0/1965486363 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v48) ==== 93+0+10 (secure 0 0 0) 0x7f0920061df0 con 0x7f09380b66f0 2024-09-21T03:20:43.069 INFO:teuthology.orchestra.run.smithi105.stdout:pg_num: 1 2024-09-21T03:20:43.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.069+0000 7f093d198640 1 -- 172.21.15.105:0/1965486363 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0918078bc0 msgr2=0x7f091807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:43.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.069+0000 7f093d198640 1 --2- 172.21.15.105:0/1965486363 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0918078bc0 0x7f091807b0d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0928034000 tx=0x7f0928004730 comp rx=0 tx=0).stop 2024-09-21T03:20:43.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.069+0000 7f093d198640 1 -- 172.21.15.105:0/1965486363 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09380b66f0 msgr2=0x7f09380d0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:43.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.069+0000 7f093d198640 1 --2- 172.21.15.105:0/1965486363 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09380b66f0 0x7f09380d0690 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f092000c3a0 tx=0x7f092000c860 comp rx=0 tx=0).stop 2024-09-21T03:20:43.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.069+0000 7f093d198640 1 -- 172.21.15.105:0/1965486363 shutdown_connections 2024-09-21T03:20:43.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.069+0000 7f093d198640 1 --2- 172.21.15.105:0/1965486363 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0918078bc0 0x7f091807b0d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:43.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.069+0000 7f093d198640 1 --2- 172.21.15.105:0/1965486363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09380ce660 0x7f09380cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:43.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.069+0000 7f093d198640 1 --2- 172.21.15.105:0/1965486363 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09380b66f0 0x7f09380d0690 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:43.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.069+0000 7f093d198640 1 --2- 172.21.15.105:0/1965486363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09380b40f0 0x7f093809ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:43.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.069+0000 7f093d198640 1 -- 172.21.15.105:0/1965486363 >> 172.21.15.105:0/1965486363 conn(0x7f09380d12a0 msgr2=0x7f0938068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:43.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.070+0000 7f093d198640 1 -- 172.21.15.105:0/1965486363 shutdown_connections 2024-09-21T03:20:43.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.070+0000 7f093d198640 1 -- 172.21.15.105:0/1965486363 wait complete. 2024-09-21T03:20:43.082 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_cache_size' 2024-09-21T03:20:43.195 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.193+0000 7fa3cd427640 1 -- 172.21.15.105:0/3764823767 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3c806e170 msgr2=0x7fa3c80b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:43.195 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.193+0000 7fa3cd427640 1 --2- 172.21.15.105:0/3764823767 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3c806e170 0x7fa3c80b3540 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa3c808d9b0 tx=0x7fa3b802a4d0 comp rx=0 tx=0).stop 2024-09-21T03:20:43.196 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.193+0000 7fa3cd427640 1 -- 172.21.15.105:0/3764823767 shutdown_connections 2024-09-21T03:20:43.196 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.193+0000 7fa3cd427640 1 --2- 172.21.15.105:0/3764823767 >> v2:172.21.15.162:3300/0 conn(0x7fa3c806f4b0 0x7fa3c80d3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:43.196 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.193+0000 7fa3cd427640 1 --2- 172.21.15.105:0/3764823767 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3c806e170 0x7fa3c80b3540 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:43.196 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.193+0000 7fa3cd427640 1 -- 172.21.15.105:0/3764823767 >> 172.21.15.105:0/3764823767 conn(0x7fa3c808bfc0 msgr2=0x7fa3c809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:43.196 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.193+0000 7fa3cd427640 1 -- 172.21.15.105:0/3764823767 shutdown_connections 2024-09-21T03:20:43.196 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.193+0000 7fa3cd427640 1 -- 172.21.15.105:0/3764823767 wait complete. 2024-09-21T03:20:43.199 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.194+0000 7fa3cd427640 1 Processor -- start 2024-09-21T03:20:43.199 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.195+0000 7fa3cd427640 1 -- start start 2024-09-21T03:20:43.199 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.196+0000 7fa3cd427640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3c806f4b0 0x7fa3c81f97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:43.199 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.196+0000 7fa3cd427640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3c80d3870 0x7fa3c80cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:43.199 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.196+0000 7fa3cd427640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3c80caa70 0x7fa3c80b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:43.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.196+0000 7fa3cd427640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c80d0ce0 con 0x7fa3c80d3870 2024-09-21T03:20:43.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.196+0000 7fa3cd427640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c80cf4e0 con 0x7fa3c806f4b0 2024-09-21T03:20:43.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.196+0000 7fa3cd427640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa3c80d0e60 con 0x7fa3c80caa70 2024-09-21T03:20:43.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.196+0000 7fa3c67fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3c80d3870 0x7fa3c80cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:43.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.196+0000 7fa3c67fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3c80d3870 0x7fa3c80cdd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:54320/0 (socket says 172.21.15.105:54320) 2024-09-21T03:20:43.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.196+0000 7fa3c67fc640 1 -- 172.21.15.105:0/391521596 learned_addr learned my addr 172.21.15.105:0/391521596 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:43.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.196+0000 7fa3c6ffd640 1 --2- 172.21.15.105:0/391521596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3c806f4b0 0x7fa3c81f97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:43.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.196+0000 7fa3c77fe640 1 --2- 172.21.15.105:0/391521596 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3c80caa70 0x7fa3c80b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:43.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.196+0000 7fa3c67fc640 1 -- 172.21.15.105:0/391521596 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3c80caa70 msgr2=0x7fa3c80b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:43.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.196+0000 7fa3c67fc640 1 --2- 172.21.15.105:0/391521596 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3c80caa70 0x7fa3c80b4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:43.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.196+0000 7fa3c67fc640 1 -- 172.21.15.105:0/391521596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3c806f4b0 msgr2=0x7fa3c81f97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:43.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.196+0000 7fa3c67fc640 1 --2- 172.21.15.105:0/391521596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3c806f4b0 0x7fa3c81f97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:43.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.196+0000 7fa3c67fc640 1 -- 172.21.15.105:0/391521596 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3c81e84e0 con 0x7fa3c80d3870 2024-09-21T03:20:43.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.196+0000 7fa3c67fc640 1 --2- 172.21.15.105:0/391521596 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3c80d3870 0x7fa3c80cdd10 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc00d6a0 tx=0x7fa3bc00db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:43.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.197+0000 7fa3af7fe640 1 -- 172.21.15.105:0/391521596 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc017070 con 0x7fa3c80d3870 2024-09-21T03:20:43.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.197+0000 7fa3af7fe640 1 -- 172.21.15.105:0/391521596 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa3bc009b10 con 0x7fa3c80d3870 2024-09-21T03:20:43.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.197+0000 7fa3cd427640 1 -- 172.21.15.105:0/391521596 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3c81e87c0 con 0x7fa3c80d3870 2024-09-21T03:20:43.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.197+0000 7fa3af7fe640 1 -- 172.21.15.105:0/391521596 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc010460 con 0x7fa3c80d3870 2024-09-21T03:20:43.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.197+0000 7fa3cd427640 1 -- 172.21.15.105:0/391521596 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3c81e8d80 con 0x7fa3c80d3870 2024-09-21T03:20:43.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.198+0000 7fa3cd427640 1 -- 172.21.15.105:0/391521596 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3c806e170 con 0x7fa3c80d3870 2024-09-21T03:20:43.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.198+0000 7fa3af7fe640 1 -- 172.21.15.105:0/391521596 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa3bc01a070 con 0x7fa3c80d3870 2024-09-21T03:20:43.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.199+0000 7fa3af7fe640 1 --2- 172.21.15.105:0/391521596 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa3b4078b90 0x7fa3b407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:43.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.199+0000 7fa3af7fe640 1 -- 172.21.15.105:0/391521596 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 4943+0+0 (secure 0 0 0) 0x7fa3bc09a9a0 con 0x7fa3c80d3870 2024-09-21T03:20:43.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.199+0000 7fa3c6ffd640 1 --2- 172.21.15.105:0/391521596 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa3b4078b90 0x7fa3b407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:43.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.200+0000 7fa3c6ffd640 1 --2- 172.21.15.105:0/391521596 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa3b4078b90 0x7fa3b407b0a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8034000 tx=0x7fa3b8004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:43.205 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.203+0000 7fa3af7fe640 1 -- 172.21.15.105:0/391521596 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa3bc062bb0 con 0x7fa3c80d3870 2024-09-21T03:20:43.450 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:43.448+0000 7fa3cd427640 1 -- 172.21.15.105:0/391521596 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_cache_size"]} v 0) -- 0x7fa3c80d15d0 con 0x7fa3c80d3870 2024-09-21T03:20:44.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.441+0000 7fa3af7fe640 1 -- 172.21.15.105:0/391521596 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_cache_size"]}]=0 v131) ==== 153+0+0 (secure 0 0 0) 0x7fa3bc0675e0 con 0x7fa3c80d3870 2024-09-21T03:20:44.445 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.444+0000 7fa3cd427640 1 -- 172.21.15.105:0/391521596 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa3b4078b90 msgr2=0x7fa3b407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:44.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.444+0000 7fa3cd427640 1 --2- 172.21.15.105:0/391521596 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa3b4078b90 0x7fa3b407b0a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8034000 tx=0x7fa3b8004730 comp rx=0 tx=0).stop 2024-09-21T03:20:44.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.444+0000 7fa3cd427640 1 -- 172.21.15.105:0/391521596 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3c80d3870 msgr2=0x7fa3c80cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:44.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.444+0000 7fa3cd427640 1 --2- 172.21.15.105:0/391521596 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3c80d3870 0x7fa3c80cdd10 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc00d6a0 tx=0x7fa3bc00db60 comp rx=0 tx=0).stop 2024-09-21T03:20:44.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.444+0000 7fa3cd427640 1 -- 172.21.15.105:0/391521596 shutdown_connections 2024-09-21T03:20:44.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.444+0000 7fa3cd427640 1 --2- 172.21.15.105:0/391521596 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa3b4078b90 0x7fa3b407b0a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:44.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.444+0000 7fa3cd427640 1 --2- 172.21.15.105:0/391521596 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3c80caa70 0x7fa3c80b4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:44.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.444+0000 7fa3cd427640 1 --2- 172.21.15.105:0/391521596 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3c80d3870 0x7fa3c80cdd10 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:44.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.444+0000 7fa3cd427640 1 --2- 172.21.15.105:0/391521596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3c806f4b0 0x7fa3c81f97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:44.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.444+0000 7fa3cd427640 1 -- 172.21.15.105:0/391521596 >> 172.21.15.105:0/391521596 conn(0x7fa3c808bfc0 msgr2=0x7fa3c80b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:44.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.444+0000 7fa3cd427640 1 -- 172.21.15.105:0/391521596 shutdown_connections 2024-09-21T03:20:44.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.444+0000 7fa3cd427640 1 -- 172.21.15.105:0/391521596 wait complete. 2024-09-21T03:20:44.459 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T03:20:44.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.574+0000 7fcbb5cde640 1 -- 172.21.15.105:0/830959810 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbb00cf320 msgr2=0x7fcbb00ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:44.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.574+0000 7fcbb5cde640 1 --2- 172.21.15.105:0/830959810 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbb00cf320 0x7fcbb00ccbc0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fcba4009830 tx=0x7fcba402a510 comp rx=0 tx=0).stop 2024-09-21T03:20:44.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.574+0000 7fcbb5cde640 1 -- 172.21.15.105:0/830959810 shutdown_connections 2024-09-21T03:20:44.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.574+0000 7fcbb5cde640 1 --2- 172.21.15.105:0/830959810 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbb00cf320 0x7fcbb00ccbc0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:44.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.574+0000 7fcbb5cde640 1 -- 172.21.15.105:0/830959810 >> 172.21.15.105:0/830959810 conn(0x7fcbb006d4f0 msgr2=0x7fcbb0071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:44.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.574+0000 7fcbb5cde640 1 -- 172.21.15.105:0/830959810 shutdown_connections 2024-09-21T03:20:44.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.574+0000 7fcbb5cde640 1 -- 172.21.15.105:0/830959810 wait complete. 2024-09-21T03:20:44.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.575+0000 7fcbb5cde640 1 Processor -- start 2024-09-21T03:20:44.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.576+0000 7fcbb5cde640 1 -- start start 2024-09-21T03:20:44.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.577+0000 7fcbb5cde640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbb00b7cc0 0x7fcbb0155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:44.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.577+0000 7fcbb5cde640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbb00cf320 0x7fcbb0158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:44.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.577+0000 7fcbb5cde640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbb01600b0 0x7fcbb0158990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:44.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.577+0000 7fcbb5cde640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb00d15b0 con 0x7fcbb01600b0 2024-09-21T03:20:44.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.577+0000 7fcbb5cde640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb00d1430 con 0x7fcbb00cf320 2024-09-21T03:20:44.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.577+0000 7fcbb5cde640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcbb00d1730 con 0x7fcbb00b7cc0 2024-09-21T03:20:44.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.577+0000 7fcbaffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbb01600b0 0x7fcbb0158990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:44.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.577+0000 7fcbaffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbb01600b0 0x7fcbb0158990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:54344/0 (socket says 172.21.15.105:54344) 2024-09-21T03:20:44.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.577+0000 7fcbaffff640 1 -- 172.21.15.105:0/928876143 learned_addr learned my addr 172.21.15.105:0/928876143 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:44.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.577+0000 7fcbaeffd640 1 --2- 172.21.15.105:0/928876143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbb00cf320 0x7fcbb0158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:44.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.577+0000 7fcbaf7fe640 1 --2- 172.21.15.105:0/928876143 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbb00b7cc0 0x7fcbb0155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:44.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.577+0000 7fcbaffff640 1 -- 172.21.15.105:0/928876143 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbb00b7cc0 msgr2=0x7fcbb0155550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:44.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.577+0000 7fcbaffff640 1 --2- 172.21.15.105:0/928876143 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbb00b7cc0 0x7fcbb0155550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:44.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.577+0000 7fcbaffff640 1 -- 172.21.15.105:0/928876143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbb00cf320 msgr2=0x7fcbb0158450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:44.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.577+0000 7fcbaffff640 1 --2- 172.21.15.105:0/928876143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbb00cf320 0x7fcbb0158450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:44.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.577+0000 7fcbaffff640 1 -- 172.21.15.105:0/928876143 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbb00b3b00 con 0x7fcbb01600b0 2024-09-21T03:20:44.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.577+0000 7fcbaeffd640 1 --2- 172.21.15.105:0/928876143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbb00cf320 0x7fcbb0158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:20:44.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.577+0000 7fcbaffff640 1 --2- 172.21.15.105:0/928876143 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbb01600b0 0x7fcbb0158990 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fcba800b9e0 tx=0x7fcba800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:44.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.578+0000 7fcb97fff640 1 -- 172.21.15.105:0/928876143 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba8003b70 con 0x7fcbb01600b0 2024-09-21T03:20:44.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.578+0000 7fcb97fff640 1 -- 172.21.15.105:0/928876143 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcba8003e00 con 0x7fcbb01600b0 2024-09-21T03:20:44.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.578+0000 7fcbb5cde640 1 -- 172.21.15.105:0/928876143 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbb00b3de0 con 0x7fcbb01600b0 2024-09-21T03:20:44.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.578+0000 7fcb97fff640 1 -- 172.21.15.105:0/928876143 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba800cb80 con 0x7fcbb01600b0 2024-09-21T03:20:44.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.578+0000 7fcbb5cde640 1 -- 172.21.15.105:0/928876143 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbb00c9420 con 0x7fcbb01600b0 2024-09-21T03:20:44.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.579+0000 7fcbb5cde640 1 -- 172.21.15.105:0/928876143 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbb00d0050 con 0x7fcbb01600b0 2024-09-21T03:20:44.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.579+0000 7fcb97fff640 1 -- 172.21.15.105:0/928876143 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcba8004000 con 0x7fcbb01600b0 2024-09-21T03:20:44.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.580+0000 7fcb97fff640 1 --2- 172.21.15.105:0/928876143 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcb9c078b90 0x7fcb9c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:44.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.580+0000 7fcb97fff640 1 -- 172.21.15.105:0/928876143 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 4943+0+0 (secure 0 0 0) 0x7fcba809a8c0 con 0x7fcbb01600b0 2024-09-21T03:20:44.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.580+0000 7fcbaf7fe640 1 --2- 172.21.15.105:0/928876143 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcb9c078b90 0x7fcb9c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:44.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.581+0000 7fcbaf7fe640 1 --2- 172.21.15.105:0/928876143 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcb9c078b90 0x7fcb9c07b0a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fcba0007fd0 tx=0x7fcba0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:44.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.584+0000 7fcb97fff640 1 -- 172.21.15.105:0/928876143 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fcbb00d0050 con 0x7fcbb01600b0 2024-09-21T03:20:44.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.760+0000 7fcbb5cde640 1 -- 172.21.15.105:0/928876143 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fcbb00ccbc0 con 0x7fcbb01600b0 2024-09-21T03:20:44.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.761+0000 7fcb97fff640 1 -- 172.21.15.105:0/928876143 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v37) ==== 59+0+2294 (secure 0 0 0) 0x7fcba8063000 con 0x7fcbb01600b0 2024-09-21T03:20:44.762 INFO:teuthology.orchestra.run.smithi105.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T03:20:44.762 INFO:teuthology.orchestra.run.smithi105.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T03:20:44.763 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced client_mount_timeout 30 2024-09-21T03:20:44.763 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced debug_client 20/20 2024-09-21T03:20:44.763 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced debug_mgr 20/20 2024-09-21T03:20:44.763 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced debug_ms 1/1 2024-09-21T03:20:44.763 INFO:teuthology.orchestra.run.smithi105.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T03:20:44.763 INFO:teuthology.orchestra.run.smithi105.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T03:20:44.763 INFO:teuthology.orchestra.run.smithi105.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 7291.545169 2024-09-21T03:20:44.763 INFO:teuthology.orchestra.run.smithi105.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5080.142035 2024-09-21T03:20:44.763 INFO:teuthology.orchestra.run.smithi105.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5120.988640 2024-09-21T03:20:44.763 INFO:teuthology.orchestra.run.smithi105.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4938.196268 2024-09-21T03:20:44.763 INFO:teuthology.orchestra.run.smithi105.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4906.316728 2024-09-21T03:20:44.763 INFO:teuthology.orchestra.run.smithi105.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4701.273858 2024-09-21T03:20:44.763 INFO:teuthology.orchestra.run.smithi105.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4947.710044 2024-09-21T03:20:44.763 INFO:teuthology.orchestra.run.smithi105.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5174.949063 2024-09-21T03:20:44.764 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced debug_mds 20/20 2024-09-21T03:20:44.764 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T03:20:44.764 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced debug_ms 2/2 2024-09-21T03:20:44.764 INFO:teuthology.orchestra.run.smithi105.stdout:mds dev mds_debug_frag true 2024-09-21T03:20:44.764 INFO:teuthology.orchestra.run.smithi105.stdout:mds dev mds_debug_scatterstat true 2024-09-21T03:20:44.764 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T03:20:44.764 INFO:teuthology.orchestra.run.smithi105.stdout:mds dev mds_verify_scatter true 2024-09-21T03:20:44.764 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T03:20:44.764 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T03:20:44.764 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T03:20:44.764 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced client_mount_timeout 600 2024-09-21T03:20:44.764 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced debug_client 20/20 2024-09-21T03:20:44.764 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced debug_ms 1/1 2024-09-21T03:20:44.764 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T03:20:44.765 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T03:20:44.766 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.763+0000 7fcbb5cde640 1 -- 172.21.15.105:0/928876143 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcb9c078b90 msgr2=0x7fcb9c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:44.766 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.763+0000 7fcbb5cde640 1 --2- 172.21.15.105:0/928876143 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcb9c078b90 0x7fcb9c07b0a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fcba0007fd0 tx=0x7fcba0009040 comp rx=0 tx=0).stop 2024-09-21T03:20:44.766 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.763+0000 7fcbb5cde640 1 -- 172.21.15.105:0/928876143 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbb01600b0 msgr2=0x7fcbb0158990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:44.766 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.763+0000 7fcbb5cde640 1 --2- 172.21.15.105:0/928876143 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbb01600b0 0x7fcbb0158990 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fcba800b9e0 tx=0x7fcba800bea0 comp rx=0 tx=0).stop 2024-09-21T03:20:44.766 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.763+0000 7fcbb5cde640 1 -- 172.21.15.105:0/928876143 shutdown_connections 2024-09-21T03:20:44.766 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.763+0000 7fcbb5cde640 1 --2- 172.21.15.105:0/928876143 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcb9c078b90 0x7fcb9c07b0a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:44.766 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.763+0000 7fcbb5cde640 1 --2- 172.21.15.105:0/928876143 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbb01600b0 0x7fcbb0158990 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:44.767 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.763+0000 7fcbb5cde640 1 --2- 172.21.15.105:0/928876143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbb00cf320 0x7fcbb0158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:44.767 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.763+0000 7fcbb5cde640 1 --2- 172.21.15.105:0/928876143 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbb00b7cc0 0x7fcbb0155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:44.767 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.763+0000 7fcbb5cde640 1 -- 172.21.15.105:0/928876143 >> 172.21.15.105:0/928876143 conn(0x7fcbb006d4f0 msgr2=0x7fcbb015a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:44.767 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.763+0000 7fcbb5cde640 1 -- 172.21.15.105:0/928876143 shutdown_connections 2024-09-21T03:20:44.767 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.763+0000 7fcbb5cde640 1 -- 172.21.15.105:0/928876143 wait complete. 2024-09-21T03:20:44.776 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T03:20:44.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.890+0000 7f30358bd640 1 -- 172.21.15.105:0/1856502745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30300ceb40 msgr2=0x7f30300cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:44.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.890+0000 7f30358bd640 1 --2- 172.21.15.105:0/1856502745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30300ceb40 0x7f30300cef50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f30300ba090 tx=0x7f302802a9a0 comp rx=0 tx=0).stop 2024-09-21T03:20:44.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.891+0000 7f30358bd640 1 -- 172.21.15.105:0/1856502745 shutdown_connections 2024-09-21T03:20:44.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.891+0000 7f30358bd640 1 --2- 172.21.15.105:0/1856502745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30300ceb40 0x7f30300cef50 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:44.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.891+0000 7f30358bd640 1 --2- 172.21.15.105:0/1856502745 >> v2:172.21.15.162:3300/0 conn(0x7f303006e170 0x7f30300b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:44.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.891+0000 7f30358bd640 1 -- 172.21.15.105:0/1856502745 >> 172.21.15.105:0/1856502745 conn(0x7f303008bfc0 msgr2=0x7f303009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:44.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.891+0000 7f30358bd640 1 -- 172.21.15.105:0/1856502745 shutdown_connections 2024-09-21T03:20:44.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.891+0000 7f30358bd640 1 -- 172.21.15.105:0/1856502745 wait complete. 2024-09-21T03:20:44.894 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.892+0000 7f30358bd640 1 Processor -- start 2024-09-21T03:20:44.894 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.893+0000 7f30358bd640 1 -- start start 2024-09-21T03:20:44.896 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.894+0000 7f30358bd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f303006f4b0 0x7f303015c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:44.897 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.894+0000 7f30358bd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30300ceb40 0x7f30301f8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:44.897 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.894+0000 7f30358bd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30301f8fa0 0x7f30301608d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:44.897 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.894+0000 7f30358bd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f30300d0e60 con 0x7f30301f8fa0 2024-09-21T03:20:44.897 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.894+0000 7f30358bd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f30300d0ce0 con 0x7f30300ceb40 2024-09-21T03:20:44.897 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.894+0000 7f30358bd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f30300d0fe0 con 0x7f303006f4b0 2024-09-21T03:20:44.897 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.894+0000 7f302f7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30301f8fa0 0x7f30301608d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:44.897 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.894+0000 7f302f7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30301f8fa0 0x7f30301608d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:54368/0 (socket says 172.21.15.105:54368) 2024-09-21T03:20:44.897 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.894+0000 7f302f7fe640 1 -- 172.21.15.105:0/602321858 learned_addr learned my addr 172.21.15.105:0/602321858 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:44.897 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.894+0000 7f302e7fc640 1 --2- 172.21.15.105:0/602321858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30300ceb40 0x7f30301f8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:44.897 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.894+0000 7f302effd640 1 --2- 172.21.15.105:0/602321858 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f303006f4b0 0x7f303015c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:44.897 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.894+0000 7f302f7fe640 1 -- 172.21.15.105:0/602321858 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f303006f4b0 msgr2=0x7f303015c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:44.897 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.894+0000 7f302f7fe640 1 --2- 172.21.15.105:0/602321858 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f303006f4b0 0x7f303015c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:44.897 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.894+0000 7f302f7fe640 1 -- 172.21.15.105:0/602321858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30300ceb40 msgr2=0x7f30301f8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:44.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.894+0000 7f302f7fe640 1 --2- 172.21.15.105:0/602321858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30300ceb40 0x7f30301f8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:44.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.894+0000 7f302f7fe640 1 -- 172.21.15.105:0/602321858 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30301f5450 con 0x7f30301f8fa0 2024-09-21T03:20:44.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.894+0000 7f302f7fe640 1 --2- 172.21.15.105:0/602321858 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30301f8fa0 0x7f30301608d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f3028033040 tx=0x7f3028031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:44.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.895+0000 7f3017fff640 1 -- 172.21.15.105:0/602321858 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3028034040 con 0x7f30301f8fa0 2024-09-21T03:20:44.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.895+0000 7f3017fff640 1 -- 172.21.15.105:0/602321858 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3028004340 con 0x7f30301f8fa0 2024-09-21T03:20:44.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.895+0000 7f30358bd640 1 -- 172.21.15.105:0/602321858 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30301f5730 con 0x7f30301f8fa0 2024-09-21T03:20:44.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.895+0000 7f3017fff640 1 -- 172.21.15.105:0/602321858 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30280046f0 con 0x7f30301f8fa0 2024-09-21T03:20:44.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.895+0000 7f30358bd640 1 -- 172.21.15.105:0/602321858 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30301f5cf0 con 0x7f30301f8fa0 2024-09-21T03:20:44.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.896+0000 7f30358bd640 1 -- 172.21.15.105:0/602321858 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30301f9500 con 0x7f30301f8fa0 2024-09-21T03:20:44.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.897+0000 7f3017fff640 1 -- 172.21.15.105:0/602321858 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3028037020 con 0x7f30301f8fa0 2024-09-21T03:20:44.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.897+0000 7f3017fff640 1 --2- 172.21.15.105:0/602321858 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f301c078bc0 0x7f301c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:44.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.897+0000 7f3017fff640 1 -- 172.21.15.105:0/602321858 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 4943+0+0 (secure 0 0 0) 0x7f30280bc060 con 0x7f30301f8fa0 2024-09-21T03:20:44.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.897+0000 7f302effd640 1 --2- 172.21.15.105:0/602321858 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f301c078bc0 0x7f301c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:44.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.898+0000 7f302effd640 1 --2- 172.21.15.105:0/602321858 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f301c078bc0 0x7f301c07b0d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f302000bb50 tx=0x7f302000b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:44.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:44.902+0000 7f3017fff640 1 -- 172.21.15.105:0/602321858 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f30280840d0 con 0x7f30301f8fa0 2024-09-21T03:20:45.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.079+0000 7f30358bd640 1 -- 172.21.15.105:0/602321858 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f30300d1570 con 0x7f30301f8fa0 2024-09-21T03:20:45.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.083+0000 7f3017fff640 1 -- 172.21.15.105:0/602321858 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v38)=0 v38) ==== 122+0+0 (secure 0 0 0) 0x7f3028088b00 con 0x7f30301f8fa0 2024-09-21T03:20:45.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.086+0000 7f30358bd640 1 -- 172.21.15.105:0/602321858 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f301c078bc0 msgr2=0x7f301c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:45.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.086+0000 7f30358bd640 1 --2- 172.21.15.105:0/602321858 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f301c078bc0 0x7f301c07b0d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f302000bb50 tx=0x7f302000b2e0 comp rx=0 tx=0).stop 2024-09-21T03:20:45.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.086+0000 7f30358bd640 1 -- 172.21.15.105:0/602321858 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30301f8fa0 msgr2=0x7f30301608d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:45.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.086+0000 7f30358bd640 1 --2- 172.21.15.105:0/602321858 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30301f8fa0 0x7f30301608d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f3028033040 tx=0x7f3028031ee0 comp rx=0 tx=0).stop 2024-09-21T03:20:45.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.086+0000 7f30358bd640 1 -- 172.21.15.105:0/602321858 shutdown_connections 2024-09-21T03:20:45.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.086+0000 7f30358bd640 1 --2- 172.21.15.105:0/602321858 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f301c078bc0 0x7f301c07b0d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:45.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.086+0000 7f30358bd640 1 --2- 172.21.15.105:0/602321858 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30301f8fa0 0x7f30301608d0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:45.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.086+0000 7f30358bd640 1 --2- 172.21.15.105:0/602321858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30300ceb40 0x7f30301f8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:45.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.086+0000 7f30358bd640 1 --2- 172.21.15.105:0/602321858 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f303006f4b0 0x7f303015c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:45.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.086+0000 7f30358bd640 1 -- 172.21.15.105:0/602321858 >> 172.21.15.105:0/602321858 conn(0x7f303008bfc0 msgr2=0x7f30300b1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:45.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.086+0000 7f30358bd640 1 -- 172.21.15.105:0/602321858 shutdown_connections 2024-09-21T03:20:45.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.086+0000 7f30358bd640 1 -- 172.21.15.105:0/602321858 wait complete. 2024-09-21T03:20:45.098 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T03:20:45.099 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T03:20:45.142 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T03:20:45.187 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T03:20:45.187 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:20:45.187 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:20:45.202 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T03:20:45.203 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:20:45.203 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:20:45.221 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=452 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T03:20:45.221 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:20:45.222 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:20:45.259 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T03:20:45.259 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:20:45.259 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:20:45.279 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=452 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T03:20:45.279 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T03:20:45.279 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:20:45.411 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.410+0000 7ff4c7fff640 1 -- 172.21.15.105:0/908910773 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4c80cd860 msgr2=0x7ff4c80b4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:45.412 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.410+0000 7ff4c7fff640 1 --2- 172.21.15.105:0/908910773 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4c80cd860 0x7ff4c80b4700 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8005fd0 tx=0x7ff4b802aa10 comp rx=0 tx=0).stop 2024-09-21T03:20:45.412 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.410+0000 7ff4c7fff640 1 -- 172.21.15.105:0/908910773 shutdown_connections 2024-09-21T03:20:45.412 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.410+0000 7ff4c7fff640 1 --2- 172.21.15.105:0/908910773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4c809aa30 0x7ff4c809ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:45.412 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.410+0000 7ff4c7fff640 1 --2- 172.21.15.105:0/908910773 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4c80cd860 0x7ff4c80b4700 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:45.412 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.410+0000 7ff4c7fff640 1 -- 172.21.15.105:0/908910773 >> 172.21.15.105:0/908910773 conn(0x7ff4c80b3be0 msgr2=0x7ff4c80b3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:45.412 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.410+0000 7ff4c7fff640 1 -- 172.21.15.105:0/908910773 shutdown_connections 2024-09-21T03:20:45.412 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.410+0000 7ff4c7fff640 1 -- 172.21.15.105:0/908910773 wait complete. 2024-09-21T03:20:45.413 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.412+0000 7ff4c7fff640 1 Processor -- start 2024-09-21T03:20:45.413 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.412+0000 7ff4c7fff640 1 -- start start 2024-09-21T03:20:45.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.413+0000 7ff4c7fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4c809aa30 0x7ff4c81f3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:45.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.413+0000 7ff4c7fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4c80b6e20 0x7ff4c8156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:45.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.413+0000 7ff4c7fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4c80cd860 0x7ff4c809be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:45.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.413+0000 7ff4c7fff640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c80d0a60 con 0x7ff4c809aa30 2024-09-21T03:20:45.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.413+0000 7ff4c7fff640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c80d08e0 con 0x7ff4c80cd860 2024-09-21T03:20:45.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.413+0000 7ff4c7fff640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff4c80d0be0 con 0x7ff4c80b6e20 2024-09-21T03:20:45.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.413+0000 7ff4c6ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4c809aa30 0x7ff4c81f3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:45.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.413+0000 7ff4c6ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4c809aa30 0x7ff4c81f3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:54388/0 (socket says 172.21.15.105:54388) 2024-09-21T03:20:45.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.413+0000 7ff4c6ffd640 1 -- 172.21.15.105:0/1116336684 learned_addr learned my addr 172.21.15.105:0/1116336684 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:45.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.413+0000 7ff4c77fe640 1 --2- 172.21.15.105:0/1116336684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4c80cd860 0x7ff4c809be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:45.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.413+0000 7ff4c67fc640 1 --2- 172.21.15.105:0/1116336684 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4c80b6e20 0x7ff4c8156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:45.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.413+0000 7ff4c6ffd640 1 -- 172.21.15.105:0/1116336684 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4c80b6e20 msgr2=0x7ff4c8156860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:45.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.413+0000 7ff4c6ffd640 1 --2- 172.21.15.105:0/1116336684 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4c80b6e20 0x7ff4c8156860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:45.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.413+0000 7ff4c6ffd640 1 -- 172.21.15.105:0/1116336684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4c80cd860 msgr2=0x7ff4c809be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:45.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.413+0000 7ff4c6ffd640 1 --2- 172.21.15.105:0/1116336684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4c80cd860 0x7ff4c809be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:45.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.413+0000 7ff4c6ffd640 1 -- 172.21.15.105:0/1116336684 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c8158a60 con 0x7ff4c809aa30 2024-09-21T03:20:45.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.413+0000 7ff4c77fe640 1 --2- 172.21.15.105:0/1116336684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4c80cd860 0x7ff4c809be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:20:45.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.413+0000 7ff4c6ffd640 1 --2- 172.21.15.105:0/1116336684 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4c809aa30 0x7ff4c81f3b80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8006010 tx=0x7ff4b8003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:45.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.414+0000 7ff4af7fe640 1 -- 172.21.15.105:0/1116336684 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b8033050 con 0x7ff4c809aa30 2024-09-21T03:20:45.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.414+0000 7ff4af7fe640 1 -- 172.21.15.105:0/1116336684 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4b8004b40 con 0x7ff4c809aa30 2024-09-21T03:20:45.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.414+0000 7ff4c7fff640 1 -- 172.21.15.105:0/1116336684 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4c8158d40 con 0x7ff4c809aa30 2024-09-21T03:20:45.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.414+0000 7ff4af7fe640 1 -- 172.21.15.105:0/1116336684 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b80042d0 con 0x7ff4c809aa30 2024-09-21T03:20:45.418 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.414+0000 7ff4c7fff640 1 -- 172.21.15.105:0/1116336684 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4c8159300 con 0x7ff4c809aa30 2024-09-21T03:20:45.418 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.415+0000 7ff4c7fff640 1 -- 172.21.15.105:0/1116336684 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4c8070ac0 con 0x7ff4c809aa30 2024-09-21T03:20:45.418 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.415+0000 7ff4af7fe640 1 -- 172.21.15.105:0/1116336684 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff4b8036070 con 0x7ff4c809aa30 2024-09-21T03:20:45.419 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.416+0000 7ff4af7fe640 1 --2- 172.21.15.105:0/1116336684 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff4b4078bc0 0x7ff4b407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:45.419 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.416+0000 7ff4af7fe640 1 -- 172.21.15.105:0/1116336684 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 4943+0+0 (secure 0 0 0) 0x7ff4b80bb9e0 con 0x7ff4c809aa30 2024-09-21T03:20:45.419 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.416+0000 7ff4c67fc640 1 --2- 172.21.15.105:0/1116336684 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff4b4078bc0 0x7ff4b407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:45.419 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.417+0000 7ff4c67fc640 1 --2- 172.21.15.105:0/1116336684 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff4b4078bc0 0x7ff4b407b0d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff4c809ca50 tx=0x7ff4bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:45.422 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.420+0000 7ff4af7fe640 1 -- 172.21.15.105:0/1116336684 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff4c8070ac0 con 0x7ff4c809aa30 2024-09-21T03:20:45.635 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.633+0000 7ff4c7fff640 1 -- 172.21.15.105:0/1116336684 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff4c80b39d0 con 0x7ff4c809aa30 2024-09-21T03:20:45.635 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.634+0000 7ff4af7fe640 1 -- 172.21.15.105:0/1116336684 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+3917 (secure 0 0 0) 0x7ff4c80b39d0 con 0x7ff4c809aa30 2024-09-21T03:20:45.636 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:20:45.636 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":27,"btime":"2024-09-21T03:20:39:314713+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4889,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/2075944521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2075944521},{"type":"v1","addr":"172.21.15.162:6837","nonce":2075944521}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5086,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/4008776831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":4008776831},{"type":"v1","addr":"172.21.15.105:6835","nonce":4008776831}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2322902258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2322902258},{"type":"v1","addr":"172.21.15.162:6836","nonce":2322902258}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/53033907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":53033907},{"type":"v1","addr":"172.21.15.105:6833","nonce":53033907}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[]} 2024-09-21T03:20:45.636 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 27 2024-09-21T03:20:45.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.636+0000 7ff4c7fff640 1 -- 172.21.15.105:0/1116336684 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff4b4078bc0 msgr2=0x7ff4b407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:45.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.636+0000 7ff4c7fff640 1 --2- 172.21.15.105:0/1116336684 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff4b4078bc0 0x7ff4b407b0d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff4c809ca50 tx=0x7ff4bc009040 comp rx=0 tx=0).stop 2024-09-21T03:20:45.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.636+0000 7ff4c7fff640 1 -- 172.21.15.105:0/1116336684 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4c809aa30 msgr2=0x7ff4c81f3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:45.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.636+0000 7ff4c7fff640 1 --2- 172.21.15.105:0/1116336684 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4c809aa30 0x7ff4c81f3b80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8006010 tx=0x7ff4b8003f10 comp rx=0 tx=0).stop 2024-09-21T03:20:45.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.636+0000 7ff4c7fff640 1 -- 172.21.15.105:0/1116336684 shutdown_connections 2024-09-21T03:20:45.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.636+0000 7ff4c7fff640 1 --2- 172.21.15.105:0/1116336684 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff4b4078bc0 0x7ff4b407b0d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:45.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.636+0000 7ff4c7fff640 1 --2- 172.21.15.105:0/1116336684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4c80cd860 0x7ff4c809be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:45.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.636+0000 7ff4c7fff640 1 --2- 172.21.15.105:0/1116336684 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4c80b6e20 0x7ff4c8156860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:45.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.636+0000 7ff4c7fff640 1 --2- 172.21.15.105:0/1116336684 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4c809aa30 0x7ff4c81f3b80 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:45.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.636+0000 7ff4c7fff640 1 -- 172.21.15.105:0/1116336684 >> 172.21.15.105:0/1116336684 conn(0x7ff4c80b3be0 msgr2=0x7ff4c8070ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:45.639 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.636+0000 7ff4c7fff640 1 -- 172.21.15.105:0/1116336684 shutdown_connections 2024-09-21T03:20:45.639 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.636+0000 7ff4c7fff640 1 -- 172.21.15.105:0/1116336684 wait complete. 2024-09-21T03:20:45.649 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T03:20:45.649 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-21T03:20:45.649 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T03:20:45.650 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:20:45.650 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T03:20:45.650 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T03:20:45.650 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T03:20:45.650 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:20:45.650 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T03:20:45.650 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T03:20:45.650 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T03:20:45.651 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:20:45.651 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T03:20:45.651 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T03:20:45.651 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T03:20:45.651 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:20:45.659 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T03:20:45.659 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T03:20:45.662 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T03:20:45.662 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T03:20:45.663 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T03:20:45.663 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T03:20:45.664 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T03:20:45.664 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T03:20:45.704 INFO:tasks.ceph.mds.a:Started 2024-09-21T03:20:45.704 DEBUG:teuthology.parallel:result is None 2024-09-21T03:20:45.705 INFO:tasks.ceph.mds.c:Started 2024-09-21T03:20:45.706 DEBUG:teuthology.parallel:result is None 2024-09-21T03:20:45.707 INFO:tasks.ceph.mds.b:Started 2024-09-21T03:20:45.707 DEBUG:teuthology.parallel:result is None 2024-09-21T03:20:45.707 INFO:tasks.ceph.mds.d:Started 2024-09-21T03:20:45.707 DEBUG:teuthology.parallel:result is None 2024-09-21T03:20:45.708 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T03:20:45.791 INFO:tasks.ceph.mds.a.smithi105.stdout:starting mds.a at 2024-09-21T03:20:45.792 INFO:tasks.ceph.mds.c.smithi105.stdout:starting mds.c at 2024-09-21T03:20:45.800 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-09-21T03:20:45.801 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-09-21T03:20:45.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.826+0000 7f2b4f398640 1 -- 172.21.15.105:0/2118227384 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b4815c580 msgr2=0x7f2b48070540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:45.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.826+0000 7f2b4f398640 1 --2- 172.21.15.105:0/2118227384 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b4815c580 0x7f2b48070540 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f2b480d1cd0 tx=0x7f2b3802a5f0 comp rx=0 tx=0).stop 2024-09-21T03:20:45.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.826+0000 7f2b4f398640 1 -- 172.21.15.105:0/2118227384 shutdown_connections 2024-09-21T03:20:45.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.826+0000 7f2b4f398640 1 --2- 172.21.15.105:0/2118227384 >> v2:172.21.15.162:3300/0 conn(0x7f2b48155ce0 0x7f2b480b45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:45.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.826+0000 7f2b4f398640 1 --2- 172.21.15.105:0/2118227384 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b4815c580 0x7f2b48070540 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:45.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.826+0000 7f2b4f398640 1 -- 172.21.15.105:0/2118227384 >> 172.21.15.105:0/2118227384 conn(0x7f2b4806def0 msgr2=0x7f2b4806e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:45.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.826+0000 7f2b4f398640 1 -- 172.21.15.105:0/2118227384 shutdown_connections 2024-09-21T03:20:45.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.826+0000 7f2b4f398640 1 -- 172.21.15.105:0/2118227384 wait complete. 2024-09-21T03:20:45.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.828+0000 7f2b4f398640 1 Processor -- start 2024-09-21T03:20:45.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.828+0000 7f2b4f398640 1 -- start start 2024-09-21T03:20:45.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.829+0000 7f2b4f398640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b48074420 0x7f2b480cc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:45.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.829+0000 7f2b4f398640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b48155ce0 0x7f2b481f6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:45.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.829+0000 7f2b4f398640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b481f2aa0 0x7f2b48158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:45.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.829+0000 7f2b4f398640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2b480b5030 con 0x7f2b48074420 2024-09-21T03:20:45.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.829+0000 7f2b4f398640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2b480b4eb0 con 0x7f2b481f2aa0 2024-09-21T03:20:45.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.829+0000 7f2b4f398640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2b480b51b0 con 0x7f2b48155ce0 2024-09-21T03:20:45.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.829+0000 7f2b4d134640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b48074420 0x7f2b480cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:45.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.829+0000 7f2b4d134640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b48074420 0x7f2b480cc980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:54438/0 (socket says 172.21.15.105:54438) 2024-09-21T03:20:45.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.829+0000 7f2b4d134640 1 -- 172.21.15.105:0/3608685458 learned_addr learned my addr 172.21.15.105:0/3608685458 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:45.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.830+0000 7f2b4d935640 1 --2- 172.21.15.105:0/3608685458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b481f2aa0 0x7f2b48158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:45.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.830+0000 7f2b4c933640 1 --2- 172.21.15.105:0/3608685458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b48155ce0 0x7f2b481f6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:45.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.830+0000 7f2b4d134640 1 -- 172.21.15.105:0/3608685458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b48155ce0 msgr2=0x7f2b481f6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:45.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.830+0000 7f2b4d134640 1 --2- 172.21.15.105:0/3608685458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b48155ce0 0x7f2b481f6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:45.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.830+0000 7f2b4d134640 1 -- 172.21.15.105:0/3608685458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b481f2aa0 msgr2=0x7f2b48158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:45.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.830+0000 7f2b4d134640 1 --2- 172.21.15.105:0/3608685458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b481f2aa0 0x7f2b48158080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:45.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.830+0000 7f2b4d134640 1 -- 172.21.15.105:0/3608685458 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b481f22e0 con 0x7f2b48074420 2024-09-21T03:20:45.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.830+0000 7f2b4d935640 1 --2- 172.21.15.105:0/3608685458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b481f2aa0 0x7f2b48158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:20:45.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.830+0000 7f2b4d134640 1 --2- 172.21.15.105:0/3608685458 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b48074420 0x7f2b480cc980 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f2b4400c3a0 tx=0x7f2b4400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:45.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.830+0000 7f2b3dffb640 1 -- 172.21.15.105:0/3608685458 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b44017070 con 0x7f2b48074420 2024-09-21T03:20:45.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.830+0000 7f2b3dffb640 1 -- 172.21.15.105:0/3608685458 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b440053c0 con 0x7f2b48074420 2024-09-21T03:20:45.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.830+0000 7f2b4f398640 1 -- 172.21.15.105:0/3608685458 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b480c6cd0 con 0x7f2b48074420 2024-09-21T03:20:45.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.830+0000 7f2b3dffb640 1 -- 172.21.15.105:0/3608685458 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b44003850 con 0x7f2b48074420 2024-09-21T03:20:45.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.830+0000 7f2b4f398640 1 -- 172.21.15.105:0/3608685458 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b480c6710 con 0x7f2b48074420 2024-09-21T03:20:45.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.831+0000 7f2b4f398640 1 -- 172.21.15.105:0/3608685458 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b481f20d0 con 0x7f2b48074420 2024-09-21T03:20:45.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.832+0000 7f2b3dffb640 1 -- 172.21.15.105:0/3608685458 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2b4401a070 con 0x7f2b48074420 2024-09-21T03:20:45.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.833+0000 7f2b3dffb640 1 --2- 172.21.15.105:0/3608685458 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2b2c07add0 0x7f2b2c07d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:45.835 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.833+0000 7f2b3dffb640 1 -- 172.21.15.105:0/3608685458 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 4943+0+0 (secure 0 0 0) 0x7f2b44099e00 con 0x7f2b48074420 2024-09-21T03:20:45.835 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.833+0000 7f2b4c933640 1 --2- 172.21.15.105:0/3608685458 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2b2c07add0 0x7f2b2c07d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:45.835 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.833+0000 7f2b4c933640 1 --2- 172.21.15.105:0/3608685458 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2b2c07add0 0x7f2b2c07d2e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2b38033000 tx=0x7f2b38004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:45.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:45.837+0000 7f2b3dffb640 1 -- 172.21.15.105:0/3608685458 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2b44062540 con 0x7f2b48074420 2024-09-21T03:20:46.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:46.026+0000 7f2b4f398640 1 -- 172.21.15.105:0/3608685458 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f2b480b56d0 con 0x7f2b48074420 2024-09-21T03:20:47.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.105+0000 7f2b3dffb640 1 -- 172.21.15.105:0/3608685458 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v53) ==== 97+0+0 (secure 0 0 0) 0x7f2b44061e40 con 0x7f2b48074420 2024-09-21T03:20:47.107 INFO:teuthology.orchestra.run.smithi105.stderr: removed all blocklist entries 2024-09-21T03:20:47.110 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.108+0000 7f2b4f398640 1 -- 172.21.15.105:0/3608685458 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2b2c07add0 msgr2=0x7f2b2c07d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:47.110 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.108+0000 7f2b4f398640 1 --2- 172.21.15.105:0/3608685458 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2b2c07add0 0x7f2b2c07d2e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2b38033000 tx=0x7f2b38004730 comp rx=0 tx=0).stop 2024-09-21T03:20:47.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.108+0000 7f2b4f398640 1 -- 172.21.15.105:0/3608685458 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b48074420 msgr2=0x7f2b480cc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:47.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.108+0000 7f2b4f398640 1 --2- 172.21.15.105:0/3608685458 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b48074420 0x7f2b480cc980 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f2b4400c3a0 tx=0x7f2b4400c860 comp rx=0 tx=0).stop 2024-09-21T03:20:47.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.108+0000 7f2b4f398640 1 -- 172.21.15.105:0/3608685458 shutdown_connections 2024-09-21T03:20:47.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.108+0000 7f2b4f398640 1 --2- 172.21.15.105:0/3608685458 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2b2c07add0 0x7f2b2c07d2e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:47.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.108+0000 7f2b4f398640 1 --2- 172.21.15.105:0/3608685458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b481f2aa0 0x7f2b48158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:47.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.108+0000 7f2b4f398640 1 --2- 172.21.15.105:0/3608685458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b48155ce0 0x7f2b481f6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:47.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.108+0000 7f2b4f398640 1 --2- 172.21.15.105:0/3608685458 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b48074420 0x7f2b480cc980 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:47.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.108+0000 7f2b4f398640 1 -- 172.21.15.105:0/3608685458 >> 172.21.15.105:0/3608685458 conn(0x7f2b4806def0 msgr2=0x7f2b48153e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:47.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.109+0000 7f2b4f398640 1 -- 172.21.15.105:0/3608685458 shutdown_connections 2024-09-21T03:20:47.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.109+0000 7f2b4f398640 1 -- 172.21.15.105:0/3608685458 wait complete. 2024-09-21T03:20:47.124 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T03:20:47.243 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.242+0000 7f5bf5952640 1 -- 172.21.15.105:0/1235354653 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5bf00b66b0 msgr2=0x7f5bf00b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:47.244 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.242+0000 7f5bf5952640 1 --2- 172.21.15.105:0/1235354653 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5bf00b66b0 0x7f5bf00b3710 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8005fd0 tx=0x7f5bd802a670 comp rx=0 tx=0).stop 2024-09-21T03:20:47.244 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.242+0000 7f5bf5952640 1 -- 172.21.15.105:0/1235354653 shutdown_connections 2024-09-21T03:20:47.244 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.242+0000 7f5bf5952640 1 --2- 172.21.15.105:0/1235354653 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5bf00b66b0 0x7f5bf00b3710 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:47.244 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.242+0000 7f5bf5952640 1 -- 172.21.15.105:0/1235354653 >> 172.21.15.105:0/1235354653 conn(0x7f5bf009d7f0 msgr2=0x7f5bf00d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:47.244 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.242+0000 7f5bf5952640 1 -- 172.21.15.105:0/1235354653 shutdown_connections 2024-09-21T03:20:47.244 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.242+0000 7f5bf5952640 1 -- 172.21.15.105:0/1235354653 wait complete. 2024-09-21T03:20:47.245 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.243+0000 7f5bf5952640 1 Processor -- start 2024-09-21T03:20:47.245 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.244+0000 7f5bf5952640 1 -- start start 2024-09-21T03:20:47.248 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.245+0000 7f5bf5952640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5bf006e0e0 0x7f5bf00b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:47.248 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.245+0000 7f5bf5952640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5bf00b9970 0x7f5bf00b4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:47.248 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.245+0000 7f5bf5952640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bf015ca30 0x7f5bf014e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:47.248 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.245+0000 7f5bf5952640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf006ec00 con 0x7f5bf006e0e0 2024-09-21T03:20:47.248 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.245+0000 7f5bf5952640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf00d5010 con 0x7f5bf015ca30 2024-09-21T03:20:47.248 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.245+0000 7f5bf5952640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5bf006ed80 con 0x7f5bf00b9970 2024-09-21T03:20:47.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.245+0000 7f5beeffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5bf006e0e0 0x7f5bf00b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:47.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.245+0000 7f5beeffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5bf006e0e0 0x7f5bf00b3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:54458/0 (socket says 172.21.15.105:54458) 2024-09-21T03:20:47.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.245+0000 7f5beeffd640 1 -- 172.21.15.105:0/2777855842 learned_addr learned my addr 172.21.15.105:0/2777855842 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:47.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.245+0000 7f5bef7fe640 1 --2- 172.21.15.105:0/2777855842 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bf015ca30 0x7f5bf014e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:47.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.245+0000 7f5be67fc640 1 --2- 172.21.15.105:0/2777855842 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5bf00b9970 0x7f5bf00b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:47.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.245+0000 7f5beeffd640 1 -- 172.21.15.105:0/2777855842 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5bf00b9970 msgr2=0x7f5bf00b4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:47.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.245+0000 7f5beeffd640 1 --2- 172.21.15.105:0/2777855842 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5bf00b9970 0x7f5bf00b4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:47.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.245+0000 7f5beeffd640 1 -- 172.21.15.105:0/2777855842 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bf015ca30 msgr2=0x7f5bf014e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:47.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.245+0000 7f5beeffd640 1 --2- 172.21.15.105:0/2777855842 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bf015ca30 0x7f5bf014e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:47.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.245+0000 7f5beeffd640 1 -- 172.21.15.105:0/2777855842 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bf00cd7f0 con 0x7f5bf006e0e0 2024-09-21T03:20:47.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.245+0000 7f5bef7fe640 1 --2- 172.21.15.105:0/2777855842 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bf015ca30 0x7f5bf014e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:20:47.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.246+0000 7f5beeffd640 1 --2- 172.21.15.105:0/2777855842 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5bf006e0e0 0x7f5bf00b3e10 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f5be000c3c0 tx=0x7f5be000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:47.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.246+0000 7f5becff9640 1 -- 172.21.15.105:0/2777855842 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be0017070 con 0x7f5bf006e0e0 2024-09-21T03:20:47.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.246+0000 7f5becff9640 1 -- 172.21.15.105:0/2777855842 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5be00035f0 con 0x7f5bf006e0e0 2024-09-21T03:20:47.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.246+0000 7f5becff9640 1 -- 172.21.15.105:0/2777855842 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be0003a80 con 0x7f5bf006e0e0 2024-09-21T03:20:47.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.246+0000 7f5bf5952640 1 -- 172.21.15.105:0/2777855842 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bf00cdad0 con 0x7f5bf006e0e0 2024-09-21T03:20:47.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.246+0000 7f5bf5952640 1 -- 172.21.15.105:0/2777855842 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bf00ce090 con 0x7f5bf006e0e0 2024-09-21T03:20:47.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.247+0000 7f5bf5952640 1 -- 172.21.15.105:0/2777855842 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bf00cd3a0 con 0x7f5bf006e0e0 2024-09-21T03:20:47.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.247+0000 7f5becff9640 1 -- 172.21.15.105:0/2777855842 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5be001a070 con 0x7f5bf006e0e0 2024-09-21T03:20:47.251 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.248+0000 7f5becff9640 1 --2- 172.21.15.105:0/2777855842 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5bd0078bc0 0x7f5bd007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:47.251 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.248+0000 7f5becff9640 1 -- 172.21.15.105:0/2777855842 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4857+0+0 (secure 0 0 0) 0x7f5be0099bb0 con 0x7f5bf006e0e0 2024-09-21T03:20:47.251 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.248+0000 7f5be67fc640 1 --2- 172.21.15.105:0/2777855842 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5bd0078bc0 0x7f5bd007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:47.251 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.249+0000 7f5be67fc640 1 --2- 172.21.15.105:0/2777855842 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5bd0078bc0 0x7f5bd007b0d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8033000 tx=0x7f5bd8004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:47.254 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.252+0000 7f5becff9640 1 -- 172.21.15.105:0/2777855842 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5bf00cd3a0 con 0x7f5bf006e0e0 2024-09-21T03:20:47.499 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.497+0000 7f5bf5952640 1 -- 172.21.15.105:0/2777855842 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f5bf006f1f0 con 0x7f5bf006e0e0 2024-09-21T03:20:47.499 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.498+0000 7f5becff9640 1 -- 172.21.15.105:0/2777855842 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) ==== 80+0+5304 (secure 0 0 0) 0x7f5be00623d0 con 0x7f5bf006e0e0 2024-09-21T03:20:47.499 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:20:47.500 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-21T03:20:47.500 INFO:teuthology.orchestra.run.smithi105.stdout: "auth_dump": [ 2024-09-21T03:20:47.500 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:47.500 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mds.a", 2024-09-21T03:20:47.500 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mtIIZDhAAJIXLpzTFBOFhnOwLzsdL6w==", 2024-09-21T03:20:47.500 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:20:47.500 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:20:47.500 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:20:47.500 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:20:47.500 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:20:47.500 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:47.500 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:47.500 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:47.500 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mds.b", 2024-09-21T03:20:47.501 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mGKANGxAAeAuUYMtLP7GXKfIELR7qMA==", 2024-09-21T03:20:47.501 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:20:47.501 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:20:47.501 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:20:47.501 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:20:47.501 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:20:47.501 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:47.501 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:47.502 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:47.502 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mds.c", 2024-09-21T03:20:47.502 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mwQzQFRAAElYtgnIdYzzkeg8AtiU+kA==", 2024-09-21T03:20:47.502 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:20:47.502 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:20:47.502 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:20:47.502 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:20:47.503 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:20:47.503 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:47.503 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:47.503 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:47.503 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mds.d", 2024-09-21T03:20:47.503 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mZkWyIhAAu4XWptFcbDrYjozzrgMcGQ==", 2024-09-21T03:20:47.503 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:20:47.503 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:20:47.503 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:20:47.503 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:20:47.503 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:20:47.503 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:47.503 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:47.503 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:47.503 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.0", 2024-09-21T03:20:47.504 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDMOu5mrSk2BRAAuEPjuEeUJEI3Sa2fiLaJyw==", 2024-09-21T03:20:47.504 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:20:47.504 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:20:47.504 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:20:47.504 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:20:47.504 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:47.504 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:47.504 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:47.504 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.1", 2024-09-21T03:20:47.504 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDPOu5mAT4UCBAAase7NV3ARBSu4QloaQdlzA==", 2024-09-21T03:20:47.504 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:20:47.504 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:20:47.504 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:20:47.504 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:20:47.504 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:47.505 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:47.505 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:47.505 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.2", 2024-09-21T03:20:47.505 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDSOu5ma4LRChAASottrmolMcagbspeyGVzBQ==", 2024-09-21T03:20:47.505 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:20:47.505 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:20:47.505 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:20:47.505 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:20:47.505 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:47.505 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:47.505 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:47.505 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.3", 2024-09-21T03:20:47.505 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDVOu5mD5RWHBAAKuNr4F3GA0EP566aQ07ZVw==", 2024-09-21T03:20:47.505 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:20:47.506 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:20:47.506 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:20:47.506 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:20:47.506 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:47.506 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:47.506 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:47.506 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.4", 2024-09-21T03:20:47.506 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDcOu5m++UBChAAqmgoPBQ/as4tc+UQPwaflg==", 2024-09-21T03:20:47.506 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:20:47.506 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:20:47.506 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:20:47.506 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:20:47.506 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:47.507 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:47.507 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:47.507 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.5", 2024-09-21T03:20:47.507 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDfOu5maYYZKRAA1ungglTU3TW1B/XNRjBuZQ==", 2024-09-21T03:20:47.507 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:20:47.507 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:20:47.507 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:20:47.507 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:20:47.507 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:47.507 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:47.507 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:47.507 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.6", 2024-09-21T03:20:47.507 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDjOu5mmwIqHBAAf6oNdLNkmM9yufP8XA2+og==", 2024-09-21T03:20:47.507 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:20:47.508 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:20:47.508 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:20:47.508 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:20:47.508 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:47.508 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:47.508 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:47.508 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.7", 2024-09-21T03:20:47.508 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDmOu5mtCciHhAAPTnZubJ+7mGXcXZykCWxHg==", 2024-09-21T03:20:47.508 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:20:47.508 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:20:47.508 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:20:47.508 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:20:47.508 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:47.508 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:47.509 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:47.509 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.0", 2024-09-21T03:20:47.509 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mughoJxAAhY0bzJmq+oNyzCdtafkC9w==", 2024-09-21T03:20:47.509 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:20:47.509 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:20:47.509 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow r", 2024-09-21T03:20:47.509 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-21T03:20:47.509 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:47.509 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:47.509 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:47.509 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.1", 2024-09-21T03:20:47.509 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5m4Vn2LhAAnEa/01ql5quuRCVHOVwB7w==", 2024-09-21T03:20:47.509 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:20:47.509 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:20:47.509 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow r", 2024-09-21T03:20:47.510 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow rw", 2024-09-21T03:20:47.510 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow rwx" 2024-09-21T03:20:47.510 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:47.510 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:47.510 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:47.510 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.2", 2024-09-21T03:20:47.510 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mKi0mKxAAoetnL61ujgtg2cvscdjCLQ==", 2024-09-21T03:20:47.510 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:20:47.510 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:20:47.510 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow r", 2024-09-21T03:20:47.510 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow rw", 2024-09-21T03:20:47.510 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow rwx" 2024-09-21T03:20:47.510 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:47.510 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:47.511 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:47.511 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.3", 2024-09-21T03:20:47.511 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mWZDAMhAAs4BuFHMSkJa6+piN/FeeXQ==", 2024-09-21T03:20:47.511 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:20:47.511 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:20:47.511 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow r", 2024-09-21T03:20:47.511 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow rw", 2024-09-21T03:20:47.511 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow rwx" 2024-09-21T03:20:47.511 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:47.511 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:47.511 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:47.511 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.admin", 2024-09-21T03:20:47.511 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDHOu5m4JRYLBAAgZ8nh5VIiWhuZ4+vrnmngw==", 2024-09-21T03:20:47.511 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:20:47.512 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow *", 2024-09-21T03:20:47.512 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:20:47.512 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:20:47.512 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:20:47.512 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:47.512 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:47.512 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:47.512 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mgr.x", 2024-09-21T03:20:47.512 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5m92lTChAAQ61muQmc6uBs7b5mq3Zt8g==", 2024-09-21T03:20:47.512 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:20:47.513 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow *", 2024-09-21T03:20:47.513 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile mgr", 2024-09-21T03:20:47.513 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:20:47.513 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:47.513 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:20:47.513 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:47.513 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mgr.y", 2024-09-21T03:20:47.513 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mh07bBRAAflFF00xr1ew4zttUi5TGng==", 2024-09-21T03:20:47.513 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:20:47.513 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow *", 2024-09-21T03:20:47.513 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile mgr", 2024-09-21T03:20:47.513 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:20:47.513 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:47.513 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:47.514 INFO:teuthology.orchestra.run.smithi105.stdout: ] 2024-09-21T03:20:47.514 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-21T03:20:47.515 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.500+0000 7f5bf5952640 1 -- 172.21.15.105:0/2777855842 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5bd0078bc0 msgr2=0x7f5bd007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:47.516 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.500+0000 7f5bf5952640 1 --2- 172.21.15.105:0/2777855842 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5bd0078bc0 0x7f5bd007b0d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8033000 tx=0x7f5bd8004730 comp rx=0 tx=0).stop 2024-09-21T03:20:47.516 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.500+0000 7f5bf5952640 1 -- 172.21.15.105:0/2777855842 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5bf006e0e0 msgr2=0x7f5bf00b3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:47.516 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.500+0000 7f5bf5952640 1 --2- 172.21.15.105:0/2777855842 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5bf006e0e0 0x7f5bf00b3e10 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f5be000c3c0 tx=0x7f5be000c880 comp rx=0 tx=0).stop 2024-09-21T03:20:47.516 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.500+0000 7f5bf5952640 1 -- 172.21.15.105:0/2777855842 shutdown_connections 2024-09-21T03:20:47.516 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.500+0000 7f5bf5952640 1 --2- 172.21.15.105:0/2777855842 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5bd0078bc0 0x7f5bd007b0d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:47.516 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.500+0000 7f5bf5952640 1 --2- 172.21.15.105:0/2777855842 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bf015ca30 0x7f5bf014e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:47.516 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.500+0000 7f5bf5952640 1 --2- 172.21.15.105:0/2777855842 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5bf00b9970 0x7f5bf00b4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:47.516 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.500+0000 7f5bf5952640 1 --2- 172.21.15.105:0/2777855842 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5bf006e0e0 0x7f5bf00b3e10 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:47.516 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.500+0000 7f5bf5952640 1 -- 172.21.15.105:0/2777855842 >> 172.21.15.105:0/2777855842 conn(0x7f5bf009d7f0 msgr2=0x7f5bf015e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:47.516 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.500+0000 7f5bf5952640 1 -- 172.21.15.105:0/2777855842 shutdown_connections 2024-09-21T03:20:47.516 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.500+0000 7f5bf5952640 1 -- 172.21.15.105:0/2777855842 wait complete. 2024-09-21T03:20:47.517 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T03:20:47.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.628+0000 7fc10409b640 1 -- 172.21.15.105:0/2919008580 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0fc0cff70 msgr2=0x7fc0fc15c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:47.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.628+0000 7fc10409b640 1 --2- 172.21.15.105:0/2919008580 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0fc0cff70 0x7fc0fc15c830 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8009830 tx=0x7fc0f802a480 comp rx=0 tx=0).stop 2024-09-21T03:20:47.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.628+0000 7fc10409b640 1 -- 172.21.15.105:0/2919008580 shutdown_connections 2024-09-21T03:20:47.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.628+0000 7fc10409b640 1 --2- 172.21.15.105:0/2919008580 >> v2:172.21.15.162:3300/0 conn(0x7fc0fc0b4530 0x7fc0fc0d0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:47.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.628+0000 7fc10409b640 1 --2- 172.21.15.105:0/2919008580 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0fc0cff70 0x7fc0fc15c830 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:47.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.628+0000 7fc10409b640 1 -- 172.21.15.105:0/2919008580 >> 172.21.15.105:0/2919008580 conn(0x7fc0fc0cee20 msgr2=0x7fc0fc0cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:47.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.628+0000 7fc10409b640 1 -- 172.21.15.105:0/2919008580 shutdown_connections 2024-09-21T03:20:47.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.628+0000 7fc10409b640 1 -- 172.21.15.105:0/2919008580 wait complete. 2024-09-21T03:20:47.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.630+0000 7fc10409b640 1 Processor -- start 2024-09-21T03:20:47.632 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.630+0000 7fc10409b640 1 -- start start 2024-09-21T03:20:47.634 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.631+0000 7fc10409b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0fc0cff70 0x7fc0fc145020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:47.634 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.631+0000 7fc10409b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0fc160c90 0x7fc0fc15a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:47.634 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.631+0000 7fc10409b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0fc15ab50 0x7fc0fc15ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:47.635 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.631+0000 7fc10409b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc0fc0d17d0 con 0x7fc0fc160c90 2024-09-21T03:20:47.635 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.631+0000 7fc10409b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc0fc0d1650 con 0x7fc0fc15ab50 2024-09-21T03:20:47.635 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.631+0000 7fc10409b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc0fc0d1950 con 0x7fc0fc0cff70 2024-09-21T03:20:47.635 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.631+0000 7fc101636640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0fc160c90 0x7fc0fc15a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:47.635 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.632+0000 7fc101636640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0fc160c90 0x7fc0fc15a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:54474/0 (socket says 172.21.15.105:54474) 2024-09-21T03:20:47.635 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.632+0000 7fc101636640 1 -- 172.21.15.105:0/2045296775 learned_addr learned my addr 172.21.15.105:0/2045296775 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:47.635 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.632+0000 7fc102638640 1 --2- 172.21.15.105:0/2045296775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0fc15ab50 0x7fc0fc15ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:47.635 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.632+0000 7fc101e37640 1 --2- 172.21.15.105:0/2045296775 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0fc0cff70 0x7fc0fc145020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:47.636 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.632+0000 7fc101636640 1 -- 172.21.15.105:0/2045296775 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0fc0cff70 msgr2=0x7fc0fc145020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:47.636 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.632+0000 7fc101636640 1 --2- 172.21.15.105:0/2045296775 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0fc0cff70 0x7fc0fc145020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:47.636 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.632+0000 7fc101636640 1 -- 172.21.15.105:0/2045296775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0fc15ab50 msgr2=0x7fc0fc15ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:47.636 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.632+0000 7fc101636640 1 --2- 172.21.15.105:0/2045296775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0fc15ab50 0x7fc0fc15ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:47.636 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.632+0000 7fc101636640 1 -- 172.21.15.105:0/2045296775 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0fc0cb590 con 0x7fc0fc160c90 2024-09-21T03:20:47.636 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.632+0000 7fc101636640 1 --2- 172.21.15.105:0/2045296775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0fc160c90 0x7fc0fc15a610 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec00c3f0 tx=0x7fc0ec00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:47.636 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.632+0000 7fc0f27fc640 1 -- 172.21.15.105:0/2045296775 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ec006890 con 0x7fc0fc160c90 2024-09-21T03:20:47.636 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.632+0000 7fc0f27fc640 1 -- 172.21.15.105:0/2045296775 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc0ec006b20 con 0x7fc0fc160c90 2024-09-21T03:20:47.636 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.632+0000 7fc10409b640 1 -- 172.21.15.105:0/2045296775 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0fc0cb870 con 0x7fc0fc160c90 2024-09-21T03:20:47.636 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.632+0000 7fc0f27fc640 1 -- 172.21.15.105:0/2045296775 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ec007020 con 0x7fc0fc160c90 2024-09-21T03:20:47.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.632+0000 7fc10409b640 1 -- 172.21.15.105:0/2045296775 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0fc0cbe30 con 0x7fc0fc160c90 2024-09-21T03:20:47.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.633+0000 7fc10409b640 1 -- 172.21.15.105:0/2045296775 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0fc0d1e20 con 0x7fc0fc160c90 2024-09-21T03:20:47.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.634+0000 7fc0f27fc640 1 -- 172.21.15.105:0/2045296775 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc0ec019020 con 0x7fc0fc160c90 2024-09-21T03:20:47.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.634+0000 7fc0f27fc640 1 --2- 172.21.15.105:0/2045296775 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc0e0078b90 0x7fc0e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:47.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.634+0000 7fc0f27fc640 1 -- 172.21.15.105:0/2045296775 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4857+0+0 (secure 0 0 0) 0x7fc0ec099dc0 con 0x7fc0fc160c90 2024-09-21T03:20:47.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.634+0000 7fc101e37640 1 --2- 172.21.15.105:0/2045296775 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc0e0078b90 0x7fc0e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:47.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.635+0000 7fc101e37640 1 --2- 172.21.15.105:0/2045296775 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc0e0078b90 0x7fc0e007b0a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8034000 tx=0x7fc0f8004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:47.640 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.639+0000 7fc0f27fc640 1 -- 172.21.15.105:0/2045296775 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc0ec062670 con 0x7fc0fc160c90 2024-09-21T03:20:47.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.818+0000 7fc10409b640 1 -- 172.21.15.105:0/2045296775 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fc0fc15bd20 con 0x7fc0fc160c90 2024-09-21T03:20:47.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.818+0000 7fc0f27fc640 1 -- 172.21.15.105:0/2045296775 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v53) ==== 84+0+65 (secure 0 0 0) 0x7fc0ec061f70 con 0x7fc0fc160c90 2024-09-21T03:20:47.820 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:20:47.821 INFO:teuthology.orchestra.run.smithi105.stdout:[ 2024-09-21T03:20:47.821 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:20:47.821 INFO:teuthology.orchestra.run.smithi105.stdout: "poolnum": 1, 2024-09-21T03:20:47.821 INFO:teuthology.orchestra.run.smithi105.stdout: "poolname": ".mgr" 2024-09-21T03:20:47.821 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:20:47.821 INFO:teuthology.orchestra.run.smithi105.stdout:] 2024-09-21T03:20:47.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.821+0000 7fc10409b640 1 -- 172.21.15.105:0/2045296775 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc0e0078b90 msgr2=0x7fc0e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:47.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.821+0000 7fc10409b640 1 --2- 172.21.15.105:0/2045296775 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc0e0078b90 0x7fc0e007b0a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8034000 tx=0x7fc0f8004730 comp rx=0 tx=0).stop 2024-09-21T03:20:47.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.821+0000 7fc10409b640 1 -- 172.21.15.105:0/2045296775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0fc160c90 msgr2=0x7fc0fc15a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:47.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.821+0000 7fc10409b640 1 --2- 172.21.15.105:0/2045296775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0fc160c90 0x7fc0fc15a610 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec00c3f0 tx=0x7fc0ec00c7f0 comp rx=0 tx=0).stop 2024-09-21T03:20:47.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.821+0000 7fc10409b640 1 -- 172.21.15.105:0/2045296775 shutdown_connections 2024-09-21T03:20:47.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.821+0000 7fc10409b640 1 --2- 172.21.15.105:0/2045296775 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc0e0078b90 0x7fc0e007b0a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:47.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.821+0000 7fc10409b640 1 --2- 172.21.15.105:0/2045296775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0fc15ab50 0x7fc0fc15ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:47.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.821+0000 7fc10409b640 1 --2- 172.21.15.105:0/2045296775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0fc160c90 0x7fc0fc15a610 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:47.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.821+0000 7fc10409b640 1 --2- 172.21.15.105:0/2045296775 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0fc0cff70 0x7fc0fc145020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:47.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.821+0000 7fc10409b640 1 -- 172.21.15.105:0/2045296775 >> 172.21.15.105:0/2045296775 conn(0x7fc0fc0cee20 msgr2=0x7fc0fc0b66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:47.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.821+0000 7fc10409b640 1 -- 172.21.15.105:0/2045296775 shutdown_connections 2024-09-21T03:20:47.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.821+0000 7fc10409b640 1 -- 172.21.15.105:0/2045296775 wait complete. 2024-09-21T03:20:47.834 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T03:20:47.834 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T03:20:47.950 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.948+0000 7fdc65aec640 1 -- 172.21.15.105:0/4125584541 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc48003a50 msgr2=0x7fdc48003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:47.951 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.948+0000 7fdc65aec640 1 --2- 172.21.15.105:0/4125584541 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc48003a50 0x7fdc48003ec0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fdc500016c0 tx=0x7fdc48005830 comp rx=0 tx=0).stop 2024-09-21T03:20:47.951 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.948+0000 7fdc65aec640 1 -- 172.21.15.105:0/4125584541 shutdown_connections 2024-09-21T03:20:47.951 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.948+0000 7fdc65aec640 1 --2- 172.21.15.105:0/4125584541 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc48003a50 0x7fdc48003ec0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:47.951 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.948+0000 7fdc65aec640 1 -- 172.21.15.105:0/4125584541 >> 172.21.15.105:0/4125584541 conn(0x7fdc60072a90 msgr2=0x7fdc60072ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:47.951 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.948+0000 7fdc65aec640 1 -- 172.21.15.105:0/4125584541 shutdown_connections 2024-09-21T03:20:47.951 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.948+0000 7fdc65aec640 1 -- 172.21.15.105:0/4125584541 wait complete. 2024-09-21T03:20:47.952 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.949+0000 7fdc65aec640 1 Processor -- start 2024-09-21T03:20:47.952 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.950+0000 7fdc65aec640 1 -- start start 2024-09-21T03:20:47.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.951+0000 7fdc65aec640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc48003a50 0x7fdc60159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:47.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.951+0000 7fdc65aec640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc601f4540 0x7fdc601f6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:47.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.951+0000 7fdc65aec640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc6015b610 0x7fdc601f6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:47.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.951+0000 7fdc65aec640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdc6015c7e0 con 0x7fdc601f4540 2024-09-21T03:20:47.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.951+0000 7fdc65aec640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdc6015c660 con 0x7fdc48003a50 2024-09-21T03:20:47.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.951+0000 7fdc65aec640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdc6015c960 con 0x7fdc6015b610 2024-09-21T03:20:47.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.951+0000 7fdc5effd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc601f4540 0x7fdc601f6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:47.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.951+0000 7fdc5effd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc601f4540 0x7fdc601f6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:54496/0 (socket says 172.21.15.105:54496) 2024-09-21T03:20:47.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.951+0000 7fdc5effd640 1 -- 172.21.15.105:0/23780037 learned_addr learned my addr 172.21.15.105:0/23780037 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:47.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.951+0000 7fdc5ffff640 1 --2- 172.21.15.105:0/23780037 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc6015b610 0x7fdc601f6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:47.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.951+0000 7fdc5f7fe640 1 --2- 172.21.15.105:0/23780037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc48003a50 0x7fdc60159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:47.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.951+0000 7fdc5effd640 1 -- 172.21.15.105:0/23780037 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc6015b610 msgr2=0x7fdc601f6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:47.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.951+0000 7fdc5effd640 1 --2- 172.21.15.105:0/23780037 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc6015b610 0x7fdc601f6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:47.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.951+0000 7fdc5effd640 1 -- 172.21.15.105:0/23780037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc48003a50 msgr2=0x7fdc60159230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:47.956 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.951+0000 7fdc5effd640 1 --2- 172.21.15.105:0/23780037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc48003a50 0x7fdc60159230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:47.956 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.951+0000 7fdc5effd640 1 -- 172.21.15.105:0/23780037 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc600ca8c0 con 0x7fdc601f4540 2024-09-21T03:20:47.956 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.951+0000 7fdc5f7fe640 1 --2- 172.21.15.105:0/23780037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc48003a50 0x7fdc60159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:20:47.956 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.951+0000 7fdc5ffff640 1 --2- 172.21.15.105:0/23780037 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc6015b610 0x7fdc601f6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:20:47.956 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.951+0000 7fdc5effd640 1 --2- 172.21.15.105:0/23780037 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc601f4540 0x7fdc601f6280 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fdc54011b50 tx=0x7fdc5400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:47.956 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.952+0000 7fdc47fff640 1 -- 172.21.15.105:0/23780037 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc54005220 con 0x7fdc601f4540 2024-09-21T03:20:47.956 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.952+0000 7fdc47fff640 1 -- 172.21.15.105:0/23780037 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc540053c0 con 0x7fdc601f4540 2024-09-21T03:20:47.956 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.952+0000 7fdc65aec640 1 -- 172.21.15.105:0/23780037 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc600caba0 con 0x7fdc601f4540 2024-09-21T03:20:47.956 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.952+0000 7fdc47fff640 1 -- 172.21.15.105:0/23780037 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc540047a0 con 0x7fdc601f4540 2024-09-21T03:20:47.956 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.952+0000 7fdc65aec640 1 -- 172.21.15.105:0/23780037 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc600cb160 con 0x7fdc601f4540 2024-09-21T03:20:47.958 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.953+0000 7fdc65aec640 1 -- 172.21.15.105:0/23780037 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc60076820 con 0x7fdc601f4540 2024-09-21T03:20:47.958 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.953+0000 7fdc47fff640 1 -- 172.21.15.105:0/23780037 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdc54004940 con 0x7fdc601f4540 2024-09-21T03:20:47.958 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.954+0000 7fdc47fff640 1 --2- 172.21.15.105:0/23780037 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdc4c078bc0 0x7fdc4c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:47.958 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.954+0000 7fdc47fff640 1 -- 172.21.15.105:0/23780037 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4857+0+0 (secure 0 0 0) 0x7fdc5409bc30 con 0x7fdc601f4540 2024-09-21T03:20:47.958 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.954+0000 7fdc5f7fe640 1 --2- 172.21.15.105:0/23780037 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdc4c078bc0 0x7fdc4c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:47.958 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.955+0000 7fdc5f7fe640 1 --2- 172.21.15.105:0/23780037 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdc4c078bc0 0x7fdc4c07b0d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdc50032000 tx=0x7fdc50001190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:47.961 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:47.959+0000 7fdc47fff640 1 -- 172.21.15.105:0/23780037 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fdc60076820 con 0x7fdc601f4540 2024-09-21T03:20:48.138 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:48.135+0000 7fdc65aec640 1 -- 172.21.15.105:0/23780037 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fdc600ccd30 con 0x7fdc601f4540 2024-09-21T03:20:49.110 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.108+0000 7fdc47fff640 1 -- 172.21.15.105:0/23780037 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v54) ==== 138+0+0 (secure 0 0 0) 0x7fdc540643c0 con 0x7fdc601f4540 2024-09-21T03:20:49.110 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_metadata' created 2024-09-21T03:20:49.113 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.111+0000 7fdc65aec640 1 -- 172.21.15.105:0/23780037 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdc4c078bc0 msgr2=0x7fdc4c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:49.113 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.111+0000 7fdc65aec640 1 --2- 172.21.15.105:0/23780037 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdc4c078bc0 0x7fdc4c07b0d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdc50032000 tx=0x7fdc50001190 comp rx=0 tx=0).stop 2024-09-21T03:20:49.113 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.111+0000 7fdc65aec640 1 -- 172.21.15.105:0/23780037 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc601f4540 msgr2=0x7fdc601f6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:49.114 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.111+0000 7fdc65aec640 1 --2- 172.21.15.105:0/23780037 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc601f4540 0x7fdc601f6280 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fdc54011b50 tx=0x7fdc5400f790 comp rx=0 tx=0).stop 2024-09-21T03:20:49.114 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.111+0000 7fdc65aec640 1 -- 172.21.15.105:0/23780037 shutdown_connections 2024-09-21T03:20:49.114 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.111+0000 7fdc65aec640 1 --2- 172.21.15.105:0/23780037 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdc4c078bc0 0x7fdc4c07b0d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:49.114 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.111+0000 7fdc65aec640 1 --2- 172.21.15.105:0/23780037 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc6015b610 0x7fdc601f6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:49.114 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.111+0000 7fdc65aec640 1 --2- 172.21.15.105:0/23780037 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc601f4540 0x7fdc601f6280 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:49.114 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.111+0000 7fdc65aec640 1 --2- 172.21.15.105:0/23780037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc48003a50 0x7fdc60159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:49.114 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.111+0000 7fdc65aec640 1 -- 172.21.15.105:0/23780037 >> 172.21.15.105:0/23780037 conn(0x7fdc60072a90 msgr2=0x7fdc600b59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:49.114 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.111+0000 7fdc65aec640 1 -- 172.21.15.105:0/23780037 shutdown_connections 2024-09-21T03:20:49.114 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.111+0000 7fdc65aec640 1 -- 172.21.15.105:0/23780037 wait complete. 2024-09-21T03:20:49.131 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T03:20:49.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.253+0000 7f658c816640 1 -- 172.21.15.105:0/3194099994 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65880ceb40 msgr2=0x7f65880cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:49.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.253+0000 7f658c816640 1 --2- 172.21.15.105:0/3194099994 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65880ceb40 0x7f65880cef50 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f65880ba570 tx=0x7f658002aa70 comp rx=0 tx=0).stop 2024-09-21T03:20:49.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.253+0000 7f658c816640 1 -- 172.21.15.105:0/3194099994 shutdown_connections 2024-09-21T03:20:49.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.253+0000 7f658c816640 1 --2- 172.21.15.105:0/3194099994 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65880ceb40 0x7f65880cef50 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:49.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.253+0000 7f658c816640 1 --2- 172.21.15.105:0/3194099994 >> v2:172.21.15.162:3300/0 conn(0x7f658806e170 0x7f65880b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:49.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.253+0000 7f658c816640 1 -- 172.21.15.105:0/3194099994 >> 172.21.15.105:0/3194099994 conn(0x7f658808bfc0 msgr2=0x7f658809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:49.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.253+0000 7f658c816640 1 -- 172.21.15.105:0/3194099994 shutdown_connections 2024-09-21T03:20:49.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.253+0000 7f658c816640 1 -- 172.21.15.105:0/3194099994 wait complete. 2024-09-21T03:20:49.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.255+0000 7f658c816640 1 Processor -- start 2024-09-21T03:20:49.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.255+0000 7f658c816640 1 -- start start 2024-09-21T03:20:49.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.256+0000 7f658c816640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f658806f4b0 0x7f65880c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:49.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.256+0000 7f658c816640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65880ceb40 0x7f65880a1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:49.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.256+0000 7f658c816640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65881f9570 0x7f65881f89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:49.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.256+0000 7f658c816640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f65880d0e60 con 0x7f65881f9570 2024-09-21T03:20:49.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.256+0000 7f658c816640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f65880d0ce0 con 0x7f658806f4b0 2024-09-21T03:20:49.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.256+0000 7f658c816640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f65880d0fe0 con 0x7f65880ceb40 2024-09-21T03:20:49.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.256+0000 7f6586d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65881f9570 0x7f65881f89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:49.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.256+0000 7f6586d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65881f9570 0x7f65881f89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:54520/0 (socket says 172.21.15.105:54520) 2024-09-21T03:20:49.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.256+0000 7f6586d9d640 1 -- 172.21.15.105:0/2291584975 learned_addr learned my addr 172.21.15.105:0/2291584975 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:49.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.257+0000 7f658659c640 1 --2- 172.21.15.105:0/2291584975 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f658806f4b0 0x7f65880c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:49.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.257+0000 7f657dd9b640 1 --2- 172.21.15.105:0/2291584975 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65880ceb40 0x7f65880a1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:49.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.257+0000 7f6586d9d640 1 -- 172.21.15.105:0/2291584975 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65880ceb40 msgr2=0x7f65880a1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:49.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.257+0000 7f6586d9d640 1 --2- 172.21.15.105:0/2291584975 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65880ceb40 0x7f65880a1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:49.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.257+0000 7f6586d9d640 1 -- 172.21.15.105:0/2291584975 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f658806f4b0 msgr2=0x7f65880c9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:49.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.257+0000 7f6586d9d640 1 --2- 172.21.15.105:0/2291584975 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f658806f4b0 0x7f65880c9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:49.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.257+0000 7f6586d9d640 1 -- 172.21.15.105:0/2291584975 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65880a2420 con 0x7f65881f9570 2024-09-21T03:20:49.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.257+0000 7f657dd9b640 1 --2- 172.21.15.105:0/2291584975 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65880ceb40 0x7f65880a1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:20:49.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.257+0000 7f6586d9d640 1 --2- 172.21.15.105:0/2291584975 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65881f9570 0x7f65881f89b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f658002b060 tx=0x7f6580003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:49.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.257+0000 7f657f7fe640 1 -- 172.21.15.105:0/2291584975 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6580033050 con 0x7f65881f9570 2024-09-21T03:20:49.262 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.257+0000 7f657f7fe640 1 -- 172.21.15.105:0/2291584975 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6580004450 con 0x7f65881f9570 2024-09-21T03:20:49.262 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.257+0000 7f657f7fe640 1 -- 172.21.15.105:0/2291584975 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6580038450 con 0x7f65881f9570 2024-09-21T03:20:49.262 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.257+0000 7f658c816640 1 -- 172.21.15.105:0/2291584975 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65880c99c0 con 0x7f65881f9570 2024-09-21T03:20:49.262 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.257+0000 7f658c816640 1 -- 172.21.15.105:0/2291584975 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65880c9f80 con 0x7f65881f9570 2024-09-21T03:20:49.263 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.258+0000 7f658c816640 1 -- 172.21.15.105:0/2291584975 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65880d1510 con 0x7f65881f9570 2024-09-21T03:20:49.263 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.259+0000 7f657f7fe640 1 -- 172.21.15.105:0/2291584975 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6580036070 con 0x7f65881f9570 2024-09-21T03:20:49.263 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.259+0000 7f657f7fe640 1 --2- 172.21.15.105:0/2291584975 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6568078b90 0x7f656807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:49.263 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.259+0000 7f657f7fe640 1 -- 172.21.15.105:0/2291584975 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5227+0+0 (secure 0 0 0) 0x7f65800bc0c0 con 0x7f65881f9570 2024-09-21T03:20:49.263 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.260+0000 7f658659c640 1 --2- 172.21.15.105:0/2291584975 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6568078b90 0x7f656807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:49.263 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.260+0000 7f658659c640 1 --2- 172.21.15.105:0/2291584975 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6568078b90 0x7f656807b0a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f657800bb50 tx=0x7f657800b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:49.266 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.264+0000 7f657f7fe640 1 -- 172.21.15.105:0/2291584975 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f65880a2420 con 0x7f65881f9570 2024-09-21T03:20:49.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:49.444+0000 7f658c816640 1 -- 172.21.15.105:0/2291584975 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f65880cf900 con 0x7f65881f9570 2024-09-21T03:20:50.116 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.113+0000 7f657f7fe640 1 -- 172.21.15.105:0/2291584975 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v55) ==== 170+0+0 (secure 0 0 0) 0x7f65800846f0 con 0x7f65881f9570 2024-09-21T03:20:50.116 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_data' created 2024-09-21T03:20:50.118 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.116+0000 7f658c816640 1 -- 172.21.15.105:0/2291584975 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6568078b90 msgr2=0x7f656807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:50.118 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.116+0000 7f658c816640 1 --2- 172.21.15.105:0/2291584975 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6568078b90 0x7f656807b0a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f657800bb50 tx=0x7f657800b2e0 comp rx=0 tx=0).stop 2024-09-21T03:20:50.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.116+0000 7f658c816640 1 -- 172.21.15.105:0/2291584975 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65881f9570 msgr2=0x7f65881f89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:50.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.116+0000 7f658c816640 1 --2- 172.21.15.105:0/2291584975 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65881f9570 0x7f65881f89b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f658002b060 tx=0x7f6580003f90 comp rx=0 tx=0).stop 2024-09-21T03:20:50.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.116+0000 7f658c816640 1 -- 172.21.15.105:0/2291584975 shutdown_connections 2024-09-21T03:20:50.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.116+0000 7f658c816640 1 --2- 172.21.15.105:0/2291584975 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6568078b90 0x7f656807b0a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:50.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.116+0000 7f658c816640 1 --2- 172.21.15.105:0/2291584975 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65881f9570 0x7f65881f89b0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:50.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.116+0000 7f658c816640 1 --2- 172.21.15.105:0/2291584975 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65880ceb40 0x7f65880a1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:50.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.116+0000 7f658c816640 1 --2- 172.21.15.105:0/2291584975 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f658806f4b0 0x7f65880c9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:50.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.116+0000 7f658c816640 1 -- 172.21.15.105:0/2291584975 >> 172.21.15.105:0/2291584975 conn(0x7f658808bfc0 msgr2=0x7f6588068d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:50.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.116+0000 7f658c816640 1 -- 172.21.15.105:0/2291584975 shutdown_connections 2024-09-21T03:20:50.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.116+0000 7f658c816640 1 -- 172.21.15.105:0/2291584975 wait complete. 2024-09-21T03:20:50.142 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T03:20:50.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.256+0000 7f1045c8b640 1 -- 172.21.15.105:0/1381656565 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1028003c10 msgr2=0x7f1028004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:50.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.256+0000 7f1045c8b640 1 --2- 172.21.15.105:0/1381656565 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1028003c10 0x7f1028004060 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1030009b50 tx=0x7f1028005830 comp rx=0 tx=0).stop 2024-09-21T03:20:50.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.256+0000 7f103ffff640 1 -- 172.21.15.105:0/1381656565 reap_dead start 2024-09-21T03:20:50.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.256+0000 7f1045c8b640 1 -- 172.21.15.105:0/1381656565 shutdown_connections 2024-09-21T03:20:50.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.256+0000 7f1045c8b640 1 -- 172.21.15.105:0/1381656565 >> 172.21.15.105:0/1381656565 conn(0x7f104006d4f0 msgr2=0x7f1040071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:50.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.256+0000 7f1045c8b640 1 -- 172.21.15.105:0/1381656565 shutdown_connections 2024-09-21T03:20:50.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.256+0000 7f1045c8b640 1 -- 172.21.15.105:0/1381656565 wait complete. 2024-09-21T03:20:50.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.258+0000 7f1045c8b640 1 Processor -- start 2024-09-21T03:20:50.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.258+0000 7f1045c8b640 1 -- start start 2024-09-21T03:20:50.267 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.259+0000 7f1045c8b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1028003c10 0x7f10401f6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:50.267 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.259+0000 7f1045c8b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1040158820 0x7f10400b3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:50.267 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.259+0000 7f1045c8b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1040151060 0x7f10400b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:50.267 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.259+0000 7f1045c8b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f10400d0530 con 0x7f1040158820 2024-09-21T03:20:50.268 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.259+0000 7f1045c8b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f10400cd080 con 0x7f1028003c10 2024-09-21T03:20:50.268 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.259+0000 7f1045c8b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f10400d06b0 con 0x7f1040151060 2024-09-21T03:20:50.268 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.260+0000 7f103effd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1040158820 0x7f10400b3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:50.268 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.260+0000 7f103effd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1040158820 0x7f10400b3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:54536/0 (socket says 172.21.15.105:54536) 2024-09-21T03:20:50.268 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.260+0000 7f103effd640 1 -- 172.21.15.105:0/438306883 learned_addr learned my addr 172.21.15.105:0/438306883 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:50.268 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.260+0000 7f103f7fe640 1 --2- 172.21.15.105:0/438306883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1028003c10 0x7f10401f6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:50.268 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.260+0000 7f103ffff640 1 --2- 172.21.15.105:0/438306883 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1040151060 0x7f10400b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:50.269 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.260+0000 7f103effd640 1 -- 172.21.15.105:0/438306883 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1040151060 msgr2=0x7f10400b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:50.269 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.260+0000 7f103effd640 1 --2- 172.21.15.105:0/438306883 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1040151060 0x7f10400b3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:50.269 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.260+0000 7f103effd640 1 -- 172.21.15.105:0/438306883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1028003c10 msgr2=0x7f10401f6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:50.269 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.260+0000 7f103effd640 1 --2- 172.21.15.105:0/438306883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1028003c10 0x7f10401f6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:50.269 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.260+0000 7f103effd640 1 -- 172.21.15.105:0/438306883 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1040153d10 con 0x7f1040158820 2024-09-21T03:20:50.269 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.260+0000 7f103effd640 1 --2- 172.21.15.105:0/438306883 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1040158820 0x7f10400b3680 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f1034003ec0 tx=0x7f1034001800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:50.269 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.260+0000 7f1027fff640 1 -- 172.21.15.105:0/438306883 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1034016030 con 0x7f1040158820 2024-09-21T03:20:50.269 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.260+0000 7f1027fff640 1 -- 172.21.15.105:0/438306883 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1034011700 con 0x7f1040158820 2024-09-21T03:20:50.270 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.260+0000 7f1027fff640 1 -- 172.21.15.105:0/438306883 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1034011b50 con 0x7f1040158820 2024-09-21T03:20:50.270 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.260+0000 7f1045c8b640 1 -- 172.21.15.105:0/438306883 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10400b4100 con 0x7f1040158820 2024-09-21T03:20:50.270 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.260+0000 7f1045c8b640 1 -- 172.21.15.105:0/438306883 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1040154260 con 0x7f1040158820 2024-09-21T03:20:50.270 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.261+0000 7f1045c8b640 1 -- 172.21.15.105:0/438306883 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1040069450 con 0x7f1040158820 2024-09-21T03:20:50.270 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.262+0000 7f1027fff640 1 -- 172.21.15.105:0/438306883 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1034019070 con 0x7f1040158820 2024-09-21T03:20:50.270 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.262+0000 7f1027fff640 1 --2- 172.21.15.105:0/438306883 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f102c078bc0 0x7f102c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:50.270 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.262+0000 7f1027fff640 1 -- 172.21.15.105:0/438306883 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5609+0+0 (secure 0 0 0) 0x7f103409b340 con 0x7f1040158820 2024-09-21T03:20:50.270 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.263+0000 7f103f7fe640 1 --2- 172.21.15.105:0/438306883 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f102c078bc0 0x7f102c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:50.270 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.263+0000 7f103f7fe640 1 --2- 172.21.15.105:0/438306883 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f102c078bc0 0x7f102c07b0d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1030035000 tx=0x7f103002d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:50.270 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.267+0000 7f1027fff640 1 -- 172.21.15.105:0/438306883 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1040069450 con 0x7f1040158820 2024-09-21T03:20:50.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:50.479+0000 7f1045c8b640 1 -- 172.21.15.105:0/438306883 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f10400d0c40 con 0x7f1040158820 2024-09-21T03:20:51.117 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.114+0000 7f1027fff640 1 -- 172.21.15.105:0/438306883 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v29) ==== 172+0+0 (secure 0 0 0) 0x7f1034063870 con 0x7f1040158820 2024-09-21T03:20:51.117 INFO:teuthology.orchestra.run.smithi105.stderr:new fs with metadata pool 8 and data pool 9 2024-09-21T03:20:51.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.119+0000 7f1045c8b640 1 -- 172.21.15.105:0/438306883 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f102c078bc0 msgr2=0x7f102c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:51.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.119+0000 7f1045c8b640 1 --2- 172.21.15.105:0/438306883 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f102c078bc0 0x7f102c07b0d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1030035000 tx=0x7f103002d040 comp rx=0 tx=0).stop 2024-09-21T03:20:51.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.119+0000 7f1045c8b640 1 -- 172.21.15.105:0/438306883 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1040158820 msgr2=0x7f10400b3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:51.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.119+0000 7f1045c8b640 1 --2- 172.21.15.105:0/438306883 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1040158820 0x7f10400b3680 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f1034003ec0 tx=0x7f1034001800 comp rx=0 tx=0).stop 2024-09-21T03:20:51.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.120+0000 7f1045c8b640 1 -- 172.21.15.105:0/438306883 shutdown_connections 2024-09-21T03:20:51.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.120+0000 7f1045c8b640 1 --2- 172.21.15.105:0/438306883 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f102c078bc0 0x7f102c07b0d0 secure :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1030035000 tx=0x7f103002d040 comp rx=0 tx=0).stop 2024-09-21T03:20:51.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.120+0000 7f1045c8b640 1 --2- 172.21.15.105:0/438306883 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1040151060 0x7f10400b3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:51.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.120+0000 7f1045c8b640 1 --2- 172.21.15.105:0/438306883 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1040158820 0x7f10400b3680 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:51.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.120+0000 7f1045c8b640 1 --2- 172.21.15.105:0/438306883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1028003c10 0x7f10401f6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:51.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.120+0000 7f1045c8b640 1 -- 172.21.15.105:0/438306883 >> 172.21.15.105:0/438306883 conn(0x7f104006d4f0 msgr2=0x7f104015eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:51.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.121+0000 7f1045c8b640 1 -- 172.21.15.105:0/438306883 shutdown_connections 2024-09-21T03:20:51.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.121+0000 7f1045c8b640 1 -- 172.21.15.105:0/438306883 wait complete. 2024-09-21T03:20:51.156 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:20:51.269 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.267+0000 7f549528b640 1 -- 172.21.15.105:0/3176023305 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5490070440 msgr2=0x7f5490074b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:51.270 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.267+0000 7f549528b640 1 --2- 172.21.15.105:0/3176023305 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5490070440 0x7f5490074b80 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5488005fd0 tx=0x7f548802a5d0 comp rx=0 tx=0).stop 2024-09-21T03:20:51.270 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.267+0000 7f549528b640 1 -- 172.21.15.105:0/3176023305 shutdown_connections 2024-09-21T03:20:51.270 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.267+0000 7f549528b640 1 --2- 172.21.15.105:0/3176023305 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5490070440 0x7f5490074b80 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:51.270 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.267+0000 7f549528b640 1 --2- 172.21.15.105:0/3176023305 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5490070030 0x7f5490074640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:51.270 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.267+0000 7f549528b640 1 -- 172.21.15.105:0/3176023305 >> 172.21.15.105:0/3176023305 conn(0x7f54900b1cb0 msgr2=0x7f54900b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:51.270 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.267+0000 7f549528b640 1 -- 172.21.15.105:0/3176023305 shutdown_connections 2024-09-21T03:20:51.270 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.267+0000 7f549528b640 1 -- 172.21.15.105:0/3176023305 wait complete. 2024-09-21T03:20:51.271 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.269+0000 7f549528b640 1 Processor -- start 2024-09-21T03:20:51.271 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.269+0000 7f549528b640 1 -- start start 2024-09-21T03:20:51.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.270+0000 7f549528b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5490070030 0x7f54901594f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:51.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.270+0000 7f549528b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5490070440 0x7f5490158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:51.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.270+0000 7f549528b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5490073170 0x7f549009bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:51.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.270+0000 7f549528b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f54900b3a90 con 0x7f5490070440 2024-09-21T03:20:51.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.270+0000 7f549528b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f54900b3910 con 0x7f5490070030 2024-09-21T03:20:51.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.270+0000 7f549528b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f54900b3c10 con 0x7f5490073170 2024-09-21T03:20:51.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.270+0000 7f548e7fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5490070440 0x7f5490158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:51.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.270+0000 7f548e7fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5490070440 0x7f5490158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:54554/0 (socket says 172.21.15.105:54554) 2024-09-21T03:20:51.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.270+0000 7f548e7fc640 1 -- 172.21.15.105:0/300276952 learned_addr learned my addr 172.21.15.105:0/300276952 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:51.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.270+0000 7f548e7fc640 1 -- 172.21.15.105:0/300276952 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5490073170 msgr2=0x7f549009bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:51.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.270+0000 7f548e7fc640 1 --2- 172.21.15.105:0/300276952 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5490073170 0x7f549009bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:51.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.270+0000 7f548e7fc640 1 -- 172.21.15.105:0/300276952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5490070030 msgr2=0x7f54901594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:51.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.270+0000 7f548e7fc640 1 --2- 172.21.15.105:0/300276952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5490070030 0x7f54901594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:51.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.270+0000 7f548e7fc640 1 -- 172.21.15.105:0/300276952 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f549009aad0 con 0x7f5490070440 2024-09-21T03:20:51.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.270+0000 7f548e7fc640 1 --2- 172.21.15.105:0/300276952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5490070440 0x7f5490158110 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f548400d650 tx=0x7f548400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:51.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.271+0000 7f54777fe640 1 -- 172.21.15.105:0/300276952 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5484017070 con 0x7f5490070440 2024-09-21T03:20:51.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.271+0000 7f54777fe640 1 -- 172.21.15.105:0/300276952 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5484009ab0 con 0x7f5490070440 2024-09-21T03:20:51.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.271+0000 7f549528b640 1 -- 172.21.15.105:0/300276952 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5490159a30 con 0x7f5490070440 2024-09-21T03:20:51.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.271+0000 7f54777fe640 1 -- 172.21.15.105:0/300276952 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5484010460 con 0x7f5490070440 2024-09-21T03:20:51.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.271+0000 7f549528b640 1 -- 172.21.15.105:0/300276952 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f549009b050 con 0x7f5490070440 2024-09-21T03:20:51.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.272+0000 7f549528b640 1 -- 172.21.15.105:0/300276952 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54900b4130 con 0x7f5490070440 2024-09-21T03:20:51.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.272+0000 7f54777fe640 1 -- 172.21.15.105:0/300276952 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f548401a070 con 0x7f5490070440 2024-09-21T03:20:51.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.273+0000 7f54777fe640 1 --2- 172.21.15.105:0/300276952 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f547c078b90 0x7f547c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:51.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.273+0000 7f54777fe640 1 -- 172.21.15.105:0/300276952 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5709+0+0 (secure 0 0 0) 0x7f548409ae60 con 0x7f5490070440 2024-09-21T03:20:51.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.273+0000 7f548effd640 1 --2- 172.21.15.105:0/300276952 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f547c078b90 0x7f547c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:51.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.274+0000 7f548effd640 1 --2- 172.21.15.105:0/300276952 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f547c078b90 0x7f547c07b0a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f54800012e0 tx=0x7f5480007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:51.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.277+0000 7f54777fe640 1 -- 172.21.15.105:0/300276952 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f54840632a0 con 0x7f5490070440 2024-09-21T03:20:51.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.453+0000 7f549528b640 1 -- 172.21.15.105:0/300276952 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f54900ae560 con 0x7f5490070440 2024-09-21T03:20:51.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.454+0000 7f54777fe640 1 -- 172.21.15.105:0/300276952 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) ==== 74+0+16810 (secure 0 0 0) 0x7f5484062ba0 con 0x7f5490070440 2024-09-21T03:20:51.457 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:20:51.457 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":56,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:20:50.482153+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:20:48.140896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-21T03:20:49.449787+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:20:51.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.456+0000 7f549528b640 1 -- 172.21.15.105:0/300276952 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f547c078b90 msgr2=0x7f547c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:51.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.456+0000 7f549528b640 1 --2- 172.21.15.105:0/300276952 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f547c078b90 0x7f547c07b0a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f54800012e0 tx=0x7f5480007d30 comp rx=0 tx=0).stop 2024-09-21T03:20:51.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.456+0000 7f549528b640 1 -- 172.21.15.105:0/300276952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5490070440 msgr2=0x7f5490158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:51.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.456+0000 7f549528b640 1 --2- 172.21.15.105:0/300276952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5490070440 0x7f5490158110 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f548400d650 tx=0x7f548400db10 comp rx=0 tx=0).stop 2024-09-21T03:20:51.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.457+0000 7f549528b640 1 -- 172.21.15.105:0/300276952 shutdown_connections 2024-09-21T03:20:51.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.457+0000 7f549528b640 1 --2- 172.21.15.105:0/300276952 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f547c078b90 0x7f547c07b0a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:51.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.457+0000 7f549528b640 1 --2- 172.21.15.105:0/300276952 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5490073170 0x7f549009bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:51.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.457+0000 7f549528b640 1 --2- 172.21.15.105:0/300276952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5490070440 0x7f5490158110 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:51.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.457+0000 7f549528b640 1 --2- 172.21.15.105:0/300276952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5490070030 0x7f54901594f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:51.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.457+0000 7f549528b640 1 -- 172.21.15.105:0/300276952 >> 172.21.15.105:0/300276952 conn(0x7f54900b1cb0 msgr2=0x7f54900ad800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:51.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.457+0000 7f549528b640 1 -- 172.21.15.105:0/300276952 shutdown_connections 2024-09-21T03:20:51.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.457+0000 7f549528b640 1 -- 172.21.15.105:0/300276952 wait complete. 2024-09-21T03:20:51.472 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:20:51.584 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.581+0000 7efe17771640 1 -- 172.21.15.105:0/2015335562 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdfc003c10 msgr2=0x7efdfc004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:51.585 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.581+0000 7efe17771640 1 --2- 172.21.15.105:0/2015335562 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdfc003c10 0x7efdfc004060 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7efe0c001f80 tx=0x7efdfc005830 comp rx=0 tx=0).stop 2024-09-21T03:20:51.585 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.581+0000 7efe15d0e640 1 -- 172.21.15.105:0/2015335562 reap_dead start 2024-09-21T03:20:51.585 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.582+0000 7efe17771640 1 -- 172.21.15.105:0/2015335562 shutdown_connections 2024-09-21T03:20:51.585 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.582+0000 7efe17771640 1 -- 172.21.15.105:0/2015335562 >> 172.21.15.105:0/2015335562 conn(0x7efe1009d7f0 msgr2=0x7efe100d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:51.585 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.582+0000 7efe17771640 1 -- 172.21.15.105:0/2015335562 shutdown_connections 2024-09-21T03:20:51.585 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.582+0000 7efe17771640 1 -- 172.21.15.105:0/2015335562 wait complete. 2024-09-21T03:20:51.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.583+0000 7efe17771640 1 Processor -- start 2024-09-21T03:20:51.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.583+0000 7efe17771640 1 -- start start 2024-09-21T03:20:51.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.585+0000 7efe17771640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efdfc003c10 0x7efe1015e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:51.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.585+0000 7efe17771640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe100c9db0 0x7efe100b2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:51.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.585+0000 7efe17771640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe100b3070 0x7efe100c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:51.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.585+0000 7efe17771640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efe100d5110 con 0x7efe100c9db0 2024-09-21T03:20:51.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.585+0000 7efe17771640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efe100d4f90 con 0x7efdfc003c10 2024-09-21T03:20:51.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.585+0000 7efe17771640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7efe1006f1c0 con 0x7efe100b3070 2024-09-21T03:20:51.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.585+0000 7efe14d0c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe100c9db0 0x7efe100b2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:51.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.585+0000 7efe14d0c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe100c9db0 0x7efe100b2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:35680/0 (socket says 172.21.15.105:35680) 2024-09-21T03:20:51.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.585+0000 7efe14d0c640 1 -- 172.21.15.105:0/787871180 learned_addr learned my addr 172.21.15.105:0/787871180 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:51.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.585+0000 7efe15d0e640 1 --2- 172.21.15.105:0/787871180 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe100b3070 0x7efe100c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:51.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.585+0000 7efe1550d640 1 --2- 172.21.15.105:0/787871180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efdfc003c10 0x7efe1015e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:51.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.585+0000 7efe14d0c640 1 -- 172.21.15.105:0/787871180 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe100b3070 msgr2=0x7efe100c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:51.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.585+0000 7efe14d0c640 1 --2- 172.21.15.105:0/787871180 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe100b3070 0x7efe100c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:51.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.585+0000 7efe14d0c640 1 -- 172.21.15.105:0/787871180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efdfc003c10 msgr2=0x7efe1015e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:51.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.585+0000 7efe14d0c640 1 --2- 172.21.15.105:0/787871180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efdfc003c10 0x7efe1015e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:51.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.585+0000 7efe14d0c640 1 -- 172.21.15.105:0/787871180 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe100cc670 con 0x7efe100c9db0 2024-09-21T03:20:51.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.585+0000 7efe14d0c640 1 --2- 172.21.15.105:0/787871180 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe100c9db0 0x7efe100b2b30 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7efe00011ab0 tx=0x7efe00011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:51.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.585+0000 7efe05ffb640 1 -- 172.21.15.105:0/787871180 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0001e070 con 0x7efe100c9db0 2024-09-21T03:20:51.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.585+0000 7efe05ffb640 1 -- 172.21.15.105:0/787871180 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe0000fe70 con 0x7efe100c9db0 2024-09-21T03:20:51.591 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.585+0000 7efe05ffb640 1 -- 172.21.15.105:0/787871180 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe000042b0 con 0x7efe100c9db0 2024-09-21T03:20:51.591 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.585+0000 7efe17771640 1 -- 172.21.15.105:0/787871180 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe100b3480 con 0x7efe100c9db0 2024-09-21T03:20:51.591 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.586+0000 7efe17771640 1 -- 172.21.15.105:0/787871180 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe100a1770 con 0x7efe100c9db0 2024-09-21T03:20:51.592 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.587+0000 7efe17771640 1 -- 172.21.15.105:0/787871180 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe100b5fa0 con 0x7efe100c9db0 2024-09-21T03:20:51.592 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.587+0000 7efe05ffb640 1 -- 172.21.15.105:0/787871180 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efe00021070 con 0x7efe100c9db0 2024-09-21T03:20:51.592 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.588+0000 7efe05ffb640 1 --2- 172.21.15.105:0/787871180 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efdf4078b90 0x7efdf407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:51.592 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.588+0000 7efe05ffb640 1 -- 172.21.15.105:0/787871180 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5709+0+0 (secure 0 0 0) 0x7efe0009b6f0 con 0x7efe100c9db0 2024-09-21T03:20:51.592 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.588+0000 7efe1550d640 1 --2- 172.21.15.105:0/787871180 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efdf4078b90 0x7efdf407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:51.592 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.589+0000 7efe1550d640 1 --2- 172.21.15.105:0/787871180 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efdf4078b90 0x7efdf407b0a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efe0c001f50 tx=0x7efe0c001730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:51.595 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.592+0000 7efe05ffb640 1 -- 172.21.15.105:0/787871180 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7efe100b3480 con 0x7efe100c9db0 2024-09-21T03:20:51.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.770+0000 7efe17771640 1 -- 172.21.15.105:0/787871180 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efe100d3fb0 con 0x7efe100c9db0 2024-09-21T03:20:51.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.771+0000 7efe05ffb640 1 -- 172.21.15.105:0/787871180 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) ==== 74+0+16810 (secure 0 0 0) 0x7efe00063600 con 0x7efe100c9db0 2024-09-21T03:20:51.774 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:20:51.774 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":56,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:20:50.482153+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:20:48.140896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-21T03:20:49.449787+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:20:51.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.774+0000 7efe17771640 1 -- 172.21.15.105:0/787871180 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efdf4078b90 msgr2=0x7efdf407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:51.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.774+0000 7efe17771640 1 --2- 172.21.15.105:0/787871180 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efdf4078b90 0x7efdf407b0a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efe0c001f50 tx=0x7efe0c001730 comp rx=0 tx=0).stop 2024-09-21T03:20:51.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.774+0000 7efe17771640 1 -- 172.21.15.105:0/787871180 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe100c9db0 msgr2=0x7efe100b2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:51.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.774+0000 7efe17771640 1 --2- 172.21.15.105:0/787871180 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe100c9db0 0x7efe100b2b30 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7efe00011ab0 tx=0x7efe00011f70 comp rx=0 tx=0).stop 2024-09-21T03:20:51.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.774+0000 7efe17771640 1 -- 172.21.15.105:0/787871180 shutdown_connections 2024-09-21T03:20:51.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.774+0000 7efe17771640 1 --2- 172.21.15.105:0/787871180 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efdf4078b90 0x7efdf407b0a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:51.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.774+0000 7efe17771640 1 --2- 172.21.15.105:0/787871180 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe100b3070 0x7efe100c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:51.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.774+0000 7efe17771640 1 --2- 172.21.15.105:0/787871180 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe100c9db0 0x7efe100b2b30 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:51.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.774+0000 7efe17771640 1 --2- 172.21.15.105:0/787871180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efdfc003c10 0x7efe1015e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:51.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.774+0000 7efe17771640 1 -- 172.21.15.105:0/787871180 >> 172.21.15.105:0/787871180 conn(0x7efe1009d7f0 msgr2=0x7efe100ceb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:51.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.774+0000 7efe17771640 1 -- 172.21.15.105:0/787871180 shutdown_connections 2024-09-21T03:20:51.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.774+0000 7efe17771640 1 -- 172.21.15.105:0/787871180 wait complete. 2024-09-21T03:20:51.788 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T03:20:51.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.901+0000 7f77d63ba640 1 -- 172.21.15.105:0/915553336 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77d006e170 msgr2=0x7f77d00b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:51.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.901+0000 7f77d63ba640 1 --2- 172.21.15.105:0/915553336 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77d006e170 0x7f77d00b3540 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f77c0009830 tx=0x7f77c002a480 comp rx=0 tx=0).stop 2024-09-21T03:20:51.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.901+0000 7f77d63ba640 1 -- 172.21.15.105:0/915553336 shutdown_connections 2024-09-21T03:20:51.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.901+0000 7f77d63ba640 1 --2- 172.21.15.105:0/915553336 >> v2:172.21.15.162:3300/0 conn(0x7f77d006f4b0 0x7f77d00d3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:51.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.901+0000 7f77d63ba640 1 --2- 172.21.15.105:0/915553336 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77d006e170 0x7f77d00b3540 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:51.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.901+0000 7f77d63ba640 1 -- 172.21.15.105:0/915553336 >> 172.21.15.105:0/915553336 conn(0x7f77d008bfc0 msgr2=0x7f77d009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:51.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.901+0000 7f77d63ba640 1 -- 172.21.15.105:0/915553336 shutdown_connections 2024-09-21T03:20:51.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.901+0000 7f77d63ba640 1 -- 172.21.15.105:0/915553336 wait complete. 2024-09-21T03:20:51.906 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.903+0000 7f77d63ba640 1 Processor -- start 2024-09-21T03:20:51.906 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.903+0000 7f77d63ba640 1 -- start start 2024-09-21T03:20:51.908 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.905+0000 7f77d63ba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77d006f4b0 0x7f77d00cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:51.908 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.905+0000 7f77d63ba640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77d00d3870 0x7f77d00b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:51.909 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.905+0000 7f77d63ba640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77d01f8780 0x7f77d01f8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:51.909 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.905+0000 7f77d63ba640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f77d00d0e60 con 0x7f77d00d3870 2024-09-21T03:20:51.909 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.905+0000 7f77d63ba640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f77d00d0ce0 con 0x7f77d006f4b0 2024-09-21T03:20:51.909 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.905+0000 7f77d63ba640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f77d00d0fe0 con 0x7f77d01f8780 2024-09-21T03:20:51.909 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.905+0000 7f77cf7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77d00d3870 0x7f77d00b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:51.909 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.905+0000 7f77cf7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77d00d3870 0x7f77d00b5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:35688/0 (socket says 172.21.15.105:35688) 2024-09-21T03:20:51.909 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.905+0000 7f77cf7fe640 1 -- 172.21.15.105:0/1314578520 learned_addr learned my addr 172.21.15.105:0/1314578520 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:51.909 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.905+0000 7f77cffff640 1 --2- 172.21.15.105:0/1314578520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77d006f4b0 0x7f77d00cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:51.909 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.905+0000 7f77d4957640 1 --2- 172.21.15.105:0/1314578520 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77d01f8780 0x7f77d01f8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:51.909 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.905+0000 7f77cf7fe640 1 -- 172.21.15.105:0/1314578520 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77d01f8780 msgr2=0x7f77d01f8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:51.909 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.905+0000 7f77cf7fe640 1 --2- 172.21.15.105:0/1314578520 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77d01f8780 0x7f77d01f8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:51.909 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.905+0000 7f77cf7fe640 1 -- 172.21.15.105:0/1314578520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77d006f4b0 msgr2=0x7f77d00cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:51.909 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.905+0000 7f77cf7fe640 1 --2- 172.21.15.105:0/1314578520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77d006f4b0 0x7f77d00cb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:51.910 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.905+0000 7f77cf7fe640 1 -- 172.21.15.105:0/1314578520 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77d01f95e0 con 0x7f77d00d3870 2024-09-21T03:20:51.910 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.905+0000 7f77cf7fe640 1 --2- 172.21.15.105:0/1314578520 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77d00d3870 0x7f77d00b5c50 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f77c400e9f0 tx=0x7f77c400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:51.910 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.905+0000 7f77ccff9640 1 -- 172.21.15.105:0/1314578520 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c4004440 con 0x7f77d00d3870 2024-09-21T03:20:51.910 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.906+0000 7f77d63ba640 1 -- 172.21.15.105:0/1314578520 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77d01f90d0 con 0x7f77d00d3870 2024-09-21T03:20:51.910 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.906+0000 7f77ccff9640 1 -- 172.21.15.105:0/1314578520 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f77c400c9a0 con 0x7f77d00d3870 2024-09-21T03:20:51.910 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.906+0000 7f77ccff9640 1 -- 172.21.15.105:0/1314578520 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c400cdd0 con 0x7f77d00d3870 2024-09-21T03:20:51.910 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.906+0000 7f77d63ba640 1 -- 172.21.15.105:0/1314578520 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77d00b4bb0 con 0x7f77d00d3870 2024-09-21T03:20:51.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.907+0000 7f77d63ba640 1 -- 172.21.15.105:0/1314578520 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77d00d1500 con 0x7f77d00d3870 2024-09-21T03:20:51.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.907+0000 7f77ccff9640 1 -- 172.21.15.105:0/1314578520 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f77c40035f0 con 0x7f77d00d3870 2024-09-21T03:20:51.912 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.908+0000 7f77ccff9640 1 --2- 172.21.15.105:0/1314578520 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f77bc078b90 0x7f77bc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:51.912 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.908+0000 7f77ccff9640 1 -- 172.21.15.105:0/1314578520 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5709+0+0 (secure 0 0 0) 0x7f77c409b8c0 con 0x7f77d00d3870 2024-09-21T03:20:51.912 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.908+0000 7f77cffff640 1 --2- 172.21.15.105:0/1314578520 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f77bc078b90 0x7f77bc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:51.912 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.909+0000 7f77cffff640 1 --2- 172.21.15.105:0/1314578520 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f77bc078b90 0x7f77bc07b0a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f77c0009830 tx=0x7f77c0004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:51.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:51.912+0000 7f77ccff9640 1 -- 172.21.15.105:0/1314578520 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f77d01f90d0 con 0x7f77d00d3870 2024-09-21T03:20:52.131 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:52.129+0000 7f77d63ba640 1 -- 172.21.15.105:0/1314578520 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f77d006eea0 con 0x7f77d00d3870 2024-09-21T03:20:53.138 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.136+0000 7f77ccff9640 1 -- 172.21.15.105:0/1314578520 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v31) ==== 118+0+0 (secure 0 0 0) 0x7f77d01f95e0 con 0x7f77d00d3870 2024-09-21T03:20:53.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.139+0000 7f77d63ba640 1 -- 172.21.15.105:0/1314578520 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f77bc078b90 msgr2=0x7f77bc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:53.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.139+0000 7f77d63ba640 1 --2- 172.21.15.105:0/1314578520 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f77bc078b90 0x7f77bc07b0a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f77c0009830 tx=0x7f77c0004730 comp rx=0 tx=0).stop 2024-09-21T03:20:53.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.139+0000 7f77d63ba640 1 -- 172.21.15.105:0/1314578520 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77d00d3870 msgr2=0x7f77d00b5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:53.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.139+0000 7f77d63ba640 1 --2- 172.21.15.105:0/1314578520 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77d00d3870 0x7f77d00b5c50 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f77c400e9f0 tx=0x7f77c400eeb0 comp rx=0 tx=0).stop 2024-09-21T03:20:53.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.139+0000 7f77d63ba640 1 -- 172.21.15.105:0/1314578520 shutdown_connections 2024-09-21T03:20:53.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.139+0000 7f77d63ba640 1 --2- 172.21.15.105:0/1314578520 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f77bc078b90 0x7f77bc07b0a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:53.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.139+0000 7f77d63ba640 1 --2- 172.21.15.105:0/1314578520 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77d01f8780 0x7f77d01f8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:53.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.139+0000 7f77d63ba640 1 --2- 172.21.15.105:0/1314578520 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77d00d3870 0x7f77d00b5c50 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:53.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.139+0000 7f77d63ba640 1 --2- 172.21.15.105:0/1314578520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77d006f4b0 0x7f77d00cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:53.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.139+0000 7f77d63ba640 1 -- 172.21.15.105:0/1314578520 >> 172.21.15.105:0/1314578520 conn(0x7f77d008bfc0 msgr2=0x7f77d0161aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:53.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.139+0000 7f77d63ba640 1 -- 172.21.15.105:0/1314578520 shutdown_connections 2024-09-21T03:20:53.145 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.139+0000 7f77d63ba640 1 -- 172.21.15.105:0/1314578520 wait complete. 2024-09-21T03:20:53.155 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T03:20:53.156 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T03:20:53.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.274+0000 7f408db6e640 1 -- 172.21.15.105:0/4122388176 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40880cec50 msgr2=0x7f40880cf060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:53.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.274+0000 7f408db6e640 1 --2- 172.21.15.105:0/4122388176 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40880cec50 0x7f40880cf060 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f40880b4ea0 tx=0x7f408002a560 comp rx=0 tx=0).stop 2024-09-21T03:20:53.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.274+0000 7f408db6e640 1 -- 172.21.15.105:0/4122388176 shutdown_connections 2024-09-21T03:20:53.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.274+0000 7f408db6e640 1 --2- 172.21.15.105:0/4122388176 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40880cec50 0x7f40880cf060 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:53.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.274+0000 7f408db6e640 1 --2- 172.21.15.105:0/4122388176 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4088156f10 0x7f408815d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:53.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.274+0000 7f408db6e640 1 --2- 172.21.15.105:0/4122388176 >> v2:172.21.15.162:3300/0 conn(0x7f4088161020 0x7f40880ccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:53.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.274+0000 7f408db6e640 1 -- 172.21.15.105:0/4122388176 >> 172.21.15.105:0/4122388176 conn(0x7f408806d4f0 msgr2=0x7f4088071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:53.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.274+0000 7f408db6e640 1 -- 172.21.15.105:0/4122388176 shutdown_connections 2024-09-21T03:20:53.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.274+0000 7f408db6e640 1 -- 172.21.15.105:0/4122388176 wait complete. 2024-09-21T03:20:53.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.275+0000 7f408db6e640 1 Processor -- start 2024-09-21T03:20:53.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.276+0000 7f408db6e640 1 -- start start 2024-09-21T03:20:53.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.277+0000 7f408db6e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40880cec50 0x7f40881f3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:53.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.277+0000 7f408db6e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4088156f10 0x7f408814c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:53.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.277+0000 7f408db6e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4088161020 0x7f40880ca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:53.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.277+0000 7f408db6e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f40880d06b0 con 0x7f4088161020 2024-09-21T03:20:53.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.277+0000 7f408db6e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f40880d0530 con 0x7f40880cec50 2024-09-21T03:20:53.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.277+0000 7f408db6e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f40880d0830 con 0x7f4088156f10 2024-09-21T03:20:53.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.277+0000 7f4087fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4088161020 0x7f40880ca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:53.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.277+0000 7f4087fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4088161020 0x7f40880ca7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:35700/0 (socket says 172.21.15.105:35700) 2024-09-21T03:20:53.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.277+0000 7f4087fff640 1 -- 172.21.15.105:0/1824910544 learned_addr learned my addr 172.21.15.105:0/1824910544 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:53.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.277+0000 7f40877fe640 1 --2- 172.21.15.105:0/1824910544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40880cec50 0x7f40881f3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:53.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.277+0000 7f4086ffd640 1 --2- 172.21.15.105:0/1824910544 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4088156f10 0x7f408814c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:53.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.277+0000 7f4087fff640 1 -- 172.21.15.105:0/1824910544 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4088156f10 msgr2=0x7f408814c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:53.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.277+0000 7f4087fff640 1 --2- 172.21.15.105:0/1824910544 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4088156f10 0x7f408814c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:53.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.277+0000 7f4087fff640 1 -- 172.21.15.105:0/1824910544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40880cec50 msgr2=0x7f40881f3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:53.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.277+0000 7f4087fff640 1 --2- 172.21.15.105:0/1824910544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40880cec50 0x7f40881f3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:53.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.277+0000 7f4087fff640 1 -- 172.21.15.105:0/1824910544 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40881f41e0 con 0x7f4088161020 2024-09-21T03:20:53.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.277+0000 7f4086ffd640 1 --2- 172.21.15.105:0/1824910544 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4088156f10 0x7f408814c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:20:53.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.278+0000 7f4087fff640 1 --2- 172.21.15.105:0/1824910544 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4088161020 0x7f40880ca7f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f4080009230 tx=0x7f4080003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:53.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.278+0000 7f406ffff640 1 -- 172.21.15.105:0/1824910544 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f408003e030 con 0x7f4088161020 2024-09-21T03:20:53.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.278+0000 7f406ffff640 1 -- 172.21.15.105:0/1824910544 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4080003e50 con 0x7f4088161020 2024-09-21T03:20:53.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.278+0000 7f408db6e640 1 -- 172.21.15.105:0/1824910544 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f408814cd90 con 0x7f4088161020 2024-09-21T03:20:53.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.278+0000 7f406ffff640 1 -- 172.21.15.105:0/1824910544 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4080035040 con 0x7f4088161020 2024-09-21T03:20:53.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.278+0000 7f408db6e640 1 -- 172.21.15.105:0/1824910544 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40881f4900 con 0x7f4088161020 2024-09-21T03:20:53.283 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.279+0000 7f408db6e640 1 -- 172.21.15.105:0/1824910544 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40880cdd80 con 0x7f4088161020 2024-09-21T03:20:53.283 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.279+0000 7f406ffff640 1 -- 172.21.15.105:0/1824910544 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4080041030 con 0x7f4088161020 2024-09-21T03:20:53.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.280+0000 7f406ffff640 1 --2- 172.21.15.105:0/1824910544 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4074078b90 0x7f407407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:53.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.280+0000 7f406ffff640 1 -- 172.21.15.105:0/1824910544 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f40800bb3f0 con 0x7f4088161020 2024-09-21T03:20:53.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.280+0000 7f40877fe640 1 --2- 172.21.15.105:0/1824910544 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4074078b90 0x7f407407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:53.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.281+0000 7f40877fe640 1 --2- 172.21.15.105:0/1824910544 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4074078b90 0x7f407407b0a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4078005fd0 tx=0x7f40780095e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:53.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.285+0000 7f406ffff640 1 -- 172.21.15.105:0/1824910544 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f40880cdd80 con 0x7f4088161020 2024-09-21T03:20:53.504 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:53.502+0000 7f408db6e640 1 -- 172.21.15.105:0/1824910544 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f40881f43b0 con 0x7f4088161020 2024-09-21T03:20:54.145 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.142+0000 7f406ffff640 1 -- 172.21.15.105:0/1824910544 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v32) ==== 122+0+0 (secure 0 0 0) 0x7f4080083270 con 0x7f4088161020 2024-09-21T03:20:54.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.146+0000 7f408db6e640 1 -- 172.21.15.105:0/1824910544 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4074078b90 msgr2=0x7f407407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:54.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.146+0000 7f408db6e640 1 --2- 172.21.15.105:0/1824910544 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4074078b90 0x7f407407b0a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4078005fd0 tx=0x7f40780095e0 comp rx=0 tx=0).stop 2024-09-21T03:20:54.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.146+0000 7f408db6e640 1 -- 172.21.15.105:0/1824910544 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4088161020 msgr2=0x7f40880ca7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:54.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.146+0000 7f408db6e640 1 --2- 172.21.15.105:0/1824910544 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4088161020 0x7f40880ca7f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f4080009230 tx=0x7f4080003960 comp rx=0 tx=0).stop 2024-09-21T03:20:54.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.146+0000 7f408db6e640 1 -- 172.21.15.105:0/1824910544 shutdown_connections 2024-09-21T03:20:54.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.146+0000 7f408db6e640 1 --2- 172.21.15.105:0/1824910544 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4074078b90 0x7f407407b0a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:54.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.146+0000 7f408db6e640 1 --2- 172.21.15.105:0/1824910544 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4088161020 0x7f40880ca7f0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:54.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.146+0000 7f408db6e640 1 --2- 172.21.15.105:0/1824910544 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4088156f10 0x7f408814c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:54.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.146+0000 7f408db6e640 1 --2- 172.21.15.105:0/1824910544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40880cec50 0x7f40881f3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:54.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.146+0000 7f408db6e640 1 -- 172.21.15.105:0/1824910544 >> 172.21.15.105:0/1824910544 conn(0x7f408806d4f0 msgr2=0x7f40880711c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:54.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.146+0000 7f408db6e640 1 -- 172.21.15.105:0/1824910544 shutdown_connections 2024-09-21T03:20:54.150 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.146+0000 7f408db6e640 1 -- 172.21.15.105:0/1824910544 wait complete. 2024-09-21T03:20:54.161 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T03:20:54.161 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:20:54.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.272+0000 7f4b07a7e640 1 -- 172.21.15.105:0/2903625497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b000d1d40 msgr2=0x7f4b000b5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:54.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.272+0000 7f4b07a7e640 1 --2- 172.21.15.105:0/2903625497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b000d1d40 0x7f4b000b5210 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f4afc005fd0 tx=0x7f4afc02aa00 comp rx=0 tx=0).stop 2024-09-21T03:20:54.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.272+0000 7f4b07a7e640 1 -- 172.21.15.105:0/2903625497 shutdown_connections 2024-09-21T03:20:54.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.272+0000 7f4b07a7e640 1 --2- 172.21.15.105:0/2903625497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b000ccba0 0x7f4b000ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:54.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.272+0000 7f4b07a7e640 1 --2- 172.21.15.105:0/2903625497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b000d1d40 0x7f4b000b5210 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:54.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.272+0000 7f4b07a7e640 1 -- 172.21.15.105:0/2903625497 >> 172.21.15.105:0/2903625497 conn(0x7f4b000b3f10 msgr2=0x7f4b000b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:54.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.272+0000 7f4b07a7e640 1 -- 172.21.15.105:0/2903625497 shutdown_connections 2024-09-21T03:20:54.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.272+0000 7f4b07a7e640 1 -- 172.21.15.105:0/2903625497 wait complete. 2024-09-21T03:20:54.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.274+0000 7f4b07a7e640 1 Processor -- start 2024-09-21T03:20:54.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.274+0000 7f4b07a7e640 1 -- start start 2024-09-21T03:20:54.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.275+0000 7f4b07a7e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b000ccba0 0x7f4b00155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:54.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.275+0000 7f4b07a7e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b000d1d40 0x7f4b000b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:54.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.275+0000 7f4b07a7e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b0015c6f0 0x7f4b001f5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:54.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.275+0000 7f4b07a7e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4b000d1270 con 0x7f4b0015c6f0 2024-09-21T03:20:54.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.275+0000 7f4b07a7e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4b000d10f0 con 0x7f4b000d1d40 2024-09-21T03:20:54.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.275+0000 7f4b07a7e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4b000d13f0 con 0x7f4b000ccba0 2024-09-21T03:20:54.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.275+0000 7f4b0601b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b0015c6f0 0x7f4b001f5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:54.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.275+0000 7f4b0601b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b0015c6f0 0x7f4b001f5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:35706/0 (socket says 172.21.15.105:35706) 2024-09-21T03:20:54.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.275+0000 7f4b0601b640 1 -- 172.21.15.105:0/3995003890 learned_addr learned my addr 172.21.15.105:0/3995003890 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:54.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.275+0000 7f4b05019640 1 --2- 172.21.15.105:0/3995003890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b000d1d40 0x7f4b000b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:54.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.275+0000 7f4b0581a640 1 --2- 172.21.15.105:0/3995003890 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b000ccba0 0x7f4b00155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:54.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.275+0000 7f4b0601b640 1 -- 172.21.15.105:0/3995003890 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b000ccba0 msgr2=0x7f4b00155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:54.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.275+0000 7f4b0601b640 1 --2- 172.21.15.105:0/3995003890 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b000ccba0 0x7f4b00155c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:54.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.275+0000 7f4b0601b640 1 -- 172.21.15.105:0/3995003890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b000d1d40 msgr2=0x7f4b000b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:54.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.275+0000 7f4b0601b640 1 --2- 172.21.15.105:0/3995003890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b000d1d40 0x7f4b000b0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:54.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.275+0000 7f4b0601b640 1 -- 172.21.15.105:0/3995003890 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b0006fec0 con 0x7f4b0015c6f0 2024-09-21T03:20:54.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.275+0000 7f4b0581a640 1 --2- 172.21.15.105:0/3995003890 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b000ccba0 0x7f4b00155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:20:54.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.275+0000 7f4b05019640 1 --2- 172.21.15.105:0/3995003890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b000d1d40 0x7f4b000b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:20:54.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.276+0000 7f4b0601b640 1 --2- 172.21.15.105:0/3995003890 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b0015c6f0 0x7f4b001f5de0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f4af800b410 tx=0x7f4af800b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:54.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.276+0000 7f4af67fc640 1 -- 172.21.15.105:0/3995003890 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af8015020 con 0x7f4b0015c6f0 2024-09-21T03:20:54.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.276+0000 7f4af67fc640 1 -- 172.21.15.105:0/3995003890 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4af8011920 con 0x7f4b0015c6f0 2024-09-21T03:20:54.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.276+0000 7f4af67fc640 1 -- 172.21.15.105:0/3995003890 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af8011d70 con 0x7f4b0015c6f0 2024-09-21T03:20:54.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.276+0000 7f4b07a7e640 1 -- 172.21.15.105:0/3995003890 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b001f9360 con 0x7f4b0015c6f0 2024-09-21T03:20:54.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.276+0000 7f4b07a7e640 1 -- 172.21.15.105:0/3995003890 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b001f9920 con 0x7f4b0015c6f0 2024-09-21T03:20:54.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.277+0000 7f4b07a7e640 1 -- 172.21.15.105:0/3995003890 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b000d1990 con 0x7f4b0015c6f0 2024-09-21T03:20:54.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.278+0000 7f4af67fc640 1 -- 172.21.15.105:0/3995003890 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4af8018020 con 0x7f4b0015c6f0 2024-09-21T03:20:54.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.278+0000 7f4af67fc640 1 --2- 172.21.15.105:0/3995003890 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4ae4078bc0 0x7f4ae407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:54.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.278+0000 7f4af67fc640 1 -- 172.21.15.105:0/3995003890 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f4af809ab90 con 0x7f4b0015c6f0 2024-09-21T03:20:54.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.278+0000 7f4b0581a640 1 --2- 172.21.15.105:0/3995003890 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4ae4078bc0 0x7f4ae407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:54.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.279+0000 7f4b0581a640 1 --2- 172.21.15.105:0/3995003890 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4ae4078bc0 0x7f4ae407b0d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4afc035000 tx=0x7f4afc004ab0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:54.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.283+0000 7f4af67fc640 1 -- 172.21.15.105:0/3995003890 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4af801f020 con 0x7f4b0015c6f0 2024-09-21T03:20:54.499 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.497+0000 7f4b07a7e640 1 -- 172.21.15.105:0/3995003890 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4b00069060 con 0x7f4b0015c6f0 2024-09-21T03:20:54.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.497+0000 7f4af67fc640 1 -- 172.21.15.105:0/3995003890 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+5232 (secure 0 0 0) 0x7f4af8063060 con 0x7f4b0015c6f0 2024-09-21T03:20:54.500 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:20:54.500 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":32,"btime":"2024-09-21T03:20:54:138507+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5099,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3633306312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3633306312},{"type":"v1","addr":"172.21.15.162:6836","nonce":3633306312}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5356,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3748267738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3748267738},{"type":"v1","addr":"172.21.15.162:6837","nonce":3748267738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/431670561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":431670561},{"type":"v1","addr":"172.21.15.105:6833","nonce":431670561}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:20:50.482111+0000","modified":"2024-09-21T03:20:53.504519+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1075697245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1075697245},{"type":"v1","addr":"172.21.15.105:6835","nonce":1075697245}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5643,"qdb_cluster":[5643]},"id":4}]} 2024-09-21T03:20:54.500 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 32 2024-09-21T03:20:54.503 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.500+0000 7f4b07a7e640 1 -- 172.21.15.105:0/3995003890 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4ae4078bc0 msgr2=0x7f4ae407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:54.503 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.500+0000 7f4b07a7e640 1 --2- 172.21.15.105:0/3995003890 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4ae4078bc0 0x7f4ae407b0d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4afc035000 tx=0x7f4afc004ab0 comp rx=0 tx=0).stop 2024-09-21T03:20:54.503 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.500+0000 7f4b07a7e640 1 -- 172.21.15.105:0/3995003890 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b0015c6f0 msgr2=0x7f4b001f5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:54.503 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.500+0000 7f4b07a7e640 1 --2- 172.21.15.105:0/3995003890 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b0015c6f0 0x7f4b001f5de0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f4af800b410 tx=0x7f4af800b810 comp rx=0 tx=0).stop 2024-09-21T03:20:54.504 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.500+0000 7f4b07a7e640 1 -- 172.21.15.105:0/3995003890 shutdown_connections 2024-09-21T03:20:54.504 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.500+0000 7f4b07a7e640 1 --2- 172.21.15.105:0/3995003890 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4ae4078bc0 0x7f4ae407b0d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:54.504 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.500+0000 7f4b07a7e640 1 --2- 172.21.15.105:0/3995003890 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b0015c6f0 0x7f4b001f5de0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:54.504 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.500+0000 7f4b07a7e640 1 --2- 172.21.15.105:0/3995003890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b000d1d40 0x7f4b000b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:54.504 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.500+0000 7f4b07a7e640 1 --2- 172.21.15.105:0/3995003890 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b000ccba0 0x7f4b00155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:54.504 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.500+0000 7f4b07a7e640 1 -- 172.21.15.105:0/3995003890 >> 172.21.15.105:0/3995003890 conn(0x7f4b000b3f10 msgr2=0x7f4b000b7340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:54.504 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.500+0000 7f4b07a7e640 1 -- 172.21.15.105:0/3995003890 shutdown_connections 2024-09-21T03:20:54.504 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.500+0000 7f4b07a7e640 1 -- 172.21.15.105:0/3995003890 wait complete. 2024-09-21T03:20:54.514 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:20:54.625 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.623+0000 7f7fa3d2b640 1 -- 172.21.15.105:0/3061797447 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f9c06fec0 msgr2=0x7f7f9c0702d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:54.626 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.623+0000 7f7fa3d2b640 1 --2- 172.21.15.105:0/3061797447 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f9c06fec0 0x7f7f9c0702d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c06a1c0 tx=0x7f7f8c02a530 comp rx=0 tx=0).stop 2024-09-21T03:20:54.626 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.623+0000 7f7fa3d2b640 1 -- 172.21.15.105:0/3061797447 shutdown_connections 2024-09-21T03:20:54.626 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.623+0000 7f7fa3d2b640 1 --2- 172.21.15.105:0/3061797447 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f9c06fec0 0x7f7f9c0702d0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:54.626 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.623+0000 7f7fa3d2b640 1 --2- 172.21.15.105:0/3061797447 >> v2:172.21.15.162:3300/0 conn(0x7f7f9c0b4090 0x7f7f9c0b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:54.626 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.623+0000 7f7fa3d2b640 1 -- 172.21.15.105:0/3061797447 >> 172.21.15.105:0/3061797447 conn(0x7f7f9c0cdcc0 msgr2=0x7f7f9c0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:54.626 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.623+0000 7f7fa3d2b640 1 -- 172.21.15.105:0/3061797447 shutdown_connections 2024-09-21T03:20:54.626 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.623+0000 7f7fa3d2b640 1 -- 172.21.15.105:0/3061797447 wait complete. 2024-09-21T03:20:54.627 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.624+0000 7f7fa3d2b640 1 Processor -- start 2024-09-21T03:20:54.627 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.625+0000 7f7fa3d2b640 1 -- start start 2024-09-21T03:20:54.629 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.626+0000 7f7fa3d2b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f9c06fec0 0x7f7f9c14c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:54.629 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.626+0000 7f7fa3d2b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f9c0b4090 0x7f7f9c1f6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:54.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.626+0000 7f7fa3d2b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f9c0cfeb0 0x7f7f9c1f7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:54.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.626+0000 7f7fa3d2b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c0b4a30 con 0x7f7f9c06fec0 2024-09-21T03:20:54.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.626+0000 7f7fa3d2b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c0b48b0 con 0x7f7f9c0b4090 2024-09-21T03:20:54.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.626+0000 7f7fa3d2b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7f9c0b4bb0 con 0x7f7f9c0cfeb0 2024-09-21T03:20:54.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.626+0000 7f7fa1ac7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f9c06fec0 0x7f7f9c14c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:54.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.626+0000 7f7fa1ac7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f9c06fec0 0x7f7f9c14c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:35716/0 (socket says 172.21.15.105:35716) 2024-09-21T03:20:54.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.626+0000 7f7fa1ac7640 1 -- 172.21.15.105:0/337625627 learned_addr learned my addr 172.21.15.105:0/337625627 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:54.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.626+0000 7f7fa12c6640 1 --2- 172.21.15.105:0/337625627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f9c0b4090 0x7f7f9c1f6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:54.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.626+0000 7f7fa1ac7640 1 -- 172.21.15.105:0/337625627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f9c0cfeb0 msgr2=0x7f7f9c1f7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:54.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.626+0000 7f7fa1ac7640 1 --2- 172.21.15.105:0/337625627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f9c0cfeb0 0x7f7f9c1f7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:54.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.626+0000 7f7fa1ac7640 1 -- 172.21.15.105:0/337625627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f9c0b4090 msgr2=0x7f7f9c1f6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:54.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.626+0000 7f7fa1ac7640 1 --2- 172.21.15.105:0/337625627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f9c0b4090 0x7f7f9c1f6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:54.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.626+0000 7f7fa1ac7640 1 -- 172.21.15.105:0/337625627 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f9c14eda0 con 0x7f7f9c06fec0 2024-09-21T03:20:54.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.626+0000 7f7fa1ac7640 1 --2- 172.21.15.105:0/337625627 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f9c06fec0 0x7f7f9c14c1e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f7f9800c970 tx=0x7f7f9800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:54.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.626+0000 7f7f927fc640 1 -- 172.21.15.105:0/337625627 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f98007bb0 con 0x7f7f9c06fec0 2024-09-21T03:20:54.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.626+0000 7f7f927fc640 1 -- 172.21.15.105:0/337625627 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f98007e40 con 0x7f7f9c06fec0 2024-09-21T03:20:54.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.626+0000 7f7fa3d2b640 1 -- 172.21.15.105:0/337625627 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f9c14f040 con 0x7f7f9c06fec0 2024-09-21T03:20:54.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.627+0000 7f7f927fc640 1 -- 172.21.15.105:0/337625627 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9800f690 con 0x7f7f9c06fec0 2024-09-21T03:20:54.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.627+0000 7f7fa3d2b640 1 -- 172.21.15.105:0/337625627 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f9c14f600 con 0x7f7f9c06fec0 2024-09-21T03:20:54.632 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.627+0000 7f7fa3d2b640 1 -- 172.21.15.105:0/337625627 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f9c0b5040 con 0x7f7f9c06fec0 2024-09-21T03:20:54.632 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.628+0000 7f7f927fc640 1 -- 172.21.15.105:0/337625627 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7f98018400 con 0x7f7f9c06fec0 2024-09-21T03:20:54.632 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.629+0000 7f7f927fc640 1 --2- 172.21.15.105:0/337625627 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7f80078bc0 0x7f7f8007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:54.632 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.629+0000 7f7f927fc640 1 -- 172.21.15.105:0/337625627 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f7f9809b490 con 0x7f7f9c06fec0 2024-09-21T03:20:54.632 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.629+0000 7f7fa12c6640 1 --2- 172.21.15.105:0/337625627 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7f80078bc0 0x7f7f8007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:54.632 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.630+0000 7f7fa12c6640 1 --2- 172.21.15.105:0/337625627 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7f80078bc0 0x7f7f8007b0d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c034000 tx=0x7f7f8c004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:54.636 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.634+0000 7f7f927fc640 1 -- 172.21.15.105:0/337625627 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7f98014030 con 0x7f7f9c06fec0 2024-09-21T03:20:54.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.811+0000 7f7fa3d2b640 1 -- 172.21.15.105:0/337625627 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7f9c0b0740 con 0x7f7f9c06fec0 2024-09-21T03:20:54.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.812+0000 7f7f927fc640 1 -- 172.21.15.105:0/337625627 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+16797 (secure 0 0 0) 0x7f7f98063960 con 0x7f7f9c06fec0 2024-09-21T03:20:54.815 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:20:54.815 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":57,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:20:52.125692+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:20:48.140896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-21T03:20:49.449787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:20:54.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.815+0000 7f7fa3d2b640 1 -- 172.21.15.105:0/337625627 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7f80078bc0 msgr2=0x7f7f8007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:54.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.815+0000 7f7fa3d2b640 1 --2- 172.21.15.105:0/337625627 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7f80078bc0 0x7f7f8007b0d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c034000 tx=0x7f7f8c004730 comp rx=0 tx=0).stop 2024-09-21T03:20:54.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.815+0000 7f7fa3d2b640 1 -- 172.21.15.105:0/337625627 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f9c06fec0 msgr2=0x7f7f9c14c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:54.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.815+0000 7f7fa3d2b640 1 --2- 172.21.15.105:0/337625627 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f9c06fec0 0x7f7f9c14c1e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f7f9800c970 tx=0x7f7f9800ce30 comp rx=0 tx=0).stop 2024-09-21T03:20:54.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.815+0000 7f7fa3d2b640 1 -- 172.21.15.105:0/337625627 shutdown_connections 2024-09-21T03:20:54.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.815+0000 7f7fa3d2b640 1 --2- 172.21.15.105:0/337625627 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7f80078bc0 0x7f7f8007b0d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:54.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.815+0000 7f7fa3d2b640 1 --2- 172.21.15.105:0/337625627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f9c0cfeb0 0x7f7f9c1f7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:54.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.815+0000 7f7fa3d2b640 1 --2- 172.21.15.105:0/337625627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f9c0b4090 0x7f7f9c1f6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:54.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.815+0000 7f7fa3d2b640 1 --2- 172.21.15.105:0/337625627 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f9c06fec0 0x7f7f9c14c1e0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:54.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.815+0000 7f7fa3d2b640 1 -- 172.21.15.105:0/337625627 >> 172.21.15.105:0/337625627 conn(0x7f7f9c0cdcc0 msgr2=0x7f7f9c0d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:54.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.815+0000 7f7fa3d2b640 1 -- 172.21.15.105:0/337625627 shutdown_connections 2024-09-21T03:20:54.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.815+0000 7f7fa3d2b640 1 -- 172.21.15.105:0/337625627 wait complete. 2024-09-21T03:20:54.828 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T03:20:54.829 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:20:54.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.939+0000 7fae02fa8640 1 -- 172.21.15.105:0/525511464 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fade8003a50 msgr2=0x7fade8003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:54.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.939+0000 7fae02fa8640 1 --2- 172.21.15.105:0/525511464 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fade8003a50 0x7fade8003ec0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fadec009e20 tx=0x7fade8005830 comp rx=0 tx=0).stop 2024-09-21T03:20:54.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.939+0000 7fae02fa8640 1 -- 172.21.15.105:0/525511464 shutdown_connections 2024-09-21T03:20:54.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.939+0000 7fae02fa8640 1 --2- 172.21.15.105:0/525511464 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fade8003a50 0x7fade8003ec0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:54.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.939+0000 7fae02fa8640 1 -- 172.21.15.105:0/525511464 >> 172.21.15.105:0/525511464 conn(0x7fadfc09d8f0 msgr2=0x7fadfc0d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:54.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.939+0000 7fae02fa8640 1 -- 172.21.15.105:0/525511464 shutdown_connections 2024-09-21T03:20:54.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.939+0000 7fae02fa8640 1 -- 172.21.15.105:0/525511464 wait complete. 2024-09-21T03:20:54.943 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.940+0000 7fae02fa8640 1 Processor -- start 2024-09-21T03:20:54.943 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.940+0000 7fae02fa8640 1 -- start start 2024-09-21T03:20:54.946 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.942+0000 7fae02fa8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fade8003a50 0x7fadfc0ca540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:54.946 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.942+0000 7fae02fa8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadfc1fa0b0 0x7fadfc15ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:54.946 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.942+0000 7fae02fa8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fadfc15f370 0x7fadfc1f5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:54.946 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.942+0000 7fae02fa8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fadfc0d0fb0 con 0x7fade8003a50 2024-09-21T03:20:54.946 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.942+0000 7fae02fa8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fadfc0d1fa0 con 0x7fadfc1fa0b0 2024-09-21T03:20:54.946 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.942+0000 7fae02fa8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fadfc0d1130 con 0x7fadfc15f370 2024-09-21T03:20:54.946 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.942+0000 7fae00d44640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fade8003a50 0x7fadfc0ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:54.946 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.942+0000 7fae00d44640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fade8003a50 0x7fadfc0ca540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:35738/0 (socket says 172.21.15.105:35738) 2024-09-21T03:20:54.946 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.942+0000 7fae00d44640 1 -- 172.21.15.105:0/759600863 learned_addr learned my addr 172.21.15.105:0/759600863 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:54.946 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.942+0000 7fae00d44640 1 -- 172.21.15.105:0/759600863 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fadfc15f370 msgr2=0x7fadfc1f5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:54.946 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.942+0000 7fadfbfff640 1 --2- 172.21.15.105:0/759600863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadfc1fa0b0 0x7fadfc15ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:54.946 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.942+0000 7fae01545640 1 --2- 172.21.15.105:0/759600863 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fadfc15f370 0x7fadfc1f5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:54.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.942+0000 7fae00d44640 1 --2- 172.21.15.105:0/759600863 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fadfc15f370 0x7fadfc1f5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:54.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.942+0000 7fae00d44640 1 -- 172.21.15.105:0/759600863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadfc1fa0b0 msgr2=0x7fadfc15ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:54.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.942+0000 7fae00d44640 1 --2- 172.21.15.105:0/759600863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadfc1fa0b0 0x7fadfc15ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:54.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.942+0000 7fae00d44640 1 -- 172.21.15.105:0/759600863 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadfc0cb830 con 0x7fade8003a50 2024-09-21T03:20:54.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.942+0000 7fadfbfff640 1 --2- 172.21.15.105:0/759600863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadfc1fa0b0 0x7fadfc15ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:20:54.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.942+0000 7fae01545640 1 --2- 172.21.15.105:0/759600863 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fadfc15f370 0x7fadfc1f5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:20:54.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.943+0000 7fae00d44640 1 --2- 172.21.15.105:0/759600863 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fade8003a50 0x7fadfc0ca540 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fadec036040 tx=0x7fadec0336d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:54.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.943+0000 7fadf97fa640 1 -- 172.21.15.105:0/759600863 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadec038040 con 0x7fade8003a50 2024-09-21T03:20:54.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.943+0000 7fadf97fa640 1 -- 172.21.15.105:0/759600863 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fadec041070 con 0x7fade8003a50 2024-09-21T03:20:54.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.943+0000 7fae02fa8640 1 -- 172.21.15.105:0/759600863 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadfc0cbb10 con 0x7fade8003a50 2024-09-21T03:20:54.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.943+0000 7fadf97fa640 1 -- 172.21.15.105:0/759600863 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadec033b00 con 0x7fade8003a50 2024-09-21T03:20:54.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.943+0000 7fae02fa8640 1 -- 172.21.15.105:0/759600863 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadfc15f7f0 con 0x7fade8003a50 2024-09-21T03:20:54.948 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.944+0000 7fae02fa8640 1 -- 172.21.15.105:0/759600863 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadfc0cbd50 con 0x7fade8003a50 2024-09-21T03:20:54.948 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.945+0000 7fadf97fa640 1 -- 172.21.15.105:0/759600863 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fadec033ca0 con 0x7fade8003a50 2024-09-21T03:20:54.948 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.945+0000 7fadf97fa640 1 --2- 172.21.15.105:0/759600863 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7faddc078bc0 0x7faddc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:54.948 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.945+0000 7fadf97fa640 1 -- 172.21.15.105:0/759600863 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fadec0bc0c0 con 0x7fade8003a50 2024-09-21T03:20:54.948 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.946+0000 7fadfbfff640 1 --2- 172.21.15.105:0/759600863 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7faddc078bc0 0x7faddc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:54.949 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.946+0000 7fadfbfff640 1 --2- 172.21.15.105:0/759600863 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7faddc078bc0 0x7faddc07b0d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fade4000f60 tx=0x7fade4000ed0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:54.952 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:54.949+0000 7fadf97fa640 1 -- 172.21.15.105:0/759600863 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fadec084670 con 0x7fade8003a50 2024-09-21T03:20:55.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.124+0000 7fae02fa8640 1 -- 172.21.15.105:0/759600863 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fadfc15fa90 con 0x7faddc078bc0 2024-09-21T03:20:55.131 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.129+0000 7fadf97fa640 1 -- 172.21.15.105:0/759600863 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239518 (secure 0 0 0) 0x7fadfc15fa90 con 0x7faddc078bc0 2024-09-21T03:20:55.132 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:20:55.135 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:20:55.137 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.132+0000 7fae02fa8640 1 -- 172.21.15.105:0/759600863 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7faddc078bc0 msgr2=0x7faddc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:55.137 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.132+0000 7fae02fa8640 1 --2- 172.21.15.105:0/759600863 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7faddc078bc0 0x7faddc07b0d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fade4000f60 tx=0x7fade4000ed0 comp rx=0 tx=0).stop 2024-09-21T03:20:55.137 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.132+0000 7fae02fa8640 1 -- 172.21.15.105:0/759600863 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fade8003a50 msgr2=0x7fadfc0ca540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:55.137 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.132+0000 7fae02fa8640 1 --2- 172.21.15.105:0/759600863 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fade8003a50 0x7fadfc0ca540 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fadec036040 tx=0x7fadec0336d0 comp rx=0 tx=0).stop 2024-09-21T03:20:55.137 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.132+0000 7fae02fa8640 1 -- 172.21.15.105:0/759600863 shutdown_connections 2024-09-21T03:20:55.137 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.132+0000 7fae02fa8640 1 --2- 172.21.15.105:0/759600863 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7faddc078bc0 0x7faddc07b0d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:55.137 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.132+0000 7fae02fa8640 1 --2- 172.21.15.105:0/759600863 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fadfc15f370 0x7fadfc1f5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:55.137 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.132+0000 7fae02fa8640 1 --2- 172.21.15.105:0/759600863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fadfc1fa0b0 0x7fadfc15ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:55.137 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.132+0000 7fae02fa8640 1 --2- 172.21.15.105:0/759600863 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fade8003a50 0x7fadfc0ca540 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:55.137 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.132+0000 7fae02fa8640 1 -- 172.21.15.105:0/759600863 >> 172.21.15.105:0/759600863 conn(0x7fadfc09d8f0 msgr2=0x7fadfc154530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:55.137 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.132+0000 7fae02fa8640 1 -- 172.21.15.105:0/759600863 shutdown_connections 2024-09-21T03:20:55.137 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.132+0000 7fae02fa8640 1 -- 172.21.15.105:0/759600863 wait complete. 2024-09-21T03:20:55.146 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2024-09-21T03:20:53.316335+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":111,"num_write_kb":1629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":22,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":234772,"kb_used_data":6056,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754739948,"statfs":{"total":773094113280,"available":772853706752,"internally_reserved":0,"allocated":6201344,"data_stored":3191950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.203500"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T03:20:51.137145+0000","last_change":"2024-09-21T03:20:51.135147+0000","last_active":"2024-09-21T03:20:51.137145+0000","last_peered":"2024-09-21T03:20:51.137145+0000","last_clean":"2024-09-21T03:20:51.137145+0000","last_became_active":"2024-09-21T03:20:51.134321+0000","last_became_peered":"2024-09-21T03:20:51.134321+0000","last_unstale":"2024-09-21T03:20:51.137145+0000","last_undegraded":"2024-09-21T03:20:51.137145+0000","last_fullsized":"2024-09-21T03:20:51.137145+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:19.132149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T03:20:51.129250+0000","last_change":"2024-09-21T03:20:51.128173+0000","last_active":"2024-09-21T03:20:51.129250+0000","last_peered":"2024-09-21T03:20:51.129250+0000","last_clean":"2024-09-21T03:20:51.129250+0000","last_became_active":"2024-09-21T03:20:51.127881+0000","last_became_peered":"2024-09-21T03:20:51.127881+0000","last_unstale":"2024-09-21T03:20:51.129250+0000","last_undegraded":"2024-09-21T03:20:51.129250+0000","last_fullsized":"2024-09-21T03:20:51.129250+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:20.391935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T03:20:51.132626+0000","last_change":"2024-09-21T03:20:51.129177+0000","last_active":"2024-09-21T03:20:51.132626+0000","last_peered":"2024-09-21T03:20:51.132626+0000","last_clean":"2024-09-21T03:20:51.132626+0000","last_became_active":"2024-09-21T03:20:51.128883+0000","last_became_peered":"2024-09-21T03:20:51.128883+0000","last_unstale":"2024-09-21T03:20:51.132626+0000","last_undegraded":"2024-09-21T03:20:51.132626+0000","last_fullsized":"2024-09-21T03:20:51.132626+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:15.467165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T03:20:51.135491+0000","last_change":"2024-09-21T03:20:51.131782+0000","last_active":"2024-09-21T03:20:51.135491+0000","last_peered":"2024-09-21T03:20:51.135491+0000","last_clean":"2024-09-21T03:20:51.135491+0000","last_became_active":"2024-09-21T03:20:51.131035+0000","last_became_peered":"2024-09-21T03:20:51.131035+0000","last_unstale":"2024-09-21T03:20:51.135491+0000","last_undegraded":"2024-09-21T03:20:51.135491+0000","last_fullsized":"2024-09-21T03:20:51.135491+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:49.079449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T03:20:51.142858+0000","last_change":"2024-09-21T03:20:51.137276+0000","last_active":"2024-09-21T03:20:51.142858+0000","last_peered":"2024-09-21T03:20:51.142858+0000","last_clean":"2024-09-21T03:20:51.142858+0000","last_became_active":"2024-09-21T03:20:51.136969+0000","last_became_peered":"2024-09-21T03:20:51.136969+0000","last_unstale":"2024-09-21T03:20:51.142858+0000","last_undegraded":"2024-09-21T03:20:51.142858+0000","last_fullsized":"2024-09-21T03:20:51.142858+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:03.859814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"56'4","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T03:20:51.150901+0000","last_change":"2024-09-21T03:20:50.129678+0000","last_active":"2024-09-21T03:20:51.150901+0000","last_peered":"2024-09-21T03:20:51.150901+0000","last_clean":"2024-09-21T03:20:51.150901+0000","last_became_active":"2024-09-21T03:20:50.129395+0000","last_became_peered":"2024-09-21T03:20:50.129395+0000","last_unstale":"2024-09-21T03:20:51.150901+0000","last_undegraded":"2024-09-21T03:20:51.150901+0000","last_fullsized":"2024-09-21T03:20:51.150901+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:31:16.033635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:49.107531+0000","last_change":"2024-09-21T03:20:49.107531+0000","last_active":"2024-09-21T03:20:49.107531+0000","last_peered":"2024-09-21T03:20:49.107531+0000","last_clean":"2024-09-21T03:20:49.107531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:49.107531+0000","last_undegraded":"2024-09-21T03:20:49.107531+0000","last_fullsized":"2024-09-21T03:20:49.107531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T03:20:51.151005+0000","last_change":"2024-09-21T03:20:51.147141+0000","last_active":"2024-09-21T03:20:51.151005+0000","last_peered":"2024-09-21T03:20:51.151005+0000","last_clean":"2024-09-21T03:20:51.151005+0000","last_became_active":"2024-09-21T03:20:51.146892+0000","last_became_peered":"2024-09-21T03:20:51.146892+0000","last_unstale":"2024-09-21T03:20:51.151005+0000","last_undegraded":"2024-09-21T03:20:51.151005+0000","last_fullsized":"2024-09-21T03:20:51.151005+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:06.867776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"56'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T03:20:51.151315+0000","last_change":"2024-09-21T03:20:50.136885+0000","last_active":"2024-09-21T03:20:51.151315+0000","last_peered":"2024-09-21T03:20:51.151315+0000","last_clean":"2024-09-21T03:20:51.151315+0000","last_became_active":"2024-09-21T03:20:50.136586+0000","last_became_peered":"2024-09-21T03:20:50.136586+0000","last_unstale":"2024-09-21T03:20:51.151315+0000","last_undegraded":"2024-09-21T03:20:51.151315+0000","last_fullsized":"2024-09-21T03:20:51.151315+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:54:05.166113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T03:20:51.137506+0000","last_change":"2024-09-21T03:20:51.134750+0000","last_active":"2024-09-21T03:20:51.137506+0000","last_peered":"2024-09-21T03:20:51.137506+0000","last_clean":"2024-09-21T03:20:51.137506+0000","last_became_active":"2024-09-21T03:20:51.134416+0000","last_became_peered":"2024-09-21T03:20:51.134416+0000","last_unstale":"2024-09-21T03:20:51.137506+0000","last_undegraded":"2024-09-21T03:20:51.137506+0000","last_fullsized":"2024-09-21T03:20:51.137506+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:40.060192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:49.107531+0000","last_change":"2024-09-21T03:20:49.107531+0000","last_active":"2024-09-21T03:20:49.107531+0000","last_peered":"2024-09-21T03:20:49.107531+0000","last_clean":"2024-09-21T03:20:49.107531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:49.107531+0000","last_undegraded":"2024-09-21T03:20:49.107531+0000","last_fullsized":"2024-09-21T03:20:49.107531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:49.107531+0000","last_change":"2024-09-21T03:20:49.107531+0000","last_active":"2024-09-21T03:20:49.107531+0000","last_peered":"2024-09-21T03:20:49.107531+0000","last_clean":"2024-09-21T03:20:49.107531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:49.107531+0000","last_undegraded":"2024-09-21T03:20:49.107531+0000","last_fullsized":"2024-09-21T03:20:49.107531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"56'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T03:20:51.146585+0000","last_change":"2024-09-21T03:20:50.128718+0000","last_active":"2024-09-21T03:20:51.146585+0000","last_peered":"2024-09-21T03:20:51.146585+0000","last_clean":"2024-09-21T03:20:51.146585+0000","last_became_active":"2024-09-21T03:20:50.128388+0000","last_became_peered":"2024-09-21T03:20:50.128388+0000","last_unstale":"2024-09-21T03:20:51.146585+0000","last_undegraded":"2024-09-21T03:20:51.146585+0000","last_fullsized":"2024-09-21T03:20:51.146585+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:33.784819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:49.107531+0000","last_change":"2024-09-21T03:20:49.107531+0000","last_active":"2024-09-21T03:20:49.107531+0000","last_peered":"2024-09-21T03:20:49.107531+0000","last_clean":"2024-09-21T03:20:49.107531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:49.107531+0000","last_undegraded":"2024-09-21T03:20:49.107531+0000","last_fullsized":"2024-09-21T03:20:49.107531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:49.107531+0000","last_change":"2024-09-21T03:20:49.107531+0000","last_active":"2024-09-21T03:20:49.107531+0000","last_peered":"2024-09-21T03:20:49.107531+0000","last_clean":"2024-09-21T03:20:49.107531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:49.107531+0000","last_undegraded":"2024-09-21T03:20:49.107531+0000","last_fullsized":"2024-09-21T03:20:49.107531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:49.107531+0000","last_change":"2024-09-21T03:20:49.107531+0000","last_active":"2024-09-21T03:20:49.107531+0000","last_peered":"2024-09-21T03:20:49.107531+0000","last_clean":"2024-09-21T03:20:49.107531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:49.107531+0000","last_undegraded":"2024-09-21T03:20:49.107531+0000","last_fullsized":"2024-09-21T03:20:49.107531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:49.107531+0000","last_change":"2024-09-21T03:20:49.107531+0000","last_active":"2024-09-21T03:20:49.107531+0000","last_peered":"2024-09-21T03:20:49.107531+0000","last_clean":"2024-09-21T03:20:49.107531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:49.107531+0000","last_undegraded":"2024-09-21T03:20:49.107531+0000","last_fullsized":"2024-09-21T03:20:49.107531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:49.107531+0000","last_change":"2024-09-21T03:20:49.107531+0000","last_active":"2024-09-21T03:20:49.107531+0000","last_peered":"2024-09-21T03:20:49.107531+0000","last_clean":"2024-09-21T03:20:49.107531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:49.107531+0000","last_undegraded":"2024-09-21T03:20:49.107531+0000","last_fullsized":"2024-09-21T03:20:49.107531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:49.107531+0000","last_change":"2024-09-21T03:20:49.107531+0000","last_active":"2024-09-21T03:20:49.107531+0000","last_peered":"2024-09-21T03:20:49.107531+0000","last_clean":"2024-09-21T03:20:49.107531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:49.107531+0000","last_undegraded":"2024-09-21T03:20:49.107531+0000","last_fullsized":"2024-09-21T03:20:49.107531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:49.107531+0000","last_change":"2024-09-21T03:20:49.107531+0000","last_active":"2024-09-21T03:20:49.107531+0000","last_peered":"2024-09-21T03:20:49.107531+0000","last_clean":"2024-09-21T03:20:49.107531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:49.107531+0000","last_undegraded":"2024-09-21T03:20:49.107531+0000","last_fullsized":"2024-09-21T03:20:49.107531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:49.107531+0000","last_change":"2024-09-21T03:20:49.107531+0000","last_active":"2024-09-21T03:20:49.107531+0000","last_peered":"2024-09-21T03:20:49.107531+0000","last_clean":"2024-09-21T03:20:49.107531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:49.107531+0000","last_undegraded":"2024-09-21T03:20:49.107531+0000","last_fullsized":"2024-09-21T03:20:49.107531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:49.107531+0000","last_change":"2024-09-21T03:20:49.107531+0000","last_active":"2024-09-21T03:20:49.107531+0000","last_peered":"2024-09-21T03:20:49.107531+0000","last_clean":"2024-09-21T03:20:49.107531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:49.107531+0000","last_undegraded":"2024-09-21T03:20:49.107531+0000","last_fullsized":"2024-09-21T03:20:49.107531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:49.107531+0000","last_change":"2024-09-21T03:20:49.107531+0000","last_active":"2024-09-21T03:20:49.107531+0000","last_peered":"2024-09-21T03:20:49.107531+0000","last_clean":"2024-09-21T03:20:49.107531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:49.107531+0000","last_undegraded":"2024-09-21T03:20:49.107531+0000","last_fullsized":"2024-09-21T03:20:49.107531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:49.107531+0000","last_change":"2024-09-21T03:20:49.107531+0000","last_active":"2024-09-21T03:20:49.107531+0000","last_peered":"2024-09-21T03:20:49.107531+0000","last_clean":"2024-09-21T03:20:49.107531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:49.107531+0000","last_undegraded":"2024-09-21T03:20:49.107531+0000","last_fullsized":"2024-09-21T03:20:49.107531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"56'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T03:20:51.145214+0000","last_change":"2024-09-21T03:20:50.135257+0000","last_active":"2024-09-21T03:20:51.145214+0000","last_peered":"2024-09-21T03:20:51.145214+0000","last_clean":"2024-09-21T03:20:51.145214+0000","last_became_active":"2024-09-21T03:20:50.134960+0000","last_became_peered":"2024-09-21T03:20:50.134960+0000","last_unstale":"2024-09-21T03:20:51.145214+0000","last_undegraded":"2024-09-21T03:20:51.145214+0000","last_fullsized":"2024-09-21T03:20:51.145214+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:14.013132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:49.107531+0000","last_change":"2024-09-21T03:20:49.107531+0000","last_active":"2024-09-21T03:20:49.107531+0000","last_peered":"2024-09-21T03:20:49.107531+0000","last_clean":"2024-09-21T03:20:49.107531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:49.107531+0000","last_undegraded":"2024-09-21T03:20:49.107531+0000","last_fullsized":"2024-09-21T03:20:49.107531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T03:20:51.120623+0000","last_change":"2024-09-21T03:20:50.139832+0000","last_active":"2024-09-21T03:20:51.120623+0000","last_peered":"2024-09-21T03:20:51.120623+0000","last_clean":"2024-09-21T03:20:51.120623+0000","last_became_active":"2024-09-21T03:20:50.139505+0000","last_became_peered":"2024-09-21T03:20:50.139505+0000","last_unstale":"2024-09-21T03:20:51.120623+0000","last_undegraded":"2024-09-21T03:20:51.120623+0000","last_fullsized":"2024-09-21T03:20:51.120623+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:06.780416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:49.107531+0000","last_change":"2024-09-21T03:20:49.107531+0000","last_active":"2024-09-21T03:20:49.107531+0000","last_peered":"2024-09-21T03:20:49.107531+0000","last_clean":"2024-09-21T03:20:49.107531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:49.107531+0000","last_undegraded":"2024-09-21T03:20:49.107531+0000","last_fullsized":"2024-09-21T03:20:49.107531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T03:20:51.131731+0000","last_change":"2024-09-21T03:20:51.128657+0000","last_active":"2024-09-21T03:20:51.131731+0000","last_peered":"2024-09-21T03:20:51.131731+0000","last_clean":"2024-09-21T03:20:51.131731+0000","last_became_active":"2024-09-21T03:20:51.127920+0000","last_became_peered":"2024-09-21T03:20:51.127920+0000","last_unstale":"2024-09-21T03:20:51.131731+0000","last_undegraded":"2024-09-21T03:20:51.131731+0000","last_fullsized":"2024-09-21T03:20:51.131731+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:45.031578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:49.107531+0000","last_change":"2024-09-21T03:20:49.107531+0000","last_active":"2024-09-21T03:20:49.107531+0000","last_peered":"2024-09-21T03:20:49.107531+0000","last_clean":"2024-09-21T03:20:49.107531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:49.107531+0000","last_undegraded":"2024-09-21T03:20:49.107531+0000","last_fullsized":"2024-09-21T03:20:49.107531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T03:20:51.143466+0000","last_change":"2024-09-21T03:20:51.141851+0000","last_active":"2024-09-21T03:20:51.143466+0000","last_peered":"2024-09-21T03:20:51.143466+0000","last_clean":"2024-09-21T03:20:51.143466+0000","last_became_active":"2024-09-21T03:20:51.137860+0000","last_became_peered":"2024-09-21T03:20:51.137860+0000","last_unstale":"2024-09-21T03:20:51.143466+0000","last_undegraded":"2024-09-21T03:20:51.143466+0000","last_fullsized":"2024-09-21T03:20:51.143466+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:29.859686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:49.107531+0000","last_change":"2024-09-21T03:20:49.107531+0000","last_active":"2024-09-21T03:20:49.107531+0000","last_peered":"2024-09-21T03:20:49.107531+0000","last_clean":"2024-09-21T03:20:49.107531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:49.107531+0000","last_undegraded":"2024-09-21T03:20:49.107531+0000","last_fullsized":"2024-09-21T03:20:49.107531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:49.107531+0000","last_change":"2024-09-21T03:20:49.107531+0000","last_active":"2024-09-21T03:20:49.107531+0000","last_peered":"2024-09-21T03:20:49.107531+0000","last_clean":"2024-09-21T03:20:49.107531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:49.107531+0000","last_undegraded":"2024-09-21T03:20:49.107531+0000","last_fullsized":"2024-09-21T03:20:49.107531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T03:20:51.120785+0000","last_change":"2024-09-21T03:20:50.134186+0000","last_active":"2024-09-21T03:20:51.120785+0000","last_peered":"2024-09-21T03:20:51.120785+0000","last_clean":"2024-09-21T03:20:51.120785+0000","last_became_active":"2024-09-21T03:20:50.133876+0000","last_became_peered":"2024-09-21T03:20:50.133876+0000","last_unstale":"2024-09-21T03:20:51.120785+0000","last_undegraded":"2024-09-21T03:20:51.120785+0000","last_fullsized":"2024-09-21T03:20:51.120785+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:56:27.448141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:49.107531+0000","last_change":"2024-09-21T03:20:49.107531+0000","last_active":"2024-09-21T03:20:49.107531+0000","last_peered":"2024-09-21T03:20:49.107531+0000","last_clean":"2024-09-21T03:20:49.107531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:49.107531+0000","last_undegraded":"2024-09-21T03:20:49.107531+0000","last_fullsized":"2024-09-21T03:20:49.107531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T03:20:51.139775+0000","last_change":"2024-09-21T03:20:51.136287+0000","last_active":"2024-09-21T03:20:51.139775+0000","last_peered":"2024-09-21T03:20:51.139775+0000","last_clean":"2024-09-21T03:20:51.139775+0000","last_became_active":"2024-09-21T03:20:51.135651+0000","last_became_peered":"2024-09-21T03:20:51.135651+0000","last_unstale":"2024-09-21T03:20:51.139775+0000","last_undegraded":"2024-09-21T03:20:51.139775+0000","last_fullsized":"2024-09-21T03:20:51.139775+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:38.038250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:49.107531+0000","last_change":"2024-09-21T03:20:49.107531+0000","last_active":"2024-09-21T03:20:49.107531+0000","last_peered":"2024-09-21T03:20:49.107531+0000","last_clean":"2024-09-21T03:20:49.107531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:49.107531+0000","last_undegraded":"2024-09-21T03:20:49.107531+0000","last_fullsized":"2024-09-21T03:20:49.107531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:49.107531+0000","last_change":"2024-09-21T03:20:49.107531+0000","last_active":"2024-09-21T03:20:49.107531+0000","last_peered":"2024-09-21T03:20:49.107531+0000","last_clean":"2024-09-21T03:20:49.107531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:49.107531+0000","last_undegraded":"2024-09-21T03:20:49.107531+0000","last_fullsized":"2024-09-21T03:20:49.107531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:49.107531+0000","last_change":"2024-09-21T03:20:49.107531+0000","last_active":"2024-09-21T03:20:49.107531+0000","last_peered":"2024-09-21T03:20:49.107531+0000","last_clean":"2024-09-21T03:20:49.107531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:49.107531+0000","last_undegraded":"2024-09-21T03:20:49.107531+0000","last_fullsized":"2024-09-21T03:20:49.107531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:49.107531+0000","last_change":"2024-09-21T03:20:49.107531+0000","last_active":"2024-09-21T03:20:49.107531+0000","last_peered":"2024-09-21T03:20:49.107531+0000","last_clean":"2024-09-21T03:20:49.107531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:49.107531+0000","last_undegraded":"2024-09-21T03:20:49.107531+0000","last_fullsized":"2024-09-21T03:20:49.107531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:49.107531+0000","last_change":"2024-09-21T03:20:49.107531+0000","last_active":"2024-09-21T03:20:49.107531+0000","last_peered":"2024-09-21T03:20:49.107531+0000","last_clean":"2024-09-21T03:20:49.107531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:49.107531+0000","last_undegraded":"2024-09-21T03:20:49.107531+0000","last_fullsized":"2024-09-21T03:20:49.107531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:50.110083+0000","last_change":"2024-09-21T03:20:50.110083+0000","last_active":"2024-09-21T03:20:50.110083+0000","last_peered":"2024-09-21T03:20:50.110083+0000","last_clean":"2024-09-21T03:20:50.110083+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:50.110083+0000","last_undegraded":"2024-09-21T03:20:50.110083+0000","last_fullsized":"2024-09-21T03:20:50.110083+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:20:49.107531+0000","last_change":"2024-09-21T03:20:49.107531+0000","last_active":"2024-09-21T03:20:49.107531+0000","last_peered":"2024-09-21T03:20:49.107531+0000","last_clean":"2024-09-21T03:20:49.107531+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:20:49.107531+0000","last_undegraded":"2024-09-21T03:20:49.107531+0000","last_fullsized":"2024-09-21T03:20:49.107531+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":166,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-21T03:20:47.110441+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:20:47.110441+0000","last_peered":"2024-09-21T03:20:47.110441+0000","last_clean":"2024-09-21T03:20:47.110441+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:20:47.110441+0000","last_undegraded":"2024-09-21T03:20:47.110441+0000","last_fullsized":"2024-09-21T03:20:47.110441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":20,"acting":20,"num_store_stats":1},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":12,"acting":12,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509475,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28224,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343616,"statfs":{"total":96636764160,"available":96607862784,"internally_reserved":0,"allocated":1220608,"data_stored":841335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27640,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":626688,"data_stored":250967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509473,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27628,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":614400,"data_stored":245840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509473,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27640,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":626688,"data_stored":250967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31792,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340048,"statfs":{"total":96636764160,"available":96604209152,"internally_reserved":0,"allocated":614400,"data_stored":245840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27628,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":614400,"data_stored":245840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31800,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340040,"statfs":{"total":96636764160,"available":96604200960,"internally_reserved":0,"allocated":626688,"data_stored":250967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1257472,"data_stored":860194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:20:55.150 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:20:55.299 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.296+0000 7f63939c6640 1 -- 172.21.15.105:0/2127965254 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63780053a0 msgr2=0x7f637800ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:55.299 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.296+0000 7f63939c6640 1 --2- 172.21.15.105:0/2127965254 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63780053a0 0x7f637800ba50 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f6384005fd0 tx=0x7f6378005830 comp rx=0 tx=0).stop 2024-09-21T03:20:55.299 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.296+0000 7f63939c6640 1 -- 172.21.15.105:0/2127965254 shutdown_connections 2024-09-21T03:20:55.299 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.296+0000 7f63939c6640 1 --2- 172.21.15.105:0/2127965254 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63780053a0 0x7f637800ba50 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:55.299 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.296+0000 7f63939c6640 1 -- 172.21.15.105:0/2127965254 >> 172.21.15.105:0/2127965254 conn(0x7f638c09d840 msgr2=0x7f638c08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:55.299 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.296+0000 7f63939c6640 1 -- 172.21.15.105:0/2127965254 shutdown_connections 2024-09-21T03:20:55.299 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.296+0000 7f63939c6640 1 -- 172.21.15.105:0/2127965254 wait complete. 2024-09-21T03:20:55.300 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.298+0000 7f63939c6640 1 Processor -- start 2024-09-21T03:20:55.300 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.298+0000 7f63939c6640 1 -- start start 2024-09-21T03:20:55.303 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.299+0000 7f63939c6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63780053a0 0x7f638c159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:55.303 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.299+0000 7f63939c6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f638c159680 0x7f638c146c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:55.303 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.299+0000 7f63939c6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f638c1471b0 0x7f638c1475c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:55.303 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.299+0000 7f63939c6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f638c06fb20 con 0x7f63780053a0 2024-09-21T03:20:55.303 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.299+0000 7f63939c6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f638c06f9a0 con 0x7f638c1471b0 2024-09-21T03:20:55.303 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.299+0000 7f63939c6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f638c06e610 con 0x7f638c159680 2024-09-21T03:20:55.303 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.299+0000 7f6391762640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63780053a0 0x7f638c159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:55.303 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.299+0000 7f6391762640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63780053a0 0x7f638c159140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:35754/0 (socket says 172.21.15.105:35754) 2024-09-21T03:20:55.303 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.299+0000 7f6391762640 1 -- 172.21.15.105:0/73929037 learned_addr learned my addr 172.21.15.105:0/73929037 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:55.304 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.300+0000 7f6391762640 1 -- 172.21.15.105:0/73929037 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f638c159680 msgr2=0x7f638c146c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:55.304 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.300+0000 7f6391762640 1 --2- 172.21.15.105:0/73929037 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f638c159680 0x7f638c146c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:55.304 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.300+0000 7f6391762640 1 -- 172.21.15.105:0/73929037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f638c1471b0 msgr2=0x7f638c1475c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:55.304 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.300+0000 7f6391762640 1 --2- 172.21.15.105:0/73929037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f638c1471b0 0x7f638c1475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:55.304 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.300+0000 7f6391762640 1 -- 172.21.15.105:0/73929037 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f638c0cbe80 con 0x7f63780053a0 2024-09-21T03:20:55.304 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.300+0000 7f6391762640 1 --2- 172.21.15.105:0/73929037 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63780053a0 0x7f638c159140 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f638800e590 tx=0x7f638800ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:55.304 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.300+0000 7f6381ffb640 1 -- 172.21.15.105:0/73929037 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6388015020 con 0x7f63780053a0 2024-09-21T03:20:55.304 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.300+0000 7f6381ffb640 1 -- 172.21.15.105:0/73929037 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f63880109a0 con 0x7f63780053a0 2024-09-21T03:20:55.304 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.300+0000 7f63939c6640 1 -- 172.21.15.105:0/73929037 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f638c156df0 con 0x7f63780053a0 2024-09-21T03:20:55.304 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.300+0000 7f6381ffb640 1 -- 172.21.15.105:0/73929037 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6388010df0 con 0x7f63780053a0 2024-09-21T03:20:55.304 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.300+0000 7f63939c6640 1 -- 172.21.15.105:0/73929037 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f638c15b590 con 0x7f63780053a0 2024-09-21T03:20:55.305 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.301+0000 7f63939c6640 1 -- 172.21.15.105:0/73929037 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f638c0d1350 con 0x7f63780053a0 2024-09-21T03:20:55.305 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.302+0000 7f6381ffb640 1 -- 172.21.15.105:0/73929037 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6388018020 con 0x7f63780053a0 2024-09-21T03:20:55.305 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.302+0000 7f6381ffb640 1 --2- 172.21.15.105:0/73929037 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6370078b90 0x7f637007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:55.305 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.302+0000 7f6381ffb640 1 -- 172.21.15.105:0/73929037 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f638809b1a0 con 0x7f63780053a0 2024-09-21T03:20:55.305 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.303+0000 7f6390f61640 1 --2- 172.21.15.105:0/73929037 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6370078b90 0x7f637007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:55.306 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.303+0000 7f6390f61640 1 --2- 172.21.15.105:0/73929037 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6370078b90 0x7f637007b0a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f638c1590d0 tx=0x7f637c0060b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:55.309 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.307+0000 7f6381ffb640 1 -- 172.21.15.105:0/73929037 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f638c0d1350 con 0x7f63780053a0 2024-09-21T03:20:55.483 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.480+0000 7f63939c6640 1 -- 172.21.15.105:0/73929037 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f638c06ea50 con 0x7f6370078b90 2024-09-21T03:20:55.487 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.485+0000 7f6381ffb640 1 -- 172.21.15.105:0/73929037 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251942 (secure 0 0 0) 0x7f638c06ea50 con 0x7f6370078b90 2024-09-21T03:20:55.490 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:20:55.491 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:20:55.493 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.488+0000 7f63939c6640 1 -- 172.21.15.105:0/73929037 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6370078b90 msgr2=0x7f637007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:55.493 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.488+0000 7f63939c6640 1 --2- 172.21.15.105:0/73929037 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6370078b90 0x7f637007b0a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f638c1590d0 tx=0x7f637c0060b0 comp rx=0 tx=0).stop 2024-09-21T03:20:55.493 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.488+0000 7f63939c6640 1 -- 172.21.15.105:0/73929037 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63780053a0 msgr2=0x7f638c159140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:55.493 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.488+0000 7f63939c6640 1 --2- 172.21.15.105:0/73929037 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63780053a0 0x7f638c159140 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f638800e590 tx=0x7f638800ea50 comp rx=0 tx=0).stop 2024-09-21T03:20:55.493 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.488+0000 7f63939c6640 1 -- 172.21.15.105:0/73929037 shutdown_connections 2024-09-21T03:20:55.493 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.488+0000 7f63939c6640 1 --2- 172.21.15.105:0/73929037 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6370078b90 0x7f637007b0a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:55.493 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.488+0000 7f63939c6640 1 --2- 172.21.15.105:0/73929037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f638c1471b0 0x7f638c1475c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:55.493 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.488+0000 7f63939c6640 1 --2- 172.21.15.105:0/73929037 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f638c159680 0x7f638c146c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:55.493 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.488+0000 7f63939c6640 1 --2- 172.21.15.105:0/73929037 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63780053a0 0x7f638c159140 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:55.493 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.488+0000 7f63939c6640 1 -- 172.21.15.105:0/73929037 >> 172.21.15.105:0/73929037 conn(0x7f638c09d840 msgr2=0x7f638c0b10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:55.493 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.488+0000 7f63939c6640 1 -- 172.21.15.105:0/73929037 shutdown_connections 2024-09-21T03:20:55.493 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.488+0000 7f63939c6640 1 -- 172.21.15.105:0/73929037 wait complete. 2024-09-21T03:20:55.502 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":130,"stamp":"2024-09-21T03:20:55.316795+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":160,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235220,"kb_used_data":6476,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754739500,"statfs":{"total":773094113280,"available":772853248000,"internally_reserved":0,"allocated":6631424,"data_stored":3386070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001320"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.382369+0000","last_change":"2024-09-21T03:20:51.133344+0000","last_active":"2024-09-21T03:20:52.382369+0000","last_peered":"2024-09-21T03:20:52.382369+0000","last_clean":"2024-09-21T03:20:52.382369+0000","last_became_active":"2024-09-21T03:20:51.133041+0000","last_became_peered":"2024-09-21T03:20:51.133041+0000","last_unstale":"2024-09-21T03:20:52.382369+0000","last_undegraded":"2024-09-21T03:20:52.382369+0000","last_fullsized":"2024-09-21T03:20:52.382369+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:27:47.366482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.382708+0000","last_change":"2024-09-21T03:20:51.144706+0000","last_active":"2024-09-21T03:20:52.382708+0000","last_peered":"2024-09-21T03:20:52.382708+0000","last_clean":"2024-09-21T03:20:52.382708+0000","last_became_active":"2024-09-21T03:20:51.144287+0000","last_became_peered":"2024-09-21T03:20:51.144287+0000","last_unstale":"2024-09-21T03:20:52.382708+0000","last_undegraded":"2024-09-21T03:20:52.382708+0000","last_fullsized":"2024-09-21T03:20:52.382708+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:06.032125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.383090+0000","last_change":"2024-09-21T03:20:51.140947+0000","last_active":"2024-09-21T03:20:52.383090+0000","last_peered":"2024-09-21T03:20:52.383090+0000","last_clean":"2024-09-21T03:20:52.383090+0000","last_became_active":"2024-09-21T03:20:51.140572+0000","last_became_peered":"2024-09-21T03:20:51.140572+0000","last_unstale":"2024-09-21T03:20:52.383090+0000","last_undegraded":"2024-09-21T03:20:52.383090+0000","last_fullsized":"2024-09-21T03:20:52.383090+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:44.044117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.383548+0000","last_change":"2024-09-21T03:20:51.136875+0000","last_active":"2024-09-21T03:20:52.383548+0000","last_peered":"2024-09-21T03:20:52.383548+0000","last_clean":"2024-09-21T03:20:52.383548+0000","last_became_active":"2024-09-21T03:20:51.135635+0000","last_became_peered":"2024-09-21T03:20:51.135635+0000","last_unstale":"2024-09-21T03:20:52.383548+0000","last_undegraded":"2024-09-21T03:20:52.383548+0000","last_fullsized":"2024-09-21T03:20:52.383548+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:10.017760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.382583+0000","last_change":"2024-09-21T03:20:51.138686+0000","last_active":"2024-09-21T03:20:52.382583+0000","last_peered":"2024-09-21T03:20:52.382583+0000","last_clean":"2024-09-21T03:20:52.382583+0000","last_became_active":"2024-09-21T03:20:51.138387+0000","last_became_peered":"2024-09-21T03:20:51.138387+0000","last_unstale":"2024-09-21T03:20:52.382583+0000","last_undegraded":"2024-09-21T03:20:52.382583+0000","last_fullsized":"2024-09-21T03:20:52.382583+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:46:50.262998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T03:20:51.137145+0000","last_change":"2024-09-21T03:20:51.135147+0000","last_active":"2024-09-21T03:20:51.137145+0000","last_peered":"2024-09-21T03:20:51.137145+0000","last_clean":"2024-09-21T03:20:51.137145+0000","last_became_active":"2024-09-21T03:20:51.134321+0000","last_became_peered":"2024-09-21T03:20:51.134321+0000","last_unstale":"2024-09-21T03:20:51.137145+0000","last_undegraded":"2024-09-21T03:20:51.137145+0000","last_fullsized":"2024-09-21T03:20:51.137145+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:19.132149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.139694+0000","last_change":"2024-09-21T03:20:51.135574+0000","last_active":"2024-09-21T03:20:52.139694+0000","last_peered":"2024-09-21T03:20:52.139694+0000","last_clean":"2024-09-21T03:20:52.139694+0000","last_became_active":"2024-09-21T03:20:51.135217+0000","last_became_peered":"2024-09-21T03:20:51.135217+0000","last_unstale":"2024-09-21T03:20:52.139694+0000","last_undegraded":"2024-09-21T03:20:52.139694+0000","last_fullsized":"2024-09-21T03:20:52.139694+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:28:20.785579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.382462+0000","last_change":"2024-09-21T03:20:51.138142+0000","last_active":"2024-09-21T03:20:52.382462+0000","last_peered":"2024-09-21T03:20:52.382462+0000","last_clean":"2024-09-21T03:20:52.382462+0000","last_became_active":"2024-09-21T03:20:51.137828+0000","last_became_peered":"2024-09-21T03:20:51.137828+0000","last_unstale":"2024-09-21T03:20:52.382462+0000","last_undegraded":"2024-09-21T03:20:52.382462+0000","last_fullsized":"2024-09-21T03:20:52.382462+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:40.430627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.140021+0000","last_change":"2024-09-21T03:20:51.129204+0000","last_active":"2024-09-21T03:20:52.140021+0000","last_peered":"2024-09-21T03:20:52.140021+0000","last_clean":"2024-09-21T03:20:52.140021+0000","last_became_active":"2024-09-21T03:20:51.128893+0000","last_became_peered":"2024-09-21T03:20:51.128893+0000","last_unstale":"2024-09-21T03:20:52.140021+0000","last_undegraded":"2024-09-21T03:20:52.140021+0000","last_fullsized":"2024-09-21T03:20:52.140021+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:44:07.495484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.134616+0000","last_change":"2024-09-21T03:20:51.141597+0000","last_active":"2024-09-21T03:20:52.134616+0000","last_peered":"2024-09-21T03:20:52.134616+0000","last_clean":"2024-09-21T03:20:52.134616+0000","last_became_active":"2024-09-21T03:20:51.141293+0000","last_became_peered":"2024-09-21T03:20:51.141293+0000","last_unstale":"2024-09-21T03:20:52.134616+0000","last_undegraded":"2024-09-21T03:20:52.134616+0000","last_fullsized":"2024-09-21T03:20:52.134616+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:59:39.348272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.134551+0000","last_change":"2024-09-21T03:20:51.148005+0000","last_active":"2024-09-21T03:20:52.134551+0000","last_peered":"2024-09-21T03:20:52.134551+0000","last_clean":"2024-09-21T03:20:52.134551+0000","last_became_active":"2024-09-21T03:20:51.147305+0000","last_became_peered":"2024-09-21T03:20:51.147305+0000","last_unstale":"2024-09-21T03:20:52.134551+0000","last_undegraded":"2024-09-21T03:20:52.134551+0000","last_fullsized":"2024-09-21T03:20:52.134551+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:34:54.979688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.383553+0000","last_change":"2024-09-21T03:20:51.144176+0000","last_active":"2024-09-21T03:20:52.383553+0000","last_peered":"2024-09-21T03:20:52.383553+0000","last_clean":"2024-09-21T03:20:52.383553+0000","last_became_active":"2024-09-21T03:20:51.143808+0000","last_became_peered":"2024-09-21T03:20:51.143808+0000","last_unstale":"2024-09-21T03:20:52.383553+0000","last_undegraded":"2024-09-21T03:20:52.383553+0000","last_fullsized":"2024-09-21T03:20:52.383553+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:12.875542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.140209+0000","last_change":"2024-09-21T03:20:51.128510+0000","last_active":"2024-09-21T03:20:52.140209+0000","last_peered":"2024-09-21T03:20:52.140209+0000","last_clean":"2024-09-21T03:20:52.140209+0000","last_became_active":"2024-09-21T03:20:51.128145+0000","last_became_peered":"2024-09-21T03:20:51.128145+0000","last_unstale":"2024-09-21T03:20:52.140209+0000","last_undegraded":"2024-09-21T03:20:52.140209+0000","last_fullsized":"2024-09-21T03:20:52.140209+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:13:47.054722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.140088+0000","last_change":"2024-09-21T03:20:51.136836+0000","last_active":"2024-09-21T03:20:52.140088+0000","last_peered":"2024-09-21T03:20:52.140088+0000","last_clean":"2024-09-21T03:20:52.140088+0000","last_became_active":"2024-09-21T03:20:51.136497+0000","last_became_peered":"2024-09-21T03:20:51.136497+0000","last_unstale":"2024-09-21T03:20:52.140088+0000","last_undegraded":"2024-09-21T03:20:52.140088+0000","last_fullsized":"2024-09-21T03:20:52.140088+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:05.250437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.140728+0000","last_change":"2024-09-21T03:20:51.142732+0000","last_active":"2024-09-21T03:20:52.140728+0000","last_peered":"2024-09-21T03:20:52.140728+0000","last_clean":"2024-09-21T03:20:52.140728+0000","last_became_active":"2024-09-21T03:20:51.142415+0000","last_became_peered":"2024-09-21T03:20:51.142415+0000","last_unstale":"2024-09-21T03:20:52.140728+0000","last_undegraded":"2024-09-21T03:20:52.140728+0000","last_fullsized":"2024-09-21T03:20:52.140728+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:01.957820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T03:20:51.129250+0000","last_change":"2024-09-21T03:20:51.128173+0000","last_active":"2024-09-21T03:20:51.129250+0000","last_peered":"2024-09-21T03:20:51.129250+0000","last_clean":"2024-09-21T03:20:51.129250+0000","last_became_active":"2024-09-21T03:20:51.127881+0000","last_became_peered":"2024-09-21T03:20:51.127881+0000","last_unstale":"2024-09-21T03:20:51.129250+0000","last_undegraded":"2024-09-21T03:20:51.129250+0000","last_fullsized":"2024-09-21T03:20:51.129250+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:20.391935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.383257+0000","last_change":"2024-09-21T03:20:51.137412+0000","last_active":"2024-09-21T03:20:52.383257+0000","last_peered":"2024-09-21T03:20:52.383257+0000","last_clean":"2024-09-21T03:20:52.383257+0000","last_became_active":"2024-09-21T03:20:51.133364+0000","last_became_peered":"2024-09-21T03:20:51.133364+0000","last_unstale":"2024-09-21T03:20:52.383257+0000","last_undegraded":"2024-09-21T03:20:52.383257+0000","last_fullsized":"2024-09-21T03:20:52.383257+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:15.022393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.383043+0000","last_change":"2024-09-21T03:20:51.139252+0000","last_active":"2024-09-21T03:20:52.383043+0000","last_peered":"2024-09-21T03:20:52.383043+0000","last_clean":"2024-09-21T03:20:52.383043+0000","last_became_active":"2024-09-21T03:20:51.138915+0000","last_became_peered":"2024-09-21T03:20:51.138915+0000","last_unstale":"2024-09-21T03:20:52.383043+0000","last_undegraded":"2024-09-21T03:20:52.383043+0000","last_fullsized":"2024-09-21T03:20:52.383043+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:06.125628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.382402+0000","last_change":"2024-09-21T03:20:51.131007+0000","last_active":"2024-09-21T03:20:52.382402+0000","last_peered":"2024-09-21T03:20:52.382402+0000","last_clean":"2024-09-21T03:20:52.382402+0000","last_became_active":"2024-09-21T03:20:51.130670+0000","last_became_peered":"2024-09-21T03:20:51.130670+0000","last_unstale":"2024-09-21T03:20:52.382402+0000","last_undegraded":"2024-09-21T03:20:52.382402+0000","last_fullsized":"2024-09-21T03:20:52.382402+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:36.097808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.383072+0000","last_change":"2024-09-21T03:20:51.132944+0000","last_active":"2024-09-21T03:20:52.383072+0000","last_peered":"2024-09-21T03:20:52.383072+0000","last_clean":"2024-09-21T03:20:52.383072+0000","last_became_active":"2024-09-21T03:20:51.132148+0000","last_became_peered":"2024-09-21T03:20:51.132148+0000","last_unstale":"2024-09-21T03:20:52.383072+0000","last_undegraded":"2024-09-21T03:20:52.383072+0000","last_fullsized":"2024-09-21T03:20:52.383072+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:46:36.079728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.382771+0000","last_change":"2024-09-21T03:20:51.144738+0000","last_active":"2024-09-21T03:20:52.382771+0000","last_peered":"2024-09-21T03:20:52.382771+0000","last_clean":"2024-09-21T03:20:52.382771+0000","last_became_active":"2024-09-21T03:20:51.144385+0000","last_became_peered":"2024-09-21T03:20:51.144385+0000","last_unstale":"2024-09-21T03:20:52.382771+0000","last_undegraded":"2024-09-21T03:20:52.382771+0000","last_fullsized":"2024-09-21T03:20:52.382771+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:05.703646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.382907+0000","last_change":"2024-09-21T03:20:51.136968+0000","last_active":"2024-09-21T03:20:52.382907+0000","last_peered":"2024-09-21T03:20:52.382907+0000","last_clean":"2024-09-21T03:20:52.382907+0000","last_became_active":"2024-09-21T03:20:51.136287+0000","last_became_peered":"2024-09-21T03:20:51.136287+0000","last_unstale":"2024-09-21T03:20:52.382907+0000","last_undegraded":"2024-09-21T03:20:52.382907+0000","last_fullsized":"2024-09-21T03:20:52.382907+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:30:44.768323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.382202+0000","last_change":"2024-09-21T03:20:51.140900+0000","last_active":"2024-09-21T03:20:52.382202+0000","last_peered":"2024-09-21T03:20:52.382202+0000","last_clean":"2024-09-21T03:20:52.382202+0000","last_became_active":"2024-09-21T03:20:51.139830+0000","last_became_peered":"2024-09-21T03:20:51.139830+0000","last_unstale":"2024-09-21T03:20:52.382202+0000","last_undegraded":"2024-09-21T03:20:52.382202+0000","last_fullsized":"2024-09-21T03:20:52.382202+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:18.397355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.139716+0000","last_change":"2024-09-21T03:20:51.128471+0000","last_active":"2024-09-21T03:20:52.139716+0000","last_peered":"2024-09-21T03:20:52.139716+0000","last_clean":"2024-09-21T03:20:52.139716+0000","last_became_active":"2024-09-21T03:20:51.128121+0000","last_became_peered":"2024-09-21T03:20:51.128121+0000","last_unstale":"2024-09-21T03:20:52.139716+0000","last_undegraded":"2024-09-21T03:20:52.139716+0000","last_fullsized":"2024-09-21T03:20:52.139716+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:42.501265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.382642+0000","last_change":"2024-09-21T03:20:51.148782+0000","last_active":"2024-09-21T03:20:52.382642+0000","last_peered":"2024-09-21T03:20:52.382642+0000","last_clean":"2024-09-21T03:20:52.382642+0000","last_became_active":"2024-09-21T03:20:51.148453+0000","last_became_peered":"2024-09-21T03:20:51.148453+0000","last_unstale":"2024-09-21T03:20:52.382642+0000","last_undegraded":"2024-09-21T03:20:52.382642+0000","last_fullsized":"2024-09-21T03:20:52.382642+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:54.494780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.382665+0000","last_change":"2024-09-21T03:20:51.132901+0000","last_active":"2024-09-21T03:20:52.382665+0000","last_peered":"2024-09-21T03:20:52.382665+0000","last_clean":"2024-09-21T03:20:52.382665+0000","last_became_active":"2024-09-21T03:20:51.131870+0000","last_became_peered":"2024-09-21T03:20:51.131870+0000","last_unstale":"2024-09-21T03:20:52.382665+0000","last_undegraded":"2024-09-21T03:20:52.382665+0000","last_fullsized":"2024-09-21T03:20:52.382665+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:18.489559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T03:20:51.132626+0000","last_change":"2024-09-21T03:20:51.129177+0000","last_active":"2024-09-21T03:20:51.132626+0000","last_peered":"2024-09-21T03:20:51.132626+0000","last_clean":"2024-09-21T03:20:51.132626+0000","last_became_active":"2024-09-21T03:20:51.128883+0000","last_became_peered":"2024-09-21T03:20:51.128883+0000","last_unstale":"2024-09-21T03:20:51.132626+0000","last_undegraded":"2024-09-21T03:20:51.132626+0000","last_fullsized":"2024-09-21T03:20:51.132626+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:15.467165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.382633+0000","last_change":"2024-09-21T03:20:51.139947+0000","last_active":"2024-09-21T03:20:52.382633+0000","last_peered":"2024-09-21T03:20:52.382633+0000","last_clean":"2024-09-21T03:20:52.382633+0000","last_became_active":"2024-09-21T03:20:51.139456+0000","last_became_peered":"2024-09-21T03:20:51.139456+0000","last_unstale":"2024-09-21T03:20:52.382633+0000","last_undegraded":"2024-09-21T03:20:52.382633+0000","last_fullsized":"2024-09-21T03:20:52.382633+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:55.101816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.383509+0000","last_change":"2024-09-21T03:20:51.139771+0000","last_active":"2024-09-21T03:20:52.383509+0000","last_peered":"2024-09-21T03:20:52.383509+0000","last_clean":"2024-09-21T03:20:52.383509+0000","last_became_active":"2024-09-21T03:20:51.139464+0000","last_became_peered":"2024-09-21T03:20:51.139464+0000","last_unstale":"2024-09-21T03:20:52.383509+0000","last_undegraded":"2024-09-21T03:20:52.383509+0000","last_fullsized":"2024-09-21T03:20:52.383509+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:09:13.921388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.382914+0000","last_change":"2024-09-21T03:20:51.140337+0000","last_active":"2024-09-21T03:20:52.382914+0000","last_peered":"2024-09-21T03:20:52.382914+0000","last_clean":"2024-09-21T03:20:52.382914+0000","last_became_active":"2024-09-21T03:20:51.139843+0000","last_became_peered":"2024-09-21T03:20:51.139843+0000","last_unstale":"2024-09-21T03:20:52.382914+0000","last_undegraded":"2024-09-21T03:20:52.382914+0000","last_fullsized":"2024-09-21T03:20:52.382914+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:08.476663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.382155+0000","last_change":"2024-09-21T03:20:51.143574+0000","last_active":"2024-09-21T03:20:52.382155+0000","last_peered":"2024-09-21T03:20:52.382155+0000","last_clean":"2024-09-21T03:20:52.382155+0000","last_became_active":"2024-09-21T03:20:51.143150+0000","last_became_peered":"2024-09-21T03:20:51.143150+0000","last_unstale":"2024-09-21T03:20:52.382155+0000","last_undegraded":"2024-09-21T03:20:52.382155+0000","last_fullsized":"2024-09-21T03:20:52.382155+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:25.526941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T03:20:51.135491+0000","last_change":"2024-09-21T03:20:51.131782+0000","last_active":"2024-09-21T03:20:51.135491+0000","last_peered":"2024-09-21T03:20:51.135491+0000","last_clean":"2024-09-21T03:20:51.135491+0000","last_became_active":"2024-09-21T03:20:51.131035+0000","last_became_peered":"2024-09-21T03:20:51.131035+0000","last_unstale":"2024-09-21T03:20:51.135491+0000","last_undegraded":"2024-09-21T03:20:51.135491+0000","last_fullsized":"2024-09-21T03:20:51.135491+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:49.079449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T03:20:51.142858+0000","last_change":"2024-09-21T03:20:51.137276+0000","last_active":"2024-09-21T03:20:51.142858+0000","last_peered":"2024-09-21T03:20:51.142858+0000","last_clean":"2024-09-21T03:20:51.142858+0000","last_became_active":"2024-09-21T03:20:51.136969+0000","last_became_peered":"2024-09-21T03:20:51.136969+0000","last_unstale":"2024-09-21T03:20:51.142858+0000","last_undegraded":"2024-09-21T03:20:51.142858+0000","last_fullsized":"2024-09-21T03:20:51.142858+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:03.859814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"56'4","reported_seq":17,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T03:20:51.150901+0000","last_change":"2024-09-21T03:20:50.129678+0000","last_active":"2024-09-21T03:20:51.150901+0000","last_peered":"2024-09-21T03:20:51.150901+0000","last_clean":"2024-09-21T03:20:51.150901+0000","last_became_active":"2024-09-21T03:20:50.129395+0000","last_became_peered":"2024-09-21T03:20:50.129395+0000","last_unstale":"2024-09-21T03:20:51.150901+0000","last_undegraded":"2024-09-21T03:20:51.150901+0000","last_fullsized":"2024-09-21T03:20:51.150901+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:31:16.033635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.134650+0000","last_change":"2024-09-21T03:20:51.146715+0000","last_active":"2024-09-21T03:20:52.134650+0000","last_peered":"2024-09-21T03:20:52.134650+0000","last_clean":"2024-09-21T03:20:52.134650+0000","last_became_active":"2024-09-21T03:20:51.146438+0000","last_became_peered":"2024-09-21T03:20:51.146438+0000","last_unstale":"2024-09-21T03:20:52.134650+0000","last_undegraded":"2024-09-21T03:20:52.134650+0000","last_fullsized":"2024-09-21T03:20:52.134650+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:05:02.027651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.382848+0000","last_change":"2024-09-21T03:20:50.133501+0000","last_active":"2024-09-21T03:20:52.382848+0000","last_peered":"2024-09-21T03:20:52.382848+0000","last_clean":"2024-09-21T03:20:52.382848+0000","last_became_active":"2024-09-21T03:20:50.133207+0000","last_became_peered":"2024-09-21T03:20:50.133207+0000","last_unstale":"2024-09-21T03:20:52.382848+0000","last_undegraded":"2024-09-21T03:20:52.382848+0000","last_fullsized":"2024-09-21T03:20:52.382848+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:48.935474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T03:20:51.151005+0000","last_change":"2024-09-21T03:20:51.147141+0000","last_active":"2024-09-21T03:20:51.151005+0000","last_peered":"2024-09-21T03:20:51.151005+0000","last_clean":"2024-09-21T03:20:51.151005+0000","last_became_active":"2024-09-21T03:20:51.146892+0000","last_became_peered":"2024-09-21T03:20:51.146892+0000","last_unstale":"2024-09-21T03:20:51.151005+0000","last_undegraded":"2024-09-21T03:20:51.151005+0000","last_fullsized":"2024-09-21T03:20:51.151005+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:06.867776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"56'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T03:20:51.151315+0000","last_change":"2024-09-21T03:20:50.136885+0000","last_active":"2024-09-21T03:20:51.151315+0000","last_peered":"2024-09-21T03:20:51.151315+0000","last_clean":"2024-09-21T03:20:51.151315+0000","last_became_active":"2024-09-21T03:20:50.136586+0000","last_became_peered":"2024-09-21T03:20:50.136586+0000","last_unstale":"2024-09-21T03:20:51.151315+0000","last_undegraded":"2024-09-21T03:20:51.151315+0000","last_fullsized":"2024-09-21T03:20:51.151315+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:54:05.166113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T03:20:51.137506+0000","last_change":"2024-09-21T03:20:51.134750+0000","last_active":"2024-09-21T03:20:51.137506+0000","last_peered":"2024-09-21T03:20:51.137506+0000","last_clean":"2024-09-21T03:20:51.137506+0000","last_became_active":"2024-09-21T03:20:51.134416+0000","last_became_peered":"2024-09-21T03:20:51.134416+0000","last_unstale":"2024-09-21T03:20:51.137506+0000","last_undegraded":"2024-09-21T03:20:51.137506+0000","last_fullsized":"2024-09-21T03:20:51.137506+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:40.060192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.383653+0000","last_change":"2024-09-21T03:20:50.131423+0000","last_active":"2024-09-21T03:20:52.383653+0000","last_peered":"2024-09-21T03:20:52.383653+0000","last_clean":"2024-09-21T03:20:52.383653+0000","last_became_active":"2024-09-21T03:20:50.131099+0000","last_became_peered":"2024-09-21T03:20:50.131099+0000","last_unstale":"2024-09-21T03:20:52.383653+0000","last_undegraded":"2024-09-21T03:20:52.383653+0000","last_fullsized":"2024-09-21T03:20:52.383653+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:54.719394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.382974+0000","last_change":"2024-09-21T03:20:51.136585+0000","last_active":"2024-09-21T03:20:52.382974+0000","last_peered":"2024-09-21T03:20:52.382974+0000","last_clean":"2024-09-21T03:20:52.382974+0000","last_became_active":"2024-09-21T03:20:51.135906+0000","last_became_peered":"2024-09-21T03:20:51.135906+0000","last_unstale":"2024-09-21T03:20:52.382974+0000","last_undegraded":"2024-09-21T03:20:52.382974+0000","last_fullsized":"2024-09-21T03:20:52.382974+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:46.810633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.140434+0000","last_change":"2024-09-21T03:20:50.132826+0000","last_active":"2024-09-21T03:20:52.140434+0000","last_peered":"2024-09-21T03:20:52.140434+0000","last_clean":"2024-09-21T03:20:52.140434+0000","last_became_active":"2024-09-21T03:20:50.132495+0000","last_became_peered":"2024-09-21T03:20:50.132495+0000","last_unstale":"2024-09-21T03:20:52.140434+0000","last_undegraded":"2024-09-21T03:20:52.140434+0000","last_fullsized":"2024-09-21T03:20:52.140434+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:56.708474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.382991+0000","last_change":"2024-09-21T03:20:51.131785+0000","last_active":"2024-09-21T03:20:52.382991+0000","last_peered":"2024-09-21T03:20:52.382991+0000","last_clean":"2024-09-21T03:20:52.382991+0000","last_became_active":"2024-09-21T03:20:51.131500+0000","last_became_peered":"2024-09-21T03:20:51.131500+0000","last_unstale":"2024-09-21T03:20:52.382991+0000","last_undegraded":"2024-09-21T03:20:52.382991+0000","last_fullsized":"2024-09-21T03:20:52.382991+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:53:06.166974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"56'1","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T03:20:51.146585+0000","last_change":"2024-09-21T03:20:50.128718+0000","last_active":"2024-09-21T03:20:51.146585+0000","last_peered":"2024-09-21T03:20:51.146585+0000","last_clean":"2024-09-21T03:20:51.146585+0000","last_became_active":"2024-09-21T03:20:50.128388+0000","last_became_peered":"2024-09-21T03:20:50.128388+0000","last_unstale":"2024-09-21T03:20:51.146585+0000","last_undegraded":"2024-09-21T03:20:51.146585+0000","last_fullsized":"2024-09-21T03:20:51.146585+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:33.784819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.140014+0000","last_change":"2024-09-21T03:20:51.135890+0000","last_active":"2024-09-21T03:20:52.140014+0000","last_peered":"2024-09-21T03:20:52.140014+0000","last_clean":"2024-09-21T03:20:52.140014+0000","last_became_active":"2024-09-21T03:20:51.135543+0000","last_became_peered":"2024-09-21T03:20:51.135543+0000","last_unstale":"2024-09-21T03:20:52.140014+0000","last_undegraded":"2024-09-21T03:20:52.140014+0000","last_fullsized":"2024-09-21T03:20:52.140014+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:40.518864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.382052+0000","last_change":"2024-09-21T03:20:50.130150+0000","last_active":"2024-09-21T03:20:52.382052+0000","last_peered":"2024-09-21T03:20:52.382052+0000","last_clean":"2024-09-21T03:20:52.382052+0000","last_became_active":"2024-09-21T03:20:50.129609+0000","last_became_peered":"2024-09-21T03:20:50.129609+0000","last_unstale":"2024-09-21T03:20:52.382052+0000","last_undegraded":"2024-09-21T03:20:52.382052+0000","last_fullsized":"2024-09-21T03:20:52.382052+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:26.892351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.383165+0000","last_change":"2024-09-21T03:20:51.131393+0000","last_active":"2024-09-21T03:20:52.383165+0000","last_peered":"2024-09-21T03:20:52.383165+0000","last_clean":"2024-09-21T03:20:52.383165+0000","last_became_active":"2024-09-21T03:20:51.131034+0000","last_became_peered":"2024-09-21T03:20:51.131034+0000","last_unstale":"2024-09-21T03:20:52.383165+0000","last_undegraded":"2024-09-21T03:20:52.383165+0000","last_fullsized":"2024-09-21T03:20:52.383165+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:37:35.525589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.139887+0000","last_change":"2024-09-21T03:20:50.139960+0000","last_active":"2024-09-21T03:20:52.139887+0000","last_peered":"2024-09-21T03:20:52.139887+0000","last_clean":"2024-09-21T03:20:52.139887+0000","last_became_active":"2024-09-21T03:20:50.139636+0000","last_became_peered":"2024-09-21T03:20:50.139636+0000","last_unstale":"2024-09-21T03:20:52.139887+0000","last_undegraded":"2024-09-21T03:20:52.139887+0000","last_fullsized":"2024-09-21T03:20:52.139887+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:48.169354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.140533+0000","last_change":"2024-09-21T03:20:51.142701+0000","last_active":"2024-09-21T03:20:52.140533+0000","last_peered":"2024-09-21T03:20:52.140533+0000","last_clean":"2024-09-21T03:20:52.140533+0000","last_became_active":"2024-09-21T03:20:51.142371+0000","last_became_peered":"2024-09-21T03:20:51.142371+0000","last_unstale":"2024-09-21T03:20:52.140533+0000","last_undegraded":"2024-09-21T03:20:52.140533+0000","last_fullsized":"2024-09-21T03:20:52.140533+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:27.894903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.383232+0000","last_change":"2024-09-21T03:20:50.132597+0000","last_active":"2024-09-21T03:20:52.383232+0000","last_peered":"2024-09-21T03:20:52.383232+0000","last_clean":"2024-09-21T03:20:52.383232+0000","last_became_active":"2024-09-21T03:20:50.132255+0000","last_became_peered":"2024-09-21T03:20:50.132255+0000","last_unstale":"2024-09-21T03:20:52.383232+0000","last_undegraded":"2024-09-21T03:20:52.383232+0000","last_fullsized":"2024-09-21T03:20:52.383232+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:01.402019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.383301+0000","last_change":"2024-09-21T03:20:51.149441+0000","last_active":"2024-09-21T03:20:52.383301+0000","last_peered":"2024-09-21T03:20:52.383301+0000","last_clean":"2024-09-21T03:20:52.383301+0000","last_became_active":"2024-09-21T03:20:51.148750+0000","last_became_peered":"2024-09-21T03:20:51.148750+0000","last_unstale":"2024-09-21T03:20:52.383301+0000","last_undegraded":"2024-09-21T03:20:52.383301+0000","last_fullsized":"2024-09-21T03:20:52.383301+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:30.337005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.382958+0000","last_change":"2024-09-21T03:20:50.134863+0000","last_active":"2024-09-21T03:20:52.382958+0000","last_peered":"2024-09-21T03:20:52.382958+0000","last_clean":"2024-09-21T03:20:52.382958+0000","last_became_active":"2024-09-21T03:20:50.134565+0000","last_became_peered":"2024-09-21T03:20:50.134565+0000","last_unstale":"2024-09-21T03:20:52.382958+0000","last_undegraded":"2024-09-21T03:20:52.382958+0000","last_fullsized":"2024-09-21T03:20:52.382958+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:39.030020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.134437+0000","last_change":"2024-09-21T03:20:51.145995+0000","last_active":"2024-09-21T03:20:52.134437+0000","last_peered":"2024-09-21T03:20:52.134437+0000","last_clean":"2024-09-21T03:20:52.134437+0000","last_became_active":"2024-09-21T03:20:51.145685+0000","last_became_peered":"2024-09-21T03:20:51.145685+0000","last_unstale":"2024-09-21T03:20:52.134437+0000","last_undegraded":"2024-09-21T03:20:52.134437+0000","last_fullsized":"2024-09-21T03:20:52.134437+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:58.766266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"56'3","reported_seq":18,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.383363+0000","last_change":"2024-09-21T03:20:50.126498+0000","last_active":"2024-09-21T03:20:52.383363+0000","last_peered":"2024-09-21T03:20:52.383363+0000","last_clean":"2024-09-21T03:20:52.383363+0000","last_became_active":"2024-09-21T03:20:50.126182+0000","last_became_peered":"2024-09-21T03:20:50.126182+0000","last_unstale":"2024-09-21T03:20:52.383363+0000","last_undegraded":"2024-09-21T03:20:52.383363+0000","last_fullsized":"2024-09-21T03:20:52.383363+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:01.893444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.383061+0000","last_change":"2024-09-21T03:20:51.150134+0000","last_active":"2024-09-21T03:20:52.383061+0000","last_peered":"2024-09-21T03:20:52.383061+0000","last_clean":"2024-09-21T03:20:52.383061+0000","last_became_active":"2024-09-21T03:20:51.149399+0000","last_became_peered":"2024-09-21T03:20:51.149399+0000","last_unstale":"2024-09-21T03:20:52.383061+0000","last_undegraded":"2024-09-21T03:20:52.383061+0000","last_fullsized":"2024-09-21T03:20:52.383061+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:12.875542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"56'6","reported_seq":21,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.140836+0000","last_change":"2024-09-21T03:20:50.134992+0000","last_active":"2024-09-21T03:20:52.140836+0000","last_peered":"2024-09-21T03:20:52.140836+0000","last_clean":"2024-09-21T03:20:52.140836+0000","last_became_active":"2024-09-21T03:20:50.134683+0000","last_became_peered":"2024-09-21T03:20:50.134683+0000","last_unstale":"2024-09-21T03:20:52.140836+0000","last_undegraded":"2024-09-21T03:20:52.140836+0000","last_fullsized":"2024-09-21T03:20:52.140836+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:38.249745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.382202+0000","last_change":"2024-09-21T03:20:51.149912+0000","last_active":"2024-09-21T03:20:52.382202+0000","last_peered":"2024-09-21T03:20:52.382202+0000","last_clean":"2024-09-21T03:20:52.382202+0000","last_became_active":"2024-09-21T03:20:51.148811+0000","last_became_peered":"2024-09-21T03:20:51.148811+0000","last_unstale":"2024-09-21T03:20:52.382202+0000","last_undegraded":"2024-09-21T03:20:52.382202+0000","last_fullsized":"2024-09-21T03:20:52.382202+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:21:48.318245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.383286+0000","last_change":"2024-09-21T03:20:50.139562+0000","last_active":"2024-09-21T03:20:52.383286+0000","last_peered":"2024-09-21T03:20:52.383286+0000","last_clean":"2024-09-21T03:20:52.383286+0000","last_became_active":"2024-09-21T03:20:50.139255+0000","last_became_peered":"2024-09-21T03:20:50.139255+0000","last_unstale":"2024-09-21T03:20:52.383286+0000","last_undegraded":"2024-09-21T03:20:52.383286+0000","last_fullsized":"2024-09-21T03:20:52.383286+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:57.644431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.383281+0000","last_change":"2024-09-21T03:20:51.140014+0000","last_active":"2024-09-21T03:20:52.383281+0000","last_peered":"2024-09-21T03:20:52.383281+0000","last_clean":"2024-09-21T03:20:52.383281+0000","last_became_active":"2024-09-21T03:20:51.139564+0000","last_became_peered":"2024-09-21T03:20:51.139564+0000","last_unstale":"2024-09-21T03:20:52.383281+0000","last_undegraded":"2024-09-21T03:20:52.383281+0000","last_fullsized":"2024-09-21T03:20:52.383281+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:11:49.555944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.139742+0000","last_change":"2024-09-21T03:20:50.125536+0000","last_active":"2024-09-21T03:20:52.139742+0000","last_peered":"2024-09-21T03:20:52.139742+0000","last_clean":"2024-09-21T03:20:52.139742+0000","last_became_active":"2024-09-21T03:20:50.125220+0000","last_became_peered":"2024-09-21T03:20:50.125220+0000","last_unstale":"2024-09-21T03:20:52.139742+0000","last_undegraded":"2024-09-21T03:20:52.139742+0000","last_fullsized":"2024-09-21T03:20:52.139742+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:36.643628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.139740+0000","last_change":"2024-09-21T03:20:51.136420+0000","last_active":"2024-09-21T03:20:52.139740+0000","last_peered":"2024-09-21T03:20:52.139740+0000","last_clean":"2024-09-21T03:20:52.139740+0000","last_became_active":"2024-09-21T03:20:51.136081+0000","last_became_peered":"2024-09-21T03:20:51.136081+0000","last_unstale":"2024-09-21T03:20:52.139740+0000","last_undegraded":"2024-09-21T03:20:52.139740+0000","last_fullsized":"2024-09-21T03:20:52.139740+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:16:09.860455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.382174+0000","last_change":"2024-09-21T03:20:50.131034+0000","last_active":"2024-09-21T03:20:52.382174+0000","last_peered":"2024-09-21T03:20:52.382174+0000","last_clean":"2024-09-21T03:20:52.382174+0000","last_became_active":"2024-09-21T03:20:50.130680+0000","last_became_peered":"2024-09-21T03:20:50.130680+0000","last_unstale":"2024-09-21T03:20:52.382174+0000","last_undegraded":"2024-09-21T03:20:52.382174+0000","last_fullsized":"2024-09-21T03:20:52.382174+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:04.247885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.382928+0000","last_change":"2024-09-21T03:20:51.146034+0000","last_active":"2024-09-21T03:20:52.382928+0000","last_peered":"2024-09-21T03:20:52.382928+0000","last_clean":"2024-09-21T03:20:52.382928+0000","last_became_active":"2024-09-21T03:20:51.145755+0000","last_became_peered":"2024-09-21T03:20:51.145755+0000","last_unstale":"2024-09-21T03:20:52.382928+0000","last_undegraded":"2024-09-21T03:20:52.382928+0000","last_fullsized":"2024-09-21T03:20:52.382928+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:00.513766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"56'8","reported_seq":23,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.382423+0000","last_change":"2024-09-21T03:20:50.129311+0000","last_active":"2024-09-21T03:20:52.382423+0000","last_peered":"2024-09-21T03:20:52.382423+0000","last_clean":"2024-09-21T03:20:52.382423+0000","last_became_active":"2024-09-21T03:20:50.128984+0000","last_became_peered":"2024-09-21T03:20:50.128984+0000","last_unstale":"2024-09-21T03:20:52.382423+0000","last_undegraded":"2024-09-21T03:20:52.382423+0000","last_fullsized":"2024-09-21T03:20:52.382423+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:07.303246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.383055+0000","last_change":"2024-09-21T03:20:51.139345+0000","last_active":"2024-09-21T03:20:52.383055+0000","last_peered":"2024-09-21T03:20:52.383055+0000","last_clean":"2024-09-21T03:20:52.383055+0000","last_became_active":"2024-09-21T03:20:51.138989+0000","last_became_peered":"2024-09-21T03:20:51.138989+0000","last_unstale":"2024-09-21T03:20:52.383055+0000","last_undegraded":"2024-09-21T03:20:52.383055+0000","last_fullsized":"2024-09-21T03:20:52.383055+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:25.405964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.383437+0000","last_change":"2024-09-21T03:20:50.139040+0000","last_active":"2024-09-21T03:20:52.383437+0000","last_peered":"2024-09-21T03:20:52.383437+0000","last_clean":"2024-09-21T03:20:52.383437+0000","last_became_active":"2024-09-21T03:20:50.138711+0000","last_became_peered":"2024-09-21T03:20:50.138711+0000","last_unstale":"2024-09-21T03:20:52.383437+0000","last_undegraded":"2024-09-21T03:20:52.383437+0000","last_fullsized":"2024-09-21T03:20:52.383437+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:21:47.315693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.382954+0000","last_change":"2024-09-21T03:20:51.149099+0000","last_active":"2024-09-21T03:20:52.382954+0000","last_peered":"2024-09-21T03:20:52.382954+0000","last_clean":"2024-09-21T03:20:52.382954+0000","last_became_active":"2024-09-21T03:20:51.148753+0000","last_became_peered":"2024-09-21T03:20:51.148753+0000","last_unstale":"2024-09-21T03:20:52.382954+0000","last_undegraded":"2024-09-21T03:20:52.382954+0000","last_fullsized":"2024-09-21T03:20:52.382954+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:00.513766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"56'2","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T03:20:51.145214+0000","last_change":"2024-09-21T03:20:50.135257+0000","last_active":"2024-09-21T03:20:51.145214+0000","last_peered":"2024-09-21T03:20:51.145214+0000","last_clean":"2024-09-21T03:20:51.145214+0000","last_became_active":"2024-09-21T03:20:50.134960+0000","last_became_peered":"2024-09-21T03:20:50.134960+0000","last_unstale":"2024-09-21T03:20:51.145214+0000","last_undegraded":"2024-09-21T03:20:51.145214+0000","last_fullsized":"2024-09-21T03:20:51.145214+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:14.013132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.383289+0000","last_change":"2024-09-21T03:20:51.139709+0000","last_active":"2024-09-21T03:20:52.383289+0000","last_peered":"2024-09-21T03:20:52.383289+0000","last_clean":"2024-09-21T03:20:52.383289+0000","last_became_active":"2024-09-21T03:20:51.139399+0000","last_became_peered":"2024-09-21T03:20:51.139399+0000","last_unstale":"2024-09-21T03:20:52.383289+0000","last_undegraded":"2024-09-21T03:20:52.383289+0000","last_fullsized":"2024-09-21T03:20:52.383289+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:52.931632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.382415+0000","last_change":"2024-09-21T03:20:50.131923+0000","last_active":"2024-09-21T03:20:52.382415+0000","last_peered":"2024-09-21T03:20:52.382415+0000","last_clean":"2024-09-21T03:20:52.382415+0000","last_became_active":"2024-09-21T03:20:50.131583+0000","last_became_peered":"2024-09-21T03:20:50.131583+0000","last_unstale":"2024-09-21T03:20:52.382415+0000","last_undegraded":"2024-09-21T03:20:52.382415+0000","last_fullsized":"2024-09-21T03:20:52.382415+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:00.955267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.383361+0000","last_change":"2024-09-21T03:20:51.150211+0000","last_active":"2024-09-21T03:20:52.383361+0000","last_peered":"2024-09-21T03:20:52.383361+0000","last_clean":"2024-09-21T03:20:52.383361+0000","last_became_active":"2024-09-21T03:20:51.149887+0000","last_became_peered":"2024-09-21T03:20:51.149887+0000","last_unstale":"2024-09-21T03:20:52.383361+0000","last_undegraded":"2024-09-21T03:20:52.383361+0000","last_fullsized":"2024-09-21T03:20:52.383361+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:13.094892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T03:20:51.120623+0000","last_change":"2024-09-21T03:20:50.139832+0000","last_active":"2024-09-21T03:20:51.120623+0000","last_peered":"2024-09-21T03:20:51.120623+0000","last_clean":"2024-09-21T03:20:51.120623+0000","last_became_active":"2024-09-21T03:20:50.139505+0000","last_became_peered":"2024-09-21T03:20:50.139505+0000","last_unstale":"2024-09-21T03:20:51.120623+0000","last_undegraded":"2024-09-21T03:20:51.120623+0000","last_fullsized":"2024-09-21T03:20:51.120623+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:06.780416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.382243+0000","last_change":"2024-09-21T03:20:51.149486+0000","last_active":"2024-09-21T03:20:52.382243+0000","last_peered":"2024-09-21T03:20:52.382243+0000","last_clean":"2024-09-21T03:20:52.382243+0000","last_became_active":"2024-09-21T03:20:51.148832+0000","last_became_peered":"2024-09-21T03:20:51.148832+0000","last_unstale":"2024-09-21T03:20:52.382243+0000","last_undegraded":"2024-09-21T03:20:52.382243+0000","last_fullsized":"2024-09-21T03:20:52.382243+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:06:28.903784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.383622+0000","last_change":"2024-09-21T03:20:50.134376+0000","last_active":"2024-09-21T03:20:52.383622+0000","last_peered":"2024-09-21T03:20:52.383622+0000","last_clean":"2024-09-21T03:20:52.383622+0000","last_became_active":"2024-09-21T03:20:50.134082+0000","last_became_peered":"2024-09-21T03:20:50.134082+0000","last_unstale":"2024-09-21T03:20:52.383622+0000","last_undegraded":"2024-09-21T03:20:52.383622+0000","last_fullsized":"2024-09-21T03:20:52.383622+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:06:27.901232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T03:20:51.131731+0000","last_change":"2024-09-21T03:20:51.128657+0000","last_active":"2024-09-21T03:20:51.131731+0000","last_peered":"2024-09-21T03:20:51.131731+0000","last_clean":"2024-09-21T03:20:51.131731+0000","last_became_active":"2024-09-21T03:20:51.127920+0000","last_became_peered":"2024-09-21T03:20:51.127920+0000","last_unstale":"2024-09-21T03:20:51.131731+0000","last_undegraded":"2024-09-21T03:20:51.131731+0000","last_fullsized":"2024-09-21T03:20:51.131731+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:45.031578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.134376+0000","last_change":"2024-09-21T03:20:50.133469+0000","last_active":"2024-09-21T03:20:52.134376+0000","last_peered":"2024-09-21T03:20:52.134376+0000","last_clean":"2024-09-21T03:20:52.134376+0000","last_became_active":"2024-09-21T03:20:50.132892+0000","last_became_peered":"2024-09-21T03:20:50.132892+0000","last_unstale":"2024-09-21T03:20:52.134376+0000","last_undegraded":"2024-09-21T03:20:52.134376+0000","last_fullsized":"2024-09-21T03:20:52.134376+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:12:18.777014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T03:20:51.143466+0000","last_change":"2024-09-21T03:20:51.141851+0000","last_active":"2024-09-21T03:20:51.143466+0000","last_peered":"2024-09-21T03:20:51.143466+0000","last_clean":"2024-09-21T03:20:51.143466+0000","last_became_active":"2024-09-21T03:20:51.137860+0000","last_became_peered":"2024-09-21T03:20:51.137860+0000","last_unstale":"2024-09-21T03:20:51.143466+0000","last_undegraded":"2024-09-21T03:20:51.143466+0000","last_fullsized":"2024-09-21T03:20:51.143466+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:29.859686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.382311+0000","last_change":"2024-09-21T03:20:50.139966+0000","last_active":"2024-09-21T03:20:52.382311+0000","last_peered":"2024-09-21T03:20:52.382311+0000","last_clean":"2024-09-21T03:20:52.382311+0000","last_became_active":"2024-09-21T03:20:50.139658+0000","last_became_peered":"2024-09-21T03:20:50.139658+0000","last_unstale":"2024-09-21T03:20:52.382311+0000","last_undegraded":"2024-09-21T03:20:52.382311+0000","last_fullsized":"2024-09-21T03:20:52.382311+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:44:06.492931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.382599+0000","last_change":"2024-09-21T03:20:51.134999+0000","last_active":"2024-09-21T03:20:52.382599+0000","last_peered":"2024-09-21T03:20:52.382599+0000","last_clean":"2024-09-21T03:20:52.382599+0000","last_became_active":"2024-09-21T03:20:51.134643+0000","last_became_peered":"2024-09-21T03:20:51.134643+0000","last_unstale":"2024-09-21T03:20:52.382599+0000","last_undegraded":"2024-09-21T03:20:52.382599+0000","last_fullsized":"2024-09-21T03:20:52.382599+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:48:30.691823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.134614+0000","last_change":"2024-09-21T03:20:50.140081+0000","last_active":"2024-09-21T03:20:52.134614+0000","last_peered":"2024-09-21T03:20:52.134614+0000","last_clean":"2024-09-21T03:20:52.134614+0000","last_became_active":"2024-09-21T03:20:50.139718+0000","last_became_peered":"2024-09-21T03:20:50.139718+0000","last_unstale":"2024-09-21T03:20:52.134614+0000","last_undegraded":"2024-09-21T03:20:52.134614+0000","last_fullsized":"2024-09-21T03:20:52.134614+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:48:19.421148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.382975+0000","last_change":"2024-09-21T03:20:51.144279+0000","last_active":"2024-09-21T03:20:52.382975+0000","last_peered":"2024-09-21T03:20:52.382975+0000","last_clean":"2024-09-21T03:20:52.382975+0000","last_became_active":"2024-09-21T03:20:51.143153+0000","last_became_peered":"2024-09-21T03:20:51.143153+0000","last_unstale":"2024-09-21T03:20:52.382975+0000","last_undegraded":"2024-09-21T03:20:52.382975+0000","last_fullsized":"2024-09-21T03:20:52.382975+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:30:06.875621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T03:20:51.120785+0000","last_change":"2024-09-21T03:20:50.134186+0000","last_active":"2024-09-21T03:20:51.120785+0000","last_peered":"2024-09-21T03:20:51.120785+0000","last_clean":"2024-09-21T03:20:51.120785+0000","last_became_active":"2024-09-21T03:20:50.133876+0000","last_became_peered":"2024-09-21T03:20:50.133876+0000","last_unstale":"2024-09-21T03:20:51.120785+0000","last_undegraded":"2024-09-21T03:20:51.120785+0000","last_fullsized":"2024-09-21T03:20:51.120785+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:56:27.448141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.134657+0000","last_change":"2024-09-21T03:20:51.142102+0000","last_active":"2024-09-21T03:20:52.134657+0000","last_peered":"2024-09-21T03:20:52.134657+0000","last_clean":"2024-09-21T03:20:52.134657+0000","last_became_active":"2024-09-21T03:20:51.141795+0000","last_became_peered":"2024-09-21T03:20:51.141795+0000","last_unstale":"2024-09-21T03:20:52.134657+0000","last_undegraded":"2024-09-21T03:20:52.134657+0000","last_fullsized":"2024-09-21T03:20:52.134657+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:53.547164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.140264+0000","last_change":"2024-09-21T03:20:50.133207+0000","last_active":"2024-09-21T03:20:52.140264+0000","last_peered":"2024-09-21T03:20:52.140264+0000","last_clean":"2024-09-21T03:20:52.140264+0000","last_became_active":"2024-09-21T03:20:50.132886+0000","last_became_peered":"2024-09-21T03:20:50.132886+0000","last_unstale":"2024-09-21T03:20:52.140264+0000","last_undegraded":"2024-09-21T03:20:52.140264+0000","last_fullsized":"2024-09-21T03:20:52.140264+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:55.403828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-21T03:20:51.139775+0000","last_change":"2024-09-21T03:20:51.136287+0000","last_active":"2024-09-21T03:20:51.139775+0000","last_peered":"2024-09-21T03:20:51.139775+0000","last_clean":"2024-09-21T03:20:51.139775+0000","last_became_active":"2024-09-21T03:20:51.135651+0000","last_became_peered":"2024-09-21T03:20:51.135651+0000","last_unstale":"2024-09-21T03:20:51.139775+0000","last_undegraded":"2024-09-21T03:20:51.139775+0000","last_fullsized":"2024-09-21T03:20:51.139775+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:38.038250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.383656+0000","last_change":"2024-09-21T03:20:50.133384+0000","last_active":"2024-09-21T03:20:52.383656+0000","last_peered":"2024-09-21T03:20:52.383656+0000","last_clean":"2024-09-21T03:20:52.383656+0000","last_became_active":"2024-09-21T03:20:50.133076+0000","last_became_peered":"2024-09-21T03:20:50.133076+0000","last_unstale":"2024-09-21T03:20:52.383656+0000","last_undegraded":"2024-09-21T03:20:52.383656+0000","last_fullsized":"2024-09-21T03:20:52.383656+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:53:55.107452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.383170+0000","last_change":"2024-09-21T03:20:51.148090+0000","last_active":"2024-09-21T03:20:52.383170+0000","last_peered":"2024-09-21T03:20:52.383170+0000","last_clean":"2024-09-21T03:20:52.383170+0000","last_became_active":"2024-09-21T03:20:51.147827+0000","last_became_peered":"2024-09-21T03:20:51.147827+0000","last_unstale":"2024-09-21T03:20:52.383170+0000","last_undegraded":"2024-09-21T03:20:52.383170+0000","last_fullsized":"2024-09-21T03:20:52.383170+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:14.309903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.134238+0000","last_change":"2024-09-21T03:20:50.131569+0000","last_active":"2024-09-21T03:20:52.134238+0000","last_peered":"2024-09-21T03:20:52.134238+0000","last_clean":"2024-09-21T03:20:52.134238+0000","last_became_active":"2024-09-21T03:20:50.131278+0000","last_became_peered":"2024-09-21T03:20:50.131278+0000","last_unstale":"2024-09-21T03:20:52.134238+0000","last_undegraded":"2024-09-21T03:20:52.134238+0000","last_fullsized":"2024-09-21T03:20:52.134238+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:03:26.659961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.383292+0000","last_change":"2024-09-21T03:20:51.146077+0000","last_active":"2024-09-21T03:20:52.383292+0000","last_peered":"2024-09-21T03:20:52.383292+0000","last_clean":"2024-09-21T03:20:52.383292+0000","last_became_active":"2024-09-21T03:20:51.145803+0000","last_became_peered":"2024-09-21T03:20:51.145803+0000","last_unstale":"2024-09-21T03:20:52.383292+0000","last_undegraded":"2024-09-21T03:20:52.383292+0000","last_fullsized":"2024-09-21T03:20:52.383292+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:08.386923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.140214+0000","last_change":"2024-09-21T03:20:50.137251+0000","last_active":"2024-09-21T03:20:52.140214+0000","last_peered":"2024-09-21T03:20:52.140214+0000","last_clean":"2024-09-21T03:20:52.140214+0000","last_became_active":"2024-09-21T03:20:50.136937+0000","last_became_peered":"2024-09-21T03:20:50.136937+0000","last_unstale":"2024-09-21T03:20:52.140214+0000","last_undegraded":"2024-09-21T03:20:52.140214+0000","last_fullsized":"2024-09-21T03:20:52.140214+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:57.763713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.134245+0000","last_change":"2024-09-21T03:20:51.141068+0000","last_active":"2024-09-21T03:20:52.134245+0000","last_peered":"2024-09-21T03:20:52.134245+0000","last_clean":"2024-09-21T03:20:52.134245+0000","last_became_active":"2024-09-21T03:20:51.140756+0000","last_became_peered":"2024-09-21T03:20:51.140756+0000","last_unstale":"2024-09-21T03:20:52.134245+0000","last_undegraded":"2024-09-21T03:20:52.134245+0000","last_fullsized":"2024-09-21T03:20:52.134245+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:57.711026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.134208+0000","last_change":"2024-09-21T03:20:50.134662+0000","last_active":"2024-09-21T03:20:52.134208+0000","last_peered":"2024-09-21T03:20:52.134208+0000","last_clean":"2024-09-21T03:20:52.134208+0000","last_became_active":"2024-09-21T03:20:50.134367+0000","last_became_peered":"2024-09-21T03:20:50.134367+0000","last_unstale":"2024-09-21T03:20:52.134208+0000","last_undegraded":"2024-09-21T03:20:52.134208+0000","last_fullsized":"2024-09-21T03:20:52.134208+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:36.643628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.383514+0000","last_change":"2024-09-21T03:20:51.135213+0000","last_active":"2024-09-21T03:20:52.383514+0000","last_peered":"2024-09-21T03:20:52.383514+0000","last_clean":"2024-09-21T03:20:52.383514+0000","last_became_active":"2024-09-21T03:20:51.134901+0000","last_became_peered":"2024-09-21T03:20:51.134901+0000","last_unstale":"2024-09-21T03:20:52.383514+0000","last_undegraded":"2024-09-21T03:20:52.383514+0000","last_fullsized":"2024-09-21T03:20:52.383514+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:42.169702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.382730+0000","last_change":"2024-09-21T03:20:50.133340+0000","last_active":"2024-09-21T03:20:52.382730+0000","last_peered":"2024-09-21T03:20:52.382730+0000","last_clean":"2024-09-21T03:20:52.382730+0000","last_became_active":"2024-09-21T03:20:50.131791+0000","last_became_peered":"2024-09-21T03:20:50.131791+0000","last_unstale":"2024-09-21T03:20:52.382730+0000","last_undegraded":"2024-09-21T03:20:52.382730+0000","last_fullsized":"2024-09-21T03:20:52.382730+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:48:29.689271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.382671+0000","last_change":"2024-09-21T03:20:51.132378+0000","last_active":"2024-09-21T03:20:52.382671+0000","last_peered":"2024-09-21T03:20:52.382671+0000","last_clean":"2024-09-21T03:20:52.382671+0000","last_became_active":"2024-09-21T03:20:51.131049+0000","last_became_peered":"2024-09-21T03:20:51.131049+0000","last_unstale":"2024-09-21T03:20:52.382671+0000","last_undegraded":"2024-09-21T03:20:52.382671+0000","last_fullsized":"2024-09-21T03:20:52.382671+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:50.110083+0000","last_clean_scrub_stamp":"2024-09-21T03:20:50.110083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:11.678535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.139764+0000","last_change":"2024-09-21T03:20:50.128554+0000","last_active":"2024-09-21T03:20:52.139764+0000","last_peered":"2024-09-21T03:20:52.139764+0000","last_clean":"2024-09-21T03:20:52.139764+0000","last_became_active":"2024-09-21T03:20:50.128231+0000","last_became_peered":"2024-09-21T03:20:50.128231+0000","last_unstale":"2024-09-21T03:20:52.139764+0000","last_undegraded":"2024-09-21T03:20:52.139764+0000","last_fullsized":"2024-09-21T03:20:52.139764+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:20:49.107531+0000","last_clean_scrub_stamp":"2024-09-21T03:20:49.107531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:00.138910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":174,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-21T03:20:52.382656+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:20:52.382656+0000","last_peered":"2024-09-21T03:20:52.382656+0000","last_clean":"2024-09-21T03:20:52.382656+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:20:52.382656+0000","last_undegraded":"2024-09-21T03:20:52.382656+0000","last_fullsized":"2024-09-21T03:20:52.382656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509476,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28280,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343560,"statfs":{"total":96636764160,"available":96607805440,"internally_reserved":0,"allocated":1277952,"data_stored":866654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509475,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":675840,"data_stored":276126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509474,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":684032,"data_stored":276778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509474,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":688128,"data_stored":277738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509475,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":684032,"data_stored":276182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509475,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":684032,"data_stored":276182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509475,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":679936,"data_stored":276216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1257472,"data_stored":860194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:20:55.506 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T03:20:55.506 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T03:20:55.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.660+0000 7f2732df1640 1 -- 172.21.15.105:0/981228627 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f272c0706c0 msgr2=0x7f272c072ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:55.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.660+0000 7f2732df1640 1 --2- 172.21.15.105:0/981228627 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f272c0706c0 0x7f272c072ff0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f2724005fd0 tx=0x7f272402a820 comp rx=0 tx=0).stop 2024-09-21T03:20:55.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.660+0000 7f2732df1640 1 -- 172.21.15.105:0/981228627 shutdown_connections 2024-09-21T03:20:55.664 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.660+0000 7f2732df1640 1 --2- 172.21.15.105:0/981228627 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f272c0706c0 0x7f272c072ff0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:55.664 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.660+0000 7f2732df1640 1 --2- 172.21.15.105:0/981228627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f272c0cd3e0 0x7f272c070180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:55.664 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.660+0000 7f2732df1640 1 -- 172.21.15.105:0/981228627 >> 172.21.15.105:0/981228627 conn(0x7f272c06d7d0 msgr2=0x7f272c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:55.664 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.660+0000 7f2732df1640 1 -- 172.21.15.105:0/981228627 shutdown_connections 2024-09-21T03:20:55.664 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.660+0000 7f2732df1640 1 -- 172.21.15.105:0/981228627 wait complete. 2024-09-21T03:20:55.665 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.662+0000 7f2732df1640 1 Processor -- start 2024-09-21T03:20:55.665 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.662+0000 7f2732df1640 1 -- start start 2024-09-21T03:20:55.668 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.664+0000 7f2732df1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f272c0706c0 0x7f272c1f2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:55.668 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.664+0000 7f2732df1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f272c0af780 0x7f272c1472a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:55.668 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.664+0000 7f2732df1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f272c0cd3e0 0x7f272c1477e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:55.668 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.664+0000 7f2732df1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f272c073b20 con 0x7f272c0706c0 2024-09-21T03:20:55.668 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.664+0000 7f2732df1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f272c0739a0 con 0x7f272c0cd3e0 2024-09-21T03:20:55.668 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.664+0000 7f2732df1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f272c073ca0 con 0x7f272c0af780 2024-09-21T03:20:55.668 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.664+0000 7f2730b8d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f272c0706c0 0x7f272c1f2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:55.669 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.664+0000 7f2730b8d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f272c0706c0 0x7f272c1f2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:35774/0 (socket says 172.21.15.105:35774) 2024-09-21T03:20:55.669 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.664+0000 7f2730b8d640 1 -- 172.21.15.105:0/585942140 learned_addr learned my addr 172.21.15.105:0/585942140 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:55.669 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.664+0000 7f2723fff640 1 --2- 172.21.15.105:0/585942140 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f272c0af780 0x7f272c1472a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:55.669 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.664+0000 7f273138e640 1 --2- 172.21.15.105:0/585942140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f272c0cd3e0 0x7f272c1477e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:55.669 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.664+0000 7f2730b8d640 1 -- 172.21.15.105:0/585942140 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f272c0af780 msgr2=0x7f272c1472a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:55.669 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.664+0000 7f2730b8d640 1 --2- 172.21.15.105:0/585942140 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f272c0af780 0x7f272c1472a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:55.669 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.664+0000 7f2730b8d640 1 -- 172.21.15.105:0/585942140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f272c0cd3e0 msgr2=0x7f272c1477e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:55.669 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.664+0000 7f2730b8d640 1 --2- 172.21.15.105:0/585942140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f272c0cd3e0 0x7f272c1477e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:55.670 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.664+0000 7f2730b8d640 1 -- 172.21.15.105:0/585942140 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f272c1f2d40 con 0x7f272c0706c0 2024-09-21T03:20:55.670 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.664+0000 7f273138e640 1 --2- 172.21.15.105:0/585942140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f272c0cd3e0 0x7f272c1477e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:20:55.670 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.664+0000 7f2723fff640 1 --2- 172.21.15.105:0/585942140 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f272c0af780 0x7f272c1472a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:20:55.670 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.664+0000 7f2730b8d640 1 --2- 172.21.15.105:0/585942140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f272c0706c0 0x7f272c1f2800 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f272800c3f0 tx=0x7f272800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:55.670 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.664+0000 7f27217fa640 1 -- 172.21.15.105:0/585942140 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2728017070 con 0x7f272c0706c0 2024-09-21T03:20:55.670 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.664+0000 7f27217fa640 1 -- 172.21.15.105:0/585942140 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f27280035f0 con 0x7f272c0706c0 2024-09-21T03:20:55.670 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.664+0000 7f2732df1640 1 -- 172.21.15.105:0/585942140 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f272c15cc90 con 0x7f272c0706c0 2024-09-21T03:20:55.670 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.664+0000 7f27217fa640 1 -- 172.21.15.105:0/585942140 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2728003a40 con 0x7f272c0706c0 2024-09-21T03:20:55.671 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.664+0000 7f2732df1640 1 -- 172.21.15.105:0/585942140 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f272c1467c0 con 0x7f272c0706c0 2024-09-21T03:20:55.671 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.666+0000 7f2732df1640 1 -- 172.21.15.105:0/585942140 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f272c072ff0 con 0x7f272c0706c0 2024-09-21T03:20:55.671 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.666+0000 7f27217fa640 1 -- 172.21.15.105:0/585942140 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f272801a070 con 0x7f272c0706c0 2024-09-21T03:20:55.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.667+0000 7f27217fa640 1 --2- 172.21.15.105:0/585942140 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2718078b90 0x7f271807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:55.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.667+0000 7f27217fa640 1 -- 172.21.15.105:0/585942140 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f272809a050 con 0x7f272c0706c0 2024-09-21T03:20:55.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.667+0000 7f2723fff640 1 --2- 172.21.15.105:0/585942140 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2718078b90 0x7f271807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:55.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.667+0000 7f2723fff640 1 --2- 172.21.15.105:0/585942140 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2718078b90 0x7f271807b0a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f272c15f0c0 tx=0x7f271c005db0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:55.673 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.671+0000 7f27217fa640 1 -- 172.21.15.105:0/585942140 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2728062520 con 0x7f272c0706c0 2024-09-21T03:20:55.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.915+0000 7f2732df1640 1 -- 172.21.15.105:0/585942140 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f272c146e80 con 0x7f272c0706c0 2024-09-21T03:20:55.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.918+0000 7f27217fa640 1 -- 172.21.15.105:0/585942140 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7f2728061e20 con 0x7f272c0706c0 2024-09-21T03:20:55.920 INFO:teuthology.orchestra.run.smithi105.stdout:[client.0] 2024-09-21T03:20:55.920 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQDIOu5mughoJxAAhY0bzJmq+oNyzCdtafkC9w== 2024-09-21T03:20:55.920 INFO:teuthology.orchestra.run.smithi105.stdout: caps mds = "allow" 2024-09-21T03:20:55.921 INFO:teuthology.orchestra.run.smithi105.stdout: caps mon = "allow r" 2024-09-21T03:20:55.921 INFO:teuthology.orchestra.run.smithi105.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T03:20:55.921 INFO:teuthology.orchestra.run.smithi105.stderr:updated caps for client.0 2024-09-21T03:20:55.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.920+0000 7f2732df1640 1 -- 172.21.15.105:0/585942140 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2718078b90 msgr2=0x7f271807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:55.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.920+0000 7f2732df1640 1 --2- 172.21.15.105:0/585942140 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2718078b90 0x7f271807b0a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f272c15f0c0 tx=0x7f271c005db0 comp rx=0 tx=0).stop 2024-09-21T03:20:55.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.920+0000 7f2732df1640 1 -- 172.21.15.105:0/585942140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f272c0706c0 msgr2=0x7f272c1f2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:55.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.920+0000 7f2732df1640 1 --2- 172.21.15.105:0/585942140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f272c0706c0 0x7f272c1f2800 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f272800c3f0 tx=0x7f272800c8b0 comp rx=0 tx=0).stop 2024-09-21T03:20:55.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.920+0000 7f2732df1640 1 -- 172.21.15.105:0/585942140 shutdown_connections 2024-09-21T03:20:55.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.920+0000 7f2732df1640 1 --2- 172.21.15.105:0/585942140 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2718078b90 0x7f271807b0a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:55.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.920+0000 7f2732df1640 1 --2- 172.21.15.105:0/585942140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f272c0cd3e0 0x7f272c1477e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:55.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.920+0000 7f2732df1640 1 --2- 172.21.15.105:0/585942140 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f272c0af780 0x7f272c1472a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:55.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.920+0000 7f2732df1640 1 --2- 172.21.15.105:0/585942140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f272c0706c0 0x7f272c1f2800 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:55.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.920+0000 7f2732df1640 1 -- 172.21.15.105:0/585942140 >> 172.21.15.105:0/585942140 conn(0x7f272c06d7d0 msgr2=0x7f272c09ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:55.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.920+0000 7f2732df1640 1 -- 172.21.15.105:0/585942140 shutdown_connections 2024-09-21T03:20:55.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:55.920+0000 7f2732df1640 1 -- 172.21.15.105:0/585942140 wait complete. 2024-09-21T03:20:55.934 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:20:56.047 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.044+0000 7f8b42c0a640 1 -- 172.21.15.105:0/2638155198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b3c0b4090 msgr2=0x7f8b3c0b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:56.047 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.044+0000 7f8b42c0a640 1 --2- 172.21.15.105:0/2638155198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b3c0b4090 0x7f8b3c0b3550 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c009830 tx=0x7f8b2c02a510 comp rx=0 tx=0).stop 2024-09-21T03:20:56.047 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.044+0000 7f8b42c0a640 1 -- 172.21.15.105:0/2638155198 shutdown_connections 2024-09-21T03:20:56.048 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.044+0000 7f8b42c0a640 1 --2- 172.21.15.105:0/2638155198 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b3c06fec0 0x7f8b3c0702d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.048 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.044+0000 7f8b42c0a640 1 --2- 172.21.15.105:0/2638155198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b3c0b4090 0x7f8b3c0b3550 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.048 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.044+0000 7f8b42c0a640 1 -- 172.21.15.105:0/2638155198 >> 172.21.15.105:0/2638155198 conn(0x7f8b3c0cdcc0 msgr2=0x7f8b3c0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:56.048 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.044+0000 7f8b42c0a640 1 -- 172.21.15.105:0/2638155198 shutdown_connections 2024-09-21T03:20:56.048 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.044+0000 7f8b42c0a640 1 -- 172.21.15.105:0/2638155198 wait complete. 2024-09-21T03:20:56.048 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.046+0000 7f8b42c0a640 1 Processor -- start 2024-09-21T03:20:56.048 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.046+0000 7f8b42c0a640 1 -- start start 2024-09-21T03:20:56.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.047+0000 7f8b42c0a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b3c06fec0 0x7f8b3c09c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:56.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.047+0000 7f8b42c0a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b3c0b4090 0x7f8b3c1f9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:56.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.047+0000 7f8b42c0a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b3c0cfeb0 0x7f8b3c15da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:56.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.047+0000 7f8b42c0a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8b3c0b4a30 con 0x7f8b3c0b4090 2024-09-21T03:20:56.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.047+0000 7f8b42c0a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8b3c0b48b0 con 0x7f8b3c0cfeb0 2024-09-21T03:20:56.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.047+0000 7f8b42c0a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8b3c0b4bb0 con 0x7f8b3c06fec0 2024-09-21T03:20:56.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.047+0000 7f8b3bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b3c0b4090 0x7f8b3c1f9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:56.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.047+0000 7f8b3bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b3c0b4090 0x7f8b3c1f9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:35798/0 (socket says 172.21.15.105:35798) 2024-09-21T03:20:56.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.047+0000 7f8b3bfff640 1 -- 172.21.15.105:0/1877074736 learned_addr learned my addr 172.21.15.105:0/1877074736 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:56.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.047+0000 7f8b409a6640 1 --2- 172.21.15.105:0/1877074736 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b3c06fec0 0x7f8b3c09c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:56.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.047+0000 7f8b411a7640 1 --2- 172.21.15.105:0/1877074736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b3c0cfeb0 0x7f8b3c15da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:56.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.048+0000 7f8b3bfff640 1 -- 172.21.15.105:0/1877074736 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b3c06fec0 msgr2=0x7f8b3c09c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:56.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.048+0000 7f8b3bfff640 1 --2- 172.21.15.105:0/1877074736 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b3c06fec0 0x7f8b3c09c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.048+0000 7f8b3bfff640 1 -- 172.21.15.105:0/1877074736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b3c0cfeb0 msgr2=0x7f8b3c15da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:56.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.048+0000 7f8b3bfff640 1 --2- 172.21.15.105:0/1877074736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b3c0cfeb0 0x7f8b3c15da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.048+0000 7f8b3bfff640 1 -- 172.21.15.105:0/1877074736 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b3c09af80 con 0x7f8b3c0b4090 2024-09-21T03:20:56.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.048+0000 7f8b409a6640 1 --2- 172.21.15.105:0/1877074736 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b3c06fec0 0x7f8b3c09c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:20:56.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.048+0000 7f8b3bfff640 1 --2- 172.21.15.105:0/1877074736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b3c0b4090 0x7f8b3c1f9920 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f8b3000d6d0 tx=0x7f8b3000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:56.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.048+0000 7f8b397fa640 1 -- 172.21.15.105:0/1877074736 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b30017070 con 0x7f8b3c0b4090 2024-09-21T03:20:56.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.048+0000 7f8b397fa640 1 -- 172.21.15.105:0/1877074736 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b30004310 con 0x7f8b3c0b4090 2024-09-21T03:20:56.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.048+0000 7f8b42c0a640 1 -- 172.21.15.105:0/1877074736 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b3c09b260 con 0x7f8b3c0b4090 2024-09-21T03:20:56.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.048+0000 7f8b397fa640 1 -- 172.21.15.105:0/1877074736 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b30009a20 con 0x7f8b3c0b4090 2024-09-21T03:20:56.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.048+0000 7f8b42c0a640 1 -- 172.21.15.105:0/1877074736 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b3c09b820 con 0x7f8b3c0b4090 2024-09-21T03:20:56.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.049+0000 7f8b42c0a640 1 -- 172.21.15.105:0/1877074736 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b3c0b50d0 con 0x7f8b3c0b4090 2024-09-21T03:20:56.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.050+0000 7f8b397fa640 1 -- 172.21.15.105:0/1877074736 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8b30009bc0 con 0x7f8b3c0b4090 2024-09-21T03:20:56.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.050+0000 7f8b397fa640 1 --2- 172.21.15.105:0/1877074736 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8b28078bc0 0x7f8b2807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:56.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.050+0000 7f8b397fa640 1 -- 172.21.15.105:0/1877074736 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f8b3009ac90 con 0x7f8b3c0b4090 2024-09-21T03:20:56.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.050+0000 7f8b409a6640 1 --2- 172.21.15.105:0/1877074736 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8b28078bc0 0x7f8b2807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:56.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.051+0000 7f8b409a6640 1 --2- 172.21.15.105:0/1877074736 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8b28078bc0 0x7f8b2807b0d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c034000 tx=0x7f8b2c004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:56.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.055+0000 7f8b397fa640 1 -- 172.21.15.105:0/1877074736 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8b30063160 con 0x7f8b3c0b4090 2024-09-21T03:20:56.235 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:20:56.242 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:20:56.273 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.270+0000 7f8b42c0a640 1 -- 172.21.15.105:0/1877074736 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b3c0b1a70 con 0x7f8b3c0b4090 2024-09-21T03:20:56.273 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.270+0000 7f8b397fa640 1 -- 172.21.15.105:0/1877074736 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+5232 (secure 0 0 0) 0x7f8b30062a60 con 0x7f8b3c0b4090 2024-09-21T03:20:56.274 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:20:56.274 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":32,"btime":"2024-09-21T03:20:54:138507+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5099,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3633306312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3633306312},{"type":"v1","addr":"172.21.15.162:6836","nonce":3633306312}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5356,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3748267738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3748267738},{"type":"v1","addr":"172.21.15.162:6837","nonce":3748267738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/431670561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":431670561},{"type":"v1","addr":"172.21.15.105:6833","nonce":431670561}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:20:50.482111+0000","modified":"2024-09-21T03:20:53.504519+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1075697245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1075697245},{"type":"v1","addr":"172.21.15.105:6835","nonce":1075697245}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5643,"qdb_cluster":[5643]},"id":4}]} 2024-09-21T03:20:56.274 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 32 2024-09-21T03:20:56.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.272+0000 7f8b42c0a640 1 -- 172.21.15.105:0/1877074736 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8b28078bc0 msgr2=0x7f8b2807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:56.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.272+0000 7f8b42c0a640 1 --2- 172.21.15.105:0/1877074736 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8b28078bc0 0x7f8b2807b0d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c034000 tx=0x7f8b2c004730 comp rx=0 tx=0).stop 2024-09-21T03:20:56.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.273+0000 7f8b42c0a640 1 -- 172.21.15.105:0/1877074736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b3c0b4090 msgr2=0x7f8b3c1f9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:56.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.273+0000 7f8b42c0a640 1 --2- 172.21.15.105:0/1877074736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b3c0b4090 0x7f8b3c1f9920 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f8b3000d6d0 tx=0x7f8b3000db90 comp rx=0 tx=0).stop 2024-09-21T03:20:56.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.273+0000 7f8b42c0a640 1 -- 172.21.15.105:0/1877074736 shutdown_connections 2024-09-21T03:20:56.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.273+0000 7f8b42c0a640 1 --2- 172.21.15.105:0/1877074736 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8b28078bc0 0x7f8b2807b0d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.273+0000 7f8b42c0a640 1 --2- 172.21.15.105:0/1877074736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b3c0cfeb0 0x7f8b3c15da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.273+0000 7f8b42c0a640 1 --2- 172.21.15.105:0/1877074736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b3c0b4090 0x7f8b3c1f9920 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.273+0000 7f8b42c0a640 1 --2- 172.21.15.105:0/1877074736 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b3c06fec0 0x7f8b3c09c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.273+0000 7f8b42c0a640 1 -- 172.21.15.105:0/1877074736 >> 172.21.15.105:0/1877074736 conn(0x7f8b3c0cdcc0 msgr2=0x7f8b3c0747c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:56.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.273+0000 7f8b42c0a640 1 -- 172.21.15.105:0/1877074736 shutdown_connections 2024-09-21T03:20:56.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.273+0000 7f8b42c0a640 1 -- 172.21.15.105:0/1877074736 wait complete. 2024-09-21T03:20:56.455 INFO:tasks.ceph.mds.c.smithi105.stderr:2024-09-21T03:20:56.453+0000 7f7fd3097640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T03:20:56.689 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T03:20:50.482111+0000', 'modified': '2024-09-21T03:20:53.504519+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5643}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5643': {'gid': 5643, 'name': 'c', 'rank': 0, 'incarnation': 29, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.105:6835/1075697245', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6834', 'nonce': 1075697245}, {'type': 'v1', 'addr': '172.21.15.105:6835', 'nonce': 1075697245}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5643, 'qdb_cluster': [5643]} 2024-09-21T03:20:56.689 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T03:20:56.690 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-21T03:20:56.809 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.806+0000 7f2a84390640 1 -- 172.21.15.105:0/3117769685 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a7c0b3a10 msgr2=0x7f2a7c0d14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:56.809 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.806+0000 7f2a84390640 1 --2- 172.21.15.105:0/3117769685 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a7c0b3a10 0x7f2a7c0d14f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2a70009830 tx=0x7f2a7002a480 comp rx=0 tx=0).stop 2024-09-21T03:20:56.809 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.806+0000 7f2a84390640 1 -- 172.21.15.105:0/3117769685 shutdown_connections 2024-09-21T03:20:56.810 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.806+0000 7f2a84390640 1 --2- 172.21.15.105:0/3117769685 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a7c0b3a10 0x7f2a7c0d14f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.810 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.806+0000 7f2a84390640 1 --2- 172.21.15.105:0/3117769685 >> v2:172.21.15.162:3300/0 conn(0x7f2a7c0b9b60 0x7f2a7c0d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.810 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.806+0000 7f2a84390640 1 -- 172.21.15.105:0/3117769685 >> 172.21.15.105:0/3117769685 conn(0x7f2a7c09d8f0 msgr2=0x7f2a7c0d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:56.810 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.806+0000 7f2a84390640 1 -- 172.21.15.105:0/3117769685 shutdown_connections 2024-09-21T03:20:56.810 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.806+0000 7f2a84390640 1 -- 172.21.15.105:0/3117769685 wait complete. 2024-09-21T03:20:56.811 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.808+0000 7f2a84390640 1 Processor -- start 2024-09-21T03:20:56.811 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.808+0000 7f2a84390640 1 -- start start 2024-09-21T03:20:56.813 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.809+0000 7f2a84390640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a7c0b3a10 0x7f2a7c15d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:56.813 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.809+0000 7f2a84390640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a7c0b9b60 0x7f2a7c15dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:56.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.809+0000 7f2a84390640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a7c162430 0x7f2a7c0b79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:56.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.809+0000 7f2a84390640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7c162f50 con 0x7f2a7c0b9b60 2024-09-21T03:20:56.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.809+0000 7f2a84390640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7c0d1fa0 con 0x7f2a7c162430 2024-09-21T03:20:56.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.809+0000 7f2a84390640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2a7c1630d0 con 0x7f2a7c0b3a10 2024-09-21T03:20:56.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.809+0000 7f2a8192b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a7c0b9b60 0x7f2a7c15dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:56.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.809+0000 7f2a8192b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a7c0b9b60 0x7f2a7c15dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:35800/0 (socket says 172.21.15.105:35800) 2024-09-21T03:20:56.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.809+0000 7f2a8192b640 1 -- 172.21.15.105:0/64966587 learned_addr learned my addr 172.21.15.105:0/64966587 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:56.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.809+0000 7f2a8292d640 1 --2- 172.21.15.105:0/64966587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a7c162430 0x7f2a7c0b79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:56.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.809+0000 7f2a8212c640 1 --2- 172.21.15.105:0/64966587 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a7c0b3a10 0x7f2a7c15d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:56.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.809+0000 7f2a8192b640 1 -- 172.21.15.105:0/64966587 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a7c0b3a10 msgr2=0x7f2a7c15d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:56.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.809+0000 7f2a8192b640 1 --2- 172.21.15.105:0/64966587 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a7c0b3a10 0x7f2a7c15d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.809+0000 7f2a8192b640 1 -- 172.21.15.105:0/64966587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a7c162430 msgr2=0x7f2a7c0b79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:56.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.809+0000 7f2a8192b640 1 --2- 172.21.15.105:0/64966587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a7c162430 0x7f2a7c0b79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.809+0000 7f2a8192b640 1 -- 172.21.15.105:0/64966587 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a7c15e530 con 0x7f2a7c0b9b60 2024-09-21T03:20:56.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.810+0000 7f2a8192b640 1 --2- 172.21.15.105:0/64966587 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a7c0b9b60 0x7f2a7c15dff0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f2a70009950 tx=0x7f2a70033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:56.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.810+0000 7f2a7affd640 1 -- 172.21.15.105:0/64966587 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a70031d60 con 0x7f2a7c0b9b60 2024-09-21T03:20:56.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.810+0000 7f2a7affd640 1 -- 172.21.15.105:0/64966587 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2a70033e10 con 0x7f2a7c0b9b60 2024-09-21T03:20:56.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.810+0000 7f2a7affd640 1 -- 172.21.15.105:0/64966587 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a70005260 con 0x7f2a7c0b9b60 2024-09-21T03:20:56.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.810+0000 7f2a84390640 1 -- 172.21.15.105:0/64966587 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a7c1f9a70 con 0x7f2a7c0b9b60 2024-09-21T03:20:56.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.810+0000 7f2a84390640 1 -- 172.21.15.105:0/64966587 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a7c1fa030 con 0x7f2a7c0b9b60 2024-09-21T03:20:56.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.812+0000 7f2a7affd640 1 -- 172.21.15.105:0/64966587 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2a70005400 con 0x7f2a7c0b9b60 2024-09-21T03:20:56.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.812+0000 7f2a7affd640 1 --2- 172.21.15.105:0/64966587 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2a68078b90 0x7f2a6807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:56.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.812+0000 7f2a7affd640 1 -- 172.21.15.105:0/64966587 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f2a700bbe00 con 0x7f2a7c0b9b60 2024-09-21T03:20:56.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.813+0000 7f2a8212c640 1 --2- 172.21.15.105:0/64966587 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2a68078b90 0x7f2a6807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:56.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.813+0000 7f2a8b3de740 1 Processor -- start 2024-09-21T03:20:56.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.813+0000 7f2a8b3de740 1 -- start start 2024-09-21T03:20:56.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.813+0000 7f2a8212c640 1 --2- 172.21.15.105:0/64966587 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2a68078b90 0x7f2a6807b0a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c0095f0 tx=0x7f2a6c005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:56.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.815+0000 7f2a8b3de740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c80bb3270 0x562c80f84fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:56.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.815+0000 7f2a8b3de740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562c80b8a3b0 0x562c80f85500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:56.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.815+0000 7f2a8b3de740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c80b92590 0x562c80fa2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:56.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.815+0000 7f2a8b3de740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x562c80ecd820 con 0x562c80b8a3b0 2024-09-21T03:20:56.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.815+0000 7f2a8b3de740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562c80ebcc50 con 0x562c80b92590 2024-09-21T03:20:56.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.815+0000 7f2a8b3de740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x562c80ec0a60 con 0x562c80bb3270 2024-09-21T03:20:56.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.815+0000 7f2a8192b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562c80b8a3b0 0x562c80f85500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:56.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.815+0000 7f2a8192b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562c80b8a3b0 0x562c80f85500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:35814/0 (socket says 172.21.15.105:35814) 2024-09-21T03:20:56.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.815+0000 7f2a8192b640 1 -- 172.21.15.105:0/2220376513 learned_addr learned my addr 172.21.15.105:0/2220376513 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:56.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.815+0000 7f2a8212c640 1 --2- 172.21.15.105:0/2220376513 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c80bb3270 0x562c80f84fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:56.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.815+0000 7f2a8292d640 1 --2- 172.21.15.105:0/2220376513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c80b92590 0x562c80fa2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:56.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.815+0000 7f2a8192b640 1 -- 172.21.15.105:0/2220376513 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c80bb3270 msgr2=0x562c80f84fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:20:56.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.815+0000 7f2a8192b640 1 --2- 172.21.15.105:0/2220376513 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c80bb3270 0x562c80f84fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.815+0000 7f2a8192b640 1 -- 172.21.15.105:0/2220376513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c80b92590 msgr2=0x562c80fa2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:20:56.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.815+0000 7f2a8192b640 1 --2- 172.21.15.105:0/2220376513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c80b92590 0x562c80fa2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.815+0000 7f2a8192b640 1 -- 172.21.15.105:0/2220376513 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c80c1e850 con 0x562c80b8a3b0 2024-09-21T03:20:56.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.815+0000 7f2a8292d640 1 --2- 172.21.15.105:0/2220376513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c80b92590 0x562c80fa2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:20:56.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.815+0000 7f2a8212c640 1 --2- 172.21.15.105:0/2220376513 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c80bb3270 0x562c80f84fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:20:56.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.815+0000 7f2a8192b640 1 --2- 172.21.15.105:0/2220376513 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562c80b8a3b0 0x562c80f85500 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f2a70083c10 tx=0x7f2a7007fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ef798ab46b2978d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:56.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.815+0000 7f2a63fff640 1 -- 172.21.15.105:0/2220376513 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a70048030 con 0x562c80b8a3b0 2024-09-21T03:20:56.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.815+0000 7f2a63fff640 1 -- 172.21.15.105:0/2220376513 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2a70083790 con 0x562c80b8a3b0 2024-09-21T03:20:56.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.815+0000 7f2a63fff640 1 -- 172.21.15.105:0/2220376513 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a700840e0 con 0x562c80b8a3b0 2024-09-21T03:20:56.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.816+0000 7f2a8b3de740 1 -- 172.21.15.105:0/2220376513 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562c80b8a3b0 msgr2=0x562c80f85500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:56.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.816+0000 7f2a8b3de740 1 --2- 172.21.15.105:0/2220376513 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562c80b8a3b0 0x562c80f85500 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f2a70083c10 tx=0x7f2a7007fbf0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.816+0000 7f2a8b3de740 1 -- 172.21.15.105:0/2220376513 shutdown_connections 2024-09-21T03:20:56.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.816+0000 7f2a8b3de740 1 --2- 172.21.15.105:0/2220376513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c80b92590 0x562c80fa2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.816+0000 7f2a8b3de740 1 --2- 172.21.15.105:0/2220376513 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562c80b8a3b0 0x562c80f85500 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.816+0000 7f2a8b3de740 1 --2- 172.21.15.105:0/2220376513 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c80bb3270 0x562c80f84fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.816+0000 7f2a8b3de740 1 -- 172.21.15.105:0/2220376513 >> 172.21.15.105:0/2220376513 conn(0x562c80ba73c0 msgr2=0x562c80f5b280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:56.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.816+0000 7f2a8b3de740 1 -- 172.21.15.105:0/2220376513 shutdown_connections 2024-09-21T03:20:56.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.816+0000 7f2a8b3de740 1 -- 172.21.15.105:0/2220376513 wait complete. 2024-09-21T03:20:56.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.817+0000 7f2a8b3de740 1 -- start start 2024-09-21T03:20:56.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.817+0000 7f2a8b3de740 1 Processor -- start 2024-09-21T03:20:56.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.819+0000 7f2a8b3de740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562c80b8a3b0 0x562c80f9a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:56.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.819+0000 7f2a8b3de740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c80b92590 0x562c80f72bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:56.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.819+0000 7f2a8b3de740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c80bb3270 0x562c80f99370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:56.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.819+0000 7f2a8b3de740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x562c80c2d620 con 0x562c80b8a3b0 2024-09-21T03:20:56.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.819+0000 7f2a8b3de740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562c80e625f0 con 0x562c80b92590 2024-09-21T03:20:56.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.819+0000 7f2a8b3de740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x562c80f980a0 con 0x562c80bb3270 2024-09-21T03:20:56.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.819+0000 7f2a8b3de740 10 client.0 _ll_register_callbacks cb 0x562c80e660a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:20:56.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.819+0000 7f2a8212c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562c80b8a3b0 0x562c80f9a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:56.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.819+0000 7f2a8212c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562c80b8a3b0 0x562c80f9a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:35820/0 (socket says 172.21.15.105:35820) 2024-09-21T03:20:56.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.819+0000 7f2a8212c640 1 -- 172.21.15.105:0/2647489608 learned_addr learned my addr 172.21.15.105:0/2647489608 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:56.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.819+0000 7f2a8192b640 1 --2- 172.21.15.105:0/2647489608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c80b92590 0x562c80f72bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:56.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.819+0000 7f2a8212c640 1 -- 172.21.15.105:0/2647489608 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c80bb3270 msgr2=0x562c80f99370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:20:56.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.819+0000 7f2a8212c640 1 --2- 172.21.15.105:0/2647489608 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c80bb3270 0x562c80f99370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.819+0000 7f2a8212c640 1 -- 172.21.15.105:0/2647489608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c80b92590 msgr2=0x562c80f72bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:20:56.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.819+0000 7f2a8212c640 1 --2- 172.21.15.105:0/2647489608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c80b92590 0x562c80f72bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.819+0000 7f2a8212c640 1 -- 172.21.15.105:0/2647489608 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c80c956b0 con 0x562c80b8a3b0 2024-09-21T03:20:56.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.819+0000 7f2a8212c640 1 --2- 172.21.15.105:0/2647489608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562c80b8a3b0 0x562c80f9a390 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c004550 tx=0x7f2a6c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af4a1947165d6484 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:56.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.819+0000 7f2a617fa640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-21T03:20:56.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.819+0000 7f2a617fa640 1 -- 172.21.15.105:0/2647489608 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c027440 con 0x562c80b8a3b0 2024-09-21T03:20:56.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.820+0000 7f2a617fa640 1 -- 172.21.15.105:0/2647489608 <== mon.0 v2:172.21.15.105:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f2a6c0275e0 con 0x562c80b8a3b0 2024-09-21T03:20:56.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.820+0000 7f2a8b3de740 1 -- 172.21.15.105:0/2647489608 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a70083790 con 0x562c80b8a3b0 2024-09-21T03:20:56.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.820+0000 7f2a617fa640 1 -- 172.21.15.105:0/2647489608 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f2a6c02f050 con 0x562c80b8a3b0 2024-09-21T03:20:56.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.820+0000 7f2a8b3de740 10 client.5769 fetch_fsmap learned FSMap version 32 2024-09-21T03:20:56.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.820+0000 7f2a8b3de740 1 -- 172.21.15.105:0/2647489608 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) -- 0x562c80f9b880 con 0x562c80b8a3b0 2024-09-21T03:20:56.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.820+0000 7f2a617fa640 1 -- 172.21.15.105:0/2647489608 <== mon.0 v2:172.21.15.105:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2a70083790 con 0x562c80b8a3b0 2024-09-21T03:20:56.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.820+0000 7f2a617fa640 1 -- 172.21.15.105:0/2647489608 <== mon.0 v2:172.21.15.105:3300/0 5 ==== fsmap(e 32) ==== 3502+0+0 (secure 0 0 0) 0x7f2a6c025020 con 0x562c80b8a3b0 2024-09-21T03:20:56.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.820+0000 7f2a8b3de740 10 client.5769 fetch_fsmap finished waiting for FSMap version 32 2024-09-21T03:20:56.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.820+0000 7f2a8b3de740 10 client.5769 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T03:20:56.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.820+0000 7f2a8b3de740 20 client.5769 populate_metadata read hostname 'smithi105' 2024-09-21T03:20:56.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.820+0000 7f2a8b3de740 1 --2- 172.21.15.105:0/2647489608 >> [v2:172.21.15.105:6834/1075697245,v1:172.21.15.105:6835/1075697245] conn(0x562c80b71e40 0x562c80f96eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:56.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.820+0000 7f2a8b3de740 4 client.5769 mds_command: new command op to 5643 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:20:56.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.820+0000 7f2a8b3de740 1 -- 172.21.15.105:0/2647489608 --> [v2:172.21.15.105:6834/1075697245,v1:172.21.15.105:6835/1075697245] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c80ecf770 con 0x562c80b71e40 2024-09-21T03:20:56.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.820+0000 7f2a8192b640 1 --2- 172.21.15.105:0/2647489608 >> [v2:172.21.15.105:6834/1075697245,v1:172.21.15.105:6835/1075697245] conn(0x562c80b71e40 0x562c80f96eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:56.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.820+0000 7f2a617fa640 10 client.5769 ms_handle_connect on v2:172.21.15.105:6834/1075697245 2024-09-21T03:20:56.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.821+0000 7f2a8192b640 1 --2- 172.21.15.105:0/2647489608 >> [v2:172.21.15.105:6834/1075697245,v1:172.21.15.105:6835/1075697245] conn(0x562c80b71e40 0x562c80f96eb0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbe91e4b1be738dc server_cookie=e7b090e55332d0fc in_seq=0 out_seq=0 2024-09-21T03:20:56.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.821+0000 7f2a617fa640 1 -- 172.21.15.105:0/2647489608 <== mds.0 v2:172.21.15.105:6834/1075697245 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562c80ecf770 con 0x562c80b71e40 2024-09-21T03:20:56.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.821+0000 7f2a617fa640 10 client.5769 handle_command_reply: tid=0 2024-09-21T03:20:56.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.821+0000 7f2a8b3de740 1 client.5769 shutdown 2024-09-21T03:20:56.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.821+0000 7f2a8b3de740 1 -- 172.21.15.105:0/2647489608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562c80b8a3b0 msgr2=0x562c80f9a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:56.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.821+0000 7f2a8b3de740 1 --2- 172.21.15.105:0/2647489608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562c80b8a3b0 0x562c80f9a390 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c004550 tx=0x7f2a6c004730 comp rx=0 tx=0).stop 2024-09-21T03:20:56.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.821+0000 7f2a8b3de740 1 -- 172.21.15.105:0/2647489608 shutdown_connections 2024-09-21T03:20:56.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.821+0000 7f2a8b3de740 1 --2- 172.21.15.105:0/2647489608 >> [v2:172.21.15.105:6834/1075697245,v1:172.21.15.105:6835/1075697245] conn(0x562c80b71e40 0x562c80f96eb0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.821+0000 7f2a8b3de740 1 --2- 172.21.15.105:0/2647489608 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c80bb3270 0x562c80f99370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.821+0000 7f2a617fa640 0 client.5769 ms_handle_reset on v2:172.21.15.105:6834/1075697245 2024-09-21T03:20:56.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.821+0000 7f2a8b3de740 1 --2- 172.21.15.105:0/2647489608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c80b92590 0x562c80f72bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.821+0000 7f2a8b3de740 1 --2- 172.21.15.105:0/2647489608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562c80b8a3b0 0x562c80f9a390 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.821+0000 7f2a8b3de740 1 -- 172.21.15.105:0/2647489608 >> 172.21.15.105:0/2647489608 conn(0x562c80ba73c0 msgr2=0x562c80f55b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:56.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.822+0000 7f2a8b3de740 1 -- 172.21.15.105:0/2647489608 shutdown_connections 2024-09-21T03:20:56.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.822+0000 7f2a8b3de740 1 -- 172.21.15.105:0/2647489608 wait complete. 2024-09-21T03:20:56.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.822+0000 7f2a8b3de740 20 client.5769 trim_cache size 0 max 16384 2024-09-21T03:20:56.843 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.840+0000 7f2a8b3de740 1 Processor -- start 2024-09-21T03:20:56.843 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.840+0000 7f2a8b3de740 1 -- start start 2024-09-21T03:20:56.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.841+0000 7f2a8b3de740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562c80b8a3b0 0x562c80f9c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:56.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.841+0000 7f2a8b3de740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c80b92590 0x562c80f9cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:56.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.841+0000 7f2a8b3de740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c80bb3270 0x562c80f96eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:56.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.841+0000 7f2a8b3de740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7c157e70 con 0x562c80b8a3b0 2024-09-21T03:20:56.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.841+0000 7f2a8b3de740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7c1571d0 con 0x562c80b92590 2024-09-21T03:20:56.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.841+0000 7f2a8b3de740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2a7c157820 con 0x562c80bb3270 2024-09-21T03:20:56.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.841+0000 7f2a8212c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562c80b8a3b0 0x562c80f9c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:56.847 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.841+0000 7f2a8212c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562c80b8a3b0 0x562c80f9c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:35824/0 (socket says 172.21.15.105:35824) 2024-09-21T03:20:56.847 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.841+0000 7f2a8212c640 1 -- 172.21.15.105:0/2086505776 learned_addr learned my addr 172.21.15.105:0/2086505776 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:56.847 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.842+0000 7f2a8212c640 1 -- 172.21.15.105:0/2086505776 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c80bb3270 msgr2=0x562c80f96eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:20:56.847 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.842+0000 7f2a8212c640 1 --2- 172.21.15.105:0/2086505776 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c80bb3270 0x562c80f96eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.847 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.842+0000 7f2a8212c640 1 -- 172.21.15.105:0/2086505776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c80b92590 msgr2=0x562c80f9cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:20:56.847 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.842+0000 7f2a8192b640 1 --2- 172.21.15.105:0/2086505776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c80b92590 0x562c80f9cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:56.847 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.842+0000 7f2a8212c640 1 --2- 172.21.15.105:0/2086505776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c80b92590 0x562c80f9cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.847 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.842+0000 7f2a8212c640 1 -- 172.21.15.105:0/2086505776 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c80f96240 con 0x562c80b8a3b0 2024-09-21T03:20:56.847 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.842+0000 7f2a8212c640 1 --2- 172.21.15.105:0/2086505776 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562c80b8a3b0 0x562c80f9c610 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c016040 tx=0x7f2a6c0279f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f2ca90e9db566 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:56.848 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.842+0000 7f2a637fe640 1 -- 172.21.15.105:0/2086505776 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c039020 con 0x562c80b8a3b0 2024-09-21T03:20:56.848 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.842+0000 7f2a637fe640 1 -- 172.21.15.105:0/2086505776 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2a6c0039c0 con 0x562c80b8a3b0 2024-09-21T03:20:56.848 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.842+0000 7f2a637fe640 1 -- 172.21.15.105:0/2086505776 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c0276a0 con 0x562c80b8a3b0 2024-09-21T03:20:56.848 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.843+0000 7f2a8b3de740 1 -- 172.21.15.105:0/2086505776 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562c80b8a3b0 msgr2=0x562c80f9c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:56.848 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.843+0000 7f2a8b3de740 1 --2- 172.21.15.105:0/2086505776 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562c80b8a3b0 0x562c80f9c610 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c016040 tx=0x7f2a6c0279f0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.849 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.843+0000 7f2a8b3de740 1 -- 172.21.15.105:0/2086505776 shutdown_connections 2024-09-21T03:20:56.849 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.843+0000 7f2a8b3de740 1 --2- 172.21.15.105:0/2086505776 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c80bb3270 0x562c80f96eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.849 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.843+0000 7f2a8b3de740 1 --2- 172.21.15.105:0/2086505776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c80b92590 0x562c80f9cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.849 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.843+0000 7f2a8b3de740 1 --2- 172.21.15.105:0/2086505776 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562c80b8a3b0 0x562c80f9c610 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.849 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.843+0000 7f2a8b3de740 1 -- 172.21.15.105:0/2086505776 >> 172.21.15.105:0/2086505776 conn(0x562c80ba73c0 msgr2=0x562c80f9bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:56.849 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.843+0000 7f2a8b3de740 1 -- 172.21.15.105:0/2086505776 shutdown_connections 2024-09-21T03:20:56.849 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.843+0000 7f2a8b3de740 1 -- 172.21.15.105:0/2086505776 wait complete. 2024-09-21T03:20:56.849 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.844+0000 7f2a8b3de740 1 -- start start 2024-09-21T03:20:56.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.844+0000 7f2a8b3de740 1 Processor -- start 2024-09-21T03:20:56.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.845+0000 7f2a8b3de740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c80b8a3b0 0x562c81009050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:56.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.845+0000 7f2a8b3de740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562c80b92590 0x562c80f6ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:56.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.845+0000 7f2a8b3de740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c80bb3270 0x562c80f6f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:56.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.845+0000 7f2a8b3de740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x562c80f73680 con 0x562c80b92590 2024-09-21T03:20:56.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.845+0000 7f2a8b3de740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562c80f97e90 con 0x562c80b8a3b0 2024-09-21T03:20:56.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.845+0000 7f2a8b3de740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x562c80fb24d0 con 0x562c80bb3270 2024-09-21T03:20:56.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.845+0000 7f2a8b3de740 10 client.0 _ll_register_callbacks cb 0x7f2a6c009870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:20:56.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.845+0000 7f2a8192b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562c80b92590 0x562c80f6ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:56.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.845+0000 7f2a8192b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562c80b92590 0x562c80f6ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:35826/0 (socket says 172.21.15.105:35826) 2024-09-21T03:20:56.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.845+0000 7f2a8192b640 1 -- 172.21.15.105:0/1819005787 learned_addr learned my addr 172.21.15.105:0/1819005787 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:56.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.845+0000 7f2a8212c640 1 --2- 172.21.15.105:0/1819005787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c80b8a3b0 0x562c81009050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:56.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.845+0000 7f2a8292d640 1 --2- 172.21.15.105:0/1819005787 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c80bb3270 0x562c80f6f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:56.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.846+0000 7f2a8192b640 1 -- 172.21.15.105:0/1819005787 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c80bb3270 msgr2=0x562c80f6f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:20:56.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.846+0000 7f2a8192b640 1 --2- 172.21.15.105:0/1819005787 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c80bb3270 0x562c80f6f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.846+0000 7f2a8192b640 1 -- 172.21.15.105:0/1819005787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c80b8a3b0 msgr2=0x562c81009050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:20:56.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.846+0000 7f2a8192b640 1 --2- 172.21.15.105:0/1819005787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c80b8a3b0 0x562c81009050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.846+0000 7f2a8192b640 1 -- 172.21.15.105:0/1819005787 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c80f9bf60 con 0x562c80b92590 2024-09-21T03:20:56.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.846+0000 7f2a8212c640 1 --2- 172.21.15.105:0/1819005787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c80b8a3b0 0x562c81009050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:20:56.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.846+0000 7f2a8192b640 1 --2- 172.21.15.105:0/1819005787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562c80b92590 0x562c80f6ede0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f2a700bc120 tx=0x7f2a700ba200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daff25635de62a63 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:56.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.846+0000 7f2a617fa640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-21T03:20:56.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.846+0000 7f2a617fa640 1 -- 172.21.15.105:0/1819005787 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a70048070 con 0x562c80b92590 2024-09-21T03:20:56.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.846+0000 7f2a617fa640 1 -- 172.21.15.105:0/1819005787 <== mon.0 v2:172.21.15.105:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f2a700840f0 con 0x562c80b92590 2024-09-21T03:20:56.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.846+0000 7f2a8b3de740 1 -- 172.21.15.105:0/1819005787 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a6c0039c0 con 0x562c80b92590 2024-09-21T03:20:56.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.846+0000 7f2a617fa640 1 -- 172.21.15.105:0/1819005787 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f2a70083790 con 0x562c80b92590 2024-09-21T03:20:56.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.846+0000 7f2a8b3de740 10 client.5775 fetch_fsmap learned FSMap version 32 2024-09-21T03:20:56.858 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.846+0000 7f2a8b3de740 1 -- 172.21.15.105:0/1819005787 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) -- 0x562c80f9c240 con 0x562c80b92590 2024-09-21T03:20:56.858 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.846+0000 7f2a617fa640 1 -- 172.21.15.105:0/1819005787 <== mon.0 v2:172.21.15.105:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2a6c0039c0 con 0x562c80b92590 2024-09-21T03:20:56.858 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.846+0000 7f2a617fa640 1 -- 172.21.15.105:0/1819005787 <== mon.0 v2:172.21.15.105:3300/0 5 ==== fsmap(e 32) ==== 3502+0+0 (secure 0 0 0) 0x7f2a7008d0d0 con 0x562c80b92590 2024-09-21T03:20:56.858 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.846+0000 7f2a8b3de740 10 client.5775 fetch_fsmap finished waiting for FSMap version 32 2024-09-21T03:20:56.858 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.846+0000 7f2a8b3de740 10 client.5775 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T03:20:56.858 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.846+0000 7f2a8b3de740 20 client.5775 populate_metadata read hostname 'smithi105' 2024-09-21T03:20:56.858 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.846+0000 7f2a8b3de740 1 --2- 172.21.15.105:0/1819005787 >> [v2:172.21.15.105:6834/1075697245,v1:172.21.15.105:6835/1075697245] conn(0x562c80f9c820 0x562c80f54550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:56.858 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.846+0000 7f2a8b3de740 4 client.5775 mds_command: new command op to 5643 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T03:20:56.858 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.846+0000 7f2a8b3de740 1 -- 172.21.15.105:0/1819005787 --> [v2:172.21.15.105:6834/1075697245,v1:172.21.15.105:6835/1075697245] -- command(tid 0: {"prefix": "status"}) -- 0x562c80ecb220 con 0x562c80f9c820 2024-09-21T03:20:56.858 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.846+0000 7f2a8212c640 1 --2- 172.21.15.105:0/1819005787 >> [v2:172.21.15.105:6834/1075697245,v1:172.21.15.105:6835/1075697245] conn(0x562c80f9c820 0x562c80f54550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:56.858 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.847+0000 7f2a617fa640 10 client.5775 ms_handle_connect on v2:172.21.15.105:6834/1075697245 2024-09-21T03:20:56.858 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.847+0000 7f2a8212c640 1 --2- 172.21.15.105:0/1819005787 >> [v2:172.21.15.105:6834/1075697245,v1:172.21.15.105:6835/1075697245] conn(0x562c80f9c820 0x562c80f54550 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5daedbe88f15330c server_cookie=3cbac8c322bad49b in_seq=0 out_seq=0 2024-09-21T03:20:56.858 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.847+0000 7f2a617fa640 1 -- 172.21.15.105:0/1819005787 <== mds.0 v2:172.21.15.105:6834/1075697245 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x562c80ecb220 con 0x562c80f9c820 2024-09-21T03:20:56.858 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.847+0000 7f2a617fa640 10 client.5775 handle_command_reply: tid=0 2024-09-21T03:20:56.859 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.847+0000 7f2a8b3de740 1 client.5775 shutdown 2024-09-21T03:20:56.859 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.847+0000 7f2a8b3de740 1 -- 172.21.15.105:0/1819005787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562c80b92590 msgr2=0x562c80f6ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:56.859 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.847+0000 7f2a8b3de740 1 --2- 172.21.15.105:0/1819005787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562c80b92590 0x562c80f6ede0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f2a700bc120 tx=0x7f2a700ba200 comp rx=0 tx=0).stop 2024-09-21T03:20:56.859 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.847+0000 7f2a8b3de740 1 -- 172.21.15.105:0/1819005787 shutdown_connections 2024-09-21T03:20:56.859 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.847+0000 7f2a8b3de740 1 --2- 172.21.15.105:0/1819005787 >> [v2:172.21.15.105:6834/1075697245,v1:172.21.15.105:6835/1075697245] conn(0x562c80f9c820 0x562c80f54550 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.859 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.847+0000 7f2a8b3de740 1 --2- 172.21.15.105:0/1819005787 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x562c80bb3270 0x562c80f6f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.859 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.847+0000 7f2a8b3de740 1 --2- 172.21.15.105:0/1819005787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562c80b92590 0x562c80f6ede0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.859 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.847+0000 7f2a8b3de740 1 --2- 172.21.15.105:0/1819005787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562c80b8a3b0 0x562c81009050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.859 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.847+0000 7f2a617fa640 0 client.5775 ms_handle_reset on v2:172.21.15.105:6834/1075697245 2024-09-21T03:20:56.859 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.847+0000 7f2a8b3de740 1 -- 172.21.15.105:0/1819005787 >> 172.21.15.105:0/1819005787 conn(0x562c80ba73c0 msgr2=0x562c80fa1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:56.859 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.847+0000 7f2a8b3de740 1 -- 172.21.15.105:0/1819005787 shutdown_connections 2024-09-21T03:20:56.859 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.847+0000 7f2a8b3de740 1 -- 172.21.15.105:0/1819005787 wait complete. 2024-09-21T03:20:56.859 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.847+0000 7f2a8b3de740 20 client.5775 trim_cache size 0 max 16384 2024-09-21T03:20:56.860 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-21T03:20:56.860 INFO:teuthology.orchestra.run.smithi105.stdout: "cluster_fsid": "29d80f4f-e5de-4b26-8384-24c2d8019945", 2024-09-21T03:20:56.860 INFO:teuthology.orchestra.run.smithi105.stdout: "whoami": 0, 2024-09-21T03:20:56.860 INFO:teuthology.orchestra.run.smithi105.stdout: "id": 5643, 2024-09-21T03:20:56.860 INFO:teuthology.orchestra.run.smithi105.stdout: "want_state": "up:active", 2024-09-21T03:20:56.860 INFO:teuthology.orchestra.run.smithi105.stdout: "state": "up:active", 2024-09-21T03:20:56.860 INFO:teuthology.orchestra.run.smithi105.stdout: "fs_name": "cephfs", 2024-09-21T03:20:56.860 INFO:teuthology.orchestra.run.smithi105.stdout: "rank_uptime": 5.7320288899999996, 2024-09-21T03:20:56.860 INFO:teuthology.orchestra.run.smithi105.stdout: "mdsmap_epoch": 32, 2024-09-21T03:20:56.860 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_epoch": 57, 2024-09-21T03:20:56.860 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_epoch_barrier": 57, 2024-09-21T03:20:56.860 INFO:teuthology.orchestra.run.smithi105.stdout: "uptime": 11.055993448000001 2024-09-21T03:20:56.860 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-21T03:20:56.862 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.848+0000 7f2a84390640 1 -- 172.21.15.105:0/64966587 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2a68078b90 msgr2=0x7f2a6807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:56.862 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.848+0000 7f2a84390640 1 --2- 172.21.15.105:0/64966587 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2a68078b90 0x7f2a6807b0a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c0095f0 tx=0x7f2a6c005f90 comp rx=0 tx=0).stop 2024-09-21T03:20:56.862 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.848+0000 7f2a84390640 1 -- 172.21.15.105:0/64966587 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a7c0b9b60 msgr2=0x7f2a7c15dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:56.862 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.848+0000 7f2a84390640 1 --2- 172.21.15.105:0/64966587 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a7c0b9b60 0x7f2a7c15dff0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f2a70009950 tx=0x7f2a70033c20 comp rx=0 tx=0).stop 2024-09-21T03:20:56.862 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.848+0000 7f2a84390640 1 -- 172.21.15.105:0/64966587 shutdown_connections 2024-09-21T03:20:56.862 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.848+0000 7f2a84390640 1 --2- 172.21.15.105:0/64966587 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2a68078b90 0x7f2a6807b0a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.862 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.848+0000 7f2a84390640 1 --2- 172.21.15.105:0/64966587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a7c162430 0x7f2a7c0b79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.862 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.848+0000 7f2a84390640 1 --2- 172.21.15.105:0/64966587 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a7c0b9b60 0x7f2a7c15dff0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.862 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.848+0000 7f2a84390640 1 --2- 172.21.15.105:0/64966587 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2a7c0b3a10 0x7f2a7c15d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.862 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.848+0000 7f2a84390640 1 -- 172.21.15.105:0/64966587 >> 172.21.15.105:0/64966587 conn(0x7f2a7c09d8f0 msgr2=0x7f2a7c15b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:56.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.848+0000 7f2a84390640 1 -- 172.21.15.105:0/64966587 shutdown_connections 2024-09-21T03:20:56.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.848+0000 7f2a84390640 1 -- 172.21.15.105:0/64966587 wait complete. 2024-09-21T03:20:56.863 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T03:20:56.976 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.974+0000 7feadc1ad640 1 -- 172.21.15.105:0/3403655806 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fead40cfb90 msgr2=0x7fead40ccb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:56.977 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.974+0000 7feadc1ad640 1 --2- 172.21.15.105:0/3403655806 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fead40cfb90 0x7fead40ccb30 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fead40ce460 tx=0x7feac402a4d0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.977 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.974+0000 7feadc1ad640 1 -- 172.21.15.105:0/3403655806 shutdown_connections 2024-09-21T03:20:56.977 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.974+0000 7feadc1ad640 1 --2- 172.21.15.105:0/3403655806 >> v2:172.21.15.162:3300/0 conn(0x7fead40cd070 0x7fead40b2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.977 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.974+0000 7feadc1ad640 1 --2- 172.21.15.105:0/3403655806 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fead40cfb90 0x7fead40ccb30 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.977 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.974+0000 7feadc1ad640 1 --2- 172.21.15.105:0/3403655806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fead40cf660 0x7fead40cf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.977 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.974+0000 7feadc1ad640 1 -- 172.21.15.105:0/3403655806 >> 172.21.15.105:0/3403655806 conn(0x7fead40b1cb0 msgr2=0x7fead40b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:56.977 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.974+0000 7feadc1ad640 1 -- 172.21.15.105:0/3403655806 shutdown_connections 2024-09-21T03:20:56.977 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.974+0000 7feadc1ad640 1 -- 172.21.15.105:0/3403655806 wait complete. 2024-09-21T03:20:56.978 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.975+0000 7feadc1ad640 1 Processor -- start 2024-09-21T03:20:56.978 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.976+0000 7feadc1ad640 1 -- start start 2024-09-21T03:20:56.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.977+0000 7feadc1ad640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fead40cd070 0x7fead409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:56.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.977+0000 7feadc1ad640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fead40cf660 0x7fead4074900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:56.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.977+0000 7feadc1ad640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fead40cfb90 0x7fead4156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:56.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.977+0000 7feadc1ad640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fead4070f20 con 0x7fead40cf660 2024-09-21T03:20:56.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.977+0000 7feadc1ad640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fead40af810 con 0x7fead40cfb90 2024-09-21T03:20:56.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.977+0000 7feadc1ad640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fead40710a0 con 0x7fead40cd070 2024-09-21T03:20:56.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.977+0000 7fead9748640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fead40cf660 0x7fead4074900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:56.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.977+0000 7fead9748640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fead40cf660 0x7fead4074900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:35846/0 (socket says 172.21.15.105:35846) 2024-09-21T03:20:56.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.977+0000 7fead9748640 1 -- 172.21.15.105:0/1860497469 learned_addr learned my addr 172.21.15.105:0/1860497469 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:56.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.977+0000 7feada74a640 1 --2- 172.21.15.105:0/1860497469 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fead40cfb90 0x7fead4156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:56.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.977+0000 7fead9f49640 1 --2- 172.21.15.105:0/1860497469 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fead40cd070 0x7fead409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:56.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.977+0000 7fead9748640 1 -- 172.21.15.105:0/1860497469 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fead40cd070 msgr2=0x7fead409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:56.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.977+0000 7fead9748640 1 --2- 172.21.15.105:0/1860497469 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fead40cd070 0x7fead409aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.977+0000 7fead9748640 1 -- 172.21.15.105:0/1860497469 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fead40cfb90 msgr2=0x7fead4156700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:56.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.977+0000 7fead9748640 1 --2- 172.21.15.105:0/1860497469 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fead40cfb90 0x7fead4156700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:56.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.977+0000 7fead9748640 1 -- 172.21.15.105:0/1860497469 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fead409b280 con 0x7fead40cf660 2024-09-21T03:20:56.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.977+0000 7fead9748640 1 --2- 172.21.15.105:0/1860497469 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fead40cf660 0x7fead4074900 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7feac4034040 tx=0x7feac40038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:56.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.977+0000 7feaca7fc640 1 -- 172.21.15.105:0/1860497469 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac403e030 con 0x7fead40cf660 2024-09-21T03:20:56.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.978+0000 7feaca7fc640 1 -- 172.21.15.105:0/1860497469 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feac4003ca0 con 0x7fead40cf660 2024-09-21T03:20:56.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.978+0000 7feadc1ad640 1 -- 172.21.15.105:0/1860497469 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fead409b560 con 0x7fead40cf660 2024-09-21T03:20:56.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.978+0000 7feaca7fc640 1 -- 172.21.15.105:0/1860497469 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac4035040 con 0x7fead40cf660 2024-09-21T03:20:56.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.978+0000 7feadc1ad640 1 -- 172.21.15.105:0/1860497469 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fead409bb20 con 0x7fead40cf660 2024-09-21T03:20:56.983 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.979+0000 7feadc1ad640 1 -- 172.21.15.105:0/1860497469 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fead409aff0 con 0x7fead40cf660 2024-09-21T03:20:56.983 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.979+0000 7feaca7fc640 1 -- 172.21.15.105:0/1860497469 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feac4041030 con 0x7fead40cf660 2024-09-21T03:20:56.983 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.980+0000 7feaca7fc640 1 --2- 172.21.15.105:0/1860497469 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7feab8078bc0 0x7feab807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:56.983 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.980+0000 7feaca7fc640 1 -- 172.21.15.105:0/1860497469 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7feac40bb100 con 0x7fead40cf660 2024-09-21T03:20:56.983 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.980+0000 7fead9f49640 1 --2- 172.21.15.105:0/1860497469 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7feab8078bc0 0x7feab807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:56.983 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.981+0000 7fead9f49640 1 --2- 172.21.15.105:0/1860497469 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7feab8078bc0 0x7feab807b0d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fead40c3830 tx=0x7fead0005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:56.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:56.985+0000 7feaca7fc640 1 -- 172.21.15.105:0/1860497469 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7feac4083010 con 0x7fead40cf660 2024-09-21T03:20:57.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:57.198+0000 7feadc1ad640 1 -- 172.21.15.105:0/1860497469 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fead409bd20 con 0x7fead40cf660 2024-09-21T03:20:57.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:57.199+0000 7feaca7fc640 1 -- 172.21.15.105:0/1860497469 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) ==== 53+0+73 (secure 0 0 0) 0x7fead409bd20 con 0x7fead40cf660 2024-09-21T03:20:57.201 INFO:teuthology.orchestra.run.smithi105.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T03:20:57.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:57.201+0000 7feadc1ad640 1 -- 172.21.15.105:0/1860497469 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7feab8078bc0 msgr2=0x7feab807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:57.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:57.201+0000 7feadc1ad640 1 --2- 172.21.15.105:0/1860497469 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7feab8078bc0 0x7feab807b0d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fead40c3830 tx=0x7fead0005f90 comp rx=0 tx=0).stop 2024-09-21T03:20:57.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:57.201+0000 7feadc1ad640 1 -- 172.21.15.105:0/1860497469 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fead40cf660 msgr2=0x7fead4074900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:57.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:57.201+0000 7feadc1ad640 1 --2- 172.21.15.105:0/1860497469 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fead40cf660 0x7fead4074900 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7feac4034040 tx=0x7feac40038a0 comp rx=0 tx=0).stop 2024-09-21T03:20:57.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:57.201+0000 7feadc1ad640 1 -- 172.21.15.105:0/1860497469 shutdown_connections 2024-09-21T03:20:57.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:57.201+0000 7feadc1ad640 1 --2- 172.21.15.105:0/1860497469 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7feab8078bc0 0x7feab807b0d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:57.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:57.201+0000 7feadc1ad640 1 --2- 172.21.15.105:0/1860497469 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fead40cfb90 0x7fead4156700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:57.205 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:57.201+0000 7feadc1ad640 1 --2- 172.21.15.105:0/1860497469 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fead40cf660 0x7fead4074900 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:57.205 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:57.201+0000 7feadc1ad640 1 --2- 172.21.15.105:0/1860497469 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fead40cd070 0x7fead409aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:57.205 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:57.201+0000 7feadc1ad640 1 -- 172.21.15.105:0/1860497469 >> 172.21.15.105:0/1860497469 conn(0x7fead40b1cb0 msgr2=0x7fead40b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:57.205 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:57.201+0000 7feadc1ad640 1 -- 172.21.15.105:0/1860497469 shutdown_connections 2024-09-21T03:20:57.205 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:57.201+0000 7feadc1ad640 1 -- 172.21.15.105:0/1860497469 wait complete. 2024-09-21T03:20:57.215 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T03:20:57.215 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T03:20:57.215 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi105.front.sepia.ceph.com 2024-09-21T03:20:57.215 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T03:20:57.215 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T03:20:57.215 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T03:20:57.215 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T03:20:57.215 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T03:20:57.215 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:20:57.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:20:57.216 DEBUG:teuthology.orchestra.run.smithi105:> ip addr 2024-09-21T03:20:57.231 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T03:20:57.231 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T03:20:57.231 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T03:20:57.231 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:20:57.231 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2024-09-21T03:20:57.232 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:20:57.232 INFO:teuthology.orchestra.run.smithi105.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:20:57.232 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b8 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:20:57.232 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f0 2024-09-21T03:20:57.232 INFO:teuthology.orchestra.run.smithi105.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:20:57.232 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b9 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:20:57.232 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f1 2024-09-21T03:20:57.232 INFO:teuthology.orchestra.run.smithi105.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:20:57.232 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:28 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:20:57.232 INFO:teuthology.orchestra.run.smithi105.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T03:20:57.232 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:29 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:20:57.232 INFO:teuthology.orchestra.run.smithi105.stdout: inet 172.21.15.105/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T03:20:57.232 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft 42650sec preferred_lft 42650sec 2024-09-21T03:20:57.232 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::ec4:7aff:fe8f:d429/64 scope link noprefixroute 2024-09-21T03:20:57.233 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:20:57.233 INFO:teuthology.orchestra.run.smithi105.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T03:20:57.233 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 86:15:ed:f2:4e:d8 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:20:57.233 INFO:teuthology.orchestra.run.smithi105.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T03:20:57.233 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:20:57.233 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::80db:6aff:fece:44c2/64 scope link 2024-09-21T03:20:57.233 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:20:57.233 INFO:teuthology.orchestra.run.smithi105.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:20:57.233 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 86:15:ed:f2:4e:d8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T03:20:57.233 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::8415:edff:fef2:4ed8/64 scope link 2024-09-21T03:20:57.233 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:20:57.233 INFO:teuthology.orchestra.run.smithi105.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:20:57.233 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether a2:e9:7c:d4:c7:c7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T03:20:57.233 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::a0e9:7cff:fed4:c7c7/64 scope link 2024-09-21T03:20:57.234 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:20:57.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:20:57.234 DEBUG:teuthology.orchestra.run.smithi105:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T03:20:57.295 INFO:teuthology.orchestra.run.smithi105.stdout:1 2024-09-21T03:20:57.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:20:57.296 DEBUG:teuthology.orchestra.run.smithi105:> route 2024-09-21T03:20:57.353 INFO:teuthology.orchestra.run.smithi105.stdout:Kernel IP routing table 2024-09-21T03:20:57.353 INFO:teuthology.orchestra.run.smithi105.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T03:20:57.353 INFO:teuthology.orchestra.run.smithi105.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T03:20:57.353 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T03:20:57.353 INFO:teuthology.orchestra.run.smithi105.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T03:20:57.353 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:20:57.354 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-21T03:20:57.354 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T03:20:57.354 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T03:20:57.354 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T03:20:57.354 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-21T03:20:57.441 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:20:57.473 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:20:57.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:20:57.479 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-09-21T03:20:57.494 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T03:20:57.494 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T03:20:57.494 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:20:57.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:20:57.495 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set brx.0 up 2024-09-21T03:20:57.559 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:20:57.559 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T03:20:57.615 INFO:teuthology.orchestra.run.smithi105.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:20:57.615 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:20:57.615 DEBUG:teuthology.orchestra.run.smithi105:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T03:20:57.670 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-21T03:20:57.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:20:57.670 DEBUG:teuthology.orchestra.run.smithi105:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:20:57.765 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:20:57.765 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T03:20:57.765 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2024-09-21T03:20:57.775 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:20:57.775 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T03:20:57.775 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2024-09-21T03:20:57.776 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:20:57.776 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:20:57.781 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:20:57.781 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T03:20:57.781 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2024-09-21T03:20:57.781 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:20:57.781 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:20:57.782 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-21T03:20:57.782 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-21T03:20:57.782 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=29d80f4f-e5de-4b26-8384-24c2d8019945" will pass to kernel 2024-09-21T03:20:57.782 INFO:teuthology.orchestra.run.smithi105.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T03:20:57.782 INFO:teuthology.orchestra.run.smithi105.stdout: You just mounted a file system that supports labels which does not 2024-09-21T03:20:57.782 INFO:teuthology.orchestra.run.smithi105.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T03:20:57.782 INFO:teuthology.orchestra.run.smithi105.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T03:20:57.782 INFO:teuthology.orchestra.run.smithi105.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T03:20:57.784 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T03:20:57.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:20:57.784 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T03:20:57.808 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:20:57.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:20:57.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:20:57.909 INFO:teuthology.orchestra.run.smithi105.stdout:client5784 2024-09-21T03:20:57.909 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:20:57.910 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:20:57.925 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T03:20:58.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.075+0000 7f39cb4c5640 1 -- 172.21.15.105:0/940757501 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39c415fb70 msgr2=0x7f39c40b3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:58.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.075+0000 7f39cb4c5640 1 --2- 172.21.15.105:0/940757501 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39c415fb70 0x7f39c40b3a60 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f39bc005fd0 tx=0x7f39bc02aa10 comp rx=0 tx=0).stop 2024-09-21T03:20:58.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.075+0000 7f39cb4c5640 1 -- 172.21.15.105:0/940757501 shutdown_connections 2024-09-21T03:20:58.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.075+0000 7f39cb4c5640 1 --2- 172.21.15.105:0/940757501 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39c415fb70 0x7f39c40b3a60 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:58.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.075+0000 7f39cb4c5640 1 --2- 172.21.15.105:0/940757501 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39c415e8b0 0x7f39c415f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:58.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.075+0000 7f39cb4c5640 1 -- 172.21.15.105:0/940757501 >> 172.21.15.105:0/940757501 conn(0x7f39c40d15f0 msgr2=0x7f39c4073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:58.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.075+0000 7f39cb4c5640 1 -- 172.21.15.105:0/940757501 shutdown_connections 2024-09-21T03:20:58.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.075+0000 7f39cb4c5640 1 -- 172.21.15.105:0/940757501 wait complete. 2024-09-21T03:20:58.078 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.076+0000 7f39cb4c5640 1 Processor -- start 2024-09-21T03:20:58.078 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.077+0000 7f39cb4c5640 1 -- start start 2024-09-21T03:20:58.082 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.078+0000 7f39cb4c5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39c40b4f80 0x7f39c40c59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:58.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.078+0000 7f39cb4c5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39c415e8b0 0x7f39c4158f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:58.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.078+0000 7f39cb4c5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39c415fb70 0x7f39c414ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:58.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.078+0000 7f39cb4c5640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f39c4073e50 con 0x7f39c415e8b0 2024-09-21T03:20:58.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.078+0000 7f39cb4c5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f39c40b4350 con 0x7f39c415fb70 2024-09-21T03:20:58.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.078+0000 7f39cb4c5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f39c4073fd0 con 0x7f39c40b4f80 2024-09-21T03:20:58.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.078+0000 7f39c8a60640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39c415e8b0 0x7f39c4158f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:58.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.078+0000 7f39c8a60640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39c415e8b0 0x7f39c4158f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:35858/0 (socket says 172.21.15.105:35858) 2024-09-21T03:20:58.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.078+0000 7f39c8a60640 1 -- 172.21.15.105:0/4069253820 learned_addr learned my addr 172.21.15.105:0/4069253820 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:58.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.078+0000 7f39c9a62640 1 --2- 172.21.15.105:0/4069253820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39c415fb70 0x7f39c414ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:58.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.078+0000 7f39c9261640 1 --2- 172.21.15.105:0/4069253820 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39c40b4f80 0x7f39c40c59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:58.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.078+0000 7f39c8a60640 1 -- 172.21.15.105:0/4069253820 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39c40b4f80 msgr2=0x7f39c40c59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:58.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.078+0000 7f39c8a60640 1 --2- 172.21.15.105:0/4069253820 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39c40b4f80 0x7f39c40c59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:58.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.078+0000 7f39c8a60640 1 -- 172.21.15.105:0/4069253820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39c415fb70 msgr2=0x7f39c414ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:58.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.078+0000 7f39c8a60640 1 --2- 172.21.15.105:0/4069253820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39c415fb70 0x7f39c414ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:58.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.078+0000 7f39c8a60640 1 -- 172.21.15.105:0/4069253820 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c4155bb0 con 0x7f39c415e8b0 2024-09-21T03:20:58.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.078+0000 7f39c8a60640 1 --2- 172.21.15.105:0/4069253820 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39c415e8b0 0x7f39c4158f40 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f39b400b440 tx=0x7f39b400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:58.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.079+0000 7f39b9ffb640 1 -- 172.21.15.105:0/4069253820 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b4015020 con 0x7f39c415e8b0 2024-09-21T03:20:58.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.079+0000 7f39b9ffb640 1 -- 172.21.15.105:0/4069253820 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39b4011980 con 0x7f39c415e8b0 2024-09-21T03:20:58.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.079+0000 7f39b9ffb640 1 -- 172.21.15.105:0/4069253820 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b4011dd0 con 0x7f39c415e8b0 2024-09-21T03:20:58.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.079+0000 7f39cb4c5640 1 -- 172.21.15.105:0/4069253820 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39c4158180 con 0x7f39c415e8b0 2024-09-21T03:20:58.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.079+0000 7f39cb4c5640 1 -- 172.21.15.105:0/4069253820 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39c4158740 con 0x7f39c415e8b0 2024-09-21T03:20:58.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.080+0000 7f39cb4c5640 1 -- 172.21.15.105:0/4069253820 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39c4074530 con 0x7f39c415e8b0 2024-09-21T03:20:58.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.081+0000 7f39b9ffb640 1 -- 172.21.15.105:0/4069253820 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f39b4018020 con 0x7f39c415e8b0 2024-09-21T03:20:58.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.081+0000 7f39b9ffb640 1 --2- 172.21.15.105:0/4069253820 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f39a8078bc0 0x7f39a807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:58.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.081+0000 7f39b9ffb640 1 -- 172.21.15.105:0/4069253820 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f39b409ac30 con 0x7f39c415e8b0 2024-09-21T03:20:58.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.081+0000 7f39c9261640 1 --2- 172.21.15.105:0/4069253820 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f39a8078bc0 0x7f39a807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:58.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.082+0000 7f39c9261640 1 --2- 172.21.15.105:0/4069253820 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f39a8078bc0 0x7f39a807b0d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f39c0000f60 tx=0x7f39c0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:58.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.086+0000 7f39b9ffb640 1 -- 172.21.15.105:0/4069253820 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f39b401f020 con 0x7f39c415e8b0 2024-09-21T03:20:58.308 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.307+0000 7f39cb4c5640 1 -- 172.21.15.105:0/4069253820 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f39c415aa50 con 0x7f39c415e8b0 2024-09-21T03:20:58.309 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.307+0000 7f39b9ffb640 1 -- 172.21.15.105:0/4069253820 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) ==== 53+0+73 (secure 0 0 0) 0x7f39b400d040 con 0x7f39c415e8b0 2024-09-21T03:20:58.309 INFO:teuthology.orchestra.run.smithi105.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T03:20:58.312 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.309+0000 7f39cb4c5640 1 -- 172.21.15.105:0/4069253820 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f39a8078bc0 msgr2=0x7f39a807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:58.312 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.309+0000 7f39cb4c5640 1 --2- 172.21.15.105:0/4069253820 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f39a8078bc0 0x7f39a807b0d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f39c0000f60 tx=0x7f39c0009040 comp rx=0 tx=0).stop 2024-09-21T03:20:58.312 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.309+0000 7f39cb4c5640 1 -- 172.21.15.105:0/4069253820 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39c415e8b0 msgr2=0x7f39c4158f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:58.312 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.309+0000 7f39cb4c5640 1 --2- 172.21.15.105:0/4069253820 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39c415e8b0 0x7f39c4158f40 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f39b400b440 tx=0x7f39b400b900 comp rx=0 tx=0).stop 2024-09-21T03:20:58.312 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.309+0000 7f39cb4c5640 1 -- 172.21.15.105:0/4069253820 shutdown_connections 2024-09-21T03:20:58.312 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.309+0000 7f39cb4c5640 1 --2- 172.21.15.105:0/4069253820 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f39a8078bc0 0x7f39a807b0d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:58.312 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.309+0000 7f39cb4c5640 1 --2- 172.21.15.105:0/4069253820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39c415fb70 0x7f39c414ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:58.312 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.309+0000 7f39cb4c5640 1 --2- 172.21.15.105:0/4069253820 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39c415e8b0 0x7f39c4158f40 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:58.313 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.309+0000 7f39cb4c5640 1 --2- 172.21.15.105:0/4069253820 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39c40b4f80 0x7f39c40c59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:58.313 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.309+0000 7f39cb4c5640 1 -- 172.21.15.105:0/4069253820 >> 172.21.15.105:0/4069253820 conn(0x7f39c40d15f0 msgr2=0x7f39c41612d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:58.313 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.310+0000 7f39cb4c5640 1 -- 172.21.15.105:0/4069253820 shutdown_connections 2024-09-21T03:20:58.313 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:58.310+0000 7f39cb4c5640 1 -- 172.21.15.105:0/4069253820 wait complete. 2024-09-21T03:20:58.323 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T03:20:58.323 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T03:20:58.323 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2024-09-21T03:20:58.323 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-21T03:20:58.323 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T03:20:58.323 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T03:20:58.323 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T03:20:58.323 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T03:20:58.323 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T03:20:58.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:20:58.323 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2024-09-21T03:20:58.343 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T03:20:58.344 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T03:20:58.344 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T03:20:58.344 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:20:58.344 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-09-21T03:20:58.344 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:20:58.344 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:20:58.344 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:20:58.344 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f0 2024-09-21T03:20:58.345 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:20:58.345 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:20:58.345 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f1 2024-09-21T03:20:58.345 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:20:58.345 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:20:58.345 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T03:20:58.345 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:20:58.345 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T03:20:58.345 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42642sec preferred_lft 42642sec 2024-09-21T03:20:58.345 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::ec4:7aff:fe88:7f41/64 scope link noprefixroute 2024-09-21T03:20:58.345 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:20:58.345 INFO:teuthology.orchestra.run.smithi162.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T03:20:58.345 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 32:ad:10:1b:86:54 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:20:58.346 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T03:20:58.346 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:20:58.346 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::c03a:6bff:febf:f5a9/64 scope link 2024-09-21T03:20:58.346 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:20:58.346 INFO:teuthology.orchestra.run.smithi162.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:20:58.346 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 32:ad:10:1b:86:54 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T03:20:58.346 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::30ad:10ff:fe1b:8654/64 scope link 2024-09-21T03:20:58.346 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:20:58.346 INFO:teuthology.orchestra.run.smithi162.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:20:58.346 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 6a:62:2d:53:ae:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-21T03:20:58.346 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::6862:2dff:fe53:aec0/64 scope link 2024-09-21T03:20:58.346 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:20:58.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:20:58.347 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T03:20:58.412 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-09-21T03:20:58.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:20:58.414 DEBUG:teuthology.orchestra.run.smithi162:> route 2024-09-21T03:20:58.472 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2024-09-21T03:20:58.472 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T03:20:58.473 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T03:20:58.473 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T03:20:58.473 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T03:20:58.473 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:20:58.473 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-09-21T03:20:58.473 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T03:20:58.473 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T03:20:58.473 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T03:20:58.474 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-09-21T03:20:58.568 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:20:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:20:58.603 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:20:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:20:58.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:20:58.610 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-09-21T03:20:58.625 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-21T03:20:58.626 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-21T03:20:58.626 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T03:20:58.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:20:58.626 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.0 up 2024-09-21T03:20:58.692 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:20:58.693 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-21T03:20:58.748 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-21T03:20:58.748 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:20:58.749 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-21T03:20:58.803 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-21T03:20:58.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:20:58.804 DEBUG:teuthology.orchestra.run.smithi162:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:20:58.898 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:20:58.898 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T03:20:58.898 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-21T03:20:58.909 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:20:58.909 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T03:20:58.909 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-21T03:20:58.909 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:20:58.909 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:20:58.915 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:20:58.915 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T03:20:58.915 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-21T03:20:58.915 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:20:58.915 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:20:58.915 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-21T03:20:58.915 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-21T03:20:58.915 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=29d80f4f-e5de-4b26-8384-24c2d8019945" will pass to kernel 2024-09-21T03:20:58.916 INFO:teuthology.orchestra.run.smithi162.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-21T03:20:58.916 INFO:teuthology.orchestra.run.smithi162.stdout: You just mounted a file system that supports labels which does not 2024-09-21T03:20:58.916 INFO:teuthology.orchestra.run.smithi162.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T03:20:58.916 INFO:teuthology.orchestra.run.smithi162.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T03:20:58.916 INFO:teuthology.orchestra.run.smithi162.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T03:20:58.917 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T03:20:58.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:20:58.917 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-21T03:20:58.941 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:20:59.030 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:20:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:20:59.033 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:20:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:20:59.039 INFO:teuthology.orchestra.run.smithi162.stdout:client5180 2024-09-21T03:20:59.039 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:20:59.039 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:20:59.056 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T03:20:59.056 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T03:20:59.112 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T03:20:59.149 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T03:20:59.149 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T03:20:59.150 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:20:59.150 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:20:59.166 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:20:59.166 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:20:59.223 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T03:20:59.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.375+0000 7f53dc9e4640 1 -- 172.21.15.105:0/1851758830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53d80d2460 msgr2=0x7f53d815d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:59.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.375+0000 7f53dc9e4640 1 --2- 172.21.15.105:0/1851758830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53d80d2460 0x7f53d815d130 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f53d8074b10 tx=0x7f53cc02a560 comp rx=0 tx=0).stop 2024-09-21T03:20:59.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.375+0000 7f53dc9e4640 1 -- 172.21.15.105:0/1851758830 shutdown_connections 2024-09-21T03:20:59.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.375+0000 7f53dc9e4640 1 --2- 172.21.15.105:0/1851758830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53d80d2460 0x7f53d815d130 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:59.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.375+0000 7f53dc9e4640 1 --2- 172.21.15.105:0/1851758830 >> v2:172.21.15.162:3300/0 conn(0x7f53d81570e0 0x7f53d80d1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:59.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.375+0000 7f53dc9e4640 1 -- 172.21.15.105:0/1851758830 >> 172.21.15.105:0/1851758830 conn(0x7f53d806d550 msgr2=0x7f53d8071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:59.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.375+0000 7f53dc9e4640 1 -- 172.21.15.105:0/1851758830 shutdown_connections 2024-09-21T03:20:59.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.375+0000 7f53dc9e4640 1 -- 172.21.15.105:0/1851758830 wait complete. 2024-09-21T03:20:59.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.377+0000 7f53dc9e4640 1 Processor -- start 2024-09-21T03:20:59.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.377+0000 7f53dc9e4640 1 -- start start 2024-09-21T03:20:59.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.378+0000 7f53dc9e4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53d80d2460 0x7f53d81f7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:59.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.378+0000 7f53dc9e4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f53d81570e0 0x7f53d8146440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:59.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.378+0000 7f53dc9e4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53d815d670 0x7f53d80d0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:59.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.378+0000 7f53dc9e4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f53d80b7d20 con 0x7f53d815d670 2024-09-21T03:20:59.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.378+0000 7f53dc9e4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f53d80b7ba0 con 0x7f53d80d2460 2024-09-21T03:20:59.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.378+0000 7f53dc9e4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f53d80b7ea0 con 0x7f53d81570e0 2024-09-21T03:20:59.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.378+0000 7f53d6d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53d815d670 0x7f53d80d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:59.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.378+0000 7f53d6d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53d815d670 0x7f53d80d0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:35872/0 (socket says 172.21.15.105:35872) 2024-09-21T03:20:59.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.378+0000 7f53d6d9d640 1 -- 172.21.15.105:0/2223865193 learned_addr learned my addr 172.21.15.105:0/2223865193 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:59.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.379+0000 7f53d5d9b640 1 --2- 172.21.15.105:0/2223865193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f53d81570e0 0x7f53d8146440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:59.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.379+0000 7f53d659c640 1 --2- 172.21.15.105:0/2223865193 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53d80d2460 0x7f53d81f7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:59.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.379+0000 7f53d6d9d640 1 -- 172.21.15.105:0/2223865193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f53d81570e0 msgr2=0x7f53d8146440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:59.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.379+0000 7f53d6d9d640 1 --2- 172.21.15.105:0/2223865193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f53d81570e0 0x7f53d8146440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:59.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.379+0000 7f53d6d9d640 1 -- 172.21.15.105:0/2223865193 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53d80d2460 msgr2=0x7f53d81f7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:59.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.379+0000 7f53d6d9d640 1 --2- 172.21.15.105:0/2223865193 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53d80d2460 0x7f53d81f7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:59.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.379+0000 7f53d6d9d640 1 -- 172.21.15.105:0/2223865193 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d81f7fc0 con 0x7f53d815d670 2024-09-21T03:20:59.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.379+0000 7f53d6d9d640 1 --2- 172.21.15.105:0/2223865193 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53d815d670 0x7f53d80d0150 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f53d000b440 tx=0x7f53d000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:59.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.379+0000 7f53c6ffd640 1 -- 172.21.15.105:0/2223865193 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d0011830 con 0x7f53d815d670 2024-09-21T03:20:59.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.379+0000 7f53c6ffd640 1 -- 172.21.15.105:0/2223865193 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f53d0016070 con 0x7f53d815d670 2024-09-21T03:20:59.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.379+0000 7f53dc9e4640 1 -- 172.21.15.105:0/2223865193 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53d8157940 con 0x7f53d815d670 2024-09-21T03:20:59.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.379+0000 7f53c6ffd640 1 -- 172.21.15.105:0/2223865193 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d0011d60 con 0x7f53d815d670 2024-09-21T03:20:59.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.379+0000 7f53dc9e4640 1 -- 172.21.15.105:0/2223865193 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53d8147140 con 0x7f53d815d670 2024-09-21T03:20:59.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.380+0000 7f53dc9e4640 1 -- 172.21.15.105:0/2223865193 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53d815d130 con 0x7f53d815d670 2024-09-21T03:20:59.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.381+0000 7f53c6ffd640 1 -- 172.21.15.105:0/2223865193 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f53d001b460 con 0x7f53d815d670 2024-09-21T03:20:59.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.381+0000 7f53c6ffd640 1 --2- 172.21.15.105:0/2223865193 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f53b8078b90 0x7f53b807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:59.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.382+0000 7f53c6ffd640 1 -- 172.21.15.105:0/2223865193 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f53d009a870 con 0x7f53d815d670 2024-09-21T03:20:59.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.382+0000 7f53d659c640 1 --2- 172.21.15.105:0/2223865193 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f53b8078b90 0x7f53b807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:59.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.382+0000 7f53d659c640 1 --2- 172.21.15.105:0/2223865193 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f53b8078b90 0x7f53b807b0a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f53c800ae50 tx=0x7f53c800a540 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:59.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.386+0000 7f53c6ffd640 1 -- 172.21.15.105:0/2223865193 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f53d81f7fc0 con 0x7f53d815d670 2024-09-21T03:20:59.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.574+0000 7f53dc9e4640 1 -- 172.21.15.105:0/2223865193 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f53d81576a0 con 0x7f53d815d670 2024-09-21T03:20:59.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.575+0000 7f53c6ffd640 1 -- 172.21.15.105:0/2223865193 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v57) ==== 80+0+0 (secure 0 0 0) 0x7f53d00625e0 con 0x7f53d815d670 2024-09-21T03:20:59.576 INFO:teuthology.orchestra.run.smithi105.stderr:listed 0 entries 2024-09-21T03:20:59.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.577+0000 7f53dc9e4640 1 -- 172.21.15.105:0/2223865193 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f53b8078b90 msgr2=0x7f53b807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:59.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.577+0000 7f53dc9e4640 1 --2- 172.21.15.105:0/2223865193 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f53b8078b90 0x7f53b807b0a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f53c800ae50 tx=0x7f53c800a540 comp rx=0 tx=0).stop 2024-09-21T03:20:59.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.577+0000 7f53dc9e4640 1 -- 172.21.15.105:0/2223865193 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53d815d670 msgr2=0x7f53d80d0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:59.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.577+0000 7f53dc9e4640 1 --2- 172.21.15.105:0/2223865193 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53d815d670 0x7f53d80d0150 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f53d000b440 tx=0x7f53d000b900 comp rx=0 tx=0).stop 2024-09-21T03:20:59.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.577+0000 7f53dc9e4640 1 -- 172.21.15.105:0/2223865193 shutdown_connections 2024-09-21T03:20:59.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.577+0000 7f53dc9e4640 1 --2- 172.21.15.105:0/2223865193 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f53b8078b90 0x7f53b807b0a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:59.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.577+0000 7f53dc9e4640 1 --2- 172.21.15.105:0/2223865193 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53d815d670 0x7f53d80d0150 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:59.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.577+0000 7f53dc9e4640 1 --2- 172.21.15.105:0/2223865193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f53d81570e0 0x7f53d8146440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:59.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.577+0000 7f53dc9e4640 1 --2- 172.21.15.105:0/2223865193 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53d80d2460 0x7f53d81f7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:59.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.577+0000 7f53dc9e4640 1 -- 172.21.15.105:0/2223865193 >> 172.21.15.105:0/2223865193 conn(0x7f53d806d550 msgr2=0x7f53d80d1460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:59.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.577+0000 7f53dc9e4640 1 -- 172.21.15.105:0/2223865193 shutdown_connections 2024-09-21T03:20:59.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.577+0000 7f53dc9e4640 1 -- 172.21.15.105:0/2223865193 wait complete. 2024-09-21T03:20:59.590 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T03:20:59.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:20:59.590 DEBUG:teuthology.orchestra.run.smithi105:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T03:20:59.618 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi105.front.sepia.ceph.com 2024-09-21T03:20:59.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:20:59.619 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T03:20:59.674 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T03:20:59.674 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:20:59.674 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:20:59.691 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:20:59.691 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:20:59.748 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T03:20:59.862 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.860+0000 7fca40a1d640 1 -- 172.21.15.105:0/163852283 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca3c070e40 msgr2=0x7fca3c15f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:59.862 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.860+0000 7fca40a1d640 1 --2- 172.21.15.105:0/163852283 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca3c070e40 0x7fca3c15f2a0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fca3c06e8c0 tx=0x7fca2402a5f0 comp rx=0 tx=0).stop 2024-09-21T03:20:59.862 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.860+0000 7fca40a1d640 1 -- 172.21.15.105:0/163852283 shutdown_connections 2024-09-21T03:20:59.862 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.860+0000 7fca40a1d640 1 --2- 172.21.15.105:0/163852283 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca3c070e40 0x7fca3c15f2a0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:59.862 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.860+0000 7fca40a1d640 1 --2- 172.21.15.105:0/163852283 >> v2:172.21.15.162:3300/0 conn(0x7fca3c15f7e0 0x7fca3c0ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:59.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.860+0000 7fca40a1d640 1 -- 172.21.15.105:0/163852283 >> 172.21.15.105:0/163852283 conn(0x7fca3c0cd530 msgr2=0x7fca3c0cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:20:59.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.860+0000 7fca40a1d640 1 -- 172.21.15.105:0/163852283 shutdown_connections 2024-09-21T03:20:59.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.860+0000 7fca40a1d640 1 -- 172.21.15.105:0/163852283 wait complete. 2024-09-21T03:20:59.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.862+0000 7fca40a1d640 1 Processor -- start 2024-09-21T03:20:59.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.862+0000 7fca40a1d640 1 -- start start 2024-09-21T03:20:59.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.863+0000 7fca40a1d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca3c070e40 0x7fca3c0ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:59.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.863+0000 7fca40a1d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca3c075fa0 0x7fca3c154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:59.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.863+0000 7fca40a1d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca3c15f7e0 0x7fca3c1f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:59.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.863+0000 7fca40a1d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fca3c0cef50 con 0x7fca3c15f7e0 2024-09-21T03:20:59.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.863+0000 7fca40a1d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fca3c0cedd0 con 0x7fca3c075fa0 2024-09-21T03:20:59.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.863+0000 7fca40a1d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fca3c0cf0d0 con 0x7fca3c070e40 2024-09-21T03:20:59.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.864+0000 7fca3ad9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca3c15f7e0 0x7fca3c1f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:59.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.864+0000 7fca31d9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca3c075fa0 0x7fca3c154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:59.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.864+0000 7fca3ad9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca3c15f7e0 0x7fca3c1f64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:35890/0 (socket says 172.21.15.105:35890) 2024-09-21T03:20:59.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.864+0000 7fca3ad9d640 1 -- 172.21.15.105:0/1060321666 learned_addr learned my addr 172.21.15.105:0/1060321666 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:20:59.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.864+0000 7fca3a59c640 1 --2- 172.21.15.105:0/1060321666 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca3c070e40 0x7fca3c0ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:59.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.864+0000 7fca3ad9d640 1 -- 172.21.15.105:0/1060321666 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca3c070e40 msgr2=0x7fca3c0ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:59.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.864+0000 7fca3ad9d640 1 --2- 172.21.15.105:0/1060321666 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca3c070e40 0x7fca3c0ca6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:59.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.864+0000 7fca3ad9d640 1 -- 172.21.15.105:0/1060321666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca3c075fa0 msgr2=0x7fca3c154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:20:59.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.864+0000 7fca3ad9d640 1 --2- 172.21.15.105:0/1060321666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca3c075fa0 0x7fca3c154610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:20:59.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.864+0000 7fca3ad9d640 1 -- 172.21.15.105:0/1060321666 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca3c1598e0 con 0x7fca3c15f7e0 2024-09-21T03:20:59.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.864+0000 7fca31d9b640 1 --2- 172.21.15.105:0/1060321666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca3c075fa0 0x7fca3c154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:20:59.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.864+0000 7fca3ad9d640 1 --2- 172.21.15.105:0/1060321666 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca3c15f7e0 0x7fca3c1f64e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fca3400ea40 tx=0x7fca3400ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:59.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.864+0000 7fca337fe640 1 -- 172.21.15.105:0/1060321666 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3400ce40 con 0x7fca3c15f7e0 2024-09-21T03:20:59.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.864+0000 7fca337fe640 1 -- 172.21.15.105:0/1060321666 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca34004c10 con 0x7fca3c15f7e0 2024-09-21T03:20:59.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.864+0000 7fca40a1d640 1 -- 172.21.15.105:0/1060321666 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca3c159bc0 con 0x7fca3c15f7e0 2024-09-21T03:20:59.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.864+0000 7fca337fe640 1 -- 172.21.15.105:0/1060321666 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca34005020 con 0x7fca3c15f7e0 2024-09-21T03:20:59.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.864+0000 7fca40a1d640 1 -- 172.21.15.105:0/1060321666 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca3c15a180 con 0x7fca3c15f7e0 2024-09-21T03:20:59.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.866+0000 7fca40a1d640 1 -- 172.21.15.105:0/1060321666 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca3c0696c0 con 0x7fca3c15f7e0 2024-09-21T03:20:59.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.866+0000 7fca337fe640 1 -- 172.21.15.105:0/1060321666 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fca340051c0 con 0x7fca3c15f7e0 2024-09-21T03:20:59.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.867+0000 7fca337fe640 1 --2- 172.21.15.105:0/1060321666 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fca1c078bc0 0x7fca1c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:20:59.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.867+0000 7fca337fe640 1 -- 172.21.15.105:0/1060321666 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fca3409b940 con 0x7fca3c15f7e0 2024-09-21T03:20:59.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.867+0000 7fca3a59c640 1 --2- 172.21.15.105:0/1060321666 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fca1c078bc0 0x7fca1c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:20:59.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.867+0000 7fca3a59c640 1 --2- 172.21.15.105:0/1060321666 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fca1c078bc0 0x7fca1c07b0d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fca2c001720 tx=0x7fca2c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:20:59.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:20:59.871+0000 7fca337fe640 1 -- 172.21.15.105:0/1060321666 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fca3c0696c0 con 0x7fca3c15f7e0 2024-09-21T03:21:00.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.057+0000 7fca40a1d640 1 -- 172.21.15.105:0/1060321666 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fca3c0cf640 con 0x7fca3c15f7e0 2024-09-21T03:21:00.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.058+0000 7fca337fe640 1 -- 172.21.15.105:0/1060321666 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v57) ==== 80+0+0 (secure 0 0 0) 0x7fca340637c0 con 0x7fca3c15f7e0 2024-09-21T03:21:00.060 INFO:teuthology.orchestra.run.smithi105.stderr:listed 0 entries 2024-09-21T03:21:00.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.060+0000 7fca40a1d640 1 -- 172.21.15.105:0/1060321666 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fca1c078bc0 msgr2=0x7fca1c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:00.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.060+0000 7fca40a1d640 1 --2- 172.21.15.105:0/1060321666 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fca1c078bc0 0x7fca1c07b0d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fca2c001720 tx=0x7fca2c009040 comp rx=0 tx=0).stop 2024-09-21T03:21:00.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.060+0000 7fca40a1d640 1 -- 172.21.15.105:0/1060321666 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca3c15f7e0 msgr2=0x7fca3c1f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:00.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.060+0000 7fca40a1d640 1 --2- 172.21.15.105:0/1060321666 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca3c15f7e0 0x7fca3c1f64e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fca3400ea40 tx=0x7fca3400ef00 comp rx=0 tx=0).stop 2024-09-21T03:21:00.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.060+0000 7fca40a1d640 1 -- 172.21.15.105:0/1060321666 shutdown_connections 2024-09-21T03:21:00.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.060+0000 7fca40a1d640 1 --2- 172.21.15.105:0/1060321666 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fca1c078bc0 0x7fca1c07b0d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:00.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.060+0000 7fca40a1d640 1 --2- 172.21.15.105:0/1060321666 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca3c15f7e0 0x7fca3c1f64e0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:00.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.060+0000 7fca40a1d640 1 --2- 172.21.15.105:0/1060321666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca3c075fa0 0x7fca3c154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:00.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.060+0000 7fca40a1d640 1 --2- 172.21.15.105:0/1060321666 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca3c070e40 0x7fca3c0ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:00.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.060+0000 7fca40a1d640 1 -- 172.21.15.105:0/1060321666 >> 172.21.15.105:0/1060321666 conn(0x7fca3c0cd530 msgr2=0x7fca3c15cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:00.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.060+0000 7fca40a1d640 1 -- 172.21.15.105:0/1060321666 shutdown_connections 2024-09-21T03:21:00.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.060+0000 7fca40a1d640 1 -- 172.21.15.105:0/1060321666 wait complete. 2024-09-21T03:21:00.073 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-21T03:21:00.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:21:00.073 DEBUG:teuthology.orchestra.run.smithi162:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-21T03:21:00.103 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2024-09-21T03:21:00.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:21:00.103 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-21T03:21:00.159 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T03:21:00.159 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:21:00.159 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:21:00.176 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T03:21:00.176 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T03:21:00.177 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:21:00.177 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:21:00.215 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=452 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T03:21:00.215 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:21:00.330 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.327+0000 7f18eb3e4640 1 -- 172.21.15.105:0/1176601691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18e40cad30 msgr2=0x7f18e406ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:00.331 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.327+0000 7f18eb3e4640 1 --2- 172.21.15.105:0/1176601691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18e40cad30 0x7f18e406ffa0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f18e40c71a0 tx=0x7f18d402a560 comp rx=0 tx=0).stop 2024-09-21T03:21:00.331 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.327+0000 7f18eb3e4640 1 -- 172.21.15.105:0/1176601691 shutdown_connections 2024-09-21T03:21:00.331 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.327+0000 7f18eb3e4640 1 --2- 172.21.15.105:0/1176601691 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18e40704e0 0x7f18e40cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:00.331 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.327+0000 7f18eb3e4640 1 --2- 172.21.15.105:0/1176601691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18e40cad30 0x7f18e406ffa0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:00.331 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.327+0000 7f18eb3e4640 1 --2- 172.21.15.105:0/1176601691 >> v2:172.21.15.162:3300/0 conn(0x7f18e40ca800 0x7f18e40cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:00.331 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.327+0000 7f18eb3e4640 1 -- 172.21.15.105:0/1176601691 >> 172.21.15.105:0/1176601691 conn(0x7f18e40b1cb0 msgr2=0x7f18e40b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:00.331 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.327+0000 7f18eb3e4640 1 -- 172.21.15.105:0/1176601691 shutdown_connections 2024-09-21T03:21:00.331 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.327+0000 7f18eb3e4640 1 -- 172.21.15.105:0/1176601691 wait complete. 2024-09-21T03:21:00.331 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.329+0000 7f18eb3e4640 1 Processor -- start 2024-09-21T03:21:00.331 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.329+0000 7f18eb3e4640 1 -- start start 2024-09-21T03:21:00.333 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.330+0000 7f18eb3e4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18e40704e0 0x7f18e4158310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:00.333 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.330+0000 7f18eb3e4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18e40ca800 0x7f18e40c4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:00.333 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.330+0000 7f18eb3e4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18e40cad30 0x7f18e40c53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:00.333 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.330+0000 7f18eb3e4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f18e40cd140 con 0x7f18e40704e0 2024-09-21T03:21:00.333 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.330+0000 7f18eb3e4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f18e40ccfc0 con 0x7f18e40cad30 2024-09-21T03:21:00.333 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.330+0000 7f18eb3e4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f18e40cd2c0 con 0x7f18e40ca800 2024-09-21T03:21:00.333 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.330+0000 7f18e9180640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18e40704e0 0x7f18e4158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:00.333 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.330+0000 7f18e9180640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18e40704e0 0x7f18e4158310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:35912/0 (socket says 172.21.15.105:35912) 2024-09-21T03:21:00.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.330+0000 7f18e9180640 1 -- 172.21.15.105:0/2817638749 learned_addr learned my addr 172.21.15.105:0/2817638749 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:00.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.330+0000 7f18e897f640 1 --2- 172.21.15.105:0/2817638749 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18e40ca800 0x7f18e40c4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:00.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.330+0000 7f18e9981640 1 --2- 172.21.15.105:0/2817638749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18e40cad30 0x7f18e40c53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:00.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.331+0000 7f18e9180640 1 -- 172.21.15.105:0/2817638749 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18e40ca800 msgr2=0x7f18e40c4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:00.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.331+0000 7f18e9180640 1 --2- 172.21.15.105:0/2817638749 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18e40ca800 0x7f18e40c4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:00.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.331+0000 7f18e9180640 1 -- 172.21.15.105:0/2817638749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18e40cad30 msgr2=0x7f18e40c53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:00.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.331+0000 7f18e9180640 1 --2- 172.21.15.105:0/2817638749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18e40cad30 0x7f18e40c53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:00.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.331+0000 7f18e9180640 1 -- 172.21.15.105:0/2817638749 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e415c2a0 con 0x7f18e40704e0 2024-09-21T03:21:00.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.331+0000 7f18e9981640 1 --2- 172.21.15.105:0/2817638749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18e40cad30 0x7f18e40c53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:21:00.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.331+0000 7f18e9180640 1 --2- 172.21.15.105:0/2817638749 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18e40704e0 0x7f18e4158310 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f18e000d6d0 tx=0x7f18e000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:00.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.331+0000 7f18d9ffb640 1 -- 172.21.15.105:0/2817638749 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e0017070 con 0x7f18e40704e0 2024-09-21T03:21:00.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.331+0000 7f18d9ffb640 1 -- 172.21.15.105:0/2817638749 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f18e0004310 con 0x7f18e40704e0 2024-09-21T03:21:00.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.331+0000 7f18eb3e4640 1 -- 172.21.15.105:0/2817638749 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18e415c580 con 0x7f18e40704e0 2024-09-21T03:21:00.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.331+0000 7f18d9ffb640 1 -- 172.21.15.105:0/2817638749 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e0009a80 con 0x7f18e40704e0 2024-09-21T03:21:00.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.331+0000 7f18eb3e4640 1 -- 172.21.15.105:0/2817638749 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18e415cb40 con 0x7f18e40704e0 2024-09-21T03:21:00.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.332+0000 7f18eb3e4640 1 -- 172.21.15.105:0/2817638749 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18e406ff90 con 0x7f18e40704e0 2024-09-21T03:21:00.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.333+0000 7f18d9ffb640 1 -- 172.21.15.105:0/2817638749 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f18e00035f0 con 0x7f18e40704e0 2024-09-21T03:21:00.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.333+0000 7f18d9ffb640 1 --2- 172.21.15.105:0/2817638749 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f18c8078b90 0x7f18c807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:00.336 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.334+0000 7f18d9ffb640 1 -- 172.21.15.105:0/2817638749 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f18e009ae70 con 0x7f18e40704e0 2024-09-21T03:21:00.336 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.334+0000 7f18e897f640 1 --2- 172.21.15.105:0/2817638749 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f18c8078b90 0x7f18c807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:00.336 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.334+0000 7f18e897f640 1 --2- 172.21.15.105:0/2817638749 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f18c8078b90 0x7f18c807b0a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f18d4033000 tx=0x7f18d4004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:00.339 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.338+0000 7f18d9ffb640 1 -- 172.21.15.105:0/2817638749 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f18e0062cf0 con 0x7f18e40704e0 2024-09-21T03:21:00.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.555+0000 7f18eb3e4640 1 -- 172.21.15.105:0/2817638749 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f18e40cc7b0 con 0x7f18e40704e0 2024-09-21T03:21:00.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.556+0000 7f18d9ffb640 1 -- 172.21.15.105:0/2817638749 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+5232 (secure 0 0 0) 0x7f18e0067720 con 0x7f18e40704e0 2024-09-21T03:21:00.557 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:00.558 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":32,"btime":"2024-09-21T03:20:54:138507+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5099,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3633306312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3633306312},{"type":"v1","addr":"172.21.15.162:6836","nonce":3633306312}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5356,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3748267738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3748267738},{"type":"v1","addr":"172.21.15.162:6837","nonce":3748267738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/431670561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":431670561},{"type":"v1","addr":"172.21.15.105:6833","nonce":431670561}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:20:50.482111+0000","modified":"2024-09-21T03:20:53.504519+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1075697245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1075697245},{"type":"v1","addr":"172.21.15.105:6835","nonce":1075697245}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5643,"qdb_cluster":[5643]},"id":4}]} 2024-09-21T03:21:00.558 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 32 2024-09-21T03:21:00.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.558+0000 7f18eb3e4640 1 -- 172.21.15.105:0/2817638749 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f18c8078b90 msgr2=0x7f18c807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:00.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.558+0000 7f18eb3e4640 1 --2- 172.21.15.105:0/2817638749 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f18c8078b90 0x7f18c807b0a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f18d4033000 tx=0x7f18d4004730 comp rx=0 tx=0).stop 2024-09-21T03:21:00.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.558+0000 7f18eb3e4640 1 -- 172.21.15.105:0/2817638749 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18e40704e0 msgr2=0x7f18e4158310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:00.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.558+0000 7f18eb3e4640 1 --2- 172.21.15.105:0/2817638749 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18e40704e0 0x7f18e4158310 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f18e000d6d0 tx=0x7f18e000db90 comp rx=0 tx=0).stop 2024-09-21T03:21:00.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.558+0000 7f18eb3e4640 1 -- 172.21.15.105:0/2817638749 shutdown_connections 2024-09-21T03:21:00.561 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.558+0000 7f18eb3e4640 1 --2- 172.21.15.105:0/2817638749 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f18c8078b90 0x7f18c807b0a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:00.561 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.558+0000 7f18eb3e4640 1 --2- 172.21.15.105:0/2817638749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18e40cad30 0x7f18e40c53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:00.561 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.558+0000 7f18eb3e4640 1 --2- 172.21.15.105:0/2817638749 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18e40ca800 0x7f18e40c4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:00.561 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.558+0000 7f18eb3e4640 1 --2- 172.21.15.105:0/2817638749 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18e40704e0 0x7f18e4158310 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:00.561 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.558+0000 7f18eb3e4640 1 -- 172.21.15.105:0/2817638749 >> 172.21.15.105:0/2817638749 conn(0x7f18e40b1cb0 msgr2=0x7f18e4074400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:00.561 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.558+0000 7f18eb3e4640 1 -- 172.21.15.105:0/2817638749 shutdown_connections 2024-09-21T03:21:00.561 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.558+0000 7f18eb3e4640 1 -- 172.21.15.105:0/2817638749 wait complete. 2024-09-21T03:21:00.571 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:21:00.682 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.680+0000 7f8c48d32640 1 -- 172.21.15.105:0/1725055550 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c440d12c0 msgr2=0x7f8c440d16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:00.682 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.680+0000 7f8c48d32640 1 --2- 172.21.15.105:0/1725055550 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c440d12c0 0x7f8c440d16d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f8c440724e0 tx=0x7f8c3c02aac0 comp rx=0 tx=0).stop 2024-09-21T03:21:00.682 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.680+0000 7f8c48d32640 1 -- 172.21.15.105:0/1725055550 shutdown_connections 2024-09-21T03:21:00.682 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.680+0000 7f8c48d32640 1 --2- 172.21.15.105:0/1725055550 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c440d12c0 0x7f8c440d16d0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:00.682 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.680+0000 7f8c48d32640 1 --2- 172.21.15.105:0/1725055550 >> v2:172.21.15.162:3300/0 conn(0x7f8c440ccbd0 0x7f8c440d0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:00.683 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.680+0000 7f8c48d32640 1 -- 172.21.15.105:0/1725055550 >> 172.21.15.105:0/1725055550 conn(0x7f8c44072ae0 msgr2=0x7f8c44072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:00.683 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.680+0000 7f8c48d32640 1 -- 172.21.15.105:0/1725055550 shutdown_connections 2024-09-21T03:21:00.683 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.680+0000 7f8c48d32640 1 -- 172.21.15.105:0/1725055550 wait complete. 2024-09-21T03:21:00.684 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.682+0000 7f8c48d32640 1 Processor -- start 2024-09-21T03:21:00.684 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.682+0000 7f8c48d32640 1 -- start start 2024-09-21T03:21:00.686 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.684+0000 7f8c48d32640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c440b51c0 0x7f8c441f74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:00.687 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.684+0000 7f8c48d32640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c440ccbd0 0x7f8c4414aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:00.687 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.684+0000 7f8c48d32640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c440d12c0 0x7f8c440b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:00.687 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.684+0000 7f8c48d32640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8c440cf280 con 0x7f8c440b51c0 2024-09-21T03:21:00.687 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.684+0000 7f8c48d32640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8c440cf100 con 0x7f8c440ccbd0 2024-09-21T03:21:00.687 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.684+0000 7f8c48d32640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8c440cf400 con 0x7f8c440d12c0 2024-09-21T03:21:00.687 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.684+0000 7f8c4259c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c440b51c0 0x7f8c441f74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:00.687 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.684+0000 7f8c4259c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c440b51c0 0x7f8c441f74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:35932/0 (socket says 172.21.15.105:35932) 2024-09-21T03:21:00.687 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.684+0000 7f8c4259c640 1 -- 172.21.15.105:0/275840664 learned_addr learned my addr 172.21.15.105:0/275840664 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:00.687 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.684+0000 7f8c39d9b640 1 --2- 172.21.15.105:0/275840664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c440ccbd0 0x7f8c4414aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:00.687 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.684+0000 7f8c42d9d640 1 --2- 172.21.15.105:0/275840664 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c440d12c0 0x7f8c440b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:00.687 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.684+0000 7f8c4259c640 1 -- 172.21.15.105:0/275840664 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c440d12c0 msgr2=0x7f8c440b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:00.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.684+0000 7f8c4259c640 1 --2- 172.21.15.105:0/275840664 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c440d12c0 0x7f8c440b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:00.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.684+0000 7f8c4259c640 1 -- 172.21.15.105:0/275840664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c440ccbd0 msgr2=0x7f8c4414aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:00.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.684+0000 7f8c4259c640 1 --2- 172.21.15.105:0/275840664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c440ccbd0 0x7f8c4414aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:00.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.684+0000 7f8c4259c640 1 -- 172.21.15.105:0/275840664 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c440a9b60 con 0x7f8c440b51c0 2024-09-21T03:21:00.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.684+0000 7f8c39d9b640 1 --2- 172.21.15.105:0/275840664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c440ccbd0 0x7f8c4414aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:21:00.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.684+0000 7f8c4259c640 1 --2- 172.21.15.105:0/275840664 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c440b51c0 0x7f8c441f74d0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f8c3400c3c0 tx=0x7f8c3400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:00.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.684+0000 7f8c3b7fe640 1 -- 172.21.15.105:0/275840664 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c34017070 con 0x7f8c440b51c0 2024-09-21T03:21:00.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.684+0000 7f8c3b7fe640 1 -- 172.21.15.105:0/275840664 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c340035f0 con 0x7f8c440b51c0 2024-09-21T03:21:00.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.684+0000 7f8c3b7fe640 1 -- 172.21.15.105:0/275840664 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c34003a80 con 0x7f8c440b51c0 2024-09-21T03:21:00.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.684+0000 7f8c48d32640 1 -- 172.21.15.105:0/275840664 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c440c8f50 con 0x7f8c440b51c0 2024-09-21T03:21:00.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.684+0000 7f8c48d32640 1 -- 172.21.15.105:0/275840664 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c440c8470 con 0x7f8c440b51c0 2024-09-21T03:21:00.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.686+0000 7f8c48d32640 1 -- 172.21.15.105:0/275840664 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c440cf8b0 con 0x7f8c440b51c0 2024-09-21T03:21:00.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.686+0000 7f8c3b7fe640 1 -- 172.21.15.105:0/275840664 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8c3401a070 con 0x7f8c440b51c0 2024-09-21T03:21:00.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.687+0000 7f8c3b7fe640 1 --2- 172.21.15.105:0/275840664 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c24078bc0 0x7f8c2407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:00.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.687+0000 7f8c3b7fe640 1 -- 172.21.15.105:0/275840664 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f8c3409a070 con 0x7f8c440b51c0 2024-09-21T03:21:00.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.687+0000 7f8c39d9b640 1 --2- 172.21.15.105:0/275840664 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c24078bc0 0x7f8c2407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:00.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.688+0000 7f8c39d9b640 1 --2- 172.21.15.105:0/275840664 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c24078bc0 0x7f8c2407b0d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8c440c9360 tx=0x7f8c2c005dd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:00.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.691+0000 7f8c3b7fe640 1 -- 172.21.15.105:0/275840664 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8c340624b0 con 0x7f8c440b51c0 2024-09-21T03:21:00.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.902+0000 7f8c48d32640 1 -- 172.21.15.105:0/275840664 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8c440b67a0 con 0x7f8c440b51c0 2024-09-21T03:21:00.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.902+0000 7f8c3b7fe640 1 -- 172.21.15.105:0/275840664 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+5232 (secure 0 0 0) 0x7f8c34061db0 con 0x7f8c440b51c0 2024-09-21T03:21:00.904 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:00.905 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":32,"btime":"2024-09-21T03:20:54:138507+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5099,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3633306312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3633306312},{"type":"v1","addr":"172.21.15.162:6836","nonce":3633306312}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5356,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3748267738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3748267738},{"type":"v1","addr":"172.21.15.162:6837","nonce":3748267738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/431670561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":431670561},{"type":"v1","addr":"172.21.15.105:6833","nonce":431670561}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:20:50.482111+0000","modified":"2024-09-21T03:20:53.504519+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1075697245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1075697245},{"type":"v1","addr":"172.21.15.105:6835","nonce":1075697245}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5643,"qdb_cluster":[5643]},"id":4}]} 2024-09-21T03:21:00.905 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 32 2024-09-21T03:21:00.907 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.905+0000 7f8c48d32640 1 -- 172.21.15.105:0/275840664 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c24078bc0 msgr2=0x7f8c2407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:00.907 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.905+0000 7f8c48d32640 1 --2- 172.21.15.105:0/275840664 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c24078bc0 0x7f8c2407b0d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8c440c9360 tx=0x7f8c2c005dd0 comp rx=0 tx=0).stop 2024-09-21T03:21:00.907 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.905+0000 7f8c48d32640 1 -- 172.21.15.105:0/275840664 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c440b51c0 msgr2=0x7f8c441f74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:00.907 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.905+0000 7f8c48d32640 1 --2- 172.21.15.105:0/275840664 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c440b51c0 0x7f8c441f74d0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f8c3400c3c0 tx=0x7f8c3400c880 comp rx=0 tx=0).stop 2024-09-21T03:21:00.907 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.905+0000 7f8c48d32640 1 -- 172.21.15.105:0/275840664 shutdown_connections 2024-09-21T03:21:00.907 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.905+0000 7f8c48d32640 1 --2- 172.21.15.105:0/275840664 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c24078bc0 0x7f8c2407b0d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:00.907 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.905+0000 7f8c48d32640 1 --2- 172.21.15.105:0/275840664 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c440d12c0 0x7f8c440b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:00.907 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.905+0000 7f8c48d32640 1 --2- 172.21.15.105:0/275840664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c440ccbd0 0x7f8c4414aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:00.907 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.905+0000 7f8c48d32640 1 --2- 172.21.15.105:0/275840664 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c440b51c0 0x7f8c441f74d0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:00.908 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.905+0000 7f8c48d32640 1 -- 172.21.15.105:0/275840664 >> 172.21.15.105:0/275840664 conn(0x7f8c44072ae0 msgr2=0x7f8c4415b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:00.908 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.905+0000 7f8c48d32640 1 -- 172.21.15.105:0/275840664 shutdown_connections 2024-09-21T03:21:00.908 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:00.905+0000 7f8c48d32640 1 -- 172.21.15.105:0/275840664 wait complete. 2024-09-21T03:21:00.918 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:21:01.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.028+0000 7f1eacb13640 1 -- 172.21.15.105:0/2351132337 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e940040b0 msgr2=0x7f1e94004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:01.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.028+0000 7f1eacb13640 1 --2- 172.21.15.105:0/2351132337 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e940040b0 0x7f1e94004800 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1e90006fc0 tx=0x7f1e94005830 comp rx=0 tx=0).stop 2024-09-21T03:21:01.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.028+0000 7f1ea6d9d640 1 -- 172.21.15.105:0/2351132337 reap_dead start 2024-09-21T03:21:01.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.028+0000 7f1eacb13640 1 -- 172.21.15.105:0/2351132337 shutdown_connections 2024-09-21T03:21:01.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.028+0000 7f1eacb13640 1 -- 172.21.15.105:0/2351132337 >> 172.21.15.105:0/2351132337 conn(0x7f1ea80b1cb0 msgr2=0x7f1ea80b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:01.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.028+0000 7f1eacb13640 1 -- 172.21.15.105:0/2351132337 shutdown_connections 2024-09-21T03:21:01.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.028+0000 7f1eacb13640 1 -- 172.21.15.105:0/2351132337 wait complete. 2024-09-21T03:21:01.032 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.030+0000 7f1eacb13640 1 Processor -- start 2024-09-21T03:21:01.032 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.030+0000 7f1eacb13640 1 -- start start 2024-09-21T03:21:01.034 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.032+0000 7f1eacb13640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e940040b0 0x7f1ea81f6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:01.034 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.032+0000 7f1eacb13640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ea80c9e60 0x7f1ea814c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:01.034 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.032+0000 7f1eacb13640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ea815e0f0 0x7f1ea815e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:01.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.032+0000 7f1eacb13640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea8073cc0 con 0x7f1ea80c9e60 2024-09-21T03:21:01.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.032+0000 7f1eacb13640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea80cbdd0 con 0x7f1e940040b0 2024-09-21T03:21:01.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.032+0000 7f1eacb13640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1ea8073e40 con 0x7f1ea815e0f0 2024-09-21T03:21:01.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.032+0000 7f1e9dd9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ea80c9e60 0x7f1ea814c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:01.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.032+0000 7f1e9dd9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ea80c9e60 0x7f1ea814c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:35948/0 (socket says 172.21.15.105:35948) 2024-09-21T03:21:01.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.032+0000 7f1e9dd9b640 1 -- 172.21.15.105:0/3244495179 learned_addr learned my addr 172.21.15.105:0/3244495179 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:01.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.032+0000 7f1ea659c640 1 --2- 172.21.15.105:0/3244495179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e940040b0 0x7f1ea81f6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:01.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.032+0000 7f1ea6d9d640 1 --2- 172.21.15.105:0/3244495179 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ea815e0f0 0x7f1ea815e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:01.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.032+0000 7f1e9dd9b640 1 -- 172.21.15.105:0/3244495179 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ea815e0f0 msgr2=0x7f1ea815e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:01.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.032+0000 7f1e9dd9b640 1 --2- 172.21.15.105:0/3244495179 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ea815e0f0 0x7f1ea815e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:01.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.032+0000 7f1e9dd9b640 1 -- 172.21.15.105:0/3244495179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e940040b0 msgr2=0x7f1ea81f6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:01.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.032+0000 7f1e9dd9b640 1 --2- 172.21.15.105:0/3244495179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e940040b0 0x7f1ea81f6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:01.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.032+0000 7f1e9dd9b640 1 -- 172.21.15.105:0/3244495179 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ea809bf00 con 0x7f1ea80c9e60 2024-09-21T03:21:01.036 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.032+0000 7f1e9dd9b640 1 --2- 172.21.15.105:0/3244495179 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ea80c9e60 0x7f1ea814c680 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1e9000c350 tx=0x7f1e90006d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:01.036 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.032+0000 7f1e9f7fe640 1 -- 172.21.15.105:0/3244495179 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e90031040 con 0x7f1ea80c9e60 2024-09-21T03:21:01.036 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.032+0000 7f1e9f7fe640 1 -- 172.21.15.105:0/3244495179 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e900035f0 con 0x7f1ea80c9e60 2024-09-21T03:21:01.036 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.032+0000 7f1eacb13640 1 -- 172.21.15.105:0/3244495179 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ea815ea40 con 0x7f1ea80c9e60 2024-09-21T03:21:01.036 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.032+0000 7f1e9f7fe640 1 -- 172.21.15.105:0/3244495179 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e90003a00 con 0x7f1ea80c9e60 2024-09-21T03:21:01.036 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.032+0000 7f1eacb13640 1 -- 172.21.15.105:0/3244495179 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ea809c460 con 0x7f1ea80c9e60 2024-09-21T03:21:01.037 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.033+0000 7f1eacb13640 1 -- 172.21.15.105:0/3244495179 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ea80ca300 con 0x7f1ea80c9e60 2024-09-21T03:21:01.037 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.034+0000 7f1e9f7fe640 1 -- 172.21.15.105:0/3244495179 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1e90034070 con 0x7f1ea80c9e60 2024-09-21T03:21:01.037 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.035+0000 7f1e9f7fe640 1 --2- 172.21.15.105:0/3244495179 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1e88078bf0 0x7f1e8807b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:01.037 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.035+0000 7f1e9f7fe640 1 -- 172.21.15.105:0/3244495179 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f1e900bab60 con 0x7f1ea80c9e60 2024-09-21T03:21:01.037 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.035+0000 7f1ea659c640 1 --2- 172.21.15.105:0/3244495179 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1e88078bf0 0x7f1e8807b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:01.037 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.035+0000 7f1ea659c640 1 --2- 172.21.15.105:0/3244495179 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1e88078bf0 0x7f1e8807b100 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1ea80cb250 tx=0x7f1e9800b260 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:01.040 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.039+0000 7f1e9f7fe640 1 -- 172.21.15.105:0/3244495179 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1ea815ea40 con 0x7f1ea80c9e60 2024-09-21T03:21:01.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.220+0000 7f1eacb13640 1 -- 172.21.15.105:0/3244495179 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1ea80743a0 con 0x7f1ea80c9e60 2024-09-21T03:21:01.223 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.221+0000 7f1e9f7fe640 1 -- 172.21.15.105:0/3244495179 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+16797 (secure 0 0 0) 0x7f1ea809bf00 con 0x7f1ea80c9e60 2024-09-21T03:21:01.223 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:01.223 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":57,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:20:52.125692+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:20:48.140896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-21T03:20:49.449787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:21:01.226 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.224+0000 7f1eacb13640 1 -- 172.21.15.105:0/3244495179 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1e88078bf0 msgr2=0x7f1e8807b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:01.226 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.224+0000 7f1eacb13640 1 --2- 172.21.15.105:0/3244495179 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1e88078bf0 0x7f1e8807b100 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1ea80cb250 tx=0x7f1e9800b260 comp rx=0 tx=0).stop 2024-09-21T03:21:01.226 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.224+0000 7f1eacb13640 1 -- 172.21.15.105:0/3244495179 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ea80c9e60 msgr2=0x7f1ea814c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:01.226 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.224+0000 7f1eacb13640 1 --2- 172.21.15.105:0/3244495179 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ea80c9e60 0x7f1ea814c680 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1e9000c350 tx=0x7f1e90006d30 comp rx=0 tx=0).stop 2024-09-21T03:21:01.226 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.224+0000 7f1eacb13640 1 -- 172.21.15.105:0/3244495179 shutdown_connections 2024-09-21T03:21:01.226 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.224+0000 7f1eacb13640 1 --2- 172.21.15.105:0/3244495179 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1e88078bf0 0x7f1e8807b100 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:01.226 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.224+0000 7f1eacb13640 1 --2- 172.21.15.105:0/3244495179 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ea815e0f0 0x7f1ea815e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:01.226 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.224+0000 7f1eacb13640 1 --2- 172.21.15.105:0/3244495179 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ea80c9e60 0x7f1ea814c680 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:01.226 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.224+0000 7f1eacb13640 1 --2- 172.21.15.105:0/3244495179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e940040b0 0x7f1ea81f6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:01.226 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.224+0000 7f1eacb13640 1 -- 172.21.15.105:0/3244495179 >> 172.21.15.105:0/3244495179 conn(0x7f1ea80b1cb0 msgr2=0x7f1ea80b47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:01.226 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.224+0000 7f1eacb13640 1 -- 172.21.15.105:0/3244495179 shutdown_connections 2024-09-21T03:21:01.226 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.224+0000 7f1eacb13640 1 -- 172.21.15.105:0/3244495179 wait complete. 2024-09-21T03:21:01.237 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T03:21:01.237 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:21:01.350 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.348+0000 7f9bfb7ad640 1 -- 172.21.15.105:0/2001069822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9be0003a80 msgr2=0x7f9be0003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:01.350 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.348+0000 7f9bfb7ad640 1 --2- 172.21.15.105:0/2001069822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9be0003a80 0x7f9be0003ef0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f9bf40d11c0 tx=0x7f9be0005830 comp rx=0 tx=0).stop 2024-09-21T03:21:01.350 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.348+0000 7f9bf9d4a640 1 -- 172.21.15.105:0/2001069822 reap_dead start 2024-09-21T03:21:01.351 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.348+0000 7f9bfb7ad640 1 -- 172.21.15.105:0/2001069822 shutdown_connections 2024-09-21T03:21:01.351 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.348+0000 7f9bfb7ad640 1 -- 172.21.15.105:0/2001069822 >> 172.21.15.105:0/2001069822 conn(0x7f9bf40b1cb0 msgr2=0x7f9bf40b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:01.351 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.348+0000 7f9bfb7ad640 1 -- 172.21.15.105:0/2001069822 shutdown_connections 2024-09-21T03:21:01.351 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.348+0000 7f9bfb7ad640 1 -- 172.21.15.105:0/2001069822 wait complete. 2024-09-21T03:21:01.351 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.350+0000 7f9bfb7ad640 1 Processor -- start 2024-09-21T03:21:01.352 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.350+0000 7f9bfb7ad640 1 -- start start 2024-09-21T03:21:01.354 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.351+0000 7f9bfb7ad640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9be0003a80 0x7f9bf41e44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:01.354 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.351+0000 7f9bfb7ad640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bf41e6aa0 0x7f9bf4143610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:01.354 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.351+0000 7f9bfb7ad640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9bf4141580 0x7f9bf4141990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:01.354 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.351+0000 7f9bfb7ad640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf4073cc0 con 0x7f9bf4141580 2024-09-21T03:21:01.354 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.351+0000 7f9bfb7ad640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf40cbde0 con 0x7f9bf41e6aa0 2024-09-21T03:21:01.355 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.351+0000 7f9bfb7ad640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9bf4073e40 con 0x7f9be0003a80 2024-09-21T03:21:01.355 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.352+0000 7f9bf9d4a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9bf4141580 0x7f9bf4141990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:01.355 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.352+0000 7f9bf9d4a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9bf4141580 0x7f9bf4141990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:35970/0 (socket says 172.21.15.105:35970) 2024-09-21T03:21:01.355 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.352+0000 7f9bf9d4a640 1 -- 172.21.15.105:0/2835219206 learned_addr learned my addr 172.21.15.105:0/2835219206 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:01.355 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.352+0000 7f9bf8d48640 1 --2- 172.21.15.105:0/2835219206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bf41e6aa0 0x7f9bf4143610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:01.355 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.352+0000 7f9bf9549640 1 --2- 172.21.15.105:0/2835219206 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9be0003a80 0x7f9bf41e44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:01.355 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.352+0000 7f9bf9d4a640 1 -- 172.21.15.105:0/2835219206 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9be0003a80 msgr2=0x7f9bf41e44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:01.355 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.352+0000 7f9bf9d4a640 1 --2- 172.21.15.105:0/2835219206 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9be0003a80 0x7f9bf41e44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:01.355 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.352+0000 7f9bf9d4a640 1 -- 172.21.15.105:0/2835219206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bf41e6aa0 msgr2=0x7f9bf4143610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:01.355 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.352+0000 7f9bf9d4a640 1 --2- 172.21.15.105:0/2835219206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bf41e6aa0 0x7f9bf4143610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:01.355 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.352+0000 7f9bf9d4a640 1 -- 172.21.15.105:0/2835219206 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bf4144180 con 0x7f9bf4141580 2024-09-21T03:21:01.355 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.352+0000 7f9bf9549640 1 --2- 172.21.15.105:0/2835219206 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9be0003a80 0x7f9bf41e44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:21:01.355 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.352+0000 7f9bf9d4a640 1 --2- 172.21.15.105:0/2835219206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9bf4141580 0x7f9bf4141990 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4070de0 tx=0x7f9bec00fd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:01.355 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.352+0000 7f9be9ffb640 1 -- 172.21.15.105:0/2835219206 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bec003b80 con 0x7f9bf4141580 2024-09-21T03:21:01.356 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.352+0000 7f9be9ffb640 1 -- 172.21.15.105:0/2835219206 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9bec003e10 con 0x7f9bf4141580 2024-09-21T03:21:01.356 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.352+0000 7f9be9ffb640 1 -- 172.21.15.105:0/2835219206 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bec004d80 con 0x7f9bf4141580 2024-09-21T03:21:01.356 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.352+0000 7f9bfb7ad640 1 -- 172.21.15.105:0/2835219206 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bf4144460 con 0x7f9bf4141580 2024-09-21T03:21:01.356 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.352+0000 7f9bfb7ad640 1 -- 172.21.15.105:0/2835219206 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bf41e62a0 con 0x7f9bf4141580 2024-09-21T03:21:01.356 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.353+0000 7f9bfb7ad640 1 -- 172.21.15.105:0/2835219206 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bf4143ef0 con 0x7f9bf4141580 2024-09-21T03:21:01.357 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.354+0000 7f9be9ffb640 1 -- 172.21.15.105:0/2835219206 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9bec01a020 con 0x7f9bf4141580 2024-09-21T03:21:01.357 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.354+0000 7f9be9ffb640 1 --2- 172.21.15.105:0/2835219206 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9bd8078bc0 0x7f9bd807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:01.357 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.355+0000 7f9be9ffb640 1 -- 172.21.15.105:0/2835219206 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f9bec09aff0 con 0x7f9bf4141580 2024-09-21T03:21:01.357 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.355+0000 7f9bf9549640 1 --2- 172.21.15.105:0/2835219206 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9bd8078bc0 0x7f9bd807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:01.357 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.355+0000 7f9bf9549640 1 --2- 172.21.15.105:0/2835219206 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9bd8078bc0 0x7f9bd807b0d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0033000 tx=0x7f9bf002d000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:01.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.359+0000 7f9be9ffb640 1 -- 172.21.15.105:0/2835219206 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9bec0633b0 con 0x7f9bf4141580 2024-09-21T03:21:01.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.572+0000 7f9bfb7ad640 1 -- 172.21.15.105:0/2835219206 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9bf40743a0 con 0x7f9bf4141580 2024-09-21T03:21:01.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.572+0000 7f9be9ffb640 1 -- 172.21.15.105:0/2835219206 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+5232 (secure 0 0 0) 0x7f9bec062cb0 con 0x7f9bf4141580 2024-09-21T03:21:01.574 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:01.574 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":32,"btime":"2024-09-21T03:20:54:138507+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5099,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3633306312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3633306312},{"type":"v1","addr":"172.21.15.162:6836","nonce":3633306312}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5356,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3748267738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3748267738},{"type":"v1","addr":"172.21.15.162:6837","nonce":3748267738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/431670561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":431670561},{"type":"v1","addr":"172.21.15.105:6833","nonce":431670561}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:20:50.482111+0000","modified":"2024-09-21T03:20:53.504519+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1075697245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1075697245},{"type":"v1","addr":"172.21.15.105:6835","nonce":1075697245}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5643,"qdb_cluster":[5643]},"id":4}]} 2024-09-21T03:21:01.575 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 32 2024-09-21T03:21:01.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.575+0000 7f9bfb7ad640 1 -- 172.21.15.105:0/2835219206 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9bd8078bc0 msgr2=0x7f9bd807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:01.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.575+0000 7f9bfb7ad640 1 --2- 172.21.15.105:0/2835219206 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9bd8078bc0 0x7f9bd807b0d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0033000 tx=0x7f9bf002d000 comp rx=0 tx=0).stop 2024-09-21T03:21:01.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.575+0000 7f9bfb7ad640 1 -- 172.21.15.105:0/2835219206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9bf4141580 msgr2=0x7f9bf4141990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:01.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.575+0000 7f9bfb7ad640 1 --2- 172.21.15.105:0/2835219206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9bf4141580 0x7f9bf4141990 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4070de0 tx=0x7f9bec00fd90 comp rx=0 tx=0).stop 2024-09-21T03:21:01.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.575+0000 7f9bfb7ad640 1 -- 172.21.15.105:0/2835219206 shutdown_connections 2024-09-21T03:21:01.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.575+0000 7f9bfb7ad640 1 --2- 172.21.15.105:0/2835219206 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9bd8078bc0 0x7f9bd807b0d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:01.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.575+0000 7f9bfb7ad640 1 --2- 172.21.15.105:0/2835219206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9bf4141580 0x7f9bf4141990 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:01.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.575+0000 7f9bfb7ad640 1 --2- 172.21.15.105:0/2835219206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bf41e6aa0 0x7f9bf4143610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:01.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.575+0000 7f9bfb7ad640 1 --2- 172.21.15.105:0/2835219206 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9be0003a80 0x7f9bf41e44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:01.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.575+0000 7f9bfb7ad640 1 -- 172.21.15.105:0/2835219206 >> 172.21.15.105:0/2835219206 conn(0x7f9bf40b1cb0 msgr2=0x7f9bf40b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:01.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.575+0000 7f9bfb7ad640 1 -- 172.21.15.105:0/2835219206 shutdown_connections 2024-09-21T03:21:01.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.575+0000 7f9bfb7ad640 1 -- 172.21.15.105:0/2835219206 wait complete. 2024-09-21T03:21:01.588 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:21:01.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.699+0000 7f9e22ca9640 1 -- 172.21.15.105:0/593966118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e1c15d670 msgr2=0x7f9e1c0b7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:01.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.699+0000 7f9e22ca9640 1 --2- 172.21.15.105:0/593966118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e1c15d670 0x7f9e1c0b7490 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c0d2fa0 tx=0x7f9e1402aa30 comp rx=0 tx=0).stop 2024-09-21T03:21:01.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.699+0000 7f9e22ca9640 1 -- 172.21.15.105:0/593966118 shutdown_connections 2024-09-21T03:21:01.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.699+0000 7f9e22ca9640 1 --2- 172.21.15.105:0/593966118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e1c15d670 0x7f9e1c0b7490 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:01.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.699+0000 7f9e22ca9640 1 --2- 172.21.15.105:0/593966118 >> v2:172.21.15.162:3300/0 conn(0x7f9e1c0d2460 0x7f9e1c15d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:01.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.699+0000 7f9e22ca9640 1 --2- 172.21.15.105:0/593966118 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e1c1570e0 0x7f9e1c0d1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:01.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.699+0000 7f9e22ca9640 1 -- 172.21.15.105:0/593966118 >> 172.21.15.105:0/593966118 conn(0x7f9e1c06d550 msgr2=0x7f9e1c071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:01.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.699+0000 7f9e22ca9640 1 -- 172.21.15.105:0/593966118 shutdown_connections 2024-09-21T03:21:01.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.699+0000 7f9e22ca9640 1 -- 172.21.15.105:0/593966118 wait complete. 2024-09-21T03:21:01.702 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.701+0000 7f9e22ca9640 1 Processor -- start 2024-09-21T03:21:01.702 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.701+0000 7f9e22ca9640 1 -- start start 2024-09-21T03:21:01.705 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.702+0000 7f9e22ca9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e1c0d2460 0x7f9e1c15c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:01.705 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.702+0000 7f9e22ca9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e1c1570e0 0x7f9e1c146b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:01.705 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.702+0000 7f9e22ca9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e1c15d670 0x7f9e1c1470b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:01.705 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.702+0000 7f9e22ca9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9e1c0b7b50 con 0x7f9e1c0d2460 2024-09-21T03:21:01.705 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.702+0000 7f9e22ca9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9e1c0b79d0 con 0x7f9e1c1570e0 2024-09-21T03:21:01.705 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.702+0000 7f9e22ca9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9e1c0b7cd0 con 0x7f9e1c15d670 2024-09-21T03:21:01.705 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.702+0000 7f9e20a45640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e1c0d2460 0x7f9e1c15c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:01.705 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.702+0000 7f9e20a45640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e1c0d2460 0x7f9e1c15c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:47116/0 (socket says 172.21.15.105:47116) 2024-09-21T03:21:01.705 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.702+0000 7f9e20a45640 1 -- 172.21.15.105:0/828603599 learned_addr learned my addr 172.21.15.105:0/828603599 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:01.705 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.702+0000 7f9e13fff640 1 --2- 172.21.15.105:0/828603599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e1c1570e0 0x7f9e1c146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:01.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.702+0000 7f9e21246640 1 --2- 172.21.15.105:0/828603599 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e1c15d670 0x7f9e1c1470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:01.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.702+0000 7f9e20a45640 1 -- 172.21.15.105:0/828603599 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e1c15d670 msgr2=0x7f9e1c1470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:01.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.702+0000 7f9e20a45640 1 --2- 172.21.15.105:0/828603599 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e1c15d670 0x7f9e1c1470b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:01.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.703+0000 7f9e20a45640 1 -- 172.21.15.105:0/828603599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e1c1570e0 msgr2=0x7f9e1c146b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:01.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.703+0000 7f9e20a45640 1 --2- 172.21.15.105:0/828603599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e1c1570e0 0x7f9e1c146b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:01.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.703+0000 7f9e20a45640 1 -- 172.21.15.105:0/828603599 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e1c158120 con 0x7f9e1c0d2460 2024-09-21T03:21:01.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.703+0000 7f9e20a45640 1 --2- 172.21.15.105:0/828603599 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e1c0d2460 0x7f9e1c15c600 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f9e1800d700 tx=0x7f9e1800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:01.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.703+0000 7f9e117fa640 1 -- 172.21.15.105:0/828603599 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e18017070 con 0x7f9e1c0d2460 2024-09-21T03:21:01.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.703+0000 7f9e117fa640 1 -- 172.21.15.105:0/828603599 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e18005310 con 0x7f9e1c0d2460 2024-09-21T03:21:01.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.703+0000 7f9e117fa640 1 -- 172.21.15.105:0/828603599 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e18009820 con 0x7f9e1c0d2460 2024-09-21T03:21:01.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.703+0000 7f9e22ca9640 1 -- 172.21.15.105:0/828603599 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e1c0cb730 con 0x7f9e1c0d2460 2024-09-21T03:21:01.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.703+0000 7f9e22ca9640 1 -- 172.21.15.105:0/828603599 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e1c147ae0 con 0x7f9e1c0d2460 2024-09-21T03:21:01.707 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.704+0000 7f9e22ca9640 1 -- 172.21.15.105:0/828603599 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e1c0694e0 con 0x7f9e1c0d2460 2024-09-21T03:21:01.707 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.705+0000 7f9e117fa640 1 -- 172.21.15.105:0/828603599 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9e180099c0 con 0x7f9e1c0d2460 2024-09-21T03:21:01.707 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.705+0000 7f9e117fa640 1 --2- 172.21.15.105:0/828603599 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9e08078bc0 0x7f9e0807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:01.707 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.705+0000 7f9e117fa640 1 -- 172.21.15.105:0/828603599 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f9e1809adc0 con 0x7f9e1c0d2460 2024-09-21T03:21:01.707 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.705+0000 7f9e13fff640 1 --2- 172.21.15.105:0/828603599 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9e08078bc0 0x7f9e0807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:01.708 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.706+0000 7f9e13fff640 1 --2- 172.21.15.105:0/828603599 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9e08078bc0 0x7f9e0807b0d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c0d1ed0 tx=0x7f9e0c005d70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:01.711 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.710+0000 7f9e117fa640 1 -- 172.21.15.105:0/828603599 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9e1c0694e0 con 0x7f9e1c0d2460 2024-09-21T03:21:01.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.923+0000 7f9e22ca9640 1 -- 172.21.15.105:0/828603599 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e1c0d1f20 con 0x7f9e1c0d2460 2024-09-21T03:21:01.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.923+0000 7f9e117fa640 1 -- 172.21.15.105:0/828603599 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+5232 (secure 0 0 0) 0x7f9e18063290 con 0x7f9e1c0d2460 2024-09-21T03:21:01.925 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:01.925 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":32,"btime":"2024-09-21T03:20:54:138507+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5099,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3633306312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3633306312},{"type":"v1","addr":"172.21.15.162:6836","nonce":3633306312}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5356,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3748267738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3748267738},{"type":"v1","addr":"172.21.15.162:6837","nonce":3748267738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/431670561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":431670561},{"type":"v1","addr":"172.21.15.105:6833","nonce":431670561}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:20:50.482111+0000","modified":"2024-09-21T03:20:53.504519+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5643":{"gid":5643,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1075697245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1075697245},{"type":"v1","addr":"172.21.15.105:6835","nonce":1075697245}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5643,"qdb_cluster":[5643]},"id":4}]} 2024-09-21T03:21:01.926 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 32 2024-09-21T03:21:01.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.926+0000 7f9e22ca9640 1 -- 172.21.15.105:0/828603599 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9e08078bc0 msgr2=0x7f9e0807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:01.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.926+0000 7f9e22ca9640 1 --2- 172.21.15.105:0/828603599 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9e08078bc0 0x7f9e0807b0d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c0d1ed0 tx=0x7f9e0c005d70 comp rx=0 tx=0).stop 2024-09-21T03:21:01.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.926+0000 7f9e22ca9640 1 -- 172.21.15.105:0/828603599 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e1c0d2460 msgr2=0x7f9e1c15c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:01.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.926+0000 7f9e22ca9640 1 --2- 172.21.15.105:0/828603599 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e1c0d2460 0x7f9e1c15c600 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f9e1800d700 tx=0x7f9e1800dbc0 comp rx=0 tx=0).stop 2024-09-21T03:21:01.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.926+0000 7f9e22ca9640 1 -- 172.21.15.105:0/828603599 shutdown_connections 2024-09-21T03:21:01.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.926+0000 7f9e22ca9640 1 --2- 172.21.15.105:0/828603599 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9e08078bc0 0x7f9e0807b0d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:01.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.926+0000 7f9e22ca9640 1 --2- 172.21.15.105:0/828603599 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e1c15d670 0x7f9e1c1470b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:01.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.926+0000 7f9e22ca9640 1 --2- 172.21.15.105:0/828603599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e1c1570e0 0x7f9e1c146b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:01.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.926+0000 7f9e22ca9640 1 --2- 172.21.15.105:0/828603599 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e1c0d2460 0x7f9e1c15c600 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:01.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.926+0000 7f9e22ca9640 1 -- 172.21.15.105:0/828603599 >> 172.21.15.105:0/828603599 conn(0x7f9e1c06d550 msgr2=0x7f9e1c0b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:01.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.926+0000 7f9e22ca9640 1 -- 172.21.15.105:0/828603599 shutdown_connections 2024-09-21T03:21:01.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:01.926+0000 7f9e22ca9640 1 -- 172.21.15.105:0/828603599 wait complete. 2024-09-21T03:21:01.939 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:21:02.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.050+0000 7fe8591f1640 1 -- 172.21.15.105:0/2434976231 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe854144270 msgr2=0x7fe8540b5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:02.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.050+0000 7fe8591f1640 1 --2- 172.21.15.105:0/2434976231 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe854144270 0x7fe8540b5680 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fe844009830 tx=0x7fe84402a510 comp rx=0 tx=0).stop 2024-09-21T03:21:02.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.050+0000 7fe8591f1640 1 -- 172.21.15.105:0/2434976231 shutdown_connections 2024-09-21T03:21:02.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.050+0000 7fe8591f1640 1 --2- 172.21.15.105:0/2434976231 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe854144270 0x7fe8540b5680 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:02.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.050+0000 7fe8591f1640 1 -- 172.21.15.105:0/2434976231 >> 172.21.15.105:0/2434976231 conn(0x7fe8540d15f0 msgr2=0x7fe854073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:02.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.050+0000 7fe8591f1640 1 -- 172.21.15.105:0/2434976231 shutdown_connections 2024-09-21T03:21:02.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.050+0000 7fe8591f1640 1 -- 172.21.15.105:0/2434976231 wait complete. 2024-09-21T03:21:02.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.052+0000 7fe8591f1640 1 Processor -- start 2024-09-21T03:21:02.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.052+0000 7fe8591f1640 1 -- start start 2024-09-21T03:21:02.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.053+0000 7fe8591f1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe854142270 0x7fe854159d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:02.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.053+0000 7fe8591f1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe854144270 0x7fe85415e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:02.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.053+0000 7fe8591f1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe85415e790 0x7fe854140fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:02.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.053+0000 7fe8591f1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe8540b5da0 con 0x7fe854142270 2024-09-21T03:21:02.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.053+0000 7fe8591f1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe854142890 con 0x7fe85415e790 2024-09-21T03:21:02.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.053+0000 7fe8591f1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe8540d0570 con 0x7fe854144270 2024-09-21T03:21:02.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.053+0000 7fe852d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe854142270 0x7fe854159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:02.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.053+0000 7fe852d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe854142270 0x7fe854159d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:47124/0 (socket says 172.21.15.105:47124) 2024-09-21T03:21:02.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.053+0000 7fe852d9d640 1 -- 172.21.15.105:0/633908599 learned_addr learned my addr 172.21.15.105:0/633908599 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:02.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.053+0000 7fe852d9d640 1 -- 172.21.15.105:0/633908599 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe854144270 msgr2=0x7fe85415e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:02.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.053+0000 7fe852d9d640 1 --2- 172.21.15.105:0/633908599 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe854144270 0x7fe85415e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:02.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.053+0000 7fe85359e640 1 --2- 172.21.15.105:0/633908599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe85415e790 0x7fe854140fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:02.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.053+0000 7fe852d9d640 1 -- 172.21.15.105:0/633908599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe85415e790 msgr2=0x7fe854140fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:02.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.053+0000 7fe852d9d640 1 --2- 172.21.15.105:0/633908599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe85415e790 0x7fe854140fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:02.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.053+0000 7fe852d9d640 1 -- 172.21.15.105:0/633908599 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe85415eba0 con 0x7fe854142270 2024-09-21T03:21:02.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.054+0000 7fe852d9d640 1 --2- 172.21.15.105:0/633908599 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe854142270 0x7fe854159d70 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe844009950 tx=0x7fe844033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:02.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.054+0000 7fe83b7fe640 1 -- 172.21.15.105:0/633908599 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe844031d60 con 0x7fe854142270 2024-09-21T03:21:02.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.054+0000 7fe83b7fe640 1 -- 172.21.15.105:0/633908599 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe844033e10 con 0x7fe854142270 2024-09-21T03:21:02.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.054+0000 7fe8591f1640 1 -- 172.21.15.105:0/633908599 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8541f3370 con 0x7fe854142270 2024-09-21T03:21:02.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.054+0000 7fe83b7fe640 1 -- 172.21.15.105:0/633908599 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe844005260 con 0x7fe854142270 2024-09-21T03:21:02.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.054+0000 7fe8591f1640 1 -- 172.21.15.105:0/633908599 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8541f3930 con 0x7fe854142270 2024-09-21T03:21:02.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.055+0000 7fe8591f1640 1 -- 172.21.15.105:0/633908599 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8540b5680 con 0x7fe854142270 2024-09-21T03:21:02.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.056+0000 7fe83b7fe640 1 -- 172.21.15.105:0/633908599 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe844005400 con 0x7fe854142270 2024-09-21T03:21:02.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.056+0000 7fe83b7fe640 1 --2- 172.21.15.105:0/633908599 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe840078b90 0x7fe84007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:02.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.056+0000 7fe83b7fe640 1 -- 172.21.15.105:0/633908599 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fe8440bbf40 con 0x7fe854142270 2024-09-21T03:21:02.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.057+0000 7fe85259c640 1 --2- 172.21.15.105:0/633908599 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe840078b90 0x7fe84007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:02.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.057+0000 7fe85259c640 1 --2- 172.21.15.105:0/633908599 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe840078b90 0x7fe84007b0a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe854144e50 tx=0x7fe848007930 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:02.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.061+0000 7fe83b7fe640 1 -- 172.21.15.105:0/633908599 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe85415eba0 con 0x7fe854142270 2024-09-21T03:21:02.242 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.241+0000 7fe8591f1640 1 -- 172.21.15.105:0/633908599 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe8540cd2b0 con 0x7fe854142270 2024-09-21T03:21:02.243 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.242+0000 7fe83b7fe640 1 -- 172.21.15.105:0/633908599 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+16797 (secure 0 0 0) 0x7fe84403f030 con 0x7fe854142270 2024-09-21T03:21:02.243 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:02.244 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":57,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:20:52.125692+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:20:48.140896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-21T03:20:49.449787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:21:02.246 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.244+0000 7fe8591f1640 1 -- 172.21.15.105:0/633908599 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe840078b90 msgr2=0x7fe84007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:02.246 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.244+0000 7fe8591f1640 1 --2- 172.21.15.105:0/633908599 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe840078b90 0x7fe84007b0a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe854144e50 tx=0x7fe848007930 comp rx=0 tx=0).stop 2024-09-21T03:21:02.246 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.244+0000 7fe8591f1640 1 -- 172.21.15.105:0/633908599 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe854142270 msgr2=0x7fe854159d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:02.246 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.244+0000 7fe8591f1640 1 --2- 172.21.15.105:0/633908599 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe854142270 0x7fe854159d70 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe844009950 tx=0x7fe844033c20 comp rx=0 tx=0).stop 2024-09-21T03:21:02.246 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.244+0000 7fe8591f1640 1 -- 172.21.15.105:0/633908599 shutdown_connections 2024-09-21T03:21:02.246 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.244+0000 7fe8591f1640 1 --2- 172.21.15.105:0/633908599 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe840078b90 0x7fe84007b0a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:02.246 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.244+0000 7fe8591f1640 1 --2- 172.21.15.105:0/633908599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe85415e790 0x7fe854140fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:02.246 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.244+0000 7fe8591f1640 1 --2- 172.21.15.105:0/633908599 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe854144270 0x7fe85415e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:02.246 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.244+0000 7fe8591f1640 1 --2- 172.21.15.105:0/633908599 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe854142270 0x7fe854159d70 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:02.247 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.244+0000 7fe8591f1640 1 -- 172.21.15.105:0/633908599 >> 172.21.15.105:0/633908599 conn(0x7fe8540d15f0 msgr2=0x7fe8540705c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:02.247 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.244+0000 7fe8591f1640 1 -- 172.21.15.105:0/633908599 shutdown_connections 2024-09-21T03:21:02.247 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.244+0000 7fe8591f1640 1 -- 172.21.15.105:0/633908599 wait complete. 2024-09-21T03:21:02.257 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T03:21:02.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.368+0000 7f2df1c63640 1 -- 172.21.15.105:0/3982702252 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2dec0b7fe0 msgr2=0x7f2dec0ced30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:02.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.368+0000 7f2df1c63640 1 --2- 172.21.15.105:0/3982702252 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2dec0b7fe0 0x7f2dec0ced30 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f2dec0747a0 tx=0x7f2de002a560 comp rx=0 tx=0).stop 2024-09-21T03:21:02.371 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.368+0000 7f2df1c63640 1 -- 172.21.15.105:0/3982702252 shutdown_connections 2024-09-21T03:21:02.371 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.368+0000 7f2df1c63640 1 --2- 172.21.15.105:0/3982702252 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2dec0b7fe0 0x7f2dec0ced30 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:02.371 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.368+0000 7f2df1c63640 1 --2- 172.21.15.105:0/3982702252 >> v2:172.21.15.162:3300/0 conn(0x7f2dec0cd360 0x7f2dec15c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:02.371 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.368+0000 7f2df1c63640 1 -- 172.21.15.105:0/3982702252 >> 172.21.15.105:0/3982702252 conn(0x7f2dec0710b0 msgr2=0x7f2dec0714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:02.371 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.368+0000 7f2df1c63640 1 -- 172.21.15.105:0/3982702252 shutdown_connections 2024-09-21T03:21:02.371 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.368+0000 7f2df1c63640 1 -- 172.21.15.105:0/3982702252 wait complete. 2024-09-21T03:21:02.371 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.370+0000 7f2df1c63640 1 Processor -- start 2024-09-21T03:21:02.372 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.370+0000 7f2df1c63640 1 -- start start 2024-09-21T03:21:02.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.371+0000 7f2df1c63640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2dec0b7fe0 0x7f2dec0a94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:02.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.371+0000 7f2df1c63640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2dec0cd360 0x7f2dec14b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:02.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.371+0000 7f2df1c63640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2dec0cf270 0x7f2dec1f6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:02.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.372+0000 7f2df1c63640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2dec072f60 con 0x7f2dec0b7fe0 2024-09-21T03:21:02.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.372+0000 7f2df1c63640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2dec0d13b0 con 0x7f2dec0cd360 2024-09-21T03:21:02.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.372+0000 7f2df1c63640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2dec0730e0 con 0x7f2dec0cf270 2024-09-21T03:21:02.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.372+0000 7f2deb7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2dec0b7fe0 0x7f2dec0a94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:02.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.372+0000 7f2deb7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2dec0b7fe0 0x7f2dec0a94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:47136/0 (socket says 172.21.15.105:47136) 2024-09-21T03:21:02.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.372+0000 7f2deb7fe640 1 -- 172.21.15.105:0/2233613131 learned_addr learned my addr 172.21.15.105:0/2233613131 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:02.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.372+0000 7f2deaffd640 1 --2- 172.21.15.105:0/2233613131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2dec0cd360 0x7f2dec14b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:02.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.372+0000 7f2debfff640 1 --2- 172.21.15.105:0/2233613131 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2dec0cf270 0x7f2dec1f6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:02.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.372+0000 7f2deb7fe640 1 -- 172.21.15.105:0/2233613131 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2dec0cf270 msgr2=0x7f2dec1f6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:02.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.372+0000 7f2deb7fe640 1 --2- 172.21.15.105:0/2233613131 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2dec0cf270 0x7f2dec1f6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:02.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.372+0000 7f2deb7fe640 1 -- 172.21.15.105:0/2233613131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2dec0cd360 msgr2=0x7f2dec14b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:02.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.372+0000 7f2deb7fe640 1 --2- 172.21.15.105:0/2233613131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2dec0cd360 0x7f2dec14b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:02.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.372+0000 7f2deb7fe640 1 -- 172.21.15.105:0/2233613131 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dec0a99e0 con 0x7f2dec0b7fe0 2024-09-21T03:21:02.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.372+0000 7f2deb7fe640 1 --2- 172.21.15.105:0/2233613131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2dec0b7fe0 0x7f2dec0a94a0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc00d740 tx=0x7f2ddc00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:02.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.372+0000 7f2dd3fff640 1 -- 172.21.15.105:0/2233613131 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc017070 con 0x7f2dec0b7fe0 2024-09-21T03:21:02.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.372+0000 7f2dd3fff640 1 -- 172.21.15.105:0/2233613131 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ddc009d20 con 0x7f2dec0b7fe0 2024-09-21T03:21:02.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.372+0000 7f2dd3fff640 1 -- 172.21.15.105:0/2233613131 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc0106c0 con 0x7f2dec0b7fe0 2024-09-21T03:21:02.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.372+0000 7f2df1c63640 1 -- 172.21.15.105:0/2233613131 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dec0cacb0 con 0x7f2dec0b7fe0 2024-09-21T03:21:02.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.373+0000 7f2df1c63640 1 -- 172.21.15.105:0/2233613131 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dec0cb270 con 0x7f2dec0b7fe0 2024-09-21T03:21:02.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.374+0000 7f2df1c63640 1 -- 172.21.15.105:0/2233613131 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dec06a5e0 con 0x7f2dec0b7fe0 2024-09-21T03:21:02.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.374+0000 7f2dd3fff640 1 -- 172.21.15.105:0/2233613131 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2ddc01a070 con 0x7f2dec0b7fe0 2024-09-21T03:21:02.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.375+0000 7f2dd3fff640 1 --2- 172.21.15.105:0/2233613131 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2dd8078bc0 0x7f2dd807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:02.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.375+0000 7f2dd3fff640 1 -- 172.21.15.105:0/2233613131 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f2ddc09add0 con 0x7f2dec0b7fe0 2024-09-21T03:21:02.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.375+0000 7f2deaffd640 1 --2- 172.21.15.105:0/2233613131 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2dd8078bc0 0x7f2dd807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:02.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.376+0000 7f2deaffd640 1 --2- 172.21.15.105:0/2233613131 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2dd8078bc0 0x7f2dd807b0d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2de0033000 tx=0x7f2de0004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:02.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.380+0000 7f2dd3fff640 1 -- 172.21.15.105:0/2233613131 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2dec06a5e0 con 0x7f2dec0b7fe0 2024-09-21T03:21:02.591 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.590+0000 7f2df1c63640 1 -- 172.21.15.105:0/2233613131 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f2dec073600 con 0x7f2dec0b7fe0 2024-09-21T03:21:02.592 INFO:tasks.ceph.mon.a.smithi105.stderr:2024-09-21T03:21:02.591+0000 7f25819ea640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T03:21:02.596 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.594+0000 7f2dd3fff640 1 -- 172.21.15.105:0/2233613131 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) ==== 161+0+0 (secure 0 0 0) 0x7f2ddc062bc0 con 0x7f2dec0b7fe0 2024-09-21T03:21:02.596 INFO:teuthology.orchestra.run.smithi105.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T03:21:02.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.597+0000 7f2df1c63640 1 -- 172.21.15.105:0/2233613131 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2dd8078bc0 msgr2=0x7f2dd807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:02.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.597+0000 7f2df1c63640 1 --2- 172.21.15.105:0/2233613131 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2dd8078bc0 0x7f2dd807b0d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2de0033000 tx=0x7f2de0004730 comp rx=0 tx=0).stop 2024-09-21T03:21:02.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.597+0000 7f2df1c63640 1 -- 172.21.15.105:0/2233613131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2dec0b7fe0 msgr2=0x7f2dec0a94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:02.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.597+0000 7f2df1c63640 1 --2- 172.21.15.105:0/2233613131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2dec0b7fe0 0x7f2dec0a94a0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc00d740 tx=0x7f2ddc00dc00 comp rx=0 tx=0).stop 2024-09-21T03:21:02.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.597+0000 7f2df1c63640 1 -- 172.21.15.105:0/2233613131 shutdown_connections 2024-09-21T03:21:02.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.597+0000 7f2df1c63640 1 --2- 172.21.15.105:0/2233613131 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2dd8078bc0 0x7f2dd807b0d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:02.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.597+0000 7f2df1c63640 1 --2- 172.21.15.105:0/2233613131 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2dec0cf270 0x7f2dec1f6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:02.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.597+0000 7f2df1c63640 1 --2- 172.21.15.105:0/2233613131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2dec0cd360 0x7f2dec14b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:02.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.597+0000 7f2df1c63640 1 --2- 172.21.15.105:0/2233613131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2dec0b7fe0 0x7f2dec0a94a0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:02.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.597+0000 7f2df1c63640 1 -- 172.21.15.105:0/2233613131 >> 172.21.15.105:0/2233613131 conn(0x7f2dec0710b0 msgr2=0x7f2dec0b7050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:02.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.598+0000 7f2df1c63640 1 -- 172.21.15.105:0/2233613131 shutdown_connections 2024-09-21T03:21:02.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.598+0000 7f2df1c63640 1 -- 172.21.15.105:0/2233613131 wait complete. 2024-09-21T03:21:02.601 INFO:tasks.ceph.mds.c.smithi105.stderr: -1963> 2024-09-21T03:20:56.453+0000 7f7fd3097640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T03:21:02.611 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T03:21:02.652 INFO:tasks.ceph.mds.c.smithi105.stdout:starting mds.c at 2024-09-21T03:21:02.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.726+0000 7f72b5ff1640 1 -- 172.21.15.105:0/3837232863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72b00b9b60 msgr2=0x7f72b00d4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:02.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.726+0000 7f72b5ff1640 1 --2- 172.21.15.105:0/3837232863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72b00b9b60 0x7f72b00d4d80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f72a0009820 tx=0x7f72a002a380 comp rx=0 tx=0).stop 2024-09-21T03:21:02.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.726+0000 7f72b5ff1640 1 -- 172.21.15.105:0/3837232863 shutdown_connections 2024-09-21T03:21:02.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.726+0000 7f72b5ff1640 1 --2- 172.21.15.105:0/3837232863 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f72b00b66b0 0x7f72b006eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:02.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.726+0000 7f72b5ff1640 1 --2- 172.21.15.105:0/3837232863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72b00b9b60 0x7f72b00d4d80 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:02.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.726+0000 7f72b5ff1640 1 -- 172.21.15.105:0/3837232863 >> 172.21.15.105:0/3837232863 conn(0x7f72b009d7f0 msgr2=0x7f72b00d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:02.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.726+0000 7f72b5ff1640 1 -- 172.21.15.105:0/3837232863 shutdown_connections 2024-09-21T03:21:02.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.726+0000 7f72b5ff1640 1 -- 172.21.15.105:0/3837232863 wait complete. 2024-09-21T03:21:02.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.728+0000 7f72b5ff1640 1 Processor -- start 2024-09-21T03:21:02.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.728+0000 7f72b5ff1640 1 -- start start 2024-09-21T03:21:02.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.729+0000 7f72b5ff1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72b00b9b60 0x7f72b0150a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:02.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.729+0000 7f72b5ff1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72b00cf540 0x7f72b01f8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:02.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.729+0000 7f72b5ff1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f72b015f0e0 0x7f72b01f9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:02.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.729+0000 7f72b5ff1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f72b006f5e0 con 0x7f72b00b9b60 2024-09-21T03:21:02.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.729+0000 7f72b5ff1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f72b006f460 con 0x7f72b00cf540 2024-09-21T03:21:02.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.729+0000 7f72b5ff1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f72b006f760 con 0x7f72b015f0e0 2024-09-21T03:21:02.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.729+0000 7f72af7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72b00b9b60 0x7f72b0150a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:02.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.729+0000 7f72af7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72b00b9b60 0x7f72b0150a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:47176/0 (socket says 172.21.15.105:47176) 2024-09-21T03:21:02.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.729+0000 7f72af7fe640 1 -- 172.21.15.105:0/999784452 learned_addr learned my addr 172.21.15.105:0/999784452 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:02.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.729+0000 7f72aeffd640 1 --2- 172.21.15.105:0/999784452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72b00cf540 0x7f72b01f8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:02.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.729+0000 7f72affff640 1 --2- 172.21.15.105:0/999784452 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f72b015f0e0 0x7f72b01f9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:02.733 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.729+0000 7f72af7fe640 1 -- 172.21.15.105:0/999784452 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f72b015f0e0 msgr2=0x7f72b01f9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:02.733 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.729+0000 7f72af7fe640 1 --2- 172.21.15.105:0/999784452 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f72b015f0e0 0x7f72b01f9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:02.733 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.729+0000 7f72af7fe640 1 -- 172.21.15.105:0/999784452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72b00cf540 msgr2=0x7f72b01f8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:02.733 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.729+0000 7f72af7fe640 1 --2- 172.21.15.105:0/999784452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72b00cf540 0x7f72b01f8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:02.733 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.729+0000 7f72af7fe640 1 -- 172.21.15.105:0/999784452 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b0150fc0 con 0x7f72b00b9b60 2024-09-21T03:21:02.733 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.729+0000 7f72aeffd640 1 --2- 172.21.15.105:0/999784452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72b00cf540 0x7f72b01f8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:21:02.733 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.730+0000 7f72af7fe640 1 --2- 172.21.15.105:0/999784452 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72b00b9b60 0x7f72b0150a80 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f72a0009940 tx=0x7f72a0004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:02.733 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.730+0000 7f7297fff640 1 -- 172.21.15.105:0/999784452 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a0037040 con 0x7f72b00b9b60 2024-09-21T03:21:02.733 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.730+0000 7f7297fff640 1 -- 172.21.15.105:0/999784452 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f72a0040070 con 0x7f72b00b9b60 2024-09-21T03:21:02.733 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.730+0000 7f72b5ff1640 1 -- 172.21.15.105:0/999784452 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72b01e9b90 con 0x7f72b00b9b60 2024-09-21T03:21:02.733 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.730+0000 7f7297fff640 1 -- 172.21.15.105:0/999784452 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a0005c30 con 0x7f72b00b9b60 2024-09-21T03:21:02.733 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.730+0000 7f72b5ff1640 1 -- 172.21.15.105:0/999784452 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72b00cccf0 con 0x7f72b00b9b60 2024-09-21T03:21:02.734 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.731+0000 7f72b5ff1640 1 -- 172.21.15.105:0/999784452 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72b006fc80 con 0x7f72b00b9b60 2024-09-21T03:21:02.734 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.731+0000 7f7297fff640 1 -- 172.21.15.105:0/999784452 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f72a00042b0 con 0x7f72b00b9b60 2024-09-21T03:21:02.734 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.732+0000 7f7297fff640 1 --2- 172.21.15.105:0/999784452 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f729c078b90 0x7f729c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:02.735 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.732+0000 7f7297fff640 1 -- 172.21.15.105:0/999784452 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5795+0+0 (secure 0 0 0) 0x7f72a00bafd0 con 0x7f72b00b9b60 2024-09-21T03:21:02.735 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.732+0000 7f72aeffd640 1 --2- 172.21.15.105:0/999784452 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f729c078b90 0x7f729c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:02.735 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.733+0000 7f72aeffd640 1 --2- 172.21.15.105:0/999784452 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f729c078b90 0x7f729c07b0a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f72b0154710 tx=0x7f72a4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:02.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.737+0000 7f7297fff640 1 -- 172.21.15.105:0/999784452 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f72a00833c0 con 0x7f72b00b9b60 2024-09-21T03:21:02.951 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:02.950+0000 7f72b5ff1640 1 -- 172.21.15.105:0/999784452 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f72b00d3fb0 con 0x7f72b00b9b60 2024-09-21T03:21:03.601 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.597+0000 7f7297fff640 1 -- 172.21.15.105:0/999784452 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v34) ==== 104+0+0 (secure 0 0 0) 0x7f72a0082cc0 con 0x7f72b00b9b60 2024-09-21T03:21:03.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.601+0000 7f72b5ff1640 1 -- 172.21.15.105:0/999784452 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f729c078b90 msgr2=0x7f729c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:03.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.601+0000 7f72b5ff1640 1 --2- 172.21.15.105:0/999784452 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f729c078b90 0x7f729c07b0a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f72b0154710 tx=0x7f72a4009040 comp rx=0 tx=0).stop 2024-09-21T03:21:03.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.601+0000 7f72b5ff1640 1 -- 172.21.15.105:0/999784452 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72b00b9b60 msgr2=0x7f72b0150a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:03.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.601+0000 7f72b5ff1640 1 --2- 172.21.15.105:0/999784452 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72b00b9b60 0x7f72b0150a80 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f72a0009940 tx=0x7f72a0004a50 comp rx=0 tx=0).stop 2024-09-21T03:21:03.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.601+0000 7f72b5ff1640 1 -- 172.21.15.105:0/999784452 shutdown_connections 2024-09-21T03:21:03.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.601+0000 7f72b5ff1640 1 --2- 172.21.15.105:0/999784452 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f729c078b90 0x7f729c07b0a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:03.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.601+0000 7f72b5ff1640 1 --2- 172.21.15.105:0/999784452 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f72b015f0e0 0x7f72b01f9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:03.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.601+0000 7f72b5ff1640 1 --2- 172.21.15.105:0/999784452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72b00cf540 0x7f72b01f8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:03.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.601+0000 7f72b5ff1640 1 --2- 172.21.15.105:0/999784452 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72b00b9b60 0x7f72b0150a80 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:03.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.601+0000 7f72b5ff1640 1 -- 172.21.15.105:0/999784452 >> 172.21.15.105:0/999784452 conn(0x7f72b009d7f0 msgr2=0x7f72b00d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:03.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.601+0000 7f72b5ff1640 1 -- 172.21.15.105:0/999784452 shutdown_connections 2024-09-21T03:21:03.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.601+0000 7f72b5ff1640 1 -- 172.21.15.105:0/999784452 wait complete. 2024-09-21T03:21:03.616 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T03:21:03.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.776+0000 7f3b781ba640 1 -- 172.21.15.105:0/2001685560 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b700d0ef0 msgr2=0x7f3b700d1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:03.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.776+0000 7f3b781ba640 1 --2- 172.21.15.105:0/2001685560 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b700d0ef0 0x7f3b700d1300 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3b68005fd0 tx=0x7f3b6802a820 comp rx=0 tx=0).stop 2024-09-21T03:21:03.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.776+0000 7f3b781ba640 1 -- 172.21.15.105:0/2001685560 shutdown_connections 2024-09-21T03:21:03.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.776+0000 7f3b781ba640 1 --2- 172.21.15.105:0/2001685560 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b700cf540 0x7f3b7015e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:03.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.776+0000 7f3b781ba640 1 --2- 172.21.15.105:0/2001685560 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b700d0ef0 0x7f3b700d1300 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:03.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.776+0000 7f3b781ba640 1 -- 172.21.15.105:0/2001685560 >> 172.21.15.105:0/2001685560 conn(0x7f3b7008dc50 msgr2=0x7f3b7009d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:03.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.776+0000 7f3b781ba640 1 -- 172.21.15.105:0/2001685560 shutdown_connections 2024-09-21T03:21:03.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.776+0000 7f3b781ba640 1 -- 172.21.15.105:0/2001685560 wait complete. 2024-09-21T03:21:03.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.778+0000 7f3b781ba640 1 Processor -- start 2024-09-21T03:21:03.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.778+0000 7f3b781ba640 1 -- start start 2024-09-21T03:21:03.782 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.779+0000 7f3b781ba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b7006fa70 0x7f3b7015a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:03.782 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.779+0000 7f3b781ba640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b700cf540 0x7f3b700cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:03.782 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.779+0000 7f3b781ba640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b700d0ef0 0x7f3b700cbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:03.782 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.779+0000 7f3b781ba640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3b70162b20 con 0x7f3b700cf540 2024-09-21T03:21:03.782 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.779+0000 7f3b781ba640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3b701629a0 con 0x7f3b7006fa70 2024-09-21T03:21:03.782 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.779+0000 7f3b781ba640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3b70162ca0 con 0x7f3b700d0ef0 2024-09-21T03:21:03.782 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.779+0000 7f3b75755640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b700cf540 0x7f3b700cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:03.782 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.779+0000 7f3b75755640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b700cf540 0x7f3b700cb5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:47188/0 (socket says 172.21.15.105:47188) 2024-09-21T03:21:03.782 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.779+0000 7f3b75755640 1 -- 172.21.15.105:0/2545384397 learned_addr learned my addr 172.21.15.105:0/2545384397 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:03.782 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.779+0000 7f3b76757640 1 --2- 172.21.15.105:0/2545384397 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b700d0ef0 0x7f3b700cbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:03.782 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.779+0000 7f3b75f56640 1 --2- 172.21.15.105:0/2545384397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b7006fa70 0x7f3b7015a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:03.782 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.779+0000 7f3b75755640 1 -- 172.21.15.105:0/2545384397 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b700d0ef0 msgr2=0x7f3b700cbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:03.782 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.779+0000 7f3b75755640 1 --2- 172.21.15.105:0/2545384397 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b700d0ef0 0x7f3b700cbaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:03.783 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.779+0000 7f3b75755640 1 -- 172.21.15.105:0/2545384397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b7006fa70 msgr2=0x7f3b7015a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:03.783 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.779+0000 7f3b75755640 1 --2- 172.21.15.105:0/2545384397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b7006fa70 0x7f3b7015a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:03.783 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.779+0000 7f3b75755640 1 -- 172.21.15.105:0/2545384397 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b7015a840 con 0x7f3b700cf540 2024-09-21T03:21:03.783 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.780+0000 7f3b75755640 1 --2- 172.21.15.105:0/2545384397 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b700cf540 0x7f3b700cb5b0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f3b6400e9f0 tx=0x7f3b6400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:03.783 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.780+0000 7f3b6e7fc640 1 -- 172.21.15.105:0/2545384397 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6400cd80 con 0x7f3b700cf540 2024-09-21T03:21:03.783 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.780+0000 7f3b6e7fc640 1 -- 172.21.15.105:0/2545384397 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b64004020 con 0x7f3b700cf540 2024-09-21T03:21:03.783 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.780+0000 7f3b781ba640 1 -- 172.21.15.105:0/2545384397 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b700ce540 con 0x7f3b700cf540 2024-09-21T03:21:03.783 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.780+0000 7f3b6e7fc640 1 -- 172.21.15.105:0/2545384397 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b64004470 con 0x7f3b700cf540 2024-09-21T03:21:03.783 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.780+0000 7f3b781ba640 1 -- 172.21.15.105:0/2545384397 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b700cc940 con 0x7f3b700cf540 2024-09-21T03:21:03.784 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.781+0000 7f3b781ba640 1 -- 172.21.15.105:0/2545384397 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b700ccd80 con 0x7f3b700cf540 2024-09-21T03:21:03.784 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.781+0000 7f3b6e7fc640 1 -- 172.21.15.105:0/2545384397 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3b640035f0 con 0x7f3b700cf540 2024-09-21T03:21:03.784 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.782+0000 7f3b6e7fc640 1 --2- 172.21.15.105:0/2545384397 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3b5c078b90 0x7f3b5c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:03.784 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.782+0000 7f3b6e7fc640 1 -- 172.21.15.105:0/2545384397 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5795+0+0 (secure 0 0 0) 0x7f3b6409b530 con 0x7f3b700cf540 2024-09-21T03:21:03.784 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.782+0000 7f3b75f56640 1 --2- 172.21.15.105:0/2545384397 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3b5c078b90 0x7f3b5c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:03.784 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.783+0000 7f3b75f56640 1 --2- 172.21.15.105:0/2545384397 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3b5c078b90 0x7f3b5c07b0a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3b60001720 tx=0x7f3b60007e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:03.788 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.786+0000 7f3b6e7fc640 1 -- 172.21.15.105:0/2545384397 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3b64063350 con 0x7f3b700cf540 2024-09-21T03:21:03.965 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:03.964+0000 7f3b781ba640 1 -- 172.21.15.105:0/2545384397 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3b70163170 con 0x7f3b700cf540 2024-09-21T03:21:04.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.601+0000 7f3b6e7fc640 1 -- 172.21.15.105:0/2545384397 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v59) ==== 181+0+0 (secure 0 0 0) 0x7f3b64067d80 con 0x7f3b700cf540 2024-09-21T03:21:04.603 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_metadata' removed 2024-09-21T03:21:04.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.603+0000 7f3b781ba640 1 -- 172.21.15.105:0/2545384397 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3b5c078b90 msgr2=0x7f3b5c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:04.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.603+0000 7f3b781ba640 1 --2- 172.21.15.105:0/2545384397 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3b5c078b90 0x7f3b5c07b0a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3b60001720 tx=0x7f3b60007e90 comp rx=0 tx=0).stop 2024-09-21T03:21:04.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.603+0000 7f3b781ba640 1 -- 172.21.15.105:0/2545384397 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b700cf540 msgr2=0x7f3b700cb5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:04.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.603+0000 7f3b781ba640 1 --2- 172.21.15.105:0/2545384397 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b700cf540 0x7f3b700cb5b0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f3b6400e9f0 tx=0x7f3b6400eeb0 comp rx=0 tx=0).stop 2024-09-21T03:21:04.606 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.603+0000 7f3b781ba640 1 -- 172.21.15.105:0/2545384397 shutdown_connections 2024-09-21T03:21:04.606 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.603+0000 7f3b781ba640 1 --2- 172.21.15.105:0/2545384397 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3b5c078b90 0x7f3b5c07b0a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:04.606 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.603+0000 7f3b781ba640 1 --2- 172.21.15.105:0/2545384397 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b700d0ef0 0x7f3b700cbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:04.606 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.603+0000 7f3b781ba640 1 --2- 172.21.15.105:0/2545384397 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b700cf540 0x7f3b700cb5b0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:04.606 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.603+0000 7f3b781ba640 1 --2- 172.21.15.105:0/2545384397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b7006fa70 0x7f3b7015a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:04.606 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.604+0000 7f3b781ba640 1 -- 172.21.15.105:0/2545384397 >> 172.21.15.105:0/2545384397 conn(0x7f3b7008dc50 msgr2=0x7f3b70161330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:04.606 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.604+0000 7f3b781ba640 1 -- 172.21.15.105:0/2545384397 shutdown_connections 2024-09-21T03:21:04.606 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.604+0000 7f3b781ba640 1 -- 172.21.15.105:0/2545384397 wait complete. 2024-09-21T03:21:04.618 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T03:21:04.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.736+0000 7f0e3e6bd640 1 -- 172.21.15.105:0/3249820412 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e380b4070 msgr2=0x7f0e3815b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:04.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.736+0000 7f0e3e6bd640 1 --2- 172.21.15.105:0/3249820412 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e380b4070 0x7f0e3815b9f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0e28009830 tx=0x7f0e2802a510 comp rx=0 tx=0).stop 2024-09-21T03:21:04.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.736+0000 7f0e3e6bd640 1 -- 172.21.15.105:0/3249820412 shutdown_connections 2024-09-21T03:21:04.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.736+0000 7f0e3e6bd640 1 --2- 172.21.15.105:0/3249820412 >> v2:172.21.15.162:3300/0 conn(0x7f0e380ae030 0x7f0e380b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:04.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.736+0000 7f0e3e6bd640 1 --2- 172.21.15.105:0/3249820412 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e380b4070 0x7f0e3815b9f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:04.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.736+0000 7f0e3e6bd640 1 -- 172.21.15.105:0/3249820412 >> 172.21.15.105:0/3249820412 conn(0x7f0e380b2d50 msgr2=0x7f0e380b3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:04.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.736+0000 7f0e3e6bd640 1 -- 172.21.15.105:0/3249820412 shutdown_connections 2024-09-21T03:21:04.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.736+0000 7f0e3e6bd640 1 -- 172.21.15.105:0/3249820412 wait complete. 2024-09-21T03:21:04.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.737+0000 7f0e3e6bd640 1 Processor -- start 2024-09-21T03:21:04.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.738+0000 7f0e3e6bd640 1 -- start start 2024-09-21T03:21:04.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.739+0000 7f0e3e6bd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e380ae030 0x7f0e3814f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:04.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.739+0000 7f0e3e6bd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e380b4070 0x7f0e380cd910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:04.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.739+0000 7f0e3e6bd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e380b5bc0 0x7f0e380cde50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:04.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.739+0000 7f0e3e6bd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0e38165990 con 0x7f0e380b4070 2024-09-21T03:21:04.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.739+0000 7f0e3e6bd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0e38165810 con 0x7f0e380ae030 2024-09-21T03:21:04.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.739+0000 7f0e3e6bd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0e38165b10 con 0x7f0e380b5bc0 2024-09-21T03:21:04.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.739+0000 7f0e377fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e380b4070 0x7f0e380cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:04.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.739+0000 7f0e377fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e380b4070 0x7f0e380cd910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:47202/0 (socket says 172.21.15.105:47202) 2024-09-21T03:21:04.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.739+0000 7f0e377fe640 1 -- 172.21.15.105:0/2520280554 learned_addr learned my addr 172.21.15.105:0/2520280554 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:04.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.739+0000 7f0e37fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e380ae030 0x7f0e3814f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:04.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.739+0000 7f0e3cc5a640 1 --2- 172.21.15.105:0/2520280554 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e380b5bc0 0x7f0e380cde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:04.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.739+0000 7f0e377fe640 1 -- 172.21.15.105:0/2520280554 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e380b5bc0 msgr2=0x7f0e380cde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:04.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.739+0000 7f0e377fe640 1 --2- 172.21.15.105:0/2520280554 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e380b5bc0 0x7f0e380cde50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:04.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.739+0000 7f0e377fe640 1 -- 172.21.15.105:0/2520280554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e380ae030 msgr2=0x7f0e3814f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:04.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.739+0000 7f0e377fe640 1 --2- 172.21.15.105:0/2520280554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e380ae030 0x7f0e3814f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:04.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.739+0000 7f0e377fe640 1 -- 172.21.15.105:0/2520280554 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e3809e2d0 con 0x7f0e380b4070 2024-09-21T03:21:04.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.740+0000 7f0e377fe640 1 --2- 172.21.15.105:0/2520280554 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e380b4070 0x7f0e380cd910 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c00eb30 tx=0x7f0e2c009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:04.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.740+0000 7f0e34ff9640 1 -- 172.21.15.105:0/2520280554 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c00bc90 con 0x7f0e380b4070 2024-09-21T03:21:04.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.740+0000 7f0e34ff9640 1 -- 172.21.15.105:0/2520280554 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e2c00be30 con 0x7f0e380b4070 2024-09-21T03:21:04.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.740+0000 7f0e3e6bd640 1 -- 172.21.15.105:0/2520280554 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e3809e5b0 con 0x7f0e380b4070 2024-09-21T03:21:04.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.740+0000 7f0e34ff9640 1 -- 172.21.15.105:0/2520280554 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c004220 con 0x7f0e380b4070 2024-09-21T03:21:04.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.740+0000 7f0e3e6bd640 1 -- 172.21.15.105:0/2520280554 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e3809eb70 con 0x7f0e380b4070 2024-09-21T03:21:04.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.741+0000 7f0e3e6bd640 1 -- 172.21.15.105:0/2520280554 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e380b5680 con 0x7f0e380b4070 2024-09-21T03:21:04.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.741+0000 7f0e34ff9640 1 -- 172.21.15.105:0/2520280554 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0e2c0035f0 con 0x7f0e380b4070 2024-09-21T03:21:04.745 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.742+0000 7f0e34ff9640 1 --2- 172.21.15.105:0/2520280554 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0e24078bc0 0x7f0e2407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:04.745 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.742+0000 7f0e34ff9640 1 -- 172.21.15.105:0/2520280554 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5357+0+0 (secure 0 0 0) 0x7f0e2c09c780 con 0x7f0e380b4070 2024-09-21T03:21:04.745 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.742+0000 7f0e37fff640 1 --2- 172.21.15.105:0/2520280554 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0e24078bc0 0x7f0e2407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:04.745 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.743+0000 7f0e37fff640 1 --2- 172.21.15.105:0/2520280554 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0e24078bc0 0x7f0e2407b0d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0e28034000 tx=0x7f0e28004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:04.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.746+0000 7f0e34ff9640 1 -- 172.21.15.105:0/2520280554 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0e2c064760 con 0x7f0e380b4070 2024-09-21T03:21:04.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:04.927+0000 7f0e3e6bd640 1 -- 172.21.15.105:0/2520280554 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0e381591a0 con 0x7f0e380b4070 2024-09-21T03:21:05.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.608+0000 7f0e34ff9640 1 -- 172.21.15.105:0/2520280554 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v60) ==== 169+0+0 (secure 0 0 0) 0x7f0e2c069190 con 0x7f0e380b4070 2024-09-21T03:21:05.610 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_data' removed 2024-09-21T03:21:05.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.611+0000 7f0e3e6bd640 1 -- 172.21.15.105:0/2520280554 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0e24078bc0 msgr2=0x7f0e2407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:05.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.611+0000 7f0e3e6bd640 1 --2- 172.21.15.105:0/2520280554 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0e24078bc0 0x7f0e2407b0d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0e28034000 tx=0x7f0e28004730 comp rx=0 tx=0).stop 2024-09-21T03:21:05.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.611+0000 7f0e3e6bd640 1 -- 172.21.15.105:0/2520280554 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e380b4070 msgr2=0x7f0e380cd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:05.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.611+0000 7f0e3e6bd640 1 --2- 172.21.15.105:0/2520280554 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e380b4070 0x7f0e380cd910 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c00eb30 tx=0x7f0e2c009f70 comp rx=0 tx=0).stop 2024-09-21T03:21:05.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.611+0000 7f0e3e6bd640 1 -- 172.21.15.105:0/2520280554 shutdown_connections 2024-09-21T03:21:05.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.611+0000 7f0e3e6bd640 1 --2- 172.21.15.105:0/2520280554 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0e24078bc0 0x7f0e2407b0d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:05.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.611+0000 7f0e3e6bd640 1 --2- 172.21.15.105:0/2520280554 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e380b5bc0 0x7f0e380cde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:05.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.611+0000 7f0e3e6bd640 1 --2- 172.21.15.105:0/2520280554 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e380b4070 0x7f0e380cd910 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:05.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.611+0000 7f0e3e6bd640 1 --2- 172.21.15.105:0/2520280554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e380ae030 0x7f0e3814f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:05.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.611+0000 7f0e3e6bd640 1 -- 172.21.15.105:0/2520280554 >> 172.21.15.105:0/2520280554 conn(0x7f0e380b2d50 msgr2=0x7f0e380ceeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:05.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.611+0000 7f0e3e6bd640 1 -- 172.21.15.105:0/2520280554 shutdown_connections 2024-09-21T03:21:05.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.611+0000 7f0e3e6bd640 1 -- 172.21.15.105:0/2520280554 wait complete. 2024-09-21T03:21:05.628 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-21T03:21:05.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.742+0000 7f62101c3640 1 -- 172.21.15.105:0/4103312067 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62080d3870 msgr2=0x7f62080ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:05.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.742+0000 7f62101c3640 1 --2- 172.21.15.105:0/4103312067 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62080d3870 0x7f62080ceb40 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f62080ba570 tx=0x7f620002a9c0 comp rx=0 tx=0).stop 2024-09-21T03:21:05.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.742+0000 7f62101c3640 1 -- 172.21.15.105:0/4103312067 shutdown_connections 2024-09-21T03:21:05.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.742+0000 7f62101c3640 1 --2- 172.21.15.105:0/4103312067 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62080d3870 0x7f62080ceb40 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:05.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.742+0000 7f62101c3640 1 --2- 172.21.15.105:0/4103312067 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f620806f4b0 0x7f62080d3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:05.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.742+0000 7f62101c3640 1 --2- 172.21.15.105:0/4103312067 >> v2:172.21.15.162:3300/0 conn(0x7f620806e170 0x7f62080b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:05.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.742+0000 7f62101c3640 1 -- 172.21.15.105:0/4103312067 >> 172.21.15.105:0/4103312067 conn(0x7f620808bfc0 msgr2=0x7f620809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:05.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.742+0000 7f62101c3640 1 -- 172.21.15.105:0/4103312067 shutdown_connections 2024-09-21T03:21:05.745 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.742+0000 7f62101c3640 1 -- 172.21.15.105:0/4103312067 wait complete. 2024-09-21T03:21:05.745 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.744+0000 7f62101c3640 1 Processor -- start 2024-09-21T03:21:05.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.744+0000 7f62101c3640 1 -- start start 2024-09-21T03:21:05.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.745+0000 7f62101c3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f620806f4b0 0x7f62080b4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:05.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.745+0000 7f62101c3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62080d3870 0x7f6208151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:05.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.745+0000 7f62101c3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62080b55a0 0x7f6208151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:05.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.745+0000 7f62101c3640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f62080cf490 con 0x7f62080b55a0 2024-09-21T03:21:05.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.745+0000 7f62101c3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f62080cf310 con 0x7f62080d3870 2024-09-21T03:21:05.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.745+0000 7f62101c3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f62080d0ce0 con 0x7f620806f4b0 2024-09-21T03:21:05.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.746+0000 7f620e760640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62080b55a0 0x7f6208151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:05.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.746+0000 7f620e760640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62080b55a0 0x7f6208151c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:47216/0 (socket says 172.21.15.105:47216) 2024-09-21T03:21:05.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.746+0000 7f620e760640 1 -- 172.21.15.105:0/2449514821 learned_addr learned my addr 172.21.15.105:0/2449514821 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:05.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.746+0000 7f620d75e640 1 --2- 172.21.15.105:0/2449514821 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62080d3870 0x7f6208151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:05.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.746+0000 7f620df5f640 1 --2- 172.21.15.105:0/2449514821 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f620806f4b0 0x7f62080b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:05.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.746+0000 7f620e760640 1 -- 172.21.15.105:0/2449514821 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f620806f4b0 msgr2=0x7f62080b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:05.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.746+0000 7f620e760640 1 --2- 172.21.15.105:0/2449514821 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f620806f4b0 0x7f62080b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:05.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.746+0000 7f620e760640 1 -- 172.21.15.105:0/2449514821 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62080d3870 msgr2=0x7f6208151750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:05.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.746+0000 7f620e760640 1 --2- 172.21.15.105:0/2449514821 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62080d3870 0x7f6208151750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:05.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.746+0000 7f620e760640 1 -- 172.21.15.105:0/2449514821 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62080ce8f0 con 0x7f62080b55a0 2024-09-21T03:21:05.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.746+0000 7f620e760640 1 --2- 172.21.15.105:0/2449514821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62080b55a0 0x7f6208151c90 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f6200006010 tx=0x7f6200003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:05.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.746+0000 7f61fe7fc640 1 -- 172.21.15.105:0/2449514821 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6200034040 con 0x7f62080b55a0 2024-09-21T03:21:05.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.746+0000 7f61fe7fc640 1 -- 172.21.15.105:0/2449514821 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6200004540 con 0x7f62080b55a0 2024-09-21T03:21:05.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.746+0000 7f61fe7fc640 1 -- 172.21.15.105:0/2449514821 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6200045480 con 0x7f62080b55a0 2024-09-21T03:21:05.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.746+0000 7f62101c3640 1 -- 172.21.15.105:0/2449514821 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62080b4b00 con 0x7f62080b55a0 2024-09-21T03:21:05.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.746+0000 7f62101c3640 1 -- 172.21.15.105:0/2449514821 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62081544b0 con 0x7f62080b55a0 2024-09-21T03:21:05.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.747+0000 7f62101c3640 1 -- 172.21.15.105:0/2449514821 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f620806e170 con 0x7f62080b55a0 2024-09-21T03:21:05.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.748+0000 7f61fe7fc640 1 -- 172.21.15.105:0/2449514821 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6200037020 con 0x7f62080b55a0 2024-09-21T03:21:05.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.748+0000 7f61fe7fc640 1 --2- 172.21.15.105:0/2449514821 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f61ec078bc0 0x7f61ec07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:05.751 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.749+0000 7f61fe7fc640 1 -- 172.21.15.105:0/2449514821 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7f62000bc1f0 con 0x7f62080b55a0 2024-09-21T03:21:05.751 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.749+0000 7f620df5f640 1 --2- 172.21.15.105:0/2449514821 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f61ec078bc0 0x7f61ec07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:05.751 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.749+0000 7f620df5f640 1 --2- 172.21.15.105:0/2449514821 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f61ec078bc0 0x7f61ec07b0d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f620400bb50 tx=0x7f620400b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:05.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.753+0000 7f61fe7fc640 1 -- 172.21.15.105:0/2449514821 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f62080ce8f0 con 0x7f62080b55a0 2024-09-21T03:21:05.938 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.936+0000 7f62101c3640 1 -- 172.21.15.105:0/2449514821 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f62080b1cf0 con 0x7f62080b55a0 2024-09-21T03:21:05.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.940+0000 7f61fe7fc640 1 -- 172.21.15.105:0/2449514821 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v39) ==== 71+0+0 (secure 0 0 0) 0x7f62000842f0 con 0x7f62080b55a0 2024-09-21T03:21:05.944 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.942+0000 7f62101c3640 1 -- 172.21.15.105:0/2449514821 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f61ec078bc0 msgr2=0x7f61ec07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:05.944 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.942+0000 7f62101c3640 1 --2- 172.21.15.105:0/2449514821 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f61ec078bc0 0x7f61ec07b0d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f620400bb50 tx=0x7f620400b2e0 comp rx=0 tx=0).stop 2024-09-21T03:21:05.944 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.942+0000 7f62101c3640 1 -- 172.21.15.105:0/2449514821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62080b55a0 msgr2=0x7f6208151c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:05.944 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.942+0000 7f62101c3640 1 --2- 172.21.15.105:0/2449514821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62080b55a0 0x7f6208151c90 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f6200006010 tx=0x7f6200003f10 comp rx=0 tx=0).stop 2024-09-21T03:21:05.945 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.942+0000 7f62101c3640 1 -- 172.21.15.105:0/2449514821 shutdown_connections 2024-09-21T03:21:05.945 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.942+0000 7f62101c3640 1 --2- 172.21.15.105:0/2449514821 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f61ec078bc0 0x7f61ec07b0d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:05.945 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.942+0000 7f62101c3640 1 --2- 172.21.15.105:0/2449514821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62080b55a0 0x7f6208151c90 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:05.945 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.942+0000 7f62101c3640 1 --2- 172.21.15.105:0/2449514821 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62080d3870 0x7f6208151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:05.945 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.942+0000 7f62101c3640 1 --2- 172.21.15.105:0/2449514821 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f620806f4b0 0x7f62080b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:05.945 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.942+0000 7f62101c3640 1 -- 172.21.15.105:0/2449514821 >> 172.21.15.105:0/2449514821 conn(0x7f620808bfc0 msgr2=0x7f6208161870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:05.945 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.942+0000 7f62101c3640 1 -- 172.21.15.105:0/2449514821 shutdown_connections 2024-09-21T03:21:05.945 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:05.942+0000 7f62101c3640 1 -- 172.21.15.105:0/2449514821 wait complete. 2024-09-21T03:21:05.955 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_cache_size' 2024-09-21T03:21:06.068 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.066+0000 7f35e4758640 1 -- 172.21.15.105:0/3494643488 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35c4005250 msgr2=0x7f35c400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:06.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.066+0000 7f35e4758640 1 --2- 172.21.15.105:0/3494643488 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35c4005250 0x7f35c400b9c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f35dc15d020 tx=0x7f35c4005830 comp rx=0 tx=0).stop 2024-09-21T03:21:06.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.066+0000 7f35e4758640 1 -- 172.21.15.105:0/3494643488 shutdown_connections 2024-09-21T03:21:06.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.066+0000 7f35e4758640 1 --2- 172.21.15.105:0/3494643488 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35c4005250 0x7f35c400b9c0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:06.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.066+0000 7f35e4758640 1 -- 172.21.15.105:0/3494643488 >> 172.21.15.105:0/3494643488 conn(0x7f35dc06d550 msgr2=0x7f35dc071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:06.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.066+0000 7f35e4758640 1 -- 172.21.15.105:0/3494643488 shutdown_connections 2024-09-21T03:21:06.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.066+0000 7f35e4758640 1 -- 172.21.15.105:0/3494643488 wait complete. 2024-09-21T03:21:06.070 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.068+0000 7f35e4758640 1 Processor -- start 2024-09-21T03:21:06.070 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.068+0000 7f35e4758640 1 -- start start 2024-09-21T03:21:06.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.069+0000 7f35e4758640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35c4005250 0x7f35dc1f28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:06.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.069+0000 7f35e4758640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35dc1e8a90 0x7f35dc1f2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:06.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.069+0000 7f35e4758640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35dc0cae60 0x7f35dc0cb270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:06.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.070+0000 7f35e4758640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f35dc15d4c0 con 0x7f35dc1e8a90 2024-09-21T03:21:06.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.070+0000 7f35e4758640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f35dc15d340 con 0x7f35c4005250 2024-09-21T03:21:06.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.070+0000 7f35e4758640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f35dc0d1f20 con 0x7f35dc0cae60 2024-09-21T03:21:06.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.070+0000 7f35e1cf3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35dc1e8a90 0x7f35dc1f2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:06.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.070+0000 7f35e1cf3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35dc1e8a90 0x7f35dc1f2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:47236/0 (socket says 172.21.15.105:47236) 2024-09-21T03:21:06.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.070+0000 7f35e1cf3640 1 -- 172.21.15.105:0/3521338182 learned_addr learned my addr 172.21.15.105:0/3521338182 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:06.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.070+0000 7f35e24f4640 1 --2- 172.21.15.105:0/3521338182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35c4005250 0x7f35dc1f28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:06.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.070+0000 7f35e2cf5640 1 --2- 172.21.15.105:0/3521338182 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35dc0cae60 0x7f35dc0cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:06.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.070+0000 7f35e1cf3640 1 -- 172.21.15.105:0/3521338182 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35dc0cae60 msgr2=0x7f35dc0cb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:06.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.070+0000 7f35e1cf3640 1 --2- 172.21.15.105:0/3521338182 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35dc0cae60 0x7f35dc0cb270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:06.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.070+0000 7f35e1cf3640 1 -- 172.21.15.105:0/3521338182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35c4005250 msgr2=0x7f35dc1f28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:06.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.070+0000 7f35e1cf3640 1 --2- 172.21.15.105:0/3521338182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35c4005250 0x7f35dc1f28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:06.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.070+0000 7f35e1cf3640 1 -- 172.21.15.105:0/3521338182 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35dc1e7ff0 con 0x7f35dc1e8a90 2024-09-21T03:21:06.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.070+0000 7f35e1cf3640 1 --2- 172.21.15.105:0/3521338182 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35dc1e8a90 0x7f35dc1f2e00 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f35d0005f60 tx=0x7f35d0011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:06.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.070+0000 7f35daffd640 1 -- 172.21.15.105:0/3521338182 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d001f070 con 0x7f35dc1e8a90 2024-09-21T03:21:06.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.070+0000 7f35daffd640 1 -- 172.21.15.105:0/3521338182 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f35d000fe40 con 0x7f35dc1e8a90 2024-09-21T03:21:06.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.070+0000 7f35daffd640 1 -- 172.21.15.105:0/3521338182 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d00126b0 con 0x7f35dc1e8a90 2024-09-21T03:21:06.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.070+0000 7f35e4758640 1 -- 172.21.15.105:0/3521338182 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35dc0c98c0 con 0x7f35dc1e8a90 2024-09-21T03:21:06.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.070+0000 7f35e4758640 1 -- 172.21.15.105:0/3521338182 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35dc1e8290 con 0x7f35dc1e8a90 2024-09-21T03:21:06.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.071+0000 7f35e4758640 1 -- 172.21.15.105:0/3521338182 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35dc0d2410 con 0x7f35dc1e8a90 2024-09-21T03:21:06.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.072+0000 7f35daffd640 1 -- 172.21.15.105:0/3521338182 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f35d0022070 con 0x7f35dc1e8a90 2024-09-21T03:21:06.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.073+0000 7f35daffd640 1 --2- 172.21.15.105:0/3521338182 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f35c8078b90 0x7f35c807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:06.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.073+0000 7f35daffd640 1 -- 172.21.15.105:0/3521338182 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7f35d009bb90 con 0x7f35dc1e8a90 2024-09-21T03:21:06.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.073+0000 7f35e24f4640 1 --2- 172.21.15.105:0/3521338182 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f35c8078b90 0x7f35c807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:06.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.073+0000 7f35e24f4640 1 --2- 172.21.15.105:0/3521338182 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f35c8078b90 0x7f35c807b0a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f35cc0066b0 tx=0x7f35cc006b70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:06.078 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.076+0000 7f35daffd640 1 -- 172.21.15.105:0/3521338182 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f35d0063df0 con 0x7f35dc1e8a90 2024-09-21T03:21:06.327 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.326+0000 7f35e4758640 1 -- 172.21.15.105:0/3521338182 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_cache_size"]} v 0) -- 0x7f35dc0b72e0 con 0x7f35dc1e8a90 2024-09-21T03:21:06.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.609+0000 7f35daffd640 1 -- 172.21.15.105:0/3521338182 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_cache_size"]}]=0 v152) ==== 150+0+0 (secure 0 0 0) 0x7f35d0068820 con 0x7f35dc1e8a90 2024-09-21T03:21:06.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.612+0000 7f35e4758640 1 -- 172.21.15.105:0/3521338182 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f35c8078b90 msgr2=0x7f35c807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:06.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.612+0000 7f35e4758640 1 --2- 172.21.15.105:0/3521338182 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f35c8078b90 0x7f35c807b0a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f35cc0066b0 tx=0x7f35cc006b70 comp rx=0 tx=0).stop 2024-09-21T03:21:06.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.612+0000 7f35e4758640 1 -- 172.21.15.105:0/3521338182 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35dc1e8a90 msgr2=0x7f35dc1f2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:06.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.612+0000 7f35e4758640 1 --2- 172.21.15.105:0/3521338182 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35dc1e8a90 0x7f35dc1f2e00 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f35d0005f60 tx=0x7f35d0011cb0 comp rx=0 tx=0).stop 2024-09-21T03:21:06.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.612+0000 7f35e4758640 1 -- 172.21.15.105:0/3521338182 shutdown_connections 2024-09-21T03:21:06.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.612+0000 7f35e4758640 1 --2- 172.21.15.105:0/3521338182 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f35c8078b90 0x7f35c807b0a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:06.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.612+0000 7f35e4758640 1 --2- 172.21.15.105:0/3521338182 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35dc0cae60 0x7f35dc0cb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:06.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.612+0000 7f35e4758640 1 --2- 172.21.15.105:0/3521338182 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35dc1e8a90 0x7f35dc1f2e00 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:06.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.612+0000 7f35e4758640 1 --2- 172.21.15.105:0/3521338182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35c4005250 0x7f35dc1f28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:06.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.612+0000 7f35e4758640 1 -- 172.21.15.105:0/3521338182 >> 172.21.15.105:0/3521338182 conn(0x7f35dc06d550 msgr2=0x7f35dc0d0150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:06.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.612+0000 7f35e4758640 1 -- 172.21.15.105:0/3521338182 shutdown_connections 2024-09-21T03:21:06.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.612+0000 7f35e4758640 1 -- 172.21.15.105:0/3521338182 wait complete. 2024-09-21T03:21:06.624 INFO:tasks.cephfs_test_runner:test_client_cache_size (tasks.cephfs.test_client_limits.TestClientLimits) ... skipped 'Require FUSE client to inject client release failure' 2024-09-21T03:21:06.625 INFO:tasks.cephfs_test_runner:Starting test: test_client_max_caps (tasks.cephfs.test_client_limits.TestClientLimits) That the MDS will not let a client sit above mds_max_caps_per_client caps. 2024-09-21T03:21:06.625 INFO:tasks.cephfs_test_runner:test_client_max_caps (tasks.cephfs.test_client_limits.TestClientLimits) 2024-09-21T03:21:06.625 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:21:06.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.736+0000 7f6b50c4d640 1 -- 172.21.15.105:0/4080022928 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b4c0d2630 msgr2=0x7f6b4c15d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:06.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.736+0000 7f6b50c4d640 1 --2- 172.21.15.105:0/4080022928 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b4c0d2630 0x7f6b4c15d130 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f6b40005fd0 tx=0x7f6b4002a5d0 comp rx=0 tx=0).stop 2024-09-21T03:21:06.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.736+0000 7f6b50c4d640 1 -- 172.21.15.105:0/4080022928 shutdown_connections 2024-09-21T03:21:06.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.736+0000 7f6b50c4d640 1 --2- 172.21.15.105:0/4080022928 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b4c15d670 0x7f6b4c0b7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:06.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.736+0000 7f6b50c4d640 1 --2- 172.21.15.105:0/4080022928 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b4c0d2630 0x7f6b4c15d130 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:06.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.736+0000 7f6b50c4d640 1 -- 172.21.15.105:0/4080022928 >> 172.21.15.105:0/4080022928 conn(0x7f6b4c06d550 msgr2=0x7f6b4c071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:06.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.736+0000 7f6b50c4d640 1 -- 172.21.15.105:0/4080022928 shutdown_connections 2024-09-21T03:21:06.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.736+0000 7f6b50c4d640 1 -- 172.21.15.105:0/4080022928 wait complete. 2024-09-21T03:21:06.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.738+0000 7f6b50c4d640 1 Processor -- start 2024-09-21T03:21:06.740 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.738+0000 7f6b50c4d640 1 -- start start 2024-09-21T03:21:06.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.739+0000 7f6b50c4d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b4c1570e0 0x7f6b4c157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:06.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.739+0000 7f6b50c4d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b4c15d670 0x7f6b4c14d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:06.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.739+0000 7f6b50c4d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b4c0c8340 0x7f6b4c0c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:06.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.739+0000 7f6b50c4d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4c0b7d60 con 0x7f6b4c15d670 2024-09-21T03:21:06.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.739+0000 7f6b50c4d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4c0b7be0 con 0x7f6b4c1570e0 2024-09-21T03:21:06.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.739+0000 7f6b50c4d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6b4c0b7ee0 con 0x7f6b4c0c8340 2024-09-21T03:21:06.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.739+0000 7f6b49d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b4c15d670 0x7f6b4c14d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:06.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.739+0000 7f6b49d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b4c15d670 0x7f6b4c14d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:47260/0 (socket says 172.21.15.105:47260) 2024-09-21T03:21:06.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.739+0000 7f6b49d9b640 1 -- 172.21.15.105:0/2259456814 learned_addr learned my addr 172.21.15.105:0/2259456814 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:06.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.739+0000 7f6b4a59c640 1 --2- 172.21.15.105:0/2259456814 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b4c1570e0 0x7f6b4c157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:06.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.739+0000 7f6b4ad9d640 1 --2- 172.21.15.105:0/2259456814 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b4c0c8340 0x7f6b4c0c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:06.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.739+0000 7f6b49d9b640 1 -- 172.21.15.105:0/2259456814 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b4c0c8340 msgr2=0x7f6b4c0c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:06.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.739+0000 7f6b49d9b640 1 --2- 172.21.15.105:0/2259456814 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b4c0c8340 0x7f6b4c0c8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:06.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.739+0000 7f6b49d9b640 1 -- 172.21.15.105:0/2259456814 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b4c1570e0 msgr2=0x7f6b4c157610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:06.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.739+0000 7f6b49d9b640 1 --2- 172.21.15.105:0/2259456814 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b4c1570e0 0x7f6b4c157610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:06.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.739+0000 7f6b49d9b640 1 -- 172.21.15.105:0/2259456814 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b4c0c8c90 con 0x7f6b4c15d670 2024-09-21T03:21:06.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.740+0000 7f6b49d9b640 1 --2- 172.21.15.105:0/2259456814 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b4c15d670 0x7f6b4c14d090 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f6b40034040 tx=0x7f6b400038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:06.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.740+0000 7f6b3affd640 1 -- 172.21.15.105:0/2259456814 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4003e030 con 0x7f6b4c15d670 2024-09-21T03:21:06.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.740+0000 7f6b3affd640 1 -- 172.21.15.105:0/2259456814 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b40003ca0 con 0x7f6b4c15d670 2024-09-21T03:21:06.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.740+0000 7f6b50c4d640 1 -- 172.21.15.105:0/2259456814 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b4c1f7480 con 0x7f6b4c15d670 2024-09-21T03:21:06.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.740+0000 7f6b3affd640 1 -- 172.21.15.105:0/2259456814 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b40035040 con 0x7f6b4c15d670 2024-09-21T03:21:06.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.740+0000 7f6b50c4d640 1 -- 172.21.15.105:0/2259456814 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b4c1f7a40 con 0x7f6b4c15d670 2024-09-21T03:21:06.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.741+0000 7f6b50c4d640 1 -- 172.21.15.105:0/2259456814 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b4c15d130 con 0x7f6b4c15d670 2024-09-21T03:21:06.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.741+0000 7f6b3affd640 1 -- 172.21.15.105:0/2259456814 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6b40041030 con 0x7f6b4c15d670 2024-09-21T03:21:06.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.742+0000 7f6b3affd640 1 --2- 172.21.15.105:0/2259456814 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6b2c078bc0 0x7f6b2c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:06.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.742+0000 7f6b3affd640 1 -- 172.21.15.105:0/2259456814 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7f6b400baef0 con 0x7f6b4c15d670 2024-09-21T03:21:06.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.742+0000 7f6b4a59c640 1 --2- 172.21.15.105:0/2259456814 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6b2c078bc0 0x7f6b2c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:06.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.743+0000 7f6b4a59c640 1 --2- 172.21.15.105:0/2259456814 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6b2c078bc0 0x7f6b2c07b0d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c001720 tx=0x7f6b3c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:06.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.746+0000 7f6b3affd640 1 -- 172.21.15.105:0/2259456814 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6b4c0c8c90 con 0x7f6b4c15d670 2024-09-21T03:21:06.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.923+0000 7f6b50c4d640 1 -- 172.21.15.105:0/2259456814 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6b4c0b1810 con 0x7f6b4c15d670 2024-09-21T03:21:06.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.924+0000 7f6b3affd640 1 -- 172.21.15.105:0/2259456814 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) ==== 74+0+13106 (secure 0 0 0) 0x7f6b40083070 con 0x7f6b4c15d670 2024-09-21T03:21:06.926 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:06.926 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":60,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:21:05.602391+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.105:6835/1075697245":"2024-09-22T03:21:02.591572+0000","172.21.15.105:6834/1075697245":"2024-09-22T03:21:02.591572+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:21:06.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.926+0000 7f6b50c4d640 1 -- 172.21.15.105:0/2259456814 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6b2c078bc0 msgr2=0x7f6b2c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:06.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.926+0000 7f6b50c4d640 1 --2- 172.21.15.105:0/2259456814 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6b2c078bc0 0x7f6b2c07b0d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c001720 tx=0x7f6b3c009040 comp rx=0 tx=0).stop 2024-09-21T03:21:06.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.926+0000 7f6b50c4d640 1 -- 172.21.15.105:0/2259456814 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b4c15d670 msgr2=0x7f6b4c14d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:06.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.926+0000 7f6b50c4d640 1 --2- 172.21.15.105:0/2259456814 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b4c15d670 0x7f6b4c14d090 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f6b40034040 tx=0x7f6b400038a0 comp rx=0 tx=0).stop 2024-09-21T03:21:06.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.926+0000 7f6b50c4d640 1 -- 172.21.15.105:0/2259456814 shutdown_connections 2024-09-21T03:21:06.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.926+0000 7f6b50c4d640 1 --2- 172.21.15.105:0/2259456814 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6b2c078bc0 0x7f6b2c07b0d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:06.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.926+0000 7f6b50c4d640 1 --2- 172.21.15.105:0/2259456814 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b4c0c8340 0x7f6b4c0c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:06.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.926+0000 7f6b50c4d640 1 --2- 172.21.15.105:0/2259456814 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b4c15d670 0x7f6b4c14d090 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:06.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.926+0000 7f6b50c4d640 1 --2- 172.21.15.105:0/2259456814 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b4c1570e0 0x7f6b4c157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:06.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.926+0000 7f6b50c4d640 1 -- 172.21.15.105:0/2259456814 >> 172.21.15.105:0/2259456814 conn(0x7f6b4c06d550 msgr2=0x7f6b4c0b3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:06.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.926+0000 7f6b50c4d640 1 -- 172.21.15.105:0/2259456814 shutdown_connections 2024-09-21T03:21:06.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:06.926+0000 7f6b50c4d640 1 -- 172.21.15.105:0/2259456814 wait complete. 2024-09-21T03:21:06.939 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T03:18:19.296947+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T03:21:06.939 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T03:21:07.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.053+0000 7f77e85b0640 1 -- 172.21.15.105:0/1820477663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77e0156f10 msgr2=0x7f77e015d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:07.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.053+0000 7f77e85b0640 1 --2- 172.21.15.105:0/1820477663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77e0156f10 0x7f77e015d9c0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f77d0009830 tx=0x7f77d002a5a0 comp rx=0 tx=0).stop 2024-09-21T03:21:07.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.053+0000 7f77e85b0640 1 -- 172.21.15.105:0/1820477663 shutdown_connections 2024-09-21T03:21:07.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.053+0000 7f77e85b0640 1 --2- 172.21.15.105:0/1820477663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77e0156f10 0x7f77e015d9c0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:07.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.053+0000 7f77e85b0640 1 --2- 172.21.15.105:0/1820477663 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77e0161020 0x7f77e00ccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:07.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.053+0000 7f77e85b0640 1 -- 172.21.15.105:0/1820477663 >> 172.21.15.105:0/1820477663 conn(0x7f77e006d4f0 msgr2=0x7f77e0071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:07.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.053+0000 7f77e85b0640 1 -- 172.21.15.105:0/1820477663 shutdown_connections 2024-09-21T03:21:07.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.053+0000 7f77e85b0640 1 -- 172.21.15.105:0/1820477663 wait complete. 2024-09-21T03:21:07.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.055+0000 7f77e85b0640 1 Processor -- start 2024-09-21T03:21:07.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.055+0000 7f77e85b0640 1 -- start start 2024-09-21T03:21:07.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.056+0000 7f77e85b0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77e00cec50 0x7f77e01f7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:07.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.056+0000 7f77e85b0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77e0156f10 0x7f77e0149690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:07.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.056+0000 7f77e85b0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77e0161020 0x7f77e01f3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:07.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.056+0000 7f77e85b0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f77e00d08c0 con 0x7f77e0161020 2024-09-21T03:21:07.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.056+0000 7f77e85b0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f77e00d0740 con 0x7f77e00cec50 2024-09-21T03:21:07.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.056+0000 7f77e85b0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f77e00d0a40 con 0x7f77e0156f10 2024-09-21T03:21:07.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.056+0000 7f77e6b4d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77e0161020 0x7f77e01f3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:07.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.056+0000 7f77e6b4d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77e0161020 0x7f77e01f3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:47274/0 (socket says 172.21.15.105:47274) 2024-09-21T03:21:07.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.056+0000 7f77e6b4d640 1 -- 172.21.15.105:0/1216214886 learned_addr learned my addr 172.21.15.105:0/1216214886 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:07.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.057+0000 7f77e5b4b640 1 --2- 172.21.15.105:0/1216214886 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77e0156f10 0x7f77e0149690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:07.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.057+0000 7f77e6b4d640 1 -- 172.21.15.105:0/1216214886 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77e0156f10 msgr2=0x7f77e0149690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:07.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.057+0000 7f77e6b4d640 1 --2- 172.21.15.105:0/1216214886 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77e0156f10 0x7f77e0149690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:07.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.057+0000 7f77e6b4d640 1 -- 172.21.15.105:0/1216214886 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77e00cec50 msgr2=0x7f77e01f7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:07.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.057+0000 7f77e6b4d640 1 --2- 172.21.15.105:0/1216214886 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77e00cec50 0x7f77e01f7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:07.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.057+0000 7f77e6b4d640 1 -- 172.21.15.105:0/1216214886 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77e01f4670 con 0x7f77e0161020 2024-09-21T03:21:07.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.057+0000 7f77e6b4d640 1 --2- 172.21.15.105:0/1216214886 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77e0161020 0x7f77e01f3b00 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f77d800c370 tx=0x7f77d800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:07.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.057+0000 7f77d6ffd640 1 -- 172.21.15.105:0/1216214886 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d8017070 con 0x7f77e0161020 2024-09-21T03:21:07.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.057+0000 7f77d6ffd640 1 -- 172.21.15.105:0/1216214886 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f77d80035f0 con 0x7f77e0161020 2024-09-21T03:21:07.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.057+0000 7f77e85b0640 1 -- 172.21.15.105:0/1216214886 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77e01f4950 con 0x7f77e0161020 2024-09-21T03:21:07.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.057+0000 7f77d6ffd640 1 -- 172.21.15.105:0/1216214886 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d8003a40 con 0x7f77e0161020 2024-09-21T03:21:07.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.057+0000 7f77e85b0640 1 -- 172.21.15.105:0/1216214886 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77e01f7390 con 0x7f77e0161020 2024-09-21T03:21:07.061 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.058+0000 7f77e85b0640 1 -- 172.21.15.105:0/1216214886 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77e00d0f80 con 0x7f77e0161020 2024-09-21T03:21:07.061 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.059+0000 7f77d6ffd640 1 -- 172.21.15.105:0/1216214886 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f77d801a070 con 0x7f77e0161020 2024-09-21T03:21:07.061 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.059+0000 7f77d6ffd640 1 --2- 172.21.15.105:0/1216214886 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f77c4078b90 0x7f77c407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:07.061 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.059+0000 7f77d6ffd640 1 -- 172.21.15.105:0/1216214886 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7f77d8099c70 con 0x7f77e0161020 2024-09-21T03:21:07.061 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.059+0000 7f77e634c640 1 --2- 172.21.15.105:0/1216214886 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f77c4078b90 0x7f77c407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:07.061 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.060+0000 7f77e634c640 1 --2- 172.21.15.105:0/1216214886 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f77c4078b90 0x7f77c407b0a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f77dc007b40 tx=0x7f77dc005ed0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:07.065 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.064+0000 7f77d6ffd640 1 -- 172.21.15.105:0/1216214886 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f77e015df00 con 0x7f77e0161020 2024-09-21T03:21:07.244 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.242+0000 7f77e85b0640 1 -- 172.21.15.105:0/1216214886 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f77e00c5be0 con 0x7f77e0161020 2024-09-21T03:21:07.244 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.242+0000 7f77d6ffd640 1 -- 172.21.15.105:0/1216214886 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) ==== 93+0+10 (secure 0 0 0) 0x7f77d8062440 con 0x7f77e0161020 2024-09-21T03:21:07.244 INFO:teuthology.orchestra.run.smithi105.stdout:pg_num: 1 2024-09-21T03:21:07.247 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.245+0000 7f77e85b0640 1 -- 172.21.15.105:0/1216214886 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f77c4078b90 msgr2=0x7f77c407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:07.247 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.245+0000 7f77e85b0640 1 --2- 172.21.15.105:0/1216214886 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f77c4078b90 0x7f77c407b0a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f77dc007b40 tx=0x7f77dc005ed0 comp rx=0 tx=0).stop 2024-09-21T03:21:07.247 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.245+0000 7f77e85b0640 1 -- 172.21.15.105:0/1216214886 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77e0161020 msgr2=0x7f77e01f3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:07.247 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.245+0000 7f77e85b0640 1 --2- 172.21.15.105:0/1216214886 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77e0161020 0x7f77e01f3b00 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f77d800c370 tx=0x7f77d800c830 comp rx=0 tx=0).stop 2024-09-21T03:21:07.247 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.245+0000 7f77e85b0640 1 -- 172.21.15.105:0/1216214886 shutdown_connections 2024-09-21T03:21:07.247 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.245+0000 7f77e85b0640 1 --2- 172.21.15.105:0/1216214886 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f77c4078b90 0x7f77c407b0a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:07.247 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.245+0000 7f77e85b0640 1 --2- 172.21.15.105:0/1216214886 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77e0161020 0x7f77e01f3b00 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:07.247 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.245+0000 7f77e85b0640 1 --2- 172.21.15.105:0/1216214886 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77e0156f10 0x7f77e0149690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:07.248 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.245+0000 7f77e85b0640 1 --2- 172.21.15.105:0/1216214886 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77e00cec50 0x7f77e01f7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:07.248 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.245+0000 7f77e85b0640 1 -- 172.21.15.105:0/1216214886 >> 172.21.15.105:0/1216214886 conn(0x7f77e006d4f0 msgr2=0x7f77e015eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:07.248 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.245+0000 7f77e85b0640 1 -- 172.21.15.105:0/1216214886 shutdown_connections 2024-09-21T03:21:07.248 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.245+0000 7f77e85b0640 1 -- 172.21.15.105:0/1216214886 wait complete. 2024-09-21T03:21:07.257 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_max_caps' 2024-09-21T03:21:07.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.367+0000 7f7a20f51640 1 -- 172.21.15.105:0/2782209202 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a1c0b4090 msgr2=0x7f7a1c0b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:07.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.367+0000 7f7a20f51640 1 --2- 172.21.15.105:0/2782209202 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a1c0b4090 0x7f7a1c0b3550 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c005fd0 tx=0x7f7a0c02a5d0 comp rx=0 tx=0).stop 2024-09-21T03:21:07.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.367+0000 7f7a20f51640 1 -- 172.21.15.105:0/2782209202 shutdown_connections 2024-09-21T03:21:07.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.367+0000 7f7a20f51640 1 --2- 172.21.15.105:0/2782209202 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a1c06fec0 0x7f7a1c0702d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:07.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.367+0000 7f7a20f51640 1 --2- 172.21.15.105:0/2782209202 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a1c0b4090 0x7f7a1c0b3550 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:07.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.367+0000 7f7a20f51640 1 -- 172.21.15.105:0/2782209202 >> 172.21.15.105:0/2782209202 conn(0x7f7a1c0cdcc0 msgr2=0x7f7a1c0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:07.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.367+0000 7f7a20f51640 1 -- 172.21.15.105:0/2782209202 shutdown_connections 2024-09-21T03:21:07.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.367+0000 7f7a20f51640 1 -- 172.21.15.105:0/2782209202 wait complete. 2024-09-21T03:21:07.371 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.369+0000 7f7a20f51640 1 Processor -- start 2024-09-21T03:21:07.371 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.369+0000 7f7a20f51640 1 -- start start 2024-09-21T03:21:07.373 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.371+0000 7f7a20f51640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a1c06fec0 0x7f7a1c0c9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:07.373 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.371+0000 7f7a20f51640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a1c0b4090 0x7f7a1c0b2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:07.373 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.371+0000 7f7a20f51640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a1c0cfeb0 0x7f7a1c0c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:07.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.371+0000 7f7a20f51640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1c0b4a30 con 0x7f7a1c06fec0 2024-09-21T03:21:07.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.371+0000 7f7a20f51640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1c0b48b0 con 0x7f7a1c0b4090 2024-09-21T03:21:07.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.371+0000 7f7a20f51640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7a1c0b4bb0 con 0x7f7a1c0cfeb0 2024-09-21T03:21:07.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.371+0000 7f7a1a59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a1c06fec0 0x7f7a1c0c9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:07.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.371+0000 7f7a1a59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a1c06fec0 0x7f7a1c0c9320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:47298/0 (socket says 172.21.15.105:47298) 2024-09-21T03:21:07.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.371+0000 7f7a1a59c640 1 -- 172.21.15.105:0/2581187364 learned_addr learned my addr 172.21.15.105:0/2581187364 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:07.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.371+0000 7f7a1ad9d640 1 --2- 172.21.15.105:0/2581187364 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a1c0cfeb0 0x7f7a1c0c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:07.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.371+0000 7f7a19d9b640 1 --2- 172.21.15.105:0/2581187364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a1c0b4090 0x7f7a1c0b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:07.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.371+0000 7f7a1a59c640 1 -- 172.21.15.105:0/2581187364 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a1c0cfeb0 msgr2=0x7f7a1c0c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:07.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.371+0000 7f7a1a59c640 1 --2- 172.21.15.105:0/2581187364 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a1c0cfeb0 0x7f7a1c0c9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:07.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.371+0000 7f7a1a59c640 1 -- 172.21.15.105:0/2581187364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a1c0b4090 msgr2=0x7f7a1c0b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:07.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.371+0000 7f7a1a59c640 1 --2- 172.21.15.105:0/2581187364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a1c0b4090 0x7f7a1c0b2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:07.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.371+0000 7f7a1a59c640 1 -- 172.21.15.105:0/2581187364 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a1c0cc000 con 0x7f7a1c06fec0 2024-09-21T03:21:07.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.371+0000 7f7a1a59c640 1 --2- 172.21.15.105:0/2581187364 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a1c06fec0 0x7f7a1c0c9320 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c000c00 tx=0x7f7a0c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:07.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.371+0000 7f7a0affd640 1 -- 172.21.15.105:0/2581187364 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c03e030 con 0x7f7a1c06fec0 2024-09-21T03:21:07.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.371+0000 7f7a0affd640 1 -- 172.21.15.105:0/2581187364 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7a0c003ca0 con 0x7f7a1c06fec0 2024-09-21T03:21:07.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.371+0000 7f7a20f51640 1 -- 172.21.15.105:0/2581187364 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a1c0cc2e0 con 0x7f7a1c06fec0 2024-09-21T03:21:07.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.371+0000 7f7a0affd640 1 -- 172.21.15.105:0/2581187364 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c035040 con 0x7f7a1c06fec0 2024-09-21T03:21:07.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.372+0000 7f7a20f51640 1 -- 172.21.15.105:0/2581187364 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a1c0cc8a0 con 0x7f7a1c06fec0 2024-09-21T03:21:07.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.373+0000 7f7a20f51640 1 -- 172.21.15.105:0/2581187364 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a1c0b50d0 con 0x7f7a1c06fec0 2024-09-21T03:21:07.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.373+0000 7f7a0affd640 1 -- 172.21.15.105:0/2581187364 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7a0c041030 con 0x7f7a1c06fec0 2024-09-21T03:21:07.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.374+0000 7f7a0affd640 1 --2- 172.21.15.105:0/2581187364 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f79fc078b90 0x7f79fc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:07.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.374+0000 7f7a0affd640 1 -- 172.21.15.105:0/2581187364 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7f7a0c0baf70 con 0x7f7a1c06fec0 2024-09-21T03:21:07.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.374+0000 7f7a19d9b640 1 --2- 172.21.15.105:0/2581187364 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f79fc078b90 0x7f79fc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:07.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.374+0000 7f7a19d9b640 1 --2- 172.21.15.105:0/2581187364 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f79fc078b90 0x7f79fc07b0a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c0c9b20 tx=0x7f7a1000b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:07.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.378+0000 7f7a0affd640 1 -- 172.21.15.105:0/2581187364 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7a0c083060 con 0x7f7a1c06fec0 2024-09-21T03:21:07.627 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:07.625+0000 7f7a20f51640 1 -- 172.21.15.105:0/2581187364 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_max_caps"]} v 0) -- 0x7f7a1c15edc0 con 0x7f7a1c06fec0 2024-09-21T03:21:08.619 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.617+0000 7f7a0affd640 1 -- 172.21.15.105:0/2581187364 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_max_caps"]}]=0 v154) ==== 151+0+0 (secure 0 0 0) 0x7f7a0c087a90 con 0x7f7a1c06fec0 2024-09-21T03:21:08.622 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.620+0000 7f7a20f51640 1 -- 172.21.15.105:0/2581187364 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f79fc078b90 msgr2=0x7f79fc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:08.622 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.620+0000 7f7a20f51640 1 --2- 172.21.15.105:0/2581187364 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f79fc078b90 0x7f79fc07b0a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c0c9b20 tx=0x7f7a1000b2e0 comp rx=0 tx=0).stop 2024-09-21T03:21:08.622 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.620+0000 7f7a20f51640 1 -- 172.21.15.105:0/2581187364 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a1c06fec0 msgr2=0x7f7a1c0c9320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:08.623 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.620+0000 7f7a20f51640 1 --2- 172.21.15.105:0/2581187364 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a1c06fec0 0x7f7a1c0c9320 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c000c00 tx=0x7f7a0c0038a0 comp rx=0 tx=0).stop 2024-09-21T03:21:08.623 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.620+0000 7f7a20f51640 1 -- 172.21.15.105:0/2581187364 shutdown_connections 2024-09-21T03:21:08.623 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.620+0000 7f7a20f51640 1 --2- 172.21.15.105:0/2581187364 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f79fc078b90 0x7f79fc07b0a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:08.623 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.620+0000 7f7a20f51640 1 --2- 172.21.15.105:0/2581187364 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a1c0cfeb0 0x7f7a1c0c9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:08.623 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.620+0000 7f7a20f51640 1 --2- 172.21.15.105:0/2581187364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a1c0b4090 0x7f7a1c0b2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:08.623 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.620+0000 7f7a20f51640 1 --2- 172.21.15.105:0/2581187364 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a1c06fec0 0x7f7a1c0c9320 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:08.623 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.621+0000 7f7a20f51640 1 -- 172.21.15.105:0/2581187364 >> 172.21.15.105:0/2581187364 conn(0x7f7a1c0cdcc0 msgr2=0x7f7a1c0ae010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:08.623 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.621+0000 7f7a20f51640 1 -- 172.21.15.105:0/2581187364 shutdown_connections 2024-09-21T03:21:08.623 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.621+0000 7f7a20f51640 1 -- 172.21.15.105:0/2581187364 wait complete. 2024-09-21T03:21:08.634 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T03:21:08.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.746+0000 7f23130da640 1 -- 172.21.15.105:0/2761848512 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22f4003f90 msgr2=0x7f22f4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:08.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.746+0000 7f23130da640 1 --2- 172.21.15.105:0/2761848512 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22f4003f90 0x7f22f4004800 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f230c0ced00 tx=0x7f22f4005830 comp rx=0 tx=0).stop 2024-09-21T03:21:08.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.746+0000 7f2311677640 1 -- 172.21.15.105:0/2761848512 reap_dead start 2024-09-21T03:21:08.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.746+0000 7f23130da640 1 -- 172.21.15.105:0/2761848512 shutdown_connections 2024-09-21T03:21:08.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.746+0000 7f23130da640 1 -- 172.21.15.105:0/2761848512 >> 172.21.15.105:0/2761848512 conn(0x7f230c0cdcc0 msgr2=0x7f230c0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:08.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.746+0000 7f23130da640 1 -- 172.21.15.105:0/2761848512 shutdown_connections 2024-09-21T03:21:08.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.746+0000 7f23130da640 1 -- 172.21.15.105:0/2761848512 wait complete. 2024-09-21T03:21:08.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.748+0000 7f23130da640 1 Processor -- start 2024-09-21T03:21:08.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.748+0000 7f23130da640 1 -- start start 2024-09-21T03:21:08.753 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.750+0000 7f23130da640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22f4003f90 0x7f230c14ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:08.753 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.750+0000 7f23130da640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f230c1f59a0 0x7f230c0b5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:08.753 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.750+0000 7f23130da640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f230c1f5db0 0x7f230c0b5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:08.753 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.750+0000 7f23130da640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f230c0b46a0 con 0x7f230c1f59a0 2024-09-21T03:21:08.753 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.750+0000 7f23130da640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f230c0b39b0 con 0x7f22f4003f90 2024-09-21T03:21:08.753 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.750+0000 7f23130da640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f230c0b4820 con 0x7f230c1f5db0 2024-09-21T03:21:08.753 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.750+0000 7f230bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f230c1f59a0 0x7f230c0b5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:08.753 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.750+0000 7f230bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f230c1f59a0 0x7f230c0b5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:47322/0 (socket says 172.21.15.105:47322) 2024-09-21T03:21:08.753 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.750+0000 7f230bfff640 1 -- 172.21.15.105:0/1066906667 learned_addr learned my addr 172.21.15.105:0/1066906667 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:08.753 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.750+0000 7f2310e76640 1 --2- 172.21.15.105:0/1066906667 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22f4003f90 0x7f230c14ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:08.753 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.750+0000 7f2311677640 1 --2- 172.21.15.105:0/1066906667 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f230c1f5db0 0x7f230c0b5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:08.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.750+0000 7f230bfff640 1 -- 172.21.15.105:0/1066906667 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f230c1f5db0 msgr2=0x7f230c0b5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:08.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.750+0000 7f230bfff640 1 --2- 172.21.15.105:0/1066906667 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f230c1f5db0 0x7f230c0b5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:08.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.750+0000 7f230bfff640 1 -- 172.21.15.105:0/1066906667 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22f4003f90 msgr2=0x7f230c14ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:08.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.750+0000 7f230bfff640 1 --2- 172.21.15.105:0/1066906667 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22f4003f90 0x7f230c14ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:08.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.750+0000 7f230bfff640 1 -- 172.21.15.105:0/1066906667 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f230c1f6490 con 0x7f230c1f59a0 2024-09-21T03:21:08.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.750+0000 7f230bfff640 1 --2- 172.21.15.105:0/1066906667 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f230c1f59a0 0x7f230c0b5400 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f230000c350 tx=0x7f2300006310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:08.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.750+0000 7f23097fa640 1 -- 172.21.15.105:0/1066906667 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23000037f0 con 0x7f230c1f59a0 2024-09-21T03:21:08.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.750+0000 7f23097fa640 1 -- 172.21.15.105:0/1066906667 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2300003a80 con 0x7f230c1f59a0 2024-09-21T03:21:08.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.751+0000 7f23130da640 1 -- 172.21.15.105:0/1066906667 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f230c1f6770 con 0x7f230c1f59a0 2024-09-21T03:21:08.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.751+0000 7f23097fa640 1 -- 172.21.15.105:0/1066906667 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230002f480 con 0x7f230c1f59a0 2024-09-21T03:21:08.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.751+0000 7f23130da640 1 -- 172.21.15.105:0/1066906667 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f230c1f6d30 con 0x7f230c1f59a0 2024-09-21T03:21:08.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.751+0000 7f23130da640 1 -- 172.21.15.105:0/1066906667 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f230c0b4db0 con 0x7f230c1f59a0 2024-09-21T03:21:08.755 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.752+0000 7f23097fa640 1 -- 172.21.15.105:0/1066906667 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f230002f620 con 0x7f230c1f59a0 2024-09-21T03:21:08.755 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.753+0000 7f23097fa640 1 --2- 172.21.15.105:0/1066906667 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f22f8078b90 0x7f22f807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:08.755 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.753+0000 7f23097fa640 1 -- 172.21.15.105:0/1066906667 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7f23000bb970 con 0x7f230c1f59a0 2024-09-21T03:21:08.755 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.753+0000 7f2310e76640 1 --2- 172.21.15.105:0/1066906667 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f22f8078b90 0x7f22f807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:08.755 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.754+0000 7f2310e76640 1 --2- 172.21.15.105:0/1066906667 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f22f8078b90 0x7f22f807b0a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f22fc0011a0 tx=0x7f22fc006b10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:08.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.757+0000 7f23097fa640 1 -- 172.21.15.105:0/1066906667 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2300049030 con 0x7f230c1f59a0 2024-09-21T03:21:08.935 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.933+0000 7f23130da640 1 -- 172.21.15.105:0/1066906667 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f230c0b0550 con 0x7f230c1f59a0 2024-09-21T03:21:08.935 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.934+0000 7f23097fa640 1 -- 172.21.15.105:0/1066906667 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v39) ==== 59+0+2294 (secure 0 0 0) 0x7f23000840b0 con 0x7f230c1f59a0 2024-09-21T03:21:08.936 INFO:teuthology.orchestra.run.smithi105.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T03:21:08.936 INFO:teuthology.orchestra.run.smithi105.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T03:21:08.936 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced client_mount_timeout 30 2024-09-21T03:21:08.936 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced debug_client 20/20 2024-09-21T03:21:08.936 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced debug_mgr 20/20 2024-09-21T03:21:08.936 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced debug_ms 1/1 2024-09-21T03:21:08.936 INFO:teuthology.orchestra.run.smithi105.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T03:21:08.936 INFO:teuthology.orchestra.run.smithi105.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T03:21:08.936 INFO:teuthology.orchestra.run.smithi105.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 7291.545169 2024-09-21T03:21:08.936 INFO:teuthology.orchestra.run.smithi105.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5080.142035 2024-09-21T03:21:08.937 INFO:teuthology.orchestra.run.smithi105.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5120.988640 2024-09-21T03:21:08.937 INFO:teuthology.orchestra.run.smithi105.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4938.196268 2024-09-21T03:21:08.937 INFO:teuthology.orchestra.run.smithi105.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4906.316728 2024-09-21T03:21:08.937 INFO:teuthology.orchestra.run.smithi105.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4701.273858 2024-09-21T03:21:08.937 INFO:teuthology.orchestra.run.smithi105.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4947.710044 2024-09-21T03:21:08.937 INFO:teuthology.orchestra.run.smithi105.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5174.949063 2024-09-21T03:21:08.937 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced debug_mds 20/20 2024-09-21T03:21:08.937 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T03:21:08.937 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced debug_ms 2/2 2024-09-21T03:21:08.937 INFO:teuthology.orchestra.run.smithi105.stdout:mds dev mds_debug_frag true 2024-09-21T03:21:08.937 INFO:teuthology.orchestra.run.smithi105.stdout:mds dev mds_debug_scatterstat true 2024-09-21T03:21:08.937 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T03:21:08.937 INFO:teuthology.orchestra.run.smithi105.stdout:mds dev mds_verify_scatter true 2024-09-21T03:21:08.937 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T03:21:08.938 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T03:21:08.938 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T03:21:08.938 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced client_mount_timeout 600 2024-09-21T03:21:08.938 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced debug_client 20/20 2024-09-21T03:21:08.938 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced debug_ms 1/1 2024-09-21T03:21:08.938 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T03:21:08.938 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T03:21:08.939 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.936+0000 7f23130da640 1 -- 172.21.15.105:0/1066906667 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f22f8078b90 msgr2=0x7f22f807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:08.939 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.936+0000 7f23130da640 1 --2- 172.21.15.105:0/1066906667 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f22f8078b90 0x7f22f807b0a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f22fc0011a0 tx=0x7f22fc006b10 comp rx=0 tx=0).stop 2024-09-21T03:21:08.939 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.936+0000 7f23130da640 1 -- 172.21.15.105:0/1066906667 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f230c1f59a0 msgr2=0x7f230c0b5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:08.939 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.936+0000 7f23130da640 1 --2- 172.21.15.105:0/1066906667 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f230c1f59a0 0x7f230c0b5400 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f230000c350 tx=0x7f2300006310 comp rx=0 tx=0).stop 2024-09-21T03:21:08.939 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.936+0000 7f23130da640 1 -- 172.21.15.105:0/1066906667 shutdown_connections 2024-09-21T03:21:08.939 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.936+0000 7f23130da640 1 --2- 172.21.15.105:0/1066906667 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f22f8078b90 0x7f22f807b0a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:08.939 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.936+0000 7f23130da640 1 --2- 172.21.15.105:0/1066906667 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f230c1f5db0 0x7f230c0b5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:08.940 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.936+0000 7f23130da640 1 --2- 172.21.15.105:0/1066906667 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f230c1f59a0 0x7f230c0b5400 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:08.940 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.936+0000 7f23130da640 1 --2- 172.21.15.105:0/1066906667 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22f4003f90 0x7f230c14ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:08.940 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.936+0000 7f23130da640 1 -- 172.21.15.105:0/1066906667 >> 172.21.15.105:0/1066906667 conn(0x7f230c0cdcc0 msgr2=0x7f230c0b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:08.940 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.936+0000 7f23130da640 1 -- 172.21.15.105:0/1066906667 shutdown_connections 2024-09-21T03:21:08.940 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:08.936+0000 7f23130da640 1 -- 172.21.15.105:0/1066906667 wait complete. 2024-09-21T03:21:08.949 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T03:21:09.065 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.063+0000 7f6cd695e640 1 -- 172.21.15.105:0/2456077478 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6cd0074420 msgr2=0x7f6cd006fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:09.065 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.063+0000 7f6cd695e640 1 --2- 172.21.15.105:0/2456077478 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6cd0074420 0x7f6cd006fe30 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0073910 tx=0x7f6cc002a5f0 comp rx=0 tx=0).stop 2024-09-21T03:21:09.065 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.063+0000 7f6cd695e640 1 -- 172.21.15.105:0/2456077478 shutdown_connections 2024-09-21T03:21:09.065 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.063+0000 7f6cd695e640 1 --2- 172.21.15.105:0/2456077478 >> v2:172.21.15.162:3300/0 conn(0x7f6cd015c580 0x7f6cd0070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:09.066 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.063+0000 7f6cd695e640 1 --2- 172.21.15.105:0/2456077478 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6cd0074420 0x7f6cd006fe30 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:09.066 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.063+0000 7f6cd695e640 1 -- 172.21.15.105:0/2456077478 >> 172.21.15.105:0/2456077478 conn(0x7f6cd006def0 msgr2=0x7f6cd006e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:09.066 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.063+0000 7f6cd695e640 1 -- 172.21.15.105:0/2456077478 shutdown_connections 2024-09-21T03:21:09.066 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.063+0000 7f6cd695e640 1 -- 172.21.15.105:0/2456077478 wait complete. 2024-09-21T03:21:09.066 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.065+0000 7f6cd695e640 1 Processor -- start 2024-09-21T03:21:09.067 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.065+0000 7f6cd695e640 1 -- start start 2024-09-21T03:21:09.070 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.066+0000 7f6cd695e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6cd0074420 0x7f6cd0159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:09.070 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.066+0000 7f6cd695e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6cd0155ce0 0x7f6cd01f7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:09.070 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.066+0000 7f6cd695e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cd006cfc0 0x7f6cd006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:09.070 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.066+0000 7f6cd695e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd015f850 con 0x7f6cd0155ce0 2024-09-21T03:21:09.070 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.066+0000 7f6cd695e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd0070b80 con 0x7f6cd006cfc0 2024-09-21T03:21:09.070 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.066+0000 7f6cd695e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6cd015f9d0 con 0x7f6cd0074420 2024-09-21T03:21:09.070 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.066+0000 7f6ccf7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6cd0155ce0 0x7f6cd01f7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:09.070 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.066+0000 7f6ccf7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6cd0155ce0 0x7f6cd01f7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:47336/0 (socket says 172.21.15.105:47336) 2024-09-21T03:21:09.070 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.067+0000 7f6ccf7fe640 1 -- 172.21.15.105:0/1216598248 learned_addr learned my addr 172.21.15.105:0/1216598248 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:09.070 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.067+0000 7f6cd4efb640 1 --2- 172.21.15.105:0/1216598248 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cd006cfc0 0x7f6cd006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:09.070 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.067+0000 7f6ccffff640 1 --2- 172.21.15.105:0/1216598248 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6cd0074420 0x7f6cd0159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:09.070 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.067+0000 7f6ccf7fe640 1 -- 172.21.15.105:0/1216598248 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6cd0074420 msgr2=0x7f6cd0159cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:09.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.067+0000 7f6ccf7fe640 1 --2- 172.21.15.105:0/1216598248 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6cd0074420 0x7f6cd0159cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:09.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.067+0000 7f6ccf7fe640 1 -- 172.21.15.105:0/1216598248 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cd006cfc0 msgr2=0x7f6cd006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:09.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.067+0000 7f6ccf7fe640 1 --2- 172.21.15.105:0/1216598248 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cd006cfc0 0x7f6cd006d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:09.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.067+0000 7f6ccf7fe640 1 -- 172.21.15.105:0/1216598248 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd01f36c0 con 0x7f6cd0155ce0 2024-09-21T03:21:09.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.067+0000 7f6ccffff640 1 --2- 172.21.15.105:0/1216598248 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6cd0074420 0x7f6cd0159cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:21:09.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.067+0000 7f6ccf7fe640 1 --2- 172.21.15.105:0/1216598248 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6cd0155ce0 0x7f6cd01f7590 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f6cc400d6d0 tx=0x7f6cc400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:09.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.067+0000 7f6cccff9640 1 -- 172.21.15.105:0/1216598248 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc4017070 con 0x7f6cd0155ce0 2024-09-21T03:21:09.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.067+0000 7f6cccff9640 1 -- 172.21.15.105:0/1216598248 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6cc4009b10 con 0x7f6cd0155ce0 2024-09-21T03:21:09.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.067+0000 7f6cd695e640 1 -- 172.21.15.105:0/1216598248 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cd01f3960 con 0x7f6cd0155ce0 2024-09-21T03:21:09.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.067+0000 7f6cccff9640 1 -- 172.21.15.105:0/1216598248 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc4010460 con 0x7f6cd0155ce0 2024-09-21T03:21:09.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.067+0000 7f6cd695e640 1 -- 172.21.15.105:0/1216598248 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cd00ccaa0 con 0x7f6cd0155ce0 2024-09-21T03:21:09.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.068+0000 7f6cd695e640 1 -- 172.21.15.105:0/1216598248 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cd006a700 con 0x7f6cd0155ce0 2024-09-21T03:21:09.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.069+0000 7f6cccff9640 1 -- 172.21.15.105:0/1216598248 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6cc401a070 con 0x7f6cd0155ce0 2024-09-21T03:21:09.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.069+0000 7f6cccff9640 1 --2- 172.21.15.105:0/1216598248 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6cbc078b90 0x7f6cbc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:09.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.070+0000 7f6cccff9640 1 -- 172.21.15.105:0/1216598248 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7f6cc409aa90 con 0x7f6cd0155ce0 2024-09-21T03:21:09.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.070+0000 7f6ccffff640 1 --2- 172.21.15.105:0/1216598248 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6cbc078b90 0x7f6cbc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:09.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.070+0000 7f6ccffff640 1 --2- 172.21.15.105:0/1216598248 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6cbc078b90 0x7f6cbc07b0a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0033000 tx=0x7f6cc0004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:09.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.074+0000 7f6cccff9640 1 -- 172.21.15.105:0/1216598248 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6cc4062c10 con 0x7f6cd0155ce0 2024-09-21T03:21:09.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.249+0000 7f6cd695e640 1 -- 172.21.15.105:0/1216598248 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f6cd015a210 con 0x7f6cd0155ce0 2024-09-21T03:21:09.254 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.252+0000 7f6cccff9640 1 -- 172.21.15.105:0/1216598248 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v40)=0 v40) ==== 122+0+0 (secure 0 0 0) 0x7f6cc4067640 con 0x7f6cd0155ce0 2024-09-21T03:21:09.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.254+0000 7f6cd695e640 1 -- 172.21.15.105:0/1216598248 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6cbc078b90 msgr2=0x7f6cbc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:09.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.254+0000 7f6cd695e640 1 --2- 172.21.15.105:0/1216598248 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6cbc078b90 0x7f6cbc07b0a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0033000 tx=0x7f6cc0004730 comp rx=0 tx=0).stop 2024-09-21T03:21:09.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.254+0000 7f6cd695e640 1 -- 172.21.15.105:0/1216598248 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6cd0155ce0 msgr2=0x7f6cd01f7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:09.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.254+0000 7f6cd695e640 1 --2- 172.21.15.105:0/1216598248 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6cd0155ce0 0x7f6cd01f7590 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f6cc400d6d0 tx=0x7f6cc400db90 comp rx=0 tx=0).stop 2024-09-21T03:21:09.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.255+0000 7f6cd695e640 1 -- 172.21.15.105:0/1216598248 shutdown_connections 2024-09-21T03:21:09.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.255+0000 7f6cd695e640 1 --2- 172.21.15.105:0/1216598248 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6cbc078b90 0x7f6cbc07b0a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:09.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.255+0000 7f6cd695e640 1 --2- 172.21.15.105:0/1216598248 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cd006cfc0 0x7f6cd006d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:09.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.255+0000 7f6cd695e640 1 --2- 172.21.15.105:0/1216598248 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6cd0155ce0 0x7f6cd01f7590 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:09.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.255+0000 7f6cd695e640 1 --2- 172.21.15.105:0/1216598248 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6cd0074420 0x7f6cd0159cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:09.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.255+0000 7f6cd695e640 1 -- 172.21.15.105:0/1216598248 >> 172.21.15.105:0/1216598248 conn(0x7f6cd006def0 msgr2=0x7f6cd00cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:09.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.255+0000 7f6cd695e640 1 -- 172.21.15.105:0/1216598248 shutdown_connections 2024-09-21T03:21:09.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.255+0000 7f6cd695e640 1 -- 172.21.15.105:0/1216598248 wait complete. 2024-09-21T03:21:09.267 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T03:21:09.267 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T03:21:09.301 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T03:21:09.341 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T03:21:09.341 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:21:09.341 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:21:09.357 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T03:21:09.357 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:21:09.357 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:21:09.400 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=452 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T03:21:09.400 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:21:09.400 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:21:09.416 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T03:21:09.416 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:21:09.416 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:21:09.458 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=452 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T03:21:09.458 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T03:21:09.459 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:21:09.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.568+0000 7fa195c2e640 1 -- 172.21.15.105:0/1408028444 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1901600b0 msgr2=0x7fa1900ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:09.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.568+0000 7fa195c2e640 1 --2- 172.21.15.105:0/1408028444 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1901600b0 0x7fa1900ccbc0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa1900ce1b0 tx=0x7fa18002a560 comp rx=0 tx=0).stop 2024-09-21T03:21:09.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.568+0000 7fa195c2e640 1 -- 172.21.15.105:0/1408028444 shutdown_connections 2024-09-21T03:21:09.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.568+0000 7fa195c2e640 1 --2- 172.21.15.105:0/1408028444 >> v2:172.21.15.162:3300/0 conn(0x7fa1900b7cc0 0x7fa1900cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:09.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.568+0000 7fa195c2e640 1 --2- 172.21.15.105:0/1408028444 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1901600b0 0x7fa1900ccbc0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:09.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.568+0000 7fa195c2e640 1 -- 172.21.15.105:0/1408028444 >> 172.21.15.105:0/1408028444 conn(0x7fa19006d4f0 msgr2=0x7fa190071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:09.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.568+0000 7fa195c2e640 1 -- 172.21.15.105:0/1408028444 shutdown_connections 2024-09-21T03:21:09.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.568+0000 7fa195c2e640 1 -- 172.21.15.105:0/1408028444 wait complete. 2024-09-21T03:21:09.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.570+0000 7fa195c2e640 1 Processor -- start 2024-09-21T03:21:09.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.570+0000 7fa195c2e640 1 -- start start 2024-09-21T03:21:09.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.571+0000 7fa195c2e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1900b7cc0 0x7fa1900cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:09.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.571+0000 7fa195c2e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1900cf150 0x7fa1901582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:09.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.571+0000 7fa195c2e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1901600b0 0x7fa190158800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:09.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.571+0000 7fa195c2e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa1900b4460 con 0x7fa1901600b0 2024-09-21T03:21:09.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.571+0000 7fa195c2e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa1900d1ba0 con 0x7fa1900b7cc0 2024-09-21T03:21:09.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.571+0000 7fa195c2e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa1900b45e0 con 0x7fa1900cf150 2024-09-21T03:21:09.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.571+0000 7fa18ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1901600b0 0x7fa190158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:09.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.571+0000 7fa18ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1901600b0 0x7fa190158800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:47356/0 (socket says 172.21.15.105:47356) 2024-09-21T03:21:09.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.571+0000 7fa18ffff640 1 -- 172.21.15.105:0/2279319451 learned_addr learned my addr 172.21.15.105:0/2279319451 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:09.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.571+0000 7fa18f7fe640 1 --2- 172.21.15.105:0/2279319451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1900b7cc0 0x7fa1900cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:09.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.571+0000 7fa18effd640 1 --2- 172.21.15.105:0/2279319451 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1900cf150 0x7fa1901582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:09.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.571+0000 7fa18ffff640 1 -- 172.21.15.105:0/2279319451 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1900cf150 msgr2=0x7fa1901582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:09.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.571+0000 7fa18ffff640 1 --2- 172.21.15.105:0/2279319451 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1900cf150 0x7fa1901582c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:09.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.571+0000 7fa18ffff640 1 -- 172.21.15.105:0/2279319451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1900b7cc0 msgr2=0x7fa1900cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:09.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.571+0000 7fa18ffff640 1 --2- 172.21.15.105:0/2279319451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1900b7cc0 0x7fa1900cadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:09.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.571+0000 7fa18ffff640 1 -- 172.21.15.105:0/2279319451 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1900ccb20 con 0x7fa1901600b0 2024-09-21T03:21:09.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.572+0000 7fa18ffff640 1 --2- 172.21.15.105:0/2279319451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1901600b0 0x7fa190158800 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fa18800b9e0 tx=0x7fa18800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:09.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.572+0000 7fa177fff640 1 -- 172.21.15.105:0/2279319451 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa188019070 con 0x7fa1901600b0 2024-09-21T03:21:09.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.572+0000 7fa177fff640 1 -- 172.21.15.105:0/2279319451 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa18800cc10 con 0x7fa1901600b0 2024-09-21T03:21:09.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.572+0000 7fa195c2e640 1 -- 172.21.15.105:0/2279319451 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa190156c00 con 0x7fa1901600b0 2024-09-21T03:21:09.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.572+0000 7fa177fff640 1 -- 172.21.15.105:0/2279319451 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa188014440 con 0x7fa1901600b0 2024-09-21T03:21:09.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.572+0000 7fa195c2e640 1 -- 172.21.15.105:0/2279319451 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1901571c0 con 0x7fa1901600b0 2024-09-21T03:21:09.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.573+0000 7fa195c2e640 1 -- 172.21.15.105:0/2279319451 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1900cec10 con 0x7fa1901600b0 2024-09-21T03:21:09.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.573+0000 7fa177fff640 1 -- 172.21.15.105:0/2279319451 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa18801c070 con 0x7fa1901600b0 2024-09-21T03:21:09.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.574+0000 7fa177fff640 1 --2- 172.21.15.105:0/2279319451 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa17c078b90 0x7fa17c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:09.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.574+0000 7fa177fff640 1 -- 172.21.15.105:0/2279319451 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7fa18809a690 con 0x7fa1901600b0 2024-09-21T03:21:09.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.574+0000 7fa18f7fe640 1 --2- 172.21.15.105:0/2279319451 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa17c078b90 0x7fa17c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:09.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.575+0000 7fa18f7fe640 1 --2- 172.21.15.105:0/2279319451 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa17c078b90 0x7fa17c07b0a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa180033000 tx=0x7fa180004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:09.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.579+0000 7fa177fff640 1 -- 172.21.15.105:0/2279319451 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa188062780 con 0x7fa1901600b0 2024-09-21T03:21:09.791 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.790+0000 7fa195c2e640 1 -- 172.21.15.105:0/2279319451 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa1900b3d00 con 0x7fa1901600b0 2024-09-21T03:21:09.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.790+0000 7fa177fff640 1 -- 172.21.15.105:0/2279319451 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+3920 (secure 0 0 0) 0x7fa1880671b0 con 0x7fa1901600b0 2024-09-21T03:21:09.792 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:09.792 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":34,"btime":"2024-09-21T03:21:03:595348+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5099,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3633306312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3633306312},{"type":"v1","addr":"172.21.15.162:6836","nonce":3633306312}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5356,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3748267738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3748267738},{"type":"v1","addr":"172.21.15.162:6837","nonce":3748267738}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/431670561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":431670561},{"type":"v1","addr":"172.21.15.105:6833","nonce":431670561}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5859,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1719332038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1719332038},{"type":"v1","addr":"172.21.15.105:6835","nonce":1719332038}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[]} 2024-09-21T03:21:09.793 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 34 2024-09-21T03:21:09.794 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.793+0000 7fa195c2e640 1 -- 172.21.15.105:0/2279319451 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa17c078b90 msgr2=0x7fa17c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:09.795 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.793+0000 7fa195c2e640 1 --2- 172.21.15.105:0/2279319451 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa17c078b90 0x7fa17c07b0a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa180033000 tx=0x7fa180004730 comp rx=0 tx=0).stop 2024-09-21T03:21:09.795 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.793+0000 7fa195c2e640 1 -- 172.21.15.105:0/2279319451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1901600b0 msgr2=0x7fa190158800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:09.795 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.793+0000 7fa195c2e640 1 --2- 172.21.15.105:0/2279319451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1901600b0 0x7fa190158800 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fa18800b9e0 tx=0x7fa18800bea0 comp rx=0 tx=0).stop 2024-09-21T03:21:09.795 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.793+0000 7fa195c2e640 1 -- 172.21.15.105:0/2279319451 shutdown_connections 2024-09-21T03:21:09.795 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.793+0000 7fa195c2e640 1 --2- 172.21.15.105:0/2279319451 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa17c078b90 0x7fa17c07b0a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:09.795 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.793+0000 7fa195c2e640 1 --2- 172.21.15.105:0/2279319451 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1901600b0 0x7fa190158800 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:09.795 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.793+0000 7fa195c2e640 1 --2- 172.21.15.105:0/2279319451 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1900cf150 0x7fa1901582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:09.795 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.793+0000 7fa195c2e640 1 --2- 172.21.15.105:0/2279319451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1900b7cc0 0x7fa1900cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:09.795 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.793+0000 7fa195c2e640 1 -- 172.21.15.105:0/2279319451 >> 172.21.15.105:0/2279319451 conn(0x7fa19006d4f0 msgr2=0x7fa1900b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:09.795 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.793+0000 7fa195c2e640 1 -- 172.21.15.105:0/2279319451 shutdown_connections 2024-09-21T03:21:09.795 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.793+0000 7fa195c2e640 1 -- 172.21.15.105:0/2279319451 wait complete. 2024-09-21T03:21:09.806 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T03:21:09.806 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-21T03:21:09.806 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T03:21:09.806 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:21:09.806 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T03:21:09.806 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T03:21:09.807 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T03:21:09.807 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:21:09.807 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T03:21:09.807 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T03:21:09.807 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T03:21:09.807 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:21:09.807 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T03:21:09.807 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T03:21:09.808 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T03:21:09.808 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:21:09.815 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T03:21:09.815 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T03:21:09.819 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T03:21:09.819 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T03:21:09.820 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T03:21:09.820 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T03:21:09.821 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T03:21:09.821 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T03:21:09.861 INFO:tasks.ceph.mds.a:Started 2024-09-21T03:21:09.862 DEBUG:teuthology.parallel:result is None 2024-09-21T03:21:09.862 INFO:tasks.ceph.mds.c:Started 2024-09-21T03:21:09.863 DEBUG:teuthology.parallel:result is None 2024-09-21T03:21:09.864 INFO:tasks.ceph.mds.b:Started 2024-09-21T03:21:09.864 DEBUG:teuthology.parallel:result is None 2024-09-21T03:21:09.864 INFO:tasks.ceph.mds.d:Started 2024-09-21T03:21:09.865 DEBUG:teuthology.parallel:result is None 2024-09-21T03:21:09.865 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T03:21:09.948 INFO:tasks.ceph.mds.c.smithi105.stdout:starting mds.c at 2024-09-21T03:21:09.948 INFO:tasks.ceph.mds.a.smithi105.stdout:starting mds.a at 2024-09-21T03:21:09.957 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-09-21T03:21:09.957 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-09-21T03:21:09.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.983+0000 7f998888b640 1 -- 172.21.15.105:0/330322075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99840b55b0 msgr2=0x7f99841662c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:09.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.983+0000 7f998888b640 1 --2- 172.21.15.105:0/330322075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99840b55b0 0x7f99841662c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f997c005fd0 tx=0x7f997c02c860 comp rx=0 tx=0).stop 2024-09-21T03:21:09.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.983+0000 7f998888b640 1 -- 172.21.15.105:0/330322075 shutdown_connections 2024-09-21T03:21:09.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.983+0000 7f998888b640 1 --2- 172.21.15.105:0/330322075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99840b55b0 0x7f99841662c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:09.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.983+0000 7f998888b640 1 -- 172.21.15.105:0/330322075 >> 172.21.15.105:0/330322075 conn(0x7f998406def0 msgr2=0x7f998406e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:09.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.983+0000 7f998888b640 1 -- 172.21.15.105:0/330322075 shutdown_connections 2024-09-21T03:21:09.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.983+0000 7f998888b640 1 -- 172.21.15.105:0/330322075 wait complete. 2024-09-21T03:21:09.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.985+0000 7f998888b640 1 Processor -- start 2024-09-21T03:21:09.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.985+0000 7f998888b640 1 -- start start 2024-09-21T03:21:09.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.986+0000 7f998888b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9984074420 0x7f9984150f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:09.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.987+0000 7f998888b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99840b55b0 0x7f99841589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:09.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.987+0000 7f998888b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99841f1d40 0x7f998415d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:09.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.987+0000 7f998888b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f998406d170 con 0x7f99840b55b0 2024-09-21T03:21:09.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.987+0000 7f998888b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f998406cff0 con 0x7f9984074420 2024-09-21T03:21:09.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.987+0000 7f998888b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f998406d2f0 con 0x7f99841f1d40 2024-09-21T03:21:09.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.987+0000 7f9981d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99840b55b0 0x7f99841589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:09.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.987+0000 7f9981d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99840b55b0 0x7f99841589c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:47416/0 (socket says 172.21.15.105:47416) 2024-09-21T03:21:09.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.987+0000 7f9981d9b640 1 -- 172.21.15.105:0/2952521583 learned_addr learned my addr 172.21.15.105:0/2952521583 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:09.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.987+0000 7f998259c640 1 --2- 172.21.15.105:0/2952521583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9984074420 0x7f9984150f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:09.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.987+0000 7f9981d9b640 1 -- 172.21.15.105:0/2952521583 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99841f1d40 msgr2=0x7f998415d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:09.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.987+0000 7f9981d9b640 1 --2- 172.21.15.105:0/2952521583 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99841f1d40 0x7f998415d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:09.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.987+0000 7f9981d9b640 1 -- 172.21.15.105:0/2952521583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9984074420 msgr2=0x7f9984150f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:09.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.987+0000 7f9981d9b640 1 --2- 172.21.15.105:0/2952521583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9984074420 0x7f9984150f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:09.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.987+0000 7f9981d9b640 1 -- 172.21.15.105:0/2952521583 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9984159680 con 0x7f99840b55b0 2024-09-21T03:21:09.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.987+0000 7f998259c640 1 --2- 172.21.15.105:0/2952521583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9984074420 0x7f9984150f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:21:09.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.987+0000 7f9981d9b640 1 --2- 172.21.15.105:0/2952521583 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99840b55b0 0x7f99841589c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f99780013c0 tx=0x7f997800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:09.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.987+0000 7f9972ffd640 1 -- 172.21.15.105:0/2952521583 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9978016020 con 0x7f99840b55b0 2024-09-21T03:21:09.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.987+0000 7f9972ffd640 1 -- 172.21.15.105:0/2952521583 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f997800a8d0 con 0x7f99840b55b0 2024-09-21T03:21:09.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.987+0000 7f9972ffd640 1 -- 172.21.15.105:0/2952521583 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997800ace0 con 0x7f99840b55b0 2024-09-21T03:21:09.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.988+0000 7f998888b640 1 -- 172.21.15.105:0/2952521583 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99841593a0 con 0x7f99840b55b0 2024-09-21T03:21:09.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.988+0000 7f998888b640 1 -- 172.21.15.105:0/2952521583 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99841f1540 con 0x7f99840b55b0 2024-09-21T03:21:09.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.988+0000 7f998888b640 1 -- 172.21.15.105:0/2952521583 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f998406a700 con 0x7f99840b55b0 2024-09-21T03:21:09.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.989+0000 7f9972ffd640 1 -- 172.21.15.105:0/2952521583 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9978019020 con 0x7f99840b55b0 2024-09-21T03:21:09.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.990+0000 7f9972ffd640 1 --2- 172.21.15.105:0/2952521583 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9964078b90 0x7f996407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:09.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.990+0000 7f9972ffd640 1 -- 172.21.15.105:0/2952521583 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7f997809a740 con 0x7f99840b55b0 2024-09-21T03:21:09.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.990+0000 7f998259c640 1 --2- 172.21.15.105:0/2952521583 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9964078b90 0x7f996407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:09.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.991+0000 7f998259c640 1 --2- 172.21.15.105:0/2952521583 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9964078b90 0x7f996407b0a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9974001120 tx=0x7f9974009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:09.996 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:09.995+0000 7f9972ffd640 1 -- 172.21.15.105:0/2952521583 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f998406a700 con 0x7f99840b55b0 2024-09-21T03:21:10.183 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:10.181+0000 7f998888b640 1 -- 172.21.15.105:0/2952521583 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f99841f1050 con 0x7f99840b55b0 2024-09-21T03:21:11.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.279+0000 7f9972ffd640 1 -- 172.21.15.105:0/2952521583 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v65) ==== 97+0+0 (secure 0 0 0) 0x7f9978020030 con 0x7f99840b55b0 2024-09-21T03:21:11.281 INFO:teuthology.orchestra.run.smithi105.stderr: removed all blocklist entries 2024-09-21T03:21:11.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.282+0000 7f998888b640 1 -- 172.21.15.105:0/2952521583 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9964078b90 msgr2=0x7f996407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:11.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.282+0000 7f998888b640 1 --2- 172.21.15.105:0/2952521583 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9964078b90 0x7f996407b0a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9974001120 tx=0x7f9974009040 comp rx=0 tx=0).stop 2024-09-21T03:21:11.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.282+0000 7f998888b640 1 -- 172.21.15.105:0/2952521583 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99840b55b0 msgr2=0x7f99841589c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:11.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.282+0000 7f998888b640 1 --2- 172.21.15.105:0/2952521583 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99840b55b0 0x7f99841589c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f99780013c0 tx=0x7f997800cb90 comp rx=0 tx=0).stop 2024-09-21T03:21:11.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.282+0000 7f998888b640 1 -- 172.21.15.105:0/2952521583 shutdown_connections 2024-09-21T03:21:11.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.282+0000 7f998888b640 1 --2- 172.21.15.105:0/2952521583 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9964078b90 0x7f996407b0a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:11.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.282+0000 7f998888b640 1 --2- 172.21.15.105:0/2952521583 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99841f1d40 0x7f998415d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:11.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.282+0000 7f998888b640 1 --2- 172.21.15.105:0/2952521583 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99840b55b0 0x7f99841589c0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:11.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.282+0000 7f998888b640 1 --2- 172.21.15.105:0/2952521583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9984074420 0x7f9984150f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:11.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.282+0000 7f998888b640 1 -- 172.21.15.105:0/2952521583 >> 172.21.15.105:0/2952521583 conn(0x7f998406def0 msgr2=0x7f998406e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:11.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.282+0000 7f998888b640 1 -- 172.21.15.105:0/2952521583 shutdown_connections 2024-09-21T03:21:11.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.282+0000 7f998888b640 1 -- 172.21.15.105:0/2952521583 wait complete. 2024-09-21T03:21:11.297 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T03:21:11.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.415+0000 7febbd827640 1 -- 172.21.15.105:0/2574509133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feba4004060 msgr2=0x7feba4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:11.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.415+0000 7febbd827640 1 --2- 172.21.15.105:0/2574509133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feba4004060 0x7feba4004800 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7feba000bbe0 tx=0x7feba4005830 comp rx=0 tx=0).stop 2024-09-21T03:21:11.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.415+0000 7febb77fe640 1 -- 172.21.15.105:0/2574509133 reap_dead start 2024-09-21T03:21:11.418 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.415+0000 7febbd827640 1 -- 172.21.15.105:0/2574509133 shutdown_connections 2024-09-21T03:21:11.418 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.415+0000 7febbd827640 1 -- 172.21.15.105:0/2574509133 >> 172.21.15.105:0/2574509133 conn(0x7febb808bfc0 msgr2=0x7febb809d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:11.418 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.415+0000 7febbd827640 1 -- 172.21.15.105:0/2574509133 shutdown_connections 2024-09-21T03:21:11.418 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.415+0000 7febbd827640 1 -- 172.21.15.105:0/2574509133 wait complete. 2024-09-21T03:21:11.418 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.417+0000 7febbd827640 1 Processor -- start 2024-09-21T03:21:11.419 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.417+0000 7febbd827640 1 -- start start 2024-09-21T03:21:11.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.418+0000 7febbd827640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feba4004060 0x7febb80b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:11.422 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.418+0000 7febbd827640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febb80b12c0 0x7febb815ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:11.422 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.418+0000 7febbd827640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febb80cdc60 0x7febb80ce070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:11.422 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.418+0000 7febbd827640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7febb81626e0 con 0x7feba4004060 2024-09-21T03:21:11.422 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.418+0000 7febbd827640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7febb80cfed0 con 0x7febb80cdc60 2024-09-21T03:21:11.422 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.418+0000 7febbd827640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7febb8162860 con 0x7febb80b12c0 2024-09-21T03:21:11.422 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.419+0000 7febb6ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feba4004060 0x7febb80b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:11.422 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.419+0000 7febb6ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feba4004060 0x7febb80b21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:47478/0 (socket says 172.21.15.105:47478) 2024-09-21T03:21:11.422 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.419+0000 7febb6ffd640 1 -- 172.21.15.105:0/47389854 learned_addr learned my addr 172.21.15.105:0/47389854 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:11.422 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.419+0000 7febb77fe640 1 --2- 172.21.15.105:0/47389854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febb80cdc60 0x7febb80ce070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:11.422 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.419+0000 7febae7fc640 1 --2- 172.21.15.105:0/47389854 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febb80b12c0 0x7febb815ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:11.422 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.419+0000 7febb6ffd640 1 -- 172.21.15.105:0/47389854 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febb80b12c0 msgr2=0x7febb815ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:11.422 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.419+0000 7febb6ffd640 1 --2- 172.21.15.105:0/47389854 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febb80b12c0 0x7febb815ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:11.423 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.419+0000 7febb6ffd640 1 -- 172.21.15.105:0/47389854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febb80cdc60 msgr2=0x7febb80ce070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:11.423 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.419+0000 7febb6ffd640 1 --2- 172.21.15.105:0/47389854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febb80cdc60 0x7febb80ce070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:11.423 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.419+0000 7febb6ffd640 1 -- 172.21.15.105:0/47389854 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb80ce5b0 con 0x7feba4004060 2024-09-21T03:21:11.423 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.419+0000 7febae7fc640 1 --2- 172.21.15.105:0/47389854 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febb80b12c0 0x7febb815ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:21:11.423 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.419+0000 7febb77fe640 1 --2- 172.21.15.105:0/47389854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febb80cdc60 0x7febb80ce070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:21:11.423 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.419+0000 7febb6ffd640 1 --2- 172.21.15.105:0/47389854 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feba4004060 0x7febb80b21b0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7feba8006600 tx=0x7feba80039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:11.423 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.419+0000 7febb4ff9640 1 -- 172.21.15.105:0/47389854 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba8015070 con 0x7feba4004060 2024-09-21T03:21:11.423 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.419+0000 7febb4ff9640 1 -- 172.21.15.105:0/47389854 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feba8011900 con 0x7feba4004060 2024-09-21T03:21:11.423 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.419+0000 7febbd827640 1 -- 172.21.15.105:0/47389854 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febb80cb4f0 con 0x7feba4004060 2024-09-21T03:21:11.423 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.419+0000 7febb4ff9640 1 -- 172.21.15.105:0/47389854 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba8011d50 con 0x7feba4004060 2024-09-21T03:21:11.423 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.419+0000 7febbd827640 1 -- 172.21.15.105:0/47389854 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febb80cba70 con 0x7feba4004060 2024-09-21T03:21:11.423 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.420+0000 7febbd827640 1 -- 172.21.15.105:0/47389854 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febb80cf090 con 0x7feba4004060 2024-09-21T03:21:11.424 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.421+0000 7febb4ff9640 1 -- 172.21.15.105:0/47389854 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feba8018070 con 0x7feba4004060 2024-09-21T03:21:11.424 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.422+0000 7febb4ff9640 1 --2- 172.21.15.105:0/47389854 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7feb98078b90 0x7feb9807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:11.424 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.422+0000 7febb4ff9640 1 -- 172.21.15.105:0/47389854 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 4857+0+0 (secure 0 0 0) 0x7feba809b7c0 con 0x7feba4004060 2024-09-21T03:21:11.424 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.422+0000 7febae7fc640 1 --2- 172.21.15.105:0/47389854 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7feb98078b90 0x7feb9807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:11.424 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.422+0000 7febae7fc640 1 --2- 172.21.15.105:0/47389854 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7feb98078b90 0x7feb9807b0a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7feba0035000 tx=0x7feba00046c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:11.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.426+0000 7febb4ff9640 1 -- 172.21.15.105:0/47389854 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7febb80ce5b0 con 0x7feba4004060 2024-09-21T03:21:11.675 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.674+0000 7febbd827640 1 -- 172.21.15.105:0/47389854 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7febb80b47e0 con 0x7feba4004060 2024-09-21T03:21:11.676 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.674+0000 7febb4ff9640 1 -- 172.21.15.105:0/47389854 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) ==== 80+0+5304 (secure 0 0 0) 0x7feba8064070 con 0x7feba4004060 2024-09-21T03:21:11.676 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:11.676 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-21T03:21:11.676 INFO:teuthology.orchestra.run.smithi105.stdout: "auth_dump": [ 2024-09-21T03:21:11.676 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:21:11.676 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mds.a", 2024-09-21T03:21:11.676 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mtIIZDhAAJIXLpzTFBOFhnOwLzsdL6w==", 2024-09-21T03:21:11.677 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:21:11.677 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:21:11.677 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:21:11.677 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:21:11.677 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:21:11.677 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:11.677 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:21:11.677 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:21:11.677 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mds.b", 2024-09-21T03:21:11.677 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mGKANGxAAeAuUYMtLP7GXKfIELR7qMA==", 2024-09-21T03:21:11.677 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:21:11.677 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:21:11.677 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:21:11.678 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:21:11.678 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:21:11.678 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:11.678 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:21:11.678 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:21:11.678 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mds.c", 2024-09-21T03:21:11.678 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mwQzQFRAAElYtgnIdYzzkeg8AtiU+kA==", 2024-09-21T03:21:11.678 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:21:11.678 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:21:11.678 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:21:11.678 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:21:11.678 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:21:11.678 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:11.679 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:21:11.679 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:21:11.679 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mds.d", 2024-09-21T03:21:11.679 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mZkWyIhAAu4XWptFcbDrYjozzrgMcGQ==", 2024-09-21T03:21:11.679 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:21:11.679 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:21:11.679 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:21:11.679 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:21:11.679 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:21:11.679 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:11.679 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:21:11.679 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:21:11.679 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.0", 2024-09-21T03:21:11.679 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDMOu5mrSk2BRAAuEPjuEeUJEI3Sa2fiLaJyw==", 2024-09-21T03:21:11.680 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:21:11.680 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:21:11.680 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:21:11.680 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:21:11.680 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:11.680 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:21:11.680 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:21:11.680 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.1", 2024-09-21T03:21:11.680 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDPOu5mAT4UCBAAase7NV3ARBSu4QloaQdlzA==", 2024-09-21T03:21:11.680 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:21:11.680 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:21:11.680 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:21:11.680 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:21:11.680 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:11.681 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:21:11.681 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:21:11.681 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.2", 2024-09-21T03:21:11.681 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDSOu5ma4LRChAASottrmolMcagbspeyGVzBQ==", 2024-09-21T03:21:11.681 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:21:11.681 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:21:11.681 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:21:11.681 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:21:11.681 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:11.681 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:21:11.681 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:21:11.681 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.3", 2024-09-21T03:21:11.681 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDVOu5mD5RWHBAAKuNr4F3GA0EP566aQ07ZVw==", 2024-09-21T03:21:11.681 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:21:11.682 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:21:11.682 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:21:11.682 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:21:11.682 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:11.682 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:21:11.682 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:21:11.682 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.4", 2024-09-21T03:21:11.682 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDcOu5m++UBChAAqmgoPBQ/as4tc+UQPwaflg==", 2024-09-21T03:21:11.682 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:21:11.682 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:21:11.682 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:21:11.682 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:21:11.682 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:11.682 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:21:11.683 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:21:11.683 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.5", 2024-09-21T03:21:11.683 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDfOu5maYYZKRAA1ungglTU3TW1B/XNRjBuZQ==", 2024-09-21T03:21:11.683 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:21:11.683 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:21:11.683 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:21:11.683 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:21:11.683 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:11.683 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:21:11.683 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:21:11.683 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.6", 2024-09-21T03:21:11.683 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDjOu5mmwIqHBAAf6oNdLNkmM9yufP8XA2+og==", 2024-09-21T03:21:11.683 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:21:11.683 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:21:11.683 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:21:11.684 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:21:11.684 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:11.684 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:21:11.684 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:21:11.684 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.7", 2024-09-21T03:21:11.684 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDmOu5mtCciHhAAPTnZubJ+7mGXcXZykCWxHg==", 2024-09-21T03:21:11.684 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:21:11.684 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:21:11.684 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:21:11.684 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:21:11.684 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:11.684 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:21:11.684 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:21:11.684 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.0", 2024-09-21T03:21:11.685 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mughoJxAAhY0bzJmq+oNyzCdtafkC9w==", 2024-09-21T03:21:11.685 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:21:11.685 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:21:11.685 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow r", 2024-09-21T03:21:11.685 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-21T03:21:11.685 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:11.685 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:21:11.685 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:21:11.685 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.1", 2024-09-21T03:21:11.685 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5m4Vn2LhAAnEa/01ql5quuRCVHOVwB7w==", 2024-09-21T03:21:11.685 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:21:11.685 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:21:11.685 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow r", 2024-09-21T03:21:11.686 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow rw", 2024-09-21T03:21:11.686 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow rwx" 2024-09-21T03:21:11.686 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:11.686 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:21:11.686 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:21:11.686 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.2", 2024-09-21T03:21:11.686 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mKi0mKxAAoetnL61ujgtg2cvscdjCLQ==", 2024-09-21T03:21:11.686 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:21:11.686 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:21:11.686 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow r", 2024-09-21T03:21:11.686 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow rw", 2024-09-21T03:21:11.686 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow rwx" 2024-09-21T03:21:11.686 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:11.686 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:21:11.687 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:21:11.687 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.3", 2024-09-21T03:21:11.687 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mWZDAMhAAs4BuFHMSkJa6+piN/FeeXQ==", 2024-09-21T03:21:11.687 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:21:11.687 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:21:11.687 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow r", 2024-09-21T03:21:11.687 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow rw", 2024-09-21T03:21:11.687 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow rwx" 2024-09-21T03:21:11.687 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:11.687 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:21:11.687 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:21:11.687 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.admin", 2024-09-21T03:21:11.687 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDHOu5m4JRYLBAAgZ8nh5VIiWhuZ4+vrnmngw==", 2024-09-21T03:21:11.687 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:21:11.687 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow *", 2024-09-21T03:21:11.688 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:21:11.688 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:21:11.688 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:21:11.688 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:11.688 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:21:11.688 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:21:11.688 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mgr.x", 2024-09-21T03:21:11.688 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5m92lTChAAQ61muQmc6uBs7b5mq3Zt8g==", 2024-09-21T03:21:11.688 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:21:11.688 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow *", 2024-09-21T03:21:11.688 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile mgr", 2024-09-21T03:21:11.688 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:21:11.688 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:11.688 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:21:11.689 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:21:11.689 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mgr.y", 2024-09-21T03:21:11.689 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mh07bBRAAflFF00xr1ew4zttUi5TGng==", 2024-09-21T03:21:11.689 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:21:11.689 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow *", 2024-09-21T03:21:11.689 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile mgr", 2024-09-21T03:21:11.689 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:21:11.689 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:11.689 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:11.689 INFO:teuthology.orchestra.run.smithi105.stdout: ] 2024-09-21T03:21:11.689 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-21T03:21:11.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.676+0000 7febbd827640 1 -- 172.21.15.105:0/47389854 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7feb98078b90 msgr2=0x7feb9807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:11.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.676+0000 7febbd827640 1 --2- 172.21.15.105:0/47389854 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7feb98078b90 0x7feb9807b0a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7feba0035000 tx=0x7feba00046c0 comp rx=0 tx=0).stop 2024-09-21T03:21:11.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.677+0000 7febbd827640 1 -- 172.21.15.105:0/47389854 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feba4004060 msgr2=0x7febb80b21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:11.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.677+0000 7febbd827640 1 --2- 172.21.15.105:0/47389854 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feba4004060 0x7febb80b21b0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7feba8006600 tx=0x7feba80039c0 comp rx=0 tx=0).stop 2024-09-21T03:21:11.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.677+0000 7febbd827640 1 -- 172.21.15.105:0/47389854 shutdown_connections 2024-09-21T03:21:11.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.677+0000 7febbd827640 1 --2- 172.21.15.105:0/47389854 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7feb98078b90 0x7feb9807b0a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:11.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.677+0000 7febbd827640 1 --2- 172.21.15.105:0/47389854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febb80cdc60 0x7febb80ce070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:11.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.677+0000 7febbd827640 1 --2- 172.21.15.105:0/47389854 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febb80b12c0 0x7febb815ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:11.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.677+0000 7febbd827640 1 --2- 172.21.15.105:0/47389854 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feba4004060 0x7febb80b21b0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:11.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.677+0000 7febbd827640 1 -- 172.21.15.105:0/47389854 >> 172.21.15.105:0/47389854 conn(0x7febb808bfc0 msgr2=0x7febb80d3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:11.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.677+0000 7febbd827640 1 -- 172.21.15.105:0/47389854 shutdown_connections 2024-09-21T03:21:11.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.677+0000 7febbd827640 1 -- 172.21.15.105:0/47389854 wait complete. 2024-09-21T03:21:11.692 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T03:21:11.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.802+0000 7fba8e169640 1 -- 172.21.15.105:0/1493038172 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fba880cf150 msgr2=0x7fba880b3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:11.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.802+0000 7fba8e169640 1 --2- 172.21.15.105:0/1493038172 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fba880cf150 0x7fba880b3d50 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fba880cf9f0 tx=0x7fba8002aa30 comp rx=0 tx=0).stop 2024-09-21T03:21:11.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.802+0000 7fba8e169640 1 -- 172.21.15.105:0/1493038172 shutdown_connections 2024-09-21T03:21:11.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.802+0000 7fba8e169640 1 --2- 172.21.15.105:0/1493038172 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fba880cf150 0x7fba880b3d50 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:11.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.802+0000 7fba8e169640 1 --2- 172.21.15.105:0/1493038172 >> v2:172.21.15.162:3300/0 conn(0x7fba880b7cc0 0x7fba880cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:11.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.802+0000 7fba8e169640 1 --2- 172.21.15.105:0/1493038172 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba881600b0 0x7fba880ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:11.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.802+0000 7fba8e169640 1 -- 172.21.15.105:0/1493038172 >> 172.21.15.105:0/1493038172 conn(0x7fba8806d4f0 msgr2=0x7fba88071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:11.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.802+0000 7fba8e169640 1 -- 172.21.15.105:0/1493038172 shutdown_connections 2024-09-21T03:21:11.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.802+0000 7fba8e169640 1 -- 172.21.15.105:0/1493038172 wait complete. 2024-09-21T03:21:11.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.804+0000 7fba8e169640 1 Processor -- start 2024-09-21T03:21:11.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.804+0000 7fba8e169640 1 -- start start 2024-09-21T03:21:11.808 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.805+0000 7fba8e169640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba880b7cc0 0x7fba881506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:11.808 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.805+0000 7fba8e169640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fba880cf150 0x7fba880cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:11.809 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.805+0000 7fba8e169640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba881600b0 0x7fba880cc210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:11.809 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.805+0000 7fba8e169640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fba880b4620 con 0x7fba880cf150 2024-09-21T03:21:11.809 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.805+0000 7fba8e169640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fba880b44a0 con 0x7fba880b7cc0 2024-09-21T03:21:11.809 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.805+0000 7fba8e169640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fba880b47a0 con 0x7fba881600b0 2024-09-21T03:21:11.809 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.805+0000 7fba86ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fba880cf150 0x7fba880cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:11.809 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.805+0000 7fba86ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fba880cf150 0x7fba880cbcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:47494/0 (socket says 172.21.15.105:47494) 2024-09-21T03:21:11.809 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.805+0000 7fba86ffd640 1 -- 172.21.15.105:0/1057276626 learned_addr learned my addr 172.21.15.105:0/1057276626 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:11.809 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.806+0000 7fba877fe640 1 --2- 172.21.15.105:0/1057276626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba880b7cc0 0x7fba881506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:11.809 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.806+0000 7fba87fff640 1 --2- 172.21.15.105:0/1057276626 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba881600b0 0x7fba880cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:11.809 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.806+0000 7fba86ffd640 1 -- 172.21.15.105:0/1057276626 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba881600b0 msgr2=0x7fba880cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:11.809 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.806+0000 7fba86ffd640 1 --2- 172.21.15.105:0/1057276626 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba881600b0 0x7fba880cc210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:11.809 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.806+0000 7fba86ffd640 1 -- 172.21.15.105:0/1057276626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba880b7cc0 msgr2=0x7fba881506c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:11.809 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.806+0000 7fba86ffd640 1 --2- 172.21.15.105:0/1057276626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba880b7cc0 0x7fba881506c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:11.809 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.806+0000 7fba86ffd640 1 -- 172.21.15.105:0/1057276626 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba880c9a60 con 0x7fba880cf150 2024-09-21T03:21:11.810 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.806+0000 7fba877fe640 1 --2- 172.21.15.105:0/1057276626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba880b7cc0 0x7fba881506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:21:11.810 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.806+0000 7fba87fff640 1 --2- 172.21.15.105:0/1057276626 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba881600b0 0x7fba880cc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:21:11.810 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.806+0000 7fba86ffd640 1 --2- 172.21.15.105:0/1057276626 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fba880cf150 0x7fba880cbcd0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fba7c00b410 tx=0x7fba7c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:11.810 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.806+0000 7fba6ffff640 1 -- 172.21.15.105:0/1057276626 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7c015020 con 0x7fba880cf150 2024-09-21T03:21:11.810 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.806+0000 7fba6ffff640 1 -- 172.21.15.105:0/1057276626 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba7c011940 con 0x7fba880cf150 2024-09-21T03:21:11.810 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.806+0000 7fba8e169640 1 -- 172.21.15.105:0/1057276626 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba880c9d40 con 0x7fba880cf150 2024-09-21T03:21:11.810 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.806+0000 7fba6ffff640 1 -- 172.21.15.105:0/1057276626 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7c011d90 con 0x7fba880cf150 2024-09-21T03:21:11.810 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.806+0000 7fba8e169640 1 -- 172.21.15.105:0/1057276626 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba880ca300 con 0x7fba880cf150 2024-09-21T03:21:11.810 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.807+0000 7fba8e169640 1 -- 172.21.15.105:0/1057276626 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba880b3d50 con 0x7fba880cf150 2024-09-21T03:21:11.811 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.808+0000 7fba6ffff640 1 -- 172.21.15.105:0/1057276626 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fba7c018020 con 0x7fba880cf150 2024-09-21T03:21:11.811 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.808+0000 7fba6ffff640 1 --2- 172.21.15.105:0/1057276626 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fba74078b90 0x7fba7407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:11.811 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.808+0000 7fba6ffff640 1 -- 172.21.15.105:0/1057276626 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 4857+0+0 (secure 0 0 0) 0x7fba7c09a930 con 0x7fba880cf150 2024-09-21T03:21:11.811 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.809+0000 7fba877fe640 1 --2- 172.21.15.105:0/1057276626 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fba74078b90 0x7fba7407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:11.811 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.809+0000 7fba877fe640 1 --2- 172.21.15.105:0/1057276626 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fba74078b90 0x7fba7407b0a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fba7800a870 tx=0x7fba78008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:11.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.813+0000 7fba6ffff640 1 -- 172.21.15.105:0/1057276626 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fba7c01f020 con 0x7fba880cf150 2024-09-21T03:21:11.993 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.991+0000 7fba8e169640 1 -- 172.21.15.105:0/1057276626 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fba880cccb0 con 0x7fba880cf150 2024-09-21T03:21:11.993 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.991+0000 7fba6ffff640 1 -- 172.21.15.105:0/1057276626 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v65) ==== 84+0+65 (secure 0 0 0) 0x7fba7c063150 con 0x7fba880cf150 2024-09-21T03:21:11.993 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:11.993 INFO:teuthology.orchestra.run.smithi105.stdout:[ 2024-09-21T03:21:11.993 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:21:11.993 INFO:teuthology.orchestra.run.smithi105.stdout: "poolnum": 1, 2024-09-21T03:21:11.993 INFO:teuthology.orchestra.run.smithi105.stdout: "poolname": ".mgr" 2024-09-21T03:21:11.993 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:11.993 INFO:teuthology.orchestra.run.smithi105.stdout:] 2024-09-21T03:21:11.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.993+0000 7fba8e169640 1 -- 172.21.15.105:0/1057276626 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fba74078b90 msgr2=0x7fba7407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:11.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.993+0000 7fba8e169640 1 --2- 172.21.15.105:0/1057276626 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fba74078b90 0x7fba7407b0a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fba7800a870 tx=0x7fba78008040 comp rx=0 tx=0).stop 2024-09-21T03:21:11.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.993+0000 7fba8e169640 1 -- 172.21.15.105:0/1057276626 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fba880cf150 msgr2=0x7fba880cbcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:11.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.993+0000 7fba8e169640 1 --2- 172.21.15.105:0/1057276626 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fba880cf150 0x7fba880cbcd0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fba7c00b410 tx=0x7fba7c00b8d0 comp rx=0 tx=0).stop 2024-09-21T03:21:11.996 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.993+0000 7fba8e169640 1 -- 172.21.15.105:0/1057276626 shutdown_connections 2024-09-21T03:21:11.996 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.993+0000 7fba8e169640 1 --2- 172.21.15.105:0/1057276626 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fba74078b90 0x7fba7407b0a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:11.996 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.993+0000 7fba8e169640 1 --2- 172.21.15.105:0/1057276626 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fba881600b0 0x7fba880cc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:11.996 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.993+0000 7fba8e169640 1 --2- 172.21.15.105:0/1057276626 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fba880cf150 0x7fba880cbcd0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:11.996 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.993+0000 7fba8e169640 1 --2- 172.21.15.105:0/1057276626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba880b7cc0 0x7fba881506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:11.996 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.993+0000 7fba8e169640 1 -- 172.21.15.105:0/1057276626 >> 172.21.15.105:0/1057276626 conn(0x7fba8806d4f0 msgr2=0x7fba880d2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:11.996 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.993+0000 7fba8e169640 1 -- 172.21.15.105:0/1057276626 shutdown_connections 2024-09-21T03:21:11.996 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:11.993+0000 7fba8e169640 1 -- 172.21.15.105:0/1057276626 wait complete. 2024-09-21T03:21:12.006 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T03:21:12.007 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T03:21:12.122 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:12.121+0000 7f07ab157640 1 -- 172.21.15.105:0/1276207067 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07a415cc30 msgr2=0x7f07a4160a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:12.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:12.121+0000 7f07ab157640 1 --2- 172.21.15.105:0/1276207067 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07a415cc30 0x7f07a4160a00 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f0794005fd0 tx=0x7f079402a5d0 comp rx=0 tx=0).stop 2024-09-21T03:21:12.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:12.121+0000 7f07ab157640 1 -- 172.21.15.105:0/1276207067 shutdown_connections 2024-09-21T03:21:12.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:12.121+0000 7f07ab157640 1 --2- 172.21.15.105:0/1276207067 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07a415cc30 0x7f07a4160a00 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:12.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:12.121+0000 7f07ab157640 1 --2- 172.21.15.105:0/1276207067 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07a415a310 0x7f07a40d1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:12.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:12.121+0000 7f07ab157640 1 -- 172.21.15.105:0/1276207067 >> 172.21.15.105:0/1276207067 conn(0x7f07a40ced50 msgr2=0x7f07a40cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:12.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:12.121+0000 7f07ab157640 1 -- 172.21.15.105:0/1276207067 shutdown_connections 2024-09-21T03:21:12.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:12.121+0000 7f07ab157640 1 -- 172.21.15.105:0/1276207067 wait complete. 2024-09-21T03:21:12.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:12.122+0000 7f07ab157640 1 Processor -- start 2024-09-21T03:21:12.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:12.122+0000 7f07ab157640 1 -- start start 2024-09-21T03:21:12.127 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:12.124+0000 7f07ab157640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07a4071090 0x7f07a41f4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:12.127 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:12.124+0000 7f07ab157640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07a415a310 0x7f07a4148280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:12.127 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:12.124+0000 7f07ab157640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07a415cc30 0x7f07a40ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:12.127 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:12.124+0000 7f07ab157640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f07a40d01a0 con 0x7f07a415a310 2024-09-21T03:21:12.127 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:12.124+0000 7f07ab157640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f07a40d0020 con 0x7f07a415cc30 2024-09-21T03:21:12.127 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:12.124+0000 7f07ab157640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f07a40d0320 con 0x7f07a4071090 2024-09-21T03:21:12.127 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:12.124+0000 7f079bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07a415a310 0x7f07a4148280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:12.127 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:12.124+0000 7f079bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07a415a310 0x7f07a4148280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:47504/0 (socket says 172.21.15.105:47504) 2024-09-21T03:21:12.128 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:12.124+0000 7f079bfff640 1 -- 172.21.15.105:0/3252324098 learned_addr learned my addr 172.21.15.105:0/3252324098 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:12.128 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:12.124+0000 7f07a8ef3640 1 --2- 172.21.15.105:0/3252324098 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07a4071090 0x7f07a41f4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:12.128 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:12.124+0000 7f07a96f4640 1 --2- 172.21.15.105:0/3252324098 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07a415cc30 0x7f07a40ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:12.128 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:12.124+0000 7f079bfff640 1 -- 172.21.15.105:0/3252324098 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07a4071090 msgr2=0x7f07a41f4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:12.128 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:12.124+0000 7f079bfff640 1 --2- 172.21.15.105:0/3252324098 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07a4071090 0x7f07a41f4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:12.128 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:12.124+0000 7f079bfff640 1 -- 172.21.15.105:0/3252324098 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07a415cc30 msgr2=0x7f07a40ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:12.128 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:12.124+0000 7f079bfff640 1 --2- 172.21.15.105:0/3252324098 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07a415cc30 0x7f07a40ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:12.128 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:12.124+0000 7f079bfff640 1 -- 172.21.15.105:0/3252324098 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07a41f4770 con 0x7f07a415a310 2024-09-21T03:21:12.128 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:12.125+0000 7f079bfff640 1 --2- 172.21.15.105:0/3252324098 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07a415a310 0x7f07a4148280 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f0794034040 tx=0x7f07940035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:12.129 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:12.125+0000 7f07997fa640 1 -- 172.21.15.105:0/3252324098 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f079403e030 con 0x7f07a415a310 2024-09-21T03:21:12.129 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:12.125+0000 7f07997fa640 1 -- 172.21.15.105:0/3252324098 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0794003ae0 con 0x7f07a415a310 2024-09-21T03:21:12.129 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:12.125+0000 7f07ab157640 1 -- 172.21.15.105:0/3252324098 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07a40c9440 con 0x7f07a415a310 2024-09-21T03:21:12.129 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:12.125+0000 7f07997fa640 1 -- 172.21.15.105:0/3252324098 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0794035040 con 0x7f07a415a310 2024-09-21T03:21:12.129 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:12.125+0000 7f07ab157640 1 -- 172.21.15.105:0/3252324098 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07a40c99c0 con 0x7f07a415a310 2024-09-21T03:21:12.130 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:12.126+0000 7f07ab157640 1 -- 172.21.15.105:0/3252324098 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07a40d07d0 con 0x7f07a415a310 2024-09-21T03:21:12.130 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:12.127+0000 7f07997fa640 1 -- 172.21.15.105:0/3252324098 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0794041030 con 0x7f07a415a310 2024-09-21T03:21:12.130 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:12.127+0000 7f07997fa640 1 --2- 172.21.15.105:0/3252324098 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0790078bc0 0x7f079007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:12.130 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:12.127+0000 7f07997fa640 1 -- 172.21.15.105:0/3252324098 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 4857+0+0 (secure 0 0 0) 0x7f07940bb150 con 0x7f07a415a310 2024-09-21T03:21:12.130 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:12.127+0000 7f07a8ef3640 1 --2- 172.21.15.105:0/3252324098 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0790078bc0 0x7f079007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:12.130 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:12.128+0000 7f07a8ef3640 1 --2- 172.21.15.105:0/3252324098 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0790078bc0 0x7f079007b0d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f07a40ce780 tx=0x7f07a0005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:12.133 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:12.132+0000 7f07997fa640 1 -- 172.21.15.105:0/3252324098 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f07a41f4770 con 0x7f07a415a310 2024-09-21T03:21:12.312 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:12.311+0000 7f07ab157640 1 -- 172.21.15.105:0/3252324098 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f07a40c8dc0 con 0x7f07a415a310 2024-09-21T03:21:13.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.282+0000 7f07997fa640 1 -- 172.21.15.105:0/3252324098 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v66) ==== 138+0+0 (secure 0 0 0) 0x7f0794083320 con 0x7f07a415a310 2024-09-21T03:21:13.284 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_metadata' created 2024-09-21T03:21:13.288 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.286+0000 7f07ab157640 1 -- 172.21.15.105:0/3252324098 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0790078bc0 msgr2=0x7f079007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:13.288 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.286+0000 7f07ab157640 1 --2- 172.21.15.105:0/3252324098 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0790078bc0 0x7f079007b0d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f07a40ce780 tx=0x7f07a0005f90 comp rx=0 tx=0).stop 2024-09-21T03:21:13.288 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.286+0000 7f07ab157640 1 -- 172.21.15.105:0/3252324098 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07a415a310 msgr2=0x7f07a4148280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:13.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.286+0000 7f07ab157640 1 --2- 172.21.15.105:0/3252324098 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07a415a310 0x7f07a4148280 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f0794034040 tx=0x7f07940035f0 comp rx=0 tx=0).stop 2024-09-21T03:21:13.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.287+0000 7f07ab157640 1 -- 172.21.15.105:0/3252324098 shutdown_connections 2024-09-21T03:21:13.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.287+0000 7f07ab157640 1 --2- 172.21.15.105:0/3252324098 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0790078bc0 0x7f079007b0d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:13.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.287+0000 7f07ab157640 1 --2- 172.21.15.105:0/3252324098 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07a415cc30 0x7f07a40ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:13.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.287+0000 7f07ab157640 1 --2- 172.21.15.105:0/3252324098 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07a415a310 0x7f07a4148280 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:13.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.287+0000 7f07ab157640 1 --2- 172.21.15.105:0/3252324098 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07a4071090 0x7f07a41f4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:13.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.287+0000 7f07ab157640 1 -- 172.21.15.105:0/3252324098 >> 172.21.15.105:0/3252324098 conn(0x7f07a40ced50 msgr2=0x7f07a415c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:13.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.287+0000 7f07ab157640 1 -- 172.21.15.105:0/3252324098 shutdown_connections 2024-09-21T03:21:13.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.287+0000 7f07ab157640 1 -- 172.21.15.105:0/3252324098 wait complete. 2024-09-21T03:21:13.305 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T03:21:13.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.428+0000 7f7d2007e640 1 -- 172.21.15.105:0/3042955450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d180cfeb0 msgr2=0x7f7d180d02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:13.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.428+0000 7f7d2007e640 1 --2- 172.21.15.105:0/3042955450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d180cfeb0 0x7f7d180d02c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f7d1806a1c0 tx=0x7f7d1002aa30 comp rx=0 tx=0).stop 2024-09-21T03:21:13.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.428+0000 7f7d2007e640 1 -- 172.21.15.105:0/3042955450 shutdown_connections 2024-09-21T03:21:13.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.428+0000 7f7d2007e640 1 --2- 172.21.15.105:0/3042955450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d180cfeb0 0x7f7d180d02c0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:13.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.428+0000 7f7d2007e640 1 --2- 172.21.15.105:0/3042955450 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d1806fec0 0x7f7d180702d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:13.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.428+0000 7f7d2007e640 1 --2- 172.21.15.105:0/3042955450 >> v2:172.21.15.162:3300/0 conn(0x7f7d180b4090 0x7f7d180b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:13.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.428+0000 7f7d2007e640 1 -- 172.21.15.105:0/3042955450 >> 172.21.15.105:0/3042955450 conn(0x7f7d180cdcc0 msgr2=0x7f7d180ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:13.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.429+0000 7f7d2007e640 1 -- 172.21.15.105:0/3042955450 shutdown_connections 2024-09-21T03:21:13.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.429+0000 7f7d2007e640 1 -- 172.21.15.105:0/3042955450 wait complete. 2024-09-21T03:21:13.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.430+0000 7f7d2007e640 1 Processor -- start 2024-09-21T03:21:13.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.430+0000 7f7d2007e640 1 -- start start 2024-09-21T03:21:13.434 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.432+0000 7f7d2007e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d1806fec0 0x7f7d18153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:13.434 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.432+0000 7f7d2007e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d180b4090 0x7f7d181f3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:13.434 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.432+0000 7f7d2007e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d180cfeb0 0x7f7d1809ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:13.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.432+0000 7f7d2007e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7d180b4820 con 0x7f7d1806fec0 2024-09-21T03:21:13.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.432+0000 7f7d2007e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7d180b46a0 con 0x7f7d180cfeb0 2024-09-21T03:21:13.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.432+0000 7f7d2007e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7d180b49a0 con 0x7f7d180b4090 2024-09-21T03:21:13.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.432+0000 7f7d1de1a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d1806fec0 0x7f7d18153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:13.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.432+0000 7f7d1de1a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d1806fec0 0x7f7d18153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:47510/0 (socket says 172.21.15.105:47510) 2024-09-21T03:21:13.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.432+0000 7f7d1de1a640 1 -- 172.21.15.105:0/3012203006 learned_addr learned my addr 172.21.15.105:0/3012203006 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:13.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.432+0000 7f7d1e61b640 1 --2- 172.21.15.105:0/3012203006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d180cfeb0 0x7f7d1809ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:13.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.432+0000 7f7d1d619640 1 --2- 172.21.15.105:0/3012203006 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d180b4090 0x7f7d181f3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:13.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.432+0000 7f7d1de1a640 1 -- 172.21.15.105:0/3012203006 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d180b4090 msgr2=0x7f7d181f3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:13.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.432+0000 7f7d1de1a640 1 --2- 172.21.15.105:0/3012203006 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d180b4090 0x7f7d181f3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:13.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.432+0000 7f7d1de1a640 1 -- 172.21.15.105:0/3012203006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d180cfeb0 msgr2=0x7f7d1809ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:13.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.432+0000 7f7d1de1a640 1 --2- 172.21.15.105:0/3012203006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d180cfeb0 0x7f7d1809ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:13.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.432+0000 7f7d1de1a640 1 -- 172.21.15.105:0/3012203006 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d1809dc40 con 0x7f7d1806fec0 2024-09-21T03:21:13.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.432+0000 7f7d1de1a640 1 --2- 172.21.15.105:0/3012203006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d1806fec0 0x7f7d18153dd0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400c970 tx=0x7f7d1400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:13.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.432+0000 7f7d0e7fc640 1 -- 172.21.15.105:0/3012203006 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d14007b50 con 0x7f7d1806fec0 2024-09-21T03:21:13.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.432+0000 7f7d0e7fc640 1 -- 172.21.15.105:0/3012203006 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d14007de0 con 0x7f7d1806fec0 2024-09-21T03:21:13.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.432+0000 7f7d2007e640 1 -- 172.21.15.105:0/3012203006 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d1809df20 con 0x7f7d1806fec0 2024-09-21T03:21:13.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.432+0000 7f7d0e7fc640 1 -- 172.21.15.105:0/3012203006 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d14005280 con 0x7f7d1806fec0 2024-09-21T03:21:13.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.432+0000 7f7d2007e640 1 -- 172.21.15.105:0/3012203006 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d1809e4e0 con 0x7f7d1806fec0 2024-09-21T03:21:13.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.433+0000 7f7d2007e640 1 -- 172.21.15.105:0/3012203006 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d180b3550 con 0x7f7d1806fec0 2024-09-21T03:21:13.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.434+0000 7f7d0e7fc640 1 -- 172.21.15.105:0/3012203006 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7d14005420 con 0x7f7d1806fec0 2024-09-21T03:21:13.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.435+0000 7f7d0e7fc640 1 --2- 172.21.15.105:0/3012203006 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7cfc078b90 0x7f7cfc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:13.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.435+0000 7f7d0e7fc640 1 -- 172.21.15.105:0/3012203006 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5227+0+0 (secure 0 0 0) 0x7f7d1409b310 con 0x7f7d1806fec0 2024-09-21T03:21:13.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.435+0000 7f7d1d619640 1 --2- 172.21.15.105:0/3012203006 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7cfc078b90 0x7f7cfc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:13.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.436+0000 7f7d1d619640 1 --2- 172.21.15.105:0/3012203006 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7cfc078b90 0x7f7cfc07b0a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7d1815da40 tx=0x7f7d08005ef0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:13.442 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.439+0000 7f7d0e7fc640 1 -- 172.21.15.105:0/3012203006 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7d14014030 con 0x7f7d1806fec0 2024-09-21T03:21:13.619 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:13.617+0000 7f7d2007e640 1 -- 172.21.15.105:0/3012203006 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f7d1806db40 con 0x7f7d1806fec0 2024-09-21T03:21:14.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.288+0000 7f7d0e7fc640 1 -- 172.21.15.105:0/3012203006 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v67) ==== 170+0+0 (secure 0 0 0) 0x7f7d14063430 con 0x7f7d1806fec0 2024-09-21T03:21:14.289 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_data' created 2024-09-21T03:21:14.293 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.291+0000 7f7d2007e640 1 -- 172.21.15.105:0/3012203006 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7cfc078b90 msgr2=0x7f7cfc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:14.293 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.291+0000 7f7d2007e640 1 --2- 172.21.15.105:0/3012203006 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7cfc078b90 0x7f7cfc07b0a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7d1815da40 tx=0x7f7d08005ef0 comp rx=0 tx=0).stop 2024-09-21T03:21:14.293 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.291+0000 7f7d2007e640 1 -- 172.21.15.105:0/3012203006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d1806fec0 msgr2=0x7f7d18153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:14.293 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.291+0000 7f7d2007e640 1 --2- 172.21.15.105:0/3012203006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d1806fec0 0x7f7d18153dd0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400c970 tx=0x7f7d1400ce30 comp rx=0 tx=0).stop 2024-09-21T03:21:14.293 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.291+0000 7f7d2007e640 1 -- 172.21.15.105:0/3012203006 shutdown_connections 2024-09-21T03:21:14.293 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.291+0000 7f7d2007e640 1 --2- 172.21.15.105:0/3012203006 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7cfc078b90 0x7f7cfc07b0a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:14.293 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.291+0000 7f7d2007e640 1 --2- 172.21.15.105:0/3012203006 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d180cfeb0 0x7f7d1809ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:14.293 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.291+0000 7f7d2007e640 1 --2- 172.21.15.105:0/3012203006 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d180b4090 0x7f7d181f3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:14.293 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.291+0000 7f7d2007e640 1 --2- 172.21.15.105:0/3012203006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d1806fec0 0x7f7d18153dd0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:14.293 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.291+0000 7f7d2007e640 1 -- 172.21.15.105:0/3012203006 >> 172.21.15.105:0/3012203006 conn(0x7f7d180cdcc0 msgr2=0x7f7d1806cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:14.293 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.291+0000 7f7d2007e640 1 -- 172.21.15.105:0/3012203006 shutdown_connections 2024-09-21T03:21:14.293 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.291+0000 7f7d2007e640 1 -- 172.21.15.105:0/3012203006 wait complete. 2024-09-21T03:21:14.318 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T03:21:14.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.433+0000 7f0eed412640 1 -- 172.21.15.105:0/3530324787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ee80cec50 msgr2=0x7f0ee80cf060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:14.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.433+0000 7f0eed412640 1 --2- 172.21.15.105:0/3530324787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ee80cec50 0x7f0ee80cf060 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0005fd0 tx=0x7f0ee002aa90 comp rx=0 tx=0).stop 2024-09-21T03:21:14.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.433+0000 7f0eed412640 1 -- 172.21.15.105:0/3530324787 shutdown_connections 2024-09-21T03:21:14.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.433+0000 7f0eed412640 1 --2- 172.21.15.105:0/3530324787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ee80cec50 0x7f0ee80cf060 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:14.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.433+0000 7f0eed412640 1 --2- 172.21.15.105:0/3530324787 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ee8161020 0x7f0ee80ccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:14.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.433+0000 7f0eed412640 1 -- 172.21.15.105:0/3530324787 >> 172.21.15.105:0/3530324787 conn(0x7f0ee806d4f0 msgr2=0x7f0ee8071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:14.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.433+0000 7f0eed412640 1 -- 172.21.15.105:0/3530324787 shutdown_connections 2024-09-21T03:21:14.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.433+0000 7f0eed412640 1 -- 172.21.15.105:0/3530324787 wait complete. 2024-09-21T03:21:14.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.435+0000 7f0eed412640 1 Processor -- start 2024-09-21T03:21:14.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.435+0000 7f0eed412640 1 -- start start 2024-09-21T03:21:14.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.436+0000 7f0eed412640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ee80cec50 0x7f0ee81f6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:14.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.436+0000 7f0eed412640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ee8156f10 0x7f0ee81f4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:14.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.436+0000 7f0eed412640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ee8161020 0x7f0ee8157c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:14.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.436+0000 7f0eed412640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee80d08c0 con 0x7f0ee80cec50 2024-09-21T03:21:14.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.436+0000 7f0eed412640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee80d0740 con 0x7f0ee8156f10 2024-09-21T03:21:14.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.436+0000 7f0eed412640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0ee80d0a40 con 0x7f0ee8161020 2024-09-21T03:21:14.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.437+0000 7f0ee6ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ee80cec50 0x7f0ee81f6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:14.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.437+0000 7f0ee6ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ee80cec50 0x7f0ee81f6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:47532/0 (socket says 172.21.15.105:47532) 2024-09-21T03:21:14.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.437+0000 7f0ee6ffd640 1 -- 172.21.15.105:0/3865829676 learned_addr learned my addr 172.21.15.105:0/3865829676 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:14.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.437+0000 7f0ee77fe640 1 --2- 172.21.15.105:0/3865829676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ee8161020 0x7f0ee8157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:14.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.437+0000 7f0ede7fc640 1 --2- 172.21.15.105:0/3865829676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ee8156f10 0x7f0ee81f4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:14.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.437+0000 7f0ee6ffd640 1 -- 172.21.15.105:0/3865829676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ee8161020 msgr2=0x7f0ee8157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:14.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.437+0000 7f0ee6ffd640 1 --2- 172.21.15.105:0/3865829676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ee8161020 0x7f0ee8157c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:14.441 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.437+0000 7f0ee6ffd640 1 -- 172.21.15.105:0/3865829676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ee8156f10 msgr2=0x7f0ee81f4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:14.441 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.437+0000 7f0ee6ffd640 1 --2- 172.21.15.105:0/3865829676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ee8156f10 0x7f0ee81f4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:14.441 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.437+0000 7f0ee6ffd640 1 -- 172.21.15.105:0/3865829676 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ee81f71a0 con 0x7f0ee80cec50 2024-09-21T03:21:14.441 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.437+0000 7f0ede7fc640 1 --2- 172.21.15.105:0/3865829676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ee8156f10 0x7f0ee81f4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:21:14.441 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.437+0000 7f0ee6ffd640 1 --2- 172.21.15.105:0/3865829676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ee80cec50 0x7f0ee81f6c60 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f0ed800d770 tx=0x7f0ed800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:14.441 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.437+0000 7f0edffff640 1 -- 172.21.15.105:0/3865829676 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed8017070 con 0x7f0ee80cec50 2024-09-21T03:21:14.441 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.437+0000 7f0edffff640 1 -- 172.21.15.105:0/3865829676 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ed8009d20 con 0x7f0ee80cec50 2024-09-21T03:21:14.441 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.437+0000 7f0eed412640 1 -- 172.21.15.105:0/3865829676 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ee81f3860 con 0x7f0ee80cec50 2024-09-21T03:21:14.441 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.437+0000 7f0edffff640 1 -- 172.21.15.105:0/3865829676 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed80106c0 con 0x7f0ee80cec50 2024-09-21T03:21:14.441 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.437+0000 7f0eed412640 1 -- 172.21.15.105:0/3865829676 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ee81f7990 con 0x7f0ee80cec50 2024-09-21T03:21:14.441 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.438+0000 7f0eed412640 1 -- 172.21.15.105:0/3865829676 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ee80d0fd0 con 0x7f0ee80cec50 2024-09-21T03:21:14.442 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.439+0000 7f0edffff640 1 -- 172.21.15.105:0/3865829676 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0ed801a070 con 0x7f0ee80cec50 2024-09-21T03:21:14.442 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.440+0000 7f0edffff640 1 --2- 172.21.15.105:0/3865829676 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0ec8078b90 0x7f0ec807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:14.442 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.440+0000 7f0edffff640 1 -- 172.21.15.105:0/3865829676 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5609+0+0 (secure 0 0 0) 0x7f0ed809ae70 con 0x7f0ee80cec50 2024-09-21T03:21:14.442 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.440+0000 7f0ede7fc640 1 --2- 172.21.15.105:0/3865829676 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0ec8078b90 0x7f0ec807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:14.442 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.440+0000 7f0ede7fc640 1 --2- 172.21.15.105:0/3865829676 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0ec8078b90 0x7f0ec807b0a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0ee80b7e60 tx=0x7f0ed0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:14.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.444+0000 7f0edffff640 1 -- 172.21.15.105:0/3865829676 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0ed8062c40 con 0x7f0ee80cec50 2024-09-21T03:21:14.660 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:14.659+0000 7f0eed412640 1 -- 172.21.15.105:0/3865829676 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f0ee81f7b60 con 0x7f0ee80cec50 2024-09-21T03:21:15.291 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.289+0000 7f0edffff640 1 -- 172.21.15.105:0/3865829676 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v36) ==== 174+0+0 (secure 0 0 0) 0x7f0ed8085110 con 0x7f0ee80cec50 2024-09-21T03:21:15.291 INFO:teuthology.orchestra.run.smithi105.stderr:new fs with metadata pool 10 and data pool 11 2024-09-21T03:21:15.293 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.292+0000 7f0eed412640 1 -- 172.21.15.105:0/3865829676 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0ec8078b90 msgr2=0x7f0ec807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:15.294 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.292+0000 7f0eed412640 1 --2- 172.21.15.105:0/3865829676 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0ec8078b90 0x7f0ec807b0a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0ee80b7e60 tx=0x7f0ed0009040 comp rx=0 tx=0).stop 2024-09-21T03:21:15.294 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.292+0000 7f0eed412640 1 -- 172.21.15.105:0/3865829676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ee80cec50 msgr2=0x7f0ee81f6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:15.294 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.292+0000 7f0eed412640 1 --2- 172.21.15.105:0/3865829676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ee80cec50 0x7f0ee81f6c60 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f0ed800d770 tx=0x7f0ed800dc30 comp rx=0 tx=0).stop 2024-09-21T03:21:15.294 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.292+0000 7f0eed412640 1 -- 172.21.15.105:0/3865829676 shutdown_connections 2024-09-21T03:21:15.294 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.292+0000 7f0eed412640 1 --2- 172.21.15.105:0/3865829676 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0ec8078b90 0x7f0ec807b0a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:15.294 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.292+0000 7f0eed412640 1 --2- 172.21.15.105:0/3865829676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ee8161020 0x7f0ee8157c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:15.294 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.292+0000 7f0eed412640 1 --2- 172.21.15.105:0/3865829676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ee8156f10 0x7f0ee81f4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:15.294 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.292+0000 7f0eed412640 1 --2- 172.21.15.105:0/3865829676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ee80cec50 0x7f0ee81f6c60 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:15.294 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.292+0000 7f0eed412640 1 -- 172.21.15.105:0/3865829676 >> 172.21.15.105:0/3865829676 conn(0x7f0ee806d4f0 msgr2=0x7f0ee815e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:15.294 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.292+0000 7f0eed412640 1 -- 172.21.15.105:0/3865829676 shutdown_connections 2024-09-21T03:21:15.295 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.292+0000 7f0eed412640 1 -- 172.21.15.105:0/3865829676 wait complete. 2024-09-21T03:21:15.314 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:21:15.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.429+0000 7f1ac2f89640 1 -- 172.21.15.105:0/2094719177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1abc1570e0 msgr2=0x7f1abc0d1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:15.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.429+0000 7f1ac2f89640 1 --2- 172.21.15.105:0/2094719177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1abc1570e0 0x7f1abc0d1f20 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f1abc0d2de0 tx=0x7f1aac02aa30 comp rx=0 tx=0).stop 2024-09-21T03:21:15.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.429+0000 7f1ac2f89640 1 -- 172.21.15.105:0/2094719177 shutdown_connections 2024-09-21T03:21:15.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.429+0000 7f1ac2f89640 1 --2- 172.21.15.105:0/2094719177 >> v2:172.21.15.162:3300/0 conn(0x7f1abc15d670 0x7f1abc0b7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:15.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.429+0000 7f1ac2f89640 1 --2- 172.21.15.105:0/2094719177 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1abc0d2460 0x7f1abc15d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:15.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.429+0000 7f1ac2f89640 1 --2- 172.21.15.105:0/2094719177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1abc1570e0 0x7f1abc0d1f20 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:15.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.429+0000 7f1ac2f89640 1 -- 172.21.15.105:0/2094719177 >> 172.21.15.105:0/2094719177 conn(0x7f1abc06d550 msgr2=0x7f1abc071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:15.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.429+0000 7f1ac2f89640 1 -- 172.21.15.105:0/2094719177 shutdown_connections 2024-09-21T03:21:15.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.429+0000 7f1ac2f89640 1 -- 172.21.15.105:0/2094719177 wait complete. 2024-09-21T03:21:15.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.431+0000 7f1ac2f89640 1 Processor -- start 2024-09-21T03:21:15.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.431+0000 7f1ac2f89640 1 -- start start 2024-09-21T03:21:15.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.433+0000 7f1ac2f89640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1abc0d2460 0x7f1abc157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:15.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.433+0000 7f1ac2f89640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1abc1570e0 0x7f1abc1493b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:15.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.433+0000 7f1ac2f89640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1abc15d670 0x7f1abc0cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:15.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.433+0000 7f1ac2f89640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1abc0b7b50 con 0x7f1abc0d2460 2024-09-21T03:21:15.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.433+0000 7f1ac2f89640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1abc0b79d0 con 0x7f1abc1570e0 2024-09-21T03:21:15.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.433+0000 7f1ac2f89640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1abc0b7cd0 con 0x7f1abc15d670 2024-09-21T03:21:15.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.433+0000 7f1ac0d25640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1abc0d2460 0x7f1abc157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:15.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.433+0000 7f1ac0d25640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1abc0d2460 0x7f1abc157610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:47540/0 (socket says 172.21.15.105:47540) 2024-09-21T03:21:15.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.433+0000 7f1ac0d25640 1 -- 172.21.15.105:0/2666312393 learned_addr learned my addr 172.21.15.105:0/2666312393 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:15.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.433+0000 7f1abbfff640 1 --2- 172.21.15.105:0/2666312393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1abc1570e0 0x7f1abc1493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:15.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.433+0000 7f1ac1526640 1 --2- 172.21.15.105:0/2666312393 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1abc15d670 0x7f1abc0cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:15.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.433+0000 7f1ac0d25640 1 -- 172.21.15.105:0/2666312393 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1abc15d670 msgr2=0x7f1abc0cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:15.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.433+0000 7f1ac0d25640 1 --2- 172.21.15.105:0/2666312393 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1abc15d670 0x7f1abc0cc7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:15.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.433+0000 7f1ac0d25640 1 -- 172.21.15.105:0/2666312393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1abc1570e0 msgr2=0x7f1abc1493b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:15.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.433+0000 7f1ac0d25640 1 --2- 172.21.15.105:0/2666312393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1abc1570e0 0x7f1abc1493b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:15.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.433+0000 7f1ac0d25640 1 -- 172.21.15.105:0/2666312393 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1abc1498f0 con 0x7f1abc0d2460 2024-09-21T03:21:15.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.433+0000 7f1abbfff640 1 --2- 172.21.15.105:0/2666312393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1abc1570e0 0x7f1abc1493b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:21:15.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.433+0000 7f1ac0d25640 1 --2- 172.21.15.105:0/2666312393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1abc0d2460 0x7f1abc157610 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f1aac02b020 tx=0x7f1aac003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:15.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.433+0000 7f1ab97fa640 1 -- 172.21.15.105:0/2666312393 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aac033050 con 0x7f1abc0d2460 2024-09-21T03:21:15.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.433+0000 7f1ab97fa640 1 -- 172.21.15.105:0/2666312393 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1aac0045f0 con 0x7f1abc0d2460 2024-09-21T03:21:15.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.433+0000 7f1ab97fa640 1 -- 172.21.15.105:0/2666312393 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aac038450 con 0x7f1abc0d2460 2024-09-21T03:21:15.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.433+0000 7f1ac2f89640 1 -- 172.21.15.105:0/2666312393 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1abc0c7480 con 0x7f1abc0d2460 2024-09-21T03:21:15.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.433+0000 7f1ac2f89640 1 -- 172.21.15.105:0/2666312393 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1abc0c7a40 con 0x7f1abc0d2460 2024-09-21T03:21:15.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.434+0000 7f1ac2f89640 1 -- 172.21.15.105:0/2666312393 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1abc0d1ed0 con 0x7f1abc0d2460 2024-09-21T03:21:15.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.435+0000 7f1ab97fa640 1 -- 172.21.15.105:0/2666312393 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1aac036070 con 0x7f1abc0d2460 2024-09-21T03:21:15.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.435+0000 7f1ab97fa640 1 --2- 172.21.15.105:0/2666312393 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1a9c078b90 0x7f1a9c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:15.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.436+0000 7f1ab97fa640 1 -- 172.21.15.105:0/2666312393 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f1aac0bc3a0 con 0x7f1abc0d2460 2024-09-21T03:21:15.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.436+0000 7f1abbfff640 1 --2- 172.21.15.105:0/2666312393 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1a9c078b90 0x7f1a9c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:15.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.436+0000 7f1abbfff640 1 --2- 172.21.15.105:0/2666312393 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1a9c078b90 0x7f1a9c07b0a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4005fd0 tx=0x7f1aa4005e20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:15.441 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.440+0000 7f1ab97fa640 1 -- 172.21.15.105:0/2666312393 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1aac0847e0 con 0x7f1abc0d2460 2024-09-21T03:21:15.617 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.616+0000 7f1ac2f89640 1 -- 172.21.15.105:0/2666312393 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1abc070100 con 0x7f1abc0d2460 2024-09-21T03:21:15.619 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.617+0000 7f1ab97fa640 1 -- 172.21.15.105:0/2666312393 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+16813 (secure 0 0 0) 0x7f1aac0840e0 con 0x7f1abc0d2460 2024-09-21T03:21:15.620 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:15.620 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":68,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:21:14.660275+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:21:12.315659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-21T03:21:13.622324+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:21:15.622 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.619+0000 7f1ac2f89640 1 -- 172.21.15.105:0/2666312393 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1a9c078b90 msgr2=0x7f1a9c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:15.622 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.619+0000 7f1ac2f89640 1 --2- 172.21.15.105:0/2666312393 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1a9c078b90 0x7f1a9c07b0a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4005fd0 tx=0x7f1aa4005e20 comp rx=0 tx=0).stop 2024-09-21T03:21:15.623 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.619+0000 7f1ac2f89640 1 -- 172.21.15.105:0/2666312393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1abc0d2460 msgr2=0x7f1abc157610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:15.623 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.619+0000 7f1ac2f89640 1 --2- 172.21.15.105:0/2666312393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1abc0d2460 0x7f1abc157610 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f1aac02b020 tx=0x7f1aac003f90 comp rx=0 tx=0).stop 2024-09-21T03:21:15.623 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.619+0000 7f1ac2f89640 1 -- 172.21.15.105:0/2666312393 shutdown_connections 2024-09-21T03:21:15.623 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.619+0000 7f1ac2f89640 1 --2- 172.21.15.105:0/2666312393 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1a9c078b90 0x7f1a9c07b0a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:15.623 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.619+0000 7f1ac2f89640 1 --2- 172.21.15.105:0/2666312393 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1abc15d670 0x7f1abc0cc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:15.623 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.619+0000 7f1ac2f89640 1 --2- 172.21.15.105:0/2666312393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1abc1570e0 0x7f1abc1493b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:15.623 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.619+0000 7f1ac2f89640 1 --2- 172.21.15.105:0/2666312393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1abc0d2460 0x7f1abc157610 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:15.623 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.619+0000 7f1ac2f89640 1 -- 172.21.15.105:0/2666312393 >> 172.21.15.105:0/2666312393 conn(0x7f1abc06d550 msgr2=0x7f1abc0b60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:15.623 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.619+0000 7f1ac2f89640 1 -- 172.21.15.105:0/2666312393 shutdown_connections 2024-09-21T03:21:15.623 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.619+0000 7f1ac2f89640 1 -- 172.21.15.105:0/2666312393 wait complete. 2024-09-21T03:21:15.633 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:21:15.745 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.744+0000 7fd965227640 1 -- 172.21.15.105:0/1184749701 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd96015b6a0 msgr2=0x7fd9600b5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:15.745 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.744+0000 7fd965227640 1 --2- 172.21.15.105:0/1184749701 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd96015b6a0 0x7fd9600b5250 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd950009830 tx=0x7fd95002a5c0 comp rx=0 tx=0).stop 2024-09-21T03:21:15.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.744+0000 7fd965227640 1 -- 172.21.15.105:0/1184749701 shutdown_connections 2024-09-21T03:21:15.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.744+0000 7fd965227640 1 --2- 172.21.15.105:0/1184749701 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd96015b6a0 0x7fd9600b5250 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:15.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.744+0000 7fd965227640 1 -- 172.21.15.105:0/1184749701 >> 172.21.15.105:0/1184749701 conn(0x7fd9600b2160 msgr2=0x7fd9600b2570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:15.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.744+0000 7fd965227640 1 -- 172.21.15.105:0/1184749701 shutdown_connections 2024-09-21T03:21:15.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.744+0000 7fd965227640 1 -- 172.21.15.105:0/1184749701 wait complete. 2024-09-21T03:21:15.747 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.746+0000 7fd965227640 1 Processor -- start 2024-09-21T03:21:15.747 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.746+0000 7fd965227640 1 -- start start 2024-09-21T03:21:15.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.747+0000 7fd965227640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9600cf0d0 0x7fd9601f5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:15.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.747+0000 7fd965227640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd96015b6a0 0x7fd960150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:15.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.747+0000 7fd965227640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd96014b270 0x7fd960151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:15.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.747+0000 7fd965227640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd96006fdf0 con 0x7fd9600cf0d0 2024-09-21T03:21:15.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.747+0000 7fd965227640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd9600cf6f0 con 0x7fd96015b6a0 2024-09-21T03:21:15.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.747+0000 7fd965227640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd96006ff70 con 0x7fd96014b270 2024-09-21T03:21:15.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.747+0000 7fd95ed9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9600cf0d0 0x7fd9601f5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:15.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.747+0000 7fd95ed9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9600cf0d0 0x7fd9601f5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:47546/0 (socket says 172.21.15.105:47546) 2024-09-21T03:21:15.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.747+0000 7fd95ed9d640 1 -- 172.21.15.105:0/1646148598 learned_addr learned my addr 172.21.15.105:0/1646148598 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:15.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.747+0000 7fd95e59c640 1 --2- 172.21.15.105:0/1646148598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd96015b6a0 0x7fd960150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:15.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.747+0000 7fd95f59e640 1 --2- 172.21.15.105:0/1646148598 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd96014b270 0x7fd960151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:15.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.747+0000 7fd95ed9d640 1 -- 172.21.15.105:0/1646148598 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd96014b270 msgr2=0x7fd960151aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:15.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.747+0000 7fd95ed9d640 1 --2- 172.21.15.105:0/1646148598 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd96014b270 0x7fd960151aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:15.751 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.747+0000 7fd95ed9d640 1 -- 172.21.15.105:0/1646148598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd96015b6a0 msgr2=0x7fd960150240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:15.751 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.747+0000 7fd95ed9d640 1 --2- 172.21.15.105:0/1646148598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd96015b6a0 0x7fd960150240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:15.751 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.747+0000 7fd95ed9d640 1 -- 172.21.15.105:0/1646148598 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9600adaf0 con 0x7fd9600cf0d0 2024-09-21T03:21:15.751 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.747+0000 7fd95e59c640 1 --2- 172.21.15.105:0/1646148598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd96015b6a0 0x7fd960150240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:21:15.751 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.748+0000 7fd95ed9d640 1 --2- 172.21.15.105:0/1646148598 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9600cf0d0 0x7fd9601f5dc0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd950009950 tx=0x7fd950033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:15.751 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.748+0000 7fd9477fe640 1 -- 172.21.15.105:0/1646148598 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd950031d60 con 0x7fd9600cf0d0 2024-09-21T03:21:15.751 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.748+0000 7fd9477fe640 1 -- 172.21.15.105:0/1646148598 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9500330d0 con 0x7fd9600cf0d0 2024-09-21T03:21:15.751 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.748+0000 7fd965227640 1 -- 172.21.15.105:0/1646148598 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9600addd0 con 0x7fd9600cf0d0 2024-09-21T03:21:15.751 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.748+0000 7fd9477fe640 1 -- 172.21.15.105:0/1646148598 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd950033520 con 0x7fd9600cf0d0 2024-09-21T03:21:15.751 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.748+0000 7fd965227640 1 -- 172.21.15.105:0/1646148598 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9600ae390 con 0x7fd9600cf0d0 2024-09-21T03:21:15.752 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.749+0000 7fd965227640 1 -- 172.21.15.105:0/1646148598 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd960076820 con 0x7fd9600cf0d0 2024-09-21T03:21:15.752 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.749+0000 7fd9477fe640 1 -- 172.21.15.105:0/1646148598 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd9500035f0 con 0x7fd9600cf0d0 2024-09-21T03:21:15.752 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.750+0000 7fd9477fe640 1 --2- 172.21.15.105:0/1646148598 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd94c078b90 0x7fd94c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:15.752 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.750+0000 7fd9477fe640 1 -- 172.21.15.105:0/1646148598 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7fd9500bc2a0 con 0x7fd9600cf0d0 2024-09-21T03:21:15.752 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.750+0000 7fd95e59c640 1 --2- 172.21.15.105:0/1646148598 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd94c078b90 0x7fd94c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:15.752 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.751+0000 7fd95e59c640 1 --2- 172.21.15.105:0/1646148598 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd94c078b90 0x7fd94c07b0a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd9601f6420 tx=0x7fd954009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:15.756 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.754+0000 7fd9477fe640 1 -- 172.21.15.105:0/1646148598 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd960076820 con 0x7fd9600cf0d0 2024-09-21T03:21:15.932 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.931+0000 7fd965227640 1 -- 172.21.15.105:0/1646148598 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd9600b55b0 con 0x7fd9600cf0d0 2024-09-21T03:21:15.933 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.932+0000 7fd9477fe640 1 -- 172.21.15.105:0/1646148598 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+16813 (secure 0 0 0) 0x7fd9600b55b0 con 0x7fd9600cf0d0 2024-09-21T03:21:15.934 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:15.934 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":68,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:21:14.660275+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:21:12.315659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-21T03:21:13.622324+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:21:15.936 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.934+0000 7fd965227640 1 -- 172.21.15.105:0/1646148598 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd94c078b90 msgr2=0x7fd94c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:15.936 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.934+0000 7fd965227640 1 --2- 172.21.15.105:0/1646148598 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd94c078b90 0x7fd94c07b0a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd9601f6420 tx=0x7fd954009040 comp rx=0 tx=0).stop 2024-09-21T03:21:15.936 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.934+0000 7fd965227640 1 -- 172.21.15.105:0/1646148598 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9600cf0d0 msgr2=0x7fd9601f5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:15.936 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.934+0000 7fd965227640 1 --2- 172.21.15.105:0/1646148598 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9600cf0d0 0x7fd9601f5dc0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd950009950 tx=0x7fd950033d60 comp rx=0 tx=0).stop 2024-09-21T03:21:15.936 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.934+0000 7fd965227640 1 -- 172.21.15.105:0/1646148598 shutdown_connections 2024-09-21T03:21:15.936 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.934+0000 7fd965227640 1 --2- 172.21.15.105:0/1646148598 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd94c078b90 0x7fd94c07b0a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:15.936 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.934+0000 7fd965227640 1 --2- 172.21.15.105:0/1646148598 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd96014b270 0x7fd960151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:15.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.934+0000 7fd965227640 1 --2- 172.21.15.105:0/1646148598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd96015b6a0 0x7fd960150240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:15.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.934+0000 7fd965227640 1 --2- 172.21.15.105:0/1646148598 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9600cf0d0 0x7fd9601f5dc0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:15.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.934+0000 7fd965227640 1 -- 172.21.15.105:0/1646148598 >> 172.21.15.105:0/1646148598 conn(0x7fd9600b2160 msgr2=0x7fd9600b46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:15.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.934+0000 7fd965227640 1 -- 172.21.15.105:0/1646148598 shutdown_connections 2024-09-21T03:21:15.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:15.934+0000 7fd965227640 1 -- 172.21.15.105:0/1646148598 wait complete. 2024-09-21T03:21:15.948 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T03:21:16.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.062+0000 7f827724d640 1 -- 172.21.15.105:0/1763945575 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f827015bf20 msgr2=0x7f82700ca9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:16.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.062+0000 7f827724d640 1 --2- 172.21.15.105:0/1763945575 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f827015bf20 0x7f82700ca9a0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f826400a940 tx=0x7f826402b8f0 comp rx=0 tx=0).stop 2024-09-21T03:21:16.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.062+0000 7f827724d640 1 -- 172.21.15.105:0/1763945575 shutdown_connections 2024-09-21T03:21:16.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.062+0000 7f827724d640 1 --2- 172.21.15.105:0/1763945575 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f827015bf20 0x7f82700ca9a0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:16.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.062+0000 7f827724d640 1 -- 172.21.15.105:0/1763945575 >> 172.21.15.105:0/1763945575 conn(0x7f82700b1cb0 msgr2=0x7f82700b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:16.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.062+0000 7f827724d640 1 -- 172.21.15.105:0/1763945575 shutdown_connections 2024-09-21T03:21:16.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.062+0000 7f827724d640 1 -- 172.21.15.105:0/1763945575 wait complete. 2024-09-21T03:21:16.065 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.064+0000 7f827724d640 1 Processor -- start 2024-09-21T03:21:16.065 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.064+0000 7f827724d640 1 -- start start 2024-09-21T03:21:16.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.065+0000 7f827724d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82700caee0 0x7f82700c6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:16.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.065+0000 7f827724d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82700cfb00 0x7f8270159950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:16.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.065+0000 7f827724d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f827015bf20 0x7f827009cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:16.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.065+0000 7f827724d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8270070730 con 0x7f82700cfb00 2024-09-21T03:21:16.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.065+0000 7f827724d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f82700705b0 con 0x7f827015bf20 2024-09-21T03:21:16.070 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.065+0000 7f827724d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f82700708b0 con 0x7f82700caee0 2024-09-21T03:21:16.070 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.065+0000 7f826ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82700cfb00 0x7f8270159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:16.070 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.065+0000 7f826ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82700cfb00 0x7f8270159950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:47564/0 (socket says 172.21.15.105:47564) 2024-09-21T03:21:16.070 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.065+0000 7f826ffff640 1 -- 172.21.15.105:0/983509308 learned_addr learned my addr 172.21.15.105:0/983509308 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:16.070 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.065+0000 7f82757ea640 1 --2- 172.21.15.105:0/983509308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f827015bf20 0x7f827009cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:16.070 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.065+0000 7f8274fe9640 1 --2- 172.21.15.105:0/983509308 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82700caee0 0x7f82700c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:16.070 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.066+0000 7f826ffff640 1 -- 172.21.15.105:0/983509308 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82700caee0 msgr2=0x7f82700c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:16.070 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.066+0000 7f826ffff640 1 --2- 172.21.15.105:0/983509308 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82700caee0 0x7f82700c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:16.070 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.066+0000 7f826ffff640 1 -- 172.21.15.105:0/983509308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f827015bf20 msgr2=0x7f827009cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:16.070 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.066+0000 7f826ffff640 1 --2- 172.21.15.105:0/983509308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f827015bf20 0x7f827009cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:16.070 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.066+0000 7f826ffff640 1 -- 172.21.15.105:0/983509308 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82700c6c40 con 0x7f82700cfb00 2024-09-21T03:21:16.070 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.066+0000 7f82757ea640 1 --2- 172.21.15.105:0/983509308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f827015bf20 0x7f827009cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:21:16.070 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.066+0000 7f826ffff640 1 --2- 172.21.15.105:0/983509308 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82700cfb00 0x7f8270159950 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f826400a890 tx=0x7f82640043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:16.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.066+0000 7f826d7fa640 1 -- 172.21.15.105:0/983509308 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8264003a00 con 0x7f82700cfb00 2024-09-21T03:21:16.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.066+0000 7f826d7fa640 1 -- 172.21.15.105:0/983509308 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8264040070 con 0x7f82700cfb00 2024-09-21T03:21:16.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.066+0000 7f827724d640 1 -- 172.21.15.105:0/983509308 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f827015f1c0 con 0x7f82700cfb00 2024-09-21T03:21:16.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.066+0000 7f826d7fa640 1 -- 172.21.15.105:0/983509308 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8264032480 con 0x7f82700cfb00 2024-09-21T03:21:16.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.066+0000 7f827724d640 1 -- 172.21.15.105:0/983509308 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82701f7900 con 0x7f82700cfb00 2024-09-21T03:21:16.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.067+0000 7f827724d640 1 -- 172.21.15.105:0/983509308 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82700ca9a0 con 0x7f82700cfb00 2024-09-21T03:21:16.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.068+0000 7f826d7fa640 1 -- 172.21.15.105:0/983509308 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8264032620 con 0x7f82700cfb00 2024-09-21T03:21:16.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.068+0000 7f826d7fa640 1 --2- 172.21.15.105:0/983509308 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f825c078b90 0x7f825c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:16.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.069+0000 7f826d7fa640 1 -- 172.21.15.105:0/983509308 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f82640bcaa0 con 0x7f82700cfb00 2024-09-21T03:21:16.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.069+0000 7f8274fe9640 1 --2- 172.21.15.105:0/983509308 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f825c078b90 0x7f825c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:16.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.069+0000 7f8274fe9640 1 --2- 172.21.15.105:0/983509308 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f825c078b90 0x7f825c07b0a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8260000f60 tx=0x7f8260009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:16.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.073+0000 7f826d7fa640 1 -- 172.21.15.105:0/983509308 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8264085030 con 0x7f82700cfb00 2024-09-21T03:21:16.290 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.288+0000 7f827724d640 1 -- 172.21.15.105:0/983509308 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f82701f73b0 con 0x7f82700cfb00 2024-09-21T03:21:16.305 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.304+0000 7f826d7fa640 1 -- 172.21.15.105:0/983509308 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v37) ==== 118+0+0 (secure 0 0 0) 0x7f8264084930 con 0x7f82700cfb00 2024-09-21T03:21:16.309 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.307+0000 7f827724d640 1 -- 172.21.15.105:0/983509308 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f825c078b90 msgr2=0x7f825c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:16.309 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.307+0000 7f827724d640 1 --2- 172.21.15.105:0/983509308 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f825c078b90 0x7f825c07b0a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8260000f60 tx=0x7f8260009040 comp rx=0 tx=0).stop 2024-09-21T03:21:16.309 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.307+0000 7f827724d640 1 -- 172.21.15.105:0/983509308 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82700cfb00 msgr2=0x7f8270159950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:16.309 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.307+0000 7f827724d640 1 --2- 172.21.15.105:0/983509308 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82700cfb00 0x7f8270159950 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f826400a890 tx=0x7f82640043d0 comp rx=0 tx=0).stop 2024-09-21T03:21:16.309 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.307+0000 7f827724d640 1 -- 172.21.15.105:0/983509308 shutdown_connections 2024-09-21T03:21:16.309 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.307+0000 7f827724d640 1 --2- 172.21.15.105:0/983509308 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f825c078b90 0x7f825c07b0a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:16.309 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.307+0000 7f827724d640 1 --2- 172.21.15.105:0/983509308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f827015bf20 0x7f827009cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:16.310 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.307+0000 7f827724d640 1 --2- 172.21.15.105:0/983509308 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82700cfb00 0x7f8270159950 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:16.310 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.307+0000 7f827724d640 1 --2- 172.21.15.105:0/983509308 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82700caee0 0x7f82700c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:16.310 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.307+0000 7f827724d640 1 -- 172.21.15.105:0/983509308 >> 172.21.15.105:0/983509308 conn(0x7f82700b1cb0 msgr2=0x7f82700b0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:16.310 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.307+0000 7f827724d640 1 -- 172.21.15.105:0/983509308 shutdown_connections 2024-09-21T03:21:16.310 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.307+0000 7f827724d640 1 -- 172.21.15.105:0/983509308 wait complete. 2024-09-21T03:21:16.320 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T03:21:16.321 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T03:21:16.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.435+0000 7f4686b2b640 1 -- 172.21.15.105:0/1333881798 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46800b55b0 msgr2=0x7f46801662c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:16.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.435+0000 7f4686b2b640 1 --2- 172.21.15.105:0/1333881798 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46800b55b0 0x7f46801662c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f4678005fd0 tx=0x7f467802aa90 comp rx=0 tx=0).stop 2024-09-21T03:21:16.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.435+0000 7f4686b2b640 1 -- 172.21.15.105:0/1333881798 shutdown_connections 2024-09-21T03:21:16.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.435+0000 7f4686b2b640 1 --2- 172.21.15.105:0/1333881798 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46800b55b0 0x7f46801662c0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:16.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.435+0000 7f4686b2b640 1 -- 172.21.15.105:0/1333881798 >> 172.21.15.105:0/1333881798 conn(0x7f468006def0 msgr2=0x7f468006e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:16.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.435+0000 7f4686b2b640 1 -- 172.21.15.105:0/1333881798 shutdown_connections 2024-09-21T03:21:16.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.435+0000 7f4686b2b640 1 -- 172.21.15.105:0/1333881798 wait complete. 2024-09-21T03:21:16.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.437+0000 7f4686b2b640 1 Processor -- start 2024-09-21T03:21:16.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.437+0000 7f4686b2b640 1 -- start start 2024-09-21T03:21:16.441 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.438+0000 7f4686b2b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4680074420 0x7f46800b3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:16.441 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.438+0000 7f4686b2b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46800b55b0 0x7f468013c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:16.441 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.438+0000 7f4686b2b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f468006cde0 0x7f468006d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:16.441 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.438+0000 7f4686b2b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4680166b90 con 0x7f46800b55b0 2024-09-21T03:21:16.442 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.438+0000 7f4686b2b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4680166a10 con 0x7f468006cde0 2024-09-21T03:21:16.442 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.438+0000 7f4686b2b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4680166d10 con 0x7f4680074420 2024-09-21T03:21:16.442 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.439+0000 7f4677fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46800b55b0 0x7f468013c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:16.442 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.439+0000 7f4677fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46800b55b0 0x7f468013c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:47578/0 (socket says 172.21.15.105:47578) 2024-09-21T03:21:16.442 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.439+0000 7f4677fff640 1 -- 172.21.15.105:0/2655727717 learned_addr learned my addr 172.21.15.105:0/2655727717 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:16.442 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.439+0000 7f46850c8640 1 --2- 172.21.15.105:0/2655727717 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f468006cde0 0x7f468006d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:16.442 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.439+0000 7f46848c7640 1 --2- 172.21.15.105:0/2655727717 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4680074420 0x7f46800b3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:16.442 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.439+0000 7f4677fff640 1 -- 172.21.15.105:0/2655727717 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4680074420 msgr2=0x7f46800b3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:16.442 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.439+0000 7f4677fff640 1 --2- 172.21.15.105:0/2655727717 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4680074420 0x7f46800b3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:16.442 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.439+0000 7f4677fff640 1 -- 172.21.15.105:0/2655727717 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f468006cde0 msgr2=0x7f468006d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:16.442 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.439+0000 7f4677fff640 1 --2- 172.21.15.105:0/2655727717 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f468006cde0 0x7f468006d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:16.442 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.439+0000 7f4677fff640 1 -- 172.21.15.105:0/2655727717 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46800b3cb0 con 0x7f46800b55b0 2024-09-21T03:21:16.442 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.439+0000 7f46850c8640 1 --2- 172.21.15.105:0/2655727717 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f468006cde0 0x7f468006d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:21:16.442 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.439+0000 7f4677fff640 1 --2- 172.21.15.105:0/2655727717 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46800b55b0 0x7f468013c920 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f467000c340 tx=0x7f467000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:16.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.439+0000 7f46757fa640 1 -- 172.21.15.105:0/2655727717 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4670017070 con 0x7f46800b55b0 2024-09-21T03:21:16.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.439+0000 7f46757fa640 1 -- 172.21.15.105:0/2655727717 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46700035f0 con 0x7f46800b55b0 2024-09-21T03:21:16.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.439+0000 7f4686b2b640 1 -- 172.21.15.105:0/2655727717 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f468006d730 con 0x7f46800b55b0 2024-09-21T03:21:16.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.439+0000 7f46757fa640 1 -- 172.21.15.105:0/2655727717 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4670003a40 con 0x7f46800b55b0 2024-09-21T03:21:16.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.439+0000 7f4686b2b640 1 -- 172.21.15.105:0/2655727717 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46800b2700 con 0x7f46800b55b0 2024-09-21T03:21:16.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.440+0000 7f4686b2b640 1 -- 172.21.15.105:0/2655727717 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46800b2190 con 0x7f46800b55b0 2024-09-21T03:21:16.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.441+0000 7f46757fa640 1 -- 172.21.15.105:0/2655727717 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f467001a070 con 0x7f46800b55b0 2024-09-21T03:21:16.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.442+0000 7f46757fa640 1 --2- 172.21.15.105:0/2655727717 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f466c078b90 0x7f466c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:16.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.442+0000 7f46757fa640 1 -- 172.21.15.105:0/2655727717 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f4670099f50 con 0x7f46800b55b0 2024-09-21T03:21:16.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.442+0000 7f46848c7640 1 --2- 172.21.15.105:0/2655727717 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f466c078b90 0x7f466c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:16.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.442+0000 7f46848c7640 1 --2- 172.21.15.105:0/2655727717 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f466c078b90 0x7f466c07b0a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f467c006fd0 tx=0x7f467c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:16.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.446+0000 7f46757fa640 1 -- 172.21.15.105:0/2655727717 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f468006d730 con 0x7f46800b55b0 2024-09-21T03:21:16.660 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:16.659+0000 7f4686b2b640 1 -- 172.21.15.105:0/2655727717 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f468015c580 con 0x7f46800b55b0 2024-09-21T03:21:17.315 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.313+0000 7f46757fa640 1 -- 172.21.15.105:0/2655727717 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v38) ==== 122+0+0 (secure 0 0 0) 0x7f46800b3cb0 con 0x7f46800b55b0 2024-09-21T03:21:17.318 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.316+0000 7f4686b2b640 1 -- 172.21.15.105:0/2655727717 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f466c078b90 msgr2=0x7f466c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:17.318 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.316+0000 7f4686b2b640 1 --2- 172.21.15.105:0/2655727717 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f466c078b90 0x7f466c07b0a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f467c006fd0 tx=0x7f467c008040 comp rx=0 tx=0).stop 2024-09-21T03:21:17.319 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.316+0000 7f4686b2b640 1 -- 172.21.15.105:0/2655727717 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46800b55b0 msgr2=0x7f468013c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:17.319 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.316+0000 7f4686b2b640 1 --2- 172.21.15.105:0/2655727717 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46800b55b0 0x7f468013c920 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f467000c340 tx=0x7f467000c800 comp rx=0 tx=0).stop 2024-09-21T03:21:17.319 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.316+0000 7f4686b2b640 1 -- 172.21.15.105:0/2655727717 shutdown_connections 2024-09-21T03:21:17.319 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.316+0000 7f4686b2b640 1 --2- 172.21.15.105:0/2655727717 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f466c078b90 0x7f466c07b0a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:17.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.316+0000 7f4686b2b640 1 --2- 172.21.15.105:0/2655727717 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f468006cde0 0x7f468006d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:17.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.316+0000 7f4686b2b640 1 --2- 172.21.15.105:0/2655727717 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46800b55b0 0x7f468013c920 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:17.321 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.316+0000 7f4686b2b640 1 --2- 172.21.15.105:0/2655727717 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4680074420 0x7f46800b3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:17.322 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.316+0000 7f4686b2b640 1 -- 172.21.15.105:0/2655727717 >> 172.21.15.105:0/2655727717 conn(0x7f468006def0 msgr2=0x7f468006e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:17.322 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.317+0000 7f4686b2b640 1 -- 172.21.15.105:0/2655727717 shutdown_connections 2024-09-21T03:21:17.322 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.317+0000 7f4686b2b640 1 -- 172.21.15.105:0/2655727717 wait complete. 2024-09-21T03:21:17.331 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T03:21:17.331 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:21:17.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.446+0000 7fcd178d3640 1 -- 172.21.15.105:0/2632035690 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fccf8004800 msgr2=0x7fccf8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:17.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.446+0000 7fcd178d3640 1 --2- 172.21.15.105:0/2632035690 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fccf8004800 0x7fccf8004c10 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fcd04001690 tx=0x7fccf8005830 comp rx=0 tx=0).stop 2024-09-21T03:21:17.449 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.446+0000 7fcd178d3640 1 -- 172.21.15.105:0/2632035690 shutdown_connections 2024-09-21T03:21:17.449 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.446+0000 7fcd178d3640 1 --2- 172.21.15.105:0/2632035690 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fccf8004800 0x7fccf8004c10 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:17.449 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.446+0000 7fcd178d3640 1 -- 172.21.15.105:0/2632035690 >> 172.21.15.105:0/2632035690 conn(0x7fcd10072ae0 msgr2=0x7fcd10072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:17.449 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.446+0000 7fcd178d3640 1 -- 172.21.15.105:0/2632035690 shutdown_connections 2024-09-21T03:21:17.449 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.446+0000 7fcd178d3640 1 -- 172.21.15.105:0/2632035690 wait complete. 2024-09-21T03:21:17.450 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.448+0000 7fcd178d3640 1 Processor -- start 2024-09-21T03:21:17.450 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.448+0000 7fcd178d3640 1 -- start start 2024-09-21T03:21:17.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.449+0000 7fcd178d3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fccf8004800 0x7fcd101483f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:17.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.449+0000 7fcd178d3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd101f71e0 0x7fcd100abfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:17.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.449+0000 7fcd178d3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd100cb850 0x7fcd10159800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:17.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.449+0000 7fcd178d3640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1015c860 con 0x7fccf8004800 2024-09-21T03:21:17.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.449+0000 7fcd178d3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1015c6e0 con 0x7fcd101f71e0 2024-09-21T03:21:17.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.449+0000 7fcd178d3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcd1015c9e0 con 0x7fcd100cb850 2024-09-21T03:21:17.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.449+0000 7fcd1566f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fccf8004800 0x7fcd101483f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:17.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.449+0000 7fcd1566f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fccf8004800 0x7fcd101483f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:47582/0 (socket says 172.21.15.105:47582) 2024-09-21T03:21:17.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.449+0000 7fcd1566f640 1 -- 172.21.15.105:0/2155773487 learned_addr learned my addr 172.21.15.105:0/2155773487 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:17.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.449+0000 7fcd14e6e640 1 --2- 172.21.15.105:0/2155773487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd101f71e0 0x7fcd100abfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:17.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.449+0000 7fcd15e70640 1 --2- 172.21.15.105:0/2155773487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd100cb850 0x7fcd10159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:17.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.449+0000 7fcd1566f640 1 -- 172.21.15.105:0/2155773487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd100cb850 msgr2=0x7fcd10159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:17.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.449+0000 7fcd1566f640 1 --2- 172.21.15.105:0/2155773487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd100cb850 0x7fcd10159800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:17.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.450+0000 7fcd1566f640 1 -- 172.21.15.105:0/2155773487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd101f71e0 msgr2=0x7fcd100abfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:17.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.450+0000 7fcd1566f640 1 --2- 172.21.15.105:0/2155773487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd101f71e0 0x7fcd100abfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:17.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.450+0000 7fcd1566f640 1 -- 172.21.15.105:0/2155773487 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd10158a40 con 0x7fccf8004800 2024-09-21T03:21:17.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.450+0000 7fcd14e6e640 1 --2- 172.21.15.105:0/2155773487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd101f71e0 0x7fcd100abfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:21:17.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.450+0000 7fcd1566f640 1 --2- 172.21.15.105:0/2155773487 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fccf8004800 0x7fcd101483f0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fcd00011c90 tx=0x7fcd0000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:17.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.450+0000 7fcd0dffb640 1 -- 172.21.15.105:0/2155773487 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd00003d80 con 0x7fccf8004800 2024-09-21T03:21:17.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.450+0000 7fcd0dffb640 1 -- 172.21.15.105:0/2155773487 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd00004050 con 0x7fccf8004800 2024-09-21T03:21:17.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.450+0000 7fcd178d3640 1 -- 172.21.15.105:0/2155773487 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd10158d20 con 0x7fccf8004800 2024-09-21T03:21:17.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.450+0000 7fcd0dffb640 1 -- 172.21.15.105:0/2155773487 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd00004400 con 0x7fccf8004800 2024-09-21T03:21:17.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.450+0000 7fcd178d3640 1 -- 172.21.15.105:0/2155773487 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd101592e0 con 0x7fccf8004800 2024-09-21T03:21:17.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.451+0000 7fcd178d3640 1 -- 172.21.15.105:0/2155773487 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd1015cbc0 con 0x7fccf8004800 2024-09-21T03:21:17.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.452+0000 7fcd0dffb640 1 -- 172.21.15.105:0/2155773487 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcd000045a0 con 0x7fccf8004800 2024-09-21T03:21:17.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.452+0000 7fcd0dffb640 1 --2- 172.21.15.105:0/2155773487 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fccfc078bc0 0x7fccfc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:17.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.452+0000 7fcd0dffb640 1 -- 172.21.15.105:0/2155773487 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fcd0009c490 con 0x7fccf8004800 2024-09-21T03:21:17.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.452+0000 7fcd14e6e640 1 --2- 172.21.15.105:0/2155773487 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fccfc078bc0 0x7fccfc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:17.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.453+0000 7fcd14e6e640 1 --2- 172.21.15.105:0/2155773487 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fccfc078bc0 0x7fccfc07b0d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcd04032000 tx=0x7fcd04001190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:17.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.457+0000 7fcd0dffb640 1 -- 172.21.15.105:0/2155773487 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fcd000648d0 con 0x7fccf8004800 2024-09-21T03:21:17.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.671+0000 7fcd178d3640 1 -- 172.21.15.105:0/2155773487 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcd1015be80 con 0x7fccf8004800 2024-09-21T03:21:17.673 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.671+0000 7fcd0dffb640 1 -- 172.21.15.105:0/2155773487 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5234 (secure 0 0 0) 0x7fcd000641d0 con 0x7fccf8004800 2024-09-21T03:21:17.673 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:17.673 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":38,"btime":"2024-09-21T03:21:17:305276+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5593,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2041248590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2041248590},{"type":"v1","addr":"172.21.15.162:6836","nonce":2041248590}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5596,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/775014606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":775014606},{"type":"v1","addr":"172.21.15.162:6837","nonce":775014606}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5937,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3799275472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3799275472},{"type":"v1","addr":"172.21.15.105:6833","nonce":3799275472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:21:14.660239+0000","modified":"2024-09-21T03:21:16.660264+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5940},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5940":{"gid":5940,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1561028223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1561028223},{"type":"v1","addr":"172.21.15.105:6835","nonce":1561028223}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5940,"qdb_cluster":[5940]},"id":5}]} 2024-09-21T03:21:17.674 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 38 2024-09-21T03:21:17.676 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.674+0000 7fcd178d3640 1 -- 172.21.15.105:0/2155773487 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fccfc078bc0 msgr2=0x7fccfc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:17.676 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.674+0000 7fcd178d3640 1 --2- 172.21.15.105:0/2155773487 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fccfc078bc0 0x7fccfc07b0d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcd04032000 tx=0x7fcd04001190 comp rx=0 tx=0).stop 2024-09-21T03:21:17.676 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.674+0000 7fcd178d3640 1 -- 172.21.15.105:0/2155773487 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fccf8004800 msgr2=0x7fcd101483f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:17.676 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.674+0000 7fcd178d3640 1 --2- 172.21.15.105:0/2155773487 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fccf8004800 0x7fcd101483f0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fcd00011c90 tx=0x7fcd0000f790 comp rx=0 tx=0).stop 2024-09-21T03:21:17.676 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.674+0000 7fcd178d3640 1 -- 172.21.15.105:0/2155773487 shutdown_connections 2024-09-21T03:21:17.676 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.674+0000 7fcd178d3640 1 --2- 172.21.15.105:0/2155773487 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fccfc078bc0 0x7fccfc07b0d0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:17.676 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.674+0000 7fcd178d3640 1 --2- 172.21.15.105:0/2155773487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd100cb850 0x7fcd10159800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:17.676 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.674+0000 7fcd178d3640 1 --2- 172.21.15.105:0/2155773487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd101f71e0 0x7fcd100abfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:17.676 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.674+0000 7fcd178d3640 1 --2- 172.21.15.105:0/2155773487 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fccf8004800 0x7fcd101483f0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:17.676 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.674+0000 7fcd178d3640 1 -- 172.21.15.105:0/2155773487 >> 172.21.15.105:0/2155773487 conn(0x7fcd10072ae0 msgr2=0x7fcd100cebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:17.676 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.674+0000 7fcd178d3640 1 -- 172.21.15.105:0/2155773487 shutdown_connections 2024-09-21T03:21:17.677 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.674+0000 7fcd178d3640 1 -- 172.21.15.105:0/2155773487 wait complete. 2024-09-21T03:21:17.687 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:21:17.800 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.798+0000 7f372c407640 1 -- 172.21.15.105:0/1055042130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f372415c6f0 msgr2=0x7f37240ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:17.800 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.798+0000 7f372c407640 1 --2- 172.21.15.105:0/1055042130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f372415c6f0 0x7f37240ceb50 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f3724070810 tx=0x7f371402a560 comp rx=0 tx=0).stop 2024-09-21T03:21:17.800 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.798+0000 7f372c407640 1 -- 172.21.15.105:0/1055042130 shutdown_connections 2024-09-21T03:21:17.800 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.798+0000 7f372c407640 1 --2- 172.21.15.105:0/1055042130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f372415c6f0 0x7f37240ceb50 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:17.800 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.798+0000 7f372c407640 1 --2- 172.21.15.105:0/1055042130 >> v2:172.21.15.162:3300/0 conn(0x7f37240d1d40 0x7f37240b5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:17.800 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.798+0000 7f372c407640 1 -- 172.21.15.105:0/1055042130 >> 172.21.15.105:0/1055042130 conn(0x7f37240b3f10 msgr2=0x7f37240b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:17.800 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.798+0000 7f372c407640 1 -- 172.21.15.105:0/1055042130 shutdown_connections 2024-09-21T03:21:17.800 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.798+0000 7f372c407640 1 -- 172.21.15.105:0/1055042130 wait complete. 2024-09-21T03:21:17.801 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.799+0000 7f372c407640 1 Processor -- start 2024-09-21T03:21:17.801 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.800+0000 7f372c407640 1 -- start start 2024-09-21T03:21:17.803 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.801+0000 7f372c407640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37240ccba0 0x7f37240caa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:17.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.801+0000 7f372c407640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37240d1d40 0x7f37240b0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:17.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.801+0000 7f372c407640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f372415c6f0 0x7f37240b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:17.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.801+0000 7f372c407640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f37240d11f0 con 0x7f37240d1d40 2024-09-21T03:21:17.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.801+0000 7f372c407640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f37240d1070 con 0x7f37240ccba0 2024-09-21T03:21:17.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.801+0000 7f372c407640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f37240d1370 con 0x7f372415c6f0 2024-09-21T03:21:17.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.801+0000 7f37299a2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37240d1d40 0x7f37240b0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:17.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.801+0000 7f37299a2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37240d1d40 0x7f37240b0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:47604/0 (socket says 172.21.15.105:47604) 2024-09-21T03:21:17.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.801+0000 7f37299a2640 1 -- 172.21.15.105:0/2173105087 learned_addr learned my addr 172.21.15.105:0/2173105087 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:17.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.801+0000 7f372a1a3640 1 --2- 172.21.15.105:0/2173105087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37240ccba0 0x7f37240caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:17.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.801+0000 7f372a9a4640 1 --2- 172.21.15.105:0/2173105087 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f372415c6f0 0x7f37240b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:17.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.801+0000 7f37299a2640 1 -- 172.21.15.105:0/2173105087 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f372415c6f0 msgr2=0x7f37240b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:17.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.801+0000 7f37299a2640 1 --2- 172.21.15.105:0/2173105087 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f372415c6f0 0x7f37240b10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:17.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.801+0000 7f37299a2640 1 -- 172.21.15.105:0/2173105087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37240ccba0 msgr2=0x7f37240caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:17.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.801+0000 7f37299a2640 1 --2- 172.21.15.105:0/2173105087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37240ccba0 0x7f37240caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:17.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.801+0000 7f37299a2640 1 -- 172.21.15.105:0/2173105087 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37240cb770 con 0x7f37240d1d40 2024-09-21T03:21:17.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.801+0000 7f372a9a4640 1 --2- 172.21.15.105:0/2173105087 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f372415c6f0 0x7f37240b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:21:17.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.801+0000 7f37299a2640 1 --2- 172.21.15.105:0/2173105087 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37240d1d40 0x7f37240b0b80 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f3714000c00 tx=0x7f37140039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:17.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.802+0000 7f371affd640 1 -- 172.21.15.105:0/2173105087 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371403e030 con 0x7f37240d1d40 2024-09-21T03:21:17.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.802+0000 7f371affd640 1 -- 172.21.15.105:0/2173105087 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f37140047a0 con 0x7f37240d1d40 2024-09-21T03:21:17.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.802+0000 7f371affd640 1 -- 172.21.15.105:0/2173105087 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3714035040 con 0x7f37240d1d40 2024-09-21T03:21:17.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.802+0000 7f372c407640 1 -- 172.21.15.105:0/2173105087 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37240cba50 con 0x7f37240d1d40 2024-09-21T03:21:17.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.802+0000 7f372c407640 1 -- 172.21.15.105:0/2173105087 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37240cc010 con 0x7f37240d1d40 2024-09-21T03:21:17.807 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.803+0000 7f372c407640 1 -- 172.21.15.105:0/2173105087 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37240b5540 con 0x7f37240d1d40 2024-09-21T03:21:17.807 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.803+0000 7f371affd640 1 -- 172.21.15.105:0/2173105087 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3714041030 con 0x7f37240d1d40 2024-09-21T03:21:17.807 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.804+0000 7f371affd640 1 --2- 172.21.15.105:0/2173105087 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3708078b90 0x7f370807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:17.807 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.804+0000 7f371affd640 1 -- 172.21.15.105:0/2173105087 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f37140bb4a0 con 0x7f37240d1d40 2024-09-21T03:21:17.807 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.804+0000 7f372a1a3640 1 --2- 172.21.15.105:0/2173105087 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3708078b90 0x7f370807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:17.807 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.804+0000 7f372a1a3640 1 --2- 172.21.15.105:0/2173105087 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3708078b90 0x7f370807b0a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3720005c40 tx=0x7f372000a550 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:17.810 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.808+0000 7f371affd640 1 -- 172.21.15.105:0/2173105087 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f37240b5540 con 0x7f37240d1d40 2024-09-21T03:21:17.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.985+0000 7f372c407640 1 -- 172.21.15.105:0/2173105087 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f37240cb500 con 0x7f37240d1d40 2024-09-21T03:21:17.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.986+0000 7f371affd640 1 -- 172.21.15.105:0/2173105087 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) ==== 74+0+16800 (secure 0 0 0) 0x7f37140833b0 con 0x7f37240d1d40 2024-09-21T03:21:17.988 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:17.988 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":69,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:21:16.299955+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:21:12.315659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-21T03:21:13.622324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:21:17.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.988+0000 7f372c407640 1 -- 172.21.15.105:0/2173105087 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3708078b90 msgr2=0x7f370807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:17.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.988+0000 7f372c407640 1 --2- 172.21.15.105:0/2173105087 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3708078b90 0x7f370807b0a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3720005c40 tx=0x7f372000a550 comp rx=0 tx=0).stop 2024-09-21T03:21:17.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.988+0000 7f372c407640 1 -- 172.21.15.105:0/2173105087 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37240d1d40 msgr2=0x7f37240b0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:17.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.988+0000 7f372c407640 1 --2- 172.21.15.105:0/2173105087 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37240d1d40 0x7f37240b0b80 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f3714000c00 tx=0x7f37140039e0 comp rx=0 tx=0).stop 2024-09-21T03:21:17.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.988+0000 7f372c407640 1 -- 172.21.15.105:0/2173105087 shutdown_connections 2024-09-21T03:21:17.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.988+0000 7f372c407640 1 --2- 172.21.15.105:0/2173105087 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3708078b90 0x7f370807b0a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:17.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.988+0000 7f372c407640 1 --2- 172.21.15.105:0/2173105087 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f372415c6f0 0x7f37240b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:17.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.988+0000 7f372c407640 1 --2- 172.21.15.105:0/2173105087 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37240d1d40 0x7f37240b0b80 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:17.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.988+0000 7f372c407640 1 --2- 172.21.15.105:0/2173105087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37240ccba0 0x7f37240caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:17.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.988+0000 7f372c407640 1 -- 172.21.15.105:0/2173105087 >> 172.21.15.105:0/2173105087 conn(0x7f37240b3f10 msgr2=0x7f37240b3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:17.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.988+0000 7f372c407640 1 -- 172.21.15.105:0/2173105087 shutdown_connections 2024-09-21T03:21:17.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:17.988+0000 7f372c407640 1 -- 172.21.15.105:0/2173105087 wait complete. 2024-09-21T03:21:18.001 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T03:21:18.001 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:21:18.114 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.112+0000 7feb29f20640 1 -- 172.21.15.105:0/528468474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb240b9b60 msgr2=0x7feb240d4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:18.114 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.112+0000 7feb29f20640 1 --2- 172.21.15.105:0/528468474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb240b9b60 0x7feb240d4d80 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7feb140098e0 tx=0x7feb1402a4a0 comp rx=0 tx=0).stop 2024-09-21T03:21:18.114 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.112+0000 7feb29f20640 1 -- 172.21.15.105:0/528468474 shutdown_connections 2024-09-21T03:21:18.114 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.112+0000 7feb29f20640 1 --2- 172.21.15.105:0/528468474 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb240b66b0 0x7feb2406eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:18.114 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.112+0000 7feb29f20640 1 --2- 172.21.15.105:0/528468474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb240b9b60 0x7feb240d4d80 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:18.114 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.112+0000 7feb29f20640 1 -- 172.21.15.105:0/528468474 >> 172.21.15.105:0/528468474 conn(0x7feb2409d7f0 msgr2=0x7feb240d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:18.114 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.112+0000 7feb29f20640 1 -- 172.21.15.105:0/528468474 shutdown_connections 2024-09-21T03:21:18.115 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.112+0000 7feb29f20640 1 -- 172.21.15.105:0/528468474 wait complete. 2024-09-21T03:21:18.115 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.114+0000 7feb29f20640 1 Processor -- start 2024-09-21T03:21:18.115 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.114+0000 7feb29f20640 1 -- start start 2024-09-21T03:21:18.118 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.115+0000 7feb29f20640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb240b9b60 0x7feb240c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:18.118 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.115+0000 7feb29f20640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb240cf540 0x7feb2415ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:18.118 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.115+0000 7feb29f20640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb2415bb20 0x7feb241f9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:18.118 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.115+0000 7feb29f20640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7feb2406f630 con 0x7feb240b9b60 2024-09-21T03:21:18.118 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.115+0000 7feb29f20640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feb2406f4b0 con 0x7feb240cf540 2024-09-21T03:21:18.118 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.115+0000 7feb29f20640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7feb2406f7b0 con 0x7feb2415bb20 2024-09-21T03:21:18.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.115+0000 7feb237fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb240b9b60 0x7feb240c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:18.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.115+0000 7feb237fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb240b9b60 0x7feb240c8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:47620/0 (socket says 172.21.15.105:47620) 2024-09-21T03:21:18.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.115+0000 7feb237fe640 1 -- 172.21.15.105:0/56759490 learned_addr learned my addr 172.21.15.105:0/56759490 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:18.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.115+0000 7feb23fff640 1 --2- 172.21.15.105:0/56759490 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb2415bb20 0x7feb241f9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:18.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.115+0000 7feb22ffd640 1 --2- 172.21.15.105:0/56759490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb240cf540 0x7feb2415ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:18.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.116+0000 7feb237fe640 1 -- 172.21.15.105:0/56759490 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb2415bb20 msgr2=0x7feb241f9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:18.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.116+0000 7feb237fe640 1 --2- 172.21.15.105:0/56759490 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb2415bb20 0x7feb241f9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:18.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.116+0000 7feb237fe640 1 -- 172.21.15.105:0/56759490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb240cf540 msgr2=0x7feb2415ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:18.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.116+0000 7feb237fe640 1 --2- 172.21.15.105:0/56759490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb240cf540 0x7feb2415ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:18.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.116+0000 7feb237fe640 1 -- 172.21.15.105:0/56759490 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb2415b390 con 0x7feb240b9b60 2024-09-21T03:21:18.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.116+0000 7feb23fff640 1 --2- 172.21.15.105:0/56759490 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb2415bb20 0x7feb241f9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:21:18.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.116+0000 7feb237fe640 1 --2- 172.21.15.105:0/56759490 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb240b9b60 0x7feb240c8050 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7feb140099d0 tx=0x7feb14004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:18.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.116+0000 7feb0bfff640 1 -- 172.21.15.105:0/56759490 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb14005cf0 con 0x7feb240b9b60 2024-09-21T03:21:18.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.116+0000 7feb0bfff640 1 -- 172.21.15.105:0/56759490 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb14004e50 con 0x7feb240b9b60 2024-09-21T03:21:18.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.116+0000 7feb0bfff640 1 -- 172.21.15.105:0/56759490 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb14031e60 con 0x7feb240b9b60 2024-09-21T03:21:18.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.116+0000 7feb29f20640 1 -- 172.21.15.105:0/56759490 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb240c9760 con 0x7feb240b9b60 2024-09-21T03:21:18.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.116+0000 7feb29f20640 1 -- 172.21.15.105:0/56759490 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb240c9d20 con 0x7feb240b9b60 2024-09-21T03:21:18.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.117+0000 7feb29f20640 1 -- 172.21.15.105:0/56759490 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb2415b940 con 0x7feb240b9b60 2024-09-21T03:21:18.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.118+0000 7feb0bfff640 1 -- 172.21.15.105:0/56759490 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feb140330d0 con 0x7feb240b9b60 2024-09-21T03:21:18.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.119+0000 7feb0bfff640 1 --2- 172.21.15.105:0/56759490 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7feb10078bc0 0x7feb1007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:18.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.119+0000 7feb22ffd640 1 --2- 172.21.15.105:0/56759490 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7feb10078bc0 0x7feb1007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:18.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.119+0000 7feb0bfff640 1 -- 172.21.15.105:0/56759490 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7feb140bbf50 con 0x7feb240b9b60 2024-09-21T03:21:18.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.119+0000 7feb22ffd640 1 --2- 172.21.15.105:0/56759490 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7feb10078bc0 0x7feb1007b0d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7feb241e7820 tx=0x7feb18009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:18.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.123+0000 7feb0bfff640 1 -- 172.21.15.105:0/56759490 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7feb2415b940 con 0x7feb240b9b60 2024-09-21T03:21:18.297 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.295+0000 7feb29f20640 1 -- 172.21.15.105:0/56759490 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feb2406fcd0 con 0x7feb10078bc0 2024-09-21T03:21:18.301 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.300+0000 7feb0bfff640 1 -- 172.21.15.105:0/56759490 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241333 (secure 0 0 0) 0x7feb2406fcd0 con 0x7feb10078bc0 2024-09-21T03:21:18.304 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:18.305 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:21:18.307 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.303+0000 7feb29f20640 1 -- 172.21.15.105:0/56759490 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7feb10078bc0 msgr2=0x7feb1007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:18.307 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.303+0000 7feb29f20640 1 --2- 172.21.15.105:0/56759490 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7feb10078bc0 0x7feb1007b0d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7feb241e7820 tx=0x7feb18009040 comp rx=0 tx=0).stop 2024-09-21T03:21:18.307 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.303+0000 7feb29f20640 1 -- 172.21.15.105:0/56759490 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb240b9b60 msgr2=0x7feb240c8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:18.307 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.303+0000 7feb29f20640 1 --2- 172.21.15.105:0/56759490 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb240b9b60 0x7feb240c8050 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7feb140099d0 tx=0x7feb14004a50 comp rx=0 tx=0).stop 2024-09-21T03:21:18.307 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.303+0000 7feb29f20640 1 -- 172.21.15.105:0/56759490 shutdown_connections 2024-09-21T03:21:18.307 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.303+0000 7feb29f20640 1 --2- 172.21.15.105:0/56759490 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7feb10078bc0 0x7feb1007b0d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:18.307 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.303+0000 7feb29f20640 1 --2- 172.21.15.105:0/56759490 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb2415bb20 0x7feb241f9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:18.307 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.303+0000 7feb29f20640 1 --2- 172.21.15.105:0/56759490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb240cf540 0x7feb2415ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:18.307 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.303+0000 7feb29f20640 1 --2- 172.21.15.105:0/56759490 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb240b9b60 0x7feb240c8050 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:18.307 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.303+0000 7feb29f20640 1 -- 172.21.15.105:0/56759490 >> 172.21.15.105:0/56759490 conn(0x7feb2409d7f0 msgr2=0x7feb240d1290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:18.307 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.303+0000 7feb29f20640 1 -- 172.21.15.105:0/56759490 shutdown_connections 2024-09-21T03:21:18.307 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.303+0000 7feb29f20640 1 -- 172.21.15.105:0/56759490 wait complete. 2024-09-21T03:21:18.316 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2024-09-21T03:21:17.321896+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":78,"acting":78,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236080,"kb_used_data":7356,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754738640,"statfs":{"total":773094113280,"available":772852367360,"internally_reserved":0,"allocated":7532544,"data_stored":3778663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.036321"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.322799+0000","last_change":"2024-09-21T03:21:15.320132+0000","last_active":"2024-09-21T03:21:15.322799+0000","last_peered":"2024-09-21T03:21:15.322799+0000","last_clean":"2024-09-21T03:21:15.322799+0000","last_became_active":"2024-09-21T03:21:15.319814+0000","last_became_peered":"2024-09-21T03:21:15.319814+0000","last_unstale":"2024-09-21T03:21:15.322799+0000","last_undegraded":"2024-09-21T03:21:15.322799+0000","last_fullsized":"2024-09-21T03:21:15.322799+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:52.724426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.321464+0000","last_change":"2024-09-21T03:21:15.319096+0000","last_active":"2024-09-21T03:21:15.321464+0000","last_peered":"2024-09-21T03:21:15.321464+0000","last_clean":"2024-09-21T03:21:15.321464+0000","last_became_active":"2024-09-21T03:21:15.318769+0000","last_became_peered":"2024-09-21T03:21:15.318769+0000","last_unstale":"2024-09-21T03:21:15.321464+0000","last_undegraded":"2024-09-21T03:21:15.321464+0000","last_fullsized":"2024-09-21T03:21:15.321464+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:26.465077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.314579+0000","last_change":"2024-09-21T03:21:15.313301+0000","last_active":"2024-09-21T03:21:15.314579+0000","last_peered":"2024-09-21T03:21:15.314579+0000","last_clean":"2024-09-21T03:21:15.314579+0000","last_became_active":"2024-09-21T03:21:15.313019+0000","last_became_peered":"2024-09-21T03:21:15.313019+0000","last_unstale":"2024-09-21T03:21:15.314579+0000","last_undegraded":"2024-09-21T03:21:15.314579+0000","last_fullsized":"2024-09-21T03:21:15.314579+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:58.046608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.289153+0000","last_change":"2024-09-21T03:21:13.289153+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.289153+0000","last_undegraded":"2024-09-21T03:21:13.289153+0000","last_fullsized":"2024-09-21T03:21:13.289153+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"68'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.322118+0000","last_change":"2024-09-21T03:21:14.308412+0000","last_active":"2024-09-21T03:21:15.322118+0000","last_peered":"2024-09-21T03:21:15.322118+0000","last_clean":"2024-09-21T03:21:15.322118+0000","last_became_active":"2024-09-21T03:21:14.308143+0000","last_became_peered":"2024-09-21T03:21:14.308143+0000","last_unstale":"2024-09-21T03:21:15.322118+0000","last_undegraded":"2024-09-21T03:21:15.322118+0000","last_fullsized":"2024-09-21T03:21:15.322118+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:35:45.932535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.287103+0000","last_change":"2024-09-21T03:21:13.287103+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.287103+0000","last_undegraded":"2024-09-21T03:21:13.287103+0000","last_fullsized":"2024-09-21T03:21:13.287103+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.288678+0000","last_change":"2024-09-21T03:21:13.288678+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.288678+0000","last_undegraded":"2024-09-21T03:21:13.288678+0000","last_fullsized":"2024-09-21T03:21:13.288678+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.289248+0000","last_change":"2024-09-21T03:21:13.289248+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.289248+0000","last_undegraded":"2024-09-21T03:21:13.289248+0000","last_fullsized":"2024-09-21T03:21:13.289248+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.290484+0000","last_change":"2024-09-21T03:21:13.290484+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.290484+0000","last_undegraded":"2024-09-21T03:21:13.290484+0000","last_fullsized":"2024-09-21T03:21:13.290484+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.291496+0000","last_change":"2024-09-21T03:21:13.291496+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.291496+0000","last_undegraded":"2024-09-21T03:21:13.291496+0000","last_fullsized":"2024-09-21T03:21:13.291496+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.314596+0000","last_change":"2024-09-21T03:21:15.312519+0000","last_active":"2024-09-21T03:21:15.314596+0000","last_peered":"2024-09-21T03:21:15.314596+0000","last_clean":"2024-09-21T03:21:15.314596+0000","last_became_active":"2024-09-21T03:21:15.312186+0000","last_became_peered":"2024-09-21T03:21:15.312186+0000","last_unstale":"2024-09-21T03:21:15.314596+0000","last_undegraded":"2024-09-21T03:21:15.314596+0000","last_fullsized":"2024-09-21T03:21:15.314596+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:48:45.076339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.293082+0000","last_change":"2024-09-21T03:21:13.293082+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.293082+0000","last_undegraded":"2024-09-21T03:21:13.293082+0000","last_fullsized":"2024-09-21T03:21:13.293082+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.287132+0000","last_change":"2024-09-21T03:21:13.287132+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.287132+0000","last_undegraded":"2024-09-21T03:21:13.287132+0000","last_fullsized":"2024-09-21T03:21:13.287132+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.289759+0000","last_change":"2024-09-21T03:21:13.289759+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.289759+0000","last_undegraded":"2024-09-21T03:21:13.289759+0000","last_fullsized":"2024-09-21T03:21:13.289759+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.289253+0000","last_change":"2024-09-21T03:21:13.289253+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.289253+0000","last_undegraded":"2024-09-21T03:21:13.289253+0000","last_fullsized":"2024-09-21T03:21:13.289253+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.291517+0000","last_change":"2024-09-21T03:21:13.291517+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.291517+0000","last_undegraded":"2024-09-21T03:21:13.291517+0000","last_fullsized":"2024-09-21T03:21:13.291517+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.291546+0000","last_change":"2024-09-21T03:21:13.291546+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.291546+0000","last_undegraded":"2024-09-21T03:21:13.291546+0000","last_fullsized":"2024-09-21T03:21:13.291546+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.289789+0000","last_change":"2024-09-21T03:21:13.289789+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.289789+0000","last_undegraded":"2024-09-21T03:21:13.289789+0000","last_fullsized":"2024-09-21T03:21:13.289789+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.322785+0000","last_change":"2024-09-21T03:21:15.320020+0000","last_active":"2024-09-21T03:21:15.322785+0000","last_peered":"2024-09-21T03:21:15.322785+0000","last_clean":"2024-09-21T03:21:15.322785+0000","last_became_active":"2024-09-21T03:21:15.319702+0000","last_became_peered":"2024-09-21T03:21:15.319702+0000","last_unstale":"2024-09-21T03:21:15.322785+0000","last_undegraded":"2024-09-21T03:21:15.322785+0000","last_fullsized":"2024-09-21T03:21:15.322785+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:28.854474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.292833+0000","last_change":"2024-09-21T03:21:13.292833+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.292833+0000","last_undegraded":"2024-09-21T03:21:13.292833+0000","last_fullsized":"2024-09-21T03:21:13.292833+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.287111+0000","last_change":"2024-09-21T03:21:13.287111+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.287111+0000","last_undegraded":"2024-09-21T03:21:13.287111+0000","last_fullsized":"2024-09-21T03:21:13.287111+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.289323+0000","last_change":"2024-09-21T03:21:13.289323+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.289323+0000","last_undegraded":"2024-09-21T03:21:13.289323+0000","last_fullsized":"2024-09-21T03:21:13.289323+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.287071+0000","last_change":"2024-09-21T03:21:13.287071+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.287071+0000","last_undegraded":"2024-09-21T03:21:13.287071+0000","last_fullsized":"2024-09-21T03:21:13.287071+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.289681+0000","last_change":"2024-09-21T03:21:13.289681+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.289681+0000","last_undegraded":"2024-09-21T03:21:13.289681+0000","last_fullsized":"2024-09-21T03:21:13.289681+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.288944+0000","last_change":"2024-09-21T03:21:13.288944+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.288944+0000","last_undegraded":"2024-09-21T03:21:13.288944+0000","last_fullsized":"2024-09-21T03:21:13.288944+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.288605+0000","last_change":"2024-09-21T03:21:13.288605+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.288605+0000","last_undegraded":"2024-09-21T03:21:13.288605+0000","last_fullsized":"2024-09-21T03:21:13.288605+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.292029+0000","last_change":"2024-09-21T03:21:13.292029+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.292029+0000","last_undegraded":"2024-09-21T03:21:13.292029+0000","last_fullsized":"2024-09-21T03:21:13.292029+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.303159+0000","last_change":"2024-09-21T03:21:14.310881+0000","last_active":"2024-09-21T03:21:15.303159+0000","last_peered":"2024-09-21T03:21:15.303159+0000","last_clean":"2024-09-21T03:21:15.303159+0000","last_became_active":"2024-09-21T03:21:14.309420+0000","last_became_peered":"2024-09-21T03:21:14.309420+0000","last_unstale":"2024-09-21T03:21:15.303159+0000","last_undegraded":"2024-09-21T03:21:15.303159+0000","last_fullsized":"2024-09-21T03:21:15.303159+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:31.033897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.315502+0000","last_change":"2024-09-21T03:21:15.314776+0000","last_active":"2024-09-21T03:21:15.315502+0000","last_peered":"2024-09-21T03:21:15.315502+0000","last_clean":"2024-09-21T03:21:15.315502+0000","last_became_active":"2024-09-21T03:21:15.314469+0000","last_became_peered":"2024-09-21T03:21:15.314469+0000","last_unstale":"2024-09-21T03:21:15.315502+0000","last_undegraded":"2024-09-21T03:21:15.315502+0000","last_fullsized":"2024-09-21T03:21:15.315502+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:02:54.407198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.288034+0000","last_change":"2024-09-21T03:21:13.288034+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.288034+0000","last_undegraded":"2024-09-21T03:21:13.288034+0000","last_fullsized":"2024-09-21T03:21:13.288034+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.292041+0000","last_change":"2024-09-21T03:21:13.292041+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.292041+0000","last_undegraded":"2024-09-21T03:21:13.292041+0000","last_fullsized":"2024-09-21T03:21:13.292041+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.293448+0000","last_change":"2024-09-21T03:21:13.293448+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.293448+0000","last_undegraded":"2024-09-21T03:21:13.293448+0000","last_fullsized":"2024-09-21T03:21:13.293448+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.301724+0000","last_change":"2024-09-21T03:21:14.306171+0000","last_active":"2024-09-21T03:21:15.301724+0000","last_peered":"2024-09-21T03:21:15.301724+0000","last_clean":"2024-09-21T03:21:15.301724+0000","last_became_active":"2024-09-21T03:21:14.305871+0000","last_became_peered":"2024-09-21T03:21:14.305871+0000","last_unstale":"2024-09-21T03:21:15.301724+0000","last_undegraded":"2024-09-21T03:21:15.301724+0000","last_fullsized":"2024-09-21T03:21:15.301724+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:48.590153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.292925+0000","last_change":"2024-09-21T03:21:13.292925+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.292925+0000","last_undegraded":"2024-09-21T03:21:13.292925+0000","last_fullsized":"2024-09-21T03:21:13.292925+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.291872+0000","last_change":"2024-09-21T03:21:13.291872+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.291872+0000","last_undegraded":"2024-09-21T03:21:13.291872+0000","last_fullsized":"2024-09-21T03:21:13.291872+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.287262+0000","last_change":"2024-09-21T03:21:13.287262+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.287262+0000","last_undegraded":"2024-09-21T03:21:13.287262+0000","last_fullsized":"2024-09-21T03:21:13.287262+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.288820+0000","last_change":"2024-09-21T03:21:13.288820+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.288820+0000","last_undegraded":"2024-09-21T03:21:13.288820+0000","last_fullsized":"2024-09-21T03:21:13.288820+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.288432+0000","last_change":"2024-09-21T03:21:13.288432+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.288432+0000","last_undegraded":"2024-09-21T03:21:13.288432+0000","last_fullsized":"2024-09-21T03:21:13.288432+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":191,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-21T03:21:13.286190+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:21:13.286190+0000","last_peered":"2024-09-21T03:21:13.286190+0000","last_clean":"2024-09-21T03:21:13.286190+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:21:13.286190+0000","last_undegraded":"2024-09-21T03:21:13.286190+0000","last_fullsized":"2024-09-21T03:21:13.286190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":1},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509480,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28384,"kb_used_data":1356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343456,"statfs":{"total":96636764160,"available":96607698944,"internally_reserved":0,"allocated":1388544,"data_stored":915659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":794624,"data_stored":325291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509478,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":794624,"data_stored":325291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509478,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":782336,"data_stored":319474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":782336,"data_stored":319474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":782336,"data_stored":319474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509479,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":794624,"data_stored":325291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1413120,"data_stored":928709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:21:18.320 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:21:18.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.467+0000 7f2c4ab57640 1 -- 172.21.15.105:0/3562540750 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c4406d4f0 msgr2=0x7f2c44071250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:18.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.467+0000 7f2c4ab57640 1 --2- 172.21.15.105:0/3562540750 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c4406d4f0 0x7f2c44071250 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2c34005fd0 tx=0x7f2c3402a670 comp rx=0 tx=0).stop 2024-09-21T03:21:18.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.467+0000 7f2c4ab57640 1 -- 172.21.15.105:0/3562540750 shutdown_connections 2024-09-21T03:21:18.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.467+0000 7f2c4ab57640 1 --2- 172.21.15.105:0/3562540750 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c4406d4f0 0x7f2c44071250 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:18.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.467+0000 7f2c4ab57640 1 --2- 172.21.15.105:0/3562540750 >> v2:172.21.15.162:3300/0 conn(0x7f2c440ce7d0 0x7f2c440cfcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:18.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.467+0000 7f2c4ab57640 1 -- 172.21.15.105:0/3562540750 >> 172.21.15.105:0/3562540750 conn(0x7f2c440cdcb0 msgr2=0x7f2c440ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:18.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.467+0000 7f2c4ab57640 1 -- 172.21.15.105:0/3562540750 shutdown_connections 2024-09-21T03:21:18.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.467+0000 7f2c4ab57640 1 -- 172.21.15.105:0/3562540750 wait complete. 2024-09-21T03:21:18.470 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.469+0000 7f2c4ab57640 1 Processor -- start 2024-09-21T03:21:18.470 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.469+0000 7f2c4ab57640 1 -- start start 2024-09-21T03:21:18.473 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.470+0000 7f2c4ab57640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c440ce7d0 0x7f2c441501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:18.473 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.470+0000 7f2c4ab57640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c441600a0 0x7f2c440b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:18.473 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.470+0000 7f2c4ab57640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c440b3720 0x7f2c440adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:18.473 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.470+0000 7f2c4ab57640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2c440d0370 con 0x7f2c440ce7d0 2024-09-21T03:21:18.473 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.470+0000 7f2c4ab57640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2c440d01f0 con 0x7f2c440b3720 2024-09-21T03:21:18.473 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.470+0000 7f2c4ab57640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2c440d04f0 con 0x7f2c441600a0 2024-09-21T03:21:18.473 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.470+0000 7f2c488f3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c440ce7d0 0x7f2c441501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:18.473 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.470+0000 7f2c488f3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c440ce7d0 0x7f2c441501a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:47624/0 (socket says 172.21.15.105:47624) 2024-09-21T03:21:18.473 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.470+0000 7f2c488f3640 1 -- 172.21.15.105:0/460128508 learned_addr learned my addr 172.21.15.105:0/460128508 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:18.473 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.470+0000 7f2c3bfff640 1 --2- 172.21.15.105:0/460128508 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c441600a0 0x7f2c440b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:18.473 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.470+0000 7f2c490f4640 1 --2- 172.21.15.105:0/460128508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c440b3720 0x7f2c440adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:18.473 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.471+0000 7f2c488f3640 1 -- 172.21.15.105:0/460128508 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c441600a0 msgr2=0x7f2c440b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:18.473 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.471+0000 7f2c488f3640 1 --2- 172.21.15.105:0/460128508 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c441600a0 0x7f2c440b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:18.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.471+0000 7f2c488f3640 1 -- 172.21.15.105:0/460128508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c440b3720 msgr2=0x7f2c440adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:18.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.471+0000 7f2c488f3640 1 --2- 172.21.15.105:0/460128508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c440b3720 0x7f2c440adfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:18.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.471+0000 7f2c488f3640 1 -- 172.21.15.105:0/460128508 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c441f6880 con 0x7f2c440ce7d0 2024-09-21T03:21:18.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.471+0000 7f2c488f3640 1 --2- 172.21.15.105:0/460128508 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c440ce7d0 0x7f2c441501a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f2c4000c3d0 tx=0x7f2c4000c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:18.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.471+0000 7f2c397fa640 1 -- 172.21.15.105:0/460128508 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c40017070 con 0x7f2c440ce7d0 2024-09-21T03:21:18.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.471+0000 7f2c4ab57640 1 -- 172.21.15.105:0/460128508 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c441f6af0 con 0x7f2c440ce7d0 2024-09-21T03:21:18.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.471+0000 7f2c397fa640 1 -- 172.21.15.105:0/460128508 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c400053c0 con 0x7f2c440ce7d0 2024-09-21T03:21:18.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.471+0000 7f2c397fa640 1 -- 172.21.15.105:0/460128508 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c40003850 con 0x7f2c440ce7d0 2024-09-21T03:21:18.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.471+0000 7f2c4ab57640 1 -- 172.21.15.105:0/460128508 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c441f70b0 con 0x7f2c440ce7d0 2024-09-21T03:21:18.475 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.472+0000 7f2c4ab57640 1 -- 172.21.15.105:0/460128508 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c440d09a0 con 0x7f2c440ce7d0 2024-09-21T03:21:18.475 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.473+0000 7f2c397fa640 1 -- 172.21.15.105:0/460128508 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2c4001a070 con 0x7f2c440ce7d0 2024-09-21T03:21:18.475 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.474+0000 7f2c397fa640 1 --2- 172.21.15.105:0/460128508 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2c30078b90 0x7f2c3007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:18.475 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.474+0000 7f2c3bfff640 1 --2- 172.21.15.105:0/460128508 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2c30078b90 0x7f2c3007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:18.475 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.474+0000 7f2c397fa640 1 -- 172.21.15.105:0/460128508 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f2c40099f90 con 0x7f2c440ce7d0 2024-09-21T03:21:18.476 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.474+0000 7f2c3bfff640 1 --2- 172.21.15.105:0/460128508 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2c30078b90 0x7f2c3007b0a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2c34033000 tx=0x7f2c34004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:18.480 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.478+0000 7f2c397fa640 1 -- 172.21.15.105:0/460128508 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2c40061d90 con 0x7f2c440ce7d0 2024-09-21T03:21:18.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.650+0000 7f2c4ab57640 1 -- 172.21.15.105:0/460128508 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2c440ce380 con 0x7f2c30078b90 2024-09-21T03:21:18.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.654+0000 7f2c397fa640 1 -- 172.21.15.105:0/460128508 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241333 (secure 0 0 0) 0x7f2c440ce380 con 0x7f2c30078b90 2024-09-21T03:21:18.658 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:18.659 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:21:18.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.657+0000 7f2c4ab57640 1 -- 172.21.15.105:0/460128508 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2c30078b90 msgr2=0x7f2c3007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:18.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.657+0000 7f2c4ab57640 1 --2- 172.21.15.105:0/460128508 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2c30078b90 0x7f2c3007b0a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2c34033000 tx=0x7f2c34004730 comp rx=0 tx=0).stop 2024-09-21T03:21:18.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.657+0000 7f2c4ab57640 1 -- 172.21.15.105:0/460128508 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c440ce7d0 msgr2=0x7f2c441501a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:18.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.657+0000 7f2c4ab57640 1 --2- 172.21.15.105:0/460128508 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c440ce7d0 0x7f2c441501a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f2c4000c3d0 tx=0x7f2c4000c7d0 comp rx=0 tx=0).stop 2024-09-21T03:21:18.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.657+0000 7f2c4ab57640 1 -- 172.21.15.105:0/460128508 shutdown_connections 2024-09-21T03:21:18.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.657+0000 7f2c4ab57640 1 --2- 172.21.15.105:0/460128508 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2c30078b90 0x7f2c3007b0a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:18.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.657+0000 7f2c4ab57640 1 --2- 172.21.15.105:0/460128508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c440b3720 0x7f2c440adfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:18.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.657+0000 7f2c4ab57640 1 --2- 172.21.15.105:0/460128508 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c441600a0 0x7f2c440b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:18.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.657+0000 7f2c4ab57640 1 --2- 172.21.15.105:0/460128508 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c440ce7d0 0x7f2c441501a0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:18.662 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.657+0000 7f2c4ab57640 1 -- 172.21.15.105:0/460128508 >> 172.21.15.105:0/460128508 conn(0x7f2c440cdcb0 msgr2=0x7f2c4415cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:18.662 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.657+0000 7f2c4ab57640 1 -- 172.21.15.105:0/460128508 shutdown_connections 2024-09-21T03:21:18.662 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.657+0000 7f2c4ab57640 1 -- 172.21.15.105:0/460128508 wait complete. 2024-09-21T03:21:18.670 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2024-09-21T03:21:17.321896+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":78,"acting":78,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236080,"kb_used_data":7356,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754738640,"statfs":{"total":773094113280,"available":772852367360,"internally_reserved":0,"allocated":7532544,"data_stored":3778663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.036321"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.322799+0000","last_change":"2024-09-21T03:21:15.320132+0000","last_active":"2024-09-21T03:21:15.322799+0000","last_peered":"2024-09-21T03:21:15.322799+0000","last_clean":"2024-09-21T03:21:15.322799+0000","last_became_active":"2024-09-21T03:21:15.319814+0000","last_became_peered":"2024-09-21T03:21:15.319814+0000","last_unstale":"2024-09-21T03:21:15.322799+0000","last_undegraded":"2024-09-21T03:21:15.322799+0000","last_fullsized":"2024-09-21T03:21:15.322799+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:52.724426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.321464+0000","last_change":"2024-09-21T03:21:15.319096+0000","last_active":"2024-09-21T03:21:15.321464+0000","last_peered":"2024-09-21T03:21:15.321464+0000","last_clean":"2024-09-21T03:21:15.321464+0000","last_became_active":"2024-09-21T03:21:15.318769+0000","last_became_peered":"2024-09-21T03:21:15.318769+0000","last_unstale":"2024-09-21T03:21:15.321464+0000","last_undegraded":"2024-09-21T03:21:15.321464+0000","last_fullsized":"2024-09-21T03:21:15.321464+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:26.465077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.314579+0000","last_change":"2024-09-21T03:21:15.313301+0000","last_active":"2024-09-21T03:21:15.314579+0000","last_peered":"2024-09-21T03:21:15.314579+0000","last_clean":"2024-09-21T03:21:15.314579+0000","last_became_active":"2024-09-21T03:21:15.313019+0000","last_became_peered":"2024-09-21T03:21:15.313019+0000","last_unstale":"2024-09-21T03:21:15.314579+0000","last_undegraded":"2024-09-21T03:21:15.314579+0000","last_fullsized":"2024-09-21T03:21:15.314579+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:58.046608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.289153+0000","last_change":"2024-09-21T03:21:13.289153+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.289153+0000","last_undegraded":"2024-09-21T03:21:13.289153+0000","last_fullsized":"2024-09-21T03:21:13.289153+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"68'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.322118+0000","last_change":"2024-09-21T03:21:14.308412+0000","last_active":"2024-09-21T03:21:15.322118+0000","last_peered":"2024-09-21T03:21:15.322118+0000","last_clean":"2024-09-21T03:21:15.322118+0000","last_became_active":"2024-09-21T03:21:14.308143+0000","last_became_peered":"2024-09-21T03:21:14.308143+0000","last_unstale":"2024-09-21T03:21:15.322118+0000","last_undegraded":"2024-09-21T03:21:15.322118+0000","last_fullsized":"2024-09-21T03:21:15.322118+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:35:45.932535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.287103+0000","last_change":"2024-09-21T03:21:13.287103+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.287103+0000","last_undegraded":"2024-09-21T03:21:13.287103+0000","last_fullsized":"2024-09-21T03:21:13.287103+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.288678+0000","last_change":"2024-09-21T03:21:13.288678+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.288678+0000","last_undegraded":"2024-09-21T03:21:13.288678+0000","last_fullsized":"2024-09-21T03:21:13.288678+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.289248+0000","last_change":"2024-09-21T03:21:13.289248+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.289248+0000","last_undegraded":"2024-09-21T03:21:13.289248+0000","last_fullsized":"2024-09-21T03:21:13.289248+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.290484+0000","last_change":"2024-09-21T03:21:13.290484+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.290484+0000","last_undegraded":"2024-09-21T03:21:13.290484+0000","last_fullsized":"2024-09-21T03:21:13.290484+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.291496+0000","last_change":"2024-09-21T03:21:13.291496+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.291496+0000","last_undegraded":"2024-09-21T03:21:13.291496+0000","last_fullsized":"2024-09-21T03:21:13.291496+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.314596+0000","last_change":"2024-09-21T03:21:15.312519+0000","last_active":"2024-09-21T03:21:15.314596+0000","last_peered":"2024-09-21T03:21:15.314596+0000","last_clean":"2024-09-21T03:21:15.314596+0000","last_became_active":"2024-09-21T03:21:15.312186+0000","last_became_peered":"2024-09-21T03:21:15.312186+0000","last_unstale":"2024-09-21T03:21:15.314596+0000","last_undegraded":"2024-09-21T03:21:15.314596+0000","last_fullsized":"2024-09-21T03:21:15.314596+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:48:45.076339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.293082+0000","last_change":"2024-09-21T03:21:13.293082+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.293082+0000","last_undegraded":"2024-09-21T03:21:13.293082+0000","last_fullsized":"2024-09-21T03:21:13.293082+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.287132+0000","last_change":"2024-09-21T03:21:13.287132+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.287132+0000","last_undegraded":"2024-09-21T03:21:13.287132+0000","last_fullsized":"2024-09-21T03:21:13.287132+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.289759+0000","last_change":"2024-09-21T03:21:13.289759+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.289759+0000","last_undegraded":"2024-09-21T03:21:13.289759+0000","last_fullsized":"2024-09-21T03:21:13.289759+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.289253+0000","last_change":"2024-09-21T03:21:13.289253+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.289253+0000","last_undegraded":"2024-09-21T03:21:13.289253+0000","last_fullsized":"2024-09-21T03:21:13.289253+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.291517+0000","last_change":"2024-09-21T03:21:13.291517+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.291517+0000","last_undegraded":"2024-09-21T03:21:13.291517+0000","last_fullsized":"2024-09-21T03:21:13.291517+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.291546+0000","last_change":"2024-09-21T03:21:13.291546+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.291546+0000","last_undegraded":"2024-09-21T03:21:13.291546+0000","last_fullsized":"2024-09-21T03:21:13.291546+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.289789+0000","last_change":"2024-09-21T03:21:13.289789+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.289789+0000","last_undegraded":"2024-09-21T03:21:13.289789+0000","last_fullsized":"2024-09-21T03:21:13.289789+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.322785+0000","last_change":"2024-09-21T03:21:15.320020+0000","last_active":"2024-09-21T03:21:15.322785+0000","last_peered":"2024-09-21T03:21:15.322785+0000","last_clean":"2024-09-21T03:21:15.322785+0000","last_became_active":"2024-09-21T03:21:15.319702+0000","last_became_peered":"2024-09-21T03:21:15.319702+0000","last_unstale":"2024-09-21T03:21:15.322785+0000","last_undegraded":"2024-09-21T03:21:15.322785+0000","last_fullsized":"2024-09-21T03:21:15.322785+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:28.854474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.292833+0000","last_change":"2024-09-21T03:21:13.292833+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.292833+0000","last_undegraded":"2024-09-21T03:21:13.292833+0000","last_fullsized":"2024-09-21T03:21:13.292833+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.287111+0000","last_change":"2024-09-21T03:21:13.287111+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.287111+0000","last_undegraded":"2024-09-21T03:21:13.287111+0000","last_fullsized":"2024-09-21T03:21:13.287111+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.289323+0000","last_change":"2024-09-21T03:21:13.289323+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.289323+0000","last_undegraded":"2024-09-21T03:21:13.289323+0000","last_fullsized":"2024-09-21T03:21:13.289323+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.287071+0000","last_change":"2024-09-21T03:21:13.287071+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.287071+0000","last_undegraded":"2024-09-21T03:21:13.287071+0000","last_fullsized":"2024-09-21T03:21:13.287071+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.289681+0000","last_change":"2024-09-21T03:21:13.289681+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.289681+0000","last_undegraded":"2024-09-21T03:21:13.289681+0000","last_fullsized":"2024-09-21T03:21:13.289681+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.288944+0000","last_change":"2024-09-21T03:21:13.288944+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.288944+0000","last_undegraded":"2024-09-21T03:21:13.288944+0000","last_fullsized":"2024-09-21T03:21:13.288944+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.288605+0000","last_change":"2024-09-21T03:21:13.288605+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.288605+0000","last_undegraded":"2024-09-21T03:21:13.288605+0000","last_fullsized":"2024-09-21T03:21:13.288605+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.292029+0000","last_change":"2024-09-21T03:21:13.292029+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.292029+0000","last_undegraded":"2024-09-21T03:21:13.292029+0000","last_fullsized":"2024-09-21T03:21:13.292029+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.303159+0000","last_change":"2024-09-21T03:21:14.310881+0000","last_active":"2024-09-21T03:21:15.303159+0000","last_peered":"2024-09-21T03:21:15.303159+0000","last_clean":"2024-09-21T03:21:15.303159+0000","last_became_active":"2024-09-21T03:21:14.309420+0000","last_became_peered":"2024-09-21T03:21:14.309420+0000","last_unstale":"2024-09-21T03:21:15.303159+0000","last_undegraded":"2024-09-21T03:21:15.303159+0000","last_fullsized":"2024-09-21T03:21:15.303159+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:31.033897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.315502+0000","last_change":"2024-09-21T03:21:15.314776+0000","last_active":"2024-09-21T03:21:15.315502+0000","last_peered":"2024-09-21T03:21:15.315502+0000","last_clean":"2024-09-21T03:21:15.315502+0000","last_became_active":"2024-09-21T03:21:15.314469+0000","last_became_peered":"2024-09-21T03:21:15.314469+0000","last_unstale":"2024-09-21T03:21:15.315502+0000","last_undegraded":"2024-09-21T03:21:15.315502+0000","last_fullsized":"2024-09-21T03:21:15.315502+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:02:54.407198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.288034+0000","last_change":"2024-09-21T03:21:13.288034+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.288034+0000","last_undegraded":"2024-09-21T03:21:13.288034+0000","last_fullsized":"2024-09-21T03:21:13.288034+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.292041+0000","last_change":"2024-09-21T03:21:13.292041+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.292041+0000","last_undegraded":"2024-09-21T03:21:13.292041+0000","last_fullsized":"2024-09-21T03:21:13.292041+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.293448+0000","last_change":"2024-09-21T03:21:13.293448+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.293448+0000","last_undegraded":"2024-09-21T03:21:13.293448+0000","last_fullsized":"2024-09-21T03:21:13.293448+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.301724+0000","last_change":"2024-09-21T03:21:14.306171+0000","last_active":"2024-09-21T03:21:15.301724+0000","last_peered":"2024-09-21T03:21:15.301724+0000","last_clean":"2024-09-21T03:21:15.301724+0000","last_became_active":"2024-09-21T03:21:14.305871+0000","last_became_peered":"2024-09-21T03:21:14.305871+0000","last_unstale":"2024-09-21T03:21:15.301724+0000","last_undegraded":"2024-09-21T03:21:15.301724+0000","last_fullsized":"2024-09-21T03:21:15.301724+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:48.590153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.292925+0000","last_change":"2024-09-21T03:21:13.292925+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.292925+0000","last_undegraded":"2024-09-21T03:21:13.292925+0000","last_fullsized":"2024-09-21T03:21:13.292925+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.291872+0000","last_change":"2024-09-21T03:21:13.291872+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.291872+0000","last_undegraded":"2024-09-21T03:21:13.291872+0000","last_fullsized":"2024-09-21T03:21:13.291872+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.287262+0000","last_change":"2024-09-21T03:21:13.287262+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.287262+0000","last_undegraded":"2024-09-21T03:21:13.287262+0000","last_fullsized":"2024-09-21T03:21:13.287262+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.288820+0000","last_change":"2024-09-21T03:21:13.288820+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.288820+0000","last_undegraded":"2024-09-21T03:21:13.288820+0000","last_fullsized":"2024-09-21T03:21:13.288820+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.288432+0000","last_change":"2024-09-21T03:21:13.288432+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.288432+0000","last_undegraded":"2024-09-21T03:21:13.288432+0000","last_fullsized":"2024-09-21T03:21:13.288432+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":191,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-21T03:21:13.286190+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:21:13.286190+0000","last_peered":"2024-09-21T03:21:13.286190+0000","last_clean":"2024-09-21T03:21:13.286190+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:21:13.286190+0000","last_undegraded":"2024-09-21T03:21:13.286190+0000","last_fullsized":"2024-09-21T03:21:13.286190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":1},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509480,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28384,"kb_used_data":1356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343456,"statfs":{"total":96636764160,"available":96607698944,"internally_reserved":0,"allocated":1388544,"data_stored":915659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":794624,"data_stored":325291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509478,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":794624,"data_stored":325291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509478,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":782336,"data_stored":319474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":782336,"data_stored":319474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":782336,"data_stored":319474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509479,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":794624,"data_stored":325291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1413120,"data_stored":928709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:21:18.674 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:21:18.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.821+0000 7f69df84d640 1 -- 172.21.15.105:0/1798772120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69d806e0a0 msgr2=0x7f69d80b97e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:18.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.821+0000 7f69df84d640 1 --2- 172.21.15.105:0/1798772120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69d806e0a0 0x7f69d80b97e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f69d40098e0 tx=0x7f69d402a400 comp rx=0 tx=0).stop 2024-09-21T03:21:18.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.821+0000 7f69df84d640 1 -- 172.21.15.105:0/1798772120 shutdown_connections 2024-09-21T03:21:18.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.821+0000 7f69df84d640 1 --2- 172.21.15.105:0/1798772120 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69d80d0e50 0x7f69d80d1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:18.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.821+0000 7f69df84d640 1 --2- 172.21.15.105:0/1798772120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69d806e0a0 0x7f69d80b97e0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:18.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.821+0000 7f69df84d640 1 -- 172.21.15.105:0/1798772120 >> 172.21.15.105:0/1798772120 conn(0x7f69d809d840 msgr2=0x7f69d808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:18.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.821+0000 7f69df84d640 1 -- 172.21.15.105:0/1798772120 shutdown_connections 2024-09-21T03:21:18.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.821+0000 7f69df84d640 1 -- 172.21.15.105:0/1798772120 wait complete. 2024-09-21T03:21:18.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.823+0000 7f69df84d640 1 Processor -- start 2024-09-21T03:21:18.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.823+0000 7f69df84d640 1 -- start start 2024-09-21T03:21:18.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.824+0000 7f69df84d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69d806e0a0 0x7f69d815bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:18.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.824+0000 7f69df84d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69d806f6e0 0x7f69d81f96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:18.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.824+0000 7f69df84d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69d80d0e50 0x7f69d81f9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:18.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.824+0000 7f69df84d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f69d80cfea0 con 0x7f69d806e0a0 2024-09-21T03:21:18.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.824+0000 7f69df84d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f69d80cfd20 con 0x7f69d80d0e50 2024-09-21T03:21:18.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.824+0000 7f69df84d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f69d80d0020 con 0x7f69d806f6e0 2024-09-21T03:21:18.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.825+0000 7f69dd5e9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69d806e0a0 0x7f69d815bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:18.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.825+0000 7f69dd5e9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69d806e0a0 0x7f69d815bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:47642/0 (socket says 172.21.15.105:47642) 2024-09-21T03:21:18.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.825+0000 7f69dd5e9640 1 -- 172.21.15.105:0/3815718378 learned_addr learned my addr 172.21.15.105:0/3815718378 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:18.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.825+0000 7f69dcde8640 1 --2- 172.21.15.105:0/3815718378 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69d806f6e0 0x7f69d81f96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:18.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.825+0000 7f69dddea640 1 --2- 172.21.15.105:0/3815718378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69d80d0e50 0x7f69d81f9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:18.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.825+0000 7f69dd5e9640 1 -- 172.21.15.105:0/3815718378 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69d806f6e0 msgr2=0x7f69d81f96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:18.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.825+0000 7f69dd5e9640 1 --2- 172.21.15.105:0/3815718378 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69d806f6e0 0x7f69d81f96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:18.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.825+0000 7f69dd5e9640 1 -- 172.21.15.105:0/3815718378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69d80d0e50 msgr2=0x7f69d81f9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:18.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.825+0000 7f69dd5e9640 1 --2- 172.21.15.105:0/3815718378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69d80d0e50 0x7f69d81f9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:18.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.825+0000 7f69dd5e9640 1 -- 172.21.15.105:0/3815718378 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69d80a1c90 con 0x7f69d806e0a0 2024-09-21T03:21:18.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.825+0000 7f69dddea640 1 --2- 172.21.15.105:0/3815718378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69d80d0e50 0x7f69d81f9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:21:18.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.825+0000 7f69dd5e9640 1 --2- 172.21.15.105:0/3815718378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69d806e0a0 0x7f69d815bfe0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f69d4009a00 tx=0x7f69d40052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:18.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.825+0000 7f69cdffb640 1 -- 172.21.15.105:0/3815718378 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d403f070 con 0x7f69d806e0a0 2024-09-21T03:21:18.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.825+0000 7f69cdffb640 1 -- 172.21.15.105:0/3815718378 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69d4004340 con 0x7f69d806e0a0 2024-09-21T03:21:18.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.825+0000 7f69cdffb640 1 -- 172.21.15.105:0/3815718378 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d4005cf0 con 0x7f69d806e0a0 2024-09-21T03:21:18.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.825+0000 7f69df84d640 1 -- 172.21.15.105:0/3815718378 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69d81fa3b0 con 0x7f69d806e0a0 2024-09-21T03:21:18.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.825+0000 7f69df84d640 1 -- 172.21.15.105:0/3815718378 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69d80a1f30 con 0x7f69d806e0a0 2024-09-21T03:21:18.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.826+0000 7f69df84d640 1 -- 172.21.15.105:0/3815718378 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69d80d04b0 con 0x7f69d806e0a0 2024-09-21T03:21:18.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.827+0000 7f69cdffb640 1 -- 172.21.15.105:0/3815718378 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f69d4042070 con 0x7f69d806e0a0 2024-09-21T03:21:18.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.827+0000 7f69cdffb640 1 --2- 172.21.15.105:0/3815718378 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f69bc078b90 0x7f69bc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:18.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.828+0000 7f69cdffb640 1 -- 172.21.15.105:0/3815718378 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f69d40bbc40 con 0x7f69d806e0a0 2024-09-21T03:21:18.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.828+0000 7f69dcde8640 1 --2- 172.21.15.105:0/3815718378 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f69bc078b90 0x7f69bc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:18.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.828+0000 7f69dcde8640 1 --2- 172.21.15.105:0/3815718378 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f69bc078b90 0x7f69bc07b0a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f69c8006fd0 tx=0x7f69c8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:18.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:18.832+0000 7f69cdffb640 1 -- 172.21.15.105:0/3815718378 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f69d4031770 con 0x7f69d806e0a0 2024-09-21T03:21:19.008 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.006+0000 7f69df84d640 1 -- 172.21.15.105:0/3815718378 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f69d8069a50 con 0x7f69bc078b90 2024-09-21T03:21:19.012 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.011+0000 7f69cdffb640 1 -- 172.21.15.105:0/3815718378 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241333 (secure 0 0 0) 0x7f69d8069a50 con 0x7f69bc078b90 2024-09-21T03:21:19.015 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:19.016 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:21:19.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.014+0000 7f69df84d640 1 -- 172.21.15.105:0/3815718378 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f69bc078b90 msgr2=0x7f69bc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:19.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.014+0000 7f69df84d640 1 --2- 172.21.15.105:0/3815718378 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f69bc078b90 0x7f69bc07b0a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f69c8006fd0 tx=0x7f69c8008040 comp rx=0 tx=0).stop 2024-09-21T03:21:19.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.014+0000 7f69df84d640 1 -- 172.21.15.105:0/3815718378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69d806e0a0 msgr2=0x7f69d815bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:19.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.014+0000 7f69df84d640 1 --2- 172.21.15.105:0/3815718378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69d806e0a0 0x7f69d815bfe0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f69d4009a00 tx=0x7f69d40052f0 comp rx=0 tx=0).stop 2024-09-21T03:21:19.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.014+0000 7f69df84d640 1 -- 172.21.15.105:0/3815718378 shutdown_connections 2024-09-21T03:21:19.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.014+0000 7f69df84d640 1 --2- 172.21.15.105:0/3815718378 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f69bc078b90 0x7f69bc07b0a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:19.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.014+0000 7f69df84d640 1 --2- 172.21.15.105:0/3815718378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69d80d0e50 0x7f69d81f9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:19.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.015+0000 7f69df84d640 1 --2- 172.21.15.105:0/3815718378 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69d806f6e0 0x7f69d81f96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:19.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.015+0000 7f69df84d640 1 --2- 172.21.15.105:0/3815718378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69d806e0a0 0x7f69d815bfe0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:19.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.015+0000 7f69df84d640 1 -- 172.21.15.105:0/3815718378 >> 172.21.15.105:0/3815718378 conn(0x7f69d809d840 msgr2=0x7f69d80b9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:19.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.015+0000 7f69df84d640 1 -- 172.21.15.105:0/3815718378 shutdown_connections 2024-09-21T03:21:19.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.015+0000 7f69df84d640 1 -- 172.21.15.105:0/3815718378 wait complete. 2024-09-21T03:21:19.027 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2024-09-21T03:21:17.321896+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":78,"acting":78,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236080,"kb_used_data":7356,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754738640,"statfs":{"total":773094113280,"available":772852367360,"internally_reserved":0,"allocated":7532544,"data_stored":3778663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.036321"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.322799+0000","last_change":"2024-09-21T03:21:15.320132+0000","last_active":"2024-09-21T03:21:15.322799+0000","last_peered":"2024-09-21T03:21:15.322799+0000","last_clean":"2024-09-21T03:21:15.322799+0000","last_became_active":"2024-09-21T03:21:15.319814+0000","last_became_peered":"2024-09-21T03:21:15.319814+0000","last_unstale":"2024-09-21T03:21:15.322799+0000","last_undegraded":"2024-09-21T03:21:15.322799+0000","last_fullsized":"2024-09-21T03:21:15.322799+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:52.724426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.321464+0000","last_change":"2024-09-21T03:21:15.319096+0000","last_active":"2024-09-21T03:21:15.321464+0000","last_peered":"2024-09-21T03:21:15.321464+0000","last_clean":"2024-09-21T03:21:15.321464+0000","last_became_active":"2024-09-21T03:21:15.318769+0000","last_became_peered":"2024-09-21T03:21:15.318769+0000","last_unstale":"2024-09-21T03:21:15.321464+0000","last_undegraded":"2024-09-21T03:21:15.321464+0000","last_fullsized":"2024-09-21T03:21:15.321464+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:26.465077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.314579+0000","last_change":"2024-09-21T03:21:15.313301+0000","last_active":"2024-09-21T03:21:15.314579+0000","last_peered":"2024-09-21T03:21:15.314579+0000","last_clean":"2024-09-21T03:21:15.314579+0000","last_became_active":"2024-09-21T03:21:15.313019+0000","last_became_peered":"2024-09-21T03:21:15.313019+0000","last_unstale":"2024-09-21T03:21:15.314579+0000","last_undegraded":"2024-09-21T03:21:15.314579+0000","last_fullsized":"2024-09-21T03:21:15.314579+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:58.046608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.289153+0000","last_change":"2024-09-21T03:21:13.289153+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.289153+0000","last_undegraded":"2024-09-21T03:21:13.289153+0000","last_fullsized":"2024-09-21T03:21:13.289153+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"68'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.322118+0000","last_change":"2024-09-21T03:21:14.308412+0000","last_active":"2024-09-21T03:21:15.322118+0000","last_peered":"2024-09-21T03:21:15.322118+0000","last_clean":"2024-09-21T03:21:15.322118+0000","last_became_active":"2024-09-21T03:21:14.308143+0000","last_became_peered":"2024-09-21T03:21:14.308143+0000","last_unstale":"2024-09-21T03:21:15.322118+0000","last_undegraded":"2024-09-21T03:21:15.322118+0000","last_fullsized":"2024-09-21T03:21:15.322118+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:35:45.932535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.287103+0000","last_change":"2024-09-21T03:21:13.287103+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.287103+0000","last_undegraded":"2024-09-21T03:21:13.287103+0000","last_fullsized":"2024-09-21T03:21:13.287103+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.288678+0000","last_change":"2024-09-21T03:21:13.288678+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.288678+0000","last_undegraded":"2024-09-21T03:21:13.288678+0000","last_fullsized":"2024-09-21T03:21:13.288678+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.289248+0000","last_change":"2024-09-21T03:21:13.289248+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.289248+0000","last_undegraded":"2024-09-21T03:21:13.289248+0000","last_fullsized":"2024-09-21T03:21:13.289248+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.290484+0000","last_change":"2024-09-21T03:21:13.290484+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.290484+0000","last_undegraded":"2024-09-21T03:21:13.290484+0000","last_fullsized":"2024-09-21T03:21:13.290484+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.291496+0000","last_change":"2024-09-21T03:21:13.291496+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.291496+0000","last_undegraded":"2024-09-21T03:21:13.291496+0000","last_fullsized":"2024-09-21T03:21:13.291496+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.314596+0000","last_change":"2024-09-21T03:21:15.312519+0000","last_active":"2024-09-21T03:21:15.314596+0000","last_peered":"2024-09-21T03:21:15.314596+0000","last_clean":"2024-09-21T03:21:15.314596+0000","last_became_active":"2024-09-21T03:21:15.312186+0000","last_became_peered":"2024-09-21T03:21:15.312186+0000","last_unstale":"2024-09-21T03:21:15.314596+0000","last_undegraded":"2024-09-21T03:21:15.314596+0000","last_fullsized":"2024-09-21T03:21:15.314596+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:48:45.076339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.293082+0000","last_change":"2024-09-21T03:21:13.293082+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.293082+0000","last_undegraded":"2024-09-21T03:21:13.293082+0000","last_fullsized":"2024-09-21T03:21:13.293082+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.287132+0000","last_change":"2024-09-21T03:21:13.287132+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.287132+0000","last_undegraded":"2024-09-21T03:21:13.287132+0000","last_fullsized":"2024-09-21T03:21:13.287132+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.289759+0000","last_change":"2024-09-21T03:21:13.289759+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.289759+0000","last_undegraded":"2024-09-21T03:21:13.289759+0000","last_fullsized":"2024-09-21T03:21:13.289759+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.289253+0000","last_change":"2024-09-21T03:21:13.289253+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.289253+0000","last_undegraded":"2024-09-21T03:21:13.289253+0000","last_fullsized":"2024-09-21T03:21:13.289253+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.291517+0000","last_change":"2024-09-21T03:21:13.291517+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.291517+0000","last_undegraded":"2024-09-21T03:21:13.291517+0000","last_fullsized":"2024-09-21T03:21:13.291517+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.291546+0000","last_change":"2024-09-21T03:21:13.291546+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.291546+0000","last_undegraded":"2024-09-21T03:21:13.291546+0000","last_fullsized":"2024-09-21T03:21:13.291546+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.289789+0000","last_change":"2024-09-21T03:21:13.289789+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.289789+0000","last_undegraded":"2024-09-21T03:21:13.289789+0000","last_fullsized":"2024-09-21T03:21:13.289789+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.322785+0000","last_change":"2024-09-21T03:21:15.320020+0000","last_active":"2024-09-21T03:21:15.322785+0000","last_peered":"2024-09-21T03:21:15.322785+0000","last_clean":"2024-09-21T03:21:15.322785+0000","last_became_active":"2024-09-21T03:21:15.319702+0000","last_became_peered":"2024-09-21T03:21:15.319702+0000","last_unstale":"2024-09-21T03:21:15.322785+0000","last_undegraded":"2024-09-21T03:21:15.322785+0000","last_fullsized":"2024-09-21T03:21:15.322785+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:28.854474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.292833+0000","last_change":"2024-09-21T03:21:13.292833+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.292833+0000","last_undegraded":"2024-09-21T03:21:13.292833+0000","last_fullsized":"2024-09-21T03:21:13.292833+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.287111+0000","last_change":"2024-09-21T03:21:13.287111+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.287111+0000","last_undegraded":"2024-09-21T03:21:13.287111+0000","last_fullsized":"2024-09-21T03:21:13.287111+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.289323+0000","last_change":"2024-09-21T03:21:13.289323+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.289323+0000","last_undegraded":"2024-09-21T03:21:13.289323+0000","last_fullsized":"2024-09-21T03:21:13.289323+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.287071+0000","last_change":"2024-09-21T03:21:13.287071+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.287071+0000","last_undegraded":"2024-09-21T03:21:13.287071+0000","last_fullsized":"2024-09-21T03:21:13.287071+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.289681+0000","last_change":"2024-09-21T03:21:13.289681+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.289681+0000","last_undegraded":"2024-09-21T03:21:13.289681+0000","last_fullsized":"2024-09-21T03:21:13.289681+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.288944+0000","last_change":"2024-09-21T03:21:13.288944+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.288944+0000","last_undegraded":"2024-09-21T03:21:13.288944+0000","last_fullsized":"2024-09-21T03:21:13.288944+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.288605+0000","last_change":"2024-09-21T03:21:13.288605+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.288605+0000","last_undegraded":"2024-09-21T03:21:13.288605+0000","last_fullsized":"2024-09-21T03:21:13.288605+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.292029+0000","last_change":"2024-09-21T03:21:13.292029+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.292029+0000","last_undegraded":"2024-09-21T03:21:13.292029+0000","last_fullsized":"2024-09-21T03:21:13.292029+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.303159+0000","last_change":"2024-09-21T03:21:14.310881+0000","last_active":"2024-09-21T03:21:15.303159+0000","last_peered":"2024-09-21T03:21:15.303159+0000","last_clean":"2024-09-21T03:21:15.303159+0000","last_became_active":"2024-09-21T03:21:14.309420+0000","last_became_peered":"2024-09-21T03:21:14.309420+0000","last_unstale":"2024-09-21T03:21:15.303159+0000","last_undegraded":"2024-09-21T03:21:15.303159+0000","last_fullsized":"2024-09-21T03:21:15.303159+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:31.033897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.315502+0000","last_change":"2024-09-21T03:21:15.314776+0000","last_active":"2024-09-21T03:21:15.315502+0000","last_peered":"2024-09-21T03:21:15.315502+0000","last_clean":"2024-09-21T03:21:15.315502+0000","last_became_active":"2024-09-21T03:21:15.314469+0000","last_became_peered":"2024-09-21T03:21:15.314469+0000","last_unstale":"2024-09-21T03:21:15.315502+0000","last_undegraded":"2024-09-21T03:21:15.315502+0000","last_fullsized":"2024-09-21T03:21:15.315502+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:02:54.407198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.288034+0000","last_change":"2024-09-21T03:21:13.288034+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.288034+0000","last_undegraded":"2024-09-21T03:21:13.288034+0000","last_fullsized":"2024-09-21T03:21:13.288034+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.292041+0000","last_change":"2024-09-21T03:21:13.292041+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.292041+0000","last_undegraded":"2024-09-21T03:21:13.292041+0000","last_fullsized":"2024-09-21T03:21:13.292041+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.293448+0000","last_change":"2024-09-21T03:21:13.293448+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.293448+0000","last_undegraded":"2024-09-21T03:21:13.293448+0000","last_fullsized":"2024-09-21T03:21:13.293448+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.301724+0000","last_change":"2024-09-21T03:21:14.306171+0000","last_active":"2024-09-21T03:21:15.301724+0000","last_peered":"2024-09-21T03:21:15.301724+0000","last_clean":"2024-09-21T03:21:15.301724+0000","last_became_active":"2024-09-21T03:21:14.305871+0000","last_became_peered":"2024-09-21T03:21:14.305871+0000","last_unstale":"2024-09-21T03:21:15.301724+0000","last_undegraded":"2024-09-21T03:21:15.301724+0000","last_fullsized":"2024-09-21T03:21:15.301724+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:48.590153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.292925+0000","last_change":"2024-09-21T03:21:13.292925+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.292925+0000","last_undegraded":"2024-09-21T03:21:13.292925+0000","last_fullsized":"2024-09-21T03:21:13.292925+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.291872+0000","last_change":"2024-09-21T03:21:13.291872+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.291872+0000","last_undegraded":"2024-09-21T03:21:13.291872+0000","last_fullsized":"2024-09-21T03:21:13.291872+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.287262+0000","last_change":"2024-09-21T03:21:13.287262+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.287262+0000","last_undegraded":"2024-09-21T03:21:13.287262+0000","last_fullsized":"2024-09-21T03:21:13.287262+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.288820+0000","last_change":"2024-09-21T03:21:13.288820+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.288820+0000","last_undegraded":"2024-09-21T03:21:13.288820+0000","last_fullsized":"2024-09-21T03:21:13.288820+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:21:14.283562+0000","last_change":"2024-09-21T03:21:14.283562+0000","last_active":"2024-09-21T03:21:14.283562+0000","last_peered":"2024-09-21T03:21:14.283562+0000","last_clean":"2024-09-21T03:21:14.283562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:14.283562+0000","last_undegraded":"2024-09-21T03:21:14.283562+0000","last_fullsized":"2024-09-21T03:21:14.283562+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-21T03:21:13.288432+0000","last_change":"2024-09-21T03:21:13.288432+0000","last_active":"2024-09-21T03:21:13.281266+0000","last_peered":"2024-09-21T03:21:13.281266+0000","last_clean":"2024-09-21T03:21:13.281266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:13.288432+0000","last_undegraded":"2024-09-21T03:21:13.288432+0000","last_fullsized":"2024-09-21T03:21:13.288432+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":191,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-21T03:21:13.286190+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:21:13.286190+0000","last_peered":"2024-09-21T03:21:13.286190+0000","last_clean":"2024-09-21T03:21:13.286190+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:21:13.286190+0000","last_undegraded":"2024-09-21T03:21:13.286190+0000","last_fullsized":"2024-09-21T03:21:13.286190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":1},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509480,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28384,"kb_used_data":1356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343456,"statfs":{"total":96636764160,"available":96607698944,"internally_reserved":0,"allocated":1388544,"data_stored":915659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":794624,"data_stored":325291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509478,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":794624,"data_stored":325291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509478,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":782336,"data_stored":319474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":782336,"data_stored":319474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":782336,"data_stored":319474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509479,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":794624,"data_stored":325291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1413120,"data_stored":928709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:21:19.068 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3f is not active+clean 2024-09-21T03:21:19.068 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.068 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3e is not active+clean 2024-09-21T03:21:19.068 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.068 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3d is not active+clean 2024-09-21T03:21:19.068 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.069 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3c is not active+clean 2024-09-21T03:21:19.069 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.069 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3b is not active+clean 2024-09-21T03:21:19.069 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.069 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3a is not active+clean 2024-09-21T03:21:19.069 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.069 INFO:tasks.ceph.ceph_manager.ceph:PG 11.39 is not active+clean 2024-09-21T03:21:19.069 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.069 INFO:tasks.ceph.ceph_manager.ceph:PG 11.38 is not active+clean 2024-09-21T03:21:19.069 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.069 INFO:tasks.ceph.ceph_manager.ceph:PG 11.37 is not active+clean 2024-09-21T03:21:19.070 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.070 INFO:tasks.ceph.ceph_manager.ceph:PG 11.36 is not active+clean 2024-09-21T03:21:19.070 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.070 INFO:tasks.ceph.ceph_manager.ceph:PG 11.35 is not active+clean 2024-09-21T03:21:19.070 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.070 INFO:tasks.ceph.ceph_manager.ceph:PG 11.34 is not active+clean 2024-09-21T03:21:19.070 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.070 INFO:tasks.ceph.ceph_manager.ceph:PG 11.32 is not active+clean 2024-09-21T03:21:19.070 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.071 INFO:tasks.ceph.ceph_manager.ceph:PG 11.30 is not active+clean 2024-09-21T03:21:19.071 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.071 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2f is not active+clean 2024-09-21T03:21:19.071 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.071 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2e is not active+clean 2024-09-21T03:21:19.071 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.071 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2d is not active+clean 2024-09-21T03:21:19.071 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.071 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2b is not active+clean 2024-09-21T03:21:19.071 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.072 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2a is not active+clean 2024-09-21T03:21:19.072 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.072 INFO:tasks.ceph.ceph_manager.ceph:PG 11.29 is not active+clean 2024-09-21T03:21:19.072 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.072 INFO:tasks.ceph.ceph_manager.ceph:PG 11.28 is not active+clean 2024-09-21T03:21:19.072 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.072 INFO:tasks.ceph.ceph_manager.ceph:PG 11.27 is not active+clean 2024-09-21T03:21:19.072 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.072 INFO:tasks.ceph.ceph_manager.ceph:PG 11.26 is not active+clean 2024-09-21T03:21:19.072 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.072 INFO:tasks.ceph.ceph_manager.ceph:PG 11.25 is not active+clean 2024-09-21T03:21:19.073 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.073 INFO:tasks.ceph.ceph_manager.ceph:PG 11.24 is not active+clean 2024-09-21T03:21:19.073 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.073 INFO:tasks.ceph.ceph_manager.ceph:PG 11.23 is not active+clean 2024-09-21T03:21:19.073 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.073 INFO:tasks.ceph.ceph_manager.ceph:PG 11.22 is not active+clean 2024-09-21T03:21:19.073 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.073 INFO:tasks.ceph.ceph_manager.ceph:PG 11.21 is not active+clean 2024-09-21T03:21:19.073 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.073 INFO:tasks.ceph.ceph_manager.ceph:PG 11.20 is not active+clean 2024-09-21T03:21:19.073 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.074 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1e is not active+clean 2024-09-21T03:21:19.074 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.074 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1f is not active+clean 2024-09-21T03:21:19.074 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:21:13.289153+0000', 'last_change': '2024-09-21T03:21:13.289153+0000', 'last_active': '2024-09-21T03:21:13.281266+0000', 'last_peered': '2024-09-21T03:21:13.281266+0000', 'last_clean': '2024-09-21T03:21:13.281266+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:13.289153+0000', 'last_undegraded': '2024-09-21T03:21:13.289153+0000', 'last_fullsized': '2024-09-21T03:21:13.289153+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T03:21:19.074 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1f is not active+clean 2024-09-21T03:21:19.074 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.074 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1c is not active+clean 2024-09-21T03:21:19.074 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.074 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1d is not active+clean 2024-09-21T03:21:19.074 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:21:13.287103+0000', 'last_change': '2024-09-21T03:21:13.287103+0000', 'last_active': '2024-09-21T03:21:13.281266+0000', 'last_peered': '2024-09-21T03:21:13.281266+0000', 'last_clean': '2024-09-21T03:21:13.281266+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:13.287103+0000', 'last_undegraded': '2024-09-21T03:21:13.287103+0000', 'last_fullsized': '2024-09-21T03:21:13.287103+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T03:21:19.074 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1d is not active+clean 2024-09-21T03:21:19.075 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.075 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1c is not active+clean 2024-09-21T03:21:19.075 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:21:13.288678+0000', 'last_change': '2024-09-21T03:21:13.288678+0000', 'last_active': '2024-09-21T03:21:13.281266+0000', 'last_peered': '2024-09-21T03:21:13.281266+0000', 'last_clean': '2024-09-21T03:21:13.281266+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:13.288678+0000', 'last_undegraded': '2024-09-21T03:21:13.288678+0000', 'last_fullsized': '2024-09-21T03:21:13.288678+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T03:21:19.075 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1a is not active+clean 2024-09-21T03:21:19.075 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.075 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1b is not active+clean 2024-09-21T03:21:19.075 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:21:13.289248+0000', 'last_change': '2024-09-21T03:21:13.289248+0000', 'last_active': '2024-09-21T03:21:13.281266+0000', 'last_peered': '2024-09-21T03:21:13.281266+0000', 'last_clean': '2024-09-21T03:21:13.281266+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:13.289248+0000', 'last_undegraded': '2024-09-21T03:21:13.289248+0000', 'last_fullsized': '2024-09-21T03:21:13.289248+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T03:21:19.075 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1b is not active+clean 2024-09-21T03:21:19.075 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.075 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1a is not active+clean 2024-09-21T03:21:19.075 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:21:13.290484+0000', 'last_change': '2024-09-21T03:21:13.290484+0000', 'last_active': '2024-09-21T03:21:13.281266+0000', 'last_peered': '2024-09-21T03:21:13.281266+0000', 'last_clean': '2024-09-21T03:21:13.281266+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:13.290484+0000', 'last_undegraded': '2024-09-21T03:21:13.290484+0000', 'last_fullsized': '2024-09-21T03:21:13.290484+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T03:21:19.075 INFO:tasks.ceph.ceph_manager.ceph:PG 11.18 is not active+clean 2024-09-21T03:21:19.076 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.076 INFO:tasks.ceph.ceph_manager.ceph:PG 10.19 is not active+clean 2024-09-21T03:21:19.076 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:21:13.291496+0000', 'last_change': '2024-09-21T03:21:13.291496+0000', 'last_active': '2024-09-21T03:21:13.281266+0000', 'last_peered': '2024-09-21T03:21:13.281266+0000', 'last_clean': '2024-09-21T03:21:13.281266+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:13.291496+0000', 'last_undegraded': '2024-09-21T03:21:13.291496+0000', 'last_fullsized': '2024-09-21T03:21:13.291496+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T03:21:19.076 INFO:tasks.ceph.ceph_manager.ceph:PG 10.18 is not active+clean 2024-09-21T03:21:19.076 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:21:13.293082+0000', 'last_change': '2024-09-21T03:21:13.293082+0000', 'last_active': '2024-09-21T03:21:13.281266+0000', 'last_peered': '2024-09-21T03:21:13.281266+0000', 'last_clean': '2024-09-21T03:21:13.281266+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:13.293082+0000', 'last_undegraded': '2024-09-21T03:21:13.293082+0000', 'last_fullsized': '2024-09-21T03:21:13.293082+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T03:21:19.076 INFO:tasks.ceph.ceph_manager.ceph:PG 11.16 is not active+clean 2024-09-21T03:21:19.076 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.076 INFO:tasks.ceph.ceph_manager.ceph:PG 10.17 is not active+clean 2024-09-21T03:21:19.076 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:21:13.287132+0000', 'last_change': '2024-09-21T03:21:13.287132+0000', 'last_active': '2024-09-21T03:21:13.281266+0000', 'last_peered': '2024-09-21T03:21:13.281266+0000', 'last_clean': '2024-09-21T03:21:13.281266+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:13.287132+0000', 'last_undegraded': '2024-09-21T03:21:13.287132+0000', 'last_fullsized': '2024-09-21T03:21:13.287132+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T03:21:19.076 INFO:tasks.ceph.ceph_manager.ceph:PG 11.17 is not active+clean 2024-09-21T03:21:19.076 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.077 INFO:tasks.ceph.ceph_manager.ceph:PG 10.16 is not active+clean 2024-09-21T03:21:19.077 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:21:13.289759+0000', 'last_change': '2024-09-21T03:21:13.289759+0000', 'last_active': '2024-09-21T03:21:13.281266+0000', 'last_peered': '2024-09-21T03:21:13.281266+0000', 'last_clean': '2024-09-21T03:21:13.281266+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:13.289759+0000', 'last_undegraded': '2024-09-21T03:21:13.289759+0000', 'last_fullsized': '2024-09-21T03:21:13.289759+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T03:21:19.077 INFO:tasks.ceph.ceph_manager.ceph:PG 11.14 is not active+clean 2024-09-21T03:21:19.077 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.077 INFO:tasks.ceph.ceph_manager.ceph:PG 10.15 is not active+clean 2024-09-21T03:21:19.077 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:21:13.289253+0000', 'last_change': '2024-09-21T03:21:13.289253+0000', 'last_active': '2024-09-21T03:21:13.281266+0000', 'last_peered': '2024-09-21T03:21:13.281266+0000', 'last_clean': '2024-09-21T03:21:13.281266+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:13.289253+0000', 'last_undegraded': '2024-09-21T03:21:13.289253+0000', 'last_fullsized': '2024-09-21T03:21:13.289253+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T03:21:19.077 INFO:tasks.ceph.ceph_manager.ceph:PG 11.15 is not active+clean 2024-09-21T03:21:19.077 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.077 INFO:tasks.ceph.ceph_manager.ceph:PG 10.14 is not active+clean 2024-09-21T03:21:19.077 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:21:13.291517+0000', 'last_change': '2024-09-21T03:21:13.291517+0000', 'last_active': '2024-09-21T03:21:13.281266+0000', 'last_peered': '2024-09-21T03:21:13.281266+0000', 'last_clean': '2024-09-21T03:21:13.281266+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:13.291517+0000', 'last_undegraded': '2024-09-21T03:21:13.291517+0000', 'last_fullsized': '2024-09-21T03:21:13.291517+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T03:21:19.077 INFO:tasks.ceph.ceph_manager.ceph:PG 11.12 is not active+clean 2024-09-21T03:21:19.077 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.078 INFO:tasks.ceph.ceph_manager.ceph:PG 10.13 is not active+clean 2024-09-21T03:21:19.078 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:21:13.291546+0000', 'last_change': '2024-09-21T03:21:13.291546+0000', 'last_active': '2024-09-21T03:21:13.281266+0000', 'last_peered': '2024-09-21T03:21:13.281266+0000', 'last_clean': '2024-09-21T03:21:13.281266+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:13.291546+0000', 'last_undegraded': '2024-09-21T03:21:13.291546+0000', 'last_fullsized': '2024-09-21T03:21:13.291546+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T03:21:19.078 INFO:tasks.ceph.ceph_manager.ceph:PG 11.13 is not active+clean 2024-09-21T03:21:19.078 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.078 INFO:tasks.ceph.ceph_manager.ceph:PG 10.12 is not active+clean 2024-09-21T03:21:19.078 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:21:13.289789+0000', 'last_change': '2024-09-21T03:21:13.289789+0000', 'last_active': '2024-09-21T03:21:13.281266+0000', 'last_peered': '2024-09-21T03:21:13.281266+0000', 'last_clean': '2024-09-21T03:21:13.281266+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:13.289789+0000', 'last_undegraded': '2024-09-21T03:21:13.289789+0000', 'last_fullsized': '2024-09-21T03:21:13.289789+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T03:21:19.078 INFO:tasks.ceph.ceph_manager.ceph:PG 10.11 is not active+clean 2024-09-21T03:21:19.078 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:21:13.292833+0000', 'last_change': '2024-09-21T03:21:13.292833+0000', 'last_active': '2024-09-21T03:21:13.281266+0000', 'last_peered': '2024-09-21T03:21:13.281266+0000', 'last_clean': '2024-09-21T03:21:13.281266+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:13.292833+0000', 'last_undegraded': '2024-09-21T03:21:13.292833+0000', 'last_fullsized': '2024-09-21T03:21:13.292833+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T03:21:19.078 INFO:tasks.ceph.ceph_manager.ceph:PG 11.11 is not active+clean 2024-09-21T03:21:19.078 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.078 INFO:tasks.ceph.ceph_manager.ceph:PG 10.10 is not active+clean 2024-09-21T03:21:19.079 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:21:13.287111+0000', 'last_change': '2024-09-21T03:21:13.287111+0000', 'last_active': '2024-09-21T03:21:13.281266+0000', 'last_peered': '2024-09-21T03:21:13.281266+0000', 'last_clean': '2024-09-21T03:21:13.281266+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:13.287111+0000', 'last_undegraded': '2024-09-21T03:21:13.287111+0000', 'last_fullsized': '2024-09-21T03:21:13.287111+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T03:21:19.079 INFO:tasks.ceph.ceph_manager.ceph:PG 11.e is not active+clean 2024-09-21T03:21:19.079 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.079 INFO:tasks.ceph.ceph_manager.ceph:PG 10.f is not active+clean 2024-09-21T03:21:19.079 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:21:13.289323+0000', 'last_change': '2024-09-21T03:21:13.289323+0000', 'last_active': '2024-09-21T03:21:13.281266+0000', 'last_peered': '2024-09-21T03:21:13.281266+0000', 'last_clean': '2024-09-21T03:21:13.281266+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:13.289323+0000', 'last_undegraded': '2024-09-21T03:21:13.289323+0000', 'last_fullsized': '2024-09-21T03:21:13.289323+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T03:21:19.079 INFO:tasks.ceph.ceph_manager.ceph:PG 11.f is not active+clean 2024-09-21T03:21:19.079 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.079 INFO:tasks.ceph.ceph_manager.ceph:PG 10.e is not active+clean 2024-09-21T03:21:19.079 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:21:13.287071+0000', 'last_change': '2024-09-21T03:21:13.287071+0000', 'last_active': '2024-09-21T03:21:13.281266+0000', 'last_peered': '2024-09-21T03:21:13.281266+0000', 'last_clean': '2024-09-21T03:21:13.281266+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:13.287071+0000', 'last_undegraded': '2024-09-21T03:21:13.287071+0000', 'last_fullsized': '2024-09-21T03:21:13.287071+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T03:21:19.079 INFO:tasks.ceph.ceph_manager.ceph:PG 11.c is not active+clean 2024-09-21T03:21:19.079 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.080 INFO:tasks.ceph.ceph_manager.ceph:PG 10.d is not active+clean 2024-09-21T03:21:19.080 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:21:13.289681+0000', 'last_change': '2024-09-21T03:21:13.289681+0000', 'last_active': '2024-09-21T03:21:13.281266+0000', 'last_peered': '2024-09-21T03:21:13.281266+0000', 'last_clean': '2024-09-21T03:21:13.281266+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:13.289681+0000', 'last_undegraded': '2024-09-21T03:21:13.289681+0000', 'last_fullsized': '2024-09-21T03:21:13.289681+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T03:21:19.080 INFO:tasks.ceph.ceph_manager.ceph:PG 11.d is not active+clean 2024-09-21T03:21:19.080 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.080 INFO:tasks.ceph.ceph_manager.ceph:PG 10.c is not active+clean 2024-09-21T03:21:19.080 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:21:13.288944+0000', 'last_change': '2024-09-21T03:21:13.288944+0000', 'last_active': '2024-09-21T03:21:13.281266+0000', 'last_peered': '2024-09-21T03:21:13.281266+0000', 'last_clean': '2024-09-21T03:21:13.281266+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:13.288944+0000', 'last_undegraded': '2024-09-21T03:21:13.288944+0000', 'last_fullsized': '2024-09-21T03:21:13.288944+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T03:21:19.080 INFO:tasks.ceph.ceph_manager.ceph:PG 11.b is not active+clean 2024-09-21T03:21:19.080 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.080 INFO:tasks.ceph.ceph_manager.ceph:PG 10.a is not active+clean 2024-09-21T03:21:19.080 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:21:13.288605+0000', 'last_change': '2024-09-21T03:21:13.288605+0000', 'last_active': '2024-09-21T03:21:13.281266+0000', 'last_peered': '2024-09-21T03:21:13.281266+0000', 'last_clean': '2024-09-21T03:21:13.281266+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:13.288605+0000', 'last_undegraded': '2024-09-21T03:21:13.288605+0000', 'last_fullsized': '2024-09-21T03:21:13.288605+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T03:21:19.081 INFO:tasks.ceph.ceph_manager.ceph:PG 11.8 is not active+clean 2024-09-21T03:21:19.081 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.081 INFO:tasks.ceph.ceph_manager.ceph:PG 10.9 is not active+clean 2024-09-21T03:21:19.081 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:21:13.292029+0000', 'last_change': '2024-09-21T03:21:13.292029+0000', 'last_active': '2024-09-21T03:21:13.281266+0000', 'last_peered': '2024-09-21T03:21:13.281266+0000', 'last_clean': '2024-09-21T03:21:13.281266+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:13.292029+0000', 'last_undegraded': '2024-09-21T03:21:13.292029+0000', 'last_fullsized': '2024-09-21T03:21:13.292029+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T03:21:19.081 INFO:tasks.ceph.ceph_manager.ceph:PG 11.9 is not active+clean 2024-09-21T03:21:19.081 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.081 INFO:tasks.ceph.ceph_manager.ceph:PG 10.7 is not active+clean 2024-09-21T03:21:19.081 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:21:13.288034+0000', 'last_change': '2024-09-21T03:21:13.288034+0000', 'last_active': '2024-09-21T03:21:13.281266+0000', 'last_peered': '2024-09-21T03:21:13.281266+0000', 'last_clean': '2024-09-21T03:21:13.281266+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:13.288034+0000', 'last_undegraded': '2024-09-21T03:21:13.288034+0000', 'last_fullsized': '2024-09-21T03:21:13.288034+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T03:21:19.081 INFO:tasks.ceph.ceph_manager.ceph:PG 11.7 is not active+clean 2024-09-21T03:21:19.081 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.082 INFO:tasks.ceph.ceph_manager.ceph:PG 10.6 is not active+clean 2024-09-21T03:21:19.082 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:21:13.292041+0000', 'last_change': '2024-09-21T03:21:13.292041+0000', 'last_active': '2024-09-21T03:21:13.281266+0000', 'last_peered': '2024-09-21T03:21:13.281266+0000', 'last_clean': '2024-09-21T03:21:13.281266+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:13.292041+0000', 'last_undegraded': '2024-09-21T03:21:13.292041+0000', 'last_fullsized': '2024-09-21T03:21:13.292041+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T03:21:19.082 INFO:tasks.ceph.ceph_manager.ceph:PG 11.4 is not active+clean 2024-09-21T03:21:19.082 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.082 INFO:tasks.ceph.ceph_manager.ceph:PG 10.5 is not active+clean 2024-09-21T03:21:19.082 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:21:13.293448+0000', 'last_change': '2024-09-21T03:21:13.293448+0000', 'last_active': '2024-09-21T03:21:13.281266+0000', 'last_peered': '2024-09-21T03:21:13.281266+0000', 'last_clean': '2024-09-21T03:21:13.281266+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:13.293448+0000', 'last_undegraded': '2024-09-21T03:21:13.293448+0000', 'last_fullsized': '2024-09-21T03:21:13.293448+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T03:21:19.082 INFO:tasks.ceph.ceph_manager.ceph:PG 11.5 is not active+clean 2024-09-21T03:21:19.082 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.083 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2 is not active+clean 2024-09-21T03:21:19.083 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.083 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3 is not active+clean 2024-09-21T03:21:19.083 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:21:13.292925+0000', 'last_change': '2024-09-21T03:21:13.292925+0000', 'last_active': '2024-09-21T03:21:13.281266+0000', 'last_peered': '2024-09-21T03:21:13.281266+0000', 'last_clean': '2024-09-21T03:21:13.281266+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:13.292925+0000', 'last_undegraded': '2024-09-21T03:21:13.292925+0000', 'last_fullsized': '2024-09-21T03:21:13.292925+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T03:21:19.083 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3 is not active+clean 2024-09-21T03:21:19.083 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.083 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2 is not active+clean 2024-09-21T03:21:19.083 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:21:13.291872+0000', 'last_change': '2024-09-21T03:21:13.291872+0000', 'last_active': '2024-09-21T03:21:13.281266+0000', 'last_peered': '2024-09-21T03:21:13.281266+0000', 'last_clean': '2024-09-21T03:21:13.281266+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:13.291872+0000', 'last_undegraded': '2024-09-21T03:21:13.291872+0000', 'last_fullsized': '2024-09-21T03:21:13.291872+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T03:21:19.084 INFO:tasks.ceph.ceph_manager.ceph:PG 11.0 is not active+clean 2024-09-21T03:21:19.084 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.084 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1 is not active+clean 2024-09-21T03:21:19.084 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:21:13.287262+0000', 'last_change': '2024-09-21T03:21:13.287262+0000', 'last_active': '2024-09-21T03:21:13.281266+0000', 'last_peered': '2024-09-21T03:21:13.281266+0000', 'last_clean': '2024-09-21T03:21:13.281266+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:13.287262+0000', 'last_undegraded': '2024-09-21T03:21:13.287262+0000', 'last_fullsized': '2024-09-21T03:21:13.287262+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T03:21:19.085 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1 is not active+clean 2024-09-21T03:21:19.085 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.085 INFO:tasks.ceph.ceph_manager.ceph:PG 10.0 is not active+clean 2024-09-21T03:21:19.086 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:21:13.288820+0000', 'last_change': '2024-09-21T03:21:13.288820+0000', 'last_active': '2024-09-21T03:21:13.281266+0000', 'last_peered': '2024-09-21T03:21:13.281266+0000', 'last_clean': '2024-09-21T03:21:13.281266+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:13.288820+0000', 'last_undegraded': '2024-09-21T03:21:13.288820+0000', 'last_fullsized': '2024-09-21T03:21:13.288820+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T03:21:19.086 INFO:tasks.ceph.ceph_manager.ceph:PG 11.a is not active+clean 2024-09-21T03:21:19.086 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:21:14.283562+0000', 'last_change': '2024-09-21T03:21:14.283562+0000', 'last_active': '2024-09-21T03:21:14.283562+0000', 'last_peered': '2024-09-21T03:21:14.283562+0000', 'last_clean': '2024-09-21T03:21:14.283562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:14.283562+0000', 'last_undegraded': '2024-09-21T03:21:14.283562+0000', 'last_fullsized': '2024-09-21T03:21:14.283562+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:14.283562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:21:19.087 INFO:tasks.ceph.ceph_manager.ceph:PG 10.b is not active+clean 2024-09-21T03:21:19.087 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:21:13.288432+0000', 'last_change': '2024-09-21T03:21:13.288432+0000', 'last_active': '2024-09-21T03:21:13.281266+0000', 'last_peered': '2024-09-21T03:21:13.281266+0000', 'last_clean': '2024-09-21T03:21:13.281266+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:13.288432+0000', 'last_undegraded': '2024-09-21T03:21:13.288432+0000', 'last_fullsized': '2024-09-21T03:21:13.288432+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:13.281266+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T03:21:19.088 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T03:21:19.199 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.197+0000 7feac1c30640 1 -- 172.21.15.105:0/2932833902 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feaa4005250 msgr2=0x7feaa400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:19.199 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.197+0000 7feac1c30640 1 --2- 172.21.15.105:0/2932833902 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feaa4005250 0x7feaa400b9c0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7feabc15d020 tx=0x7feaa4005830 comp rx=0 tx=0).stop 2024-09-21T03:21:19.199 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.197+0000 7feac1c30640 1 -- 172.21.15.105:0/2932833902 shutdown_connections 2024-09-21T03:21:19.199 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.197+0000 7feac1c30640 1 --2- 172.21.15.105:0/2932833902 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feaa4005250 0x7feaa400b9c0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:19.199 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.197+0000 7feac1c30640 1 -- 172.21.15.105:0/2932833902 >> 172.21.15.105:0/2932833902 conn(0x7feabc06d550 msgr2=0x7feabc071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:19.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.197+0000 7feac1c30640 1 -- 172.21.15.105:0/2932833902 shutdown_connections 2024-09-21T03:21:19.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.197+0000 7feac1c30640 1 -- 172.21.15.105:0/2932833902 wait complete. 2024-09-21T03:21:19.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.199+0000 7feac1c30640 1 Processor -- start 2024-09-21T03:21:19.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.199+0000 7feac1c30640 1 -- start start 2024-09-21T03:21:19.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.201+0000 7feac1c30640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feaa4005250 0x7feabc15bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:19.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.201+0000 7feac1c30640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feabc15c110 0x7feabc0c7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:19.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.201+0000 7feac1c30640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feabc0c78b0 0x7feabc153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:19.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.201+0000 7feac1c30640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7feabc0d22b0 con 0x7feabc0c78b0 2024-09-21T03:21:19.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.201+0000 7feac1c30640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feabc0d2130 con 0x7feabc15c110 2024-09-21T03:21:19.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.201+0000 7feac1c30640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7feabc15d130 con 0x7feaa4005250 2024-09-21T03:21:19.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.201+0000 7feabbfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feabc0c78b0 0x7feabc153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:19.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.201+0000 7feabbfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feabc0c78b0 0x7feabc153310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:47662/0 (socket says 172.21.15.105:47662) 2024-09-21T03:21:19.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.201+0000 7feabbfff640 1 -- 172.21.15.105:0/2525417693 learned_addr learned my addr 172.21.15.105:0/2525417693 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:19.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.201+0000 7feabb7fe640 1 --2- 172.21.15.105:0/2525417693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feaa4005250 0x7feabc15bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:19.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.201+0000 7feabaffd640 1 --2- 172.21.15.105:0/2525417693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feabc15c110 0x7feabc0c7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:19.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.201+0000 7feabbfff640 1 -- 172.21.15.105:0/2525417693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feaa4005250 msgr2=0x7feabc15bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:19.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.201+0000 7feabbfff640 1 --2- 172.21.15.105:0/2525417693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feaa4005250 0x7feabc15bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:19.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.201+0000 7feabbfff640 1 -- 172.21.15.105:0/2525417693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feabc15c110 msgr2=0x7feabc0c7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:19.205 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.201+0000 7feabbfff640 1 --2- 172.21.15.105:0/2525417693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feabc15c110 0x7feabc0c7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:19.205 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.201+0000 7feabbfff640 1 -- 172.21.15.105:0/2525417693 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feabc1fa6f0 con 0x7feabc0c78b0 2024-09-21T03:21:19.205 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.201+0000 7feabbfff640 1 --2- 172.21.15.105:0/2525417693 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feabc0c78b0 0x7feabc153310 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7feab4000f60 tx=0x7feab4001340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:19.205 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.201+0000 7feaa3fff640 1 -- 172.21.15.105:0/2525417693 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab4039070 con 0x7feabc0c78b0 2024-09-21T03:21:19.205 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.201+0000 7feaa3fff640 1 -- 172.21.15.105:0/2525417693 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feab40035f0 con 0x7feabc0c78b0 2024-09-21T03:21:19.205 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.201+0000 7feac1c30640 1 -- 172.21.15.105:0/2525417693 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feabc1f9930 con 0x7feabc0c78b0 2024-09-21T03:21:19.205 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.201+0000 7feaa3fff640 1 -- 172.21.15.105:0/2525417693 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab4003a00 con 0x7feabc0c78b0 2024-09-21T03:21:19.205 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.202+0000 7feac1c30640 1 -- 172.21.15.105:0/2525417693 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feabc1f9ef0 con 0x7feabc0c78b0 2024-09-21T03:21:19.206 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.202+0000 7feac1c30640 1 -- 172.21.15.105:0/2525417693 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feabc0b67a0 con 0x7feabc0c78b0 2024-09-21T03:21:19.206 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.204+0000 7feaa3fff640 1 -- 172.21.15.105:0/2525417693 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feab4003ba0 con 0x7feabc0c78b0 2024-09-21T03:21:19.206 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.204+0000 7feaa3fff640 1 --2- 172.21.15.105:0/2525417693 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7feaa8078b90 0x7feaa807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:19.206 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.204+0000 7feaa3fff640 1 -- 172.21.15.105:0/2525417693 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7feab40bafc0 con 0x7feabc0c78b0 2024-09-21T03:21:19.206 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.204+0000 7feabb7fe640 1 --2- 172.21.15.105:0/2525417693 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7feaa8078b90 0x7feaa807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:19.206 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.205+0000 7feabb7fe640 1 --2- 172.21.15.105:0/2525417693 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7feaa8078b90 0x7feaa807b0a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7feaac005fd0 tx=0x7feaac009500 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:19.210 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.208+0000 7feaa3fff640 1 -- 172.21.15.105:0/2525417693 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7feabc0b67a0 con 0x7feabc0c78b0 2024-09-21T03:21:19.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.452+0000 7feac1c30640 1 -- 172.21.15.105:0/2525417693 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7feabc0c7ea0 con 0x7feabc0c78b0 2024-09-21T03:21:19.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.452+0000 7feaa3fff640 1 -- 172.21.15.105:0/2525417693 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1571 (secure 0 0 0) 0x7feabc0d2870 con 0x7feabc0c78b0 2024-09-21T03:21:19.454 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:19.454 INFO:teuthology.orchestra.run.smithi105.stdout:{"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":194,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":69,"num_osds":8,"num_up_osds":8,"osd_up_since":1726888698,"num_in_osds":8,"osd_in_since":1726888688,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":58},{"state_name":"creating+peering","count":29},{"state_name":"active+clean","count":10}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":241745920,"bytes_avail":772852367360,"bytes_total":773094113280,"unknown_pgs_ratio":0.59793812036514282,"inactive_pgs_ratio":0.29896906018257141},"fsmap":{"epoch":38,"btime":"2024-09-21T03:21:17:305276+0000","id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"a","status":"up:active","gid":5940}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-09-21T03:21:03.318802+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T03:21:19.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.455+0000 7feac1c30640 1 -- 172.21.15.105:0/2525417693 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7feaa8078b90 msgr2=0x7feaa807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:19.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.455+0000 7feac1c30640 1 --2- 172.21.15.105:0/2525417693 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7feaa8078b90 0x7feaa807b0a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7feaac005fd0 tx=0x7feaac009500 comp rx=0 tx=0).stop 2024-09-21T03:21:19.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.455+0000 7feac1c30640 1 -- 172.21.15.105:0/2525417693 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feabc0c78b0 msgr2=0x7feabc153310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:19.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.455+0000 7feac1c30640 1 --2- 172.21.15.105:0/2525417693 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feabc0c78b0 0x7feabc153310 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7feab4000f60 tx=0x7feab4001340 comp rx=0 tx=0).stop 2024-09-21T03:21:19.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.455+0000 7feac1c30640 1 -- 172.21.15.105:0/2525417693 shutdown_connections 2024-09-21T03:21:19.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.455+0000 7feac1c30640 1 --2- 172.21.15.105:0/2525417693 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7feaa8078b90 0x7feaa807b0a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:19.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.455+0000 7feac1c30640 1 --2- 172.21.15.105:0/2525417693 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feabc0c78b0 0x7feabc153310 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:19.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.455+0000 7feac1c30640 1 --2- 172.21.15.105:0/2525417693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feabc15c110 0x7feabc0c7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:19.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.455+0000 7feac1c30640 1 --2- 172.21.15.105:0/2525417693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feaa4005250 0x7feabc15bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:19.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.455+0000 7feac1c30640 1 -- 172.21.15.105:0/2525417693 >> 172.21.15.105:0/2525417693 conn(0x7feabc06d550 msgr2=0x7feabc0b7d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:19.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.455+0000 7feac1c30640 1 -- 172.21.15.105:0/2525417693 shutdown_connections 2024-09-21T03:21:19.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.455+0000 7feac1c30640 1 -- 172.21.15.105:0/2525417693 wait complete. 2024-09-21T03:21:19.468 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-21T03:21:19.468 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:21:19.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.579+0000 7fb49d04d640 1 -- 172.21.15.105:0/3762337027 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb484004d40 msgr2=0x7fb4840051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:19.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.579+0000 7fb49d04d640 1 --2- 172.21.15.105:0/3762337027 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb484004d40 0x7fb4840051f0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb49000c610 tx=0x7fb484005830 comp rx=0 tx=0).stop 2024-09-21T03:21:19.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.579+0000 7fb49759e640 1 -- 172.21.15.105:0/3762337027 reap_dead start 2024-09-21T03:21:19.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.579+0000 7fb49d04d640 1 -- 172.21.15.105:0/3762337027 shutdown_connections 2024-09-21T03:21:19.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.579+0000 7fb49d04d640 1 -- 172.21.15.105:0/3762337027 >> 172.21.15.105:0/3762337027 conn(0x7fb49806d7d0 msgr2=0x7fb4980b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:19.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.579+0000 7fb49d04d640 1 -- 172.21.15.105:0/3762337027 shutdown_connections 2024-09-21T03:21:19.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.579+0000 7fb49d04d640 1 -- 172.21.15.105:0/3762337027 wait complete. 2024-09-21T03:21:19.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.581+0000 7fb49d04d640 1 Processor -- start 2024-09-21T03:21:19.583 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.582+0000 7fb49d04d640 1 -- start start 2024-09-21T03:21:19.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.583+0000 7fb49d04d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb484004d40 0x7fb498154da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:19.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.583+0000 7fb49d04d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb498153da0 0x7fb4981f21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:19.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.583+0000 7fb49d04d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb498149bd0 0x7fb498158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:19.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.583+0000 7fb49d04d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb4980b3b40 con 0x7fb498149bd0 2024-09-21T03:21:19.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.583+0000 7fb49d04d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb4980b39c0 con 0x7fb484004d40 2024-09-21T03:21:19.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.583+0000 7fb49d04d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb4980b3cc0 con 0x7fb498153da0 2024-09-21T03:21:19.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.583+0000 7fb49759e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb498149bd0 0x7fb498158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:19.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.583+0000 7fb49759e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb498149bd0 0x7fb498158bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:47680/0 (socket says 172.21.15.105:47680) 2024-09-21T03:21:19.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.583+0000 7fb49759e640 1 -- 172.21.15.105:0/2536134994 learned_addr learned my addr 172.21.15.105:0/2536134994 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:19.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.583+0000 7fb496d9d640 1 --2- 172.21.15.105:0/2536134994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb484004d40 0x7fb498154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:19.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.583+0000 7fb48e59c640 1 --2- 172.21.15.105:0/2536134994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb498153da0 0x7fb4981f21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:19.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.583+0000 7fb49759e640 1 -- 172.21.15.105:0/2536134994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb498153da0 msgr2=0x7fb4981f21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:19.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.583+0000 7fb49759e640 1 --2- 172.21.15.105:0/2536134994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb498153da0 0x7fb4981f21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:19.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.583+0000 7fb49759e640 1 -- 172.21.15.105:0/2536134994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb484004d40 msgr2=0x7fb498154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:19.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.583+0000 7fb49759e640 1 --2- 172.21.15.105:0/2536134994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb484004d40 0x7fb498154da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:19.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.583+0000 7fb49759e640 1 -- 172.21.15.105:0/2536134994 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4981f2b50 con 0x7fb498149bd0 2024-09-21T03:21:19.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.583+0000 7fb49759e640 1 --2- 172.21.15.105:0/2536134994 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb498149bd0 0x7fb498158bc0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fb49002b450 tx=0x7fb490001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:19.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.584+0000 7fb48ffff640 1 -- 172.21.15.105:0/2536134994 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb490039070 con 0x7fb498149bd0 2024-09-21T03:21:19.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.584+0000 7fb48ffff640 1 -- 172.21.15.105:0/2536134994 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb490006680 con 0x7fb498149bd0 2024-09-21T03:21:19.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.584+0000 7fb48ffff640 1 -- 172.21.15.105:0/2536134994 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb490001ff0 con 0x7fb498149bd0 2024-09-21T03:21:19.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.584+0000 7fb49d04d640 1 -- 172.21.15.105:0/2536134994 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4981f2e30 con 0x7fb498149bd0 2024-09-21T03:21:19.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.584+0000 7fb49d04d640 1 -- 172.21.15.105:0/2536134994 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4981583c0 con 0x7fb498149bd0 2024-09-21T03:21:19.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.585+0000 7fb49d04d640 1 -- 172.21.15.105:0/2536134994 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb498073400 con 0x7fb498149bd0 2024-09-21T03:21:19.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.585+0000 7fb48ffff640 1 -- 172.21.15.105:0/2536134994 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb49003c020 con 0x7fb498149bd0 2024-09-21T03:21:19.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.586+0000 7fb48ffff640 1 --2- 172.21.15.105:0/2536134994 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb478078b90 0x7fb47807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:19.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.586+0000 7fb48ffff640 1 -- 172.21.15.105:0/2536134994 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fb4900ba410 con 0x7fb498149bd0 2024-09-21T03:21:19.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.586+0000 7fb496d9d640 1 --2- 172.21.15.105:0/2536134994 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb478078b90 0x7fb47807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:19.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.587+0000 7fb496d9d640 1 --2- 172.21.15.105:0/2536134994 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb478078b90 0x7fb47807b0a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb488009c50 tx=0x7fb488005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:19.592 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.590+0000 7fb48ffff640 1 -- 172.21.15.105:0/2536134994 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb490045030 con 0x7fb498149bd0 2024-09-21T03:21:19.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.763+0000 7fb49d04d640 1 -- 172.21.15.105:0/2536134994 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb4981f28e0 con 0x7fb478078b90 2024-09-21T03:21:19.768 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.767+0000 7fb48ffff640 1 -- 172.21.15.105:0/2536134994 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252057 (secure 0 0 0) 0x7fb48805e8b0 con 0x7fb478078b90 2024-09-21T03:21:19.771 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:19.772 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:21:19.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.770+0000 7fb49d04d640 1 -- 172.21.15.105:0/2536134994 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb478078b90 msgr2=0x7fb47807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:19.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.770+0000 7fb49d04d640 1 --2- 172.21.15.105:0/2536134994 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb478078b90 0x7fb47807b0a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb488009c50 tx=0x7fb488005f90 comp rx=0 tx=0).stop 2024-09-21T03:21:19.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.770+0000 7fb49d04d640 1 -- 172.21.15.105:0/2536134994 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb498149bd0 msgr2=0x7fb498158bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:19.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.770+0000 7fb49d04d640 1 --2- 172.21.15.105:0/2536134994 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb498149bd0 0x7fb498158bc0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fb49002b450 tx=0x7fb490001aa0 comp rx=0 tx=0).stop 2024-09-21T03:21:19.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.770+0000 7fb49d04d640 1 -- 172.21.15.105:0/2536134994 shutdown_connections 2024-09-21T03:21:19.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.770+0000 7fb49d04d640 1 --2- 172.21.15.105:0/2536134994 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb478078b90 0x7fb47807b0a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:19.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.770+0000 7fb49d04d640 1 --2- 172.21.15.105:0/2536134994 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb498149bd0 0x7fb498158bc0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:19.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.770+0000 7fb49d04d640 1 --2- 172.21.15.105:0/2536134994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb498153da0 0x7fb4981f21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:19.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.770+0000 7fb49d04d640 1 --2- 172.21.15.105:0/2536134994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb484004d40 0x7fb498154da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:19.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.770+0000 7fb49d04d640 1 -- 172.21.15.105:0/2536134994 >> 172.21.15.105:0/2536134994 conn(0x7fb49806d7d0 msgr2=0x7fb4981602f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:19.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.770+0000 7fb49d04d640 1 -- 172.21.15.105:0/2536134994 shutdown_connections 2024-09-21T03:21:19.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:19.770+0000 7fb49d04d640 1 -- 172.21.15.105:0/2536134994 wait complete. 2024-09-21T03:21:19.783 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2024-09-21T03:21:19.322364+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236456,"kb_used_data":7708,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754738264,"statfs":{"total":773094113280,"available":772851982336,"internally_reserved":0,"allocated":7892992,"data_stored":3936384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001309"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.167180+0000","last_change":"2024-09-21T03:21:15.326657+0000","last_active":"2024-09-21T03:21:17.167180+0000","last_peered":"2024-09-21T03:21:17.167180+0000","last_clean":"2024-09-21T03:21:17.167180+0000","last_became_active":"2024-09-21T03:21:15.326350+0000","last_became_peered":"2024-09-21T03:21:15.326350+0000","last_unstale":"2024-09-21T03:21:17.167180+0000","last_undegraded":"2024-09-21T03:21:17.167180+0000","last_fullsized":"2024-09-21T03:21:17.167180+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:34:41.899074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.311359+0000","last_change":"2024-09-21T03:21:15.317545+0000","last_active":"2024-09-21T03:21:16.311359+0000","last_peered":"2024-09-21T03:21:16.311359+0000","last_clean":"2024-09-21T03:21:16.311359+0000","last_became_active":"2024-09-21T03:21:15.317237+0000","last_became_peered":"2024-09-21T03:21:15.317237+0000","last_unstale":"2024-09-21T03:21:16.311359+0000","last_undegraded":"2024-09-21T03:21:16.311359+0000","last_fullsized":"2024-09-21T03:21:16.311359+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:31:05.212420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.722358+0000","last_change":"2024-09-21T03:21:15.310752+0000","last_active":"2024-09-21T03:21:16.722358+0000","last_peered":"2024-09-21T03:21:16.722358+0000","last_clean":"2024-09-21T03:21:16.722358+0000","last_became_active":"2024-09-21T03:21:15.310408+0000","last_became_peered":"2024-09-21T03:21:15.310408+0000","last_unstale":"2024-09-21T03:21:16.722358+0000","last_undegraded":"2024-09-21T03:21:16.722358+0000","last_fullsized":"2024-09-21T03:21:16.722358+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:29.263335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.399941+0000","last_change":"2024-09-21T03:21:15.316510+0000","last_active":"2024-09-21T03:21:16.399941+0000","last_peered":"2024-09-21T03:21:16.399941+0000","last_clean":"2024-09-21T03:21:16.399941+0000","last_became_active":"2024-09-21T03:21:15.316202+0000","last_became_peered":"2024-09-21T03:21:15.316202+0000","last_unstale":"2024-09-21T03:21:16.399941+0000","last_undegraded":"2024-09-21T03:21:16.399941+0000","last_fullsized":"2024-09-21T03:21:16.399941+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:34.881568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.307390+0000","last_change":"2024-09-21T03:21:15.317816+0000","last_active":"2024-09-21T03:21:16.307390+0000","last_peered":"2024-09-21T03:21:16.307390+0000","last_clean":"2024-09-21T03:21:16.307390+0000","last_became_active":"2024-09-21T03:21:15.317513+0000","last_became_peered":"2024-09-21T03:21:15.317513+0000","last_unstale":"2024-09-21T03:21:16.307390+0000","last_undegraded":"2024-09-21T03:21:16.307390+0000","last_fullsized":"2024-09-21T03:21:16.307390+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:17.720643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.310303+0000","last_change":"2024-09-21T03:21:15.317111+0000","last_active":"2024-09-21T03:21:16.310303+0000","last_peered":"2024-09-21T03:21:16.310303+0000","last_clean":"2024-09-21T03:21:16.310303+0000","last_became_active":"2024-09-21T03:21:15.316815+0000","last_became_peered":"2024-09-21T03:21:15.316815+0000","last_unstale":"2024-09-21T03:21:16.310303+0000","last_undegraded":"2024-09-21T03:21:16.310303+0000","last_fullsized":"2024-09-21T03:21:16.310303+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:13.729423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.166105+0000","last_change":"2024-09-21T03:21:15.314973+0000","last_active":"2024-09-21T03:21:17.166105+0000","last_peered":"2024-09-21T03:21:17.166105+0000","last_clean":"2024-09-21T03:21:17.166105+0000","last_became_active":"2024-09-21T03:21:15.314629+0000","last_became_peered":"2024-09-21T03:21:15.314629+0000","last_unstale":"2024-09-21T03:21:17.166105+0000","last_undegraded":"2024-09-21T03:21:17.166105+0000","last_fullsized":"2024-09-21T03:21:17.166105+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:39.195872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.309951+0000","last_change":"2024-09-21T03:21:15.323786+0000","last_active":"2024-09-21T03:21:16.309951+0000","last_peered":"2024-09-21T03:21:16.309951+0000","last_clean":"2024-09-21T03:21:16.309951+0000","last_became_active":"2024-09-21T03:21:15.321831+0000","last_became_peered":"2024-09-21T03:21:15.321831+0000","last_unstale":"2024-09-21T03:21:16.309951+0000","last_undegraded":"2024-09-21T03:21:16.309951+0000","last_fullsized":"2024-09-21T03:21:16.309951+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:30.299107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.307814+0000","last_change":"2024-09-21T03:21:15.316599+0000","last_active":"2024-09-21T03:21:16.307814+0000","last_peered":"2024-09-21T03:21:16.307814+0000","last_clean":"2024-09-21T03:21:16.307814+0000","last_became_active":"2024-09-21T03:21:15.315972+0000","last_became_peered":"2024-09-21T03:21:15.315972+0000","last_unstale":"2024-09-21T03:21:16.307814+0000","last_undegraded":"2024-09-21T03:21:16.307814+0000","last_fullsized":"2024-09-21T03:21:16.307814+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:32.479277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.308879+0000","last_change":"2024-09-21T03:21:15.318299+0000","last_active":"2024-09-21T03:21:16.308879+0000","last_peered":"2024-09-21T03:21:16.308879+0000","last_clean":"2024-09-21T03:21:16.308879+0000","last_became_active":"2024-09-21T03:21:15.317954+0000","last_became_peered":"2024-09-21T03:21:15.317954+0000","last_unstale":"2024-09-21T03:21:16.308879+0000","last_undegraded":"2024-09-21T03:21:16.308879+0000","last_fullsized":"2024-09-21T03:21:16.308879+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:31:05.212420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.166726+0000","last_change":"2024-09-21T03:21:15.311522+0000","last_active":"2024-09-21T03:21:17.166726+0000","last_peered":"2024-09-21T03:21:17.166726+0000","last_clean":"2024-09-21T03:21:17.166726+0000","last_became_active":"2024-09-21T03:21:15.311172+0000","last_became_peered":"2024-09-21T03:21:15.311172+0000","last_unstale":"2024-09-21T03:21:17.166726+0000","last_undegraded":"2024-09-21T03:21:17.166726+0000","last_fullsized":"2024-09-21T03:21:17.166726+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:21.597725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.400147+0000","last_change":"2024-09-21T03:21:15.321391+0000","last_active":"2024-09-21T03:21:16.400147+0000","last_peered":"2024-09-21T03:21:16.400147+0000","last_clean":"2024-09-21T03:21:16.400147+0000","last_became_active":"2024-09-21T03:21:15.320862+0000","last_became_peered":"2024-09-21T03:21:15.320862+0000","last_unstale":"2024-09-21T03:21:16.400147+0000","last_undegraded":"2024-09-21T03:21:16.400147+0000","last_fullsized":"2024-09-21T03:21:16.400147+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:44:08.217596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.322799+0000","last_change":"2024-09-21T03:21:15.320132+0000","last_active":"2024-09-21T03:21:15.322799+0000","last_peered":"2024-09-21T03:21:15.322799+0000","last_clean":"2024-09-21T03:21:15.322799+0000","last_became_active":"2024-09-21T03:21:15.319814+0000","last_became_peered":"2024-09-21T03:21:15.319814+0000","last_unstale":"2024-09-21T03:21:15.322799+0000","last_undegraded":"2024-09-21T03:21:15.322799+0000","last_fullsized":"2024-09-21T03:21:15.322799+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:52.724426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.307396+0000","last_change":"2024-09-21T03:21:15.319061+0000","last_active":"2024-09-21T03:21:16.307396+0000","last_peered":"2024-09-21T03:21:16.307396+0000","last_clean":"2024-09-21T03:21:16.307396+0000","last_became_active":"2024-09-21T03:21:15.318760+0000","last_became_peered":"2024-09-21T03:21:15.318760+0000","last_unstale":"2024-09-21T03:21:16.307396+0000","last_undegraded":"2024-09-21T03:21:16.307396+0000","last_fullsized":"2024-09-21T03:21:16.307396+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:47.370478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.321464+0000","last_change":"2024-09-21T03:21:15.319096+0000","last_active":"2024-09-21T03:21:15.321464+0000","last_peered":"2024-09-21T03:21:15.321464+0000","last_clean":"2024-09-21T03:21:15.321464+0000","last_became_active":"2024-09-21T03:21:15.318769+0000","last_became_peered":"2024-09-21T03:21:15.318769+0000","last_unstale":"2024-09-21T03:21:15.321464+0000","last_undegraded":"2024-09-21T03:21:15.321464+0000","last_fullsized":"2024-09-21T03:21:15.321464+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:26.465077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.308434+0000","last_change":"2024-09-21T03:21:15.317737+0000","last_active":"2024-09-21T03:21:16.308434+0000","last_peered":"2024-09-21T03:21:16.308434+0000","last_clean":"2024-09-21T03:21:16.308434+0000","last_became_active":"2024-09-21T03:21:15.317432+0000","last_became_peered":"2024-09-21T03:21:15.317432+0000","last_unstale":"2024-09-21T03:21:16.308434+0000","last_undegraded":"2024-09-21T03:21:16.308434+0000","last_fullsized":"2024-09-21T03:21:16.308434+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:37.268371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.307930+0000","last_change":"2024-09-21T03:21:15.316261+0000","last_active":"2024-09-21T03:21:16.307930+0000","last_peered":"2024-09-21T03:21:16.307930+0000","last_clean":"2024-09-21T03:21:16.307930+0000","last_became_active":"2024-09-21T03:21:15.313366+0000","last_became_peered":"2024-09-21T03:21:15.313366+0000","last_unstale":"2024-09-21T03:21:16.307930+0000","last_undegraded":"2024-09-21T03:21:16.307930+0000","last_fullsized":"2024-09-21T03:21:16.307930+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:26.578050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.400049+0000","last_change":"2024-09-21T03:21:15.316970+0000","last_active":"2024-09-21T03:21:16.400049+0000","last_peered":"2024-09-21T03:21:16.400049+0000","last_clean":"2024-09-21T03:21:16.400049+0000","last_became_active":"2024-09-21T03:21:15.316648+0000","last_became_peered":"2024-09-21T03:21:15.316648+0000","last_unstale":"2024-09-21T03:21:16.400049+0000","last_undegraded":"2024-09-21T03:21:16.400049+0000","last_fullsized":"2024-09-21T03:21:16.400049+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:42.570834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.311168+0000","last_change":"2024-09-21T03:21:15.321513+0000","last_active":"2024-09-21T03:21:16.311168+0000","last_peered":"2024-09-21T03:21:16.311168+0000","last_clean":"2024-09-21T03:21:16.311168+0000","last_became_active":"2024-09-21T03:21:15.320624+0000","last_became_peered":"2024-09-21T03:21:15.320624+0000","last_unstale":"2024-09-21T03:21:16.311168+0000","last_undegraded":"2024-09-21T03:21:16.311168+0000","last_fullsized":"2024-09-21T03:21:16.311168+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:45:16.792863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.314579+0000","last_change":"2024-09-21T03:21:15.313301+0000","last_active":"2024-09-21T03:21:15.314579+0000","last_peered":"2024-09-21T03:21:15.314579+0000","last_clean":"2024-09-21T03:21:15.314579+0000","last_became_active":"2024-09-21T03:21:15.313019+0000","last_became_peered":"2024-09-21T03:21:15.313019+0000","last_unstale":"2024-09-21T03:21:15.314579+0000","last_undegraded":"2024-09-21T03:21:15.314579+0000","last_fullsized":"2024-09-21T03:21:15.314579+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:58.046608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.308777+0000","last_change":"2024-09-21T03:21:15.316205+0000","last_active":"2024-09-21T03:21:16.308777+0000","last_peered":"2024-09-21T03:21:16.308777+0000","last_clean":"2024-09-21T03:21:16.308777+0000","last_became_active":"2024-09-21T03:21:15.314888+0000","last_became_peered":"2024-09-21T03:21:15.314888+0000","last_unstale":"2024-09-21T03:21:16.308777+0000","last_undegraded":"2024-09-21T03:21:16.308777+0000","last_fullsized":"2024-09-21T03:21:16.308777+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:45:16.792863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.309355+0000","last_change":"2024-09-21T03:21:15.316306+0000","last_active":"2024-09-21T03:21:16.309355+0000","last_peered":"2024-09-21T03:21:16.309355+0000","last_clean":"2024-09-21T03:21:16.309355+0000","last_became_active":"2024-09-21T03:21:15.316017+0000","last_became_peered":"2024-09-21T03:21:15.316017+0000","last_unstale":"2024-09-21T03:21:16.309355+0000","last_undegraded":"2024-09-21T03:21:16.309355+0000","last_fullsized":"2024-09-21T03:21:16.309355+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:35.852014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.166775+0000","last_change":"2024-09-21T03:21:15.312578+0000","last_active":"2024-09-21T03:21:17.166775+0000","last_peered":"2024-09-21T03:21:17.166775+0000","last_clean":"2024-09-21T03:21:17.166775+0000","last_became_active":"2024-09-21T03:21:15.312233+0000","last_became_peered":"2024-09-21T03:21:15.312233+0000","last_unstale":"2024-09-21T03:21:17.166775+0000","last_undegraded":"2024-09-21T03:21:17.166775+0000","last_fullsized":"2024-09-21T03:21:17.166775+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:28.768786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.166212+0000","last_change":"2024-09-21T03:21:15.319775+0000","last_active":"2024-09-21T03:21:17.166212+0000","last_peered":"2024-09-21T03:21:17.166212+0000","last_clean":"2024-09-21T03:21:17.166212+0000","last_became_active":"2024-09-21T03:21:15.319454+0000","last_became_peered":"2024-09-21T03:21:15.319454+0000","last_unstale":"2024-09-21T03:21:17.166212+0000","last_undegraded":"2024-09-21T03:21:17.166212+0000","last_fullsized":"2024-09-21T03:21:17.166212+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:35:25.304218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.309477+0000","last_change":"2024-09-21T03:21:15.313986+0000","last_active":"2024-09-21T03:21:16.309477+0000","last_peered":"2024-09-21T03:21:16.309477+0000","last_clean":"2024-09-21T03:21:16.309477+0000","last_became_active":"2024-09-21T03:21:15.313657+0000","last_became_peered":"2024-09-21T03:21:15.313657+0000","last_unstale":"2024-09-21T03:21:16.309477+0000","last_undegraded":"2024-09-21T03:21:16.309477+0000","last_fullsized":"2024-09-21T03:21:16.309477+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:30.205604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.167283+0000","last_change":"2024-09-21T03:21:15.323585+0000","last_active":"2024-09-21T03:21:17.167283+0000","last_peered":"2024-09-21T03:21:17.167283+0000","last_clean":"2024-09-21T03:21:17.167283+0000","last_became_active":"2024-09-21T03:21:15.323262+0000","last_became_peered":"2024-09-21T03:21:15.323262+0000","last_unstale":"2024-09-21T03:21:17.167283+0000","last_undegraded":"2024-09-21T03:21:17.167283+0000","last_fullsized":"2024-09-21T03:21:17.167283+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:40.550567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.722364+0000","last_change":"2024-09-21T03:21:15.309600+0000","last_active":"2024-09-21T03:21:16.722364+0000","last_peered":"2024-09-21T03:21:16.722364+0000","last_clean":"2024-09-21T03:21:16.722364+0000","last_became_active":"2024-09-21T03:21:15.309280+0000","last_became_peered":"2024-09-21T03:21:15.309280+0000","last_unstale":"2024-09-21T03:21:16.722364+0000","last_undegraded":"2024-09-21T03:21:16.722364+0000","last_fullsized":"2024-09-21T03:21:16.722364+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:01.470848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.309150+0000","last_change":"2024-09-21T03:21:15.315449+0000","last_active":"2024-09-21T03:21:16.309150+0000","last_peered":"2024-09-21T03:21:16.309150+0000","last_clean":"2024-09-21T03:21:16.309150+0000","last_became_active":"2024-09-21T03:21:15.315121+0000","last_became_peered":"2024-09-21T03:21:15.315121+0000","last_unstale":"2024-09-21T03:21:16.309150+0000","last_undegraded":"2024-09-21T03:21:16.309150+0000","last_fullsized":"2024-09-21T03:21:16.309150+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:55.270254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.722376+0000","last_change":"2024-09-21T03:21:15.314781+0000","last_active":"2024-09-21T03:21:16.722376+0000","last_peered":"2024-09-21T03:21:16.722376+0000","last_clean":"2024-09-21T03:21:16.722376+0000","last_became_active":"2024-09-21T03:21:15.314222+0000","last_became_peered":"2024-09-21T03:21:15.314222+0000","last_unstale":"2024-09-21T03:21:16.722376+0000","last_undegraded":"2024-09-21T03:21:16.722376+0000","last_fullsized":"2024-09-21T03:21:16.722376+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:40.283991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.166565+0000","last_change":"2024-09-21T03:21:15.322395+0000","last_active":"2024-09-21T03:21:17.166565+0000","last_peered":"2024-09-21T03:21:17.166565+0000","last_clean":"2024-09-21T03:21:17.166565+0000","last_became_active":"2024-09-21T03:21:15.321932+0000","last_became_peered":"2024-09-21T03:21:15.321932+0000","last_unstale":"2024-09-21T03:21:17.166565+0000","last_undegraded":"2024-09-21T03:21:17.166565+0000","last_fullsized":"2024-09-21T03:21:17.166565+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:09:38.094867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.166402+0000","last_change":"2024-09-21T03:21:15.319969+0000","last_active":"2024-09-21T03:21:17.166402+0000","last_peered":"2024-09-21T03:21:17.166402+0000","last_clean":"2024-09-21T03:21:17.166402+0000","last_became_active":"2024-09-21T03:21:15.319402+0000","last_became_peered":"2024-09-21T03:21:15.319402+0000","last_unstale":"2024-09-21T03:21:17.166402+0000","last_undegraded":"2024-09-21T03:21:17.166402+0000","last_fullsized":"2024-09-21T03:21:17.166402+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:17.105111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.310076+0000","last_change":"2024-09-21T03:21:15.315137+0000","last_active":"2024-09-21T03:21:16.310076+0000","last_peered":"2024-09-21T03:21:16.310076+0000","last_clean":"2024-09-21T03:21:16.310076+0000","last_became_active":"2024-09-21T03:21:15.314829+0000","last_became_peered":"2024-09-21T03:21:15.314829+0000","last_unstale":"2024-09-21T03:21:16.310076+0000","last_undegraded":"2024-09-21T03:21:16.310076+0000","last_fullsized":"2024-09-21T03:21:16.310076+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:37.049021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.166799+0000","last_change":"2024-09-21T03:21:15.320116+0000","last_active":"2024-09-21T03:21:17.166799+0000","last_peered":"2024-09-21T03:21:17.166799+0000","last_clean":"2024-09-21T03:21:17.166799+0000","last_became_active":"2024-09-21T03:21:15.319755+0000","last_became_peered":"2024-09-21T03:21:15.319755+0000","last_unstale":"2024-09-21T03:21:17.166799+0000","last_undegraded":"2024-09-21T03:21:17.166799+0000","last_fullsized":"2024-09-21T03:21:17.166799+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:24.918019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"68'4","reported_seq":19,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.167308+0000","last_change":"2024-09-21T03:21:14.311351+0000","last_active":"2024-09-21T03:21:17.167308+0000","last_peered":"2024-09-21T03:21:17.167308+0000","last_clean":"2024-09-21T03:21:17.167308+0000","last_became_active":"2024-09-21T03:21:14.310980+0000","last_became_peered":"2024-09-21T03:21:14.310980+0000","last_unstale":"2024-09-21T03:21:17.167308+0000","last_undegraded":"2024-09-21T03:21:17.167308+0000","last_fullsized":"2024-09-21T03:21:17.167308+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:17:53.216278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.308067+0000","last_change":"2024-09-21T03:21:15.316982+0000","last_active":"2024-09-21T03:21:16.308067+0000","last_peered":"2024-09-21T03:21:16.308067+0000","last_clean":"2024-09-21T03:21:16.308067+0000","last_became_active":"2024-09-21T03:21:15.316237+0000","last_became_peered":"2024-09-21T03:21:15.316237+0000","last_unstale":"2024-09-21T03:21:16.308067+0000","last_undegraded":"2024-09-21T03:21:16.308067+0000","last_fullsized":"2024-09-21T03:21:16.308067+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:27.069475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"68'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.322118+0000","last_change":"2024-09-21T03:21:14.308412+0000","last_active":"2024-09-21T03:21:15.322118+0000","last_peered":"2024-09-21T03:21:15.322118+0000","last_clean":"2024-09-21T03:21:15.322118+0000","last_became_active":"2024-09-21T03:21:14.308143+0000","last_became_peered":"2024-09-21T03:21:14.308143+0000","last_unstale":"2024-09-21T03:21:15.322118+0000","last_undegraded":"2024-09-21T03:21:15.322118+0000","last_fullsized":"2024-09-21T03:21:15.322118+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:35:45.932535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.311010+0000","last_change":"2024-09-21T03:21:15.311660+0000","last_active":"2024-09-21T03:21:16.311010+0000","last_peered":"2024-09-21T03:21:16.311010+0000","last_clean":"2024-09-21T03:21:16.311010+0000","last_became_active":"2024-09-21T03:21:15.311360+0000","last_became_peered":"2024-09-21T03:21:15.311360+0000","last_unstale":"2024-09-21T03:21:16.311010+0000","last_undegraded":"2024-09-21T03:21:16.311010+0000","last_fullsized":"2024-09-21T03:21:16.311010+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:54.510483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.309099+0000","last_change":"2024-09-21T03:21:14.306691+0000","last_active":"2024-09-21T03:21:16.309099+0000","last_peered":"2024-09-21T03:21:16.309099+0000","last_clean":"2024-09-21T03:21:16.309099+0000","last_became_active":"2024-09-21T03:21:14.306316+0000","last_became_peered":"2024-09-21T03:21:14.306316+0000","last_unstale":"2024-09-21T03:21:16.309099+0000","last_undegraded":"2024-09-21T03:21:16.309099+0000","last_fullsized":"2024-09-21T03:21:16.309099+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:06:52.074967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.166831+0000","last_change":"2024-09-21T03:21:15.309752+0000","last_active":"2024-09-21T03:21:17.166831+0000","last_peered":"2024-09-21T03:21:17.166831+0000","last_clean":"2024-09-21T03:21:17.166831+0000","last_became_active":"2024-09-21T03:21:15.309355+0000","last_became_peered":"2024-09-21T03:21:15.309355+0000","last_unstale":"2024-09-21T03:21:17.166831+0000","last_undegraded":"2024-09-21T03:21:17.166831+0000","last_fullsized":"2024-09-21T03:21:17.166831+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:09.783908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.311100+0000","last_change":"2024-09-21T03:21:14.310776+0000","last_active":"2024-09-21T03:21:16.311100+0000","last_peered":"2024-09-21T03:21:16.311100+0000","last_clean":"2024-09-21T03:21:16.311100+0000","last_became_active":"2024-09-21T03:21:14.310449+0000","last_became_peered":"2024-09-21T03:21:14.310449+0000","last_unstale":"2024-09-21T03:21:16.311100+0000","last_undegraded":"2024-09-21T03:21:16.311100+0000","last_fullsized":"2024-09-21T03:21:16.311100+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:25.129003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.166810+0000","last_change":"2024-09-21T03:21:15.316910+0000","last_active":"2024-09-21T03:21:17.166810+0000","last_peered":"2024-09-21T03:21:17.166810+0000","last_clean":"2024-09-21T03:21:17.166810+0000","last_became_active":"2024-09-21T03:21:15.316448+0000","last_became_peered":"2024-09-21T03:21:15.316448+0000","last_unstale":"2024-09-21T03:21:17.166810+0000","last_undegraded":"2024-09-21T03:21:17.166810+0000","last_fullsized":"2024-09-21T03:21:17.166810+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:06.343181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.722446+0000","last_change":"2024-09-21T03:21:14.307004+0000","last_active":"2024-09-21T03:21:16.722446+0000","last_peered":"2024-09-21T03:21:16.722446+0000","last_clean":"2024-09-21T03:21:16.722446+0000","last_became_active":"2024-09-21T03:21:14.306628+0000","last_became_peered":"2024-09-21T03:21:14.306628+0000","last_unstale":"2024-09-21T03:21:16.722446+0000","last_undegraded":"2024-09-21T03:21:16.722446+0000","last_fullsized":"2024-09-21T03:21:16.722446+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:00.530420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.309132+0000","last_change":"2024-09-21T03:21:15.315102+0000","last_active":"2024-09-21T03:21:16.309132+0000","last_peered":"2024-09-21T03:21:16.309132+0000","last_clean":"2024-09-21T03:21:16.309132+0000","last_became_active":"2024-09-21T03:21:15.314468+0000","last_became_peered":"2024-09-21T03:21:15.314468+0000","last_unstale":"2024-09-21T03:21:16.309132+0000","last_undegraded":"2024-09-21T03:21:16.309132+0000","last_fullsized":"2024-09-21T03:21:16.309132+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:46.232546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.310389+0000","last_change":"2024-09-21T03:21:14.308574+0000","last_active":"2024-09-21T03:21:16.310389+0000","last_peered":"2024-09-21T03:21:16.310389+0000","last_clean":"2024-09-21T03:21:16.310389+0000","last_became_active":"2024-09-21T03:21:14.308261+0000","last_became_peered":"2024-09-21T03:21:14.308261+0000","last_unstale":"2024-09-21T03:21:16.310389+0000","last_undegraded":"2024-09-21T03:21:16.310389+0000","last_fullsized":"2024-09-21T03:21:16.310389+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:37.431247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.307131+0000","last_change":"2024-09-21T03:21:15.319511+0000","last_active":"2024-09-21T03:21:16.307131+0000","last_peered":"2024-09-21T03:21:16.307131+0000","last_clean":"2024-09-21T03:21:16.307131+0000","last_became_active":"2024-09-21T03:21:15.318973+0000","last_became_peered":"2024-09-21T03:21:15.318973+0000","last_unstale":"2024-09-21T03:21:16.307131+0000","last_undegraded":"2024-09-21T03:21:16.307131+0000","last_fullsized":"2024-09-21T03:21:16.307131+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:03.521751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.399564+0000","last_change":"2024-09-21T03:21:14.305720+0000","last_active":"2024-09-21T03:21:16.399564+0000","last_peered":"2024-09-21T03:21:16.399564+0000","last_clean":"2024-09-21T03:21:16.399564+0000","last_became_active":"2024-09-21T03:21:14.305352+0000","last_became_peered":"2024-09-21T03:21:14.305352+0000","last_unstale":"2024-09-21T03:21:16.399564+0000","last_undegraded":"2024-09-21T03:21:16.399564+0000","last_fullsized":"2024-09-21T03:21:16.399564+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:25.129003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.314596+0000","last_change":"2024-09-21T03:21:15.312519+0000","last_active":"2024-09-21T03:21:15.314596+0000","last_peered":"2024-09-21T03:21:15.314596+0000","last_clean":"2024-09-21T03:21:15.314596+0000","last_became_active":"2024-09-21T03:21:15.312186+0000","last_became_peered":"2024-09-21T03:21:15.312186+0000","last_unstale":"2024-09-21T03:21:15.314596+0000","last_undegraded":"2024-09-21T03:21:15.314596+0000","last_fullsized":"2024-09-21T03:21:15.314596+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:48:45.076339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.307012+0000","last_change":"2024-09-21T03:21:14.308258+0000","last_active":"2024-09-21T03:21:16.307012+0000","last_peered":"2024-09-21T03:21:16.307012+0000","last_clean":"2024-09-21T03:21:16.307012+0000","last_became_active":"2024-09-21T03:21:14.307844+0000","last_became_peered":"2024-09-21T03:21:14.307844+0000","last_unstale":"2024-09-21T03:21:16.307012+0000","last_undegraded":"2024-09-21T03:21:16.307012+0000","last_fullsized":"2024-09-21T03:21:16.307012+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:00.193104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.167347+0000","last_change":"2024-09-21T03:21:15.320225+0000","last_active":"2024-09-21T03:21:17.167347+0000","last_peered":"2024-09-21T03:21:17.167347+0000","last_clean":"2024-09-21T03:21:17.167347+0000","last_became_active":"2024-09-21T03:21:15.319482+0000","last_became_peered":"2024-09-21T03:21:15.319482+0000","last_unstale":"2024-09-21T03:21:17.167347+0000","last_undegraded":"2024-09-21T03:21:17.167347+0000","last_fullsized":"2024-09-21T03:21:17.167347+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:12.846764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.309312+0000","last_change":"2024-09-21T03:21:14.306988+0000","last_active":"2024-09-21T03:21:16.309312+0000","last_peered":"2024-09-21T03:21:16.309312+0000","last_clean":"2024-09-21T03:21:16.309312+0000","last_became_active":"2024-09-21T03:21:14.306655+0000","last_became_peered":"2024-09-21T03:21:14.306655+0000","last_unstale":"2024-09-21T03:21:16.309312+0000","last_undegraded":"2024-09-21T03:21:16.309312+0000","last_fullsized":"2024-09-21T03:21:16.309312+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:15:03.203755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.167185+0000","last_change":"2024-09-21T03:21:15.312791+0000","last_active":"2024-09-21T03:21:17.167185+0000","last_peered":"2024-09-21T03:21:17.167185+0000","last_clean":"2024-09-21T03:21:17.167185+0000","last_became_active":"2024-09-21T03:21:15.312460+0000","last_became_peered":"2024-09-21T03:21:15.312460+0000","last_unstale":"2024-09-21T03:21:17.167185+0000","last_undegraded":"2024-09-21T03:21:17.167185+0000","last_fullsized":"2024-09-21T03:21:17.167185+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:14:47.854140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.311213+0000","last_change":"2024-09-21T03:21:14.307662+0000","last_active":"2024-09-21T03:21:16.311213+0000","last_peered":"2024-09-21T03:21:16.311213+0000","last_clean":"2024-09-21T03:21:16.311213+0000","last_became_active":"2024-09-21T03:21:14.307140+0000","last_became_peered":"2024-09-21T03:21:14.307140+0000","last_unstale":"2024-09-21T03:21:16.311213+0000","last_undegraded":"2024-09-21T03:21:16.311213+0000","last_fullsized":"2024-09-21T03:21:16.311213+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:19.281187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.311144+0000","last_change":"2024-09-21T03:21:15.308995+0000","last_active":"2024-09-21T03:21:16.311144+0000","last_peered":"2024-09-21T03:21:16.311144+0000","last_clean":"2024-09-21T03:21:16.311144+0000","last_became_active":"2024-09-21T03:21:15.308668+0000","last_became_peered":"2024-09-21T03:21:15.308668+0000","last_unstale":"2024-09-21T03:21:16.311144+0000","last_undegraded":"2024-09-21T03:21:16.311144+0000","last_fullsized":"2024-09-21T03:21:16.311144+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:37.268371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"68'3","reported_seq":18,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.722429+0000","last_change":"2024-09-21T03:21:14.307750+0000","last_active":"2024-09-21T03:21:16.722429+0000","last_peered":"2024-09-21T03:21:16.722429+0000","last_clean":"2024-09-21T03:21:16.722429+0000","last_became_active":"2024-09-21T03:21:14.307455+0000","last_became_peered":"2024-09-21T03:21:14.307455+0000","last_unstale":"2024-09-21T03:21:16.722429+0000","last_undegraded":"2024-09-21T03:21:16.722429+0000","last_fullsized":"2024-09-21T03:21:16.722429+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:23.915724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.307674+0000","last_change":"2024-09-21T03:21:15.314227+0000","last_active":"2024-09-21T03:21:16.307674+0000","last_peered":"2024-09-21T03:21:16.307674+0000","last_clean":"2024-09-21T03:21:16.307674+0000","last_became_active":"2024-09-21T03:21:15.313912+0000","last_became_peered":"2024-09-21T03:21:15.313912+0000","last_unstale":"2024-09-21T03:21:16.307674+0000","last_undegraded":"2024-09-21T03:21:16.307674+0000","last_fullsized":"2024-09-21T03:21:16.307674+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:41.642751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"68'6","reported_seq":21,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.400154+0000","last_change":"2024-09-21T03:21:14.310165+0000","last_active":"2024-09-21T03:21:16.400154+0000","last_peered":"2024-09-21T03:21:16.400154+0000","last_clean":"2024-09-21T03:21:16.400154+0000","last_became_active":"2024-09-21T03:21:14.309779+0000","last_became_peered":"2024-09-21T03:21:14.309779+0000","last_unstale":"2024-09-21T03:21:16.400154+0000","last_undegraded":"2024-09-21T03:21:16.400154+0000","last_fullsized":"2024-09-21T03:21:16.400154+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:01.617914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.166372+0000","last_change":"2024-09-21T03:21:15.318449+0000","last_active":"2024-09-21T03:21:17.166372+0000","last_peered":"2024-09-21T03:21:17.166372+0000","last_clean":"2024-09-21T03:21:17.166372+0000","last_became_active":"2024-09-21T03:21:15.317723+0000","last_became_peered":"2024-09-21T03:21:15.317723+0000","last_unstale":"2024-09-21T03:21:17.166372+0000","last_undegraded":"2024-09-21T03:21:17.166372+0000","last_fullsized":"2024-09-21T03:21:17.166372+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:30.871111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.399680+0000","last_change":"2024-09-21T03:21:14.301257+0000","last_active":"2024-09-21T03:21:16.399680+0000","last_peered":"2024-09-21T03:21:16.399680+0000","last_clean":"2024-09-21T03:21:16.399680+0000","last_became_active":"2024-09-21T03:21:14.300965+0000","last_became_peered":"2024-09-21T03:21:14.300965+0000","last_unstale":"2024-09-21T03:21:16.399680+0000","last_undegraded":"2024-09-21T03:21:16.399680+0000","last_fullsized":"2024-09-21T03:21:16.399680+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:18.893129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.167294+0000","last_change":"2024-09-21T03:21:15.322171+0000","last_active":"2024-09-21T03:21:17.167294+0000","last_peered":"2024-09-21T03:21:17.167294+0000","last_clean":"2024-09-21T03:21:17.167294+0000","last_became_active":"2024-09-21T03:21:15.321798+0000","last_became_peered":"2024-09-21T03:21:15.321798+0000","last_unstale":"2024-09-21T03:21:17.167294+0000","last_undegraded":"2024-09-21T03:21:17.167294+0000","last_fullsized":"2024-09-21T03:21:17.167294+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:46:00.029272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.310506+0000","last_change":"2024-09-21T03:21:14.311892+0000","last_active":"2024-09-21T03:21:16.310506+0000","last_peered":"2024-09-21T03:21:16.310506+0000","last_clean":"2024-09-21T03:21:16.310506+0000","last_became_active":"2024-09-21T03:21:14.311532+0000","last_became_peered":"2024-09-21T03:21:14.311532+0000","last_unstale":"2024-09-21T03:21:16.310506+0000","last_undegraded":"2024-09-21T03:21:16.310506+0000","last_fullsized":"2024-09-21T03:21:16.310506+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:44.487807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.322785+0000","last_change":"2024-09-21T03:21:15.320020+0000","last_active":"2024-09-21T03:21:15.322785+0000","last_peered":"2024-09-21T03:21:15.322785+0000","last_clean":"2024-09-21T03:21:15.322785+0000","last_became_active":"2024-09-21T03:21:15.319702+0000","last_became_peered":"2024-09-21T03:21:15.319702+0000","last_unstale":"2024-09-21T03:21:15.322785+0000","last_undegraded":"2024-09-21T03:21:15.322785+0000","last_fullsized":"2024-09-21T03:21:15.322785+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:28.854474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.166030+0000","last_change":"2024-09-21T03:21:14.311749+0000","last_active":"2024-09-21T03:21:17.166030+0000","last_peered":"2024-09-21T03:21:17.166030+0000","last_clean":"2024-09-21T03:21:17.166030+0000","last_became_active":"2024-09-21T03:21:14.311265+0000","last_became_peered":"2024-09-21T03:21:14.311265+0000","last_unstale":"2024-09-21T03:21:17.166030+0000","last_undegraded":"2024-09-21T03:21:17.166030+0000","last_fullsized":"2024-09-21T03:21:17.166030+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:37:25.980686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.307235+0000","last_change":"2024-09-21T03:21:15.313074+0000","last_active":"2024-09-21T03:21:16.307235+0000","last_peered":"2024-09-21T03:21:16.307235+0000","last_clean":"2024-09-21T03:21:16.307235+0000","last_became_active":"2024-09-21T03:21:15.312336+0000","last_became_peered":"2024-09-21T03:21:15.312336+0000","last_unstale":"2024-09-21T03:21:16.307235+0000","last_undegraded":"2024-09-21T03:21:16.307235+0000","last_fullsized":"2024-09-21T03:21:16.307235+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:05:26.201129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"68'8","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.308514+0000","last_change":"2024-09-21T03:21:14.309841+0000","last_active":"2024-09-21T03:21:16.308514+0000","last_peered":"2024-09-21T03:21:16.308514+0000","last_clean":"2024-09-21T03:21:16.308514+0000","last_became_active":"2024-09-21T03:21:14.309480+0000","last_became_peered":"2024-09-21T03:21:14.309480+0000","last_unstale":"2024-09-21T03:21:16.308514+0000","last_undegraded":"2024-09-21T03:21:16.308514+0000","last_fullsized":"2024-09-21T03:21:16.308514+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:48:53.863006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.308900+0000","last_change":"2024-09-21T03:21:15.316087+0000","last_active":"2024-09-21T03:21:16.308900+0000","last_peered":"2024-09-21T03:21:16.308900+0000","last_clean":"2024-09-21T03:21:16.308900+0000","last_became_active":"2024-09-21T03:21:15.315599+0000","last_became_peered":"2024-09-21T03:21:15.315599+0000","last_unstale":"2024-09-21T03:21:16.308900+0000","last_undegraded":"2024-09-21T03:21:16.308900+0000","last_fullsized":"2024-09-21T03:21:16.308900+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:37:26.982982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.311114+0000","last_change":"2024-09-21T03:21:14.305910+0000","last_active":"2024-09-21T03:21:16.311114+0000","last_peered":"2024-09-21T03:21:16.311114+0000","last_clean":"2024-09-21T03:21:16.311114+0000","last_became_active":"2024-09-21T03:21:14.305522+0000","last_became_peered":"2024-09-21T03:21:14.305522+0000","last_unstale":"2024-09-21T03:21:16.311114+0000","last_undegraded":"2024-09-21T03:21:16.311114+0000","last_fullsized":"2024-09-21T03:21:16.311114+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:28.421620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.167422+0000","last_change":"2024-09-21T03:21:15.305932+0000","last_active":"2024-09-21T03:21:17.167422+0000","last_peered":"2024-09-21T03:21:17.167422+0000","last_clean":"2024-09-21T03:21:17.167422+0000","last_became_active":"2024-09-21T03:21:15.305574+0000","last_became_peered":"2024-09-21T03:21:15.305574+0000","last_unstale":"2024-09-21T03:21:17.167422+0000","last_undegraded":"2024-09-21T03:21:17.167422+0000","last_fullsized":"2024-09-21T03:21:17.167422+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:16.755132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.308974+0000","last_change":"2024-09-21T03:21:14.306361+0000","last_active":"2024-09-21T03:21:16.308974+0000","last_peered":"2024-09-21T03:21:16.308974+0000","last_clean":"2024-09-21T03:21:16.308974+0000","last_became_active":"2024-09-21T03:21:14.306029+0000","last_became_peered":"2024-09-21T03:21:14.306029+0000","last_unstale":"2024-09-21T03:21:16.308974+0000","last_undegraded":"2024-09-21T03:21:16.308974+0000","last_fullsized":"2024-09-21T03:21:16.308974+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:11.489428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.400112+0000","last_change":"2024-09-21T03:21:15.315315+0000","last_active":"2024-09-21T03:21:16.400112+0000","last_peered":"2024-09-21T03:21:16.400112+0000","last_clean":"2024-09-21T03:21:16.400112+0000","last_became_active":"2024-09-21T03:21:15.315006+0000","last_became_peered":"2024-09-21T03:21:15.315006+0000","last_unstale":"2024-09-21T03:21:16.400112+0000","last_undegraded":"2024-09-21T03:21:16.400112+0000","last_fullsized":"2024-09-21T03:21:16.400112+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:29.877124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.310973+0000","last_change":"2024-09-21T03:21:14.306418+0000","last_active":"2024-09-21T03:21:16.310973+0000","last_peered":"2024-09-21T03:21:16.310973+0000","last_clean":"2024-09-21T03:21:16.310973+0000","last_became_active":"2024-09-21T03:21:14.306091+0000","last_became_peered":"2024-09-21T03:21:14.306091+0000","last_unstale":"2024-09-21T03:21:16.310973+0000","last_undegraded":"2024-09-21T03:21:16.310973+0000","last_fullsized":"2024-09-21T03:21:16.310973+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:18.893129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.307761+0000","last_change":"2024-09-21T03:21:15.315351+0000","last_active":"2024-09-21T03:21:16.307761+0000","last_peered":"2024-09-21T03:21:16.307761+0000","last_clean":"2024-09-21T03:21:16.307761+0000","last_became_active":"2024-09-21T03:21:15.315064+0000","last_became_peered":"2024-09-21T03:21:15.315064+0000","last_unstale":"2024-09-21T03:21:16.307761+0000","last_undegraded":"2024-09-21T03:21:16.307761+0000","last_fullsized":"2024-09-21T03:21:16.307761+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:06:41.260202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.167030+0000","last_change":"2024-09-21T03:21:14.313985+0000","last_active":"2024-09-21T03:21:17.167030+0000","last_peered":"2024-09-21T03:21:17.167030+0000","last_clean":"2024-09-21T03:21:17.167030+0000","last_became_active":"2024-09-21T03:21:14.313675+0000","last_became_peered":"2024-09-21T03:21:14.313675+0000","last_unstale":"2024-09-21T03:21:17.167030+0000","last_undegraded":"2024-09-21T03:21:17.167030+0000","last_fullsized":"2024-09-21T03:21:17.167030+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:57.535844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.722460+0000","last_change":"2024-09-21T03:21:15.309772+0000","last_active":"2024-09-21T03:21:16.722460+0000","last_peered":"2024-09-21T03:21:16.722460+0000","last_clean":"2024-09-21T03:21:16.722460+0000","last_became_active":"2024-09-21T03:21:15.309298+0000","last_became_peered":"2024-09-21T03:21:15.309298+0000","last_unstale":"2024-09-21T03:21:16.722460+0000","last_undegraded":"2024-09-21T03:21:16.722460+0000","last_fullsized":"2024-09-21T03:21:16.722460+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:38.847194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.310538+0000","last_change":"2024-09-21T03:21:14.308273+0000","last_active":"2024-09-21T03:21:16.310538+0000","last_peered":"2024-09-21T03:21:16.310538+0000","last_clean":"2024-09-21T03:21:16.310538+0000","last_became_active":"2024-09-21T03:21:14.307628+0000","last_became_peered":"2024-09-21T03:21:14.307628+0000","last_unstale":"2024-09-21T03:21:16.310538+0000","last_undegraded":"2024-09-21T03:21:16.310538+0000","last_fullsized":"2024-09-21T03:21:16.310538+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:35.231348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.722311+0000","last_change":"2024-09-21T03:21:15.324718+0000","last_active":"2024-09-21T03:21:16.722311+0000","last_peered":"2024-09-21T03:21:16.722311+0000","last_clean":"2024-09-21T03:21:16.722311+0000","last_became_active":"2024-09-21T03:21:15.324381+0000","last_became_peered":"2024-09-21T03:21:15.324381+0000","last_unstale":"2024-09-21T03:21:16.722311+0000","last_undegraded":"2024-09-21T03:21:16.722311+0000","last_fullsized":"2024-09-21T03:21:16.722311+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:45:56.711809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.166197+0000","last_change":"2024-09-21T03:21:14.313776+0000","last_active":"2024-09-21T03:21:17.166197+0000","last_peered":"2024-09-21T03:21:17.166197+0000","last_clean":"2024-09-21T03:21:17.166197+0000","last_became_active":"2024-09-21T03:21:14.313466+0000","last_became_peered":"2024-09-21T03:21:14.313466+0000","last_unstale":"2024-09-21T03:21:17.166197+0000","last_undegraded":"2024-09-21T03:21:17.166197+0000","last_fullsized":"2024-09-21T03:21:17.166197+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:03.601810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.722541+0000","last_change":"2024-09-21T03:21:15.324726+0000","last_active":"2024-09-21T03:21:16.722541+0000","last_peered":"2024-09-21T03:21:16.722541+0000","last_clean":"2024-09-21T03:21:16.722541+0000","last_became_active":"2024-09-21T03:21:15.324425+0000","last_became_peered":"2024-09-21T03:21:15.324425+0000","last_unstale":"2024-09-21T03:21:16.722541+0000","last_undegraded":"2024-09-21T03:21:16.722541+0000","last_fullsized":"2024-09-21T03:21:16.722541+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:42:41.779875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.303159+0000","last_change":"2024-09-21T03:21:14.310881+0000","last_active":"2024-09-21T03:21:15.303159+0000","last_peered":"2024-09-21T03:21:15.303159+0000","last_clean":"2024-09-21T03:21:15.303159+0000","last_became_active":"2024-09-21T03:21:14.309420+0000","last_became_peered":"2024-09-21T03:21:14.309420+0000","last_unstale":"2024-09-21T03:21:15.303159+0000","last_undegraded":"2024-09-21T03:21:15.303159+0000","last_fullsized":"2024-09-21T03:21:15.303159+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:31.033897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.315502+0000","last_change":"2024-09-21T03:21:15.314776+0000","last_active":"2024-09-21T03:21:15.315502+0000","last_peered":"2024-09-21T03:21:15.315502+0000","last_clean":"2024-09-21T03:21:15.315502+0000","last_became_active":"2024-09-21T03:21:15.314469+0000","last_became_peered":"2024-09-21T03:21:15.314469+0000","last_unstale":"2024-09-21T03:21:15.315502+0000","last_undegraded":"2024-09-21T03:21:15.315502+0000","last_fullsized":"2024-09-21T03:21:15.315502+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:02:54.407198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.311237+0000","last_change":"2024-09-21T03:21:14.305876+0000","last_active":"2024-09-21T03:21:16.311237+0000","last_peered":"2024-09-21T03:21:16.311237+0000","last_clean":"2024-09-21T03:21:16.311237+0000","last_became_active":"2024-09-21T03:21:14.305117+0000","last_became_peered":"2024-09-21T03:21:14.305117+0000","last_unstale":"2024-09-21T03:21:16.311237+0000","last_undegraded":"2024-09-21T03:21:16.311237+0000","last_fullsized":"2024-09-21T03:21:16.311237+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:51.066086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.167056+0000","last_change":"2024-09-21T03:21:15.311807+0000","last_active":"2024-09-21T03:21:17.167056+0000","last_peered":"2024-09-21T03:21:17.167056+0000","last_clean":"2024-09-21T03:21:17.167056+0000","last_became_active":"2024-09-21T03:21:15.311514+0000","last_became_peered":"2024-09-21T03:21:15.311514+0000","last_unstale":"2024-09-21T03:21:17.167056+0000","last_undegraded":"2024-09-21T03:21:17.167056+0000","last_fullsized":"2024-09-21T03:21:17.167056+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:53.355254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"69'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.167435+0000","last_change":"2024-09-21T03:21:14.312343+0000","last_active":"2024-09-21T03:21:17.167435+0000","last_peered":"2024-09-21T03:21:17.167435+0000","last_clean":"2024-09-21T03:21:17.167435+0000","last_became_active":"2024-09-21T03:21:14.311770+0000","last_became_peered":"2024-09-21T03:21:14.311770+0000","last_unstale":"2024-09-21T03:21:17.167435+0000","last_undegraded":"2024-09-21T03:21:17.167435+0000","last_fullsized":"2024-09-21T03:21:17.167435+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:45.230250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.167028+0000","last_change":"2024-09-21T03:21:15.318749+0000","last_active":"2024-09-21T03:21:17.167028+0000","last_peered":"2024-09-21T03:21:17.167028+0000","last_clean":"2024-09-21T03:21:17.167028+0000","last_became_active":"2024-09-21T03:21:15.317143+0000","last_became_peered":"2024-09-21T03:21:15.317143+0000","last_unstale":"2024-09-21T03:21:17.167028+0000","last_undegraded":"2024-09-21T03:21:17.167028+0000","last_fullsized":"2024-09-21T03:21:17.167028+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:06.427337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.307736+0000","last_change":"2024-09-21T03:21:14.311463+0000","last_active":"2024-09-21T03:21:16.307736+0000","last_peered":"2024-09-21T03:21:16.307736+0000","last_clean":"2024-09-21T03:21:16.307736+0000","last_became_active":"2024-09-21T03:21:14.311132+0000","last_became_peered":"2024-09-21T03:21:14.311132+0000","last_unstale":"2024-09-21T03:21:16.307736+0000","last_undegraded":"2024-09-21T03:21:16.307736+0000","last_fullsized":"2024-09-21T03:21:16.307736+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:11.597949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.167001+0000","last_change":"2024-09-21T03:21:15.318032+0000","last_active":"2024-09-21T03:21:17.167001+0000","last_peered":"2024-09-21T03:21:17.167001+0000","last_clean":"2024-09-21T03:21:17.167001+0000","last_became_active":"2024-09-21T03:21:15.317595+0000","last_became_peered":"2024-09-21T03:21:15.317595+0000","last_unstale":"2024-09-21T03:21:17.167001+0000","last_undegraded":"2024-09-21T03:21:17.167001+0000","last_fullsized":"2024-09-21T03:21:17.167001+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:40.974910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.301724+0000","last_change":"2024-09-21T03:21:14.306171+0000","last_active":"2024-09-21T03:21:15.301724+0000","last_peered":"2024-09-21T03:21:15.301724+0000","last_clean":"2024-09-21T03:21:15.301724+0000","last_became_active":"2024-09-21T03:21:14.305871+0000","last_became_peered":"2024-09-21T03:21:14.305871+0000","last_unstale":"2024-09-21T03:21:15.301724+0000","last_undegraded":"2024-09-21T03:21:15.301724+0000","last_fullsized":"2024-09-21T03:21:15.301724+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:48.590153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.307392+0000","last_change":"2024-09-21T03:21:15.315466+0000","last_active":"2024-09-21T03:21:16.307392+0000","last_peered":"2024-09-21T03:21:16.307392+0000","last_clean":"2024-09-21T03:21:16.307392+0000","last_became_active":"2024-09-21T03:21:15.314857+0000","last_became_peered":"2024-09-21T03:21:15.314857+0000","last_unstale":"2024-09-21T03:21:16.307392+0000","last_undegraded":"2024-09-21T03:21:16.307392+0000","last_fullsized":"2024-09-21T03:21:16.307392+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:13.112947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.307318+0000","last_change":"2024-09-21T03:21:14.309623+0000","last_active":"2024-09-21T03:21:16.307318+0000","last_peered":"2024-09-21T03:21:16.307318+0000","last_clean":"2024-09-21T03:21:16.307318+0000","last_became_active":"2024-09-21T03:21:14.309181+0000","last_became_peered":"2024-09-21T03:21:14.309181+0000","last_unstale":"2024-09-21T03:21:16.307318+0000","last_undegraded":"2024-09-21T03:21:16.307318+0000","last_fullsized":"2024-09-21T03:21:16.307318+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:06:07.533892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.310985+0000","last_change":"2024-09-21T03:21:15.309991+0000","last_active":"2024-09-21T03:21:16.310985+0000","last_peered":"2024-09-21T03:21:16.310985+0000","last_clean":"2024-09-21T03:21:16.310985+0000","last_became_active":"2024-09-21T03:21:15.309684+0000","last_became_peered":"2024-09-21T03:21:15.309684+0000","last_unstale":"2024-09-21T03:21:16.310985+0000","last_undegraded":"2024-09-21T03:21:16.310985+0000","last_fullsized":"2024-09-21T03:21:16.310985+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:50.223934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.399564+0000","last_change":"2024-09-21T03:21:14.305668+0000","last_active":"2024-09-21T03:21:16.399564+0000","last_peered":"2024-09-21T03:21:16.399564+0000","last_clean":"2024-09-21T03:21:16.399564+0000","last_became_active":"2024-09-21T03:21:14.305355+0000","last_became_peered":"2024-09-21T03:21:14.305355+0000","last_unstale":"2024-09-21T03:21:16.399564+0000","last_undegraded":"2024-09-21T03:21:16.399564+0000","last_fullsized":"2024-09-21T03:21:16.399564+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:19.281187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.399764+0000","last_change":"2024-09-21T03:21:15.311512+0000","last_active":"2024-09-21T03:21:16.399764+0000","last_peered":"2024-09-21T03:21:16.399764+0000","last_clean":"2024-09-21T03:21:16.399764+0000","last_became_active":"2024-09-21T03:21:15.311225+0000","last_became_peered":"2024-09-21T03:21:15.311225+0000","last_unstale":"2024-09-21T03:21:16.399764+0000","last_undegraded":"2024-09-21T03:21:16.399764+0000","last_fullsized":"2024-09-21T03:21:16.399764+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:36:45.515063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.308382+0000","last_change":"2024-09-21T03:21:14.304784+0000","last_active":"2024-09-21T03:21:16.308382+0000","last_peered":"2024-09-21T03:21:16.308382+0000","last_clean":"2024-09-21T03:21:16.308382+0000","last_became_active":"2024-09-21T03:21:14.303804+0000","last_became_peered":"2024-09-21T03:21:14.303804+0000","last_unstale":"2024-09-21T03:21:16.308382+0000","last_undegraded":"2024-09-21T03:21:16.308382+0000","last_fullsized":"2024-09-21T03:21:16.308382+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:21.818166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.310196+0000","last_change":"2024-09-21T03:21:15.316164+0000","last_active":"2024-09-21T03:21:16.310196+0000","last_peered":"2024-09-21T03:21:16.310196+0000","last_clean":"2024-09-21T03:21:16.310196+0000","last_became_active":"2024-09-21T03:21:15.315685+0000","last_became_peered":"2024-09-21T03:21:15.315685+0000","last_unstale":"2024-09-21T03:21:16.310196+0000","last_undegraded":"2024-09-21T03:21:16.310196+0000","last_fullsized":"2024-09-21T03:21:16.310196+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:22.527887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.310020+0000","last_change":"2024-09-21T03:21:14.309526+0000","last_active":"2024-09-21T03:21:16.310020+0000","last_peered":"2024-09-21T03:21:16.310020+0000","last_clean":"2024-09-21T03:21:16.310020+0000","last_became_active":"2024-09-21T03:21:14.309202+0000","last_became_peered":"2024-09-21T03:21:14.309202+0000","last_unstale":"2024-09-21T03:21:16.310020+0000","last_undegraded":"2024-09-21T03:21:16.310020+0000","last_fullsized":"2024-09-21T03:21:16.310020+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:01.617914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.722484+0000","last_change":"2024-09-21T03:21:15.325101+0000","last_active":"2024-09-21T03:21:16.722484+0000","last_peered":"2024-09-21T03:21:16.722484+0000","last_clean":"2024-09-21T03:21:16.722484+0000","last_became_active":"2024-09-21T03:21:15.324796+0000","last_became_peered":"2024-09-21T03:21:15.324796+0000","last_unstale":"2024-09-21T03:21:16.722484+0000","last_undegraded":"2024-09-21T03:21:16.722484+0000","last_fullsized":"2024-09-21T03:21:16.722484+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:15:32.907203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.310691+0000","last_change":"2024-09-21T03:21:14.307393+0000","last_active":"2024-09-21T03:21:16.310691+0000","last_peered":"2024-09-21T03:21:16.310691+0000","last_clean":"2024-09-21T03:21:16.310691+0000","last_became_active":"2024-09-21T03:21:14.307069+0000","last_became_peered":"2024-09-21T03:21:14.307069+0000","last_unstale":"2024-09-21T03:21:16.310691+0000","last_undegraded":"2024-09-21T03:21:16.310691+0000","last_fullsized":"2024-09-21T03:21:16.310691+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:44:30.666667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":197,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.166187+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:21:17.166187+0000","last_peered":"2024-09-21T03:21:17.166187+0000","last_clean":"2024-09-21T03:21:17.166187+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:21:17.166187+0000","last_undegraded":"2024-09-21T03:21:17.166187+0000","last_fullsized":"2024-09-21T03:21:17.166187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509481,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28432,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343408,"statfs":{"total":96636764160,"available":96607649792,"internally_reserved":0,"allocated":1433600,"data_stored":935625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509480,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":839680,"data_stored":344733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509479,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":835584,"data_stored":344731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509479,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":835584,"data_stored":344711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509480,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":839680,"data_stored":344753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509480,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":843776,"data_stored":346253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509480,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":851968,"data_stored":346869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1413120,"data_stored":928709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:21:20.630 INFO:tasks.ceph.mds.a.smithi105.stderr:2024-09-21T03:21:20.628+0000 7f1da07e4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T03:21:22.788 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:21:22.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:22.913+0000 7f0e9a14a640 1 -- 172.21.15.105:0/2314048406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e7c003fd0 msgr2=0x7f0e7c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:22.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:22.913+0000 7f0e9a14a640 1 --2- 172.21.15.105:0/2314048406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e7c003fd0 0x7f0e7c004800 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f0e8800c260 tx=0x7f0e7c005830 comp rx=0 tx=0).stop 2024-09-21T03:21:22.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:22.913+0000 7f0e93fff640 1 -- 172.21.15.105:0/2314048406 reap_dead start 2024-09-21T03:21:22.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:22.913+0000 7f0e9a14a640 1 -- 172.21.15.105:0/2314048406 shutdown_connections 2024-09-21T03:21:22.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:22.913+0000 7f0e9a14a640 1 -- 172.21.15.105:0/2314048406 >> 172.21.15.105:0/2314048406 conn(0x7f0e9406def0 msgr2=0x7f0e9406e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:22.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:22.913+0000 7f0e9a14a640 1 -- 172.21.15.105:0/2314048406 shutdown_connections 2024-09-21T03:21:22.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:22.913+0000 7f0e9a14a640 1 -- 172.21.15.105:0/2314048406 wait complete. 2024-09-21T03:21:22.916 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:22.915+0000 7f0e9a14a640 1 Processor -- start 2024-09-21T03:21:22.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:22.915+0000 7f0e9a14a640 1 -- start start 2024-09-21T03:21:22.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:22.916+0000 7f0e9a14a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e7c003fd0 0x7f0e941f62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:22.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:22.916+0000 7f0e9a14a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e94144a40 0x7f0e94136290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:22.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:22.916+0000 7f0e9a14a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e941367d0 0x7f0e94136be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:22.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:22.916+0000 7f0e9a14a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0e94074460 con 0x7f0e7c003fd0 2024-09-21T03:21:22.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:22.916+0000 7f0e9a14a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0e940742e0 con 0x7f0e941367d0 2024-09-21T03:21:22.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:22.916+0000 7f0e9a14a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0e940745e0 con 0x7f0e94144a40 2024-09-21T03:21:22.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:22.917+0000 7f0e937fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e7c003fd0 0x7f0e941f62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:22.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:22.917+0000 7f0e937fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e7c003fd0 0x7f0e941f62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58060/0 (socket says 172.21.15.105:58060) 2024-09-21T03:21:22.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:22.917+0000 7f0e937fe640 1 -- 172.21.15.105:0/2413164086 learned_addr learned my addr 172.21.15.105:0/2413164086 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:22.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:22.917+0000 7f0e92ffd640 1 --2- 172.21.15.105:0/2413164086 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e94144a40 0x7f0e94136290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:22.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:22.917+0000 7f0e93fff640 1 --2- 172.21.15.105:0/2413164086 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e941367d0 0x7f0e94136be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:22.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:22.917+0000 7f0e937fe640 1 -- 172.21.15.105:0/2413164086 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e94144a40 msgr2=0x7f0e94136290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:22.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:22.917+0000 7f0e937fe640 1 --2- 172.21.15.105:0/2413164086 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e94144a40 0x7f0e94136290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:22.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:22.917+0000 7f0e937fe640 1 -- 172.21.15.105:0/2413164086 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e941367d0 msgr2=0x7f0e94136be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:22.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:22.917+0000 7f0e937fe640 1 --2- 172.21.15.105:0/2413164086 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e941367d0 0x7f0e94136be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:22.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:22.917+0000 7f0e937fe640 1 -- 172.21.15.105:0/2413164086 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e941f6820 con 0x7f0e7c003fd0 2024-09-21T03:21:22.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:22.917+0000 7f0e92ffd640 1 --2- 172.21.15.105:0/2413164086 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e94144a40 0x7f0e94136290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:21:22.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:22.917+0000 7f0e937fe640 1 --2- 172.21.15.105:0/2413164086 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e7c003fd0 0x7f0e941f62e0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f0e84011b10 tx=0x7f0e84011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:22.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:22.917+0000 7f0e7bfff640 1 -- 172.21.15.105:0/2413164086 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8401e070 con 0x7f0e7c003fd0 2024-09-21T03:21:22.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:22.917+0000 7f0e7bfff640 1 -- 172.21.15.105:0/2413164086 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e84004460 con 0x7f0e7c003fd0 2024-09-21T03:21:22.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:22.917+0000 7f0e9a14a640 1 -- 172.21.15.105:0/2413164086 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e941e8810 con 0x7f0e7c003fd0 2024-09-21T03:21:22.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:22.917+0000 7f0e7bfff640 1 -- 172.21.15.105:0/2413164086 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8400fc40 con 0x7f0e7c003fd0 2024-09-21T03:21:22.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:22.917+0000 7f0e9a14a640 1 -- 172.21.15.105:0/2413164086 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e941e8dd0 con 0x7f0e7c003fd0 2024-09-21T03:21:22.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:22.918+0000 7f0e9a14a640 1 -- 172.21.15.105:0/2413164086 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e9415d4e0 con 0x7f0e7c003fd0 2024-09-21T03:21:22.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:22.919+0000 7f0e7bfff640 1 -- 172.21.15.105:0/2413164086 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0e84021070 con 0x7f0e7c003fd0 2024-09-21T03:21:22.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:22.920+0000 7f0e7bfff640 1 --2- 172.21.15.105:0/2413164086 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0e80078bc0 0x7f0e8007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:22.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:22.920+0000 7f0e7bfff640 1 -- 172.21.15.105:0/2413164086 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f0e8409b6f0 con 0x7f0e7c003fd0 2024-09-21T03:21:22.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:22.920+0000 7f0e92ffd640 1 --2- 172.21.15.105:0/2413164086 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0e80078bc0 0x7f0e8007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:22.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:22.920+0000 7f0e92ffd640 1 --2- 172.21.15.105:0/2413164086 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0e80078bc0 0x7f0e8007b0d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0e88033000 tx=0x7f0e940ce4a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:22.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:22.924+0000 7f0e7bfff640 1 -- 172.21.15.105:0/2413164086 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0e84063520 con 0x7f0e7c003fd0 2024-09-21T03:21:23.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.097+0000 7f0e9a14a640 1 -- 172.21.15.105:0/2413164086 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0e940cd2e0 con 0x7f0e80078bc0 2024-09-21T03:21:23.103 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.102+0000 7f0e7bfff640 1 -- 172.21.15.105:0/2413164086 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252057 (secure 0 0 0) 0x7f0e880828b0 con 0x7f0e80078bc0 2024-09-21T03:21:23.106 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:23.107 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:21:23.110 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.105+0000 7f0e9a14a640 1 -- 172.21.15.105:0/2413164086 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0e80078bc0 msgr2=0x7f0e8007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:23.110 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.105+0000 7f0e9a14a640 1 --2- 172.21.15.105:0/2413164086 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0e80078bc0 0x7f0e8007b0d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0e88033000 tx=0x7f0e940ce4a0 comp rx=0 tx=0).stop 2024-09-21T03:21:23.110 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.105+0000 7f0e9a14a640 1 -- 172.21.15.105:0/2413164086 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e7c003fd0 msgr2=0x7f0e941f62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:23.110 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.105+0000 7f0e9a14a640 1 --2- 172.21.15.105:0/2413164086 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e7c003fd0 0x7f0e941f62e0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f0e84011b10 tx=0x7f0e84011f10 comp rx=0 tx=0).stop 2024-09-21T03:21:23.110 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.105+0000 7f0e9a14a640 1 -- 172.21.15.105:0/2413164086 shutdown_connections 2024-09-21T03:21:23.110 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.105+0000 7f0e9a14a640 1 --2- 172.21.15.105:0/2413164086 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0e80078bc0 0x7f0e8007b0d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:23.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.105+0000 7f0e9a14a640 1 --2- 172.21.15.105:0/2413164086 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e941367d0 0x7f0e94136be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:23.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.105+0000 7f0e9a14a640 1 --2- 172.21.15.105:0/2413164086 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e94144a40 0x7f0e94136290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:23.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.105+0000 7f0e9a14a640 1 --2- 172.21.15.105:0/2413164086 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e7c003fd0 0x7f0e941f62e0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:23.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.105+0000 7f0e9a14a640 1 -- 172.21.15.105:0/2413164086 >> 172.21.15.105:0/2413164086 conn(0x7f0e9406def0 msgr2=0x7f0e9415f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:23.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.105+0000 7f0e9a14a640 1 -- 172.21.15.105:0/2413164086 shutdown_connections 2024-09-21T03:21:23.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.105+0000 7f0e9a14a640 1 -- 172.21.15.105:0/2413164086 wait complete. 2024-09-21T03:21:23.119 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2024-09-21T03:21:21.323013+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236456,"kb_used_data":7708,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754738264,"statfs":{"total":773094113280,"available":772851982336,"internally_reserved":0,"allocated":7892992,"data_stored":3936384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.031762"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.167180+0000","last_change":"2024-09-21T03:21:15.326657+0000","last_active":"2024-09-21T03:21:17.167180+0000","last_peered":"2024-09-21T03:21:17.167180+0000","last_clean":"2024-09-21T03:21:17.167180+0000","last_became_active":"2024-09-21T03:21:15.326350+0000","last_became_peered":"2024-09-21T03:21:15.326350+0000","last_unstale":"2024-09-21T03:21:17.167180+0000","last_undegraded":"2024-09-21T03:21:17.167180+0000","last_fullsized":"2024-09-21T03:21:17.167180+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:34:41.899074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.311359+0000","last_change":"2024-09-21T03:21:15.317545+0000","last_active":"2024-09-21T03:21:16.311359+0000","last_peered":"2024-09-21T03:21:16.311359+0000","last_clean":"2024-09-21T03:21:16.311359+0000","last_became_active":"2024-09-21T03:21:15.317237+0000","last_became_peered":"2024-09-21T03:21:15.317237+0000","last_unstale":"2024-09-21T03:21:16.311359+0000","last_undegraded":"2024-09-21T03:21:16.311359+0000","last_fullsized":"2024-09-21T03:21:16.311359+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:31:05.212420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.722358+0000","last_change":"2024-09-21T03:21:15.310752+0000","last_active":"2024-09-21T03:21:16.722358+0000","last_peered":"2024-09-21T03:21:16.722358+0000","last_clean":"2024-09-21T03:21:16.722358+0000","last_became_active":"2024-09-21T03:21:15.310408+0000","last_became_peered":"2024-09-21T03:21:15.310408+0000","last_unstale":"2024-09-21T03:21:16.722358+0000","last_undegraded":"2024-09-21T03:21:16.722358+0000","last_fullsized":"2024-09-21T03:21:16.722358+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:29.263335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.399941+0000","last_change":"2024-09-21T03:21:15.316510+0000","last_active":"2024-09-21T03:21:16.399941+0000","last_peered":"2024-09-21T03:21:16.399941+0000","last_clean":"2024-09-21T03:21:16.399941+0000","last_became_active":"2024-09-21T03:21:15.316202+0000","last_became_peered":"2024-09-21T03:21:15.316202+0000","last_unstale":"2024-09-21T03:21:16.399941+0000","last_undegraded":"2024-09-21T03:21:16.399941+0000","last_fullsized":"2024-09-21T03:21:16.399941+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:34.881568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.307390+0000","last_change":"2024-09-21T03:21:15.317816+0000","last_active":"2024-09-21T03:21:16.307390+0000","last_peered":"2024-09-21T03:21:16.307390+0000","last_clean":"2024-09-21T03:21:16.307390+0000","last_became_active":"2024-09-21T03:21:15.317513+0000","last_became_peered":"2024-09-21T03:21:15.317513+0000","last_unstale":"2024-09-21T03:21:16.307390+0000","last_undegraded":"2024-09-21T03:21:16.307390+0000","last_fullsized":"2024-09-21T03:21:16.307390+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:17.720643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.310303+0000","last_change":"2024-09-21T03:21:15.317111+0000","last_active":"2024-09-21T03:21:16.310303+0000","last_peered":"2024-09-21T03:21:16.310303+0000","last_clean":"2024-09-21T03:21:16.310303+0000","last_became_active":"2024-09-21T03:21:15.316815+0000","last_became_peered":"2024-09-21T03:21:15.316815+0000","last_unstale":"2024-09-21T03:21:16.310303+0000","last_undegraded":"2024-09-21T03:21:16.310303+0000","last_fullsized":"2024-09-21T03:21:16.310303+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:13.729423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.166105+0000","last_change":"2024-09-21T03:21:15.314973+0000","last_active":"2024-09-21T03:21:17.166105+0000","last_peered":"2024-09-21T03:21:17.166105+0000","last_clean":"2024-09-21T03:21:17.166105+0000","last_became_active":"2024-09-21T03:21:15.314629+0000","last_became_peered":"2024-09-21T03:21:15.314629+0000","last_unstale":"2024-09-21T03:21:17.166105+0000","last_undegraded":"2024-09-21T03:21:17.166105+0000","last_fullsized":"2024-09-21T03:21:17.166105+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:39.195872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.309951+0000","last_change":"2024-09-21T03:21:15.323786+0000","last_active":"2024-09-21T03:21:16.309951+0000","last_peered":"2024-09-21T03:21:16.309951+0000","last_clean":"2024-09-21T03:21:16.309951+0000","last_became_active":"2024-09-21T03:21:15.321831+0000","last_became_peered":"2024-09-21T03:21:15.321831+0000","last_unstale":"2024-09-21T03:21:16.309951+0000","last_undegraded":"2024-09-21T03:21:16.309951+0000","last_fullsized":"2024-09-21T03:21:16.309951+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:59:30.299107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.307814+0000","last_change":"2024-09-21T03:21:15.316599+0000","last_active":"2024-09-21T03:21:16.307814+0000","last_peered":"2024-09-21T03:21:16.307814+0000","last_clean":"2024-09-21T03:21:16.307814+0000","last_became_active":"2024-09-21T03:21:15.315972+0000","last_became_peered":"2024-09-21T03:21:15.315972+0000","last_unstale":"2024-09-21T03:21:16.307814+0000","last_undegraded":"2024-09-21T03:21:16.307814+0000","last_fullsized":"2024-09-21T03:21:16.307814+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:32.479277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.308879+0000","last_change":"2024-09-21T03:21:15.318299+0000","last_active":"2024-09-21T03:21:16.308879+0000","last_peered":"2024-09-21T03:21:16.308879+0000","last_clean":"2024-09-21T03:21:16.308879+0000","last_became_active":"2024-09-21T03:21:15.317954+0000","last_became_peered":"2024-09-21T03:21:15.317954+0000","last_unstale":"2024-09-21T03:21:16.308879+0000","last_undegraded":"2024-09-21T03:21:16.308879+0000","last_fullsized":"2024-09-21T03:21:16.308879+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:31:05.212420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.166726+0000","last_change":"2024-09-21T03:21:15.311522+0000","last_active":"2024-09-21T03:21:17.166726+0000","last_peered":"2024-09-21T03:21:17.166726+0000","last_clean":"2024-09-21T03:21:17.166726+0000","last_became_active":"2024-09-21T03:21:15.311172+0000","last_became_peered":"2024-09-21T03:21:15.311172+0000","last_unstale":"2024-09-21T03:21:17.166726+0000","last_undegraded":"2024-09-21T03:21:17.166726+0000","last_fullsized":"2024-09-21T03:21:17.166726+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:21.597725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.400147+0000","last_change":"2024-09-21T03:21:15.321391+0000","last_active":"2024-09-21T03:21:16.400147+0000","last_peered":"2024-09-21T03:21:16.400147+0000","last_clean":"2024-09-21T03:21:16.400147+0000","last_became_active":"2024-09-21T03:21:15.320862+0000","last_became_peered":"2024-09-21T03:21:15.320862+0000","last_unstale":"2024-09-21T03:21:16.400147+0000","last_undegraded":"2024-09-21T03:21:16.400147+0000","last_fullsized":"2024-09-21T03:21:16.400147+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:44:08.217596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.322799+0000","last_change":"2024-09-21T03:21:15.320132+0000","last_active":"2024-09-21T03:21:15.322799+0000","last_peered":"2024-09-21T03:21:15.322799+0000","last_clean":"2024-09-21T03:21:15.322799+0000","last_became_active":"2024-09-21T03:21:15.319814+0000","last_became_peered":"2024-09-21T03:21:15.319814+0000","last_unstale":"2024-09-21T03:21:15.322799+0000","last_undegraded":"2024-09-21T03:21:15.322799+0000","last_fullsized":"2024-09-21T03:21:15.322799+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:52.724426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.307396+0000","last_change":"2024-09-21T03:21:15.319061+0000","last_active":"2024-09-21T03:21:16.307396+0000","last_peered":"2024-09-21T03:21:16.307396+0000","last_clean":"2024-09-21T03:21:16.307396+0000","last_became_active":"2024-09-21T03:21:15.318760+0000","last_became_peered":"2024-09-21T03:21:15.318760+0000","last_unstale":"2024-09-21T03:21:16.307396+0000","last_undegraded":"2024-09-21T03:21:16.307396+0000","last_fullsized":"2024-09-21T03:21:16.307396+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:47.370478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.321464+0000","last_change":"2024-09-21T03:21:15.319096+0000","last_active":"2024-09-21T03:21:15.321464+0000","last_peered":"2024-09-21T03:21:15.321464+0000","last_clean":"2024-09-21T03:21:15.321464+0000","last_became_active":"2024-09-21T03:21:15.318769+0000","last_became_peered":"2024-09-21T03:21:15.318769+0000","last_unstale":"2024-09-21T03:21:15.321464+0000","last_undegraded":"2024-09-21T03:21:15.321464+0000","last_fullsized":"2024-09-21T03:21:15.321464+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:26.465077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.308434+0000","last_change":"2024-09-21T03:21:15.317737+0000","last_active":"2024-09-21T03:21:16.308434+0000","last_peered":"2024-09-21T03:21:16.308434+0000","last_clean":"2024-09-21T03:21:16.308434+0000","last_became_active":"2024-09-21T03:21:15.317432+0000","last_became_peered":"2024-09-21T03:21:15.317432+0000","last_unstale":"2024-09-21T03:21:16.308434+0000","last_undegraded":"2024-09-21T03:21:16.308434+0000","last_fullsized":"2024-09-21T03:21:16.308434+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:37.268371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.307930+0000","last_change":"2024-09-21T03:21:15.316261+0000","last_active":"2024-09-21T03:21:16.307930+0000","last_peered":"2024-09-21T03:21:16.307930+0000","last_clean":"2024-09-21T03:21:16.307930+0000","last_became_active":"2024-09-21T03:21:15.313366+0000","last_became_peered":"2024-09-21T03:21:15.313366+0000","last_unstale":"2024-09-21T03:21:16.307930+0000","last_undegraded":"2024-09-21T03:21:16.307930+0000","last_fullsized":"2024-09-21T03:21:16.307930+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:26.578050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.400049+0000","last_change":"2024-09-21T03:21:15.316970+0000","last_active":"2024-09-21T03:21:16.400049+0000","last_peered":"2024-09-21T03:21:16.400049+0000","last_clean":"2024-09-21T03:21:16.400049+0000","last_became_active":"2024-09-21T03:21:15.316648+0000","last_became_peered":"2024-09-21T03:21:15.316648+0000","last_unstale":"2024-09-21T03:21:16.400049+0000","last_undegraded":"2024-09-21T03:21:16.400049+0000","last_fullsized":"2024-09-21T03:21:16.400049+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:42.570834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.311168+0000","last_change":"2024-09-21T03:21:15.321513+0000","last_active":"2024-09-21T03:21:16.311168+0000","last_peered":"2024-09-21T03:21:16.311168+0000","last_clean":"2024-09-21T03:21:16.311168+0000","last_became_active":"2024-09-21T03:21:15.320624+0000","last_became_peered":"2024-09-21T03:21:15.320624+0000","last_unstale":"2024-09-21T03:21:16.311168+0000","last_undegraded":"2024-09-21T03:21:16.311168+0000","last_fullsized":"2024-09-21T03:21:16.311168+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:45:16.792863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.314579+0000","last_change":"2024-09-21T03:21:15.313301+0000","last_active":"2024-09-21T03:21:15.314579+0000","last_peered":"2024-09-21T03:21:15.314579+0000","last_clean":"2024-09-21T03:21:15.314579+0000","last_became_active":"2024-09-21T03:21:15.313019+0000","last_became_peered":"2024-09-21T03:21:15.313019+0000","last_unstale":"2024-09-21T03:21:15.314579+0000","last_undegraded":"2024-09-21T03:21:15.314579+0000","last_fullsized":"2024-09-21T03:21:15.314579+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:58.046608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.308777+0000","last_change":"2024-09-21T03:21:15.316205+0000","last_active":"2024-09-21T03:21:16.308777+0000","last_peered":"2024-09-21T03:21:16.308777+0000","last_clean":"2024-09-21T03:21:16.308777+0000","last_became_active":"2024-09-21T03:21:15.314888+0000","last_became_peered":"2024-09-21T03:21:15.314888+0000","last_unstale":"2024-09-21T03:21:16.308777+0000","last_undegraded":"2024-09-21T03:21:16.308777+0000","last_fullsized":"2024-09-21T03:21:16.308777+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:45:16.792863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.309355+0000","last_change":"2024-09-21T03:21:15.316306+0000","last_active":"2024-09-21T03:21:16.309355+0000","last_peered":"2024-09-21T03:21:16.309355+0000","last_clean":"2024-09-21T03:21:16.309355+0000","last_became_active":"2024-09-21T03:21:15.316017+0000","last_became_peered":"2024-09-21T03:21:15.316017+0000","last_unstale":"2024-09-21T03:21:16.309355+0000","last_undegraded":"2024-09-21T03:21:16.309355+0000","last_fullsized":"2024-09-21T03:21:16.309355+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:35.852014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.166775+0000","last_change":"2024-09-21T03:21:15.312578+0000","last_active":"2024-09-21T03:21:17.166775+0000","last_peered":"2024-09-21T03:21:17.166775+0000","last_clean":"2024-09-21T03:21:17.166775+0000","last_became_active":"2024-09-21T03:21:15.312233+0000","last_became_peered":"2024-09-21T03:21:15.312233+0000","last_unstale":"2024-09-21T03:21:17.166775+0000","last_undegraded":"2024-09-21T03:21:17.166775+0000","last_fullsized":"2024-09-21T03:21:17.166775+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:28.768786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.166212+0000","last_change":"2024-09-21T03:21:15.319775+0000","last_active":"2024-09-21T03:21:17.166212+0000","last_peered":"2024-09-21T03:21:17.166212+0000","last_clean":"2024-09-21T03:21:17.166212+0000","last_became_active":"2024-09-21T03:21:15.319454+0000","last_became_peered":"2024-09-21T03:21:15.319454+0000","last_unstale":"2024-09-21T03:21:17.166212+0000","last_undegraded":"2024-09-21T03:21:17.166212+0000","last_fullsized":"2024-09-21T03:21:17.166212+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:35:25.304218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.309477+0000","last_change":"2024-09-21T03:21:15.313986+0000","last_active":"2024-09-21T03:21:16.309477+0000","last_peered":"2024-09-21T03:21:16.309477+0000","last_clean":"2024-09-21T03:21:16.309477+0000","last_became_active":"2024-09-21T03:21:15.313657+0000","last_became_peered":"2024-09-21T03:21:15.313657+0000","last_unstale":"2024-09-21T03:21:16.309477+0000","last_undegraded":"2024-09-21T03:21:16.309477+0000","last_fullsized":"2024-09-21T03:21:16.309477+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:30.205604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.167283+0000","last_change":"2024-09-21T03:21:15.323585+0000","last_active":"2024-09-21T03:21:17.167283+0000","last_peered":"2024-09-21T03:21:17.167283+0000","last_clean":"2024-09-21T03:21:17.167283+0000","last_became_active":"2024-09-21T03:21:15.323262+0000","last_became_peered":"2024-09-21T03:21:15.323262+0000","last_unstale":"2024-09-21T03:21:17.167283+0000","last_undegraded":"2024-09-21T03:21:17.167283+0000","last_fullsized":"2024-09-21T03:21:17.167283+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:40.550567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.722364+0000","last_change":"2024-09-21T03:21:15.309600+0000","last_active":"2024-09-21T03:21:16.722364+0000","last_peered":"2024-09-21T03:21:16.722364+0000","last_clean":"2024-09-21T03:21:16.722364+0000","last_became_active":"2024-09-21T03:21:15.309280+0000","last_became_peered":"2024-09-21T03:21:15.309280+0000","last_unstale":"2024-09-21T03:21:16.722364+0000","last_undegraded":"2024-09-21T03:21:16.722364+0000","last_fullsized":"2024-09-21T03:21:16.722364+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:01.470848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.309150+0000","last_change":"2024-09-21T03:21:15.315449+0000","last_active":"2024-09-21T03:21:16.309150+0000","last_peered":"2024-09-21T03:21:16.309150+0000","last_clean":"2024-09-21T03:21:16.309150+0000","last_became_active":"2024-09-21T03:21:15.315121+0000","last_became_peered":"2024-09-21T03:21:15.315121+0000","last_unstale":"2024-09-21T03:21:16.309150+0000","last_undegraded":"2024-09-21T03:21:16.309150+0000","last_fullsized":"2024-09-21T03:21:16.309150+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:55.270254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.722376+0000","last_change":"2024-09-21T03:21:15.314781+0000","last_active":"2024-09-21T03:21:16.722376+0000","last_peered":"2024-09-21T03:21:16.722376+0000","last_clean":"2024-09-21T03:21:16.722376+0000","last_became_active":"2024-09-21T03:21:15.314222+0000","last_became_peered":"2024-09-21T03:21:15.314222+0000","last_unstale":"2024-09-21T03:21:16.722376+0000","last_undegraded":"2024-09-21T03:21:16.722376+0000","last_fullsized":"2024-09-21T03:21:16.722376+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:19:40.283991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.166565+0000","last_change":"2024-09-21T03:21:15.322395+0000","last_active":"2024-09-21T03:21:17.166565+0000","last_peered":"2024-09-21T03:21:17.166565+0000","last_clean":"2024-09-21T03:21:17.166565+0000","last_became_active":"2024-09-21T03:21:15.321932+0000","last_became_peered":"2024-09-21T03:21:15.321932+0000","last_unstale":"2024-09-21T03:21:17.166565+0000","last_undegraded":"2024-09-21T03:21:17.166565+0000","last_fullsized":"2024-09-21T03:21:17.166565+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:09:38.094867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.166402+0000","last_change":"2024-09-21T03:21:15.319969+0000","last_active":"2024-09-21T03:21:17.166402+0000","last_peered":"2024-09-21T03:21:17.166402+0000","last_clean":"2024-09-21T03:21:17.166402+0000","last_became_active":"2024-09-21T03:21:15.319402+0000","last_became_peered":"2024-09-21T03:21:15.319402+0000","last_unstale":"2024-09-21T03:21:17.166402+0000","last_undegraded":"2024-09-21T03:21:17.166402+0000","last_fullsized":"2024-09-21T03:21:17.166402+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:17.105111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.310076+0000","last_change":"2024-09-21T03:21:15.315137+0000","last_active":"2024-09-21T03:21:16.310076+0000","last_peered":"2024-09-21T03:21:16.310076+0000","last_clean":"2024-09-21T03:21:16.310076+0000","last_became_active":"2024-09-21T03:21:15.314829+0000","last_became_peered":"2024-09-21T03:21:15.314829+0000","last_unstale":"2024-09-21T03:21:16.310076+0000","last_undegraded":"2024-09-21T03:21:16.310076+0000","last_fullsized":"2024-09-21T03:21:16.310076+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:37.049021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.166799+0000","last_change":"2024-09-21T03:21:15.320116+0000","last_active":"2024-09-21T03:21:17.166799+0000","last_peered":"2024-09-21T03:21:17.166799+0000","last_clean":"2024-09-21T03:21:17.166799+0000","last_became_active":"2024-09-21T03:21:15.319755+0000","last_became_peered":"2024-09-21T03:21:15.319755+0000","last_unstale":"2024-09-21T03:21:17.166799+0000","last_undegraded":"2024-09-21T03:21:17.166799+0000","last_fullsized":"2024-09-21T03:21:17.166799+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:24.918019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"68'4","reported_seq":19,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.167308+0000","last_change":"2024-09-21T03:21:14.311351+0000","last_active":"2024-09-21T03:21:17.167308+0000","last_peered":"2024-09-21T03:21:17.167308+0000","last_clean":"2024-09-21T03:21:17.167308+0000","last_became_active":"2024-09-21T03:21:14.310980+0000","last_became_peered":"2024-09-21T03:21:14.310980+0000","last_unstale":"2024-09-21T03:21:17.167308+0000","last_undegraded":"2024-09-21T03:21:17.167308+0000","last_fullsized":"2024-09-21T03:21:17.167308+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:17:53.216278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.308067+0000","last_change":"2024-09-21T03:21:15.316982+0000","last_active":"2024-09-21T03:21:16.308067+0000","last_peered":"2024-09-21T03:21:16.308067+0000","last_clean":"2024-09-21T03:21:16.308067+0000","last_became_active":"2024-09-21T03:21:15.316237+0000","last_became_peered":"2024-09-21T03:21:15.316237+0000","last_unstale":"2024-09-21T03:21:16.308067+0000","last_undegraded":"2024-09-21T03:21:16.308067+0000","last_fullsized":"2024-09-21T03:21:16.308067+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:27.069475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"68'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.322118+0000","last_change":"2024-09-21T03:21:14.308412+0000","last_active":"2024-09-21T03:21:15.322118+0000","last_peered":"2024-09-21T03:21:15.322118+0000","last_clean":"2024-09-21T03:21:15.322118+0000","last_became_active":"2024-09-21T03:21:14.308143+0000","last_became_peered":"2024-09-21T03:21:14.308143+0000","last_unstale":"2024-09-21T03:21:15.322118+0000","last_undegraded":"2024-09-21T03:21:15.322118+0000","last_fullsized":"2024-09-21T03:21:15.322118+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:35:45.932535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.311010+0000","last_change":"2024-09-21T03:21:15.311660+0000","last_active":"2024-09-21T03:21:16.311010+0000","last_peered":"2024-09-21T03:21:16.311010+0000","last_clean":"2024-09-21T03:21:16.311010+0000","last_became_active":"2024-09-21T03:21:15.311360+0000","last_became_peered":"2024-09-21T03:21:15.311360+0000","last_unstale":"2024-09-21T03:21:16.311010+0000","last_undegraded":"2024-09-21T03:21:16.311010+0000","last_fullsized":"2024-09-21T03:21:16.311010+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:54.510483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.309099+0000","last_change":"2024-09-21T03:21:14.306691+0000","last_active":"2024-09-21T03:21:16.309099+0000","last_peered":"2024-09-21T03:21:16.309099+0000","last_clean":"2024-09-21T03:21:16.309099+0000","last_became_active":"2024-09-21T03:21:14.306316+0000","last_became_peered":"2024-09-21T03:21:14.306316+0000","last_unstale":"2024-09-21T03:21:16.309099+0000","last_undegraded":"2024-09-21T03:21:16.309099+0000","last_fullsized":"2024-09-21T03:21:16.309099+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:06:52.074967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.166831+0000","last_change":"2024-09-21T03:21:15.309752+0000","last_active":"2024-09-21T03:21:17.166831+0000","last_peered":"2024-09-21T03:21:17.166831+0000","last_clean":"2024-09-21T03:21:17.166831+0000","last_became_active":"2024-09-21T03:21:15.309355+0000","last_became_peered":"2024-09-21T03:21:15.309355+0000","last_unstale":"2024-09-21T03:21:17.166831+0000","last_undegraded":"2024-09-21T03:21:17.166831+0000","last_fullsized":"2024-09-21T03:21:17.166831+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:09.783908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.311100+0000","last_change":"2024-09-21T03:21:14.310776+0000","last_active":"2024-09-21T03:21:16.311100+0000","last_peered":"2024-09-21T03:21:16.311100+0000","last_clean":"2024-09-21T03:21:16.311100+0000","last_became_active":"2024-09-21T03:21:14.310449+0000","last_became_peered":"2024-09-21T03:21:14.310449+0000","last_unstale":"2024-09-21T03:21:16.311100+0000","last_undegraded":"2024-09-21T03:21:16.311100+0000","last_fullsized":"2024-09-21T03:21:16.311100+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:25.129003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.166810+0000","last_change":"2024-09-21T03:21:15.316910+0000","last_active":"2024-09-21T03:21:17.166810+0000","last_peered":"2024-09-21T03:21:17.166810+0000","last_clean":"2024-09-21T03:21:17.166810+0000","last_became_active":"2024-09-21T03:21:15.316448+0000","last_became_peered":"2024-09-21T03:21:15.316448+0000","last_unstale":"2024-09-21T03:21:17.166810+0000","last_undegraded":"2024-09-21T03:21:17.166810+0000","last_fullsized":"2024-09-21T03:21:17.166810+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:06.343181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.722446+0000","last_change":"2024-09-21T03:21:14.307004+0000","last_active":"2024-09-21T03:21:16.722446+0000","last_peered":"2024-09-21T03:21:16.722446+0000","last_clean":"2024-09-21T03:21:16.722446+0000","last_became_active":"2024-09-21T03:21:14.306628+0000","last_became_peered":"2024-09-21T03:21:14.306628+0000","last_unstale":"2024-09-21T03:21:16.722446+0000","last_undegraded":"2024-09-21T03:21:16.722446+0000","last_fullsized":"2024-09-21T03:21:16.722446+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:00.530420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.309132+0000","last_change":"2024-09-21T03:21:15.315102+0000","last_active":"2024-09-21T03:21:16.309132+0000","last_peered":"2024-09-21T03:21:16.309132+0000","last_clean":"2024-09-21T03:21:16.309132+0000","last_became_active":"2024-09-21T03:21:15.314468+0000","last_became_peered":"2024-09-21T03:21:15.314468+0000","last_unstale":"2024-09-21T03:21:16.309132+0000","last_undegraded":"2024-09-21T03:21:16.309132+0000","last_fullsized":"2024-09-21T03:21:16.309132+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:46.232546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.310389+0000","last_change":"2024-09-21T03:21:14.308574+0000","last_active":"2024-09-21T03:21:16.310389+0000","last_peered":"2024-09-21T03:21:16.310389+0000","last_clean":"2024-09-21T03:21:16.310389+0000","last_became_active":"2024-09-21T03:21:14.308261+0000","last_became_peered":"2024-09-21T03:21:14.308261+0000","last_unstale":"2024-09-21T03:21:16.310389+0000","last_undegraded":"2024-09-21T03:21:16.310389+0000","last_fullsized":"2024-09-21T03:21:16.310389+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:37.431247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.307131+0000","last_change":"2024-09-21T03:21:15.319511+0000","last_active":"2024-09-21T03:21:16.307131+0000","last_peered":"2024-09-21T03:21:16.307131+0000","last_clean":"2024-09-21T03:21:16.307131+0000","last_became_active":"2024-09-21T03:21:15.318973+0000","last_became_peered":"2024-09-21T03:21:15.318973+0000","last_unstale":"2024-09-21T03:21:16.307131+0000","last_undegraded":"2024-09-21T03:21:16.307131+0000","last_fullsized":"2024-09-21T03:21:16.307131+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:00:03.521751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.399564+0000","last_change":"2024-09-21T03:21:14.305720+0000","last_active":"2024-09-21T03:21:16.399564+0000","last_peered":"2024-09-21T03:21:16.399564+0000","last_clean":"2024-09-21T03:21:16.399564+0000","last_became_active":"2024-09-21T03:21:14.305352+0000","last_became_peered":"2024-09-21T03:21:14.305352+0000","last_unstale":"2024-09-21T03:21:16.399564+0000","last_undegraded":"2024-09-21T03:21:16.399564+0000","last_fullsized":"2024-09-21T03:21:16.399564+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:25.129003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.314596+0000","last_change":"2024-09-21T03:21:15.312519+0000","last_active":"2024-09-21T03:21:15.314596+0000","last_peered":"2024-09-21T03:21:15.314596+0000","last_clean":"2024-09-21T03:21:15.314596+0000","last_became_active":"2024-09-21T03:21:15.312186+0000","last_became_peered":"2024-09-21T03:21:15.312186+0000","last_unstale":"2024-09-21T03:21:15.314596+0000","last_undegraded":"2024-09-21T03:21:15.314596+0000","last_fullsized":"2024-09-21T03:21:15.314596+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:48:45.076339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.307012+0000","last_change":"2024-09-21T03:21:14.308258+0000","last_active":"2024-09-21T03:21:16.307012+0000","last_peered":"2024-09-21T03:21:16.307012+0000","last_clean":"2024-09-21T03:21:16.307012+0000","last_became_active":"2024-09-21T03:21:14.307844+0000","last_became_peered":"2024-09-21T03:21:14.307844+0000","last_unstale":"2024-09-21T03:21:16.307012+0000","last_undegraded":"2024-09-21T03:21:16.307012+0000","last_fullsized":"2024-09-21T03:21:16.307012+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:00.193104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.167347+0000","last_change":"2024-09-21T03:21:15.320225+0000","last_active":"2024-09-21T03:21:17.167347+0000","last_peered":"2024-09-21T03:21:17.167347+0000","last_clean":"2024-09-21T03:21:17.167347+0000","last_became_active":"2024-09-21T03:21:15.319482+0000","last_became_peered":"2024-09-21T03:21:15.319482+0000","last_unstale":"2024-09-21T03:21:17.167347+0000","last_undegraded":"2024-09-21T03:21:17.167347+0000","last_fullsized":"2024-09-21T03:21:17.167347+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:12.846764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.309312+0000","last_change":"2024-09-21T03:21:14.306988+0000","last_active":"2024-09-21T03:21:16.309312+0000","last_peered":"2024-09-21T03:21:16.309312+0000","last_clean":"2024-09-21T03:21:16.309312+0000","last_became_active":"2024-09-21T03:21:14.306655+0000","last_became_peered":"2024-09-21T03:21:14.306655+0000","last_unstale":"2024-09-21T03:21:16.309312+0000","last_undegraded":"2024-09-21T03:21:16.309312+0000","last_fullsized":"2024-09-21T03:21:16.309312+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:15:03.203755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.167185+0000","last_change":"2024-09-21T03:21:15.312791+0000","last_active":"2024-09-21T03:21:17.167185+0000","last_peered":"2024-09-21T03:21:17.167185+0000","last_clean":"2024-09-21T03:21:17.167185+0000","last_became_active":"2024-09-21T03:21:15.312460+0000","last_became_peered":"2024-09-21T03:21:15.312460+0000","last_unstale":"2024-09-21T03:21:17.167185+0000","last_undegraded":"2024-09-21T03:21:17.167185+0000","last_fullsized":"2024-09-21T03:21:17.167185+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:14:47.854140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.311213+0000","last_change":"2024-09-21T03:21:14.307662+0000","last_active":"2024-09-21T03:21:16.311213+0000","last_peered":"2024-09-21T03:21:16.311213+0000","last_clean":"2024-09-21T03:21:16.311213+0000","last_became_active":"2024-09-21T03:21:14.307140+0000","last_became_peered":"2024-09-21T03:21:14.307140+0000","last_unstale":"2024-09-21T03:21:16.311213+0000","last_undegraded":"2024-09-21T03:21:16.311213+0000","last_fullsized":"2024-09-21T03:21:16.311213+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:19.281187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.311144+0000","last_change":"2024-09-21T03:21:15.308995+0000","last_active":"2024-09-21T03:21:16.311144+0000","last_peered":"2024-09-21T03:21:16.311144+0000","last_clean":"2024-09-21T03:21:16.311144+0000","last_became_active":"2024-09-21T03:21:15.308668+0000","last_became_peered":"2024-09-21T03:21:15.308668+0000","last_unstale":"2024-09-21T03:21:16.311144+0000","last_undegraded":"2024-09-21T03:21:16.311144+0000","last_fullsized":"2024-09-21T03:21:16.311144+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:37.268371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"68'3","reported_seq":18,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.722429+0000","last_change":"2024-09-21T03:21:14.307750+0000","last_active":"2024-09-21T03:21:16.722429+0000","last_peered":"2024-09-21T03:21:16.722429+0000","last_clean":"2024-09-21T03:21:16.722429+0000","last_became_active":"2024-09-21T03:21:14.307455+0000","last_became_peered":"2024-09-21T03:21:14.307455+0000","last_unstale":"2024-09-21T03:21:16.722429+0000","last_undegraded":"2024-09-21T03:21:16.722429+0000","last_fullsized":"2024-09-21T03:21:16.722429+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:23.915724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.307674+0000","last_change":"2024-09-21T03:21:15.314227+0000","last_active":"2024-09-21T03:21:16.307674+0000","last_peered":"2024-09-21T03:21:16.307674+0000","last_clean":"2024-09-21T03:21:16.307674+0000","last_became_active":"2024-09-21T03:21:15.313912+0000","last_became_peered":"2024-09-21T03:21:15.313912+0000","last_unstale":"2024-09-21T03:21:16.307674+0000","last_undegraded":"2024-09-21T03:21:16.307674+0000","last_fullsized":"2024-09-21T03:21:16.307674+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:41.642751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"68'6","reported_seq":21,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.400154+0000","last_change":"2024-09-21T03:21:14.310165+0000","last_active":"2024-09-21T03:21:16.400154+0000","last_peered":"2024-09-21T03:21:16.400154+0000","last_clean":"2024-09-21T03:21:16.400154+0000","last_became_active":"2024-09-21T03:21:14.309779+0000","last_became_peered":"2024-09-21T03:21:14.309779+0000","last_unstale":"2024-09-21T03:21:16.400154+0000","last_undegraded":"2024-09-21T03:21:16.400154+0000","last_fullsized":"2024-09-21T03:21:16.400154+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:01.617914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.166372+0000","last_change":"2024-09-21T03:21:15.318449+0000","last_active":"2024-09-21T03:21:17.166372+0000","last_peered":"2024-09-21T03:21:17.166372+0000","last_clean":"2024-09-21T03:21:17.166372+0000","last_became_active":"2024-09-21T03:21:15.317723+0000","last_became_peered":"2024-09-21T03:21:15.317723+0000","last_unstale":"2024-09-21T03:21:17.166372+0000","last_undegraded":"2024-09-21T03:21:17.166372+0000","last_fullsized":"2024-09-21T03:21:17.166372+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:30.871111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.399680+0000","last_change":"2024-09-21T03:21:14.301257+0000","last_active":"2024-09-21T03:21:16.399680+0000","last_peered":"2024-09-21T03:21:16.399680+0000","last_clean":"2024-09-21T03:21:16.399680+0000","last_became_active":"2024-09-21T03:21:14.300965+0000","last_became_peered":"2024-09-21T03:21:14.300965+0000","last_unstale":"2024-09-21T03:21:16.399680+0000","last_undegraded":"2024-09-21T03:21:16.399680+0000","last_fullsized":"2024-09-21T03:21:16.399680+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:18.893129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.167294+0000","last_change":"2024-09-21T03:21:15.322171+0000","last_active":"2024-09-21T03:21:17.167294+0000","last_peered":"2024-09-21T03:21:17.167294+0000","last_clean":"2024-09-21T03:21:17.167294+0000","last_became_active":"2024-09-21T03:21:15.321798+0000","last_became_peered":"2024-09-21T03:21:15.321798+0000","last_unstale":"2024-09-21T03:21:17.167294+0000","last_undegraded":"2024-09-21T03:21:17.167294+0000","last_fullsized":"2024-09-21T03:21:17.167294+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:46:00.029272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.310506+0000","last_change":"2024-09-21T03:21:14.311892+0000","last_active":"2024-09-21T03:21:16.310506+0000","last_peered":"2024-09-21T03:21:16.310506+0000","last_clean":"2024-09-21T03:21:16.310506+0000","last_became_active":"2024-09-21T03:21:14.311532+0000","last_became_peered":"2024-09-21T03:21:14.311532+0000","last_unstale":"2024-09-21T03:21:16.310506+0000","last_undegraded":"2024-09-21T03:21:16.310506+0000","last_fullsized":"2024-09-21T03:21:16.310506+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:44.487807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.322785+0000","last_change":"2024-09-21T03:21:15.320020+0000","last_active":"2024-09-21T03:21:15.322785+0000","last_peered":"2024-09-21T03:21:15.322785+0000","last_clean":"2024-09-21T03:21:15.322785+0000","last_became_active":"2024-09-21T03:21:15.319702+0000","last_became_peered":"2024-09-21T03:21:15.319702+0000","last_unstale":"2024-09-21T03:21:15.322785+0000","last_undegraded":"2024-09-21T03:21:15.322785+0000","last_fullsized":"2024-09-21T03:21:15.322785+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:28.854474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.166030+0000","last_change":"2024-09-21T03:21:14.311749+0000","last_active":"2024-09-21T03:21:17.166030+0000","last_peered":"2024-09-21T03:21:17.166030+0000","last_clean":"2024-09-21T03:21:17.166030+0000","last_became_active":"2024-09-21T03:21:14.311265+0000","last_became_peered":"2024-09-21T03:21:14.311265+0000","last_unstale":"2024-09-21T03:21:17.166030+0000","last_undegraded":"2024-09-21T03:21:17.166030+0000","last_fullsized":"2024-09-21T03:21:17.166030+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:37:25.980686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.307235+0000","last_change":"2024-09-21T03:21:15.313074+0000","last_active":"2024-09-21T03:21:16.307235+0000","last_peered":"2024-09-21T03:21:16.307235+0000","last_clean":"2024-09-21T03:21:16.307235+0000","last_became_active":"2024-09-21T03:21:15.312336+0000","last_became_peered":"2024-09-21T03:21:15.312336+0000","last_unstale":"2024-09-21T03:21:16.307235+0000","last_undegraded":"2024-09-21T03:21:16.307235+0000","last_fullsized":"2024-09-21T03:21:16.307235+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:05:26.201129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"68'8","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.308514+0000","last_change":"2024-09-21T03:21:14.309841+0000","last_active":"2024-09-21T03:21:16.308514+0000","last_peered":"2024-09-21T03:21:16.308514+0000","last_clean":"2024-09-21T03:21:16.308514+0000","last_became_active":"2024-09-21T03:21:14.309480+0000","last_became_peered":"2024-09-21T03:21:14.309480+0000","last_unstale":"2024-09-21T03:21:16.308514+0000","last_undegraded":"2024-09-21T03:21:16.308514+0000","last_fullsized":"2024-09-21T03:21:16.308514+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:48:53.863006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.308900+0000","last_change":"2024-09-21T03:21:15.316087+0000","last_active":"2024-09-21T03:21:16.308900+0000","last_peered":"2024-09-21T03:21:16.308900+0000","last_clean":"2024-09-21T03:21:16.308900+0000","last_became_active":"2024-09-21T03:21:15.315599+0000","last_became_peered":"2024-09-21T03:21:15.315599+0000","last_unstale":"2024-09-21T03:21:16.308900+0000","last_undegraded":"2024-09-21T03:21:16.308900+0000","last_fullsized":"2024-09-21T03:21:16.308900+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:37:26.982982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.311114+0000","last_change":"2024-09-21T03:21:14.305910+0000","last_active":"2024-09-21T03:21:16.311114+0000","last_peered":"2024-09-21T03:21:16.311114+0000","last_clean":"2024-09-21T03:21:16.311114+0000","last_became_active":"2024-09-21T03:21:14.305522+0000","last_became_peered":"2024-09-21T03:21:14.305522+0000","last_unstale":"2024-09-21T03:21:16.311114+0000","last_undegraded":"2024-09-21T03:21:16.311114+0000","last_fullsized":"2024-09-21T03:21:16.311114+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:28.421620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.167422+0000","last_change":"2024-09-21T03:21:15.305932+0000","last_active":"2024-09-21T03:21:17.167422+0000","last_peered":"2024-09-21T03:21:17.167422+0000","last_clean":"2024-09-21T03:21:17.167422+0000","last_became_active":"2024-09-21T03:21:15.305574+0000","last_became_peered":"2024-09-21T03:21:15.305574+0000","last_unstale":"2024-09-21T03:21:17.167422+0000","last_undegraded":"2024-09-21T03:21:17.167422+0000","last_fullsized":"2024-09-21T03:21:17.167422+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:16.755132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.308974+0000","last_change":"2024-09-21T03:21:14.306361+0000","last_active":"2024-09-21T03:21:16.308974+0000","last_peered":"2024-09-21T03:21:16.308974+0000","last_clean":"2024-09-21T03:21:16.308974+0000","last_became_active":"2024-09-21T03:21:14.306029+0000","last_became_peered":"2024-09-21T03:21:14.306029+0000","last_unstale":"2024-09-21T03:21:16.308974+0000","last_undegraded":"2024-09-21T03:21:16.308974+0000","last_fullsized":"2024-09-21T03:21:16.308974+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:22:11.489428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.400112+0000","last_change":"2024-09-21T03:21:15.315315+0000","last_active":"2024-09-21T03:21:16.400112+0000","last_peered":"2024-09-21T03:21:16.400112+0000","last_clean":"2024-09-21T03:21:16.400112+0000","last_became_active":"2024-09-21T03:21:15.315006+0000","last_became_peered":"2024-09-21T03:21:15.315006+0000","last_unstale":"2024-09-21T03:21:16.400112+0000","last_undegraded":"2024-09-21T03:21:16.400112+0000","last_fullsized":"2024-09-21T03:21:16.400112+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:45:29.877124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.310973+0000","last_change":"2024-09-21T03:21:14.306418+0000","last_active":"2024-09-21T03:21:16.310973+0000","last_peered":"2024-09-21T03:21:16.310973+0000","last_clean":"2024-09-21T03:21:16.310973+0000","last_became_active":"2024-09-21T03:21:14.306091+0000","last_became_peered":"2024-09-21T03:21:14.306091+0000","last_unstale":"2024-09-21T03:21:16.310973+0000","last_undegraded":"2024-09-21T03:21:16.310973+0000","last_fullsized":"2024-09-21T03:21:16.310973+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:18.893129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.307761+0000","last_change":"2024-09-21T03:21:15.315351+0000","last_active":"2024-09-21T03:21:16.307761+0000","last_peered":"2024-09-21T03:21:16.307761+0000","last_clean":"2024-09-21T03:21:16.307761+0000","last_became_active":"2024-09-21T03:21:15.315064+0000","last_became_peered":"2024-09-21T03:21:15.315064+0000","last_unstale":"2024-09-21T03:21:16.307761+0000","last_undegraded":"2024-09-21T03:21:16.307761+0000","last_fullsized":"2024-09-21T03:21:16.307761+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:06:41.260202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.167030+0000","last_change":"2024-09-21T03:21:14.313985+0000","last_active":"2024-09-21T03:21:17.167030+0000","last_peered":"2024-09-21T03:21:17.167030+0000","last_clean":"2024-09-21T03:21:17.167030+0000","last_became_active":"2024-09-21T03:21:14.313675+0000","last_became_peered":"2024-09-21T03:21:14.313675+0000","last_unstale":"2024-09-21T03:21:17.167030+0000","last_undegraded":"2024-09-21T03:21:17.167030+0000","last_fullsized":"2024-09-21T03:21:17.167030+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:40:57.535844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.722460+0000","last_change":"2024-09-21T03:21:15.309772+0000","last_active":"2024-09-21T03:21:16.722460+0000","last_peered":"2024-09-21T03:21:16.722460+0000","last_clean":"2024-09-21T03:21:16.722460+0000","last_became_active":"2024-09-21T03:21:15.309298+0000","last_became_peered":"2024-09-21T03:21:15.309298+0000","last_unstale":"2024-09-21T03:21:16.722460+0000","last_undegraded":"2024-09-21T03:21:16.722460+0000","last_fullsized":"2024-09-21T03:21:16.722460+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:38.847194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.310538+0000","last_change":"2024-09-21T03:21:14.308273+0000","last_active":"2024-09-21T03:21:16.310538+0000","last_peered":"2024-09-21T03:21:16.310538+0000","last_clean":"2024-09-21T03:21:16.310538+0000","last_became_active":"2024-09-21T03:21:14.307628+0000","last_became_peered":"2024-09-21T03:21:14.307628+0000","last_unstale":"2024-09-21T03:21:16.310538+0000","last_undegraded":"2024-09-21T03:21:16.310538+0000","last_fullsized":"2024-09-21T03:21:16.310538+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:35.231348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.722311+0000","last_change":"2024-09-21T03:21:15.324718+0000","last_active":"2024-09-21T03:21:16.722311+0000","last_peered":"2024-09-21T03:21:16.722311+0000","last_clean":"2024-09-21T03:21:16.722311+0000","last_became_active":"2024-09-21T03:21:15.324381+0000","last_became_peered":"2024-09-21T03:21:15.324381+0000","last_unstale":"2024-09-21T03:21:16.722311+0000","last_undegraded":"2024-09-21T03:21:16.722311+0000","last_fullsized":"2024-09-21T03:21:16.722311+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:45:56.711809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.166197+0000","last_change":"2024-09-21T03:21:14.313776+0000","last_active":"2024-09-21T03:21:17.166197+0000","last_peered":"2024-09-21T03:21:17.166197+0000","last_clean":"2024-09-21T03:21:17.166197+0000","last_became_active":"2024-09-21T03:21:14.313466+0000","last_became_peered":"2024-09-21T03:21:14.313466+0000","last_unstale":"2024-09-21T03:21:17.166197+0000","last_undegraded":"2024-09-21T03:21:17.166197+0000","last_fullsized":"2024-09-21T03:21:17.166197+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:03.601810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.722541+0000","last_change":"2024-09-21T03:21:15.324726+0000","last_active":"2024-09-21T03:21:16.722541+0000","last_peered":"2024-09-21T03:21:16.722541+0000","last_clean":"2024-09-21T03:21:16.722541+0000","last_became_active":"2024-09-21T03:21:15.324425+0000","last_became_peered":"2024-09-21T03:21:15.324425+0000","last_unstale":"2024-09-21T03:21:16.722541+0000","last_undegraded":"2024-09-21T03:21:16.722541+0000","last_fullsized":"2024-09-21T03:21:16.722541+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:42:41.779875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.303159+0000","last_change":"2024-09-21T03:21:14.310881+0000","last_active":"2024-09-21T03:21:15.303159+0000","last_peered":"2024-09-21T03:21:15.303159+0000","last_clean":"2024-09-21T03:21:15.303159+0000","last_became_active":"2024-09-21T03:21:14.309420+0000","last_became_peered":"2024-09-21T03:21:14.309420+0000","last_unstale":"2024-09-21T03:21:15.303159+0000","last_undegraded":"2024-09-21T03:21:15.303159+0000","last_fullsized":"2024-09-21T03:21:15.303159+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:31.033897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.315502+0000","last_change":"2024-09-21T03:21:15.314776+0000","last_active":"2024-09-21T03:21:15.315502+0000","last_peered":"2024-09-21T03:21:15.315502+0000","last_clean":"2024-09-21T03:21:15.315502+0000","last_became_active":"2024-09-21T03:21:15.314469+0000","last_became_peered":"2024-09-21T03:21:15.314469+0000","last_unstale":"2024-09-21T03:21:15.315502+0000","last_undegraded":"2024-09-21T03:21:15.315502+0000","last_fullsized":"2024-09-21T03:21:15.315502+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:02:54.407198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.311237+0000","last_change":"2024-09-21T03:21:14.305876+0000","last_active":"2024-09-21T03:21:16.311237+0000","last_peered":"2024-09-21T03:21:16.311237+0000","last_clean":"2024-09-21T03:21:16.311237+0000","last_became_active":"2024-09-21T03:21:14.305117+0000","last_became_peered":"2024-09-21T03:21:14.305117+0000","last_unstale":"2024-09-21T03:21:16.311237+0000","last_undegraded":"2024-09-21T03:21:16.311237+0000","last_fullsized":"2024-09-21T03:21:16.311237+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:51.066086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.167056+0000","last_change":"2024-09-21T03:21:15.311807+0000","last_active":"2024-09-21T03:21:17.167056+0000","last_peered":"2024-09-21T03:21:17.167056+0000","last_clean":"2024-09-21T03:21:17.167056+0000","last_became_active":"2024-09-21T03:21:15.311514+0000","last_became_peered":"2024-09-21T03:21:15.311514+0000","last_unstale":"2024-09-21T03:21:17.167056+0000","last_undegraded":"2024-09-21T03:21:17.167056+0000","last_fullsized":"2024-09-21T03:21:17.167056+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:53.355254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"69'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.167435+0000","last_change":"2024-09-21T03:21:14.312343+0000","last_active":"2024-09-21T03:21:17.167435+0000","last_peered":"2024-09-21T03:21:17.167435+0000","last_clean":"2024-09-21T03:21:17.167435+0000","last_became_active":"2024-09-21T03:21:14.311770+0000","last_became_peered":"2024-09-21T03:21:14.311770+0000","last_unstale":"2024-09-21T03:21:17.167435+0000","last_undegraded":"2024-09-21T03:21:17.167435+0000","last_fullsized":"2024-09-21T03:21:17.167435+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:45.230250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.167028+0000","last_change":"2024-09-21T03:21:15.318749+0000","last_active":"2024-09-21T03:21:17.167028+0000","last_peered":"2024-09-21T03:21:17.167028+0000","last_clean":"2024-09-21T03:21:17.167028+0000","last_became_active":"2024-09-21T03:21:15.317143+0000","last_became_peered":"2024-09-21T03:21:15.317143+0000","last_unstale":"2024-09-21T03:21:17.167028+0000","last_undegraded":"2024-09-21T03:21:17.167028+0000","last_fullsized":"2024-09-21T03:21:17.167028+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:06.427337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.307736+0000","last_change":"2024-09-21T03:21:14.311463+0000","last_active":"2024-09-21T03:21:16.307736+0000","last_peered":"2024-09-21T03:21:16.307736+0000","last_clean":"2024-09-21T03:21:16.307736+0000","last_became_active":"2024-09-21T03:21:14.311132+0000","last_became_peered":"2024-09-21T03:21:14.311132+0000","last_unstale":"2024-09-21T03:21:16.307736+0000","last_undegraded":"2024-09-21T03:21:16.307736+0000","last_fullsized":"2024-09-21T03:21:16.307736+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:11.597949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.167001+0000","last_change":"2024-09-21T03:21:15.318032+0000","last_active":"2024-09-21T03:21:17.167001+0000","last_peered":"2024-09-21T03:21:17.167001+0000","last_clean":"2024-09-21T03:21:17.167001+0000","last_became_active":"2024-09-21T03:21:15.317595+0000","last_became_peered":"2024-09-21T03:21:15.317595+0000","last_unstale":"2024-09-21T03:21:17.167001+0000","last_undegraded":"2024-09-21T03:21:17.167001+0000","last_fullsized":"2024-09-21T03:21:17.167001+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:40.974910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-21T03:21:15.301724+0000","last_change":"2024-09-21T03:21:14.306171+0000","last_active":"2024-09-21T03:21:15.301724+0000","last_peered":"2024-09-21T03:21:15.301724+0000","last_clean":"2024-09-21T03:21:15.301724+0000","last_became_active":"2024-09-21T03:21:14.305871+0000","last_became_peered":"2024-09-21T03:21:14.305871+0000","last_unstale":"2024-09-21T03:21:15.301724+0000","last_undegraded":"2024-09-21T03:21:15.301724+0000","last_fullsized":"2024-09-21T03:21:15.301724+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:48.590153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.307392+0000","last_change":"2024-09-21T03:21:15.315466+0000","last_active":"2024-09-21T03:21:16.307392+0000","last_peered":"2024-09-21T03:21:16.307392+0000","last_clean":"2024-09-21T03:21:16.307392+0000","last_became_active":"2024-09-21T03:21:15.314857+0000","last_became_peered":"2024-09-21T03:21:15.314857+0000","last_unstale":"2024-09-21T03:21:16.307392+0000","last_undegraded":"2024-09-21T03:21:16.307392+0000","last_fullsized":"2024-09-21T03:21:16.307392+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:13.112947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.307318+0000","last_change":"2024-09-21T03:21:14.309623+0000","last_active":"2024-09-21T03:21:16.307318+0000","last_peered":"2024-09-21T03:21:16.307318+0000","last_clean":"2024-09-21T03:21:16.307318+0000","last_became_active":"2024-09-21T03:21:14.309181+0000","last_became_peered":"2024-09-21T03:21:14.309181+0000","last_unstale":"2024-09-21T03:21:16.307318+0000","last_undegraded":"2024-09-21T03:21:16.307318+0000","last_fullsized":"2024-09-21T03:21:16.307318+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:06:07.533892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.310985+0000","last_change":"2024-09-21T03:21:15.309991+0000","last_active":"2024-09-21T03:21:16.310985+0000","last_peered":"2024-09-21T03:21:16.310985+0000","last_clean":"2024-09-21T03:21:16.310985+0000","last_became_active":"2024-09-21T03:21:15.309684+0000","last_became_peered":"2024-09-21T03:21:15.309684+0000","last_unstale":"2024-09-21T03:21:16.310985+0000","last_undegraded":"2024-09-21T03:21:16.310985+0000","last_fullsized":"2024-09-21T03:21:16.310985+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:50.223934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.399564+0000","last_change":"2024-09-21T03:21:14.305668+0000","last_active":"2024-09-21T03:21:16.399564+0000","last_peered":"2024-09-21T03:21:16.399564+0000","last_clean":"2024-09-21T03:21:16.399564+0000","last_became_active":"2024-09-21T03:21:14.305355+0000","last_became_peered":"2024-09-21T03:21:14.305355+0000","last_unstale":"2024-09-21T03:21:16.399564+0000","last_undegraded":"2024-09-21T03:21:16.399564+0000","last_fullsized":"2024-09-21T03:21:16.399564+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:19.281187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.399764+0000","last_change":"2024-09-21T03:21:15.311512+0000","last_active":"2024-09-21T03:21:16.399764+0000","last_peered":"2024-09-21T03:21:16.399764+0000","last_clean":"2024-09-21T03:21:16.399764+0000","last_became_active":"2024-09-21T03:21:15.311225+0000","last_became_peered":"2024-09-21T03:21:15.311225+0000","last_unstale":"2024-09-21T03:21:16.399764+0000","last_undegraded":"2024-09-21T03:21:16.399764+0000","last_fullsized":"2024-09-21T03:21:16.399764+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:36:45.515063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.308382+0000","last_change":"2024-09-21T03:21:14.304784+0000","last_active":"2024-09-21T03:21:16.308382+0000","last_peered":"2024-09-21T03:21:16.308382+0000","last_clean":"2024-09-21T03:21:16.308382+0000","last_became_active":"2024-09-21T03:21:14.303804+0000","last_became_peered":"2024-09-21T03:21:14.303804+0000","last_unstale":"2024-09-21T03:21:16.308382+0000","last_undegraded":"2024-09-21T03:21:16.308382+0000","last_fullsized":"2024-09-21T03:21:16.308382+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:21.818166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.310196+0000","last_change":"2024-09-21T03:21:15.316164+0000","last_active":"2024-09-21T03:21:16.310196+0000","last_peered":"2024-09-21T03:21:16.310196+0000","last_clean":"2024-09-21T03:21:16.310196+0000","last_became_active":"2024-09-21T03:21:15.315685+0000","last_became_peered":"2024-09-21T03:21:15.315685+0000","last_unstale":"2024-09-21T03:21:16.310196+0000","last_undegraded":"2024-09-21T03:21:16.310196+0000","last_fullsized":"2024-09-21T03:21:16.310196+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:22.527887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.310020+0000","last_change":"2024-09-21T03:21:14.309526+0000","last_active":"2024-09-21T03:21:16.310020+0000","last_peered":"2024-09-21T03:21:16.310020+0000","last_clean":"2024-09-21T03:21:16.310020+0000","last_became_active":"2024-09-21T03:21:14.309202+0000","last_became_peered":"2024-09-21T03:21:14.309202+0000","last_unstale":"2024-09-21T03:21:16.310020+0000","last_undegraded":"2024-09-21T03:21:16.310020+0000","last_fullsized":"2024-09-21T03:21:16.310020+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:01.617914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.722484+0000","last_change":"2024-09-21T03:21:15.325101+0000","last_active":"2024-09-21T03:21:16.722484+0000","last_peered":"2024-09-21T03:21:16.722484+0000","last_clean":"2024-09-21T03:21:16.722484+0000","last_became_active":"2024-09-21T03:21:15.324796+0000","last_became_peered":"2024-09-21T03:21:15.324796+0000","last_unstale":"2024-09-21T03:21:16.722484+0000","last_undegraded":"2024-09-21T03:21:16.722484+0000","last_fullsized":"2024-09-21T03:21:16.722484+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:14.283562+0000","last_clean_scrub_stamp":"2024-09-21T03:21:14.283562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:15:32.907203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:16.310691+0000","last_change":"2024-09-21T03:21:14.307393+0000","last_active":"2024-09-21T03:21:16.310691+0000","last_peered":"2024-09-21T03:21:16.310691+0000","last_clean":"2024-09-21T03:21:16.310691+0000","last_became_active":"2024-09-21T03:21:14.307069+0000","last_became_peered":"2024-09-21T03:21:14.307069+0000","last_unstale":"2024-09-21T03:21:16.310691+0000","last_undegraded":"2024-09-21T03:21:16.310691+0000","last_fullsized":"2024-09-21T03:21:16.310691+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:13.281266+0000","last_clean_scrub_stamp":"2024-09-21T03:21:13.281266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:44:30.666667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":197,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-21T03:21:17.166187+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:21:17.166187+0000","last_peered":"2024-09-21T03:21:17.166187+0000","last_clean":"2024-09-21T03:21:17.166187+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:21:17.166187+0000","last_undegraded":"2024-09-21T03:21:17.166187+0000","last_fullsized":"2024-09-21T03:21:17.166187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509481,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28432,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343408,"statfs":{"total":96636764160,"available":96607649792,"internally_reserved":0,"allocated":1433600,"data_stored":935625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509480,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":839680,"data_stored":344733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509479,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":835584,"data_stored":344731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509479,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":835584,"data_stored":344711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509480,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":839680,"data_stored":344753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509480,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":843776,"data_stored":346253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509480,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":851968,"data_stored":346869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1413120,"data_stored":928709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:21:23.123 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T03:21:23.124 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T03:21:23.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.276+0000 7f3593fc6640 1 -- 172.21.15.105:0/2460187375 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f358c0cfeb0 msgr2=0x7f358c0d02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:23.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.276+0000 7f3593fc6640 1 --2- 172.21.15.105:0/2460187375 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f358c0cfeb0 0x7f358c0d02c0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f3584005fd0 tx=0x7f358402aa00 comp rx=0 tx=0).stop 2024-09-21T03:21:23.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.276+0000 7f3593fc6640 1 -- 172.21.15.105:0/2460187375 shutdown_connections 2024-09-21T03:21:23.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.276+0000 7f3593fc6640 1 --2- 172.21.15.105:0/2460187375 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f358c0cfeb0 0x7f358c0d02c0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:23.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.276+0000 7f3593fc6640 1 --2- 172.21.15.105:0/2460187375 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f358c0b4090 0x7f358c0b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:23.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.276+0000 7f3593fc6640 1 -- 172.21.15.105:0/2460187375 >> 172.21.15.105:0/2460187375 conn(0x7f358c0cdcc0 msgr2=0x7f358c0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:23.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.276+0000 7f3593fc6640 1 -- 172.21.15.105:0/2460187375 shutdown_connections 2024-09-21T03:21:23.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.276+0000 7f3593fc6640 1 -- 172.21.15.105:0/2460187375 wait complete. 2024-09-21T03:21:23.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.278+0000 7f3593fc6640 1 Processor -- start 2024-09-21T03:21:23.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.278+0000 7f3593fc6640 1 -- start start 2024-09-21T03:21:23.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.279+0000 7f3593fc6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f358c06fec0 0x7f358c1f9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:23.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.279+0000 7f3593fc6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f358c0b4090 0x7f358c09c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:23.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.279+0000 7f3593fc6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f358c0cfeb0 0x7f358c15d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:23.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.279+0000 7f3593fc6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f358c0b4a30 con 0x7f358c0b4090 2024-09-21T03:21:23.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.279+0000 7f3593fc6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f358c0b48b0 con 0x7f358c06fec0 2024-09-21T03:21:23.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.279+0000 7f3593fc6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f358c0b4bb0 con 0x7f358c0cfeb0 2024-09-21T03:21:23.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.280+0000 7f3591561640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f358c0b4090 0x7f358c09c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:23.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.280+0000 7f3591561640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f358c0b4090 0x7f358c09c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58086/0 (socket says 172.21.15.105:58086) 2024-09-21T03:21:23.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.280+0000 7f3591561640 1 -- 172.21.15.105:0/2318775901 learned_addr learned my addr 172.21.15.105:0/2318775901 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:23.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.280+0000 7f3591561640 1 -- 172.21.15.105:0/2318775901 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f358c0cfeb0 msgr2=0x7f358c15d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:23.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.280+0000 7f3592563640 1 --2- 172.21.15.105:0/2318775901 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f358c0cfeb0 0x7f358c15d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:23.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.280+0000 7f3591d62640 1 --2- 172.21.15.105:0/2318775901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f358c06fec0 0x7f358c1f9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:23.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.280+0000 7f3591561640 1 --2- 172.21.15.105:0/2318775901 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f358c0cfeb0 0x7f358c15d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:23.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.280+0000 7f3591561640 1 -- 172.21.15.105:0/2318775901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f358c06fec0 msgr2=0x7f358c1f9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:23.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.280+0000 7f3591561640 1 --2- 172.21.15.105:0/2318775901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f358c06fec0 0x7f358c1f9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:23.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.280+0000 7f3591561640 1 -- 172.21.15.105:0/2318775901 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f358c1f5a80 con 0x7f358c0b4090 2024-09-21T03:21:23.288 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.280+0000 7f3591561640 1 --2- 172.21.15.105:0/2318775901 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f358c0b4090 0x7f358c09c350 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f357c00b3c0 tx=0x7f357c00b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:23.288 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.280+0000 7f35827fc640 1 -- 172.21.15.105:0/2318775901 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f357c011830 con 0x7f358c0b4090 2024-09-21T03:21:23.288 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.280+0000 7f35827fc640 1 -- 172.21.15.105:0/2318775901 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f357c016070 con 0x7f358c0b4090 2024-09-21T03:21:23.288 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.280+0000 7f3593fc6640 1 -- 172.21.15.105:0/2318775901 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f358c1f5d60 con 0x7f358c0b4090 2024-09-21T03:21:23.288 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.280+0000 7f35827fc640 1 -- 172.21.15.105:0/2318775901 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f357c011d40 con 0x7f358c0b4090 2024-09-21T03:21:23.288 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.280+0000 7f3593fc6640 1 -- 172.21.15.105:0/2318775901 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f358c1f6320 con 0x7f358c0b4090 2024-09-21T03:21:23.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.281+0000 7f3593fc6640 1 -- 172.21.15.105:0/2318775901 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f358c0b5060 con 0x7f358c0b4090 2024-09-21T03:21:23.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.282+0000 7f35827fc640 1 -- 172.21.15.105:0/2318775901 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f357c01b460 con 0x7f358c0b4090 2024-09-21T03:21:23.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.282+0000 7f35827fc640 1 --2- 172.21.15.105:0/2318775901 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3570078b90 0x7f357007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:23.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.282+0000 7f35827fc640 1 -- 172.21.15.105:0/2318775901 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f357c09a9d0 con 0x7f358c0b4090 2024-09-21T03:21:23.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.283+0000 7f3591d62640 1 --2- 172.21.15.105:0/2318775901 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3570078b90 0x7f357007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:23.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.283+0000 7f3591d62640 1 --2- 172.21.15.105:0/2318775901 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3570078b90 0x7f357007b0a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3588005fd0 tx=0x7f3588005bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:23.290 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.287+0000 7f35827fc640 1 -- 172.21.15.105:0/2318775901 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f357c062ea0 con 0x7f358c0b4090 2024-09-21T03:21:23.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.536+0000 7f3593fc6640 1 -- 172.21.15.105:0/2318775901 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f358c050ff0 con 0x7f358c0b4090 2024-09-21T03:21:23.542 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.541+0000 7f35827fc640 1 -- 172.21.15.105:0/2318775901 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7f357c0627a0 con 0x7f358c0b4090 2024-09-21T03:21:23.543 INFO:teuthology.orchestra.run.smithi105.stdout:[client.0] 2024-09-21T03:21:23.543 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQDIOu5mughoJxAAhY0bzJmq+oNyzCdtafkC9w== 2024-09-21T03:21:23.543 INFO:teuthology.orchestra.run.smithi105.stdout: caps mds = "allow" 2024-09-21T03:21:23.543 INFO:teuthology.orchestra.run.smithi105.stdout: caps mon = "allow r" 2024-09-21T03:21:23.543 INFO:teuthology.orchestra.run.smithi105.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T03:21:23.543 INFO:teuthology.orchestra.run.smithi105.stderr:updated caps for client.0 2024-09-21T03:21:23.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.543+0000 7f3593fc6640 1 -- 172.21.15.105:0/2318775901 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3570078b90 msgr2=0x7f357007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:23.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.543+0000 7f3593fc6640 1 --2- 172.21.15.105:0/2318775901 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3570078b90 0x7f357007b0a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3588005fd0 tx=0x7f3588005bc0 comp rx=0 tx=0).stop 2024-09-21T03:21:23.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.543+0000 7f3593fc6640 1 -- 172.21.15.105:0/2318775901 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f358c0b4090 msgr2=0x7f358c09c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:23.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.543+0000 7f3593fc6640 1 --2- 172.21.15.105:0/2318775901 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f358c0b4090 0x7f358c09c350 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f357c00b3c0 tx=0x7f357c00b880 comp rx=0 tx=0).stop 2024-09-21T03:21:23.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.543+0000 7f3593fc6640 1 -- 172.21.15.105:0/2318775901 shutdown_connections 2024-09-21T03:21:23.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.543+0000 7f3593fc6640 1 --2- 172.21.15.105:0/2318775901 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3570078b90 0x7f357007b0a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:23.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.543+0000 7f3593fc6640 1 --2- 172.21.15.105:0/2318775901 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f358c0cfeb0 0x7f358c15d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:23.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.543+0000 7f3593fc6640 1 --2- 172.21.15.105:0/2318775901 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f358c0b4090 0x7f358c09c350 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:23.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.543+0000 7f3593fc6640 1 --2- 172.21.15.105:0/2318775901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f358c06fec0 0x7f358c1f9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:23.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.543+0000 7f3593fc6640 1 -- 172.21.15.105:0/2318775901 >> 172.21.15.105:0/2318775901 conn(0x7f358c0cdcc0 msgr2=0x7f358c0ae3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:23.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.544+0000 7f3593fc6640 1 -- 172.21.15.105:0/2318775901 shutdown_connections 2024-09-21T03:21:23.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.544+0000 7f3593fc6640 1 -- 172.21.15.105:0/2318775901 wait complete. 2024-09-21T03:21:23.556 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:21:23.668 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.666+0000 7f409027e640 1 -- 172.21.15.105:0/2951532000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40880b0520 msgr2=0x7f4088071650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:23.669 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.666+0000 7f409027e640 1 --2- 172.21.15.105:0/2951532000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40880b0520 0x7f4088071650 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f407c009830 tx=0x7f407c02a510 comp rx=0 tx=0).stop 2024-09-21T03:21:23.669 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.667+0000 7f409027e640 1 -- 172.21.15.105:0/2951532000 shutdown_connections 2024-09-21T03:21:23.669 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.667+0000 7f409027e640 1 --2- 172.21.15.105:0/2951532000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40880b0520 0x7f4088071650 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:23.669 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.667+0000 7f409027e640 1 --2- 172.21.15.105:0/2951532000 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f408815b8f0 0x7f40880cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:23.669 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.667+0000 7f409027e640 1 -- 172.21.15.105:0/2951532000 >> 172.21.15.105:0/2951532000 conn(0x7f40880cdcb0 msgr2=0x7f40880ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:23.669 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.667+0000 7f409027e640 1 -- 172.21.15.105:0/2951532000 shutdown_connections 2024-09-21T03:21:23.669 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.667+0000 7f409027e640 1 -- 172.21.15.105:0/2951532000 wait complete. 2024-09-21T03:21:23.670 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.668+0000 7f409027e640 1 Processor -- start 2024-09-21T03:21:23.670 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.668+0000 7f409027e640 1 -- start start 2024-09-21T03:21:23.674 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.670+0000 7f409027e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f40880b0520 0x7f40881e0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:23.674 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.670+0000 7f409027e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40880b2cb0 0x7f408806cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:23.674 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.670+0000 7f409027e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f408815b8f0 0x7f408814f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:23.674 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.670+0000 7f409027e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f40880ae330 con 0x7f40880b2cb0 2024-09-21T03:21:23.674 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.670+0000 7f409027e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f40880ae1b0 con 0x7f408815b8f0 2024-09-21T03:21:23.674 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.670+0000 7f409027e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f40880ae4b0 con 0x7f40880b0520 2024-09-21T03:21:23.674 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.670+0000 7f408d819640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40880b2cb0 0x7f408806cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:23.675 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.670+0000 7f408d819640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40880b2cb0 0x7f408806cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58090/0 (socket says 172.21.15.105:58090) 2024-09-21T03:21:23.675 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.670+0000 7f408d819640 1 -- 172.21.15.105:0/3306509685 learned_addr learned my addr 172.21.15.105:0/3306509685 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:23.675 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.670+0000 7f408e01a640 1 --2- 172.21.15.105:0/3306509685 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f40880b0520 0x7f40881e0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:23.675 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.670+0000 7f408e81b640 1 --2- 172.21.15.105:0/3306509685 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f408815b8f0 0x7f408814f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:23.675 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.670+0000 7f408d819640 1 -- 172.21.15.105:0/3306509685 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f40880b0520 msgr2=0x7f40881e0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:23.675 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.670+0000 7f408d819640 1 --2- 172.21.15.105:0/3306509685 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f40880b0520 0x7f40881e0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:23.675 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.670+0000 7f408d819640 1 -- 172.21.15.105:0/3306509685 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f408815b8f0 msgr2=0x7f408814f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:23.675 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.670+0000 7f408d819640 1 --2- 172.21.15.105:0/3306509685 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f408815b8f0 0x7f408814f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:23.675 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.670+0000 7f408d819640 1 -- 172.21.15.105:0/3306509685 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4088152fb0 con 0x7f40880b2cb0 2024-09-21T03:21:23.675 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.670+0000 7f408d819640 1 --2- 172.21.15.105:0/3306509685 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40880b2cb0 0x7f408806cfc0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f407c000c00 tx=0x7f407c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:23.675 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.670+0000 7f4086ffd640 1 -- 172.21.15.105:0/3306509685 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407c005c90 con 0x7f40880b2cb0 2024-09-21T03:21:23.675 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.670+0000 7f4086ffd640 1 -- 172.21.15.105:0/3306509685 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f407c005310 con 0x7f40880b2cb0 2024-09-21T03:21:23.675 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.670+0000 7f4086ffd640 1 -- 172.21.15.105:0/3306509685 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407c0047a0 con 0x7f40880b2cb0 2024-09-21T03:21:23.676 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.671+0000 7f409027e640 1 -- 172.21.15.105:0/3306509685 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40881521f0 con 0x7f40880b2cb0 2024-09-21T03:21:23.676 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.671+0000 7f409027e640 1 -- 172.21.15.105:0/3306509685 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40881527b0 con 0x7f40880b2cb0 2024-09-21T03:21:23.676 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.672+0000 7f409027e640 1 -- 172.21.15.105:0/3306509685 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4088071650 con 0x7f40880b2cb0 2024-09-21T03:21:23.676 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.672+0000 7f4086ffd640 1 -- 172.21.15.105:0/3306509685 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f407c004b50 con 0x7f40880b2cb0 2024-09-21T03:21:23.676 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.673+0000 7f4086ffd640 1 --2- 172.21.15.105:0/3306509685 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4074078b90 0x7f407407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:23.676 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.673+0000 7f4086ffd640 1 -- 172.21.15.105:0/3306509685 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f407c0bc250 con 0x7f40880b2cb0 2024-09-21T03:21:23.676 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.673+0000 7f408e01a640 1 --2- 172.21.15.105:0/3306509685 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4074078b90 0x7f407407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:23.676 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.674+0000 7f408e01a640 1 --2- 172.21.15.105:0/3306509685 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4074078b90 0x7f407407b0a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f40780095f0 tx=0x7f4078005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:23.679 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.677+0000 7f4086ffd640 1 -- 172.21.15.105:0/3306509685 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f407c03f030 con 0x7f40880b2cb0 2024-09-21T03:21:23.889 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.887+0000 7f409027e640 1 -- 172.21.15.105:0/3306509685 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f40880cd710 con 0x7f40880b2cb0 2024-09-21T03:21:23.889 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.888+0000 7f4086ffd640 1 -- 172.21.15.105:0/3306509685 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5234 (secure 0 0 0) 0x7f407c031e20 con 0x7f40880b2cb0 2024-09-21T03:21:23.889 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:23.889 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":38,"btime":"2024-09-21T03:21:17:305276+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5593,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2041248590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2041248590},{"type":"v1","addr":"172.21.15.162:6836","nonce":2041248590}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5596,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/775014606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":775014606},{"type":"v1","addr":"172.21.15.162:6837","nonce":775014606}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5937,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3799275472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3799275472},{"type":"v1","addr":"172.21.15.105:6833","nonce":3799275472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:21:14.660239+0000","modified":"2024-09-21T03:21:16.660264+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5940},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5940":{"gid":5940,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1561028223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1561028223},{"type":"v1","addr":"172.21.15.105:6835","nonce":1561028223}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5940,"qdb_cluster":[5940]},"id":5}]} 2024-09-21T03:21:23.890 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 38 2024-09-21T03:21:23.891 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.890+0000 7f409027e640 1 -- 172.21.15.105:0/3306509685 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4074078b90 msgr2=0x7f407407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:23.891 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.890+0000 7f409027e640 1 --2- 172.21.15.105:0/3306509685 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4074078b90 0x7f407407b0a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f40780095f0 tx=0x7f4078005f90 comp rx=0 tx=0).stop 2024-09-21T03:21:23.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.890+0000 7f409027e640 1 -- 172.21.15.105:0/3306509685 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40880b2cb0 msgr2=0x7f408806cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:23.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.890+0000 7f409027e640 1 --2- 172.21.15.105:0/3306509685 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40880b2cb0 0x7f408806cfc0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f407c000c00 tx=0x7f407c004270 comp rx=0 tx=0).stop 2024-09-21T03:21:23.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.890+0000 7f409027e640 1 -- 172.21.15.105:0/3306509685 shutdown_connections 2024-09-21T03:21:23.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.890+0000 7f409027e640 1 --2- 172.21.15.105:0/3306509685 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4074078b90 0x7f407407b0a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:23.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.890+0000 7f409027e640 1 --2- 172.21.15.105:0/3306509685 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f408815b8f0 0x7f408814f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:23.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.890+0000 7f409027e640 1 --2- 172.21.15.105:0/3306509685 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40880b2cb0 0x7f408806cfc0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:23.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.890+0000 7f409027e640 1 --2- 172.21.15.105:0/3306509685 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f40880b0520 0x7f40881e0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:23.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.890+0000 7f409027e640 1 -- 172.21.15.105:0/3306509685 >> 172.21.15.105:0/3306509685 conn(0x7f40880cdcb0 msgr2=0x7f40880b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:23.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.890+0000 7f409027e640 1 -- 172.21.15.105:0/3306509685 shutdown_connections 2024-09-21T03:21:23.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:23.890+0000 7f409027e640 1 -- 172.21.15.105:0/3306509685 wait complete. 2024-09-21T03:21:24.306 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T03:21:14.660239+0000', 'modified': '2024-09-21T03:21:16.660264+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5940}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5940': {'gid': 5940, 'name': 'a', 'rank': 0, 'incarnation': 36, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.105:6835/1561028223', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6834', 'nonce': 1561028223}, {'type': 'v1', 'addr': '172.21.15.105:6835', 'nonce': 1561028223}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5940, 'qdb_cluster': [5940]} 2024-09-21T03:21:24.306 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T03:21:24.306 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-21T03:21:24.420 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.418+0000 7f8f2da0a640 1 -- 172.21.15.105:0/3394890232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f280ceb40 msgr2=0x7f8f280cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:24.420 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.418+0000 7f8f2da0a640 1 --2- 172.21.15.105:0/3394890232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f280ceb40 0x7f8f280cef50 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f8f280ba090 tx=0x7f8f1802a9a0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.420 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.418+0000 7f8f2da0a640 1 -- 172.21.15.105:0/3394890232 shutdown_connections 2024-09-21T03:21:24.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.418+0000 7f8f2da0a640 1 --2- 172.21.15.105:0/3394890232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f280ceb40 0x7f8f280cef50 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.418+0000 7f8f2da0a640 1 --2- 172.21.15.105:0/3394890232 >> v2:172.21.15.162:3300/0 conn(0x7f8f2806e170 0x7f8f280b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.418+0000 7f8f2da0a640 1 -- 172.21.15.105:0/3394890232 >> 172.21.15.105:0/3394890232 conn(0x7f8f2808bfc0 msgr2=0x7f8f2809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:24.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.418+0000 7f8f2da0a640 1 -- 172.21.15.105:0/3394890232 shutdown_connections 2024-09-21T03:21:24.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.418+0000 7f8f2da0a640 1 -- 172.21.15.105:0/3394890232 wait complete. 2024-09-21T03:21:24.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.420+0000 7f8f2da0a640 1 Processor -- start 2024-09-21T03:21:24.422 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.420+0000 7f8f2da0a640 1 -- start start 2024-09-21T03:21:24.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.422+0000 7f8f2da0a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f2806f4b0 0x7f8f281e8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:24.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.422+0000 7f8f2da0a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f280ceb40 0x7f8f281e8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:24.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.422+0000 7f8f2da0a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f2815f800 0x7f8f280cd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:24.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.422+0000 7f8f2da0a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8f280d0e60 con 0x7f8f2806f4b0 2024-09-21T03:21:24.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.422+0000 7f8f2da0a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8f280d0ce0 con 0x7f8f280ceb40 2024-09-21T03:21:24.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.422+0000 7f8f2da0a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8f280d0fe0 con 0x7f8f2815f800 2024-09-21T03:21:24.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.422+0000 7f8f26ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f2806f4b0 0x7f8f281e8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:24.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.422+0000 7f8f26ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f2806f4b0 0x7f8f281e8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58106/0 (socket says 172.21.15.105:58106) 2024-09-21T03:21:24.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.422+0000 7f8f26ffd640 1 -- 172.21.15.105:0/500473800 learned_addr learned my addr 172.21.15.105:0/500473800 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:24.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.422+0000 7f8f267fc640 1 --2- 172.21.15.105:0/500473800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f280ceb40 0x7f8f281e8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:24.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.422+0000 7f8f277fe640 1 --2- 172.21.15.105:0/500473800 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f2815f800 0x7f8f280cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:24.426 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.422+0000 7f8f26ffd640 1 -- 172.21.15.105:0/500473800 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f2815f800 msgr2=0x7f8f280cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:24.426 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.422+0000 7f8f26ffd640 1 --2- 172.21.15.105:0/500473800 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f2815f800 0x7f8f280cd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.426 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.422+0000 7f8f26ffd640 1 -- 172.21.15.105:0/500473800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f280ceb40 msgr2=0x7f8f281e8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:24.426 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.422+0000 7f8f26ffd640 1 --2- 172.21.15.105:0/500473800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f280ceb40 0x7f8f281e8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.426 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.422+0000 7f8f26ffd640 1 -- 172.21.15.105:0/500473800 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f280caf80 con 0x7f8f2806f4b0 2024-09-21T03:21:24.426 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.422+0000 7f8f277fe640 1 --2- 172.21.15.105:0/500473800 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f2815f800 0x7f8f280cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:21:24.426 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.422+0000 7f8f26ffd640 1 --2- 172.21.15.105:0/500473800 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f2806f4b0 0x7f8f281e8440 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f8f2000d740 tx=0x7f8f2000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:24.426 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.422+0000 7f8f1ffff640 1 -- 172.21.15.105:0/500473800 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f20017070 con 0x7f8f2806f4b0 2024-09-21T03:21:24.426 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.422+0000 7f8f1ffff640 1 -- 172.21.15.105:0/500473800 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f20009d20 con 0x7f8f2806f4b0 2024-09-21T03:21:24.426 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.422+0000 7f8f2da0a640 1 -- 172.21.15.105:0/500473800 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f280cb260 con 0x7f8f2806f4b0 2024-09-21T03:21:24.426 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.422+0000 7f8f1ffff640 1 -- 172.21.15.105:0/500473800 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f200106c0 con 0x7f8f2806f4b0 2024-09-21T03:21:24.426 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.423+0000 7f8f2da0a640 1 -- 172.21.15.105:0/500473800 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f280cd040 con 0x7f8f2806f4b0 2024-09-21T03:21:24.427 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.425+0000 7f8f1ffff640 1 -- 172.21.15.105:0/500473800 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8f2001a070 con 0x7f8f2806f4b0 2024-09-21T03:21:24.427 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.425+0000 7f8f1ffff640 1 --2- 172.21.15.105:0/500473800 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8f08078b90 0x7f8f0807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:24.427 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.426+0000 7f8f1ffff640 1 -- 172.21.15.105:0/500473800 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f8f2009aeb0 con 0x7f8f2806f4b0 2024-09-21T03:21:24.427 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.426+0000 7f8f267fc640 1 --2- 172.21.15.105:0/500473800 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8f08078b90 0x7f8f0807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:24.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.426+0000 7f8f34a53740 1 Processor -- start 2024-09-21T03:21:24.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.426+0000 7f8f34a53740 1 -- start start 2024-09-21T03:21:24.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.426+0000 7f8f267fc640 1 --2- 172.21.15.105:0/500473800 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8f08078b90 0x7f8f0807b0a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8f10006fd0 tx=0x7f8f10008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:24.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.427+0000 7f8f34a53740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556ab577c270 0x556ab5b4dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:24.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.427+0000 7f8f34a53740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ab57533b0 0x556ab5b4e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:24.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.427+0000 7f8f34a53740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ab575b590 0x556ab5b6b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:24.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.427+0000 7f8f34a53740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x556ab5a96820 con 0x556ab57533b0 2024-09-21T03:21:24.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.427+0000 7f8f34a53740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556ab5a85c50 con 0x556ab575b590 2024-09-21T03:21:24.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.427+0000 7f8f34a53740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x556ab5a89a60 con 0x556ab577c270 2024-09-21T03:21:24.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.428+0000 7f8f267fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ab57533b0 0x556ab5b4e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:24.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.428+0000 7f8f267fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ab57533b0 0x556ab5b4e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58118/0 (socket says 172.21.15.105:58118) 2024-09-21T03:21:24.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.428+0000 7f8f267fc640 1 -- 172.21.15.105:0/1513623598 learned_addr learned my addr 172.21.15.105:0/1513623598 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:24.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.428+0000 7f8f26ffd640 1 --2- 172.21.15.105:0/1513623598 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556ab577c270 0x556ab5b4dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:24.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.428+0000 7f8f277fe640 1 --2- 172.21.15.105:0/1513623598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ab575b590 0x556ab5b6b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:24.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.428+0000 7f8f267fc640 1 -- 172.21.15.105:0/1513623598 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556ab577c270 msgr2=0x556ab5b4dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:21:24.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.428+0000 7f8f267fc640 1 --2- 172.21.15.105:0/1513623598 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556ab577c270 0x556ab5b4dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.428+0000 7f8f267fc640 1 -- 172.21.15.105:0/1513623598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ab575b590 msgr2=0x556ab5b6b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:21:24.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.428+0000 7f8f267fc640 1 --2- 172.21.15.105:0/1513623598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ab575b590 0x556ab5b6b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.428+0000 7f8f267fc640 1 -- 172.21.15.105:0/1513623598 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ab57e7850 con 0x556ab57533b0 2024-09-21T03:21:24.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.428+0000 7f8f267fc640 1 --2- 172.21.15.105:0/1513623598 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ab57533b0 0x556ab5b4e500 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f8f1000bfb0 tx=0x7f8f10010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eda4a505f21708a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:24.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.428+0000 7f8f1d7fa640 1 -- 172.21.15.105:0/1513623598 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f1001a040 con 0x556ab57533b0 2024-09-21T03:21:24.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.428+0000 7f8f1d7fa640 1 -- 172.21.15.105:0/1513623598 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f10023070 con 0x556ab57533b0 2024-09-21T03:21:24.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.428+0000 7f8f1d7fa640 1 -- 172.21.15.105:0/1513623598 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f10014980 con 0x556ab57533b0 2024-09-21T03:21:24.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.429+0000 7f8f34a53740 1 -- 172.21.15.105:0/1513623598 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ab57533b0 msgr2=0x556ab5b4e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:24.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.429+0000 7f8f34a53740 1 --2- 172.21.15.105:0/1513623598 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ab57533b0 0x556ab5b4e500 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f8f1000bfb0 tx=0x7f8f10010000 comp rx=0 tx=0).stop 2024-09-21T03:21:24.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.429+0000 7f8f34a53740 1 -- 172.21.15.105:0/1513623598 shutdown_connections 2024-09-21T03:21:24.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.429+0000 7f8f34a53740 1 --2- 172.21.15.105:0/1513623598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ab575b590 0x556ab5b6b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.429+0000 7f8f34a53740 1 --2- 172.21.15.105:0/1513623598 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ab57533b0 0x556ab5b4e500 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.429+0000 7f8f34a53740 1 --2- 172.21.15.105:0/1513623598 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556ab577c270 0x556ab5b4dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.433 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.429+0000 7f8f34a53740 1 -- 172.21.15.105:0/1513623598 >> 172.21.15.105:0/1513623598 conn(0x556ab57703c0 msgr2=0x556ab5b24280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:24.433 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.429+0000 7f8f34a53740 1 -- 172.21.15.105:0/1513623598 shutdown_connections 2024-09-21T03:21:24.433 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.429+0000 7f8f34a53740 1 -- 172.21.15.105:0/1513623598 wait complete. 2024-09-21T03:21:24.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.430+0000 7f8f34a53740 1 -- start start 2024-09-21T03:21:24.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.430+0000 7f8f34a53740 1 Processor -- start 2024-09-21T03:21:24.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.431+0000 7f8f34a53740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ab57533b0 0x556ab5b7bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:24.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.431+0000 7f8f34a53740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556ab575b590 0x556ab5b3c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:24.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.431+0000 7f8f34a53740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ab577c270 0x556ab5b6c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:24.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.431+0000 7f8f34a53740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x556ab57f6620 con 0x556ab577c270 2024-09-21T03:21:24.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.431+0000 7f8f34a53740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556ab5a2b5f0 con 0x556ab57533b0 2024-09-21T03:21:24.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.431+0000 7f8f34a53740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x556ab5b4ea40 con 0x556ab575b590 2024-09-21T03:21:24.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.431+0000 7f8f34a53740 10 client.0 _ll_register_callbacks cb 0x556ab5a2f0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:21:24.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.431+0000 7f8f277fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ab577c270 0x556ab5b6c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:24.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.431+0000 7f8f277fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ab577c270 0x556ab5b6c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58130/0 (socket says 172.21.15.105:58130) 2024-09-21T03:21:24.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.431+0000 7f8f277fe640 1 -- 172.21.15.105:0/1868999989 learned_addr learned my addr 172.21.15.105:0/1868999989 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:24.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.432+0000 7f8f267fc640 1 --2- 172.21.15.105:0/1868999989 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556ab575b590 0x556ab5b3c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:24.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.432+0000 7f8f26ffd640 1 --2- 172.21.15.105:0/1868999989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ab57533b0 0x556ab5b7bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:24.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.432+0000 7f8f277fe640 1 -- 172.21.15.105:0/1868999989 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556ab575b590 msgr2=0x556ab5b3c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:21:24.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.432+0000 7f8f277fe640 1 --2- 172.21.15.105:0/1868999989 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556ab575b590 0x556ab5b3c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.432+0000 7f8f277fe640 1 -- 172.21.15.105:0/1868999989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ab57533b0 msgr2=0x556ab5b7bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:21:24.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.432+0000 7f8f277fe640 1 --2- 172.21.15.105:0/1868999989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ab57533b0 0x556ab5b7bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.432+0000 7f8f277fe640 1 -- 172.21.15.105:0/1868999989 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ab585e6b0 con 0x556ab577c270 2024-09-21T03:21:24.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.432+0000 7f8f277fe640 1 --2- 172.21.15.105:0/1868999989 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ab577c270 0x556ab5b6c280 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f8f1802af90 tx=0x7f8f1802aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfde8be2f7ecfe6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:24.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.432+0000 7f8f067fc640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-21T03:21:24.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.432+0000 7f8f067fc640 1 -- 172.21.15.105:0/1868999989 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f18034040 con 0x556ab577c270 2024-09-21T03:21:24.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.432+0000 7f8f34a53740 1 -- 172.21.15.105:0/1868999989 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f10023070 con 0x556ab577c270 2024-09-21T03:21:24.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.432+0000 7f8f067fc640 1 -- 172.21.15.105:0/1868999989 <== mon.0 v2:172.21.15.105:3300/0 2 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f8f18030b60 con 0x556ab577c270 2024-09-21T03:21:24.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.432+0000 7f8f067fc640 1 -- 172.21.15.105:0/1868999989 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f8f1804f050 con 0x556ab577c270 2024-09-21T03:21:24.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.432+0000 7f8f34a53740 10 client.6096 fetch_fsmap learned FSMap version 38 2024-09-21T03:21:24.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.432+0000 7f8f34a53740 1 -- 172.21.15.105:0/1868999989 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) -- 0x556ab5b3c7a0 con 0x556ab577c270 2024-09-21T03:21:24.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.432+0000 7f8f067fc640 1 -- 172.21.15.105:0/1868999989 <== mon.0 v2:172.21.15.105:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f10023070 con 0x556ab577c270 2024-09-21T03:21:24.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.433+0000 7f8f067fc640 1 -- 172.21.15.105:0/1868999989 <== mon.0 v2:172.21.15.105:3300/0 5 ==== fsmap(e 38) ==== 3502+0+0 (secure 0 0 0) 0x7f8f18052020 con 0x556ab577c270 2024-09-21T03:21:24.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.433+0000 7f8f34a53740 10 client.6096 fetch_fsmap finished waiting for FSMap version 38 2024-09-21T03:21:24.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.433+0000 7f8f34a53740 10 client.6096 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T03:21:24.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.433+0000 7f8f34a53740 20 client.6096 populate_metadata read hostname 'smithi105' 2024-09-21T03:21:24.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.433+0000 7f8f34a53740 1 --2- 172.21.15.105:0/1868999989 >> [v2:172.21.15.105:6834/1561028223,v1:172.21.15.105:6835/1561028223] conn(0x556ab573ae40 0x556ab5b77be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:24.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.433+0000 7f8f34a53740 4 client.6096 mds_command: new command op to 5940 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:21:24.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.433+0000 7f8f34a53740 1 -- 172.21.15.105:0/1868999989 --> [v2:172.21.15.105:6834/1561028223,v1:172.21.15.105:6835/1561028223] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ab5a98770 con 0x556ab573ae40 2024-09-21T03:21:24.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.433+0000 7f8f26ffd640 1 --2- 172.21.15.105:0/1868999989 >> [v2:172.21.15.105:6834/1561028223,v1:172.21.15.105:6835/1561028223] conn(0x556ab573ae40 0x556ab5b77be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:24.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.433+0000 7f8f067fc640 10 client.6096 ms_handle_connect on v2:172.21.15.105:6834/1561028223 2024-09-21T03:21:24.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.433+0000 7f8f26ffd640 1 --2- 172.21.15.105:0/1868999989 >> [v2:172.21.15.105:6834/1561028223,v1:172.21.15.105:6835/1561028223] conn(0x556ab573ae40 0x556ab5b77be0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad966a8325fe921d server_cookie=7db43ab99027f0f4 in_seq=0 out_seq=0 2024-09-21T03:21:24.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.434+0000 7f8f067fc640 1 -- 172.21.15.105:0/1868999989 <== mds.0 v2:172.21.15.105:6834/1561028223 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556ab5a98770 con 0x556ab573ae40 2024-09-21T03:21:24.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.434+0000 7f8f067fc640 10 client.6096 handle_command_reply: tid=0 2024-09-21T03:21:24.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.434+0000 7f8f34a53740 1 client.6096 shutdown 2024-09-21T03:21:24.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.434+0000 7f8f34a53740 1 -- 172.21.15.105:0/1868999989 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ab577c270 msgr2=0x556ab5b6c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:24.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.434+0000 7f8f34a53740 1 --2- 172.21.15.105:0/1868999989 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ab577c270 0x556ab5b6c280 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f8f1802af90 tx=0x7f8f1802aec0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.434+0000 7f8f34a53740 1 -- 172.21.15.105:0/1868999989 shutdown_connections 2024-09-21T03:21:24.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.434+0000 7f8f34a53740 1 --2- 172.21.15.105:0/1868999989 >> [v2:172.21.15.105:6834/1561028223,v1:172.21.15.105:6835/1561028223] conn(0x556ab573ae40 0x556ab5b77be0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.434+0000 7f8f34a53740 1 --2- 172.21.15.105:0/1868999989 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ab577c270 0x556ab5b6c280 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.434+0000 7f8f067fc640 0 client.6096 ms_handle_reset on v2:172.21.15.105:6834/1561028223 2024-09-21T03:21:24.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.434+0000 7f8f34a53740 1 --2- 172.21.15.105:0/1868999989 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556ab575b590 0x556ab5b3c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.434+0000 7f8f34a53740 1 --2- 172.21.15.105:0/1868999989 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ab57533b0 0x556ab5b7bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.434+0000 7f8f34a53740 1 -- 172.21.15.105:0/1868999989 >> 172.21.15.105:0/1868999989 conn(0x556ab57703c0 msgr2=0x556ab5b69600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:24.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.434+0000 7f8f34a53740 1 -- 172.21.15.105:0/1868999989 shutdown_connections 2024-09-21T03:21:24.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.434+0000 7f8f34a53740 1 -- 172.21.15.105:0/1868999989 wait complete. 2024-09-21T03:21:24.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.434+0000 7f8f34a53740 20 client.6096 trim_cache size 0 max 16384 2024-09-21T03:21:24.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.452+0000 7f8f34a53740 1 Processor -- start 2024-09-21T03:21:24.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.452+0000 7f8f34a53740 1 -- start start 2024-09-21T03:21:24.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.454+0000 7f8f34a53740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ab57533b0 0x556ab5b3c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:24.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.454+0000 7f8f34a53740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ab575b590 0x556ab5b6bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:24.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.454+0000 7f8f34a53740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556ab577c270 0x556ab5b4ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:24.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.454+0000 7f8f34a53740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8f28201300 con 0x556ab575b590 2024-09-21T03:21:24.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.454+0000 7f8f34a53740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8f28150fc0 con 0x556ab57533b0 2024-09-21T03:21:24.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.454+0000 7f8f34a53740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8f28151610 con 0x556ab577c270 2024-09-21T03:21:24.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.454+0000 7f8f267fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ab575b590 0x556ab5b6bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:24.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.454+0000 7f8f267fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ab575b590 0x556ab5b6bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58132/0 (socket says 172.21.15.105:58132) 2024-09-21T03:21:24.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.454+0000 7f8f267fc640 1 -- 172.21.15.105:0/2919821662 learned_addr learned my addr 172.21.15.105:0/2919821662 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:24.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.454+0000 7f8f26ffd640 1 --2- 172.21.15.105:0/2919821662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ab57533b0 0x556ab5b3c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:24.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.454+0000 7f8f267fc640 1 -- 172.21.15.105:0/2919821662 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556ab577c270 msgr2=0x556ab5b4ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:21:24.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.454+0000 7f8f277fe640 1 --2- 172.21.15.105:0/2919821662 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556ab577c270 0x556ab5b4ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:24.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.454+0000 7f8f267fc640 1 --2- 172.21.15.105:0/2919821662 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556ab577c270 0x556ab5b4ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.454+0000 7f8f267fc640 1 -- 172.21.15.105:0/2919821662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ab57533b0 msgr2=0x556ab5b3c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:21:24.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.454+0000 7f8f267fc640 1 --2- 172.21.15.105:0/2919821662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ab57533b0 0x556ab5b3c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.454+0000 7f8f267fc640 1 -- 172.21.15.105:0/2919821662 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ab5b47c50 con 0x556ab575b590 2024-09-21T03:21:24.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.454+0000 7f8f267fc640 1 --2- 172.21.15.105:0/2919821662 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ab575b590 0x556ab5b6bdf0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f8f1000b630 tx=0x7f8f100046f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a471b62db93ed00 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:24.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.454+0000 7f8f1cff9640 1 -- 172.21.15.105:0/2919821662 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f1002b070 con 0x556ab575b590 2024-09-21T03:21:24.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.454+0000 7f8f1cff9640 1 -- 172.21.15.105:0/2919821662 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f10023070 con 0x556ab575b590 2024-09-21T03:21:24.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.454+0000 7f8f1cff9640 1 -- 172.21.15.105:0/2919821662 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f10014780 con 0x556ab575b590 2024-09-21T03:21:24.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.455+0000 7f8f34a53740 1 -- 172.21.15.105:0/2919821662 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ab575b590 msgr2=0x556ab5b6bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:24.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.455+0000 7f8f34a53740 1 --2- 172.21.15.105:0/2919821662 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ab575b590 0x556ab5b6bdf0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f8f1000b630 tx=0x7f8f100046f0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.455+0000 7f8f34a53740 1 -- 172.21.15.105:0/2919821662 shutdown_connections 2024-09-21T03:21:24.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.455+0000 7f8f34a53740 1 --2- 172.21.15.105:0/2919821662 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556ab577c270 0x556ab5b4ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.455+0000 7f8f34a53740 1 --2- 172.21.15.105:0/2919821662 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ab575b590 0x556ab5b6bdf0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.455+0000 7f8f34a53740 1 --2- 172.21.15.105:0/2919821662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ab57533b0 0x556ab5b3c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.455+0000 7f8f34a53740 1 -- 172.21.15.105:0/2919821662 >> 172.21.15.105:0/2919821662 conn(0x556ab57703c0 msgr2=0x556ab5b243e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:24.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.455+0000 7f8f34a53740 1 -- 172.21.15.105:0/2919821662 shutdown_connections 2024-09-21T03:21:24.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.455+0000 7f8f34a53740 1 -- 172.21.15.105:0/2919821662 wait complete. 2024-09-21T03:21:24.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.456+0000 7f8f34a53740 1 -- start start 2024-09-21T03:21:24.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.456+0000 7f8f34a53740 1 Processor -- start 2024-09-21T03:21:24.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.457+0000 7f8f34a53740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ab57533b0 0x556ab5beaf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:24.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.457+0000 7f8f34a53740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556ab575b590 0x556ab5b1d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:24.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.457+0000 7f8f34a53740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ab577c270 0x556ab5b1da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:24.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.458+0000 7f8f34a53740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x556ab5b5fd40 con 0x556ab57533b0 2024-09-21T03:21:24.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.458+0000 7f8f34a53740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556ab5b61ad0 con 0x556ab577c270 2024-09-21T03:21:24.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.458+0000 7f8f34a53740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x556ab5b46c10 con 0x556ab575b590 2024-09-21T03:21:24.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.458+0000 7f8f34a53740 10 client.0 _ll_register_callbacks cb 0x7f8f18003de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:21:24.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.458+0000 7f8f26ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ab57533b0 0x556ab5beaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:24.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.458+0000 7f8f26ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ab57533b0 0x556ab5beaf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58140/0 (socket says 172.21.15.105:58140) 2024-09-21T03:21:24.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.458+0000 7f8f26ffd640 1 -- 172.21.15.105:0/2151020134 learned_addr learned my addr 172.21.15.105:0/2151020134 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:24.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.458+0000 7f8f267fc640 1 --2- 172.21.15.105:0/2151020134 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556ab575b590 0x556ab5b1d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:24.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.458+0000 7f8f277fe640 1 --2- 172.21.15.105:0/2151020134 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ab577c270 0x556ab5b1da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:24.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.458+0000 7f8f26ffd640 1 -- 172.21.15.105:0/2151020134 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556ab575b590 msgr2=0x556ab5b1d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:21:24.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.458+0000 7f8f26ffd640 1 --2- 172.21.15.105:0/2151020134 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556ab575b590 0x556ab5b1d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.458+0000 7f8f26ffd640 1 -- 172.21.15.105:0/2151020134 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ab577c270 msgr2=0x556ab5b1da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:21:24.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.458+0000 7f8f26ffd640 1 --2- 172.21.15.105:0/2151020134 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ab577c270 0x556ab5b1da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.458+0000 7f8f26ffd640 1 -- 172.21.15.105:0/2151020134 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ab5b25c80 con 0x556ab57533b0 2024-09-21T03:21:24.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.458+0000 7f8f26ffd640 1 --2- 172.21.15.105:0/2151020134 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ab57533b0 0x556ab5beaf20 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f8f20066010 tx=0x7f8f20000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d66628564032ae6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:24.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.458+0000 7f8f067fc640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-21T03:21:24.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.458+0000 7f8f067fc640 1 -- 172.21.15.105:0/2151020134 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f20021040 con 0x556ab57533b0 2024-09-21T03:21:24.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.458+0000 7f8f067fc640 1 -- 172.21.15.105:0/2151020134 <== mon.0 v2:172.21.15.105:3300/0 2 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f8f20061e50 con 0x556ab57533b0 2024-09-21T03:21:24.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.458+0000 7f8f34a53740 1 -- 172.21.15.105:0/2151020134 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f10023070 con 0x556ab57533b0 2024-09-21T03:21:24.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.458+0000 7f8f067fc640 1 -- 172.21.15.105:0/2151020134 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f8f20062bf0 con 0x556ab57533b0 2024-09-21T03:21:24.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.458+0000 7f8f34a53740 10 client.6102 fetch_fsmap learned FSMap version 38 2024-09-21T03:21:24.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.458+0000 7f8f34a53740 1 -- 172.21.15.105:0/2151020134 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) -- 0x556ab5bec3f0 con 0x556ab57533b0 2024-09-21T03:21:24.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.459+0000 7f8f067fc640 1 -- 172.21.15.105:0/2151020134 <== mon.0 v2:172.21.15.105:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f10023070 con 0x556ab57533b0 2024-09-21T03:21:24.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.459+0000 7f8f067fc640 1 -- 172.21.15.105:0/2151020134 <== mon.0 v2:172.21.15.105:3300/0 5 ==== fsmap(e 38) ==== 3502+0+0 (secure 0 0 0) 0x7f8f2005e540 con 0x556ab57533b0 2024-09-21T03:21:24.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.459+0000 7f8f34a53740 10 client.6102 fetch_fsmap finished waiting for FSMap version 38 2024-09-21T03:21:24.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.459+0000 7f8f34a53740 10 client.6102 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T03:21:24.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.459+0000 7f8f34a53740 20 client.6102 populate_metadata read hostname 'smithi105' 2024-09-21T03:21:24.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.459+0000 7f8f34a53740 1 --2- 172.21.15.105:0/2151020134 >> [v2:172.21.15.105:6834/1561028223,v1:172.21.15.105:6835/1561028223] conn(0x556ab5bebc70 0x556ab5b4dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:24.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.459+0000 7f8f34a53740 4 client.6102 mds_command: new command op to 5940 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T03:21:24.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.459+0000 7f8f34a53740 1 -- 172.21.15.105:0/2151020134 --> [v2:172.21.15.105:6834/1561028223,v1:172.21.15.105:6835/1561028223] -- command(tid 0: {"prefix": "status"}) -- 0x556ab5a94220 con 0x556ab5bebc70 2024-09-21T03:21:24.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.459+0000 7f8f267fc640 1 --2- 172.21.15.105:0/2151020134 >> [v2:172.21.15.105:6834/1561028223,v1:172.21.15.105:6835/1561028223] conn(0x556ab5bebc70 0x556ab5b4dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:24.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.459+0000 7f8f067fc640 10 client.6102 ms_handle_connect on v2:172.21.15.105:6834/1561028223 2024-09-21T03:21:24.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.459+0000 7f8f267fc640 1 --2- 172.21.15.105:0/2151020134 >> [v2:172.21.15.105:6834/1561028223,v1:172.21.15.105:6835/1561028223] conn(0x556ab5bebc70 0x556ab5b4dc60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d90a6be712504ba server_cookie=b0f77d3c4ca2ebb4 in_seq=0 out_seq=0 2024-09-21T03:21:24.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.459+0000 7f8f067fc640 1 -- 172.21.15.105:0/2151020134 <== mds.0 v2:172.21.15.105:6834/1561028223 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x556ab5a94220 con 0x556ab5bebc70 2024-09-21T03:21:24.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.459+0000 7f8f067fc640 10 client.6102 handle_command_reply: tid=0 2024-09-21T03:21:24.466 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.459+0000 7f8f34a53740 1 client.6102 shutdown 2024-09-21T03:21:24.466 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.460+0000 7f8f34a53740 1 -- 172.21.15.105:0/2151020134 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ab57533b0 msgr2=0x556ab5beaf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:24.466 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.460+0000 7f8f34a53740 1 --2- 172.21.15.105:0/2151020134 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ab57533b0 0x556ab5beaf20 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f8f20066010 tx=0x7f8f20000bc0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.466 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.460+0000 7f8f34a53740 1 -- 172.21.15.105:0/2151020134 shutdown_connections 2024-09-21T03:21:24.466 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.460+0000 7f8f34a53740 1 --2- 172.21.15.105:0/2151020134 >> [v2:172.21.15.105:6834/1561028223,v1:172.21.15.105:6835/1561028223] conn(0x556ab5bebc70 0x556ab5b4dc60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.466 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.460+0000 7f8f34a53740 1 --2- 172.21.15.105:0/2151020134 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556ab577c270 0x556ab5b1da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.466 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.460+0000 7f8f067fc640 0 client.6102 ms_handle_reset on v2:172.21.15.105:6834/1561028223 2024-09-21T03:21:24.466 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.460+0000 7f8f34a53740 1 --2- 172.21.15.105:0/2151020134 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556ab575b590 0x556ab5b1d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.466 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.460+0000 7f8f34a53740 1 --2- 172.21.15.105:0/2151020134 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556ab57533b0 0x556ab5beaf20 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.466 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.460+0000 7f8f34a53740 1 -- 172.21.15.105:0/2151020134 >> 172.21.15.105:0/2151020134 conn(0x556ab57703c0 msgr2=0x556ab5b6bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:24.466 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.460+0000 7f8f34a53740 1 -- 172.21.15.105:0/2151020134 shutdown_connections 2024-09-21T03:21:24.466 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.460+0000 7f8f34a53740 1 -- 172.21.15.105:0/2151020134 wait complete. 2024-09-21T03:21:24.466 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.460+0000 7f8f34a53740 20 client.6102 trim_cache size 0 max 16384 2024-09-21T03:21:24.467 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-21T03:21:24.467 INFO:teuthology.orchestra.run.smithi105.stdout: "cluster_fsid": "29d80f4f-e5de-4b26-8384-24c2d8019945", 2024-09-21T03:21:24.467 INFO:teuthology.orchestra.run.smithi105.stdout: "whoami": 0, 2024-09-21T03:21:24.467 INFO:teuthology.orchestra.run.smithi105.stdout: "id": 5940, 2024-09-21T03:21:24.467 INFO:teuthology.orchestra.run.smithi105.stdout: "want_state": "up:active", 2024-09-21T03:21:24.467 INFO:teuthology.orchestra.run.smithi105.stdout: "state": "up:active", 2024-09-21T03:21:24.467 INFO:teuthology.orchestra.run.smithi105.stdout: "fs_name": "cephfs", 2024-09-21T03:21:24.467 INFO:teuthology.orchestra.run.smithi105.stdout: "rank_uptime": 9.169945749, 2024-09-21T03:21:24.467 INFO:teuthology.orchestra.run.smithi105.stdout: "mdsmap_epoch": 38, 2024-09-21T03:21:24.467 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_epoch": 69, 2024-09-21T03:21:24.467 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_epoch_barrier": 69, 2024-09-21T03:21:24.468 INFO:teuthology.orchestra.run.smithi105.stdout: "uptime": 14.510609494000001 2024-09-21T03:21:24.468 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-21T03:21:24.468 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.460+0000 7f8f2da0a640 1 -- 172.21.15.105:0/500473800 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8f08078b90 msgr2=0x7f8f0807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:24.468 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.460+0000 7f8f2da0a640 1 --2- 172.21.15.105:0/500473800 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8f08078b90 0x7f8f0807b0a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8f10006fd0 tx=0x7f8f10008040 comp rx=0 tx=0).stop 2024-09-21T03:21:24.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.460+0000 7f8f2da0a640 1 -- 172.21.15.105:0/500473800 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f2806f4b0 msgr2=0x7f8f281e8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:24.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.460+0000 7f8f2da0a640 1 --2- 172.21.15.105:0/500473800 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f2806f4b0 0x7f8f281e8440 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f8f2000d740 tx=0x7f8f2000dc00 comp rx=0 tx=0).stop 2024-09-21T03:21:24.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.460+0000 7f8f2da0a640 1 -- 172.21.15.105:0/500473800 shutdown_connections 2024-09-21T03:21:24.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.460+0000 7f8f2da0a640 1 --2- 172.21.15.105:0/500473800 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8f08078b90 0x7f8f0807b0a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.460+0000 7f8f2da0a640 1 --2- 172.21.15.105:0/500473800 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f2815f800 0x7f8f280cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.460+0000 7f8f2da0a640 1 --2- 172.21.15.105:0/500473800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f280ceb40 0x7f8f281e8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.460+0000 7f8f2da0a640 1 --2- 172.21.15.105:0/500473800 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f2806f4b0 0x7f8f281e8440 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.460+0000 7f8f2da0a640 1 -- 172.21.15.105:0/500473800 >> 172.21.15.105:0/500473800 conn(0x7f8f2808bfc0 msgr2=0x7f8f280b2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:24.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.460+0000 7f8f2da0a640 1 -- 172.21.15.105:0/500473800 shutdown_connections 2024-09-21T03:21:24.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.460+0000 7f8f2da0a640 1 -- 172.21.15.105:0/500473800 wait complete. 2024-09-21T03:21:24.473 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T03:21:24.585 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.583+0000 7fcc27df1640 1 -- 172.21.15.105:0/1833808361 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc200cf150 msgr2=0x7fcc200b3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:24.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.583+0000 7fcc27df1640 1 --2- 172.21.15.105:0/1833808361 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc200cf150 0x7fcc200b3d50 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fcc200cf9f0 tx=0x7fcc1802aa30 comp rx=0 tx=0).stop 2024-09-21T03:21:24.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.583+0000 7fcc27df1640 1 -- 172.21.15.105:0/1833808361 shutdown_connections 2024-09-21T03:21:24.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.583+0000 7fcc27df1640 1 --2- 172.21.15.105:0/1833808361 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc200cf150 0x7fcc200b3d50 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.583+0000 7fcc27df1640 1 --2- 172.21.15.105:0/1833808361 >> v2:172.21.15.162:3300/0 conn(0x7fcc200b7cc0 0x7fcc200cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.583+0000 7fcc27df1640 1 --2- 172.21.15.105:0/1833808361 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc201600b0 0x7fcc200ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.583+0000 7fcc27df1640 1 -- 172.21.15.105:0/1833808361 >> 172.21.15.105:0/1833808361 conn(0x7fcc2006d4f0 msgr2=0x7fcc20071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:24.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.584+0000 7fcc27df1640 1 -- 172.21.15.105:0/1833808361 shutdown_connections 2024-09-21T03:21:24.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.584+0000 7fcc27df1640 1 -- 172.21.15.105:0/1833808361 wait complete. 2024-09-21T03:21:24.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.585+0000 7fcc27df1640 1 Processor -- start 2024-09-21T03:21:24.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.585+0000 7fcc27df1640 1 -- start start 2024-09-21T03:21:24.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.587+0000 7fcc27df1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc200b7cc0 0x7fcc201f7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:24.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.587+0000 7fcc27df1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc200cf150 0x7fcc20158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:24.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.587+0000 7fcc27df1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc201600b0 0x7fcc200aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:24.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.587+0000 7fcc27df1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcc200b4620 con 0x7fcc200b7cc0 2024-09-21T03:21:24.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.587+0000 7fcc27df1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcc200b44a0 con 0x7fcc201600b0 2024-09-21T03:21:24.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.587+0000 7fcc27df1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcc200b47a0 con 0x7fcc200cf150 2024-09-21T03:21:24.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.587+0000 7fcc25b8d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc200b7cc0 0x7fcc201f7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:24.591 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.587+0000 7fcc25b8d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc200b7cc0 0x7fcc201f7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58162/0 (socket says 172.21.15.105:58162) 2024-09-21T03:21:24.591 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.587+0000 7fcc25b8d640 1 -- 172.21.15.105:0/4179304177 learned_addr learned my addr 172.21.15.105:0/4179304177 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:24.591 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.587+0000 7fcc2538c640 1 --2- 172.21.15.105:0/4179304177 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc200cf150 0x7fcc20158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:24.591 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.587+0000 7fcc2638e640 1 --2- 172.21.15.105:0/4179304177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc201600b0 0x7fcc200aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:24.591 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.587+0000 7fcc25b8d640 1 -- 172.21.15.105:0/4179304177 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc200cf150 msgr2=0x7fcc20158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:24.591 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.587+0000 7fcc25b8d640 1 --2- 172.21.15.105:0/4179304177 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc200cf150 0x7fcc20158ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.592 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.587+0000 7fcc25b8d640 1 -- 172.21.15.105:0/4179304177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc201600b0 msgr2=0x7fcc200aaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:24.592 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.587+0000 7fcc25b8d640 1 --2- 172.21.15.105:0/4179304177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc201600b0 0x7fcc200aaa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.592 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.587+0000 7fcc25b8d640 1 -- 172.21.15.105:0/4179304177 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc200c94b0 con 0x7fcc200b7cc0 2024-09-21T03:21:24.592 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.587+0000 7fcc25b8d640 1 --2- 172.21.15.105:0/4179304177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc200b7cc0 0x7fcc201f7e20 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c00d740 tx=0x7fcc1c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:24.592 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.587+0000 7fcc167fc640 1 -- 172.21.15.105:0/4179304177 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c017070 con 0x7fcc200b7cc0 2024-09-21T03:21:24.592 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.587+0000 7fcc167fc640 1 -- 172.21.15.105:0/4179304177 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc1c009d20 con 0x7fcc200b7cc0 2024-09-21T03:21:24.592 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.587+0000 7fcc27df1640 1 -- 172.21.15.105:0/4179304177 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc200c9790 con 0x7fcc200b7cc0 2024-09-21T03:21:24.592 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.587+0000 7fcc167fc640 1 -- 172.21.15.105:0/4179304177 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c0106c0 con 0x7fcc200b7cc0 2024-09-21T03:21:24.592 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.587+0000 7fcc27df1640 1 -- 172.21.15.105:0/4179304177 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc200c9d50 con 0x7fcc200b7cc0 2024-09-21T03:21:24.592 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.588+0000 7fcc27df1640 1 -- 172.21.15.105:0/4179304177 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc200b3d50 con 0x7fcc200b7cc0 2024-09-21T03:21:24.593 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.589+0000 7fcc167fc640 1 -- 172.21.15.105:0/4179304177 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcc1c01a070 con 0x7fcc200b7cc0 2024-09-21T03:21:24.594 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.590+0000 7fcc167fc640 1 --2- 172.21.15.105:0/4179304177 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcc04078b90 0x7fcc0407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:24.594 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.590+0000 7fcc167fc640 1 -- 172.21.15.105:0/4179304177 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fcc1c09add0 con 0x7fcc200b7cc0 2024-09-21T03:21:24.594 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.590+0000 7fcc2538c640 1 --2- 172.21.15.105:0/4179304177 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcc04078b90 0x7fcc0407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:24.594 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.591+0000 7fcc2538c640 1 --2- 172.21.15.105:0/4179304177 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcc04078b90 0x7fcc0407b0a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcc200b7c90 tx=0x7fcc10005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:24.596 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.595+0000 7fcc167fc640 1 -- 172.21.15.105:0/4179304177 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fcc1c062c50 con 0x7fcc200b7cc0 2024-09-21T03:21:24.808 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.806+0000 7fcc27df1640 1 -- 172.21.15.105:0/4179304177 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fcc2015ed60 con 0x7fcc200b7cc0 2024-09-21T03:21:24.808 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.806+0000 7fcc167fc640 1 -- 172.21.15.105:0/4179304177 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v38) ==== 53+0+73 (secure 0 0 0) 0x7fcc1c067680 con 0x7fcc200b7cc0 2024-09-21T03:21:24.808 INFO:teuthology.orchestra.run.smithi105.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T03:21:24.810 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.808+0000 7fcc27df1640 1 -- 172.21.15.105:0/4179304177 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcc04078b90 msgr2=0x7fcc0407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:24.810 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.808+0000 7fcc27df1640 1 --2- 172.21.15.105:0/4179304177 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcc04078b90 0x7fcc0407b0a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcc200b7c90 tx=0x7fcc10005f90 comp rx=0 tx=0).stop 2024-09-21T03:21:24.810 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.808+0000 7fcc27df1640 1 -- 172.21.15.105:0/4179304177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc200b7cc0 msgr2=0x7fcc201f7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:24.810 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.808+0000 7fcc27df1640 1 --2- 172.21.15.105:0/4179304177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc200b7cc0 0x7fcc201f7e20 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c00d740 tx=0x7fcc1c00dc00 comp rx=0 tx=0).stop 2024-09-21T03:21:24.811 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.808+0000 7fcc27df1640 1 -- 172.21.15.105:0/4179304177 shutdown_connections 2024-09-21T03:21:24.811 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.808+0000 7fcc27df1640 1 --2- 172.21.15.105:0/4179304177 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcc04078b90 0x7fcc0407b0a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.811 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.808+0000 7fcc27df1640 1 --2- 172.21.15.105:0/4179304177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc201600b0 0x7fcc200aaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.811 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.808+0000 7fcc27df1640 1 --2- 172.21.15.105:0/4179304177 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc200cf150 0x7fcc20158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.811 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.808+0000 7fcc27df1640 1 --2- 172.21.15.105:0/4179304177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc200b7cc0 0x7fcc201f7e20 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:24.811 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.808+0000 7fcc27df1640 1 -- 172.21.15.105:0/4179304177 >> 172.21.15.105:0/4179304177 conn(0x7fcc2006d4f0 msgr2=0x7fcc2015dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:24.811 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.808+0000 7fcc27df1640 1 -- 172.21.15.105:0/4179304177 shutdown_connections 2024-09-21T03:21:24.811 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:24.808+0000 7fcc27df1640 1 -- 172.21.15.105:0/4179304177 wait complete. 2024-09-21T03:21:24.822 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T03:21:24.822 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T03:21:24.822 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi105.front.sepia.ceph.com 2024-09-21T03:21:24.822 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T03:21:24.822 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T03:21:24.822 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T03:21:24.822 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T03:21:24.822 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T03:21:24.822 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:21:24.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:21:24.823 DEBUG:teuthology.orchestra.run.smithi105:> ip addr 2024-09-21T03:21:24.838 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T03:21:24.838 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T03:21:24.838 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T03:21:24.839 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:21:24.839 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2024-09-21T03:21:24.839 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:21:24.839 INFO:teuthology.orchestra.run.smithi105.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:21:24.839 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b8 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:21:24.839 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f0 2024-09-21T03:21:24.839 INFO:teuthology.orchestra.run.smithi105.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:21:24.839 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b9 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:21:24.839 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f1 2024-09-21T03:21:24.839 INFO:teuthology.orchestra.run.smithi105.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:21:24.839 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:28 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:21:24.839 INFO:teuthology.orchestra.run.smithi105.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T03:21:24.839 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:29 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:21:24.840 INFO:teuthology.orchestra.run.smithi105.stdout: inet 172.21.15.105/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T03:21:24.840 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft 42623sec preferred_lft 42623sec 2024-09-21T03:21:24.840 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::ec4:7aff:fe8f:d429/64 scope link noprefixroute 2024-09-21T03:21:24.840 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:21:24.840 INFO:teuthology.orchestra.run.smithi105.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T03:21:24.840 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 86:15:ed:f2:4e:d8 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:21:24.840 INFO:teuthology.orchestra.run.smithi105.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T03:21:24.840 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:21:24.840 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::80db:6aff:fece:44c2/64 scope link 2024-09-21T03:21:24.840 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:21:24.840 INFO:teuthology.orchestra.run.smithi105.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:21:24.840 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 86:15:ed:f2:4e:d8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T03:21:24.841 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::8415:edff:fef2:4ed8/64 scope link 2024-09-21T03:21:24.841 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:21:24.841 INFO:teuthology.orchestra.run.smithi105.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:21:24.841 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether a2:e9:7c:d4:c7:c7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T03:21:24.841 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::a0e9:7cff:fed4:c7c7/64 scope link 2024-09-21T03:21:24.841 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:21:24.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:21:24.841 DEBUG:teuthology.orchestra.run.smithi105:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T03:21:24.901 INFO:teuthology.orchestra.run.smithi105.stdout:1 2024-09-21T03:21:24.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:21:24.903 DEBUG:teuthology.orchestra.run.smithi105:> route 2024-09-21T03:21:24.959 INFO:teuthology.orchestra.run.smithi105.stdout:Kernel IP routing table 2024-09-21T03:21:24.959 INFO:teuthology.orchestra.run.smithi105.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T03:21:24.959 INFO:teuthology.orchestra.run.smithi105.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T03:21:24.959 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T03:21:24.960 INFO:teuthology.orchestra.run.smithi105.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T03:21:24.960 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:21:24.960 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-21T03:21:24.960 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T03:21:24.960 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T03:21:24.960 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T03:21:24.960 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-21T03:21:25.047 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:21:25.079 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:21:25.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:21:25.085 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-09-21T03:21:25.100 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T03:21:25.100 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T03:21:25.100 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:21:25.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:21:25.101 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set brx.0 up 2024-09-21T03:21:25.165 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:21:25.165 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T03:21:25.220 INFO:teuthology.orchestra.run.smithi105.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:21:25.221 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:21:25.221 DEBUG:teuthology.orchestra.run.smithi105:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T03:21:25.275 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-21T03:21:25.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:21:25.275 DEBUG:teuthology.orchestra.run.smithi105:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:21:25.370 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:21:25.370 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T03:21:25.370 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2024-09-21T03:21:25.381 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:21:25.381 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T03:21:25.381 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2024-09-21T03:21:25.381 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:21:25.381 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:21:25.387 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:21:25.387 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T03:21:25.387 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2024-09-21T03:21:25.387 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:21:25.387 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:21:25.387 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-21T03:21:25.387 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-21T03:21:25.387 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=29d80f4f-e5de-4b26-8384-24c2d8019945" will pass to kernel 2024-09-21T03:21:25.388 INFO:teuthology.orchestra.run.smithi105.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T03:21:25.388 INFO:teuthology.orchestra.run.smithi105.stdout: You just mounted a file system that supports labels which does not 2024-09-21T03:21:25.388 INFO:teuthology.orchestra.run.smithi105.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T03:21:25.388 INFO:teuthology.orchestra.run.smithi105.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T03:21:25.388 INFO:teuthology.orchestra.run.smithi105.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T03:21:25.389 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T03:21:25.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:21:25.389 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T03:21:25.414 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:21:25.504 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:21:25.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:21:25.515 INFO:teuthology.orchestra.run.smithi105.stdout:client5375 2024-09-21T03:21:25.516 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:21:25.516 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:21:25.533 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T03:21:25.685 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.683+0000 7f9d28120640 1 -- 172.21.15.105:0/3982895704 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d20070440 msgr2=0x7f9d200b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:25.685 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.683+0000 7f9d28120640 1 --2- 172.21.15.105:0/3982895704 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d20070440 0x7f9d200b3090 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f9d20070e70 tx=0x7f9d1802a980 comp rx=0 tx=0).stop 2024-09-21T03:21:25.685 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.683+0000 7f9d28120640 1 -- 172.21.15.105:0/3982895704 shutdown_connections 2024-09-21T03:21:25.685 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.683+0000 7f9d28120640 1 --2- 172.21.15.105:0/3982895704 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d20070440 0x7f9d200b3090 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:25.686 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.683+0000 7f9d28120640 1 --2- 172.21.15.105:0/3982895704 >> v2:172.21.15.162:3300/0 conn(0x7f9d20073170 0x7f9d2015c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:25.686 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.683+0000 7f9d28120640 1 -- 172.21.15.105:0/3982895704 >> 172.21.15.105:0/3982895704 conn(0x7f9d200b1cb0 msgr2=0x7f9d200b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:25.686 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.683+0000 7f9d28120640 1 -- 172.21.15.105:0/3982895704 shutdown_connections 2024-09-21T03:21:25.686 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.683+0000 7f9d28120640 1 -- 172.21.15.105:0/3982895704 wait complete. 2024-09-21T03:21:25.686 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.685+0000 7f9d28120640 1 Processor -- start 2024-09-21T03:21:25.687 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.685+0000 7f9d28120640 1 -- start start 2024-09-21T03:21:25.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.686+0000 7f9d28120640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d20070030 0x7f9d200c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:25.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.686+0000 7f9d28120640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d20070440 0x7f9d2015a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:25.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.686+0000 7f9d28120640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d20073170 0x7f9d200d0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:25.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.686+0000 7f9d28120640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9d200b3a40 con 0x7f9d20070030 2024-09-21T03:21:25.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.686+0000 7f9d28120640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9d200b38c0 con 0x7f9d20070440 2024-09-21T03:21:25.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.686+0000 7f9d28120640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9d200b3bc0 con 0x7f9d20073170 2024-09-21T03:21:25.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.686+0000 7f9d25ebc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d20070030 0x7f9d200c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:25.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.686+0000 7f9d25ebc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d20070030 0x7f9d200c98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58178/0 (socket says 172.21.15.105:58178) 2024-09-21T03:21:25.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.687+0000 7f9d25ebc640 1 -- 172.21.15.105:0/909067900 learned_addr learned my addr 172.21.15.105:0/909067900 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:25.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.687+0000 7f9d25ebc640 1 -- 172.21.15.105:0/909067900 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d20073170 msgr2=0x7f9d200d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:25.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.687+0000 7f9d25ebc640 1 --2- 172.21.15.105:0/909067900 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d20073170 0x7f9d200d0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:25.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.687+0000 7f9d25ebc640 1 -- 172.21.15.105:0/909067900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d20070440 msgr2=0x7f9d2015a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:25.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.687+0000 7f9d256bb640 1 --2- 172.21.15.105:0/909067900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d20070440 0x7f9d2015a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:25.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.687+0000 7f9d25ebc640 1 --2- 172.21.15.105:0/909067900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d20070440 0x7f9d2015a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:25.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.687+0000 7f9d25ebc640 1 -- 172.21.15.105:0/909067900 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d200cc0a0 con 0x7f9d20070030 2024-09-21T03:21:25.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.687+0000 7f9d256bb640 1 --2- 172.21.15.105:0/909067900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d20070440 0x7f9d2015a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:21:25.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.687+0000 7f9d25ebc640 1 --2- 172.21.15.105:0/909067900 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d20070030 0x7f9d200c98a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c00c970 tx=0x7f9d1c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:25.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.687+0000 7f9d167fc640 1 -- 172.21.15.105:0/909067900 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c007bb0 con 0x7f9d20070030 2024-09-21T03:21:25.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.687+0000 7f9d167fc640 1 -- 172.21.15.105:0/909067900 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d1c007e40 con 0x7f9d20070030 2024-09-21T03:21:25.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.687+0000 7f9d28120640 1 -- 172.21.15.105:0/909067900 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d200cc380 con 0x7f9d20070030 2024-09-21T03:21:25.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.687+0000 7f9d167fc640 1 -- 172.21.15.105:0/909067900 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c005280 con 0x7f9d20070030 2024-09-21T03:21:25.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.687+0000 7f9d28120640 1 -- 172.21.15.105:0/909067900 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d2009aa30 con 0x7f9d20070030 2024-09-21T03:21:25.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.688+0000 7f9d28120640 1 -- 172.21.15.105:0/909067900 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d200b40e0 con 0x7f9d20070030 2024-09-21T03:21:25.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.689+0000 7f9d167fc640 1 -- 172.21.15.105:0/909067900 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9d1c005420 con 0x7f9d20070030 2024-09-21T03:21:25.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.690+0000 7f9d167fc640 1 --2- 172.21.15.105:0/909067900 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9d04078bc0 0x7f9d0407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:25.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.690+0000 7f9d167fc640 1 -- 172.21.15.105:0/909067900 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f9d1c09b1e0 con 0x7f9d20070030 2024-09-21T03:21:25.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.690+0000 7f9d256bb640 1 --2- 172.21.15.105:0/909067900 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9d04078bc0 0x7f9d0407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:25.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.690+0000 7f9d256bb640 1 --2- 172.21.15.105:0/909067900 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9d04078bc0 0x7f9d0407b0d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9d200b27a0 tx=0x7f9d10008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:25.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.694+0000 7f9d167fc640 1 -- 172.21.15.105:0/909067900 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9d1c014030 con 0x7f9d20070030 2024-09-21T03:21:25.909 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.907+0000 7f9d28120640 1 -- 172.21.15.105:0/909067900 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9d200b52a0 con 0x7f9d20070030 2024-09-21T03:21:25.909 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.907+0000 7f9d167fc640 1 -- 172.21.15.105:0/909067900 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v38) ==== 53+0+73 (secure 0 0 0) 0x7f9d1c0636e0 con 0x7f9d20070030 2024-09-21T03:21:25.909 INFO:teuthology.orchestra.run.smithi105.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T03:21:25.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.910+0000 7f9d28120640 1 -- 172.21.15.105:0/909067900 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9d04078bc0 msgr2=0x7f9d0407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:25.912 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.910+0000 7f9d28120640 1 --2- 172.21.15.105:0/909067900 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9d04078bc0 0x7f9d0407b0d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9d200b27a0 tx=0x7f9d10008040 comp rx=0 tx=0).stop 2024-09-21T03:21:25.912 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.910+0000 7f9d28120640 1 -- 172.21.15.105:0/909067900 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d20070030 msgr2=0x7f9d200c98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:25.912 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.910+0000 7f9d28120640 1 --2- 172.21.15.105:0/909067900 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d20070030 0x7f9d200c98a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c00c970 tx=0x7f9d1c00ce30 comp rx=0 tx=0).stop 2024-09-21T03:21:25.912 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.910+0000 7f9d28120640 1 -- 172.21.15.105:0/909067900 shutdown_connections 2024-09-21T03:21:25.912 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.910+0000 7f9d28120640 1 --2- 172.21.15.105:0/909067900 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9d04078bc0 0x7f9d0407b0d0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:25.912 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.910+0000 7f9d28120640 1 --2- 172.21.15.105:0/909067900 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d20073170 0x7f9d200d0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:25.912 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.910+0000 7f9d28120640 1 --2- 172.21.15.105:0/909067900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d20070440 0x7f9d2015a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:25.912 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.910+0000 7f9d28120640 1 --2- 172.21.15.105:0/909067900 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d20070030 0x7f9d200c98a0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:25.912 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.910+0000 7f9d28120640 1 -- 172.21.15.105:0/909067900 >> 172.21.15.105:0/909067900 conn(0x7f9d200b1cb0 msgr2=0x7f9d200ad3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:25.912 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.910+0000 7f9d28120640 1 -- 172.21.15.105:0/909067900 shutdown_connections 2024-09-21T03:21:25.912 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:25.910+0000 7f9d28120640 1 -- 172.21.15.105:0/909067900 wait complete. 2024-09-21T03:21:25.922 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T03:21:25.923 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T03:21:25.923 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2024-09-21T03:21:25.923 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-21T03:21:25.923 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T03:21:25.923 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T03:21:25.923 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T03:21:25.923 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T03:21:25.923 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T03:21:25.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:21:25.923 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2024-09-21T03:21:25.943 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T03:21:25.943 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T03:21:25.943 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T03:21:25.944 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:21:25.944 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-09-21T03:21:25.944 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:21:25.944 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:21:25.944 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:21:25.944 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f0 2024-09-21T03:21:25.944 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:21:25.944 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:21:25.944 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f1 2024-09-21T03:21:25.944 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:21:25.944 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:21:25.944 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T03:21:25.944 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:21:25.944 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T03:21:25.945 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42614sec preferred_lft 42614sec 2024-09-21T03:21:25.945 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::ec4:7aff:fe88:7f41/64 scope link noprefixroute 2024-09-21T03:21:25.945 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:21:25.945 INFO:teuthology.orchestra.run.smithi162.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T03:21:25.945 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 32:ad:10:1b:86:54 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:21:25.945 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T03:21:25.945 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:21:25.945 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::c03a:6bff:febf:f5a9/64 scope link 2024-09-21T03:21:25.945 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:21:25.945 INFO:teuthology.orchestra.run.smithi162.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:21:25.945 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 32:ad:10:1b:86:54 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T03:21:25.945 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::30ad:10ff:fe1b:8654/64 scope link 2024-09-21T03:21:25.945 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:21:25.945 INFO:teuthology.orchestra.run.smithi162.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:21:25.945 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 6a:62:2d:53:ae:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-21T03:21:25.946 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::6862:2dff:fe53:aec0/64 scope link 2024-09-21T03:21:25.946 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:21:25.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:21:25.946 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T03:21:26.011 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-09-21T03:21:26.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:21:26.013 DEBUG:teuthology.orchestra.run.smithi162:> route 2024-09-21T03:21:26.072 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2024-09-21T03:21:26.072 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T03:21:26.072 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T03:21:26.072 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T03:21:26.072 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T03:21:26.072 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:21:26.072 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-09-21T03:21:26.072 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T03:21:26.072 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T03:21:26.072 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T03:21:26.073 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-09-21T03:21:26.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:21:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:21:26.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:21:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:21:26.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:21:26.206 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-09-21T03:21:26.222 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-21T03:21:26.222 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-21T03:21:26.222 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T03:21:26.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:21:26.223 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.0 up 2024-09-21T03:21:26.288 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:21:26.288 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-21T03:21:26.306 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:21:26.308 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:21:26.344 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-21T03:21:26.345 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:21:26.346 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-21T03:21:26.399 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-21T03:21:26.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:21:26.399 DEBUG:teuthology.orchestra.run.smithi162:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:21:26.492 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:21:26.492 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T03:21:26.492 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-21T03:21:26.503 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:21:26.503 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T03:21:26.503 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-21T03:21:26.503 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:21:26.503 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:21:26.508 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:21:26.508 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T03:21:26.509 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-21T03:21:26.509 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:21:26.509 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:21:26.509 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-21T03:21:26.509 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-21T03:21:26.510 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=29d80f4f-e5de-4b26-8384-24c2d8019945" will pass to kernel 2024-09-21T03:21:26.512 INFO:teuthology.orchestra.run.smithi162.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-21T03:21:26.512 INFO:teuthology.orchestra.run.smithi162.stdout: You just mounted a file system that supports labels which does not 2024-09-21T03:21:26.512 INFO:teuthology.orchestra.run.smithi162.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T03:21:26.512 INFO:teuthology.orchestra.run.smithi162.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T03:21:26.512 INFO:teuthology.orchestra.run.smithi162.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T03:21:26.513 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T03:21:26.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:21:26.513 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-21T03:21:26.538 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:21:26.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:21:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:21:26.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:21:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:21:26.634 INFO:teuthology.orchestra.run.smithi162.stdout:client6117 2024-09-21T03:21:26.635 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:21:26.635 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:21:26.651 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_min_caps_per_client 2024-09-21T03:21:26.769 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.766+0000 7f7b2d90b640 1 -- 172.21.15.105:0/2418593087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b280b9b60 msgr2=0x7f7b280d4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:26.769 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.766+0000 7f7b2d90b640 1 --2- 172.21.15.105:0/2418593087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b280b9b60 0x7f7b280d4d80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7b180098e0 tx=0x7f7b1802a4a0 comp rx=0 tx=0).stop 2024-09-21T03:21:26.769 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.766+0000 7f7b2d90b640 1 -- 172.21.15.105:0/2418593087 shutdown_connections 2024-09-21T03:21:26.769 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.766+0000 7f7b2d90b640 1 --2- 172.21.15.105:0/2418593087 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b280cf540 0x7f7b280b5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:26.770 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.766+0000 7f7b2d90b640 1 --2- 172.21.15.105:0/2418593087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b280b9b60 0x7f7b280d4d80 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:26.770 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.766+0000 7f7b2d90b640 1 -- 172.21.15.105:0/2418593087 >> 172.21.15.105:0/2418593087 conn(0x7f7b2809d7f0 msgr2=0x7f7b280d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:26.770 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.767+0000 7f7b2d90b640 1 -- 172.21.15.105:0/2418593087 shutdown_connections 2024-09-21T03:21:26.770 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.767+0000 7f7b2d90b640 1 -- 172.21.15.105:0/2418593087 wait complete. 2024-09-21T03:21:26.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.768+0000 7f7b2d90b640 1 Processor -- start 2024-09-21T03:21:26.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.768+0000 7f7b2d90b640 1 -- start start 2024-09-21T03:21:26.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.770+0000 7f7b2d90b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b280b64e0 0x7f7b280c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:26.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.770+0000 7f7b2d90b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b280b9b60 0x7f7b2815e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:26.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.770+0000 7f7b2d90b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b280cf540 0x7f7b2815e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:26.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.770+0000 7f7b2d90b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7b280d2e40 con 0x7f7b280b64e0 2024-09-21T03:21:26.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.770+0000 7f7b2d90b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7b280d2cc0 con 0x7f7b280b9b60 2024-09-21T03:21:26.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.770+0000 7f7b2d90b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7b280d2fc0 con 0x7f7b280cf540 2024-09-21T03:21:26.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.770+0000 7f7b26ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b280b64e0 0x7f7b280c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:26.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.770+0000 7f7b26ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b280b64e0 0x7f7b280c9e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58194/0 (socket says 172.21.15.105:58194) 2024-09-21T03:21:26.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.770+0000 7f7b26ffd640 1 -- 172.21.15.105:0/404922702 learned_addr learned my addr 172.21.15.105:0/404922702 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:26.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.770+0000 7f7b1e7fc640 1 --2- 172.21.15.105:0/404922702 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b280b9b60 0x7f7b2815e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:26.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.770+0000 7f7b277fe640 1 --2- 172.21.15.105:0/404922702 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b280cf540 0x7f7b2815e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:26.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.770+0000 7f7b26ffd640 1 -- 172.21.15.105:0/404922702 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b280cf540 msgr2=0x7f7b2815e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:26.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.770+0000 7f7b26ffd640 1 --2- 172.21.15.105:0/404922702 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b280cf540 0x7f7b2815e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:26.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.770+0000 7f7b26ffd640 1 -- 172.21.15.105:0/404922702 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b280b9b60 msgr2=0x7f7b2815e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:26.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.770+0000 7f7b26ffd640 1 --2- 172.21.15.105:0/404922702 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b280b9b60 0x7f7b2815e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:26.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.770+0000 7f7b26ffd640 1 -- 172.21.15.105:0/404922702 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b280ce6e0 con 0x7f7b280b64e0 2024-09-21T03:21:26.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.770+0000 7f7b26ffd640 1 --2- 172.21.15.105:0/404922702 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b280b64e0 0x7f7b280c9e10 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f7b18009a00 tx=0x7f7b180052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:26.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.771+0000 7f7b24ff9640 1 -- 172.21.15.105:0/404922702 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1803f070 con 0x7f7b280b64e0 2024-09-21T03:21:26.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.771+0000 7f7b24ff9640 1 -- 172.21.15.105:0/404922702 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b18004250 con 0x7f7b280b64e0 2024-09-21T03:21:26.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.771+0000 7f7b24ff9640 1 -- 172.21.15.105:0/404922702 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b18005cf0 con 0x7f7b280b64e0 2024-09-21T03:21:26.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.771+0000 7f7b2d90b640 1 -- 172.21.15.105:0/404922702 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b280c9330 con 0x7f7b280b64e0 2024-09-21T03:21:26.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.771+0000 7f7b2d90b640 1 -- 172.21.15.105:0/404922702 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b280c98f0 con 0x7f7b280b64e0 2024-09-21T03:21:26.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.772+0000 7f7b2d90b640 1 -- 172.21.15.105:0/404922702 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b280c9160 con 0x7f7b280b64e0 2024-09-21T03:21:26.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.772+0000 7f7b24ff9640 1 -- 172.21.15.105:0/404922702 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7b18042070 con 0x7f7b280b64e0 2024-09-21T03:21:26.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.773+0000 7f7b24ff9640 1 --2- 172.21.15.105:0/404922702 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7b08078b90 0x7f7b0807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:26.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.773+0000 7f7b24ff9640 1 -- 172.21.15.105:0/404922702 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f7b180bbb40 con 0x7f7b280b64e0 2024-09-21T03:21:26.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.773+0000 7f7b1e7fc640 1 --2- 172.21.15.105:0/404922702 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7b08078b90 0x7f7b0807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:26.780 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.774+0000 7f7b1e7fc640 1 --2- 172.21.15.105:0/404922702 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7b08078b90 0x7f7b0807b0a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7b100095f0 tx=0x7f7b10005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:26.780 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.777+0000 7f7b24ff9640 1 -- 172.21.15.105:0/404922702 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7b18083940 con 0x7f7b280b64e0 2024-09-21T03:21:26.958 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.956+0000 7f7b2d90b640 1 -- 172.21.15.105:0/404922702 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_min_caps_per_client"} v 0) -- 0x7f7b280d3470 con 0x7f7b280b64e0 2024-09-21T03:21:26.958 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.956+0000 7f7b24ff9640 1 -- 172.21.15.105:0/404922702 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_min_caps_per_client"}]=0 v40) ==== 106+0+4 (secure 0 0 0) 0x7f7b18088370 con 0x7f7b280b64e0 2024-09-21T03:21:26.958 INFO:teuthology.orchestra.run.smithi105.stdout:100 2024-09-21T03:21:26.961 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.958+0000 7f7b2d90b640 1 -- 172.21.15.105:0/404922702 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7b08078b90 msgr2=0x7f7b0807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:26.961 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.958+0000 7f7b2d90b640 1 --2- 172.21.15.105:0/404922702 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7b08078b90 0x7f7b0807b0a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7b100095f0 tx=0x7f7b10005f90 comp rx=0 tx=0).stop 2024-09-21T03:21:26.961 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.958+0000 7f7b2d90b640 1 -- 172.21.15.105:0/404922702 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b280b64e0 msgr2=0x7f7b280c9e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:26.961 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.958+0000 7f7b2d90b640 1 --2- 172.21.15.105:0/404922702 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b280b64e0 0x7f7b280c9e10 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f7b18009a00 tx=0x7f7b180052f0 comp rx=0 tx=0).stop 2024-09-21T03:21:26.961 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.958+0000 7f7b2d90b640 1 -- 172.21.15.105:0/404922702 shutdown_connections 2024-09-21T03:21:26.962 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.958+0000 7f7b2d90b640 1 --2- 172.21.15.105:0/404922702 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7b08078b90 0x7f7b0807b0a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:26.962 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.958+0000 7f7b2d90b640 1 --2- 172.21.15.105:0/404922702 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b280cf540 0x7f7b2815e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:26.962 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.958+0000 7f7b2d90b640 1 --2- 172.21.15.105:0/404922702 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b280b9b60 0x7f7b2815e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:26.962 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.958+0000 7f7b2d90b640 1 --2- 172.21.15.105:0/404922702 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b280b64e0 0x7f7b280c9e10 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:26.962 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.958+0000 7f7b2d90b640 1 -- 172.21.15.105:0/404922702 >> 172.21.15.105:0/404922702 conn(0x7f7b2809d7f0 msgr2=0x7f7b280b1350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:26.962 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.958+0000 7f7b2d90b640 1 -- 172.21.15.105:0/404922702 shutdown_connections 2024-09-21T03:21:26.962 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:26.958+0000 7f7b2d90b640 1 -- 172.21.15.105:0/404922702 wait complete. 2024-09-21T03:21:26.972 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_max_caps_per_client 200 2024-09-21T03:21:27.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.087+0000 7f0c9cd6e640 1 -- 172.21.15.105:0/1046388898 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c98070e40 msgr2=0x7f0c9815f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:27.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.087+0000 7f0c9cd6e640 1 --2- 172.21.15.105:0/1046388898 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c98070e40 0x7f0c9815f2a0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c009830 tx=0x7f0c8c02a5c0 comp rx=0 tx=0).stop 2024-09-21T03:21:27.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.087+0000 7f0c9cd6e640 1 -- 172.21.15.105:0/1046388898 shutdown_connections 2024-09-21T03:21:27.091 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.087+0000 7f0c9cd6e640 1 --2- 172.21.15.105:0/1046388898 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c98070e40 0x7f0c9815f2a0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:27.091 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.087+0000 7f0c9cd6e640 1 -- 172.21.15.105:0/1046388898 >> 172.21.15.105:0/1046388898 conn(0x7f0c980cd530 msgr2=0x7f0c980cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:27.091 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.087+0000 7f0c9cd6e640 1 -- 172.21.15.105:0/1046388898 shutdown_connections 2024-09-21T03:21:27.091 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.087+0000 7f0c9cd6e640 1 -- 172.21.15.105:0/1046388898 wait complete. 2024-09-21T03:21:27.097 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.089+0000 7f0c9cd6e640 1 Processor -- start 2024-09-21T03:21:27.097 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.089+0000 7f0c9cd6e640 1 -- start start 2024-09-21T03:21:27.097 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.090+0000 7f0c9cd6e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c98070e40 0x7f0c98140150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:27.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.090+0000 7f0c9cd6e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c98075fa0 0x7f0c981e6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:27.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.090+0000 7f0c9cd6e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c9815f7e0 0x7f0c981f2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:27.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.090+0000 7f0c9cd6e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0c980cf1a0 con 0x7f0c9815f7e0 2024-09-21T03:21:27.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.090+0000 7f0c9cd6e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0c980cf020 con 0x7f0c98070e40 2024-09-21T03:21:27.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.090+0000 7f0c9cd6e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0c980cf320 con 0x7f0c98075fa0 2024-09-21T03:21:27.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.090+0000 7f0c96d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c9815f7e0 0x7f0c981f2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:27.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.091+0000 7f0c96d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c9815f7e0 0x7f0c981f2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58220/0 (socket says 172.21.15.105:58220) 2024-09-21T03:21:27.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.091+0000 7f0c96d9d640 1 -- 172.21.15.105:0/3943040359 learned_addr learned my addr 172.21.15.105:0/3943040359 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:27.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.091+0000 7f0c9659c640 1 --2- 172.21.15.105:0/3943040359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c98070e40 0x7f0c98140150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:27.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.091+0000 7f0c95d9b640 1 --2- 172.21.15.105:0/3943040359 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c98075fa0 0x7f0c981e6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:27.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.091+0000 7f0c96d9d640 1 -- 172.21.15.105:0/3943040359 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c98075fa0 msgr2=0x7f0c981e6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:27.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.091+0000 7f0c96d9d640 1 --2- 172.21.15.105:0/3943040359 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c98075fa0 0x7f0c981e6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:27.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.091+0000 7f0c96d9d640 1 -- 172.21.15.105:0/3943040359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c98070e40 msgr2=0x7f0c98140150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:27.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.091+0000 7f0c96d9d640 1 --2- 172.21.15.105:0/3943040359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c98070e40 0x7f0c98140150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:27.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.091+0000 7f0c96d9d640 1 -- 172.21.15.105:0/3943040359 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c980c5d50 con 0x7f0c9815f7e0 2024-09-21T03:21:27.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.091+0000 7f0c96d9d640 1 --2- 172.21.15.105:0/3943040359 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c9815f7e0 0x7f0c981f2180 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f0c9000e640 tx=0x7f0c9000eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:27.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.091+0000 7f0c86ffd640 1 -- 172.21.15.105:0/3943040359 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c900052d0 con 0x7f0c9815f7e0 2024-09-21T03:21:27.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.091+0000 7f0c86ffd640 1 -- 172.21.15.105:0/3943040359 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c9000c780 con 0x7f0c9815f7e0 2024-09-21T03:21:27.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.091+0000 7f0c9cd6e640 1 -- 172.21.15.105:0/3943040359 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c980c6030 con 0x7f0c9815f7e0 2024-09-21T03:21:27.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.091+0000 7f0c86ffd640 1 -- 172.21.15.105:0/3943040359 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c9000cb90 con 0x7f0c9815f7e0 2024-09-21T03:21:27.101 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.091+0000 7f0c9cd6e640 1 -- 172.21.15.105:0/3943040359 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c980c65f0 con 0x7f0c9815f7e0 2024-09-21T03:21:27.101 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.092+0000 7f0c9cd6e640 1 -- 172.21.15.105:0/3943040359 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c980cf8b0 con 0x7f0c9815f7e0 2024-09-21T03:21:27.101 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.093+0000 7f0c86ffd640 1 -- 172.21.15.105:0/3943040359 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0c900035f0 con 0x7f0c9815f7e0 2024-09-21T03:21:27.101 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.094+0000 7f0c86ffd640 1 --2- 172.21.15.105:0/3943040359 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0c78078b90 0x7f0c7807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:27.101 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.094+0000 7f0c86ffd640 1 -- 172.21.15.105:0/3943040359 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f0c9009d000 con 0x7f0c9815f7e0 2024-09-21T03:21:27.101 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.094+0000 7f0c9659c640 1 --2- 172.21.15.105:0/3943040359 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0c78078b90 0x7f0c7807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:27.102 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.094+0000 7f0c9659c640 1 --2- 172.21.15.105:0/3943040359 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0c78078b90 0x7f0c7807b0a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0c88004a30 tx=0x7f0c88001a50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:27.102 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.098+0000 7f0c86ffd640 1 -- 172.21.15.105:0/3943040359 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0c90016020 con 0x7f0c9815f7e0 2024-09-21T03:21:27.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.277+0000 7f0c9cd6e640 1 -- 172.21.15.105:0/3943040359 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command([{prefix=config set, name=mds_max_caps_per_client}] v 0) -- 0x7f0c98160120 con 0x7f0c9815f7e0 2024-09-21T03:21:27.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.280+0000 7f0c86ffd640 1 -- 172.21.15.105:0/3943040359 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_max_caps_per_client}]=0 v41)=0 v41) ==== 123+0+0 (secure 0 0 0) 0x7f0c9815fbf0 con 0x7f0c9815f7e0 2024-09-21T03:21:27.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.283+0000 7f0c9cd6e640 1 -- 172.21.15.105:0/3943040359 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0c78078b90 msgr2=0x7f0c7807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:27.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.283+0000 7f0c9cd6e640 1 --2- 172.21.15.105:0/3943040359 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0c78078b90 0x7f0c7807b0a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0c88004a30 tx=0x7f0c88001a50 comp rx=0 tx=0).stop 2024-09-21T03:21:27.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.283+0000 7f0c9cd6e640 1 -- 172.21.15.105:0/3943040359 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c9815f7e0 msgr2=0x7f0c981f2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:27.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.283+0000 7f0c9cd6e640 1 --2- 172.21.15.105:0/3943040359 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c9815f7e0 0x7f0c981f2180 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f0c9000e640 tx=0x7f0c9000eb00 comp rx=0 tx=0).stop 2024-09-21T03:21:27.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.283+0000 7f0c9cd6e640 1 -- 172.21.15.105:0/3943040359 shutdown_connections 2024-09-21T03:21:27.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.283+0000 7f0c9cd6e640 1 --2- 172.21.15.105:0/3943040359 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0c78078b90 0x7f0c7807b0a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:27.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.283+0000 7f0c9cd6e640 1 --2- 172.21.15.105:0/3943040359 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c9815f7e0 0x7f0c981f2180 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:27.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.283+0000 7f0c9cd6e640 1 --2- 172.21.15.105:0/3943040359 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c98075fa0 0x7f0c981e6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:27.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.283+0000 7f0c9cd6e640 1 --2- 172.21.15.105:0/3943040359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c98070e40 0x7f0c98140150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:27.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.283+0000 7f0c9cd6e640 1 -- 172.21.15.105:0/3943040359 >> 172.21.15.105:0/3943040359 conn(0x7f0c980cd530 msgr2=0x7f0c9815e860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:27.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.283+0000 7f0c9cd6e640 1 -- 172.21.15.105:0/3943040359 shutdown_connections 2024-09-21T03:21:27.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:27.283+0000 7f0c9cd6e640 1 -- 172.21.15.105:0/3943040359 wait complete. 2024-09-21T03:21:27.296 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:21:27.296 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:21:27.312 DEBUG:teuthology.orchestra.run.smithi105:> stdin-killer -- python3 -c ' 2024-09-21T03:21:27.313 DEBUG:teuthology.orchestra.run.smithi105:> import os 2024-09-21T03:21:27.313 DEBUG:teuthology.orchestra.run.smithi105:> import uuid 2024-09-21T03:21:27.313 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-21T03:21:27.313 DEBUG:teuthology.orchestra.run.smithi105:> n = 600 2024-09-21T03:21:27.313 DEBUG:teuthology.orchestra.run.smithi105:> create_hard_links = False 2024-09-21T03:21:27.313 DEBUG:teuthology.orchestra.run.smithi105:> if 0 > 0: 2024-09-21T03:21:27.313 DEBUG:teuthology.orchestra.run.smithi105:> create_hard_links = True 2024-09-21T03:21:27.313 DEBUG:teuthology.orchestra.run.smithi105:> path = "/home/ubuntu/cephtest/mnt.0/foo/" 2024-09-21T03:21:27.313 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-21T03:21:27.313 DEBUG:teuthology.orchestra.run.smithi105:> dpath = os.path.dirname(path) 2024-09-21T03:21:27.313 DEBUG:teuthology.orchestra.run.smithi105:> fnameprefix = os.path.basename(path) 2024-09-21T03:21:27.313 DEBUG:teuthology.orchestra.run.smithi105:> os.makedirs(dpath, exist_ok=True) 2024-09-21T03:21:27.313 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-21T03:21:27.313 DEBUG:teuthology.orchestra.run.smithi105:> try: 2024-09-21T03:21:27.313 DEBUG:teuthology.orchestra.run.smithi105:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-21T03:21:27.314 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-21T03:21:27.314 DEBUG:teuthology.orchestra.run.smithi105:> for i in range(n): 2024-09-21T03:21:27.314 DEBUG:teuthology.orchestra.run.smithi105:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-21T03:21:27.314 DEBUG:teuthology.orchestra.run.smithi105:> with open(fpath, '"'"'w'"'"') as f: 2024-09-21T03:21:27.314 DEBUG:teuthology.orchestra.run.smithi105:> f.write(f"{i}") 2024-09-21T03:21:27.314 DEBUG:teuthology.orchestra.run.smithi105:> if True: 2024-09-21T03:21:27.314 DEBUG:teuthology.orchestra.run.smithi105:> f.flush() 2024-09-21T03:21:27.314 DEBUG:teuthology.orchestra.run.smithi105:> os.fsync(f.fileno()) 2024-09-21T03:21:27.314 DEBUG:teuthology.orchestra.run.smithi105:> if False: 2024-09-21T03:21:27.314 DEBUG:teuthology.orchestra.run.smithi105:> os.unlink(fpath) 2024-09-21T03:21:27.314 DEBUG:teuthology.orchestra.run.smithi105:> if False: 2024-09-21T03:21:27.314 DEBUG:teuthology.orchestra.run.smithi105:> os.fsync(dirfd) 2024-09-21T03:21:27.314 DEBUG:teuthology.orchestra.run.smithi105:> if create_hard_links: 2024-09-21T03:21:27.314 DEBUG:teuthology.orchestra.run.smithi105:> for j in range(0): 2024-09-21T03:21:27.315 DEBUG:teuthology.orchestra.run.smithi105:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-21T03:21:27.315 DEBUG:teuthology.orchestra.run.smithi105:> if False: 2024-09-21T03:21:27.315 DEBUG:teuthology.orchestra.run.smithi105:> os.fsync(dirfd) 2024-09-21T03:21:27.315 DEBUG:teuthology.orchestra.run.smithi105:> finally: 2024-09-21T03:21:27.315 DEBUG:teuthology.orchestra.run.smithi105:> os.close(dirfd) 2024-09-21T03:21:27.315 DEBUG:teuthology.orchestra.run.smithi105:> ' 2024-09-21T03:21:30.105 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:21:30.110 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:21:30.110 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:21:30.167 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:21:30.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:21:30.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:21:30.263 INFO:teuthology.orchestra.run.smithi105.stdout:client5375 2024-09-21T03:21:30.263 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:21:30.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.377+0000 7f5b7b227640 1 -- 172.21.15.105:0/3335010452 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b740b66b0 msgr2=0x7f5b740d4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:30.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.377+0000 7f5b7b227640 1 --2- 172.21.15.105:0/3335010452 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b740b66b0 0x7f5b740d4d80 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f5b64009830 tx=0x7f5b6402a3f0 comp rx=0 tx=0).stop 2024-09-21T03:21:30.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.377+0000 7f5b7b227640 1 -- 172.21.15.105:0/3335010452 shutdown_connections 2024-09-21T03:21:30.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.377+0000 7f5b7b227640 1 --2- 172.21.15.105:0/3335010452 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b740cf540 0x7f5b7406eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:30.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.377+0000 7f5b7b227640 1 --2- 172.21.15.105:0/3335010452 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b740b66b0 0x7f5b740d4d80 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:30.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.377+0000 7f5b7b227640 1 -- 172.21.15.105:0/3335010452 >> 172.21.15.105:0/3335010452 conn(0x7f5b7409d7f0 msgr2=0x7f5b740d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:30.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.377+0000 7f5b7b227640 1 -- 172.21.15.105:0/3335010452 shutdown_connections 2024-09-21T03:21:30.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.377+0000 7f5b7b227640 1 -- 172.21.15.105:0/3335010452 wait complete. 2024-09-21T03:21:30.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.379+0000 7f5b7b227640 1 Processor -- start 2024-09-21T03:21:30.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.379+0000 7f5b7b227640 1 -- start start 2024-09-21T03:21:30.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.380+0000 7f5b7b227640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b740b9b60 0x7f5b740a1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:30.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.380+0000 7f5b7b227640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b740cf540 0x7f5b7415f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:30.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.380+0000 7f5b7b227640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b741f5cb0 0x7f5b741f50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:30.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.380+0000 7f5b7b227640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7406f630 con 0x7f5b740cf540 2024-09-21T03:21:30.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.380+0000 7f5b7b227640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7406f4b0 con 0x7f5b740b9b60 2024-09-21T03:21:30.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.380+0000 7f5b7b227640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5b7406f7b0 con 0x7f5b741f5cb0 2024-09-21T03:21:30.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.380+0000 7f5b6bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b740cf540 0x7f5b7415f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:30.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.380+0000 7f5b6bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b740cf540 0x7f5b7415f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58226/0 (socket says 172.21.15.105:58226) 2024-09-21T03:21:30.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.380+0000 7f5b6bfff640 1 -- 172.21.15.105:0/2329680686 learned_addr learned my addr 172.21.15.105:0/2329680686 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:30.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.380+0000 7f5b797c4640 1 --2- 172.21.15.105:0/2329680686 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b741f5cb0 0x7f5b741f50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:30.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.380+0000 7f5b78fc3640 1 --2- 172.21.15.105:0/2329680686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b740b9b60 0x7f5b740a1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:30.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.381+0000 7f5b6bfff640 1 -- 172.21.15.105:0/2329680686 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b741f5cb0 msgr2=0x7f5b741f50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:30.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.381+0000 7f5b6bfff640 1 --2- 172.21.15.105:0/2329680686 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b741f5cb0 0x7f5b741f50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:30.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.381+0000 7f5b6bfff640 1 -- 172.21.15.105:0/2329680686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b740b9b60 msgr2=0x7f5b740a1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:30.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.381+0000 7f5b6bfff640 1 --2- 172.21.15.105:0/2329680686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b740b9b60 0x7f5b740a1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:30.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.381+0000 7f5b6bfff640 1 -- 172.21.15.105:0/2329680686 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b740cc1a0 con 0x7f5b740cf540 2024-09-21T03:21:30.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.381+0000 7f5b6bfff640 1 --2- 172.21.15.105:0/2329680686 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b740cf540 0x7f5b7415f840 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f5b6402a9e0 tx=0x7f5b64033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:30.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.381+0000 7f5b697fa640 1 -- 172.21.15.105:0/2329680686 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b64031d60 con 0x7f5b740cf540 2024-09-21T03:21:30.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.381+0000 7f5b697fa640 1 -- 172.21.15.105:0/2329680686 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b64033e10 con 0x7f5b740cf540 2024-09-21T03:21:30.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.381+0000 7f5b7b227640 1 -- 172.21.15.105:0/2329680686 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b740cc480 con 0x7f5b740cf540 2024-09-21T03:21:30.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.381+0000 7f5b697fa640 1 -- 172.21.15.105:0/2329680686 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b64005260 con 0x7f5b740cf540 2024-09-21T03:21:30.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.381+0000 7f5b7b227640 1 -- 172.21.15.105:0/2329680686 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b740cca40 con 0x7f5b740cf540 2024-09-21T03:21:30.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.382+0000 7f5b7b227640 1 -- 172.21.15.105:0/2329680686 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b7406fcd0 con 0x7f5b740cf540 2024-09-21T03:21:30.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.383+0000 7f5b697fa640 1 -- 172.21.15.105:0/2329680686 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5b64005400 con 0x7f5b740cf540 2024-09-21T03:21:30.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.383+0000 7f5b697fa640 1 --2- 172.21.15.105:0/2329680686 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5b60078b90 0x7f5b6007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:30.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.383+0000 7f5b697fa640 1 -- 172.21.15.105:0/2329680686 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f5b640bbf80 con 0x7f5b740cf540 2024-09-21T03:21:30.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.384+0000 7f5b78fc3640 1 --2- 172.21.15.105:0/2329680686 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5b60078b90 0x7f5b6007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:30.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.384+0000 7f5b78fc3640 1 --2- 172.21.15.105:0/2329680686 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5b60078b90 0x7f5b6007b0a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5b700016f0 tx=0x7f5b70009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:30.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.388+0000 7f5b697fa640 1 -- 172.21.15.105:0/2329680686 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5b6403f030 con 0x7f5b740cf540 2024-09-21T03:21:30.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.602+0000 7f5b7b227640 1 -- 172.21.15.105:0/2329680686 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5b740d3fb0 con 0x7f5b740cf540 2024-09-21T03:21:30.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.603+0000 7f5b697fa640 1 -- 172.21.15.105:0/2329680686 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5234 (secure 0 0 0) 0x7f5b64083d70 con 0x7f5b740cf540 2024-09-21T03:21:30.605 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:30.605 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":38,"btime":"2024-09-21T03:21:17:305276+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5593,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2041248590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2041248590},{"type":"v1","addr":"172.21.15.162:6836","nonce":2041248590}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5596,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/775014606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":775014606},{"type":"v1","addr":"172.21.15.162:6837","nonce":775014606}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5937,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3799275472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3799275472},{"type":"v1","addr":"172.21.15.105:6833","nonce":3799275472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:21:14.660239+0000","modified":"2024-09-21T03:21:16.660264+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5940},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5940":{"gid":5940,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1561028223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1561028223},{"type":"v1","addr":"172.21.15.105:6835","nonce":1561028223}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5940,"qdb_cluster":[5940]},"id":5}]} 2024-09-21T03:21:30.605 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 38 2024-09-21T03:21:30.607 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.605+0000 7f5b7b227640 1 -- 172.21.15.105:0/2329680686 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5b60078b90 msgr2=0x7f5b6007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:30.607 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.605+0000 7f5b7b227640 1 --2- 172.21.15.105:0/2329680686 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5b60078b90 0x7f5b6007b0a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5b700016f0 tx=0x7f5b70009040 comp rx=0 tx=0).stop 2024-09-21T03:21:30.607 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.605+0000 7f5b7b227640 1 -- 172.21.15.105:0/2329680686 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b740cf540 msgr2=0x7f5b7415f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:30.607 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.605+0000 7f5b7b227640 1 --2- 172.21.15.105:0/2329680686 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b740cf540 0x7f5b7415f840 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f5b6402a9e0 tx=0x7f5b64033c20 comp rx=0 tx=0).stop 2024-09-21T03:21:30.607 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.605+0000 7f5b7b227640 1 -- 172.21.15.105:0/2329680686 shutdown_connections 2024-09-21T03:21:30.608 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.605+0000 7f5b7b227640 1 --2- 172.21.15.105:0/2329680686 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5b60078b90 0x7f5b6007b0a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:30.608 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.605+0000 7f5b7b227640 1 --2- 172.21.15.105:0/2329680686 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b741f5cb0 0x7f5b741f50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:30.608 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.605+0000 7f5b7b227640 1 --2- 172.21.15.105:0/2329680686 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b740cf540 0x7f5b7415f840 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:30.608 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.605+0000 7f5b7b227640 1 --2- 172.21.15.105:0/2329680686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b740b9b60 0x7f5b740a1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:30.608 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.605+0000 7f5b7b227640 1 -- 172.21.15.105:0/2329680686 >> 172.21.15.105:0/2329680686 conn(0x7f5b7409d7f0 msgr2=0x7f5b741e7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:30.608 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.605+0000 7f5b7b227640 1 -- 172.21.15.105:0/2329680686 shutdown_connections 2024-09-21T03:21:30.608 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:30.605+0000 7f5b7b227640 1 -- 172.21.15.105:0/2329680686 wait complete. 2024-09-21T03:21:30.618 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-21T03:21:30.742 INFO:teuthology.orchestra.run.smithi105.stdout:[{"id":6117,"entity":{"name":{"type":"client","num":6117},"addr":{"type":"v1","addr":"172.21.15.162:0","nonce":3860319644}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":4.2269139789999999,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.9750490658435496,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.6117 v1:172.21.15.162:0/3860319644","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi162","kernel_version":"5.14.0-508.el9.x86_64","root":"/"}},{"id":5375,"entity":{"name":{"type":"client","num":5375},"addr":{"type":"v1","addr":"172.21.15.105:0","nonce":3372869439}},"state":"open","num_leases":1,"num_caps":602,"request_load_avg":614,"uptime":5.3488911449999996,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":819.16880462928555,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":578.84760680753163,"halflife":1.5},"recall_caps_throttle2o":{"value":320.45852596517636,"halflife":0.5},"session_cache_liveness":{"value":1199.4982687869222,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":630,"last_trim_completed_flushes_tid":601,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.5375 v1:172.21.15.105:0/3372869439","completed_requests":[],"prealloc_inos":[{"start":"0x10000000002","length":500},{"start":"0x1000000044d","length":903}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi105","kernel_version":"5.14.0-508.el9.x86_64","root":"/"}}] 2024-09-21T03:21:30.743 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi162", "kernel_version": "5.14.0-508.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.162:0", "nonce": 3860319644, "type": "v1" }, "name": { "num": 6117, "type": "client" } }, "id": 6117, "inst": "client.6117 v1:172.21.15.162:0/3860319644", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.9750490658435496 }, "state": "open", "uptime": 4.226913979 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi105", "kernel_version": "5.14.0-508.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "172.21.15.105:0", "nonce": 3372869439, "type": "v1" }, "name": { "num": 5375, "type": "client" } }, "id": 5375, "inst": "client.5375 v1:172.21.15.105:0/3372869439", "last_trim_completed_flushes_tid": 601, "last_trim_completed_requests_tid": 630, "num_caps": 602, "num_completed_flushes": 1, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000002" }, { "length": 903, "start": "0x1000000044d" } ], "recall_caps": { "halflife": 60, "value": 819.1688046292855 }, "recall_caps_throttle": { "halflife": 1.5, "value": 578.8476068075316 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 320.45852596517636 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 614, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 1199.4982687869222 }, "state": "open", "uptime": 5.348891145 } ] 2024-09-21T03:21:30.743 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-09-21T03:21:35.745 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:21:35.871 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:35.869+0000 7f773316e640 1 -- 172.21.15.105:0/2691515222 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7714004800 msgr2=0x7f7714004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:35.871 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:35.869+0000 7f773316e640 1 --2- 172.21.15.105:0/2691515222 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7714004800 0x7f7714004c10 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f772c0b7120 tx=0x7f7714005830 comp rx=0 tx=0).stop 2024-09-21T03:21:35.871 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:35.869+0000 7f773170b640 1 -- 172.21.15.105:0/2691515222 reap_dead start 2024-09-21T03:21:35.871 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:35.869+0000 7f773316e640 1 -- 172.21.15.105:0/2691515222 shutdown_connections 2024-09-21T03:21:35.871 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:35.869+0000 7f773316e640 1 -- 172.21.15.105:0/2691515222 >> 172.21.15.105:0/2691515222 conn(0x7f772c08bfc0 msgr2=0x7f772c09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:35.871 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:35.869+0000 7f773316e640 1 -- 172.21.15.105:0/2691515222 shutdown_connections 2024-09-21T03:21:35.871 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:35.869+0000 7f773316e640 1 -- 172.21.15.105:0/2691515222 wait complete. 2024-09-21T03:21:35.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:35.871+0000 7f773316e640 1 Processor -- start 2024-09-21T03:21:35.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:35.871+0000 7f773316e640 1 -- start start 2024-09-21T03:21:35.875 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:35.872+0000 7f773316e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7714004800 0x7f772c0c9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:35.875 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:35.872+0000 7f773316e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f772c0cb350 0x7f772c155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:35.875 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:35.872+0000 7f773316e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f772c0b1e90 0x7f772c0b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:35.875 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:35.872+0000 7f773316e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f772c0cfd70 con 0x7f7714004800 2024-09-21T03:21:35.876 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:35.872+0000 7f773316e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f772c0cfbf0 con 0x7f772c0b1e90 2024-09-21T03:21:35.876 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:35.872+0000 7f773316e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f772c0cfef0 con 0x7f772c0cb350 2024-09-21T03:21:35.876 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:35.872+0000 7f7730f0a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7714004800 0x7f772c0c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:35.876 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:35.872+0000 7f7730f0a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7714004800 0x7f772c0c9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:50424/0 (socket says 172.21.15.105:50424) 2024-09-21T03:21:35.876 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:35.872+0000 7f7730f0a640 1 -- 172.21.15.105:0/478693722 learned_addr learned my addr 172.21.15.105:0/478693722 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:35.876 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:35.873+0000 7f773170b640 1 --2- 172.21.15.105:0/478693722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f772c0b1e90 0x7f772c0b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:35.876 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:35.873+0000 7f7730f0a640 1 -- 172.21.15.105:0/478693722 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f772c0cb350 msgr2=0x7f772c155bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:35.876 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:35.873+0000 7f7723fff640 1 --2- 172.21.15.105:0/478693722 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f772c0cb350 0x7f772c155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:35.876 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:35.873+0000 7f7730f0a640 1 --2- 172.21.15.105:0/478693722 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f772c0cb350 0x7f772c155bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:35.876 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:35.873+0000 7f7730f0a640 1 -- 172.21.15.105:0/478693722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f772c0b1e90 msgr2=0x7f772c0b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:35.876 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:35.873+0000 7f7730f0a640 1 --2- 172.21.15.105:0/478693722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f772c0b1e90 0x7f772c0b22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:35.876 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:35.873+0000 7f7730f0a640 1 -- 172.21.15.105:0/478693722 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f772c0b27e0 con 0x7f7714004800 2024-09-21T03:21:35.876 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:35.873+0000 7f7723fff640 1 --2- 172.21.15.105:0/478693722 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f772c0cb350 0x7f772c155bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:21:35.877 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:35.873+0000 7f7730f0a640 1 --2- 172.21.15.105:0/478693722 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7714004800 0x7f772c0c9610 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f7728003f30 tx=0x7f772800f7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:35.877 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:35.873+0000 7f77217fa640 1 -- 172.21.15.105:0/478693722 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7728015070 con 0x7f7714004800 2024-09-21T03:21:35.877 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:35.873+0000 7f77217fa640 1 -- 172.21.15.105:0/478693722 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7728011840 con 0x7f7714004800 2024-09-21T03:21:35.877 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:35.873+0000 7f773316e640 1 -- 172.21.15.105:0/478693722 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f772c1f91e0 con 0x7f7714004800 2024-09-21T03:21:35.877 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:35.873+0000 7f77217fa640 1 -- 172.21.15.105:0/478693722 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7728011c70 con 0x7f7714004800 2024-09-21T03:21:35.877 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:35.873+0000 7f773316e640 1 -- 172.21.15.105:0/478693722 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f772c1f94c0 con 0x7f7714004800 2024-09-21T03:21:35.878 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:35.874+0000 7f773316e640 1 -- 172.21.15.105:0/478693722 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f772c163170 con 0x7f7714004800 2024-09-21T03:21:35.878 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:35.875+0000 7f77217fa640 1 -- 172.21.15.105:0/478693722 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7728018070 con 0x7f7714004800 2024-09-21T03:21:35.878 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:35.876+0000 7f77217fa640 1 --2- 172.21.15.105:0/478693722 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7718078bc0 0x7f771807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:35.878 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:35.876+0000 7f77217fa640 1 -- 172.21.15.105:0/478693722 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f772809b340 con 0x7f7714004800 2024-09-21T03:21:35.878 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:35.876+0000 7f7723fff640 1 --2- 172.21.15.105:0/478693722 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7718078bc0 0x7f771807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:35.878 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:35.876+0000 7f7723fff640 1 --2- 172.21.15.105:0/478693722 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7718078bc0 0x7f771807b0d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f771c035000 tx=0x7f771c02d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:35.882 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:35.880+0000 7f77217fa640 1 -- 172.21.15.105:0/478693722 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f772c0b27e0 con 0x7f7714004800 2024-09-21T03:21:36.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.092+0000 7f773316e640 1 -- 172.21.15.105:0/478693722 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f772c0b4020 con 0x7f7714004800 2024-09-21T03:21:36.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.093+0000 7f77217fa640 1 -- 172.21.15.105:0/478693722 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5234 (secure 0 0 0) 0x7f7728063810 con 0x7f7714004800 2024-09-21T03:21:36.095 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:36.095 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":38,"btime":"2024-09-21T03:21:17:305276+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5593,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2041248590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2041248590},{"type":"v1","addr":"172.21.15.162:6836","nonce":2041248590}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5596,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/775014606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":775014606},{"type":"v1","addr":"172.21.15.162:6837","nonce":775014606}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5937,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3799275472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3799275472},{"type":"v1","addr":"172.21.15.105:6833","nonce":3799275472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:21:14.660239+0000","modified":"2024-09-21T03:21:16.660264+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5940},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5940":{"gid":5940,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1561028223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1561028223},{"type":"v1","addr":"172.21.15.105:6835","nonce":1561028223}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5940,"qdb_cluster":[5940]},"id":5}]} 2024-09-21T03:21:36.095 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 38 2024-09-21T03:21:36.097 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.095+0000 7f773316e640 1 -- 172.21.15.105:0/478693722 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7718078bc0 msgr2=0x7f771807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:36.097 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.095+0000 7f773316e640 1 --2- 172.21.15.105:0/478693722 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7718078bc0 0x7f771807b0d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f771c035000 tx=0x7f771c02d040 comp rx=0 tx=0).stop 2024-09-21T03:21:36.097 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.095+0000 7f773316e640 1 -- 172.21.15.105:0/478693722 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7714004800 msgr2=0x7f772c0c9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:36.097 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.095+0000 7f773316e640 1 --2- 172.21.15.105:0/478693722 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7714004800 0x7f772c0c9610 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f7728003f30 tx=0x7f772800f7e0 comp rx=0 tx=0).stop 2024-09-21T03:21:36.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.095+0000 7f773316e640 1 -- 172.21.15.105:0/478693722 shutdown_connections 2024-09-21T03:21:36.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.095+0000 7f773316e640 1 --2- 172.21.15.105:0/478693722 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7718078bc0 0x7f771807b0d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:36.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.095+0000 7f773316e640 1 --2- 172.21.15.105:0/478693722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f772c0b1e90 0x7f772c0b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:36.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.095+0000 7f773316e640 1 --2- 172.21.15.105:0/478693722 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f772c0cb350 0x7f772c155bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:36.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.095+0000 7f773316e640 1 --2- 172.21.15.105:0/478693722 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7714004800 0x7f772c0c9610 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:36.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.095+0000 7f773316e640 1 -- 172.21.15.105:0/478693722 >> 172.21.15.105:0/478693722 conn(0x7f772c08bfc0 msgr2=0x7f772c0d3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:36.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.095+0000 7f773316e640 1 -- 172.21.15.105:0/478693722 shutdown_connections 2024-09-21T03:21:36.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.095+0000 7f773316e640 1 -- 172.21.15.105:0/478693722 wait complete. 2024-09-21T03:21:36.108 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-21T03:21:36.232 INFO:teuthology.orchestra.run.smithi105.stdout:[{"id":6117,"entity":{"name":{"type":"client","num":6117},"addr":{"type":"v1","addr":"172.21.15.162:0","nonce":3860319644}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":9.7168022539999992,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.9375508686789407,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.6117 v1:172.21.15.162:0/3860319644","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi162","kernel_version":"5.14.0-508.el9.x86_64","root":"/"}},{"id":5375,"entity":{"name":{"type":"client","num":5375},"addr":{"type":"v1","addr":"172.21.15.105:0","nonce":3372869439}},"state":"open","num_leases":1,"num_caps":179,"request_load_avg":577,"uptime":10.83877942,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":2095.6201717098893,"halflife":60},"release_caps":{"value":411.87725604853227,"halflife":60},"recall_caps_throttle":{"value":435.73573472310494,"halflife":1.5},"recall_caps_throttle2o":{"value":33.030621950869168,"halflife":0.5},"session_cache_liveness":{"value":1184.3795189491523,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":630,"last_trim_completed_flushes_tid":601,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.5375 v1:172.21.15.105:0/3372869439","completed_requests":[],"prealloc_inos":[{"start":"0x10000000002","length":500},{"start":"0x1000000044d","length":903}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi105","kernel_version":"5.14.0-508.el9.x86_64","root":"/"}}] 2024-09-21T03:21:36.233 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi162", "kernel_version": "5.14.0-508.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.162:0", "nonce": 3860319644, "type": "v1" }, "name": { "num": 6117, "type": "client" } }, "id": 6117, "inst": "client.6117 v1:172.21.15.162:0/3860319644", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.9375508686789407 }, "state": "open", "uptime": 9.716802254 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi105", "kernel_version": "5.14.0-508.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "172.21.15.105:0", "nonce": 3372869439, "type": "v1" }, "name": { "num": 5375, "type": "client" } }, "id": 5375, "inst": "client.5375 v1:172.21.15.105:0/3372869439", "last_trim_completed_flushes_tid": 601, "last_trim_completed_requests_tid": 630, "num_caps": 179, "num_completed_flushes": 1, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000002" }, { "length": 903, "start": "0x1000000044d" } ], "recall_caps": { "halflife": 60, "value": 2095.6201717098893 }, "recall_caps_throttle": { "halflife": 1.5, "value": 435.73573472310494 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 33.03062195086917 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 411.8772560485323 }, "request_load_avg": 577, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 1184.3795189491523 }, "state": "open", "uptime": 10.83877942 } ] 2024-09-21T03:21:36.233 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-21T03:21:36.233 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T03:21:36.233 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T03:21:36.275 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T03:21:36.317 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T03:21:36.317 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T03:21:36.317 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:21:36.317 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:21:36.333 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:21:36.333 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:21:36.390 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T03:21:36.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.543+0000 7f8f3c769640 1 -- 172.21.15.105:0/2326342468 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f1c004800 msgr2=0x7f8f1c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:36.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.543+0000 7f8f3c769640 1 --2- 172.21.15.105:0/2326342468 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f1c004800 0x7f8f1c004c10 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f8f28001690 tx=0x7f8f1c005830 comp rx=0 tx=0).stop 2024-09-21T03:21:36.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.543+0000 7f8f3c769640 1 -- 172.21.15.105:0/2326342468 shutdown_connections 2024-09-21T03:21:36.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.543+0000 7f8f3c769640 1 --2- 172.21.15.105:0/2326342468 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f1c004800 0x7f8f1c004c10 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:36.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.543+0000 7f8f3c769640 1 -- 172.21.15.105:0/2326342468 >> 172.21.15.105:0/2326342468 conn(0x7f8f34072ae0 msgr2=0x7f8f34072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:36.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.543+0000 7f8f3c769640 1 -- 172.21.15.105:0/2326342468 shutdown_connections 2024-09-21T03:21:36.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.543+0000 7f8f3c769640 1 -- 172.21.15.105:0/2326342468 wait complete. 2024-09-21T03:21:36.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.545+0000 7f8f3c769640 1 Processor -- start 2024-09-21T03:21:36.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.545+0000 7f8f3c769640 1 -- start start 2024-09-21T03:21:36.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.546+0000 7f8f3c769640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f1c004800 0x7f8f341f04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:36.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.546+0000 7f8f3c769640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f341591d0 0x7f8f341595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:36.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.546+0000 7f8f3c769640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f341f6780 0x7f8f341f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:36.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.546+0000 7f8f3c769640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3415c860 con 0x7f8f341591d0 2024-09-21T03:21:36.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.546+0000 7f8f3c769640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3415c6e0 con 0x7f8f1c004800 2024-09-21T03:21:36.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.546+0000 7f8f3c769640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8f3415c9e0 con 0x7f8f341f6780 2024-09-21T03:21:36.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.546+0000 7f8f39d04640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f341591d0 0x7f8f341595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:36.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.546+0000 7f8f39d04640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f341591d0 0x7f8f341595e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:50450/0 (socket says 172.21.15.105:50450) 2024-09-21T03:21:36.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.546+0000 7f8f39d04640 1 -- 172.21.15.105:0/3822287936 learned_addr learned my addr 172.21.15.105:0/3822287936 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:36.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.546+0000 7f8f3ad06640 1 --2- 172.21.15.105:0/3822287936 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f341f6780 0x7f8f341f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:36.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.546+0000 7f8f3a505640 1 --2- 172.21.15.105:0/3822287936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f1c004800 0x7f8f341f04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:36.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.546+0000 7f8f39d04640 1 -- 172.21.15.105:0/3822287936 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f341f6780 msgr2=0x7f8f341f6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:36.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.546+0000 7f8f39d04640 1 --2- 172.21.15.105:0/3822287936 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f341f6780 0x7f8f341f6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:36.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.547+0000 7f8f39d04640 1 -- 172.21.15.105:0/3822287936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f1c004800 msgr2=0x7f8f341f04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:36.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.547+0000 7f8f39d04640 1 --2- 172.21.15.105:0/3822287936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f1c004800 0x7f8f341f04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:36.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.547+0000 7f8f39d04640 1 -- 172.21.15.105:0/3822287936 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f34159b20 con 0x7f8f341591d0 2024-09-21T03:21:36.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.547+0000 7f8f39d04640 1 --2- 172.21.15.105:0/3822287936 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f341591d0 0x7f8f341595e0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f8f2802a8e0 tx=0x7f8f280063a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:36.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.547+0000 7f8f32ffd640 1 -- 172.21.15.105:0/3822287936 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f28003a00 con 0x7f8f341591d0 2024-09-21T03:21:36.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.547+0000 7f8f32ffd640 1 -- 172.21.15.105:0/3822287936 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f28039070 con 0x7f8f341591d0 2024-09-21T03:21:36.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.547+0000 7f8f32ffd640 1 -- 172.21.15.105:0/3822287936 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f28033420 con 0x7f8f341591d0 2024-09-21T03:21:36.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.547+0000 7f8f3c769640 1 -- 172.21.15.105:0/3822287936 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f340ad1e0 con 0x7f8f341591d0 2024-09-21T03:21:36.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.547+0000 7f8f3c769640 1 -- 172.21.15.105:0/3822287936 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f3414ab00 con 0x7f8f341591d0 2024-09-21T03:21:36.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.548+0000 7f8f3c769640 1 -- 172.21.15.105:0/3822287936 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f3415cbc0 con 0x7f8f341591d0 2024-09-21T03:21:36.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.549+0000 7f8f32ffd640 1 -- 172.21.15.105:0/3822287936 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8f28044020 con 0x7f8f341591d0 2024-09-21T03:21:36.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.549+0000 7f8f32ffd640 1 --2- 172.21.15.105:0/3822287936 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8f20078b90 0x7f8f2007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:36.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.549+0000 7f8f32ffd640 1 -- 172.21.15.105:0/3822287936 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f8f280ba4f0 con 0x7f8f341591d0 2024-09-21T03:21:36.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.550+0000 7f8f3a505640 1 --2- 172.21.15.105:0/3822287936 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8f20078b90 0x7f8f2007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:36.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.550+0000 7f8f3a505640 1 --2- 172.21.15.105:0/3822287936 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8f20078b90 0x7f8f2007b0a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8f34052910 tx=0x7f8f24005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:36.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.554+0000 7f8f32ffd640 1 -- 172.21.15.105:0/3822287936 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8f34159b20 con 0x7f8f341591d0 2024-09-21T03:21:36.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.741+0000 7f8f3c769640 1 -- 172.21.15.105:0/3822287936 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8f34148360 con 0x7f8f341591d0 2024-09-21T03:21:36.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.741+0000 7f8f32ffd640 1 -- 172.21.15.105:0/3822287936 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v69) ==== 80+0+0 (secure 0 0 0) 0x7f8f280829f0 con 0x7f8f341591d0 2024-09-21T03:21:36.743 INFO:teuthology.orchestra.run.smithi105.stderr:listed 0 entries 2024-09-21T03:21:36.745 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.744+0000 7f8f3c769640 1 -- 172.21.15.105:0/3822287936 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8f20078b90 msgr2=0x7f8f2007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:36.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.744+0000 7f8f3c769640 1 --2- 172.21.15.105:0/3822287936 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8f20078b90 0x7f8f2007b0a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8f34052910 tx=0x7f8f24005f90 comp rx=0 tx=0).stop 2024-09-21T03:21:36.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.744+0000 7f8f3c769640 1 -- 172.21.15.105:0/3822287936 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f341591d0 msgr2=0x7f8f341595e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:36.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.744+0000 7f8f3c769640 1 --2- 172.21.15.105:0/3822287936 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f341591d0 0x7f8f341595e0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f8f2802a8e0 tx=0x7f8f280063a0 comp rx=0 tx=0).stop 2024-09-21T03:21:36.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.744+0000 7f8f3c769640 1 -- 172.21.15.105:0/3822287936 shutdown_connections 2024-09-21T03:21:36.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.744+0000 7f8f3c769640 1 --2- 172.21.15.105:0/3822287936 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8f20078b90 0x7f8f2007b0a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:36.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.744+0000 7f8f3c769640 1 --2- 172.21.15.105:0/3822287936 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f341f6780 0x7f8f341f6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:36.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.744+0000 7f8f3c769640 1 --2- 172.21.15.105:0/3822287936 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f341591d0 0x7f8f341595e0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:36.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.744+0000 7f8f3c769640 1 --2- 172.21.15.105:0/3822287936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f1c004800 0x7f8f341f04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:36.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.744+0000 7f8f3c769640 1 -- 172.21.15.105:0/3822287936 >> 172.21.15.105:0/3822287936 conn(0x7f8f34072ae0 msgr2=0x7f8f340b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:36.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.744+0000 7f8f3c769640 1 -- 172.21.15.105:0/3822287936 shutdown_connections 2024-09-21T03:21:36.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:36.744+0000 7f8f3c769640 1 -- 172.21.15.105:0/3822287936 wait complete. 2024-09-21T03:21:36.756 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T03:21:36.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:21:36.756 DEBUG:teuthology.orchestra.run.smithi105:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T03:21:36.870 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi105.front.sepia.ceph.com 2024-09-21T03:21:36.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:21:36.870 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T03:21:36.885 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T03:21:36.885 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:21:36.885 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:21:36.902 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:21:36.902 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:21:36.960 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T03:21:37.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.071+0000 7fd0d6b39640 1 -- 172.21.15.105:0/1450361933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0d0142270 msgr2=0x7fd0d0073e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:37.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.071+0000 7fd0d6b39640 1 --2- 172.21.15.105:0/1450361933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0d0142270 0x7fd0d0073e50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0005fd0 tx=0x7fd0c002a5d0 comp rx=0 tx=0).stop 2024-09-21T03:21:37.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.071+0000 7fd0d6b39640 1 -- 172.21.15.105:0/1450361933 shutdown_connections 2024-09-21T03:21:37.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.071+0000 7fd0d6b39640 1 --2- 172.21.15.105:0/1450361933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0d0142270 0x7fd0d0073e50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:37.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.071+0000 7fd0d6b39640 1 --2- 172.21.15.105:0/1450361933 >> v2:172.21.15.162:3300/0 conn(0x7fd0d0142680 0x7fd0d0074390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:37.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.071+0000 7fd0d6b39640 1 -- 172.21.15.105:0/1450361933 >> 172.21.15.105:0/1450361933 conn(0x7fd0d00d15f0 msgr2=0x7fd0d0073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:37.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.071+0000 7fd0d6b39640 1 -- 172.21.15.105:0/1450361933 shutdown_connections 2024-09-21T03:21:37.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.071+0000 7fd0d6b39640 1 -- 172.21.15.105:0/1450361933 wait complete. 2024-09-21T03:21:37.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.072+0000 7fd0d6b39640 1 Processor -- start 2024-09-21T03:21:37.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.073+0000 7fd0d6b39640 1 -- start start 2024-09-21T03:21:37.078 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.074+0000 7fd0d6b39640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0d0142270 0x7fd0d01410f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:37.078 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.074+0000 7fd0d6b39640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0d0142680 0x7fd0d0157c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:37.078 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.074+0000 7fd0d6b39640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0d0144270 0x7fd0d0158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:37.078 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.074+0000 7fd0d6b39640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d00d01f0 con 0x7fd0d0142270 2024-09-21T03:21:37.078 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.074+0000 7fd0d6b39640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d00d0070 con 0x7fd0d0144270 2024-09-21T03:21:37.078 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.074+0000 7fd0d6b39640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd0d00d0370 con 0x7fd0d0142680 2024-09-21T03:21:37.078 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.074+0000 7fd0d48d5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0d0142270 0x7fd0d01410f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:37.078 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.074+0000 7fd0d48d5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0d0142270 0x7fd0d01410f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:50462/0 (socket says 172.21.15.105:50462) 2024-09-21T03:21:37.078 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.074+0000 7fd0d48d5640 1 -- 172.21.15.105:0/2470130751 learned_addr learned my addr 172.21.15.105:0/2470130751 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:37.078 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.074+0000 7fd0c7fff640 1 --2- 172.21.15.105:0/2470130751 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0d0142680 0x7fd0d0157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:37.078 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.074+0000 7fd0d50d6640 1 --2- 172.21.15.105:0/2470130751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0d0144270 0x7fd0d0158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:37.079 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.074+0000 7fd0d48d5640 1 -- 172.21.15.105:0/2470130751 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0d0142680 msgr2=0x7fd0d0157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:37.079 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.074+0000 7fd0d48d5640 1 --2- 172.21.15.105:0/2470130751 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0d0142680 0x7fd0d0157c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:37.079 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.074+0000 7fd0d48d5640 1 -- 172.21.15.105:0/2470130751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0d0144270 msgr2=0x7fd0d0158190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:37.079 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.074+0000 7fd0d48d5640 1 --2- 172.21.15.105:0/2470130751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0d0144270 0x7fd0d0158190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:37.079 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.074+0000 7fd0d48d5640 1 -- 172.21.15.105:0/2470130751 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0d0141db0 con 0x7fd0d0142270 2024-09-21T03:21:37.079 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.075+0000 7fd0d48d5640 1 --2- 172.21.15.105:0/2470130751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0d0142270 0x7fd0d01410f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc00c3d0 tx=0x7fd0cc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:37.079 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.075+0000 7fd0c57fa640 1 -- 172.21.15.105:0/2470130751 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc017070 con 0x7fd0d0142270 2024-09-21T03:21:37.079 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.075+0000 7fd0c57fa640 1 -- 172.21.15.105:0/2470130751 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd0cc0053c0 con 0x7fd0d0142270 2024-09-21T03:21:37.079 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.075+0000 7fd0d6b39640 1 -- 172.21.15.105:0/2470130751 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0d01f5f60 con 0x7fd0d0142270 2024-09-21T03:21:37.079 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.075+0000 7fd0c57fa640 1 -- 172.21.15.105:0/2470130751 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc003850 con 0x7fd0d0142270 2024-09-21T03:21:37.079 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.075+0000 7fd0d6b39640 1 -- 172.21.15.105:0/2470130751 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0d0141630 con 0x7fd0d0142270 2024-09-21T03:21:37.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.076+0000 7fd0d6b39640 1 -- 172.21.15.105:0/2470130751 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0d01418c0 con 0x7fd0d0142270 2024-09-21T03:21:37.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.077+0000 7fd0c57fa640 1 -- 172.21.15.105:0/2470130751 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd0cc01a070 con 0x7fd0d0142270 2024-09-21T03:21:37.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.077+0000 7fd0c57fa640 1 --2- 172.21.15.105:0/2470130751 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd0bc078b90 0x7fd0bc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:37.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.077+0000 7fd0c57fa640 1 -- 172.21.15.105:0/2470130751 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fd0cc09a020 con 0x7fd0d0142270 2024-09-21T03:21:37.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.077+0000 7fd0c7fff640 1 --2- 172.21.15.105:0/2470130751 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd0bc078b90 0x7fd0bc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:37.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.078+0000 7fd0c7fff640 1 --2- 172.21.15.105:0/2470130751 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd0bc078b90 0x7fd0bc07b0a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0033000 tx=0x7fd0c0004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:37.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.082+0000 7fd0c57fa640 1 -- 172.21.15.105:0/2470130751 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd0cc0624f0 con 0x7fd0d0142270 2024-09-21T03:21:37.272 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.270+0000 7fd0d6b39640 1 -- 172.21.15.105:0/2470130751 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd0d00b5680 con 0x7fd0d0142270 2024-09-21T03:21:37.273 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.270+0000 7fd0c57fa640 1 -- 172.21.15.105:0/2470130751 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v69) ==== 80+0+0 (secure 0 0 0) 0x7fd0cc061df0 con 0x7fd0d0142270 2024-09-21T03:21:37.273 INFO:teuthology.orchestra.run.smithi105.stderr:listed 0 entries 2024-09-21T03:21:37.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.273+0000 7fd0d6b39640 1 -- 172.21.15.105:0/2470130751 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd0bc078b90 msgr2=0x7fd0bc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:37.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.273+0000 7fd0d6b39640 1 --2- 172.21.15.105:0/2470130751 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd0bc078b90 0x7fd0bc07b0a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0033000 tx=0x7fd0c0004730 comp rx=0 tx=0).stop 2024-09-21T03:21:37.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.273+0000 7fd0d6b39640 1 -- 172.21.15.105:0/2470130751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0d0142270 msgr2=0x7fd0d01410f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:37.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.273+0000 7fd0d6b39640 1 --2- 172.21.15.105:0/2470130751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0d0142270 0x7fd0d01410f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc00c3d0 tx=0x7fd0cc00c890 comp rx=0 tx=0).stop 2024-09-21T03:21:37.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.273+0000 7fd0d6b39640 1 -- 172.21.15.105:0/2470130751 shutdown_connections 2024-09-21T03:21:37.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.273+0000 7fd0d6b39640 1 --2- 172.21.15.105:0/2470130751 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd0bc078b90 0x7fd0bc07b0a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:37.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.273+0000 7fd0d6b39640 1 --2- 172.21.15.105:0/2470130751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0d0144270 0x7fd0d0158190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:37.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.273+0000 7fd0d6b39640 1 --2- 172.21.15.105:0/2470130751 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0d0142680 0x7fd0d0157c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:37.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.273+0000 7fd0d6b39640 1 --2- 172.21.15.105:0/2470130751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0d0142270 0x7fd0d01410f0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:37.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.273+0000 7fd0d6b39640 1 -- 172.21.15.105:0/2470130751 >> 172.21.15.105:0/2470130751 conn(0x7fd0d00d15f0 msgr2=0x7fd0d01438b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:37.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.273+0000 7fd0d6b39640 1 -- 172.21.15.105:0/2470130751 shutdown_connections 2024-09-21T03:21:37.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.273+0000 7fd0d6b39640 1 -- 172.21.15.105:0/2470130751 wait complete. 2024-09-21T03:21:37.286 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-21T03:21:37.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:21:37.287 DEBUG:teuthology.orchestra.run.smithi162:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-21T03:21:37.318 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2024-09-21T03:21:37.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:21:37.319 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-21T03:21:37.376 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T03:21:37.377 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:21:37.377 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:21:37.393 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T03:21:37.393 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T03:21:37.393 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:21:37.393 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:21:37.434 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=452 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T03:21:37.434 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:21:37.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.543+0000 7f139175e640 1 -- 172.21.15.105:0/1395712017 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f138c0d2ed0 msgr2=0x7f138c0d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:37.547 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.543+0000 7f139175e640 1 --2- 172.21.15.105:0/1395712017 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f138c0d2ed0 0x7f138c0d1a80 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f138c0d5690 tx=0x7f137c02a540 comp rx=0 tx=0).stop 2024-09-21T03:21:37.547 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.544+0000 7f139175e640 1 -- 172.21.15.105:0/1395712017 shutdown_connections 2024-09-21T03:21:37.547 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.544+0000 7f139175e640 1 --2- 172.21.15.105:0/1395712017 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f138c0cf5d0 0x7f138c0cf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:37.547 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.544+0000 7f139175e640 1 --2- 172.21.15.105:0/1395712017 >> v2:172.21.15.162:3300/0 conn(0x7f138c0b9b70 0x7f138c0cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:37.547 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.544+0000 7f139175e640 1 --2- 172.21.15.105:0/1395712017 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f138c0d2ed0 0x7f138c0d1a80 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:37.547 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.544+0000 7f139175e640 1 -- 172.21.15.105:0/1395712017 >> 172.21.15.105:0/1395712017 conn(0x7f138c08bfc0 msgr2=0x7f138c09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:37.547 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.544+0000 7f139175e640 1 -- 172.21.15.105:0/1395712017 shutdown_connections 2024-09-21T03:21:37.547 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.544+0000 7f139175e640 1 -- 172.21.15.105:0/1395712017 wait complete. 2024-09-21T03:21:37.548 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.545+0000 7f139175e640 1 Processor -- start 2024-09-21T03:21:37.548 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.546+0000 7f139175e640 1 -- start start 2024-09-21T03:21:37.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.547+0000 7f139175e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f138c0b9b70 0x7f138c1f2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:37.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.547+0000 7f139175e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f138c0cf5d0 0x7f138c15e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:37.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.547+0000 7f139175e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f138c0d2ed0 0x7f138c15c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:37.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.547+0000 7f139175e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f138c0d45c0 con 0x7f138c0b9b70 2024-09-21T03:21:37.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.547+0000 7f139175e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f138c0d4440 con 0x7f138c0d2ed0 2024-09-21T03:21:37.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.547+0000 7f139175e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f138c0d4740 con 0x7f138c0cf5d0 2024-09-21T03:21:37.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.547+0000 7f138affd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f138c0b9b70 0x7f138c1f2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:37.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.547+0000 7f138affd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f138c0b9b70 0x7f138c1f2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:50478/0 (socket says 172.21.15.105:50478) 2024-09-21T03:21:37.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.547+0000 7f138affd640 1 -- 172.21.15.105:0/3690000074 learned_addr learned my addr 172.21.15.105:0/3690000074 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:37.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.547+0000 7f138a7fc640 1 --2- 172.21.15.105:0/3690000074 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f138c0cf5d0 0x7f138c15e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:37.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.547+0000 7f138b7fe640 1 --2- 172.21.15.105:0/3690000074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f138c0d2ed0 0x7f138c15c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:37.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.547+0000 7f138affd640 1 -- 172.21.15.105:0/3690000074 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f138c0cf5d0 msgr2=0x7f138c15e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:37.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.547+0000 7f138affd640 1 --2- 172.21.15.105:0/3690000074 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f138c0cf5d0 0x7f138c15e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:37.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.547+0000 7f138affd640 1 -- 172.21.15.105:0/3690000074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f138c0d2ed0 msgr2=0x7f138c15c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:37.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.547+0000 7f138affd640 1 --2- 172.21.15.105:0/3690000074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f138c0d2ed0 0x7f138c15c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:37.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.547+0000 7f138affd640 1 -- 172.21.15.105:0/3690000074 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f138c15f150 con 0x7f138c0b9b70 2024-09-21T03:21:37.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.547+0000 7f138b7fe640 1 --2- 172.21.15.105:0/3690000074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f138c0d2ed0 0x7f138c15c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:21:37.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.547+0000 7f138affd640 1 --2- 172.21.15.105:0/3690000074 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f138c0b9b70 0x7f138c1f2b60 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f137c031770 tx=0x7f137c0049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:37.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.548+0000 7f13737fe640 1 -- 172.21.15.105:0/3690000074 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f137c031d60 con 0x7f138c0b9b70 2024-09-21T03:21:37.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.548+0000 7f13737fe640 1 -- 172.21.15.105:0/3690000074 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f137c033070 con 0x7f138c0b9b70 2024-09-21T03:21:37.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.548+0000 7f139175e640 1 -- 172.21.15.105:0/3690000074 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f138c0c9390 con 0x7f138c0b9b70 2024-09-21T03:21:37.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.548+0000 7f13737fe640 1 -- 172.21.15.105:0/3690000074 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f137c0334a0 con 0x7f138c0b9b70 2024-09-21T03:21:37.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.548+0000 7f139175e640 1 -- 172.21.15.105:0/3690000074 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f138c15d260 con 0x7f138c0b9b70 2024-09-21T03:21:37.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.549+0000 7f139175e640 1 -- 172.21.15.105:0/3690000074 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f138c15d4c0 con 0x7f138c0b9b70 2024-09-21T03:21:37.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.549+0000 7f13737fe640 1 -- 172.21.15.105:0/3690000074 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f137c033640 con 0x7f138c0b9b70 2024-09-21T03:21:37.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.550+0000 7f13737fe640 1 --2- 172.21.15.105:0/3690000074 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1378078bc0 0x7f137807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:37.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.550+0000 7f13737fe640 1 -- 172.21.15.105:0/3690000074 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f137c0bc000 con 0x7f138c0b9b70 2024-09-21T03:21:37.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.550+0000 7f138a7fc640 1 --2- 172.21.15.105:0/3690000074 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1378078bc0 0x7f137807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:37.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.551+0000 7f138a7fc640 1 --2- 172.21.15.105:0/3690000074 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1378078bc0 0x7f137807b0d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f138c0cf4d0 tx=0x7f138000b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:37.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.555+0000 7f13737fe640 1 -- 172.21.15.105:0/3690000074 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f137c03f030 con 0x7f138c0b9b70 2024-09-21T03:21:37.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.771+0000 7f139175e640 1 -- 172.21.15.105:0/3690000074 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f138c0cf9e0 con 0x7f138c0b9b70 2024-09-21T03:21:37.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.771+0000 7f13737fe640 1 -- 172.21.15.105:0/3690000074 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5234 (secure 0 0 0) 0x7f137c084560 con 0x7f138c0b9b70 2024-09-21T03:21:37.774 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:37.774 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":38,"btime":"2024-09-21T03:21:17:305276+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5593,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2041248590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2041248590},{"type":"v1","addr":"172.21.15.162:6836","nonce":2041248590}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5596,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/775014606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":775014606},{"type":"v1","addr":"172.21.15.162:6837","nonce":775014606}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5937,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3799275472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3799275472},{"type":"v1","addr":"172.21.15.105:6833","nonce":3799275472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:21:14.660239+0000","modified":"2024-09-21T03:21:16.660264+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5940},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5940":{"gid":5940,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1561028223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1561028223},{"type":"v1","addr":"172.21.15.105:6835","nonce":1561028223}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5940,"qdb_cluster":[5940]},"id":5}]} 2024-09-21T03:21:37.775 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 38 2024-09-21T03:21:37.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.773+0000 7f139175e640 1 -- 172.21.15.105:0/3690000074 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1378078bc0 msgr2=0x7f137807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:37.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.773+0000 7f139175e640 1 --2- 172.21.15.105:0/3690000074 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1378078bc0 0x7f137807b0d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f138c0cf4d0 tx=0x7f138000b2e0 comp rx=0 tx=0).stop 2024-09-21T03:21:37.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.773+0000 7f139175e640 1 -- 172.21.15.105:0/3690000074 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f138c0b9b70 msgr2=0x7f138c1f2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:37.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.773+0000 7f139175e640 1 --2- 172.21.15.105:0/3690000074 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f138c0b9b70 0x7f138c1f2b60 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f137c031770 tx=0x7f137c0049d0 comp rx=0 tx=0).stop 2024-09-21T03:21:37.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.774+0000 7f139175e640 1 -- 172.21.15.105:0/3690000074 shutdown_connections 2024-09-21T03:21:37.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.774+0000 7f139175e640 1 --2- 172.21.15.105:0/3690000074 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1378078bc0 0x7f137807b0d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:37.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.774+0000 7f139175e640 1 --2- 172.21.15.105:0/3690000074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f138c0d2ed0 0x7f138c15c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:37.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.774+0000 7f139175e640 1 --2- 172.21.15.105:0/3690000074 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f138c0cf5d0 0x7f138c15e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:37.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.774+0000 7f139175e640 1 --2- 172.21.15.105:0/3690000074 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f138c0b9b70 0x7f138c1f2b60 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:37.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.774+0000 7f139175e640 1 -- 172.21.15.105:0/3690000074 >> 172.21.15.105:0/3690000074 conn(0x7f138c08bfc0 msgr2=0x7f138c0b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:37.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.774+0000 7f139175e640 1 -- 172.21.15.105:0/3690000074 shutdown_connections 2024-09-21T03:21:37.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.774+0000 7f139175e640 1 -- 172.21.15.105:0/3690000074 wait complete. 2024-09-21T03:21:37.787 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:21:37.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.897+0000 7f204b60e640 1 -- 172.21.15.105:0/3819015024 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f202c005250 msgr2=0x7f202c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:37.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.897+0000 7f204b60e640 1 --2- 172.21.15.105:0/3819015024 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f202c005250 0x7f202c00b9c0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f203400c640 tx=0x7f202c005830 comp rx=0 tx=0).stop 2024-09-21T03:21:37.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.897+0000 7f204b60e640 1 -- 172.21.15.105:0/3819015024 shutdown_connections 2024-09-21T03:21:37.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.897+0000 7f204b60e640 1 --2- 172.21.15.105:0/3819015024 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f202c005250 0x7f202c00b9c0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:37.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.897+0000 7f204b60e640 1 -- 172.21.15.105:0/3819015024 >> 172.21.15.105:0/3819015024 conn(0x7f2044072ae0 msgr2=0x7f2044072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:37.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.897+0000 7f204b60e640 1 -- 172.21.15.105:0/3819015024 shutdown_connections 2024-09-21T03:21:37.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.897+0000 7f204b60e640 1 -- 172.21.15.105:0/3819015024 wait complete. 2024-09-21T03:21:37.901 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.899+0000 7f204b60e640 1 Processor -- start 2024-09-21T03:21:37.901 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.899+0000 7f204b60e640 1 -- start start 2024-09-21T03:21:37.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.900+0000 7f204b60e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f202c005250 0x7f2044148060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:37.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.900+0000 7f204b60e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2044158050 0x7f2044158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:37.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.900+0000 7f204b60e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20441f6dc0 0x7f20441f71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:37.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.900+0000 7f204b60e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f20440d1a60 con 0x7f2044158050 2024-09-21T03:21:37.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.900+0000 7f204b60e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f20440d18e0 con 0x7f202c005250 2024-09-21T03:21:37.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.900+0000 7f204b60e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f20440d1100 con 0x7f20441f6dc0 2024-09-21T03:21:37.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.900+0000 7f2048ba9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2044158050 0x7f2044158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:37.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.900+0000 7f2048ba9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2044158050 0x7f2044158460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:50492/0 (socket says 172.21.15.105:50492) 2024-09-21T03:21:37.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.900+0000 7f2048ba9640 1 -- 172.21.15.105:0/2455777745 learned_addr learned my addr 172.21.15.105:0/2455777745 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:37.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.900+0000 7f20493aa640 1 --2- 172.21.15.105:0/2455777745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f202c005250 0x7f2044148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:37.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.900+0000 7f2049bab640 1 --2- 172.21.15.105:0/2455777745 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20441f6dc0 0x7f20441f71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:37.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.901+0000 7f2048ba9640 1 -- 172.21.15.105:0/2455777745 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20441f6dc0 msgr2=0x7f20441f71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:37.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.901+0000 7f2048ba9640 1 --2- 172.21.15.105:0/2455777745 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20441f6dc0 0x7f20441f71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:37.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.901+0000 7f2048ba9640 1 -- 172.21.15.105:0/2455777745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f202c005250 msgr2=0x7f2044148060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:37.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.901+0000 7f2048ba9640 1 --2- 172.21.15.105:0/2455777745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f202c005250 0x7f2044148060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:37.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.901+0000 7f2048ba9640 1 -- 172.21.15.105:0/2455777745 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20440caf10 con 0x7f2044158050 2024-09-21T03:21:37.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.901+0000 7f2048ba9640 1 --2- 172.21.15.105:0/2455777745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2044158050 0x7f2044158460 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f2038011ab0 tx=0x7f2038011eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:37.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.901+0000 7f2041ffb640 1 -- 172.21.15.105:0/2455777745 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203801e070 con 0x7f2044158050 2024-09-21T03:21:37.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.901+0000 7f2041ffb640 1 -- 172.21.15.105:0/2455777745 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2038004460 con 0x7f2044158050 2024-09-21T03:21:37.906 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.901+0000 7f2041ffb640 1 -- 172.21.15.105:0/2455777745 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203800fc00 con 0x7f2044158050 2024-09-21T03:21:37.906 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.901+0000 7f204b60e640 1 -- 172.21.15.105:0/2455777745 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20440cb1f0 con 0x7f2044158050 2024-09-21T03:21:37.906 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.901+0000 7f204b60e640 1 -- 172.21.15.105:0/2455777745 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20440cb7b0 con 0x7f2044158050 2024-09-21T03:21:37.906 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.902+0000 7f204b60e640 1 -- 172.21.15.105:0/2455777745 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f204415c9d0 con 0x7f2044158050 2024-09-21T03:21:37.907 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.903+0000 7f2041ffb640 1 -- 172.21.15.105:0/2455777745 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2038021070 con 0x7f2044158050 2024-09-21T03:21:37.907 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.903+0000 7f2041ffb640 1 --2- 172.21.15.105:0/2455777745 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2030078bc0 0x7f203007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:37.907 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.903+0000 7f2041ffb640 1 -- 172.21.15.105:0/2455777745 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f203809b6d0 con 0x7f2044158050 2024-09-21T03:21:37.907 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.904+0000 7f20493aa640 1 --2- 172.21.15.105:0/2455777745 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2030078bc0 0x7f203007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:37.907 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.904+0000 7f20493aa640 1 --2- 172.21.15.105:0/2455777745 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2030078bc0 0x7f203007b0d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f203c006680 tx=0x7f203c006b70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:37.910 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:37.908+0000 7f2041ffb640 1 -- 172.21.15.105:0/2455777745 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f20380634c0 con 0x7f2044158050 2024-09-21T03:21:38.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.119+0000 7f204b60e640 1 -- 172.21.15.105:0/2455777745 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20440caca0 con 0x7f2044158050 2024-09-21T03:21:38.122 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.119+0000 7f2041ffb640 1 -- 172.21.15.105:0/2455777745 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5234 (secure 0 0 0) 0x7f2038067ef0 con 0x7f2044158050 2024-09-21T03:21:38.122 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:38.122 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":38,"btime":"2024-09-21T03:21:17:305276+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5593,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2041248590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2041248590},{"type":"v1","addr":"172.21.15.162:6836","nonce":2041248590}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5596,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/775014606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":775014606},{"type":"v1","addr":"172.21.15.162:6837","nonce":775014606}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5937,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3799275472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3799275472},{"type":"v1","addr":"172.21.15.105:6833","nonce":3799275472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:21:14.660239+0000","modified":"2024-09-21T03:21:16.660264+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5940},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5940":{"gid":5940,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1561028223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1561028223},{"type":"v1","addr":"172.21.15.105:6835","nonce":1561028223}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5940,"qdb_cluster":[5940]},"id":5}]} 2024-09-21T03:21:38.123 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 38 2024-09-21T03:21:38.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.121+0000 7f204b60e640 1 -- 172.21.15.105:0/2455777745 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2030078bc0 msgr2=0x7f203007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:38.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.121+0000 7f204b60e640 1 --2- 172.21.15.105:0/2455777745 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2030078bc0 0x7f203007b0d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f203c006680 tx=0x7f203c006b70 comp rx=0 tx=0).stop 2024-09-21T03:21:38.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.121+0000 7f204b60e640 1 -- 172.21.15.105:0/2455777745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2044158050 msgr2=0x7f2044158460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:38.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.121+0000 7f204b60e640 1 --2- 172.21.15.105:0/2455777745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2044158050 0x7f2044158460 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f2038011ab0 tx=0x7f2038011eb0 comp rx=0 tx=0).stop 2024-09-21T03:21:38.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.121+0000 7f204b60e640 1 -- 172.21.15.105:0/2455777745 shutdown_connections 2024-09-21T03:21:38.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.121+0000 7f204b60e640 1 --2- 172.21.15.105:0/2455777745 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2030078bc0 0x7f203007b0d0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:38.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.121+0000 7f204b60e640 1 --2- 172.21.15.105:0/2455777745 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20441f6dc0 0x7f20441f71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:38.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.121+0000 7f204b60e640 1 --2- 172.21.15.105:0/2455777745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2044158050 0x7f2044158460 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:38.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.121+0000 7f204b60e640 1 --2- 172.21.15.105:0/2455777745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f202c005250 0x7f2044148060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:38.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.121+0000 7f204b60e640 1 -- 172.21.15.105:0/2455777745 >> 172.21.15.105:0/2455777745 conn(0x7f2044072ae0 msgr2=0x7f20440b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:38.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.122+0000 7f204b60e640 1 -- 172.21.15.105:0/2455777745 shutdown_connections 2024-09-21T03:21:38.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.122+0000 7f204b60e640 1 -- 172.21.15.105:0/2455777745 wait complete. 2024-09-21T03:21:38.135 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:21:38.248 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.245+0000 7f1f1157b640 1 -- 172.21.15.105:0/123896387 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ef4004800 msgr2=0x7f1ef4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:38.248 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.245+0000 7f1f1157b640 1 --2- 172.21.15.105:0/123896387 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ef4004800 0x7f1ef4004c10 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c0d0a00 tx=0x7f1ef4005830 comp rx=0 tx=0).stop 2024-09-21T03:21:38.248 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.245+0000 7f1f0b7fe640 1 -- 172.21.15.105:0/123896387 reap_dead start 2024-09-21T03:21:38.248 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.245+0000 7f1f1157b640 1 -- 172.21.15.105:0/123896387 shutdown_connections 2024-09-21T03:21:38.248 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.245+0000 7f1f1157b640 1 -- 172.21.15.105:0/123896387 >> 172.21.15.105:0/123896387 conn(0x7f1f0c08bfc0 msgr2=0x7f1f0c09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:38.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.245+0000 7f1f1157b640 1 -- 172.21.15.105:0/123896387 shutdown_connections 2024-09-21T03:21:38.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.245+0000 7f1f1157b640 1 -- 172.21.15.105:0/123896387 wait complete. 2024-09-21T03:21:38.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.247+0000 7f1f1157b640 1 Processor -- start 2024-09-21T03:21:38.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.247+0000 7f1f1157b640 1 -- start start 2024-09-21T03:21:38.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.248+0000 7f1f1157b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ef4004800 0x7f1f0c1f54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:38.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.248+0000 7f1f1157b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f0c0c83e0 0x7f1f0c0c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:38.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.248+0000 7f1f1157b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1f0c150460 0x7f1f0c150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:38.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.248+0000 7f1f1157b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0c0cfd70 con 0x7f1ef4004800 2024-09-21T03:21:38.253 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.248+0000 7f1f1157b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0c0cfbf0 con 0x7f1f0c0c83e0 2024-09-21T03:21:38.253 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.248+0000 7f1f1157b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1f0c160040 con 0x7f1f0c150460 2024-09-21T03:21:38.253 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.249+0000 7f1f0affd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ef4004800 0x7f1f0c1f54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:38.253 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.249+0000 7f1f0affd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ef4004800 0x7f1f0c1f54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:50502/0 (socket says 172.21.15.105:50502) 2024-09-21T03:21:38.253 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.249+0000 7f1f0affd640 1 -- 172.21.15.105:0/1277895236 learned_addr learned my addr 172.21.15.105:0/1277895236 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:38.253 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.249+0000 7f1f0a7fc640 1 --2- 172.21.15.105:0/1277895236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f0c0c83e0 0x7f1f0c0c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:38.253 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.249+0000 7f1f0b7fe640 1 --2- 172.21.15.105:0/1277895236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1f0c150460 0x7f1f0c150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:38.253 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.249+0000 7f1f0affd640 1 -- 172.21.15.105:0/1277895236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1f0c150460 msgr2=0x7f1f0c150870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:38.253 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.249+0000 7f1f0affd640 1 --2- 172.21.15.105:0/1277895236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1f0c150460 0x7f1f0c150870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:38.253 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.249+0000 7f1f0affd640 1 -- 172.21.15.105:0/1277895236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f0c0c83e0 msgr2=0x7f1f0c0c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:38.253 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.249+0000 7f1f0affd640 1 --2- 172.21.15.105:0/1277895236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f0c0c83e0 0x7f1f0c0c87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:38.253 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.249+0000 7f1f0affd640 1 -- 172.21.15.105:0/1277895236 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f0c0c90d0 con 0x7f1ef4004800 2024-09-21T03:21:38.254 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.249+0000 7f1f0b7fe640 1 --2- 172.21.15.105:0/1277895236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1f0c150460 0x7f1f0c150870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:21:38.254 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.249+0000 7f1f0a7fc640 1 --2- 172.21.15.105:0/1277895236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f0c0c83e0 0x7f1f0c0c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:21:38.254 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.249+0000 7f1f0affd640 1 --2- 172.21.15.105:0/1277895236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ef4004800 0x7f1f0c1f54e0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f1efc0063d0 tx=0x7f1efc0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:38.254 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.249+0000 7f1ef37fe640 1 -- 172.21.15.105:0/1277895236 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc015070 con 0x7f1ef4004800 2024-09-21T03:21:38.254 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.249+0000 7f1ef37fe640 1 -- 172.21.15.105:0/1277895236 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1efc011860 con 0x7f1ef4004800 2024-09-21T03:21:38.254 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.249+0000 7f1f1157b640 1 -- 172.21.15.105:0/1277895236 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f0c0c93b0 con 0x7f1ef4004800 2024-09-21T03:21:38.254 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.249+0000 7f1ef37fe640 1 -- 172.21.15.105:0/1277895236 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc011cb0 con 0x7f1ef4004800 2024-09-21T03:21:38.254 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.249+0000 7f1f1157b640 1 -- 172.21.15.105:0/1277895236 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f0c0c9970 con 0x7f1ef4004800 2024-09-21T03:21:38.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.250+0000 7f1f1157b640 1 -- 172.21.15.105:0/1277895236 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f0c1630e0 con 0x7f1ef4004800 2024-09-21T03:21:38.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.251+0000 7f1ef37fe640 1 -- 172.21.15.105:0/1277895236 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1efc018070 con 0x7f1ef4004800 2024-09-21T03:21:38.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.251+0000 7f1ef37fe640 1 --2- 172.21.15.105:0/1277895236 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1ef8078b90 0x7f1ef807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:38.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.252+0000 7f1ef37fe640 1 -- 172.21.15.105:0/1277895236 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f1efc09bab0 con 0x7f1ef4004800 2024-09-21T03:21:38.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.252+0000 7f1f0a7fc640 1 --2- 172.21.15.105:0/1277895236 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1ef8078b90 0x7f1ef807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:38.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.252+0000 7f1f0a7fc640 1 --2- 172.21.15.105:0/1277895236 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1ef8078b90 0x7f1ef807b0a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1f00035000 tx=0x7f1f000046c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:38.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.256+0000 7f1ef37fe640 1 -- 172.21.15.105:0/1277895236 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1efc063f00 con 0x7f1ef4004800 2024-09-21T03:21:38.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.437+0000 7f1f1157b640 1 -- 172.21.15.105:0/1277895236 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f0c1622b0 con 0x7f1ef4004800 2024-09-21T03:21:38.441 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.438+0000 7f1ef37fe640 1 -- 172.21.15.105:0/1277895236 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) ==== 74+0+16800 (secure 0 0 0) 0x7f1efc063800 con 0x7f1ef4004800 2024-09-21T03:21:38.441 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:38.441 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":69,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:21:16.299955+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:21:12.315659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-21T03:21:13.622324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:21:38.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.440+0000 7f1f1157b640 1 -- 172.21.15.105:0/1277895236 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1ef8078b90 msgr2=0x7f1ef807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:38.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.440+0000 7f1f1157b640 1 --2- 172.21.15.105:0/1277895236 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1ef8078b90 0x7f1ef807b0a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1f00035000 tx=0x7f1f000046c0 comp rx=0 tx=0).stop 2024-09-21T03:21:38.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.440+0000 7f1f1157b640 1 -- 172.21.15.105:0/1277895236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ef4004800 msgr2=0x7f1f0c1f54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:38.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.440+0000 7f1f1157b640 1 --2- 172.21.15.105:0/1277895236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ef4004800 0x7f1f0c1f54e0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f1efc0063d0 tx=0x7f1efc0039c0 comp rx=0 tx=0).stop 2024-09-21T03:21:38.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.440+0000 7f1f1157b640 1 -- 172.21.15.105:0/1277895236 shutdown_connections 2024-09-21T03:21:38.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.440+0000 7f1f1157b640 1 --2- 172.21.15.105:0/1277895236 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1ef8078b90 0x7f1ef807b0a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:38.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.440+0000 7f1f1157b640 1 --2- 172.21.15.105:0/1277895236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1f0c150460 0x7f1f0c150870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:38.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.440+0000 7f1f1157b640 1 --2- 172.21.15.105:0/1277895236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f0c0c83e0 0x7f1f0c0c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:38.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.440+0000 7f1f1157b640 1 --2- 172.21.15.105:0/1277895236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ef4004800 0x7f1f0c1f54e0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:38.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.440+0000 7f1f1157b640 1 -- 172.21.15.105:0/1277895236 >> 172.21.15.105:0/1277895236 conn(0x7f1f0c08bfc0 msgr2=0x7f1f0c06ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:38.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.440+0000 7f1f1157b640 1 -- 172.21.15.105:0/1277895236 shutdown_connections 2024-09-21T03:21:38.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.441+0000 7f1f1157b640 1 -- 172.21.15.105:0/1277895236 wait complete. 2024-09-21T03:21:38.454 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T03:21:38.454 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:21:38.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.564+0000 7f120868b640 1 -- 172.21.15.105:0/2047397399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12000d1490 msgr2=0x7f12000cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:38.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.564+0000 7f120868b640 1 --2- 172.21.15.105:0/2047397399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12000d1490 0x7f12000cebf0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f1200073f50 tx=0x7f11f802a560 comp rx=0 tx=0).stop 2024-09-21T03:21:38.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.564+0000 7f120868b640 1 -- 172.21.15.105:0/2047397399 shutdown_connections 2024-09-21T03:21:38.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.564+0000 7f120868b640 1 --2- 172.21.15.105:0/2047397399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12000d1490 0x7f12000cebf0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:38.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.564+0000 7f120868b640 1 --2- 172.21.15.105:0/2047397399 >> v2:172.21.15.162:3300/0 conn(0x7f12000b51c0 0x7f120015c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:38.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.564+0000 7f120868b640 1 -- 172.21.15.105:0/2047397399 >> 172.21.15.105:0/2047397399 conn(0x7f1200072ae0 msgr2=0x7f1200072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:38.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.564+0000 7f120868b640 1 -- 172.21.15.105:0/2047397399 shutdown_connections 2024-09-21T03:21:38.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.564+0000 7f120868b640 1 -- 172.21.15.105:0/2047397399 wait complete. 2024-09-21T03:21:38.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.566+0000 7f120868b640 1 Processor -- start 2024-09-21T03:21:38.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.566+0000 7f120868b640 1 -- start start 2024-09-21T03:21:38.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.567+0000 7f120868b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12000b51c0 0x7f12001ea140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:38.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.567+0000 7f120868b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f12000ccbd0 0x7f12001e5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:38.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.567+0000 7f120868b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12000d1490 0x7f1200145430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:38.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.567+0000 7f120868b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f12000cf2b0 con 0x7f12000d1490 2024-09-21T03:21:38.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.567+0000 7f120868b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f12000cf130 con 0x7f12000b51c0 2024-09-21T03:21:38.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.567+0000 7f120868b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f12000cf430 con 0x7f12000ccbd0 2024-09-21T03:21:38.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.567+0000 7f1206c28640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12000d1490 0x7f1200145430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:38.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.568+0000 7f1206c28640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12000d1490 0x7f1200145430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:50520/0 (socket says 172.21.15.105:50520) 2024-09-21T03:21:38.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.568+0000 7f1206c28640 1 -- 172.21.15.105:0/2192601116 learned_addr learned my addr 172.21.15.105:0/2192601116 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:38.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.568+0000 7f1205c26640 1 --2- 172.21.15.105:0/2192601116 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f12000ccbd0 0x7f12001e5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:38.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.568+0000 7f1206427640 1 --2- 172.21.15.105:0/2192601116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12000b51c0 0x7f12001ea140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:38.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.568+0000 7f1206c28640 1 -- 172.21.15.105:0/2192601116 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f12000ccbd0 msgr2=0x7f12001e5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:38.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.568+0000 7f1206c28640 1 --2- 172.21.15.105:0/2192601116 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f12000ccbd0 0x7f12001e5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:38.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.568+0000 7f1206c28640 1 -- 172.21.15.105:0/2192601116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12000b51c0 msgr2=0x7f12001ea140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:38.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.568+0000 7f1206c28640 1 --2- 172.21.15.105:0/2192601116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12000b51c0 0x7f12001ea140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:38.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.568+0000 7f1206c28640 1 -- 172.21.15.105:0/2192601116 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1200144990 con 0x7f12000d1490 2024-09-21T03:21:38.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.568+0000 7f1206c28640 1 --2- 172.21.15.105:0/2192601116 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12000d1490 0x7f1200145430 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f11f8034040 tx=0x7f11f8003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:38.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.568+0000 7f11f6ffd640 1 -- 172.21.15.105:0/2192601116 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f803e030 con 0x7f12000d1490 2024-09-21T03:21:38.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.568+0000 7f11f6ffd640 1 -- 172.21.15.105:0/2192601116 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11f8003e50 con 0x7f12000d1490 2024-09-21T03:21:38.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.568+0000 7f11f6ffd640 1 -- 172.21.15.105:0/2192601116 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f8035040 con 0x7f12000d1490 2024-09-21T03:21:38.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.568+0000 7f120868b640 1 -- 172.21.15.105:0/2192601116 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12001ea990 con 0x7f12000d1490 2024-09-21T03:21:38.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.568+0000 7f120868b640 1 -- 172.21.15.105:0/2192601116 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1200144c30 con 0x7f12000d1490 2024-09-21T03:21:38.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.569+0000 7f120868b640 1 -- 172.21.15.105:0/2192601116 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12001ea700 con 0x7f12000d1490 2024-09-21T03:21:38.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.570+0000 7f11f6ffd640 1 -- 172.21.15.105:0/2192601116 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f11f8041030 con 0x7f12000d1490 2024-09-21T03:21:38.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.570+0000 7f11f6ffd640 1 --2- 172.21.15.105:0/2192601116 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f11e4078b90 0x7f11e407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:38.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.571+0000 7f11f6ffd640 1 -- 172.21.15.105:0/2192601116 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f11f80bb5b0 con 0x7f12000d1490 2024-09-21T03:21:38.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.571+0000 7f1206427640 1 --2- 172.21.15.105:0/2192601116 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f11e4078b90 0x7f11e407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:38.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.571+0000 7f1206427640 1 --2- 172.21.15.105:0/2192601116 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f11e4078b90 0x7f11e407b0a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f11fc005c40 tx=0x7f11fc00a350 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:38.578 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.575+0000 7f11f6ffd640 1 -- 172.21.15.105:0/2192601116 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f11f80839f0 con 0x7f12000d1490 2024-09-21T03:21:38.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.790+0000 7f120868b640 1 -- 172.21.15.105:0/2192601116 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f12000cf920 con 0x7f12000d1490 2024-09-21T03:21:38.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.790+0000 7f11f6ffd640 1 -- 172.21.15.105:0/2192601116 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5234 (secure 0 0 0) 0x7f11f80832f0 con 0x7f12000d1490 2024-09-21T03:21:38.793 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:38.793 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":38,"btime":"2024-09-21T03:21:17:305276+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5593,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2041248590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2041248590},{"type":"v1","addr":"172.21.15.162:6836","nonce":2041248590}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5596,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/775014606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":775014606},{"type":"v1","addr":"172.21.15.162:6837","nonce":775014606}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5937,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3799275472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3799275472},{"type":"v1","addr":"172.21.15.105:6833","nonce":3799275472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:21:14.660239+0000","modified":"2024-09-21T03:21:16.660264+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5940},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5940":{"gid":5940,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1561028223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1561028223},{"type":"v1","addr":"172.21.15.105:6835","nonce":1561028223}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5940,"qdb_cluster":[5940]},"id":5}]} 2024-09-21T03:21:38.793 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 38 2024-09-21T03:21:38.796 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.793+0000 7f120868b640 1 -- 172.21.15.105:0/2192601116 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f11e4078b90 msgr2=0x7f11e407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:38.796 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.793+0000 7f120868b640 1 --2- 172.21.15.105:0/2192601116 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f11e4078b90 0x7f11e407b0a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f11fc005c40 tx=0x7f11fc00a350 comp rx=0 tx=0).stop 2024-09-21T03:21:38.796 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.793+0000 7f120868b640 1 -- 172.21.15.105:0/2192601116 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12000d1490 msgr2=0x7f1200145430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:38.796 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.793+0000 7f120868b640 1 --2- 172.21.15.105:0/2192601116 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12000d1490 0x7f1200145430 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f11f8034040 tx=0x7f11f8003960 comp rx=0 tx=0).stop 2024-09-21T03:21:38.796 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.793+0000 7f120868b640 1 -- 172.21.15.105:0/2192601116 shutdown_connections 2024-09-21T03:21:38.796 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.793+0000 7f120868b640 1 --2- 172.21.15.105:0/2192601116 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f11e4078b90 0x7f11e407b0a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:38.796 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.793+0000 7f120868b640 1 --2- 172.21.15.105:0/2192601116 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12000d1490 0x7f1200145430 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:38.796 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.793+0000 7f120868b640 1 --2- 172.21.15.105:0/2192601116 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f12000ccbd0 0x7f12001e5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:38.796 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.793+0000 7f120868b640 1 --2- 172.21.15.105:0/2192601116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12000b51c0 0x7f12001ea140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:38.796 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.793+0000 7f120868b640 1 -- 172.21.15.105:0/2192601116 >> 172.21.15.105:0/2192601116 conn(0x7f1200072ae0 msgr2=0x7f1200068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:38.796 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.793+0000 7f120868b640 1 -- 172.21.15.105:0/2192601116 shutdown_connections 2024-09-21T03:21:38.796 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.793+0000 7f120868b640 1 -- 172.21.15.105:0/2192601116 wait complete. 2024-09-21T03:21:38.806 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:21:38.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.917+0000 7f0173ecc640 1 -- 172.21.15.105:0/3477304526 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f016c0b97e0 msgr2=0x7f016c06f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:38.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.917+0000 7f0173ecc640 1 --2- 172.21.15.105:0/3477304526 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f016c0b97e0 0x7f016c06f6e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f015c009830 tx=0x7f015c02a3f0 comp rx=0 tx=0).stop 2024-09-21T03:21:38.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.917+0000 7f0173ecc640 1 -- 172.21.15.105:0/3477304526 shutdown_connections 2024-09-21T03:21:38.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.917+0000 7f0173ecc640 1 --2- 172.21.15.105:0/3477304526 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f016c0d0e50 0x7f016c0d1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:38.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.917+0000 7f0173ecc640 1 --2- 172.21.15.105:0/3477304526 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f016c0b97e0 0x7f016c06f6e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:38.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.917+0000 7f0173ecc640 1 -- 172.21.15.105:0/3477304526 >> 172.21.15.105:0/3477304526 conn(0x7f016c09d840 msgr2=0x7f016c08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:38.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.917+0000 7f0173ecc640 1 -- 172.21.15.105:0/3477304526 shutdown_connections 2024-09-21T03:21:38.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.917+0000 7f0173ecc640 1 -- 172.21.15.105:0/3477304526 wait complete. 2024-09-21T03:21:38.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.919+0000 7f0173ecc640 1 Processor -- start 2024-09-21T03:21:38.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.919+0000 7f0173ecc640 1 -- start start 2024-09-21T03:21:38.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.920+0000 7f0173ecc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f016c06e0a0 0x7f016c1f4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:38.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.920+0000 7f0173ecc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f016c0b97e0 0x7f016c1f89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:38.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.920+0000 7f0173ecc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f016c0d0e50 0x7f016c1f8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:38.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.920+0000 7f0173ecc640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f016c0cfea0 con 0x7f016c0d0e50 2024-09-21T03:21:38.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.920+0000 7f0173ecc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f016c0cfd20 con 0x7f016c06e0a0 2024-09-21T03:21:38.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.920+0000 7f0173ecc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f016c0d0020 con 0x7f016c0b97e0 2024-09-21T03:21:38.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.920+0000 7f0172469640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f016c0d0e50 0x7f016c1f8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:38.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.920+0000 7f0172469640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f016c0d0e50 0x7f016c1f8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:50534/0 (socket says 172.21.15.105:50534) 2024-09-21T03:21:38.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.920+0000 7f0172469640 1 -- 172.21.15.105:0/343603373 learned_addr learned my addr 172.21.15.105:0/343603373 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:38.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.920+0000 7f0171467640 1 --2- 172.21.15.105:0/343603373 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f016c0b97e0 0x7f016c1f89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:38.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.920+0000 7f0171c68640 1 --2- 172.21.15.105:0/343603373 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f016c06e0a0 0x7f016c1f4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:38.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.921+0000 7f0172469640 1 -- 172.21.15.105:0/343603373 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f016c0b97e0 msgr2=0x7f016c1f89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:38.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.921+0000 7f0172469640 1 --2- 172.21.15.105:0/343603373 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f016c0b97e0 0x7f016c1f89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:38.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.921+0000 7f0172469640 1 -- 172.21.15.105:0/343603373 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f016c06e0a0 msgr2=0x7f016c1f4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:38.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.921+0000 7f0172469640 1 --2- 172.21.15.105:0/343603373 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f016c06e0a0 0x7f016c1f4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:38.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.921+0000 7f0172469640 1 -- 172.21.15.105:0/343603373 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f016c0cdac0 con 0x7f016c0d0e50 2024-09-21T03:21:38.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.921+0000 7f0172469640 1 --2- 172.21.15.105:0/343603373 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f016c0d0e50 0x7f016c1f8f00 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f016400ebf0 tx=0x7f016400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:38.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.921+0000 7f01627fc640 1 -- 172.21.15.105:0/343603373 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0164003b70 con 0x7f016c0d0e50 2024-09-21T03:21:38.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.921+0000 7f0173ecc640 1 -- 172.21.15.105:0/343603373 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f016c0cdda0 con 0x7f016c0d0e50 2024-09-21T03:21:38.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.921+0000 7f01627fc640 1 -- 172.21.15.105:0/343603373 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0164003d10 con 0x7f016c0d0e50 2024-09-21T03:21:38.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.921+0000 7f01627fc640 1 -- 172.21.15.105:0/343603373 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0164004280 con 0x7f016c0d0e50 2024-09-21T03:21:38.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.921+0000 7f0173ecc640 1 -- 172.21.15.105:0/343603373 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f016c0ce360 con 0x7f016c0d0e50 2024-09-21T03:21:38.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.922+0000 7f0173ecc640 1 -- 172.21.15.105:0/343603373 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f016c0cd830 con 0x7f016c0d0e50 2024-09-21T03:21:38.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.923+0000 7f01627fc640 1 -- 172.21.15.105:0/343603373 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0164004420 con 0x7f016c0d0e50 2024-09-21T03:21:38.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.923+0000 7f01627fc640 1 --2- 172.21.15.105:0/343603373 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0150078b90 0x7f015007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:38.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.923+0000 7f01627fc640 1 -- 172.21.15.105:0/343603373 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f016409b940 con 0x7f016c0d0e50 2024-09-21T03:21:38.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.923+0000 7f0171c68640 1 --2- 172.21.15.105:0/343603373 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0150078b90 0x7f015007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:38.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.924+0000 7f0171c68640 1 --2- 172.21.15.105:0/343603373 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0150078b90 0x7f015007b0a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0168007d40 tx=0x7f0168007cd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:38.930 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:38.928+0000 7f01627fc640 1 -- 172.21.15.105:0/343603373 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f01640636b0 con 0x7f016c0d0e50 2024-09-21T03:21:39.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.142+0000 7f0173ecc640 1 -- 172.21.15.105:0/343603373 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f016c0d0420 con 0x7f016c0d0e50 2024-09-21T03:21:39.145 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.142+0000 7f01627fc640 1 -- 172.21.15.105:0/343603373 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5234 (secure 0 0 0) 0x7f01640680e0 con 0x7f016c0d0e50 2024-09-21T03:21:39.145 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:39.145 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":38,"btime":"2024-09-21T03:21:17:305276+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5593,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2041248590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2041248590},{"type":"v1","addr":"172.21.15.162:6836","nonce":2041248590}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5596,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/775014606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":775014606},{"type":"v1","addr":"172.21.15.162:6837","nonce":775014606}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5937,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3799275472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3799275472},{"type":"v1","addr":"172.21.15.105:6833","nonce":3799275472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:21:14.660239+0000","modified":"2024-09-21T03:21:16.660264+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5940},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5940":{"gid":5940,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1561028223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1561028223},{"type":"v1","addr":"172.21.15.105:6835","nonce":1561028223}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5940,"qdb_cluster":[5940]},"id":5}]} 2024-09-21T03:21:39.145 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 38 2024-09-21T03:21:39.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.144+0000 7f0173ecc640 1 -- 172.21.15.105:0/343603373 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0150078b90 msgr2=0x7f015007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:39.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.144+0000 7f0173ecc640 1 --2- 172.21.15.105:0/343603373 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0150078b90 0x7f015007b0a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0168007d40 tx=0x7f0168007cd0 comp rx=0 tx=0).stop 2024-09-21T03:21:39.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.144+0000 7f0173ecc640 1 -- 172.21.15.105:0/343603373 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f016c0d0e50 msgr2=0x7f016c1f8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:39.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.144+0000 7f0173ecc640 1 --2- 172.21.15.105:0/343603373 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f016c0d0e50 0x7f016c1f8f00 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f016400ebf0 tx=0x7f016400c6a0 comp rx=0 tx=0).stop 2024-09-21T03:21:39.148 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.144+0000 7f0173ecc640 1 -- 172.21.15.105:0/343603373 shutdown_connections 2024-09-21T03:21:39.148 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.144+0000 7f0173ecc640 1 --2- 172.21.15.105:0/343603373 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0150078b90 0x7f015007b0a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:39.148 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.144+0000 7f0173ecc640 1 --2- 172.21.15.105:0/343603373 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f016c0d0e50 0x7f016c1f8f00 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:39.148 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.144+0000 7f0173ecc640 1 --2- 172.21.15.105:0/343603373 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f016c0b97e0 0x7f016c1f89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:39.148 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.144+0000 7f0173ecc640 1 --2- 172.21.15.105:0/343603373 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f016c06e0a0 0x7f016c1f4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:39.148 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.144+0000 7f0173ecc640 1 -- 172.21.15.105:0/343603373 >> 172.21.15.105:0/343603373 conn(0x7f016c09d840 msgr2=0x7f016c068e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:39.148 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.144+0000 7f0173ecc640 1 -- 172.21.15.105:0/343603373 shutdown_connections 2024-09-21T03:21:39.148 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.145+0000 7f0173ecc640 1 -- 172.21.15.105:0/343603373 wait complete. 2024-09-21T03:21:39.158 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:21:39.270 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.268+0000 7f37a9f58640 1 -- 172.21.15.105:0/2704118309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37a40b2cb0 msgr2=0x7f37a40b30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:39.271 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.268+0000 7f37a9f58640 1 --2- 172.21.15.105:0/2704118309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37a40b2cb0 0x7f37a40b30c0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f37a4075570 tx=0x7f379c02aa30 comp rx=0 tx=0).stop 2024-09-21T03:21:39.271 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.268+0000 7f37a9f58640 1 -- 172.21.15.105:0/2704118309 shutdown_connections 2024-09-21T03:21:39.271 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.268+0000 7f37a9f58640 1 --2- 172.21.15.105:0/2704118309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37a40b2cb0 0x7f37a40b30c0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:39.271 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.268+0000 7f37a9f58640 1 --2- 172.21.15.105:0/2704118309 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37a40b0520 0x7f37a4071650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:39.271 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.268+0000 7f37a9f58640 1 --2- 172.21.15.105:0/2704118309 >> v2:172.21.15.162:3300/0 conn(0x7f37a415b8f0 0x7f37a40cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:39.271 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.268+0000 7f37a9f58640 1 -- 172.21.15.105:0/2704118309 >> 172.21.15.105:0/2704118309 conn(0x7f37a40cdcb0 msgr2=0x7f37a40ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:39.271 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.268+0000 7f37a9f58640 1 -- 172.21.15.105:0/2704118309 shutdown_connections 2024-09-21T03:21:39.271 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.268+0000 7f37a9f58640 1 -- 172.21.15.105:0/2704118309 wait complete. 2024-09-21T03:21:39.272 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.270+0000 7f37a9f58640 1 Processor -- start 2024-09-21T03:21:39.272 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.270+0000 7f37a9f58640 1 -- start start 2024-09-21T03:21:39.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.271+0000 7f37a9f58640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37a40b0520 0x7f37a41f93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:39.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.271+0000 7f37a9f58640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37a40b2cb0 0x7f37a41e1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:39.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.271+0000 7f37a9f58640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37a415b8f0 0x7f37a414d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:39.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.271+0000 7f37a9f58640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f37a40adfa0 con 0x7f37a415b8f0 2024-09-21T03:21:39.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.271+0000 7f37a9f58640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f37a4071da0 con 0x7f37a40b0520 2024-09-21T03:21:39.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.271+0000 7f37a9f58640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f37a40ae120 con 0x7f37a40b2cb0 2024-09-21T03:21:39.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.271+0000 7f37a3fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37a415b8f0 0x7f37a414d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:39.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.271+0000 7f37a3fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37a415b8f0 0x7f37a414d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:50540/0 (socket says 172.21.15.105:50540) 2024-09-21T03:21:39.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.271+0000 7f37a3fff640 1 -- 172.21.15.105:0/3846902547 learned_addr learned my addr 172.21.15.105:0/3846902547 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:39.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.271+0000 7f37a2ffd640 1 --2- 172.21.15.105:0/3846902547 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37a40b2cb0 0x7f37a41e1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:39.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.271+0000 7f37a37fe640 1 --2- 172.21.15.105:0/3846902547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37a40b0520 0x7f37a41f93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:39.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.271+0000 7f37a3fff640 1 -- 172.21.15.105:0/3846902547 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37a40b2cb0 msgr2=0x7f37a41e1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:39.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.271+0000 7f37a3fff640 1 --2- 172.21.15.105:0/3846902547 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37a40b2cb0 0x7f37a41e1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:39.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.271+0000 7f37a3fff640 1 -- 172.21.15.105:0/3846902547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37a40b0520 msgr2=0x7f37a41f93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:39.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.271+0000 7f37a3fff640 1 --2- 172.21.15.105:0/3846902547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37a40b0520 0x7f37a41f93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:39.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.271+0000 7f37a3fff640 1 -- 172.21.15.105:0/3846902547 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37a41e0cd0 con 0x7f37a415b8f0 2024-09-21T03:21:39.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.272+0000 7f37a3fff640 1 --2- 172.21.15.105:0/3846902547 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37a415b8f0 0x7f37a414d6e0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f379c02b020 tx=0x7f379c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:39.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.272+0000 7f378bfff640 1 -- 172.21.15.105:0/3846902547 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f379c033050 con 0x7f37a415b8f0 2024-09-21T03:21:39.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.272+0000 7f378bfff640 1 -- 172.21.15.105:0/3846902547 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f379c004450 con 0x7f37a415b8f0 2024-09-21T03:21:39.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.272+0000 7f37a9f58640 1 -- 172.21.15.105:0/3846902547 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37a41e0fb0 con 0x7f37a415b8f0 2024-09-21T03:21:39.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.272+0000 7f378bfff640 1 -- 172.21.15.105:0/3846902547 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f379c038450 con 0x7f37a415b8f0 2024-09-21T03:21:39.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.272+0000 7f37a9f58640 1 -- 172.21.15.105:0/3846902547 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37a41e1570 con 0x7f37a415b8f0 2024-09-21T03:21:39.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.273+0000 7f37a9f58640 1 -- 172.21.15.105:0/3846902547 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37a40b30c0 con 0x7f37a415b8f0 2024-09-21T03:21:39.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.273+0000 7f378bfff640 1 -- 172.21.15.105:0/3846902547 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f379c036070 con 0x7f37a415b8f0 2024-09-21T03:21:39.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.274+0000 7f378bfff640 1 --2- 172.21.15.105:0/3846902547 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3790078bc0 0x7f379007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:39.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.274+0000 7f378bfff640 1 -- 172.21.15.105:0/3846902547 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f379c0bc290 con 0x7f37a415b8f0 2024-09-21T03:21:39.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.274+0000 7f37a37fe640 1 --2- 172.21.15.105:0/3846902547 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3790078bc0 0x7f379007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:39.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.275+0000 7f37a37fe640 1 --2- 172.21.15.105:0/3846902547 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3790078bc0 0x7f379007b0d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3794005fd0 tx=0x7f3794005850 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:39.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.278+0000 7f378bfff640 1 -- 172.21.15.105:0/3846902547 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f379c0846d0 con 0x7f37a415b8f0 2024-09-21T03:21:39.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.462+0000 7f37a9f58640 1 -- 172.21.15.105:0/3846902547 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f37a40af2b0 con 0x7f37a415b8f0 2024-09-21T03:21:39.466 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.464+0000 7f378bfff640 1 -- 172.21.15.105:0/3846902547 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) ==== 74+0+16800 (secure 0 0 0) 0x7f379c083fd0 con 0x7f37a415b8f0 2024-09-21T03:21:39.466 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:39.467 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":69,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:21:16.299955+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:21:12.315659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-21T03:21:13.622324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:21:39.468 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.466+0000 7f37a9f58640 1 -- 172.21.15.105:0/3846902547 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3790078bc0 msgr2=0x7f379007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:39.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.466+0000 7f37a9f58640 1 --2- 172.21.15.105:0/3846902547 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3790078bc0 0x7f379007b0d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3794005fd0 tx=0x7f3794005850 comp rx=0 tx=0).stop 2024-09-21T03:21:39.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.466+0000 7f37a9f58640 1 -- 172.21.15.105:0/3846902547 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37a415b8f0 msgr2=0x7f37a414d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:39.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.466+0000 7f37a9f58640 1 --2- 172.21.15.105:0/3846902547 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37a415b8f0 0x7f37a414d6e0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f379c02b020 tx=0x7f379c003f10 comp rx=0 tx=0).stop 2024-09-21T03:21:39.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.466+0000 7f37a9f58640 1 -- 172.21.15.105:0/3846902547 shutdown_connections 2024-09-21T03:21:39.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.466+0000 7f37a9f58640 1 --2- 172.21.15.105:0/3846902547 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3790078bc0 0x7f379007b0d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:39.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.466+0000 7f37a9f58640 1 --2- 172.21.15.105:0/3846902547 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37a415b8f0 0x7f37a414d6e0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:39.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.466+0000 7f37a9f58640 1 --2- 172.21.15.105:0/3846902547 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37a40b2cb0 0x7f37a41e1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:39.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.466+0000 7f37a9f58640 1 --2- 172.21.15.105:0/3846902547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37a40b0520 0x7f37a41f93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:39.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.466+0000 7f37a9f58640 1 -- 172.21.15.105:0/3846902547 >> 172.21.15.105:0/3846902547 conn(0x7f37a40cdcb0 msgr2=0x7f37a40b5af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:39.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.466+0000 7f37a9f58640 1 -- 172.21.15.105:0/3846902547 shutdown_connections 2024-09-21T03:21:39.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.466+0000 7f37a9f58640 1 -- 172.21.15.105:0/3846902547 wait complete. 2024-09-21T03:21:39.480 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T03:21:39.593 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.590+0000 7f3ec520e640 1 -- 172.21.15.105:0/2995439988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ec00b2cb0 msgr2=0x7f3ec00b30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:39.593 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.590+0000 7f3ec520e640 1 --2- 172.21.15.105:0/2995439988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ec00b2cb0 0x7f3ec00b30c0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8009860 tx=0x7f3eb802a540 comp rx=0 tx=0).stop 2024-09-21T03:21:39.593 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.590+0000 7f3ec520e640 1 -- 172.21.15.105:0/2995439988 shutdown_connections 2024-09-21T03:21:39.593 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.590+0000 7f3ec520e640 1 --2- 172.21.15.105:0/2995439988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ec00b2cb0 0x7f3ec00b30c0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:39.593 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.590+0000 7f3ec520e640 1 --2- 172.21.15.105:0/2995439988 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ec015b8f0 0x7f3ec00cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:39.593 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.590+0000 7f3ec520e640 1 -- 172.21.15.105:0/2995439988 >> 172.21.15.105:0/2995439988 conn(0x7f3ec00cdcb0 msgr2=0x7f3ec00ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:39.593 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.590+0000 7f3ec520e640 1 -- 172.21.15.105:0/2995439988 shutdown_connections 2024-09-21T03:21:39.593 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.590+0000 7f3ec520e640 1 -- 172.21.15.105:0/2995439988 wait complete. 2024-09-21T03:21:39.594 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.592+0000 7f3ec520e640 1 Processor -- start 2024-09-21T03:21:39.594 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.592+0000 7f3ec520e640 1 -- start start 2024-09-21T03:21:39.597 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.593+0000 7f3ec520e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ec00b0520 0x7f3ec01e5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:39.597 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.593+0000 7f3ec520e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ec00b2cb0 0x7f3ec0147610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:39.597 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.593+0000 7f3ec520e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ec015b8f0 0x7f3ec006cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:39.597 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.593+0000 7f3ec520e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec00ae370 con 0x7f3ec00b0520 2024-09-21T03:21:39.597 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.593+0000 7f3ec520e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec00ae1f0 con 0x7f3ec015b8f0 2024-09-21T03:21:39.597 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.593+0000 7f3ec520e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3ec00ae4f0 con 0x7f3ec00b2cb0 2024-09-21T03:21:39.597 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.593+0000 7f3ebed9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ec00b0520 0x7f3ec01e5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:39.597 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.593+0000 7f3ebed9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ec00b0520 0x7f3ec01e5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:50556/0 (socket says 172.21.15.105:50556) 2024-09-21T03:21:39.597 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.593+0000 7f3ebed9d640 1 -- 172.21.15.105:0/816605805 learned_addr learned my addr 172.21.15.105:0/816605805 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:39.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.594+0000 7f3ebed9d640 1 -- 172.21.15.105:0/816605805 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ec00b2cb0 msgr2=0x7f3ec0147610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:39.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.594+0000 7f3ebed9d640 1 --2- 172.21.15.105:0/816605805 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ec00b2cb0 0x7f3ec0147610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:39.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.594+0000 7f3ebed9d640 1 -- 172.21.15.105:0/816605805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ec015b8f0 msgr2=0x7f3ec006cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:39.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.594+0000 7f3ebed9d640 1 --2- 172.21.15.105:0/816605805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ec015b8f0 0x7f3ec006cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:39.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.594+0000 7f3ebed9d640 1 -- 172.21.15.105:0/816605805 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ec0147b50 con 0x7f3ec00b0520 2024-09-21T03:21:39.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.594+0000 7f3ebed9d640 1 --2- 172.21.15.105:0/816605805 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ec00b0520 0x7f3ec01e5910 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f3eb000eb60 tx=0x7f3eb000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:39.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.594+0000 7f3eb77fe640 1 -- 172.21.15.105:0/816605805 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb0010630 con 0x7f3ec00b0520 2024-09-21T03:21:39.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.594+0000 7f3eb77fe640 1 -- 172.21.15.105:0/816605805 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3eb00108c0 con 0x7f3ec00b0520 2024-09-21T03:21:39.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.594+0000 7f3ec520e640 1 -- 172.21.15.105:0/816605805 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ec01f3450 con 0x7f3ec00b0520 2024-09-21T03:21:39.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.594+0000 7f3eb77fe640 1 -- 172.21.15.105:0/816605805 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb0010d10 con 0x7f3ec00b0520 2024-09-21T03:21:39.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.594+0000 7f3ec520e640 1 -- 172.21.15.105:0/816605805 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ec01f3a10 con 0x7f3ec00b0520 2024-09-21T03:21:39.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.595+0000 7f3ec520e640 1 -- 172.21.15.105:0/816605805 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ec00b30c0 con 0x7f3ec00b0520 2024-09-21T03:21:39.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.596+0000 7f3eb77fe640 1 -- 172.21.15.105:0/816605805 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3eb0018420 con 0x7f3ec00b0520 2024-09-21T03:21:39.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.596+0000 7f3eb77fe640 1 --2- 172.21.15.105:0/816605805 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3ea0078b90 0x7f3ea007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:39.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.596+0000 7f3eb77fe640 1 -- 172.21.15.105:0/816605805 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f3eb009bb20 con 0x7f3ec00b0520 2024-09-21T03:21:39.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.596+0000 7f3ebe59c640 1 --2- 172.21.15.105:0/816605805 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3ea0078b90 0x7f3ea007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:39.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.597+0000 7f3ebe59c640 1 --2- 172.21.15.105:0/816605805 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3ea0078b90 0x7f3ea007b0a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3ea80046b0 tx=0x7f3ea80012b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:39.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.601+0000 7f3eb77fe640 1 -- 172.21.15.105:0/816605805 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3ec0147b50 con 0x7f3ec00b0520 2024-09-21T03:21:39.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.814+0000 7f3ec520e640 1 -- 172.21.15.105:0/816605805 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f3ec01e60a0 con 0x7f3ec00b0520 2024-09-21T03:21:39.818 INFO:tasks.ceph.mon.a.smithi105.stderr:2024-09-21T03:21:39.815+0000 7f25819ea640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T03:21:39.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.817+0000 7f3eb77fe640 1 -- 172.21.15.105:0/816605805 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v39) ==== 161+0+0 (secure 0 0 0) 0x7f3eb000ee60 con 0x7f3ec00b0520 2024-09-21T03:21:39.819 INFO:teuthology.orchestra.run.smithi105.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T03:21:39.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.819+0000 7f3ec520e640 1 -- 172.21.15.105:0/816605805 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3ea0078b90 msgr2=0x7f3ea007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:39.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.819+0000 7f3ec520e640 1 --2- 172.21.15.105:0/816605805 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3ea0078b90 0x7f3ea007b0a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3ea80046b0 tx=0x7f3ea80012b0 comp rx=0 tx=0).stop 2024-09-21T03:21:39.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.819+0000 7f3ec520e640 1 -- 172.21.15.105:0/816605805 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ec00b0520 msgr2=0x7f3ec01e5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:39.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.819+0000 7f3ec520e640 1 --2- 172.21.15.105:0/816605805 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ec00b0520 0x7f3ec01e5910 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f3eb000eb60 tx=0x7f3eb000c6a0 comp rx=0 tx=0).stop 2024-09-21T03:21:39.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.819+0000 7f3ec520e640 1 -- 172.21.15.105:0/816605805 shutdown_connections 2024-09-21T03:21:39.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.819+0000 7f3ec520e640 1 --2- 172.21.15.105:0/816605805 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3ea0078b90 0x7f3ea007b0a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:39.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.819+0000 7f3ec520e640 1 --2- 172.21.15.105:0/816605805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ec015b8f0 0x7f3ec006cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:39.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.819+0000 7f3ec520e640 1 --2- 172.21.15.105:0/816605805 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ec00b2cb0 0x7f3ec0147610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:39.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.819+0000 7f3ec520e640 1 --2- 172.21.15.105:0/816605805 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ec00b0520 0x7f3ec01e5910 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:39.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.819+0000 7f3ec520e640 1 -- 172.21.15.105:0/816605805 >> 172.21.15.105:0/816605805 conn(0x7f3ec00cdcb0 msgr2=0x7f3ec00b22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:39.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.819+0000 7f3ec520e640 1 -- 172.21.15.105:0/816605805 shutdown_connections 2024-09-21T03:21:39.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.819+0000 7f3ec520e640 1 -- 172.21.15.105:0/816605805 wait complete. 2024-09-21T03:21:39.833 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T03:21:39.884 INFO:tasks.ceph.mds.a.smithi105.stdout:starting mds.a at 2024-09-21T03:21:39.950 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.947+0000 7fcc04c7e640 1 -- 172.21.15.105:0/1599162920 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc0015a130 msgr2=0x7fcc000d0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:39.951 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.947+0000 7fcc04c7e640 1 --2- 172.21.15.105:0/1599162920 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc0015a130 0x7fcc000d0190 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0009830 tx=0x7fcbf002a510 comp rx=0 tx=0).stop 2024-09-21T03:21:39.951 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.948+0000 7fcc04c7e640 1 -- 172.21.15.105:0/1599162920 shutdown_connections 2024-09-21T03:21:39.951 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.948+0000 7fcc04c7e640 1 --2- 172.21.15.105:0/1599162920 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc0015a130 0x7fcc000d0190 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:39.951 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.948+0000 7fcc04c7e640 1 -- 172.21.15.105:0/1599162920 >> 172.21.15.105:0/1599162920 conn(0x7fcc0006def0 msgr2=0x7fcc0006e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:39.951 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.948+0000 7fcc04c7e640 1 -- 172.21.15.105:0/1599162920 shutdown_connections 2024-09-21T03:21:39.951 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.948+0000 7fcc04c7e640 1 -- 172.21.15.105:0/1599162920 wait complete. 2024-09-21T03:21:39.952 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.950+0000 7fcc04c7e640 1 Processor -- start 2024-09-21T03:21:39.952 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.950+0000 7fcc04c7e640 1 -- start start 2024-09-21T03:21:39.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.951+0000 7fcc04c7e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc000cdbb0 0x7fcc001f65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:39.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.951+0000 7fcc04c7e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc0015a130 0x7fcc001f6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:39.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.951+0000 7fcc04c7e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc00138b90 0x7fcc00138fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:39.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.951+0000 7fcc04c7e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcc00074c20 con 0x7fcc0015a130 2024-09-21T03:21:39.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.951+0000 7fcc04c7e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcc00074aa0 con 0x7fcc00138b90 2024-09-21T03:21:39.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.951+0000 7fcc04c7e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcc00074da0 con 0x7fcc000cdbb0 2024-09-21T03:21:39.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.951+0000 7fcbfdd9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc0015a130 0x7fcc001f6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:39.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.951+0000 7fcbfdd9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc0015a130 0x7fcc001f6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:50588/0 (socket says 172.21.15.105:50588) 2024-09-21T03:21:39.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.951+0000 7fcbfdd9b640 1 -- 172.21.15.105:0/2295379162 learned_addr learned my addr 172.21.15.105:0/2295379162 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:39.956 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.951+0000 7fcbfe59c640 1 --2- 172.21.15.105:0/2295379162 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc000cdbb0 0x7fcc001f65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:39.956 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.951+0000 7fcbfed9d640 1 --2- 172.21.15.105:0/2295379162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc00138b90 0x7fcc00138fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:39.956 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.951+0000 7fcbfdd9b640 1 -- 172.21.15.105:0/2295379162 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc000cdbb0 msgr2=0x7fcc001f65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:39.956 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.951+0000 7fcbfdd9b640 1 --2- 172.21.15.105:0/2295379162 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc000cdbb0 0x7fcc001f65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:39.956 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.951+0000 7fcbfdd9b640 1 -- 172.21.15.105:0/2295379162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc00138b90 msgr2=0x7fcc00138fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:39.956 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.951+0000 7fcbfdd9b640 1 --2- 172.21.15.105:0/2295379162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc00138b90 0x7fcc00138fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:39.956 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.951+0000 7fcbfdd9b640 1 -- 172.21.15.105:0/2295379162 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc001394e0 con 0x7fcc0015a130 2024-09-21T03:21:39.956 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.951+0000 7fcbfed9d640 1 --2- 172.21.15.105:0/2295379162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc00138b90 0x7fcc00138fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:21:39.956 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.951+0000 7fcbfdd9b640 1 --2- 172.21.15.105:0/2295379162 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc0015a130 0x7fcc001f6b30 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fcbf400c3c0 tx=0x7fcbf400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:39.956 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.952+0000 7fcbeeffd640 1 -- 172.21.15.105:0/2295379162 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf4017070 con 0x7fcc0015a130 2024-09-21T03:21:39.956 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.952+0000 7fcbeeffd640 1 -- 172.21.15.105:0/2295379162 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcbf40035f0 con 0x7fcc0015a130 2024-09-21T03:21:39.957 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.952+0000 7fcc04c7e640 1 -- 172.21.15.105:0/2295379162 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc001399d0 con 0x7fcc0015a130 2024-09-21T03:21:39.957 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.952+0000 7fcbeeffd640 1 -- 172.21.15.105:0/2295379162 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf4003a80 con 0x7fcc0015a130 2024-09-21T03:21:39.957 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.952+0000 7fcc04c7e640 1 -- 172.21.15.105:0/2295379162 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc000cae30 con 0x7fcc0015a130 2024-09-21T03:21:39.958 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.953+0000 7fcc04c7e640 1 -- 172.21.15.105:0/2295379162 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc00139740 con 0x7fcc0015a130 2024-09-21T03:21:39.958 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.953+0000 7fcbeeffd640 1 -- 172.21.15.105:0/2295379162 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcbf401a070 con 0x7fcc0015a130 2024-09-21T03:21:39.958 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.954+0000 7fcbeeffd640 1 --2- 172.21.15.105:0/2295379162 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcbe0078bc0 0x7fcbe007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:39.958 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.954+0000 7fcbeeffd640 1 -- 172.21.15.105:0/2295379162 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5795+0+0 (secure 0 0 0) 0x7fcbf4099fa0 con 0x7fcc0015a130 2024-09-21T03:21:39.958 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.954+0000 7fcbfe59c640 1 --2- 172.21.15.105:0/2295379162 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcbe0078bc0 0x7fcbe007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:39.958 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.955+0000 7fcbfe59c640 1 --2- 172.21.15.105:0/2295379162 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcbe0078bc0 0x7fcbe007b0d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0034000 tx=0x7fcbf0004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:39.961 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:39.959+0000 7fcbeeffd640 1 -- 172.21.15.105:0/2295379162 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fcbf4061d30 con 0x7fcc0015a130 2024-09-21T03:21:40.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.171+0000 7fcc04c7e640 1 -- 172.21.15.105:0/2295379162 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fcc000d0190 con 0x7fcc0015a130 2024-09-21T03:21:40.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.818+0000 7fcbeeffd640 1 -- 172.21.15.105:0/2295379162 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v40) ==== 104+0+0 (secure 0 0 0) 0x7fcbf4066760 con 0x7fcc0015a130 2024-09-21T03:21:40.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.822+0000 7fcc04c7e640 1 -- 172.21.15.105:0/2295379162 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcbe0078bc0 msgr2=0x7fcbe007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:40.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.822+0000 7fcc04c7e640 1 --2- 172.21.15.105:0/2295379162 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcbe0078bc0 0x7fcbe007b0d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0034000 tx=0x7fcbf0004730 comp rx=0 tx=0).stop 2024-09-21T03:21:40.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.822+0000 7fcc04c7e640 1 -- 172.21.15.105:0/2295379162 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc0015a130 msgr2=0x7fcc001f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:40.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.822+0000 7fcc04c7e640 1 --2- 172.21.15.105:0/2295379162 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc0015a130 0x7fcc001f6b30 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fcbf400c3c0 tx=0x7fcbf400c880 comp rx=0 tx=0).stop 2024-09-21T03:21:40.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.822+0000 7fcc04c7e640 1 -- 172.21.15.105:0/2295379162 shutdown_connections 2024-09-21T03:21:40.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.822+0000 7fcc04c7e640 1 --2- 172.21.15.105:0/2295379162 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcbe0078bc0 0x7fcbe007b0d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:40.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.822+0000 7fcc04c7e640 1 --2- 172.21.15.105:0/2295379162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc00138b90 0x7fcc00138fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:40.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.822+0000 7fcc04c7e640 1 --2- 172.21.15.105:0/2295379162 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc0015a130 0x7fcc001f6b30 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:40.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.822+0000 7fcc04c7e640 1 --2- 172.21.15.105:0/2295379162 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc000cdbb0 0x7fcc001f65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:40.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.822+0000 7fcc04c7e640 1 -- 172.21.15.105:0/2295379162 >> 172.21.15.105:0/2295379162 conn(0x7fcc0006def0 msgr2=0x7fcc0006cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:40.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.822+0000 7fcc04c7e640 1 -- 172.21.15.105:0/2295379162 shutdown_connections 2024-09-21T03:21:40.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.822+0000 7fcc04c7e640 1 -- 172.21.15.105:0/2295379162 wait complete. 2024-09-21T03:21:40.837 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T03:21:40.957 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.954+0000 7fe77600a640 1 -- 172.21.15.105:0/1815808362 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe7700d0340 msgr2=0x7fe7700ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:40.957 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.954+0000 7fe77600a640 1 --2- 172.21.15.105:0/1815808362 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe7700d0340 0x7fe7700ccbc0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fe770160be0 tx=0x7fe76802aa00 comp rx=0 tx=0).stop 2024-09-21T03:21:40.957 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.954+0000 7fe77600a640 1 -- 172.21.15.105:0/1815808362 shutdown_connections 2024-09-21T03:21:40.957 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.954+0000 7fe77600a640 1 --2- 172.21.15.105:0/1815808362 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe7700d0340 0x7fe7700ccbc0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:40.957 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.954+0000 7fe77600a640 1 --2- 172.21.15.105:0/1815808362 >> v2:172.21.15.162:3300/0 conn(0x7fe7700cff30 0x7fe77015c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:40.957 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.954+0000 7fe77600a640 1 --2- 172.21.15.105:0/1815808362 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7701601c0 0x7fe7700d1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:40.957 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.954+0000 7fe77600a640 1 -- 172.21.15.105:0/1815808362 >> 172.21.15.105:0/1815808362 conn(0x7fe770072a90 msgr2=0x7fe770072ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:40.957 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.954+0000 7fe77600a640 1 -- 172.21.15.105:0/1815808362 shutdown_connections 2024-09-21T03:21:40.957 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.954+0000 7fe77600a640 1 -- 172.21.15.105:0/1815808362 wait complete. 2024-09-21T03:21:40.958 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.956+0000 7fe77600a640 1 Processor -- start 2024-09-21T03:21:40.958 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.956+0000 7fe77600a640 1 -- start start 2024-09-21T03:21:40.961 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.957+0000 7fe77600a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7700cff30 0x7fe7700b4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:40.961 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.957+0000 7fe77600a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe7700d0340 0x7fe7700b1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:40.961 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.957+0000 7fe77600a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7701601c0 0x7fe7701f6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:40.961 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.957+0000 7fe77600a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe77015d0d0 con 0x7fe7700d0340 2024-09-21T03:21:40.961 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.957+0000 7fe77600a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe7700cd500 con 0x7fe7701601c0 2024-09-21T03:21:40.961 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.957+0000 7fe77600a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe77015d250 con 0x7fe7700cff30 2024-09-21T03:21:40.961 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.957+0000 7fe76effd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe7700d0340 0x7fe7700b1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:40.961 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.957+0000 7fe76effd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe7700d0340 0x7fe7700b1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:50602/0 (socket says 172.21.15.105:50602) 2024-09-21T03:21:40.961 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.957+0000 7fe76effd640 1 -- 172.21.15.105:0/1841235973 learned_addr learned my addr 172.21.15.105:0/1841235973 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:40.962 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.957+0000 7fe76ffff640 1 --2- 172.21.15.105:0/1841235973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7701601c0 0x7fe7701f6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:40.962 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.957+0000 7fe76f7fe640 1 --2- 172.21.15.105:0/1841235973 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7700cff30 0x7fe7700b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:40.962 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.958+0000 7fe76effd640 1 -- 172.21.15.105:0/1841235973 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7700cff30 msgr2=0x7fe7700b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:40.962 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.958+0000 7fe76effd640 1 --2- 172.21.15.105:0/1841235973 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7700cff30 0x7fe7700b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:40.962 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.958+0000 7fe76effd640 1 -- 172.21.15.105:0/1841235973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7701601c0 msgr2=0x7fe7701f6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:40.962 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.958+0000 7fe76effd640 1 --2- 172.21.15.105:0/1841235973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7701601c0 0x7fe7701f6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:40.962 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.958+0000 7fe76effd640 1 -- 172.21.15.105:0/1841235973 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7700b25f0 con 0x7fe7700d0340 2024-09-21T03:21:40.962 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.958+0000 7fe76effd640 1 --2- 172.21.15.105:0/1841235973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe7700d0340 0x7fe7700b1930 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fe76400d6d0 tx=0x7fe76400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:40.962 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.958+0000 7fe757fff640 1 -- 172.21.15.105:0/1841235973 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe764017070 con 0x7fe7700d0340 2024-09-21T03:21:40.962 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.958+0000 7fe757fff640 1 -- 172.21.15.105:0/1841235973 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe764004310 con 0x7fe7700d0340 2024-09-21T03:21:40.962 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.958+0000 7fe77600a640 1 -- 172.21.15.105:0/1841235973 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7700b28d0 con 0x7fe7700d0340 2024-09-21T03:21:40.962 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.958+0000 7fe757fff640 1 -- 172.21.15.105:0/1841235973 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe764009a20 con 0x7fe7700d0340 2024-09-21T03:21:40.962 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.958+0000 7fe77600a640 1 -- 172.21.15.105:0/1841235973 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7700b2e90 con 0x7fe7700d0340 2024-09-21T03:21:40.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.959+0000 7fe77600a640 1 -- 172.21.15.105:0/1841235973 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7700b2360 con 0x7fe7700d0340 2024-09-21T03:21:40.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.960+0000 7fe757fff640 1 -- 172.21.15.105:0/1841235973 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe7640035f0 con 0x7fe7700d0340 2024-09-21T03:21:40.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.960+0000 7fe757fff640 1 --2- 172.21.15.105:0/1841235973 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe75c078b90 0x7fe75c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:40.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.960+0000 7fe757fff640 1 -- 172.21.15.105:0/1841235973 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5795+0+0 (secure 0 0 0) 0x7fe76409afc0 con 0x7fe7700d0340 2024-09-21T03:21:40.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.960+0000 7fe76f7fe640 1 --2- 172.21.15.105:0/1841235973 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe75c078b90 0x7fe75c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:40.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.961+0000 7fe76f7fe640 1 --2- 172.21.15.105:0/1841235973 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe75c078b90 0x7fe75c07b0a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe7600045b0 tx=0x7fe76000b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:40.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:40.965+0000 7fe757fff640 1 -- 172.21.15.105:0/1841235973 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe764062cd0 con 0x7fe7700d0340 2024-09-21T03:21:41.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.141+0000 7fe77600a640 1 -- 172.21.15.105:0/1841235973 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe7700ccbc0 con 0x7fe7700d0340 2024-09-21T03:21:41.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.823+0000 7fe757fff640 1 -- 172.21.15.105:0/1841235973 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v71) ==== 181+0+0 (secure 0 0 0) 0x7fe764067700 con 0x7fe7700d0340 2024-09-21T03:21:41.826 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_metadata' removed 2024-09-21T03:21:41.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.826+0000 7fe77600a640 1 -- 172.21.15.105:0/1841235973 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe75c078b90 msgr2=0x7fe75c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:41.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.826+0000 7fe77600a640 1 --2- 172.21.15.105:0/1841235973 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe75c078b90 0x7fe75c07b0a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe7600045b0 tx=0x7fe76000b2e0 comp rx=0 tx=0).stop 2024-09-21T03:21:41.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.826+0000 7fe77600a640 1 -- 172.21.15.105:0/1841235973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe7700d0340 msgr2=0x7fe7700b1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:41.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.826+0000 7fe77600a640 1 --2- 172.21.15.105:0/1841235973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe7700d0340 0x7fe7700b1930 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fe76400d6d0 tx=0x7fe76400db90 comp rx=0 tx=0).stop 2024-09-21T03:21:41.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.826+0000 7fe77600a640 1 -- 172.21.15.105:0/1841235973 shutdown_connections 2024-09-21T03:21:41.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.826+0000 7fe77600a640 1 --2- 172.21.15.105:0/1841235973 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe75c078b90 0x7fe75c07b0a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:41.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.826+0000 7fe77600a640 1 --2- 172.21.15.105:0/1841235973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7701601c0 0x7fe7701f6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:41.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.826+0000 7fe77600a640 1 --2- 172.21.15.105:0/1841235973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe7700d0340 0x7fe7700b1930 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:41.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.826+0000 7fe77600a640 1 --2- 172.21.15.105:0/1841235973 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7700cff30 0x7fe7700b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:41.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.826+0000 7fe77600a640 1 -- 172.21.15.105:0/1841235973 >> 172.21.15.105:0/1841235973 conn(0x7fe770072a90 msgr2=0x7fe7700d2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:41.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.826+0000 7fe77600a640 1 -- 172.21.15.105:0/1841235973 shutdown_connections 2024-09-21T03:21:41.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.826+0000 7fe77600a640 1 -- 172.21.15.105:0/1841235973 wait complete. 2024-09-21T03:21:41.846 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T03:21:41.970 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.967+0000 7f2fb91da640 1 -- 172.21.15.105:0/3841397702 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fb415b660 msgr2=0x7f2fb415f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:41.970 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.967+0000 7f2fb91da640 1 --2- 172.21.15.105:0/3841397702 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fb415b660 0x7f2fb415f5d0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c005fd0 tx=0x7f2f9c02a540 comp rx=0 tx=0).stop 2024-09-21T03:21:41.970 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.967+0000 7f2fb91da640 1 -- 172.21.15.105:0/3841397702 shutdown_connections 2024-09-21T03:21:41.970 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.967+0000 7f2fb91da640 1 --2- 172.21.15.105:0/3841397702 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fb415b660 0x7f2fb415f5d0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:41.970 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.967+0000 7f2fb91da640 1 --2- 172.21.15.105:0/3841397702 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fb406f1d0 0x7f2fb415f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:41.970 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.967+0000 7f2fb91da640 1 -- 172.21.15.105:0/3841397702 >> 172.21.15.105:0/3841397702 conn(0x7f2fb40d0130 msgr2=0x7f2fb40d0540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:41.970 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.967+0000 7f2fb91da640 1 -- 172.21.15.105:0/3841397702 shutdown_connections 2024-09-21T03:21:41.970 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.967+0000 7f2fb91da640 1 -- 172.21.15.105:0/3841397702 wait complete. 2024-09-21T03:21:41.971 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.969+0000 7f2fb91da640 1 Processor -- start 2024-09-21T03:21:41.971 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.969+0000 7f2fb91da640 1 -- start start 2024-09-21T03:21:41.974 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.970+0000 7f2fb91da640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fb406f1d0 0x7f2fb4157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:41.974 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.970+0000 7f2fb91da640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fb40ca780 0x7f2fb414b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:41.974 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.970+0000 7f2fb91da640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fb415b660 0x7f2fb415d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:41.974 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.970+0000 7f2fb91da640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb406edb0 con 0x7f2fb406f1d0 2024-09-21T03:21:41.974 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.970+0000 7f2fb91da640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb40af270 con 0x7f2fb40ca780 2024-09-21T03:21:41.974 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.970+0000 7f2fb91da640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2fb406ef30 con 0x7f2fb415b660 2024-09-21T03:21:41.974 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.970+0000 7f2fb2d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fb406f1d0 0x7f2fb4157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:41.974 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.970+0000 7f2fb2d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fb406f1d0 0x7f2fb4157c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51622/0 (socket says 172.21.15.105:51622) 2024-09-21T03:21:41.974 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.970+0000 7f2fb2d9d640 1 -- 172.21.15.105:0/2596919947 learned_addr learned my addr 172.21.15.105:0/2596919947 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:41.975 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.971+0000 7f2fb2d9d640 1 -- 172.21.15.105:0/2596919947 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fb415b660 msgr2=0x7f2fb415d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:41.975 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.971+0000 7f2fb2d9d640 1 --2- 172.21.15.105:0/2596919947 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fb415b660 0x7f2fb415d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:41.975 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.971+0000 7f2fb2d9d640 1 -- 172.21.15.105:0/2596919947 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fb40ca780 msgr2=0x7f2fb414b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:41.975 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.971+0000 7f2fb2d9d640 1 --2- 172.21.15.105:0/2596919947 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fb40ca780 0x7f2fb414b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:41.975 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.971+0000 7f2fb2d9d640 1 -- 172.21.15.105:0/2596919947 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fb409bb70 con 0x7f2fb406f1d0 2024-09-21T03:21:41.975 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.971+0000 7f2fb2d9d640 1 --2- 172.21.15.105:0/2596919947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fb406f1d0 0x7f2fb4157c80 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f2fa400b410 tx=0x7f2fa400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:41.975 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.971+0000 7f2fabfff640 1 -- 172.21.15.105:0/2596919947 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa4015020 con 0x7f2fb406f1d0 2024-09-21T03:21:41.975 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.971+0000 7f2fabfff640 1 -- 172.21.15.105:0/2596919947 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2fa4011940 con 0x7f2fb406f1d0 2024-09-21T03:21:41.975 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.971+0000 7f2fb91da640 1 -- 172.21.15.105:0/2596919947 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fb414baa0 con 0x7f2fb406f1d0 2024-09-21T03:21:41.975 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.971+0000 7f2fabfff640 1 -- 172.21.15.105:0/2596919947 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa4011d90 con 0x7f2fb406f1d0 2024-09-21T03:21:41.975 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.971+0000 7f2fb91da640 1 -- 172.21.15.105:0/2596919947 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fb409b890 con 0x7f2fb406f1d0 2024-09-21T03:21:41.976 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.972+0000 7f2fb91da640 1 -- 172.21.15.105:0/2596919947 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fb40cb560 con 0x7f2fb406f1d0 2024-09-21T03:21:41.976 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.973+0000 7f2fabfff640 1 -- 172.21.15.105:0/2596919947 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2fa4018020 con 0x7f2fb406f1d0 2024-09-21T03:21:41.976 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.973+0000 7f2fabfff640 1 --2- 172.21.15.105:0/2596919947 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2f94078b90 0x7f2f9407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:41.976 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.973+0000 7f2fabfff640 1 -- 172.21.15.105:0/2596919947 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5357+0+0 (secure 0 0 0) 0x7f2fa409ac20 con 0x7f2fb406f1d0 2024-09-21T03:21:41.976 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.974+0000 7f2faa59c640 1 --2- 172.21.15.105:0/2596919947 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2f94078b90 0x7f2f9407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:41.977 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.974+0000 7f2faa59c640 1 --2- 172.21.15.105:0/2596919947 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2f94078b90 0x7f2f9407b0a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c033000 tx=0x7f2f9c0046c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:41.980 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:41.978+0000 7f2fabfff640 1 -- 172.21.15.105:0/2596919947 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2fa401f020 con 0x7f2fb406f1d0 2024-09-21T03:21:42.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.153+0000 7f2fb91da640 1 -- 172.21.15.105:0/2596919947 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2fb40c9f80 con 0x7f2fb406f1d0 2024-09-21T03:21:42.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.825+0000 7f2fabfff640 1 -- 172.21.15.105:0/2596919947 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v72) ==== 169+0+0 (secure 0 0 0) 0x7f2fa40631c0 con 0x7f2fb406f1d0 2024-09-21T03:21:42.827 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_data' removed 2024-09-21T03:21:42.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.828+0000 7f2fb91da640 1 -- 172.21.15.105:0/2596919947 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2f94078b90 msgr2=0x7f2f9407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:42.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.828+0000 7f2fb91da640 1 --2- 172.21.15.105:0/2596919947 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2f94078b90 0x7f2f9407b0a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c033000 tx=0x7f2f9c0046c0 comp rx=0 tx=0).stop 2024-09-21T03:21:42.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.828+0000 7f2fb91da640 1 -- 172.21.15.105:0/2596919947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fb406f1d0 msgr2=0x7f2fb4157c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:42.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.828+0000 7f2fb91da640 1 --2- 172.21.15.105:0/2596919947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fb406f1d0 0x7f2fb4157c80 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f2fa400b410 tx=0x7f2fa400b8d0 comp rx=0 tx=0).stop 2024-09-21T03:21:42.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.828+0000 7f2fb91da640 1 -- 172.21.15.105:0/2596919947 shutdown_connections 2024-09-21T03:21:42.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.828+0000 7f2fb91da640 1 --2- 172.21.15.105:0/2596919947 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2f94078b90 0x7f2f9407b0a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:42.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.828+0000 7f2fb91da640 1 --2- 172.21.15.105:0/2596919947 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fb415b660 0x7f2fb415d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:42.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.829+0000 7f2fb91da640 1 --2- 172.21.15.105:0/2596919947 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fb40ca780 0x7f2fb414b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:42.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.829+0000 7f2fb91da640 1 --2- 172.21.15.105:0/2596919947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2fb406f1d0 0x7f2fb4157c80 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:42.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.829+0000 7f2fb91da640 1 -- 172.21.15.105:0/2596919947 >> 172.21.15.105:0/2596919947 conn(0x7f2fb40d0130 msgr2=0x7f2fb40cdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:42.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.829+0000 7f2fb91da640 1 -- 172.21.15.105:0/2596919947 shutdown_connections 2024-09-21T03:21:42.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.829+0000 7f2fb91da640 1 -- 172.21.15.105:0/2596919947 wait complete. 2024-09-21T03:21:42.845 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-21T03:21:42.965 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.962+0000 7f65747da640 1 -- 172.21.15.105:0/3384322758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f656c0d2630 msgr2=0x7f656c15d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:42.965 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.962+0000 7f65747da640 1 --2- 172.21.15.105:0/3384322758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f656c0d2630 0x7f656c15d130 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f655c009830 tx=0x7f655c02a510 comp rx=0 tx=0).stop 2024-09-21T03:21:42.965 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.962+0000 7f65747da640 1 -- 172.21.15.105:0/3384322758 shutdown_connections 2024-09-21T03:21:42.965 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.962+0000 7f65747da640 1 --2- 172.21.15.105:0/3384322758 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f656c15d670 0x7f656c0b7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:42.965 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.962+0000 7f65747da640 1 --2- 172.21.15.105:0/3384322758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f656c0d2630 0x7f656c15d130 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:42.965 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.962+0000 7f65747da640 1 -- 172.21.15.105:0/3384322758 >> 172.21.15.105:0/3384322758 conn(0x7f656c06d550 msgr2=0x7f656c071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:42.965 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.962+0000 7f65747da640 1 -- 172.21.15.105:0/3384322758 shutdown_connections 2024-09-21T03:21:42.965 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.962+0000 7f65747da640 1 -- 172.21.15.105:0/3384322758 wait complete. 2024-09-21T03:21:42.966 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.964+0000 7f65747da640 1 Processor -- start 2024-09-21T03:21:42.966 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.964+0000 7f65747da640 1 -- start start 2024-09-21T03:21:42.969 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.965+0000 7f65747da640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f656c1570e0 0x7f656c0ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:42.969 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.965+0000 7f65747da640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f656c15d670 0x7f656c1f6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:42.969 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.965+0000 7f65747da640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f656c0cb530 0x7f656c0cb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:42.969 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.965+0000 7f65747da640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f656c0b7d60 con 0x7f656c1570e0 2024-09-21T03:21:42.969 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.965+0000 7f65747da640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f656c0b7be0 con 0x7f656c15d670 2024-09-21T03:21:42.969 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.965+0000 7f65747da640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f656c0b7ee0 con 0x7f656c0cb530 2024-09-21T03:21:42.969 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.965+0000 7f6572576640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f656c1570e0 0x7f656c0ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:42.969 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.965+0000 7f6572576640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f656c1570e0 0x7f656c0ca2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51646/0 (socket says 172.21.15.105:51646) 2024-09-21T03:21:42.969 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.965+0000 7f6572576640 1 -- 172.21.15.105:0/4087326250 learned_addr learned my addr 172.21.15.105:0/4087326250 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:42.970 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.965+0000 7f6572d77640 1 --2- 172.21.15.105:0/4087326250 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f656c0cb530 0x7f656c0cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:42.970 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.965+0000 7f6572576640 1 -- 172.21.15.105:0/4087326250 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f656c0cb530 msgr2=0x7f656c0cb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:42.970 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.965+0000 7f6572576640 1 --2- 172.21.15.105:0/4087326250 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f656c0cb530 0x7f656c0cb940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:42.970 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.965+0000 7f6571d75640 1 --2- 172.21.15.105:0/4087326250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f656c15d670 0x7f656c1f6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:42.970 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.965+0000 7f6572576640 1 -- 172.21.15.105:0/4087326250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f656c15d670 msgr2=0x7f656c1f6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:42.970 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.965+0000 7f6572576640 1 --2- 172.21.15.105:0/4087326250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f656c15d670 0x7f656c1f6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:42.970 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.965+0000 7f6572576640 1 -- 172.21.15.105:0/4087326250 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f656c0cbe80 con 0x7f656c1570e0 2024-09-21T03:21:42.970 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.965+0000 7f6572d77640 1 --2- 172.21.15.105:0/4087326250 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f656c0cb530 0x7f656c0cb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:21:42.970 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.965+0000 7f6571d75640 1 --2- 172.21.15.105:0/4087326250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f656c15d670 0x7f656c1f6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:21:42.970 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.966+0000 7f6572576640 1 --2- 172.21.15.105:0/4087326250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f656c1570e0 0x7f656c0ca2a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f656800c460 tx=0x7f656800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:42.970 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.966+0000 7f6562ffd640 1 -- 172.21.15.105:0/4087326250 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6568011790 con 0x7f656c1570e0 2024-09-21T03:21:42.970 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.966+0000 7f6562ffd640 1 -- 172.21.15.105:0/4087326250 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6568017070 con 0x7f656c1570e0 2024-09-21T03:21:42.970 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.966+0000 7f65747da640 1 -- 172.21.15.105:0/4087326250 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f656c0cad20 con 0x7f656c1570e0 2024-09-21T03:21:42.970 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.966+0000 7f6562ffd640 1 -- 172.21.15.105:0/4087326250 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6568011ce0 con 0x7f656c1570e0 2024-09-21T03:21:42.971 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.966+0000 7f65747da640 1 -- 172.21.15.105:0/4087326250 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f656c0c61e0 con 0x7f656c1570e0 2024-09-21T03:21:42.971 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.967+0000 7f65747da640 1 -- 172.21.15.105:0/4087326250 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f656c15d130 con 0x7f656c1570e0 2024-09-21T03:21:42.972 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.968+0000 7f6562ffd640 1 -- 172.21.15.105:0/4087326250 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f656801c460 con 0x7f656c1570e0 2024-09-21T03:21:42.972 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.968+0000 7f6562ffd640 1 --2- 172.21.15.105:0/4087326250 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6550078bc0 0x7f655007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:42.972 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.968+0000 7f6562ffd640 1 -- 172.21.15.105:0/4087326250 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 4943+0+0 (secure 0 0 0) 0x7f656809a7e0 con 0x7f656c1570e0 2024-09-21T03:21:42.972 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.968+0000 7f6571d75640 1 --2- 172.21.15.105:0/4087326250 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6550078bc0 0x7f655007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:42.972 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.969+0000 7f6571d75640 1 --2- 172.21.15.105:0/4087326250 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6550078bc0 0x7f655007b0d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f655c034000 tx=0x7f655c004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:42.975 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:42.973+0000 7f6562ffd640 1 -- 172.21.15.105:0/4087326250 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f656c0cbe80 con 0x7f656c1570e0 2024-09-21T03:21:43.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.157+0000 7f65747da640 1 -- 172.21.15.105:0/4087326250 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f656c0ca7e0 con 0x7f656c1570e0 2024-09-21T03:21:43.163 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.161+0000 7f6562ffd640 1 -- 172.21.15.105:0/4087326250 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v42) ==== 71+0+0 (secure 0 0 0) 0x7f6568062f20 con 0x7f656c1570e0 2024-09-21T03:21:43.166 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.163+0000 7f65747da640 1 -- 172.21.15.105:0/4087326250 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6550078bc0 msgr2=0x7f655007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:43.166 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.163+0000 7f65747da640 1 --2- 172.21.15.105:0/4087326250 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6550078bc0 0x7f655007b0d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f655c034000 tx=0x7f655c004730 comp rx=0 tx=0).stop 2024-09-21T03:21:43.166 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.163+0000 7f65747da640 1 -- 172.21.15.105:0/4087326250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f656c1570e0 msgr2=0x7f656c0ca2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:43.166 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.163+0000 7f65747da640 1 --2- 172.21.15.105:0/4087326250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f656c1570e0 0x7f656c0ca2a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f656800c460 tx=0x7f656800c920 comp rx=0 tx=0).stop 2024-09-21T03:21:43.166 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.163+0000 7f65747da640 1 -- 172.21.15.105:0/4087326250 shutdown_connections 2024-09-21T03:21:43.166 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.163+0000 7f65747da640 1 --2- 172.21.15.105:0/4087326250 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6550078bc0 0x7f655007b0d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:43.166 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.163+0000 7f65747da640 1 --2- 172.21.15.105:0/4087326250 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f656c0cb530 0x7f656c0cb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:43.166 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.163+0000 7f65747da640 1 --2- 172.21.15.105:0/4087326250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f656c15d670 0x7f656c1f6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:43.166 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.163+0000 7f65747da640 1 --2- 172.21.15.105:0/4087326250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f656c1570e0 0x7f656c0ca2a0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:43.167 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.163+0000 7f65747da640 1 -- 172.21.15.105:0/4087326250 >> 172.21.15.105:0/4087326250 conn(0x7f656c06d550 msgr2=0x7f656c0b7010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:43.167 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.163+0000 7f65747da640 1 -- 172.21.15.105:0/4087326250 shutdown_connections 2024-09-21T03:21:43.167 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.163+0000 7f65747da640 1 -- 172.21.15.105:0/4087326250 wait complete. 2024-09-21T03:21:43.177 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_max_caps' 2024-09-21T03:21:43.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.286+0000 7fa470d69640 1 -- 172.21.15.105:0/391233221 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa458003c60 msgr2=0x7fa4580040b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:43.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.286+0000 7fa470d69640 1 --2- 172.21.15.105:0/391233221 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa458003c60 0x7fa4580040b0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fa45c001830 tx=0x7fa458005830 comp rx=0 tx=0).stop 2024-09-21T03:21:43.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.286+0000 7fa46ad9d640 1 -- 172.21.15.105:0/391233221 reap_dead start 2024-09-21T03:21:43.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.286+0000 7fa470d69640 1 -- 172.21.15.105:0/391233221 shutdown_connections 2024-09-21T03:21:43.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.286+0000 7fa470d69640 1 -- 172.21.15.105:0/391233221 >> 172.21.15.105:0/391233221 conn(0x7fa46c0cdcc0 msgr2=0x7fa46c0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:43.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.286+0000 7fa470d69640 1 -- 172.21.15.105:0/391233221 shutdown_connections 2024-09-21T03:21:43.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.286+0000 7fa470d69640 1 -- 172.21.15.105:0/391233221 wait complete. 2024-09-21T03:21:43.290 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.288+0000 7fa470d69640 1 Processor -- start 2024-09-21T03:21:43.290 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.288+0000 7fa470d69640 1 -- start start 2024-09-21T03:21:43.293 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.289+0000 7fa470d69640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa458003c60 0x7fa46c0b75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:43.293 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.289+0000 7fa470d69640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa46c15ea40 0x7fa46c15d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:43.293 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.289+0000 7fa470d69640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa46c06cde0 0x7fa46c06d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:43.294 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.289+0000 7fa470d69640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c0b38e0 con 0x7fa46c06cde0 2024-09-21T03:21:43.294 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.289+0000 7fa470d69640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c0b3760 con 0x7fa458003c60 2024-09-21T03:21:43.294 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.289+0000 7fa470d69640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa46c1f71e0 con 0x7fa46c15ea40 2024-09-21T03:21:43.294 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.289+0000 7fa46ad9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa46c06cde0 0x7fa46c06d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:43.294 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.289+0000 7fa46ad9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa46c06cde0 0x7fa46c06d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51670/0 (socket says 172.21.15.105:51670) 2024-09-21T03:21:43.294 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.289+0000 7fa46ad9d640 1 -- 172.21.15.105:0/443794127 learned_addr learned my addr 172.21.15.105:0/443794127 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:43.294 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.289+0000 7fa46a59c640 1 --2- 172.21.15.105:0/443794127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa458003c60 0x7fa46c0b75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:43.294 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.290+0000 7fa461d9b640 1 --2- 172.21.15.105:0/443794127 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa46c15ea40 0x7fa46c15d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:43.294 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.290+0000 7fa46ad9d640 1 -- 172.21.15.105:0/443794127 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa46c15ea40 msgr2=0x7fa46c15d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:43.294 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.290+0000 7fa46ad9d640 1 --2- 172.21.15.105:0/443794127 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa46c15ea40 0x7fa46c15d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:43.294 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.290+0000 7fa46ad9d640 1 -- 172.21.15.105:0/443794127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa458003c60 msgr2=0x7fa46c0b75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:43.294 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.290+0000 7fa46ad9d640 1 --2- 172.21.15.105:0/443794127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa458003c60 0x7fa46c0b75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:43.294 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.290+0000 7fa46ad9d640 1 -- 172.21.15.105:0/443794127 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa46c06d730 con 0x7fa46c06cde0 2024-09-21T03:21:43.295 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.290+0000 7fa46ad9d640 1 --2- 172.21.15.105:0/443794127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa46c06cde0 0x7fa46c06d1f0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fa46c0715e0 tx=0x7fa464006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:43.295 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.290+0000 7fa4637fe640 1 -- 172.21.15.105:0/443794127 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa464011900 con 0x7fa46c06cde0 2024-09-21T03:21:43.295 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.290+0000 7fa4637fe640 1 -- 172.21.15.105:0/443794127 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa464018070 con 0x7fa46c06cde0 2024-09-21T03:21:43.295 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.290+0000 7fa470d69640 1 -- 172.21.15.105:0/443794127 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa46c1f6660 con 0x7fa46c06cde0 2024-09-21T03:21:43.295 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.290+0000 7fa4637fe640 1 -- 172.21.15.105:0/443794127 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa464011d60 con 0x7fa46c06cde0 2024-09-21T03:21:43.295 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.290+0000 7fa470d69640 1 -- 172.21.15.105:0/443794127 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa46c1f6c20 con 0x7fa46c06cde0 2024-09-21T03:21:43.296 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.291+0000 7fa470d69640 1 -- 172.21.15.105:0/443794127 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa46c0b7bf0 con 0x7fa46c06cde0 2024-09-21T03:21:43.296 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.292+0000 7fa4637fe640 1 -- 172.21.15.105:0/443794127 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa46401d460 con 0x7fa46c06cde0 2024-09-21T03:21:43.296 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.292+0000 7fa4637fe640 1 --2- 172.21.15.105:0/443794127 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa44c078b90 0x7fa44c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:43.296 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.292+0000 7fa4637fe640 1 -- 172.21.15.105:0/443794127 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 4943+0+0 (secure 0 0 0) 0x7fa46409b2c0 con 0x7fa46c06cde0 2024-09-21T03:21:43.296 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.292+0000 7fa46a59c640 1 --2- 172.21.15.105:0/443794127 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa44c078b90 0x7fa44c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:43.296 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.293+0000 7fa46a59c640 1 --2- 172.21.15.105:0/443794127 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa44c078b90 0x7fa44c07b0a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa45c032000 tx=0x7fa45c001360 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:43.299 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.297+0000 7fa4637fe640 1 -- 172.21.15.105:0/443794127 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa46c06d730 con 0x7fa46c06cde0 2024-09-21T03:21:43.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.544+0000 7fa470d69640 1 -- 172.21.15.105:0/443794127 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_max_caps"]} v 0) -- 0x7fa46c06fec0 con 0x7fa46c06cde0 2024-09-21T03:21:43.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.834+0000 7fa4637fe640 1 -- 172.21.15.105:0/443794127 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_max_caps"]}]=0 v183) ==== 148+0+0 (secure 0 0 0) 0x7fa464063a90 con 0x7fa46c06cde0 2024-09-21T03:21:43.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.836+0000 7fa470d69640 1 -- 172.21.15.105:0/443794127 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa44c078b90 msgr2=0x7fa44c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:43.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.836+0000 7fa470d69640 1 --2- 172.21.15.105:0/443794127 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa44c078b90 0x7fa44c07b0a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa45c032000 tx=0x7fa45c001360 comp rx=0 tx=0).stop 2024-09-21T03:21:43.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.836+0000 7fa470d69640 1 -- 172.21.15.105:0/443794127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa46c06cde0 msgr2=0x7fa46c06d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:43.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.836+0000 7fa470d69640 1 --2- 172.21.15.105:0/443794127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa46c06cde0 0x7fa46c06d1f0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fa46c0715e0 tx=0x7fa464006430 comp rx=0 tx=0).stop 2024-09-21T03:21:43.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.836+0000 7fa470d69640 1 -- 172.21.15.105:0/443794127 shutdown_connections 2024-09-21T03:21:43.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.836+0000 7fa470d69640 1 --2- 172.21.15.105:0/443794127 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa44c078b90 0x7fa44c07b0a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:43.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.836+0000 7fa470d69640 1 --2- 172.21.15.105:0/443794127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa46c06cde0 0x7fa46c06d1f0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:43.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.836+0000 7fa470d69640 1 --2- 172.21.15.105:0/443794127 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa46c15ea40 0x7fa46c15d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:43.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.836+0000 7fa470d69640 1 --2- 172.21.15.105:0/443794127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa458003c60 0x7fa46c0b75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:43.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.836+0000 7fa470d69640 1 -- 172.21.15.105:0/443794127 >> 172.21.15.105:0/443794127 conn(0x7fa46c0cdcc0 msgr2=0x7fa46c0aef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:43.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.836+0000 7fa470d69640 1 -- 172.21.15.105:0/443794127 shutdown_connections 2024-09-21T03:21:43.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.836+0000 7fa470d69640 1 -- 172.21.15.105:0/443794127 wait complete. 2024-09-21T03:21:43.850 INFO:tasks.cephfs_test_runner:That the MDS will not let a client sit above mds_max_caps_per_client caps. ... ok 2024-09-21T03:21:43.851 INFO:tasks.cephfs_test_runner:Starting test: test_client_min_caps_working_set (tasks.cephfs.test_client_limits.TestClientLimits) When a client has inodes pinned in its cache (open files), that the MDS 2024-09-21T03:21:43.851 INFO:tasks.cephfs_test_runner:test_client_min_caps_working_set (tasks.cephfs.test_client_limits.TestClientLimits) 2024-09-21T03:21:43.851 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:21:43.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.961+0000 7fdd7a519640 1 -- 172.21.15.105:0/3224721628 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd5c003a50 msgr2=0x7fdd5c003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:43.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.961+0000 7fdd7a519640 1 --2- 172.21.15.105:0/3224721628 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd5c003a50 0x7fdd5c003ec0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fdd64009b20 tx=0x7fdd5c005830 comp rx=0 tx=0).stop 2024-09-21T03:21:43.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.962+0000 7fdd7a519640 1 -- 172.21.15.105:0/3224721628 shutdown_connections 2024-09-21T03:21:43.965 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.962+0000 7fdd7a519640 1 --2- 172.21.15.105:0/3224721628 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd5c003a50 0x7fdd5c003ec0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:43.965 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.962+0000 7fdd7a519640 1 -- 172.21.15.105:0/3224721628 >> 172.21.15.105:0/3224721628 conn(0x7fdd740b1cb0 msgr2=0x7fdd740b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:43.965 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.962+0000 7fdd7a519640 1 -- 172.21.15.105:0/3224721628 shutdown_connections 2024-09-21T03:21:43.965 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.962+0000 7fdd7a519640 1 -- 172.21.15.105:0/3224721628 wait complete. 2024-09-21T03:21:43.966 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.963+0000 7fdd7a519640 1 Processor -- start 2024-09-21T03:21:43.966 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.964+0000 7fdd7a519640 1 -- start start 2024-09-21T03:21:43.969 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.965+0000 7fdd7a519640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdd5c003a50 0x7fdd7414ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:43.969 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.965+0000 7fdd7a519640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd7414b1c0 0x7fdd7415dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:43.969 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.965+0000 7fdd7a519640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd7415e420 0x7fdd7415e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:43.969 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.965+0000 7fdd7a519640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdd740cc830 con 0x7fdd7415e420 2024-09-21T03:21:43.969 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.965+0000 7fdd7a519640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdd740cbd70 con 0x7fdd7414b1c0 2024-09-21T03:21:43.969 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.965+0000 7fdd7a519640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdd740cc9b0 con 0x7fdd5c003a50 2024-09-21T03:21:43.969 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.965+0000 7fdd78ab6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd7415e420 0x7fdd7415e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:43.969 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.965+0000 7fdd78ab6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd7415e420 0x7fdd7415e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51682/0 (socket says 172.21.15.105:51682) 2024-09-21T03:21:43.969 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.965+0000 7fdd78ab6640 1 -- 172.21.15.105:0/912669442 learned_addr learned my addr 172.21.15.105:0/912669442 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:43.969 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.965+0000 7fdd73fff640 1 --2- 172.21.15.105:0/912669442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdd5c003a50 0x7fdd7414ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:43.969 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.965+0000 7fdd737fe640 1 --2- 172.21.15.105:0/912669442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd7414b1c0 0x7fdd7415dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:43.970 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.965+0000 7fdd78ab6640 1 -- 172.21.15.105:0/912669442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdd5c003a50 msgr2=0x7fdd7414ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:43.970 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.965+0000 7fdd78ab6640 1 --2- 172.21.15.105:0/912669442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdd5c003a50 0x7fdd7414ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:43.970 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.965+0000 7fdd78ab6640 1 -- 172.21.15.105:0/912669442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd7414b1c0 msgr2=0x7fdd7415dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:43.970 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.965+0000 7fdd78ab6640 1 --2- 172.21.15.105:0/912669442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd7414b1c0 0x7fdd7415dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:43.970 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.965+0000 7fdd78ab6640 1 -- 172.21.15.105:0/912669442 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd740c7740 con 0x7fdd7415e420 2024-09-21T03:21:43.970 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.965+0000 7fdd78ab6640 1 --2- 172.21.15.105:0/912669442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd7415e420 0x7fdd7415e830 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fdd740cc780 tx=0x7fdd6c0019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:43.970 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.965+0000 7fdd70ff9640 1 -- 172.21.15.105:0/912669442 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd6c011870 con 0x7fdd7415e420 2024-09-21T03:21:43.970 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.966+0000 7fdd70ff9640 1 -- 172.21.15.105:0/912669442 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd6c017070 con 0x7fdd7415e420 2024-09-21T03:21:43.970 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.966+0000 7fdd7a519640 1 -- 172.21.15.105:0/912669442 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd740c9b80 con 0x7fdd7415e420 2024-09-21T03:21:43.970 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.966+0000 7fdd70ff9640 1 -- 172.21.15.105:0/912669442 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd6c011cf0 con 0x7fdd7415e420 2024-09-21T03:21:43.970 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.966+0000 7fdd7a519640 1 -- 172.21.15.105:0/912669442 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd740c71d0 con 0x7fdd7415e420 2024-09-21T03:21:43.970 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.966+0000 7fdd7a519640 1 -- 172.21.15.105:0/912669442 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd740ca0a0 con 0x7fdd7415e420 2024-09-21T03:21:43.971 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.967+0000 7fdd70ff9640 1 -- 172.21.15.105:0/912669442 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdd6c01c460 con 0x7fdd7415e420 2024-09-21T03:21:43.971 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.968+0000 7fdd70ff9640 1 --2- 172.21.15.105:0/912669442 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdd60078b90 0x7fdd6007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:43.971 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.968+0000 7fdd70ff9640 1 -- 172.21.15.105:0/912669442 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 4943+0+0 (secure 0 0 0) 0x7fdd6c09afa0 con 0x7fdd7415e420 2024-09-21T03:21:43.971 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.968+0000 7fdd73fff640 1 --2- 172.21.15.105:0/912669442 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdd60078b90 0x7fdd6007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:43.971 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.968+0000 7fdd73fff640 1 --2- 172.21.15.105:0/912669442 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdd60078b90 0x7fdd6007b0a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fdd64035000 tx=0x7fdd6402d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:43.975 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:43.972+0000 7fdd70ff9640 1 -- 172.21.15.105:0/912669442 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fdd740ca0a0 con 0x7fdd7415e420 2024-09-21T03:21:44.151 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.149+0000 7fdd7a519640 1 -- 172.21.15.105:0/912669442 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdd740ccf10 con 0x7fdd7415e420 2024-09-21T03:21:44.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.149+0000 7fdd70ff9640 1 -- 172.21.15.105:0/912669442 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+13107 (secure 0 0 0) 0x7fdd6c063120 con 0x7fdd7415e420 2024-09-21T03:21:44.152 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:44.152 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":72,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:21:42.825247+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.105:6835/1561028223":"2024-09-22T03:21:39.817067+0000","172.21.15.105:6834/1561028223":"2024-09-22T03:21:39.817067+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:21:44.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.152+0000 7fdd7a519640 1 -- 172.21.15.105:0/912669442 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdd60078b90 msgr2=0x7fdd6007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:44.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.152+0000 7fdd7a519640 1 --2- 172.21.15.105:0/912669442 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdd60078b90 0x7fdd6007b0a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fdd64035000 tx=0x7fdd6402d040 comp rx=0 tx=0).stop 2024-09-21T03:21:44.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.152+0000 7fdd7a519640 1 -- 172.21.15.105:0/912669442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd7415e420 msgr2=0x7fdd7415e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:44.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.152+0000 7fdd7a519640 1 --2- 172.21.15.105:0/912669442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd7415e420 0x7fdd7415e830 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fdd740cc780 tx=0x7fdd6c0019b0 comp rx=0 tx=0).stop 2024-09-21T03:21:44.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.152+0000 7fdd7a519640 1 -- 172.21.15.105:0/912669442 shutdown_connections 2024-09-21T03:21:44.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.152+0000 7fdd7a519640 1 --2- 172.21.15.105:0/912669442 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdd60078b90 0x7fdd6007b0a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:44.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.152+0000 7fdd7a519640 1 --2- 172.21.15.105:0/912669442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd7415e420 0x7fdd7415e830 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:44.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.152+0000 7fdd7a519640 1 --2- 172.21.15.105:0/912669442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd7414b1c0 0x7fdd7415dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:44.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.152+0000 7fdd7a519640 1 --2- 172.21.15.105:0/912669442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdd5c003a50 0x7fdd7414ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:44.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.152+0000 7fdd7a519640 1 -- 172.21.15.105:0/912669442 >> 172.21.15.105:0/912669442 conn(0x7fdd740b1cb0 msgr2=0x7fdd7406f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:44.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.152+0000 7fdd7a519640 1 -- 172.21.15.105:0/912669442 shutdown_connections 2024-09-21T03:21:44.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.152+0000 7fdd7a519640 1 -- 172.21.15.105:0/912669442 wait complete. 2024-09-21T03:21:44.165 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T03:18:19.296947+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T03:21:44.166 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T03:21:44.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.278+0000 7fe560e84640 1 -- 172.21.15.105:0/2394945420 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe544003a50 msgr2=0x7fe544003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:44.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.278+0000 7fe560e84640 1 --2- 172.21.15.105:0/2394945420 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe544003a50 0x7fe544003ec0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fe54c006fc0 tx=0x7fe544005830 comp rx=0 tx=0).stop 2024-09-21T03:21:44.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.278+0000 7fe560e84640 1 -- 172.21.15.105:0/2394945420 shutdown_connections 2024-09-21T03:21:44.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.278+0000 7fe560e84640 1 --2- 172.21.15.105:0/2394945420 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe544003a50 0x7fe544003ec0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:44.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.278+0000 7fe560e84640 1 -- 172.21.15.105:0/2394945420 >> 172.21.15.105:0/2394945420 conn(0x7fe55c06d550 msgr2=0x7fe55c071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:44.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.278+0000 7fe560e84640 1 -- 172.21.15.105:0/2394945420 shutdown_connections 2024-09-21T03:21:44.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.278+0000 7fe560e84640 1 -- 172.21.15.105:0/2394945420 wait complete. 2024-09-21T03:21:44.283 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.280+0000 7fe560e84640 1 Processor -- start 2024-09-21T03:21:44.283 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.280+0000 7fe560e84640 1 -- start start 2024-09-21T03:21:44.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.281+0000 7fe560e84640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe544003a50 0x7fe55c14a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:44.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.281+0000 7fe560e84640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe55c0b3c30 0x7fe55c0b7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:44.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.281+0000 7fe560e84640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe55c1f4030 0x7fe55c1f4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:44.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.281+0000 7fe560e84640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe55c15da70 con 0x7fe55c0b3c30 2024-09-21T03:21:44.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.281+0000 7fe560e84640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe55c15d8f0 con 0x7fe544003a50 2024-09-21T03:21:44.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.281+0000 7fe560e84640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe55c15dbf0 con 0x7fe55c1f4030 2024-09-21T03:21:44.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.282+0000 7fe559d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe55c0b3c30 0x7fe55c0b7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:44.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.282+0000 7fe559d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe55c0b3c30 0x7fe55c0b7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51704/0 (socket says 172.21.15.105:51704) 2024-09-21T03:21:44.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.282+0000 7fe559d9b640 1 -- 172.21.15.105:0/349107734 learned_addr learned my addr 172.21.15.105:0/349107734 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:44.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.282+0000 7fe55ad9d640 1 --2- 172.21.15.105:0/349107734 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe55c1f4030 0x7fe55c1f4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:44.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.282+0000 7fe55a59c640 1 --2- 172.21.15.105:0/349107734 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe544003a50 0x7fe55c14a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:44.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.282+0000 7fe559d9b640 1 -- 172.21.15.105:0/349107734 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe55c1f4030 msgr2=0x7fe55c1f4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:44.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.282+0000 7fe559d9b640 1 --2- 172.21.15.105:0/349107734 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe55c1f4030 0x7fe55c1f4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:44.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.282+0000 7fe559d9b640 1 -- 172.21.15.105:0/349107734 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe544003a50 msgr2=0x7fe55c14a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:44.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.282+0000 7fe559d9b640 1 --2- 172.21.15.105:0/349107734 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe544003a50 0x7fe55c14a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:44.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.282+0000 7fe559d9b640 1 -- 172.21.15.105:0/349107734 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe55c1f38a0 con 0x7fe55c0b3c30 2024-09-21T03:21:44.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.282+0000 7fe559d9b640 1 --2- 172.21.15.105:0/349107734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe55c0b3c30 0x7fe55c0b7bd0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fe550004ca0 tx=0x7fe550001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:44.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.282+0000 7fe54affd640 1 -- 172.21.15.105:0/349107734 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe550015020 con 0x7fe55c0b3c30 2024-09-21T03:21:44.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.282+0000 7fe54affd640 1 -- 172.21.15.105:0/349107734 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe550011750 con 0x7fe55c0b3c30 2024-09-21T03:21:44.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.282+0000 7fe560e84640 1 -- 172.21.15.105:0/349107734 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe55c14abb0 con 0x7fe55c0b3c30 2024-09-21T03:21:44.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.282+0000 7fe54affd640 1 -- 172.21.15.105:0/349107734 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe550011b80 con 0x7fe55c0b3c30 2024-09-21T03:21:44.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.282+0000 7fe560e84640 1 -- 172.21.15.105:0/349107734 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe55c159e30 con 0x7fe55c0b3c30 2024-09-21T03:21:44.288 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.283+0000 7fe560e84640 1 -- 172.21.15.105:0/349107734 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe55c159ba0 con 0x7fe55c0b3c30 2024-09-21T03:21:44.288 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.284+0000 7fe54affd640 1 -- 172.21.15.105:0/349107734 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe550018020 con 0x7fe55c0b3c30 2024-09-21T03:21:44.288 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.284+0000 7fe54affd640 1 --2- 172.21.15.105:0/349107734 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe53c078b90 0x7fe53c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:44.288 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.285+0000 7fe54affd640 1 -- 172.21.15.105:0/349107734 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 4943+0+0 (secure 0 0 0) 0x7fe55009b2f0 con 0x7fe55c0b3c30 2024-09-21T03:21:44.288 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.285+0000 7fe55a59c640 1 --2- 172.21.15.105:0/349107734 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe53c078b90 0x7fe53c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:44.288 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.285+0000 7fe55a59c640 1 --2- 172.21.15.105:0/349107734 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe53c078b90 0x7fe53c07b0a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe54c033000 tx=0x7fe54c000fe0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:44.291 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.289+0000 7fe54affd640 1 -- 172.21.15.105:0/349107734 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe55001f020 con 0x7fe55c0b3c30 2024-09-21T03:21:44.466 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.463+0000 7fe560e84640 1 -- 172.21.15.105:0/349107734 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe55c0ced40 con 0x7fe55c0b3c30 2024-09-21T03:21:44.466 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.464+0000 7fe54affd640 1 -- 172.21.15.105:0/349107734 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) ==== 93+0+10 (secure 0 0 0) 0x7fe550063ac0 con 0x7fe55c0b3c30 2024-09-21T03:21:44.467 INFO:teuthology.orchestra.run.smithi105.stdout:pg_num: 1 2024-09-21T03:21:44.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.466+0000 7fe560e84640 1 -- 172.21.15.105:0/349107734 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe53c078b90 msgr2=0x7fe53c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:44.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.466+0000 7fe560e84640 1 --2- 172.21.15.105:0/349107734 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe53c078b90 0x7fe53c07b0a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe54c033000 tx=0x7fe54c000fe0 comp rx=0 tx=0).stop 2024-09-21T03:21:44.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.466+0000 7fe560e84640 1 -- 172.21.15.105:0/349107734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe55c0b3c30 msgr2=0x7fe55c0b7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:44.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.466+0000 7fe560e84640 1 --2- 172.21.15.105:0/349107734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe55c0b3c30 0x7fe55c0b7bd0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fe550004ca0 tx=0x7fe550001670 comp rx=0 tx=0).stop 2024-09-21T03:21:44.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.466+0000 7fe560e84640 1 -- 172.21.15.105:0/349107734 shutdown_connections 2024-09-21T03:21:44.470 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.466+0000 7fe560e84640 1 --2- 172.21.15.105:0/349107734 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe53c078b90 0x7fe53c07b0a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:44.470 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.466+0000 7fe560e84640 1 --2- 172.21.15.105:0/349107734 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe55c1f4030 0x7fe55c1f4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:44.470 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.466+0000 7fe560e84640 1 --2- 172.21.15.105:0/349107734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe55c0b3c30 0x7fe55c0b7bd0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:44.470 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.466+0000 7fe560e84640 1 --2- 172.21.15.105:0/349107734 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe544003a50 0x7fe55c14a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:44.470 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.466+0000 7fe560e84640 1 -- 172.21.15.105:0/349107734 >> 172.21.15.105:0/349107734 conn(0x7fe55c06d550 msgr2=0x7fe55c160120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:44.470 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.466+0000 7fe560e84640 1 -- 172.21.15.105:0/349107734 shutdown_connections 2024-09-21T03:21:44.470 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.466+0000 7fe560e84640 1 -- 172.21.15.105:0/349107734 wait complete. 2024-09-21T03:21:44.480 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_min_caps_working_set' 2024-09-21T03:21:44.594 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.591+0000 7f74c6120640 1 -- 172.21.15.105:0/10100881 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74ac003a50 msgr2=0x7f74ac003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:44.594 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.591+0000 7f74c6120640 1 --2- 172.21.15.105:0/10100881 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74ac003a50 0x7f74ac003ec0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f74b0009d00 tx=0x7f74ac005830 comp rx=0 tx=0).stop 2024-09-21T03:21:44.594 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.591+0000 7f74c6120640 1 -- 172.21.15.105:0/10100881 shutdown_connections 2024-09-21T03:21:44.594 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.591+0000 7f74c6120640 1 --2- 172.21.15.105:0/10100881 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74ac003a50 0x7f74ac003ec0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:44.594 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.591+0000 7f74c6120640 1 -- 172.21.15.105:0/10100881 >> 172.21.15.105:0/10100881 conn(0x7f74c006def0 msgr2=0x7f74c006e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:44.594 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.591+0000 7f74c6120640 1 -- 172.21.15.105:0/10100881 shutdown_connections 2024-09-21T03:21:44.594 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.591+0000 7f74c6120640 1 -- 172.21.15.105:0/10100881 wait complete. 2024-09-21T03:21:44.595 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.593+0000 7f74c6120640 1 Processor -- start 2024-09-21T03:21:44.595 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.593+0000 7f74c6120640 1 -- start start 2024-09-21T03:21:44.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.594+0000 7f74c6120640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74ac003a50 0x7f74c01f5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:44.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.594+0000 7f74c6120640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f74c015a2e0 0x7f74c015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:44.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.594+0000 7f74c6120640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74c00cf590 0x7f74c00cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:44.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.594+0000 7f74c6120640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f74c00702d0 con 0x7f74c00cf590 2024-09-21T03:21:44.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.594+0000 7f74c6120640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f74c0070150 con 0x7f74ac003a50 2024-09-21T03:21:44.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.594+0000 7f74c6120640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f74c0070450 con 0x7f74c015a2e0 2024-09-21T03:21:44.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.594+0000 7f74bffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74c00cf590 0x7f74c00cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:44.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.594+0000 7f74bffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74c00cf590 0x7f74c00cf9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51732/0 (socket says 172.21.15.105:51732) 2024-09-21T03:21:44.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.594+0000 7f74bffff640 1 -- 172.21.15.105:0/4051024896 learned_addr learned my addr 172.21.15.105:0/4051024896 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:44.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.594+0000 7f74beffd640 1 --2- 172.21.15.105:0/4051024896 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f74c015a2e0 0x7f74c015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:44.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.594+0000 7f74bf7fe640 1 --2- 172.21.15.105:0/4051024896 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74ac003a50 0x7f74c01f5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:44.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.595+0000 7f74bffff640 1 -- 172.21.15.105:0/4051024896 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f74c015a2e0 msgr2=0x7f74c015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:44.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.595+0000 7f74bffff640 1 --2- 172.21.15.105:0/4051024896 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f74c015a2e0 0x7f74c015a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:44.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.595+0000 7f74bffff640 1 -- 172.21.15.105:0/4051024896 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74ac003a50 msgr2=0x7f74c01f5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:44.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.595+0000 7f74bffff640 1 --2- 172.21.15.105:0/4051024896 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74ac003a50 0x7f74c01f5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:44.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.595+0000 7f74bffff640 1 -- 172.21.15.105:0/4051024896 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74c00cfee0 con 0x7f74c00cf590 2024-09-21T03:21:44.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.595+0000 7f74bffff640 1 --2- 172.21.15.105:0/4051024896 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74c00cf590 0x7f74c00cf9a0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f74c0074340 tx=0x7f74b8006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:44.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.595+0000 7f74b7fff640 1 -- 172.21.15.105:0/4051024896 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b8011900 con 0x7f74c00cf590 2024-09-21T03:21:44.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.595+0000 7f74b7fff640 1 -- 172.21.15.105:0/4051024896 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74b8018070 con 0x7f74c00cf590 2024-09-21T03:21:44.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.595+0000 7f74b7fff640 1 -- 172.21.15.105:0/4051024896 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b8011d40 con 0x7f74c00cf590 2024-09-21T03:21:44.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.595+0000 7f74c6120640 1 -- 172.21.15.105:0/4051024896 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74c01f2d80 con 0x7f74c00cf590 2024-09-21T03:21:44.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.595+0000 7f74c6120640 1 -- 172.21.15.105:0/4051024896 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74c01f69d0 con 0x7f74c00cf590 2024-09-21T03:21:44.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.596+0000 7f74c6120640 1 -- 172.21.15.105:0/4051024896 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74c00709b0 con 0x7f74c00cf590 2024-09-21T03:21:44.601 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.597+0000 7f74b7fff640 1 -- 172.21.15.105:0/4051024896 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f74b801d460 con 0x7f74c00cf590 2024-09-21T03:21:44.601 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.597+0000 7f74b7fff640 1 --2- 172.21.15.105:0/4051024896 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f74a0078bc0 0x7f74a007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:44.601 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.597+0000 7f74b7fff640 1 -- 172.21.15.105:0/4051024896 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 4943+0+0 (secure 0 0 0) 0x7f74b809b430 con 0x7f74c00cf590 2024-09-21T03:21:44.601 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.597+0000 7f74bf7fe640 1 --2- 172.21.15.105:0/4051024896 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f74a0078bc0 0x7f74a007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:44.601 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.598+0000 7f74bf7fe640 1 --2- 172.21.15.105:0/4051024896 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f74a0078bc0 0x7f74a007b0d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f74b0035000 tx=0x7f74b00046c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:44.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.602+0000 7f74b7fff640 1 -- 172.21.15.105:0/4051024896 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f74c00cfee0 con 0x7f74c00cf590 2024-09-21T03:21:44.850 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:44.847+0000 7f74c6120640 1 -- 172.21.15.105:0/4051024896 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_min_caps_working_set"]} v 0) -- 0x7f74c006e3a0 con 0x7f74c00cf590 2024-09-21T03:21:45.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.842+0000 7f74b7fff640 1 -- 172.21.15.105:0/4051024896 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_min_caps_working_set"]}]=0 v185) ==== 163+0+0 (secure 0 0 0) 0x7f74b8063b70 con 0x7f74c00cf590 2024-09-21T03:21:45.848 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.846+0000 7f74c6120640 1 -- 172.21.15.105:0/4051024896 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f74a0078bc0 msgr2=0x7f74a007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:45.848 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.846+0000 7f74c6120640 1 --2- 172.21.15.105:0/4051024896 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f74a0078bc0 0x7f74a007b0d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f74b0035000 tx=0x7f74b00046c0 comp rx=0 tx=0).stop 2024-09-21T03:21:45.848 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.846+0000 7f74c6120640 1 -- 172.21.15.105:0/4051024896 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74c00cf590 msgr2=0x7f74c00cf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:45.848 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.846+0000 7f74c6120640 1 --2- 172.21.15.105:0/4051024896 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74c00cf590 0x7f74c00cf9a0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f74c0074340 tx=0x7f74b8006430 comp rx=0 tx=0).stop 2024-09-21T03:21:45.848 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.846+0000 7f74c6120640 1 -- 172.21.15.105:0/4051024896 shutdown_connections 2024-09-21T03:21:45.848 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.846+0000 7f74c6120640 1 --2- 172.21.15.105:0/4051024896 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f74a0078bc0 0x7f74a007b0d0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:45.848 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.846+0000 7f74c6120640 1 --2- 172.21.15.105:0/4051024896 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74c00cf590 0x7f74c00cf9a0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:45.848 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.846+0000 7f74c6120640 1 --2- 172.21.15.105:0/4051024896 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f74c015a2e0 0x7f74c015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:45.848 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.846+0000 7f74c6120640 1 --2- 172.21.15.105:0/4051024896 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74ac003a50 0x7f74c01f5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:45.848 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.846+0000 7f74c6120640 1 -- 172.21.15.105:0/4051024896 >> 172.21.15.105:0/4051024896 conn(0x7f74c006def0 msgr2=0x7f74c0153f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:45.849 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.846+0000 7f74c6120640 1 -- 172.21.15.105:0/4051024896 shutdown_connections 2024-09-21T03:21:45.849 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.846+0000 7f74c6120640 1 -- 172.21.15.105:0/4051024896 wait complete. 2024-09-21T03:21:45.862 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T03:21:45.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.978+0000 7fb1d7b8b640 1 -- 172.21.15.105:0/1588539254 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1d00cf540 msgr2=0x7fb1d00b5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:45.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.978+0000 7fb1d7b8b640 1 --2- 172.21.15.105:0/1588539254 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1d00cf540 0x7fb1d00b5fa0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fb1d00b6e20 tx=0x7fb1c002a440 comp rx=0 tx=0).stop 2024-09-21T03:21:45.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.978+0000 7fb1d7b8b640 1 -- 172.21.15.105:0/1588539254 shutdown_connections 2024-09-21T03:21:45.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.978+0000 7fb1d7b8b640 1 --2- 172.21.15.105:0/1588539254 >> v2:172.21.15.162:3300/0 conn(0x7fb1d00b64e0 0x7fb1d00d25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:45.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.978+0000 7fb1d7b8b640 1 --2- 172.21.15.105:0/1588539254 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1d00cf540 0x7fb1d00b5fa0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:45.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.978+0000 7fb1d7b8b640 1 --2- 172.21.15.105:0/1588539254 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1d00b9b60 0x7fb1d00d4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:45.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.978+0000 7fb1d7b8b640 1 -- 172.21.15.105:0/1588539254 >> 172.21.15.105:0/1588539254 conn(0x7fb1d009d7f0 msgr2=0x7fb1d00d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:45.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.978+0000 7fb1d7b8b640 1 -- 172.21.15.105:0/1588539254 shutdown_connections 2024-09-21T03:21:45.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.978+0000 7fb1d7b8b640 1 -- 172.21.15.105:0/1588539254 wait complete. 2024-09-21T03:21:45.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.980+0000 7fb1d7b8b640 1 Processor -- start 2024-09-21T03:21:45.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.980+0000 7fb1d7b8b640 1 -- start start 2024-09-21T03:21:45.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.982+0000 7fb1d7b8b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1d00b64e0 0x7fb1d00a00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:45.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.982+0000 7fb1d7b8b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1d00b9b60 0x7fb1d01578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:45.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.982+0000 7fb1d7b8b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1d00cf540 0x7fb1d0160a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:45.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.982+0000 7fb1d7b8b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d00d2f30 con 0x7fb1d00cf540 2024-09-21T03:21:45.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.982+0000 7fb1d7b8b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d00d2db0 con 0x7fb1d00b9b60 2024-09-21T03:21:45.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.982+0000 7fb1d7b8b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb1d00d30b0 con 0x7fb1d00b64e0 2024-09-21T03:21:45.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.982+0000 7fb1d6128640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1d00cf540 0x7fb1d0160a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:45.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.982+0000 7fb1d6128640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1d00cf540 0x7fb1d0160a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51750/0 (socket says 172.21.15.105:51750) 2024-09-21T03:21:45.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.982+0000 7fb1d6128640 1 -- 172.21.15.105:0/557601038 learned_addr learned my addr 172.21.15.105:0/557601038 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:45.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.982+0000 7fb1d5927640 1 --2- 172.21.15.105:0/557601038 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1d00b64e0 0x7fb1d00a00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:45.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.982+0000 7fb1d5126640 1 --2- 172.21.15.105:0/557601038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1d00b9b60 0x7fb1d01578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:45.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.982+0000 7fb1d6128640 1 -- 172.21.15.105:0/557601038 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1d00b64e0 msgr2=0x7fb1d00a00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:45.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.982+0000 7fb1d6128640 1 --2- 172.21.15.105:0/557601038 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1d00b64e0 0x7fb1d00a00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:45.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.982+0000 7fb1d6128640 1 -- 172.21.15.105:0/557601038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1d00b9b60 msgr2=0x7fb1d01578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:45.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.982+0000 7fb1d6128640 1 --2- 172.21.15.105:0/557601038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1d00b9b60 0x7fb1d01578f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:45.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.982+0000 7fb1d6128640 1 -- 172.21.15.105:0/557601038 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1d00a09d0 con 0x7fb1d00cf540 2024-09-21T03:21:45.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.982+0000 7fb1d5927640 1 --2- 172.21.15.105:0/557601038 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1d00b64e0 0x7fb1d00a00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:21:45.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.982+0000 7fb1d6128640 1 --2- 172.21.15.105:0/557601038 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1d00cf540 0x7fb1d0160a70 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fb1c800e990 tx=0x7fb1c800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:45.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.982+0000 7fb1c67fc640 1 -- 172.21.15.105:0/557601038 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c8004d20 con 0x7fb1d00cf540 2024-09-21T03:21:45.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.982+0000 7fb1c67fc640 1 -- 172.21.15.105:0/557601038 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1c800caa0 con 0x7fb1d00cf540 2024-09-21T03:21:45.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.982+0000 7fb1d7b8b640 1 -- 172.21.15.105:0/557601038 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1d00a0cb0 con 0x7fb1d00cf540 2024-09-21T03:21:45.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.982+0000 7fb1c67fc640 1 -- 172.21.15.105:0/557601038 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c8005020 con 0x7fb1d00cf540 2024-09-21T03:21:45.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.982+0000 7fb1d7b8b640 1 -- 172.21.15.105:0/557601038 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1d00a1270 con 0x7fb1d00cf540 2024-09-21T03:21:45.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.983+0000 7fb1d7b8b640 1 -- 172.21.15.105:0/557601038 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1d00a0740 con 0x7fb1d00cf540 2024-09-21T03:21:45.988 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.984+0000 7fb1c67fc640 1 -- 172.21.15.105:0/557601038 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb1c80051c0 con 0x7fb1d00cf540 2024-09-21T03:21:45.988 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.984+0000 7fb1c67fc640 1 --2- 172.21.15.105:0/557601038 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb1b4078b90 0x7fb1b407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:45.988 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.984+0000 7fb1c67fc640 1 -- 172.21.15.105:0/557601038 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 4943+0+0 (secure 0 0 0) 0x7fb1c809b310 con 0x7fb1d00cf540 2024-09-21T03:21:45.988 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.984+0000 7fb1d5927640 1 --2- 172.21.15.105:0/557601038 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb1b4078b90 0x7fb1b407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:45.988 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.985+0000 7fb1d5927640 1 --2- 172.21.15.105:0/557601038 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb1b4078b90 0x7fb1b407b0a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc00bbb0 tx=0x7fb1cc005ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:45.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:45.989+0000 7fb1c67fc640 1 -- 172.21.15.105:0/557601038 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb1c8016030 con 0x7fb1d00cf540 2024-09-21T03:21:46.169 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.166+0000 7fb1d7b8b640 1 -- 172.21.15.105:0/557601038 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fb1d00d4d80 con 0x7fb1d00cf540 2024-09-21T03:21:46.169 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.167+0000 7fb1c67fc640 1 -- 172.21.15.105:0/557601038 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v42) ==== 59+0+2294 (secure 0 0 0) 0x7fb1c806c020 con 0x7fb1d00cf540 2024-09-21T03:21:46.170 INFO:teuthology.orchestra.run.smithi105.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T03:21:46.170 INFO:teuthology.orchestra.run.smithi105.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T03:21:46.170 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced client_mount_timeout 30 2024-09-21T03:21:46.170 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced debug_client 20/20 2024-09-21T03:21:46.170 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced debug_mgr 20/20 2024-09-21T03:21:46.170 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced debug_ms 1/1 2024-09-21T03:21:46.170 INFO:teuthology.orchestra.run.smithi105.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T03:21:46.170 INFO:teuthology.orchestra.run.smithi105.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T03:21:46.170 INFO:teuthology.orchestra.run.smithi105.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 7291.545169 2024-09-21T03:21:46.170 INFO:teuthology.orchestra.run.smithi105.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5080.142035 2024-09-21T03:21:46.170 INFO:teuthology.orchestra.run.smithi105.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5120.988640 2024-09-21T03:21:46.170 INFO:teuthology.orchestra.run.smithi105.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4938.196268 2024-09-21T03:21:46.171 INFO:teuthology.orchestra.run.smithi105.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4906.316728 2024-09-21T03:21:46.171 INFO:teuthology.orchestra.run.smithi105.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4701.273858 2024-09-21T03:21:46.171 INFO:teuthology.orchestra.run.smithi105.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4947.710044 2024-09-21T03:21:46.171 INFO:teuthology.orchestra.run.smithi105.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5174.949063 2024-09-21T03:21:46.171 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced debug_mds 20/20 2024-09-21T03:21:46.171 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T03:21:46.171 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced debug_ms 2/2 2024-09-21T03:21:46.171 INFO:teuthology.orchestra.run.smithi105.stdout:mds dev mds_debug_frag true 2024-09-21T03:21:46.171 INFO:teuthology.orchestra.run.smithi105.stdout:mds dev mds_debug_scatterstat true 2024-09-21T03:21:46.171 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T03:21:46.171 INFO:teuthology.orchestra.run.smithi105.stdout:mds dev mds_verify_scatter true 2024-09-21T03:21:46.171 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T03:21:46.171 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T03:21:46.171 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T03:21:46.172 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced client_mount_timeout 600 2024-09-21T03:21:46.172 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced debug_client 20/20 2024-09-21T03:21:46.172 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced debug_ms 1/1 2024-09-21T03:21:46.172 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T03:21:46.172 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T03:21:46.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.170+0000 7fb1d7b8b640 1 -- 172.21.15.105:0/557601038 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb1b4078b90 msgr2=0x7fb1b407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:46.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.170+0000 7fb1d7b8b640 1 --2- 172.21.15.105:0/557601038 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb1b4078b90 0x7fb1b407b0a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc00bbb0 tx=0x7fb1cc005ec0 comp rx=0 tx=0).stop 2024-09-21T03:21:46.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.170+0000 7fb1d7b8b640 1 -- 172.21.15.105:0/557601038 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1d00cf540 msgr2=0x7fb1d0160a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:46.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.170+0000 7fb1d7b8b640 1 --2- 172.21.15.105:0/557601038 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1d00cf540 0x7fb1d0160a70 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fb1c800e990 tx=0x7fb1c800ee50 comp rx=0 tx=0).stop 2024-09-21T03:21:46.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.170+0000 7fb1d7b8b640 1 -- 172.21.15.105:0/557601038 shutdown_connections 2024-09-21T03:21:46.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.170+0000 7fb1d7b8b640 1 --2- 172.21.15.105:0/557601038 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb1b4078b90 0x7fb1b407b0a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:46.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.170+0000 7fb1d7b8b640 1 --2- 172.21.15.105:0/557601038 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1d00cf540 0x7fb1d0160a70 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:46.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.170+0000 7fb1d7b8b640 1 --2- 172.21.15.105:0/557601038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1d00b9b60 0x7fb1d01578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:46.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.170+0000 7fb1d7b8b640 1 --2- 172.21.15.105:0/557601038 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1d00b64e0 0x7fb1d00a00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:46.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.170+0000 7fb1d7b8b640 1 -- 172.21.15.105:0/557601038 >> 172.21.15.105:0/557601038 conn(0x7fb1d009d7f0 msgr2=0x7fb1d00b7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:46.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.170+0000 7fb1d7b8b640 1 -- 172.21.15.105:0/557601038 shutdown_connections 2024-09-21T03:21:46.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.170+0000 7fb1d7b8b640 1 -- 172.21.15.105:0/557601038 wait complete. 2024-09-21T03:21:46.183 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T03:21:46.298 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.296+0000 7fbe31cf9640 1 -- 172.21.15.105:0/2457692092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe14003a50 msgr2=0x7fbe14003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:46.299 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.296+0000 7fbe31cf9640 1 --2- 172.21.15.105:0/2457692092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe14003a50 0x7fbe14003ec0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c009b40 tx=0x7fbe14005830 comp rx=0 tx=0).stop 2024-09-21T03:21:46.299 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.296+0000 7fbe31cf9640 1 -- 172.21.15.105:0/2457692092 shutdown_connections 2024-09-21T03:21:46.299 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.296+0000 7fbe31cf9640 1 --2- 172.21.15.105:0/2457692092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe14003a50 0x7fbe14003ec0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:46.299 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.296+0000 7fbe31cf9640 1 -- 172.21.15.105:0/2457692092 >> 172.21.15.105:0/2457692092 conn(0x7fbe2c0d12a0 msgr2=0x7fbe2c0d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:46.299 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.296+0000 7fbe31cf9640 1 -- 172.21.15.105:0/2457692092 shutdown_connections 2024-09-21T03:21:46.299 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.296+0000 7fbe31cf9640 1 -- 172.21.15.105:0/2457692092 wait complete. 2024-09-21T03:21:46.300 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.297+0000 7fbe31cf9640 1 Processor -- start 2024-09-21T03:21:46.300 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.298+0000 7fbe31cf9640 1 -- start start 2024-09-21T03:21:46.303 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.299+0000 7fbe31cf9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe14003a50 0x7fbe2c1f28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:46.303 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.299+0000 7fbe31cf9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe2c1f6ea0 0x7fbe2c09e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:46.303 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.299+0000 7fbe31cf9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe2c09b7a0 0x7fbe2c15c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:46.303 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.299+0000 7fbe31cf9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbe2c0b6230 con 0x7fbe2c09b7a0 2024-09-21T03:21:46.303 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.299+0000 7fbe31cf9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbe2c0b60b0 con 0x7fbe2c1f6ea0 2024-09-21T03:21:46.303 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.299+0000 7fbe31cf9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbe2c0b63b0 con 0x7fbe14003a50 2024-09-21T03:21:46.303 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.299+0000 7fbe2bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe2c09b7a0 0x7fbe2c15c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:46.303 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.299+0000 7fbe2bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe2c09b7a0 0x7fbe2c15c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51770/0 (socket says 172.21.15.105:51770) 2024-09-21T03:21:46.303 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.299+0000 7fbe2bfff640 1 -- 172.21.15.105:0/3742222171 learned_addr learned my addr 172.21.15.105:0/3742222171 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:46.304 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.299+0000 7fbe2b7fe640 1 --2- 172.21.15.105:0/3742222171 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe14003a50 0x7fbe2c1f28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:46.304 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.299+0000 7fbe2affd640 1 --2- 172.21.15.105:0/3742222171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe2c1f6ea0 0x7fbe2c09e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:46.304 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.299+0000 7fbe2bfff640 1 -- 172.21.15.105:0/3742222171 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe14003a50 msgr2=0x7fbe2c1f28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:46.304 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.299+0000 7fbe2bfff640 1 --2- 172.21.15.105:0/3742222171 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe14003a50 0x7fbe2c1f28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:46.304 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.299+0000 7fbe2bfff640 1 -- 172.21.15.105:0/3742222171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe2c1f6ea0 msgr2=0x7fbe2c09e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:46.304 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.299+0000 7fbe2bfff640 1 --2- 172.21.15.105:0/3742222171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe2c1f6ea0 0x7fbe2c09e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:46.304 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.299+0000 7fbe2bfff640 1 -- 172.21.15.105:0/3742222171 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe2c09d530 con 0x7fbe2c09b7a0 2024-09-21T03:21:46.304 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.299+0000 7fbe2b7fe640 1 --2- 172.21.15.105:0/3742222171 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe14003a50 0x7fbe2c1f28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:21:46.304 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.299+0000 7fbe2affd640 1 --2- 172.21.15.105:0/3742222171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe2c1f6ea0 0x7fbe2c09e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:21:46.304 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.299+0000 7fbe2bfff640 1 --2- 172.21.15.105:0/3742222171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe2c09b7a0 0x7fbe2c15c770 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c0cc550 tx=0x7fbe240019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:46.304 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.300+0000 7fbe13fff640 1 -- 172.21.15.105:0/3742222171 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe240107d0 con 0x7fbe2c09b7a0 2024-09-21T03:21:46.304 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.300+0000 7fbe13fff640 1 -- 172.21.15.105:0/3742222171 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe24016070 con 0x7fbe2c09b7a0 2024-09-21T03:21:46.305 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.300+0000 7fbe13fff640 1 -- 172.21.15.105:0/3742222171 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe24010ce0 con 0x7fbe2c09b7a0 2024-09-21T03:21:46.305 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.300+0000 7fbe31cf9640 1 -- 172.21.15.105:0/3742222171 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe2c09d810 con 0x7fbe2c09b7a0 2024-09-21T03:21:46.305 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.300+0000 7fbe31cf9640 1 -- 172.21.15.105:0/3742222171 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe2c09ddd0 con 0x7fbe2c09b7a0 2024-09-21T03:21:46.306 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.301+0000 7fbe31cf9640 1 -- 172.21.15.105:0/3742222171 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe2c0ce110 con 0x7fbe2c09b7a0 2024-09-21T03:21:46.306 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.301+0000 7fbe13fff640 1 -- 172.21.15.105:0/3742222171 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbe2401b460 con 0x7fbe2c09b7a0 2024-09-21T03:21:46.306 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.302+0000 7fbe13fff640 1 --2- 172.21.15.105:0/3742222171 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbe18078b90 0x7fbe1807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:46.306 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.302+0000 7fbe13fff640 1 -- 172.21.15.105:0/3742222171 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 4943+0+0 (secure 0 0 0) 0x7fbe2409b2b0 con 0x7fbe2c09b7a0 2024-09-21T03:21:46.306 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.302+0000 7fbe2b7fe640 1 --2- 172.21.15.105:0/3742222171 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbe18078b90 0x7fbe1807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:46.306 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.302+0000 7fbe2b7fe640 1 --2- 172.21.15.105:0/3742222171 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbe18078b90 0x7fbe1807b0a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c035000 tx=0x7fbe1c0046c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:46.309 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.306+0000 7fbe13fff640 1 -- 172.21.15.105:0/3742222171 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbe240639f0 con 0x7fbe2c09b7a0 2024-09-21T03:21:46.487 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.484+0000 7fbe31cf9640 1 -- 172.21.15.105:0/3742222171 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fbe2c06ef00 con 0x7fbe2c09b7a0 2024-09-21T03:21:46.490 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.488+0000 7fbe13fff640 1 -- 172.21.15.105:0/3742222171 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v43)=0 v43) ==== 122+0+0 (secure 0 0 0) 0x7fbe2409b0d0 con 0x7fbe2c09b7a0 2024-09-21T03:21:46.493 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.490+0000 7fbe31cf9640 1 -- 172.21.15.105:0/3742222171 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbe18078b90 msgr2=0x7fbe1807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:46.493 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.490+0000 7fbe31cf9640 1 --2- 172.21.15.105:0/3742222171 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbe18078b90 0x7fbe1807b0a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c035000 tx=0x7fbe1c0046c0 comp rx=0 tx=0).stop 2024-09-21T03:21:46.493 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.490+0000 7fbe31cf9640 1 -- 172.21.15.105:0/3742222171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe2c09b7a0 msgr2=0x7fbe2c15c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:46.493 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.490+0000 7fbe31cf9640 1 --2- 172.21.15.105:0/3742222171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe2c09b7a0 0x7fbe2c15c770 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c0cc550 tx=0x7fbe240019b0 comp rx=0 tx=0).stop 2024-09-21T03:21:46.493 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.490+0000 7fbe31cf9640 1 -- 172.21.15.105:0/3742222171 shutdown_connections 2024-09-21T03:21:46.493 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.490+0000 7fbe31cf9640 1 --2- 172.21.15.105:0/3742222171 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbe18078b90 0x7fbe1807b0a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:46.493 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.490+0000 7fbe31cf9640 1 --2- 172.21.15.105:0/3742222171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe2c09b7a0 0x7fbe2c15c770 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:46.494 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.490+0000 7fbe31cf9640 1 --2- 172.21.15.105:0/3742222171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe2c1f6ea0 0x7fbe2c09e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:46.494 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.490+0000 7fbe31cf9640 1 --2- 172.21.15.105:0/3742222171 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe14003a50 0x7fbe2c1f28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:46.494 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.490+0000 7fbe31cf9640 1 -- 172.21.15.105:0/3742222171 >> 172.21.15.105:0/3742222171 conn(0x7fbe2c0d12a0 msgr2=0x7fbe2c070730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:46.494 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.490+0000 7fbe31cf9640 1 -- 172.21.15.105:0/3742222171 shutdown_connections 2024-09-21T03:21:46.494 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.490+0000 7fbe31cf9640 1 -- 172.21.15.105:0/3742222171 wait complete. 2024-09-21T03:21:46.504 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T03:21:46.504 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T03:21:46.538 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T03:21:46.579 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T03:21:46.579 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:21:46.579 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:21:46.595 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T03:21:46.595 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:21:46.595 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:21:46.637 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=452 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T03:21:46.637 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:21:46.637 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:21:46.653 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T03:21:46.653 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:21:46.653 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:21:46.695 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=452 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T03:21:46.695 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T03:21:46.695 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:21:46.809 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.807+0000 7fc519fba640 1 -- 172.21.15.105:0/1195378826 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc51406f4b0 msgr2=0x7fc5140d3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:46.809 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.807+0000 7fc519fba640 1 --2- 172.21.15.105:0/1195378826 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc51406f4b0 0x7fc5140d3330 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc508009860 tx=0x7fc50802a4b0 comp rx=0 tx=0).stop 2024-09-21T03:21:46.809 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.807+0000 7fc519fba640 1 -- 172.21.15.105:0/1195378826 shutdown_connections 2024-09-21T03:21:46.809 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.807+0000 7fc519fba640 1 --2- 172.21.15.105:0/1195378826 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc51406f4b0 0x7fc5140d3330 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:46.809 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.807+0000 7fc519fba640 1 --2- 172.21.15.105:0/1195378826 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc51406e170 0x7fc5140b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:46.809 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.807+0000 7fc519fba640 1 -- 172.21.15.105:0/1195378826 >> 172.21.15.105:0/1195378826 conn(0x7fc51408bfc0 msgr2=0x7fc51409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:46.809 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.807+0000 7fc519fba640 1 -- 172.21.15.105:0/1195378826 shutdown_connections 2024-09-21T03:21:46.809 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.807+0000 7fc519fba640 1 -- 172.21.15.105:0/1195378826 wait complete. 2024-09-21T03:21:46.810 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.809+0000 7fc519fba640 1 Processor -- start 2024-09-21T03:21:46.810 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.809+0000 7fc519fba640 1 -- start start 2024-09-21T03:21:46.813 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.810+0000 7fc519fba640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc51406f4b0 0x7fc5141e9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:46.813 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.810+0000 7fc519fba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5140d3870 0x7fc5141f6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:46.813 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.810+0000 7fc519fba640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5140cabb0 0x7fc5141f6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:46.813 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.810+0000 7fc519fba640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc5140d0e60 con 0x7fc51406f4b0 2024-09-21T03:21:46.813 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.810+0000 7fc519fba640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc5140d0ce0 con 0x7fc5140d3870 2024-09-21T03:21:46.813 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.810+0000 7fc519fba640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc5140d0fe0 con 0x7fc5140cabb0 2024-09-21T03:21:46.813 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.810+0000 7fc5137fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc51406f4b0 0x7fc5141e9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:46.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.810+0000 7fc5137fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc51406f4b0 0x7fc5141e9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51778/0 (socket says 172.21.15.105:51778) 2024-09-21T03:21:46.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.810+0000 7fc5137fe640 1 -- 172.21.15.105:0/1354569832 learned_addr learned my addr 172.21.15.105:0/1354569832 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:46.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.810+0000 7fc513fff640 1 --2- 172.21.15.105:0/1354569832 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5140cabb0 0x7fc5141f6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:46.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.810+0000 7fc512ffd640 1 --2- 172.21.15.105:0/1354569832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5140d3870 0x7fc5141f6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:46.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.811+0000 7fc5137fe640 1 -- 172.21.15.105:0/1354569832 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5140cabb0 msgr2=0x7fc5141f6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:46.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.811+0000 7fc5137fe640 1 --2- 172.21.15.105:0/1354569832 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5140cabb0 0x7fc5141f6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:46.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.811+0000 7fc5137fe640 1 -- 172.21.15.105:0/1354569832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5140d3870 msgr2=0x7fc5141f6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:46.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.811+0000 7fc5137fe640 1 --2- 172.21.15.105:0/1354569832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5140d3870 0x7fc5141f6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:46.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.811+0000 7fc5137fe640 1 -- 172.21.15.105:0/1354569832 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc51415f080 con 0x7fc51406f4b0 2024-09-21T03:21:46.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.811+0000 7fc512ffd640 1 --2- 172.21.15.105:0/1354569832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5140d3870 0x7fc5141f6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:21:46.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.811+0000 7fc5137fe640 1 --2- 172.21.15.105:0/1354569832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc51406f4b0 0x7fc5141e9b90 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fc50400e9f0 tx=0x7fc50400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:46.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.811+0000 7fc4fbfff640 1 -- 172.21.15.105:0/1354569832 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50400cd80 con 0x7fc51406f4b0 2024-09-21T03:21:46.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.811+0000 7fc519fba640 1 -- 172.21.15.105:0/1354569832 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5141e8af0 con 0x7fc51406f4b0 2024-09-21T03:21:46.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.811+0000 7fc4fbfff640 1 -- 172.21.15.105:0/1354569832 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc504004020 con 0x7fc51406f4b0 2024-09-21T03:21:46.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.811+0000 7fc4fbfff640 1 -- 172.21.15.105:0/1354569832 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc504004450 con 0x7fc51406f4b0 2024-09-21T03:21:46.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.811+0000 7fc519fba640 1 -- 172.21.15.105:0/1354569832 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5141e90b0 con 0x7fc51406f4b0 2024-09-21T03:21:46.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.812+0000 7fc519fba640 1 -- 172.21.15.105:0/1354569832 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5140d1500 con 0x7fc51406f4b0 2024-09-21T03:21:46.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.813+0000 7fc4fbfff640 1 -- 172.21.15.105:0/1354569832 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc5040035f0 con 0x7fc51406f4b0 2024-09-21T03:21:46.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.813+0000 7fc4fbfff640 1 --2- 172.21.15.105:0/1354569832 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc500078bc0 0x7fc50007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:46.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.813+0000 7fc4fbfff640 1 -- 172.21.15.105:0/1354569832 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 4943+0+0 (secure 0 0 0) 0x7fc50409b2f0 con 0x7fc51406f4b0 2024-09-21T03:21:46.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.813+0000 7fc512ffd640 1 --2- 172.21.15.105:0/1354569832 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc500078bc0 0x7fc50007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:46.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.814+0000 7fc512ffd640 1 --2- 172.21.15.105:0/1354569832 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc500078bc0 0x7fc50007b0d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc508034000 tx=0x7fc508004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:46.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:46.818+0000 7fc4fbfff640 1 -- 172.21.15.105:0/1354569832 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc504063a40 con 0x7fc51406f4b0 2024-09-21T03:21:47.033 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.032+0000 7fc519fba640 1 -- 172.21.15.105:0/1354569832 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc51406ef10 con 0x7fc51406f4b0 2024-09-21T03:21:47.034 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.032+0000 7fc4fbfff640 1 -- 172.21.15.105:0/1354569832 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+3920 (secure 0 0 0) 0x7fc504063340 con 0x7fc51406f4b0 2024-09-21T03:21:47.034 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:47.034 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":40,"btime":"2024-09-21T03:21:40:818868+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5593,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2041248590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2041248590},{"type":"v1","addr":"172.21.15.162:6836","nonce":2041248590}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5596,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/775014606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":775014606},{"type":"v1","addr":"172.21.15.162:6837","nonce":775014606}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5937,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/3799275472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3799275472},{"type":"v1","addr":"172.21.15.105:6833","nonce":3799275472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":6204,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3604179462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3604179462},{"type":"v1","addr":"172.21.15.105:6835","nonce":3604179462}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[]} 2024-09-21T03:21:47.034 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 40 2024-09-21T03:21:47.036 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.034+0000 7fc519fba640 1 -- 172.21.15.105:0/1354569832 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc500078bc0 msgr2=0x7fc50007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:47.036 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.034+0000 7fc519fba640 1 --2- 172.21.15.105:0/1354569832 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc500078bc0 0x7fc50007b0d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc508034000 tx=0x7fc508004730 comp rx=0 tx=0).stop 2024-09-21T03:21:47.036 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.034+0000 7fc519fba640 1 -- 172.21.15.105:0/1354569832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc51406f4b0 msgr2=0x7fc5141e9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:47.036 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.034+0000 7fc519fba640 1 --2- 172.21.15.105:0/1354569832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc51406f4b0 0x7fc5141e9b90 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fc50400e9f0 tx=0x7fc50400eeb0 comp rx=0 tx=0).stop 2024-09-21T03:21:47.037 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.034+0000 7fc519fba640 1 -- 172.21.15.105:0/1354569832 shutdown_connections 2024-09-21T03:21:47.037 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.034+0000 7fc519fba640 1 --2- 172.21.15.105:0/1354569832 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc500078bc0 0x7fc50007b0d0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:47.037 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.034+0000 7fc519fba640 1 --2- 172.21.15.105:0/1354569832 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5140cabb0 0x7fc5141f6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:47.037 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.034+0000 7fc519fba640 1 --2- 172.21.15.105:0/1354569832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5140d3870 0x7fc5141f6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:47.037 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.034+0000 7fc519fba640 1 --2- 172.21.15.105:0/1354569832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc51406f4b0 0x7fc5141e9b90 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:47.037 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.034+0000 7fc519fba640 1 -- 172.21.15.105:0/1354569832 >> 172.21.15.105:0/1354569832 conn(0x7fc51408bfc0 msgr2=0x7fc5140b2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:47.037 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.035+0000 7fc519fba640 1 -- 172.21.15.105:0/1354569832 shutdown_connections 2024-09-21T03:21:47.037 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.035+0000 7fc519fba640 1 -- 172.21.15.105:0/1354569832 wait complete. 2024-09-21T03:21:47.047 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T03:21:47.047 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-21T03:21:47.048 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T03:21:47.048 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:21:47.048 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T03:21:47.048 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T03:21:47.048 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T03:21:47.048 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:21:47.048 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T03:21:47.048 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T03:21:47.049 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T03:21:47.049 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:21:47.049 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T03:21:47.049 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T03:21:47.049 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T03:21:47.049 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:21:47.058 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T03:21:47.058 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T03:21:47.060 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T03:21:47.060 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T03:21:47.061 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T03:21:47.061 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T03:21:47.062 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T03:21:47.062 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T03:21:47.102 INFO:tasks.ceph.mds.c:Started 2024-09-21T03:21:47.103 DEBUG:teuthology.parallel:result is None 2024-09-21T03:21:47.104 INFO:tasks.ceph.mds.a:Started 2024-09-21T03:21:47.104 DEBUG:teuthology.parallel:result is None 2024-09-21T03:21:47.105 INFO:tasks.ceph.mds.b:Started 2024-09-21T03:21:47.105 DEBUG:teuthology.parallel:result is None 2024-09-21T03:21:47.106 INFO:tasks.ceph.mds.d:Started 2024-09-21T03:21:47.106 DEBUG:teuthology.parallel:result is None 2024-09-21T03:21:47.106 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T03:21:47.189 INFO:tasks.ceph.mds.c.smithi105.stdout:starting mds.c at 2024-09-21T03:21:47.189 INFO:tasks.ceph.mds.a.smithi105.stdout:starting mds.a at 2024-09-21T03:21:47.198 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-09-21T03:21:47.198 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-09-21T03:21:47.227 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.223+0000 7f2be032b640 1 -- 172.21.15.105:0/1804620389 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2bd80cd360 msgr2=0x7f2bd815c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:47.227 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.223+0000 7f2be032b640 1 --2- 172.21.15.105:0/1804620389 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2bd80cd360 0x7f2bd815c6a0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f2bd80cc8f0 tx=0x7f2bd402a4d0 comp rx=0 tx=0).stop 2024-09-21T03:21:47.227 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.223+0000 7f2be032b640 1 -- 172.21.15.105:0/1804620389 shutdown_connections 2024-09-21T03:21:47.228 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.223+0000 7f2be032b640 1 --2- 172.21.15.105:0/1804620389 >> v2:172.21.15.162:3300/0 conn(0x7f2bd80cf440 0x7f2bd80d0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:47.228 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.223+0000 7f2be032b640 1 --2- 172.21.15.105:0/1804620389 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2bd80cd360 0x7f2bd815c6a0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:47.228 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.223+0000 7f2be032b640 1 -- 172.21.15.105:0/1804620389 >> 172.21.15.105:0/1804620389 conn(0x7f2bd80710b0 msgr2=0x7f2bd80714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:47.228 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.223+0000 7f2be032b640 1 -- 172.21.15.105:0/1804620389 shutdown_connections 2024-09-21T03:21:47.228 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.223+0000 7f2be032b640 1 -- 172.21.15.105:0/1804620389 wait complete. 2024-09-21T03:21:47.228 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.225+0000 7f2be032b640 1 Processor -- start 2024-09-21T03:21:47.228 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.225+0000 7f2be032b640 1 -- start start 2024-09-21T03:21:47.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.227+0000 7f2be032b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2bd80b7fe0 0x7f2bd80c9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:47.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.227+0000 7f2be032b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2bd80cd360 0x7f2bd80c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:47.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.227+0000 7f2be032b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2bd80c6bf0 0x7f2bd80b6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:47.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.227+0000 7f2be032b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd80d0b40 con 0x7f2bd80b7fe0 2024-09-21T03:21:47.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.227+0000 7f2be032b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd80d09c0 con 0x7f2bd80c6bf0 2024-09-21T03:21:47.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.227+0000 7f2be032b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2bd80d0cc0 con 0x7f2bd80cd360 2024-09-21T03:21:47.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.227+0000 7f2bde0c7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2bd80b7fe0 0x7f2bd80c9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:47.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.227+0000 7f2bde0c7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2bd80b7fe0 0x7f2bd80c9b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51842/0 (socket says 172.21.15.105:51842) 2024-09-21T03:21:47.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.227+0000 7f2bde0c7640 1 -- 172.21.15.105:0/1927434870 learned_addr learned my addr 172.21.15.105:0/1927434870 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:47.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.227+0000 7f2bdd8c6640 1 --2- 172.21.15.105:0/1927434870 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2bd80cd360 0x7f2bd80c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:47.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.227+0000 7f2bde8c8640 1 --2- 172.21.15.105:0/1927434870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2bd80c6bf0 0x7f2bd80b6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:47.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.227+0000 7f2bde0c7640 1 -- 172.21.15.105:0/1927434870 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2bd80cd360 msgr2=0x7f2bd80c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:47.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.227+0000 7f2bde0c7640 1 --2- 172.21.15.105:0/1927434870 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2bd80cd360 0x7f2bd80c66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:47.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.227+0000 7f2bde0c7640 1 -- 172.21.15.105:0/1927434870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2bd80c6bf0 msgr2=0x7f2bd80b6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:47.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.227+0000 7f2bde0c7640 1 --2- 172.21.15.105:0/1927434870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2bd80c6bf0 0x7f2bd80b6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:47.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.227+0000 7f2bde0c7640 1 -- 172.21.15.105:0/1927434870 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bd8159110 con 0x7f2bd80b7fe0 2024-09-21T03:21:47.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.227+0000 7f2bde0c7640 1 --2- 172.21.15.105:0/1927434870 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2bd80b7fe0 0x7f2bd80c9b50 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f2bd40099c0 tx=0x7f2bd40039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:47.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.227+0000 7f2bceffd640 1 -- 172.21.15.105:0/1927434870 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd403e030 con 0x7f2bd80b7fe0 2024-09-21T03:21:47.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.227+0000 7f2bceffd640 1 -- 172.21.15.105:0/1927434870 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2bd40047a0 con 0x7f2bd80b7fe0 2024-09-21T03:21:47.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.228+0000 7f2be032b640 1 -- 172.21.15.105:0/1927434870 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bd8158b50 con 0x7f2bd80b7fe0 2024-09-21T03:21:47.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.228+0000 7f2bceffd640 1 -- 172.21.15.105:0/1927434870 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd4035040 con 0x7f2bd80b7fe0 2024-09-21T03:21:47.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.228+0000 7f2be032b640 1 -- 172.21.15.105:0/1927434870 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bd80c5eb0 con 0x7f2bd80b7fe0 2024-09-21T03:21:47.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.229+0000 7f2be032b640 1 -- 172.21.15.105:0/1927434870 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bd80d11d0 con 0x7f2bd80b7fe0 2024-09-21T03:21:47.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.229+0000 7f2bceffd640 1 -- 172.21.15.105:0/1927434870 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2bd4041030 con 0x7f2bd80b7fe0 2024-09-21T03:21:47.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.230+0000 7f2bceffd640 1 --2- 172.21.15.105:0/1927434870 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2bbc078b90 0x7f2bbc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:47.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.230+0000 7f2bceffd640 1 -- 172.21.15.105:0/1927434870 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 4943+0+0 (secure 0 0 0) 0x7f2bd40bb210 con 0x7f2bd80b7fe0 2024-09-21T03:21:47.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.230+0000 7f2bdd8c6640 1 --2- 172.21.15.105:0/1927434870 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2bbc078b90 0x7f2bbc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:47.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.230+0000 7f2bdd8c6640 1 --2- 172.21.15.105:0/1927434870 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2bbc078b90 0x7f2bbc07b0a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2bd81e8410 tx=0x7f2bc8009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:47.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.234+0000 7f2bceffd640 1 -- 172.21.15.105:0/1927434870 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2bd4083300 con 0x7f2bd80b7fe0 2024-09-21T03:21:47.424 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.422+0000 7f2be032b640 1 -- 172.21.15.105:0/1927434870 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f2bd80cc200 con 0x7f2bd80b7fe0 2024-09-21T03:21:47.855 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.854+0000 7f2bceffd640 1 -- 172.21.15.105:0/1927434870 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v74) ==== 97+0+0 (secure 0 0 0) 0x7f2bd4087d30 con 0x7f2bd80b7fe0 2024-09-21T03:21:47.856 INFO:teuthology.orchestra.run.smithi105.stderr: removed all blocklist entries 2024-09-21T03:21:47.858 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.856+0000 7f2be032b640 1 -- 172.21.15.105:0/1927434870 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2bbc078b90 msgr2=0x7f2bbc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:47.858 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.856+0000 7f2be032b640 1 --2- 172.21.15.105:0/1927434870 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2bbc078b90 0x7f2bbc07b0a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2bd81e8410 tx=0x7f2bc8009060 comp rx=0 tx=0).stop 2024-09-21T03:21:47.858 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.856+0000 7f2be032b640 1 -- 172.21.15.105:0/1927434870 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2bd80b7fe0 msgr2=0x7f2bd80c9b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:47.858 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.856+0000 7f2be032b640 1 --2- 172.21.15.105:0/1927434870 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2bd80b7fe0 0x7f2bd80c9b50 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f2bd40099c0 tx=0x7f2bd40039e0 comp rx=0 tx=0).stop 2024-09-21T03:21:47.859 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.857+0000 7f2be032b640 1 -- 172.21.15.105:0/1927434870 shutdown_connections 2024-09-21T03:21:47.859 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.857+0000 7f2be032b640 1 --2- 172.21.15.105:0/1927434870 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2bbc078b90 0x7f2bbc07b0a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:47.859 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.857+0000 7f2be032b640 1 --2- 172.21.15.105:0/1927434870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2bd80c6bf0 0x7f2bd80b6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:47.859 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.857+0000 7f2be032b640 1 --2- 172.21.15.105:0/1927434870 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2bd80cd360 0x7f2bd80c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:47.859 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.857+0000 7f2be032b640 1 --2- 172.21.15.105:0/1927434870 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2bd80b7fe0 0x7f2bd80c9b50 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:47.859 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.857+0000 7f2be032b640 1 -- 172.21.15.105:0/1927434870 >> 172.21.15.105:0/1927434870 conn(0x7f2bd80710b0 msgr2=0x7f2bd80b26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:47.859 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.857+0000 7f2be032b640 1 -- 172.21.15.105:0/1927434870 shutdown_connections 2024-09-21T03:21:47.859 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.857+0000 7f2be032b640 1 -- 172.21.15.105:0/1927434870 wait complete. 2024-09-21T03:21:47.871 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T03:21:47.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.985+0000 7f7e0b6de640 1 -- 172.21.15.105:0/2936244135 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e0415c580 msgr2=0x7f7e04070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:47.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.985+0000 7f7e0b6de640 1 --2- 172.21.15.105:0/2936244135 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e0415c580 0x7f7e04070370 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f7df4005fd0 tx=0x7f7df402a530 comp rx=0 tx=0).stop 2024-09-21T03:21:47.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.985+0000 7f7e0b6de640 1 -- 172.21.15.105:0/2936244135 shutdown_connections 2024-09-21T03:21:47.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.985+0000 7f7e0b6de640 1 --2- 172.21.15.105:0/2936244135 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e0415c580 0x7f7e04070370 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:47.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.985+0000 7f7e0b6de640 1 --2- 172.21.15.105:0/2936244135 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e04074420 0x7f7e0406fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:47.988 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.985+0000 7f7e0b6de640 1 -- 172.21.15.105:0/2936244135 >> 172.21.15.105:0/2936244135 conn(0x7f7e0406def0 msgr2=0x7f7e0406e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:47.988 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.985+0000 7f7e0b6de640 1 -- 172.21.15.105:0/2936244135 shutdown_connections 2024-09-21T03:21:47.988 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.985+0000 7f7e0b6de640 1 -- 172.21.15.105:0/2936244135 wait complete. 2024-09-21T03:21:47.988 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.987+0000 7f7e0b6de640 1 Processor -- start 2024-09-21T03:21:47.988 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.987+0000 7f7e0b6de640 1 -- start start 2024-09-21T03:21:47.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.988+0000 7f7e0b6de640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e04074420 0x7f7e04151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:47.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.988+0000 7f7e0b6de640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e04155ce0 0x7f7e041f30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:47.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.988+0000 7f7e0b6de640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e040d0b80 0x7f7e040d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:47.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.988+0000 7f7e0b6de640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7e0415f850 con 0x7f7e04155ce0 2024-09-21T03:21:47.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.988+0000 7f7e0b6de640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7e04070ba0 con 0x7f7e04074420 2024-09-21T03:21:47.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.988+0000 7f7e0b6de640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7e0415f9d0 con 0x7f7e040d0b80 2024-09-21T03:21:47.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.988+0000 7f7e08c79640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e04155ce0 0x7f7e041f30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:47.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.988+0000 7f7e08c79640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e04155ce0 0x7f7e041f30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51864/0 (socket says 172.21.15.105:51864) 2024-09-21T03:21:47.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.988+0000 7f7e08c79640 1 -- 172.21.15.105:0/1231222687 learned_addr learned my addr 172.21.15.105:0/1231222687 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:47.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.989+0000 7f7e09c7b640 1 --2- 172.21.15.105:0/1231222687 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e040d0b80 0x7f7e040d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:47.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.989+0000 7f7e0947a640 1 --2- 172.21.15.105:0/1231222687 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e04074420 0x7f7e04151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:47.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.989+0000 7f7e08c79640 1 -- 172.21.15.105:0/1231222687 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e040d0b80 msgr2=0x7f7e040d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:47.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.989+0000 7f7e08c79640 1 --2- 172.21.15.105:0/1231222687 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e040d0b80 0x7f7e040d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:47.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.989+0000 7f7e08c79640 1 -- 172.21.15.105:0/1231222687 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e04074420 msgr2=0x7f7e04151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:47.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.989+0000 7f7e08c79640 1 --2- 172.21.15.105:0/1231222687 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e04074420 0x7f7e04151d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:47.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.989+0000 7f7e08c79640 1 -- 172.21.15.105:0/1231222687 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e040d14d0 con 0x7f7e04155ce0 2024-09-21T03:21:47.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.989+0000 7f7e0947a640 1 --2- 172.21.15.105:0/1231222687 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e04074420 0x7f7e04151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:21:47.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.989+0000 7f7e08c79640 1 --2- 172.21.15.105:0/1231222687 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e04155ce0 0x7f7e041f30a0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f7df4034040 tx=0x7f7df40039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:47.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.989+0000 7f7df9ffb640 1 -- 172.21.15.105:0/1231222687 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df403e030 con 0x7f7e04155ce0 2024-09-21T03:21:47.993 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.989+0000 7f7df9ffb640 1 -- 172.21.15.105:0/1231222687 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7df40047a0 con 0x7f7e04155ce0 2024-09-21T03:21:47.993 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.989+0000 7f7df9ffb640 1 -- 172.21.15.105:0/1231222687 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df4035040 con 0x7f7e04155ce0 2024-09-21T03:21:47.993 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.989+0000 7f7e0b6de640 1 -- 172.21.15.105:0/1231222687 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e041f3c20 con 0x7f7e04155ce0 2024-09-21T03:21:47.993 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.989+0000 7f7e0b6de640 1 -- 172.21.15.105:0/1231222687 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e041f44c0 con 0x7f7e04155ce0 2024-09-21T03:21:47.994 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.990+0000 7f7e0b6de640 1 -- 172.21.15.105:0/1231222687 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e04073f40 con 0x7f7e04155ce0 2024-09-21T03:21:47.994 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.991+0000 7f7df9ffb640 1 -- 172.21.15.105:0/1231222687 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7df4041030 con 0x7f7e04155ce0 2024-09-21T03:21:47.994 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.991+0000 7f7df9ffb640 1 --2- 172.21.15.105:0/1231222687 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7de8078b90 0x7f7de807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:47.994 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.992+0000 7f7df9ffb640 1 -- 172.21.15.105:0/1231222687 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 4857+0+0 (secure 0 0 0) 0x7f7df40bb1b0 con 0x7f7e04155ce0 2024-09-21T03:21:47.994 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.992+0000 7f7e0947a640 1 --2- 172.21.15.105:0/1231222687 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7de8078b90 0x7f7de807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:47.994 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.992+0000 7f7e0947a640 1 --2- 172.21.15.105:0/1231222687 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7de8078b90 0x7f7de807b0a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7e000058c0 tx=0x7f7e00005c90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:47.997 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:47.996+0000 7f7df9ffb640 1 -- 172.21.15.105:0/1231222687 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7e040d14d0 con 0x7f7e04155ce0 2024-09-21T03:21:48.242 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.240+0000 7f7e0b6de640 1 -- 172.21.15.105:0/1231222687 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f7e041f39b0 con 0x7f7e04155ce0 2024-09-21T03:21:48.242 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.241+0000 7f7df9ffb640 1 -- 172.21.15.105:0/1231222687 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) ==== 80+0+5304 (secure 0 0 0) 0x7f7df4083a60 con 0x7f7e04155ce0 2024-09-21T03:21:48.242 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:48.242 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-21T03:21:48.243 INFO:teuthology.orchestra.run.smithi105.stdout: "auth_dump": [ 2024-09-21T03:21:48.243 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:21:48.243 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mds.a", 2024-09-21T03:21:48.243 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mtIIZDhAAJIXLpzTFBOFhnOwLzsdL6w==", 2024-09-21T03:21:48.243 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:21:48.243 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:21:48.243 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:21:48.243 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:21:48.243 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:21:48.243 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:48.243 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:21:48.243 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:21:48.243 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mds.b", 2024-09-21T03:21:48.244 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mGKANGxAAeAuUYMtLP7GXKfIELR7qMA==", 2024-09-21T03:21:48.244 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:21:48.244 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:21:48.244 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:21:48.244 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:21:48.244 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:21:48.244 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:48.244 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:21:48.244 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:21:48.244 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mds.c", 2024-09-21T03:21:48.244 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mwQzQFRAAElYtgnIdYzzkeg8AtiU+kA==", 2024-09-21T03:21:48.244 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:21:48.244 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:21:48.244 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:21:48.245 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:21:48.245 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:21:48.245 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:48.245 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:21:48.245 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:21:48.245 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mds.d", 2024-09-21T03:21:48.245 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mZkWyIhAAu4XWptFcbDrYjozzrgMcGQ==", 2024-09-21T03:21:48.245 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:21:48.245 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:21:48.245 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:21:48.245 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:21:48.245 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:21:48.245 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:48.245 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:21:48.246 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:21:48.246 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.0", 2024-09-21T03:21:48.246 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDMOu5mrSk2BRAAuEPjuEeUJEI3Sa2fiLaJyw==", 2024-09-21T03:21:48.246 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:21:48.246 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:21:48.246 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:21:48.246 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:21:48.246 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:48.246 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:21:48.246 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:21:48.246 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.1", 2024-09-21T03:21:48.246 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDPOu5mAT4UCBAAase7NV3ARBSu4QloaQdlzA==", 2024-09-21T03:21:48.246 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:21:48.246 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:21:48.246 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:21:48.247 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:21:48.247 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:48.247 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:21:48.247 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:21:48.247 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.2", 2024-09-21T03:21:48.247 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDSOu5ma4LRChAASottrmolMcagbspeyGVzBQ==", 2024-09-21T03:21:48.247 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:21:48.247 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:21:48.247 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:21:48.247 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:21:48.247 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:48.247 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:21:48.247 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:21:48.247 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.3", 2024-09-21T03:21:48.247 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDVOu5mD5RWHBAAKuNr4F3GA0EP566aQ07ZVw==", 2024-09-21T03:21:48.247 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:21:48.248 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:21:48.248 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:21:48.248 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:21:48.248 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:48.248 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:21:48.248 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:21:48.248 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.4", 2024-09-21T03:21:48.248 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDcOu5m++UBChAAqmgoPBQ/as4tc+UQPwaflg==", 2024-09-21T03:21:48.248 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:21:48.248 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:21:48.248 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:21:48.248 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:21:48.248 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:48.248 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:21:48.248 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:21:48.248 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.5", 2024-09-21T03:21:48.249 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDfOu5maYYZKRAA1ungglTU3TW1B/XNRjBuZQ==", 2024-09-21T03:21:48.249 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:21:48.249 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:21:48.249 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:21:48.249 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:21:48.249 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:48.249 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:21:48.249 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:21:48.249 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.6", 2024-09-21T03:21:48.249 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDjOu5mmwIqHBAAf6oNdLNkmM9yufP8XA2+og==", 2024-09-21T03:21:48.249 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:21:48.249 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:21:48.249 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:21:48.249 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:21:48.249 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:48.250 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:21:48.250 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:21:48.250 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.7", 2024-09-21T03:21:48.250 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDmOu5mtCciHhAAPTnZubJ+7mGXcXZykCWxHg==", 2024-09-21T03:21:48.250 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:21:48.250 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:21:48.250 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:21:48.250 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:21:48.250 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:48.250 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:21:48.250 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:21:48.250 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.0", 2024-09-21T03:21:48.250 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mughoJxAAhY0bzJmq+oNyzCdtafkC9w==", 2024-09-21T03:21:48.250 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:21:48.250 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:21:48.250 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow r", 2024-09-21T03:21:48.251 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-21T03:21:48.251 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:48.251 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:21:48.251 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:21:48.251 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.1", 2024-09-21T03:21:48.251 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5m4Vn2LhAAnEa/01ql5quuRCVHOVwB7w==", 2024-09-21T03:21:48.251 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:21:48.251 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:21:48.251 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow r", 2024-09-21T03:21:48.251 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow rw", 2024-09-21T03:21:48.251 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow rwx" 2024-09-21T03:21:48.251 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:48.251 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:21:48.251 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:21:48.251 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.2", 2024-09-21T03:21:48.252 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mKi0mKxAAoetnL61ujgtg2cvscdjCLQ==", 2024-09-21T03:21:48.252 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:21:48.252 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:21:48.252 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow r", 2024-09-21T03:21:48.252 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow rw", 2024-09-21T03:21:48.252 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow rwx" 2024-09-21T03:21:48.252 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:48.252 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:21:48.252 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:21:48.252 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.3", 2024-09-21T03:21:48.252 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mWZDAMhAAs4BuFHMSkJa6+piN/FeeXQ==", 2024-09-21T03:21:48.252 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:21:48.252 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:21:48.252 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow r", 2024-09-21T03:21:48.252 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow rw", 2024-09-21T03:21:48.253 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow rwx" 2024-09-21T03:21:48.253 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:48.253 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:21:48.253 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:21:48.253 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.admin", 2024-09-21T03:21:48.253 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDHOu5m4JRYLBAAgZ8nh5VIiWhuZ4+vrnmngw==", 2024-09-21T03:21:48.253 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:21:48.253 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow *", 2024-09-21T03:21:48.253 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:21:48.253 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:21:48.253 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:21:48.253 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:48.253 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:21:48.253 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:21:48.253 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mgr.x", 2024-09-21T03:21:48.254 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5m92lTChAAQ61muQmc6uBs7b5mq3Zt8g==", 2024-09-21T03:21:48.254 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:21:48.254 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow *", 2024-09-21T03:21:48.254 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile mgr", 2024-09-21T03:21:48.254 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:21:48.254 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:48.254 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:21:48.254 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:21:48.254 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mgr.y", 2024-09-21T03:21:48.254 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mh07bBRAAflFF00xr1ew4zttUi5TGng==", 2024-09-21T03:21:48.254 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:21:48.254 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow *", 2024-09-21T03:21:48.254 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile mgr", 2024-09-21T03:21:48.254 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:21:48.255 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:48.255 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:48.255 INFO:teuthology.orchestra.run.smithi105.stdout: ] 2024-09-21T03:21:48.255 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-21T03:21:48.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.243+0000 7f7e0b6de640 1 -- 172.21.15.105:0/1231222687 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7de8078b90 msgr2=0x7f7de807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:48.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.243+0000 7f7e0b6de640 1 --2- 172.21.15.105:0/1231222687 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7de8078b90 0x7f7de807b0a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7e000058c0 tx=0x7f7e00005c90 comp rx=0 tx=0).stop 2024-09-21T03:21:48.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.243+0000 7f7e0b6de640 1 -- 172.21.15.105:0/1231222687 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e04155ce0 msgr2=0x7f7e041f30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:48.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.243+0000 7f7e0b6de640 1 --2- 172.21.15.105:0/1231222687 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e04155ce0 0x7f7e041f30a0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f7df4034040 tx=0x7f7df40039e0 comp rx=0 tx=0).stop 2024-09-21T03:21:48.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.243+0000 7f7e0b6de640 1 -- 172.21.15.105:0/1231222687 shutdown_connections 2024-09-21T03:21:48.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.243+0000 7f7e0b6de640 1 --2- 172.21.15.105:0/1231222687 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7de8078b90 0x7f7de807b0a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:48.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.243+0000 7f7e0b6de640 1 --2- 172.21.15.105:0/1231222687 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e040d0b80 0x7f7e040d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:48.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.243+0000 7f7e0b6de640 1 --2- 172.21.15.105:0/1231222687 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e04155ce0 0x7f7e041f30a0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:48.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.243+0000 7f7e0b6de640 1 --2- 172.21.15.105:0/1231222687 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e04074420 0x7f7e04151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:48.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.243+0000 7f7e0b6de640 1 -- 172.21.15.105:0/1231222687 >> 172.21.15.105:0/1231222687 conn(0x7f7e0406def0 msgr2=0x7f7e040d0120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:48.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.243+0000 7f7e0b6de640 1 -- 172.21.15.105:0/1231222687 shutdown_connections 2024-09-21T03:21:48.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.243+0000 7f7e0b6de640 1 -- 172.21.15.105:0/1231222687 wait complete. 2024-09-21T03:21:48.257 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T03:21:48.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.368+0000 7f13a5a0e640 1 -- 172.21.15.105:0/1580055564 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13a00b9970 msgr2=0x7f13a00b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:48.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.368+0000 7f13a5a0e640 1 --2- 172.21.15.105:0/1580055564 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13a00b9970 0x7f13a00b3710 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f1394009be0 tx=0x7f139402a8d0 comp rx=0 tx=0).stop 2024-09-21T03:21:48.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.368+0000 7f13a5a0e640 1 -- 172.21.15.105:0/1580055564 shutdown_connections 2024-09-21T03:21:48.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.368+0000 7f13a5a0e640 1 --2- 172.21.15.105:0/1580055564 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13a006e0e0 0x7f13a006e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:48.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.368+0000 7f13a5a0e640 1 --2- 172.21.15.105:0/1580055564 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13a00b9970 0x7f13a00b3710 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:48.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.368+0000 7f13a5a0e640 1 -- 172.21.15.105:0/1580055564 >> 172.21.15.105:0/1580055564 conn(0x7f13a009d7f0 msgr2=0x7f13a00d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:48.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.368+0000 7f13a5a0e640 1 -- 172.21.15.105:0/1580055564 shutdown_connections 2024-09-21T03:21:48.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.368+0000 7f13a5a0e640 1 -- 172.21.15.105:0/1580055564 wait complete. 2024-09-21T03:21:48.371 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.369+0000 7f13a5a0e640 1 Processor -- start 2024-09-21T03:21:48.371 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.370+0000 7f13a5a0e640 1 -- start start 2024-09-21T03:21:48.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.371+0000 7f13a5a0e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13a006e0e0 0x7f13a01f95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:48.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.371+0000 7f13a5a0e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13a00b5fa0 0x7f13a015ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:48.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.371+0000 7f13a5a0e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13a00b9970 0x7f13a015c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:48.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.371+0000 7f13a5a0e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f13a006ea30 con 0x7f13a00b5fa0 2024-09-21T03:21:48.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.371+0000 7f13a5a0e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f13a00d5010 con 0x7f13a00b9970 2024-09-21T03:21:48.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.371+0000 7f13a5a0e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f13a006ebb0 con 0x7f13a006e0e0 2024-09-21T03:21:48.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.371+0000 7f139e7fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13a00b5fa0 0x7f13a015ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:48.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.371+0000 7f139e7fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13a00b5fa0 0x7f13a015ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51878/0 (socket says 172.21.15.105:51878) 2024-09-21T03:21:48.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.371+0000 7f139e7fc640 1 -- 172.21.15.105:0/2123094701 learned_addr learned my addr 172.21.15.105:0/2123094701 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:48.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.371+0000 7f139effd640 1 --2- 172.21.15.105:0/2123094701 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13a006e0e0 0x7f13a01f95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:48.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.371+0000 7f139e7fc640 1 -- 172.21.15.105:0/2123094701 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13a006e0e0 msgr2=0x7f13a01f95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:48.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.371+0000 7f139e7fc640 1 --2- 172.21.15.105:0/2123094701 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13a006e0e0 0x7f13a01f95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:48.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.371+0000 7f139f7fe640 1 --2- 172.21.15.105:0/2123094701 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13a00b9970 0x7f13a015c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:48.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.371+0000 7f139e7fc640 1 -- 172.21.15.105:0/2123094701 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13a00b9970 msgr2=0x7f13a015c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:48.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.371+0000 7f139e7fc640 1 --2- 172.21.15.105:0/2123094701 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13a00b9970 0x7f13a015c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:48.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.371+0000 7f139e7fc640 1 -- 172.21.15.105:0/2123094701 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13a01f9b00 con 0x7f13a00b5fa0 2024-09-21T03:21:48.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.372+0000 7f139e7fc640 1 --2- 172.21.15.105:0/2123094701 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13a00b5fa0 0x7f13a015ba10 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f139000c3c0 tx=0x7f139000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:48.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.372+0000 7f1387fff640 1 -- 172.21.15.105:0/2123094701 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1390017070 con 0x7f13a00b5fa0 2024-09-21T03:21:48.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.372+0000 7f1387fff640 1 -- 172.21.15.105:0/2123094701 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f13900035f0 con 0x7f13a00b5fa0 2024-09-21T03:21:48.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.372+0000 7f13a5a0e640 1 -- 172.21.15.105:0/2123094701 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13a01f5c10 con 0x7f13a00b5fa0 2024-09-21T03:21:48.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.372+0000 7f1387fff640 1 -- 172.21.15.105:0/2123094701 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1390003a80 con 0x7f13a00b5fa0 2024-09-21T03:21:48.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.372+0000 7f13a5a0e640 1 -- 172.21.15.105:0/2123094701 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13a01f61d0 con 0x7f13a00b5fa0 2024-09-21T03:21:48.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.373+0000 7f13a5a0e640 1 -- 172.21.15.105:0/2123094701 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13a01f5980 con 0x7f13a00b5fa0 2024-09-21T03:21:48.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.374+0000 7f1387fff640 1 -- 172.21.15.105:0/2123094701 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f139001a070 con 0x7f13a00b5fa0 2024-09-21T03:21:48.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.374+0000 7f1387fff640 1 --2- 172.21.15.105:0/2123094701 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f138c078bc0 0x7f138c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:48.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.374+0000 7f1387fff640 1 -- 172.21.15.105:0/2123094701 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 4857+0+0 (secure 0 0 0) 0x7f1390099c50 con 0x7f13a00b5fa0 2024-09-21T03:21:48.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.374+0000 7f139effd640 1 --2- 172.21.15.105:0/2123094701 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f138c078bc0 0x7f138c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:48.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.375+0000 7f139effd640 1 --2- 172.21.15.105:0/2123094701 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f138c078bc0 0x7f138c07b0d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f13a00d3de0 tx=0x7f1394004ab0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:48.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.379+0000 7f1387fff640 1 -- 172.21.15.105:0/2123094701 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f139009f020 con 0x7f13a00b5fa0 2024-09-21T03:21:48.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.556+0000 7f13a5a0e640 1 -- 172.21.15.105:0/2123094701 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f13a00b3710 con 0x7f13a00b5fa0 2024-09-21T03:21:48.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.556+0000 7f1387fff640 1 -- 172.21.15.105:0/2123094701 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v76) ==== 84+0+65 (secure 0 0 0) 0x7f13a01f9b00 con 0x7f13a00b5fa0 2024-09-21T03:21:48.558 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:48.558 INFO:teuthology.orchestra.run.smithi105.stdout:[ 2024-09-21T03:21:48.558 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:21:48.558 INFO:teuthology.orchestra.run.smithi105.stdout: "poolnum": 1, 2024-09-21T03:21:48.558 INFO:teuthology.orchestra.run.smithi105.stdout: "poolname": ".mgr" 2024-09-21T03:21:48.558 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:21:48.558 INFO:teuthology.orchestra.run.smithi105.stdout:] 2024-09-21T03:21:48.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.558+0000 7f13a5a0e640 1 -- 172.21.15.105:0/2123094701 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f138c078bc0 msgr2=0x7f138c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:48.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.558+0000 7f13a5a0e640 1 --2- 172.21.15.105:0/2123094701 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f138c078bc0 0x7f138c07b0d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f13a00d3de0 tx=0x7f1394004ab0 comp rx=0 tx=0).stop 2024-09-21T03:21:48.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.558+0000 7f13a5a0e640 1 -- 172.21.15.105:0/2123094701 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13a00b5fa0 msgr2=0x7f13a015ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:48.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.558+0000 7f13a5a0e640 1 --2- 172.21.15.105:0/2123094701 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13a00b5fa0 0x7f13a015ba10 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f139000c3c0 tx=0x7f139000c880 comp rx=0 tx=0).stop 2024-09-21T03:21:48.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.558+0000 7f13a5a0e640 1 -- 172.21.15.105:0/2123094701 shutdown_connections 2024-09-21T03:21:48.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.558+0000 7f13a5a0e640 1 --2- 172.21.15.105:0/2123094701 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f138c078bc0 0x7f138c07b0d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:48.561 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.558+0000 7f13a5a0e640 1 --2- 172.21.15.105:0/2123094701 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13a00b9970 0x7f13a015c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:48.561 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.558+0000 7f13a5a0e640 1 --2- 172.21.15.105:0/2123094701 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13a00b5fa0 0x7f13a015ba10 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:48.561 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.558+0000 7f13a5a0e640 1 --2- 172.21.15.105:0/2123094701 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13a006e0e0 0x7f13a01f95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:48.561 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.558+0000 7f13a5a0e640 1 -- 172.21.15.105:0/2123094701 >> 172.21.15.105:0/2123094701 conn(0x7f13a009d7f0 msgr2=0x7f13a015ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:48.561 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.558+0000 7f13a5a0e640 1 -- 172.21.15.105:0/2123094701 shutdown_connections 2024-09-21T03:21:48.561 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.558+0000 7f13a5a0e640 1 -- 172.21.15.105:0/2123094701 wait complete. 2024-09-21T03:21:48.571 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T03:21:48.571 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T03:21:48.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.687+0000 7f906156e640 1 -- 172.21.15.105:0/202555483 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f905c0b96c0 msgr2=0x7f905c0d23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:48.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.687+0000 7f906156e640 1 --2- 172.21.15.105:0/202555483 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f905c0b96c0 0x7f905c0d23f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f905c09dfb0 tx=0x7f905402a9e0 comp rx=0 tx=0).stop 2024-09-21T03:21:48.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.687+0000 7f906156e640 1 -- 172.21.15.105:0/202555483 shutdown_connections 2024-09-21T03:21:48.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.687+0000 7f906156e640 1 --2- 172.21.15.105:0/202555483 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f905c0b96c0 0x7f905c0d23f0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:48.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.687+0000 7f906156e640 1 --2- 172.21.15.105:0/202555483 >> v2:172.21.15.162:3300/0 conn(0x7f905c0cfa70 0x7f905c06e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:48.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.687+0000 7f906156e640 1 -- 172.21.15.105:0/202555483 >> 172.21.15.105:0/202555483 conn(0x7f905c09d8a0 msgr2=0x7f905c08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:48.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.687+0000 7f906156e640 1 -- 172.21.15.105:0/202555483 shutdown_connections 2024-09-21T03:21:48.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.687+0000 7f906156e640 1 -- 172.21.15.105:0/202555483 wait complete. 2024-09-21T03:21:48.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.689+0000 7f906156e640 1 Processor -- start 2024-09-21T03:21:48.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.689+0000 7f906156e640 1 -- start start 2024-09-21T03:21:48.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.690+0000 7f906156e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f905c0b96c0 0x7f905c0b6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:48.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.690+0000 7f906156e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f905c0d18f0 0x7f905c0c9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:48.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.690+0000 7f906156e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f905c0b6840 0x7f905c1f8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:48.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.690+0000 7f906156e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f905c0d2db0 con 0x7f905c0b6840 2024-09-21T03:21:48.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.690+0000 7f906156e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f905c0d2c30 con 0x7f905c0d18f0 2024-09-21T03:21:48.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.690+0000 7f906156e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f905c0d2f30 con 0x7f905c0b96c0 2024-09-21T03:21:48.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.690+0000 7f905b7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f905c0b6840 0x7f905c1f8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:48.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.690+0000 7f905b7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f905c0b6840 0x7f905c1f8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51904/0 (socket says 172.21.15.105:51904) 2024-09-21T03:21:48.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.690+0000 7f905b7fe640 1 -- 172.21.15.105:0/2660689835 learned_addr learned my addr 172.21.15.105:0/2660689835 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:48.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.690+0000 7f905a7fc640 1 --2- 172.21.15.105:0/2660689835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f905c0d18f0 0x7f905c0c9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:48.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.690+0000 7f905affd640 1 --2- 172.21.15.105:0/2660689835 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f905c0b96c0 0x7f905c0b6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:48.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.691+0000 7f905b7fe640 1 -- 172.21.15.105:0/2660689835 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f905c0b96c0 msgr2=0x7f905c0b6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:48.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.691+0000 7f905b7fe640 1 --2- 172.21.15.105:0/2660689835 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f905c0b96c0 0x7f905c0b6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:48.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.691+0000 7f905b7fe640 1 -- 172.21.15.105:0/2660689835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f905c0d18f0 msgr2=0x7f905c0c9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:48.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.691+0000 7f905b7fe640 1 --2- 172.21.15.105:0/2660689835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f905c0d18f0 0x7f905c0c9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:48.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.691+0000 7f905b7fe640 1 -- 172.21.15.105:0/2660689835 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f905c1f5820 con 0x7f905c0b6840 2024-09-21T03:21:48.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.691+0000 7f905b7fe640 1 --2- 172.21.15.105:0/2660689835 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f905c0b6840 0x7f905c1f8d80 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f905402afd0 tx=0x7f9054003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:48.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.691+0000 7f90437fe640 1 -- 172.21.15.105:0/2660689835 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9054033050 con 0x7f905c0b6840 2024-09-21T03:21:48.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.691+0000 7f90437fe640 1 -- 172.21.15.105:0/2660689835 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9054004450 con 0x7f905c0b6840 2024-09-21T03:21:48.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.691+0000 7f906156e640 1 -- 172.21.15.105:0/2660689835 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f905c1f5b00 con 0x7f905c0b6840 2024-09-21T03:21:48.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.691+0000 7f90437fe640 1 -- 172.21.15.105:0/2660689835 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9054038450 con 0x7f905c0b6840 2024-09-21T03:21:48.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.691+0000 7f906156e640 1 -- 172.21.15.105:0/2660689835 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f905c1f60c0 con 0x7f905c0b6840 2024-09-21T03:21:48.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.692+0000 7f906156e640 1 -- 172.21.15.105:0/2660689835 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f905c0d23f0 con 0x7f905c0b6840 2024-09-21T03:21:48.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.693+0000 7f90437fe640 1 -- 172.21.15.105:0/2660689835 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9054036070 con 0x7f905c0b6840 2024-09-21T03:21:48.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.693+0000 7f90437fe640 1 --2- 172.21.15.105:0/2660689835 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9048078b90 0x7f904807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:48.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.693+0000 7f90437fe640 1 -- 172.21.15.105:0/2660689835 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 4857+0+0 (secure 0 0 0) 0x7f90540bbe90 con 0x7f905c0b6840 2024-09-21T03:21:48.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.694+0000 7f905affd640 1 --2- 172.21.15.105:0/2660689835 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9048078b90 0x7f904807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:48.696 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.694+0000 7f905affd640 1 --2- 172.21.15.105:0/2660689835 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9048078b90 0x7f904807b0a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f904c006fd0 tx=0x7f904c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:48.699 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.698+0000 7f90437fe640 1 -- 172.21.15.105:0/2660689835 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f90540846b0 con 0x7f905c0b6840 2024-09-21T03:21:48.880 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:48.878+0000 7f906156e640 1 -- 172.21.15.105:0/2660689835 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f905c0b2d00 con 0x7f905c0b6840 2024-09-21T03:21:49.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:49.864+0000 7f90437fe640 1 -- 172.21.15.105:0/2660689835 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v77) ==== 138+0+0 (secure 0 0 0) 0x7f9054083fb0 con 0x7f905c0b6840 2024-09-21T03:21:49.866 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_metadata' created 2024-09-21T03:21:49.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:49.867+0000 7f906156e640 1 -- 172.21.15.105:0/2660689835 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9048078b90 msgr2=0x7f904807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:49.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:49.867+0000 7f906156e640 1 --2- 172.21.15.105:0/2660689835 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9048078b90 0x7f904807b0a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f904c006fd0 tx=0x7f904c008040 comp rx=0 tx=0).stop 2024-09-21T03:21:49.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:49.867+0000 7f906156e640 1 -- 172.21.15.105:0/2660689835 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f905c0b6840 msgr2=0x7f905c1f8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:49.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:49.867+0000 7f906156e640 1 --2- 172.21.15.105:0/2660689835 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f905c0b6840 0x7f905c1f8d80 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f905402afd0 tx=0x7f9054003f90 comp rx=0 tx=0).stop 2024-09-21T03:21:49.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:49.867+0000 7f906156e640 1 -- 172.21.15.105:0/2660689835 shutdown_connections 2024-09-21T03:21:49.870 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:49.867+0000 7f906156e640 1 --2- 172.21.15.105:0/2660689835 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9048078b90 0x7f904807b0a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:49.870 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:49.867+0000 7f906156e640 1 --2- 172.21.15.105:0/2660689835 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f905c0b6840 0x7f905c1f8d80 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:49.870 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:49.867+0000 7f906156e640 1 --2- 172.21.15.105:0/2660689835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f905c0d18f0 0x7f905c0c9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:49.870 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:49.867+0000 7f906156e640 1 --2- 172.21.15.105:0/2660689835 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f905c0b96c0 0x7f905c0b6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:49.870 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:49.867+0000 7f906156e640 1 -- 172.21.15.105:0/2660689835 >> 172.21.15.105:0/2660689835 conn(0x7f905c09d8a0 msgr2=0x7f905c0cf150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:49.870 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:49.867+0000 7f906156e640 1 -- 172.21.15.105:0/2660689835 shutdown_connections 2024-09-21T03:21:49.870 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:49.868+0000 7f906156e640 1 -- 172.21.15.105:0/2660689835 wait complete. 2024-09-21T03:21:49.887 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T03:21:50.013 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.011+0000 7f5033486640 1 -- 172.21.15.105:0/729927199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f502c0cd360 msgr2=0x7f502c15c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:50.013 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.011+0000 7f5033486640 1 --2- 172.21.15.105:0/729927199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f502c0cd360 0x7f502c15c6a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5028009830 tx=0x7f502802a4b0 comp rx=0 tx=0).stop 2024-09-21T03:21:50.014 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.011+0000 7f5033486640 1 -- 172.21.15.105:0/729927199 shutdown_connections 2024-09-21T03:21:50.014 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.011+0000 7f5033486640 1 --2- 172.21.15.105:0/729927199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f502c0cd360 0x7f502c15c6a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:50.014 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.011+0000 7f5033486640 1 -- 172.21.15.105:0/729927199 >> 172.21.15.105:0/729927199 conn(0x7f502c0710b0 msgr2=0x7f502c0714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:50.014 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.012+0000 7f5033486640 1 -- 172.21.15.105:0/729927199 shutdown_connections 2024-09-21T03:21:50.014 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.012+0000 7f5033486640 1 -- 172.21.15.105:0/729927199 wait complete. 2024-09-21T03:21:50.015 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.013+0000 7f5033486640 1 Processor -- start 2024-09-21T03:21:50.015 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.013+0000 7f5033486640 1 -- start start 2024-09-21T03:21:50.017 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.015+0000 7f5033486640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f502c0b7fe0 0x7f502c147c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:50.017 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.015+0000 7f5033486640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f502c0cd360 0x7f502c15cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:50.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.015+0000 7f5033486640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f502c1f4130 0x7f502c0b6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:50.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.015+0000 7f5033486640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f502c0d0dd0 con 0x7f502c1f4130 2024-09-21T03:21:50.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.015+0000 7f5033486640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f502c0d0c50 con 0x7f502c0cd360 2024-09-21T03:21:50.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.015+0000 7f5033486640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f502c0d0f50 con 0x7f502c0b7fe0 2024-09-21T03:21:50.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.015+0000 7f5031a23640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f502c1f4130 0x7f502c0b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:50.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.015+0000 7f5031a23640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f502c1f4130 0x7f502c0b6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51918/0 (socket says 172.21.15.105:51918) 2024-09-21T03:21:50.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.015+0000 7f5031a23640 1 -- 172.21.15.105:0/2244621431 learned_addr learned my addr 172.21.15.105:0/2244621431 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:50.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.015+0000 7f5031222640 1 --2- 172.21.15.105:0/2244621431 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f502c0b7fe0 0x7f502c147c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:50.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.015+0000 7f5030a21640 1 --2- 172.21.15.105:0/2244621431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f502c0cd360 0x7f502c15cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:50.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.015+0000 7f5031a23640 1 -- 172.21.15.105:0/2244621431 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f502c0b7fe0 msgr2=0x7f502c147c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:50.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.015+0000 7f5031a23640 1 --2- 172.21.15.105:0/2244621431 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f502c0b7fe0 0x7f502c147c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:50.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.015+0000 7f5031a23640 1 -- 172.21.15.105:0/2244621431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f502c0cd360 msgr2=0x7f502c15cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:50.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.015+0000 7f5031a23640 1 --2- 172.21.15.105:0/2244621431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f502c0cd360 0x7f502c15cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:50.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.015+0000 7f5031a23640 1 -- 172.21.15.105:0/2244621431 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f502c15ae40 con 0x7f502c1f4130 2024-09-21T03:21:50.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.015+0000 7f5031a23640 1 --2- 172.21.15.105:0/2244621431 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f502c1f4130 0x7f502c0b6390 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f50240015a0 tx=0x7f502400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:50.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.015+0000 7f5021ffb640 1 -- 172.21.15.105:0/2244621431 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5024016020 con 0x7f502c1f4130 2024-09-21T03:21:50.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.015+0000 7f5021ffb640 1 -- 172.21.15.105:0/2244621431 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f502400ae20 con 0x7f502c1f4130 2024-09-21T03:21:50.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.015+0000 7f5033486640 1 -- 172.21.15.105:0/2244621431 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f502c15a080 con 0x7f502c1f4130 2024-09-21T03:21:50.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.015+0000 7f5021ffb640 1 -- 172.21.15.105:0/2244621431 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5024012660 con 0x7f502c1f4130 2024-09-21T03:21:50.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.016+0000 7f5033486640 1 -- 172.21.15.105:0/2244621431 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f502c15a640 con 0x7f502c1f4130 2024-09-21T03:21:50.020 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.016+0000 7f5033486640 1 -- 172.21.15.105:0/2244621431 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f502c15c6a0 con 0x7f502c1f4130 2024-09-21T03:21:50.020 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.017+0000 7f5021ffb640 1 -- 172.21.15.105:0/2244621431 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5024019020 con 0x7f502c1f4130 2024-09-21T03:21:50.020 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.018+0000 7f5021ffb640 1 --2- 172.21.15.105:0/2244621431 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5010078b90 0x7f501007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:50.020 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.018+0000 7f5021ffb640 1 -- 172.21.15.105:0/2244621431 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5227+0+0 (secure 0 0 0) 0x7f502409b110 con 0x7f502c1f4130 2024-09-21T03:21:50.020 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.018+0000 7f5031222640 1 --2- 172.21.15.105:0/2244621431 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5010078b90 0x7f501007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:50.020 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.018+0000 7f5031222640 1 --2- 172.21.15.105:0/2244621431 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5010078b90 0x7f501007b0a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5028034000 tx=0x7f5028004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:50.024 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.022+0000 7f5021ffb640 1 -- 172.21.15.105:0/2244621431 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5024020020 con 0x7f502c1f4130 2024-09-21T03:21:50.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.202+0000 7f5033486640 1 -- 172.21.15.105:0/2244621431 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f502c073560 con 0x7f502c1f4130 2024-09-21T03:21:50.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.867+0000 7f5021ffb640 1 -- 172.21.15.105:0/2244621431 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v78) ==== 170+0+0 (secure 0 0 0) 0x7f5024063170 con 0x7f502c1f4130 2024-09-21T03:21:50.869 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_data' created 2024-09-21T03:21:50.872 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.870+0000 7f5033486640 1 -- 172.21.15.105:0/2244621431 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5010078b90 msgr2=0x7f501007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:50.872 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.870+0000 7f5033486640 1 --2- 172.21.15.105:0/2244621431 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5010078b90 0x7f501007b0a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5028034000 tx=0x7f5028004730 comp rx=0 tx=0).stop 2024-09-21T03:21:50.872 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.870+0000 7f5033486640 1 -- 172.21.15.105:0/2244621431 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f502c1f4130 msgr2=0x7f502c0b6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:50.872 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.870+0000 7f5033486640 1 --2- 172.21.15.105:0/2244621431 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f502c1f4130 0x7f502c0b6390 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f50240015a0 tx=0x7f502400a430 comp rx=0 tx=0).stop 2024-09-21T03:21:50.872 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.870+0000 7f5033486640 1 -- 172.21.15.105:0/2244621431 shutdown_connections 2024-09-21T03:21:50.872 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.870+0000 7f5033486640 1 --2- 172.21.15.105:0/2244621431 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5010078b90 0x7f501007b0a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:50.872 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.870+0000 7f5033486640 1 --2- 172.21.15.105:0/2244621431 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f502c1f4130 0x7f502c0b6390 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:50.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.870+0000 7f5033486640 1 --2- 172.21.15.105:0/2244621431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f502c0cd360 0x7f502c15cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:50.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.870+0000 7f5033486640 1 --2- 172.21.15.105:0/2244621431 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f502c0b7fe0 0x7f502c147c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:50.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.870+0000 7f5033486640 1 -- 172.21.15.105:0/2244621431 >> 172.21.15.105:0/2244621431 conn(0x7f502c0710b0 msgr2=0x7f502c0b24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:50.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.870+0000 7f5033486640 1 -- 172.21.15.105:0/2244621431 shutdown_connections 2024-09-21T03:21:50.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:50.870+0000 7f5033486640 1 -- 172.21.15.105:0/2244621431 wait complete. 2024-09-21T03:21:50.900 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T03:21:51.017 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.015+0000 7f1fe4a30640 1 -- 172.21.15.105:0/3746328680 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fcc003fe0 msgr2=0x7f1fcc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:51.017 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.015+0000 7f1fe4a30640 1 --2- 172.21.15.105:0/3746328680 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fcc003fe0 0x7f1fcc004800 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8009b50 tx=0x7f1fcc005830 comp rx=0 tx=0).stop 2024-09-21T03:21:51.017 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.015+0000 7f1fded9d640 1 -- 172.21.15.105:0/3746328680 reap_dead start 2024-09-21T03:21:51.017 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.015+0000 7f1fe4a30640 1 -- 172.21.15.105:0/3746328680 shutdown_connections 2024-09-21T03:21:51.017 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.015+0000 7f1fe4a30640 1 -- 172.21.15.105:0/3746328680 >> 172.21.15.105:0/3746328680 conn(0x7f1fe00cdcb0 msgr2=0x7f1fe00ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:51.017 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.015+0000 7f1fe4a30640 1 -- 172.21.15.105:0/3746328680 shutdown_connections 2024-09-21T03:21:51.017 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.015+0000 7f1fe4a30640 1 -- 172.21.15.105:0/3746328680 wait complete. 2024-09-21T03:21:51.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.017+0000 7f1fe4a30640 1 Processor -- start 2024-09-21T03:21:51.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.017+0000 7f1fe4a30640 1 -- start start 2024-09-21T03:21:51.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.018+0000 7f1fe4a30640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fcc003fe0 0x7f1fe014f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:51.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.018+0000 7f1fe4a30640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fe00c9a80 0x7f1fe00c52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:51.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.018+0000 7f1fe4a30640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fe009dc90 0x7f1fe009e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:51.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.018+0000 7f1fe4a30640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe00adfa0 con 0x7f1fe009dc90 2024-09-21T03:21:51.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.018+0000 7f1fe4a30640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe0071c90 con 0x7f1fe00c9a80 2024-09-21T03:21:51.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.018+0000 7f1fe4a30640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1fe00ae120 con 0x7f1fcc003fe0 2024-09-21T03:21:51.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.018+0000 7f1fded9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fe009dc90 0x7f1fe009e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:51.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.018+0000 7f1fded9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fe009dc90 0x7f1fe009e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51930/0 (socket says 172.21.15.105:51930) 2024-09-21T03:21:51.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.018+0000 7f1fded9d640 1 -- 172.21.15.105:0/2170367843 learned_addr learned my addr 172.21.15.105:0/2170367843 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:51.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.018+0000 7f1fde59c640 1 --2- 172.21.15.105:0/2170367843 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fcc003fe0 0x7f1fe014f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:51.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.018+0000 7f1fddd9b640 1 --2- 172.21.15.105:0/2170367843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fe00c9a80 0x7f1fe00c52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:51.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.018+0000 7f1fded9d640 1 -- 172.21.15.105:0/2170367843 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fcc003fe0 msgr2=0x7f1fe014f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:51.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.018+0000 7f1fded9d640 1 --2- 172.21.15.105:0/2170367843 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fcc003fe0 0x7f1fe014f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:51.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.018+0000 7f1fded9d640 1 -- 172.21.15.105:0/2170367843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fe00c9a80 msgr2=0x7f1fe00c52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:51.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.018+0000 7f1fded9d640 1 --2- 172.21.15.105:0/2170367843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fe00c9a80 0x7f1fe00c52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:51.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.018+0000 7f1fded9d640 1 -- 172.21.15.105:0/2170367843 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fe014f920 con 0x7f1fe009dc90 2024-09-21T03:21:51.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.019+0000 7f1fded9d640 1 --2- 172.21.15.105:0/2170367843 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fe009dc90 0x7f1fe009e0a0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0073d10 tx=0x7f1fd80039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:51.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.019+0000 7f1fd6ffd640 1 -- 172.21.15.105:0/2170367843 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8011840 con 0x7f1fe009dc90 2024-09-21T03:21:51.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.019+0000 7f1fd6ffd640 1 -- 172.21.15.105:0/2170367843 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1fd8018070 con 0x7f1fe009dc90 2024-09-21T03:21:51.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.019+0000 7f1fe4a30640 1 -- 172.21.15.105:0/2170367843 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fe009e5e0 con 0x7f1fe009dc90 2024-09-21T03:21:51.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.019+0000 7f1fd6ffd640 1 -- 172.21.15.105:0/2170367843 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8011ca0 con 0x7f1fe009dc90 2024-09-21T03:21:51.023 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.019+0000 7f1fe4a30640 1 -- 172.21.15.105:0/2170367843 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fe01f70e0 con 0x7f1fe009dc90 2024-09-21T03:21:51.023 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.020+0000 7f1fe4a30640 1 -- 172.21.15.105:0/2170367843 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fe00ae680 con 0x7f1fe009dc90 2024-09-21T03:21:51.023 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.021+0000 7f1fd6ffd640 1 -- 172.21.15.105:0/2170367843 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1fd8027430 con 0x7f1fe009dc90 2024-09-21T03:21:51.024 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.021+0000 7f1fd6ffd640 1 --2- 172.21.15.105:0/2170367843 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1fc0078b90 0x7f1fc007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:51.024 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.021+0000 7f1fd6ffd640 1 -- 172.21.15.105:0/2170367843 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5609+0+0 (secure 0 0 0) 0x7f1fd809bc70 con 0x7f1fe009dc90 2024-09-21T03:21:51.024 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.021+0000 7f1fde59c640 1 --2- 172.21.15.105:0/2170367843 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1fc0078b90 0x7f1fc007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:51.024 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.022+0000 7f1fde59c640 1 --2- 172.21.15.105:0/2170367843 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1fc0078b90 0x7f1fc007b0a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0000f80 tx=0x7f1fd0006e30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:51.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.025+0000 7f1fd6ffd640 1 -- 172.21.15.105:0/2170367843 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1fe009e5e0 con 0x7f1fe009dc90 2024-09-21T03:21:51.239 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.237+0000 7f1fe4a30640 1 -- 172.21.15.105:0/2170367843 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f1fe01f6b90 con 0x7f1fe009dc90 2024-09-21T03:21:51.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.889+0000 7f1fd6ffd640 1 -- 172.21.15.105:0/2170367843 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v43) ==== 174+0+0 (secure 0 0 0) 0x7f1fe014f920 con 0x7f1fe009dc90 2024-09-21T03:21:51.893 INFO:teuthology.orchestra.run.smithi105.stderr:new fs with metadata pool 12 and data pool 13 2024-09-21T03:21:51.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.898+0000 7f1fe4a30640 1 -- 172.21.15.105:0/2170367843 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1fc0078b90 msgr2=0x7f1fc007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:51.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.898+0000 7f1fe4a30640 1 --2- 172.21.15.105:0/2170367843 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1fc0078b90 0x7f1fc007b0a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0000f80 tx=0x7f1fd0006e30 comp rx=0 tx=0).stop 2024-09-21T03:21:51.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.898+0000 7f1fe4a30640 1 -- 172.21.15.105:0/2170367843 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fe009dc90 msgr2=0x7f1fe009e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:51.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.898+0000 7f1fe4a30640 1 --2- 172.21.15.105:0/2170367843 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fe009dc90 0x7f1fe009e0a0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0073d10 tx=0x7f1fd80039c0 comp rx=0 tx=0).stop 2024-09-21T03:21:51.902 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.900+0000 7f1fe4a30640 1 -- 172.21.15.105:0/2170367843 shutdown_connections 2024-09-21T03:21:51.902 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.900+0000 7f1fe4a30640 1 --2- 172.21.15.105:0/2170367843 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1fc0078b90 0x7f1fc007b0a0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:51.902 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.900+0000 7f1fe4a30640 1 --2- 172.21.15.105:0/2170367843 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fe009dc90 0x7f1fe009e0a0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:51.902 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.900+0000 7f1fe4a30640 1 --2- 172.21.15.105:0/2170367843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fe00c9a80 0x7f1fe00c52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:51.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.900+0000 7f1fe4a30640 1 --2- 172.21.15.105:0/2170367843 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fcc003fe0 0x7f1fe014f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:51.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.900+0000 7f1fe4a30640 1 -- 172.21.15.105:0/2170367843 >> 172.21.15.105:0/2170367843 conn(0x7f1fe00cdcb0 msgr2=0x7f1fe00ae890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:51.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.901+0000 7f1fe4a30640 1 -- 172.21.15.105:0/2170367843 shutdown_connections 2024-09-21T03:21:51.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:51.901+0000 7f1fe4a30640 1 -- 172.21.15.105:0/2170367843 wait complete. 2024-09-21T03:21:51.926 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:21:52.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.036+0000 7f28bb28c640 1 -- 172.21.15.105:0/1175874144 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28a0005250 msgr2=0x7f28a000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:52.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.036+0000 7f28bb28c640 1 --2- 172.21.15.105:0/1175874144 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28a0005250 0x7f28a000b9c0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f28ac005fd0 tx=0x7f28a0005830 comp rx=0 tx=0).stop 2024-09-21T03:21:52.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.036+0000 7f28bb28c640 1 -- 172.21.15.105:0/1175874144 shutdown_connections 2024-09-21T03:21:52.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.037+0000 7f28bb28c640 1 --2- 172.21.15.105:0/1175874144 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28a0005250 0x7f28a000b9c0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:52.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.037+0000 7f28bb28c640 1 -- 172.21.15.105:0/1175874144 >> 172.21.15.105:0/1175874144 conn(0x7f28b40d15f0 msgr2=0x7f28b4073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:52.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.037+0000 7f28bb28c640 1 -- 172.21.15.105:0/1175874144 shutdown_connections 2024-09-21T03:21:52.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.037+0000 7f28bb28c640 1 -- 172.21.15.105:0/1175874144 wait complete. 2024-09-21T03:21:52.040 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.038+0000 7f28bb28c640 1 Processor -- start 2024-09-21T03:21:52.040 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.038+0000 7f28bb28c640 1 -- start start 2024-09-21T03:21:52.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.040+0000 7f28bb28c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28a0005250 0x7f28b41f8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:52.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.040+0000 7f28bb28c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28b415bc40 0x7f28b41f8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:52.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.040+0000 7f28bb28c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28b40b3b60 0x7f28b40b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:52.043 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.040+0000 7f28bb28c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f28b40b5680 con 0x7f28a0005250 2024-09-21T03:21:52.043 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.040+0000 7f28bb28c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f28b4142890 con 0x7f28b40b3b60 2024-09-21T03:21:52.043 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.040+0000 7f28bb28c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f28b40b5800 con 0x7f28b415bc40 2024-09-21T03:21:52.043 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.040+0000 7f28b9028640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28a0005250 0x7f28b41f8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:52.043 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.040+0000 7f28b9028640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28a0005250 0x7f28b41f8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:45186/0 (socket says 172.21.15.105:45186) 2024-09-21T03:21:52.043 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.040+0000 7f28b9028640 1 -- 172.21.15.105:0/4089446592 learned_addr learned my addr 172.21.15.105:0/4089446592 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:52.043 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.040+0000 7f28b9829640 1 --2- 172.21.15.105:0/4089446592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28b40b3b60 0x7f28b40b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:52.043 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.040+0000 7f28b8827640 1 --2- 172.21.15.105:0/4089446592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28b415bc40 0x7f28b41f8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:52.043 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.040+0000 7f28b9028640 1 -- 172.21.15.105:0/4089446592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28b415bc40 msgr2=0x7f28b41f8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:52.043 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.040+0000 7f28b9028640 1 --2- 172.21.15.105:0/4089446592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28b415bc40 0x7f28b41f8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:52.043 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.040+0000 7f28b9028640 1 -- 172.21.15.105:0/4089446592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28b40b3b60 msgr2=0x7f28b40b3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:52.043 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.040+0000 7f28b9028640 1 --2- 172.21.15.105:0/4089446592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28b40b3b60 0x7f28b40b3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:52.043 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.040+0000 7f28b9028640 1 -- 172.21.15.105:0/4089446592 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28b40cba70 con 0x7f28a0005250 2024-09-21T03:21:52.044 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.040+0000 7f28b9028640 1 --2- 172.21.15.105:0/4089446592 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28a0005250 0x7f28b41f8350 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f28b0003f00 tx=0x7f28b0001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:52.044 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.040+0000 7f28a9ffb640 1 -- 172.21.15.105:0/4089446592 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b0015070 con 0x7f28a0005250 2024-09-21T03:21:52.044 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.040+0000 7f28a9ffb640 1 -- 172.21.15.105:0/4089446592 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f28b0011840 con 0x7f28a0005250 2024-09-21T03:21:52.044 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.040+0000 7f28bb28c640 1 -- 172.21.15.105:0/4089446592 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28b40b44b0 con 0x7f28a0005250 2024-09-21T03:21:52.044 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.040+0000 7f28a9ffb640 1 -- 172.21.15.105:0/4089446592 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b0011c90 con 0x7f28a0005250 2024-09-21T03:21:52.044 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.041+0000 7f28bb28c640 1 -- 172.21.15.105:0/4089446592 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28b41f56f0 con 0x7f28a0005250 2024-09-21T03:21:52.045 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.042+0000 7f28bb28c640 1 -- 172.21.15.105:0/4089446592 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28b4073e50 con 0x7f28a0005250 2024-09-21T03:21:52.045 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.042+0000 7f28a9ffb640 1 -- 172.21.15.105:0/4089446592 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f28b0018070 con 0x7f28a0005250 2024-09-21T03:21:52.045 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.043+0000 7f28a9ffb640 1 --2- 172.21.15.105:0/4089446592 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2898078b90 0x7f289807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:52.045 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.043+0000 7f28a9ffb640 1 -- 172.21.15.105:0/4089446592 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5709+0+0 (secure 0 0 0) 0x7f28b009b9a0 con 0x7f28a0005250 2024-09-21T03:21:52.045 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.043+0000 7f28b8827640 1 --2- 172.21.15.105:0/4089446592 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2898078b90 0x7f289807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:52.045 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.043+0000 7f28b8827640 1 --2- 172.21.15.105:0/4089446592 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2898078b90 0x7f289807b0a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f28b415ec40 tx=0x7f28a40067a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:52.049 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.047+0000 7f28a9ffb640 1 -- 172.21.15.105:0/4089446592 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f28b40b44b0 con 0x7f28a0005250 2024-09-21T03:21:52.225 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.223+0000 7f28bb28c640 1 -- 172.21.15.105:0/4089446592 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f28b4069260 con 0x7f28a0005250 2024-09-21T03:21:52.226 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.225+0000 7f28a9ffb640 1 -- 172.21.15.105:0/4089446592 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+16805 (secure 0 0 0) 0x7f28b0063790 con 0x7f28a0005250 2024-09-21T03:21:52.226 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:52.227 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":79,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:21:51.239188+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:21:48.883188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-21T03:21:50.206885+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:21:52.228 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.227+0000 7f28bb28c640 1 -- 172.21.15.105:0/4089446592 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2898078b90 msgr2=0x7f289807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:52.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.227+0000 7f28bb28c640 1 --2- 172.21.15.105:0/4089446592 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2898078b90 0x7f289807b0a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f28b415ec40 tx=0x7f28a40067a0 comp rx=0 tx=0).stop 2024-09-21T03:21:52.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.227+0000 7f28bb28c640 1 -- 172.21.15.105:0/4089446592 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28a0005250 msgr2=0x7f28b41f8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:52.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.227+0000 7f28bb28c640 1 --2- 172.21.15.105:0/4089446592 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28a0005250 0x7f28b41f8350 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f28b0003f00 tx=0x7f28b0001630 comp rx=0 tx=0).stop 2024-09-21T03:21:52.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.227+0000 7f28bb28c640 1 -- 172.21.15.105:0/4089446592 shutdown_connections 2024-09-21T03:21:52.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.227+0000 7f28bb28c640 1 --2- 172.21.15.105:0/4089446592 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2898078b90 0x7f289807b0a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:52.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.227+0000 7f28bb28c640 1 --2- 172.21.15.105:0/4089446592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28b40b3b60 0x7f28b40b3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:52.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.227+0000 7f28bb28c640 1 --2- 172.21.15.105:0/4089446592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28b415bc40 0x7f28b41f8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:52.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.227+0000 7f28bb28c640 1 --2- 172.21.15.105:0/4089446592 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28a0005250 0x7f28b41f8350 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:52.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.227+0000 7f28bb28c640 1 -- 172.21.15.105:0/4089446592 >> 172.21.15.105:0/4089446592 conn(0x7f28b40d15f0 msgr2=0x7f28b4071270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:52.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.227+0000 7f28bb28c640 1 -- 172.21.15.105:0/4089446592 shutdown_connections 2024-09-21T03:21:52.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.227+0000 7f28bb28c640 1 -- 172.21.15.105:0/4089446592 wait complete. 2024-09-21T03:21:52.240 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:21:52.354 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.351+0000 7fd09f807640 1 -- 172.21.15.105:0/1908288907 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0980d2ed0 msgr2=0x7fd0980d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:52.354 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.351+0000 7fd09f807640 1 --2- 172.21.15.105:0/1908288907 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0980d2ed0 0x7fd0980d1a80 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fd0940098e0 tx=0x7fd09402a5d0 comp rx=0 tx=0).stop 2024-09-21T03:21:52.354 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.351+0000 7fd09f807640 1 -- 172.21.15.105:0/1908288907 shutdown_connections 2024-09-21T03:21:52.354 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.351+0000 7fd09f807640 1 --2- 172.21.15.105:0/1908288907 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0980cf7a0 0x7fd0981626e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:52.354 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.351+0000 7fd09f807640 1 --2- 172.21.15.105:0/1908288907 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0980d2ed0 0x7fd0980d1a80 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:52.354 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.351+0000 7fd09f807640 1 -- 172.21.15.105:0/1908288907 >> 172.21.15.105:0/1908288907 conn(0x7fd09808bfc0 msgr2=0x7fd09809d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:52.354 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.352+0000 7fd09f807640 1 -- 172.21.15.105:0/1908288907 shutdown_connections 2024-09-21T03:21:52.354 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.352+0000 7fd09f807640 1 -- 172.21.15.105:0/1908288907 wait complete. 2024-09-21T03:21:52.355 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.353+0000 7fd09f807640 1 Processor -- start 2024-09-21T03:21:52.355 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.353+0000 7fd09f807640 1 -- start start 2024-09-21T03:21:52.357 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.355+0000 7fd09f807640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0980b9b70 0x7fd0980cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:52.357 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.355+0000 7fd09f807640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0980cf7a0 0x7fd0981f5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:52.357 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.355+0000 7fd09f807640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0980d2ed0 0x7fd098151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:52.357 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.355+0000 7fd09f807640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd098162da0 con 0x7fd0980d2ed0 2024-09-21T03:21:52.358 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.355+0000 7fd09f807640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd098162c20 con 0x7fd0980b9b70 2024-09-21T03:21:52.358 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.355+0000 7fd09f807640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd098162f20 con 0x7fd0980cf7a0 2024-09-21T03:21:52.358 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.355+0000 7fd09dda4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0980d2ed0 0x7fd098151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:52.358 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.355+0000 7fd09dda4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0980d2ed0 0x7fd098151580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:45214/0 (socket says 172.21.15.105:45214) 2024-09-21T03:21:52.358 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.355+0000 7fd09dda4640 1 -- 172.21.15.105:0/2369284908 learned_addr learned my addr 172.21.15.105:0/2369284908 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:52.358 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.355+0000 7fd09cda2640 1 --2- 172.21.15.105:0/2369284908 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0980cf7a0 0x7fd0981f5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:52.358 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.355+0000 7fd09d5a3640 1 --2- 172.21.15.105:0/2369284908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0980b9b70 0x7fd0980cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:52.358 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.355+0000 7fd09dda4640 1 -- 172.21.15.105:0/2369284908 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0980cf7a0 msgr2=0x7fd0981f5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:52.358 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.355+0000 7fd09dda4640 1 --2- 172.21.15.105:0/2369284908 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0980cf7a0 0x7fd0981f5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:52.358 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.355+0000 7fd09dda4640 1 -- 172.21.15.105:0/2369284908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0980b9b70 msgr2=0x7fd0980cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:52.359 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.355+0000 7fd09dda4640 1 --2- 172.21.15.105:0/2369284908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0980b9b70 0x7fd0980cb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:52.359 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.355+0000 7fd09dda4640 1 -- 172.21.15.105:0/2369284908 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd098161530 con 0x7fd0980d2ed0 2024-09-21T03:21:52.359 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.355+0000 7fd09dda4640 1 --2- 172.21.15.105:0/2369284908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0980d2ed0 0x7fd098151580 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fd09000cab0 tx=0x7fd09000cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:52.359 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.355+0000 7fd08dffb640 1 -- 172.21.15.105:0/2369284908 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd09000ae20 con 0x7fd0980d2ed0 2024-09-21T03:21:52.359 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.355+0000 7fd08dffb640 1 -- 172.21.15.105:0/2369284908 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd090003a60 con 0x7fd0980d2ed0 2024-09-21T03:21:52.359 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.355+0000 7fd09f807640 1 -- 172.21.15.105:0/2369284908 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0981f9e70 con 0x7fd0980d2ed0 2024-09-21T03:21:52.359 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.355+0000 7fd08dffb640 1 -- 172.21.15.105:0/2369284908 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd090004030 con 0x7fd0980d2ed0 2024-09-21T03:21:52.359 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.356+0000 7fd09f807640 1 -- 172.21.15.105:0/2369284908 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0980c91e0 con 0x7fd0980d2ed0 2024-09-21T03:21:52.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.357+0000 7fd09f807640 1 -- 172.21.15.105:0/2369284908 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0981634b0 con 0x7fd0980d2ed0 2024-09-21T03:21:52.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.357+0000 7fd08dffb640 1 -- 172.21.15.105:0/2369284908 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd0900041d0 con 0x7fd0980d2ed0 2024-09-21T03:21:52.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.358+0000 7fd08dffb640 1 --2- 172.21.15.105:0/2369284908 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd07c078b90 0x7fd07c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:52.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.358+0000 7fd08dffb640 1 -- 172.21.15.105:0/2369284908 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5709+0+0 (secure 0 0 0) 0x7fd09009b4a0 con 0x7fd0980d2ed0 2024-09-21T03:21:52.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.358+0000 7fd09d5a3640 1 --2- 172.21.15.105:0/2369284908 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd07c078b90 0x7fd07c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:52.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.359+0000 7fd09d5a3640 1 --2- 172.21.15.105:0/2369284908 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd07c078b90 0x7fd07c07b0a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd094034000 tx=0x7fd094004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:52.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.362+0000 7fd08dffb640 1 -- 172.21.15.105:0/2369284908 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd090014070 con 0x7fd0980d2ed0 2024-09-21T03:21:52.541 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.540+0000 7fd09f807640 1 -- 172.21.15.105:0/2369284908 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd0980b5780 con 0x7fd0980d2ed0 2024-09-21T03:21:52.542 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.541+0000 7fd08dffb640 1 -- 172.21.15.105:0/2369284908 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+16805 (secure 0 0 0) 0x7fd090063290 con 0x7fd0980d2ed0 2024-09-21T03:21:52.543 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:52.543 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":79,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:21:51.239188+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:21:48.883188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-21T03:21:50.206885+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:21:52.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.543+0000 7fd09f807640 1 -- 172.21.15.105:0/2369284908 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd07c078b90 msgr2=0x7fd07c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:52.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.543+0000 7fd09f807640 1 --2- 172.21.15.105:0/2369284908 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd07c078b90 0x7fd07c07b0a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd094034000 tx=0x7fd094004730 comp rx=0 tx=0).stop 2024-09-21T03:21:52.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.543+0000 7fd09f807640 1 -- 172.21.15.105:0/2369284908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0980d2ed0 msgr2=0x7fd098151580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:52.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.543+0000 7fd09f807640 1 --2- 172.21.15.105:0/2369284908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0980d2ed0 0x7fd098151580 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fd09000cab0 tx=0x7fd09000cf70 comp rx=0 tx=0).stop 2024-09-21T03:21:52.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.543+0000 7fd09f807640 1 -- 172.21.15.105:0/2369284908 shutdown_connections 2024-09-21T03:21:52.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.543+0000 7fd09f807640 1 --2- 172.21.15.105:0/2369284908 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd07c078b90 0x7fd07c07b0a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:52.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.543+0000 7fd09f807640 1 --2- 172.21.15.105:0/2369284908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0980d2ed0 0x7fd098151580 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:52.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.543+0000 7fd09f807640 1 --2- 172.21.15.105:0/2369284908 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd0980cf7a0 0x7fd0981f5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:52.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.543+0000 7fd09f807640 1 --2- 172.21.15.105:0/2369284908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0980b9b70 0x7fd0980cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:52.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.543+0000 7fd09f807640 1 -- 172.21.15.105:0/2369284908 >> 172.21.15.105:0/2369284908 conn(0x7fd09808bfc0 msgr2=0x7fd09806e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:52.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.543+0000 7fd09f807640 1 -- 172.21.15.105:0/2369284908 shutdown_connections 2024-09-21T03:21:52.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.543+0000 7fd09f807640 1 -- 172.21.15.105:0/2369284908 wait complete. 2024-09-21T03:21:52.556 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T03:21:52.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.670+0000 7fb1d45eb640 1 -- 172.21.15.105:0/3083141944 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1cc0cc1e0 msgr2=0x7fb1cc0af3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:52.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.670+0000 7fb1d45eb640 1 --2- 172.21.15.105:0/3083141944 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1cc0cc1e0 0x7fb1cc0af3c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8005fd0 tx=0x7fb1c802a5d0 comp rx=0 tx=0).stop 2024-09-21T03:21:52.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.670+0000 7fb1d45eb640 1 -- 172.21.15.105:0/3083141944 shutdown_connections 2024-09-21T03:21:52.673 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.670+0000 7fb1d45eb640 1 --2- 172.21.15.105:0/3083141944 >> v2:172.21.15.162:3300/0 conn(0x7fb1cc0ccb50 0x7fb1cc0ccf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:52.673 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.670+0000 7fb1d45eb640 1 --2- 172.21.15.105:0/3083141944 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1cc0cc1e0 0x7fb1cc0af3c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:52.673 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.670+0000 7fb1d45eb640 1 -- 172.21.15.105:0/3083141944 >> 172.21.15.105:0/3083141944 conn(0x7fb1cc06d7d0 msgr2=0x7fb1cc0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:52.673 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.670+0000 7fb1d45eb640 1 -- 172.21.15.105:0/3083141944 shutdown_connections 2024-09-21T03:21:52.673 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.670+0000 7fb1d45eb640 1 -- 172.21.15.105:0/3083141944 wait complete. 2024-09-21T03:21:52.674 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.672+0000 7fb1d45eb640 1 Processor -- start 2024-09-21T03:21:52.674 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.672+0000 7fb1d45eb640 1 -- start start 2024-09-21T03:21:52.676 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.673+0000 7fb1d45eb640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1cc0cc1e0 0x7fb1cc09bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:52.676 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.673+0000 7fb1d45eb640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1cc0ccb50 0x7fb1cc152350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:52.677 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.673+0000 7fb1d45eb640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1cc15d8a0 0x7fb1cc1556f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:52.677 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.673+0000 7fb1d45eb640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb1cc1533a0 con 0x7fb1cc15d8a0 2024-09-21T03:21:52.677 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.673+0000 7fb1d45eb640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb1cc15d400 con 0x7fb1cc0ccb50 2024-09-21T03:21:52.677 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.673+0000 7fb1d45eb640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb1cc153520 con 0x7fb1cc0cc1e0 2024-09-21T03:21:52.677 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.674+0000 7fb1d2b88640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1cc15d8a0 0x7fb1cc1556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:52.677 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.674+0000 7fb1d2387640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1cc0cc1e0 0x7fb1cc09bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:52.677 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.674+0000 7fb1d2387640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1cc0cc1e0 0x7fb1cc09bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.105:54994/0 (socket says 172.21.15.105:54994) 2024-09-21T03:21:52.677 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.674+0000 7fb1d2b88640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1cc15d8a0 0x7fb1cc1556f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:45220/0 (socket says 172.21.15.105:45220) 2024-09-21T03:21:52.677 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.674+0000 7fb1d2387640 1 -- 172.21.15.105:0/3034583102 learned_addr learned my addr 172.21.15.105:0/3034583102 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:52.677 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.674+0000 7fb1d1b86640 1 --2- 172.21.15.105:0/3034583102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1cc0ccb50 0x7fb1cc152350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:52.677 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.674+0000 7fb1d2b88640 1 -- 172.21.15.105:0/3034583102 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1cc0cc1e0 msgr2=0x7fb1cc09bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:52.677 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.674+0000 7fb1d2b88640 1 --2- 172.21.15.105:0/3034583102 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1cc0cc1e0 0x7fb1cc09bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:52.677 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.674+0000 7fb1d2b88640 1 -- 172.21.15.105:0/3034583102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1cc0ccb50 msgr2=0x7fb1cc152350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:52.678 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.674+0000 7fb1d2b88640 1 --2- 172.21.15.105:0/3034583102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1cc0ccb50 0x7fb1cc152350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:52.678 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.674+0000 7fb1d2b88640 1 -- 172.21.15.105:0/3034583102 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1cc1f7580 con 0x7fb1cc15d8a0 2024-09-21T03:21:52.678 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.674+0000 7fb1d2b88640 1 --2- 172.21.15.105:0/3034583102 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1cc15d8a0 0x7fb1cc1556f0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fb1c400e9b0 tx=0x7fb1c400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:52.678 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.674+0000 7fb1c2ffd640 1 -- 172.21.15.105:0/3034583102 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c4004d20 con 0x7fb1cc15d8a0 2024-09-21T03:21:52.678 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.674+0000 7fb1d45eb640 1 -- 172.21.15.105:0/3034583102 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1cc1f7860 con 0x7fb1cc15d8a0 2024-09-21T03:21:52.678 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.674+0000 7fb1c2ffd640 1 -- 172.21.15.105:0/3034583102 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1c400cb20 con 0x7fb1cc15d8a0 2024-09-21T03:21:52.678 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.674+0000 7fb1c2ffd640 1 -- 172.21.15.105:0/3034583102 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c4005020 con 0x7fb1cc15d8a0 2024-09-21T03:21:52.678 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.674+0000 7fb1d45eb640 1 -- 172.21.15.105:0/3034583102 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1cc1f7e20 con 0x7fb1cc15d8a0 2024-09-21T03:21:52.679 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.675+0000 7fb1d45eb640 1 -- 172.21.15.105:0/3034583102 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1cc09c2c0 con 0x7fb1cc15d8a0 2024-09-21T03:21:52.679 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.676+0000 7fb1c2ffd640 1 -- 172.21.15.105:0/3034583102 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb1c40051c0 con 0x7fb1cc15d8a0 2024-09-21T03:21:52.679 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.677+0000 7fb1c2ffd640 1 --2- 172.21.15.105:0/3034583102 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb1b0078b90 0x7fb1b007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:52.679 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.677+0000 7fb1c2ffd640 1 -- 172.21.15.105:0/3034583102 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5709+0+0 (secure 0 0 0) 0x7fb1c409b990 con 0x7fb1cc15d8a0 2024-09-21T03:21:52.679 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.677+0000 7fb1d2387640 1 --2- 172.21.15.105:0/3034583102 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb1b0078b90 0x7fb1b007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:52.679 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.677+0000 7fb1d2387640 1 --2- 172.21.15.105:0/3034583102 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb1b0078b90 0x7fb1b007b0a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8009230 tx=0x7fb1c8004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:52.683 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.681+0000 7fb1c2ffd640 1 -- 172.21.15.105:0/3034583102 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb1c4063700 con 0x7fb1cc15d8a0 2024-09-21T03:21:52.897 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:52.895+0000 7fb1d45eb640 1 -- 172.21.15.105:0/3034583102 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb1cc1f7310 con 0x7fb1cc15d8a0 2024-09-21T03:21:53.866 INFO:tasks.ceph.mds.a.smithi105.stderr:2024-09-21T03:21:53.864+0000 7fef7b17e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T03:21:53.901 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:53.900+0000 7fb1c2ffd640 1 -- 172.21.15.105:0/3034583102 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v46) ==== 118+0+0 (secure 0 0 0) 0x7fb1c4068130 con 0x7fb1cc15d8a0 2024-09-21T03:21:53.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:53.903+0000 7fb1d45eb640 1 -- 172.21.15.105:0/3034583102 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb1b0078b90 msgr2=0x7fb1b007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:53.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:53.903+0000 7fb1d45eb640 1 --2- 172.21.15.105:0/3034583102 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb1b0078b90 0x7fb1b007b0a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8009230 tx=0x7fb1c8004730 comp rx=0 tx=0).stop 2024-09-21T03:21:53.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:53.903+0000 7fb1d45eb640 1 -- 172.21.15.105:0/3034583102 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1cc15d8a0 msgr2=0x7fb1cc1556f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:53.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:53.903+0000 7fb1d45eb640 1 --2- 172.21.15.105:0/3034583102 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1cc15d8a0 0x7fb1cc1556f0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fb1c400e9b0 tx=0x7fb1c400ee70 comp rx=0 tx=0).stop 2024-09-21T03:21:53.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:53.903+0000 7fb1d45eb640 1 -- 172.21.15.105:0/3034583102 shutdown_connections 2024-09-21T03:21:53.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:53.903+0000 7fb1d45eb640 1 --2- 172.21.15.105:0/3034583102 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb1b0078b90 0x7fb1b007b0a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:53.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:53.903+0000 7fb1d45eb640 1 --2- 172.21.15.105:0/3034583102 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1cc15d8a0 0x7fb1cc1556f0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:53.906 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:53.903+0000 7fb1d45eb640 1 --2- 172.21.15.105:0/3034583102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1cc0ccb50 0x7fb1cc152350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:53.906 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:53.903+0000 7fb1d45eb640 1 --2- 172.21.15.105:0/3034583102 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1cc0cc1e0 0x7fb1cc09bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:53.906 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:53.903+0000 7fb1d45eb640 1 -- 172.21.15.105:0/3034583102 >> 172.21.15.105:0/3034583102 conn(0x7fb1cc06d7d0 msgr2=0x7fb1cc0cfe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:53.906 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:53.903+0000 7fb1d45eb640 1 -- 172.21.15.105:0/3034583102 shutdown_connections 2024-09-21T03:21:53.906 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:53.903+0000 7fb1d45eb640 1 -- 172.21.15.105:0/3034583102 wait complete. 2024-09-21T03:21:53.919 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T03:21:53.919 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T03:21:54.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.041+0000 7f73eb20a640 1 -- 172.21.15.105:0/4248965068 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73cc004d40 msgr2=0x7f73cc005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:54.043 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.041+0000 7f73eb20a640 1 --2- 172.21.15.105:0/4248965068 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73cc004d40 0x7f73cc005150 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f73e40cb830 tx=0x7f73cc005830 comp rx=0 tx=0).stop 2024-09-21T03:21:54.043 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.041+0000 7f73e97a7640 1 -- 172.21.15.105:0/4248965068 reap_dead start 2024-09-21T03:21:54.043 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.041+0000 7f73eb20a640 1 -- 172.21.15.105:0/4248965068 shutdown_connections 2024-09-21T03:21:54.043 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.041+0000 7f73eb20a640 1 -- 172.21.15.105:0/4248965068 >> 172.21.15.105:0/4248965068 conn(0x7f73e40cdcb0 msgr2=0x7f73e40ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:54.043 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.041+0000 7f73eb20a640 1 -- 172.21.15.105:0/4248965068 shutdown_connections 2024-09-21T03:21:54.043 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.041+0000 7f73eb20a640 1 -- 172.21.15.105:0/4248965068 wait complete. 2024-09-21T03:21:54.044 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.042+0000 7f73eb20a640 1 Processor -- start 2024-09-21T03:21:54.044 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.043+0000 7f73eb20a640 1 -- start start 2024-09-21T03:21:54.047 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.044+0000 7f73eb20a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73e41e4dc0 0x7f73e4148450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:54.047 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.044+0000 7f73eb20a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73e41e75a0 0x7f73e41e79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:54.047 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.044+0000 7f73eb20a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73e40b0c20 0x7f73e40b1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:54.047 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.044+0000 7f73eb20a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f73e40b3240 con 0x7f73e41e75a0 2024-09-21T03:21:54.047 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.044+0000 7f73eb20a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f73e40b30c0 con 0x7f73e41e4dc0 2024-09-21T03:21:54.047 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.044+0000 7f73eb20a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f73e40b33c0 con 0x7f73e40b0c20 2024-09-21T03:21:54.047 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.044+0000 7f73e3fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73e41e75a0 0x7f73e41e79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:54.047 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.044+0000 7f73e3fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73e41e75a0 0x7f73e41e79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:45244/0 (socket says 172.21.15.105:45244) 2024-09-21T03:21:54.047 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.044+0000 7f73e3fff640 1 -- 172.21.15.105:0/2435928071 learned_addr learned my addr 172.21.15.105:0/2435928071 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:54.048 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.044+0000 7f73e8fa6640 1 --2- 172.21.15.105:0/2435928071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73e41e4dc0 0x7f73e4148450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:54.048 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.044+0000 7f73e97a7640 1 --2- 172.21.15.105:0/2435928071 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73e40b0c20 0x7f73e40b1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:54.048 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.044+0000 7f73e3fff640 1 -- 172.21.15.105:0/2435928071 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73e40b0c20 msgr2=0x7f73e40b1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:54.048 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.044+0000 7f73e3fff640 1 --2- 172.21.15.105:0/2435928071 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73e40b0c20 0x7f73e40b1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:54.048 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.044+0000 7f73e3fff640 1 -- 172.21.15.105:0/2435928071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73e41e4dc0 msgr2=0x7f73e4148450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:54.048 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.044+0000 7f73e3fff640 1 --2- 172.21.15.105:0/2435928071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73e41e4dc0 0x7f73e4148450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:54.048 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.044+0000 7f73e3fff640 1 -- 172.21.15.105:0/2435928071 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73e41e7ef0 con 0x7f73e41e75a0 2024-09-21T03:21:54.048 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.044+0000 7f73e3fff640 1 --2- 172.21.15.105:0/2435928071 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73e41e75a0 0x7f73e41e79b0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f73d8003670 tx=0x7f73d8003aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:54.048 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.045+0000 7f73e17fa640 1 -- 172.21.15.105:0/2435928071 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d8015070 con 0x7f73e41e75a0 2024-09-21T03:21:54.048 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.045+0000 7f73e17fa640 1 -- 172.21.15.105:0/2435928071 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f73d8011920 con 0x7f73e41e75a0 2024-09-21T03:21:54.048 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.045+0000 7f73eb20a640 1 -- 172.21.15.105:0/2435928071 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73e40b1570 con 0x7f73e41e75a0 2024-09-21T03:21:54.048 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.045+0000 7f73e17fa640 1 -- 172.21.15.105:0/2435928071 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d8011d70 con 0x7f73e41e75a0 2024-09-21T03:21:54.048 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.045+0000 7f73eb20a640 1 -- 172.21.15.105:0/2435928071 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73e41491d0 con 0x7f73e41e75a0 2024-09-21T03:21:54.049 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.046+0000 7f73eb20a640 1 -- 172.21.15.105:0/2435928071 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73e40cf130 con 0x7f73e41e75a0 2024-09-21T03:21:54.049 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.046+0000 7f73e17fa640 1 -- 172.21.15.105:0/2435928071 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f73d8018070 con 0x7f73e41e75a0 2024-09-21T03:21:54.049 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.047+0000 7f73e17fa640 1 --2- 172.21.15.105:0/2435928071 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f73d0078bc0 0x7f73d007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:54.049 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.047+0000 7f73e17fa640 1 -- 172.21.15.105:0/2435928071 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f73d809ba20 con 0x7f73e41e75a0 2024-09-21T03:21:54.050 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.047+0000 7f73e8fa6640 1 --2- 172.21.15.105:0/2435928071 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f73d0078bc0 0x7f73d007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:54.050 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.048+0000 7f73e8fa6640 1 --2- 172.21.15.105:0/2435928071 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f73d0078bc0 0x7f73d007b0d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f73e40b5f30 tx=0x7f73d4005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:54.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.051+0000 7f73e17fa640 1 -- 172.21.15.105:0/2435928071 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f73e40b1570 con 0x7f73e41e75a0 2024-09-21T03:21:54.266 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.264+0000 7f73eb20a640 1 -- 172.21.15.105:0/2435928071 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f73e40b4e80 con 0x7f73e41e75a0 2024-09-21T03:21:54.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.903+0000 7f73e17fa640 1 -- 172.21.15.105:0/2435928071 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v47) ==== 122+0+0 (secure 0 0 0) 0x7f73e40b3600 con 0x7f73e41e75a0 2024-09-21T03:21:54.907 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.906+0000 7f73eb20a640 1 -- 172.21.15.105:0/2435928071 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f73d0078bc0 msgr2=0x7f73d007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:54.908 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.906+0000 7f73eb20a640 1 --2- 172.21.15.105:0/2435928071 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f73d0078bc0 0x7f73d007b0d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f73e40b5f30 tx=0x7f73d4005f90 comp rx=0 tx=0).stop 2024-09-21T03:21:54.908 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.906+0000 7f73eb20a640 1 -- 172.21.15.105:0/2435928071 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73e41e75a0 msgr2=0x7f73e41e79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:54.908 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.906+0000 7f73eb20a640 1 --2- 172.21.15.105:0/2435928071 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73e41e75a0 0x7f73e41e79b0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f73d8003670 tx=0x7f73d8003aa0 comp rx=0 tx=0).stop 2024-09-21T03:21:54.908 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.906+0000 7f73eb20a640 1 -- 172.21.15.105:0/2435928071 shutdown_connections 2024-09-21T03:21:54.908 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.906+0000 7f73eb20a640 1 --2- 172.21.15.105:0/2435928071 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f73d0078bc0 0x7f73d007b0d0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:54.908 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.906+0000 7f73eb20a640 1 --2- 172.21.15.105:0/2435928071 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73e40b0c20 0x7f73e40b1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:54.908 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.906+0000 7f73eb20a640 1 --2- 172.21.15.105:0/2435928071 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73e41e75a0 0x7f73e41e79b0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:54.908 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.906+0000 7f73eb20a640 1 --2- 172.21.15.105:0/2435928071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73e41e4dc0 0x7f73e4148450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:54.908 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.906+0000 7f73eb20a640 1 -- 172.21.15.105:0/2435928071 >> 172.21.15.105:0/2435928071 conn(0x7f73e40cdcb0 msgr2=0x7f73e4068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:54.908 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.906+0000 7f73eb20a640 1 -- 172.21.15.105:0/2435928071 shutdown_connections 2024-09-21T03:21:54.908 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:54.906+0000 7f73eb20a640 1 -- 172.21.15.105:0/2435928071 wait complete. 2024-09-21T03:21:54.921 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T03:21:54.921 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:21:55.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.078+0000 7f06ed320640 1 -- 172.21.15.105:0/638837225 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06d0004800 msgr2=0x7f06d0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:55.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.078+0000 7f06ed320640 1 --2- 172.21.15.105:0/638837225 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06d0004800 0x7f06d0004c10 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f06dc009b50 tx=0x7f06d0005830 comp rx=0 tx=0).stop 2024-09-21T03:21:55.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.078+0000 7f06e77fe640 1 -- 172.21.15.105:0/638837225 reap_dead start 2024-09-21T03:21:55.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.078+0000 7f06ed320640 1 -- 172.21.15.105:0/638837225 shutdown_connections 2024-09-21T03:21:55.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.078+0000 7f06ed320640 1 -- 172.21.15.105:0/638837225 >> 172.21.15.105:0/638837225 conn(0x7f06e808bfc0 msgr2=0x7f06e809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:55.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.078+0000 7f06ed320640 1 -- 172.21.15.105:0/638837225 shutdown_connections 2024-09-21T03:21:55.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.078+0000 7f06ed320640 1 -- 172.21.15.105:0/638837225 wait complete. 2024-09-21T03:21:55.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.080+0000 7f06ed320640 1 Processor -- start 2024-09-21T03:21:55.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.080+0000 7f06ed320640 1 -- start start 2024-09-21T03:21:55.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.081+0000 7f06ed320640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06d0004800 0x7f06e80c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:55.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.081+0000 7f06ed320640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06e81f5390 0x7f06e815cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:55.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.081+0000 7f06ed320640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06e80cda90 0x7f06e80cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:55.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.081+0000 7f06ed320640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f06e80d2740 con 0x7f06e81f5390 2024-09-21T03:21:55.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.081+0000 7f06ed320640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f06e80d1810 con 0x7f06d0004800 2024-09-21T03:21:55.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.081+0000 7f06ed320640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f06e80d28c0 con 0x7f06e80cda90 2024-09-21T03:21:55.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.081+0000 7f06e67fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06e81f5390 0x7f06e815cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:55.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.081+0000 7f06e67fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06e81f5390 0x7f06e815cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:45262/0 (socket says 172.21.15.105:45262) 2024-09-21T03:21:55.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.081+0000 7f06e67fc640 1 -- 172.21.15.105:0/3538691045 learned_addr learned my addr 172.21.15.105:0/3538691045 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:55.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.081+0000 7f06e6ffd640 1 --2- 172.21.15.105:0/3538691045 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06d0004800 0x7f06e80c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:55.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.081+0000 7f06e77fe640 1 --2- 172.21.15.105:0/3538691045 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06e80cda90 0x7f06e80cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:55.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.082+0000 7f06e67fc640 1 -- 172.21.15.105:0/3538691045 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06e80cda90 msgr2=0x7f06e80cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:55.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.082+0000 7f06e67fc640 1 --2- 172.21.15.105:0/3538691045 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06e80cda90 0x7f06e80cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:55.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.082+0000 7f06e67fc640 1 -- 172.21.15.105:0/3538691045 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06d0004800 msgr2=0x7f06e80c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:55.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.082+0000 7f06e67fc640 1 --2- 172.21.15.105:0/3538691045 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06d0004800 0x7f06e80c8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:55.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.082+0000 7f06e67fc640 1 -- 172.21.15.105:0/3538691045 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e80cb120 con 0x7f06e81f5390 2024-09-21T03:21:55.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.082+0000 7f06e67fc640 1 --2- 172.21.15.105:0/3538691045 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06e81f5390 0x7f06e815cee0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f06dc009a70 tx=0x7f06dc009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:55.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.082+0000 7f06cf7fe640 1 -- 172.21.15.105:0/3538691045 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06dc038050 con 0x7f06e81f5390 2024-09-21T03:21:55.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.082+0000 7f06cf7fe640 1 -- 172.21.15.105:0/3538691045 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06dc039040 con 0x7f06e81f5390 2024-09-21T03:21:55.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.082+0000 7f06ed320640 1 -- 172.21.15.105:0/3538691045 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06e81f6370 con 0x7f06e81f5390 2024-09-21T03:21:55.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.082+0000 7f06cf7fe640 1 -- 172.21.15.105:0/3538691045 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06dc033e40 con 0x7f06e81f5390 2024-09-21T03:21:55.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.082+0000 7f06ed320640 1 -- 172.21.15.105:0/3538691045 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06e81f5db0 con 0x7f06e81f5390 2024-09-21T03:21:55.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.083+0000 7f06ed320640 1 -- 172.21.15.105:0/3538691045 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06e81f5840 con 0x7f06e81f5390 2024-09-21T03:21:55.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.084+0000 7f06cf7fe640 1 -- 172.21.15.105:0/3538691045 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f06dc02b8c0 con 0x7f06e81f5390 2024-09-21T03:21:55.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.084+0000 7f06cf7fe640 1 --2- 172.21.15.105:0/3538691045 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f06d4078b90 0x7f06d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:55.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.084+0000 7f06cf7fe640 1 -- 172.21.15.105:0/3538691045 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f06dc0bbf20 con 0x7f06e81f5390 2024-09-21T03:21:55.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.085+0000 7f06e6ffd640 1 --2- 172.21.15.105:0/3538691045 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f06d4078b90 0x7f06d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:55.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.085+0000 7f06e6ffd640 1 --2- 172.21.15.105:0/3538691045 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f06d4078b90 0x7f06d407b0a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f06d8000ff0 tx=0x7f06d8001b90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:55.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.089+0000 7f06cf7fe640 1 -- 172.21.15.105:0/3538691045 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f06dc084480 con 0x7f06e81f5390 2024-09-21T03:21:55.301 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.300+0000 7f06ed320640 1 -- 172.21.15.105:0/3538691045 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f06e80cfb70 con 0x7f06e81f5390 2024-09-21T03:21:55.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.300+0000 7f06cf7fe640 1 -- 172.21.15.105:0/3538691045 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5234 (secure 0 0 0) 0x7f06dc083d80 con 0x7f06e81f5390 2024-09-21T03:21:55.302 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:55.302 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":47,"btime":"2024-09-21T03:21:54:900892+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5878,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/352800965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":352800965},{"type":"v1","addr":"172.21.15.162:6836","nonce":352800965}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":5881,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3338554559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3338554559},{"type":"v1","addr":"172.21.15.162:6837","nonce":3338554559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/3520449576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3520449576},{"type":"v1","addr":"172.21.15.105:6834","nonce":3520449576}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:21:51.239132+0000","modified":"2024-09-21T03:21:54.265820+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6288":{"gid":6288,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/2722940718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2722940718},{"type":"v1","addr":"172.21.15.105:6835","nonce":2722940718}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6288,"qdb_cluster":[6288]},"id":6}]} 2024-09-21T03:21:55.303 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 47 2024-09-21T03:21:55.304 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.302+0000 7f06ed320640 1 -- 172.21.15.105:0/3538691045 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f06d4078b90 msgr2=0x7f06d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:55.304 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.302+0000 7f06ed320640 1 --2- 172.21.15.105:0/3538691045 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f06d4078b90 0x7f06d407b0a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f06d8000ff0 tx=0x7f06d8001b90 comp rx=0 tx=0).stop 2024-09-21T03:21:55.305 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.303+0000 7f06ed320640 1 -- 172.21.15.105:0/3538691045 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06e81f5390 msgr2=0x7f06e815cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:55.305 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.303+0000 7f06ed320640 1 --2- 172.21.15.105:0/3538691045 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06e81f5390 0x7f06e815cee0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f06dc009a70 tx=0x7f06dc009850 comp rx=0 tx=0).stop 2024-09-21T03:21:55.305 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.303+0000 7f06ed320640 1 -- 172.21.15.105:0/3538691045 shutdown_connections 2024-09-21T03:21:55.305 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.303+0000 7f06ed320640 1 --2- 172.21.15.105:0/3538691045 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f06d4078b90 0x7f06d407b0a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:55.305 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.303+0000 7f06ed320640 1 --2- 172.21.15.105:0/3538691045 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f06e80cda90 0x7f06e80cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:55.305 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.303+0000 7f06ed320640 1 --2- 172.21.15.105:0/3538691045 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06e81f5390 0x7f06e815cee0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:55.305 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.303+0000 7f06ed320640 1 --2- 172.21.15.105:0/3538691045 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f06d0004800 0x7f06e80c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:55.305 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.303+0000 7f06ed320640 1 -- 172.21.15.105:0/3538691045 >> 172.21.15.105:0/3538691045 conn(0x7f06e808bfc0 msgr2=0x7f06e8068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:55.305 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.303+0000 7f06ed320640 1 -- 172.21.15.105:0/3538691045 shutdown_connections 2024-09-21T03:21:55.305 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.303+0000 7f06ed320640 1 -- 172.21.15.105:0/3538691045 wait complete. 2024-09-21T03:21:55.316 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:21:55.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.426+0000 7f0ed649b640 1 -- 172.21.15.105:0/4239308139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ed00ccba0 msgr2=0x7f0ed00ccfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:55.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.426+0000 7f0ed649b640 1 --2- 172.21.15.105:0/4239308139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ed00ccba0 0x7f0ed00ccfb0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0070810 tx=0x7f0ec802aac0 comp rx=0 tx=0).stop 2024-09-21T03:21:55.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.426+0000 7f0ed649b640 1 -- 172.21.15.105:0/4239308139 shutdown_connections 2024-09-21T03:21:55.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.426+0000 7f0ed649b640 1 --2- 172.21.15.105:0/4239308139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ed00ccba0 0x7f0ed00ccfb0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:55.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.426+0000 7f0ed649b640 1 --2- 172.21.15.105:0/4239308139 >> v2:172.21.15.162:3300/0 conn(0x7f0ed00d1d40 0x7f0ed00b5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:55.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.426+0000 7f0ed649b640 1 -- 172.21.15.105:0/4239308139 >> 172.21.15.105:0/4239308139 conn(0x7f0ed00b3f10 msgr2=0x7f0ed00b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:55.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.426+0000 7f0ed649b640 1 -- 172.21.15.105:0/4239308139 shutdown_connections 2024-09-21T03:21:55.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.426+0000 7f0ed649b640 1 -- 172.21.15.105:0/4239308139 wait complete. 2024-09-21T03:21:55.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.428+0000 7f0ed649b640 1 Processor -- start 2024-09-21T03:21:55.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.428+0000 7f0ed649b640 1 -- start start 2024-09-21T03:21:55.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.429+0000 7f0ed649b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ed00ccba0 0x7f0ed01f4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:55.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.429+0000 7f0ed649b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ed00d1d40 0x7f0ed00b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:55.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.429+0000 7f0ed649b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ed015c6f0 0x7f0ed01f6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:55.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.429+0000 7f0ed649b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed00d11f0 con 0x7f0ed015c6f0 2024-09-21T03:21:55.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.429+0000 7f0ed649b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed00d1070 con 0x7f0ed00d1d40 2024-09-21T03:21:55.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.429+0000 7f0ed649b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0ed00d1370 con 0x7f0ed00ccba0 2024-09-21T03:21:55.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.429+0000 7f0ed4a38640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ed015c6f0 0x7f0ed01f6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:55.433 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.429+0000 7f0ed4a38640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ed015c6f0 0x7f0ed01f6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:45276/0 (socket says 172.21.15.105:45276) 2024-09-21T03:21:55.433 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.429+0000 7f0ed4a38640 1 -- 172.21.15.105:0/1420535841 learned_addr learned my addr 172.21.15.105:0/1420535841 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:55.433 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.429+0000 7f0ecf7fe640 1 --2- 172.21.15.105:0/1420535841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ed00d1d40 0x7f0ed00b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:55.433 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.429+0000 7f0ecffff640 1 --2- 172.21.15.105:0/1420535841 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ed00ccba0 0x7f0ed01f4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:55.433 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.429+0000 7f0ed4a38640 1 -- 172.21.15.105:0/1420535841 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ed00ccba0 msgr2=0x7f0ed01f4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:55.433 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.429+0000 7f0ed4a38640 1 --2- 172.21.15.105:0/1420535841 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ed00ccba0 0x7f0ed01f4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:55.433 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.429+0000 7f0ed4a38640 1 -- 172.21.15.105:0/1420535841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ed00d1d40 msgr2=0x7f0ed00b0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:55.433 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.429+0000 7f0ed4a38640 1 --2- 172.21.15.105:0/1420535841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ed00d1d40 0x7f0ed00b0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:55.433 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.430+0000 7f0ed4a38640 1 -- 172.21.15.105:0/1420535841 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed0159bf0 con 0x7f0ed015c6f0 2024-09-21T03:21:55.433 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.430+0000 7f0ed4a38640 1 --2- 172.21.15.105:0/1420535841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ed015c6f0 0x7f0ed01f6ba0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8009d60 tx=0x7f0ec8003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:55.433 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.430+0000 7f0eccff9640 1 -- 172.21.15.105:0/1420535841 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec8044070 con 0x7f0ed015c6f0 2024-09-21T03:21:55.433 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.430+0000 7f0eccff9640 1 -- 172.21.15.105:0/1420535841 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ec8004250 con 0x7f0ed015c6f0 2024-09-21T03:21:55.433 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.430+0000 7f0ed649b640 1 -- 172.21.15.105:0/1420535841 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ed01f7710 con 0x7f0ed015c6f0 2024-09-21T03:21:55.434 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.430+0000 7f0eccff9640 1 -- 172.21.15.105:0/1420535841 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec8004680 con 0x7f0ed015c6f0 2024-09-21T03:21:55.434 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.430+0000 7f0ed649b640 1 -- 172.21.15.105:0/1420535841 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ed01f3900 con 0x7f0ed015c6f0 2024-09-21T03:21:55.434 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.431+0000 7f0ed649b640 1 -- 172.21.15.105:0/1420535841 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ed01f7480 con 0x7f0ed015c6f0 2024-09-21T03:21:55.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.432+0000 7f0eccff9640 1 -- 172.21.15.105:0/1420535841 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0ec8036400 con 0x7f0ed015c6f0 2024-09-21T03:21:55.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.432+0000 7f0eccff9640 1 --2- 172.21.15.105:0/1420535841 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0ebc078b90 0x7f0ebc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:55.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.433+0000 7f0eccff9640 1 -- 172.21.15.105:0/1420535841 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f0ec80bb3a0 con 0x7f0ed015c6f0 2024-09-21T03:21:55.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.433+0000 7f0ecffff640 1 --2- 172.21.15.105:0/1420535841 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0ebc078b90 0x7f0ebc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:55.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.433+0000 7f0ecffff640 1 --2- 172.21.15.105:0/1420535841 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0ebc078b90 0x7f0ebc07b0a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0004630 tx=0x7f0ec000b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:55.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.437+0000 7f0eccff9640 1 -- 172.21.15.105:0/1420535841 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0ec8032030 con 0x7f0ed015c6f0 2024-09-21T03:21:55.616 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.614+0000 7f0ed649b640 1 -- 172.21.15.105:0/1420535841 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0ed00ce170 con 0x7f0ed015c6f0 2024-09-21T03:21:55.617 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.616+0000 7f0eccff9640 1 -- 172.21.15.105:0/1420535841 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+16792 (secure 0 0 0) 0x7f0ed00ce170 con 0x7f0ed015c6f0 2024-09-21T03:21:55.617 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:55.618 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":80,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:21:52.888548+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:21:48.883188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-21T03:21:50.206885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:21:55.620 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.618+0000 7f0ed649b640 1 -- 172.21.15.105:0/1420535841 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0ebc078b90 msgr2=0x7f0ebc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:55.620 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.618+0000 7f0ed649b640 1 --2- 172.21.15.105:0/1420535841 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0ebc078b90 0x7f0ebc07b0a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0004630 tx=0x7f0ec000b2e0 comp rx=0 tx=0).stop 2024-09-21T03:21:55.620 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.618+0000 7f0ed649b640 1 -- 172.21.15.105:0/1420535841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ed015c6f0 msgr2=0x7f0ed01f6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:55.620 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.618+0000 7f0ed649b640 1 --2- 172.21.15.105:0/1420535841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ed015c6f0 0x7f0ed01f6ba0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8009d60 tx=0x7f0ec8003f10 comp rx=0 tx=0).stop 2024-09-21T03:21:55.621 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.618+0000 7f0ed649b640 1 -- 172.21.15.105:0/1420535841 shutdown_connections 2024-09-21T03:21:55.621 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.618+0000 7f0ed649b640 1 --2- 172.21.15.105:0/1420535841 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0ebc078b90 0x7f0ebc07b0a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:55.621 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.618+0000 7f0ed649b640 1 --2- 172.21.15.105:0/1420535841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ed015c6f0 0x7f0ed01f6ba0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:55.621 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.618+0000 7f0ed649b640 1 --2- 172.21.15.105:0/1420535841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ed00d1d40 0x7f0ed00b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:55.621 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.618+0000 7f0ed649b640 1 --2- 172.21.15.105:0/1420535841 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ed00ccba0 0x7f0ed01f4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:55.621 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.618+0000 7f0ed649b640 1 -- 172.21.15.105:0/1420535841 >> 172.21.15.105:0/1420535841 conn(0x7f0ed00b3f10 msgr2=0x7f0ed00b6130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:55.621 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.618+0000 7f0ed649b640 1 -- 172.21.15.105:0/1420535841 shutdown_connections 2024-09-21T03:21:55.621 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.618+0000 7f0ed649b640 1 -- 172.21.15.105:0/1420535841 wait complete. 2024-09-21T03:21:55.631 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T03:21:55.632 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:21:55.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.742+0000 7fb53ba4d640 1 -- 172.21.15.105:0/3527130622 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5340b9b60 msgr2=0x7fb5340d4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:55.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.742+0000 7fb53ba4d640 1 --2- 172.21.15.105:0/3527130622 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5340b9b60 0x7fb5340d4d80 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fb5300098e0 tx=0x7fb53002a4f0 comp rx=0 tx=0).stop 2024-09-21T03:21:55.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.742+0000 7fb53ba4d640 1 -- 172.21.15.105:0/3527130622 shutdown_connections 2024-09-21T03:21:55.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.742+0000 7fb53ba4d640 1 --2- 172.21.15.105:0/3527130622 >> v2:172.21.15.162:3300/0 conn(0x7fb5340b66b0 0x7fb53406eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:55.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.742+0000 7fb53ba4d640 1 --2- 172.21.15.105:0/3527130622 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5340b9b60 0x7fb5340d4d80 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:55.745 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.742+0000 7fb53ba4d640 1 -- 172.21.15.105:0/3527130622 >> 172.21.15.105:0/3527130622 conn(0x7fb53409d7f0 msgr2=0x7fb5340d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:55.745 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.742+0000 7fb53ba4d640 1 -- 172.21.15.105:0/3527130622 shutdown_connections 2024-09-21T03:21:55.745 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.742+0000 7fb53ba4d640 1 -- 172.21.15.105:0/3527130622 wait complete. 2024-09-21T03:21:55.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.744+0000 7fb53ba4d640 1 Processor -- start 2024-09-21T03:21:55.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.744+0000 7fb53ba4d640 1 -- start start 2024-09-21T03:21:55.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.745+0000 7fb53ba4d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5340b9b60 0x7fb5340c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:55.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.745+0000 7fb53ba4d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb5340cf540 0x7fb534160d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:55.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.745+0000 7fb53ba4d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5340c9e00 0x7fb534161240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:55.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.745+0000 7fb53ba4d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb53406f600 con 0x7fb5340b9b60 2024-09-21T03:21:55.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.745+0000 7fb53ba4d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb53406f480 con 0x7fb5340c9e00 2024-09-21T03:21:55.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.745+0000 7fb53ba4d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb53406f780 con 0x7fb5340cf540 2024-09-21T03:21:55.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.745+0000 7fb5397e9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5340b9b60 0x7fb5340c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:55.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.745+0000 7fb5397e9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5340b9b60 0x7fb5340c98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:45300/0 (socket says 172.21.15.105:45300) 2024-09-21T03:21:55.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.745+0000 7fb5397e9640 1 -- 172.21.15.105:0/1559498595 learned_addr learned my addr 172.21.15.105:0/1559498595 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:55.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.746+0000 7fb5397e9640 1 -- 172.21.15.105:0/1559498595 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb5340cf540 msgr2=0x7fb534160d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:55.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.746+0000 7fb5397e9640 1 --2- 172.21.15.105:0/1559498595 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb5340cf540 0x7fb534160d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:55.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.746+0000 7fb5397e9640 1 -- 172.21.15.105:0/1559498595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5340c9e00 msgr2=0x7fb534161240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:55.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.746+0000 7fb5397e9640 1 --2- 172.21.15.105:0/1559498595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5340c9e00 0x7fb534161240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:55.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.746+0000 7fb5397e9640 1 -- 172.21.15.105:0/1559498595 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5340c83c0 con 0x7fb5340b9b60 2024-09-21T03:21:55.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.746+0000 7fb5397e9640 1 --2- 172.21.15.105:0/1559498595 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5340b9b60 0x7fb5340c98c0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fb530009a00 tx=0x7fb530005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:55.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.746+0000 7fb529ffb640 1 -- 172.21.15.105:0/1559498595 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb53003f070 con 0x7fb5340b9b60 2024-09-21T03:21:55.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.746+0000 7fb529ffb640 1 -- 172.21.15.105:0/1559498595 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb530004360 con 0x7fb5340b9b60 2024-09-21T03:21:55.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.746+0000 7fb53ba4d640 1 -- 172.21.15.105:0/1559498595 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5340c86a0 con 0x7fb5340b9b60 2024-09-21T03:21:55.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.746+0000 7fb529ffb640 1 -- 172.21.15.105:0/1559498595 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb530031bb0 con 0x7fb5340b9b60 2024-09-21T03:21:55.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.746+0000 7fb53ba4d640 1 -- 172.21.15.105:0/1559498595 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5340c8c60 con 0x7fb5340b9b60 2024-09-21T03:21:55.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.747+0000 7fb53ba4d640 1 -- 172.21.15.105:0/1559498595 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb53406fd00 con 0x7fb5340b9b60 2024-09-21T03:21:55.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.748+0000 7fb529ffb640 1 -- 172.21.15.105:0/1559498595 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb530042070 con 0x7fb5340b9b60 2024-09-21T03:21:55.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.748+0000 7fb529ffb640 1 --2- 172.21.15.105:0/1559498595 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb518078b90 0x7fb51807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:55.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.749+0000 7fb529ffb640 1 -- 172.21.15.105:0/1559498595 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7fb5300bbc50 con 0x7fb5340b9b60 2024-09-21T03:21:55.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.749+0000 7fb538fe8640 1 --2- 172.21.15.105:0/1559498595 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb518078b90 0x7fb51807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:55.751 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.749+0000 7fb538fe8640 1 --2- 172.21.15.105:0/1559498595 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb518078b90 0x7fb51807b0a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb5340cc7f0 tx=0x7fb524007930 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:55.755 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.753+0000 7fb529ffb640 1 -- 172.21.15.105:0/1559498595 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb5300c1020 con 0x7fb5340b9b60 2024-09-21T03:21:55.931 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.929+0000 7fb53ba4d640 1 -- 172.21.15.105:0/1559498595 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb5340d3fb0 con 0x7fb518078b90 2024-09-21T03:21:55.935 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.934+0000 7fb529ffb640 1 -- 172.21.15.105:0/1559498595 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251718 (secure 0 0 0) 0x7fb5340d3fb0 con 0x7fb518078b90 2024-09-21T03:21:55.938 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:55.939 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:21:55.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.937+0000 7fb53ba4d640 1 -- 172.21.15.105:0/1559498595 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb518078b90 msgr2=0x7fb51807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:55.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.937+0000 7fb53ba4d640 1 --2- 172.21.15.105:0/1559498595 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb518078b90 0x7fb51807b0a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb5340cc7f0 tx=0x7fb524007930 comp rx=0 tx=0).stop 2024-09-21T03:21:55.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.937+0000 7fb53ba4d640 1 -- 172.21.15.105:0/1559498595 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5340b9b60 msgr2=0x7fb5340c98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:55.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.937+0000 7fb53ba4d640 1 --2- 172.21.15.105:0/1559498595 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5340b9b60 0x7fb5340c98c0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fb530009a00 tx=0x7fb530005270 comp rx=0 tx=0).stop 2024-09-21T03:21:55.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.937+0000 7fb53ba4d640 1 -- 172.21.15.105:0/1559498595 shutdown_connections 2024-09-21T03:21:55.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.937+0000 7fb53ba4d640 1 --2- 172.21.15.105:0/1559498595 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb518078b90 0x7fb51807b0a0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:55.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.937+0000 7fb53ba4d640 1 --2- 172.21.15.105:0/1559498595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5340c9e00 0x7fb534161240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:55.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.937+0000 7fb53ba4d640 1 --2- 172.21.15.105:0/1559498595 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb5340cf540 0x7fb534160d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:55.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.937+0000 7fb53ba4d640 1 --2- 172.21.15.105:0/1559498595 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5340b9b60 0x7fb5340c98c0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:55.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.937+0000 7fb53ba4d640 1 -- 172.21.15.105:0/1559498595 >> 172.21.15.105:0/1559498595 conn(0x7fb53409d7f0 msgr2=0x7fb5340b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:55.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.937+0000 7fb53ba4d640 1 -- 172.21.15.105:0/1559498595 shutdown_connections 2024-09-21T03:21:55.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:55.938+0000 7fb53ba4d640 1 -- 172.21.15.105:0/1559498595 wait complete. 2024-09-21T03:21:55.950 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":183,"stamp":"2024-09-21T03:21:55.331418+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":125,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":94,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258272,"kb_used_data":8740,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716448,"statfs":{"total":773094113280,"available":772829642752,"internally_reserved":0,"allocated":8949760,"data_stored":4397375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.464815"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900303+0000","last_change":"2024-09-21T03:21:51.891281+0000","last_active":"2024-09-21T03:21:52.900303+0000","last_peered":"2024-09-21T03:21:52.900303+0000","last_clean":"2024-09-21T03:21:52.900303+0000","last_became_active":"2024-09-21T03:21:51.890980+0000","last_became_peered":"2024-09-21T03:21:51.890980+0000","last_unstale":"2024-09-21T03:21:52.900303+0000","last_undegraded":"2024-09-21T03:21:52.900303+0000","last_fullsized":"2024-09-21T03:21:52.900303+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:11.163288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899999+0000","last_change":"2024-09-21T03:21:51.898465+0000","last_active":"2024-09-21T03:21:52.899999+0000","last_peered":"2024-09-21T03:21:52.899999+0000","last_clean":"2024-09-21T03:21:52.899999+0000","last_became_active":"2024-09-21T03:21:51.897528+0000","last_became_peered":"2024-09-21T03:21:51.897528+0000","last_unstale":"2024-09-21T03:21:52.899999+0000","last_undegraded":"2024-09-21T03:21:52.899999+0000","last_fullsized":"2024-09-21T03:21:52.899999+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:58.179373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.578114+0000","last_change":"2024-09-21T03:21:51.910099+0000","last_active":"2024-09-21T03:21:53.578114+0000","last_peered":"2024-09-21T03:21:53.578114+0000","last_clean":"2024-09-21T03:21:53.578114+0000","last_became_active":"2024-09-21T03:21:51.908796+0000","last_became_peered":"2024-09-21T03:21:51.908796+0000","last_unstale":"2024-09-21T03:21:53.578114+0000","last_undegraded":"2024-09-21T03:21:53.578114+0000","last_fullsized":"2024-09-21T03:21:53.578114+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:03.322054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.270250+0000","last_change":"2024-09-21T03:21:51.903031+0000","last_active":"2024-09-21T03:21:53.270250+0000","last_peered":"2024-09-21T03:21:53.270250+0000","last_clean":"2024-09-21T03:21:53.270250+0000","last_became_active":"2024-09-21T03:21:51.902704+0000","last_became_peered":"2024-09-21T03:21:51.902704+0000","last_unstale":"2024-09-21T03:21:53.270250+0000","last_undegraded":"2024-09-21T03:21:53.270250+0000","last_fullsized":"2024-09-21T03:21:53.270250+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:22.814195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898426+0000","last_change":"2024-09-21T03:21:51.894670+0000","last_active":"2024-09-21T03:21:52.898426+0000","last_peered":"2024-09-21T03:21:52.898426+0000","last_clean":"2024-09-21T03:21:52.898426+0000","last_became_active":"2024-09-21T03:21:51.894129+0000","last_became_peered":"2024-09-21T03:21:51.894129+0000","last_unstale":"2024-09-21T03:21:52.898426+0000","last_undegraded":"2024-09-21T03:21:52.898426+0000","last_fullsized":"2024-09-21T03:21:52.898426+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:10:23.798227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:21:51.911046+0000","last_change":"2024-09-21T03:21:51.905285+0000","last_active":"2024-09-21T03:21:51.911046+0000","last_peered":"2024-09-21T03:21:51.911046+0000","last_clean":"2024-09-21T03:21:51.911046+0000","last_became_active":"2024-09-21T03:21:51.904901+0000","last_became_peered":"2024-09-21T03:21:51.904901+0000","last_unstale":"2024-09-21T03:21:51.911046+0000","last_undegraded":"2024-09-21T03:21:51.911046+0000","last_fullsized":"2024-09-21T03:21:51.911046+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:38.052497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.269833+0000","last_change":"2024-09-21T03:21:51.905587+0000","last_active":"2024-09-21T03:21:53.269833+0000","last_peered":"2024-09-21T03:21:53.269833+0000","last_clean":"2024-09-21T03:21:53.269833+0000","last_became_active":"2024-09-21T03:21:51.905274+0000","last_became_peered":"2024-09-21T03:21:51.905274+0000","last_unstale":"2024-09-21T03:21:53.269833+0000","last_undegraded":"2024-09-21T03:21:53.269833+0000","last_fullsized":"2024-09-21T03:21:53.269833+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:59.109536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:21:51.910644+0000","last_change":"2024-09-21T03:21:51.907560+0000","last_active":"2024-09-21T03:21:51.910644+0000","last_peered":"2024-09-21T03:21:51.910644+0000","last_clean":"2024-09-21T03:21:51.910644+0000","last_became_active":"2024-09-21T03:21:51.907143+0000","last_became_peered":"2024-09-21T03:21:51.907143+0000","last_unstale":"2024-09-21T03:21:51.910644+0000","last_undegraded":"2024-09-21T03:21:51.910644+0000","last_fullsized":"2024-09-21T03:21:51.910644+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:16.865640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:21:51.911342+0000","last_change":"2024-09-21T03:21:51.908687+0000","last_active":"2024-09-21T03:21:51.911342+0000","last_peered":"2024-09-21T03:21:51.911342+0000","last_clean":"2024-09-21T03:21:51.911342+0000","last_became_active":"2024-09-21T03:21:51.908386+0000","last_became_peered":"2024-09-21T03:21:51.908386+0000","last_unstale":"2024-09-21T03:21:51.911342+0000","last_undegraded":"2024-09-21T03:21:51.911342+0000","last_fullsized":"2024-09-21T03:21:51.911342+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:50:08.646746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900295+0000","last_change":"2024-09-21T03:21:51.903820+0000","last_active":"2024-09-21T03:21:52.900295+0000","last_peered":"2024-09-21T03:21:52.900295+0000","last_clean":"2024-09-21T03:21:52.900295+0000","last_became_active":"2024-09-21T03:21:51.903292+0000","last_became_peered":"2024-09-21T03:21:51.903292+0000","last_unstale":"2024-09-21T03:21:52.900295+0000","last_undegraded":"2024-09-21T03:21:52.900295+0000","last_fullsized":"2024-09-21T03:21:52.900295+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:02.311208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899833+0000","last_change":"2024-09-21T03:21:51.898032+0000","last_active":"2024-09-21T03:21:52.899833+0000","last_peered":"2024-09-21T03:21:52.899833+0000","last_clean":"2024-09-21T03:21:52.899833+0000","last_became_active":"2024-09-21T03:21:51.897696+0000","last_became_peered":"2024-09-21T03:21:51.897696+0000","last_unstale":"2024-09-21T03:21:52.899833+0000","last_undegraded":"2024-09-21T03:21:52.899833+0000","last_fullsized":"2024-09-21T03:21:52.899833+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:55.624250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900229+0000","last_change":"2024-09-21T03:21:51.890813+0000","last_active":"2024-09-21T03:21:52.900229+0000","last_peered":"2024-09-21T03:21:52.900229+0000","last_clean":"2024-09-21T03:21:52.900229+0000","last_became_active":"2024-09-21T03:21:51.890330+0000","last_became_peered":"2024-09-21T03:21:51.890330+0000","last_unstale":"2024-09-21T03:21:52.900229+0000","last_undegraded":"2024-09-21T03:21:52.900229+0000","last_fullsized":"2024-09-21T03:21:52.900229+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:52:04.989198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.578126+0000","last_change":"2024-09-21T03:21:51.901017+0000","last_active":"2024-09-21T03:21:53.578126+0000","last_peered":"2024-09-21T03:21:53.578126+0000","last_clean":"2024-09-21T03:21:53.578126+0000","last_became_active":"2024-09-21T03:21:51.900655+0000","last_became_peered":"2024-09-21T03:21:51.900655+0000","last_unstale":"2024-09-21T03:21:53.578126+0000","last_undegraded":"2024-09-21T03:21:53.578126+0000","last_fullsized":"2024-09-21T03:21:53.578126+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:24.486253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.270005+0000","last_change":"2024-09-21T03:21:51.907469+0000","last_active":"2024-09-21T03:21:53.270005+0000","last_peered":"2024-09-21T03:21:53.270005+0000","last_clean":"2024-09-21T03:21:53.270005+0000","last_became_active":"2024-09-21T03:21:51.907159+0000","last_became_peered":"2024-09-21T03:21:51.907159+0000","last_unstale":"2024-09-21T03:21:53.270005+0000","last_undegraded":"2024-09-21T03:21:53.270005+0000","last_fullsized":"2024-09-21T03:21:53.270005+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:45:31.092132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.576587+0000","last_change":"2024-09-21T03:21:51.900790+0000","last_active":"2024-09-21T03:21:53.576587+0000","last_peered":"2024-09-21T03:21:53.576587+0000","last_clean":"2024-09-21T03:21:53.576587+0000","last_became_active":"2024-09-21T03:21:51.900484+0000","last_became_peered":"2024-09-21T03:21:51.900484+0000","last_unstale":"2024-09-21T03:21:53.576587+0000","last_undegraded":"2024-09-21T03:21:53.576587+0000","last_fullsized":"2024-09-21T03:21:53.576587+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:52.176078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898035+0000","last_change":"2024-09-21T03:21:51.896039+0000","last_active":"2024-09-21T03:21:52.898035+0000","last_peered":"2024-09-21T03:21:52.898035+0000","last_clean":"2024-09-21T03:21:52.898035+0000","last_became_active":"2024-09-21T03:21:51.895701+0000","last_became_peered":"2024-09-21T03:21:51.895701+0000","last_unstale":"2024-09-21T03:21:52.898035+0000","last_undegraded":"2024-09-21T03:21:52.898035+0000","last_fullsized":"2024-09-21T03:21:52.898035+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:05.844984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898871+0000","last_change":"2024-09-21T03:21:51.903045+0000","last_active":"2024-09-21T03:21:52.898871+0000","last_peered":"2024-09-21T03:21:52.898871+0000","last_clean":"2024-09-21T03:21:52.898871+0000","last_became_active":"2024-09-21T03:21:51.902734+0000","last_became_peered":"2024-09-21T03:21:51.902734+0000","last_unstale":"2024-09-21T03:21:52.898871+0000","last_undegraded":"2024-09-21T03:21:52.898871+0000","last_fullsized":"2024-09-21T03:21:52.898871+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:05.726920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.270049+0000","last_change":"2024-09-21T03:21:51.898501+0000","last_active":"2024-09-21T03:21:53.270049+0000","last_peered":"2024-09-21T03:21:53.270049+0000","last_clean":"2024-09-21T03:21:53.270049+0000","last_became_active":"2024-09-21T03:21:51.898186+0000","last_became_peered":"2024-09-21T03:21:51.898186+0000","last_unstale":"2024-09-21T03:21:53.270049+0000","last_undegraded":"2024-09-21T03:21:53.270049+0000","last_fullsized":"2024-09-21T03:21:53.270049+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:13.850020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-09-21T03:21:50.877538+0000","last_change":"2024-09-21T03:21:50.877538+0000","last_active":"2024-09-21T03:21:50.865211+0000","last_peered":"2024-09-21T03:21:50.865211+0000","last_clean":"2024-09-21T03:21:50.865211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:50.877538+0000","last_undegraded":"2024-09-21T03:21:50.877538+0000","last_fullsized":"2024-09-21T03:21:50.877538+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.270225+0000","last_change":"2024-09-21T03:21:51.909012+0000","last_active":"2024-09-21T03:21:53.270225+0000","last_peered":"2024-09-21T03:21:53.270225+0000","last_clean":"2024-09-21T03:21:53.270225+0000","last_became_active":"2024-09-21T03:21:51.908626+0000","last_became_peered":"2024-09-21T03:21:51.908626+0000","last_unstale":"2024-09-21T03:21:53.270225+0000","last_undegraded":"2024-09-21T03:21:53.270225+0000","last_fullsized":"2024-09-21T03:21:53.270225+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:24.606033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.270080+0000","last_change":"2024-09-21T03:21:51.907947+0000","last_active":"2024-09-21T03:21:53.270080+0000","last_peered":"2024-09-21T03:21:53.270080+0000","last_clean":"2024-09-21T03:21:53.270080+0000","last_became_active":"2024-09-21T03:21:51.907646+0000","last_became_peered":"2024-09-21T03:21:51.907646+0000","last_unstale":"2024-09-21T03:21:53.270080+0000","last_undegraded":"2024-09-21T03:21:53.270080+0000","last_fullsized":"2024-09-21T03:21:53.270080+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:45:53.374512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900150+0000","last_change":"2024-09-21T03:21:51.905074+0000","last_active":"2024-09-21T03:21:52.900150+0000","last_peered":"2024-09-21T03:21:52.900150+0000","last_clean":"2024-09-21T03:21:52.900150+0000","last_became_active":"2024-09-21T03:21:51.904768+0000","last_became_peered":"2024-09-21T03:21:51.904768+0000","last_unstale":"2024-09-21T03:21:52.900150+0000","last_undegraded":"2024-09-21T03:21:52.900150+0000","last_fullsized":"2024-09-21T03:21:52.900150+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:34.814915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899934+0000","last_change":"2024-09-21T03:21:51.908346+0000","last_active":"2024-09-21T03:21:52.899934+0000","last_peered":"2024-09-21T03:21:52.899934+0000","last_clean":"2024-09-21T03:21:52.899934+0000","last_became_active":"2024-09-21T03:21:51.907761+0000","last_became_peered":"2024-09-21T03:21:51.907761+0000","last_unstale":"2024-09-21T03:21:52.899934+0000","last_undegraded":"2024-09-21T03:21:52.899934+0000","last_fullsized":"2024-09-21T03:21:52.899934+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:31.112370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.269875+0000","last_change":"2024-09-21T03:21:51.907169+0000","last_active":"2024-09-21T03:21:53.269875+0000","last_peered":"2024-09-21T03:21:53.269875+0000","last_clean":"2024-09-21T03:21:53.269875+0000","last_became_active":"2024-09-21T03:21:51.906861+0000","last_became_peered":"2024-09-21T03:21:51.906861+0000","last_unstale":"2024-09-21T03:21:53.269875+0000","last_undegraded":"2024-09-21T03:21:53.269875+0000","last_fullsized":"2024-09-21T03:21:53.269875+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:50.311072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900138+0000","last_change":"2024-09-21T03:21:51.898498+0000","last_active":"2024-09-21T03:21:52.900138+0000","last_peered":"2024-09-21T03:21:52.900138+0000","last_clean":"2024-09-21T03:21:52.900138+0000","last_became_active":"2024-09-21T03:21:51.898168+0000","last_became_peered":"2024-09-21T03:21:51.898168+0000","last_unstale":"2024-09-21T03:21:52.900138+0000","last_undegraded":"2024-09-21T03:21:52.900138+0000","last_fullsized":"2024-09-21T03:21:52.900138+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:46.365557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.578351+0000","last_change":"2024-09-21T03:21:51.903010+0000","last_active":"2024-09-21T03:21:53.578351+0000","last_peered":"2024-09-21T03:21:53.578351+0000","last_clean":"2024-09-21T03:21:53.578351+0000","last_became_active":"2024-09-21T03:21:51.902660+0000","last_became_peered":"2024-09-21T03:21:51.902660+0000","last_unstale":"2024-09-21T03:21:53.578351+0000","last_undegraded":"2024-09-21T03:21:53.578351+0000","last_fullsized":"2024-09-21T03:21:53.578351+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:00:43.998502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898480+0000","last_change":"2024-09-21T03:21:51.901714+0000","last_active":"2024-09-21T03:21:52.898480+0000","last_peered":"2024-09-21T03:21:52.898480+0000","last_clean":"2024-09-21T03:21:52.898480+0000","last_became_active":"2024-09-21T03:21:51.901323+0000","last_became_peered":"2024-09-21T03:21:51.901323+0000","last_unstale":"2024-09-21T03:21:52.898480+0000","last_undegraded":"2024-09-21T03:21:52.898480+0000","last_fullsized":"2024-09-21T03:21:52.898480+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:09.488852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900477+0000","last_change":"2024-09-21T03:21:51.892582+0000","last_active":"2024-09-21T03:21:52.900477+0000","last_peered":"2024-09-21T03:21:52.900477+0000","last_clean":"2024-09-21T03:21:52.900477+0000","last_became_active":"2024-09-21T03:21:51.892311+0000","last_became_peered":"2024-09-21T03:21:51.892311+0000","last_unstale":"2024-09-21T03:21:52.900477+0000","last_undegraded":"2024-09-21T03:21:52.900477+0000","last_fullsized":"2024-09-21T03:21:52.900477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:33.342412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899954+0000","last_change":"2024-09-21T03:21:51.902574+0000","last_active":"2024-09-21T03:21:52.899954+0000","last_peered":"2024-09-21T03:21:52.899954+0000","last_clean":"2024-09-21T03:21:52.899954+0000","last_became_active":"2024-09-21T03:21:51.902279+0000","last_became_peered":"2024-09-21T03:21:51.902279+0000","last_unstale":"2024-09-21T03:21:52.899954+0000","last_undegraded":"2024-09-21T03:21:52.899954+0000","last_fullsized":"2024-09-21T03:21:52.899954+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:07.452760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899652+0000","last_change":"2024-09-21T03:21:51.903656+0000","last_active":"2024-09-21T03:21:52.899652+0000","last_peered":"2024-09-21T03:21:52.899652+0000","last_clean":"2024-09-21T03:21:52.899652+0000","last_became_active":"2024-09-21T03:21:51.903346+0000","last_became_peered":"2024-09-21T03:21:51.903346+0000","last_unstale":"2024-09-21T03:21:52.899652+0000","last_undegraded":"2024-09-21T03:21:52.899652+0000","last_fullsized":"2024-09-21T03:21:52.899652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:05.605373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898116+0000","last_change":"2024-09-21T03:21:51.906337+0000","last_active":"2024-09-21T03:21:52.898116+0000","last_peered":"2024-09-21T03:21:52.898116+0000","last_clean":"2024-09-21T03:21:52.898116+0000","last_became_active":"2024-09-21T03:21:51.906006+0000","last_became_peered":"2024-09-21T03:21:51.906006+0000","last_unstale":"2024-09-21T03:21:52.898116+0000","last_undegraded":"2024-09-21T03:21:52.898116+0000","last_fullsized":"2024-09-21T03:21:52.898116+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:52.059197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899915+0000","last_change":"2024-09-21T03:21:51.890919+0000","last_active":"2024-09-21T03:21:52.899915+0000","last_peered":"2024-09-21T03:21:52.899915+0000","last_clean":"2024-09-21T03:21:52.899915+0000","last_became_active":"2024-09-21T03:21:51.890036+0000","last_became_peered":"2024-09-21T03:21:51.890036+0000","last_unstale":"2024-09-21T03:21:52.899915+0000","last_undegraded":"2024-09-21T03:21:52.899915+0000","last_fullsized":"2024-09-21T03:21:52.899915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:50:08.646746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898739+0000","last_change":"2024-09-21T03:21:51.891404+0000","last_active":"2024-09-21T03:21:52.898739+0000","last_peered":"2024-09-21T03:21:52.898739+0000","last_clean":"2024-09-21T03:21:52.898739+0000","last_became_active":"2024-09-21T03:21:51.891067+0000","last_became_peered":"2024-09-21T03:21:51.891067+0000","last_unstale":"2024-09-21T03:21:52.898739+0000","last_undegraded":"2024-09-21T03:21:52.898739+0000","last_fullsized":"2024-09-21T03:21:52.898739+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:43:18.361524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"79'4","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900471+0000","last_change":"2024-09-21T03:21:50.884910+0000","last_active":"2024-09-21T03:21:52.900471+0000","last_peered":"2024-09-21T03:21:52.900471+0000","last_clean":"2024-09-21T03:21:52.900471+0000","last_became_active":"2024-09-21T03:21:50.884574+0000","last_became_peered":"2024-09-21T03:21:50.884574+0000","last_unstale":"2024-09-21T03:21:52.900471+0000","last_undegraded":"2024-09-21T03:21:52.900471+0000","last_fullsized":"2024-09-21T03:21:52.900471+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:04.344766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900386+0000","last_change":"2024-09-21T03:21:51.908073+0000","last_active":"2024-09-21T03:21:52.900386+0000","last_peered":"2024-09-21T03:21:52.900386+0000","last_clean":"2024-09-21T03:21:52.900386+0000","last_became_active":"2024-09-21T03:21:51.907654+0000","last_became_peered":"2024-09-21T03:21:51.907654+0000","last_unstale":"2024-09-21T03:21:52.900386+0000","last_undegraded":"2024-09-21T03:21:52.900386+0000","last_fullsized":"2024-09-21T03:21:52.900386+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:03.307063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"79'1","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899061+0000","last_change":"2024-09-21T03:21:50.888297+0000","last_active":"2024-09-21T03:21:52.899061+0000","last_peered":"2024-09-21T03:21:52.899061+0000","last_clean":"2024-09-21T03:21:52.899061+0000","last_became_active":"2024-09-21T03:21:50.887943+0000","last_became_peered":"2024-09-21T03:21:50.887943+0000","last_unstale":"2024-09-21T03:21:52.899061+0000","last_undegraded":"2024-09-21T03:21:52.899061+0000","last_fullsized":"2024-09-21T03:21:52.899061+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:57.173705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900498+0000","last_change":"2024-09-21T03:21:51.890296+0000","last_active":"2024-09-21T03:21:52.900498+0000","last_peered":"2024-09-21T03:21:52.900498+0000","last_clean":"2024-09-21T03:21:52.900498+0000","last_became_active":"2024-09-21T03:21:51.889937+0000","last_became_peered":"2024-09-21T03:21:51.889937+0000","last_unstale":"2024-09-21T03:21:52.900498+0000","last_undegraded":"2024-09-21T03:21:52.900498+0000","last_fullsized":"2024-09-21T03:21:52.900498+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:31.802933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:21:50.892113+0000","last_change":"2024-09-21T03:21:50.888653+0000","last_active":"2024-09-21T03:21:50.892113+0000","last_peered":"2024-09-21T03:21:50.892113+0000","last_clean":"2024-09-21T03:21:50.892113+0000","last_became_active":"2024-09-21T03:21:50.888329+0000","last_became_peered":"2024-09-21T03:21:50.888329+0000","last_unstale":"2024-09-21T03:21:50.892113+0000","last_undegraded":"2024-09-21T03:21:50.892113+0000","last_fullsized":"2024-09-21T03:21:50.892113+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:59.226138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.578269+0000","last_change":"2024-09-21T03:21:51.902475+0000","last_active":"2024-09-21T03:21:53.578269+0000","last_peered":"2024-09-21T03:21:53.578269+0000","last_clean":"2024-09-21T03:21:53.578269+0000","last_became_active":"2024-09-21T03:21:51.901928+0000","last_became_peered":"2024-09-21T03:21:51.901928+0000","last_unstale":"2024-09-21T03:21:53.578269+0000","last_undegraded":"2024-09-21T03:21:53.578269+0000","last_fullsized":"2024-09-21T03:21:53.578269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:16.502189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:21:50.893596+0000","last_change":"2024-09-21T03:21:50.889500+0000","last_active":"2024-09-21T03:21:50.893596+0000","last_peered":"2024-09-21T03:21:50.893596+0000","last_clean":"2024-09-21T03:21:50.893596+0000","last_became_active":"2024-09-21T03:21:50.889200+0000","last_became_peered":"2024-09-21T03:21:50.889200+0000","last_unstale":"2024-09-21T03:21:50.893596+0000","last_undegraded":"2024-09-21T03:21:50.893596+0000","last_fullsized":"2024-09-21T03:21:50.893596+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:27.545400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899896+0000","last_change":"2024-09-21T03:21:51.903101+0000","last_active":"2024-09-21T03:21:52.899896+0000","last_peered":"2024-09-21T03:21:52.899896+0000","last_clean":"2024-09-21T03:21:52.899896+0000","last_became_active":"2024-09-21T03:21:51.902773+0000","last_became_peered":"2024-09-21T03:21:51.902773+0000","last_unstale":"2024-09-21T03:21:52.899896+0000","last_undegraded":"2024-09-21T03:21:52.899896+0000","last_fullsized":"2024-09-21T03:21:52.899896+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:01.885867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"79'1","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898638+0000","last_change":"2024-09-21T03:21:50.890186+0000","last_active":"2024-09-21T03:21:52.898638+0000","last_peered":"2024-09-21T03:21:52.898638+0000","last_clean":"2024-09-21T03:21:52.898638+0000","last_became_active":"2024-09-21T03:21:50.889742+0000","last_became_peered":"2024-09-21T03:21:50.889742+0000","last_unstale":"2024-09-21T03:21:52.898638+0000","last_undegraded":"2024-09-21T03:21:52.898638+0000","last_fullsized":"2024-09-21T03:21:52.898638+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:06.447091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898436+0000","last_change":"2024-09-21T03:21:51.902339+0000","last_active":"2024-09-21T03:21:52.898436+0000","last_peered":"2024-09-21T03:21:52.898436+0000","last_clean":"2024-09-21T03:21:52.898436+0000","last_became_active":"2024-09-21T03:21:51.902038+0000","last_became_peered":"2024-09-21T03:21:51.902038+0000","last_unstale":"2024-09-21T03:21:52.898436+0000","last_undegraded":"2024-09-21T03:21:52.898436+0000","last_fullsized":"2024-09-21T03:21:52.898436+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:15.428843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"79'1","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898008+0000","last_change":"2024-09-21T03:21:50.889708+0000","last_active":"2024-09-21T03:21:52.898008+0000","last_peered":"2024-09-21T03:21:52.898008+0000","last_clean":"2024-09-21T03:21:52.898008+0000","last_became_active":"2024-09-21T03:21:50.888284+0000","last_became_peered":"2024-09-21T03:21:50.888284+0000","last_unstale":"2024-09-21T03:21:52.898008+0000","last_undegraded":"2024-09-21T03:21:52.898008+0000","last_fullsized":"2024-09-21T03:21:52.898008+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:04.599704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577421+0000","last_change":"2024-09-21T03:21:51.905014+0000","last_active":"2024-09-21T03:21:53.577421+0000","last_peered":"2024-09-21T03:21:53.577421+0000","last_clean":"2024-09-21T03:21:53.577421+0000","last_became_active":"2024-09-21T03:21:51.904638+0000","last_became_peered":"2024-09-21T03:21:51.904638+0000","last_unstale":"2024-09-21T03:21:53.577421+0000","last_undegraded":"2024-09-21T03:21:53.577421+0000","last_fullsized":"2024-09-21T03:21:53.577421+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:40:07.583428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:21:50.893644+0000","last_change":"2024-09-21T03:21:50.890284+0000","last_active":"2024-09-21T03:21:50.893644+0000","last_peered":"2024-09-21T03:21:50.893644+0000","last_clean":"2024-09-21T03:21:50.893644+0000","last_became_active":"2024-09-21T03:21:50.890002+0000","last_became_peered":"2024-09-21T03:21:50.890002+0000","last_unstale":"2024-09-21T03:21:50.893644+0000","last_undegraded":"2024-09-21T03:21:50.893644+0000","last_fullsized":"2024-09-21T03:21:50.893644+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:50.274219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.576875+0000","last_change":"2024-09-21T03:21:51.899993+0000","last_active":"2024-09-21T03:21:53.576875+0000","last_peered":"2024-09-21T03:21:53.576875+0000","last_clean":"2024-09-21T03:21:53.576875+0000","last_became_active":"2024-09-21T03:21:51.899632+0000","last_became_peered":"2024-09-21T03:21:51.899632+0000","last_unstale":"2024-09-21T03:21:53.576875+0000","last_undegraded":"2024-09-21T03:21:53.576875+0000","last_fullsized":"2024-09-21T03:21:53.576875+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:15.015396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899544+0000","last_change":"2024-09-21T03:21:50.894291+0000","last_active":"2024-09-21T03:21:52.899544+0000","last_peered":"2024-09-21T03:21:52.899544+0000","last_clean":"2024-09-21T03:21:52.899544+0000","last_became_active":"2024-09-21T03:21:50.894001+0000","last_became_peered":"2024-09-21T03:21:50.894001+0000","last_unstale":"2024-09-21T03:21:52.899544+0000","last_undegraded":"2024-09-21T03:21:52.899544+0000","last_fullsized":"2024-09-21T03:21:52.899544+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:38:02.558962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577019+0000","last_change":"2024-09-21T03:21:51.894313+0000","last_active":"2024-09-21T03:21:53.577019+0000","last_peered":"2024-09-21T03:21:53.577019+0000","last_clean":"2024-09-21T03:21:53.577019+0000","last_became_active":"2024-09-21T03:21:51.894003+0000","last_became_peered":"2024-09-21T03:21:51.894003+0000","last_unstale":"2024-09-21T03:21:53.577019+0000","last_undegraded":"2024-09-21T03:21:53.577019+0000","last_fullsized":"2024-09-21T03:21:53.577019+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:55.444519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900543+0000","last_change":"2024-09-21T03:21:50.883437+0000","last_active":"2024-09-21T03:21:52.900543+0000","last_peered":"2024-09-21T03:21:52.900543+0000","last_clean":"2024-09-21T03:21:52.900543+0000","last_became_active":"2024-09-21T03:21:50.883111+0000","last_became_peered":"2024-09-21T03:21:50.883111+0000","last_unstale":"2024-09-21T03:21:52.900543+0000","last_undegraded":"2024-09-21T03:21:52.900543+0000","last_fullsized":"2024-09-21T03:21:52.900543+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:50.701648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:21:51.910716+0000","last_change":"2024-09-21T03:21:51.904652+0000","last_active":"2024-09-21T03:21:51.910716+0000","last_peered":"2024-09-21T03:21:51.910716+0000","last_clean":"2024-09-21T03:21:51.910716+0000","last_became_active":"2024-09-21T03:21:51.904284+0000","last_became_peered":"2024-09-21T03:21:51.904284+0000","last_unstale":"2024-09-21T03:21:51.910716+0000","last_undegraded":"2024-09-21T03:21:51.910716+0000","last_fullsized":"2024-09-21T03:21:51.910716+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:25.792212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900223+0000","last_change":"2024-09-21T03:21:50.890689+0000","last_active":"2024-09-21T03:21:52.900223+0000","last_peered":"2024-09-21T03:21:52.900223+0000","last_clean":"2024-09-21T03:21:52.900223+0000","last_became_active":"2024-09-21T03:21:50.890329+0000","last_became_peered":"2024-09-21T03:21:50.890329+0000","last_unstale":"2024-09-21T03:21:52.900223+0000","last_undegraded":"2024-09-21T03:21:52.900223+0000","last_fullsized":"2024-09-21T03:21:52.900223+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:46:35.605253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-09-21T03:21:50.876522+0000","last_change":"2024-09-21T03:21:50.876522+0000","last_active":"2024-09-21T03:21:50.865211+0000","last_peered":"2024-09-21T03:21:50.865211+0000","last_clean":"2024-09-21T03:21:50.865211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:50.876522+0000","last_undegraded":"2024-09-21T03:21:50.876522+0000","last_fullsized":"2024-09-21T03:21:50.876522+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"79'3","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899751+0000","last_change":"2024-09-21T03:21:50.891311+0000","last_active":"2024-09-21T03:21:52.899751+0000","last_peered":"2024-09-21T03:21:52.899751+0000","last_clean":"2024-09-21T03:21:52.899751+0000","last_became_active":"2024-09-21T03:21:50.890713+0000","last_became_peered":"2024-09-21T03:21:50.890713+0000","last_unstale":"2024-09-21T03:21:52.899751+0000","last_undegraded":"2024-09-21T03:21:52.899751+0000","last_fullsized":"2024-09-21T03:21:52.899751+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:41.919161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898766+0000","last_change":"2024-09-21T03:21:51.908205+0000","last_active":"2024-09-21T03:21:52.898766+0000","last_peered":"2024-09-21T03:21:52.898766+0000","last_clean":"2024-09-21T03:21:52.898766+0000","last_became_active":"2024-09-21T03:21:51.907239+0000","last_became_peered":"2024-09-21T03:21:51.907239+0000","last_unstale":"2024-09-21T03:21:52.898766+0000","last_undegraded":"2024-09-21T03:21:52.898766+0000","last_fullsized":"2024-09-21T03:21:52.898766+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:08:40.548484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"79'6","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:21:51.917164+0000","last_change":"2024-09-21T03:21:50.887898+0000","last_active":"2024-09-21T03:21:51.917164+0000","last_peered":"2024-09-21T03:21:51.917164+0000","last_clean":"2024-09-21T03:21:51.917164+0000","last_became_active":"2024-09-21T03:21:50.887571+0000","last_became_peered":"2024-09-21T03:21:50.887571+0000","last_unstale":"2024-09-21T03:21:51.917164+0000","last_undegraded":"2024-09-21T03:21:51.917164+0000","last_fullsized":"2024-09-21T03:21:51.917164+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:47:46.235056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-09-21T03:21:50.875320+0000","last_change":"2024-09-21T03:21:50.875320+0000","last_active":"2024-09-21T03:21:50.865211+0000","last_peered":"2024-09-21T03:21:50.865211+0000","last_clean":"2024-09-21T03:21:50.865211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:50.875320+0000","last_undegraded":"2024-09-21T03:21:50.875320+0000","last_fullsized":"2024-09-21T03:21:50.875320+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"79'2","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899993+0000","last_change":"2024-09-21T03:21:50.889245+0000","last_active":"2024-09-21T03:21:52.899993+0000","last_peered":"2024-09-21T03:21:52.899993+0000","last_clean":"2024-09-21T03:21:52.899993+0000","last_became_active":"2024-09-21T03:21:50.888937+0000","last_became_peered":"2024-09-21T03:21:50.888937+0000","last_unstale":"2024-09-21T03:21:52.899993+0000","last_undegraded":"2024-09-21T03:21:52.899993+0000","last_fullsized":"2024-09-21T03:21:52.899993+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:45:52.368843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.578464+0000","last_change":"2024-09-21T03:21:51.905440+0000","last_active":"2024-09-21T03:21:53.578464+0000","last_peered":"2024-09-21T03:21:53.578464+0000","last_clean":"2024-09-21T03:21:53.578464+0000","last_became_active":"2024-09-21T03:21:51.905015+0000","last_became_peered":"2024-09-21T03:21:51.905015+0000","last_unstale":"2024-09-21T03:21:53.578464+0000","last_undegraded":"2024-09-21T03:21:53.578464+0000","last_fullsized":"2024-09-21T03:21:53.578464+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:55.444519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.576949+0000","last_change":"2024-09-21T03:21:50.885645+0000","last_active":"2024-09-21T03:21:53.576949+0000","last_peered":"2024-09-21T03:21:53.576949+0000","last_clean":"2024-09-21T03:21:53.576949+0000","last_became_active":"2024-09-21T03:21:50.885322+0000","last_became_peered":"2024-09-21T03:21:50.885322+0000","last_unstale":"2024-09-21T03:21:53.576949+0000","last_undegraded":"2024-09-21T03:21:53.576949+0000","last_fullsized":"2024-09-21T03:21:53.576949+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:21:22.286598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899587+0000","last_change":"2024-09-21T03:21:51.904861+0000","last_active":"2024-09-21T03:21:52.899587+0000","last_peered":"2024-09-21T03:21:52.899587+0000","last_clean":"2024-09-21T03:21:52.899587+0000","last_became_active":"2024-09-21T03:21:51.904529+0000","last_became_peered":"2024-09-21T03:21:51.904529+0000","last_unstale":"2024-09-21T03:21:52.899587+0000","last_undegraded":"2024-09-21T03:21:52.899587+0000","last_fullsized":"2024-09-21T03:21:52.899587+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:14.676515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:21:51.892974+0000","last_change":"2024-09-21T03:21:50.893102+0000","last_active":"2024-09-21T03:21:51.892974+0000","last_peered":"2024-09-21T03:21:51.892974+0000","last_clean":"2024-09-21T03:21:51.892974+0000","last_became_active":"2024-09-21T03:21:50.892785+0000","last_became_peered":"2024-09-21T03:21:50.892785+0000","last_unstale":"2024-09-21T03:21:51.892974+0000","last_undegraded":"2024-09-21T03:21:51.892974+0000","last_fullsized":"2024-09-21T03:21:51.892974+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:17.615245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899583+0000","last_change":"2024-09-21T03:21:51.894797+0000","last_active":"2024-09-21T03:21:52.899583+0000","last_peered":"2024-09-21T03:21:52.899583+0000","last_clean":"2024-09-21T03:21:52.899583+0000","last_became_active":"2024-09-21T03:21:51.894373+0000","last_became_peered":"2024-09-21T03:21:51.894373+0000","last_unstale":"2024-09-21T03:21:52.899583+0000","last_undegraded":"2024-09-21T03:21:52.899583+0000","last_fullsized":"2024-09-21T03:21:52.899583+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:02:38.762310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:21:50.887615+0000","last_change":"2024-09-21T03:21:50.883788+0000","last_active":"2024-09-21T03:21:50.887615+0000","last_peered":"2024-09-21T03:21:50.887615+0000","last_clean":"2024-09-21T03:21:50.887615+0000","last_became_active":"2024-09-21T03:21:50.883369+0000","last_became_peered":"2024-09-21T03:21:50.883369+0000","last_unstale":"2024-09-21T03:21:50.887615+0000","last_undegraded":"2024-09-21T03:21:50.887615+0000","last_fullsized":"2024-09-21T03:21:50.887615+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:18.324712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.578242+0000","last_change":"2024-09-21T03:21:51.898550+0000","last_active":"2024-09-21T03:21:53.578242+0000","last_peered":"2024-09-21T03:21:53.578242+0000","last_clean":"2024-09-21T03:21:53.578242+0000","last_became_active":"2024-09-21T03:21:51.898201+0000","last_became_peered":"2024-09-21T03:21:51.898201+0000","last_unstale":"2024-09-21T03:21:53.578242+0000","last_undegraded":"2024-09-21T03:21:53.578242+0000","last_fullsized":"2024-09-21T03:21:53.578242+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:11:42.267787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"79'1","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900728+0000","last_change":"2024-09-21T03:21:50.889581+0000","last_active":"2024-09-21T03:21:52.900728+0000","last_peered":"2024-09-21T03:21:52.900728+0000","last_clean":"2024-09-21T03:21:52.900728+0000","last_became_active":"2024-09-21T03:21:50.889245+0000","last_became_peered":"2024-09-21T03:21:50.889245+0000","last_unstale":"2024-09-21T03:21:52.900728+0000","last_undegraded":"2024-09-21T03:21:52.900728+0000","last_fullsized":"2024-09-21T03:21:52.900728+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:00.493999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900576+0000","last_change":"2024-09-21T03:21:51.899099+0000","last_active":"2024-09-21T03:21:52.900576+0000","last_peered":"2024-09-21T03:21:52.900576+0000","last_clean":"2024-09-21T03:21:52.900576+0000","last_became_active":"2024-09-21T03:21:51.898350+0000","last_became_peered":"2024-09-21T03:21:51.898350+0000","last_unstale":"2024-09-21T03:21:52.900576+0000","last_undegraded":"2024-09-21T03:21:52.900576+0000","last_fullsized":"2024-09-21T03:21:52.900576+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:43.337873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:21:50.896489+0000","last_change":"2024-09-21T03:21:50.892793+0000","last_active":"2024-09-21T03:21:50.896489+0000","last_peered":"2024-09-21T03:21:50.896489+0000","last_clean":"2024-09-21T03:21:50.896489+0000","last_became_active":"2024-09-21T03:21:50.892459+0000","last_became_peered":"2024-09-21T03:21:50.892459+0000","last_unstale":"2024-09-21T03:21:50.896489+0000","last_undegraded":"2024-09-21T03:21:50.896489+0000","last_fullsized":"2024-09-21T03:21:50.896489+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:53:29.177030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898808+0000","last_change":"2024-09-21T03:21:51.893380+0000","last_active":"2024-09-21T03:21:52.898808+0000","last_peered":"2024-09-21T03:21:52.898808+0000","last_clean":"2024-09-21T03:21:52.898808+0000","last_became_active":"2024-09-21T03:21:51.893039+0000","last_became_peered":"2024-09-21T03:21:51.893039+0000","last_unstale":"2024-09-21T03:21:52.898808+0000","last_undegraded":"2024-09-21T03:21:52.898808+0000","last_fullsized":"2024-09-21T03:21:52.898808+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:11.163288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:21:50.893627+0000","last_change":"2024-09-21T03:21:50.891075+0000","last_active":"2024-09-21T03:21:50.893627+0000","last_peered":"2024-09-21T03:21:50.893627+0000","last_clean":"2024-09-21T03:21:50.893627+0000","last_became_active":"2024-09-21T03:21:50.890732+0000","last_became_peered":"2024-09-21T03:21:50.890732+0000","last_unstale":"2024-09-21T03:21:50.893627+0000","last_undegraded":"2024-09-21T03:21:50.893627+0000","last_fullsized":"2024-09-21T03:21:50.893627+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:08.020422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.270234+0000","last_change":"2024-09-21T03:21:51.907368+0000","last_active":"2024-09-21T03:21:53.270234+0000","last_peered":"2024-09-21T03:21:53.270234+0000","last_clean":"2024-09-21T03:21:53.270234+0000","last_became_active":"2024-09-21T03:21:51.906509+0000","last_became_peered":"2024-09-21T03:21:51.906509+0000","last_unstale":"2024-09-21T03:21:53.270234+0000","last_undegraded":"2024-09-21T03:21:53.270234+0000","last_fullsized":"2024-09-21T03:21:53.270234+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:31:41.794069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"79'2","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577118+0000","last_change":"2024-09-21T03:21:50.881909+0000","last_active":"2024-09-21T03:21:53.577118+0000","last_peered":"2024-09-21T03:21:53.577118+0000","last_clean":"2024-09-21T03:21:53.577118+0000","last_became_active":"2024-09-21T03:21:50.881541+0000","last_became_peered":"2024-09-21T03:21:50.881541+0000","last_unstale":"2024-09-21T03:21:53.577118+0000","last_undegraded":"2024-09-21T03:21:53.577118+0000","last_fullsized":"2024-09-21T03:21:53.577118+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:02.316385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:21:51.907914+0000","last_change":"2024-09-21T03:21:51.901261+0000","last_active":"2024-09-21T03:21:51.907914+0000","last_peered":"2024-09-21T03:21:51.907914+0000","last_clean":"2024-09-21T03:21:51.907914+0000","last_became_active":"2024-09-21T03:21:51.900954+0000","last_became_peered":"2024-09-21T03:21:51.900954+0000","last_unstale":"2024-09-21T03:21:51.907914+0000","last_undegraded":"2024-09-21T03:21:51.907914+0000","last_fullsized":"2024-09-21T03:21:51.907914+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:41.233859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.270134+0000","last_change":"2024-09-21T03:21:50.884684+0000","last_active":"2024-09-21T03:21:53.270134+0000","last_peered":"2024-09-21T03:21:53.270134+0000","last_clean":"2024-09-21T03:21:53.270134+0000","last_became_active":"2024-09-21T03:21:50.883447+0000","last_became_peered":"2024-09-21T03:21:50.883447+0000","last_unstale":"2024-09-21T03:21:53.270134+0000","last_undegraded":"2024-09-21T03:21:53.270134+0000","last_fullsized":"2024-09-21T03:21:53.270134+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:10.639009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.269927+0000","last_change":"2024-09-21T03:21:51.901038+0000","last_active":"2024-09-21T03:21:53.269927+0000","last_peered":"2024-09-21T03:21:53.269927+0000","last_clean":"2024-09-21T03:21:53.269927+0000","last_became_active":"2024-09-21T03:21:51.900648+0000","last_became_peered":"2024-09-21T03:21:51.900648+0000","last_unstale":"2024-09-21T03:21:53.269927+0000","last_undegraded":"2024-09-21T03:21:53.269927+0000","last_fullsized":"2024-09-21T03:21:53.269927+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:26.805582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.269785+0000","last_change":"2024-09-21T03:21:50.891133+0000","last_active":"2024-09-21T03:21:53.269785+0000","last_peered":"2024-09-21T03:21:53.269785+0000","last_clean":"2024-09-21T03:21:53.269785+0000","last_became_active":"2024-09-21T03:21:50.890817+0000","last_became_peered":"2024-09-21T03:21:50.890817+0000","last_unstale":"2024-09-21T03:21:53.269785+0000","last_undegraded":"2024-09-21T03:21:53.269785+0000","last_fullsized":"2024-09-21T03:21:53.269785+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:16.600569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:21:51.911382+0000","last_change":"2024-09-21T03:21:51.909921+0000","last_active":"2024-09-21T03:21:51.911382+0000","last_peered":"2024-09-21T03:21:51.911382+0000","last_clean":"2024-09-21T03:21:51.911382+0000","last_became_active":"2024-09-21T03:21:51.909432+0000","last_became_peered":"2024-09-21T03:21:51.909432+0000","last_unstale":"2024-09-21T03:21:51.911382+0000","last_undegraded":"2024-09-21T03:21:51.911382+0000","last_fullsized":"2024-09-21T03:21:51.911382+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:31.112370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.576433+0000","last_change":"2024-09-21T03:21:50.881109+0000","last_active":"2024-09-21T03:21:53.576433+0000","last_peered":"2024-09-21T03:21:53.576433+0000","last_clean":"2024-09-21T03:21:53.576433+0000","last_became_active":"2024-09-21T03:21:50.880825+0000","last_became_peered":"2024-09-21T03:21:50.880825+0000","last_unstale":"2024-09-21T03:21:53.576433+0000","last_undegraded":"2024-09-21T03:21:53.576433+0000","last_fullsized":"2024-09-21T03:21:53.576433+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:40:06.577759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899093+0000","last_change":"2024-09-21T03:21:51.900827+0000","last_active":"2024-09-21T03:21:52.899093+0000","last_peered":"2024-09-21T03:21:52.899093+0000","last_clean":"2024-09-21T03:21:52.899093+0000","last_became_active":"2024-09-21T03:21:51.900485+0000","last_became_peered":"2024-09-21T03:21:51.900485+0000","last_unstale":"2024-09-21T03:21:52.899093+0000","last_undegraded":"2024-09-21T03:21:52.899093+0000","last_fullsized":"2024-09-21T03:21:52.899093+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:40.866323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"79'2","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899992+0000","last_change":"2024-09-21T03:21:50.886982+0000","last_active":"2024-09-21T03:21:52.899992+0000","last_peered":"2024-09-21T03:21:52.899992+0000","last_clean":"2024-09-21T03:21:52.899992+0000","last_became_active":"2024-09-21T03:21:50.886661+0000","last_became_peered":"2024-09-21T03:21:50.886661+0000","last_unstale":"2024-09-21T03:21:52.899992+0000","last_undegraded":"2024-09-21T03:21:52.899992+0000","last_fullsized":"2024-09-21T03:21:52.899992+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:31:40.788400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.578330+0000","last_change":"2024-09-21T03:21:51.909713+0000","last_active":"2024-09-21T03:21:53.578330+0000","last_peered":"2024-09-21T03:21:53.578330+0000","last_clean":"2024-09-21T03:21:53.578330+0000","last_became_active":"2024-09-21T03:21:51.909373+0000","last_became_peered":"2024-09-21T03:21:51.909373+0000","last_unstale":"2024-09-21T03:21:53.578330+0000","last_undegraded":"2024-09-21T03:21:53.578330+0000","last_fullsized":"2024-09-21T03:21:53.578330+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:52.176078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"79'1","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899881+0000","last_change":"2024-09-21T03:21:50.891027+0000","last_active":"2024-09-21T03:21:52.899881+0000","last_peered":"2024-09-21T03:21:52.899881+0000","last_clean":"2024-09-21T03:21:52.899881+0000","last_became_active":"2024-09-21T03:21:50.890732+0000","last_became_peered":"2024-09-21T03:21:50.890732+0000","last_unstale":"2024-09-21T03:21:52.899881+0000","last_undegraded":"2024-09-21T03:21:52.899881+0000","last_fullsized":"2024-09-21T03:21:52.899881+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:21.808526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900708+0000","last_change":"2024-09-21T03:21:51.905815+0000","last_active":"2024-09-21T03:21:52.900708+0000","last_peered":"2024-09-21T03:21:52.900708+0000","last_clean":"2024-09-21T03:21:52.900708+0000","last_became_active":"2024-09-21T03:21:51.905422+0000","last_became_peered":"2024-09-21T03:21:51.905422+0000","last_unstale":"2024-09-21T03:21:52.900708+0000","last_undegraded":"2024-09-21T03:21:52.900708+0000","last_fullsized":"2024-09-21T03:21:52.900708+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:31.675347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899899+0000","last_change":"2024-09-21T03:21:50.891090+0000","last_active":"2024-09-21T03:21:52.899899+0000","last_peered":"2024-09-21T03:21:52.899899+0000","last_clean":"2024-09-21T03:21:52.899899+0000","last_became_active":"2024-09-21T03:21:50.890775+0000","last_became_peered":"2024-09-21T03:21:50.890775+0000","last_unstale":"2024-09-21T03:21:52.899899+0000","last_undegraded":"2024-09-21T03:21:52.899899+0000","last_fullsized":"2024-09-21T03:21:52.899899+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:28.931234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899083+0000","last_change":"2024-09-21T03:21:51.907507+0000","last_active":"2024-09-21T03:21:52.899083+0000","last_peered":"2024-09-21T03:21:52.899083+0000","last_clean":"2024-09-21T03:21:52.899083+0000","last_became_active":"2024-09-21T03:21:51.906065+0000","last_became_peered":"2024-09-21T03:21:51.906065+0000","last_unstale":"2024-09-21T03:21:52.899083+0000","last_undegraded":"2024-09-21T03:21:52.899083+0000","last_fullsized":"2024-09-21T03:21:52.899083+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:34:58.232355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900634+0000","last_change":"2024-09-21T03:21:50.882989+0000","last_active":"2024-09-21T03:21:52.900634+0000","last_peered":"2024-09-21T03:21:52.900634+0000","last_clean":"2024-09-21T03:21:52.900634+0000","last_became_active":"2024-09-21T03:21:50.882493+0000","last_became_peered":"2024-09-21T03:21:50.882493+0000","last_unstale":"2024-09-21T03:21:52.900634+0000","last_undegraded":"2024-09-21T03:21:52.900634+0000","last_fullsized":"2024-09-21T03:21:52.900634+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:48.422744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:21:51.908069+0000","last_change":"2024-09-21T03:21:51.901903+0000","last_active":"2024-09-21T03:21:51.908069+0000","last_peered":"2024-09-21T03:21:51.908069+0000","last_clean":"2024-09-21T03:21:51.908069+0000","last_became_active":"2024-09-21T03:21:51.901578+0000","last_became_peered":"2024-09-21T03:21:51.901578+0000","last_unstale":"2024-09-21T03:21:51.908069+0000","last_undegraded":"2024-09-21T03:21:51.908069+0000","last_fullsized":"2024-09-21T03:21:51.908069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:26.773312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:21:50.889552+0000","last_change":"2024-09-21T03:21:50.886896+0000","last_active":"2024-09-21T03:21:50.889552+0000","last_peered":"2024-09-21T03:21:50.889552+0000","last_clean":"2024-09-21T03:21:50.889552+0000","last_became_active":"2024-09-21T03:21:50.886606+0000","last_became_peered":"2024-09-21T03:21:50.886606+0000","last_unstale":"2024-09-21T03:21:50.889552+0000","last_undegraded":"2024-09-21T03:21:50.889552+0000","last_fullsized":"2024-09-21T03:21:50.889552+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:36:12.594255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-09-21T03:21:50.877825+0000","last_change":"2024-09-21T03:21:50.877825+0000","last_active":"2024-09-21T03:21:50.865211+0000","last_peered":"2024-09-21T03:21:50.865211+0000","last_clean":"2024-09-21T03:21:50.865211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:50.877825+0000","last_undegraded":"2024-09-21T03:21:50.877825+0000","last_fullsized":"2024-09-21T03:21:50.877825+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898172+0000","last_change":"2024-09-21T03:21:50.888581+0000","last_active":"2024-09-21T03:21:52.898172+0000","last_peered":"2024-09-21T03:21:52.898172+0000","last_clean":"2024-09-21T03:21:52.898172+0000","last_became_active":"2024-09-21T03:21:50.887896+0000","last_became_peered":"2024-09-21T03:21:50.887896+0000","last_unstale":"2024-09-21T03:21:52.898172+0000","last_undegraded":"2024-09-21T03:21:52.898172+0000","last_fullsized":"2024-09-21T03:21:52.898172+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:00.880198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577694+0000","last_change":"2024-09-21T03:21:51.903858+0000","last_active":"2024-09-21T03:21:53.577694+0000","last_peered":"2024-09-21T03:21:53.577694+0000","last_clean":"2024-09-21T03:21:53.577694+0000","last_became_active":"2024-09-21T03:21:51.903527+0000","last_became_peered":"2024-09-21T03:21:51.903527+0000","last_unstale":"2024-09-21T03:21:53.577694+0000","last_undegraded":"2024-09-21T03:21:53.577694+0000","last_fullsized":"2024-09-21T03:21:53.577694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:21:23.292266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900099+0000","last_change":"2024-09-21T03:21:50.891506+0000","last_active":"2024-09-21T03:21:52.900099+0000","last_peered":"2024-09-21T03:21:52.900099+0000","last_clean":"2024-09-21T03:21:52.900099+0000","last_became_active":"2024-09-21T03:21:50.891130+0000","last_became_peered":"2024-09-21T03:21:50.891130+0000","last_unstale":"2024-09-21T03:21:52.900099+0000","last_undegraded":"2024-09-21T03:21:52.900099+0000","last_fullsized":"2024-09-21T03:21:52.900099+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:16.126547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899967+0000","last_change":"2024-09-21T03:21:51.894997+0000","last_active":"2024-09-21T03:21:52.899967+0000","last_peered":"2024-09-21T03:21:52.899967+0000","last_clean":"2024-09-21T03:21:52.899967+0000","last_became_active":"2024-09-21T03:21:51.894658+0000","last_became_peered":"2024-09-21T03:21:51.894658+0000","last_unstale":"2024-09-21T03:21:52.899967+0000","last_undegraded":"2024-09-21T03:21:52.899967+0000","last_fullsized":"2024-09-21T03:21:52.899967+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:09.488852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.897965+0000","last_change":"2024-09-21T03:21:50.891199+0000","last_active":"2024-09-21T03:21:52.897965+0000","last_peered":"2024-09-21T03:21:52.897965+0000","last_clean":"2024-09-21T03:21:52.897965+0000","last_became_active":"2024-09-21T03:21:50.890837+0000","last_became_peered":"2024-09-21T03:21:50.890837+0000","last_unstale":"2024-09-21T03:21:52.897965+0000","last_undegraded":"2024-09-21T03:21:52.897965+0000","last_fullsized":"2024-09-21T03:21:52.897965+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:54.618581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900002+0000","last_change":"2024-09-21T03:21:51.899525+0000","last_active":"2024-09-21T03:21:52.900002+0000","last_peered":"2024-09-21T03:21:52.900002+0000","last_clean":"2024-09-21T03:21:52.900002+0000","last_became_active":"2024-09-21T03:21:51.899003+0000","last_became_peered":"2024-09-21T03:21:51.899003+0000","last_unstale":"2024-09-21T03:21:52.900002+0000","last_undegraded":"2024-09-21T03:21:52.900002+0000","last_fullsized":"2024-09-21T03:21:52.900002+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:51.707317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"79'1","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.578284+0000","last_change":"2024-09-21T03:21:50.886216+0000","last_active":"2024-09-21T03:21:53.578284+0000","last_peered":"2024-09-21T03:21:53.578284+0000","last_clean":"2024-09-21T03:21:53.578284+0000","last_became_active":"2024-09-21T03:21:50.885887+0000","last_became_peered":"2024-09-21T03:21:50.885887+0000","last_unstale":"2024-09-21T03:21:53.578284+0000","last_undegraded":"2024-09-21T03:21:53.578284+0000","last_fullsized":"2024-09-21T03:21:53.578284+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:08.483183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":219,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577601+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:21:53.577601+0000","last_peered":"2024-09-21T03:21:53.577601+0000","last_clean":"2024-09-21T03:21:53.577601+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:21:53.577601+0000","last_undegraded":"2024-09-21T03:21:53.577601+0000","last_fullsized":"2024-09-21T03:21:53.577601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25,"ondisk_log_size":25,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509488,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1560576,"data_stored":991979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509487,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":974848,"data_stored":402235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509486,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":978944,"data_stored":403175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509486,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":962560,"data_stored":401541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509487,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":974848,"data_stored":403153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509487,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":966656,"data_stored":402123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509487,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":987136,"data_stored":408035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32696,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339144,"statfs":{"total":96636764160,"available":96603283456,"internally_reserved":0,"allocated":1544192,"data_stored":985134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:21:55.954 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:21:56.104 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.102+0000 7f27a6206640 1 -- 172.21.15.105:0/1627774331 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27a00cf320 msgr2=0x7f27a00ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:56.104 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.102+0000 7f27a6206640 1 --2- 172.21.15.105:0/1627774331 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27a00cf320 0x7f27a00ccbc0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f2794005fd0 tx=0x7f279402a670 comp rx=0 tx=0).stop 2024-09-21T03:21:56.104 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.102+0000 7f27a6206640 1 -- 172.21.15.105:0/1627774331 shutdown_connections 2024-09-21T03:21:56.104 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.102+0000 7f27a6206640 1 --2- 172.21.15.105:0/1627774331 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27a00cf320 0x7f27a00ccbc0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:56.104 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.102+0000 7f27a6206640 1 -- 172.21.15.105:0/1627774331 >> 172.21.15.105:0/1627774331 conn(0x7f27a006d4f0 msgr2=0x7f27a0071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:56.104 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.102+0000 7f27a6206640 1 -- 172.21.15.105:0/1627774331 shutdown_connections 2024-09-21T03:21:56.104 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.102+0000 7f27a6206640 1 -- 172.21.15.105:0/1627774331 wait complete. 2024-09-21T03:21:56.105 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.103+0000 7f27a6206640 1 Processor -- start 2024-09-21T03:21:56.105 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.104+0000 7f27a6206640 1 -- start start 2024-09-21T03:21:56.108 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.105+0000 7f27a6206640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27a00b7cc0 0x7f27a00b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:56.108 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.105+0000 7f27a6206640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27a00cf320 0x7f27a01f73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:56.108 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.105+0000 7f27a6206640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27a01600b0 0x7f27a01f7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:56.108 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.105+0000 7f27a6206640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f27a00d15b0 con 0x7f27a01600b0 2024-09-21T03:21:56.108 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.105+0000 7f27a6206640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f27a00d1430 con 0x7f27a00cf320 2024-09-21T03:21:56.108 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.105+0000 7f27a6206640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f27a00d1730 con 0x7f27a00b7cc0 2024-09-21T03:21:56.108 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.105+0000 7f279ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27a01600b0 0x7f27a01f7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:56.108 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.105+0000 7f279ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27a01600b0 0x7f27a01f7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:45314/0 (socket says 172.21.15.105:45314) 2024-09-21T03:21:56.108 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.105+0000 7f279ffff640 1 -- 172.21.15.105:0/2796942254 learned_addr learned my addr 172.21.15.105:0/2796942254 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:56.108 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.105+0000 7f279f7fe640 1 --2- 172.21.15.105:0/2796942254 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27a00b7cc0 0x7f27a00b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:56.108 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.105+0000 7f279effd640 1 --2- 172.21.15.105:0/2796942254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27a00cf320 0x7f27a01f73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:56.108 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.105+0000 7f279ffff640 1 -- 172.21.15.105:0/2796942254 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27a00b7cc0 msgr2=0x7f27a00b3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:56.109 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.105+0000 7f279ffff640 1 --2- 172.21.15.105:0/2796942254 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27a00b7cc0 0x7f27a00b3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:56.109 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.105+0000 7f279ffff640 1 -- 172.21.15.105:0/2796942254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27a00cf320 msgr2=0x7f27a01f73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:56.109 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.105+0000 7f279ffff640 1 --2- 172.21.15.105:0/2796942254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27a00cf320 0x7f27a01f73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:56.109 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.105+0000 7f279ffff640 1 -- 172.21.15.105:0/2796942254 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27a00b4290 con 0x7f27a01600b0 2024-09-21T03:21:56.109 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.106+0000 7f279ffff640 1 --2- 172.21.15.105:0/2796942254 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27a01600b0 0x7f27a01f7900 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f2798002230 tx=0x7f279800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:56.109 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.106+0000 7f2787fff640 1 -- 172.21.15.105:0/2796942254 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2798003b70 con 0x7f27a01600b0 2024-09-21T03:21:56.109 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.106+0000 7f2787fff640 1 -- 172.21.15.105:0/2796942254 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2798003d10 con 0x7f27a01600b0 2024-09-21T03:21:56.109 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.106+0000 7f27a6206640 1 -- 172.21.15.105:0/2796942254 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27a01f8140 con 0x7f27a01600b0 2024-09-21T03:21:56.109 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.106+0000 7f2787fff640 1 -- 172.21.15.105:0/2796942254 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2798005330 con 0x7f27a01600b0 2024-09-21T03:21:56.109 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.106+0000 7f27a6206640 1 -- 172.21.15.105:0/2796942254 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27a01570e0 con 0x7f27a01600b0 2024-09-21T03:21:56.110 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.107+0000 7f27a6206640 1 -- 172.21.15.105:0/2796942254 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27a0157310 con 0x7f27a01600b0 2024-09-21T03:21:56.110 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.108+0000 7f2787fff640 1 -- 172.21.15.105:0/2796942254 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f27980056e0 con 0x7f27a01600b0 2024-09-21T03:21:56.110 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.108+0000 7f2787fff640 1 --2- 172.21.15.105:0/2796942254 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f278c078b90 0x7f278c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:56.110 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.108+0000 7f2787fff640 1 -- 172.21.15.105:0/2796942254 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f279809abd0 con 0x7f27a01600b0 2024-09-21T03:21:56.110 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.108+0000 7f279f7fe640 1 --2- 172.21.15.105:0/2796942254 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f278c078b90 0x7f278c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:56.110 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.109+0000 7f279f7fe640 1 --2- 172.21.15.105:0/2796942254 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f278c078b90 0x7f278c07b0a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2790000f60 tx=0x7f2790009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:56.114 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.112+0000 7f2787fff640 1 -- 172.21.15.105:0/2796942254 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f27a0157310 con 0x7f27a01600b0 2024-09-21T03:21:56.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.285+0000 7f27a6206640 1 -- 172.21.15.105:0/2796942254 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f27a00ccbc0 con 0x7f278c078b90 2024-09-21T03:21:56.291 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.289+0000 7f2787fff640 1 -- 172.21.15.105:0/2796942254 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251718 (secure 0 0 0) 0x7f27a00ccbc0 con 0x7f278c078b90 2024-09-21T03:21:56.293 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:56.295 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:21:56.296 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.292+0000 7f27a6206640 1 -- 172.21.15.105:0/2796942254 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f278c078b90 msgr2=0x7f278c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:56.296 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.292+0000 7f27a6206640 1 --2- 172.21.15.105:0/2796942254 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f278c078b90 0x7f278c07b0a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2790000f60 tx=0x7f2790009040 comp rx=0 tx=0).stop 2024-09-21T03:21:56.296 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.292+0000 7f27a6206640 1 -- 172.21.15.105:0/2796942254 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27a01600b0 msgr2=0x7f27a01f7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:56.296 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.292+0000 7f27a6206640 1 --2- 172.21.15.105:0/2796942254 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27a01600b0 0x7f27a01f7900 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f2798002230 tx=0x7f279800cb90 comp rx=0 tx=0).stop 2024-09-21T03:21:56.296 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.292+0000 7f27a6206640 1 -- 172.21.15.105:0/2796942254 shutdown_connections 2024-09-21T03:21:56.297 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.292+0000 7f27a6206640 1 --2- 172.21.15.105:0/2796942254 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f278c078b90 0x7f278c07b0a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:56.297 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.292+0000 7f27a6206640 1 --2- 172.21.15.105:0/2796942254 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27a01600b0 0x7f27a01f7900 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:56.297 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.292+0000 7f27a6206640 1 --2- 172.21.15.105:0/2796942254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27a00cf320 0x7f27a01f73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:56.297 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.292+0000 7f27a6206640 1 --2- 172.21.15.105:0/2796942254 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27a00b7cc0 0x7f27a00b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:56.297 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.292+0000 7f27a6206640 1 -- 172.21.15.105:0/2796942254 >> 172.21.15.105:0/2796942254 conn(0x7f27a006d4f0 msgr2=0x7f27a0071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:56.297 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.292+0000 7f27a6206640 1 -- 172.21.15.105:0/2796942254 shutdown_connections 2024-09-21T03:21:56.297 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.293+0000 7f27a6206640 1 -- 172.21.15.105:0/2796942254 wait complete. 2024-09-21T03:21:56.305 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":183,"stamp":"2024-09-21T03:21:55.331418+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":125,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":94,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258272,"kb_used_data":8740,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716448,"statfs":{"total":773094113280,"available":772829642752,"internally_reserved":0,"allocated":8949760,"data_stored":4397375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.464815"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900303+0000","last_change":"2024-09-21T03:21:51.891281+0000","last_active":"2024-09-21T03:21:52.900303+0000","last_peered":"2024-09-21T03:21:52.900303+0000","last_clean":"2024-09-21T03:21:52.900303+0000","last_became_active":"2024-09-21T03:21:51.890980+0000","last_became_peered":"2024-09-21T03:21:51.890980+0000","last_unstale":"2024-09-21T03:21:52.900303+0000","last_undegraded":"2024-09-21T03:21:52.900303+0000","last_fullsized":"2024-09-21T03:21:52.900303+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:11.163288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899999+0000","last_change":"2024-09-21T03:21:51.898465+0000","last_active":"2024-09-21T03:21:52.899999+0000","last_peered":"2024-09-21T03:21:52.899999+0000","last_clean":"2024-09-21T03:21:52.899999+0000","last_became_active":"2024-09-21T03:21:51.897528+0000","last_became_peered":"2024-09-21T03:21:51.897528+0000","last_unstale":"2024-09-21T03:21:52.899999+0000","last_undegraded":"2024-09-21T03:21:52.899999+0000","last_fullsized":"2024-09-21T03:21:52.899999+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:58.179373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.578114+0000","last_change":"2024-09-21T03:21:51.910099+0000","last_active":"2024-09-21T03:21:53.578114+0000","last_peered":"2024-09-21T03:21:53.578114+0000","last_clean":"2024-09-21T03:21:53.578114+0000","last_became_active":"2024-09-21T03:21:51.908796+0000","last_became_peered":"2024-09-21T03:21:51.908796+0000","last_unstale":"2024-09-21T03:21:53.578114+0000","last_undegraded":"2024-09-21T03:21:53.578114+0000","last_fullsized":"2024-09-21T03:21:53.578114+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:03.322054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.270250+0000","last_change":"2024-09-21T03:21:51.903031+0000","last_active":"2024-09-21T03:21:53.270250+0000","last_peered":"2024-09-21T03:21:53.270250+0000","last_clean":"2024-09-21T03:21:53.270250+0000","last_became_active":"2024-09-21T03:21:51.902704+0000","last_became_peered":"2024-09-21T03:21:51.902704+0000","last_unstale":"2024-09-21T03:21:53.270250+0000","last_undegraded":"2024-09-21T03:21:53.270250+0000","last_fullsized":"2024-09-21T03:21:53.270250+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:22.814195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898426+0000","last_change":"2024-09-21T03:21:51.894670+0000","last_active":"2024-09-21T03:21:52.898426+0000","last_peered":"2024-09-21T03:21:52.898426+0000","last_clean":"2024-09-21T03:21:52.898426+0000","last_became_active":"2024-09-21T03:21:51.894129+0000","last_became_peered":"2024-09-21T03:21:51.894129+0000","last_unstale":"2024-09-21T03:21:52.898426+0000","last_undegraded":"2024-09-21T03:21:52.898426+0000","last_fullsized":"2024-09-21T03:21:52.898426+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:10:23.798227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:21:51.911046+0000","last_change":"2024-09-21T03:21:51.905285+0000","last_active":"2024-09-21T03:21:51.911046+0000","last_peered":"2024-09-21T03:21:51.911046+0000","last_clean":"2024-09-21T03:21:51.911046+0000","last_became_active":"2024-09-21T03:21:51.904901+0000","last_became_peered":"2024-09-21T03:21:51.904901+0000","last_unstale":"2024-09-21T03:21:51.911046+0000","last_undegraded":"2024-09-21T03:21:51.911046+0000","last_fullsized":"2024-09-21T03:21:51.911046+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:38.052497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.269833+0000","last_change":"2024-09-21T03:21:51.905587+0000","last_active":"2024-09-21T03:21:53.269833+0000","last_peered":"2024-09-21T03:21:53.269833+0000","last_clean":"2024-09-21T03:21:53.269833+0000","last_became_active":"2024-09-21T03:21:51.905274+0000","last_became_peered":"2024-09-21T03:21:51.905274+0000","last_unstale":"2024-09-21T03:21:53.269833+0000","last_undegraded":"2024-09-21T03:21:53.269833+0000","last_fullsized":"2024-09-21T03:21:53.269833+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:59.109536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:21:51.910644+0000","last_change":"2024-09-21T03:21:51.907560+0000","last_active":"2024-09-21T03:21:51.910644+0000","last_peered":"2024-09-21T03:21:51.910644+0000","last_clean":"2024-09-21T03:21:51.910644+0000","last_became_active":"2024-09-21T03:21:51.907143+0000","last_became_peered":"2024-09-21T03:21:51.907143+0000","last_unstale":"2024-09-21T03:21:51.910644+0000","last_undegraded":"2024-09-21T03:21:51.910644+0000","last_fullsized":"2024-09-21T03:21:51.910644+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:16.865640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:21:51.911342+0000","last_change":"2024-09-21T03:21:51.908687+0000","last_active":"2024-09-21T03:21:51.911342+0000","last_peered":"2024-09-21T03:21:51.911342+0000","last_clean":"2024-09-21T03:21:51.911342+0000","last_became_active":"2024-09-21T03:21:51.908386+0000","last_became_peered":"2024-09-21T03:21:51.908386+0000","last_unstale":"2024-09-21T03:21:51.911342+0000","last_undegraded":"2024-09-21T03:21:51.911342+0000","last_fullsized":"2024-09-21T03:21:51.911342+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:50:08.646746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900295+0000","last_change":"2024-09-21T03:21:51.903820+0000","last_active":"2024-09-21T03:21:52.900295+0000","last_peered":"2024-09-21T03:21:52.900295+0000","last_clean":"2024-09-21T03:21:52.900295+0000","last_became_active":"2024-09-21T03:21:51.903292+0000","last_became_peered":"2024-09-21T03:21:51.903292+0000","last_unstale":"2024-09-21T03:21:52.900295+0000","last_undegraded":"2024-09-21T03:21:52.900295+0000","last_fullsized":"2024-09-21T03:21:52.900295+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:02.311208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899833+0000","last_change":"2024-09-21T03:21:51.898032+0000","last_active":"2024-09-21T03:21:52.899833+0000","last_peered":"2024-09-21T03:21:52.899833+0000","last_clean":"2024-09-21T03:21:52.899833+0000","last_became_active":"2024-09-21T03:21:51.897696+0000","last_became_peered":"2024-09-21T03:21:51.897696+0000","last_unstale":"2024-09-21T03:21:52.899833+0000","last_undegraded":"2024-09-21T03:21:52.899833+0000","last_fullsized":"2024-09-21T03:21:52.899833+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:55.624250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900229+0000","last_change":"2024-09-21T03:21:51.890813+0000","last_active":"2024-09-21T03:21:52.900229+0000","last_peered":"2024-09-21T03:21:52.900229+0000","last_clean":"2024-09-21T03:21:52.900229+0000","last_became_active":"2024-09-21T03:21:51.890330+0000","last_became_peered":"2024-09-21T03:21:51.890330+0000","last_unstale":"2024-09-21T03:21:52.900229+0000","last_undegraded":"2024-09-21T03:21:52.900229+0000","last_fullsized":"2024-09-21T03:21:52.900229+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:52:04.989198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.578126+0000","last_change":"2024-09-21T03:21:51.901017+0000","last_active":"2024-09-21T03:21:53.578126+0000","last_peered":"2024-09-21T03:21:53.578126+0000","last_clean":"2024-09-21T03:21:53.578126+0000","last_became_active":"2024-09-21T03:21:51.900655+0000","last_became_peered":"2024-09-21T03:21:51.900655+0000","last_unstale":"2024-09-21T03:21:53.578126+0000","last_undegraded":"2024-09-21T03:21:53.578126+0000","last_fullsized":"2024-09-21T03:21:53.578126+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:24.486253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.270005+0000","last_change":"2024-09-21T03:21:51.907469+0000","last_active":"2024-09-21T03:21:53.270005+0000","last_peered":"2024-09-21T03:21:53.270005+0000","last_clean":"2024-09-21T03:21:53.270005+0000","last_became_active":"2024-09-21T03:21:51.907159+0000","last_became_peered":"2024-09-21T03:21:51.907159+0000","last_unstale":"2024-09-21T03:21:53.270005+0000","last_undegraded":"2024-09-21T03:21:53.270005+0000","last_fullsized":"2024-09-21T03:21:53.270005+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:45:31.092132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.576587+0000","last_change":"2024-09-21T03:21:51.900790+0000","last_active":"2024-09-21T03:21:53.576587+0000","last_peered":"2024-09-21T03:21:53.576587+0000","last_clean":"2024-09-21T03:21:53.576587+0000","last_became_active":"2024-09-21T03:21:51.900484+0000","last_became_peered":"2024-09-21T03:21:51.900484+0000","last_unstale":"2024-09-21T03:21:53.576587+0000","last_undegraded":"2024-09-21T03:21:53.576587+0000","last_fullsized":"2024-09-21T03:21:53.576587+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:52.176078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898035+0000","last_change":"2024-09-21T03:21:51.896039+0000","last_active":"2024-09-21T03:21:52.898035+0000","last_peered":"2024-09-21T03:21:52.898035+0000","last_clean":"2024-09-21T03:21:52.898035+0000","last_became_active":"2024-09-21T03:21:51.895701+0000","last_became_peered":"2024-09-21T03:21:51.895701+0000","last_unstale":"2024-09-21T03:21:52.898035+0000","last_undegraded":"2024-09-21T03:21:52.898035+0000","last_fullsized":"2024-09-21T03:21:52.898035+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:05.844984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898871+0000","last_change":"2024-09-21T03:21:51.903045+0000","last_active":"2024-09-21T03:21:52.898871+0000","last_peered":"2024-09-21T03:21:52.898871+0000","last_clean":"2024-09-21T03:21:52.898871+0000","last_became_active":"2024-09-21T03:21:51.902734+0000","last_became_peered":"2024-09-21T03:21:51.902734+0000","last_unstale":"2024-09-21T03:21:52.898871+0000","last_undegraded":"2024-09-21T03:21:52.898871+0000","last_fullsized":"2024-09-21T03:21:52.898871+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:05.726920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.270049+0000","last_change":"2024-09-21T03:21:51.898501+0000","last_active":"2024-09-21T03:21:53.270049+0000","last_peered":"2024-09-21T03:21:53.270049+0000","last_clean":"2024-09-21T03:21:53.270049+0000","last_became_active":"2024-09-21T03:21:51.898186+0000","last_became_peered":"2024-09-21T03:21:51.898186+0000","last_unstale":"2024-09-21T03:21:53.270049+0000","last_undegraded":"2024-09-21T03:21:53.270049+0000","last_fullsized":"2024-09-21T03:21:53.270049+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:13.850020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-09-21T03:21:50.877538+0000","last_change":"2024-09-21T03:21:50.877538+0000","last_active":"2024-09-21T03:21:50.865211+0000","last_peered":"2024-09-21T03:21:50.865211+0000","last_clean":"2024-09-21T03:21:50.865211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:50.877538+0000","last_undegraded":"2024-09-21T03:21:50.877538+0000","last_fullsized":"2024-09-21T03:21:50.877538+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.270225+0000","last_change":"2024-09-21T03:21:51.909012+0000","last_active":"2024-09-21T03:21:53.270225+0000","last_peered":"2024-09-21T03:21:53.270225+0000","last_clean":"2024-09-21T03:21:53.270225+0000","last_became_active":"2024-09-21T03:21:51.908626+0000","last_became_peered":"2024-09-21T03:21:51.908626+0000","last_unstale":"2024-09-21T03:21:53.270225+0000","last_undegraded":"2024-09-21T03:21:53.270225+0000","last_fullsized":"2024-09-21T03:21:53.270225+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:24.606033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.270080+0000","last_change":"2024-09-21T03:21:51.907947+0000","last_active":"2024-09-21T03:21:53.270080+0000","last_peered":"2024-09-21T03:21:53.270080+0000","last_clean":"2024-09-21T03:21:53.270080+0000","last_became_active":"2024-09-21T03:21:51.907646+0000","last_became_peered":"2024-09-21T03:21:51.907646+0000","last_unstale":"2024-09-21T03:21:53.270080+0000","last_undegraded":"2024-09-21T03:21:53.270080+0000","last_fullsized":"2024-09-21T03:21:53.270080+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:45:53.374512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900150+0000","last_change":"2024-09-21T03:21:51.905074+0000","last_active":"2024-09-21T03:21:52.900150+0000","last_peered":"2024-09-21T03:21:52.900150+0000","last_clean":"2024-09-21T03:21:52.900150+0000","last_became_active":"2024-09-21T03:21:51.904768+0000","last_became_peered":"2024-09-21T03:21:51.904768+0000","last_unstale":"2024-09-21T03:21:52.900150+0000","last_undegraded":"2024-09-21T03:21:52.900150+0000","last_fullsized":"2024-09-21T03:21:52.900150+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:34.814915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899934+0000","last_change":"2024-09-21T03:21:51.908346+0000","last_active":"2024-09-21T03:21:52.899934+0000","last_peered":"2024-09-21T03:21:52.899934+0000","last_clean":"2024-09-21T03:21:52.899934+0000","last_became_active":"2024-09-21T03:21:51.907761+0000","last_became_peered":"2024-09-21T03:21:51.907761+0000","last_unstale":"2024-09-21T03:21:52.899934+0000","last_undegraded":"2024-09-21T03:21:52.899934+0000","last_fullsized":"2024-09-21T03:21:52.899934+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:31.112370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.269875+0000","last_change":"2024-09-21T03:21:51.907169+0000","last_active":"2024-09-21T03:21:53.269875+0000","last_peered":"2024-09-21T03:21:53.269875+0000","last_clean":"2024-09-21T03:21:53.269875+0000","last_became_active":"2024-09-21T03:21:51.906861+0000","last_became_peered":"2024-09-21T03:21:51.906861+0000","last_unstale":"2024-09-21T03:21:53.269875+0000","last_undegraded":"2024-09-21T03:21:53.269875+0000","last_fullsized":"2024-09-21T03:21:53.269875+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:50.311072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900138+0000","last_change":"2024-09-21T03:21:51.898498+0000","last_active":"2024-09-21T03:21:52.900138+0000","last_peered":"2024-09-21T03:21:52.900138+0000","last_clean":"2024-09-21T03:21:52.900138+0000","last_became_active":"2024-09-21T03:21:51.898168+0000","last_became_peered":"2024-09-21T03:21:51.898168+0000","last_unstale":"2024-09-21T03:21:52.900138+0000","last_undegraded":"2024-09-21T03:21:52.900138+0000","last_fullsized":"2024-09-21T03:21:52.900138+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:46.365557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.578351+0000","last_change":"2024-09-21T03:21:51.903010+0000","last_active":"2024-09-21T03:21:53.578351+0000","last_peered":"2024-09-21T03:21:53.578351+0000","last_clean":"2024-09-21T03:21:53.578351+0000","last_became_active":"2024-09-21T03:21:51.902660+0000","last_became_peered":"2024-09-21T03:21:51.902660+0000","last_unstale":"2024-09-21T03:21:53.578351+0000","last_undegraded":"2024-09-21T03:21:53.578351+0000","last_fullsized":"2024-09-21T03:21:53.578351+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:00:43.998502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898480+0000","last_change":"2024-09-21T03:21:51.901714+0000","last_active":"2024-09-21T03:21:52.898480+0000","last_peered":"2024-09-21T03:21:52.898480+0000","last_clean":"2024-09-21T03:21:52.898480+0000","last_became_active":"2024-09-21T03:21:51.901323+0000","last_became_peered":"2024-09-21T03:21:51.901323+0000","last_unstale":"2024-09-21T03:21:52.898480+0000","last_undegraded":"2024-09-21T03:21:52.898480+0000","last_fullsized":"2024-09-21T03:21:52.898480+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:09.488852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900477+0000","last_change":"2024-09-21T03:21:51.892582+0000","last_active":"2024-09-21T03:21:52.900477+0000","last_peered":"2024-09-21T03:21:52.900477+0000","last_clean":"2024-09-21T03:21:52.900477+0000","last_became_active":"2024-09-21T03:21:51.892311+0000","last_became_peered":"2024-09-21T03:21:51.892311+0000","last_unstale":"2024-09-21T03:21:52.900477+0000","last_undegraded":"2024-09-21T03:21:52.900477+0000","last_fullsized":"2024-09-21T03:21:52.900477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:33.342412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899954+0000","last_change":"2024-09-21T03:21:51.902574+0000","last_active":"2024-09-21T03:21:52.899954+0000","last_peered":"2024-09-21T03:21:52.899954+0000","last_clean":"2024-09-21T03:21:52.899954+0000","last_became_active":"2024-09-21T03:21:51.902279+0000","last_became_peered":"2024-09-21T03:21:51.902279+0000","last_unstale":"2024-09-21T03:21:52.899954+0000","last_undegraded":"2024-09-21T03:21:52.899954+0000","last_fullsized":"2024-09-21T03:21:52.899954+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:07.452760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899652+0000","last_change":"2024-09-21T03:21:51.903656+0000","last_active":"2024-09-21T03:21:52.899652+0000","last_peered":"2024-09-21T03:21:52.899652+0000","last_clean":"2024-09-21T03:21:52.899652+0000","last_became_active":"2024-09-21T03:21:51.903346+0000","last_became_peered":"2024-09-21T03:21:51.903346+0000","last_unstale":"2024-09-21T03:21:52.899652+0000","last_undegraded":"2024-09-21T03:21:52.899652+0000","last_fullsized":"2024-09-21T03:21:52.899652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:05.605373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898116+0000","last_change":"2024-09-21T03:21:51.906337+0000","last_active":"2024-09-21T03:21:52.898116+0000","last_peered":"2024-09-21T03:21:52.898116+0000","last_clean":"2024-09-21T03:21:52.898116+0000","last_became_active":"2024-09-21T03:21:51.906006+0000","last_became_peered":"2024-09-21T03:21:51.906006+0000","last_unstale":"2024-09-21T03:21:52.898116+0000","last_undegraded":"2024-09-21T03:21:52.898116+0000","last_fullsized":"2024-09-21T03:21:52.898116+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:52.059197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899915+0000","last_change":"2024-09-21T03:21:51.890919+0000","last_active":"2024-09-21T03:21:52.899915+0000","last_peered":"2024-09-21T03:21:52.899915+0000","last_clean":"2024-09-21T03:21:52.899915+0000","last_became_active":"2024-09-21T03:21:51.890036+0000","last_became_peered":"2024-09-21T03:21:51.890036+0000","last_unstale":"2024-09-21T03:21:52.899915+0000","last_undegraded":"2024-09-21T03:21:52.899915+0000","last_fullsized":"2024-09-21T03:21:52.899915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:50:08.646746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898739+0000","last_change":"2024-09-21T03:21:51.891404+0000","last_active":"2024-09-21T03:21:52.898739+0000","last_peered":"2024-09-21T03:21:52.898739+0000","last_clean":"2024-09-21T03:21:52.898739+0000","last_became_active":"2024-09-21T03:21:51.891067+0000","last_became_peered":"2024-09-21T03:21:51.891067+0000","last_unstale":"2024-09-21T03:21:52.898739+0000","last_undegraded":"2024-09-21T03:21:52.898739+0000","last_fullsized":"2024-09-21T03:21:52.898739+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:43:18.361524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"79'4","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900471+0000","last_change":"2024-09-21T03:21:50.884910+0000","last_active":"2024-09-21T03:21:52.900471+0000","last_peered":"2024-09-21T03:21:52.900471+0000","last_clean":"2024-09-21T03:21:52.900471+0000","last_became_active":"2024-09-21T03:21:50.884574+0000","last_became_peered":"2024-09-21T03:21:50.884574+0000","last_unstale":"2024-09-21T03:21:52.900471+0000","last_undegraded":"2024-09-21T03:21:52.900471+0000","last_fullsized":"2024-09-21T03:21:52.900471+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:04.344766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900386+0000","last_change":"2024-09-21T03:21:51.908073+0000","last_active":"2024-09-21T03:21:52.900386+0000","last_peered":"2024-09-21T03:21:52.900386+0000","last_clean":"2024-09-21T03:21:52.900386+0000","last_became_active":"2024-09-21T03:21:51.907654+0000","last_became_peered":"2024-09-21T03:21:51.907654+0000","last_unstale":"2024-09-21T03:21:52.900386+0000","last_undegraded":"2024-09-21T03:21:52.900386+0000","last_fullsized":"2024-09-21T03:21:52.900386+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:03.307063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"79'1","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899061+0000","last_change":"2024-09-21T03:21:50.888297+0000","last_active":"2024-09-21T03:21:52.899061+0000","last_peered":"2024-09-21T03:21:52.899061+0000","last_clean":"2024-09-21T03:21:52.899061+0000","last_became_active":"2024-09-21T03:21:50.887943+0000","last_became_peered":"2024-09-21T03:21:50.887943+0000","last_unstale":"2024-09-21T03:21:52.899061+0000","last_undegraded":"2024-09-21T03:21:52.899061+0000","last_fullsized":"2024-09-21T03:21:52.899061+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:57.173705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900498+0000","last_change":"2024-09-21T03:21:51.890296+0000","last_active":"2024-09-21T03:21:52.900498+0000","last_peered":"2024-09-21T03:21:52.900498+0000","last_clean":"2024-09-21T03:21:52.900498+0000","last_became_active":"2024-09-21T03:21:51.889937+0000","last_became_peered":"2024-09-21T03:21:51.889937+0000","last_unstale":"2024-09-21T03:21:52.900498+0000","last_undegraded":"2024-09-21T03:21:52.900498+0000","last_fullsized":"2024-09-21T03:21:52.900498+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:31.802933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:21:50.892113+0000","last_change":"2024-09-21T03:21:50.888653+0000","last_active":"2024-09-21T03:21:50.892113+0000","last_peered":"2024-09-21T03:21:50.892113+0000","last_clean":"2024-09-21T03:21:50.892113+0000","last_became_active":"2024-09-21T03:21:50.888329+0000","last_became_peered":"2024-09-21T03:21:50.888329+0000","last_unstale":"2024-09-21T03:21:50.892113+0000","last_undegraded":"2024-09-21T03:21:50.892113+0000","last_fullsized":"2024-09-21T03:21:50.892113+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:59.226138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.578269+0000","last_change":"2024-09-21T03:21:51.902475+0000","last_active":"2024-09-21T03:21:53.578269+0000","last_peered":"2024-09-21T03:21:53.578269+0000","last_clean":"2024-09-21T03:21:53.578269+0000","last_became_active":"2024-09-21T03:21:51.901928+0000","last_became_peered":"2024-09-21T03:21:51.901928+0000","last_unstale":"2024-09-21T03:21:53.578269+0000","last_undegraded":"2024-09-21T03:21:53.578269+0000","last_fullsized":"2024-09-21T03:21:53.578269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:16.502189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:21:50.893596+0000","last_change":"2024-09-21T03:21:50.889500+0000","last_active":"2024-09-21T03:21:50.893596+0000","last_peered":"2024-09-21T03:21:50.893596+0000","last_clean":"2024-09-21T03:21:50.893596+0000","last_became_active":"2024-09-21T03:21:50.889200+0000","last_became_peered":"2024-09-21T03:21:50.889200+0000","last_unstale":"2024-09-21T03:21:50.893596+0000","last_undegraded":"2024-09-21T03:21:50.893596+0000","last_fullsized":"2024-09-21T03:21:50.893596+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:27.545400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899896+0000","last_change":"2024-09-21T03:21:51.903101+0000","last_active":"2024-09-21T03:21:52.899896+0000","last_peered":"2024-09-21T03:21:52.899896+0000","last_clean":"2024-09-21T03:21:52.899896+0000","last_became_active":"2024-09-21T03:21:51.902773+0000","last_became_peered":"2024-09-21T03:21:51.902773+0000","last_unstale":"2024-09-21T03:21:52.899896+0000","last_undegraded":"2024-09-21T03:21:52.899896+0000","last_fullsized":"2024-09-21T03:21:52.899896+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:01.885867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"79'1","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898638+0000","last_change":"2024-09-21T03:21:50.890186+0000","last_active":"2024-09-21T03:21:52.898638+0000","last_peered":"2024-09-21T03:21:52.898638+0000","last_clean":"2024-09-21T03:21:52.898638+0000","last_became_active":"2024-09-21T03:21:50.889742+0000","last_became_peered":"2024-09-21T03:21:50.889742+0000","last_unstale":"2024-09-21T03:21:52.898638+0000","last_undegraded":"2024-09-21T03:21:52.898638+0000","last_fullsized":"2024-09-21T03:21:52.898638+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:06.447091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898436+0000","last_change":"2024-09-21T03:21:51.902339+0000","last_active":"2024-09-21T03:21:52.898436+0000","last_peered":"2024-09-21T03:21:52.898436+0000","last_clean":"2024-09-21T03:21:52.898436+0000","last_became_active":"2024-09-21T03:21:51.902038+0000","last_became_peered":"2024-09-21T03:21:51.902038+0000","last_unstale":"2024-09-21T03:21:52.898436+0000","last_undegraded":"2024-09-21T03:21:52.898436+0000","last_fullsized":"2024-09-21T03:21:52.898436+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:15.428843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"79'1","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898008+0000","last_change":"2024-09-21T03:21:50.889708+0000","last_active":"2024-09-21T03:21:52.898008+0000","last_peered":"2024-09-21T03:21:52.898008+0000","last_clean":"2024-09-21T03:21:52.898008+0000","last_became_active":"2024-09-21T03:21:50.888284+0000","last_became_peered":"2024-09-21T03:21:50.888284+0000","last_unstale":"2024-09-21T03:21:52.898008+0000","last_undegraded":"2024-09-21T03:21:52.898008+0000","last_fullsized":"2024-09-21T03:21:52.898008+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:04.599704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577421+0000","last_change":"2024-09-21T03:21:51.905014+0000","last_active":"2024-09-21T03:21:53.577421+0000","last_peered":"2024-09-21T03:21:53.577421+0000","last_clean":"2024-09-21T03:21:53.577421+0000","last_became_active":"2024-09-21T03:21:51.904638+0000","last_became_peered":"2024-09-21T03:21:51.904638+0000","last_unstale":"2024-09-21T03:21:53.577421+0000","last_undegraded":"2024-09-21T03:21:53.577421+0000","last_fullsized":"2024-09-21T03:21:53.577421+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:40:07.583428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:21:50.893644+0000","last_change":"2024-09-21T03:21:50.890284+0000","last_active":"2024-09-21T03:21:50.893644+0000","last_peered":"2024-09-21T03:21:50.893644+0000","last_clean":"2024-09-21T03:21:50.893644+0000","last_became_active":"2024-09-21T03:21:50.890002+0000","last_became_peered":"2024-09-21T03:21:50.890002+0000","last_unstale":"2024-09-21T03:21:50.893644+0000","last_undegraded":"2024-09-21T03:21:50.893644+0000","last_fullsized":"2024-09-21T03:21:50.893644+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:50.274219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.576875+0000","last_change":"2024-09-21T03:21:51.899993+0000","last_active":"2024-09-21T03:21:53.576875+0000","last_peered":"2024-09-21T03:21:53.576875+0000","last_clean":"2024-09-21T03:21:53.576875+0000","last_became_active":"2024-09-21T03:21:51.899632+0000","last_became_peered":"2024-09-21T03:21:51.899632+0000","last_unstale":"2024-09-21T03:21:53.576875+0000","last_undegraded":"2024-09-21T03:21:53.576875+0000","last_fullsized":"2024-09-21T03:21:53.576875+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:15.015396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899544+0000","last_change":"2024-09-21T03:21:50.894291+0000","last_active":"2024-09-21T03:21:52.899544+0000","last_peered":"2024-09-21T03:21:52.899544+0000","last_clean":"2024-09-21T03:21:52.899544+0000","last_became_active":"2024-09-21T03:21:50.894001+0000","last_became_peered":"2024-09-21T03:21:50.894001+0000","last_unstale":"2024-09-21T03:21:52.899544+0000","last_undegraded":"2024-09-21T03:21:52.899544+0000","last_fullsized":"2024-09-21T03:21:52.899544+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:38:02.558962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577019+0000","last_change":"2024-09-21T03:21:51.894313+0000","last_active":"2024-09-21T03:21:53.577019+0000","last_peered":"2024-09-21T03:21:53.577019+0000","last_clean":"2024-09-21T03:21:53.577019+0000","last_became_active":"2024-09-21T03:21:51.894003+0000","last_became_peered":"2024-09-21T03:21:51.894003+0000","last_unstale":"2024-09-21T03:21:53.577019+0000","last_undegraded":"2024-09-21T03:21:53.577019+0000","last_fullsized":"2024-09-21T03:21:53.577019+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:55.444519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900543+0000","last_change":"2024-09-21T03:21:50.883437+0000","last_active":"2024-09-21T03:21:52.900543+0000","last_peered":"2024-09-21T03:21:52.900543+0000","last_clean":"2024-09-21T03:21:52.900543+0000","last_became_active":"2024-09-21T03:21:50.883111+0000","last_became_peered":"2024-09-21T03:21:50.883111+0000","last_unstale":"2024-09-21T03:21:52.900543+0000","last_undegraded":"2024-09-21T03:21:52.900543+0000","last_fullsized":"2024-09-21T03:21:52.900543+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:50.701648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:21:51.910716+0000","last_change":"2024-09-21T03:21:51.904652+0000","last_active":"2024-09-21T03:21:51.910716+0000","last_peered":"2024-09-21T03:21:51.910716+0000","last_clean":"2024-09-21T03:21:51.910716+0000","last_became_active":"2024-09-21T03:21:51.904284+0000","last_became_peered":"2024-09-21T03:21:51.904284+0000","last_unstale":"2024-09-21T03:21:51.910716+0000","last_undegraded":"2024-09-21T03:21:51.910716+0000","last_fullsized":"2024-09-21T03:21:51.910716+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:25.792212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900223+0000","last_change":"2024-09-21T03:21:50.890689+0000","last_active":"2024-09-21T03:21:52.900223+0000","last_peered":"2024-09-21T03:21:52.900223+0000","last_clean":"2024-09-21T03:21:52.900223+0000","last_became_active":"2024-09-21T03:21:50.890329+0000","last_became_peered":"2024-09-21T03:21:50.890329+0000","last_unstale":"2024-09-21T03:21:52.900223+0000","last_undegraded":"2024-09-21T03:21:52.900223+0000","last_fullsized":"2024-09-21T03:21:52.900223+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:46:35.605253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-09-21T03:21:50.876522+0000","last_change":"2024-09-21T03:21:50.876522+0000","last_active":"2024-09-21T03:21:50.865211+0000","last_peered":"2024-09-21T03:21:50.865211+0000","last_clean":"2024-09-21T03:21:50.865211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:50.876522+0000","last_undegraded":"2024-09-21T03:21:50.876522+0000","last_fullsized":"2024-09-21T03:21:50.876522+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"79'3","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899751+0000","last_change":"2024-09-21T03:21:50.891311+0000","last_active":"2024-09-21T03:21:52.899751+0000","last_peered":"2024-09-21T03:21:52.899751+0000","last_clean":"2024-09-21T03:21:52.899751+0000","last_became_active":"2024-09-21T03:21:50.890713+0000","last_became_peered":"2024-09-21T03:21:50.890713+0000","last_unstale":"2024-09-21T03:21:52.899751+0000","last_undegraded":"2024-09-21T03:21:52.899751+0000","last_fullsized":"2024-09-21T03:21:52.899751+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:41.919161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898766+0000","last_change":"2024-09-21T03:21:51.908205+0000","last_active":"2024-09-21T03:21:52.898766+0000","last_peered":"2024-09-21T03:21:52.898766+0000","last_clean":"2024-09-21T03:21:52.898766+0000","last_became_active":"2024-09-21T03:21:51.907239+0000","last_became_peered":"2024-09-21T03:21:51.907239+0000","last_unstale":"2024-09-21T03:21:52.898766+0000","last_undegraded":"2024-09-21T03:21:52.898766+0000","last_fullsized":"2024-09-21T03:21:52.898766+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:08:40.548484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"79'6","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:21:51.917164+0000","last_change":"2024-09-21T03:21:50.887898+0000","last_active":"2024-09-21T03:21:51.917164+0000","last_peered":"2024-09-21T03:21:51.917164+0000","last_clean":"2024-09-21T03:21:51.917164+0000","last_became_active":"2024-09-21T03:21:50.887571+0000","last_became_peered":"2024-09-21T03:21:50.887571+0000","last_unstale":"2024-09-21T03:21:51.917164+0000","last_undegraded":"2024-09-21T03:21:51.917164+0000","last_fullsized":"2024-09-21T03:21:51.917164+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:47:46.235056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-09-21T03:21:50.875320+0000","last_change":"2024-09-21T03:21:50.875320+0000","last_active":"2024-09-21T03:21:50.865211+0000","last_peered":"2024-09-21T03:21:50.865211+0000","last_clean":"2024-09-21T03:21:50.865211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:50.875320+0000","last_undegraded":"2024-09-21T03:21:50.875320+0000","last_fullsized":"2024-09-21T03:21:50.875320+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"79'2","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899993+0000","last_change":"2024-09-21T03:21:50.889245+0000","last_active":"2024-09-21T03:21:52.899993+0000","last_peered":"2024-09-21T03:21:52.899993+0000","last_clean":"2024-09-21T03:21:52.899993+0000","last_became_active":"2024-09-21T03:21:50.888937+0000","last_became_peered":"2024-09-21T03:21:50.888937+0000","last_unstale":"2024-09-21T03:21:52.899993+0000","last_undegraded":"2024-09-21T03:21:52.899993+0000","last_fullsized":"2024-09-21T03:21:52.899993+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:45:52.368843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.578464+0000","last_change":"2024-09-21T03:21:51.905440+0000","last_active":"2024-09-21T03:21:53.578464+0000","last_peered":"2024-09-21T03:21:53.578464+0000","last_clean":"2024-09-21T03:21:53.578464+0000","last_became_active":"2024-09-21T03:21:51.905015+0000","last_became_peered":"2024-09-21T03:21:51.905015+0000","last_unstale":"2024-09-21T03:21:53.578464+0000","last_undegraded":"2024-09-21T03:21:53.578464+0000","last_fullsized":"2024-09-21T03:21:53.578464+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:55.444519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.576949+0000","last_change":"2024-09-21T03:21:50.885645+0000","last_active":"2024-09-21T03:21:53.576949+0000","last_peered":"2024-09-21T03:21:53.576949+0000","last_clean":"2024-09-21T03:21:53.576949+0000","last_became_active":"2024-09-21T03:21:50.885322+0000","last_became_peered":"2024-09-21T03:21:50.885322+0000","last_unstale":"2024-09-21T03:21:53.576949+0000","last_undegraded":"2024-09-21T03:21:53.576949+0000","last_fullsized":"2024-09-21T03:21:53.576949+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:21:22.286598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899587+0000","last_change":"2024-09-21T03:21:51.904861+0000","last_active":"2024-09-21T03:21:52.899587+0000","last_peered":"2024-09-21T03:21:52.899587+0000","last_clean":"2024-09-21T03:21:52.899587+0000","last_became_active":"2024-09-21T03:21:51.904529+0000","last_became_peered":"2024-09-21T03:21:51.904529+0000","last_unstale":"2024-09-21T03:21:52.899587+0000","last_undegraded":"2024-09-21T03:21:52.899587+0000","last_fullsized":"2024-09-21T03:21:52.899587+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:14.676515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:21:51.892974+0000","last_change":"2024-09-21T03:21:50.893102+0000","last_active":"2024-09-21T03:21:51.892974+0000","last_peered":"2024-09-21T03:21:51.892974+0000","last_clean":"2024-09-21T03:21:51.892974+0000","last_became_active":"2024-09-21T03:21:50.892785+0000","last_became_peered":"2024-09-21T03:21:50.892785+0000","last_unstale":"2024-09-21T03:21:51.892974+0000","last_undegraded":"2024-09-21T03:21:51.892974+0000","last_fullsized":"2024-09-21T03:21:51.892974+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:17.615245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899583+0000","last_change":"2024-09-21T03:21:51.894797+0000","last_active":"2024-09-21T03:21:52.899583+0000","last_peered":"2024-09-21T03:21:52.899583+0000","last_clean":"2024-09-21T03:21:52.899583+0000","last_became_active":"2024-09-21T03:21:51.894373+0000","last_became_peered":"2024-09-21T03:21:51.894373+0000","last_unstale":"2024-09-21T03:21:52.899583+0000","last_undegraded":"2024-09-21T03:21:52.899583+0000","last_fullsized":"2024-09-21T03:21:52.899583+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:02:38.762310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:21:50.887615+0000","last_change":"2024-09-21T03:21:50.883788+0000","last_active":"2024-09-21T03:21:50.887615+0000","last_peered":"2024-09-21T03:21:50.887615+0000","last_clean":"2024-09-21T03:21:50.887615+0000","last_became_active":"2024-09-21T03:21:50.883369+0000","last_became_peered":"2024-09-21T03:21:50.883369+0000","last_unstale":"2024-09-21T03:21:50.887615+0000","last_undegraded":"2024-09-21T03:21:50.887615+0000","last_fullsized":"2024-09-21T03:21:50.887615+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:18.324712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.578242+0000","last_change":"2024-09-21T03:21:51.898550+0000","last_active":"2024-09-21T03:21:53.578242+0000","last_peered":"2024-09-21T03:21:53.578242+0000","last_clean":"2024-09-21T03:21:53.578242+0000","last_became_active":"2024-09-21T03:21:51.898201+0000","last_became_peered":"2024-09-21T03:21:51.898201+0000","last_unstale":"2024-09-21T03:21:53.578242+0000","last_undegraded":"2024-09-21T03:21:53.578242+0000","last_fullsized":"2024-09-21T03:21:53.578242+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:11:42.267787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"79'1","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900728+0000","last_change":"2024-09-21T03:21:50.889581+0000","last_active":"2024-09-21T03:21:52.900728+0000","last_peered":"2024-09-21T03:21:52.900728+0000","last_clean":"2024-09-21T03:21:52.900728+0000","last_became_active":"2024-09-21T03:21:50.889245+0000","last_became_peered":"2024-09-21T03:21:50.889245+0000","last_unstale":"2024-09-21T03:21:52.900728+0000","last_undegraded":"2024-09-21T03:21:52.900728+0000","last_fullsized":"2024-09-21T03:21:52.900728+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:00.493999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900576+0000","last_change":"2024-09-21T03:21:51.899099+0000","last_active":"2024-09-21T03:21:52.900576+0000","last_peered":"2024-09-21T03:21:52.900576+0000","last_clean":"2024-09-21T03:21:52.900576+0000","last_became_active":"2024-09-21T03:21:51.898350+0000","last_became_peered":"2024-09-21T03:21:51.898350+0000","last_unstale":"2024-09-21T03:21:52.900576+0000","last_undegraded":"2024-09-21T03:21:52.900576+0000","last_fullsized":"2024-09-21T03:21:52.900576+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:43.337873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:21:50.896489+0000","last_change":"2024-09-21T03:21:50.892793+0000","last_active":"2024-09-21T03:21:50.896489+0000","last_peered":"2024-09-21T03:21:50.896489+0000","last_clean":"2024-09-21T03:21:50.896489+0000","last_became_active":"2024-09-21T03:21:50.892459+0000","last_became_peered":"2024-09-21T03:21:50.892459+0000","last_unstale":"2024-09-21T03:21:50.896489+0000","last_undegraded":"2024-09-21T03:21:50.896489+0000","last_fullsized":"2024-09-21T03:21:50.896489+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:53:29.177030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898808+0000","last_change":"2024-09-21T03:21:51.893380+0000","last_active":"2024-09-21T03:21:52.898808+0000","last_peered":"2024-09-21T03:21:52.898808+0000","last_clean":"2024-09-21T03:21:52.898808+0000","last_became_active":"2024-09-21T03:21:51.893039+0000","last_became_peered":"2024-09-21T03:21:51.893039+0000","last_unstale":"2024-09-21T03:21:52.898808+0000","last_undegraded":"2024-09-21T03:21:52.898808+0000","last_fullsized":"2024-09-21T03:21:52.898808+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:11.163288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:21:50.893627+0000","last_change":"2024-09-21T03:21:50.891075+0000","last_active":"2024-09-21T03:21:50.893627+0000","last_peered":"2024-09-21T03:21:50.893627+0000","last_clean":"2024-09-21T03:21:50.893627+0000","last_became_active":"2024-09-21T03:21:50.890732+0000","last_became_peered":"2024-09-21T03:21:50.890732+0000","last_unstale":"2024-09-21T03:21:50.893627+0000","last_undegraded":"2024-09-21T03:21:50.893627+0000","last_fullsized":"2024-09-21T03:21:50.893627+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:08.020422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.270234+0000","last_change":"2024-09-21T03:21:51.907368+0000","last_active":"2024-09-21T03:21:53.270234+0000","last_peered":"2024-09-21T03:21:53.270234+0000","last_clean":"2024-09-21T03:21:53.270234+0000","last_became_active":"2024-09-21T03:21:51.906509+0000","last_became_peered":"2024-09-21T03:21:51.906509+0000","last_unstale":"2024-09-21T03:21:53.270234+0000","last_undegraded":"2024-09-21T03:21:53.270234+0000","last_fullsized":"2024-09-21T03:21:53.270234+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:31:41.794069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"79'2","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577118+0000","last_change":"2024-09-21T03:21:50.881909+0000","last_active":"2024-09-21T03:21:53.577118+0000","last_peered":"2024-09-21T03:21:53.577118+0000","last_clean":"2024-09-21T03:21:53.577118+0000","last_became_active":"2024-09-21T03:21:50.881541+0000","last_became_peered":"2024-09-21T03:21:50.881541+0000","last_unstale":"2024-09-21T03:21:53.577118+0000","last_undegraded":"2024-09-21T03:21:53.577118+0000","last_fullsized":"2024-09-21T03:21:53.577118+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:02.316385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:21:51.907914+0000","last_change":"2024-09-21T03:21:51.901261+0000","last_active":"2024-09-21T03:21:51.907914+0000","last_peered":"2024-09-21T03:21:51.907914+0000","last_clean":"2024-09-21T03:21:51.907914+0000","last_became_active":"2024-09-21T03:21:51.900954+0000","last_became_peered":"2024-09-21T03:21:51.900954+0000","last_unstale":"2024-09-21T03:21:51.907914+0000","last_undegraded":"2024-09-21T03:21:51.907914+0000","last_fullsized":"2024-09-21T03:21:51.907914+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:41.233859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.270134+0000","last_change":"2024-09-21T03:21:50.884684+0000","last_active":"2024-09-21T03:21:53.270134+0000","last_peered":"2024-09-21T03:21:53.270134+0000","last_clean":"2024-09-21T03:21:53.270134+0000","last_became_active":"2024-09-21T03:21:50.883447+0000","last_became_peered":"2024-09-21T03:21:50.883447+0000","last_unstale":"2024-09-21T03:21:53.270134+0000","last_undegraded":"2024-09-21T03:21:53.270134+0000","last_fullsized":"2024-09-21T03:21:53.270134+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:10.639009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.269927+0000","last_change":"2024-09-21T03:21:51.901038+0000","last_active":"2024-09-21T03:21:53.269927+0000","last_peered":"2024-09-21T03:21:53.269927+0000","last_clean":"2024-09-21T03:21:53.269927+0000","last_became_active":"2024-09-21T03:21:51.900648+0000","last_became_peered":"2024-09-21T03:21:51.900648+0000","last_unstale":"2024-09-21T03:21:53.269927+0000","last_undegraded":"2024-09-21T03:21:53.269927+0000","last_fullsized":"2024-09-21T03:21:53.269927+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:26.805582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.269785+0000","last_change":"2024-09-21T03:21:50.891133+0000","last_active":"2024-09-21T03:21:53.269785+0000","last_peered":"2024-09-21T03:21:53.269785+0000","last_clean":"2024-09-21T03:21:53.269785+0000","last_became_active":"2024-09-21T03:21:50.890817+0000","last_became_peered":"2024-09-21T03:21:50.890817+0000","last_unstale":"2024-09-21T03:21:53.269785+0000","last_undegraded":"2024-09-21T03:21:53.269785+0000","last_fullsized":"2024-09-21T03:21:53.269785+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:16.600569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:21:51.911382+0000","last_change":"2024-09-21T03:21:51.909921+0000","last_active":"2024-09-21T03:21:51.911382+0000","last_peered":"2024-09-21T03:21:51.911382+0000","last_clean":"2024-09-21T03:21:51.911382+0000","last_became_active":"2024-09-21T03:21:51.909432+0000","last_became_peered":"2024-09-21T03:21:51.909432+0000","last_unstale":"2024-09-21T03:21:51.911382+0000","last_undegraded":"2024-09-21T03:21:51.911382+0000","last_fullsized":"2024-09-21T03:21:51.911382+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:31.112370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.576433+0000","last_change":"2024-09-21T03:21:50.881109+0000","last_active":"2024-09-21T03:21:53.576433+0000","last_peered":"2024-09-21T03:21:53.576433+0000","last_clean":"2024-09-21T03:21:53.576433+0000","last_became_active":"2024-09-21T03:21:50.880825+0000","last_became_peered":"2024-09-21T03:21:50.880825+0000","last_unstale":"2024-09-21T03:21:53.576433+0000","last_undegraded":"2024-09-21T03:21:53.576433+0000","last_fullsized":"2024-09-21T03:21:53.576433+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:40:06.577759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899093+0000","last_change":"2024-09-21T03:21:51.900827+0000","last_active":"2024-09-21T03:21:52.899093+0000","last_peered":"2024-09-21T03:21:52.899093+0000","last_clean":"2024-09-21T03:21:52.899093+0000","last_became_active":"2024-09-21T03:21:51.900485+0000","last_became_peered":"2024-09-21T03:21:51.900485+0000","last_unstale":"2024-09-21T03:21:52.899093+0000","last_undegraded":"2024-09-21T03:21:52.899093+0000","last_fullsized":"2024-09-21T03:21:52.899093+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:40.866323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"79'2","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899992+0000","last_change":"2024-09-21T03:21:50.886982+0000","last_active":"2024-09-21T03:21:52.899992+0000","last_peered":"2024-09-21T03:21:52.899992+0000","last_clean":"2024-09-21T03:21:52.899992+0000","last_became_active":"2024-09-21T03:21:50.886661+0000","last_became_peered":"2024-09-21T03:21:50.886661+0000","last_unstale":"2024-09-21T03:21:52.899992+0000","last_undegraded":"2024-09-21T03:21:52.899992+0000","last_fullsized":"2024-09-21T03:21:52.899992+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:31:40.788400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.578330+0000","last_change":"2024-09-21T03:21:51.909713+0000","last_active":"2024-09-21T03:21:53.578330+0000","last_peered":"2024-09-21T03:21:53.578330+0000","last_clean":"2024-09-21T03:21:53.578330+0000","last_became_active":"2024-09-21T03:21:51.909373+0000","last_became_peered":"2024-09-21T03:21:51.909373+0000","last_unstale":"2024-09-21T03:21:53.578330+0000","last_undegraded":"2024-09-21T03:21:53.578330+0000","last_fullsized":"2024-09-21T03:21:53.578330+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:52.176078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"79'1","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899881+0000","last_change":"2024-09-21T03:21:50.891027+0000","last_active":"2024-09-21T03:21:52.899881+0000","last_peered":"2024-09-21T03:21:52.899881+0000","last_clean":"2024-09-21T03:21:52.899881+0000","last_became_active":"2024-09-21T03:21:50.890732+0000","last_became_peered":"2024-09-21T03:21:50.890732+0000","last_unstale":"2024-09-21T03:21:52.899881+0000","last_undegraded":"2024-09-21T03:21:52.899881+0000","last_fullsized":"2024-09-21T03:21:52.899881+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:21.808526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900708+0000","last_change":"2024-09-21T03:21:51.905815+0000","last_active":"2024-09-21T03:21:52.900708+0000","last_peered":"2024-09-21T03:21:52.900708+0000","last_clean":"2024-09-21T03:21:52.900708+0000","last_became_active":"2024-09-21T03:21:51.905422+0000","last_became_peered":"2024-09-21T03:21:51.905422+0000","last_unstale":"2024-09-21T03:21:52.900708+0000","last_undegraded":"2024-09-21T03:21:52.900708+0000","last_fullsized":"2024-09-21T03:21:52.900708+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:31.675347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899899+0000","last_change":"2024-09-21T03:21:50.891090+0000","last_active":"2024-09-21T03:21:52.899899+0000","last_peered":"2024-09-21T03:21:52.899899+0000","last_clean":"2024-09-21T03:21:52.899899+0000","last_became_active":"2024-09-21T03:21:50.890775+0000","last_became_peered":"2024-09-21T03:21:50.890775+0000","last_unstale":"2024-09-21T03:21:52.899899+0000","last_undegraded":"2024-09-21T03:21:52.899899+0000","last_fullsized":"2024-09-21T03:21:52.899899+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:28.931234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899083+0000","last_change":"2024-09-21T03:21:51.907507+0000","last_active":"2024-09-21T03:21:52.899083+0000","last_peered":"2024-09-21T03:21:52.899083+0000","last_clean":"2024-09-21T03:21:52.899083+0000","last_became_active":"2024-09-21T03:21:51.906065+0000","last_became_peered":"2024-09-21T03:21:51.906065+0000","last_unstale":"2024-09-21T03:21:52.899083+0000","last_undegraded":"2024-09-21T03:21:52.899083+0000","last_fullsized":"2024-09-21T03:21:52.899083+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:34:58.232355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900634+0000","last_change":"2024-09-21T03:21:50.882989+0000","last_active":"2024-09-21T03:21:52.900634+0000","last_peered":"2024-09-21T03:21:52.900634+0000","last_clean":"2024-09-21T03:21:52.900634+0000","last_became_active":"2024-09-21T03:21:50.882493+0000","last_became_peered":"2024-09-21T03:21:50.882493+0000","last_unstale":"2024-09-21T03:21:52.900634+0000","last_undegraded":"2024-09-21T03:21:52.900634+0000","last_fullsized":"2024-09-21T03:21:52.900634+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:48.422744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:21:51.908069+0000","last_change":"2024-09-21T03:21:51.901903+0000","last_active":"2024-09-21T03:21:51.908069+0000","last_peered":"2024-09-21T03:21:51.908069+0000","last_clean":"2024-09-21T03:21:51.908069+0000","last_became_active":"2024-09-21T03:21:51.901578+0000","last_became_peered":"2024-09-21T03:21:51.901578+0000","last_unstale":"2024-09-21T03:21:51.908069+0000","last_undegraded":"2024-09-21T03:21:51.908069+0000","last_fullsized":"2024-09-21T03:21:51.908069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:26.773312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:21:50.889552+0000","last_change":"2024-09-21T03:21:50.886896+0000","last_active":"2024-09-21T03:21:50.889552+0000","last_peered":"2024-09-21T03:21:50.889552+0000","last_clean":"2024-09-21T03:21:50.889552+0000","last_became_active":"2024-09-21T03:21:50.886606+0000","last_became_peered":"2024-09-21T03:21:50.886606+0000","last_unstale":"2024-09-21T03:21:50.889552+0000","last_undegraded":"2024-09-21T03:21:50.889552+0000","last_fullsized":"2024-09-21T03:21:50.889552+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:36:12.594255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-09-21T03:21:50.877825+0000","last_change":"2024-09-21T03:21:50.877825+0000","last_active":"2024-09-21T03:21:50.865211+0000","last_peered":"2024-09-21T03:21:50.865211+0000","last_clean":"2024-09-21T03:21:50.865211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:50.877825+0000","last_undegraded":"2024-09-21T03:21:50.877825+0000","last_fullsized":"2024-09-21T03:21:50.877825+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898172+0000","last_change":"2024-09-21T03:21:50.888581+0000","last_active":"2024-09-21T03:21:52.898172+0000","last_peered":"2024-09-21T03:21:52.898172+0000","last_clean":"2024-09-21T03:21:52.898172+0000","last_became_active":"2024-09-21T03:21:50.887896+0000","last_became_peered":"2024-09-21T03:21:50.887896+0000","last_unstale":"2024-09-21T03:21:52.898172+0000","last_undegraded":"2024-09-21T03:21:52.898172+0000","last_fullsized":"2024-09-21T03:21:52.898172+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:00.880198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577694+0000","last_change":"2024-09-21T03:21:51.903858+0000","last_active":"2024-09-21T03:21:53.577694+0000","last_peered":"2024-09-21T03:21:53.577694+0000","last_clean":"2024-09-21T03:21:53.577694+0000","last_became_active":"2024-09-21T03:21:51.903527+0000","last_became_peered":"2024-09-21T03:21:51.903527+0000","last_unstale":"2024-09-21T03:21:53.577694+0000","last_undegraded":"2024-09-21T03:21:53.577694+0000","last_fullsized":"2024-09-21T03:21:53.577694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:21:23.292266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900099+0000","last_change":"2024-09-21T03:21:50.891506+0000","last_active":"2024-09-21T03:21:52.900099+0000","last_peered":"2024-09-21T03:21:52.900099+0000","last_clean":"2024-09-21T03:21:52.900099+0000","last_became_active":"2024-09-21T03:21:50.891130+0000","last_became_peered":"2024-09-21T03:21:50.891130+0000","last_unstale":"2024-09-21T03:21:52.900099+0000","last_undegraded":"2024-09-21T03:21:52.900099+0000","last_fullsized":"2024-09-21T03:21:52.900099+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:16.126547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899967+0000","last_change":"2024-09-21T03:21:51.894997+0000","last_active":"2024-09-21T03:21:52.899967+0000","last_peered":"2024-09-21T03:21:52.899967+0000","last_clean":"2024-09-21T03:21:52.899967+0000","last_became_active":"2024-09-21T03:21:51.894658+0000","last_became_peered":"2024-09-21T03:21:51.894658+0000","last_unstale":"2024-09-21T03:21:52.899967+0000","last_undegraded":"2024-09-21T03:21:52.899967+0000","last_fullsized":"2024-09-21T03:21:52.899967+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:09.488852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.897965+0000","last_change":"2024-09-21T03:21:50.891199+0000","last_active":"2024-09-21T03:21:52.897965+0000","last_peered":"2024-09-21T03:21:52.897965+0000","last_clean":"2024-09-21T03:21:52.897965+0000","last_became_active":"2024-09-21T03:21:50.890837+0000","last_became_peered":"2024-09-21T03:21:50.890837+0000","last_unstale":"2024-09-21T03:21:52.897965+0000","last_undegraded":"2024-09-21T03:21:52.897965+0000","last_fullsized":"2024-09-21T03:21:52.897965+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:54.618581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900002+0000","last_change":"2024-09-21T03:21:51.899525+0000","last_active":"2024-09-21T03:21:52.900002+0000","last_peered":"2024-09-21T03:21:52.900002+0000","last_clean":"2024-09-21T03:21:52.900002+0000","last_became_active":"2024-09-21T03:21:51.899003+0000","last_became_peered":"2024-09-21T03:21:51.899003+0000","last_unstale":"2024-09-21T03:21:52.900002+0000","last_undegraded":"2024-09-21T03:21:52.900002+0000","last_fullsized":"2024-09-21T03:21:52.900002+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:51.707317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"79'1","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.578284+0000","last_change":"2024-09-21T03:21:50.886216+0000","last_active":"2024-09-21T03:21:53.578284+0000","last_peered":"2024-09-21T03:21:53.578284+0000","last_clean":"2024-09-21T03:21:53.578284+0000","last_became_active":"2024-09-21T03:21:50.885887+0000","last_became_peered":"2024-09-21T03:21:50.885887+0000","last_unstale":"2024-09-21T03:21:53.578284+0000","last_undegraded":"2024-09-21T03:21:53.578284+0000","last_fullsized":"2024-09-21T03:21:53.578284+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:08.483183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":219,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577601+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:21:53.577601+0000","last_peered":"2024-09-21T03:21:53.577601+0000","last_clean":"2024-09-21T03:21:53.577601+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:21:53.577601+0000","last_undegraded":"2024-09-21T03:21:53.577601+0000","last_fullsized":"2024-09-21T03:21:53.577601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25,"ondisk_log_size":25,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509488,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1560576,"data_stored":991979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509487,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":974848,"data_stored":402235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509486,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":978944,"data_stored":403175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509486,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":962560,"data_stored":401541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509487,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":974848,"data_stored":403153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509487,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":966656,"data_stored":402123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509487,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":987136,"data_stored":408035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32696,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339144,"statfs":{"total":96636764160,"available":96603283456,"internally_reserved":0,"allocated":1544192,"data_stored":985134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:21:56.309 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:21:56.386 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:21:56.390 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:21:56.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.458+0000 7fa8f224d640 1 -- 172.21.15.105:0/672686754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8ec0d0e50 msgr2=0x7fa8ec0d1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:56.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.458+0000 7fa8f224d640 1 --2- 172.21.15.105:0/672686754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8ec0d0e50 0x7fa8ec0d1260 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4005fd0 tx=0x7fa8e402a980 comp rx=0 tx=0).stop 2024-09-21T03:21:56.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.458+0000 7fa8f224d640 1 -- 172.21.15.105:0/672686754 shutdown_connections 2024-09-21T03:21:56.461 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.458+0000 7fa8f224d640 1 --2- 172.21.15.105:0/672686754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8ec0d0e50 0x7fa8ec0d1260 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:56.461 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.458+0000 7fa8f224d640 1 --2- 172.21.15.105:0/672686754 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa8ec06e0a0 0x7fa8ec0b97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:56.461 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.458+0000 7fa8f224d640 1 -- 172.21.15.105:0/672686754 >> 172.21.15.105:0/672686754 conn(0x7fa8ec09d840 msgr2=0x7fa8ec08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:56.461 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.458+0000 7fa8f224d640 1 -- 172.21.15.105:0/672686754 shutdown_connections 2024-09-21T03:21:56.461 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.458+0000 7fa8f224d640 1 -- 172.21.15.105:0/672686754 wait complete. 2024-09-21T03:21:56.462 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.460+0000 7fa8f224d640 1 Processor -- start 2024-09-21T03:21:56.462 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.460+0000 7fa8f224d640 1 -- start start 2024-09-21T03:21:56.466 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.461+0000 7fa8f224d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8ec06e0a0 0x7fa8ec15b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:56.466 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.461+0000 7fa8f224d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8ec06f6e0 0x7fa8ec0b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:56.466 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.461+0000 7fa8f224d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa8ec0d0e50 0x7fa8ec0b5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:56.466 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.461+0000 7fa8f224d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ec0cfea0 con 0x7fa8ec06e0a0 2024-09-21T03:21:56.466 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.461+0000 7fa8f224d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ec0cfd20 con 0x7fa8ec06f6e0 2024-09-21T03:21:56.466 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.461+0000 7fa8f224d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa8ec0d0020 con 0x7fa8ec0d0e50 2024-09-21T03:21:56.466 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.461+0000 7fa8eb7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8ec06e0a0 0x7fa8ec15b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:56.466 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.461+0000 7fa8eb7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8ec06e0a0 0x7fa8ec15b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:45330/0 (socket says 172.21.15.105:45330) 2024-09-21T03:21:56.467 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.461+0000 7fa8eb7fe640 1 -- 172.21.15.105:0/4254788776 learned_addr learned my addr 172.21.15.105:0/4254788776 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:56.467 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.461+0000 7fa8ebfff640 1 --2- 172.21.15.105:0/4254788776 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa8ec0d0e50 0x7fa8ec0b5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:56.467 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.461+0000 7fa8eb7fe640 1 -- 172.21.15.105:0/4254788776 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa8ec0d0e50 msgr2=0x7fa8ec0b5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:56.467 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.461+0000 7fa8eb7fe640 1 --2- 172.21.15.105:0/4254788776 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa8ec0d0e50 0x7fa8ec0b5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:56.467 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.461+0000 7fa8eb7fe640 1 -- 172.21.15.105:0/4254788776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8ec06f6e0 msgr2=0x7fa8ec0b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:56.467 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.461+0000 7fa8eb7fe640 1 --2- 172.21.15.105:0/4254788776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8ec06f6e0 0x7fa8ec0b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:56.467 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.461+0000 7fa8eb7fe640 1 -- 172.21.15.105:0/4254788776 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8ec0ce3e0 con 0x7fa8ec06e0a0 2024-09-21T03:21:56.467 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.462+0000 7fa8eb7fe640 1 --2- 172.21.15.105:0/4254788776 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8ec06e0a0 0x7fa8ec15b420 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc00d720 tx=0x7fa8dc00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:56.467 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.462+0000 7fa8d3fff640 1 -- 172.21.15.105:0/4254788776 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc009c30 con 0x7fa8ec06e0a0 2024-09-21T03:21:56.467 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.462+0000 7fa8d3fff640 1 -- 172.21.15.105:0/4254788776 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa8dc00de30 con 0x7fa8ec06e0a0 2024-09-21T03:21:56.467 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.462+0000 7fa8d3fff640 1 -- 172.21.15.105:0/4254788776 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc004260 con 0x7fa8ec06e0a0 2024-09-21T03:21:56.467 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.462+0000 7fa8f224d640 1 -- 172.21.15.105:0/4254788776 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8ec0ce6c0 con 0x7fa8ec06e0a0 2024-09-21T03:21:56.467 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.462+0000 7fa8f224d640 1 -- 172.21.15.105:0/4254788776 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8ec0b6710 con 0x7fa8ec06e0a0 2024-09-21T03:21:56.467 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.463+0000 7fa8f224d640 1 -- 172.21.15.105:0/4254788776 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8ec0ce900 con 0x7fa8ec06e0a0 2024-09-21T03:21:56.468 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.463+0000 7fa8d3fff640 1 -- 172.21.15.105:0/4254788776 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa8dc005030 con 0x7fa8ec06e0a0 2024-09-21T03:21:56.468 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.464+0000 7fa8d3fff640 1 --2- 172.21.15.105:0/4254788776 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa8d8078b90 0x7fa8d807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:56.468 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.464+0000 7fa8d3fff640 1 -- 172.21.15.105:0/4254788776 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7fa8dc09b370 con 0x7fa8ec06e0a0 2024-09-21T03:21:56.468 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.464+0000 7fa8eaffd640 1 --2- 172.21.15.105:0/4254788776 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa8d8078b90 0x7fa8d807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:56.468 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.465+0000 7fa8eaffd640 1 --2- 172.21.15.105:0/4254788776 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa8d8078b90 0x7fa8d807b0a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa8e0000f60 tx=0x7fa8e00079b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:56.470 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.468+0000 7fa8d3fff640 1 -- 172.21.15.105:0/4254788776 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa8ec0ce900 con 0x7fa8ec06e0a0 2024-09-21T03:21:56.644 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.642+0000 7fa8f224d640 1 -- 172.21.15.105:0/4254788776 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa8ec0ce190 con 0x7fa8d8078b90 2024-09-21T03:21:56.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.647+0000 7fa8d3fff640 1 -- 172.21.15.105:0/4254788776 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251718 (secure 0 0 0) 0x7fa8ec0ce190 con 0x7fa8d8078b90 2024-09-21T03:21:56.652 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:56.653 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:21:56.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.650+0000 7fa8f224d640 1 -- 172.21.15.105:0/4254788776 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa8d8078b90 msgr2=0x7fa8d807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:56.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.650+0000 7fa8f224d640 1 --2- 172.21.15.105:0/4254788776 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa8d8078b90 0x7fa8d807b0a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa8e0000f60 tx=0x7fa8e00079b0 comp rx=0 tx=0).stop 2024-09-21T03:21:56.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.650+0000 7fa8f224d640 1 -- 172.21.15.105:0/4254788776 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8ec06e0a0 msgr2=0x7fa8ec15b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:56.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.650+0000 7fa8f224d640 1 --2- 172.21.15.105:0/4254788776 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8ec06e0a0 0x7fa8ec15b420 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc00d720 tx=0x7fa8dc00dbe0 comp rx=0 tx=0).stop 2024-09-21T03:21:56.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.650+0000 7fa8f224d640 1 -- 172.21.15.105:0/4254788776 shutdown_connections 2024-09-21T03:21:56.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.650+0000 7fa8f224d640 1 --2- 172.21.15.105:0/4254788776 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa8d8078b90 0x7fa8d807b0a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:56.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.650+0000 7fa8f224d640 1 --2- 172.21.15.105:0/4254788776 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa8ec0d0e50 0x7fa8ec0b5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:56.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.650+0000 7fa8f224d640 1 --2- 172.21.15.105:0/4254788776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8ec06f6e0 0x7fa8ec0b5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:56.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.650+0000 7fa8f224d640 1 --2- 172.21.15.105:0/4254788776 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8ec06e0a0 0x7fa8ec15b420 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:56.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.650+0000 7fa8f224d640 1 -- 172.21.15.105:0/4254788776 >> 172.21.15.105:0/4254788776 conn(0x7fa8ec09d840 msgr2=0x7fa8ec0b93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:56.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.650+0000 7fa8f224d640 1 -- 172.21.15.105:0/4254788776 shutdown_connections 2024-09-21T03:21:56.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.650+0000 7fa8f224d640 1 -- 172.21.15.105:0/4254788776 wait complete. 2024-09-21T03:21:56.663 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":183,"stamp":"2024-09-21T03:21:55.331418+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":125,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":94,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258272,"kb_used_data":8740,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716448,"statfs":{"total":773094113280,"available":772829642752,"internally_reserved":0,"allocated":8949760,"data_stored":4397375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.464815"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900303+0000","last_change":"2024-09-21T03:21:51.891281+0000","last_active":"2024-09-21T03:21:52.900303+0000","last_peered":"2024-09-21T03:21:52.900303+0000","last_clean":"2024-09-21T03:21:52.900303+0000","last_became_active":"2024-09-21T03:21:51.890980+0000","last_became_peered":"2024-09-21T03:21:51.890980+0000","last_unstale":"2024-09-21T03:21:52.900303+0000","last_undegraded":"2024-09-21T03:21:52.900303+0000","last_fullsized":"2024-09-21T03:21:52.900303+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:11.163288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899999+0000","last_change":"2024-09-21T03:21:51.898465+0000","last_active":"2024-09-21T03:21:52.899999+0000","last_peered":"2024-09-21T03:21:52.899999+0000","last_clean":"2024-09-21T03:21:52.899999+0000","last_became_active":"2024-09-21T03:21:51.897528+0000","last_became_peered":"2024-09-21T03:21:51.897528+0000","last_unstale":"2024-09-21T03:21:52.899999+0000","last_undegraded":"2024-09-21T03:21:52.899999+0000","last_fullsized":"2024-09-21T03:21:52.899999+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:58.179373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.578114+0000","last_change":"2024-09-21T03:21:51.910099+0000","last_active":"2024-09-21T03:21:53.578114+0000","last_peered":"2024-09-21T03:21:53.578114+0000","last_clean":"2024-09-21T03:21:53.578114+0000","last_became_active":"2024-09-21T03:21:51.908796+0000","last_became_peered":"2024-09-21T03:21:51.908796+0000","last_unstale":"2024-09-21T03:21:53.578114+0000","last_undegraded":"2024-09-21T03:21:53.578114+0000","last_fullsized":"2024-09-21T03:21:53.578114+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:03.322054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.270250+0000","last_change":"2024-09-21T03:21:51.903031+0000","last_active":"2024-09-21T03:21:53.270250+0000","last_peered":"2024-09-21T03:21:53.270250+0000","last_clean":"2024-09-21T03:21:53.270250+0000","last_became_active":"2024-09-21T03:21:51.902704+0000","last_became_peered":"2024-09-21T03:21:51.902704+0000","last_unstale":"2024-09-21T03:21:53.270250+0000","last_undegraded":"2024-09-21T03:21:53.270250+0000","last_fullsized":"2024-09-21T03:21:53.270250+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:22.814195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898426+0000","last_change":"2024-09-21T03:21:51.894670+0000","last_active":"2024-09-21T03:21:52.898426+0000","last_peered":"2024-09-21T03:21:52.898426+0000","last_clean":"2024-09-21T03:21:52.898426+0000","last_became_active":"2024-09-21T03:21:51.894129+0000","last_became_peered":"2024-09-21T03:21:51.894129+0000","last_unstale":"2024-09-21T03:21:52.898426+0000","last_undegraded":"2024-09-21T03:21:52.898426+0000","last_fullsized":"2024-09-21T03:21:52.898426+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:10:23.798227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:21:51.911046+0000","last_change":"2024-09-21T03:21:51.905285+0000","last_active":"2024-09-21T03:21:51.911046+0000","last_peered":"2024-09-21T03:21:51.911046+0000","last_clean":"2024-09-21T03:21:51.911046+0000","last_became_active":"2024-09-21T03:21:51.904901+0000","last_became_peered":"2024-09-21T03:21:51.904901+0000","last_unstale":"2024-09-21T03:21:51.911046+0000","last_undegraded":"2024-09-21T03:21:51.911046+0000","last_fullsized":"2024-09-21T03:21:51.911046+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:38.052497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.269833+0000","last_change":"2024-09-21T03:21:51.905587+0000","last_active":"2024-09-21T03:21:53.269833+0000","last_peered":"2024-09-21T03:21:53.269833+0000","last_clean":"2024-09-21T03:21:53.269833+0000","last_became_active":"2024-09-21T03:21:51.905274+0000","last_became_peered":"2024-09-21T03:21:51.905274+0000","last_unstale":"2024-09-21T03:21:53.269833+0000","last_undegraded":"2024-09-21T03:21:53.269833+0000","last_fullsized":"2024-09-21T03:21:53.269833+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:59.109536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:21:51.910644+0000","last_change":"2024-09-21T03:21:51.907560+0000","last_active":"2024-09-21T03:21:51.910644+0000","last_peered":"2024-09-21T03:21:51.910644+0000","last_clean":"2024-09-21T03:21:51.910644+0000","last_became_active":"2024-09-21T03:21:51.907143+0000","last_became_peered":"2024-09-21T03:21:51.907143+0000","last_unstale":"2024-09-21T03:21:51.910644+0000","last_undegraded":"2024-09-21T03:21:51.910644+0000","last_fullsized":"2024-09-21T03:21:51.910644+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:16.865640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:21:51.911342+0000","last_change":"2024-09-21T03:21:51.908687+0000","last_active":"2024-09-21T03:21:51.911342+0000","last_peered":"2024-09-21T03:21:51.911342+0000","last_clean":"2024-09-21T03:21:51.911342+0000","last_became_active":"2024-09-21T03:21:51.908386+0000","last_became_peered":"2024-09-21T03:21:51.908386+0000","last_unstale":"2024-09-21T03:21:51.911342+0000","last_undegraded":"2024-09-21T03:21:51.911342+0000","last_fullsized":"2024-09-21T03:21:51.911342+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:50:08.646746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900295+0000","last_change":"2024-09-21T03:21:51.903820+0000","last_active":"2024-09-21T03:21:52.900295+0000","last_peered":"2024-09-21T03:21:52.900295+0000","last_clean":"2024-09-21T03:21:52.900295+0000","last_became_active":"2024-09-21T03:21:51.903292+0000","last_became_peered":"2024-09-21T03:21:51.903292+0000","last_unstale":"2024-09-21T03:21:52.900295+0000","last_undegraded":"2024-09-21T03:21:52.900295+0000","last_fullsized":"2024-09-21T03:21:52.900295+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:02.311208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899833+0000","last_change":"2024-09-21T03:21:51.898032+0000","last_active":"2024-09-21T03:21:52.899833+0000","last_peered":"2024-09-21T03:21:52.899833+0000","last_clean":"2024-09-21T03:21:52.899833+0000","last_became_active":"2024-09-21T03:21:51.897696+0000","last_became_peered":"2024-09-21T03:21:51.897696+0000","last_unstale":"2024-09-21T03:21:52.899833+0000","last_undegraded":"2024-09-21T03:21:52.899833+0000","last_fullsized":"2024-09-21T03:21:52.899833+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:55.624250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900229+0000","last_change":"2024-09-21T03:21:51.890813+0000","last_active":"2024-09-21T03:21:52.900229+0000","last_peered":"2024-09-21T03:21:52.900229+0000","last_clean":"2024-09-21T03:21:52.900229+0000","last_became_active":"2024-09-21T03:21:51.890330+0000","last_became_peered":"2024-09-21T03:21:51.890330+0000","last_unstale":"2024-09-21T03:21:52.900229+0000","last_undegraded":"2024-09-21T03:21:52.900229+0000","last_fullsized":"2024-09-21T03:21:52.900229+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:52:04.989198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.578126+0000","last_change":"2024-09-21T03:21:51.901017+0000","last_active":"2024-09-21T03:21:53.578126+0000","last_peered":"2024-09-21T03:21:53.578126+0000","last_clean":"2024-09-21T03:21:53.578126+0000","last_became_active":"2024-09-21T03:21:51.900655+0000","last_became_peered":"2024-09-21T03:21:51.900655+0000","last_unstale":"2024-09-21T03:21:53.578126+0000","last_undegraded":"2024-09-21T03:21:53.578126+0000","last_fullsized":"2024-09-21T03:21:53.578126+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:24.486253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.270005+0000","last_change":"2024-09-21T03:21:51.907469+0000","last_active":"2024-09-21T03:21:53.270005+0000","last_peered":"2024-09-21T03:21:53.270005+0000","last_clean":"2024-09-21T03:21:53.270005+0000","last_became_active":"2024-09-21T03:21:51.907159+0000","last_became_peered":"2024-09-21T03:21:51.907159+0000","last_unstale":"2024-09-21T03:21:53.270005+0000","last_undegraded":"2024-09-21T03:21:53.270005+0000","last_fullsized":"2024-09-21T03:21:53.270005+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:45:31.092132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.576587+0000","last_change":"2024-09-21T03:21:51.900790+0000","last_active":"2024-09-21T03:21:53.576587+0000","last_peered":"2024-09-21T03:21:53.576587+0000","last_clean":"2024-09-21T03:21:53.576587+0000","last_became_active":"2024-09-21T03:21:51.900484+0000","last_became_peered":"2024-09-21T03:21:51.900484+0000","last_unstale":"2024-09-21T03:21:53.576587+0000","last_undegraded":"2024-09-21T03:21:53.576587+0000","last_fullsized":"2024-09-21T03:21:53.576587+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:52.176078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898035+0000","last_change":"2024-09-21T03:21:51.896039+0000","last_active":"2024-09-21T03:21:52.898035+0000","last_peered":"2024-09-21T03:21:52.898035+0000","last_clean":"2024-09-21T03:21:52.898035+0000","last_became_active":"2024-09-21T03:21:51.895701+0000","last_became_peered":"2024-09-21T03:21:51.895701+0000","last_unstale":"2024-09-21T03:21:52.898035+0000","last_undegraded":"2024-09-21T03:21:52.898035+0000","last_fullsized":"2024-09-21T03:21:52.898035+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:05.844984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898871+0000","last_change":"2024-09-21T03:21:51.903045+0000","last_active":"2024-09-21T03:21:52.898871+0000","last_peered":"2024-09-21T03:21:52.898871+0000","last_clean":"2024-09-21T03:21:52.898871+0000","last_became_active":"2024-09-21T03:21:51.902734+0000","last_became_peered":"2024-09-21T03:21:51.902734+0000","last_unstale":"2024-09-21T03:21:52.898871+0000","last_undegraded":"2024-09-21T03:21:52.898871+0000","last_fullsized":"2024-09-21T03:21:52.898871+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:05.726920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.270049+0000","last_change":"2024-09-21T03:21:51.898501+0000","last_active":"2024-09-21T03:21:53.270049+0000","last_peered":"2024-09-21T03:21:53.270049+0000","last_clean":"2024-09-21T03:21:53.270049+0000","last_became_active":"2024-09-21T03:21:51.898186+0000","last_became_peered":"2024-09-21T03:21:51.898186+0000","last_unstale":"2024-09-21T03:21:53.270049+0000","last_undegraded":"2024-09-21T03:21:53.270049+0000","last_fullsized":"2024-09-21T03:21:53.270049+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:13.850020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-09-21T03:21:50.877538+0000","last_change":"2024-09-21T03:21:50.877538+0000","last_active":"2024-09-21T03:21:50.865211+0000","last_peered":"2024-09-21T03:21:50.865211+0000","last_clean":"2024-09-21T03:21:50.865211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:50.877538+0000","last_undegraded":"2024-09-21T03:21:50.877538+0000","last_fullsized":"2024-09-21T03:21:50.877538+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.270225+0000","last_change":"2024-09-21T03:21:51.909012+0000","last_active":"2024-09-21T03:21:53.270225+0000","last_peered":"2024-09-21T03:21:53.270225+0000","last_clean":"2024-09-21T03:21:53.270225+0000","last_became_active":"2024-09-21T03:21:51.908626+0000","last_became_peered":"2024-09-21T03:21:51.908626+0000","last_unstale":"2024-09-21T03:21:53.270225+0000","last_undegraded":"2024-09-21T03:21:53.270225+0000","last_fullsized":"2024-09-21T03:21:53.270225+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:24.606033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.270080+0000","last_change":"2024-09-21T03:21:51.907947+0000","last_active":"2024-09-21T03:21:53.270080+0000","last_peered":"2024-09-21T03:21:53.270080+0000","last_clean":"2024-09-21T03:21:53.270080+0000","last_became_active":"2024-09-21T03:21:51.907646+0000","last_became_peered":"2024-09-21T03:21:51.907646+0000","last_unstale":"2024-09-21T03:21:53.270080+0000","last_undegraded":"2024-09-21T03:21:53.270080+0000","last_fullsized":"2024-09-21T03:21:53.270080+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:45:53.374512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900150+0000","last_change":"2024-09-21T03:21:51.905074+0000","last_active":"2024-09-21T03:21:52.900150+0000","last_peered":"2024-09-21T03:21:52.900150+0000","last_clean":"2024-09-21T03:21:52.900150+0000","last_became_active":"2024-09-21T03:21:51.904768+0000","last_became_peered":"2024-09-21T03:21:51.904768+0000","last_unstale":"2024-09-21T03:21:52.900150+0000","last_undegraded":"2024-09-21T03:21:52.900150+0000","last_fullsized":"2024-09-21T03:21:52.900150+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:34.814915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899934+0000","last_change":"2024-09-21T03:21:51.908346+0000","last_active":"2024-09-21T03:21:52.899934+0000","last_peered":"2024-09-21T03:21:52.899934+0000","last_clean":"2024-09-21T03:21:52.899934+0000","last_became_active":"2024-09-21T03:21:51.907761+0000","last_became_peered":"2024-09-21T03:21:51.907761+0000","last_unstale":"2024-09-21T03:21:52.899934+0000","last_undegraded":"2024-09-21T03:21:52.899934+0000","last_fullsized":"2024-09-21T03:21:52.899934+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:31.112370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.269875+0000","last_change":"2024-09-21T03:21:51.907169+0000","last_active":"2024-09-21T03:21:53.269875+0000","last_peered":"2024-09-21T03:21:53.269875+0000","last_clean":"2024-09-21T03:21:53.269875+0000","last_became_active":"2024-09-21T03:21:51.906861+0000","last_became_peered":"2024-09-21T03:21:51.906861+0000","last_unstale":"2024-09-21T03:21:53.269875+0000","last_undegraded":"2024-09-21T03:21:53.269875+0000","last_fullsized":"2024-09-21T03:21:53.269875+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:50.311072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900138+0000","last_change":"2024-09-21T03:21:51.898498+0000","last_active":"2024-09-21T03:21:52.900138+0000","last_peered":"2024-09-21T03:21:52.900138+0000","last_clean":"2024-09-21T03:21:52.900138+0000","last_became_active":"2024-09-21T03:21:51.898168+0000","last_became_peered":"2024-09-21T03:21:51.898168+0000","last_unstale":"2024-09-21T03:21:52.900138+0000","last_undegraded":"2024-09-21T03:21:52.900138+0000","last_fullsized":"2024-09-21T03:21:52.900138+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:46.365557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.578351+0000","last_change":"2024-09-21T03:21:51.903010+0000","last_active":"2024-09-21T03:21:53.578351+0000","last_peered":"2024-09-21T03:21:53.578351+0000","last_clean":"2024-09-21T03:21:53.578351+0000","last_became_active":"2024-09-21T03:21:51.902660+0000","last_became_peered":"2024-09-21T03:21:51.902660+0000","last_unstale":"2024-09-21T03:21:53.578351+0000","last_undegraded":"2024-09-21T03:21:53.578351+0000","last_fullsized":"2024-09-21T03:21:53.578351+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:00:43.998502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898480+0000","last_change":"2024-09-21T03:21:51.901714+0000","last_active":"2024-09-21T03:21:52.898480+0000","last_peered":"2024-09-21T03:21:52.898480+0000","last_clean":"2024-09-21T03:21:52.898480+0000","last_became_active":"2024-09-21T03:21:51.901323+0000","last_became_peered":"2024-09-21T03:21:51.901323+0000","last_unstale":"2024-09-21T03:21:52.898480+0000","last_undegraded":"2024-09-21T03:21:52.898480+0000","last_fullsized":"2024-09-21T03:21:52.898480+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:09.488852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900477+0000","last_change":"2024-09-21T03:21:51.892582+0000","last_active":"2024-09-21T03:21:52.900477+0000","last_peered":"2024-09-21T03:21:52.900477+0000","last_clean":"2024-09-21T03:21:52.900477+0000","last_became_active":"2024-09-21T03:21:51.892311+0000","last_became_peered":"2024-09-21T03:21:51.892311+0000","last_unstale":"2024-09-21T03:21:52.900477+0000","last_undegraded":"2024-09-21T03:21:52.900477+0000","last_fullsized":"2024-09-21T03:21:52.900477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:33.342412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899954+0000","last_change":"2024-09-21T03:21:51.902574+0000","last_active":"2024-09-21T03:21:52.899954+0000","last_peered":"2024-09-21T03:21:52.899954+0000","last_clean":"2024-09-21T03:21:52.899954+0000","last_became_active":"2024-09-21T03:21:51.902279+0000","last_became_peered":"2024-09-21T03:21:51.902279+0000","last_unstale":"2024-09-21T03:21:52.899954+0000","last_undegraded":"2024-09-21T03:21:52.899954+0000","last_fullsized":"2024-09-21T03:21:52.899954+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:07.452760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899652+0000","last_change":"2024-09-21T03:21:51.903656+0000","last_active":"2024-09-21T03:21:52.899652+0000","last_peered":"2024-09-21T03:21:52.899652+0000","last_clean":"2024-09-21T03:21:52.899652+0000","last_became_active":"2024-09-21T03:21:51.903346+0000","last_became_peered":"2024-09-21T03:21:51.903346+0000","last_unstale":"2024-09-21T03:21:52.899652+0000","last_undegraded":"2024-09-21T03:21:52.899652+0000","last_fullsized":"2024-09-21T03:21:52.899652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:05.605373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898116+0000","last_change":"2024-09-21T03:21:51.906337+0000","last_active":"2024-09-21T03:21:52.898116+0000","last_peered":"2024-09-21T03:21:52.898116+0000","last_clean":"2024-09-21T03:21:52.898116+0000","last_became_active":"2024-09-21T03:21:51.906006+0000","last_became_peered":"2024-09-21T03:21:51.906006+0000","last_unstale":"2024-09-21T03:21:52.898116+0000","last_undegraded":"2024-09-21T03:21:52.898116+0000","last_fullsized":"2024-09-21T03:21:52.898116+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:52.059197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899915+0000","last_change":"2024-09-21T03:21:51.890919+0000","last_active":"2024-09-21T03:21:52.899915+0000","last_peered":"2024-09-21T03:21:52.899915+0000","last_clean":"2024-09-21T03:21:52.899915+0000","last_became_active":"2024-09-21T03:21:51.890036+0000","last_became_peered":"2024-09-21T03:21:51.890036+0000","last_unstale":"2024-09-21T03:21:52.899915+0000","last_undegraded":"2024-09-21T03:21:52.899915+0000","last_fullsized":"2024-09-21T03:21:52.899915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:50:08.646746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898739+0000","last_change":"2024-09-21T03:21:51.891404+0000","last_active":"2024-09-21T03:21:52.898739+0000","last_peered":"2024-09-21T03:21:52.898739+0000","last_clean":"2024-09-21T03:21:52.898739+0000","last_became_active":"2024-09-21T03:21:51.891067+0000","last_became_peered":"2024-09-21T03:21:51.891067+0000","last_unstale":"2024-09-21T03:21:52.898739+0000","last_undegraded":"2024-09-21T03:21:52.898739+0000","last_fullsized":"2024-09-21T03:21:52.898739+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:43:18.361524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"79'4","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900471+0000","last_change":"2024-09-21T03:21:50.884910+0000","last_active":"2024-09-21T03:21:52.900471+0000","last_peered":"2024-09-21T03:21:52.900471+0000","last_clean":"2024-09-21T03:21:52.900471+0000","last_became_active":"2024-09-21T03:21:50.884574+0000","last_became_peered":"2024-09-21T03:21:50.884574+0000","last_unstale":"2024-09-21T03:21:52.900471+0000","last_undegraded":"2024-09-21T03:21:52.900471+0000","last_fullsized":"2024-09-21T03:21:52.900471+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:04.344766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900386+0000","last_change":"2024-09-21T03:21:51.908073+0000","last_active":"2024-09-21T03:21:52.900386+0000","last_peered":"2024-09-21T03:21:52.900386+0000","last_clean":"2024-09-21T03:21:52.900386+0000","last_became_active":"2024-09-21T03:21:51.907654+0000","last_became_peered":"2024-09-21T03:21:51.907654+0000","last_unstale":"2024-09-21T03:21:52.900386+0000","last_undegraded":"2024-09-21T03:21:52.900386+0000","last_fullsized":"2024-09-21T03:21:52.900386+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:03.307063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"79'1","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899061+0000","last_change":"2024-09-21T03:21:50.888297+0000","last_active":"2024-09-21T03:21:52.899061+0000","last_peered":"2024-09-21T03:21:52.899061+0000","last_clean":"2024-09-21T03:21:52.899061+0000","last_became_active":"2024-09-21T03:21:50.887943+0000","last_became_peered":"2024-09-21T03:21:50.887943+0000","last_unstale":"2024-09-21T03:21:52.899061+0000","last_undegraded":"2024-09-21T03:21:52.899061+0000","last_fullsized":"2024-09-21T03:21:52.899061+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:57.173705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900498+0000","last_change":"2024-09-21T03:21:51.890296+0000","last_active":"2024-09-21T03:21:52.900498+0000","last_peered":"2024-09-21T03:21:52.900498+0000","last_clean":"2024-09-21T03:21:52.900498+0000","last_became_active":"2024-09-21T03:21:51.889937+0000","last_became_peered":"2024-09-21T03:21:51.889937+0000","last_unstale":"2024-09-21T03:21:52.900498+0000","last_undegraded":"2024-09-21T03:21:52.900498+0000","last_fullsized":"2024-09-21T03:21:52.900498+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:31.802933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:21:50.892113+0000","last_change":"2024-09-21T03:21:50.888653+0000","last_active":"2024-09-21T03:21:50.892113+0000","last_peered":"2024-09-21T03:21:50.892113+0000","last_clean":"2024-09-21T03:21:50.892113+0000","last_became_active":"2024-09-21T03:21:50.888329+0000","last_became_peered":"2024-09-21T03:21:50.888329+0000","last_unstale":"2024-09-21T03:21:50.892113+0000","last_undegraded":"2024-09-21T03:21:50.892113+0000","last_fullsized":"2024-09-21T03:21:50.892113+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:59.226138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.578269+0000","last_change":"2024-09-21T03:21:51.902475+0000","last_active":"2024-09-21T03:21:53.578269+0000","last_peered":"2024-09-21T03:21:53.578269+0000","last_clean":"2024-09-21T03:21:53.578269+0000","last_became_active":"2024-09-21T03:21:51.901928+0000","last_became_peered":"2024-09-21T03:21:51.901928+0000","last_unstale":"2024-09-21T03:21:53.578269+0000","last_undegraded":"2024-09-21T03:21:53.578269+0000","last_fullsized":"2024-09-21T03:21:53.578269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:16.502189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:21:50.893596+0000","last_change":"2024-09-21T03:21:50.889500+0000","last_active":"2024-09-21T03:21:50.893596+0000","last_peered":"2024-09-21T03:21:50.893596+0000","last_clean":"2024-09-21T03:21:50.893596+0000","last_became_active":"2024-09-21T03:21:50.889200+0000","last_became_peered":"2024-09-21T03:21:50.889200+0000","last_unstale":"2024-09-21T03:21:50.893596+0000","last_undegraded":"2024-09-21T03:21:50.893596+0000","last_fullsized":"2024-09-21T03:21:50.893596+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:27.545400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899896+0000","last_change":"2024-09-21T03:21:51.903101+0000","last_active":"2024-09-21T03:21:52.899896+0000","last_peered":"2024-09-21T03:21:52.899896+0000","last_clean":"2024-09-21T03:21:52.899896+0000","last_became_active":"2024-09-21T03:21:51.902773+0000","last_became_peered":"2024-09-21T03:21:51.902773+0000","last_unstale":"2024-09-21T03:21:52.899896+0000","last_undegraded":"2024-09-21T03:21:52.899896+0000","last_fullsized":"2024-09-21T03:21:52.899896+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:01.885867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"79'1","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898638+0000","last_change":"2024-09-21T03:21:50.890186+0000","last_active":"2024-09-21T03:21:52.898638+0000","last_peered":"2024-09-21T03:21:52.898638+0000","last_clean":"2024-09-21T03:21:52.898638+0000","last_became_active":"2024-09-21T03:21:50.889742+0000","last_became_peered":"2024-09-21T03:21:50.889742+0000","last_unstale":"2024-09-21T03:21:52.898638+0000","last_undegraded":"2024-09-21T03:21:52.898638+0000","last_fullsized":"2024-09-21T03:21:52.898638+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:06.447091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898436+0000","last_change":"2024-09-21T03:21:51.902339+0000","last_active":"2024-09-21T03:21:52.898436+0000","last_peered":"2024-09-21T03:21:52.898436+0000","last_clean":"2024-09-21T03:21:52.898436+0000","last_became_active":"2024-09-21T03:21:51.902038+0000","last_became_peered":"2024-09-21T03:21:51.902038+0000","last_unstale":"2024-09-21T03:21:52.898436+0000","last_undegraded":"2024-09-21T03:21:52.898436+0000","last_fullsized":"2024-09-21T03:21:52.898436+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:15.428843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"79'1","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898008+0000","last_change":"2024-09-21T03:21:50.889708+0000","last_active":"2024-09-21T03:21:52.898008+0000","last_peered":"2024-09-21T03:21:52.898008+0000","last_clean":"2024-09-21T03:21:52.898008+0000","last_became_active":"2024-09-21T03:21:50.888284+0000","last_became_peered":"2024-09-21T03:21:50.888284+0000","last_unstale":"2024-09-21T03:21:52.898008+0000","last_undegraded":"2024-09-21T03:21:52.898008+0000","last_fullsized":"2024-09-21T03:21:52.898008+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:04.599704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577421+0000","last_change":"2024-09-21T03:21:51.905014+0000","last_active":"2024-09-21T03:21:53.577421+0000","last_peered":"2024-09-21T03:21:53.577421+0000","last_clean":"2024-09-21T03:21:53.577421+0000","last_became_active":"2024-09-21T03:21:51.904638+0000","last_became_peered":"2024-09-21T03:21:51.904638+0000","last_unstale":"2024-09-21T03:21:53.577421+0000","last_undegraded":"2024-09-21T03:21:53.577421+0000","last_fullsized":"2024-09-21T03:21:53.577421+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:40:07.583428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:21:50.893644+0000","last_change":"2024-09-21T03:21:50.890284+0000","last_active":"2024-09-21T03:21:50.893644+0000","last_peered":"2024-09-21T03:21:50.893644+0000","last_clean":"2024-09-21T03:21:50.893644+0000","last_became_active":"2024-09-21T03:21:50.890002+0000","last_became_peered":"2024-09-21T03:21:50.890002+0000","last_unstale":"2024-09-21T03:21:50.893644+0000","last_undegraded":"2024-09-21T03:21:50.893644+0000","last_fullsized":"2024-09-21T03:21:50.893644+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:50.274219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.576875+0000","last_change":"2024-09-21T03:21:51.899993+0000","last_active":"2024-09-21T03:21:53.576875+0000","last_peered":"2024-09-21T03:21:53.576875+0000","last_clean":"2024-09-21T03:21:53.576875+0000","last_became_active":"2024-09-21T03:21:51.899632+0000","last_became_peered":"2024-09-21T03:21:51.899632+0000","last_unstale":"2024-09-21T03:21:53.576875+0000","last_undegraded":"2024-09-21T03:21:53.576875+0000","last_fullsized":"2024-09-21T03:21:53.576875+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:15.015396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899544+0000","last_change":"2024-09-21T03:21:50.894291+0000","last_active":"2024-09-21T03:21:52.899544+0000","last_peered":"2024-09-21T03:21:52.899544+0000","last_clean":"2024-09-21T03:21:52.899544+0000","last_became_active":"2024-09-21T03:21:50.894001+0000","last_became_peered":"2024-09-21T03:21:50.894001+0000","last_unstale":"2024-09-21T03:21:52.899544+0000","last_undegraded":"2024-09-21T03:21:52.899544+0000","last_fullsized":"2024-09-21T03:21:52.899544+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:38:02.558962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577019+0000","last_change":"2024-09-21T03:21:51.894313+0000","last_active":"2024-09-21T03:21:53.577019+0000","last_peered":"2024-09-21T03:21:53.577019+0000","last_clean":"2024-09-21T03:21:53.577019+0000","last_became_active":"2024-09-21T03:21:51.894003+0000","last_became_peered":"2024-09-21T03:21:51.894003+0000","last_unstale":"2024-09-21T03:21:53.577019+0000","last_undegraded":"2024-09-21T03:21:53.577019+0000","last_fullsized":"2024-09-21T03:21:53.577019+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:55.444519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900543+0000","last_change":"2024-09-21T03:21:50.883437+0000","last_active":"2024-09-21T03:21:52.900543+0000","last_peered":"2024-09-21T03:21:52.900543+0000","last_clean":"2024-09-21T03:21:52.900543+0000","last_became_active":"2024-09-21T03:21:50.883111+0000","last_became_peered":"2024-09-21T03:21:50.883111+0000","last_unstale":"2024-09-21T03:21:52.900543+0000","last_undegraded":"2024-09-21T03:21:52.900543+0000","last_fullsized":"2024-09-21T03:21:52.900543+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:50.701648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:21:51.910716+0000","last_change":"2024-09-21T03:21:51.904652+0000","last_active":"2024-09-21T03:21:51.910716+0000","last_peered":"2024-09-21T03:21:51.910716+0000","last_clean":"2024-09-21T03:21:51.910716+0000","last_became_active":"2024-09-21T03:21:51.904284+0000","last_became_peered":"2024-09-21T03:21:51.904284+0000","last_unstale":"2024-09-21T03:21:51.910716+0000","last_undegraded":"2024-09-21T03:21:51.910716+0000","last_fullsized":"2024-09-21T03:21:51.910716+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:25.792212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900223+0000","last_change":"2024-09-21T03:21:50.890689+0000","last_active":"2024-09-21T03:21:52.900223+0000","last_peered":"2024-09-21T03:21:52.900223+0000","last_clean":"2024-09-21T03:21:52.900223+0000","last_became_active":"2024-09-21T03:21:50.890329+0000","last_became_peered":"2024-09-21T03:21:50.890329+0000","last_unstale":"2024-09-21T03:21:52.900223+0000","last_undegraded":"2024-09-21T03:21:52.900223+0000","last_fullsized":"2024-09-21T03:21:52.900223+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:46:35.605253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-09-21T03:21:50.876522+0000","last_change":"2024-09-21T03:21:50.876522+0000","last_active":"2024-09-21T03:21:50.865211+0000","last_peered":"2024-09-21T03:21:50.865211+0000","last_clean":"2024-09-21T03:21:50.865211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:50.876522+0000","last_undegraded":"2024-09-21T03:21:50.876522+0000","last_fullsized":"2024-09-21T03:21:50.876522+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"79'3","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899751+0000","last_change":"2024-09-21T03:21:50.891311+0000","last_active":"2024-09-21T03:21:52.899751+0000","last_peered":"2024-09-21T03:21:52.899751+0000","last_clean":"2024-09-21T03:21:52.899751+0000","last_became_active":"2024-09-21T03:21:50.890713+0000","last_became_peered":"2024-09-21T03:21:50.890713+0000","last_unstale":"2024-09-21T03:21:52.899751+0000","last_undegraded":"2024-09-21T03:21:52.899751+0000","last_fullsized":"2024-09-21T03:21:52.899751+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:41.919161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898766+0000","last_change":"2024-09-21T03:21:51.908205+0000","last_active":"2024-09-21T03:21:52.898766+0000","last_peered":"2024-09-21T03:21:52.898766+0000","last_clean":"2024-09-21T03:21:52.898766+0000","last_became_active":"2024-09-21T03:21:51.907239+0000","last_became_peered":"2024-09-21T03:21:51.907239+0000","last_unstale":"2024-09-21T03:21:52.898766+0000","last_undegraded":"2024-09-21T03:21:52.898766+0000","last_fullsized":"2024-09-21T03:21:52.898766+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:08:40.548484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"79'6","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:21:51.917164+0000","last_change":"2024-09-21T03:21:50.887898+0000","last_active":"2024-09-21T03:21:51.917164+0000","last_peered":"2024-09-21T03:21:51.917164+0000","last_clean":"2024-09-21T03:21:51.917164+0000","last_became_active":"2024-09-21T03:21:50.887571+0000","last_became_peered":"2024-09-21T03:21:50.887571+0000","last_unstale":"2024-09-21T03:21:51.917164+0000","last_undegraded":"2024-09-21T03:21:51.917164+0000","last_fullsized":"2024-09-21T03:21:51.917164+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:47:46.235056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-09-21T03:21:50.875320+0000","last_change":"2024-09-21T03:21:50.875320+0000","last_active":"2024-09-21T03:21:50.865211+0000","last_peered":"2024-09-21T03:21:50.865211+0000","last_clean":"2024-09-21T03:21:50.865211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:50.875320+0000","last_undegraded":"2024-09-21T03:21:50.875320+0000","last_fullsized":"2024-09-21T03:21:50.875320+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"79'2","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899993+0000","last_change":"2024-09-21T03:21:50.889245+0000","last_active":"2024-09-21T03:21:52.899993+0000","last_peered":"2024-09-21T03:21:52.899993+0000","last_clean":"2024-09-21T03:21:52.899993+0000","last_became_active":"2024-09-21T03:21:50.888937+0000","last_became_peered":"2024-09-21T03:21:50.888937+0000","last_unstale":"2024-09-21T03:21:52.899993+0000","last_undegraded":"2024-09-21T03:21:52.899993+0000","last_fullsized":"2024-09-21T03:21:52.899993+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:45:52.368843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.578464+0000","last_change":"2024-09-21T03:21:51.905440+0000","last_active":"2024-09-21T03:21:53.578464+0000","last_peered":"2024-09-21T03:21:53.578464+0000","last_clean":"2024-09-21T03:21:53.578464+0000","last_became_active":"2024-09-21T03:21:51.905015+0000","last_became_peered":"2024-09-21T03:21:51.905015+0000","last_unstale":"2024-09-21T03:21:53.578464+0000","last_undegraded":"2024-09-21T03:21:53.578464+0000","last_fullsized":"2024-09-21T03:21:53.578464+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:55.444519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.576949+0000","last_change":"2024-09-21T03:21:50.885645+0000","last_active":"2024-09-21T03:21:53.576949+0000","last_peered":"2024-09-21T03:21:53.576949+0000","last_clean":"2024-09-21T03:21:53.576949+0000","last_became_active":"2024-09-21T03:21:50.885322+0000","last_became_peered":"2024-09-21T03:21:50.885322+0000","last_unstale":"2024-09-21T03:21:53.576949+0000","last_undegraded":"2024-09-21T03:21:53.576949+0000","last_fullsized":"2024-09-21T03:21:53.576949+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:21:22.286598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899587+0000","last_change":"2024-09-21T03:21:51.904861+0000","last_active":"2024-09-21T03:21:52.899587+0000","last_peered":"2024-09-21T03:21:52.899587+0000","last_clean":"2024-09-21T03:21:52.899587+0000","last_became_active":"2024-09-21T03:21:51.904529+0000","last_became_peered":"2024-09-21T03:21:51.904529+0000","last_unstale":"2024-09-21T03:21:52.899587+0000","last_undegraded":"2024-09-21T03:21:52.899587+0000","last_fullsized":"2024-09-21T03:21:52.899587+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:14.676515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:21:51.892974+0000","last_change":"2024-09-21T03:21:50.893102+0000","last_active":"2024-09-21T03:21:51.892974+0000","last_peered":"2024-09-21T03:21:51.892974+0000","last_clean":"2024-09-21T03:21:51.892974+0000","last_became_active":"2024-09-21T03:21:50.892785+0000","last_became_peered":"2024-09-21T03:21:50.892785+0000","last_unstale":"2024-09-21T03:21:51.892974+0000","last_undegraded":"2024-09-21T03:21:51.892974+0000","last_fullsized":"2024-09-21T03:21:51.892974+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:17.615245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899583+0000","last_change":"2024-09-21T03:21:51.894797+0000","last_active":"2024-09-21T03:21:52.899583+0000","last_peered":"2024-09-21T03:21:52.899583+0000","last_clean":"2024-09-21T03:21:52.899583+0000","last_became_active":"2024-09-21T03:21:51.894373+0000","last_became_peered":"2024-09-21T03:21:51.894373+0000","last_unstale":"2024-09-21T03:21:52.899583+0000","last_undegraded":"2024-09-21T03:21:52.899583+0000","last_fullsized":"2024-09-21T03:21:52.899583+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:02:38.762310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:21:50.887615+0000","last_change":"2024-09-21T03:21:50.883788+0000","last_active":"2024-09-21T03:21:50.887615+0000","last_peered":"2024-09-21T03:21:50.887615+0000","last_clean":"2024-09-21T03:21:50.887615+0000","last_became_active":"2024-09-21T03:21:50.883369+0000","last_became_peered":"2024-09-21T03:21:50.883369+0000","last_unstale":"2024-09-21T03:21:50.887615+0000","last_undegraded":"2024-09-21T03:21:50.887615+0000","last_fullsized":"2024-09-21T03:21:50.887615+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:18.324712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.578242+0000","last_change":"2024-09-21T03:21:51.898550+0000","last_active":"2024-09-21T03:21:53.578242+0000","last_peered":"2024-09-21T03:21:53.578242+0000","last_clean":"2024-09-21T03:21:53.578242+0000","last_became_active":"2024-09-21T03:21:51.898201+0000","last_became_peered":"2024-09-21T03:21:51.898201+0000","last_unstale":"2024-09-21T03:21:53.578242+0000","last_undegraded":"2024-09-21T03:21:53.578242+0000","last_fullsized":"2024-09-21T03:21:53.578242+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:11:42.267787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"79'1","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900728+0000","last_change":"2024-09-21T03:21:50.889581+0000","last_active":"2024-09-21T03:21:52.900728+0000","last_peered":"2024-09-21T03:21:52.900728+0000","last_clean":"2024-09-21T03:21:52.900728+0000","last_became_active":"2024-09-21T03:21:50.889245+0000","last_became_peered":"2024-09-21T03:21:50.889245+0000","last_unstale":"2024-09-21T03:21:52.900728+0000","last_undegraded":"2024-09-21T03:21:52.900728+0000","last_fullsized":"2024-09-21T03:21:52.900728+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:00.493999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900576+0000","last_change":"2024-09-21T03:21:51.899099+0000","last_active":"2024-09-21T03:21:52.900576+0000","last_peered":"2024-09-21T03:21:52.900576+0000","last_clean":"2024-09-21T03:21:52.900576+0000","last_became_active":"2024-09-21T03:21:51.898350+0000","last_became_peered":"2024-09-21T03:21:51.898350+0000","last_unstale":"2024-09-21T03:21:52.900576+0000","last_undegraded":"2024-09-21T03:21:52.900576+0000","last_fullsized":"2024-09-21T03:21:52.900576+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:43.337873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:21:50.896489+0000","last_change":"2024-09-21T03:21:50.892793+0000","last_active":"2024-09-21T03:21:50.896489+0000","last_peered":"2024-09-21T03:21:50.896489+0000","last_clean":"2024-09-21T03:21:50.896489+0000","last_became_active":"2024-09-21T03:21:50.892459+0000","last_became_peered":"2024-09-21T03:21:50.892459+0000","last_unstale":"2024-09-21T03:21:50.896489+0000","last_undegraded":"2024-09-21T03:21:50.896489+0000","last_fullsized":"2024-09-21T03:21:50.896489+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:53:29.177030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898808+0000","last_change":"2024-09-21T03:21:51.893380+0000","last_active":"2024-09-21T03:21:52.898808+0000","last_peered":"2024-09-21T03:21:52.898808+0000","last_clean":"2024-09-21T03:21:52.898808+0000","last_became_active":"2024-09-21T03:21:51.893039+0000","last_became_peered":"2024-09-21T03:21:51.893039+0000","last_unstale":"2024-09-21T03:21:52.898808+0000","last_undegraded":"2024-09-21T03:21:52.898808+0000","last_fullsized":"2024-09-21T03:21:52.898808+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:11.163288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:21:50.893627+0000","last_change":"2024-09-21T03:21:50.891075+0000","last_active":"2024-09-21T03:21:50.893627+0000","last_peered":"2024-09-21T03:21:50.893627+0000","last_clean":"2024-09-21T03:21:50.893627+0000","last_became_active":"2024-09-21T03:21:50.890732+0000","last_became_peered":"2024-09-21T03:21:50.890732+0000","last_unstale":"2024-09-21T03:21:50.893627+0000","last_undegraded":"2024-09-21T03:21:50.893627+0000","last_fullsized":"2024-09-21T03:21:50.893627+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:50:08.020422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.270234+0000","last_change":"2024-09-21T03:21:51.907368+0000","last_active":"2024-09-21T03:21:53.270234+0000","last_peered":"2024-09-21T03:21:53.270234+0000","last_clean":"2024-09-21T03:21:53.270234+0000","last_became_active":"2024-09-21T03:21:51.906509+0000","last_became_peered":"2024-09-21T03:21:51.906509+0000","last_unstale":"2024-09-21T03:21:53.270234+0000","last_undegraded":"2024-09-21T03:21:53.270234+0000","last_fullsized":"2024-09-21T03:21:53.270234+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:31:41.794069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"79'2","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577118+0000","last_change":"2024-09-21T03:21:50.881909+0000","last_active":"2024-09-21T03:21:53.577118+0000","last_peered":"2024-09-21T03:21:53.577118+0000","last_clean":"2024-09-21T03:21:53.577118+0000","last_became_active":"2024-09-21T03:21:50.881541+0000","last_became_peered":"2024-09-21T03:21:50.881541+0000","last_unstale":"2024-09-21T03:21:53.577118+0000","last_undegraded":"2024-09-21T03:21:53.577118+0000","last_fullsized":"2024-09-21T03:21:53.577118+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:02.316385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:21:51.907914+0000","last_change":"2024-09-21T03:21:51.901261+0000","last_active":"2024-09-21T03:21:51.907914+0000","last_peered":"2024-09-21T03:21:51.907914+0000","last_clean":"2024-09-21T03:21:51.907914+0000","last_became_active":"2024-09-21T03:21:51.900954+0000","last_became_peered":"2024-09-21T03:21:51.900954+0000","last_unstale":"2024-09-21T03:21:51.907914+0000","last_undegraded":"2024-09-21T03:21:51.907914+0000","last_fullsized":"2024-09-21T03:21:51.907914+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:41.233859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.270134+0000","last_change":"2024-09-21T03:21:50.884684+0000","last_active":"2024-09-21T03:21:53.270134+0000","last_peered":"2024-09-21T03:21:53.270134+0000","last_clean":"2024-09-21T03:21:53.270134+0000","last_became_active":"2024-09-21T03:21:50.883447+0000","last_became_peered":"2024-09-21T03:21:50.883447+0000","last_unstale":"2024-09-21T03:21:53.270134+0000","last_undegraded":"2024-09-21T03:21:53.270134+0000","last_fullsized":"2024-09-21T03:21:53.270134+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:10.639009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.269927+0000","last_change":"2024-09-21T03:21:51.901038+0000","last_active":"2024-09-21T03:21:53.269927+0000","last_peered":"2024-09-21T03:21:53.269927+0000","last_clean":"2024-09-21T03:21:53.269927+0000","last_became_active":"2024-09-21T03:21:51.900648+0000","last_became_peered":"2024-09-21T03:21:51.900648+0000","last_unstale":"2024-09-21T03:21:53.269927+0000","last_undegraded":"2024-09-21T03:21:53.269927+0000","last_fullsized":"2024-09-21T03:21:53.269927+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:26.805582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.269785+0000","last_change":"2024-09-21T03:21:50.891133+0000","last_active":"2024-09-21T03:21:53.269785+0000","last_peered":"2024-09-21T03:21:53.269785+0000","last_clean":"2024-09-21T03:21:53.269785+0000","last_became_active":"2024-09-21T03:21:50.890817+0000","last_became_peered":"2024-09-21T03:21:50.890817+0000","last_unstale":"2024-09-21T03:21:53.269785+0000","last_undegraded":"2024-09-21T03:21:53.269785+0000","last_fullsized":"2024-09-21T03:21:53.269785+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:16.600569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:21:51.911382+0000","last_change":"2024-09-21T03:21:51.909921+0000","last_active":"2024-09-21T03:21:51.911382+0000","last_peered":"2024-09-21T03:21:51.911382+0000","last_clean":"2024-09-21T03:21:51.911382+0000","last_became_active":"2024-09-21T03:21:51.909432+0000","last_became_peered":"2024-09-21T03:21:51.909432+0000","last_unstale":"2024-09-21T03:21:51.911382+0000","last_undegraded":"2024-09-21T03:21:51.911382+0000","last_fullsized":"2024-09-21T03:21:51.911382+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:31.112370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.576433+0000","last_change":"2024-09-21T03:21:50.881109+0000","last_active":"2024-09-21T03:21:53.576433+0000","last_peered":"2024-09-21T03:21:53.576433+0000","last_clean":"2024-09-21T03:21:53.576433+0000","last_became_active":"2024-09-21T03:21:50.880825+0000","last_became_peered":"2024-09-21T03:21:50.880825+0000","last_unstale":"2024-09-21T03:21:53.576433+0000","last_undegraded":"2024-09-21T03:21:53.576433+0000","last_fullsized":"2024-09-21T03:21:53.576433+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:40:06.577759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899093+0000","last_change":"2024-09-21T03:21:51.900827+0000","last_active":"2024-09-21T03:21:52.899093+0000","last_peered":"2024-09-21T03:21:52.899093+0000","last_clean":"2024-09-21T03:21:52.899093+0000","last_became_active":"2024-09-21T03:21:51.900485+0000","last_became_peered":"2024-09-21T03:21:51.900485+0000","last_unstale":"2024-09-21T03:21:52.899093+0000","last_undegraded":"2024-09-21T03:21:52.899093+0000","last_fullsized":"2024-09-21T03:21:52.899093+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:40.866323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"79'2","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899992+0000","last_change":"2024-09-21T03:21:50.886982+0000","last_active":"2024-09-21T03:21:52.899992+0000","last_peered":"2024-09-21T03:21:52.899992+0000","last_clean":"2024-09-21T03:21:52.899992+0000","last_became_active":"2024-09-21T03:21:50.886661+0000","last_became_peered":"2024-09-21T03:21:50.886661+0000","last_unstale":"2024-09-21T03:21:52.899992+0000","last_undegraded":"2024-09-21T03:21:52.899992+0000","last_fullsized":"2024-09-21T03:21:52.899992+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:31:40.788400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.578330+0000","last_change":"2024-09-21T03:21:51.909713+0000","last_active":"2024-09-21T03:21:53.578330+0000","last_peered":"2024-09-21T03:21:53.578330+0000","last_clean":"2024-09-21T03:21:53.578330+0000","last_became_active":"2024-09-21T03:21:51.909373+0000","last_became_peered":"2024-09-21T03:21:51.909373+0000","last_unstale":"2024-09-21T03:21:53.578330+0000","last_undegraded":"2024-09-21T03:21:53.578330+0000","last_fullsized":"2024-09-21T03:21:53.578330+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:52.176078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"79'1","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899881+0000","last_change":"2024-09-21T03:21:50.891027+0000","last_active":"2024-09-21T03:21:52.899881+0000","last_peered":"2024-09-21T03:21:52.899881+0000","last_clean":"2024-09-21T03:21:52.899881+0000","last_became_active":"2024-09-21T03:21:50.890732+0000","last_became_peered":"2024-09-21T03:21:50.890732+0000","last_unstale":"2024-09-21T03:21:52.899881+0000","last_undegraded":"2024-09-21T03:21:52.899881+0000","last_fullsized":"2024-09-21T03:21:52.899881+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:21.808526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900708+0000","last_change":"2024-09-21T03:21:51.905815+0000","last_active":"2024-09-21T03:21:52.900708+0000","last_peered":"2024-09-21T03:21:52.900708+0000","last_clean":"2024-09-21T03:21:52.900708+0000","last_became_active":"2024-09-21T03:21:51.905422+0000","last_became_peered":"2024-09-21T03:21:51.905422+0000","last_unstale":"2024-09-21T03:21:52.900708+0000","last_undegraded":"2024-09-21T03:21:52.900708+0000","last_fullsized":"2024-09-21T03:21:52.900708+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:31.675347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899899+0000","last_change":"2024-09-21T03:21:50.891090+0000","last_active":"2024-09-21T03:21:52.899899+0000","last_peered":"2024-09-21T03:21:52.899899+0000","last_clean":"2024-09-21T03:21:52.899899+0000","last_became_active":"2024-09-21T03:21:50.890775+0000","last_became_peered":"2024-09-21T03:21:50.890775+0000","last_unstale":"2024-09-21T03:21:52.899899+0000","last_undegraded":"2024-09-21T03:21:52.899899+0000","last_fullsized":"2024-09-21T03:21:52.899899+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:28.931234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899083+0000","last_change":"2024-09-21T03:21:51.907507+0000","last_active":"2024-09-21T03:21:52.899083+0000","last_peered":"2024-09-21T03:21:52.899083+0000","last_clean":"2024-09-21T03:21:52.899083+0000","last_became_active":"2024-09-21T03:21:51.906065+0000","last_became_peered":"2024-09-21T03:21:51.906065+0000","last_unstale":"2024-09-21T03:21:52.899083+0000","last_undegraded":"2024-09-21T03:21:52.899083+0000","last_fullsized":"2024-09-21T03:21:52.899083+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:34:58.232355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900634+0000","last_change":"2024-09-21T03:21:50.882989+0000","last_active":"2024-09-21T03:21:52.900634+0000","last_peered":"2024-09-21T03:21:52.900634+0000","last_clean":"2024-09-21T03:21:52.900634+0000","last_became_active":"2024-09-21T03:21:50.882493+0000","last_became_peered":"2024-09-21T03:21:50.882493+0000","last_unstale":"2024-09-21T03:21:52.900634+0000","last_undegraded":"2024-09-21T03:21:52.900634+0000","last_fullsized":"2024-09-21T03:21:52.900634+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:48.422744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:21:51.908069+0000","last_change":"2024-09-21T03:21:51.901903+0000","last_active":"2024-09-21T03:21:51.908069+0000","last_peered":"2024-09-21T03:21:51.908069+0000","last_clean":"2024-09-21T03:21:51.908069+0000","last_became_active":"2024-09-21T03:21:51.901578+0000","last_became_peered":"2024-09-21T03:21:51.901578+0000","last_unstale":"2024-09-21T03:21:51.908069+0000","last_undegraded":"2024-09-21T03:21:51.908069+0000","last_fullsized":"2024-09-21T03:21:51.908069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:26.773312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:21:50.889552+0000","last_change":"2024-09-21T03:21:50.886896+0000","last_active":"2024-09-21T03:21:50.889552+0000","last_peered":"2024-09-21T03:21:50.889552+0000","last_clean":"2024-09-21T03:21:50.889552+0000","last_became_active":"2024-09-21T03:21:50.886606+0000","last_became_peered":"2024-09-21T03:21:50.886606+0000","last_unstale":"2024-09-21T03:21:50.889552+0000","last_undegraded":"2024-09-21T03:21:50.889552+0000","last_fullsized":"2024-09-21T03:21:50.889552+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:36:12.594255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-09-21T03:21:50.877825+0000","last_change":"2024-09-21T03:21:50.877825+0000","last_active":"2024-09-21T03:21:50.865211+0000","last_peered":"2024-09-21T03:21:50.865211+0000","last_clean":"2024-09-21T03:21:50.865211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:21:50.877825+0000","last_undegraded":"2024-09-21T03:21:50.877825+0000","last_fullsized":"2024-09-21T03:21:50.877825+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898172+0000","last_change":"2024-09-21T03:21:50.888581+0000","last_active":"2024-09-21T03:21:52.898172+0000","last_peered":"2024-09-21T03:21:52.898172+0000","last_clean":"2024-09-21T03:21:52.898172+0000","last_became_active":"2024-09-21T03:21:50.887896+0000","last_became_peered":"2024-09-21T03:21:50.887896+0000","last_unstale":"2024-09-21T03:21:52.898172+0000","last_undegraded":"2024-09-21T03:21:52.898172+0000","last_fullsized":"2024-09-21T03:21:52.898172+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:00.880198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577694+0000","last_change":"2024-09-21T03:21:51.903858+0000","last_active":"2024-09-21T03:21:53.577694+0000","last_peered":"2024-09-21T03:21:53.577694+0000","last_clean":"2024-09-21T03:21:53.577694+0000","last_became_active":"2024-09-21T03:21:51.903527+0000","last_became_peered":"2024-09-21T03:21:51.903527+0000","last_unstale":"2024-09-21T03:21:53.577694+0000","last_undegraded":"2024-09-21T03:21:53.577694+0000","last_fullsized":"2024-09-21T03:21:53.577694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:21:23.292266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900099+0000","last_change":"2024-09-21T03:21:50.891506+0000","last_active":"2024-09-21T03:21:52.900099+0000","last_peered":"2024-09-21T03:21:52.900099+0000","last_clean":"2024-09-21T03:21:52.900099+0000","last_became_active":"2024-09-21T03:21:50.891130+0000","last_became_peered":"2024-09-21T03:21:50.891130+0000","last_unstale":"2024-09-21T03:21:52.900099+0000","last_undegraded":"2024-09-21T03:21:52.900099+0000","last_fullsized":"2024-09-21T03:21:52.900099+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:16.126547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899967+0000","last_change":"2024-09-21T03:21:51.894997+0000","last_active":"2024-09-21T03:21:52.899967+0000","last_peered":"2024-09-21T03:21:52.899967+0000","last_clean":"2024-09-21T03:21:52.899967+0000","last_became_active":"2024-09-21T03:21:51.894658+0000","last_became_peered":"2024-09-21T03:21:51.894658+0000","last_unstale":"2024-09-21T03:21:52.899967+0000","last_undegraded":"2024-09-21T03:21:52.899967+0000","last_fullsized":"2024-09-21T03:21:52.899967+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:09.488852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.897965+0000","last_change":"2024-09-21T03:21:50.891199+0000","last_active":"2024-09-21T03:21:52.897965+0000","last_peered":"2024-09-21T03:21:52.897965+0000","last_clean":"2024-09-21T03:21:52.897965+0000","last_became_active":"2024-09-21T03:21:50.890837+0000","last_became_peered":"2024-09-21T03:21:50.890837+0000","last_unstale":"2024-09-21T03:21:52.897965+0000","last_undegraded":"2024-09-21T03:21:52.897965+0000","last_fullsized":"2024-09-21T03:21:52.897965+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:54.618581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900002+0000","last_change":"2024-09-21T03:21:51.899525+0000","last_active":"2024-09-21T03:21:52.900002+0000","last_peered":"2024-09-21T03:21:52.900002+0000","last_clean":"2024-09-21T03:21:52.900002+0000","last_became_active":"2024-09-21T03:21:51.899003+0000","last_became_peered":"2024-09-21T03:21:51.899003+0000","last_unstale":"2024-09-21T03:21:52.900002+0000","last_undegraded":"2024-09-21T03:21:52.900002+0000","last_fullsized":"2024-09-21T03:21:52.900002+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:51.707317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"79'1","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.578284+0000","last_change":"2024-09-21T03:21:50.886216+0000","last_active":"2024-09-21T03:21:53.578284+0000","last_peered":"2024-09-21T03:21:53.578284+0000","last_clean":"2024-09-21T03:21:53.578284+0000","last_became_active":"2024-09-21T03:21:50.885887+0000","last_became_peered":"2024-09-21T03:21:50.885887+0000","last_unstale":"2024-09-21T03:21:53.578284+0000","last_undegraded":"2024-09-21T03:21:53.578284+0000","last_fullsized":"2024-09-21T03:21:53.578284+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:08.483183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":219,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577601+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:21:53.577601+0000","last_peered":"2024-09-21T03:21:53.577601+0000","last_clean":"2024-09-21T03:21:53.577601+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:21:53.577601+0000","last_undegraded":"2024-09-21T03:21:53.577601+0000","last_fullsized":"2024-09-21T03:21:53.577601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25,"ondisk_log_size":25,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509488,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1560576,"data_stored":991979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509487,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":974848,"data_stored":402235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509486,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":978944,"data_stored":403175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509486,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":962560,"data_stored":401541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509487,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":974848,"data_stored":403153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509487,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":966656,"data_stored":402123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509487,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":987136,"data_stored":408035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32696,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339144,"statfs":{"total":96636764160,"available":96603283456,"internally_reserved":0,"allocated":1544192,"data_stored":985134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:21:56.667 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2d is not active+clean 2024-09-21T03:21:56.667 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:21:50.877538+0000', 'last_change': '2024-09-21T03:21:50.877538+0000', 'last_active': '2024-09-21T03:21:50.865211+0000', 'last_peered': '2024-09-21T03:21:50.865211+0000', 'last_clean': '2024-09-21T03:21:50.865211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:50.877538+0000', 'last_undegraded': '2024-09-21T03:21:50.877538+0000', 'last_fullsized': '2024-09-21T03:21:50.877538+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:50.865211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:50.865211+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:50.865211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:21:56.667 INFO:tasks.ceph.ceph_manager.ceph:PG 13.14 is not active+clean 2024-09-21T03:21:56.667 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:21:50.876522+0000', 'last_change': '2024-09-21T03:21:50.876522+0000', 'last_active': '2024-09-21T03:21:50.865211+0000', 'last_peered': '2024-09-21T03:21:50.865211+0000', 'last_clean': '2024-09-21T03:21:50.865211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:50.876522+0000', 'last_undegraded': '2024-09-21T03:21:50.876522+0000', 'last_fullsized': '2024-09-21T03:21:50.876522+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:50.865211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:50.865211+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:50.865211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:21:56.667 INFO:tasks.ceph.ceph_manager.ceph:PG 13.12 is not active+clean 2024-09-21T03:21:56.667 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:21:50.875320+0000', 'last_change': '2024-09-21T03:21:50.875320+0000', 'last_active': '2024-09-21T03:21:50.865211+0000', 'last_peered': '2024-09-21T03:21:50.865211+0000', 'last_clean': '2024-09-21T03:21:50.865211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:50.875320+0000', 'last_undegraded': '2024-09-21T03:21:50.875320+0000', 'last_fullsized': '2024-09-21T03:21:50.875320+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:50.865211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:50.865211+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:50.865211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:21:56.667 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3 is not active+clean 2024-09-21T03:21:56.667 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:21:50.877825+0000', 'last_change': '2024-09-21T03:21:50.877825+0000', 'last_active': '2024-09-21T03:21:50.865211+0000', 'last_peered': '2024-09-21T03:21:50.865211+0000', 'last_clean': '2024-09-21T03:21:50.865211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:21:50.877825+0000', 'last_undegraded': '2024-09-21T03:21:50.877825+0000', 'last_fullsized': '2024-09-21T03:21:50.877825+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:21:50.865211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:21:50.865211+0000', 'last_clean_scrub_stamp': '2024-09-21T03:21:50.865211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:21:56.668 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T03:21:56.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.813+0000 7f2173a40640 1 -- 172.21.15.105:0/3227851056 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2158003fd0 msgr2=0x7f2158004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:56.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.813+0000 7f2173a40640 1 --2- 172.21.15.105:0/3227851056 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2158003fd0 0x7f2158004800 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f216c0ced00 tx=0x7f2158005830 comp rx=0 tx=0).stop 2024-09-21T03:21:56.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.813+0000 7f2171fdd640 1 -- 172.21.15.105:0/3227851056 reap_dead start 2024-09-21T03:21:56.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.813+0000 7f2173a40640 1 -- 172.21.15.105:0/3227851056 shutdown_connections 2024-09-21T03:21:56.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.813+0000 7f2173a40640 1 -- 172.21.15.105:0/3227851056 >> 172.21.15.105:0/3227851056 conn(0x7f216c0cdcc0 msgr2=0x7f216c0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:56.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.813+0000 7f2173a40640 1 -- 172.21.15.105:0/3227851056 shutdown_connections 2024-09-21T03:21:56.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.813+0000 7f2173a40640 1 -- 172.21.15.105:0/3227851056 wait complete. 2024-09-21T03:21:56.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.815+0000 7f2173a40640 1 Processor -- start 2024-09-21T03:21:56.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.815+0000 7f2173a40640 1 -- start start 2024-09-21T03:21:56.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.816+0000 7f2173a40640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2158003fd0 0x7f216c1e4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:56.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.816+0000 7f2173a40640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f216c157da0 0x7f216c159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:56.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.816+0000 7f2173a40640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f216c1581b0 0x7f216c15a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:56.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.816+0000 7f2173a40640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f216c0d07e0 con 0x7f216c1581b0 2024-09-21T03:21:56.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.816+0000 7f2173a40640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f216c0d0660 con 0x7f2158003fd0 2024-09-21T03:21:56.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.816+0000 7f2173a40640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f216c0d0960 con 0x7f216c157da0 2024-09-21T03:21:56.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.817+0000 7f2171fdd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f216c1581b0 0x7f216c15a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:56.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.817+0000 7f2171fdd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f216c1581b0 0x7f216c15a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:45352/0 (socket says 172.21.15.105:45352) 2024-09-21T03:21:56.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.817+0000 7f2171fdd640 1 -- 172.21.15.105:0/1787519028 learned_addr learned my addr 172.21.15.105:0/1787519028 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:56.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.817+0000 7f21717dc640 1 --2- 172.21.15.105:0/1787519028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2158003fd0 0x7f216c1e4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:56.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.817+0000 7f2170fdb640 1 --2- 172.21.15.105:0/1787519028 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f216c157da0 0x7f216c159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:56.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.817+0000 7f2171fdd640 1 -- 172.21.15.105:0/1787519028 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f216c157da0 msgr2=0x7f216c159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:56.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.817+0000 7f2171fdd640 1 --2- 172.21.15.105:0/1787519028 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f216c157da0 0x7f216c159ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:56.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.817+0000 7f2171fdd640 1 -- 172.21.15.105:0/1787519028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2158003fd0 msgr2=0x7f216c1e4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:56.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.817+0000 7f2171fdd640 1 --2- 172.21.15.105:0/1787519028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2158003fd0 0x7f216c1e4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:56.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.817+0000 7f2171fdd640 1 -- 172.21.15.105:0/1787519028 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f216c1f88e0 con 0x7f216c1581b0 2024-09-21T03:21:56.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.817+0000 7f2170fdb640 1 --2- 172.21.15.105:0/1787519028 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f216c157da0 0x7f216c159ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:21:56.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.817+0000 7f21717dc640 1 --2- 172.21.15.105:0/1787519028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2158003fd0 0x7f216c1e4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:21:56.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.817+0000 7f2171fdd640 1 --2- 172.21.15.105:0/1787519028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f216c1581b0 0x7f216c15a000 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f2164005fd0 tx=0x7f2164010e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:56.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.817+0000 7f2161ffb640 1 -- 172.21.15.105:0/1787519028 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216400ee20 con 0x7f216c1581b0 2024-09-21T03:21:56.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.817+0000 7f2161ffb640 1 -- 172.21.15.105:0/1787519028 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2164015070 con 0x7f216c1581b0 2024-09-21T03:21:56.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.817+0000 7f2161ffb640 1 -- 172.21.15.105:0/1787519028 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2164003d00 con 0x7f216c1581b0 2024-09-21T03:21:56.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.817+0000 7f2173a40640 1 -- 172.21.15.105:0/1787519028 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f216c1f8bc0 con 0x7f216c1581b0 2024-09-21T03:21:56.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.818+0000 7f2173a40640 1 -- 172.21.15.105:0/1787519028 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f216c1f9180 con 0x7f216c1581b0 2024-09-21T03:21:56.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.818+0000 7f2173a40640 1 -- 172.21.15.105:0/1787519028 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f216c0b3550 con 0x7f216c1581b0 2024-09-21T03:21:56.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.819+0000 7f2161ffb640 1 -- 172.21.15.105:0/1787519028 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2164004030 con 0x7f216c1581b0 2024-09-21T03:21:56.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.820+0000 7f2161ffb640 1 --2- 172.21.15.105:0/1787519028 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2150078b90 0x7f215007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:56.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.820+0000 7f2161ffb640 1 -- 172.21.15.105:0/1787519028 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f216409b3d0 con 0x7f216c1581b0 2024-09-21T03:21:56.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.820+0000 7f21717dc640 1 --2- 172.21.15.105:0/1787519028 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2150078b90 0x7f215007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:56.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.820+0000 7f21717dc640 1 --2- 172.21.15.105:0/1787519028 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2150078b90 0x7f215007b0a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2168001eb0 tx=0x7f2168000f50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:56.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:56.824+0000 7f2161ffb640 1 -- 172.21.15.105:0/1787519028 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2164063810 con 0x7f216c1581b0 2024-09-21T03:21:57.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.069+0000 7f2173a40640 1 -- 172.21.15.105:0/1787519028 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f216c0b0cb0 con 0x7f216c1581b0 2024-09-21T03:21:57.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.070+0000 7f2161ffb640 1 -- 172.21.15.105:0/1787519028 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1560 (secure 0 0 0) 0x7f2164063110 con 0x7f216c1581b0 2024-09-21T03:21:57.072 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:57.072 INFO:teuthology.orchestra.run.smithi105.stdout:{"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":232,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":80,"num_osds":8,"num_up_osds":8,"osd_up_since":1726888698,"num_in_osds":8,"osd_in_since":1726888688,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":93},{"state_name":"creating+peering","count":4}],"num_pgs":97,"num_pools":3,"num_objects":17,"data_bytes":592778,"bytes_used":264470528,"bytes_avail":772829642752,"bytes_total":773094113280,"inactive_pgs_ratio":0.041237112134695053,"write_bytes_sec":2623,"read_op_per_sec":0,"write_op_per_sec":4},"fsmap":{"epoch":47,"btime":"2024-09-21T03:21:54:900892+0000","id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":6288}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-09-21T03:21:03.318802+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T03:21:57.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.072+0000 7f2173a40640 1 -- 172.21.15.105:0/1787519028 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2150078b90 msgr2=0x7f215007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:57.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.072+0000 7f2173a40640 1 --2- 172.21.15.105:0/1787519028 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2150078b90 0x7f215007b0a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2168001eb0 tx=0x7f2168000f50 comp rx=0 tx=0).stop 2024-09-21T03:21:57.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.072+0000 7f2173a40640 1 -- 172.21.15.105:0/1787519028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f216c1581b0 msgr2=0x7f216c15a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:57.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.072+0000 7f2173a40640 1 --2- 172.21.15.105:0/1787519028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f216c1581b0 0x7f216c15a000 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f2164005fd0 tx=0x7f2164010e50 comp rx=0 tx=0).stop 2024-09-21T03:21:57.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.072+0000 7f2173a40640 1 -- 172.21.15.105:0/1787519028 shutdown_connections 2024-09-21T03:21:57.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.072+0000 7f2173a40640 1 --2- 172.21.15.105:0/1787519028 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2150078b90 0x7f215007b0a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:57.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.072+0000 7f2173a40640 1 --2- 172.21.15.105:0/1787519028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f216c1581b0 0x7f216c15a000 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:57.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.072+0000 7f2173a40640 1 --2- 172.21.15.105:0/1787519028 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f216c157da0 0x7f216c159ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:57.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.072+0000 7f2173a40640 1 --2- 172.21.15.105:0/1787519028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2158003fd0 0x7f216c1e4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:57.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.072+0000 7f2173a40640 1 -- 172.21.15.105:0/1787519028 >> 172.21.15.105:0/1787519028 conn(0x7f216c0cdcc0 msgr2=0x7f216c0b2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:57.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.072+0000 7f2173a40640 1 -- 172.21.15.105:0/1787519028 shutdown_connections 2024-09-21T03:21:57.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.072+0000 7f2173a40640 1 -- 172.21.15.105:0/1787519028 wait complete. 2024-09-21T03:21:57.085 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-21T03:21:57.085 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:21:57.197 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.196+0000 7fd93a6de640 1 -- 172.21.15.105:0/2361533483 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd934142680 msgr2=0x7fd934074390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:57.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.196+0000 7fd93a6de640 1 --2- 172.21.15.105:0/2361533483 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd934142680 0x7fd934074390 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fd93413ed90 tx=0x7fd92c02aa30 comp rx=0 tx=0).stop 2024-09-21T03:21:57.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.196+0000 7fd93a6de640 1 -- 172.21.15.105:0/2361533483 shutdown_connections 2024-09-21T03:21:57.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.196+0000 7fd93a6de640 1 --2- 172.21.15.105:0/2361533483 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd934142680 0x7fd934074390 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:57.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.196+0000 7fd93a6de640 1 --2- 172.21.15.105:0/2361533483 >> v2:172.21.15.162:3300/0 conn(0x7fd934142270 0x7fd934073e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:57.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.196+0000 7fd93a6de640 1 --2- 172.21.15.105:0/2361533483 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd934144270 0x7fd9340b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:57.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.196+0000 7fd93a6de640 1 -- 172.21.15.105:0/2361533483 >> 172.21.15.105:0/2361533483 conn(0x7fd9340d15f0 msgr2=0x7fd934073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:57.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.196+0000 7fd93a6de640 1 -- 172.21.15.105:0/2361533483 shutdown_connections 2024-09-21T03:21:57.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.196+0000 7fd93a6de640 1 -- 172.21.15.105:0/2361533483 wait complete. 2024-09-21T03:21:57.199 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.197+0000 7fd93a6de640 1 Processor -- start 2024-09-21T03:21:57.199 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.198+0000 7fd93a6de640 1 -- start start 2024-09-21T03:21:57.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.199+0000 7fd93a6de640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd934142270 0x7fd93413f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:57.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.199+0000 7fd93a6de640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd934142680 0x7fd93413fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:57.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.199+0000 7fd93a6de640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd934144270 0x7fd9341f6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:57.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.199+0000 7fd93a6de640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd9340cfe60 con 0x7fd934142270 2024-09-21T03:21:57.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.199+0000 7fd93a6de640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd9340b5dd0 con 0x7fd934144270 2024-09-21T03:21:57.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.199+0000 7fd93a6de640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd9340cffe0 con 0x7fd934142680 2024-09-21T03:21:57.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.199+0000 7fd933fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd934142270 0x7fd93413f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:57.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.199+0000 7fd933fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd934142270 0x7fd93413f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:45364/0 (socket says 172.21.15.105:45364) 2024-09-21T03:21:57.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.199+0000 7fd933fff640 1 -- 172.21.15.105:0/4262573542 learned_addr learned my addr 172.21.15.105:0/4262573542 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:21:57.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.199+0000 7fd9337fe640 1 --2- 172.21.15.105:0/4262573542 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd934142680 0x7fd93413fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:57.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.199+0000 7fd938c7b640 1 --2- 172.21.15.105:0/4262573542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd934144270 0x7fd9341f6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:57.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.199+0000 7fd933fff640 1 -- 172.21.15.105:0/4262573542 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd934142680 msgr2=0x7fd93413fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:57.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.199+0000 7fd933fff640 1 --2- 172.21.15.105:0/4262573542 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd934142680 0x7fd93413fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:57.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.199+0000 7fd933fff640 1 -- 172.21.15.105:0/4262573542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd934144270 msgr2=0x7fd9341f6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:57.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.199+0000 7fd933fff640 1 --2- 172.21.15.105:0/4262573542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd934144270 0x7fd9341f6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:57.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.199+0000 7fd933fff640 1 -- 172.21.15.105:0/4262573542 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9340c68c0 con 0x7fd934142270 2024-09-21T03:21:57.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.199+0000 7fd933fff640 1 --2- 172.21.15.105:0/4262573542 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd934142270 0x7fd93413f890 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fd92400d6d0 tx=0x7fd92400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:57.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.200+0000 7fd930ff9640 1 -- 172.21.15.105:0/4262573542 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd924017070 con 0x7fd934142270 2024-09-21T03:21:57.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.200+0000 7fd930ff9640 1 -- 172.21.15.105:0/4262573542 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd924005330 con 0x7fd934142270 2024-09-21T03:21:57.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.200+0000 7fd93a6de640 1 -- 172.21.15.105:0/4262573542 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9341f3430 con 0x7fd934142270 2024-09-21T03:21:57.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.200+0000 7fd930ff9640 1 -- 172.21.15.105:0/4262573542 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9240097c0 con 0x7fd934142270 2024-09-21T03:21:57.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.200+0000 7fd93a6de640 1 -- 172.21.15.105:0/4262573542 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9341f39f0 con 0x7fd934142270 2024-09-21T03:21:57.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.201+0000 7fd93a6de640 1 -- 172.21.15.105:0/4262573542 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9340b5680 con 0x7fd934142270 2024-09-21T03:21:57.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.202+0000 7fd930ff9640 1 -- 172.21.15.105:0/4262573542 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd924009960 con 0x7fd934142270 2024-09-21T03:21:57.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.202+0000 7fd930ff9640 1 --2- 172.21.15.105:0/4262573542 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd914078b90 0x7fd91407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:21:57.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.203+0000 7fd930ff9640 1 -- 172.21.15.105:0/4262573542 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7fd92409ad20 con 0x7fd934142270 2024-09-21T03:21:57.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.203+0000 7fd9337fe640 1 --2- 172.21.15.105:0/4262573542 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd914078b90 0x7fd91407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:21:57.205 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.203+0000 7fd9337fe640 1 --2- 172.21.15.105:0/4262573542 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd914078b90 0x7fd91407b0a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd9340b4ae0 tx=0x7fd91c00b390 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:21:57.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.207+0000 7fd930ff9640 1 -- 172.21.15.105:0/4262573542 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd924062b10 con 0x7fd934142270 2024-09-21T03:21:57.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.380+0000 7fd93a6de640 1 -- 172.21.15.105:0/4262573542 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd934141e40 con 0x7fd914078b90 2024-09-21T03:21:57.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.385+0000 7fd930ff9640 1 -- 172.21.15.105:0/4262573542 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252058 (secure 0 0 0) 0x7fd934141e40 con 0x7fd914078b90 2024-09-21T03:21:57.389 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:21:57.390 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:21:57.391 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.388+0000 7fd93a6de640 1 -- 172.21.15.105:0/4262573542 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd914078b90 msgr2=0x7fd91407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:57.391 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.388+0000 7fd93a6de640 1 --2- 172.21.15.105:0/4262573542 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd914078b90 0x7fd91407b0a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd9340b4ae0 tx=0x7fd91c00b390 comp rx=0 tx=0).stop 2024-09-21T03:21:57.391 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.388+0000 7fd93a6de640 1 -- 172.21.15.105:0/4262573542 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd934142270 msgr2=0x7fd93413f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:21:57.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.388+0000 7fd93a6de640 1 --2- 172.21.15.105:0/4262573542 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd934142270 0x7fd93413f890 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fd92400d6d0 tx=0x7fd92400db90 comp rx=0 tx=0).stop 2024-09-21T03:21:57.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.388+0000 7fd93a6de640 1 -- 172.21.15.105:0/4262573542 shutdown_connections 2024-09-21T03:21:57.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.388+0000 7fd93a6de640 1 --2- 172.21.15.105:0/4262573542 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd914078b90 0x7fd91407b0a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:57.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.388+0000 7fd93a6de640 1 --2- 172.21.15.105:0/4262573542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd934144270 0x7fd9341f6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:57.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.388+0000 7fd93a6de640 1 --2- 172.21.15.105:0/4262573542 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd934142680 0x7fd93413fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:57.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.388+0000 7fd93a6de640 1 --2- 172.21.15.105:0/4262573542 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd934142270 0x7fd93413f890 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:21:57.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.388+0000 7fd93a6de640 1 -- 172.21.15.105:0/4262573542 >> 172.21.15.105:0/4262573542 conn(0x7fd9340d15f0 msgr2=0x7fd934143120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:21:57.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.388+0000 7fd93a6de640 1 -- 172.21.15.105:0/4262573542 shutdown_connections 2024-09-21T03:21:57.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:21:57.388+0000 7fd93a6de640 1 -- 172.21.15.105:0/4262573542 wait complete. 2024-09-21T03:21:57.401 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":184,"stamp":"2024-09-21T03:21:57.332031+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258300,"kb_used_data":8768,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716420,"statfs":{"total":773094113280,"available":772829614080,"internally_reserved":0,"allocated":8978432,"data_stored":4410484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.463066"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900303+0000","last_change":"2024-09-21T03:21:51.891281+0000","last_active":"2024-09-21T03:21:52.900303+0000","last_peered":"2024-09-21T03:21:52.900303+0000","last_clean":"2024-09-21T03:21:52.900303+0000","last_became_active":"2024-09-21T03:21:51.890980+0000","last_became_peered":"2024-09-21T03:21:51.890980+0000","last_unstale":"2024-09-21T03:21:52.900303+0000","last_undegraded":"2024-09-21T03:21:52.900303+0000","last_fullsized":"2024-09-21T03:21:52.900303+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:11.163288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899999+0000","last_change":"2024-09-21T03:21:51.898465+0000","last_active":"2024-09-21T03:21:52.899999+0000","last_peered":"2024-09-21T03:21:52.899999+0000","last_clean":"2024-09-21T03:21:52.899999+0000","last_became_active":"2024-09-21T03:21:51.897528+0000","last_became_peered":"2024-09-21T03:21:51.897528+0000","last_unstale":"2024-09-21T03:21:52.899999+0000","last_undegraded":"2024-09-21T03:21:52.899999+0000","last_fullsized":"2024-09-21T03:21:52.899999+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:58.179373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.578114+0000","last_change":"2024-09-21T03:21:51.910099+0000","last_active":"2024-09-21T03:21:53.578114+0000","last_peered":"2024-09-21T03:21:53.578114+0000","last_clean":"2024-09-21T03:21:53.578114+0000","last_became_active":"2024-09-21T03:21:51.908796+0000","last_became_peered":"2024-09-21T03:21:51.908796+0000","last_unstale":"2024-09-21T03:21:53.578114+0000","last_undegraded":"2024-09-21T03:21:53.578114+0000","last_fullsized":"2024-09-21T03:21:53.578114+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:03.322054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.270250+0000","last_change":"2024-09-21T03:21:51.903031+0000","last_active":"2024-09-21T03:21:53.270250+0000","last_peered":"2024-09-21T03:21:53.270250+0000","last_clean":"2024-09-21T03:21:53.270250+0000","last_became_active":"2024-09-21T03:21:51.902704+0000","last_became_peered":"2024-09-21T03:21:51.902704+0000","last_unstale":"2024-09-21T03:21:53.270250+0000","last_undegraded":"2024-09-21T03:21:53.270250+0000","last_fullsized":"2024-09-21T03:21:53.270250+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:22.814195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898426+0000","last_change":"2024-09-21T03:21:51.894670+0000","last_active":"2024-09-21T03:21:52.898426+0000","last_peered":"2024-09-21T03:21:52.898426+0000","last_clean":"2024-09-21T03:21:52.898426+0000","last_became_active":"2024-09-21T03:21:51.894129+0000","last_became_peered":"2024-09-21T03:21:51.894129+0000","last_unstale":"2024-09-21T03:21:52.898426+0000","last_undegraded":"2024-09-21T03:21:52.898426+0000","last_fullsized":"2024-09-21T03:21:52.898426+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:10:23.798227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:21:51.911046+0000","last_change":"2024-09-21T03:21:51.905285+0000","last_active":"2024-09-21T03:21:51.911046+0000","last_peered":"2024-09-21T03:21:51.911046+0000","last_clean":"2024-09-21T03:21:51.911046+0000","last_became_active":"2024-09-21T03:21:51.904901+0000","last_became_peered":"2024-09-21T03:21:51.904901+0000","last_unstale":"2024-09-21T03:21:51.911046+0000","last_undegraded":"2024-09-21T03:21:51.911046+0000","last_fullsized":"2024-09-21T03:21:51.911046+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:38.052497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.269833+0000","last_change":"2024-09-21T03:21:51.905587+0000","last_active":"2024-09-21T03:21:53.269833+0000","last_peered":"2024-09-21T03:21:53.269833+0000","last_clean":"2024-09-21T03:21:53.269833+0000","last_became_active":"2024-09-21T03:21:51.905274+0000","last_became_peered":"2024-09-21T03:21:51.905274+0000","last_unstale":"2024-09-21T03:21:53.269833+0000","last_undegraded":"2024-09-21T03:21:53.269833+0000","last_fullsized":"2024-09-21T03:21:53.269833+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:59.109536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:21:51.910644+0000","last_change":"2024-09-21T03:21:51.907560+0000","last_active":"2024-09-21T03:21:51.910644+0000","last_peered":"2024-09-21T03:21:51.910644+0000","last_clean":"2024-09-21T03:21:51.910644+0000","last_became_active":"2024-09-21T03:21:51.907143+0000","last_became_peered":"2024-09-21T03:21:51.907143+0000","last_unstale":"2024-09-21T03:21:51.910644+0000","last_undegraded":"2024-09-21T03:21:51.910644+0000","last_fullsized":"2024-09-21T03:21:51.910644+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:16.865640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:21:51.911342+0000","last_change":"2024-09-21T03:21:51.908687+0000","last_active":"2024-09-21T03:21:51.911342+0000","last_peered":"2024-09-21T03:21:51.911342+0000","last_clean":"2024-09-21T03:21:51.911342+0000","last_became_active":"2024-09-21T03:21:51.908386+0000","last_became_peered":"2024-09-21T03:21:51.908386+0000","last_unstale":"2024-09-21T03:21:51.911342+0000","last_undegraded":"2024-09-21T03:21:51.911342+0000","last_fullsized":"2024-09-21T03:21:51.911342+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:50:08.646746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900295+0000","last_change":"2024-09-21T03:21:51.903820+0000","last_active":"2024-09-21T03:21:52.900295+0000","last_peered":"2024-09-21T03:21:52.900295+0000","last_clean":"2024-09-21T03:21:52.900295+0000","last_became_active":"2024-09-21T03:21:51.903292+0000","last_became_peered":"2024-09-21T03:21:51.903292+0000","last_unstale":"2024-09-21T03:21:52.900295+0000","last_undegraded":"2024-09-21T03:21:52.900295+0000","last_fullsized":"2024-09-21T03:21:52.900295+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:02.311208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899833+0000","last_change":"2024-09-21T03:21:51.898032+0000","last_active":"2024-09-21T03:21:52.899833+0000","last_peered":"2024-09-21T03:21:52.899833+0000","last_clean":"2024-09-21T03:21:52.899833+0000","last_became_active":"2024-09-21T03:21:51.897696+0000","last_became_peered":"2024-09-21T03:21:51.897696+0000","last_unstale":"2024-09-21T03:21:52.899833+0000","last_undegraded":"2024-09-21T03:21:52.899833+0000","last_fullsized":"2024-09-21T03:21:52.899833+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:55.624250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900229+0000","last_change":"2024-09-21T03:21:51.890813+0000","last_active":"2024-09-21T03:21:52.900229+0000","last_peered":"2024-09-21T03:21:52.900229+0000","last_clean":"2024-09-21T03:21:52.900229+0000","last_became_active":"2024-09-21T03:21:51.890330+0000","last_became_peered":"2024-09-21T03:21:51.890330+0000","last_unstale":"2024-09-21T03:21:52.900229+0000","last_undegraded":"2024-09-21T03:21:52.900229+0000","last_fullsized":"2024-09-21T03:21:52.900229+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:52:04.989198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.578126+0000","last_change":"2024-09-21T03:21:51.901017+0000","last_active":"2024-09-21T03:21:53.578126+0000","last_peered":"2024-09-21T03:21:53.578126+0000","last_clean":"2024-09-21T03:21:53.578126+0000","last_became_active":"2024-09-21T03:21:51.900655+0000","last_became_peered":"2024-09-21T03:21:51.900655+0000","last_unstale":"2024-09-21T03:21:53.578126+0000","last_undegraded":"2024-09-21T03:21:53.578126+0000","last_fullsized":"2024-09-21T03:21:53.578126+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:24.486253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.270005+0000","last_change":"2024-09-21T03:21:51.907469+0000","last_active":"2024-09-21T03:21:53.270005+0000","last_peered":"2024-09-21T03:21:53.270005+0000","last_clean":"2024-09-21T03:21:53.270005+0000","last_became_active":"2024-09-21T03:21:51.907159+0000","last_became_peered":"2024-09-21T03:21:51.907159+0000","last_unstale":"2024-09-21T03:21:53.270005+0000","last_undegraded":"2024-09-21T03:21:53.270005+0000","last_fullsized":"2024-09-21T03:21:53.270005+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:45:31.092132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.576587+0000","last_change":"2024-09-21T03:21:51.900790+0000","last_active":"2024-09-21T03:21:53.576587+0000","last_peered":"2024-09-21T03:21:53.576587+0000","last_clean":"2024-09-21T03:21:53.576587+0000","last_became_active":"2024-09-21T03:21:51.900484+0000","last_became_peered":"2024-09-21T03:21:51.900484+0000","last_unstale":"2024-09-21T03:21:53.576587+0000","last_undegraded":"2024-09-21T03:21:53.576587+0000","last_fullsized":"2024-09-21T03:21:53.576587+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:52.176078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898035+0000","last_change":"2024-09-21T03:21:51.896039+0000","last_active":"2024-09-21T03:21:52.898035+0000","last_peered":"2024-09-21T03:21:52.898035+0000","last_clean":"2024-09-21T03:21:52.898035+0000","last_became_active":"2024-09-21T03:21:51.895701+0000","last_became_peered":"2024-09-21T03:21:51.895701+0000","last_unstale":"2024-09-21T03:21:52.898035+0000","last_undegraded":"2024-09-21T03:21:52.898035+0000","last_fullsized":"2024-09-21T03:21:52.898035+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:05.844984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898871+0000","last_change":"2024-09-21T03:21:51.903045+0000","last_active":"2024-09-21T03:21:52.898871+0000","last_peered":"2024-09-21T03:21:52.898871+0000","last_clean":"2024-09-21T03:21:52.898871+0000","last_became_active":"2024-09-21T03:21:51.902734+0000","last_became_peered":"2024-09-21T03:21:51.902734+0000","last_unstale":"2024-09-21T03:21:52.898871+0000","last_undegraded":"2024-09-21T03:21:52.898871+0000","last_fullsized":"2024-09-21T03:21:52.898871+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:05.726920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.270049+0000","last_change":"2024-09-21T03:21:51.898501+0000","last_active":"2024-09-21T03:21:53.270049+0000","last_peered":"2024-09-21T03:21:53.270049+0000","last_clean":"2024-09-21T03:21:53.270049+0000","last_became_active":"2024-09-21T03:21:51.898186+0000","last_became_peered":"2024-09-21T03:21:51.898186+0000","last_unstale":"2024-09-21T03:21:53.270049+0000","last_undegraded":"2024-09-21T03:21:53.270049+0000","last_fullsized":"2024-09-21T03:21:53.270049+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:13.850020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577352+0000","last_change":"2024-09-21T03:21:51.902747+0000","last_active":"2024-09-21T03:21:53.577352+0000","last_peered":"2024-09-21T03:21:53.577352+0000","last_clean":"2024-09-21T03:21:53.577352+0000","last_became_active":"2024-09-21T03:21:51.902401+0000","last_became_peered":"2024-09-21T03:21:51.902401+0000","last_unstale":"2024-09-21T03:21:53.577352+0000","last_undegraded":"2024-09-21T03:21:53.577352+0000","last_fullsized":"2024-09-21T03:21:53.577352+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:55:36.643881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.270225+0000","last_change":"2024-09-21T03:21:51.909012+0000","last_active":"2024-09-21T03:21:53.270225+0000","last_peered":"2024-09-21T03:21:53.270225+0000","last_clean":"2024-09-21T03:21:53.270225+0000","last_became_active":"2024-09-21T03:21:51.908626+0000","last_became_peered":"2024-09-21T03:21:51.908626+0000","last_unstale":"2024-09-21T03:21:53.270225+0000","last_undegraded":"2024-09-21T03:21:53.270225+0000","last_fullsized":"2024-09-21T03:21:53.270225+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:24.606033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.270080+0000","last_change":"2024-09-21T03:21:51.907947+0000","last_active":"2024-09-21T03:21:53.270080+0000","last_peered":"2024-09-21T03:21:53.270080+0000","last_clean":"2024-09-21T03:21:53.270080+0000","last_became_active":"2024-09-21T03:21:51.907646+0000","last_became_peered":"2024-09-21T03:21:51.907646+0000","last_unstale":"2024-09-21T03:21:53.270080+0000","last_undegraded":"2024-09-21T03:21:53.270080+0000","last_fullsized":"2024-09-21T03:21:53.270080+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:45:53.374512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900150+0000","last_change":"2024-09-21T03:21:51.905074+0000","last_active":"2024-09-21T03:21:52.900150+0000","last_peered":"2024-09-21T03:21:52.900150+0000","last_clean":"2024-09-21T03:21:52.900150+0000","last_became_active":"2024-09-21T03:21:51.904768+0000","last_became_peered":"2024-09-21T03:21:51.904768+0000","last_unstale":"2024-09-21T03:21:52.900150+0000","last_undegraded":"2024-09-21T03:21:52.900150+0000","last_fullsized":"2024-09-21T03:21:52.900150+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:34.814915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899934+0000","last_change":"2024-09-21T03:21:51.908346+0000","last_active":"2024-09-21T03:21:52.899934+0000","last_peered":"2024-09-21T03:21:52.899934+0000","last_clean":"2024-09-21T03:21:52.899934+0000","last_became_active":"2024-09-21T03:21:51.907761+0000","last_became_peered":"2024-09-21T03:21:51.907761+0000","last_unstale":"2024-09-21T03:21:52.899934+0000","last_undegraded":"2024-09-21T03:21:52.899934+0000","last_fullsized":"2024-09-21T03:21:52.899934+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:31.112370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.269875+0000","last_change":"2024-09-21T03:21:51.907169+0000","last_active":"2024-09-21T03:21:53.269875+0000","last_peered":"2024-09-21T03:21:53.269875+0000","last_clean":"2024-09-21T03:21:53.269875+0000","last_became_active":"2024-09-21T03:21:51.906861+0000","last_became_peered":"2024-09-21T03:21:51.906861+0000","last_unstale":"2024-09-21T03:21:53.269875+0000","last_undegraded":"2024-09-21T03:21:53.269875+0000","last_fullsized":"2024-09-21T03:21:53.269875+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:50.311072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900138+0000","last_change":"2024-09-21T03:21:51.898498+0000","last_active":"2024-09-21T03:21:52.900138+0000","last_peered":"2024-09-21T03:21:52.900138+0000","last_clean":"2024-09-21T03:21:52.900138+0000","last_became_active":"2024-09-21T03:21:51.898168+0000","last_became_peered":"2024-09-21T03:21:51.898168+0000","last_unstale":"2024-09-21T03:21:52.900138+0000","last_undegraded":"2024-09-21T03:21:52.900138+0000","last_fullsized":"2024-09-21T03:21:52.900138+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:46.365557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.578351+0000","last_change":"2024-09-21T03:21:51.903010+0000","last_active":"2024-09-21T03:21:53.578351+0000","last_peered":"2024-09-21T03:21:53.578351+0000","last_clean":"2024-09-21T03:21:53.578351+0000","last_became_active":"2024-09-21T03:21:51.902660+0000","last_became_peered":"2024-09-21T03:21:51.902660+0000","last_unstale":"2024-09-21T03:21:53.578351+0000","last_undegraded":"2024-09-21T03:21:53.578351+0000","last_fullsized":"2024-09-21T03:21:53.578351+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:00:43.998502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898480+0000","last_change":"2024-09-21T03:21:51.901714+0000","last_active":"2024-09-21T03:21:52.898480+0000","last_peered":"2024-09-21T03:21:52.898480+0000","last_clean":"2024-09-21T03:21:52.898480+0000","last_became_active":"2024-09-21T03:21:51.901323+0000","last_became_peered":"2024-09-21T03:21:51.901323+0000","last_unstale":"2024-09-21T03:21:52.898480+0000","last_undegraded":"2024-09-21T03:21:52.898480+0000","last_fullsized":"2024-09-21T03:21:52.898480+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:09.488852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900477+0000","last_change":"2024-09-21T03:21:51.892582+0000","last_active":"2024-09-21T03:21:52.900477+0000","last_peered":"2024-09-21T03:21:52.900477+0000","last_clean":"2024-09-21T03:21:52.900477+0000","last_became_active":"2024-09-21T03:21:51.892311+0000","last_became_peered":"2024-09-21T03:21:51.892311+0000","last_unstale":"2024-09-21T03:21:52.900477+0000","last_undegraded":"2024-09-21T03:21:52.900477+0000","last_fullsized":"2024-09-21T03:21:52.900477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:33.342412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899954+0000","last_change":"2024-09-21T03:21:51.902574+0000","last_active":"2024-09-21T03:21:52.899954+0000","last_peered":"2024-09-21T03:21:52.899954+0000","last_clean":"2024-09-21T03:21:52.899954+0000","last_became_active":"2024-09-21T03:21:51.902279+0000","last_became_peered":"2024-09-21T03:21:51.902279+0000","last_unstale":"2024-09-21T03:21:52.899954+0000","last_undegraded":"2024-09-21T03:21:52.899954+0000","last_fullsized":"2024-09-21T03:21:52.899954+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:07.452760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899652+0000","last_change":"2024-09-21T03:21:51.903656+0000","last_active":"2024-09-21T03:21:52.899652+0000","last_peered":"2024-09-21T03:21:52.899652+0000","last_clean":"2024-09-21T03:21:52.899652+0000","last_became_active":"2024-09-21T03:21:51.903346+0000","last_became_peered":"2024-09-21T03:21:51.903346+0000","last_unstale":"2024-09-21T03:21:52.899652+0000","last_undegraded":"2024-09-21T03:21:52.899652+0000","last_fullsized":"2024-09-21T03:21:52.899652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:05.605373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898116+0000","last_change":"2024-09-21T03:21:51.906337+0000","last_active":"2024-09-21T03:21:52.898116+0000","last_peered":"2024-09-21T03:21:52.898116+0000","last_clean":"2024-09-21T03:21:52.898116+0000","last_became_active":"2024-09-21T03:21:51.906006+0000","last_became_peered":"2024-09-21T03:21:51.906006+0000","last_unstale":"2024-09-21T03:21:52.898116+0000","last_undegraded":"2024-09-21T03:21:52.898116+0000","last_fullsized":"2024-09-21T03:21:52.898116+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:52.059197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899915+0000","last_change":"2024-09-21T03:21:51.890919+0000","last_active":"2024-09-21T03:21:52.899915+0000","last_peered":"2024-09-21T03:21:52.899915+0000","last_clean":"2024-09-21T03:21:52.899915+0000","last_became_active":"2024-09-21T03:21:51.890036+0000","last_became_peered":"2024-09-21T03:21:51.890036+0000","last_unstale":"2024-09-21T03:21:52.899915+0000","last_undegraded":"2024-09-21T03:21:52.899915+0000","last_fullsized":"2024-09-21T03:21:52.899915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:50:08.646746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898739+0000","last_change":"2024-09-21T03:21:51.891404+0000","last_active":"2024-09-21T03:21:52.898739+0000","last_peered":"2024-09-21T03:21:52.898739+0000","last_clean":"2024-09-21T03:21:52.898739+0000","last_became_active":"2024-09-21T03:21:51.891067+0000","last_became_peered":"2024-09-21T03:21:51.891067+0000","last_unstale":"2024-09-21T03:21:52.898739+0000","last_undegraded":"2024-09-21T03:21:52.898739+0000","last_fullsized":"2024-09-21T03:21:52.898739+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:43:18.361524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"79'4","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900471+0000","last_change":"2024-09-21T03:21:50.884910+0000","last_active":"2024-09-21T03:21:52.900471+0000","last_peered":"2024-09-21T03:21:52.900471+0000","last_clean":"2024-09-21T03:21:52.900471+0000","last_became_active":"2024-09-21T03:21:50.884574+0000","last_became_peered":"2024-09-21T03:21:50.884574+0000","last_unstale":"2024-09-21T03:21:52.900471+0000","last_undegraded":"2024-09-21T03:21:52.900471+0000","last_fullsized":"2024-09-21T03:21:52.900471+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:04.344766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900386+0000","last_change":"2024-09-21T03:21:51.908073+0000","last_active":"2024-09-21T03:21:52.900386+0000","last_peered":"2024-09-21T03:21:52.900386+0000","last_clean":"2024-09-21T03:21:52.900386+0000","last_became_active":"2024-09-21T03:21:51.907654+0000","last_became_peered":"2024-09-21T03:21:51.907654+0000","last_unstale":"2024-09-21T03:21:52.900386+0000","last_undegraded":"2024-09-21T03:21:52.900386+0000","last_fullsized":"2024-09-21T03:21:52.900386+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:03.307063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"79'1","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899061+0000","last_change":"2024-09-21T03:21:50.888297+0000","last_active":"2024-09-21T03:21:52.899061+0000","last_peered":"2024-09-21T03:21:52.899061+0000","last_clean":"2024-09-21T03:21:52.899061+0000","last_became_active":"2024-09-21T03:21:50.887943+0000","last_became_peered":"2024-09-21T03:21:50.887943+0000","last_unstale":"2024-09-21T03:21:52.899061+0000","last_undegraded":"2024-09-21T03:21:52.899061+0000","last_fullsized":"2024-09-21T03:21:52.899061+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:57.173705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900498+0000","last_change":"2024-09-21T03:21:51.890296+0000","last_active":"2024-09-21T03:21:52.900498+0000","last_peered":"2024-09-21T03:21:52.900498+0000","last_clean":"2024-09-21T03:21:52.900498+0000","last_became_active":"2024-09-21T03:21:51.889937+0000","last_became_peered":"2024-09-21T03:21:51.889937+0000","last_unstale":"2024-09-21T03:21:52.900498+0000","last_undegraded":"2024-09-21T03:21:52.900498+0000","last_fullsized":"2024-09-21T03:21:52.900498+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:31.802933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"79'2","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577347+0000","last_change":"2024-09-21T03:21:50.888653+0000","last_active":"2024-09-21T03:21:53.577347+0000","last_peered":"2024-09-21T03:21:53.577347+0000","last_clean":"2024-09-21T03:21:53.577347+0000","last_became_active":"2024-09-21T03:21:50.888329+0000","last_became_peered":"2024-09-21T03:21:50.888329+0000","last_unstale":"2024-09-21T03:21:53.577347+0000","last_undegraded":"2024-09-21T03:21:53.577347+0000","last_fullsized":"2024-09-21T03:21:53.577347+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:22:33.757619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.578269+0000","last_change":"2024-09-21T03:21:51.902475+0000","last_active":"2024-09-21T03:21:53.578269+0000","last_peered":"2024-09-21T03:21:53.578269+0000","last_clean":"2024-09-21T03:21:53.578269+0000","last_became_active":"2024-09-21T03:21:51.901928+0000","last_became_peered":"2024-09-21T03:21:51.901928+0000","last_unstale":"2024-09-21T03:21:53.578269+0000","last_undegraded":"2024-09-21T03:21:53.578269+0000","last_fullsized":"2024-09-21T03:21:53.578269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:16.502189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"79'2","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577358+0000","last_change":"2024-09-21T03:21:50.889500+0000","last_active":"2024-09-21T03:21:53.577358+0000","last_peered":"2024-09-21T03:21:53.577358+0000","last_clean":"2024-09-21T03:21:53.577358+0000","last_became_active":"2024-09-21T03:21:50.889200+0000","last_became_peered":"2024-09-21T03:21:50.889200+0000","last_unstale":"2024-09-21T03:21:53.577358+0000","last_undegraded":"2024-09-21T03:21:53.577358+0000","last_fullsized":"2024-09-21T03:21:53.577358+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:51.051625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899896+0000","last_change":"2024-09-21T03:21:51.903101+0000","last_active":"2024-09-21T03:21:52.899896+0000","last_peered":"2024-09-21T03:21:52.899896+0000","last_clean":"2024-09-21T03:21:52.899896+0000","last_became_active":"2024-09-21T03:21:51.902773+0000","last_became_peered":"2024-09-21T03:21:51.902773+0000","last_unstale":"2024-09-21T03:21:52.899896+0000","last_undegraded":"2024-09-21T03:21:52.899896+0000","last_fullsized":"2024-09-21T03:21:52.899896+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:01.885867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"79'1","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898638+0000","last_change":"2024-09-21T03:21:50.890186+0000","last_active":"2024-09-21T03:21:52.898638+0000","last_peered":"2024-09-21T03:21:52.898638+0000","last_clean":"2024-09-21T03:21:52.898638+0000","last_became_active":"2024-09-21T03:21:50.889742+0000","last_became_peered":"2024-09-21T03:21:50.889742+0000","last_unstale":"2024-09-21T03:21:52.898638+0000","last_undegraded":"2024-09-21T03:21:52.898638+0000","last_fullsized":"2024-09-21T03:21:52.898638+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:06.447091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898436+0000","last_change":"2024-09-21T03:21:51.902339+0000","last_active":"2024-09-21T03:21:52.898436+0000","last_peered":"2024-09-21T03:21:52.898436+0000","last_clean":"2024-09-21T03:21:52.898436+0000","last_became_active":"2024-09-21T03:21:51.902038+0000","last_became_peered":"2024-09-21T03:21:51.902038+0000","last_unstale":"2024-09-21T03:21:52.898436+0000","last_undegraded":"2024-09-21T03:21:52.898436+0000","last_fullsized":"2024-09-21T03:21:52.898436+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:15.428843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"79'1","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898008+0000","last_change":"2024-09-21T03:21:50.889708+0000","last_active":"2024-09-21T03:21:52.898008+0000","last_peered":"2024-09-21T03:21:52.898008+0000","last_clean":"2024-09-21T03:21:52.898008+0000","last_became_active":"2024-09-21T03:21:50.888284+0000","last_became_peered":"2024-09-21T03:21:50.888284+0000","last_unstale":"2024-09-21T03:21:52.898008+0000","last_undegraded":"2024-09-21T03:21:52.898008+0000","last_fullsized":"2024-09-21T03:21:52.898008+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:04.599704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577421+0000","last_change":"2024-09-21T03:21:51.905014+0000","last_active":"2024-09-21T03:21:53.577421+0000","last_peered":"2024-09-21T03:21:53.577421+0000","last_clean":"2024-09-21T03:21:53.577421+0000","last_became_active":"2024-09-21T03:21:51.904638+0000","last_became_peered":"2024-09-21T03:21:51.904638+0000","last_unstale":"2024-09-21T03:21:53.577421+0000","last_undegraded":"2024-09-21T03:21:53.577421+0000","last_fullsized":"2024-09-21T03:21:53.577421+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:40:07.583428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577424+0000","last_change":"2024-09-21T03:21:50.890284+0000","last_active":"2024-09-21T03:21:53.577424+0000","last_peered":"2024-09-21T03:21:53.577424+0000","last_clean":"2024-09-21T03:21:53.577424+0000","last_became_active":"2024-09-21T03:21:50.890002+0000","last_became_peered":"2024-09-21T03:21:50.890002+0000","last_unstale":"2024-09-21T03:21:53.577424+0000","last_undegraded":"2024-09-21T03:21:53.577424+0000","last_fullsized":"2024-09-21T03:21:53.577424+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:16.074069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.576875+0000","last_change":"2024-09-21T03:21:51.899993+0000","last_active":"2024-09-21T03:21:53.576875+0000","last_peered":"2024-09-21T03:21:53.576875+0000","last_clean":"2024-09-21T03:21:53.576875+0000","last_became_active":"2024-09-21T03:21:51.899632+0000","last_became_peered":"2024-09-21T03:21:51.899632+0000","last_unstale":"2024-09-21T03:21:53.576875+0000","last_undegraded":"2024-09-21T03:21:53.576875+0000","last_fullsized":"2024-09-21T03:21:53.576875+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:15.015396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899544+0000","last_change":"2024-09-21T03:21:50.894291+0000","last_active":"2024-09-21T03:21:52.899544+0000","last_peered":"2024-09-21T03:21:52.899544+0000","last_clean":"2024-09-21T03:21:52.899544+0000","last_became_active":"2024-09-21T03:21:50.894001+0000","last_became_peered":"2024-09-21T03:21:50.894001+0000","last_unstale":"2024-09-21T03:21:52.899544+0000","last_undegraded":"2024-09-21T03:21:52.899544+0000","last_fullsized":"2024-09-21T03:21:52.899544+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:38:02.558962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577019+0000","last_change":"2024-09-21T03:21:51.894313+0000","last_active":"2024-09-21T03:21:53.577019+0000","last_peered":"2024-09-21T03:21:53.577019+0000","last_clean":"2024-09-21T03:21:53.577019+0000","last_became_active":"2024-09-21T03:21:51.894003+0000","last_became_peered":"2024-09-21T03:21:51.894003+0000","last_unstale":"2024-09-21T03:21:53.577019+0000","last_undegraded":"2024-09-21T03:21:53.577019+0000","last_fullsized":"2024-09-21T03:21:53.577019+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:55.444519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900543+0000","last_change":"2024-09-21T03:21:50.883437+0000","last_active":"2024-09-21T03:21:52.900543+0000","last_peered":"2024-09-21T03:21:52.900543+0000","last_clean":"2024-09-21T03:21:52.900543+0000","last_became_active":"2024-09-21T03:21:50.883111+0000","last_became_peered":"2024-09-21T03:21:50.883111+0000","last_unstale":"2024-09-21T03:21:52.900543+0000","last_undegraded":"2024-09-21T03:21:52.900543+0000","last_fullsized":"2024-09-21T03:21:52.900543+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:50.701648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:21:51.910716+0000","last_change":"2024-09-21T03:21:51.904652+0000","last_active":"2024-09-21T03:21:51.910716+0000","last_peered":"2024-09-21T03:21:51.910716+0000","last_clean":"2024-09-21T03:21:51.910716+0000","last_became_active":"2024-09-21T03:21:51.904284+0000","last_became_peered":"2024-09-21T03:21:51.904284+0000","last_unstale":"2024-09-21T03:21:51.910716+0000","last_undegraded":"2024-09-21T03:21:51.910716+0000","last_fullsized":"2024-09-21T03:21:51.910716+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:25.792212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900223+0000","last_change":"2024-09-21T03:21:50.890689+0000","last_active":"2024-09-21T03:21:52.900223+0000","last_peered":"2024-09-21T03:21:52.900223+0000","last_clean":"2024-09-21T03:21:52.900223+0000","last_became_active":"2024-09-21T03:21:50.890329+0000","last_became_peered":"2024-09-21T03:21:50.890329+0000","last_unstale":"2024-09-21T03:21:52.900223+0000","last_undegraded":"2024-09-21T03:21:52.900223+0000","last_fullsized":"2024-09-21T03:21:52.900223+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:46:35.605253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577187+0000","last_change":"2024-09-21T03:21:51.904862+0000","last_active":"2024-09-21T03:21:53.577187+0000","last_peered":"2024-09-21T03:21:53.577187+0000","last_clean":"2024-09-21T03:21:53.577187+0000","last_became_active":"2024-09-21T03:21:51.904529+0000","last_became_peered":"2024-09-21T03:21:51.904529+0000","last_unstale":"2024-09-21T03:21:53.577187+0000","last_undegraded":"2024-09-21T03:21:53.577187+0000","last_fullsized":"2024-09-21T03:21:53.577187+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:19.505940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"79'3","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899751+0000","last_change":"2024-09-21T03:21:50.891311+0000","last_active":"2024-09-21T03:21:52.899751+0000","last_peered":"2024-09-21T03:21:52.899751+0000","last_clean":"2024-09-21T03:21:52.899751+0000","last_became_active":"2024-09-21T03:21:50.890713+0000","last_became_peered":"2024-09-21T03:21:50.890713+0000","last_unstale":"2024-09-21T03:21:52.899751+0000","last_undegraded":"2024-09-21T03:21:52.899751+0000","last_fullsized":"2024-09-21T03:21:52.899751+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:41.919161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898766+0000","last_change":"2024-09-21T03:21:51.908205+0000","last_active":"2024-09-21T03:21:52.898766+0000","last_peered":"2024-09-21T03:21:52.898766+0000","last_clean":"2024-09-21T03:21:52.898766+0000","last_became_active":"2024-09-21T03:21:51.907239+0000","last_became_peered":"2024-09-21T03:21:51.907239+0000","last_unstale":"2024-09-21T03:21:52.898766+0000","last_undegraded":"2024-09-21T03:21:52.898766+0000","last_fullsized":"2024-09-21T03:21:52.898766+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:08:40.548484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"79'6","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:21:51.917164+0000","last_change":"2024-09-21T03:21:50.887898+0000","last_active":"2024-09-21T03:21:51.917164+0000","last_peered":"2024-09-21T03:21:51.917164+0000","last_clean":"2024-09-21T03:21:51.917164+0000","last_became_active":"2024-09-21T03:21:50.887571+0000","last_became_peered":"2024-09-21T03:21:50.887571+0000","last_unstale":"2024-09-21T03:21:51.917164+0000","last_undegraded":"2024-09-21T03:21:51.917164+0000","last_fullsized":"2024-09-21T03:21:51.917164+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:47:46.235056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577488+0000","last_change":"2024-09-21T03:21:51.903978+0000","last_active":"2024-09-21T03:21:53.577488+0000","last_peered":"2024-09-21T03:21:53.577488+0000","last_clean":"2024-09-21T03:21:53.577488+0000","last_became_active":"2024-09-21T03:21:51.903596+0000","last_became_peered":"2024-09-21T03:21:51.903596+0000","last_unstale":"2024-09-21T03:21:53.577488+0000","last_undegraded":"2024-09-21T03:21:53.577488+0000","last_fullsized":"2024-09-21T03:21:53.577488+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:27:39.139799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"79'2","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899993+0000","last_change":"2024-09-21T03:21:50.889245+0000","last_active":"2024-09-21T03:21:52.899993+0000","last_peered":"2024-09-21T03:21:52.899993+0000","last_clean":"2024-09-21T03:21:52.899993+0000","last_became_active":"2024-09-21T03:21:50.888937+0000","last_became_peered":"2024-09-21T03:21:50.888937+0000","last_unstale":"2024-09-21T03:21:52.899993+0000","last_undegraded":"2024-09-21T03:21:52.899993+0000","last_fullsized":"2024-09-21T03:21:52.899993+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:45:52.368843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.578464+0000","last_change":"2024-09-21T03:21:51.905440+0000","last_active":"2024-09-21T03:21:53.578464+0000","last_peered":"2024-09-21T03:21:53.578464+0000","last_clean":"2024-09-21T03:21:53.578464+0000","last_became_active":"2024-09-21T03:21:51.905015+0000","last_became_peered":"2024-09-21T03:21:51.905015+0000","last_unstale":"2024-09-21T03:21:53.578464+0000","last_undegraded":"2024-09-21T03:21:53.578464+0000","last_fullsized":"2024-09-21T03:21:53.578464+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:55.444519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.576949+0000","last_change":"2024-09-21T03:21:50.885645+0000","last_active":"2024-09-21T03:21:53.576949+0000","last_peered":"2024-09-21T03:21:53.576949+0000","last_clean":"2024-09-21T03:21:53.576949+0000","last_became_active":"2024-09-21T03:21:50.885322+0000","last_became_peered":"2024-09-21T03:21:50.885322+0000","last_unstale":"2024-09-21T03:21:53.576949+0000","last_undegraded":"2024-09-21T03:21:53.576949+0000","last_fullsized":"2024-09-21T03:21:53.576949+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:21:22.286598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899587+0000","last_change":"2024-09-21T03:21:51.904861+0000","last_active":"2024-09-21T03:21:52.899587+0000","last_peered":"2024-09-21T03:21:52.899587+0000","last_clean":"2024-09-21T03:21:52.899587+0000","last_became_active":"2024-09-21T03:21:51.904529+0000","last_became_peered":"2024-09-21T03:21:51.904529+0000","last_unstale":"2024-09-21T03:21:52.899587+0000","last_undegraded":"2024-09-21T03:21:52.899587+0000","last_fullsized":"2024-09-21T03:21:52.899587+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:14.676515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:21:51.892974+0000","last_change":"2024-09-21T03:21:50.893102+0000","last_active":"2024-09-21T03:21:51.892974+0000","last_peered":"2024-09-21T03:21:51.892974+0000","last_clean":"2024-09-21T03:21:51.892974+0000","last_became_active":"2024-09-21T03:21:50.892785+0000","last_became_peered":"2024-09-21T03:21:50.892785+0000","last_unstale":"2024-09-21T03:21:51.892974+0000","last_undegraded":"2024-09-21T03:21:51.892974+0000","last_fullsized":"2024-09-21T03:21:51.892974+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:17.615245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899583+0000","last_change":"2024-09-21T03:21:51.894797+0000","last_active":"2024-09-21T03:21:52.899583+0000","last_peered":"2024-09-21T03:21:52.899583+0000","last_clean":"2024-09-21T03:21:52.899583+0000","last_became_active":"2024-09-21T03:21:51.894373+0000","last_became_peered":"2024-09-21T03:21:51.894373+0000","last_unstale":"2024-09-21T03:21:52.899583+0000","last_undegraded":"2024-09-21T03:21:52.899583+0000","last_fullsized":"2024-09-21T03:21:52.899583+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:02:38.762310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"79'8","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577257+0000","last_change":"2024-09-21T03:21:50.883788+0000","last_active":"2024-09-21T03:21:53.577257+0000","last_peered":"2024-09-21T03:21:53.577257+0000","last_clean":"2024-09-21T03:21:53.577257+0000","last_became_active":"2024-09-21T03:21:50.883369+0000","last_became_peered":"2024-09-21T03:21:50.883369+0000","last_unstale":"2024-09-21T03:21:53.577257+0000","last_undegraded":"2024-09-21T03:21:53.577257+0000","last_fullsized":"2024-09-21T03:21:53.577257+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:56:39.433202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.578242+0000","last_change":"2024-09-21T03:21:51.898550+0000","last_active":"2024-09-21T03:21:53.578242+0000","last_peered":"2024-09-21T03:21:53.578242+0000","last_clean":"2024-09-21T03:21:53.578242+0000","last_became_active":"2024-09-21T03:21:51.898201+0000","last_became_peered":"2024-09-21T03:21:51.898201+0000","last_unstale":"2024-09-21T03:21:53.578242+0000","last_undegraded":"2024-09-21T03:21:53.578242+0000","last_fullsized":"2024-09-21T03:21:53.578242+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:11:42.267787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"79'1","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900728+0000","last_change":"2024-09-21T03:21:50.889581+0000","last_active":"2024-09-21T03:21:52.900728+0000","last_peered":"2024-09-21T03:21:52.900728+0000","last_clean":"2024-09-21T03:21:52.900728+0000","last_became_active":"2024-09-21T03:21:50.889245+0000","last_became_peered":"2024-09-21T03:21:50.889245+0000","last_unstale":"2024-09-21T03:21:52.900728+0000","last_undegraded":"2024-09-21T03:21:52.900728+0000","last_fullsized":"2024-09-21T03:21:52.900728+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:00.493999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900576+0000","last_change":"2024-09-21T03:21:51.899099+0000","last_active":"2024-09-21T03:21:52.900576+0000","last_peered":"2024-09-21T03:21:52.900576+0000","last_clean":"2024-09-21T03:21:52.900576+0000","last_became_active":"2024-09-21T03:21:51.898350+0000","last_became_peered":"2024-09-21T03:21:51.898350+0000","last_unstale":"2024-09-21T03:21:52.900576+0000","last_undegraded":"2024-09-21T03:21:52.900576+0000","last_fullsized":"2024-09-21T03:21:52.900576+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:43.337873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"79'2","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.576933+0000","last_change":"2024-09-21T03:21:50.892793+0000","last_active":"2024-09-21T03:21:53.576933+0000","last_peered":"2024-09-21T03:21:53.576933+0000","last_clean":"2024-09-21T03:21:53.576933+0000","last_became_active":"2024-09-21T03:21:50.892459+0000","last_became_peered":"2024-09-21T03:21:50.892459+0000","last_unstale":"2024-09-21T03:21:53.576933+0000","last_undegraded":"2024-09-21T03:21:53.576933+0000","last_fullsized":"2024-09-21T03:21:53.576933+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:54.992900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898808+0000","last_change":"2024-09-21T03:21:51.893380+0000","last_active":"2024-09-21T03:21:52.898808+0000","last_peered":"2024-09-21T03:21:52.898808+0000","last_clean":"2024-09-21T03:21:52.898808+0000","last_became_active":"2024-09-21T03:21:51.893039+0000","last_became_peered":"2024-09-21T03:21:51.893039+0000","last_unstale":"2024-09-21T03:21:52.898808+0000","last_undegraded":"2024-09-21T03:21:52.898808+0000","last_fullsized":"2024-09-21T03:21:52.898808+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:11.163288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577437+0000","last_change":"2024-09-21T03:21:50.891075+0000","last_active":"2024-09-21T03:21:53.577437+0000","last_peered":"2024-09-21T03:21:53.577437+0000","last_clean":"2024-09-21T03:21:53.577437+0000","last_became_active":"2024-09-21T03:21:50.890732+0000","last_became_peered":"2024-09-21T03:21:50.890732+0000","last_unstale":"2024-09-21T03:21:53.577437+0000","last_undegraded":"2024-09-21T03:21:53.577437+0000","last_fullsized":"2024-09-21T03:21:53.577437+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:29.480411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.270234+0000","last_change":"2024-09-21T03:21:51.907368+0000","last_active":"2024-09-21T03:21:53.270234+0000","last_peered":"2024-09-21T03:21:53.270234+0000","last_clean":"2024-09-21T03:21:53.270234+0000","last_became_active":"2024-09-21T03:21:51.906509+0000","last_became_peered":"2024-09-21T03:21:51.906509+0000","last_unstale":"2024-09-21T03:21:53.270234+0000","last_undegraded":"2024-09-21T03:21:53.270234+0000","last_fullsized":"2024-09-21T03:21:53.270234+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:31:41.794069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"79'2","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577118+0000","last_change":"2024-09-21T03:21:50.881909+0000","last_active":"2024-09-21T03:21:53.577118+0000","last_peered":"2024-09-21T03:21:53.577118+0000","last_clean":"2024-09-21T03:21:53.577118+0000","last_became_active":"2024-09-21T03:21:50.881541+0000","last_became_peered":"2024-09-21T03:21:50.881541+0000","last_unstale":"2024-09-21T03:21:53.577118+0000","last_undegraded":"2024-09-21T03:21:53.577118+0000","last_fullsized":"2024-09-21T03:21:53.577118+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:02.316385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:21:51.907914+0000","last_change":"2024-09-21T03:21:51.901261+0000","last_active":"2024-09-21T03:21:51.907914+0000","last_peered":"2024-09-21T03:21:51.907914+0000","last_clean":"2024-09-21T03:21:51.907914+0000","last_became_active":"2024-09-21T03:21:51.900954+0000","last_became_peered":"2024-09-21T03:21:51.900954+0000","last_unstale":"2024-09-21T03:21:51.907914+0000","last_undegraded":"2024-09-21T03:21:51.907914+0000","last_fullsized":"2024-09-21T03:21:51.907914+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:41.233859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.270134+0000","last_change":"2024-09-21T03:21:50.884684+0000","last_active":"2024-09-21T03:21:53.270134+0000","last_peered":"2024-09-21T03:21:53.270134+0000","last_clean":"2024-09-21T03:21:53.270134+0000","last_became_active":"2024-09-21T03:21:50.883447+0000","last_became_peered":"2024-09-21T03:21:50.883447+0000","last_unstale":"2024-09-21T03:21:53.270134+0000","last_undegraded":"2024-09-21T03:21:53.270134+0000","last_fullsized":"2024-09-21T03:21:53.270134+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:10.639009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.269927+0000","last_change":"2024-09-21T03:21:51.901038+0000","last_active":"2024-09-21T03:21:53.269927+0000","last_peered":"2024-09-21T03:21:53.269927+0000","last_clean":"2024-09-21T03:21:53.269927+0000","last_became_active":"2024-09-21T03:21:51.900648+0000","last_became_peered":"2024-09-21T03:21:51.900648+0000","last_unstale":"2024-09-21T03:21:53.269927+0000","last_undegraded":"2024-09-21T03:21:53.269927+0000","last_fullsized":"2024-09-21T03:21:53.269927+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:26.805582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.269785+0000","last_change":"2024-09-21T03:21:50.891133+0000","last_active":"2024-09-21T03:21:53.269785+0000","last_peered":"2024-09-21T03:21:53.269785+0000","last_clean":"2024-09-21T03:21:53.269785+0000","last_became_active":"2024-09-21T03:21:50.890817+0000","last_became_peered":"2024-09-21T03:21:50.890817+0000","last_unstale":"2024-09-21T03:21:53.269785+0000","last_undegraded":"2024-09-21T03:21:53.269785+0000","last_fullsized":"2024-09-21T03:21:53.269785+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:16.600569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:21:51.911382+0000","last_change":"2024-09-21T03:21:51.909921+0000","last_active":"2024-09-21T03:21:51.911382+0000","last_peered":"2024-09-21T03:21:51.911382+0000","last_clean":"2024-09-21T03:21:51.911382+0000","last_became_active":"2024-09-21T03:21:51.909432+0000","last_became_peered":"2024-09-21T03:21:51.909432+0000","last_unstale":"2024-09-21T03:21:51.911382+0000","last_undegraded":"2024-09-21T03:21:51.911382+0000","last_fullsized":"2024-09-21T03:21:51.911382+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:31.112370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.576433+0000","last_change":"2024-09-21T03:21:50.881109+0000","last_active":"2024-09-21T03:21:53.576433+0000","last_peered":"2024-09-21T03:21:53.576433+0000","last_clean":"2024-09-21T03:21:53.576433+0000","last_became_active":"2024-09-21T03:21:50.880825+0000","last_became_peered":"2024-09-21T03:21:50.880825+0000","last_unstale":"2024-09-21T03:21:53.576433+0000","last_undegraded":"2024-09-21T03:21:53.576433+0000","last_fullsized":"2024-09-21T03:21:53.576433+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:40:06.577759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899093+0000","last_change":"2024-09-21T03:21:51.900827+0000","last_active":"2024-09-21T03:21:52.899093+0000","last_peered":"2024-09-21T03:21:52.899093+0000","last_clean":"2024-09-21T03:21:52.899093+0000","last_became_active":"2024-09-21T03:21:51.900485+0000","last_became_peered":"2024-09-21T03:21:51.900485+0000","last_unstale":"2024-09-21T03:21:52.899093+0000","last_undegraded":"2024-09-21T03:21:52.899093+0000","last_fullsized":"2024-09-21T03:21:52.899093+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:40.866323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"79'2","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899992+0000","last_change":"2024-09-21T03:21:50.886982+0000","last_active":"2024-09-21T03:21:52.899992+0000","last_peered":"2024-09-21T03:21:52.899992+0000","last_clean":"2024-09-21T03:21:52.899992+0000","last_became_active":"2024-09-21T03:21:50.886661+0000","last_became_peered":"2024-09-21T03:21:50.886661+0000","last_unstale":"2024-09-21T03:21:52.899992+0000","last_undegraded":"2024-09-21T03:21:52.899992+0000","last_fullsized":"2024-09-21T03:21:52.899992+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:31:40.788400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.578330+0000","last_change":"2024-09-21T03:21:51.909713+0000","last_active":"2024-09-21T03:21:53.578330+0000","last_peered":"2024-09-21T03:21:53.578330+0000","last_clean":"2024-09-21T03:21:53.578330+0000","last_became_active":"2024-09-21T03:21:51.909373+0000","last_became_peered":"2024-09-21T03:21:51.909373+0000","last_unstale":"2024-09-21T03:21:53.578330+0000","last_undegraded":"2024-09-21T03:21:53.578330+0000","last_fullsized":"2024-09-21T03:21:53.578330+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:52.176078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"79'1","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899881+0000","last_change":"2024-09-21T03:21:50.891027+0000","last_active":"2024-09-21T03:21:52.899881+0000","last_peered":"2024-09-21T03:21:52.899881+0000","last_clean":"2024-09-21T03:21:52.899881+0000","last_became_active":"2024-09-21T03:21:50.890732+0000","last_became_peered":"2024-09-21T03:21:50.890732+0000","last_unstale":"2024-09-21T03:21:52.899881+0000","last_undegraded":"2024-09-21T03:21:52.899881+0000","last_fullsized":"2024-09-21T03:21:52.899881+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:21.808526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900708+0000","last_change":"2024-09-21T03:21:51.905815+0000","last_active":"2024-09-21T03:21:52.900708+0000","last_peered":"2024-09-21T03:21:52.900708+0000","last_clean":"2024-09-21T03:21:52.900708+0000","last_became_active":"2024-09-21T03:21:51.905422+0000","last_became_peered":"2024-09-21T03:21:51.905422+0000","last_unstale":"2024-09-21T03:21:52.900708+0000","last_undegraded":"2024-09-21T03:21:52.900708+0000","last_fullsized":"2024-09-21T03:21:52.900708+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:31.675347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899899+0000","last_change":"2024-09-21T03:21:50.891090+0000","last_active":"2024-09-21T03:21:52.899899+0000","last_peered":"2024-09-21T03:21:52.899899+0000","last_clean":"2024-09-21T03:21:52.899899+0000","last_became_active":"2024-09-21T03:21:50.890775+0000","last_became_peered":"2024-09-21T03:21:50.890775+0000","last_unstale":"2024-09-21T03:21:52.899899+0000","last_undegraded":"2024-09-21T03:21:52.899899+0000","last_fullsized":"2024-09-21T03:21:52.899899+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:28.931234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899083+0000","last_change":"2024-09-21T03:21:51.907507+0000","last_active":"2024-09-21T03:21:52.899083+0000","last_peered":"2024-09-21T03:21:52.899083+0000","last_clean":"2024-09-21T03:21:52.899083+0000","last_became_active":"2024-09-21T03:21:51.906065+0000","last_became_peered":"2024-09-21T03:21:51.906065+0000","last_unstale":"2024-09-21T03:21:52.899083+0000","last_undegraded":"2024-09-21T03:21:52.899083+0000","last_fullsized":"2024-09-21T03:21:52.899083+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:34:58.232355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900634+0000","last_change":"2024-09-21T03:21:50.882989+0000","last_active":"2024-09-21T03:21:52.900634+0000","last_peered":"2024-09-21T03:21:52.900634+0000","last_clean":"2024-09-21T03:21:52.900634+0000","last_became_active":"2024-09-21T03:21:50.882493+0000","last_became_peered":"2024-09-21T03:21:50.882493+0000","last_unstale":"2024-09-21T03:21:52.900634+0000","last_undegraded":"2024-09-21T03:21:52.900634+0000","last_fullsized":"2024-09-21T03:21:52.900634+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:48.422744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:21:51.908069+0000","last_change":"2024-09-21T03:21:51.901903+0000","last_active":"2024-09-21T03:21:51.908069+0000","last_peered":"2024-09-21T03:21:51.908069+0000","last_clean":"2024-09-21T03:21:51.908069+0000","last_became_active":"2024-09-21T03:21:51.901578+0000","last_became_peered":"2024-09-21T03:21:51.901578+0000","last_unstale":"2024-09-21T03:21:51.908069+0000","last_undegraded":"2024-09-21T03:21:51.908069+0000","last_fullsized":"2024-09-21T03:21:51.908069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:26.773312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577176+0000","last_change":"2024-09-21T03:21:50.886896+0000","last_active":"2024-09-21T03:21:53.577176+0000","last_peered":"2024-09-21T03:21:53.577176+0000","last_clean":"2024-09-21T03:21:53.577176+0000","last_became_active":"2024-09-21T03:21:50.886606+0000","last_became_peered":"2024-09-21T03:21:50.886606+0000","last_unstale":"2024-09-21T03:21:53.577176+0000","last_undegraded":"2024-09-21T03:21:53.577176+0000","last_fullsized":"2024-09-21T03:21:53.577176+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:25:56.849713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577058+0000","last_change":"2024-09-21T03:21:51.903666+0000","last_active":"2024-09-21T03:21:53.577058+0000","last_peered":"2024-09-21T03:21:53.577058+0000","last_clean":"2024-09-21T03:21:53.577058+0000","last_became_active":"2024-09-21T03:21:51.903368+0000","last_became_peered":"2024-09-21T03:21:51.903368+0000","last_unstale":"2024-09-21T03:21:53.577058+0000","last_undegraded":"2024-09-21T03:21:53.577058+0000","last_fullsized":"2024-09-21T03:21:53.577058+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:29:11.217555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898172+0000","last_change":"2024-09-21T03:21:50.888581+0000","last_active":"2024-09-21T03:21:52.898172+0000","last_peered":"2024-09-21T03:21:52.898172+0000","last_clean":"2024-09-21T03:21:52.898172+0000","last_became_active":"2024-09-21T03:21:50.887896+0000","last_became_peered":"2024-09-21T03:21:50.887896+0000","last_unstale":"2024-09-21T03:21:52.898172+0000","last_undegraded":"2024-09-21T03:21:52.898172+0000","last_fullsized":"2024-09-21T03:21:52.898172+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:00.880198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577694+0000","last_change":"2024-09-21T03:21:51.903858+0000","last_active":"2024-09-21T03:21:53.577694+0000","last_peered":"2024-09-21T03:21:53.577694+0000","last_clean":"2024-09-21T03:21:53.577694+0000","last_became_active":"2024-09-21T03:21:51.903527+0000","last_became_peered":"2024-09-21T03:21:51.903527+0000","last_unstale":"2024-09-21T03:21:53.577694+0000","last_undegraded":"2024-09-21T03:21:53.577694+0000","last_fullsized":"2024-09-21T03:21:53.577694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:21:23.292266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900099+0000","last_change":"2024-09-21T03:21:50.891506+0000","last_active":"2024-09-21T03:21:52.900099+0000","last_peered":"2024-09-21T03:21:52.900099+0000","last_clean":"2024-09-21T03:21:52.900099+0000","last_became_active":"2024-09-21T03:21:50.891130+0000","last_became_peered":"2024-09-21T03:21:50.891130+0000","last_unstale":"2024-09-21T03:21:52.900099+0000","last_undegraded":"2024-09-21T03:21:52.900099+0000","last_fullsized":"2024-09-21T03:21:52.900099+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:16.126547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899967+0000","last_change":"2024-09-21T03:21:51.894997+0000","last_active":"2024-09-21T03:21:52.899967+0000","last_peered":"2024-09-21T03:21:52.899967+0000","last_clean":"2024-09-21T03:21:52.899967+0000","last_became_active":"2024-09-21T03:21:51.894658+0000","last_became_peered":"2024-09-21T03:21:51.894658+0000","last_unstale":"2024-09-21T03:21:52.899967+0000","last_undegraded":"2024-09-21T03:21:52.899967+0000","last_fullsized":"2024-09-21T03:21:52.899967+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:09.488852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.897965+0000","last_change":"2024-09-21T03:21:50.891199+0000","last_active":"2024-09-21T03:21:52.897965+0000","last_peered":"2024-09-21T03:21:52.897965+0000","last_clean":"2024-09-21T03:21:52.897965+0000","last_became_active":"2024-09-21T03:21:50.890837+0000","last_became_peered":"2024-09-21T03:21:50.890837+0000","last_unstale":"2024-09-21T03:21:52.897965+0000","last_undegraded":"2024-09-21T03:21:52.897965+0000","last_fullsized":"2024-09-21T03:21:52.897965+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:54.618581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900002+0000","last_change":"2024-09-21T03:21:51.899525+0000","last_active":"2024-09-21T03:21:52.900002+0000","last_peered":"2024-09-21T03:21:52.900002+0000","last_clean":"2024-09-21T03:21:52.900002+0000","last_became_active":"2024-09-21T03:21:51.899003+0000","last_became_peered":"2024-09-21T03:21:51.899003+0000","last_unstale":"2024-09-21T03:21:52.900002+0000","last_undegraded":"2024-09-21T03:21:52.900002+0000","last_fullsized":"2024-09-21T03:21:52.900002+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:51.707317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"79'1","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.578284+0000","last_change":"2024-09-21T03:21:50.886216+0000","last_active":"2024-09-21T03:21:53.578284+0000","last_peered":"2024-09-21T03:21:53.578284+0000","last_clean":"2024-09-21T03:21:53.578284+0000","last_became_active":"2024-09-21T03:21:50.885887+0000","last_became_peered":"2024-09-21T03:21:50.885887+0000","last_unstale":"2024-09-21T03:21:53.578284+0000","last_undegraded":"2024-09-21T03:21:53.578284+0000","last_fullsized":"2024-09-21T03:21:53.578284+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:08.483183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":219,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577601+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:21:53.577601+0000","last_peered":"2024-09-21T03:21:53.577601+0000","last_clean":"2024-09-21T03:21:53.577601+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:21:53.577601+0000","last_undegraded":"2024-09-21T03:21:53.577601+0000","last_fullsized":"2024-09-21T03:21:53.577601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509488,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1560576,"data_stored":991979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509487,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":974848,"data_stored":402235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509486,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":978944,"data_stored":403175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509486,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":962560,"data_stored":401541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509487,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":974848,"data_stored":403153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509487,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":966656,"data_stored":402123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509487,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":987136,"data_stored":408035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32724,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339116,"statfs":{"total":96636764160,"available":96603254784,"internally_reserved":0,"allocated":1572864,"data_stored":998243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:22:00.405 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:22:00.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.530+0000 7fa1c26c5640 1 -- 172.21.15.105:0/723184862 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1bc0af780 msgr2=0x7fa1bc0b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:00.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.530+0000 7fa1c26c5640 1 --2- 172.21.15.105:0/723184862 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1bc0af780 0x7fa1bc0b39c0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc0cffa0 tx=0x7fa1ac02a540 comp rx=0 tx=0).stop 2024-09-21T03:22:00.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.530+0000 7fa1c26c5640 1 -- 172.21.15.105:0/723184862 shutdown_connections 2024-09-21T03:22:00.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.530+0000 7fa1c26c5640 1 --2- 172.21.15.105:0/723184862 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1bc0706c0 0x7fa1bc072ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:00.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.530+0000 7fa1c26c5640 1 --2- 172.21.15.105:0/723184862 >> v2:172.21.15.162:3300/0 conn(0x7fa1bc0cd3e0 0x7fa1bc070180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:00.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.530+0000 7fa1c26c5640 1 --2- 172.21.15.105:0/723184862 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1bc0af780 0x7fa1bc0b39c0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:00.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.530+0000 7fa1c26c5640 1 -- 172.21.15.105:0/723184862 >> 172.21.15.105:0/723184862 conn(0x7fa1bc06d7d0 msgr2=0x7fa1bc0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:00.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.530+0000 7fa1c26c5640 1 -- 172.21.15.105:0/723184862 shutdown_connections 2024-09-21T03:22:00.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.530+0000 7fa1c26c5640 1 -- 172.21.15.105:0/723184862 wait complete. 2024-09-21T03:22:00.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.532+0000 7fa1c26c5640 1 Processor -- start 2024-09-21T03:22:00.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.532+0000 7fa1c26c5640 1 -- start start 2024-09-21T03:22:00.536 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.533+0000 7fa1c26c5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1bc0706c0 0x7fa1bc1564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:00.536 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.533+0000 7fa1c26c5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1bc0af780 0x7fa1bc154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:00.536 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.533+0000 7fa1c26c5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1bc0cd3e0 0x7fa1bc15e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:00.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.533+0000 7fa1c26c5640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa1bc073930 con 0x7fa1bc0af780 2024-09-21T03:22:00.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.533+0000 7fa1c26c5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa1bc0737b0 con 0x7fa1bc0706c0 2024-09-21T03:22:00.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.533+0000 7fa1c26c5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa1bc073ab0 con 0x7fa1bc0cd3e0 2024-09-21T03:22:00.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.534+0000 7fa1bb7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1bc0af780 0x7fa1bc154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:00.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.534+0000 7fa1bb7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1bc0af780 0x7fa1bc154c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:45376/0 (socket says 172.21.15.105:45376) 2024-09-21T03:22:00.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.534+0000 7fa1bb7fe640 1 -- 172.21.15.105:0/219102225 learned_addr learned my addr 172.21.15.105:0/219102225 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:22:00.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.534+0000 7fa1bbfff640 1 --2- 172.21.15.105:0/219102225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1bc0706c0 0x7fa1bc1564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:00.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.534+0000 7fa1c0c62640 1 --2- 172.21.15.105:0/219102225 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1bc0cd3e0 0x7fa1bc15e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:00.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.534+0000 7fa1bb7fe640 1 -- 172.21.15.105:0/219102225 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1bc0cd3e0 msgr2=0x7fa1bc15e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:00.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.534+0000 7fa1bb7fe640 1 --2- 172.21.15.105:0/219102225 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1bc0cd3e0 0x7fa1bc15e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:00.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.534+0000 7fa1bb7fe640 1 -- 172.21.15.105:0/219102225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1bc0706c0 msgr2=0x7fa1bc1564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:00.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.534+0000 7fa1bb7fe640 1 --2- 172.21.15.105:0/219102225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1bc0706c0 0x7fa1bc1564f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:00.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.534+0000 7fa1bb7fe640 1 -- 172.21.15.105:0/219102225 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1bc159070 con 0x7fa1bc0af780 2024-09-21T03:22:00.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.534+0000 7fa1bb7fe640 1 --2- 172.21.15.105:0/219102225 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1bc0af780 0x7fa1bc154c10 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fa1b000d6d0 tx=0x7fa1b000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:00.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.534+0000 7fa1b8ff9640 1 -- 172.21.15.105:0/219102225 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0017070 con 0x7fa1bc0af780 2024-09-21T03:22:00.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.534+0000 7fa1b8ff9640 1 -- 172.21.15.105:0/219102225 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1b0004310 con 0x7fa1bc0af780 2024-09-21T03:22:00.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.534+0000 7fa1c26c5640 1 -- 172.21.15.105:0/219102225 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1bc159350 con 0x7fa1bc0af780 2024-09-21T03:22:00.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.534+0000 7fa1b8ff9640 1 -- 172.21.15.105:0/219102225 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0009a80 con 0x7fa1bc0af780 2024-09-21T03:22:00.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.534+0000 7fa1c26c5640 1 -- 172.21.15.105:0/219102225 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1bc09bdc0 con 0x7fa1bc0af780 2024-09-21T03:22:00.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.535+0000 7fa1c26c5640 1 -- 172.21.15.105:0/219102225 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1bc156bd0 con 0x7fa1bc0af780 2024-09-21T03:22:00.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.536+0000 7fa1b8ff9640 1 -- 172.21.15.105:0/219102225 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa1b0009c20 con 0x7fa1bc0af780 2024-09-21T03:22:00.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.537+0000 7fa1b8ff9640 1 --2- 172.21.15.105:0/219102225 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa1a8078b90 0x7fa1a807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:00.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.537+0000 7fa1b8ff9640 1 -- 172.21.15.105:0/219102225 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7fa1b009abd0 con 0x7fa1bc0af780 2024-09-21T03:22:00.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.537+0000 7fa1bbfff640 1 --2- 172.21.15.105:0/219102225 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa1a8078b90 0x7fa1a807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:00.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.538+0000 7fa1bbfff640 1 --2- 172.21.15.105:0/219102225 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa1a8078b90 0x7fa1a807b0a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac033000 tx=0x7fa1ac004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:00.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.541+0000 7fa1b8ff9640 1 -- 172.21.15.105:0/219102225 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa1b0062ae0 con 0x7fa1bc0af780 2024-09-21T03:22:00.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.717+0000 7fa1c26c5640 1 -- 172.21.15.105:0/219102225 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa1bc158e20 con 0x7fa1a8078b90 2024-09-21T03:22:00.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.721+0000 7fa1b8ff9640 1 -- 172.21.15.105:0/219102225 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251985 (secure 0 0 0) 0x7fa1bc158e20 con 0x7fa1a8078b90 2024-09-21T03:22:00.726 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:22:00.727 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:22:00.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.724+0000 7fa1c26c5640 1 -- 172.21.15.105:0/219102225 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa1a8078b90 msgr2=0x7fa1a807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:00.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.724+0000 7fa1c26c5640 1 --2- 172.21.15.105:0/219102225 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa1a8078b90 0x7fa1a807b0a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac033000 tx=0x7fa1ac004730 comp rx=0 tx=0).stop 2024-09-21T03:22:00.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.724+0000 7fa1c26c5640 1 -- 172.21.15.105:0/219102225 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1bc0af780 msgr2=0x7fa1bc154c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:00.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.724+0000 7fa1c26c5640 1 --2- 172.21.15.105:0/219102225 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1bc0af780 0x7fa1bc154c10 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fa1b000d6d0 tx=0x7fa1b000db90 comp rx=0 tx=0).stop 2024-09-21T03:22:00.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.725+0000 7fa1c26c5640 1 -- 172.21.15.105:0/219102225 shutdown_connections 2024-09-21T03:22:00.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.725+0000 7fa1c26c5640 1 --2- 172.21.15.105:0/219102225 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa1a8078b90 0x7fa1a807b0a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:00.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.725+0000 7fa1c26c5640 1 --2- 172.21.15.105:0/219102225 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1bc0cd3e0 0x7fa1bc15e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:00.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.725+0000 7fa1c26c5640 1 --2- 172.21.15.105:0/219102225 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1bc0af780 0x7fa1bc154c10 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:00.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.725+0000 7fa1c26c5640 1 --2- 172.21.15.105:0/219102225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1bc0706c0 0x7fa1bc1564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:00.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.725+0000 7fa1c26c5640 1 -- 172.21.15.105:0/219102225 >> 172.21.15.105:0/219102225 conn(0x7fa1bc06d7d0 msgr2=0x7fa1bc0ad9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:00.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.725+0000 7fa1c26c5640 1 -- 172.21.15.105:0/219102225 shutdown_connections 2024-09-21T03:22:00.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.725+0000 7fa1c26c5640 1 -- 172.21.15.105:0/219102225 wait complete. 2024-09-21T03:22:00.738 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":185,"stamp":"2024-09-21T03:21:59.332680+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258364,"kb_used_data":8840,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716356,"statfs":{"total":773094113280,"available":772829548544,"internally_reserved":0,"allocated":9052160,"data_stored":4448284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002179"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900303+0000","last_change":"2024-09-21T03:21:51.891281+0000","last_active":"2024-09-21T03:21:52.900303+0000","last_peered":"2024-09-21T03:21:52.900303+0000","last_clean":"2024-09-21T03:21:52.900303+0000","last_became_active":"2024-09-21T03:21:51.890980+0000","last_became_peered":"2024-09-21T03:21:51.890980+0000","last_unstale":"2024-09-21T03:21:52.900303+0000","last_undegraded":"2024-09-21T03:21:52.900303+0000","last_fullsized":"2024-09-21T03:21:52.900303+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:11.163288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899999+0000","last_change":"2024-09-21T03:21:51.898465+0000","last_active":"2024-09-21T03:21:52.899999+0000","last_peered":"2024-09-21T03:21:52.899999+0000","last_clean":"2024-09-21T03:21:52.899999+0000","last_became_active":"2024-09-21T03:21:51.897528+0000","last_became_peered":"2024-09-21T03:21:51.897528+0000","last_unstale":"2024-09-21T03:21:52.899999+0000","last_undegraded":"2024-09-21T03:21:52.899999+0000","last_fullsized":"2024-09-21T03:21:52.899999+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:58.179373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.578114+0000","last_change":"2024-09-21T03:21:51.910099+0000","last_active":"2024-09-21T03:21:53.578114+0000","last_peered":"2024-09-21T03:21:53.578114+0000","last_clean":"2024-09-21T03:21:53.578114+0000","last_became_active":"2024-09-21T03:21:51.908796+0000","last_became_peered":"2024-09-21T03:21:51.908796+0000","last_unstale":"2024-09-21T03:21:53.578114+0000","last_undegraded":"2024-09-21T03:21:53.578114+0000","last_fullsized":"2024-09-21T03:21:53.578114+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:03.322054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.270250+0000","last_change":"2024-09-21T03:21:51.903031+0000","last_active":"2024-09-21T03:21:53.270250+0000","last_peered":"2024-09-21T03:21:53.270250+0000","last_clean":"2024-09-21T03:21:53.270250+0000","last_became_active":"2024-09-21T03:21:51.902704+0000","last_became_peered":"2024-09-21T03:21:51.902704+0000","last_unstale":"2024-09-21T03:21:53.270250+0000","last_undegraded":"2024-09-21T03:21:53.270250+0000","last_fullsized":"2024-09-21T03:21:53.270250+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:22.814195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898426+0000","last_change":"2024-09-21T03:21:51.894670+0000","last_active":"2024-09-21T03:21:52.898426+0000","last_peered":"2024-09-21T03:21:52.898426+0000","last_clean":"2024-09-21T03:21:52.898426+0000","last_became_active":"2024-09-21T03:21:51.894129+0000","last_became_peered":"2024-09-21T03:21:51.894129+0000","last_unstale":"2024-09-21T03:21:52.898426+0000","last_undegraded":"2024-09-21T03:21:52.898426+0000","last_fullsized":"2024-09-21T03:21:52.898426+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:10:23.798227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577390+0000","last_change":"2024-09-21T03:21:51.905285+0000","last_active":"2024-09-21T03:21:53.577390+0000","last_peered":"2024-09-21T03:21:53.577390+0000","last_clean":"2024-09-21T03:21:53.577390+0000","last_became_active":"2024-09-21T03:21:51.904901+0000","last_became_peered":"2024-09-21T03:21:51.904901+0000","last_unstale":"2024-09-21T03:21:53.577390+0000","last_undegraded":"2024-09-21T03:21:53.577390+0000","last_fullsized":"2024-09-21T03:21:53.577390+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:03.307063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.269833+0000","last_change":"2024-09-21T03:21:51.905587+0000","last_active":"2024-09-21T03:21:53.269833+0000","last_peered":"2024-09-21T03:21:53.269833+0000","last_clean":"2024-09-21T03:21:53.269833+0000","last_became_active":"2024-09-21T03:21:51.905274+0000","last_became_peered":"2024-09-21T03:21:51.905274+0000","last_unstale":"2024-09-21T03:21:53.269833+0000","last_undegraded":"2024-09-21T03:21:53.269833+0000","last_fullsized":"2024-09-21T03:21:53.269833+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:59.109536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577130+0000","last_change":"2024-09-21T03:21:51.907560+0000","last_active":"2024-09-21T03:21:53.577130+0000","last_peered":"2024-09-21T03:21:53.577130+0000","last_clean":"2024-09-21T03:21:53.577130+0000","last_became_active":"2024-09-21T03:21:51.907143+0000","last_became_peered":"2024-09-21T03:21:51.907143+0000","last_unstale":"2024-09-21T03:21:53.577130+0000","last_undegraded":"2024-09-21T03:21:53.577130+0000","last_fullsized":"2024-09-21T03:21:53.577130+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:29.914046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577737+0000","last_change":"2024-09-21T03:21:51.908687+0000","last_active":"2024-09-21T03:21:53.577737+0000","last_peered":"2024-09-21T03:21:53.577737+0000","last_clean":"2024-09-21T03:21:53.577737+0000","last_became_active":"2024-09-21T03:21:51.908386+0000","last_became_peered":"2024-09-21T03:21:51.908386+0000","last_unstale":"2024-09-21T03:21:53.577737+0000","last_undegraded":"2024-09-21T03:21:53.577737+0000","last_fullsized":"2024-09-21T03:21:53.577737+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:33.342412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900295+0000","last_change":"2024-09-21T03:21:51.903820+0000","last_active":"2024-09-21T03:21:52.900295+0000","last_peered":"2024-09-21T03:21:52.900295+0000","last_clean":"2024-09-21T03:21:52.900295+0000","last_became_active":"2024-09-21T03:21:51.903292+0000","last_became_peered":"2024-09-21T03:21:51.903292+0000","last_unstale":"2024-09-21T03:21:52.900295+0000","last_undegraded":"2024-09-21T03:21:52.900295+0000","last_fullsized":"2024-09-21T03:21:52.900295+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:04:02.311208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899833+0000","last_change":"2024-09-21T03:21:51.898032+0000","last_active":"2024-09-21T03:21:52.899833+0000","last_peered":"2024-09-21T03:21:52.899833+0000","last_clean":"2024-09-21T03:21:52.899833+0000","last_became_active":"2024-09-21T03:21:51.897696+0000","last_became_peered":"2024-09-21T03:21:51.897696+0000","last_unstale":"2024-09-21T03:21:52.899833+0000","last_undegraded":"2024-09-21T03:21:52.899833+0000","last_fullsized":"2024-09-21T03:21:52.899833+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:55.624250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900229+0000","last_change":"2024-09-21T03:21:51.890813+0000","last_active":"2024-09-21T03:21:52.900229+0000","last_peered":"2024-09-21T03:21:52.900229+0000","last_clean":"2024-09-21T03:21:52.900229+0000","last_became_active":"2024-09-21T03:21:51.890330+0000","last_became_peered":"2024-09-21T03:21:51.890330+0000","last_unstale":"2024-09-21T03:21:52.900229+0000","last_undegraded":"2024-09-21T03:21:52.900229+0000","last_fullsized":"2024-09-21T03:21:52.900229+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:52:04.989198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.578126+0000","last_change":"2024-09-21T03:21:51.901017+0000","last_active":"2024-09-21T03:21:53.578126+0000","last_peered":"2024-09-21T03:21:53.578126+0000","last_clean":"2024-09-21T03:21:53.578126+0000","last_became_active":"2024-09-21T03:21:51.900655+0000","last_became_peered":"2024-09-21T03:21:51.900655+0000","last_unstale":"2024-09-21T03:21:53.578126+0000","last_undegraded":"2024-09-21T03:21:53.578126+0000","last_fullsized":"2024-09-21T03:21:53.578126+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:24.486253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.270005+0000","last_change":"2024-09-21T03:21:51.907469+0000","last_active":"2024-09-21T03:21:53.270005+0000","last_peered":"2024-09-21T03:21:53.270005+0000","last_clean":"2024-09-21T03:21:53.270005+0000","last_became_active":"2024-09-21T03:21:51.907159+0000","last_became_peered":"2024-09-21T03:21:51.907159+0000","last_unstale":"2024-09-21T03:21:53.270005+0000","last_undegraded":"2024-09-21T03:21:53.270005+0000","last_fullsized":"2024-09-21T03:21:53.270005+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:45:31.092132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.576587+0000","last_change":"2024-09-21T03:21:51.900790+0000","last_active":"2024-09-21T03:21:53.576587+0000","last_peered":"2024-09-21T03:21:53.576587+0000","last_clean":"2024-09-21T03:21:53.576587+0000","last_became_active":"2024-09-21T03:21:51.900484+0000","last_became_peered":"2024-09-21T03:21:51.900484+0000","last_unstale":"2024-09-21T03:21:53.576587+0000","last_undegraded":"2024-09-21T03:21:53.576587+0000","last_fullsized":"2024-09-21T03:21:53.576587+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:52.176078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898035+0000","last_change":"2024-09-21T03:21:51.896039+0000","last_active":"2024-09-21T03:21:52.898035+0000","last_peered":"2024-09-21T03:21:52.898035+0000","last_clean":"2024-09-21T03:21:52.898035+0000","last_became_active":"2024-09-21T03:21:51.895701+0000","last_became_peered":"2024-09-21T03:21:51.895701+0000","last_unstale":"2024-09-21T03:21:52.898035+0000","last_undegraded":"2024-09-21T03:21:52.898035+0000","last_fullsized":"2024-09-21T03:21:52.898035+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:05.844984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898871+0000","last_change":"2024-09-21T03:21:51.903045+0000","last_active":"2024-09-21T03:21:52.898871+0000","last_peered":"2024-09-21T03:21:52.898871+0000","last_clean":"2024-09-21T03:21:52.898871+0000","last_became_active":"2024-09-21T03:21:51.902734+0000","last_became_peered":"2024-09-21T03:21:51.902734+0000","last_unstale":"2024-09-21T03:21:52.898871+0000","last_undegraded":"2024-09-21T03:21:52.898871+0000","last_fullsized":"2024-09-21T03:21:52.898871+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:05.726920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.270049+0000","last_change":"2024-09-21T03:21:51.898501+0000","last_active":"2024-09-21T03:21:53.270049+0000","last_peered":"2024-09-21T03:21:53.270049+0000","last_clean":"2024-09-21T03:21:53.270049+0000","last_became_active":"2024-09-21T03:21:51.898186+0000","last_became_peered":"2024-09-21T03:21:51.898186+0000","last_unstale":"2024-09-21T03:21:53.270049+0000","last_undegraded":"2024-09-21T03:21:53.270049+0000","last_fullsized":"2024-09-21T03:21:53.270049+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:13.850020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577352+0000","last_change":"2024-09-21T03:21:51.902747+0000","last_active":"2024-09-21T03:21:53.577352+0000","last_peered":"2024-09-21T03:21:53.577352+0000","last_clean":"2024-09-21T03:21:53.577352+0000","last_became_active":"2024-09-21T03:21:51.902401+0000","last_became_peered":"2024-09-21T03:21:51.902401+0000","last_unstale":"2024-09-21T03:21:53.577352+0000","last_undegraded":"2024-09-21T03:21:53.577352+0000","last_fullsized":"2024-09-21T03:21:53.577352+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:55:36.643881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.270225+0000","last_change":"2024-09-21T03:21:51.909012+0000","last_active":"2024-09-21T03:21:53.270225+0000","last_peered":"2024-09-21T03:21:53.270225+0000","last_clean":"2024-09-21T03:21:53.270225+0000","last_became_active":"2024-09-21T03:21:51.908626+0000","last_became_peered":"2024-09-21T03:21:51.908626+0000","last_unstale":"2024-09-21T03:21:53.270225+0000","last_undegraded":"2024-09-21T03:21:53.270225+0000","last_fullsized":"2024-09-21T03:21:53.270225+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:24.606033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.270080+0000","last_change":"2024-09-21T03:21:51.907947+0000","last_active":"2024-09-21T03:21:53.270080+0000","last_peered":"2024-09-21T03:21:53.270080+0000","last_clean":"2024-09-21T03:21:53.270080+0000","last_became_active":"2024-09-21T03:21:51.907646+0000","last_became_peered":"2024-09-21T03:21:51.907646+0000","last_unstale":"2024-09-21T03:21:53.270080+0000","last_undegraded":"2024-09-21T03:21:53.270080+0000","last_fullsized":"2024-09-21T03:21:53.270080+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:45:53.374512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900150+0000","last_change":"2024-09-21T03:21:51.905074+0000","last_active":"2024-09-21T03:21:52.900150+0000","last_peered":"2024-09-21T03:21:52.900150+0000","last_clean":"2024-09-21T03:21:52.900150+0000","last_became_active":"2024-09-21T03:21:51.904768+0000","last_became_peered":"2024-09-21T03:21:51.904768+0000","last_unstale":"2024-09-21T03:21:52.900150+0000","last_undegraded":"2024-09-21T03:21:52.900150+0000","last_fullsized":"2024-09-21T03:21:52.900150+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:34.814915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899934+0000","last_change":"2024-09-21T03:21:51.908346+0000","last_active":"2024-09-21T03:21:52.899934+0000","last_peered":"2024-09-21T03:21:52.899934+0000","last_clean":"2024-09-21T03:21:52.899934+0000","last_became_active":"2024-09-21T03:21:51.907761+0000","last_became_peered":"2024-09-21T03:21:51.907761+0000","last_unstale":"2024-09-21T03:21:52.899934+0000","last_undegraded":"2024-09-21T03:21:52.899934+0000","last_fullsized":"2024-09-21T03:21:52.899934+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:31.112370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.269875+0000","last_change":"2024-09-21T03:21:51.907169+0000","last_active":"2024-09-21T03:21:53.269875+0000","last_peered":"2024-09-21T03:21:53.269875+0000","last_clean":"2024-09-21T03:21:53.269875+0000","last_became_active":"2024-09-21T03:21:51.906861+0000","last_became_peered":"2024-09-21T03:21:51.906861+0000","last_unstale":"2024-09-21T03:21:53.269875+0000","last_undegraded":"2024-09-21T03:21:53.269875+0000","last_fullsized":"2024-09-21T03:21:53.269875+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:50.311072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900138+0000","last_change":"2024-09-21T03:21:51.898498+0000","last_active":"2024-09-21T03:21:52.900138+0000","last_peered":"2024-09-21T03:21:52.900138+0000","last_clean":"2024-09-21T03:21:52.900138+0000","last_became_active":"2024-09-21T03:21:51.898168+0000","last_became_peered":"2024-09-21T03:21:51.898168+0000","last_unstale":"2024-09-21T03:21:52.900138+0000","last_undegraded":"2024-09-21T03:21:52.900138+0000","last_fullsized":"2024-09-21T03:21:52.900138+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:46.365557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.578351+0000","last_change":"2024-09-21T03:21:51.903010+0000","last_active":"2024-09-21T03:21:53.578351+0000","last_peered":"2024-09-21T03:21:53.578351+0000","last_clean":"2024-09-21T03:21:53.578351+0000","last_became_active":"2024-09-21T03:21:51.902660+0000","last_became_peered":"2024-09-21T03:21:51.902660+0000","last_unstale":"2024-09-21T03:21:53.578351+0000","last_undegraded":"2024-09-21T03:21:53.578351+0000","last_fullsized":"2024-09-21T03:21:53.578351+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:00:43.998502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898480+0000","last_change":"2024-09-21T03:21:51.901714+0000","last_active":"2024-09-21T03:21:52.898480+0000","last_peered":"2024-09-21T03:21:52.898480+0000","last_clean":"2024-09-21T03:21:52.898480+0000","last_became_active":"2024-09-21T03:21:51.901323+0000","last_became_peered":"2024-09-21T03:21:51.901323+0000","last_unstale":"2024-09-21T03:21:52.898480+0000","last_undegraded":"2024-09-21T03:21:52.898480+0000","last_fullsized":"2024-09-21T03:21:52.898480+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:09.488852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900477+0000","last_change":"2024-09-21T03:21:51.892582+0000","last_active":"2024-09-21T03:21:52.900477+0000","last_peered":"2024-09-21T03:21:52.900477+0000","last_clean":"2024-09-21T03:21:52.900477+0000","last_became_active":"2024-09-21T03:21:51.892311+0000","last_became_peered":"2024-09-21T03:21:51.892311+0000","last_unstale":"2024-09-21T03:21:52.900477+0000","last_undegraded":"2024-09-21T03:21:52.900477+0000","last_fullsized":"2024-09-21T03:21:52.900477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:33.342412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899954+0000","last_change":"2024-09-21T03:21:51.902574+0000","last_active":"2024-09-21T03:21:52.899954+0000","last_peered":"2024-09-21T03:21:52.899954+0000","last_clean":"2024-09-21T03:21:52.899954+0000","last_became_active":"2024-09-21T03:21:51.902279+0000","last_became_peered":"2024-09-21T03:21:51.902279+0000","last_unstale":"2024-09-21T03:21:52.899954+0000","last_undegraded":"2024-09-21T03:21:52.899954+0000","last_fullsized":"2024-09-21T03:21:52.899954+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:07.452760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899652+0000","last_change":"2024-09-21T03:21:51.903656+0000","last_active":"2024-09-21T03:21:52.899652+0000","last_peered":"2024-09-21T03:21:52.899652+0000","last_clean":"2024-09-21T03:21:52.899652+0000","last_became_active":"2024-09-21T03:21:51.903346+0000","last_became_peered":"2024-09-21T03:21:51.903346+0000","last_unstale":"2024-09-21T03:21:52.899652+0000","last_undegraded":"2024-09-21T03:21:52.899652+0000","last_fullsized":"2024-09-21T03:21:52.899652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:05.605373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898116+0000","last_change":"2024-09-21T03:21:51.906337+0000","last_active":"2024-09-21T03:21:52.898116+0000","last_peered":"2024-09-21T03:21:52.898116+0000","last_clean":"2024-09-21T03:21:52.898116+0000","last_became_active":"2024-09-21T03:21:51.906006+0000","last_became_peered":"2024-09-21T03:21:51.906006+0000","last_unstale":"2024-09-21T03:21:52.898116+0000","last_undegraded":"2024-09-21T03:21:52.898116+0000","last_fullsized":"2024-09-21T03:21:52.898116+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:43:52.059197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899915+0000","last_change":"2024-09-21T03:21:51.890919+0000","last_active":"2024-09-21T03:21:52.899915+0000","last_peered":"2024-09-21T03:21:52.899915+0000","last_clean":"2024-09-21T03:21:52.899915+0000","last_became_active":"2024-09-21T03:21:51.890036+0000","last_became_peered":"2024-09-21T03:21:51.890036+0000","last_unstale":"2024-09-21T03:21:52.899915+0000","last_undegraded":"2024-09-21T03:21:52.899915+0000","last_fullsized":"2024-09-21T03:21:52.899915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:50:08.646746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898739+0000","last_change":"2024-09-21T03:21:51.891404+0000","last_active":"2024-09-21T03:21:52.898739+0000","last_peered":"2024-09-21T03:21:52.898739+0000","last_clean":"2024-09-21T03:21:52.898739+0000","last_became_active":"2024-09-21T03:21:51.891067+0000","last_became_peered":"2024-09-21T03:21:51.891067+0000","last_unstale":"2024-09-21T03:21:52.898739+0000","last_undegraded":"2024-09-21T03:21:52.898739+0000","last_fullsized":"2024-09-21T03:21:52.898739+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:43:18.361524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"79'4","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900471+0000","last_change":"2024-09-21T03:21:50.884910+0000","last_active":"2024-09-21T03:21:52.900471+0000","last_peered":"2024-09-21T03:21:52.900471+0000","last_clean":"2024-09-21T03:21:52.900471+0000","last_became_active":"2024-09-21T03:21:50.884574+0000","last_became_peered":"2024-09-21T03:21:50.884574+0000","last_unstale":"2024-09-21T03:21:52.900471+0000","last_undegraded":"2024-09-21T03:21:52.900471+0000","last_fullsized":"2024-09-21T03:21:52.900471+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:42:04.344766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900386+0000","last_change":"2024-09-21T03:21:51.908073+0000","last_active":"2024-09-21T03:21:52.900386+0000","last_peered":"2024-09-21T03:21:52.900386+0000","last_clean":"2024-09-21T03:21:52.900386+0000","last_became_active":"2024-09-21T03:21:51.907654+0000","last_became_peered":"2024-09-21T03:21:51.907654+0000","last_unstale":"2024-09-21T03:21:52.900386+0000","last_undegraded":"2024-09-21T03:21:52.900386+0000","last_fullsized":"2024-09-21T03:21:52.900386+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:03.307063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"79'1","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899061+0000","last_change":"2024-09-21T03:21:50.888297+0000","last_active":"2024-09-21T03:21:52.899061+0000","last_peered":"2024-09-21T03:21:52.899061+0000","last_clean":"2024-09-21T03:21:52.899061+0000","last_became_active":"2024-09-21T03:21:50.887943+0000","last_became_peered":"2024-09-21T03:21:50.887943+0000","last_unstale":"2024-09-21T03:21:52.899061+0000","last_undegraded":"2024-09-21T03:21:52.899061+0000","last_fullsized":"2024-09-21T03:21:52.899061+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:57.173705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900498+0000","last_change":"2024-09-21T03:21:51.890296+0000","last_active":"2024-09-21T03:21:52.900498+0000","last_peered":"2024-09-21T03:21:52.900498+0000","last_clean":"2024-09-21T03:21:52.900498+0000","last_became_active":"2024-09-21T03:21:51.889937+0000","last_became_peered":"2024-09-21T03:21:51.889937+0000","last_unstale":"2024-09-21T03:21:52.900498+0000","last_undegraded":"2024-09-21T03:21:52.900498+0000","last_fullsized":"2024-09-21T03:21:52.900498+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:31.802933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"79'2","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577347+0000","last_change":"2024-09-21T03:21:50.888653+0000","last_active":"2024-09-21T03:21:53.577347+0000","last_peered":"2024-09-21T03:21:53.577347+0000","last_clean":"2024-09-21T03:21:53.577347+0000","last_became_active":"2024-09-21T03:21:50.888329+0000","last_became_peered":"2024-09-21T03:21:50.888329+0000","last_unstale":"2024-09-21T03:21:53.577347+0000","last_undegraded":"2024-09-21T03:21:53.577347+0000","last_fullsized":"2024-09-21T03:21:53.577347+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:22:33.757619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.578269+0000","last_change":"2024-09-21T03:21:51.902475+0000","last_active":"2024-09-21T03:21:53.578269+0000","last_peered":"2024-09-21T03:21:53.578269+0000","last_clean":"2024-09-21T03:21:53.578269+0000","last_became_active":"2024-09-21T03:21:51.901928+0000","last_became_peered":"2024-09-21T03:21:51.901928+0000","last_unstale":"2024-09-21T03:21:53.578269+0000","last_undegraded":"2024-09-21T03:21:53.578269+0000","last_fullsized":"2024-09-21T03:21:53.578269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:16.502189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"79'2","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577358+0000","last_change":"2024-09-21T03:21:50.889500+0000","last_active":"2024-09-21T03:21:53.577358+0000","last_peered":"2024-09-21T03:21:53.577358+0000","last_clean":"2024-09-21T03:21:53.577358+0000","last_became_active":"2024-09-21T03:21:50.889200+0000","last_became_peered":"2024-09-21T03:21:50.889200+0000","last_unstale":"2024-09-21T03:21:53.577358+0000","last_undegraded":"2024-09-21T03:21:53.577358+0000","last_fullsized":"2024-09-21T03:21:53.577358+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:51.051625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899896+0000","last_change":"2024-09-21T03:21:51.903101+0000","last_active":"2024-09-21T03:21:52.899896+0000","last_peered":"2024-09-21T03:21:52.899896+0000","last_clean":"2024-09-21T03:21:52.899896+0000","last_became_active":"2024-09-21T03:21:51.902773+0000","last_became_peered":"2024-09-21T03:21:51.902773+0000","last_unstale":"2024-09-21T03:21:52.899896+0000","last_undegraded":"2024-09-21T03:21:52.899896+0000","last_fullsized":"2024-09-21T03:21:52.899896+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:01.885867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"79'1","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898638+0000","last_change":"2024-09-21T03:21:50.890186+0000","last_active":"2024-09-21T03:21:52.898638+0000","last_peered":"2024-09-21T03:21:52.898638+0000","last_clean":"2024-09-21T03:21:52.898638+0000","last_became_active":"2024-09-21T03:21:50.889742+0000","last_became_peered":"2024-09-21T03:21:50.889742+0000","last_unstale":"2024-09-21T03:21:52.898638+0000","last_undegraded":"2024-09-21T03:21:52.898638+0000","last_fullsized":"2024-09-21T03:21:52.898638+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:06.447091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898436+0000","last_change":"2024-09-21T03:21:51.902339+0000","last_active":"2024-09-21T03:21:52.898436+0000","last_peered":"2024-09-21T03:21:52.898436+0000","last_clean":"2024-09-21T03:21:52.898436+0000","last_became_active":"2024-09-21T03:21:51.902038+0000","last_became_peered":"2024-09-21T03:21:51.902038+0000","last_unstale":"2024-09-21T03:21:52.898436+0000","last_undegraded":"2024-09-21T03:21:52.898436+0000","last_fullsized":"2024-09-21T03:21:52.898436+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:39:15.428843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"79'1","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898008+0000","last_change":"2024-09-21T03:21:50.889708+0000","last_active":"2024-09-21T03:21:52.898008+0000","last_peered":"2024-09-21T03:21:52.898008+0000","last_clean":"2024-09-21T03:21:52.898008+0000","last_became_active":"2024-09-21T03:21:50.888284+0000","last_became_peered":"2024-09-21T03:21:50.888284+0000","last_unstale":"2024-09-21T03:21:52.898008+0000","last_undegraded":"2024-09-21T03:21:52.898008+0000","last_fullsized":"2024-09-21T03:21:52.898008+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:04.599704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577421+0000","last_change":"2024-09-21T03:21:51.905014+0000","last_active":"2024-09-21T03:21:53.577421+0000","last_peered":"2024-09-21T03:21:53.577421+0000","last_clean":"2024-09-21T03:21:53.577421+0000","last_became_active":"2024-09-21T03:21:51.904638+0000","last_became_peered":"2024-09-21T03:21:51.904638+0000","last_unstale":"2024-09-21T03:21:53.577421+0000","last_undegraded":"2024-09-21T03:21:53.577421+0000","last_fullsized":"2024-09-21T03:21:53.577421+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:40:07.583428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577424+0000","last_change":"2024-09-21T03:21:50.890284+0000","last_active":"2024-09-21T03:21:53.577424+0000","last_peered":"2024-09-21T03:21:53.577424+0000","last_clean":"2024-09-21T03:21:53.577424+0000","last_became_active":"2024-09-21T03:21:50.890002+0000","last_became_peered":"2024-09-21T03:21:50.890002+0000","last_unstale":"2024-09-21T03:21:53.577424+0000","last_undegraded":"2024-09-21T03:21:53.577424+0000","last_fullsized":"2024-09-21T03:21:53.577424+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:33:16.074069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.576875+0000","last_change":"2024-09-21T03:21:51.899993+0000","last_active":"2024-09-21T03:21:53.576875+0000","last_peered":"2024-09-21T03:21:53.576875+0000","last_clean":"2024-09-21T03:21:53.576875+0000","last_became_active":"2024-09-21T03:21:51.899632+0000","last_became_peered":"2024-09-21T03:21:51.899632+0000","last_unstale":"2024-09-21T03:21:53.576875+0000","last_undegraded":"2024-09-21T03:21:53.576875+0000","last_fullsized":"2024-09-21T03:21:53.576875+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:15.015396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899544+0000","last_change":"2024-09-21T03:21:50.894291+0000","last_active":"2024-09-21T03:21:52.899544+0000","last_peered":"2024-09-21T03:21:52.899544+0000","last_clean":"2024-09-21T03:21:52.899544+0000","last_became_active":"2024-09-21T03:21:50.894001+0000","last_became_peered":"2024-09-21T03:21:50.894001+0000","last_unstale":"2024-09-21T03:21:52.899544+0000","last_undegraded":"2024-09-21T03:21:52.899544+0000","last_fullsized":"2024-09-21T03:21:52.899544+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:38:02.558962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577019+0000","last_change":"2024-09-21T03:21:51.894313+0000","last_active":"2024-09-21T03:21:53.577019+0000","last_peered":"2024-09-21T03:21:53.577019+0000","last_clean":"2024-09-21T03:21:53.577019+0000","last_became_active":"2024-09-21T03:21:51.894003+0000","last_became_peered":"2024-09-21T03:21:51.894003+0000","last_unstale":"2024-09-21T03:21:53.577019+0000","last_undegraded":"2024-09-21T03:21:53.577019+0000","last_fullsized":"2024-09-21T03:21:53.577019+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:55.444519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900543+0000","last_change":"2024-09-21T03:21:50.883437+0000","last_active":"2024-09-21T03:21:52.900543+0000","last_peered":"2024-09-21T03:21:52.900543+0000","last_clean":"2024-09-21T03:21:52.900543+0000","last_became_active":"2024-09-21T03:21:50.883111+0000","last_became_peered":"2024-09-21T03:21:50.883111+0000","last_unstale":"2024-09-21T03:21:52.900543+0000","last_undegraded":"2024-09-21T03:21:52.900543+0000","last_fullsized":"2024-09-21T03:21:52.900543+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:50.701648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577751+0000","last_change":"2024-09-21T03:21:51.904652+0000","last_active":"2024-09-21T03:21:53.577751+0000","last_peered":"2024-09-21T03:21:53.577751+0000","last_clean":"2024-09-21T03:21:53.577751+0000","last_became_active":"2024-09-21T03:21:51.904284+0000","last_became_peered":"2024-09-21T03:21:51.904284+0000","last_unstale":"2024-09-21T03:21:53.577751+0000","last_undegraded":"2024-09-21T03:21:53.577751+0000","last_fullsized":"2024-09-21T03:21:53.577751+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:31.802933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900223+0000","last_change":"2024-09-21T03:21:50.890689+0000","last_active":"2024-09-21T03:21:52.900223+0000","last_peered":"2024-09-21T03:21:52.900223+0000","last_clean":"2024-09-21T03:21:52.900223+0000","last_became_active":"2024-09-21T03:21:50.890329+0000","last_became_peered":"2024-09-21T03:21:50.890329+0000","last_unstale":"2024-09-21T03:21:52.900223+0000","last_undegraded":"2024-09-21T03:21:52.900223+0000","last_fullsized":"2024-09-21T03:21:52.900223+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:46:35.605253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577187+0000","last_change":"2024-09-21T03:21:51.904862+0000","last_active":"2024-09-21T03:21:53.577187+0000","last_peered":"2024-09-21T03:21:53.577187+0000","last_clean":"2024-09-21T03:21:53.577187+0000","last_became_active":"2024-09-21T03:21:51.904529+0000","last_became_peered":"2024-09-21T03:21:51.904529+0000","last_unstale":"2024-09-21T03:21:53.577187+0000","last_undegraded":"2024-09-21T03:21:53.577187+0000","last_fullsized":"2024-09-21T03:21:53.577187+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:19.505940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"79'3","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899751+0000","last_change":"2024-09-21T03:21:50.891311+0000","last_active":"2024-09-21T03:21:52.899751+0000","last_peered":"2024-09-21T03:21:52.899751+0000","last_clean":"2024-09-21T03:21:52.899751+0000","last_became_active":"2024-09-21T03:21:50.890713+0000","last_became_peered":"2024-09-21T03:21:50.890713+0000","last_unstale":"2024-09-21T03:21:52.899751+0000","last_undegraded":"2024-09-21T03:21:52.899751+0000","last_fullsized":"2024-09-21T03:21:52.899751+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:41.919161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898766+0000","last_change":"2024-09-21T03:21:51.908205+0000","last_active":"2024-09-21T03:21:52.898766+0000","last_peered":"2024-09-21T03:21:52.898766+0000","last_clean":"2024-09-21T03:21:52.898766+0000","last_became_active":"2024-09-21T03:21:51.907239+0000","last_became_peered":"2024-09-21T03:21:51.907239+0000","last_unstale":"2024-09-21T03:21:52.898766+0000","last_undegraded":"2024-09-21T03:21:52.898766+0000","last_fullsized":"2024-09-21T03:21:52.898766+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:08:40.548484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"79'6","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577328+0000","last_change":"2024-09-21T03:21:50.887898+0000","last_active":"2024-09-21T03:21:53.577328+0000","last_peered":"2024-09-21T03:21:53.577328+0000","last_clean":"2024-09-21T03:21:53.577328+0000","last_became_active":"2024-09-21T03:21:50.887571+0000","last_became_peered":"2024-09-21T03:21:50.887571+0000","last_unstale":"2024-09-21T03:21:53.577328+0000","last_undegraded":"2024-09-21T03:21:53.577328+0000","last_fullsized":"2024-09-21T03:21:53.577328+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:47:46.235056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577488+0000","last_change":"2024-09-21T03:21:51.903978+0000","last_active":"2024-09-21T03:21:53.577488+0000","last_peered":"2024-09-21T03:21:53.577488+0000","last_clean":"2024-09-21T03:21:53.577488+0000","last_became_active":"2024-09-21T03:21:51.903596+0000","last_became_peered":"2024-09-21T03:21:51.903596+0000","last_unstale":"2024-09-21T03:21:53.577488+0000","last_undegraded":"2024-09-21T03:21:53.577488+0000","last_fullsized":"2024-09-21T03:21:53.577488+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:27:39.139799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"79'2","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899993+0000","last_change":"2024-09-21T03:21:50.889245+0000","last_active":"2024-09-21T03:21:52.899993+0000","last_peered":"2024-09-21T03:21:52.899993+0000","last_clean":"2024-09-21T03:21:52.899993+0000","last_became_active":"2024-09-21T03:21:50.888937+0000","last_became_peered":"2024-09-21T03:21:50.888937+0000","last_unstale":"2024-09-21T03:21:52.899993+0000","last_undegraded":"2024-09-21T03:21:52.899993+0000","last_fullsized":"2024-09-21T03:21:52.899993+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:45:52.368843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.578464+0000","last_change":"2024-09-21T03:21:51.905440+0000","last_active":"2024-09-21T03:21:53.578464+0000","last_peered":"2024-09-21T03:21:53.578464+0000","last_clean":"2024-09-21T03:21:53.578464+0000","last_became_active":"2024-09-21T03:21:51.905015+0000","last_became_peered":"2024-09-21T03:21:51.905015+0000","last_unstale":"2024-09-21T03:21:53.578464+0000","last_undegraded":"2024-09-21T03:21:53.578464+0000","last_fullsized":"2024-09-21T03:21:53.578464+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:55.444519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.576949+0000","last_change":"2024-09-21T03:21:50.885645+0000","last_active":"2024-09-21T03:21:53.576949+0000","last_peered":"2024-09-21T03:21:53.576949+0000","last_clean":"2024-09-21T03:21:53.576949+0000","last_became_active":"2024-09-21T03:21:50.885322+0000","last_became_peered":"2024-09-21T03:21:50.885322+0000","last_unstale":"2024-09-21T03:21:53.576949+0000","last_undegraded":"2024-09-21T03:21:53.576949+0000","last_fullsized":"2024-09-21T03:21:53.576949+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:21:22.286598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899587+0000","last_change":"2024-09-21T03:21:51.904861+0000","last_active":"2024-09-21T03:21:52.899587+0000","last_peered":"2024-09-21T03:21:52.899587+0000","last_clean":"2024-09-21T03:21:52.899587+0000","last_became_active":"2024-09-21T03:21:51.904529+0000","last_became_peered":"2024-09-21T03:21:51.904529+0000","last_unstale":"2024-09-21T03:21:52.899587+0000","last_undegraded":"2024-09-21T03:21:52.899587+0000","last_fullsized":"2024-09-21T03:21:52.899587+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:10:14.676515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577415+0000","last_change":"2024-09-21T03:21:50.893102+0000","last_active":"2024-09-21T03:21:53.577415+0000","last_peered":"2024-09-21T03:21:53.577415+0000","last_clean":"2024-09-21T03:21:53.577415+0000","last_became_active":"2024-09-21T03:21:50.892785+0000","last_became_peered":"2024-09-21T03:21:50.892785+0000","last_unstale":"2024-09-21T03:21:53.577415+0000","last_undegraded":"2024-09-21T03:21:53.577415+0000","last_fullsized":"2024-09-21T03:21:53.577415+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:17.615245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899583+0000","last_change":"2024-09-21T03:21:51.894797+0000","last_active":"2024-09-21T03:21:52.899583+0000","last_peered":"2024-09-21T03:21:52.899583+0000","last_clean":"2024-09-21T03:21:52.899583+0000","last_became_active":"2024-09-21T03:21:51.894373+0000","last_became_peered":"2024-09-21T03:21:51.894373+0000","last_unstale":"2024-09-21T03:21:52.899583+0000","last_undegraded":"2024-09-21T03:21:52.899583+0000","last_fullsized":"2024-09-21T03:21:52.899583+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:02:38.762310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"79'8","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577257+0000","last_change":"2024-09-21T03:21:50.883788+0000","last_active":"2024-09-21T03:21:53.577257+0000","last_peered":"2024-09-21T03:21:53.577257+0000","last_clean":"2024-09-21T03:21:53.577257+0000","last_became_active":"2024-09-21T03:21:50.883369+0000","last_became_peered":"2024-09-21T03:21:50.883369+0000","last_unstale":"2024-09-21T03:21:53.577257+0000","last_undegraded":"2024-09-21T03:21:53.577257+0000","last_fullsized":"2024-09-21T03:21:53.577257+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:56:39.433202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.578242+0000","last_change":"2024-09-21T03:21:51.898550+0000","last_active":"2024-09-21T03:21:53.578242+0000","last_peered":"2024-09-21T03:21:53.578242+0000","last_clean":"2024-09-21T03:21:53.578242+0000","last_became_active":"2024-09-21T03:21:51.898201+0000","last_became_peered":"2024-09-21T03:21:51.898201+0000","last_unstale":"2024-09-21T03:21:53.578242+0000","last_undegraded":"2024-09-21T03:21:53.578242+0000","last_fullsized":"2024-09-21T03:21:53.578242+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:11:42.267787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"79'1","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900728+0000","last_change":"2024-09-21T03:21:50.889581+0000","last_active":"2024-09-21T03:21:52.900728+0000","last_peered":"2024-09-21T03:21:52.900728+0000","last_clean":"2024-09-21T03:21:52.900728+0000","last_became_active":"2024-09-21T03:21:50.889245+0000","last_became_peered":"2024-09-21T03:21:50.889245+0000","last_unstale":"2024-09-21T03:21:52.900728+0000","last_undegraded":"2024-09-21T03:21:52.900728+0000","last_fullsized":"2024-09-21T03:21:52.900728+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:00.493999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900576+0000","last_change":"2024-09-21T03:21:51.899099+0000","last_active":"2024-09-21T03:21:52.900576+0000","last_peered":"2024-09-21T03:21:52.900576+0000","last_clean":"2024-09-21T03:21:52.900576+0000","last_became_active":"2024-09-21T03:21:51.898350+0000","last_became_peered":"2024-09-21T03:21:51.898350+0000","last_unstale":"2024-09-21T03:21:52.900576+0000","last_undegraded":"2024-09-21T03:21:52.900576+0000","last_fullsized":"2024-09-21T03:21:52.900576+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:43.337873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"79'2","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.576933+0000","last_change":"2024-09-21T03:21:50.892793+0000","last_active":"2024-09-21T03:21:53.576933+0000","last_peered":"2024-09-21T03:21:53.576933+0000","last_clean":"2024-09-21T03:21:53.576933+0000","last_became_active":"2024-09-21T03:21:50.892459+0000","last_became_peered":"2024-09-21T03:21:50.892459+0000","last_unstale":"2024-09-21T03:21:53.576933+0000","last_undegraded":"2024-09-21T03:21:53.576933+0000","last_fullsized":"2024-09-21T03:21:53.576933+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:54.992900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898808+0000","last_change":"2024-09-21T03:21:51.893380+0000","last_active":"2024-09-21T03:21:52.898808+0000","last_peered":"2024-09-21T03:21:52.898808+0000","last_clean":"2024-09-21T03:21:52.898808+0000","last_became_active":"2024-09-21T03:21:51.893039+0000","last_became_peered":"2024-09-21T03:21:51.893039+0000","last_unstale":"2024-09-21T03:21:52.898808+0000","last_undegraded":"2024-09-21T03:21:52.898808+0000","last_fullsized":"2024-09-21T03:21:52.898808+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:11.163288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577437+0000","last_change":"2024-09-21T03:21:50.891075+0000","last_active":"2024-09-21T03:21:53.577437+0000","last_peered":"2024-09-21T03:21:53.577437+0000","last_clean":"2024-09-21T03:21:53.577437+0000","last_became_active":"2024-09-21T03:21:50.890732+0000","last_became_peered":"2024-09-21T03:21:50.890732+0000","last_unstale":"2024-09-21T03:21:53.577437+0000","last_undegraded":"2024-09-21T03:21:53.577437+0000","last_fullsized":"2024-09-21T03:21:53.577437+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:29.480411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.270234+0000","last_change":"2024-09-21T03:21:51.907368+0000","last_active":"2024-09-21T03:21:53.270234+0000","last_peered":"2024-09-21T03:21:53.270234+0000","last_clean":"2024-09-21T03:21:53.270234+0000","last_became_active":"2024-09-21T03:21:51.906509+0000","last_became_peered":"2024-09-21T03:21:51.906509+0000","last_unstale":"2024-09-21T03:21:53.270234+0000","last_undegraded":"2024-09-21T03:21:53.270234+0000","last_fullsized":"2024-09-21T03:21:53.270234+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:31:41.794069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"79'2","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577118+0000","last_change":"2024-09-21T03:21:50.881909+0000","last_active":"2024-09-21T03:21:53.577118+0000","last_peered":"2024-09-21T03:21:53.577118+0000","last_clean":"2024-09-21T03:21:53.577118+0000","last_became_active":"2024-09-21T03:21:50.881541+0000","last_became_peered":"2024-09-21T03:21:50.881541+0000","last_unstale":"2024-09-21T03:21:53.577118+0000","last_undegraded":"2024-09-21T03:21:53.577118+0000","last_fullsized":"2024-09-21T03:21:53.577118+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:44:02.316385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577275+0000","last_change":"2024-09-21T03:21:51.901261+0000","last_active":"2024-09-21T03:21:53.577275+0000","last_peered":"2024-09-21T03:21:53.577275+0000","last_clean":"2024-09-21T03:21:53.577275+0000","last_became_active":"2024-09-21T03:21:51.900954+0000","last_became_peered":"2024-09-21T03:21:51.900954+0000","last_unstale":"2024-09-21T03:21:53.577275+0000","last_undegraded":"2024-09-21T03:21:53.577275+0000","last_fullsized":"2024-09-21T03:21:53.577275+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:50:07.239832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.270134+0000","last_change":"2024-09-21T03:21:50.884684+0000","last_active":"2024-09-21T03:21:53.270134+0000","last_peered":"2024-09-21T03:21:53.270134+0000","last_clean":"2024-09-21T03:21:53.270134+0000","last_became_active":"2024-09-21T03:21:50.883447+0000","last_became_peered":"2024-09-21T03:21:50.883447+0000","last_unstale":"2024-09-21T03:21:53.270134+0000","last_undegraded":"2024-09-21T03:21:53.270134+0000","last_fullsized":"2024-09-21T03:21:53.270134+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:14:10.639009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.269927+0000","last_change":"2024-09-21T03:21:51.901038+0000","last_active":"2024-09-21T03:21:53.269927+0000","last_peered":"2024-09-21T03:21:53.269927+0000","last_clean":"2024-09-21T03:21:53.269927+0000","last_became_active":"2024-09-21T03:21:51.900648+0000","last_became_peered":"2024-09-21T03:21:51.900648+0000","last_unstale":"2024-09-21T03:21:53.269927+0000","last_undegraded":"2024-09-21T03:21:53.269927+0000","last_fullsized":"2024-09-21T03:21:53.269927+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:26.805582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.269785+0000","last_change":"2024-09-21T03:21:50.891133+0000","last_active":"2024-09-21T03:21:53.269785+0000","last_peered":"2024-09-21T03:21:53.269785+0000","last_clean":"2024-09-21T03:21:53.269785+0000","last_became_active":"2024-09-21T03:21:50.890817+0000","last_became_peered":"2024-09-21T03:21:50.890817+0000","last_unstale":"2024-09-21T03:21:53.269785+0000","last_undegraded":"2024-09-21T03:21:53.269785+0000","last_fullsized":"2024-09-21T03:21:53.269785+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:50:16.600569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577172+0000","last_change":"2024-09-21T03:21:51.909921+0000","last_active":"2024-09-21T03:21:53.577172+0000","last_peered":"2024-09-21T03:21:53.577172+0000","last_clean":"2024-09-21T03:21:53.577172+0000","last_became_active":"2024-09-21T03:21:51.909432+0000","last_became_peered":"2024-09-21T03:21:51.909432+0000","last_unstale":"2024-09-21T03:21:53.577172+0000","last_undegraded":"2024-09-21T03:21:53.577172+0000","last_fullsized":"2024-09-21T03:21:53.577172+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:08:40.548484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.576433+0000","last_change":"2024-09-21T03:21:50.881109+0000","last_active":"2024-09-21T03:21:53.576433+0000","last_peered":"2024-09-21T03:21:53.576433+0000","last_clean":"2024-09-21T03:21:53.576433+0000","last_became_active":"2024-09-21T03:21:50.880825+0000","last_became_peered":"2024-09-21T03:21:50.880825+0000","last_unstale":"2024-09-21T03:21:53.576433+0000","last_undegraded":"2024-09-21T03:21:53.576433+0000","last_fullsized":"2024-09-21T03:21:53.576433+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:40:06.577759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899093+0000","last_change":"2024-09-21T03:21:51.900827+0000","last_active":"2024-09-21T03:21:52.899093+0000","last_peered":"2024-09-21T03:21:52.899093+0000","last_clean":"2024-09-21T03:21:52.899093+0000","last_became_active":"2024-09-21T03:21:51.900485+0000","last_became_peered":"2024-09-21T03:21:51.900485+0000","last_unstale":"2024-09-21T03:21:52.899093+0000","last_undegraded":"2024-09-21T03:21:52.899093+0000","last_fullsized":"2024-09-21T03:21:52.899093+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:40.866323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"79'2","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899992+0000","last_change":"2024-09-21T03:21:50.886982+0000","last_active":"2024-09-21T03:21:52.899992+0000","last_peered":"2024-09-21T03:21:52.899992+0000","last_clean":"2024-09-21T03:21:52.899992+0000","last_became_active":"2024-09-21T03:21:50.886661+0000","last_became_peered":"2024-09-21T03:21:50.886661+0000","last_unstale":"2024-09-21T03:21:52.899992+0000","last_undegraded":"2024-09-21T03:21:52.899992+0000","last_fullsized":"2024-09-21T03:21:52.899992+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:31:40.788400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.578330+0000","last_change":"2024-09-21T03:21:51.909713+0000","last_active":"2024-09-21T03:21:53.578330+0000","last_peered":"2024-09-21T03:21:53.578330+0000","last_clean":"2024-09-21T03:21:53.578330+0000","last_became_active":"2024-09-21T03:21:51.909373+0000","last_became_peered":"2024-09-21T03:21:51.909373+0000","last_unstale":"2024-09-21T03:21:53.578330+0000","last_undegraded":"2024-09-21T03:21:53.578330+0000","last_fullsized":"2024-09-21T03:21:53.578330+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:52.176078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"79'1","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899881+0000","last_change":"2024-09-21T03:21:50.891027+0000","last_active":"2024-09-21T03:21:52.899881+0000","last_peered":"2024-09-21T03:21:52.899881+0000","last_clean":"2024-09-21T03:21:52.899881+0000","last_became_active":"2024-09-21T03:21:50.890732+0000","last_became_peered":"2024-09-21T03:21:50.890732+0000","last_unstale":"2024-09-21T03:21:52.899881+0000","last_undegraded":"2024-09-21T03:21:52.899881+0000","last_fullsized":"2024-09-21T03:21:52.899881+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:21.808526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900708+0000","last_change":"2024-09-21T03:21:51.905815+0000","last_active":"2024-09-21T03:21:52.900708+0000","last_peered":"2024-09-21T03:21:52.900708+0000","last_clean":"2024-09-21T03:21:52.900708+0000","last_became_active":"2024-09-21T03:21:51.905422+0000","last_became_peered":"2024-09-21T03:21:51.905422+0000","last_unstale":"2024-09-21T03:21:52.900708+0000","last_undegraded":"2024-09-21T03:21:52.900708+0000","last_fullsized":"2024-09-21T03:21:52.900708+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:31.675347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899899+0000","last_change":"2024-09-21T03:21:50.891090+0000","last_active":"2024-09-21T03:21:52.899899+0000","last_peered":"2024-09-21T03:21:52.899899+0000","last_clean":"2024-09-21T03:21:52.899899+0000","last_became_active":"2024-09-21T03:21:50.890775+0000","last_became_peered":"2024-09-21T03:21:50.890775+0000","last_unstale":"2024-09-21T03:21:52.899899+0000","last_undegraded":"2024-09-21T03:21:52.899899+0000","last_fullsized":"2024-09-21T03:21:52.899899+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:28.931234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899083+0000","last_change":"2024-09-21T03:21:51.907507+0000","last_active":"2024-09-21T03:21:52.899083+0000","last_peered":"2024-09-21T03:21:52.899083+0000","last_clean":"2024-09-21T03:21:52.899083+0000","last_became_active":"2024-09-21T03:21:51.906065+0000","last_became_peered":"2024-09-21T03:21:51.906065+0000","last_unstale":"2024-09-21T03:21:52.899083+0000","last_undegraded":"2024-09-21T03:21:52.899083+0000","last_fullsized":"2024-09-21T03:21:52.899083+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:34:58.232355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900634+0000","last_change":"2024-09-21T03:21:50.882989+0000","last_active":"2024-09-21T03:21:52.900634+0000","last_peered":"2024-09-21T03:21:52.900634+0000","last_clean":"2024-09-21T03:21:52.900634+0000","last_became_active":"2024-09-21T03:21:50.882493+0000","last_became_peered":"2024-09-21T03:21:50.882493+0000","last_unstale":"2024-09-21T03:21:52.900634+0000","last_undegraded":"2024-09-21T03:21:52.900634+0000","last_fullsized":"2024-09-21T03:21:52.900634+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:48.422744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577198+0000","last_change":"2024-09-21T03:21:51.901903+0000","last_active":"2024-09-21T03:21:53.577198+0000","last_peered":"2024-09-21T03:21:53.577198+0000","last_clean":"2024-09-21T03:21:53.577198+0000","last_became_active":"2024-09-21T03:21:51.901578+0000","last_became_peered":"2024-09-21T03:21:51.901578+0000","last_unstale":"2024-09-21T03:21:53.577198+0000","last_undegraded":"2024-09-21T03:21:53.577198+0000","last_fullsized":"2024-09-21T03:21:53.577198+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:52:04.989198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577176+0000","last_change":"2024-09-21T03:21:50.886896+0000","last_active":"2024-09-21T03:21:53.577176+0000","last_peered":"2024-09-21T03:21:53.577176+0000","last_clean":"2024-09-21T03:21:53.577176+0000","last_became_active":"2024-09-21T03:21:50.886606+0000","last_became_peered":"2024-09-21T03:21:50.886606+0000","last_unstale":"2024-09-21T03:21:53.577176+0000","last_undegraded":"2024-09-21T03:21:53.577176+0000","last_fullsized":"2024-09-21T03:21:53.577176+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:25:56.849713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577058+0000","last_change":"2024-09-21T03:21:51.903666+0000","last_active":"2024-09-21T03:21:53.577058+0000","last_peered":"2024-09-21T03:21:53.577058+0000","last_clean":"2024-09-21T03:21:53.577058+0000","last_became_active":"2024-09-21T03:21:51.903368+0000","last_became_peered":"2024-09-21T03:21:51.903368+0000","last_unstale":"2024-09-21T03:21:53.577058+0000","last_undegraded":"2024-09-21T03:21:53.577058+0000","last_fullsized":"2024-09-21T03:21:53.577058+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:29:11.217555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.898172+0000","last_change":"2024-09-21T03:21:50.888581+0000","last_active":"2024-09-21T03:21:52.898172+0000","last_peered":"2024-09-21T03:21:52.898172+0000","last_clean":"2024-09-21T03:21:52.898172+0000","last_became_active":"2024-09-21T03:21:50.887896+0000","last_became_peered":"2024-09-21T03:21:50.887896+0000","last_unstale":"2024-09-21T03:21:52.898172+0000","last_undegraded":"2024-09-21T03:21:52.898172+0000","last_fullsized":"2024-09-21T03:21:52.898172+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:00.880198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577694+0000","last_change":"2024-09-21T03:21:51.903858+0000","last_active":"2024-09-21T03:21:53.577694+0000","last_peered":"2024-09-21T03:21:53.577694+0000","last_clean":"2024-09-21T03:21:53.577694+0000","last_became_active":"2024-09-21T03:21:51.903527+0000","last_became_peered":"2024-09-21T03:21:51.903527+0000","last_unstale":"2024-09-21T03:21:53.577694+0000","last_undegraded":"2024-09-21T03:21:53.577694+0000","last_fullsized":"2024-09-21T03:21:53.577694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:21:23.292266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900099+0000","last_change":"2024-09-21T03:21:50.891506+0000","last_active":"2024-09-21T03:21:52.900099+0000","last_peered":"2024-09-21T03:21:52.900099+0000","last_clean":"2024-09-21T03:21:52.900099+0000","last_became_active":"2024-09-21T03:21:50.891130+0000","last_became_peered":"2024-09-21T03:21:50.891130+0000","last_unstale":"2024-09-21T03:21:52.900099+0000","last_undegraded":"2024-09-21T03:21:52.900099+0000","last_fullsized":"2024-09-21T03:21:52.900099+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:16.126547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.899967+0000","last_change":"2024-09-21T03:21:51.894997+0000","last_active":"2024-09-21T03:21:52.899967+0000","last_peered":"2024-09-21T03:21:52.899967+0000","last_clean":"2024-09-21T03:21:52.899967+0000","last_became_active":"2024-09-21T03:21:51.894658+0000","last_became_peered":"2024-09-21T03:21:51.894658+0000","last_unstale":"2024-09-21T03:21:52.899967+0000","last_undegraded":"2024-09-21T03:21:52.899967+0000","last_fullsized":"2024-09-21T03:21:52.899967+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:09.488852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.897965+0000","last_change":"2024-09-21T03:21:50.891199+0000","last_active":"2024-09-21T03:21:52.897965+0000","last_peered":"2024-09-21T03:21:52.897965+0000","last_clean":"2024-09-21T03:21:52.897965+0000","last_became_active":"2024-09-21T03:21:50.890837+0000","last_became_peered":"2024-09-21T03:21:50.890837+0000","last_unstale":"2024-09-21T03:21:52.897965+0000","last_undegraded":"2024-09-21T03:21:52.897965+0000","last_fullsized":"2024-09-21T03:21:52.897965+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:20:54.618581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:52.900002+0000","last_change":"2024-09-21T03:21:51.899525+0000","last_active":"2024-09-21T03:21:52.900002+0000","last_peered":"2024-09-21T03:21:52.900002+0000","last_clean":"2024-09-21T03:21:52.900002+0000","last_became_active":"2024-09-21T03:21:51.899003+0000","last_became_peered":"2024-09-21T03:21:51.899003+0000","last_unstale":"2024-09-21T03:21:52.900002+0000","last_undegraded":"2024-09-21T03:21:52.900002+0000","last_fullsized":"2024-09-21T03:21:52.900002+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:50.865211+0000","last_clean_scrub_stamp":"2024-09-21T03:21:50.865211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:51.707317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"79'1","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.578284+0000","last_change":"2024-09-21T03:21:50.886216+0000","last_active":"2024-09-21T03:21:53.578284+0000","last_peered":"2024-09-21T03:21:53.578284+0000","last_clean":"2024-09-21T03:21:53.578284+0000","last_became_active":"2024-09-21T03:21:50.885887+0000","last_became_peered":"2024-09-21T03:21:50.885887+0000","last_unstale":"2024-09-21T03:21:53.578284+0000","last_undegraded":"2024-09-21T03:21:53.578284+0000","last_fullsized":"2024-09-21T03:21:53.578284+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:21:49.859542+0000","last_clean_scrub_stamp":"2024-09-21T03:21:49.859542+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:08.483183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":219,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T03:21:53.577601+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:21:53.577601+0000","last_peered":"2024-09-21T03:21:53.577601+0000","last_clean":"2024-09-21T03:21:53.577601+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:21:53.577601+0000","last_undegraded":"2024-09-21T03:21:53.577601+0000","last_fullsized":"2024-09-21T03:21:53.577601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509489,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32732,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339108,"statfs":{"total":96636764160,"available":96603246592,"internally_reserved":0,"allocated":1572864,"data_stored":998279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509488,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":987136,"data_stored":408535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509487,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":991232,"data_stored":409475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509487,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":974848,"data_stored":407841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509488,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":987136,"data_stored":409453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509488,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":978944,"data_stored":408423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509488,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":987136,"data_stored":408035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32724,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339116,"statfs":{"total":96636764160,"available":96603254784,"internally_reserved":0,"allocated":1572864,"data_stored":998243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:22:00.744 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T03:22:00.745 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T03:22:00.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.897+0000 7f20e3b19640 1 -- 172.21.15.105:0/3016928240 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20dc0cc1e0 msgr2=0x7f20dc0af3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:00.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.897+0000 7f20e3b19640 1 --2- 172.21.15.105:0/3016928240 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20dc0cc1e0 0x7f20dc0af3c0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f20dc072bc0 tx=0x7f20d802a8b0 comp rx=0 tx=0).stop 2024-09-21T03:22:00.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.897+0000 7f20e3b19640 1 -- 172.21.15.105:0/3016928240 shutdown_connections 2024-09-21T03:22:00.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.897+0000 7f20e3b19640 1 --2- 172.21.15.105:0/3016928240 >> v2:172.21.15.162:3300/0 conn(0x7f20dc15d8a0 0x7f20dc0b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:00.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.897+0000 7f20e3b19640 1 --2- 172.21.15.105:0/3016928240 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20dc0cc1e0 0x7f20dc0af3c0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:00.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.897+0000 7f20e3b19640 1 -- 172.21.15.105:0/3016928240 >> 172.21.15.105:0/3016928240 conn(0x7f20dc06d7d0 msgr2=0x7f20dc0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:00.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.897+0000 7f20e3b19640 1 -- 172.21.15.105:0/3016928240 shutdown_connections 2024-09-21T03:22:00.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.897+0000 7f20e3b19640 1 -- 172.21.15.105:0/3016928240 wait complete. 2024-09-21T03:22:00.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.899+0000 7f20e3b19640 1 Processor -- start 2024-09-21T03:22:00.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.899+0000 7f20e3b19640 1 -- start start 2024-09-21T03:22:00.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.900+0000 7f20e3b19640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20dc0cc1e0 0x7f20dc149d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:00.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.900+0000 7f20e3b19640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20dc0ccb50 0x7f20dc159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:00.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.900+0000 7f20e3b19640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20dc15d8a0 0x7f20dc1f6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:00.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.900+0000 7f20e3b19640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f20dc153520 con 0x7f20dc0ccb50 2024-09-21T03:22:00.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.900+0000 7f20e3b19640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f20dc1533a0 con 0x7f20dc15d8a0 2024-09-21T03:22:00.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.900+0000 7f20e3b19640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f20dc1536a0 con 0x7f20dc0cc1e0 2024-09-21T03:22:00.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.900+0000 7f20e10b4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20dc0ccb50 0x7f20dc159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:00.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.900+0000 7f20e10b4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20dc0ccb50 0x7f20dc159430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:45398/0 (socket says 172.21.15.105:45398) 2024-09-21T03:22:00.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.900+0000 7f20e10b4640 1 -- 172.21.15.105:0/576473330 learned_addr learned my addr 172.21.15.105:0/576473330 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:22:00.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.900+0000 7f20e10b4640 1 -- 172.21.15.105:0/576473330 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20dc0cc1e0 msgr2=0x7f20dc149d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:00.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.900+0000 7f20e10b4640 1 --2- 172.21.15.105:0/576473330 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20dc0cc1e0 0x7f20dc149d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:00.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.900+0000 7f20e10b4640 1 -- 172.21.15.105:0/576473330 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20dc15d8a0 msgr2=0x7f20dc1f6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:00.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.900+0000 7f20e10b4640 1 --2- 172.21.15.105:0/576473330 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20dc15d8a0 0x7f20dc1f6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:00.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.900+0000 7f20e10b4640 1 -- 172.21.15.105:0/576473330 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20dc15de50 con 0x7f20dc0ccb50 2024-09-21T03:22:00.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.900+0000 7f20e10b4640 1 --2- 172.21.15.105:0/576473330 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20dc0ccb50 0x7f20dc159430 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f20cc00d770 tx=0x7f20cc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:00.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.901+0000 7f20d27fc640 1 -- 172.21.15.105:0/576473330 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20cc017070 con 0x7f20dc0ccb50 2024-09-21T03:22:00.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.901+0000 7f20d27fc640 1 -- 172.21.15.105:0/576473330 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20cc009d20 con 0x7f20dc0ccb50 2024-09-21T03:22:00.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.901+0000 7f20e3b19640 1 -- 172.21.15.105:0/576473330 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20dc15a120 con 0x7f20dc0ccb50 2024-09-21T03:22:00.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.901+0000 7f20d27fc640 1 -- 172.21.15.105:0/576473330 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20cc0106c0 con 0x7f20dc0ccb50 2024-09-21T03:22:00.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.901+0000 7f20e3b19640 1 -- 172.21.15.105:0/576473330 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20dc15a6e0 con 0x7f20dc0ccb50 2024-09-21T03:22:00.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.902+0000 7f20e3b19640 1 -- 172.21.15.105:0/576473330 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20dc153b50 con 0x7f20dc0ccb50 2024-09-21T03:22:00.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.902+0000 7f20d27fc640 1 -- 172.21.15.105:0/576473330 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f20cc01a070 con 0x7f20dc0ccb50 2024-09-21T03:22:00.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.903+0000 7f20d27fc640 1 --2- 172.21.15.105:0/576473330 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f20c0078bc0 0x7f20c007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:00.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.903+0000 7f20d27fc640 1 -- 172.21.15.105:0/576473330 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f20cc09ae70 con 0x7f20dc0ccb50 2024-09-21T03:22:00.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.903+0000 7f20e18b5640 1 --2- 172.21.15.105:0/576473330 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f20c0078bc0 0x7f20c007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:00.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.904+0000 7f20e18b5640 1 --2- 172.21.15.105:0/576473330 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f20c0078bc0 0x7f20c007b0d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f20d8034000 tx=0x7f20d8004a40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:00.909 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:00.907+0000 7f20d27fc640 1 -- 172.21.15.105:0/576473330 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f20cc0632b0 con 0x7f20dc0ccb50 2024-09-21T03:22:01.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.154+0000 7f20e3b19640 1 -- 172.21.15.105:0/576473330 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f20dc14a240 con 0x7f20dc0ccb50 2024-09-21T03:22:01.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.157+0000 7f20d27fc640 1 -- 172.21.15.105:0/576473330 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7f20cc062bb0 con 0x7f20dc0ccb50 2024-09-21T03:22:01.159 INFO:teuthology.orchestra.run.smithi105.stdout:[client.0] 2024-09-21T03:22:01.159 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQDIOu5mughoJxAAhY0bzJmq+oNyzCdtafkC9w== 2024-09-21T03:22:01.159 INFO:teuthology.orchestra.run.smithi105.stdout: caps mds = "allow" 2024-09-21T03:22:01.159 INFO:teuthology.orchestra.run.smithi105.stdout: caps mon = "allow r" 2024-09-21T03:22:01.159 INFO:teuthology.orchestra.run.smithi105.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T03:22:01.159 INFO:teuthology.orchestra.run.smithi105.stderr:updated caps for client.0 2024-09-21T03:22:01.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.159+0000 7f20e3b19640 1 -- 172.21.15.105:0/576473330 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f20c0078bc0 msgr2=0x7f20c007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:01.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.159+0000 7f20e3b19640 1 --2- 172.21.15.105:0/576473330 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f20c0078bc0 0x7f20c007b0d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f20d8034000 tx=0x7f20d8004a40 comp rx=0 tx=0).stop 2024-09-21T03:22:01.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.159+0000 7f20e3b19640 1 -- 172.21.15.105:0/576473330 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20dc0ccb50 msgr2=0x7f20dc159430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:01.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.159+0000 7f20e3b19640 1 --2- 172.21.15.105:0/576473330 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20dc0ccb50 0x7f20dc159430 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f20cc00d770 tx=0x7f20cc00dc30 comp rx=0 tx=0).stop 2024-09-21T03:22:01.162 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.160+0000 7f20e3b19640 1 -- 172.21.15.105:0/576473330 shutdown_connections 2024-09-21T03:22:01.162 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.160+0000 7f20e3b19640 1 --2- 172.21.15.105:0/576473330 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f20c0078bc0 0x7f20c007b0d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:01.162 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.160+0000 7f20e3b19640 1 --2- 172.21.15.105:0/576473330 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20dc15d8a0 0x7f20dc1f6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:01.162 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.160+0000 7f20e3b19640 1 --2- 172.21.15.105:0/576473330 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20dc0ccb50 0x7f20dc159430 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:01.162 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.160+0000 7f20e3b19640 1 --2- 172.21.15.105:0/576473330 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f20dc0cc1e0 0x7f20dc149d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:01.162 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.160+0000 7f20e3b19640 1 -- 172.21.15.105:0/576473330 >> 172.21.15.105:0/576473330 conn(0x7f20dc06d7d0 msgr2=0x7f20dc0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:01.162 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.160+0000 7f20e3b19640 1 -- 172.21.15.105:0/576473330 shutdown_connections 2024-09-21T03:22:01.162 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.160+0000 7f20e3b19640 1 -- 172.21.15.105:0/576473330 wait complete. 2024-09-21T03:22:01.172 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:22:01.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.284+0000 7f136698b640 1 -- 172.21.15.105:0/2970838280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f134c0051c0 msgr2=0x7f134c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:01.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.284+0000 7f136698b640 1 --2- 172.21.15.105:0/2970838280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f134c0051c0 0x7f134c00b9c0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f13600720d0 tx=0x7f134c005830 comp rx=0 tx=0).stop 2024-09-21T03:22:01.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.284+0000 7f136698b640 1 -- 172.21.15.105:0/2970838280 shutdown_connections 2024-09-21T03:22:01.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.284+0000 7f136698b640 1 --2- 172.21.15.105:0/2970838280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f134c0051c0 0x7f134c00b9c0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:01.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.284+0000 7f136698b640 1 -- 172.21.15.105:0/2970838280 >> 172.21.15.105:0/2970838280 conn(0x7f136006d4f0 msgr2=0x7f1360071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:01.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.284+0000 7f136698b640 1 -- 172.21.15.105:0/2970838280 shutdown_connections 2024-09-21T03:22:01.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.284+0000 7f136698b640 1 -- 172.21.15.105:0/2970838280 wait complete. 2024-09-21T03:22:01.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.285+0000 7f136698b640 1 Processor -- start 2024-09-21T03:22:01.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.285+0000 7f136698b640 1 -- start start 2024-09-21T03:22:01.290 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.287+0000 7f136698b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f134c0051c0 0x7f136014ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:01.290 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.287+0000 7f136698b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13601f7300 0x7f13601f7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:01.290 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.287+0000 7f136698b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13601f7c50 0x7f13600b59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:01.290 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.287+0000 7f136698b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f13600cec10 con 0x7f13601f7300 2024-09-21T03:22:01.290 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.287+0000 7f136698b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f13600cd040 con 0x7f13601f7c50 2024-09-21T03:22:01.290 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.287+0000 7f136698b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f13600ced90 con 0x7f134c0051c0 2024-09-21T03:22:01.290 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.287+0000 7f1357fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13601f7300 0x7f13601f7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:01.291 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.287+0000 7f1357fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13601f7300 0x7f13601f7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:45416/0 (socket says 172.21.15.105:45416) 2024-09-21T03:22:01.291 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.287+0000 7f1357fff640 1 -- 172.21.15.105:0/986771068 learned_addr learned my addr 172.21.15.105:0/986771068 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:22:01.291 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.287+0000 7f1364f28640 1 --2- 172.21.15.105:0/986771068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13601f7c50 0x7f13600b59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:01.291 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.287+0000 7f135ffff640 1 --2- 172.21.15.105:0/986771068 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f134c0051c0 0x7f136014ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:01.291 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.287+0000 7f1357fff640 1 -- 172.21.15.105:0/986771068 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f134c0051c0 msgr2=0x7f136014ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:01.291 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.287+0000 7f1357fff640 1 --2- 172.21.15.105:0/986771068 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f134c0051c0 0x7f136014ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:01.291 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.287+0000 7f1357fff640 1 -- 172.21.15.105:0/986771068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13601f7c50 msgr2=0x7f13600b59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:01.291 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.287+0000 7f1357fff640 1 --2- 172.21.15.105:0/986771068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13601f7c50 0x7f13600b59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:01.291 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.287+0000 7f1357fff640 1 -- 172.21.15.105:0/986771068 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13600cb940 con 0x7f13601f7300 2024-09-21T03:22:01.291 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.287+0000 7f1357fff640 1 --2- 172.21.15.105:0/986771068 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13601f7300 0x7f13601f7710 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f1348011ab0 tx=0x7f1348011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:01.291 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.287+0000 7f135d7fa640 1 -- 172.21.15.105:0/986771068 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f134801e070 con 0x7f13601f7300 2024-09-21T03:22:01.291 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.287+0000 7f135d7fa640 1 -- 172.21.15.105:0/986771068 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f134800fe70 con 0x7f13601f7300 2024-09-21T03:22:01.291 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.288+0000 7f135d7fa640 1 -- 172.21.15.105:0/986771068 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13480042b0 con 0x7f13601f7300 2024-09-21T03:22:01.292 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.288+0000 7f136698b640 1 -- 172.21.15.105:0/986771068 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13600cbc20 con 0x7f13601f7300 2024-09-21T03:22:01.292 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.288+0000 7f136698b640 1 -- 172.21.15.105:0/986771068 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13600b54c0 con 0x7f13601f7300 2024-09-21T03:22:01.292 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.288+0000 7f136698b640 1 -- 172.21.15.105:0/986771068 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13600cb6b0 con 0x7f13601f7300 2024-09-21T03:22:01.292 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.289+0000 7f135d7fa640 1 -- 172.21.15.105:0/986771068 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1348021070 con 0x7f13601f7300 2024-09-21T03:22:01.292 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.290+0000 7f135d7fa640 1 --2- 172.21.15.105:0/986771068 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1340078bc0 0x7f134007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:01.292 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.290+0000 7f135d7fa640 1 -- 172.21.15.105:0/986771068 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f134809b630 con 0x7f13601f7300 2024-09-21T03:22:01.293 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.291+0000 7f135ffff640 1 --2- 172.21.15.105:0/986771068 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1340078bc0 0x7f134007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:01.293 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.292+0000 7f135ffff640 1 --2- 172.21.15.105:0/986771068 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1340078bc0 0x7f134007b0d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1350006650 tx=0x7f13500062f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:01.296 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.295+0000 7f135d7fa640 1 -- 172.21.15.105:0/986771068 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1348063540 con 0x7f13601f7300 2024-09-21T03:22:01.510 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.509+0000 7f136698b640 1 -- 172.21.15.105:0/986771068 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13600cc140 con 0x7f13601f7300 2024-09-21T03:22:01.511 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.509+0000 7f135d7fa640 1 -- 172.21.15.105:0/986771068 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5234 (secure 0 0 0) 0x7f13600cc140 con 0x7f13601f7300 2024-09-21T03:22:01.511 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:22:01.511 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":47,"btime":"2024-09-21T03:21:54:900892+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5878,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/352800965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":352800965},{"type":"v1","addr":"172.21.15.162:6836","nonce":352800965}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":5881,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3338554559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3338554559},{"type":"v1","addr":"172.21.15.162:6837","nonce":3338554559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/3520449576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3520449576},{"type":"v1","addr":"172.21.15.105:6834","nonce":3520449576}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:21:51.239132+0000","modified":"2024-09-21T03:21:54.265820+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6288":{"gid":6288,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/2722940718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2722940718},{"type":"v1","addr":"172.21.15.105:6835","nonce":2722940718}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6288,"qdb_cluster":[6288]},"id":6}]} 2024-09-21T03:22:01.511 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 47 2024-09-21T03:22:01.513 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.511+0000 7f136698b640 1 -- 172.21.15.105:0/986771068 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1340078bc0 msgr2=0x7f134007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:01.513 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.511+0000 7f136698b640 1 --2- 172.21.15.105:0/986771068 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1340078bc0 0x7f134007b0d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1350006650 tx=0x7f13500062f0 comp rx=0 tx=0).stop 2024-09-21T03:22:01.513 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.511+0000 7f136698b640 1 -- 172.21.15.105:0/986771068 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13601f7300 msgr2=0x7f13601f7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:01.513 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.511+0000 7f136698b640 1 --2- 172.21.15.105:0/986771068 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13601f7300 0x7f13601f7710 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f1348011ab0 tx=0x7f1348011f70 comp rx=0 tx=0).stop 2024-09-21T03:22:01.513 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.511+0000 7f136698b640 1 -- 172.21.15.105:0/986771068 shutdown_connections 2024-09-21T03:22:01.513 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.511+0000 7f136698b640 1 --2- 172.21.15.105:0/986771068 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1340078bc0 0x7f134007b0d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:01.514 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.511+0000 7f136698b640 1 --2- 172.21.15.105:0/986771068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13601f7c50 0x7f13600b59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:01.514 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.511+0000 7f136698b640 1 --2- 172.21.15.105:0/986771068 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13601f7300 0x7f13601f7710 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:01.514 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.511+0000 7f136698b640 1 --2- 172.21.15.105:0/986771068 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f134c0051c0 0x7f136014ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:01.514 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.511+0000 7f136698b640 1 -- 172.21.15.105:0/986771068 >> 172.21.15.105:0/986771068 conn(0x7f136006d4f0 msgr2=0x7f13600b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:01.514 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.511+0000 7f136698b640 1 -- 172.21.15.105:0/986771068 shutdown_connections 2024-09-21T03:22:01.514 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:01.511+0000 7f136698b640 1 -- 172.21.15.105:0/986771068 wait complete. 2024-09-21T03:22:01.927 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 47, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T03:21:51.239132+0000', 'modified': '2024-09-21T03:21:54.265820+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6288}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6288': {'gid': 6288, 'name': 'a', 'rank': 0, 'incarnation': 43, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.105:6835/2722940718', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6833', 'nonce': 2722940718}, {'type': 'v1', 'addr': '172.21.15.105:6835', 'nonce': 2722940718}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6288, 'qdb_cluster': [6288]} 2024-09-21T03:22:01.927 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T03:22:01.927 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-21T03:22:02.046 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.044+0000 7f90a6789640 1 -- 172.21.15.105:0/1884260583 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f908c003c10 msgr2=0x7f908c004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:02.047 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.044+0000 7f90a6789640 1 --2- 172.21.15.105:0/1884260583 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f908c003c10 0x7f908c004060 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f9090009b50 tx=0x7f908c005830 comp rx=0 tx=0).stop 2024-09-21T03:22:02.047 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.044+0000 7f90a4d26640 1 -- 172.21.15.105:0/1884260583 reap_dead start 2024-09-21T03:22:02.047 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.044+0000 7f90a6789640 1 -- 172.21.15.105:0/1884260583 shutdown_connections 2024-09-21T03:22:02.047 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.044+0000 7f90a6789640 1 -- 172.21.15.105:0/1884260583 >> 172.21.15.105:0/1884260583 conn(0x7f90a00cdcb0 msgr2=0x7f90a00ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:02.047 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.045+0000 7f90a6789640 1 -- 172.21.15.105:0/1884260583 shutdown_connections 2024-09-21T03:22:02.047 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.045+0000 7f90a6789640 1 -- 172.21.15.105:0/1884260583 wait complete. 2024-09-21T03:22:02.048 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.046+0000 7f90a6789640 1 Processor -- start 2024-09-21T03:22:02.048 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.046+0000 7f90a6789640 1 -- start start 2024-09-21T03:22:02.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.048+0000 7f90a6789640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f908c003c10 0x7f90a01f1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:02.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.048+0000 7f90a6789640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90a015a010 0x7f90a009cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:02.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.048+0000 7f90a6789640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90a0159260 0x7f90a0159670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:02.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.048+0000 7f90a6789640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f90a00adfa0 con 0x7f908c003c10 2024-09-21T03:22:02.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.048+0000 7f90a6789640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f90a00cf3c0 con 0x7f90a0159260 2024-09-21T03:22:02.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.048+0000 7f90a6789640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f90a00ae120 con 0x7f90a015a010 2024-09-21T03:22:02.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.048+0000 7f909ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f908c003c10 0x7f90a01f1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:02.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.048+0000 7f909ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f908c003c10 0x7f90a01f1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56140/0 (socket says 172.21.15.105:56140) 2024-09-21T03:22:02.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.048+0000 7f909ffff640 1 -- 172.21.15.105:0/1396509020 learned_addr learned my addr 172.21.15.105:0/1396509020 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:22:02.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.048+0000 7f9097fff640 1 --2- 172.21.15.105:0/1396509020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90a015a010 0x7f90a009cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:02.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.048+0000 7f90a4d26640 1 --2- 172.21.15.105:0/1396509020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90a0159260 0x7f90a0159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:02.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.048+0000 7f909ffff640 1 -- 172.21.15.105:0/1396509020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90a015a010 msgr2=0x7f90a009cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:02.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.048+0000 7f909ffff640 1 --2- 172.21.15.105:0/1396509020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90a015a010 0x7f90a009cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:02.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.048+0000 7f909ffff640 1 -- 172.21.15.105:0/1396509020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90a0159260 msgr2=0x7f90a0159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:02.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.048+0000 7f909ffff640 1 --2- 172.21.15.105:0/1396509020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90a0159260 0x7f90a0159670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:02.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.048+0000 7f909ffff640 1 -- 172.21.15.105:0/1396509020 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90a0159bb0 con 0x7f908c003c10 2024-09-21T03:22:02.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.048+0000 7f90a4d26640 1 --2- 172.21.15.105:0/1396509020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90a0159260 0x7f90a0159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:22:02.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.048+0000 7f909ffff640 1 --2- 172.21.15.105:0/1396509020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f908c003c10 0x7f90a01f1260 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f9090036040 tx=0x7f9090033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:02.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.048+0000 7f909d7fa640 1 -- 172.21.15.105:0/1396509020 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9090038040 con 0x7f908c003c10 2024-09-21T03:22:02.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.048+0000 7f909d7fa640 1 -- 172.21.15.105:0/1396509020 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9090004020 con 0x7f908c003c10 2024-09-21T03:22:02.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.048+0000 7f90a6789640 1 -- 172.21.15.105:0/1396509020 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90a01f2390 con 0x7f908c003c10 2024-09-21T03:22:02.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.048+0000 7f909d7fa640 1 -- 172.21.15.105:0/1396509020 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9090004470 con 0x7f908c003c10 2024-09-21T03:22:02.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.048+0000 7f90a6789640 1 -- 172.21.15.105:0/1396509020 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90a01f1a90 con 0x7f908c003c10 2024-09-21T03:22:02.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.050+0000 7f909d7fa640 1 -- 172.21.15.105:0/1396509020 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9090045020 con 0x7f908c003c10 2024-09-21T03:22:02.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.051+0000 7f909d7fa640 1 --2- 172.21.15.105:0/1396509020 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9080078bc0 0x7f908007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:02.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.051+0000 7f909d7fa640 1 -- 172.21.15.105:0/1396509020 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f90900bb6b0 con 0x7f908c003c10 2024-09-21T03:22:02.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.051+0000 7f9097fff640 1 --2- 172.21.15.105:0/1396509020 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9080078bc0 0x7f908007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:02.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.051+0000 7f90ad7d3740 1 Processor -- start 2024-09-21T03:22:02.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.051+0000 7f90ad7d3740 1 -- start start 2024-09-21T03:22:02.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.052+0000 7f9097fff640 1 --2- 172.21.15.105:0/1396509020 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9080078bc0 0x7f908007b0d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9088001050 tx=0x7f90880011e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:02.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.053+0000 7f90ad7d3740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565349c98270 0x56534a069fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:02.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.053+0000 7f90ad7d3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565349c6f3b0 0x56534a06a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:02.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.053+0000 7f90ad7d3740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x565349c77590 0x56534a0873e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:02.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.053+0000 7f90ad7d3740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x565349fb2820 con 0x565349c98270 2024-09-21T03:22:02.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.053+0000 7f90ad7d3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x565349fa1c50 con 0x565349c6f3b0 2024-09-21T03:22:02.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.053+0000 7f90ad7d3740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x565349fa5a60 con 0x565349c77590 2024-09-21T03:22:02.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.053+0000 7f909ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565349c98270 0x56534a069fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:02.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.053+0000 7f909ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565349c98270 0x56534a069fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56146/0 (socket says 172.21.15.105:56146) 2024-09-21T03:22:02.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.053+0000 7f909ffff640 1 -- 172.21.15.105:0/3840805634 learned_addr learned my addr 172.21.15.105:0/3840805634 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:22:02.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.053+0000 7f9097fff640 1 --2- 172.21.15.105:0/3840805634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565349c6f3b0 0x56534a06a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:02.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.053+0000 7f90a4d26640 1 --2- 172.21.15.105:0/3840805634 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x565349c77590 0x56534a0873e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:02.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.053+0000 7f909ffff640 1 -- 172.21.15.105:0/3840805634 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x565349c77590 msgr2=0x56534a0873e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:22:02.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.053+0000 7f909ffff640 1 --2- 172.21.15.105:0/3840805634 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x565349c77590 0x56534a0873e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:02.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.053+0000 7f909ffff640 1 -- 172.21.15.105:0/3840805634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565349c6f3b0 msgr2=0x56534a06a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:22:02.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.053+0000 7f909ffff640 1 --2- 172.21.15.105:0/3840805634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565349c6f3b0 0x56534a06a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:02.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.053+0000 7f909ffff640 1 -- 172.21.15.105:0/3840805634 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565349d03850 con 0x565349c98270 2024-09-21T03:22:02.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.053+0000 7f9097fff640 1 --2- 172.21.15.105:0/3840805634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565349c6f3b0 0x56534a06a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:22:02.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.053+0000 7f909ffff640 1 --2- 172.21.15.105:0/3840805634 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565349c98270 0x56534a069fa0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f90900b9c90 tx=0x7f9090083550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ad69ccb745d9b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:02.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.053+0000 7f9095ffb640 1 -- 172.21.15.105:0/3840805634 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9090088080 con 0x565349c98270 2024-09-21T03:22:02.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.053+0000 7f9095ffb640 1 -- 172.21.15.105:0/3840805634 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f909007f8c0 con 0x565349c98270 2024-09-21T03:22:02.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.053+0000 7f9095ffb640 1 -- 172.21.15.105:0/3840805634 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9090083af0 con 0x565349c98270 2024-09-21T03:22:02.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.054+0000 7f90ad7d3740 1 -- 172.21.15.105:0/3840805634 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565349c98270 msgr2=0x56534a069fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:02.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.054+0000 7f90ad7d3740 1 --2- 172.21.15.105:0/3840805634 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565349c98270 0x56534a069fa0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f90900b9c90 tx=0x7f9090083550 comp rx=0 tx=0).stop 2024-09-21T03:22:02.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.054+0000 7f90ad7d3740 1 -- 172.21.15.105:0/3840805634 shutdown_connections 2024-09-21T03:22:02.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.054+0000 7f90ad7d3740 1 --2- 172.21.15.105:0/3840805634 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x565349c77590 0x56534a0873e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:02.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.054+0000 7f90ad7d3740 1 --2- 172.21.15.105:0/3840805634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565349c6f3b0 0x56534a06a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:02.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.054+0000 7f90ad7d3740 1 --2- 172.21.15.105:0/3840805634 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565349c98270 0x56534a069fa0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:02.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.054+0000 7f90ad7d3740 1 -- 172.21.15.105:0/3840805634 >> 172.21.15.105:0/3840805634 conn(0x565349c8c3c0 msgr2=0x56534a040260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:02.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.054+0000 7f90ad7d3740 1 -- 172.21.15.105:0/3840805634 shutdown_connections 2024-09-21T03:22:02.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.054+0000 7f90ad7d3740 1 -- 172.21.15.105:0/3840805634 wait complete. 2024-09-21T03:22:02.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.055+0000 7f90ad7d3740 1 -- start start 2024-09-21T03:22:02.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.055+0000 7f90ad7d3740 1 Processor -- start 2024-09-21T03:22:02.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.057+0000 7f90ad7d3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565349c6f3b0 0x56534a07f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:02.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.057+0000 7f90ad7d3740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x565349c77590 0x56534a07feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:02.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.057+0000 7f90ad7d3740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565349c98270 0x56534a0587c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:02.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.057+0000 7f90ad7d3740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x565349d12620 con 0x565349c98270 2024-09-21T03:22:02.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.057+0000 7f90ad7d3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x565349f475f0 con 0x565349c6f3b0 2024-09-21T03:22:02.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.057+0000 7f90ad7d3740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x565349fb2820 con 0x565349c77590 2024-09-21T03:22:02.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.057+0000 7f90ad7d3740 10 client.0 _ll_register_callbacks cb 0x565349f4b0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:22:02.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.057+0000 7f90a4d26640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565349c98270 0x56534a0587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:02.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.057+0000 7f909ffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565349c6f3b0 0x56534a07f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:02.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.057+0000 7f90a4d26640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565349c98270 0x56534a0587c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56158/0 (socket says 172.21.15.105:56158) 2024-09-21T03:22:02.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.057+0000 7f90a4d26640 1 -- 172.21.15.105:0/1121472425 learned_addr learned my addr 172.21.15.105:0/1121472425 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:22:02.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.057+0000 7f9097fff640 1 --2- 172.21.15.105:0/1121472425 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x565349c77590 0x56534a07feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:02.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.057+0000 7f90a4d26640 1 -- 172.21.15.105:0/1121472425 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x565349c77590 msgr2=0x56534a07feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:22:02.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.057+0000 7f90a4d26640 1 --2- 172.21.15.105:0/1121472425 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x565349c77590 0x56534a07feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:02.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.057+0000 7f90a4d26640 1 -- 172.21.15.105:0/1121472425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565349c6f3b0 msgr2=0x56534a07f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:22:02.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.057+0000 7f90a4d26640 1 --2- 172.21.15.105:0/1121472425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565349c6f3b0 0x56534a07f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:02.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.057+0000 7f90a4d26640 1 -- 172.21.15.105:0/1121472425 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565349d7a6b0 con 0x565349c98270 2024-09-21T03:22:02.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.057+0000 7f90a4d26640 1 --2- 172.21.15.105:0/1121472425 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565349c98270 0x56534a0587c0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f90a00cb830 tx=0x7f90980066e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c14e4dfcf2b3465 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:02.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.057+0000 7f907effd640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-21T03:22:02.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.057+0000 7f907effd640 1 -- 172.21.15.105:0/1121472425 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9098012440 con 0x565349c98270 2024-09-21T03:22:02.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.058+0000 7f907effd640 1 -- 172.21.15.105:0/1121472425 <== mon.0 v2:172.21.15.105:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f909800a8e0 con 0x565349c98270 2024-09-21T03:22:02.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.058+0000 7f90ad7d3740 1 -- 172.21.15.105:0/1121472425 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f909007f8c0 con 0x565349c98270 2024-09-21T03:22:02.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.058+0000 7f907effd640 1 -- 172.21.15.105:0/1121472425 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f9098022050 con 0x565349c98270 2024-09-21T03:22:02.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.058+0000 7f90ad7d3740 10 client.6444 fetch_fsmap learned FSMap version 47 2024-09-21T03:22:02.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.058+0000 7f90ad7d3740 1 -- 172.21.15.105:0/1121472425 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) -- 0x56534a0949c0 con 0x565349c98270 2024-09-21T03:22:02.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.058+0000 7f907effd640 1 -- 172.21.15.105:0/1121472425 <== mon.0 v2:172.21.15.105:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f909007f8c0 con 0x565349c98270 2024-09-21T03:22:02.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.058+0000 7f907effd640 1 -- 172.21.15.105:0/1121472425 <== mon.0 v2:172.21.15.105:3300/0 5 ==== fsmap(e 47) ==== 3502+0+0 (secure 0 0 0) 0x7f9098025020 con 0x565349c98270 2024-09-21T03:22:02.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.058+0000 7f90ad7d3740 10 client.6444 fetch_fsmap finished waiting for FSMap version 47 2024-09-21T03:22:02.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.058+0000 7f90ad7d3740 10 client.6444 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T03:22:02.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.058+0000 7f90ad7d3740 20 client.6444 populate_metadata read hostname 'smithi105' 2024-09-21T03:22:02.065 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.058+0000 7f90ad7d3740 1 --2- 172.21.15.105:0/1121472425 >> [v2:172.21.15.105:6833/2722940718,v1:172.21.15.105:6835/2722940718] conn(0x565349c56e40 0x56534a07bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:02.065 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.058+0000 7f90ad7d3740 4 client.6444 mds_command: new command op to 6288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:22:02.065 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.058+0000 7f90ad7d3740 1 -- 172.21.15.105:0/1121472425 --> [v2:172.21.15.105:6833/2722940718,v1:172.21.15.105:6835/2722940718] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565349fb4770 con 0x565349c56e40 2024-09-21T03:22:02.065 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.058+0000 7f909ffff640 1 --2- 172.21.15.105:0/1121472425 >> [v2:172.21.15.105:6833/2722940718,v1:172.21.15.105:6835/2722940718] conn(0x565349c56e40 0x56534a07bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:02.065 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.058+0000 7f907effd640 10 client.6444 ms_handle_connect on v2:172.21.15.105:6833/2722940718 2024-09-21T03:22:02.065 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.059+0000 7f909ffff640 1 --2- 172.21.15.105:0/1121472425 >> [v2:172.21.15.105:6833/2722940718,v1:172.21.15.105:6835/2722940718] conn(0x565349c56e40 0x56534a07bc10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84f967b5902c2ee8 server_cookie=9146c385b48435a6 in_seq=0 out_seq=0 2024-09-21T03:22:02.065 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.059+0000 7f907effd640 1 -- 172.21.15.105:0/1121472425 <== mds.0 v2:172.21.15.105:6833/2722940718 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x565349fb4770 con 0x565349c56e40 2024-09-21T03:22:02.065 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.059+0000 7f907effd640 10 client.6444 handle_command_reply: tid=0 2024-09-21T03:22:02.065 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.059+0000 7f90ad7d3740 1 client.6444 shutdown 2024-09-21T03:22:02.065 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.059+0000 7f90ad7d3740 1 -- 172.21.15.105:0/1121472425 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565349c98270 msgr2=0x56534a0587c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:02.065 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.059+0000 7f90ad7d3740 1 --2- 172.21.15.105:0/1121472425 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565349c98270 0x56534a0587c0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f90a00cb830 tx=0x7f90980066e0 comp rx=0 tx=0).stop 2024-09-21T03:22:02.065 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.059+0000 7f90ad7d3740 1 -- 172.21.15.105:0/1121472425 shutdown_connections 2024-09-21T03:22:02.065 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.059+0000 7f90ad7d3740 1 --2- 172.21.15.105:0/1121472425 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565349c98270 0x56534a0587c0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:02.065 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.059+0000 7f90ad7d3740 1 --2- 172.21.15.105:0/1121472425 >> [v2:172.21.15.105:6833/2722940718,v1:172.21.15.105:6835/2722940718] conn(0x565349c56e40 0x56534a07bc10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:02.066 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.059+0000 7f90ad7d3740 1 --2- 172.21.15.105:0/1121472425 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x565349c77590 0x56534a07feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:02.066 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.059+0000 7f90ad7d3740 1 --2- 172.21.15.105:0/1121472425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565349c6f3b0 0x56534a07f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:02.066 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.059+0000 7f90ad7d3740 1 -- 172.21.15.105:0/1121472425 >> 172.21.15.105:0/1121472425 conn(0x565349c8c3c0 msgr2=0x56534a03ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:02.066 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.059+0000 7f907effd640 0 client.6444 ms_handle_reset on v2:172.21.15.105:6833/2722940718 2024-09-21T03:22:02.066 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.060+0000 7f90ad7d3740 1 -- 172.21.15.105:0/1121472425 shutdown_connections 2024-09-21T03:22:02.066 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.060+0000 7f90ad7d3740 1 -- 172.21.15.105:0/1121472425 wait complete. 2024-09-21T03:22:02.066 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.060+0000 7f90ad7d3740 20 client.6444 trim_cache size 0 max 16384 2024-09-21T03:22:02.079 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.078+0000 7f90ad7d3740 1 Processor -- start 2024-09-21T03:22:02.079 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.078+0000 7f90ad7d3740 1 -- start start 2024-09-21T03:22:02.082 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.079+0000 7f90ad7d3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565349c6f3b0 0x56534a03bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:02.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.079+0000 7f90ad7d3740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x565349c77590 0x56534a0670c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:02.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.079+0000 7f90ad7d3740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565349c98270 0x56534a07cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:02.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.079+0000 7f90ad7d3740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f90a00b5370 con 0x565349c98270 2024-09-21T03:22:02.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.079+0000 7f90ad7d3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f90a01f55a0 con 0x565349c6f3b0 2024-09-21T03:22:02.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.079+0000 7f90ad7d3740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f90a00b4d20 con 0x565349c77590 2024-09-21T03:22:02.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.079+0000 7f90a4d26640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565349c98270 0x56534a07cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:02.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.079+0000 7f90a4d26640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565349c98270 0x56534a07cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56160/0 (socket says 172.21.15.105:56160) 2024-09-21T03:22:02.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.079+0000 7f90a4d26640 1 -- 172.21.15.105:0/1531825208 learned_addr learned my addr 172.21.15.105:0/1531825208 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:22:02.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.079+0000 7f9097fff640 1 --2- 172.21.15.105:0/1531825208 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x565349c77590 0x56534a0670c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:02.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.079+0000 7f909ffff640 1 --2- 172.21.15.105:0/1531825208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565349c6f3b0 0x56534a03bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:02.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.079+0000 7f90a4d26640 1 -- 172.21.15.105:0/1531825208 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x565349c77590 msgr2=0x56534a0670c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:22:02.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.080+0000 7f90a4d26640 1 --2- 172.21.15.105:0/1531825208 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x565349c77590 0x56534a0670c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:02.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.080+0000 7f90a4d26640 1 -- 172.21.15.105:0/1531825208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565349c6f3b0 msgr2=0x56534a03bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:22:02.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.080+0000 7f90a4d26640 1 --2- 172.21.15.105:0/1531825208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565349c6f3b0 0x56534a03bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:02.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.080+0000 7f90a4d26640 1 -- 172.21.15.105:0/1531825208 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56534a03bc70 con 0x565349c98270 2024-09-21T03:22:02.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.080+0000 7f909ffff640 1 --2- 172.21.15.105:0/1531825208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565349c6f3b0 0x56534a03bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:22:02.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.080+0000 7f90a4d26640 1 --2- 172.21.15.105:0/1531825208 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565349c98270 0x56534a07cdd0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f9098003de0 tx=0x7f9098003e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cbe7a8f47c73b1e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:02.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.080+0000 7f90957fa640 1 -- 172.21.15.105:0/1531825208 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909800a2b0 con 0x565349c98270 2024-09-21T03:22:02.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.080+0000 7f90957fa640 1 -- 172.21.15.105:0/1531825208 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f909800a540 con 0x565349c98270 2024-09-21T03:22:02.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.080+0000 7f90957fa640 1 -- 172.21.15.105:0/1531825208 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909800a990 con 0x565349c98270 2024-09-21T03:22:02.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.081+0000 7f90ad7d3740 1 -- 172.21.15.105:0/1531825208 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565349c98270 msgr2=0x56534a07cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:02.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.081+0000 7f90ad7d3740 1 --2- 172.21.15.105:0/1531825208 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565349c98270 0x56534a07cdd0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f9098003de0 tx=0x7f9098003e10 comp rx=0 tx=0).stop 2024-09-21T03:22:02.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.081+0000 7f90ad7d3740 1 -- 172.21.15.105:0/1531825208 shutdown_connections 2024-09-21T03:22:02.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.081+0000 7f90ad7d3740 1 --2- 172.21.15.105:0/1531825208 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565349c98270 0x56534a07cdd0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:02.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.081+0000 7f90ad7d3740 1 --2- 172.21.15.105:0/1531825208 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x565349c77590 0x56534a0670c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:02.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.081+0000 7f90ad7d3740 1 --2- 172.21.15.105:0/1531825208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565349c6f3b0 0x56534a03bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:02.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.081+0000 7f90ad7d3740 1 -- 172.21.15.105:0/1531825208 >> 172.21.15.105:0/1531825208 conn(0x565349c8c3c0 msgr2=0x56534a0583a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:02.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.081+0000 7f90ad7d3740 1 -- 172.21.15.105:0/1531825208 shutdown_connections 2024-09-21T03:22:02.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.081+0000 7f90ad7d3740 1 -- 172.21.15.105:0/1531825208 wait complete. 2024-09-21T03:22:02.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.081+0000 7f90ad7d3740 1 -- start start 2024-09-21T03:22:02.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.082+0000 7f90ad7d3740 1 Processor -- start 2024-09-21T03:22:02.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.083+0000 7f90ad7d3740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565349c6f3b0 0x56534a1085c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:02.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.083+0000 7f90ad7d3740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x565349c77590 0x56534a07d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:02.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.083+0000 7f90ad7d3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565349c98270 0x56534a09d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:02.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.083+0000 7f90ad7d3740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x56534a094260 con 0x565349c6f3b0 2024-09-21T03:22:02.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.083+0000 7f90ad7d3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56534a07ef20 con 0x565349c98270 2024-09-21T03:22:02.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.083+0000 7f90ad7d3740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56534a059dd0 con 0x565349c77590 2024-09-21T03:22:02.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.083+0000 7f90ad7d3740 10 client.0 _ll_register_callbacks cb 0x7f9098006f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:22:02.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.083+0000 7f909ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565349c6f3b0 0x56534a1085c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:02.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.083+0000 7f909ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565349c6f3b0 0x56534a1085c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56174/0 (socket says 172.21.15.105:56174) 2024-09-21T03:22:02.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.083+0000 7f909ffff640 1 -- 172.21.15.105:0/555853125 learned_addr learned my addr 172.21.15.105:0/555853125 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:22:02.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.083+0000 7f9097fff640 1 --2- 172.21.15.105:0/555853125 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x565349c77590 0x56534a07d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:02.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.083+0000 7f90a4d26640 1 --2- 172.21.15.105:0/555853125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565349c98270 0x56534a09d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:02.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.083+0000 7f909ffff640 1 -- 172.21.15.105:0/555853125 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x565349c77590 msgr2=0x56534a07d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:22:02.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.083+0000 7f909ffff640 1 --2- 172.21.15.105:0/555853125 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x565349c77590 0x56534a07d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:02.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.083+0000 7f909ffff640 1 -- 172.21.15.105:0/555853125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565349c98270 msgr2=0x56534a09d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:22:02.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.083+0000 7f909ffff640 1 --2- 172.21.15.105:0/555853125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565349c98270 0x56534a09d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:02.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.083+0000 7f909ffff640 1 -- 172.21.15.105:0/555853125 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56534a0810d0 con 0x565349c6f3b0 2024-09-21T03:22:02.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.084+0000 7f909ffff640 1 --2- 172.21.15.105:0/555853125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565349c6f3b0 0x56534a1085c0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f90900808c0 tx=0x7f9090009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ca0402fa72c316d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:02.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.084+0000 7f907effd640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-21T03:22:02.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.084+0000 7f907effd640 1 -- 172.21.15.105:0/555853125 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9090083ab0 con 0x565349c6f3b0 2024-09-21T03:22:02.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.084+0000 7f907effd640 1 -- 172.21.15.105:0/555853125 <== mon.0 v2:172.21.15.105:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f909008ca10 con 0x565349c6f3b0 2024-09-21T03:22:02.091 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.084+0000 7f90ad7d3740 1 -- 172.21.15.105:0/555853125 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f909800a540 con 0x565349c6f3b0 2024-09-21T03:22:02.091 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.084+0000 7f907effd640 1 -- 172.21.15.105:0/555853125 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f909007f8c0 con 0x565349c6f3b0 2024-09-21T03:22:02.091 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.084+0000 7f90ad7d3740 10 client.6450 fetch_fsmap learned FSMap version 47 2024-09-21T03:22:02.091 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.084+0000 7f90ad7d3740 1 -- 172.21.15.105:0/555853125 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) -- 0x56534a085690 con 0x565349c6f3b0 2024-09-21T03:22:02.091 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.084+0000 7f907effd640 1 -- 172.21.15.105:0/555853125 <== mon.0 v2:172.21.15.105:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f909800a540 con 0x565349c6f3b0 2024-09-21T03:22:02.091 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.084+0000 7f907effd640 1 -- 172.21.15.105:0/555853125 <== mon.0 v2:172.21.15.105:3300/0 5 ==== fsmap(e 47) ==== 3502+0+0 (secure 0 0 0) 0x7f909003b030 con 0x565349c6f3b0 2024-09-21T03:22:02.091 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.084+0000 7f90ad7d3740 10 client.6450 fetch_fsmap finished waiting for FSMap version 47 2024-09-21T03:22:02.091 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.084+0000 7f90ad7d3740 10 client.6450 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T03:22:02.091 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.084+0000 7f90ad7d3740 20 client.6450 populate_metadata read hostname 'smithi105' 2024-09-21T03:22:02.091 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.084+0000 7f90ad7d3740 1 --2- 172.21.15.105:0/555853125 >> [v2:172.21.15.105:6833/2722940718,v1:172.21.15.105:6835/2722940718] conn(0x56534a10c140 0x56534a10c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:02.091 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.084+0000 7f90ad7d3740 4 client.6450 mds_command: new command op to 6288 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T03:22:02.091 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.084+0000 7f90ad7d3740 1 -- 172.21.15.105:0/555853125 --> [v2:172.21.15.105:6833/2722940718,v1:172.21.15.105:6835/2722940718] -- command(tid 0: {"prefix": "status"}) -- 0x565349fb0220 con 0x56534a10c140 2024-09-21T03:22:02.091 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.084+0000 7f9097fff640 1 --2- 172.21.15.105:0/555853125 >> [v2:172.21.15.105:6833/2722940718,v1:172.21.15.105:6835/2722940718] conn(0x56534a10c140 0x56534a10c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:02.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.085+0000 7f907effd640 10 client.6450 ms_handle_connect on v2:172.21.15.105:6833/2722940718 2024-09-21T03:22:02.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.085+0000 7f9097fff640 1 --2- 172.21.15.105:0/555853125 >> [v2:172.21.15.105:6833/2722940718,v1:172.21.15.105:6835/2722940718] conn(0x56534a10c140 0x56534a10c550 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4796d852e2873f0 server_cookie=8510551d5248c56a in_seq=0 out_seq=0 2024-09-21T03:22:02.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.085+0000 7f907effd640 1 -- 172.21.15.105:0/555853125 <== mds.0 v2:172.21.15.105:6833/2722940718 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x565349fb0220 con 0x56534a10c140 2024-09-21T03:22:02.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.085+0000 7f907effd640 10 client.6450 handle_command_reply: tid=0 2024-09-21T03:22:02.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.085+0000 7f90ad7d3740 1 client.6450 shutdown 2024-09-21T03:22:02.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.085+0000 7f90ad7d3740 1 -- 172.21.15.105:0/555853125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565349c6f3b0 msgr2=0x56534a1085c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:02.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.085+0000 7f90ad7d3740 1 --2- 172.21.15.105:0/555853125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565349c6f3b0 0x56534a1085c0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f90900808c0 tx=0x7f9090009850 comp rx=0 tx=0).stop 2024-09-21T03:22:02.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.085+0000 7f90ad7d3740 1 -- 172.21.15.105:0/555853125 shutdown_connections 2024-09-21T03:22:02.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.085+0000 7f90ad7d3740 1 --2- 172.21.15.105:0/555853125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565349c98270 0x56534a09d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:02.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.085+0000 7f90ad7d3740 1 --2- 172.21.15.105:0/555853125 >> [v2:172.21.15.105:6833/2722940718,v1:172.21.15.105:6835/2722940718] conn(0x56534a10c140 0x56534a10c550 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:02.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.085+0000 7f90ad7d3740 1 --2- 172.21.15.105:0/555853125 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x565349c77590 0x56534a07d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:02.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.085+0000 7f90ad7d3740 1 --2- 172.21.15.105:0/555853125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x565349c6f3b0 0x56534a1085c0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:02.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.085+0000 7f90ad7d3740 1 -- 172.21.15.105:0/555853125 >> 172.21.15.105:0/555853125 conn(0x565349c8c3c0 msgr2=0x56534a03a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:02.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.085+0000 7f907effd640 0 client.6450 ms_handle_reset on v2:172.21.15.105:6833/2722940718 2024-09-21T03:22:02.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.085+0000 7f90ad7d3740 1 -- 172.21.15.105:0/555853125 shutdown_connections 2024-09-21T03:22:02.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.085+0000 7f90ad7d3740 1 -- 172.21.15.105:0/555853125 wait complete. 2024-09-21T03:22:02.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.085+0000 7f90ad7d3740 20 client.6450 trim_cache size 0 max 16384 2024-09-21T03:22:02.093 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-21T03:22:02.093 INFO:teuthology.orchestra.run.smithi105.stdout: "cluster_fsid": "29d80f4f-e5de-4b26-8384-24c2d8019945", 2024-09-21T03:22:02.093 INFO:teuthology.orchestra.run.smithi105.stdout: "whoami": 0, 2024-09-21T03:22:02.093 INFO:teuthology.orchestra.run.smithi105.stdout: "id": 6288, 2024-09-21T03:22:02.093 INFO:teuthology.orchestra.run.smithi105.stdout: "want_state": "up:active", 2024-09-21T03:22:02.093 INFO:teuthology.orchestra.run.smithi105.stdout: "state": "up:active", 2024-09-21T03:22:02.093 INFO:teuthology.orchestra.run.smithi105.stdout: "fs_name": "cephfs", 2024-09-21T03:22:02.094 INFO:teuthology.orchestra.run.smithi105.stdout: "rank_uptime": 10.196685227, 2024-09-21T03:22:02.094 INFO:teuthology.orchestra.run.smithi105.stdout: "mdsmap_epoch": 47, 2024-09-21T03:22:02.094 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_epoch": 80, 2024-09-21T03:22:02.094 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_epoch_barrier": 80, 2024-09-21T03:22:02.094 INFO:teuthology.orchestra.run.smithi105.stdout: "uptime": 14.895626074999999 2024-09-21T03:22:02.094 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-21T03:22:02.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.086+0000 7f90a6789640 1 -- 172.21.15.105:0/1396509020 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9080078bc0 msgr2=0x7f908007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:02.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.086+0000 7f90a6789640 1 --2- 172.21.15.105:0/1396509020 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9080078bc0 0x7f908007b0d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9088001050 tx=0x7f90880011e0 comp rx=0 tx=0).stop 2024-09-21T03:22:02.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.086+0000 7f90a6789640 1 -- 172.21.15.105:0/1396509020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f908c003c10 msgr2=0x7f90a01f1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:02.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.086+0000 7f90a6789640 1 --2- 172.21.15.105:0/1396509020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f908c003c10 0x7f90a01f1260 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f9090036040 tx=0x7f9090033670 comp rx=0 tx=0).stop 2024-09-21T03:22:02.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.086+0000 7f90a6789640 1 -- 172.21.15.105:0/1396509020 shutdown_connections 2024-09-21T03:22:02.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.086+0000 7f90a6789640 1 --2- 172.21.15.105:0/1396509020 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9080078bc0 0x7f908007b0d0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:02.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.086+0000 7f90a6789640 1 --2- 172.21.15.105:0/1396509020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90a0159260 0x7f90a0159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:02.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.086+0000 7f90a6789640 1 --2- 172.21.15.105:0/1396509020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90a015a010 0x7f90a009cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:02.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.086+0000 7f90a6789640 1 --2- 172.21.15.105:0/1396509020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f908c003c10 0x7f90a01f1260 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:02.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.086+0000 7f90a6789640 1 -- 172.21.15.105:0/1396509020 >> 172.21.15.105:0/1396509020 conn(0x7f90a00cdcb0 msgr2=0x7f90a0073d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:02.096 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.086+0000 7f90a6789640 1 -- 172.21.15.105:0/1396509020 shutdown_connections 2024-09-21T03:22:02.096 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.086+0000 7f90a6789640 1 -- 172.21.15.105:0/1396509020 wait complete. 2024-09-21T03:22:02.099 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T03:22:02.211 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.209+0000 7f0e24a8b640 1 -- 172.21.15.105:0/982603350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e0c004d40 msgr2=0x7f0e0c005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:02.211 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.209+0000 7f0e24a8b640 1 --2- 172.21.15.105:0/982603350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e0c004d40 0x7f0e0c005150 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f0e1800c260 tx=0x7f0e0c005830 comp rx=0 tx=0).stop 2024-09-21T03:22:02.211 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.209+0000 7f0e1ed9d640 1 -- 172.21.15.105:0/982603350 reap_dead start 2024-09-21T03:22:02.212 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.209+0000 7f0e24a8b640 1 -- 172.21.15.105:0/982603350 shutdown_connections 2024-09-21T03:22:02.212 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.209+0000 7f0e24a8b640 1 -- 172.21.15.105:0/982603350 >> 172.21.15.105:0/982603350 conn(0x7f0e200cdcb0 msgr2=0x7f0e200ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:02.212 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.209+0000 7f0e24a8b640 1 -- 172.21.15.105:0/982603350 shutdown_connections 2024-09-21T03:22:02.212 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.209+0000 7f0e24a8b640 1 -- 172.21.15.105:0/982603350 wait complete. 2024-09-21T03:22:02.213 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.211+0000 7f0e24a8b640 1 Processor -- start 2024-09-21T03:22:02.213 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.211+0000 7f0e24a8b640 1 -- start start 2024-09-21T03:22:02.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.213+0000 7f0e24a8b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e0c004d40 0x7f0e201f2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:02.216 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.213+0000 7f0e24a8b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e201f6560 0x7f0e200b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:02.216 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.213+0000 7f0e24a8b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e200d0250 0x7f0e200d0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:02.216 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.213+0000 7f0e24a8b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2006d320 con 0x7f0e200d0250 2024-09-21T03:22:02.216 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.213+0000 7f0e24a8b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0e200715c0 con 0x7f0e201f6560 2024-09-21T03:22:02.216 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.213+0000 7f0e24a8b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0e2006d4a0 con 0x7f0e0c004d40 2024-09-21T03:22:02.216 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.213+0000 7f0e1ed9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e200d0250 0x7f0e200d0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:02.216 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.213+0000 7f0e1ed9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e200d0250 0x7f0e200d0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56182/0 (socket says 172.21.15.105:56182) 2024-09-21T03:22:02.216 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.213+0000 7f0e1ed9d640 1 -- 172.21.15.105:0/618892968 learned_addr learned my addr 172.21.15.105:0/618892968 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:22:02.216 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.213+0000 7f0e1e59c640 1 --2- 172.21.15.105:0/618892968 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e0c004d40 0x7f0e201f2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:02.216 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.213+0000 7f0e1dd9b640 1 --2- 172.21.15.105:0/618892968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e201f6560 0x7f0e200b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:02.216 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.213+0000 7f0e1ed9d640 1 -- 172.21.15.105:0/618892968 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e0c004d40 msgr2=0x7f0e201f2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:02.216 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.213+0000 7f0e1ed9d640 1 --2- 172.21.15.105:0/618892968 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e0c004d40 0x7f0e201f2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:02.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.213+0000 7f0e1ed9d640 1 -- 172.21.15.105:0/618892968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e201f6560 msgr2=0x7f0e200b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:02.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.213+0000 7f0e1ed9d640 1 --2- 172.21.15.105:0/618892968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e201f6560 0x7f0e200b2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:02.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.213+0000 7f0e1ed9d640 1 -- 172.21.15.105:0/618892968 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e200d0ba0 con 0x7f0e200d0250 2024-09-21T03:22:02.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.213+0000 7f0e1ed9d640 1 --2- 172.21.15.105:0/618892968 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e200d0250 0x7f0e200d0660 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f0e1802b0f0 tx=0x7f0e18036c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:02.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.213+0000 7f0e16ffd640 1 -- 172.21.15.105:0/618892968 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e18031050 con 0x7f0e200d0250 2024-09-21T03:22:02.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.214+0000 7f0e16ffd640 1 -- 172.21.15.105:0/618892968 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e180014f0 con 0x7f0e200d0250 2024-09-21T03:22:02.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.214+0000 7f0e24a8b640 1 -- 172.21.15.105:0/618892968 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e201f3830 con 0x7f0e200d0250 2024-09-21T03:22:02.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.214+0000 7f0e16ffd640 1 -- 172.21.15.105:0/618892968 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e18006c30 con 0x7f0e200d0250 2024-09-21T03:22:02.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.214+0000 7f0e24a8b640 1 -- 172.21.15.105:0/618892968 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e201f3df0 con 0x7f0e200d0250 2024-09-21T03:22:02.218 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.215+0000 7f0e24a8b640 1 -- 172.21.15.105:0/618892968 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e2006cde0 con 0x7f0e200d0250 2024-09-21T03:22:02.218 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.215+0000 7f0e16ffd640 1 -- 172.21.15.105:0/618892968 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0e18036d10 con 0x7f0e200d0250 2024-09-21T03:22:02.218 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.216+0000 7f0e16ffd640 1 --2- 172.21.15.105:0/618892968 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0e00078bc0 0x7f0e0007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:02.218 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.216+0000 7f0e16ffd640 1 -- 172.21.15.105:0/618892968 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f0e180ba910 con 0x7f0e200d0250 2024-09-21T03:22:02.218 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.216+0000 7f0e1e59c640 1 --2- 172.21.15.105:0/618892968 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0e00078bc0 0x7f0e0007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:02.219 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.217+0000 7f0e1e59c640 1 --2- 172.21.15.105:0/618892968 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0e00078bc0 0x7f0e0007b0d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0e10005fd0 tx=0x7f0e10009500 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:02.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.220+0000 7f0e16ffd640 1 -- 172.21.15.105:0/618892968 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0e200d0ba0 con 0x7f0e200d0250 2024-09-21T03:22:02.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.433+0000 7f0e24a8b640 1 -- 172.21.15.105:0/618892968 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0e201f35c0 con 0x7f0e200d0250 2024-09-21T03:22:02.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.433+0000 7f0e16ffd640 1 -- 172.21.15.105:0/618892968 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v47) ==== 53+0+73 (secure 0 0 0) 0x7f0e18082d50 con 0x7f0e200d0250 2024-09-21T03:22:02.435 INFO:teuthology.orchestra.run.smithi105.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T03:22:02.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.435+0000 7f0e24a8b640 1 -- 172.21.15.105:0/618892968 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0e00078bc0 msgr2=0x7f0e0007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:02.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.435+0000 7f0e24a8b640 1 --2- 172.21.15.105:0/618892968 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0e00078bc0 0x7f0e0007b0d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0e10005fd0 tx=0x7f0e10009500 comp rx=0 tx=0).stop 2024-09-21T03:22:02.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.435+0000 7f0e24a8b640 1 -- 172.21.15.105:0/618892968 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e200d0250 msgr2=0x7f0e200d0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:02.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.435+0000 7f0e24a8b640 1 --2- 172.21.15.105:0/618892968 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e200d0250 0x7f0e200d0660 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f0e1802b0f0 tx=0x7f0e18036c20 comp rx=0 tx=0).stop 2024-09-21T03:22:02.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.436+0000 7f0e24a8b640 1 -- 172.21.15.105:0/618892968 shutdown_connections 2024-09-21T03:22:02.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.436+0000 7f0e24a8b640 1 --2- 172.21.15.105:0/618892968 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0e00078bc0 0x7f0e0007b0d0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:02.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.436+0000 7f0e24a8b640 1 --2- 172.21.15.105:0/618892968 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e200d0250 0x7f0e200d0660 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:02.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.436+0000 7f0e24a8b640 1 --2- 172.21.15.105:0/618892968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e201f6560 0x7f0e200b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:02.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.436+0000 7f0e24a8b640 1 --2- 172.21.15.105:0/618892968 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e0c004d40 0x7f0e201f2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:02.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.436+0000 7f0e24a8b640 1 -- 172.21.15.105:0/618892968 >> 172.21.15.105:0/618892968 conn(0x7f0e200cdcb0 msgr2=0x7f0e200adfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:02.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.436+0000 7f0e24a8b640 1 -- 172.21.15.105:0/618892968 shutdown_connections 2024-09-21T03:22:02.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02.436+0000 7f0e24a8b640 1 -- 172.21.15.105:0/618892968 wait complete. 2024-09-21T03:22:02.448 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T03:22:02.449 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T03:22:02.449 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi105.front.sepia.ceph.com 2024-09-21T03:22:02.449 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T03:22:02.449 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T03:22:02.449 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T03:22:02.449 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T03:22:02.449 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T03:22:02.449 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:22:02.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:22:02.449 DEBUG:teuthology.orchestra.run.smithi105:> ip addr 2024-09-21T03:22:02.465 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T03:22:02.465 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T03:22:02.465 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T03:22:02.465 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:22:02.465 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2024-09-21T03:22:02.465 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:22:02.466 INFO:teuthology.orchestra.run.smithi105.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:22:02.466 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b8 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:22:02.466 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f0 2024-09-21T03:22:02.466 INFO:teuthology.orchestra.run.smithi105.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:22:02.466 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b9 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:22:02.466 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f1 2024-09-21T03:22:02.466 INFO:teuthology.orchestra.run.smithi105.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:22:02.466 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:28 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:22:02.466 INFO:teuthology.orchestra.run.smithi105.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T03:22:02.466 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:29 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:22:02.466 INFO:teuthology.orchestra.run.smithi105.stdout: inet 172.21.15.105/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T03:22:02.466 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft 42585sec preferred_lft 42585sec 2024-09-21T03:22:02.466 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::ec4:7aff:fe8f:d429/64 scope link noprefixroute 2024-09-21T03:22:02.467 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:22:02.467 INFO:teuthology.orchestra.run.smithi105.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T03:22:02.467 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 86:15:ed:f2:4e:d8 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:22:02.467 INFO:teuthology.orchestra.run.smithi105.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T03:22:02.467 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:22:02.467 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::80db:6aff:fece:44c2/64 scope link 2024-09-21T03:22:02.467 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:22:02.467 INFO:teuthology.orchestra.run.smithi105.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:22:02.467 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 86:15:ed:f2:4e:d8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T03:22:02.467 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::8415:edff:fef2:4ed8/64 scope link 2024-09-21T03:22:02.467 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:22:02.467 INFO:teuthology.orchestra.run.smithi105.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:22:02.467 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether a2:e9:7c:d4:c7:c7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T03:22:02.467 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::a0e9:7cff:fed4:c7c7/64 scope link 2024-09-21T03:22:02.467 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:22:02.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:22:02.468 DEBUG:teuthology.orchestra.run.smithi105:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T03:22:02.528 INFO:teuthology.orchestra.run.smithi105.stdout:1 2024-09-21T03:22:02.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:22:02.530 DEBUG:teuthology.orchestra.run.smithi105:> route 2024-09-21T03:22:02.586 INFO:teuthology.orchestra.run.smithi105.stdout:Kernel IP routing table 2024-09-21T03:22:02.586 INFO:teuthology.orchestra.run.smithi105.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T03:22:02.587 INFO:teuthology.orchestra.run.smithi105.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T03:22:02.587 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T03:22:02.587 INFO:teuthology.orchestra.run.smithi105.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T03:22:02.587 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:22:02.587 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-21T03:22:02.587 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T03:22:02.587 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T03:22:02.587 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T03:22:02.587 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-21T03:22:02.674 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:22:02.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:22:02.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:22:02.712 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-09-21T03:22:02.727 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T03:22:02.727 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T03:22:02.727 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:22:02.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:22:02.728 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set brx.0 up 2024-09-21T03:22:02.792 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:22:02.792 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T03:22:02.847 INFO:teuthology.orchestra.run.smithi105.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:22:02.847 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:22:02.848 DEBUG:teuthology.orchestra.run.smithi105:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T03:22:02.902 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-21T03:22:02.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:22:02.902 DEBUG:teuthology.orchestra.run.smithi105:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:22:02.996 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:22:02.996 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T03:22:02.996 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2024-09-21T03:22:03.007 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:22:03.007 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T03:22:03.007 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2024-09-21T03:22:03.007 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:22:03.007 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:22:03.013 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:22:03.013 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T03:22:03.013 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2024-09-21T03:22:03.013 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:22:03.013 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:22:03.013 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-21T03:22:03.013 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-21T03:22:03.013 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=29d80f4f-e5de-4b26-8384-24c2d8019945" will pass to kernel 2024-09-21T03:22:03.014 INFO:teuthology.orchestra.run.smithi105.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T03:22:03.014 INFO:teuthology.orchestra.run.smithi105.stdout: You just mounted a file system that supports labels which does not 2024-09-21T03:22:03.014 INFO:teuthology.orchestra.run.smithi105.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T03:22:03.014 INFO:teuthology.orchestra.run.smithi105.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T03:22:03.014 INFO:teuthology.orchestra.run.smithi105.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T03:22:03.015 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T03:22:03.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:22:03.016 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T03:22:03.040 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:22:03.130 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:22:03.134 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:22:03.140 INFO:teuthology.orchestra.run.smithi105.stdout:client6459 2024-09-21T03:22:03.140 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:22:03.140 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:22:03.157 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T03:22:03.309 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.307+0000 7f929f6a9640 1 -- 172.21.15.105:0/3977502980 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92980d2ed0 msgr2=0x7f92980d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:03.309 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.307+0000 7f929f6a9640 1 --2- 172.21.15.105:0/3977502980 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92980d2ed0 0x7f92980d1a80 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f92980c8020 tx=0x7f929402a540 comp rx=0 tx=0).stop 2024-09-21T03:22:03.309 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.307+0000 7f929f6a9640 1 -- 172.21.15.105:0/3977502980 shutdown_connections 2024-09-21T03:22:03.310 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.307+0000 7f929f6a9640 1 --2- 172.21.15.105:0/3977502980 >> v2:172.21.15.162:3300/0 conn(0x7f92980cf5d0 0x7f92980cf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:03.310 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.307+0000 7f929f6a9640 1 --2- 172.21.15.105:0/3977502980 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92980b9b70 0x7f92980cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:03.310 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.307+0000 7f929f6a9640 1 --2- 172.21.15.105:0/3977502980 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92980d2ed0 0x7f92980d1a80 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:03.310 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.307+0000 7f929f6a9640 1 -- 172.21.15.105:0/3977502980 >> 172.21.15.105:0/3977502980 conn(0x7f929808bfc0 msgr2=0x7f929809d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:03.310 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.307+0000 7f929f6a9640 1 -- 172.21.15.105:0/3977502980 shutdown_connections 2024-09-21T03:22:03.310 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.307+0000 7f929f6a9640 1 -- 172.21.15.105:0/3977502980 wait complete. 2024-09-21T03:22:03.311 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.309+0000 7f929f6a9640 1 Processor -- start 2024-09-21T03:22:03.311 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.309+0000 7f929f6a9640 1 -- start start 2024-09-21T03:22:03.313 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.310+0000 7f929f6a9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92980b9b70 0x7f92980c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:03.313 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.310+0000 7f929f6a9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92980cf5d0 0x7f92980cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:03.313 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.311+0000 7f929f6a9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92980d2ed0 0x7f92980cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:03.313 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.311+0000 7f929f6a9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f92980d4640 con 0x7f92980b9b70 2024-09-21T03:22:03.314 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.311+0000 7f929f6a9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f92980d44c0 con 0x7f92980d2ed0 2024-09-21T03:22:03.314 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.311+0000 7f929f6a9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f92980d47c0 con 0x7f92980cf5d0 2024-09-21T03:22:03.314 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.311+0000 7f929d445640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92980b9b70 0x7f92980c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:03.314 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.311+0000 7f929d445640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92980b9b70 0x7f92980c98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56206/0 (socket says 172.21.15.105:56206) 2024-09-21T03:22:03.314 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.311+0000 7f929d445640 1 -- 172.21.15.105:0/2142966247 learned_addr learned my addr 172.21.15.105:0/2142966247 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:22:03.314 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.311+0000 7f929d445640 1 -- 172.21.15.105:0/2142966247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92980cf5d0 msgr2=0x7f92980cd7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T03:22:03.314 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.311+0000 7f929d445640 1 --2- 172.21.15.105:0/2142966247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92980cf5d0 0x7f92980cd7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:03.314 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.311+0000 7f929d445640 1 -- 172.21.15.105:0/2142966247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92980d2ed0 msgr2=0x7f92980cdd00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T03:22:03.314 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.311+0000 7f929d445640 1 --2- 172.21.15.105:0/2142966247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92980d2ed0 0x7f92980cdd00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:03.314 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.311+0000 7f929d445640 1 -- 172.21.15.105:0/2142966247 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f929809e670 con 0x7f92980b9b70 2024-09-21T03:22:03.314 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.311+0000 7f929d445640 1 --2- 172.21.15.105:0/2142966247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92980b9b70 0x7f92980c98c0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f929402ab30 tx=0x7f9294004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:03.314 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.311+0000 7f928dffb640 1 -- 172.21.15.105:0/2142966247 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9294031b50 con 0x7f92980b9b70 2024-09-21T03:22:03.314 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.311+0000 7f928dffb640 1 -- 172.21.15.105:0/2142966247 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9294031de0 con 0x7f92980b9b70 2024-09-21T03:22:03.315 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.311+0000 7f929f6a9640 1 -- 172.21.15.105:0/2142966247 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f929809e200 con 0x7f92980b9b70 2024-09-21T03:22:03.315 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.311+0000 7f928dffb640 1 -- 172.21.15.105:0/2142966247 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92940052a0 con 0x7f92980b9b70 2024-09-21T03:22:03.315 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.312+0000 7f929f6a9640 1 -- 172.21.15.105:0/2142966247 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92980a0780 con 0x7f92980b9b70 2024-09-21T03:22:03.315 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.312+0000 7f929f6a9640 1 -- 172.21.15.105:0/2142966247 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f929806f790 con 0x7f92980b9b70 2024-09-21T03:22:03.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.313+0000 7f928dffb640 1 -- 172.21.15.105:0/2142966247 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9294005440 con 0x7f92980b9b70 2024-09-21T03:22:03.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.314+0000 7f928dffb640 1 --2- 172.21.15.105:0/2142966247 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f927c078bc0 0x7f927c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:03.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.314+0000 7f928dffb640 1 -- 172.21.15.105:0/2142966247 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f92940bc1f0 con 0x7f92980b9b70 2024-09-21T03:22:03.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.314+0000 7f929cc44640 1 --2- 172.21.15.105:0/2142966247 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f927c078bc0 0x7f927c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:03.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.315+0000 7f929cc44640 1 --2- 172.21.15.105:0/2142966247 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f927c078bc0 0x7f927c07b0d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f929806f590 tx=0x7f9288005b60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:03.320 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.318+0000 7f928dffb640 1 -- 172.21.15.105:0/2142966247 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f929806f790 con 0x7f92980b9b70 2024-09-21T03:22:03.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.533+0000 7f929f6a9640 1 -- 172.21.15.105:0/2142966247 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f92980cf9e0 con 0x7f92980b9b70 2024-09-21T03:22:03.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.534+0000 7f928dffb640 1 -- 172.21.15.105:0/2142966247 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v47) ==== 53+0+73 (secure 0 0 0) 0x7f929809e670 con 0x7f92980b9b70 2024-09-21T03:22:03.536 INFO:teuthology.orchestra.run.smithi105.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T03:22:03.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.536+0000 7f929f6a9640 1 -- 172.21.15.105:0/2142966247 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f927c078bc0 msgr2=0x7f927c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:03.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.536+0000 7f929f6a9640 1 --2- 172.21.15.105:0/2142966247 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f927c078bc0 0x7f927c07b0d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f929806f590 tx=0x7f9288005b60 comp rx=0 tx=0).stop 2024-09-21T03:22:03.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.536+0000 7f929f6a9640 1 -- 172.21.15.105:0/2142966247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92980b9b70 msgr2=0x7f92980c98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:03.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.536+0000 7f929f6a9640 1 --2- 172.21.15.105:0/2142966247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92980b9b70 0x7f92980c98c0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f929402ab30 tx=0x7f9294004ac0 comp rx=0 tx=0).stop 2024-09-21T03:22:03.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.536+0000 7f929f6a9640 1 -- 172.21.15.105:0/2142966247 shutdown_connections 2024-09-21T03:22:03.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.536+0000 7f929f6a9640 1 --2- 172.21.15.105:0/2142966247 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f927c078bc0 0x7f927c07b0d0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:03.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.536+0000 7f929f6a9640 1 --2- 172.21.15.105:0/2142966247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92980d2ed0 0x7f92980cdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:03.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.536+0000 7f929f6a9640 1 --2- 172.21.15.105:0/2142966247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92980cf5d0 0x7f92980cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:03.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.536+0000 7f929f6a9640 1 --2- 172.21.15.105:0/2142966247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92980b9b70 0x7f92980c98c0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:03.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.536+0000 7f929f6a9640 1 -- 172.21.15.105:0/2142966247 >> 172.21.15.105:0/2142966247 conn(0x7f929808bfc0 msgr2=0x7f92980b2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:03.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.536+0000 7f929f6a9640 1 -- 172.21.15.105:0/2142966247 shutdown_connections 2024-09-21T03:22:03.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:03.536+0000 7f929f6a9640 1 -- 172.21.15.105:0/2142966247 wait complete. 2024-09-21T03:22:03.549 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T03:22:03.549 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T03:22:03.549 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2024-09-21T03:22:03.549 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-21T03:22:03.549 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T03:22:03.549 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T03:22:03.549 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T03:22:03.550 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T03:22:03.550 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T03:22:03.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:22:03.550 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2024-09-21T03:22:03.569 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T03:22:03.570 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T03:22:03.570 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T03:22:03.570 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:22:03.570 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-09-21T03:22:03.570 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:22:03.570 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:22:03.570 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:22:03.570 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f0 2024-09-21T03:22:03.570 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:22:03.570 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:22:03.570 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f1 2024-09-21T03:22:03.570 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:22:03.570 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:22:03.571 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T03:22:03.571 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:22:03.571 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T03:22:03.571 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42577sec preferred_lft 42577sec 2024-09-21T03:22:03.571 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::ec4:7aff:fe88:7f41/64 scope link noprefixroute 2024-09-21T03:22:03.571 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:22:03.571 INFO:teuthology.orchestra.run.smithi162.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T03:22:03.571 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 32:ad:10:1b:86:54 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:22:03.571 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T03:22:03.571 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:22:03.571 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::c03a:6bff:febf:f5a9/64 scope link 2024-09-21T03:22:03.571 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:22:03.571 INFO:teuthology.orchestra.run.smithi162.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:22:03.572 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 32:ad:10:1b:86:54 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T03:22:03.572 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::30ad:10ff:fe1b:8654/64 scope link 2024-09-21T03:22:03.572 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:22:03.572 INFO:teuthology.orchestra.run.smithi162.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:22:03.572 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 6a:62:2d:53:ae:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-21T03:22:03.572 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::6862:2dff:fe53:aec0/64 scope link 2024-09-21T03:22:03.572 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:22:03.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:22:03.572 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T03:22:03.637 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-09-21T03:22:03.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:22:03.639 DEBUG:teuthology.orchestra.run.smithi162:> route 2024-09-21T03:22:03.698 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2024-09-21T03:22:03.698 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T03:22:03.698 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T03:22:03.698 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T03:22:03.698 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T03:22:03.698 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:22:03.698 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-09-21T03:22:03.699 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T03:22:03.699 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T03:22:03.699 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T03:22:03.699 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-09-21T03:22:03.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:22:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:22:03.825 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:22:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:22:03.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:22:03.831 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-09-21T03:22:03.846 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-21T03:22:03.846 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-21T03:22:03.847 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T03:22:03.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:22:03.847 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.0 up 2024-09-21T03:22:03.911 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:22:03.912 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-21T03:22:03.967 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-21T03:22:03.967 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:22:03.967 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-21T03:22:04.022 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-21T03:22:04.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:22:04.022 DEBUG:teuthology.orchestra.run.smithi162:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:22:04.116 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:22:04.117 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T03:22:04.117 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-21T03:22:04.127 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:22:04.127 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T03:22:04.127 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-21T03:22:04.127 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:22:04.128 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:22:04.134 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:22:04.134 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T03:22:04.134 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-21T03:22:04.134 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:22:04.134 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:22:04.134 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-21T03:22:04.134 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-21T03:22:04.134 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=29d80f4f-e5de-4b26-8384-24c2d8019945" will pass to kernel 2024-09-21T03:22:04.134 INFO:teuthology.orchestra.run.smithi162.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-21T03:22:04.135 INFO:teuthology.orchestra.run.smithi162.stdout: You just mounted a file system that supports labels which does not 2024-09-21T03:22:04.135 INFO:teuthology.orchestra.run.smithi162.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T03:22:04.135 INFO:teuthology.orchestra.run.smithi162.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T03:22:04.135 INFO:teuthology.orchestra.run.smithi162.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T03:22:04.136 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T03:22:04.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:22:04.137 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-21T03:22:04.161 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:22:04.250 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:22:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:22:04.251 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:22:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:22:04.257 INFO:teuthology.orchestra.run.smithi162.stdout:client5600 2024-09-21T03:22:04.258 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:22:04.258 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:22:04.273 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_cache_memory_limit 1K 2024-09-21T03:22:04.394 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.392+0000 7f4eb524d640 1 -- 172.21.15.105:0/914842312 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4eb00b51c0 msgr2=0x7f4eb015c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:04.394 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.392+0000 7f4eb524d640 1 --2- 172.21.15.105:0/914842312 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4eb00b51c0 0x7f4eb015c6e0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f4eb00cd8d0 tx=0x7f4ea002a530 comp rx=0 tx=0).stop 2024-09-21T03:22:04.394 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.392+0000 7f4eb524d640 1 -- 172.21.15.105:0/914842312 shutdown_connections 2024-09-21T03:22:04.394 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.392+0000 7f4eb524d640 1 --2- 172.21.15.105:0/914842312 >> v2:172.21.15.162:3300/0 conn(0x7f4eb00d1490 0x7f4eb00cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:04.394 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.392+0000 7f4eb524d640 1 --2- 172.21.15.105:0/914842312 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4eb00b51c0 0x7f4eb015c6e0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:04.394 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.392+0000 7f4eb524d640 1 -- 172.21.15.105:0/914842312 >> 172.21.15.105:0/914842312 conn(0x7f4eb0072ae0 msgr2=0x7f4eb0072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:04.395 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.392+0000 7f4eb524d640 1 -- 172.21.15.105:0/914842312 shutdown_connections 2024-09-21T03:22:04.395 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.392+0000 7f4eb524d640 1 -- 172.21.15.105:0/914842312 wait complete. 2024-09-21T03:22:04.396 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.394+0000 7f4eb524d640 1 Processor -- start 2024-09-21T03:22:04.396 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.394+0000 7f4eb524d640 1 -- start start 2024-09-21T03:22:04.398 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.395+0000 7f4eb524d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4eb00b51c0 0x7f4eb00cba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:04.398 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.395+0000 7f4eb524d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4eb00ccbd0 0x7f4eb014a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:04.398 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.395+0000 7f4eb524d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4eb00d1490 0x7f4eb014ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:04.398 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.395+0000 7f4eb524d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb00cf2b0 con 0x7f4eb00d1490 2024-09-21T03:22:04.399 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.395+0000 7f4eb524d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb00cf130 con 0x7f4eb00ccbd0 2024-09-21T03:22:04.399 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.395+0000 7f4eb524d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4eb00cf430 con 0x7f4eb00b51c0 2024-09-21T03:22:04.399 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.396+0000 7f4eaf59e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4eb00d1490 0x7f4eb014ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:04.399 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.396+0000 7f4eaf59e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4eb00d1490 0x7f4eb014ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56220/0 (socket says 172.21.15.105:56220) 2024-09-21T03:22:04.399 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.396+0000 7f4eaf59e640 1 -- 172.21.15.105:0/3017640746 learned_addr learned my addr 172.21.15.105:0/3017640746 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:22:04.399 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.396+0000 7f4eae59c640 1 --2- 172.21.15.105:0/3017640746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4eb00ccbd0 0x7f4eb014a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:04.399 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.396+0000 7f4eaed9d640 1 --2- 172.21.15.105:0/3017640746 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4eb00b51c0 0x7f4eb00cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:04.399 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.396+0000 7f4eaf59e640 1 -- 172.21.15.105:0/3017640746 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4eb00b51c0 msgr2=0x7f4eb00cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:04.399 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.396+0000 7f4eaf59e640 1 --2- 172.21.15.105:0/3017640746 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4eb00b51c0 0x7f4eb00cba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:04.399 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.396+0000 7f4eaf59e640 1 -- 172.21.15.105:0/3017640746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4eb00ccbd0 msgr2=0x7f4eb014a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:04.399 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.396+0000 7f4eaf59e640 1 --2- 172.21.15.105:0/3017640746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4eb00ccbd0 0x7f4eb014a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:04.399 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.396+0000 7f4eaf59e640 1 -- 172.21.15.105:0/3017640746 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eb0158340 con 0x7f4eb00d1490 2024-09-21T03:22:04.399 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.396+0000 7f4eaf59e640 1 --2- 172.21.15.105:0/3017640746 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4eb00d1490 0x7f4eb014ab30 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f4ea800ea80 tx=0x7f4ea800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:04.400 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.396+0000 7f4e977fe640 1 -- 172.21.15.105:0/3017640746 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8004b20 con 0x7f4eb00d1490 2024-09-21T03:22:04.400 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.396+0000 7f4e977fe640 1 -- 172.21.15.105:0/3017640746 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ea8004ce0 con 0x7f4eb00d1490 2024-09-21T03:22:04.400 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.396+0000 7f4e977fe640 1 -- 172.21.15.105:0/3017640746 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8005280 con 0x7f4eb00d1490 2024-09-21T03:22:04.400 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.396+0000 7f4eb524d640 1 -- 172.21.15.105:0/3017640746 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eb0158620 con 0x7f4eb00d1490 2024-09-21T03:22:04.400 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.396+0000 7f4eb524d640 1 -- 172.21.15.105:0/3017640746 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eb0158be0 con 0x7f4eb00d1490 2024-09-21T03:22:04.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.397+0000 7f4eb524d640 1 -- 172.21.15.105:0/3017640746 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4eb00cf900 con 0x7f4eb00d1490 2024-09-21T03:22:04.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.398+0000 7f4e977fe640 1 -- 172.21.15.105:0/3017640746 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4ea8005420 con 0x7f4eb00d1490 2024-09-21T03:22:04.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.399+0000 7f4e977fe640 1 --2- 172.21.15.105:0/3017640746 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4e9c078b90 0x7f4e9c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:04.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.399+0000 7f4e977fe640 1 -- 172.21.15.105:0/3017640746 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f4ea809b780 con 0x7f4eb00d1490 2024-09-21T03:22:04.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.399+0000 7f4eaed9d640 1 --2- 172.21.15.105:0/3017640746 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4e9c078b90 0x7f4e9c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:04.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.399+0000 7f4eaed9d640 1 --2- 172.21.15.105:0/3017640746 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4e9c078b90 0x7f4e9c07b0a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0034000 tx=0x7f4ea0004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:04.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.406+0000 7f4e977fe640 1 -- 172.21.15.105:0/3017640746 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4ea8063690 con 0x7f4eb00d1490 2024-09-21T03:22:04.584 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.582+0000 7f4eb524d640 1 -- 172.21.15.105:0/3017640746 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command([{prefix=config set, name=mds_cache_memory_limit}] v 0) -- 0x7f4eb00b7ba0 con 0x7f4eb00d1490 2024-09-21T03:22:04.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.586+0000 7f4e977fe640 1 -- 172.21.15.105:0/3017640746 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_cache_memory_limit}]=0 v44)=0 v44) ==== 121+0+0 (secure 0 0 0) 0x7f4ea80680c0 con 0x7f4eb00d1490 2024-09-21T03:22:04.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.588+0000 7f4eb524d640 1 -- 172.21.15.105:0/3017640746 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4e9c078b90 msgr2=0x7f4e9c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:04.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.588+0000 7f4eb524d640 1 --2- 172.21.15.105:0/3017640746 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4e9c078b90 0x7f4e9c07b0a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0034000 tx=0x7f4ea0004730 comp rx=0 tx=0).stop 2024-09-21T03:22:04.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.588+0000 7f4eb524d640 1 -- 172.21.15.105:0/3017640746 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4eb00d1490 msgr2=0x7f4eb014ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:04.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.588+0000 7f4eb524d640 1 --2- 172.21.15.105:0/3017640746 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4eb00d1490 0x7f4eb014ab30 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f4ea800ea80 tx=0x7f4ea800ef40 comp rx=0 tx=0).stop 2024-09-21T03:22:04.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.588+0000 7f4eb524d640 1 -- 172.21.15.105:0/3017640746 shutdown_connections 2024-09-21T03:22:04.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.588+0000 7f4eb524d640 1 --2- 172.21.15.105:0/3017640746 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4e9c078b90 0x7f4e9c07b0a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:04.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.588+0000 7f4eb524d640 1 --2- 172.21.15.105:0/3017640746 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4eb00d1490 0x7f4eb014ab30 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:04.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.588+0000 7f4eb524d640 1 --2- 172.21.15.105:0/3017640746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4eb00ccbd0 0x7f4eb014a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:04.591 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.588+0000 7f4eb524d640 1 --2- 172.21.15.105:0/3017640746 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4eb00b51c0 0x7f4eb00cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:04.591 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.588+0000 7f4eb524d640 1 -- 172.21.15.105:0/3017640746 >> 172.21.15.105:0/3017640746 conn(0x7f4eb0072ae0 msgr2=0x7f4eb00b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:04.591 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.588+0000 7f4eb524d640 1 -- 172.21.15.105:0/3017640746 shutdown_connections 2024-09-21T03:22:04.591 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.588+0000 7f4eb524d640 1 -- 172.21.15.105:0/3017640746 wait complete. 2024-09-21T03:22:04.601 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_recall_max_caps 200 2024-09-21T03:22:04.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.715+0000 7fcabdc0a640 1 -- 172.21.15.105:0/986943913 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcab815f9b0 msgr2=0x7fcab8166420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:04.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.715+0000 7fcabdc0a640 1 --2- 172.21.15.105:0/986943913 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcab815f9b0 0x7fcab8166420 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fcab0005fd0 tx=0x7fcab002a9a0 comp rx=0 tx=0).stop 2024-09-21T03:22:04.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.715+0000 7fcabdc0a640 1 -- 172.21.15.105:0/986943913 shutdown_connections 2024-09-21T03:22:04.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.715+0000 7fcabdc0a640 1 --2- 172.21.15.105:0/986943913 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcab815f9b0 0x7fcab8166420 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:04.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.715+0000 7fcabdc0a640 1 -- 172.21.15.105:0/986943913 >> 172.21.15.105:0/986943913 conn(0x7fcab80cd530 msgr2=0x7fcab80cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:04.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.715+0000 7fcabdc0a640 1 -- 172.21.15.105:0/986943913 shutdown_connections 2024-09-21T03:22:04.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.715+0000 7fcabdc0a640 1 -- 172.21.15.105:0/986943913 wait complete. 2024-09-21T03:22:04.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.717+0000 7fcabdc0a640 1 Processor -- start 2024-09-21T03:22:04.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.717+0000 7fcabdc0a640 1 -- start start 2024-09-21T03:22:04.721 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.718+0000 7fcabdc0a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcab8070e40 0x7fcab81f5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:04.721 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.718+0000 7fcabdc0a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcab8075fa0 0x7fcab80b4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:04.721 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.718+0000 7fcabdc0a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcab814f460 0x7fcab815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:04.721 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.718+0000 7fcabdc0a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcab8166ae0 con 0x7fcab814f460 2024-09-21T03:22:04.721 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.718+0000 7fcabdc0a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcab8166960 con 0x7fcab8070e40 2024-09-21T03:22:04.721 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.718+0000 7fcabdc0a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcab8166c60 con 0x7fcab8075fa0 2024-09-21T03:22:04.721 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.718+0000 7fcab7fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcab814f460 0x7fcab815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:04.721 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.718+0000 7fcab7fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcab814f460 0x7fcab815a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56234/0 (socket says 172.21.15.105:56234) 2024-09-21T03:22:04.721 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.718+0000 7fcab7fff640 1 -- 172.21.15.105:0/126987800 learned_addr learned my addr 172.21.15.105:0/126987800 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:22:04.721 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.718+0000 7fcab7fff640 1 -- 172.21.15.105:0/126987800 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcab8075fa0 msgr2=0x7fcab80b4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:04.721 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.718+0000 7fcab7fff640 1 --2- 172.21.15.105:0/126987800 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcab8075fa0 0x7fcab80b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:04.721 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.718+0000 7fcab7fff640 1 -- 172.21.15.105:0/126987800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcab8070e40 msgr2=0x7fcab81f5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:04.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.718+0000 7fcab7fff640 1 --2- 172.21.15.105:0/126987800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcab8070e40 0x7fcab81f5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:04.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.718+0000 7fcab7fff640 1 -- 172.21.15.105:0/126987800 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcab81f6620 con 0x7fcab814f460 2024-09-21T03:22:04.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.719+0000 7fcab7fff640 1 --2- 172.21.15.105:0/126987800 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcab814f460 0x7fcab815a6f0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fcab0033040 tx=0x7fcab0030e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:04.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.719+0000 7fca9ffff640 1 -- 172.21.15.105:0/126987800 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab0004040 con 0x7fcab814f460 2024-09-21T03:22:04.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.719+0000 7fca9ffff640 1 -- 172.21.15.105:0/126987800 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcab00041e0 con 0x7fcab814f460 2024-09-21T03:22:04.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.719+0000 7fcabdc0a640 1 -- 172.21.15.105:0/126987800 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcab81f6900 con 0x7fcab814f460 2024-09-21T03:22:04.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.719+0000 7fca9ffff640 1 -- 172.21.15.105:0/126987800 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab00045d0 con 0x7fcab814f460 2024-09-21T03:22:04.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.719+0000 7fcabdc0a640 1 -- 172.21.15.105:0/126987800 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcab80b4940 con 0x7fcab814f460 2024-09-21T03:22:04.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.720+0000 7fcabdc0a640 1 -- 172.21.15.105:0/126987800 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcab81f6390 con 0x7fcab814f460 2024-09-21T03:22:04.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.720+0000 7fca9ffff640 1 -- 172.21.15.105:0/126987800 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcab0031470 con 0x7fcab814f460 2024-09-21T03:22:04.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.721+0000 7fca9ffff640 1 --2- 172.21.15.105:0/126987800 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcaa4078bc0 0x7fcaa407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:04.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.721+0000 7fca9ffff640 1 -- 172.21.15.105:0/126987800 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7fcab00bc5c0 con 0x7fcab814f460 2024-09-21T03:22:04.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.721+0000 7fcab77fe640 1 --2- 172.21.15.105:0/126987800 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcaa4078bc0 0x7fcaa407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:04.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.722+0000 7fcab77fe640 1 --2- 172.21.15.105:0/126987800 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcaa4078bc0 0x7fcaa407b0d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8000f60 tx=0x7fcaa8007990 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:04.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.725+0000 7fca9ffff640 1 -- 172.21.15.105:0/126987800 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fcab0084a00 con 0x7fcab814f460 2024-09-21T03:22:04.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.902+0000 7fcabdc0a640 1 -- 172.21.15.105:0/126987800 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command([{prefix=config set, name=mds_recall_max_caps}] v 0) -- 0x7fcab806e100 con 0x7fcab814f460 2024-09-21T03:22:04.908 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.906+0000 7fca9ffff640 1 -- 172.21.15.105:0/126987800 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_recall_max_caps}]=0 v45)=0 v45) ==== 119+0+0 (secure 0 0 0) 0x7fcab0084300 con 0x7fcab814f460 2024-09-21T03:22:04.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.909+0000 7fcabdc0a640 1 -- 172.21.15.105:0/126987800 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcaa4078bc0 msgr2=0x7fcaa407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:04.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.909+0000 7fcabdc0a640 1 --2- 172.21.15.105:0/126987800 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcaa4078bc0 0x7fcaa407b0d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8000f60 tx=0x7fcaa8007990 comp rx=0 tx=0).stop 2024-09-21T03:22:04.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.909+0000 7fcabdc0a640 1 -- 172.21.15.105:0/126987800 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcab814f460 msgr2=0x7fcab815a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:04.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.909+0000 7fcabdc0a640 1 --2- 172.21.15.105:0/126987800 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcab814f460 0x7fcab815a6f0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fcab0033040 tx=0x7fcab0030e50 comp rx=0 tx=0).stop 2024-09-21T03:22:04.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.909+0000 7fcabdc0a640 1 -- 172.21.15.105:0/126987800 shutdown_connections 2024-09-21T03:22:04.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.909+0000 7fcabdc0a640 1 --2- 172.21.15.105:0/126987800 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcaa4078bc0 0x7fcaa407b0d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:04.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.909+0000 7fcabdc0a640 1 --2- 172.21.15.105:0/126987800 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcab814f460 0x7fcab815a6f0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:04.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.909+0000 7fcabdc0a640 1 --2- 172.21.15.105:0/126987800 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcab8075fa0 0x7fcab80b4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:04.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.909+0000 7fcabdc0a640 1 --2- 172.21.15.105:0/126987800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcab8070e40 0x7fcab81f5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:04.912 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.909+0000 7fcabdc0a640 1 -- 172.21.15.105:0/126987800 >> 172.21.15.105:0/126987800 conn(0x7fcab80cd530 msgr2=0x7fcab815c390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:04.912 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.909+0000 7fcabdc0a640 1 -- 172.21.15.105:0/126987800 shutdown_connections 2024-09-21T03:22:04.912 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:04.909+0000 7fcabdc0a640 1 -- 172.21.15.105:0/126987800 wait complete. 2024-09-21T03:22:04.922 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_recall_warning_threshold 400 2024-09-21T03:22:05.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.035+0000 7f4eb44a9640 1 -- 172.21.15.105:0/2918925523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4eac0cfeb0 msgr2=0x7f4eac0d02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:05.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.035+0000 7f4eb44a9640 1 --2- 172.21.15.105:0/2918925523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4eac0cfeb0 0x7f4eac0d02c0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f4eac06a1c0 tx=0x7f4ea402aa30 comp rx=0 tx=0).stop 2024-09-21T03:22:05.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.035+0000 7f4eb44a9640 1 -- 172.21.15.105:0/2918925523 shutdown_connections 2024-09-21T03:22:05.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.035+0000 7f4eb44a9640 1 --2- 172.21.15.105:0/2918925523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4eac0cfeb0 0x7f4eac0d02c0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:05.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.035+0000 7f4eb44a9640 1 --2- 172.21.15.105:0/2918925523 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4eac06fec0 0x7f4eac0702d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:05.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.035+0000 7f4eb44a9640 1 --2- 172.21.15.105:0/2918925523 >> v2:172.21.15.162:3300/0 conn(0x7f4eac0b4090 0x7f4eac0b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:05.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.035+0000 7f4eb44a9640 1 -- 172.21.15.105:0/2918925523 >> 172.21.15.105:0/2918925523 conn(0x7f4eac0cdcc0 msgr2=0x7f4eac0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:05.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.035+0000 7f4eb44a9640 1 -- 172.21.15.105:0/2918925523 shutdown_connections 2024-09-21T03:22:05.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.035+0000 7f4eb44a9640 1 -- 172.21.15.105:0/2918925523 wait complete. 2024-09-21T03:22:05.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.037+0000 7f4eb44a9640 1 Processor -- start 2024-09-21T03:22:05.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.037+0000 7f4eb44a9640 1 -- start start 2024-09-21T03:22:05.041 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.038+0000 7f4eb44a9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4eac06fec0 0x7f4eac148b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:05.041 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.038+0000 7f4eb44a9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4eac0b4090 0x7f4eac1f3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:05.041 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.038+0000 7f4eb44a9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4eac0cfeb0 0x7f4eac148070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:05.041 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.038+0000 7f4eb44a9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4eac0b4820 con 0x7f4eac0b4090 2024-09-21T03:22:05.041 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.038+0000 7f4eb44a9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4eac0b46a0 con 0x7f4eac0cfeb0 2024-09-21T03:22:05.041 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.038+0000 7f4eb44a9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4eac0b49a0 con 0x7f4eac06fec0 2024-09-21T03:22:05.041 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.038+0000 7f4eb1a44640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4eac0b4090 0x7f4eac1f3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:05.041 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.038+0000 7f4eb1a44640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4eac0b4090 0x7f4eac1f3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56260/0 (socket says 172.21.15.105:56260) 2024-09-21T03:22:05.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.038+0000 7f4eb1a44640 1 -- 172.21.15.105:0/1580738963 learned_addr learned my addr 172.21.15.105:0/1580738963 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:22:05.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.038+0000 7f4eb1a44640 1 -- 172.21.15.105:0/1580738963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4eac06fec0 msgr2=0x7f4eac148b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:05.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.038+0000 7f4eb2245640 1 --2- 172.21.15.105:0/1580738963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4eac06fec0 0x7f4eac148b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:05.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.039+0000 7f4eb2a46640 1 --2- 172.21.15.105:0/1580738963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4eac0cfeb0 0x7f4eac148070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:05.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.039+0000 7f4eb1a44640 1 --2- 172.21.15.105:0/1580738963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4eac06fec0 0x7f4eac148b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:05.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.039+0000 7f4eb1a44640 1 -- 172.21.15.105:0/1580738963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4eac0cfeb0 msgr2=0x7f4eac148070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:05.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.039+0000 7f4eb1a44640 1 --2- 172.21.15.105:0/1580738963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4eac0cfeb0 0x7f4eac148070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:05.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.039+0000 7f4eb1a44640 1 -- 172.21.15.105:0/1580738963 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eac1f6ef0 con 0x7f4eac0b4090 2024-09-21T03:22:05.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.039+0000 7f4eb1a44640 1 --2- 172.21.15.105:0/1580738963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4eac0b4090 0x7f4eac1f3d60 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f4ea000c9a0 tx=0x7f4ea000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:05.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.039+0000 7f4eaaffd640 1 -- 172.21.15.105:0/1580738963 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea0004230 con 0x7f4eac0b4090 2024-09-21T03:22:05.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.039+0000 7f4eaaffd640 1 -- 172.21.15.105:0/1580738963 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ea00044c0 con 0x7f4eac0b4090 2024-09-21T03:22:05.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.039+0000 7f4eb44a9640 1 -- 172.21.15.105:0/1580738963 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eac1f71d0 con 0x7f4eac0b4090 2024-09-21T03:22:05.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.039+0000 7f4eaaffd640 1 -- 172.21.15.105:0/1580738963 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea0007bf0 con 0x7f4eac0b4090 2024-09-21T03:22:05.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.039+0000 7f4eb44a9640 1 -- 172.21.15.105:0/1580738963 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eac14acf0 con 0x7f4eac0b4090 2024-09-21T03:22:05.043 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.040+0000 7f4eb44a9640 1 -- 172.21.15.105:0/1580738963 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4eac0b3550 con 0x7f4eac0b4090 2024-09-21T03:22:05.043 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.041+0000 7f4eaaffd640 1 -- 172.21.15.105:0/1580738963 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4ea00035f0 con 0x7f4eac0b4090 2024-09-21T03:22:05.043 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.041+0000 7f4eaaffd640 1 --2- 172.21.15.105:0/1580738963 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4e98078b90 0x7f4e9807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:05.043 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.042+0000 7f4eaaffd640 1 -- 172.21.15.105:0/1580738963 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f4ea009b5e0 con 0x7f4eac0b4090 2024-09-21T03:22:05.043 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.042+0000 7f4eb2245640 1 --2- 172.21.15.105:0/1580738963 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4e98078b90 0x7f4e9807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:05.044 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.042+0000 7f4eb2245640 1 --2- 172.21.15.105:0/1580738963 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4e98078b90 0x7f4e9807b0a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c00b9a0 tx=0x7f4e9c005c20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:05.046 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.045+0000 7f4eaaffd640 1 -- 172.21.15.105:0/1580738963 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4ea0014070 con 0x7f4eac0b4090 2024-09-21T03:22:05.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.220+0000 7f4eb44a9640 1 -- 172.21.15.105:0/1580738963 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command([{prefix=config set, name=mds_recall_warning_threshold}] v 0) -- 0x7f4eac1f6c10 con 0x7f4eac0b4090 2024-09-21T03:22:05.227 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.225+0000 7f4eaaffd640 1 -- 172.21.15.105:0/1580738963 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_recall_warning_threshold}]=0 v46)=0 v46) ==== 128+0+0 (secure 0 0 0) 0x7f4ea0063b00 con 0x7f4eac0b4090 2024-09-21T03:22:05.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.228+0000 7f4eb44a9640 1 -- 172.21.15.105:0/1580738963 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4e98078b90 msgr2=0x7f4e9807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:05.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.228+0000 7f4eb44a9640 1 --2- 172.21.15.105:0/1580738963 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4e98078b90 0x7f4e9807b0a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c00b9a0 tx=0x7f4e9c005c20 comp rx=0 tx=0).stop 2024-09-21T03:22:05.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.228+0000 7f4eb44a9640 1 -- 172.21.15.105:0/1580738963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4eac0b4090 msgr2=0x7f4eac1f3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:05.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.228+0000 7f4eb44a9640 1 --2- 172.21.15.105:0/1580738963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4eac0b4090 0x7f4eac1f3d60 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f4ea000c9a0 tx=0x7f4ea000ce60 comp rx=0 tx=0).stop 2024-09-21T03:22:05.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.228+0000 7f4eb44a9640 1 -- 172.21.15.105:0/1580738963 shutdown_connections 2024-09-21T03:22:05.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.228+0000 7f4eb44a9640 1 --2- 172.21.15.105:0/1580738963 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4e98078b90 0x7f4e9807b0a0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:05.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.228+0000 7f4eb44a9640 1 --2- 172.21.15.105:0/1580738963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4eac0cfeb0 0x7f4eac148070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:05.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.228+0000 7f4eb44a9640 1 --2- 172.21.15.105:0/1580738963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4eac0b4090 0x7f4eac1f3d60 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:05.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.228+0000 7f4eb44a9640 1 --2- 172.21.15.105:0/1580738963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4eac06fec0 0x7f4eac148b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:05.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.228+0000 7f4eb44a9640 1 -- 172.21.15.105:0/1580738963 >> 172.21.15.105:0/1580738963 conn(0x7f4eac0cdcc0 msgr2=0x7f4eac0ae1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:05.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.228+0000 7f4eb44a9640 1 -- 172.21.15.105:0/1580738963 shutdown_connections 2024-09-21T03:22:05.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.228+0000 7f4eb44a9640 1 -- 172.21.15.105:0/1580738963 wait complete. 2024-09-21T03:22:05.242 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_min_caps_working_set 800 2024-09-21T03:22:05.358 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.356+0000 7fc584a15640 1 -- 172.21.15.105:0/2768904505 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc56c004d40 msgr2=0x7fc56c005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:05.358 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.356+0000 7fc584a15640 1 --2- 172.21.15.105:0/2768904505 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc56c004d40 0x7fc56c005150 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fc5800cb830 tx=0x7fc56c005830 comp rx=0 tx=0).stop 2024-09-21T03:22:05.358 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.356+0000 7fc57ed9d640 1 -- 172.21.15.105:0/2768904505 reap_dead start 2024-09-21T03:22:05.359 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.356+0000 7fc584a15640 1 -- 172.21.15.105:0/2768904505 shutdown_connections 2024-09-21T03:22:05.359 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.356+0000 7fc584a15640 1 -- 172.21.15.105:0/2768904505 >> 172.21.15.105:0/2768904505 conn(0x7fc5800cdcb0 msgr2=0x7fc5800ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:05.359 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.356+0000 7fc584a15640 1 -- 172.21.15.105:0/2768904505 shutdown_connections 2024-09-21T03:22:05.359 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.356+0000 7fc584a15640 1 -- 172.21.15.105:0/2768904505 wait complete. 2024-09-21T03:22:05.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.358+0000 7fc584a15640 1 Processor -- start 2024-09-21T03:22:05.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.358+0000 7fc584a15640 1 -- start start 2024-09-21T03:22:05.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.360+0000 7fc584a15640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc56c004d40 0x7fc5800cc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:05.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.360+0000 7fc584a15640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5801f5b50 0x7fc5801e35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:05.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.360+0000 7fc584a15640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5801e61a0 0x7fc5801e65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:05.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.360+0000 7fc584a15640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc5800cf2b0 con 0x7fc56c004d40 2024-09-21T03:22:05.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.360+0000 7fc584a15640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc5800cf130 con 0x7fc5801f5b50 2024-09-21T03:22:05.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.360+0000 7fc584a15640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc5800cf430 con 0x7fc5801e61a0 2024-09-21T03:22:05.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.360+0000 7fc57e59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc56c004d40 0x7fc5800cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:05.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.360+0000 7fc57e59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc56c004d40 0x7fc5800cc530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56276/0 (socket says 172.21.15.105:56276) 2024-09-21T03:22:05.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.360+0000 7fc57e59c640 1 -- 172.21.15.105:0/2397865960 learned_addr learned my addr 172.21.15.105:0/2397865960 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:22:05.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.360+0000 7fc57ed9d640 1 --2- 172.21.15.105:0/2397865960 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5801e61a0 0x7fc5801e65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:05.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.360+0000 7fc575d9b640 1 --2- 172.21.15.105:0/2397865960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5801f5b50 0x7fc5801e35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:05.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.360+0000 7fc57e59c640 1 -- 172.21.15.105:0/2397865960 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5801e61a0 msgr2=0x7fc5801e65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:05.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.360+0000 7fc57e59c640 1 --2- 172.21.15.105:0/2397865960 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5801e61a0 0x7fc5801e65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:05.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.360+0000 7fc57e59c640 1 -- 172.21.15.105:0/2397865960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5801f5b50 msgr2=0x7fc5801e35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:05.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.360+0000 7fc57e59c640 1 --2- 172.21.15.105:0/2397865960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5801f5b50 0x7fc5801e35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:05.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.360+0000 7fc57e59c640 1 -- 172.21.15.105:0/2397865960 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5801e6af0 con 0x7fc56c004d40 2024-09-21T03:22:05.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.360+0000 7fc575d9b640 1 --2- 172.21.15.105:0/2397865960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5801f5b50 0x7fc5801e35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:22:05.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.360+0000 7fc57e59c640 1 --2- 172.21.15.105:0/2397865960 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc56c004d40 0x7fc5800cc530 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fc570011ae0 tx=0x7fc570009e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:05.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.360+0000 7fc5777fe640 1 -- 172.21.15.105:0/2397865960 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57001e070 con 0x7fc56c004d40 2024-09-21T03:22:05.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.361+0000 7fc5777fe640 1 -- 172.21.15.105:0/2397865960 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc570004480 con 0x7fc56c004d40 2024-09-21T03:22:05.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.361+0000 7fc584a15640 1 -- 172.21.15.105:0/2397865960 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc58009aa30 con 0x7fc56c004d40 2024-09-21T03:22:05.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.361+0000 7fc5777fe640 1 -- 172.21.15.105:0/2397865960 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57000fc60 con 0x7fc56c004d40 2024-09-21T03:22:05.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.361+0000 7fc584a15640 1 -- 172.21.15.105:0/2397865960 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5801f2d90 con 0x7fc56c004d40 2024-09-21T03:22:05.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.362+0000 7fc584a15640 1 -- 172.21.15.105:0/2397865960 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc580071650 con 0x7fc56c004d40 2024-09-21T03:22:05.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.362+0000 7fc5777fe640 1 -- 172.21.15.105:0/2397865960 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc570021070 con 0x7fc56c004d40 2024-09-21T03:22:05.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.363+0000 7fc5777fe640 1 --2- 172.21.15.105:0/2397865960 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc560078b90 0x7fc56007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:05.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.363+0000 7fc5777fe640 1 -- 172.21.15.105:0/2397865960 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7fc57009b720 con 0x7fc56c004d40 2024-09-21T03:22:05.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.363+0000 7fc575d9b640 1 --2- 172.21.15.105:0/2397865960 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc560078b90 0x7fc56007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:05.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.364+0000 7fc575d9b640 1 --2- 172.21.15.105:0/2397865960 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc560078b90 0x7fc56007b0a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc5800b47e0 tx=0x7fc568005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:05.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.367+0000 7fc5777fe640 1 -- 172.21.15.105:0/2397865960 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc5801e6af0 con 0x7fc56c004d40 2024-09-21T03:22:05.547 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.545+0000 7fc584a15640 1 -- 172.21.15.105:0/2397865960 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command([{prefix=config set, name=mds_min_caps_working_set}] v 0) -- 0x7fc5800b4dd0 con 0x7fc56c004d40 2024-09-21T03:22:05.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.549+0000 7fc5777fe640 1 -- 172.21.15.105:0/2397865960 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_min_caps_working_set}]=0 v47)=0 v47) ==== 124+0+0 (secure 0 0 0) 0x7fc570063630 con 0x7fc56c004d40 2024-09-21T03:22:05.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.551+0000 7fc584a15640 1 -- 172.21.15.105:0/2397865960 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc560078b90 msgr2=0x7fc56007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:05.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.551+0000 7fc584a15640 1 --2- 172.21.15.105:0/2397865960 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc560078b90 0x7fc56007b0a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc5800b47e0 tx=0x7fc568005f90 comp rx=0 tx=0).stop 2024-09-21T03:22:05.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.551+0000 7fc584a15640 1 -- 172.21.15.105:0/2397865960 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc56c004d40 msgr2=0x7fc5800cc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:05.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.551+0000 7fc584a15640 1 --2- 172.21.15.105:0/2397865960 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc56c004d40 0x7fc5800cc530 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fc570011ae0 tx=0x7fc570009e40 comp rx=0 tx=0).stop 2024-09-21T03:22:05.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.551+0000 7fc584a15640 1 -- 172.21.15.105:0/2397865960 shutdown_connections 2024-09-21T03:22:05.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.551+0000 7fc584a15640 1 --2- 172.21.15.105:0/2397865960 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc560078b90 0x7fc56007b0a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:05.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.551+0000 7fc584a15640 1 --2- 172.21.15.105:0/2397865960 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5801e61a0 0x7fc5801e65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:05.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.551+0000 7fc584a15640 1 --2- 172.21.15.105:0/2397865960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5801f5b50 0x7fc5801e35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:05.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.551+0000 7fc584a15640 1 --2- 172.21.15.105:0/2397865960 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc56c004d40 0x7fc5800cc530 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:05.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.551+0000 7fc584a15640 1 -- 172.21.15.105:0/2397865960 >> 172.21.15.105:0/2397865960 conn(0x7fc5800cdcb0 msgr2=0x7fc5801e4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:05.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.551+0000 7fc584a15640 1 -- 172.21.15.105:0/2397865960 shutdown_connections 2024-09-21T03:22:05.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.551+0000 7fc584a15640 1 -- 172.21.15.105:0/2397865960 wait complete. 2024-09-21T03:22:05.564 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_min_caps_per_client 2024-09-21T03:22:05.679 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.677+0000 7f16c109b640 1 -- 172.21.15.105:0/312805150 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16bc0705d0 msgr2=0x7f16bc0b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:05.679 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.677+0000 7f16c109b640 1 --2- 172.21.15.105:0/312805150 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16bc0705d0 0x7f16bc0b3550 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f16b0005fd0 tx=0x7f16b002a5d0 comp rx=0 tx=0).stop 2024-09-21T03:22:05.679 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.677+0000 7f16c109b640 1 -- 172.21.15.105:0/312805150 shutdown_connections 2024-09-21T03:22:05.679 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.677+0000 7f16c109b640 1 --2- 172.21.15.105:0/312805150 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16bc0705d0 0x7f16bc0b3550 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:05.679 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.677+0000 7f16c109b640 1 --2- 172.21.15.105:0/312805150 >> v2:172.21.15.162:3300/0 conn(0x7f16bc0cfeb0 0x7f16bc0d02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:05.679 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.677+0000 7f16c109b640 1 -- 172.21.15.105:0/312805150 >> 172.21.15.105:0/312805150 conn(0x7f16bc0cdcc0 msgr2=0x7f16bc0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:05.679 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.677+0000 7f16c109b640 1 -- 172.21.15.105:0/312805150 shutdown_connections 2024-09-21T03:22:05.680 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.677+0000 7f16c109b640 1 -- 172.21.15.105:0/312805150 wait complete. 2024-09-21T03:22:05.680 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.679+0000 7f16c109b640 1 Processor -- start 2024-09-21T03:22:05.680 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.679+0000 7f16c109b640 1 -- start start 2024-09-21T03:22:05.683 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.680+0000 7f16c109b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16bc0b4090 0x7f16bc06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:05.683 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.680+0000 7f16c109b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16bc0cfeb0 0x7f16bc09b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:05.683 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.680+0000 7f16c109b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f16bc06d530 0x7f16bc09b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:05.683 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.680+0000 7f16c109b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f16bc0b4a30 con 0x7f16bc06d530 2024-09-21T03:22:05.683 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.680+0000 7f16c109b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f16bc0b48b0 con 0x7f16bc0b4090 2024-09-21T03:22:05.683 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.680+0000 7f16c109b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f16bc0b4bb0 con 0x7f16bc0cfeb0 2024-09-21T03:22:05.683 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.680+0000 7f16bb59e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f16bc06d530 0x7f16bc09b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:05.683 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.680+0000 7f16bb59e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f16bc06d530 0x7f16bc09b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56280/0 (socket says 172.21.15.105:56280) 2024-09-21T03:22:05.683 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.680+0000 7f16bb59e640 1 -- 172.21.15.105:0/846989837 learned_addr learned my addr 172.21.15.105:0/846989837 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:22:05.684 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.681+0000 7f16bad9d640 1 --2- 172.21.15.105:0/846989837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16bc0b4090 0x7f16bc06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:05.684 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.681+0000 7f16ba59c640 1 --2- 172.21.15.105:0/846989837 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16bc0cfeb0 0x7f16bc09b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:05.684 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.681+0000 7f16bb59e640 1 -- 172.21.15.105:0/846989837 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16bc0cfeb0 msgr2=0x7f16bc09b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:05.684 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.681+0000 7f16bb59e640 1 --2- 172.21.15.105:0/846989837 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16bc0cfeb0 0x7f16bc09b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:05.684 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.681+0000 7f16bb59e640 1 -- 172.21.15.105:0/846989837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16bc0b4090 msgr2=0x7f16bc06cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:05.684 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.681+0000 7f16bb59e640 1 --2- 172.21.15.105:0/846989837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16bc0b4090 0x7f16bc06cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:05.684 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.681+0000 7f16bb59e640 1 -- 172.21.15.105:0/846989837 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16bc15e330 con 0x7f16bc06d530 2024-09-21T03:22:05.684 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.681+0000 7f16bad9d640 1 --2- 172.21.15.105:0/846989837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16bc0b4090 0x7f16bc06cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:22:05.684 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.681+0000 7f16bb59e640 1 --2- 172.21.15.105:0/846989837 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f16bc06d530 0x7f16bc09b8f0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f16b400e740 tx=0x7f16b400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:05.684 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.681+0000 7f16a37fe640 1 -- 172.21.15.105:0/846989837 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b400ccc0 con 0x7f16bc06d530 2024-09-21T03:22:05.684 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.681+0000 7f16a37fe640 1 -- 172.21.15.105:0/846989837 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16b400ce80 con 0x7f16bc06d530 2024-09-21T03:22:05.684 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.681+0000 7f16c109b640 1 -- 172.21.15.105:0/846989837 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16bc09ea70 con 0x7f16bc06d530 2024-09-21T03:22:05.684 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.681+0000 7f16a37fe640 1 -- 172.21.15.105:0/846989837 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b4005280 con 0x7f16bc06d530 2024-09-21T03:22:05.684 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.681+0000 7f16c109b640 1 -- 172.21.15.105:0/846989837 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16bc09abb0 con 0x7f16bc06d530 2024-09-21T03:22:05.685 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.682+0000 7f16c109b640 1 -- 172.21.15.105:0/846989837 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16bc09e7e0 con 0x7f16bc06d530 2024-09-21T03:22:05.686 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.683+0000 7f16a37fe640 1 -- 172.21.15.105:0/846989837 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f16b4005420 con 0x7f16bc06d530 2024-09-21T03:22:05.686 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.683+0000 7f16a37fe640 1 --2- 172.21.15.105:0/846989837 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f16a8078b90 0x7f16a807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:05.686 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.683+0000 7f16a37fe640 1 -- 172.21.15.105:0/846989837 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f16b409b6c0 con 0x7f16bc06d530 2024-09-21T03:22:05.686 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.684+0000 7f16bad9d640 1 --2- 172.21.15.105:0/846989837 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f16a8078b90 0x7f16a807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:05.686 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.684+0000 7f16bad9d640 1 --2- 172.21.15.105:0/846989837 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f16a8078b90 0x7f16a807b0a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f16ac001d70 tx=0x7f16ac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:05.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.688+0000 7f16a37fe640 1 -- 172.21.15.105:0/846989837 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f16b4063b00 con 0x7f16bc06d530 2024-09-21T03:22:05.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.868+0000 7f16c109b640 1 -- 172.21.15.105:0/846989837 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_min_caps_per_client"} v 0) -- 0x7f16bc0b5060 con 0x7f16bc06d530 2024-09-21T03:22:05.870 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.868+0000 7f16a37fe640 1 -- 172.21.15.105:0/846989837 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_min_caps_per_client"}]=0 v47) ==== 106+0+4 (secure 0 0 0) 0x7f16b4063400 con 0x7f16bc06d530 2024-09-21T03:22:05.870 INFO:teuthology.orchestra.run.smithi105.stdout:100 2024-09-21T03:22:05.872 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.870+0000 7f16c109b640 1 -- 172.21.15.105:0/846989837 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f16a8078b90 msgr2=0x7f16a807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:05.872 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.870+0000 7f16c109b640 1 --2- 172.21.15.105:0/846989837 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f16a8078b90 0x7f16a807b0a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f16ac001d70 tx=0x7f16ac009040 comp rx=0 tx=0).stop 2024-09-21T03:22:05.872 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.870+0000 7f16c109b640 1 -- 172.21.15.105:0/846989837 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f16bc06d530 msgr2=0x7f16bc09b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:05.872 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.870+0000 7f16c109b640 1 --2- 172.21.15.105:0/846989837 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f16bc06d530 0x7f16bc09b8f0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f16b400e740 tx=0x7f16b400ec00 comp rx=0 tx=0).stop 2024-09-21T03:22:05.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.870+0000 7f16c109b640 1 -- 172.21.15.105:0/846989837 shutdown_connections 2024-09-21T03:22:05.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.870+0000 7f16c109b640 1 --2- 172.21.15.105:0/846989837 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f16a8078b90 0x7f16a807b0a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:05.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.870+0000 7f16c109b640 1 --2- 172.21.15.105:0/846989837 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f16bc06d530 0x7f16bc09b8f0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:05.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.870+0000 7f16c109b640 1 --2- 172.21.15.105:0/846989837 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16bc0cfeb0 0x7f16bc09b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:05.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.870+0000 7f16c109b640 1 --2- 172.21.15.105:0/846989837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16bc0b4090 0x7f16bc06cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:05.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.870+0000 7f16c109b640 1 -- 172.21.15.105:0/846989837 >> 172.21.15.105:0/846989837 conn(0x7f16bc0cdcc0 msgr2=0x7f16bc0adf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:05.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.870+0000 7f16c109b640 1 -- 172.21.15.105:0/846989837 shutdown_connections 2024-09-21T03:22:05.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.870+0000 7f16c109b640 1 -- 172.21.15.105:0/846989837 wait complete. 2024-09-21T03:22:05.883 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_recall_warning_decay_rate 2024-09-21T03:22:05.998 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.996+0000 7fad72025640 1 -- 172.21.15.105:0/3567332496 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad6c0b4090 msgr2=0x7fad6c0b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:05.998 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.996+0000 7fad72025640 1 --2- 172.21.15.105:0/3567332496 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad6c0b4090 0x7fad6c0b3550 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fad5c005fd0 tx=0x7fad5c02a8b0 comp rx=0 tx=0).stop 2024-09-21T03:22:05.998 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.996+0000 7fad72025640 1 -- 172.21.15.105:0/3567332496 shutdown_connections 2024-09-21T03:22:05.998 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.996+0000 7fad72025640 1 --2- 172.21.15.105:0/3567332496 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad6c0b4090 0x7fad6c0b3550 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:05.998 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.996+0000 7fad72025640 1 -- 172.21.15.105:0/3567332496 >> 172.21.15.105:0/3567332496 conn(0x7fad6c0cdcc0 msgr2=0x7fad6c0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:05.998 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.996+0000 7fad72025640 1 -- 172.21.15.105:0/3567332496 shutdown_connections 2024-09-21T03:22:05.998 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.996+0000 7fad72025640 1 -- 172.21.15.105:0/3567332496 wait complete. 2024-09-21T03:22:05.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.998+0000 7fad72025640 1 Processor -- start 2024-09-21T03:22:05.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.998+0000 7fad72025640 1 -- start start 2024-09-21T03:22:06.002 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.999+0000 7fad72025640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad6c06fec0 0x7fad6c09d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:06.002 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.999+0000 7fad72025640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad6c0b4090 0x7fad6c06cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:06.002 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.999+0000 7fad72025640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad6c0cfeb0 0x7fad6c155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:06.002 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.999+0000 7fad72025640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fad6c0b4bd0 con 0x7fad6c0cfeb0 2024-09-21T03:22:06.002 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.999+0000 7fad72025640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fad6c0b4a50 con 0x7fad6c06fec0 2024-09-21T03:22:06.002 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.999+0000 7fad72025640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fad6c0b4d50 con 0x7fad6c0b4090 2024-09-21T03:22:06.002 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.999+0000 7fad6bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad6c0cfeb0 0x7fad6c155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:06.002 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.999+0000 7fad6bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad6c0cfeb0 0x7fad6c155250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56304/0 (socket says 172.21.15.105:56304) 2024-09-21T03:22:06.002 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.999+0000 7fad6bfff640 1 -- 172.21.15.105:0/3613811787 learned_addr learned my addr 172.21.15.105:0/3613811787 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:22:06.002 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.999+0000 7fad6b7fe640 1 --2- 172.21.15.105:0/3613811787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad6c06fec0 0x7fad6c09d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:06.002 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.999+0000 7fad6bfff640 1 -- 172.21.15.105:0/3613811787 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad6c0b4090 msgr2=0x7fad6c06cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:06.003 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.999+0000 7fad6bfff640 1 --2- 172.21.15.105:0/3613811787 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad6c0b4090 0x7fad6c06cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:06.003 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.999+0000 7fad6bfff640 1 -- 172.21.15.105:0/3613811787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad6c06fec0 msgr2=0x7fad6c09d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:06.003 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.999+0000 7fad6bfff640 1 --2- 172.21.15.105:0/3613811787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad6c06fec0 0x7fad6c09d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:06.003 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:05.999+0000 7fad6bfff640 1 -- 172.21.15.105:0/3613811787 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad6c1f36d0 con 0x7fad6c0cfeb0 2024-09-21T03:22:06.003 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.000+0000 7fad6bfff640 1 --2- 172.21.15.105:0/3613811787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad6c0cfeb0 0x7fad6c155250 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fad6400c390 tx=0x7fad6400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:06.003 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.000+0000 7fad53fff640 1 -- 172.21.15.105:0/3613811787 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad64011790 con 0x7fad6c0cfeb0 2024-09-21T03:22:06.003 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.000+0000 7fad53fff640 1 -- 172.21.15.105:0/3613811787 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad64017070 con 0x7fad6c0cfeb0 2024-09-21T03:22:06.003 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.000+0000 7fad72025640 1 -- 172.21.15.105:0/3613811787 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad6c1f39b0 con 0x7fad6c0cfeb0 2024-09-21T03:22:06.003 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.000+0000 7fad53fff640 1 -- 172.21.15.105:0/3613811787 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad64011c60 con 0x7fad6c0cfeb0 2024-09-21T03:22:06.003 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.000+0000 7fad72025640 1 -- 172.21.15.105:0/3613811787 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad6c1f3f70 con 0x7fad6c0cfeb0 2024-09-21T03:22:06.004 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.001+0000 7fad72025640 1 -- 172.21.15.105:0/3613811787 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad6c09db60 con 0x7fad6c0cfeb0 2024-09-21T03:22:06.004 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.002+0000 7fad53fff640 1 -- 172.21.15.105:0/3613811787 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fad6401c460 con 0x7fad6c0cfeb0 2024-09-21T03:22:06.004 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.002+0000 7fad53fff640 1 --2- 172.21.15.105:0/3613811787 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fad58078b90 0x7fad5807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:06.004 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.002+0000 7fad53fff640 1 -- 172.21.15.105:0/3613811787 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7fad6409b4c0 con 0x7fad6c0cfeb0 2024-09-21T03:22:06.004 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.002+0000 7fad6b7fe640 1 --2- 172.21.15.105:0/3613811787 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fad58078b90 0x7fad5807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:06.005 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.003+0000 7fad6b7fe640 1 --2- 172.21.15.105:0/3613811787 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fad58078b90 0x7fad5807b0a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fad5c034000 tx=0x7fad5c004ab0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:06.007 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.006+0000 7fad53fff640 1 -- 172.21.15.105:0/3613811787 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fad640639e0 con 0x7fad6c0cfeb0 2024-09-21T03:22:06.184 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.182+0000 7fad72025640 1 -- 172.21.15.105:0/3613811787 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_recall_warning_decay_rate"} v 0) -- 0x7fad6c0b5200 con 0x7fad6c0cfeb0 2024-09-21T03:22:06.184 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.183+0000 7fad53fff640 1 -- 172.21.15.105:0/3613811787 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_recall_warning_decay_rate"}]=0 v47) ==== 112+0+10 (secure 0 0 0) 0x7fad640632e0 con 0x7fad6c0cfeb0 2024-09-21T03:22:06.184 INFO:teuthology.orchestra.run.smithi105.stdout:60.000000 2024-09-21T03:22:06.187 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.185+0000 7fad72025640 1 -- 172.21.15.105:0/3613811787 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fad58078b90 msgr2=0x7fad5807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:06.187 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.185+0000 7fad72025640 1 --2- 172.21.15.105:0/3613811787 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fad58078b90 0x7fad5807b0a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fad5c034000 tx=0x7fad5c004ab0 comp rx=0 tx=0).stop 2024-09-21T03:22:06.187 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.185+0000 7fad72025640 1 -- 172.21.15.105:0/3613811787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad6c0cfeb0 msgr2=0x7fad6c155250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:06.187 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.185+0000 7fad72025640 1 --2- 172.21.15.105:0/3613811787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad6c0cfeb0 0x7fad6c155250 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fad6400c390 tx=0x7fad6400c850 comp rx=0 tx=0).stop 2024-09-21T03:22:06.187 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.185+0000 7fad72025640 1 -- 172.21.15.105:0/3613811787 shutdown_connections 2024-09-21T03:22:06.188 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.185+0000 7fad72025640 1 --2- 172.21.15.105:0/3613811787 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fad58078b90 0x7fad5807b0a0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:06.188 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.185+0000 7fad72025640 1 --2- 172.21.15.105:0/3613811787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad6c0cfeb0 0x7fad6c155250 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:06.188 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.185+0000 7fad72025640 1 --2- 172.21.15.105:0/3613811787 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad6c0b4090 0x7fad6c06cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:06.188 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.185+0000 7fad72025640 1 --2- 172.21.15.105:0/3613811787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad6c06fec0 0x7fad6c09d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:06.188 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.185+0000 7fad72025640 1 -- 172.21.15.105:0/3613811787 >> 172.21.15.105:0/3613811787 conn(0x7fad6c0cdcc0 msgr2=0x7fad6c073e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:06.188 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.185+0000 7fad72025640 1 -- 172.21.15.105:0/3613811787 shutdown_connections 2024-09-21T03:22:06.188 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.185+0000 7fad72025640 1 -- 172.21.15.105:0/3613811787 wait complete. 2024-09-21T03:22:06.198 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:22:06.198 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:22:06.213 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:22:06.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:22:06.303 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:22:06.309 INFO:teuthology.orchestra.run.smithi105.stdout:client6459 2024-09-21T03:22:06.309 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:22:06.309 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:22:06.325 DEBUG:teuthology.orchestra.run.smithi105:> stdin-killer -- python3 -c ' 2024-09-21T03:22:06.325 DEBUG:teuthology.orchestra.run.smithi105:> import fcntl 2024-09-21T03:22:06.325 DEBUG:teuthology.orchestra.run.smithi105:> import sys 2024-09-21T03:22:06.325 DEBUG:teuthology.orchestra.run.smithi105:> import time 2024-09-21T03:22:06.325 DEBUG:teuthology.orchestra.run.smithi105:> import os 2024-09-21T03:22:06.325 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-21T03:22:06.325 DEBUG:teuthology.orchestra.run.smithi105:> fcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK) 2024-09-21T03:22:06.325 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-21T03:22:06.325 DEBUG:teuthology.orchestra.run.smithi105:> n = 400 2024-09-21T03:22:06.325 DEBUG:teuthology.orchestra.run.smithi105:> abs_path = "/home/ubuntu/cephtest/mnt.0/subdir" 2024-09-21T03:22:06.325 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-21T03:22:06.325 DEBUG:teuthology.orchestra.run.smithi105:> if not os.path.exists(abs_path): 2024-09-21T03:22:06.325 DEBUG:teuthology.orchestra.run.smithi105:> os.makedirs(abs_path) 2024-09-21T03:22:06.326 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-21T03:22:06.326 DEBUG:teuthology.orchestra.run.smithi105:> handles = [] 2024-09-21T03:22:06.326 DEBUG:teuthology.orchestra.run.smithi105:> for i in range(0, n): 2024-09-21T03:22:06.326 DEBUG:teuthology.orchestra.run.smithi105:> fname = "file_"+str(i) 2024-09-21T03:22:06.326 DEBUG:teuthology.orchestra.run.smithi105:> path = os.path.join(abs_path, fname) 2024-09-21T03:22:06.326 DEBUG:teuthology.orchestra.run.smithi105:> handles.append(open(path, '"'"'w'"'"')) 2024-09-21T03:22:06.326 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-21T03:22:06.326 DEBUG:teuthology.orchestra.run.smithi105:> print("waiting with handles open", file=sys.stderr) 2024-09-21T03:22:06.326 DEBUG:teuthology.orchestra.run.smithi105:> while True: 2024-09-21T03:22:06.326 DEBUG:teuthology.orchestra.run.smithi105:> print("open_n_background: keeping files open", file=sys.stderr) 2024-09-21T03:22:06.326 DEBUG:teuthology.orchestra.run.smithi105:> try: 2024-09-21T03:22:06.326 DEBUG:teuthology.orchestra.run.smithi105:> if os.read(0, 4096) == b"": 2024-09-21T03:22:06.326 DEBUG:teuthology.orchestra.run.smithi105:> break 2024-09-21T03:22:06.326 DEBUG:teuthology.orchestra.run.smithi105:> except BlockingIOError: 2024-09-21T03:22:06.326 DEBUG:teuthology.orchestra.run.smithi105:> pass 2024-09-21T03:22:06.326 DEBUG:teuthology.orchestra.run.smithi105:> time.sleep(2) 2024-09-21T03:22:06.327 DEBUG:teuthology.orchestra.run.smithi105:> print("stdin closed, goodbye!", file=sys.stderr) 2024-09-21T03:22:06.327 DEBUG:teuthology.orchestra.run.smithi105:> ' 2024-09-21T03:22:06.368 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:22:06.483 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.481+0000 7fad80b20640 1 -- 172.21.15.105:0/2271220903 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad7c0ced00 msgr2=0x7fad7c0cf110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:06.483 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.481+0000 7fad80b20640 1 --2- 172.21.15.105:0/2271220903 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad7c0ced00 0x7fad7c0cf110 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fad7c0b4ee0 tx=0x7fad7402aac0 comp rx=0 tx=0).stop 2024-09-21T03:22:06.483 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.481+0000 7fad80b20640 1 -- 172.21.15.105:0/2271220903 shutdown_connections 2024-09-21T03:22:06.483 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.481+0000 7fad80b20640 1 --2- 172.21.15.105:0/2271220903 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad7c0ced00 0x7fad7c0cf110 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:06.483 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.481+0000 7fad80b20640 1 --2- 172.21.15.105:0/2271220903 >> v2:172.21.15.162:3300/0 conn(0x7fad7c0cd3b0 0x7fad7c157130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:06.483 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.481+0000 7fad80b20640 1 -- 172.21.15.105:0/2271220903 >> 172.21.15.105:0/2271220903 conn(0x7fad7c06d550 msgr2=0x7fad7c071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:06.484 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.481+0000 7fad80b20640 1 -- 172.21.15.105:0/2271220903 shutdown_connections 2024-09-21T03:22:06.484 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.481+0000 7fad80b20640 1 -- 172.21.15.105:0/2271220903 wait complete. 2024-09-21T03:22:06.485 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.483+0000 7fad80b20640 1 Processor -- start 2024-09-21T03:22:06.485 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.483+0000 7fad80b20640 1 -- start start 2024-09-21T03:22:06.487 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.484+0000 7fad80b20640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad7c0cd3b0 0x7fad7c06fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:06.487 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.484+0000 7fad80b20640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad7c0ced00 0x7fad7c1f5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:06.487 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.484+0000 7fad80b20640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad7c160f60 0x7fad7c15b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:06.487 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.484+0000 7fad80b20640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fad7c0d07e0 con 0x7fad7c160f60 2024-09-21T03:22:06.487 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.484+0000 7fad80b20640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fad7c0d0660 con 0x7fad7c0ced00 2024-09-21T03:22:06.487 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.484+0000 7fad80b20640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fad7c0d0960 con 0x7fad7c0cd3b0 2024-09-21T03:22:06.487 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.484+0000 7fad7ad9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad7c160f60 0x7fad7c15b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:06.487 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.484+0000 7fad7ad9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad7c160f60 0x7fad7c15b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56322/0 (socket says 172.21.15.105:56322) 2024-09-21T03:22:06.487 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.484+0000 7fad7ad9d640 1 -- 172.21.15.105:0/1257010306 learned_addr learned my addr 172.21.15.105:0/1257010306 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:22:06.487 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.484+0000 7fad7a59c640 1 --2- 172.21.15.105:0/1257010306 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad7c0cd3b0 0x7fad7c06fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:06.487 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.484+0000 7fad73fff640 1 --2- 172.21.15.105:0/1257010306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad7c0ced00 0x7fad7c1f5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:06.488 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.485+0000 7fad7ad9d640 1 -- 172.21.15.105:0/1257010306 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad7c0cd3b0 msgr2=0x7fad7c06fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:06.488 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.485+0000 7fad7ad9d640 1 --2- 172.21.15.105:0/1257010306 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad7c0cd3b0 0x7fad7c06fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:06.488 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.485+0000 7fad7ad9d640 1 -- 172.21.15.105:0/1257010306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad7c0ced00 msgr2=0x7fad7c1f5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:06.488 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.485+0000 7fad7ad9d640 1 --2- 172.21.15.105:0/1257010306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad7c0ced00 0x7fad7c1f5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:06.488 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.485+0000 7fad7ad9d640 1 -- 172.21.15.105:0/1257010306 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad7c06eb50 con 0x7fad7c160f60 2024-09-21T03:22:06.488 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.485+0000 7fad7ad9d640 1 --2- 172.21.15.105:0/1257010306 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad7c160f60 0x7fad7c15b540 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fad74009d60 tx=0x7fad74003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:06.488 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.485+0000 7fad72ffd640 1 -- 172.21.15.105:0/1257010306 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad74044070 con 0x7fad7c160f60 2024-09-21T03:22:06.488 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.485+0000 7fad72ffd640 1 -- 172.21.15.105:0/1257010306 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad74004250 con 0x7fad7c160f60 2024-09-21T03:22:06.488 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.485+0000 7fad72ffd640 1 -- 172.21.15.105:0/1257010306 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad74004680 con 0x7fad7c160f60 2024-09-21T03:22:06.488 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.485+0000 7fad80b20640 1 -- 172.21.15.105:0/1257010306 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad7c06ee30 con 0x7fad7c160f60 2024-09-21T03:22:06.488 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.485+0000 7fad80b20640 1 -- 172.21.15.105:0/1257010306 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad7c14a770 con 0x7fad7c160f60 2024-09-21T03:22:06.489 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.486+0000 7fad80b20640 1 -- 172.21.15.105:0/1257010306 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad7c0a98a0 con 0x7fad7c160f60 2024-09-21T03:22:06.489 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.487+0000 7fad72ffd640 1 -- 172.21.15.105:0/1257010306 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fad74036400 con 0x7fad7c160f60 2024-09-21T03:22:06.489 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.488+0000 7fad72ffd640 1 --2- 172.21.15.105:0/1257010306 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fad5c078b90 0x7fad5c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:06.489 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.488+0000 7fad72ffd640 1 -- 172.21.15.105:0/1257010306 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7fad740bb310 con 0x7fad7c160f60 2024-09-21T03:22:06.490 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.488+0000 7fad7a59c640 1 --2- 172.21.15.105:0/1257010306 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fad5c078b90 0x7fad5c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:06.490 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.489+0000 7fad7a59c640 1 --2- 172.21.15.105:0/1257010306 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fad5c078b90 0x7fad5c07b0a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fad6c005fd0 tx=0x7fad6c00b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:06.493 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.492+0000 7fad72ffd640 1 -- 172.21.15.105:0/1257010306 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fad74032030 con 0x7fad7c160f60 2024-09-21T03:22:06.717 INFO:teuthology.orchestra.run.smithi105.stderr:waiting with handles open 2024-09-21T03:22:06.717 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:22:06.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.796+0000 7fad80b20640 1 -- 172.21.15.105:0/1257010306 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fad7c14a9d0 con 0x7fad7c160f60 2024-09-21T03:22:06.798 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.796+0000 7fad72ffd640 1 -- 172.21.15.105:0/1257010306 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5234 (secure 0 0 0) 0x7fad74004820 con 0x7fad7c160f60 2024-09-21T03:22:06.798 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:22:06.798 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":47,"btime":"2024-09-21T03:21:54:900892+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5878,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/352800965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":352800965},{"type":"v1","addr":"172.21.15.162:6836","nonce":352800965}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":5881,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3338554559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3338554559},{"type":"v1","addr":"172.21.15.162:6837","nonce":3338554559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/3520449576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3520449576},{"type":"v1","addr":"172.21.15.105:6834","nonce":3520449576}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:21:51.239132+0000","modified":"2024-09-21T03:21:54.265820+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6288":{"gid":6288,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/2722940718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2722940718},{"type":"v1","addr":"172.21.15.105:6835","nonce":2722940718}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6288,"qdb_cluster":[6288]},"id":6}]} 2024-09-21T03:22:06.798 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 47 2024-09-21T03:22:06.800 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.798+0000 7fad80b20640 1 -- 172.21.15.105:0/1257010306 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fad5c078b90 msgr2=0x7fad5c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:06.801 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.798+0000 7fad80b20640 1 --2- 172.21.15.105:0/1257010306 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fad5c078b90 0x7fad5c07b0a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fad6c005fd0 tx=0x7fad6c00b2e0 comp rx=0 tx=0).stop 2024-09-21T03:22:06.801 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.798+0000 7fad80b20640 1 -- 172.21.15.105:0/1257010306 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad7c160f60 msgr2=0x7fad7c15b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:06.801 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.798+0000 7fad80b20640 1 --2- 172.21.15.105:0/1257010306 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad7c160f60 0x7fad7c15b540 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fad74009d60 tx=0x7fad74003f10 comp rx=0 tx=0).stop 2024-09-21T03:22:06.801 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.799+0000 7fad80b20640 1 -- 172.21.15.105:0/1257010306 shutdown_connections 2024-09-21T03:22:06.801 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.799+0000 7fad80b20640 1 --2- 172.21.15.105:0/1257010306 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fad5c078b90 0x7fad5c07b0a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:06.801 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.799+0000 7fad80b20640 1 --2- 172.21.15.105:0/1257010306 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad7c160f60 0x7fad7c15b540 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:06.801 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.799+0000 7fad80b20640 1 --2- 172.21.15.105:0/1257010306 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad7c0ced00 0x7fad7c1f5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:06.801 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.799+0000 7fad80b20640 1 --2- 172.21.15.105:0/1257010306 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad7c0cd3b0 0x7fad7c06fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:06.801 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.799+0000 7fad80b20640 1 -- 172.21.15.105:0/1257010306 >> 172.21.15.105:0/1257010306 conn(0x7fad7c06d550 msgr2=0x7fad7c0b6610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:06.801 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.799+0000 7fad80b20640 1 -- 172.21.15.105:0/1257010306 shutdown_connections 2024-09-21T03:22:06.801 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:06.799+0000 7fad80b20640 1 -- 172.21.15.105:0/1257010306 wait complete. 2024-09-21T03:22:06.812 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-21T03:22:06.940 INFO:teuthology.orchestra.run.smithi105.stdout:[{"id":5600,"entity":{"name":{"type":"client","num":5600},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":653968294}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":2.7999430190000001,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.991251735565347,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5600 v1:192.168.0.1:0/653968294","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi162","kernel_version":"5.14.0-508.el9.x86_64","root":"/"}},{"id":6459,"entity":{"name":{"type":"client","num":6459},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":4275552342}},"state":"open","num_leases":1,"num_caps":402,"request_load_avg":425,"uptime":3.9219201849999998,"requests_in_flight":400,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":199.93300835794165,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":197.33776301894744,"halflife":1.5},"recall_caps_throttle2o":{"value":192.1191299274943,"halflife":0.5},"session_cache_liveness":{"value":804.33497726165683,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":29,"last_trim_completed_flushes_tid":0,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.6459 v1:192.168.0.1:0/4275552342","completed_requests":[],"prealloc_inos":[{"start":"0x10000000001","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi105","kernel_version":"5.14.0-508.el9.x86_64","root":"/"}}] 2024-09-21T03:22:06.940 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi162", "kernel_version": "5.14.0-508.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 653968294, "type": "v1" }, "name": { "num": 5600, "type": "client" } }, "id": 5600, "inst": "client.5600 v1:192.168.0.1:0/653968294", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.991251735565347 }, "state": "open", "uptime": 2.799943019 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi105", "kernel_version": "5.14.0-508.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 4275552342, "type": "v1" }, "name": { "num": 6459, "type": "client" } }, "id": 6459, "inst": "client.6459 v1:192.168.0.1:0/4275552342", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 29, "num_caps": 402, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 1000, "start": "0x10000000001" } ], "recall_caps": { "halflife": 60, "value": 199.93300835794165 }, "recall_caps_throttle": { "halflife": 1.5, "value": 197.33776301894744 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 192.1191299274943 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 425, "requests_in_flight": 400, "session_cache_liveness": { "halflife": 300, "value": 804.3349772616568 }, "state": "open", "uptime": 3.921920185 } ] 2024-09-21T03:22:06.941 INFO:tasks.ceph_test_case:waiting 120.0s for health warning matching MDS_CACHE_OVERSIZED 2024-09-21T03:22:06.941 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T03:22:07.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.050+0000 7f0ec797b640 1 -- 172.21.15.105:0/471276496 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0eac005150 msgr2=0x7f0eac00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:07.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.050+0000 7f0ec797b640 1 --2- 172.21.15.105:0/471276496 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0eac005150 0x7f0eac00b9c0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0070de0 tx=0x7f0eac005830 comp rx=0 tx=0).stop 2024-09-21T03:22:07.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.050+0000 7f0ec5f18640 1 -- 172.21.15.105:0/471276496 reap_dead start 2024-09-21T03:22:07.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.050+0000 7f0ec797b640 1 -- 172.21.15.105:0/471276496 shutdown_connections 2024-09-21T03:22:07.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.050+0000 7f0ec797b640 1 -- 172.21.15.105:0/471276496 >> 172.21.15.105:0/471276496 conn(0x7f0ec00b1cb0 msgr2=0x7f0ec00b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:07.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.050+0000 7f0ec797b640 1 -- 172.21.15.105:0/471276496 shutdown_connections 2024-09-21T03:22:07.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.050+0000 7f0ec797b640 1 -- 172.21.15.105:0/471276496 wait complete. 2024-09-21T03:22:07.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.052+0000 7f0ec797b640 1 Processor -- start 2024-09-21T03:22:07.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.052+0000 7f0ec797b640 1 -- start start 2024-09-21T03:22:07.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.053+0000 7f0ec797b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ec00c67e0 0x7f0ec01f2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:07.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.053+0000 7f0ec797b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ec015a9f0 0x7f0ec009ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:07.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.053+0000 7f0ec797b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ec009cf80 0x7f0ec01f63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:07.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.053+0000 7f0ec797b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec00cbb80 con 0x7f0ec00c67e0 2024-09-21T03:22:07.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.053+0000 7f0ec797b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec00cba00 con 0x7f0ec015a9f0 2024-09-21T03:22:07.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.053+0000 7f0ec797b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0ec00cbd00 con 0x7f0ec009cf80 2024-09-21T03:22:07.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.053+0000 7f0ec5717640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ec00c67e0 0x7f0ec01f2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:07.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.053+0000 7f0ec5717640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ec00c67e0 0x7f0ec01f2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56330/0 (socket says 172.21.15.105:56330) 2024-09-21T03:22:07.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.053+0000 7f0ec5717640 1 -- 172.21.15.105:0/2344656246 learned_addr learned my addr 172.21.15.105:0/2344656246 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:22:07.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.054+0000 7f0ec4f16640 1 --2- 172.21.15.105:0/2344656246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ec015a9f0 0x7f0ec009ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:07.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.054+0000 7f0ec5f18640 1 --2- 172.21.15.105:0/2344656246 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ec009cf80 0x7f0ec01f63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:07.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.054+0000 7f0ec5717640 1 -- 172.21.15.105:0/2344656246 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ec009cf80 msgr2=0x7f0ec01f63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:07.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.054+0000 7f0ec5717640 1 --2- 172.21.15.105:0/2344656246 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ec009cf80 0x7f0ec01f63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:07.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.054+0000 7f0ec5717640 1 -- 172.21.15.105:0/2344656246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ec015a9f0 msgr2=0x7f0ec009ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:07.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.054+0000 7f0ec5717640 1 --2- 172.21.15.105:0/2344656246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ec015a9f0 0x7f0ec009ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:07.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.054+0000 7f0ec5717640 1 -- 172.21.15.105:0/2344656246 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ec009d390 con 0x7f0ec00c67e0 2024-09-21T03:22:07.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.054+0000 7f0ec4f16640 1 --2- 172.21.15.105:0/2344656246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ec015a9f0 0x7f0ec009ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:22:07.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.054+0000 7f0ec5f18640 1 --2- 172.21.15.105:0/2344656246 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ec009cf80 0x7f0ec01f63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:22:07.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.054+0000 7f0ec5717640 1 --2- 172.21.15.105:0/2344656246 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ec00c67e0 0x7f0ec01f2de0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc006610 tx=0x7f0ebc0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:07.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.054+0000 7f0eb5ffb640 1 -- 172.21.15.105:0/2344656246 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ebc015070 con 0x7f0ec00c67e0 2024-09-21T03:22:07.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.054+0000 7f0eb5ffb640 1 -- 172.21.15.105:0/2344656246 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ebc011900 con 0x7f0ec00c67e0 2024-09-21T03:22:07.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.054+0000 7f0ec797b640 1 -- 172.21.15.105:0/2344656246 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ec015cf30 con 0x7f0ec00c67e0 2024-09-21T03:22:07.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.054+0000 7f0eb5ffb640 1 -- 172.21.15.105:0/2344656246 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ebc011d50 con 0x7f0ec00c67e0 2024-09-21T03:22:07.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.054+0000 7f0ec797b640 1 -- 172.21.15.105:0/2344656246 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ec01f36a0 con 0x7f0ec00c67e0 2024-09-21T03:22:07.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.055+0000 7f0ec797b640 1 -- 172.21.15.105:0/2344656246 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ec00735b0 con 0x7f0ec00c67e0 2024-09-21T03:22:07.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.056+0000 7f0eb5ffb640 1 -- 172.21.15.105:0/2344656246 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0ebc010420 con 0x7f0ec00c67e0 2024-09-21T03:22:07.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.056+0000 7f0eb5ffb640 1 --2- 172.21.15.105:0/2344656246 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0ea4078b90 0x7f0ea407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:07.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.057+0000 7f0eb5ffb640 1 -- 172.21.15.105:0/2344656246 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f0ebc09bbb0 con 0x7f0ec00c67e0 2024-09-21T03:22:07.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.057+0000 7f0ec4f16640 1 --2- 172.21.15.105:0/2344656246 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0ea4078b90 0x7f0ea407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:07.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.057+0000 7f0ec4f16640 1 --2- 172.21.15.105:0/2344656246 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0ea4078b90 0x7f0ea407b0a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0005fd0 tx=0x7f0eb000b530 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:07.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.061+0000 7f0eb5ffb640 1 -- 172.21.15.105:0/2344656246 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0ec009d390 con 0x7f0ec00c67e0 2024-09-21T03:22:07.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.279+0000 7f0ec797b640 1 -- 172.21.15.105:0/2344656246 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0ec0074850 con 0x7f0ec00c67e0 2024-09-21T03:22:07.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.280+0000 7f0eb5ffb640 1 -- 172.21.15.105:0/2344656246 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f0ebc064090 con 0x7f0ec00c67e0 2024-09-21T03:22:07.282 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:22:07.282 INFO:teuthology.orchestra.run.smithi105.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T03:22:07.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.282+0000 7f0ec797b640 1 -- 172.21.15.105:0/2344656246 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0ea4078b90 msgr2=0x7f0ea407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:07.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.282+0000 7f0ec797b640 1 --2- 172.21.15.105:0/2344656246 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0ea4078b90 0x7f0ea407b0a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0005fd0 tx=0x7f0eb000b530 comp rx=0 tx=0).stop 2024-09-21T03:22:07.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.282+0000 7f0ec797b640 1 -- 172.21.15.105:0/2344656246 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ec00c67e0 msgr2=0x7f0ec01f2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:07.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.282+0000 7f0ec797b640 1 --2- 172.21.15.105:0/2344656246 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ec00c67e0 0x7f0ec01f2de0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc006610 tx=0x7f0ebc0039c0 comp rx=0 tx=0).stop 2024-09-21T03:22:07.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.282+0000 7f0ec797b640 1 -- 172.21.15.105:0/2344656246 shutdown_connections 2024-09-21T03:22:07.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.282+0000 7f0ec797b640 1 --2- 172.21.15.105:0/2344656246 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0ea4078b90 0x7f0ea407b0a0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:07.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.282+0000 7f0ec797b640 1 --2- 172.21.15.105:0/2344656246 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ec009cf80 0x7f0ec01f63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:07.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.282+0000 7f0ec797b640 1 --2- 172.21.15.105:0/2344656246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ec015a9f0 0x7f0ec009ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:07.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.282+0000 7f0ec797b640 1 --2- 172.21.15.105:0/2344656246 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ec00c67e0 0x7f0ec01f2de0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:07.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.282+0000 7f0ec797b640 1 -- 172.21.15.105:0/2344656246 >> 172.21.15.105:0/2344656246 conn(0x7f0ec00b1cb0 msgr2=0x7f0ec015b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:07.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.282+0000 7f0ec797b640 1 -- 172.21.15.105:0/2344656246 shutdown_connections 2024-09-21T03:22:07.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:07.282+0000 7f0ec797b640 1 -- 172.21.15.105:0/2344656246 wait complete. 2024-09-21T03:22:07.297 DEBUG:tasks.ceph_test_case:Not expected number of summary strings ([]) 2024-09-21T03:22:07.297 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-21T03:22:08.719 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:22:10.721 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:22:12.297 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T03:22:12.424 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.422+0000 7f1906158640 1 -- 172.21.15.105:0/1103642567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f190015b8f0 msgr2=0x7f19000cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:12.424 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.422+0000 7f1906158640 1 --2- 172.21.15.105:0/1103642567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f190015b8f0 0x7f19000cf130 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f18f0009900 tx=0x7f18f002a610 comp rx=0 tx=0).stop 2024-09-21T03:22:12.424 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.422+0000 7f1906158640 1 -- 172.21.15.105:0/1103642567 shutdown_connections 2024-09-21T03:22:12.424 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.422+0000 7f1906158640 1 --2- 172.21.15.105:0/1103642567 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19000b2cb0 0x7f19000b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:12.424 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.422+0000 7f1906158640 1 --2- 172.21.15.105:0/1103642567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f190015b8f0 0x7f19000cf130 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:12.424 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.422+0000 7f1906158640 1 -- 172.21.15.105:0/1103642567 >> 172.21.15.105:0/1103642567 conn(0x7f19000cdcb0 msgr2=0x7f19000ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:12.424 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.422+0000 7f1906158640 1 -- 172.21.15.105:0/1103642567 shutdown_connections 2024-09-21T03:22:12.424 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.422+0000 7f1906158640 1 -- 172.21.15.105:0/1103642567 wait complete. 2024-09-21T03:22:12.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.423+0000 7f1906158640 1 Processor -- start 2024-09-21T03:22:12.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.424+0000 7f1906158640 1 -- start start 2024-09-21T03:22:12.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.425+0000 7f1906158640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19000b0520 0x7f19000ca960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:12.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.425+0000 7f1906158640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19000b2cb0 0x7f1900156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:12.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.425+0000 7f1906158640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f190015b8f0 0x7f1900158760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:12.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.425+0000 7f1906158640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f19000ae330 con 0x7f19000b2cb0 2024-09-21T03:22:12.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.425+0000 7f1906158640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f19000ae1b0 con 0x7f190015b8f0 2024-09-21T03:22:12.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.425+0000 7f1906158640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f19000ae4b0 con 0x7f19000b0520 2024-09-21T03:22:12.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.425+0000 7f18f7fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19000b2cb0 0x7f1900156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:12.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.425+0000 7f18f7fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19000b2cb0 0x7f1900156910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:45170/0 (socket says 172.21.15.105:45170) 2024-09-21T03:22:12.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.425+0000 7f18f7fff640 1 -- 172.21.15.105:0/1964900094 learned_addr learned my addr 172.21.15.105:0/1964900094 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:22:12.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.425+0000 7f18ff7fe640 1 --2- 172.21.15.105:0/1964900094 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19000b0520 0x7f19000ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:12.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.425+0000 7f18fffff640 1 --2- 172.21.15.105:0/1964900094 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f190015b8f0 0x7f1900158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:12.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.426+0000 7f18f7fff640 1 -- 172.21.15.105:0/1964900094 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19000b0520 msgr2=0x7f19000ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:12.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.426+0000 7f18f7fff640 1 --2- 172.21.15.105:0/1964900094 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19000b0520 0x7f19000ca960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:12.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.426+0000 7f18f7fff640 1 -- 172.21.15.105:0/1964900094 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f190015b8f0 msgr2=0x7f1900158760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:12.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.426+0000 7f18f7fff640 1 --2- 172.21.15.105:0/1964900094 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f190015b8f0 0x7f1900158760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:12.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.426+0000 7f18f7fff640 1 -- 172.21.15.105:0/1964900094 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1900156e50 con 0x7f19000b2cb0 2024-09-21T03:22:12.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.426+0000 7f18f7fff640 1 --2- 172.21.15.105:0/1964900094 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19000b2cb0 0x7f1900156910 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f18e800c3f0 tx=0x7f18e800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:12.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.426+0000 7f18fcff9640 1 -- 172.21.15.105:0/1964900094 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e8017070 con 0x7f19000b2cb0 2024-09-21T03:22:12.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.426+0000 7f1906158640 1 -- 172.21.15.105:0/1964900094 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f190009e830 con 0x7f19000b2cb0 2024-09-21T03:22:12.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.426+0000 7f18fcff9640 1 -- 172.21.15.105:0/1964900094 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f18e80053e0 con 0x7f19000b2cb0 2024-09-21T03:22:12.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.426+0000 7f18fcff9640 1 -- 172.21.15.105:0/1964900094 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e8003870 con 0x7f19000b2cb0 2024-09-21T03:22:12.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.426+0000 7f1906158640 1 -- 172.21.15.105:0/1964900094 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f190009d050 con 0x7f19000b2cb0 2024-09-21T03:22:12.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.427+0000 7f1906158640 1 -- 172.21.15.105:0/1964900094 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19000b30c0 con 0x7f19000b2cb0 2024-09-21T03:22:12.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.428+0000 7f18fcff9640 1 -- 172.21.15.105:0/1964900094 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f18e801a070 con 0x7f19000b2cb0 2024-09-21T03:22:12.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.428+0000 7f18fcff9640 1 --2- 172.21.15.105:0/1964900094 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f18e0078b90 0x7f18e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:12.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.428+0000 7f18fcff9640 1 -- 172.21.15.105:0/1964900094 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5767+0+0 (secure 0 0 0) 0x7f18e8099f20 con 0x7f19000b2cb0 2024-09-21T03:22:12.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.429+0000 7f18ff7fe640 1 --2- 172.21.15.105:0/1964900094 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f18e0078b90 0x7f18e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:12.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.429+0000 7f18ff7fe640 1 --2- 172.21.15.105:0/1964900094 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f18e0078b90 0x7f18e007b0a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f18f0033000 tx=0x7f18f0004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:12.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.433+0000 7f18fcff9640 1 -- 172.21.15.105:0/1964900094 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f19000b3600 con 0x7f19000b2cb0 2024-09-21T03:22:12.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.646+0000 7f1906158640 1 -- 172.21.15.105:0/1964900094 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f19001f48f0 con 0x7f19000b2cb0 2024-09-21T03:22:12.649 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.647+0000 7f18fcff9640 1 -- 172.21.15.105:0/1964900094 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f18e8061ce0 con 0x7f19000b2cb0 2024-09-21T03:22:12.649 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:22:12.649 INFO:teuthology.orchestra.run.smithi105.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-21T03:22:12.651 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.649+0000 7f1906158640 1 -- 172.21.15.105:0/1964900094 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f18e0078b90 msgr2=0x7f18e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:12.651 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.649+0000 7f1906158640 1 --2- 172.21.15.105:0/1964900094 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f18e0078b90 0x7f18e007b0a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f18f0033000 tx=0x7f18f0004730 comp rx=0 tx=0).stop 2024-09-21T03:22:12.651 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.649+0000 7f1906158640 1 -- 172.21.15.105:0/1964900094 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19000b2cb0 msgr2=0x7f1900156910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:12.651 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.649+0000 7f1906158640 1 --2- 172.21.15.105:0/1964900094 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19000b2cb0 0x7f1900156910 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f18e800c3f0 tx=0x7f18e800c7f0 comp rx=0 tx=0).stop 2024-09-21T03:22:12.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.649+0000 7f1906158640 1 -- 172.21.15.105:0/1964900094 shutdown_connections 2024-09-21T03:22:12.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.649+0000 7f1906158640 1 --2- 172.21.15.105:0/1964900094 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f18e0078b90 0x7f18e007b0a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:12.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.649+0000 7f1906158640 1 --2- 172.21.15.105:0/1964900094 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f190015b8f0 0x7f1900158760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:12.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.649+0000 7f1906158640 1 --2- 172.21.15.105:0/1964900094 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19000b2cb0 0x7f1900156910 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:12.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.649+0000 7f1906158640 1 --2- 172.21.15.105:0/1964900094 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19000b0520 0x7f19000ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:12.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.649+0000 7f1906158640 1 -- 172.21.15.105:0/1964900094 >> 172.21.15.105:0/1964900094 conn(0x7f19000cdcb0 msgr2=0x7f19000cb860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:12.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.649+0000 7f1906158640 1 -- 172.21.15.105:0/1964900094 shutdown_connections 2024-09-21T03:22:12.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.649+0000 7f1906158640 1 -- 172.21.15.105:0/1964900094 wait complete. 2024-09-21T03:22:12.662 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-21T03:22:12.662 INFO:tasks.ceph_test_case:waiting 120.0s for health warning matching MDS_CLIENT_RECALL 2024-09-21T03:22:12.662 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T03:22:12.723 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:22:12.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.772+0000 7ff52cb51640 1 -- 172.21.15.105:0/3349442819 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff510004d40 msgr2=0x7ff510005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:12.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.772+0000 7ff52cb51640 1 --2- 172.21.15.105:0/3349442819 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff510004d40 0x7ff510005190 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7ff520005fd0 tx=0x7ff510005830 comp rx=0 tx=0).stop 2024-09-21T03:22:12.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.772+0000 7ff526d9d640 1 -- 172.21.15.105:0/3349442819 reap_dead start 2024-09-21T03:22:12.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.772+0000 7ff52cb51640 1 -- 172.21.15.105:0/3349442819 shutdown_connections 2024-09-21T03:22:12.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.772+0000 7ff52cb51640 1 -- 172.21.15.105:0/3349442819 >> 172.21.15.105:0/3349442819 conn(0x7ff5280b1cb0 msgr2=0x7ff5280b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:12.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.772+0000 7ff52cb51640 1 -- 172.21.15.105:0/3349442819 shutdown_connections 2024-09-21T03:22:12.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.772+0000 7ff52cb51640 1 -- 172.21.15.105:0/3349442819 wait complete. 2024-09-21T03:22:12.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.774+0000 7ff52cb51640 1 Processor -- start 2024-09-21T03:22:12.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.774+0000 7ff52cb51640 1 -- start start 2024-09-21T03:22:12.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.776+0000 7ff52cb51640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff510004d40 0x7ff528154c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:12.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.776+0000 7ff52cb51640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff528155140 0x7ff52809d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:12.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.776+0000 7ff52cb51640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5281f56a0 0x7ff52809d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:12.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.776+0000 7ff52cb51640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff528073940 con 0x7ff5281f56a0 2024-09-21T03:22:12.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.776+0000 7ff52cb51640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff5280737c0 con 0x7ff510004d40 2024-09-21T03:22:12.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.776+0000 7ff52cb51640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff528073ac0 con 0x7ff528155140 2024-09-21T03:22:12.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.776+0000 7ff526d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5281f56a0 0x7ff52809d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:12.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.776+0000 7ff526d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5281f56a0 0x7ff52809d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:45192/0 (socket says 172.21.15.105:45192) 2024-09-21T03:22:12.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.776+0000 7ff526d9d640 1 -- 172.21.15.105:0/766805201 learned_addr learned my addr 172.21.15.105:0/766805201 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:22:12.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.776+0000 7ff525d9b640 1 --2- 172.21.15.105:0/766805201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff528155140 0x7ff52809d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:12.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.776+0000 7ff52659c640 1 --2- 172.21.15.105:0/766805201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff510004d40 0x7ff528154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:12.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.776+0000 7ff526d9d640 1 -- 172.21.15.105:0/766805201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff528155140 msgr2=0x7ff52809d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:12.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.776+0000 7ff526d9d640 1 --2- 172.21.15.105:0/766805201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff528155140 0x7ff52809d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:12.780 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.776+0000 7ff526d9d640 1 -- 172.21.15.105:0/766805201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff510004d40 msgr2=0x7ff528154c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:12.780 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.776+0000 7ff526d9d640 1 --2- 172.21.15.105:0/766805201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff510004d40 0x7ff528154c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:12.780 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.776+0000 7ff526d9d640 1 -- 172.21.15.105:0/766805201 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff528152dc0 con 0x7ff5281f56a0 2024-09-21T03:22:12.780 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.776+0000 7ff526d9d640 1 --2- 172.21.15.105:0/766805201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5281f56a0 0x7ff52809d890 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7ff520009f10 tx=0x7ff520033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:12.780 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.776+0000 7ff516ffd640 1 -- 172.21.15.105:0/766805201 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff520038040 con 0x7ff5281f56a0 2024-09-21T03:22:12.780 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.776+0000 7ff516ffd640 1 -- 172.21.15.105:0/766805201 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff520045070 con 0x7ff5281f56a0 2024-09-21T03:22:12.780 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.776+0000 7ff516ffd640 1 -- 172.21.15.105:0/766805201 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff520033a40 con 0x7ff5281f56a0 2024-09-21T03:22:12.780 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.776+0000 7ff52cb51640 1 -- 172.21.15.105:0/766805201 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5281530a0 con 0x7ff5281f56a0 2024-09-21T03:22:12.780 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.777+0000 7ff52cb51640 1 -- 172.21.15.105:0/766805201 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff528153660 con 0x7ff5281f56a0 2024-09-21T03:22:12.781 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.777+0000 7ff52cb51640 1 -- 172.21.15.105:0/766805201 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5280cba00 con 0x7ff5281f56a0 2024-09-21T03:22:12.781 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.778+0000 7ff516ffd640 1 -- 172.21.15.105:0/766805201 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff520033be0 con 0x7ff5281f56a0 2024-09-21T03:22:12.781 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.779+0000 7ff516ffd640 1 --2- 172.21.15.105:0/766805201 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff508078b90 0x7ff50807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:12.781 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.779+0000 7ff516ffd640 1 -- 172.21.15.105:0/766805201 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5767+0+0 (secure 0 0 0) 0x7ff5200bdc60 con 0x7ff5281f56a0 2024-09-21T03:22:12.781 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.779+0000 7ff52659c640 1 --2- 172.21.15.105:0/766805201 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff508078b90 0x7ff50807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:12.781 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.780+0000 7ff52659c640 1 --2- 172.21.15.105:0/766805201 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff508078b90 0x7ff50807b0a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff518000ff0 tx=0x7ff518001cd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:12.785 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.783+0000 7ff516ffd640 1 -- 172.21.15.105:0/766805201 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff520085a10 con 0x7ff5281f56a0 2024-09-21T03:22:13.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.998+0000 7ff52cb51640 1 -- 172.21.15.105:0/766805201 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff52809e0d0 con 0x7ff5281f56a0 2024-09-21T03:22:13.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:12.999+0000 7ff516ffd640 1 -- 172.21.15.105:0/766805201 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7ff52008a440 con 0x7ff5281f56a0 2024-09-21T03:22:13.001 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:22:13.001 INFO:teuthology.orchestra.run.smithi105.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-21T03:22:13.003 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:13.001+0000 7ff52cb51640 1 -- 172.21.15.105:0/766805201 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff508078b90 msgr2=0x7ff50807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:13.003 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:13.001+0000 7ff52cb51640 1 --2- 172.21.15.105:0/766805201 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff508078b90 0x7ff50807b0a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff518000ff0 tx=0x7ff518001cd0 comp rx=0 tx=0).stop 2024-09-21T03:22:13.003 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:13.001+0000 7ff52cb51640 1 -- 172.21.15.105:0/766805201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5281f56a0 msgr2=0x7ff52809d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:13.003 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:13.001+0000 7ff52cb51640 1 --2- 172.21.15.105:0/766805201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5281f56a0 0x7ff52809d890 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7ff520009f10 tx=0x7ff520033670 comp rx=0 tx=0).stop 2024-09-21T03:22:13.003 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:13.001+0000 7ff52cb51640 1 -- 172.21.15.105:0/766805201 shutdown_connections 2024-09-21T03:22:13.003 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:13.001+0000 7ff52cb51640 1 --2- 172.21.15.105:0/766805201 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff508078b90 0x7ff50807b0a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:13.003 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:13.001+0000 7ff52cb51640 1 --2- 172.21.15.105:0/766805201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5281f56a0 0x7ff52809d890 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:13.003 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:13.001+0000 7ff52cb51640 1 --2- 172.21.15.105:0/766805201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff528155140 0x7ff52809d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:13.003 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:13.001+0000 7ff52cb51640 1 --2- 172.21.15.105:0/766805201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff510004d40 0x7ff528154c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:13.003 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:13.001+0000 7ff52cb51640 1 -- 172.21.15.105:0/766805201 >> 172.21.15.105:0/766805201 conn(0x7ff5280b1cb0 msgr2=0x7ff5280b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:13.004 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:13.001+0000 7ff52cb51640 1 -- 172.21.15.105:0/766805201 shutdown_connections 2024-09-21T03:22:13.004 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:13.001+0000 7ff52cb51640 1 -- 172.21.15.105:0/766805201 wait complete. 2024-09-21T03:22:13.014 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-21T03:22:13.014 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-21T03:22:14.725 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:22:16.727 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:22:18.015 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T03:22:18.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.139+0000 7f462b713640 1 -- 172.21.15.105:0/3897725822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46240ceb40 msgr2=0x7f46240cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:18.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.139+0000 7f462b713640 1 --2- 172.21.15.105:0/3897725822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46240ceb40 0x7f46240cef50 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f461c005fd0 tx=0x7f461c02a820 comp rx=0 tx=0).stop 2024-09-21T03:22:18.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.139+0000 7f462b713640 1 -- 172.21.15.105:0/3897725822 shutdown_connections 2024-09-21T03:22:18.142 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.139+0000 7f462b713640 1 --2- 172.21.15.105:0/3897725822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46240ceb40 0x7f46240cef50 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:18.142 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.139+0000 7f462b713640 1 -- 172.21.15.105:0/3897725822 >> 172.21.15.105:0/3897725822 conn(0x7f462408bfc0 msgr2=0x7f462409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:18.142 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.139+0000 7f462b713640 1 -- 172.21.15.105:0/3897725822 shutdown_connections 2024-09-21T03:22:18.142 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.139+0000 7f462b713640 1 -- 172.21.15.105:0/3897725822 wait complete. 2024-09-21T03:22:18.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.141+0000 7f462b713640 1 Processor -- start 2024-09-21T03:22:18.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.141+0000 7f462b713640 1 -- start start 2024-09-21T03:22:18.145 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.142+0000 7f462b713640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46240b3540 0x7f46241f54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:18.145 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.142+0000 7f462b713640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46240ceb40 0x7f46240cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:18.145 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.143+0000 7f462b713640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46241f5a10 0x7f46240ce490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:18.145 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.143+0000 7f462b713640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f46240d1070 con 0x7f46240b3540 2024-09-21T03:22:18.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.143+0000 7f462b713640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f46240d0ef0 con 0x7f46240ceb40 2024-09-21T03:22:18.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.143+0000 7f462b713640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f46240d11f0 con 0x7f46241f5a10 2024-09-21T03:22:18.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.143+0000 7f46294af640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46240b3540 0x7f46241f54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:18.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.143+0000 7f46294af640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46240b3540 0x7f46241f54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:45208/0 (socket says 172.21.15.105:45208) 2024-09-21T03:22:18.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.143+0000 7f46294af640 1 -- 172.21.15.105:0/581911115 learned_addr learned my addr 172.21.15.105:0/581911115 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:22:18.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.143+0000 7f4628cae640 1 --2- 172.21.15.105:0/581911115 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46240ceb40 0x7f46240cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:18.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.143+0000 7f4629cb0640 1 --2- 172.21.15.105:0/581911115 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46241f5a10 0x7f46240ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:18.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.143+0000 7f46294af640 1 -- 172.21.15.105:0/581911115 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46241f5a10 msgr2=0x7f46240ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:18.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.143+0000 7f46294af640 1 --2- 172.21.15.105:0/581911115 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46241f5a10 0x7f46240ce490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:18.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.143+0000 7f46294af640 1 -- 172.21.15.105:0/581911115 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46240ceb40 msgr2=0x7f46240cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:18.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.143+0000 7f46294af640 1 --2- 172.21.15.105:0/581911115 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46240ceb40 0x7f46240cdf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:18.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.143+0000 7f46294af640 1 -- 172.21.15.105:0/581911115 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46240c85f0 con 0x7f46240b3540 2024-09-21T03:22:18.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.143+0000 7f46294af640 1 --2- 172.21.15.105:0/581911115 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46240b3540 0x7f46241f54d0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f462000b3f0 tx=0x7f462000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:18.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.143+0000 7f4619ffb640 1 -- 172.21.15.105:0/581911115 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4620015020 con 0x7f46240b3540 2024-09-21T03:22:18.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.143+0000 7f4619ffb640 1 -- 172.21.15.105:0/581911115 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4620011920 con 0x7f46240b3540 2024-09-21T03:22:18.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.143+0000 7f462b713640 1 -- 172.21.15.105:0/581911115 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46240c88d0 con 0x7f46240b3540 2024-09-21T03:22:18.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.143+0000 7f4619ffb640 1 -- 172.21.15.105:0/581911115 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4620011d70 con 0x7f46240b3540 2024-09-21T03:22:18.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.144+0000 7f462b713640 1 -- 172.21.15.105:0/581911115 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46240c8e90 con 0x7f46240b3540 2024-09-21T03:22:18.148 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.145+0000 7f462b713640 1 -- 172.21.15.105:0/581911115 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f462406edf0 con 0x7f46240b3540 2024-09-21T03:22:18.148 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.145+0000 7f4619ffb640 1 -- 172.21.15.105:0/581911115 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4620018020 con 0x7f46240b3540 2024-09-21T03:22:18.148 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.146+0000 7f4619ffb640 1 --2- 172.21.15.105:0/581911115 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4608078bc0 0x7f460807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:18.148 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.146+0000 7f4619ffb640 1 -- 172.21.15.105:0/581911115 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5767+0+0 (secure 0 0 0) 0x7f462009a9b0 con 0x7f46240b3540 2024-09-21T03:22:18.148 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.146+0000 7f4628cae640 1 --2- 172.21.15.105:0/581911115 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4608078bc0 0x7f460807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:18.148 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.147+0000 7f4628cae640 1 --2- 172.21.15.105:0/581911115 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4608078bc0 0x7f460807b0d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f46140046b0 tx=0x7f4614009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:18.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.151+0000 7f4619ffb640 1 -- 172.21.15.105:0/581911115 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f462406edf0 con 0x7f46240b3540 2024-09-21T03:22:18.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.363+0000 7f462b713640 1 -- 172.21.15.105:0/581911115 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f462406e170 con 0x7f46240b3540 2024-09-21T03:22:18.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.363+0000 7f4619ffb640 1 -- 172.21.15.105:0/581911115 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f462001f030 con 0x7f46240b3540 2024-09-21T03:22:18.365 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:22:18.365 INFO:teuthology.orchestra.run.smithi105.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-21T03:22:18.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.365+0000 7f462b713640 1 -- 172.21.15.105:0/581911115 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4608078bc0 msgr2=0x7f460807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:18.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.365+0000 7f462b713640 1 --2- 172.21.15.105:0/581911115 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4608078bc0 0x7f460807b0d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f46140046b0 tx=0x7f4614009040 comp rx=0 tx=0).stop 2024-09-21T03:22:18.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.365+0000 7f462b713640 1 -- 172.21.15.105:0/581911115 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46240b3540 msgr2=0x7f46241f54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:18.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.365+0000 7f462b713640 1 --2- 172.21.15.105:0/581911115 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46240b3540 0x7f46241f54d0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f462000b3f0 tx=0x7f462000b8b0 comp rx=0 tx=0).stop 2024-09-21T03:22:18.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.365+0000 7f462b713640 1 -- 172.21.15.105:0/581911115 shutdown_connections 2024-09-21T03:22:18.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.365+0000 7f462b713640 1 --2- 172.21.15.105:0/581911115 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4608078bc0 0x7f460807b0d0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:18.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.365+0000 7f462b713640 1 --2- 172.21.15.105:0/581911115 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46241f5a10 0x7f46240ce490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:18.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.365+0000 7f462b713640 1 --2- 172.21.15.105:0/581911115 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46240ceb40 0x7f46240cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:18.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.365+0000 7f462b713640 1 --2- 172.21.15.105:0/581911115 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46240b3540 0x7f46241f54d0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:18.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.365+0000 7f462b713640 1 -- 172.21.15.105:0/581911115 >> 172.21.15.105:0/581911115 conn(0x7f462408bfc0 msgr2=0x7f4624068eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:18.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.365+0000 7f462b713640 1 -- 172.21.15.105:0/581911115 shutdown_connections 2024-09-21T03:22:18.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:18.365+0000 7f462b713640 1 -- 172.21.15.105:0/581911115 wait complete. 2024-09-21T03:22:18.378 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-21T03:22:18.378 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-21T03:22:18.729 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:22:20.732 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:22:22.734 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:22:23.379 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T03:22:23.504 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.502+0000 7f03ba0de640 1 -- 172.21.15.105:0/2901118551 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03a0004800 msgr2=0x7f03a0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:23.504 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.502+0000 7f03ba0de640 1 --2- 172.21.15.105:0/2901118551 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03a0004800 0x7f03a0004c10 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f03b40d5560 tx=0x7f03a0005830 comp rx=0 tx=0).stop 2024-09-21T03:22:23.505 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.502+0000 7f03b3fff640 1 -- 172.21.15.105:0/2901118551 reap_dead start 2024-09-21T03:22:23.505 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.502+0000 7f03ba0de640 1 -- 172.21.15.105:0/2901118551 shutdown_connections 2024-09-21T03:22:23.505 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.503+0000 7f03ba0de640 1 -- 172.21.15.105:0/2901118551 >> 172.21.15.105:0/2901118551 conn(0x7f03b408bfc0 msgr2=0x7f03b409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:23.505 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.503+0000 7f03ba0de640 1 -- 172.21.15.105:0/2901118551 shutdown_connections 2024-09-21T03:22:23.505 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.503+0000 7f03ba0de640 1 -- 172.21.15.105:0/2901118551 wait complete. 2024-09-21T03:22:23.506 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.504+0000 7f03ba0de640 1 Processor -- start 2024-09-21T03:22:23.506 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.504+0000 7f03ba0de640 1 -- start start 2024-09-21T03:22:23.508 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.506+0000 7f03ba0de640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03a0004800 0x7f03b414e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:23.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.506+0000 7f03ba0de640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03b41e9c30 0x7f03b40b7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:23.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.506+0000 7f03ba0de640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03b40b8250 0x7f03b40cd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:23.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.506+0000 7f03ba0de640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f03b40cf3d0 con 0x7f03b41e9c30 2024-09-21T03:22:23.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.506+0000 7f03ba0de640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f03b40cf250 con 0x7f03b40b8250 2024-09-21T03:22:23.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.506+0000 7f03ba0de640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f03b40b3540 con 0x7f03a0004800 2024-09-21T03:22:23.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.506+0000 7f03abfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03b41e9c30 0x7f03b40b7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:23.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.506+0000 7f03abfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03b41e9c30 0x7f03b40b7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:39534/0 (socket says 172.21.15.105:39534) 2024-09-21T03:22:23.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.506+0000 7f03abfff640 1 -- 172.21.15.105:0/2025361174 learned_addr learned my addr 172.21.15.105:0/2025361174 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:22:23.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.506+0000 7f03b37fe640 1 --2- 172.21.15.105:0/2025361174 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03a0004800 0x7f03b414e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:23.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.506+0000 7f03b3fff640 1 --2- 172.21.15.105:0/2025361174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03b40b8250 0x7f03b40cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:23.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.506+0000 7f03abfff640 1 -- 172.21.15.105:0/2025361174 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03a0004800 msgr2=0x7f03b414e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:23.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.506+0000 7f03abfff640 1 --2- 172.21.15.105:0/2025361174 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03a0004800 0x7f03b414e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:23.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.506+0000 7f03abfff640 1 -- 172.21.15.105:0/2025361174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03b40b8250 msgr2=0x7f03b40cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:23.510 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.506+0000 7f03abfff640 1 --2- 172.21.15.105:0/2025361174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03b40b8250 0x7f03b40cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:23.510 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.506+0000 7f03abfff640 1 -- 172.21.15.105:0/2025361174 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03b40b8660 con 0x7f03b41e9c30 2024-09-21T03:22:23.510 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.506+0000 7f03abfff640 1 --2- 172.21.15.105:0/2025361174 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03b41e9c30 0x7f03b40b7d10 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f039c036040 tx=0x7f039c0336f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:23.510 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.506+0000 7f03b0ff9640 1 -- 172.21.15.105:0/2025361174 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f039c038040 con 0x7f03b41e9c30 2024-09-21T03:22:23.510 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.506+0000 7f03b0ff9640 1 -- 172.21.15.105:0/2025361174 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f039c0338e0 con 0x7f03b41e9c30 2024-09-21T03:22:23.510 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.506+0000 7f03ba0de640 1 -- 172.21.15.105:0/2025361174 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03b4160ee0 con 0x7f03b41e9c30 2024-09-21T03:22:23.510 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.506+0000 7f03b0ff9640 1 -- 172.21.15.105:0/2025361174 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f039c033d30 con 0x7f03b41e9c30 2024-09-21T03:22:23.510 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.507+0000 7f03ba0de640 1 -- 172.21.15.105:0/2025361174 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03b40ccd90 con 0x7f03b41e9c30 2024-09-21T03:22:23.511 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.507+0000 7f03ba0de640 1 -- 172.21.15.105:0/2025361174 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03b40b5670 con 0x7f03b41e9c30 2024-09-21T03:22:23.511 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.508+0000 7f03b0ff9640 1 -- 172.21.15.105:0/2025361174 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f039c043020 con 0x7f03b41e9c30 2024-09-21T03:22:23.511 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.509+0000 7f03b0ff9640 1 --2- 172.21.15.105:0/2025361174 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0394078b90 0x7f039407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:23.511 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.509+0000 7f03b0ff9640 1 -- 172.21.15.105:0/2025361174 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5767+0+0 (secure 0 0 0) 0x7f039c0baee0 con 0x7f03b41e9c30 2024-09-21T03:22:23.511 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.509+0000 7f03b37fe640 1 --2- 172.21.15.105:0/2025361174 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0394078b90 0x7f039407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:23.511 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.509+0000 7f03b37fe640 1 --2- 172.21.15.105:0/2025361174 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0394078b90 0x7f039407b0a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f03a4009ab0 tx=0x7f03a4005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:23.515 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.513+0000 7f03b0ff9640 1 -- 172.21.15.105:0/2025361174 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f03b40b5670 con 0x7f03b41e9c30 2024-09-21T03:22:23.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.726+0000 7f03ba0de640 1 -- 172.21.15.105:0/2025361174 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f03b40d3330 con 0x7f03b41e9c30 2024-09-21T03:22:23.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.726+0000 7f03b0ff9640 1 -- 172.21.15.105:0/2025361174 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f039c04a020 con 0x7f03b41e9c30 2024-09-21T03:22:23.728 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:22:23.728 INFO:teuthology.orchestra.run.smithi105.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-21T03:22:23.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.728+0000 7f03ba0de640 1 -- 172.21.15.105:0/2025361174 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0394078b90 msgr2=0x7f039407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:23.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.728+0000 7f03ba0de640 1 --2- 172.21.15.105:0/2025361174 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0394078b90 0x7f039407b0a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f03a4009ab0 tx=0x7f03a4005f90 comp rx=0 tx=0).stop 2024-09-21T03:22:23.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.728+0000 7f03ba0de640 1 -- 172.21.15.105:0/2025361174 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03b41e9c30 msgr2=0x7f03b40b7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:23.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.728+0000 7f03ba0de640 1 --2- 172.21.15.105:0/2025361174 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03b41e9c30 0x7f03b40b7d10 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f039c036040 tx=0x7f039c0336f0 comp rx=0 tx=0).stop 2024-09-21T03:22:23.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.728+0000 7f03ba0de640 1 -- 172.21.15.105:0/2025361174 shutdown_connections 2024-09-21T03:22:23.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.728+0000 7f03ba0de640 1 --2- 172.21.15.105:0/2025361174 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0394078b90 0x7f039407b0a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:23.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.728+0000 7f03ba0de640 1 --2- 172.21.15.105:0/2025361174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03b40b8250 0x7f03b40cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:23.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.728+0000 7f03ba0de640 1 --2- 172.21.15.105:0/2025361174 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03b41e9c30 0x7f03b40b7d10 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:23.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.728+0000 7f03ba0de640 1 --2- 172.21.15.105:0/2025361174 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03a0004800 0x7f03b414e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:23.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.728+0000 7f03ba0de640 1 -- 172.21.15.105:0/2025361174 >> 172.21.15.105:0/2025361174 conn(0x7f03b408bfc0 msgr2=0x7f03b40d0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:23.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.728+0000 7f03ba0de640 1 -- 172.21.15.105:0/2025361174 shutdown_connections 2024-09-21T03:22:23.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:23.728+0000 7f03ba0de640 1 -- 172.21.15.105:0/2025361174 wait complete. 2024-09-21T03:22:23.741 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-21T03:22:23.741 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-21T03:22:24.736 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:22:26.541 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:22:26.545 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:22:26.738 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:22:28.740 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:22:28.742 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T03:22:28.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:28.864+0000 7fd6a3e25640 1 -- 172.21.15.105:0/3911039721 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd69c0af780 msgr2=0x7fd69c0b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:28.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:28.864+0000 7fd6a3e25640 1 --2- 172.21.15.105:0/3911039721 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd69c0af780 0x7fd69c0b39c0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fd698009830 tx=0x7fd69802a5c0 comp rx=0 tx=0).stop 2024-09-21T03:22:28.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:28.864+0000 7fd6a3e25640 1 -- 172.21.15.105:0/3911039721 shutdown_connections 2024-09-21T03:22:28.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:28.864+0000 7fd6a3e25640 1 --2- 172.21.15.105:0/3911039721 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd69c0af780 0x7fd69c0b39c0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:28.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:28.864+0000 7fd6a3e25640 1 -- 172.21.15.105:0/3911039721 >> 172.21.15.105:0/3911039721 conn(0x7fd69c06d7d0 msgr2=0x7fd69c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:28.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:28.864+0000 7fd6a3e25640 1 -- 172.21.15.105:0/3911039721 shutdown_connections 2024-09-21T03:22:28.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:28.864+0000 7fd6a3e25640 1 -- 172.21.15.105:0/3911039721 wait complete. 2024-09-21T03:22:28.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:28.866+0000 7fd6a3e25640 1 Processor -- start 2024-09-21T03:22:28.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:28.866+0000 7fd6a3e25640 1 -- start start 2024-09-21T03:22:28.871 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:28.867+0000 7fd6a3e25640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd69c072ff0 0x7fd69c152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:28.871 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:28.867+0000 7fd6a3e25640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd69c0af780 0x7fd69c09c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:28.871 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:28.867+0000 7fd6a3e25640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd69c0cd3e0 0x7fd69c157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:28.871 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:28.867+0000 7fd6a3e25640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd69c166bf0 con 0x7fd69c0af780 2024-09-21T03:22:28.871 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:28.867+0000 7fd6a3e25640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd69c0cda00 con 0x7fd69c0cd3e0 2024-09-21T03:22:28.871 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:28.867+0000 7fd6a3e25640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd69c166d70 con 0x7fd69c072ff0 2024-09-21T03:22:28.871 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:28.867+0000 7fd6a13c0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd69c0af780 0x7fd69c09c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:28.872 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:28.868+0000 7fd6a13c0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd69c0af780 0x7fd69c09c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:39552/0 (socket says 172.21.15.105:39552) 2024-09-21T03:22:28.872 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:28.868+0000 7fd6a13c0640 1 -- 172.21.15.105:0/2083372516 learned_addr learned my addr 172.21.15.105:0/2083372516 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:22:28.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:28.868+0000 7fd6a1bc1640 1 --2- 172.21.15.105:0/2083372516 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd69c072ff0 0x7fd69c152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:28.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:28.868+0000 7fd6a23c2640 1 --2- 172.21.15.105:0/2083372516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd69c0cd3e0 0x7fd69c157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:28.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:28.868+0000 7fd6a13c0640 1 -- 172.21.15.105:0/2083372516 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd69c072ff0 msgr2=0x7fd69c152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:28.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:28.868+0000 7fd6a13c0640 1 --2- 172.21.15.105:0/2083372516 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd69c072ff0 0x7fd69c152c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:28.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:28.868+0000 7fd6a13c0640 1 -- 172.21.15.105:0/2083372516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd69c0cd3e0 msgr2=0x7fd69c157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:28.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:28.868+0000 7fd6a13c0640 1 --2- 172.21.15.105:0/2083372516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd69c0cd3e0 0x7fd69c157d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:28.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:28.868+0000 7fd6a13c0640 1 -- 172.21.15.105:0/2083372516 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd69c09c990 con 0x7fd69c0af780 2024-09-21T03:22:28.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:28.868+0000 7fd6a23c2640 1 --2- 172.21.15.105:0/2083372516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd69c0cd3e0 0x7fd69c157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:22:28.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:28.868+0000 7fd6a13c0640 1 --2- 172.21.15.105:0/2083372516 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd69c0af780 0x7fd69c09c450 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fd68c001eb0 tx=0x7fd68c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:28.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:28.868+0000 7fd6927fc640 1 -- 172.21.15.105:0/2083372516 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd68c017070 con 0x7fd69c0af780 2024-09-21T03:22:28.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:28.868+0000 7fd6927fc640 1 -- 172.21.15.105:0/2083372516 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd68c0053c0 con 0x7fd69c0af780 2024-09-21T03:22:28.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:28.868+0000 7fd6a3e25640 1 -- 172.21.15.105:0/2083372516 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd69c15afc0 con 0x7fd69c0af780 2024-09-21T03:22:28.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:28.868+0000 7fd6927fc640 1 -- 172.21.15.105:0/2083372516 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd68c003830 con 0x7fd69c0af780 2024-09-21T03:22:28.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:28.868+0000 7fd6a3e25640 1 -- 172.21.15.105:0/2083372516 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd69c09ab60 con 0x7fd69c0af780 2024-09-21T03:22:28.875 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:28.869+0000 7fd6a3e25640 1 -- 172.21.15.105:0/2083372516 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd69c0b39c0 con 0x7fd69c0af780 2024-09-21T03:22:28.875 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:28.870+0000 7fd6927fc640 1 -- 172.21.15.105:0/2083372516 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd68c01a070 con 0x7fd69c0af780 2024-09-21T03:22:28.875 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:28.871+0000 7fd6927fc640 1 --2- 172.21.15.105:0/2083372516 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd680078bc0 0x7fd68007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:28.875 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:28.871+0000 7fd6a1bc1640 1 --2- 172.21.15.105:0/2083372516 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd680078bc0 0x7fd68007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:28.875 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:28.871+0000 7fd6927fc640 1 -- 172.21.15.105:0/2083372516 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5767+0+0 (secure 0 0 0) 0x7fd68c09a030 con 0x7fd69c0af780 2024-09-21T03:22:28.875 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:28.871+0000 7fd6a1bc1640 1 --2- 172.21.15.105:0/2083372516 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd680078bc0 0x7fd68007b0d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd698034000 tx=0x7fd698004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:28.878 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:28.875+0000 7fd6927fc640 1 -- 172.21.15.105:0/2083372516 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd68c062550 con 0x7fd69c0af780 2024-09-21T03:22:29.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:29.091+0000 7fd6a3e25640 1 -- 172.21.15.105:0/2083372516 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd69c0b0de0 con 0x7fd69c0af780 2024-09-21T03:22:29.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:29.091+0000 7fd6927fc640 1 -- 172.21.15.105:0/2083372516 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7fd68c061e50 con 0x7fd69c0af780 2024-09-21T03:22:29.094 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:22:29.095 INFO:teuthology.orchestra.run.smithi105.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-21T03:22:29.096 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:29.093+0000 7fd6a3e25640 1 -- 172.21.15.105:0/2083372516 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd680078bc0 msgr2=0x7fd68007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:29.096 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:29.093+0000 7fd6a3e25640 1 --2- 172.21.15.105:0/2083372516 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd680078bc0 0x7fd68007b0d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd698034000 tx=0x7fd698004730 comp rx=0 tx=0).stop 2024-09-21T03:22:29.097 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:29.093+0000 7fd6a3e25640 1 -- 172.21.15.105:0/2083372516 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd69c0af780 msgr2=0x7fd69c09c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:29.097 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:29.093+0000 7fd6a3e25640 1 --2- 172.21.15.105:0/2083372516 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd69c0af780 0x7fd69c09c450 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fd68c001eb0 tx=0x7fd68c00c890 comp rx=0 tx=0).stop 2024-09-21T03:22:29.097 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:29.093+0000 7fd6a3e25640 1 -- 172.21.15.105:0/2083372516 shutdown_connections 2024-09-21T03:22:29.097 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:29.093+0000 7fd6a3e25640 1 --2- 172.21.15.105:0/2083372516 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd680078bc0 0x7fd68007b0d0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:29.097 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:29.093+0000 7fd6a3e25640 1 --2- 172.21.15.105:0/2083372516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd69c0cd3e0 0x7fd69c157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:29.097 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:29.093+0000 7fd6a3e25640 1 --2- 172.21.15.105:0/2083372516 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd69c0af780 0x7fd69c09c450 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:29.097 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:29.093+0000 7fd6a3e25640 1 --2- 172.21.15.105:0/2083372516 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd69c072ff0 0x7fd69c152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:29.097 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:29.093+0000 7fd6a3e25640 1 -- 172.21.15.105:0/2083372516 >> 172.21.15.105:0/2083372516 conn(0x7fd69c06d7d0 msgr2=0x7fd69c0ced10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:29.097 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:29.093+0000 7fd6a3e25640 1 -- 172.21.15.105:0/2083372516 shutdown_connections 2024-09-21T03:22:29.097 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:29.093+0000 7fd6a3e25640 1 -- 172.21.15.105:0/2083372516 wait complete. 2024-09-21T03:22:29.108 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-21T03:22:29.108 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-21T03:22:30.741 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:22:32.743 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:22:34.109 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T03:22:34.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.231+0000 7f1b58fe4640 1 -- 172.21.15.105:0/707312381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1b540cfb00 msgr2=0x7f1b5415bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:34.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.231+0000 7f1b58fe4640 1 --2- 172.21.15.105:0/707312381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1b540cfb00 0x7f1b5415bf20 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f1b54071270 tx=0x7f1b4402aa30 comp rx=0 tx=0).stop 2024-09-21T03:22:34.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.231+0000 7f1b58fe4640 1 -- 172.21.15.105:0/707312381 shutdown_connections 2024-09-21T03:22:34.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.231+0000 7f1b58fe4640 1 --2- 172.21.15.105:0/707312381 >> v2:172.21.15.162:3300/0 conn(0x7f1b540cf570 0x7f1b540caee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:34.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.231+0000 7f1b58fe4640 1 --2- 172.21.15.105:0/707312381 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1b540cf160 0x7f1b540ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:34.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.231+0000 7f1b58fe4640 1 --2- 172.21.15.105:0/707312381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1b540cfb00 0x7f1b5415bf20 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:34.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.231+0000 7f1b58fe4640 1 -- 172.21.15.105:0/707312381 >> 172.21.15.105:0/707312381 conn(0x7f1b540b1cb0 msgr2=0x7f1b540b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:34.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.231+0000 7f1b58fe4640 1 -- 172.21.15.105:0/707312381 shutdown_connections 2024-09-21T03:22:34.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.231+0000 7f1b58fe4640 1 -- 172.21.15.105:0/707312381 wait complete. 2024-09-21T03:22:34.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.233+0000 7f1b58fe4640 1 Processor -- start 2024-09-21T03:22:34.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.233+0000 7f1b58fe4640 1 -- start start 2024-09-21T03:22:34.238 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.235+0000 7f1b58fe4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1b540cf160 0x7f1b541597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:34.238 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.235+0000 7f1b58fe4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b540cf570 0x7f1b541f6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:34.238 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.235+0000 7f1b58fe4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1b540cfb00 0x7f1b541f7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:34.238 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.235+0000 7f1b58fe4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1b5415ee20 con 0x7f1b540cfb00 2024-09-21T03:22:34.238 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.235+0000 7f1b58fe4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1b5415eca0 con 0x7f1b540cf570 2024-09-21T03:22:34.238 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.235+0000 7f1b58fe4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1b5415efa0 con 0x7f1b540cf160 2024-09-21T03:22:34.239 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.235+0000 7f1b52d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1b540cfb00 0x7f1b541f7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:34.239 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.235+0000 7f1b52d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1b540cfb00 0x7f1b541f7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:54606/0 (socket says 172.21.15.105:54606) 2024-09-21T03:22:34.239 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.235+0000 7f1b52d9d640 1 -- 172.21.15.105:0/2205101619 learned_addr learned my addr 172.21.15.105:0/2205101619 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:22:34.239 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.235+0000 7f1b51d9b640 1 --2- 172.21.15.105:0/2205101619 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b540cf570 0x7f1b541f6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:34.239 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.235+0000 7f1b5259c640 1 --2- 172.21.15.105:0/2205101619 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1b540cf160 0x7f1b541597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:34.239 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.235+0000 7f1b52d9d640 1 -- 172.21.15.105:0/2205101619 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1b540cf160 msgr2=0x7f1b541597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:34.239 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.235+0000 7f1b52d9d640 1 --2- 172.21.15.105:0/2205101619 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1b540cf160 0x7f1b541597e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:34.239 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.235+0000 7f1b52d9d640 1 -- 172.21.15.105:0/2205101619 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b540cf570 msgr2=0x7f1b541f6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:34.239 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.235+0000 7f1b52d9d640 1 --2- 172.21.15.105:0/2205101619 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b540cf570 0x7f1b541f6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:34.239 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.235+0000 7f1b52d9d640 1 -- 172.21.15.105:0/2205101619 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b541f4660 con 0x7f1b540cfb00 2024-09-21T03:22:34.239 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.235+0000 7f1b52d9d640 1 --2- 172.21.15.105:0/2205101619 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1b540cfb00 0x7f1b541f7370 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c00d660 tx=0x7f1b4c00db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:34.239 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.236+0000 7f1b42ffd640 1 -- 172.21.15.105:0/2205101619 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c017070 con 0x7f1b540cfb00 2024-09-21T03:22:34.239 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.236+0000 7f1b42ffd640 1 -- 172.21.15.105:0/2205101619 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b4c005310 con 0x7f1b540cfb00 2024-09-21T03:22:34.239 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.236+0000 7f1b58fe4640 1 -- 172.21.15.105:0/2205101619 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b541f38a0 con 0x7f1b540cfb00 2024-09-21T03:22:34.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.236+0000 7f1b42ffd640 1 -- 172.21.15.105:0/2205101619 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c009820 con 0x7f1b540cfb00 2024-09-21T03:22:34.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.236+0000 7f1b58fe4640 1 -- 172.21.15.105:0/2205101619 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b541f3e60 con 0x7f1b540cfb00 2024-09-21T03:22:34.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.237+0000 7f1b58fe4640 1 -- 172.21.15.105:0/2205101619 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b5415bf20 con 0x7f1b540cfb00 2024-09-21T03:22:34.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.237+0000 7f1b42ffd640 1 -- 172.21.15.105:0/2205101619 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1b4c0099c0 con 0x7f1b540cfb00 2024-09-21T03:22:34.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.238+0000 7f1b42ffd640 1 --2- 172.21.15.105:0/2205101619 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1b34078bc0 0x7f1b3407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:34.241 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.238+0000 7f1b42ffd640 1 -- 172.21.15.105:0/2205101619 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5767+0+0 (secure 0 0 0) 0x7f1b4c09acb0 con 0x7f1b540cfb00 2024-09-21T03:22:34.241 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.238+0000 7f1b5259c640 1 --2- 172.21.15.105:0/2205101619 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1b34078bc0 0x7f1b3407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:34.241 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.239+0000 7f1b5259c640 1 --2- 172.21.15.105:0/2205101619 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1b34078bc0 0x7f1b3407b0d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1b44035000 tx=0x7f1b4403b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:34.245 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.243+0000 7f1b42ffd640 1 -- 172.21.15.105:0/2205101619 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1b4c062af0 con 0x7f1b540cfb00 2024-09-21T03:22:34.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.457+0000 7f1b58fe4640 1 -- 172.21.15.105:0/2205101619 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1b540ccdd0 con 0x7f1b540cfb00 2024-09-21T03:22:34.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.458+0000 7f1b42ffd640 1 -- 172.21.15.105:0/2205101619 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f1b4c067520 con 0x7f1b540cfb00 2024-09-21T03:22:34.460 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:22:34.460 INFO:teuthology.orchestra.run.smithi105.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-21T03:22:34.462 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.460+0000 7f1b58fe4640 1 -- 172.21.15.105:0/2205101619 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1b34078bc0 msgr2=0x7f1b3407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:34.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.460+0000 7f1b58fe4640 1 --2- 172.21.15.105:0/2205101619 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1b34078bc0 0x7f1b3407b0d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1b44035000 tx=0x7f1b4403b040 comp rx=0 tx=0).stop 2024-09-21T03:22:34.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.460+0000 7f1b58fe4640 1 -- 172.21.15.105:0/2205101619 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1b540cfb00 msgr2=0x7f1b541f7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:34.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.460+0000 7f1b58fe4640 1 --2- 172.21.15.105:0/2205101619 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1b540cfb00 0x7f1b541f7370 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c00d660 tx=0x7f1b4c00db20 comp rx=0 tx=0).stop 2024-09-21T03:22:34.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.460+0000 7f1b58fe4640 1 -- 172.21.15.105:0/2205101619 shutdown_connections 2024-09-21T03:22:34.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.460+0000 7f1b58fe4640 1 --2- 172.21.15.105:0/2205101619 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1b34078bc0 0x7f1b3407b0d0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:34.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.460+0000 7f1b58fe4640 1 --2- 172.21.15.105:0/2205101619 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1b540cfb00 0x7f1b541f7370 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:34.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.460+0000 7f1b58fe4640 1 --2- 172.21.15.105:0/2205101619 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b540cf570 0x7f1b541f6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:34.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.460+0000 7f1b58fe4640 1 --2- 172.21.15.105:0/2205101619 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1b540cf160 0x7f1b541597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:34.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.460+0000 7f1b58fe4640 1 -- 172.21.15.105:0/2205101619 >> 172.21.15.105:0/2205101619 conn(0x7f1b540b1cb0 msgr2=0x7f1b5415a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:34.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.460+0000 7f1b58fe4640 1 -- 172.21.15.105:0/2205101619 shutdown_connections 2024-09-21T03:22:34.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:34.460+0000 7f1b58fe4640 1 -- 172.21.15.105:0/2205101619 wait complete. 2024-09-21T03:22:34.473 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-21T03:22:34.473 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-21T03:22:34.745 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:22:36.747 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:22:38.749 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:22:39.474 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T03:22:39.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.598+0000 7f74081e4640 1 -- 172.21.15.105:0/4250351111 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73e8004800 msgr2=0x7f73e8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:39.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.598+0000 7f74081e4640 1 --2- 172.21.15.105:0/4250351111 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73e8004800 0x7f73e8004c10 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f7400072de0 tx=0x7f73e8005830 comp rx=0 tx=0).stop 2024-09-21T03:22:39.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.598+0000 7f74081e4640 1 -- 172.21.15.105:0/4250351111 shutdown_connections 2024-09-21T03:22:39.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.598+0000 7f74081e4640 1 --2- 172.21.15.105:0/4250351111 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73e8004800 0x7f73e8004c10 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:39.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.598+0000 7f74081e4640 1 -- 172.21.15.105:0/4250351111 >> 172.21.15.105:0/4250351111 conn(0x7f74000b1cb0 msgr2=0x7f74000b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:39.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.598+0000 7f74081e4640 1 -- 172.21.15.105:0/4250351111 shutdown_connections 2024-09-21T03:22:39.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.598+0000 7f74081e4640 1 -- 172.21.15.105:0/4250351111 wait complete. 2024-09-21T03:22:39.601 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.600+0000 7f74081e4640 1 Processor -- start 2024-09-21T03:22:39.601 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.600+0000 7f74081e4640 1 -- start start 2024-09-21T03:22:39.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.601+0000 7f74081e4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73e8004800 0x7f74001f7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:39.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.601+0000 7f74081e4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f740009d040 0x7f740015b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:39.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.601+0000 7f74081e4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f740009d450 0x7f740015b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:39.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.601+0000 7f74081e4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7400074640 con 0x7f740009d450 2024-09-21T03:22:39.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.601+0000 7f74081e4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f740015cc60 con 0x7f740009d040 2024-09-21T03:22:39.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.601+0000 7f74081e4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f74000747c0 con 0x7f73e8004800 2024-09-21T03:22:39.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.601+0000 7f7406781640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f740009d450 0x7f740015b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:39.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.601+0000 7f7406781640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f740009d450 0x7f740015b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:54620/0 (socket says 172.21.15.105:54620) 2024-09-21T03:22:39.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.601+0000 7f7406781640 1 -- 172.21.15.105:0/3440072460 learned_addr learned my addr 172.21.15.105:0/3440072460 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:22:39.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.601+0000 7f740577f640 1 --2- 172.21.15.105:0/3440072460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f740009d040 0x7f740015b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:39.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.601+0000 7f7405f80640 1 --2- 172.21.15.105:0/3440072460 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73e8004800 0x7f74001f7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:39.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.602+0000 7f7406781640 1 -- 172.21.15.105:0/3440072460 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73e8004800 msgr2=0x7f74001f7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:39.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.602+0000 7f7406781640 1 --2- 172.21.15.105:0/3440072460 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73e8004800 0x7f74001f7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:39.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.602+0000 7f7406781640 1 -- 172.21.15.105:0/3440072460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f740009d040 msgr2=0x7f740015b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:39.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.602+0000 7f7406781640 1 --2- 172.21.15.105:0/3440072460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f740009d040 0x7f740015b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:39.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.602+0000 7f7406781640 1 -- 172.21.15.105:0/3440072460 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74001f4190 con 0x7f740009d450 2024-09-21T03:22:39.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.602+0000 7f7406781640 1 --2- 172.21.15.105:0/3440072460 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f740009d450 0x7f740015b780 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f74000cd410 tx=0x7f73f0010e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:39.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.602+0000 7f73fe7fc640 1 -- 172.21.15.105:0/3440072460 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f000edb0 con 0x7f740009d450 2024-09-21T03:22:39.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.602+0000 7f73fe7fc640 1 -- 172.21.15.105:0/3440072460 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f73f0015070 con 0x7f740009d450 2024-09-21T03:22:39.606 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.602+0000 7f74081e4640 1 -- 172.21.15.105:0/3440072460 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74001f3610 con 0x7f740009d450 2024-09-21T03:22:39.606 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.602+0000 7f73fe7fc640 1 -- 172.21.15.105:0/3440072460 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f0003bd0 con 0x7f740009d450 2024-09-21T03:22:39.606 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.602+0000 7f74081e4640 1 -- 172.21.15.105:0/3440072460 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74001f3bd0 con 0x7f740009d450 2024-09-21T03:22:39.607 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.603+0000 7f74081e4640 1 -- 172.21.15.105:0/3440072460 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7400074d20 con 0x7f740009d450 2024-09-21T03:22:39.607 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.604+0000 7f73fe7fc640 1 -- 172.21.15.105:0/3440072460 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f73f0004030 con 0x7f740009d450 2024-09-21T03:22:39.607 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.604+0000 7f73fe7fc640 1 --2- 172.21.15.105:0/3440072460 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f73ec078b90 0x7f73ec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:39.607 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.604+0000 7f73fe7fc640 1 -- 172.21.15.105:0/3440072460 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5767+0+0 (secure 0 0 0) 0x7f73f009b810 con 0x7f740009d450 2024-09-21T03:22:39.607 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.605+0000 7f7405f80640 1 --2- 172.21.15.105:0/3440072460 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f73ec078b90 0x7f73ec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:39.607 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.605+0000 7f7405f80640 1 --2- 172.21.15.105:0/3440072460 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f73ec078b90 0x7f73ec07b0a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f73f8006680 tx=0x7f73f8006b70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:39.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.609+0000 7f73fe7fc640 1 -- 172.21.15.105:0/3440072460 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f73f00635c0 con 0x7f740009d450 2024-09-21T03:22:39.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.825+0000 7f74081e4640 1 -- 172.21.15.105:0/3440072460 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f74000c3860 con 0x7f740009d450 2024-09-21T03:22:39.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.825+0000 7f73fe7fc640 1 -- 172.21.15.105:0/3440072460 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f73f0067ff0 con 0x7f740009d450 2024-09-21T03:22:39.827 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:22:39.827 INFO:teuthology.orchestra.run.smithi105.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-21T03:22:39.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.827+0000 7f74081e4640 1 -- 172.21.15.105:0/3440072460 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f73ec078b90 msgr2=0x7f73ec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:39.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.827+0000 7f74081e4640 1 --2- 172.21.15.105:0/3440072460 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f73ec078b90 0x7f73ec07b0a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f73f8006680 tx=0x7f73f8006b70 comp rx=0 tx=0).stop 2024-09-21T03:22:39.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.827+0000 7f74081e4640 1 -- 172.21.15.105:0/3440072460 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f740009d450 msgr2=0x7f740015b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:39.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.827+0000 7f74081e4640 1 --2- 172.21.15.105:0/3440072460 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f740009d450 0x7f740015b780 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f74000cd410 tx=0x7f73f0010e80 comp rx=0 tx=0).stop 2024-09-21T03:22:39.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.827+0000 7f74081e4640 1 -- 172.21.15.105:0/3440072460 shutdown_connections 2024-09-21T03:22:39.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.827+0000 7f74081e4640 1 --2- 172.21.15.105:0/3440072460 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f73ec078b90 0x7f73ec07b0a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:39.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.827+0000 7f74081e4640 1 --2- 172.21.15.105:0/3440072460 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f740009d450 0x7f740015b780 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:39.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.827+0000 7f74081e4640 1 --2- 172.21.15.105:0/3440072460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f740009d040 0x7f740015b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:39.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.827+0000 7f74081e4640 1 --2- 172.21.15.105:0/3440072460 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73e8004800 0x7f74001f7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:39.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.827+0000 7f74081e4640 1 -- 172.21.15.105:0/3440072460 >> 172.21.15.105:0/3440072460 conn(0x7f74000b1cb0 msgr2=0x7f74000ad950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:39.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.827+0000 7f74081e4640 1 -- 172.21.15.105:0/3440072460 shutdown_connections 2024-09-21T03:22:39.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:39.827+0000 7f74081e4640 1 -- 172.21.15.105:0/3440072460 wait complete. 2024-09-21T03:22:39.840 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-21T03:22:39.840 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-21T03:22:40.751 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:22:42.754 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:22:44.756 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:22:44.841 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T03:22:44.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:44.965+0000 7f73e0b2b640 1 -- 172.21.15.105:0/702036521 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73dc06cde0 msgr2=0x7f73dc06d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:44.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:44.965+0000 7f73e0b2b640 1 --2- 172.21.15.105:0/702036521 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73dc06cde0 0x7f73dc06d1f0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f73d0009830 tx=0x7f73d002a530 comp rx=0 tx=0).stop 2024-09-21T03:22:44.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:44.965+0000 7f73e0b2b640 1 -- 172.21.15.105:0/702036521 shutdown_connections 2024-09-21T03:22:44.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:44.965+0000 7f73e0b2b640 1 --2- 172.21.15.105:0/702036521 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73dc06cde0 0x7f73dc06d1f0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:44.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:44.965+0000 7f73e0b2b640 1 -- 172.21.15.105:0/702036521 >> 172.21.15.105:0/702036521 conn(0x7f73dc0cd530 msgr2=0x7f73dc0cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:44.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:44.965+0000 7f73e0b2b640 1 -- 172.21.15.105:0/702036521 shutdown_connections 2024-09-21T03:22:44.968 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:44.965+0000 7f73e0b2b640 1 -- 172.21.15.105:0/702036521 wait complete. 2024-09-21T03:22:44.969 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:44.967+0000 7f73e0b2b640 1 Processor -- start 2024-09-21T03:22:44.969 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:44.967+0000 7f73e0b2b640 1 -- start start 2024-09-21T03:22:44.973 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:44.968+0000 7f73e0b2b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73dc06cde0 0x7f73dc1e6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:44.973 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:44.968+0000 7f73e0b2b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73dc06e470 0x7f73dc143020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:44.973 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:44.968+0000 7f73e0b2b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73dc160340 0x7f73dc1e7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:44.973 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:44.968+0000 7f73e0b2b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f73dc160e60 con 0x7f73dc06cde0 2024-09-21T03:22:44.973 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:44.968+0000 7f73e0b2b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f73dc0cbc00 con 0x7f73dc160340 2024-09-21T03:22:44.973 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:44.968+0000 7f73e0b2b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f73dc160fe0 con 0x7f73dc06e470 2024-09-21T03:22:44.973 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:44.969+0000 7f73da59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73dc06cde0 0x7f73dc1e6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:44.973 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:44.969+0000 7f73da59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73dc06cde0 0x7f73dc1e6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:43386/0 (socket says 172.21.15.105:43386) 2024-09-21T03:22:44.974 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:44.969+0000 7f73da59c640 1 -- 172.21.15.105:0/4004753353 learned_addr learned my addr 172.21.15.105:0/4004753353 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:22:44.974 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:44.969+0000 7f73dad9d640 1 --2- 172.21.15.105:0/4004753353 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73dc160340 0x7f73dc1e7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:44.974 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:44.969+0000 7f73da59c640 1 -- 172.21.15.105:0/4004753353 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73dc06e470 msgr2=0x7f73dc143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:44.974 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:44.969+0000 7f73da59c640 1 --2- 172.21.15.105:0/4004753353 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73dc06e470 0x7f73dc143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:44.974 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:44.969+0000 7f73da59c640 1 -- 172.21.15.105:0/4004753353 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73dc160340 msgr2=0x7f73dc1e7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:44.974 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:44.969+0000 7f73da59c640 1 --2- 172.21.15.105:0/4004753353 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73dc160340 0x7f73dc1e7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:44.974 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:44.969+0000 7f73da59c640 1 -- 172.21.15.105:0/4004753353 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73dc1e6eb0 con 0x7f73dc06cde0 2024-09-21T03:22:44.974 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:44.969+0000 7f73dad9d640 1 --2- 172.21.15.105:0/4004753353 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73dc160340 0x7f73dc1e7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:22:44.974 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:44.969+0000 7f73da59c640 1 --2- 172.21.15.105:0/4004753353 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73dc06cde0 0x7f73dc1e6620 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f73cc00c750 tx=0x7f73cc00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:44.975 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:44.969+0000 7f73caffd640 1 -- 172.21.15.105:0/4004753353 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73cc00ce60 con 0x7f73dc06cde0 2024-09-21T03:22:44.975 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:44.969+0000 7f73caffd640 1 -- 172.21.15.105:0/4004753353 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f73cc003b70 con 0x7f73dc06cde0 2024-09-21T03:22:44.975 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:44.969+0000 7f73e0b2b640 1 -- 172.21.15.105:0/4004753353 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73dc1e7190 con 0x7f73dc06cde0 2024-09-21T03:22:44.975 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:44.969+0000 7f73caffd640 1 -- 172.21.15.105:0/4004753353 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73cc00a850 con 0x7f73dc06cde0 2024-09-21T03:22:44.975 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:44.969+0000 7f73e0b2b640 1 -- 172.21.15.105:0/4004753353 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73dc1e7750 con 0x7f73dc06cde0 2024-09-21T03:22:44.976 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:44.970+0000 7f73e0b2b640 1 -- 172.21.15.105:0/4004753353 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73dc06d1f0 con 0x7f73dc06cde0 2024-09-21T03:22:44.976 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:44.971+0000 7f73caffd640 1 -- 172.21.15.105:0/4004753353 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f73cc00a9f0 con 0x7f73dc06cde0 2024-09-21T03:22:44.978 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:44.972+0000 7f73caffd640 1 --2- 172.21.15.105:0/4004753353 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f73bc078bc0 0x7f73bc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:44.978 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:44.972+0000 7f73caffd640 1 -- 172.21.15.105:0/4004753353 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5767+0+0 (secure 0 0 0) 0x7f73cc09ab10 con 0x7f73dc06cde0 2024-09-21T03:22:44.978 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:44.972+0000 7f73d9d9b640 1 --2- 172.21.15.105:0/4004753353 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f73bc078bc0 0x7f73bc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:44.978 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:44.972+0000 7f73d9d9b640 1 --2- 172.21.15.105:0/4004753353 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f73bc078bc0 0x7f73bc07b0d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f73d0034000 tx=0x7f73d00046c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:44.980 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:44.976+0000 7f73caffd640 1 -- 172.21.15.105:0/4004753353 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f73cc062fa0 con 0x7f73dc06cde0 2024-09-21T03:22:45.189 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:45.188+0000 7f73e0b2b640 1 -- 172.21.15.105:0/4004753353 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f73dc0b63c0 con 0x7f73dc06cde0 2024-09-21T03:22:45.190 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:45.188+0000 7f73caffd640 1 -- 172.21.15.105:0/4004753353 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f73cc0628a0 con 0x7f73dc06cde0 2024-09-21T03:22:45.190 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:22:45.190 INFO:teuthology.orchestra.run.smithi105.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-21T03:22:45.192 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:45.190+0000 7f73e0b2b640 1 -- 172.21.15.105:0/4004753353 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f73bc078bc0 msgr2=0x7f73bc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:45.192 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:45.190+0000 7f73e0b2b640 1 --2- 172.21.15.105:0/4004753353 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f73bc078bc0 0x7f73bc07b0d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f73d0034000 tx=0x7f73d00046c0 comp rx=0 tx=0).stop 2024-09-21T03:22:45.192 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:45.190+0000 7f73e0b2b640 1 -- 172.21.15.105:0/4004753353 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73dc06cde0 msgr2=0x7f73dc1e6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:45.192 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:45.190+0000 7f73e0b2b640 1 --2- 172.21.15.105:0/4004753353 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73dc06cde0 0x7f73dc1e6620 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f73cc00c750 tx=0x7f73cc00cc10 comp rx=0 tx=0).stop 2024-09-21T03:22:45.193 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:45.190+0000 7f73e0b2b640 1 -- 172.21.15.105:0/4004753353 shutdown_connections 2024-09-21T03:22:45.193 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:45.190+0000 7f73e0b2b640 1 --2- 172.21.15.105:0/4004753353 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f73bc078bc0 0x7f73bc07b0d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:45.193 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:45.190+0000 7f73e0b2b640 1 --2- 172.21.15.105:0/4004753353 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73dc160340 0x7f73dc1e7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:45.193 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:45.190+0000 7f73e0b2b640 1 --2- 172.21.15.105:0/4004753353 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73dc06e470 0x7f73dc143020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:45.193 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:45.190+0000 7f73e0b2b640 1 --2- 172.21.15.105:0/4004753353 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73dc06cde0 0x7f73dc1e6620 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:45.193 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:45.190+0000 7f73e0b2b640 1 -- 172.21.15.105:0/4004753353 >> 172.21.15.105:0/4004753353 conn(0x7f73dc0cd530 msgr2=0x7f73dc0cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:45.193 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:45.190+0000 7f73e0b2b640 1 -- 172.21.15.105:0/4004753353 shutdown_connections 2024-09-21T03:22:45.193 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:45.190+0000 7f73e0b2b640 1 -- 172.21.15.105:0/4004753353 wait complete. 2024-09-21T03:22:45.203 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-21T03:22:45.203 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-21T03:22:46.758 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:22:48.760 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:22:50.204 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T03:22:50.329 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.327+0000 7f55d54ce640 1 -- 172.21.15.105:0/3079640677 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55d006e170 msgr2=0x7f55d00b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:50.330 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.327+0000 7f55d54ce640 1 --2- 172.21.15.105:0/3079640677 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55d006e170 0x7f55d00b3540 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f55d00ba090 tx=0x7f55c002a5a0 comp rx=0 tx=0).stop 2024-09-21T03:22:50.330 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.327+0000 7f55d54ce640 1 -- 172.21.15.105:0/3079640677 shutdown_connections 2024-09-21T03:22:50.330 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.327+0000 7f55d54ce640 1 --2- 172.21.15.105:0/3079640677 >> v2:172.21.15.162:3300/0 conn(0x7f55d00ceb40 0x7f55d00cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:50.330 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.327+0000 7f55d54ce640 1 --2- 172.21.15.105:0/3079640677 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55d006e170 0x7f55d00b3540 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:50.330 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.327+0000 7f55d54ce640 1 -- 172.21.15.105:0/3079640677 >> 172.21.15.105:0/3079640677 conn(0x7f55d008bfc0 msgr2=0x7f55d009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:50.330 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.327+0000 7f55d54ce640 1 -- 172.21.15.105:0/3079640677 shutdown_connections 2024-09-21T03:22:50.330 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.327+0000 7f55d54ce640 1 -- 172.21.15.105:0/3079640677 wait complete. 2024-09-21T03:22:50.331 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.329+0000 7f55d54ce640 1 Processor -- start 2024-09-21T03:22:50.331 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.329+0000 7f55d54ce640 1 -- start start 2024-09-21T03:22:50.333 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.331+0000 7f55d54ce640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55d006f4b0 0x7f55d01f4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:50.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.331+0000 7f55d54ce640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55d00ceb40 0x7f55d00c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:50.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.331+0000 7f55d54ce640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55d00ccaa0 0x7f55d00cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:50.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.331+0000 7f55d54ce640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f55d00d0e60 con 0x7f55d00ceb40 2024-09-21T03:22:50.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.331+0000 7f55d54ce640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f55d00d0ce0 con 0x7f55d006f4b0 2024-09-21T03:22:50.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.331+0000 7f55d54ce640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f55d00d0fe0 con 0x7f55d00ccaa0 2024-09-21T03:22:50.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.331+0000 7f55ce7fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55d00ceb40 0x7f55d00c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:50.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.331+0000 7f55ce7fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55d00ceb40 0x7f55d00c9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:43406/0 (socket says 172.21.15.105:43406) 2024-09-21T03:22:50.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.331+0000 7f55ce7fc640 1 -- 172.21.15.105:0/2381840332 learned_addr learned my addr 172.21.15.105:0/2381840332 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:22:50.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.331+0000 7f55ceffd640 1 --2- 172.21.15.105:0/2381840332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55d006f4b0 0x7f55d01f4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:50.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.331+0000 7f55cf7fe640 1 --2- 172.21.15.105:0/2381840332 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55d00ccaa0 0x7f55d00cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:50.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.331+0000 7f55ce7fc640 1 -- 172.21.15.105:0/2381840332 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55d00ccaa0 msgr2=0x7f55d00cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:50.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.331+0000 7f55ce7fc640 1 --2- 172.21.15.105:0/2381840332 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55d00ccaa0 0x7f55d00cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:50.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.331+0000 7f55ce7fc640 1 -- 172.21.15.105:0/2381840332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55d006f4b0 msgr2=0x7f55d01f4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:50.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.331+0000 7f55ce7fc640 1 --2- 172.21.15.105:0/2381840332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55d006f4b0 0x7f55d01f4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:50.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.331+0000 7f55ce7fc640 1 -- 172.21.15.105:0/2381840332 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55d00c9060 con 0x7f55d00ceb40 2024-09-21T03:22:50.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.331+0000 7f55ceffd640 1 --2- 172.21.15.105:0/2381840332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55d006f4b0 0x7f55d01f4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:22:50.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.331+0000 7f55ce7fc640 1 --2- 172.21.15.105:0/2381840332 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55d00ceb40 0x7f55d00c9b00 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f55c400c3f0 tx=0x7f55c400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:50.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.332+0000 7f55b77fe640 1 -- 172.21.15.105:0/2381840332 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c4017070 con 0x7f55d00ceb40 2024-09-21T03:22:50.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.332+0000 7f55b77fe640 1 -- 172.21.15.105:0/2381840332 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55c40053e0 con 0x7f55d00ceb40 2024-09-21T03:22:50.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.332+0000 7f55b77fe640 1 -- 172.21.15.105:0/2381840332 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c4003870 con 0x7f55d00ceb40 2024-09-21T03:22:50.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.332+0000 7f55d54ce640 1 -- 172.21.15.105:0/2381840332 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55d01ea0f0 con 0x7f55d00ceb40 2024-09-21T03:22:50.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.332+0000 7f55d54ce640 1 -- 172.21.15.105:0/2381840332 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55d00c95e0 con 0x7f55d00ceb40 2024-09-21T03:22:50.336 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.333+0000 7f55d54ce640 1 -- 172.21.15.105:0/2381840332 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55d01e9e60 con 0x7f55d00ceb40 2024-09-21T03:22:50.336 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.334+0000 7f55b77fe640 1 -- 172.21.15.105:0/2381840332 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f55c401a070 con 0x7f55d00ceb40 2024-09-21T03:22:50.336 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.334+0000 7f55b77fe640 1 --2- 172.21.15.105:0/2381840332 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f55bc078b90 0x7f55bc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:50.336 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.334+0000 7f55b77fe640 1 -- 172.21.15.105:0/2381840332 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5767+0+0 (secure 0 0 0) 0x7f55c409a040 con 0x7f55d00ceb40 2024-09-21T03:22:50.336 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.334+0000 7f55ceffd640 1 --2- 172.21.15.105:0/2381840332 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f55bc078b90 0x7f55bc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:50.337 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.335+0000 7f55ceffd640 1 --2- 172.21.15.105:0/2381840332 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f55bc078b90 0x7f55bc07b0a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f55c0033000 tx=0x7f55c0004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:50.340 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.339+0000 7f55b77fe640 1 -- 172.21.15.105:0/2381840332 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f55c4062590 con 0x7f55d00ceb40 2024-09-21T03:22:50.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.551+0000 7f55d54ce640 1 -- 172.21.15.105:0/2381840332 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f55d00d1510 con 0x7f55d00ceb40 2024-09-21T03:22:50.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.552+0000 7f55b77fe640 1 -- 172.21.15.105:0/2381840332 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f55c4061e90 con 0x7f55d00ceb40 2024-09-21T03:22:50.553 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:22:50.553 INFO:teuthology.orchestra.run.smithi105.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-21T03:22:50.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.554+0000 7f55d54ce640 1 -- 172.21.15.105:0/2381840332 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f55bc078b90 msgr2=0x7f55bc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:50.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.554+0000 7f55d54ce640 1 --2- 172.21.15.105:0/2381840332 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f55bc078b90 0x7f55bc07b0a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f55c0033000 tx=0x7f55c0004730 comp rx=0 tx=0).stop 2024-09-21T03:22:50.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.554+0000 7f55d54ce640 1 -- 172.21.15.105:0/2381840332 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55d00ceb40 msgr2=0x7f55d00c9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:50.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.554+0000 7f55d54ce640 1 --2- 172.21.15.105:0/2381840332 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55d00ceb40 0x7f55d00c9b00 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f55c400c3f0 tx=0x7f55c400c8b0 comp rx=0 tx=0).stop 2024-09-21T03:22:50.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.554+0000 7f55d54ce640 1 -- 172.21.15.105:0/2381840332 shutdown_connections 2024-09-21T03:22:50.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.554+0000 7f55d54ce640 1 --2- 172.21.15.105:0/2381840332 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f55bc078b90 0x7f55bc07b0a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:50.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.554+0000 7f55d54ce640 1 --2- 172.21.15.105:0/2381840332 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f55d00ccaa0 0x7f55d00cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:50.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.554+0000 7f55d54ce640 1 --2- 172.21.15.105:0/2381840332 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55d00ceb40 0x7f55d00c9b00 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:50.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.554+0000 7f55d54ce640 1 --2- 172.21.15.105:0/2381840332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f55d006f4b0 0x7f55d01f4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:50.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.554+0000 7f55d54ce640 1 -- 172.21.15.105:0/2381840332 >> 172.21.15.105:0/2381840332 conn(0x7f55d008bfc0 msgr2=0x7f55d006eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:50.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.554+0000 7f55d54ce640 1 -- 172.21.15.105:0/2381840332 shutdown_connections 2024-09-21T03:22:50.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:50.554+0000 7f55d54ce640 1 -- 172.21.15.105:0/2381840332 wait complete. 2024-09-21T03:22:50.567 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-21T03:22:50.567 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-21T03:22:50.762 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:22:52.764 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:22:54.765 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:22:55.567 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T03:22:55.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.690+0000 7f0e86870640 1 -- 172.21.15.105:0/2853480517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e800b3540 msgr2=0x7f0e800d3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:55.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.690+0000 7f0e86870640 1 --2- 172.21.15.105:0/2853480517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e800b3540 0x7f0e800d3330 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f0e800ba090 tx=0x7f0e7402a4a0 comp rx=0 tx=0).stop 2024-09-21T03:22:55.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.691+0000 7f0e86870640 1 -- 172.21.15.105:0/2853480517 shutdown_connections 2024-09-21T03:22:55.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.691+0000 7f0e86870640 1 --2- 172.21.15.105:0/2853480517 >> v2:172.21.15.162:3300/0 conn(0x7f0e800d3870 0x7f0e800ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:55.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.691+0000 7f0e86870640 1 --2- 172.21.15.105:0/2853480517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e800b3540 0x7f0e800d3330 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:55.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.691+0000 7f0e86870640 1 -- 172.21.15.105:0/2853480517 >> 172.21.15.105:0/2853480517 conn(0x7f0e8008bfc0 msgr2=0x7f0e8009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:55.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.691+0000 7f0e86870640 1 -- 172.21.15.105:0/2853480517 shutdown_connections 2024-09-21T03:22:55.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.691+0000 7f0e86870640 1 -- 172.21.15.105:0/2853480517 wait complete. 2024-09-21T03:22:55.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.692+0000 7f0e86870640 1 Processor -- start 2024-09-21T03:22:55.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.693+0000 7f0e86870640 1 -- start start 2024-09-21T03:22:55.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.694+0000 7f0e86870640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e800b3540 0x7f0e801498c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:55.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.694+0000 7f0e86870640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e800d3870 0x7f0e801f8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:55.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.694+0000 7f0e86870640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e80155a40 0x7f0e801f8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:55.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.694+0000 7f0e86870640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0e800d0ce0 con 0x7f0e800b3540 2024-09-21T03:22:55.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.694+0000 7f0e86870640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0e800cf490 con 0x7f0e800d3870 2024-09-21T03:22:55.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.694+0000 7f0e86870640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0e800d0e60 con 0x7f0e80155a40 2024-09-21T03:22:55.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.694+0000 7f0e7ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e800b3540 0x7f0e801498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:55.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.694+0000 7f0e7ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e800b3540 0x7f0e801498c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:44930/0 (socket says 172.21.15.105:44930) 2024-09-21T03:22:55.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.694+0000 7f0e7ffff640 1 -- 172.21.15.105:0/816456994 learned_addr learned my addr 172.21.15.105:0/816456994 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:22:55.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.694+0000 7f0e7f7fe640 1 --2- 172.21.15.105:0/816456994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e800d3870 0x7f0e801f8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:55.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.694+0000 7f0e84e0d640 1 --2- 172.21.15.105:0/816456994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e80155a40 0x7f0e801f8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:55.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.694+0000 7f0e7ffff640 1 -- 172.21.15.105:0/816456994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e80155a40 msgr2=0x7f0e801f8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:55.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.694+0000 7f0e7ffff640 1 --2- 172.21.15.105:0/816456994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e80155a40 0x7f0e801f8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:55.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.694+0000 7f0e7ffff640 1 -- 172.21.15.105:0/816456994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e800d3870 msgr2=0x7f0e801f8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:55.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.694+0000 7f0e7ffff640 1 --2- 172.21.15.105:0/816456994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e800d3870 0x7f0e801f8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:55.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.694+0000 7f0e7ffff640 1 -- 172.21.15.105:0/816456994 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e800ce040 con 0x7f0e800b3540 2024-09-21T03:22:55.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.694+0000 7f0e7f7fe640 1 --2- 172.21.15.105:0/816456994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e800d3870 0x7f0e801f8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:22:55.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.694+0000 7f0e7ffff640 1 --2- 172.21.15.105:0/816456994 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e800b3540 0x7f0e801498c0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f0e7000c3d0 tx=0x7f0e7000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:55.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.695+0000 7f0e7cff9640 1 -- 172.21.15.105:0/816456994 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e70011790 con 0x7f0e800b3540 2024-09-21T03:22:55.699 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.695+0000 7f0e7cff9640 1 -- 172.21.15.105:0/816456994 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e70017070 con 0x7f0e800b3540 2024-09-21T03:22:55.699 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.695+0000 7f0e86870640 1 -- 172.21.15.105:0/816456994 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e800cab00 con 0x7f0e800b3540 2024-09-21T03:22:55.699 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.695+0000 7f0e7cff9640 1 -- 172.21.15.105:0/816456994 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e70011cc0 con 0x7f0e800b3540 2024-09-21T03:22:55.699 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.695+0000 7f0e86870640 1 -- 172.21.15.105:0/816456994 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e801f99c0 con 0x7f0e800b3540 2024-09-21T03:22:55.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.697+0000 7f0e7cff9640 1 -- 172.21.15.105:0/816456994 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0e7001c460 con 0x7f0e800b3540 2024-09-21T03:22:55.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.697+0000 7f0e86870640 1 -- 172.21.15.105:0/816456994 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e8006e170 con 0x7f0e800b3540 2024-09-21T03:22:55.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.697+0000 7f0e7cff9640 1 --2- 172.21.15.105:0/816456994 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0e6c078b90 0x7f0e6c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:22:55.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.697+0000 7f0e7cff9640 1 -- 172.21.15.105:0/816456994 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5767+0+0 (secure 0 0 0) 0x7f0e7009ab50 con 0x7f0e800b3540 2024-09-21T03:22:55.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.697+0000 7f0e7f7fe640 1 --2- 172.21.15.105:0/816456994 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0e6c078b90 0x7f0e6c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:22:55.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.698+0000 7f0e7f7fe640 1 --2- 172.21.15.105:0/816456994 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0e6c078b90 0x7f0e6c07b0a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0e74034000 tx=0x7f0e74004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:22:55.703 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.702+0000 7f0e7cff9640 1 -- 172.21.15.105:0/816456994 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0e70062f50 con 0x7f0e800b3540 2024-09-21T03:22:55.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.918+0000 7f0e86870640 1 -- 172.21.15.105:0/816456994 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0e800b8fb0 con 0x7f0e800b3540 2024-09-21T03:22:55.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.918+0000 7f0e7cff9640 1 -- 172.21.15.105:0/816456994 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f0e70062850 con 0x7f0e800b3540 2024-09-21T03:22:55.920 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:22:55.920 INFO:teuthology.orchestra.run.smithi105.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-21T03:22:55.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.920+0000 7f0e86870640 1 -- 172.21.15.105:0/816456994 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0e6c078b90 msgr2=0x7f0e6c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:55.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.920+0000 7f0e86870640 1 --2- 172.21.15.105:0/816456994 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0e6c078b90 0x7f0e6c07b0a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0e74034000 tx=0x7f0e74004730 comp rx=0 tx=0).stop 2024-09-21T03:22:55.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.920+0000 7f0e86870640 1 -- 172.21.15.105:0/816456994 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e800b3540 msgr2=0x7f0e801498c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:22:55.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.920+0000 7f0e86870640 1 --2- 172.21.15.105:0/816456994 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e800b3540 0x7f0e801498c0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f0e7000c3d0 tx=0x7f0e7000c890 comp rx=0 tx=0).stop 2024-09-21T03:22:55.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.920+0000 7f0e86870640 1 -- 172.21.15.105:0/816456994 shutdown_connections 2024-09-21T03:22:55.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.920+0000 7f0e86870640 1 --2- 172.21.15.105:0/816456994 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0e6c078b90 0x7f0e6c07b0a0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:55.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.920+0000 7f0e86870640 1 --2- 172.21.15.105:0/816456994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e80155a40 0x7f0e801f8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:55.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.920+0000 7f0e86870640 1 --2- 172.21.15.105:0/816456994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e800d3870 0x7f0e801f8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:55.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.920+0000 7f0e86870640 1 --2- 172.21.15.105:0/816456994 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e800b3540 0x7f0e801498c0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:22:55.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.920+0000 7f0e86870640 1 -- 172.21.15.105:0/816456994 >> 172.21.15.105:0/816456994 conn(0x7f0e8008bfc0 msgr2=0x7f0e8006f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:22:55.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.921+0000 7f0e86870640 1 -- 172.21.15.105:0/816456994 shutdown_connections 2024-09-21T03:22:55.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:22:55.921+0000 7f0e86870640 1 -- 172.21.15.105:0/816456994 wait complete. 2024-09-21T03:22:55.933 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-21T03:22:55.933 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-21T03:22:56.679 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:22:56.682 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:22:56.767 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:22:58.769 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:23:00.771 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:23:00.934 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T03:23:01.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.060+0000 7fa6efd51640 1 -- 172.21.15.105:0/3441549579 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6e80cd370 msgr2=0x7fa6e815d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:01.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.060+0000 7fa6efd51640 1 --2- 172.21.15.105:0/3441549579 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6e80cd370 0x7fa6e815d7d0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fa6e80b1740 tx=0x7fa6d802a510 comp rx=0 tx=0).stop 2024-09-21T03:23:01.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.060+0000 7fa6efd51640 1 -- 172.21.15.105:0/3441549579 shutdown_connections 2024-09-21T03:23:01.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.060+0000 7fa6efd51640 1 --2- 172.21.15.105:0/3441549579 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6e815c8b0 0x7fa6e815dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:01.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.060+0000 7fa6efd51640 1 --2- 172.21.15.105:0/3441549579 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6e80cd370 0x7fa6e815d7d0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:01.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.061+0000 7fa6efd51640 1 -- 172.21.15.105:0/3441549579 >> 172.21.15.105:0/3441549579 conn(0x7fa6e806d230 msgr2=0x7fa6e806d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:01.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.061+0000 7fa6efd51640 1 -- 172.21.15.105:0/3441549579 shutdown_connections 2024-09-21T03:23:01.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.061+0000 7fa6efd51640 1 -- 172.21.15.105:0/3441549579 wait complete. 2024-09-21T03:23:01.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.062+0000 7fa6efd51640 1 Processor -- start 2024-09-21T03:23:01.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.062+0000 7fa6efd51640 1 -- start start 2024-09-21T03:23:01.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.064+0000 7fa6efd51640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6e80cff40 0x7fa6e80b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:01.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.064+0000 7fa6efd51640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6e815c8b0 0x7fa6e8155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:01.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.064+0000 7fa6efd51640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6e806f780 0x7fa6e8159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:01.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.064+0000 7fa6efd51640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e815eb10 con 0x7fa6e815c8b0 2024-09-21T03:23:01.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.064+0000 7fa6efd51640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e815e990 con 0x7fa6e80cff40 2024-09-21T03:23:01.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.064+0000 7fa6efd51640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa6e815ec90 con 0x7fa6e806f780 2024-09-21T03:23:01.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.064+0000 7fa6ed2ec640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6e815c8b0 0x7fa6e8155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:01.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.064+0000 7fa6ed2ec640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6e815c8b0 0x7fa6e8155930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:44950/0 (socket says 172.21.15.105:44950) 2024-09-21T03:23:01.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.064+0000 7fa6ed2ec640 1 -- 172.21.15.105:0/4105991850 learned_addr learned my addr 172.21.15.105:0/4105991850 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:23:01.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.064+0000 7fa6edaed640 1 --2- 172.21.15.105:0/4105991850 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6e80cff40 0x7fa6e80b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:01.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.064+0000 7fa6ee2ee640 1 --2- 172.21.15.105:0/4105991850 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6e806f780 0x7fa6e8159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:01.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.064+0000 7fa6ed2ec640 1 -- 172.21.15.105:0/4105991850 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6e806f780 msgr2=0x7fa6e8159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:01.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.064+0000 7fa6ed2ec640 1 --2- 172.21.15.105:0/4105991850 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6e806f780 0x7fa6e8159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:01.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.064+0000 7fa6ed2ec640 1 -- 172.21.15.105:0/4105991850 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6e80cff40 msgr2=0x7fa6e80b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:01.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.064+0000 7fa6ed2ec640 1 --2- 172.21.15.105:0/4105991850 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6e80cff40 0x7fa6e80b51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:01.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.064+0000 7fa6ed2ec640 1 -- 172.21.15.105:0/4105991850 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6e81f5be0 con 0x7fa6e815c8b0 2024-09-21T03:23:01.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.064+0000 7fa6edaed640 1 --2- 172.21.15.105:0/4105991850 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6e80cff40 0x7fa6e80b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:23:01.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.064+0000 7fa6ed2ec640 1 --2- 172.21.15.105:0/4105991850 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6e815c8b0 0x7fa6e8155930 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8034040 tx=0x7fa6d80039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:01.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.064+0000 7fa6de7fc640 1 -- 172.21.15.105:0/4105991850 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d803e030 con 0x7fa6e815c8b0 2024-09-21T03:23:01.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.065+0000 7fa6de7fc640 1 -- 172.21.15.105:0/4105991850 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa6d80047a0 con 0x7fa6e815c8b0 2024-09-21T03:23:01.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.065+0000 7fa6efd51640 1 -- 172.21.15.105:0/4105991850 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6e81f5ec0 con 0x7fa6e815c8b0 2024-09-21T03:23:01.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.065+0000 7fa6de7fc640 1 -- 172.21.15.105:0/4105991850 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d8035040 con 0x7fa6e815c8b0 2024-09-21T03:23:01.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.065+0000 7fa6efd51640 1 -- 172.21.15.105:0/4105991850 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6e81f6480 con 0x7fa6e815c8b0 2024-09-21T03:23:01.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.065+0000 7fa6efd51640 1 -- 172.21.15.105:0/4105991850 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6e80cde30 con 0x7fa6e815c8b0 2024-09-21T03:23:01.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.066+0000 7fa6de7fc640 1 -- 172.21.15.105:0/4105991850 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa6d8041030 con 0x7fa6e815c8b0 2024-09-21T03:23:01.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.067+0000 7fa6de7fc640 1 --2- 172.21.15.105:0/4105991850 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa6cc078b90 0x7fa6cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:01.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.067+0000 7fa6de7fc640 1 -- 172.21.15.105:0/4105991850 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5767+0+0 (secure 0 0 0) 0x7fa6d80bb970 con 0x7fa6e815c8b0 2024-09-21T03:23:01.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.067+0000 7fa6edaed640 1 --2- 172.21.15.105:0/4105991850 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa6cc078b90 0x7fa6cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:01.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.068+0000 7fa6edaed640 1 --2- 172.21.15.105:0/4105991850 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa6cc078b90 0x7fa6cc07b0a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4006fd0 tx=0x7fa6e4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:01.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.071+0000 7fa6de7fc640 1 -- 172.21.15.105:0/4105991850 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa6e80cde30 con 0x7fa6e815c8b0 2024-09-21T03:23:01.290 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.288+0000 7fa6efd51640 1 -- 172.21.15.105:0/4105991850 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa6e80cf570 con 0x7fa6e815c8b0 2024-09-21T03:23:01.291 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.288+0000 7fa6de7fc640 1 -- 172.21.15.105:0/4105991850 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7fa6e80cf570 con 0x7fa6e815c8b0 2024-09-21T03:23:01.291 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:23:01.291 INFO:teuthology.orchestra.run.smithi105.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-21T03:23:01.292 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.290+0000 7fa6efd51640 1 -- 172.21.15.105:0/4105991850 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa6cc078b90 msgr2=0x7fa6cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:01.292 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.290+0000 7fa6efd51640 1 --2- 172.21.15.105:0/4105991850 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa6cc078b90 0x7fa6cc07b0a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4006fd0 tx=0x7fa6e4008040 comp rx=0 tx=0).stop 2024-09-21T03:23:01.293 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.290+0000 7fa6efd51640 1 -- 172.21.15.105:0/4105991850 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6e815c8b0 msgr2=0x7fa6e8155930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:01.293 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.290+0000 7fa6efd51640 1 --2- 172.21.15.105:0/4105991850 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6e815c8b0 0x7fa6e8155930 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8034040 tx=0x7fa6d80039e0 comp rx=0 tx=0).stop 2024-09-21T03:23:01.293 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.290+0000 7fa6efd51640 1 -- 172.21.15.105:0/4105991850 shutdown_connections 2024-09-21T03:23:01.293 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.290+0000 7fa6efd51640 1 --2- 172.21.15.105:0/4105991850 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa6cc078b90 0x7fa6cc07b0a0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:01.293 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.290+0000 7fa6efd51640 1 --2- 172.21.15.105:0/4105991850 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6e806f780 0x7fa6e8159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:01.293 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.290+0000 7fa6efd51640 1 --2- 172.21.15.105:0/4105991850 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6e815c8b0 0x7fa6e8155930 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:01.293 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.290+0000 7fa6efd51640 1 --2- 172.21.15.105:0/4105991850 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6e80cff40 0x7fa6e80b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:01.293 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.291+0000 7fa6efd51640 1 -- 172.21.15.105:0/4105991850 >> 172.21.15.105:0/4105991850 conn(0x7fa6e806d230 msgr2=0x7fa6e80c9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:01.293 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.291+0000 7fa6efd51640 1 -- 172.21.15.105:0/4105991850 shutdown_connections 2024-09-21T03:23:01.293 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:01.291+0000 7fa6efd51640 1 -- 172.21.15.105:0/4105991850 wait complete. 2024-09-21T03:23:01.303 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-21T03:23:01.304 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-21T03:23:02.773 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:23:04.775 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:23:06.304 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T03:23:06.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.429+0000 7fabb1319640 1 -- 172.21.15.105:0/2045687229 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab94003a30 msgr2=0x7fab94003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:06.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.429+0000 7fabb1319640 1 --2- 172.21.15.105:0/2045687229 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab94003a30 0x7fab94003ea0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fab9c00c610 tx=0x7fab94005830 comp rx=0 tx=0).stop 2024-09-21T03:23:06.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.429+0000 7fabab7fe640 1 -- 172.21.15.105:0/2045687229 reap_dead start 2024-09-21T03:23:06.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.429+0000 7fabb1319640 1 -- 172.21.15.105:0/2045687229 shutdown_connections 2024-09-21T03:23:06.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.430+0000 7fabb1319640 1 -- 172.21.15.105:0/2045687229 >> 172.21.15.105:0/2045687229 conn(0x7fabac06d550 msgr2=0x7fabac071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:06.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.430+0000 7fabb1319640 1 -- 172.21.15.105:0/2045687229 shutdown_connections 2024-09-21T03:23:06.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.430+0000 7fabb1319640 1 -- 172.21.15.105:0/2045687229 wait complete. 2024-09-21T03:23:06.433 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.431+0000 7fabb1319640 1 Processor -- start 2024-09-21T03:23:06.433 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.432+0000 7fabb1319640 1 -- start start 2024-09-21T03:23:06.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.433+0000 7fabb1319640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab94003a30 0x7fabac0cc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:06.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.433+0000 7fabb1319640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabac0cc5a0 0x7fabac143760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:06.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.433+0000 7fabb1319640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabac143ca0 0x7fabac1f2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:06.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.433+0000 7fabb1319640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fabac0b7820 con 0x7fabac0cc5a0 2024-09-21T03:23:06.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.433+0000 7fabb1319640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fabac0b76a0 con 0x7fabac143ca0 2024-09-21T03:23:06.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.433+0000 7fabb1319640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fabac0b79a0 con 0x7fab94003a30 2024-09-21T03:23:06.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.433+0000 7fabaa7fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabac0cc5a0 0x7fabac143760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:06.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.433+0000 7fabaa7fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabac0cc5a0 0x7fabac143760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42916/0 (socket says 172.21.15.105:42916) 2024-09-21T03:23:06.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.433+0000 7fabaa7fc640 1 -- 172.21.15.105:0/311265429 learned_addr learned my addr 172.21.15.105:0/311265429 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:23:06.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.433+0000 7fabaaffd640 1 --2- 172.21.15.105:0/311265429 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab94003a30 0x7fabac0cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:06.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.433+0000 7fabab7fe640 1 --2- 172.21.15.105:0/311265429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabac143ca0 0x7fabac1f2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:06.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.433+0000 7fabaa7fc640 1 -- 172.21.15.105:0/311265429 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab94003a30 msgr2=0x7fabac0cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:06.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.433+0000 7fabaa7fc640 1 --2- 172.21.15.105:0/311265429 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab94003a30 0x7fabac0cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:06.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.433+0000 7fabaa7fc640 1 -- 172.21.15.105:0/311265429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabac143ca0 msgr2=0x7fabac1f2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:06.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.433+0000 7fabaa7fc640 1 --2- 172.21.15.105:0/311265429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabac143ca0 0x7fabac1f2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:06.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.433+0000 7fabaa7fc640 1 -- 172.21.15.105:0/311265429 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabac1e81b0 con 0x7fabac0cc5a0 2024-09-21T03:23:06.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.433+0000 7fabaa7fc640 1 --2- 172.21.15.105:0/311265429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabac0cc5a0 0x7fabac143760 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7faba0003fb0 tx=0x7faba0001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:06.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.434+0000 7fab937fe640 1 -- 172.21.15.105:0/311265429 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba0015070 con 0x7fabac0cc5a0 2024-09-21T03:23:06.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.434+0000 7fab937fe640 1 -- 172.21.15.105:0/311265429 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faba0011840 con 0x7fabac0cc5a0 2024-09-21T03:23:06.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.434+0000 7fabb1319640 1 -- 172.21.15.105:0/311265429 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabac1e8490 con 0x7fabac0cc5a0 2024-09-21T03:23:06.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.434+0000 7fab937fe640 1 -- 172.21.15.105:0/311265429 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba0011c90 con 0x7fabac0cc5a0 2024-09-21T03:23:06.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.434+0000 7fabb1319640 1 -- 172.21.15.105:0/311265429 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabac1e8a50 con 0x7fabac0cc5a0 2024-09-21T03:23:06.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.435+0000 7fabb1319640 1 -- 172.21.15.105:0/311265429 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabac0ce3d0 con 0x7fabac0cc5a0 2024-09-21T03:23:06.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.436+0000 7fab937fe640 1 -- 172.21.15.105:0/311265429 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faba0018070 con 0x7fabac0cc5a0 2024-09-21T03:23:06.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.436+0000 7fab937fe640 1 --2- 172.21.15.105:0/311265429 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fab98078b90 0x7fab9807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:06.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.436+0000 7fab937fe640 1 -- 172.21.15.105:0/311265429 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5767+0+0 (secure 0 0 0) 0x7faba009b890 con 0x7fabac0cc5a0 2024-09-21T03:23:06.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.436+0000 7fabaaffd640 1 --2- 172.21.15.105:0/311265429 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fab98078b90 0x7fab9807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:06.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.437+0000 7fabaaffd640 1 --2- 172.21.15.105:0/311265429 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fab98078b90 0x7fab9807b0a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fab9c033000 tx=0x7fab9c001360 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:06.442 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.441+0000 7fab937fe640 1 -- 172.21.15.105:0/311265429 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fabac0ce3d0 con 0x7fabac0cc5a0 2024-09-21T03:23:06.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.654+0000 7fabb1319640 1 -- 172.21.15.105:0/311265429 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fabac0b7f00 con 0x7fabac0cc5a0 2024-09-21T03:23:06.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.655+0000 7fab937fe640 1 -- 172.21.15.105:0/311265429 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7faba00636d0 con 0x7fabac0cc5a0 2024-09-21T03:23:06.657 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:23:06.657 INFO:teuthology.orchestra.run.smithi105.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-21T03:23:06.659 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.657+0000 7fabb1319640 1 -- 172.21.15.105:0/311265429 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fab98078b90 msgr2=0x7fab9807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:06.659 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.657+0000 7fabb1319640 1 --2- 172.21.15.105:0/311265429 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fab98078b90 0x7fab9807b0a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fab9c033000 tx=0x7fab9c001360 comp rx=0 tx=0).stop 2024-09-21T03:23:06.659 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.657+0000 7fabb1319640 1 -- 172.21.15.105:0/311265429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabac0cc5a0 msgr2=0x7fabac143760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:06.659 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.657+0000 7fabb1319640 1 --2- 172.21.15.105:0/311265429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabac0cc5a0 0x7fabac143760 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7faba0003fb0 tx=0x7faba0001630 comp rx=0 tx=0).stop 2024-09-21T03:23:06.659 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.657+0000 7fabb1319640 1 -- 172.21.15.105:0/311265429 shutdown_connections 2024-09-21T03:23:06.659 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.657+0000 7fabb1319640 1 --2- 172.21.15.105:0/311265429 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fab98078b90 0x7fab9807b0a0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:06.659 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.657+0000 7fabb1319640 1 --2- 172.21.15.105:0/311265429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabac143ca0 0x7fabac1f2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:06.660 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.657+0000 7fabb1319640 1 --2- 172.21.15.105:0/311265429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabac0cc5a0 0x7fabac143760 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:06.660 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.657+0000 7fabb1319640 1 --2- 172.21.15.105:0/311265429 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab94003a30 0x7fabac0cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:06.660 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.657+0000 7fabb1319640 1 -- 172.21.15.105:0/311265429 >> 172.21.15.105:0/311265429 conn(0x7fabac06d550 msgr2=0x7fabac160130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:06.660 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.657+0000 7fabb1319640 1 -- 172.21.15.105:0/311265429 shutdown_connections 2024-09-21T03:23:06.660 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:06.657+0000 7fabb1319640 1 -- 172.21.15.105:0/311265429 wait complete. 2024-09-21T03:23:06.670 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-21T03:23:06.670 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-21T03:23:06.777 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:23:08.780 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:23:10.782 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:23:11.671 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T03:23:11.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.795+0000 7f288d838640 1 -- 172.21.15.105:0/1776964817 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28880ce7d0 msgr2=0x7f288806cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:11.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.795+0000 7f288d838640 1 --2- 172.21.15.105:0/1776964817 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28880ce7d0 0x7f288806cde0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f2888070f40 tx=0x7f287002a5d0 comp rx=0 tx=0).stop 2024-09-21T03:23:11.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.795+0000 7f288d838640 1 -- 172.21.15.105:0/1776964817 shutdown_connections 2024-09-21T03:23:11.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.795+0000 7f288d838640 1 --2- 172.21.15.105:0/1776964817 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2888070360 0x7f288806d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:11.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.795+0000 7f288d838640 1 --2- 172.21.15.105:0/1776964817 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28880ce7d0 0x7f288806cde0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:11.798 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.795+0000 7f288d838640 1 --2- 172.21.15.105:0/1776964817 >> v2:172.21.15.162:3300/0 conn(0x7f28881600a0 0x7f2888071250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:11.798 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.795+0000 7f288d838640 1 -- 172.21.15.105:0/1776964817 >> 172.21.15.105:0/1776964817 conn(0x7f28880cdcb0 msgr2=0x7f28880ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:11.798 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.795+0000 7f288d838640 1 -- 172.21.15.105:0/1776964817 shutdown_connections 2024-09-21T03:23:11.798 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.795+0000 7f288d838640 1 -- 172.21.15.105:0/1776964817 wait complete. 2024-09-21T03:23:11.798 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.797+0000 7f288d838640 1 Processor -- start 2024-09-21T03:23:11.799 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.797+0000 7f288d838640 1 -- start start 2024-09-21T03:23:11.803 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.798+0000 7f288d838640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2888070360 0x7f288814d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:11.803 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.798+0000 7f288d838640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28880ce7d0 0x7f28880ca1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:11.803 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.798+0000 7f288d838640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28881600a0 0x7f288814b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:11.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.798+0000 7f288d838640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f28880b3040 con 0x7f2888070360 2024-09-21T03:23:11.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.798+0000 7f288d838640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f28880b2ec0 con 0x7f28880ce7d0 2024-09-21T03:23:11.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.798+0000 7f288d838640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f28880b31c0 con 0x7f28881600a0 2024-09-21T03:23:11.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.798+0000 7f2886ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2888070360 0x7f288814d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:11.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.798+0000 7f2886ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2888070360 0x7f288814d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40564/0 (socket says 172.21.15.105:40564) 2024-09-21T03:23:11.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.798+0000 7f2886ffd640 1 -- 172.21.15.105:0/3890611782 learned_addr learned my addr 172.21.15.105:0/3890611782 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:23:11.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.799+0000 7f28867fc640 1 --2- 172.21.15.105:0/3890611782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28880ce7d0 0x7f28880ca1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:11.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.799+0000 7f2886ffd640 1 -- 172.21.15.105:0/3890611782 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28881600a0 msgr2=0x7f288814b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:11.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.799+0000 7f28877fe640 1 --2- 172.21.15.105:0/3890611782 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28881600a0 0x7f288814b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:11.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.799+0000 7f2886ffd640 1 --2- 172.21.15.105:0/3890611782 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28881600a0 0x7f288814b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:11.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.799+0000 7f2886ffd640 1 -- 172.21.15.105:0/3890611782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28880ce7d0 msgr2=0x7f28880ca1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:11.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.799+0000 7f2886ffd640 1 --2- 172.21.15.105:0/3890611782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28880ce7d0 0x7f28880ca1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:11.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.799+0000 7f2886ffd640 1 -- 172.21.15.105:0/3890611782 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f288814e1c0 con 0x7f2888070360 2024-09-21T03:23:11.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.799+0000 7f28867fc640 1 --2- 172.21.15.105:0/3890611782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28880ce7d0 0x7f28880ca1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:23:11.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.799+0000 7f28877fe640 1 --2- 172.21.15.105:0/3890611782 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28881600a0 0x7f288814b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:23:11.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.799+0000 7f2886ffd640 1 --2- 172.21.15.105:0/3890611782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2888070360 0x7f288814d7f0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f288000c9a0 tx=0x7f288000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:11.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.799+0000 7f287ffff640 1 -- 172.21.15.105:0/3890611782 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2880007bb0 con 0x7f2888070360 2024-09-21T03:23:11.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.799+0000 7f288d838640 1 -- 172.21.15.105:0/3890611782 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f288814e4a0 con 0x7f2888070360 2024-09-21T03:23:11.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.799+0000 7f287ffff640 1 -- 172.21.15.105:0/3890611782 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2880007e40 con 0x7f2888070360 2024-09-21T03:23:11.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.799+0000 7f287ffff640 1 -- 172.21.15.105:0/3890611782 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288000f690 con 0x7f2888070360 2024-09-21T03:23:11.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.799+0000 7f288d838640 1 -- 172.21.15.105:0/3890611782 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28880ca6e0 con 0x7f2888070360 2024-09-21T03:23:11.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.800+0000 7f288d838640 1 -- 172.21.15.105:0/3890611782 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2888071250 con 0x7f2888070360 2024-09-21T03:23:11.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.801+0000 7f287ffff640 1 -- 172.21.15.105:0/3890611782 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f288000f830 con 0x7f2888070360 2024-09-21T03:23:11.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.801+0000 7f287ffff640 1 --2- 172.21.15.105:0/3890611782 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2868078b90 0x7f286807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:11.807 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.802+0000 7f287ffff640 1 -- 172.21.15.105:0/3890611782 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5767+0+0 (secure 0 0 0) 0x7f288009ba00 con 0x7f2888070360 2024-09-21T03:23:11.807 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.802+0000 7f28867fc640 1 --2- 172.21.15.105:0/3890611782 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2868078b90 0x7f286807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:11.807 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.802+0000 7f28867fc640 1 --2- 172.21.15.105:0/3890611782 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2868078b90 0x7f286807b0a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2870033000 tx=0x7f2870004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:11.807 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:11.805+0000 7f287ffff640 1 -- 172.21.15.105:0/3890611782 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2880027080 con 0x7f2888070360 2024-09-21T03:23:12.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:12.024+0000 7f288d838640 1 -- 172.21.15.105:0/3890611782 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f288815fc70 con 0x7f2888070360 2024-09-21T03:23:12.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:12.024+0000 7f287ffff640 1 -- 172.21.15.105:0/3890611782 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f2880014030 con 0x7f2888070360 2024-09-21T03:23:12.026 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:23:12.026 INFO:teuthology.orchestra.run.smithi105.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-21T03:23:12.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:12.026+0000 7f288d838640 1 -- 172.21.15.105:0/3890611782 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2868078b90 msgr2=0x7f286807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:12.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:12.026+0000 7f288d838640 1 --2- 172.21.15.105:0/3890611782 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2868078b90 0x7f286807b0a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2870033000 tx=0x7f2870004730 comp rx=0 tx=0).stop 2024-09-21T03:23:12.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:12.026+0000 7f288d838640 1 -- 172.21.15.105:0/3890611782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2888070360 msgr2=0x7f288814d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:12.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:12.026+0000 7f288d838640 1 --2- 172.21.15.105:0/3890611782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2888070360 0x7f288814d7f0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f288000c9a0 tx=0x7f288000ce60 comp rx=0 tx=0).stop 2024-09-21T03:23:12.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:12.026+0000 7f288d838640 1 -- 172.21.15.105:0/3890611782 shutdown_connections 2024-09-21T03:23:12.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:12.026+0000 7f288d838640 1 --2- 172.21.15.105:0/3890611782 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2868078b90 0x7f286807b0a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:12.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:12.026+0000 7f288d838640 1 --2- 172.21.15.105:0/3890611782 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28881600a0 0x7f288814b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:12.029 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:12.026+0000 7f288d838640 1 --2- 172.21.15.105:0/3890611782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28880ce7d0 0x7f28880ca1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:12.029 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:12.026+0000 7f288d838640 1 --2- 172.21.15.105:0/3890611782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2888070360 0x7f288814d7f0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:12.029 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:12.026+0000 7f288d838640 1 -- 172.21.15.105:0/3890611782 >> 172.21.15.105:0/3890611782 conn(0x7f28880cdcb0 msgr2=0x7f28880ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:12.029 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:12.026+0000 7f288d838640 1 -- 172.21.15.105:0/3890611782 shutdown_connections 2024-09-21T03:23:12.029 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:12.026+0000 7f288d838640 1 -- 172.21.15.105:0/3890611782 wait complete. 2024-09-21T03:23:12.039 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-21T03:23:12.039 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-21T03:23:12.784 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:23:14.785 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:23:16.787 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:23:17.039 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T03:23:17.165 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.162+0000 7fdc82094640 1 -- 172.21.15.105:0/523928374 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc7c0b40f0 msgr2=0x7fdc7c06cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:17.165 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.162+0000 7fdc82094640 1 --2- 172.21.15.105:0/523928374 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc7c0b40f0 0x7fdc7c06cde0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdc74005fd0 tx=0x7fdc7402a8b0 comp rx=0 tx=0).stop 2024-09-21T03:23:17.165 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.162+0000 7fdc82094640 1 -- 172.21.15.105:0/523928374 shutdown_connections 2024-09-21T03:23:17.165 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.162+0000 7fdc82094640 1 --2- 172.21.15.105:0/523928374 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc7c0b60b0 0x7fdc7c0ce660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:17.165 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.162+0000 7fdc82094640 1 --2- 172.21.15.105:0/523928374 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc7c0b40f0 0x7fdc7c06cde0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:17.165 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.162+0000 7fdc82094640 1 -- 172.21.15.105:0/523928374 >> 172.21.15.105:0/523928374 conn(0x7fdc7c0d12a0 msgr2=0x7fdc7c0d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:17.165 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.162+0000 7fdc82094640 1 -- 172.21.15.105:0/523928374 shutdown_connections 2024-09-21T03:23:17.165 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.162+0000 7fdc82094640 1 -- 172.21.15.105:0/523928374 wait complete. 2024-09-21T03:23:17.166 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.164+0000 7fdc82094640 1 Processor -- start 2024-09-21T03:23:17.166 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.164+0000 7fdc82094640 1 -- start start 2024-09-21T03:23:17.169 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.165+0000 7fdc82094640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc7c0b40f0 0x7fdc7c1555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:17.169 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.165+0000 7fdc82094640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc7c0b60b0 0x7fdc7c0c6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:17.169 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.165+0000 7fdc82094640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc7c0b66f0 0x7fdc7c0c7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:17.169 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.165+0000 7fdc82094640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c06d4a0 con 0x7fdc7c0b40f0 2024-09-21T03:23:17.169 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.165+0000 7fdc82094640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c06d320 con 0x7fdc7c0b66f0 2024-09-21T03:23:17.169 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.165+0000 7fdc82094640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdc7c06d620 con 0x7fdc7c0b60b0 2024-09-21T03:23:17.169 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.165+0000 7fdc7b7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc7c0b40f0 0x7fdc7c1555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:17.169 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.165+0000 7fdc7b7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc7c0b40f0 0x7fdc7c1555f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40580/0 (socket says 172.21.15.105:40580) 2024-09-21T03:23:17.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.165+0000 7fdc7b7fe640 1 -- 172.21.15.105:0/2335999542 learned_addr learned my addr 172.21.15.105:0/2335999542 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:23:17.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.165+0000 7fdc7affd640 1 --2- 172.21.15.105:0/2335999542 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc7c0b60b0 0x7fdc7c0c6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:17.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.165+0000 7fdc7b7fe640 1 -- 172.21.15.105:0/2335999542 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc7c0b60b0 msgr2=0x7fdc7c0c6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:17.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.165+0000 7fdc7b7fe640 1 --2- 172.21.15.105:0/2335999542 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc7c0b60b0 0x7fdc7c0c6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:17.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.165+0000 7fdc7b7fe640 1 -- 172.21.15.105:0/2335999542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc7c0b66f0 msgr2=0x7fdc7c0c7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:17.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.165+0000 7fdc7bfff640 1 --2- 172.21.15.105:0/2335999542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc7c0b66f0 0x7fdc7c0c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:17.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.165+0000 7fdc7b7fe640 1 --2- 172.21.15.105:0/2335999542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc7c0b66f0 0x7fdc7c0c7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:17.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.166+0000 7fdc7b7fe640 1 -- 172.21.15.105:0/2335999542 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc7c1f3c40 con 0x7fdc7c0b40f0 2024-09-21T03:23:17.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.166+0000 7fdc7b7fe640 1 --2- 172.21.15.105:0/2335999542 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc7c0b40f0 0x7fdc7c1555f0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c00c390 tx=0x7fdc6c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:17.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.166+0000 7fdc63fff640 1 -- 172.21.15.105:0/2335999542 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c004020 con 0x7fdc7c0b40f0 2024-09-21T03:23:17.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.166+0000 7fdc63fff640 1 -- 172.21.15.105:0/2335999542 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc6c0042b0 con 0x7fdc7c0b40f0 2024-09-21T03:23:17.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.166+0000 7fdc82094640 1 -- 172.21.15.105:0/2335999542 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc7c1f3f20 con 0x7fdc7c0b40f0 2024-09-21T03:23:17.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.166+0000 7fdc63fff640 1 -- 172.21.15.105:0/2335999542 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c003640 con 0x7fdc7c0b40f0 2024-09-21T03:23:17.171 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.166+0000 7fdc82094640 1 -- 172.21.15.105:0/2335999542 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc7c1f44e0 con 0x7fdc7c0b40f0 2024-09-21T03:23:17.171 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.167+0000 7fdc82094640 1 -- 172.21.15.105:0/2335999542 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc7c06db20 con 0x7fdc7c0b40f0 2024-09-21T03:23:17.171 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.168+0000 7fdc63fff640 1 -- 172.21.15.105:0/2335999542 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdc6c019020 con 0x7fdc7c0b40f0 2024-09-21T03:23:17.172 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.168+0000 7fdc63fff640 1 --2- 172.21.15.105:0/2335999542 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdc68078b90 0x7fdc6807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:17.172 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.168+0000 7fdc63fff640 1 -- 172.21.15.105:0/2335999542 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5767+0+0 (secure 0 0 0) 0x7fdc6c09a4f0 con 0x7fdc7c0b40f0 2024-09-21T03:23:17.172 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.168+0000 7fdc7affd640 1 --2- 172.21.15.105:0/2335999542 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdc68078b90 0x7fdc6807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:17.172 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.169+0000 7fdc7affd640 1 --2- 172.21.15.105:0/2335999542 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdc68078b90 0x7fdc6807b0a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c0b13a0 tx=0x7fdc70005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:17.175 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.173+0000 7fdc63fff640 1 -- 172.21.15.105:0/2335999542 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fdc6c0628f0 con 0x7fdc7c0b40f0 2024-09-21T03:23:17.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.384+0000 7fdc82094640 1 -- 172.21.15.105:0/2335999542 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fdc7c0b2640 con 0x7fdc7c0b40f0 2024-09-21T03:23:17.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.385+0000 7fdc63fff640 1 -- 172.21.15.105:0/2335999542 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7fdc6c0621f0 con 0x7fdc7c0b40f0 2024-09-21T03:23:17.388 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:23:17.388 INFO:teuthology.orchestra.run.smithi105.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-21T03:23:17.390 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.387+0000 7fdc82094640 1 -- 172.21.15.105:0/2335999542 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdc68078b90 msgr2=0x7fdc6807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:17.390 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.387+0000 7fdc82094640 1 --2- 172.21.15.105:0/2335999542 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdc68078b90 0x7fdc6807b0a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c0b13a0 tx=0x7fdc70005f90 comp rx=0 tx=0).stop 2024-09-21T03:23:17.390 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.387+0000 7fdc82094640 1 -- 172.21.15.105:0/2335999542 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc7c0b40f0 msgr2=0x7fdc7c1555f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:17.390 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.387+0000 7fdc82094640 1 --2- 172.21.15.105:0/2335999542 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc7c0b40f0 0x7fdc7c1555f0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c00c390 tx=0x7fdc6c00c850 comp rx=0 tx=0).stop 2024-09-21T03:23:17.390 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.387+0000 7fdc82094640 1 -- 172.21.15.105:0/2335999542 shutdown_connections 2024-09-21T03:23:17.390 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.387+0000 7fdc82094640 1 --2- 172.21.15.105:0/2335999542 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdc68078b90 0x7fdc6807b0a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:17.391 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.387+0000 7fdc82094640 1 --2- 172.21.15.105:0/2335999542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc7c0b66f0 0x7fdc7c0c7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:17.391 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.387+0000 7fdc82094640 1 --2- 172.21.15.105:0/2335999542 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc7c0b60b0 0x7fdc7c0c6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:17.391 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.387+0000 7fdc82094640 1 --2- 172.21.15.105:0/2335999542 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc7c0b40f0 0x7fdc7c1555f0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:17.391 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.387+0000 7fdc82094640 1 -- 172.21.15.105:0/2335999542 >> 172.21.15.105:0/2335999542 conn(0x7fdc7c0d12a0 msgr2=0x7fdc7c0b35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:17.391 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.387+0000 7fdc82094640 1 -- 172.21.15.105:0/2335999542 shutdown_connections 2024-09-21T03:23:17.391 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:17.387+0000 7fdc82094640 1 -- 172.21.15.105:0/2335999542 wait complete. 2024-09-21T03:23:17.401 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-21T03:23:17.401 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-21T03:23:18.789 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:23:20.791 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:23:22.402 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T03:23:22.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.525+0000 7fe29b3a1640 1 -- 172.21.15.105:0/143486944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2940706b0 msgr2=0x7fe2940735b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:22.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.525+0000 7fe29b3a1640 1 --2- 172.21.15.105:0/143486944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2940706b0 0x7fe2940735b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe28c005fd0 tx=0x7fe28c02aa90 comp rx=0 tx=0).stop 2024-09-21T03:23:22.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.525+0000 7fe29b3a1640 1 -- 172.21.15.105:0/143486944 shutdown_connections 2024-09-21T03:23:22.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.525+0000 7fe29b3a1640 1 --2- 172.21.15.105:0/143486944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2940706b0 0x7fe2940735b0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:22.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.525+0000 7fe29b3a1640 1 --2- 172.21.15.105:0/143486944 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2940ca800 0x7fe2940cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:22.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.525+0000 7fe29b3a1640 1 -- 172.21.15.105:0/143486944 >> 172.21.15.105:0/143486944 conn(0x7fe2940b1cb0 msgr2=0x7fe2940b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:22.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.525+0000 7fe29b3a1640 1 -- 172.21.15.105:0/143486944 shutdown_connections 2024-09-21T03:23:22.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.525+0000 7fe29b3a1640 1 -- 172.21.15.105:0/143486944 wait complete. 2024-09-21T03:23:22.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.527+0000 7fe29b3a1640 1 Processor -- start 2024-09-21T03:23:22.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.527+0000 7fe29b3a1640 1 -- start start 2024-09-21T03:23:22.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.528+0000 7fe29b3a1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2940ca800 0x7fe2941597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:22.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.528+0000 7fe29b3a1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2940cad30 0x7fe2941e5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:22.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.528+0000 7fe29b3a1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2941e5fc0 0x7fe29415e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:22.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.528+0000 7fe29b3a1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe294073f60 con 0x7fe2941e5fc0 2024-09-21T03:23:22.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.528+0000 7fe29b3a1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe294073de0 con 0x7fe2940ca800 2024-09-21T03:23:22.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.528+0000 7fe29b3a1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe2940740e0 con 0x7fe2940cad30 2024-09-21T03:23:22.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.528+0000 7fe29993e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2941e5fc0 0x7fe29415e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:22.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.528+0000 7fe29993e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2941e5fc0 0x7fe29415e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:49790/0 (socket says 172.21.15.105:49790) 2024-09-21T03:23:22.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.528+0000 7fe29993e640 1 -- 172.21.15.105:0/3857514939 learned_addr learned my addr 172.21.15.105:0/3857514939 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:23:22.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.528+0000 7fe29913d640 1 --2- 172.21.15.105:0/3857514939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2940ca800 0x7fe2941597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:22.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.528+0000 7fe29893c640 1 --2- 172.21.15.105:0/3857514939 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2940cad30 0x7fe2941e5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:22.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.529+0000 7fe29993e640 1 -- 172.21.15.105:0/3857514939 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2940cad30 msgr2=0x7fe2941e5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:22.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.529+0000 7fe29993e640 1 --2- 172.21.15.105:0/3857514939 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2940cad30 0x7fe2941e5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:22.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.529+0000 7fe29993e640 1 -- 172.21.15.105:0/3857514939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2940ca800 msgr2=0x7fe2941597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:22.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.529+0000 7fe29993e640 1 --2- 172.21.15.105:0/3857514939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2940ca800 0x7fe2941597e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:22.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.529+0000 7fe29993e640 1 -- 172.21.15.105:0/3857514939 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2941f33b0 con 0x7fe2941e5fc0 2024-09-21T03:23:22.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.529+0000 7fe29913d640 1 --2- 172.21.15.105:0/3857514939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2940ca800 0x7fe2941597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:23:22.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.529+0000 7fe29993e640 1 --2- 172.21.15.105:0/3857514939 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2941e5fc0 0x7fe29415e0f0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fe28c006010 tx=0x7fe28c003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:22.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.529+0000 7fe285ffb640 1 -- 172.21.15.105:0/3857514939 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28c044070 con 0x7fe2941e5fc0 2024-09-21T03:23:22.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.529+0000 7fe285ffb640 1 -- 172.21.15.105:0/3857514939 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe28c004040 con 0x7fe2941e5fc0 2024-09-21T03:23:22.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.529+0000 7fe285ffb640 1 -- 172.21.15.105:0/3857514939 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28c004430 con 0x7fe2941e5fc0 2024-09-21T03:23:22.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.529+0000 7fe29b3a1640 1 -- 172.21.15.105:0/3857514939 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2941f3690 con 0x7fe2941e5fc0 2024-09-21T03:23:22.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.529+0000 7fe29b3a1640 1 -- 172.21.15.105:0/3857514939 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2941f3c50 con 0x7fe2941e5fc0 2024-09-21T03:23:22.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.530+0000 7fe29b3a1640 1 -- 172.21.15.105:0/3857514939 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe294074600 con 0x7fe2941e5fc0 2024-09-21T03:23:22.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.531+0000 7fe285ffb640 1 -- 172.21.15.105:0/3857514939 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe28c047070 con 0x7fe2941e5fc0 2024-09-21T03:23:22.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.532+0000 7fe285ffb640 1 --2- 172.21.15.105:0/3857514939 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe278078bc0 0x7fe27807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:22.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.532+0000 7fe285ffb640 1 -- 172.21.15.105:0/3857514939 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5767+0+0 (secure 0 0 0) 0x7fe28c0bbb60 con 0x7fe2941e5fc0 2024-09-21T03:23:22.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.532+0000 7fe29913d640 1 --2- 172.21.15.105:0/3857514939 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe278078bc0 0x7fe27807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:22.536 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.532+0000 7fe29913d640 1 --2- 172.21.15.105:0/3857514939 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe278078bc0 0x7fe27807b0d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe2940cb250 tx=0x7fe290005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:22.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.536+0000 7fe285ffb640 1 -- 172.21.15.105:0/3857514939 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe28c032030 con 0x7fe2941e5fc0 2024-09-21T03:23:22.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.751+0000 7fe29b3a1640 1 -- 172.21.15.105:0/3857514939 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe294073610 con 0x7fe2941e5fc0 2024-09-21T03:23:22.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.751+0000 7fe285ffb640 1 -- 172.21.15.105:0/3857514939 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7fe28c083ff0 con 0x7fe2941e5fc0 2024-09-21T03:23:22.754 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:23:22.754 INFO:teuthology.orchestra.run.smithi105.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-21T03:23:22.756 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.754+0000 7fe29b3a1640 1 -- 172.21.15.105:0/3857514939 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe278078bc0 msgr2=0x7fe27807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:22.756 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.754+0000 7fe29b3a1640 1 --2- 172.21.15.105:0/3857514939 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe278078bc0 0x7fe27807b0d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe2940cb250 tx=0x7fe290005f90 comp rx=0 tx=0).stop 2024-09-21T03:23:22.757 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.754+0000 7fe29b3a1640 1 -- 172.21.15.105:0/3857514939 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2941e5fc0 msgr2=0x7fe29415e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:22.757 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.754+0000 7fe29b3a1640 1 --2- 172.21.15.105:0/3857514939 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2941e5fc0 0x7fe29415e0f0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fe28c006010 tx=0x7fe28c003ce0 comp rx=0 tx=0).stop 2024-09-21T03:23:22.757 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.754+0000 7fe29b3a1640 1 -- 172.21.15.105:0/3857514939 shutdown_connections 2024-09-21T03:23:22.757 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.754+0000 7fe29b3a1640 1 --2- 172.21.15.105:0/3857514939 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe278078bc0 0x7fe27807b0d0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:22.757 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.754+0000 7fe29b3a1640 1 --2- 172.21.15.105:0/3857514939 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2941e5fc0 0x7fe29415e0f0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:22.757 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.754+0000 7fe29b3a1640 1 --2- 172.21.15.105:0/3857514939 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2940cad30 0x7fe2941e5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:22.757 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.754+0000 7fe29b3a1640 1 --2- 172.21.15.105:0/3857514939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2940ca800 0x7fe2941597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:22.757 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.754+0000 7fe29b3a1640 1 -- 172.21.15.105:0/3857514939 >> 172.21.15.105:0/3857514939 conn(0x7fe2940b1cb0 msgr2=0x7fe2940b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:22.757 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.754+0000 7fe29b3a1640 1 -- 172.21.15.105:0/3857514939 shutdown_connections 2024-09-21T03:23:22.757 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:22.754+0000 7fe29b3a1640 1 -- 172.21.15.105:0/3857514939 wait complete. 2024-09-21T03:23:22.767 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-21T03:23:22.767 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-21T03:23:22.794 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:23:24.796 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:23:26.798 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:23:26.840 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:23:26.842 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:23:27.768 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T03:23:27.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:27.890+0000 7f8b1ee64640 1 -- 172.21.15.105:0/3047186969 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b180b4090 msgr2=0x7f8b180b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:27.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:27.890+0000 7f8b1ee64640 1 --2- 172.21.15.105:0/3047186969 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b180b4090 0x7f8b180b3550 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f8b18071020 tx=0x7f8b0c02a530 comp rx=0 tx=0).stop 2024-09-21T03:23:27.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:27.890+0000 7f8b1ee64640 1 -- 172.21.15.105:0/3047186969 shutdown_connections 2024-09-21T03:23:27.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:27.890+0000 7f8b1ee64640 1 --2- 172.21.15.105:0/3047186969 >> v2:172.21.15.162:3300/0 conn(0x7f8b180cfeb0 0x7f8b180d02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:27.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:27.890+0000 7f8b1ee64640 1 --2- 172.21.15.105:0/3047186969 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b180b4090 0x7f8b180b3550 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:27.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:27.890+0000 7f8b1ee64640 1 -- 172.21.15.105:0/3047186969 >> 172.21.15.105:0/3047186969 conn(0x7f8b180cdcc0 msgr2=0x7f8b180ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:27.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:27.890+0000 7f8b1ee64640 1 -- 172.21.15.105:0/3047186969 shutdown_connections 2024-09-21T03:23:27.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:27.890+0000 7f8b1ee64640 1 -- 172.21.15.105:0/3047186969 wait complete. 2024-09-21T03:23:27.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:27.892+0000 7f8b1ee64640 1 Processor -- start 2024-09-21T03:23:27.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:27.892+0000 7f8b1ee64640 1 -- start start 2024-09-21T03:23:27.896 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:27.894+0000 7f8b1ee64640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b1806fec0 0x7f8b181f2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:27.897 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:27.894+0000 7f8b1ee64640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b180b4090 0x7f8b181e6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:27.897 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:27.894+0000 7f8b1ee64640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b180cfeb0 0x7f8b1815de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:27.897 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:27.894+0000 7f8b1ee64640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8b180b4a30 con 0x7f8b1806fec0 2024-09-21T03:23:27.897 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:27.894+0000 7f8b1ee64640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8b180b48b0 con 0x7f8b180cfeb0 2024-09-21T03:23:27.897 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:27.894+0000 7f8b1ee64640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8b180b4bb0 con 0x7f8b180b4090 2024-09-21T03:23:27.897 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:27.894+0000 7f8b1cc00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b1806fec0 0x7f8b181f2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:27.897 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:27.894+0000 7f8b1cc00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b1806fec0 0x7f8b181f2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:49810/0 (socket says 172.21.15.105:49810) 2024-09-21T03:23:27.897 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:27.894+0000 7f8b1cc00640 1 -- 172.21.15.105:0/2122875822 learned_addr learned my addr 172.21.15.105:0/2122875822 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:23:27.897 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:27.894+0000 7f8b1d401640 1 --2- 172.21.15.105:0/2122875822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b180cfeb0 0x7f8b1815de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:27.897 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:27.894+0000 7f8b17fff640 1 --2- 172.21.15.105:0/2122875822 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b180b4090 0x7f8b181e6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:27.897 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:27.894+0000 7f8b1cc00640 1 -- 172.21.15.105:0/2122875822 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b180b4090 msgr2=0x7f8b181e6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:27.897 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:27.894+0000 7f8b1cc00640 1 --2- 172.21.15.105:0/2122875822 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b180b4090 0x7f8b181e6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:27.897 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:27.894+0000 7f8b1cc00640 1 -- 172.21.15.105:0/2122875822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b180cfeb0 msgr2=0x7f8b1815de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:27.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:27.894+0000 7f8b1cc00640 1 --2- 172.21.15.105:0/2122875822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b180cfeb0 0x7f8b1815de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:27.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:27.894+0000 7f8b1cc00640 1 -- 172.21.15.105:0/2122875822 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b18157ee0 con 0x7f8b1806fec0 2024-09-21T03:23:27.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:27.894+0000 7f8b17fff640 1 --2- 172.21.15.105:0/2122875822 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b180b4090 0x7f8b181e6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:23:27.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:27.894+0000 7f8b1cc00640 1 --2- 172.21.15.105:0/2122875822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b1806fec0 0x7f8b181f2ea0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c0098f0 tx=0x7f8b0c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:27.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:27.894+0000 7f8b157fa640 1 -- 172.21.15.105:0/2122875822 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c031d60 con 0x7f8b1806fec0 2024-09-21T03:23:27.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:27.894+0000 7f8b157fa640 1 -- 172.21.15.105:0/2122875822 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b0c033e10 con 0x7f8b1806fec0 2024-09-21T03:23:27.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:27.894+0000 7f8b1ee64640 1 -- 172.21.15.105:0/2122875822 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b181581c0 con 0x7f8b1806fec0 2024-09-21T03:23:27.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:27.894+0000 7f8b157fa640 1 -- 172.21.15.105:0/2122875822 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c005260 con 0x7f8b1806fec0 2024-09-21T03:23:27.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:27.895+0000 7f8b1ee64640 1 -- 172.21.15.105:0/2122875822 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b181f4c50 con 0x7f8b1806fec0 2024-09-21T03:23:27.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:27.896+0000 7f8b1ee64640 1 -- 172.21.15.105:0/2122875822 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b180b5060 con 0x7f8b1806fec0 2024-09-21T03:23:27.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:27.896+0000 7f8b157fa640 1 -- 172.21.15.105:0/2122875822 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8b0c005400 con 0x7f8b1806fec0 2024-09-21T03:23:27.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:27.897+0000 7f8b157fa640 1 --2- 172.21.15.105:0/2122875822 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8afc078b90 0x7f8afc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:27.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:27.897+0000 7f8b157fa640 1 -- 172.21.15.105:0/2122875822 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5767+0+0 (secure 0 0 0) 0x7f8b0c0bbdf0 con 0x7f8b1806fec0 2024-09-21T03:23:27.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:27.897+0000 7f8b17fff640 1 --2- 172.21.15.105:0/2122875822 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8afc078b90 0x7f8afc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:27.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:27.898+0000 7f8b17fff640 1 --2- 172.21.15.105:0/2122875822 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8afc078b90 0x7f8afc07b0a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8b04000f60 tx=0x7f8b04009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:27.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:27.902+0000 7f8b157fa640 1 -- 172.21.15.105:0/2122875822 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8b0c03f030 con 0x7f8b1806fec0 2024-09-21T03:23:28.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:28.118+0000 7f8b1ee64640 1 -- 172.21.15.105:0/2122875822 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8b180b1150 con 0x7f8b1806fec0 2024-09-21T03:23:28.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:28.118+0000 7f8b157fa640 1 -- 172.21.15.105:0/2122875822 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f8b0c005d00 con 0x7f8b1806fec0 2024-09-21T03:23:28.120 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:23:28.120 INFO:teuthology.orchestra.run.smithi105.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-21T03:23:28.122 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:28.120+0000 7f8b1ee64640 1 -- 172.21.15.105:0/2122875822 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8afc078b90 msgr2=0x7f8afc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:28.122 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:28.120+0000 7f8b1ee64640 1 --2- 172.21.15.105:0/2122875822 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8afc078b90 0x7f8afc07b0a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8b04000f60 tx=0x7f8b04009040 comp rx=0 tx=0).stop 2024-09-21T03:23:28.122 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:28.120+0000 7f8b1ee64640 1 -- 172.21.15.105:0/2122875822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b1806fec0 msgr2=0x7f8b181f2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:28.122 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:28.120+0000 7f8b1ee64640 1 --2- 172.21.15.105:0/2122875822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b1806fec0 0x7f8b181f2ea0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c0098f0 tx=0x7f8b0c033c20 comp rx=0 tx=0).stop 2024-09-21T03:23:28.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:28.120+0000 7f8b1ee64640 1 -- 172.21.15.105:0/2122875822 shutdown_connections 2024-09-21T03:23:28.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:28.120+0000 7f8b1ee64640 1 --2- 172.21.15.105:0/2122875822 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8afc078b90 0x7f8afc07b0a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:28.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:28.120+0000 7f8b1ee64640 1 --2- 172.21.15.105:0/2122875822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b180cfeb0 0x7f8b1815de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:28.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:28.120+0000 7f8b1ee64640 1 --2- 172.21.15.105:0/2122875822 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b180b4090 0x7f8b181e6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:28.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:28.120+0000 7f8b1ee64640 1 --2- 172.21.15.105:0/2122875822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b1806fec0 0x7f8b181f2ea0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:28.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:28.120+0000 7f8b1ee64640 1 -- 172.21.15.105:0/2122875822 >> 172.21.15.105:0/2122875822 conn(0x7f8b180cdcc0 msgr2=0x7f8b180adf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:28.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:28.120+0000 7f8b1ee64640 1 -- 172.21.15.105:0/2122875822 shutdown_connections 2024-09-21T03:23:28.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:28.120+0000 7f8b1ee64640 1 -- 172.21.15.105:0/2122875822 wait complete. 2024-09-21T03:23:28.133 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-21T03:23:28.133 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-21T03:23:28.800 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:23:30.802 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:23:32.804 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:23:33.134 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T03:23:33.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.258+0000 7ff71d40a640 1 -- 172.21.15.105:0/1605053693 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff704004800 msgr2=0x7ff704004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:33.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.258+0000 7ff71d40a640 1 --2- 172.21.15.105:0/1605053693 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff704004800 0x7ff704004c10 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7ff71808c9c0 tx=0x7ff704005830 comp rx=0 tx=0).stop 2024-09-21T03:23:33.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.258+0000 7ff7177fe640 1 -- 172.21.15.105:0/1605053693 reap_dead start 2024-09-21T03:23:33.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.258+0000 7ff71d40a640 1 -- 172.21.15.105:0/1605053693 shutdown_connections 2024-09-21T03:23:33.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.258+0000 7ff71d40a640 1 -- 172.21.15.105:0/1605053693 >> 172.21.15.105:0/1605053693 conn(0x7ff71809d8f0 msgr2=0x7ff7180d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:33.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.258+0000 7ff71d40a640 1 -- 172.21.15.105:0/1605053693 shutdown_connections 2024-09-21T03:23:33.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.258+0000 7ff71d40a640 1 -- 172.21.15.105:0/1605053693 wait complete. 2024-09-21T03:23:33.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.260+0000 7ff71d40a640 1 Processor -- start 2024-09-21T03:23:33.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.260+0000 7ff71d40a640 1 -- start start 2024-09-21T03:23:33.264 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.261+0000 7ff71d40a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff704004800 0x7ff718157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:33.264 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.261+0000 7ff71d40a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7180b52f0 0x7ff7180c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:33.264 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.261+0000 7ff71d40a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7180c9b00 0x7ff7180b5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:33.264 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.261+0000 7ff71d40a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff7181630d0 con 0x7ff7180c9b00 2024-09-21T03:23:33.264 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.261+0000 7ff71d40a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff718162f50 con 0x7ff7180b52f0 2024-09-21T03:23:33.264 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.261+0000 7ff71d40a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff718163250 con 0x7ff704004800 2024-09-21T03:23:33.264 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.261+0000 7ff7177fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7180c9b00 0x7ff7180b5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:33.264 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.261+0000 7ff7177fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7180c9b00 0x7ff7180b5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:57728/0 (socket says 172.21.15.105:57728) 2024-09-21T03:23:33.264 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.261+0000 7ff7177fe640 1 -- 172.21.15.105:0/3281214152 learned_addr learned my addr 172.21.15.105:0/3281214152 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:23:33.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.261+0000 7ff716ffd640 1 --2- 172.21.15.105:0/3281214152 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff704004800 0x7ff718157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:33.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.261+0000 7ff70ffff640 1 --2- 172.21.15.105:0/3281214152 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7180b52f0 0x7ff7180c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:33.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.261+0000 7ff7177fe640 1 -- 172.21.15.105:0/3281214152 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff704004800 msgr2=0x7ff718157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:33.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.261+0000 7ff7177fe640 1 --2- 172.21.15.105:0/3281214152 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff704004800 0x7ff718157590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:33.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.261+0000 7ff7177fe640 1 -- 172.21.15.105:0/3281214152 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7180b52f0 msgr2=0x7ff7180c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:33.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.261+0000 7ff7177fe640 1 --2- 172.21.15.105:0/3281214152 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7180b52f0 0x7ff7180c95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:33.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.261+0000 7ff7177fe640 1 -- 172.21.15.105:0/3281214152 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7180c9f10 con 0x7ff7180c9b00 2024-09-21T03:23:33.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.261+0000 7ff7177fe640 1 --2- 172.21.15.105:0/3281214152 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7180c9b00 0x7ff7180b5a30 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7ff7180ceba0 tx=0x7ff71000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:33.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.262+0000 7ff70f7fe640 1 -- 172.21.15.105:0/3281214152 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff71000eea0 con 0x7ff7180c9b00 2024-09-21T03:23:33.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.262+0000 7ff70f7fe640 1 -- 172.21.15.105:0/3281214152 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff710017070 con 0x7ff7180c9b00 2024-09-21T03:23:33.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.262+0000 7ff71d40a640 1 -- 172.21.15.105:0/3281214152 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7180ce3e0 con 0x7ff7180c9b00 2024-09-21T03:23:33.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.262+0000 7ff70f7fe640 1 -- 172.21.15.105:0/3281214152 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff710011460 con 0x7ff7180c9b00 2024-09-21T03:23:33.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.262+0000 7ff71d40a640 1 -- 172.21.15.105:0/3281214152 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7180cbe90 con 0x7ff7180c9b00 2024-09-21T03:23:33.266 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.263+0000 7ff71d40a640 1 -- 172.21.15.105:0/3281214152 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7180ce150 con 0x7ff7180c9b00 2024-09-21T03:23:33.266 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.263+0000 7ff70f7fe640 1 -- 172.21.15.105:0/3281214152 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff710011600 con 0x7ff7180c9b00 2024-09-21T03:23:33.267 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.264+0000 7ff70f7fe640 1 --2- 172.21.15.105:0/3281214152 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff6f8078bc0 0x7ff6f807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:33.267 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.264+0000 7ff70f7fe640 1 -- 172.21.15.105:0/3281214152 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5767+0+0 (secure 0 0 0) 0x7ff71009b1b0 con 0x7ff7180c9b00 2024-09-21T03:23:33.267 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.264+0000 7ff716ffd640 1 --2- 172.21.15.105:0/3281214152 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff6f8078bc0 0x7ff6f807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:33.267 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.265+0000 7ff716ffd640 1 --2- 172.21.15.105:0/3281214152 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff6f8078bc0 0x7ff6f807b0d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff708009cd0 tx=0x7ff708005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:33.270 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.269+0000 7ff70f7fe640 1 -- 172.21.15.105:0/3281214152 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff7180c9f10 con 0x7ff7180c9b00 2024-09-21T03:23:33.483 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.481+0000 7ff71d40a640 1 -- 172.21.15.105:0/3281214152 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff7180d1800 con 0x7ff7180c9b00 2024-09-21T03:23:33.483 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.482+0000 7ff70f7fe640 1 -- 172.21.15.105:0/3281214152 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7ff710063640 con 0x7ff7180c9b00 2024-09-21T03:23:33.484 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:23:33.484 INFO:teuthology.orchestra.run.smithi105.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-21T03:23:33.486 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.484+0000 7ff71d40a640 1 -- 172.21.15.105:0/3281214152 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff6f8078bc0 msgr2=0x7ff6f807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:33.486 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.484+0000 7ff71d40a640 1 --2- 172.21.15.105:0/3281214152 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff6f8078bc0 0x7ff6f807b0d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff708009cd0 tx=0x7ff708005f90 comp rx=0 tx=0).stop 2024-09-21T03:23:33.486 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.484+0000 7ff71d40a640 1 -- 172.21.15.105:0/3281214152 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7180c9b00 msgr2=0x7ff7180b5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:33.486 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.484+0000 7ff71d40a640 1 --2- 172.21.15.105:0/3281214152 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7180c9b00 0x7ff7180b5a30 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7ff7180ceba0 tx=0x7ff71000ec50 comp rx=0 tx=0).stop 2024-09-21T03:23:33.486 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.484+0000 7ff71d40a640 1 -- 172.21.15.105:0/3281214152 shutdown_connections 2024-09-21T03:23:33.486 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.484+0000 7ff71d40a640 1 --2- 172.21.15.105:0/3281214152 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff6f8078bc0 0x7ff6f807b0d0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:33.486 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.484+0000 7ff71d40a640 1 --2- 172.21.15.105:0/3281214152 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7180c9b00 0x7ff7180b5a30 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:33.486 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.484+0000 7ff71d40a640 1 --2- 172.21.15.105:0/3281214152 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7180b52f0 0x7ff7180c95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:33.486 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.484+0000 7ff71d40a640 1 --2- 172.21.15.105:0/3281214152 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff704004800 0x7ff718157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:33.486 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.484+0000 7ff71d40a640 1 -- 172.21.15.105:0/3281214152 >> 172.21.15.105:0/3281214152 conn(0x7ff71809d8f0 msgr2=0x7ff71806f980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:33.486 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.484+0000 7ff71d40a640 1 -- 172.21.15.105:0/3281214152 shutdown_connections 2024-09-21T03:23:33.487 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:33.484+0000 7ff71d40a640 1 -- 172.21.15.105:0/3281214152 wait complete. 2024-09-21T03:23:33.496 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-21T03:23:33.496 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-21T03:23:34.806 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:23:36.808 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:23:38.497 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T03:23:38.623 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.621+0000 7f5cbf1ba640 1 -- 172.21.15.105:0/3319485856 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5cb80cfeb0 msgr2=0x7f5cb80d02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:38.623 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.621+0000 7f5cbf1ba640 1 --2- 172.21.15.105:0/3319485856 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5cb80cfeb0 0x7f5cb80d02c0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f5cb815f310 tx=0x7f5cb002a530 comp rx=0 tx=0).stop 2024-09-21T03:23:38.623 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.621+0000 7f5cbf1ba640 1 -- 172.21.15.105:0/3319485856 shutdown_connections 2024-09-21T03:23:38.623 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.621+0000 7f5cbf1ba640 1 --2- 172.21.15.105:0/3319485856 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5cb80cfeb0 0x7f5cb80d02c0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:38.624 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.621+0000 7f5cbf1ba640 1 --2- 172.21.15.105:0/3319485856 >> v2:172.21.15.162:3300/0 conn(0x7f5cb80705d0 0x7f5cb80b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:38.624 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.621+0000 7f5cbf1ba640 1 -- 172.21.15.105:0/3319485856 >> 172.21.15.105:0/3319485856 conn(0x7f5cb80cdcc0 msgr2=0x7f5cb80ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:38.624 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.621+0000 7f5cbf1ba640 1 -- 172.21.15.105:0/3319485856 shutdown_connections 2024-09-21T03:23:38.624 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.621+0000 7f5cbf1ba640 1 -- 172.21.15.105:0/3319485856 wait complete. 2024-09-21T03:23:38.624 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.623+0000 7f5cbf1ba640 1 Processor -- start 2024-09-21T03:23:38.624 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.623+0000 7f5cbf1ba640 1 -- start start 2024-09-21T03:23:38.627 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.624+0000 7f5cbf1ba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5cb80b4090 0x7f5cb81497b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:38.627 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.624+0000 7f5cbf1ba640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5cb80cfeb0 0x7f5cb81f04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:38.627 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.624+0000 7f5cbf1ba640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5cb814b840 0x7f5cb81f38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:38.627 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.624+0000 7f5cbf1ba640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb80b4a30 con 0x7f5cb814b840 2024-09-21T03:23:38.627 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.624+0000 7f5cbf1ba640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb80b48b0 con 0x7f5cb80b4090 2024-09-21T03:23:38.627 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.624+0000 7f5cbf1ba640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5cb80b4bb0 con 0x7f5cb80cfeb0 2024-09-21T03:23:38.628 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.625+0000 7f5cbd757640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5cb814b840 0x7f5cb81f38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:38.628 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.625+0000 7f5cbd757640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5cb814b840 0x7f5cb81f38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:57748/0 (socket says 172.21.15.105:57748) 2024-09-21T03:23:38.628 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.625+0000 7f5cbd757640 1 -- 172.21.15.105:0/3077509699 learned_addr learned my addr 172.21.15.105:0/3077509699 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:23:38.628 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.625+0000 7f5cb7fff640 1 --2- 172.21.15.105:0/3077509699 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5cb80cfeb0 0x7f5cb81f04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:38.628 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.625+0000 7f5cbcf56640 1 --2- 172.21.15.105:0/3077509699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5cb80b4090 0x7f5cb81497b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:38.628 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.625+0000 7f5cbd757640 1 -- 172.21.15.105:0/3077509699 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5cb80cfeb0 msgr2=0x7f5cb81f04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:38.628 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.625+0000 7f5cbd757640 1 --2- 172.21.15.105:0/3077509699 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5cb80cfeb0 0x7f5cb81f04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:38.628 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.625+0000 7f5cbd757640 1 -- 172.21.15.105:0/3077509699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5cb80b4090 msgr2=0x7f5cb81497b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:38.628 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.625+0000 7f5cbd757640 1 --2- 172.21.15.105:0/3077509699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5cb80b4090 0x7f5cb81497b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:38.628 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.625+0000 7f5cbd757640 1 -- 172.21.15.105:0/3077509699 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cb814c780 con 0x7f5cb814b840 2024-09-21T03:23:38.628 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.625+0000 7f5cbd757640 1 --2- 172.21.15.105:0/3077509699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5cb814b840 0x7f5cb81f38a0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f5cb002ab20 tx=0x7f5cb0033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:38.628 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.625+0000 7f5cb57fa640 1 -- 172.21.15.105:0/3077509699 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb0031d60 con 0x7f5cb814b840 2024-09-21T03:23:38.628 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.625+0000 7f5cb57fa640 1 -- 172.21.15.105:0/3077509699 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5cb0033e10 con 0x7f5cb814b840 2024-09-21T03:23:38.628 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.625+0000 7f5cbf1ba640 1 -- 172.21.15.105:0/3077509699 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cb814bee0 con 0x7f5cb814b840 2024-09-21T03:23:38.629 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.625+0000 7f5cb57fa640 1 -- 172.21.15.105:0/3077509699 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb0005280 con 0x7f5cb814b840 2024-09-21T03:23:38.629 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.625+0000 7f5cbf1ba640 1 -- 172.21.15.105:0/3077509699 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cb814c4a0 con 0x7f5cb814b840 2024-09-21T03:23:38.629 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.626+0000 7f5cbf1ba640 1 -- 172.21.15.105:0/3077509699 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cb81f31f0 con 0x7f5cb814b840 2024-09-21T03:23:38.629 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.627+0000 7f5cb57fa640 1 -- 172.21.15.105:0/3077509699 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5cb0005420 con 0x7f5cb814b840 2024-09-21T03:23:38.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.627+0000 7f5cb57fa640 1 --2- 172.21.15.105:0/3077509699 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5ca4078b90 0x7f5ca407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:38.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.628+0000 7f5cb57fa640 1 -- 172.21.15.105:0/3077509699 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5767+0+0 (secure 0 0 0) 0x7f5cb00bbf00 con 0x7f5cb814b840 2024-09-21T03:23:38.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.628+0000 7f5cbcf56640 1 --2- 172.21.15.105:0/3077509699 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5ca4078b90 0x7f5ca407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:38.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.628+0000 7f5cbcf56640 1 --2- 172.21.15.105:0/3077509699 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5ca4078b90 0x7f5ca407b0a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8001720 tx=0x7f5ca8007e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:38.634 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.632+0000 7f5cb57fa640 1 -- 172.21.15.105:0/3077509699 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5cb003f030 con 0x7f5cb814b840 2024-09-21T03:23:38.810 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:23:38.852 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.850+0000 7f5cbf1ba640 1 -- 172.21.15.105:0/3077509699 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5cb814bc70 con 0x7f5cb814b840 2024-09-21T03:23:38.852 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.851+0000 7f5cb57fa640 1 -- 172.21.15.105:0/3077509699 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f5cb0083cb0 con 0x7f5cb814b840 2024-09-21T03:23:38.852 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:23:38.853 INFO:teuthology.orchestra.run.smithi105.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-21T03:23:38.855 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.853+0000 7f5cbf1ba640 1 -- 172.21.15.105:0/3077509699 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5ca4078b90 msgr2=0x7f5ca407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:38.855 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.853+0000 7f5cbf1ba640 1 --2- 172.21.15.105:0/3077509699 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5ca4078b90 0x7f5ca407b0a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8001720 tx=0x7f5ca8007e90 comp rx=0 tx=0).stop 2024-09-21T03:23:38.855 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.853+0000 7f5cbf1ba640 1 -- 172.21.15.105:0/3077509699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5cb814b840 msgr2=0x7f5cb81f38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:38.855 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.853+0000 7f5cbf1ba640 1 --2- 172.21.15.105:0/3077509699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5cb814b840 0x7f5cb81f38a0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f5cb002ab20 tx=0x7f5cb0033c20 comp rx=0 tx=0).stop 2024-09-21T03:23:38.855 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.853+0000 7f5cbf1ba640 1 -- 172.21.15.105:0/3077509699 shutdown_connections 2024-09-21T03:23:38.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.853+0000 7f5cbf1ba640 1 --2- 172.21.15.105:0/3077509699 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5ca4078b90 0x7f5ca407b0a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:38.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.853+0000 7f5cbf1ba640 1 --2- 172.21.15.105:0/3077509699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5cb814b840 0x7f5cb81f38a0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:38.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.853+0000 7f5cbf1ba640 1 --2- 172.21.15.105:0/3077509699 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5cb80cfeb0 0x7f5cb81f04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:38.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.853+0000 7f5cbf1ba640 1 --2- 172.21.15.105:0/3077509699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5cb80b4090 0x7f5cb81497b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:38.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.853+0000 7f5cbf1ba640 1 -- 172.21.15.105:0/3077509699 >> 172.21.15.105:0/3077509699 conn(0x7f5cb80cdcc0 msgr2=0x7f5cb80b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:38.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.853+0000 7f5cbf1ba640 1 -- 172.21.15.105:0/3077509699 shutdown_connections 2024-09-21T03:23:38.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:38.853+0000 7f5cbf1ba640 1 -- 172.21.15.105:0/3077509699 wait complete. 2024-09-21T03:23:38.865 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-21T03:23:38.866 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-21T03:23:40.812 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:23:42.815 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:23:43.867 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T03:23:43.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:43.993+0000 7fafa06fa640 1 -- 172.21.15.105:0/282212303 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf980cd3e0 msgr2=0x7faf98070180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:43.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:43.993+0000 7fafa06fa640 1 --2- 172.21.15.105:0/282212303 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf980cd3e0 0x7faf98070180 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7faf980cffa0 tx=0x7faf8802a540 comp rx=0 tx=0).stop 2024-09-21T03:23:43.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:43.993+0000 7fafa06fa640 1 -- 172.21.15.105:0/282212303 shutdown_connections 2024-09-21T03:23:43.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:43.993+0000 7fafa06fa640 1 --2- 172.21.15.105:0/282212303 >> v2:172.21.15.162:3300/0 conn(0x7faf980706c0 0x7faf98072ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:43.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:43.993+0000 7fafa06fa640 1 --2- 172.21.15.105:0/282212303 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf980cd3e0 0x7faf98070180 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:43.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:43.993+0000 7fafa06fa640 1 --2- 172.21.15.105:0/282212303 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf980af780 0x7faf980b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:43.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:43.993+0000 7fafa06fa640 1 -- 172.21.15.105:0/282212303 >> 172.21.15.105:0/282212303 conn(0x7faf9806d7d0 msgr2=0x7faf980b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:43.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:43.993+0000 7fafa06fa640 1 -- 172.21.15.105:0/282212303 shutdown_connections 2024-09-21T03:23:43.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:43.993+0000 7fafa06fa640 1 -- 172.21.15.105:0/282212303 wait complete. 2024-09-21T03:23:43.996 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:43.995+0000 7fafa06fa640 1 Processor -- start 2024-09-21T03:23:43.996 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:43.995+0000 7fafa06fa640 1 -- start start 2024-09-21T03:23:43.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:43.996+0000 7fafa06fa640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf980706c0 0x7faf9814ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:43.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:43.996+0000 7fafa06fa640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf980af780 0x7faf981f9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:43.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:43.996+0000 7fafa06fa640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf980cd3e0 0x7faf981f99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:43.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:43.996+0000 7fafa06fa640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7faf98073930 con 0x7faf980706c0 2024-09-21T03:23:43.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:43.996+0000 7fafa06fa640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faf980737b0 con 0x7faf980af780 2024-09-21T03:23:43.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:43.996+0000 7fafa06fa640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faf98073ab0 con 0x7faf980cd3e0 2024-09-21T03:23:43.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:43.996+0000 7faf9e496640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf980706c0 0x7faf9814ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:43.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:43.996+0000 7faf9e496640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf980706c0 0x7faf9814ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:45584/0 (socket says 172.21.15.105:45584) 2024-09-21T03:23:43.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:43.996+0000 7faf9e496640 1 -- 172.21.15.105:0/2915618659 learned_addr learned my addr 172.21.15.105:0/2915618659 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:23:43.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:43.996+0000 7faf9dc95640 1 --2- 172.21.15.105:0/2915618659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf980af780 0x7faf981f9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:44.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:43.996+0000 7faf9ec97640 1 --2- 172.21.15.105:0/2915618659 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf980cd3e0 0x7faf981f99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:44.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:43.996+0000 7faf9e496640 1 -- 172.21.15.105:0/2915618659 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf980cd3e0 msgr2=0x7faf981f99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:44.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:43.996+0000 7faf9e496640 1 --2- 172.21.15.105:0/2915618659 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf980cd3e0 0x7faf981f99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:44.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:43.996+0000 7faf9e496640 1 -- 172.21.15.105:0/2915618659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf980af780 msgr2=0x7faf981f9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:44.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:43.996+0000 7faf9e496640 1 --2- 172.21.15.105:0/2915618659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf980af780 0x7faf981f9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:44.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:43.996+0000 7faf9e496640 1 -- 172.21.15.105:0/2915618659 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf9809d5c0 con 0x7faf980706c0 2024-09-21T03:23:44.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:43.996+0000 7faf9ec97640 1 --2- 172.21.15.105:0/2915618659 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf980cd3e0 0x7faf981f99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:23:44.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:43.996+0000 7faf9e496640 1 --2- 172.21.15.105:0/2915618659 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf980706c0 0x7faf9814ff30 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7faf9400b410 tx=0x7faf9400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:44.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:43.997+0000 7faf8effd640 1 -- 172.21.15.105:0/2915618659 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf94015020 con 0x7faf980706c0 2024-09-21T03:23:44.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:43.997+0000 7faf8effd640 1 -- 172.21.15.105:0/2915618659 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf94011940 con 0x7faf980706c0 2024-09-21T03:23:44.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:43.997+0000 7faf8effd640 1 -- 172.21.15.105:0/2915618659 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf94011d90 con 0x7faf980706c0 2024-09-21T03:23:44.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:43.997+0000 7fafa06fa640 1 -- 172.21.15.105:0/2915618659 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf98150680 con 0x7faf980706c0 2024-09-21T03:23:44.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:43.997+0000 7fafa06fa640 1 -- 172.21.15.105:0/2915618659 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf98167690 con 0x7faf980706c0 2024-09-21T03:23:44.001 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:43.998+0000 7fafa06fa640 1 -- 172.21.15.105:0/2915618659 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf980b39c0 con 0x7faf980706c0 2024-09-21T03:23:44.001 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:43.999+0000 7faf8effd640 1 -- 172.21.15.105:0/2915618659 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faf94018020 con 0x7faf980706c0 2024-09-21T03:23:44.001 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:43.999+0000 7faf8effd640 1 --2- 172.21.15.105:0/2915618659 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7faf7c078b90 0x7faf7c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:44.001 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:43.999+0000 7faf8effd640 1 -- 172.21.15.105:0/2915618659 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5767+0+0 (secure 0 0 0) 0x7faf9409ab90 con 0x7faf980706c0 2024-09-21T03:23:44.002 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:43.999+0000 7faf9dc95640 1 --2- 172.21.15.105:0/2915618659 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7faf7c078b90 0x7faf7c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:44.002 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:44.000+0000 7faf9dc95640 1 --2- 172.21.15.105:0/2915618659 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7faf7c078b90 0x7faf7c07b0a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7faf88033000 tx=0x7faf88004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:44.005 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:44.004+0000 7faf8effd640 1 -- 172.21.15.105:0/2915618659 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7faf9401f020 con 0x7faf980706c0 2024-09-21T03:23:44.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:44.215+0000 7fafa06fa640 1 -- 172.21.15.105:0/2915618659 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7faf981678c0 con 0x7faf980706c0 2024-09-21T03:23:44.218 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:44.216+0000 7faf8effd640 1 -- 172.21.15.105:0/2915618659 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7faf940630b0 con 0x7faf980706c0 2024-09-21T03:23:44.218 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:23:44.218 INFO:teuthology.orchestra.run.smithi105.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-21T03:23:44.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:44.218+0000 7fafa06fa640 1 -- 172.21.15.105:0/2915618659 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7faf7c078b90 msgr2=0x7faf7c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:44.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:44.218+0000 7fafa06fa640 1 --2- 172.21.15.105:0/2915618659 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7faf7c078b90 0x7faf7c07b0a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7faf88033000 tx=0x7faf88004730 comp rx=0 tx=0).stop 2024-09-21T03:23:44.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:44.218+0000 7fafa06fa640 1 -- 172.21.15.105:0/2915618659 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf980706c0 msgr2=0x7faf9814ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:44.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:44.218+0000 7fafa06fa640 1 --2- 172.21.15.105:0/2915618659 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf980706c0 0x7faf9814ff30 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7faf9400b410 tx=0x7faf9400b8d0 comp rx=0 tx=0).stop 2024-09-21T03:23:44.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:44.218+0000 7fafa06fa640 1 -- 172.21.15.105:0/2915618659 shutdown_connections 2024-09-21T03:23:44.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:44.218+0000 7fafa06fa640 1 --2- 172.21.15.105:0/2915618659 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7faf7c078b90 0x7faf7c07b0a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:44.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:44.218+0000 7fafa06fa640 1 --2- 172.21.15.105:0/2915618659 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf980cd3e0 0x7faf981f99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:44.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:44.218+0000 7fafa06fa640 1 --2- 172.21.15.105:0/2915618659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf980af780 0x7faf981f9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:44.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:44.218+0000 7fafa06fa640 1 --2- 172.21.15.105:0/2915618659 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf980706c0 0x7faf9814ff30 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:44.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:44.218+0000 7fafa06fa640 1 -- 172.21.15.105:0/2915618659 >> 172.21.15.105:0/2915618659 conn(0x7faf9806d7d0 msgr2=0x7faf980afbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:44.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:44.218+0000 7fafa06fa640 1 -- 172.21.15.105:0/2915618659 shutdown_connections 2024-09-21T03:23:44.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:44.218+0000 7fafa06fa640 1 -- 172.21.15.105:0/2915618659 wait complete. 2024-09-21T03:23:44.230 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-21T03:23:44.231 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-21T03:23:44.817 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:23:46.818 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:23:48.820 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:23:49.231 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T03:23:49.356 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.354+0000 7f70b86bd640 1 -- 172.21.15.105:0/1353996273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70b0144270 msgr2=0x7f70b00b5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:49.356 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.354+0000 7f70b86bd640 1 --2- 172.21.15.105:0/1353996273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70b0144270 0x7f70b00b5680 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f70ac009830 tx=0x7f70ac02a510 comp rx=0 tx=0).stop 2024-09-21T03:23:49.356 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.354+0000 7f70b86bd640 1 -- 172.21.15.105:0/1353996273 shutdown_connections 2024-09-21T03:23:49.356 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.354+0000 7f70b86bd640 1 --2- 172.21.15.105:0/1353996273 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70b0074560 0x7f70b00cfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:49.356 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.354+0000 7f70b86bd640 1 --2- 172.21.15.105:0/1353996273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70b0144270 0x7f70b00b5680 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:49.356 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.354+0000 7f70b86bd640 1 -- 172.21.15.105:0/1353996273 >> 172.21.15.105:0/1353996273 conn(0x7f70b00d15f0 msgr2=0x7f70b0073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:49.356 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.354+0000 7f70b86bd640 1 -- 172.21.15.105:0/1353996273 shutdown_connections 2024-09-21T03:23:49.356 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.354+0000 7f70b86bd640 1 -- 172.21.15.105:0/1353996273 wait complete. 2024-09-21T03:23:49.357 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.356+0000 7f70b86bd640 1 Processor -- start 2024-09-21T03:23:49.357 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.356+0000 7f70b86bd640 1 -- start start 2024-09-21T03:23:49.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.357+0000 7f70b86bd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70b0142270 0x7f70b01378a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:49.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.357+0000 7f70b86bd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70b0144270 0x7f70b00cc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:49.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.357+0000 7f70b86bd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70b00cc6d0 0x7f70b00b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:49.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.357+0000 7f70b86bd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f70b0142800 con 0x7f70b0144270 2024-09-21T03:23:49.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.357+0000 7f70b86bd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f70b0142680 con 0x7f70b0142270 2024-09-21T03:23:49.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.357+0000 7f70b86bd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f70b0142980 con 0x7f70b00cc6d0 2024-09-21T03:23:49.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.357+0000 7f70b5c58640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70b0144270 0x7f70b00cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:49.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.357+0000 7f70b5c58640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70b0144270 0x7f70b00cc190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:45598/0 (socket says 172.21.15.105:45598) 2024-09-21T03:23:49.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.357+0000 7f70b5c58640 1 -- 172.21.15.105:0/763288384 learned_addr learned my addr 172.21.15.105:0/763288384 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:23:49.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.358+0000 7f70b6c5a640 1 --2- 172.21.15.105:0/763288384 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70b00cc6d0 0x7f70b00b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:49.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.358+0000 7f70b6459640 1 --2- 172.21.15.105:0/763288384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70b0142270 0x7f70b01378a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:49.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.358+0000 7f70b5c58640 1 -- 172.21.15.105:0/763288384 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70b00cc6d0 msgr2=0x7f70b00b3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:49.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.358+0000 7f70b5c58640 1 --2- 172.21.15.105:0/763288384 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70b00cc6d0 0x7f70b00b3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:49.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.358+0000 7f70b5c58640 1 -- 172.21.15.105:0/763288384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70b0142270 msgr2=0x7f70b01378a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:49.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.358+0000 7f70b5c58640 1 --2- 172.21.15.105:0/763288384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70b0142270 0x7f70b01378a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:49.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.358+0000 7f70b5c58640 1 -- 172.21.15.105:0/763288384 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70b00cce50 con 0x7f70b0144270 2024-09-21T03:23:49.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.358+0000 7f70b6459640 1 --2- 172.21.15.105:0/763288384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70b0142270 0x7f70b01378a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:23:49.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.358+0000 7f70b5c58640 1 --2- 172.21.15.105:0/763288384 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70b0144270 0x7f70b00cc190 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f70a000c3c0 tx=0x7f70a000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:49.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.358+0000 7f70a6ffd640 1 -- 172.21.15.105:0/763288384 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a0017070 con 0x7f70b0144270 2024-09-21T03:23:49.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.358+0000 7f70a6ffd640 1 -- 172.21.15.105:0/763288384 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f70a00035f0 con 0x7f70b0144270 2024-09-21T03:23:49.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.358+0000 7f70b86bd640 1 -- 172.21.15.105:0/763288384 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70b01351b0 con 0x7f70b0144270 2024-09-21T03:23:49.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.358+0000 7f70a6ffd640 1 -- 172.21.15.105:0/763288384 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a0003a20 con 0x7f70b0144270 2024-09-21T03:23:49.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.358+0000 7f70b86bd640 1 -- 172.21.15.105:0/763288384 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70b0136d10 con 0x7f70b0144270 2024-09-21T03:23:49.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.359+0000 7f70b86bd640 1 -- 172.21.15.105:0/763288384 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70b00ccba0 con 0x7f70b0144270 2024-09-21T03:23:49.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.360+0000 7f70a6ffd640 1 -- 172.21.15.105:0/763288384 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f70a001a070 con 0x7f70b0144270 2024-09-21T03:23:49.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.360+0000 7f70a6ffd640 1 --2- 172.21.15.105:0/763288384 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7094078bc0 0x7f709407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:49.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.361+0000 7f70a6ffd640 1 -- 172.21.15.105:0/763288384 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5767+0+0 (secure 0 0 0) 0x7f70a0099fe0 con 0x7f70b0144270 2024-09-21T03:23:49.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.361+0000 7f70b6459640 1 --2- 172.21.15.105:0/763288384 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7094078bc0 0x7f709407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:49.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.361+0000 7f70b6459640 1 --2- 172.21.15.105:0/763288384 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7094078bc0 0x7f709407b0d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f70ac034000 tx=0x7f70ac004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:49.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.365+0000 7f70a6ffd640 1 -- 172.21.15.105:0/763288384 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f70a0062470 con 0x7f70b0144270 2024-09-21T03:23:49.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.578+0000 7f70b86bd640 1 -- 172.21.15.105:0/763288384 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f70b00d0640 con 0x7f70b0144270 2024-09-21T03:23:49.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.578+0000 7f70a6ffd640 1 -- 172.21.15.105:0/763288384 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f70a0061d70 con 0x7f70b0144270 2024-09-21T03:23:49.580 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:23:49.580 INFO:teuthology.orchestra.run.smithi105.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-21T03:23:49.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.580+0000 7f70b86bd640 1 -- 172.21.15.105:0/763288384 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7094078bc0 msgr2=0x7f709407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:49.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.580+0000 7f70b86bd640 1 --2- 172.21.15.105:0/763288384 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7094078bc0 0x7f709407b0d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f70ac034000 tx=0x7f70ac004730 comp rx=0 tx=0).stop 2024-09-21T03:23:49.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.580+0000 7f70b86bd640 1 -- 172.21.15.105:0/763288384 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70b0144270 msgr2=0x7f70b00cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:49.583 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.580+0000 7f70b86bd640 1 --2- 172.21.15.105:0/763288384 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70b0144270 0x7f70b00cc190 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f70a000c3c0 tx=0x7f70a000c880 comp rx=0 tx=0).stop 2024-09-21T03:23:49.583 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.580+0000 7f70b86bd640 1 -- 172.21.15.105:0/763288384 shutdown_connections 2024-09-21T03:23:49.583 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.580+0000 7f70b86bd640 1 --2- 172.21.15.105:0/763288384 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7094078bc0 0x7f709407b0d0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:49.583 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.580+0000 7f70b86bd640 1 --2- 172.21.15.105:0/763288384 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70b00cc6d0 0x7f70b00b3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:49.583 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.580+0000 7f70b86bd640 1 --2- 172.21.15.105:0/763288384 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70b0144270 0x7f70b00cc190 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:49.583 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.580+0000 7f70b86bd640 1 --2- 172.21.15.105:0/763288384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70b0142270 0x7f70b01378a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:49.583 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.580+0000 7f70b86bd640 1 -- 172.21.15.105:0/763288384 >> 172.21.15.105:0/763288384 conn(0x7f70b00d15f0 msgr2=0x7f70b00702e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:49.583 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.581+0000 7f70b86bd640 1 -- 172.21.15.105:0/763288384 shutdown_connections 2024-09-21T03:23:49.583 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:49.581+0000 7f70b86bd640 1 -- 172.21.15.105:0/763288384 wait complete. 2024-09-21T03:23:49.593 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-21T03:23:49.593 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-21T03:23:50.822 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:23:52.823 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:23:54.594 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T03:23:54.720 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.718+0000 7f2dc6539640 1 -- 172.21.15.105:0/3207934896 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2da8005350 msgr2=0x7f2da800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:54.720 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.718+0000 7f2dc6539640 1 --2- 172.21.15.105:0/3207934896 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2da8005350 0x7f2da800b9c0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f2dc00cd410 tx=0x7f2da8005830 comp rx=0 tx=0).stop 2024-09-21T03:23:54.720 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.718+0000 7f2dc6539640 1 -- 172.21.15.105:0/3207934896 shutdown_connections 2024-09-21T03:23:54.720 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.718+0000 7f2dc6539640 1 --2- 172.21.15.105:0/3207934896 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2da8005350 0x7f2da800b9c0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:54.720 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.718+0000 7f2dc6539640 1 -- 172.21.15.105:0/3207934896 >> 172.21.15.105:0/3207934896 conn(0x7f2dc00b1cb0 msgr2=0x7f2dc00b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:54.720 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.718+0000 7f2dc6539640 1 -- 172.21.15.105:0/3207934896 shutdown_connections 2024-09-21T03:23:54.720 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.718+0000 7f2dc6539640 1 -- 172.21.15.105:0/3207934896 wait complete. 2024-09-21T03:23:54.721 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.719+0000 7f2dc6539640 1 Processor -- start 2024-09-21T03:23:54.721 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.720+0000 7f2dc6539640 1 -- start start 2024-09-21T03:23:54.724 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.721+0000 7f2dc6539640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2da8005350 0x7f2dc00ce400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:54.724 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.721+0000 7f2dc6539640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2dc0155fc0 0x7f2dc0155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:54.724 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.721+0000 7f2dc6539640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2dc00b4390 0x7f2dc00b47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:54.724 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.721+0000 7f2dc6539640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc0074a80 con 0x7f2da8005350 2024-09-21T03:23:54.724 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.721+0000 7f2dc6539640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc0074900 con 0x7f2dc00b4390 2024-09-21T03:23:54.724 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.721+0000 7f2dc6539640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2dc0074c00 con 0x7f2dc0155fc0 2024-09-21T03:23:54.724 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.721+0000 7f2dbffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2da8005350 0x7f2dc00ce400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:54.724 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.721+0000 7f2dbffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2da8005350 0x7f2dc00ce400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:47046/0 (socket says 172.21.15.105:47046) 2024-09-21T03:23:54.724 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.721+0000 7f2dbffff640 1 -- 172.21.15.105:0/2971114830 learned_addr learned my addr 172.21.15.105:0/2971114830 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:23:54.724 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.721+0000 7f2dbf7fe640 1 --2- 172.21.15.105:0/2971114830 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2dc0155fc0 0x7f2dc0155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:54.724 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.721+0000 7f2dc4ad6640 1 --2- 172.21.15.105:0/2971114830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2dc00b4390 0x7f2dc00b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:54.724 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.721+0000 7f2dbffff640 1 -- 172.21.15.105:0/2971114830 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2dc0155fc0 msgr2=0x7f2dc0155140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:54.724 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.721+0000 7f2dbffff640 1 --2- 172.21.15.105:0/2971114830 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2dc0155fc0 0x7f2dc0155140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:54.725 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.721+0000 7f2dbffff640 1 -- 172.21.15.105:0/2971114830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2dc00b4390 msgr2=0x7f2dc00b47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:54.725 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.721+0000 7f2dbffff640 1 --2- 172.21.15.105:0/2971114830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2dc00b4390 0x7f2dc00b47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:54.725 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.721+0000 7f2dbffff640 1 -- 172.21.15.105:0/2971114830 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dc00b4ce0 con 0x7f2da8005350 2024-09-21T03:23:54.725 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.721+0000 7f2dc4ad6640 1 --2- 172.21.15.105:0/2971114830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2dc00b4390 0x7f2dc00b47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:23:54.725 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.722+0000 7f2dbffff640 1 --2- 172.21.15.105:0/2971114830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2da8005350 0x7f2dc00ce400 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f2db0006600 tx=0x7f2db00039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:54.725 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.722+0000 7f2dbcff9640 1 -- 172.21.15.105:0/2971114830 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db0015070 con 0x7f2da8005350 2024-09-21T03:23:54.725 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.722+0000 7f2dbcff9640 1 -- 172.21.15.105:0/2971114830 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2db0011900 con 0x7f2da8005350 2024-09-21T03:23:54.725 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.722+0000 7f2dc6539640 1 -- 172.21.15.105:0/2971114830 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dc009d880 con 0x7f2da8005350 2024-09-21T03:23:54.725 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.722+0000 7f2dbcff9640 1 -- 172.21.15.105:0/2971114830 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db0011d50 con 0x7f2da8005350 2024-09-21T03:23:54.725 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.722+0000 7f2dc6539640 1 -- 172.21.15.105:0/2971114830 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dc009d5a0 con 0x7f2da8005350 2024-09-21T03:23:54.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.723+0000 7f2dc6539640 1 -- 172.21.15.105:0/2971114830 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dc00c3860 con 0x7f2da8005350 2024-09-21T03:23:54.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.724+0000 7f2dbcff9640 1 -- 172.21.15.105:0/2971114830 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2db0018070 con 0x7f2da8005350 2024-09-21T03:23:54.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.724+0000 7f2dbcff9640 1 --2- 172.21.15.105:0/2971114830 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2dac078b90 0x7f2dac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:23:54.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.724+0000 7f2dbcff9640 1 -- 172.21.15.105:0/2971114830 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5767+0+0 (secure 0 0 0) 0x7f2db009bb10 con 0x7f2da8005350 2024-09-21T03:23:54.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.724+0000 7f2dbf7fe640 1 --2- 172.21.15.105:0/2971114830 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2dac078b90 0x7f2dac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:23:54.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.725+0000 7f2dbf7fe640 1 --2- 172.21.15.105:0/2971114830 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2dac078b90 0x7f2dac07b0a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2dc009c770 tx=0x7f2db400b260 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:23:54.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.729+0000 7f2dbcff9640 1 -- 172.21.15.105:0/2971114830 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2dc00b4ce0 con 0x7f2da8005350 2024-09-21T03:23:54.825 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:23:54.944 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.943+0000 7f2dc6539640 1 -- 172.21.15.105:0/2971114830 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2dc01e6e10 con 0x7f2da8005350 2024-09-21T03:23:54.945 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.943+0000 7f2dbcff9640 1 -- 172.21.15.105:0/2971114830 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f2db0063960 con 0x7f2da8005350 2024-09-21T03:23:54.945 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:23:54.945 INFO:teuthology.orchestra.run.smithi105.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-21T03:23:54.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.945+0000 7f2dc6539640 1 -- 172.21.15.105:0/2971114830 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2dac078b90 msgr2=0x7f2dac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:54.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.945+0000 7f2dc6539640 1 --2- 172.21.15.105:0/2971114830 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2dac078b90 0x7f2dac07b0a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2dc009c770 tx=0x7f2db400b260 comp rx=0 tx=0).stop 2024-09-21T03:23:54.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.945+0000 7f2dc6539640 1 -- 172.21.15.105:0/2971114830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2da8005350 msgr2=0x7f2dc00ce400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:23:54.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.945+0000 7f2dc6539640 1 --2- 172.21.15.105:0/2971114830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2da8005350 0x7f2dc00ce400 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f2db0006600 tx=0x7f2db00039c0 comp rx=0 tx=0).stop 2024-09-21T03:23:54.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.945+0000 7f2dc6539640 1 -- 172.21.15.105:0/2971114830 shutdown_connections 2024-09-21T03:23:54.948 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.945+0000 7f2dc6539640 1 --2- 172.21.15.105:0/2971114830 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2dac078b90 0x7f2dac07b0a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:54.948 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.945+0000 7f2dc6539640 1 --2- 172.21.15.105:0/2971114830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2dc00b4390 0x7f2dc00b47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:54.948 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.945+0000 7f2dc6539640 1 --2- 172.21.15.105:0/2971114830 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2dc0155fc0 0x7f2dc0155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:54.948 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.945+0000 7f2dc6539640 1 --2- 172.21.15.105:0/2971114830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2da8005350 0x7f2dc00ce400 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:23:54.948 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.945+0000 7f2dc6539640 1 -- 172.21.15.105:0/2971114830 >> 172.21.15.105:0/2971114830 conn(0x7f2dc00b1cb0 msgr2=0x7f2dc00ae2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:23:54.948 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.946+0000 7f2dc6539640 1 -- 172.21.15.105:0/2971114830 shutdown_connections 2024-09-21T03:23:54.948 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:23:54.946+0000 7f2dc6539640 1 -- 172.21.15.105:0/2971114830 wait complete. 2024-09-21T03:23:54.958 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-21T03:23:54.958 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-21T03:23:56.828 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:23:56.985 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:23:56.988 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:23:58.830 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:23:59.959 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T03:24:00.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.081+0000 7f2b9cd20640 1 -- 172.21.15.105:0/3823491889 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b84005350 msgr2=0x7f2b8400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:00.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.081+0000 7f2b9cd20640 1 --2- 172.21.15.105:0/3823491889 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b84005350 0x7f2b8400b9c0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f2b90001d90 tx=0x7f2b84005830 comp rx=0 tx=0).stop 2024-09-21T03:24:00.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.081+0000 7f2b9cd20640 1 -- 172.21.15.105:0/3823491889 shutdown_connections 2024-09-21T03:24:00.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.081+0000 7f2b9cd20640 1 --2- 172.21.15.105:0/3823491889 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b84005350 0x7f2b8400b9c0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:00.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.081+0000 7f2b9cd20640 1 -- 172.21.15.105:0/3823491889 >> 172.21.15.105:0/3823491889 conn(0x7f2b9806d7d0 msgr2=0x7f2b980b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:00.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.081+0000 7f2b9cd20640 1 -- 172.21.15.105:0/3823491889 shutdown_connections 2024-09-21T03:24:00.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.081+0000 7f2b9cd20640 1 -- 172.21.15.105:0/3823491889 wait complete. 2024-09-21T03:24:00.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.083+0000 7f2b9cd20640 1 Processor -- start 2024-09-21T03:24:00.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.083+0000 7f2b9cd20640 1 -- start start 2024-09-21T03:24:00.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.084+0000 7f2b9cd20640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b84005350 0x7f2b981f5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:00.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.084+0000 7f2b9cd20640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b981f6290 0x7f2b980cac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:00.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.084+0000 7f2b9cd20640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b980cb140 0x7f2b9806ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:00.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.084+0000 7f2b9cd20640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2b980b3b40 con 0x7f2b981f6290 2024-09-21T03:24:00.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.084+0000 7f2b9cd20640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2b980b39c0 con 0x7f2b980cb140 2024-09-21T03:24:00.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.084+0000 7f2b9cd20640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2b980b3cc0 con 0x7f2b84005350 2024-09-21T03:24:00.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.085+0000 7f2b8ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b981f6290 0x7f2b980cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:00.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.085+0000 7f2b8ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b981f6290 0x7f2b980cac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:47070/0 (socket says 172.21.15.105:47070) 2024-09-21T03:24:00.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.085+0000 7f2b8ffff640 1 -- 172.21.15.105:0/1354369314 learned_addr learned my addr 172.21.15.105:0/1354369314 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:00.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.085+0000 7f2b96d9d640 1 --2- 172.21.15.105:0/1354369314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b980cb140 0x7f2b9806ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:00.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.085+0000 7f2b9659c640 1 --2- 172.21.15.105:0/1354369314 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b84005350 0x7f2b981f5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:00.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.085+0000 7f2b8ffff640 1 -- 172.21.15.105:0/1354369314 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b84005350 msgr2=0x7f2b981f5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:00.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.085+0000 7f2b8ffff640 1 --2- 172.21.15.105:0/1354369314 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b84005350 0x7f2b981f5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:00.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.085+0000 7f2b8ffff640 1 -- 172.21.15.105:0/1354369314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b980cb140 msgr2=0x7f2b9806ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:00.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.085+0000 7f2b8ffff640 1 --2- 172.21.15.105:0/1354369314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b980cb140 0x7f2b9806ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:00.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.085+0000 7f2b8ffff640 1 -- 172.21.15.105:0/1354369314 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b98156980 con 0x7f2b981f6290 2024-09-21T03:24:00.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.085+0000 7f2b8ffff640 1 --2- 172.21.15.105:0/1354369314 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b981f6290 0x7f2b980cac00 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f2b800118d0 tx=0x7f2b80011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:00.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.085+0000 7f2b8effd640 1 -- 172.21.15.105:0/1354369314 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8001e070 con 0x7f2b981f6290 2024-09-21T03:24:00.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.085+0000 7f2b9cd20640 1 -- 172.21.15.105:0/1354369314 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b98156c60 con 0x7f2b981f6290 2024-09-21T03:24:00.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.085+0000 7f2b8effd640 1 -- 172.21.15.105:0/1354369314 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b8000fbb0 con 0x7f2b981f6290 2024-09-21T03:24:00.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.085+0000 7f2b8effd640 1 -- 172.21.15.105:0/1354369314 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b80019410 con 0x7f2b981f6290 2024-09-21T03:24:00.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.085+0000 7f2b9cd20640 1 -- 172.21.15.105:0/1354369314 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b98157220 con 0x7f2b981f6290 2024-09-21T03:24:00.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.087+0000 7f2b9cd20640 1 -- 172.21.15.105:0/1354369314 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b98072ff0 con 0x7f2b981f6290 2024-09-21T03:24:00.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.087+0000 7f2b8effd640 1 -- 172.21.15.105:0/1354369314 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2b80021070 con 0x7f2b981f6290 2024-09-21T03:24:00.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.088+0000 7f2b8effd640 1 --2- 172.21.15.105:0/1354369314 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2b78078b90 0x7f2b7807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:00.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.088+0000 7f2b8effd640 1 -- 172.21.15.105:0/1354369314 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5767+0+0 (secure 0 0 0) 0x7f2b8009b540 con 0x7f2b981f6290 2024-09-21T03:24:00.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.088+0000 7f2b9659c640 1 --2- 172.21.15.105:0/1354369314 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2b78078b90 0x7f2b7807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:00.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.088+0000 7f2b9659c640 1 --2- 172.21.15.105:0/1354369314 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2b78078b90 0x7f2b7807b0a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2b88000fb0 tx=0x7f2b88006040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:00.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.092+0000 7f2b8effd640 1 -- 172.21.15.105:0/1354369314 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2b80063330 con 0x7f2b981f6290 2024-09-21T03:24:00.308 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.307+0000 7f2b9cd20640 1 -- 172.21.15.105:0/1354369314 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2b98074090 con 0x7f2b981f6290 2024-09-21T03:24:00.309 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.307+0000 7f2b8effd640 1 -- 172.21.15.105:0/1354369314 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f2b80067d60 con 0x7f2b981f6290 2024-09-21T03:24:00.309 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:24:00.309 INFO:teuthology.orchestra.run.smithi105.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-21T03:24:00.311 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.309+0000 7f2b9cd20640 1 -- 172.21.15.105:0/1354369314 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2b78078b90 msgr2=0x7f2b7807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:00.311 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.309+0000 7f2b9cd20640 1 --2- 172.21.15.105:0/1354369314 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2b78078b90 0x7f2b7807b0a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2b88000fb0 tx=0x7f2b88006040 comp rx=0 tx=0).stop 2024-09-21T03:24:00.311 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.309+0000 7f2b9cd20640 1 -- 172.21.15.105:0/1354369314 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b981f6290 msgr2=0x7f2b980cac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:00.311 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.309+0000 7f2b9cd20640 1 --2- 172.21.15.105:0/1354369314 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b981f6290 0x7f2b980cac00 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f2b800118d0 tx=0x7f2b80011d90 comp rx=0 tx=0).stop 2024-09-21T03:24:00.311 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.309+0000 7f2b9cd20640 1 -- 172.21.15.105:0/1354369314 shutdown_connections 2024-09-21T03:24:00.311 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.309+0000 7f2b9cd20640 1 --2- 172.21.15.105:0/1354369314 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2b78078b90 0x7f2b7807b0a0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:00.311 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.309+0000 7f2b9cd20640 1 --2- 172.21.15.105:0/1354369314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b980cb140 0x7f2b9806ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:00.312 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.309+0000 7f2b9cd20640 1 --2- 172.21.15.105:0/1354369314 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b981f6290 0x7f2b980cac00 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:00.312 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.309+0000 7f2b9cd20640 1 --2- 172.21.15.105:0/1354369314 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b84005350 0x7f2b981f5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:00.312 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.309+0000 7f2b9cd20640 1 -- 172.21.15.105:0/1354369314 >> 172.21.15.105:0/1354369314 conn(0x7f2b9806d7d0 msgr2=0x7f2b980745b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:00.312 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.309+0000 7f2b9cd20640 1 -- 172.21.15.105:0/1354369314 shutdown_connections 2024-09-21T03:24:00.312 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:00.309+0000 7f2b9cd20640 1 -- 172.21.15.105:0/1354369314 wait complete. 2024-09-21T03:24:00.322 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-21T03:24:00.322 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-21T03:24:00.832 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:24:02.834 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:24:04.836 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:24:05.323 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T03:24:05.449 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.446+0000 7ffa2b1cc640 1 -- 172.21.15.105:0/2175767165 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa240caee0 msgr2=0x7ffa2406ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:05.449 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.446+0000 7ffa2b1cc640 1 --2- 172.21.15.105:0/2175767165 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa240caee0 0x7ffa2406ee90 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7ffa24072c00 tx=0x7ffa1c02a8b0 comp rx=0 tx=0).stop 2024-09-21T03:24:05.449 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.446+0000 7ffa2b1cc640 1 -- 172.21.15.105:0/2175767165 shutdown_connections 2024-09-21T03:24:05.449 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.446+0000 7ffa2b1cc640 1 --2- 172.21.15.105:0/2175767165 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa240caee0 0x7ffa2406ee90 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:05.449 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.446+0000 7ffa2b1cc640 1 --2- 172.21.15.105:0/2175767165 >> v2:172.21.15.162:3300/0 conn(0x7ffa2415bf20 0x7ffa240ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:05.449 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.446+0000 7ffa2b1cc640 1 -- 172.21.15.105:0/2175767165 >> 172.21.15.105:0/2175767165 conn(0x7ffa240b1cb0 msgr2=0x7ffa240b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:05.449 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.446+0000 7ffa2b1cc640 1 -- 172.21.15.105:0/2175767165 shutdown_connections 2024-09-21T03:24:05.449 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.446+0000 7ffa2b1cc640 1 -- 172.21.15.105:0/2175767165 wait complete. 2024-09-21T03:24:05.450 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.448+0000 7ffa2b1cc640 1 Processor -- start 2024-09-21T03:24:05.450 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.448+0000 7ffa2b1cc640 1 -- start start 2024-09-21T03:24:05.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.449+0000 7ffa2b1cc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa240caee0 0x7ffa240c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:05.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.449+0000 7ffa2b1cc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa240cfb00 0x7ffa2415def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:05.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.449+0000 7ffa2b1cc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa2415bf20 0x7ffa2415f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:05.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.449+0000 7ffa2b1cc640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ffa2406f3d0 con 0x7ffa240cfb00 2024-09-21T03:24:05.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.449+0000 7ffa2b1cc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ffa2415c3e0 con 0x7ffa2415bf20 2024-09-21T03:24:05.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.449+0000 7ffa2b1cc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ffa2406f550 con 0x7ffa240caee0 2024-09-21T03:24:05.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.449+0000 7ffa23fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa240cfb00 0x7ffa2415def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:05.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.449+0000 7ffa23fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa240cfb00 0x7ffa2415def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:36230/0 (socket says 172.21.15.105:36230) 2024-09-21T03:24:05.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.449+0000 7ffa23fff640 1 -- 172.21.15.105:0/2619905097 learned_addr learned my addr 172.21.15.105:0/2619905097 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:05.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.450+0000 7ffa28f68640 1 --2- 172.21.15.105:0/2619905097 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa240caee0 0x7ffa240c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:05.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.450+0000 7ffa29769640 1 --2- 172.21.15.105:0/2619905097 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa2415bf20 0x7ffa2415f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:05.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.450+0000 7ffa23fff640 1 -- 172.21.15.105:0/2619905097 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa240caee0 msgr2=0x7ffa240c6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:05.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.450+0000 7ffa23fff640 1 --2- 172.21.15.105:0/2619905097 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa240caee0 0x7ffa240c6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:05.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.450+0000 7ffa23fff640 1 -- 172.21.15.105:0/2619905097 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa2415bf20 msgr2=0x7ffa2415f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:05.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.450+0000 7ffa23fff640 1 --2- 172.21.15.105:0/2619905097 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa2415bf20 0x7ffa2415f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:05.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.450+0000 7ffa23fff640 1 -- 172.21.15.105:0/2619905097 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa240c50f0 con 0x7ffa240cfb00 2024-09-21T03:24:05.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.450+0000 7ffa23fff640 1 --2- 172.21.15.105:0/2619905097 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa240cfb00 0x7ffa2415def0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7ffa1000d6a0 tx=0x7ffa1000db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:05.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.450+0000 7ffa217fa640 1 -- 172.21.15.105:0/2619905097 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa10017070 con 0x7ffa240cfb00 2024-09-21T03:24:05.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.450+0000 7ffa217fa640 1 -- 172.21.15.105:0/2619905097 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa10004310 con 0x7ffa240cfb00 2024-09-21T03:24:05.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.450+0000 7ffa2b1cc640 1 -- 172.21.15.105:0/2619905097 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa241f6620 con 0x7ffa240cfb00 2024-09-21T03:24:05.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.450+0000 7ffa217fa640 1 -- 172.21.15.105:0/2619905097 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa10009a80 con 0x7ffa240cfb00 2024-09-21T03:24:05.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.450+0000 7ffa2b1cc640 1 -- 172.21.15.105:0/2619905097 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa241f6be0 con 0x7ffa240cfb00 2024-09-21T03:24:05.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.451+0000 7ffa2b1cc640 1 -- 172.21.15.105:0/2619905097 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa241f6390 con 0x7ffa240cfb00 2024-09-21T03:24:05.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.452+0000 7ffa217fa640 1 -- 172.21.15.105:0/2619905097 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ffa10009c20 con 0x7ffa240cfb00 2024-09-21T03:24:05.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.453+0000 7ffa217fa640 1 --2- 172.21.15.105:0/2619905097 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ffa08078b90 0x7ffa0807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:05.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.453+0000 7ffa217fa640 1 -- 172.21.15.105:0/2619905097 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5767+0+0 (secure 0 0 0) 0x7ffa1009ad80 con 0x7ffa240cfb00 2024-09-21T03:24:05.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.453+0000 7ffa28f68640 1 --2- 172.21.15.105:0/2619905097 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ffa08078b90 0x7ffa0807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:05.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.453+0000 7ffa28f68640 1 --2- 172.21.15.105:0/2619905097 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ffa08078b90 0x7ffa0807b0a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ffa18007fd0 tx=0x7ffa18009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:05.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.458+0000 7ffa217fa640 1 -- 172.21.15.105:0/2619905097 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ffa10063210 con 0x7ffa240cfb00 2024-09-21T03:24:05.674 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.672+0000 7ffa2b1cc640 1 -- 172.21.15.105:0/2619905097 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ffa241f6e20 con 0x7ffa240cfb00 2024-09-21T03:24:05.675 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.672+0000 7ffa217fa640 1 -- 172.21.15.105:0/2619905097 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7ffa241f6e20 con 0x7ffa240cfb00 2024-09-21T03:24:05.675 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:24:05.675 INFO:teuthology.orchestra.run.smithi105.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-21T03:24:05.677 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.674+0000 7ffa2b1cc640 1 -- 172.21.15.105:0/2619905097 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ffa08078b90 msgr2=0x7ffa0807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:05.677 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.674+0000 7ffa2b1cc640 1 --2- 172.21.15.105:0/2619905097 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ffa08078b90 0x7ffa0807b0a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ffa18007fd0 tx=0x7ffa18009040 comp rx=0 tx=0).stop 2024-09-21T03:24:05.678 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.674+0000 7ffa2b1cc640 1 -- 172.21.15.105:0/2619905097 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa240cfb00 msgr2=0x7ffa2415def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:05.678 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.674+0000 7ffa2b1cc640 1 --2- 172.21.15.105:0/2619905097 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa240cfb00 0x7ffa2415def0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7ffa1000d6a0 tx=0x7ffa1000db60 comp rx=0 tx=0).stop 2024-09-21T03:24:05.678 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.675+0000 7ffa2b1cc640 1 -- 172.21.15.105:0/2619905097 shutdown_connections 2024-09-21T03:24:05.678 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.675+0000 7ffa2b1cc640 1 --2- 172.21.15.105:0/2619905097 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ffa08078b90 0x7ffa0807b0a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:05.678 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.675+0000 7ffa2b1cc640 1 --2- 172.21.15.105:0/2619905097 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa2415bf20 0x7ffa2415f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:05.678 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.675+0000 7ffa2b1cc640 1 --2- 172.21.15.105:0/2619905097 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa240cfb00 0x7ffa2415def0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:05.678 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.675+0000 7ffa2b1cc640 1 --2- 172.21.15.105:0/2619905097 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa240caee0 0x7ffa240c6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:05.678 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.675+0000 7ffa2b1cc640 1 -- 172.21.15.105:0/2619905097 >> 172.21.15.105:0/2619905097 conn(0x7ffa240b1cb0 msgr2=0x7ffa24072e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:05.678 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.675+0000 7ffa2b1cc640 1 -- 172.21.15.105:0/2619905097 shutdown_connections 2024-09-21T03:24:05.678 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:05.675+0000 7ffa2b1cc640 1 -- 172.21.15.105:0/2619905097 wait complete. 2024-09-21T03:24:05.688 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-21T03:24:05.688 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-21T03:24:06.838 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:24:08.840 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:24:10.689 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T03:24:10.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:10.811+0000 7fe47aca2640 1 -- 172.21.15.105:0/1185933710 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4740ca800 msgr2=0x7fe4740cba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:10.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:10.811+0000 7fe47aca2640 1 --2- 172.21.15.105:0/1185933710 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4740ca800 0x7fe4740cba00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe468009830 tx=0x7fe46802a510 comp rx=0 tx=0).stop 2024-09-21T03:24:10.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:10.811+0000 7fe47aca2640 1 -- 172.21.15.105:0/1185933710 shutdown_connections 2024-09-21T03:24:10.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:10.811+0000 7fe47aca2640 1 --2- 172.21.15.105:0/1185933710 >> v2:172.21.15.162:3300/0 conn(0x7fe4740cad30 0x7fe47406ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:10.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:10.811+0000 7fe47aca2640 1 --2- 172.21.15.105:0/1185933710 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4740ca800 0x7fe4740cba00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:10.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:10.811+0000 7fe47aca2640 1 -- 172.21.15.105:0/1185933710 >> 172.21.15.105:0/1185933710 conn(0x7fe4740b1cb0 msgr2=0x7fe4740b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:10.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:10.811+0000 7fe47aca2640 1 -- 172.21.15.105:0/1185933710 shutdown_connections 2024-09-21T03:24:10.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:10.811+0000 7fe47aca2640 1 -- 172.21.15.105:0/1185933710 wait complete. 2024-09-21T03:24:10.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:10.813+0000 7fe47aca2640 1 Processor -- start 2024-09-21T03:24:10.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:10.813+0000 7fe47aca2640 1 -- start start 2024-09-21T03:24:10.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:10.814+0000 7fe47aca2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4740704e0 0x7fe4741525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:10.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:10.814+0000 7fe47aca2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4740ca800 0x7fe47415bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:10.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:10.814+0000 7fe47aca2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4740cad30 0x7fe4740c5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:10.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:10.814+0000 7fe47aca2640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe4740ccf40 con 0x7fe4740cad30 2024-09-21T03:24:10.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:10.814+0000 7fe47aca2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe4740747d0 con 0x7fe4740704e0 2024-09-21T03:24:10.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:10.814+0000 7fe47aca2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe4740cd0c0 con 0x7fe4740ca800 2024-09-21T03:24:10.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:10.814+0000 7fe47923f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4740cad30 0x7fe4740c5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:10.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:10.814+0000 7fe47923f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4740cad30 0x7fe4740c5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:36238/0 (socket says 172.21.15.105:36238) 2024-09-21T03:24:10.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:10.814+0000 7fe47923f640 1 -- 172.21.15.105:0/1529913020 learned_addr learned my addr 172.21.15.105:0/1529913020 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:10.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:10.815+0000 7fe478a3e640 1 --2- 172.21.15.105:0/1529913020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4740704e0 0x7fe4741525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:10.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:10.815+0000 7fe473fff640 1 --2- 172.21.15.105:0/1529913020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4740ca800 0x7fe47415bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:10.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:10.815+0000 7fe47923f640 1 -- 172.21.15.105:0/1529913020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4740ca800 msgr2=0x7fe47415bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:10.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:10.815+0000 7fe47923f640 1 --2- 172.21.15.105:0/1529913020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4740ca800 0x7fe47415bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:10.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:10.815+0000 7fe47923f640 1 -- 172.21.15.105:0/1529913020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4740704e0 msgr2=0x7fe4741525c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:10.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:10.815+0000 7fe47923f640 1 --2- 172.21.15.105:0/1529913020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4740704e0 0x7fe4741525c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:10.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:10.815+0000 7fe47923f640 1 -- 172.21.15.105:0/1529913020 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe47415c850 con 0x7fe4740cad30 2024-09-21T03:24:10.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:10.815+0000 7fe478a3e640 1 --2- 172.21.15.105:0/1529913020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4740704e0 0x7fe4741525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:24:10.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:10.815+0000 7fe47923f640 1 --2- 172.21.15.105:0/1529913020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4740cad30 0x7fe4740c5e00 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fe46c00ed50 tx=0x7fe46c00c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:10.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:10.815+0000 7fe4717fa640 1 -- 172.21.15.105:0/1529913020 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46c011670 con 0x7fe4740cad30 2024-09-21T03:24:10.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:10.815+0000 7fe4717fa640 1 -- 172.21.15.105:0/1529913020 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe46c011900 con 0x7fe4740cad30 2024-09-21T03:24:10.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:10.815+0000 7fe47aca2640 1 -- 172.21.15.105:0/1529913020 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe47415cb30 con 0x7fe4740cad30 2024-09-21T03:24:10.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:10.815+0000 7fe4717fa640 1 -- 172.21.15.105:0/1529913020 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46c011d30 con 0x7fe4740cad30 2024-09-21T03:24:10.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:10.815+0000 7fe47aca2640 1 -- 172.21.15.105:0/1529913020 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4740c7320 con 0x7fe4740cad30 2024-09-21T03:24:10.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:10.816+0000 7fe47aca2640 1 -- 172.21.15.105:0/1529913020 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe47415d050 con 0x7fe4740cad30 2024-09-21T03:24:10.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:10.817+0000 7fe4717fa640 1 -- 172.21.15.105:0/1529913020 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe46c01a400 con 0x7fe4740cad30 2024-09-21T03:24:10.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:10.818+0000 7fe4717fa640 1 --2- 172.21.15.105:0/1529913020 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe458078b90 0x7fe45807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:10.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:10.818+0000 7fe4717fa640 1 -- 172.21.15.105:0/1529913020 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5767+0+0 (secure 0 0 0) 0x7fe46c09db90 con 0x7fe4740cad30 2024-09-21T03:24:10.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:10.818+0000 7fe478a3e640 1 --2- 172.21.15.105:0/1529913020 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe458078b90 0x7fe45807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:10.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:10.818+0000 7fe478a3e640 1 --2- 172.21.15.105:0/1529913020 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe458078b90 0x7fe45807b0a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe468034000 tx=0x7fe468004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:10.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:10.822+0000 7fe4717fa640 1 -- 172.21.15.105:0/1529913020 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe46c016030 con 0x7fe4740cad30 2024-09-21T03:24:10.842 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:24:11.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:11.037+0000 7fe47aca2640 1 -- 172.21.15.105:0/1529913020 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe4740cd650 con 0x7fe4740cad30 2024-09-21T03:24:11.040 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:11.037+0000 7fe4717fa640 1 -- 172.21.15.105:0/1529913020 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7fe4740708f0 con 0x7fe4740cad30 2024-09-21T03:24:11.040 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:24:11.040 INFO:teuthology.orchestra.run.smithi105.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-21T03:24:11.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:11.039+0000 7fe47aca2640 1 -- 172.21.15.105:0/1529913020 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe458078b90 msgr2=0x7fe45807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:11.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:11.039+0000 7fe47aca2640 1 --2- 172.21.15.105:0/1529913020 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe458078b90 0x7fe45807b0a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe468034000 tx=0x7fe468004730 comp rx=0 tx=0).stop 2024-09-21T03:24:11.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:11.039+0000 7fe47aca2640 1 -- 172.21.15.105:0/1529913020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4740cad30 msgr2=0x7fe4740c5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:11.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:11.039+0000 7fe47aca2640 1 --2- 172.21.15.105:0/1529913020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4740cad30 0x7fe4740c5e00 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fe46c00ed50 tx=0x7fe46c00c640 comp rx=0 tx=0).stop 2024-09-21T03:24:11.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:11.039+0000 7fe47aca2640 1 -- 172.21.15.105:0/1529913020 shutdown_connections 2024-09-21T03:24:11.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:11.039+0000 7fe47aca2640 1 --2- 172.21.15.105:0/1529913020 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe458078b90 0x7fe45807b0a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:11.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:11.039+0000 7fe47aca2640 1 --2- 172.21.15.105:0/1529913020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4740cad30 0x7fe4740c5e00 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:11.043 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:11.039+0000 7fe47aca2640 1 --2- 172.21.15.105:0/1529913020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4740ca800 0x7fe47415bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:11.043 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:11.039+0000 7fe47aca2640 1 --2- 172.21.15.105:0/1529913020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4740704e0 0x7fe4741525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:11.043 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:11.039+0000 7fe47aca2640 1 -- 172.21.15.105:0/1529913020 >> 172.21.15.105:0/1529913020 conn(0x7fe4740b1cb0 msgr2=0x7fe474073cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:11.043 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:11.039+0000 7fe47aca2640 1 -- 172.21.15.105:0/1529913020 shutdown_connections 2024-09-21T03:24:11.043 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:11.039+0000 7fe47aca2640 1 -- 172.21.15.105:0/1529913020 wait complete. 2024-09-21T03:24:11.053 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-21T03:24:11.054 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-21T03:24:12.844 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:24:14.846 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:24:16.055 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T03:24:16.180 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.178+0000 7ff34fb71640 1 -- 172.21.15.105:0/1410887082 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3480706b0 msgr2=0x7ff3480cba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:16.180 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.178+0000 7ff34fb71640 1 --2- 172.21.15.105:0/1410887082 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3480706b0 0x7ff3480cba00 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7ff348070dc0 tx=0x7ff33802a530 comp rx=0 tx=0).stop 2024-09-21T03:24:16.180 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.178+0000 7ff34fb71640 1 -- 172.21.15.105:0/1410887082 shutdown_connections 2024-09-21T03:24:16.180 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.178+0000 7ff34fb71640 1 --2- 172.21.15.105:0/1410887082 >> v2:172.21.15.162:3300/0 conn(0x7ff3480cad30 0x7ff3480735b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:16.180 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.178+0000 7ff34fb71640 1 --2- 172.21.15.105:0/1410887082 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3480706b0 0x7ff3480cba00 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:16.180 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.178+0000 7ff34fb71640 1 -- 172.21.15.105:0/1410887082 >> 172.21.15.105:0/1410887082 conn(0x7ff3480b1cb0 msgr2=0x7ff3480b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:16.180 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.178+0000 7ff34fb71640 1 -- 172.21.15.105:0/1410887082 shutdown_connections 2024-09-21T03:24:16.180 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.178+0000 7ff34fb71640 1 -- 172.21.15.105:0/1410887082 wait complete. 2024-09-21T03:24:16.181 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.180+0000 7ff34fb71640 1 Processor -- start 2024-09-21T03:24:16.181 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.180+0000 7ff34fb71640 1 -- start start 2024-09-21T03:24:16.184 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.181+0000 7ff34fb71640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3480ca800 0x7ff3481e74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:16.184 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.181+0000 7ff34fb71640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3480cad30 0x7ff34814d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:16.184 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.181+0000 7ff34fb71640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff348158420 0x7ff3481f4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:16.184 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.181+0000 7ff34fb71640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff348073ec0 con 0x7ff3480ca800 2024-09-21T03:24:16.184 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.181+0000 7ff34fb71640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff348073d40 con 0x7ff348158420 2024-09-21T03:24:16.184 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.181+0000 7ff34fb71640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff348074040 con 0x7ff3480cad30 2024-09-21T03:24:16.184 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.181+0000 7ff34d90d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3480ca800 0x7ff3481e74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:16.184 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.181+0000 7ff34d90d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3480ca800 0x7ff3481e74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51366/0 (socket says 172.21.15.105:51366) 2024-09-21T03:24:16.184 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.181+0000 7ff34d90d640 1 -- 172.21.15.105:0/4098696526 learned_addr learned my addr 172.21.15.105:0/4098696526 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:16.184 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.181+0000 7ff34d90d640 1 -- 172.21.15.105:0/4098696526 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3480cad30 msgr2=0x7ff34814d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:16.184 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.181+0000 7ff34d90d640 1 --2- 172.21.15.105:0/4098696526 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3480cad30 0x7ff34814d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:16.184 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.181+0000 7ff34d90d640 1 -- 172.21.15.105:0/4098696526 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff348158420 msgr2=0x7ff3481f4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:16.185 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.181+0000 7ff34d90d640 1 --2- 172.21.15.105:0/4098696526 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff348158420 0x7ff3481f4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:16.185 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.181+0000 7ff34d90d640 1 -- 172.21.15.105:0/4098696526 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3481f7730 con 0x7ff3480ca800 2024-09-21T03:24:16.185 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.181+0000 7ff34d90d640 1 --2- 172.21.15.105:0/4098696526 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3480ca800 0x7ff3481e74f0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7ff34400cb40 tx=0x7ff34400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:16.185 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.182+0000 7ff33e7fc640 1 -- 172.21.15.105:0/4098696526 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff344016020 con 0x7ff3480ca800 2024-09-21T03:24:16.185 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.182+0000 7ff33e7fc640 1 -- 172.21.15.105:0/4098696526 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff34400ad90 con 0x7ff3480ca800 2024-09-21T03:24:16.185 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.182+0000 7ff34fb71640 1 -- 172.21.15.105:0/4098696526 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3481e6730 con 0x7ff3480ca800 2024-09-21T03:24:16.185 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.182+0000 7ff33e7fc640 1 -- 172.21.15.105:0/4098696526 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff344012680 con 0x7ff3480ca800 2024-09-21T03:24:16.185 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.182+0000 7ff34fb71640 1 -- 172.21.15.105:0/4098696526 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3481e6cf0 con 0x7ff3480ca800 2024-09-21T03:24:16.186 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.183+0000 7ff34fb71640 1 -- 172.21.15.105:0/4098696526 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3480745d0 con 0x7ff3480ca800 2024-09-21T03:24:16.186 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.183+0000 7ff33e7fc640 1 -- 172.21.15.105:0/4098696526 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff344019020 con 0x7ff3480ca800 2024-09-21T03:24:16.186 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.184+0000 7ff33e7fc640 1 --2- 172.21.15.105:0/4098696526 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff32c078bc0 0x7ff32c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:16.186 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.184+0000 7ff33e7fc640 1 -- 172.21.15.105:0/4098696526 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5767+0+0 (secure 0 0 0) 0x7ff34409b310 con 0x7ff3480ca800 2024-09-21T03:24:16.186 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.184+0000 7ff34d10c640 1 --2- 172.21.15.105:0/4098696526 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff32c078bc0 0x7ff32c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:16.186 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.185+0000 7ff34d10c640 1 --2- 172.21.15.105:0/4098696526 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff32c078bc0 0x7ff32c07b0d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff338034000 tx=0x7ff3380046c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:16.190 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.189+0000 7ff33e7fc640 1 -- 172.21.15.105:0/4098696526 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff344020020 con 0x7ff3480ca800 2024-09-21T03:24:16.404 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.402+0000 7ff34fb71640 1 -- 172.21.15.105:0/4098696526 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff3480c6e70 con 0x7ff3480ca800 2024-09-21T03:24:16.404 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.402+0000 7ff33e7fc640 1 -- 172.21.15.105:0/4098696526 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7ff3440637a0 con 0x7ff3480ca800 2024-09-21T03:24:16.404 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:24:16.404 INFO:teuthology.orchestra.run.smithi105.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-21T03:24:16.406 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.404+0000 7ff34fb71640 1 -- 172.21.15.105:0/4098696526 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff32c078bc0 msgr2=0x7ff32c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:16.406 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.405+0000 7ff34fb71640 1 --2- 172.21.15.105:0/4098696526 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff32c078bc0 0x7ff32c07b0d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff338034000 tx=0x7ff3380046c0 comp rx=0 tx=0).stop 2024-09-21T03:24:16.406 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.405+0000 7ff34fb71640 1 -- 172.21.15.105:0/4098696526 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3480ca800 msgr2=0x7ff3481e74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:16.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.405+0000 7ff34fb71640 1 --2- 172.21.15.105:0/4098696526 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3480ca800 0x7ff3481e74f0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7ff34400cb40 tx=0x7ff34400a060 comp rx=0 tx=0).stop 2024-09-21T03:24:16.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.405+0000 7ff34fb71640 1 -- 172.21.15.105:0/4098696526 shutdown_connections 2024-09-21T03:24:16.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.405+0000 7ff34fb71640 1 --2- 172.21.15.105:0/4098696526 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff32c078bc0 0x7ff32c07b0d0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:16.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.405+0000 7ff34fb71640 1 --2- 172.21.15.105:0/4098696526 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff348158420 0x7ff3481f4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:16.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.405+0000 7ff34fb71640 1 --2- 172.21.15.105:0/4098696526 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff3480cad30 0x7ff34814d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:16.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.405+0000 7ff34fb71640 1 --2- 172.21.15.105:0/4098696526 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3480ca800 0x7ff3481e74f0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:16.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.405+0000 7ff34fb71640 1 -- 172.21.15.105:0/4098696526 >> 172.21.15.105:0/4098696526 conn(0x7ff3480b1cb0 msgr2=0x7ff34815b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:16.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.405+0000 7ff34fb71640 1 -- 172.21.15.105:0/4098696526 shutdown_connections 2024-09-21T03:24:16.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:16.405+0000 7ff34fb71640 1 -- 172.21.15.105:0/4098696526 wait complete. 2024-09-21T03:24:16.417 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-21T03:24:16.417 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-21T03:24:16.848 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:24:18.850 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:24:20.853 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:24:21.418 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T03:24:21.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.542+0000 7fbb82c4a640 1 -- 172.21.15.105:0/1311416340 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb64005350 msgr2=0x7fbb6400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:21.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.542+0000 7fbb82c4a640 1 --2- 172.21.15.105:0/1311416340 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb64005350 0x7fbb6400b9c0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fbb74001dc0 tx=0x7fbb64005830 comp rx=0 tx=0).stop 2024-09-21T03:24:21.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.542+0000 7fbb82c4a640 1 -- 172.21.15.105:0/1311416340 shutdown_connections 2024-09-21T03:24:21.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.542+0000 7fbb82c4a640 1 --2- 172.21.15.105:0/1311416340 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb64005350 0x7fbb6400b9c0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:21.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.542+0000 7fbb82c4a640 1 -- 172.21.15.105:0/1311416340 >> 172.21.15.105:0/1311416340 conn(0x7fbb7c0cd530 msgr2=0x7fbb7c0cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:21.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.542+0000 7fbb82c4a640 1 -- 172.21.15.105:0/1311416340 shutdown_connections 2024-09-21T03:24:21.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.542+0000 7fbb82c4a640 1 -- 172.21.15.105:0/1311416340 wait complete. 2024-09-21T03:24:21.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.544+0000 7fbb82c4a640 1 Processor -- start 2024-09-21T03:24:21.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.544+0000 7fbb82c4a640 1 -- start start 2024-09-21T03:24:21.548 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.545+0000 7fbb82c4a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb64005350 0x7fbb7c15ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:21.548 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.545+0000 7fbb82c4a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb7c0b11e0 0x7fbb7c13d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:21.548 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.545+0000 7fbb82c4a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb7c13e1a0 0x7fbb7c152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:21.548 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.546+0000 7fbb82c4a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbb7c163050 con 0x7fbb7c13e1a0 2024-09-21T03:24:21.548 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.546+0000 7fbb82c4a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbb7c162ed0 con 0x7fbb7c0b11e0 2024-09-21T03:24:21.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.546+0000 7fbb82c4a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbb7c1631d0 con 0x7fbb64005350 2024-09-21T03:24:21.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.546+0000 7fbb811e7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb7c13e1a0 0x7fbb7c152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:21.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.546+0000 7fbb811e7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb7c13e1a0 0x7fbb7c152250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:45840/0 (socket says 172.21.15.105:45840) 2024-09-21T03:24:21.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.546+0000 7fbb811e7640 1 -- 172.21.15.105:0/2828414948 learned_addr learned my addr 172.21.15.105:0/2828414948 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:21.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.546+0000 7fbb73fff640 1 --2- 172.21.15.105:0/2828414948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb7c0b11e0 0x7fbb7c13d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:21.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.546+0000 7fbb809e6640 1 --2- 172.21.15.105:0/2828414948 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb64005350 0x7fbb7c15ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:21.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.546+0000 7fbb811e7640 1 -- 172.21.15.105:0/2828414948 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb64005350 msgr2=0x7fbb7c15ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:21.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.546+0000 7fbb811e7640 1 --2- 172.21.15.105:0/2828414948 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb64005350 0x7fbb7c15ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:21.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.546+0000 7fbb811e7640 1 -- 172.21.15.105:0/2828414948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb7c0b11e0 msgr2=0x7fbb7c13d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:21.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.546+0000 7fbb811e7640 1 --2- 172.21.15.105:0/2828414948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb7c0b11e0 0x7fbb7c13d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:21.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.546+0000 7fbb811e7640 1 -- 172.21.15.105:0/2828414948 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb7c0b0770 con 0x7fbb7c13e1a0 2024-09-21T03:24:21.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.546+0000 7fbb811e7640 1 --2- 172.21.15.105:0/2828414948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb7c13e1a0 0x7fbb7c152250 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fbb74001eb0 tx=0x7fbb74006ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:21.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.546+0000 7fbb717fa640 1 -- 172.21.15.105:0/2828414948 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb74003d80 con 0x7fbb7c13e1a0 2024-09-21T03:24:21.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.546+0000 7fbb717fa640 1 -- 172.21.15.105:0/2828414948 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbb74005b00 con 0x7fbb7c13e1a0 2024-09-21T03:24:21.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.546+0000 7fbb82c4a640 1 -- 172.21.15.105:0/2828414948 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb7c15c9a0 con 0x7fbb7c13e1a0 2024-09-21T03:24:21.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.546+0000 7fbb717fa640 1 -- 172.21.15.105:0/2828414948 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb74005f50 con 0x7fbb7c13e1a0 2024-09-21T03:24:21.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.546+0000 7fbb82c4a640 1 -- 172.21.15.105:0/2828414948 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb7c15cc60 con 0x7fbb7c13e1a0 2024-09-21T03:24:21.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.547+0000 7fbb82c4a640 1 -- 172.21.15.105:0/2828414948 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb7c0c9fa0 con 0x7fbb7c13e1a0 2024-09-21T03:24:21.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.548+0000 7fbb717fa640 1 -- 172.21.15.105:0/2828414948 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbb74005030 con 0x7fbb7c13e1a0 2024-09-21T03:24:21.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.549+0000 7fbb717fa640 1 --2- 172.21.15.105:0/2828414948 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbb68078b90 0x7fbb6807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:21.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.549+0000 7fbb717fa640 1 -- 172.21.15.105:0/2828414948 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5767+0+0 (secure 0 0 0) 0x7fbb740ba8d0 con 0x7fbb7c13e1a0 2024-09-21T03:24:21.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.549+0000 7fbb809e6640 1 --2- 172.21.15.105:0/2828414948 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbb68078b90 0x7fbb6807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:21.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.550+0000 7fbb809e6640 1 --2- 172.21.15.105:0/2828414948 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbb68078b90 0x7fbb6807b0a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fbb78009bd0 tx=0x7fbb78005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:21.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.554+0000 7fbb717fa640 1 -- 172.21.15.105:0/2828414948 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbb740826c0 con 0x7fbb7c13e1a0 2024-09-21T03:24:21.770 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.768+0000 7fbb82c4a640 1 -- 172.21.15.105:0/2828414948 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbb7c0cdbb0 con 0x7fbb7c13e1a0 2024-09-21T03:24:21.770 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.768+0000 7fbb717fa640 1 -- 172.21.15.105:0/2828414948 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7fbb740870f0 con 0x7fbb7c13e1a0 2024-09-21T03:24:21.770 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:24:21.770 INFO:teuthology.orchestra.run.smithi105.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-21T03:24:21.772 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.771+0000 7fbb82c4a640 1 -- 172.21.15.105:0/2828414948 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbb68078b90 msgr2=0x7fbb6807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:21.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.771+0000 7fbb82c4a640 1 --2- 172.21.15.105:0/2828414948 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbb68078b90 0x7fbb6807b0a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fbb78009bd0 tx=0x7fbb78005f90 comp rx=0 tx=0).stop 2024-09-21T03:24:21.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.771+0000 7fbb82c4a640 1 -- 172.21.15.105:0/2828414948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb7c13e1a0 msgr2=0x7fbb7c152250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:21.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.771+0000 7fbb82c4a640 1 --2- 172.21.15.105:0/2828414948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb7c13e1a0 0x7fbb7c152250 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fbb74001eb0 tx=0x7fbb74006ca0 comp rx=0 tx=0).stop 2024-09-21T03:24:21.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.771+0000 7fbb82c4a640 1 -- 172.21.15.105:0/2828414948 shutdown_connections 2024-09-21T03:24:21.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.771+0000 7fbb82c4a640 1 --2- 172.21.15.105:0/2828414948 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbb68078b90 0x7fbb6807b0a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:21.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.771+0000 7fbb82c4a640 1 --2- 172.21.15.105:0/2828414948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb7c13e1a0 0x7fbb7c152250 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:21.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.771+0000 7fbb82c4a640 1 --2- 172.21.15.105:0/2828414948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb7c0b11e0 0x7fbb7c13d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:21.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.771+0000 7fbb82c4a640 1 --2- 172.21.15.105:0/2828414948 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb64005350 0x7fbb7c15ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:21.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.771+0000 7fbb82c4a640 1 -- 172.21.15.105:0/2828414948 >> 172.21.15.105:0/2828414948 conn(0x7fbb7c0cd530 msgr2=0x7fbb7c1539c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:21.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.771+0000 7fbb82c4a640 1 -- 172.21.15.105:0/2828414948 shutdown_connections 2024-09-21T03:24:21.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21.771+0000 7fbb82c4a640 1 -- 172.21.15.105:0/2828414948 wait complete. 2024-09-21T03:24:21.783 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-21T03:24:21.784 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:21 stdin-killer INFO: expiration expected; waiting 5 seconds for command to complete 2024-09-21T03:24:22.854 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:24:22.855 INFO:teuthology.orchestra.run.smithi105.stderr:stdin closed, goodbye! 2024-09-21T03:24:22.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:24:22.875 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T03:24:22.875 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T03:24:22.956 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T03:24:22.999 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T03:24:22.999 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T03:24:22.999 DEBUG:tasks.cephfs.mount:terminating RemoteProcess(client=, args=['stdin-killer', '--', 'python3', '-c', '\nimport fcntl\nimport sys\nimport time\nimport os\n\nfcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK)\n\nn = 400\nabs_path = "/home/ubuntu/cephtest/mnt.0/subdir"\n\nif not os.path.exists(abs_path):\n os.makedirs(abs_path)\n\nhandles = []\nfor i in range(0, n):\n fname = "file_"+str(i)\n path = os.path.join(abs_path, fname)\n handles.append(open(path, \'w\'))\n\nprint("waiting with handles open", file=sys.stderr)\nwhile True:\n print("open_n_background: keeping files open", file=sys.stderr)\n try:\n if os.read(0, 4096) == b"":\n break\n except BlockingIOError:\n pass\n time.sleep(2)\nprint("stdin closed, goodbye!", file=sys.stderr)\n'], check_status=True, hostname='smithi105') 2024-09-21T03:24:22.999 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:24:23.000 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:24:23.017 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:24:23.017 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:24:23.074 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T03:24:23.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.227+0000 7f90b304d640 1 -- 172.21.15.105:0/638932175 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90ac06fec0 msgr2=0x7f90ac0702d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:23.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.227+0000 7f90b304d640 1 --2- 172.21.15.105:0/638932175 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90ac06fec0 0x7f90ac0702d0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f90ac06a1c0 tx=0x7f909c02a5f0 comp rx=0 tx=0).stop 2024-09-21T03:24:23.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.227+0000 7f90b304d640 1 -- 172.21.15.105:0/638932175 shutdown_connections 2024-09-21T03:24:23.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.227+0000 7f90b304d640 1 --2- 172.21.15.105:0/638932175 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90ac06fec0 0x7f90ac0702d0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:23.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.227+0000 7f90b304d640 1 --2- 172.21.15.105:0/638932175 >> v2:172.21.15.162:3300/0 conn(0x7f90ac0b4090 0x7f90ac0b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:23.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.227+0000 7f90b304d640 1 -- 172.21.15.105:0/638932175 >> 172.21.15.105:0/638932175 conn(0x7f90ac0cdcc0 msgr2=0x7f90ac0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:23.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.227+0000 7f90b304d640 1 -- 172.21.15.105:0/638932175 shutdown_connections 2024-09-21T03:24:23.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.227+0000 7f90b304d640 1 -- 172.21.15.105:0/638932175 wait complete. 2024-09-21T03:24:23.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.229+0000 7f90b304d640 1 Processor -- start 2024-09-21T03:24:23.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.229+0000 7f90b304d640 1 -- start start 2024-09-21T03:24:23.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.231+0000 7f90b304d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90ac06fec0 0x7f90ac0c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:23.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.231+0000 7f90b304d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90ac0b4090 0x7f90ac14f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:23.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.231+0000 7f90b304d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90ac0cfeb0 0x7f90ac151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:23.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.231+0000 7f90b304d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f90ac0b4a30 con 0x7f90ac06fec0 2024-09-21T03:24:23.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.231+0000 7f90b304d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f90ac0b48b0 con 0x7f90ac0b4090 2024-09-21T03:24:23.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.231+0000 7f90b304d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f90ac0b4bb0 con 0x7f90ac0cfeb0 2024-09-21T03:24:23.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.231+0000 7f90b0de9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90ac06fec0 0x7f90ac0c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:23.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.231+0000 7f90b0de9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90ac06fec0 0x7f90ac0c9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:45866/0 (socket says 172.21.15.105:45866) 2024-09-21T03:24:23.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.231+0000 7f90b0de9640 1 -- 172.21.15.105:0/945832782 learned_addr learned my addr 172.21.15.105:0/945832782 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:23.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.231+0000 7f90a3fff640 1 --2- 172.21.15.105:0/945832782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90ac0b4090 0x7f90ac14f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:23.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.231+0000 7f90b15ea640 1 --2- 172.21.15.105:0/945832782 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90ac0cfeb0 0x7f90ac151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:23.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.231+0000 7f90b0de9640 1 -- 172.21.15.105:0/945832782 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90ac0cfeb0 msgr2=0x7f90ac151b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:23.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.231+0000 7f90b0de9640 1 --2- 172.21.15.105:0/945832782 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90ac0cfeb0 0x7f90ac151b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:23.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.231+0000 7f90b0de9640 1 -- 172.21.15.105:0/945832782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90ac0b4090 msgr2=0x7f90ac14f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:23.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.231+0000 7f90b0de9640 1 --2- 172.21.15.105:0/945832782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90ac0b4090 0x7f90ac14f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:23.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.231+0000 7f90b0de9640 1 -- 172.21.15.105:0/945832782 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90ac1528a0 con 0x7f90ac06fec0 2024-09-21T03:24:23.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.231+0000 7f90b0de9640 1 --2- 172.21.15.105:0/945832782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90ac06fec0 0x7f90ac0c9fe0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f90a800b410 tx=0x7f90a800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:23.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.231+0000 7f90a17fa640 1 -- 172.21.15.105:0/945832782 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a8015020 con 0x7f90ac06fec0 2024-09-21T03:24:23.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.231+0000 7f90a17fa640 1 -- 172.21.15.105:0/945832782 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f90a8011940 con 0x7f90ac06fec0 2024-09-21T03:24:23.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.231+0000 7f90b304d640 1 -- 172.21.15.105:0/945832782 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90ac0c9500 con 0x7f90ac06fec0 2024-09-21T03:24:23.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.231+0000 7f90a17fa640 1 -- 172.21.15.105:0/945832782 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a8011d90 con 0x7f90ac06fec0 2024-09-21T03:24:23.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.231+0000 7f90b304d640 1 -- 172.21.15.105:0/945832782 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90ac0c9ac0 con 0x7f90ac06fec0 2024-09-21T03:24:23.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.232+0000 7f90b304d640 1 -- 172.21.15.105:0/945832782 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90ac0c9320 con 0x7f90ac06fec0 2024-09-21T03:24:23.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.233+0000 7f90a17fa640 1 -- 172.21.15.105:0/945832782 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f90a8018020 con 0x7f90ac06fec0 2024-09-21T03:24:23.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.234+0000 7f90a17fa640 1 --2- 172.21.15.105:0/945832782 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9098078b90 0x7f909807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:23.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.234+0000 7f90a17fa640 1 -- 172.21.15.105:0/945832782 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5767+0+0 (secure 0 0 0) 0x7f90a809b210 con 0x7f90ac06fec0 2024-09-21T03:24:23.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.234+0000 7f90a3fff640 1 --2- 172.21.15.105:0/945832782 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9098078b90 0x7f909807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:23.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.235+0000 7f90a3fff640 1 --2- 172.21.15.105:0/945832782 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9098078b90 0x7f909807b0a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f909c033000 tx=0x7f909c004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:23.239 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.237+0000 7f90a17fa640 1 -- 172.21.15.105:0/945832782 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f90ac0c9320 con 0x7f90ac06fec0 2024-09-21T03:24:23.427 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.425+0000 7f90b304d640 1 -- 172.21.15.105:0/945832782 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f90ac0b50f0 con 0x7f90ac06fec0 2024-09-21T03:24:23.427 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.425+0000 7f90a17fa640 1 -- 172.21.15.105:0/945832782 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v82) ==== 80+0+0 (secure 0 0 0) 0x7f90a801f020 con 0x7f90ac06fec0 2024-09-21T03:24:23.427 INFO:teuthology.orchestra.run.smithi105.stderr:listed 0 entries 2024-09-21T03:24:23.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.427+0000 7f90b304d640 1 -- 172.21.15.105:0/945832782 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9098078b90 msgr2=0x7f909807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:23.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.427+0000 7f90b304d640 1 --2- 172.21.15.105:0/945832782 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9098078b90 0x7f909807b0a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f909c033000 tx=0x7f909c004730 comp rx=0 tx=0).stop 2024-09-21T03:24:23.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.427+0000 7f90b304d640 1 -- 172.21.15.105:0/945832782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90ac06fec0 msgr2=0x7f90ac0c9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:23.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.428+0000 7f90b304d640 1 --2- 172.21.15.105:0/945832782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90ac06fec0 0x7f90ac0c9fe0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f90a800b410 tx=0x7f90a800b8d0 comp rx=0 tx=0).stop 2024-09-21T03:24:23.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.428+0000 7f90b304d640 1 -- 172.21.15.105:0/945832782 shutdown_connections 2024-09-21T03:24:23.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.428+0000 7f90b304d640 1 --2- 172.21.15.105:0/945832782 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9098078b90 0x7f909807b0a0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:23.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.428+0000 7f90b304d640 1 --2- 172.21.15.105:0/945832782 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90ac0cfeb0 0x7f90ac151b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:23.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.428+0000 7f90b304d640 1 --2- 172.21.15.105:0/945832782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90ac0b4090 0x7f90ac14f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:23.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.428+0000 7f90b304d640 1 --2- 172.21.15.105:0/945832782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90ac06fec0 0x7f90ac0c9fe0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:23.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.428+0000 7f90b304d640 1 -- 172.21.15.105:0/945832782 >> 172.21.15.105:0/945832782 conn(0x7f90ac0cdcc0 msgr2=0x7f90ac0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:23.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.428+0000 7f90b304d640 1 -- 172.21.15.105:0/945832782 shutdown_connections 2024-09-21T03:24:23.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.428+0000 7f90b304d640 1 -- 172.21.15.105:0/945832782 wait complete. 2024-09-21T03:24:23.440 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T03:24:23.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:24:23.440 DEBUG:teuthology.orchestra.run.smithi105:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T03:24:23.484 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi105.front.sepia.ceph.com 2024-09-21T03:24:23.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:24:23.484 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T03:24:23.539 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T03:24:23.540 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:24:23.540 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:24:23.557 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:24:23.557 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:24:23.614 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T03:24:23.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.724+0000 7f58496b2640 1 -- 172.21.15.105:0/1411458288 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58440b3710 msgr2=0x7f584406e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:23.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.724+0000 7f58496b2640 1 --2- 172.21.15.105:0/1411458288 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58440b3710 0x7f584406e7f0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f583c005fd0 tx=0x7f583c02a8b0 comp rx=0 tx=0).stop 2024-09-21T03:24:23.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.725+0000 7f58496b2640 1 -- 172.21.15.105:0/1411458288 shutdown_connections 2024-09-21T03:24:23.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.725+0000 7f58496b2640 1 --2- 172.21.15.105:0/1411458288 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58440b3710 0x7f584406e7f0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:23.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.725+0000 7f58496b2640 1 -- 172.21.15.105:0/1411458288 >> 172.21.15.105:0/1411458288 conn(0x7f584409d7f0 msgr2=0x7f58440d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:23.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.725+0000 7f58496b2640 1 -- 172.21.15.105:0/1411458288 shutdown_connections 2024-09-21T03:24:23.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.725+0000 7f58496b2640 1 -- 172.21.15.105:0/1411458288 wait complete. 2024-09-21T03:24:23.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.726+0000 7f58496b2640 1 Processor -- start 2024-09-21T03:24:23.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.726+0000 7f58496b2640 1 -- start start 2024-09-21T03:24:23.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.728+0000 7f58496b2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58440b3710 0x7f58440ca660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:23.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.728+0000 7f58496b2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58440b9970 0x7f584415bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:23.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.728+0000 7f58496b2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58441f5fe0 0x7f58440cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:23.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.728+0000 7f58496b2640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f584406ed30 con 0x7f58440b9970 2024-09-21T03:24:23.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.728+0000 7f58496b2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f58440d5010 con 0x7f58440b3710 2024-09-21T03:24:23.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.728+0000 7f58496b2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f584406eeb0 con 0x7f58441f5fe0 2024-09-21T03:24:23.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.728+0000 7f583a7fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58440b9970 0x7f584415bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:23.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.728+0000 7f583a7fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58440b9970 0x7f584415bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:45886/0 (socket says 172.21.15.105:45886) 2024-09-21T03:24:23.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.728+0000 7f583a7fc640 1 -- 172.21.15.105:0/789471679 learned_addr learned my addr 172.21.15.105:0/789471679 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:23.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.728+0000 7f5842ffd640 1 --2- 172.21.15.105:0/789471679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58440b3710 0x7f58440ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:23.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.728+0000 7f58437fe640 1 --2- 172.21.15.105:0/789471679 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58441f5fe0 0x7f58440cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:23.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.728+0000 7f583a7fc640 1 -- 172.21.15.105:0/789471679 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58441f5fe0 msgr2=0x7f58440cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:23.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.728+0000 7f583a7fc640 1 --2- 172.21.15.105:0/789471679 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58441f5fe0 0x7f58440cd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:23.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.728+0000 7f583a7fc640 1 -- 172.21.15.105:0/789471679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58440b3710 msgr2=0x7f58440ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:23.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.728+0000 7f583a7fc640 1 --2- 172.21.15.105:0/789471679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58440b3710 0x7f58440ca660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:23.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.728+0000 7f583a7fc640 1 -- 172.21.15.105:0/789471679 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58440cb840 con 0x7f58440b9970 2024-09-21T03:24:23.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.728+0000 7f5842ffd640 1 --2- 172.21.15.105:0/789471679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58440b3710 0x7f58440ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:24:23.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.728+0000 7f583a7fc640 1 --2- 172.21.15.105:0/789471679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58440b9970 0x7f584415bc50 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f582c00b420 tx=0x7f582c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:23.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.728+0000 7f583bfff640 1 -- 172.21.15.105:0/789471679 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582c011830 con 0x7f58440b9970 2024-09-21T03:24:23.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.728+0000 7f583bfff640 1 -- 172.21.15.105:0/789471679 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f582c016070 con 0x7f58440b9970 2024-09-21T03:24:23.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.728+0000 7f583bfff640 1 -- 172.21.15.105:0/789471679 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582c011d60 con 0x7f58440b9970 2024-09-21T03:24:23.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.728+0000 7f58496b2640 1 -- 172.21.15.105:0/789471679 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58440cbb20 con 0x7f58440b9970 2024-09-21T03:24:23.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.729+0000 7f58496b2640 1 -- 172.21.15.105:0/789471679 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58440cc600 con 0x7f58440b9970 2024-09-21T03:24:23.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.729+0000 7f58496b2640 1 -- 172.21.15.105:0/789471679 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f584406f340 con 0x7f58440b9970 2024-09-21T03:24:23.733 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.730+0000 7f583bfff640 1 -- 172.21.15.105:0/789471679 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f582c01b460 con 0x7f58440b9970 2024-09-21T03:24:23.733 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.731+0000 7f583bfff640 1 --2- 172.21.15.105:0/789471679 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5824078b90 0x7f582407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:23.733 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.731+0000 7f583bfff640 1 -- 172.21.15.105:0/789471679 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5767+0+0 (secure 0 0 0) 0x7f582c09a870 con 0x7f58440b9970 2024-09-21T03:24:23.733 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.731+0000 7f5842ffd640 1 --2- 172.21.15.105:0/789471679 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5824078b90 0x7f582407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:23.733 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.731+0000 7f5842ffd640 1 --2- 172.21.15.105:0/789471679 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5824078b90 0x7f582407b0a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5834007910 tx=0x7f5834009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:23.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.735+0000 7f583bfff640 1 -- 172.21.15.105:0/789471679 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f582c020020 con 0x7f58440b9970 2024-09-21T03:24:23.933 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.931+0000 7f58496b2640 1 -- 172.21.15.105:0/789471679 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f58440b9700 con 0x7f58440b9970 2024-09-21T03:24:23.933 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.931+0000 7f583bfff640 1 -- 172.21.15.105:0/789471679 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v82) ==== 80+0+0 (secure 0 0 0) 0x7f582c062d00 con 0x7f58440b9970 2024-09-21T03:24:23.933 INFO:teuthology.orchestra.run.smithi105.stderr:listed 0 entries 2024-09-21T03:24:23.936 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.934+0000 7f58496b2640 1 -- 172.21.15.105:0/789471679 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5824078b90 msgr2=0x7f582407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:23.936 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.934+0000 7f58496b2640 1 --2- 172.21.15.105:0/789471679 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5824078b90 0x7f582407b0a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5834007910 tx=0x7f5834009040 comp rx=0 tx=0).stop 2024-09-21T03:24:23.936 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.934+0000 7f58496b2640 1 -- 172.21.15.105:0/789471679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58440b9970 msgr2=0x7f584415bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:23.936 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.934+0000 7f58496b2640 1 --2- 172.21.15.105:0/789471679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58440b9970 0x7f584415bc50 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f582c00b420 tx=0x7f582c00b8e0 comp rx=0 tx=0).stop 2024-09-21T03:24:23.936 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.934+0000 7f58496b2640 1 -- 172.21.15.105:0/789471679 shutdown_connections 2024-09-21T03:24:23.936 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.934+0000 7f58496b2640 1 --2- 172.21.15.105:0/789471679 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5824078b90 0x7f582407b0a0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:23.936 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.934+0000 7f58496b2640 1 --2- 172.21.15.105:0/789471679 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58441f5fe0 0x7f58440cd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:23.936 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.934+0000 7f58496b2640 1 --2- 172.21.15.105:0/789471679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58440b9970 0x7f584415bc50 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:23.936 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.934+0000 7f58496b2640 1 --2- 172.21.15.105:0/789471679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58440b3710 0x7f58440ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:23.936 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.934+0000 7f58496b2640 1 -- 172.21.15.105:0/789471679 >> 172.21.15.105:0/789471679 conn(0x7f584409d7f0 msgr2=0x7f58440ceb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:23.936 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.934+0000 7f58496b2640 1 -- 172.21.15.105:0/789471679 shutdown_connections 2024-09-21T03:24:23.936 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:23.934+0000 7f58496b2640 1 -- 172.21.15.105:0/789471679 wait complete. 2024-09-21T03:24:23.946 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-21T03:24:23.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:24:23.947 DEBUG:teuthology.orchestra.run.smithi162:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-21T03:24:23.977 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2024-09-21T03:24:23.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:24:23.977 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-21T03:24:24.034 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T03:24:24.034 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:24:24.034 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:24:24.050 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T03:24:24.051 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T03:24:24.051 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:24:24.051 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:24:24.090 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=452 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T03:24:24.091 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:24:24.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.200+0000 7f418bd07640 1 -- 172.21.15.105:0/2651683446 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41840b4110 msgr2=0x7f41840b4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:24.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.200+0000 7f418bd07640 1 --2- 172.21.15.105:0/2651683446 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41840b4110 0x7f41840b4520 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4178009830 tx=0x7f417802a480 comp rx=0 tx=0).stop 2024-09-21T03:24:24.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.200+0000 7f418bd07640 1 -- 172.21.15.105:0/2651683446 shutdown_connections 2024-09-21T03:24:24.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.200+0000 7f418bd07640 1 --2- 172.21.15.105:0/2651683446 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f418406cde0 0x7f418406d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:24.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.200+0000 7f418bd07640 1 --2- 172.21.15.105:0/2651683446 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41840b4110 0x7f41840b4520 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:24.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.200+0000 7f418bd07640 1 -- 172.21.15.105:0/2651683446 >> 172.21.15.105:0/2651683446 conn(0x7f418406def0 msgr2=0x7f418406e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:24.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.201+0000 7f418bd07640 1 -- 172.21.15.105:0/2651683446 shutdown_connections 2024-09-21T03:24:24.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.201+0000 7f418bd07640 1 -- 172.21.15.105:0/2651683446 wait complete. 2024-09-21T03:24:24.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.202+0000 7f418bd07640 1 Processor -- start 2024-09-21T03:24:24.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.202+0000 7f418bd07640 1 -- start start 2024-09-21T03:24:24.206 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.204+0000 7f418bd07640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f418406cde0 0x7f4184140330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:24.206 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.204+0000 7f418bd07640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41840b4110 0x7f4184154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:24.207 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.204+0000 7f418bd07640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41841559b0 0x7f41841546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:24.207 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.204+0000 7f418bd07640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4184074a20 con 0x7f41840b4110 2024-09-21T03:24:24.207 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.204+0000 7f418bd07640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f41840748a0 con 0x7f418406cde0 2024-09-21T03:24:24.207 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.204+0000 7f418bd07640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4184074ba0 con 0x7f41841559b0 2024-09-21T03:24:24.207 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.204+0000 7f41892a2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41840b4110 0x7f4184154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:24.207 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.204+0000 7f41892a2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41840b4110 0x7f4184154170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:45890/0 (socket says 172.21.15.105:45890) 2024-09-21T03:24:24.207 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.204+0000 7f41892a2640 1 -- 172.21.15.105:0/2043258816 learned_addr learned my addr 172.21.15.105:0/2043258816 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:24.207 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.204+0000 7f418a2a4640 1 --2- 172.21.15.105:0/2043258816 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41841559b0 0x7f41841546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:24.207 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.204+0000 7f4189aa3640 1 --2- 172.21.15.105:0/2043258816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f418406cde0 0x7f4184140330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:24.207 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.204+0000 7f41892a2640 1 -- 172.21.15.105:0/2043258816 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41841559b0 msgr2=0x7f41841546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:24.207 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.204+0000 7f41892a2640 1 --2- 172.21.15.105:0/2043258816 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41841559b0 0x7f41841546b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:24.207 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.204+0000 7f41892a2640 1 -- 172.21.15.105:0/2043258816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f418406cde0 msgr2=0x7f4184140330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:24.207 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.204+0000 7f41892a2640 1 --2- 172.21.15.105:0/2043258816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f418406cde0 0x7f4184140330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:24.207 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.204+0000 7f41892a2640 1 -- 172.21.15.105:0/2043258816 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41841f58b0 con 0x7f41840b4110 2024-09-21T03:24:24.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.204+0000 7f41892a2640 1 --2- 172.21.15.105:0/2043258816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41840b4110 0x7f4184154170 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f4178009950 tx=0x7f4178033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:24.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.204+0000 7f41827fc640 1 -- 172.21.15.105:0/2043258816 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4178005c90 con 0x7f41840b4110 2024-09-21T03:24:24.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.204+0000 7f41827fc640 1 -- 172.21.15.105:0/2043258816 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4178031e50 con 0x7f41840b4110 2024-09-21T03:24:24.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.204+0000 7f41827fc640 1 -- 172.21.15.105:0/2043258816 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4178005260 con 0x7f41840b4110 2024-09-21T03:24:24.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.204+0000 7f418bd07640 1 -- 172.21.15.105:0/2043258816 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4184143160 con 0x7f41840b4110 2024-09-21T03:24:24.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.205+0000 7f418bd07640 1 -- 172.21.15.105:0/2043258816 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4184143720 con 0x7f41840b4110 2024-09-21T03:24:24.209 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.205+0000 7f418bd07640 1 -- 172.21.15.105:0/2043258816 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4184075070 con 0x7f41840b4110 2024-09-21T03:24:24.209 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.206+0000 7f41827fc640 1 -- 172.21.15.105:0/2043258816 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4178005400 con 0x7f41840b4110 2024-09-21T03:24:24.209 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.207+0000 7f41827fc640 1 --2- 172.21.15.105:0/2043258816 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4170078bc0 0x7f417007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:24.209 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.207+0000 7f41827fc640 1 -- 172.21.15.105:0/2043258816 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5767+0+0 (secure 0 0 0) 0x7f41780bc0b0 con 0x7f41840b4110 2024-09-21T03:24:24.209 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.207+0000 7f4189aa3640 1 --2- 172.21.15.105:0/2043258816 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4170078bc0 0x7f417007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:24.209 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.207+0000 7f4189aa3640 1 --2- 172.21.15.105:0/2043258816 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4170078bc0 0x7f417007b0d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f41740017e0 tx=0x7f4174009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:24.212 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.210+0000 7f41827fc640 1 -- 172.21.15.105:0/2043258816 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f417803f030 con 0x7f41840b4110 2024-09-21T03:24:24.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.424+0000 7f418bd07640 1 -- 172.21.15.105:0/2043258816 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4184142ef0 con 0x7f41840b4110 2024-09-21T03:24:24.426 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.425+0000 7f41827fc640 1 -- 172.21.15.105:0/2043258816 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+5235 (secure 0 0 0) 0x7f4178083fd0 con 0x7f41840b4110 2024-09-21T03:24:24.426 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:24:24.426 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":50,"btime":"2024-09-21T03:23:20:763690+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5878,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/352800965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":352800965},{"type":"v1","addr":"172.21.15.162:6836","nonce":352800965}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":5881,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3338554559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3338554559},{"type":"v1","addr":"172.21.15.162:6837","nonce":3338554559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/3520449576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3520449576},{"type":"v1","addr":"172.21.15.105:6834","nonce":3520449576}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:21:51.239132+0000","modified":"2024-09-21T03:23:19.920431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6288":{"gid":6288,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":25,"addr":"172.21.15.105:6835/2722940718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2722940718},{"type":"v1","addr":"172.21.15.105:6835","nonce":2722940718}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6288,"qdb_cluster":[6288]},"id":6}]} 2024-09-21T03:24:24.427 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 50 2024-09-21T03:24:24.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.427+0000 7f418bd07640 1 -- 172.21.15.105:0/2043258816 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4170078bc0 msgr2=0x7f417007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:24.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.427+0000 7f418bd07640 1 --2- 172.21.15.105:0/2043258816 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4170078bc0 0x7f417007b0d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f41740017e0 tx=0x7f4174009040 comp rx=0 tx=0).stop 2024-09-21T03:24:24.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.427+0000 7f418bd07640 1 -- 172.21.15.105:0/2043258816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41840b4110 msgr2=0x7f4184154170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:24.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.427+0000 7f418bd07640 1 --2- 172.21.15.105:0/2043258816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41840b4110 0x7f4184154170 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f4178009950 tx=0x7f4178033c20 comp rx=0 tx=0).stop 2024-09-21T03:24:24.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.427+0000 7f418bd07640 1 -- 172.21.15.105:0/2043258816 shutdown_connections 2024-09-21T03:24:24.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.427+0000 7f418bd07640 1 --2- 172.21.15.105:0/2043258816 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4170078bc0 0x7f417007b0d0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:24.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.427+0000 7f418bd07640 1 --2- 172.21.15.105:0/2043258816 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41841559b0 0x7f41841546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:24.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.427+0000 7f418bd07640 1 --2- 172.21.15.105:0/2043258816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41840b4110 0x7f4184154170 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:24.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.427+0000 7f418bd07640 1 --2- 172.21.15.105:0/2043258816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f418406cde0 0x7f4184140330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:24.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.427+0000 7f418bd07640 1 -- 172.21.15.105:0/2043258816 >> 172.21.15.105:0/2043258816 conn(0x7f418406def0 msgr2=0x7f418415c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:24.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.427+0000 7f418bd07640 1 -- 172.21.15.105:0/2043258816 shutdown_connections 2024-09-21T03:24:24.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.427+0000 7f418bd07640 1 -- 172.21.15.105:0/2043258816 wait complete. 2024-09-21T03:24:24.440 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:24:24.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.551+0000 7fccbe97b640 1 -- 172.21.15.105:0/597731807 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fccb8070e40 msgr2=0x7fccb815f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:24.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.551+0000 7fccbe97b640 1 --2- 172.21.15.105:0/597731807 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fccb8070e40 0x7fccb815f2a0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fccac005fd0 tx=0x7fccac02a530 comp rx=0 tx=0).stop 2024-09-21T03:24:24.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.551+0000 7fccbe97b640 1 -- 172.21.15.105:0/597731807 shutdown_connections 2024-09-21T03:24:24.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.551+0000 7fccbe97b640 1 --2- 172.21.15.105:0/597731807 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fccb815f7e0 0x7fccb80ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:24.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.551+0000 7fccbe97b640 1 --2- 172.21.15.105:0/597731807 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fccb8070e40 0x7fccb815f2a0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:24.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.551+0000 7fccbe97b640 1 -- 172.21.15.105:0/597731807 >> 172.21.15.105:0/597731807 conn(0x7fccb80cd530 msgr2=0x7fccb80cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:24.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.551+0000 7fccbe97b640 1 -- 172.21.15.105:0/597731807 shutdown_connections 2024-09-21T03:24:24.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.551+0000 7fccbe97b640 1 -- 172.21.15.105:0/597731807 wait complete. 2024-09-21T03:24:24.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.553+0000 7fccbe97b640 1 Processor -- start 2024-09-21T03:24:24.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.553+0000 7fccbe97b640 1 -- start start 2024-09-21T03:24:24.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.554+0000 7fccbe97b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fccb8070e40 0x7fccb81534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:24.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.554+0000 7fccbe97b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fccb8075fa0 0x7fccb8158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:24.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.554+0000 7fccbe97b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fccb815f7e0 0x7fccb81e9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:24.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.554+0000 7fccbe97b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fccb80cef50 con 0x7fccb815f7e0 2024-09-21T03:24:24.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.554+0000 7fccbe97b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fccb80cedd0 con 0x7fccb8070e40 2024-09-21T03:24:24.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.554+0000 7fccbe97b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fccb80cf0d0 con 0x7fccb8075fa0 2024-09-21T03:24:24.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.554+0000 7fccbcf18640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fccb815f7e0 0x7fccb81e9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:24.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.554+0000 7fccbcf18640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fccb815f7e0 0x7fccb81e9460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:45916/0 (socket says 172.21.15.105:45916) 2024-09-21T03:24:24.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.554+0000 7fccbcf18640 1 -- 172.21.15.105:0/150393848 learned_addr learned my addr 172.21.15.105:0/150393848 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:24.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.555+0000 7fccb77fe640 1 --2- 172.21.15.105:0/150393848 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fccb8075fa0 0x7fccb8158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:24.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.555+0000 7fccb7fff640 1 --2- 172.21.15.105:0/150393848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fccb8070e40 0x7fccb81534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:24.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.555+0000 7fccbcf18640 1 -- 172.21.15.105:0/150393848 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fccb8075fa0 msgr2=0x7fccb8158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:24.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.555+0000 7fccbcf18640 1 --2- 172.21.15.105:0/150393848 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fccb8075fa0 0x7fccb8158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:24.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.555+0000 7fccbcf18640 1 -- 172.21.15.105:0/150393848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fccb8070e40 msgr2=0x7fccb81534c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:24.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.555+0000 7fccbcf18640 1 --2- 172.21.15.105:0/150393848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fccb8070e40 0x7fccb81534c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:24.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.555+0000 7fccbcf18640 1 -- 172.21.15.105:0/150393848 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb81f8ed0 con 0x7fccb815f7e0 2024-09-21T03:24:24.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.555+0000 7fccb7fff640 1 --2- 172.21.15.105:0/150393848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fccb8070e40 0x7fccb81534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:24:24.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.555+0000 7fccbcf18640 1 --2- 172.21.15.105:0/150393848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fccb815f7e0 0x7fccb81e9460 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fccb000cab0 tx=0x7fccb000cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:24.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.555+0000 7fccb4ff9640 1 -- 172.21.15.105:0/150393848 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb0007d30 con 0x7fccb815f7e0 2024-09-21T03:24:24.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.555+0000 7fccb4ff9640 1 -- 172.21.15.105:0/150393848 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fccb000f450 con 0x7fccb815f7e0 2024-09-21T03:24:24.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.555+0000 7fccbe97b640 1 -- 172.21.15.105:0/150393848 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccb81f9140 con 0x7fccb815f7e0 2024-09-21T03:24:24.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.555+0000 7fccb4ff9640 1 -- 172.21.15.105:0/150393848 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb000f8a0 con 0x7fccb815f7e0 2024-09-21T03:24:24.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.555+0000 7fccbe97b640 1 -- 172.21.15.105:0/150393848 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccb81f9700 con 0x7fccb815f7e0 2024-09-21T03:24:24.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.556+0000 7fccbe97b640 1 -- 172.21.15.105:0/150393848 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccb81597a0 con 0x7fccb815f7e0 2024-09-21T03:24:24.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.557+0000 7fccb4ff9640 1 -- 172.21.15.105:0/150393848 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fccb000fa40 con 0x7fccb815f7e0 2024-09-21T03:24:24.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.557+0000 7fccb4ff9640 1 --2- 172.21.15.105:0/150393848 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcca4078b90 0x7fcca407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:24.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.558+0000 7fccb4ff9640 1 -- 172.21.15.105:0/150393848 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5767+0+0 (secure 0 0 0) 0x7fccb009b5c0 con 0x7fccb815f7e0 2024-09-21T03:24:24.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.558+0000 7fccb7fff640 1 --2- 172.21.15.105:0/150393848 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcca4078b90 0x7fcca407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:24.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.558+0000 7fccb7fff640 1 --2- 172.21.15.105:0/150393848 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcca4078b90 0x7fcca407b0a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fcca8006fd0 tx=0x7fcca8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:24.563 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.562+0000 7fccb4ff9640 1 -- 172.21.15.105:0/150393848 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fccb0014070 con 0x7fccb815f7e0 2024-09-21T03:24:24.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.772+0000 7fccbe97b640 1 -- 172.21.15.105:0/150393848 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fccb80cf6b0 con 0x7fccb815f7e0 2024-09-21T03:24:24.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.773+0000 7fccb4ff9640 1 -- 172.21.15.105:0/150393848 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+5235 (secure 0 0 0) 0x7fccb006c020 con 0x7fccb815f7e0 2024-09-21T03:24:24.775 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:24:24.775 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":50,"btime":"2024-09-21T03:23:20:763690+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5878,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/352800965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":352800965},{"type":"v1","addr":"172.21.15.162:6836","nonce":352800965}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":5881,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3338554559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3338554559},{"type":"v1","addr":"172.21.15.162:6837","nonce":3338554559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/3520449576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3520449576},{"type":"v1","addr":"172.21.15.105:6834","nonce":3520449576}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:21:51.239132+0000","modified":"2024-09-21T03:23:19.920431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6288":{"gid":6288,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":25,"addr":"172.21.15.105:6835/2722940718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2722940718},{"type":"v1","addr":"172.21.15.105:6835","nonce":2722940718}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6288,"qdb_cluster":[6288]},"id":6}]} 2024-09-21T03:24:24.775 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 50 2024-09-21T03:24:24.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.775+0000 7fccbe97b640 1 -- 172.21.15.105:0/150393848 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcca4078b90 msgr2=0x7fcca407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:24.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.775+0000 7fccbe97b640 1 --2- 172.21.15.105:0/150393848 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcca4078b90 0x7fcca407b0a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fcca8006fd0 tx=0x7fcca8008040 comp rx=0 tx=0).stop 2024-09-21T03:24:24.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.775+0000 7fccbe97b640 1 -- 172.21.15.105:0/150393848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fccb815f7e0 msgr2=0x7fccb81e9460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:24.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.775+0000 7fccbe97b640 1 --2- 172.21.15.105:0/150393848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fccb815f7e0 0x7fccb81e9460 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fccb000cab0 tx=0x7fccb000cf70 comp rx=0 tx=0).stop 2024-09-21T03:24:24.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.775+0000 7fccbe97b640 1 -- 172.21.15.105:0/150393848 shutdown_connections 2024-09-21T03:24:24.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.775+0000 7fccbe97b640 1 --2- 172.21.15.105:0/150393848 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcca4078b90 0x7fcca407b0a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:24.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.775+0000 7fccbe97b640 1 --2- 172.21.15.105:0/150393848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fccb815f7e0 0x7fccb81e9460 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:24.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.775+0000 7fccbe97b640 1 --2- 172.21.15.105:0/150393848 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fccb8075fa0 0x7fccb8158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:24.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.775+0000 7fccbe97b640 1 --2- 172.21.15.105:0/150393848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fccb8070e40 0x7fccb81534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:24.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.775+0000 7fccbe97b640 1 -- 172.21.15.105:0/150393848 >> 172.21.15.105:0/150393848 conn(0x7fccb80cd530 msgr2=0x7fccb80cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:24.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.775+0000 7fccbe97b640 1 -- 172.21.15.105:0/150393848 shutdown_connections 2024-09-21T03:24:24.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.775+0000 7fccbe97b640 1 -- 172.21.15.105:0/150393848 wait complete. 2024-09-21T03:24:24.788 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:24:24.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.898+0000 7f273ed39640 1 -- 172.21.15.105:0/1836679434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27380d2460 msgr2=0x7f273815d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:24.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.898+0000 7f273ed39640 1 --2- 172.21.15.105:0/1836679434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27380d2460 0x7f273815d130 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f272c005fd0 tx=0x7f272c02a5d0 comp rx=0 tx=0).stop 2024-09-21T03:24:24.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.898+0000 7f273ed39640 1 -- 172.21.15.105:0/1836679434 shutdown_connections 2024-09-21T03:24:24.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.898+0000 7f273ed39640 1 --2- 172.21.15.105:0/1836679434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27380d2460 0x7f273815d130 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:24.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.898+0000 7f273ed39640 1 --2- 172.21.15.105:0/1836679434 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27381570e0 0x7f27380d1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:24.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.898+0000 7f273ed39640 1 -- 172.21.15.105:0/1836679434 >> 172.21.15.105:0/1836679434 conn(0x7f273806d550 msgr2=0x7f2738071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:24.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.898+0000 7f273ed39640 1 -- 172.21.15.105:0/1836679434 shutdown_connections 2024-09-21T03:24:24.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.898+0000 7f273ed39640 1 -- 172.21.15.105:0/1836679434 wait complete. 2024-09-21T03:24:24.901 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.900+0000 7f273ed39640 1 Processor -- start 2024-09-21T03:24:24.901 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.900+0000 7f273ed39640 1 -- start start 2024-09-21T03:24:24.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.901+0000 7f273ed39640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27380d2460 0x7f2738158b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:24.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.901+0000 7f273ed39640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27381570e0 0x7f2738147980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:24.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.901+0000 7f273ed39640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f273815d670 0x7f2738146e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:24.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.901+0000 7f273ed39640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f27380b7f30 con 0x7f27380d2460 2024-09-21T03:24:24.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.901+0000 7f273ed39640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f27380b7db0 con 0x7f27381570e0 2024-09-21T03:24:24.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.901+0000 7f273ed39640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f27380b80b0 con 0x7f273815d670 2024-09-21T03:24:24.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.901+0000 7f273cad5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27380d2460 0x7f2738158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:24.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.901+0000 7f273cad5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27380d2460 0x7f2738158b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:45938/0 (socket says 172.21.15.105:45938) 2024-09-21T03:24:24.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.901+0000 7f273cad5640 1 -- 172.21.15.105:0/2584468609 learned_addr learned my addr 172.21.15.105:0/2584468609 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:24.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.901+0000 7f273d2d6640 1 --2- 172.21.15.105:0/2584468609 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f273815d670 0x7f2738146e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:24.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.901+0000 7f2737fff640 1 --2- 172.21.15.105:0/2584468609 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27381570e0 0x7f2738147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:24.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.901+0000 7f273cad5640 1 -- 172.21.15.105:0/2584468609 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f273815d670 msgr2=0x7f2738146e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:24.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.901+0000 7f273cad5640 1 --2- 172.21.15.105:0/2584468609 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f273815d670 0x7f2738146e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:24.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.901+0000 7f273cad5640 1 -- 172.21.15.105:0/2584468609 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27381570e0 msgr2=0x7f2738147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:24.905 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.901+0000 7f273cad5640 1 --2- 172.21.15.105:0/2584468609 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27381570e0 0x7f2738147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:24.906 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.902+0000 7f273cad5640 1 -- 172.21.15.105:0/2584468609 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2738157a60 con 0x7f27380d2460 2024-09-21T03:24:24.906 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.902+0000 7f273d2d6640 1 --2- 172.21.15.105:0/2584468609 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f273815d670 0x7f2738146e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:24:24.906 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.902+0000 7f273cad5640 1 --2- 172.21.15.105:0/2584468609 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27380d2460 0x7f2738158b00 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f272800d770 tx=0x7f272800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:24.906 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.902+0000 7f27357fa640 1 -- 172.21.15.105:0/2584468609 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2728017070 con 0x7f27380d2460 2024-09-21T03:24:24.906 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.902+0000 7f27357fa640 1 -- 172.21.15.105:0/2584468609 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2728009d20 con 0x7f27380d2460 2024-09-21T03:24:24.906 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.902+0000 7f27357fa640 1 -- 172.21.15.105:0/2584468609 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27280106c0 con 0x7f27380d2460 2024-09-21T03:24:24.906 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.902+0000 7f273ed39640 1 -- 172.21.15.105:0/2584468609 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2738157d40 con 0x7f27380d2460 2024-09-21T03:24:24.906 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.902+0000 7f273ed39640 1 -- 172.21.15.105:0/2584468609 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2738158300 con 0x7f27380d2460 2024-09-21T03:24:24.906 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.903+0000 7f273ed39640 1 -- 172.21.15.105:0/2584468609 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f273815d130 con 0x7f27380d2460 2024-09-21T03:24:24.907 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.904+0000 7f27357fa640 1 -- 172.21.15.105:0/2584468609 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f272801a070 con 0x7f27380d2460 2024-09-21T03:24:24.907 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.904+0000 7f27357fa640 1 --2- 172.21.15.105:0/2584468609 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2724078b90 0x7f272407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:24.907 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.904+0000 7f27357fa640 1 -- 172.21.15.105:0/2584468609 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5767+0+0 (secure 0 0 0) 0x7f272809aff0 con 0x7f27380d2460 2024-09-21T03:24:24.907 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.904+0000 7f2737fff640 1 --2- 172.21.15.105:0/2584468609 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2724078b90 0x7f272407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:24.907 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.905+0000 7f2737fff640 1 --2- 172.21.15.105:0/2584468609 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2724078b90 0x7f272407b0a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f272c033000 tx=0x7f272c004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:24.910 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:24.909+0000 7f27357fa640 1 -- 172.21.15.105:0/2584468609 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2728063400 con 0x7f27380d2460 2024-09-21T03:24:25.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.086+0000 7f273ed39640 1 -- 172.21.15.105:0/2584468609 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f27380ce3d0 con 0x7f27380d2460 2024-09-21T03:24:25.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.087+0000 7f27357fa640 1 -- 172.21.15.105:0/2584468609 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+16890 (secure 0 0 0) 0x7f2728062d00 con 0x7f27380d2460 2024-09-21T03:24:25.089 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:24:25.090 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":82,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:22:10.607372+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:21:48.883188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-21T03:21:50.206885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.16","mappings":[{"from":1,"to":5}]},{"pgid":"13.29","mappings":[{"from":6,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:24:25.091 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.090+0000 7f273ed39640 1 -- 172.21.15.105:0/2584468609 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2724078b90 msgr2=0x7f272407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:25.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.090+0000 7f273ed39640 1 --2- 172.21.15.105:0/2584468609 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2724078b90 0x7f272407b0a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f272c033000 tx=0x7f272c004730 comp rx=0 tx=0).stop 2024-09-21T03:24:25.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.090+0000 7f273ed39640 1 -- 172.21.15.105:0/2584468609 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27380d2460 msgr2=0x7f2738158b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:25.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.090+0000 7f273ed39640 1 --2- 172.21.15.105:0/2584468609 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27380d2460 0x7f2738158b00 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f272800d770 tx=0x7f272800dc30 comp rx=0 tx=0).stop 2024-09-21T03:24:25.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.090+0000 7f273ed39640 1 -- 172.21.15.105:0/2584468609 shutdown_connections 2024-09-21T03:24:25.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.090+0000 7f273ed39640 1 --2- 172.21.15.105:0/2584468609 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2724078b90 0x7f272407b0a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:25.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.090+0000 7f273ed39640 1 --2- 172.21.15.105:0/2584468609 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f273815d670 0x7f2738146e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:25.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.090+0000 7f273ed39640 1 --2- 172.21.15.105:0/2584468609 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27381570e0 0x7f2738147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:25.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.090+0000 7f273ed39640 1 --2- 172.21.15.105:0/2584468609 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27380d2460 0x7f2738158b00 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:25.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.090+0000 7f273ed39640 1 -- 172.21.15.105:0/2584468609 >> 172.21.15.105:0/2584468609 conn(0x7f273806d550 msgr2=0x7f27380d13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:25.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.090+0000 7f273ed39640 1 -- 172.21.15.105:0/2584468609 shutdown_connections 2024-09-21T03:24:25.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.090+0000 7f273ed39640 1 -- 172.21.15.105:0/2584468609 wait complete. 2024-09-21T03:24:25.103 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T03:24:25.103 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:24:25.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.213+0000 7f2404f82640 1 -- 172.21.15.105:0/696088164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23e8005300 msgr2=0x7f23e800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:25.216 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.213+0000 7f2404f82640 1 --2- 172.21.15.105:0/696088164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23e8005300 0x7f23e800b9c0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f23f8001d90 tx=0x7f23e8005830 comp rx=0 tx=0).stop 2024-09-21T03:24:25.216 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.214+0000 7f2404f82640 1 -- 172.21.15.105:0/696088164 shutdown_connections 2024-09-21T03:24:25.216 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.214+0000 7f2404f82640 1 --2- 172.21.15.105:0/696088164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23e8005300 0x7f23e800b9c0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:25.216 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.214+0000 7f2404f82640 1 -- 172.21.15.105:0/696088164 >> 172.21.15.105:0/696088164 conn(0x7f24000d15f0 msgr2=0x7f2400073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:25.216 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.214+0000 7f2404f82640 1 -- 172.21.15.105:0/696088164 shutdown_connections 2024-09-21T03:24:25.216 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.214+0000 7f2404f82640 1 -- 172.21.15.105:0/696088164 wait complete. 2024-09-21T03:24:25.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.216+0000 7f2404f82640 1 Processor -- start 2024-09-21T03:24:25.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.216+0000 7f2404f82640 1 -- start start 2024-09-21T03:24:25.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.217+0000 7f2404f82640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23e8005300 0x7f2400071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:25.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.217+0000 7f2404f82640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24000716d0 0x7f240012ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:25.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.217+0000 7f2404f82640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f240012f0f0 0x7f240013f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:25.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.217+0000 7f2404f82640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f24000b5a10 con 0x7f23e8005300 2024-09-21T03:24:25.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.217+0000 7f2404f82640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f24000b5890 con 0x7f24000716d0 2024-09-21T03:24:25.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.217+0000 7f2404f82640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f24000b5b90 con 0x7f240012f0f0 2024-09-21T03:24:25.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.217+0000 7f23fe59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23e8005300 0x7f2400071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:25.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.217+0000 7f23fe59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23e8005300 0x7f2400071190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:45950/0 (socket says 172.21.15.105:45950) 2024-09-21T03:24:25.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.217+0000 7f23fe59c640 1 -- 172.21.15.105:0/1411632314 learned_addr learned my addr 172.21.15.105:0/1411632314 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:25.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.217+0000 7f23fed9d640 1 --2- 172.21.15.105:0/1411632314 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f240012f0f0 0x7f240013f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:25.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.217+0000 7f23fdd9b640 1 --2- 172.21.15.105:0/1411632314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24000716d0 0x7f240012ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:25.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.217+0000 7f23fe59c640 1 -- 172.21.15.105:0/1411632314 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f240012f0f0 msgr2=0x7f240013f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:25.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.217+0000 7f23fe59c640 1 --2- 172.21.15.105:0/1411632314 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f240012f0f0 0x7f240013f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:25.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.217+0000 7f23fe59c640 1 -- 172.21.15.105:0/1411632314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24000716d0 msgr2=0x7f240012ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:25.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.217+0000 7f23fe59c640 1 --2- 172.21.15.105:0/1411632314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24000716d0 0x7f240012ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:25.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.217+0000 7f23fe59c640 1 -- 172.21.15.105:0/1411632314 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2400071ae0 con 0x7f23e8005300 2024-09-21T03:24:25.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.217+0000 7f23fe59c640 1 --2- 172.21.15.105:0/1411632314 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23e8005300 0x7f2400071190 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f23f0001860 tx=0x7f23f000eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:25.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.218+0000 7f23eeffd640 1 -- 172.21.15.105:0/1411632314 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f00118c0 con 0x7f23e8005300 2024-09-21T03:24:25.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.218+0000 7f23eeffd640 1 -- 172.21.15.105:0/1411632314 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23f0015020 con 0x7f23e8005300 2024-09-21T03:24:25.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.218+0000 7f2404f82640 1 -- 172.21.15.105:0/1411632314 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24001319b0 con 0x7f23e8005300 2024-09-21T03:24:25.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.218+0000 7f23eeffd640 1 -- 172.21.15.105:0/1411632314 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f0011db0 con 0x7f23e8005300 2024-09-21T03:24:25.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.218+0000 7f2404f82640 1 -- 172.21.15.105:0/1411632314 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24001f25a0 con 0x7f23e8005300 2024-09-21T03:24:25.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.219+0000 7f2404f82640 1 -- 172.21.15.105:0/1411632314 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2400073fc0 con 0x7f23e8005300 2024-09-21T03:24:25.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.219+0000 7f23eeffd640 1 -- 172.21.15.105:0/1411632314 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f23f000c3e0 con 0x7f23e8005300 2024-09-21T03:24:25.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.220+0000 7f23eeffd640 1 --2- 172.21.15.105:0/1411632314 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f23e0078b90 0x7f23e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:25.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.220+0000 7f23eeffd640 1 -- 172.21.15.105:0/1411632314 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5767+0+0 (secure 0 0 0) 0x7f23f009c9c0 con 0x7f23e8005300 2024-09-21T03:24:25.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.220+0000 7f23fdd9b640 1 --2- 172.21.15.105:0/1411632314 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f23e0078b90 0x7f23e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:25.223 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.221+0000 7f23fdd9b640 1 --2- 172.21.15.105:0/1411632314 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f23e0078b90 0x7f23e007b0a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f24000cce30 tx=0x7f23f400b260 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:25.226 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.225+0000 7f23eeffd640 1 -- 172.21.15.105:0/1411632314 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f23f009ee20 con 0x7f23e8005300 2024-09-21T03:24:25.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.434+0000 7f2404f82640 1 -- 172.21.15.105:0/1411632314 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f24000737e0 con 0x7f23e8005300 2024-09-21T03:24:25.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.435+0000 7f23eeffd640 1 -- 172.21.15.105:0/1411632314 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+5235 (secure 0 0 0) 0x7f23f001f030 con 0x7f23e8005300 2024-09-21T03:24:25.437 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:24:25.437 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":50,"btime":"2024-09-21T03:23:20:763690+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5878,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/352800965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":352800965},{"type":"v1","addr":"172.21.15.162:6836","nonce":352800965}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":5881,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3338554559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3338554559},{"type":"v1","addr":"172.21.15.162:6837","nonce":3338554559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/3520449576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3520449576},{"type":"v1","addr":"172.21.15.105:6834","nonce":3520449576}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:21:51.239132+0000","modified":"2024-09-21T03:23:19.920431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6288":{"gid":6288,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":25,"addr":"172.21.15.105:6835/2722940718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2722940718},{"type":"v1","addr":"172.21.15.105:6835","nonce":2722940718}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6288,"qdb_cluster":[6288]},"id":6}]} 2024-09-21T03:24:25.437 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 50 2024-09-21T03:24:25.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.437+0000 7f2404f82640 1 -- 172.21.15.105:0/1411632314 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f23e0078b90 msgr2=0x7f23e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:25.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.437+0000 7f2404f82640 1 --2- 172.21.15.105:0/1411632314 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f23e0078b90 0x7f23e007b0a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f24000cce30 tx=0x7f23f400b260 comp rx=0 tx=0).stop 2024-09-21T03:24:25.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.437+0000 7f2404f82640 1 -- 172.21.15.105:0/1411632314 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23e8005300 msgr2=0x7f2400071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:25.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.437+0000 7f2404f82640 1 --2- 172.21.15.105:0/1411632314 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23e8005300 0x7f2400071190 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f23f0001860 tx=0x7f23f000eac0 comp rx=0 tx=0).stop 2024-09-21T03:24:25.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.437+0000 7f2404f82640 1 -- 172.21.15.105:0/1411632314 shutdown_connections 2024-09-21T03:24:25.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.437+0000 7f2404f82640 1 --2- 172.21.15.105:0/1411632314 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f23e0078b90 0x7f23e007b0a0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:25.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.437+0000 7f2404f82640 1 --2- 172.21.15.105:0/1411632314 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f240012f0f0 0x7f240013f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:25.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.437+0000 7f2404f82640 1 --2- 172.21.15.105:0/1411632314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24000716d0 0x7f240012ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:25.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.437+0000 7f2404f82640 1 --2- 172.21.15.105:0/1411632314 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23e8005300 0x7f2400071190 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:25.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.437+0000 7f2404f82640 1 -- 172.21.15.105:0/1411632314 >> 172.21.15.105:0/1411632314 conn(0x7f24000d15f0 msgr2=0x7f240006f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:25.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.437+0000 7f2404f82640 1 -- 172.21.15.105:0/1411632314 shutdown_connections 2024-09-21T03:24:25.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.437+0000 7f2404f82640 1 -- 172.21.15.105:0/1411632314 wait complete. 2024-09-21T03:24:25.450 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:24:25.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.562+0000 7f5edc68b640 1 -- 172.21.15.105:0/526572512 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ec0003a00 msgr2=0x7f5ec0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:25.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.562+0000 7f5edc68b640 1 --2- 172.21.15.105:0/526572512 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ec0003a00 0x7f5ec0003e70 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f5ed000c260 tx=0x7f5ec0005830 comp rx=0 tx=0).stop 2024-09-21T03:24:25.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.562+0000 7f5edac28640 1 -- 172.21.15.105:0/526572512 reap_dead start 2024-09-21T03:24:25.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.562+0000 7f5edc68b640 1 -- 172.21.15.105:0/526572512 shutdown_connections 2024-09-21T03:24:25.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.562+0000 7f5edc68b640 1 -- 172.21.15.105:0/526572512 >> 172.21.15.105:0/526572512 conn(0x7f5ed409d7f0 msgr2=0x7f5ed40d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:25.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.562+0000 7f5edc68b640 1 -- 172.21.15.105:0/526572512 shutdown_connections 2024-09-21T03:24:25.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.562+0000 7f5edc68b640 1 -- 172.21.15.105:0/526572512 wait complete. 2024-09-21T03:24:25.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.564+0000 7f5edc68b640 1 Processor -- start 2024-09-21T03:24:25.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.564+0000 7f5edc68b640 1 -- start start 2024-09-21T03:24:25.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.565+0000 7f5edc68b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ec0003a00 0x7f5ed40ca860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:25.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.565+0000 7f5edc68b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ed4160340 0x7f5ed40cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:25.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.565+0000 7f5edc68b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ed40ce000 0x7f5ed414d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:25.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.565+0000 7f5edc68b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed40b66b0 con 0x7f5ec0003a00 2024-09-21T03:24:25.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.565+0000 7f5edc68b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed40d5010 con 0x7f5ed4160340 2024-09-21T03:24:25.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.565+0000 7f5edc68b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5ed40b6830 con 0x7f5ed40ce000 2024-09-21T03:24:25.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.565+0000 7f5eda427640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ec0003a00 0x7f5ed40ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:25.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.565+0000 7f5eda427640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ec0003a00 0x7f5ed40ca860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:45982/0 (socket says 172.21.15.105:45982) 2024-09-21T03:24:25.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.565+0000 7f5eda427640 1 -- 172.21.15.105:0/3888623434 learned_addr learned my addr 172.21.15.105:0/3888623434 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:25.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.565+0000 7f5edac28640 1 --2- 172.21.15.105:0/3888623434 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ed40ce000 0x7f5ed414d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:25.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.565+0000 7f5ed9c26640 1 --2- 172.21.15.105:0/3888623434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ed4160340 0x7f5ed40cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:25.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.565+0000 7f5eda427640 1 -- 172.21.15.105:0/3888623434 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ed40ce000 msgr2=0x7f5ed414d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:25.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.565+0000 7f5eda427640 1 --2- 172.21.15.105:0/3888623434 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ed40ce000 0x7f5ed414d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:25.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.565+0000 7f5eda427640 1 -- 172.21.15.105:0/3888623434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ed4160340 msgr2=0x7f5ed40cdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:25.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.565+0000 7f5eda427640 1 --2- 172.21.15.105:0/3888623434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ed4160340 0x7f5ed40cdac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:25.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.565+0000 7f5eda427640 1 -- 172.21.15.105:0/3888623434 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ed414b5e0 con 0x7f5ec0003a00 2024-09-21T03:24:25.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.566+0000 7f5eda427640 1 --2- 172.21.15.105:0/3888623434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ec0003a00 0x7f5ed40ca860 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0001e80 tx=0x7f5ed0006380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:25.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.566+0000 7f5ecaffd640 1 -- 172.21.15.105:0/3888623434 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed0031050 con 0x7f5ec0003a00 2024-09-21T03:24:25.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.566+0000 7f5ecaffd640 1 -- 172.21.15.105:0/3888623434 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ed0003b10 con 0x7f5ec0003a00 2024-09-21T03:24:25.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.566+0000 7f5edc68b640 1 -- 172.21.15.105:0/3888623434 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ed40cb5f0 con 0x7f5ec0003a00 2024-09-21T03:24:25.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.566+0000 7f5ecaffd640 1 -- 172.21.15.105:0/3888623434 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed0000f40 con 0x7f5ec0003a00 2024-09-21T03:24:25.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.566+0000 7f5edc68b640 1 -- 172.21.15.105:0/3888623434 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ed40cd2e0 con 0x7f5ec0003a00 2024-09-21T03:24:25.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.567+0000 7f5edc68b640 1 -- 172.21.15.105:0/3888623434 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ed40b39b0 con 0x7f5ec0003a00 2024-09-21T03:24:25.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.567+0000 7f5ecaffd640 1 -- 172.21.15.105:0/3888623434 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5ed002d410 con 0x7f5ec0003a00 2024-09-21T03:24:25.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.568+0000 7f5ecaffd640 1 --2- 172.21.15.105:0/3888623434 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5eb8078b90 0x7f5eb807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:25.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.568+0000 7f5ecaffd640 1 -- 172.21.15.105:0/3888623434 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5767+0+0 (secure 0 0 0) 0x7f5ed00bab30 con 0x7f5ec0003a00 2024-09-21T03:24:25.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.568+0000 7f5ed9c26640 1 --2- 172.21.15.105:0/3888623434 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5eb8078b90 0x7f5eb807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:25.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.569+0000 7f5ed9c26640 1 --2- 172.21.15.105:0/3888623434 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5eb8078b90 0x7f5eb807b0a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5ed415a350 tx=0x7f5ec4005f10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:25.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.573+0000 7f5ecaffd640 1 -- 172.21.15.105:0/3888623434 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5ed0046070 con 0x7f5ec0003a00 2024-09-21T03:24:25.787 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.785+0000 7f5edc68b640 1 -- 172.21.15.105:0/3888623434 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ed40c7dd0 con 0x7f5ec0003a00 2024-09-21T03:24:25.787 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.785+0000 7f5ecaffd640 1 -- 172.21.15.105:0/3888623434 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+5235 (secure 0 0 0) 0x7f5ed0082970 con 0x7f5ec0003a00 2024-09-21T03:24:25.788 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:24:25.788 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":50,"btime":"2024-09-21T03:23:20:763690+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5878,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/352800965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":352800965},{"type":"v1","addr":"172.21.15.162:6836","nonce":352800965}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":5881,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3338554559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3338554559},{"type":"v1","addr":"172.21.15.162:6837","nonce":3338554559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/3520449576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3520449576},{"type":"v1","addr":"172.21.15.105:6834","nonce":3520449576}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:21:51.239132+0000","modified":"2024-09-21T03:23:19.920431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6288":{"gid":6288,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":25,"addr":"172.21.15.105:6835/2722940718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2722940718},{"type":"v1","addr":"172.21.15.105:6835","nonce":2722940718}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6288,"qdb_cluster":[6288]},"id":6}]} 2024-09-21T03:24:25.790 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 50 2024-09-21T03:24:25.790 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.787+0000 7f5edc68b640 1 -- 172.21.15.105:0/3888623434 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5eb8078b90 msgr2=0x7f5eb807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:25.790 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.787+0000 7f5edc68b640 1 --2- 172.21.15.105:0/3888623434 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5eb8078b90 0x7f5eb807b0a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5ed415a350 tx=0x7f5ec4005f10 comp rx=0 tx=0).stop 2024-09-21T03:24:25.790 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.787+0000 7f5edc68b640 1 -- 172.21.15.105:0/3888623434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ec0003a00 msgr2=0x7f5ed40ca860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:25.790 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.787+0000 7f5edc68b640 1 --2- 172.21.15.105:0/3888623434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ec0003a00 0x7f5ed40ca860 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0001e80 tx=0x7f5ed0006380 comp rx=0 tx=0).stop 2024-09-21T03:24:25.790 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.787+0000 7f5edc68b640 1 -- 172.21.15.105:0/3888623434 shutdown_connections 2024-09-21T03:24:25.790 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.787+0000 7f5edc68b640 1 --2- 172.21.15.105:0/3888623434 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5eb8078b90 0x7f5eb807b0a0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:25.790 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.787+0000 7f5edc68b640 1 --2- 172.21.15.105:0/3888623434 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ed40ce000 0x7f5ed414d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:25.790 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.787+0000 7f5edc68b640 1 --2- 172.21.15.105:0/3888623434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ed4160340 0x7f5ed40cdac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:25.790 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.787+0000 7f5edc68b640 1 --2- 172.21.15.105:0/3888623434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ec0003a00 0x7f5ed40ca860 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:25.790 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.787+0000 7f5edc68b640 1 -- 172.21.15.105:0/3888623434 >> 172.21.15.105:0/3888623434 conn(0x7f5ed409d7f0 msgr2=0x7f5ed415e400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:25.791 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.788+0000 7f5edc68b640 1 -- 172.21.15.105:0/3888623434 shutdown_connections 2024-09-21T03:24:25.791 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.788+0000 7f5edc68b640 1 -- 172.21.15.105:0/3888623434 wait complete. 2024-09-21T03:24:25.800 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:24:25.913 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.911+0000 7fd9d9a63640 1 -- 172.21.15.105:0/2013765016 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9d40b51c0 msgr2=0x7fd9d415c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:25.913 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.911+0000 7fd9d9a63640 1 --2- 172.21.15.105:0/2013765016 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9d40b51c0 0x7fd9d415c6e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4005fd0 tx=0x7fd9c402a5d0 comp rx=0 tx=0).stop 2024-09-21T03:24:25.913 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.911+0000 7fd9d9a63640 1 -- 172.21.15.105:0/2013765016 shutdown_connections 2024-09-21T03:24:25.913 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.911+0000 7fd9d9a63640 1 --2- 172.21.15.105:0/2013765016 >> v2:172.21.15.162:3300/0 conn(0x7fd9d40d1490 0x7fd9d40cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:25.913 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.911+0000 7fd9d9a63640 1 --2- 172.21.15.105:0/2013765016 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9d40b51c0 0x7fd9d415c6e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:25.913 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.911+0000 7fd9d9a63640 1 -- 172.21.15.105:0/2013765016 >> 172.21.15.105:0/2013765016 conn(0x7fd9d4072ae0 msgr2=0x7fd9d4072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:25.913 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.911+0000 7fd9d9a63640 1 -- 172.21.15.105:0/2013765016 shutdown_connections 2024-09-21T03:24:25.913 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.911+0000 7fd9d9a63640 1 -- 172.21.15.105:0/2013765016 wait complete. 2024-09-21T03:24:25.914 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.913+0000 7fd9d9a63640 1 Processor -- start 2024-09-21T03:24:25.914 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.913+0000 7fd9d9a63640 1 -- start start 2024-09-21T03:24:25.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.914+0000 7fd9d9a63640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9d40b51c0 0x7fd9d40c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:25.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.914+0000 7fd9d9a63640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9d40ccbd0 0x7fd9d41f6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:25.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.914+0000 7fd9d9a63640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9d40d1490 0x7fd9d41f71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:25.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.914+0000 7fd9d9a63640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d40cf2b0 con 0x7fd9d40d1490 2024-09-21T03:24:25.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.914+0000 7fd9d9a63640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d40cf130 con 0x7fd9d40ccbd0 2024-09-21T03:24:25.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.914+0000 7fd9d9a63640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd9d40cf430 con 0x7fd9d40b51c0 2024-09-21T03:24:25.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.914+0000 7fd9d3fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9d40d1490 0x7fd9d41f71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:25.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.914+0000 7fd9d3fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9d40d1490 0x7fd9d41f71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:45992/0 (socket says 172.21.15.105:45992) 2024-09-21T03:24:25.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.914+0000 7fd9d3fff640 1 -- 172.21.15.105:0/2493855004 learned_addr learned my addr 172.21.15.105:0/2493855004 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:25.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.914+0000 7fd9d2ffd640 1 --2- 172.21.15.105:0/2493855004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9d40ccbd0 0x7fd9d41f6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:25.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.914+0000 7fd9d37fe640 1 --2- 172.21.15.105:0/2493855004 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9d40b51c0 0x7fd9d40c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:25.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.915+0000 7fd9d3fff640 1 -- 172.21.15.105:0/2493855004 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9d40b51c0 msgr2=0x7fd9d40c7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:25.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.915+0000 7fd9d3fff640 1 --2- 172.21.15.105:0/2493855004 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9d40b51c0 0x7fd9d40c7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:25.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.915+0000 7fd9d3fff640 1 -- 172.21.15.105:0/2493855004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9d40ccbd0 msgr2=0x7fd9d41f6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:25.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.915+0000 7fd9d3fff640 1 --2- 172.21.15.105:0/2493855004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9d40ccbd0 0x7fd9d41f6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:25.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.915+0000 7fd9d3fff640 1 -- 172.21.15.105:0/2493855004 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9d41e64a0 con 0x7fd9d40d1490 2024-09-21T03:24:25.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.915+0000 7fd9d3fff640 1 --2- 172.21.15.105:0/2493855004 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9d40d1490 0x7fd9d41f71a0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc00ea80 tx=0x7fd9cc00ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:25.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.915+0000 7fd9bbfff640 1 -- 172.21.15.105:0/2493855004 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc004b20 con 0x7fd9d40d1490 2024-09-21T03:24:25.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.915+0000 7fd9bbfff640 1 -- 172.21.15.105:0/2493855004 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9cc004ce0 con 0x7fd9d40d1490 2024-09-21T03:24:25.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.915+0000 7fd9d9a63640 1 -- 172.21.15.105:0/2493855004 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9d40c6b50 con 0x7fd9d40d1490 2024-09-21T03:24:25.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.915+0000 7fd9bbfff640 1 -- 172.21.15.105:0/2493855004 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc005280 con 0x7fd9d40d1490 2024-09-21T03:24:25.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.915+0000 7fd9d9a63640 1 -- 172.21.15.105:0/2493855004 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9d40c7110 con 0x7fd9d40d1490 2024-09-21T03:24:25.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.916+0000 7fd9d9a63640 1 -- 172.21.15.105:0/2493855004 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9d40cf880 con 0x7fd9d40d1490 2024-09-21T03:24:25.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.917+0000 7fd9bbfff640 1 -- 172.21.15.105:0/2493855004 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd9cc005420 con 0x7fd9d40d1490 2024-09-21T03:24:25.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.917+0000 7fd9bbfff640 1 --2- 172.21.15.105:0/2493855004 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd9c0078b90 0x7fd9c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:25.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.917+0000 7fd9bbfff640 1 -- 172.21.15.105:0/2493855004 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5767+0+0 (secure 0 0 0) 0x7fd9cc09b8e0 con 0x7fd9d40d1490 2024-09-21T03:24:25.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.917+0000 7fd9d37fe640 1 --2- 172.21.15.105:0/2493855004 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd9c0078b90 0x7fd9c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:25.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.918+0000 7fd9d37fe640 1 --2- 172.21.15.105:0/2493855004 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd9c0078b90 0x7fd9c007b0a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4033000 tx=0x7fd9c4004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:25.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:25.922+0000 7fd9bbfff640 1 -- 172.21.15.105:0/2493855004 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd9cc0636a0 con 0x7fd9d40d1490 2024-09-21T03:24:26.101 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.099+0000 7fd9d9a63640 1 -- 172.21.15.105:0/2493855004 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd9d415ca00 con 0x7fd9d40d1490 2024-09-21T03:24:26.102 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.100+0000 7fd9bbfff640 1 -- 172.21.15.105:0/2493855004 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+16890 (secure 0 0 0) 0x7fd9cc0680d0 con 0x7fd9d40d1490 2024-09-21T03:24:26.102 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:24:26.102 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":82,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:22:10.607372+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:21:48.883188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-21T03:21:50.206885+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.16","mappings":[{"from":1,"to":5}]},{"pgid":"13.29","mappings":[{"from":6,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:24:26.104 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.102+0000 7fd9d9a63640 1 -- 172.21.15.105:0/2493855004 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd9c0078b90 msgr2=0x7fd9c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:26.105 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.102+0000 7fd9d9a63640 1 --2- 172.21.15.105:0/2493855004 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd9c0078b90 0x7fd9c007b0a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4033000 tx=0x7fd9c4004730 comp rx=0 tx=0).stop 2024-09-21T03:24:26.105 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.102+0000 7fd9d9a63640 1 -- 172.21.15.105:0/2493855004 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9d40d1490 msgr2=0x7fd9d41f71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:26.105 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.102+0000 7fd9d9a63640 1 --2- 172.21.15.105:0/2493855004 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9d40d1490 0x7fd9d41f71a0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc00ea80 tx=0x7fd9cc00ef40 comp rx=0 tx=0).stop 2024-09-21T03:24:26.105 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.102+0000 7fd9d9a63640 1 -- 172.21.15.105:0/2493855004 shutdown_connections 2024-09-21T03:24:26.105 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.102+0000 7fd9d9a63640 1 --2- 172.21.15.105:0/2493855004 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd9c0078b90 0x7fd9c007b0a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:26.105 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.102+0000 7fd9d9a63640 1 --2- 172.21.15.105:0/2493855004 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9d40d1490 0x7fd9d41f71a0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:26.105 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.102+0000 7fd9d9a63640 1 --2- 172.21.15.105:0/2493855004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9d40ccbd0 0x7fd9d41f6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:26.105 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.102+0000 7fd9d9a63640 1 --2- 172.21.15.105:0/2493855004 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9d40b51c0 0x7fd9d40c7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:26.105 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.102+0000 7fd9d9a63640 1 -- 172.21.15.105:0/2493855004 >> 172.21.15.105:0/2493855004 conn(0x7fd9d4072ae0 msgr2=0x7fd9d40d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:26.105 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.103+0000 7fd9d9a63640 1 -- 172.21.15.105:0/2493855004 shutdown_connections 2024-09-21T03:24:26.105 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.103+0000 7fd9d9a63640 1 -- 172.21.15.105:0/2493855004 wait complete. 2024-09-21T03:24:26.115 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T03:24:26.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.227+0000 7f7a0ded5640 1 -- 172.21.15.105:0/2645234037 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a08142270 msgr2=0x7f7a08073e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:26.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.227+0000 7f7a0ded5640 1 --2- 172.21.15.105:0/2645234037 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a08142270 0x7f7a08073e50 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f79f0005fd0 tx=0x7f79f002a5d0 comp rx=0 tx=0).stop 2024-09-21T03:24:26.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.227+0000 7f7a0ded5640 1 -- 172.21.15.105:0/2645234037 shutdown_connections 2024-09-21T03:24:26.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.227+0000 7f7a0ded5640 1 --2- 172.21.15.105:0/2645234037 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a08142270 0x7f7a08073e50 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:26.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.227+0000 7f7a0ded5640 1 --2- 172.21.15.105:0/2645234037 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a08144270 0x7f7a080b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:26.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.227+0000 7f7a0ded5640 1 -- 172.21.15.105:0/2645234037 >> 172.21.15.105:0/2645234037 conn(0x7f7a080d15f0 msgr2=0x7f7a08073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:26.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.227+0000 7f7a0ded5640 1 -- 172.21.15.105:0/2645234037 shutdown_connections 2024-09-21T03:24:26.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.227+0000 7f7a0ded5640 1 -- 172.21.15.105:0/2645234037 wait complete. 2024-09-21T03:24:26.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.229+0000 7f7a0ded5640 1 Processor -- start 2024-09-21T03:24:26.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.229+0000 7f7a0ded5640 1 -- start start 2024-09-21T03:24:26.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.230+0000 7f7a0ded5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a08142270 0x7f7a080cc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:26.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.230+0000 7f7a0ded5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a08142680 0x7f7a08130240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:26.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.230+0000 7f7a0ded5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a08144270 0x7f7a08130780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:26.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.230+0000 7f7a0ded5640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7a080d06f0 con 0x7f7a08142270 2024-09-21T03:24:26.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.230+0000 7f7a0ded5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7a080d0570 con 0x7f7a08144270 2024-09-21T03:24:26.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.230+0000 7f7a0ded5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7a080d0870 con 0x7f7a08142680 2024-09-21T03:24:26.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.230+0000 7f7a077fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a08142270 0x7f7a080cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:26.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.230+0000 7f7a077fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a08142270 0x7f7a080cc800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:46012/0 (socket says 172.21.15.105:46012) 2024-09-21T03:24:26.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.230+0000 7f7a077fe640 1 -- 172.21.15.105:0/2297938236 learned_addr learned my addr 172.21.15.105:0/2297938236 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:26.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.231+0000 7f7a077fe640 1 -- 172.21.15.105:0/2297938236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a08142680 msgr2=0x7f7a08130240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:26.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.231+0000 7f7a077fe640 1 --2- 172.21.15.105:0/2297938236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a08142680 0x7f7a08130240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:26.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.231+0000 7f7a077fe640 1 -- 172.21.15.105:0/2297938236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a08144270 msgr2=0x7f7a08130780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:26.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.231+0000 7f7a077fe640 1 --2- 172.21.15.105:0/2297938236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a08144270 0x7f7a08130780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:26.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.231+0000 7f7a077fe640 1 -- 172.21.15.105:0/2297938236 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a0815a980 con 0x7f7a08142270 2024-09-21T03:24:26.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.231+0000 7f7a077fe640 1 --2- 172.21.15.105:0/2297938236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a08142270 0x7f7a080cc800 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f79f800d6d0 tx=0x7f79f800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:26.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.231+0000 7f7a04ff9640 1 -- 172.21.15.105:0/2297938236 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f8017070 con 0x7f7a08142270 2024-09-21T03:24:26.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.231+0000 7f7a04ff9640 1 -- 172.21.15.105:0/2297938236 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f79f8005330 con 0x7f7a08142270 2024-09-21T03:24:26.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.231+0000 7f7a0ded5640 1 -- 172.21.15.105:0/2297938236 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a08131180 con 0x7f7a08142270 2024-09-21T03:24:26.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.231+0000 7f7a04ff9640 1 -- 172.21.15.105:0/2297938236 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f80097c0 con 0x7f7a08142270 2024-09-21T03:24:26.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.231+0000 7f7a0ded5640 1 -- 172.21.15.105:0/2297938236 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a08130ea0 con 0x7f7a08142270 2024-09-21T03:24:26.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.232+0000 7f7a0ded5640 1 -- 172.21.15.105:0/2297938236 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a08074550 con 0x7f7a08142270 2024-09-21T03:24:26.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.233+0000 7f7a04ff9640 1 -- 172.21.15.105:0/2297938236 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f79f8009b70 con 0x7f7a08142270 2024-09-21T03:24:26.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.233+0000 7f7a04ff9640 1 --2- 172.21.15.105:0/2297938236 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f79e8078b90 0x7f79e807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:26.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.233+0000 7f7a04ff9640 1 -- 172.21.15.105:0/2297938236 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5767+0+0 (secure 0 0 0) 0x7f79f809afb0 con 0x7f7a08142270 2024-09-21T03:24:26.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.233+0000 7f79fffff640 1 --2- 172.21.15.105:0/2297938236 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f79e8078b90 0x7f79e807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:26.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.234+0000 7f79fffff640 1 --2- 172.21.15.105:0/2297938236 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f79e8078b90 0x7f79e807b0a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f79f0033000 tx=0x7f79f00046c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:26.239 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.238+0000 7f7a04ff9640 1 -- 172.21.15.105:0/2297938236 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f79f80634d0 con 0x7f7a08142270 2024-09-21T03:24:26.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.453+0000 7f7a0ded5640 1 -- 172.21.15.105:0/2297938236 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f7a08141f90 con 0x7f7a08142270 2024-09-21T03:24:26.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.453+0000 7f7a04ff9640 1 -- 172.21.15.105:0/2297938236 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=-1 MDS has one of two health warnings which could extend recovery: MDS_TRIM or MDS_CACHE_OVERSIZED. MDS failover is not recommended since it might cause unexpected file system unavailability. If you wish to proceed, pass --yes-i-really-mean-it v50) ==== 316+0+0 (secure 0 0 0) 0x7f79f8062dd0 con 0x7f7a08142270 2024-09-21T03:24:26.455 INFO:teuthology.orchestra.run.smithi105.stderr:Error EPERM: MDS has one of two health warnings which could extend recovery: MDS_TRIM or MDS_CACHE_OVERSIZED. MDS failover is not recommended since it might cause unexpected file system unavailability. If you wish to proceed, pass --yes-i-really-mean-it 2024-09-21T03:24:26.460 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:24:26.460 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs --yes-i-really-mean-it 2024-09-21T03:24:26.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.574+0000 7f3fba669640 1 -- 172.21.15.105:0/4117238215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f9c005250 msgr2=0x7f3f9c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:26.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.574+0000 7f3fba669640 1 --2- 172.21.15.105:0/4117238215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f9c005250 0x7f3f9c00b9c0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f3fac001d90 tx=0x7f3f9c005830 comp rx=0 tx=0).stop 2024-09-21T03:24:26.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.574+0000 7f3fba669640 1 -- 172.21.15.105:0/4117238215 shutdown_connections 2024-09-21T03:24:26.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.574+0000 7f3fba669640 1 --2- 172.21.15.105:0/4117238215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f9c005250 0x7f3f9c00b9c0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:26.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.574+0000 7f3fba669640 1 -- 172.21.15.105:0/4117238215 >> 172.21.15.105:0/4117238215 conn(0x7f3fb406def0 msgr2=0x7f3fb406e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:26.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.574+0000 7f3fba669640 1 -- 172.21.15.105:0/4117238215 shutdown_connections 2024-09-21T03:24:26.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.574+0000 7f3fba669640 1 -- 172.21.15.105:0/4117238215 wait complete. 2024-09-21T03:24:26.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.576+0000 7f3fba669640 1 Processor -- start 2024-09-21T03:24:26.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.576+0000 7f3fba669640 1 -- start start 2024-09-21T03:24:26.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.577+0000 7f3fba669640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f9c005250 0x7f3fb415afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:26.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.577+0000 7f3fba669640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fb41505e0 0x7f3fb41509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:26.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.577+0000 7f3fba669640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3fb41f1f10 0x7f3fb41f2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:26.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.577+0000 7f3fba669640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb4070320 con 0x7f3fb41f1f10 2024-09-21T03:24:26.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.577+0000 7f3fba669640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb40701a0 con 0x7f3f9c005250 2024-09-21T03:24:26.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.577+0000 7f3fba669640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3fb40704a0 con 0x7f3fb41505e0 2024-09-21T03:24:26.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.577+0000 7f3fb8c06640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3fb41f1f10 0x7f3fb41f2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:26.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.578+0000 7f3fb8c06640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3fb41f1f10 0x7f3fb41f2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:46024/0 (socket says 172.21.15.105:46024) 2024-09-21T03:24:26.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.578+0000 7f3fb8c06640 1 -- 172.21.15.105:0/1571877554 learned_addr learned my addr 172.21.15.105:0/1571877554 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:26.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.578+0000 7f3fb3fff640 1 --2- 172.21.15.105:0/1571877554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f9c005250 0x7f3fb415afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:26.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.578+0000 7f3fb37fe640 1 --2- 172.21.15.105:0/1571877554 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fb41505e0 0x7f3fb41509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:26.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.578+0000 7f3fb8c06640 1 -- 172.21.15.105:0/1571877554 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fb41505e0 msgr2=0x7f3fb41509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:26.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.578+0000 7f3fb8c06640 1 --2- 172.21.15.105:0/1571877554 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fb41505e0 0x7f3fb41509f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:26.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.578+0000 7f3fb8c06640 1 -- 172.21.15.105:0/1571877554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f9c005250 msgr2=0x7f3fb415afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:26.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.578+0000 7f3fb8c06640 1 --2- 172.21.15.105:0/1571877554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f9c005250 0x7f3fb415afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:26.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.578+0000 7f3fb8c06640 1 -- 172.21.15.105:0/1571877554 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fb40b3310 con 0x7f3fb41f1f10 2024-09-21T03:24:26.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.578+0000 7f3fb8c06640 1 --2- 172.21.15.105:0/1571877554 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3fb41f1f10 0x7f3fb41f2320 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f3fac001eb0 tx=0x7f3fac006d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:26.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.578+0000 7f3fb0ff9640 1 -- 172.21.15.105:0/1571877554 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fac003d80 con 0x7f3fb41f1f10 2024-09-21T03:24:26.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.578+0000 7f3fb0ff9640 1 -- 172.21.15.105:0/1571877554 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3fac005b80 con 0x7f3fb41f1f10 2024-09-21T03:24:26.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.578+0000 7f3fba669640 1 -- 172.21.15.105:0/1571877554 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fb40b2ea0 con 0x7f3fb41f1f10 2024-09-21T03:24:26.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.578+0000 7f3fb0ff9640 1 -- 172.21.15.105:0/1571877554 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fac005fd0 con 0x7f3fb41f1f10 2024-09-21T03:24:26.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.578+0000 7f3fba669640 1 -- 172.21.15.105:0/1571877554 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fb40b1b10 con 0x7f3fb41f1f10 2024-09-21T03:24:26.583 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.579+0000 7f3fba669640 1 -- 172.21.15.105:0/1571877554 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fb40b3070 con 0x7f3fb41f1f10 2024-09-21T03:24:26.583 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.580+0000 7f3fb0ff9640 1 -- 172.21.15.105:0/1571877554 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3fac005030 con 0x7f3fb41f1f10 2024-09-21T03:24:26.583 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.580+0000 7f3fb0ff9640 1 --2- 172.21.15.105:0/1571877554 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3fa0078b90 0x7f3fa007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:26.583 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.580+0000 7f3fb0ff9640 1 -- 172.21.15.105:0/1571877554 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5767+0+0 (secure 0 0 0) 0x7f3fac0ba9e0 con 0x7f3fb41f1f10 2024-09-21T03:24:26.583 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.581+0000 7f3fb3fff640 1 --2- 172.21.15.105:0/1571877554 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3fa0078b90 0x7f3fa007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:26.583 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.581+0000 7f3fb3fff640 1 --2- 172.21.15.105:0/1571877554 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3fa0078b90 0x7f3fa007b0a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4009bd0 tx=0x7f3fa4005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:26.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.585+0000 7f3fb0ff9640 1 -- 172.21.15.105:0/1571877554 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3fb40b3070 con 0x7f3fb41f1f10 2024-09-21T03:24:26.800 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.798+0000 7f3fba669640 1 -- 172.21.15.105:0/1571877554 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f3fb4070a00 con 0x7f3fb41f1f10 2024-09-21T03:24:26.800 INFO:tasks.ceph.mon.a.smithi105.stderr:2024-09-21T03:24:26.799+0000 7f25819ea640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T03:24:26.802 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.800+0000 7f3fb0ff9640 1 -- 172.21.15.105:0/1571877554 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v51) ==== 191+0+0 (secure 0 0 0) 0x7f3fac043060 con 0x7f3fb41f1f10 2024-09-21T03:24:26.802 INFO:teuthology.orchestra.run.smithi105.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T03:24:26.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.803+0000 7f3fba669640 1 -- 172.21.15.105:0/1571877554 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3fa0078b90 msgr2=0x7f3fa007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:26.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.803+0000 7f3fba669640 1 --2- 172.21.15.105:0/1571877554 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3fa0078b90 0x7f3fa007b0a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4009bd0 tx=0x7f3fa4005f90 comp rx=0 tx=0).stop 2024-09-21T03:24:26.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.803+0000 7f3fba669640 1 -- 172.21.15.105:0/1571877554 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3fb41f1f10 msgr2=0x7f3fb41f2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:26.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.803+0000 7f3fba669640 1 --2- 172.21.15.105:0/1571877554 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3fb41f1f10 0x7f3fb41f2320 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f3fac001eb0 tx=0x7f3fac006d40 comp rx=0 tx=0).stop 2024-09-21T03:24:26.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.803+0000 7f3fba669640 1 -- 172.21.15.105:0/1571877554 shutdown_connections 2024-09-21T03:24:26.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.803+0000 7f3fba669640 1 --2- 172.21.15.105:0/1571877554 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3fa0078b90 0x7f3fa007b0a0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:26.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.803+0000 7f3fba669640 1 --2- 172.21.15.105:0/1571877554 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3fb41f1f10 0x7f3fb41f2320 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:26.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.803+0000 7f3fba669640 1 --2- 172.21.15.105:0/1571877554 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fb41505e0 0x7f3fb41509f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:26.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.803+0000 7f3fba669640 1 --2- 172.21.15.105:0/1571877554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f9c005250 0x7f3fb415afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:26.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.803+0000 7f3fba669640 1 -- 172.21.15.105:0/1571877554 >> 172.21.15.105:0/1571877554 conn(0x7f3fb406def0 msgr2=0x7f3fb40cfe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:26.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.803+0000 7f3fba669640 1 -- 172.21.15.105:0/1571877554 shutdown_connections 2024-09-21T03:24:26.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.803+0000 7f3fba669640 1 -- 172.21.15.105:0/1571877554 wait complete. 2024-09-21T03:24:26.819 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T03:24:26.868 INFO:tasks.ceph.mds.a.smithi105.stdout:starting mds.a at 2024-09-21T03:24:26.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.935+0000 7f6ef2e71640 1 -- 172.21.15.105:0/814883107 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6edc003a30 msgr2=0x7f6edc003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:26.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.935+0000 7f6ef2e71640 1 --2- 172.21.15.105:0/814883107 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6edc003a30 0x7f6edc003ea0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f6ee00016e0 tx=0x7f6edc005830 comp rx=0 tx=0).stop 2024-09-21T03:24:26.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.935+0000 7f6ef140e640 1 -- 172.21.15.105:0/814883107 reap_dead start 2024-09-21T03:24:26.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.935+0000 7f6ef2e71640 1 -- 172.21.15.105:0/814883107 shutdown_connections 2024-09-21T03:24:26.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.935+0000 7f6ef2e71640 1 -- 172.21.15.105:0/814883107 >> 172.21.15.105:0/814883107 conn(0x7f6eec0d12a0 msgr2=0x7f6eec0d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:26.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.935+0000 7f6ef2e71640 1 -- 172.21.15.105:0/814883107 shutdown_connections 2024-09-21T03:24:26.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.935+0000 7f6ef2e71640 1 -- 172.21.15.105:0/814883107 wait complete. 2024-09-21T03:24:26.938 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.937+0000 7f6ef2e71640 1 Processor -- start 2024-09-21T03:24:26.938 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.937+0000 7f6ef2e71640 1 -- start start 2024-09-21T03:24:26.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.938+0000 7f6ef2e71640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6edc003a30 0x7f6eec0c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:26.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.938+0000 7f6ef2e71640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6eec0c7b60 0x7f6eec1f4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:26.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.938+0000 7f6ef2e71640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6eec1f4c90 0x7f6eec1cec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:26.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.938+0000 7f6ef2e71640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6eec06cde0 con 0x7f6eec0c7b60 2024-09-21T03:24:26.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.938+0000 7f6ef2e71640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6eec0b20d0 con 0x7f6edc003a30 2024-09-21T03:24:26.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.938+0000 7f6ef2e71640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6eec06cf60 con 0x7f6eec1f4c90 2024-09-21T03:24:26.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.938+0000 7f6eebfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6eec0c7b60 0x7f6eec1f4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:26.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.938+0000 7f6eebfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6eec0c7b60 0x7f6eec1f4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:46062/0 (socket says 172.21.15.105:46062) 2024-09-21T03:24:26.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.938+0000 7f6eebfff640 1 -- 172.21.15.105:0/864496864 learned_addr learned my addr 172.21.15.105:0/864496864 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:26.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.938+0000 7f6ef140e640 1 --2- 172.21.15.105:0/864496864 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6eec1f4c90 0x7f6eec1cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:26.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.938+0000 7f6ef0c0d640 1 --2- 172.21.15.105:0/864496864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6edc003a30 0x7f6eec0c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:26.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.939+0000 7f6eebfff640 1 -- 172.21.15.105:0/864496864 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6eec1f4c90 msgr2=0x7f6eec1cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:26.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.939+0000 7f6eebfff640 1 --2- 172.21.15.105:0/864496864 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6eec1f4c90 0x7f6eec1cec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:26.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.939+0000 7f6eebfff640 1 -- 172.21.15.105:0/864496864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6edc003a30 msgr2=0x7f6eec0c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:26.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.939+0000 7f6eebfff640 1 --2- 172.21.15.105:0/864496864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6edc003a30 0x7f6eec0c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:26.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.939+0000 7f6eebfff640 1 -- 172.21.15.105:0/864496864 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eec1f50a0 con 0x7f6eec0c7b60 2024-09-21T03:24:26.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.939+0000 7f6eebfff640 1 --2- 172.21.15.105:0/864496864 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6eec0c7b60 0x7f6eec1f4750 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f6ed800e5c0 tx=0x7f6ed800ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:26.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.939+0000 7f6ee97fa640 1 -- 172.21.15.105:0/864496864 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8015070 con 0x7f6eec0c7b60 2024-09-21T03:24:26.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.939+0000 7f6ee97fa640 1 -- 172.21.15.105:0/864496864 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ed800ca00 con 0x7f6eec0c7b60 2024-09-21T03:24:26.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.939+0000 7f6ef2e71640 1 -- 172.21.15.105:0/864496864 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6eec1f1fc0 con 0x7f6eec0c7b60 2024-09-21T03:24:26.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.939+0000 7f6ee97fa640 1 -- 172.21.15.105:0/864496864 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed800cdf0 con 0x7f6eec0c7b60 2024-09-21T03:24:26.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.939+0000 7f6ef2e71640 1 -- 172.21.15.105:0/864496864 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6eec1e33a0 con 0x7f6eec0c7b60 2024-09-21T03:24:26.943 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.940+0000 7f6ef2e71640 1 -- 172.21.15.105:0/864496864 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6eec0b0de0 con 0x7f6eec0c7b60 2024-09-21T03:24:26.943 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.941+0000 7f6ee97fa640 1 -- 172.21.15.105:0/864496864 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6ed8018070 con 0x7f6eec0c7b60 2024-09-21T03:24:26.944 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.941+0000 7f6ee97fa640 1 --2- 172.21.15.105:0/864496864 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6ed0078b90 0x7f6ed007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:26.944 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.941+0000 7f6ee97fa640 1 -- 172.21.15.105:0/864496864 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5853+0+0 (secure 0 0 0) 0x7f6ed809b1c0 con 0x7f6eec0c7b60 2024-09-21T03:24:26.944 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.941+0000 7f6ef0c0d640 1 --2- 172.21.15.105:0/864496864 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6ed0078b90 0x7f6ed007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:26.944 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.942+0000 7f6ef0c0d640 1 --2- 172.21.15.105:0/864496864 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6ed0078b90 0x7f6ed007b0a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6eec0ceda0 tx=0x7f6ee00011e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:26.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:26.946+0000 7f6ee97fa640 1 -- 172.21.15.105:0/864496864 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6eec1f50a0 con 0x7f6eec0c7b60 2024-09-21T03:24:27.046 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:24:27.049 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:24:27.165 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.163+0000 7f6ef2e71640 1 -- 172.21.15.105:0/864496864 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f6eec071af0 con 0x7f6eec0c7b60 2024-09-21T03:24:27.803 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.802+0000 7f6ee97fa640 1 -- 172.21.15.105:0/864496864 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v52) ==== 104+0+0 (secure 0 0 0) 0x7f6ed8062fb0 con 0x7f6eec0c7b60 2024-09-21T03:24:27.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.804+0000 7f6ef2e71640 1 -- 172.21.15.105:0/864496864 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6ed0078b90 msgr2=0x7f6ed007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:27.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.804+0000 7f6ef2e71640 1 --2- 172.21.15.105:0/864496864 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6ed0078b90 0x7f6ed007b0a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f6eec0ceda0 tx=0x7f6ee00011e0 comp rx=0 tx=0).stop 2024-09-21T03:24:27.807 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.804+0000 7f6ef2e71640 1 -- 172.21.15.105:0/864496864 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6eec0c7b60 msgr2=0x7f6eec1f4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:27.807 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.804+0000 7f6ef2e71640 1 --2- 172.21.15.105:0/864496864 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6eec0c7b60 0x7f6eec1f4750 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f6ed800e5c0 tx=0x7f6ed800ea80 comp rx=0 tx=0).stop 2024-09-21T03:24:27.807 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.805+0000 7f6ef2e71640 1 -- 172.21.15.105:0/864496864 shutdown_connections 2024-09-21T03:24:27.807 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.805+0000 7f6ef2e71640 1 --2- 172.21.15.105:0/864496864 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6ed0078b90 0x7f6ed007b0a0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:27.807 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.805+0000 7f6ef2e71640 1 --2- 172.21.15.105:0/864496864 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6eec1f4c90 0x7f6eec1cec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:27.807 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.805+0000 7f6ef2e71640 1 --2- 172.21.15.105:0/864496864 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6eec0c7b60 0x7f6eec1f4750 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:27.807 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.805+0000 7f6ef2e71640 1 --2- 172.21.15.105:0/864496864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6edc003a30 0x7f6eec0c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:27.807 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.805+0000 7f6ef2e71640 1 -- 172.21.15.105:0/864496864 >> 172.21.15.105:0/864496864 conn(0x7f6eec0d12a0 msgr2=0x7f6eec070650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:27.807 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.805+0000 7f6ef2e71640 1 -- 172.21.15.105:0/864496864 shutdown_connections 2024-09-21T03:24:27.807 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.805+0000 7f6ef2e71640 1 -- 172.21.15.105:0/864496864 wait complete. 2024-09-21T03:24:27.819 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T03:24:27.940 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.938+0000 7f3dd95df640 1 -- 172.21.15.105:0/2307651629 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3dd40b6910 msgr2=0x7f3dd415bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:27.940 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.938+0000 7f3dd95df640 1 --2- 172.21.15.105:0/2307651629 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3dd40b6910 0x7f3dd415bb80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc005fd0 tx=0x7f3dcc02a940 comp rx=0 tx=0).stop 2024-09-21T03:24:27.940 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.938+0000 7f3dd95df640 1 -- 172.21.15.105:0/2307651629 shutdown_connections 2024-09-21T03:24:27.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.938+0000 7f3dd95df640 1 --2- 172.21.15.105:0/2307651629 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3dd40b6910 0x7f3dd415bb80 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:27.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.938+0000 7f3dd95df640 1 -- 172.21.15.105:0/2307651629 >> 172.21.15.105:0/2307651629 conn(0x7f3dd4073d90 msgr2=0x7f3dd40741a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:27.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.938+0000 7f3dd95df640 1 -- 172.21.15.105:0/2307651629 shutdown_connections 2024-09-21T03:24:27.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.939+0000 7f3dd95df640 1 -- 172.21.15.105:0/2307651629 wait complete. 2024-09-21T03:24:27.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.940+0000 7f3dd95df640 1 Processor -- start 2024-09-21T03:24:27.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.940+0000 7f3dd95df640 1 -- start start 2024-09-21T03:24:27.945 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.942+0000 7f3dd95df640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3dd40b6910 0x7f3dd41f99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:27.945 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.942+0000 7f3dd95df640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3dd41527d0 0x7f3dd40b4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:27.945 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.942+0000 7f3dd95df640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3dd40b47c0 0x7f3dd414f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:27.945 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.942+0000 7f3dd95df640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd40cffb0 con 0x7f3dd40b6910 2024-09-21T03:24:27.945 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.942+0000 7f3dd95df640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd40cfe30 con 0x7f3dd40b47c0 2024-09-21T03:24:27.945 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.942+0000 7f3dd95df640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3dd40d0130 con 0x7f3dd41527d0 2024-09-21T03:24:27.945 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.942+0000 7f3dd2ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3dd40b6910 0x7f3dd41f99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:27.945 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.942+0000 7f3dd2ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3dd40b6910 0x7f3dd41f99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:46070/0 (socket says 172.21.15.105:46070) 2024-09-21T03:24:27.945 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.942+0000 7f3dd2ffd640 1 -- 172.21.15.105:0/2352393584 learned_addr learned my addr 172.21.15.105:0/2352393584 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:27.945 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.942+0000 7f3dd37fe640 1 --2- 172.21.15.105:0/2352393584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3dd40b47c0 0x7f3dd414f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:27.945 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.942+0000 7f3dd27fc640 1 --2- 172.21.15.105:0/2352393584 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3dd41527d0 0x7f3dd40b4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:27.945 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.942+0000 7f3dd2ffd640 1 -- 172.21.15.105:0/2352393584 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3dd41527d0 msgr2=0x7f3dd40b4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:27.946 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.942+0000 7f3dd2ffd640 1 --2- 172.21.15.105:0/2352393584 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3dd41527d0 0x7f3dd40b4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:27.946 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.942+0000 7f3dd2ffd640 1 -- 172.21.15.105:0/2352393584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3dd40b47c0 msgr2=0x7f3dd414f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:27.946 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.942+0000 7f3dd2ffd640 1 --2- 172.21.15.105:0/2352393584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3dd40b47c0 0x7f3dd414f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:27.946 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.942+0000 7f3dd2ffd640 1 -- 172.21.15.105:0/2352393584 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd41f59b0 con 0x7f3dd40b6910 2024-09-21T03:24:27.946 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.942+0000 7f3dd2ffd640 1 --2- 172.21.15.105:0/2352393584 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3dd40b6910 0x7f3dd41f99b0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f3dc400c430 tx=0x7f3dc400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:27.946 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.942+0000 7f3dcb7fe640 1 -- 172.21.15.105:0/2352393584 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc4011790 con 0x7f3dd40b6910 2024-09-21T03:24:27.946 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.943+0000 7f3dd95df640 1 -- 172.21.15.105:0/2352393584 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dd40aa4f0 con 0x7f3dd40b6910 2024-09-21T03:24:27.946 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.943+0000 7f3dcb7fe640 1 -- 172.21.15.105:0/2352393584 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3dc4017070 con 0x7f3dd40b6910 2024-09-21T03:24:27.946 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.943+0000 7f3dcb7fe640 1 -- 172.21.15.105:0/2352393584 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc4011ca0 con 0x7f3dd40b6910 2024-09-21T03:24:27.946 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.943+0000 7f3dd95df640 1 -- 172.21.15.105:0/2352393584 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dd40aaab0 con 0x7f3dd40b6910 2024-09-21T03:24:27.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.944+0000 7f3dd95df640 1 -- 172.21.15.105:0/2352393584 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dd415b5e0 con 0x7f3dd40b6910 2024-09-21T03:24:27.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.944+0000 7f3dcb7fe640 1 -- 172.21.15.105:0/2352393584 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3dc401c460 con 0x7f3dd40b6910 2024-09-21T03:24:27.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.945+0000 7f3dcb7fe640 1 --2- 172.21.15.105:0/2352393584 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3db4078bc0 0x7f3db407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:27.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.945+0000 7f3dcb7fe640 1 -- 172.21.15.105:0/2352393584 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5853+0+0 (secure 0 0 0) 0x7f3dc409a9e0 con 0x7f3dd40b6910 2024-09-21T03:24:27.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.945+0000 7f3dd27fc640 1 --2- 172.21.15.105:0/2352393584 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3db4078bc0 0x7f3db407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:27.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.946+0000 7f3dd27fc640 1 --2- 172.21.15.105:0/2352393584 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3db4078bc0 0x7f3db407b0d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3dd40b51d0 tx=0x7f3dbc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:27.951 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:27.949+0000 7f3dcb7fe640 1 -- 172.21.15.105:0/2352393584 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3dc4062750 con 0x7f3dd40b6910 2024-09-21T03:24:28.129 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:28.128+0000 7f3dd95df640 1 -- 172.21.15.105:0/2352393584 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3dd40d07a0 con 0x7f3dd40b6910 2024-09-21T03:24:28.938 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:28.936+0000 7f3dcb7fe640 1 -- 172.21.15.105:0/2352393584 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v84) ==== 181+0+0 (secure 0 0 0) 0x7f3dc4067180 con 0x7f3dd40b6910 2024-09-21T03:24:28.938 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_metadata' removed 2024-09-21T03:24:28.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:28.939+0000 7f3dd95df640 1 -- 172.21.15.105:0/2352393584 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3db4078bc0 msgr2=0x7f3db407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:28.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:28.939+0000 7f3dd95df640 1 --2- 172.21.15.105:0/2352393584 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3db4078bc0 0x7f3db407b0d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3dd40b51d0 tx=0x7f3dbc009040 comp rx=0 tx=0).stop 2024-09-21T03:24:28.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:28.939+0000 7f3dd95df640 1 -- 172.21.15.105:0/2352393584 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3dd40b6910 msgr2=0x7f3dd41f99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:28.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:28.939+0000 7f3dd95df640 1 --2- 172.21.15.105:0/2352393584 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3dd40b6910 0x7f3dd41f99b0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f3dc400c430 tx=0x7f3dc400c8f0 comp rx=0 tx=0).stop 2024-09-21T03:24:28.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:28.939+0000 7f3dd95df640 1 -- 172.21.15.105:0/2352393584 shutdown_connections 2024-09-21T03:24:28.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:28.939+0000 7f3dd95df640 1 --2- 172.21.15.105:0/2352393584 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3db4078bc0 0x7f3db407b0d0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:28.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:28.939+0000 7f3dd95df640 1 --2- 172.21.15.105:0/2352393584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3dd40b47c0 0x7f3dd414f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:28.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:28.939+0000 7f3dd95df640 1 --2- 172.21.15.105:0/2352393584 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3dd41527d0 0x7f3dd40b4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:28.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:28.939+0000 7f3dd95df640 1 --2- 172.21.15.105:0/2352393584 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3dd40b6910 0x7f3dd41f99b0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:28.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:28.939+0000 7f3dd95df640 1 -- 172.21.15.105:0/2352393584 >> 172.21.15.105:0/2352393584 conn(0x7f3dd4073d90 msgr2=0x7f3dd4151db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:28.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:28.940+0000 7f3dd95df640 1 -- 172.21.15.105:0/2352393584 shutdown_connections 2024-09-21T03:24:28.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:28.940+0000 7f3dd95df640 1 -- 172.21.15.105:0/2352393584 wait complete. 2024-09-21T03:24:28.955 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T03:24:29.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.081+0000 7f61eb0cc640 1 -- 172.21.15.105:0/792971169 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61cc005320 msgr2=0x7f61cc00b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:29.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.081+0000 7f61eb0cc640 1 --2- 172.21.15.105:0/792971169 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61cc005320 0x7f61cc00b9e0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f61dc005fd0 tx=0x7f61cc005830 comp rx=0 tx=0).stop 2024-09-21T03:24:29.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.081+0000 7f61eb0cc640 1 -- 172.21.15.105:0/792971169 shutdown_connections 2024-09-21T03:24:29.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.081+0000 7f61eb0cc640 1 --2- 172.21.15.105:0/792971169 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61cc005320 0x7f61cc00b9e0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:29.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.081+0000 7f61eb0cc640 1 -- 172.21.15.105:0/792971169 >> 172.21.15.105:0/792971169 conn(0x7f61e40d0130 msgr2=0x7f61e40d0540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:29.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.082+0000 7f61eb0cc640 1 -- 172.21.15.105:0/792971169 shutdown_connections 2024-09-21T03:24:29.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.082+0000 7f61eb0cc640 1 -- 172.21.15.105:0/792971169 wait complete. 2024-09-21T03:24:29.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.083+0000 7f61eb0cc640 1 Processor -- start 2024-09-21T03:24:29.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.083+0000 7f61eb0cc640 1 -- start start 2024-09-21T03:24:29.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.085+0000 7f61eb0cc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61cc005320 0x7f61e414ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:29.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.085+0000 7f61eb0cc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61e414d3d0 0x7f61e414d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:29.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.085+0000 7f61eb0cc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61e414dee0 0x7f61e41f8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:29.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.085+0000 7f61eb0cc640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f61e40af220 con 0x7f61cc005320 2024-09-21T03:24:29.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.085+0000 7f61eb0cc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f61e406efc0 con 0x7f61e414dee0 2024-09-21T03:24:29.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.085+0000 7f61eb0cc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f61e415f090 con 0x7f61e414d3d0 2024-09-21T03:24:29.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.085+0000 7f61e8e68640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61cc005320 0x7f61e414ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:29.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.085+0000 7f61e8e68640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61cc005320 0x7f61e414ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:46094/0 (socket says 172.21.15.105:46094) 2024-09-21T03:24:29.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.085+0000 7f61e8e68640 1 -- 172.21.15.105:0/1844742020 learned_addr learned my addr 172.21.15.105:0/1844742020 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:29.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.085+0000 7f61e9669640 1 --2- 172.21.15.105:0/1844742020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61e414dee0 0x7f61e41f8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:29.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.085+0000 7f61e3fff640 1 --2- 172.21.15.105:0/1844742020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61e414d3d0 0x7f61e414d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:29.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.085+0000 7f61e8e68640 1 -- 172.21.15.105:0/1844742020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61e414d3d0 msgr2=0x7f61e414d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:29.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.085+0000 7f61e8e68640 1 --2- 172.21.15.105:0/1844742020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61e414d3d0 0x7f61e414d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:29.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.085+0000 7f61e8e68640 1 -- 172.21.15.105:0/1844742020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61e414dee0 msgr2=0x7f61e41f8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:29.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.085+0000 7f61e8e68640 1 --2- 172.21.15.105:0/1844742020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61e414dee0 0x7f61e41f8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:29.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.085+0000 7f61e8e68640 1 -- 172.21.15.105:0/1844742020 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61e4159ce0 con 0x7f61cc005320 2024-09-21T03:24:29.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.085+0000 7f61e8e68640 1 --2- 172.21.15.105:0/1844742020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61cc005320 0x7f61e414ce90 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f61d4003d80 tx=0x7f61d4001800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:29.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.085+0000 7f61e17fa640 1 -- 172.21.15.105:0/1844742020 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d4011700 con 0x7f61cc005320 2024-09-21T03:24:29.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.086+0000 7f61e17fa640 1 -- 172.21.15.105:0/1844742020 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61d4016020 con 0x7f61cc005320 2024-09-21T03:24:29.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.086+0000 7f61eb0cc640 1 -- 172.21.15.105:0/1844742020 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61e415d2b0 con 0x7f61cc005320 2024-09-21T03:24:29.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.086+0000 7f61e17fa640 1 -- 172.21.15.105:0/1844742020 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d4011b40 con 0x7f61cc005320 2024-09-21T03:24:29.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.086+0000 7f61eb0cc640 1 -- 172.21.15.105:0/1844742020 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61e415d870 con 0x7f61cc005320 2024-09-21T03:24:29.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.086+0000 7f61eb0cc640 1 -- 172.21.15.105:0/1844742020 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61e415f510 con 0x7f61cc005320 2024-09-21T03:24:29.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.087+0000 7f61e17fa640 1 -- 172.21.15.105:0/1844742020 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f61d4011ce0 con 0x7f61cc005320 2024-09-21T03:24:29.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.088+0000 7f61e17fa640 1 --2- 172.21.15.105:0/1844742020 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f61d0078b90 0x7f61d007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:29.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.088+0000 7f61e17fa640 1 -- 172.21.15.105:0/1844742020 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5415+0+0 (secure 0 0 0) 0x7f61d409b620 con 0x7f61cc005320 2024-09-21T03:24:29.091 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.088+0000 7f61e3fff640 1 --2- 172.21.15.105:0/1844742020 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f61d0078b90 0x7f61d007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:29.091 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.089+0000 7f61e3fff640 1 --2- 172.21.15.105:0/1844742020 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f61d0078b90 0x7f61d007b0a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f61e409e150 tx=0x7f61d8000ed0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:29.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.092+0000 7f61e17fa640 1 -- 172.21.15.105:0/1844742020 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f61d4020030 con 0x7f61cc005320 2024-09-21T03:24:29.271 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.269+0000 7f61eb0cc640 1 -- 172.21.15.105:0/1844742020 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f61e40c39e0 con 0x7f61cc005320 2024-09-21T03:24:29.950 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.948+0000 7f61e17fa640 1 -- 172.21.15.105:0/1844742020 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v85) ==== 169+0+0 (secure 0 0 0) 0x7f61e4159ce0 con 0x7f61cc005320 2024-09-21T03:24:29.950 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_data' removed 2024-09-21T03:24:29.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.951+0000 7f61eb0cc640 1 -- 172.21.15.105:0/1844742020 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f61d0078b90 msgr2=0x7f61d007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:29.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.951+0000 7f61eb0cc640 1 --2- 172.21.15.105:0/1844742020 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f61d0078b90 0x7f61d007b0a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f61e409e150 tx=0x7f61d8000ed0 comp rx=0 tx=0).stop 2024-09-21T03:24:29.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.951+0000 7f61eb0cc640 1 -- 172.21.15.105:0/1844742020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61cc005320 msgr2=0x7f61e414ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:29.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.951+0000 7f61eb0cc640 1 --2- 172.21.15.105:0/1844742020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61cc005320 0x7f61e414ce90 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f61d4003d80 tx=0x7f61d4001800 comp rx=0 tx=0).stop 2024-09-21T03:24:29.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.952+0000 7f61eb0cc640 1 -- 172.21.15.105:0/1844742020 shutdown_connections 2024-09-21T03:24:29.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.952+0000 7f61eb0cc640 1 --2- 172.21.15.105:0/1844742020 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f61d0078b90 0x7f61d007b0a0 secure :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f61e409e150 tx=0x7f61d8000ed0 comp rx=0 tx=0).stop 2024-09-21T03:24:29.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.952+0000 7f61eb0cc640 1 --2- 172.21.15.105:0/1844742020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61e414dee0 0x7f61e41f8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:29.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.952+0000 7f61eb0cc640 1 --2- 172.21.15.105:0/1844742020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61e414d3d0 0x7f61e414d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:29.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.952+0000 7f61eb0cc640 1 --2- 172.21.15.105:0/1844742020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61cc005320 0x7f61e414ce90 secure :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f61d4003d80 tx=0x7f61d4001800 comp rx=0 tx=0).stop 2024-09-21T03:24:29.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.952+0000 7f61eb0cc640 1 -- 172.21.15.105:0/1844742020 >> 172.21.15.105:0/1844742020 conn(0x7f61e40d0130 msgr2=0x7f61e40cdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:29.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.953+0000 7f61eb0cc640 1 -- 172.21.15.105:0/1844742020 shutdown_connections 2024-09-21T03:24:29.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:29.953+0000 7f61eb0cc640 1 -- 172.21.15.105:0/1844742020 wait complete. 2024-09-21T03:24:29.968 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-21T03:24:30.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.081+0000 7fc54c494640 1 -- 172.21.15.105:0/3973758994 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5440ca800 msgr2=0x7fc5440cba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:30.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.081+0000 7fc54c494640 1 --2- 172.21.15.105:0/3973758994 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5440ca800 0x7fc5440cba00 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fc54409e2e0 tx=0x7fc54002a560 comp rx=0 tx=0).stop 2024-09-21T03:24:30.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.081+0000 7fc54c494640 1 -- 172.21.15.105:0/3973758994 shutdown_connections 2024-09-21T03:24:30.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.081+0000 7fc54c494640 1 --2- 172.21.15.105:0/3973758994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5440704e0 0x7fc5440cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:30.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.081+0000 7fc54c494640 1 --2- 172.21.15.105:0/3973758994 >> v2:172.21.15.162:3300/0 conn(0x7fc5440cad30 0x7fc54406ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:30.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.081+0000 7fc54c494640 1 --2- 172.21.15.105:0/3973758994 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5440ca800 0x7fc5440cba00 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:30.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.081+0000 7fc54c494640 1 -- 172.21.15.105:0/3973758994 >> 172.21.15.105:0/3973758994 conn(0x7fc5440b1cb0 msgr2=0x7fc5440b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:30.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.081+0000 7fc54c494640 1 -- 172.21.15.105:0/3973758994 shutdown_connections 2024-09-21T03:24:30.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.081+0000 7fc54c494640 1 -- 172.21.15.105:0/3973758994 wait complete. 2024-09-21T03:24:30.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.083+0000 7fc54c494640 1 Processor -- start 2024-09-21T03:24:30.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.083+0000 7fc54c494640 1 -- start start 2024-09-21T03:24:30.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.084+0000 7fc54c494640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5440704e0 0x7fc54409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:30.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.084+0000 7fc54c494640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5440ca800 0x7fc5440c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:30.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.084+0000 7fc54c494640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5440cad30 0x7fc54409c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:30.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.084+0000 7fc54c494640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc5440cd140 con 0x7fc5440cad30 2024-09-21T03:24:30.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.084+0000 7fc54c494640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc5440ccfc0 con 0x7fc5440704e0 2024-09-21T03:24:30.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.084+0000 7fc54c494640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc5440cd2c0 con 0x7fc5440ca800 2024-09-21T03:24:30.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.084+0000 7fc54aa31640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5440cad30 0x7fc54409c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:30.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.084+0000 7fc54aa31640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5440cad30 0x7fc54409c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:46114/0 (socket says 172.21.15.105:46114) 2024-09-21T03:24:30.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.085+0000 7fc54aa31640 1 -- 172.21.15.105:0/1449814676 learned_addr learned my addr 172.21.15.105:0/1449814676 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:30.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.085+0000 7fc54a230640 1 --2- 172.21.15.105:0/1449814676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5440704e0 0x7fc54409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:30.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.085+0000 7fc549a2f640 1 --2- 172.21.15.105:0/1449814676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5440ca800 0x7fc5440c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:30.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.085+0000 7fc54aa31640 1 -- 172.21.15.105:0/1449814676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5440ca800 msgr2=0x7fc5440c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:30.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.085+0000 7fc54aa31640 1 --2- 172.21.15.105:0/1449814676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5440ca800 0x7fc5440c89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:30.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.085+0000 7fc54aa31640 1 -- 172.21.15.105:0/1449814676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5440704e0 msgr2=0x7fc54409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:30.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.085+0000 7fc54aa31640 1 --2- 172.21.15.105:0/1449814676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5440704e0 0x7fc54409aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:30.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.085+0000 7fc54aa31640 1 -- 172.21.15.105:0/1449814676 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc54409b3a0 con 0x7fc5440cad30 2024-09-21T03:24:30.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.085+0000 7fc54aa31640 1 --2- 172.21.15.105:0/1449814676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5440cad30 0x7fc54409c740 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fc53c00e9c0 tx=0x7fc53c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:30.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.085+0000 7fc53affd640 1 -- 172.21.15.105:0/1449814676 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53c004d20 con 0x7fc5440cad30 2024-09-21T03:24:30.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.085+0000 7fc53affd640 1 -- 172.21.15.105:0/1449814676 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc53c00cb20 con 0x7fc5440cad30 2024-09-21T03:24:30.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.085+0000 7fc54c494640 1 -- 172.21.15.105:0/1449814676 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc54409b680 con 0x7fc5440cad30 2024-09-21T03:24:30.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.085+0000 7fc53affd640 1 -- 172.21.15.105:0/1449814676 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53c005020 con 0x7fc5440cad30 2024-09-21T03:24:30.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.085+0000 7fc54c494640 1 -- 172.21.15.105:0/1449814676 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc54409bc40 con 0x7fc5440cad30 2024-09-21T03:24:30.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.086+0000 7fc54c494640 1 -- 172.21.15.105:0/1449814676 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc54409b0f0 con 0x7fc5440cad30 2024-09-21T03:24:30.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.087+0000 7fc53affd640 1 -- 172.21.15.105:0/1449814676 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc53c0051c0 con 0x7fc5440cad30 2024-09-21T03:24:30.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.087+0000 7fc53affd640 1 --2- 172.21.15.105:0/1449814676 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc528078b90 0x7fc52807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:30.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.088+0000 7fc53affd640 1 -- 172.21.15.105:0/1449814676 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 4943+0+0 (secure 0 0 0) 0x7fc53c09b220 con 0x7fc5440cad30 2024-09-21T03:24:30.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.088+0000 7fc54a230640 1 --2- 172.21.15.105:0/1449814676 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc528078b90 0x7fc52807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:30.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.088+0000 7fc54a230640 1 --2- 172.21.15.105:0/1449814676 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc528078b90 0x7fc52807b0a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc540033000 tx=0x7fc540004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:30.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.092+0000 7fc53affd640 1 -- 172.21.15.105:0/1449814676 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc53c016030 con 0x7fc5440cad30 2024-09-21T03:24:30.272 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.271+0000 7fc54c494640 1 -- 172.21.15.105:0/1449814676 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7fc5440cba00 con 0x7fc5440cad30 2024-09-21T03:24:30.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.275+0000 7fc53affd640 1 -- 172.21.15.105:0/1449814676 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v48) ==== 71+0+0 (secure 0 0 0) 0x7fc53c0633a0 con 0x7fc5440cad30 2024-09-21T03:24:30.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.277+0000 7fc54c494640 1 -- 172.21.15.105:0/1449814676 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc528078b90 msgr2=0x7fc52807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:30.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.277+0000 7fc54c494640 1 --2- 172.21.15.105:0/1449814676 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc528078b90 0x7fc52807b0a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc540033000 tx=0x7fc540004730 comp rx=0 tx=0).stop 2024-09-21T03:24:30.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.277+0000 7fc54c494640 1 -- 172.21.15.105:0/1449814676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5440cad30 msgr2=0x7fc54409c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:30.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.277+0000 7fc54c494640 1 --2- 172.21.15.105:0/1449814676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5440cad30 0x7fc54409c740 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fc53c00e9c0 tx=0x7fc53c00ee80 comp rx=0 tx=0).stop 2024-09-21T03:24:30.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.278+0000 7fc54c494640 1 -- 172.21.15.105:0/1449814676 shutdown_connections 2024-09-21T03:24:30.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.278+0000 7fc54c494640 1 --2- 172.21.15.105:0/1449814676 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc528078b90 0x7fc52807b0a0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:30.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.278+0000 7fc54c494640 1 --2- 172.21.15.105:0/1449814676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5440cad30 0x7fc54409c740 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:30.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.278+0000 7fc54c494640 1 --2- 172.21.15.105:0/1449814676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5440ca800 0x7fc5440c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:30.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.278+0000 7fc54c494640 1 --2- 172.21.15.105:0/1449814676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5440704e0 0x7fc54409aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:30.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.278+0000 7fc54c494640 1 -- 172.21.15.105:0/1449814676 >> 172.21.15.105:0/1449814676 conn(0x7fc5440b1cb0 msgr2=0x7fc5440d0760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:30.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.278+0000 7fc54c494640 1 -- 172.21.15.105:0/1449814676 shutdown_connections 2024-09-21T03:24:30.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.278+0000 7fc54c494640 1 -- 172.21.15.105:0/1449814676 wait complete. 2024-09-21T03:24:30.290 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_min_caps_working_set' 2024-09-21T03:24:30.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.401+0000 7f6612dda640 1 -- 172.21.15.105:0/921986079 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f660c0d0e50 msgr2=0x7f660c0d1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:30.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.401+0000 7f6612dda640 1 --2- 172.21.15.105:0/921986079 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f660c0d0e50 0x7f660c0d1260 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f6604005fd0 tx=0x7f660402a780 comp rx=0 tx=0).stop 2024-09-21T03:24:30.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.401+0000 7f6612dda640 1 -- 172.21.15.105:0/921986079 shutdown_connections 2024-09-21T03:24:30.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.401+0000 7f6612dda640 1 --2- 172.21.15.105:0/921986079 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f660c0d0e50 0x7f660c0d1260 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:30.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.401+0000 7f6612dda640 1 --2- 172.21.15.105:0/921986079 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f660c0b97e0 0x7f660c06f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:30.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.401+0000 7f6612dda640 1 -- 172.21.15.105:0/921986079 >> 172.21.15.105:0/921986079 conn(0x7f660c09d840 msgr2=0x7f660c08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:30.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.401+0000 7f6612dda640 1 -- 172.21.15.105:0/921986079 shutdown_connections 2024-09-21T03:24:30.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.401+0000 7f6612dda640 1 -- 172.21.15.105:0/921986079 wait complete. 2024-09-21T03:24:30.404 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.402+0000 7f6612dda640 1 Processor -- start 2024-09-21T03:24:30.404 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.402+0000 7f6612dda640 1 -- start start 2024-09-21T03:24:30.406 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.404+0000 7f6612dda640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f660c06e0a0 0x7f660c1514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:30.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.404+0000 7f6612dda640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f660c0b97e0 0x7f660c153cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:30.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.404+0000 7f6612dda640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f660c0d0e50 0x7f660c1f96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:30.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.404+0000 7f6612dda640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f660c0cfea0 con 0x7f660c0d0e50 2024-09-21T03:24:30.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.404+0000 7f6612dda640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f660c0cfd20 con 0x7f660c0b97e0 2024-09-21T03:24:30.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.404+0000 7f6612dda640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f660c0d0020 con 0x7f660c06e0a0 2024-09-21T03:24:30.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.404+0000 7f6611377640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f660c0d0e50 0x7f660c1f96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:30.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.404+0000 7f6611377640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f660c0d0e50 0x7f660c1f96f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:46138/0 (socket says 172.21.15.105:46138) 2024-09-21T03:24:30.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.404+0000 7f6611377640 1 -- 172.21.15.105:0/3246860735 learned_addr learned my addr 172.21.15.105:0/3246860735 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:30.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.404+0000 7f6610b76640 1 --2- 172.21.15.105:0/3246860735 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f660c06e0a0 0x7f660c1514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:30.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.404+0000 7f660bfff640 1 --2- 172.21.15.105:0/3246860735 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f660c0b97e0 0x7f660c153cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:30.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.404+0000 7f6611377640 1 -- 172.21.15.105:0/3246860735 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f660c06e0a0 msgr2=0x7f660c1514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:30.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.404+0000 7f6611377640 1 --2- 172.21.15.105:0/3246860735 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f660c06e0a0 0x7f660c1514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:30.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.404+0000 7f6611377640 1 -- 172.21.15.105:0/3246860735 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f660c0b97e0 msgr2=0x7f660c153cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:30.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.404+0000 7f6611377640 1 --2- 172.21.15.105:0/3246860735 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f660c0b97e0 0x7f660c153cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:30.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.404+0000 7f6611377640 1 -- 172.21.15.105:0/3246860735 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f660c1f8f10 con 0x7f660c0d0e50 2024-09-21T03:24:30.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.404+0000 7f6611377640 1 --2- 172.21.15.105:0/3246860735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f660c0d0e50 0x7f660c1f96f0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f6604005fd0 tx=0x7f6604003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:30.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.405+0000 7f66097fa640 1 -- 172.21.15.105:0/3246860735 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6604040070 con 0x7f660c0d0e50 2024-09-21T03:24:30.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.405+0000 7f66097fa640 1 -- 172.21.15.105:0/3246860735 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6604004540 con 0x7f660c0d0e50 2024-09-21T03:24:30.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.405+0000 7f6612dda640 1 -- 172.21.15.105:0/3246860735 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f660c154740 con 0x7f660c0d0e50 2024-09-21T03:24:30.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.405+0000 7f66097fa640 1 -- 172.21.15.105:0/3246860735 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f660403c420 con 0x7f660c0d0e50 2024-09-21T03:24:30.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.405+0000 7f6612dda640 1 -- 172.21.15.105:0/3246860735 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f660c1f91d0 con 0x7f660c0d0e50 2024-09-21T03:24:30.409 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.406+0000 7f6612dda640 1 -- 172.21.15.105:0/3246860735 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f660c1544b0 con 0x7f660c0d0e50 2024-09-21T03:24:30.409 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.406+0000 7f66097fa640 1 -- 172.21.15.105:0/3246860735 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6604043070 con 0x7f660c0d0e50 2024-09-21T03:24:30.409 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.407+0000 7f66097fa640 1 --2- 172.21.15.105:0/3246860735 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f65f8078b90 0x7f65f807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:30.409 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.407+0000 7f66097fa640 1 -- 172.21.15.105:0/3246860735 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 4943+0+0 (secure 0 0 0) 0x7f66040bbe20 con 0x7f660c0d0e50 2024-09-21T03:24:30.409 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.407+0000 7f6610b76640 1 --2- 172.21.15.105:0/3246860735 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f65f8078b90 0x7f65f807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:30.409 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.408+0000 7f6610b76640 1 --2- 172.21.15.105:0/3246860735 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f65f8078b90 0x7f65f807b0a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f65fc0015b0 tx=0x7f65fc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:30.413 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.412+0000 7f66097fa640 1 -- 172.21.15.105:0/3246860735 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f66040845f0 con 0x7f660c0d0e50 2024-09-21T03:24:30.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.657+0000 7f6612dda640 1 -- 172.21.15.105:0/3246860735 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_min_caps_working_set"]} v 0) -- 0x7f660c0d0420 con 0x7f660c0d0e50 2024-09-21T03:24:30.951 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.949+0000 7f66097fa640 1 -- 172.21.15.105:0/3246860735 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_min_caps_working_set"]}]=0 v296) ==== 160+0+0 (secure 0 0 0) 0x7f6604083ef0 con 0x7f660c0d0e50 2024-09-21T03:24:30.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.952+0000 7f6612dda640 1 -- 172.21.15.105:0/3246860735 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f65f8078b90 msgr2=0x7f65f807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:30.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.952+0000 7f6612dda640 1 --2- 172.21.15.105:0/3246860735 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f65f8078b90 0x7f65f807b0a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f65fc0015b0 tx=0x7f65fc009040 comp rx=0 tx=0).stop 2024-09-21T03:24:30.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.952+0000 7f6612dda640 1 -- 172.21.15.105:0/3246860735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f660c0d0e50 msgr2=0x7f660c1f96f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:30.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.952+0000 7f6612dda640 1 --2- 172.21.15.105:0/3246860735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f660c0d0e50 0x7f660c1f96f0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f6604005fd0 tx=0x7f6604003ce0 comp rx=0 tx=0).stop 2024-09-21T03:24:30.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.952+0000 7f6612dda640 1 -- 172.21.15.105:0/3246860735 shutdown_connections 2024-09-21T03:24:30.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.952+0000 7f6612dda640 1 --2- 172.21.15.105:0/3246860735 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f65f8078b90 0x7f65f807b0a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:30.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.952+0000 7f6612dda640 1 --2- 172.21.15.105:0/3246860735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f660c0d0e50 0x7f660c1f96f0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:30.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.952+0000 7f6612dda640 1 --2- 172.21.15.105:0/3246860735 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f660c0b97e0 0x7f660c153cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:30.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.952+0000 7f6612dda640 1 --2- 172.21.15.105:0/3246860735 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f660c06e0a0 0x7f660c1514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:30.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.952+0000 7f6612dda640 1 -- 172.21.15.105:0/3246860735 >> 172.21.15.105:0/3246860735 conn(0x7f660c09d840 msgr2=0x7f660c06e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:30.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.952+0000 7f6612dda640 1 -- 172.21.15.105:0/3246860735 shutdown_connections 2024-09-21T03:24:30.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:30.952+0000 7f6612dda640 1 -- 172.21.15.105:0/3246860735 wait complete. 2024-09-21T03:24:30.965 INFO:tasks.cephfs_test_runner:When a client has inodes pinned in its cache (open files), that the MDS ... ok 2024-09-21T03:24:30.965 INFO:tasks.cephfs_test_runner:Starting test: test_client_oldest_tid (tasks.cephfs.test_client_limits.TestClientLimits) When a client does not advance its oldest tid, the MDS should notice that 2024-09-21T03:24:30.965 INFO:tasks.cephfs_test_runner:test_client_oldest_tid (tasks.cephfs.test_client_limits.TestClientLimits) 2024-09-21T03:24:30.966 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:24:31.079 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.077+0000 7fcd3af32640 1 -- 172.21.15.105:0/1484246856 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd340cf320 msgr2=0x7fcd340d0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:31.079 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.077+0000 7fcd3af32640 1 --2- 172.21.15.105:0/1484246856 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd340cf320 0x7fcd340d0980 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fcd34074af0 tx=0x7fcd2c02a560 comp rx=0 tx=0).stop 2024-09-21T03:24:31.079 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.077+0000 7fcd3af32640 1 -- 172.21.15.105:0/1484246856 shutdown_connections 2024-09-21T03:24:31.079 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.077+0000 7fcd3af32640 1 --2- 172.21.15.105:0/1484246856 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd340cf320 0x7fcd340d0980 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:31.079 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.077+0000 7fcd3af32640 1 --2- 172.21.15.105:0/1484246856 >> v2:172.21.15.162:3300/0 conn(0x7fcd341600b0 0x7fcd340ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:31.079 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.077+0000 7fcd3af32640 1 -- 172.21.15.105:0/1484246856 >> 172.21.15.105:0/1484246856 conn(0x7fcd3406d4f0 msgr2=0x7fcd34071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:31.079 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.077+0000 7fcd3af32640 1 -- 172.21.15.105:0/1484246856 shutdown_connections 2024-09-21T03:24:31.079 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.077+0000 7fcd3af32640 1 -- 172.21.15.105:0/1484246856 wait complete. 2024-09-21T03:24:31.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.079+0000 7fcd3af32640 1 Processor -- start 2024-09-21T03:24:31.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.079+0000 7fcd3af32640 1 -- start start 2024-09-21T03:24:31.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.080+0000 7fcd3af32640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd340b7cc0 0x7fcd3414f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:31.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.080+0000 7fcd3af32640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd340cf320 0x7fcd340c9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:31.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.080+0000 7fcd3af32640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd341600b0 0x7fcd340c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:31.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.080+0000 7fcd3af32640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcd340d13c0 con 0x7fcd341600b0 2024-09-21T03:24:31.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.080+0000 7fcd3af32640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcd340d1240 con 0x7fcd340b7cc0 2024-09-21T03:24:31.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.080+0000 7fcd3af32640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcd340d1540 con 0x7fcd340cf320 2024-09-21T03:24:31.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.080+0000 7fcd394cf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd341600b0 0x7fcd340c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:31.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.080+0000 7fcd394cf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd341600b0 0x7fcd340c9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:46154/0 (socket says 172.21.15.105:46154) 2024-09-21T03:24:31.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.080+0000 7fcd394cf640 1 -- 172.21.15.105:0/716474517 learned_addr learned my addr 172.21.15.105:0/716474517 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:31.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.080+0000 7fcd38cce640 1 --2- 172.21.15.105:0/716474517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd340b7cc0 0x7fcd3414f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:31.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.080+0000 7fcd33fff640 1 --2- 172.21.15.105:0/716474517 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd340cf320 0x7fcd340c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:31.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.080+0000 7fcd394cf640 1 -- 172.21.15.105:0/716474517 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd340cf320 msgr2=0x7fcd340c9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:31.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.080+0000 7fcd394cf640 1 --2- 172.21.15.105:0/716474517 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd340cf320 0x7fcd340c9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:31.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.080+0000 7fcd394cf640 1 -- 172.21.15.105:0/716474517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd340b7cc0 msgr2=0x7fcd3414f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:31.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.080+0000 7fcd394cf640 1 --2- 172.21.15.105:0/716474517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd340b7cc0 0x7fcd3414f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:31.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.080+0000 7fcd394cf640 1 -- 172.21.15.105:0/716474517 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd3414fbd0 con 0x7fcd341600b0 2024-09-21T03:24:31.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.081+0000 7fcd394cf640 1 --2- 172.21.15.105:0/716474517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd341600b0 0x7fcd340c9a80 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c009230 tx=0x7fcd2c003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:31.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.081+0000 7fcd317fa640 1 -- 172.21.15.105:0/716474517 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c03e030 con 0x7fcd341600b0 2024-09-21T03:24:31.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.081+0000 7fcd317fa640 1 -- 172.21.15.105:0/716474517 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd2c003e50 con 0x7fcd341600b0 2024-09-21T03:24:31.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.081+0000 7fcd3af32640 1 -- 172.21.15.105:0/716474517 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd340caf70 con 0x7fcd341600b0 2024-09-21T03:24:31.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.081+0000 7fcd317fa640 1 -- 172.21.15.105:0/716474517 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c035040 con 0x7fcd341600b0 2024-09-21T03:24:31.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.081+0000 7fcd3af32640 1 -- 172.21.15.105:0/716474517 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd340cb530 con 0x7fcd341600b0 2024-09-21T03:24:31.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.082+0000 7fcd3af32640 1 -- 172.21.15.105:0/716474517 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd340d1a60 con 0x7fcd341600b0 2024-09-21T03:24:31.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.083+0000 7fcd317fa640 1 -- 172.21.15.105:0/716474517 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcd2c041030 con 0x7fcd341600b0 2024-09-21T03:24:31.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.083+0000 7fcd317fa640 1 --2- 172.21.15.105:0/716474517 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcd20078b90 0x7fcd2007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:31.086 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.083+0000 7fcd317fa640 1 -- 172.21.15.105:0/716474517 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 4943+0+0 (secure 0 0 0) 0x7fcd2c0bb2d0 con 0x7fcd341600b0 2024-09-21T03:24:31.086 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.083+0000 7fcd38cce640 1 --2- 172.21.15.105:0/716474517 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcd20078b90 0x7fcd2007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:31.086 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.084+0000 7fcd38cce640 1 --2- 172.21.15.105:0/716474517 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcd20078b90 0x7fcd2007b0a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fcd240058c0 tx=0x7fcd24005d80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:31.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.088+0000 7fcd317fa640 1 -- 172.21.15.105:0/716474517 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fcd2c083ab0 con 0x7fcd341600b0 2024-09-21T03:24:31.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.264+0000 7fcd3af32640 1 -- 172.21.15.105:0/716474517 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcd340c9ff0 con 0x7fcd341600b0 2024-09-21T03:24:31.266 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.265+0000 7fcd317fa640 1 -- 172.21.15.105:0/716474517 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+13107 (secure 0 0 0) 0x7fcd2c0833b0 con 0x7fcd341600b0 2024-09-21T03:24:31.266 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:24:31.266 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":85,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:24:29.944232+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.105:6835/2722940718":"2024-09-22T03:24:26.799788+0000","172.21.15.105:6833/2722940718":"2024-09-22T03:24:26.799788+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:24:31.269 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.267+0000 7fcd3af32640 1 -- 172.21.15.105:0/716474517 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcd20078b90 msgr2=0x7fcd2007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:31.269 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.267+0000 7fcd3af32640 1 --2- 172.21.15.105:0/716474517 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcd20078b90 0x7fcd2007b0a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fcd240058c0 tx=0x7fcd24005d80 comp rx=0 tx=0).stop 2024-09-21T03:24:31.269 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.267+0000 7fcd3af32640 1 -- 172.21.15.105:0/716474517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd341600b0 msgr2=0x7fcd340c9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:31.269 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.267+0000 7fcd3af32640 1 --2- 172.21.15.105:0/716474517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd341600b0 0x7fcd340c9a80 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c009230 tx=0x7fcd2c003960 comp rx=0 tx=0).stop 2024-09-21T03:24:31.269 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.267+0000 7fcd3af32640 1 -- 172.21.15.105:0/716474517 shutdown_connections 2024-09-21T03:24:31.269 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.267+0000 7fcd3af32640 1 --2- 172.21.15.105:0/716474517 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcd20078b90 0x7fcd2007b0a0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:31.270 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.267+0000 7fcd3af32640 1 --2- 172.21.15.105:0/716474517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd341600b0 0x7fcd340c9a80 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:31.270 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.267+0000 7fcd3af32640 1 --2- 172.21.15.105:0/716474517 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd340cf320 0x7fcd340c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:31.270 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.267+0000 7fcd3af32640 1 --2- 172.21.15.105:0/716474517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd340b7cc0 0x7fcd3414f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:31.270 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.267+0000 7fcd3af32640 1 -- 172.21.15.105:0/716474517 >> 172.21.15.105:0/716474517 conn(0x7fcd3406d4f0 msgr2=0x7fcd3415ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:31.270 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.267+0000 7fcd3af32640 1 -- 172.21.15.105:0/716474517 shutdown_connections 2024-09-21T03:24:31.270 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.267+0000 7fcd3af32640 1 -- 172.21.15.105:0/716474517 wait complete. 2024-09-21T03:24:31.280 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T03:18:19.296947+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T03:24:31.280 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T03:24:31.396 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.395+0000 7fa29d757640 1 -- 172.21.15.105:0/4274993355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2980d2ed0 msgr2=0x7fa2980d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:31.397 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.395+0000 7fa29d757640 1 --2- 172.21.15.105:0/4274993355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2980d2ed0 0x7fa2980d1a80 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fa29808d4e0 tx=0x7fa28802a940 comp rx=0 tx=0).stop 2024-09-21T03:24:31.397 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.395+0000 7fa29d757640 1 -- 172.21.15.105:0/4274993355 shutdown_connections 2024-09-21T03:24:31.397 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.395+0000 7fa29d757640 1 --2- 172.21.15.105:0/4274993355 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2980cf7a0 0x7fa2981626e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:31.397 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.395+0000 7fa29d757640 1 --2- 172.21.15.105:0/4274993355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2980d2ed0 0x7fa2980d1a80 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:31.397 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.395+0000 7fa29d757640 1 -- 172.21.15.105:0/4274993355 >> 172.21.15.105:0/4274993355 conn(0x7fa29808bfc0 msgr2=0x7fa29809d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:31.397 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.395+0000 7fa29d757640 1 -- 172.21.15.105:0/4274993355 shutdown_connections 2024-09-21T03:24:31.397 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.395+0000 7fa29d757640 1 -- 172.21.15.105:0/4274993355 wait complete. 2024-09-21T03:24:31.398 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.397+0000 7fa29d757640 1 Processor -- start 2024-09-21T03:24:31.398 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.397+0000 7fa29d757640 1 -- start start 2024-09-21T03:24:31.400 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.398+0000 7fa29d757640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2980b9b70 0x7fa2981f94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:31.400 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.398+0000 7fa29d757640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2980cf7a0 0x7fa298153bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:31.400 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.398+0000 7fa29d757640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2980d2ed0 0x7fa2980b2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:31.400 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.398+0000 7fa29d757640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa298162da0 con 0x7fa2980b9b70 2024-09-21T03:24:31.400 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.398+0000 7fa29d757640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa298162c20 con 0x7fa2980d2ed0 2024-09-21T03:24:31.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.398+0000 7fa29d757640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa298162f20 con 0x7fa2980cf7a0 2024-09-21T03:24:31.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.398+0000 7fa296ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2980b9b70 0x7fa2981f94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:31.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.398+0000 7fa296ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2980b9b70 0x7fa2981f94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:33616/0 (socket says 172.21.15.105:33616) 2024-09-21T03:24:31.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.398+0000 7fa296ffd640 1 -- 172.21.15.105:0/160508336 learned_addr learned my addr 172.21.15.105:0/160508336 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:31.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.398+0000 7fa296ffd640 1 -- 172.21.15.105:0/160508336 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2980cf7a0 msgr2=0x7fa298153bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:31.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.398+0000 7fa296ffd640 1 --2- 172.21.15.105:0/160508336 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2980cf7a0 0x7fa298153bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:31.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.398+0000 7fa296ffd640 1 -- 172.21.15.105:0/160508336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2980d2ed0 msgr2=0x7fa2980b2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:31.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.398+0000 7fa296ffd640 1 --2- 172.21.15.105:0/160508336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2980d2ed0 0x7fa2980b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:31.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.398+0000 7fa296ffd640 1 -- 172.21.15.105:0/160508336 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2981546b0 con 0x7fa2980b9b70 2024-09-21T03:24:31.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.398+0000 7fa296ffd640 1 --2- 172.21.15.105:0/160508336 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2980b9b70 0x7fa2981f94b0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fa288000f80 tx=0x7fa288031da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:31.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.398+0000 7fa27f7fe640 1 -- 172.21.15.105:0/160508336 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa288034050 con 0x7fa2980b9b70 2024-09-21T03:24:31.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.399+0000 7fa27f7fe640 1 -- 172.21.15.105:0/160508336 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa288004e30 con 0x7fa2980b9b70 2024-09-21T03:24:31.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.399+0000 7fa27f7fe640 1 -- 172.21.15.105:0/160508336 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa288004490 con 0x7fa2980b9b70 2024-09-21T03:24:31.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.399+0000 7fa29d757640 1 -- 172.21.15.105:0/160508336 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2981f99f0 con 0x7fa2980b9b70 2024-09-21T03:24:31.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.399+0000 7fa29d757640 1 -- 172.21.15.105:0/160508336 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2981f9cc0 con 0x7fa2980b9b70 2024-09-21T03:24:31.402 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.400+0000 7fa29d757640 1 -- 172.21.15.105:0/160508336 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2981634b0 con 0x7fa2980b9b70 2024-09-21T03:24:31.402 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.400+0000 7fa27f7fe640 1 -- 172.21.15.105:0/160508336 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa288037020 con 0x7fa2980b9b70 2024-09-21T03:24:31.402 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.401+0000 7fa27f7fe640 1 --2- 172.21.15.105:0/160508336 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa284078b90 0x7fa28407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:31.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.401+0000 7fa27f7fe640 1 -- 172.21.15.105:0/160508336 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 4943+0+0 (secure 0 0 0) 0x7fa2880bbbf0 con 0x7fa2980b9b70 2024-09-21T03:24:31.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.401+0000 7fa2967fc640 1 --2- 172.21.15.105:0/160508336 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa284078b90 0x7fa28407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:31.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.402+0000 7fa2967fc640 1 --2- 172.21.15.105:0/160508336 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa284078b90 0x7fa28407b0a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa2980b5750 tx=0x7fa28c006ba0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:31.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.405+0000 7fa27f7fe640 1 -- 172.21.15.105:0/160508336 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa288084330 con 0x7fa2980b9b70 2024-09-21T03:24:31.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.580+0000 7fa29d757640 1 -- 172.21.15.105:0/160508336 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa2980c7c70 con 0x7fa2980b9b70 2024-09-21T03:24:31.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.581+0000 7fa27f7fe640 1 -- 172.21.15.105:0/160508336 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) ==== 93+0+10 (secure 0 0 0) 0x7fa288083c30 con 0x7fa2980b9b70 2024-09-21T03:24:31.582 INFO:teuthology.orchestra.run.smithi105.stdout:pg_num: 1 2024-09-21T03:24:31.585 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.583+0000 7fa29d757640 1 -- 172.21.15.105:0/160508336 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa284078b90 msgr2=0x7fa28407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:31.585 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.583+0000 7fa29d757640 1 --2- 172.21.15.105:0/160508336 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa284078b90 0x7fa28407b0a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa2980b5750 tx=0x7fa28c006ba0 comp rx=0 tx=0).stop 2024-09-21T03:24:31.585 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.583+0000 7fa29d757640 1 -- 172.21.15.105:0/160508336 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2980b9b70 msgr2=0x7fa2981f94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:31.585 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.583+0000 7fa29d757640 1 --2- 172.21.15.105:0/160508336 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2980b9b70 0x7fa2981f94b0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fa288000f80 tx=0x7fa288031da0 comp rx=0 tx=0).stop 2024-09-21T03:24:31.585 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.583+0000 7fa29d757640 1 -- 172.21.15.105:0/160508336 shutdown_connections 2024-09-21T03:24:31.585 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.583+0000 7fa29d757640 1 --2- 172.21.15.105:0/160508336 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa284078b90 0x7fa28407b0a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:31.585 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.583+0000 7fa29d757640 1 --2- 172.21.15.105:0/160508336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2980d2ed0 0x7fa2980b2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:31.585 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.583+0000 7fa29d757640 1 --2- 172.21.15.105:0/160508336 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2980cf7a0 0x7fa298153bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:31.585 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.583+0000 7fa29d757640 1 --2- 172.21.15.105:0/160508336 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2980b9b70 0x7fa2981f94b0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:31.585 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.583+0000 7fa29d757640 1 -- 172.21.15.105:0/160508336 >> 172.21.15.105:0/160508336 conn(0x7fa29808bfc0 msgr2=0x7fa2980d3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:31.585 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.583+0000 7fa29d757640 1 -- 172.21.15.105:0/160508336 shutdown_connections 2024-09-21T03:24:31.585 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.583+0000 7fa29d757640 1 -- 172.21.15.105:0/160508336 wait complete. 2024-09-21T03:24:31.596 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_oldest_tid' 2024-09-21T03:24:31.708 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.706+0000 7f21e7a07640 1 -- 172.21.15.105:0/2377929448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21e00b7cc0 msgr2=0x7f21e00cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:31.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.706+0000 7f21e7a07640 1 --2- 172.21.15.105:0/2377929448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21e00b7cc0 0x7f21e00cec10 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f21e0074fd0 tx=0x7f21d002a560 comp rx=0 tx=0).stop 2024-09-21T03:24:31.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.707+0000 7f21e7a07640 1 -- 172.21.15.105:0/2377929448 shutdown_connections 2024-09-21T03:24:31.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.707+0000 7f21e7a07640 1 --2- 172.21.15.105:0/2377929448 >> v2:172.21.15.162:3300/0 conn(0x7f21e00cf150 0x7f21e00b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:31.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.707+0000 7f21e7a07640 1 --2- 172.21.15.105:0/2377929448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21e00b7cc0 0x7f21e00cec10 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:31.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.707+0000 7f21e7a07640 1 --2- 172.21.15.105:0/2377929448 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21e01600b0 0x7f21e00ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:31.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.707+0000 7f21e7a07640 1 -- 172.21.15.105:0/2377929448 >> 172.21.15.105:0/2377929448 conn(0x7f21e006d4f0 msgr2=0x7f21e0071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:31.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.707+0000 7f21e7a07640 1 -- 172.21.15.105:0/2377929448 shutdown_connections 2024-09-21T03:24:31.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.707+0000 7f21e7a07640 1 -- 172.21.15.105:0/2377929448 wait complete. 2024-09-21T03:24:31.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.708+0000 7f21e7a07640 1 Processor -- start 2024-09-21T03:24:31.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.708+0000 7f21e7a07640 1 -- start start 2024-09-21T03:24:31.712 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.710+0000 7f21e7a07640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21e00b7cc0 0x7f21e00b0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:31.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.710+0000 7f21e7a07640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21e00cf150 0x7f21e00b6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:31.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.710+0000 7f21e7a07640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21e01600b0 0x7f21e00b68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:31.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.710+0000 7f21e7a07640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f21e00b4620 con 0x7f21e01600b0 2024-09-21T03:24:31.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.710+0000 7f21e7a07640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f21e00b44a0 con 0x7f21e00cf150 2024-09-21T03:24:31.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.710+0000 7f21e7a07640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f21e00b47a0 con 0x7f21e00b7cc0 2024-09-21T03:24:31.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.710+0000 7f21e5fa4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21e01600b0 0x7f21e00b68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:31.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.710+0000 7f21e5fa4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21e01600b0 0x7f21e00b68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:33644/0 (socket says 172.21.15.105:33644) 2024-09-21T03:24:31.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.710+0000 7f21e5fa4640 1 -- 172.21.15.105:0/2961417918 learned_addr learned my addr 172.21.15.105:0/2961417918 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:31.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.710+0000 7f21e57a3640 1 --2- 172.21.15.105:0/2961417918 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21e00b7cc0 0x7f21e00b0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:31.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.710+0000 7f21e4fa2640 1 --2- 172.21.15.105:0/2961417918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21e00cf150 0x7f21e00b6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:31.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.710+0000 7f21e5fa4640 1 -- 172.21.15.105:0/2961417918 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21e00b7cc0 msgr2=0x7f21e00b0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:31.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.710+0000 7f21e5fa4640 1 --2- 172.21.15.105:0/2961417918 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21e00b7cc0 0x7f21e00b0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:31.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.710+0000 7f21e5fa4640 1 -- 172.21.15.105:0/2961417918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21e00cf150 msgr2=0x7f21e00b6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:31.714 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.710+0000 7f21e5fa4640 1 --2- 172.21.15.105:0/2961417918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21e00cf150 0x7f21e00b6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:31.714 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.710+0000 7f21e5fa4640 1 -- 172.21.15.105:0/2961417918 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e01f3fe0 con 0x7f21e01600b0 2024-09-21T03:24:31.714 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.710+0000 7f21e5fa4640 1 --2- 172.21.15.105:0/2961417918 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21e01600b0 0x7f21e00b68b0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f21d800cab0 tx=0x7f21d800cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:31.714 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.710+0000 7f21d5ffb640 1 -- 172.21.15.105:0/2961417918 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d8007d30 con 0x7f21e01600b0 2024-09-21T03:24:31.714 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.710+0000 7f21d5ffb640 1 -- 172.21.15.105:0/2961417918 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21d800f450 con 0x7f21e01600b0 2024-09-21T03:24:31.714 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.711+0000 7f21e7a07640 1 -- 172.21.15.105:0/2961417918 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21e01f42c0 con 0x7f21e01600b0 2024-09-21T03:24:31.714 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.711+0000 7f21d5ffb640 1 -- 172.21.15.105:0/2961417918 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d800f8a0 con 0x7f21e01600b0 2024-09-21T03:24:31.714 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.711+0000 7f21e7a07640 1 -- 172.21.15.105:0/2961417918 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21e01f4880 con 0x7f21e01600b0 2024-09-21T03:24:31.715 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.712+0000 7f21e7a07640 1 -- 172.21.15.105:0/2961417918 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21e00b3d50 con 0x7f21e01600b0 2024-09-21T03:24:31.715 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.712+0000 7f21d5ffb640 1 -- 172.21.15.105:0/2961417918 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f21d800fa40 con 0x7f21e01600b0 2024-09-21T03:24:31.715 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.713+0000 7f21d5ffb640 1 --2- 172.21.15.105:0/2961417918 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f21c4078b90 0x7f21c407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:31.715 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.713+0000 7f21d5ffb640 1 -- 172.21.15.105:0/2961417918 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 4943+0+0 (secure 0 0 0) 0x7f21d809b2a0 con 0x7f21e01600b0 2024-09-21T03:24:31.715 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.713+0000 7f21e57a3640 1 --2- 172.21.15.105:0/2961417918 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f21c4078b90 0x7f21c407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:31.715 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.714+0000 7f21e57a3640 1 --2- 172.21.15.105:0/2961417918 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f21c4078b90 0x7f21c407b0a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f21dc00a490 tx=0x7f21dc00a420 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:31.719 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.718+0000 7f21d5ffb640 1 -- 172.21.15.105:0/2961417918 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f21d8014030 con 0x7f21e01600b0 2024-09-21T03:24:31.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:31.966+0000 7f21e7a07640 1 -- 172.21.15.105:0/2961417918 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_oldest_tid"]} v 0) -- 0x7f21e00ccad0 con 0x7f21e01600b0 2024-09-21T03:24:32.959 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:32.958+0000 7f21d5ffb640 1 -- 172.21.15.105:0/2961417918 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_oldest_tid"]}]=0 v298) ==== 153+0+0 (secure 0 0 0) 0x7f21d809b0c0 con 0x7f21e01600b0 2024-09-21T03:24:32.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:32.960+0000 7f21e7a07640 1 -- 172.21.15.105:0/2961417918 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f21c4078b90 msgr2=0x7f21c407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:32.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:32.960+0000 7f21e7a07640 1 --2- 172.21.15.105:0/2961417918 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f21c4078b90 0x7f21c407b0a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f21dc00a490 tx=0x7f21dc00a420 comp rx=0 tx=0).stop 2024-09-21T03:24:32.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:32.960+0000 7f21e7a07640 1 -- 172.21.15.105:0/2961417918 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21e01600b0 msgr2=0x7f21e00b68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:32.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:32.960+0000 7f21e7a07640 1 --2- 172.21.15.105:0/2961417918 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21e01600b0 0x7f21e00b68b0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f21d800cab0 tx=0x7f21d800cf70 comp rx=0 tx=0).stop 2024-09-21T03:24:32.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:32.960+0000 7f21e7a07640 1 -- 172.21.15.105:0/2961417918 shutdown_connections 2024-09-21T03:24:32.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:32.960+0000 7f21e7a07640 1 --2- 172.21.15.105:0/2961417918 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f21c4078b90 0x7f21c407b0a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:32.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:32.960+0000 7f21e7a07640 1 --2- 172.21.15.105:0/2961417918 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21e01600b0 0x7f21e00b68b0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:32.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:32.960+0000 7f21e7a07640 1 --2- 172.21.15.105:0/2961417918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21e00cf150 0x7f21e00b6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:32.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:32.960+0000 7f21e7a07640 1 --2- 172.21.15.105:0/2961417918 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21e00b7cc0 0x7f21e00b0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:32.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:32.960+0000 7f21e7a07640 1 -- 172.21.15.105:0/2961417918 >> 172.21.15.105:0/2961417918 conn(0x7f21e006d4f0 msgr2=0x7f21e00712e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:32.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:32.961+0000 7f21e7a07640 1 -- 172.21.15.105:0/2961417918 shutdown_connections 2024-09-21T03:24:32.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:32.961+0000 7f21e7a07640 1 -- 172.21.15.105:0/2961417918 wait complete. 2024-09-21T03:24:32.976 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T03:24:33.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.093+0000 7ff373b39640 1 -- 172.21.15.105:0/1638713832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff36c0d05c0 msgr2=0x7ff36c0b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:33.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.093+0000 7ff373b39640 1 --2- 172.21.15.105:0/1638713832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff36c0d05c0 0x7ff36c0b3550 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7ff364005fd0 tx=0x7ff36402a8b0 comp rx=0 tx=0).stop 2024-09-21T03:24:33.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.093+0000 7ff373b39640 1 -- 172.21.15.105:0/1638713832 shutdown_connections 2024-09-21T03:24:33.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.093+0000 7ff373b39640 1 --2- 172.21.15.105:0/1638713832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff36c0d05c0 0x7ff36c0b3550 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:33.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.093+0000 7ff373b39640 1 -- 172.21.15.105:0/1638713832 >> 172.21.15.105:0/1638713832 conn(0x7ff36c0cdcc0 msgr2=0x7ff36c0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:33.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.093+0000 7ff373b39640 1 -- 172.21.15.105:0/1638713832 shutdown_connections 2024-09-21T03:24:33.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.093+0000 7ff373b39640 1 -- 172.21.15.105:0/1638713832 wait complete. 2024-09-21T03:24:33.096 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.094+0000 7ff373b39640 1 Processor -- start 2024-09-21T03:24:33.096 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.095+0000 7ff373b39640 1 -- start start 2024-09-21T03:24:33.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.096+0000 7ff373b39640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff36c0b4090 0x7ff36c14a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:33.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.096+0000 7ff373b39640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff36c0d05c0 0x7ff36c06cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:33.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.096+0000 7ff373b39640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff36c158c00 0x7ff36c06d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:33.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.096+0000 7ff373b39640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff36c0b4bd0 con 0x7ff36c158c00 2024-09-21T03:24:33.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.096+0000 7ff373b39640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff36c0b4a50 con 0x7ff36c0d05c0 2024-09-21T03:24:33.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.096+0000 7ff373b39640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff36c0b4d50 con 0x7ff36c0b4090 2024-09-21T03:24:33.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.096+0000 7ff3720d6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff36c158c00 0x7ff36c06d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:33.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.096+0000 7ff3720d6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff36c158c00 0x7ff36c06d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:33666/0 (socket says 172.21.15.105:33666) 2024-09-21T03:24:33.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.096+0000 7ff3720d6640 1 -- 172.21.15.105:0/3655358643 learned_addr learned my addr 172.21.15.105:0/3655358643 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:33.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.096+0000 7ff3710d4640 1 --2- 172.21.15.105:0/3655358643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff36c0d05c0 0x7ff36c06cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:33.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.096+0000 7ff3718d5640 1 --2- 172.21.15.105:0/3655358643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff36c0b4090 0x7ff36c14a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:33.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.096+0000 7ff3720d6640 1 -- 172.21.15.105:0/3655358643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff36c0b4090 msgr2=0x7ff36c14a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:33.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.096+0000 7ff3720d6640 1 --2- 172.21.15.105:0/3655358643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff36c0b4090 0x7ff36c14a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:33.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.096+0000 7ff3720d6640 1 -- 172.21.15.105:0/3655358643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff36c0d05c0 msgr2=0x7ff36c06cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:33.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.096+0000 7ff3720d6640 1 --2- 172.21.15.105:0/3655358643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff36c0d05c0 0x7ff36c06cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:33.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.096+0000 7ff3720d6640 1 -- 172.21.15.105:0/3655358643 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff36c09dfe0 con 0x7ff36c158c00 2024-09-21T03:24:33.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.096+0000 7ff3710d4640 1 --2- 172.21.15.105:0/3655358643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff36c0d05c0 0x7ff36c06cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:24:33.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.096+0000 7ff3718d5640 1 --2- 172.21.15.105:0/3655358643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff36c0b4090 0x7ff36c14a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:24:33.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.096+0000 7ff3720d6640 1 --2- 172.21.15.105:0/3655358643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff36c158c00 0x7ff36c06d320 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7ff364006010 tx=0x7ff364003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:33.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.097+0000 7ff3627fc640 1 -- 172.21.15.105:0/3655358643 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff364031b90 con 0x7ff36c158c00 2024-09-21T03:24:33.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.097+0000 7ff3627fc640 1 -- 172.21.15.105:0/3655358643 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff364031e20 con 0x7ff36c158c00 2024-09-21T03:24:33.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.097+0000 7ff3627fc640 1 -- 172.21.15.105:0/3655358643 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff364033310 con 0x7ff36c158c00 2024-09-21T03:24:33.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.097+0000 7ff373b39640 1 -- 172.21.15.105:0/3655358643 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff36c1f7670 con 0x7ff36c158c00 2024-09-21T03:24:33.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.097+0000 7ff373b39640 1 -- 172.21.15.105:0/3655358643 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff36c1f7c30 con 0x7ff36c158c00 2024-09-21T03:24:33.101 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.098+0000 7ff373b39640 1 -- 172.21.15.105:0/3655358643 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff36c0d2390 con 0x7ff36c158c00 2024-09-21T03:24:33.101 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.098+0000 7ff3627fc640 1 -- 172.21.15.105:0/3655358643 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff364031660 con 0x7ff36c158c00 2024-09-21T03:24:33.101 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.099+0000 7ff3627fc640 1 --2- 172.21.15.105:0/3655358643 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff350078b90 0x7ff35007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:33.101 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.099+0000 7ff3627fc640 1 -- 172.21.15.105:0/3655358643 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 4943+0+0 (secure 0 0 0) 0x7ff3640bc0a0 con 0x7ff36c158c00 2024-09-21T03:24:33.101 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.099+0000 7ff3718d5640 1 --2- 172.21.15.105:0/3655358643 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff350078b90 0x7ff35007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:33.101 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.099+0000 7ff3718d5640 1 --2- 172.21.15.105:0/3655358643 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff350078b90 0x7ff35007b0a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff36800a810 tx=0x7ff368008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:33.105 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.103+0000 7ff3627fc640 1 -- 172.21.15.105:0/3655358643 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff36403f030 con 0x7ff36c158c00 2024-09-21T03:24:33.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.278+0000 7ff373b39640 1 -- 172.21.15.105:0/3655358643 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7ff36c1f7400 con 0x7ff36c158c00 2024-09-21T03:24:33.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.279+0000 7ff3627fc640 1 -- 172.21.15.105:0/3655358643 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v48) ==== 59+0+2294 (secure 0 0 0) 0x7ff3640847f0 con 0x7ff36c158c00 2024-09-21T03:24:33.281 INFO:teuthology.orchestra.run.smithi105.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T03:24:33.281 INFO:teuthology.orchestra.run.smithi105.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T03:24:33.281 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced client_mount_timeout 30 2024-09-21T03:24:33.281 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced debug_client 20/20 2024-09-21T03:24:33.281 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced debug_mgr 20/20 2024-09-21T03:24:33.281 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced debug_ms 1/1 2024-09-21T03:24:33.281 INFO:teuthology.orchestra.run.smithi105.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T03:24:33.281 INFO:teuthology.orchestra.run.smithi105.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T03:24:33.281 INFO:teuthology.orchestra.run.smithi105.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 7291.545169 2024-09-21T03:24:33.281 INFO:teuthology.orchestra.run.smithi105.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5080.142035 2024-09-21T03:24:33.281 INFO:teuthology.orchestra.run.smithi105.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5120.988640 2024-09-21T03:24:33.281 INFO:teuthology.orchestra.run.smithi105.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4938.196268 2024-09-21T03:24:33.282 INFO:teuthology.orchestra.run.smithi105.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4906.316728 2024-09-21T03:24:33.282 INFO:teuthology.orchestra.run.smithi105.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4701.273858 2024-09-21T03:24:33.282 INFO:teuthology.orchestra.run.smithi105.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4947.710044 2024-09-21T03:24:33.282 INFO:teuthology.orchestra.run.smithi105.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5174.949063 2024-09-21T03:24:33.282 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced debug_mds 20/20 2024-09-21T03:24:33.282 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T03:24:33.282 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced debug_ms 2/2 2024-09-21T03:24:33.282 INFO:teuthology.orchestra.run.smithi105.stdout:mds dev mds_debug_frag true 2024-09-21T03:24:33.282 INFO:teuthology.orchestra.run.smithi105.stdout:mds dev mds_debug_scatterstat true 2024-09-21T03:24:33.282 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T03:24:33.282 INFO:teuthology.orchestra.run.smithi105.stdout:mds dev mds_verify_scatter true 2024-09-21T03:24:33.282 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T03:24:33.282 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T03:24:33.283 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T03:24:33.283 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced client_mount_timeout 600 2024-09-21T03:24:33.283 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced debug_client 20/20 2024-09-21T03:24:33.283 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced debug_ms 1/1 2024-09-21T03:24:33.283 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T03:24:33.283 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T03:24:33.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.281+0000 7ff373b39640 1 -- 172.21.15.105:0/3655358643 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff350078b90 msgr2=0x7ff35007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:33.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.281+0000 7ff373b39640 1 --2- 172.21.15.105:0/3655358643 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff350078b90 0x7ff35007b0a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff36800a810 tx=0x7ff368008040 comp rx=0 tx=0).stop 2024-09-21T03:24:33.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.281+0000 7ff373b39640 1 -- 172.21.15.105:0/3655358643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff36c158c00 msgr2=0x7ff36c06d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:33.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.281+0000 7ff373b39640 1 --2- 172.21.15.105:0/3655358643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff36c158c00 0x7ff36c06d320 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7ff364006010 tx=0x7ff364003ba0 comp rx=0 tx=0).stop 2024-09-21T03:24:33.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.281+0000 7ff373b39640 1 -- 172.21.15.105:0/3655358643 shutdown_connections 2024-09-21T03:24:33.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.281+0000 7ff373b39640 1 --2- 172.21.15.105:0/3655358643 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff350078b90 0x7ff35007b0a0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:33.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.281+0000 7ff373b39640 1 --2- 172.21.15.105:0/3655358643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff36c158c00 0x7ff36c06d320 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:33.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.281+0000 7ff373b39640 1 --2- 172.21.15.105:0/3655358643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff36c0d05c0 0x7ff36c06cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:33.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.281+0000 7ff373b39640 1 --2- 172.21.15.105:0/3655358643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff36c0b4090 0x7ff36c14a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:33.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.281+0000 7ff373b39640 1 -- 172.21.15.105:0/3655358643 >> 172.21.15.105:0/3655358643 conn(0x7ff36c0cdcc0 msgr2=0x7ff36c0b5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:33.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.281+0000 7ff373b39640 1 -- 172.21.15.105:0/3655358643 shutdown_connections 2024-09-21T03:24:33.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.281+0000 7ff373b39640 1 -- 172.21.15.105:0/3655358643 wait complete. 2024-09-21T03:24:33.293 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T03:24:33.409 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.407+0000 7f61ea03f640 1 -- 172.21.15.105:0/310513446 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61e40d4c30 msgr2=0x7f61e40b9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:33.409 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.407+0000 7f61ea03f640 1 --2- 172.21.15.105:0/310513446 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61e40d4c30 0x7f61e40b9900 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f61e408d780 tx=0x7f61d402a540 comp rx=0 tx=0).stop 2024-09-21T03:24:33.409 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.407+0000 7f61ea03f640 1 -- 172.21.15.105:0/310513446 shutdown_connections 2024-09-21T03:24:33.409 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.407+0000 7f61ea03f640 1 --2- 172.21.15.105:0/310513446 >> v2:172.21.15.162:3300/0 conn(0x7f61e40b66b0 0x7f61e406e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:33.409 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.407+0000 7f61ea03f640 1 --2- 172.21.15.105:0/310513446 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61e40d4c30 0x7f61e40b9900 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:33.410 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.407+0000 7f61ea03f640 1 -- 172.21.15.105:0/310513446 >> 172.21.15.105:0/310513446 conn(0x7f61e409d830 msgr2=0x7f61e40d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:33.410 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.407+0000 7f61ea03f640 1 -- 172.21.15.105:0/310513446 shutdown_connections 2024-09-21T03:24:33.410 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.407+0000 7f61ea03f640 1 -- 172.21.15.105:0/310513446 wait complete. 2024-09-21T03:24:33.411 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.409+0000 7f61ea03f640 1 Processor -- start 2024-09-21T03:24:33.411 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.409+0000 7f61ea03f640 1 -- start start 2024-09-21T03:24:33.413 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.410+0000 7f61ea03f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61e40b3910 0x7f61e40cca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:33.413 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.410+0000 7f61ea03f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61e40d4c30 0x7f61e4151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:33.413 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.410+0000 7f61ea03f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61e4152100 0x7f61e4161190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:33.413 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.410+0000 7f61ea03f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f61e406eae0 con 0x7f61e40b3910 2024-09-21T03:24:33.413 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.410+0000 7f61ea03f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f61e406e960 con 0x7f61e4152100 2024-09-21T03:24:33.413 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.410+0000 7f61ea03f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f61e406ec60 con 0x7f61e40d4c30 2024-09-21T03:24:33.414 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.410+0000 7f61e37fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61e40b3910 0x7f61e40cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:33.414 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.410+0000 7f61e37fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61e40b3910 0x7f61e40cca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:33672/0 (socket says 172.21.15.105:33672) 2024-09-21T03:24:33.414 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.410+0000 7f61e37fe640 1 -- 172.21.15.105:0/1262400129 learned_addr learned my addr 172.21.15.105:0/1262400129 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:33.414 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.411+0000 7f61dbfff640 1 --2- 172.21.15.105:0/1262400129 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61e40d4c30 0x7f61e4151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:33.414 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.411+0000 7f61e3fff640 1 --2- 172.21.15.105:0/1262400129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61e4152100 0x7f61e4161190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:33.414 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.411+0000 7f61e37fe640 1 -- 172.21.15.105:0/1262400129 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61e40d4c30 msgr2=0x7f61e4151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:33.414 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.411+0000 7f61e37fe640 1 --2- 172.21.15.105:0/1262400129 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61e40d4c30 0x7f61e4151bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:33.414 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.411+0000 7f61e37fe640 1 -- 172.21.15.105:0/1262400129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61e4152100 msgr2=0x7f61e4161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:33.414 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.411+0000 7f61e37fe640 1 --2- 172.21.15.105:0/1262400129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61e4152100 0x7f61e4161190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:33.414 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.411+0000 7f61e37fe640 1 -- 172.21.15.105:0/1262400129 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61e40ccf50 con 0x7f61e40b3910 2024-09-21T03:24:33.414 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.411+0000 7f61e3fff640 1 --2- 172.21.15.105:0/1262400129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61e4152100 0x7f61e4161190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:24:33.414 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.411+0000 7f61e37fe640 1 --2- 172.21.15.105:0/1262400129 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61e40b3910 0x7f61e40cca10 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f61d402ab30 tx=0x7f61d40052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:33.414 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.411+0000 7f61e0ff9640 1 -- 172.21.15.105:0/1262400129 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d4031b50 con 0x7f61e40b3910 2024-09-21T03:24:33.415 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.411+0000 7f61e0ff9640 1 -- 172.21.15.105:0/1262400129 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61d4031de0 con 0x7f61e40b3910 2024-09-21T03:24:33.415 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.411+0000 7f61ea03f640 1 -- 172.21.15.105:0/1262400129 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61e4158120 con 0x7f61e40b3910 2024-09-21T03:24:33.415 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.411+0000 7f61e0ff9640 1 -- 172.21.15.105:0/1262400129 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d4004a00 con 0x7f61e40b3910 2024-09-21T03:24:33.415 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.411+0000 7f61ea03f640 1 -- 172.21.15.105:0/1262400129 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61e41586e0 con 0x7f61e40b3910 2024-09-21T03:24:33.415 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.412+0000 7f61ea03f640 1 -- 172.21.15.105:0/1262400129 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61e406f1f0 con 0x7f61e40b3910 2024-09-21T03:24:33.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.413+0000 7f61e0ff9640 1 -- 172.21.15.105:0/1262400129 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f61d4004ba0 con 0x7f61e40b3910 2024-09-21T03:24:33.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.414+0000 7f61e0ff9640 1 --2- 172.21.15.105:0/1262400129 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f61c4078bc0 0x7f61c407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:33.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.414+0000 7f61e0ff9640 1 -- 172.21.15.105:0/1262400129 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 4943+0+0 (secure 0 0 0) 0x7f61d40bbda0 con 0x7f61e40b3910 2024-09-21T03:24:33.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.414+0000 7f61dbfff640 1 --2- 172.21.15.105:0/1262400129 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f61c4078bc0 0x7f61c407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:33.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.415+0000 7f61dbfff640 1 --2- 172.21.15.105:0/1262400129 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f61c4078bc0 0x7f61c407b0d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f61e4160df0 tx=0x7f61cc009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:33.420 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.419+0000 7f61e0ff9640 1 -- 172.21.15.105:0/1262400129 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f61e40ccf50 con 0x7f61e40b3910 2024-09-21T03:24:33.595 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.594+0000 7f61ea03f640 1 -- 172.21.15.105:0/1262400129 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f61e40ce6b0 con 0x7f61e40b3910 2024-09-21T03:24:33.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.598+0000 7f61e0ff9640 1 -- 172.21.15.105:0/1262400129 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v49)=0 v49) ==== 122+0+0 (secure 0 0 0) 0x7f61d403f030 con 0x7f61e40b3910 2024-09-21T03:24:33.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.600+0000 7f61ea03f640 1 -- 172.21.15.105:0/1262400129 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f61c4078bc0 msgr2=0x7f61c407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:33.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.600+0000 7f61ea03f640 1 --2- 172.21.15.105:0/1262400129 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f61c4078bc0 0x7f61c407b0d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f61e4160df0 tx=0x7f61cc009060 comp rx=0 tx=0).stop 2024-09-21T03:24:33.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.600+0000 7f61ea03f640 1 -- 172.21.15.105:0/1262400129 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61e40b3910 msgr2=0x7f61e40cca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:33.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.600+0000 7f61ea03f640 1 --2- 172.21.15.105:0/1262400129 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61e40b3910 0x7f61e40cca10 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f61d402ab30 tx=0x7f61d40052f0 comp rx=0 tx=0).stop 2024-09-21T03:24:33.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.600+0000 7f61ea03f640 1 -- 172.21.15.105:0/1262400129 shutdown_connections 2024-09-21T03:24:33.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.600+0000 7f61ea03f640 1 --2- 172.21.15.105:0/1262400129 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f61c4078bc0 0x7f61c407b0d0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:33.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.600+0000 7f61ea03f640 1 --2- 172.21.15.105:0/1262400129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61e4152100 0x7f61e4161190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:33.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.600+0000 7f61ea03f640 1 --2- 172.21.15.105:0/1262400129 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61e40d4c30 0x7f61e4151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:33.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.600+0000 7f61ea03f640 1 --2- 172.21.15.105:0/1262400129 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61e40b3910 0x7f61e40cca10 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:33.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.600+0000 7f61ea03f640 1 -- 172.21.15.105:0/1262400129 >> 172.21.15.105:0/1262400129 conn(0x7f61e409d830 msgr2=0x7f61e40b7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:33.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.600+0000 7f61ea03f640 1 -- 172.21.15.105:0/1262400129 shutdown_connections 2024-09-21T03:24:33.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.600+0000 7f61ea03f640 1 -- 172.21.15.105:0/1262400129 wait complete. 2024-09-21T03:24:33.613 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T03:24:33.613 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T03:24:33.646 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T03:24:33.687 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T03:24:33.687 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:24:33.688 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:24:33.703 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T03:24:33.703 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:24:33.703 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:24:33.746 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=452 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T03:24:33.746 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:24:33.746 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:24:33.761 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T03:24:33.761 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:24:33.761 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:24:33.804 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=452 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T03:24:33.804 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T03:24:33.805 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:24:33.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.915+0000 7fc69b958640 1 -- 172.21.15.105:0/1860985112 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6940d1d40 msgr2=0x7fc6940b5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:33.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.915+0000 7fc69b958640 1 --2- 172.21.15.105:0/1860985112 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6940d1d40 0x7fc6940b5210 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fc694074550 tx=0x7fc69002a5f0 comp rx=0 tx=0).stop 2024-09-21T03:24:33.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.915+0000 7fc69b958640 1 -- 172.21.15.105:0/1860985112 shutdown_connections 2024-09-21T03:24:33.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.915+0000 7fc69b958640 1 --2- 172.21.15.105:0/1860985112 >> v2:172.21.15.162:3300/0 conn(0x7fc69415c6f0 0x7fc6940ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:33.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.915+0000 7fc69b958640 1 --2- 172.21.15.105:0/1860985112 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6940d1d40 0x7fc6940b5210 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:33.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.915+0000 7fc69b958640 1 -- 172.21.15.105:0/1860985112 >> 172.21.15.105:0/1860985112 conn(0x7fc6940b3f10 msgr2=0x7fc6940b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:33.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.915+0000 7fc69b958640 1 -- 172.21.15.105:0/1860985112 shutdown_connections 2024-09-21T03:24:33.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.915+0000 7fc69b958640 1 -- 172.21.15.105:0/1860985112 wait complete. 2024-09-21T03:24:33.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.917+0000 7fc69b958640 1 Processor -- start 2024-09-21T03:24:33.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.917+0000 7fc69b958640 1 -- start start 2024-09-21T03:24:33.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.918+0000 7fc69b958640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6940ccba0 0x7fc69414b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:33.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.918+0000 7fc69b958640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6940d1d40 0x7fc6940abd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:33.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.918+0000 7fc69b958640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc69415c6f0 0x7fc6940cb490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:33.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.918+0000 7fc69b958640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc6940d11f0 con 0x7fc6940ccba0 2024-09-21T03:24:33.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.918+0000 7fc69b958640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc6940d1070 con 0x7fc6940d1d40 2024-09-21T03:24:33.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.918+0000 7fc69b958640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc6940d1370 con 0x7fc69415c6f0 2024-09-21T03:24:33.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.918+0000 7fc6996f4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6940ccba0 0x7fc69414b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:33.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.918+0000 7fc6996f4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6940ccba0 0x7fc69414b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:33692/0 (socket says 172.21.15.105:33692) 2024-09-21T03:24:33.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.918+0000 7fc6996f4640 1 -- 172.21.15.105:0/3905929518 learned_addr learned my addr 172.21.15.105:0/3905929518 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:33.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.918+0000 7fc699ef5640 1 --2- 172.21.15.105:0/3905929518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc69415c6f0 0x7fc6940cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:33.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.918+0000 7fc698ef3640 1 --2- 172.21.15.105:0/3905929518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6940d1d40 0x7fc6940abd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:33.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.918+0000 7fc6996f4640 1 -- 172.21.15.105:0/3905929518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc69415c6f0 msgr2=0x7fc6940cb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:33.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.918+0000 7fc6996f4640 1 --2- 172.21.15.105:0/3905929518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc69415c6f0 0x7fc6940cb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:33.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.918+0000 7fc6996f4640 1 -- 172.21.15.105:0/3905929518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6940d1d40 msgr2=0x7fc6940abd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:33.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.918+0000 7fc6996f4640 1 --2- 172.21.15.105:0/3905929518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6940d1d40 0x7fc6940abd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:33.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.918+0000 7fc6996f4640 1 -- 172.21.15.105:0/3905929518 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6940ca410 con 0x7fc6940ccba0 2024-09-21T03:24:33.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.918+0000 7fc6996f4640 1 --2- 172.21.15.105:0/3905929518 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6940ccba0 0x7fc69414b260 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fc690034040 tx=0x7fc690003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:33.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.919+0000 7fc689ffb640 1 -- 172.21.15.105:0/3905929518 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69003e030 con 0x7fc6940ccba0 2024-09-21T03:24:33.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.919+0000 7fc689ffb640 1 -- 172.21.15.105:0/3905929518 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc690003e00 con 0x7fc6940ccba0 2024-09-21T03:24:33.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.919+0000 7fc69b958640 1 -- 172.21.15.105:0/3905929518 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6940ca6d0 con 0x7fc6940ccba0 2024-09-21T03:24:33.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.919+0000 7fc689ffb640 1 -- 172.21.15.105:0/3905929518 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc690035040 con 0x7fc6940ccba0 2024-09-21T03:24:33.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.919+0000 7fc69b958640 1 -- 172.21.15.105:0/3905929518 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6940cac90 con 0x7fc6940ccba0 2024-09-21T03:24:33.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.920+0000 7fc69b958640 1 -- 172.21.15.105:0/3905929518 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6940d1870 con 0x7fc6940ccba0 2024-09-21T03:24:33.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.920+0000 7fc689ffb640 1 -- 172.21.15.105:0/3905929518 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc690041030 con 0x7fc6940ccba0 2024-09-21T03:24:33.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.921+0000 7fc689ffb640 1 --2- 172.21.15.105:0/3905929518 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc678078bc0 0x7fc67807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:33.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.921+0000 7fc689ffb640 1 -- 172.21.15.105:0/3905929518 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 4943+0+0 (secure 0 0 0) 0x7fc6900bb210 con 0x7fc6940ccba0 2024-09-21T03:24:33.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.921+0000 7fc698ef3640 1 --2- 172.21.15.105:0/3905929518 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc678078bc0 0x7fc67807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:33.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.922+0000 7fc698ef3640 1 --2- 172.21.15.105:0/3905929518 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc678078bc0 0x7fc67807b0d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc684005fd0 tx=0x7fc684005850 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:33.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:33.925+0000 7fc689ffb640 1 -- 172.21.15.105:0/3905929518 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc690083950 con 0x7fc6940ccba0 2024-09-21T03:24:34.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.139+0000 7fc69b958640 1 -- 172.21.15.105:0/3905929518 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6940b82e0 con 0x7fc6940ccba0 2024-09-21T03:24:34.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.140+0000 7fc689ffb640 1 -- 172.21.15.105:0/3905929518 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+3917 (secure 0 0 0) 0x7fc690083250 con 0x7fc6940ccba0 2024-09-21T03:24:34.142 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:24:34.142 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":52,"btime":"2024-09-21T03:24:27:801566+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5878,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/352800965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":352800965},{"type":"v1","addr":"172.21.15.162:6836","nonce":352800965}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":5881,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3338554559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3338554559},{"type":"v1","addr":"172.21.15.162:6837","nonce":3338554559}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/3520449576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3520449576},{"type":"v1","addr":"172.21.15.105:6834","nonce":3520449576}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6759,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/409800320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":409800320},{"type":"v1","addr":"172.21.15.105:6835","nonce":409800320}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[]} 2024-09-21T03:24:34.142 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 52 2024-09-21T03:24:34.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.142+0000 7fc69b958640 1 -- 172.21.15.105:0/3905929518 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc678078bc0 msgr2=0x7fc67807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:34.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.142+0000 7fc69b958640 1 --2- 172.21.15.105:0/3905929518 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc678078bc0 0x7fc67807b0d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc684005fd0 tx=0x7fc684005850 comp rx=0 tx=0).stop 2024-09-21T03:24:34.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.142+0000 7fc69b958640 1 -- 172.21.15.105:0/3905929518 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6940ccba0 msgr2=0x7fc69414b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:34.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.142+0000 7fc69b958640 1 --2- 172.21.15.105:0/3905929518 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6940ccba0 0x7fc69414b260 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fc690034040 tx=0x7fc690003910 comp rx=0 tx=0).stop 2024-09-21T03:24:34.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.142+0000 7fc69b958640 1 -- 172.21.15.105:0/3905929518 shutdown_connections 2024-09-21T03:24:34.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.142+0000 7fc69b958640 1 --2- 172.21.15.105:0/3905929518 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc678078bc0 0x7fc67807b0d0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:34.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.142+0000 7fc69b958640 1 --2- 172.21.15.105:0/3905929518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc69415c6f0 0x7fc6940cb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:34.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.142+0000 7fc69b958640 1 --2- 172.21.15.105:0/3905929518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6940d1d40 0x7fc6940abd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:34.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.142+0000 7fc69b958640 1 --2- 172.21.15.105:0/3905929518 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6940ccba0 0x7fc69414b260 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:34.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.142+0000 7fc69b958640 1 -- 172.21.15.105:0/3905929518 >> 172.21.15.105:0/3905929518 conn(0x7fc6940b3f10 msgr2=0x7fc6940b7120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:34.145 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.142+0000 7fc69b958640 1 -- 172.21.15.105:0/3905929518 shutdown_connections 2024-09-21T03:24:34.145 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.142+0000 7fc69b958640 1 -- 172.21.15.105:0/3905929518 wait complete. 2024-09-21T03:24:34.155 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T03:24:34.155 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-21T03:24:34.155 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T03:24:34.155 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:24:34.155 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T03:24:34.155 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T03:24:34.155 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T03:24:34.156 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:24:34.156 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T03:24:34.156 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T03:24:34.156 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T03:24:34.156 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:24:34.156 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T03:24:34.156 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T03:24:34.157 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T03:24:34.157 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:24:34.166 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T03:24:34.166 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T03:24:34.169 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T03:24:34.169 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T03:24:34.169 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T03:24:34.169 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T03:24:34.170 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T03:24:34.170 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T03:24:34.210 INFO:tasks.ceph.mds.c:Started 2024-09-21T03:24:34.210 DEBUG:teuthology.parallel:result is None 2024-09-21T03:24:34.211 INFO:tasks.ceph.mds.a:Started 2024-09-21T03:24:34.211 DEBUG:teuthology.parallel:result is None 2024-09-21T03:24:34.212 INFO:tasks.ceph.mds.b:Started 2024-09-21T03:24:34.213 DEBUG:teuthology.parallel:result is None 2024-09-21T03:24:34.213 INFO:tasks.ceph.mds.d:Started 2024-09-21T03:24:34.213 DEBUG:teuthology.parallel:result is None 2024-09-21T03:24:34.213 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T03:24:34.297 INFO:tasks.ceph.mds.a.smithi105.stdout:starting mds.a at 2024-09-21T03:24:34.297 INFO:tasks.ceph.mds.c.smithi105.stdout:starting mds.c at 2024-09-21T03:24:34.306 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-09-21T03:24:34.306 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-09-21T03:24:34.332 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.330+0000 7f738acce640 1 -- 172.21.15.105:0/43526002 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f738406e170 msgr2=0x7f73840b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:34.332 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.330+0000 7f738acce640 1 --2- 172.21.15.105:0/43526002 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f738406e170 0x7f73840b3540 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f7378009860 tx=0x7f737802a4b0 comp rx=0 tx=0).stop 2024-09-21T03:24:34.332 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.330+0000 7f738acce640 1 -- 172.21.15.105:0/43526002 shutdown_connections 2024-09-21T03:24:34.332 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.330+0000 7f738acce640 1 --2- 172.21.15.105:0/43526002 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73840ceb40 0x7f73840cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:34.332 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.330+0000 7f738acce640 1 --2- 172.21.15.105:0/43526002 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f738406e170 0x7f73840b3540 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:34.332 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.330+0000 7f738acce640 1 -- 172.21.15.105:0/43526002 >> 172.21.15.105:0/43526002 conn(0x7f738408bfc0 msgr2=0x7f738409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:34.332 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.330+0000 7f738acce640 1 -- 172.21.15.105:0/43526002 shutdown_connections 2024-09-21T03:24:34.333 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.330+0000 7f738acce640 1 -- 172.21.15.105:0/43526002 wait complete. 2024-09-21T03:24:34.333 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.332+0000 7f738acce640 1 Processor -- start 2024-09-21T03:24:34.333 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.332+0000 7f738acce640 1 -- start start 2024-09-21T03:24:34.336 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.333+0000 7f738acce640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f738406f4b0 0x7f738414e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:34.336 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.333+0000 7f738acce640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73840ceb40 0x7f73840ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:34.336 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.333+0000 7f738acce640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f738414e970 0x7f73840ca580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:34.336 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.333+0000 7f738acce640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f73840d0e60 con 0x7f73840ceb40 2024-09-21T03:24:34.337 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.333+0000 7f738acce640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f73840d0ce0 con 0x7f738414e970 2024-09-21T03:24:34.337 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.333+0000 7f738acce640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f73840d0fe0 con 0x7f738406f4b0 2024-09-21T03:24:34.337 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.333+0000 7f7383fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73840ceb40 0x7f73840ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:34.337 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.333+0000 7f7383fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73840ceb40 0x7f73840ca040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:33730/0 (socket says 172.21.15.105:33730) 2024-09-21T03:24:34.337 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.333+0000 7f7383fff640 1 -- 172.21.15.105:0/2071513755 learned_addr learned my addr 172.21.15.105:0/2071513755 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:34.337 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.333+0000 7f7388a6a640 1 --2- 172.21.15.105:0/2071513755 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f738406f4b0 0x7f738414e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:34.337 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.333+0000 7f738926b640 1 --2- 172.21.15.105:0/2071513755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f738414e970 0x7f73840ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:34.337 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.334+0000 7f7383fff640 1 -- 172.21.15.105:0/2071513755 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f738406f4b0 msgr2=0x7f738414e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:34.337 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.334+0000 7f7383fff640 1 --2- 172.21.15.105:0/2071513755 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f738406f4b0 0x7f738414e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:34.337 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.334+0000 7f7383fff640 1 -- 172.21.15.105:0/2071513755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f738414e970 msgr2=0x7f73840ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:34.337 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.334+0000 7f7383fff640 1 --2- 172.21.15.105:0/2071513755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f738414e970 0x7f73840ca580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:34.337 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.334+0000 7f7383fff640 1 -- 172.21.15.105:0/2071513755 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7384160250 con 0x7f73840ceb40 2024-09-21T03:24:34.337 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.334+0000 7f7383fff640 1 --2- 172.21.15.105:0/2071513755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73840ceb40 0x7f73840ca040 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f737000c400 tx=0x7f737000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:34.338 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.334+0000 7f73817fa640 1 -- 172.21.15.105:0/2071513755 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7370011790 con 0x7f73840ceb40 2024-09-21T03:24:34.338 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.334+0000 7f73817fa640 1 -- 172.21.15.105:0/2071513755 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7370017070 con 0x7f73840ceb40 2024-09-21T03:24:34.338 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.334+0000 7f738acce640 1 -- 172.21.15.105:0/2071513755 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73840ce840 con 0x7f73840ceb40 2024-09-21T03:24:34.338 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.334+0000 7f73817fa640 1 -- 172.21.15.105:0/2071513755 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7370011ce0 con 0x7f73840ceb40 2024-09-21T03:24:34.338 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.334+0000 7f738acce640 1 -- 172.21.15.105:0/2071513755 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73840cb940 con 0x7f73840ceb40 2024-09-21T03:24:34.339 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.335+0000 7f738acce640 1 -- 172.21.15.105:0/2071513755 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73840d15a0 con 0x7f73840ceb40 2024-09-21T03:24:34.339 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.336+0000 7f73817fa640 1 -- 172.21.15.105:0/2071513755 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f737001c460 con 0x7f73840ceb40 2024-09-21T03:24:34.339 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.337+0000 7f73817fa640 1 --2- 172.21.15.105:0/2071513755 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7368078b90 0x7f736807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:34.339 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.337+0000 7f73817fa640 1 -- 172.21.15.105:0/2071513755 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 4943+0+0 (secure 0 0 0) 0x7f737009a640 con 0x7f73840ceb40 2024-09-21T03:24:34.339 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.337+0000 7f7388a6a640 1 --2- 172.21.15.105:0/2071513755 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7368078b90 0x7f736807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:34.339 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.337+0000 7f7388a6a640 1 --2- 172.21.15.105:0/2071513755 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7368078b90 0x7f736807b0a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7378034000 tx=0x7f7378004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:34.343 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.342+0000 7f73817fa640 1 -- 172.21.15.105:0/2071513755 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7370062730 con 0x7f73840ceb40 2024-09-21T03:24:34.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.529+0000 7f738acce640 1 -- 172.21.15.105:0/2071513755 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f73840d4220 con 0x7f73840ceb40 2024-09-21T03:24:34.977 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.975+0000 7f73817fa640 1 -- 172.21.15.105:0/2071513755 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v87) ==== 97+0+0 (secure 0 0 0) 0x7f7370067160 con 0x7f73840ceb40 2024-09-21T03:24:34.977 INFO:teuthology.orchestra.run.smithi105.stderr: removed all blocklist entries 2024-09-21T03:24:34.979 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.977+0000 7f738acce640 1 -- 172.21.15.105:0/2071513755 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7368078b90 msgr2=0x7f736807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:34.979 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.978+0000 7f738acce640 1 --2- 172.21.15.105:0/2071513755 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7368078b90 0x7f736807b0a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7378034000 tx=0x7f7378004730 comp rx=0 tx=0).stop 2024-09-21T03:24:34.980 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.978+0000 7f738acce640 1 -- 172.21.15.105:0/2071513755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73840ceb40 msgr2=0x7f73840ca040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:34.980 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.978+0000 7f738acce640 1 --2- 172.21.15.105:0/2071513755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73840ceb40 0x7f73840ca040 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f737000c400 tx=0x7f737000c8c0 comp rx=0 tx=0).stop 2024-09-21T03:24:34.980 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.978+0000 7f738acce640 1 -- 172.21.15.105:0/2071513755 shutdown_connections 2024-09-21T03:24:34.980 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.978+0000 7f738acce640 1 --2- 172.21.15.105:0/2071513755 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7368078b90 0x7f736807b0a0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:34.980 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.978+0000 7f738acce640 1 --2- 172.21.15.105:0/2071513755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f738414e970 0x7f73840ca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:34.980 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.978+0000 7f738acce640 1 --2- 172.21.15.105:0/2071513755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73840ceb40 0x7f73840ca040 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:34.980 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.978+0000 7f738acce640 1 --2- 172.21.15.105:0/2071513755 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f738406f4b0 0x7f738414e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:34.980 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.978+0000 7f738acce640 1 -- 172.21.15.105:0/2071513755 >> 172.21.15.105:0/2071513755 conn(0x7f738408bfc0 msgr2=0x7f73840b1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:34.980 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.978+0000 7f738acce640 1 -- 172.21.15.105:0/2071513755 shutdown_connections 2024-09-21T03:24:34.980 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:34.978+0000 7f738acce640 1 -- 172.21.15.105:0/2071513755 wait complete. 2024-09-21T03:24:34.993 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T03:24:35.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.105+0000 7f6b7b45c640 1 -- 172.21.15.105:0/3402769314 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b741600b0 msgr2=0x7f6b740ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:35.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.105+0000 7f6b7b45c640 1 --2- 172.21.15.105:0/3402769314 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b741600b0 0x7f6b740ccbc0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f6b70005fd0 tx=0x7f6b7002a520 comp rx=0 tx=0).stop 2024-09-21T03:24:35.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.105+0000 7f6b7b45c640 1 -- 172.21.15.105:0/3402769314 shutdown_connections 2024-09-21T03:24:35.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.105+0000 7f6b7b45c640 1 --2- 172.21.15.105:0/3402769314 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b740b7cc0 0x7f6b740cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:35.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.105+0000 7f6b7b45c640 1 --2- 172.21.15.105:0/3402769314 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b741600b0 0x7f6b740ccbc0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:35.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.105+0000 7f6b7b45c640 1 -- 172.21.15.105:0/3402769314 >> 172.21.15.105:0/3402769314 conn(0x7f6b7406d4f0 msgr2=0x7f6b74071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:35.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.105+0000 7f6b7b45c640 1 -- 172.21.15.105:0/3402769314 shutdown_connections 2024-09-21T03:24:35.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.105+0000 7f6b7b45c640 1 -- 172.21.15.105:0/3402769314 wait complete. 2024-09-21T03:24:35.108 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.107+0000 7f6b7b45c640 1 Processor -- start 2024-09-21T03:24:35.108 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.107+0000 7f6b7b45c640 1 -- start start 2024-09-21T03:24:35.110 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.108+0000 7f6b7b45c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b740b7cc0 0x7f6b74157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:35.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.108+0000 7f6b7b45c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b740cf150 0x7f6b7414b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:35.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.108+0000 7f6b7b45c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b741600b0 0x7f6b740c9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:35.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.108+0000 7f6b7b45c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6b740b4460 con 0x7f6b740cf150 2024-09-21T03:24:35.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.108+0000 7f6b7b45c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6b740d1be0 con 0x7f6b741600b0 2024-09-21T03:24:35.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.108+0000 7f6b7b45c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6b740b45e0 con 0x7f6b740b7cc0 2024-09-21T03:24:35.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.108+0000 7f6b789f7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b740cf150 0x7f6b7414b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:35.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.108+0000 7f6b789f7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b740cf150 0x7f6b7414b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:33748/0 (socket says 172.21.15.105:33748) 2024-09-21T03:24:35.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.108+0000 7f6b789f7640 1 -- 172.21.15.105:0/3325772812 learned_addr learned my addr 172.21.15.105:0/3325772812 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:35.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.108+0000 7f6b799f9640 1 --2- 172.21.15.105:0/3325772812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b741600b0 0x7f6b740c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:35.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.108+0000 7f6b791f8640 1 --2- 172.21.15.105:0/3325772812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b740b7cc0 0x7f6b74157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:35.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.108+0000 7f6b789f7640 1 -- 172.21.15.105:0/3325772812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b740b7cc0 msgr2=0x7f6b74157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:35.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.108+0000 7f6b789f7640 1 --2- 172.21.15.105:0/3325772812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b740b7cc0 0x7f6b74157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:35.112 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.108+0000 7f6b789f7640 1 -- 172.21.15.105:0/3325772812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b741600b0 msgr2=0x7f6b740c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:35.112 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.108+0000 7f6b789f7640 1 --2- 172.21.15.105:0/3325772812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b741600b0 0x7f6b740c9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:35.112 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.108+0000 7f6b789f7640 1 -- 172.21.15.105:0/3325772812 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b741586a0 con 0x7f6b740cf150 2024-09-21T03:24:35.112 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.108+0000 7f6b789f7640 1 --2- 172.21.15.105:0/3325772812 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b740cf150 0x7f6b7414b890 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f6b6400b440 tx=0x7f6b6400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:35.112 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.108+0000 7f6b69ffb640 1 -- 172.21.15.105:0/3325772812 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b64015020 con 0x7f6b740cf150 2024-09-21T03:24:35.112 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.109+0000 7f6b69ffb640 1 -- 172.21.15.105:0/3325772812 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b64011980 con 0x7f6b740cf150 2024-09-21T03:24:35.112 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.109+0000 7f6b7b45c640 1 -- 172.21.15.105:0/3325772812 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b74158980 con 0x7f6b740cf150 2024-09-21T03:24:35.112 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.109+0000 7f6b69ffb640 1 -- 172.21.15.105:0/3325772812 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b64011dd0 con 0x7f6b740cf150 2024-09-21T03:24:35.112 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.109+0000 7f6b7b45c640 1 -- 172.21.15.105:0/3325772812 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b74156d60 con 0x7f6b740cf150 2024-09-21T03:24:35.113 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.110+0000 7f6b7b45c640 1 -- 172.21.15.105:0/3325772812 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b74158410 con 0x7f6b740cf150 2024-09-21T03:24:35.113 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.110+0000 7f6b69ffb640 1 -- 172.21.15.105:0/3325772812 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6b64018020 con 0x7f6b740cf150 2024-09-21T03:24:35.113 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.111+0000 7f6b69ffb640 1 --2- 172.21.15.105:0/3325772812 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6b58078bc0 0x7f6b5807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:35.113 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.111+0000 7f6b69ffb640 1 -- 172.21.15.105:0/3325772812 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 4857+0+0 (secure 0 0 0) 0x7f6b6409ab10 con 0x7f6b740cf150 2024-09-21T03:24:35.113 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.111+0000 7f6b791f8640 1 --2- 172.21.15.105:0/3325772812 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6b58078bc0 0x7f6b5807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:35.113 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.112+0000 7f6b791f8640 1 --2- 172.21.15.105:0/3325772812 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6b58078bc0 0x7f6b5807b0d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6b70033000 tx=0x7f6b70004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:35.117 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.116+0000 7f6b69ffb640 1 -- 172.21.15.105:0/3325772812 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6b6401f020 con 0x7f6b740cf150 2024-09-21T03:24:35.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.359+0000 7f6b7b45c640 1 -- 172.21.15.105:0/3325772812 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f6b74076820 con 0x7f6b740cf150 2024-09-21T03:24:35.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.360+0000 7f6b69ffb640 1 -- 172.21.15.105:0/3325772812 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) ==== 80+0+5304 (secure 0 0 0) 0x7f6b6400d040 con 0x7f6b740cf150 2024-09-21T03:24:35.362 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:24:35.362 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-21T03:24:35.362 INFO:teuthology.orchestra.run.smithi105.stdout: "auth_dump": [ 2024-09-21T03:24:35.362 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:24:35.362 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mds.a", 2024-09-21T03:24:35.362 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mtIIZDhAAJIXLpzTFBOFhnOwLzsdL6w==", 2024-09-21T03:24:35.362 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:24:35.362 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:24:35.363 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:24:35.363 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:24:35.363 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:24:35.363 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:24:35.363 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:24:35.363 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:24:35.363 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mds.b", 2024-09-21T03:24:35.363 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mGKANGxAAeAuUYMtLP7GXKfIELR7qMA==", 2024-09-21T03:24:35.363 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:24:35.363 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:24:35.363 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:24:35.364 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:24:35.364 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:24:35.364 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:24:35.364 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:24:35.364 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:24:35.364 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mds.c", 2024-09-21T03:24:35.364 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mwQzQFRAAElYtgnIdYzzkeg8AtiU+kA==", 2024-09-21T03:24:35.364 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:24:35.364 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:24:35.364 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:24:35.364 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:24:35.364 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:24:35.365 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:24:35.365 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:24:35.365 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:24:35.365 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mds.d", 2024-09-21T03:24:35.365 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mZkWyIhAAu4XWptFcbDrYjozzrgMcGQ==", 2024-09-21T03:24:35.365 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:24:35.365 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:24:35.365 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:24:35.365 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:24:35.365 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:24:35.365 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:24:35.365 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:24:35.366 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:24:35.366 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.0", 2024-09-21T03:24:35.366 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDMOu5mrSk2BRAAuEPjuEeUJEI3Sa2fiLaJyw==", 2024-09-21T03:24:35.366 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:24:35.366 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:24:35.366 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:24:35.366 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:24:35.366 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:24:35.366 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:24:35.366 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:24:35.366 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.1", 2024-09-21T03:24:35.367 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDPOu5mAT4UCBAAase7NV3ARBSu4QloaQdlzA==", 2024-09-21T03:24:35.367 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:24:35.367 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:24:35.367 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:24:35.367 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:24:35.367 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:24:35.367 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:24:35.367 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:24:35.367 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.2", 2024-09-21T03:24:35.367 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDSOu5ma4LRChAASottrmolMcagbspeyGVzBQ==", 2024-09-21T03:24:35.367 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:24:35.367 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:24:35.367 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:24:35.368 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:24:35.368 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:24:35.368 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:24:35.368 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:24:35.368 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.3", 2024-09-21T03:24:35.368 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDVOu5mD5RWHBAAKuNr4F3GA0EP566aQ07ZVw==", 2024-09-21T03:24:35.368 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:24:35.368 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:24:35.368 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:24:35.368 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:24:35.368 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:24:35.369 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:24:35.369 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:24:35.369 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.4", 2024-09-21T03:24:35.369 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDcOu5m++UBChAAqmgoPBQ/as4tc+UQPwaflg==", 2024-09-21T03:24:35.369 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:24:35.369 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:24:35.369 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:24:35.369 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:24:35.369 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:24:35.369 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:24:35.369 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:24:35.369 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.5", 2024-09-21T03:24:35.370 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDfOu5maYYZKRAA1ungglTU3TW1B/XNRjBuZQ==", 2024-09-21T03:24:35.370 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:24:35.370 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:24:35.370 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:24:35.370 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:24:35.370 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:24:35.370 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:24:35.370 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:24:35.370 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.6", 2024-09-21T03:24:35.370 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDjOu5mmwIqHBAAf6oNdLNkmM9yufP8XA2+og==", 2024-09-21T03:24:35.370 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:24:35.370 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:24:35.371 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:24:35.371 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:24:35.371 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:24:35.371 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:24:35.371 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:24:35.371 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.7", 2024-09-21T03:24:35.371 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDmOu5mtCciHhAAPTnZubJ+7mGXcXZykCWxHg==", 2024-09-21T03:24:35.371 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:24:35.371 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:24:35.371 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:24:35.371 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:24:35.371 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:24:35.372 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:24:35.372 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:24:35.372 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.0", 2024-09-21T03:24:35.372 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mughoJxAAhY0bzJmq+oNyzCdtafkC9w==", 2024-09-21T03:24:35.372 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:24:35.372 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:24:35.372 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow r", 2024-09-21T03:24:35.372 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-21T03:24:35.372 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:24:35.372 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:24:35.372 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:24:35.372 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.1", 2024-09-21T03:24:35.373 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5m4Vn2LhAAnEa/01ql5quuRCVHOVwB7w==", 2024-09-21T03:24:35.373 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:24:35.373 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:24:35.373 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow r", 2024-09-21T03:24:35.373 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow rw", 2024-09-21T03:24:35.373 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow rwx" 2024-09-21T03:24:35.373 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:24:35.373 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:24:35.373 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:24:35.373 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.2", 2024-09-21T03:24:35.373 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mKi0mKxAAoetnL61ujgtg2cvscdjCLQ==", 2024-09-21T03:24:35.373 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:24:35.374 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:24:35.374 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow r", 2024-09-21T03:24:35.374 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow rw", 2024-09-21T03:24:35.374 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow rwx" 2024-09-21T03:24:35.374 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:24:35.374 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:24:35.374 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:24:35.374 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.3", 2024-09-21T03:24:35.374 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mWZDAMhAAs4BuFHMSkJa6+piN/FeeXQ==", 2024-09-21T03:24:35.374 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:24:35.374 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:24:35.374 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow r", 2024-09-21T03:24:35.375 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow rw", 2024-09-21T03:24:35.375 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow rwx" 2024-09-21T03:24:35.375 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:24:35.375 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:24:35.375 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:24:35.375 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.admin", 2024-09-21T03:24:35.375 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDHOu5m4JRYLBAAgZ8nh5VIiWhuZ4+vrnmngw==", 2024-09-21T03:24:35.375 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:24:35.375 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow *", 2024-09-21T03:24:35.375 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:24:35.375 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:24:35.375 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:24:35.376 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:24:35.376 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:24:35.376 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:24:35.376 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mgr.x", 2024-09-21T03:24:35.376 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5m92lTChAAQ61muQmc6uBs7b5mq3Zt8g==", 2024-09-21T03:24:35.376 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:24:35.376 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow *", 2024-09-21T03:24:35.376 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile mgr", 2024-09-21T03:24:35.376 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:24:35.376 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:24:35.376 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:24:35.376 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:24:35.376 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mgr.y", 2024-09-21T03:24:35.377 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mh07bBRAAflFF00xr1ew4zttUi5TGng==", 2024-09-21T03:24:35.377 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:24:35.377 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow *", 2024-09-21T03:24:35.377 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile mgr", 2024-09-21T03:24:35.377 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:24:35.377 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:24:35.377 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:24:35.377 INFO:teuthology.orchestra.run.smithi105.stdout: ] 2024-09-21T03:24:35.377 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-21T03:24:35.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.362+0000 7f6b7b45c640 1 -- 172.21.15.105:0/3325772812 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6b58078bc0 msgr2=0x7f6b5807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:35.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.362+0000 7f6b7b45c640 1 --2- 172.21.15.105:0/3325772812 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6b58078bc0 0x7f6b5807b0d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6b70033000 tx=0x7f6b70004730 comp rx=0 tx=0).stop 2024-09-21T03:24:35.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.362+0000 7f6b7b45c640 1 -- 172.21.15.105:0/3325772812 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b740cf150 msgr2=0x7f6b7414b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:35.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.362+0000 7f6b7b45c640 1 --2- 172.21.15.105:0/3325772812 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b740cf150 0x7f6b7414b890 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f6b6400b440 tx=0x7f6b6400b900 comp rx=0 tx=0).stop 2024-09-21T03:24:35.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.362+0000 7f6b7b45c640 1 -- 172.21.15.105:0/3325772812 shutdown_connections 2024-09-21T03:24:35.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.362+0000 7f6b7b45c640 1 --2- 172.21.15.105:0/3325772812 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6b58078bc0 0x7f6b5807b0d0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:35.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.362+0000 7f6b7b45c640 1 --2- 172.21.15.105:0/3325772812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b741600b0 0x7f6b740c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:35.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.362+0000 7f6b7b45c640 1 --2- 172.21.15.105:0/3325772812 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b740cf150 0x7f6b7414b890 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:35.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.362+0000 7f6b7b45c640 1 --2- 172.21.15.105:0/3325772812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b740b7cc0 0x7f6b74157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:35.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.362+0000 7f6b7b45c640 1 -- 172.21.15.105:0/3325772812 >> 172.21.15.105:0/3325772812 conn(0x7f6b7406d4f0 msgr2=0x7f6b7415c600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:35.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.362+0000 7f6b7b45c640 1 -- 172.21.15.105:0/3325772812 shutdown_connections 2024-09-21T03:24:35.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.362+0000 7f6b7b45c640 1 -- 172.21.15.105:0/3325772812 wait complete. 2024-09-21T03:24:35.380 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T03:24:35.493 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.491+0000 7f6a4b782640 1 -- 172.21.15.105:0/389774589 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a4406e170 msgr2=0x7f6a440b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:35.493 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.491+0000 7f6a4b782640 1 --2- 172.21.15.105:0/389774589 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a4406e170 0x7f6a440b3540 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f6a4408d9b0 tx=0x7f6a4002a4d0 comp rx=0 tx=0).stop 2024-09-21T03:24:35.493 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.491+0000 7f6a4b782640 1 -- 172.21.15.105:0/389774589 shutdown_connections 2024-09-21T03:24:35.494 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.491+0000 7f6a4b782640 1 --2- 172.21.15.105:0/389774589 >> v2:172.21.15.162:3300/0 conn(0x7f6a4406f4b0 0x7f6a440d3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:35.494 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.491+0000 7f6a4b782640 1 --2- 172.21.15.105:0/389774589 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a4406e170 0x7f6a440b3540 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:35.494 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.491+0000 7f6a4b782640 1 -- 172.21.15.105:0/389774589 >> 172.21.15.105:0/389774589 conn(0x7f6a4408bfc0 msgr2=0x7f6a4409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:35.494 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.491+0000 7f6a4b782640 1 -- 172.21.15.105:0/389774589 shutdown_connections 2024-09-21T03:24:35.494 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.491+0000 7f6a4b782640 1 -- 172.21.15.105:0/389774589 wait complete. 2024-09-21T03:24:35.495 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.493+0000 7f6a4b782640 1 Processor -- start 2024-09-21T03:24:35.495 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.493+0000 7f6a4b782640 1 -- start start 2024-09-21T03:24:35.497 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.494+0000 7f6a4b782640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a4406f4b0 0x7f6a440c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:35.497 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.494+0000 7f6a4b782640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a440d3870 0x7f6a441f2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:35.497 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.494+0000 7f6a4b782640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a440c8f20 0x7f6a440b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:35.497 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.494+0000 7f6a4b782640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6a440d0ce0 con 0x7f6a440d3870 2024-09-21T03:24:35.497 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.494+0000 7f6a4b782640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6a440cf4e0 con 0x7f6a440c8f20 2024-09-21T03:24:35.497 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.494+0000 7f6a4b782640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6a440d0e60 con 0x7f6a4406f4b0 2024-09-21T03:24:35.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.494+0000 7f6a48d1d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a440d3870 0x7f6a441f2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:35.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.495+0000 7f6a48d1d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a440d3870 0x7f6a441f2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:33772/0 (socket says 172.21.15.105:33772) 2024-09-21T03:24:35.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.495+0000 7f6a48d1d640 1 -- 172.21.15.105:0/711155309 learned_addr learned my addr 172.21.15.105:0/711155309 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:35.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.495+0000 7f6a49d1f640 1 --2- 172.21.15.105:0/711155309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a440c8f20 0x7f6a440b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:35.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.495+0000 7f6a4951e640 1 --2- 172.21.15.105:0/711155309 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a4406f4b0 0x7f6a440c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:35.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.495+0000 7f6a48d1d640 1 -- 172.21.15.105:0/711155309 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a4406f4b0 msgr2=0x7f6a440c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:35.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.495+0000 7f6a48d1d640 1 --2- 172.21.15.105:0/711155309 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a4406f4b0 0x7f6a440c89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:35.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.495+0000 7f6a48d1d640 1 -- 172.21.15.105:0/711155309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a440c8f20 msgr2=0x7f6a440b4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:35.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.495+0000 7f6a48d1d640 1 --2- 172.21.15.105:0/711155309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a440c8f20 0x7f6a440b4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:35.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.495+0000 7f6a48d1d640 1 -- 172.21.15.105:0/711155309 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a441f5890 con 0x7f6a440d3870 2024-09-21T03:24:35.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.495+0000 7f6a4951e640 1 --2- 172.21.15.105:0/711155309 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a4406f4b0 0x7f6a440c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:24:35.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.495+0000 7f6a49d1f640 1 --2- 172.21.15.105:0/711155309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a440c8f20 0x7f6a440b4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:24:35.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.495+0000 7f6a48d1d640 1 --2- 172.21.15.105:0/711155309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a440d3870 0x7f6a441f2590 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f6a3400c9a0 tx=0x7f6a3400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:35.499 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.495+0000 7f6a39ffb640 1 -- 172.21.15.105:0/711155309 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a34007bb0 con 0x7f6a440d3870 2024-09-21T03:24:35.499 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.495+0000 7f6a39ffb640 1 -- 172.21.15.105:0/711155309 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a34007e40 con 0x7f6a440d3870 2024-09-21T03:24:35.499 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.495+0000 7f6a4b782640 1 -- 172.21.15.105:0/711155309 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a441f5b70 con 0x7f6a440d3870 2024-09-21T03:24:35.499 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.495+0000 7f6a39ffb640 1 -- 172.21.15.105:0/711155309 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a34005280 con 0x7f6a440d3870 2024-09-21T03:24:35.499 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.495+0000 7f6a4b782640 1 -- 172.21.15.105:0/711155309 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a441f6130 con 0x7f6a440d3870 2024-09-21T03:24:35.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.497+0000 7f6a4b782640 1 -- 172.21.15.105:0/711155309 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a4406e170 con 0x7f6a440d3870 2024-09-21T03:24:35.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.497+0000 7f6a39ffb640 1 -- 172.21.15.105:0/711155309 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6a34005420 con 0x7f6a440d3870 2024-09-21T03:24:35.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.497+0000 7f6a39ffb640 1 --2- 172.21.15.105:0/711155309 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6a28078b90 0x7f6a2807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:35.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.497+0000 7f6a39ffb640 1 -- 172.21.15.105:0/711155309 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 4857+0+0 (secure 0 0 0) 0x7f6a3409ae60 con 0x7f6a440d3870 2024-09-21T03:24:35.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.497+0000 7f6a4951e640 1 --2- 172.21.15.105:0/711155309 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6a28078b90 0x7f6a2807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:35.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.498+0000 7f6a4951e640 1 --2- 172.21.15.105:0/711155309 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6a28078b90 0x7f6a2807b0a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6a40034000 tx=0x7f6a40004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:35.503 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.502+0000 7f6a39ffb640 1 -- 172.21.15.105:0/711155309 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6a34014030 con 0x7f6a440d3870 2024-09-21T03:24:35.682 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.680+0000 7f6a4b782640 1 -- 172.21.15.105:0/711155309 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f6a440b3500 con 0x7f6a440d3870 2024-09-21T03:24:35.682 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.680+0000 7f6a39ffb640 1 -- 172.21.15.105:0/711155309 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v89) ==== 84+0+65 (secure 0 0 0) 0x7f6a34063670 con 0x7f6a440d3870 2024-09-21T03:24:35.682 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:24:35.682 INFO:teuthology.orchestra.run.smithi105.stdout:[ 2024-09-21T03:24:35.683 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:24:35.683 INFO:teuthology.orchestra.run.smithi105.stdout: "poolnum": 1, 2024-09-21T03:24:35.683 INFO:teuthology.orchestra.run.smithi105.stdout: "poolname": ".mgr" 2024-09-21T03:24:35.683 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:24:35.683 INFO:teuthology.orchestra.run.smithi105.stdout:] 2024-09-21T03:24:35.685 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.683+0000 7f6a4b782640 1 -- 172.21.15.105:0/711155309 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6a28078b90 msgr2=0x7f6a2807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:35.685 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.683+0000 7f6a4b782640 1 --2- 172.21.15.105:0/711155309 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6a28078b90 0x7f6a2807b0a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6a40034000 tx=0x7f6a40004730 comp rx=0 tx=0).stop 2024-09-21T03:24:35.685 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.683+0000 7f6a4b782640 1 -- 172.21.15.105:0/711155309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a440d3870 msgr2=0x7f6a441f2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:35.685 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.683+0000 7f6a4b782640 1 --2- 172.21.15.105:0/711155309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a440d3870 0x7f6a441f2590 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f6a3400c9a0 tx=0x7f6a3400ce60 comp rx=0 tx=0).stop 2024-09-21T03:24:35.685 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.683+0000 7f6a4b782640 1 -- 172.21.15.105:0/711155309 shutdown_connections 2024-09-21T03:24:35.685 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.683+0000 7f6a4b782640 1 --2- 172.21.15.105:0/711155309 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6a28078b90 0x7f6a2807b0a0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:35.685 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.683+0000 7f6a4b782640 1 --2- 172.21.15.105:0/711155309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a440c8f20 0x7f6a440b4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:35.685 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.683+0000 7f6a4b782640 1 --2- 172.21.15.105:0/711155309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a440d3870 0x7f6a441f2590 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:35.685 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.683+0000 7f6a4b782640 1 --2- 172.21.15.105:0/711155309 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a4406f4b0 0x7f6a440c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:35.685 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.683+0000 7f6a4b782640 1 -- 172.21.15.105:0/711155309 >> 172.21.15.105:0/711155309 conn(0x7f6a4408bfc0 msgr2=0x7f6a440cf660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:35.685 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.683+0000 7f6a4b782640 1 -- 172.21.15.105:0/711155309 shutdown_connections 2024-09-21T03:24:35.686 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.683+0000 7f6a4b782640 1 -- 172.21.15.105:0/711155309 wait complete. 2024-09-21T03:24:35.696 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T03:24:35.696 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T03:24:35.813 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.811+0000 7ffb0b841640 1 -- 172.21.15.105:0/2076652709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb040cf5e0 msgr2=0x7ffb040cf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:35.813 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.811+0000 7ffb0b841640 1 --2- 172.21.15.105:0/2076652709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb040cf5e0 0x7ffb040cf9f0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7ffb040ccff0 tx=0x7ffafc02aa30 comp rx=0 tx=0).stop 2024-09-21T03:24:35.813 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.811+0000 7ffb0b841640 1 -- 172.21.15.105:0/2076652709 shutdown_connections 2024-09-21T03:24:35.813 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.811+0000 7ffb0b841640 1 --2- 172.21.15.105:0/2076652709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb040cf5e0 0x7ffb040cf9f0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:35.813 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.811+0000 7ffb0b841640 1 --2- 172.21.15.105:0/2076652709 >> v2:172.21.15.162:3300/0 conn(0x7ffb0415ce50 0x7ffb0415d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:35.813 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.811+0000 7ffb0b841640 1 --2- 172.21.15.105:0/2076652709 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb04152740 0x7ffb0415c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:35.813 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.811+0000 7ffb0b841640 1 -- 172.21.15.105:0/2076652709 >> 172.21.15.105:0/2076652709 conn(0x7ffb04073d90 msgr2=0x7ffb040741a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:35.813 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.811+0000 7ffb0b841640 1 -- 172.21.15.105:0/2076652709 shutdown_connections 2024-09-21T03:24:35.813 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.811+0000 7ffb0b841640 1 -- 172.21.15.105:0/2076652709 wait complete. 2024-09-21T03:24:35.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.813+0000 7ffb0b841640 1 Processor -- start 2024-09-21T03:24:35.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.813+0000 7ffb0b841640 1 -- start start 2024-09-21T03:24:35.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.814+0000 7ffb0b841640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb040cf5e0 0x7ffb041590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:35.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.814+0000 7ffb0b841640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb04152740 0x7ffb0414de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:35.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.814+0000 7ffb0b841640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb0415ce50 0x7ffb040b0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:35.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.814+0000 7ffb0b841640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ffb04070a10 con 0x7ffb0415ce50 2024-09-21T03:24:35.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.814+0000 7ffb0b841640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ffb040d08a0 con 0x7ffb04152740 2024-09-21T03:24:35.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.814+0000 7ffb0b841640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ffb04070b90 con 0x7ffb040cf5e0 2024-09-21T03:24:35.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.814+0000 7ffb09dde640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb0415ce50 0x7ffb040b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:35.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.814+0000 7ffb09dde640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb0415ce50 0x7ffb040b0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:33794/0 (socket says 172.21.15.105:33794) 2024-09-21T03:24:35.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.814+0000 7ffb09dde640 1 -- 172.21.15.105:0/3731256376 learned_addr learned my addr 172.21.15.105:0/3731256376 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:35.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.814+0000 7ffb095dd640 1 --2- 172.21.15.105:0/3731256376 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb040cf5e0 0x7ffb041590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:35.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.814+0000 7ffb08ddc640 1 --2- 172.21.15.105:0/3731256376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb04152740 0x7ffb0414de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:35.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.814+0000 7ffb09dde640 1 -- 172.21.15.105:0/3731256376 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb040cf5e0 msgr2=0x7ffb041590c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:35.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.814+0000 7ffb09dde640 1 --2- 172.21.15.105:0/3731256376 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb040cf5e0 0x7ffb041590c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:35.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.814+0000 7ffb09dde640 1 -- 172.21.15.105:0/3731256376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb04152740 msgr2=0x7ffb0414de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:35.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.814+0000 7ffb09dde640 1 --2- 172.21.15.105:0/3731256376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb04152740 0x7ffb0414de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:35.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.814+0000 7ffb09dde640 1 -- 172.21.15.105:0/3731256376 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb040b6230 con 0x7ffb0415ce50 2024-09-21T03:24:35.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.814+0000 7ffb09dde640 1 --2- 172.21.15.105:0/3731256376 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb0415ce50 0x7ffb040b0840 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7ffafc02b020 tx=0x7ffafc003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:35.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.815+0000 7ffaf9ffb640 1 -- 172.21.15.105:0/3731256376 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffafc033050 con 0x7ffb0415ce50 2024-09-21T03:24:35.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.815+0000 7ffaf9ffb640 1 -- 172.21.15.105:0/3731256376 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffafc004450 con 0x7ffb0415ce50 2024-09-21T03:24:35.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.815+0000 7ffb0b841640 1 -- 172.21.15.105:0/3731256376 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb041f6e80 con 0x7ffb0415ce50 2024-09-21T03:24:35.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.815+0000 7ffaf9ffb640 1 -- 172.21.15.105:0/3731256376 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffafc004840 con 0x7ffb0415ce50 2024-09-21T03:24:35.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.815+0000 7ffb0b841640 1 -- 172.21.15.105:0/3731256376 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb041f7440 con 0x7ffb0415ce50 2024-09-21T03:24:35.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.816+0000 7ffb0b841640 1 -- 172.21.15.105:0/3731256376 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb040b5fa0 con 0x7ffb0415ce50 2024-09-21T03:24:35.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.817+0000 7ffaf9ffb640 1 -- 172.21.15.105:0/3731256376 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ffafc036070 con 0x7ffb0415ce50 2024-09-21T03:24:35.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.817+0000 7ffaf9ffb640 1 --2- 172.21.15.105:0/3731256376 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ffae8078bc0 0x7ffae807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:35.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.817+0000 7ffaf9ffb640 1 -- 172.21.15.105:0/3731256376 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 4857+0+0 (secure 0 0 0) 0x7ffafc0bbe30 con 0x7ffb0415ce50 2024-09-21T03:24:35.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.817+0000 7ffb095dd640 1 --2- 172.21.15.105:0/3731256376 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ffae8078bc0 0x7ffae807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:35.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.818+0000 7ffb095dd640 1 --2- 172.21.15.105:0/3731256376 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ffae8078bc0 0x7ffae807b0d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ffb00009960 tx=0x7ffb00005c90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:35.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:35.822+0000 7ffaf9ffb640 1 -- 172.21.15.105:0/3731256376 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ffafc037e90 con 0x7ffb0415ce50 2024-09-21T03:24:36.003 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:36.002+0000 7ffb0b841640 1 -- 172.21.15.105:0/3731256376 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ffb04076500 con 0x7ffb0415ce50 2024-09-21T03:24:36.989 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:36.987+0000 7ffaf9ffb640 1 -- 172.21.15.105:0/3731256376 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v90) ==== 138+0+0 (secure 0 0 0) 0x7ffafc084650 con 0x7ffb0415ce50 2024-09-21T03:24:36.989 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_metadata' created 2024-09-21T03:24:36.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:36.990+0000 7ffb0b841640 1 -- 172.21.15.105:0/3731256376 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ffae8078bc0 msgr2=0x7ffae807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:36.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:36.990+0000 7ffb0b841640 1 --2- 172.21.15.105:0/3731256376 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ffae8078bc0 0x7ffae807b0d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ffb00009960 tx=0x7ffb00005c90 comp rx=0 tx=0).stop 2024-09-21T03:24:36.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:36.990+0000 7ffb0b841640 1 -- 172.21.15.105:0/3731256376 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb0415ce50 msgr2=0x7ffb040b0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:36.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:36.990+0000 7ffb0b841640 1 --2- 172.21.15.105:0/3731256376 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb0415ce50 0x7ffb040b0840 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7ffafc02b020 tx=0x7ffafc003f10 comp rx=0 tx=0).stop 2024-09-21T03:24:36.993 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:36.990+0000 7ffb0b841640 1 -- 172.21.15.105:0/3731256376 shutdown_connections 2024-09-21T03:24:36.993 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:36.990+0000 7ffb0b841640 1 --2- 172.21.15.105:0/3731256376 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ffae8078bc0 0x7ffae807b0d0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:36.993 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:36.990+0000 7ffb0b841640 1 --2- 172.21.15.105:0/3731256376 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb0415ce50 0x7ffb040b0840 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:36.993 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:36.990+0000 7ffb0b841640 1 --2- 172.21.15.105:0/3731256376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb04152740 0x7ffb0414de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:36.993 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:36.990+0000 7ffb0b841640 1 --2- 172.21.15.105:0/3731256376 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb040cf5e0 0x7ffb041590c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:36.993 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:36.990+0000 7ffb0b841640 1 -- 172.21.15.105:0/3731256376 >> 172.21.15.105:0/3731256376 conn(0x7ffb04073d90 msgr2=0x7ffb040b1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:36.993 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:36.990+0000 7ffb0b841640 1 -- 172.21.15.105:0/3731256376 shutdown_connections 2024-09-21T03:24:36.993 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:36.991+0000 7ffb0b841640 1 -- 172.21.15.105:0/3731256376 wait complete. 2024-09-21T03:24:37.010 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T03:24:37.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.134+0000 7f51f17e4640 1 -- 172.21.15.105:0/898972493 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f51d4004d40 msgr2=0x7f51d4005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:37.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.134+0000 7f51f17e4640 1 --2- 172.21.15.105:0/898972493 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f51d4004d40 0x7f51d4005150 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f51e4002230 tx=0x7f51d4005830 comp rx=0 tx=0).stop 2024-09-21T03:24:37.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.134+0000 7f51eb7fe640 1 -- 172.21.15.105:0/898972493 reap_dead start 2024-09-21T03:24:37.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.134+0000 7f51f17e4640 1 -- 172.21.15.105:0/898972493 shutdown_connections 2024-09-21T03:24:37.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.134+0000 7f51f17e4640 1 -- 172.21.15.105:0/898972493 >> 172.21.15.105:0/898972493 conn(0x7f51ec08bfc0 msgr2=0x7f51ec09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:37.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.134+0000 7f51f17e4640 1 -- 172.21.15.105:0/898972493 shutdown_connections 2024-09-21T03:24:37.137 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.134+0000 7f51f17e4640 1 -- 172.21.15.105:0/898972493 wait complete. 2024-09-21T03:24:37.137 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.136+0000 7f51f17e4640 1 Processor -- start 2024-09-21T03:24:37.138 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.136+0000 7f51f17e4640 1 -- start start 2024-09-21T03:24:37.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.137+0000 7f51f17e4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51d4004d40 0x7f51ec0ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:37.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.137+0000 7f51f17e4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f51ec0cbb40 0x7f51ec0c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:37.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.137+0000 7f51f17e4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51ec157bb0 0x7f51ec0b8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:37.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.137+0000 7f51f17e4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f51ec0cf9e0 con 0x7f51ec0cbb40 2024-09-21T03:24:37.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.137+0000 7f51f17e4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f51ec0cf430 con 0x7f51ec157bb0 2024-09-21T03:24:37.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.137+0000 7f51f17e4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f51ec0cfb60 con 0x7f51d4004d40 2024-09-21T03:24:37.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.137+0000 7f51ea7fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f51ec0cbb40 0x7f51ec0c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:37.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.138+0000 7f51ea7fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f51ec0cbb40 0x7f51ec0c80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:33814/0 (socket says 172.21.15.105:33814) 2024-09-21T03:24:37.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.138+0000 7f51ea7fc640 1 -- 172.21.15.105:0/1372806286 learned_addr learned my addr 172.21.15.105:0/1372806286 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:37.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.138+0000 7f51eb7fe640 1 --2- 172.21.15.105:0/1372806286 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51ec157bb0 0x7f51ec0b8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:37.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.138+0000 7f51eaffd640 1 --2- 172.21.15.105:0/1372806286 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51d4004d40 0x7f51ec0ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:37.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.138+0000 7f51ea7fc640 1 -- 172.21.15.105:0/1372806286 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51d4004d40 msgr2=0x7f51ec0ca6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:37.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.138+0000 7f51ea7fc640 1 --2- 172.21.15.105:0/1372806286 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51d4004d40 0x7f51ec0ca6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:37.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.138+0000 7f51ea7fc640 1 -- 172.21.15.105:0/1372806286 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51ec157bb0 msgr2=0x7f51ec0b8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:37.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.138+0000 7f51ea7fc640 1 --2- 172.21.15.105:0/1372806286 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51ec157bb0 0x7f51ec0b8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:37.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.138+0000 7f51ea7fc640 1 -- 172.21.15.105:0/1372806286 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51ec0cc320 con 0x7f51ec0cbb40 2024-09-21T03:24:37.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.138+0000 7f51ea7fc640 1 --2- 172.21.15.105:0/1372806286 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f51ec0cbb40 0x7f51ec0c80f0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f51e00118e0 tx=0x7f51e0011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:37.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.138+0000 7f51d37fe640 1 -- 172.21.15.105:0/1372806286 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e0004460 con 0x7f51ec0cbb40 2024-09-21T03:24:37.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.138+0000 7f51d37fe640 1 -- 172.21.15.105:0/1372806286 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51e000f940 con 0x7f51ec0cbb40 2024-09-21T03:24:37.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.138+0000 7f51d37fe640 1 -- 172.21.15.105:0/1372806286 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e000fd90 con 0x7f51ec0cbb40 2024-09-21T03:24:37.142 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.138+0000 7f51f17e4640 1 -- 172.21.15.105:0/1372806286 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51ec0c9c00 con 0x7f51ec0cbb40 2024-09-21T03:24:37.142 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.138+0000 7f51f17e4640 1 -- 172.21.15.105:0/1372806286 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51ec0ca1c0 con 0x7f51ec0cbb40 2024-09-21T03:24:37.142 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.139+0000 7f51f17e4640 1 -- 172.21.15.105:0/1372806286 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51ec0cc090 con 0x7f51ec0cbb40 2024-09-21T03:24:37.142 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.140+0000 7f51d37fe640 1 -- 172.21.15.105:0/1372806286 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f51e0005020 con 0x7f51ec0cbb40 2024-09-21T03:24:37.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.141+0000 7f51d37fe640 1 --2- 172.21.15.105:0/1372806286 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f51d8078bc0 0x7f51d807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:37.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.141+0000 7f51d37fe640 1 -- 172.21.15.105:0/1372806286 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5227+0+0 (secure 0 0 0) 0x7f51e009b670 con 0x7f51ec0cbb40 2024-09-21T03:24:37.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.141+0000 7f51eaffd640 1 --2- 172.21.15.105:0/1372806286 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f51d8078bc0 0x7f51d807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:37.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.141+0000 7f51eaffd640 1 --2- 172.21.15.105:0/1372806286 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f51d8078bc0 0x7f51d807b0d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f51dc009cc0 tx=0x7f51dc005f30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:37.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.145+0000 7f51d37fe640 1 -- 172.21.15.105:0/1372806286 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f51e0063d20 con 0x7f51ec0cbb40 2024-09-21T03:24:37.324 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.322+0000 7f51f17e4640 1 -- 172.21.15.105:0/1372806286 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f51ec0d04d0 con 0x7f51ec0cbb40 2024-09-21T03:24:37.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.993+0000 7f51d37fe640 1 -- 172.21.15.105:0/1372806286 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v91) ==== 170+0+0 (secure 0 0 0) 0x7f51e0063620 con 0x7f51ec0cbb40 2024-09-21T03:24:37.995 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_data' created 2024-09-21T03:24:37.998 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.996+0000 7f51f17e4640 1 -- 172.21.15.105:0/1372806286 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f51d8078bc0 msgr2=0x7f51d807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:37.998 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.996+0000 7f51f17e4640 1 --2- 172.21.15.105:0/1372806286 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f51d8078bc0 0x7f51d807b0d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f51dc009cc0 tx=0x7f51dc005f30 comp rx=0 tx=0).stop 2024-09-21T03:24:37.998 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.996+0000 7f51f17e4640 1 -- 172.21.15.105:0/1372806286 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f51ec0cbb40 msgr2=0x7f51ec0c80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:37.998 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.996+0000 7f51f17e4640 1 --2- 172.21.15.105:0/1372806286 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f51ec0cbb40 0x7f51ec0c80f0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f51e00118e0 tx=0x7f51e0011ce0 comp rx=0 tx=0).stop 2024-09-21T03:24:37.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.996+0000 7f51f17e4640 1 -- 172.21.15.105:0/1372806286 shutdown_connections 2024-09-21T03:24:37.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.996+0000 7f51f17e4640 1 --2- 172.21.15.105:0/1372806286 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f51d8078bc0 0x7f51d807b0d0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:37.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.996+0000 7f51f17e4640 1 --2- 172.21.15.105:0/1372806286 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51ec157bb0 0x7f51ec0b8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:37.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.996+0000 7f51f17e4640 1 --2- 172.21.15.105:0/1372806286 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f51ec0cbb40 0x7f51ec0c80f0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:37.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.996+0000 7f51f17e4640 1 --2- 172.21.15.105:0/1372806286 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51d4004d40 0x7f51ec0ca6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:37.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.996+0000 7f51f17e4640 1 -- 172.21.15.105:0/1372806286 >> 172.21.15.105:0/1372806286 conn(0x7f51ec08bfc0 msgr2=0x7f51ec0b5f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:37.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.996+0000 7f51f17e4640 1 -- 172.21.15.105:0/1372806286 shutdown_connections 2024-09-21T03:24:37.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:37.997+0000 7f51f17e4640 1 -- 172.21.15.105:0/1372806286 wait complete. 2024-09-21T03:24:38.025 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T03:24:38.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.143+0000 7ff77fbc3640 1 -- 172.21.15.105:0/360547694 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7780b4a50 msgr2=0x7ff7780b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:38.145 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.143+0000 7ff77fbc3640 1 --2- 172.21.15.105:0/360547694 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7780b4a50 0x7ff7780b4e60 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7ff770005fd0 tx=0x7ff77002aa90 comp rx=0 tx=0).stop 2024-09-21T03:24:38.145 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.143+0000 7ff77fbc3640 1 -- 172.21.15.105:0/360547694 shutdown_connections 2024-09-21T03:24:38.145 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.143+0000 7ff77fbc3640 1 --2- 172.21.15.105:0/360547694 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7780b4a50 0x7ff7780b4e60 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:38.145 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.143+0000 7ff77fbc3640 1 --2- 172.21.15.105:0/360547694 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7780d2430 0x7ff7780cf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:38.145 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.143+0000 7ff77fbc3640 1 -- 172.21.15.105:0/360547694 >> 172.21.15.105:0/360547694 conn(0x7ff77809d880 msgr2=0x7ff77808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:38.145 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.143+0000 7ff77fbc3640 1 -- 172.21.15.105:0/360547694 shutdown_connections 2024-09-21T03:24:38.145 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.143+0000 7ff77fbc3640 1 -- 172.21.15.105:0/360547694 wait complete. 2024-09-21T03:24:38.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.144+0000 7ff77fbc3640 1 Processor -- start 2024-09-21T03:24:38.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.145+0000 7ff77fbc3640 1 -- start start 2024-09-21T03:24:38.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.146+0000 7ff77fbc3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7780b4a50 0x7ff778150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:38.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.146+0000 7ff77fbc3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7780d0c70 0x7ff778150c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:38.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.146+0000 7ff77fbc3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7780d2430 0x7ff7781f90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:38.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.146+0000 7ff77fbc3640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff7780b5520 con 0x7ff7780b4a50 2024-09-21T03:24:38.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.146+0000 7ff77fbc3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff7780b53a0 con 0x7ff7780d2430 2024-09-21T03:24:38.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.146+0000 7ff77fbc3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff7780b56a0 con 0x7ff7780d0c70 2024-09-21T03:24:38.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.146+0000 7ff77d95f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7780b4a50 0x7ff778150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:38.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.146+0000 7ff77d95f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7780b4a50 0x7ff778150700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:33844/0 (socket says 172.21.15.105:33844) 2024-09-21T03:24:38.150 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.146+0000 7ff77d95f640 1 -- 172.21.15.105:0/2008955987 learned_addr learned my addr 172.21.15.105:0/2008955987 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:38.150 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.146+0000 7ff77e160640 1 --2- 172.21.15.105:0/2008955987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7780d2430 0x7ff7781f90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:38.150 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.146+0000 7ff77d15e640 1 --2- 172.21.15.105:0/2008955987 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7780d0c70 0x7ff778150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:38.150 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.146+0000 7ff77d95f640 1 -- 172.21.15.105:0/2008955987 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7780d0c70 msgr2=0x7ff778150c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:38.150 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.146+0000 7ff77d95f640 1 --2- 172.21.15.105:0/2008955987 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7780d0c70 0x7ff778150c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:38.150 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.146+0000 7ff77d95f640 1 -- 172.21.15.105:0/2008955987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7780d2430 msgr2=0x7ff7781f90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:38.150 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.146+0000 7ff77d95f640 1 --2- 172.21.15.105:0/2008955987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7780d2430 0x7ff7781f90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:38.150 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.146+0000 7ff77d95f640 1 -- 172.21.15.105:0/2008955987 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7780cac10 con 0x7ff7780b4a50 2024-09-21T03:24:38.150 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.146+0000 7ff77e160640 1 --2- 172.21.15.105:0/2008955987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7780d2430 0x7ff7781f90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:24:38.150 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.146+0000 7ff77d15e640 1 --2- 172.21.15.105:0/2008955987 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7780d0c70 0x7ff778150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:24:38.150 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.146+0000 7ff77d95f640 1 --2- 172.21.15.105:0/2008955987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7780b4a50 0x7ff778150700 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7ff77400c970 tx=0x7ff77400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:38.150 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.147+0000 7ff76e7fc640 1 -- 172.21.15.105:0/2008955987 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff774007bb0 con 0x7ff7780b4a50 2024-09-21T03:24:38.150 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.147+0000 7ff76e7fc640 1 -- 172.21.15.105:0/2008955987 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff774007e40 con 0x7ff7780b4a50 2024-09-21T03:24:38.150 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.147+0000 7ff77fbc3640 1 -- 172.21.15.105:0/2008955987 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7780cc740 con 0x7ff7780b4a50 2024-09-21T03:24:38.151 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.147+0000 7ff76e7fc640 1 -- 172.21.15.105:0/2008955987 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77400f690 con 0x7ff7780b4a50 2024-09-21T03:24:38.151 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.147+0000 7ff77fbc3640 1 -- 172.21.15.105:0/2008955987 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7780c9180 con 0x7ff7780b4a50 2024-09-21T03:24:38.151 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.148+0000 7ff77fbc3640 1 -- 172.21.15.105:0/2008955987 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7780c93e0 con 0x7ff7780b4a50 2024-09-21T03:24:38.151 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.148+0000 7ff76e7fc640 1 -- 172.21.15.105:0/2008955987 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff774018400 con 0x7ff7780b4a50 2024-09-21T03:24:38.151 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.149+0000 7ff76e7fc640 1 --2- 172.21.15.105:0/2008955987 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff75c078bc0 0x7ff75c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:38.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.149+0000 7ff76e7fc640 1 -- 172.21.15.105:0/2008955987 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5609+0+0 (secure 0 0 0) 0x7ff77409b530 con 0x7ff7780b4a50 2024-09-21T03:24:38.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.149+0000 7ff77d15e640 1 --2- 172.21.15.105:0/2008955987 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff75c078bc0 0x7ff75c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:38.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.150+0000 7ff77d15e640 1 --2- 172.21.15.105:0/2008955987 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff75c078bc0 0x7ff75c07b0d0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff77806fbd0 tx=0x7ff768009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:38.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.154+0000 7ff76e7fc640 1 -- 172.21.15.105:0/2008955987 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff774014030 con 0x7ff7780b4a50 2024-09-21T03:24:38.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.368+0000 7ff77fbc3640 1 -- 172.21.15.105:0/2008955987 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7ff7780b4e60 con 0x7ff7780b4a50 2024-09-21T03:24:38.996 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.995+0000 7ff76e7fc640 1 -- 172.21.15.105:0/2008955987 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v55) ==== 174+0+0 (secure 0 0 0) 0x7ff7740639d0 con 0x7ff7780b4a50 2024-09-21T03:24:38.997 INFO:teuthology.orchestra.run.smithi105.stderr:new fs with metadata pool 14 and data pool 15 2024-09-21T03:24:39.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.999+0000 7ff77fbc3640 1 -- 172.21.15.105:0/2008955987 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff75c078bc0 msgr2=0x7ff75c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:39.001 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.999+0000 7ff77fbc3640 1 --2- 172.21.15.105:0/2008955987 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff75c078bc0 0x7ff75c07b0d0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff77806fbd0 tx=0x7ff768009040 comp rx=0 tx=0).stop 2024-09-21T03:24:39.001 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.999+0000 7ff77fbc3640 1 -- 172.21.15.105:0/2008955987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7780b4a50 msgr2=0x7ff778150700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:39.001 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.999+0000 7ff77fbc3640 1 --2- 172.21.15.105:0/2008955987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7780b4a50 0x7ff778150700 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7ff77400c970 tx=0x7ff77400ce30 comp rx=0 tx=0).stop 2024-09-21T03:24:39.002 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.999+0000 7ff77fbc3640 1 -- 172.21.15.105:0/2008955987 shutdown_connections 2024-09-21T03:24:39.002 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.999+0000 7ff77fbc3640 1 --2- 172.21.15.105:0/2008955987 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff75c078bc0 0x7ff75c07b0d0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:39.002 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.999+0000 7ff77fbc3640 1 --2- 172.21.15.105:0/2008955987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7780d2430 0x7ff7781f90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:39.002 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.999+0000 7ff77fbc3640 1 --2- 172.21.15.105:0/2008955987 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7780d0c70 0x7ff778150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:39.002 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.999+0000 7ff77fbc3640 1 --2- 172.21.15.105:0/2008955987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7780b4a50 0x7ff778150700 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:39.002 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:38.999+0000 7ff77fbc3640 1 -- 172.21.15.105:0/2008955987 >> 172.21.15.105:0/2008955987 conn(0x7ff77809d880 msgr2=0x7ff7780b9630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:39.002 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.000+0000 7ff77fbc3640 1 -- 172.21.15.105:0/2008955987 shutdown_connections 2024-09-21T03:24:39.002 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.001+0000 7ff77fbc3640 1 -- 172.21.15.105:0/2008955987 wait complete. 2024-09-21T03:24:39.040 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:24:39.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.154+0000 7f1243d6e640 1 -- 172.21.15.105:0/1861913553 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f123c072ff0 msgr2=0x7f123c073400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:39.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.154+0000 7f1243d6e640 1 --2- 172.21.15.105:0/1861913553 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f123c072ff0 0x7f123c073400 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f1234005fd0 tx=0x7f123402a8b0 comp rx=0 tx=0).stop 2024-09-21T03:24:39.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.154+0000 7f1243d6e640 1 -- 172.21.15.105:0/1861913553 shutdown_connections 2024-09-21T03:24:39.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.154+0000 7f1243d6e640 1 --2- 172.21.15.105:0/1861913553 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f123c072ff0 0x7f123c073400 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:39.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.154+0000 7f1243d6e640 1 -- 172.21.15.105:0/1861913553 >> 172.21.15.105:0/1861913553 conn(0x7f123c06d7d0 msgr2=0x7f123c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:39.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.154+0000 7f1243d6e640 1 -- 172.21.15.105:0/1861913553 shutdown_connections 2024-09-21T03:24:39.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.154+0000 7f1243d6e640 1 -- 172.21.15.105:0/1861913553 wait complete. 2024-09-21T03:24:39.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.156+0000 7f1243d6e640 1 Processor -- start 2024-09-21T03:24:39.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.156+0000 7f1243d6e640 1 -- start start 2024-09-21T03:24:39.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.157+0000 7f1243d6e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f123c072ff0 0x7f123c155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:39.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.157+0000 7f1243d6e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f123c0af780 0x7f123c09be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:39.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.157+0000 7f1243d6e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f123c0cd3e0 0x7f123c09c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:39.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.157+0000 7f1243d6e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f123c166bf0 con 0x7f123c072ff0 2024-09-21T03:24:39.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.157+0000 7f1243d6e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f123c073bf0 con 0x7f123c0af780 2024-09-21T03:24:39.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.157+0000 7f1243d6e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f123c166d70 con 0x7f123c0cd3e0 2024-09-21T03:24:39.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.157+0000 7f1241b0a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f123c072ff0 0x7f123c155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:39.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.157+0000 7f1241b0a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f123c072ff0 0x7f123c155a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:33866/0 (socket says 172.21.15.105:33866) 2024-09-21T03:24:39.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.157+0000 7f1241b0a640 1 -- 172.21.15.105:0/1722723269 learned_addr learned my addr 172.21.15.105:0/1722723269 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:39.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.157+0000 7f124230b640 1 --2- 172.21.15.105:0/1722723269 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f123c0cd3e0 0x7f123c09c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:39.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.157+0000 7f1241309640 1 --2- 172.21.15.105:0/1722723269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f123c0af780 0x7f123c09be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:39.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.157+0000 7f1241b0a640 1 -- 172.21.15.105:0/1722723269 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f123c0cd3e0 msgr2=0x7f123c09c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:39.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.157+0000 7f1241b0a640 1 --2- 172.21.15.105:0/1722723269 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f123c0cd3e0 0x7f123c09c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:39.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.157+0000 7f1241b0a640 1 -- 172.21.15.105:0/1722723269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f123c0af780 msgr2=0x7f123c09be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:39.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.157+0000 7f1241b0a640 1 --2- 172.21.15.105:0/1722723269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f123c0af780 0x7f123c09be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:39.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.157+0000 7f1241b0a640 1 -- 172.21.15.105:0/1722723269 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f123c15ada0 con 0x7f123c072ff0 2024-09-21T03:24:39.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.158+0000 7f1241b0a640 1 --2- 172.21.15.105:0/1722723269 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f123c072ff0 0x7f123c155a50 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f123800c430 tx=0x7f123800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:39.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.158+0000 7f12327fc640 1 -- 172.21.15.105:0/1722723269 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1238011790 con 0x7f123c072ff0 2024-09-21T03:24:39.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.158+0000 7f12327fc640 1 -- 172.21.15.105:0/1722723269 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1238017070 con 0x7f123c072ff0 2024-09-21T03:24:39.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.158+0000 7f1243d6e640 1 -- 172.21.15.105:0/1722723269 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f123c15b080 con 0x7f123c072ff0 2024-09-21T03:24:39.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.158+0000 7f12327fc640 1 -- 172.21.15.105:0/1722723269 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1238011ce0 con 0x7f123c072ff0 2024-09-21T03:24:39.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.158+0000 7f1243d6e640 1 -- 172.21.15.105:0/1722723269 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f123c15b640 con 0x7f123c072ff0 2024-09-21T03:24:39.162 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.159+0000 7f1243d6e640 1 -- 172.21.15.105:0/1722723269 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f123c0b26c0 con 0x7f123c072ff0 2024-09-21T03:24:39.162 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.160+0000 7f12327fc640 1 -- 172.21.15.105:0/1722723269 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f123801c460 con 0x7f123c072ff0 2024-09-21T03:24:39.162 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.160+0000 7f12327fc640 1 --2- 172.21.15.105:0/1722723269 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1220078bc0 0x7f122007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:39.162 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.161+0000 7f12327fc640 1 -- 172.21.15.105:0/1722723269 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f123809aae0 con 0x7f123c072ff0 2024-09-21T03:24:39.162 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.161+0000 7f1241309640 1 --2- 172.21.15.105:0/1722723269 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1220078bc0 0x7f122007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:39.163 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.161+0000 7f1241309640 1 --2- 172.21.15.105:0/1722723269 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1220078bc0 0x7f122007b0d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f123c15a950 tx=0x7f122c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:39.166 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.165+0000 7f12327fc640 1 -- 172.21.15.105:0/1722723269 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1238062f20 con 0x7f123c072ff0 2024-09-21T03:24:39.347 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.345+0000 7f1243d6e640 1 -- 172.21.15.105:0/1722723269 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f123c15cca0 con 0x7f123c072ff0 2024-09-21T03:24:39.348 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.347+0000 7f12327fc640 1 -- 172.21.15.105:0/1722723269 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+16753 (secure 0 0 0) 0x7f1238062820 con 0x7f123c072ff0 2024-09-21T03:24:39.348 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:24:39.349 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":92,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:24:38.369536+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:24:36.006836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-21T03:24:37.327374+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:24:39.351 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.349+0000 7f1243d6e640 1 -- 172.21.15.105:0/1722723269 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1220078bc0 msgr2=0x7f122007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:39.351 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.349+0000 7f1243d6e640 1 --2- 172.21.15.105:0/1722723269 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1220078bc0 0x7f122007b0d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f123c15a950 tx=0x7f122c009040 comp rx=0 tx=0).stop 2024-09-21T03:24:39.351 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.349+0000 7f1243d6e640 1 -- 172.21.15.105:0/1722723269 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f123c072ff0 msgr2=0x7f123c155a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:39.351 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.349+0000 7f1243d6e640 1 --2- 172.21.15.105:0/1722723269 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f123c072ff0 0x7f123c155a50 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f123800c430 tx=0x7f123800c8f0 comp rx=0 tx=0).stop 2024-09-21T03:24:39.351 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.349+0000 7f1243d6e640 1 -- 172.21.15.105:0/1722723269 shutdown_connections 2024-09-21T03:24:39.351 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.349+0000 7f1243d6e640 1 --2- 172.21.15.105:0/1722723269 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1220078bc0 0x7f122007b0d0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:39.351 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.349+0000 7f1243d6e640 1 --2- 172.21.15.105:0/1722723269 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f123c0cd3e0 0x7f123c09c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:39.351 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.349+0000 7f1243d6e640 1 --2- 172.21.15.105:0/1722723269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f123c0af780 0x7f123c09be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:39.351 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.349+0000 7f1243d6e640 1 --2- 172.21.15.105:0/1722723269 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f123c072ff0 0x7f123c155a50 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:39.351 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.349+0000 7f1243d6e640 1 -- 172.21.15.105:0/1722723269 >> 172.21.15.105:0/1722723269 conn(0x7f123c06d7d0 msgr2=0x7f123c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:39.351 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.349+0000 7f1243d6e640 1 -- 172.21.15.105:0/1722723269 shutdown_connections 2024-09-21T03:24:39.352 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.349+0000 7f1243d6e640 1 -- 172.21.15.105:0/1722723269 wait complete. 2024-09-21T03:24:39.362 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:24:39.475 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.473+0000 7f2880520640 1 -- 172.21.15.105:0/4125725398 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2864004800 msgr2=0x7f2864004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:39.475 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.473+0000 7f2880520640 1 --2- 172.21.15.105:0/4125725398 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2864004800 0x7f2864004c10 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f286800c6e0 tx=0x7f2864005830 comp rx=0 tx=0).stop 2024-09-21T03:24:39.475 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.473+0000 7f2880520640 1 -- 172.21.15.105:0/4125725398 shutdown_connections 2024-09-21T03:24:39.475 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.473+0000 7f2880520640 1 --2- 172.21.15.105:0/4125725398 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2864004800 0x7f2864004c10 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:39.475 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.473+0000 7f2880520640 1 -- 172.21.15.105:0/4125725398 >> 172.21.15.105:0/4125725398 conn(0x7f287806d7d0 msgr2=0x7f28780b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:39.475 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.473+0000 7f2880520640 1 -- 172.21.15.105:0/4125725398 shutdown_connections 2024-09-21T03:24:39.475 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.473+0000 7f2880520640 1 -- 172.21.15.105:0/4125725398 wait complete. 2024-09-21T03:24:39.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.475+0000 7f2880520640 1 Processor -- start 2024-09-21T03:24:39.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.475+0000 7f2880520640 1 -- start start 2024-09-21T03:24:39.479 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.476+0000 7f2880520640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2864004800 0x7f287815e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:39.480 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.476+0000 7f2880520640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f287814efa0 0x7f287806ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:39.480 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.476+0000 7f2880520640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f287814f3b0 0x7f287806f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:39.480 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.476+0000 7f2880520640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f28780b3eb0 con 0x7f287814efa0 2024-09-21T03:24:39.480 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.476+0000 7f2880520640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f28780b3d30 con 0x7f2864004800 2024-09-21T03:24:39.480 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.476+0000 7f2880520640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2878070180 con 0x7f287814f3b0 2024-09-21T03:24:39.480 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.476+0000 7f287dabb640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f287814efa0 0x7f287806ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:39.480 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.477+0000 7f287dabb640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f287814efa0 0x7f287806ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:33874/0 (socket says 172.21.15.105:33874) 2024-09-21T03:24:39.480 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.477+0000 7f287dabb640 1 -- 172.21.15.105:0/3434211011 learned_addr learned my addr 172.21.15.105:0/3434211011 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:39.480 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.477+0000 7f287eabd640 1 --2- 172.21.15.105:0/3434211011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f287814f3b0 0x7f287806f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:39.480 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.477+0000 7f287e2bc640 1 --2- 172.21.15.105:0/3434211011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2864004800 0x7f287815e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:39.480 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.477+0000 7f287dabb640 1 -- 172.21.15.105:0/3434211011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f287814f3b0 msgr2=0x7f287806f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:39.480 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.477+0000 7f287dabb640 1 --2- 172.21.15.105:0/3434211011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f287814f3b0 0x7f287806f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:39.480 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.477+0000 7f287dabb640 1 -- 172.21.15.105:0/3434211011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2864004800 msgr2=0x7f287815e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:39.481 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.477+0000 7f287dabb640 1 --2- 172.21.15.105:0/3434211011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2864004800 0x7f287815e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:39.481 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.477+0000 7f287dabb640 1 -- 172.21.15.105:0/3434211011 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f287815b570 con 0x7f287814efa0 2024-09-21T03:24:39.481 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.477+0000 7f287eabd640 1 --2- 172.21.15.105:0/3434211011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f287814f3b0 0x7f287806f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:24:39.481 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.477+0000 7f287dabb640 1 --2- 172.21.15.105:0/3434211011 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f287814efa0 0x7f287806ee90 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f286800c800 tx=0x7f2868006380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:39.481 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.477+0000 7f286effd640 1 -- 172.21.15.105:0/3434211011 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2868004830 con 0x7f287814efa0 2024-09-21T03:24:39.481 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.477+0000 7f286effd640 1 -- 172.21.15.105:0/3434211011 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2868039070 con 0x7f287814efa0 2024-09-21T03:24:39.481 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.477+0000 7f286effd640 1 -- 172.21.15.105:0/3434211011 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2868004d80 con 0x7f287814efa0 2024-09-21T03:24:39.481 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.477+0000 7f2880520640 1 -- 172.21.15.105:0/3434211011 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f287815daf0 con 0x7f287814efa0 2024-09-21T03:24:39.481 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.477+0000 7f2880520640 1 -- 172.21.15.105:0/3434211011 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28781e6980 con 0x7f287814efa0 2024-09-21T03:24:39.481 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.478+0000 7f2880520640 1 -- 172.21.15.105:0/3434211011 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f287815e010 con 0x7f287814efa0 2024-09-21T03:24:39.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.479+0000 7f286effd640 1 -- 172.21.15.105:0/3434211011 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2868043030 con 0x7f287814efa0 2024-09-21T03:24:39.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.479+0000 7f286effd640 1 --2- 172.21.15.105:0/3434211011 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f285c078b90 0x7f285c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:39.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.479+0000 7f286effd640 1 -- 172.21.15.105:0/3434211011 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f28680ba700 con 0x7f287814efa0 2024-09-21T03:24:39.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.480+0000 7f287e2bc640 1 --2- 172.21.15.105:0/3434211011 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f285c078b90 0x7f285c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:39.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.480+0000 7f287e2bc640 1 --2- 172.21.15.105:0/3434211011 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f285c078b90 0x7f285c07b0a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f2874001860 tx=0x7f2874001c90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:39.485 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.484+0000 7f286effd640 1 -- 172.21.15.105:0/3434211011 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f287815e010 con 0x7f287814efa0 2024-09-21T03:24:39.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.660+0000 7f2880520640 1 -- 172.21.15.105:0/3434211011 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f28780b1980 con 0x7f287814efa0 2024-09-21T03:24:39.662 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.661+0000 7f286effd640 1 -- 172.21.15.105:0/3434211011 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+16753 (secure 0 0 0) 0x7f28780b1980 con 0x7f287814efa0 2024-09-21T03:24:39.663 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:24:39.663 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":92,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:24:38.369536+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:24:36.006836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-21T03:24:37.327374+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:24:39.666 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.663+0000 7f2880520640 1 -- 172.21.15.105:0/3434211011 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f285c078b90 msgr2=0x7f285c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:39.666 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.663+0000 7f2880520640 1 --2- 172.21.15.105:0/3434211011 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f285c078b90 0x7f285c07b0a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f2874001860 tx=0x7f2874001c90 comp rx=0 tx=0).stop 2024-09-21T03:24:39.666 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.663+0000 7f2880520640 1 -- 172.21.15.105:0/3434211011 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f287814efa0 msgr2=0x7f287806ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:39.666 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.663+0000 7f2880520640 1 --2- 172.21.15.105:0/3434211011 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f287814efa0 0x7f287806ee90 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f286800c800 tx=0x7f2868006380 comp rx=0 tx=0).stop 2024-09-21T03:24:39.666 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.663+0000 7f2880520640 1 -- 172.21.15.105:0/3434211011 shutdown_connections 2024-09-21T03:24:39.666 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.663+0000 7f2880520640 1 --2- 172.21.15.105:0/3434211011 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f285c078b90 0x7f285c07b0a0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:39.667 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.663+0000 7f2880520640 1 --2- 172.21.15.105:0/3434211011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f287814f3b0 0x7f287806f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:39.667 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.663+0000 7f2880520640 1 --2- 172.21.15.105:0/3434211011 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f287814efa0 0x7f287806ee90 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:39.667 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.663+0000 7f2880520640 1 --2- 172.21.15.105:0/3434211011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2864004800 0x7f287815e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:39.667 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.663+0000 7f2880520640 1 -- 172.21.15.105:0/3434211011 >> 172.21.15.105:0/3434211011 conn(0x7f287806d7d0 msgr2=0x7f28780ad020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:39.667 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.663+0000 7f2880520640 1 -- 172.21.15.105:0/3434211011 shutdown_connections 2024-09-21T03:24:39.667 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.663+0000 7f2880520640 1 -- 172.21.15.105:0/3434211011 wait complete. 2024-09-21T03:24:39.676 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T03:24:39.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.790+0000 7fa796664640 1 -- 172.21.15.105:0/282805007 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7900cad30 msgr2=0x7fa7900735b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:39.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.790+0000 7fa796664640 1 --2- 172.21.15.105:0/282805007 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7900cad30 0x7fa7900735b0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fa788005fd0 tx=0x7fa78802a8b0 comp rx=0 tx=0).stop 2024-09-21T03:24:39.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.790+0000 7fa796664640 1 -- 172.21.15.105:0/282805007 shutdown_connections 2024-09-21T03:24:39.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.790+0000 7fa796664640 1 --2- 172.21.15.105:0/282805007 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7900cad30 0x7fa7900735b0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:39.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.790+0000 7fa796664640 1 --2- 172.21.15.105:0/282805007 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7900706b0 0x7fa7900cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:39.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.790+0000 7fa796664640 1 -- 172.21.15.105:0/282805007 >> 172.21.15.105:0/282805007 conn(0x7fa7900b1cb0 msgr2=0x7fa7900b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:39.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.790+0000 7fa796664640 1 -- 172.21.15.105:0/282805007 shutdown_connections 2024-09-21T03:24:39.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.790+0000 7fa796664640 1 -- 172.21.15.105:0/282805007 wait complete. 2024-09-21T03:24:39.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.792+0000 7fa796664640 1 Processor -- start 2024-09-21T03:24:39.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.792+0000 7fa796664640 1 -- start start 2024-09-21T03:24:39.796 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.793+0000 7fa796664640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7900ca800 0x7fa7900c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:39.796 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.793+0000 7fa796664640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7900cad30 0x7fa7900c6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:39.796 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.793+0000 7fa796664640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7901f56d0 0x7fa79015bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:39.796 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.793+0000 7fa796664640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa790073f00 con 0x7fa7901f56d0 2024-09-21T03:24:39.796 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.793+0000 7fa796664640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa790073d80 con 0x7fa7900cad30 2024-09-21T03:24:39.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.793+0000 7fa796664640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa790074080 con 0x7fa7900ca800 2024-09-21T03:24:39.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.793+0000 7fa794c01640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7901f56d0 0x7fa79015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:39.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.793+0000 7fa794c01640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7901f56d0 0x7fa79015bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:33890/0 (socket says 172.21.15.105:33890) 2024-09-21T03:24:39.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.793+0000 7fa794c01640 1 -- 172.21.15.105:0/1453842803 learned_addr learned my addr 172.21.15.105:0/1453842803 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:39.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.794+0000 7fa78f7fe640 1 --2- 172.21.15.105:0/1453842803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7900cad30 0x7fa7900c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:39.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.794+0000 7fa78ffff640 1 --2- 172.21.15.105:0/1453842803 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7900ca800 0x7fa7900c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:39.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.794+0000 7fa794c01640 1 -- 172.21.15.105:0/1453842803 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7900ca800 msgr2=0x7fa7900c5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:39.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.794+0000 7fa794c01640 1 --2- 172.21.15.105:0/1453842803 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7900ca800 0x7fa7900c5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:39.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.794+0000 7fa794c01640 1 -- 172.21.15.105:0/1453842803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7900cad30 msgr2=0x7fa7900c6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:39.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.794+0000 7fa794c01640 1 --2- 172.21.15.105:0/1453842803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7900cad30 0x7fa7900c6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:39.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.794+0000 7fa794c01640 1 -- 172.21.15.105:0/1453842803 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa79015ecf0 con 0x7fa7901f56d0 2024-09-21T03:24:39.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.794+0000 7fa78f7fe640 1 --2- 172.21.15.105:0/1453842803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7900cad30 0x7fa7900c6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:24:39.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.794+0000 7fa794c01640 1 --2- 172.21.15.105:0/1453842803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7901f56d0 0x7fa79015bee0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fa78802aea0 tx=0x7fa7880039f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:39.798 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.794+0000 7fa78cff9640 1 -- 172.21.15.105:0/1453842803 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa788004040 con 0x7fa7901f56d0 2024-09-21T03:24:39.798 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.794+0000 7fa78cff9640 1 -- 172.21.15.105:0/1453842803 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa7880042d0 con 0x7fa7901f56d0 2024-09-21T03:24:39.798 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.794+0000 7fa796664640 1 -- 172.21.15.105:0/1453842803 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7900c4de0 con 0x7fa7901f56d0 2024-09-21T03:24:39.798 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.794+0000 7fa78cff9640 1 -- 172.21.15.105:0/1453842803 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa788004700 con 0x7fa7901f56d0 2024-09-21T03:24:39.798 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.794+0000 7fa796664640 1 -- 172.21.15.105:0/1453842803 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7900c5360 con 0x7fa7901f56d0 2024-09-21T03:24:39.799 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.795+0000 7fa796664640 1 -- 172.21.15.105:0/1453842803 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7900745b0 con 0x7fa7901f56d0 2024-09-21T03:24:39.799 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.796+0000 7fa78cff9640 1 -- 172.21.15.105:0/1453842803 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa78803d430 con 0x7fa7901f56d0 2024-09-21T03:24:39.799 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.796+0000 7fa78cff9640 1 --2- 172.21.15.105:0/1453842803 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa77c078b90 0x7fa77c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:39.799 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.796+0000 7fa78cff9640 1 -- 172.21.15.105:0/1453842803 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7fa7880bea10 con 0x7fa7901f56d0 2024-09-21T03:24:39.799 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.796+0000 7fa78ffff640 1 --2- 172.21.15.105:0/1453842803 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa77c078b90 0x7fa77c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:39.799 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.797+0000 7fa78ffff640 1 --2- 172.21.15.105:0/1453842803 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa77c078b90 0x7fa77c07b0a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa7900cb250 tx=0x7fa780009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:39.802 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:39.801+0000 7fa78cff9640 1 -- 172.21.15.105:0/1453842803 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa788041030 con 0x7fa7901f56d0 2024-09-21T03:24:39.974 INFO:tasks.ceph.mds.c.smithi105.stderr:2024-09-21T03:24:39.972+0000 7fba08f84640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T03:24:40.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:40.018+0000 7fa796664640 1 -- 172.21.15.105:0/1453842803 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fa79015ea80 con 0x7fa7901f56d0 2024-09-21T03:24:41.017 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.015+0000 7fa78cff9640 1 -- 172.21.15.105:0/1453842803 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v57) ==== 118+0+0 (secure 0 0 0) 0x7fa7880317b0 con 0x7fa7901f56d0 2024-09-21T03:24:41.020 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.018+0000 7fa796664640 1 -- 172.21.15.105:0/1453842803 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa77c078b90 msgr2=0x7fa77c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:41.020 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.018+0000 7fa796664640 1 --2- 172.21.15.105:0/1453842803 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa77c078b90 0x7fa77c07b0a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa7900cb250 tx=0x7fa780009040 comp rx=0 tx=0).stop 2024-09-21T03:24:41.020 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.018+0000 7fa796664640 1 -- 172.21.15.105:0/1453842803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7901f56d0 msgr2=0x7fa79015bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:41.020 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.018+0000 7fa796664640 1 --2- 172.21.15.105:0/1453842803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7901f56d0 0x7fa79015bee0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fa78802aea0 tx=0x7fa7880039f0 comp rx=0 tx=0).stop 2024-09-21T03:24:41.020 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.018+0000 7fa796664640 1 -- 172.21.15.105:0/1453842803 shutdown_connections 2024-09-21T03:24:41.020 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.018+0000 7fa796664640 1 --2- 172.21.15.105:0/1453842803 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa77c078b90 0x7fa77c07b0a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:41.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.018+0000 7fa796664640 1 --2- 172.21.15.105:0/1453842803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7901f56d0 0x7fa79015bee0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:41.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.018+0000 7fa796664640 1 --2- 172.21.15.105:0/1453842803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7900cad30 0x7fa7900c6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:41.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.018+0000 7fa796664640 1 --2- 172.21.15.105:0/1453842803 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7900ca800 0x7fa7900c5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:41.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.018+0000 7fa796664640 1 -- 172.21.15.105:0/1453842803 >> 172.21.15.105:0/1453842803 conn(0x7fa7900b1cb0 msgr2=0x7fa7900b3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:41.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.018+0000 7fa796664640 1 -- 172.21.15.105:0/1453842803 shutdown_connections 2024-09-21T03:24:41.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.018+0000 7fa796664640 1 -- 172.21.15.105:0/1453842803 wait complete. 2024-09-21T03:24:41.032 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T03:24:41.033 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T03:24:41.151 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.149+0000 7f8ebdb13640 1 -- 172.21.15.105:0/1124075141 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ea0004800 msgr2=0x7f8ea0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:41.151 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.149+0000 7f8ebdb13640 1 --2- 172.21.15.105:0/1124075141 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ea0004800 0x7f8ea0004c10 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f8eac009b50 tx=0x7f8ea0005830 comp rx=0 tx=0).stop 2024-09-21T03:24:41.151 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.149+0000 7f8ebdb13640 1 -- 172.21.15.105:0/1124075141 shutdown_connections 2024-09-21T03:24:41.151 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.149+0000 7f8ebdb13640 1 --2- 172.21.15.105:0/1124075141 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ea0004800 0x7f8ea0004c10 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:41.151 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.149+0000 7f8ebdb13640 1 -- 172.21.15.105:0/1124075141 >> 172.21.15.105:0/1124075141 conn(0x7f8eb808bfc0 msgr2=0x7f8eb809d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:41.151 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.149+0000 7f8ebdb13640 1 -- 172.21.15.105:0/1124075141 shutdown_connections 2024-09-21T03:24:41.151 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.149+0000 7f8ebdb13640 1 -- 172.21.15.105:0/1124075141 wait complete. 2024-09-21T03:24:41.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.151+0000 7f8ebdb13640 1 Processor -- start 2024-09-21T03:24:41.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.151+0000 7f8ebdb13640 1 -- start start 2024-09-21T03:24:41.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.152+0000 7f8ebdb13640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ea0004800 0x7f8eb8160560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:41.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.152+0000 7f8ebdb13640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8eb814da40 0x7f8eb8160aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:41.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.152+0000 7f8ebdb13640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eb815c080 0x7f8eb8150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:41.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.152+0000 7f8ebdb13640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb80cfd70 con 0x7f8eb814da40 2024-09-21T03:24:41.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.152+0000 7f8ebdb13640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb80cfbf0 con 0x7f8eb815c080 2024-09-21T03:24:41.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.152+0000 7f8ebdb13640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8eb80cfef0 con 0x7f8ea0004800 2024-09-21T03:24:41.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.152+0000 7f8eb6ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8eb814da40 0x7f8eb8160aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:41.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.152+0000 7f8eb6ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8eb814da40 0x7f8eb8160aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:33902/0 (socket says 172.21.15.105:33902) 2024-09-21T03:24:41.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.152+0000 7f8eb6ffd640 1 -- 172.21.15.105:0/2762274950 learned_addr learned my addr 172.21.15.105:0/2762274950 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:41.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.152+0000 7f8eb6ffd640 1 -- 172.21.15.105:0/2762274950 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ea0004800 msgr2=0x7f8eb8160560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:41.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.152+0000 7f8eb6ffd640 1 --2- 172.21.15.105:0/2762274950 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ea0004800 0x7f8eb8160560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:41.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.152+0000 7f8eb7fff640 1 --2- 172.21.15.105:0/2762274950 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eb815c080 0x7f8eb8150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:41.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.152+0000 7f8eb6ffd640 1 -- 172.21.15.105:0/2762274950 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eb815c080 msgr2=0x7f8eb8150620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:41.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.153+0000 7f8eb6ffd640 1 --2- 172.21.15.105:0/2762274950 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eb815c080 0x7f8eb8150620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:41.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.153+0000 7f8eb6ffd640 1 -- 172.21.15.105:0/2762274950 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb81f9510 con 0x7f8eb814da40 2024-09-21T03:24:41.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.153+0000 7f8eb6ffd640 1 --2- 172.21.15.105:0/2762274950 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8eb814da40 0x7f8eb8160aa0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f8eac036040 tx=0x7f8eac0336f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:41.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.153+0000 7f8e9ffff640 1 -- 172.21.15.105:0/2762274950 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eac038040 con 0x7f8eb814da40 2024-09-21T03:24:41.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.153+0000 7f8e9ffff640 1 -- 172.21.15.105:0/2762274950 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8eac004230 con 0x7f8eb814da40 2024-09-21T03:24:41.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.153+0000 7f8e9ffff640 1 -- 172.21.15.105:0/2762274950 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eac0338e0 con 0x7f8eb814da40 2024-09-21T03:24:41.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.153+0000 7f8ebdb13640 1 -- 172.21.15.105:0/2762274950 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8eb81f97f0 con 0x7f8eb814da40 2024-09-21T03:24:41.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.153+0000 7f8ebdb13640 1 -- 172.21.15.105:0/2762274950 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8eb81f8fa0 con 0x7f8eb814da40 2024-09-21T03:24:41.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.154+0000 7f8ebdb13640 1 -- 172.21.15.105:0/2762274950 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8eb81f9260 con 0x7f8eb814da40 2024-09-21T03:24:41.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.155+0000 7f8e9ffff640 1 -- 172.21.15.105:0/2762274950 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8eac02b8a0 con 0x7f8eb814da40 2024-09-21T03:24:41.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.155+0000 7f8e9ffff640 1 --2- 172.21.15.105:0/2762274950 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8ea4078b90 0x7f8ea407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:41.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.155+0000 7f8e9ffff640 1 -- 172.21.15.105:0/2762274950 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7f8eac0bb500 con 0x7f8eb814da40 2024-09-21T03:24:41.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.156+0000 7f8eb77fe640 1 --2- 172.21.15.105:0/2762274950 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8ea4078b90 0x7f8ea407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:41.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.156+0000 7f8eb77fe640 1 --2- 172.21.15.105:0/2762274950 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8ea4078b90 0x7f8ea407b0a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8ea80019d0 tx=0x7f8ea8001240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:41.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.160+0000 7f8e9ffff640 1 -- 172.21.15.105:0/2762274950 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8eac0839d0 con 0x7f8eb814da40 2024-09-21T03:24:41.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:41.377+0000 7f8ebdb13640 1 -- 172.21.15.105:0/2762274950 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f8eb80b9df0 con 0x7f8eb814da40 2024-09-21T03:24:42.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.021+0000 7f8e9ffff640 1 -- 172.21.15.105:0/2762274950 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v58) ==== 122+0+0 (secure 0 0 0) 0x7f8eac0832d0 con 0x7f8eb814da40 2024-09-21T03:24:42.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.023+0000 7f8ebdb13640 1 -- 172.21.15.105:0/2762274950 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8ea4078b90 msgr2=0x7f8ea407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:42.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.023+0000 7f8ebdb13640 1 --2- 172.21.15.105:0/2762274950 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8ea4078b90 0x7f8ea407b0a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8ea80019d0 tx=0x7f8ea8001240 comp rx=0 tx=0).stop 2024-09-21T03:24:42.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.023+0000 7f8ebdb13640 1 -- 172.21.15.105:0/2762274950 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8eb814da40 msgr2=0x7f8eb8160aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:42.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.023+0000 7f8ebdb13640 1 --2- 172.21.15.105:0/2762274950 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8eb814da40 0x7f8eb8160aa0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f8eac036040 tx=0x7f8eac0336f0 comp rx=0 tx=0).stop 2024-09-21T03:24:42.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.023+0000 7f8ebdb13640 1 -- 172.21.15.105:0/2762274950 shutdown_connections 2024-09-21T03:24:42.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.023+0000 7f8ebdb13640 1 --2- 172.21.15.105:0/2762274950 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8ea4078b90 0x7f8ea407b0a0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:42.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.023+0000 7f8ebdb13640 1 --2- 172.21.15.105:0/2762274950 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eb815c080 0x7f8eb8150620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:42.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.023+0000 7f8ebdb13640 1 --2- 172.21.15.105:0/2762274950 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8eb814da40 0x7f8eb8160aa0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:42.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.023+0000 7f8ebdb13640 1 --2- 172.21.15.105:0/2762274950 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ea0004800 0x7f8eb8160560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:42.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.023+0000 7f8ebdb13640 1 -- 172.21.15.105:0/2762274950 >> 172.21.15.105:0/2762274950 conn(0x7f8eb808bfc0 msgr2=0x7f8eb80b10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:42.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.024+0000 7f8ebdb13640 1 -- 172.21.15.105:0/2762274950 shutdown_connections 2024-09-21T03:24:42.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.024+0000 7f8ebdb13640 1 -- 172.21.15.105:0/2762274950 wait complete. 2024-09-21T03:24:42.038 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T03:24:42.038 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:24:42.151 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.149+0000 7f9ad91da640 1 -- 172.21.15.105:0/4155620015 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ad4074420 msgr2=0x7f9ad406fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:42.151 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.149+0000 7f9ad91da640 1 --2- 172.21.15.105:0/4155620015 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ad4074420 0x7f9ad406fe30 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4005fd0 tx=0x7f9ac402a530 comp rx=0 tx=0).stop 2024-09-21T03:24:42.151 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.149+0000 7f9ad91da640 1 -- 172.21.15.105:0/4155620015 shutdown_connections 2024-09-21T03:24:42.151 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.149+0000 7f9ad91da640 1 --2- 172.21.15.105:0/4155620015 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9ad4155ce0 0x7f9ad40b45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:42.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.149+0000 7f9ad91da640 1 --2- 172.21.15.105:0/4155620015 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ad4074420 0x7f9ad406fe30 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:42.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.149+0000 7f9ad91da640 1 -- 172.21.15.105:0/4155620015 >> 172.21.15.105:0/4155620015 conn(0x7f9ad406def0 msgr2=0x7f9ad406e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:42.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.149+0000 7f9ad91da640 1 -- 172.21.15.105:0/4155620015 shutdown_connections 2024-09-21T03:24:42.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.149+0000 7f9ad91da640 1 -- 172.21.15.105:0/4155620015 wait complete. 2024-09-21T03:24:42.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.151+0000 7f9ad91da640 1 Processor -- start 2024-09-21T03:24:42.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.151+0000 7f9ad91da640 1 -- start start 2024-09-21T03:24:42.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.153+0000 7f9ad91da640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ad4074420 0x7f9ad41f5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:42.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.153+0000 7f9ad91da640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ad4155ce0 0x7f9ad4149cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:42.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.153+0000 7f9ad91da640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9ad414a1f0 0x7f9ad40d0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:42.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.153+0000 7f9ad91da640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad40b5090 con 0x7f9ad4155ce0 2024-09-21T03:24:42.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.153+0000 7f9ad91da640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad40b4f10 con 0x7f9ad4074420 2024-09-21T03:24:42.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.153+0000 7f9ad91da640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9ad40b5210 con 0x7f9ad414a1f0 2024-09-21T03:24:42.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.153+0000 7f9aca59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ad4155ce0 0x7f9ad4149cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:42.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.153+0000 7f9aca59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ad4155ce0 0x7f9ad4149cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:60474/0 (socket says 172.21.15.105:60474) 2024-09-21T03:24:42.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.153+0000 7f9aca59c640 1 -- 172.21.15.105:0/4003187235 learned_addr learned my addr 172.21.15.105:0/4003187235 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:42.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.153+0000 7f9ad2d9d640 1 --2- 172.21.15.105:0/4003187235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ad4074420 0x7f9ad41f5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:42.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.153+0000 7f9ad359e640 1 --2- 172.21.15.105:0/4003187235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9ad414a1f0 0x7f9ad40d0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:42.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.153+0000 7f9aca59c640 1 -- 172.21.15.105:0/4003187235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9ad414a1f0 msgr2=0x7f9ad40d0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:42.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.153+0000 7f9aca59c640 1 --2- 172.21.15.105:0/4003187235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9ad414a1f0 0x7f9ad40d0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:42.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.153+0000 7f9aca59c640 1 -- 172.21.15.105:0/4003187235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ad4074420 msgr2=0x7f9ad41f5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:42.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.153+0000 7f9aca59c640 1 --2- 172.21.15.105:0/4003187235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ad4074420 0x7f9ad41f5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:42.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.153+0000 7f9aca59c640 1 -- 172.21.15.105:0/4003187235 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad4151290 con 0x7f9ad4155ce0 2024-09-21T03:24:42.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.153+0000 7f9aca59c640 1 --2- 172.21.15.105:0/4003187235 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ad4155ce0 0x7f9ad4149cb0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f9abc00b3f0 tx=0x7f9abc00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:42.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.153+0000 7f9acbfff640 1 -- 172.21.15.105:0/4003187235 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc015020 con 0x7f9ad4155ce0 2024-09-21T03:24:42.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.153+0000 7f9acbfff640 1 -- 172.21.15.105:0/4003187235 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9abc011920 con 0x7f9ad4155ce0 2024-09-21T03:24:42.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.153+0000 7f9ad91da640 1 -- 172.21.15.105:0/4003187235 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ad413d950 con 0x7f9ad4155ce0 2024-09-21T03:24:42.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.153+0000 7f9acbfff640 1 -- 172.21.15.105:0/4003187235 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc011d70 con 0x7f9ad4155ce0 2024-09-21T03:24:42.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.154+0000 7f9ad91da640 1 -- 172.21.15.105:0/4003187235 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ad413df10 con 0x7f9ad4155ce0 2024-09-21T03:24:42.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.154+0000 7f9ad91da640 1 -- 172.21.15.105:0/4003187235 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ad413d6c0 con 0x7f9ad4155ce0 2024-09-21T03:24:42.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.155+0000 7f9acbfff640 1 -- 172.21.15.105:0/4003187235 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9abc018020 con 0x7f9ad4155ce0 2024-09-21T03:24:42.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.156+0000 7f9acbfff640 1 --2- 172.21.15.105:0/4003187235 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9ab4078b90 0x7f9ab407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:42.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.156+0000 7f9acbfff640 1 -- 172.21.15.105:0/4003187235 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7f9abc09a770 con 0x7f9ad4155ce0 2024-09-21T03:24:42.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.156+0000 7f9ad2d9d640 1 --2- 172.21.15.105:0/4003187235 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9ab4078b90 0x7f9ab407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:42.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.157+0000 7f9ad2d9d640 1 --2- 172.21.15.105:0/4003187235 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9ab4078b90 0x7f9ab407b0a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4033000 tx=0x7f9ac4004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:42.162 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.160+0000 7f9acbfff640 1 -- 172.21.15.105:0/4003187235 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9abc01f030 con 0x7f9ad4155ce0 2024-09-21T03:24:42.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.374+0000 7f9ad91da640 1 -- 172.21.15.105:0/4003187235 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ad40b5790 con 0x7f9ad4155ce0 2024-09-21T03:24:42.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.374+0000 7f9acbfff640 1 -- 172.21.15.105:0/4003187235 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+5234 (secure 0 0 0) 0x7f9abc0625f0 con 0x7f9ad4155ce0 2024-09-21T03:24:42.376 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:24:42.376 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":58,"btime":"2024-09-21T03:24:42:016797+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5801,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2175278360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2175278360},{"type":"v1","addr":"172.21.15.162:6836","nonce":2175278360}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6292,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2152611733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2152611733},{"type":"v1","addr":"172.21.15.105:6835","nonce":2152611733}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1722830153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1722830153},{"type":"v1","addr":"172.21.15.162:6837","nonce":1722830153}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:24:38.369493+0000","modified":"2024-09-21T03:24:41.378239+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6840},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6840":{"gid":6840,"name":"c","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6834/636426076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":636426076},{"type":"v1","addr":"172.21.15.105:6834","nonce":636426076}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6840,"qdb_cluster":[6840]},"id":7}]} 2024-09-21T03:24:42.376 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 58 2024-09-21T03:24:42.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.376+0000 7f9ad91da640 1 -- 172.21.15.105:0/4003187235 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9ab4078b90 msgr2=0x7f9ab407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:42.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.376+0000 7f9ad91da640 1 --2- 172.21.15.105:0/4003187235 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9ab4078b90 0x7f9ab407b0a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4033000 tx=0x7f9ac4004730 comp rx=0 tx=0).stop 2024-09-21T03:24:42.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.376+0000 7f9ad91da640 1 -- 172.21.15.105:0/4003187235 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ad4155ce0 msgr2=0x7f9ad4149cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:42.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.376+0000 7f9ad91da640 1 --2- 172.21.15.105:0/4003187235 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ad4155ce0 0x7f9ad4149cb0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f9abc00b3f0 tx=0x7f9abc00b8b0 comp rx=0 tx=0).stop 2024-09-21T03:24:42.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.376+0000 7f9ad91da640 1 -- 172.21.15.105:0/4003187235 shutdown_connections 2024-09-21T03:24:42.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.376+0000 7f9ad91da640 1 --2- 172.21.15.105:0/4003187235 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9ab4078b90 0x7f9ab407b0a0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:42.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.376+0000 7f9ad91da640 1 --2- 172.21.15.105:0/4003187235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9ad414a1f0 0x7f9ad40d0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:42.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.376+0000 7f9ad91da640 1 --2- 172.21.15.105:0/4003187235 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ad4155ce0 0x7f9ad4149cb0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:42.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.376+0000 7f9ad91da640 1 --2- 172.21.15.105:0/4003187235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ad4074420 0x7f9ad41f5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:42.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.376+0000 7f9ad91da640 1 -- 172.21.15.105:0/4003187235 >> 172.21.15.105:0/4003187235 conn(0x7f9ad406def0 msgr2=0x7f9ad415e400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:42.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.376+0000 7f9ad91da640 1 -- 172.21.15.105:0/4003187235 shutdown_connections 2024-09-21T03:24:42.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.376+0000 7f9ad91da640 1 -- 172.21.15.105:0/4003187235 wait complete. 2024-09-21T03:24:42.389 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:24:42.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.500+0000 7f81169da640 1 -- 172.21.15.105:0/1215686008 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80f8003a80 msgr2=0x7f80f8003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:42.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.500+0000 7f81169da640 1 --2- 172.21.15.105:0/1215686008 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80f8003a80 0x7f80f8003ef0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f810000c2e0 tx=0x7f80f8005830 comp rx=0 tx=0).stop 2024-09-21T03:24:42.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.500+0000 7f8114f77640 1 -- 172.21.15.105:0/1215686008 reap_dead start 2024-09-21T03:24:42.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.500+0000 7f81169da640 1 -- 172.21.15.105:0/1215686008 shutdown_connections 2024-09-21T03:24:42.503 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.500+0000 7f81169da640 1 -- 172.21.15.105:0/1215686008 >> 172.21.15.105:0/1215686008 conn(0x7f81100cdcb0 msgr2=0x7f81100ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:42.503 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.500+0000 7f81169da640 1 -- 172.21.15.105:0/1215686008 shutdown_connections 2024-09-21T03:24:42.503 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.500+0000 7f81169da640 1 -- 172.21.15.105:0/1215686008 wait complete. 2024-09-21T03:24:42.503 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.502+0000 7f81169da640 1 Processor -- start 2024-09-21T03:24:42.504 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.502+0000 7f81169da640 1 -- start start 2024-09-21T03:24:42.506 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.503+0000 7f81169da640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80f8003a80 0x7f8110153420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:42.506 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.503+0000 7f81169da640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81100c4dd0 0x7f8110159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:42.506 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.503+0000 7f81169da640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8110159d80 0x7f811009c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:42.507 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.503+0000 7f81169da640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f81100adfa0 con 0x7f8110159d80 2024-09-21T03:24:42.507 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.503+0000 7f81169da640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8110071ca0 con 0x7f81100c4dd0 2024-09-21T03:24:42.507 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.503+0000 7f81169da640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f81100ae120 con 0x7f80f8003a80 2024-09-21T03:24:42.507 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.504+0000 7f8114f77640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8110159d80 0x7f811009c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:42.507 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.504+0000 7f8114f77640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8110159d80 0x7f811009c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:60494/0 (socket says 172.21.15.105:60494) 2024-09-21T03:24:42.507 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.504+0000 7f8114f77640 1 -- 172.21.15.105:0/4166042168 learned_addr learned my addr 172.21.15.105:0/4166042168 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:42.507 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.504+0000 7f810f7fe640 1 --2- 172.21.15.105:0/4166042168 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81100c4dd0 0x7f8110159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:42.507 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.504+0000 7f810ffff640 1 --2- 172.21.15.105:0/4166042168 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80f8003a80 0x7f8110153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:42.507 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.504+0000 7f8114f77640 1 -- 172.21.15.105:0/4166042168 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80f8003a80 msgr2=0x7f8110153420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:42.507 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.504+0000 7f8114f77640 1 --2- 172.21.15.105:0/4166042168 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80f8003a80 0x7f8110153420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:42.507 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.504+0000 7f8114f77640 1 -- 172.21.15.105:0/4166042168 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81100c4dd0 msgr2=0x7f8110159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:42.507 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.504+0000 7f8114f77640 1 --2- 172.21.15.105:0/4166042168 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81100c4dd0 0x7f8110159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:42.507 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.504+0000 7f8114f77640 1 -- 172.21.15.105:0/4166042168 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f811015a190 con 0x7f8110159d80 2024-09-21T03:24:42.508 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.504+0000 7f8114f77640 1 --2- 172.21.15.105:0/4166042168 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8110159d80 0x7f811009c040 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f81100b6250 tx=0x7f8108001bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:42.508 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.504+0000 7f810cff9640 1 -- 172.21.15.105:0/4166042168 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8108015070 con 0x7f8110159d80 2024-09-21T03:24:42.508 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.504+0000 7f810cff9640 1 -- 172.21.15.105:0/4166042168 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8108011900 con 0x7f8110159d80 2024-09-21T03:24:42.508 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.504+0000 7f81169da640 1 -- 172.21.15.105:0/4166042168 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81101f2a90 con 0x7f8110159d80 2024-09-21T03:24:42.508 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.504+0000 7f810cff9640 1 -- 172.21.15.105:0/4166042168 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8108011d10 con 0x7f8110159d80 2024-09-21T03:24:42.508 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.504+0000 7f81169da640 1 -- 172.21.15.105:0/4166042168 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81101f3050 con 0x7f8110159d80 2024-09-21T03:24:42.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.505+0000 7f81169da640 1 -- 172.21.15.105:0/4166042168 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81100af830 con 0x7f8110159d80 2024-09-21T03:24:42.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.506+0000 7f810cff9640 1 -- 172.21.15.105:0/4166042168 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8108018070 con 0x7f8110159d80 2024-09-21T03:24:42.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.507+0000 7f810cff9640 1 --2- 172.21.15.105:0/4166042168 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f80fc078b90 0x7f80fc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:42.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.507+0000 7f810cff9640 1 -- 172.21.15.105:0/4166042168 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7f810809b860 con 0x7f8110159d80 2024-09-21T03:24:42.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.507+0000 7f810ffff640 1 --2- 172.21.15.105:0/4166042168 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f80fc078b90 0x7f80fc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:42.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.508+0000 7f810ffff640 1 --2- 172.21.15.105:0/4166042168 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f80fc078b90 0x7f80fc07b0a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f8100033000 tx=0x7f8100038040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:42.513 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.512+0000 7f810cff9640 1 -- 172.21.15.105:0/4166042168 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f811015a190 con 0x7f8110159d80 2024-09-21T03:24:42.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.688+0000 7f81169da640 1 -- 172.21.15.105:0/4166042168 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8110159320 con 0x7f8110159d80 2024-09-21T03:24:42.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.689+0000 7f810cff9640 1 -- 172.21.15.105:0/4166042168 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+16740 (secure 0 0 0) 0x7f810809b020 con 0x7f8110159d80 2024-09-21T03:24:42.691 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:24:42.692 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":93,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:24:40.003709+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:24:36.006836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-21T03:24:37.327374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:24:42.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.692+0000 7f81169da640 1 -- 172.21.15.105:0/4166042168 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f80fc078b90 msgr2=0x7f80fc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:42.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.692+0000 7f81169da640 1 --2- 172.21.15.105:0/4166042168 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f80fc078b90 0x7f80fc07b0a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f8100033000 tx=0x7f8100038040 comp rx=0 tx=0).stop 2024-09-21T03:24:42.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.692+0000 7f81169da640 1 -- 172.21.15.105:0/4166042168 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8110159d80 msgr2=0x7f811009c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:42.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.692+0000 7f81169da640 1 --2- 172.21.15.105:0/4166042168 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8110159d80 0x7f811009c040 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f81100b6250 tx=0x7f8108001bb0 comp rx=0 tx=0).stop 2024-09-21T03:24:42.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.692+0000 7f81169da640 1 -- 172.21.15.105:0/4166042168 shutdown_connections 2024-09-21T03:24:42.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.692+0000 7f81169da640 1 --2- 172.21.15.105:0/4166042168 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f80fc078b90 0x7f80fc07b0a0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:42.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.692+0000 7f81169da640 1 --2- 172.21.15.105:0/4166042168 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8110159d80 0x7f811009c040 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:42.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.692+0000 7f81169da640 1 --2- 172.21.15.105:0/4166042168 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81100c4dd0 0x7f8110159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:42.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.692+0000 7f81169da640 1 --2- 172.21.15.105:0/4166042168 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80f8003a80 0x7f8110153420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:42.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.692+0000 7f81169da640 1 -- 172.21.15.105:0/4166042168 >> 172.21.15.105:0/4166042168 conn(0x7f81100cdcb0 msgr2=0x7f81100d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:42.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.692+0000 7f81169da640 1 -- 172.21.15.105:0/4166042168 shutdown_connections 2024-09-21T03:24:42.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.692+0000 7f81169da640 1 -- 172.21.15.105:0/4166042168 wait complete. 2024-09-21T03:24:42.705 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T03:24:42.706 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:24:42.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.816+0000 7febf2084640 1 -- 172.21.15.105:0/3748855510 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7febec0d1560 msgr2=0x7febec06f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:42.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.816+0000 7febf2084640 1 --2- 172.21.15.105:0/3748855510 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7febec0d1560 0x7febec06f6e0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7febe4005fd0 tx=0x7febe402a820 comp rx=0 tx=0).stop 2024-09-21T03:24:42.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.816+0000 7febf2084640 1 -- 172.21.15.105:0/3748855510 shutdown_connections 2024-09-21T03:24:42.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.816+0000 7febf2084640 1 --2- 172.21.15.105:0/3748855510 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7febec0d1560 0x7febec06f6e0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:42.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.816+0000 7febf2084640 1 -- 172.21.15.105:0/3748855510 >> 172.21.15.105:0/3748855510 conn(0x7febec09d840 msgr2=0x7febec08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:42.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.816+0000 7febf2084640 1 -- 172.21.15.105:0/3748855510 shutdown_connections 2024-09-21T03:24:42.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.816+0000 7febf2084640 1 -- 172.21.15.105:0/3748855510 wait complete. 2024-09-21T03:24:42.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.817+0000 7febf2084640 1 Processor -- start 2024-09-21T03:24:42.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.818+0000 7febf2084640 1 -- start start 2024-09-21T03:24:42.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.819+0000 7febf2084640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7febec06e0a0 0x7febec0cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:42.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.819+0000 7febf2084640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febec0b97e0 0x7febec1552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:42.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.819+0000 7febf2084640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febec0a0990 0x7febec152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:42.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.819+0000 7febf2084640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7febec0cff50 con 0x7febec06e0a0 2024-09-21T03:24:42.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.819+0000 7febf2084640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7febec0cfdd0 con 0x7febec0b97e0 2024-09-21T03:24:42.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.819+0000 7febf2084640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7febec0d00d0 con 0x7febec0a0990 2024-09-21T03:24:42.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.819+0000 7febeb7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7febec06e0a0 0x7febec0cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:42.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.819+0000 7febeb7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7febec06e0a0 0x7febec0cdb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:60500/0 (socket says 172.21.15.105:60500) 2024-09-21T03:24:42.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.819+0000 7febeb7fe640 1 -- 172.21.15.105:0/348098028 learned_addr learned my addr 172.21.15.105:0/348098028 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:42.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.819+0000 7febeaffd640 1 --2- 172.21.15.105:0/348098028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febec0b97e0 0x7febec1552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:42.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.819+0000 7febebfff640 1 --2- 172.21.15.105:0/348098028 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febec0a0990 0x7febec152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:42.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.819+0000 7febeb7fe640 1 -- 172.21.15.105:0/348098028 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febec0a0990 msgr2=0x7febec152840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:42.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.819+0000 7febeb7fe640 1 --2- 172.21.15.105:0/348098028 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febec0a0990 0x7febec152840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:42.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.819+0000 7febeb7fe640 1 -- 172.21.15.105:0/348098028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febec0b97e0 msgr2=0x7febec1552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:42.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.819+0000 7febeb7fe640 1 --2- 172.21.15.105:0/348098028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febec0b97e0 0x7febec1552a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:42.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.819+0000 7febeb7fe640 1 -- 172.21.15.105:0/348098028 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febec1557e0 con 0x7febec06e0a0 2024-09-21T03:24:42.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.820+0000 7febeb7fe640 1 --2- 172.21.15.105:0/348098028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7febec06e0a0 0x7febec0cdb90 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7febdc00c390 tx=0x7febdc00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:42.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.820+0000 7febd3fff640 1 -- 172.21.15.105:0/348098028 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febdc017070 con 0x7febec06e0a0 2024-09-21T03:24:42.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.820+0000 7febd3fff640 1 -- 172.21.15.105:0/348098028 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7febdc0053c0 con 0x7febec06e0a0 2024-09-21T03:24:42.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.820+0000 7febf2084640 1 -- 172.21.15.105:0/348098028 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febec0cc650 con 0x7febec06e0a0 2024-09-21T03:24:42.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.820+0000 7febd3fff640 1 -- 172.21.15.105:0/348098028 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febdc003880 con 0x7febec06e0a0 2024-09-21T03:24:42.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.820+0000 7febf2084640 1 -- 172.21.15.105:0/348098028 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febec0ccdd0 con 0x7febec06e0a0 2024-09-21T03:24:42.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.821+0000 7febf2084640 1 -- 172.21.15.105:0/348098028 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febec0760c0 con 0x7febec06e0a0 2024-09-21T03:24:42.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.821+0000 7febd3fff640 1 -- 172.21.15.105:0/348098028 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7febdc01a070 con 0x7febec06e0a0 2024-09-21T03:24:42.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.822+0000 7febd3fff640 1 --2- 172.21.15.105:0/348098028 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7febd8078b90 0x7febd807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:42.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.822+0000 7febd3fff640 1 -- 172.21.15.105:0/348098028 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7febdc09a1d0 con 0x7febec06e0a0 2024-09-21T03:24:42.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.822+0000 7febeaffd640 1 --2- 172.21.15.105:0/348098028 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7febd8078b90 0x7febd807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:42.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.823+0000 7febeaffd640 1 --2- 172.21.15.105:0/348098028 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7febd8078b90 0x7febd807b0a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7febec0ce610 tx=0x7febe0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:42.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:42.827+0000 7febd3fff640 1 -- 172.21.15.105:0/348098028 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7febec0760c0 con 0x7febec06e0a0 2024-09-21T03:24:43.001 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.000+0000 7febf2084640 1 -- 172.21.15.105:0/348098028 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7febec069a50 con 0x7febd8078b90 2024-09-21T03:24:43.006 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.004+0000 7febd3fff640 1 -- 172.21.15.105:0/348098028 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244870 (secure 0 0 0) 0x7febec069a50 con 0x7febd8078b90 2024-09-21T03:24:43.008 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:24:43.010 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:24:43.011 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.007+0000 7febf2084640 1 -- 172.21.15.105:0/348098028 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7febd8078b90 msgr2=0x7febd807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:43.011 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.007+0000 7febf2084640 1 --2- 172.21.15.105:0/348098028 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7febd8078b90 0x7febd807b0a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7febec0ce610 tx=0x7febe0009040 comp rx=0 tx=0).stop 2024-09-21T03:24:43.012 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.007+0000 7febf2084640 1 -- 172.21.15.105:0/348098028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7febec06e0a0 msgr2=0x7febec0cdb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:43.012 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.007+0000 7febf2084640 1 --2- 172.21.15.105:0/348098028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7febec06e0a0 0x7febec0cdb90 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7febdc00c390 tx=0x7febdc00c850 comp rx=0 tx=0).stop 2024-09-21T03:24:43.012 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.008+0000 7febf2084640 1 -- 172.21.15.105:0/348098028 shutdown_connections 2024-09-21T03:24:43.012 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.008+0000 7febf2084640 1 --2- 172.21.15.105:0/348098028 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7febd8078b90 0x7febd807b0a0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:43.012 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.008+0000 7febf2084640 1 --2- 172.21.15.105:0/348098028 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7febec0a0990 0x7febec152840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:43.012 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.008+0000 7febf2084640 1 --2- 172.21.15.105:0/348098028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7febec0b97e0 0x7febec1552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:43.012 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.008+0000 7febf2084640 1 --2- 172.21.15.105:0/348098028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7febec06e0a0 0x7febec0cdb90 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:43.012 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.008+0000 7febf2084640 1 -- 172.21.15.105:0/348098028 >> 172.21.15.105:0/348098028 conn(0x7febec09d840 msgr2=0x7febec161a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:43.012 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.008+0000 7febf2084640 1 -- 172.21.15.105:0/348098028 shutdown_connections 2024-09-21T03:24:43.012 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.008+0000 7febf2084640 1 -- 172.21.15.105:0/348098028 wait complete. 2024-09-21T03:24:43.020 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":279,"stamp":"2024-09-21T03:24:41.379210+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":156,"acting":156,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259380,"kb_used_data":9860,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715340,"statfs":{"total":773094113280,"available":772828508160,"internally_reserved":0,"allocated":10096640,"data_stored":4923297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.385696"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.009730+0000","last_change":"2024-09-21T03:24:38.009730+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.009730+0000","last_undegraded":"2024-09-21T03:24:38.009730+0000","last_fullsized":"2024-09-21T03:24:38.009730+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:24:37.988740+0000","last_change":"2024-09-21T03:24:37.988740+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.988740+0000","last_undegraded":"2024-09-21T03:24:37.988740+0000","last_fullsized":"2024-09-21T03:24:37.988740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.015446+0000","last_change":"2024-09-21T03:24:38.015446+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.015446+0000","last_undegraded":"2024-09-21T03:24:38.015446+0000","last_fullsized":"2024-09-21T03:24:38.015446+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.001334+0000","last_change":"2024-09-21T03:24:38.001334+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.001334+0000","last_undegraded":"2024-09-21T03:24:38.001334+0000","last_fullsized":"2024-09-21T03:24:38.001334+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:37.998731+0000","last_change":"2024-09-21T03:24:37.998731+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.998731+0000","last_undegraded":"2024-09-21T03:24:37.998731+0000","last_fullsized":"2024-09-21T03:24:37.998731+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.004276+0000","last_change":"2024-09-21T03:24:38.004276+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.004276+0000","last_undegraded":"2024-09-21T03:24:38.004276+0000","last_fullsized":"2024-09-21T03:24:38.004276+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.004347+0000","last_change":"2024-09-21T03:24:38.004347+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.004347+0000","last_undegraded":"2024-09-21T03:24:38.004347+0000","last_fullsized":"2024-09-21T03:24:38.004347+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:24:37.988740+0000","last_change":"2024-09-21T03:24:37.988740+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.988740+0000","last_undegraded":"2024-09-21T03:24:37.988740+0000","last_fullsized":"2024-09-21T03:24:37.988740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:37.999417+0000","last_change":"2024-09-21T03:24:37.999417+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.999417+0000","last_undegraded":"2024-09-21T03:24:37.999417+0000","last_fullsized":"2024-09-21T03:24:37.999417+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003577+0000","last_change":"2024-09-21T03:24:38.003577+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003577+0000","last_undegraded":"2024-09-21T03:24:38.003577+0000","last_fullsized":"2024-09-21T03:24:38.003577+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.004174+0000","last_change":"2024-09-21T03:24:38.004174+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.004174+0000","last_undegraded":"2024-09-21T03:24:38.004174+0000","last_fullsized":"2024-09-21T03:24:38.004174+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:37.999876+0000","last_change":"2024-09-21T03:24:37.999876+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.999876+0000","last_undegraded":"2024-09-21T03:24:37.999876+0000","last_fullsized":"2024-09-21T03:24:37.999876+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.001000+0000","last_change":"2024-09-21T03:24:38.001000+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.001000+0000","last_undegraded":"2024-09-21T03:24:38.001000+0000","last_fullsized":"2024-09-21T03:24:38.001000+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.007202+0000","last_change":"2024-09-21T03:24:38.007202+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.007202+0000","last_undegraded":"2024-09-21T03:24:38.007202+0000","last_fullsized":"2024-09-21T03:24:38.007202+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.004206+0000","last_change":"2024-09-21T03:24:38.004206+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.004206+0000","last_undegraded":"2024-09-21T03:24:38.004206+0000","last_fullsized":"2024-09-21T03:24:38.004206+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003903+0000","last_change":"2024-09-21T03:24:38.003903+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003903+0000","last_undegraded":"2024-09-21T03:24:38.003903+0000","last_fullsized":"2024-09-21T03:24:38.003903+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:24:37.988740+0000","last_change":"2024-09-21T03:24:37.988740+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.988740+0000","last_undegraded":"2024-09-21T03:24:37.988740+0000","last_fullsized":"2024-09-21T03:24:37.988740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003207+0000","last_change":"2024-09-21T03:24:38.003207+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003207+0000","last_undegraded":"2024-09-21T03:24:38.003207+0000","last_fullsized":"2024-09-21T03:24:38.003207+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003192+0000","last_change":"2024-09-21T03:24:38.003192+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003192+0000","last_undegraded":"2024-09-21T03:24:38.003192+0000","last_fullsized":"2024-09-21T03:24:38.003192+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:37.999307+0000","last_change":"2024-09-21T03:24:37.999307+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.999307+0000","last_undegraded":"2024-09-21T03:24:37.999307+0000","last_fullsized":"2024-09-21T03:24:37.999307+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003713+0000","last_change":"2024-09-21T03:24:38.003713+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003713+0000","last_undegraded":"2024-09-21T03:24:38.003713+0000","last_fullsized":"2024-09-21T03:24:38.003713+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:24:37.988740+0000","last_change":"2024-09-21T03:24:37.988740+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.988740+0000","last_undegraded":"2024-09-21T03:24:37.988740+0000","last_fullsized":"2024-09-21T03:24:37.988740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:24:37.988740+0000","last_change":"2024-09-21T03:24:37.988740+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.988740+0000","last_undegraded":"2024-09-21T03:24:37.988740+0000","last_fullsized":"2024-09-21T03:24:37.988740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.002993+0000","last_change":"2024-09-21T03:24:38.002993+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.002993+0000","last_undegraded":"2024-09-21T03:24:38.002993+0000","last_fullsized":"2024-09-21T03:24:38.002993+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.005336+0000","last_change":"2024-09-21T03:24:38.005336+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.005336+0000","last_undegraded":"2024-09-21T03:24:38.005336+0000","last_fullsized":"2024-09-21T03:24:38.005336+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:24:37.988740+0000","last_change":"2024-09-21T03:24:37.988740+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.988740+0000","last_undegraded":"2024-09-21T03:24:37.988740+0000","last_fullsized":"2024-09-21T03:24:37.988740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.002986+0000","last_change":"2024-09-21T03:24:38.002986+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.002986+0000","last_undegraded":"2024-09-21T03:24:38.002986+0000","last_fullsized":"2024-09-21T03:24:38.002986+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.006293+0000","last_change":"2024-09-21T03:24:38.006293+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.006293+0000","last_undegraded":"2024-09-21T03:24:38.006293+0000","last_fullsized":"2024-09-21T03:24:38.006293+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:24:37.988740+0000","last_change":"2024-09-21T03:24:37.988740+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.988740+0000","last_undegraded":"2024-09-21T03:24:37.988740+0000","last_fullsized":"2024-09-21T03:24:37.988740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.006709+0000","last_change":"2024-09-21T03:24:38.006709+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.006709+0000","last_undegraded":"2024-09-21T03:24:38.006709+0000","last_fullsized":"2024-09-21T03:24:38.006709+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003705+0000","last_change":"2024-09-21T03:24:38.003705+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003705+0000","last_undegraded":"2024-09-21T03:24:38.003705+0000","last_fullsized":"2024-09-21T03:24:38.003705+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.010814+0000","last_change":"2024-09-21T03:24:38.010814+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.010814+0000","last_undegraded":"2024-09-21T03:24:38.010814+0000","last_fullsized":"2024-09-21T03:24:38.010814+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003562+0000","last_change":"2024-09-21T03:24:38.003562+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003562+0000","last_undegraded":"2024-09-21T03:24:38.003562+0000","last_fullsized":"2024-09-21T03:24:38.003562+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:24:36.986597+0000","last_change":"2024-09-21T03:24:36.986597+0000","last_active":"2024-09-21T03:24:36.986597+0000","last_peered":"2024-09-21T03:24:36.986597+0000","last_clean":"2024-09-21T03:24:36.986597+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:36.986597+0000","last_undegraded":"2024-09-21T03:24:36.986597+0000","last_fullsized":"2024-09-21T03:24:36.986597+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.002494+0000","last_change":"2024-09-21T03:24:38.002494+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.002494+0000","last_undegraded":"2024-09-21T03:24:38.002494+0000","last_fullsized":"2024-09-21T03:24:38.002494+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.020618+0000","last_change":"2024-09-21T03:24:38.019879+0000","last_active":"2024-09-21T03:24:38.020618+0000","last_peered":"2024-09-21T03:24:38.020618+0000","last_clean":"2024-09-21T03:24:38.020618+0000","last_became_active":"2024-09-21T03:24:38.019498+0000","last_became_peered":"2024-09-21T03:24:38.019498+0000","last_unstale":"2024-09-21T03:24:38.020618+0000","last_undegraded":"2024-09-21T03:24:38.020618+0000","last_fullsized":"2024-09-21T03:24:38.020618+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:05.347691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.012629+0000","last_change":"2024-09-21T03:24:38.012629+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.012629+0000","last_undegraded":"2024-09-21T03:24:38.012629+0000","last_fullsized":"2024-09-21T03:24:38.012629+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:24:36.986597+0000","last_change":"2024-09-21T03:24:36.986597+0000","last_active":"2024-09-21T03:24:36.986597+0000","last_peered":"2024-09-21T03:24:36.986597+0000","last_clean":"2024-09-21T03:24:36.986597+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:36.986597+0000","last_undegraded":"2024-09-21T03:24:36.986597+0000","last_fullsized":"2024-09-21T03:24:36.986597+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:37.998740+0000","last_change":"2024-09-21T03:24:37.998740+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.998740+0000","last_undegraded":"2024-09-21T03:24:37.998740+0000","last_fullsized":"2024-09-21T03:24:37.998740+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:24:36.986597+0000","last_change":"2024-09-21T03:24:36.986597+0000","last_active":"2024-09-21T03:24:36.986597+0000","last_peered":"2024-09-21T03:24:36.986597+0000","last_clean":"2024-09-21T03:24:36.986597+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:36.986597+0000","last_undegraded":"2024-09-21T03:24:36.986597+0000","last_fullsized":"2024-09-21T03:24:36.986597+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.002418+0000","last_change":"2024-09-21T03:24:38.002418+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.002418+0000","last_undegraded":"2024-09-21T03:24:38.002418+0000","last_fullsized":"2024-09-21T03:24:38.002418+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.024352+0000","last_change":"2024-09-21T03:24:38.020873+0000","last_active":"2024-09-21T03:24:38.024352+0000","last_peered":"2024-09-21T03:24:38.024352+0000","last_clean":"2024-09-21T03:24:38.024352+0000","last_became_active":"2024-09-21T03:24:38.020586+0000","last_became_peered":"2024-09-21T03:24:38.020586+0000","last_unstale":"2024-09-21T03:24:38.024352+0000","last_undegraded":"2024-09-21T03:24:38.024352+0000","last_fullsized":"2024-09-21T03:24:38.024352+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:38.297464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.002377+0000","last_change":"2024-09-21T03:24:38.002377+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.002377+0000","last_undegraded":"2024-09-21T03:24:38.002377+0000","last_fullsized":"2024-09-21T03:24:38.002377+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:24:36.986597+0000","last_change":"2024-09-21T03:24:36.986597+0000","last_active":"2024-09-21T03:24:36.986597+0000","last_peered":"2024-09-21T03:24:36.986597+0000","last_clean":"2024-09-21T03:24:36.986597+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:36.986597+0000","last_undegraded":"2024-09-21T03:24:36.986597+0000","last_fullsized":"2024-09-21T03:24:36.986597+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.000926+0000","last_change":"2024-09-21T03:24:38.000926+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.000926+0000","last_undegraded":"2024-09-21T03:24:38.000926+0000","last_fullsized":"2024-09-21T03:24:38.000926+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.017601+0000","last_change":"2024-09-21T03:24:38.015466+0000","last_active":"2024-09-21T03:24:38.017601+0000","last_peered":"2024-09-21T03:24:38.017601+0000","last_clean":"2024-09-21T03:24:38.017601+0000","last_became_active":"2024-09-21T03:24:38.015170+0000","last_became_peered":"2024-09-21T03:24:38.015170+0000","last_unstale":"2024-09-21T03:24:38.017601+0000","last_undegraded":"2024-09-21T03:24:38.017601+0000","last_fullsized":"2024-09-21T03:24:38.017601+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:45:46.694000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:37.999985+0000","last_change":"2024-09-21T03:24:37.999985+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.999985+0000","last_undegraded":"2024-09-21T03:24:37.999985+0000","last_fullsized":"2024-09-21T03:24:37.999985+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.029707+0000","last_change":"2024-09-21T03:24:38.024676+0000","last_active":"2024-09-21T03:24:38.029707+0000","last_peered":"2024-09-21T03:24:38.029707+0000","last_clean":"2024-09-21T03:24:38.029707+0000","last_became_active":"2024-09-21T03:24:38.024305+0000","last_became_peered":"2024-09-21T03:24:38.024305+0000","last_unstale":"2024-09-21T03:24:38.029707+0000","last_undegraded":"2024-09-21T03:24:38.029707+0000","last_fullsized":"2024-09-21T03:24:38.029707+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:01.136782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:24:37.988740+0000","last_change":"2024-09-21T03:24:37.988740+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.988740+0000","last_undegraded":"2024-09-21T03:24:37.988740+0000","last_fullsized":"2024-09-21T03:24:37.988740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.023790+0000","last_change":"2024-09-21T03:24:38.019784+0000","last_active":"2024-09-21T03:24:38.023790+0000","last_peered":"2024-09-21T03:24:38.023790+0000","last_clean":"2024-09-21T03:24:38.023790+0000","last_became_active":"2024-09-21T03:24:38.019456+0000","last_became_peered":"2024-09-21T03:24:38.019456+0000","last_unstale":"2024-09-21T03:24:38.023790+0000","last_undegraded":"2024-09-21T03:24:38.023790+0000","last_fullsized":"2024-09-21T03:24:38.023790+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:28.389174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:37.997537+0000","last_change":"2024-09-21T03:24:37.997537+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.997537+0000","last_undegraded":"2024-09-21T03:24:37.997537+0000","last_fullsized":"2024-09-21T03:24:37.997537+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.012124+0000","last_change":"2024-09-21T03:24:38.011409+0000","last_active":"2024-09-21T03:24:38.012124+0000","last_peered":"2024-09-21T03:24:38.012124+0000","last_clean":"2024-09-21T03:24:38.012124+0000","last_became_active":"2024-09-21T03:24:38.011093+0000","last_became_peered":"2024-09-21T03:24:38.011093+0000","last_unstale":"2024-09-21T03:24:38.012124+0000","last_undegraded":"2024-09-21T03:24:38.012124+0000","last_fullsized":"2024-09-21T03:24:38.012124+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:27:39.891218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003759+0000","last_change":"2024-09-21T03:24:38.003759+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003759+0000","last_undegraded":"2024-09-21T03:24:38.003759+0000","last_fullsized":"2024-09-21T03:24:38.003759+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.014568+0000","last_change":"2024-09-21T03:24:38.010947+0000","last_active":"2024-09-21T03:24:38.014568+0000","last_peered":"2024-09-21T03:24:38.014568+0000","last_clean":"2024-09-21T03:24:38.014568+0000","last_became_active":"2024-09-21T03:24:38.010622+0000","last_became_peered":"2024-09-21T03:24:38.010622+0000","last_unstale":"2024-09-21T03:24:38.014568+0000","last_undegraded":"2024-09-21T03:24:38.014568+0000","last_fullsized":"2024-09-21T03:24:38.014568+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:39.345967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.001774+0000","last_change":"2024-09-21T03:24:38.001774+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.001774+0000","last_undegraded":"2024-09-21T03:24:38.001774+0000","last_fullsized":"2024-09-21T03:24:38.001774+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.014753+0000","last_change":"2024-09-21T03:24:38.011098+0000","last_active":"2024-09-21T03:24:38.014753+0000","last_peered":"2024-09-21T03:24:38.014753+0000","last_clean":"2024-09-21T03:24:38.014753+0000","last_became_active":"2024-09-21T03:24:38.010775+0000","last_became_peered":"2024-09-21T03:24:38.010775+0000","last_unstale":"2024-09-21T03:24:38.014753+0000","last_undegraded":"2024-09-21T03:24:38.014753+0000","last_fullsized":"2024-09-21T03:24:38.014753+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:07.330132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.001499+0000","last_change":"2024-09-21T03:24:38.001499+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.001499+0000","last_undegraded":"2024-09-21T03:24:38.001499+0000","last_fullsized":"2024-09-21T03:24:38.001499+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.013734+0000","last_change":"2024-09-21T03:24:38.012254+0000","last_active":"2024-09-21T03:24:38.013734+0000","last_peered":"2024-09-21T03:24:38.013734+0000","last_clean":"2024-09-21T03:24:38.013734+0000","last_became_active":"2024-09-21T03:24:38.011372+0000","last_became_peered":"2024-09-21T03:24:38.011372+0000","last_unstale":"2024-09-21T03:24:38.013734+0000","last_undegraded":"2024-09-21T03:24:38.013734+0000","last_fullsized":"2024-09-21T03:24:38.013734+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:09:27.979140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.013455+0000","last_change":"2024-09-21T03:24:38.013455+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.013455+0000","last_undegraded":"2024-09-21T03:24:38.013455+0000","last_fullsized":"2024-09-21T03:24:38.013455+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.025174+0000","last_change":"2024-09-21T03:24:38.024584+0000","last_active":"2024-09-21T03:24:38.025174+0000","last_peered":"2024-09-21T03:24:38.025174+0000","last_clean":"2024-09-21T03:24:38.025174+0000","last_became_active":"2024-09-21T03:24:38.024237+0000","last_became_peered":"2024-09-21T03:24:38.024237+0000","last_unstale":"2024-09-21T03:24:38.025174+0000","last_undegraded":"2024-09-21T03:24:38.025174+0000","last_fullsized":"2024-09-21T03:24:38.025174+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:11:04.742300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:37.997604+0000","last_change":"2024-09-21T03:24:37.997604+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.997604+0000","last_undegraded":"2024-09-21T03:24:37.997604+0000","last_fullsized":"2024-09-21T03:24:37.997604+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.012184+0000","last_change":"2024-09-21T03:24:38.006652+0000","last_active":"2024-09-21T03:24:38.012184+0000","last_peered":"2024-09-21T03:24:38.012184+0000","last_clean":"2024-09-21T03:24:38.012184+0000","last_became_active":"2024-09-21T03:24:38.006287+0000","last_became_peered":"2024-09-21T03:24:38.006287+0000","last_unstale":"2024-09-21T03:24:38.012184+0000","last_undegraded":"2024-09-21T03:24:38.012184+0000","last_fullsized":"2024-09-21T03:24:38.012184+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:05.098529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003029+0000","last_change":"2024-09-21T03:24:38.003029+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003029+0000","last_undegraded":"2024-09-21T03:24:38.003029+0000","last_fullsized":"2024-09-21T03:24:38.003029+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.023856+0000","last_change":"2024-09-21T03:24:38.020494+0000","last_active":"2024-09-21T03:24:38.023856+0000","last_peered":"2024-09-21T03:24:38.023856+0000","last_clean":"2024-09-21T03:24:38.023856+0000","last_became_active":"2024-09-21T03:24:38.019461+0000","last_became_peered":"2024-09-21T03:24:38.019461+0000","last_unstale":"2024-09-21T03:24:38.023856+0000","last_undegraded":"2024-09-21T03:24:38.023856+0000","last_fullsized":"2024-09-21T03:24:38.023856+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:02.623575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.004869+0000","last_change":"2024-09-21T03:24:38.004869+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.004869+0000","last_undegraded":"2024-09-21T03:24:38.004869+0000","last_fullsized":"2024-09-21T03:24:38.004869+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.014683+0000","last_change":"2024-09-21T03:24:38.009947+0000","last_active":"2024-09-21T03:24:38.014683+0000","last_peered":"2024-09-21T03:24:38.014683+0000","last_clean":"2024-09-21T03:24:38.014683+0000","last_became_active":"2024-09-21T03:24:38.009587+0000","last_became_peered":"2024-09-21T03:24:38.009587+0000","last_unstale":"2024-09-21T03:24:38.014683+0000","last_undegraded":"2024-09-21T03:24:38.014683+0000","last_fullsized":"2024-09-21T03:24:38.014683+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:52.734164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003114+0000","last_change":"2024-09-21T03:24:38.003114+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003114+0000","last_undegraded":"2024-09-21T03:24:38.003114+0000","last_fullsized":"2024-09-21T03:24:38.003114+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.014314+0000","last_change":"2024-09-21T03:24:38.010166+0000","last_active":"2024-09-21T03:24:38.014314+0000","last_peered":"2024-09-21T03:24:38.014314+0000","last_clean":"2024-09-21T03:24:38.014314+0000","last_became_active":"2024-09-21T03:24:38.009774+0000","last_became_peered":"2024-09-21T03:24:38.009774+0000","last_unstale":"2024-09-21T03:24:38.014314+0000","last_undegraded":"2024-09-21T03:24:38.014314+0000","last_fullsized":"2024-09-21T03:24:38.014314+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:05:48.407790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.000756+0000","last_change":"2024-09-21T03:24:38.000756+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.000756+0000","last_undegraded":"2024-09-21T03:24:38.000756+0000","last_fullsized":"2024-09-21T03:24:38.000756+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:24:36.986597+0000","last_change":"2024-09-21T03:24:36.986597+0000","last_active":"2024-09-21T03:24:36.986597+0000","last_peered":"2024-09-21T03:24:36.986597+0000","last_clean":"2024-09-21T03:24:36.986597+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:36.986597+0000","last_undegraded":"2024-09-21T03:24:36.986597+0000","last_fullsized":"2024-09-21T03:24:36.986597+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.006035+0000","last_change":"2024-09-21T03:24:38.006035+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.006035+0000","last_undegraded":"2024-09-21T03:24:38.006035+0000","last_fullsized":"2024-09-21T03:24:38.006035+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:24:36.986597+0000","last_change":"2024-09-21T03:24:36.986597+0000","last_active":"2024-09-21T03:24:36.986597+0000","last_peered":"2024-09-21T03:24:36.986597+0000","last_clean":"2024-09-21T03:24:36.986597+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:36.986597+0000","last_undegraded":"2024-09-21T03:24:36.986597+0000","last_fullsized":"2024-09-21T03:24:36.986597+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003049+0000","last_change":"2024-09-21T03:24:38.003049+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003049+0000","last_undegraded":"2024-09-21T03:24:38.003049+0000","last_fullsized":"2024-09-21T03:24:38.003049+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.023296+0000","last_change":"2024-09-21T03:24:38.020820+0000","last_active":"2024-09-21T03:24:38.023296+0000","last_peered":"2024-09-21T03:24:38.023296+0000","last_clean":"2024-09-21T03:24:38.023296+0000","last_became_active":"2024-09-21T03:24:38.020470+0000","last_became_peered":"2024-09-21T03:24:38.020470+0000","last_unstale":"2024-09-21T03:24:38.023296+0000","last_undegraded":"2024-09-21T03:24:38.023296+0000","last_fullsized":"2024-09-21T03:24:38.023296+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:07.330132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.004963+0000","last_change":"2024-09-21T03:24:38.004963+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.004963+0000","last_undegraded":"2024-09-21T03:24:38.004963+0000","last_fullsized":"2024-09-21T03:24:38.004963+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.017363+0000","last_change":"2024-09-21T03:24:38.012506+0000","last_active":"2024-09-21T03:24:38.017363+0000","last_peered":"2024-09-21T03:24:38.017363+0000","last_clean":"2024-09-21T03:24:38.017363+0000","last_became_active":"2024-09-21T03:24:38.012187+0000","last_became_peered":"2024-09-21T03:24:38.012187+0000","last_unstale":"2024-09-21T03:24:38.017363+0000","last_undegraded":"2024-09-21T03:24:38.017363+0000","last_fullsized":"2024-09-21T03:24:38.017363+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:52.734164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.002421+0000","last_change":"2024-09-21T03:24:38.002421+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.002421+0000","last_undegraded":"2024-09-21T03:24:38.002421+0000","last_fullsized":"2024-09-21T03:24:38.002421+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:24:36.986597+0000","last_change":"2024-09-21T03:24:36.986597+0000","last_active":"2024-09-21T03:24:36.986597+0000","last_peered":"2024-09-21T03:24:36.986597+0000","last_clean":"2024-09-21T03:24:36.986597+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:36.986597+0000","last_undegraded":"2024-09-21T03:24:36.986597+0000","last_fullsized":"2024-09-21T03:24:36.986597+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:24:37.988740+0000","last_change":"2024-09-21T03:24:37.988740+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.988740+0000","last_undegraded":"2024-09-21T03:24:37.988740+0000","last_fullsized":"2024-09-21T03:24:37.988740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.014607+0000","last_change":"2024-09-21T03:24:38.010449+0000","last_active":"2024-09-21T03:24:38.014607+0000","last_peered":"2024-09-21T03:24:38.014607+0000","last_clean":"2024-09-21T03:24:38.014607+0000","last_became_active":"2024-09-21T03:24:38.010079+0000","last_became_peered":"2024-09-21T03:24:38.010079+0000","last_unstale":"2024-09-21T03:24:38.014607+0000","last_undegraded":"2024-09-21T03:24:38.014607+0000","last_fullsized":"2024-09-21T03:24:38.014607+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:05.098529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.008511+0000","last_change":"2024-09-21T03:24:38.008511+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.008511+0000","last_undegraded":"2024-09-21T03:24:38.008511+0000","last_fullsized":"2024-09-21T03:24:38.008511+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:24:36.986597+0000","last_change":"2024-09-21T03:24:36.986597+0000","last_active":"2024-09-21T03:24:36.986597+0000","last_peered":"2024-09-21T03:24:36.986597+0000","last_clean":"2024-09-21T03:24:36.986597+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:36.986597+0000","last_undegraded":"2024-09-21T03:24:36.986597+0000","last_fullsized":"2024-09-21T03:24:36.986597+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.009699+0000","last_change":"2024-09-21T03:24:38.009699+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.009699+0000","last_undegraded":"2024-09-21T03:24:38.009699+0000","last_fullsized":"2024-09-21T03:24:38.009699+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:24:36.986597+0000","last_change":"2024-09-21T03:24:36.986597+0000","last_active":"2024-09-21T03:24:36.986597+0000","last_peered":"2024-09-21T03:24:36.986597+0000","last_clean":"2024-09-21T03:24:36.986597+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:36.986597+0000","last_undegraded":"2024-09-21T03:24:36.986597+0000","last_fullsized":"2024-09-21T03:24:36.986597+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.001353+0000","last_change":"2024-09-21T03:24:38.001353+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.001353+0000","last_undegraded":"2024-09-21T03:24:38.001353+0000","last_fullsized":"2024-09-21T03:24:38.001353+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.009636+0000","last_change":"2024-09-21T03:24:38.008647+0000","last_active":"2024-09-21T03:24:38.009636+0000","last_peered":"2024-09-21T03:24:38.009636+0000","last_clean":"2024-09-21T03:24:38.009636+0000","last_became_active":"2024-09-21T03:24:38.008243+0000","last_became_peered":"2024-09-21T03:24:38.008243+0000","last_unstale":"2024-09-21T03:24:38.009636+0000","last_undegraded":"2024-09-21T03:24:38.009636+0000","last_fullsized":"2024-09-21T03:24:38.009636+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:07.016728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.005410+0000","last_change":"2024-09-21T03:24:38.005410+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.005410+0000","last_undegraded":"2024-09-21T03:24:38.005410+0000","last_fullsized":"2024-09-21T03:24:38.005410+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:24:36.986597+0000","last_change":"2024-09-21T03:24:36.986597+0000","last_active":"2024-09-21T03:24:36.986597+0000","last_peered":"2024-09-21T03:24:36.986597+0000","last_clean":"2024-09-21T03:24:36.986597+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:36.986597+0000","last_undegraded":"2024-09-21T03:24:36.986597+0000","last_fullsized":"2024-09-21T03:24:36.986597+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:37.997676+0000","last_change":"2024-09-21T03:24:37.997676+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.997676+0000","last_undegraded":"2024-09-21T03:24:37.997676+0000","last_fullsized":"2024-09-21T03:24:37.997676+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.023348+0000","last_change":"2024-09-21T03:24:38.022179+0000","last_active":"2024-09-21T03:24:38.023348+0000","last_peered":"2024-09-21T03:24:38.023348+0000","last_clean":"2024-09-21T03:24:38.023348+0000","last_became_active":"2024-09-21T03:24:38.021893+0000","last_became_peered":"2024-09-21T03:24:38.021893+0000","last_unstale":"2024-09-21T03:24:38.023348+0000","last_undegraded":"2024-09-21T03:24:38.023348+0000","last_fullsized":"2024-09-21T03:24:38.023348+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:12.129049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.004467+0000","last_change":"2024-09-21T03:24:38.004467+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.004467+0000","last_undegraded":"2024-09-21T03:24:38.004467+0000","last_fullsized":"2024-09-21T03:24:38.004467+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.023870+0000","last_change":"2024-09-21T03:24:38.020153+0000","last_active":"2024-09-21T03:24:38.023870+0000","last_peered":"2024-09-21T03:24:38.023870+0000","last_clean":"2024-09-21T03:24:38.023870+0000","last_became_active":"2024-09-21T03:24:38.019792+0000","last_became_peered":"2024-09-21T03:24:38.019792+0000","last_unstale":"2024-09-21T03:24:38.023870+0000","last_undegraded":"2024-09-21T03:24:38.023870+0000","last_fullsized":"2024-09-21T03:24:38.023870+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:25.908182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.001944+0000","last_change":"2024-09-21T03:24:38.001944+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.001944+0000","last_undegraded":"2024-09-21T03:24:38.001944+0000","last_fullsized":"2024-09-21T03:24:38.001944+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.021398+0000","last_change":"2024-09-21T03:24:38.017820+0000","last_active":"2024-09-21T03:24:38.021398+0000","last_peered":"2024-09-21T03:24:38.021398+0000","last_clean":"2024-09-21T03:24:38.021398+0000","last_became_active":"2024-09-21T03:24:38.017280+0000","last_became_peered":"2024-09-21T03:24:38.017280+0000","last_unstale":"2024-09-21T03:24:38.021398+0000","last_undegraded":"2024-09-21T03:24:38.021398+0000","last_fullsized":"2024-09-21T03:24:38.021398+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:31:14.545857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.002984+0000","last_change":"2024-09-21T03:24:38.002984+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.002984+0000","last_undegraded":"2024-09-21T03:24:38.002984+0000","last_fullsized":"2024-09-21T03:24:38.002984+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.014481+0000","last_change":"2024-09-21T03:24:38.009806+0000","last_active":"2024-09-21T03:24:38.014481+0000","last_peered":"2024-09-21T03:24:38.014481+0000","last_clean":"2024-09-21T03:24:38.014481+0000","last_became_active":"2024-09-21T03:24:38.009384+0000","last_became_peered":"2024-09-21T03:24:38.009384+0000","last_unstale":"2024-09-21T03:24:38.014481+0000","last_undegraded":"2024-09-21T03:24:38.014481+0000","last_fullsized":"2024-09-21T03:24:38.014481+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:52:46.248335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":242,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:37.998420+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:24:37.998420+0000","last_peered":"2024-09-21T03:24:37.998420+0000","last_clean":"2024-09-21T03:24:37.998420+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:24:37.998420+0000","last_undegraded":"2024-09-21T03:24:37.998420+0000","last_fullsized":"2024-09-21T03:24:37.998420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":110,"acting":110,"num_store_stats":7},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":44,"acting":44,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509521,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32864,"kb_used_data":1672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338976,"statfs":{"total":96636764160,"available":96603111424,"internally_reserved":0,"allocated":1712128,"data_stored":1060484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509520,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1118208,"data_stored":470116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509519,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1118208,"data_stored":470116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509519,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1105920,"data_stored":463841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509520,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1118208,"data_stored":470116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509520,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1118208,"data_stored":470116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509520,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1118208,"data_stored":470116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32836,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339004,"statfs":{"total":96636764160,"available":96603140096,"internally_reserved":0,"allocated":1687552,"data_stored":1048392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:24:43.024 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:24:43.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.172+0000 7f309ea93640 1 -- 172.21.15.105:0/1595159629 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30980cd3e0 msgr2=0x7f3098070180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:43.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.172+0000 7f309ea93640 1 --2- 172.21.15.105:0/1595159629 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30980cd3e0 0x7f3098070180 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f308c005fd0 tx=0x7f308c02a820 comp rx=0 tx=0).stop 2024-09-21T03:24:43.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.172+0000 7f309ea93640 1 -- 172.21.15.105:0/1595159629 shutdown_connections 2024-09-21T03:24:43.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.172+0000 7f309ea93640 1 --2- 172.21.15.105:0/1595159629 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30980706c0 0x7f3098072ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:43.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.172+0000 7f309ea93640 1 --2- 172.21.15.105:0/1595159629 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30980cd3e0 0x7f3098070180 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:43.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.172+0000 7f309ea93640 1 -- 172.21.15.105:0/1595159629 >> 172.21.15.105:0/1595159629 conn(0x7f309806d7d0 msgr2=0x7f30980b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:43.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.172+0000 7f309ea93640 1 -- 172.21.15.105:0/1595159629 shutdown_connections 2024-09-21T03:24:43.175 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.172+0000 7f309ea93640 1 -- 172.21.15.105:0/1595159629 wait complete. 2024-09-21T03:24:43.175 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.174+0000 7f309ea93640 1 Processor -- start 2024-09-21T03:24:43.175 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.174+0000 7f309ea93640 1 -- start start 2024-09-21T03:24:43.178 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.175+0000 7f309ea93640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30980706c0 0x7f30980ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:43.178 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.175+0000 7f309ea93640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30980af780 0x7f30981f8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:43.178 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.175+0000 7f309ea93640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30980cd3e0 0x7f30981e8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:43.178 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.175+0000 7f309ea93640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3098073bd0 con 0x7f30980706c0 2024-09-21T03:24:43.178 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.175+0000 7f309ea93640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3098073a50 con 0x7f30980cd3e0 2024-09-21T03:24:43.178 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.175+0000 7f309ea93640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f309815f930 con 0x7f30980af780 2024-09-21T03:24:43.178 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.175+0000 7f309c82f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30980706c0 0x7f30980ae9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:43.179 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.175+0000 7f309c82f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30980706c0 0x7f30980ae9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:60508/0 (socket says 172.21.15.105:60508) 2024-09-21T03:24:43.179 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.175+0000 7f309c82f640 1 -- 172.21.15.105:0/191072005 learned_addr learned my addr 172.21.15.105:0/191072005 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:43.179 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.175+0000 7f309d030640 1 --2- 172.21.15.105:0/191072005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30980cd3e0 0x7f30981e8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:43.179 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.175+0000 7f3097fff640 1 --2- 172.21.15.105:0/191072005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30980af780 0x7f30981f8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:43.179 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.176+0000 7f309c82f640 1 -- 172.21.15.105:0/191072005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30980af780 msgr2=0x7f30981f8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:43.179 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.176+0000 7f309c82f640 1 --2- 172.21.15.105:0/191072005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30980af780 0x7f30981f8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:43.179 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.176+0000 7f309c82f640 1 -- 172.21.15.105:0/191072005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30980cd3e0 msgr2=0x7f30981e8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:43.179 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.176+0000 7f309c82f640 1 --2- 172.21.15.105:0/191072005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30980cd3e0 0x7f30981e8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:43.179 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.176+0000 7f309c82f640 1 -- 172.21.15.105:0/191072005 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30981f98d0 con 0x7f30980706c0 2024-09-21T03:24:43.179 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.176+0000 7f3097fff640 1 --2- 172.21.15.105:0/191072005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30980af780 0x7f30981f8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:24:43.179 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.176+0000 7f309c82f640 1 --2- 172.21.15.105:0/191072005 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30980706c0 0x7f30980ae9c0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f308800c3a0 tx=0x7f308800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:43.179 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.176+0000 7f30957fa640 1 -- 172.21.15.105:0/191072005 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3088017070 con 0x7f30980706c0 2024-09-21T03:24:43.179 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.176+0000 7f30957fa640 1 -- 172.21.15.105:0/191072005 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30880053c0 con 0x7f30980706c0 2024-09-21T03:24:43.179 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.176+0000 7f309ea93640 1 -- 172.21.15.105:0/191072005 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30981f58a0 con 0x7f30980706c0 2024-09-21T03:24:43.180 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.176+0000 7f30957fa640 1 -- 172.21.15.105:0/191072005 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3088003850 con 0x7f30980706c0 2024-09-21T03:24:43.180 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.176+0000 7f309ea93640 1 -- 172.21.15.105:0/191072005 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30981f5e60 con 0x7f30980706c0 2024-09-21T03:24:43.180 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.177+0000 7f309ea93640 1 -- 172.21.15.105:0/191072005 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3098072ff0 con 0x7f30980706c0 2024-09-21T03:24:43.180 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.178+0000 7f30957fa640 1 -- 172.21.15.105:0/191072005 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f308801a070 con 0x7f30980706c0 2024-09-21T03:24:43.181 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.178+0000 7f30957fa640 1 --2- 172.21.15.105:0/191072005 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3084078b90 0x7f308407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:43.181 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.178+0000 7f30957fa640 1 -- 172.21.15.105:0/191072005 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7f308809a010 con 0x7f30980706c0 2024-09-21T03:24:43.181 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.179+0000 7f3097fff640 1 --2- 172.21.15.105:0/191072005 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3084078b90 0x7f308407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:43.181 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.179+0000 7f3097fff640 1 --2- 172.21.15.105:0/191072005 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3084078b90 0x7f308407b0a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f308c034000 tx=0x7f308c004ab0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:43.184 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.183+0000 7f30957fa640 1 -- 172.21.15.105:0/191072005 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3088061e10 con 0x7f30980706c0 2024-09-21T03:24:43.359 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.358+0000 7f309ea93640 1 -- 172.21.15.105:0/191072005 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f30981f9bb0 con 0x7f3084078b90 2024-09-21T03:24:43.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.362+0000 7f30957fa640 1 -- 172.21.15.105:0/191072005 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244870 (secure 0 0 0) 0x7f30981f9bb0 con 0x7f3084078b90 2024-09-21T03:24:43.366 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:24:43.367 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:24:43.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.365+0000 7f309ea93640 1 -- 172.21.15.105:0/191072005 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3084078b90 msgr2=0x7f308407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:43.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.365+0000 7f309ea93640 1 --2- 172.21.15.105:0/191072005 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3084078b90 0x7f308407b0a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f308c034000 tx=0x7f308c004ab0 comp rx=0 tx=0).stop 2024-09-21T03:24:43.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.365+0000 7f309ea93640 1 -- 172.21.15.105:0/191072005 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30980706c0 msgr2=0x7f30980ae9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:43.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.365+0000 7f309ea93640 1 --2- 172.21.15.105:0/191072005 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30980706c0 0x7f30980ae9c0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f308800c3a0 tx=0x7f308800c860 comp rx=0 tx=0).stop 2024-09-21T03:24:43.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.366+0000 7f309ea93640 1 -- 172.21.15.105:0/191072005 shutdown_connections 2024-09-21T03:24:43.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.366+0000 7f309ea93640 1 --2- 172.21.15.105:0/191072005 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3084078b90 0x7f308407b0a0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:43.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.366+0000 7f309ea93640 1 --2- 172.21.15.105:0/191072005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30980cd3e0 0x7f30981e8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:43.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.366+0000 7f309ea93640 1 --2- 172.21.15.105:0/191072005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30980af780 0x7f30981f8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:43.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.366+0000 7f309ea93640 1 --2- 172.21.15.105:0/191072005 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30980706c0 0x7f30980ae9c0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:43.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.366+0000 7f309ea93640 1 -- 172.21.15.105:0/191072005 >> 172.21.15.105:0/191072005 conn(0x7f309806d7d0 msgr2=0x7f30980ce320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:43.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.366+0000 7f309ea93640 1 -- 172.21.15.105:0/191072005 shutdown_connections 2024-09-21T03:24:43.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.366+0000 7f309ea93640 1 -- 172.21.15.105:0/191072005 wait complete. 2024-09-21T03:24:43.378 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":279,"stamp":"2024-09-21T03:24:41.379210+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":156,"acting":156,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259380,"kb_used_data":9860,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715340,"statfs":{"total":773094113280,"available":772828508160,"internally_reserved":0,"allocated":10096640,"data_stored":4923297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.385696"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.009730+0000","last_change":"2024-09-21T03:24:38.009730+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.009730+0000","last_undegraded":"2024-09-21T03:24:38.009730+0000","last_fullsized":"2024-09-21T03:24:38.009730+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:24:37.988740+0000","last_change":"2024-09-21T03:24:37.988740+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.988740+0000","last_undegraded":"2024-09-21T03:24:37.988740+0000","last_fullsized":"2024-09-21T03:24:37.988740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.015446+0000","last_change":"2024-09-21T03:24:38.015446+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.015446+0000","last_undegraded":"2024-09-21T03:24:38.015446+0000","last_fullsized":"2024-09-21T03:24:38.015446+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.001334+0000","last_change":"2024-09-21T03:24:38.001334+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.001334+0000","last_undegraded":"2024-09-21T03:24:38.001334+0000","last_fullsized":"2024-09-21T03:24:38.001334+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:37.998731+0000","last_change":"2024-09-21T03:24:37.998731+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.998731+0000","last_undegraded":"2024-09-21T03:24:37.998731+0000","last_fullsized":"2024-09-21T03:24:37.998731+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.004276+0000","last_change":"2024-09-21T03:24:38.004276+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.004276+0000","last_undegraded":"2024-09-21T03:24:38.004276+0000","last_fullsized":"2024-09-21T03:24:38.004276+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.004347+0000","last_change":"2024-09-21T03:24:38.004347+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.004347+0000","last_undegraded":"2024-09-21T03:24:38.004347+0000","last_fullsized":"2024-09-21T03:24:38.004347+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:24:37.988740+0000","last_change":"2024-09-21T03:24:37.988740+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.988740+0000","last_undegraded":"2024-09-21T03:24:37.988740+0000","last_fullsized":"2024-09-21T03:24:37.988740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:37.999417+0000","last_change":"2024-09-21T03:24:37.999417+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.999417+0000","last_undegraded":"2024-09-21T03:24:37.999417+0000","last_fullsized":"2024-09-21T03:24:37.999417+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003577+0000","last_change":"2024-09-21T03:24:38.003577+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003577+0000","last_undegraded":"2024-09-21T03:24:38.003577+0000","last_fullsized":"2024-09-21T03:24:38.003577+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.004174+0000","last_change":"2024-09-21T03:24:38.004174+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.004174+0000","last_undegraded":"2024-09-21T03:24:38.004174+0000","last_fullsized":"2024-09-21T03:24:38.004174+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:37.999876+0000","last_change":"2024-09-21T03:24:37.999876+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.999876+0000","last_undegraded":"2024-09-21T03:24:37.999876+0000","last_fullsized":"2024-09-21T03:24:37.999876+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.001000+0000","last_change":"2024-09-21T03:24:38.001000+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.001000+0000","last_undegraded":"2024-09-21T03:24:38.001000+0000","last_fullsized":"2024-09-21T03:24:38.001000+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.007202+0000","last_change":"2024-09-21T03:24:38.007202+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.007202+0000","last_undegraded":"2024-09-21T03:24:38.007202+0000","last_fullsized":"2024-09-21T03:24:38.007202+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.004206+0000","last_change":"2024-09-21T03:24:38.004206+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.004206+0000","last_undegraded":"2024-09-21T03:24:38.004206+0000","last_fullsized":"2024-09-21T03:24:38.004206+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003903+0000","last_change":"2024-09-21T03:24:38.003903+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003903+0000","last_undegraded":"2024-09-21T03:24:38.003903+0000","last_fullsized":"2024-09-21T03:24:38.003903+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:24:37.988740+0000","last_change":"2024-09-21T03:24:37.988740+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.988740+0000","last_undegraded":"2024-09-21T03:24:37.988740+0000","last_fullsized":"2024-09-21T03:24:37.988740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003207+0000","last_change":"2024-09-21T03:24:38.003207+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003207+0000","last_undegraded":"2024-09-21T03:24:38.003207+0000","last_fullsized":"2024-09-21T03:24:38.003207+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003192+0000","last_change":"2024-09-21T03:24:38.003192+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003192+0000","last_undegraded":"2024-09-21T03:24:38.003192+0000","last_fullsized":"2024-09-21T03:24:38.003192+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:37.999307+0000","last_change":"2024-09-21T03:24:37.999307+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.999307+0000","last_undegraded":"2024-09-21T03:24:37.999307+0000","last_fullsized":"2024-09-21T03:24:37.999307+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003713+0000","last_change":"2024-09-21T03:24:38.003713+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003713+0000","last_undegraded":"2024-09-21T03:24:38.003713+0000","last_fullsized":"2024-09-21T03:24:38.003713+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:24:37.988740+0000","last_change":"2024-09-21T03:24:37.988740+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.988740+0000","last_undegraded":"2024-09-21T03:24:37.988740+0000","last_fullsized":"2024-09-21T03:24:37.988740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:24:37.988740+0000","last_change":"2024-09-21T03:24:37.988740+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.988740+0000","last_undegraded":"2024-09-21T03:24:37.988740+0000","last_fullsized":"2024-09-21T03:24:37.988740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.002993+0000","last_change":"2024-09-21T03:24:38.002993+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.002993+0000","last_undegraded":"2024-09-21T03:24:38.002993+0000","last_fullsized":"2024-09-21T03:24:38.002993+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.005336+0000","last_change":"2024-09-21T03:24:38.005336+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.005336+0000","last_undegraded":"2024-09-21T03:24:38.005336+0000","last_fullsized":"2024-09-21T03:24:38.005336+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:24:37.988740+0000","last_change":"2024-09-21T03:24:37.988740+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.988740+0000","last_undegraded":"2024-09-21T03:24:37.988740+0000","last_fullsized":"2024-09-21T03:24:37.988740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.002986+0000","last_change":"2024-09-21T03:24:38.002986+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.002986+0000","last_undegraded":"2024-09-21T03:24:38.002986+0000","last_fullsized":"2024-09-21T03:24:38.002986+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.006293+0000","last_change":"2024-09-21T03:24:38.006293+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.006293+0000","last_undegraded":"2024-09-21T03:24:38.006293+0000","last_fullsized":"2024-09-21T03:24:38.006293+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:24:37.988740+0000","last_change":"2024-09-21T03:24:37.988740+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.988740+0000","last_undegraded":"2024-09-21T03:24:37.988740+0000","last_fullsized":"2024-09-21T03:24:37.988740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.006709+0000","last_change":"2024-09-21T03:24:38.006709+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.006709+0000","last_undegraded":"2024-09-21T03:24:38.006709+0000","last_fullsized":"2024-09-21T03:24:38.006709+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003705+0000","last_change":"2024-09-21T03:24:38.003705+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003705+0000","last_undegraded":"2024-09-21T03:24:38.003705+0000","last_fullsized":"2024-09-21T03:24:38.003705+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.010814+0000","last_change":"2024-09-21T03:24:38.010814+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.010814+0000","last_undegraded":"2024-09-21T03:24:38.010814+0000","last_fullsized":"2024-09-21T03:24:38.010814+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003562+0000","last_change":"2024-09-21T03:24:38.003562+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003562+0000","last_undegraded":"2024-09-21T03:24:38.003562+0000","last_fullsized":"2024-09-21T03:24:38.003562+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:24:36.986597+0000","last_change":"2024-09-21T03:24:36.986597+0000","last_active":"2024-09-21T03:24:36.986597+0000","last_peered":"2024-09-21T03:24:36.986597+0000","last_clean":"2024-09-21T03:24:36.986597+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:36.986597+0000","last_undegraded":"2024-09-21T03:24:36.986597+0000","last_fullsized":"2024-09-21T03:24:36.986597+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.002494+0000","last_change":"2024-09-21T03:24:38.002494+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.002494+0000","last_undegraded":"2024-09-21T03:24:38.002494+0000","last_fullsized":"2024-09-21T03:24:38.002494+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.020618+0000","last_change":"2024-09-21T03:24:38.019879+0000","last_active":"2024-09-21T03:24:38.020618+0000","last_peered":"2024-09-21T03:24:38.020618+0000","last_clean":"2024-09-21T03:24:38.020618+0000","last_became_active":"2024-09-21T03:24:38.019498+0000","last_became_peered":"2024-09-21T03:24:38.019498+0000","last_unstale":"2024-09-21T03:24:38.020618+0000","last_undegraded":"2024-09-21T03:24:38.020618+0000","last_fullsized":"2024-09-21T03:24:38.020618+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:05.347691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.012629+0000","last_change":"2024-09-21T03:24:38.012629+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.012629+0000","last_undegraded":"2024-09-21T03:24:38.012629+0000","last_fullsized":"2024-09-21T03:24:38.012629+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:24:36.986597+0000","last_change":"2024-09-21T03:24:36.986597+0000","last_active":"2024-09-21T03:24:36.986597+0000","last_peered":"2024-09-21T03:24:36.986597+0000","last_clean":"2024-09-21T03:24:36.986597+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:36.986597+0000","last_undegraded":"2024-09-21T03:24:36.986597+0000","last_fullsized":"2024-09-21T03:24:36.986597+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:37.998740+0000","last_change":"2024-09-21T03:24:37.998740+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.998740+0000","last_undegraded":"2024-09-21T03:24:37.998740+0000","last_fullsized":"2024-09-21T03:24:37.998740+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:24:36.986597+0000","last_change":"2024-09-21T03:24:36.986597+0000","last_active":"2024-09-21T03:24:36.986597+0000","last_peered":"2024-09-21T03:24:36.986597+0000","last_clean":"2024-09-21T03:24:36.986597+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:36.986597+0000","last_undegraded":"2024-09-21T03:24:36.986597+0000","last_fullsized":"2024-09-21T03:24:36.986597+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.002418+0000","last_change":"2024-09-21T03:24:38.002418+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.002418+0000","last_undegraded":"2024-09-21T03:24:38.002418+0000","last_fullsized":"2024-09-21T03:24:38.002418+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.024352+0000","last_change":"2024-09-21T03:24:38.020873+0000","last_active":"2024-09-21T03:24:38.024352+0000","last_peered":"2024-09-21T03:24:38.024352+0000","last_clean":"2024-09-21T03:24:38.024352+0000","last_became_active":"2024-09-21T03:24:38.020586+0000","last_became_peered":"2024-09-21T03:24:38.020586+0000","last_unstale":"2024-09-21T03:24:38.024352+0000","last_undegraded":"2024-09-21T03:24:38.024352+0000","last_fullsized":"2024-09-21T03:24:38.024352+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:38.297464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.002377+0000","last_change":"2024-09-21T03:24:38.002377+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.002377+0000","last_undegraded":"2024-09-21T03:24:38.002377+0000","last_fullsized":"2024-09-21T03:24:38.002377+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:24:36.986597+0000","last_change":"2024-09-21T03:24:36.986597+0000","last_active":"2024-09-21T03:24:36.986597+0000","last_peered":"2024-09-21T03:24:36.986597+0000","last_clean":"2024-09-21T03:24:36.986597+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:36.986597+0000","last_undegraded":"2024-09-21T03:24:36.986597+0000","last_fullsized":"2024-09-21T03:24:36.986597+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.000926+0000","last_change":"2024-09-21T03:24:38.000926+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.000926+0000","last_undegraded":"2024-09-21T03:24:38.000926+0000","last_fullsized":"2024-09-21T03:24:38.000926+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.017601+0000","last_change":"2024-09-21T03:24:38.015466+0000","last_active":"2024-09-21T03:24:38.017601+0000","last_peered":"2024-09-21T03:24:38.017601+0000","last_clean":"2024-09-21T03:24:38.017601+0000","last_became_active":"2024-09-21T03:24:38.015170+0000","last_became_peered":"2024-09-21T03:24:38.015170+0000","last_unstale":"2024-09-21T03:24:38.017601+0000","last_undegraded":"2024-09-21T03:24:38.017601+0000","last_fullsized":"2024-09-21T03:24:38.017601+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:45:46.694000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:37.999985+0000","last_change":"2024-09-21T03:24:37.999985+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.999985+0000","last_undegraded":"2024-09-21T03:24:37.999985+0000","last_fullsized":"2024-09-21T03:24:37.999985+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.029707+0000","last_change":"2024-09-21T03:24:38.024676+0000","last_active":"2024-09-21T03:24:38.029707+0000","last_peered":"2024-09-21T03:24:38.029707+0000","last_clean":"2024-09-21T03:24:38.029707+0000","last_became_active":"2024-09-21T03:24:38.024305+0000","last_became_peered":"2024-09-21T03:24:38.024305+0000","last_unstale":"2024-09-21T03:24:38.029707+0000","last_undegraded":"2024-09-21T03:24:38.029707+0000","last_fullsized":"2024-09-21T03:24:38.029707+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:01.136782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:24:37.988740+0000","last_change":"2024-09-21T03:24:37.988740+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.988740+0000","last_undegraded":"2024-09-21T03:24:37.988740+0000","last_fullsized":"2024-09-21T03:24:37.988740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.023790+0000","last_change":"2024-09-21T03:24:38.019784+0000","last_active":"2024-09-21T03:24:38.023790+0000","last_peered":"2024-09-21T03:24:38.023790+0000","last_clean":"2024-09-21T03:24:38.023790+0000","last_became_active":"2024-09-21T03:24:38.019456+0000","last_became_peered":"2024-09-21T03:24:38.019456+0000","last_unstale":"2024-09-21T03:24:38.023790+0000","last_undegraded":"2024-09-21T03:24:38.023790+0000","last_fullsized":"2024-09-21T03:24:38.023790+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:28.389174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:37.997537+0000","last_change":"2024-09-21T03:24:37.997537+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.997537+0000","last_undegraded":"2024-09-21T03:24:37.997537+0000","last_fullsized":"2024-09-21T03:24:37.997537+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.012124+0000","last_change":"2024-09-21T03:24:38.011409+0000","last_active":"2024-09-21T03:24:38.012124+0000","last_peered":"2024-09-21T03:24:38.012124+0000","last_clean":"2024-09-21T03:24:38.012124+0000","last_became_active":"2024-09-21T03:24:38.011093+0000","last_became_peered":"2024-09-21T03:24:38.011093+0000","last_unstale":"2024-09-21T03:24:38.012124+0000","last_undegraded":"2024-09-21T03:24:38.012124+0000","last_fullsized":"2024-09-21T03:24:38.012124+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:27:39.891218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003759+0000","last_change":"2024-09-21T03:24:38.003759+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003759+0000","last_undegraded":"2024-09-21T03:24:38.003759+0000","last_fullsized":"2024-09-21T03:24:38.003759+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.014568+0000","last_change":"2024-09-21T03:24:38.010947+0000","last_active":"2024-09-21T03:24:38.014568+0000","last_peered":"2024-09-21T03:24:38.014568+0000","last_clean":"2024-09-21T03:24:38.014568+0000","last_became_active":"2024-09-21T03:24:38.010622+0000","last_became_peered":"2024-09-21T03:24:38.010622+0000","last_unstale":"2024-09-21T03:24:38.014568+0000","last_undegraded":"2024-09-21T03:24:38.014568+0000","last_fullsized":"2024-09-21T03:24:38.014568+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:39.345967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.001774+0000","last_change":"2024-09-21T03:24:38.001774+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.001774+0000","last_undegraded":"2024-09-21T03:24:38.001774+0000","last_fullsized":"2024-09-21T03:24:38.001774+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.014753+0000","last_change":"2024-09-21T03:24:38.011098+0000","last_active":"2024-09-21T03:24:38.014753+0000","last_peered":"2024-09-21T03:24:38.014753+0000","last_clean":"2024-09-21T03:24:38.014753+0000","last_became_active":"2024-09-21T03:24:38.010775+0000","last_became_peered":"2024-09-21T03:24:38.010775+0000","last_unstale":"2024-09-21T03:24:38.014753+0000","last_undegraded":"2024-09-21T03:24:38.014753+0000","last_fullsized":"2024-09-21T03:24:38.014753+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:07.330132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.001499+0000","last_change":"2024-09-21T03:24:38.001499+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.001499+0000","last_undegraded":"2024-09-21T03:24:38.001499+0000","last_fullsized":"2024-09-21T03:24:38.001499+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.013734+0000","last_change":"2024-09-21T03:24:38.012254+0000","last_active":"2024-09-21T03:24:38.013734+0000","last_peered":"2024-09-21T03:24:38.013734+0000","last_clean":"2024-09-21T03:24:38.013734+0000","last_became_active":"2024-09-21T03:24:38.011372+0000","last_became_peered":"2024-09-21T03:24:38.011372+0000","last_unstale":"2024-09-21T03:24:38.013734+0000","last_undegraded":"2024-09-21T03:24:38.013734+0000","last_fullsized":"2024-09-21T03:24:38.013734+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:09:27.979140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.013455+0000","last_change":"2024-09-21T03:24:38.013455+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.013455+0000","last_undegraded":"2024-09-21T03:24:38.013455+0000","last_fullsized":"2024-09-21T03:24:38.013455+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.025174+0000","last_change":"2024-09-21T03:24:38.024584+0000","last_active":"2024-09-21T03:24:38.025174+0000","last_peered":"2024-09-21T03:24:38.025174+0000","last_clean":"2024-09-21T03:24:38.025174+0000","last_became_active":"2024-09-21T03:24:38.024237+0000","last_became_peered":"2024-09-21T03:24:38.024237+0000","last_unstale":"2024-09-21T03:24:38.025174+0000","last_undegraded":"2024-09-21T03:24:38.025174+0000","last_fullsized":"2024-09-21T03:24:38.025174+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:11:04.742300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:37.997604+0000","last_change":"2024-09-21T03:24:37.997604+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.997604+0000","last_undegraded":"2024-09-21T03:24:37.997604+0000","last_fullsized":"2024-09-21T03:24:37.997604+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.012184+0000","last_change":"2024-09-21T03:24:38.006652+0000","last_active":"2024-09-21T03:24:38.012184+0000","last_peered":"2024-09-21T03:24:38.012184+0000","last_clean":"2024-09-21T03:24:38.012184+0000","last_became_active":"2024-09-21T03:24:38.006287+0000","last_became_peered":"2024-09-21T03:24:38.006287+0000","last_unstale":"2024-09-21T03:24:38.012184+0000","last_undegraded":"2024-09-21T03:24:38.012184+0000","last_fullsized":"2024-09-21T03:24:38.012184+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:05.098529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003029+0000","last_change":"2024-09-21T03:24:38.003029+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003029+0000","last_undegraded":"2024-09-21T03:24:38.003029+0000","last_fullsized":"2024-09-21T03:24:38.003029+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.023856+0000","last_change":"2024-09-21T03:24:38.020494+0000","last_active":"2024-09-21T03:24:38.023856+0000","last_peered":"2024-09-21T03:24:38.023856+0000","last_clean":"2024-09-21T03:24:38.023856+0000","last_became_active":"2024-09-21T03:24:38.019461+0000","last_became_peered":"2024-09-21T03:24:38.019461+0000","last_unstale":"2024-09-21T03:24:38.023856+0000","last_undegraded":"2024-09-21T03:24:38.023856+0000","last_fullsized":"2024-09-21T03:24:38.023856+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:02.623575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.004869+0000","last_change":"2024-09-21T03:24:38.004869+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.004869+0000","last_undegraded":"2024-09-21T03:24:38.004869+0000","last_fullsized":"2024-09-21T03:24:38.004869+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.014683+0000","last_change":"2024-09-21T03:24:38.009947+0000","last_active":"2024-09-21T03:24:38.014683+0000","last_peered":"2024-09-21T03:24:38.014683+0000","last_clean":"2024-09-21T03:24:38.014683+0000","last_became_active":"2024-09-21T03:24:38.009587+0000","last_became_peered":"2024-09-21T03:24:38.009587+0000","last_unstale":"2024-09-21T03:24:38.014683+0000","last_undegraded":"2024-09-21T03:24:38.014683+0000","last_fullsized":"2024-09-21T03:24:38.014683+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:52.734164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003114+0000","last_change":"2024-09-21T03:24:38.003114+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003114+0000","last_undegraded":"2024-09-21T03:24:38.003114+0000","last_fullsized":"2024-09-21T03:24:38.003114+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.014314+0000","last_change":"2024-09-21T03:24:38.010166+0000","last_active":"2024-09-21T03:24:38.014314+0000","last_peered":"2024-09-21T03:24:38.014314+0000","last_clean":"2024-09-21T03:24:38.014314+0000","last_became_active":"2024-09-21T03:24:38.009774+0000","last_became_peered":"2024-09-21T03:24:38.009774+0000","last_unstale":"2024-09-21T03:24:38.014314+0000","last_undegraded":"2024-09-21T03:24:38.014314+0000","last_fullsized":"2024-09-21T03:24:38.014314+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:05:48.407790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.000756+0000","last_change":"2024-09-21T03:24:38.000756+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.000756+0000","last_undegraded":"2024-09-21T03:24:38.000756+0000","last_fullsized":"2024-09-21T03:24:38.000756+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:24:36.986597+0000","last_change":"2024-09-21T03:24:36.986597+0000","last_active":"2024-09-21T03:24:36.986597+0000","last_peered":"2024-09-21T03:24:36.986597+0000","last_clean":"2024-09-21T03:24:36.986597+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:36.986597+0000","last_undegraded":"2024-09-21T03:24:36.986597+0000","last_fullsized":"2024-09-21T03:24:36.986597+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.006035+0000","last_change":"2024-09-21T03:24:38.006035+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.006035+0000","last_undegraded":"2024-09-21T03:24:38.006035+0000","last_fullsized":"2024-09-21T03:24:38.006035+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:24:36.986597+0000","last_change":"2024-09-21T03:24:36.986597+0000","last_active":"2024-09-21T03:24:36.986597+0000","last_peered":"2024-09-21T03:24:36.986597+0000","last_clean":"2024-09-21T03:24:36.986597+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:36.986597+0000","last_undegraded":"2024-09-21T03:24:36.986597+0000","last_fullsized":"2024-09-21T03:24:36.986597+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003049+0000","last_change":"2024-09-21T03:24:38.003049+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003049+0000","last_undegraded":"2024-09-21T03:24:38.003049+0000","last_fullsized":"2024-09-21T03:24:38.003049+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.023296+0000","last_change":"2024-09-21T03:24:38.020820+0000","last_active":"2024-09-21T03:24:38.023296+0000","last_peered":"2024-09-21T03:24:38.023296+0000","last_clean":"2024-09-21T03:24:38.023296+0000","last_became_active":"2024-09-21T03:24:38.020470+0000","last_became_peered":"2024-09-21T03:24:38.020470+0000","last_unstale":"2024-09-21T03:24:38.023296+0000","last_undegraded":"2024-09-21T03:24:38.023296+0000","last_fullsized":"2024-09-21T03:24:38.023296+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:07.330132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.004963+0000","last_change":"2024-09-21T03:24:38.004963+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.004963+0000","last_undegraded":"2024-09-21T03:24:38.004963+0000","last_fullsized":"2024-09-21T03:24:38.004963+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.017363+0000","last_change":"2024-09-21T03:24:38.012506+0000","last_active":"2024-09-21T03:24:38.017363+0000","last_peered":"2024-09-21T03:24:38.017363+0000","last_clean":"2024-09-21T03:24:38.017363+0000","last_became_active":"2024-09-21T03:24:38.012187+0000","last_became_peered":"2024-09-21T03:24:38.012187+0000","last_unstale":"2024-09-21T03:24:38.017363+0000","last_undegraded":"2024-09-21T03:24:38.017363+0000","last_fullsized":"2024-09-21T03:24:38.017363+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:52.734164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.002421+0000","last_change":"2024-09-21T03:24:38.002421+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.002421+0000","last_undegraded":"2024-09-21T03:24:38.002421+0000","last_fullsized":"2024-09-21T03:24:38.002421+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:24:36.986597+0000","last_change":"2024-09-21T03:24:36.986597+0000","last_active":"2024-09-21T03:24:36.986597+0000","last_peered":"2024-09-21T03:24:36.986597+0000","last_clean":"2024-09-21T03:24:36.986597+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:36.986597+0000","last_undegraded":"2024-09-21T03:24:36.986597+0000","last_fullsized":"2024-09-21T03:24:36.986597+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:24:37.988740+0000","last_change":"2024-09-21T03:24:37.988740+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.988740+0000","last_undegraded":"2024-09-21T03:24:37.988740+0000","last_fullsized":"2024-09-21T03:24:37.988740+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.014607+0000","last_change":"2024-09-21T03:24:38.010449+0000","last_active":"2024-09-21T03:24:38.014607+0000","last_peered":"2024-09-21T03:24:38.014607+0000","last_clean":"2024-09-21T03:24:38.014607+0000","last_became_active":"2024-09-21T03:24:38.010079+0000","last_became_peered":"2024-09-21T03:24:38.010079+0000","last_unstale":"2024-09-21T03:24:38.014607+0000","last_undegraded":"2024-09-21T03:24:38.014607+0000","last_fullsized":"2024-09-21T03:24:38.014607+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:05.098529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.008511+0000","last_change":"2024-09-21T03:24:38.008511+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.008511+0000","last_undegraded":"2024-09-21T03:24:38.008511+0000","last_fullsized":"2024-09-21T03:24:38.008511+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:24:36.986597+0000","last_change":"2024-09-21T03:24:36.986597+0000","last_active":"2024-09-21T03:24:36.986597+0000","last_peered":"2024-09-21T03:24:36.986597+0000","last_clean":"2024-09-21T03:24:36.986597+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:36.986597+0000","last_undegraded":"2024-09-21T03:24:36.986597+0000","last_fullsized":"2024-09-21T03:24:36.986597+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.009699+0000","last_change":"2024-09-21T03:24:38.009699+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.009699+0000","last_undegraded":"2024-09-21T03:24:38.009699+0000","last_fullsized":"2024-09-21T03:24:38.009699+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:24:36.986597+0000","last_change":"2024-09-21T03:24:36.986597+0000","last_active":"2024-09-21T03:24:36.986597+0000","last_peered":"2024-09-21T03:24:36.986597+0000","last_clean":"2024-09-21T03:24:36.986597+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:36.986597+0000","last_undegraded":"2024-09-21T03:24:36.986597+0000","last_fullsized":"2024-09-21T03:24:36.986597+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.001353+0000","last_change":"2024-09-21T03:24:38.001353+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.001353+0000","last_undegraded":"2024-09-21T03:24:38.001353+0000","last_fullsized":"2024-09-21T03:24:38.001353+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.009636+0000","last_change":"2024-09-21T03:24:38.008647+0000","last_active":"2024-09-21T03:24:38.009636+0000","last_peered":"2024-09-21T03:24:38.009636+0000","last_clean":"2024-09-21T03:24:38.009636+0000","last_became_active":"2024-09-21T03:24:38.008243+0000","last_became_peered":"2024-09-21T03:24:38.008243+0000","last_unstale":"2024-09-21T03:24:38.009636+0000","last_undegraded":"2024-09-21T03:24:38.009636+0000","last_fullsized":"2024-09-21T03:24:38.009636+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:07.016728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.005410+0000","last_change":"2024-09-21T03:24:38.005410+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.005410+0000","last_undegraded":"2024-09-21T03:24:38.005410+0000","last_fullsized":"2024-09-21T03:24:38.005410+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:24:36.986597+0000","last_change":"2024-09-21T03:24:36.986597+0000","last_active":"2024-09-21T03:24:36.986597+0000","last_peered":"2024-09-21T03:24:36.986597+0000","last_clean":"2024-09-21T03:24:36.986597+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:36.986597+0000","last_undegraded":"2024-09-21T03:24:36.986597+0000","last_fullsized":"2024-09-21T03:24:36.986597+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:37.997676+0000","last_change":"2024-09-21T03:24:37.997676+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.997676+0000","last_undegraded":"2024-09-21T03:24:37.997676+0000","last_fullsized":"2024-09-21T03:24:37.997676+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.023348+0000","last_change":"2024-09-21T03:24:38.022179+0000","last_active":"2024-09-21T03:24:38.023348+0000","last_peered":"2024-09-21T03:24:38.023348+0000","last_clean":"2024-09-21T03:24:38.023348+0000","last_became_active":"2024-09-21T03:24:38.021893+0000","last_became_peered":"2024-09-21T03:24:38.021893+0000","last_unstale":"2024-09-21T03:24:38.023348+0000","last_undegraded":"2024-09-21T03:24:38.023348+0000","last_fullsized":"2024-09-21T03:24:38.023348+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:12.129049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.004467+0000","last_change":"2024-09-21T03:24:38.004467+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.004467+0000","last_undegraded":"2024-09-21T03:24:38.004467+0000","last_fullsized":"2024-09-21T03:24:38.004467+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.023870+0000","last_change":"2024-09-21T03:24:38.020153+0000","last_active":"2024-09-21T03:24:38.023870+0000","last_peered":"2024-09-21T03:24:38.023870+0000","last_clean":"2024-09-21T03:24:38.023870+0000","last_became_active":"2024-09-21T03:24:38.019792+0000","last_became_peered":"2024-09-21T03:24:38.019792+0000","last_unstale":"2024-09-21T03:24:38.023870+0000","last_undegraded":"2024-09-21T03:24:38.023870+0000","last_fullsized":"2024-09-21T03:24:38.023870+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:25.908182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.001944+0000","last_change":"2024-09-21T03:24:38.001944+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.001944+0000","last_undegraded":"2024-09-21T03:24:38.001944+0000","last_fullsized":"2024-09-21T03:24:38.001944+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.021398+0000","last_change":"2024-09-21T03:24:38.017820+0000","last_active":"2024-09-21T03:24:38.021398+0000","last_peered":"2024-09-21T03:24:38.021398+0000","last_clean":"2024-09-21T03:24:38.021398+0000","last_became_active":"2024-09-21T03:24:38.017280+0000","last_became_peered":"2024-09-21T03:24:38.017280+0000","last_unstale":"2024-09-21T03:24:38.021398+0000","last_undegraded":"2024-09-21T03:24:38.021398+0000","last_fullsized":"2024-09-21T03:24:38.021398+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:31:14.545857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.002984+0000","last_change":"2024-09-21T03:24:38.002984+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.002984+0000","last_undegraded":"2024-09-21T03:24:38.002984+0000","last_fullsized":"2024-09-21T03:24:38.002984+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.014481+0000","last_change":"2024-09-21T03:24:38.009806+0000","last_active":"2024-09-21T03:24:38.014481+0000","last_peered":"2024-09-21T03:24:38.014481+0000","last_clean":"2024-09-21T03:24:38.014481+0000","last_became_active":"2024-09-21T03:24:38.009384+0000","last_became_peered":"2024-09-21T03:24:38.009384+0000","last_unstale":"2024-09-21T03:24:38.014481+0000","last_undegraded":"2024-09-21T03:24:38.014481+0000","last_fullsized":"2024-09-21T03:24:38.014481+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:52:46.248335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":242,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:37.998420+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:24:37.998420+0000","last_peered":"2024-09-21T03:24:37.998420+0000","last_clean":"2024-09-21T03:24:37.998420+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:24:37.998420+0000","last_undegraded":"2024-09-21T03:24:37.998420+0000","last_fullsized":"2024-09-21T03:24:37.998420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":110,"acting":110,"num_store_stats":7},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":44,"acting":44,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509521,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32864,"kb_used_data":1672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338976,"statfs":{"total":96636764160,"available":96603111424,"internally_reserved":0,"allocated":1712128,"data_stored":1060484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509520,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1118208,"data_stored":470116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509519,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1118208,"data_stored":470116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509519,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1105920,"data_stored":463841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509520,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1118208,"data_stored":470116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509520,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1118208,"data_stored":470116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509520,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1118208,"data_stored":470116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32836,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339004,"statfs":{"total":96636764160,"available":96603140096,"internally_reserved":0,"allocated":1687552,"data_stored":1048392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:24:43.382 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:24:43.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.529+0000 7effc9ab6640 1 -- 172.21.15.105:0/1728575495 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effc415b8f0 msgr2=0x7effc40cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:43.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.529+0000 7effc9ab6640 1 --2- 172.21.15.105:0/1728575495 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effc415b8f0 0x7effc40cf130 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7effb4005fd0 tx=0x7effb402a5c0 comp rx=0 tx=0).stop 2024-09-21T03:24:43.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.529+0000 7effc9ab6640 1 -- 172.21.15.105:0/1728575495 shutdown_connections 2024-09-21T03:24:43.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.529+0000 7effc9ab6640 1 --2- 172.21.15.105:0/1728575495 >> v2:172.21.15.162:3300/0 conn(0x7effc40b2cb0 0x7effc40b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:43.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.529+0000 7effc9ab6640 1 --2- 172.21.15.105:0/1728575495 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effc415b8f0 0x7effc40cf130 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:43.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.529+0000 7effc9ab6640 1 -- 172.21.15.105:0/1728575495 >> 172.21.15.105:0/1728575495 conn(0x7effc40cdcb0 msgr2=0x7effc40ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:43.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.529+0000 7effc9ab6640 1 -- 172.21.15.105:0/1728575495 shutdown_connections 2024-09-21T03:24:43.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.529+0000 7effc9ab6640 1 -- 172.21.15.105:0/1728575495 wait complete. 2024-09-21T03:24:43.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.531+0000 7effc9ab6640 1 Processor -- start 2024-09-21T03:24:43.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.531+0000 7effc9ab6640 1 -- start start 2024-09-21T03:24:43.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.532+0000 7effc9ab6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effc40b0520 0x7effc414c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:43.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.532+0000 7effc9ab6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effc40b2cb0 0x7effc40b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:43.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.532+0000 7effc9ab6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effc415b8f0 0x7effc40b2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:43.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.532+0000 7effc9ab6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7effc40ae370 con 0x7effc415b8f0 2024-09-21T03:24:43.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.532+0000 7effc9ab6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7effc40ae1f0 con 0x7effc40b0520 2024-09-21T03:24:43.536 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.532+0000 7effc9ab6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7effc40ae4f0 con 0x7effc40b2cb0 2024-09-21T03:24:43.536 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.532+0000 7effc3fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effc415b8f0 0x7effc40b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:43.536 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.532+0000 7effc3fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effc415b8f0 0x7effc40b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:60516/0 (socket says 172.21.15.105:60516) 2024-09-21T03:24:43.536 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.532+0000 7effc3fff640 1 -- 172.21.15.105:0/2800924517 learned_addr learned my addr 172.21.15.105:0/2800924517 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:43.536 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.532+0000 7effc37fe640 1 --2- 172.21.15.105:0/2800924517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effc40b0520 0x7effc414c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:43.536 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.532+0000 7effc2ffd640 1 --2- 172.21.15.105:0/2800924517 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effc40b2cb0 0x7effc40b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:43.536 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.533+0000 7effc3fff640 1 -- 172.21.15.105:0/2800924517 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effc40b2cb0 msgr2=0x7effc40b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:43.536 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.533+0000 7effc3fff640 1 --2- 172.21.15.105:0/2800924517 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effc40b2cb0 0x7effc40b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:43.536 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.533+0000 7effc3fff640 1 -- 172.21.15.105:0/2800924517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effc40b0520 msgr2=0x7effc414c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:43.536 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.533+0000 7effc3fff640 1 --2- 172.21.15.105:0/2800924517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effc40b0520 0x7effc414c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:43.536 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.533+0000 7effc3fff640 1 -- 172.21.15.105:0/2800924517 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effc409b890 con 0x7effc415b8f0 2024-09-21T03:24:43.536 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.533+0000 7effc3fff640 1 --2- 172.21.15.105:0/2800924517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effc415b8f0 0x7effc40b2030 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7effbc00ebf0 tx=0x7effbc00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:43.536 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.533+0000 7effabfff640 1 -- 172.21.15.105:0/2800924517 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effbc003b70 con 0x7effc415b8f0 2024-09-21T03:24:43.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.533+0000 7effabfff640 1 -- 172.21.15.105:0/2800924517 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7effbc003d10 con 0x7effc415b8f0 2024-09-21T03:24:43.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.533+0000 7effc9ab6640 1 -- 172.21.15.105:0/2800924517 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effc41501f0 con 0x7effc415b8f0 2024-09-21T03:24:43.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.533+0000 7effabfff640 1 -- 172.21.15.105:0/2800924517 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effbc004280 con 0x7effc415b8f0 2024-09-21T03:24:43.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.533+0000 7effc9ab6640 1 -- 172.21.15.105:0/2800924517 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effc41507b0 con 0x7effc415b8f0 2024-09-21T03:24:43.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.534+0000 7effc9ab6640 1 -- 172.21.15.105:0/2800924517 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effc4156870 con 0x7effc415b8f0 2024-09-21T03:24:43.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.535+0000 7effabfff640 1 -- 172.21.15.105:0/2800924517 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7effbc004420 con 0x7effc415b8f0 2024-09-21T03:24:43.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.535+0000 7effabfff640 1 --2- 172.21.15.105:0/2800924517 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7effb0078bc0 0x7effb007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:43.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.535+0000 7effabfff640 1 -- 172.21.15.105:0/2800924517 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7effbc09b7f0 con 0x7effc415b8f0 2024-09-21T03:24:43.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.536+0000 7effc37fe640 1 --2- 172.21.15.105:0/2800924517 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7effb0078bc0 0x7effb007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:43.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.536+0000 7effc37fe640 1 --2- 172.21.15.105:0/2800924517 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7effb0078bc0 0x7effb007b0d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7effb4005fd0 tx=0x7effb4004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:43.541 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.540+0000 7effabfff640 1 -- 172.21.15.105:0/2800924517 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7effc4156870 con 0x7effc415b8f0 2024-09-21T03:24:43.716 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.714+0000 7effc9ab6640 1 -- 172.21.15.105:0/2800924517 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7effc40b30c0 con 0x7effb0078bc0 2024-09-21T03:24:43.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.719+0000 7effabfff640 1 -- 172.21.15.105:0/2800924517 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247544 (secure 0 0 0) 0x7effc40b30c0 con 0x7effb0078bc0 2024-09-21T03:24:43.725 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:24:43.726 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:24:43.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.723+0000 7effc9ab6640 1 -- 172.21.15.105:0/2800924517 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7effb0078bc0 msgr2=0x7effb007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:43.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.723+0000 7effc9ab6640 1 --2- 172.21.15.105:0/2800924517 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7effb0078bc0 0x7effb007b0d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7effb4005fd0 tx=0x7effb4004730 comp rx=0 tx=0).stop 2024-09-21T03:24:43.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.723+0000 7effc9ab6640 1 -- 172.21.15.105:0/2800924517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effc415b8f0 msgr2=0x7effc40b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:43.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.723+0000 7effc9ab6640 1 --2- 172.21.15.105:0/2800924517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effc415b8f0 0x7effc40b2030 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7effbc00ebf0 tx=0x7effbc00c6a0 comp rx=0 tx=0).stop 2024-09-21T03:24:43.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.723+0000 7effc9ab6640 1 -- 172.21.15.105:0/2800924517 shutdown_connections 2024-09-21T03:24:43.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.723+0000 7effc9ab6640 1 --2- 172.21.15.105:0/2800924517 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7effb0078bc0 0x7effb007b0d0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:43.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.723+0000 7effc9ab6640 1 --2- 172.21.15.105:0/2800924517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effc415b8f0 0x7effc40b2030 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:43.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.723+0000 7effc9ab6640 1 --2- 172.21.15.105:0/2800924517 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effc40b2cb0 0x7effc40b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:43.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.723+0000 7effc9ab6640 1 --2- 172.21.15.105:0/2800924517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effc40b0520 0x7effc414c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:43.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.723+0000 7effc9ab6640 1 -- 172.21.15.105:0/2800924517 >> 172.21.15.105:0/2800924517 conn(0x7effc40cdcb0 msgr2=0x7effc406cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:43.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.723+0000 7effc9ab6640 1 -- 172.21.15.105:0/2800924517 shutdown_connections 2024-09-21T03:24:43.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.723+0000 7effc9ab6640 1 -- 172.21.15.105:0/2800924517 wait complete. 2024-09-21T03:24:43.735 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":280,"stamp":"2024-09-21T03:24:43.379607+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":113,"num_write_kb":1629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84,"ondisk_log_size":84,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259436,"kb_used_data":9912,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715284,"statfs":{"total":773094113280,"available":772828450816,"internally_reserved":0,"allocated":10149888,"data_stored":4949046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001489"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.009730+0000","last_change":"2024-09-21T03:24:38.009730+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.009730+0000","last_undegraded":"2024-09-21T03:24:38.009730+0000","last_fullsized":"2024-09-21T03:24:38.009730+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.013059+0000","last_change":"2024-09-21T03:24:39.030988+0000","last_active":"2024-09-21T03:24:40.013059+0000","last_peered":"2024-09-21T03:24:40.013059+0000","last_clean":"2024-09-21T03:24:40.013059+0000","last_became_active":"2024-09-21T03:24:39.030685+0000","last_became_peered":"2024-09-21T03:24:39.030685+0000","last_unstale":"2024-09-21T03:24:40.013059+0000","last_undegraded":"2024-09-21T03:24:40.013059+0000","last_fullsized":"2024-09-21T03:24:40.013059+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:30.830696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.015446+0000","last_change":"2024-09-21T03:24:38.015446+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.015446+0000","last_undegraded":"2024-09-21T03:24:38.015446+0000","last_fullsized":"2024-09-21T03:24:38.015446+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.001334+0000","last_change":"2024-09-21T03:24:38.001334+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.001334+0000","last_undegraded":"2024-09-21T03:24:38.001334+0000","last_fullsized":"2024-09-21T03:24:38.001334+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:37.998731+0000","last_change":"2024-09-21T03:24:37.998731+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.998731+0000","last_undegraded":"2024-09-21T03:24:37.998731+0000","last_fullsized":"2024-09-21T03:24:37.998731+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.004276+0000","last_change":"2024-09-21T03:24:38.004276+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.004276+0000","last_undegraded":"2024-09-21T03:24:38.004276+0000","last_fullsized":"2024-09-21T03:24:38.004276+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.004347+0000","last_change":"2024-09-21T03:24:38.004347+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.004347+0000","last_undegraded":"2024-09-21T03:24:38.004347+0000","last_fullsized":"2024-09-21T03:24:38.004347+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.012650+0000","last_change":"2024-09-21T03:24:39.023580+0000","last_active":"2024-09-21T03:24:40.012650+0000","last_peered":"2024-09-21T03:24:40.012650+0000","last_clean":"2024-09-21T03:24:40.012650+0000","last_became_active":"2024-09-21T03:24:39.023204+0000","last_became_peered":"2024-09-21T03:24:39.023204+0000","last_unstale":"2024-09-21T03:24:40.012650+0000","last_undegraded":"2024-09-21T03:24:40.012650+0000","last_fullsized":"2024-09-21T03:24:40.012650+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:24.160293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:37.999417+0000","last_change":"2024-09-21T03:24:37.999417+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.999417+0000","last_undegraded":"2024-09-21T03:24:37.999417+0000","last_fullsized":"2024-09-21T03:24:37.999417+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003577+0000","last_change":"2024-09-21T03:24:38.003577+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003577+0000","last_undegraded":"2024-09-21T03:24:38.003577+0000","last_fullsized":"2024-09-21T03:24:38.003577+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.004174+0000","last_change":"2024-09-21T03:24:38.004174+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.004174+0000","last_undegraded":"2024-09-21T03:24:38.004174+0000","last_fullsized":"2024-09-21T03:24:38.004174+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:37.999876+0000","last_change":"2024-09-21T03:24:37.999876+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.999876+0000","last_undegraded":"2024-09-21T03:24:37.999876+0000","last_fullsized":"2024-09-21T03:24:37.999876+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.001000+0000","last_change":"2024-09-21T03:24:38.001000+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.001000+0000","last_undegraded":"2024-09-21T03:24:38.001000+0000","last_fullsized":"2024-09-21T03:24:38.001000+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.007202+0000","last_change":"2024-09-21T03:24:38.007202+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.007202+0000","last_undegraded":"2024-09-21T03:24:38.007202+0000","last_fullsized":"2024-09-21T03:24:38.007202+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.004206+0000","last_change":"2024-09-21T03:24:38.004206+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.004206+0000","last_undegraded":"2024-09-21T03:24:38.004206+0000","last_fullsized":"2024-09-21T03:24:38.004206+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003903+0000","last_change":"2024-09-21T03:24:38.003903+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003903+0000","last_undegraded":"2024-09-21T03:24:38.003903+0000","last_fullsized":"2024-09-21T03:24:38.003903+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.013399+0000","last_change":"2024-09-21T03:24:39.032389+0000","last_active":"2024-09-21T03:24:40.013399+0000","last_peered":"2024-09-21T03:24:40.013399+0000","last_clean":"2024-09-21T03:24:40.013399+0000","last_became_active":"2024-09-21T03:24:39.032088+0000","last_became_peered":"2024-09-21T03:24:39.032088+0000","last_unstale":"2024-09-21T03:24:40.013399+0000","last_undegraded":"2024-09-21T03:24:40.013399+0000","last_fullsized":"2024-09-21T03:24:40.013399+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:20.478211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003207+0000","last_change":"2024-09-21T03:24:38.003207+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003207+0000","last_undegraded":"2024-09-21T03:24:38.003207+0000","last_fullsized":"2024-09-21T03:24:38.003207+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003192+0000","last_change":"2024-09-21T03:24:38.003192+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003192+0000","last_undegraded":"2024-09-21T03:24:38.003192+0000","last_fullsized":"2024-09-21T03:24:38.003192+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:37.999307+0000","last_change":"2024-09-21T03:24:37.999307+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.999307+0000","last_undegraded":"2024-09-21T03:24:37.999307+0000","last_fullsized":"2024-09-21T03:24:37.999307+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003713+0000","last_change":"2024-09-21T03:24:38.003713+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003713+0000","last_undegraded":"2024-09-21T03:24:38.003713+0000","last_fullsized":"2024-09-21T03:24:38.003713+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.012693+0000","last_change":"2024-09-21T03:24:39.029686+0000","last_active":"2024-09-21T03:24:40.012693+0000","last_peered":"2024-09-21T03:24:40.012693+0000","last_clean":"2024-09-21T03:24:40.012693+0000","last_became_active":"2024-09-21T03:24:39.025264+0000","last_became_peered":"2024-09-21T03:24:39.025264+0000","last_unstale":"2024-09-21T03:24:40.012693+0000","last_undegraded":"2024-09-21T03:24:40.012693+0000","last_fullsized":"2024-09-21T03:24:40.012693+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:31:34.867080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.012776+0000","last_change":"2024-09-21T03:24:39.020402+0000","last_active":"2024-09-21T03:24:40.012776+0000","last_peered":"2024-09-21T03:24:40.012776+0000","last_clean":"2024-09-21T03:24:40.012776+0000","last_became_active":"2024-09-21T03:24:39.020093+0000","last_became_peered":"2024-09-21T03:24:39.020093+0000","last_unstale":"2024-09-21T03:24:40.012776+0000","last_undegraded":"2024-09-21T03:24:40.012776+0000","last_fullsized":"2024-09-21T03:24:40.012776+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:07:49.387867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.002993+0000","last_change":"2024-09-21T03:24:38.002993+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.002993+0000","last_undegraded":"2024-09-21T03:24:38.002993+0000","last_fullsized":"2024-09-21T03:24:38.002993+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.005336+0000","last_change":"2024-09-21T03:24:38.005336+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.005336+0000","last_undegraded":"2024-09-21T03:24:38.005336+0000","last_fullsized":"2024-09-21T03:24:38.005336+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.013270+0000","last_change":"2024-09-21T03:24:39.028282+0000","last_active":"2024-09-21T03:24:40.013270+0000","last_peered":"2024-09-21T03:24:40.013270+0000","last_clean":"2024-09-21T03:24:40.013270+0000","last_became_active":"2024-09-21T03:24:39.027993+0000","last_became_peered":"2024-09-21T03:24:39.027993+0000","last_unstale":"2024-09-21T03:24:40.013270+0000","last_undegraded":"2024-09-21T03:24:40.013270+0000","last_fullsized":"2024-09-21T03:24:40.013270+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:07.763847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.002986+0000","last_change":"2024-09-21T03:24:38.002986+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.002986+0000","last_undegraded":"2024-09-21T03:24:38.002986+0000","last_fullsized":"2024-09-21T03:24:38.002986+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.006293+0000","last_change":"2024-09-21T03:24:38.006293+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.006293+0000","last_undegraded":"2024-09-21T03:24:38.006293+0000","last_fullsized":"2024-09-21T03:24:38.006293+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.013154+0000","last_change":"2024-09-21T03:24:39.024343+0000","last_active":"2024-09-21T03:24:40.013154+0000","last_peered":"2024-09-21T03:24:40.013154+0000","last_clean":"2024-09-21T03:24:40.013154+0000","last_became_active":"2024-09-21T03:24:39.024033+0000","last_became_peered":"2024-09-21T03:24:39.024033+0000","last_unstale":"2024-09-21T03:24:40.013154+0000","last_undegraded":"2024-09-21T03:24:40.013154+0000","last_fullsized":"2024-09-21T03:24:40.013154+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:54.404219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.006709+0000","last_change":"2024-09-21T03:24:38.006709+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.006709+0000","last_undegraded":"2024-09-21T03:24:38.006709+0000","last_fullsized":"2024-09-21T03:24:38.006709+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003705+0000","last_change":"2024-09-21T03:24:38.003705+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003705+0000","last_undegraded":"2024-09-21T03:24:38.003705+0000","last_fullsized":"2024-09-21T03:24:38.003705+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.010814+0000","last_change":"2024-09-21T03:24:38.010814+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.010814+0000","last_undegraded":"2024-09-21T03:24:38.010814+0000","last_fullsized":"2024-09-21T03:24:38.010814+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003562+0000","last_change":"2024-09-21T03:24:38.003562+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003562+0000","last_undegraded":"2024-09-21T03:24:38.003562+0000","last_fullsized":"2024-09-21T03:24:38.003562+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"92'4","reported_seq":19,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.013528+0000","last_change":"2024-09-21T03:24:38.015939+0000","last_active":"2024-09-21T03:24:40.013528+0000","last_peered":"2024-09-21T03:24:40.013528+0000","last_clean":"2024-09-21T03:24:40.013528+0000","last_became_active":"2024-09-21T03:24:38.015624+0000","last_became_peered":"2024-09-21T03:24:38.015624+0000","last_unstale":"2024-09-21T03:24:40.013528+0000","last_undegraded":"2024-09-21T03:24:40.013528+0000","last_fullsized":"2024-09-21T03:24:40.013528+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:36:17.535190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.002494+0000","last_change":"2024-09-21T03:24:38.002494+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.002494+0000","last_undegraded":"2024-09-21T03:24:38.002494+0000","last_fullsized":"2024-09-21T03:24:38.002494+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.020618+0000","last_change":"2024-09-21T03:24:38.019879+0000","last_active":"2024-09-21T03:24:38.020618+0000","last_peered":"2024-09-21T03:24:38.020618+0000","last_clean":"2024-09-21T03:24:38.020618+0000","last_became_active":"2024-09-21T03:24:38.019498+0000","last_became_peered":"2024-09-21T03:24:38.019498+0000","last_unstale":"2024-09-21T03:24:38.020618+0000","last_undegraded":"2024-09-21T03:24:38.020618+0000","last_fullsized":"2024-09-21T03:24:38.020618+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:05.347691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.012629+0000","last_change":"2024-09-21T03:24:38.012629+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.012629+0000","last_undegraded":"2024-09-21T03:24:38.012629+0000","last_fullsized":"2024-09-21T03:24:38.012629+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"92'2","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.013041+0000","last_change":"2024-09-21T03:24:38.014576+0000","last_active":"2024-09-21T03:24:40.013041+0000","last_peered":"2024-09-21T03:24:40.013041+0000","last_clean":"2024-09-21T03:24:40.013041+0000","last_became_active":"2024-09-21T03:24:38.014251+0000","last_became_peered":"2024-09-21T03:24:38.014251+0000","last_unstale":"2024-09-21T03:24:40.013041+0000","last_undegraded":"2024-09-21T03:24:40.013041+0000","last_fullsized":"2024-09-21T03:24:40.013041+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:14.129111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:37.998740+0000","last_change":"2024-09-21T03:24:37.998740+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.998740+0000","last_undegraded":"2024-09-21T03:24:37.998740+0000","last_fullsized":"2024-09-21T03:24:37.998740+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"92'2","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.012903+0000","last_change":"2024-09-21T03:24:38.014977+0000","last_active":"2024-09-21T03:24:40.012903+0000","last_peered":"2024-09-21T03:24:40.012903+0000","last_clean":"2024-09-21T03:24:40.012903+0000","last_became_active":"2024-09-21T03:24:38.014673+0000","last_became_peered":"2024-09-21T03:24:38.014673+0000","last_unstale":"2024-09-21T03:24:40.012903+0000","last_undegraded":"2024-09-21T03:24:40.012903+0000","last_fullsized":"2024-09-21T03:24:40.012903+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:16:19.513335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.002418+0000","last_change":"2024-09-21T03:24:38.002418+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.002418+0000","last_undegraded":"2024-09-21T03:24:38.002418+0000","last_fullsized":"2024-09-21T03:24:38.002418+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.024352+0000","last_change":"2024-09-21T03:24:38.020873+0000","last_active":"2024-09-21T03:24:38.024352+0000","last_peered":"2024-09-21T03:24:38.024352+0000","last_clean":"2024-09-21T03:24:38.024352+0000","last_became_active":"2024-09-21T03:24:38.020586+0000","last_became_peered":"2024-09-21T03:24:38.020586+0000","last_unstale":"2024-09-21T03:24:38.024352+0000","last_undegraded":"2024-09-21T03:24:38.024352+0000","last_fullsized":"2024-09-21T03:24:38.024352+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:38.297464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.002377+0000","last_change":"2024-09-21T03:24:38.002377+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.002377+0000","last_undegraded":"2024-09-21T03:24:38.002377+0000","last_fullsized":"2024-09-21T03:24:38.002377+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"92'1","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.012733+0000","last_change":"2024-09-21T03:24:38.020632+0000","last_active":"2024-09-21T03:24:40.012733+0000","last_peered":"2024-09-21T03:24:40.012733+0000","last_clean":"2024-09-21T03:24:40.012733+0000","last_became_active":"2024-09-21T03:24:38.020311+0000","last_became_peered":"2024-09-21T03:24:38.020311+0000","last_unstale":"2024-09-21T03:24:40.012733+0000","last_undegraded":"2024-09-21T03:24:40.012733+0000","last_fullsized":"2024-09-21T03:24:40.012733+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:43.226556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.000926+0000","last_change":"2024-09-21T03:24:38.000926+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.000926+0000","last_undegraded":"2024-09-21T03:24:38.000926+0000","last_fullsized":"2024-09-21T03:24:38.000926+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.017601+0000","last_change":"2024-09-21T03:24:38.015466+0000","last_active":"2024-09-21T03:24:38.017601+0000","last_peered":"2024-09-21T03:24:38.017601+0000","last_clean":"2024-09-21T03:24:38.017601+0000","last_became_active":"2024-09-21T03:24:38.015170+0000","last_became_peered":"2024-09-21T03:24:38.015170+0000","last_unstale":"2024-09-21T03:24:38.017601+0000","last_undegraded":"2024-09-21T03:24:38.017601+0000","last_fullsized":"2024-09-21T03:24:38.017601+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:45:46.694000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:37.999985+0000","last_change":"2024-09-21T03:24:37.999985+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.999985+0000","last_undegraded":"2024-09-21T03:24:37.999985+0000","last_fullsized":"2024-09-21T03:24:37.999985+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.029707+0000","last_change":"2024-09-21T03:24:38.024676+0000","last_active":"2024-09-21T03:24:38.029707+0000","last_peered":"2024-09-21T03:24:38.029707+0000","last_clean":"2024-09-21T03:24:38.029707+0000","last_became_active":"2024-09-21T03:24:38.024305+0000","last_became_peered":"2024-09-21T03:24:38.024305+0000","last_unstale":"2024-09-21T03:24:38.029707+0000","last_undegraded":"2024-09-21T03:24:38.029707+0000","last_fullsized":"2024-09-21T03:24:38.029707+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:01.136782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.013296+0000","last_change":"2024-09-21T03:24:39.024776+0000","last_active":"2024-09-21T03:24:40.013296+0000","last_peered":"2024-09-21T03:24:40.013296+0000","last_clean":"2024-09-21T03:24:40.013296+0000","last_became_active":"2024-09-21T03:24:39.024478+0000","last_became_peered":"2024-09-21T03:24:39.024478+0000","last_unstale":"2024-09-21T03:24:40.013296+0000","last_undegraded":"2024-09-21T03:24:40.013296+0000","last_fullsized":"2024-09-21T03:24:40.013296+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:55.518801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.023790+0000","last_change":"2024-09-21T03:24:38.019784+0000","last_active":"2024-09-21T03:24:38.023790+0000","last_peered":"2024-09-21T03:24:38.023790+0000","last_clean":"2024-09-21T03:24:38.023790+0000","last_became_active":"2024-09-21T03:24:38.019456+0000","last_became_peered":"2024-09-21T03:24:38.019456+0000","last_unstale":"2024-09-21T03:24:38.023790+0000","last_undegraded":"2024-09-21T03:24:38.023790+0000","last_fullsized":"2024-09-21T03:24:38.023790+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:28.389174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:37.997537+0000","last_change":"2024-09-21T03:24:37.997537+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.997537+0000","last_undegraded":"2024-09-21T03:24:37.997537+0000","last_fullsized":"2024-09-21T03:24:37.997537+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.012124+0000","last_change":"2024-09-21T03:24:38.011409+0000","last_active":"2024-09-21T03:24:38.012124+0000","last_peered":"2024-09-21T03:24:38.012124+0000","last_clean":"2024-09-21T03:24:38.012124+0000","last_became_active":"2024-09-21T03:24:38.011093+0000","last_became_peered":"2024-09-21T03:24:38.011093+0000","last_unstale":"2024-09-21T03:24:38.012124+0000","last_undegraded":"2024-09-21T03:24:38.012124+0000","last_fullsized":"2024-09-21T03:24:38.012124+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:27:39.891218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003759+0000","last_change":"2024-09-21T03:24:38.003759+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003759+0000","last_undegraded":"2024-09-21T03:24:38.003759+0000","last_fullsized":"2024-09-21T03:24:38.003759+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.014568+0000","last_change":"2024-09-21T03:24:38.010947+0000","last_active":"2024-09-21T03:24:38.014568+0000","last_peered":"2024-09-21T03:24:38.014568+0000","last_clean":"2024-09-21T03:24:38.014568+0000","last_became_active":"2024-09-21T03:24:38.010622+0000","last_became_peered":"2024-09-21T03:24:38.010622+0000","last_unstale":"2024-09-21T03:24:38.014568+0000","last_undegraded":"2024-09-21T03:24:38.014568+0000","last_fullsized":"2024-09-21T03:24:38.014568+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:39.345967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.001774+0000","last_change":"2024-09-21T03:24:38.001774+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.001774+0000","last_undegraded":"2024-09-21T03:24:38.001774+0000","last_fullsized":"2024-09-21T03:24:38.001774+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.014753+0000","last_change":"2024-09-21T03:24:38.011098+0000","last_active":"2024-09-21T03:24:38.014753+0000","last_peered":"2024-09-21T03:24:38.014753+0000","last_clean":"2024-09-21T03:24:38.014753+0000","last_became_active":"2024-09-21T03:24:38.010775+0000","last_became_peered":"2024-09-21T03:24:38.010775+0000","last_unstale":"2024-09-21T03:24:38.014753+0000","last_undegraded":"2024-09-21T03:24:38.014753+0000","last_fullsized":"2024-09-21T03:24:38.014753+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:07.330132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.001499+0000","last_change":"2024-09-21T03:24:38.001499+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.001499+0000","last_undegraded":"2024-09-21T03:24:38.001499+0000","last_fullsized":"2024-09-21T03:24:38.001499+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.013734+0000","last_change":"2024-09-21T03:24:38.012254+0000","last_active":"2024-09-21T03:24:38.013734+0000","last_peered":"2024-09-21T03:24:38.013734+0000","last_clean":"2024-09-21T03:24:38.013734+0000","last_became_active":"2024-09-21T03:24:38.011372+0000","last_became_peered":"2024-09-21T03:24:38.011372+0000","last_unstale":"2024-09-21T03:24:38.013734+0000","last_undegraded":"2024-09-21T03:24:38.013734+0000","last_fullsized":"2024-09-21T03:24:38.013734+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:09:27.979140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.013455+0000","last_change":"2024-09-21T03:24:38.013455+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.013455+0000","last_undegraded":"2024-09-21T03:24:38.013455+0000","last_fullsized":"2024-09-21T03:24:38.013455+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.025174+0000","last_change":"2024-09-21T03:24:38.024584+0000","last_active":"2024-09-21T03:24:38.025174+0000","last_peered":"2024-09-21T03:24:38.025174+0000","last_clean":"2024-09-21T03:24:38.025174+0000","last_became_active":"2024-09-21T03:24:38.024237+0000","last_became_peered":"2024-09-21T03:24:38.024237+0000","last_unstale":"2024-09-21T03:24:38.025174+0000","last_undegraded":"2024-09-21T03:24:38.025174+0000","last_fullsized":"2024-09-21T03:24:38.025174+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:11:04.742300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:37.997604+0000","last_change":"2024-09-21T03:24:37.997604+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.997604+0000","last_undegraded":"2024-09-21T03:24:37.997604+0000","last_fullsized":"2024-09-21T03:24:37.997604+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.012184+0000","last_change":"2024-09-21T03:24:38.006652+0000","last_active":"2024-09-21T03:24:38.012184+0000","last_peered":"2024-09-21T03:24:38.012184+0000","last_clean":"2024-09-21T03:24:38.012184+0000","last_became_active":"2024-09-21T03:24:38.006287+0000","last_became_peered":"2024-09-21T03:24:38.006287+0000","last_unstale":"2024-09-21T03:24:38.012184+0000","last_undegraded":"2024-09-21T03:24:38.012184+0000","last_fullsized":"2024-09-21T03:24:38.012184+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:05.098529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003029+0000","last_change":"2024-09-21T03:24:38.003029+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003029+0000","last_undegraded":"2024-09-21T03:24:38.003029+0000","last_fullsized":"2024-09-21T03:24:38.003029+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.023856+0000","last_change":"2024-09-21T03:24:38.020494+0000","last_active":"2024-09-21T03:24:38.023856+0000","last_peered":"2024-09-21T03:24:38.023856+0000","last_clean":"2024-09-21T03:24:38.023856+0000","last_became_active":"2024-09-21T03:24:38.019461+0000","last_became_peered":"2024-09-21T03:24:38.019461+0000","last_unstale":"2024-09-21T03:24:38.023856+0000","last_undegraded":"2024-09-21T03:24:38.023856+0000","last_fullsized":"2024-09-21T03:24:38.023856+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:02.623575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.004869+0000","last_change":"2024-09-21T03:24:38.004869+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.004869+0000","last_undegraded":"2024-09-21T03:24:38.004869+0000","last_fullsized":"2024-09-21T03:24:38.004869+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.014683+0000","last_change":"2024-09-21T03:24:38.009947+0000","last_active":"2024-09-21T03:24:38.014683+0000","last_peered":"2024-09-21T03:24:38.014683+0000","last_clean":"2024-09-21T03:24:38.014683+0000","last_became_active":"2024-09-21T03:24:38.009587+0000","last_became_peered":"2024-09-21T03:24:38.009587+0000","last_unstale":"2024-09-21T03:24:38.014683+0000","last_undegraded":"2024-09-21T03:24:38.014683+0000","last_fullsized":"2024-09-21T03:24:38.014683+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:52.734164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003114+0000","last_change":"2024-09-21T03:24:38.003114+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003114+0000","last_undegraded":"2024-09-21T03:24:38.003114+0000","last_fullsized":"2024-09-21T03:24:38.003114+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.014314+0000","last_change":"2024-09-21T03:24:38.010166+0000","last_active":"2024-09-21T03:24:38.014314+0000","last_peered":"2024-09-21T03:24:38.014314+0000","last_clean":"2024-09-21T03:24:38.014314+0000","last_became_active":"2024-09-21T03:24:38.009774+0000","last_became_peered":"2024-09-21T03:24:38.009774+0000","last_unstale":"2024-09-21T03:24:38.014314+0000","last_undegraded":"2024-09-21T03:24:38.014314+0000","last_fullsized":"2024-09-21T03:24:38.014314+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:05:48.407790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.000756+0000","last_change":"2024-09-21T03:24:38.000756+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.000756+0000","last_undegraded":"2024-09-21T03:24:38.000756+0000","last_fullsized":"2024-09-21T03:24:38.000756+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.013025+0000","last_change":"2024-09-21T03:24:38.013762+0000","last_active":"2024-09-21T03:24:40.013025+0000","last_peered":"2024-09-21T03:24:40.013025+0000","last_clean":"2024-09-21T03:24:40.013025+0000","last_became_active":"2024-09-21T03:24:38.013455+0000","last_became_peered":"2024-09-21T03:24:38.013455+0000","last_unstale":"2024-09-21T03:24:40.013025+0000","last_undegraded":"2024-09-21T03:24:40.013025+0000","last_fullsized":"2024-09-21T03:24:40.013025+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:26.681911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.006035+0000","last_change":"2024-09-21T03:24:38.006035+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.006035+0000","last_undegraded":"2024-09-21T03:24:38.006035+0000","last_fullsized":"2024-09-21T03:24:38.006035+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"92'2","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.013020+0000","last_change":"2024-09-21T03:24:38.014934+0000","last_active":"2024-09-21T03:24:40.013020+0000","last_peered":"2024-09-21T03:24:40.013020+0000","last_clean":"2024-09-21T03:24:40.013020+0000","last_became_active":"2024-09-21T03:24:38.014613+0000","last_became_peered":"2024-09-21T03:24:38.014613+0000","last_unstale":"2024-09-21T03:24:40.013020+0000","last_undegraded":"2024-09-21T03:24:40.013020+0000","last_fullsized":"2024-09-21T03:24:40.013020+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:27.000670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003049+0000","last_change":"2024-09-21T03:24:38.003049+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003049+0000","last_undegraded":"2024-09-21T03:24:38.003049+0000","last_fullsized":"2024-09-21T03:24:38.003049+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.023296+0000","last_change":"2024-09-21T03:24:38.020820+0000","last_active":"2024-09-21T03:24:38.023296+0000","last_peered":"2024-09-21T03:24:38.023296+0000","last_clean":"2024-09-21T03:24:38.023296+0000","last_became_active":"2024-09-21T03:24:38.020470+0000","last_became_peered":"2024-09-21T03:24:38.020470+0000","last_unstale":"2024-09-21T03:24:38.023296+0000","last_undegraded":"2024-09-21T03:24:38.023296+0000","last_fullsized":"2024-09-21T03:24:38.023296+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:07.330132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.004963+0000","last_change":"2024-09-21T03:24:38.004963+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.004963+0000","last_undegraded":"2024-09-21T03:24:38.004963+0000","last_fullsized":"2024-09-21T03:24:38.004963+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.017363+0000","last_change":"2024-09-21T03:24:38.012506+0000","last_active":"2024-09-21T03:24:38.017363+0000","last_peered":"2024-09-21T03:24:38.017363+0000","last_clean":"2024-09-21T03:24:38.017363+0000","last_became_active":"2024-09-21T03:24:38.012187+0000","last_became_peered":"2024-09-21T03:24:38.012187+0000","last_unstale":"2024-09-21T03:24:38.017363+0000","last_undegraded":"2024-09-21T03:24:38.017363+0000","last_fullsized":"2024-09-21T03:24:38.017363+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:52.734164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.002421+0000","last_change":"2024-09-21T03:24:38.002421+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.002421+0000","last_undegraded":"2024-09-21T03:24:38.002421+0000","last_fullsized":"2024-09-21T03:24:38.002421+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.012694+0000","last_change":"2024-09-21T03:24:38.022079+0000","last_active":"2024-09-21T03:24:40.012694+0000","last_peered":"2024-09-21T03:24:40.012694+0000","last_clean":"2024-09-21T03:24:40.012694+0000","last_became_active":"2024-09-21T03:24:38.021757+0000","last_became_peered":"2024-09-21T03:24:38.021757+0000","last_unstale":"2024-09-21T03:24:40.012694+0000","last_undegraded":"2024-09-21T03:24:40.012694+0000","last_fullsized":"2024-09-21T03:24:40.012694+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:41:36.864607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.013484+0000","last_change":"2024-09-21T03:24:39.029954+0000","last_active":"2024-09-21T03:24:40.013484+0000","last_peered":"2024-09-21T03:24:40.013484+0000","last_clean":"2024-09-21T03:24:40.013484+0000","last_became_active":"2024-09-21T03:24:39.029648+0000","last_became_peered":"2024-09-21T03:24:39.029648+0000","last_unstale":"2024-09-21T03:24:40.013484+0000","last_undegraded":"2024-09-21T03:24:40.013484+0000","last_fullsized":"2024-09-21T03:24:40.013484+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:55.774659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.014607+0000","last_change":"2024-09-21T03:24:38.010449+0000","last_active":"2024-09-21T03:24:38.014607+0000","last_peered":"2024-09-21T03:24:38.014607+0000","last_clean":"2024-09-21T03:24:38.014607+0000","last_became_active":"2024-09-21T03:24:38.010079+0000","last_became_peered":"2024-09-21T03:24:38.010079+0000","last_unstale":"2024-09-21T03:24:38.014607+0000","last_undegraded":"2024-09-21T03:24:38.014607+0000","last_fullsized":"2024-09-21T03:24:38.014607+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:05.098529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.008511+0000","last_change":"2024-09-21T03:24:38.008511+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.008511+0000","last_undegraded":"2024-09-21T03:24:38.008511+0000","last_fullsized":"2024-09-21T03:24:38.008511+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"92'1","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.013378+0000","last_change":"2024-09-21T03:24:38.015200+0000","last_active":"2024-09-21T03:24:40.013378+0000","last_peered":"2024-09-21T03:24:40.013378+0000","last_clean":"2024-09-21T03:24:40.013378+0000","last_became_active":"2024-09-21T03:24:38.014843+0000","last_became_peered":"2024-09-21T03:24:38.014843+0000","last_unstale":"2024-09-21T03:24:40.013378+0000","last_undegraded":"2024-09-21T03:24:40.013378+0000","last_fullsized":"2024-09-21T03:24:40.013378+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:29.367833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.009699+0000","last_change":"2024-09-21T03:24:38.009699+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.009699+0000","last_undegraded":"2024-09-21T03:24:38.009699+0000","last_fullsized":"2024-09-21T03:24:38.009699+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.013139+0000","last_change":"2024-09-21T03:24:38.010800+0000","last_active":"2024-09-21T03:24:40.013139+0000","last_peered":"2024-09-21T03:24:40.013139+0000","last_clean":"2024-09-21T03:24:40.013139+0000","last_became_active":"2024-09-21T03:24:38.010478+0000","last_became_peered":"2024-09-21T03:24:38.010478+0000","last_unstale":"2024-09-21T03:24:40.013139+0000","last_undegraded":"2024-09-21T03:24:40.013139+0000","last_fullsized":"2024-09-21T03:24:40.013139+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:12.070978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.001353+0000","last_change":"2024-09-21T03:24:38.001353+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.001353+0000","last_undegraded":"2024-09-21T03:24:38.001353+0000","last_fullsized":"2024-09-21T03:24:38.001353+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.009636+0000","last_change":"2024-09-21T03:24:38.008647+0000","last_active":"2024-09-21T03:24:38.009636+0000","last_peered":"2024-09-21T03:24:38.009636+0000","last_clean":"2024-09-21T03:24:38.009636+0000","last_became_active":"2024-09-21T03:24:38.008243+0000","last_became_peered":"2024-09-21T03:24:38.008243+0000","last_unstale":"2024-09-21T03:24:38.009636+0000","last_undegraded":"2024-09-21T03:24:38.009636+0000","last_fullsized":"2024-09-21T03:24:38.009636+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:07.016728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.005410+0000","last_change":"2024-09-21T03:24:38.005410+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.005410+0000","last_undegraded":"2024-09-21T03:24:38.005410+0000","last_fullsized":"2024-09-21T03:24:38.005410+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.013125+0000","last_change":"2024-09-21T03:24:38.012316+0000","last_active":"2024-09-21T03:24:40.013125+0000","last_peered":"2024-09-21T03:24:40.013125+0000","last_clean":"2024-09-21T03:24:40.013125+0000","last_became_active":"2024-09-21T03:24:38.012027+0000","last_became_peered":"2024-09-21T03:24:38.012027+0000","last_unstale":"2024-09-21T03:24:40.013125+0000","last_undegraded":"2024-09-21T03:24:40.013125+0000","last_fullsized":"2024-09-21T03:24:40.013125+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:17.738117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:37.997676+0000","last_change":"2024-09-21T03:24:37.997676+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.997676+0000","last_undegraded":"2024-09-21T03:24:37.997676+0000","last_fullsized":"2024-09-21T03:24:37.997676+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.023348+0000","last_change":"2024-09-21T03:24:38.022179+0000","last_active":"2024-09-21T03:24:38.023348+0000","last_peered":"2024-09-21T03:24:38.023348+0000","last_clean":"2024-09-21T03:24:38.023348+0000","last_became_active":"2024-09-21T03:24:38.021893+0000","last_became_peered":"2024-09-21T03:24:38.021893+0000","last_unstale":"2024-09-21T03:24:38.023348+0000","last_undegraded":"2024-09-21T03:24:38.023348+0000","last_fullsized":"2024-09-21T03:24:38.023348+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:12.129049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.004467+0000","last_change":"2024-09-21T03:24:38.004467+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.004467+0000","last_undegraded":"2024-09-21T03:24:38.004467+0000","last_fullsized":"2024-09-21T03:24:38.004467+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.023870+0000","last_change":"2024-09-21T03:24:38.020153+0000","last_active":"2024-09-21T03:24:38.023870+0000","last_peered":"2024-09-21T03:24:38.023870+0000","last_clean":"2024-09-21T03:24:38.023870+0000","last_became_active":"2024-09-21T03:24:38.019792+0000","last_became_peered":"2024-09-21T03:24:38.019792+0000","last_unstale":"2024-09-21T03:24:38.023870+0000","last_undegraded":"2024-09-21T03:24:38.023870+0000","last_fullsized":"2024-09-21T03:24:38.023870+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:25.908182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.001944+0000","last_change":"2024-09-21T03:24:38.001944+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.001944+0000","last_undegraded":"2024-09-21T03:24:38.001944+0000","last_fullsized":"2024-09-21T03:24:38.001944+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.021398+0000","last_change":"2024-09-21T03:24:38.017820+0000","last_active":"2024-09-21T03:24:38.021398+0000","last_peered":"2024-09-21T03:24:38.021398+0000","last_clean":"2024-09-21T03:24:38.021398+0000","last_became_active":"2024-09-21T03:24:38.017280+0000","last_became_peered":"2024-09-21T03:24:38.017280+0000","last_unstale":"2024-09-21T03:24:38.021398+0000","last_undegraded":"2024-09-21T03:24:38.021398+0000","last_fullsized":"2024-09-21T03:24:38.021398+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:31:14.545857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.002984+0000","last_change":"2024-09-21T03:24:38.002984+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.002984+0000","last_undegraded":"2024-09-21T03:24:38.002984+0000","last_fullsized":"2024-09-21T03:24:38.002984+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.014481+0000","last_change":"2024-09-21T03:24:38.009806+0000","last_active":"2024-09-21T03:24:38.014481+0000","last_peered":"2024-09-21T03:24:38.014481+0000","last_clean":"2024-09-21T03:24:38.014481+0000","last_became_active":"2024-09-21T03:24:38.009384+0000","last_became_peered":"2024-09-21T03:24:38.009384+0000","last_unstale":"2024-09-21T03:24:38.014481+0000","last_undegraded":"2024-09-21T03:24:38.014481+0000","last_fullsized":"2024-09-21T03:24:38.014481+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:52:46.248335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":242,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:37.998420+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:24:37.998420+0000","last_peered":"2024-09-21T03:24:37.998420+0000","last_clean":"2024-09-21T03:24:37.998420+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:24:37.998420+0000","last_undegraded":"2024-09-21T03:24:37.998420+0000","last_fullsized":"2024-09-21T03:24:37.998420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509521,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32864,"kb_used_data":1672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338976,"statfs":{"total":96636764160,"available":96603111424,"internally_reserved":0,"allocated":1712128,"data_stored":1060484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509520,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1118208,"data_stored":470116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509519,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1118208,"data_stored":470116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509519,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1105920,"data_stored":463841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509520,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1118208,"data_stored":470116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509520,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1118208,"data_stored":470116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509520,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1118208,"data_stored":470116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32892,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338948,"statfs":{"total":96636764160,"available":96603082752,"internally_reserved":0,"allocated":1740800,"data_stored":1074141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:24:43.739 INFO:tasks.ceph.ceph_manager.ceph:PG 15.3f is not active+clean 2024-09-21T03:24:43.739 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.009730+0000', 'last_change': '2024-09-21T03:24:38.009730+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.009730+0000', 'last_undegraded': '2024-09-21T03:24:38.009730+0000', 'last_fullsized': '2024-09-21T03:24:38.009730+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T03:24:43.739 INFO:tasks.ceph.ceph_manager.ceph:PG 15.3d is not active+clean 2024-09-21T03:24:43.739 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.015446+0000', 'last_change': '2024-09-21T03:24:38.015446+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.015446+0000', 'last_undegraded': '2024-09-21T03:24:38.015446+0000', 'last_fullsized': '2024-09-21T03:24:38.015446+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T03:24:43.739 INFO:tasks.ceph.ceph_manager.ceph:PG 15.3c is not active+clean 2024-09-21T03:24:43.739 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.001334+0000', 'last_change': '2024-09-21T03:24:38.001334+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.001334+0000', 'last_undegraded': '2024-09-21T03:24:38.001334+0000', 'last_fullsized': '2024-09-21T03:24:38.001334+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T03:24:43.739 INFO:tasks.ceph.ceph_manager.ceph:PG 15.3b is not active+clean 2024-09-21T03:24:43.739 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:37.998731+0000', 'last_change': '2024-09-21T03:24:37.998731+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:37.998731+0000', 'last_undegraded': '2024-09-21T03:24:37.998731+0000', 'last_fullsized': '2024-09-21T03:24:37.998731+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T03:24:43.739 INFO:tasks.ceph.ceph_manager.ceph:PG 15.3a is not active+clean 2024-09-21T03:24:43.739 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.004276+0000', 'last_change': '2024-09-21T03:24:38.004276+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.004276+0000', 'last_undegraded': '2024-09-21T03:24:38.004276+0000', 'last_fullsized': '2024-09-21T03:24:38.004276+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T03:24:43.739 INFO:tasks.ceph.ceph_manager.ceph:PG 15.39 is not active+clean 2024-09-21T03:24:43.740 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.004347+0000', 'last_change': '2024-09-21T03:24:38.004347+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.004347+0000', 'last_undegraded': '2024-09-21T03:24:38.004347+0000', 'last_fullsized': '2024-09-21T03:24:38.004347+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T03:24:43.740 INFO:tasks.ceph.ceph_manager.ceph:PG 15.37 is not active+clean 2024-09-21T03:24:43.740 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:37.999417+0000', 'last_change': '2024-09-21T03:24:37.999417+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:37.999417+0000', 'last_undegraded': '2024-09-21T03:24:37.999417+0000', 'last_fullsized': '2024-09-21T03:24:37.999417+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T03:24:43.740 INFO:tasks.ceph.ceph_manager.ceph:PG 15.36 is not active+clean 2024-09-21T03:24:43.740 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.003577+0000', 'last_change': '2024-09-21T03:24:38.003577+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.003577+0000', 'last_undegraded': '2024-09-21T03:24:38.003577+0000', 'last_fullsized': '2024-09-21T03:24:38.003577+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T03:24:43.740 INFO:tasks.ceph.ceph_manager.ceph:PG 15.35 is not active+clean 2024-09-21T03:24:43.740 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.004174+0000', 'last_change': '2024-09-21T03:24:38.004174+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.004174+0000', 'last_undegraded': '2024-09-21T03:24:38.004174+0000', 'last_fullsized': '2024-09-21T03:24:38.004174+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T03:24:43.740 INFO:tasks.ceph.ceph_manager.ceph:PG 15.34 is not active+clean 2024-09-21T03:24:43.740 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:37.999876+0000', 'last_change': '2024-09-21T03:24:37.999876+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:37.999876+0000', 'last_undegraded': '2024-09-21T03:24:37.999876+0000', 'last_fullsized': '2024-09-21T03:24:37.999876+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T03:24:43.740 INFO:tasks.ceph.ceph_manager.ceph:PG 15.33 is not active+clean 2024-09-21T03:24:43.740 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.001000+0000', 'last_change': '2024-09-21T03:24:38.001000+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.001000+0000', 'last_undegraded': '2024-09-21T03:24:38.001000+0000', 'last_fullsized': '2024-09-21T03:24:38.001000+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T03:24:43.740 INFO:tasks.ceph.ceph_manager.ceph:PG 15.32 is not active+clean 2024-09-21T03:24:43.741 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.007202+0000', 'last_change': '2024-09-21T03:24:38.007202+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.007202+0000', 'last_undegraded': '2024-09-21T03:24:38.007202+0000', 'last_fullsized': '2024-09-21T03:24:38.007202+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T03:24:43.741 INFO:tasks.ceph.ceph_manager.ceph:PG 15.31 is not active+clean 2024-09-21T03:24:43.741 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.004206+0000', 'last_change': '2024-09-21T03:24:38.004206+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.004206+0000', 'last_undegraded': '2024-09-21T03:24:38.004206+0000', 'last_fullsized': '2024-09-21T03:24:38.004206+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T03:24:43.741 INFO:tasks.ceph.ceph_manager.ceph:PG 15.30 is not active+clean 2024-09-21T03:24:43.741 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.003903+0000', 'last_change': '2024-09-21T03:24:38.003903+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.003903+0000', 'last_undegraded': '2024-09-21T03:24:38.003903+0000', 'last_fullsized': '2024-09-21T03:24:38.003903+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T03:24:43.741 INFO:tasks.ceph.ceph_manager.ceph:PG 15.2e is not active+clean 2024-09-21T03:24:43.741 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.003207+0000', 'last_change': '2024-09-21T03:24:38.003207+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.003207+0000', 'last_undegraded': '2024-09-21T03:24:38.003207+0000', 'last_fullsized': '2024-09-21T03:24:38.003207+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T03:24:43.741 INFO:tasks.ceph.ceph_manager.ceph:PG 15.2d is not active+clean 2024-09-21T03:24:43.741 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.003192+0000', 'last_change': '2024-09-21T03:24:38.003192+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.003192+0000', 'last_undegraded': '2024-09-21T03:24:38.003192+0000', 'last_fullsized': '2024-09-21T03:24:38.003192+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T03:24:43.741 INFO:tasks.ceph.ceph_manager.ceph:PG 15.2c is not active+clean 2024-09-21T03:24:43.741 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:37.999307+0000', 'last_change': '2024-09-21T03:24:37.999307+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:37.999307+0000', 'last_undegraded': '2024-09-21T03:24:37.999307+0000', 'last_fullsized': '2024-09-21T03:24:37.999307+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T03:24:43.741 INFO:tasks.ceph.ceph_manager.ceph:PG 15.2b is not active+clean 2024-09-21T03:24:43.742 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.003713+0000', 'last_change': '2024-09-21T03:24:38.003713+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.003713+0000', 'last_undegraded': '2024-09-21T03:24:38.003713+0000', 'last_fullsized': '2024-09-21T03:24:38.003713+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T03:24:43.742 INFO:tasks.ceph.ceph_manager.ceph:PG 15.28 is not active+clean 2024-09-21T03:24:43.742 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.002993+0000', 'last_change': '2024-09-21T03:24:38.002993+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.002993+0000', 'last_undegraded': '2024-09-21T03:24:38.002993+0000', 'last_fullsized': '2024-09-21T03:24:38.002993+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T03:24:43.742 INFO:tasks.ceph.ceph_manager.ceph:PG 15.27 is not active+clean 2024-09-21T03:24:43.742 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.005336+0000', 'last_change': '2024-09-21T03:24:38.005336+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.005336+0000', 'last_undegraded': '2024-09-21T03:24:38.005336+0000', 'last_fullsized': '2024-09-21T03:24:38.005336+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T03:24:43.742 INFO:tasks.ceph.ceph_manager.ceph:PG 15.25 is not active+clean 2024-09-21T03:24:43.742 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.002986+0000', 'last_change': '2024-09-21T03:24:38.002986+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.002986+0000', 'last_undegraded': '2024-09-21T03:24:38.002986+0000', 'last_fullsized': '2024-09-21T03:24:38.002986+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T03:24:43.742 INFO:tasks.ceph.ceph_manager.ceph:PG 15.24 is not active+clean 2024-09-21T03:24:43.742 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.006293+0000', 'last_change': '2024-09-21T03:24:38.006293+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.006293+0000', 'last_undegraded': '2024-09-21T03:24:38.006293+0000', 'last_fullsized': '2024-09-21T03:24:38.006293+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T03:24:43.742 INFO:tasks.ceph.ceph_manager.ceph:PG 15.22 is not active+clean 2024-09-21T03:24:43.742 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.006709+0000', 'last_change': '2024-09-21T03:24:38.006709+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.006709+0000', 'last_undegraded': '2024-09-21T03:24:38.006709+0000', 'last_fullsized': '2024-09-21T03:24:38.006709+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T03:24:43.743 INFO:tasks.ceph.ceph_manager.ceph:PG 15.21 is not active+clean 2024-09-21T03:24:43.743 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.003705+0000', 'last_change': '2024-09-21T03:24:38.003705+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.003705+0000', 'last_undegraded': '2024-09-21T03:24:38.003705+0000', 'last_fullsized': '2024-09-21T03:24:38.003705+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T03:24:43.743 INFO:tasks.ceph.ceph_manager.ceph:PG 15.20 is not active+clean 2024-09-21T03:24:43.743 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.010814+0000', 'last_change': '2024-09-21T03:24:38.010814+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.010814+0000', 'last_undegraded': '2024-09-21T03:24:38.010814+0000', 'last_fullsized': '2024-09-21T03:24:38.010814+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T03:24:43.743 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1e is not active+clean 2024-09-21T03:24:43.743 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.003562+0000', 'last_change': '2024-09-21T03:24:38.003562+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.003562+0000', 'last_undegraded': '2024-09-21T03:24:38.003562+0000', 'last_fullsized': '2024-09-21T03:24:38.003562+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T03:24:43.743 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1f is not active+clean 2024-09-21T03:24:43.743 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.002494+0000', 'last_change': '2024-09-21T03:24:38.002494+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.002494+0000', 'last_undegraded': '2024-09-21T03:24:38.002494+0000', 'last_fullsized': '2024-09-21T03:24:38.002494+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T03:24:43.743 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1c is not active+clean 2024-09-21T03:24:43.743 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.012629+0000', 'last_change': '2024-09-21T03:24:38.012629+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.012629+0000', 'last_undegraded': '2024-09-21T03:24:38.012629+0000', 'last_fullsized': '2024-09-21T03:24:38.012629+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T03:24:43.743 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1d is not active+clean 2024-09-21T03:24:43.743 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:37.998740+0000', 'last_change': '2024-09-21T03:24:37.998740+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:37.998740+0000', 'last_undegraded': '2024-09-21T03:24:37.998740+0000', 'last_fullsized': '2024-09-21T03:24:37.998740+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T03:24:43.743 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1a is not active+clean 2024-09-21T03:24:43.744 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.002418+0000', 'last_change': '2024-09-21T03:24:38.002418+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.002418+0000', 'last_undegraded': '2024-09-21T03:24:38.002418+0000', 'last_fullsized': '2024-09-21T03:24:38.002418+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T03:24:43.744 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1b is not active+clean 2024-09-21T03:24:43.744 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.002377+0000', 'last_change': '2024-09-21T03:24:38.002377+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.002377+0000', 'last_undegraded': '2024-09-21T03:24:38.002377+0000', 'last_fullsized': '2024-09-21T03:24:38.002377+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T03:24:43.744 INFO:tasks.ceph.ceph_manager.ceph:PG 15.18 is not active+clean 2024-09-21T03:24:43.744 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.000926+0000', 'last_change': '2024-09-21T03:24:38.000926+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.000926+0000', 'last_undegraded': '2024-09-21T03:24:38.000926+0000', 'last_fullsized': '2024-09-21T03:24:38.000926+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T03:24:43.744 INFO:tasks.ceph.ceph_manager.ceph:PG 15.19 is not active+clean 2024-09-21T03:24:43.744 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:37.999985+0000', 'last_change': '2024-09-21T03:24:37.999985+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:37.999985+0000', 'last_undegraded': '2024-09-21T03:24:37.999985+0000', 'last_fullsized': '2024-09-21T03:24:37.999985+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T03:24:43.744 INFO:tasks.ceph.ceph_manager.ceph:PG 15.17 is not active+clean 2024-09-21T03:24:43.744 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:37.997537+0000', 'last_change': '2024-09-21T03:24:37.997537+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:37.997537+0000', 'last_undegraded': '2024-09-21T03:24:37.997537+0000', 'last_fullsized': '2024-09-21T03:24:37.997537+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T03:24:43.744 INFO:tasks.ceph.ceph_manager.ceph:PG 15.14 is not active+clean 2024-09-21T03:24:43.744 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.003759+0000', 'last_change': '2024-09-21T03:24:38.003759+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.003759+0000', 'last_undegraded': '2024-09-21T03:24:38.003759+0000', 'last_fullsized': '2024-09-21T03:24:38.003759+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T03:24:43.744 INFO:tasks.ceph.ceph_manager.ceph:PG 15.15 is not active+clean 2024-09-21T03:24:43.744 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.001774+0000', 'last_change': '2024-09-21T03:24:38.001774+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.001774+0000', 'last_undegraded': '2024-09-21T03:24:38.001774+0000', 'last_fullsized': '2024-09-21T03:24:38.001774+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T03:24:43.745 INFO:tasks.ceph.ceph_manager.ceph:PG 15.12 is not active+clean 2024-09-21T03:24:43.745 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.001499+0000', 'last_change': '2024-09-21T03:24:38.001499+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.001499+0000', 'last_undegraded': '2024-09-21T03:24:38.001499+0000', 'last_fullsized': '2024-09-21T03:24:38.001499+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T03:24:43.745 INFO:tasks.ceph.ceph_manager.ceph:PG 15.13 is not active+clean 2024-09-21T03:24:43.745 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.013455+0000', 'last_change': '2024-09-21T03:24:38.013455+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.013455+0000', 'last_undegraded': '2024-09-21T03:24:38.013455+0000', 'last_fullsized': '2024-09-21T03:24:38.013455+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T03:24:43.745 INFO:tasks.ceph.ceph_manager.ceph:PG 15.10 is not active+clean 2024-09-21T03:24:43.745 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:37.997604+0000', 'last_change': '2024-09-21T03:24:37.997604+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:37.997604+0000', 'last_undegraded': '2024-09-21T03:24:37.997604+0000', 'last_fullsized': '2024-09-21T03:24:37.997604+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T03:24:43.745 INFO:tasks.ceph.ceph_manager.ceph:PG 15.11 is not active+clean 2024-09-21T03:24:43.745 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.003029+0000', 'last_change': '2024-09-21T03:24:38.003029+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.003029+0000', 'last_undegraded': '2024-09-21T03:24:38.003029+0000', 'last_fullsized': '2024-09-21T03:24:38.003029+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T03:24:43.745 INFO:tasks.ceph.ceph_manager.ceph:PG 15.f is not active+clean 2024-09-21T03:24:43.745 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.004869+0000', 'last_change': '2024-09-21T03:24:38.004869+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.004869+0000', 'last_undegraded': '2024-09-21T03:24:38.004869+0000', 'last_fullsized': '2024-09-21T03:24:38.004869+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T03:24:43.745 INFO:tasks.ceph.ceph_manager.ceph:PG 15.c is not active+clean 2024-09-21T03:24:43.745 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.003114+0000', 'last_change': '2024-09-21T03:24:38.003114+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.003114+0000', 'last_undegraded': '2024-09-21T03:24:38.003114+0000', 'last_fullsized': '2024-09-21T03:24:38.003114+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T03:24:43.746 INFO:tasks.ceph.ceph_manager.ceph:PG 15.d is not active+clean 2024-09-21T03:24:43.746 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.000756+0000', 'last_change': '2024-09-21T03:24:38.000756+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.000756+0000', 'last_undegraded': '2024-09-21T03:24:38.000756+0000', 'last_fullsized': '2024-09-21T03:24:38.000756+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T03:24:43.746 INFO:tasks.ceph.ceph_manager.ceph:PG 15.a is not active+clean 2024-09-21T03:24:43.746 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.006035+0000', 'last_change': '2024-09-21T03:24:38.006035+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.006035+0000', 'last_undegraded': '2024-09-21T03:24:38.006035+0000', 'last_fullsized': '2024-09-21T03:24:38.006035+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T03:24:43.746 INFO:tasks.ceph.ceph_manager.ceph:PG 15.b is not active+clean 2024-09-21T03:24:43.746 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.003049+0000', 'last_change': '2024-09-21T03:24:38.003049+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.003049+0000', 'last_undegraded': '2024-09-21T03:24:38.003049+0000', 'last_fullsized': '2024-09-21T03:24:38.003049+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T03:24:43.746 INFO:tasks.ceph.ceph_manager.ceph:PG 15.8 is not active+clean 2024-09-21T03:24:43.746 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.004963+0000', 'last_change': '2024-09-21T03:24:38.004963+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.004963+0000', 'last_undegraded': '2024-09-21T03:24:38.004963+0000', 'last_fullsized': '2024-09-21T03:24:38.004963+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T03:24:43.746 INFO:tasks.ceph.ceph_manager.ceph:PG 15.9 is not active+clean 2024-09-21T03:24:43.746 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.002421+0000', 'last_change': '2024-09-21T03:24:38.002421+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.002421+0000', 'last_undegraded': '2024-09-21T03:24:38.002421+0000', 'last_fullsized': '2024-09-21T03:24:38.002421+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T03:24:43.746 INFO:tasks.ceph.ceph_manager.ceph:PG 15.7 is not active+clean 2024-09-21T03:24:43.746 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.008511+0000', 'last_change': '2024-09-21T03:24:38.008511+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.008511+0000', 'last_undegraded': '2024-09-21T03:24:38.008511+0000', 'last_fullsized': '2024-09-21T03:24:38.008511+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T03:24:43.747 INFO:tasks.ceph.ceph_manager.ceph:PG 15.4 is not active+clean 2024-09-21T03:24:43.747 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.009699+0000', 'last_change': '2024-09-21T03:24:38.009699+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.009699+0000', 'last_undegraded': '2024-09-21T03:24:38.009699+0000', 'last_fullsized': '2024-09-21T03:24:38.009699+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T03:24:43.747 INFO:tasks.ceph.ceph_manager.ceph:PG 15.5 is not active+clean 2024-09-21T03:24:43.747 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.001353+0000', 'last_change': '2024-09-21T03:24:38.001353+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.001353+0000', 'last_undegraded': '2024-09-21T03:24:38.001353+0000', 'last_fullsized': '2024-09-21T03:24:38.001353+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T03:24:43.747 INFO:tasks.ceph.ceph_manager.ceph:PG 15.2 is not active+clean 2024-09-21T03:24:43.747 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.005410+0000', 'last_change': '2024-09-21T03:24:38.005410+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.005410+0000', 'last_undegraded': '2024-09-21T03:24:38.005410+0000', 'last_fullsized': '2024-09-21T03:24:38.005410+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T03:24:43.747 INFO:tasks.ceph.ceph_manager.ceph:PG 15.3 is not active+clean 2024-09-21T03:24:43.747 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:37.997676+0000', 'last_change': '2024-09-21T03:24:37.997676+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:37.997676+0000', 'last_undegraded': '2024-09-21T03:24:37.997676+0000', 'last_fullsized': '2024-09-21T03:24:37.997676+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T03:24:43.747 INFO:tasks.ceph.ceph_manager.ceph:PG 15.0 is not active+clean 2024-09-21T03:24:43.747 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.004467+0000', 'last_change': '2024-09-21T03:24:38.004467+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.004467+0000', 'last_undegraded': '2024-09-21T03:24:38.004467+0000', 'last_fullsized': '2024-09-21T03:24:38.004467+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T03:24:43.747 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1 is not active+clean 2024-09-21T03:24:43.747 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.001944+0000', 'last_change': '2024-09-21T03:24:38.001944+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.001944+0000', 'last_undegraded': '2024-09-21T03:24:38.001944+0000', 'last_fullsized': '2024-09-21T03:24:38.001944+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T03:24:43.747 INFO:tasks.ceph.ceph_manager.ceph:PG 15.e is not active+clean 2024-09-21T03:24:43.748 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:24:38.002984+0000', 'last_change': '2024-09-21T03:24:38.002984+0000', 'last_active': '2024-09-21T03:24:37.988740+0000', 'last_peered': '2024-09-21T03:24:37.988740+0000', 'last_clean': '2024-09-21T03:24:37.988740+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:24:38.002984+0000', 'last_undegraded': '2024-09-21T03:24:38.002984+0000', 'last_fullsized': '2024-09-21T03:24:38.002984+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'last_clean_scrub_stamp': '2024-09-21T03:24:37.988740+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T03:24:43.748 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T03:24:43.888 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.886+0000 7f145478a640 1 -- 172.21.15.105:0/3258707820 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f144c1570e0 msgr2=0x7f144c0d1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:43.888 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.886+0000 7f145478a640 1 --2- 172.21.15.105:0/3258707820 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f144c1570e0 0x7f144c0d1f20 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f144c074e30 tx=0x7f144802a530 comp rx=0 tx=0).stop 2024-09-21T03:24:43.888 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.886+0000 7f145478a640 1 -- 172.21.15.105:0/3258707820 shutdown_connections 2024-09-21T03:24:43.888 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.886+0000 7f145478a640 1 --2- 172.21.15.105:0/3258707820 >> v2:172.21.15.162:3300/0 conn(0x7f144c15d840 0x7f144c0b7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:43.888 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.886+0000 7f145478a640 1 --2- 172.21.15.105:0/3258707820 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f144c1570e0 0x7f144c0d1f20 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:43.888 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.886+0000 7f145478a640 1 -- 172.21.15.105:0/3258707820 >> 172.21.15.105:0/3258707820 conn(0x7f144c06d550 msgr2=0x7f144c071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:43.888 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.886+0000 7f145478a640 1 -- 172.21.15.105:0/3258707820 shutdown_connections 2024-09-21T03:24:43.888 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.886+0000 7f145478a640 1 -- 172.21.15.105:0/3258707820 wait complete. 2024-09-21T03:24:43.889 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.887+0000 7f145478a640 1 Processor -- start 2024-09-21T03:24:43.889 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.888+0000 7f145478a640 1 -- start start 2024-09-21T03:24:43.891 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.889+0000 7f145478a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f144c0d2460 0x7f144c1f3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:43.891 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.889+0000 7f145478a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f144c1570e0 0x7f144c0c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:43.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.889+0000 7f145478a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f144c15d840 0x7f144c1502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:43.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.889+0000 7f145478a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f144c0b7d60 con 0x7f144c15d840 2024-09-21T03:24:43.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.889+0000 7f145478a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f144c0b7be0 con 0x7f144c0d2460 2024-09-21T03:24:43.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.889+0000 7f145478a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f144c0b7ee0 con 0x7f144c1570e0 2024-09-21T03:24:43.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.889+0000 7f1452d27640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f144c15d840 0x7f144c1502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:43.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.889+0000 7f1452d27640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f144c15d840 0x7f144c1502a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:60528/0 (socket says 172.21.15.105:60528) 2024-09-21T03:24:43.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.889+0000 7f1452d27640 1 -- 172.21.15.105:0/4154076889 learned_addr learned my addr 172.21.15.105:0/4154076889 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:43.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.889+0000 7f1452526640 1 --2- 172.21.15.105:0/4154076889 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f144c0d2460 0x7f144c1f3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:43.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.889+0000 7f1452d27640 1 -- 172.21.15.105:0/4154076889 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f144c1570e0 msgr2=0x7f144c0c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:43.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.889+0000 7f1452d27640 1 --2- 172.21.15.105:0/4154076889 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f144c1570e0 0x7f144c0c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:43.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.889+0000 7f1452d27640 1 -- 172.21.15.105:0/4154076889 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f144c0d2460 msgr2=0x7f144c1f3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:43.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.889+0000 7f1452d27640 1 --2- 172.21.15.105:0/4154076889 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f144c0d2460 0x7f144c1f3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:43.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.889+0000 7f1452d27640 1 -- 172.21.15.105:0/4154076889 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f144c1f42a0 con 0x7f144c15d840 2024-09-21T03:24:43.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.889+0000 7f1452526640 1 --2- 172.21.15.105:0/4154076889 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f144c0d2460 0x7f144c1f3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:24:43.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.889+0000 7f1452d27640 1 --2- 172.21.15.105:0/4154076889 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f144c15d840 0x7f144c1502a0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f144400ca80 tx=0x7f144400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:43.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.889+0000 7f1442ffd640 1 -- 172.21.15.105:0/4154076889 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1444007d90 con 0x7f144c15d840 2024-09-21T03:24:43.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.890+0000 7f1442ffd640 1 -- 172.21.15.105:0/4154076889 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1444004c30 con 0x7f144c15d840 2024-09-21T03:24:43.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.890+0000 7f1442ffd640 1 -- 172.21.15.105:0/4154076889 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1444005280 con 0x7f144c15d840 2024-09-21T03:24:43.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.890+0000 7f145478a640 1 -- 172.21.15.105:0/4154076889 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f144c1f4580 con 0x7f144c15d840 2024-09-21T03:24:43.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.890+0000 7f145478a640 1 -- 172.21.15.105:0/4154076889 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f144c1f4b40 con 0x7f144c15d840 2024-09-21T03:24:43.894 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.890+0000 7f145478a640 1 -- 172.21.15.105:0/4154076889 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f144c0d1f20 con 0x7f144c15d840 2024-09-21T03:24:43.894 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.891+0000 7f1442ffd640 1 -- 172.21.15.105:0/4154076889 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1444005420 con 0x7f144c15d840 2024-09-21T03:24:43.894 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.892+0000 7f1442ffd640 1 --2- 172.21.15.105:0/4154076889 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1430078b90 0x7f143007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:43.894 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.892+0000 7f1442ffd640 1 -- 172.21.15.105:0/4154076889 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7f144409b700 con 0x7f144c15d840 2024-09-21T03:24:43.894 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.892+0000 7f1452526640 1 --2- 172.21.15.105:0/4154076889 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1430078b90 0x7f143007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:43.894 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.892+0000 7f1452526640 1 --2- 172.21.15.105:0/4154076889 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1430078b90 0x7f143007b0a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1448034000 tx=0x7f1448004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:43.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:43.896+0000 7f1442ffd640 1 -- 172.21.15.105:0/4154076889 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1444014070 con 0x7f144c15d840 2024-09-21T03:24:44.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.145+0000 7f145478a640 1 -- 172.21.15.105:0/4154076889 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f144c0b7580 con 0x7f144c15d840 2024-09-21T03:24:44.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.145+0000 7f1442ffd640 1 -- 172.21.15.105:0/4154076889 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1139 (secure 0 0 0) 0x7f1444063c60 con 0x7f144c15d840 2024-09-21T03:24:44.147 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:24:44.147 INFO:teuthology.orchestra.run.smithi105.stdout:{"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":399,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":93,"num_osds":8,"num_up_osds":8,"osd_up_since":1726888698,"num_in_osds":8,"osd_in_since":1726888688,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":55},{"state_name":"active+clean","count":42}],"num_pgs":97,"num_pools":3,"num_objects":8,"data_bytes":590950,"bytes_used":265662464,"bytes_avail":772828450816,"bytes_total":773094113280,"inactive_pgs_ratio":0.56701028347015381,"write_bytes_sec":170,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":58,"btime":"2024-09-21T03:24:42:016797+0000","id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":6840}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":9,"modified":"2024-09-21T03:22:59.350968+0000","services":{}},"progress_events":{}} 2024-09-21T03:24:44.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.147+0000 7f145478a640 1 -- 172.21.15.105:0/4154076889 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1430078b90 msgr2=0x7f143007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:44.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.147+0000 7f145478a640 1 --2- 172.21.15.105:0/4154076889 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1430078b90 0x7f143007b0a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1448034000 tx=0x7f1448004730 comp rx=0 tx=0).stop 2024-09-21T03:24:44.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.147+0000 7f145478a640 1 -- 172.21.15.105:0/4154076889 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f144c15d840 msgr2=0x7f144c1502a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:44.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.147+0000 7f145478a640 1 --2- 172.21.15.105:0/4154076889 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f144c15d840 0x7f144c1502a0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f144400ca80 tx=0x7f144400cf40 comp rx=0 tx=0).stop 2024-09-21T03:24:44.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.147+0000 7f145478a640 1 -- 172.21.15.105:0/4154076889 shutdown_connections 2024-09-21T03:24:44.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.147+0000 7f145478a640 1 --2- 172.21.15.105:0/4154076889 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1430078b90 0x7f143007b0a0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:44.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.147+0000 7f145478a640 1 --2- 172.21.15.105:0/4154076889 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f144c15d840 0x7f144c1502a0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:44.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.147+0000 7f145478a640 1 --2- 172.21.15.105:0/4154076889 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f144c1570e0 0x7f144c0c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:44.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.147+0000 7f145478a640 1 --2- 172.21.15.105:0/4154076889 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f144c0d2460 0x7f144c1f3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:44.150 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.147+0000 7f145478a640 1 -- 172.21.15.105:0/4154076889 >> 172.21.15.105:0/4154076889 conn(0x7f144c06d550 msgr2=0x7f144c0b15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:44.150 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.147+0000 7f145478a640 1 -- 172.21.15.105:0/4154076889 shutdown_connections 2024-09-21T03:24:44.150 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.147+0000 7f145478a640 1 -- 172.21.15.105:0/4154076889 wait complete. 2024-09-21T03:24:44.160 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-21T03:24:44.160 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:24:44.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.270+0000 7f8760762640 1 -- 172.21.15.105:0/925915921 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87580cfeb0 msgr2=0x7f87580d02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:44.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.270+0000 7f8760762640 1 --2- 172.21.15.105:0/925915921 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87580cfeb0 0x7f87580d02c0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f87580d22a0 tx=0x7f875002a560 comp rx=0 tx=0).stop 2024-09-21T03:24:44.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.270+0000 7f8760762640 1 -- 172.21.15.105:0/925915921 shutdown_connections 2024-09-21T03:24:44.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.270+0000 7f8760762640 1 --2- 172.21.15.105:0/925915921 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87580cfeb0 0x7f87580d02c0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:44.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.270+0000 7f8760762640 1 --2- 172.21.15.105:0/925915921 >> v2:172.21.15.162:3300/0 conn(0x7f875806fec0 0x7f87580702d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:44.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.270+0000 7f8760762640 1 --2- 172.21.15.105:0/925915921 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87580b4090 0x7f87580b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:44.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.270+0000 7f8760762640 1 -- 172.21.15.105:0/925915921 >> 172.21.15.105:0/925915921 conn(0x7f87580cdcc0 msgr2=0x7f87580ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:44.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.270+0000 7f8760762640 1 -- 172.21.15.105:0/925915921 shutdown_connections 2024-09-21T03:24:44.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.270+0000 7f8760762640 1 -- 172.21.15.105:0/925915921 wait complete. 2024-09-21T03:24:44.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.272+0000 7f8760762640 1 Processor -- start 2024-09-21T03:24:44.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.272+0000 7f8760762640 1 -- start start 2024-09-21T03:24:44.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.273+0000 7f8760762640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f875806fec0 0x7f8758145450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:44.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.273+0000 7f8760762640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87580b4090 0x7f87580ae330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:44.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.273+0000 7f8760762640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87580cfeb0 0x7f875815e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:44.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.273+0000 7f8760762640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f87580b46a0 con 0x7f875806fec0 2024-09-21T03:24:44.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.273+0000 7f8760762640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f87580b4820 con 0x7f87580b4090 2024-09-21T03:24:44.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.273+0000 7f8760762640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f87580b49a0 con 0x7f87580cfeb0 2024-09-21T03:24:44.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.273+0000 7f875e4fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f875806fec0 0x7f8758145450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:44.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.273+0000 7f875e4fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f875806fec0 0x7f8758145450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:60548/0 (socket says 172.21.15.105:60548) 2024-09-21T03:24:44.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.273+0000 7f875e4fe640 1 -- 172.21.15.105:0/3319794898 learned_addr learned my addr 172.21.15.105:0/3319794898 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:44.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.273+0000 7f875dcfd640 1 --2- 172.21.15.105:0/3319794898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87580b4090 0x7f87580ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:44.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.273+0000 7f875ecff640 1 --2- 172.21.15.105:0/3319794898 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87580cfeb0 0x7f875815e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:44.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.273+0000 7f875e4fe640 1 -- 172.21.15.105:0/3319794898 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87580cfeb0 msgr2=0x7f875815e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:44.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.273+0000 7f875e4fe640 1 --2- 172.21.15.105:0/3319794898 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87580cfeb0 0x7f875815e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:44.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.273+0000 7f875e4fe640 1 -- 172.21.15.105:0/3319794898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87580b4090 msgr2=0x7f87580ae330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:44.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.273+0000 7f875e4fe640 1 --2- 172.21.15.105:0/3319794898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87580b4090 0x7f87580ae330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:44.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.273+0000 7f875e4fe640 1 -- 172.21.15.105:0/3319794898 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8758156290 con 0x7f875806fec0 2024-09-21T03:24:44.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.273+0000 7f875ecff640 1 --2- 172.21.15.105:0/3319794898 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87580cfeb0 0x7f875815e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:24:44.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.273+0000 7f875dcfd640 1 --2- 172.21.15.105:0/3319794898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87580b4090 0x7f87580ae330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:24:44.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.274+0000 7f875e4fe640 1 --2- 172.21.15.105:0/3319794898 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f875806fec0 0x7f8758145450 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f874800cce0 tx=0x7f874800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:44.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.274+0000 7f8756ffd640 1 -- 172.21.15.105:0/3319794898 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f874800f450 con 0x7f875806fec0 2024-09-21T03:24:44.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.274+0000 7f8756ffd640 1 -- 172.21.15.105:0/3319794898 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f874800f6e0 con 0x7f875806fec0 2024-09-21T03:24:44.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.274+0000 7f8760762640 1 -- 172.21.15.105:0/3319794898 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f875815dd10 con 0x7f875806fec0 2024-09-21T03:24:44.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.274+0000 7f8756ffd640 1 -- 172.21.15.105:0/3319794898 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f874800fb30 con 0x7f875806fec0 2024-09-21T03:24:44.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.274+0000 7f8760762640 1 -- 172.21.15.105:0/3319794898 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8758156790 con 0x7f875806fec0 2024-09-21T03:24:44.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.275+0000 7f8760762640 1 -- 172.21.15.105:0/3319794898 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87580b3550 con 0x7f875806fec0 2024-09-21T03:24:44.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.275+0000 7f8756ffd640 1 -- 172.21.15.105:0/3319794898 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8748018400 con 0x7f875806fec0 2024-09-21T03:24:44.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.276+0000 7f8756ffd640 1 --2- 172.21.15.105:0/3319794898 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8744078bc0 0x7f874407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:44.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.276+0000 7f8756ffd640 1 -- 172.21.15.105:0/3319794898 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7f874809b830 con 0x7f875806fec0 2024-09-21T03:24:44.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.276+0000 7f875dcfd640 1 --2- 172.21.15.105:0/3319794898 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8744078bc0 0x7f874407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:44.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.277+0000 7f875dcfd640 1 --2- 172.21.15.105:0/3319794898 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8744078bc0 0x7f874407b0d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f875815a940 tx=0x7f874c005e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:44.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.280+0000 7f8756ffd640 1 -- 172.21.15.105:0/3319794898 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8748014030 con 0x7f875806fec0 2024-09-21T03:24:44.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.457+0000 7f8760762640 1 -- 172.21.15.105:0/3319794898 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f87580ce590 con 0x7f8744078bc0 2024-09-21T03:24:44.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.462+0000 7f8756ffd640 1 -- 172.21.15.105:0/3319794898 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247544 (secure 0 0 0) 0x7f87580ce590 con 0x7f8744078bc0 2024-09-21T03:24:44.466 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:24:44.467 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:24:44.468 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.465+0000 7f8760762640 1 -- 172.21.15.105:0/3319794898 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8744078bc0 msgr2=0x7f874407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:44.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.465+0000 7f8760762640 1 --2- 172.21.15.105:0/3319794898 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8744078bc0 0x7f874407b0d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f875815a940 tx=0x7f874c005e90 comp rx=0 tx=0).stop 2024-09-21T03:24:44.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.465+0000 7f8760762640 1 -- 172.21.15.105:0/3319794898 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f875806fec0 msgr2=0x7f8758145450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:44.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.465+0000 7f8760762640 1 --2- 172.21.15.105:0/3319794898 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f875806fec0 0x7f8758145450 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f874800cce0 tx=0x7f874800a620 comp rx=0 tx=0).stop 2024-09-21T03:24:44.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.465+0000 7f8760762640 1 -- 172.21.15.105:0/3319794898 shutdown_connections 2024-09-21T03:24:44.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.465+0000 7f8760762640 1 --2- 172.21.15.105:0/3319794898 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8744078bc0 0x7f874407b0d0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:44.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.465+0000 7f8760762640 1 --2- 172.21.15.105:0/3319794898 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87580cfeb0 0x7f875815e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:44.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.465+0000 7f8760762640 1 --2- 172.21.15.105:0/3319794898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87580b4090 0x7f87580ae330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:44.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.465+0000 7f8760762640 1 --2- 172.21.15.105:0/3319794898 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f875806fec0 0x7f8758145450 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:44.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.465+0000 7f8760762640 1 -- 172.21.15.105:0/3319794898 >> 172.21.15.105:0/3319794898 conn(0x7f87580cdcc0 msgr2=0x7f87580b4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:44.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.465+0000 7f8760762640 1 -- 172.21.15.105:0/3319794898 shutdown_connections 2024-09-21T03:24:44.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:44.465+0000 7f8760762640 1 -- 172.21.15.105:0/3319794898 wait complete. 2024-09-21T03:24:44.478 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":280,"stamp":"2024-09-21T03:24:43.379607+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":113,"num_write_kb":1629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84,"ondisk_log_size":84,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259436,"kb_used_data":9912,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715284,"statfs":{"total":773094113280,"available":772828450816,"internally_reserved":0,"allocated":10149888,"data_stored":4949046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001489"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.009730+0000","last_change":"2024-09-21T03:24:38.009730+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.009730+0000","last_undegraded":"2024-09-21T03:24:38.009730+0000","last_fullsized":"2024-09-21T03:24:38.009730+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.013059+0000","last_change":"2024-09-21T03:24:39.030988+0000","last_active":"2024-09-21T03:24:40.013059+0000","last_peered":"2024-09-21T03:24:40.013059+0000","last_clean":"2024-09-21T03:24:40.013059+0000","last_became_active":"2024-09-21T03:24:39.030685+0000","last_became_peered":"2024-09-21T03:24:39.030685+0000","last_unstale":"2024-09-21T03:24:40.013059+0000","last_undegraded":"2024-09-21T03:24:40.013059+0000","last_fullsized":"2024-09-21T03:24:40.013059+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:30.830696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.015446+0000","last_change":"2024-09-21T03:24:38.015446+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.015446+0000","last_undegraded":"2024-09-21T03:24:38.015446+0000","last_fullsized":"2024-09-21T03:24:38.015446+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.001334+0000","last_change":"2024-09-21T03:24:38.001334+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.001334+0000","last_undegraded":"2024-09-21T03:24:38.001334+0000","last_fullsized":"2024-09-21T03:24:38.001334+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:37.998731+0000","last_change":"2024-09-21T03:24:37.998731+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.998731+0000","last_undegraded":"2024-09-21T03:24:37.998731+0000","last_fullsized":"2024-09-21T03:24:37.998731+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.004276+0000","last_change":"2024-09-21T03:24:38.004276+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.004276+0000","last_undegraded":"2024-09-21T03:24:38.004276+0000","last_fullsized":"2024-09-21T03:24:38.004276+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.004347+0000","last_change":"2024-09-21T03:24:38.004347+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.004347+0000","last_undegraded":"2024-09-21T03:24:38.004347+0000","last_fullsized":"2024-09-21T03:24:38.004347+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.012650+0000","last_change":"2024-09-21T03:24:39.023580+0000","last_active":"2024-09-21T03:24:40.012650+0000","last_peered":"2024-09-21T03:24:40.012650+0000","last_clean":"2024-09-21T03:24:40.012650+0000","last_became_active":"2024-09-21T03:24:39.023204+0000","last_became_peered":"2024-09-21T03:24:39.023204+0000","last_unstale":"2024-09-21T03:24:40.012650+0000","last_undegraded":"2024-09-21T03:24:40.012650+0000","last_fullsized":"2024-09-21T03:24:40.012650+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:24.160293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:37.999417+0000","last_change":"2024-09-21T03:24:37.999417+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.999417+0000","last_undegraded":"2024-09-21T03:24:37.999417+0000","last_fullsized":"2024-09-21T03:24:37.999417+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003577+0000","last_change":"2024-09-21T03:24:38.003577+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003577+0000","last_undegraded":"2024-09-21T03:24:38.003577+0000","last_fullsized":"2024-09-21T03:24:38.003577+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.004174+0000","last_change":"2024-09-21T03:24:38.004174+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.004174+0000","last_undegraded":"2024-09-21T03:24:38.004174+0000","last_fullsized":"2024-09-21T03:24:38.004174+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:37.999876+0000","last_change":"2024-09-21T03:24:37.999876+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.999876+0000","last_undegraded":"2024-09-21T03:24:37.999876+0000","last_fullsized":"2024-09-21T03:24:37.999876+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.001000+0000","last_change":"2024-09-21T03:24:38.001000+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.001000+0000","last_undegraded":"2024-09-21T03:24:38.001000+0000","last_fullsized":"2024-09-21T03:24:38.001000+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.007202+0000","last_change":"2024-09-21T03:24:38.007202+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.007202+0000","last_undegraded":"2024-09-21T03:24:38.007202+0000","last_fullsized":"2024-09-21T03:24:38.007202+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.004206+0000","last_change":"2024-09-21T03:24:38.004206+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.004206+0000","last_undegraded":"2024-09-21T03:24:38.004206+0000","last_fullsized":"2024-09-21T03:24:38.004206+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003903+0000","last_change":"2024-09-21T03:24:38.003903+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003903+0000","last_undegraded":"2024-09-21T03:24:38.003903+0000","last_fullsized":"2024-09-21T03:24:38.003903+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.013399+0000","last_change":"2024-09-21T03:24:39.032389+0000","last_active":"2024-09-21T03:24:40.013399+0000","last_peered":"2024-09-21T03:24:40.013399+0000","last_clean":"2024-09-21T03:24:40.013399+0000","last_became_active":"2024-09-21T03:24:39.032088+0000","last_became_peered":"2024-09-21T03:24:39.032088+0000","last_unstale":"2024-09-21T03:24:40.013399+0000","last_undegraded":"2024-09-21T03:24:40.013399+0000","last_fullsized":"2024-09-21T03:24:40.013399+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:20.478211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003207+0000","last_change":"2024-09-21T03:24:38.003207+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003207+0000","last_undegraded":"2024-09-21T03:24:38.003207+0000","last_fullsized":"2024-09-21T03:24:38.003207+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003192+0000","last_change":"2024-09-21T03:24:38.003192+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003192+0000","last_undegraded":"2024-09-21T03:24:38.003192+0000","last_fullsized":"2024-09-21T03:24:38.003192+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:37.999307+0000","last_change":"2024-09-21T03:24:37.999307+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.999307+0000","last_undegraded":"2024-09-21T03:24:37.999307+0000","last_fullsized":"2024-09-21T03:24:37.999307+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003713+0000","last_change":"2024-09-21T03:24:38.003713+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003713+0000","last_undegraded":"2024-09-21T03:24:38.003713+0000","last_fullsized":"2024-09-21T03:24:38.003713+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.012693+0000","last_change":"2024-09-21T03:24:39.029686+0000","last_active":"2024-09-21T03:24:40.012693+0000","last_peered":"2024-09-21T03:24:40.012693+0000","last_clean":"2024-09-21T03:24:40.012693+0000","last_became_active":"2024-09-21T03:24:39.025264+0000","last_became_peered":"2024-09-21T03:24:39.025264+0000","last_unstale":"2024-09-21T03:24:40.012693+0000","last_undegraded":"2024-09-21T03:24:40.012693+0000","last_fullsized":"2024-09-21T03:24:40.012693+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:31:34.867080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.012776+0000","last_change":"2024-09-21T03:24:39.020402+0000","last_active":"2024-09-21T03:24:40.012776+0000","last_peered":"2024-09-21T03:24:40.012776+0000","last_clean":"2024-09-21T03:24:40.012776+0000","last_became_active":"2024-09-21T03:24:39.020093+0000","last_became_peered":"2024-09-21T03:24:39.020093+0000","last_unstale":"2024-09-21T03:24:40.012776+0000","last_undegraded":"2024-09-21T03:24:40.012776+0000","last_fullsized":"2024-09-21T03:24:40.012776+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:07:49.387867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.002993+0000","last_change":"2024-09-21T03:24:38.002993+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.002993+0000","last_undegraded":"2024-09-21T03:24:38.002993+0000","last_fullsized":"2024-09-21T03:24:38.002993+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.005336+0000","last_change":"2024-09-21T03:24:38.005336+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.005336+0000","last_undegraded":"2024-09-21T03:24:38.005336+0000","last_fullsized":"2024-09-21T03:24:38.005336+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.013270+0000","last_change":"2024-09-21T03:24:39.028282+0000","last_active":"2024-09-21T03:24:40.013270+0000","last_peered":"2024-09-21T03:24:40.013270+0000","last_clean":"2024-09-21T03:24:40.013270+0000","last_became_active":"2024-09-21T03:24:39.027993+0000","last_became_peered":"2024-09-21T03:24:39.027993+0000","last_unstale":"2024-09-21T03:24:40.013270+0000","last_undegraded":"2024-09-21T03:24:40.013270+0000","last_fullsized":"2024-09-21T03:24:40.013270+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:07.763847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.002986+0000","last_change":"2024-09-21T03:24:38.002986+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.002986+0000","last_undegraded":"2024-09-21T03:24:38.002986+0000","last_fullsized":"2024-09-21T03:24:38.002986+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.006293+0000","last_change":"2024-09-21T03:24:38.006293+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.006293+0000","last_undegraded":"2024-09-21T03:24:38.006293+0000","last_fullsized":"2024-09-21T03:24:38.006293+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.013154+0000","last_change":"2024-09-21T03:24:39.024343+0000","last_active":"2024-09-21T03:24:40.013154+0000","last_peered":"2024-09-21T03:24:40.013154+0000","last_clean":"2024-09-21T03:24:40.013154+0000","last_became_active":"2024-09-21T03:24:39.024033+0000","last_became_peered":"2024-09-21T03:24:39.024033+0000","last_unstale":"2024-09-21T03:24:40.013154+0000","last_undegraded":"2024-09-21T03:24:40.013154+0000","last_fullsized":"2024-09-21T03:24:40.013154+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:54.404219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.006709+0000","last_change":"2024-09-21T03:24:38.006709+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.006709+0000","last_undegraded":"2024-09-21T03:24:38.006709+0000","last_fullsized":"2024-09-21T03:24:38.006709+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003705+0000","last_change":"2024-09-21T03:24:38.003705+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003705+0000","last_undegraded":"2024-09-21T03:24:38.003705+0000","last_fullsized":"2024-09-21T03:24:38.003705+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.010814+0000","last_change":"2024-09-21T03:24:38.010814+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.010814+0000","last_undegraded":"2024-09-21T03:24:38.010814+0000","last_fullsized":"2024-09-21T03:24:38.010814+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003562+0000","last_change":"2024-09-21T03:24:38.003562+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003562+0000","last_undegraded":"2024-09-21T03:24:38.003562+0000","last_fullsized":"2024-09-21T03:24:38.003562+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"92'4","reported_seq":19,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.013528+0000","last_change":"2024-09-21T03:24:38.015939+0000","last_active":"2024-09-21T03:24:40.013528+0000","last_peered":"2024-09-21T03:24:40.013528+0000","last_clean":"2024-09-21T03:24:40.013528+0000","last_became_active":"2024-09-21T03:24:38.015624+0000","last_became_peered":"2024-09-21T03:24:38.015624+0000","last_unstale":"2024-09-21T03:24:40.013528+0000","last_undegraded":"2024-09-21T03:24:40.013528+0000","last_fullsized":"2024-09-21T03:24:40.013528+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:36:17.535190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.002494+0000","last_change":"2024-09-21T03:24:38.002494+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.002494+0000","last_undegraded":"2024-09-21T03:24:38.002494+0000","last_fullsized":"2024-09-21T03:24:38.002494+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.020618+0000","last_change":"2024-09-21T03:24:38.019879+0000","last_active":"2024-09-21T03:24:38.020618+0000","last_peered":"2024-09-21T03:24:38.020618+0000","last_clean":"2024-09-21T03:24:38.020618+0000","last_became_active":"2024-09-21T03:24:38.019498+0000","last_became_peered":"2024-09-21T03:24:38.019498+0000","last_unstale":"2024-09-21T03:24:38.020618+0000","last_undegraded":"2024-09-21T03:24:38.020618+0000","last_fullsized":"2024-09-21T03:24:38.020618+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:05.347691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.012629+0000","last_change":"2024-09-21T03:24:38.012629+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.012629+0000","last_undegraded":"2024-09-21T03:24:38.012629+0000","last_fullsized":"2024-09-21T03:24:38.012629+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"92'2","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.013041+0000","last_change":"2024-09-21T03:24:38.014576+0000","last_active":"2024-09-21T03:24:40.013041+0000","last_peered":"2024-09-21T03:24:40.013041+0000","last_clean":"2024-09-21T03:24:40.013041+0000","last_became_active":"2024-09-21T03:24:38.014251+0000","last_became_peered":"2024-09-21T03:24:38.014251+0000","last_unstale":"2024-09-21T03:24:40.013041+0000","last_undegraded":"2024-09-21T03:24:40.013041+0000","last_fullsized":"2024-09-21T03:24:40.013041+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:14.129111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:37.998740+0000","last_change":"2024-09-21T03:24:37.998740+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.998740+0000","last_undegraded":"2024-09-21T03:24:37.998740+0000","last_fullsized":"2024-09-21T03:24:37.998740+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"92'2","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.012903+0000","last_change":"2024-09-21T03:24:38.014977+0000","last_active":"2024-09-21T03:24:40.012903+0000","last_peered":"2024-09-21T03:24:40.012903+0000","last_clean":"2024-09-21T03:24:40.012903+0000","last_became_active":"2024-09-21T03:24:38.014673+0000","last_became_peered":"2024-09-21T03:24:38.014673+0000","last_unstale":"2024-09-21T03:24:40.012903+0000","last_undegraded":"2024-09-21T03:24:40.012903+0000","last_fullsized":"2024-09-21T03:24:40.012903+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:16:19.513335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.002418+0000","last_change":"2024-09-21T03:24:38.002418+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.002418+0000","last_undegraded":"2024-09-21T03:24:38.002418+0000","last_fullsized":"2024-09-21T03:24:38.002418+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.024352+0000","last_change":"2024-09-21T03:24:38.020873+0000","last_active":"2024-09-21T03:24:38.024352+0000","last_peered":"2024-09-21T03:24:38.024352+0000","last_clean":"2024-09-21T03:24:38.024352+0000","last_became_active":"2024-09-21T03:24:38.020586+0000","last_became_peered":"2024-09-21T03:24:38.020586+0000","last_unstale":"2024-09-21T03:24:38.024352+0000","last_undegraded":"2024-09-21T03:24:38.024352+0000","last_fullsized":"2024-09-21T03:24:38.024352+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:38.297464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.002377+0000","last_change":"2024-09-21T03:24:38.002377+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.002377+0000","last_undegraded":"2024-09-21T03:24:38.002377+0000","last_fullsized":"2024-09-21T03:24:38.002377+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"92'1","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.012733+0000","last_change":"2024-09-21T03:24:38.020632+0000","last_active":"2024-09-21T03:24:40.012733+0000","last_peered":"2024-09-21T03:24:40.012733+0000","last_clean":"2024-09-21T03:24:40.012733+0000","last_became_active":"2024-09-21T03:24:38.020311+0000","last_became_peered":"2024-09-21T03:24:38.020311+0000","last_unstale":"2024-09-21T03:24:40.012733+0000","last_undegraded":"2024-09-21T03:24:40.012733+0000","last_fullsized":"2024-09-21T03:24:40.012733+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:43.226556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.000926+0000","last_change":"2024-09-21T03:24:38.000926+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.000926+0000","last_undegraded":"2024-09-21T03:24:38.000926+0000","last_fullsized":"2024-09-21T03:24:38.000926+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.017601+0000","last_change":"2024-09-21T03:24:38.015466+0000","last_active":"2024-09-21T03:24:38.017601+0000","last_peered":"2024-09-21T03:24:38.017601+0000","last_clean":"2024-09-21T03:24:38.017601+0000","last_became_active":"2024-09-21T03:24:38.015170+0000","last_became_peered":"2024-09-21T03:24:38.015170+0000","last_unstale":"2024-09-21T03:24:38.017601+0000","last_undegraded":"2024-09-21T03:24:38.017601+0000","last_fullsized":"2024-09-21T03:24:38.017601+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:45:46.694000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:37.999985+0000","last_change":"2024-09-21T03:24:37.999985+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.999985+0000","last_undegraded":"2024-09-21T03:24:37.999985+0000","last_fullsized":"2024-09-21T03:24:37.999985+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.029707+0000","last_change":"2024-09-21T03:24:38.024676+0000","last_active":"2024-09-21T03:24:38.029707+0000","last_peered":"2024-09-21T03:24:38.029707+0000","last_clean":"2024-09-21T03:24:38.029707+0000","last_became_active":"2024-09-21T03:24:38.024305+0000","last_became_peered":"2024-09-21T03:24:38.024305+0000","last_unstale":"2024-09-21T03:24:38.029707+0000","last_undegraded":"2024-09-21T03:24:38.029707+0000","last_fullsized":"2024-09-21T03:24:38.029707+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:01.136782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.013296+0000","last_change":"2024-09-21T03:24:39.024776+0000","last_active":"2024-09-21T03:24:40.013296+0000","last_peered":"2024-09-21T03:24:40.013296+0000","last_clean":"2024-09-21T03:24:40.013296+0000","last_became_active":"2024-09-21T03:24:39.024478+0000","last_became_peered":"2024-09-21T03:24:39.024478+0000","last_unstale":"2024-09-21T03:24:40.013296+0000","last_undegraded":"2024-09-21T03:24:40.013296+0000","last_fullsized":"2024-09-21T03:24:40.013296+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:55.518801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.023790+0000","last_change":"2024-09-21T03:24:38.019784+0000","last_active":"2024-09-21T03:24:38.023790+0000","last_peered":"2024-09-21T03:24:38.023790+0000","last_clean":"2024-09-21T03:24:38.023790+0000","last_became_active":"2024-09-21T03:24:38.019456+0000","last_became_peered":"2024-09-21T03:24:38.019456+0000","last_unstale":"2024-09-21T03:24:38.023790+0000","last_undegraded":"2024-09-21T03:24:38.023790+0000","last_fullsized":"2024-09-21T03:24:38.023790+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:28.389174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:37.997537+0000","last_change":"2024-09-21T03:24:37.997537+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.997537+0000","last_undegraded":"2024-09-21T03:24:37.997537+0000","last_fullsized":"2024-09-21T03:24:37.997537+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.012124+0000","last_change":"2024-09-21T03:24:38.011409+0000","last_active":"2024-09-21T03:24:38.012124+0000","last_peered":"2024-09-21T03:24:38.012124+0000","last_clean":"2024-09-21T03:24:38.012124+0000","last_became_active":"2024-09-21T03:24:38.011093+0000","last_became_peered":"2024-09-21T03:24:38.011093+0000","last_unstale":"2024-09-21T03:24:38.012124+0000","last_undegraded":"2024-09-21T03:24:38.012124+0000","last_fullsized":"2024-09-21T03:24:38.012124+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:27:39.891218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003759+0000","last_change":"2024-09-21T03:24:38.003759+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003759+0000","last_undegraded":"2024-09-21T03:24:38.003759+0000","last_fullsized":"2024-09-21T03:24:38.003759+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.014568+0000","last_change":"2024-09-21T03:24:38.010947+0000","last_active":"2024-09-21T03:24:38.014568+0000","last_peered":"2024-09-21T03:24:38.014568+0000","last_clean":"2024-09-21T03:24:38.014568+0000","last_became_active":"2024-09-21T03:24:38.010622+0000","last_became_peered":"2024-09-21T03:24:38.010622+0000","last_unstale":"2024-09-21T03:24:38.014568+0000","last_undegraded":"2024-09-21T03:24:38.014568+0000","last_fullsized":"2024-09-21T03:24:38.014568+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:39.345967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.001774+0000","last_change":"2024-09-21T03:24:38.001774+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.001774+0000","last_undegraded":"2024-09-21T03:24:38.001774+0000","last_fullsized":"2024-09-21T03:24:38.001774+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.014753+0000","last_change":"2024-09-21T03:24:38.011098+0000","last_active":"2024-09-21T03:24:38.014753+0000","last_peered":"2024-09-21T03:24:38.014753+0000","last_clean":"2024-09-21T03:24:38.014753+0000","last_became_active":"2024-09-21T03:24:38.010775+0000","last_became_peered":"2024-09-21T03:24:38.010775+0000","last_unstale":"2024-09-21T03:24:38.014753+0000","last_undegraded":"2024-09-21T03:24:38.014753+0000","last_fullsized":"2024-09-21T03:24:38.014753+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:07.330132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.001499+0000","last_change":"2024-09-21T03:24:38.001499+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.001499+0000","last_undegraded":"2024-09-21T03:24:38.001499+0000","last_fullsized":"2024-09-21T03:24:38.001499+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.013734+0000","last_change":"2024-09-21T03:24:38.012254+0000","last_active":"2024-09-21T03:24:38.013734+0000","last_peered":"2024-09-21T03:24:38.013734+0000","last_clean":"2024-09-21T03:24:38.013734+0000","last_became_active":"2024-09-21T03:24:38.011372+0000","last_became_peered":"2024-09-21T03:24:38.011372+0000","last_unstale":"2024-09-21T03:24:38.013734+0000","last_undegraded":"2024-09-21T03:24:38.013734+0000","last_fullsized":"2024-09-21T03:24:38.013734+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:09:27.979140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.013455+0000","last_change":"2024-09-21T03:24:38.013455+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.013455+0000","last_undegraded":"2024-09-21T03:24:38.013455+0000","last_fullsized":"2024-09-21T03:24:38.013455+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.025174+0000","last_change":"2024-09-21T03:24:38.024584+0000","last_active":"2024-09-21T03:24:38.025174+0000","last_peered":"2024-09-21T03:24:38.025174+0000","last_clean":"2024-09-21T03:24:38.025174+0000","last_became_active":"2024-09-21T03:24:38.024237+0000","last_became_peered":"2024-09-21T03:24:38.024237+0000","last_unstale":"2024-09-21T03:24:38.025174+0000","last_undegraded":"2024-09-21T03:24:38.025174+0000","last_fullsized":"2024-09-21T03:24:38.025174+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:11:04.742300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:37.997604+0000","last_change":"2024-09-21T03:24:37.997604+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.997604+0000","last_undegraded":"2024-09-21T03:24:37.997604+0000","last_fullsized":"2024-09-21T03:24:37.997604+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.012184+0000","last_change":"2024-09-21T03:24:38.006652+0000","last_active":"2024-09-21T03:24:38.012184+0000","last_peered":"2024-09-21T03:24:38.012184+0000","last_clean":"2024-09-21T03:24:38.012184+0000","last_became_active":"2024-09-21T03:24:38.006287+0000","last_became_peered":"2024-09-21T03:24:38.006287+0000","last_unstale":"2024-09-21T03:24:38.012184+0000","last_undegraded":"2024-09-21T03:24:38.012184+0000","last_fullsized":"2024-09-21T03:24:38.012184+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:05.098529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003029+0000","last_change":"2024-09-21T03:24:38.003029+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003029+0000","last_undegraded":"2024-09-21T03:24:38.003029+0000","last_fullsized":"2024-09-21T03:24:38.003029+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.023856+0000","last_change":"2024-09-21T03:24:38.020494+0000","last_active":"2024-09-21T03:24:38.023856+0000","last_peered":"2024-09-21T03:24:38.023856+0000","last_clean":"2024-09-21T03:24:38.023856+0000","last_became_active":"2024-09-21T03:24:38.019461+0000","last_became_peered":"2024-09-21T03:24:38.019461+0000","last_unstale":"2024-09-21T03:24:38.023856+0000","last_undegraded":"2024-09-21T03:24:38.023856+0000","last_fullsized":"2024-09-21T03:24:38.023856+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:02.623575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.004869+0000","last_change":"2024-09-21T03:24:38.004869+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.004869+0000","last_undegraded":"2024-09-21T03:24:38.004869+0000","last_fullsized":"2024-09-21T03:24:38.004869+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.014683+0000","last_change":"2024-09-21T03:24:38.009947+0000","last_active":"2024-09-21T03:24:38.014683+0000","last_peered":"2024-09-21T03:24:38.014683+0000","last_clean":"2024-09-21T03:24:38.014683+0000","last_became_active":"2024-09-21T03:24:38.009587+0000","last_became_peered":"2024-09-21T03:24:38.009587+0000","last_unstale":"2024-09-21T03:24:38.014683+0000","last_undegraded":"2024-09-21T03:24:38.014683+0000","last_fullsized":"2024-09-21T03:24:38.014683+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:52.734164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003114+0000","last_change":"2024-09-21T03:24:38.003114+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003114+0000","last_undegraded":"2024-09-21T03:24:38.003114+0000","last_fullsized":"2024-09-21T03:24:38.003114+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.014314+0000","last_change":"2024-09-21T03:24:38.010166+0000","last_active":"2024-09-21T03:24:38.014314+0000","last_peered":"2024-09-21T03:24:38.014314+0000","last_clean":"2024-09-21T03:24:38.014314+0000","last_became_active":"2024-09-21T03:24:38.009774+0000","last_became_peered":"2024-09-21T03:24:38.009774+0000","last_unstale":"2024-09-21T03:24:38.014314+0000","last_undegraded":"2024-09-21T03:24:38.014314+0000","last_fullsized":"2024-09-21T03:24:38.014314+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:05:48.407790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.000756+0000","last_change":"2024-09-21T03:24:38.000756+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.000756+0000","last_undegraded":"2024-09-21T03:24:38.000756+0000","last_fullsized":"2024-09-21T03:24:38.000756+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.013025+0000","last_change":"2024-09-21T03:24:38.013762+0000","last_active":"2024-09-21T03:24:40.013025+0000","last_peered":"2024-09-21T03:24:40.013025+0000","last_clean":"2024-09-21T03:24:40.013025+0000","last_became_active":"2024-09-21T03:24:38.013455+0000","last_became_peered":"2024-09-21T03:24:38.013455+0000","last_unstale":"2024-09-21T03:24:40.013025+0000","last_undegraded":"2024-09-21T03:24:40.013025+0000","last_fullsized":"2024-09-21T03:24:40.013025+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:26.681911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.006035+0000","last_change":"2024-09-21T03:24:38.006035+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.006035+0000","last_undegraded":"2024-09-21T03:24:38.006035+0000","last_fullsized":"2024-09-21T03:24:38.006035+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"92'2","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.013020+0000","last_change":"2024-09-21T03:24:38.014934+0000","last_active":"2024-09-21T03:24:40.013020+0000","last_peered":"2024-09-21T03:24:40.013020+0000","last_clean":"2024-09-21T03:24:40.013020+0000","last_became_active":"2024-09-21T03:24:38.014613+0000","last_became_peered":"2024-09-21T03:24:38.014613+0000","last_unstale":"2024-09-21T03:24:40.013020+0000","last_undegraded":"2024-09-21T03:24:40.013020+0000","last_fullsized":"2024-09-21T03:24:40.013020+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:27.000670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.003049+0000","last_change":"2024-09-21T03:24:38.003049+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.003049+0000","last_undegraded":"2024-09-21T03:24:38.003049+0000","last_fullsized":"2024-09-21T03:24:38.003049+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.023296+0000","last_change":"2024-09-21T03:24:38.020820+0000","last_active":"2024-09-21T03:24:38.023296+0000","last_peered":"2024-09-21T03:24:38.023296+0000","last_clean":"2024-09-21T03:24:38.023296+0000","last_became_active":"2024-09-21T03:24:38.020470+0000","last_became_peered":"2024-09-21T03:24:38.020470+0000","last_unstale":"2024-09-21T03:24:38.023296+0000","last_undegraded":"2024-09-21T03:24:38.023296+0000","last_fullsized":"2024-09-21T03:24:38.023296+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:07.330132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.004963+0000","last_change":"2024-09-21T03:24:38.004963+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.004963+0000","last_undegraded":"2024-09-21T03:24:38.004963+0000","last_fullsized":"2024-09-21T03:24:38.004963+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.017363+0000","last_change":"2024-09-21T03:24:38.012506+0000","last_active":"2024-09-21T03:24:38.017363+0000","last_peered":"2024-09-21T03:24:38.017363+0000","last_clean":"2024-09-21T03:24:38.017363+0000","last_became_active":"2024-09-21T03:24:38.012187+0000","last_became_peered":"2024-09-21T03:24:38.012187+0000","last_unstale":"2024-09-21T03:24:38.017363+0000","last_undegraded":"2024-09-21T03:24:38.017363+0000","last_fullsized":"2024-09-21T03:24:38.017363+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:52.734164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.002421+0000","last_change":"2024-09-21T03:24:38.002421+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.002421+0000","last_undegraded":"2024-09-21T03:24:38.002421+0000","last_fullsized":"2024-09-21T03:24:38.002421+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.012694+0000","last_change":"2024-09-21T03:24:38.022079+0000","last_active":"2024-09-21T03:24:40.012694+0000","last_peered":"2024-09-21T03:24:40.012694+0000","last_clean":"2024-09-21T03:24:40.012694+0000","last_became_active":"2024-09-21T03:24:38.021757+0000","last_became_peered":"2024-09-21T03:24:38.021757+0000","last_unstale":"2024-09-21T03:24:40.012694+0000","last_undegraded":"2024-09-21T03:24:40.012694+0000","last_fullsized":"2024-09-21T03:24:40.012694+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:41:36.864607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.013484+0000","last_change":"2024-09-21T03:24:39.029954+0000","last_active":"2024-09-21T03:24:40.013484+0000","last_peered":"2024-09-21T03:24:40.013484+0000","last_clean":"2024-09-21T03:24:40.013484+0000","last_became_active":"2024-09-21T03:24:39.029648+0000","last_became_peered":"2024-09-21T03:24:39.029648+0000","last_unstale":"2024-09-21T03:24:40.013484+0000","last_undegraded":"2024-09-21T03:24:40.013484+0000","last_fullsized":"2024-09-21T03:24:40.013484+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:55.774659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.014607+0000","last_change":"2024-09-21T03:24:38.010449+0000","last_active":"2024-09-21T03:24:38.014607+0000","last_peered":"2024-09-21T03:24:38.014607+0000","last_clean":"2024-09-21T03:24:38.014607+0000","last_became_active":"2024-09-21T03:24:38.010079+0000","last_became_peered":"2024-09-21T03:24:38.010079+0000","last_unstale":"2024-09-21T03:24:38.014607+0000","last_undegraded":"2024-09-21T03:24:38.014607+0000","last_fullsized":"2024-09-21T03:24:38.014607+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:05.098529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.008511+0000","last_change":"2024-09-21T03:24:38.008511+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.008511+0000","last_undegraded":"2024-09-21T03:24:38.008511+0000","last_fullsized":"2024-09-21T03:24:38.008511+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"92'1","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.013378+0000","last_change":"2024-09-21T03:24:38.015200+0000","last_active":"2024-09-21T03:24:40.013378+0000","last_peered":"2024-09-21T03:24:40.013378+0000","last_clean":"2024-09-21T03:24:40.013378+0000","last_became_active":"2024-09-21T03:24:38.014843+0000","last_became_peered":"2024-09-21T03:24:38.014843+0000","last_unstale":"2024-09-21T03:24:40.013378+0000","last_undegraded":"2024-09-21T03:24:40.013378+0000","last_fullsized":"2024-09-21T03:24:40.013378+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:29.367833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.009699+0000","last_change":"2024-09-21T03:24:38.009699+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.009699+0000","last_undegraded":"2024-09-21T03:24:38.009699+0000","last_fullsized":"2024-09-21T03:24:38.009699+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.013139+0000","last_change":"2024-09-21T03:24:38.010800+0000","last_active":"2024-09-21T03:24:40.013139+0000","last_peered":"2024-09-21T03:24:40.013139+0000","last_clean":"2024-09-21T03:24:40.013139+0000","last_became_active":"2024-09-21T03:24:38.010478+0000","last_became_peered":"2024-09-21T03:24:38.010478+0000","last_unstale":"2024-09-21T03:24:40.013139+0000","last_undegraded":"2024-09-21T03:24:40.013139+0000","last_fullsized":"2024-09-21T03:24:40.013139+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:12.070978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.001353+0000","last_change":"2024-09-21T03:24:38.001353+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.001353+0000","last_undegraded":"2024-09-21T03:24:38.001353+0000","last_fullsized":"2024-09-21T03:24:38.001353+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.009636+0000","last_change":"2024-09-21T03:24:38.008647+0000","last_active":"2024-09-21T03:24:38.009636+0000","last_peered":"2024-09-21T03:24:38.009636+0000","last_clean":"2024-09-21T03:24:38.009636+0000","last_became_active":"2024-09-21T03:24:38.008243+0000","last_became_peered":"2024-09-21T03:24:38.008243+0000","last_unstale":"2024-09-21T03:24:38.009636+0000","last_undegraded":"2024-09-21T03:24:38.009636+0000","last_fullsized":"2024-09-21T03:24:38.009636+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:07.016728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.005410+0000","last_change":"2024-09-21T03:24:38.005410+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.005410+0000","last_undegraded":"2024-09-21T03:24:38.005410+0000","last_fullsized":"2024-09-21T03:24:38.005410+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.013125+0000","last_change":"2024-09-21T03:24:38.012316+0000","last_active":"2024-09-21T03:24:40.013125+0000","last_peered":"2024-09-21T03:24:40.013125+0000","last_clean":"2024-09-21T03:24:40.013125+0000","last_became_active":"2024-09-21T03:24:38.012027+0000","last_became_peered":"2024-09-21T03:24:38.012027+0000","last_unstale":"2024-09-21T03:24:40.013125+0000","last_undegraded":"2024-09-21T03:24:40.013125+0000","last_fullsized":"2024-09-21T03:24:40.013125+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:17.738117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:37.997676+0000","last_change":"2024-09-21T03:24:37.997676+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:37.997676+0000","last_undegraded":"2024-09-21T03:24:37.997676+0000","last_fullsized":"2024-09-21T03:24:37.997676+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.023348+0000","last_change":"2024-09-21T03:24:38.022179+0000","last_active":"2024-09-21T03:24:38.023348+0000","last_peered":"2024-09-21T03:24:38.023348+0000","last_clean":"2024-09-21T03:24:38.023348+0000","last_became_active":"2024-09-21T03:24:38.021893+0000","last_became_peered":"2024-09-21T03:24:38.021893+0000","last_unstale":"2024-09-21T03:24:38.023348+0000","last_undegraded":"2024-09-21T03:24:38.023348+0000","last_fullsized":"2024-09-21T03:24:38.023348+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:12.129049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.004467+0000","last_change":"2024-09-21T03:24:38.004467+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.004467+0000","last_undegraded":"2024-09-21T03:24:38.004467+0000","last_fullsized":"2024-09-21T03:24:38.004467+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.023870+0000","last_change":"2024-09-21T03:24:38.020153+0000","last_active":"2024-09-21T03:24:38.023870+0000","last_peered":"2024-09-21T03:24:38.023870+0000","last_clean":"2024-09-21T03:24:38.023870+0000","last_became_active":"2024-09-21T03:24:38.019792+0000","last_became_peered":"2024-09-21T03:24:38.019792+0000","last_unstale":"2024-09-21T03:24:38.023870+0000","last_undegraded":"2024-09-21T03:24:38.023870+0000","last_fullsized":"2024-09-21T03:24:38.023870+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:57:25.908182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.001944+0000","last_change":"2024-09-21T03:24:38.001944+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.001944+0000","last_undegraded":"2024-09-21T03:24:38.001944+0000","last_fullsized":"2024-09-21T03:24:38.001944+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.021398+0000","last_change":"2024-09-21T03:24:38.017820+0000","last_active":"2024-09-21T03:24:38.021398+0000","last_peered":"2024-09-21T03:24:38.021398+0000","last_clean":"2024-09-21T03:24:38.021398+0000","last_became_active":"2024-09-21T03:24:38.017280+0000","last_became_peered":"2024-09-21T03:24:38.017280+0000","last_unstale":"2024-09-21T03:24:38.021398+0000","last_undegraded":"2024-09-21T03:24:38.021398+0000","last_fullsized":"2024-09-21T03:24:38.021398+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:31:14.545857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-21T03:24:38.002984+0000","last_change":"2024-09-21T03:24:38.002984+0000","last_active":"2024-09-21T03:24:37.988740+0000","last_peered":"2024-09-21T03:24:37.988740+0000","last_clean":"2024-09-21T03:24:37.988740+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:24:38.002984+0000","last_undegraded":"2024-09-21T03:24:38.002984+0000","last_fullsized":"2024-09-21T03:24:38.002984+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:38.014481+0000","last_change":"2024-09-21T03:24:38.009806+0000","last_active":"2024-09-21T03:24:38.014481+0000","last_peered":"2024-09-21T03:24:38.014481+0000","last_clean":"2024-09-21T03:24:38.014481+0000","last_became_active":"2024-09-21T03:24:38.009384+0000","last_became_peered":"2024-09-21T03:24:38.009384+0000","last_unstale":"2024-09-21T03:24:38.014481+0000","last_undegraded":"2024-09-21T03:24:38.014481+0000","last_fullsized":"2024-09-21T03:24:38.014481+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:52:46.248335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":242,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-21T03:24:37.998420+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:24:37.998420+0000","last_peered":"2024-09-21T03:24:37.998420+0000","last_clean":"2024-09-21T03:24:37.998420+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:24:37.998420+0000","last_undegraded":"2024-09-21T03:24:37.998420+0000","last_fullsized":"2024-09-21T03:24:37.998420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509521,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32864,"kb_used_data":1672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338976,"statfs":{"total":96636764160,"available":96603111424,"internally_reserved":0,"allocated":1712128,"data_stored":1060484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509520,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1118208,"data_stored":470116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509519,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1118208,"data_stored":470116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509519,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1105920,"data_stored":463841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509520,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1118208,"data_stored":470116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509520,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1118208,"data_stored":470116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509520,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1118208,"data_stored":470116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32892,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338948,"statfs":{"total":96636764160,"available":96603082752,"internally_reserved":0,"allocated":1740800,"data_stored":1074141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:24:47.482 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:24:47.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.608+0000 7fd2887da640 1 -- 172.21.15.105:0/4046035001 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2800cad30 msgr2=0x7fd2800735b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:47.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.608+0000 7fd2887da640 1 --2- 172.21.15.105:0/4046035001 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2800cad30 0x7fd2800735b0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fd28009e2e0 tx=0x7fd27802a8b0 comp rx=0 tx=0).stop 2024-09-21T03:24:47.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.608+0000 7fd2887da640 1 -- 172.21.15.105:0/4046035001 shutdown_connections 2024-09-21T03:24:47.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.608+0000 7fd2887da640 1 --2- 172.21.15.105:0/4046035001 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2800cad30 0x7fd2800735b0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:47.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.608+0000 7fd2887da640 1 --2- 172.21.15.105:0/4046035001 >> v2:172.21.15.162:3300/0 conn(0x7fd2800706b0 0x7fd2800cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:47.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.608+0000 7fd2887da640 1 -- 172.21.15.105:0/4046035001 >> 172.21.15.105:0/4046035001 conn(0x7fd2800b1cb0 msgr2=0x7fd2800b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:47.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.608+0000 7fd2887da640 1 -- 172.21.15.105:0/4046035001 shutdown_connections 2024-09-21T03:24:47.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.608+0000 7fd2887da640 1 -- 172.21.15.105:0/4046035001 wait complete. 2024-09-21T03:24:47.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.610+0000 7fd2887da640 1 Processor -- start 2024-09-21T03:24:47.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.610+0000 7fd2887da640 1 -- start start 2024-09-21T03:24:47.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.611+0000 7fd2887da640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2800ca800 0x7fd2801f2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:47.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.611+0000 7fd2887da640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2800cad30 0x7fd2801f63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:47.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.611+0000 7fd2887da640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd280151a30 0x7fd2801f6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:47.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.611+0000 7fd2887da640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd280073ec0 con 0x7fd2800ca800 2024-09-21T03:24:47.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.611+0000 7fd2887da640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd280073d40 con 0x7fd280151a30 2024-09-21T03:24:47.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.611+0000 7fd2887da640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd280074040 con 0x7fd2800cad30 2024-09-21T03:24:47.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.611+0000 7fd286576640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2800ca800 0x7fd2801f2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:47.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.611+0000 7fd286576640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2800ca800 0x7fd2801f2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:60574/0 (socket says 172.21.15.105:60574) 2024-09-21T03:24:47.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.611+0000 7fd286576640 1 -- 172.21.15.105:0/3169090418 learned_addr learned my addr 172.21.15.105:0/3169090418 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:47.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.611+0000 7fd286d77640 1 --2- 172.21.15.105:0/3169090418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd280151a30 0x7fd2801f6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:47.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.611+0000 7fd285d75640 1 --2- 172.21.15.105:0/3169090418 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2800cad30 0x7fd2801f63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:47.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.611+0000 7fd286576640 1 -- 172.21.15.105:0/3169090418 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2800cad30 msgr2=0x7fd2801f63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:47.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.611+0000 7fd286576640 1 --2- 172.21.15.105:0/3169090418 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2800cad30 0x7fd2801f63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:47.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.611+0000 7fd286576640 1 -- 172.21.15.105:0/3169090418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd280151a30 msgr2=0x7fd2801f6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:47.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.611+0000 7fd286576640 1 --2- 172.21.15.105:0/3169090418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd280151a30 0x7fd2801f6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:47.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.611+0000 7fd286576640 1 -- 172.21.15.105:0/3169090418 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd28009c700 con 0x7fd2800ca800 2024-09-21T03:24:47.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.612+0000 7fd286576640 1 --2- 172.21.15.105:0/3169090418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2800ca800 0x7fd2801f2560 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fd27c00c3c0 tx=0x7fd27c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:47.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.612+0000 7fd276ffd640 1 -- 172.21.15.105:0/3169090418 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd27c017070 con 0x7fd2800ca800 2024-09-21T03:24:47.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.612+0000 7fd276ffd640 1 -- 172.21.15.105:0/3169090418 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd27c0035f0 con 0x7fd2800ca800 2024-09-21T03:24:47.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.612+0000 7fd2887da640 1 -- 172.21.15.105:0/3169090418 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd28009be60 con 0x7fd2800ca800 2024-09-21T03:24:47.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.612+0000 7fd276ffd640 1 -- 172.21.15.105:0/3169090418 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd27c003a20 con 0x7fd2800ca800 2024-09-21T03:24:47.616 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.612+0000 7fd2887da640 1 -- 172.21.15.105:0/3169090418 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd28009c420 con 0x7fd2800ca800 2024-09-21T03:24:47.616 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.613+0000 7fd2887da640 1 -- 172.21.15.105:0/3169090418 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2800745d0 con 0x7fd2800ca800 2024-09-21T03:24:47.617 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.614+0000 7fd276ffd640 1 -- 172.21.15.105:0/3169090418 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd27c01a070 con 0x7fd2800ca800 2024-09-21T03:24:47.617 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.614+0000 7fd276ffd640 1 --2- 172.21.15.105:0/3169090418 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd264078b90 0x7fd26407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:47.617 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.614+0000 7fd276ffd640 1 -- 172.21.15.105:0/3169090418 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7fd27c099e80 con 0x7fd2800ca800 2024-09-21T03:24:47.617 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.614+0000 7fd285d75640 1 --2- 172.21.15.105:0/3169090418 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd264078b90 0x7fd26407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:47.617 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.615+0000 7fd285d75640 1 --2- 172.21.15.105:0/3169090418 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd264078b90 0x7fd26407b0a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd2700058c0 tx=0x7fd27000c440 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:47.620 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.619+0000 7fd276ffd640 1 -- 172.21.15.105:0/3169090418 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd27c0623e0 con 0x7fd2800ca800 2024-09-21T03:24:47.794 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.792+0000 7fd2887da640 1 -- 172.21.15.105:0/3169090418 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd28009dfc0 con 0x7fd264078b90 2024-09-21T03:24:47.798 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.797+0000 7fd276ffd640 1 -- 172.21.15.105:0/3169090418 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252063 (secure 0 0 0) 0x7fd28009dfc0 con 0x7fd264078b90 2024-09-21T03:24:47.801 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:24:47.802 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:24:47.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.801+0000 7fd2887da640 1 -- 172.21.15.105:0/3169090418 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd264078b90 msgr2=0x7fd26407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:47.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.801+0000 7fd2887da640 1 --2- 172.21.15.105:0/3169090418 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd264078b90 0x7fd26407b0a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd2700058c0 tx=0x7fd27000c440 comp rx=0 tx=0).stop 2024-09-21T03:24:47.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.801+0000 7fd2887da640 1 -- 172.21.15.105:0/3169090418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2800ca800 msgr2=0x7fd2801f2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:47.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.801+0000 7fd2887da640 1 --2- 172.21.15.105:0/3169090418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2800ca800 0x7fd2801f2560 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fd27c00c3c0 tx=0x7fd27c00c880 comp rx=0 tx=0).stop 2024-09-21T03:24:47.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.801+0000 7fd2887da640 1 -- 172.21.15.105:0/3169090418 shutdown_connections 2024-09-21T03:24:47.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.801+0000 7fd2887da640 1 --2- 172.21.15.105:0/3169090418 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd264078b90 0x7fd26407b0a0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:47.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.801+0000 7fd2887da640 1 --2- 172.21.15.105:0/3169090418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd280151a30 0x7fd2801f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:47.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.801+0000 7fd2887da640 1 --2- 172.21.15.105:0/3169090418 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2800cad30 0x7fd2801f63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:47.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.801+0000 7fd2887da640 1 --2- 172.21.15.105:0/3169090418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2800ca800 0x7fd2801f2560 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:47.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.801+0000 7fd2887da640 1 -- 172.21.15.105:0/3169090418 >> 172.21.15.105:0/3169090418 conn(0x7fd2800b1cb0 msgr2=0x7fd2800acf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:47.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.801+0000 7fd2887da640 1 -- 172.21.15.105:0/3169090418 shutdown_connections 2024-09-21T03:24:47.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.801+0000 7fd2887da640 1 -- 172.21.15.105:0/3169090418 wait complete. 2024-09-21T03:24:47.814 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":282,"stamp":"2024-09-21T03:24:47.381002+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259672,"kb_used_data":10152,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715048,"statfs":{"total":773094113280,"available":772828209152,"internally_reserved":0,"allocated":10395648,"data_stored":5051084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.383578"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.818471+0000","last_change":"2024-09-21T03:24:39.014172+0000","last_active":"2024-09-21T03:24:40.818471+0000","last_peered":"2024-09-21T03:24:40.818471+0000","last_clean":"2024-09-21T03:24:40.818471+0000","last_became_active":"2024-09-21T03:24:39.013870+0000","last_became_peered":"2024-09-21T03:24:39.013870+0000","last_unstale":"2024-09-21T03:24:40.818471+0000","last_undegraded":"2024-09-21T03:24:40.818471+0000","last_fullsized":"2024-09-21T03:24:40.818471+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:40.102713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.013059+0000","last_change":"2024-09-21T03:24:39.030988+0000","last_active":"2024-09-21T03:24:40.013059+0000","last_peered":"2024-09-21T03:24:40.013059+0000","last_clean":"2024-09-21T03:24:40.013059+0000","last_became_active":"2024-09-21T03:24:39.030685+0000","last_became_peered":"2024-09-21T03:24:39.030685+0000","last_unstale":"2024-09-21T03:24:40.013059+0000","last_undegraded":"2024-09-21T03:24:40.013059+0000","last_fullsized":"2024-09-21T03:24:40.013059+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:19:30.830696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.819151+0000","last_change":"2024-09-21T03:24:39.015022+0000","last_active":"2024-09-21T03:24:40.819151+0000","last_peered":"2024-09-21T03:24:40.819151+0000","last_clean":"2024-09-21T03:24:40.819151+0000","last_became_active":"2024-09-21T03:24:39.014679+0000","last_became_peered":"2024-09-21T03:24:39.014679+0000","last_unstale":"2024-09-21T03:24:40.819151+0000","last_undegraded":"2024-09-21T03:24:40.819151+0000","last_fullsized":"2024-09-21T03:24:40.819151+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:21.441089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.819151+0000","last_change":"2024-09-21T03:24:39.027032+0000","last_active":"2024-09-21T03:24:40.819151+0000","last_peered":"2024-09-21T03:24:40.819151+0000","last_clean":"2024-09-21T03:24:40.819151+0000","last_became_active":"2024-09-21T03:24:39.026686+0000","last_became_peered":"2024-09-21T03:24:39.026686+0000","last_unstale":"2024-09-21T03:24:40.819151+0000","last_undegraded":"2024-09-21T03:24:40.819151+0000","last_fullsized":"2024-09-21T03:24:40.819151+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:32.298290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.016259+0000","last_change":"2024-09-21T03:24:39.021050+0000","last_active":"2024-09-21T03:24:40.016259+0000","last_peered":"2024-09-21T03:24:40.016259+0000","last_clean":"2024-09-21T03:24:40.016259+0000","last_became_active":"2024-09-21T03:24:39.020593+0000","last_became_peered":"2024-09-21T03:24:39.020593+0000","last_unstale":"2024-09-21T03:24:40.016259+0000","last_undegraded":"2024-09-21T03:24:40.016259+0000","last_fullsized":"2024-09-21T03:24:40.016259+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:38.111860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.817630+0000","last_change":"2024-09-21T03:24:39.015878+0000","last_active":"2024-09-21T03:24:40.817630+0000","last_peered":"2024-09-21T03:24:40.817630+0000","last_clean":"2024-09-21T03:24:40.817630+0000","last_became_active":"2024-09-21T03:24:39.015550+0000","last_became_peered":"2024-09-21T03:24:39.015550+0000","last_unstale":"2024-09-21T03:24:40.817630+0000","last_undegraded":"2024-09-21T03:24:40.817630+0000","last_fullsized":"2024-09-21T03:24:40.817630+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:56.891253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.817400+0000","last_change":"2024-09-21T03:24:39.015576+0000","last_active":"2024-09-21T03:24:40.817400+0000","last_peered":"2024-09-21T03:24:40.817400+0000","last_clean":"2024-09-21T03:24:40.817400+0000","last_became_active":"2024-09-21T03:24:39.015261+0000","last_became_peered":"2024-09-21T03:24:39.015261+0000","last_unstale":"2024-09-21T03:24:40.817400+0000","last_undegraded":"2024-09-21T03:24:40.817400+0000","last_fullsized":"2024-09-21T03:24:40.817400+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:29:43.056802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.012650+0000","last_change":"2024-09-21T03:24:39.023580+0000","last_active":"2024-09-21T03:24:40.012650+0000","last_peered":"2024-09-21T03:24:40.012650+0000","last_clean":"2024-09-21T03:24:40.012650+0000","last_became_active":"2024-09-21T03:24:39.023204+0000","last_became_peered":"2024-09-21T03:24:39.023204+0000","last_unstale":"2024-09-21T03:24:40.012650+0000","last_undegraded":"2024-09-21T03:24:40.012650+0000","last_fullsized":"2024-09-21T03:24:40.012650+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:24.160293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.017426+0000","last_change":"2024-09-21T03:24:39.020868+0000","last_active":"2024-09-21T03:24:40.017426+0000","last_peered":"2024-09-21T03:24:40.017426+0000","last_clean":"2024-09-21T03:24:40.017426+0000","last_became_active":"2024-09-21T03:24:39.020524+0000","last_became_peered":"2024-09-21T03:24:39.020524+0000","last_unstale":"2024-09-21T03:24:40.017426+0000","last_undegraded":"2024-09-21T03:24:40.017426+0000","last_fullsized":"2024-09-21T03:24:40.017426+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:50.413593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.016451+0000","last_change":"2024-09-21T03:24:39.012213+0000","last_active":"2024-09-21T03:24:40.016451+0000","last_peered":"2024-09-21T03:24:40.016451+0000","last_clean":"2024-09-21T03:24:40.016451+0000","last_became_active":"2024-09-21T03:24:39.011808+0000","last_became_peered":"2024-09-21T03:24:39.011808+0000","last_unstale":"2024-09-21T03:24:40.016451+0000","last_undegraded":"2024-09-21T03:24:40.016451+0000","last_fullsized":"2024-09-21T03:24:40.016451+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:23:01.032228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.818225+0000","last_change":"2024-09-21T03:24:39.008909+0000","last_active":"2024-09-21T03:24:40.818225+0000","last_peered":"2024-09-21T03:24:40.818225+0000","last_clean":"2024-09-21T03:24:40.818225+0000","last_became_active":"2024-09-21T03:24:39.008497+0000","last_became_peered":"2024-09-21T03:24:39.008497+0000","last_unstale":"2024-09-21T03:24:40.818225+0000","last_undegraded":"2024-09-21T03:24:40.818225+0000","last_fullsized":"2024-09-21T03:24:40.818225+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:21:09.429100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.016629+0000","last_change":"2024-09-21T03:24:39.012255+0000","last_active":"2024-09-21T03:24:40.016629+0000","last_peered":"2024-09-21T03:24:40.016629+0000","last_clean":"2024-09-21T03:24:40.016629+0000","last_became_active":"2024-09-21T03:24:39.011863+0000","last_became_peered":"2024-09-21T03:24:39.011863+0000","last_unstale":"2024-09-21T03:24:40.016629+0000","last_undegraded":"2024-09-21T03:24:40.016629+0000","last_fullsized":"2024-09-21T03:24:40.016629+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:59:10.362654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.818024+0000","last_change":"2024-09-21T03:24:39.022643+0000","last_active":"2024-09-21T03:24:40.818024+0000","last_peered":"2024-09-21T03:24:40.818024+0000","last_clean":"2024-09-21T03:24:40.818024+0000","last_became_active":"2024-09-21T03:24:39.022330+0000","last_became_peered":"2024-09-21T03:24:39.022330+0000","last_unstale":"2024-09-21T03:24:40.818024+0000","last_undegraded":"2024-09-21T03:24:40.818024+0000","last_fullsized":"2024-09-21T03:24:40.818024+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:45.416152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.291191+0000","last_change":"2024-09-21T03:24:39.016360+0000","last_active":"2024-09-21T03:24:40.291191+0000","last_peered":"2024-09-21T03:24:40.291191+0000","last_clean":"2024-09-21T03:24:40.291191+0000","last_became_active":"2024-09-21T03:24:39.016060+0000","last_became_peered":"2024-09-21T03:24:39.016060+0000","last_unstale":"2024-09-21T03:24:40.291191+0000","last_undegraded":"2024-09-21T03:24:40.291191+0000","last_fullsized":"2024-09-21T03:24:40.291191+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:27:09.686730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.817960+0000","last_change":"2024-09-21T03:24:39.027135+0000","last_active":"2024-09-21T03:24:40.817960+0000","last_peered":"2024-09-21T03:24:40.817960+0000","last_clean":"2024-09-21T03:24:40.817960+0000","last_became_active":"2024-09-21T03:24:39.026817+0000","last_became_peered":"2024-09-21T03:24:39.026817+0000","last_unstale":"2024-09-21T03:24:40.817960+0000","last_undegraded":"2024-09-21T03:24:40.817960+0000","last_fullsized":"2024-09-21T03:24:40.817960+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:59:21.270935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.817871+0000","last_change":"2024-09-21T03:24:39.024675+0000","last_active":"2024-09-21T03:24:40.817871+0000","last_peered":"2024-09-21T03:24:40.817871+0000","last_clean":"2024-09-21T03:24:40.817871+0000","last_became_active":"2024-09-21T03:24:39.024283+0000","last_became_peered":"2024-09-21T03:24:39.024283+0000","last_unstale":"2024-09-21T03:24:40.817871+0000","last_undegraded":"2024-09-21T03:24:40.817871+0000","last_fullsized":"2024-09-21T03:24:40.817871+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:26:34.337717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.013399+0000","last_change":"2024-09-21T03:24:39.032389+0000","last_active":"2024-09-21T03:24:40.013399+0000","last_peered":"2024-09-21T03:24:40.013399+0000","last_clean":"2024-09-21T03:24:40.013399+0000","last_became_active":"2024-09-21T03:24:39.032088+0000","last_became_peered":"2024-09-21T03:24:39.032088+0000","last_unstale":"2024-09-21T03:24:40.013399+0000","last_undegraded":"2024-09-21T03:24:40.013399+0000","last_fullsized":"2024-09-21T03:24:40.013399+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:20.478211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.818567+0000","last_change":"2024-09-21T03:24:39.026780+0000","last_active":"2024-09-21T03:24:40.818567+0000","last_peered":"2024-09-21T03:24:40.818567+0000","last_clean":"2024-09-21T03:24:40.818567+0000","last_became_active":"2024-09-21T03:24:39.026446+0000","last_became_peered":"2024-09-21T03:24:39.026446+0000","last_unstale":"2024-09-21T03:24:40.818567+0000","last_undegraded":"2024-09-21T03:24:40.818567+0000","last_fullsized":"2024-09-21T03:24:40.818567+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:00.807496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.291521+0000","last_change":"2024-09-21T03:24:39.019581+0000","last_active":"2024-09-21T03:24:40.291521+0000","last_peered":"2024-09-21T03:24:40.291521+0000","last_clean":"2024-09-21T03:24:40.291521+0000","last_became_active":"2024-09-21T03:24:39.019216+0000","last_became_peered":"2024-09-21T03:24:39.019216+0000","last_unstale":"2024-09-21T03:24:40.291521+0000","last_undegraded":"2024-09-21T03:24:40.291521+0000","last_fullsized":"2024-09-21T03:24:40.291521+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:00.250771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.016885+0000","last_change":"2024-09-21T03:24:39.020002+0000","last_active":"2024-09-21T03:24:40.016885+0000","last_peered":"2024-09-21T03:24:40.016885+0000","last_clean":"2024-09-21T03:24:40.016885+0000","last_became_active":"2024-09-21T03:24:39.019685+0000","last_became_peered":"2024-09-21T03:24:39.019685+0000","last_unstale":"2024-09-21T03:24:40.016885+0000","last_undegraded":"2024-09-21T03:24:40.016885+0000","last_fullsized":"2024-09-21T03:24:40.016885+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:04.491877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.291589+0000","last_change":"2024-09-21T03:24:39.027761+0000","last_active":"2024-09-21T03:24:40.291589+0000","last_peered":"2024-09-21T03:24:40.291589+0000","last_clean":"2024-09-21T03:24:40.291589+0000","last_became_active":"2024-09-21T03:24:39.027262+0000","last_became_peered":"2024-09-21T03:24:39.027262+0000","last_unstale":"2024-09-21T03:24:40.291589+0000","last_undegraded":"2024-09-21T03:24:40.291589+0000","last_fullsized":"2024-09-21T03:24:40.291589+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:02.138925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.012693+0000","last_change":"2024-09-21T03:24:39.029686+0000","last_active":"2024-09-21T03:24:40.012693+0000","last_peered":"2024-09-21T03:24:40.012693+0000","last_clean":"2024-09-21T03:24:40.012693+0000","last_became_active":"2024-09-21T03:24:39.025264+0000","last_became_peered":"2024-09-21T03:24:39.025264+0000","last_unstale":"2024-09-21T03:24:40.012693+0000","last_undegraded":"2024-09-21T03:24:40.012693+0000","last_fullsized":"2024-09-21T03:24:40.012693+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:31:34.867080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.012776+0000","last_change":"2024-09-21T03:24:39.020402+0000","last_active":"2024-09-21T03:24:40.012776+0000","last_peered":"2024-09-21T03:24:40.012776+0000","last_clean":"2024-09-21T03:24:40.012776+0000","last_became_active":"2024-09-21T03:24:39.020093+0000","last_became_peered":"2024-09-21T03:24:39.020093+0000","last_unstale":"2024-09-21T03:24:40.012776+0000","last_undegraded":"2024-09-21T03:24:40.012776+0000","last_fullsized":"2024-09-21T03:24:40.012776+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:07:49.387867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.818073+0000","last_change":"2024-09-21T03:24:39.010743+0000","last_active":"2024-09-21T03:24:40.818073+0000","last_peered":"2024-09-21T03:24:40.818073+0000","last_clean":"2024-09-21T03:24:40.818073+0000","last_became_active":"2024-09-21T03:24:39.010451+0000","last_became_peered":"2024-09-21T03:24:39.010451+0000","last_unstale":"2024-09-21T03:24:40.818073+0000","last_undegraded":"2024-09-21T03:24:40.818073+0000","last_fullsized":"2024-09-21T03:24:40.818073+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:19:05.795154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.016076+0000","last_change":"2024-09-21T03:24:39.031148+0000","last_active":"2024-09-21T03:24:40.016076+0000","last_peered":"2024-09-21T03:24:40.016076+0000","last_clean":"2024-09-21T03:24:40.016076+0000","last_became_active":"2024-09-21T03:24:39.030789+0000","last_became_peered":"2024-09-21T03:24:39.030789+0000","last_unstale":"2024-09-21T03:24:40.016076+0000","last_undegraded":"2024-09-21T03:24:40.016076+0000","last_fullsized":"2024-09-21T03:24:40.016076+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:49:53.481820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.013270+0000","last_change":"2024-09-21T03:24:39.028282+0000","last_active":"2024-09-21T03:24:40.013270+0000","last_peered":"2024-09-21T03:24:40.013270+0000","last_clean":"2024-09-21T03:24:40.013270+0000","last_became_active":"2024-09-21T03:24:39.027993+0000","last_became_peered":"2024-09-21T03:24:39.027993+0000","last_unstale":"2024-09-21T03:24:40.013270+0000","last_undegraded":"2024-09-21T03:24:40.013270+0000","last_fullsized":"2024-09-21T03:24:40.013270+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:07.763847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.818079+0000","last_change":"2024-09-21T03:24:39.024592+0000","last_active":"2024-09-21T03:24:40.818079+0000","last_peered":"2024-09-21T03:24:40.818079+0000","last_clean":"2024-09-21T03:24:40.818079+0000","last_became_active":"2024-09-21T03:24:39.024238+0000","last_became_peered":"2024-09-21T03:24:39.024238+0000","last_unstale":"2024-09-21T03:24:40.818079+0000","last_undegraded":"2024-09-21T03:24:40.818079+0000","last_fullsized":"2024-09-21T03:24:40.818079+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:01:06.711631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.017119+0000","last_change":"2024-09-21T03:24:39.021314+0000","last_active":"2024-09-21T03:24:40.017119+0000","last_peered":"2024-09-21T03:24:40.017119+0000","last_clean":"2024-09-21T03:24:40.017119+0000","last_became_active":"2024-09-21T03:24:39.020840+0000","last_became_peered":"2024-09-21T03:24:39.020840+0000","last_unstale":"2024-09-21T03:24:40.017119+0000","last_undegraded":"2024-09-21T03:24:40.017119+0000","last_fullsized":"2024-09-21T03:24:40.017119+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:42.811424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.013154+0000","last_change":"2024-09-21T03:24:39.024343+0000","last_active":"2024-09-21T03:24:40.013154+0000","last_peered":"2024-09-21T03:24:40.013154+0000","last_clean":"2024-09-21T03:24:40.013154+0000","last_became_active":"2024-09-21T03:24:39.024033+0000","last_became_peered":"2024-09-21T03:24:39.024033+0000","last_unstale":"2024-09-21T03:24:40.013154+0000","last_undegraded":"2024-09-21T03:24:40.013154+0000","last_fullsized":"2024-09-21T03:24:40.013154+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:54.404219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.291193+0000","last_change":"2024-09-21T03:24:39.013486+0000","last_active":"2024-09-21T03:24:40.291193+0000","last_peered":"2024-09-21T03:24:40.291193+0000","last_clean":"2024-09-21T03:24:40.291193+0000","last_became_active":"2024-09-21T03:24:39.013164+0000","last_became_peered":"2024-09-21T03:24:39.013164+0000","last_unstale":"2024-09-21T03:24:40.291193+0000","last_undegraded":"2024-09-21T03:24:40.291193+0000","last_fullsized":"2024-09-21T03:24:40.291193+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:20.830051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.818195+0000","last_change":"2024-09-21T03:24:39.025311+0000","last_active":"2024-09-21T03:24:40.818195+0000","last_peered":"2024-09-21T03:24:40.818195+0000","last_clean":"2024-09-21T03:24:40.818195+0000","last_became_active":"2024-09-21T03:24:39.023973+0000","last_became_peered":"2024-09-21T03:24:39.023973+0000","last_unstale":"2024-09-21T03:24:40.818195+0000","last_undegraded":"2024-09-21T03:24:40.818195+0000","last_fullsized":"2024-09-21T03:24:40.818195+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:46:09.322148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.817884+0000","last_change":"2024-09-21T03:24:39.027103+0000","last_active":"2024-09-21T03:24:40.817884+0000","last_peered":"2024-09-21T03:24:40.817884+0000","last_clean":"2024-09-21T03:24:40.817884+0000","last_became_active":"2024-09-21T03:24:39.026582+0000","last_became_peered":"2024-09-21T03:24:39.026582+0000","last_unstale":"2024-09-21T03:24:40.817884+0000","last_undegraded":"2024-09-21T03:24:40.817884+0000","last_fullsized":"2024-09-21T03:24:40.817884+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:05.926331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.291607+0000","last_change":"2024-09-21T03:24:39.014030+0000","last_active":"2024-09-21T03:24:40.291607+0000","last_peered":"2024-09-21T03:24:40.291607+0000","last_clean":"2024-09-21T03:24:40.291607+0000","last_became_active":"2024-09-21T03:24:39.013692+0000","last_became_peered":"2024-09-21T03:24:39.013692+0000","last_unstale":"2024-09-21T03:24:40.291607+0000","last_undegraded":"2024-09-21T03:24:40.291607+0000","last_fullsized":"2024-09-21T03:24:40.291607+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:28.982880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"92'4","reported_seq":19,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.013528+0000","last_change":"2024-09-21T03:24:38.015939+0000","last_active":"2024-09-21T03:24:40.013528+0000","last_peered":"2024-09-21T03:24:40.013528+0000","last_clean":"2024-09-21T03:24:40.013528+0000","last_became_active":"2024-09-21T03:24:38.015624+0000","last_became_peered":"2024-09-21T03:24:38.015624+0000","last_unstale":"2024-09-21T03:24:40.013528+0000","last_undegraded":"2024-09-21T03:24:40.013528+0000","last_fullsized":"2024-09-21T03:24:40.013528+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:36:17.535190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.818604+0000","last_change":"2024-09-21T03:24:39.022997+0000","last_active":"2024-09-21T03:24:40.818604+0000","last_peered":"2024-09-21T03:24:40.818604+0000","last_clean":"2024-09-21T03:24:40.818604+0000","last_became_active":"2024-09-21T03:24:39.022628+0000","last_became_peered":"2024-09-21T03:24:39.022628+0000","last_unstale":"2024-09-21T03:24:40.818604+0000","last_undegraded":"2024-09-21T03:24:40.818604+0000","last_fullsized":"2024-09-21T03:24:40.818604+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:01:06.711631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"92'1","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.817779+0000","last_change":"2024-09-21T03:24:38.019879+0000","last_active":"2024-09-21T03:24:40.817779+0000","last_peered":"2024-09-21T03:24:40.817779+0000","last_clean":"2024-09-21T03:24:40.817779+0000","last_became_active":"2024-09-21T03:24:38.019498+0000","last_became_peered":"2024-09-21T03:24:38.019498+0000","last_unstale":"2024-09-21T03:24:40.817779+0000","last_undegraded":"2024-09-21T03:24:40.817779+0000","last_fullsized":"2024-09-21T03:24:40.817779+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:40.902861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.818419+0000","last_change":"2024-09-21T03:24:39.017474+0000","last_active":"2024-09-21T03:24:40.818419+0000","last_peered":"2024-09-21T03:24:40.818419+0000","last_clean":"2024-09-21T03:24:40.818419+0000","last_became_active":"2024-09-21T03:24:39.017111+0000","last_became_peered":"2024-09-21T03:24:39.017111+0000","last_unstale":"2024-09-21T03:24:40.818419+0000","last_undegraded":"2024-09-21T03:24:40.818419+0000","last_fullsized":"2024-09-21T03:24:40.818419+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:40.637483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"92'2","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.013041+0000","last_change":"2024-09-21T03:24:38.014576+0000","last_active":"2024-09-21T03:24:40.013041+0000","last_peered":"2024-09-21T03:24:40.013041+0000","last_clean":"2024-09-21T03:24:40.013041+0000","last_became_active":"2024-09-21T03:24:38.014251+0000","last_became_peered":"2024-09-21T03:24:38.014251+0000","last_unstale":"2024-09-21T03:24:40.013041+0000","last_undegraded":"2024-09-21T03:24:40.013041+0000","last_fullsized":"2024-09-21T03:24:40.013041+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:14.129111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.016927+0000","last_change":"2024-09-21T03:24:39.018204+0000","last_active":"2024-09-21T03:24:40.016927+0000","last_peered":"2024-09-21T03:24:40.016927+0000","last_clean":"2024-09-21T03:24:40.016927+0000","last_became_active":"2024-09-21T03:24:39.017901+0000","last_became_peered":"2024-09-21T03:24:39.017901+0000","last_unstale":"2024-09-21T03:24:40.016927+0000","last_undegraded":"2024-09-21T03:24:40.016927+0000","last_fullsized":"2024-09-21T03:24:40.016927+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:09.073724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"92'2","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.012903+0000","last_change":"2024-09-21T03:24:38.014977+0000","last_active":"2024-09-21T03:24:40.012903+0000","last_peered":"2024-09-21T03:24:40.012903+0000","last_clean":"2024-09-21T03:24:40.012903+0000","last_became_active":"2024-09-21T03:24:38.014673+0000","last_became_peered":"2024-09-21T03:24:38.014673+0000","last_unstale":"2024-09-21T03:24:40.012903+0000","last_undegraded":"2024-09-21T03:24:40.012903+0000","last_fullsized":"2024-09-21T03:24:40.012903+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:16:19.513335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.817874+0000","last_change":"2024-09-21T03:24:39.016974+0000","last_active":"2024-09-21T03:24:40.817874+0000","last_peered":"2024-09-21T03:24:40.817874+0000","last_clean":"2024-09-21T03:24:40.817874+0000","last_became_active":"2024-09-21T03:24:39.016300+0000","last_became_peered":"2024-09-21T03:24:39.016300+0000","last_unstale":"2024-09-21T03:24:40.817874+0000","last_undegraded":"2024-09-21T03:24:40.817874+0000","last_fullsized":"2024-09-21T03:24:40.817874+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:43.263898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"92'1","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.818239+0000","last_change":"2024-09-21T03:24:38.020873+0000","last_active":"2024-09-21T03:24:40.818239+0000","last_peered":"2024-09-21T03:24:40.818239+0000","last_clean":"2024-09-21T03:24:40.818239+0000","last_became_active":"2024-09-21T03:24:38.020586+0000","last_became_peered":"2024-09-21T03:24:38.020586+0000","last_unstale":"2024-09-21T03:24:40.818239+0000","last_undegraded":"2024-09-21T03:24:40.818239+0000","last_fullsized":"2024-09-21T03:24:40.818239+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:44.355357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.817452+0000","last_change":"2024-09-21T03:24:39.009990+0000","last_active":"2024-09-21T03:24:40.817452+0000","last_peered":"2024-09-21T03:24:40.817452+0000","last_clean":"2024-09-21T03:24:40.817452+0000","last_became_active":"2024-09-21T03:24:39.009665+0000","last_became_peered":"2024-09-21T03:24:39.009665+0000","last_unstale":"2024-09-21T03:24:40.817452+0000","last_undegraded":"2024-09-21T03:24:40.817452+0000","last_fullsized":"2024-09-21T03:24:40.817452+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:40.961074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"92'1","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.012733+0000","last_change":"2024-09-21T03:24:38.020632+0000","last_active":"2024-09-21T03:24:40.012733+0000","last_peered":"2024-09-21T03:24:40.012733+0000","last_clean":"2024-09-21T03:24:40.012733+0000","last_became_active":"2024-09-21T03:24:38.020311+0000","last_became_peered":"2024-09-21T03:24:38.020311+0000","last_unstale":"2024-09-21T03:24:40.012733+0000","last_undegraded":"2024-09-21T03:24:40.012733+0000","last_fullsized":"2024-09-21T03:24:40.012733+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:43.226556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.817852+0000","last_change":"2024-09-21T03:24:39.021895+0000","last_active":"2024-09-21T03:24:40.817852+0000","last_peered":"2024-09-21T03:24:40.817852+0000","last_clean":"2024-09-21T03:24:40.817852+0000","last_became_active":"2024-09-21T03:24:39.021578+0000","last_became_peered":"2024-09-21T03:24:39.021578+0000","last_unstale":"2024-09-21T03:24:40.817852+0000","last_undegraded":"2024-09-21T03:24:40.817852+0000","last_fullsized":"2024-09-21T03:24:40.817852+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:42.811424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.016462+0000","last_change":"2024-09-21T03:24:38.015466+0000","last_active":"2024-09-21T03:24:40.016462+0000","last_peered":"2024-09-21T03:24:40.016462+0000","last_clean":"2024-09-21T03:24:40.016462+0000","last_became_active":"2024-09-21T03:24:38.015170+0000","last_became_peered":"2024-09-21T03:24:38.015170+0000","last_unstale":"2024-09-21T03:24:40.016462+0000","last_undegraded":"2024-09-21T03:24:40.016462+0000","last_fullsized":"2024-09-21T03:24:40.016462+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:02:56.373875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.015621+0000","last_change":"2024-09-21T03:24:39.017776+0000","last_active":"2024-09-21T03:24:40.015621+0000","last_peered":"2024-09-21T03:24:40.015621+0000","last_clean":"2024-09-21T03:24:40.015621+0000","last_became_active":"2024-09-21T03:24:39.017196+0000","last_became_peered":"2024-09-21T03:24:39.017196+0000","last_unstale":"2024-09-21T03:24:40.015621+0000","last_undegraded":"2024-09-21T03:24:40.015621+0000","last_fullsized":"2024-09-21T03:24:40.015621+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:21.815522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.817901+0000","last_change":"2024-09-21T03:24:38.024676+0000","last_active":"2024-09-21T03:24:40.817901+0000","last_peered":"2024-09-21T03:24:40.817901+0000","last_clean":"2024-09-21T03:24:40.817901+0000","last_became_active":"2024-09-21T03:24:38.024305+0000","last_became_peered":"2024-09-21T03:24:38.024305+0000","last_unstale":"2024-09-21T03:24:40.817901+0000","last_undegraded":"2024-09-21T03:24:40.817901+0000","last_fullsized":"2024-09-21T03:24:40.817901+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:17:33.876711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.013296+0000","last_change":"2024-09-21T03:24:39.024776+0000","last_active":"2024-09-21T03:24:40.013296+0000","last_peered":"2024-09-21T03:24:40.013296+0000","last_clean":"2024-09-21T03:24:40.013296+0000","last_became_active":"2024-09-21T03:24:39.024478+0000","last_became_peered":"2024-09-21T03:24:39.024478+0000","last_unstale":"2024-09-21T03:24:40.013296+0000","last_undegraded":"2024-09-21T03:24:40.013296+0000","last_fullsized":"2024-09-21T03:24:40.013296+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:55.518801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.818884+0000","last_change":"2024-09-21T03:24:38.019784+0000","last_active":"2024-09-21T03:24:40.818884+0000","last_peered":"2024-09-21T03:24:40.818884+0000","last_clean":"2024-09-21T03:24:40.818884+0000","last_became_active":"2024-09-21T03:24:38.019456+0000","last_became_peered":"2024-09-21T03:24:38.019456+0000","last_unstale":"2024-09-21T03:24:40.818884+0000","last_undegraded":"2024-09-21T03:24:40.818884+0000","last_fullsized":"2024-09-21T03:24:40.818884+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:45:41.565905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.017680+0000","last_change":"2024-09-21T03:24:39.019957+0000","last_active":"2024-09-21T03:24:40.017680+0000","last_peered":"2024-09-21T03:24:40.017680+0000","last_clean":"2024-09-21T03:24:40.017680+0000","last_became_active":"2024-09-21T03:24:39.018972+0000","last_became_peered":"2024-09-21T03:24:39.018972+0000","last_unstale":"2024-09-21T03:24:40.017680+0000","last_undegraded":"2024-09-21T03:24:40.017680+0000","last_fullsized":"2024-09-21T03:24:40.017680+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:08.376812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.818731+0000","last_change":"2024-09-21T03:24:38.011409+0000","last_active":"2024-09-21T03:24:40.818731+0000","last_peered":"2024-09-21T03:24:40.818731+0000","last_clean":"2024-09-21T03:24:40.818731+0000","last_became_active":"2024-09-21T03:24:38.011093+0000","last_became_peered":"2024-09-21T03:24:38.011093+0000","last_unstale":"2024-09-21T03:24:40.818731+0000","last_undegraded":"2024-09-21T03:24:40.818731+0000","last_fullsized":"2024-09-21T03:24:40.818731+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:57:33.459603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.017305+0000","last_change":"2024-09-21T03:24:39.025769+0000","last_active":"2024-09-21T03:24:40.017305+0000","last_peered":"2024-09-21T03:24:40.017305+0000","last_clean":"2024-09-21T03:24:40.017305+0000","last_became_active":"2024-09-21T03:24:39.025447+0000","last_became_peered":"2024-09-21T03:24:39.025447+0000","last_unstale":"2024-09-21T03:24:40.017305+0000","last_undegraded":"2024-09-21T03:24:40.017305+0000","last_fullsized":"2024-09-21T03:24:40.017305+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:59:21.270935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"92'3","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.818502+0000","last_change":"2024-09-21T03:24:38.010947+0000","last_active":"2024-09-21T03:24:40.818502+0000","last_peered":"2024-09-21T03:24:40.818502+0000","last_clean":"2024-09-21T03:24:40.818502+0000","last_became_active":"2024-09-21T03:24:38.010622+0000","last_became_peered":"2024-09-21T03:24:38.010622+0000","last_unstale":"2024-09-21T03:24:40.818502+0000","last_undegraded":"2024-09-21T03:24:40.818502+0000","last_fullsized":"2024-09-21T03:24:40.818502+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:03.489734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.818343+0000","last_change":"2024-09-21T03:24:39.032023+0000","last_active":"2024-09-21T03:24:40.818343+0000","last_peered":"2024-09-21T03:24:40.818343+0000","last_clean":"2024-09-21T03:24:40.818343+0000","last_became_active":"2024-09-21T03:24:39.031673+0000","last_became_peered":"2024-09-21T03:24:39.031673+0000","last_unstale":"2024-09-21T03:24:40.818343+0000","last_undegraded":"2024-09-21T03:24:40.818343+0000","last_fullsized":"2024-09-21T03:24:40.818343+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:55:40.982641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"92'6","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.017069+0000","last_change":"2024-09-21T03:24:38.011098+0000","last_active":"2024-09-21T03:24:40.017069+0000","last_peered":"2024-09-21T03:24:40.017069+0000","last_clean":"2024-09-21T03:24:40.017069+0000","last_became_active":"2024-09-21T03:24:38.010775+0000","last_became_peered":"2024-09-21T03:24:38.010775+0000","last_unstale":"2024-09-21T03:24:40.017069+0000","last_undegraded":"2024-09-21T03:24:40.017069+0000","last_fullsized":"2024-09-21T03:24:40.017069+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:21.394672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.818012+0000","last_change":"2024-09-21T03:24:39.015593+0000","last_active":"2024-09-21T03:24:40.818012+0000","last_peered":"2024-09-21T03:24:40.818012+0000","last_clean":"2024-09-21T03:24:40.818012+0000","last_became_active":"2024-09-21T03:24:39.015277+0000","last_became_peered":"2024-09-21T03:24:39.015277+0000","last_unstale":"2024-09-21T03:24:40.818012+0000","last_undegraded":"2024-09-21T03:24:40.818012+0000","last_fullsized":"2024-09-21T03:24:40.818012+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:53.986632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"92'2","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.291658+0000","last_change":"2024-09-21T03:24:38.012254+0000","last_active":"2024-09-21T03:24:40.291658+0000","last_peered":"2024-09-21T03:24:40.291658+0000","last_clean":"2024-09-21T03:24:40.291658+0000","last_became_active":"2024-09-21T03:24:38.011372+0000","last_became_peered":"2024-09-21T03:24:38.011372+0000","last_unstale":"2024-09-21T03:24:40.291658+0000","last_undegraded":"2024-09-21T03:24:40.291658+0000","last_fullsized":"2024-09-21T03:24:40.291658+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:35:12.894698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.818172+0000","last_change":"2024-09-21T03:24:39.032579+0000","last_active":"2024-09-21T03:24:40.818172+0000","last_peered":"2024-09-21T03:24:40.818172+0000","last_clean":"2024-09-21T03:24:40.818172+0000","last_became_active":"2024-09-21T03:24:39.031958+0000","last_became_peered":"2024-09-21T03:24:39.031958+0000","last_unstale":"2024-09-21T03:24:40.818172+0000","last_undegraded":"2024-09-21T03:24:40.818172+0000","last_fullsized":"2024-09-21T03:24:40.818172+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:48.947097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.291739+0000","last_change":"2024-09-21T03:24:38.024584+0000","last_active":"2024-09-21T03:24:40.291739+0000","last_peered":"2024-09-21T03:24:40.291739+0000","last_clean":"2024-09-21T03:24:40.291739+0000","last_became_active":"2024-09-21T03:24:38.024237+0000","last_became_peered":"2024-09-21T03:24:38.024237+0000","last_unstale":"2024-09-21T03:24:40.291739+0000","last_undegraded":"2024-09-21T03:24:40.291739+0000","last_fullsized":"2024-09-21T03:24:40.291739+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:27.355246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.015502+0000","last_change":"2024-09-21T03:24:39.016323+0000","last_active":"2024-09-21T03:24:40.015502+0000","last_peered":"2024-09-21T03:24:40.015502+0000","last_clean":"2024-09-21T03:24:40.015502+0000","last_became_active":"2024-09-21T03:24:39.015981+0000","last_became_peered":"2024-09-21T03:24:39.015981+0000","last_unstale":"2024-09-21T03:24:40.015502+0000","last_undegraded":"2024-09-21T03:24:40.015502+0000","last_fullsized":"2024-09-21T03:24:40.015502+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:06.349834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.016195+0000","last_change":"2024-09-21T03:24:38.006652+0000","last_active":"2024-09-21T03:24:40.016195+0000","last_peered":"2024-09-21T03:24:40.016195+0000","last_clean":"2024-09-21T03:24:40.016195+0000","last_became_active":"2024-09-21T03:24:38.006287+0000","last_became_peered":"2024-09-21T03:24:38.006287+0000","last_unstale":"2024-09-21T03:24:40.016195+0000","last_undegraded":"2024-09-21T03:24:40.016195+0000","last_fullsized":"2024-09-21T03:24:40.016195+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:08.899159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.291201+0000","last_change":"2024-09-21T03:24:39.019041+0000","last_active":"2024-09-21T03:24:40.291201+0000","last_peered":"2024-09-21T03:24:40.291201+0000","last_clean":"2024-09-21T03:24:40.291201+0000","last_became_active":"2024-09-21T03:24:39.018720+0000","last_became_peered":"2024-09-21T03:24:39.018720+0000","last_unstale":"2024-09-21T03:24:40.291201+0000","last_undegraded":"2024-09-21T03:24:40.291201+0000","last_fullsized":"2024-09-21T03:24:40.291201+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:10.415796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"92'8","reported_seq":23,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.818033+0000","last_change":"2024-09-21T03:24:38.020494+0000","last_active":"2024-09-21T03:24:40.818033+0000","last_peered":"2024-09-21T03:24:40.818033+0000","last_clean":"2024-09-21T03:24:40.818033+0000","last_became_active":"2024-09-21T03:24:38.019461+0000","last_became_peered":"2024-09-21T03:24:38.019461+0000","last_unstale":"2024-09-21T03:24:40.818033+0000","last_undegraded":"2024-09-21T03:24:40.818033+0000","last_fullsized":"2024-09-21T03:24:40.818033+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:38.904816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.016344+0000","last_change":"2024-09-21T03:24:39.016037+0000","last_active":"2024-09-21T03:24:40.016344+0000","last_peered":"2024-09-21T03:24:40.016344+0000","last_clean":"2024-09-21T03:24:40.016344+0000","last_became_active":"2024-09-21T03:24:39.015725+0000","last_became_peered":"2024-09-21T03:24:39.015725+0000","last_unstale":"2024-09-21T03:24:40.016344+0000","last_undegraded":"2024-09-21T03:24:40.016344+0000","last_fullsized":"2024-09-21T03:24:40.016344+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:18:06.637389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"92'2","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.015930+0000","last_change":"2024-09-21T03:24:38.009947+0000","last_active":"2024-09-21T03:24:40.015930+0000","last_peered":"2024-09-21T03:24:40.015930+0000","last_clean":"2024-09-21T03:24:40.015930+0000","last_became_active":"2024-09-21T03:24:38.009587+0000","last_became_peered":"2024-09-21T03:24:38.009587+0000","last_unstale":"2024-09-21T03:24:40.015930+0000","last_undegraded":"2024-09-21T03:24:40.015930+0000","last_fullsized":"2024-09-21T03:24:40.015930+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:19.167810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.817518+0000","last_change":"2024-09-21T03:24:39.014039+0000","last_active":"2024-09-21T03:24:40.817518+0000","last_peered":"2024-09-21T03:24:40.817518+0000","last_clean":"2024-09-21T03:24:40.817518+0000","last_became_active":"2024-09-21T03:24:39.013688+0000","last_became_peered":"2024-09-21T03:24:39.013688+0000","last_unstale":"2024-09-21T03:24:40.817518+0000","last_undegraded":"2024-09-21T03:24:40.817518+0000","last_fullsized":"2024-09-21T03:24:40.817518+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:32:57.307537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"92'1","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.016752+0000","last_change":"2024-09-21T03:24:38.010166+0000","last_active":"2024-09-21T03:24:40.016752+0000","last_peered":"2024-09-21T03:24:40.016752+0000","last_clean":"2024-09-21T03:24:40.016752+0000","last_became_active":"2024-09-21T03:24:38.009774+0000","last_became_peered":"2024-09-21T03:24:38.009774+0000","last_unstale":"2024-09-21T03:24:40.016752+0000","last_undegraded":"2024-09-21T03:24:40.016752+0000","last_fullsized":"2024-09-21T03:24:40.016752+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:31.330616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.818394+0000","last_change":"2024-09-21T03:24:39.010046+0000","last_active":"2024-09-21T03:24:40.818394+0000","last_peered":"2024-09-21T03:24:40.818394+0000","last_clean":"2024-09-21T03:24:40.818394+0000","last_became_active":"2024-09-21T03:24:39.009760+0000","last_became_peered":"2024-09-21T03:24:39.009760+0000","last_unstale":"2024-09-21T03:24:40.818394+0000","last_undegraded":"2024-09-21T03:24:40.818394+0000","last_fullsized":"2024-09-21T03:24:40.818394+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:21.853953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.013025+0000","last_change":"2024-09-21T03:24:38.013762+0000","last_active":"2024-09-21T03:24:40.013025+0000","last_peered":"2024-09-21T03:24:40.013025+0000","last_clean":"2024-09-21T03:24:40.013025+0000","last_became_active":"2024-09-21T03:24:38.013455+0000","last_became_peered":"2024-09-21T03:24:38.013455+0000","last_unstale":"2024-09-21T03:24:40.013025+0000","last_undegraded":"2024-09-21T03:24:40.013025+0000","last_fullsized":"2024-09-21T03:24:40.013025+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:40:26.681911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.291551+0000","last_change":"2024-09-21T03:24:39.022097+0000","last_active":"2024-09-21T03:24:40.291551+0000","last_peered":"2024-09-21T03:24:40.291551+0000","last_clean":"2024-09-21T03:24:40.291551+0000","last_became_active":"2024-09-21T03:24:39.021760+0000","last_became_peered":"2024-09-21T03:24:39.021760+0000","last_unstale":"2024-09-21T03:24:40.291551+0000","last_undegraded":"2024-09-21T03:24:40.291551+0000","last_fullsized":"2024-09-21T03:24:40.291551+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:48.014958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"92'2","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.013020+0000","last_change":"2024-09-21T03:24:38.014934+0000","last_active":"2024-09-21T03:24:40.013020+0000","last_peered":"2024-09-21T03:24:40.013020+0000","last_clean":"2024-09-21T03:24:40.013020+0000","last_became_active":"2024-09-21T03:24:38.014613+0000","last_became_peered":"2024-09-21T03:24:38.014613+0000","last_unstale":"2024-09-21T03:24:40.013020+0000","last_undegraded":"2024-09-21T03:24:40.013020+0000","last_fullsized":"2024-09-21T03:24:40.013020+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:27.000670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.291475+0000","last_change":"2024-09-21T03:24:39.028928+0000","last_active":"2024-09-21T03:24:40.291475+0000","last_peered":"2024-09-21T03:24:40.291475+0000","last_clean":"2024-09-21T03:24:40.291475+0000","last_became_active":"2024-09-21T03:24:39.028186+0000","last_became_peered":"2024-09-21T03:24:39.028186+0000","last_unstale":"2024-09-21T03:24:40.291475+0000","last_undegraded":"2024-09-21T03:24:40.291475+0000","last_fullsized":"2024-09-21T03:24:40.291475+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:35:23.378579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.818061+0000","last_change":"2024-09-21T03:24:38.020820+0000","last_active":"2024-09-21T03:24:40.818061+0000","last_peered":"2024-09-21T03:24:40.818061+0000","last_clean":"2024-09-21T03:24:40.818061+0000","last_became_active":"2024-09-21T03:24:38.020470+0000","last_became_peered":"2024-09-21T03:24:38.020470+0000","last_unstale":"2024-09-21T03:24:40.818061+0000","last_undegraded":"2024-09-21T03:24:40.818061+0000","last_fullsized":"2024-09-21T03:24:40.818061+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:21.394672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.291182+0000","last_change":"2024-09-21T03:24:39.019118+0000","last_active":"2024-09-21T03:24:40.291182+0000","last_peered":"2024-09-21T03:24:40.291182+0000","last_clean":"2024-09-21T03:24:40.291182+0000","last_became_active":"2024-09-21T03:24:39.018794+0000","last_became_peered":"2024-09-21T03:24:39.018794+0000","last_unstale":"2024-09-21T03:24:40.291182+0000","last_undegraded":"2024-09-21T03:24:40.291182+0000","last_fullsized":"2024-09-21T03:24:40.291182+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:35.488815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.817490+0000","last_change":"2024-09-21T03:24:38.012506+0000","last_active":"2024-09-21T03:24:40.817490+0000","last_peered":"2024-09-21T03:24:40.817490+0000","last_clean":"2024-09-21T03:24:40.817490+0000","last_became_active":"2024-09-21T03:24:38.012187+0000","last_became_peered":"2024-09-21T03:24:38.012187+0000","last_unstale":"2024-09-21T03:24:40.817490+0000","last_undegraded":"2024-09-21T03:24:40.817490+0000","last_fullsized":"2024-09-21T03:24:40.817490+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:00:19.167810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.016002+0000","last_change":"2024-09-21T03:24:39.010024+0000","last_active":"2024-09-21T03:24:40.016002+0000","last_peered":"2024-09-21T03:24:40.016002+0000","last_clean":"2024-09-21T03:24:40.016002+0000","last_became_active":"2024-09-21T03:24:39.009667+0000","last_became_peered":"2024-09-21T03:24:39.009667+0000","last_unstale":"2024-09-21T03:24:40.016002+0000","last_undegraded":"2024-09-21T03:24:40.016002+0000","last_fullsized":"2024-09-21T03:24:40.016002+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:46.673091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.012694+0000","last_change":"2024-09-21T03:24:38.022079+0000","last_active":"2024-09-21T03:24:40.012694+0000","last_peered":"2024-09-21T03:24:40.012694+0000","last_clean":"2024-09-21T03:24:40.012694+0000","last_became_active":"2024-09-21T03:24:38.021757+0000","last_became_peered":"2024-09-21T03:24:38.021757+0000","last_unstale":"2024-09-21T03:24:40.012694+0000","last_undegraded":"2024-09-21T03:24:40.012694+0000","last_fullsized":"2024-09-21T03:24:40.012694+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:41:36.864607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.013484+0000","last_change":"2024-09-21T03:24:39.029954+0000","last_active":"2024-09-21T03:24:40.013484+0000","last_peered":"2024-09-21T03:24:40.013484+0000","last_clean":"2024-09-21T03:24:40.013484+0000","last_became_active":"2024-09-21T03:24:39.029648+0000","last_became_peered":"2024-09-21T03:24:39.029648+0000","last_unstale":"2024-09-21T03:24:40.013484+0000","last_undegraded":"2024-09-21T03:24:40.013484+0000","last_fullsized":"2024-09-21T03:24:40.013484+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:55.774659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"92'2","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.818069+0000","last_change":"2024-09-21T03:24:38.010449+0000","last_active":"2024-09-21T03:24:40.818069+0000","last_peered":"2024-09-21T03:24:40.818069+0000","last_clean":"2024-09-21T03:24:40.818069+0000","last_became_active":"2024-09-21T03:24:38.010079+0000","last_became_peered":"2024-09-21T03:24:38.010079+0000","last_unstale":"2024-09-21T03:24:40.818069+0000","last_undegraded":"2024-09-21T03:24:40.818069+0000","last_fullsized":"2024-09-21T03:24:40.818069+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:08.899159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.818715+0000","last_change":"2024-09-21T03:24:39.018708+0000","last_active":"2024-09-21T03:24:40.818715+0000","last_peered":"2024-09-21T03:24:40.818715+0000","last_clean":"2024-09-21T03:24:40.818715+0000","last_became_active":"2024-09-21T03:24:39.018411+0000","last_became_peered":"2024-09-21T03:24:39.018411+0000","last_unstale":"2024-09-21T03:24:40.818715+0000","last_undegraded":"2024-09-21T03:24:40.818715+0000","last_fullsized":"2024-09-21T03:24:40.818715+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:39.000383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"92'1","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.013378+0000","last_change":"2024-09-21T03:24:38.015200+0000","last_active":"2024-09-21T03:24:40.013378+0000","last_peered":"2024-09-21T03:24:40.013378+0000","last_clean":"2024-09-21T03:24:40.013378+0000","last_became_active":"2024-09-21T03:24:38.014843+0000","last_became_peered":"2024-09-21T03:24:38.014843+0000","last_unstale":"2024-09-21T03:24:40.013378+0000","last_undegraded":"2024-09-21T03:24:40.013378+0000","last_fullsized":"2024-09-21T03:24:40.013378+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:29.367833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.818528+0000","last_change":"2024-09-21T03:24:39.014613+0000","last_active":"2024-09-21T03:24:40.818528+0000","last_peered":"2024-09-21T03:24:40.818528+0000","last_clean":"2024-09-21T03:24:40.818528+0000","last_became_active":"2024-09-21T03:24:39.014309+0000","last_became_peered":"2024-09-21T03:24:39.014309+0000","last_unstale":"2024-09-21T03:24:40.818528+0000","last_undegraded":"2024-09-21T03:24:40.818528+0000","last_fullsized":"2024-09-21T03:24:40.818528+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:46.659675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.013139+0000","last_change":"2024-09-21T03:24:38.010800+0000","last_active":"2024-09-21T03:24:40.013139+0000","last_peered":"2024-09-21T03:24:40.013139+0000","last_clean":"2024-09-21T03:24:40.013139+0000","last_became_active":"2024-09-21T03:24:38.010478+0000","last_became_peered":"2024-09-21T03:24:38.010478+0000","last_unstale":"2024-09-21T03:24:40.013139+0000","last_undegraded":"2024-09-21T03:24:40.013139+0000","last_fullsized":"2024-09-21T03:24:40.013139+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:12.070978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.016575+0000","last_change":"2024-09-21T03:24:39.019398+0000","last_active":"2024-09-21T03:24:40.016575+0000","last_peered":"2024-09-21T03:24:40.016575+0000","last_clean":"2024-09-21T03:24:40.016575+0000","last_became_active":"2024-09-21T03:24:39.019075+0000","last_became_peered":"2024-09-21T03:24:39.019075+0000","last_unstale":"2024-09-21T03:24:40.016575+0000","last_undegraded":"2024-09-21T03:24:40.016575+0000","last_fullsized":"2024-09-21T03:24:40.016575+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:50:26.185797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.017314+0000","last_change":"2024-09-21T03:24:38.008647+0000","last_active":"2024-09-21T03:24:40.017314+0000","last_peered":"2024-09-21T03:24:40.017314+0000","last_clean":"2024-09-21T03:24:40.017314+0000","last_became_active":"2024-09-21T03:24:38.008243+0000","last_became_peered":"2024-09-21T03:24:38.008243+0000","last_unstale":"2024-09-21T03:24:40.017314+0000","last_undegraded":"2024-09-21T03:24:40.017314+0000","last_fullsized":"2024-09-21T03:24:40.017314+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:03.185910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.291585+0000","last_change":"2024-09-21T03:24:39.019944+0000","last_active":"2024-09-21T03:24:40.291585+0000","last_peered":"2024-09-21T03:24:40.291585+0000","last_clean":"2024-09-21T03:24:40.291585+0000","last_became_active":"2024-09-21T03:24:39.019554+0000","last_became_peered":"2024-09-21T03:24:39.019554+0000","last_unstale":"2024-09-21T03:24:40.291585+0000","last_undegraded":"2024-09-21T03:24:40.291585+0000","last_fullsized":"2024-09-21T03:24:40.291585+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:31.122031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.013125+0000","last_change":"2024-09-21T03:24:38.012316+0000","last_active":"2024-09-21T03:24:40.013125+0000","last_peered":"2024-09-21T03:24:40.013125+0000","last_clean":"2024-09-21T03:24:40.013125+0000","last_became_active":"2024-09-21T03:24:38.012027+0000","last_became_peered":"2024-09-21T03:24:38.012027+0000","last_unstale":"2024-09-21T03:24:40.013125+0000","last_undegraded":"2024-09-21T03:24:40.013125+0000","last_fullsized":"2024-09-21T03:24:40.013125+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:17.738117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.016141+0000","last_change":"2024-09-21T03:24:39.018844+0000","last_active":"2024-09-21T03:24:40.016141+0000","last_peered":"2024-09-21T03:24:40.016141+0000","last_clean":"2024-09-21T03:24:40.016141+0000","last_became_active":"2024-09-21T03:24:39.018537+0000","last_became_peered":"2024-09-21T03:24:39.018537+0000","last_unstale":"2024-09-21T03:24:40.016141+0000","last_undegraded":"2024-09-21T03:24:40.016141+0000","last_fullsized":"2024-09-21T03:24:40.016141+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:41.905004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.016711+0000","last_change":"2024-09-21T03:24:38.022179+0000","last_active":"2024-09-21T03:24:40.016711+0000","last_peered":"2024-09-21T03:24:40.016711+0000","last_clean":"2024-09-21T03:24:40.016711+0000","last_became_active":"2024-09-21T03:24:38.021893+0000","last_became_peered":"2024-09-21T03:24:38.021893+0000","last_unstale":"2024-09-21T03:24:40.016711+0000","last_undegraded":"2024-09-21T03:24:40.016711+0000","last_fullsized":"2024-09-21T03:24:40.016711+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:59:51.881609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.291183+0000","last_change":"2024-09-21T03:24:39.026980+0000","last_active":"2024-09-21T03:24:40.291183+0000","last_peered":"2024-09-21T03:24:40.291183+0000","last_clean":"2024-09-21T03:24:40.291183+0000","last_became_active":"2024-09-21T03:24:39.026646+0000","last_became_peered":"2024-09-21T03:24:39.026646+0000","last_unstale":"2024-09-21T03:24:40.291183+0000","last_undegraded":"2024-09-21T03:24:40.291183+0000","last_fullsized":"2024-09-21T03:24:40.291183+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:32:18.798876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.818207+0000","last_change":"2024-09-21T03:24:38.020153+0000","last_active":"2024-09-21T03:24:40.818207+0000","last_peered":"2024-09-21T03:24:40.818207+0000","last_clean":"2024-09-21T03:24:40.818207+0000","last_became_active":"2024-09-21T03:24:38.019792+0000","last_became_peered":"2024-09-21T03:24:38.019792+0000","last_unstale":"2024-09-21T03:24:40.818207+0000","last_undegraded":"2024-09-21T03:24:40.818207+0000","last_fullsized":"2024-09-21T03:24:40.818207+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:44:39.704046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.016276+0000","last_change":"2024-09-21T03:24:39.021377+0000","last_active":"2024-09-21T03:24:40.016276+0000","last_peered":"2024-09-21T03:24:40.016276+0000","last_clean":"2024-09-21T03:24:40.016276+0000","last_became_active":"2024-09-21T03:24:39.021075+0000","last_became_peered":"2024-09-21T03:24:39.021075+0000","last_unstale":"2024-09-21T03:24:40.016276+0000","last_undegraded":"2024-09-21T03:24:40.016276+0000","last_fullsized":"2024-09-21T03:24:40.016276+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:22.326154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.291383+0000","last_change":"2024-09-21T03:24:38.017820+0000","last_active":"2024-09-21T03:24:40.291383+0000","last_peered":"2024-09-21T03:24:40.291383+0000","last_clean":"2024-09-21T03:24:40.291383+0000","last_became_active":"2024-09-21T03:24:38.017280+0000","last_became_peered":"2024-09-21T03:24:38.017280+0000","last_unstale":"2024-09-21T03:24:40.291383+0000","last_undegraded":"2024-09-21T03:24:40.291383+0000","last_fullsized":"2024-09-21T03:24:40.291383+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:50:33.362111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.291624+0000","last_change":"2024-09-21T03:24:39.020966+0000","last_active":"2024-09-21T03:24:40.291624+0000","last_peered":"2024-09-21T03:24:40.291624+0000","last_clean":"2024-09-21T03:24:40.291624+0000","last_became_active":"2024-09-21T03:24:39.019934+0000","last_became_peered":"2024-09-21T03:24:39.019934+0000","last_unstale":"2024-09-21T03:24:40.291624+0000","last_undegraded":"2024-09-21T03:24:40.291624+0000","last_fullsized":"2024-09-21T03:24:40.291624+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:37.988740+0000","last_clean_scrub_stamp":"2024-09-21T03:24:37.988740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:57.429737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"92'1","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.817838+0000","last_change":"2024-09-21T03:24:38.009806+0000","last_active":"2024-09-21T03:24:40.817838+0000","last_peered":"2024-09-21T03:24:40.817838+0000","last_clean":"2024-09-21T03:24:40.817838+0000","last_became_active":"2024-09-21T03:24:38.009384+0000","last_became_peered":"2024-09-21T03:24:38.009384+0000","last_unstale":"2024-09-21T03:24:40.817838+0000","last_undegraded":"2024-09-21T03:24:40.817838+0000","last_fullsized":"2024-09-21T03:24:40.817838+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:24:36.986597+0000","last_clean_scrub_stamp":"2024-09-21T03:24:36.986597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:59:09.360511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":246,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-21T03:24:40.818061+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:24:40.818061+0000","last_peered":"2024-09-21T03:24:40.818061+0000","last_clean":"2024-09-21T03:24:40.818061+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:24:40.818061+0000","last_undegraded":"2024-09-21T03:24:40.818061+0000","last_fullsized":"2024-09-21T03:24:40.818061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509522,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32892,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338948,"statfs":{"total":96636764160,"available":96603082752,"internally_reserved":0,"allocated":1744896,"data_stored":1073671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509521,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32316,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339524,"statfs":{"total":96636764160,"available":96603672576,"internally_reserved":0,"allocated":1150976,"data_stored":483843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509520,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32312,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1146880,"data_stored":483261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509520,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32328,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339512,"statfs":{"total":96636764160,"available":96603660288,"internally_reserved":0,"allocated":1163264,"data_stored":484927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509521,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32320,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1159168,"data_stored":484825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509521,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32308,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339532,"statfs":{"total":96636764160,"available":96603680768,"internally_reserved":0,"allocated":1146880,"data_stored":483225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509521,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1142784,"data_stored":483191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574929,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32892,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338948,"statfs":{"total":96636764160,"available":96603082752,"internally_reserved":0,"allocated":1740800,"data_stored":1074141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:24:47.817 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T03:24:47.818 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T03:24:47.974 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.972+0000 7fa6b9589640 1 -- 172.21.15.105:0/2500450390 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6b4074420 msgr2=0x7fa6b406fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:47.975 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.972+0000 7fa6b9589640 1 --2- 172.21.15.105:0/2500450390 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6b4074420 0x7fa6b406fe30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4005fd0 tx=0x7fa6a402aa90 comp rx=0 tx=0).stop 2024-09-21T03:24:47.975 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.973+0000 7fa6b9589640 1 -- 172.21.15.105:0/2500450390 shutdown_connections 2024-09-21T03:24:47.975 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.973+0000 7fa6b9589640 1 --2- 172.21.15.105:0/2500450390 >> v2:172.21.15.162:3300/0 conn(0x7fa6b4155ce0 0x7fa6b40b45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:47.975 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.973+0000 7fa6b9589640 1 --2- 172.21.15.105:0/2500450390 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6b4074420 0x7fa6b406fe30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:47.975 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.973+0000 7fa6b9589640 1 -- 172.21.15.105:0/2500450390 >> 172.21.15.105:0/2500450390 conn(0x7fa6b406def0 msgr2=0x7fa6b406e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:47.975 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.973+0000 7fa6b9589640 1 -- 172.21.15.105:0/2500450390 shutdown_connections 2024-09-21T03:24:47.975 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.973+0000 7fa6b9589640 1 -- 172.21.15.105:0/2500450390 wait complete. 2024-09-21T03:24:47.976 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.974+0000 7fa6b9589640 1 Processor -- start 2024-09-21T03:24:47.976 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.975+0000 7fa6b9589640 1 -- start start 2024-09-21T03:24:47.978 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.976+0000 7fa6b9589640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6b4074420 0x7fa6b406cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:47.979 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.976+0000 7fa6b9589640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6b4155ce0 0x7fa6b4143be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:47.979 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.976+0000 7fa6b9589640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6b406d500 0x7fa6b40cc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:47.979 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.976+0000 7fa6b9589640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa6b40b5000 con 0x7fa6b4155ce0 2024-09-21T03:24:47.979 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.976+0000 7fa6b9589640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa6b40b4e80 con 0x7fa6b406d500 2024-09-21T03:24:47.979 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.976+0000 7fa6b9589640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa6b40b5180 con 0x7fa6b4074420 2024-09-21T03:24:47.979 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.976+0000 7fa6b27fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6b4155ce0 0x7fa6b4143be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:47.979 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.976+0000 7fa6b27fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6b4155ce0 0x7fa6b4143be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:60576/0 (socket says 172.21.15.105:60576) 2024-09-21T03:24:47.979 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.976+0000 7fa6b27fc640 1 -- 172.21.15.105:0/600026770 learned_addr learned my addr 172.21.15.105:0/600026770 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:47.979 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.976+0000 7fa6b37fe640 1 --2- 172.21.15.105:0/600026770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6b406d500 0x7fa6b40cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:47.979 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.976+0000 7fa6b2ffd640 1 --2- 172.21.15.105:0/600026770 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6b4074420 0x7fa6b406cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:47.979 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.976+0000 7fa6b27fc640 1 -- 172.21.15.105:0/600026770 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6b4074420 msgr2=0x7fa6b406cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:47.979 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.976+0000 7fa6b27fc640 1 --2- 172.21.15.105:0/600026770 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6b4074420 0x7fa6b406cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:47.980 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.976+0000 7fa6b27fc640 1 -- 172.21.15.105:0/600026770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6b406d500 msgr2=0x7fa6b40cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:47.980 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.976+0000 7fa6b27fc640 1 --2- 172.21.15.105:0/600026770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6b406d500 0x7fa6b40cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:47.980 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.976+0000 7fa6b27fc640 1 -- 172.21.15.105:0/600026770 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6b4141840 con 0x7fa6b4155ce0 2024-09-21T03:24:47.980 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.976+0000 7fa6b27fc640 1 --2- 172.21.15.105:0/600026770 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6b4155ce0 0x7fa6b4143be0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fa69c00c430 tx=0x7fa69c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:47.980 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.977+0000 7fa6ab7fe640 1 -- 172.21.15.105:0/600026770 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa69c017070 con 0x7fa6b4155ce0 2024-09-21T03:24:47.980 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.977+0000 7fa6ab7fe640 1 -- 172.21.15.105:0/600026770 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa69c0053c0 con 0x7fa6b4155ce0 2024-09-21T03:24:47.980 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.977+0000 7fa6b9589640 1 -- 172.21.15.105:0/600026770 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6b40c6290 con 0x7fa6b4155ce0 2024-09-21T03:24:47.980 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.977+0000 7fa6ab7fe640 1 -- 172.21.15.105:0/600026770 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa69c003850 con 0x7fa6b4155ce0 2024-09-21T03:24:47.980 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.977+0000 7fa6b9589640 1 -- 172.21.15.105:0/600026770 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6b40c6850 con 0x7fa6b4155ce0 2024-09-21T03:24:47.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.978+0000 7fa6b9589640 1 -- 172.21.15.105:0/600026770 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6b41446c0 con 0x7fa6b4155ce0 2024-09-21T03:24:47.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.978+0000 7fa6ab7fe640 1 -- 172.21.15.105:0/600026770 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa69c01a070 con 0x7fa6b4155ce0 2024-09-21T03:24:47.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.979+0000 7fa6ab7fe640 1 --2- 172.21.15.105:0/600026770 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa694078b90 0x7fa69407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:47.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.979+0000 7fa6ab7fe640 1 -- 172.21.15.105:0/600026770 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7fa69c09a060 con 0x7fa6b4155ce0 2024-09-21T03:24:47.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.979+0000 7fa6b2ffd640 1 --2- 172.21.15.105:0/600026770 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa694078b90 0x7fa69407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:47.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.979+0000 7fa6b2ffd640 1 --2- 172.21.15.105:0/600026770 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa694078b90 0x7fa69407b0a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4035000 tx=0x7fa6a4038040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:47.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:47.983+0000 7fa6ab7fe640 1 -- 172.21.15.105:0/600026770 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa69c061e50 con 0x7fa6b4155ce0 2024-09-21T03:24:48.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.230+0000 7fa6b9589640 1 -- 172.21.15.105:0/600026770 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fa6b40b56a0 con 0x7fa6b4155ce0 2024-09-21T03:24:48.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.233+0000 7fa6ab7fe640 1 -- 172.21.15.105:0/600026770 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) ==== 190+0+147 (secure 0 0 0) 0x7fa69c066880 con 0x7fa6b4155ce0 2024-09-21T03:24:48.235 INFO:teuthology.orchestra.run.smithi105.stdout:[client.0] 2024-09-21T03:24:48.235 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQDIOu5mughoJxAAhY0bzJmq+oNyzCdtafkC9w== 2024-09-21T03:24:48.235 INFO:teuthology.orchestra.run.smithi105.stdout: caps mds = "allow" 2024-09-21T03:24:48.235 INFO:teuthology.orchestra.run.smithi105.stdout: caps mon = "allow r" 2024-09-21T03:24:48.235 INFO:teuthology.orchestra.run.smithi105.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T03:24:48.235 INFO:teuthology.orchestra.run.smithi105.stderr:updated caps for client.0 2024-09-21T03:24:48.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.235+0000 7fa6b9589640 1 -- 172.21.15.105:0/600026770 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa694078b90 msgr2=0x7fa69407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:48.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.235+0000 7fa6b9589640 1 --2- 172.21.15.105:0/600026770 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa694078b90 0x7fa69407b0a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4035000 tx=0x7fa6a4038040 comp rx=0 tx=0).stop 2024-09-21T03:24:48.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.235+0000 7fa6b9589640 1 -- 172.21.15.105:0/600026770 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6b4155ce0 msgr2=0x7fa6b4143be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:48.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.235+0000 7fa6b9589640 1 --2- 172.21.15.105:0/600026770 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6b4155ce0 0x7fa6b4143be0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fa69c00c430 tx=0x7fa69c00c8f0 comp rx=0 tx=0).stop 2024-09-21T03:24:48.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.235+0000 7fa6b9589640 1 -- 172.21.15.105:0/600026770 shutdown_connections 2024-09-21T03:24:48.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.235+0000 7fa6b9589640 1 --2- 172.21.15.105:0/600026770 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa694078b90 0x7fa69407b0a0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:48.238 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.235+0000 7fa6b9589640 1 --2- 172.21.15.105:0/600026770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6b406d500 0x7fa6b40cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:48.238 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.235+0000 7fa6b9589640 1 --2- 172.21.15.105:0/600026770 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6b4155ce0 0x7fa6b4143be0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:48.238 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.235+0000 7fa6b9589640 1 --2- 172.21.15.105:0/600026770 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6b4074420 0x7fa6b406cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:48.238 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.235+0000 7fa6b9589640 1 -- 172.21.15.105:0/600026770 >> 172.21.15.105:0/600026770 conn(0x7fa6b406def0 msgr2=0x7fa6b40cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:48.238 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.235+0000 7fa6b9589640 1 -- 172.21.15.105:0/600026770 shutdown_connections 2024-09-21T03:24:48.238 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.235+0000 7fa6b9589640 1 -- 172.21.15.105:0/600026770 wait complete. 2024-09-21T03:24:48.248 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:24:48.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.359+0000 7fee3dfa1640 1 -- 172.21.15.105:0/1488171573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee200052b0 msgr2=0x7fee2000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:48.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.359+0000 7fee3dfa1640 1 --2- 172.21.15.105:0/1488171573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee200052b0 0x7fee2000b9c0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fee380b16d0 tx=0x7fee20005830 comp rx=0 tx=0).stop 2024-09-21T03:24:48.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.359+0000 7fee37fff640 1 -- 172.21.15.105:0/1488171573 reap_dead start 2024-09-21T03:24:48.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.359+0000 7fee3dfa1640 1 -- 172.21.15.105:0/1488171573 shutdown_connections 2024-09-21T03:24:48.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.359+0000 7fee3dfa1640 1 -- 172.21.15.105:0/1488171573 >> 172.21.15.105:0/1488171573 conn(0x7fee380cee20 msgr2=0x7fee380cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:48.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.359+0000 7fee3dfa1640 1 -- 172.21.15.105:0/1488171573 shutdown_connections 2024-09-21T03:24:48.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.359+0000 7fee3dfa1640 1 -- 172.21.15.105:0/1488171573 wait complete. 2024-09-21T03:24:48.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.360+0000 7fee3dfa1640 1 Processor -- start 2024-09-21T03:24:48.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.361+0000 7fee3dfa1640 1 -- start start 2024-09-21T03:24:48.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.362+0000 7fee3dfa1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee38147e40 0x7fee380cad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:48.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.362+0000 7fee3dfa1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee381f6890 0x7fee381f6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:48.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.362+0000 7fee3dfa1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee381f71e0 0x7fee38144310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:48.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.362+0000 7fee3dfa1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fee380d1690 con 0x7fee381f6890 2024-09-21T03:24:48.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.362+0000 7fee3dfa1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fee380d1510 con 0x7fee38147e40 2024-09-21T03:24:48.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.362+0000 7fee3dfa1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fee380d1810 con 0x7fee381f71e0 2024-09-21T03:24:48.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.362+0000 7fee36ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee381f6890 0x7fee381f6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:48.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.362+0000 7fee36ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee381f6890 0x7fee381f6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:60602/0 (socket says 172.21.15.105:60602) 2024-09-21T03:24:48.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.362+0000 7fee36ffd640 1 -- 172.21.15.105:0/609436533 learned_addr learned my addr 172.21.15.105:0/609436533 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:48.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.362+0000 7fee377fe640 1 --2- 172.21.15.105:0/609436533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee38147e40 0x7fee380cad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:48.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.362+0000 7fee37fff640 1 --2- 172.21.15.105:0/609436533 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee381f71e0 0x7fee38144310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:48.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.362+0000 7fee36ffd640 1 -- 172.21.15.105:0/609436533 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee381f71e0 msgr2=0x7fee38144310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:48.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.362+0000 7fee36ffd640 1 --2- 172.21.15.105:0/609436533 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee381f71e0 0x7fee38144310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:48.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.362+0000 7fee36ffd640 1 -- 172.21.15.105:0/609436533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee38147e40 msgr2=0x7fee380cad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:48.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.362+0000 7fee36ffd640 1 --2- 172.21.15.105:0/609436533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee38147e40 0x7fee380cad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:48.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.362+0000 7fee36ffd640 1 -- 172.21.15.105:0/609436533 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee3815ba80 con 0x7fee381f6890 2024-09-21T03:24:48.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.362+0000 7fee377fe640 1 --2- 172.21.15.105:0/609436533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee38147e40 0x7fee380cad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:24:48.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.362+0000 7fee36ffd640 1 --2- 172.21.15.105:0/609436533 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee381f6890 0x7fee381f6ca0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fee2c000c00 tx=0x7fee2c001800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:48.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.363+0000 7fee1ffff640 1 -- 172.21.15.105:0/609436533 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2c015020 con 0x7fee381f6890 2024-09-21T03:24:48.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.363+0000 7fee1ffff640 1 -- 172.21.15.105:0/609436533 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee2c0119a0 con 0x7fee381f6890 2024-09-21T03:24:48.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.363+0000 7fee3dfa1640 1 -- 172.21.15.105:0/609436533 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee3815f060 con 0x7fee381f6890 2024-09-21T03:24:48.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.363+0000 7fee1ffff640 1 -- 172.21.15.105:0/609436533 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2c011df0 con 0x7fee381f6890 2024-09-21T03:24:48.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.363+0000 7fee3dfa1640 1 -- 172.21.15.105:0/609436533 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee3815b740 con 0x7fee381f6890 2024-09-21T03:24:48.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.364+0000 7fee3dfa1640 1 -- 172.21.15.105:0/609436533 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee380d1da0 con 0x7fee381f6890 2024-09-21T03:24:48.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.364+0000 7fee1ffff640 1 -- 172.21.15.105:0/609436533 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fee2c018020 con 0x7fee381f6890 2024-09-21T03:24:48.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.365+0000 7fee1ffff640 1 --2- 172.21.15.105:0/609436533 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fee24078b90 0x7fee2407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:48.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.365+0000 7fee1ffff640 1 -- 172.21.15.105:0/609436533 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7fee2c09b480 con 0x7fee381f6890 2024-09-21T03:24:48.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.365+0000 7fee377fe640 1 --2- 172.21.15.105:0/609436533 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fee24078b90 0x7fee2407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:48.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.366+0000 7fee377fe640 1 --2- 172.21.15.105:0/609436533 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fee24078b90 0x7fee2407b0a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fee38152020 tx=0x7fee28005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:48.371 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.369+0000 7fee1ffff640 1 -- 172.21.15.105:0/609436533 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fee2c01f030 con 0x7fee381f6890 2024-09-21T03:24:48.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.585+0000 7fee3dfa1640 1 -- 172.21.15.105:0/609436533 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fee38158860 con 0x7fee381f6890 2024-09-21T03:24:48.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.585+0000 7fee1ffff640 1 -- 172.21.15.105:0/609436533 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+5234 (secure 0 0 0) 0x7fee2c063960 con 0x7fee381f6890 2024-09-21T03:24:48.587 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:24:48.587 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":58,"btime":"2024-09-21T03:24:42:016797+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5801,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2175278360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2175278360},{"type":"v1","addr":"172.21.15.162:6836","nonce":2175278360}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6292,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2152611733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2152611733},{"type":"v1","addr":"172.21.15.105:6835","nonce":2152611733}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1722830153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1722830153},{"type":"v1","addr":"172.21.15.162:6837","nonce":1722830153}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:24:38.369493+0000","modified":"2024-09-21T03:24:41.378239+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6840},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6840":{"gid":6840,"name":"c","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6834/636426076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":636426076},{"type":"v1","addr":"172.21.15.105:6834","nonce":636426076}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6840,"qdb_cluster":[6840]},"id":7}]} 2024-09-21T03:24:48.587 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 58 2024-09-21T03:24:48.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.587+0000 7fee3dfa1640 1 -- 172.21.15.105:0/609436533 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fee24078b90 msgr2=0x7fee2407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:48.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.587+0000 7fee3dfa1640 1 --2- 172.21.15.105:0/609436533 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fee24078b90 0x7fee2407b0a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fee38152020 tx=0x7fee28005f90 comp rx=0 tx=0).stop 2024-09-21T03:24:48.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.587+0000 7fee3dfa1640 1 -- 172.21.15.105:0/609436533 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee381f6890 msgr2=0x7fee381f6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:48.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.587+0000 7fee3dfa1640 1 --2- 172.21.15.105:0/609436533 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee381f6890 0x7fee381f6ca0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fee2c000c00 tx=0x7fee2c001800 comp rx=0 tx=0).stop 2024-09-21T03:24:48.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.587+0000 7fee3dfa1640 1 -- 172.21.15.105:0/609436533 shutdown_connections 2024-09-21T03:24:48.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.587+0000 7fee3dfa1640 1 --2- 172.21.15.105:0/609436533 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fee24078b90 0x7fee2407b0a0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:48.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.587+0000 7fee3dfa1640 1 --2- 172.21.15.105:0/609436533 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee381f71e0 0x7fee38144310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:48.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.587+0000 7fee3dfa1640 1 --2- 172.21.15.105:0/609436533 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee381f6890 0x7fee381f6ca0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:48.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.587+0000 7fee3dfa1640 1 --2- 172.21.15.105:0/609436533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee38147e40 0x7fee380cad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:48.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.587+0000 7fee3dfa1640 1 -- 172.21.15.105:0/609436533 >> 172.21.15.105:0/609436533 conn(0x7fee380cee20 msgr2=0x7fee380b71e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:48.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.588+0000 7fee3dfa1640 1 -- 172.21.15.105:0/609436533 shutdown_connections 2024-09-21T03:24:48.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:48.588+0000 7fee3dfa1640 1 -- 172.21.15.105:0/609436533 wait complete. 2024-09-21T03:24:49.002 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 58, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T03:24:38.369493+0000', 'modified': '2024-09-21T03:24:41.378239+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6840}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6840': {'gid': 6840, 'name': 'c', 'rank': 0, 'incarnation': 55, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.105:6834/636426076', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6832', 'nonce': 636426076}, {'type': 'v1', 'addr': '172.21.15.105:6834', 'nonce': 636426076}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6840, 'qdb_cluster': [6840]} 2024-09-21T03:24:49.003 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T03:24:49.003 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-21T03:24:49.116 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.114+0000 7f5859ddf640 1 -- 172.21.15.105:0/1724324217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58540ce7d0 msgr2=0x7f5854071250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:49.116 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.114+0000 7f5859ddf640 1 --2- 172.21.15.105:0/1724324217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58540ce7d0 0x7f5854071250 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f584c005fd0 tx=0x7f584c02a940 comp rx=0 tx=0).stop 2024-09-21T03:24:49.116 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.114+0000 7f5859ddf640 1 -- 172.21.15.105:0/1724324217 shutdown_connections 2024-09-21T03:24:49.116 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.114+0000 7f5859ddf640 1 --2- 172.21.15.105:0/1724324217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58540ce7d0 0x7f5854071250 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.116 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.114+0000 7f5859ddf640 1 -- 172.21.15.105:0/1724324217 >> 172.21.15.105:0/1724324217 conn(0x7f58540cdcb0 msgr2=0x7f58540ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:49.116 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.114+0000 7f5859ddf640 1 -- 172.21.15.105:0/1724324217 shutdown_connections 2024-09-21T03:24:49.116 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.114+0000 7f5859ddf640 1 -- 172.21.15.105:0/1724324217 wait complete. 2024-09-21T03:24:49.117 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.116+0000 7f5859ddf640 1 Processor -- start 2024-09-21T03:24:49.117 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.116+0000 7f5859ddf640 1 -- start start 2024-09-21T03:24:49.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.117+0000 7f5859ddf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58540ce7d0 0x7f58540b38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:49.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.117+0000 7f5859ddf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58541600a0 0x7f58540ae760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:49.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.117+0000 7f5859ddf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58540aeca0 0x7f58541f32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:49.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.117+0000 7f5859ddf640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f58540d0540 con 0x7f58540ce7d0 2024-09-21T03:24:49.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.117+0000 7f5859ddf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f58540d03c0 con 0x7f58540aeca0 2024-09-21T03:24:49.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.117+0000 7f5859ddf640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f58540d06c0 con 0x7f58541600a0 2024-09-21T03:24:49.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.117+0000 7f58537fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58540ce7d0 0x7f58540b38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:49.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.117+0000 7f58537fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58540ce7d0 0x7f58540b38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:60612/0 (socket says 172.21.15.105:60612) 2024-09-21T03:24:49.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.117+0000 7f58537fe640 1 -- 172.21.15.105:0/522536131 learned_addr learned my addr 172.21.15.105:0/522536131 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:49.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.118+0000 7f5852ffd640 1 --2- 172.21.15.105:0/522536131 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58541600a0 0x7f58540ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:49.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.118+0000 7f5853fff640 1 --2- 172.21.15.105:0/522536131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58540aeca0 0x7f58541f32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:49.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.118+0000 7f58537fe640 1 -- 172.21.15.105:0/522536131 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58541600a0 msgr2=0x7f58540ae760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:49.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.118+0000 7f58537fe640 1 --2- 172.21.15.105:0/522536131 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58541600a0 0x7f58540ae760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.118+0000 7f58537fe640 1 -- 172.21.15.105:0/522536131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58540aeca0 msgr2=0x7f58541f32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:49.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.118+0000 7f58537fe640 1 --2- 172.21.15.105:0/522536131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58540aeca0 0x7f58541f32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.118+0000 7f58537fe640 1 -- 172.21.15.105:0/522536131 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58540af0b0 con 0x7f58540ce7d0 2024-09-21T03:24:49.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.118+0000 7f58537fe640 1 --2- 172.21.15.105:0/522536131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58540ce7d0 0x7f58540b38e0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f584400c3c0 tx=0x7f584400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:49.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.118+0000 7f583bfff640 1 -- 172.21.15.105:0/522536131 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5844017070 con 0x7f58540ce7d0 2024-09-21T03:24:49.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.118+0000 7f583bfff640 1 -- 172.21.15.105:0/522536131 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f58440035f0 con 0x7f58540ce7d0 2024-09-21T03:24:49.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.118+0000 7f5859ddf640 1 -- 172.21.15.105:0/522536131 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f585409e910 con 0x7f58540ce7d0 2024-09-21T03:24:49.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.118+0000 7f583bfff640 1 -- 172.21.15.105:0/522536131 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5844003a80 con 0x7f58540ce7d0 2024-09-21T03:24:49.122 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.118+0000 7f5859ddf640 1 -- 172.21.15.105:0/522536131 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58540b2b90 con 0x7f58540ce7d0 2024-09-21T03:24:49.122 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.120+0000 7f583bfff640 1 -- 172.21.15.105:0/522536131 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f584401a070 con 0x7f58540ce7d0 2024-09-21T03:24:49.122 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.121+0000 7f583bfff640 1 --2- 172.21.15.105:0/522536131 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5840078b90 0x7f584007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:49.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.121+0000 7f583bfff640 1 -- 172.21.15.105:0/522536131 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7f5844099eb0 con 0x7f58540ce7d0 2024-09-21T03:24:49.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.121+0000 7f5852ffd640 1 --2- 172.21.15.105:0/522536131 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5840078b90 0x7f584007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:49.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.122+0000 7f5852ffd640 1 --2- 172.21.15.105:0/522536131 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5840078b90 0x7f584007b0a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f58540b6210 tx=0x7f5848009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:49.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.122+0000 7f5860e26740 1 Processor -- start 2024-09-21T03:24:49.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.122+0000 7f5860e26740 1 -- start start 2024-09-21T03:24:49.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.123+0000 7f5860e26740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560f40bd270 0x5560f447d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:49.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.123+0000 7f5860e26740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5560f40943b0 0x5560f448be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:49.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.123+0000 7f5860e26740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560f409c590 0x5560f448c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:49.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.123+0000 7f5860e26740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5560f43d7820 con 0x5560f40bd270 2024-09-21T03:24:49.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.123+0000 7f5860e26740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5560f43c6c50 con 0x5560f409c590 2024-09-21T03:24:49.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.123+0000 7f5860e26740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5560f43caa60 con 0x5560f40943b0 2024-09-21T03:24:49.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.123+0000 7f58537fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560f40bd270 0x5560f447d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:49.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.123+0000 7f58537fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560f40bd270 0x5560f447d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:60622/0 (socket says 172.21.15.105:60622) 2024-09-21T03:24:49.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.123+0000 7f58537fe640 1 -- 172.21.15.105:0/4159613027 learned_addr learned my addr 172.21.15.105:0/4159613027 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:49.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.123+0000 7f5853fff640 1 --2- 172.21.15.105:0/4159613027 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560f409c590 0x5560f448c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:49.127 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.123+0000 7f5852ffd640 1 --2- 172.21.15.105:0/4159613027 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5560f40943b0 0x5560f448be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:49.127 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.124+0000 7f58537fe640 1 -- 172.21.15.105:0/4159613027 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5560f40943b0 msgr2=0x5560f448be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:24:49.127 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.124+0000 7f58537fe640 1 --2- 172.21.15.105:0/4159613027 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5560f40943b0 0x5560f448be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.127 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.124+0000 7f58537fe640 1 -- 172.21.15.105:0/4159613027 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560f409c590 msgr2=0x5560f448c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:24:49.127 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.124+0000 7f58537fe640 1 --2- 172.21.15.105:0/4159613027 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560f409c590 0x5560f448c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.127 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.124+0000 7f58537fe640 1 -- 172.21.15.105:0/4159613027 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560f4128850 con 0x5560f40bd270 2024-09-21T03:24:49.127 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.124+0000 7f58537fe640 1 --2- 172.21.15.105:0/4159613027 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560f40bd270 0x5560f447d970 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f5844098410 tx=0x7f5844061530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fb256ff6c134d1d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:49.127 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.124+0000 7f58397fa640 1 -- 172.21.15.105:0/4159613027 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58440667f0 con 0x5560f40bd270 2024-09-21T03:24:49.127 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.124+0000 7f58397fa640 1 -- 172.21.15.105:0/4159613027 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5844066030 con 0x5560f40bd270 2024-09-21T03:24:49.127 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.124+0000 7f58397fa640 1 -- 172.21.15.105:0/4159613027 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584406b410 con 0x5560f40bd270 2024-09-21T03:24:49.128 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.125+0000 7f5860e26740 1 -- 172.21.15.105:0/4159613027 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560f40bd270 msgr2=0x5560f447d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:49.128 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.125+0000 7f5860e26740 1 --2- 172.21.15.105:0/4159613027 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560f40bd270 0x5560f447d970 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f5844098410 tx=0x7f5844061530 comp rx=0 tx=0).stop 2024-09-21T03:24:49.128 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.125+0000 7f5860e26740 1 -- 172.21.15.105:0/4159613027 shutdown_connections 2024-09-21T03:24:49.128 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.125+0000 7f5860e26740 1 --2- 172.21.15.105:0/4159613027 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560f409c590 0x5560f448c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.128 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.125+0000 7f5860e26740 1 --2- 172.21.15.105:0/4159613027 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5560f40943b0 0x5560f448be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.129 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.125+0000 7f5860e26740 1 --2- 172.21.15.105:0/4159613027 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560f40bd270 0x5560f447d970 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.129 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.125+0000 7f5860e26740 1 -- 172.21.15.105:0/4159613027 >> 172.21.15.105:0/4159613027 conn(0x5560f40b13c0 msgr2=0x5560f4465260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:49.129 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.125+0000 7f5860e26740 1 -- 172.21.15.105:0/4159613027 shutdown_connections 2024-09-21T03:24:49.129 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.125+0000 7f5860e26740 1 -- 172.21.15.105:0/4159613027 wait complete. 2024-09-21T03:24:49.129 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.126+0000 7f5860e26740 1 -- start start 2024-09-21T03:24:49.129 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.126+0000 7f5860e26740 1 Processor -- start 2024-09-21T03:24:49.133 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.127+0000 7f5860e26740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5560f40943b0 0x5560f44653c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:49.133 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.127+0000 7f5860e26740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560f409c590 0x5560f4464540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:49.133 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.127+0000 7f5860e26740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560f40bd270 0x5560f44a0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:49.133 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.127+0000 7f5860e26740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5560f4137620 con 0x5560f409c590 2024-09-21T03:24:49.133 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.127+0000 7f5860e26740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5560f436c5f0 con 0x5560f40bd270 2024-09-21T03:24:49.133 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.127+0000 7f5860e26740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5560f4462f80 con 0x5560f40943b0 2024-09-21T03:24:49.133 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.127+0000 7f5860e26740 10 client.0 _ll_register_callbacks cb 0x5560f43700a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:24:49.133 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.127+0000 7f5852ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560f409c590 0x5560f4464540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:49.133 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.127+0000 7f5852ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560f409c590 0x5560f4464540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:60624/0 (socket says 172.21.15.105:60624) 2024-09-21T03:24:49.133 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.127+0000 7f5852ffd640 1 -- 172.21.15.105:0/3115077843 learned_addr learned my addr 172.21.15.105:0/3115077843 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:49.133 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.127+0000 7f58537fe640 1 --2- 172.21.15.105:0/3115077843 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5560f40943b0 0x5560f44653c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:49.133 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.127+0000 7f5852ffd640 1 -- 172.21.15.105:0/3115077843 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5560f40943b0 msgr2=0x5560f44653c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:24:49.134 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.127+0000 7f5853fff640 1 --2- 172.21.15.105:0/3115077843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560f40bd270 0x5560f44a0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:49.134 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.128+0000 7f5852ffd640 1 --2- 172.21.15.105:0/3115077843 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5560f40943b0 0x5560f44653c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.134 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.128+0000 7f5852ffd640 1 -- 172.21.15.105:0/3115077843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560f40bd270 msgr2=0x5560f44a0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:24:49.134 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.128+0000 7f5852ffd640 1 --2- 172.21.15.105:0/3115077843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560f40bd270 0x5560f44a0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.134 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.128+0000 7f5852ffd640 1 -- 172.21.15.105:0/3115077843 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560f419f6b0 con 0x5560f409c590 2024-09-21T03:24:49.134 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.128+0000 7f5853fff640 1 --2- 172.21.15.105:0/3115077843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560f40bd270 0x5560f44a0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:24:49.134 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.128+0000 7f5852ffd640 1 --2- 172.21.15.105:0/3115077843 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560f409c590 0x5560f4464540 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f5848015500 tx=0x7f58480046f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=366ae083ebc92d46 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:49.134 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.128+0000 7f58327fc640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-21T03:24:49.134 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.128+0000 7f58327fc640 1 -- 172.21.15.105:0/3115077843 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5848025070 con 0x5560f409c590 2024-09-21T03:24:49.134 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.128+0000 7f58327fc640 1 -- 172.21.15.105:0/3115077843 <== mon.0 v2:172.21.15.105:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7f5848004020 con 0x5560f409c590 2024-09-21T03:24:49.134 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.128+0000 7f5860e26740 1 -- 172.21.15.105:0/3115077843 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5844066030 con 0x5560f409c590 2024-09-21T03:24:49.134 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.128+0000 7f58327fc640 1 -- 172.21.15.105:0/3115077843 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7f584802f050 con 0x5560f409c590 2024-09-21T03:24:49.134 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.128+0000 7f5860e26740 10 client.7005 fetch_fsmap learned FSMap version 58 2024-09-21T03:24:49.134 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.128+0000 7f5860e26740 1 -- 172.21.15.105:0/3115077843 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) -- 0x5560f4462d70 con 0x5560f409c590 2024-09-21T03:24:49.135 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.128+0000 7f58327fc640 1 -- 172.21.15.105:0/3115077843 <== mon.0 v2:172.21.15.105:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5844066030 con 0x5560f409c590 2024-09-21T03:24:49.135 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.128+0000 7f58327fc640 1 -- 172.21.15.105:0/3115077843 <== mon.0 v2:172.21.15.105:3300/0 5 ==== fsmap(e 58) ==== 3502+0+0 (secure 0 0 0) 0x7f5848032020 con 0x5560f409c590 2024-09-21T03:24:49.135 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.128+0000 7f5860e26740 10 client.7005 fetch_fsmap finished waiting for FSMap version 58 2024-09-21T03:24:49.135 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.128+0000 7f5860e26740 10 client.7005 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T03:24:49.135 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.128+0000 7f5860e26740 20 client.7005 populate_metadata read hostname 'smithi105' 2024-09-21T03:24:49.135 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.128+0000 7f5860e26740 1 --2- 172.21.15.105:0/3115077843 >> [v2:172.21.15.105:6832/636426076,v1:172.21.15.105:6834/636426076] conn(0x5560f407be40 0x5560f44a2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:49.135 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.128+0000 7f5860e26740 4 client.7005 mds_command: new command op to 6840 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:24:49.135 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.128+0000 7f5860e26740 1 -- 172.21.15.105:0/3115077843 --> [v2:172.21.15.105:6832/636426076,v1:172.21.15.105:6834/636426076] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5560f43d9770 con 0x5560f407be40 2024-09-21T03:24:49.135 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.128+0000 7f58537fe640 1 --2- 172.21.15.105:0/3115077843 >> [v2:172.21.15.105:6832/636426076,v1:172.21.15.105:6834/636426076] conn(0x5560f407be40 0x5560f44a2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:49.135 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.129+0000 7f58327fc640 10 client.7005 ms_handle_connect on v2:172.21.15.105:6832/636426076 2024-09-21T03:24:49.135 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.129+0000 7f58537fe640 1 --2- 172.21.15.105:0/3115077843 >> [v2:172.21.15.105:6832/636426076,v1:172.21.15.105:6834/636426076] conn(0x5560f407be40 0x5560f44a2530 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb0255b3c08aaf0c server_cookie=aa4a2596aaad9cde in_seq=0 out_seq=0 2024-09-21T03:24:49.135 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.129+0000 7f58327fc640 1 -- 172.21.15.105:0/3115077843 <== mds.0 v2:172.21.15.105:6832/636426076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5560f43d9770 con 0x5560f407be40 2024-09-21T03:24:49.135 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.129+0000 7f58327fc640 10 client.7005 handle_command_reply: tid=0 2024-09-21T03:24:49.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.130+0000 7f5860e26740 1 client.7005 shutdown 2024-09-21T03:24:49.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.130+0000 7f5860e26740 1 -- 172.21.15.105:0/3115077843 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560f409c590 msgr2=0x5560f4464540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:49.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.130+0000 7f5860e26740 1 --2- 172.21.15.105:0/3115077843 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560f409c590 0x5560f4464540 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f5848015500 tx=0x7f58480046f0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.130+0000 7f5860e26740 1 -- 172.21.15.105:0/3115077843 shutdown_connections 2024-09-21T03:24:49.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.130+0000 7f5860e26740 1 --2- 172.21.15.105:0/3115077843 >> [v2:172.21.15.105:6832/636426076,v1:172.21.15.105:6834/636426076] conn(0x5560f407be40 0x5560f44a2530 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.130+0000 7f5860e26740 1 --2- 172.21.15.105:0/3115077843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560f40bd270 0x5560f44a0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.130+0000 7f5860e26740 1 --2- 172.21.15.105:0/3115077843 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560f409c590 0x5560f4464540 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.130+0000 7f58327fc640 0 client.7005 ms_handle_reset on v2:172.21.15.105:6832/636426076 2024-09-21T03:24:49.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.130+0000 7f5860e26740 1 --2- 172.21.15.105:0/3115077843 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5560f40943b0 0x5560f44653c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.130+0000 7f5860e26740 1 -- 172.21.15.105:0/3115077843 >> 172.21.15.105:0/3115077843 conn(0x5560f40b13c0 msgr2=0x5560f448eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:49.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.130+0000 7f5860e26740 1 -- 172.21.15.105:0/3115077843 shutdown_connections 2024-09-21T03:24:49.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.130+0000 7f5860e26740 1 -- 172.21.15.105:0/3115077843 wait complete. 2024-09-21T03:24:49.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.130+0000 7f5860e26740 20 client.7005 trim_cache size 0 max 16384 2024-09-21T03:24:49.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.148+0000 7f5860e26740 1 Processor -- start 2024-09-21T03:24:49.150 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.148+0000 7f5860e26740 1 -- start start 2024-09-21T03:24:49.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.149+0000 7f5860e26740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560f40943b0 0x5560f448bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:49.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.149+0000 7f5860e26740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5560f409c590 0x5560f448c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:49.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.149+0000 7f5860e26740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560f40bd270 0x5560f44d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:49.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.149+0000 7f5860e26740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f58540cce90 con 0x5560f40bd270 2024-09-21T03:24:49.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.149+0000 7f5860e26740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f58541f4280 con 0x5560f40943b0 2024-09-21T03:24:49.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.149+0000 7f5860e26740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f585409b810 con 0x5560f409c590 2024-09-21T03:24:49.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.149+0000 7f5853fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560f40bd270 0x5560f44d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:49.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.149+0000 7f5853fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560f40bd270 0x5560f44d0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:60630/0 (socket says 172.21.15.105:60630) 2024-09-21T03:24:49.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.149+0000 7f5853fff640 1 -- 172.21.15.105:0/2052582412 learned_addr learned my addr 172.21.15.105:0/2052582412 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:49.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.150+0000 7f5853fff640 1 -- 172.21.15.105:0/2052582412 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5560f409c590 msgr2=0x5560f448c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:24:49.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.150+0000 7f58537fe640 1 --2- 172.21.15.105:0/2052582412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560f40943b0 0x5560f448bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:49.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.150+0000 7f5852ffd640 1 --2- 172.21.15.105:0/2052582412 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5560f409c590 0x5560f448c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:49.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.150+0000 7f5853fff640 1 --2- 172.21.15.105:0/2052582412 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5560f409c590 0x5560f448c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.150+0000 7f5853fff640 1 -- 172.21.15.105:0/2052582412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560f40943b0 msgr2=0x5560f448bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:24:49.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.150+0000 7f5853fff640 1 --2- 172.21.15.105:0/2052582412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560f40943b0 0x5560f448bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.150+0000 7f5853fff640 1 -- 172.21.15.105:0/2052582412 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560f447eeb0 con 0x5560f40bd270 2024-09-21T03:24:49.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.150+0000 7f58537fe640 1 --2- 172.21.15.105:0/2052582412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560f40943b0 0x5560f448bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:24:49.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.150+0000 7f5852ffd640 1 --2- 172.21.15.105:0/2052582412 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5560f409c590 0x5560f448c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:24:49.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.150+0000 7f5853fff640 1 --2- 172.21.15.105:0/2052582412 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560f40bd270 0x5560f44d0a50 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f584c009ca0 tx=0x7f584c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7cd89bceee8e512 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:49.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.150+0000 7f5838ff9640 1 -- 172.21.15.105:0/2052582412 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584c003d10 con 0x5560f40bd270 2024-09-21T03:24:49.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.150+0000 7f5838ff9640 1 -- 172.21.15.105:0/2052582412 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f584c0306c0 con 0x5560f40bd270 2024-09-21T03:24:49.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.150+0000 7f5838ff9640 1 -- 172.21.15.105:0/2052582412 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584c030a90 con 0x5560f40bd270 2024-09-21T03:24:49.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.151+0000 7f5860e26740 1 -- 172.21.15.105:0/2052582412 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560f40bd270 msgr2=0x5560f44d0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:49.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.151+0000 7f5860e26740 1 --2- 172.21.15.105:0/2052582412 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560f40bd270 0x5560f44d0a50 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f584c009ca0 tx=0x7f584c004a40 comp rx=0 tx=0).stop 2024-09-21T03:24:49.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.151+0000 7f5860e26740 1 -- 172.21.15.105:0/2052582412 shutdown_connections 2024-09-21T03:24:49.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.151+0000 7f5860e26740 1 --2- 172.21.15.105:0/2052582412 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560f40bd270 0x5560f44d0a50 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.151+0000 7f5860e26740 1 --2- 172.21.15.105:0/2052582412 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5560f409c590 0x5560f448c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.151+0000 7f5860e26740 1 --2- 172.21.15.105:0/2052582412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560f40943b0 0x5560f448bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.151+0000 7f5860e26740 1 -- 172.21.15.105:0/2052582412 >> 172.21.15.105:0/2052582412 conn(0x5560f40b13c0 msgr2=0x5560f44609e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:49.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.151+0000 7f5860e26740 1 -- 172.21.15.105:0/2052582412 shutdown_connections 2024-09-21T03:24:49.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.151+0000 7f5860e26740 1 -- 172.21.15.105:0/2052582412 wait complete. 2024-09-21T03:24:49.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.152+0000 7f5860e26740 1 -- start start 2024-09-21T03:24:49.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.152+0000 7f5860e26740 1 Processor -- start 2024-09-21T03:24:49.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.153+0000 7f5860e26740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5560f40943b0 0x5560f4526d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:49.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.153+0000 7f5860e26740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560f409c590 0x5560f448bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:49.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.153+0000 7f5860e26740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560f40bd270 0x5560f448c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:49.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.153+0000 7f5860e26740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5560f44bcfc0 con 0x5560f40bd270 2024-09-21T03:24:49.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.153+0000 7f5860e26740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5560f44a1980 con 0x5560f409c590 2024-09-21T03:24:49.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.153+0000 7f5860e26740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5560f44bd610 con 0x5560f40943b0 2024-09-21T03:24:49.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.153+0000 7f5860e26740 10 client.0 _ll_register_callbacks cb 0x7f58480095b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:24:49.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.153+0000 7f5853fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560f40bd270 0x5560f448c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:49.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.153+0000 7f5853fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560f40bd270 0x5560f448c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:60636/0 (socket says 172.21.15.105:60636) 2024-09-21T03:24:49.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.153+0000 7f5853fff640 1 -- 172.21.15.105:0/2566383018 learned_addr learned my addr 172.21.15.105:0/2566383018 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:49.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.154+0000 7f58537fe640 1 --2- 172.21.15.105:0/2566383018 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5560f40943b0 0x5560f4526d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:49.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.154+0000 7f5852ffd640 1 --2- 172.21.15.105:0/2566383018 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560f409c590 0x5560f448bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:49.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.154+0000 7f5853fff640 1 -- 172.21.15.105:0/2566383018 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5560f40943b0 msgr2=0x5560f4526d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:24:49.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.154+0000 7f5853fff640 1 --2- 172.21.15.105:0/2566383018 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5560f40943b0 0x5560f4526d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.154+0000 7f5853fff640 1 -- 172.21.15.105:0/2566383018 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560f409c590 msgr2=0x5560f448bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:24:49.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.154+0000 7f5853fff640 1 --2- 172.21.15.105:0/2566383018 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560f409c590 0x5560f448bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.154+0000 7f5853fff640 1 -- 172.21.15.105:0/2566383018 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560f44a0d90 con 0x5560f40bd270 2024-09-21T03:24:49.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.154+0000 7f58537fe640 1 --2- 172.21.15.105:0/2566383018 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5560f40943b0 0x5560f4526d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:24:49.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.154+0000 7f5852ffd640 1 --2- 172.21.15.105:0/2566383018 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560f409c590 0x5560f448bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:24:49.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.154+0000 7f5853fff640 1 --2- 172.21.15.105:0/2566383018 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560f40bd270 0x5560f448c170 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f584c042040 tx=0x7f584c03a670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5f41e57e41a4335 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:49.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.154+0000 7f58327fc640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-21T03:24:49.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.154+0000 7f58327fc640 1 -- 172.21.15.105:0/2566383018 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584c049070 con 0x5560f40bd270 2024-09-21T03:24:49.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.154+0000 7f58327fc640 1 -- 172.21.15.105:0/2566383018 <== mon.0 v2:172.21.15.105:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7f584c03abf0 con 0x5560f40bd270 2024-09-21T03:24:49.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.154+0000 7f5860e26740 1 -- 172.21.15.105:0/2566383018 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f584c0306c0 con 0x5560f40bd270 2024-09-21T03:24:49.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.154+0000 7f58327fc640 1 -- 172.21.15.105:0/2566383018 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7f584c03adf0 con 0x5560f40bd270 2024-09-21T03:24:49.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.154+0000 7f5860e26740 10 client.7011 fetch_fsmap learned FSMap version 58 2024-09-21T03:24:49.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.154+0000 7f5860e26740 1 -- 172.21.15.105:0/2566383018 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) -- 0x5560f4530730 con 0x5560f40bd270 2024-09-21T03:24:49.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.154+0000 7f58327fc640 1 -- 172.21.15.105:0/2566383018 <== mon.0 v2:172.21.15.105:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f584c0306c0 con 0x5560f40bd270 2024-09-21T03:24:49.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.154+0000 7f58327fc640 1 -- 172.21.15.105:0/2566383018 <== mon.0 v2:172.21.15.105:3300/0 5 ==== fsmap(e 58) ==== 3502+0+0 (secure 0 0 0) 0x7f584c02f070 con 0x5560f40bd270 2024-09-21T03:24:49.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.154+0000 7f5860e26740 10 client.7011 fetch_fsmap finished waiting for FSMap version 58 2024-09-21T03:24:49.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.154+0000 7f5860e26740 10 client.7011 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T03:24:49.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.154+0000 7f5860e26740 20 client.7011 populate_metadata read hostname 'smithi105' 2024-09-21T03:24:49.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.154+0000 7f5860e26740 1 --2- 172.21.15.105:0/2566383018 >> [v2:172.21.15.105:6832/636426076,v1:172.21.15.105:6834/636426076] conn(0x5560f44a32f0 0x5560f4485a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:49.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.154+0000 7f5860e26740 4 client.7011 mds_command: new command op to 6840 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T03:24:49.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.154+0000 7f5860e26740 1 -- 172.21.15.105:0/2566383018 --> [v2:172.21.15.105:6832/636426076,v1:172.21.15.105:6834/636426076] -- command(tid 0: {"prefix": "status"}) -- 0x5560f44602b0 con 0x5560f44a32f0 2024-09-21T03:24:49.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.155+0000 7f58537fe640 1 --2- 172.21.15.105:0/2566383018 >> [v2:172.21.15.105:6832/636426076,v1:172.21.15.105:6834/636426076] conn(0x5560f44a32f0 0x5560f4485a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:49.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.155+0000 7f58327fc640 10 client.7011 ms_handle_connect on v2:172.21.15.105:6832/636426076 2024-09-21T03:24:49.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.155+0000 7f58537fe640 1 --2- 172.21.15.105:0/2566383018 >> [v2:172.21.15.105:6832/636426076,v1:172.21.15.105:6834/636426076] conn(0x5560f44a32f0 0x5560f4485a40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a68631eace6f7b5 server_cookie=3c3b261fad9c2655 in_seq=0 out_seq=0 2024-09-21T03:24:49.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.155+0000 7f58327fc640 1 -- 172.21.15.105:0/2566383018 <== mds.0 v2:172.21.15.105:6832/636426076 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5560f44602b0 con 0x5560f44a32f0 2024-09-21T03:24:49.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.155+0000 7f58327fc640 10 client.7011 handle_command_reply: tid=0 2024-09-21T03:24:49.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.155+0000 7f5860e26740 1 client.7011 shutdown 2024-09-21T03:24:49.162 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.155+0000 7f5860e26740 1 -- 172.21.15.105:0/2566383018 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560f40bd270 msgr2=0x5560f448c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:49.162 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.155+0000 7f5860e26740 1 --2- 172.21.15.105:0/2566383018 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560f40bd270 0x5560f448c170 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f584c042040 tx=0x7f584c03a670 comp rx=0 tx=0).stop 2024-09-21T03:24:49.162 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.155+0000 7f5860e26740 1 -- 172.21.15.105:0/2566383018 shutdown_connections 2024-09-21T03:24:49.162 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.155+0000 7f5860e26740 1 --2- 172.21.15.105:0/2566383018 >> [v2:172.21.15.105:6832/636426076,v1:172.21.15.105:6834/636426076] conn(0x5560f44a32f0 0x5560f4485a40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.162 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.155+0000 7f5860e26740 1 --2- 172.21.15.105:0/2566383018 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5560f40bd270 0x5560f448c170 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.162 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.155+0000 7f5860e26740 1 --2- 172.21.15.105:0/2566383018 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5560f409c590 0x5560f448bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.162 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.155+0000 7f58327fc640 0 client.7011 ms_handle_reset on v2:172.21.15.105:6832/636426076 2024-09-21T03:24:49.162 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.155+0000 7f5860e26740 1 --2- 172.21.15.105:0/2566383018 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5560f40943b0 0x5560f4526d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.162 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.155+0000 7f5860e26740 1 -- 172.21.15.105:0/2566383018 >> 172.21.15.105:0/2566383018 conn(0x5560f40b13c0 msgr2=0x5560f447bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:49.162 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.155+0000 7f5860e26740 1 -- 172.21.15.105:0/2566383018 shutdown_connections 2024-09-21T03:24:49.162 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.155+0000 7f5860e26740 1 -- 172.21.15.105:0/2566383018 wait complete. 2024-09-21T03:24:49.162 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.155+0000 7f5860e26740 20 client.7011 trim_cache size 0 max 16384 2024-09-21T03:24:49.163 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-21T03:24:49.163 INFO:teuthology.orchestra.run.smithi105.stdout: "cluster_fsid": "29d80f4f-e5de-4b26-8384-24c2d8019945", 2024-09-21T03:24:49.163 INFO:teuthology.orchestra.run.smithi105.stdout: "whoami": 0, 2024-09-21T03:24:49.163 INFO:teuthology.orchestra.run.smithi105.stdout: "id": 6840, 2024-09-21T03:24:49.163 INFO:teuthology.orchestra.run.smithi105.stdout: "want_state": "up:active", 2024-09-21T03:24:49.163 INFO:teuthology.orchestra.run.smithi105.stdout: "state": "up:active", 2024-09-21T03:24:49.163 INFO:teuthology.orchestra.run.smithi105.stdout: "fs_name": "cephfs", 2024-09-21T03:24:49.163 INFO:teuthology.orchestra.run.smithi105.stdout: "rank_uptime": 10.159641584999999, 2024-09-21T03:24:49.163 INFO:teuthology.orchestra.run.smithi105.stdout: "mdsmap_epoch": 58, 2024-09-21T03:24:49.163 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_epoch": 93, 2024-09-21T03:24:49.163 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_epoch_barrier": 93, 2024-09-21T03:24:49.163 INFO:teuthology.orchestra.run.smithi105.stdout: "uptime": 14.858571634 2024-09-21T03:24:49.164 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-21T03:24:49.164 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.156+0000 7f5859ddf640 1 -- 172.21.15.105:0/522536131 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5840078b90 msgr2=0x7f584007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:49.164 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.156+0000 7f5859ddf640 1 --2- 172.21.15.105:0/522536131 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5840078b90 0x7f584007b0a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f58540b6210 tx=0x7f5848009060 comp rx=0 tx=0).stop 2024-09-21T03:24:49.164 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.156+0000 7f5859ddf640 1 -- 172.21.15.105:0/522536131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58540ce7d0 msgr2=0x7f58540b38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:49.165 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.156+0000 7f5859ddf640 1 --2- 172.21.15.105:0/522536131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58540ce7d0 0x7f58540b38e0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f584400c3c0 tx=0x7f584400c880 comp rx=0 tx=0).stop 2024-09-21T03:24:49.165 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.156+0000 7f5859ddf640 1 -- 172.21.15.105:0/522536131 shutdown_connections 2024-09-21T03:24:49.165 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.156+0000 7f5859ddf640 1 --2- 172.21.15.105:0/522536131 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5840078b90 0x7f584007b0a0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.165 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.156+0000 7f5859ddf640 1 --2- 172.21.15.105:0/522536131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58540aeca0 0x7f58541f32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.165 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.156+0000 7f5859ddf640 1 --2- 172.21.15.105:0/522536131 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58541600a0 0x7f58540ae760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.165 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.156+0000 7f5859ddf640 1 --2- 172.21.15.105:0/522536131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58540ce7d0 0x7f58540b38e0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.165 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.156+0000 7f5859ddf640 1 -- 172.21.15.105:0/522536131 >> 172.21.15.105:0/522536131 conn(0x7f58540cdcb0 msgr2=0x7f585406cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:49.165 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.156+0000 7f5859ddf640 1 -- 172.21.15.105:0/522536131 shutdown_connections 2024-09-21T03:24:49.165 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.156+0000 7f5859ddf640 1 -- 172.21.15.105:0/522536131 wait complete. 2024-09-21T03:24:49.169 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T03:24:49.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.278+0000 7fb214f7b640 1 -- 172.21.15.105:0/2478090499 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2100d12c0 msgr2=0x7fb2100d16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:49.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.278+0000 7fb214f7b640 1 --2- 172.21.15.105:0/2478090499 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2100d12c0 0x7fb2100d16d0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fb2100724e0 tx=0x7fb20802aac0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.278+0000 7fb214f7b640 1 -- 172.21.15.105:0/2478090499 shutdown_connections 2024-09-21T03:24:49.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.278+0000 7fb214f7b640 1 --2- 172.21.15.105:0/2478090499 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2100d12c0 0x7fb2100d16d0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.278+0000 7fb214f7b640 1 --2- 172.21.15.105:0/2478090499 >> v2:172.21.15.162:3300/0 conn(0x7fb2100ccbd0 0x7fb2100d0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.278+0000 7fb214f7b640 1 -- 172.21.15.105:0/2478090499 >> 172.21.15.105:0/2478090499 conn(0x7fb210072ae0 msgr2=0x7fb210072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:49.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.278+0000 7fb214f7b640 1 -- 172.21.15.105:0/2478090499 shutdown_connections 2024-09-21T03:24:49.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.278+0000 7fb214f7b640 1 -- 172.21.15.105:0/2478090499 wait complete. 2024-09-21T03:24:49.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.280+0000 7fb214f7b640 1 Processor -- start 2024-09-21T03:24:49.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.280+0000 7fb214f7b640 1 -- start start 2024-09-21T03:24:49.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.282+0000 7fb214f7b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2100b51c0 0x7fb21006f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:49.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.282+0000 7fb214f7b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2100ccbd0 0x7fb21014e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:49.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.282+0000 7fb214f7b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2100d12c0 0x7fb2100abd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:49.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.282+0000 7fb214f7b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb2100cf1d0 con 0x7fb2100ccbd0 2024-09-21T03:24:49.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.282+0000 7fb214f7b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb2100cf050 con 0x7fb2100d12c0 2024-09-21T03:24:49.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.282+0000 7fb214f7b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb2100cf350 con 0x7fb2100b51c0 2024-09-21T03:24:49.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.282+0000 7fb205d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2100ccbd0 0x7fb21014e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:49.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.282+0000 7fb205d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2100ccbd0 0x7fb21014e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:60654/0 (socket says 172.21.15.105:60654) 2024-09-21T03:24:49.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.282+0000 7fb205d9b640 1 -- 172.21.15.105:0/1188593417 learned_addr learned my addr 172.21.15.105:0/1188593417 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:49.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.282+0000 7fb20ed9d640 1 --2- 172.21.15.105:0/1188593417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2100d12c0 0x7fb2100abd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:49.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.282+0000 7fb20e59c640 1 --2- 172.21.15.105:0/1188593417 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2100b51c0 0x7fb21006f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:49.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.282+0000 7fb205d9b640 1 -- 172.21.15.105:0/1188593417 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2100b51c0 msgr2=0x7fb21006f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:49.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.282+0000 7fb205d9b640 1 --2- 172.21.15.105:0/1188593417 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2100b51c0 0x7fb21006f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.282+0000 7fb205d9b640 1 -- 172.21.15.105:0/1188593417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2100d12c0 msgr2=0x7fb2100abd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:49.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.282+0000 7fb205d9b640 1 --2- 172.21.15.105:0/1188593417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2100d12c0 0x7fb2100abd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.282+0000 7fb205d9b640 1 -- 172.21.15.105:0/1188593417 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb21006e290 con 0x7fb2100ccbd0 2024-09-21T03:24:49.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.282+0000 7fb205d9b640 1 --2- 172.21.15.105:0/1188593417 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2100ccbd0 0x7fb21014e9a0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fb1f800d740 tx=0x7fb1f800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:49.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.282+0000 7fb2077fe640 1 -- 172.21.15.105:0/1188593417 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f8017070 con 0x7fb2100ccbd0 2024-09-21T03:24:49.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.282+0000 7fb2077fe640 1 -- 172.21.15.105:0/1188593417 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1f8009d20 con 0x7fb2100ccbd0 2024-09-21T03:24:49.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.282+0000 7fb214f7b640 1 -- 172.21.15.105:0/1188593417 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb21006e570 con 0x7fb2100ccbd0 2024-09-21T03:24:49.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.282+0000 7fb2077fe640 1 -- 172.21.15.105:0/1188593417 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f80106c0 con 0x7fb2100ccbd0 2024-09-21T03:24:49.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.283+0000 7fb214f7b640 1 -- 172.21.15.105:0/1188593417 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb21006eb30 con 0x7fb2100ccbd0 2024-09-21T03:24:49.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.283+0000 7fb214f7b640 1 -- 172.21.15.105:0/1188593417 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb21006ef90 con 0x7fb2100ccbd0 2024-09-21T03:24:49.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.284+0000 7fb2077fe640 1 -- 172.21.15.105:0/1188593417 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb1f801a070 con 0x7fb2100ccbd0 2024-09-21T03:24:49.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.285+0000 7fb2077fe640 1 --2- 172.21.15.105:0/1188593417 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb1f0078b90 0x7fb1f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:49.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.285+0000 7fb2077fe640 1 -- 172.21.15.105:0/1188593417 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7fb1f809add0 con 0x7fb2100ccbd0 2024-09-21T03:24:49.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.285+0000 7fb20e59c640 1 --2- 172.21.15.105:0/1188593417 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb1f0078b90 0x7fb1f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:49.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.286+0000 7fb20e59c640 1 --2- 172.21.15.105:0/1188593417 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb1f0078b90 0x7fb1f007b0a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb2000015e0 tx=0x7fb200009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:49.291 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.289+0000 7fb2077fe640 1 -- 172.21.15.105:0/1188593417 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb1f8062c50 con 0x7fb2100ccbd0 2024-09-21T03:24:49.506 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.505+0000 7fb214f7b640 1 -- 172.21.15.105:0/1188593417 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb2100cf800 con 0x7fb2100ccbd0 2024-09-21T03:24:49.507 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.505+0000 7fb2077fe640 1 -- 172.21.15.105:0/1188593417 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v58) ==== 53+0+73 (secure 0 0 0) 0x7fb1f8067680 con 0x7fb2100ccbd0 2024-09-21T03:24:49.507 INFO:teuthology.orchestra.run.smithi105.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T03:24:49.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.507+0000 7fb214f7b640 1 -- 172.21.15.105:0/1188593417 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb1f0078b90 msgr2=0x7fb1f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:49.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.507+0000 7fb214f7b640 1 --2- 172.21.15.105:0/1188593417 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb1f0078b90 0x7fb1f007b0a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb2000015e0 tx=0x7fb200009040 comp rx=0 tx=0).stop 2024-09-21T03:24:49.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.507+0000 7fb214f7b640 1 -- 172.21.15.105:0/1188593417 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2100ccbd0 msgr2=0x7fb21014e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:49.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.507+0000 7fb214f7b640 1 --2- 172.21.15.105:0/1188593417 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2100ccbd0 0x7fb21014e9a0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fb1f800d740 tx=0x7fb1f800dc00 comp rx=0 tx=0).stop 2024-09-21T03:24:49.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.507+0000 7fb214f7b640 1 -- 172.21.15.105:0/1188593417 shutdown_connections 2024-09-21T03:24:49.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.507+0000 7fb214f7b640 1 --2- 172.21.15.105:0/1188593417 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb1f0078b90 0x7fb1f007b0a0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.507+0000 7fb214f7b640 1 --2- 172.21.15.105:0/1188593417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2100d12c0 0x7fb2100abd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.510 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.507+0000 7fb214f7b640 1 --2- 172.21.15.105:0/1188593417 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2100ccbd0 0x7fb21014e9a0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.510 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.507+0000 7fb214f7b640 1 --2- 172.21.15.105:0/1188593417 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2100b51c0 0x7fb21006f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:49.510 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.507+0000 7fb214f7b640 1 -- 172.21.15.105:0/1188593417 >> 172.21.15.105:0/1188593417 conn(0x7fb210072ae0 msgr2=0x7fb2100b6150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:49.510 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.507+0000 7fb214f7b640 1 -- 172.21.15.105:0/1188593417 shutdown_connections 2024-09-21T03:24:49.510 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49.507+0000 7fb214f7b640 1 -- 172.21.15.105:0/1188593417 wait complete. 2024-09-21T03:24:49.520 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T03:24:49.520 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T03:24:49.520 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi105.front.sepia.ceph.com 2024-09-21T03:24:49.521 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T03:24:49.521 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T03:24:49.521 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T03:24:49.521 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T03:24:49.521 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T03:24:49.521 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:24:49.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:24:49.521 DEBUG:teuthology.orchestra.run.smithi105:> ip addr 2024-09-21T03:24:49.537 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T03:24:49.537 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T03:24:49.537 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T03:24:49.537 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:24:49.537 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2024-09-21T03:24:49.537 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:24:49.537 INFO:teuthology.orchestra.run.smithi105.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:24:49.537 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b8 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:24:49.537 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f0 2024-09-21T03:24:49.537 INFO:teuthology.orchestra.run.smithi105.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:24:49.537 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b9 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:24:49.537 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f1 2024-09-21T03:24:49.537 INFO:teuthology.orchestra.run.smithi105.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:24:49.538 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:28 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:24:49.538 INFO:teuthology.orchestra.run.smithi105.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T03:24:49.538 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:29 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:24:49.538 INFO:teuthology.orchestra.run.smithi105.stdout: inet 172.21.15.105/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T03:24:49.538 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft 42418sec preferred_lft 42418sec 2024-09-21T03:24:49.538 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::ec4:7aff:fe8f:d429/64 scope link noprefixroute 2024-09-21T03:24:49.538 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:24:49.538 INFO:teuthology.orchestra.run.smithi105.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T03:24:49.538 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 86:15:ed:f2:4e:d8 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:24:49.538 INFO:teuthology.orchestra.run.smithi105.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T03:24:49.538 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:24:49.538 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::80db:6aff:fece:44c2/64 scope link 2024-09-21T03:24:49.538 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:24:49.538 INFO:teuthology.orchestra.run.smithi105.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:24:49.539 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 86:15:ed:f2:4e:d8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T03:24:49.539 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::8415:edff:fef2:4ed8/64 scope link 2024-09-21T03:24:49.539 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:24:49.539 INFO:teuthology.orchestra.run.smithi105.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:24:49.539 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether a2:e9:7c:d4:c7:c7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T03:24:49.539 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::a0e9:7cff:fed4:c7c7/64 scope link 2024-09-21T03:24:49.539 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:24:49.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:24:49.539 DEBUG:teuthology.orchestra.run.smithi105:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T03:24:49.600 INFO:teuthology.orchestra.run.smithi105.stdout:1 2024-09-21T03:24:49.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:24:49.602 DEBUG:teuthology.orchestra.run.smithi105:> route 2024-09-21T03:24:49.658 INFO:teuthology.orchestra.run.smithi105.stdout:Kernel IP routing table 2024-09-21T03:24:49.659 INFO:teuthology.orchestra.run.smithi105.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T03:24:49.659 INFO:teuthology.orchestra.run.smithi105.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T03:24:49.659 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T03:24:49.659 INFO:teuthology.orchestra.run.smithi105.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T03:24:49.659 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:24:49.659 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-21T03:24:49.659 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T03:24:49.659 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T03:24:49.659 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T03:24:49.660 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-21T03:24:49.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:24:49.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:24:49.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:24:49.784 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-09-21T03:24:49.799 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T03:24:49.800 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T03:24:49.800 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:24:49.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:24:49.800 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set brx.0 up 2024-09-21T03:24:49.865 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:24:49.865 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T03:24:49.920 INFO:teuthology.orchestra.run.smithi105.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:24:49.921 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:24:49.921 DEBUG:teuthology.orchestra.run.smithi105:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T03:24:49.975 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-21T03:24:49.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:24:49.975 DEBUG:teuthology.orchestra.run.smithi105:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:24:50.069 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:24:50.069 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T03:24:50.069 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2024-09-21T03:24:50.080 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:24:50.080 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T03:24:50.080 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2024-09-21T03:24:50.080 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:24:50.080 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:24:50.086 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:24:50.086 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T03:24:50.086 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2024-09-21T03:24:50.086 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:24:50.086 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:24:50.086 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-21T03:24:50.086 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-21T03:24:50.086 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=29d80f4f-e5de-4b26-8384-24c2d8019945" will pass to kernel 2024-09-21T03:24:50.087 INFO:teuthology.orchestra.run.smithi105.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T03:24:50.087 INFO:teuthology.orchestra.run.smithi105.stdout: You just mounted a file system that supports labels which does not 2024-09-21T03:24:50.087 INFO:teuthology.orchestra.run.smithi105.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T03:24:50.087 INFO:teuthology.orchestra.run.smithi105.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T03:24:50.087 INFO:teuthology.orchestra.run.smithi105.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T03:24:50.089 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T03:24:50.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:24:50.089 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T03:24:50.113 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:24:50.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:24:50.207 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:24:50.213 INFO:teuthology.orchestra.run.smithi105.stdout:client5888 2024-09-21T03:24:50.213 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:24:50.213 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:24:50.229 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T03:24:50.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.380+0000 7f9e5804d640 1 -- 172.21.15.105:0/3613711571 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e500b40a0 msgr2=0x7f9e50167450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:50.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.380+0000 7f9e5804d640 1 --2- 172.21.15.105:0/3613711571 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e500b40a0 0x7f9e50167450 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f9e48005fd0 tx=0x7f9e4802a940 comp rx=0 tx=0).stop 2024-09-21T03:24:50.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.380+0000 7f9e5804d640 1 -- 172.21.15.105:0/3613711571 shutdown_connections 2024-09-21T03:24:50.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.380+0000 7f9e5804d640 1 --2- 172.21.15.105:0/3613711571 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e500b40a0 0x7f9e50167450 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:50.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.380+0000 7f9e5804d640 1 -- 172.21.15.105:0/3613711571 >> 172.21.15.105:0/3613711571 conn(0x7f9e500b1cb0 msgr2=0x7f9e500b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:50.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.380+0000 7f9e5804d640 1 -- 172.21.15.105:0/3613711571 shutdown_connections 2024-09-21T03:24:50.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.380+0000 7f9e5804d640 1 -- 172.21.15.105:0/3613711571 wait complete. 2024-09-21T03:24:50.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.382+0000 7f9e5804d640 1 Processor -- start 2024-09-21T03:24:50.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.382+0000 7f9e5804d640 1 -- start start 2024-09-21T03:24:50.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.383+0000 7f9e5804d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e50070030 0x7f9e500cf440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:50.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.383+0000 7f9e5804d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e50073170 0x7f9e5015d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:50.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.383+0000 7f9e5804d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e500b40a0 0x7f9e5015da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:50.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.383+0000 7f9e5804d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9e50167ba0 con 0x7f9e50070030 2024-09-21T03:24:50.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.383+0000 7f9e5804d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9e50075090 con 0x7f9e50073170 2024-09-21T03:24:50.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.383+0000 7f9e5804d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9e50167d20 con 0x7f9e500b40a0 2024-09-21T03:24:50.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.383+0000 7f9e55de9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e50070030 0x7f9e500cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:50.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.383+0000 7f9e55de9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e50070030 0x7f9e500cf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:60668/0 (socket says 172.21.15.105:60668) 2024-09-21T03:24:50.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.384+0000 7f9e55de9640 1 -- 172.21.15.105:0/3465429050 learned_addr learned my addr 172.21.15.105:0/3465429050 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:50.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.384+0000 7f9e555e8640 1 --2- 172.21.15.105:0/3465429050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e50073170 0x7f9e5015d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:50.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.384+0000 7f9e565ea640 1 --2- 172.21.15.105:0/3465429050 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e500b40a0 0x7f9e5015da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:50.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.384+0000 7f9e55de9640 1 -- 172.21.15.105:0/3465429050 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e500b40a0 msgr2=0x7f9e5015da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:50.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.384+0000 7f9e55de9640 1 --2- 172.21.15.105:0/3465429050 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e500b40a0 0x7f9e5015da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:50.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.384+0000 7f9e55de9640 1 -- 172.21.15.105:0/3465429050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e50073170 msgr2=0x7f9e5015d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:50.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.384+0000 7f9e55de9640 1 --2- 172.21.15.105:0/3465429050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e50073170 0x7f9e5015d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:50.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.384+0000 7f9e55de9640 1 -- 172.21.15.105:0/3465429050 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e5015be90 con 0x7f9e50070030 2024-09-21T03:24:50.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.384+0000 7f9e555e8640 1 --2- 172.21.15.105:0/3465429050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e50073170 0x7f9e5015d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:24:50.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.384+0000 7f9e565ea640 1 --2- 172.21.15.105:0/3465429050 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e500b40a0 0x7f9e5015da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:24:50.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.384+0000 7f9e55de9640 1 --2- 172.21.15.105:0/3465429050 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e50070030 0x7f9e500cf440 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c00c400 tx=0x7f9e4c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:50.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.384+0000 7f9e467fc640 1 -- 172.21.15.105:0/3465429050 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c011790 con 0x7f9e50070030 2024-09-21T03:24:50.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.384+0000 7f9e467fc640 1 -- 172.21.15.105:0/3465429050 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e4c017070 con 0x7f9e50070030 2024-09-21T03:24:50.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.384+0000 7f9e467fc640 1 -- 172.21.15.105:0/3465429050 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c011ce0 con 0x7f9e50070030 2024-09-21T03:24:50.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.384+0000 7f9e5804d640 1 -- 172.21.15.105:0/3465429050 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e5015e7b0 con 0x7f9e50070030 2024-09-21T03:24:50.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.384+0000 7f9e5804d640 1 -- 172.21.15.105:0/3465429050 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e5015ed70 con 0x7f9e50070030 2024-09-21T03:24:50.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.385+0000 7f9e5804d640 1 -- 172.21.15.105:0/3465429050 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e50074640 con 0x7f9e50070030 2024-09-21T03:24:50.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.386+0000 7f9e467fc640 1 -- 172.21.15.105:0/3465429050 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9e4c01c460 con 0x7f9e50070030 2024-09-21T03:24:50.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.386+0000 7f9e467fc640 1 --2- 172.21.15.105:0/3465429050 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9e34078bc0 0x7f9e3407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:50.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.387+0000 7f9e467fc640 1 -- 172.21.15.105:0/3465429050 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7f9e4c09ab60 con 0x7f9e50070030 2024-09-21T03:24:50.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.387+0000 7f9e555e8640 1 --2- 172.21.15.105:0/3465429050 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9e34078bc0 0x7f9e3407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:50.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.387+0000 7f9e555e8640 1 --2- 172.21.15.105:0/3465429050 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9e34078bc0 0x7f9e3407b0d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9e5014e360 tx=0x7f9e40009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:50.393 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.391+0000 7f9e467fc640 1 -- 172.21.15.105:0/3465429050 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9e4c062fa0 con 0x7f9e50070030 2024-09-21T03:24:50.607 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.605+0000 7f9e5804d640 1 -- 172.21.15.105:0/3465429050 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9e500c3860 con 0x7f9e50070030 2024-09-21T03:24:50.607 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.606+0000 7f9e467fc640 1 -- 172.21.15.105:0/3465429050 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v58) ==== 53+0+73 (secure 0 0 0) 0x7f9e4c0628a0 con 0x7f9e50070030 2024-09-21T03:24:50.608 INFO:teuthology.orchestra.run.smithi105.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T03:24:50.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.608+0000 7f9e5804d640 1 -- 172.21.15.105:0/3465429050 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9e34078bc0 msgr2=0x7f9e3407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:50.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.608+0000 7f9e5804d640 1 --2- 172.21.15.105:0/3465429050 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9e34078bc0 0x7f9e3407b0d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9e5014e360 tx=0x7f9e40009040 comp rx=0 tx=0).stop 2024-09-21T03:24:50.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.608+0000 7f9e5804d640 1 -- 172.21.15.105:0/3465429050 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e50070030 msgr2=0x7f9e500cf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:50.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.608+0000 7f9e5804d640 1 --2- 172.21.15.105:0/3465429050 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e50070030 0x7f9e500cf440 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c00c400 tx=0x7f9e4c00c8c0 comp rx=0 tx=0).stop 2024-09-21T03:24:50.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.608+0000 7f9e5804d640 1 -- 172.21.15.105:0/3465429050 shutdown_connections 2024-09-21T03:24:50.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.608+0000 7f9e5804d640 1 --2- 172.21.15.105:0/3465429050 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9e34078bc0 0x7f9e3407b0d0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:50.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.608+0000 7f9e5804d640 1 --2- 172.21.15.105:0/3465429050 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e500b40a0 0x7f9e5015da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:50.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.608+0000 7f9e5804d640 1 --2- 172.21.15.105:0/3465429050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e50073170 0x7f9e5015d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:50.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.608+0000 7f9e5804d640 1 --2- 172.21.15.105:0/3465429050 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e50070030 0x7f9e500cf440 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:50.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.608+0000 7f9e5804d640 1 -- 172.21.15.105:0/3465429050 >> 172.21.15.105:0/3465429050 conn(0x7f9e500b1cb0 msgr2=0x7f9e500b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:50.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.608+0000 7f9e5804d640 1 -- 172.21.15.105:0/3465429050 shutdown_connections 2024-09-21T03:24:50.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:50.608+0000 7f9e5804d640 1 -- 172.21.15.105:0/3465429050 wait complete. 2024-09-21T03:24:50.621 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T03:24:50.621 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T03:24:50.621 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2024-09-21T03:24:50.621 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-21T03:24:50.621 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T03:24:50.621 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T03:24:50.621 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T03:24:50.621 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T03:24:50.621 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T03:24:50.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:24:50.622 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2024-09-21T03:24:50.641 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T03:24:50.641 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T03:24:50.641 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T03:24:50.642 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:24:50.642 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-09-21T03:24:50.642 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:24:50.642 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:24:50.642 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:24:50.642 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f0 2024-09-21T03:24:50.642 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:24:50.642 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:24:50.642 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f1 2024-09-21T03:24:50.642 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:24:50.642 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:24:50.642 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T03:24:50.642 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:24:50.642 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T03:24:50.643 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42410sec preferred_lft 42410sec 2024-09-21T03:24:50.643 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::ec4:7aff:fe88:7f41/64 scope link noprefixroute 2024-09-21T03:24:50.643 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:24:50.643 INFO:teuthology.orchestra.run.smithi162.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T03:24:50.643 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 32:ad:10:1b:86:54 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:24:50.643 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T03:24:50.643 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:24:50.643 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::c03a:6bff:febf:f5a9/64 scope link 2024-09-21T03:24:50.643 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:24:50.643 INFO:teuthology.orchestra.run.smithi162.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:24:50.643 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 32:ad:10:1b:86:54 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T03:24:50.643 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::30ad:10ff:fe1b:8654/64 scope link 2024-09-21T03:24:50.643 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:24:50.643 INFO:teuthology.orchestra.run.smithi162.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:24:50.644 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 6a:62:2d:53:ae:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-21T03:24:50.644 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::6862:2dff:fe53:aec0/64 scope link 2024-09-21T03:24:50.644 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:24:50.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:24:50.644 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T03:24:50.709 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-09-21T03:24:50.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:24:50.711 DEBUG:teuthology.orchestra.run.smithi162:> route 2024-09-21T03:24:50.770 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2024-09-21T03:24:50.771 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T03:24:50.771 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T03:24:50.771 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T03:24:50.771 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T03:24:50.771 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:24:50.771 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-09-21T03:24:50.771 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T03:24:50.771 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T03:24:50.771 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T03:24:50.771 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-09-21T03:24:50.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:24:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:24:50.898 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:24:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:24:50.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:24:50.905 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-09-21T03:24:50.920 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-21T03:24:50.920 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-21T03:24:50.920 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T03:24:50.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:24:50.921 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.0 up 2024-09-21T03:24:50.986 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:24:50.986 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-21T03:24:51.042 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-21T03:24:51.042 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:24:51.042 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-21T03:24:51.097 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-21T03:24:51.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:24:51.097 DEBUG:teuthology.orchestra.run.smithi162:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:24:51.191 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:24:51.191 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T03:24:51.191 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-21T03:24:51.202 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:24:51.202 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T03:24:51.202 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-21T03:24:51.202 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:24:51.202 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:24:51.208 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:24:51.208 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T03:24:51.208 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-21T03:24:51.208 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:24:51.208 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:24:51.208 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-21T03:24:51.208 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-21T03:24:51.208 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=29d80f4f-e5de-4b26-8384-24c2d8019945" will pass to kernel 2024-09-21T03:24:51.210 INFO:teuthology.orchestra.run.smithi162.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-21T03:24:51.210 INFO:teuthology.orchestra.run.smithi162.stdout: You just mounted a file system that supports labels which does not 2024-09-21T03:24:51.210 INFO:teuthology.orchestra.run.smithi162.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T03:24:51.210 INFO:teuthology.orchestra.run.smithi162.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T03:24:51.210 INFO:teuthology.orchestra.run.smithi162.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T03:24:51.211 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T03:24:51.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:24:51.211 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-21T03:24:51.235 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:24:51.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:24:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:24:51.326 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:24:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:24:51.331 INFO:teuthology.orchestra.run.smithi162.stdout:client5894 2024-09-21T03:24:51.331 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:24:51.331 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:24:51.347 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T03:24:51.348 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T03:24:51.400 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T03:24:51.437 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T03:24:51.437 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T03:24:51.437 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:24:51.437 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:24:51.454 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:24:51.454 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:24:51.511 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T03:24:51.665 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.664+0000 7fc31472b640 1 -- 172.21.15.105:0/3762767717 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc30c070af0 msgr2=0x7fc30c070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:51.666 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.664+0000 7fc31472b640 1 --2- 172.21.15.105:0/3762767717 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc30c070af0 0x7fc30c070f00 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fc30c074440 tx=0x7fc30402a4a0 comp rx=0 tx=0).stop 2024-09-21T03:24:51.666 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.664+0000 7fc31472b640 1 -- 172.21.15.105:0/3762767717 shutdown_connections 2024-09-21T03:24:51.666 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.664+0000 7fc31472b640 1 --2- 172.21.15.105:0/3762767717 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc30c070af0 0x7fc30c070f00 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:51.666 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.664+0000 7fc31472b640 1 --2- 172.21.15.105:0/3762767717 >> v2:172.21.15.162:3300/0 conn(0x7fc30c0b4090 0x7fc30c0b44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:51.666 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.664+0000 7fc31472b640 1 -- 172.21.15.105:0/3762767717 >> 172.21.15.105:0/3762767717 conn(0x7fc30c0cdcc0 msgr2=0x7fc30c0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:51.666 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.664+0000 7fc31472b640 1 -- 172.21.15.105:0/3762767717 shutdown_connections 2024-09-21T03:24:51.666 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.664+0000 7fc31472b640 1 -- 172.21.15.105:0/3762767717 wait complete. 2024-09-21T03:24:51.667 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.665+0000 7fc31472b640 1 Processor -- start 2024-09-21T03:24:51.667 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.666+0000 7fc31472b640 1 -- start start 2024-09-21T03:24:51.670 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.667+0000 7fc31472b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc30c070af0 0x7fc30c09e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:51.670 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.667+0000 7fc31472b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc30c0b4090 0x7fc30c09b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:51.670 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.667+0000 7fc31472b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc30c0adf30 0x7fc30c09bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:51.670 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.667+0000 7fc31472b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc30c071800 con 0x7fc30c0adf30 2024-09-21T03:24:51.670 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.667+0000 7fc31472b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc30c071680 con 0x7fc30c0b4090 2024-09-21T03:24:51.670 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.667+0000 7fc31472b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc30c071980 con 0x7fc30c070af0 2024-09-21T03:24:51.670 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.667+0000 7fc312cc8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc30c0adf30 0x7fc30c09bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:51.670 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.667+0000 7fc312cc8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc30c0adf30 0x7fc30c09bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:53196/0 (socket says 172.21.15.105:53196) 2024-09-21T03:24:51.670 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.667+0000 7fc312cc8640 1 -- 172.21.15.105:0/3993497850 learned_addr learned my addr 172.21.15.105:0/3993497850 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:51.670 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.667+0000 7fc311cc6640 1 --2- 172.21.15.105:0/3993497850 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc30c0b4090 0x7fc30c09b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:51.670 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.667+0000 7fc3124c7640 1 --2- 172.21.15.105:0/3993497850 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc30c070af0 0x7fc30c09e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:51.670 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.667+0000 7fc312cc8640 1 -- 172.21.15.105:0/3993497850 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc30c070af0 msgr2=0x7fc30c09e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:51.671 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.667+0000 7fc312cc8640 1 --2- 172.21.15.105:0/3993497850 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc30c070af0 0x7fc30c09e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:51.671 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.667+0000 7fc312cc8640 1 -- 172.21.15.105:0/3993497850 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc30c0b4090 msgr2=0x7fc30c09b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:51.671 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.667+0000 7fc312cc8640 1 --2- 172.21.15.105:0/3993497850 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc30c0b4090 0x7fc30c09b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:51.671 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.667+0000 7fc312cc8640 1 -- 172.21.15.105:0/3993497850 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc30c0aef40 con 0x7fc30c0adf30 2024-09-21T03:24:51.671 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.667+0000 7fc312cc8640 1 --2- 172.21.15.105:0/3993497850 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc30c0adf30 0x7fc30c09bba0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fc30402aa90 tx=0x7fc304033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:51.671 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.668+0000 7fc302ffd640 1 -- 172.21.15.105:0/3993497850 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc304031d60 con 0x7fc30c0adf30 2024-09-21T03:24:51.671 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.668+0000 7fc302ffd640 1 -- 172.21.15.105:0/3993497850 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc304033e10 con 0x7fc30c0adf30 2024-09-21T03:24:51.671 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.668+0000 7fc31472b640 1 -- 172.21.15.105:0/3993497850 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc30c0ae6a0 con 0x7fc30c0adf30 2024-09-21T03:24:51.671 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.668+0000 7fc302ffd640 1 -- 172.21.15.105:0/3993497850 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc304005280 con 0x7fc30c0adf30 2024-09-21T03:24:51.671 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.668+0000 7fc31472b640 1 -- 172.21.15.105:0/3993497850 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc30c0aec60 con 0x7fc30c0adf30 2024-09-21T03:24:51.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.669+0000 7fc31472b640 1 -- 172.21.15.105:0/3993497850 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc30c0ae3f0 con 0x7fc30c0adf30 2024-09-21T03:24:51.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.669+0000 7fc302ffd640 1 -- 172.21.15.105:0/3993497850 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc304005420 con 0x7fc30c0adf30 2024-09-21T03:24:51.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.670+0000 7fc302ffd640 1 --2- 172.21.15.105:0/3993497850 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc2f0078b90 0x7fc2f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:51.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.670+0000 7fc302ffd640 1 -- 172.21.15.105:0/3993497850 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7fc3040bbf50 con 0x7fc30c0adf30 2024-09-21T03:24:51.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.670+0000 7fc3124c7640 1 --2- 172.21.15.105:0/3993497850 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc2f0078b90 0x7fc2f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:51.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.670+0000 7fc3124c7640 1 --2- 172.21.15.105:0/3993497850 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc2f0078b90 0x7fc2f007b0a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc308007fd0 tx=0x7fc308009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:51.676 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.674+0000 7fc302ffd640 1 -- 172.21.15.105:0/3993497850 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc30403f030 con 0x7fc30c0adf30 2024-09-21T03:24:51.864 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.862+0000 7fc31472b640 1 -- 172.21.15.105:0/3993497850 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc30c075170 con 0x7fc30c0adf30 2024-09-21T03:24:51.864 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.863+0000 7fc302ffd640 1 -- 172.21.15.105:0/3993497850 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v93) ==== 80+0+0 (secure 0 0 0) 0x7fc304084390 con 0x7fc30c0adf30 2024-09-21T03:24:51.865 INFO:teuthology.orchestra.run.smithi105.stderr:listed 0 entries 2024-09-21T03:24:51.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.865+0000 7fc31472b640 1 -- 172.21.15.105:0/3993497850 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc2f0078b90 msgr2=0x7fc2f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:51.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.865+0000 7fc31472b640 1 --2- 172.21.15.105:0/3993497850 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc2f0078b90 0x7fc2f007b0a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc308007fd0 tx=0x7fc308009040 comp rx=0 tx=0).stop 2024-09-21T03:24:51.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.865+0000 7fc31472b640 1 -- 172.21.15.105:0/3993497850 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc30c0adf30 msgr2=0x7fc30c09bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:51.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.865+0000 7fc31472b640 1 --2- 172.21.15.105:0/3993497850 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc30c0adf30 0x7fc30c09bba0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fc30402aa90 tx=0x7fc304033c20 comp rx=0 tx=0).stop 2024-09-21T03:24:51.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.865+0000 7fc31472b640 1 -- 172.21.15.105:0/3993497850 shutdown_connections 2024-09-21T03:24:51.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.865+0000 7fc31472b640 1 --2- 172.21.15.105:0/3993497850 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc2f0078b90 0x7fc2f007b0a0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:51.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.865+0000 7fc31472b640 1 --2- 172.21.15.105:0/3993497850 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc30c0adf30 0x7fc30c09bba0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:51.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.865+0000 7fc31472b640 1 --2- 172.21.15.105:0/3993497850 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc30c0b4090 0x7fc30c09b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:51.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.865+0000 7fc31472b640 1 --2- 172.21.15.105:0/3993497850 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc30c070af0 0x7fc30c09e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:51.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.865+0000 7fc31472b640 1 -- 172.21.15.105:0/3993497850 >> 172.21.15.105:0/3993497850 conn(0x7fc30c0cdcc0 msgr2=0x7fc30c0b51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:51.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.865+0000 7fc31472b640 1 -- 172.21.15.105:0/3993497850 shutdown_connections 2024-09-21T03:24:51.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:51.865+0000 7fc31472b640 1 -- 172.21.15.105:0/3993497850 wait complete. 2024-09-21T03:24:51.878 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T03:24:51.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:24:51.878 DEBUG:teuthology.orchestra.run.smithi105:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T03:24:51.906 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi105.front.sepia.ceph.com 2024-09-21T03:24:51.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:24:51.906 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T03:24:51.962 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T03:24:51.962 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:24:51.962 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:24:51.978 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:24:51.979 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:24:52.035 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T03:24:52.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.145+0000 7f6bfcdc3640 1 -- 172.21.15.105:0/3092847914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bf80cff70 msgr2=0x7f6bf815c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:52.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.145+0000 7f6bfcdc3640 1 --2- 172.21.15.105:0/3092847914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bf80cff70 0x7f6bf815c830 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6be8005fd0 tx=0x7f6be802a840 comp rx=0 tx=0).stop 2024-09-21T03:24:52.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.145+0000 7f6bfcdc3640 1 -- 172.21.15.105:0/3092847914 shutdown_connections 2024-09-21T03:24:52.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.145+0000 7f6bfcdc3640 1 --2- 172.21.15.105:0/3092847914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bf80cff70 0x7f6bf815c830 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:52.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.145+0000 7f6bfcdc3640 1 -- 172.21.15.105:0/3092847914 >> 172.21.15.105:0/3092847914 conn(0x7f6bf80cee20 msgr2=0x7f6bf80cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:52.148 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.145+0000 7f6bfcdc3640 1 -- 172.21.15.105:0/3092847914 shutdown_connections 2024-09-21T03:24:52.148 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.145+0000 7f6bfcdc3640 1 -- 172.21.15.105:0/3092847914 wait complete. 2024-09-21T03:24:52.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.147+0000 7f6bfcdc3640 1 Processor -- start 2024-09-21T03:24:52.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.147+0000 7f6bfcdc3640 1 -- start start 2024-09-21T03:24:52.151 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.148+0000 7f6bfcdc3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bf80cff70 0x7f6bf81f3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:52.151 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.148+0000 7f6bfcdc3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6bf8160c90 0x7f6bf81f72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:52.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.148+0000 7f6bfcdc3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bf814f3e0 0x7f6bf80c9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:52.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.149+0000 7f6bfcdc3640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf80d1900 con 0x7f6bf814f3e0 2024-09-21T03:24:52.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.149+0000 7f6bfcdc3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf80d1780 con 0x7f6bf80cff70 2024-09-21T03:24:52.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.149+0000 7f6bfcdc3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6bf80d1a80 con 0x7f6bf8160c90 2024-09-21T03:24:52.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.149+0000 7f6bf6d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bf814f3e0 0x7f6bf80c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:52.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.149+0000 7f6bf6d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bf814f3e0 0x7f6bf80c9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:53202/0 (socket says 172.21.15.105:53202) 2024-09-21T03:24:52.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.149+0000 7f6bf6d9d640 1 -- 172.21.15.105:0/3188075811 learned_addr learned my addr 172.21.15.105:0/3188075811 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:52.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.149+0000 7f6bf659c640 1 --2- 172.21.15.105:0/3188075811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bf80cff70 0x7f6bf81f3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:52.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.149+0000 7f6bf5d9b640 1 --2- 172.21.15.105:0/3188075811 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6bf8160c90 0x7f6bf81f72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:52.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.149+0000 7f6bf6d9d640 1 -- 172.21.15.105:0/3188075811 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6bf8160c90 msgr2=0x7f6bf81f72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:52.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.149+0000 7f6bf6d9d640 1 --2- 172.21.15.105:0/3188075811 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6bf8160c90 0x7f6bf81f72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:52.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.149+0000 7f6bf6d9d640 1 -- 172.21.15.105:0/3188075811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bf80cff70 msgr2=0x7f6bf81f3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:52.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.149+0000 7f6bf6d9d640 1 --2- 172.21.15.105:0/3188075811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bf80cff70 0x7f6bf81f3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:52.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.149+0000 7f6bf6d9d640 1 -- 172.21.15.105:0/3188075811 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bf80c7fb0 con 0x7f6bf814f3e0 2024-09-21T03:24:52.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.149+0000 7f6bf6d9d640 1 --2- 172.21.15.105:0/3188075811 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bf814f3e0 0x7f6bf80c9450 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f6bf000c3f0 tx=0x7f6bf000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:52.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.149+0000 7f6be6ffd640 1 -- 172.21.15.105:0/3188075811 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf0017070 con 0x7f6bf814f3e0 2024-09-21T03:24:52.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.149+0000 7f6be6ffd640 1 -- 172.21.15.105:0/3188075811 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6bf00053c0 con 0x7f6bf814f3e0 2024-09-21T03:24:52.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.149+0000 7f6bfcdc3640 1 -- 172.21.15.105:0/3188075811 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bf80c8290 con 0x7f6bf814f3e0 2024-09-21T03:24:52.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.149+0000 7f6be6ffd640 1 -- 172.21.15.105:0/3188075811 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf0003850 con 0x7f6bf814f3e0 2024-09-21T03:24:52.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.149+0000 7f6bfcdc3640 1 -- 172.21.15.105:0/3188075811 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bf81f6da0 con 0x7f6bf814f3e0 2024-09-21T03:24:52.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.150+0000 7f6bfcdc3640 1 -- 172.21.15.105:0/3188075811 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bf815c830 con 0x7f6bf814f3e0 2024-09-21T03:24:52.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.151+0000 7f6be6ffd640 1 -- 172.21.15.105:0/3188075811 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6bf001a070 con 0x7f6bf814f3e0 2024-09-21T03:24:52.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.152+0000 7f6be6ffd640 1 --2- 172.21.15.105:0/3188075811 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6bd8078b90 0x7f6bd807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:52.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.152+0000 7f6be6ffd640 1 -- 172.21.15.105:0/3188075811 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7f6bf0099eb0 con 0x7f6bf814f3e0 2024-09-21T03:24:52.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.152+0000 7f6bf659c640 1 --2- 172.21.15.105:0/3188075811 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6bd8078b90 0x7f6bd807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:52.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.152+0000 7f6bf659c640 1 --2- 172.21.15.105:0/3188075811 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6bd8078b90 0x7f6bd807b0a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f6be8033000 tx=0x7f6be8004ab0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:52.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.156+0000 7f6be6ffd640 1 -- 172.21.15.105:0/3188075811 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6bf0061e80 con 0x7f6bf814f3e0 2024-09-21T03:24:52.346 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.345+0000 7f6bfcdc3640 1 -- 172.21.15.105:0/3188075811 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6bf814fe10 con 0x7f6bf814f3e0 2024-09-21T03:24:52.347 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.345+0000 7f6be6ffd640 1 -- 172.21.15.105:0/3188075811 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v93) ==== 80+0+0 (secure 0 0 0) 0x7f6bf00668b0 con 0x7f6bf814f3e0 2024-09-21T03:24:52.347 INFO:teuthology.orchestra.run.smithi105.stderr:listed 0 entries 2024-09-21T03:24:52.349 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.347+0000 7f6bfcdc3640 1 -- 172.21.15.105:0/3188075811 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6bd8078b90 msgr2=0x7f6bd807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:52.349 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.347+0000 7f6bfcdc3640 1 --2- 172.21.15.105:0/3188075811 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6bd8078b90 0x7f6bd807b0a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f6be8033000 tx=0x7f6be8004ab0 comp rx=0 tx=0).stop 2024-09-21T03:24:52.349 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.347+0000 7f6bfcdc3640 1 -- 172.21.15.105:0/3188075811 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bf814f3e0 msgr2=0x7f6bf80c9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:52.349 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.347+0000 7f6bfcdc3640 1 --2- 172.21.15.105:0/3188075811 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bf814f3e0 0x7f6bf80c9450 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f6bf000c3f0 tx=0x7f6bf000c8b0 comp rx=0 tx=0).stop 2024-09-21T03:24:52.350 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.347+0000 7f6bfcdc3640 1 -- 172.21.15.105:0/3188075811 shutdown_connections 2024-09-21T03:24:52.350 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.347+0000 7f6bfcdc3640 1 --2- 172.21.15.105:0/3188075811 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6bd8078b90 0x7f6bd807b0a0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:52.350 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.347+0000 7f6bfcdc3640 1 --2- 172.21.15.105:0/3188075811 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bf814f3e0 0x7f6bf80c9450 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:52.350 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.347+0000 7f6bfcdc3640 1 --2- 172.21.15.105:0/3188075811 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6bf8160c90 0x7f6bf81f72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:52.350 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.347+0000 7f6bfcdc3640 1 --2- 172.21.15.105:0/3188075811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bf80cff70 0x7f6bf81f3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:52.350 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.347+0000 7f6bfcdc3640 1 -- 172.21.15.105:0/3188075811 >> 172.21.15.105:0/3188075811 conn(0x7f6bf80cee20 msgr2=0x7f6bf8151740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:52.350 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.348+0000 7f6bfcdc3640 1 -- 172.21.15.105:0/3188075811 shutdown_connections 2024-09-21T03:24:52.350 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.348+0000 7f6bfcdc3640 1 -- 172.21.15.105:0/3188075811 wait complete. 2024-09-21T03:24:52.361 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-21T03:24:52.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:24:52.361 DEBUG:teuthology.orchestra.run.smithi162:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-21T03:24:52.389 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2024-09-21T03:24:52.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:24:52.390 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-21T03:24:52.445 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T03:24:52.445 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:24:52.445 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:24:52.461 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T03:24:52.461 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T03:24:52.461 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:24:52.461 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:24:52.501 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=452 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T03:24:52.501 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:24:52.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.612+0000 7fe0f1950640 1 -- 172.21.15.105:0/3591936937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0d8003c10 msgr2=0x7fe0d8004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:52.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.612+0000 7fe0f1950640 1 --2- 172.21.15.105:0/3591936937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0d8003c10 0x7fe0d8004060 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4009ec0 tx=0x7fe0d8005830 comp rx=0 tx=0).stop 2024-09-21T03:24:52.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.612+0000 7fe0eb7fe640 1 -- 172.21.15.105:0/3591936937 reap_dead start 2024-09-21T03:24:52.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.612+0000 7fe0f1950640 1 -- 172.21.15.105:0/3591936937 shutdown_connections 2024-09-21T03:24:52.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.612+0000 7fe0f1950640 1 -- 172.21.15.105:0/3591936937 >> 172.21.15.105:0/3591936937 conn(0x7fe0ec08bfc0 msgr2=0x7fe0ec09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:52.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.612+0000 7fe0f1950640 1 -- 172.21.15.105:0/3591936937 shutdown_connections 2024-09-21T03:24:52.614 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.612+0000 7fe0f1950640 1 -- 172.21.15.105:0/3591936937 wait complete. 2024-09-21T03:24:52.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.614+0000 7fe0f1950640 1 Processor -- start 2024-09-21T03:24:52.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.614+0000 7fe0f1950640 1 -- start start 2024-09-21T03:24:52.618 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.615+0000 7fe0f1950640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0d8003c10 0x7fe0ec0c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:52.618 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.615+0000 7fe0f1950640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe0ec1f5540 0x7fe0ec1f5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:52.618 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.615+0000 7fe0f1950640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0ec1f9330 0x7fe0ec1f9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:52.618 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.615+0000 7fe0f1950640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec0d1c00 con 0x7fe0ec1f9330 2024-09-21T03:24:52.618 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.615+0000 7fe0f1950640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec0d1a80 con 0x7fe0d8003c10 2024-09-21T03:24:52.618 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.615+0000 7fe0f1950640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe0ec0d1d80 con 0x7fe0ec1f5540 2024-09-21T03:24:52.618 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.615+0000 7fe0eb7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0ec1f9330 0x7fe0ec1f9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:52.618 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.615+0000 7fe0eb7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0ec1f9330 0x7fe0ec1f9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:53230/0 (socket says 172.21.15.105:53230) 2024-09-21T03:24:52.618 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.615+0000 7fe0eb7fe640 1 -- 172.21.15.105:0/2920455618 learned_addr learned my addr 172.21.15.105:0/2920455618 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:52.619 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.615+0000 7fe0eaffd640 1 --2- 172.21.15.105:0/2920455618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0d8003c10 0x7fe0ec0c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:52.619 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.615+0000 7fe0ea7fc640 1 --2- 172.21.15.105:0/2920455618 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe0ec1f5540 0x7fe0ec1f5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:52.619 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.616+0000 7fe0eb7fe640 1 -- 172.21.15.105:0/2920455618 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe0ec1f5540 msgr2=0x7fe0ec1f5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:52.619 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.616+0000 7fe0eb7fe640 1 --2- 172.21.15.105:0/2920455618 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe0ec1f5540 0x7fe0ec1f5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:52.619 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.616+0000 7fe0eb7fe640 1 -- 172.21.15.105:0/2920455618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0d8003c10 msgr2=0x7fe0ec0c8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:52.619 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.616+0000 7fe0eb7fe640 1 --2- 172.21.15.105:0/2920455618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0d8003c10 0x7fe0ec0c8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:52.619 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.616+0000 7fe0eb7fe640 1 -- 172.21.15.105:0/2920455618 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0ec1f6d00 con 0x7fe0ec1f9330 2024-09-21T03:24:52.619 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.616+0000 7fe0eb7fe640 1 --2- 172.21.15.105:0/2920455618 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0ec1f9330 0x7fe0ec1f9740 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec08d4e0 tx=0x7fe0dc001800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:52.619 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.616+0000 7fe0e3fff640 1 -- 172.21.15.105:0/2920455618 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc011660 con 0x7fe0ec1f9330 2024-09-21T03:24:52.619 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.616+0000 7fe0e3fff640 1 -- 172.21.15.105:0/2920455618 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe0dc017070 con 0x7fe0ec1f9330 2024-09-21T03:24:52.619 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.616+0000 7fe0f1950640 1 -- 172.21.15.105:0/2920455618 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0ec1f5f60 con 0x7fe0ec1f9330 2024-09-21T03:24:52.619 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.616+0000 7fe0e3fff640 1 -- 172.21.15.105:0/2920455618 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc011b90 con 0x7fe0ec1f9330 2024-09-21T03:24:52.619 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.616+0000 7fe0f1950640 1 -- 172.21.15.105:0/2920455618 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0ec1f6500 con 0x7fe0ec1f9330 2024-09-21T03:24:52.620 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.617+0000 7fe0f1950640 1 -- 172.21.15.105:0/2920455618 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0ec0cf090 con 0x7fe0ec1f9330 2024-09-21T03:24:52.620 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.618+0000 7fe0e3fff640 1 -- 172.21.15.105:0/2920455618 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe0dc01c460 con 0x7fe0ec1f9330 2024-09-21T03:24:52.620 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.618+0000 7fe0e3fff640 1 --2- 172.21.15.105:0/2920455618 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe0cc078b90 0x7fe0cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:52.620 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.618+0000 7fe0e3fff640 1 -- 172.21.15.105:0/2920455618 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7fe0dc09b180 con 0x7fe0ec1f9330 2024-09-21T03:24:52.621 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.618+0000 7fe0eaffd640 1 --2- 172.21.15.105:0/2920455618 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe0cc078b90 0x7fe0cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:52.621 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.619+0000 7fe0eaffd640 1 --2- 172.21.15.105:0/2920455618 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe0cc078b90 0x7fe0cc07b0a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4035000 tx=0x7fe0e4004a40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:52.624 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.623+0000 7fe0e3fff640 1 -- 172.21.15.105:0/2920455618 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe0dc063000 con 0x7fe0ec1f9330 2024-09-21T03:24:52.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.834+0000 7fe0f1950640 1 -- 172.21.15.105:0/2920455618 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe0ec0b4020 con 0x7fe0ec1f9330 2024-09-21T03:24:52.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.835+0000 7fe0e3fff640 1 -- 172.21.15.105:0/2920455618 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+5234 (secure 0 0 0) 0x7fe0dc067a30 con 0x7fe0ec1f9330 2024-09-21T03:24:52.837 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:24:52.837 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":58,"btime":"2024-09-21T03:24:42:016797+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5801,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2175278360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2175278360},{"type":"v1","addr":"172.21.15.162:6836","nonce":2175278360}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6292,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2152611733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2152611733},{"type":"v1","addr":"172.21.15.105:6835","nonce":2152611733}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1722830153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1722830153},{"type":"v1","addr":"172.21.15.162:6837","nonce":1722830153}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:24:38.369493+0000","modified":"2024-09-21T03:24:41.378239+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6840},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6840":{"gid":6840,"name":"c","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6834/636426076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":636426076},{"type":"v1","addr":"172.21.15.105:6834","nonce":636426076}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6840,"qdb_cluster":[6840]},"id":7}]} 2024-09-21T03:24:52.837 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 58 2024-09-21T03:24:52.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.837+0000 7fe0f1950640 1 -- 172.21.15.105:0/2920455618 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe0cc078b90 msgr2=0x7fe0cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:52.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.837+0000 7fe0f1950640 1 --2- 172.21.15.105:0/2920455618 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe0cc078b90 0x7fe0cc07b0a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4035000 tx=0x7fe0e4004a40 comp rx=0 tx=0).stop 2024-09-21T03:24:52.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.837+0000 7fe0f1950640 1 -- 172.21.15.105:0/2920455618 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0ec1f9330 msgr2=0x7fe0ec1f9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:52.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.837+0000 7fe0f1950640 1 --2- 172.21.15.105:0/2920455618 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0ec1f9330 0x7fe0ec1f9740 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec08d4e0 tx=0x7fe0dc001800 comp rx=0 tx=0).stop 2024-09-21T03:24:52.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.837+0000 7fe0f1950640 1 -- 172.21.15.105:0/2920455618 shutdown_connections 2024-09-21T03:24:52.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.837+0000 7fe0f1950640 1 --2- 172.21.15.105:0/2920455618 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe0cc078b90 0x7fe0cc07b0a0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:52.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.837+0000 7fe0f1950640 1 --2- 172.21.15.105:0/2920455618 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0ec1f9330 0x7fe0ec1f9740 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:52.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.837+0000 7fe0f1950640 1 --2- 172.21.15.105:0/2920455618 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe0ec1f5540 0x7fe0ec1f5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:52.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.837+0000 7fe0f1950640 1 --2- 172.21.15.105:0/2920455618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0d8003c10 0x7fe0ec0c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:52.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.837+0000 7fe0f1950640 1 -- 172.21.15.105:0/2920455618 >> 172.21.15.105:0/2920455618 conn(0x7fe0ec08bfc0 msgr2=0x7fe0ec161b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:52.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.837+0000 7fe0f1950640 1 -- 172.21.15.105:0/2920455618 shutdown_connections 2024-09-21T03:24:52.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.837+0000 7fe0f1950640 1 -- 172.21.15.105:0/2920455618 wait complete. 2024-09-21T03:24:52.851 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:24:52.962 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.961+0000 7fd200177640 1 -- 172.21.15.105:0/411669331 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1f80d1dc0 msgr2=0x7fd1f80b6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:52.962 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.961+0000 7fd200177640 1 --2- 172.21.15.105:0/411669331 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1f80d1dc0 0x7fd1f80b6330 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4009850 tx=0x7fd1f402a510 comp rx=0 tx=0).stop 2024-09-21T03:24:52.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.961+0000 7fd200177640 1 -- 172.21.15.105:0/411669331 shutdown_connections 2024-09-21T03:24:52.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.961+0000 7fd200177640 1 --2- 172.21.15.105:0/411669331 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1f80d1dc0 0x7fd1f80b6330 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:52.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.961+0000 7fd200177640 1 -- 172.21.15.105:0/411669331 >> 172.21.15.105:0/411669331 conn(0x7fd1f80d12a0 msgr2=0x7fd1f80d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:52.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.961+0000 7fd200177640 1 -- 172.21.15.105:0/411669331 shutdown_connections 2024-09-21T03:24:52.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.961+0000 7fd200177640 1 -- 172.21.15.105:0/411669331 wait complete. 2024-09-21T03:24:52.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.962+0000 7fd200177640 1 Processor -- start 2024-09-21T03:24:52.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.962+0000 7fd200177640 1 -- start start 2024-09-21T03:24:52.966 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.964+0000 7fd200177640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1f80b1300 0x7fd1f81516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:52.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.964+0000 7fd200177640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1f80b1710 0x7fd1f81544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:52.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.964+0000 7fd200177640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1f80d1dc0 0x7fd1f8154a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:52.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.964+0000 7fd200177640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f80b2970 con 0x7fd1f80b1300 2024-09-21T03:24:52.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.964+0000 7fd200177640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f81623d0 con 0x7fd1f80d1dc0 2024-09-21T03:24:52.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.964+0000 7fd200177640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd1f80b2af0 con 0x7fd1f80b1710 2024-09-21T03:24:52.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.964+0000 7fd1fdf13640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1f80b1300 0x7fd1f81516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:52.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.964+0000 7fd1fdf13640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1f80b1300 0x7fd1f81516e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:53246/0 (socket says 172.21.15.105:53246) 2024-09-21T03:24:52.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.964+0000 7fd1fdf13640 1 -- 172.21.15.105:0/3672287605 learned_addr learned my addr 172.21.15.105:0/3672287605 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:52.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.964+0000 7fd1fe714640 1 --2- 172.21.15.105:0/3672287605 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1f80d1dc0 0x7fd1f8154a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:52.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.964+0000 7fd1fd712640 1 --2- 172.21.15.105:0/3672287605 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1f80b1710 0x7fd1f81544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:52.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.964+0000 7fd1fdf13640 1 -- 172.21.15.105:0/3672287605 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1f80b1710 msgr2=0x7fd1f81544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:52.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.964+0000 7fd1fdf13640 1 --2- 172.21.15.105:0/3672287605 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1f80b1710 0x7fd1f81544c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:52.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.964+0000 7fd1fdf13640 1 -- 172.21.15.105:0/3672287605 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1f80d1dc0 msgr2=0x7fd1f8154a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:52.968 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.964+0000 7fd1fdf13640 1 --2- 172.21.15.105:0/3672287605 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1f80d1dc0 0x7fd1f8154a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:52.968 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.964+0000 7fd1fdf13640 1 -- 172.21.15.105:0/3672287605 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1f81f5f10 con 0x7fd1f80b1300 2024-09-21T03:24:52.968 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.964+0000 7fd1fdf13640 1 --2- 172.21.15.105:0/3672287605 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1f80b1300 0x7fd1f81516e0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4009940 tx=0x7fd1f4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:52.968 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.964+0000 7fd1ee7fc640 1 -- 172.21.15.105:0/3672287605 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f403f070 con 0x7fd1f80b1300 2024-09-21T03:24:52.968 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.964+0000 7fd1ee7fc640 1 -- 172.21.15.105:0/3672287605 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd1f4004ca0 con 0x7fd1f80b1300 2024-09-21T03:24:52.968 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.964+0000 7fd200177640 1 -- 172.21.15.105:0/3672287605 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1f81f61f0 con 0x7fd1f80b1300 2024-09-21T03:24:52.968 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.964+0000 7fd1ee7fc640 1 -- 172.21.15.105:0/3672287605 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f4005c30 con 0x7fd1f80b1300 2024-09-21T03:24:52.968 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.964+0000 7fd200177640 1 -- 172.21.15.105:0/3672287605 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1f81f67b0 con 0x7fd1f80b1300 2024-09-21T03:24:52.969 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.966+0000 7fd200177640 1 -- 172.21.15.105:0/3672287605 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1f80b6330 con 0x7fd1f80b1300 2024-09-21T03:24:52.969 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.966+0000 7fd1ee7fc640 1 -- 172.21.15.105:0/3672287605 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd1f4042070 con 0x7fd1f80b1300 2024-09-21T03:24:52.969 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.967+0000 7fd1ee7fc640 1 --2- 172.21.15.105:0/3672287605 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd1dc078bc0 0x7fd1dc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:52.969 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.967+0000 7fd1ee7fc640 1 -- 172.21.15.105:0/3672287605 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7fd1f40bba60 con 0x7fd1f80b1300 2024-09-21T03:24:52.969 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.967+0000 7fd1fd712640 1 --2- 172.21.15.105:0/3672287605 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd1dc078bc0 0x7fd1dc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:52.969 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.968+0000 7fd1fd712640 1 --2- 172.21.15.105:0/3672287605 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd1dc078bc0 0x7fd1dc07b0d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd1f81525b0 tx=0x7fd1e8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:52.973 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:52.972+0000 7fd1ee7fc640 1 -- 172.21.15.105:0/3672287605 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd1f4083850 con 0x7fd1f80b1300 2024-09-21T03:24:53.184 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.183+0000 7fd200177640 1 -- 172.21.15.105:0/3672287605 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd1f80b6dd0 con 0x7fd1f80b1300 2024-09-21T03:24:53.185 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.183+0000 7fd1ee7fc640 1 -- 172.21.15.105:0/3672287605 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+5234 (secure 0 0 0) 0x7fd1f4088280 con 0x7fd1f80b1300 2024-09-21T03:24:53.185 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:24:53.185 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":58,"btime":"2024-09-21T03:24:42:016797+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5801,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2175278360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2175278360},{"type":"v1","addr":"172.21.15.162:6836","nonce":2175278360}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6292,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2152611733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2152611733},{"type":"v1","addr":"172.21.15.105:6835","nonce":2152611733}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1722830153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1722830153},{"type":"v1","addr":"172.21.15.162:6837","nonce":1722830153}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:24:38.369493+0000","modified":"2024-09-21T03:24:41.378239+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6840},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6840":{"gid":6840,"name":"c","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6834/636426076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":636426076},{"type":"v1","addr":"172.21.15.105:6834","nonce":636426076}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6840,"qdb_cluster":[6840]},"id":7}]} 2024-09-21T03:24:53.186 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 58 2024-09-21T03:24:53.187 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.186+0000 7fd200177640 1 -- 172.21.15.105:0/3672287605 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd1dc078bc0 msgr2=0x7fd1dc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:53.188 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.186+0000 7fd200177640 1 --2- 172.21.15.105:0/3672287605 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd1dc078bc0 0x7fd1dc07b0d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd1f81525b0 tx=0x7fd1e8009040 comp rx=0 tx=0).stop 2024-09-21T03:24:53.188 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.186+0000 7fd200177640 1 -- 172.21.15.105:0/3672287605 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1f80b1300 msgr2=0x7fd1f81516e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:53.188 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.186+0000 7fd200177640 1 --2- 172.21.15.105:0/3672287605 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1f80b1300 0x7fd1f81516e0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4009940 tx=0x7fd1f4003c10 comp rx=0 tx=0).stop 2024-09-21T03:24:53.188 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.186+0000 7fd200177640 1 -- 172.21.15.105:0/3672287605 shutdown_connections 2024-09-21T03:24:53.188 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.186+0000 7fd200177640 1 --2- 172.21.15.105:0/3672287605 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd1dc078bc0 0x7fd1dc07b0d0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.188 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.186+0000 7fd200177640 1 --2- 172.21.15.105:0/3672287605 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1f80d1dc0 0x7fd1f8154a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.188 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.186+0000 7fd200177640 1 --2- 172.21.15.105:0/3672287605 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1f80b1710 0x7fd1f81544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.188 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.186+0000 7fd200177640 1 --2- 172.21.15.105:0/3672287605 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1f80b1300 0x7fd1f81516e0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.188 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.186+0000 7fd200177640 1 -- 172.21.15.105:0/3672287605 >> 172.21.15.105:0/3672287605 conn(0x7fd1f80d12a0 msgr2=0x7fd1f80ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:53.188 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.186+0000 7fd200177640 1 -- 172.21.15.105:0/3672287605 shutdown_connections 2024-09-21T03:24:53.188 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.186+0000 7fd200177640 1 -- 172.21.15.105:0/3672287605 wait complete. 2024-09-21T03:24:53.198 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:24:53.311 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.309+0000 7f891534a640 1 -- 172.21.15.105:0/3467855687 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88f8003aa0 msgr2=0x7f88f8003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:53.311 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.309+0000 7f891534a640 1 --2- 172.21.15.105:0/3467855687 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88f8003aa0 0x7f88f8003f10 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f890000c750 tx=0x7f88f8005830 comp rx=0 tx=0).stop 2024-09-21T03:24:53.311 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.309+0000 7f890f7fe640 1 -- 172.21.15.105:0/3467855687 reap_dead start 2024-09-21T03:24:53.311 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.309+0000 7f891534a640 1 -- 172.21.15.105:0/3467855687 shutdown_connections 2024-09-21T03:24:53.312 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.309+0000 7f891534a640 1 -- 172.21.15.105:0/3467855687 >> 172.21.15.105:0/3467855687 conn(0x7f89100cdcb0 msgr2=0x7f89100ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:53.312 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.309+0000 7f891534a640 1 -- 172.21.15.105:0/3467855687 shutdown_connections 2024-09-21T03:24:53.312 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.309+0000 7f891534a640 1 -- 172.21.15.105:0/3467855687 wait complete. 2024-09-21T03:24:53.313 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.311+0000 7f891534a640 1 Processor -- start 2024-09-21T03:24:53.313 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.311+0000 7f891534a640 1 -- start start 2024-09-21T03:24:53.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.313+0000 7f891534a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89101548f0 0x7f89101f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:53.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.313+0000 7f891534a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89100c7730 0x7f891006cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:53.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.313+0000 7f891534a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89100c7b40 0x7f891006d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:53.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.313+0000 7f891534a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f89100b3450 con 0x7f89101548f0 2024-09-21T03:24:53.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.313+0000 7f891534a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f89100b32d0 con 0x7f89100c7730 2024-09-21T03:24:53.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.313+0000 7f891534a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8910071d80 con 0x7f89100c7b40 2024-09-21T03:24:53.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.313+0000 7f890effd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89101548f0 0x7f89101f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:53.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.313+0000 7f890effd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89101548f0 0x7f89101f6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:53268/0 (socket says 172.21.15.105:53268) 2024-09-21T03:24:53.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.313+0000 7f890effd640 1 -- 172.21.15.105:0/1533009872 learned_addr learned my addr 172.21.15.105:0/1533009872 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:53.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.313+0000 7f890e7fc640 1 --2- 172.21.15.105:0/1533009872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89100c7730 0x7f891006cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:53.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.313+0000 7f890f7fe640 1 --2- 172.21.15.105:0/1533009872 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89100c7b40 0x7f891006d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:53.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.313+0000 7f890effd640 1 -- 172.21.15.105:0/1533009872 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89100c7b40 msgr2=0x7f891006d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:53.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.313+0000 7f890effd640 1 --2- 172.21.15.105:0/1533009872 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89100c7b40 0x7f891006d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.313+0000 7f890effd640 1 -- 172.21.15.105:0/1533009872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89100c7730 msgr2=0x7f891006cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:53.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.313+0000 7f890effd640 1 --2- 172.21.15.105:0/1533009872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89100c7730 0x7f891006cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.313+0000 7f890effd640 1 -- 172.21.15.105:0/1533009872 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89100c9200 con 0x7f89101548f0 2024-09-21T03:24:53.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.313+0000 7f890e7fc640 1 --2- 172.21.15.105:0/1533009872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89100c7730 0x7f891006cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:24:53.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.313+0000 7f890effd640 1 --2- 172.21.15.105:0/1533009872 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89101548f0 0x7f89101f6b90 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f890000c870 tx=0x7f890000c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:53.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.313+0000 7f88f77fe640 1 -- 172.21.15.105:0/1533009872 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890002b940 con 0x7f89101548f0 2024-09-21T03:24:53.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.313+0000 7f88f77fe640 1 -- 172.21.15.105:0/1533009872 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f890002bbd0 con 0x7f89101548f0 2024-09-21T03:24:53.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.313+0000 7f891534a640 1 -- 172.21.15.105:0/1533009872 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89101f72e0 con 0x7f89101548f0 2024-09-21T03:24:53.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.314+0000 7f88f77fe640 1 -- 172.21.15.105:0/1533009872 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8900006070 con 0x7f89101548f0 2024-09-21T03:24:53.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.314+0000 7f891534a640 1 -- 172.21.15.105:0/1533009872 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89101f78a0 con 0x7f89101548f0 2024-09-21T03:24:53.318 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.314+0000 7f891534a640 1 -- 172.21.15.105:0/1533009872 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89101f7ae0 con 0x7f89101548f0 2024-09-21T03:24:53.318 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.315+0000 7f88f77fe640 1 -- 172.21.15.105:0/1533009872 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f890003d030 con 0x7f89101548f0 2024-09-21T03:24:53.318 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.316+0000 7f88f77fe640 1 --2- 172.21.15.105:0/1533009872 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f88fc078b90 0x7f88fc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:53.318 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.316+0000 7f88f77fe640 1 -- 172.21.15.105:0/1533009872 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7f89000baf00 con 0x7f89101548f0 2024-09-21T03:24:53.318 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.316+0000 7f890e7fc640 1 --2- 172.21.15.105:0/1533009872 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f88fc078b90 0x7f88fc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:53.319 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.317+0000 7f890e7fc640 1 --2- 172.21.15.105:0/1533009872 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f88fc078b90 0x7f88fc07b0a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8904009b40 tx=0x7f8904005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:53.322 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.320+0000 7f88f77fe640 1 -- 172.21.15.105:0/1533009872 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f89101f7ae0 con 0x7f89101548f0 2024-09-21T03:24:53.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.498+0000 7f891534a640 1 -- 172.21.15.105:0/1533009872 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8910071650 con 0x7f89101548f0 2024-09-21T03:24:53.501 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.499+0000 7f88f77fe640 1 -- 172.21.15.105:0/1533009872 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+16740 (secure 0 0 0) 0x7f89100b3600 con 0x7f89101548f0 2024-09-21T03:24:53.502 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:24:53.502 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":93,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:24:40.003709+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:24:36.006836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-21T03:24:37.327374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:24:53.504 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.501+0000 7f891534a640 1 -- 172.21.15.105:0/1533009872 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f88fc078b90 msgr2=0x7f88fc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:53.504 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.501+0000 7f891534a640 1 --2- 172.21.15.105:0/1533009872 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f88fc078b90 0x7f88fc07b0a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8904009b40 tx=0x7f8904005f90 comp rx=0 tx=0).stop 2024-09-21T03:24:53.504 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.501+0000 7f891534a640 1 -- 172.21.15.105:0/1533009872 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89101548f0 msgr2=0x7f89101f6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:53.504 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.501+0000 7f891534a640 1 --2- 172.21.15.105:0/1533009872 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89101548f0 0x7f89101f6b90 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f890000c870 tx=0x7f890000c4a0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.504 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.501+0000 7f891534a640 1 -- 172.21.15.105:0/1533009872 shutdown_connections 2024-09-21T03:24:53.504 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.501+0000 7f891534a640 1 --2- 172.21.15.105:0/1533009872 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f88fc078b90 0x7f88fc07b0a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.505 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.501+0000 7f891534a640 1 --2- 172.21.15.105:0/1533009872 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89100c7b40 0x7f891006d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.505 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.501+0000 7f891534a640 1 --2- 172.21.15.105:0/1533009872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89100c7730 0x7f891006cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.505 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.501+0000 7f891534a640 1 --2- 172.21.15.105:0/1533009872 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89101548f0 0x7f89101f6b90 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.505 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.501+0000 7f891534a640 1 -- 172.21.15.105:0/1533009872 >> 172.21.15.105:0/1533009872 conn(0x7f89100cdcb0 msgr2=0x7f89100b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:53.505 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.501+0000 7f891534a640 1 -- 172.21.15.105:0/1533009872 shutdown_connections 2024-09-21T03:24:53.505 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.501+0000 7f891534a640 1 -- 172.21.15.105:0/1533009872 wait complete. 2024-09-21T03:24:53.515 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T03:24:53.516 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:24:53.628 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.625+0000 7f995e98e640 1 -- 172.21.15.105:0/1079965027 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9958075170 msgr2=0x7f99580b51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:53.628 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.625+0000 7f995e98e640 1 --2- 172.21.15.105:0/1079965027 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9958075170 0x7f99580b51d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9948005fd0 tx=0x7f994802a540 comp rx=0 tx=0).stop 2024-09-21T03:24:53.628 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.625+0000 7f995e98e640 1 -- 172.21.15.105:0/1079965027 shutdown_connections 2024-09-21T03:24:53.628 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.625+0000 7f995e98e640 1 --2- 172.21.15.105:0/1079965027 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9958070af0 0x7f9958070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.629 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.625+0000 7f995e98e640 1 --2- 172.21.15.105:0/1079965027 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9958075170 0x7f99580b51d0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.629 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.625+0000 7f995e98e640 1 -- 172.21.15.105:0/1079965027 >> 172.21.15.105:0/1079965027 conn(0x7f99580cdcc0 msgr2=0x7f99580ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:53.629 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.625+0000 7f995e98e640 1 -- 172.21.15.105:0/1079965027 shutdown_connections 2024-09-21T03:24:53.629 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.625+0000 7f995e98e640 1 -- 172.21.15.105:0/1079965027 wait complete. 2024-09-21T03:24:53.629 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.627+0000 7f995e98e640 1 Processor -- start 2024-09-21T03:24:53.630 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.627+0000 7f995e98e640 1 -- start start 2024-09-21T03:24:53.632 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.628+0000 7f995e98e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9958070af0 0x7f995814f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:53.632 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.628+0000 7f995e98e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99580b5710 0x7f995815b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:53.632 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.629+0000 7f995e98e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f995815a910 0x7f9958150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:53.632 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.629+0000 7f995e98e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9958071880 con 0x7f9958070af0 2024-09-21T03:24:53.632 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.629+0000 7f995e98e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9958071700 con 0x7f99580b5710 2024-09-21T03:24:53.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.629+0000 7f995e98e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9958071a00 con 0x7f995815a910 2024-09-21T03:24:53.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.629+0000 7f9957fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9958070af0 0x7f995814f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:53.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.629+0000 7f9957fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9958070af0 0x7f995814f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:53276/0 (socket says 172.21.15.105:53276) 2024-09-21T03:24:53.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.629+0000 7f9957fff640 1 -- 172.21.15.105:0/827328519 learned_addr learned my addr 172.21.15.105:0/827328519 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:53.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.629+0000 7f99577fe640 1 --2- 172.21.15.105:0/827328519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99580b5710 0x7f995815b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:53.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.629+0000 7f995cf2b640 1 --2- 172.21.15.105:0/827328519 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f995815a910 0x7f9958150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:53.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.629+0000 7f9957fff640 1 -- 172.21.15.105:0/827328519 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f995815a910 msgr2=0x7f9958150e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:53.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.629+0000 7f9957fff640 1 --2- 172.21.15.105:0/827328519 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f995815a910 0x7f9958150e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.629+0000 7f9957fff640 1 -- 172.21.15.105:0/827328519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99580b5710 msgr2=0x7f995815b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:53.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.629+0000 7f9957fff640 1 --2- 172.21.15.105:0/827328519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99580b5710 0x7f995815b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.629+0000 7f9957fff640 1 -- 172.21.15.105:0/827328519 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f995814f700 con 0x7f9958070af0 2024-09-21T03:24:53.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.629+0000 7f9957fff640 1 --2- 172.21.15.105:0/827328519 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9958070af0 0x7f995814f1c0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f9948000c00 tx=0x7f99480038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:53.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.629+0000 7f9954ff9640 1 -- 172.21.15.105:0/827328519 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994803e030 con 0x7f9958070af0 2024-09-21T03:24:53.634 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.629+0000 7f995e98e640 1 -- 172.21.15.105:0/827328519 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f995815bc80 con 0x7f9958070af0 2024-09-21T03:24:53.634 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.629+0000 7f9954ff9640 1 -- 172.21.15.105:0/827328519 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9948003ca0 con 0x7f9958070af0 2024-09-21T03:24:53.634 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.629+0000 7f9954ff9640 1 -- 172.21.15.105:0/827328519 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9948035040 con 0x7f9958070af0 2024-09-21T03:24:53.634 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.629+0000 7f995e98e640 1 -- 172.21.15.105:0/827328519 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99581f6e70 con 0x7f9958070af0 2024-09-21T03:24:53.634 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.630+0000 7f995e98e640 1 -- 172.21.15.105:0/827328519 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9958075170 con 0x7f9958070af0 2024-09-21T03:24:53.635 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.631+0000 7f9954ff9640 1 -- 172.21.15.105:0/827328519 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9948041030 con 0x7f9958070af0 2024-09-21T03:24:53.635 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.631+0000 7f9954ff9640 1 --2- 172.21.15.105:0/827328519 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9944078b90 0x7f994407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:53.635 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.632+0000 7f9954ff9640 1 -- 172.21.15.105:0/827328519 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7f99480bb3f0 con 0x7f9958070af0 2024-09-21T03:24:53.635 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.632+0000 7f99577fe640 1 --2- 172.21.15.105:0/827328519 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9944078b90 0x7f994407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:53.635 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.632+0000 7f99577fe640 1 --2- 172.21.15.105:0/827328519 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9944078b90 0x7f994407b0a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f995809b580 tx=0x7f994c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:53.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.636+0000 7f9954ff9640 1 -- 172.21.15.105:0/827328519 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9948083160 con 0x7f9958070af0 2024-09-21T03:24:53.853 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.850+0000 7f995e98e640 1 -- 172.21.15.105:0/827328519 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f99580b2f70 con 0x7f9958070af0 2024-09-21T03:24:53.853 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.851+0000 7f9954ff9640 1 -- 172.21.15.105:0/827328519 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+5234 (secure 0 0 0) 0x7f9948087b90 con 0x7f9958070af0 2024-09-21T03:24:53.853 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:24:53.853 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":58,"btime":"2024-09-21T03:24:42:016797+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5801,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2175278360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2175278360},{"type":"v1","addr":"172.21.15.162:6836","nonce":2175278360}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6292,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2152611733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2152611733},{"type":"v1","addr":"172.21.15.105:6835","nonce":2152611733}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1722830153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1722830153},{"type":"v1","addr":"172.21.15.162:6837","nonce":1722830153}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:24:38.369493+0000","modified":"2024-09-21T03:24:41.378239+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6840},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6840":{"gid":6840,"name":"c","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6834/636426076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":636426076},{"type":"v1","addr":"172.21.15.105:6834","nonce":636426076}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6840,"qdb_cluster":[6840]},"id":7}]} 2024-09-21T03:24:53.854 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 58 2024-09-21T03:24:53.855 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.853+0000 7f995e98e640 1 -- 172.21.15.105:0/827328519 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9944078b90 msgr2=0x7f994407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:53.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.853+0000 7f995e98e640 1 --2- 172.21.15.105:0/827328519 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9944078b90 0x7f994407b0a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f995809b580 tx=0x7f994c009040 comp rx=0 tx=0).stop 2024-09-21T03:24:53.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.853+0000 7f995e98e640 1 -- 172.21.15.105:0/827328519 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9958070af0 msgr2=0x7f995814f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:53.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.853+0000 7f995e98e640 1 --2- 172.21.15.105:0/827328519 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9958070af0 0x7f995814f1c0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f9948000c00 tx=0x7f99480038a0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.853+0000 7f995e98e640 1 -- 172.21.15.105:0/827328519 shutdown_connections 2024-09-21T03:24:53.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.853+0000 7f995e98e640 1 --2- 172.21.15.105:0/827328519 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9944078b90 0x7f994407b0a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.853+0000 7f995e98e640 1 --2- 172.21.15.105:0/827328519 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f995815a910 0x7f9958150e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.853+0000 7f995e98e640 1 --2- 172.21.15.105:0/827328519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99580b5710 0x7f995815b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.853+0000 7f995e98e640 1 --2- 172.21.15.105:0/827328519 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9958070af0 0x7f995814f1c0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.853+0000 7f995e98e640 1 -- 172.21.15.105:0/827328519 >> 172.21.15.105:0/827328519 conn(0x7f99580cdcc0 msgr2=0x7f99580b4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:53.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.853+0000 7f995e98e640 1 -- 172.21.15.105:0/827328519 shutdown_connections 2024-09-21T03:24:53.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.853+0000 7f995e98e640 1 -- 172.21.15.105:0/827328519 wait complete. 2024-09-21T03:24:53.867 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:24:53.979 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.976+0000 7f2647cde640 1 -- 172.21.15.105:0/2985382814 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2640155ce0 msgr2=0x7f26400b45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:53.979 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.976+0000 7f2647cde640 1 --2- 172.21.15.105:0/2985382814 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2640155ce0 0x7f26400b45a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2638005fd0 tx=0x7f263802aa90 comp rx=0 tx=0).stop 2024-09-21T03:24:53.979 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.976+0000 7f2647cde640 1 -- 172.21.15.105:0/2985382814 shutdown_connections 2024-09-21T03:24:53.979 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.976+0000 7f2647cde640 1 --2- 172.21.15.105:0/2985382814 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2640155ce0 0x7f26400b45a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.979 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.976+0000 7f2647cde640 1 --2- 172.21.15.105:0/2985382814 >> v2:172.21.15.162:3300/0 conn(0x7f2640074420 0x7f264006fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.979 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.976+0000 7f2647cde640 1 -- 172.21.15.105:0/2985382814 >> 172.21.15.105:0/2985382814 conn(0x7f264006def0 msgr2=0x7f264006e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:53.979 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.976+0000 7f2647cde640 1 -- 172.21.15.105:0/2985382814 shutdown_connections 2024-09-21T03:24:53.979 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.976+0000 7f2647cde640 1 -- 172.21.15.105:0/2985382814 wait complete. 2024-09-21T03:24:53.980 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.978+0000 7f2647cde640 1 Processor -- start 2024-09-21T03:24:53.980 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.978+0000 7f2647cde640 1 -- start start 2024-09-21T03:24:53.983 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.979+0000 7f2647cde640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2640074420 0x7f26401445a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:53.983 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.979+0000 7f2647cde640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2640155ce0 0x7f26401f2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:53.983 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.979+0000 7f2647cde640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f264014ac30 0x7f26401f2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:53.983 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.979+0000 7f2647cde640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f26400b5030 con 0x7f264014ac30 2024-09-21T03:24:53.983 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.979+0000 7f2647cde640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f26400b4eb0 con 0x7f2640074420 2024-09-21T03:24:53.983 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.979+0000 7f2647cde640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f26400b51b0 con 0x7f2640155ce0 2024-09-21T03:24:53.983 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.979+0000 7f264627b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f264014ac30 0x7f26401f2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:53.983 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.979+0000 7f264627b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f264014ac30 0x7f26401f2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:53284/0 (socket says 172.21.15.105:53284) 2024-09-21T03:24:53.983 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.979+0000 7f264627b640 1 -- 172.21.15.105:0/3825031274 learned_addr learned my addr 172.21.15.105:0/3825031274 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:53.983 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.979+0000 7f2645a7a640 1 --2- 172.21.15.105:0/3825031274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2640074420 0x7f26401445a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:53.983 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.979+0000 7f2645279640 1 --2- 172.21.15.105:0/3825031274 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2640155ce0 0x7f26401f2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:53.983 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.979+0000 7f264627b640 1 -- 172.21.15.105:0/3825031274 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2640155ce0 msgr2=0x7f26401f2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:53.983 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.979+0000 7f264627b640 1 --2- 172.21.15.105:0/3825031274 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2640155ce0 0x7f26401f2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.984 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.979+0000 7f264627b640 1 -- 172.21.15.105:0/3825031274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2640074420 msgr2=0x7f26401445a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:53.984 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.979+0000 7f264627b640 1 --2- 172.21.15.105:0/3825031274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2640074420 0x7f26401445a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:53.984 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.979+0000 7f264627b640 1 -- 172.21.15.105:0/3825031274 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26401f3320 con 0x7f264014ac30 2024-09-21T03:24:53.984 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.979+0000 7f2645279640 1 --2- 172.21.15.105:0/3825031274 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2640155ce0 0x7f26401f2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:24:53.984 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.980+0000 7f264627b640 1 --2- 172.21.15.105:0/3825031274 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f264014ac30 0x7f26401f2590 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f2638009bf0 tx=0x7f2638003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:53.984 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.980+0000 7f26367fc640 1 -- 172.21.15.105:0/3825031274 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2638044070 con 0x7f264014ac30 2024-09-21T03:24:53.984 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.980+0000 7f26367fc640 1 -- 172.21.15.105:0/3825031274 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2638003e00 con 0x7f264014ac30 2024-09-21T03:24:53.984 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.980+0000 7f2647cde640 1 -- 172.21.15.105:0/3825031274 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26401f3600 con 0x7f264014ac30 2024-09-21T03:24:53.984 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.980+0000 7f26367fc640 1 -- 172.21.15.105:0/3825031274 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26380044b0 con 0x7f264014ac30 2024-09-21T03:24:53.984 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.980+0000 7f2647cde640 1 -- 172.21.15.105:0/3825031274 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26401f3bc0 con 0x7f264014ac30 2024-09-21T03:24:53.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.981+0000 7f2647cde640 1 -- 172.21.15.105:0/3825031274 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26401f3090 con 0x7f264014ac30 2024-09-21T03:24:53.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.981+0000 7f26367fc640 1 -- 172.21.15.105:0/3825031274 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2638047070 con 0x7f264014ac30 2024-09-21T03:24:53.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.982+0000 7f26367fc640 1 --2- 172.21.15.105:0/3825031274 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2624078b90 0x7f262407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:53.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.982+0000 7f26367fc640 1 -- 172.21.15.105:0/3825031274 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7f26380bbb40 con 0x7f264014ac30 2024-09-21T03:24:53.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.982+0000 7f2645a7a640 1 --2- 172.21.15.105:0/3825031274 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2624078b90 0x7f262407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:53.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.983+0000 7f2645a7a640 1 --2- 172.21.15.105:0/3825031274 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2624078b90 0x7f262407b0a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f263c009b30 tx=0x7f263c005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:53.989 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:53.986+0000 7f26367fc640 1 -- 172.21.15.105:0/3825031274 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2638032030 con 0x7f264014ac30 2024-09-21T03:24:54.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.200+0000 7f2647cde640 1 -- 172.21.15.105:0/3825031274 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f26400b56d0 con 0x7f264014ac30 2024-09-21T03:24:54.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.200+0000 7f26367fc640 1 -- 172.21.15.105:0/3825031274 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+5234 (secure 0 0 0) 0x7f26380098b0 con 0x7f264014ac30 2024-09-21T03:24:54.203 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:24:54.203 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":58,"btime":"2024-09-21T03:24:42:016797+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5801,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2175278360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2175278360},{"type":"v1","addr":"172.21.15.162:6836","nonce":2175278360}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6292,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2152611733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2152611733},{"type":"v1","addr":"172.21.15.105:6835","nonce":2152611733}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1722830153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1722830153},{"type":"v1","addr":"172.21.15.162:6837","nonce":1722830153}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:24:38.369493+0000","modified":"2024-09-21T03:24:41.378239+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6840},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6840":{"gid":6840,"name":"c","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6834/636426076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":636426076},{"type":"v1","addr":"172.21.15.105:6834","nonce":636426076}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6840,"qdb_cluster":[6840]},"id":7}]} 2024-09-21T03:24:54.203 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 58 2024-09-21T03:24:54.205 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.203+0000 7f2647cde640 1 -- 172.21.15.105:0/3825031274 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2624078b90 msgr2=0x7f262407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:54.205 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.203+0000 7f2647cde640 1 --2- 172.21.15.105:0/3825031274 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2624078b90 0x7f262407b0a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f263c009b30 tx=0x7f263c005f90 comp rx=0 tx=0).stop 2024-09-21T03:24:54.206 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.203+0000 7f2647cde640 1 -- 172.21.15.105:0/3825031274 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f264014ac30 msgr2=0x7f26401f2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:54.206 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.203+0000 7f2647cde640 1 --2- 172.21.15.105:0/3825031274 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f264014ac30 0x7f26401f2590 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f2638009bf0 tx=0x7f2638003c10 comp rx=0 tx=0).stop 2024-09-21T03:24:54.206 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.203+0000 7f2647cde640 1 -- 172.21.15.105:0/3825031274 shutdown_connections 2024-09-21T03:24:54.206 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.203+0000 7f2647cde640 1 --2- 172.21.15.105:0/3825031274 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2624078b90 0x7f262407b0a0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:54.206 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.203+0000 7f2647cde640 1 --2- 172.21.15.105:0/3825031274 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f264014ac30 0x7f26401f2590 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:54.206 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.203+0000 7f2647cde640 1 --2- 172.21.15.105:0/3825031274 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2640155ce0 0x7f26401f2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:54.206 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.203+0000 7f2647cde640 1 --2- 172.21.15.105:0/3825031274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2640074420 0x7f26401445a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:54.206 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.203+0000 7f2647cde640 1 -- 172.21.15.105:0/3825031274 >> 172.21.15.105:0/3825031274 conn(0x7f264006def0 msgr2=0x7f264015e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:54.206 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.203+0000 7f2647cde640 1 -- 172.21.15.105:0/3825031274 shutdown_connections 2024-09-21T03:24:54.206 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.203+0000 7f2647cde640 1 -- 172.21.15.105:0/3825031274 wait complete. 2024-09-21T03:24:54.216 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:24:54.329 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.326+0000 7f19ecb39640 1 -- 172.21.15.105:0/701220671 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19d0005150 msgr2=0x7f19d000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:54.329 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.326+0000 7f19ecb39640 1 --2- 172.21.15.105:0/701220671 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19d0005150 0x7f19d000b9c0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f19e8070de0 tx=0x7f19d0005830 comp rx=0 tx=0).stop 2024-09-21T03:24:54.329 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.326+0000 7f19e6d9d640 1 -- 172.21.15.105:0/701220671 reap_dead start 2024-09-21T03:24:54.329 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.326+0000 7f19ecb39640 1 -- 172.21.15.105:0/701220671 shutdown_connections 2024-09-21T03:24:54.330 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.326+0000 7f19ecb39640 1 -- 172.21.15.105:0/701220671 >> 172.21.15.105:0/701220671 conn(0x7f19e80b1cb0 msgr2=0x7f19e80b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:54.330 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.327+0000 7f19ecb39640 1 -- 172.21.15.105:0/701220671 shutdown_connections 2024-09-21T03:24:54.330 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.327+0000 7f19ecb39640 1 -- 172.21.15.105:0/701220671 wait complete. 2024-09-21T03:24:54.331 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.328+0000 7f19ecb39640 1 Processor -- start 2024-09-21T03:24:54.331 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.328+0000 7f19ecb39640 1 -- start start 2024-09-21T03:24:54.333 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.330+0000 7f19ecb39640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19d0005150 0x7f19e815e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:54.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.330+0000 7f19ecb39640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19e81f5580 0x7f19e81f5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:54.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.330+0000 7f19ecb39640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19e8154230 0x7f19e8154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:54.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.330+0000 7f19ecb39640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f19e80cbb80 con 0x7f19d0005150 2024-09-21T03:24:54.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.330+0000 7f19ecb39640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f19e80cba00 con 0x7f19e8154230 2024-09-21T03:24:54.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.330+0000 7f19ecb39640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f19e80cbd00 con 0x7f19e81f5580 2024-09-21T03:24:54.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.330+0000 7f19e659c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19d0005150 0x7f19e815e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:54.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.330+0000 7f19e659c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19d0005150 0x7f19e815e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:53306/0 (socket says 172.21.15.105:53306) 2024-09-21T03:24:54.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.330+0000 7f19e659c640 1 -- 172.21.15.105:0/3809542427 learned_addr learned my addr 172.21.15.105:0/3809542427 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:54.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.330+0000 7f19e5d9b640 1 --2- 172.21.15.105:0/3809542427 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19e81f5580 0x7f19e81f5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:54.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.330+0000 7f19e6d9d640 1 --2- 172.21.15.105:0/3809542427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19e8154230 0x7f19e8154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:54.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.330+0000 7f19e659c640 1 -- 172.21.15.105:0/3809542427 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19e81f5580 msgr2=0x7f19e81f5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:54.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.330+0000 7f19e659c640 1 --2- 172.21.15.105:0/3809542427 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19e81f5580 0x7f19e81f5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:54.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.330+0000 7f19e659c640 1 -- 172.21.15.105:0/3809542427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19e8154230 msgr2=0x7f19e8154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:54.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.330+0000 7f19e659c640 1 --2- 172.21.15.105:0/3809542427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19e8154230 0x7f19e8154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:54.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.330+0000 7f19e659c640 1 -- 172.21.15.105:0/3809542427 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19e8154b80 con 0x7f19d0005150 2024-09-21T03:24:54.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.330+0000 7f19e6d9d640 1 --2- 172.21.15.105:0/3809542427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19e8154230 0x7f19e8154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:24:54.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.330+0000 7f19e5d9b640 1 --2- 172.21.15.105:0/3809542427 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19e81f5580 0x7f19e81f5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:24:54.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.330+0000 7f19e659c640 1 --2- 172.21.15.105:0/3809542427 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19d0005150 0x7f19e815e6a0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f19d800e6b0 tx=0x7f19d800eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:54.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.331+0000 7f19d6ffd640 1 -- 172.21.15.105:0/3809542427 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d801c070 con 0x7f19d0005150 2024-09-21T03:24:54.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.331+0000 7f19d6ffd640 1 -- 172.21.15.105:0/3809542427 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f19d800a7c0 con 0x7f19d0005150 2024-09-21T03:24:54.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.331+0000 7f19ecb39640 1 -- 172.21.15.105:0/3809542427 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19e815bf80 con 0x7f19d0005150 2024-09-21T03:24:54.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.331+0000 7f19d6ffd640 1 -- 172.21.15.105:0/3809542427 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d800abf0 con 0x7f19d0005150 2024-09-21T03:24:54.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.331+0000 7f19ecb39640 1 -- 172.21.15.105:0/3809542427 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19e815c540 con 0x7f19d0005150 2024-09-21T03:24:54.336 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.332+0000 7f19ecb39640 1 -- 172.21.15.105:0/3809542427 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19e8074ff0 con 0x7f19d0005150 2024-09-21T03:24:54.336 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.332+0000 7f19d6ffd640 1 -- 172.21.15.105:0/3809542427 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f19d801f070 con 0x7f19d0005150 2024-09-21T03:24:54.336 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.333+0000 7f19d6ffd640 1 --2- 172.21.15.105:0/3809542427 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f19c8078bc0 0x7f19c807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:54.336 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.333+0000 7f19d6ffd640 1 -- 172.21.15.105:0/3809542427 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7f19d809c2d0 con 0x7f19d0005150 2024-09-21T03:24:54.336 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.333+0000 7f19e5d9b640 1 --2- 172.21.15.105:0/3809542427 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f19c8078bc0 0x7f19c807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:54.336 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.334+0000 7f19e5d9b640 1 --2- 172.21.15.105:0/3809542427 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f19c8078bc0 0x7f19c807b0d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f19e8155ef0 tx=0x7f19dc005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:54.340 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.337+0000 7f19d6ffd640 1 -- 172.21.15.105:0/3809542427 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f19e8074ff0 con 0x7f19d0005150 2024-09-21T03:24:54.517 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.515+0000 7f19ecb39640 1 -- 172.21.15.105:0/3809542427 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f19e80735b0 con 0x7f19d0005150 2024-09-21T03:24:54.518 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.516+0000 7f19d6ffd640 1 -- 172.21.15.105:0/3809542427 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+16740 (secure 0 0 0) 0x7f19e8154b80 con 0x7f19d0005150 2024-09-21T03:24:54.519 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:24:54.519 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":93,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:24:40.003709+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:24:36.006836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-21T03:24:37.327374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:24:54.521 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.518+0000 7f19ecb39640 1 -- 172.21.15.105:0/3809542427 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f19c8078bc0 msgr2=0x7f19c807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:54.521 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.518+0000 7f19ecb39640 1 --2- 172.21.15.105:0/3809542427 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f19c8078bc0 0x7f19c807b0d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f19e8155ef0 tx=0x7f19dc005f90 comp rx=0 tx=0).stop 2024-09-21T03:24:54.521 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.518+0000 7f19ecb39640 1 -- 172.21.15.105:0/3809542427 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19d0005150 msgr2=0x7f19e815e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:54.521 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.518+0000 7f19ecb39640 1 --2- 172.21.15.105:0/3809542427 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19d0005150 0x7f19e815e6a0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f19d800e6b0 tx=0x7f19d800eb70 comp rx=0 tx=0).stop 2024-09-21T03:24:54.521 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.518+0000 7f19ecb39640 1 -- 172.21.15.105:0/3809542427 shutdown_connections 2024-09-21T03:24:54.521 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.518+0000 7f19ecb39640 1 --2- 172.21.15.105:0/3809542427 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f19c8078bc0 0x7f19c807b0d0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:54.521 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.518+0000 7f19ecb39640 1 --2- 172.21.15.105:0/3809542427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19e8154230 0x7f19e8154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:54.521 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.518+0000 7f19ecb39640 1 --2- 172.21.15.105:0/3809542427 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19e81f5580 0x7f19e81f5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:54.521 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.518+0000 7f19ecb39640 1 --2- 172.21.15.105:0/3809542427 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19d0005150 0x7f19e815e6a0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:54.521 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.518+0000 7f19ecb39640 1 -- 172.21.15.105:0/3809542427 >> 172.21.15.105:0/3809542427 conn(0x7f19e80b1cb0 msgr2=0x7f19e80b1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:54.521 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.518+0000 7f19ecb39640 1 -- 172.21.15.105:0/3809542427 shutdown_connections 2024-09-21T03:24:54.521 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.518+0000 7f19ecb39640 1 -- 172.21.15.105:0/3809542427 wait complete. 2024-09-21T03:24:54.532 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T03:24:54.646 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.643+0000 7f003ffa8640 1 -- 172.21.15.105:0/3076318262 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0024004800 msgr2=0x7f0024004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:54.646 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.643+0000 7f003ffa8640 1 --2- 172.21.15.105:0/3076318262 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0024004800 0x7f0024004c10 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f0028001050 tx=0x7f0024005830 comp rx=0 tx=0).stop 2024-09-21T03:24:54.646 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.643+0000 7f003ffa8640 1 -- 172.21.15.105:0/3076318262 shutdown_connections 2024-09-21T03:24:54.646 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.643+0000 7f003ffa8640 1 --2- 172.21.15.105:0/3076318262 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0024004800 0x7f0024004c10 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:54.646 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.643+0000 7f003ffa8640 1 -- 172.21.15.105:0/3076318262 >> 172.21.15.105:0/3076318262 conn(0x7f003808bfc0 msgr2=0x7f003809d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:54.646 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.643+0000 7f003ffa8640 1 -- 172.21.15.105:0/3076318262 shutdown_connections 2024-09-21T03:24:54.646 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.643+0000 7f003ffa8640 1 -- 172.21.15.105:0/3076318262 wait complete. 2024-09-21T03:24:54.647 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.645+0000 7f003ffa8640 1 Processor -- start 2024-09-21T03:24:54.647 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.645+0000 7f003ffa8640 1 -- start start 2024-09-21T03:24:54.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.646+0000 7f003ffa8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0024004800 0x7f0038152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:54.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.646+0000 7f003ffa8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00380c9030 0x7f00380b8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:54.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.646+0000 7f003ffa8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f003815fb70 0x7f00380b89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:54.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.646+0000 7f003ffa8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f00380d1c00 con 0x7f0024004800 2024-09-21T03:24:54.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.646+0000 7f003ffa8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f00380d1a80 con 0x7f003815fb70 2024-09-21T03:24:54.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.646+0000 7f003ffa8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f00380d1d80 con 0x7f00380c9030 2024-09-21T03:24:54.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.646+0000 7f003dd44640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0024004800 0x7f0038152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:54.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.646+0000 7f003dd44640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0024004800 0x7f0038152c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:53310/0 (socket says 172.21.15.105:53310) 2024-09-21T03:24:54.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.646+0000 7f003dd44640 1 -- 172.21.15.105:0/4245406429 learned_addr learned my addr 172.21.15.105:0/4245406429 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:54.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.646+0000 7f003dd44640 1 -- 172.21.15.105:0/4245406429 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00380c9030 msgr2=0x7f00380b8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:54.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.646+0000 7f003dd44640 1 --2- 172.21.15.105:0/4245406429 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00380c9030 0x7f00380b8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:54.651 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.646+0000 7f003dd44640 1 -- 172.21.15.105:0/4245406429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f003815fb70 msgr2=0x7f00380b89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:54.651 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.646+0000 7f003dd44640 1 --2- 172.21.15.105:0/4245406429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f003815fb70 0x7f00380b89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:54.651 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.646+0000 7f003dd44640 1 -- 172.21.15.105:0/4245406429 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0038153170 con 0x7f0024004800 2024-09-21T03:24:54.651 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.647+0000 7f003dd44640 1 --2- 172.21.15.105:0/4245406429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0024004800 0x7f0038152c30 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f0034011ab0 tx=0x7f0034011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:54.651 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.647+0000 7f002e7fc640 1 -- 172.21.15.105:0/4245406429 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f003401e070 con 0x7f0024004800 2024-09-21T03:24:54.651 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.647+0000 7f002e7fc640 1 -- 172.21.15.105:0/4245406429 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f003400fcd0 con 0x7f0024004800 2024-09-21T03:24:54.651 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.647+0000 7f003ffa8640 1 -- 172.21.15.105:0/4245406429 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00380c8270 con 0x7f0024004800 2024-09-21T03:24:54.651 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.647+0000 7f002e7fc640 1 -- 172.21.15.105:0/4245406429 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f003400fea0 con 0x7f0024004800 2024-09-21T03:24:54.651 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.647+0000 7f003ffa8640 1 -- 172.21.15.105:0/4245406429 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00380c8830 con 0x7f0024004800 2024-09-21T03:24:54.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.648+0000 7f003ffa8640 1 -- 172.21.15.105:0/4245406429 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00380cf310 con 0x7f0024004800 2024-09-21T03:24:54.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.649+0000 7f002e7fc640 1 -- 172.21.15.105:0/4245406429 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0034021070 con 0x7f0024004800 2024-09-21T03:24:54.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.649+0000 7f002e7fc640 1 --2- 172.21.15.105:0/4245406429 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f001c078b90 0x7f001c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:54.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.649+0000 7f002e7fc640 1 -- 172.21.15.105:0/4245406429 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5709+0+0 (secure 0 0 0) 0x7f003409b550 con 0x7f0024004800 2024-09-21T03:24:54.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.650+0000 7f003d543640 1 --2- 172.21.15.105:0/4245406429 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f001c078b90 0x7f001c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:54.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.650+0000 7f003d543640 1 --2- 172.21.15.105:0/4245406429 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f001c078b90 0x7f001c07b0a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0028033000 tx=0x7f0028000fe0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:54.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.654+0000 7f002e7fc640 1 -- 172.21.15.105:0/4245406429 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f00340633d0 con 0x7f0024004800 2024-09-21T03:24:54.871 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.868+0000 7f003ffa8640 1 -- 172.21.15.105:0/4245406429 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f00380b51a0 con 0x7f0024004800 2024-09-21T03:24:54.871 INFO:tasks.ceph.mon.a.smithi105.stderr:2024-09-21T03:24:54.869+0000 7f25819ea640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T03:24:54.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.870+0000 7f002e7fc640 1 -- 172.21.15.105:0/4245406429 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v59) ==== 161+0+0 (secure 0 0 0) 0x7f0034067e00 con 0x7f0024004800 2024-09-21T03:24:54.873 INFO:teuthology.orchestra.run.smithi105.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T03:24:54.876 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.873+0000 7f003ffa8640 1 -- 172.21.15.105:0/4245406429 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f001c078b90 msgr2=0x7f001c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:54.876 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.873+0000 7f003ffa8640 1 --2- 172.21.15.105:0/4245406429 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f001c078b90 0x7f001c07b0a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0028033000 tx=0x7f0028000fe0 comp rx=0 tx=0).stop 2024-09-21T03:24:54.876 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.873+0000 7f003ffa8640 1 -- 172.21.15.105:0/4245406429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0024004800 msgr2=0x7f0038152c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:54.876 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.873+0000 7f003ffa8640 1 --2- 172.21.15.105:0/4245406429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0024004800 0x7f0038152c30 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f0034011ab0 tx=0x7f0034011f70 comp rx=0 tx=0).stop 2024-09-21T03:24:54.876 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.873+0000 7f003ffa8640 1 -- 172.21.15.105:0/4245406429 shutdown_connections 2024-09-21T03:24:54.876 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.873+0000 7f003ffa8640 1 --2- 172.21.15.105:0/4245406429 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f001c078b90 0x7f001c07b0a0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:54.876 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.873+0000 7f003ffa8640 1 --2- 172.21.15.105:0/4245406429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f003815fb70 0x7f00380b89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:54.876 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.873+0000 7f003ffa8640 1 --2- 172.21.15.105:0/4245406429 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00380c9030 0x7f00380b8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:54.876 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.873+0000 7f003ffa8640 1 --2- 172.21.15.105:0/4245406429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0024004800 0x7f0038152c30 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:54.876 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.873+0000 7f003ffa8640 1 -- 172.21.15.105:0/4245406429 >> 172.21.15.105:0/4245406429 conn(0x7f003808bfc0 msgr2=0x7f00381604d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:54.876 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.873+0000 7f003ffa8640 1 -- 172.21.15.105:0/4245406429 shutdown_connections 2024-09-21T03:24:54.876 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:54.873+0000 7f003ffa8640 1 -- 172.21.15.105:0/4245406429 wait complete. 2024-09-21T03:24:54.878 INFO:tasks.ceph.mds.c.smithi105.stderr: -2312> 2024-09-21T03:24:39.972+0000 7fba08f84640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T03:24:54.887 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T03:24:54.930 INFO:tasks.ceph.mds.c.smithi105.stdout:starting mds.c at 2024-09-21T03:24:55.005 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.002+0000 7f8c87dc6640 1 -- 172.21.15.105:0/968230138 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c80070030 msgr2=0x7f8c80074640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:55.005 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.002+0000 7f8c87dc6640 1 --2- 172.21.15.105:0/968230138 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c80070030 0x7f8c80074640 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f8c80070e70 tx=0x7f8c7002a4d0 comp rx=0 tx=0).stop 2024-09-21T03:24:55.005 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.002+0000 7f8c87dc6640 1 -- 172.21.15.105:0/968230138 shutdown_connections 2024-09-21T03:24:55.005 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.002+0000 7f8c87dc6640 1 --2- 172.21.15.105:0/968230138 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c80070030 0x7f8c80074640 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:55.005 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.002+0000 7f8c87dc6640 1 --2- 172.21.15.105:0/968230138 >> v2:172.21.15.162:3300/0 conn(0x7f8c80073170 0x7f8c8015c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:55.005 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.002+0000 7f8c87dc6640 1 -- 172.21.15.105:0/968230138 >> 172.21.15.105:0/968230138 conn(0x7f8c800b1cb0 msgr2=0x7f8c800b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:55.005 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.002+0000 7f8c87dc6640 1 -- 172.21.15.105:0/968230138 shutdown_connections 2024-09-21T03:24:55.005 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.002+0000 7f8c87dc6640 1 -- 172.21.15.105:0/968230138 wait complete. 2024-09-21T03:24:55.006 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.003+0000 7f8c87dc6640 1 Processor -- start 2024-09-21T03:24:55.006 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.004+0000 7f8c87dc6640 1 -- start start 2024-09-21T03:24:55.009 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.005+0000 7f8c87dc6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c80070030 0x7f8c801e5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:55.009 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.005+0000 7f8c87dc6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c80070440 0x7f8c801f39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:55.009 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.005+0000 7f8c87dc6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c80073170 0x7f8c800d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:55.009 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.005+0000 7f8c87dc6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8c80075050 con 0x7f8c80070030 2024-09-21T03:24:55.009 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.005+0000 7f8c87dc6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8c80074ed0 con 0x7f8c80070440 2024-09-21T03:24:55.009 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.005+0000 7f8c87dc6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8c8006f5a0 con 0x7f8c80073170 2024-09-21T03:24:55.009 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.005+0000 7f8c85b62640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c80070030 0x7f8c801e5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:55.009 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.005+0000 7f8c85b62640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c80070030 0x7f8c801e5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:53356/0 (socket says 172.21.15.105:53356) 2024-09-21T03:24:55.009 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.005+0000 7f8c85b62640 1 -- 172.21.15.105:0/2020833130 learned_addr learned my addr 172.21.15.105:0/2020833130 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:55.010 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.005+0000 7f8c85361640 1 --2- 172.21.15.105:0/2020833130 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c80070440 0x7f8c801f39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:55.010 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.005+0000 7f8c85b62640 1 -- 172.21.15.105:0/2020833130 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c80073170 msgr2=0x7f8c800d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:55.010 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.005+0000 7f8c86363640 1 --2- 172.21.15.105:0/2020833130 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c80073170 0x7f8c800d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:55.010 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.005+0000 7f8c85b62640 1 --2- 172.21.15.105:0/2020833130 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c80073170 0x7f8c800d01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:55.010 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.005+0000 7f8c85b62640 1 -- 172.21.15.105:0/2020833130 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c80070440 msgr2=0x7f8c801f39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:55.010 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.005+0000 7f8c85b62640 1 --2- 172.21.15.105:0/2020833130 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c80070440 0x7f8c801f39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:55.010 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.005+0000 7f8c85b62640 1 -- 172.21.15.105:0/2020833130 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c801f48c0 con 0x7f8c80070030 2024-09-21T03:24:55.010 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.005+0000 7f8c85361640 1 --2- 172.21.15.105:0/2020833130 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c80070440 0x7f8c801f39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:24:55.010 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.005+0000 7f8c85b62640 1 --2- 172.21.15.105:0/2020833130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c80070030 0x7f8c801e5fe0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c00c9a0 tx=0x7f8c7c00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:55.010 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.005+0000 7f8c767fc640 1 -- 172.21.15.105:0/2020833130 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c007bb0 con 0x7f8c80070030 2024-09-21T03:24:55.010 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.006+0000 7f8c767fc640 1 -- 172.21.15.105:0/2020833130 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c7c005020 con 0x7f8c80070030 2024-09-21T03:24:55.010 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.006+0000 7f8c767fc640 1 -- 172.21.15.105:0/2020833130 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c007e60 con 0x7f8c80070030 2024-09-21T03:24:55.010 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.006+0000 7f8c87dc6640 1 -- 172.21.15.105:0/2020833130 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c801e6520 con 0x7f8c80070030 2024-09-21T03:24:55.011 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.006+0000 7f8c87dc6640 1 -- 172.21.15.105:0/2020833130 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c801f45e0 con 0x7f8c80070030 2024-09-21T03:24:55.011 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.006+0000 7f8c87dc6640 1 -- 172.21.15.105:0/2020833130 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c8006fac0 con 0x7f8c80070030 2024-09-21T03:24:55.011 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.007+0000 7f8c767fc640 1 -- 172.21.15.105:0/2020833130 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8c7c005470 con 0x7f8c80070030 2024-09-21T03:24:55.011 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.008+0000 7f8c767fc640 1 --2- 172.21.15.105:0/2020833130 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c64078b90 0x7f8c6407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:55.012 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.008+0000 7f8c767fc640 1 -- 172.21.15.105:0/2020833130 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5795+0+0 (secure 0 0 0) 0x7f8c7c09b260 con 0x7f8c80070030 2024-09-21T03:24:55.012 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.008+0000 7f8c85361640 1 --2- 172.21.15.105:0/2020833130 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c64078b90 0x7f8c6407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:55.012 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.009+0000 7f8c85361640 1 --2- 172.21.15.105:0/2020833130 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c64078b90 0x7f8c6407b0a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8c70033000 tx=0x7f8c70004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:55.015 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.013+0000 7f8c767fc640 1 -- 172.21.15.105:0/2020833130 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8c7c014030 con 0x7f8c80070030 2024-09-21T03:24:55.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.230+0000 7f8c87dc6640 1 -- 172.21.15.105:0/2020833130 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f8c800c3860 con 0x7f8c80070030 2024-09-21T03:24:55.878 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.876+0000 7f8c767fc640 1 -- 172.21.15.105:0/2020833130 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v60) ==== 104+0+0 (secure 0 0 0) 0x7f8c7c063640 con 0x7f8c80070030 2024-09-21T03:24:55.881 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.879+0000 7f8c87dc6640 1 -- 172.21.15.105:0/2020833130 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c64078b90 msgr2=0x7f8c6407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:55.882 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.879+0000 7f8c87dc6640 1 --2- 172.21.15.105:0/2020833130 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c64078b90 0x7f8c6407b0a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8c70033000 tx=0x7f8c70004730 comp rx=0 tx=0).stop 2024-09-21T03:24:55.882 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.879+0000 7f8c87dc6640 1 -- 172.21.15.105:0/2020833130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c80070030 msgr2=0x7f8c801e5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:55.882 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.879+0000 7f8c87dc6640 1 --2- 172.21.15.105:0/2020833130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c80070030 0x7f8c801e5fe0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c00c9a0 tx=0x7f8c7c00ce60 comp rx=0 tx=0).stop 2024-09-21T03:24:55.882 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.879+0000 7f8c87dc6640 1 -- 172.21.15.105:0/2020833130 shutdown_connections 2024-09-21T03:24:55.882 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.879+0000 7f8c87dc6640 1 --2- 172.21.15.105:0/2020833130 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c64078b90 0x7f8c6407b0a0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:55.882 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.879+0000 7f8c87dc6640 1 --2- 172.21.15.105:0/2020833130 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c80073170 0x7f8c800d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:55.882 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.879+0000 7f8c87dc6640 1 --2- 172.21.15.105:0/2020833130 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c80070440 0x7f8c801f39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:55.882 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.879+0000 7f8c87dc6640 1 --2- 172.21.15.105:0/2020833130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c80070030 0x7f8c801e5fe0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:55.882 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.879+0000 7f8c87dc6640 1 -- 172.21.15.105:0/2020833130 >> 172.21.15.105:0/2020833130 conn(0x7f8c800b1cb0 msgr2=0x7f8c8015ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:55.882 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.879+0000 7f8c87dc6640 1 -- 172.21.15.105:0/2020833130 shutdown_connections 2024-09-21T03:24:55.882 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:55.879+0000 7f8c87dc6640 1 -- 172.21.15.105:0/2020833130 wait complete. 2024-09-21T03:24:55.893 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T03:24:56.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.048+0000 7f4587a0a640 1 -- 172.21.15.105:0/3571965683 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f458015af70 msgr2=0x7f45800cb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:56.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.048+0000 7f4587a0a640 1 --2- 172.21.15.105:0/3571965683 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f458015af70 0x7f45800cb160 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f457c005fd0 tx=0x7f457c02a5d0 comp rx=0 tx=0).stop 2024-09-21T03:24:56.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.048+0000 7f4587a0a640 1 -- 172.21.15.105:0/3571965683 shutdown_connections 2024-09-21T03:24:56.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.048+0000 7f4587a0a640 1 --2- 172.21.15.105:0/3571965683 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f458006fd50 0x7f45800ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:56.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.048+0000 7f4587a0a640 1 --2- 172.21.15.105:0/3571965683 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f458015af70 0x7f45800cb160 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:56.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.048+0000 7f4587a0a640 1 -- 172.21.15.105:0/3571965683 >> 172.21.15.105:0/3571965683 conn(0x7f45800d0130 msgr2=0x7f45800d0540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:56.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.049+0000 7f4587a0a640 1 -- 172.21.15.105:0/3571965683 shutdown_connections 2024-09-21T03:24:56.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.049+0000 7f4587a0a640 1 -- 172.21.15.105:0/3571965683 wait complete. 2024-09-21T03:24:56.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.050+0000 7f4587a0a640 1 Processor -- start 2024-09-21T03:24:56.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.050+0000 7f4587a0a640 1 -- start start 2024-09-21T03:24:56.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.052+0000 7f4587a0a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45800706f0 0x7f4580152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:56.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.052+0000 7f4587a0a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f458015af70 0x7f458014c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:56.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.052+0000 7f4587a0a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f458009d550 0x7f45801f86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:56.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.052+0000 7f4587a0a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f458006f330 con 0x7f458009d550 2024-09-21T03:24:56.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.052+0000 7f4587a0a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f458006f1b0 con 0x7f458015af70 2024-09-21T03:24:56.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.052+0000 7f4587a0a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f458015a6b0 con 0x7f45800706f0 2024-09-21T03:24:56.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.052+0000 7f4585fa7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f458009d550 0x7f45801f86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:56.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.052+0000 7f4585fa7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f458009d550 0x7f45801f86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:53372/0 (socket says 172.21.15.105:53372) 2024-09-21T03:24:56.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.052+0000 7f4585fa7640 1 -- 172.21.15.105:0/3758946007 learned_addr learned my addr 172.21.15.105:0/3758946007 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:56.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.052+0000 7f4584fa5640 1 --2- 172.21.15.105:0/3758946007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f458015af70 0x7f458014c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:56.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.052+0000 7f45857a6640 1 --2- 172.21.15.105:0/3758946007 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45800706f0 0x7f4580152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:56.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.052+0000 7f4585fa7640 1 -- 172.21.15.105:0/3758946007 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45800706f0 msgr2=0x7f4580152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:56.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.052+0000 7f4585fa7640 1 --2- 172.21.15.105:0/3758946007 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45800706f0 0x7f4580152bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:56.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.052+0000 7f4585fa7640 1 -- 172.21.15.105:0/3758946007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f458015af70 msgr2=0x7f458014c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:56.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.052+0000 7f4585fa7640 1 --2- 172.21.15.105:0/3758946007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f458015af70 0x7f458014c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:56.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.052+0000 7f4585fa7640 1 -- 172.21.15.105:0/3758946007 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4580154510 con 0x7f458009d550 2024-09-21T03:24:56.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.052+0000 7f4585fa7640 1 --2- 172.21.15.105:0/3758946007 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f458009d550 0x7f45801f86e0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f457800e9c0 tx=0x7f457800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:56.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.052+0000 7f4575ffb640 1 -- 172.21.15.105:0/3758946007 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4578004d20 con 0x7f458009d550 2024-09-21T03:24:56.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.052+0000 7f4575ffb640 1 -- 172.21.15.105:0/3758946007 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f457800cb20 con 0x7f458009d550 2024-09-21T03:24:56.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.052+0000 7f4587a0a640 1 -- 172.21.15.105:0/3758946007 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45801547f0 con 0x7f458009d550 2024-09-21T03:24:56.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.052+0000 7f4575ffb640 1 -- 172.21.15.105:0/3758946007 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4578005020 con 0x7f458009d550 2024-09-21T03:24:56.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.053+0000 7f4587a0a640 1 -- 172.21.15.105:0/3758946007 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f458009afc0 con 0x7f458009d550 2024-09-21T03:24:56.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.054+0000 7f4587a0a640 1 -- 172.21.15.105:0/3758946007 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45800ce500 con 0x7f458009d550 2024-09-21T03:24:56.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.054+0000 7f4575ffb640 1 -- 172.21.15.105:0/3758946007 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f45780051c0 con 0x7f458009d550 2024-09-21T03:24:56.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.055+0000 7f4575ffb640 1 --2- 172.21.15.105:0/3758946007 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4564078b90 0x7f456407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:56.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.055+0000 7f4575ffb640 1 -- 172.21.15.105:0/3758946007 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5795+0+0 (secure 0 0 0) 0x7f457809b640 con 0x7f458009d550 2024-09-21T03:24:56.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.055+0000 7f45857a6640 1 --2- 172.21.15.105:0/3758946007 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4564078b90 0x7f456407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:56.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.056+0000 7f45857a6640 1 --2- 172.21.15.105:0/3758946007 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4564078b90 0x7f456407b0a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f457c033000 tx=0x7f457c004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:56.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.060+0000 7f4575ffb640 1 -- 172.21.15.105:0/3758946007 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4578016030 con 0x7f458009d550 2024-09-21T03:24:56.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.234+0000 7f4587a0a640 1 -- 172.21.15.105:0/3758946007 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f45800b0790 con 0x7f458009d550 2024-09-21T03:24:56.880 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.877+0000 7f4575ffb640 1 -- 172.21.15.105:0/3758946007 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v95) ==== 181+0+0 (secure 0 0 0) 0x7f45780633c0 con 0x7f458009d550 2024-09-21T03:24:56.880 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_metadata' removed 2024-09-21T03:24:56.884 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.880+0000 7f4587a0a640 1 -- 172.21.15.105:0/3758946007 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4564078b90 msgr2=0x7f456407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:56.884 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.880+0000 7f4587a0a640 1 --2- 172.21.15.105:0/3758946007 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4564078b90 0x7f456407b0a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f457c033000 tx=0x7f457c004730 comp rx=0 tx=0).stop 2024-09-21T03:24:56.884 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.880+0000 7f4587a0a640 1 -- 172.21.15.105:0/3758946007 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f458009d550 msgr2=0x7f45801f86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:56.884 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.880+0000 7f4587a0a640 1 --2- 172.21.15.105:0/3758946007 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f458009d550 0x7f45801f86e0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f457800e9c0 tx=0x7f457800ee80 comp rx=0 tx=0).stop 2024-09-21T03:24:56.884 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.881+0000 7f4587a0a640 1 -- 172.21.15.105:0/3758946007 shutdown_connections 2024-09-21T03:24:56.884 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.881+0000 7f4587a0a640 1 --2- 172.21.15.105:0/3758946007 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4564078b90 0x7f456407b0a0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:56.884 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.881+0000 7f4587a0a640 1 --2- 172.21.15.105:0/3758946007 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f458009d550 0x7f45801f86e0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:56.884 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.881+0000 7f4587a0a640 1 --2- 172.21.15.105:0/3758946007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f458015af70 0x7f458014c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:56.884 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.881+0000 7f4587a0a640 1 --2- 172.21.15.105:0/3758946007 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45800706f0 0x7f4580152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:56.884 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.881+0000 7f4587a0a640 1 -- 172.21.15.105:0/3758946007 >> 172.21.15.105:0/3758946007 conn(0x7f45800d0130 msgr2=0x7f45800ad270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:56.884 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.881+0000 7f4587a0a640 1 -- 172.21.15.105:0/3758946007 shutdown_connections 2024-09-21T03:24:56.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:56.881+0000 7f4587a0a640 1 -- 172.21.15.105:0/3758946007 wait complete. 2024-09-21T03:24:56.896 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T03:24:57.013 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.010+0000 7fddf65c6640 1 -- 172.21.15.105:0/2396522060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddf00d24a0 msgr2=0x7fddf00d28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:57.013 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.010+0000 7fddf65c6640 1 --2- 172.21.15.105:0/2396522060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddf00d24a0 0x7fddf00d28b0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fdde4009830 tx=0x7fdde402a510 comp rx=0 tx=0).stop 2024-09-21T03:24:57.013 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.010+0000 7fddf65c6640 1 -- 172.21.15.105:0/2396522060 shutdown_connections 2024-09-21T03:24:57.013 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.010+0000 7fddf65c6640 1 --2- 172.21.15.105:0/2396522060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddf00d24a0 0x7fddf00d28b0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:57.013 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.010+0000 7fddf65c6640 1 --2- 172.21.15.105:0/2396522060 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fddf015eb70 0x7fddf00b7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:57.013 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.010+0000 7fddf65c6640 1 -- 172.21.15.105:0/2396522060 >> 172.21.15.105:0/2396522060 conn(0x7fddf00d45c0 msgr2=0x7fddf00d49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:57.013 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.010+0000 7fddf65c6640 1 -- 172.21.15.105:0/2396522060 shutdown_connections 2024-09-21T03:24:57.013 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.010+0000 7fddf65c6640 1 -- 172.21.15.105:0/2396522060 wait complete. 2024-09-21T03:24:57.014 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.012+0000 7fddf65c6640 1 Processor -- start 2024-09-21T03:24:57.014 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.012+0000 7fddf65c6640 1 -- start start 2024-09-21T03:24:57.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.013+0000 7fddf65c6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fddf00cf280 0x7fddf0161370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:57.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.013+0000 7fddf65c6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddf00d24a0 0x7fddf0160ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:57.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.013+0000 7fddf65c6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fddf015eb70 0x7fddf014c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:57.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.013+0000 7fddf65c6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fddf00b2aa0 con 0x7fddf00d24a0 2024-09-21T03:24:57.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.013+0000 7fddf65c6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fddf00b2920 con 0x7fddf00cf280 2024-09-21T03:24:57.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.013+0000 7fddf65c6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fddf00b2c20 con 0x7fddf015eb70 2024-09-21T03:24:57.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.013+0000 7fddef7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddf00d24a0 0x7fddf0160ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:57.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.013+0000 7fddef7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddf00d24a0 0x7fddf0160ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:53390/0 (socket says 172.21.15.105:53390) 2024-09-21T03:24:57.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.013+0000 7fddef7fe640 1 -- 172.21.15.105:0/2095618658 learned_addr learned my addr 172.21.15.105:0/2095618658 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:57.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.014+0000 7fddf4b63640 1 --2- 172.21.15.105:0/2095618658 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fddf015eb70 0x7fddf014c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:57.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.014+0000 7fddeffff640 1 --2- 172.21.15.105:0/2095618658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fddf00cf280 0x7fddf0161370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:57.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.014+0000 7fddef7fe640 1 -- 172.21.15.105:0/2095618658 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fddf015eb70 msgr2=0x7fddf014c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:57.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.014+0000 7fddef7fe640 1 --2- 172.21.15.105:0/2095618658 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fddf015eb70 0x7fddf014c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:57.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.014+0000 7fddef7fe640 1 -- 172.21.15.105:0/2095618658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fddf00cf280 msgr2=0x7fddf0161370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:57.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.014+0000 7fddef7fe640 1 --2- 172.21.15.105:0/2095618658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fddf00cf280 0x7fddf0161370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:57.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.014+0000 7fddef7fe640 1 -- 172.21.15.105:0/2095618658 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf0161bc0 con 0x7fddf00d24a0 2024-09-21T03:24:57.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.014+0000 7fddf4b63640 1 --2- 172.21.15.105:0/2095618658 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fddf015eb70 0x7fddf014c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:24:57.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.014+0000 7fddef7fe640 1 --2- 172.21.15.105:0/2095618658 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddf00d24a0 0x7fddf0160ca0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fdde4009950 tx=0x7fdde4033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:57.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.014+0000 7fddecff9640 1 -- 172.21.15.105:0/2095618658 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde4031d60 con 0x7fddf00d24a0 2024-09-21T03:24:57.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.014+0000 7fddecff9640 1 -- 172.21.15.105:0/2095618658 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdde40330d0 con 0x7fddf00d24a0 2024-09-21T03:24:57.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.014+0000 7fddf65c6640 1 -- 172.21.15.105:0/2095618658 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddf0161ea0 con 0x7fddf00d24a0 2024-09-21T03:24:57.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.014+0000 7fddecff9640 1 -- 172.21.15.105:0/2095618658 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde4033520 con 0x7fddf00d24a0 2024-09-21T03:24:57.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.014+0000 7fddf65c6640 1 -- 172.21.15.105:0/2095618658 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddf01f9310 con 0x7fddf00d24a0 2024-09-21T03:24:57.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.015+0000 7fddf65c6640 1 -- 172.21.15.105:0/2095618658 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddf0161910 con 0x7fddf00d24a0 2024-09-21T03:24:57.020 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.016+0000 7fddecff9640 1 -- 172.21.15.105:0/2095618658 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdde40035f0 con 0x7fddf00d24a0 2024-09-21T03:24:57.020 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.016+0000 7fddecff9640 1 --2- 172.21.15.105:0/2095618658 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdddc078b90 0x7fdddc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:57.020 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.016+0000 7fddecff9640 1 -- 172.21.15.105:0/2095618658 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5357+0+0 (secure 0 0 0) 0x7fdde40bc0c0 con 0x7fddf00d24a0 2024-09-21T03:24:57.020 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.017+0000 7fddeffff640 1 --2- 172.21.15.105:0/2095618658 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdddc078b90 0x7fdddc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:57.020 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.017+0000 7fddeffff640 1 --2- 172.21.15.105:0/2095618658 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdddc078b90 0x7fdddc07b0a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fdde0006fd0 tx=0x7fdde0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:57.023 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.021+0000 7fddecff9640 1 -- 172.21.15.105:0/2095618658 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fdde403f030 con 0x7fddf00d24a0 2024-09-21T03:24:57.191 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:24:57.193 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:24:57.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.201+0000 7fddf65c6640 1 -- 172.21.15.105:0/2095618658 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fddf00b30e0 con 0x7fddf00d24a0 2024-09-21T03:24:57.887 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.885+0000 7fddecff9640 1 -- 172.21.15.105:0/2095618658 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v96) ==== 169+0+0 (secure 0 0 0) 0x7fdde40846e0 con 0x7fddf00d24a0 2024-09-21T03:24:57.888 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_data' removed 2024-09-21T03:24:57.890 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.887+0000 7fddf65c6640 1 -- 172.21.15.105:0/2095618658 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdddc078b90 msgr2=0x7fdddc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:57.890 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.887+0000 7fddf65c6640 1 --2- 172.21.15.105:0/2095618658 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdddc078b90 0x7fdddc07b0a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fdde0006fd0 tx=0x7fdde0008040 comp rx=0 tx=0).stop 2024-09-21T03:24:57.890 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.887+0000 7fddf65c6640 1 -- 172.21.15.105:0/2095618658 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddf00d24a0 msgr2=0x7fddf0160ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:57.891 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.887+0000 7fddf65c6640 1 --2- 172.21.15.105:0/2095618658 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddf00d24a0 0x7fddf0160ca0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fdde4009950 tx=0x7fdde4033d60 comp rx=0 tx=0).stop 2024-09-21T03:24:57.891 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.887+0000 7fddf65c6640 1 -- 172.21.15.105:0/2095618658 shutdown_connections 2024-09-21T03:24:57.891 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.887+0000 7fddf65c6640 1 --2- 172.21.15.105:0/2095618658 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdddc078b90 0x7fdddc07b0a0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:57.891 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.887+0000 7fddf65c6640 1 --2- 172.21.15.105:0/2095618658 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fddf015eb70 0x7fddf014c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:57.891 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.887+0000 7fddf65c6640 1 --2- 172.21.15.105:0/2095618658 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddf00d24a0 0x7fddf0160ca0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:57.891 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.887+0000 7fddf65c6640 1 --2- 172.21.15.105:0/2095618658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fddf00cf280 0x7fddf0161370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:57.891 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.888+0000 7fddf65c6640 1 -- 172.21.15.105:0/2095618658 >> 172.21.15.105:0/2095618658 conn(0x7fddf00d45c0 msgr2=0x7fddf015d530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:57.891 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.888+0000 7fddf65c6640 1 -- 172.21.15.105:0/2095618658 shutdown_connections 2024-09-21T03:24:57.891 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:57.888+0000 7fddf65c6640 1 -- 172.21.15.105:0/2095618658 wait complete. 2024-09-21T03:24:57.902 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-21T03:24:58.017 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.014+0000 7f7e4e6b6640 1 -- 172.21.15.105:0/2542510847 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e480d1d40 msgr2=0x7f7e480b5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:58.017 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.014+0000 7f7e4e6b6640 1 --2- 172.21.15.105:0/2542510847 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e480d1d40 0x7f7e480b5210 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f7e38005fd0 tx=0x7f7e3802a530 comp rx=0 tx=0).stop 2024-09-21T03:24:58.017 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.014+0000 7f7e4e6b6640 1 -- 172.21.15.105:0/2542510847 shutdown_connections 2024-09-21T03:24:58.017 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.014+0000 7f7e4e6b6640 1 --2- 172.21.15.105:0/2542510847 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e480ccba0 0x7f7e480ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:58.017 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.014+0000 7f7e4e6b6640 1 --2- 172.21.15.105:0/2542510847 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e480d1d40 0x7f7e480b5210 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:58.017 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.014+0000 7f7e4e6b6640 1 -- 172.21.15.105:0/2542510847 >> 172.21.15.105:0/2542510847 conn(0x7f7e480b3f10 msgr2=0x7f7e480b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:58.017 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.014+0000 7f7e4e6b6640 1 -- 172.21.15.105:0/2542510847 shutdown_connections 2024-09-21T03:24:58.017 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.014+0000 7f7e4e6b6640 1 -- 172.21.15.105:0/2542510847 wait complete. 2024-09-21T03:24:58.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.015+0000 7f7e4e6b6640 1 Processor -- start 2024-09-21T03:24:58.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.016+0000 7f7e4e6b6640 1 -- start start 2024-09-21T03:24:58.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.017+0000 7f7e4e6b6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e480ccba0 0x7f7e4814a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:58.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.017+0000 7f7e4e6b6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e480d1d40 0x7f7e48155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:58.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.017+0000 7f7e4e6b6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e4815c6f0 0x7f7e48155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:58.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.017+0000 7f7e4e6b6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7e480d1300 con 0x7f7e480d1d40 2024-09-21T03:24:58.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.017+0000 7f7e4e6b6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7e480d1180 con 0x7f7e480ccba0 2024-09-21T03:24:58.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.017+0000 7f7e4e6b6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7e480d1480 con 0x7f7e4815c6f0 2024-09-21T03:24:58.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.017+0000 7f7e477fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e480d1d40 0x7f7e48155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:58.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.017+0000 7f7e477fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e480d1d40 0x7f7e48155320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:53400/0 (socket says 172.21.15.105:53400) 2024-09-21T03:24:58.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.017+0000 7f7e477fe640 1 -- 172.21.15.105:0/3097883841 learned_addr learned my addr 172.21.15.105:0/3097883841 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:58.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.017+0000 7f7e47fff640 1 --2- 172.21.15.105:0/3097883841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e480ccba0 0x7f7e4814a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:58.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.017+0000 7f7e4cc53640 1 --2- 172.21.15.105:0/3097883841 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e4815c6f0 0x7f7e48155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:58.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.017+0000 7f7e477fe640 1 -- 172.21.15.105:0/3097883841 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e4815c6f0 msgr2=0x7f7e48155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:58.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.017+0000 7f7e477fe640 1 --2- 172.21.15.105:0/3097883841 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e4815c6f0 0x7f7e48155860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:58.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.017+0000 7f7e477fe640 1 -- 172.21.15.105:0/3097883841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e480ccba0 msgr2=0x7f7e4814a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:58.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.017+0000 7f7e477fe640 1 --2- 172.21.15.105:0/3097883841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e480ccba0 0x7f7e4814a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:58.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.017+0000 7f7e477fe640 1 -- 172.21.15.105:0/3097883841 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e4814aec0 con 0x7f7e480d1d40 2024-09-21T03:24:58.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.017+0000 7f7e47fff640 1 --2- 172.21.15.105:0/3097883841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e480ccba0 0x7f7e4814a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:24:58.023 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.018+0000 7f7e477fe640 1 --2- 172.21.15.105:0/3097883841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e480d1d40 0x7f7e48155320 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c00b420 tx=0x7f7e3c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:58.023 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.018+0000 7f7e44ff9640 1 -- 172.21.15.105:0/3097883841 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c011830 con 0x7f7e480d1d40 2024-09-21T03:24:58.023 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.018+0000 7f7e44ff9640 1 -- 172.21.15.105:0/3097883841 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e3c016070 con 0x7f7e480d1d40 2024-09-21T03:24:58.023 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.018+0000 7f7e44ff9640 1 -- 172.21.15.105:0/3097883841 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c011d60 con 0x7f7e480d1d40 2024-09-21T03:24:58.023 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.018+0000 7f7e4e6b6640 1 -- 172.21.15.105:0/3097883841 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e48154e40 con 0x7f7e480d1d40 2024-09-21T03:24:58.023 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.018+0000 7f7e4e6b6640 1 -- 172.21.15.105:0/3097883841 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e480cb6a0 con 0x7f7e480d1d40 2024-09-21T03:24:58.024 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.019+0000 7f7e4e6b6640 1 -- 172.21.15.105:0/3097883841 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e480d19b0 con 0x7f7e480d1d40 2024-09-21T03:24:58.024 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.019+0000 7f7e44ff9640 1 -- 172.21.15.105:0/3097883841 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7e3c01b460 con 0x7f7e480d1d40 2024-09-21T03:24:58.024 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.020+0000 7f7e44ff9640 1 --2- 172.21.15.105:0/3097883841 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7e34078b90 0x7f7e3407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:58.024 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.020+0000 7f7e44ff9640 1 -- 172.21.15.105:0/3097883841 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 4943+0+0 (secure 0 0 0) 0x7f7e3c09a5b0 con 0x7f7e480d1d40 2024-09-21T03:24:58.024 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.020+0000 7f7e47fff640 1 --2- 172.21.15.105:0/3097883841 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7e34078b90 0x7f7e3407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:58.024 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.021+0000 7f7e47fff640 1 --2- 172.21.15.105:0/3097883841 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7e34078b90 0x7f7e3407b0a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7e38033000 tx=0x7f7e38004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:58.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.025+0000 7f7e44ff9640 1 -- 172.21.15.105:0/3097883841 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7e3c020020 con 0x7f7e480d1d40 2024-09-21T03:24:58.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.212+0000 7f7e4e6b6640 1 -- 172.21.15.105:0/3097883841 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f7e480cb150 con 0x7f7e480d1d40 2024-09-21T03:24:58.218 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.216+0000 7f7e44ff9640 1 -- 172.21.15.105:0/3097883841 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v50) ==== 71+0+0 (secure 0 0 0) 0x7f7e4814aec0 con 0x7f7e480d1d40 2024-09-21T03:24:58.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.218+0000 7f7e4e6b6640 1 -- 172.21.15.105:0/3097883841 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7e34078b90 msgr2=0x7f7e3407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:58.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.218+0000 7f7e4e6b6640 1 --2- 172.21.15.105:0/3097883841 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7e34078b90 0x7f7e3407b0a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7e38033000 tx=0x7f7e38004730 comp rx=0 tx=0).stop 2024-09-21T03:24:58.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.218+0000 7f7e4e6b6640 1 -- 172.21.15.105:0/3097883841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e480d1d40 msgr2=0x7f7e48155320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:58.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.218+0000 7f7e4e6b6640 1 --2- 172.21.15.105:0/3097883841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e480d1d40 0x7f7e48155320 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c00b420 tx=0x7f7e3c00b8e0 comp rx=0 tx=0).stop 2024-09-21T03:24:58.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.218+0000 7f7e4e6b6640 1 -- 172.21.15.105:0/3097883841 shutdown_connections 2024-09-21T03:24:58.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.218+0000 7f7e4e6b6640 1 --2- 172.21.15.105:0/3097883841 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7e34078b90 0x7f7e3407b0a0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:58.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.218+0000 7f7e4e6b6640 1 --2- 172.21.15.105:0/3097883841 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e4815c6f0 0x7f7e48155860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:58.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.218+0000 7f7e4e6b6640 1 --2- 172.21.15.105:0/3097883841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e480d1d40 0x7f7e48155320 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:58.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.218+0000 7f7e4e6b6640 1 --2- 172.21.15.105:0/3097883841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e480ccba0 0x7f7e4814a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:58.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.218+0000 7f7e4e6b6640 1 -- 172.21.15.105:0/3097883841 >> 172.21.15.105:0/3097883841 conn(0x7f7e480b3f10 msgr2=0x7f7e480b5890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:58.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.219+0000 7f7e4e6b6640 1 -- 172.21.15.105:0/3097883841 shutdown_connections 2024-09-21T03:24:58.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.219+0000 7f7e4e6b6640 1 -- 172.21.15.105:0/3097883841 wait complete. 2024-09-21T03:24:58.232 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_oldest_tid' 2024-09-21T03:24:58.345 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.342+0000 7f54af539640 1 -- 172.21.15.105:0/1248447661 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54a80706b0 msgr2=0x7f54a80cba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:58.345 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.342+0000 7f54af539640 1 --2- 172.21.15.105:0/1248447661 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54a80706b0 0x7f54a80cba00 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f54a809e2e0 tx=0x7f549c02a530 comp rx=0 tx=0).stop 2024-09-21T03:24:58.345 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.342+0000 7f54af539640 1 -- 172.21.15.105:0/1248447661 shutdown_connections 2024-09-21T03:24:58.345 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.342+0000 7f54af539640 1 --2- 172.21.15.105:0/1248447661 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54a80cad30 0x7f54a80735b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:58.346 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.342+0000 7f54af539640 1 --2- 172.21.15.105:0/1248447661 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54a80706b0 0x7f54a80cba00 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:58.346 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.342+0000 7f54af539640 1 -- 172.21.15.105:0/1248447661 >> 172.21.15.105:0/1248447661 conn(0x7f54a80b1cb0 msgr2=0x7f54a80b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:58.346 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.342+0000 7f54af539640 1 -- 172.21.15.105:0/1248447661 shutdown_connections 2024-09-21T03:24:58.346 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.342+0000 7f54af539640 1 -- 172.21.15.105:0/1248447661 wait complete. 2024-09-21T03:24:58.346 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.344+0000 7f54af539640 1 Processor -- start 2024-09-21T03:24:58.347 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.344+0000 7f54af539640 1 -- start start 2024-09-21T03:24:58.349 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.345+0000 7f54af539640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54a80ca800 0x7f54a81f9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:58.349 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.345+0000 7f54af539640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54a80cad30 0x7f54a815a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:58.350 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.345+0000 7f54af539640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54a806ee90 0x7f54a806f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:58.350 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.345+0000 7f54af539640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f54a8073f00 con 0x7f54a80cad30 2024-09-21T03:24:58.350 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.345+0000 7f54af539640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f54a8073d80 con 0x7f54a80ca800 2024-09-21T03:24:58.350 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.345+0000 7f54af539640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f54a8074080 con 0x7f54a806ee90 2024-09-21T03:24:58.350 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.345+0000 7f54acad4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54a80cad30 0x7f54a815a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:58.350 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.345+0000 7f54acad4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54a80cad30 0x7f54a815a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:53430/0 (socket says 172.21.15.105:53430) 2024-09-21T03:24:58.350 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.345+0000 7f54acad4640 1 -- 172.21.15.105:0/1191995400 learned_addr learned my addr 172.21.15.105:0/1191995400 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:58.350 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.346+0000 7f54ad2d5640 1 --2- 172.21.15.105:0/1191995400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54a80ca800 0x7f54a81f9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:58.350 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.346+0000 7f54adad6640 1 --2- 172.21.15.105:0/1191995400 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54a806ee90 0x7f54a806f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:58.350 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.346+0000 7f54acad4640 1 -- 172.21.15.105:0/1191995400 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54a806ee90 msgr2=0x7f54a806f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:58.350 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.346+0000 7f54acad4640 1 --2- 172.21.15.105:0/1191995400 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54a806ee90 0x7f54a806f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:58.350 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.346+0000 7f54acad4640 1 -- 172.21.15.105:0/1191995400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54a80ca800 msgr2=0x7f54a81f9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:58.350 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.346+0000 7f54acad4640 1 --2- 172.21.15.105:0/1191995400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54a80ca800 0x7f54a81f9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:58.351 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.346+0000 7f54acad4640 1 -- 172.21.15.105:0/1191995400 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54a806f7e0 con 0x7f54a80cad30 2024-09-21T03:24:58.351 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.346+0000 7f54acad4640 1 --2- 172.21.15.105:0/1191995400 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54a80cad30 0x7f54a815a2a0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f549c000c00 tx=0x7f549c0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:58.351 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.346+0000 7f54a5ffb640 1 -- 172.21.15.105:0/1191995400 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549c03e030 con 0x7f54a80cad30 2024-09-21T03:24:58.351 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.346+0000 7f54a5ffb640 1 -- 172.21.15.105:0/1191995400 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f549c0047a0 con 0x7f54a80cad30 2024-09-21T03:24:58.351 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.346+0000 7f54af539640 1 -- 172.21.15.105:0/1191995400 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54a81f9fc0 con 0x7f54a80cad30 2024-09-21T03:24:58.351 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.346+0000 7f54a5ffb640 1 -- 172.21.15.105:0/1191995400 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549c035040 con 0x7f54a80cad30 2024-09-21T03:24:58.351 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.346+0000 7f54af539640 1 -- 172.21.15.105:0/1191995400 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54a80c4530 con 0x7f54a80cad30 2024-09-21T03:24:58.352 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.347+0000 7f54af539640 1 -- 172.21.15.105:0/1191995400 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54a80745e0 con 0x7f54a80cad30 2024-09-21T03:24:58.352 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.348+0000 7f54a5ffb640 1 -- 172.21.15.105:0/1191995400 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f549c041030 con 0x7f54a80cad30 2024-09-21T03:24:58.352 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.349+0000 7f54a5ffb640 1 --2- 172.21.15.105:0/1191995400 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5494078b90 0x7f549407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:58.352 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.349+0000 7f54a5ffb640 1 -- 172.21.15.105:0/1191995400 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 4943+0+0 (secure 0 0 0) 0x7f549c0bb2d0 con 0x7f54a80cad30 2024-09-21T03:24:58.352 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.349+0000 7f54ad2d5640 1 --2- 172.21.15.105:0/1191995400 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5494078b90 0x7f549407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:58.352 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.349+0000 7f54ad2d5640 1 --2- 172.21.15.105:0/1191995400 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5494078b90 0x7f549407b0a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f54a80cb250 tx=0x7f54980094d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:58.356 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.353+0000 7f54a5ffb640 1 -- 172.21.15.105:0/1191995400 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f54a806f7e0 con 0x7f54a80cad30 2024-09-21T03:24:58.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.596+0000 7f54af539640 1 -- 172.21.15.105:0/1191995400 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_oldest_tid"]} v 0) -- 0x7f54a80b1860 con 0x7f54a80cad30 2024-09-21T03:24:58.889 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.886+0000 7f54a5ffb640 1 -- 172.21.15.105:0/1191995400 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_oldest_tid"]}]=0 v322) ==== 150+0+0 (secure 0 0 0) 0x7f549c083aa0 con 0x7f54a80cad30 2024-09-21T03:24:58.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.889+0000 7f54af539640 1 -- 172.21.15.105:0/1191995400 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5494078b90 msgr2=0x7f549407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:58.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.889+0000 7f54af539640 1 --2- 172.21.15.105:0/1191995400 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5494078b90 0x7f549407b0a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f54a80cb250 tx=0x7f54980094d0 comp rx=0 tx=0).stop 2024-09-21T03:24:58.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.889+0000 7f54af539640 1 -- 172.21.15.105:0/1191995400 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54a80cad30 msgr2=0x7f54a815a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:58.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.889+0000 7f54af539640 1 --2- 172.21.15.105:0/1191995400 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54a80cad30 0x7f54a815a2a0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f549c000c00 tx=0x7f549c0039e0 comp rx=0 tx=0).stop 2024-09-21T03:24:58.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.889+0000 7f54af539640 1 -- 172.21.15.105:0/1191995400 shutdown_connections 2024-09-21T03:24:58.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.889+0000 7f54af539640 1 --2- 172.21.15.105:0/1191995400 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5494078b90 0x7f549407b0a0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:58.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.889+0000 7f54af539640 1 --2- 172.21.15.105:0/1191995400 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54a806ee90 0x7f54a806f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:58.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.889+0000 7f54af539640 1 --2- 172.21.15.105:0/1191995400 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54a80cad30 0x7f54a815a2a0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:58.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.889+0000 7f54af539640 1 --2- 172.21.15.105:0/1191995400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54a80ca800 0x7f54a81f9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:58.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.889+0000 7f54af539640 1 -- 172.21.15.105:0/1191995400 >> 172.21.15.105:0/1191995400 conn(0x7f54a80b1cb0 msgr2=0x7f54a80b36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:58.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.889+0000 7f54af539640 1 -- 172.21.15.105:0/1191995400 shutdown_connections 2024-09-21T03:24:58.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:58.889+0000 7f54af539640 1 -- 172.21.15.105:0/1191995400 wait complete. 2024-09-21T03:24:58.904 INFO:tasks.cephfs_test_runner:When a client does not advance its oldest tid, the MDS should notice that ... skipped 'Require FUSE client to inject client release failure' 2024-09-21T03:24:58.904 INFO:tasks.cephfs_test_runner:Starting test: test_client_pin (tasks.cephfs.test_client_limits.TestClientLimits) 2024-09-21T03:24:58.904 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:24:59.017 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.015+0000 7f3ed47c3640 1 -- 172.21.15.105:0/2560492247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3eb4004800 msgr2=0x7f3eb4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:59.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.015+0000 7f3ed47c3640 1 --2- 172.21.15.105:0/2560492247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3eb4004800 0x7f3eb4004c10 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f3ec000c2e0 tx=0x7f3eb4005830 comp rx=0 tx=0).stop 2024-09-21T03:24:59.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.015+0000 7f3ed47c3640 1 -- 172.21.15.105:0/2560492247 shutdown_connections 2024-09-21T03:24:59.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.015+0000 7f3ed47c3640 1 --2- 172.21.15.105:0/2560492247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3eb4004800 0x7f3eb4004c10 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:59.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.015+0000 7f3ed47c3640 1 -- 172.21.15.105:0/2560492247 >> 172.21.15.105:0/2560492247 conn(0x7f3ecc08bfc0 msgr2=0x7f3ecc09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:59.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.015+0000 7f3ed47c3640 1 -- 172.21.15.105:0/2560492247 shutdown_connections 2024-09-21T03:24:59.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.015+0000 7f3ed47c3640 1 -- 172.21.15.105:0/2560492247 wait complete. 2024-09-21T03:24:59.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.016+0000 7f3ed47c3640 1 Processor -- start 2024-09-21T03:24:59.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.017+0000 7f3ed47c3640 1 -- start start 2024-09-21T03:24:59.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.018+0000 7f3ed47c3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3eb4004800 0x7f3ecc15b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:59.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.018+0000 7f3ed47c3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ecc15b9e0 0x7f3ecc0ca3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:59.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.018+0000 7f3ed47c3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ecc0ca8f0 0x7f3ecc1f8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:59.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.018+0000 7f3ed47c3640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3ecc0d1c00 con 0x7f3eb4004800 2024-09-21T03:24:59.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.018+0000 7f3ed47c3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3ecc0d1a80 con 0x7f3ecc15b9e0 2024-09-21T03:24:59.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.018+0000 7f3ed47c3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3ecc0d1d80 con 0x7f3ecc0ca8f0 2024-09-21T03:24:59.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.018+0000 7f3ed255f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3eb4004800 0x7f3ecc15b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:59.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.018+0000 7f3ed255f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3eb4004800 0x7f3ecc15b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:53444/0 (socket says 172.21.15.105:53444) 2024-09-21T03:24:59.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.018+0000 7f3ed255f640 1 -- 172.21.15.105:0/2111153265 learned_addr learned my addr 172.21.15.105:0/2111153265 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:59.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.018+0000 7f3ed2d60640 1 --2- 172.21.15.105:0/2111153265 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ecc0ca8f0 0x7f3ecc1f8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:59.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.018+0000 7f3ed1d5e640 1 --2- 172.21.15.105:0/2111153265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ecc15b9e0 0x7f3ecc0ca3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:59.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.018+0000 7f3ed255f640 1 -- 172.21.15.105:0/2111153265 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ecc0ca8f0 msgr2=0x7f3ecc1f8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:59.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.018+0000 7f3ed255f640 1 --2- 172.21.15.105:0/2111153265 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ecc0ca8f0 0x7f3ecc1f8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:59.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.018+0000 7f3ed255f640 1 -- 172.21.15.105:0/2111153265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ecc15b9e0 msgr2=0x7f3ecc0ca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:59.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.018+0000 7f3ed255f640 1 --2- 172.21.15.105:0/2111153265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ecc15b9e0 0x7f3ecc0ca3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:59.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.018+0000 7f3ed255f640 1 -- 172.21.15.105:0/2111153265 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ecc0cad00 con 0x7f3eb4004800 2024-09-21T03:24:59.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.018+0000 7f3ed255f640 1 --2- 172.21.15.105:0/2111153265 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3eb4004800 0x7f3ecc15b320 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc00b650 tx=0x7f3ebc00bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:59.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.018+0000 7f3ecaffd640 1 -- 172.21.15.105:0/2111153265 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc010bb0 con 0x7f3eb4004800 2024-09-21T03:24:59.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.018+0000 7f3ecaffd640 1 -- 172.21.15.105:0/2111153265 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ebc015070 con 0x7f3eb4004800 2024-09-21T03:24:59.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.018+0000 7f3ed47c3640 1 -- 172.21.15.105:0/2111153265 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ecc0cb8c0 con 0x7f3eb4004800 2024-09-21T03:24:59.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.019+0000 7f3ecaffd640 1 -- 172.21.15.105:0/2111153265 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc01a470 con 0x7f3eb4004800 2024-09-21T03:24:59.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.019+0000 7f3ed47c3640 1 -- 172.21.15.105:0/2111153265 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ecc0cbe80 con 0x7f3eb4004800 2024-09-21T03:24:59.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.020+0000 7f3ed47c3640 1 -- 172.21.15.105:0/2111153265 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ecc0cf310 con 0x7f3eb4004800 2024-09-21T03:24:59.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.020+0000 7f3ecaffd640 1 -- 172.21.15.105:0/2111153265 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3ebc01a610 con 0x7f3eb4004800 2024-09-21T03:24:59.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.021+0000 7f3ecaffd640 1 --2- 172.21.15.105:0/2111153265 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3eb8078b90 0x7f3eb807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:59.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.021+0000 7f3ecaffd640 1 -- 172.21.15.105:0/2111153265 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 4943+0+0 (secure 0 0 0) 0x7f3ebc09b620 con 0x7f3eb4004800 2024-09-21T03:24:59.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.021+0000 7f3ed1d5e640 1 --2- 172.21.15.105:0/2111153265 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3eb8078b90 0x7f3eb807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:59.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.022+0000 7f3ed1d5e640 1 --2- 172.21.15.105:0/2111153265 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3eb8078b90 0x7f3eb807b0a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0033000 tx=0x7f3ec002d000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:59.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.026+0000 7f3ecaffd640 1 -- 172.21.15.105:0/2111153265 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3ecc0cad00 con 0x7f3eb4004800 2024-09-21T03:24:59.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.205+0000 7f3ed47c3640 1 -- 172.21.15.105:0/2111153265 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3ecc0b4020 con 0x7f3eb4004800 2024-09-21T03:24:59.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.206+0000 7f3ecaffd640 1 -- 172.21.15.105:0/2111153265 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) ==== 74+0+13105 (secure 0 0 0) 0x7f3ebc063e80 con 0x7f3eb4004800 2024-09-21T03:24:59.383 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:24:59.383 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":96,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:24:57.879987+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.105:6834/636426076":"2024-09-22T03:24:54.870649+0000","172.21.15.105:6832/636426076":"2024-09-22T03:24:54.870649+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:24:59.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.208+0000 7f3ed47c3640 1 -- 172.21.15.105:0/2111153265 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3eb8078b90 msgr2=0x7f3eb807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:59.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.208+0000 7f3ed47c3640 1 --2- 172.21.15.105:0/2111153265 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3eb8078b90 0x7f3eb807b0a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0033000 tx=0x7f3ec002d000 comp rx=0 tx=0).stop 2024-09-21T03:24:59.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.208+0000 7f3ed47c3640 1 -- 172.21.15.105:0/2111153265 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3eb4004800 msgr2=0x7f3ecc15b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:59.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.208+0000 7f3ed47c3640 1 --2- 172.21.15.105:0/2111153265 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3eb4004800 0x7f3ecc15b320 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc00b650 tx=0x7f3ebc00bb10 comp rx=0 tx=0).stop 2024-09-21T03:24:59.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.208+0000 7f3ed47c3640 1 -- 172.21.15.105:0/2111153265 shutdown_connections 2024-09-21T03:24:59.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.208+0000 7f3ed47c3640 1 --2- 172.21.15.105:0/2111153265 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3eb8078b90 0x7f3eb807b0a0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:59.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.208+0000 7f3ed47c3640 1 --2- 172.21.15.105:0/2111153265 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ecc0ca8f0 0x7f3ecc1f8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:59.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.208+0000 7f3ed47c3640 1 --2- 172.21.15.105:0/2111153265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ecc15b9e0 0x7f3ecc0ca3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:59.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.208+0000 7f3ed47c3640 1 --2- 172.21.15.105:0/2111153265 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3eb4004800 0x7f3ecc15b320 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:59.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.208+0000 7f3ed47c3640 1 -- 172.21.15.105:0/2111153265 >> 172.21.15.105:0/2111153265 conn(0x7f3ecc08bfc0 msgr2=0x7f3ecc0ce4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:59.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.208+0000 7f3ed47c3640 1 -- 172.21.15.105:0/2111153265 shutdown_connections 2024-09-21T03:24:59.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.208+0000 7f3ed47c3640 1 -- 172.21.15.105:0/2111153265 wait complete. 2024-09-21T03:24:59.385 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T03:18:19.296947+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T03:24:59.385 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T03:24:59.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.499+0000 7f0d91c94640 1 -- 172.21.15.105:0/3977687966 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d8c0cecf0 msgr2=0x7f0d8c0cf100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:59.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.499+0000 7f0d91c94640 1 --2- 172.21.15.105:0/3977687966 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d8c0cecf0 0x7f0d8c0cf100 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f0d84009830 tx=0x7f0d8402a480 comp rx=0 tx=0).stop 2024-09-21T03:24:59.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.499+0000 7f0d91c94640 1 -- 172.21.15.105:0/3977687966 shutdown_connections 2024-09-21T03:24:59.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.499+0000 7f0d91c94640 1 --2- 172.21.15.105:0/3977687966 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d8c0cecf0 0x7f0d8c0cf100 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:59.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.499+0000 7f0d91c94640 1 --2- 172.21.15.105:0/3977687966 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d8c160f30 0x7f0d8c156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:59.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.499+0000 7f0d91c94640 1 -- 172.21.15.105:0/3977687966 >> 172.21.15.105:0/3977687966 conn(0x7f0d8c06d550 msgr2=0x7f0d8c071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:59.502 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.499+0000 7f0d91c94640 1 -- 172.21.15.105:0/3977687966 shutdown_connections 2024-09-21T03:24:59.503 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.499+0000 7f0d91c94640 1 -- 172.21.15.105:0/3977687966 wait complete. 2024-09-21T03:24:59.503 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.501+0000 7f0d91c94640 1 Processor -- start 2024-09-21T03:24:59.503 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.501+0000 7f0d91c94640 1 -- start start 2024-09-21T03:24:59.506 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.502+0000 7f0d91c94640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d8c0cd3a0 0x7f0d8c14d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:59.506 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.502+0000 7f0d91c94640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d8c0cecf0 0x7f0d8c0b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:59.506 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.502+0000 7f0d91c94640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d8c160f30 0x7f0d8c0b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:59.506 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.502+0000 7f0d91c94640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8c0d0960 con 0x7f0d8c0cd3a0 2024-09-21T03:24:59.506 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.502+0000 7f0d91c94640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8c0d07e0 con 0x7f0d8c160f30 2024-09-21T03:24:59.506 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.502+0000 7f0d91c94640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0d8c0d0ae0 con 0x7f0d8c0cecf0 2024-09-21T03:24:59.506 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.502+0000 7f0d8b7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d8c0cd3a0 0x7f0d8c14d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:59.506 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.502+0000 7f0d8b7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d8c0cd3a0 0x7f0d8c14d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:53472/0 (socket says 172.21.15.105:53472) 2024-09-21T03:24:59.507 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.502+0000 7f0d8b7fe640 1 -- 172.21.15.105:0/1303746871 learned_addr learned my addr 172.21.15.105:0/1303746871 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:59.507 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.502+0000 7f0d8affd640 1 --2- 172.21.15.105:0/1303746871 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d8c0cecf0 0x7f0d8c0b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:59.507 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.502+0000 7f0d8bfff640 1 --2- 172.21.15.105:0/1303746871 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d8c160f30 0x7f0d8c0b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:59.507 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.503+0000 7f0d8b7fe640 1 -- 172.21.15.105:0/1303746871 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d8c0cecf0 msgr2=0x7f0d8c0b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:59.507 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.503+0000 7f0d8b7fe640 1 --2- 172.21.15.105:0/1303746871 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d8c0cecf0 0x7f0d8c0b36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:59.507 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.503+0000 7f0d8b7fe640 1 -- 172.21.15.105:0/1303746871 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d8c160f30 msgr2=0x7f0d8c0b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:59.507 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.503+0000 7f0d8b7fe640 1 --2- 172.21.15.105:0/1303746871 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d8c160f30 0x7f0d8c0b3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:59.507 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.503+0000 7f0d8b7fe640 1 -- 172.21.15.105:0/1303746871 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d8c14dbb0 con 0x7f0d8c0cd3a0 2024-09-21T03:24:59.507 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.503+0000 7f0d8bfff640 1 --2- 172.21.15.105:0/1303746871 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d8c160f30 0x7f0d8c0b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:24:59.507 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.503+0000 7f0d8b7fe640 1 --2- 172.21.15.105:0/1303746871 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d8c0cd3a0 0x7f0d8c14d670 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c00cbf0 tx=0x7f0d7c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:59.507 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.503+0000 7f0d73fff640 1 -- 172.21.15.105:0/1303746871 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c016020 con 0x7f0d8c0cd3a0 2024-09-21T03:24:59.507 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.503+0000 7f0d73fff640 1 -- 172.21.15.105:0/1303746871 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0d7c00ad90 con 0x7f0d8c0cd3a0 2024-09-21T03:24:59.507 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.503+0000 7f0d73fff640 1 -- 172.21.15.105:0/1303746871 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c012680 con 0x7f0d8c0cd3a0 2024-09-21T03:24:59.508 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.503+0000 7f0d91c94640 1 -- 172.21.15.105:0/1303746871 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d8c159ab0 con 0x7f0d8c0cd3a0 2024-09-21T03:24:59.508 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.503+0000 7f0d91c94640 1 -- 172.21.15.105:0/1303746871 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d8c0b2ee0 con 0x7f0d8c0cd3a0 2024-09-21T03:24:59.508 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.504+0000 7f0d91c94640 1 -- 172.21.15.105:0/1303746871 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d8c0d1070 con 0x7f0d8c0cd3a0 2024-09-21T03:24:59.508 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.505+0000 7f0d73fff640 1 -- 172.21.15.105:0/1303746871 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0d7c019020 con 0x7f0d8c0cd3a0 2024-09-21T03:24:59.508 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.505+0000 7f0d73fff640 1 --2- 172.21.15.105:0/1303746871 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0d78078b90 0x7f0d7807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:59.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.505+0000 7f0d73fff640 1 -- 172.21.15.105:0/1303746871 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 4943+0+0 (secure 0 0 0) 0x7f0d7c09af90 con 0x7f0d8c0cd3a0 2024-09-21T03:24:59.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.506+0000 7f0d8affd640 1 --2- 172.21.15.105:0/1303746871 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0d78078b90 0x7f0d7807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:59.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.506+0000 7f0d8affd640 1 --2- 172.21.15.105:0/1303746871 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0d78078b90 0x7f0d7807b0a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c0722a0 tx=0x7f0d8000b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:59.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.510+0000 7f0d73fff640 1 -- 172.21.15.105:0/1303746871 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0d7c020020 con 0x7f0d8c0cd3a0 2024-09-21T03:24:59.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.686+0000 7f0d91c94640 1 -- 172.21.15.105:0/1303746871 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0d8c15ba20 con 0x7f0d8c0cd3a0 2024-09-21T03:24:59.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.686+0000 7f0d73fff640 1 -- 172.21.15.105:0/1303746871 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v96) ==== 93+0+10 (secure 0 0 0) 0x7f0d8c0cf640 con 0x7f0d8c0cd3a0 2024-09-21T03:24:59.689 INFO:teuthology.orchestra.run.smithi105.stdout:pg_num: 1 2024-09-21T03:24:59.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.688+0000 7f0d91c94640 1 -- 172.21.15.105:0/1303746871 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0d78078b90 msgr2=0x7f0d7807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:59.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.688+0000 7f0d91c94640 1 --2- 172.21.15.105:0/1303746871 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0d78078b90 0x7f0d7807b0a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c0722a0 tx=0x7f0d8000b2e0 comp rx=0 tx=0).stop 2024-09-21T03:24:59.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.688+0000 7f0d91c94640 1 -- 172.21.15.105:0/1303746871 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d8c0cd3a0 msgr2=0x7f0d8c14d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:59.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.688+0000 7f0d91c94640 1 --2- 172.21.15.105:0/1303746871 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d8c0cd3a0 0x7f0d8c14d670 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c00cbf0 tx=0x7f0d7c00a060 comp rx=0 tx=0).stop 2024-09-21T03:24:59.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.689+0000 7f0d91c94640 1 -- 172.21.15.105:0/1303746871 shutdown_connections 2024-09-21T03:24:59.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.689+0000 7f0d91c94640 1 --2- 172.21.15.105:0/1303746871 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0d78078b90 0x7f0d7807b0a0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:59.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.689+0000 7f0d91c94640 1 --2- 172.21.15.105:0/1303746871 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d8c160f30 0x7f0d8c0b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:59.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.689+0000 7f0d91c94640 1 --2- 172.21.15.105:0/1303746871 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d8c0cecf0 0x7f0d8c0b36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:59.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.689+0000 7f0d91c94640 1 --2- 172.21.15.105:0/1303746871 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d8c0cd3a0 0x7f0d8c14d670 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:59.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.689+0000 7f0d91c94640 1 -- 172.21.15.105:0/1303746871 >> 172.21.15.105:0/1303746871 conn(0x7f0d8c06d550 msgr2=0x7f0d8c071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:59.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.689+0000 7f0d91c94640 1 -- 172.21.15.105:0/1303746871 shutdown_connections 2024-09-21T03:24:59.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.689+0000 7f0d91c94640 1 -- 172.21.15.105:0/1303746871 wait complete. 2024-09-21T03:24:59.702 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin' 2024-09-21T03:24:59.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.812+0000 7f8c6ec38640 1 -- 172.21.15.105:0/3208136974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c680cd370 msgr2=0x7f8c6815d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:59.814 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.812+0000 7f8c6ec38640 1 --2- 172.21.15.105:0/3208136974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c680cd370 0x7f8c6815d7d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8c58005fd0 tx=0x7f8c5802a5d0 comp rx=0 tx=0).stop 2024-09-21T03:24:59.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.812+0000 7f8c6ec38640 1 -- 172.21.15.105:0/3208136974 shutdown_connections 2024-09-21T03:24:59.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.812+0000 7f8c6ec38640 1 --2- 172.21.15.105:0/3208136974 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c6815c8b0 0x7f8c6815dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:59.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.812+0000 7f8c6ec38640 1 --2- 172.21.15.105:0/3208136974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c680cd370 0x7f8c6815d7d0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:59.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.812+0000 7f8c6ec38640 1 -- 172.21.15.105:0/3208136974 >> 172.21.15.105:0/3208136974 conn(0x7f8c6806d230 msgr2=0x7f8c6806d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:24:59.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.812+0000 7f8c6ec38640 1 -- 172.21.15.105:0/3208136974 shutdown_connections 2024-09-21T03:24:59.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.812+0000 7f8c6ec38640 1 -- 172.21.15.105:0/3208136974 wait complete. 2024-09-21T03:24:59.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.813+0000 7f8c6ec38640 1 Processor -- start 2024-09-21T03:24:59.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.813+0000 7f8c6ec38640 1 -- start start 2024-09-21T03:24:59.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.815+0000 7f8c6ec38640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c680cff40 0x7f8c681f66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:59.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.815+0000 7f8c6ec38640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c6815c8b0 0x7f8c680b3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:59.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.815+0000 7f8c6ec38640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c680b3770 0x7f8c680aa220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:59.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.815+0000 7f8c6ec38640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6815eb10 con 0x7f8c680b3770 2024-09-21T03:24:59.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.815+0000 7f8c6ec38640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6815e990 con 0x7f8c6815c8b0 2024-09-21T03:24:59.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.815+0000 7f8c6ec38640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8c6815ec90 con 0x7f8c680cff40 2024-09-21T03:24:59.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.815+0000 7f8c6d1d5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c680b3770 0x7f8c680aa220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:59.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.815+0000 7f8c6d1d5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c680b3770 0x7f8c680aa220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:53476/0 (socket says 172.21.15.105:53476) 2024-09-21T03:24:59.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.815+0000 7f8c6d1d5640 1 -- 172.21.15.105:0/1279538792 learned_addr learned my addr 172.21.15.105:0/1279538792 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:24:59.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.815+0000 7f8c6c9d4640 1 --2- 172.21.15.105:0/1279538792 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c680cff40 0x7f8c681f66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:59.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.815+0000 7f8c5ffff640 1 --2- 172.21.15.105:0/1279538792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c6815c8b0 0x7f8c680b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:59.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.815+0000 7f8c6d1d5640 1 -- 172.21.15.105:0/1279538792 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c680cff40 msgr2=0x7f8c681f66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:59.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.815+0000 7f8c6d1d5640 1 --2- 172.21.15.105:0/1279538792 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c680cff40 0x7f8c681f66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:59.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.815+0000 7f8c6d1d5640 1 -- 172.21.15.105:0/1279538792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c6815c8b0 msgr2=0x7f8c680b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:24:59.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.815+0000 7f8c6d1d5640 1 --2- 172.21.15.105:0/1279538792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c6815c8b0 0x7f8c680b3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:24:59.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.816+0000 7f8c6d1d5640 1 -- 172.21.15.105:0/1279538792 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c681f31c0 con 0x7f8c680b3770 2024-09-21T03:24:59.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.816+0000 7f8c6d1d5640 1 --2- 172.21.15.105:0/1279538792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c680b3770 0x7f8c680aa220 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f8c6000eab0 tx=0x7f8c6000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:59.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.816+0000 7f8c5d7fa640 1 -- 172.21.15.105:0/1279538792 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6000ce40 con 0x7f8c680b3770 2024-09-21T03:24:59.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.816+0000 7f8c5d7fa640 1 -- 172.21.15.105:0/1279538792 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c60004b20 con 0x7f8c680b3770 2024-09-21T03:24:59.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.816+0000 7f8c5d7fa640 1 -- 172.21.15.105:0/1279538792 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c60005020 con 0x7f8c680b3770 2024-09-21T03:24:59.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.816+0000 7f8c6ec38640 1 -- 172.21.15.105:0/1279538792 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c680aa760 con 0x7f8c680b3770 2024-09-21T03:24:59.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.816+0000 7f8c6ec38640 1 -- 172.21.15.105:0/1279538792 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c681f6fb0 con 0x7f8c680b3770 2024-09-21T03:24:59.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.817+0000 7f8c6ec38640 1 -- 172.21.15.105:0/1279538792 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c6815f220 con 0x7f8c680b3770 2024-09-21T03:24:59.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.818+0000 7f8c5d7fa640 1 -- 172.21.15.105:0/1279538792 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8c600051c0 con 0x7f8c680b3770 2024-09-21T03:24:59.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.818+0000 7f8c5d7fa640 1 --2- 172.21.15.105:0/1279538792 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c54078b90 0x7f8c5407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:24:59.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.818+0000 7f8c5d7fa640 1 -- 172.21.15.105:0/1279538792 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 4943+0+0 (secure 0 0 0) 0x7f8c6009b6c0 con 0x7f8c680b3770 2024-09-21T03:24:59.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.818+0000 7f8c6c9d4640 1 --2- 172.21.15.105:0/1279538792 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c54078b90 0x7f8c5407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:24:59.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.819+0000 7f8c6c9d4640 1 --2- 172.21.15.105:0/1279538792 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c54078b90 0x7f8c5407b0a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8c680cfe60 tx=0x7f8c64009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:24:59.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:24:59.823+0000 7f8c5d7fa640 1 -- 172.21.15.105:0/1279538792 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8c60063e90 con 0x7f8c680b3770 2024-09-21T03:25:00.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:00.071+0000 7f8c6ec38640 1 -- 172.21.15.105:0/1279538792 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin"]} v 0) -- 0x7f8c68069120 con 0x7f8c680b3770 2024-09-21T03:25:00.896 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:00.893+0000 7f8c5d7fa640 1 -- 172.21.15.105:0/1279538792 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin"]}]=0 v324) ==== 146+0+0 (secure 0 0 0) 0x7f8c60063790 con 0x7f8c680b3770 2024-09-21T03:25:00.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:00.896+0000 7f8c6ec38640 1 -- 172.21.15.105:0/1279538792 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c54078b90 msgr2=0x7f8c5407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:00.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:00.896+0000 7f8c6ec38640 1 --2- 172.21.15.105:0/1279538792 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c54078b90 0x7f8c5407b0a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8c680cfe60 tx=0x7f8c64009040 comp rx=0 tx=0).stop 2024-09-21T03:25:00.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:00.896+0000 7f8c6ec38640 1 -- 172.21.15.105:0/1279538792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c680b3770 msgr2=0x7f8c680aa220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:00.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:00.896+0000 7f8c6ec38640 1 --2- 172.21.15.105:0/1279538792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c680b3770 0x7f8c680aa220 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f8c6000eab0 tx=0x7f8c6000ef70 comp rx=0 tx=0).stop 2024-09-21T03:25:00.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:00.896+0000 7f8c6ec38640 1 -- 172.21.15.105:0/1279538792 shutdown_connections 2024-09-21T03:25:00.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:00.896+0000 7f8c6ec38640 1 --2- 172.21.15.105:0/1279538792 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c54078b90 0x7f8c5407b0a0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:00.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:00.896+0000 7f8c6ec38640 1 --2- 172.21.15.105:0/1279538792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c680b3770 0x7f8c680aa220 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:00.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:00.896+0000 7f8c6ec38640 1 --2- 172.21.15.105:0/1279538792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c6815c8b0 0x7f8c680b3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:00.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:00.896+0000 7f8c6ec38640 1 --2- 172.21.15.105:0/1279538792 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c680cff40 0x7f8c681f66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:00.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:00.896+0000 7f8c6ec38640 1 -- 172.21.15.105:0/1279538792 >> 172.21.15.105:0/1279538792 conn(0x7f8c6806d230 msgr2=0x7f8c680c9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:00.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:00.896+0000 7f8c6ec38640 1 -- 172.21.15.105:0/1279538792 shutdown_connections 2024-09-21T03:25:00.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:00.896+0000 7f8c6ec38640 1 -- 172.21.15.105:0/1279538792 wait complete. 2024-09-21T03:25:00.912 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T03:25:01.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.028+0000 7f48044b4640 1 -- 172.21.15.105:0/4162769091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47fc0d0e50 msgr2=0x7f47fc0d1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:01.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.028+0000 7f48044b4640 1 --2- 172.21.15.105:0/4162769091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47fc0d0e50 0x7f47fc0d1260 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f47fc08d490 tx=0x7f47f402a790 comp rx=0 tx=0).stop 2024-09-21T03:25:01.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.028+0000 7f48044b4640 1 -- 172.21.15.105:0/4162769091 shutdown_connections 2024-09-21T03:25:01.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.028+0000 7f48044b4640 1 --2- 172.21.15.105:0/4162769091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47fc0d0e50 0x7f47fc0d1260 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:01.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.028+0000 7f48044b4640 1 --2- 172.21.15.105:0/4162769091 >> v2:172.21.15.162:3300/0 conn(0x7f47fc06e0a0 0x7f47fc0b97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:01.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.028+0000 7f48044b4640 1 -- 172.21.15.105:0/4162769091 >> 172.21.15.105:0/4162769091 conn(0x7f47fc09d840 msgr2=0x7f47fc08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:01.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.028+0000 7f48044b4640 1 -- 172.21.15.105:0/4162769091 shutdown_connections 2024-09-21T03:25:01.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.028+0000 7f48044b4640 1 -- 172.21.15.105:0/4162769091 wait complete. 2024-09-21T03:25:01.032 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.030+0000 7f48044b4640 1 Processor -- start 2024-09-21T03:25:01.032 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.030+0000 7f48044b4640 1 -- start start 2024-09-21T03:25:01.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.031+0000 7f48044b4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47fc06e0a0 0x7f47fc0cc560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:01.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.031+0000 7f48044b4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47fc06f6e0 0x7f47fc154a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:01.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.031+0000 7f48044b4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47fc0d0e50 0x7f47fc1f5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:01.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.031+0000 7f48044b4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f47fc0cfc90 con 0x7f47fc06e0a0 2024-09-21T03:25:01.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.031+0000 7f48044b4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f47fc0cfb10 con 0x7f47fc06f6e0 2024-09-21T03:25:01.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.031+0000 7f48044b4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f47fc0cfe10 con 0x7f47fc0d0e50 2024-09-21T03:25:01.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.031+0000 7f4802250640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47fc06e0a0 0x7f47fc0cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:01.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.031+0000 7f4802250640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47fc06e0a0 0x7f47fc0cc560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:53502/0 (socket says 172.21.15.105:53502) 2024-09-21T03:25:01.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.031+0000 7f4802250640 1 -- 172.21.15.105:0/2017224456 learned_addr learned my addr 172.21.15.105:0/2017224456 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:01.036 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.031+0000 7f4802a51640 1 --2- 172.21.15.105:0/2017224456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47fc0d0e50 0x7f47fc1f5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:01.036 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.031+0000 7f4801a4f640 1 --2- 172.21.15.105:0/2017224456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47fc06f6e0 0x7f47fc154a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:01.036 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.031+0000 7f4802250640 1 -- 172.21.15.105:0/2017224456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47fc0d0e50 msgr2=0x7f47fc1f5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:01.036 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.031+0000 7f4802250640 1 --2- 172.21.15.105:0/2017224456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47fc0d0e50 0x7f47fc1f5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:01.036 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.031+0000 7f4802250640 1 -- 172.21.15.105:0/2017224456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47fc06f6e0 msgr2=0x7f47fc154a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:01.036 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.031+0000 7f4802250640 1 --2- 172.21.15.105:0/2017224456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47fc06f6e0 0x7f47fc154a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:01.036 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.031+0000 7f4802250640 1 -- 172.21.15.105:0/2017224456 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47fc0cb7a0 con 0x7f47fc06e0a0 2024-09-21T03:25:01.036 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.031+0000 7f4801a4f640 1 --2- 172.21.15.105:0/2017224456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47fc06f6e0 0x7f47fc154a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:25:01.036 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.032+0000 7f4802250640 1 --2- 172.21.15.105:0/2017224456 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47fc06e0a0 0x7f47fc0cc560 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f47ec00d700 tx=0x7f47ec00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:01.036 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.032+0000 7f47faffd640 1 -- 172.21.15.105:0/2017224456 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ec017070 con 0x7f47fc06e0a0 2024-09-21T03:25:01.036 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.032+0000 7f47faffd640 1 -- 172.21.15.105:0/2017224456 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47ec009d20 con 0x7f47fc06e0a0 2024-09-21T03:25:01.036 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.032+0000 7f48044b4640 1 -- 172.21.15.105:0/2017224456 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47fc0cba80 con 0x7f47fc06e0a0 2024-09-21T03:25:01.036 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.032+0000 7f47faffd640 1 -- 172.21.15.105:0/2017224456 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ec0106c0 con 0x7f47fc06e0a0 2024-09-21T03:25:01.036 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.032+0000 7f48044b4640 1 -- 172.21.15.105:0/2017224456 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47fc0cc040 con 0x7f47fc06e0a0 2024-09-21T03:25:01.037 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.033+0000 7f48044b4640 1 -- 172.21.15.105:0/2017224456 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47fc0d0770 con 0x7f47fc06e0a0 2024-09-21T03:25:01.037 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.034+0000 7f47faffd640 1 -- 172.21.15.105:0/2017224456 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f47ec01a070 con 0x7f47fc06e0a0 2024-09-21T03:25:01.037 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.034+0000 7f47faffd640 1 --2- 172.21.15.105:0/2017224456 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f47e8078bc0 0x7f47e807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:01.037 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.034+0000 7f47faffd640 1 -- 172.21.15.105:0/2017224456 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 4943+0+0 (secure 0 0 0) 0x7f47ec09afb0 con 0x7f47fc06e0a0 2024-09-21T03:25:01.037 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.035+0000 7f4801a4f640 1 --2- 172.21.15.105:0/2017224456 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f47e8078bc0 0x7f47e807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:01.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.035+0000 7f4801a4f640 1 --2- 172.21.15.105:0/2017224456 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f47e8078bc0 0x7f47e807b0d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f47fc0b87c0 tx=0x7f47f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:01.040 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.038+0000 7f47faffd640 1 -- 172.21.15.105:0/2017224456 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f47ec0637d0 con 0x7f47fc06e0a0 2024-09-21T03:25:01.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.214+0000 7f48044b4640 1 -- 172.21.15.105:0/2017224456 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f47fc0ccaa0 con 0x7f47fc06e0a0 2024-09-21T03:25:01.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.214+0000 7f47faffd640 1 -- 172.21.15.105:0/2017224456 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v50) ==== 59+0+2294 (secure 0 0 0) 0x7f47ec0630d0 con 0x7f47fc06e0a0 2024-09-21T03:25:01.217 INFO:teuthology.orchestra.run.smithi105.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T03:25:01.217 INFO:teuthology.orchestra.run.smithi105.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T03:25:01.217 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced client_mount_timeout 30 2024-09-21T03:25:01.218 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced debug_client 20/20 2024-09-21T03:25:01.218 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced debug_mgr 20/20 2024-09-21T03:25:01.218 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced debug_ms 1/1 2024-09-21T03:25:01.218 INFO:teuthology.orchestra.run.smithi105.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T03:25:01.218 INFO:teuthology.orchestra.run.smithi105.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T03:25:01.218 INFO:teuthology.orchestra.run.smithi105.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 7291.545169 2024-09-21T03:25:01.218 INFO:teuthology.orchestra.run.smithi105.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5080.142035 2024-09-21T03:25:01.218 INFO:teuthology.orchestra.run.smithi105.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5120.988640 2024-09-21T03:25:01.218 INFO:teuthology.orchestra.run.smithi105.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4938.196268 2024-09-21T03:25:01.218 INFO:teuthology.orchestra.run.smithi105.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4906.316728 2024-09-21T03:25:01.218 INFO:teuthology.orchestra.run.smithi105.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4701.273858 2024-09-21T03:25:01.218 INFO:teuthology.orchestra.run.smithi105.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4947.710044 2024-09-21T03:25:01.219 INFO:teuthology.orchestra.run.smithi105.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5174.949063 2024-09-21T03:25:01.219 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced debug_mds 20/20 2024-09-21T03:25:01.219 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T03:25:01.219 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced debug_ms 2/2 2024-09-21T03:25:01.219 INFO:teuthology.orchestra.run.smithi105.stdout:mds dev mds_debug_frag true 2024-09-21T03:25:01.219 INFO:teuthology.orchestra.run.smithi105.stdout:mds dev mds_debug_scatterstat true 2024-09-21T03:25:01.219 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T03:25:01.219 INFO:teuthology.orchestra.run.smithi105.stdout:mds dev mds_verify_scatter true 2024-09-21T03:25:01.219 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T03:25:01.219 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T03:25:01.219 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T03:25:01.219 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced client_mount_timeout 600 2024-09-21T03:25:01.219 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced debug_client 20/20 2024-09-21T03:25:01.219 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced debug_ms 1/1 2024-09-21T03:25:01.220 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T03:25:01.220 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T03:25:01.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.217+0000 7f48044b4640 1 -- 172.21.15.105:0/2017224456 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f47e8078bc0 msgr2=0x7f47e807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:01.220 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.217+0000 7f48044b4640 1 --2- 172.21.15.105:0/2017224456 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f47e8078bc0 0x7f47e807b0d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f47fc0b87c0 tx=0x7f47f0009040 comp rx=0 tx=0).stop 2024-09-21T03:25:01.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.217+0000 7f48044b4640 1 -- 172.21.15.105:0/2017224456 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47fc06e0a0 msgr2=0x7f47fc0cc560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:01.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.217+0000 7f48044b4640 1 --2- 172.21.15.105:0/2017224456 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47fc06e0a0 0x7f47fc0cc560 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f47ec00d700 tx=0x7f47ec00dbc0 comp rx=0 tx=0).stop 2024-09-21T03:25:01.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.217+0000 7f48044b4640 1 -- 172.21.15.105:0/2017224456 shutdown_connections 2024-09-21T03:25:01.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.217+0000 7f48044b4640 1 --2- 172.21.15.105:0/2017224456 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f47e8078bc0 0x7f47e807b0d0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:01.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.217+0000 7f48044b4640 1 --2- 172.21.15.105:0/2017224456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47fc0d0e50 0x7f47fc1f5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:01.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.217+0000 7f48044b4640 1 --2- 172.21.15.105:0/2017224456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47fc06f6e0 0x7f47fc154a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:01.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.217+0000 7f48044b4640 1 --2- 172.21.15.105:0/2017224456 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47fc06e0a0 0x7f47fc0cc560 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:01.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.217+0000 7f48044b4640 1 -- 172.21.15.105:0/2017224456 >> 172.21.15.105:0/2017224456 conn(0x7f47fc09d840 msgr2=0x7f47fc161cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:01.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.217+0000 7f48044b4640 1 -- 172.21.15.105:0/2017224456 shutdown_connections 2024-09-21T03:25:01.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.217+0000 7f48044b4640 1 -- 172.21.15.105:0/2017224456 wait complete. 2024-09-21T03:25:01.231 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T03:25:01.347 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.344+0000 7f6dd3ebe640 1 -- 172.21.15.105:0/881399802 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6db8003a30 msgr2=0x7f6db8003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:01.347 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.344+0000 7f6dd3ebe640 1 --2- 172.21.15.105:0/881399802 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6db8003a30 0x7f6db8003ea0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f6dc80016c0 tx=0x7f6db8005830 comp rx=0 tx=0).stop 2024-09-21T03:25:01.347 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.344+0000 7f6dd245b640 1 -- 172.21.15.105:0/881399802 reap_dead start 2024-09-21T03:25:01.347 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.344+0000 7f6dd3ebe640 1 -- 172.21.15.105:0/881399802 shutdown_connections 2024-09-21T03:25:01.347 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.344+0000 7f6dd3ebe640 1 -- 172.21.15.105:0/881399802 >> 172.21.15.105:0/881399802 conn(0x7f6dcc09d8f0 msgr2=0x7f6dcc0d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:01.347 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.344+0000 7f6dd3ebe640 1 -- 172.21.15.105:0/881399802 shutdown_connections 2024-09-21T03:25:01.347 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.344+0000 7f6dd3ebe640 1 -- 172.21.15.105:0/881399802 wait complete. 2024-09-21T03:25:01.348 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.345+0000 7f6dd3ebe640 1 Processor -- start 2024-09-21T03:25:01.348 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.346+0000 7f6dd3ebe640 1 -- start start 2024-09-21T03:25:01.351 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.347+0000 7f6dd3ebe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6db8003a30 0x7f6dcc0b6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:01.351 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.347+0000 7f6dd3ebe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6dcc15ca60 0x7f6dcc153a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:01.351 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.347+0000 7f6dd3ebe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6dcc160790 0x7f6dcc160ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:01.351 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.347+0000 7f6dd3ebe640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6dcc0cfdb0 con 0x7f6dcc15ca60 2024-09-21T03:25:01.351 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.347+0000 7f6dd3ebe640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6dcc0cfc30 con 0x7f6db8003a30 2024-09-21T03:25:01.351 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.347+0000 7f6dd3ebe640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6dcc0cff30 con 0x7f6dcc160790 2024-09-21T03:25:01.351 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.347+0000 7f6dd1459640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6dcc15ca60 0x7f6dcc153a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:01.351 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.347+0000 7f6dd1459640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6dcc15ca60 0x7f6dcc153a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:53520/0 (socket says 172.21.15.105:53520) 2024-09-21T03:25:01.351 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.347+0000 7f6dd1459640 1 -- 172.21.15.105:0/3997836846 learned_addr learned my addr 172.21.15.105:0/3997836846 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:01.351 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.347+0000 7f6dd1c5a640 1 --2- 172.21.15.105:0/3997836846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6db8003a30 0x7f6dcc0b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:01.352 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.347+0000 7f6dd245b640 1 --2- 172.21.15.105:0/3997836846 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6dcc160790 0x7f6dcc160ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:01.352 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.347+0000 7f6dd1459640 1 -- 172.21.15.105:0/3997836846 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6dcc160790 msgr2=0x7f6dcc160ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:01.352 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.347+0000 7f6dd1459640 1 --2- 172.21.15.105:0/3997836846 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6dcc160790 0x7f6dcc160ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:01.352 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.347+0000 7f6dd1459640 1 -- 172.21.15.105:0/3997836846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6db8003a30 msgr2=0x7f6dcc0b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:01.352 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.347+0000 7f6dd1459640 1 --2- 172.21.15.105:0/3997836846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6db8003a30 0x7f6dcc0b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:01.352 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.347+0000 7f6dd1459640 1 -- 172.21.15.105:0/3997836846 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dcc153f70 con 0x7f6dcc15ca60 2024-09-21T03:25:01.352 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.347+0000 7f6dd245b640 1 --2- 172.21.15.105:0/3997836846 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6dcc160790 0x7f6dcc160ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:25:01.352 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.347+0000 7f6dd1c5a640 1 --2- 172.21.15.105:0/3997836846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6db8003a30 0x7f6dcc0b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:25:01.352 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.347+0000 7f6dd1459640 1 --2- 172.21.15.105:0/3997836846 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6dcc15ca60 0x7f6dcc153a30 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc001400 tx=0x7f6dbc00ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:01.352 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.347+0000 7f6dc27fc640 1 -- 172.21.15.105:0/3997836846 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc015070 con 0x7f6dcc15ca60 2024-09-21T03:25:01.352 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.347+0000 7f6dc27fc640 1 -- 172.21.15.105:0/3997836846 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6dbc0109c0 con 0x7f6dcc15ca60 2024-09-21T03:25:01.352 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.347+0000 7f6dd3ebe640 1 -- 172.21.15.105:0/3997836846 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dcc1610e0 con 0x7f6dcc15ca60 2024-09-21T03:25:01.352 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.348+0000 7f6dc27fc640 1 -- 172.21.15.105:0/3997836846 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc010e10 con 0x7f6dcc15ca60 2024-09-21T03:25:01.352 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.348+0000 7f6dd3ebe640 1 -- 172.21.15.105:0/3997836846 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dcc15f530 con 0x7f6dcc15ca60 2024-09-21T03:25:01.353 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.349+0000 7f6dd3ebe640 1 -- 172.21.15.105:0/3997836846 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dcc0cf310 con 0x7f6dcc15ca60 2024-09-21T03:25:01.353 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.349+0000 7f6dc27fc640 1 -- 172.21.15.105:0/3997836846 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6dbc018070 con 0x7f6dcc15ca60 2024-09-21T03:25:01.353 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.350+0000 7f6dc27fc640 1 --2- 172.21.15.105:0/3997836846 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6db0078bf0 0x7f6db007b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:01.354 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.350+0000 7f6dc27fc640 1 -- 172.21.15.105:0/3997836846 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 4943+0+0 (secure 0 0 0) 0x7f6dbc09aeb0 con 0x7f6dcc15ca60 2024-09-21T03:25:01.354 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.350+0000 7f6dd1c5a640 1 --2- 172.21.15.105:0/3997836846 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6db0078bf0 0x7f6db007b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:01.354 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.350+0000 7f6dd1c5a640 1 --2- 172.21.15.105:0/3997836846 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6db0078bf0 0x7f6db007b100 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8032000 tx=0x7f6dc8001190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:01.357 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.354+0000 7f6dc27fc640 1 -- 172.21.15.105:0/3997836846 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6dcc1610e0 con 0x7f6dcc15ca60 2024-09-21T03:25:01.536 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.534+0000 7f6dd3ebe640 1 -- 172.21.15.105:0/3997836846 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f6dcc0b6eb0 con 0x7f6dcc15ca60 2024-09-21T03:25:01.540 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.538+0000 7f6dc27fc640 1 -- 172.21.15.105:0/3997836846 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v51)=0 v51) ==== 122+0+0 (secure 0 0 0) 0x7f6dcc153f70 con 0x7f6dcc15ca60 2024-09-21T03:25:01.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.540+0000 7f6dd3ebe640 1 -- 172.21.15.105:0/3997836846 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6db0078bf0 msgr2=0x7f6db007b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:01.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.540+0000 7f6dd3ebe640 1 --2- 172.21.15.105:0/3997836846 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6db0078bf0 0x7f6db007b100 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8032000 tx=0x7f6dc8001190 comp rx=0 tx=0).stop 2024-09-21T03:25:01.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.540+0000 7f6dd3ebe640 1 -- 172.21.15.105:0/3997836846 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6dcc15ca60 msgr2=0x7f6dcc153a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:01.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.540+0000 7f6dd3ebe640 1 --2- 172.21.15.105:0/3997836846 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6dcc15ca60 0x7f6dcc153a30 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc001400 tx=0x7f6dbc00ea20 comp rx=0 tx=0).stop 2024-09-21T03:25:01.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.540+0000 7f6dd3ebe640 1 -- 172.21.15.105:0/3997836846 shutdown_connections 2024-09-21T03:25:01.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.540+0000 7f6dd3ebe640 1 --2- 172.21.15.105:0/3997836846 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6db0078bf0 0x7f6db007b100 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:01.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.540+0000 7f6dd3ebe640 1 --2- 172.21.15.105:0/3997836846 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6dcc160790 0x7f6dcc160ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:01.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.540+0000 7f6dd3ebe640 1 --2- 172.21.15.105:0/3997836846 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6dcc15ca60 0x7f6dcc153a30 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:01.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.540+0000 7f6dd3ebe640 1 --2- 172.21.15.105:0/3997836846 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6db8003a30 0x7f6dcc0b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:01.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.540+0000 7f6dd3ebe640 1 -- 172.21.15.105:0/3997836846 >> 172.21.15.105:0/3997836846 conn(0x7f6dcc09d8f0 msgr2=0x7f6dcc0b82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:01.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.540+0000 7f6dd3ebe640 1 -- 172.21.15.105:0/3997836846 shutdown_connections 2024-09-21T03:25:01.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.540+0000 7f6dd3ebe640 1 -- 172.21.15.105:0/3997836846 wait complete. 2024-09-21T03:25:01.554 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T03:25:01.554 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T03:25:01.588 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T03:25:01.636 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T03:25:01.637 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:25:01.637 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:25:01.652 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T03:25:01.652 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:25:01.652 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:25:01.670 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=452 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T03:25:01.670 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:25:01.670 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:25:01.708 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T03:25:01.708 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:25:01.708 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:25:01.729 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=452 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T03:25:01.729 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T03:25:01.729 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:25:01.859 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.856+0000 7fdd58494640 1 -- 172.21.15.105:0/1349580720 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd5006f4b0 msgr2=0x7fdd500d3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:01.859 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.856+0000 7fdd58494640 1 --2- 172.21.15.105:0/1349580720 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd5006f4b0 0x7fdd500d3330 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fdd500ba570 tx=0x7fdd4002a4f0 comp rx=0 tx=0).stop 2024-09-21T03:25:01.859 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.856+0000 7fdd58494640 1 -- 172.21.15.105:0/1349580720 shutdown_connections 2024-09-21T03:25:01.860 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.856+0000 7fdd58494640 1 --2- 172.21.15.105:0/1349580720 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdd500d3870 0x7fdd500ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:01.860 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.856+0000 7fdd58494640 1 --2- 172.21.15.105:0/1349580720 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd5006f4b0 0x7fdd500d3330 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:01.860 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.856+0000 7fdd58494640 1 --2- 172.21.15.105:0/1349580720 >> v2:172.21.15.162:3300/0 conn(0x7fdd5006e170 0x7fdd500b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:01.860 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.856+0000 7fdd58494640 1 -- 172.21.15.105:0/1349580720 >> 172.21.15.105:0/1349580720 conn(0x7fdd5008bfc0 msgr2=0x7fdd5009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:01.860 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.856+0000 7fdd58494640 1 -- 172.21.15.105:0/1349580720 shutdown_connections 2024-09-21T03:25:01.860 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.856+0000 7fdd58494640 1 -- 172.21.15.105:0/1349580720 wait complete. 2024-09-21T03:25:01.860 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.858+0000 7fdd58494640 1 Processor -- start 2024-09-21T03:25:01.860 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.858+0000 7fdd58494640 1 -- start start 2024-09-21T03:25:01.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.859+0000 7fdd58494640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd5006f4b0 0x7fdd500ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:01.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.859+0000 7fdd58494640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd500d3870 0x7fdd500cdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:01.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.859+0000 7fdd58494640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdd500ce4e0 0x7fdd500a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:01.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.859+0000 7fdd58494640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdd500cf490 con 0x7fdd5006f4b0 2024-09-21T03:25:01.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.859+0000 7fdd58494640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdd500cf310 con 0x7fdd500d3870 2024-09-21T03:25:01.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.859+0000 7fdd58494640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdd500d0ce0 con 0x7fdd500ce4e0 2024-09-21T03:25:01.864 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.859+0000 7fdd56230640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd5006f4b0 0x7fdd500ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:01.864 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.859+0000 7fdd56230640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd5006f4b0 0x7fdd500ca6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:44496/0 (socket says 172.21.15.105:44496) 2024-09-21T03:25:01.864 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.859+0000 7fdd56230640 1 -- 172.21.15.105:0/1067275667 learned_addr learned my addr 172.21.15.105:0/1067275667 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:01.864 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.860+0000 7fdd55a2f640 1 --2- 172.21.15.105:0/1067275667 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd500d3870 0x7fdd500cdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:01.864 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.860+0000 7fdd56a31640 1 --2- 172.21.15.105:0/1067275667 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdd500ce4e0 0x7fdd500a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:01.864 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.860+0000 7fdd56230640 1 -- 172.21.15.105:0/1067275667 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdd500ce4e0 msgr2=0x7fdd500a0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:01.864 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.860+0000 7fdd56230640 1 --2- 172.21.15.105:0/1067275667 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdd500ce4e0 0x7fdd500a0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:01.864 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.860+0000 7fdd56230640 1 -- 172.21.15.105:0/1067275667 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd500d3870 msgr2=0x7fdd500cdfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:01.864 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.860+0000 7fdd56230640 1 --2- 172.21.15.105:0/1067275667 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd500d3870 0x7fdd500cdfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:01.864 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.860+0000 7fdd56230640 1 -- 172.21.15.105:0/1067275667 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd5009f350 con 0x7fdd5006f4b0 2024-09-21T03:25:01.864 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.860+0000 7fdd56230640 1 --2- 172.21.15.105:0/1067275667 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd5006f4b0 0x7fdd500ca6a0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c00b440 tx=0x7fdd4c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:01.864 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.860+0000 7fdd46ffd640 1 -- 172.21.15.105:0/1067275667 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c015020 con 0x7fdd5006f4b0 2024-09-21T03:25:01.864 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.860+0000 7fdd46ffd640 1 -- 172.21.15.105:0/1067275667 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd4c011980 con 0x7fdd5006f4b0 2024-09-21T03:25:01.864 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.860+0000 7fdd58494640 1 -- 172.21.15.105:0/1067275667 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd500c9bc0 con 0x7fdd5006f4b0 2024-09-21T03:25:01.865 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.860+0000 7fdd46ffd640 1 -- 172.21.15.105:0/1067275667 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c011dd0 con 0x7fdd5006f4b0 2024-09-21T03:25:01.865 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.860+0000 7fdd58494640 1 -- 172.21.15.105:0/1067275667 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd500ca180 con 0x7fdd5006f4b0 2024-09-21T03:25:01.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.861+0000 7fdd58494640 1 -- 172.21.15.105:0/1067275667 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd500c99b0 con 0x7fdd5006f4b0 2024-09-21T03:25:01.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.862+0000 7fdd46ffd640 1 -- 172.21.15.105:0/1067275667 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdd4c018020 con 0x7fdd5006f4b0 2024-09-21T03:25:01.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.862+0000 7fdd46ffd640 1 --2- 172.21.15.105:0/1067275667 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdd34078b90 0x7fdd3407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:01.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.862+0000 7fdd46ffd640 1 -- 172.21.15.105:0/1067275667 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 4943+0+0 (secure 0 0 0) 0x7fdd4c09aa80 con 0x7fdd5006f4b0 2024-09-21T03:25:01.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.863+0000 7fdd55a2f640 1 --2- 172.21.15.105:0/1067275667 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdd34078b90 0x7fdd3407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:01.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.863+0000 7fdd55a2f640 1 --2- 172.21.15.105:0/1067275667 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdd34078b90 0x7fdd3407b0a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fdd40033000 tx=0x7fdd40004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:01.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:01.867+0000 7fdd46ffd640 1 -- 172.21.15.105:0/1067275667 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fdd4c01f020 con 0x7fdd5006f4b0 2024-09-21T03:25:02.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.080+0000 7fdd58494640 1 -- 172.21.15.105:0/1067275667 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdd5006e170 con 0x7fdd5006f4b0 2024-09-21T03:25:02.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.081+0000 7fdd46ffd640 1 -- 172.21.15.105:0/1067275667 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+3923 (secure 0 0 0) 0x7fdd4c00d040 con 0x7fdd5006f4b0 2024-09-21T03:25:02.084 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:02.085 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":60,"btime":"2024-09-21T03:24:55:872891+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5801,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2175278360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2175278360},{"type":"v1","addr":"172.21.15.162:6836","nonce":2175278360}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6292,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2152611733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2152611733},{"type":"v1","addr":"172.21.15.105:6835","nonce":2152611733}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":6307,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1722830153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1722830153},{"type":"v1","addr":"172.21.15.162:6837","nonce":1722830153}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54},{"gid":7083,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/3967099400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3967099400},{"type":"v1","addr":"172.21.15.105:6834","nonce":3967099400}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60}],"filesystems":[]} 2024-09-21T03:25:02.085 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 60 2024-09-21T03:25:02.086 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.083+0000 7fdd58494640 1 -- 172.21.15.105:0/1067275667 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdd34078b90 msgr2=0x7fdd3407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:02.086 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.083+0000 7fdd58494640 1 --2- 172.21.15.105:0/1067275667 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdd34078b90 0x7fdd3407b0a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fdd40033000 tx=0x7fdd40004730 comp rx=0 tx=0).stop 2024-09-21T03:25:02.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.083+0000 7fdd58494640 1 -- 172.21.15.105:0/1067275667 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd5006f4b0 msgr2=0x7fdd500ca6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:02.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.083+0000 7fdd58494640 1 --2- 172.21.15.105:0/1067275667 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd5006f4b0 0x7fdd500ca6a0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c00b440 tx=0x7fdd4c00b900 comp rx=0 tx=0).stop 2024-09-21T03:25:02.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.083+0000 7fdd58494640 1 -- 172.21.15.105:0/1067275667 shutdown_connections 2024-09-21T03:25:02.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.083+0000 7fdd58494640 1 --2- 172.21.15.105:0/1067275667 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdd34078b90 0x7fdd3407b0a0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:02.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.083+0000 7fdd58494640 1 --2- 172.21.15.105:0/1067275667 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdd500ce4e0 0x7fdd500a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:02.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.083+0000 7fdd58494640 1 --2- 172.21.15.105:0/1067275667 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd500d3870 0x7fdd500cdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:02.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.083+0000 7fdd58494640 1 --2- 172.21.15.105:0/1067275667 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd5006f4b0 0x7fdd500ca6a0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:02.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.083+0000 7fdd58494640 1 -- 172.21.15.105:0/1067275667 >> 172.21.15.105:0/1067275667 conn(0x7fdd5008bfc0 msgr2=0x7fdd50068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:02.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.083+0000 7fdd58494640 1 -- 172.21.15.105:0/1067275667 shutdown_connections 2024-09-21T03:25:02.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.083+0000 7fdd58494640 1 -- 172.21.15.105:0/1067275667 wait complete. 2024-09-21T03:25:02.099 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T03:25:02.099 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-21T03:25:02.099 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T03:25:02.099 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:25:02.100 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T03:25:02.100 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T03:25:02.100 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T03:25:02.100 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:25:02.100 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T03:25:02.100 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T03:25:02.101 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T03:25:02.101 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:25:02.101 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T03:25:02.101 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T03:25:02.101 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T03:25:02.102 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:25:02.109 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T03:25:02.109 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T03:25:02.112 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T03:25:02.112 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T03:25:02.113 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T03:25:02.113 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T03:25:02.114 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T03:25:02.115 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T03:25:02.153 INFO:tasks.ceph.mds.a:Started 2024-09-21T03:25:02.154 DEBUG:teuthology.parallel:result is None 2024-09-21T03:25:02.155 INFO:tasks.ceph.mds.c:Started 2024-09-21T03:25:02.155 DEBUG:teuthology.parallel:result is None 2024-09-21T03:25:02.156 INFO:tasks.ceph.mds.b:Started 2024-09-21T03:25:02.156 DEBUG:teuthology.parallel:result is None 2024-09-21T03:25:02.157 INFO:tasks.ceph.mds.d:Started 2024-09-21T03:25:02.157 DEBUG:teuthology.parallel:result is None 2024-09-21T03:25:02.157 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T03:25:02.240 INFO:tasks.ceph.mds.c.smithi105.stdout:starting mds.c at 2024-09-21T03:25:02.240 INFO:tasks.ceph.mds.a.smithi105.stdout:starting mds.a at 2024-09-21T03:25:02.249 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-09-21T03:25:02.250 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-09-21T03:25:02.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.275+0000 7f018dc40640 1 -- 172.21.15.105:0/3188256674 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f01880d1490 msgr2=0x7f01881674d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:02.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.275+0000 7f018dc40640 1 --2- 172.21.15.105:0/3188256674 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f01880d1490 0x7f01881674d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0180009be0 tx=0x7f018002a920 comp rx=0 tx=0).stop 2024-09-21T03:25:02.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.275+0000 7f018dc40640 1 -- 172.21.15.105:0/3188256674 shutdown_connections 2024-09-21T03:25:02.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.275+0000 7f018dc40640 1 --2- 172.21.15.105:0/3188256674 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f01880d1490 0x7f01881674d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:02.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.275+0000 7f018dc40640 1 -- 172.21.15.105:0/3188256674 >> 172.21.15.105:0/3188256674 conn(0x7f0188072ae0 msgr2=0x7f0188072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:02.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.275+0000 7f018dc40640 1 -- 172.21.15.105:0/3188256674 shutdown_connections 2024-09-21T03:25:02.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.275+0000 7f018dc40640 1 -- 172.21.15.105:0/3188256674 wait complete. 2024-09-21T03:25:02.283 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.277+0000 7f018dc40640 1 Processor -- start 2024-09-21T03:25:02.283 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.277+0000 7f018dc40640 1 -- start start 2024-09-21T03:25:02.283 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.279+0000 7f018dc40640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f01880b51c0 0x7f018815aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:02.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.279+0000 7f018dc40640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01880ccbd0 0x7f018815aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:02.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.279+0000 7f018dc40640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01880d1490 0x7f0188153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:02.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.279+0000 7f018dc40640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0188167da0 con 0x7f01880ccbd0 2024-09-21T03:25:02.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.279+0000 7f018dc40640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0188167c20 con 0x7f01880d1490 2024-09-21T03:25:02.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.279+0000 7f018dc40640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0188167f20 con 0x7f01880b51c0 2024-09-21T03:25:02.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.279+0000 7f0186ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01880ccbd0 0x7f018815aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:02.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.279+0000 7f01877fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f01880b51c0 0x7f018815aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:02.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.279+0000 7f01877fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f01880b51c0 0x7f018815aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.105:38422/0 (socket says 172.21.15.105:38422) 2024-09-21T03:25:02.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.279+0000 7f0187fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01880d1490 0x7f0188153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:02.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.279+0000 7f01877fe640 1 -- 172.21.15.105:0/2429703910 learned_addr learned my addr 172.21.15.105:0/2429703910 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:02.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.279+0000 7f01877fe640 1 -- 172.21.15.105:0/2429703910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01880d1490 msgr2=0x7f0188153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:02.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.279+0000 7f01877fe640 1 --2- 172.21.15.105:0/2429703910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01880d1490 0x7f0188153780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:02.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.279+0000 7f01877fe640 1 -- 172.21.15.105:0/2429703910 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01880ccbd0 msgr2=0x7f018815aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:02.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.279+0000 7f01877fe640 1 --2- 172.21.15.105:0/2429703910 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01880ccbd0 0x7f018815aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:02.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.279+0000 7f01877fe640 1 -- 172.21.15.105:0/2429703910 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0188150790 con 0x7f01880b51c0 2024-09-21T03:25:02.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.279+0000 7f0187fff640 1 --2- 172.21.15.105:0/2429703910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01880d1490 0x7f0188153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:25:02.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.279+0000 7f0186ffd640 1 --2- 172.21.15.105:0/2429703910 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01880ccbd0 0x7f018815aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:25:02.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.279+0000 7f01877fe640 1 --2- 172.21.15.105:0/2429703910 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f01880b51c0 0x7f018815aab0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f017800c460 tx=0x7f017800c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:02.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.279+0000 7f016ffff640 1 -- 172.21.15.105:0/2429703910 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01780052d0 con 0x7f01880b51c0 2024-09-21T03:25:02.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.280+0000 7f016ffff640 1 -- 172.21.15.105:0/2429703910 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0178005490 con 0x7f01880b51c0 2024-09-21T03:25:02.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.280+0000 7f016ffff640 1 -- 172.21.15.105:0/2429703910 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0178012870 con 0x7f01880b51c0 2024-09-21T03:25:02.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.280+0000 7f018dc40640 1 -- 172.21.15.105:0/2429703910 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f018815b7c0 con 0x7f01880b51c0 2024-09-21T03:25:02.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.280+0000 7f018dc40640 1 -- 172.21.15.105:0/2429703910 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0188157600 con 0x7f01880b51c0 2024-09-21T03:25:02.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.281+0000 7f018dc40640 1 -- 172.21.15.105:0/2429703910 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0188150960 con 0x7f01880b51c0 2024-09-21T03:25:02.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.281+0000 7f016ffff640 1 -- 172.21.15.105:0/2429703910 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0178012a10 con 0x7f01880b51c0 2024-09-21T03:25:02.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.282+0000 7f016ffff640 1 --2- 172.21.15.105:0/2429703910 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0174078b90 0x7f017407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:02.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.282+0000 7f016ffff640 1 -- 172.21.15.105:0/2429703910 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(96..96 src has 1..96) ==== 4943+0+0 (secure 0 0 0) 0x7f017809a610 con 0x7f01880b51c0 2024-09-21T03:25:02.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.282+0000 7f0186ffd640 1 --2- 172.21.15.105:0/2429703910 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0174078b90 0x7f017407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:02.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.283+0000 7f0186ffd640 1 --2- 172.21.15.105:0/2429703910 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0174078b90 0x7f017407b0a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f01881f6ae0 tx=0x7f017c001760 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:02.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.286+0000 7f016ffff640 1 -- 172.21.15.105:0/2429703910 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f01780628c0 con 0x7f01880b51c0 2024-09-21T03:25:02.475 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.473+0000 7f018dc40640 1 -- 172.21.15.105:0/2429703910 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f01880cf8e0 con 0x7f01880b51c0 2024-09-21T03:25:02.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.915+0000 7f016ffff640 1 -- 172.21.15.105:0/2429703910 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v98) ==== 97+0+0 (secure 0 0 0) 0x7f01880cf8e0 con 0x7f01880b51c0 2024-09-21T03:25:02.918 INFO:teuthology.orchestra.run.smithi105.stderr: removed all blocklist entries 2024-09-21T03:25:02.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.918+0000 7f018dc40640 1 -- 172.21.15.105:0/2429703910 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0174078b90 msgr2=0x7f017407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:02.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.918+0000 7f018dc40640 1 --2- 172.21.15.105:0/2429703910 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0174078b90 0x7f017407b0a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f01881f6ae0 tx=0x7f017c001760 comp rx=0 tx=0).stop 2024-09-21T03:25:02.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.918+0000 7f018dc40640 1 -- 172.21.15.105:0/2429703910 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f01880b51c0 msgr2=0x7f018815aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:02.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.918+0000 7f018dc40640 1 --2- 172.21.15.105:0/2429703910 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f01880b51c0 0x7f018815aab0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f017800c460 tx=0x7f017800c920 comp rx=0 tx=0).stop 2024-09-21T03:25:02.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.918+0000 7f018dc40640 1 -- 172.21.15.105:0/2429703910 shutdown_connections 2024-09-21T03:25:02.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.918+0000 7f018dc40640 1 --2- 172.21.15.105:0/2429703910 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0174078b90 0x7f017407b0a0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:02.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.918+0000 7f018dc40640 1 --2- 172.21.15.105:0/2429703910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01880d1490 0x7f0188153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:02.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.918+0000 7f018dc40640 1 --2- 172.21.15.105:0/2429703910 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01880ccbd0 0x7f018815aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:02.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.918+0000 7f018dc40640 1 --2- 172.21.15.105:0/2429703910 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f01880b51c0 0x7f018815aab0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:02.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.918+0000 7f018dc40640 1 -- 172.21.15.105:0/2429703910 >> 172.21.15.105:0/2429703910 conn(0x7f0188072ae0 msgr2=0x7f01880cebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:02.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.918+0000 7f018dc40640 1 -- 172.21.15.105:0/2429703910 shutdown_connections 2024-09-21T03:25:02.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:02.918+0000 7f018dc40640 1 -- 172.21.15.105:0/2429703910 wait complete. 2024-09-21T03:25:02.933 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T03:25:03.047 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.044+0000 7f7963d57640 1 -- 172.21.15.105:0/1504023028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f795c0d2460 msgr2=0x7f795c15d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:03.047 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.044+0000 7f7963d57640 1 --2- 172.21.15.105:0/1504023028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f795c0d2460 0x7f795c15d130 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f795c074b10 tx=0x7f794c02a560 comp rx=0 tx=0).stop 2024-09-21T03:25:03.047 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.044+0000 7f7963d57640 1 -- 172.21.15.105:0/1504023028 shutdown_connections 2024-09-21T03:25:03.047 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.044+0000 7f7963d57640 1 --2- 172.21.15.105:0/1504023028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f795c0d2460 0x7f795c15d130 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:03.047 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.044+0000 7f7963d57640 1 --2- 172.21.15.105:0/1504023028 >> v2:172.21.15.162:3300/0 conn(0x7f795c1570e0 0x7f795c0d1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:03.047 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.044+0000 7f7963d57640 1 -- 172.21.15.105:0/1504023028 >> 172.21.15.105:0/1504023028 conn(0x7f795c06d550 msgr2=0x7f795c071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:03.048 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.044+0000 7f7963d57640 1 -- 172.21.15.105:0/1504023028 shutdown_connections 2024-09-21T03:25:03.048 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.044+0000 7f7963d57640 1 -- 172.21.15.105:0/1504023028 wait complete. 2024-09-21T03:25:03.048 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.046+0000 7f7963d57640 1 Processor -- start 2024-09-21T03:25:03.048 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.046+0000 7f7963d57640 1 -- start start 2024-09-21T03:25:03.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.047+0000 7f7963d57640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f795c0d2460 0x7f795c1521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:03.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.047+0000 7f7963d57640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f795c1570e0 0x7f795c153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:03.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.047+0000 7f7963d57640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f795c15d670 0x7f795c1f7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:03.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.047+0000 7f7963d57640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f795c0b7d20 con 0x7f795c1570e0 2024-09-21T03:25:03.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.047+0000 7f7963d57640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f795c0b7ba0 con 0x7f795c15d670 2024-09-21T03:25:03.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.047+0000 7f7963d57640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f795c0b7ea0 con 0x7f795c0d2460 2024-09-21T03:25:03.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.047+0000 7f79612f2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f795c1570e0 0x7f795c153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:03.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.047+0000 7f79612f2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f795c1570e0 0x7f795c153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:44572/0 (socket says 172.21.15.105:44572) 2024-09-21T03:25:03.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.047+0000 7f79612f2640 1 -- 172.21.15.105:0/2848872528 learned_addr learned my addr 172.21.15.105:0/2848872528 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:03.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.047+0000 7f79622f4640 1 --2- 172.21.15.105:0/2848872528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f795c15d670 0x7f795c1f7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:03.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.047+0000 7f7961af3640 1 --2- 172.21.15.105:0/2848872528 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f795c0d2460 0x7f795c1521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:03.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.047+0000 7f79612f2640 1 -- 172.21.15.105:0/2848872528 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f795c0d2460 msgr2=0x7f795c1521b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:03.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.048+0000 7f79612f2640 1 --2- 172.21.15.105:0/2848872528 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f795c0d2460 0x7f795c1521b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:03.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.048+0000 7f79612f2640 1 -- 172.21.15.105:0/2848872528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f795c15d670 msgr2=0x7f795c1f7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:03.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.048+0000 7f79612f2640 1 --2- 172.21.15.105:0/2848872528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f795c15d670 0x7f795c1f7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:03.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.048+0000 7f79612f2640 1 -- 172.21.15.105:0/2848872528 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f795c154850 con 0x7f795c1570e0 2024-09-21T03:25:03.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.048+0000 7f79622f4640 1 --2- 172.21.15.105:0/2848872528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f795c15d670 0x7f795c1f7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:25:03.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.048+0000 7f7961af3640 1 --2- 172.21.15.105:0/2848872528 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f795c0d2460 0x7f795c1521b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:25:03.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.048+0000 7f79612f2640 1 --2- 172.21.15.105:0/2848872528 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f795c1570e0 0x7f795c153dd0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f794c034040 tx=0x7f794c0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:03.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.048+0000 7f79527fc640 1 -- 172.21.15.105:0/2848872528 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f794c03e030 con 0x7f795c1570e0 2024-09-21T03:25:03.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.048+0000 7f79527fc640 1 -- 172.21.15.105:0/2848872528 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f794c0047a0 con 0x7f795c1570e0 2024-09-21T03:25:03.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.048+0000 7f79527fc640 1 -- 172.21.15.105:0/2848872528 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f794c035040 con 0x7f795c1570e0 2024-09-21T03:25:03.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.048+0000 7f7963d57640 1 -- 172.21.15.105:0/2848872528 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f795c154b30 con 0x7f795c1570e0 2024-09-21T03:25:03.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.048+0000 7f7963d57640 1 -- 172.21.15.105:0/2848872528 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f795c1550f0 con 0x7f795c1570e0 2024-09-21T03:25:03.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.049+0000 7f7963d57640 1 -- 172.21.15.105:0/2848872528 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f795c15cdc0 con 0x7f795c1570e0 2024-09-21T03:25:03.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.050+0000 7f79527fc640 1 -- 172.21.15.105:0/2848872528 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f794c041030 con 0x7f795c1570e0 2024-09-21T03:25:03.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.050+0000 7f79527fc640 1 --2- 172.21.15.105:0/2848872528 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7940078b90 0x7f794007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:03.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.050+0000 7f79527fc640 1 -- 172.21.15.105:0/2848872528 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 4857+0+0 (secure 0 0 0) 0x7f794c0bb280 con 0x7f795c1570e0 2024-09-21T03:25:03.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.050+0000 7f7961af3640 1 --2- 172.21.15.105:0/2848872528 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7940078b90 0x7f794007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:03.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.051+0000 7f7961af3640 1 --2- 172.21.15.105:0/2848872528 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7940078b90 0x7f794007b0a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f795800a870 tx=0x7f7958008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:03.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.055+0000 7f79527fc640 1 -- 172.21.15.105:0/2848872528 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f795c15cdc0 con 0x7f795c1570e0 2024-09-21T03:25:03.301 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.300+0000 7f7963d57640 1 -- 172.21.15.105:0/2848872528 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f795c15d130 con 0x7f795c1570e0 2024-09-21T03:25:03.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.300+0000 7f79527fc640 1 -- 172.21.15.105:0/2848872528 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) ==== 80+0+5304 (secure 0 0 0) 0x7f795c0d2870 con 0x7f795c1570e0 2024-09-21T03:25:03.302 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:03.302 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-21T03:25:03.302 INFO:teuthology.orchestra.run.smithi105.stdout: "auth_dump": [ 2024-09-21T03:25:03.302 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:25:03.302 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mds.a", 2024-09-21T03:25:03.303 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mtIIZDhAAJIXLpzTFBOFhnOwLzsdL6w==", 2024-09-21T03:25:03.303 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:25:03.303 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:25:03.303 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:25:03.303 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:25:03.303 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:25:03.303 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:03.303 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:25:03.303 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:25:03.303 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mds.b", 2024-09-21T03:25:03.303 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mGKANGxAAeAuUYMtLP7GXKfIELR7qMA==", 2024-09-21T03:25:03.303 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:25:03.304 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:25:03.304 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:25:03.304 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:25:03.304 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:25:03.304 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:03.304 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:25:03.304 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:25:03.304 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mds.c", 2024-09-21T03:25:03.304 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mwQzQFRAAElYtgnIdYzzkeg8AtiU+kA==", 2024-09-21T03:25:03.304 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:25:03.304 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:25:03.304 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:25:03.304 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:25:03.304 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:25:03.305 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:03.305 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:25:03.305 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:25:03.305 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mds.d", 2024-09-21T03:25:03.305 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mZkWyIhAAu4XWptFcbDrYjozzrgMcGQ==", 2024-09-21T03:25:03.305 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:25:03.305 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:25:03.305 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:25:03.305 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:25:03.305 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:25:03.305 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:03.305 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:25:03.305 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:25:03.306 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.0", 2024-09-21T03:25:03.306 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDMOu5mrSk2BRAAuEPjuEeUJEI3Sa2fiLaJyw==", 2024-09-21T03:25:03.306 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:25:03.306 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:25:03.306 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:25:03.306 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:25:03.306 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:03.306 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:25:03.306 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:25:03.306 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.1", 2024-09-21T03:25:03.306 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDPOu5mAT4UCBAAase7NV3ARBSu4QloaQdlzA==", 2024-09-21T03:25:03.306 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:25:03.306 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:25:03.306 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:25:03.307 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:25:03.307 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:03.307 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:25:03.307 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:25:03.307 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.2", 2024-09-21T03:25:03.307 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDSOu5ma4LRChAASottrmolMcagbspeyGVzBQ==", 2024-09-21T03:25:03.307 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:25:03.307 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:25:03.307 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:25:03.307 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:25:03.307 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:03.307 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:25:03.307 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:25:03.308 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.3", 2024-09-21T03:25:03.308 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDVOu5mD5RWHBAAKuNr4F3GA0EP566aQ07ZVw==", 2024-09-21T03:25:03.308 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:25:03.308 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:25:03.308 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:25:03.308 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:25:03.308 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:03.308 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:25:03.308 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:25:03.308 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.4", 2024-09-21T03:25:03.308 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDcOu5m++UBChAAqmgoPBQ/as4tc+UQPwaflg==", 2024-09-21T03:25:03.308 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:25:03.308 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:25:03.308 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:25:03.309 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:25:03.309 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:03.309 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:25:03.309 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:25:03.309 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.5", 2024-09-21T03:25:03.309 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDfOu5maYYZKRAA1ungglTU3TW1B/XNRjBuZQ==", 2024-09-21T03:25:03.309 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:25:03.309 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:25:03.309 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:25:03.309 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:25:03.309 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:03.309 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:25:03.309 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:25:03.310 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.6", 2024-09-21T03:25:03.310 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDjOu5mmwIqHBAAf6oNdLNkmM9yufP8XA2+og==", 2024-09-21T03:25:03.310 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:25:03.310 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:25:03.310 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:25:03.310 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:25:03.310 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:03.310 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:25:03.310 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:25:03.310 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.7", 2024-09-21T03:25:03.310 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDmOu5mtCciHhAAPTnZubJ+7mGXcXZykCWxHg==", 2024-09-21T03:25:03.310 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:25:03.310 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:25:03.311 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:25:03.311 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:25:03.311 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:03.311 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:25:03.311 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:25:03.311 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.0", 2024-09-21T03:25:03.311 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mughoJxAAhY0bzJmq+oNyzCdtafkC9w==", 2024-09-21T03:25:03.311 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:25:03.311 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:25:03.311 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow r", 2024-09-21T03:25:03.311 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-21T03:25:03.311 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:03.311 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:25:03.311 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:25:03.312 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.1", 2024-09-21T03:25:03.312 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5m4Vn2LhAAnEa/01ql5quuRCVHOVwB7w==", 2024-09-21T03:25:03.312 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:25:03.312 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:25:03.312 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow r", 2024-09-21T03:25:03.312 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow rw", 2024-09-21T03:25:03.312 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow rwx" 2024-09-21T03:25:03.312 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:03.312 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:25:03.312 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:25:03.312 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.2", 2024-09-21T03:25:03.312 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mKi0mKxAAoetnL61ujgtg2cvscdjCLQ==", 2024-09-21T03:25:03.312 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:25:03.313 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:25:03.313 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow r", 2024-09-21T03:25:03.313 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow rw", 2024-09-21T03:25:03.313 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow rwx" 2024-09-21T03:25:03.313 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:03.313 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:25:03.313 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:25:03.313 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.3", 2024-09-21T03:25:03.313 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mWZDAMhAAs4BuFHMSkJa6+piN/FeeXQ==", 2024-09-21T03:25:03.313 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:25:03.313 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:25:03.313 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow r", 2024-09-21T03:25:03.313 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow rw", 2024-09-21T03:25:03.313 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow rwx" 2024-09-21T03:25:03.314 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:03.314 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:25:03.314 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:25:03.314 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.admin", 2024-09-21T03:25:03.314 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDHOu5m4JRYLBAAgZ8nh5VIiWhuZ4+vrnmngw==", 2024-09-21T03:25:03.314 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:25:03.314 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow *", 2024-09-21T03:25:03.314 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:25:03.314 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:25:03.314 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:25:03.314 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:03.314 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:25:03.314 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:25:03.315 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mgr.x", 2024-09-21T03:25:03.315 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5m92lTChAAQ61muQmc6uBs7b5mq3Zt8g==", 2024-09-21T03:25:03.315 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:25:03.315 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow *", 2024-09-21T03:25:03.315 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile mgr", 2024-09-21T03:25:03.315 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:25:03.315 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:03.315 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:25:03.315 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:25:03.315 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mgr.y", 2024-09-21T03:25:03.315 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mh07bBRAAflFF00xr1ew4zttUi5TGng==", 2024-09-21T03:25:03.315 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:25:03.315 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow *", 2024-09-21T03:25:03.315 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile mgr", 2024-09-21T03:25:03.316 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:25:03.316 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:03.316 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:03.316 INFO:teuthology.orchestra.run.smithi105.stdout: ] 2024-09-21T03:25:03.316 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-21T03:25:03.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.302+0000 7f7963d57640 1 -- 172.21.15.105:0/2848872528 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7940078b90 msgr2=0x7f794007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:03.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.302+0000 7f7963d57640 1 --2- 172.21.15.105:0/2848872528 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7940078b90 0x7f794007b0a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f795800a870 tx=0x7f7958008040 comp rx=0 tx=0).stop 2024-09-21T03:25:03.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.302+0000 7f7963d57640 1 -- 172.21.15.105:0/2848872528 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f795c1570e0 msgr2=0x7f795c153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:03.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.302+0000 7f7963d57640 1 --2- 172.21.15.105:0/2848872528 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f795c1570e0 0x7f795c153dd0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f794c034040 tx=0x7f794c0039e0 comp rx=0 tx=0).stop 2024-09-21T03:25:03.318 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.302+0000 7f7963d57640 1 -- 172.21.15.105:0/2848872528 shutdown_connections 2024-09-21T03:25:03.318 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.303+0000 7f7963d57640 1 --2- 172.21.15.105:0/2848872528 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7940078b90 0x7f794007b0a0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:03.318 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.303+0000 7f7963d57640 1 --2- 172.21.15.105:0/2848872528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f795c15d670 0x7f795c1f7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:03.318 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.303+0000 7f7963d57640 1 --2- 172.21.15.105:0/2848872528 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f795c1570e0 0x7f795c153dd0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:03.318 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.303+0000 7f7963d57640 1 --2- 172.21.15.105:0/2848872528 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f795c0d2460 0x7f795c1521b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:03.318 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.303+0000 7f7963d57640 1 -- 172.21.15.105:0/2848872528 >> 172.21.15.105:0/2848872528 conn(0x7f795c06d550 msgr2=0x7f795c0d0150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:03.318 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.303+0000 7f7963d57640 1 -- 172.21.15.105:0/2848872528 shutdown_connections 2024-09-21T03:25:03.318 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.303+0000 7f7963d57640 1 -- 172.21.15.105:0/2848872528 wait complete. 2024-09-21T03:25:03.319 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T03:25:03.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.429+0000 7fa11b020640 1 -- 172.21.15.105:0/2332720899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa114155ce0 msgr2=0x7fa1140708b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:03.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.429+0000 7fa11b020640 1 --2- 172.21.15.105:0/2332720899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa114155ce0 0x7fa1140708b0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fa11406eeb0 tx=0x7fa10c02a560 comp rx=0 tx=0).stop 2024-09-21T03:25:03.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.429+0000 7fa11b020640 1 -- 172.21.15.105:0/2332720899 shutdown_connections 2024-09-21T03:25:03.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.429+0000 7fa11b020640 1 --2- 172.21.15.105:0/2332720899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa114155ce0 0x7fa1140708b0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:03.431 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.429+0000 7fa11b020640 1 --2- 172.21.15.105:0/2332720899 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa11415c580 0x7fa114070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:03.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.429+0000 7fa11b020640 1 --2- 172.21.15.105:0/2332720899 >> v2:172.21.15.162:3300/0 conn(0x7fa114074420 0x7fa11406fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:03.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.429+0000 7fa11b020640 1 -- 172.21.15.105:0/2332720899 >> 172.21.15.105:0/2332720899 conn(0x7fa11406def0 msgr2=0x7fa11406e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:03.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.429+0000 7fa11b020640 1 -- 172.21.15.105:0/2332720899 shutdown_connections 2024-09-21T03:25:03.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.429+0000 7fa11b020640 1 -- 172.21.15.105:0/2332720899 wait complete. 2024-09-21T03:25:03.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.431+0000 7fa11b020640 1 Processor -- start 2024-09-21T03:25:03.432 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.431+0000 7fa11b020640 1 -- start start 2024-09-21T03:25:03.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.432+0000 7fa11b020640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa114074420 0x7fa1141f72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:03.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.432+0000 7fa11b020640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa114155ce0 0x7fa11414e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:03.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.432+0000 7fa11b020640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa114151a60 0x7fa1141f3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:03.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.432+0000 7fa11b020640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa11415f9b0 con 0x7fa114151a60 2024-09-21T03:25:03.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.432+0000 7fa11b020640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa11415f830 con 0x7fa114155ce0 2024-09-21T03:25:03.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.432+0000 7fa11b020640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa11415fb30 con 0x7fa114074420 2024-09-21T03:25:03.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.433+0000 7fa1195bd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa114151a60 0x7fa1141f3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:03.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.433+0000 7fa1195bd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa114151a60 0x7fa1141f3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:44590/0 (socket says 172.21.15.105:44590) 2024-09-21T03:25:03.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.433+0000 7fa1195bd640 1 -- 172.21.15.105:0/3902532698 learned_addr learned my addr 172.21.15.105:0/3902532698 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:03.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.433+0000 7fa113fff640 1 --2- 172.21.15.105:0/3902532698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa114155ce0 0x7fa11414e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:03.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.433+0000 7fa118dbc640 1 --2- 172.21.15.105:0/3902532698 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa114074420 0x7fa1141f72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:03.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.433+0000 7fa1195bd640 1 -- 172.21.15.105:0/3902532698 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa114074420 msgr2=0x7fa1141f72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:03.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.433+0000 7fa1195bd640 1 --2- 172.21.15.105:0/3902532698 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa114074420 0x7fa1141f72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:03.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.433+0000 7fa1195bd640 1 -- 172.21.15.105:0/3902532698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa114155ce0 msgr2=0x7fa11414e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:03.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.433+0000 7fa1195bd640 1 --2- 172.21.15.105:0/3902532698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa114155ce0 0x7fa11414e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:03.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.433+0000 7fa1195bd640 1 -- 172.21.15.105:0/3902532698 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1141530f0 con 0x7fa114151a60 2024-09-21T03:25:03.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.433+0000 7fa118dbc640 1 --2- 172.21.15.105:0/3902532698 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa114074420 0x7fa1141f72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:25:03.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.433+0000 7fa113fff640 1 --2- 172.21.15.105:0/3902532698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa114155ce0 0x7fa11414e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:25:03.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.433+0000 7fa1195bd640 1 --2- 172.21.15.105:0/3902532698 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa114151a60 0x7fa1141f3bc0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fa10c034040 tx=0x7fa10c003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:03.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.433+0000 7fa1117fa640 1 -- 172.21.15.105:0/3902532698 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10c03e030 con 0x7fa114151a60 2024-09-21T03:25:03.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.433+0000 7fa1117fa640 1 -- 172.21.15.105:0/3902532698 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa10c003e50 con 0x7fa114151a60 2024-09-21T03:25:03.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.433+0000 7fa11b020640 1 -- 172.21.15.105:0/3902532698 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1141533d0 con 0x7fa114151a60 2024-09-21T03:25:03.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.433+0000 7fa1117fa640 1 -- 172.21.15.105:0/3902532698 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10c035040 con 0x7fa114151a60 2024-09-21T03:25:03.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.433+0000 7fa11b020640 1 -- 172.21.15.105:0/3902532698 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1141536b0 con 0x7fa114151a60 2024-09-21T03:25:03.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.434+0000 7fa11b020640 1 -- 172.21.15.105:0/3902532698 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa11415c580 con 0x7fa114151a60 2024-09-21T03:25:03.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.435+0000 7fa1117fa640 1 -- 172.21.15.105:0/3902532698 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa10c041030 con 0x7fa114151a60 2024-09-21T03:25:03.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.435+0000 7fa1117fa640 1 --2- 172.21.15.105:0/3902532698 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa0f4078b90 0x7fa0f407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:03.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.435+0000 7fa1117fa640 1 -- 172.21.15.105:0/3902532698 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 4857+0+0 (secure 0 0 0) 0x7fa10c0bb0f0 con 0x7fa114151a60 2024-09-21T03:25:03.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.436+0000 7fa118dbc640 1 --2- 172.21.15.105:0/3902532698 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa0f4078b90 0x7fa0f407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:03.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.436+0000 7fa118dbc640 1 --2- 172.21.15.105:0/3902532698 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa0f4078b90 0x7fa0f407b0a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa104005fd0 tx=0x7fa104009400 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:03.441 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.440+0000 7fa1117fa640 1 -- 172.21.15.105:0/3902532698 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa10c083910 con 0x7fa114151a60 2024-09-21T03:25:03.619 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.618+0000 7fa11b020640 1 -- 172.21.15.105:0/3902532698 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fa114155740 con 0x7fa114151a60 2024-09-21T03:25:03.620 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.618+0000 7fa1117fa640 1 -- 172.21.15.105:0/3902532698 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v100) ==== 84+0+65 (secure 0 0 0) 0x7fa10c083210 con 0x7fa114151a60 2024-09-21T03:25:03.620 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:03.620 INFO:teuthology.orchestra.run.smithi105.stdout:[ 2024-09-21T03:25:03.620 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:25:03.620 INFO:teuthology.orchestra.run.smithi105.stdout: "poolnum": 1, 2024-09-21T03:25:03.620 INFO:teuthology.orchestra.run.smithi105.stdout: "poolname": ".mgr" 2024-09-21T03:25:03.620 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:03.620 INFO:teuthology.orchestra.run.smithi105.stdout:] 2024-09-21T03:25:03.622 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.620+0000 7fa11b020640 1 -- 172.21.15.105:0/3902532698 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa0f4078b90 msgr2=0x7fa0f407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:03.622 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.620+0000 7fa11b020640 1 --2- 172.21.15.105:0/3902532698 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa0f4078b90 0x7fa0f407b0a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa104005fd0 tx=0x7fa104009400 comp rx=0 tx=0).stop 2024-09-21T03:25:03.622 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.620+0000 7fa11b020640 1 -- 172.21.15.105:0/3902532698 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa114151a60 msgr2=0x7fa1141f3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:03.622 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.620+0000 7fa11b020640 1 --2- 172.21.15.105:0/3902532698 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa114151a60 0x7fa1141f3bc0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fa10c034040 tx=0x7fa10c003960 comp rx=0 tx=0).stop 2024-09-21T03:25:03.622 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.620+0000 7fa11b020640 1 -- 172.21.15.105:0/3902532698 shutdown_connections 2024-09-21T03:25:03.622 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.620+0000 7fa11b020640 1 --2- 172.21.15.105:0/3902532698 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa0f4078b90 0x7fa0f407b0a0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:03.623 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.620+0000 7fa11b020640 1 --2- 172.21.15.105:0/3902532698 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa114151a60 0x7fa1141f3bc0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:03.623 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.620+0000 7fa11b020640 1 --2- 172.21.15.105:0/3902532698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa114155ce0 0x7fa11414e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:03.623 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.620+0000 7fa11b020640 1 --2- 172.21.15.105:0/3902532698 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa114074420 0x7fa1141f72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:03.623 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.620+0000 7fa11b020640 1 -- 172.21.15.105:0/3902532698 >> 172.21.15.105:0/3902532698 conn(0x7fa11406def0 msgr2=0x7fa1140cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:03.623 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.620+0000 7fa11b020640 1 -- 172.21.15.105:0/3902532698 shutdown_connections 2024-09-21T03:25:03.623 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.620+0000 7fa11b020640 1 -- 172.21.15.105:0/3902532698 wait complete. 2024-09-21T03:25:03.633 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T03:25:03.633 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T03:25:03.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.747+0000 7fb4315c6640 1 -- 172.21.15.105:0/3770469384 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb42c0b38a0 msgr2=0x7fb42c0d1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:03.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.747+0000 7fb4315c6640 1 --2- 172.21.15.105:0/3770469384 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb42c0b38a0 0x7fb42c0d1470 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fb420009830 tx=0x7fb42002a480 comp rx=0 tx=0).stop 2024-09-21T03:25:03.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.747+0000 7fb4315c6640 1 -- 172.21.15.105:0/3770469384 shutdown_connections 2024-09-21T03:25:03.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.747+0000 7fb4315c6640 1 --2- 172.21.15.105:0/3770469384 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb42c0b38a0 0x7fb42c0d1470 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:03.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.747+0000 7fb4315c6640 1 --2- 172.21.15.105:0/3770469384 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb42c06ded0 0x7fb42c0d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:03.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.747+0000 7fb4315c6640 1 -- 172.21.15.105:0/3770469384 >> 172.21.15.105:0/3770469384 conn(0x7fb42c09d820 msgr2=0x7fb42c08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:03.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.747+0000 7fb4315c6640 1 -- 172.21.15.105:0/3770469384 shutdown_connections 2024-09-21T03:25:03.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.747+0000 7fb4315c6640 1 -- 172.21.15.105:0/3770469384 wait complete. 2024-09-21T03:25:03.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.749+0000 7fb4315c6640 1 Processor -- start 2024-09-21T03:25:03.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.749+0000 7fb4315c6640 1 -- start start 2024-09-21T03:25:03.753 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.750+0000 7fb4315c6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb42c06ded0 0x7fb42c155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:03.753 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.750+0000 7fb4315c6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb42c0b38a0 0x7fb42c0c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:03.753 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.750+0000 7fb4315c6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb42c0d3f80 0x7fb42c0ca520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:03.753 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.750+0000 7fb4315c6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb42c0b6830 con 0x7fb42c06ded0 2024-09-21T03:25:03.753 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.750+0000 7fb4315c6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb42c0b66b0 con 0x7fb42c0b38a0 2024-09-21T03:25:03.753 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.750+0000 7fb4315c6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb42c0b69b0 con 0x7fb42c0d3f80 2024-09-21T03:25:03.753 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.750+0000 7fb42affd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb42c06ded0 0x7fb42c155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:03.753 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.750+0000 7fb42affd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb42c06ded0 0x7fb42c155be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:44610/0 (socket says 172.21.15.105:44610) 2024-09-21T03:25:03.753 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.750+0000 7fb42affd640 1 -- 172.21.15.105:0/3653744091 learned_addr learned my addr 172.21.15.105:0/3653744091 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:03.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.750+0000 7fb42b7fe640 1 --2- 172.21.15.105:0/3653744091 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb42c0d3f80 0x7fb42c0ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:03.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.750+0000 7fb42a7fc640 1 --2- 172.21.15.105:0/3653744091 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb42c0b38a0 0x7fb42c0c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:03.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.751+0000 7fb42affd640 1 -- 172.21.15.105:0/3653744091 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb42c0d3f80 msgr2=0x7fb42c0ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:03.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.751+0000 7fb42affd640 1 --2- 172.21.15.105:0/3653744091 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb42c0d3f80 0x7fb42c0ca520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:03.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.751+0000 7fb42affd640 1 -- 172.21.15.105:0/3653744091 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb42c0b38a0 msgr2=0x7fb42c0c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:03.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.751+0000 7fb42affd640 1 --2- 172.21.15.105:0/3653744091 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb42c0b38a0 0x7fb42c0c8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:03.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.751+0000 7fb42affd640 1 -- 172.21.15.105:0/3653744091 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb42c156120 con 0x7fb42c06ded0 2024-09-21T03:25:03.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.751+0000 7fb42affd640 1 --2- 172.21.15.105:0/3653744091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb42c06ded0 0x7fb42c155be0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fb41c00ea80 tx=0x7fb41c00ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:03.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.751+0000 7fb4137fe640 1 -- 172.21.15.105:0/3653744091 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41c00cde0 con 0x7fb42c06ded0 2024-09-21T03:25:03.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.751+0000 7fb4137fe640 1 -- 172.21.15.105:0/3653744091 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb41c011560 con 0x7fb42c06ded0 2024-09-21T03:25:03.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.751+0000 7fb4315c6640 1 -- 172.21.15.105:0/3653744091 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb42c1f57b0 con 0x7fb42c06ded0 2024-09-21T03:25:03.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.751+0000 7fb4137fe640 1 -- 172.21.15.105:0/3653744091 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41c011990 con 0x7fb42c06ded0 2024-09-21T03:25:03.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.751+0000 7fb4315c6640 1 -- 172.21.15.105:0/3653744091 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb42c1f5d70 con 0x7fb42c06ded0 2024-09-21T03:25:03.755 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.752+0000 7fb4315c6640 1 -- 172.21.15.105:0/3653744091 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb42c0b5fa0 con 0x7fb42c06ded0 2024-09-21T03:25:03.755 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.753+0000 7fb4137fe640 1 -- 172.21.15.105:0/3653744091 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb41c011b30 con 0x7fb42c06ded0 2024-09-21T03:25:03.755 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.753+0000 7fb4137fe640 1 --2- 172.21.15.105:0/3653744091 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb418078bc0 0x7fb41807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:03.755 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.754+0000 7fb4137fe640 1 -- 172.21.15.105:0/3653744091 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 4857+0+0 (secure 0 0 0) 0x7fb41c09b430 con 0x7fb42c06ded0 2024-09-21T03:25:03.755 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.754+0000 7fb42a7fc640 1 --2- 172.21.15.105:0/3653744091 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb418078bc0 0x7fb41807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:03.756 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.754+0000 7fb42a7fc640 1 --2- 172.21.15.105:0/3653744091 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb418078bc0 0x7fb41807b0d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb420034000 tx=0x7fb420004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:03.760 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.758+0000 7fb4137fe640 1 -- 172.21.15.105:0/3653744091 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb42c156120 con 0x7fb42c06ded0 2024-09-21T03:25:03.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:03.939+0000 7fb4315c6640 1 -- 172.21.15.105:0/3653744091 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb42c0761a0 con 0x7fb42c06ded0 2024-09-21T03:25:04.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:04.925+0000 7fb4137fe640 1 -- 172.21.15.105:0/3653744091 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v101) ==== 138+0+0 (secure 0 0 0) 0x7fb41c016030 con 0x7fb42c06ded0 2024-09-21T03:25:04.927 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_metadata' created 2024-09-21T03:25:04.931 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:04.929+0000 7fb4315c6640 1 -- 172.21.15.105:0/3653744091 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb418078bc0 msgr2=0x7fb41807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:04.931 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:04.929+0000 7fb4315c6640 1 --2- 172.21.15.105:0/3653744091 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb418078bc0 0x7fb41807b0d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb420034000 tx=0x7fb420004730 comp rx=0 tx=0).stop 2024-09-21T03:25:04.931 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:04.929+0000 7fb4315c6640 1 -- 172.21.15.105:0/3653744091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb42c06ded0 msgr2=0x7fb42c155be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:04.932 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:04.929+0000 7fb4315c6640 1 --2- 172.21.15.105:0/3653744091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb42c06ded0 0x7fb42c155be0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fb41c00ea80 tx=0x7fb41c00ef40 comp rx=0 tx=0).stop 2024-09-21T03:25:04.932 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:04.929+0000 7fb4315c6640 1 -- 172.21.15.105:0/3653744091 shutdown_connections 2024-09-21T03:25:04.932 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:04.929+0000 7fb4315c6640 1 --2- 172.21.15.105:0/3653744091 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb418078bc0 0x7fb41807b0d0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:04.932 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:04.929+0000 7fb4315c6640 1 --2- 172.21.15.105:0/3653744091 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb42c0d3f80 0x7fb42c0ca520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:04.932 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:04.929+0000 7fb4315c6640 1 --2- 172.21.15.105:0/3653744091 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb42c0b38a0 0x7fb42c0c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:04.932 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:04.929+0000 7fb4315c6640 1 --2- 172.21.15.105:0/3653744091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb42c06ded0 0x7fb42c155be0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:04.932 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:04.929+0000 7fb4315c6640 1 -- 172.21.15.105:0/3653744091 >> 172.21.15.105:0/3653744091 conn(0x7fb42c09d820 msgr2=0x7fb42c161b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:04.932 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:04.929+0000 7fb4315c6640 1 -- 172.21.15.105:0/3653744091 shutdown_connections 2024-09-21T03:25:04.933 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:04.929+0000 7fb4315c6640 1 -- 172.21.15.105:0/3653744091 wait complete. 2024-09-21T03:25:04.949 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T03:25:05.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.074+0000 7f73374c5640 1 -- 172.21.15.105:0/4097040131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f731c004e60 msgr2=0x7f731c0052d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:05.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.074+0000 7f73374c5640 1 --2- 172.21.15.105:0/4097040131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f731c004e60 0x7f731c0052d0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f7328009e20 tx=0x7f731c005830 comp rx=0 tx=0).stop 2024-09-21T03:25:05.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.074+0000 7f7335a62640 1 -- 172.21.15.105:0/4097040131 reap_dead start 2024-09-21T03:25:05.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.074+0000 7f73374c5640 1 -- 172.21.15.105:0/4097040131 shutdown_connections 2024-09-21T03:25:05.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.074+0000 7f73374c5640 1 -- 172.21.15.105:0/4097040131 >> 172.21.15.105:0/4097040131 conn(0x7f733008bfc0 msgr2=0x7f733009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:05.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.074+0000 7f73374c5640 1 -- 172.21.15.105:0/4097040131 shutdown_connections 2024-09-21T03:25:05.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.074+0000 7f73374c5640 1 -- 172.21.15.105:0/4097040131 wait complete. 2024-09-21T03:25:05.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.076+0000 7f73374c5640 1 Processor -- start 2024-09-21T03:25:05.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.076+0000 7f73374c5640 1 -- start start 2024-09-21T03:25:05.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.077+0000 7f73374c5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f731c004e60 0x7f7330151250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:05.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.077+0000 7f73374c5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7330152320 0x7f7330152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:05.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.077+0000 7f73374c5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7330152c70 0x7f7330153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:05.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.077+0000 7f73374c5640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f73300cf2e0 con 0x7f7330152320 2024-09-21T03:25:05.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.077+0000 7f73374c5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f73300cf160 con 0x7f731c004e60 2024-09-21T03:25:05.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.077+0000 7f73374c5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f73300b3a30 con 0x7f7330152c70 2024-09-21T03:25:05.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.077+0000 7f7334a60640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7330152320 0x7f7330152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:05.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.077+0000 7f7334a60640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7330152320 0x7f7330152730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:44640/0 (socket says 172.21.15.105:44640) 2024-09-21T03:25:05.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.077+0000 7f7334a60640 1 -- 172.21.15.105:0/2068929084 learned_addr learned my addr 172.21.15.105:0/2068929084 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:05.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.077+0000 7f7334a60640 1 -- 172.21.15.105:0/2068929084 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7330152c70 msgr2=0x7f7330153960 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T03:25:05.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.077+0000 7f7334a60640 1 --2- 172.21.15.105:0/2068929084 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7330152c70 0x7f7330153960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:05.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.077+0000 7f7334a60640 1 -- 172.21.15.105:0/2068929084 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f731c004e60 msgr2=0x7f7330151250 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T03:25:05.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.077+0000 7f7334a60640 1 --2- 172.21.15.105:0/2068929084 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f731c004e60 0x7f7330151250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:05.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.077+0000 7f7334a60640 1 -- 172.21.15.105:0/2068929084 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73300cdae0 con 0x7f7330152320 2024-09-21T03:25:05.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.078+0000 7f7334a60640 1 --2- 172.21.15.105:0/2068929084 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7330152320 0x7f7330152730 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f7320004d10 tx=0x7f7320001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:05.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.078+0000 7f7325ffb640 1 -- 172.21.15.105:0/2068929084 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73200105d0 con 0x7f7330152320 2024-09-21T03:25:05.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.078+0000 7f7325ffb640 1 -- 172.21.15.105:0/2068929084 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7320016070 con 0x7f7330152320 2024-09-21T03:25:05.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.078+0000 7f73374c5640 1 -- 172.21.15.105:0/2068929084 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73300cddc0 con 0x7f7330152320 2024-09-21T03:25:05.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.078+0000 7f7325ffb640 1 -- 172.21.15.105:0/2068929084 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7320010b00 con 0x7f7330152320 2024-09-21T03:25:05.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.078+0000 7f73374c5640 1 -- 172.21.15.105:0/2068929084 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7330151e00 con 0x7f7330152320 2024-09-21T03:25:05.082 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.079+0000 7f73374c5640 1 -- 172.21.15.105:0/2068929084 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73300d1e40 con 0x7f7330152320 2024-09-21T03:25:05.082 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.080+0000 7f7325ffb640 1 -- 172.21.15.105:0/2068929084 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7320010ca0 con 0x7f7330152320 2024-09-21T03:25:05.082 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.080+0000 7f7325ffb640 1 --2- 172.21.15.105:0/2068929084 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7314078b90 0x7f731407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:05.082 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.080+0000 7f7325ffb640 1 -- 172.21.15.105:0/2068929084 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5227+0+0 (secure 0 0 0) 0x7f732009b300 con 0x7f7330152320 2024-09-21T03:25:05.082 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.081+0000 7f7335261640 1 --2- 172.21.15.105:0/2068929084 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7314078b90 0x7f731407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:05.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.081+0000 7f7335261640 1 --2- 172.21.15.105:0/2068929084 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7314078b90 0x7f731407b0a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f732c001050 tx=0x7f732c0067a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:05.086 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.085+0000 7f7325ffb640 1 -- 172.21.15.105:0/2068929084 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f73300d1e40 con 0x7f7330152320 2024-09-21T03:25:05.266 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.264+0000 7f73374c5640 1 -- 172.21.15.105:0/2068929084 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f73300cdf90 con 0x7f7330152320 2024-09-21T03:25:05.934 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.932+0000 7f7325ffb640 1 -- 172.21.15.105:0/2068929084 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v102) ==== 170+0+0 (secure 0 0 0) 0x7f7320063920 con 0x7f7330152320 2024-09-21T03:25:05.934 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_data' created 2024-09-21T03:25:05.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.935+0000 7f73374c5640 1 -- 172.21.15.105:0/2068929084 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7314078b90 msgr2=0x7f731407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:05.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.935+0000 7f73374c5640 1 --2- 172.21.15.105:0/2068929084 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7314078b90 0x7f731407b0a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f732c001050 tx=0x7f732c0067a0 comp rx=0 tx=0).stop 2024-09-21T03:25:05.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.935+0000 7f73374c5640 1 -- 172.21.15.105:0/2068929084 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7330152320 msgr2=0x7f7330152730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:05.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.935+0000 7f73374c5640 1 --2- 172.21.15.105:0/2068929084 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7330152320 0x7f7330152730 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f7320004d10 tx=0x7f7320001630 comp rx=0 tx=0).stop 2024-09-21T03:25:05.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.935+0000 7f73374c5640 1 -- 172.21.15.105:0/2068929084 shutdown_connections 2024-09-21T03:25:05.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.935+0000 7f73374c5640 1 --2- 172.21.15.105:0/2068929084 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7314078b90 0x7f731407b0a0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:05.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.935+0000 7f73374c5640 1 --2- 172.21.15.105:0/2068929084 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7330152c70 0x7f7330153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:05.938 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.935+0000 7f73374c5640 1 --2- 172.21.15.105:0/2068929084 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7330152320 0x7f7330152730 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:05.938 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.935+0000 7f73374c5640 1 --2- 172.21.15.105:0/2068929084 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f731c004e60 0x7f7330151250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:05.938 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.935+0000 7f73374c5640 1 -- 172.21.15.105:0/2068929084 >> 172.21.15.105:0/2068929084 conn(0x7f733008bfc0 msgr2=0x7f73300b2520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:05.938 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.935+0000 7f73374c5640 1 -- 172.21.15.105:0/2068929084 shutdown_connections 2024-09-21T03:25:05.938 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:05.935+0000 7f73374c5640 1 -- 172.21.15.105:0/2068929084 wait complete. 2024-09-21T03:25:05.960 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T03:25:06.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.078+0000 7fd58f425640 1 -- 172.21.15.105:0/2008607294 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd58815f0c0 msgr2=0x7fd58815f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:06.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.078+0000 7fd58f425640 1 --2- 172.21.15.105:0/2008607294 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd58815f0c0 0x7fd58815f4d0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fd588071dc0 tx=0x7fd58402a5f0 comp rx=0 tx=0).stop 2024-09-21T03:25:06.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.078+0000 7fd58f425640 1 -- 172.21.15.105:0/2008607294 shutdown_connections 2024-09-21T03:25:06.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.078+0000 7fd58f425640 1 --2- 172.21.15.105:0/2008607294 >> v2:172.21.15.162:3300/0 conn(0x7fd588160550 0x7fd5880d0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:06.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.078+0000 7fd58f425640 1 --2- 172.21.15.105:0/2008607294 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd58815f0c0 0x7fd58815f4d0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:06.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.078+0000 7fd58f425640 1 -- 172.21.15.105:0/2008607294 >> 172.21.15.105:0/2008607294 conn(0x7fd58806d4f0 msgr2=0x7fd588071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:06.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.079+0000 7fd58f425640 1 -- 172.21.15.105:0/2008607294 shutdown_connections 2024-09-21T03:25:06.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.079+0000 7fd58f425640 1 -- 172.21.15.105:0/2008607294 wait complete. 2024-09-21T03:25:06.082 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.080+0000 7fd58f425640 1 Processor -- start 2024-09-21T03:25:06.082 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.080+0000 7fd58f425640 1 -- start start 2024-09-21T03:25:06.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.082+0000 7fd58f425640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd58815f0c0 0x7fd5880b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:06.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.082+0000 7fd58f425640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd588160140 0x7fd5880b3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:06.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.082+0000 7fd58f425640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd588160550 0x7fd5880b3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:06.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.082+0000 7fd58f425640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd5880d0ad0 con 0x7fd588160140 2024-09-21T03:25:06.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.082+0000 7fd58f425640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd5880d0950 con 0x7fd588160550 2024-09-21T03:25:06.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.082+0000 7fd58f425640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd588162030 con 0x7fd58815f0c0 2024-09-21T03:25:06.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.082+0000 7fd58c9c0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd588160140 0x7fd5880b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:06.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.082+0000 7fd58c9c0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd588160140 0x7fd5880b3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:44658/0 (socket says 172.21.15.105:44658) 2024-09-21T03:25:06.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.082+0000 7fd58c9c0640 1 -- 172.21.15.105:0/2126246348 learned_addr learned my addr 172.21.15.105:0/2126246348 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:06.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.082+0000 7fd58d1c1640 1 --2- 172.21.15.105:0/2126246348 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd58815f0c0 0x7fd5880b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:06.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.082+0000 7fd58d9c2640 1 --2- 172.21.15.105:0/2126246348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd588160550 0x7fd5880b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:06.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.082+0000 7fd58c9c0640 1 -- 172.21.15.105:0/2126246348 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd58815f0c0 msgr2=0x7fd5880b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:06.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.082+0000 7fd58c9c0640 1 --2- 172.21.15.105:0/2126246348 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd58815f0c0 0x7fd5880b2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:06.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.082+0000 7fd58c9c0640 1 -- 172.21.15.105:0/2126246348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd588160550 msgr2=0x7fd5880b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:06.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.082+0000 7fd58c9c0640 1 --2- 172.21.15.105:0/2126246348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd588160550 0x7fd5880b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:06.086 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.082+0000 7fd58c9c0640 1 -- 172.21.15.105:0/2126246348 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5880cbd50 con 0x7fd588160140 2024-09-21T03:25:06.086 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.082+0000 7fd58d1c1640 1 --2- 172.21.15.105:0/2126246348 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd58815f0c0 0x7fd5880b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:25:06.086 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.082+0000 7fd58d9c2640 1 --2- 172.21.15.105:0/2126246348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd588160550 0x7fd5880b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:25:06.086 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.082+0000 7fd58c9c0640 1 --2- 172.21.15.105:0/2126246348 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd588160140 0x7fd5880b3200 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fd57800c3c0 tx=0x7fd57800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:06.086 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.082+0000 7fd57dffb640 1 -- 172.21.15.105:0/2126246348 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd578017070 con 0x7fd588160140 2024-09-21T03:25:06.086 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.082+0000 7fd57dffb640 1 -- 172.21.15.105:0/2126246348 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd5780035f0 con 0x7fd588160140 2024-09-21T03:25:06.086 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.082+0000 7fd58f425640 1 -- 172.21.15.105:0/2126246348 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5880cba70 con 0x7fd588160140 2024-09-21T03:25:06.086 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.082+0000 7fd57dffb640 1 -- 172.21.15.105:0/2126246348 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd578003a40 con 0x7fd588160140 2024-09-21T03:25:06.086 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.083+0000 7fd58f425640 1 -- 172.21.15.105:0/2126246348 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5881564d0 con 0x7fd588160140 2024-09-21T03:25:06.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.084+0000 7fd58f425640 1 -- 172.21.15.105:0/2126246348 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd58815f4d0 con 0x7fd588160140 2024-09-21T03:25:06.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.084+0000 7fd57dffb640 1 -- 172.21.15.105:0/2126246348 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd57801a070 con 0x7fd588160140 2024-09-21T03:25:06.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.085+0000 7fd57dffb640 1 --2- 172.21.15.105:0/2126246348 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd56c078b90 0x7fd56c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:06.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.085+0000 7fd57dffb640 1 -- 172.21.15.105:0/2126246348 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5609+0+0 (secure 0 0 0) 0x7fd578099f50 con 0x7fd588160140 2024-09-21T03:25:06.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.085+0000 7fd58d1c1640 1 --2- 172.21.15.105:0/2126246348 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd56c078b90 0x7fd56c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:06.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.086+0000 7fd58d1c1640 1 --2- 172.21.15.105:0/2126246348 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd56c078b90 0x7fd56c07b0a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd584033000 tx=0x7fd584004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:06.091 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.090+0000 7fd57dffb640 1 -- 172.21.15.105:0/2126246348 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd578062540 con 0x7fd588160140 2024-09-21T03:25:06.305 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.304+0000 7fd58f425640 1 -- 172.21.15.105:0/2126246348 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fd5880cb800 con 0x7fd588160140 2024-09-21T03:25:06.935 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.933+0000 7fd57dffb640 1 -- 172.21.15.105:0/2126246348 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v63) ==== 174+0+0 (secure 0 0 0) 0x7fd578061e40 con 0x7fd588160140 2024-09-21T03:25:06.935 INFO:teuthology.orchestra.run.smithi105.stderr:new fs with metadata pool 16 and data pool 17 2024-09-21T03:25:06.938 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.937+0000 7fd58f425640 1 -- 172.21.15.105:0/2126246348 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd56c078b90 msgr2=0x7fd56c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:06.939 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.937+0000 7fd58f425640 1 --2- 172.21.15.105:0/2126246348 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd56c078b90 0x7fd56c07b0a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd584033000 tx=0x7fd584004730 comp rx=0 tx=0).stop 2024-09-21T03:25:06.939 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.937+0000 7fd58f425640 1 -- 172.21.15.105:0/2126246348 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd588160140 msgr2=0x7fd5880b3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:06.939 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.937+0000 7fd58f425640 1 --2- 172.21.15.105:0/2126246348 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd588160140 0x7fd5880b3200 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fd57800c3c0 tx=0x7fd57800c880 comp rx=0 tx=0).stop 2024-09-21T03:25:06.939 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.937+0000 7fd58f425640 1 -- 172.21.15.105:0/2126246348 shutdown_connections 2024-09-21T03:25:06.939 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.937+0000 7fd58f425640 1 --2- 172.21.15.105:0/2126246348 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd56c078b90 0x7fd56c07b0a0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:06.939 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.937+0000 7fd58f425640 1 --2- 172.21.15.105:0/2126246348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd588160550 0x7fd5880b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:06.939 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.937+0000 7fd58f425640 1 --2- 172.21.15.105:0/2126246348 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd588160140 0x7fd5880b3200 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:06.939 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.937+0000 7fd58f425640 1 --2- 172.21.15.105:0/2126246348 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd58815f0c0 0x7fd5880b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:06.939 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.937+0000 7fd58f425640 1 -- 172.21.15.105:0/2126246348 >> 172.21.15.105:0/2126246348 conn(0x7fd58806d4f0 msgr2=0x7fd588071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:06.939 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.937+0000 7fd58f425640 1 -- 172.21.15.105:0/2126246348 shutdown_connections 2024-09-21T03:25:06.939 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:06.937+0000 7fd58f425640 1 -- 172.21.15.105:0/2126246348 wait complete. 2024-09-21T03:25:06.967 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:25:07.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.083+0000 7f8efea27640 1 -- 172.21.15.105:0/158713284 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ef815d8a0 msgr2=0x7f8ef80b40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:07.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.083+0000 7f8efea27640 1 --2- 172.21.15.105:0/158713284 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ef815d8a0 0x7f8ef80b40b0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f8eec009830 tx=0x7f8eec02a510 comp rx=0 tx=0).stop 2024-09-21T03:25:07.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.083+0000 7f8efea27640 1 -- 172.21.15.105:0/158713284 shutdown_connections 2024-09-21T03:25:07.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.083+0000 7f8efea27640 1 --2- 172.21.15.105:0/158713284 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ef815d8a0 0x7f8ef80b40b0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:07.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.083+0000 7f8efea27640 1 --2- 172.21.15.105:0/158713284 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ef80cc1e0 0x7f8ef80af3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:07.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.083+0000 7f8efea27640 1 -- 172.21.15.105:0/158713284 >> 172.21.15.105:0/158713284 conn(0x7f8ef806d7d0 msgr2=0x7f8ef80b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:07.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.083+0000 7f8efea27640 1 -- 172.21.15.105:0/158713284 shutdown_connections 2024-09-21T03:25:07.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.083+0000 7f8efea27640 1 -- 172.21.15.105:0/158713284 wait complete. 2024-09-21T03:25:07.086 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.085+0000 7f8efea27640 1 Processor -- start 2024-09-21T03:25:07.086 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.085+0000 7f8efea27640 1 -- start start 2024-09-21T03:25:07.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.086+0000 7f8efea27640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ef80cc1e0 0x7f8ef8152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:07.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.086+0000 7f8efea27640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ef80ccb50 0x7f8ef80adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:07.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.086+0000 7f8efea27640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ef815d8a0 0x7f8ef80ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:07.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.086+0000 7f8efea27640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef8153520 con 0x7f8ef80ccb50 2024-09-21T03:25:07.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.086+0000 7f8efea27640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef81533a0 con 0x7f8ef815d8a0 2024-09-21T03:25:07.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.086+0000 7f8efea27640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8ef81536a0 con 0x7f8ef80cc1e0 2024-09-21T03:25:07.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.086+0000 7f8ef77fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ef80ccb50 0x7f8ef80adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:07.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.086+0000 7f8ef77fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ef80ccb50 0x7f8ef80adfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:44682/0 (socket says 172.21.15.105:44682) 2024-09-21T03:25:07.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.086+0000 7f8ef77fe640 1 -- 172.21.15.105:0/1105905348 learned_addr learned my addr 172.21.15.105:0/1105905348 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:07.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.086+0000 7f8ef7fff640 1 --2- 172.21.15.105:0/1105905348 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ef80cc1e0 0x7f8ef8152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:07.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.086+0000 7f8efcfc4640 1 --2- 172.21.15.105:0/1105905348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ef815d8a0 0x7f8ef80ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:07.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.086+0000 7f8ef77fe640 1 -- 172.21.15.105:0/1105905348 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ef80cc1e0 msgr2=0x7f8ef8152b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:07.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.086+0000 7f8ef77fe640 1 --2- 172.21.15.105:0/1105905348 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ef80cc1e0 0x7f8ef8152b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:07.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.086+0000 7f8ef77fe640 1 -- 172.21.15.105:0/1105905348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ef815d8a0 msgr2=0x7f8ef80ae4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:07.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.086+0000 7f8ef77fe640 1 --2- 172.21.15.105:0/1105905348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ef815d8a0 0x7f8ef80ae4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:07.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.086+0000 7f8ef77fe640 1 -- 172.21.15.105:0/1105905348 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ef809b1f0 con 0x7f8ef80ccb50 2024-09-21T03:25:07.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.086+0000 7f8ef7fff640 1 --2- 172.21.15.105:0/1105905348 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ef80cc1e0 0x7f8ef8152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:25:07.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.087+0000 7f8ef77fe640 1 --2- 172.21.15.105:0/1105905348 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ef80ccb50 0x7f8ef80adfa0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f8eec000c00 tx=0x7f8eec033c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:07.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.087+0000 7f8ef4ff9640 1 -- 172.21.15.105:0/1105905348 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eec005c90 con 0x7f8ef80ccb50 2024-09-21T03:25:07.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.087+0000 7f8ef4ff9640 1 -- 172.21.15.105:0/1105905348 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8eec031e50 con 0x7f8ef80ccb50 2024-09-21T03:25:07.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.087+0000 7f8efea27640 1 -- 172.21.15.105:0/1105905348 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ef809b550 con 0x7f8ef80ccb50 2024-09-21T03:25:07.091 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.087+0000 7f8ef4ff9640 1 -- 172.21.15.105:0/1105905348 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eec033310 con 0x7f8ef80ccb50 2024-09-21T03:25:07.091 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.087+0000 7f8efea27640 1 -- 172.21.15.105:0/1105905348 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ef80ad7a0 con 0x7f8ef80ccb50 2024-09-21T03:25:07.091 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.088+0000 7f8efea27640 1 -- 172.21.15.105:0/1105905348 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ef8071740 con 0x7f8ef80ccb50 2024-09-21T03:25:07.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.089+0000 7f8ef4ff9640 1 -- 172.21.15.105:0/1105905348 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8eec0334b0 con 0x7f8ef80ccb50 2024-09-21T03:25:07.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.089+0000 7f8ef4ff9640 1 --2- 172.21.15.105:0/1105905348 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8ee4078b90 0x7f8ee407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:07.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.089+0000 7f8ef4ff9640 1 -- 172.21.15.105:0/1105905348 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f8eec0bc250 con 0x7f8ef80ccb50 2024-09-21T03:25:07.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.089+0000 7f8ef7fff640 1 --2- 172.21.15.105:0/1105905348 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8ee4078b90 0x7f8ee407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:07.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.090+0000 7f8ef7fff640 1 --2- 172.21.15.105:0/1105905348 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8ee4078b90 0x7f8ee407b0a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8005fd0 tx=0x7f8ee800f360 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:07.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.094+0000 7f8ef4ff9640 1 -- 172.21.15.105:0/1105905348 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8ef8071740 con 0x7f8ef80ccb50 2024-09-21T03:25:07.273 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.271+0000 7f8efea27640 1 -- 172.21.15.105:0/1105905348 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8ef8153b50 con 0x7f8ef80ccb50 2024-09-21T03:25:07.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.273+0000 7f8ef4ff9640 1 -- 172.21.15.105:0/1105905348 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+16772 (secure 0 0 0) 0x7f8eec03f030 con 0x7f8ef80ccb50 2024-09-21T03:25:07.274 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:07.275 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":103,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:25:06.305499+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:25:03.944314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-21T03:25:05.269304+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:25:07.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.275+0000 7f8efea27640 1 -- 172.21.15.105:0/1105905348 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8ee4078b90 msgr2=0x7f8ee407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:07.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.275+0000 7f8efea27640 1 --2- 172.21.15.105:0/1105905348 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8ee4078b90 0x7f8ee407b0a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8005fd0 tx=0x7f8ee800f360 comp rx=0 tx=0).stop 2024-09-21T03:25:07.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.275+0000 7f8efea27640 1 -- 172.21.15.105:0/1105905348 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ef80ccb50 msgr2=0x7f8ef80adfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:07.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.275+0000 7f8efea27640 1 --2- 172.21.15.105:0/1105905348 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ef80ccb50 0x7f8ef80adfa0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f8eec000c00 tx=0x7f8eec033c90 comp rx=0 tx=0).stop 2024-09-21T03:25:07.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.275+0000 7f8efea27640 1 -- 172.21.15.105:0/1105905348 shutdown_connections 2024-09-21T03:25:07.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.275+0000 7f8efea27640 1 --2- 172.21.15.105:0/1105905348 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8ee4078b90 0x7f8ee407b0a0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:07.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.275+0000 7f8efea27640 1 --2- 172.21.15.105:0/1105905348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ef815d8a0 0x7f8ef80ae4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:07.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.275+0000 7f8efea27640 1 --2- 172.21.15.105:0/1105905348 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ef80ccb50 0x7f8ef80adfa0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:07.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.275+0000 7f8efea27640 1 --2- 172.21.15.105:0/1105905348 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ef80cc1e0 0x7f8ef8152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:07.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.275+0000 7f8efea27640 1 -- 172.21.15.105:0/1105905348 >> 172.21.15.105:0/1105905348 conn(0x7f8ef806d7d0 msgr2=0x7f8ef80b1500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:07.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.275+0000 7f8efea27640 1 -- 172.21.15.105:0/1105905348 shutdown_connections 2024-09-21T03:25:07.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.275+0000 7f8efea27640 1 -- 172.21.15.105:0/1105905348 wait complete. 2024-09-21T03:25:07.288 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:25:07.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.399+0000 7f401f332640 1 -- 172.21.15.105:0/3843904877 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4004003a00 msgr2=0x7f4004003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:07.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.399+0000 7f401f332640 1 --2- 172.21.15.105:0/3843904877 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4004003a00 0x7f4004003e70 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f4014009b40 tx=0x7f4004005830 comp rx=0 tx=0).stop 2024-09-21T03:25:07.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.399+0000 7f401d8cf640 1 -- 172.21.15.105:0/3843904877 reap_dead start 2024-09-21T03:25:07.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.399+0000 7f401f332640 1 -- 172.21.15.105:0/3843904877 shutdown_connections 2024-09-21T03:25:07.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.399+0000 7f401f332640 1 -- 172.21.15.105:0/3843904877 >> 172.21.15.105:0/3843904877 conn(0x7f401806d7d0 msgr2=0x7f40180b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:07.402 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.399+0000 7f401f332640 1 -- 172.21.15.105:0/3843904877 shutdown_connections 2024-09-21T03:25:07.402 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.399+0000 7f401f332640 1 -- 172.21.15.105:0/3843904877 wait complete. 2024-09-21T03:25:07.402 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.401+0000 7f401f332640 1 Processor -- start 2024-09-21T03:25:07.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.401+0000 7f401f332640 1 -- start start 2024-09-21T03:25:07.405 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.402+0000 7f401f332640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4004003a00 0x7f40180c5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:07.405 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.402+0000 7f401f332640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40181f5850 0x7f40181f1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:07.405 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.402+0000 7f401f332640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f401815d430 0x7f401809bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:07.405 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.402+0000 7f401f332640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f40180cc760 con 0x7f40181f5850 2024-09-21T03:25:07.405 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.402+0000 7f401f332640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f40180cc5e0 con 0x7f4004003a00 2024-09-21T03:25:07.405 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.402+0000 7f401f332640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4018070f20 con 0x7f401815d430 2024-09-21T03:25:07.406 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.402+0000 7f401c8cd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40181f5850 0x7f40181f1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:07.406 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.402+0000 7f401c8cd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40181f5850 0x7f40181f1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:44708/0 (socket says 172.21.15.105:44708) 2024-09-21T03:25:07.406 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.402+0000 7f401c8cd640 1 -- 172.21.15.105:0/1730503743 learned_addr learned my addr 172.21.15.105:0/1730503743 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:07.406 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.403+0000 7f401d0ce640 1 --2- 172.21.15.105:0/1730503743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4004003a00 0x7f40180c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:07.406 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.403+0000 7f401d8cf640 1 --2- 172.21.15.105:0/1730503743 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f401815d430 0x7f401809bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:07.406 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.403+0000 7f401c8cd640 1 -- 172.21.15.105:0/1730503743 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f401815d430 msgr2=0x7f401809bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:07.406 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.403+0000 7f401c8cd640 1 --2- 172.21.15.105:0/1730503743 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f401815d430 0x7f401809bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:07.406 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.403+0000 7f401c8cd640 1 -- 172.21.15.105:0/1730503743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4004003a00 msgr2=0x7f40180c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:07.406 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.403+0000 7f401c8cd640 1 --2- 172.21.15.105:0/1730503743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4004003a00 0x7f40180c5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:07.406 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.403+0000 7f401c8cd640 1 -- 172.21.15.105:0/1730503743 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40180c56c0 con 0x7f40181f5850 2024-09-21T03:25:07.406 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.403+0000 7f401d8cf640 1 --2- 172.21.15.105:0/1730503743 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f401815d430 0x7f401809bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:25:07.406 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.403+0000 7f401c8cd640 1 --2- 172.21.15.105:0/1730503743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40181f5850 0x7f40181f1ec0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f40080038d0 tx=0x7f400800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:07.406 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.403+0000 7f400dffb640 1 -- 172.21.15.105:0/1730503743 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400801d070 con 0x7f40181f5850 2024-09-21T03:25:07.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.403+0000 7f400dffb640 1 -- 172.21.15.105:0/1730503743 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f400800ed80 con 0x7f40181f5850 2024-09-21T03:25:07.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.403+0000 7f401f332640 1 -- 172.21.15.105:0/1730503743 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40180c5e40 con 0x7f40181f5850 2024-09-21T03:25:07.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.403+0000 7f400dffb640 1 -- 172.21.15.105:0/1730503743 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40080186e0 con 0x7f40181f5850 2024-09-21T03:25:07.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.403+0000 7f401f332640 1 -- 172.21.15.105:0/1730503743 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40180c53e0 con 0x7f40181f5850 2024-09-21T03:25:07.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.404+0000 7f401f332640 1 -- 172.21.15.105:0/1730503743 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40180cca50 con 0x7f40181f5850 2024-09-21T03:25:07.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.405+0000 7f400dffb640 1 -- 172.21.15.105:0/1730503743 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4008020070 con 0x7f40181f5850 2024-09-21T03:25:07.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.406+0000 7f400dffb640 1 --2- 172.21.15.105:0/1730503743 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3ffc078b90 0x7f3ffc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:07.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.406+0000 7f400dffb640 1 -- 172.21.15.105:0/1730503743 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f400809c350 con 0x7f40181f5850 2024-09-21T03:25:07.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.406+0000 7f401d0ce640 1 --2- 172.21.15.105:0/1730503743 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3ffc078b90 0x7f3ffc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:07.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.407+0000 7f401d0ce640 1 --2- 172.21.15.105:0/1730503743 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3ffc078b90 0x7f3ffc07b0a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4014034000 tx=0x7f40140046c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:07.412 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.410+0000 7f400dffb640 1 -- 172.21.15.105:0/1730503743 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f40080641d0 con 0x7f40181f5850 2024-09-21T03:25:07.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.586+0000 7f401f332640 1 -- 172.21.15.105:0/1730503743 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f40180cf010 con 0x7f40181f5850 2024-09-21T03:25:07.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.587+0000 7f400dffb640 1 -- 172.21.15.105:0/1730503743 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+16772 (secure 0 0 0) 0x7f4008068c00 con 0x7f40181f5850 2024-09-21T03:25:07.589 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:07.589 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":103,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:25:06.305499+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:25:03.944314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-21T03:25:05.269304+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:25:07.592 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.590+0000 7f401f332640 1 -- 172.21.15.105:0/1730503743 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3ffc078b90 msgr2=0x7f3ffc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:07.592 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.590+0000 7f401f332640 1 --2- 172.21.15.105:0/1730503743 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3ffc078b90 0x7f3ffc07b0a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4014034000 tx=0x7f40140046c0 comp rx=0 tx=0).stop 2024-09-21T03:25:07.592 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.590+0000 7f401f332640 1 -- 172.21.15.105:0/1730503743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40181f5850 msgr2=0x7f40181f1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:07.592 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.590+0000 7f401f332640 1 --2- 172.21.15.105:0/1730503743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40181f5850 0x7f40181f1ec0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f40080038d0 tx=0x7f400800cf90 comp rx=0 tx=0).stop 2024-09-21T03:25:07.592 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.590+0000 7f401f332640 1 -- 172.21.15.105:0/1730503743 shutdown_connections 2024-09-21T03:25:07.592 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.590+0000 7f401f332640 1 --2- 172.21.15.105:0/1730503743 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3ffc078b90 0x7f3ffc07b0a0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:07.592 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.590+0000 7f401f332640 1 --2- 172.21.15.105:0/1730503743 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f401815d430 0x7f401809bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:07.592 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.590+0000 7f401f332640 1 --2- 172.21.15.105:0/1730503743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40181f5850 0x7f40181f1ec0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:07.592 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.590+0000 7f401f332640 1 --2- 172.21.15.105:0/1730503743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4004003a00 0x7f40180c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:07.592 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.590+0000 7f401f332640 1 -- 172.21.15.105:0/1730503743 >> 172.21.15.105:0/1730503743 conn(0x7f401806d7d0 msgr2=0x7f40180ce040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:07.592 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.590+0000 7f401f332640 1 -- 172.21.15.105:0/1730503743 shutdown_connections 2024-09-21T03:25:07.592 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.590+0000 7f401f332640 1 -- 172.21.15.105:0/1730503743 wait complete. 2024-09-21T03:25:07.603 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T03:25:07.719 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.717+0000 7f38f37b0640 1 -- 172.21.15.105:0/2370848087 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38d8004800 msgr2=0x7f38d8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:07.719 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.717+0000 7f38f37b0640 1 --2- 172.21.15.105:0/2370848087 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38d8004800 0x7f38d8004c10 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f38dc001050 tx=0x7f38d8005830 comp rx=0 tx=0).stop 2024-09-21T03:25:07.719 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.717+0000 7f38f1d4d640 1 -- 172.21.15.105:0/2370848087 reap_dead start 2024-09-21T03:25:07.719 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.717+0000 7f38f37b0640 1 -- 172.21.15.105:0/2370848087 shutdown_connections 2024-09-21T03:25:07.719 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.717+0000 7f38f37b0640 1 -- 172.21.15.105:0/2370848087 >> 172.21.15.105:0/2370848087 conn(0x7f38ec06d550 msgr2=0x7f38ec071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:07.719 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.717+0000 7f38f37b0640 1 -- 172.21.15.105:0/2370848087 shutdown_connections 2024-09-21T03:25:07.719 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.717+0000 7f38f37b0640 1 -- 172.21.15.105:0/2370848087 wait complete. 2024-09-21T03:25:07.720 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.719+0000 7f38f37b0640 1 Processor -- start 2024-09-21T03:25:07.720 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.719+0000 7f38f37b0640 1 -- start start 2024-09-21T03:25:07.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.720+0000 7f38f37b0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38d8004800 0x7f38ec151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:07.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.720+0000 7f38f37b0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38ec0b21a0 0x7f38ec0b7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:07.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.720+0000 7f38f37b0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38ec0b7b80 0x7f38ec0c6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:07.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.720+0000 7f38f37b0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f38ec1612c0 con 0x7f38ec0b21a0 2024-09-21T03:25:07.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.720+0000 7f38f37b0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f38ec161140 con 0x7f38ec0b7b80 2024-09-21T03:25:07.724 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.720+0000 7f38f37b0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f38ec0d05d0 con 0x7f38d8004800 2024-09-21T03:25:07.724 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.720+0000 7f38f0d4b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38ec0b21a0 0x7f38ec0b7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:07.724 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.720+0000 7f38f0d4b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38ec0b21a0 0x7f38ec0b7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:44726/0 (socket says 172.21.15.105:44726) 2024-09-21T03:25:07.724 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.720+0000 7f38f0d4b640 1 -- 172.21.15.105:0/2404067660 learned_addr learned my addr 172.21.15.105:0/2404067660 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:07.724 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.720+0000 7f38f1d4d640 1 --2- 172.21.15.105:0/2404067660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38ec0b7b80 0x7f38ec0c6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:07.724 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.720+0000 7f38f154c640 1 --2- 172.21.15.105:0/2404067660 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38d8004800 0x7f38ec151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:07.724 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.720+0000 7f38f0d4b640 1 -- 172.21.15.105:0/2404067660 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38d8004800 msgr2=0x7f38ec151c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:07.724 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.720+0000 7f38f0d4b640 1 --2- 172.21.15.105:0/2404067660 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38d8004800 0x7f38ec151c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:07.724 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.720+0000 7f38f0d4b640 1 -- 172.21.15.105:0/2404067660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38ec0b7b80 msgr2=0x7f38ec0c6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:07.724 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.720+0000 7f38f0d4b640 1 --2- 172.21.15.105:0/2404067660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38ec0b7b80 0x7f38ec0c6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:07.724 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.720+0000 7f38f0d4b640 1 -- 172.21.15.105:0/2404067660 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38ec152140 con 0x7f38ec0b21a0 2024-09-21T03:25:07.724 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.721+0000 7f38f0d4b640 1 --2- 172.21.15.105:0/2404067660 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38ec0b21a0 0x7f38ec0b7640 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f38dc000f60 tx=0x7f38dc006310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:07.724 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.721+0000 7f38e1ffb640 1 -- 172.21.15.105:0/2404067660 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38dc039070 con 0x7f38ec0b21a0 2024-09-21T03:25:07.724 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.721+0000 7f38e1ffb640 1 -- 172.21.15.105:0/2404067660 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38dc006710 con 0x7f38ec0b21a0 2024-09-21T03:25:07.725 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.721+0000 7f38e1ffb640 1 -- 172.21.15.105:0/2404067660 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38dc02bbb0 con 0x7f38ec0b21a0 2024-09-21T03:25:07.725 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.721+0000 7f38f37b0640 1 -- 172.21.15.105:0/2404067660 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38ec0b7f90 con 0x7f38ec0b21a0 2024-09-21T03:25:07.725 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.721+0000 7f38f37b0640 1 -- 172.21.15.105:0/2404067660 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38ec1f6fe0 con 0x7f38ec0b21a0 2024-09-21T03:25:07.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.722+0000 7f38f37b0640 1 -- 172.21.15.105:0/2404067660 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38ec0cf100 con 0x7f38ec0b21a0 2024-09-21T03:25:07.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.723+0000 7f38e1ffb640 1 -- 172.21.15.105:0/2404067660 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f38dc044020 con 0x7f38ec0b21a0 2024-09-21T03:25:07.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.723+0000 7f38e1ffb640 1 --2- 172.21.15.105:0/2404067660 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f38d0078bc0 0x7f38d007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:07.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.723+0000 7f38e1ffb640 1 -- 172.21.15.105:0/2404067660 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f38dc0ba570 con 0x7f38ec0b21a0 2024-09-21T03:25:07.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.723+0000 7f38f154c640 1 --2- 172.21.15.105:0/2404067660 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f38d0078bc0 0x7f38d007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:07.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.724+0000 7f38f154c640 1 --2- 172.21.15.105:0/2404067660 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f38d0078bc0 0x7f38d007b0d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f38e8009a30 tx=0x7f38e8005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:07.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.728+0000 7f38e1ffb640 1 -- 172.21.15.105:0/2404067660 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f38ec0b7f90 con 0x7f38ec0b21a0 2024-09-21T03:25:07.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.941+0000 7f38f37b0640 1 -- 172.21.15.105:0/2404067660 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f38ec0d10c0 con 0x7f38ec0b21a0 2024-09-21T03:25:07.951 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.949+0000 7f38e1ffb640 1 -- 172.21.15.105:0/2404067660 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v64) ==== 118+0+0 (secure 0 0 0) 0x7f38ec152140 con 0x7f38ec0b21a0 2024-09-21T03:25:07.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.951+0000 7f38f37b0640 1 -- 172.21.15.105:0/2404067660 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f38d0078bc0 msgr2=0x7f38d007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:07.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.952+0000 7f38f37b0640 1 --2- 172.21.15.105:0/2404067660 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f38d0078bc0 0x7f38d007b0d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f38e8009a30 tx=0x7f38e8005f90 comp rx=0 tx=0).stop 2024-09-21T03:25:07.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.952+0000 7f38f37b0640 1 -- 172.21.15.105:0/2404067660 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38ec0b21a0 msgr2=0x7f38ec0b7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:07.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.952+0000 7f38f37b0640 1 --2- 172.21.15.105:0/2404067660 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38ec0b21a0 0x7f38ec0b7640 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f38dc000f60 tx=0x7f38dc006310 comp rx=0 tx=0).stop 2024-09-21T03:25:07.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.952+0000 7f38f37b0640 1 -- 172.21.15.105:0/2404067660 shutdown_connections 2024-09-21T03:25:07.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.952+0000 7f38f37b0640 1 --2- 172.21.15.105:0/2404067660 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f38d0078bc0 0x7f38d007b0d0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:07.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.952+0000 7f38f37b0640 1 --2- 172.21.15.105:0/2404067660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38ec0b7b80 0x7f38ec0c6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:07.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.952+0000 7f38f37b0640 1 --2- 172.21.15.105:0/2404067660 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38ec0b21a0 0x7f38ec0b7640 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:07.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.952+0000 7f38f37b0640 1 --2- 172.21.15.105:0/2404067660 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38d8004800 0x7f38ec151c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:07.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.952+0000 7f38f37b0640 1 -- 172.21.15.105:0/2404067660 >> 172.21.15.105:0/2404067660 conn(0x7f38ec06d550 msgr2=0x7f38ec071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:07.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.952+0000 7f38f37b0640 1 -- 172.21.15.105:0/2404067660 shutdown_connections 2024-09-21T03:25:07.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:07.952+0000 7f38f37b0640 1 -- 172.21.15.105:0/2404067660 wait complete. 2024-09-21T03:25:07.964 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T03:25:07.965 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T03:25:08.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.078+0000 7f9a2455f640 1 -- 172.21.15.105:0/1112086503 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a1c156f40 msgr2=0x7f9a1c15d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:08.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.078+0000 7f9a2455f640 1 --2- 172.21.15.105:0/1112086503 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a1c156f40 0x7f9a1c15d8f0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c15d5e0 tx=0x7f9a0c02a560 comp rx=0 tx=0).stop 2024-09-21T03:25:08.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.078+0000 7f9a2455f640 1 -- 172.21.15.105:0/1112086503 shutdown_connections 2024-09-21T03:25:08.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.078+0000 7f9a2455f640 1 --2- 172.21.15.105:0/1112086503 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a1c156f40 0x7f9a1c15d8f0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:08.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.078+0000 7f9a2455f640 1 --2- 172.21.15.105:0/1112086503 >> v2:172.21.15.162:3300/0 conn(0x7f9a1c0cd3a0 0x7f9a1c160f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:08.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.078+0000 7f9a2455f640 1 -- 172.21.15.105:0/1112086503 >> 172.21.15.105:0/1112086503 conn(0x7f9a1c06d550 msgr2=0x7f9a1c071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:08.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.078+0000 7f9a2455f640 1 -- 172.21.15.105:0/1112086503 shutdown_connections 2024-09-21T03:25:08.080 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.078+0000 7f9a2455f640 1 -- 172.21.15.105:0/1112086503 wait complete. 2024-09-21T03:25:08.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.080+0000 7f9a2455f640 1 Processor -- start 2024-09-21T03:25:08.081 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.080+0000 7f9a2455f640 1 -- start start 2024-09-21T03:25:08.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.081+0000 7f9a2455f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a1c0cd3a0 0x7f9a1c157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:08.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.081+0000 7f9a2455f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a1c0cecf0 0x7f9a1c0b3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:08.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.081+0000 7f9a2455f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a1c156f40 0x7f9a1c0b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:08.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.081+0000 7f9a2455f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1c0d09e0 con 0x7f9a1c0cecf0 2024-09-21T03:25:08.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.081+0000 7f9a2455f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1c0d0860 con 0x7f9a1c156f40 2024-09-21T03:25:08.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.081+0000 7f9a2455f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9a1c0d0b60 con 0x7f9a1c0cd3a0 2024-09-21T03:25:08.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.081+0000 7f9a21afa640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a1c0cecf0 0x7f9a1c0b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:08.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.081+0000 7f9a21afa640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a1c0cecf0 0x7f9a1c0b3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:44752/0 (socket says 172.21.15.105:44752) 2024-09-21T03:25:08.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.081+0000 7f9a21afa640 1 -- 172.21.15.105:0/4025309606 learned_addr learned my addr 172.21.15.105:0/4025309606 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:08.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.082+0000 7f9a21afa640 1 -- 172.21.15.105:0/4025309606 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a1c0cd3a0 msgr2=0x7f9a1c157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:08.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.082+0000 7f9a21afa640 1 --2- 172.21.15.105:0/4025309606 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a1c0cd3a0 0x7f9a1c157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:08.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.082+0000 7f9a22afc640 1 --2- 172.21.15.105:0/4025309606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a1c156f40 0x7f9a1c0b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:08.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.082+0000 7f9a21afa640 1 -- 172.21.15.105:0/4025309606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a1c156f40 msgr2=0x7f9a1c0b3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:08.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.082+0000 7f9a21afa640 1 --2- 172.21.15.105:0/4025309606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a1c156f40 0x7f9a1c0b3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:08.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.082+0000 7f9a21afa640 1 -- 172.21.15.105:0/4025309606 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a1c158130 con 0x7f9a1c0cecf0 2024-09-21T03:25:08.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.082+0000 7f9a22afc640 1 --2- 172.21.15.105:0/4025309606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a1c156f40 0x7f9a1c0b3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:25:08.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.082+0000 7f9a21afa640 1 --2- 172.21.15.105:0/4025309606 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a1c0cecf0 0x7f9a1c0b3930 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c034040 tx=0x7f9a0c0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:08.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.082+0000 7f9a12ffd640 1 -- 172.21.15.105:0/4025309606 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c03e030 con 0x7f9a1c0cecf0 2024-09-21T03:25:08.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.082+0000 7f9a12ffd640 1 -- 172.21.15.105:0/4025309606 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a0c0047a0 con 0x7f9a1c0cecf0 2024-09-21T03:25:08.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.082+0000 7f9a2455f640 1 -- 172.21.15.105:0/4025309606 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a1c15afe0 con 0x7f9a1c0cecf0 2024-09-21T03:25:08.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.082+0000 7f9a12ffd640 1 -- 172.21.15.105:0/4025309606 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c035040 con 0x7f9a1c0cecf0 2024-09-21T03:25:08.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.082+0000 7f9a2455f640 1 -- 172.21.15.105:0/4025309606 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a1c15b5a0 con 0x7f9a1c0cecf0 2024-09-21T03:25:08.086 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.083+0000 7f9a2455f640 1 -- 172.21.15.105:0/4025309606 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a1c15ad50 con 0x7f9a1c0cecf0 2024-09-21T03:25:08.086 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.084+0000 7f9a12ffd640 1 -- 172.21.15.105:0/4025309606 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9a0c041030 con 0x7f9a1c0cecf0 2024-09-21T03:25:08.086 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.084+0000 7f9a12ffd640 1 --2- 172.21.15.105:0/4025309606 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9a00078bc0 0x7f9a0007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:08.086 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.084+0000 7f9a12ffd640 1 -- 172.21.15.105:0/4025309606 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f9a0c0bb620 con 0x7f9a1c0cecf0 2024-09-21T03:25:08.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.084+0000 7f9a222fb640 1 --2- 172.21.15.105:0/4025309606 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9a00078bc0 0x7f9a0007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:08.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.085+0000 7f9a222fb640 1 --2- 172.21.15.105:0/4025309606 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9a00078bc0 0x7f9a0007b0d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f9a1800a8f0 tx=0x7f9a18005bd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:08.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.089+0000 7f9a12ffd640 1 -- 172.21.15.105:0/4025309606 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9a0c083a70 con 0x7f9a1c0cecf0 2024-09-21T03:25:08.303 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.302+0000 7f9a2455f640 1 -- 172.21.15.105:0/4025309606 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f9a1c0d10c0 con 0x7f9a1c0cecf0 2024-09-21T03:25:08.922 INFO:tasks.ceph.mds.a.smithi105.stderr:2024-09-21T03:25:08.920+0000 7f62e6998640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T03:25:08.957 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.955+0000 7f9a12ffd640 1 -- 172.21.15.105:0/4025309606 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v65) ==== 122+0+0 (secure 0 0 0) 0x7f9a0c083370 con 0x7f9a1c0cecf0 2024-09-21T03:25:08.960 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.958+0000 7f9a2455f640 1 -- 172.21.15.105:0/4025309606 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9a00078bc0 msgr2=0x7f9a0007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:08.960 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.958+0000 7f9a2455f640 1 --2- 172.21.15.105:0/4025309606 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9a00078bc0 0x7f9a0007b0d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f9a1800a8f0 tx=0x7f9a18005bd0 comp rx=0 tx=0).stop 2024-09-21T03:25:08.960 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.958+0000 7f9a2455f640 1 -- 172.21.15.105:0/4025309606 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a1c0cecf0 msgr2=0x7f9a1c0b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:08.960 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.958+0000 7f9a2455f640 1 --2- 172.21.15.105:0/4025309606 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a1c0cecf0 0x7f9a1c0b3930 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c034040 tx=0x7f9a0c0039e0 comp rx=0 tx=0).stop 2024-09-21T03:25:08.960 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.958+0000 7f9a2455f640 1 -- 172.21.15.105:0/4025309606 shutdown_connections 2024-09-21T03:25:08.960 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.958+0000 7f9a2455f640 1 --2- 172.21.15.105:0/4025309606 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9a00078bc0 0x7f9a0007b0d0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:08.960 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.958+0000 7f9a2455f640 1 --2- 172.21.15.105:0/4025309606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a1c156f40 0x7f9a1c0b3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:08.960 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.958+0000 7f9a2455f640 1 --2- 172.21.15.105:0/4025309606 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a1c0cecf0 0x7f9a1c0b3930 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:08.961 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.958+0000 7f9a2455f640 1 --2- 172.21.15.105:0/4025309606 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a1c0cd3a0 0x7f9a1c157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:08.961 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.958+0000 7f9a2455f640 1 -- 172.21.15.105:0/4025309606 >> 172.21.15.105:0/4025309606 conn(0x7f9a1c06d550 msgr2=0x7f9a1c0b6110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:08.961 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.958+0000 7f9a2455f640 1 -- 172.21.15.105:0/4025309606 shutdown_connections 2024-09-21T03:25:08.961 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:08.958+0000 7f9a2455f640 1 -- 172.21.15.105:0/4025309606 wait complete. 2024-09-21T03:25:08.973 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T03:25:08.973 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:25:09.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.088+0000 7fc6f8430640 1 -- 172.21.15.105:0/2541036728 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6f015b6a0 msgr2=0x7fc6f00b5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:09.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.088+0000 7fc6f8430640 1 --2- 172.21.15.105:0/2541036728 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6f015b6a0 0x7fc6f00b5250 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fc6f00cdb20 tx=0x7fc6ec02a530 comp rx=0 tx=0).stop 2024-09-21T03:25:09.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.088+0000 7fc6f8430640 1 -- 172.21.15.105:0/2541036728 shutdown_connections 2024-09-21T03:25:09.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.088+0000 7fc6f8430640 1 --2- 172.21.15.105:0/2541036728 >> v2:172.21.15.162:3300/0 conn(0x7fc6f00cf0d0 0x7fc6f00b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:09.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.088+0000 7fc6f8430640 1 --2- 172.21.15.105:0/2541036728 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6f015b6a0 0x7fc6f00b5250 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:09.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.088+0000 7fc6f8430640 1 -- 172.21.15.105:0/2541036728 >> 172.21.15.105:0/2541036728 conn(0x7fc6f00b2160 msgr2=0x7fc6f00b2570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:09.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.088+0000 7fc6f8430640 1 -- 172.21.15.105:0/2541036728 shutdown_connections 2024-09-21T03:25:09.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.088+0000 7fc6f8430640 1 -- 172.21.15.105:0/2541036728 wait complete. 2024-09-21T03:25:09.091 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.089+0000 7fc6f8430640 1 Processor -- start 2024-09-21T03:25:09.091 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.090+0000 7fc6f8430640 1 -- start start 2024-09-21T03:25:09.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.091+0000 7fc6f8430640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6f00cf0d0 0x7fc6f01f6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:09.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.091+0000 7fc6f8430640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc6f00cf4e0 0x7fc6f0140c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:09.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.091+0000 7fc6f8430640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6f015b6a0 0x7fc6f0143ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:09.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.091+0000 7fc6f8430640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f006ff70 con 0x7fc6f00cf0d0 2024-09-21T03:25:09.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.091+0000 7fc6f8430640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f006fdf0 con 0x7fc6f015b6a0 2024-09-21T03:25:09.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.091+0000 7fc6f8430640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc6f00700f0 con 0x7fc6f00cf4e0 2024-09-21T03:25:09.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.091+0000 7fc6f61cc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6f00cf0d0 0x7fc6f01f6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:09.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.091+0000 7fc6f61cc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6f00cf0d0 0x7fc6f01f6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:44764/0 (socket says 172.21.15.105:44764) 2024-09-21T03:25:09.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.091+0000 7fc6f61cc640 1 -- 172.21.15.105:0/2128969121 learned_addr learned my addr 172.21.15.105:0/2128969121 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:09.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.091+0000 7fc6f69cd640 1 --2- 172.21.15.105:0/2128969121 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6f015b6a0 0x7fc6f0143ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:09.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.091+0000 7fc6f59cb640 1 --2- 172.21.15.105:0/2128969121 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc6f00cf4e0 0x7fc6f0140c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:09.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.091+0000 7fc6f61cc640 1 -- 172.21.15.105:0/2128969121 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc6f00cf4e0 msgr2=0x7fc6f0140c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:09.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.091+0000 7fc6f61cc640 1 --2- 172.21.15.105:0/2128969121 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc6f00cf4e0 0x7fc6f0140c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:09.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.091+0000 7fc6f61cc640 1 -- 172.21.15.105:0/2128969121 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6f015b6a0 msgr2=0x7fc6f0143ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:09.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.091+0000 7fc6f61cc640 1 --2- 172.21.15.105:0/2128969121 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6f015b6a0 0x7fc6f0143ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:09.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.091+0000 7fc6f61cc640 1 -- 172.21.15.105:0/2128969121 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f01f74d0 con 0x7fc6f00cf0d0 2024-09-21T03:25:09.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.091+0000 7fc6f59cb640 1 --2- 172.21.15.105:0/2128969121 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc6f00cf4e0 0x7fc6f0140c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:25:09.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.091+0000 7fc6f61cc640 1 --2- 172.21.15.105:0/2128969121 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6f00cf0d0 0x7fc6f01f6b60 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec02ab20 tx=0x7fc6ec033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:09.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.091+0000 7fc6e6ffd640 1 -- 172.21.15.105:0/2128969121 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec031d60 con 0x7fc6f00cf0d0 2024-09-21T03:25:09.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.092+0000 7fc6e6ffd640 1 -- 172.21.15.105:0/2128969121 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc6ec033e10 con 0x7fc6f00cf0d0 2024-09-21T03:25:09.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.092+0000 7fc6f8430640 1 -- 172.21.15.105:0/2128969121 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6f01f77b0 con 0x7fc6f00cf0d0 2024-09-21T03:25:09.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.092+0000 7fc6e6ffd640 1 -- 172.21.15.105:0/2128969121 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec005260 con 0x7fc6f00cf0d0 2024-09-21T03:25:09.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.092+0000 7fc6f8430640 1 -- 172.21.15.105:0/2128969121 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6f01439c0 con 0x7fc6f00cf0d0 2024-09-21T03:25:09.096 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.092+0000 7fc6f8430640 1 -- 172.21.15.105:0/2128969121 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6f00b4ec0 con 0x7fc6f00cf0d0 2024-09-21T03:25:09.096 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.093+0000 7fc6e6ffd640 1 -- 172.21.15.105:0/2128969121 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc6ec005400 con 0x7fc6f00cf0d0 2024-09-21T03:25:09.096 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.094+0000 7fc6e6ffd640 1 --2- 172.21.15.105:0/2128969121 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc6d4078bc0 0x7fc6d407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:09.096 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.094+0000 7fc6e6ffd640 1 -- 172.21.15.105:0/2128969121 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7fc6ec0bbf60 con 0x7fc6f00cf0d0 2024-09-21T03:25:09.096 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.094+0000 7fc6f59cb640 1 --2- 172.21.15.105:0/2128969121 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc6d4078bc0 0x7fc6d407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:09.096 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.094+0000 7fc6f59cb640 1 --2- 172.21.15.105:0/2128969121 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc6d4078bc0 0x7fc6d407b0d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc6f00b5180 tx=0x7fc6e0005cb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:09.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.098+0000 7fc6e6ffd640 1 -- 172.21.15.105:0/2128969121 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc6ec03f030 con 0x7fc6f00cf0d0 2024-09-21T03:25:09.310 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.309+0000 7fc6f8430640 1 -- 172.21.15.105:0/2128969121 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6f006f9c0 con 0x7fc6f00cf0d0 2024-09-21T03:25:09.311 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.309+0000 7fc6e6ffd640 1 -- 172.21.15.105:0/2128969121 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) ==== 94+0+5234 (secure 0 0 0) 0x7fc6ec031770 con 0x7fc6f00cf0d0 2024-09-21T03:25:09.311 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:09.311 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":65,"btime":"2024-09-21T03:25:08:950897+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5996,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/1026486886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1026486886},{"type":"v1","addr":"172.21.15.162:6836","nonce":1026486886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1085304139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1085304139},{"type":"v1","addr":"172.21.15.162:6837","nonce":1085304139}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":7161,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/569907499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":569907499},{"type":"v1","addr":"172.21.15.105:6833","nonce":569907499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:25:06.305459+0000","modified":"2024-09-21T03:25:08.303256+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7164},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7164":{"gid":7164,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/2917579803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2917579803},{"type":"v1","addr":"172.21.15.105:6835","nonce":2917579803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7164,"qdb_cluster":[7164]},"id":8}]} 2024-09-21T03:25:09.311 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 65 2024-09-21T03:25:09.313 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.312+0000 7fc6f8430640 1 -- 172.21.15.105:0/2128969121 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc6d4078bc0 msgr2=0x7fc6d407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:09.314 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.312+0000 7fc6f8430640 1 --2- 172.21.15.105:0/2128969121 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc6d4078bc0 0x7fc6d407b0d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc6f00b5180 tx=0x7fc6e0005cb0 comp rx=0 tx=0).stop 2024-09-21T03:25:09.314 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.312+0000 7fc6f8430640 1 -- 172.21.15.105:0/2128969121 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6f00cf0d0 msgr2=0x7fc6f01f6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:09.314 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.312+0000 7fc6f8430640 1 --2- 172.21.15.105:0/2128969121 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6f00cf0d0 0x7fc6f01f6b60 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec02ab20 tx=0x7fc6ec033c20 comp rx=0 tx=0).stop 2024-09-21T03:25:09.314 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.312+0000 7fc6f8430640 1 -- 172.21.15.105:0/2128969121 shutdown_connections 2024-09-21T03:25:09.314 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.312+0000 7fc6f8430640 1 --2- 172.21.15.105:0/2128969121 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc6d4078bc0 0x7fc6d407b0d0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:09.314 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.312+0000 7fc6f8430640 1 --2- 172.21.15.105:0/2128969121 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6f015b6a0 0x7fc6f0143ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:09.314 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.312+0000 7fc6f8430640 1 --2- 172.21.15.105:0/2128969121 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc6f00cf4e0 0x7fc6f0140c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:09.314 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.312+0000 7fc6f8430640 1 --2- 172.21.15.105:0/2128969121 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6f00cf0d0 0x7fc6f01f6b60 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:09.314 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.312+0000 7fc6f8430640 1 -- 172.21.15.105:0/2128969121 >> 172.21.15.105:0/2128969121 conn(0x7fc6f00b2160 msgr2=0x7fc6f015c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:09.314 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.312+0000 7fc6f8430640 1 -- 172.21.15.105:0/2128969121 shutdown_connections 2024-09-21T03:25:09.314 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.312+0000 7fc6f8430640 1 -- 172.21.15.105:0/2128969121 wait complete. 2024-09-21T03:25:09.324 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:25:09.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.437+0000 7f1ecb670640 1 -- 172.21.15.105:0/1365836823 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1eb0004e60 msgr2=0x7f1eb00052b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:09.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.437+0000 7f1ecb670640 1 --2- 172.21.15.105:0/1365836823 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1eb0004e60 0x7f1eb00052b0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4073940 tx=0x7f1eb0005830 comp rx=0 tx=0).stop 2024-09-21T03:25:09.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.437+0000 7f1ec9c0d640 1 -- 172.21.15.105:0/1365836823 reap_dead start 2024-09-21T03:25:09.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.437+0000 7f1ecb670640 1 -- 172.21.15.105:0/1365836823 shutdown_connections 2024-09-21T03:25:09.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.437+0000 7f1ecb670640 1 -- 172.21.15.105:0/1365836823 >> 172.21.15.105:0/1365836823 conn(0x7f1ec406def0 msgr2=0x7f1ec406e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:09.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.437+0000 7f1ecb670640 1 -- 172.21.15.105:0/1365836823 shutdown_connections 2024-09-21T03:25:09.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.437+0000 7f1ecb670640 1 -- 172.21.15.105:0/1365836823 wait complete. 2024-09-21T03:25:09.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.439+0000 7f1ecb670640 1 Processor -- start 2024-09-21T03:25:09.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.439+0000 7f1ecb670640 1 -- start start 2024-09-21T03:25:09.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.440+0000 7f1ecb670640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1eb0004e60 0x7f1ec406cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:09.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.440+0000 7f1ecb670640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ec406d500 0x7f1ec41f6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:09.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.440+0000 7f1ecb670640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ec41f6ad0 0x7f1ec4146d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:09.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.440+0000 7f1ecb670640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec40b4e30 con 0x7f1ec406d500 2024-09-21T03:25:09.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.440+0000 7f1ecb670640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec40b4cb0 con 0x7f1ec41f6ad0 2024-09-21T03:25:09.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.440+0000 7f1ecb670640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1ec40b4fb0 con 0x7f1eb0004e60 2024-09-21T03:25:09.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.440+0000 7f1ec8c0b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ec406d500 0x7f1ec41f6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:09.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.440+0000 7f1ec8c0b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ec406d500 0x7f1ec41f6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:44772/0 (socket says 172.21.15.105:44772) 2024-09-21T03:25:09.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.440+0000 7f1ec8c0b640 1 -- 172.21.15.105:0/376075146 learned_addr learned my addr 172.21.15.105:0/376075146 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:09.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.440+0000 7f1ec9c0d640 1 --2- 172.21.15.105:0/376075146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ec41f6ad0 0x7f1ec4146d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:09.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.440+0000 7f1ec940c640 1 --2- 172.21.15.105:0/376075146 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1eb0004e60 0x7f1ec406cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:09.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.440+0000 7f1ec8c0b640 1 -- 172.21.15.105:0/376075146 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1eb0004e60 msgr2=0x7f1ec406cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:09.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.440+0000 7f1ec8c0b640 1 --2- 172.21.15.105:0/376075146 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1eb0004e60 0x7f1ec406cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:09.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.440+0000 7f1ec8c0b640 1 -- 172.21.15.105:0/376075146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ec41f6ad0 msgr2=0x7f1ec4146d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:09.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.440+0000 7f1ec8c0b640 1 --2- 172.21.15.105:0/376075146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ec41f6ad0 0x7f1ec4146d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:09.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.440+0000 7f1ec8c0b640 1 -- 172.21.15.105:0/376075146 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ec41449b0 con 0x7f1ec406d500 2024-09-21T03:25:09.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.441+0000 7f1ec8c0b640 1 --2- 172.21.15.105:0/376075146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ec406d500 0x7f1ec41f6590 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4004ea0 tx=0x7f1eb4004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:09.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.441+0000 7f1eb9ffb640 1 -- 172.21.15.105:0/376075146 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb4015020 con 0x7f1ec406d500 2024-09-21T03:25:09.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.441+0000 7f1eb9ffb640 1 -- 172.21.15.105:0/376075146 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1eb4011870 con 0x7f1ec406d500 2024-09-21T03:25:09.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.441+0000 7f1eb9ffb640 1 -- 172.21.15.105:0/376075146 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb4011ca0 con 0x7f1ec406d500 2024-09-21T03:25:09.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.441+0000 7f1ecb670640 1 -- 172.21.15.105:0/376075146 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ec41f72c0 con 0x7f1ec406d500 2024-09-21T03:25:09.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.441+0000 7f1ecb670640 1 -- 172.21.15.105:0/376075146 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ec41464f0 con 0x7f1ec406d500 2024-09-21T03:25:09.445 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.442+0000 7f1ecb670640 1 -- 172.21.15.105:0/376075146 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ec41f7030 con 0x7f1ec406d500 2024-09-21T03:25:09.445 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.442+0000 7f1eb9ffb640 1 -- 172.21.15.105:0/376075146 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1eb4018020 con 0x7f1ec406d500 2024-09-21T03:25:09.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.443+0000 7f1eb9ffb640 1 --2- 172.21.15.105:0/376075146 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1ea8078b90 0x7f1ea807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:09.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.443+0000 7f1eb9ffb640 1 -- 172.21.15.105:0/376075146 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f1eb409b720 con 0x7f1ec406d500 2024-09-21T03:25:09.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.443+0000 7f1ec940c640 1 --2- 172.21.15.105:0/376075146 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1ea8078b90 0x7f1ea807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:09.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.444+0000 7f1ec940c640 1 --2- 172.21.15.105:0/376075146 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1ea8078b90 0x7f1ea807b0a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0005d80 tx=0x7f1ec0005d10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:09.449 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.447+0000 7f1eb9ffb640 1 -- 172.21.15.105:0/376075146 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1eb401f020 con 0x7f1ec406d500 2024-09-21T03:25:09.627 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.625+0000 7f1ecb670640 1 -- 172.21.15.105:0/376075146 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1ec40d20c0 con 0x7f1ec406d500 2024-09-21T03:25:09.628 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.626+0000 7f1eb9ffb640 1 -- 172.21.15.105:0/376075146 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) ==== 74+0+16759 (secure 0 0 0) 0x7f1ec40d20c0 con 0x7f1ec406d500 2024-09-21T03:25:09.629 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:09.629 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":104,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:25:07.945542+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:25:03.944314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-21T03:25:05.269304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:25:09.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.629+0000 7f1ecb670640 1 -- 172.21.15.105:0/376075146 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1ea8078b90 msgr2=0x7f1ea807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:09.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.629+0000 7f1ecb670640 1 --2- 172.21.15.105:0/376075146 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1ea8078b90 0x7f1ea807b0a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0005d80 tx=0x7f1ec0005d10 comp rx=0 tx=0).stop 2024-09-21T03:25:09.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.629+0000 7f1ecb670640 1 -- 172.21.15.105:0/376075146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ec406d500 msgr2=0x7f1ec41f6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:09.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.629+0000 7f1ecb670640 1 --2- 172.21.15.105:0/376075146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ec406d500 0x7f1ec41f6590 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4004ea0 tx=0x7f1eb4004f90 comp rx=0 tx=0).stop 2024-09-21T03:25:09.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.629+0000 7f1ecb670640 1 -- 172.21.15.105:0/376075146 shutdown_connections 2024-09-21T03:25:09.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.629+0000 7f1ecb670640 1 --2- 172.21.15.105:0/376075146 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1ea8078b90 0x7f1ea807b0a0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:09.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.629+0000 7f1ecb670640 1 --2- 172.21.15.105:0/376075146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ec41f6ad0 0x7f1ec4146d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:09.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.629+0000 7f1ecb670640 1 --2- 172.21.15.105:0/376075146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ec406d500 0x7f1ec41f6590 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:09.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.629+0000 7f1ecb670640 1 --2- 172.21.15.105:0/376075146 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1eb0004e60 0x7f1ec406cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:09.632 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.629+0000 7f1ecb670640 1 -- 172.21.15.105:0/376075146 >> 172.21.15.105:0/376075146 conn(0x7f1ec406def0 msgr2=0x7f1ec4070350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:09.632 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.629+0000 7f1ecb670640 1 -- 172.21.15.105:0/376075146 shutdown_connections 2024-09-21T03:25:09.632 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.629+0000 7f1ecb670640 1 -- 172.21.15.105:0/376075146 wait complete. 2024-09-21T03:25:09.642 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T03:25:09.642 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:25:09.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.752+0000 7f1a277c6640 1 -- 172.21.15.105:0/2131313311 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a200cf130 msgr2=0x7f1a20071650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:09.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.752+0000 7f1a277c6640 1 --2- 172.21.15.105:0/2131313311 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a200cf130 0x7f1a20071650 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f1a20072af0 tx=0x7f1a1402a510 comp rx=0 tx=0).stop 2024-09-21T03:25:09.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.752+0000 7f1a277c6640 1 -- 172.21.15.105:0/2131313311 shutdown_connections 2024-09-21T03:25:09.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.752+0000 7f1a277c6640 1 --2- 172.21.15.105:0/2131313311 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1a200b2cb0 0x7f1a200b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:09.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.752+0000 7f1a277c6640 1 --2- 172.21.15.105:0/2131313311 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a200cf130 0x7f1a20071650 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:09.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.752+0000 7f1a277c6640 1 -- 172.21.15.105:0/2131313311 >> 172.21.15.105:0/2131313311 conn(0x7f1a200cdcb0 msgr2=0x7f1a200ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:09.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.752+0000 7f1a277c6640 1 -- 172.21.15.105:0/2131313311 shutdown_connections 2024-09-21T03:25:09.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.752+0000 7f1a277c6640 1 -- 172.21.15.105:0/2131313311 wait complete. 2024-09-21T03:25:09.755 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.754+0000 7f1a277c6640 1 Processor -- start 2024-09-21T03:25:09.755 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.754+0000 7f1a277c6640 1 -- start start 2024-09-21T03:25:09.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.755+0000 7f1a277c6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a200b2cb0 0x7f1a201f3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:09.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.755+0000 7f1a277c6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a200cf130 0x7f1a201e5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:09.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.755+0000 7f1a277c6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1a2015b8f0 0x7f1a2006ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:09.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.755+0000 7f1a277c6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1a200ae330 con 0x7f1a200b2cb0 2024-09-21T03:25:09.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.755+0000 7f1a277c6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1a200ae1b0 con 0x7f1a200cf130 2024-09-21T03:25:09.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.755+0000 7f1a277c6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1a200ae4b0 con 0x7f1a2015b8f0 2024-09-21T03:25:09.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.755+0000 7f1a25562640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a200b2cb0 0x7f1a201f3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:09.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.755+0000 7f1a25562640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a200b2cb0 0x7f1a201f3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:44794/0 (socket says 172.21.15.105:44794) 2024-09-21T03:25:09.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.755+0000 7f1a25562640 1 -- 172.21.15.105:0/3270802550 learned_addr learned my addr 172.21.15.105:0/3270802550 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:09.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.755+0000 7f1a25d63640 1 --2- 172.21.15.105:0/3270802550 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1a2015b8f0 0x7f1a2006ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:09.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.755+0000 7f1a24d61640 1 --2- 172.21.15.105:0/3270802550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a200cf130 0x7f1a201e5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:09.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.755+0000 7f1a25562640 1 -- 172.21.15.105:0/3270802550 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1a2015b8f0 msgr2=0x7f1a2006ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:09.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.755+0000 7f1a25562640 1 --2- 172.21.15.105:0/3270802550 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1a2015b8f0 0x7f1a2006ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:09.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.755+0000 7f1a25562640 1 -- 172.21.15.105:0/3270802550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a200cf130 msgr2=0x7f1a201e5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:09.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.755+0000 7f1a25562640 1 --2- 172.21.15.105:0/3270802550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a200cf130 0x7f1a201e5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:09.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.755+0000 7f1a25562640 1 -- 172.21.15.105:0/3270802550 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a201e5e90 con 0x7f1a200b2cb0 2024-09-21T03:25:09.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.755+0000 7f1a24d61640 1 --2- 172.21.15.105:0/3270802550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a200cf130 0x7f1a201e5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:25:09.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.756+0000 7f1a25562640 1 --2- 172.21.15.105:0/3270802550 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a200b2cb0 0x7f1a201f3550 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f1a1000b420 tx=0x7f1a1000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:09.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.756+0000 7f1a1dffb640 1 -- 172.21.15.105:0/3270802550 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a10011830 con 0x7f1a200b2cb0 2024-09-21T03:25:09.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.756+0000 7f1a1dffb640 1 -- 172.21.15.105:0/3270802550 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1a10016070 con 0x7f1a200b2cb0 2024-09-21T03:25:09.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.756+0000 7f1a277c6640 1 -- 172.21.15.105:0/3270802550 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a201e6170 con 0x7f1a200b2cb0 2024-09-21T03:25:09.760 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.756+0000 7f1a1dffb640 1 -- 172.21.15.105:0/3270802550 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a10011c70 con 0x7f1a200b2cb0 2024-09-21T03:25:09.760 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.756+0000 7f1a277c6640 1 -- 172.21.15.105:0/3270802550 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a201e6730 con 0x7f1a200b2cb0 2024-09-21T03:25:09.760 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.757+0000 7f1a277c6640 1 -- 172.21.15.105:0/3270802550 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a200b30c0 con 0x7f1a200b2cb0 2024-09-21T03:25:09.760 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.758+0000 7f1a1dffb640 1 -- 172.21.15.105:0/3270802550 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1a1001b460 con 0x7f1a200b2cb0 2024-09-21T03:25:09.761 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.758+0000 7f1a1dffb640 1 --2- 172.21.15.105:0/3270802550 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1a0c078b90 0x7f1a0c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:09.761 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.758+0000 7f1a1dffb640 1 -- 172.21.15.105:0/3270802550 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f1a1009a6e0 con 0x7f1a200b2cb0 2024-09-21T03:25:09.761 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.758+0000 7f1a24d61640 1 --2- 172.21.15.105:0/3270802550 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1a0c078b90 0x7f1a0c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:09.761 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.759+0000 7f1a24d61640 1 --2- 172.21.15.105:0/3270802550 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1a0c078b90 0x7f1a0c07b0a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f1a14033000 tx=0x7f1a14004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:09.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.763+0000 7f1a1dffb640 1 -- 172.21.15.105:0/3270802550 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1a10020020 con 0x7f1a200b2cb0 2024-09-21T03:25:09.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.941+0000 7f1a277c6640 1 -- 172.21.15.105:0/3270802550 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1a201f3a90 con 0x7f1a0c078b90 2024-09-21T03:25:09.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.946+0000 7f1a1dffb640 1 -- 172.21.15.105:0/3270802550 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251298 (secure 0 0 0) 0x7f1a201f3a90 con 0x7f1a0c078b90 2024-09-21T03:25:09.950 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:09.951 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:25:09.952 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.949+0000 7f1a277c6640 1 -- 172.21.15.105:0/3270802550 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1a0c078b90 msgr2=0x7f1a0c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:09.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.949+0000 7f1a277c6640 1 --2- 172.21.15.105:0/3270802550 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1a0c078b90 0x7f1a0c07b0a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f1a14033000 tx=0x7f1a14004730 comp rx=0 tx=0).stop 2024-09-21T03:25:09.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.949+0000 7f1a277c6640 1 -- 172.21.15.105:0/3270802550 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a200b2cb0 msgr2=0x7f1a201f3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:09.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.949+0000 7f1a277c6640 1 --2- 172.21.15.105:0/3270802550 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a200b2cb0 0x7f1a201f3550 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f1a1000b420 tx=0x7f1a1000b8e0 comp rx=0 tx=0).stop 2024-09-21T03:25:09.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.949+0000 7f1a277c6640 1 -- 172.21.15.105:0/3270802550 shutdown_connections 2024-09-21T03:25:09.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.949+0000 7f1a277c6640 1 --2- 172.21.15.105:0/3270802550 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1a0c078b90 0x7f1a0c07b0a0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:09.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.949+0000 7f1a277c6640 1 --2- 172.21.15.105:0/3270802550 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1a2015b8f0 0x7f1a2006ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:09.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.949+0000 7f1a277c6640 1 --2- 172.21.15.105:0/3270802550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a200cf130 0x7f1a201e5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:09.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.949+0000 7f1a277c6640 1 --2- 172.21.15.105:0/3270802550 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a200b2cb0 0x7f1a201f3550 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:09.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.949+0000 7f1a277c6640 1 -- 172.21.15.105:0/3270802550 >> 172.21.15.105:0/3270802550 conn(0x7f1a200cdcb0 msgr2=0x7f1a200cbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:09.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.949+0000 7f1a277c6640 1 -- 172.21.15.105:0/3270802550 shutdown_connections 2024-09-21T03:25:09.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:09.949+0000 7f1a277c6640 1 -- 172.21.15.105:0/3270802550 wait complete. 2024-09-21T03:25:09.962 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":304,"stamp":"2024-09-21T03:25:09.386466+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591054,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":134,"num_write_kb":1637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":134,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":264852,"kb_used_data":11144,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754709868,"statfs":{"total":773094113280,"available":772822904832,"internally_reserved":0,"allocated":11411456,"data_stored":5497810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":686,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.457263"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.957598+0000","last_change":"2024-09-21T03:25:05.957598+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.957598+0000","last_undegraded":"2024-09-21T03:25:05.957598+0000","last_fullsized":"2024-09-21T03:25:05.957598+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958208+0000","last_change":"2024-09-21T03:25:06.960292+0000","last_active":"2024-09-21T03:25:07.958208+0000","last_peered":"2024-09-21T03:25:07.958208+0000","last_clean":"2024-09-21T03:25:07.958208+0000","last_became_active":"2024-09-21T03:25:06.959916+0000","last_became_peered":"2024-09-21T03:25:06.959916+0000","last_unstale":"2024-09-21T03:25:07.958208+0000","last_undegraded":"2024-09-21T03:25:07.958208+0000","last_fullsized":"2024-09-21T03:25:07.958208+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:46.004543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954544+0000","last_change":"2024-09-21T03:25:06.950883+0000","last_active":"2024-09-21T03:25:07.954544+0000","last_peered":"2024-09-21T03:25:07.954544+0000","last_clean":"2024-09-21T03:25:07.954544+0000","last_became_active":"2024-09-21T03:25:06.948632+0000","last_became_peered":"2024-09-21T03:25:06.948632+0000","last_unstale":"2024-09-21T03:25:07.954544+0000","last_undegraded":"2024-09-21T03:25:07.954544+0000","last_fullsized":"2024-09-21T03:25:07.954544+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:46.652368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.957630+0000","last_change":"2024-09-21T03:25:05.957630+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.957630+0000","last_undegraded":"2024-09-21T03:25:05.957630+0000","last_fullsized":"2024-09-21T03:25:05.957630+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.955650+0000","last_change":"2024-09-21T03:25:06.953631+0000","last_active":"2024-09-21T03:25:06.955650+0000","last_peered":"2024-09-21T03:25:06.955650+0000","last_clean":"2024-09-21T03:25:06.955650+0000","last_became_active":"2024-09-21T03:25:06.953277+0000","last_became_peered":"2024-09-21T03:25:06.953277+0000","last_unstale":"2024-09-21T03:25:06.955650+0000","last_undegraded":"2024-09-21T03:25:06.955650+0000","last_fullsized":"2024-09-21T03:25:06.955650+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:41.069474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.959528+0000","last_change":"2024-09-21T03:25:06.957920+0000","last_active":"2024-09-21T03:25:06.959528+0000","last_peered":"2024-09-21T03:25:06.959528+0000","last_clean":"2024-09-21T03:25:06.959528+0000","last_became_active":"2024-09-21T03:25:06.957312+0000","last_became_peered":"2024-09-21T03:25:06.957312+0000","last_unstale":"2024-09-21T03:25:06.959528+0000","last_undegraded":"2024-09-21T03:25:06.959528+0000","last_fullsized":"2024-09-21T03:25:06.959528+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:59:38.300937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.961126+0000","last_change":"2024-09-21T03:25:06.955776+0000","last_active":"2024-09-21T03:25:06.961126+0000","last_peered":"2024-09-21T03:25:06.961126+0000","last_clean":"2024-09-21T03:25:06.961126+0000","last_became_active":"2024-09-21T03:25:06.955407+0000","last_became_peered":"2024-09-21T03:25:06.955407+0000","last_unstale":"2024-09-21T03:25:06.961126+0000","last_undegraded":"2024-09-21T03:25:06.961126+0000","last_fullsized":"2024-09-21T03:25:06.961126+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:12.663157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954048+0000","last_change":"2024-09-21T03:25:06.958844+0000","last_active":"2024-09-21T03:25:07.954048+0000","last_peered":"2024-09-21T03:25:07.954048+0000","last_clean":"2024-09-21T03:25:07.954048+0000","last_became_active":"2024-09-21T03:25:06.958516+0000","last_became_peered":"2024-09-21T03:25:06.958516+0000","last_unstale":"2024-09-21T03:25:07.954048+0000","last_undegraded":"2024-09-21T03:25:07.954048+0000","last_fullsized":"2024-09-21T03:25:07.954048+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:13.569228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.957055+0000","last_change":"2024-09-21T03:25:05.957055+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.957055+0000","last_undegraded":"2024-09-21T03:25:05.957055+0000","last_fullsized":"2024-09-21T03:25:05.957055+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.956508+0000","last_change":"2024-09-21T03:25:05.956508+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.956508+0000","last_undegraded":"2024-09-21T03:25:05.956508+0000","last_fullsized":"2024-09-21T03:25:05.956508+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.959300+0000","last_change":"2024-09-21T03:25:06.951779+0000","last_active":"2024-09-21T03:25:07.959300+0000","last_peered":"2024-09-21T03:25:07.959300+0000","last_clean":"2024-09-21T03:25:07.959300+0000","last_became_active":"2024-09-21T03:25:06.951424+0000","last_became_peered":"2024-09-21T03:25:06.951424+0000","last_unstale":"2024-09-21T03:25:07.959300+0000","last_undegraded":"2024-09-21T03:25:07.959300+0000","last_fullsized":"2024-09-21T03:25:07.959300+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:45.933380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.956841+0000","last_change":"2024-09-21T03:25:05.956841+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.956841+0000","last_undegraded":"2024-09-21T03:25:05.956841+0000","last_fullsized":"2024-09-21T03:25:05.956841+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954480+0000","last_change":"2024-09-21T03:25:06.957896+0000","last_active":"2024-09-21T03:25:07.954480+0000","last_peered":"2024-09-21T03:25:07.954480+0000","last_clean":"2024-09-21T03:25:07.954480+0000","last_became_active":"2024-09-21T03:25:06.957553+0000","last_became_peered":"2024-09-21T03:25:06.957553+0000","last_unstale":"2024-09-21T03:25:07.954480+0000","last_undegraded":"2024-09-21T03:25:07.954480+0000","last_fullsized":"2024-09-21T03:25:07.954480+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:57.501083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954067+0000","last_change":"2024-09-21T03:25:06.956034+0000","last_active":"2024-09-21T03:25:07.954067+0000","last_peered":"2024-09-21T03:25:07.954067+0000","last_clean":"2024-09-21T03:25:07.954067+0000","last_became_active":"2024-09-21T03:25:06.955669+0000","last_became_peered":"2024-09-21T03:25:06.955669+0000","last_unstale":"2024-09-21T03:25:07.954067+0000","last_undegraded":"2024-09-21T03:25:07.954067+0000","last_fullsized":"2024-09-21T03:25:07.954067+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:33.027782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.961407+0000","last_change":"2024-09-21T03:25:06.955229+0000","last_active":"2024-09-21T03:25:06.961407+0000","last_peered":"2024-09-21T03:25:06.961407+0000","last_clean":"2024-09-21T03:25:06.961407+0000","last_became_active":"2024-09-21T03:25:06.954918+0000","last_became_peered":"2024-09-21T03:25:06.954918+0000","last_unstale":"2024-09-21T03:25:06.961407+0000","last_undegraded":"2024-09-21T03:25:06.961407+0000","last_fullsized":"2024-09-21T03:25:06.961407+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:53:15.188760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.954927+0000","last_change":"2024-09-21T03:25:05.954927+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.954927+0000","last_undegraded":"2024-09-21T03:25:05.954927+0000","last_fullsized":"2024-09-21T03:25:05.954927+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958041+0000","last_change":"2024-09-21T03:25:06.948574+0000","last_active":"2024-09-21T03:25:07.958041+0000","last_peered":"2024-09-21T03:25:07.958041+0000","last_clean":"2024-09-21T03:25:07.958041+0000","last_became_active":"2024-09-21T03:25:06.948291+0000","last_became_peered":"2024-09-21T03:25:06.948291+0000","last_unstale":"2024-09-21T03:25:07.958041+0000","last_undegraded":"2024-09-21T03:25:07.958041+0000","last_fullsized":"2024-09-21T03:25:07.958041+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:23.103570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958690+0000","last_change":"2024-09-21T03:25:06.943830+0000","last_active":"2024-09-21T03:25:07.958690+0000","last_peered":"2024-09-21T03:25:07.958690+0000","last_clean":"2024-09-21T03:25:07.958690+0000","last_became_active":"2024-09-21T03:25:06.943492+0000","last_became_peered":"2024-09-21T03:25:06.943492+0000","last_unstale":"2024-09-21T03:25:07.958690+0000","last_undegraded":"2024-09-21T03:25:07.958690+0000","last_fullsized":"2024-09-21T03:25:07.958690+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:58.003935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954528+0000","last_change":"2024-09-21T03:25:06.956428+0000","last_active":"2024-09-21T03:25:07.954528+0000","last_peered":"2024-09-21T03:25:07.954528+0000","last_clean":"2024-09-21T03:25:07.954528+0000","last_became_active":"2024-09-21T03:25:06.955989+0000","last_became_peered":"2024-09-21T03:25:06.955989+0000","last_unstale":"2024-09-21T03:25:07.954528+0000","last_undegraded":"2024-09-21T03:25:07.954528+0000","last_fullsized":"2024-09-21T03:25:07.954528+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:05.806487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958257+0000","last_change":"2024-09-21T03:25:06.946863+0000","last_active":"2024-09-21T03:25:07.958257+0000","last_peered":"2024-09-21T03:25:07.958257+0000","last_clean":"2024-09-21T03:25:07.958257+0000","last_became_active":"2024-09-21T03:25:06.946516+0000","last_became_peered":"2024-09-21T03:25:06.946516+0000","last_unstale":"2024-09-21T03:25:07.958257+0000","last_undegraded":"2024-09-21T03:25:07.958257+0000","last_fullsized":"2024-09-21T03:25:07.958257+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:14.835962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.959036+0000","last_change":"2024-09-21T03:25:06.952971+0000","last_active":"2024-09-21T03:25:07.959036+0000","last_peered":"2024-09-21T03:25:07.959036+0000","last_clean":"2024-09-21T03:25:07.959036+0000","last_became_active":"2024-09-21T03:25:06.952598+0000","last_became_peered":"2024-09-21T03:25:06.952598+0000","last_unstale":"2024-09-21T03:25:07.959036+0000","last_undegraded":"2024-09-21T03:25:07.959036+0000","last_fullsized":"2024-09-21T03:25:07.959036+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:11.279234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.957889+0000","last_change":"2024-09-21T03:25:06.953872+0000","last_active":"2024-09-21T03:25:06.957889+0000","last_peered":"2024-09-21T03:25:06.957889+0000","last_clean":"2024-09-21T03:25:06.957889+0000","last_became_active":"2024-09-21T03:25:06.953516+0000","last_became_peered":"2024-09-21T03:25:06.953516+0000","last_unstale":"2024-09-21T03:25:06.957889+0000","last_undegraded":"2024-09-21T03:25:06.957889+0000","last_fullsized":"2024-09-21T03:25:06.957889+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:49.780931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.957699+0000","last_change":"2024-09-21T03:25:06.946898+0000","last_active":"2024-09-21T03:25:07.957699+0000","last_peered":"2024-09-21T03:25:07.957699+0000","last_clean":"2024-09-21T03:25:07.957699+0000","last_became_active":"2024-09-21T03:25:06.946529+0000","last_became_peered":"2024-09-21T03:25:06.946529+0000","last_unstale":"2024-09-21T03:25:07.957699+0000","last_undegraded":"2024-09-21T03:25:07.957699+0000","last_fullsized":"2024-09-21T03:25:07.957699+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:28.581453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.964617+0000","last_change":"2024-09-21T03:25:06.963339+0000","last_active":"2024-09-21T03:25:06.964617+0000","last_peered":"2024-09-21T03:25:06.964617+0000","last_clean":"2024-09-21T03:25:06.964617+0000","last_became_active":"2024-09-21T03:25:06.963052+0000","last_became_peered":"2024-09-21T03:25:06.963052+0000","last_unstale":"2024-09-21T03:25:06.964617+0000","last_undegraded":"2024-09-21T03:25:06.964617+0000","last_fullsized":"2024-09-21T03:25:06.964617+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:45.382063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958302+0000","last_change":"2024-09-21T03:25:06.947798+0000","last_active":"2024-09-21T03:25:07.958302+0000","last_peered":"2024-09-21T03:25:07.958302+0000","last_clean":"2024-09-21T03:25:07.958302+0000","last_became_active":"2024-09-21T03:25:06.947494+0000","last_became_peered":"2024-09-21T03:25:06.947494+0000","last_unstale":"2024-09-21T03:25:07.958302+0000","last_undegraded":"2024-09-21T03:25:07.958302+0000","last_fullsized":"2024-09-21T03:25:07.958302+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:58.003935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.953063+0000","last_change":"2024-09-21T03:25:05.953063+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.953063+0000","last_undegraded":"2024-09-21T03:25:05.953063+0000","last_fullsized":"2024-09-21T03:25:05.953063+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.966709+0000","last_change":"2024-09-21T03:25:06.965906+0000","last_active":"2024-09-21T03:25:06.966709+0000","last_peered":"2024-09-21T03:25:06.966709+0000","last_clean":"2024-09-21T03:25:06.966709+0000","last_became_active":"2024-09-21T03:25:06.965595+0000","last_became_peered":"2024-09-21T03:25:06.965595+0000","last_unstale":"2024-09-21T03:25:06.966709+0000","last_undegraded":"2024-09-21T03:25:06.966709+0000","last_fullsized":"2024-09-21T03:25:06.966709+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:32.430160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.974231+0000","last_change":"2024-09-21T03:25:06.972998+0000","last_active":"2024-09-21T03:25:06.974231+0000","last_peered":"2024-09-21T03:25:06.974231+0000","last_clean":"2024-09-21T03:25:06.974231+0000","last_became_active":"2024-09-21T03:25:06.972535+0000","last_became_peered":"2024-09-21T03:25:06.972535+0000","last_unstale":"2024-09-21T03:25:06.974231+0000","last_undegraded":"2024-09-21T03:25:06.974231+0000","last_fullsized":"2024-09-21T03:25:06.974231+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:23.886522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958517+0000","last_change":"2024-09-21T03:25:06.949102+0000","last_active":"2024-09-21T03:25:07.958517+0000","last_peered":"2024-09-21T03:25:07.958517+0000","last_clean":"2024-09-21T03:25:07.958517+0000","last_became_active":"2024-09-21T03:25:06.947993+0000","last_became_peered":"2024-09-21T03:25:06.947993+0000","last_unstale":"2024-09-21T03:25:07.958517+0000","last_undegraded":"2024-09-21T03:25:07.958517+0000","last_fullsized":"2024-09-21T03:25:07.958517+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:13.975782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.964008+0000","last_change":"2024-09-21T03:25:06.956996+0000","last_active":"2024-09-21T03:25:06.964008+0000","last_peered":"2024-09-21T03:25:06.964008+0000","last_clean":"2024-09-21T03:25:06.964008+0000","last_became_active":"2024-09-21T03:25:06.956687+0000","last_became_peered":"2024-09-21T03:25:06.956687+0000","last_unstale":"2024-09-21T03:25:06.964008+0000","last_undegraded":"2024-09-21T03:25:06.964008+0000","last_fullsized":"2024-09-21T03:25:06.964008+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:08.899356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.951900+0000","last_change":"2024-09-21T03:25:05.951900+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.951900+0000","last_undegraded":"2024-09-21T03:25:05.951900+0000","last_fullsized":"2024-09-21T03:25:05.951900+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.960078+0000","last_change":"2024-09-21T03:25:06.956017+0000","last_active":"2024-09-21T03:25:06.960078+0000","last_peered":"2024-09-21T03:25:06.960078+0000","last_clean":"2024-09-21T03:25:06.960078+0000","last_became_active":"2024-09-21T03:25:06.955640+0000","last_became_peered":"2024-09-21T03:25:06.955640+0000","last_unstale":"2024-09-21T03:25:06.960078+0000","last_undegraded":"2024-09-21T03:25:06.960078+0000","last_fullsized":"2024-09-21T03:25:06.960078+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:08.286393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.958319+0000","last_change":"2024-09-21T03:25:06.956659+0000","last_active":"2024-09-21T03:25:06.958319+0000","last_peered":"2024-09-21T03:25:06.958319+0000","last_clean":"2024-09-21T03:25:06.958319+0000","last_became_active":"2024-09-21T03:25:06.956166+0000","last_became_peered":"2024-09-21T03:25:06.956166+0000","last_unstale":"2024-09-21T03:25:06.958319+0000","last_undegraded":"2024-09-21T03:25:06.958319+0000","last_fullsized":"2024-09-21T03:25:06.958319+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:34.288116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"103'4","reported_seq":17,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.969661+0000","last_change":"2024-09-21T03:25:05.950693+0000","last_active":"2024-09-21T03:25:06.969661+0000","last_peered":"2024-09-21T03:25:06.969661+0000","last_clean":"2024-09-21T03:25:06.969661+0000","last_became_active":"2024-09-21T03:25:05.950331+0000","last_became_peered":"2024-09-21T03:25:05.950331+0000","last_unstale":"2024-09-21T03:25:06.969661+0000","last_undegraded":"2024-09-21T03:25:06.969661+0000","last_fullsized":"2024-09-21T03:25:06.969661+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:59.771445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958729+0000","last_change":"2024-09-21T03:25:06.946964+0000","last_active":"2024-09-21T03:25:07.958729+0000","last_peered":"2024-09-21T03:25:07.958729+0000","last_clean":"2024-09-21T03:25:07.958729+0000","last_became_active":"2024-09-21T03:25:06.945956+0000","last_became_peered":"2024-09-21T03:25:06.945956+0000","last_unstale":"2024-09-21T03:25:07.958729+0000","last_undegraded":"2024-09-21T03:25:07.958729+0000","last_fullsized":"2024-09-21T03:25:07.958729+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:49.780931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954228+0000","last_change":"2024-09-21T03:25:05.948457+0000","last_active":"2024-09-21T03:25:07.954228+0000","last_peered":"2024-09-21T03:25:07.954228+0000","last_clean":"2024-09-21T03:25:07.954228+0000","last_became_active":"2024-09-21T03:25:05.948136+0000","last_became_peered":"2024-09-21T03:25:05.948136+0000","last_unstale":"2024-09-21T03:25:07.954228+0000","last_undegraded":"2024-09-21T03:25:07.954228+0000","last_fullsized":"2024-09-21T03:25:07.954228+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:27.577914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.959487+0000","last_change":"2024-09-21T03:25:06.957624+0000","last_active":"2024-09-21T03:25:06.959487+0000","last_peered":"2024-09-21T03:25:06.959487+0000","last_clean":"2024-09-21T03:25:06.959487+0000","last_became_active":"2024-09-21T03:25:06.957274+0000","last_became_peered":"2024-09-21T03:25:06.957274+0000","last_unstale":"2024-09-21T03:25:06.959487+0000","last_undegraded":"2024-09-21T03:25:06.959487+0000","last_fullsized":"2024-09-21T03:25:06.959487+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:09.843286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.967196+0000","last_change":"2024-09-21T03:25:05.956340+0000","last_active":"2024-09-21T03:25:06.967196+0000","last_peered":"2024-09-21T03:25:06.967196+0000","last_clean":"2024-09-21T03:25:06.967196+0000","last_became_active":"2024-09-21T03:25:05.956023+0000","last_became_peered":"2024-09-21T03:25:05.956023+0000","last_unstale":"2024-09-21T03:25:06.967196+0000","last_undegraded":"2024-09-21T03:25:06.967196+0000","last_fullsized":"2024-09-21T03:25:06.967196+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:16.344677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954681+0000","last_change":"2024-09-21T03:25:06.954812+0000","last_active":"2024-09-21T03:25:07.954681+0000","last_peered":"2024-09-21T03:25:07.954681+0000","last_clean":"2024-09-21T03:25:07.954681+0000","last_became_active":"2024-09-21T03:25:06.954324+0000","last_became_peered":"2024-09-21T03:25:06.954324+0000","last_unstale":"2024-09-21T03:25:07.954681+0000","last_undegraded":"2024-09-21T03:25:07.954681+0000","last_fullsized":"2024-09-21T03:25:07.954681+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:31.650403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.967394+0000","last_change":"2024-09-21T03:25:05.951073+0000","last_active":"2024-09-21T03:25:06.967394+0000","last_peered":"2024-09-21T03:25:06.967394+0000","last_clean":"2024-09-21T03:25:06.967394+0000","last_became_active":"2024-09-21T03:25:05.950749+0000","last_became_peered":"2024-09-21T03:25:05.950749+0000","last_unstale":"2024-09-21T03:25:06.967394+0000","last_undegraded":"2024-09-21T03:25:06.967394+0000","last_fullsized":"2024-09-21T03:25:06.967394+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:07.037456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.951678+0000","last_change":"2024-09-21T03:25:05.951678+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.951678+0000","last_undegraded":"2024-09-21T03:25:05.951678+0000","last_fullsized":"2024-09-21T03:25:05.951678+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"103'1","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.966866+0000","last_change":"2024-09-21T03:25:05.952018+0000","last_active":"2024-09-21T03:25:06.966866+0000","last_peered":"2024-09-21T03:25:06.966866+0000","last_clean":"2024-09-21T03:25:06.966866+0000","last_became_active":"2024-09-21T03:25:05.951683+0000","last_became_peered":"2024-09-21T03:25:05.951683+0000","last_unstale":"2024-09-21T03:25:06.966866+0000","last_undegraded":"2024-09-21T03:25:06.966866+0000","last_fullsized":"2024-09-21T03:25:06.966866+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:06:17.348336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958896+0000","last_change":"2024-09-21T03:25:06.960288+0000","last_active":"2024-09-21T03:25:07.958896+0000","last_peered":"2024-09-21T03:25:07.958896+0000","last_clean":"2024-09-21T03:25:07.958896+0000","last_became_active":"2024-09-21T03:25:06.959943+0000","last_became_peered":"2024-09-21T03:25:06.959943+0000","last_unstale":"2024-09-21T03:25:07.958896+0000","last_undegraded":"2024-09-21T03:25:07.958896+0000","last_fullsized":"2024-09-21T03:25:07.958896+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:49.944202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"103'1","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.967731+0000","last_change":"2024-09-21T03:25:05.948442+0000","last_active":"2024-09-21T03:25:06.967731+0000","last_peered":"2024-09-21T03:25:06.967731+0000","last_clean":"2024-09-21T03:25:06.967731+0000","last_became_active":"2024-09-21T03:25:05.947682+0000","last_became_peered":"2024-09-21T03:25:05.947682+0000","last_unstale":"2024-09-21T03:25:06.967731+0000","last_undegraded":"2024-09-21T03:25:06.967731+0000","last_fullsized":"2024-09-21T03:25:06.967731+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:57.000396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.954176+0000","last_change":"2024-09-21T03:25:05.954176+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.954176+0000","last_undegraded":"2024-09-21T03:25:05.954176+0000","last_fullsized":"2024-09-21T03:25:05.954176+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.957616+0000","last_change":"2024-09-21T03:25:05.954213+0000","last_active":"2024-09-21T03:25:07.957616+0000","last_peered":"2024-09-21T03:25:07.957616+0000","last_clean":"2024-09-21T03:25:07.957616+0000","last_became_active":"2024-09-21T03:25:05.953869+0000","last_became_peered":"2024-09-21T03:25:05.953869+0000","last_unstale":"2024-09-21T03:25:07.957616+0000","last_undegraded":"2024-09-21T03:25:07.957616+0000","last_fullsized":"2024-09-21T03:25:07.957616+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:07.895817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.961160+0000","last_change":"2024-09-21T03:25:06.955915+0000","last_active":"2024-09-21T03:25:06.961160+0000","last_peered":"2024-09-21T03:25:06.961160+0000","last_clean":"2024-09-21T03:25:06.961160+0000","last_became_active":"2024-09-21T03:25:06.955458+0000","last_became_peered":"2024-09-21T03:25:06.955458+0000","last_unstale":"2024-09-21T03:25:06.961160+0000","last_undegraded":"2024-09-21T03:25:06.961160+0000","last_fullsized":"2024-09-21T03:25:06.961160+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:10.995084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.961676+0000","last_change":"2024-09-21T03:25:05.960268+0000","last_active":"2024-09-21T03:25:05.961676+0000","last_peered":"2024-09-21T03:25:05.961676+0000","last_clean":"2024-09-21T03:25:05.961676+0000","last_became_active":"2024-09-21T03:25:05.959378+0000","last_became_peered":"2024-09-21T03:25:05.959378+0000","last_unstale":"2024-09-21T03:25:05.961676+0000","last_undegraded":"2024-09-21T03:25:05.961676+0000","last_fullsized":"2024-09-21T03:25:05.961676+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:13.516789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.961224+0000","last_change":"2024-09-21T03:25:06.954630+0000","last_active":"2024-09-21T03:25:06.961224+0000","last_peered":"2024-09-21T03:25:06.961224+0000","last_clean":"2024-09-21T03:25:06.961224+0000","last_became_active":"2024-09-21T03:25:06.953583+0000","last_became_peered":"2024-09-21T03:25:06.953583+0000","last_unstale":"2024-09-21T03:25:06.961224+0000","last_undegraded":"2024-09-21T03:25:06.961224+0000","last_fullsized":"2024-09-21T03:25:06.961224+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:33.610686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.942545+0000","last_change":"2024-09-21T03:25:05.954201+0000","last_active":"2024-09-21T03:25:06.942545+0000","last_peered":"2024-09-21T03:25:06.942545+0000","last_clean":"2024-09-21T03:25:06.942545+0000","last_became_active":"2024-09-21T03:25:05.953878+0000","last_became_peered":"2024-09-21T03:25:05.953878+0000","last_unstale":"2024-09-21T03:25:06.942545+0000","last_undegraded":"2024-09-21T03:25:06.942545+0000","last_fullsized":"2024-09-21T03:25:06.942545+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:05.935127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958898+0000","last_change":"2024-09-21T03:25:06.968378+0000","last_active":"2024-09-21T03:25:07.958898+0000","last_peered":"2024-09-21T03:25:07.958898+0000","last_clean":"2024-09-21T03:25:07.958898+0000","last_became_active":"2024-09-21T03:25:06.967606+0000","last_became_peered":"2024-09-21T03:25:06.967606+0000","last_unstale":"2024-09-21T03:25:07.958898+0000","last_undegraded":"2024-09-21T03:25:07.958898+0000","last_fullsized":"2024-09-21T03:25:07.958898+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:13.975782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.944468+0000","last_change":"2024-09-21T03:25:05.946765+0000","last_active":"2024-09-21T03:25:06.944468+0000","last_peered":"2024-09-21T03:25:06.944468+0000","last_clean":"2024-09-21T03:25:06.944468+0000","last_became_active":"2024-09-21T03:25:05.946454+0000","last_became_peered":"2024-09-21T03:25:05.946454+0000","last_unstale":"2024-09-21T03:25:06.944468+0000","last_undegraded":"2024-09-21T03:25:06.944468+0000","last_fullsized":"2024-09-21T03:25:06.944468+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:22.100031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.964558+0000","last_change":"2024-09-21T03:25:06.960519+0000","last_active":"2024-09-21T03:25:06.964558+0000","last_peered":"2024-09-21T03:25:06.964558+0000","last_clean":"2024-09-21T03:25:06.964558+0000","last_became_active":"2024-09-21T03:25:06.960164+0000","last_became_peered":"2024-09-21T03:25:06.960164+0000","last_unstale":"2024-09-21T03:25:06.964558+0000","last_undegraded":"2024-09-21T03:25:06.964558+0000","last_fullsized":"2024-09-21T03:25:06.964558+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:59:33.809395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.956794+0000","last_change":"2024-09-21T03:25:05.953557+0000","last_active":"2024-09-21T03:25:05.956794+0000","last_peered":"2024-09-21T03:25:05.956794+0000","last_clean":"2024-09-21T03:25:05.956794+0000","last_became_active":"2024-09-21T03:25:05.953163+0000","last_became_peered":"2024-09-21T03:25:05.953163+0000","last_unstale":"2024-09-21T03:25:05.956794+0000","last_undegraded":"2024-09-21T03:25:05.956794+0000","last_fullsized":"2024-09-21T03:25:05.956794+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:42.745888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.956692+0000","last_change":"2024-09-21T03:25:06.954185+0000","last_active":"2024-09-21T03:25:06.956692+0000","last_peered":"2024-09-21T03:25:06.956692+0000","last_clean":"2024-09-21T03:25:06.956692+0000","last_became_active":"2024-09-21T03:25:06.953834+0000","last_became_peered":"2024-09-21T03:25:06.953834+0000","last_unstale":"2024-09-21T03:25:06.956692+0000","last_undegraded":"2024-09-21T03:25:06.956692+0000","last_fullsized":"2024-09-21T03:25:06.956692+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:27:48.468098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.961437+0000","last_change":"2024-09-21T03:25:05.959732+0000","last_active":"2024-09-21T03:25:05.961437+0000","last_peered":"2024-09-21T03:25:05.961437+0000","last_clean":"2024-09-21T03:25:05.961437+0000","last_became_active":"2024-09-21T03:25:05.959393+0000","last_became_peered":"2024-09-21T03:25:05.959393+0000","last_unstale":"2024-09-21T03:25:05.961437+0000","last_undegraded":"2024-09-21T03:25:05.961437+0000","last_fullsized":"2024-09-21T03:25:05.961437+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:54.217867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.964650+0000","last_change":"2024-09-21T03:25:06.959029+0000","last_active":"2024-09-21T03:25:06.964650+0000","last_peered":"2024-09-21T03:25:06.964650+0000","last_clean":"2024-09-21T03:25:06.964650+0000","last_became_active":"2024-09-21T03:25:06.958443+0000","last_became_peered":"2024-09-21T03:25:06.958443+0000","last_unstale":"2024-09-21T03:25:06.964650+0000","last_undegraded":"2024-09-21T03:25:06.964650+0000","last_fullsized":"2024-09-21T03:25:06.964650+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:41:16.872769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.967401+0000","last_change":"2024-09-21T03:25:05.946740+0000","last_active":"2024-09-21T03:25:06.967401+0000","last_peered":"2024-09-21T03:25:06.967401+0000","last_clean":"2024-09-21T03:25:06.967401+0000","last_became_active":"2024-09-21T03:25:05.946438+0000","last_became_peered":"2024-09-21T03:25:05.946438+0000","last_unstale":"2024-09-21T03:25:06.967401+0000","last_undegraded":"2024-09-21T03:25:06.967401+0000","last_fullsized":"2024-09-21T03:25:06.967401+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:27.205093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.958138+0000","last_change":"2024-09-21T03:25:06.954978+0000","last_active":"2024-09-21T03:25:06.958138+0000","last_peered":"2024-09-21T03:25:06.958138+0000","last_clean":"2024-09-21T03:25:06.958138+0000","last_became_active":"2024-09-21T03:25:06.954688+0000","last_became_peered":"2024-09-21T03:25:06.954688+0000","last_unstale":"2024-09-21T03:25:06.958138+0000","last_undegraded":"2024-09-21T03:25:06.958138+0000","last_fullsized":"2024-09-21T03:25:06.958138+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:03.305218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958184+0000","last_change":"2024-09-21T03:25:05.960010+0000","last_active":"2024-09-21T03:25:07.958184+0000","last_peered":"2024-09-21T03:25:07.958184+0000","last_clean":"2024-09-21T03:25:07.958184+0000","last_became_active":"2024-09-21T03:25:05.959699+0000","last_became_peered":"2024-09-21T03:25:05.959699+0000","last_unstale":"2024-09-21T03:25:07.958184+0000","last_undegraded":"2024-09-21T03:25:07.958184+0000","last_fullsized":"2024-09-21T03:25:07.958184+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:33.984094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.957851+0000","last_change":"2024-09-21T03:25:06.954255+0000","last_active":"2024-09-21T03:25:06.957851+0000","last_peered":"2024-09-21T03:25:06.957851+0000","last_clean":"2024-09-21T03:25:06.957851+0000","last_became_active":"2024-09-21T03:25:06.953960+0000","last_became_peered":"2024-09-21T03:25:06.953960+0000","last_unstale":"2024-09-21T03:25:06.957851+0000","last_undegraded":"2024-09-21T03:25:06.957851+0000","last_fullsized":"2024-09-21T03:25:06.957851+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:13.975782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"103'8","reported_seq":21,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.971415+0000","last_change":"2024-09-21T03:25:05.962238+0000","last_active":"2024-09-21T03:25:06.971415+0000","last_peered":"2024-09-21T03:25:06.971415+0000","last_clean":"2024-09-21T03:25:06.971415+0000","last_became_active":"2024-09-21T03:25:05.961869+0000","last_became_peered":"2024-09-21T03:25:05.961869+0000","last_unstale":"2024-09-21T03:25:06.971415+0000","last_undegraded":"2024-09-21T03:25:06.971415+0000","last_fullsized":"2024-09-21T03:25:06.971415+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:13.594419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.974579+0000","last_change":"2024-09-21T03:25:06.973378+0000","last_active":"2024-09-21T03:25:06.974579+0000","last_peered":"2024-09-21T03:25:06.974579+0000","last_clean":"2024-09-21T03:25:06.974579+0000","last_became_active":"2024-09-21T03:25:06.972937+0000","last_became_peered":"2024-09-21T03:25:06.972937+0000","last_unstale":"2024-09-21T03:25:06.974579+0000","last_undegraded":"2024-09-21T03:25:06.974579+0000","last_fullsized":"2024-09-21T03:25:06.974579+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:20.822035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.957250+0000","last_change":"2024-09-21T03:25:05.953632+0000","last_active":"2024-09-21T03:25:05.957250+0000","last_peered":"2024-09-21T03:25:05.957250+0000","last_clean":"2024-09-21T03:25:05.957250+0000","last_became_active":"2024-09-21T03:25:05.952747+0000","last_became_peered":"2024-09-21T03:25:05.952747+0000","last_unstale":"2024-09-21T03:25:05.957250+0000","last_undegraded":"2024-09-21T03:25:05.957250+0000","last_fullsized":"2024-09-21T03:25:05.957250+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:16.897123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.973787+0000","last_change":"2024-09-21T03:25:06.971849+0000","last_active":"2024-09-21T03:25:06.973787+0000","last_peered":"2024-09-21T03:25:06.973787+0000","last_clean":"2024-09-21T03:25:06.973787+0000","last_became_active":"2024-09-21T03:25:06.971533+0000","last_became_peered":"2024-09-21T03:25:06.971533+0000","last_unstale":"2024-09-21T03:25:06.973787+0000","last_undegraded":"2024-09-21T03:25:06.973787+0000","last_fullsized":"2024-09-21T03:25:06.973787+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:37.012007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.973664+0000","last_change":"2024-09-21T03:25:05.949862+0000","last_active":"2024-09-21T03:25:06.973664+0000","last_peered":"2024-09-21T03:25:06.973664+0000","last_clean":"2024-09-21T03:25:06.973664+0000","last_became_active":"2024-09-21T03:25:05.949503+0000","last_became_peered":"2024-09-21T03:25:05.949503+0000","last_unstale":"2024-09-21T03:25:06.973664+0000","last_undegraded":"2024-09-21T03:25:06.973664+0000","last_fullsized":"2024-09-21T03:25:06.973664+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:48.375833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954331+0000","last_change":"2024-09-21T03:25:06.968263+0000","last_active":"2024-09-21T03:25:07.954331+0000","last_peered":"2024-09-21T03:25:07.954331+0000","last_clean":"2024-09-21T03:25:07.954331+0000","last_became_active":"2024-09-21T03:25:06.967957+0000","last_became_peered":"2024-09-21T03:25:06.967957+0000","last_unstale":"2024-09-21T03:25:07.954331+0000","last_undegraded":"2024-09-21T03:25:07.954331+0000","last_fullsized":"2024-09-21T03:25:07.954331+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:38.224056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958389+0000","last_change":"2024-09-21T03:25:05.951962+0000","last_active":"2024-09-21T03:25:07.958389+0000","last_peered":"2024-09-21T03:25:07.958389+0000","last_clean":"2024-09-21T03:25:07.958389+0000","last_became_active":"2024-09-21T03:25:05.951676+0000","last_became_peered":"2024-09-21T03:25:05.951676+0000","last_unstale":"2024-09-21T03:25:07.958389+0000","last_undegraded":"2024-09-21T03:25:07.958389+0000","last_fullsized":"2024-09-21T03:25:07.958389+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:14:33.126090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954791+0000","last_change":"2024-09-21T03:25:06.958748+0000","last_active":"2024-09-21T03:25:07.954791+0000","last_peered":"2024-09-21T03:25:07.954791+0000","last_clean":"2024-09-21T03:25:07.954791+0000","last_became_active":"2024-09-21T03:25:06.958412+0000","last_became_peered":"2024-09-21T03:25:06.958412+0000","last_unstale":"2024-09-21T03:25:07.954791+0000","last_undegraded":"2024-09-21T03:25:07.954791+0000","last_fullsized":"2024-09-21T03:25:07.954791+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:02.237215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.945527+0000","last_change":"2024-09-21T03:25:05.955181+0000","last_active":"2024-09-21T03:25:06.945527+0000","last_peered":"2024-09-21T03:25:06.945527+0000","last_clean":"2024-09-21T03:25:06.945527+0000","last_became_active":"2024-09-21T03:25:05.954828+0000","last_became_peered":"2024-09-21T03:25:05.954828+0000","last_unstale":"2024-09-21T03:25:06.945527+0000","last_undegraded":"2024-09-21T03:25:06.945527+0000","last_fullsized":"2024-09-21T03:25:06.945527+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:35.311555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954227+0000","last_change":"2024-09-21T03:25:06.957965+0000","last_active":"2024-09-21T03:25:07.954227+0000","last_peered":"2024-09-21T03:25:07.954227+0000","last_clean":"2024-09-21T03:25:07.954227+0000","last_became_active":"2024-09-21T03:25:06.957637+0000","last_became_peered":"2024-09-21T03:25:06.957637+0000","last_unstale":"2024-09-21T03:25:07.954227+0000","last_undegraded":"2024-09-21T03:25:07.954227+0000","last_fullsized":"2024-09-21T03:25:07.954227+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:34.326915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.968385+0000","last_change":"2024-09-21T03:25:05.949798+0000","last_active":"2024-09-21T03:25:06.968385+0000","last_peered":"2024-09-21T03:25:06.968385+0000","last_clean":"2024-09-21T03:25:06.968385+0000","last_became_active":"2024-09-21T03:25:05.949522+0000","last_became_peered":"2024-09-21T03:25:05.949522+0000","last_unstale":"2024-09-21T03:25:06.968385+0000","last_undegraded":"2024-09-21T03:25:06.968385+0000","last_fullsized":"2024-09-21T03:25:06.968385+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:20.522015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.951118+0000","last_change":"2024-09-21T03:25:05.951118+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.951118+0000","last_undegraded":"2024-09-21T03:25:05.951118+0000","last_fullsized":"2024-09-21T03:25:05.951118+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.943364+0000","last_change":"2024-09-21T03:25:05.951055+0000","last_active":"2024-09-21T03:25:06.943364+0000","last_peered":"2024-09-21T03:25:06.943364+0000","last_clean":"2024-09-21T03:25:06.943364+0000","last_became_active":"2024-09-21T03:25:05.950689+0000","last_became_peered":"2024-09-21T03:25:05.950689+0000","last_unstale":"2024-09-21T03:25:06.943364+0000","last_undegraded":"2024-09-21T03:25:06.943364+0000","last_fullsized":"2024-09-21T03:25:06.943364+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:14.630887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954221+0000","last_change":"2024-09-21T03:25:06.957927+0000","last_active":"2024-09-21T03:25:07.954221+0000","last_peered":"2024-09-21T03:25:07.954221+0000","last_clean":"2024-09-21T03:25:07.954221+0000","last_became_active":"2024-09-21T03:25:06.956714+0000","last_became_peered":"2024-09-21T03:25:06.956714+0000","last_unstale":"2024-09-21T03:25:07.954221+0000","last_undegraded":"2024-09-21T03:25:07.954221+0000","last_fullsized":"2024-09-21T03:25:07.954221+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:28.910067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.943454+0000","last_change":"2024-09-21T03:25:05.949024+0000","last_active":"2024-09-21T03:25:06.943454+0000","last_peered":"2024-09-21T03:25:06.943454+0000","last_clean":"2024-09-21T03:25:06.943454+0000","last_became_active":"2024-09-21T03:25:05.948664+0000","last_became_peered":"2024-09-21T03:25:05.948664+0000","last_unstale":"2024-09-21T03:25:06.943454+0000","last_undegraded":"2024-09-21T03:25:06.943454+0000","last_fullsized":"2024-09-21T03:25:06.943454+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:10.198642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.970949+0000","last_change":"2024-09-21T03:25:06.966457+0000","last_active":"2024-09-21T03:25:06.970949+0000","last_peered":"2024-09-21T03:25:06.970949+0000","last_clean":"2024-09-21T03:25:06.970949+0000","last_became_active":"2024-09-21T03:25:06.965905+0000","last_became_peered":"2024-09-21T03:25:06.965905+0000","last_unstale":"2024-09-21T03:25:06.970949+0000","last_undegraded":"2024-09-21T03:25:06.970949+0000","last_fullsized":"2024-09-21T03:25:06.970949+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:28:33.939280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.964155+0000","last_change":"2024-09-21T03:25:05.961466+0000","last_active":"2024-09-21T03:25:05.964155+0000","last_peered":"2024-09-21T03:25:05.964155+0000","last_clean":"2024-09-21T03:25:05.964155+0000","last_became_active":"2024-09-21T03:25:05.961148+0000","last_became_peered":"2024-09-21T03:25:05.961148+0000","last_unstale":"2024-09-21T03:25:05.964155+0000","last_undegraded":"2024-09-21T03:25:05.964155+0000","last_fullsized":"2024-09-21T03:25:05.964155+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:07.109585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958987+0000","last_change":"2024-09-21T03:25:06.970004+0000","last_active":"2024-09-21T03:25:07.958987+0000","last_peered":"2024-09-21T03:25:07.958987+0000","last_clean":"2024-09-21T03:25:07.958987+0000","last_became_active":"2024-09-21T03:25:06.969612+0000","last_became_peered":"2024-09-21T03:25:06.969612+0000","last_unstale":"2024-09-21T03:25:07.958987+0000","last_undegraded":"2024-09-21T03:25:07.958987+0000","last_fullsized":"2024-09-21T03:25:07.958987+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:03.305218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.972709+0000","last_change":"2024-09-21T03:25:05.955665+0000","last_active":"2024-09-21T03:25:06.972709+0000","last_peered":"2024-09-21T03:25:06.972709+0000","last_clean":"2024-09-21T03:25:06.972709+0000","last_became_active":"2024-09-21T03:25:05.955365+0000","last_became_peered":"2024-09-21T03:25:05.955365+0000","last_unstale":"2024-09-21T03:25:06.972709+0000","last_undegraded":"2024-09-21T03:25:06.972709+0000","last_fullsized":"2024-09-21T03:25:06.972709+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:45.001004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.950577+0000","last_change":"2024-09-21T03:25:05.950577+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.950577+0000","last_undegraded":"2024-09-21T03:25:05.950577+0000","last_fullsized":"2024-09-21T03:25:05.950577+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958997+0000","last_change":"2024-09-21T03:25:05.949208+0000","last_active":"2024-09-21T03:25:07.958997+0000","last_peered":"2024-09-21T03:25:07.958997+0000","last_clean":"2024-09-21T03:25:07.958997+0000","last_became_active":"2024-09-21T03:25:05.948664+0000","last_became_peered":"2024-09-21T03:25:05.948664+0000","last_unstale":"2024-09-21T03:25:07.958997+0000","last_undegraded":"2024-09-21T03:25:07.958997+0000","last_fullsized":"2024-09-21T03:25:07.958997+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:20.392815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.946336+0000","last_change":"2024-09-21T03:25:05.946336+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.946336+0000","last_undegraded":"2024-09-21T03:25:05.946336+0000","last_fullsized":"2024-09-21T03:25:05.946336+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.964175+0000","last_change":"2024-09-21T03:25:05.961517+0000","last_active":"2024-09-21T03:25:05.964175+0000","last_peered":"2024-09-21T03:25:05.964175+0000","last_clean":"2024-09-21T03:25:05.964175+0000","last_became_active":"2024-09-21T03:25:05.961159+0000","last_became_peered":"2024-09-21T03:25:05.961159+0000","last_unstale":"2024-09-21T03:25:05.964175+0000","last_undegraded":"2024-09-21T03:25:05.964175+0000","last_fullsized":"2024-09-21T03:25:05.964175+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:42.357829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958256+0000","last_change":"2024-09-21T03:25:06.968024+0000","last_active":"2024-09-21T03:25:07.958256+0000","last_peered":"2024-09-21T03:25:07.958256+0000","last_clean":"2024-09-21T03:25:07.958256+0000","last_became_active":"2024-09-21T03:25:06.967584+0000","last_became_peered":"2024-09-21T03:25:06.967584+0000","last_unstale":"2024-09-21T03:25:07.958256+0000","last_undegraded":"2024-09-21T03:25:07.958256+0000","last_fullsized":"2024-09-21T03:25:07.958256+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:14.835962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.947689+0000","last_change":"2024-09-21T03:25:05.953316+0000","last_active":"2024-09-21T03:25:06.947689+0000","last_peered":"2024-09-21T03:25:06.947689+0000","last_clean":"2024-09-21T03:25:06.947689+0000","last_became_active":"2024-09-21T03:25:05.953009+0000","last_became_peered":"2024-09-21T03:25:05.953009+0000","last_unstale":"2024-09-21T03:25:06.947689+0000","last_undegraded":"2024-09-21T03:25:06.947689+0000","last_fullsized":"2024-09-21T03:25:06.947689+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:13.832422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958341+0000","last_change":"2024-09-21T03:25:06.957735+0000","last_active":"2024-09-21T03:25:07.958341+0000","last_peered":"2024-09-21T03:25:07.958341+0000","last_clean":"2024-09-21T03:25:07.958341+0000","last_became_active":"2024-09-21T03:25:06.957327+0000","last_became_peered":"2024-09-21T03:25:06.957327+0000","last_unstale":"2024-09-21T03:25:07.958341+0000","last_undegraded":"2024-09-21T03:25:07.958341+0000","last_fullsized":"2024-09-21T03:25:07.958341+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:49.780931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.945223+0000","last_change":"2024-09-21T03:25:05.949661+0000","last_active":"2024-09-21T03:25:06.945223+0000","last_peered":"2024-09-21T03:25:06.945223+0000","last_clean":"2024-09-21T03:25:06.945223+0000","last_became_active":"2024-09-21T03:25:05.949336+0000","last_became_peered":"2024-09-21T03:25:05.949336+0000","last_unstale":"2024-09-21T03:25:06.945223+0000","last_undegraded":"2024-09-21T03:25:06.945223+0000","last_fullsized":"2024-09-21T03:25:06.945223+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:48.750266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958762+0000","last_change":"2024-09-21T03:25:06.948815+0000","last_active":"2024-09-21T03:25:07.958762+0000","last_peered":"2024-09-21T03:25:07.958762+0000","last_clean":"2024-09-21T03:25:07.958762+0000","last_became_active":"2024-09-21T03:25:06.948415+0000","last_became_peered":"2024-09-21T03:25:06.948415+0000","last_unstale":"2024-09-21T03:25:07.958762+0000","last_undegraded":"2024-09-21T03:25:07.958762+0000","last_fullsized":"2024-09-21T03:25:07.958762+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:03.305218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958470+0000","last_change":"2024-09-21T03:25:05.945536+0000","last_active":"2024-09-21T03:25:07.958470+0000","last_peered":"2024-09-21T03:25:07.958470+0000","last_clean":"2024-09-21T03:25:07.958470+0000","last_became_active":"2024-09-21T03:25:05.945162+0000","last_became_peered":"2024-09-21T03:25:05.945162+0000","last_unstale":"2024-09-21T03:25:07.958470+0000","last_undegraded":"2024-09-21T03:25:07.958470+0000","last_fullsized":"2024-09-21T03:25:07.958470+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:09.991545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954517+0000","last_change":"2024-09-21T03:25:06.957533+0000","last_active":"2024-09-21T03:25:07.954517+0000","last_peered":"2024-09-21T03:25:07.954517+0000","last_clean":"2024-09-21T03:25:07.954517+0000","last_became_active":"2024-09-21T03:25:06.957214+0000","last_became_peered":"2024-09-21T03:25:06.957214+0000","last_unstale":"2024-09-21T03:25:07.954517+0000","last_undegraded":"2024-09-21T03:25:07.954517+0000","last_fullsized":"2024-09-21T03:25:07.954517+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:24.677842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.942986+0000","last_change":"2024-09-21T03:25:05.953058+0000","last_active":"2024-09-21T03:25:06.942986+0000","last_peered":"2024-09-21T03:25:06.942986+0000","last_clean":"2024-09-21T03:25:06.942986+0000","last_became_active":"2024-09-21T03:25:05.952512+0000","last_became_peered":"2024-09-21T03:25:05.952512+0000","last_unstale":"2024-09-21T03:25:06.942986+0000","last_undegraded":"2024-09-21T03:25:06.942986+0000","last_fullsized":"2024-09-21T03:25:06.942986+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:34.953614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.944325+0000","last_change":"2024-09-21T03:25:05.944325+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.944325+0000","last_undegraded":"2024-09-21T03:25:05.944325+0000","last_fullsized":"2024-09-21T03:25:05.944325+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.963735+0000","last_change":"2024-09-21T03:25:05.960646+0000","last_active":"2024-09-21T03:25:05.963735+0000","last_peered":"2024-09-21T03:25:05.963735+0000","last_clean":"2024-09-21T03:25:05.963735+0000","last_became_active":"2024-09-21T03:25:05.959992+0000","last_became_peered":"2024-09-21T03:25:05.959992+0000","last_unstale":"2024-09-21T03:25:05.963735+0000","last_undegraded":"2024-09-21T03:25:05.963735+0000","last_fullsized":"2024-09-21T03:25:05.963735+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:23.072517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.964593+0000","last_change":"2024-09-21T03:25:06.962590+0000","last_active":"2024-09-21T03:25:06.964593+0000","last_peered":"2024-09-21T03:25:06.964593+0000","last_clean":"2024-09-21T03:25:06.964593+0000","last_became_active":"2024-09-21T03:25:06.962295+0000","last_became_peered":"2024-09-21T03:25:06.962295+0000","last_unstale":"2024-09-21T03:25:06.964593+0000","last_undegraded":"2024-09-21T03:25:06.964593+0000","last_fullsized":"2024-09-21T03:25:06.964593+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:04:58.099896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.947269+0000","last_change":"2024-09-21T03:25:05.955078+0000","last_active":"2024-09-21T03:25:06.947269+0000","last_peered":"2024-09-21T03:25:06.947269+0000","last_clean":"2024-09-21T03:25:06.947269+0000","last_became_active":"2024-09-21T03:25:05.954784+0000","last_became_peered":"2024-09-21T03:25:05.954784+0000","last_unstale":"2024-09-21T03:25:06.947269+0000","last_undegraded":"2024-09-21T03:25:06.947269+0000","last_fullsized":"2024-09-21T03:25:06.947269+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:15:08.648155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":266,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954464+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:25:07.954464+0000","last_peered":"2024-09-21T03:25:07.954464+0000","last_clean":"2024-09-21T03:25:07.954464+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:25:07.954464+0000","last_undegraded":"2024-09-21T03:25:07.954464+0000","last_fullsized":"2024-09-21T03:25:07.954464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":686,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509527,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33020,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338820,"statfs":{"total":96636764160,"available":96602951680,"internally_reserved":0,"allocated":1875968,"data_stored":1131075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509526,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32456,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":1290240,"data_stored":546461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509525,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1282048,"data_stored":540695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509525,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32436,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339404,"statfs":{"total":96636764160,"available":96603549696,"internally_reserved":0,"allocated":1273856,"data_stored":540091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509526,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32456,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":1290240,"data_stored":541773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509526,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1273856,"data_stored":540091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509526,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36600,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335240,"statfs":{"total":96636764160,"available":96599285760,"internally_reserved":0,"allocated":1282048,"data_stored":540215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574933,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33000,"kb_used_data":1800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338840,"statfs":{"total":96636764160,"available":96602972160,"internally_reserved":0,"allocated":1843200,"data_stored":1117409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:25:09.966 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:25:10.115 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.113+0000 7fc12e18b640 1 -- 172.21.15.105:0/3910933710 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1280b64e0 msgr2=0x7fc1280d25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:10.115 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.113+0000 7fc12e18b640 1 --2- 172.21.15.105:0/3910933710 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1280b64e0 0x7fc1280d25b0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fc12808cab0 tx=0x7fc12002a440 comp rx=0 tx=0).stop 2024-09-21T03:25:10.115 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.113+0000 7fc12e18b640 1 -- 172.21.15.105:0/3910933710 shutdown_connections 2024-09-21T03:25:10.115 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.113+0000 7fc12e18b640 1 --2- 172.21.15.105:0/3910933710 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1280b64e0 0x7fc1280d25b0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:10.115 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.113+0000 7fc12e18b640 1 --2- 172.21.15.105:0/3910933710 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1280cf540 0x7fc1280b5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:10.115 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.113+0000 7fc12e18b640 1 --2- 172.21.15.105:0/3910933710 >> v2:172.21.15.162:3300/0 conn(0x7fc1280b9b60 0x7fc1280d4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:10.115 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.113+0000 7fc12e18b640 1 -- 172.21.15.105:0/3910933710 >> 172.21.15.105:0/3910933710 conn(0x7fc12809d7f0 msgr2=0x7fc1280d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:10.115 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.113+0000 7fc12e18b640 1 -- 172.21.15.105:0/3910933710 shutdown_connections 2024-09-21T03:25:10.115 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.113+0000 7fc12e18b640 1 -- 172.21.15.105:0/3910933710 wait complete. 2024-09-21T03:25:10.116 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.114+0000 7fc12e18b640 1 Processor -- start 2024-09-21T03:25:10.116 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.115+0000 7fc12e18b640 1 -- start start 2024-09-21T03:25:10.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.116+0000 7fc12e18b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1280b64e0 0x7fc128150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:10.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.116+0000 7fc12e18b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1280b9b60 0x7fc128151030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:10.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.116+0000 7fc12e18b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1280cf540 0x7fc1281f8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:10.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.116+0000 7fc12e18b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc1280d2f90 con 0x7fc1280cf540 2024-09-21T03:25:10.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.116+0000 7fc12e18b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc1280d2e10 con 0x7fc1280b64e0 2024-09-21T03:25:10.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.116+0000 7fc12e18b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc1280d3110 con 0x7fc1280b9b60 2024-09-21T03:25:10.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.116+0000 7fc127fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1280cf540 0x7fc1281f8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:10.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.116+0000 7fc127fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1280cf540 0x7fc1281f8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:44806/0 (socket says 172.21.15.105:44806) 2024-09-21T03:25:10.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.116+0000 7fc127fff640 1 -- 172.21.15.105:0/3733892938 learned_addr learned my addr 172.21.15.105:0/3733892938 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:10.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.116+0000 7fc1277fe640 1 --2- 172.21.15.105:0/3733892938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1280b64e0 0x7fc128150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:10.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.116+0000 7fc126ffd640 1 --2- 172.21.15.105:0/3733892938 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1280b9b60 0x7fc128151030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:10.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.116+0000 7fc127fff640 1 -- 172.21.15.105:0/3733892938 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1280b9b60 msgr2=0x7fc128151030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:10.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.116+0000 7fc127fff640 1 --2- 172.21.15.105:0/3733892938 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1280b9b60 0x7fc128151030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:10.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.116+0000 7fc127fff640 1 -- 172.21.15.105:0/3733892938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1280b64e0 msgr2=0x7fc128150af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:10.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.116+0000 7fc127fff640 1 --2- 172.21.15.105:0/3733892938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1280b64e0 0x7fc128150af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:10.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.116+0000 7fc127fff640 1 -- 172.21.15.105:0/3733892938 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc12815d160 con 0x7fc1280cf540 2024-09-21T03:25:10.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.116+0000 7fc126ffd640 1 --2- 172.21.15.105:0/3733892938 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1280b9b60 0x7fc128151030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:25:10.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.117+0000 7fc127fff640 1 --2- 172.21.15.105:0/3733892938 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1280cf540 0x7fc1281f8ed0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fc120034040 tx=0x7fc120003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:10.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.117+0000 7fc10ffff640 1 -- 172.21.15.105:0/3733892938 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc12003e030 con 0x7fc1280cf540 2024-09-21T03:25:10.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.117+0000 7fc10ffff640 1 -- 172.21.15.105:0/3733892938 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc120003c20 con 0x7fc1280cf540 2024-09-21T03:25:10.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.117+0000 7fc10ffff640 1 -- 172.21.15.105:0/3733892938 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc120035040 con 0x7fc1280cf540 2024-09-21T03:25:10.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.117+0000 7fc12e18b640 1 -- 172.21.15.105:0/3733892938 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1280c87e0 con 0x7fc1280cf540 2024-09-21T03:25:10.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.117+0000 7fc12e18b640 1 -- 172.21.15.105:0/3733892938 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1280cc770 con 0x7fc1280cf540 2024-09-21T03:25:10.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.118+0000 7fc12e18b640 1 -- 172.21.15.105:0/3733892938 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1280d4d80 con 0x7fc1280cf540 2024-09-21T03:25:10.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.119+0000 7fc10ffff640 1 -- 172.21.15.105:0/3733892938 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc120041030 con 0x7fc1280cf540 2024-09-21T03:25:10.122 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.119+0000 7fc10ffff640 1 --2- 172.21.15.105:0/3733892938 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc114078b90 0x7fc11407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:10.122 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.119+0000 7fc10ffff640 1 -- 172.21.15.105:0/3733892938 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7fc1200bb620 con 0x7fc1280cf540 2024-09-21T03:25:10.122 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.119+0000 7fc1277fe640 1 --2- 172.21.15.105:0/3733892938 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc114078b90 0x7fc11407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:10.122 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.120+0000 7fc1277fe640 1 --2- 172.21.15.105:0/3733892938 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc114078b90 0x7fc11407b0a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc118005fd0 tx=0x7fc1180094a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:10.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.123+0000 7fc10ffff640 1 -- 172.21.15.105:0/3733892938 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc1200834b0 con 0x7fc1280cf540 2024-09-21T03:25:10.299 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.297+0000 7fc12e18b640 1 -- 172.21.15.105:0/3733892938 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc1280d3fb0 con 0x7fc114078b90 2024-09-21T03:25:10.303 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.302+0000 7fc10ffff640 1 -- 172.21.15.105:0/3733892938 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251298 (secure 0 0 0) 0x7fc1280d3fb0 con 0x7fc114078b90 2024-09-21T03:25:10.306 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:10.307 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:25:10.308 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.305+0000 7fc12e18b640 1 -- 172.21.15.105:0/3733892938 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc114078b90 msgr2=0x7fc11407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:10.308 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.305+0000 7fc12e18b640 1 --2- 172.21.15.105:0/3733892938 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc114078b90 0x7fc11407b0a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc118005fd0 tx=0x7fc1180094a0 comp rx=0 tx=0).stop 2024-09-21T03:25:10.308 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.305+0000 7fc12e18b640 1 -- 172.21.15.105:0/3733892938 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1280cf540 msgr2=0x7fc1281f8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:10.308 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.305+0000 7fc12e18b640 1 --2- 172.21.15.105:0/3733892938 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1280cf540 0x7fc1281f8ed0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fc120034040 tx=0x7fc120003820 comp rx=0 tx=0).stop 2024-09-21T03:25:10.308 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.305+0000 7fc12e18b640 1 -- 172.21.15.105:0/3733892938 shutdown_connections 2024-09-21T03:25:10.308 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.305+0000 7fc12e18b640 1 --2- 172.21.15.105:0/3733892938 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc114078b90 0x7fc11407b0a0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:10.308 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.305+0000 7fc12e18b640 1 --2- 172.21.15.105:0/3733892938 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1280cf540 0x7fc1281f8ed0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:10.309 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.305+0000 7fc12e18b640 1 --2- 172.21.15.105:0/3733892938 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1280b9b60 0x7fc128151030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:10.309 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.305+0000 7fc12e18b640 1 --2- 172.21.15.105:0/3733892938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1280b64e0 0x7fc128150af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:10.309 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.305+0000 7fc12e18b640 1 -- 172.21.15.105:0/3733892938 >> 172.21.15.105:0/3733892938 conn(0x7fc12809d7f0 msgr2=0x7fc128161ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:10.309 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.305+0000 7fc12e18b640 1 -- 172.21.15.105:0/3733892938 shutdown_connections 2024-09-21T03:25:10.309 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.305+0000 7fc12e18b640 1 -- 172.21.15.105:0/3733892938 wait complete. 2024-09-21T03:25:10.318 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":304,"stamp":"2024-09-21T03:25:09.386466+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591054,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":134,"num_write_kb":1637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":134,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":264852,"kb_used_data":11144,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754709868,"statfs":{"total":773094113280,"available":772822904832,"internally_reserved":0,"allocated":11411456,"data_stored":5497810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":686,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.457263"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.957598+0000","last_change":"2024-09-21T03:25:05.957598+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.957598+0000","last_undegraded":"2024-09-21T03:25:05.957598+0000","last_fullsized":"2024-09-21T03:25:05.957598+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958208+0000","last_change":"2024-09-21T03:25:06.960292+0000","last_active":"2024-09-21T03:25:07.958208+0000","last_peered":"2024-09-21T03:25:07.958208+0000","last_clean":"2024-09-21T03:25:07.958208+0000","last_became_active":"2024-09-21T03:25:06.959916+0000","last_became_peered":"2024-09-21T03:25:06.959916+0000","last_unstale":"2024-09-21T03:25:07.958208+0000","last_undegraded":"2024-09-21T03:25:07.958208+0000","last_fullsized":"2024-09-21T03:25:07.958208+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:46.004543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954544+0000","last_change":"2024-09-21T03:25:06.950883+0000","last_active":"2024-09-21T03:25:07.954544+0000","last_peered":"2024-09-21T03:25:07.954544+0000","last_clean":"2024-09-21T03:25:07.954544+0000","last_became_active":"2024-09-21T03:25:06.948632+0000","last_became_peered":"2024-09-21T03:25:06.948632+0000","last_unstale":"2024-09-21T03:25:07.954544+0000","last_undegraded":"2024-09-21T03:25:07.954544+0000","last_fullsized":"2024-09-21T03:25:07.954544+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:46.652368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.957630+0000","last_change":"2024-09-21T03:25:05.957630+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.957630+0000","last_undegraded":"2024-09-21T03:25:05.957630+0000","last_fullsized":"2024-09-21T03:25:05.957630+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.955650+0000","last_change":"2024-09-21T03:25:06.953631+0000","last_active":"2024-09-21T03:25:06.955650+0000","last_peered":"2024-09-21T03:25:06.955650+0000","last_clean":"2024-09-21T03:25:06.955650+0000","last_became_active":"2024-09-21T03:25:06.953277+0000","last_became_peered":"2024-09-21T03:25:06.953277+0000","last_unstale":"2024-09-21T03:25:06.955650+0000","last_undegraded":"2024-09-21T03:25:06.955650+0000","last_fullsized":"2024-09-21T03:25:06.955650+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:41.069474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.959528+0000","last_change":"2024-09-21T03:25:06.957920+0000","last_active":"2024-09-21T03:25:06.959528+0000","last_peered":"2024-09-21T03:25:06.959528+0000","last_clean":"2024-09-21T03:25:06.959528+0000","last_became_active":"2024-09-21T03:25:06.957312+0000","last_became_peered":"2024-09-21T03:25:06.957312+0000","last_unstale":"2024-09-21T03:25:06.959528+0000","last_undegraded":"2024-09-21T03:25:06.959528+0000","last_fullsized":"2024-09-21T03:25:06.959528+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:59:38.300937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.961126+0000","last_change":"2024-09-21T03:25:06.955776+0000","last_active":"2024-09-21T03:25:06.961126+0000","last_peered":"2024-09-21T03:25:06.961126+0000","last_clean":"2024-09-21T03:25:06.961126+0000","last_became_active":"2024-09-21T03:25:06.955407+0000","last_became_peered":"2024-09-21T03:25:06.955407+0000","last_unstale":"2024-09-21T03:25:06.961126+0000","last_undegraded":"2024-09-21T03:25:06.961126+0000","last_fullsized":"2024-09-21T03:25:06.961126+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:12.663157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954048+0000","last_change":"2024-09-21T03:25:06.958844+0000","last_active":"2024-09-21T03:25:07.954048+0000","last_peered":"2024-09-21T03:25:07.954048+0000","last_clean":"2024-09-21T03:25:07.954048+0000","last_became_active":"2024-09-21T03:25:06.958516+0000","last_became_peered":"2024-09-21T03:25:06.958516+0000","last_unstale":"2024-09-21T03:25:07.954048+0000","last_undegraded":"2024-09-21T03:25:07.954048+0000","last_fullsized":"2024-09-21T03:25:07.954048+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:13.569228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.957055+0000","last_change":"2024-09-21T03:25:05.957055+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.957055+0000","last_undegraded":"2024-09-21T03:25:05.957055+0000","last_fullsized":"2024-09-21T03:25:05.957055+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.956508+0000","last_change":"2024-09-21T03:25:05.956508+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.956508+0000","last_undegraded":"2024-09-21T03:25:05.956508+0000","last_fullsized":"2024-09-21T03:25:05.956508+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.959300+0000","last_change":"2024-09-21T03:25:06.951779+0000","last_active":"2024-09-21T03:25:07.959300+0000","last_peered":"2024-09-21T03:25:07.959300+0000","last_clean":"2024-09-21T03:25:07.959300+0000","last_became_active":"2024-09-21T03:25:06.951424+0000","last_became_peered":"2024-09-21T03:25:06.951424+0000","last_unstale":"2024-09-21T03:25:07.959300+0000","last_undegraded":"2024-09-21T03:25:07.959300+0000","last_fullsized":"2024-09-21T03:25:07.959300+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:45.933380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.956841+0000","last_change":"2024-09-21T03:25:05.956841+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.956841+0000","last_undegraded":"2024-09-21T03:25:05.956841+0000","last_fullsized":"2024-09-21T03:25:05.956841+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954480+0000","last_change":"2024-09-21T03:25:06.957896+0000","last_active":"2024-09-21T03:25:07.954480+0000","last_peered":"2024-09-21T03:25:07.954480+0000","last_clean":"2024-09-21T03:25:07.954480+0000","last_became_active":"2024-09-21T03:25:06.957553+0000","last_became_peered":"2024-09-21T03:25:06.957553+0000","last_unstale":"2024-09-21T03:25:07.954480+0000","last_undegraded":"2024-09-21T03:25:07.954480+0000","last_fullsized":"2024-09-21T03:25:07.954480+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:57.501083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954067+0000","last_change":"2024-09-21T03:25:06.956034+0000","last_active":"2024-09-21T03:25:07.954067+0000","last_peered":"2024-09-21T03:25:07.954067+0000","last_clean":"2024-09-21T03:25:07.954067+0000","last_became_active":"2024-09-21T03:25:06.955669+0000","last_became_peered":"2024-09-21T03:25:06.955669+0000","last_unstale":"2024-09-21T03:25:07.954067+0000","last_undegraded":"2024-09-21T03:25:07.954067+0000","last_fullsized":"2024-09-21T03:25:07.954067+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:33.027782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.961407+0000","last_change":"2024-09-21T03:25:06.955229+0000","last_active":"2024-09-21T03:25:06.961407+0000","last_peered":"2024-09-21T03:25:06.961407+0000","last_clean":"2024-09-21T03:25:06.961407+0000","last_became_active":"2024-09-21T03:25:06.954918+0000","last_became_peered":"2024-09-21T03:25:06.954918+0000","last_unstale":"2024-09-21T03:25:06.961407+0000","last_undegraded":"2024-09-21T03:25:06.961407+0000","last_fullsized":"2024-09-21T03:25:06.961407+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:53:15.188760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.954927+0000","last_change":"2024-09-21T03:25:05.954927+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.954927+0000","last_undegraded":"2024-09-21T03:25:05.954927+0000","last_fullsized":"2024-09-21T03:25:05.954927+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958041+0000","last_change":"2024-09-21T03:25:06.948574+0000","last_active":"2024-09-21T03:25:07.958041+0000","last_peered":"2024-09-21T03:25:07.958041+0000","last_clean":"2024-09-21T03:25:07.958041+0000","last_became_active":"2024-09-21T03:25:06.948291+0000","last_became_peered":"2024-09-21T03:25:06.948291+0000","last_unstale":"2024-09-21T03:25:07.958041+0000","last_undegraded":"2024-09-21T03:25:07.958041+0000","last_fullsized":"2024-09-21T03:25:07.958041+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:23.103570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958690+0000","last_change":"2024-09-21T03:25:06.943830+0000","last_active":"2024-09-21T03:25:07.958690+0000","last_peered":"2024-09-21T03:25:07.958690+0000","last_clean":"2024-09-21T03:25:07.958690+0000","last_became_active":"2024-09-21T03:25:06.943492+0000","last_became_peered":"2024-09-21T03:25:06.943492+0000","last_unstale":"2024-09-21T03:25:07.958690+0000","last_undegraded":"2024-09-21T03:25:07.958690+0000","last_fullsized":"2024-09-21T03:25:07.958690+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:58.003935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954528+0000","last_change":"2024-09-21T03:25:06.956428+0000","last_active":"2024-09-21T03:25:07.954528+0000","last_peered":"2024-09-21T03:25:07.954528+0000","last_clean":"2024-09-21T03:25:07.954528+0000","last_became_active":"2024-09-21T03:25:06.955989+0000","last_became_peered":"2024-09-21T03:25:06.955989+0000","last_unstale":"2024-09-21T03:25:07.954528+0000","last_undegraded":"2024-09-21T03:25:07.954528+0000","last_fullsized":"2024-09-21T03:25:07.954528+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:05.806487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958257+0000","last_change":"2024-09-21T03:25:06.946863+0000","last_active":"2024-09-21T03:25:07.958257+0000","last_peered":"2024-09-21T03:25:07.958257+0000","last_clean":"2024-09-21T03:25:07.958257+0000","last_became_active":"2024-09-21T03:25:06.946516+0000","last_became_peered":"2024-09-21T03:25:06.946516+0000","last_unstale":"2024-09-21T03:25:07.958257+0000","last_undegraded":"2024-09-21T03:25:07.958257+0000","last_fullsized":"2024-09-21T03:25:07.958257+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:14.835962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.959036+0000","last_change":"2024-09-21T03:25:06.952971+0000","last_active":"2024-09-21T03:25:07.959036+0000","last_peered":"2024-09-21T03:25:07.959036+0000","last_clean":"2024-09-21T03:25:07.959036+0000","last_became_active":"2024-09-21T03:25:06.952598+0000","last_became_peered":"2024-09-21T03:25:06.952598+0000","last_unstale":"2024-09-21T03:25:07.959036+0000","last_undegraded":"2024-09-21T03:25:07.959036+0000","last_fullsized":"2024-09-21T03:25:07.959036+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:11.279234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.957889+0000","last_change":"2024-09-21T03:25:06.953872+0000","last_active":"2024-09-21T03:25:06.957889+0000","last_peered":"2024-09-21T03:25:06.957889+0000","last_clean":"2024-09-21T03:25:06.957889+0000","last_became_active":"2024-09-21T03:25:06.953516+0000","last_became_peered":"2024-09-21T03:25:06.953516+0000","last_unstale":"2024-09-21T03:25:06.957889+0000","last_undegraded":"2024-09-21T03:25:06.957889+0000","last_fullsized":"2024-09-21T03:25:06.957889+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:49.780931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.957699+0000","last_change":"2024-09-21T03:25:06.946898+0000","last_active":"2024-09-21T03:25:07.957699+0000","last_peered":"2024-09-21T03:25:07.957699+0000","last_clean":"2024-09-21T03:25:07.957699+0000","last_became_active":"2024-09-21T03:25:06.946529+0000","last_became_peered":"2024-09-21T03:25:06.946529+0000","last_unstale":"2024-09-21T03:25:07.957699+0000","last_undegraded":"2024-09-21T03:25:07.957699+0000","last_fullsized":"2024-09-21T03:25:07.957699+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:28.581453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.964617+0000","last_change":"2024-09-21T03:25:06.963339+0000","last_active":"2024-09-21T03:25:06.964617+0000","last_peered":"2024-09-21T03:25:06.964617+0000","last_clean":"2024-09-21T03:25:06.964617+0000","last_became_active":"2024-09-21T03:25:06.963052+0000","last_became_peered":"2024-09-21T03:25:06.963052+0000","last_unstale":"2024-09-21T03:25:06.964617+0000","last_undegraded":"2024-09-21T03:25:06.964617+0000","last_fullsized":"2024-09-21T03:25:06.964617+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:45.382063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958302+0000","last_change":"2024-09-21T03:25:06.947798+0000","last_active":"2024-09-21T03:25:07.958302+0000","last_peered":"2024-09-21T03:25:07.958302+0000","last_clean":"2024-09-21T03:25:07.958302+0000","last_became_active":"2024-09-21T03:25:06.947494+0000","last_became_peered":"2024-09-21T03:25:06.947494+0000","last_unstale":"2024-09-21T03:25:07.958302+0000","last_undegraded":"2024-09-21T03:25:07.958302+0000","last_fullsized":"2024-09-21T03:25:07.958302+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:58.003935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.953063+0000","last_change":"2024-09-21T03:25:05.953063+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.953063+0000","last_undegraded":"2024-09-21T03:25:05.953063+0000","last_fullsized":"2024-09-21T03:25:05.953063+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.966709+0000","last_change":"2024-09-21T03:25:06.965906+0000","last_active":"2024-09-21T03:25:06.966709+0000","last_peered":"2024-09-21T03:25:06.966709+0000","last_clean":"2024-09-21T03:25:06.966709+0000","last_became_active":"2024-09-21T03:25:06.965595+0000","last_became_peered":"2024-09-21T03:25:06.965595+0000","last_unstale":"2024-09-21T03:25:06.966709+0000","last_undegraded":"2024-09-21T03:25:06.966709+0000","last_fullsized":"2024-09-21T03:25:06.966709+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:32.430160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.974231+0000","last_change":"2024-09-21T03:25:06.972998+0000","last_active":"2024-09-21T03:25:06.974231+0000","last_peered":"2024-09-21T03:25:06.974231+0000","last_clean":"2024-09-21T03:25:06.974231+0000","last_became_active":"2024-09-21T03:25:06.972535+0000","last_became_peered":"2024-09-21T03:25:06.972535+0000","last_unstale":"2024-09-21T03:25:06.974231+0000","last_undegraded":"2024-09-21T03:25:06.974231+0000","last_fullsized":"2024-09-21T03:25:06.974231+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:23.886522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958517+0000","last_change":"2024-09-21T03:25:06.949102+0000","last_active":"2024-09-21T03:25:07.958517+0000","last_peered":"2024-09-21T03:25:07.958517+0000","last_clean":"2024-09-21T03:25:07.958517+0000","last_became_active":"2024-09-21T03:25:06.947993+0000","last_became_peered":"2024-09-21T03:25:06.947993+0000","last_unstale":"2024-09-21T03:25:07.958517+0000","last_undegraded":"2024-09-21T03:25:07.958517+0000","last_fullsized":"2024-09-21T03:25:07.958517+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:13.975782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.964008+0000","last_change":"2024-09-21T03:25:06.956996+0000","last_active":"2024-09-21T03:25:06.964008+0000","last_peered":"2024-09-21T03:25:06.964008+0000","last_clean":"2024-09-21T03:25:06.964008+0000","last_became_active":"2024-09-21T03:25:06.956687+0000","last_became_peered":"2024-09-21T03:25:06.956687+0000","last_unstale":"2024-09-21T03:25:06.964008+0000","last_undegraded":"2024-09-21T03:25:06.964008+0000","last_fullsized":"2024-09-21T03:25:06.964008+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:08.899356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.951900+0000","last_change":"2024-09-21T03:25:05.951900+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.951900+0000","last_undegraded":"2024-09-21T03:25:05.951900+0000","last_fullsized":"2024-09-21T03:25:05.951900+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.960078+0000","last_change":"2024-09-21T03:25:06.956017+0000","last_active":"2024-09-21T03:25:06.960078+0000","last_peered":"2024-09-21T03:25:06.960078+0000","last_clean":"2024-09-21T03:25:06.960078+0000","last_became_active":"2024-09-21T03:25:06.955640+0000","last_became_peered":"2024-09-21T03:25:06.955640+0000","last_unstale":"2024-09-21T03:25:06.960078+0000","last_undegraded":"2024-09-21T03:25:06.960078+0000","last_fullsized":"2024-09-21T03:25:06.960078+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:08.286393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.958319+0000","last_change":"2024-09-21T03:25:06.956659+0000","last_active":"2024-09-21T03:25:06.958319+0000","last_peered":"2024-09-21T03:25:06.958319+0000","last_clean":"2024-09-21T03:25:06.958319+0000","last_became_active":"2024-09-21T03:25:06.956166+0000","last_became_peered":"2024-09-21T03:25:06.956166+0000","last_unstale":"2024-09-21T03:25:06.958319+0000","last_undegraded":"2024-09-21T03:25:06.958319+0000","last_fullsized":"2024-09-21T03:25:06.958319+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:34.288116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"103'4","reported_seq":17,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.969661+0000","last_change":"2024-09-21T03:25:05.950693+0000","last_active":"2024-09-21T03:25:06.969661+0000","last_peered":"2024-09-21T03:25:06.969661+0000","last_clean":"2024-09-21T03:25:06.969661+0000","last_became_active":"2024-09-21T03:25:05.950331+0000","last_became_peered":"2024-09-21T03:25:05.950331+0000","last_unstale":"2024-09-21T03:25:06.969661+0000","last_undegraded":"2024-09-21T03:25:06.969661+0000","last_fullsized":"2024-09-21T03:25:06.969661+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:59.771445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958729+0000","last_change":"2024-09-21T03:25:06.946964+0000","last_active":"2024-09-21T03:25:07.958729+0000","last_peered":"2024-09-21T03:25:07.958729+0000","last_clean":"2024-09-21T03:25:07.958729+0000","last_became_active":"2024-09-21T03:25:06.945956+0000","last_became_peered":"2024-09-21T03:25:06.945956+0000","last_unstale":"2024-09-21T03:25:07.958729+0000","last_undegraded":"2024-09-21T03:25:07.958729+0000","last_fullsized":"2024-09-21T03:25:07.958729+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:49.780931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954228+0000","last_change":"2024-09-21T03:25:05.948457+0000","last_active":"2024-09-21T03:25:07.954228+0000","last_peered":"2024-09-21T03:25:07.954228+0000","last_clean":"2024-09-21T03:25:07.954228+0000","last_became_active":"2024-09-21T03:25:05.948136+0000","last_became_peered":"2024-09-21T03:25:05.948136+0000","last_unstale":"2024-09-21T03:25:07.954228+0000","last_undegraded":"2024-09-21T03:25:07.954228+0000","last_fullsized":"2024-09-21T03:25:07.954228+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:27.577914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.959487+0000","last_change":"2024-09-21T03:25:06.957624+0000","last_active":"2024-09-21T03:25:06.959487+0000","last_peered":"2024-09-21T03:25:06.959487+0000","last_clean":"2024-09-21T03:25:06.959487+0000","last_became_active":"2024-09-21T03:25:06.957274+0000","last_became_peered":"2024-09-21T03:25:06.957274+0000","last_unstale":"2024-09-21T03:25:06.959487+0000","last_undegraded":"2024-09-21T03:25:06.959487+0000","last_fullsized":"2024-09-21T03:25:06.959487+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:09.843286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.967196+0000","last_change":"2024-09-21T03:25:05.956340+0000","last_active":"2024-09-21T03:25:06.967196+0000","last_peered":"2024-09-21T03:25:06.967196+0000","last_clean":"2024-09-21T03:25:06.967196+0000","last_became_active":"2024-09-21T03:25:05.956023+0000","last_became_peered":"2024-09-21T03:25:05.956023+0000","last_unstale":"2024-09-21T03:25:06.967196+0000","last_undegraded":"2024-09-21T03:25:06.967196+0000","last_fullsized":"2024-09-21T03:25:06.967196+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:16.344677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954681+0000","last_change":"2024-09-21T03:25:06.954812+0000","last_active":"2024-09-21T03:25:07.954681+0000","last_peered":"2024-09-21T03:25:07.954681+0000","last_clean":"2024-09-21T03:25:07.954681+0000","last_became_active":"2024-09-21T03:25:06.954324+0000","last_became_peered":"2024-09-21T03:25:06.954324+0000","last_unstale":"2024-09-21T03:25:07.954681+0000","last_undegraded":"2024-09-21T03:25:07.954681+0000","last_fullsized":"2024-09-21T03:25:07.954681+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:31.650403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.967394+0000","last_change":"2024-09-21T03:25:05.951073+0000","last_active":"2024-09-21T03:25:06.967394+0000","last_peered":"2024-09-21T03:25:06.967394+0000","last_clean":"2024-09-21T03:25:06.967394+0000","last_became_active":"2024-09-21T03:25:05.950749+0000","last_became_peered":"2024-09-21T03:25:05.950749+0000","last_unstale":"2024-09-21T03:25:06.967394+0000","last_undegraded":"2024-09-21T03:25:06.967394+0000","last_fullsized":"2024-09-21T03:25:06.967394+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:07.037456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.951678+0000","last_change":"2024-09-21T03:25:05.951678+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.951678+0000","last_undegraded":"2024-09-21T03:25:05.951678+0000","last_fullsized":"2024-09-21T03:25:05.951678+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"103'1","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.966866+0000","last_change":"2024-09-21T03:25:05.952018+0000","last_active":"2024-09-21T03:25:06.966866+0000","last_peered":"2024-09-21T03:25:06.966866+0000","last_clean":"2024-09-21T03:25:06.966866+0000","last_became_active":"2024-09-21T03:25:05.951683+0000","last_became_peered":"2024-09-21T03:25:05.951683+0000","last_unstale":"2024-09-21T03:25:06.966866+0000","last_undegraded":"2024-09-21T03:25:06.966866+0000","last_fullsized":"2024-09-21T03:25:06.966866+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:06:17.348336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958896+0000","last_change":"2024-09-21T03:25:06.960288+0000","last_active":"2024-09-21T03:25:07.958896+0000","last_peered":"2024-09-21T03:25:07.958896+0000","last_clean":"2024-09-21T03:25:07.958896+0000","last_became_active":"2024-09-21T03:25:06.959943+0000","last_became_peered":"2024-09-21T03:25:06.959943+0000","last_unstale":"2024-09-21T03:25:07.958896+0000","last_undegraded":"2024-09-21T03:25:07.958896+0000","last_fullsized":"2024-09-21T03:25:07.958896+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:49.944202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"103'1","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.967731+0000","last_change":"2024-09-21T03:25:05.948442+0000","last_active":"2024-09-21T03:25:06.967731+0000","last_peered":"2024-09-21T03:25:06.967731+0000","last_clean":"2024-09-21T03:25:06.967731+0000","last_became_active":"2024-09-21T03:25:05.947682+0000","last_became_peered":"2024-09-21T03:25:05.947682+0000","last_unstale":"2024-09-21T03:25:06.967731+0000","last_undegraded":"2024-09-21T03:25:06.967731+0000","last_fullsized":"2024-09-21T03:25:06.967731+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:57.000396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.954176+0000","last_change":"2024-09-21T03:25:05.954176+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.954176+0000","last_undegraded":"2024-09-21T03:25:05.954176+0000","last_fullsized":"2024-09-21T03:25:05.954176+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.957616+0000","last_change":"2024-09-21T03:25:05.954213+0000","last_active":"2024-09-21T03:25:07.957616+0000","last_peered":"2024-09-21T03:25:07.957616+0000","last_clean":"2024-09-21T03:25:07.957616+0000","last_became_active":"2024-09-21T03:25:05.953869+0000","last_became_peered":"2024-09-21T03:25:05.953869+0000","last_unstale":"2024-09-21T03:25:07.957616+0000","last_undegraded":"2024-09-21T03:25:07.957616+0000","last_fullsized":"2024-09-21T03:25:07.957616+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:07.895817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.961160+0000","last_change":"2024-09-21T03:25:06.955915+0000","last_active":"2024-09-21T03:25:06.961160+0000","last_peered":"2024-09-21T03:25:06.961160+0000","last_clean":"2024-09-21T03:25:06.961160+0000","last_became_active":"2024-09-21T03:25:06.955458+0000","last_became_peered":"2024-09-21T03:25:06.955458+0000","last_unstale":"2024-09-21T03:25:06.961160+0000","last_undegraded":"2024-09-21T03:25:06.961160+0000","last_fullsized":"2024-09-21T03:25:06.961160+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:10.995084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.961676+0000","last_change":"2024-09-21T03:25:05.960268+0000","last_active":"2024-09-21T03:25:05.961676+0000","last_peered":"2024-09-21T03:25:05.961676+0000","last_clean":"2024-09-21T03:25:05.961676+0000","last_became_active":"2024-09-21T03:25:05.959378+0000","last_became_peered":"2024-09-21T03:25:05.959378+0000","last_unstale":"2024-09-21T03:25:05.961676+0000","last_undegraded":"2024-09-21T03:25:05.961676+0000","last_fullsized":"2024-09-21T03:25:05.961676+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:13.516789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.961224+0000","last_change":"2024-09-21T03:25:06.954630+0000","last_active":"2024-09-21T03:25:06.961224+0000","last_peered":"2024-09-21T03:25:06.961224+0000","last_clean":"2024-09-21T03:25:06.961224+0000","last_became_active":"2024-09-21T03:25:06.953583+0000","last_became_peered":"2024-09-21T03:25:06.953583+0000","last_unstale":"2024-09-21T03:25:06.961224+0000","last_undegraded":"2024-09-21T03:25:06.961224+0000","last_fullsized":"2024-09-21T03:25:06.961224+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:33.610686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.942545+0000","last_change":"2024-09-21T03:25:05.954201+0000","last_active":"2024-09-21T03:25:06.942545+0000","last_peered":"2024-09-21T03:25:06.942545+0000","last_clean":"2024-09-21T03:25:06.942545+0000","last_became_active":"2024-09-21T03:25:05.953878+0000","last_became_peered":"2024-09-21T03:25:05.953878+0000","last_unstale":"2024-09-21T03:25:06.942545+0000","last_undegraded":"2024-09-21T03:25:06.942545+0000","last_fullsized":"2024-09-21T03:25:06.942545+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:05.935127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958898+0000","last_change":"2024-09-21T03:25:06.968378+0000","last_active":"2024-09-21T03:25:07.958898+0000","last_peered":"2024-09-21T03:25:07.958898+0000","last_clean":"2024-09-21T03:25:07.958898+0000","last_became_active":"2024-09-21T03:25:06.967606+0000","last_became_peered":"2024-09-21T03:25:06.967606+0000","last_unstale":"2024-09-21T03:25:07.958898+0000","last_undegraded":"2024-09-21T03:25:07.958898+0000","last_fullsized":"2024-09-21T03:25:07.958898+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:13.975782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.944468+0000","last_change":"2024-09-21T03:25:05.946765+0000","last_active":"2024-09-21T03:25:06.944468+0000","last_peered":"2024-09-21T03:25:06.944468+0000","last_clean":"2024-09-21T03:25:06.944468+0000","last_became_active":"2024-09-21T03:25:05.946454+0000","last_became_peered":"2024-09-21T03:25:05.946454+0000","last_unstale":"2024-09-21T03:25:06.944468+0000","last_undegraded":"2024-09-21T03:25:06.944468+0000","last_fullsized":"2024-09-21T03:25:06.944468+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:22.100031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.964558+0000","last_change":"2024-09-21T03:25:06.960519+0000","last_active":"2024-09-21T03:25:06.964558+0000","last_peered":"2024-09-21T03:25:06.964558+0000","last_clean":"2024-09-21T03:25:06.964558+0000","last_became_active":"2024-09-21T03:25:06.960164+0000","last_became_peered":"2024-09-21T03:25:06.960164+0000","last_unstale":"2024-09-21T03:25:06.964558+0000","last_undegraded":"2024-09-21T03:25:06.964558+0000","last_fullsized":"2024-09-21T03:25:06.964558+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:59:33.809395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.956794+0000","last_change":"2024-09-21T03:25:05.953557+0000","last_active":"2024-09-21T03:25:05.956794+0000","last_peered":"2024-09-21T03:25:05.956794+0000","last_clean":"2024-09-21T03:25:05.956794+0000","last_became_active":"2024-09-21T03:25:05.953163+0000","last_became_peered":"2024-09-21T03:25:05.953163+0000","last_unstale":"2024-09-21T03:25:05.956794+0000","last_undegraded":"2024-09-21T03:25:05.956794+0000","last_fullsized":"2024-09-21T03:25:05.956794+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:42.745888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.956692+0000","last_change":"2024-09-21T03:25:06.954185+0000","last_active":"2024-09-21T03:25:06.956692+0000","last_peered":"2024-09-21T03:25:06.956692+0000","last_clean":"2024-09-21T03:25:06.956692+0000","last_became_active":"2024-09-21T03:25:06.953834+0000","last_became_peered":"2024-09-21T03:25:06.953834+0000","last_unstale":"2024-09-21T03:25:06.956692+0000","last_undegraded":"2024-09-21T03:25:06.956692+0000","last_fullsized":"2024-09-21T03:25:06.956692+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:27:48.468098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.961437+0000","last_change":"2024-09-21T03:25:05.959732+0000","last_active":"2024-09-21T03:25:05.961437+0000","last_peered":"2024-09-21T03:25:05.961437+0000","last_clean":"2024-09-21T03:25:05.961437+0000","last_became_active":"2024-09-21T03:25:05.959393+0000","last_became_peered":"2024-09-21T03:25:05.959393+0000","last_unstale":"2024-09-21T03:25:05.961437+0000","last_undegraded":"2024-09-21T03:25:05.961437+0000","last_fullsized":"2024-09-21T03:25:05.961437+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:54.217867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.964650+0000","last_change":"2024-09-21T03:25:06.959029+0000","last_active":"2024-09-21T03:25:06.964650+0000","last_peered":"2024-09-21T03:25:06.964650+0000","last_clean":"2024-09-21T03:25:06.964650+0000","last_became_active":"2024-09-21T03:25:06.958443+0000","last_became_peered":"2024-09-21T03:25:06.958443+0000","last_unstale":"2024-09-21T03:25:06.964650+0000","last_undegraded":"2024-09-21T03:25:06.964650+0000","last_fullsized":"2024-09-21T03:25:06.964650+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:41:16.872769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.967401+0000","last_change":"2024-09-21T03:25:05.946740+0000","last_active":"2024-09-21T03:25:06.967401+0000","last_peered":"2024-09-21T03:25:06.967401+0000","last_clean":"2024-09-21T03:25:06.967401+0000","last_became_active":"2024-09-21T03:25:05.946438+0000","last_became_peered":"2024-09-21T03:25:05.946438+0000","last_unstale":"2024-09-21T03:25:06.967401+0000","last_undegraded":"2024-09-21T03:25:06.967401+0000","last_fullsized":"2024-09-21T03:25:06.967401+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:27.205093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.958138+0000","last_change":"2024-09-21T03:25:06.954978+0000","last_active":"2024-09-21T03:25:06.958138+0000","last_peered":"2024-09-21T03:25:06.958138+0000","last_clean":"2024-09-21T03:25:06.958138+0000","last_became_active":"2024-09-21T03:25:06.954688+0000","last_became_peered":"2024-09-21T03:25:06.954688+0000","last_unstale":"2024-09-21T03:25:06.958138+0000","last_undegraded":"2024-09-21T03:25:06.958138+0000","last_fullsized":"2024-09-21T03:25:06.958138+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:03.305218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958184+0000","last_change":"2024-09-21T03:25:05.960010+0000","last_active":"2024-09-21T03:25:07.958184+0000","last_peered":"2024-09-21T03:25:07.958184+0000","last_clean":"2024-09-21T03:25:07.958184+0000","last_became_active":"2024-09-21T03:25:05.959699+0000","last_became_peered":"2024-09-21T03:25:05.959699+0000","last_unstale":"2024-09-21T03:25:07.958184+0000","last_undegraded":"2024-09-21T03:25:07.958184+0000","last_fullsized":"2024-09-21T03:25:07.958184+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:33.984094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.957851+0000","last_change":"2024-09-21T03:25:06.954255+0000","last_active":"2024-09-21T03:25:06.957851+0000","last_peered":"2024-09-21T03:25:06.957851+0000","last_clean":"2024-09-21T03:25:06.957851+0000","last_became_active":"2024-09-21T03:25:06.953960+0000","last_became_peered":"2024-09-21T03:25:06.953960+0000","last_unstale":"2024-09-21T03:25:06.957851+0000","last_undegraded":"2024-09-21T03:25:06.957851+0000","last_fullsized":"2024-09-21T03:25:06.957851+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:13.975782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"103'8","reported_seq":21,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.971415+0000","last_change":"2024-09-21T03:25:05.962238+0000","last_active":"2024-09-21T03:25:06.971415+0000","last_peered":"2024-09-21T03:25:06.971415+0000","last_clean":"2024-09-21T03:25:06.971415+0000","last_became_active":"2024-09-21T03:25:05.961869+0000","last_became_peered":"2024-09-21T03:25:05.961869+0000","last_unstale":"2024-09-21T03:25:06.971415+0000","last_undegraded":"2024-09-21T03:25:06.971415+0000","last_fullsized":"2024-09-21T03:25:06.971415+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:13.594419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.974579+0000","last_change":"2024-09-21T03:25:06.973378+0000","last_active":"2024-09-21T03:25:06.974579+0000","last_peered":"2024-09-21T03:25:06.974579+0000","last_clean":"2024-09-21T03:25:06.974579+0000","last_became_active":"2024-09-21T03:25:06.972937+0000","last_became_peered":"2024-09-21T03:25:06.972937+0000","last_unstale":"2024-09-21T03:25:06.974579+0000","last_undegraded":"2024-09-21T03:25:06.974579+0000","last_fullsized":"2024-09-21T03:25:06.974579+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:20.822035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.957250+0000","last_change":"2024-09-21T03:25:05.953632+0000","last_active":"2024-09-21T03:25:05.957250+0000","last_peered":"2024-09-21T03:25:05.957250+0000","last_clean":"2024-09-21T03:25:05.957250+0000","last_became_active":"2024-09-21T03:25:05.952747+0000","last_became_peered":"2024-09-21T03:25:05.952747+0000","last_unstale":"2024-09-21T03:25:05.957250+0000","last_undegraded":"2024-09-21T03:25:05.957250+0000","last_fullsized":"2024-09-21T03:25:05.957250+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:16.897123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.973787+0000","last_change":"2024-09-21T03:25:06.971849+0000","last_active":"2024-09-21T03:25:06.973787+0000","last_peered":"2024-09-21T03:25:06.973787+0000","last_clean":"2024-09-21T03:25:06.973787+0000","last_became_active":"2024-09-21T03:25:06.971533+0000","last_became_peered":"2024-09-21T03:25:06.971533+0000","last_unstale":"2024-09-21T03:25:06.973787+0000","last_undegraded":"2024-09-21T03:25:06.973787+0000","last_fullsized":"2024-09-21T03:25:06.973787+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:37.012007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.973664+0000","last_change":"2024-09-21T03:25:05.949862+0000","last_active":"2024-09-21T03:25:06.973664+0000","last_peered":"2024-09-21T03:25:06.973664+0000","last_clean":"2024-09-21T03:25:06.973664+0000","last_became_active":"2024-09-21T03:25:05.949503+0000","last_became_peered":"2024-09-21T03:25:05.949503+0000","last_unstale":"2024-09-21T03:25:06.973664+0000","last_undegraded":"2024-09-21T03:25:06.973664+0000","last_fullsized":"2024-09-21T03:25:06.973664+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:48.375833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954331+0000","last_change":"2024-09-21T03:25:06.968263+0000","last_active":"2024-09-21T03:25:07.954331+0000","last_peered":"2024-09-21T03:25:07.954331+0000","last_clean":"2024-09-21T03:25:07.954331+0000","last_became_active":"2024-09-21T03:25:06.967957+0000","last_became_peered":"2024-09-21T03:25:06.967957+0000","last_unstale":"2024-09-21T03:25:07.954331+0000","last_undegraded":"2024-09-21T03:25:07.954331+0000","last_fullsized":"2024-09-21T03:25:07.954331+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:38.224056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958389+0000","last_change":"2024-09-21T03:25:05.951962+0000","last_active":"2024-09-21T03:25:07.958389+0000","last_peered":"2024-09-21T03:25:07.958389+0000","last_clean":"2024-09-21T03:25:07.958389+0000","last_became_active":"2024-09-21T03:25:05.951676+0000","last_became_peered":"2024-09-21T03:25:05.951676+0000","last_unstale":"2024-09-21T03:25:07.958389+0000","last_undegraded":"2024-09-21T03:25:07.958389+0000","last_fullsized":"2024-09-21T03:25:07.958389+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:14:33.126090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954791+0000","last_change":"2024-09-21T03:25:06.958748+0000","last_active":"2024-09-21T03:25:07.954791+0000","last_peered":"2024-09-21T03:25:07.954791+0000","last_clean":"2024-09-21T03:25:07.954791+0000","last_became_active":"2024-09-21T03:25:06.958412+0000","last_became_peered":"2024-09-21T03:25:06.958412+0000","last_unstale":"2024-09-21T03:25:07.954791+0000","last_undegraded":"2024-09-21T03:25:07.954791+0000","last_fullsized":"2024-09-21T03:25:07.954791+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:02.237215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.945527+0000","last_change":"2024-09-21T03:25:05.955181+0000","last_active":"2024-09-21T03:25:06.945527+0000","last_peered":"2024-09-21T03:25:06.945527+0000","last_clean":"2024-09-21T03:25:06.945527+0000","last_became_active":"2024-09-21T03:25:05.954828+0000","last_became_peered":"2024-09-21T03:25:05.954828+0000","last_unstale":"2024-09-21T03:25:06.945527+0000","last_undegraded":"2024-09-21T03:25:06.945527+0000","last_fullsized":"2024-09-21T03:25:06.945527+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:35.311555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954227+0000","last_change":"2024-09-21T03:25:06.957965+0000","last_active":"2024-09-21T03:25:07.954227+0000","last_peered":"2024-09-21T03:25:07.954227+0000","last_clean":"2024-09-21T03:25:07.954227+0000","last_became_active":"2024-09-21T03:25:06.957637+0000","last_became_peered":"2024-09-21T03:25:06.957637+0000","last_unstale":"2024-09-21T03:25:07.954227+0000","last_undegraded":"2024-09-21T03:25:07.954227+0000","last_fullsized":"2024-09-21T03:25:07.954227+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:34.326915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.968385+0000","last_change":"2024-09-21T03:25:05.949798+0000","last_active":"2024-09-21T03:25:06.968385+0000","last_peered":"2024-09-21T03:25:06.968385+0000","last_clean":"2024-09-21T03:25:06.968385+0000","last_became_active":"2024-09-21T03:25:05.949522+0000","last_became_peered":"2024-09-21T03:25:05.949522+0000","last_unstale":"2024-09-21T03:25:06.968385+0000","last_undegraded":"2024-09-21T03:25:06.968385+0000","last_fullsized":"2024-09-21T03:25:06.968385+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:20.522015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.951118+0000","last_change":"2024-09-21T03:25:05.951118+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.951118+0000","last_undegraded":"2024-09-21T03:25:05.951118+0000","last_fullsized":"2024-09-21T03:25:05.951118+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.943364+0000","last_change":"2024-09-21T03:25:05.951055+0000","last_active":"2024-09-21T03:25:06.943364+0000","last_peered":"2024-09-21T03:25:06.943364+0000","last_clean":"2024-09-21T03:25:06.943364+0000","last_became_active":"2024-09-21T03:25:05.950689+0000","last_became_peered":"2024-09-21T03:25:05.950689+0000","last_unstale":"2024-09-21T03:25:06.943364+0000","last_undegraded":"2024-09-21T03:25:06.943364+0000","last_fullsized":"2024-09-21T03:25:06.943364+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:14.630887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954221+0000","last_change":"2024-09-21T03:25:06.957927+0000","last_active":"2024-09-21T03:25:07.954221+0000","last_peered":"2024-09-21T03:25:07.954221+0000","last_clean":"2024-09-21T03:25:07.954221+0000","last_became_active":"2024-09-21T03:25:06.956714+0000","last_became_peered":"2024-09-21T03:25:06.956714+0000","last_unstale":"2024-09-21T03:25:07.954221+0000","last_undegraded":"2024-09-21T03:25:07.954221+0000","last_fullsized":"2024-09-21T03:25:07.954221+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:28.910067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.943454+0000","last_change":"2024-09-21T03:25:05.949024+0000","last_active":"2024-09-21T03:25:06.943454+0000","last_peered":"2024-09-21T03:25:06.943454+0000","last_clean":"2024-09-21T03:25:06.943454+0000","last_became_active":"2024-09-21T03:25:05.948664+0000","last_became_peered":"2024-09-21T03:25:05.948664+0000","last_unstale":"2024-09-21T03:25:06.943454+0000","last_undegraded":"2024-09-21T03:25:06.943454+0000","last_fullsized":"2024-09-21T03:25:06.943454+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:10.198642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.970949+0000","last_change":"2024-09-21T03:25:06.966457+0000","last_active":"2024-09-21T03:25:06.970949+0000","last_peered":"2024-09-21T03:25:06.970949+0000","last_clean":"2024-09-21T03:25:06.970949+0000","last_became_active":"2024-09-21T03:25:06.965905+0000","last_became_peered":"2024-09-21T03:25:06.965905+0000","last_unstale":"2024-09-21T03:25:06.970949+0000","last_undegraded":"2024-09-21T03:25:06.970949+0000","last_fullsized":"2024-09-21T03:25:06.970949+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:28:33.939280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.964155+0000","last_change":"2024-09-21T03:25:05.961466+0000","last_active":"2024-09-21T03:25:05.964155+0000","last_peered":"2024-09-21T03:25:05.964155+0000","last_clean":"2024-09-21T03:25:05.964155+0000","last_became_active":"2024-09-21T03:25:05.961148+0000","last_became_peered":"2024-09-21T03:25:05.961148+0000","last_unstale":"2024-09-21T03:25:05.964155+0000","last_undegraded":"2024-09-21T03:25:05.964155+0000","last_fullsized":"2024-09-21T03:25:05.964155+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:07.109585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958987+0000","last_change":"2024-09-21T03:25:06.970004+0000","last_active":"2024-09-21T03:25:07.958987+0000","last_peered":"2024-09-21T03:25:07.958987+0000","last_clean":"2024-09-21T03:25:07.958987+0000","last_became_active":"2024-09-21T03:25:06.969612+0000","last_became_peered":"2024-09-21T03:25:06.969612+0000","last_unstale":"2024-09-21T03:25:07.958987+0000","last_undegraded":"2024-09-21T03:25:07.958987+0000","last_fullsized":"2024-09-21T03:25:07.958987+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:03.305218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.972709+0000","last_change":"2024-09-21T03:25:05.955665+0000","last_active":"2024-09-21T03:25:06.972709+0000","last_peered":"2024-09-21T03:25:06.972709+0000","last_clean":"2024-09-21T03:25:06.972709+0000","last_became_active":"2024-09-21T03:25:05.955365+0000","last_became_peered":"2024-09-21T03:25:05.955365+0000","last_unstale":"2024-09-21T03:25:06.972709+0000","last_undegraded":"2024-09-21T03:25:06.972709+0000","last_fullsized":"2024-09-21T03:25:06.972709+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:45.001004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.950577+0000","last_change":"2024-09-21T03:25:05.950577+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.950577+0000","last_undegraded":"2024-09-21T03:25:05.950577+0000","last_fullsized":"2024-09-21T03:25:05.950577+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958997+0000","last_change":"2024-09-21T03:25:05.949208+0000","last_active":"2024-09-21T03:25:07.958997+0000","last_peered":"2024-09-21T03:25:07.958997+0000","last_clean":"2024-09-21T03:25:07.958997+0000","last_became_active":"2024-09-21T03:25:05.948664+0000","last_became_peered":"2024-09-21T03:25:05.948664+0000","last_unstale":"2024-09-21T03:25:07.958997+0000","last_undegraded":"2024-09-21T03:25:07.958997+0000","last_fullsized":"2024-09-21T03:25:07.958997+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:20.392815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.946336+0000","last_change":"2024-09-21T03:25:05.946336+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.946336+0000","last_undegraded":"2024-09-21T03:25:05.946336+0000","last_fullsized":"2024-09-21T03:25:05.946336+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.964175+0000","last_change":"2024-09-21T03:25:05.961517+0000","last_active":"2024-09-21T03:25:05.964175+0000","last_peered":"2024-09-21T03:25:05.964175+0000","last_clean":"2024-09-21T03:25:05.964175+0000","last_became_active":"2024-09-21T03:25:05.961159+0000","last_became_peered":"2024-09-21T03:25:05.961159+0000","last_unstale":"2024-09-21T03:25:05.964175+0000","last_undegraded":"2024-09-21T03:25:05.964175+0000","last_fullsized":"2024-09-21T03:25:05.964175+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:42.357829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958256+0000","last_change":"2024-09-21T03:25:06.968024+0000","last_active":"2024-09-21T03:25:07.958256+0000","last_peered":"2024-09-21T03:25:07.958256+0000","last_clean":"2024-09-21T03:25:07.958256+0000","last_became_active":"2024-09-21T03:25:06.967584+0000","last_became_peered":"2024-09-21T03:25:06.967584+0000","last_unstale":"2024-09-21T03:25:07.958256+0000","last_undegraded":"2024-09-21T03:25:07.958256+0000","last_fullsized":"2024-09-21T03:25:07.958256+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:14.835962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.947689+0000","last_change":"2024-09-21T03:25:05.953316+0000","last_active":"2024-09-21T03:25:06.947689+0000","last_peered":"2024-09-21T03:25:06.947689+0000","last_clean":"2024-09-21T03:25:06.947689+0000","last_became_active":"2024-09-21T03:25:05.953009+0000","last_became_peered":"2024-09-21T03:25:05.953009+0000","last_unstale":"2024-09-21T03:25:06.947689+0000","last_undegraded":"2024-09-21T03:25:06.947689+0000","last_fullsized":"2024-09-21T03:25:06.947689+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:13.832422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958341+0000","last_change":"2024-09-21T03:25:06.957735+0000","last_active":"2024-09-21T03:25:07.958341+0000","last_peered":"2024-09-21T03:25:07.958341+0000","last_clean":"2024-09-21T03:25:07.958341+0000","last_became_active":"2024-09-21T03:25:06.957327+0000","last_became_peered":"2024-09-21T03:25:06.957327+0000","last_unstale":"2024-09-21T03:25:07.958341+0000","last_undegraded":"2024-09-21T03:25:07.958341+0000","last_fullsized":"2024-09-21T03:25:07.958341+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:49.780931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.945223+0000","last_change":"2024-09-21T03:25:05.949661+0000","last_active":"2024-09-21T03:25:06.945223+0000","last_peered":"2024-09-21T03:25:06.945223+0000","last_clean":"2024-09-21T03:25:06.945223+0000","last_became_active":"2024-09-21T03:25:05.949336+0000","last_became_peered":"2024-09-21T03:25:05.949336+0000","last_unstale":"2024-09-21T03:25:06.945223+0000","last_undegraded":"2024-09-21T03:25:06.945223+0000","last_fullsized":"2024-09-21T03:25:06.945223+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:48.750266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958762+0000","last_change":"2024-09-21T03:25:06.948815+0000","last_active":"2024-09-21T03:25:07.958762+0000","last_peered":"2024-09-21T03:25:07.958762+0000","last_clean":"2024-09-21T03:25:07.958762+0000","last_became_active":"2024-09-21T03:25:06.948415+0000","last_became_peered":"2024-09-21T03:25:06.948415+0000","last_unstale":"2024-09-21T03:25:07.958762+0000","last_undegraded":"2024-09-21T03:25:07.958762+0000","last_fullsized":"2024-09-21T03:25:07.958762+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:03.305218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958470+0000","last_change":"2024-09-21T03:25:05.945536+0000","last_active":"2024-09-21T03:25:07.958470+0000","last_peered":"2024-09-21T03:25:07.958470+0000","last_clean":"2024-09-21T03:25:07.958470+0000","last_became_active":"2024-09-21T03:25:05.945162+0000","last_became_peered":"2024-09-21T03:25:05.945162+0000","last_unstale":"2024-09-21T03:25:07.958470+0000","last_undegraded":"2024-09-21T03:25:07.958470+0000","last_fullsized":"2024-09-21T03:25:07.958470+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:09.991545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954517+0000","last_change":"2024-09-21T03:25:06.957533+0000","last_active":"2024-09-21T03:25:07.954517+0000","last_peered":"2024-09-21T03:25:07.954517+0000","last_clean":"2024-09-21T03:25:07.954517+0000","last_became_active":"2024-09-21T03:25:06.957214+0000","last_became_peered":"2024-09-21T03:25:06.957214+0000","last_unstale":"2024-09-21T03:25:07.954517+0000","last_undegraded":"2024-09-21T03:25:07.954517+0000","last_fullsized":"2024-09-21T03:25:07.954517+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:24.677842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.942986+0000","last_change":"2024-09-21T03:25:05.953058+0000","last_active":"2024-09-21T03:25:06.942986+0000","last_peered":"2024-09-21T03:25:06.942986+0000","last_clean":"2024-09-21T03:25:06.942986+0000","last_became_active":"2024-09-21T03:25:05.952512+0000","last_became_peered":"2024-09-21T03:25:05.952512+0000","last_unstale":"2024-09-21T03:25:06.942986+0000","last_undegraded":"2024-09-21T03:25:06.942986+0000","last_fullsized":"2024-09-21T03:25:06.942986+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:34.953614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.944325+0000","last_change":"2024-09-21T03:25:05.944325+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.944325+0000","last_undegraded":"2024-09-21T03:25:05.944325+0000","last_fullsized":"2024-09-21T03:25:05.944325+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.963735+0000","last_change":"2024-09-21T03:25:05.960646+0000","last_active":"2024-09-21T03:25:05.963735+0000","last_peered":"2024-09-21T03:25:05.963735+0000","last_clean":"2024-09-21T03:25:05.963735+0000","last_became_active":"2024-09-21T03:25:05.959992+0000","last_became_peered":"2024-09-21T03:25:05.959992+0000","last_unstale":"2024-09-21T03:25:05.963735+0000","last_undegraded":"2024-09-21T03:25:05.963735+0000","last_fullsized":"2024-09-21T03:25:05.963735+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:23.072517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.964593+0000","last_change":"2024-09-21T03:25:06.962590+0000","last_active":"2024-09-21T03:25:06.964593+0000","last_peered":"2024-09-21T03:25:06.964593+0000","last_clean":"2024-09-21T03:25:06.964593+0000","last_became_active":"2024-09-21T03:25:06.962295+0000","last_became_peered":"2024-09-21T03:25:06.962295+0000","last_unstale":"2024-09-21T03:25:06.964593+0000","last_undegraded":"2024-09-21T03:25:06.964593+0000","last_fullsized":"2024-09-21T03:25:06.964593+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:04:58.099896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.947269+0000","last_change":"2024-09-21T03:25:05.955078+0000","last_active":"2024-09-21T03:25:06.947269+0000","last_peered":"2024-09-21T03:25:06.947269+0000","last_clean":"2024-09-21T03:25:06.947269+0000","last_became_active":"2024-09-21T03:25:05.954784+0000","last_became_peered":"2024-09-21T03:25:05.954784+0000","last_unstale":"2024-09-21T03:25:06.947269+0000","last_undegraded":"2024-09-21T03:25:06.947269+0000","last_fullsized":"2024-09-21T03:25:06.947269+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:15:08.648155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":266,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954464+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:25:07.954464+0000","last_peered":"2024-09-21T03:25:07.954464+0000","last_clean":"2024-09-21T03:25:07.954464+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:25:07.954464+0000","last_undegraded":"2024-09-21T03:25:07.954464+0000","last_fullsized":"2024-09-21T03:25:07.954464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":686,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509527,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33020,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338820,"statfs":{"total":96636764160,"available":96602951680,"internally_reserved":0,"allocated":1875968,"data_stored":1131075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509526,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32456,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":1290240,"data_stored":546461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509525,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1282048,"data_stored":540695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509525,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32436,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339404,"statfs":{"total":96636764160,"available":96603549696,"internally_reserved":0,"allocated":1273856,"data_stored":540091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509526,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32456,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":1290240,"data_stored":541773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509526,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1273856,"data_stored":540091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509526,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36600,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335240,"statfs":{"total":96636764160,"available":96599285760,"internally_reserved":0,"allocated":1282048,"data_stored":540215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574933,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33000,"kb_used_data":1800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338840,"statfs":{"total":96636764160,"available":96602972160,"internally_reserved":0,"allocated":1843200,"data_stored":1117409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:25:10.321 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:25:10.472 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.470+0000 7fbdaf32b640 1 -- 172.21.15.105:0/3954322666 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbda80cf320 msgr2=0x7fbda80d0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:10.472 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.470+0000 7fbdaf32b640 1 --2- 172.21.15.105:0/3954322666 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbda80cf320 0x7fbda80d0980 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fbda8074af0 tx=0x7fbda002a560 comp rx=0 tx=0).stop 2024-09-21T03:25:10.472 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.470+0000 7fbdaf32b640 1 -- 172.21.15.105:0/3954322666 shutdown_connections 2024-09-21T03:25:10.472 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.470+0000 7fbdaf32b640 1 --2- 172.21.15.105:0/3954322666 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbda80cf320 0x7fbda80d0980 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:10.472 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.470+0000 7fbdaf32b640 1 --2- 172.21.15.105:0/3954322666 >> v2:172.21.15.162:3300/0 conn(0x7fbda81600b0 0x7fbda80ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:10.472 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.470+0000 7fbdaf32b640 1 -- 172.21.15.105:0/3954322666 >> 172.21.15.105:0/3954322666 conn(0x7fbda806d4f0 msgr2=0x7fbda8071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:10.472 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.470+0000 7fbdaf32b640 1 -- 172.21.15.105:0/3954322666 shutdown_connections 2024-09-21T03:25:10.472 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.470+0000 7fbdaf32b640 1 -- 172.21.15.105:0/3954322666 wait complete. 2024-09-21T03:25:10.473 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.472+0000 7fbdaf32b640 1 Processor -- start 2024-09-21T03:25:10.473 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.472+0000 7fbdaf32b640 1 -- start start 2024-09-21T03:25:10.476 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.473+0000 7fbdaf32b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbda80b7cc0 0x7fbda81f7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:10.476 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.473+0000 7fbdaf32b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbda80cf320 0x7fbda81f4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:10.476 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.473+0000 7fbdaf32b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbda81600b0 0x7fbda81441b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:10.476 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.473+0000 7fbdaf32b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbda80d13c0 con 0x7fbda81600b0 2024-09-21T03:25:10.476 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.473+0000 7fbdaf32b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbda80d1240 con 0x7fbda80cf320 2024-09-21T03:25:10.476 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.473+0000 7fbdaf32b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbda80d1540 con 0x7fbda80b7cc0 2024-09-21T03:25:10.476 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.473+0000 7fbdad8c8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbda81600b0 0x7fbda81441b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:10.476 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.473+0000 7fbdad8c8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbda81600b0 0x7fbda81441b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:44828/0 (socket says 172.21.15.105:44828) 2024-09-21T03:25:10.476 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.473+0000 7fbdad8c8640 1 -- 172.21.15.105:0/3901581595 learned_addr learned my addr 172.21.15.105:0/3901581595 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:10.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.473+0000 7fbdad0c7640 1 --2- 172.21.15.105:0/3901581595 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbda80b7cc0 0x7fbda81f7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:10.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.473+0000 7fbdac8c6640 1 --2- 172.21.15.105:0/3901581595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbda80cf320 0x7fbda81f4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:10.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.474+0000 7fbdad8c8640 1 -- 172.21.15.105:0/3901581595 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbda80b7cc0 msgr2=0x7fbda81f7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:10.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.474+0000 7fbdad8c8640 1 --2- 172.21.15.105:0/3901581595 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbda80b7cc0 0x7fbda81f7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:10.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.474+0000 7fbdad8c8640 1 -- 172.21.15.105:0/3901581595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbda80cf320 msgr2=0x7fbda81f4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:10.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.474+0000 7fbdad8c8640 1 --2- 172.21.15.105:0/3901581595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbda80cf320 0x7fbda81f4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:10.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.474+0000 7fbdad8c8640 1 -- 172.21.15.105:0/3901581595 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbda8156d60 con 0x7fbda81600b0 2024-09-21T03:25:10.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.474+0000 7fbdad0c7640 1 --2- 172.21.15.105:0/3901581595 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbda80b7cc0 0x7fbda81f7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:25:10.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.474+0000 7fbdad8c8640 1 --2- 172.21.15.105:0/3901581595 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbda81600b0 0x7fbda81441b0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fbda002ab50 tx=0x7fbda0003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:10.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.474+0000 7fbda5ffb640 1 -- 172.21.15.105:0/3901581595 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda003e030 con 0x7fbda81600b0 2024-09-21T03:25:10.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.474+0000 7fbda5ffb640 1 -- 172.21.15.105:0/3901581595 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbda0003e40 con 0x7fbda81600b0 2024-09-21T03:25:10.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.474+0000 7fbdaf32b640 1 -- 172.21.15.105:0/3901581595 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbda81f4ca0 con 0x7fbda81600b0 2024-09-21T03:25:10.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.474+0000 7fbda5ffb640 1 -- 172.21.15.105:0/3901581595 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda0035040 con 0x7fbda81600b0 2024-09-21T03:25:10.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.474+0000 7fbdaf32b640 1 -- 172.21.15.105:0/3901581595 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbda81572e0 con 0x7fbda81600b0 2024-09-21T03:25:10.478 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.475+0000 7fbdaf32b640 1 -- 172.21.15.105:0/3901581595 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbda81574b0 con 0x7fbda81600b0 2024-09-21T03:25:10.478 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.476+0000 7fbda5ffb640 1 -- 172.21.15.105:0/3901581595 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbda0041030 con 0x7fbda81600b0 2024-09-21T03:25:10.478 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.476+0000 7fbda5ffb640 1 --2- 172.21.15.105:0/3901581595 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbd94078bc0 0x7fbd9407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:10.479 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.476+0000 7fbda5ffb640 1 -- 172.21.15.105:0/3901581595 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7fbda00bb4e0 con 0x7fbda81600b0 2024-09-21T03:25:10.479 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.477+0000 7fbdad0c7640 1 --2- 172.21.15.105:0/3901581595 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbd94078bc0 0x7fbd9407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:10.479 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.477+0000 7fbdad0c7640 1 --2- 172.21.15.105:0/3901581595 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbd94078bc0 0x7fbd9407b0d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fbd98005fd0 tx=0x7fbd98009340 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:10.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.481+0000 7fbda5ffb640 1 -- 172.21.15.105:0/3901581595 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbda81574b0 con 0x7fbda81600b0 2024-09-21T03:25:10.653 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.651+0000 7fbdaf32b640 1 -- 172.21.15.105:0/3901581595 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbda80d1a60 con 0x7fbd94078bc0 2024-09-21T03:25:10.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.656+0000 7fbda5ffb640 1 -- 172.21.15.105:0/3901581595 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251298 (secure 0 0 0) 0x7fbda80d1a60 con 0x7fbd94078bc0 2024-09-21T03:25:10.660 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:10.661 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:25:10.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.659+0000 7fbdaf32b640 1 -- 172.21.15.105:0/3901581595 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbd94078bc0 msgr2=0x7fbd9407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:10.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.659+0000 7fbdaf32b640 1 --2- 172.21.15.105:0/3901581595 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbd94078bc0 0x7fbd9407b0d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fbd98005fd0 tx=0x7fbd98009340 comp rx=0 tx=0).stop 2024-09-21T03:25:10.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.659+0000 7fbdaf32b640 1 -- 172.21.15.105:0/3901581595 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbda81600b0 msgr2=0x7fbda81441b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:10.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.659+0000 7fbdaf32b640 1 --2- 172.21.15.105:0/3901581595 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbda81600b0 0x7fbda81441b0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fbda002ab50 tx=0x7fbda0003910 comp rx=0 tx=0).stop 2024-09-21T03:25:10.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.659+0000 7fbdaf32b640 1 -- 172.21.15.105:0/3901581595 shutdown_connections 2024-09-21T03:25:10.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.659+0000 7fbdaf32b640 1 --2- 172.21.15.105:0/3901581595 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbd94078bc0 0x7fbd9407b0d0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:10.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.659+0000 7fbdaf32b640 1 --2- 172.21.15.105:0/3901581595 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbda81600b0 0x7fbda81441b0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:10.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.659+0000 7fbdaf32b640 1 --2- 172.21.15.105:0/3901581595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbda80cf320 0x7fbda81f4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:10.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.659+0000 7fbdaf32b640 1 --2- 172.21.15.105:0/3901581595 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbda80b7cc0 0x7fbda81f7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:10.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.659+0000 7fbdaf32b640 1 -- 172.21.15.105:0/3901581595 >> 172.21.15.105:0/3901581595 conn(0x7fbda806d4f0 msgr2=0x7fbda80b7330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:10.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.659+0000 7fbdaf32b640 1 -- 172.21.15.105:0/3901581595 shutdown_connections 2024-09-21T03:25:10.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.659+0000 7fbdaf32b640 1 -- 172.21.15.105:0/3901581595 wait complete. 2024-09-21T03:25:10.672 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":304,"stamp":"2024-09-21T03:25:09.386466+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591054,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":134,"num_write_kb":1637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":134,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":264852,"kb_used_data":11144,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754709868,"statfs":{"total":773094113280,"available":772822904832,"internally_reserved":0,"allocated":11411456,"data_stored":5497810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":686,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.457263"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.957598+0000","last_change":"2024-09-21T03:25:05.957598+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.957598+0000","last_undegraded":"2024-09-21T03:25:05.957598+0000","last_fullsized":"2024-09-21T03:25:05.957598+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958208+0000","last_change":"2024-09-21T03:25:06.960292+0000","last_active":"2024-09-21T03:25:07.958208+0000","last_peered":"2024-09-21T03:25:07.958208+0000","last_clean":"2024-09-21T03:25:07.958208+0000","last_became_active":"2024-09-21T03:25:06.959916+0000","last_became_peered":"2024-09-21T03:25:06.959916+0000","last_unstale":"2024-09-21T03:25:07.958208+0000","last_undegraded":"2024-09-21T03:25:07.958208+0000","last_fullsized":"2024-09-21T03:25:07.958208+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:46.004543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954544+0000","last_change":"2024-09-21T03:25:06.950883+0000","last_active":"2024-09-21T03:25:07.954544+0000","last_peered":"2024-09-21T03:25:07.954544+0000","last_clean":"2024-09-21T03:25:07.954544+0000","last_became_active":"2024-09-21T03:25:06.948632+0000","last_became_peered":"2024-09-21T03:25:06.948632+0000","last_unstale":"2024-09-21T03:25:07.954544+0000","last_undegraded":"2024-09-21T03:25:07.954544+0000","last_fullsized":"2024-09-21T03:25:07.954544+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:46.652368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.957630+0000","last_change":"2024-09-21T03:25:05.957630+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.957630+0000","last_undegraded":"2024-09-21T03:25:05.957630+0000","last_fullsized":"2024-09-21T03:25:05.957630+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.955650+0000","last_change":"2024-09-21T03:25:06.953631+0000","last_active":"2024-09-21T03:25:06.955650+0000","last_peered":"2024-09-21T03:25:06.955650+0000","last_clean":"2024-09-21T03:25:06.955650+0000","last_became_active":"2024-09-21T03:25:06.953277+0000","last_became_peered":"2024-09-21T03:25:06.953277+0000","last_unstale":"2024-09-21T03:25:06.955650+0000","last_undegraded":"2024-09-21T03:25:06.955650+0000","last_fullsized":"2024-09-21T03:25:06.955650+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:41.069474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.959528+0000","last_change":"2024-09-21T03:25:06.957920+0000","last_active":"2024-09-21T03:25:06.959528+0000","last_peered":"2024-09-21T03:25:06.959528+0000","last_clean":"2024-09-21T03:25:06.959528+0000","last_became_active":"2024-09-21T03:25:06.957312+0000","last_became_peered":"2024-09-21T03:25:06.957312+0000","last_unstale":"2024-09-21T03:25:06.959528+0000","last_undegraded":"2024-09-21T03:25:06.959528+0000","last_fullsized":"2024-09-21T03:25:06.959528+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:59:38.300937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.961126+0000","last_change":"2024-09-21T03:25:06.955776+0000","last_active":"2024-09-21T03:25:06.961126+0000","last_peered":"2024-09-21T03:25:06.961126+0000","last_clean":"2024-09-21T03:25:06.961126+0000","last_became_active":"2024-09-21T03:25:06.955407+0000","last_became_peered":"2024-09-21T03:25:06.955407+0000","last_unstale":"2024-09-21T03:25:06.961126+0000","last_undegraded":"2024-09-21T03:25:06.961126+0000","last_fullsized":"2024-09-21T03:25:06.961126+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:12.663157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954048+0000","last_change":"2024-09-21T03:25:06.958844+0000","last_active":"2024-09-21T03:25:07.954048+0000","last_peered":"2024-09-21T03:25:07.954048+0000","last_clean":"2024-09-21T03:25:07.954048+0000","last_became_active":"2024-09-21T03:25:06.958516+0000","last_became_peered":"2024-09-21T03:25:06.958516+0000","last_unstale":"2024-09-21T03:25:07.954048+0000","last_undegraded":"2024-09-21T03:25:07.954048+0000","last_fullsized":"2024-09-21T03:25:07.954048+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:13.569228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.957055+0000","last_change":"2024-09-21T03:25:05.957055+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.957055+0000","last_undegraded":"2024-09-21T03:25:05.957055+0000","last_fullsized":"2024-09-21T03:25:05.957055+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.956508+0000","last_change":"2024-09-21T03:25:05.956508+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.956508+0000","last_undegraded":"2024-09-21T03:25:05.956508+0000","last_fullsized":"2024-09-21T03:25:05.956508+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.959300+0000","last_change":"2024-09-21T03:25:06.951779+0000","last_active":"2024-09-21T03:25:07.959300+0000","last_peered":"2024-09-21T03:25:07.959300+0000","last_clean":"2024-09-21T03:25:07.959300+0000","last_became_active":"2024-09-21T03:25:06.951424+0000","last_became_peered":"2024-09-21T03:25:06.951424+0000","last_unstale":"2024-09-21T03:25:07.959300+0000","last_undegraded":"2024-09-21T03:25:07.959300+0000","last_fullsized":"2024-09-21T03:25:07.959300+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:45.933380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.956841+0000","last_change":"2024-09-21T03:25:05.956841+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.956841+0000","last_undegraded":"2024-09-21T03:25:05.956841+0000","last_fullsized":"2024-09-21T03:25:05.956841+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954480+0000","last_change":"2024-09-21T03:25:06.957896+0000","last_active":"2024-09-21T03:25:07.954480+0000","last_peered":"2024-09-21T03:25:07.954480+0000","last_clean":"2024-09-21T03:25:07.954480+0000","last_became_active":"2024-09-21T03:25:06.957553+0000","last_became_peered":"2024-09-21T03:25:06.957553+0000","last_unstale":"2024-09-21T03:25:07.954480+0000","last_undegraded":"2024-09-21T03:25:07.954480+0000","last_fullsized":"2024-09-21T03:25:07.954480+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:57.501083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954067+0000","last_change":"2024-09-21T03:25:06.956034+0000","last_active":"2024-09-21T03:25:07.954067+0000","last_peered":"2024-09-21T03:25:07.954067+0000","last_clean":"2024-09-21T03:25:07.954067+0000","last_became_active":"2024-09-21T03:25:06.955669+0000","last_became_peered":"2024-09-21T03:25:06.955669+0000","last_unstale":"2024-09-21T03:25:07.954067+0000","last_undegraded":"2024-09-21T03:25:07.954067+0000","last_fullsized":"2024-09-21T03:25:07.954067+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:33.027782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.961407+0000","last_change":"2024-09-21T03:25:06.955229+0000","last_active":"2024-09-21T03:25:06.961407+0000","last_peered":"2024-09-21T03:25:06.961407+0000","last_clean":"2024-09-21T03:25:06.961407+0000","last_became_active":"2024-09-21T03:25:06.954918+0000","last_became_peered":"2024-09-21T03:25:06.954918+0000","last_unstale":"2024-09-21T03:25:06.961407+0000","last_undegraded":"2024-09-21T03:25:06.961407+0000","last_fullsized":"2024-09-21T03:25:06.961407+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:53:15.188760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.954927+0000","last_change":"2024-09-21T03:25:05.954927+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.954927+0000","last_undegraded":"2024-09-21T03:25:05.954927+0000","last_fullsized":"2024-09-21T03:25:05.954927+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958041+0000","last_change":"2024-09-21T03:25:06.948574+0000","last_active":"2024-09-21T03:25:07.958041+0000","last_peered":"2024-09-21T03:25:07.958041+0000","last_clean":"2024-09-21T03:25:07.958041+0000","last_became_active":"2024-09-21T03:25:06.948291+0000","last_became_peered":"2024-09-21T03:25:06.948291+0000","last_unstale":"2024-09-21T03:25:07.958041+0000","last_undegraded":"2024-09-21T03:25:07.958041+0000","last_fullsized":"2024-09-21T03:25:07.958041+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:23.103570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958690+0000","last_change":"2024-09-21T03:25:06.943830+0000","last_active":"2024-09-21T03:25:07.958690+0000","last_peered":"2024-09-21T03:25:07.958690+0000","last_clean":"2024-09-21T03:25:07.958690+0000","last_became_active":"2024-09-21T03:25:06.943492+0000","last_became_peered":"2024-09-21T03:25:06.943492+0000","last_unstale":"2024-09-21T03:25:07.958690+0000","last_undegraded":"2024-09-21T03:25:07.958690+0000","last_fullsized":"2024-09-21T03:25:07.958690+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:58.003935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954528+0000","last_change":"2024-09-21T03:25:06.956428+0000","last_active":"2024-09-21T03:25:07.954528+0000","last_peered":"2024-09-21T03:25:07.954528+0000","last_clean":"2024-09-21T03:25:07.954528+0000","last_became_active":"2024-09-21T03:25:06.955989+0000","last_became_peered":"2024-09-21T03:25:06.955989+0000","last_unstale":"2024-09-21T03:25:07.954528+0000","last_undegraded":"2024-09-21T03:25:07.954528+0000","last_fullsized":"2024-09-21T03:25:07.954528+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:05.806487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958257+0000","last_change":"2024-09-21T03:25:06.946863+0000","last_active":"2024-09-21T03:25:07.958257+0000","last_peered":"2024-09-21T03:25:07.958257+0000","last_clean":"2024-09-21T03:25:07.958257+0000","last_became_active":"2024-09-21T03:25:06.946516+0000","last_became_peered":"2024-09-21T03:25:06.946516+0000","last_unstale":"2024-09-21T03:25:07.958257+0000","last_undegraded":"2024-09-21T03:25:07.958257+0000","last_fullsized":"2024-09-21T03:25:07.958257+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:14.835962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.959036+0000","last_change":"2024-09-21T03:25:06.952971+0000","last_active":"2024-09-21T03:25:07.959036+0000","last_peered":"2024-09-21T03:25:07.959036+0000","last_clean":"2024-09-21T03:25:07.959036+0000","last_became_active":"2024-09-21T03:25:06.952598+0000","last_became_peered":"2024-09-21T03:25:06.952598+0000","last_unstale":"2024-09-21T03:25:07.959036+0000","last_undegraded":"2024-09-21T03:25:07.959036+0000","last_fullsized":"2024-09-21T03:25:07.959036+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:11.279234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.957889+0000","last_change":"2024-09-21T03:25:06.953872+0000","last_active":"2024-09-21T03:25:06.957889+0000","last_peered":"2024-09-21T03:25:06.957889+0000","last_clean":"2024-09-21T03:25:06.957889+0000","last_became_active":"2024-09-21T03:25:06.953516+0000","last_became_peered":"2024-09-21T03:25:06.953516+0000","last_unstale":"2024-09-21T03:25:06.957889+0000","last_undegraded":"2024-09-21T03:25:06.957889+0000","last_fullsized":"2024-09-21T03:25:06.957889+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:49.780931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.957699+0000","last_change":"2024-09-21T03:25:06.946898+0000","last_active":"2024-09-21T03:25:07.957699+0000","last_peered":"2024-09-21T03:25:07.957699+0000","last_clean":"2024-09-21T03:25:07.957699+0000","last_became_active":"2024-09-21T03:25:06.946529+0000","last_became_peered":"2024-09-21T03:25:06.946529+0000","last_unstale":"2024-09-21T03:25:07.957699+0000","last_undegraded":"2024-09-21T03:25:07.957699+0000","last_fullsized":"2024-09-21T03:25:07.957699+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:28.581453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.964617+0000","last_change":"2024-09-21T03:25:06.963339+0000","last_active":"2024-09-21T03:25:06.964617+0000","last_peered":"2024-09-21T03:25:06.964617+0000","last_clean":"2024-09-21T03:25:06.964617+0000","last_became_active":"2024-09-21T03:25:06.963052+0000","last_became_peered":"2024-09-21T03:25:06.963052+0000","last_unstale":"2024-09-21T03:25:06.964617+0000","last_undegraded":"2024-09-21T03:25:06.964617+0000","last_fullsized":"2024-09-21T03:25:06.964617+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:45.382063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958302+0000","last_change":"2024-09-21T03:25:06.947798+0000","last_active":"2024-09-21T03:25:07.958302+0000","last_peered":"2024-09-21T03:25:07.958302+0000","last_clean":"2024-09-21T03:25:07.958302+0000","last_became_active":"2024-09-21T03:25:06.947494+0000","last_became_peered":"2024-09-21T03:25:06.947494+0000","last_unstale":"2024-09-21T03:25:07.958302+0000","last_undegraded":"2024-09-21T03:25:07.958302+0000","last_fullsized":"2024-09-21T03:25:07.958302+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:58.003935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.953063+0000","last_change":"2024-09-21T03:25:05.953063+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.953063+0000","last_undegraded":"2024-09-21T03:25:05.953063+0000","last_fullsized":"2024-09-21T03:25:05.953063+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.966709+0000","last_change":"2024-09-21T03:25:06.965906+0000","last_active":"2024-09-21T03:25:06.966709+0000","last_peered":"2024-09-21T03:25:06.966709+0000","last_clean":"2024-09-21T03:25:06.966709+0000","last_became_active":"2024-09-21T03:25:06.965595+0000","last_became_peered":"2024-09-21T03:25:06.965595+0000","last_unstale":"2024-09-21T03:25:06.966709+0000","last_undegraded":"2024-09-21T03:25:06.966709+0000","last_fullsized":"2024-09-21T03:25:06.966709+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:32.430160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.974231+0000","last_change":"2024-09-21T03:25:06.972998+0000","last_active":"2024-09-21T03:25:06.974231+0000","last_peered":"2024-09-21T03:25:06.974231+0000","last_clean":"2024-09-21T03:25:06.974231+0000","last_became_active":"2024-09-21T03:25:06.972535+0000","last_became_peered":"2024-09-21T03:25:06.972535+0000","last_unstale":"2024-09-21T03:25:06.974231+0000","last_undegraded":"2024-09-21T03:25:06.974231+0000","last_fullsized":"2024-09-21T03:25:06.974231+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:23.886522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958517+0000","last_change":"2024-09-21T03:25:06.949102+0000","last_active":"2024-09-21T03:25:07.958517+0000","last_peered":"2024-09-21T03:25:07.958517+0000","last_clean":"2024-09-21T03:25:07.958517+0000","last_became_active":"2024-09-21T03:25:06.947993+0000","last_became_peered":"2024-09-21T03:25:06.947993+0000","last_unstale":"2024-09-21T03:25:07.958517+0000","last_undegraded":"2024-09-21T03:25:07.958517+0000","last_fullsized":"2024-09-21T03:25:07.958517+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:13.975782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.964008+0000","last_change":"2024-09-21T03:25:06.956996+0000","last_active":"2024-09-21T03:25:06.964008+0000","last_peered":"2024-09-21T03:25:06.964008+0000","last_clean":"2024-09-21T03:25:06.964008+0000","last_became_active":"2024-09-21T03:25:06.956687+0000","last_became_peered":"2024-09-21T03:25:06.956687+0000","last_unstale":"2024-09-21T03:25:06.964008+0000","last_undegraded":"2024-09-21T03:25:06.964008+0000","last_fullsized":"2024-09-21T03:25:06.964008+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:08.899356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.951900+0000","last_change":"2024-09-21T03:25:05.951900+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.951900+0000","last_undegraded":"2024-09-21T03:25:05.951900+0000","last_fullsized":"2024-09-21T03:25:05.951900+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.960078+0000","last_change":"2024-09-21T03:25:06.956017+0000","last_active":"2024-09-21T03:25:06.960078+0000","last_peered":"2024-09-21T03:25:06.960078+0000","last_clean":"2024-09-21T03:25:06.960078+0000","last_became_active":"2024-09-21T03:25:06.955640+0000","last_became_peered":"2024-09-21T03:25:06.955640+0000","last_unstale":"2024-09-21T03:25:06.960078+0000","last_undegraded":"2024-09-21T03:25:06.960078+0000","last_fullsized":"2024-09-21T03:25:06.960078+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:08.286393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.958319+0000","last_change":"2024-09-21T03:25:06.956659+0000","last_active":"2024-09-21T03:25:06.958319+0000","last_peered":"2024-09-21T03:25:06.958319+0000","last_clean":"2024-09-21T03:25:06.958319+0000","last_became_active":"2024-09-21T03:25:06.956166+0000","last_became_peered":"2024-09-21T03:25:06.956166+0000","last_unstale":"2024-09-21T03:25:06.958319+0000","last_undegraded":"2024-09-21T03:25:06.958319+0000","last_fullsized":"2024-09-21T03:25:06.958319+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:34.288116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"103'4","reported_seq":17,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.969661+0000","last_change":"2024-09-21T03:25:05.950693+0000","last_active":"2024-09-21T03:25:06.969661+0000","last_peered":"2024-09-21T03:25:06.969661+0000","last_clean":"2024-09-21T03:25:06.969661+0000","last_became_active":"2024-09-21T03:25:05.950331+0000","last_became_peered":"2024-09-21T03:25:05.950331+0000","last_unstale":"2024-09-21T03:25:06.969661+0000","last_undegraded":"2024-09-21T03:25:06.969661+0000","last_fullsized":"2024-09-21T03:25:06.969661+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:59.771445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958729+0000","last_change":"2024-09-21T03:25:06.946964+0000","last_active":"2024-09-21T03:25:07.958729+0000","last_peered":"2024-09-21T03:25:07.958729+0000","last_clean":"2024-09-21T03:25:07.958729+0000","last_became_active":"2024-09-21T03:25:06.945956+0000","last_became_peered":"2024-09-21T03:25:06.945956+0000","last_unstale":"2024-09-21T03:25:07.958729+0000","last_undegraded":"2024-09-21T03:25:07.958729+0000","last_fullsized":"2024-09-21T03:25:07.958729+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:49.780931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954228+0000","last_change":"2024-09-21T03:25:05.948457+0000","last_active":"2024-09-21T03:25:07.954228+0000","last_peered":"2024-09-21T03:25:07.954228+0000","last_clean":"2024-09-21T03:25:07.954228+0000","last_became_active":"2024-09-21T03:25:05.948136+0000","last_became_peered":"2024-09-21T03:25:05.948136+0000","last_unstale":"2024-09-21T03:25:07.954228+0000","last_undegraded":"2024-09-21T03:25:07.954228+0000","last_fullsized":"2024-09-21T03:25:07.954228+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:27.577914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.959487+0000","last_change":"2024-09-21T03:25:06.957624+0000","last_active":"2024-09-21T03:25:06.959487+0000","last_peered":"2024-09-21T03:25:06.959487+0000","last_clean":"2024-09-21T03:25:06.959487+0000","last_became_active":"2024-09-21T03:25:06.957274+0000","last_became_peered":"2024-09-21T03:25:06.957274+0000","last_unstale":"2024-09-21T03:25:06.959487+0000","last_undegraded":"2024-09-21T03:25:06.959487+0000","last_fullsized":"2024-09-21T03:25:06.959487+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:09.843286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.967196+0000","last_change":"2024-09-21T03:25:05.956340+0000","last_active":"2024-09-21T03:25:06.967196+0000","last_peered":"2024-09-21T03:25:06.967196+0000","last_clean":"2024-09-21T03:25:06.967196+0000","last_became_active":"2024-09-21T03:25:05.956023+0000","last_became_peered":"2024-09-21T03:25:05.956023+0000","last_unstale":"2024-09-21T03:25:06.967196+0000","last_undegraded":"2024-09-21T03:25:06.967196+0000","last_fullsized":"2024-09-21T03:25:06.967196+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:16.344677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954681+0000","last_change":"2024-09-21T03:25:06.954812+0000","last_active":"2024-09-21T03:25:07.954681+0000","last_peered":"2024-09-21T03:25:07.954681+0000","last_clean":"2024-09-21T03:25:07.954681+0000","last_became_active":"2024-09-21T03:25:06.954324+0000","last_became_peered":"2024-09-21T03:25:06.954324+0000","last_unstale":"2024-09-21T03:25:07.954681+0000","last_undegraded":"2024-09-21T03:25:07.954681+0000","last_fullsized":"2024-09-21T03:25:07.954681+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:31.650403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.967394+0000","last_change":"2024-09-21T03:25:05.951073+0000","last_active":"2024-09-21T03:25:06.967394+0000","last_peered":"2024-09-21T03:25:06.967394+0000","last_clean":"2024-09-21T03:25:06.967394+0000","last_became_active":"2024-09-21T03:25:05.950749+0000","last_became_peered":"2024-09-21T03:25:05.950749+0000","last_unstale":"2024-09-21T03:25:06.967394+0000","last_undegraded":"2024-09-21T03:25:06.967394+0000","last_fullsized":"2024-09-21T03:25:06.967394+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:07.037456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.951678+0000","last_change":"2024-09-21T03:25:05.951678+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.951678+0000","last_undegraded":"2024-09-21T03:25:05.951678+0000","last_fullsized":"2024-09-21T03:25:05.951678+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"103'1","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.966866+0000","last_change":"2024-09-21T03:25:05.952018+0000","last_active":"2024-09-21T03:25:06.966866+0000","last_peered":"2024-09-21T03:25:06.966866+0000","last_clean":"2024-09-21T03:25:06.966866+0000","last_became_active":"2024-09-21T03:25:05.951683+0000","last_became_peered":"2024-09-21T03:25:05.951683+0000","last_unstale":"2024-09-21T03:25:06.966866+0000","last_undegraded":"2024-09-21T03:25:06.966866+0000","last_fullsized":"2024-09-21T03:25:06.966866+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:06:17.348336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958896+0000","last_change":"2024-09-21T03:25:06.960288+0000","last_active":"2024-09-21T03:25:07.958896+0000","last_peered":"2024-09-21T03:25:07.958896+0000","last_clean":"2024-09-21T03:25:07.958896+0000","last_became_active":"2024-09-21T03:25:06.959943+0000","last_became_peered":"2024-09-21T03:25:06.959943+0000","last_unstale":"2024-09-21T03:25:07.958896+0000","last_undegraded":"2024-09-21T03:25:07.958896+0000","last_fullsized":"2024-09-21T03:25:07.958896+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:49.944202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"103'1","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.967731+0000","last_change":"2024-09-21T03:25:05.948442+0000","last_active":"2024-09-21T03:25:06.967731+0000","last_peered":"2024-09-21T03:25:06.967731+0000","last_clean":"2024-09-21T03:25:06.967731+0000","last_became_active":"2024-09-21T03:25:05.947682+0000","last_became_peered":"2024-09-21T03:25:05.947682+0000","last_unstale":"2024-09-21T03:25:06.967731+0000","last_undegraded":"2024-09-21T03:25:06.967731+0000","last_fullsized":"2024-09-21T03:25:06.967731+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:57.000396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.954176+0000","last_change":"2024-09-21T03:25:05.954176+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.954176+0000","last_undegraded":"2024-09-21T03:25:05.954176+0000","last_fullsized":"2024-09-21T03:25:05.954176+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.957616+0000","last_change":"2024-09-21T03:25:05.954213+0000","last_active":"2024-09-21T03:25:07.957616+0000","last_peered":"2024-09-21T03:25:07.957616+0000","last_clean":"2024-09-21T03:25:07.957616+0000","last_became_active":"2024-09-21T03:25:05.953869+0000","last_became_peered":"2024-09-21T03:25:05.953869+0000","last_unstale":"2024-09-21T03:25:07.957616+0000","last_undegraded":"2024-09-21T03:25:07.957616+0000","last_fullsized":"2024-09-21T03:25:07.957616+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:07.895817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.961160+0000","last_change":"2024-09-21T03:25:06.955915+0000","last_active":"2024-09-21T03:25:06.961160+0000","last_peered":"2024-09-21T03:25:06.961160+0000","last_clean":"2024-09-21T03:25:06.961160+0000","last_became_active":"2024-09-21T03:25:06.955458+0000","last_became_peered":"2024-09-21T03:25:06.955458+0000","last_unstale":"2024-09-21T03:25:06.961160+0000","last_undegraded":"2024-09-21T03:25:06.961160+0000","last_fullsized":"2024-09-21T03:25:06.961160+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:10.995084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.961676+0000","last_change":"2024-09-21T03:25:05.960268+0000","last_active":"2024-09-21T03:25:05.961676+0000","last_peered":"2024-09-21T03:25:05.961676+0000","last_clean":"2024-09-21T03:25:05.961676+0000","last_became_active":"2024-09-21T03:25:05.959378+0000","last_became_peered":"2024-09-21T03:25:05.959378+0000","last_unstale":"2024-09-21T03:25:05.961676+0000","last_undegraded":"2024-09-21T03:25:05.961676+0000","last_fullsized":"2024-09-21T03:25:05.961676+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:13.516789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.961224+0000","last_change":"2024-09-21T03:25:06.954630+0000","last_active":"2024-09-21T03:25:06.961224+0000","last_peered":"2024-09-21T03:25:06.961224+0000","last_clean":"2024-09-21T03:25:06.961224+0000","last_became_active":"2024-09-21T03:25:06.953583+0000","last_became_peered":"2024-09-21T03:25:06.953583+0000","last_unstale":"2024-09-21T03:25:06.961224+0000","last_undegraded":"2024-09-21T03:25:06.961224+0000","last_fullsized":"2024-09-21T03:25:06.961224+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:33.610686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.942545+0000","last_change":"2024-09-21T03:25:05.954201+0000","last_active":"2024-09-21T03:25:06.942545+0000","last_peered":"2024-09-21T03:25:06.942545+0000","last_clean":"2024-09-21T03:25:06.942545+0000","last_became_active":"2024-09-21T03:25:05.953878+0000","last_became_peered":"2024-09-21T03:25:05.953878+0000","last_unstale":"2024-09-21T03:25:06.942545+0000","last_undegraded":"2024-09-21T03:25:06.942545+0000","last_fullsized":"2024-09-21T03:25:06.942545+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:05.935127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958898+0000","last_change":"2024-09-21T03:25:06.968378+0000","last_active":"2024-09-21T03:25:07.958898+0000","last_peered":"2024-09-21T03:25:07.958898+0000","last_clean":"2024-09-21T03:25:07.958898+0000","last_became_active":"2024-09-21T03:25:06.967606+0000","last_became_peered":"2024-09-21T03:25:06.967606+0000","last_unstale":"2024-09-21T03:25:07.958898+0000","last_undegraded":"2024-09-21T03:25:07.958898+0000","last_fullsized":"2024-09-21T03:25:07.958898+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:13.975782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.944468+0000","last_change":"2024-09-21T03:25:05.946765+0000","last_active":"2024-09-21T03:25:06.944468+0000","last_peered":"2024-09-21T03:25:06.944468+0000","last_clean":"2024-09-21T03:25:06.944468+0000","last_became_active":"2024-09-21T03:25:05.946454+0000","last_became_peered":"2024-09-21T03:25:05.946454+0000","last_unstale":"2024-09-21T03:25:06.944468+0000","last_undegraded":"2024-09-21T03:25:06.944468+0000","last_fullsized":"2024-09-21T03:25:06.944468+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:22.100031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.964558+0000","last_change":"2024-09-21T03:25:06.960519+0000","last_active":"2024-09-21T03:25:06.964558+0000","last_peered":"2024-09-21T03:25:06.964558+0000","last_clean":"2024-09-21T03:25:06.964558+0000","last_became_active":"2024-09-21T03:25:06.960164+0000","last_became_peered":"2024-09-21T03:25:06.960164+0000","last_unstale":"2024-09-21T03:25:06.964558+0000","last_undegraded":"2024-09-21T03:25:06.964558+0000","last_fullsized":"2024-09-21T03:25:06.964558+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:59:33.809395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.956794+0000","last_change":"2024-09-21T03:25:05.953557+0000","last_active":"2024-09-21T03:25:05.956794+0000","last_peered":"2024-09-21T03:25:05.956794+0000","last_clean":"2024-09-21T03:25:05.956794+0000","last_became_active":"2024-09-21T03:25:05.953163+0000","last_became_peered":"2024-09-21T03:25:05.953163+0000","last_unstale":"2024-09-21T03:25:05.956794+0000","last_undegraded":"2024-09-21T03:25:05.956794+0000","last_fullsized":"2024-09-21T03:25:05.956794+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:42.745888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.956692+0000","last_change":"2024-09-21T03:25:06.954185+0000","last_active":"2024-09-21T03:25:06.956692+0000","last_peered":"2024-09-21T03:25:06.956692+0000","last_clean":"2024-09-21T03:25:06.956692+0000","last_became_active":"2024-09-21T03:25:06.953834+0000","last_became_peered":"2024-09-21T03:25:06.953834+0000","last_unstale":"2024-09-21T03:25:06.956692+0000","last_undegraded":"2024-09-21T03:25:06.956692+0000","last_fullsized":"2024-09-21T03:25:06.956692+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:27:48.468098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.961437+0000","last_change":"2024-09-21T03:25:05.959732+0000","last_active":"2024-09-21T03:25:05.961437+0000","last_peered":"2024-09-21T03:25:05.961437+0000","last_clean":"2024-09-21T03:25:05.961437+0000","last_became_active":"2024-09-21T03:25:05.959393+0000","last_became_peered":"2024-09-21T03:25:05.959393+0000","last_unstale":"2024-09-21T03:25:05.961437+0000","last_undegraded":"2024-09-21T03:25:05.961437+0000","last_fullsized":"2024-09-21T03:25:05.961437+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:54.217867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.964650+0000","last_change":"2024-09-21T03:25:06.959029+0000","last_active":"2024-09-21T03:25:06.964650+0000","last_peered":"2024-09-21T03:25:06.964650+0000","last_clean":"2024-09-21T03:25:06.964650+0000","last_became_active":"2024-09-21T03:25:06.958443+0000","last_became_peered":"2024-09-21T03:25:06.958443+0000","last_unstale":"2024-09-21T03:25:06.964650+0000","last_undegraded":"2024-09-21T03:25:06.964650+0000","last_fullsized":"2024-09-21T03:25:06.964650+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:41:16.872769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.967401+0000","last_change":"2024-09-21T03:25:05.946740+0000","last_active":"2024-09-21T03:25:06.967401+0000","last_peered":"2024-09-21T03:25:06.967401+0000","last_clean":"2024-09-21T03:25:06.967401+0000","last_became_active":"2024-09-21T03:25:05.946438+0000","last_became_peered":"2024-09-21T03:25:05.946438+0000","last_unstale":"2024-09-21T03:25:06.967401+0000","last_undegraded":"2024-09-21T03:25:06.967401+0000","last_fullsized":"2024-09-21T03:25:06.967401+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:27.205093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.958138+0000","last_change":"2024-09-21T03:25:06.954978+0000","last_active":"2024-09-21T03:25:06.958138+0000","last_peered":"2024-09-21T03:25:06.958138+0000","last_clean":"2024-09-21T03:25:06.958138+0000","last_became_active":"2024-09-21T03:25:06.954688+0000","last_became_peered":"2024-09-21T03:25:06.954688+0000","last_unstale":"2024-09-21T03:25:06.958138+0000","last_undegraded":"2024-09-21T03:25:06.958138+0000","last_fullsized":"2024-09-21T03:25:06.958138+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:03.305218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958184+0000","last_change":"2024-09-21T03:25:05.960010+0000","last_active":"2024-09-21T03:25:07.958184+0000","last_peered":"2024-09-21T03:25:07.958184+0000","last_clean":"2024-09-21T03:25:07.958184+0000","last_became_active":"2024-09-21T03:25:05.959699+0000","last_became_peered":"2024-09-21T03:25:05.959699+0000","last_unstale":"2024-09-21T03:25:07.958184+0000","last_undegraded":"2024-09-21T03:25:07.958184+0000","last_fullsized":"2024-09-21T03:25:07.958184+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:33.984094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.957851+0000","last_change":"2024-09-21T03:25:06.954255+0000","last_active":"2024-09-21T03:25:06.957851+0000","last_peered":"2024-09-21T03:25:06.957851+0000","last_clean":"2024-09-21T03:25:06.957851+0000","last_became_active":"2024-09-21T03:25:06.953960+0000","last_became_peered":"2024-09-21T03:25:06.953960+0000","last_unstale":"2024-09-21T03:25:06.957851+0000","last_undegraded":"2024-09-21T03:25:06.957851+0000","last_fullsized":"2024-09-21T03:25:06.957851+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:13.975782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"103'8","reported_seq":21,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.971415+0000","last_change":"2024-09-21T03:25:05.962238+0000","last_active":"2024-09-21T03:25:06.971415+0000","last_peered":"2024-09-21T03:25:06.971415+0000","last_clean":"2024-09-21T03:25:06.971415+0000","last_became_active":"2024-09-21T03:25:05.961869+0000","last_became_peered":"2024-09-21T03:25:05.961869+0000","last_unstale":"2024-09-21T03:25:06.971415+0000","last_undegraded":"2024-09-21T03:25:06.971415+0000","last_fullsized":"2024-09-21T03:25:06.971415+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:13.594419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.974579+0000","last_change":"2024-09-21T03:25:06.973378+0000","last_active":"2024-09-21T03:25:06.974579+0000","last_peered":"2024-09-21T03:25:06.974579+0000","last_clean":"2024-09-21T03:25:06.974579+0000","last_became_active":"2024-09-21T03:25:06.972937+0000","last_became_peered":"2024-09-21T03:25:06.972937+0000","last_unstale":"2024-09-21T03:25:06.974579+0000","last_undegraded":"2024-09-21T03:25:06.974579+0000","last_fullsized":"2024-09-21T03:25:06.974579+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:20.822035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.957250+0000","last_change":"2024-09-21T03:25:05.953632+0000","last_active":"2024-09-21T03:25:05.957250+0000","last_peered":"2024-09-21T03:25:05.957250+0000","last_clean":"2024-09-21T03:25:05.957250+0000","last_became_active":"2024-09-21T03:25:05.952747+0000","last_became_peered":"2024-09-21T03:25:05.952747+0000","last_unstale":"2024-09-21T03:25:05.957250+0000","last_undegraded":"2024-09-21T03:25:05.957250+0000","last_fullsized":"2024-09-21T03:25:05.957250+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:16.897123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.973787+0000","last_change":"2024-09-21T03:25:06.971849+0000","last_active":"2024-09-21T03:25:06.973787+0000","last_peered":"2024-09-21T03:25:06.973787+0000","last_clean":"2024-09-21T03:25:06.973787+0000","last_became_active":"2024-09-21T03:25:06.971533+0000","last_became_peered":"2024-09-21T03:25:06.971533+0000","last_unstale":"2024-09-21T03:25:06.973787+0000","last_undegraded":"2024-09-21T03:25:06.973787+0000","last_fullsized":"2024-09-21T03:25:06.973787+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:37.012007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.973664+0000","last_change":"2024-09-21T03:25:05.949862+0000","last_active":"2024-09-21T03:25:06.973664+0000","last_peered":"2024-09-21T03:25:06.973664+0000","last_clean":"2024-09-21T03:25:06.973664+0000","last_became_active":"2024-09-21T03:25:05.949503+0000","last_became_peered":"2024-09-21T03:25:05.949503+0000","last_unstale":"2024-09-21T03:25:06.973664+0000","last_undegraded":"2024-09-21T03:25:06.973664+0000","last_fullsized":"2024-09-21T03:25:06.973664+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:48.375833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954331+0000","last_change":"2024-09-21T03:25:06.968263+0000","last_active":"2024-09-21T03:25:07.954331+0000","last_peered":"2024-09-21T03:25:07.954331+0000","last_clean":"2024-09-21T03:25:07.954331+0000","last_became_active":"2024-09-21T03:25:06.967957+0000","last_became_peered":"2024-09-21T03:25:06.967957+0000","last_unstale":"2024-09-21T03:25:07.954331+0000","last_undegraded":"2024-09-21T03:25:07.954331+0000","last_fullsized":"2024-09-21T03:25:07.954331+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:38.224056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958389+0000","last_change":"2024-09-21T03:25:05.951962+0000","last_active":"2024-09-21T03:25:07.958389+0000","last_peered":"2024-09-21T03:25:07.958389+0000","last_clean":"2024-09-21T03:25:07.958389+0000","last_became_active":"2024-09-21T03:25:05.951676+0000","last_became_peered":"2024-09-21T03:25:05.951676+0000","last_unstale":"2024-09-21T03:25:07.958389+0000","last_undegraded":"2024-09-21T03:25:07.958389+0000","last_fullsized":"2024-09-21T03:25:07.958389+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:14:33.126090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954791+0000","last_change":"2024-09-21T03:25:06.958748+0000","last_active":"2024-09-21T03:25:07.954791+0000","last_peered":"2024-09-21T03:25:07.954791+0000","last_clean":"2024-09-21T03:25:07.954791+0000","last_became_active":"2024-09-21T03:25:06.958412+0000","last_became_peered":"2024-09-21T03:25:06.958412+0000","last_unstale":"2024-09-21T03:25:07.954791+0000","last_undegraded":"2024-09-21T03:25:07.954791+0000","last_fullsized":"2024-09-21T03:25:07.954791+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:02.237215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.945527+0000","last_change":"2024-09-21T03:25:05.955181+0000","last_active":"2024-09-21T03:25:06.945527+0000","last_peered":"2024-09-21T03:25:06.945527+0000","last_clean":"2024-09-21T03:25:06.945527+0000","last_became_active":"2024-09-21T03:25:05.954828+0000","last_became_peered":"2024-09-21T03:25:05.954828+0000","last_unstale":"2024-09-21T03:25:06.945527+0000","last_undegraded":"2024-09-21T03:25:06.945527+0000","last_fullsized":"2024-09-21T03:25:06.945527+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:35.311555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954227+0000","last_change":"2024-09-21T03:25:06.957965+0000","last_active":"2024-09-21T03:25:07.954227+0000","last_peered":"2024-09-21T03:25:07.954227+0000","last_clean":"2024-09-21T03:25:07.954227+0000","last_became_active":"2024-09-21T03:25:06.957637+0000","last_became_peered":"2024-09-21T03:25:06.957637+0000","last_unstale":"2024-09-21T03:25:07.954227+0000","last_undegraded":"2024-09-21T03:25:07.954227+0000","last_fullsized":"2024-09-21T03:25:07.954227+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:34.326915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.968385+0000","last_change":"2024-09-21T03:25:05.949798+0000","last_active":"2024-09-21T03:25:06.968385+0000","last_peered":"2024-09-21T03:25:06.968385+0000","last_clean":"2024-09-21T03:25:06.968385+0000","last_became_active":"2024-09-21T03:25:05.949522+0000","last_became_peered":"2024-09-21T03:25:05.949522+0000","last_unstale":"2024-09-21T03:25:06.968385+0000","last_undegraded":"2024-09-21T03:25:06.968385+0000","last_fullsized":"2024-09-21T03:25:06.968385+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:20.522015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.951118+0000","last_change":"2024-09-21T03:25:05.951118+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.951118+0000","last_undegraded":"2024-09-21T03:25:05.951118+0000","last_fullsized":"2024-09-21T03:25:05.951118+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.943364+0000","last_change":"2024-09-21T03:25:05.951055+0000","last_active":"2024-09-21T03:25:06.943364+0000","last_peered":"2024-09-21T03:25:06.943364+0000","last_clean":"2024-09-21T03:25:06.943364+0000","last_became_active":"2024-09-21T03:25:05.950689+0000","last_became_peered":"2024-09-21T03:25:05.950689+0000","last_unstale":"2024-09-21T03:25:06.943364+0000","last_undegraded":"2024-09-21T03:25:06.943364+0000","last_fullsized":"2024-09-21T03:25:06.943364+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:14.630887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954221+0000","last_change":"2024-09-21T03:25:06.957927+0000","last_active":"2024-09-21T03:25:07.954221+0000","last_peered":"2024-09-21T03:25:07.954221+0000","last_clean":"2024-09-21T03:25:07.954221+0000","last_became_active":"2024-09-21T03:25:06.956714+0000","last_became_peered":"2024-09-21T03:25:06.956714+0000","last_unstale":"2024-09-21T03:25:07.954221+0000","last_undegraded":"2024-09-21T03:25:07.954221+0000","last_fullsized":"2024-09-21T03:25:07.954221+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:28.910067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.943454+0000","last_change":"2024-09-21T03:25:05.949024+0000","last_active":"2024-09-21T03:25:06.943454+0000","last_peered":"2024-09-21T03:25:06.943454+0000","last_clean":"2024-09-21T03:25:06.943454+0000","last_became_active":"2024-09-21T03:25:05.948664+0000","last_became_peered":"2024-09-21T03:25:05.948664+0000","last_unstale":"2024-09-21T03:25:06.943454+0000","last_undegraded":"2024-09-21T03:25:06.943454+0000","last_fullsized":"2024-09-21T03:25:06.943454+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:10.198642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.970949+0000","last_change":"2024-09-21T03:25:06.966457+0000","last_active":"2024-09-21T03:25:06.970949+0000","last_peered":"2024-09-21T03:25:06.970949+0000","last_clean":"2024-09-21T03:25:06.970949+0000","last_became_active":"2024-09-21T03:25:06.965905+0000","last_became_peered":"2024-09-21T03:25:06.965905+0000","last_unstale":"2024-09-21T03:25:06.970949+0000","last_undegraded":"2024-09-21T03:25:06.970949+0000","last_fullsized":"2024-09-21T03:25:06.970949+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:28:33.939280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.964155+0000","last_change":"2024-09-21T03:25:05.961466+0000","last_active":"2024-09-21T03:25:05.964155+0000","last_peered":"2024-09-21T03:25:05.964155+0000","last_clean":"2024-09-21T03:25:05.964155+0000","last_became_active":"2024-09-21T03:25:05.961148+0000","last_became_peered":"2024-09-21T03:25:05.961148+0000","last_unstale":"2024-09-21T03:25:05.964155+0000","last_undegraded":"2024-09-21T03:25:05.964155+0000","last_fullsized":"2024-09-21T03:25:05.964155+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:07.109585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958987+0000","last_change":"2024-09-21T03:25:06.970004+0000","last_active":"2024-09-21T03:25:07.958987+0000","last_peered":"2024-09-21T03:25:07.958987+0000","last_clean":"2024-09-21T03:25:07.958987+0000","last_became_active":"2024-09-21T03:25:06.969612+0000","last_became_peered":"2024-09-21T03:25:06.969612+0000","last_unstale":"2024-09-21T03:25:07.958987+0000","last_undegraded":"2024-09-21T03:25:07.958987+0000","last_fullsized":"2024-09-21T03:25:07.958987+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:03.305218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.972709+0000","last_change":"2024-09-21T03:25:05.955665+0000","last_active":"2024-09-21T03:25:06.972709+0000","last_peered":"2024-09-21T03:25:06.972709+0000","last_clean":"2024-09-21T03:25:06.972709+0000","last_became_active":"2024-09-21T03:25:05.955365+0000","last_became_peered":"2024-09-21T03:25:05.955365+0000","last_unstale":"2024-09-21T03:25:06.972709+0000","last_undegraded":"2024-09-21T03:25:06.972709+0000","last_fullsized":"2024-09-21T03:25:06.972709+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:45.001004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.950577+0000","last_change":"2024-09-21T03:25:05.950577+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.950577+0000","last_undegraded":"2024-09-21T03:25:05.950577+0000","last_fullsized":"2024-09-21T03:25:05.950577+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958997+0000","last_change":"2024-09-21T03:25:05.949208+0000","last_active":"2024-09-21T03:25:07.958997+0000","last_peered":"2024-09-21T03:25:07.958997+0000","last_clean":"2024-09-21T03:25:07.958997+0000","last_became_active":"2024-09-21T03:25:05.948664+0000","last_became_peered":"2024-09-21T03:25:05.948664+0000","last_unstale":"2024-09-21T03:25:07.958997+0000","last_undegraded":"2024-09-21T03:25:07.958997+0000","last_fullsized":"2024-09-21T03:25:07.958997+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:20.392815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.946336+0000","last_change":"2024-09-21T03:25:05.946336+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.946336+0000","last_undegraded":"2024-09-21T03:25:05.946336+0000","last_fullsized":"2024-09-21T03:25:05.946336+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.964175+0000","last_change":"2024-09-21T03:25:05.961517+0000","last_active":"2024-09-21T03:25:05.964175+0000","last_peered":"2024-09-21T03:25:05.964175+0000","last_clean":"2024-09-21T03:25:05.964175+0000","last_became_active":"2024-09-21T03:25:05.961159+0000","last_became_peered":"2024-09-21T03:25:05.961159+0000","last_unstale":"2024-09-21T03:25:05.964175+0000","last_undegraded":"2024-09-21T03:25:05.964175+0000","last_fullsized":"2024-09-21T03:25:05.964175+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:42.357829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958256+0000","last_change":"2024-09-21T03:25:06.968024+0000","last_active":"2024-09-21T03:25:07.958256+0000","last_peered":"2024-09-21T03:25:07.958256+0000","last_clean":"2024-09-21T03:25:07.958256+0000","last_became_active":"2024-09-21T03:25:06.967584+0000","last_became_peered":"2024-09-21T03:25:06.967584+0000","last_unstale":"2024-09-21T03:25:07.958256+0000","last_undegraded":"2024-09-21T03:25:07.958256+0000","last_fullsized":"2024-09-21T03:25:07.958256+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:14.835962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.947689+0000","last_change":"2024-09-21T03:25:05.953316+0000","last_active":"2024-09-21T03:25:06.947689+0000","last_peered":"2024-09-21T03:25:06.947689+0000","last_clean":"2024-09-21T03:25:06.947689+0000","last_became_active":"2024-09-21T03:25:05.953009+0000","last_became_peered":"2024-09-21T03:25:05.953009+0000","last_unstale":"2024-09-21T03:25:06.947689+0000","last_undegraded":"2024-09-21T03:25:06.947689+0000","last_fullsized":"2024-09-21T03:25:06.947689+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:13.832422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958341+0000","last_change":"2024-09-21T03:25:06.957735+0000","last_active":"2024-09-21T03:25:07.958341+0000","last_peered":"2024-09-21T03:25:07.958341+0000","last_clean":"2024-09-21T03:25:07.958341+0000","last_became_active":"2024-09-21T03:25:06.957327+0000","last_became_peered":"2024-09-21T03:25:06.957327+0000","last_unstale":"2024-09-21T03:25:07.958341+0000","last_undegraded":"2024-09-21T03:25:07.958341+0000","last_fullsized":"2024-09-21T03:25:07.958341+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:49.780931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.945223+0000","last_change":"2024-09-21T03:25:05.949661+0000","last_active":"2024-09-21T03:25:06.945223+0000","last_peered":"2024-09-21T03:25:06.945223+0000","last_clean":"2024-09-21T03:25:06.945223+0000","last_became_active":"2024-09-21T03:25:05.949336+0000","last_became_peered":"2024-09-21T03:25:05.949336+0000","last_unstale":"2024-09-21T03:25:06.945223+0000","last_undegraded":"2024-09-21T03:25:06.945223+0000","last_fullsized":"2024-09-21T03:25:06.945223+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:48.750266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958762+0000","last_change":"2024-09-21T03:25:06.948815+0000","last_active":"2024-09-21T03:25:07.958762+0000","last_peered":"2024-09-21T03:25:07.958762+0000","last_clean":"2024-09-21T03:25:07.958762+0000","last_became_active":"2024-09-21T03:25:06.948415+0000","last_became_peered":"2024-09-21T03:25:06.948415+0000","last_unstale":"2024-09-21T03:25:07.958762+0000","last_undegraded":"2024-09-21T03:25:07.958762+0000","last_fullsized":"2024-09-21T03:25:07.958762+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:03.305218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958470+0000","last_change":"2024-09-21T03:25:05.945536+0000","last_active":"2024-09-21T03:25:07.958470+0000","last_peered":"2024-09-21T03:25:07.958470+0000","last_clean":"2024-09-21T03:25:07.958470+0000","last_became_active":"2024-09-21T03:25:05.945162+0000","last_became_peered":"2024-09-21T03:25:05.945162+0000","last_unstale":"2024-09-21T03:25:07.958470+0000","last_undegraded":"2024-09-21T03:25:07.958470+0000","last_fullsized":"2024-09-21T03:25:07.958470+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:09.991545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954517+0000","last_change":"2024-09-21T03:25:06.957533+0000","last_active":"2024-09-21T03:25:07.954517+0000","last_peered":"2024-09-21T03:25:07.954517+0000","last_clean":"2024-09-21T03:25:07.954517+0000","last_became_active":"2024-09-21T03:25:06.957214+0000","last_became_peered":"2024-09-21T03:25:06.957214+0000","last_unstale":"2024-09-21T03:25:07.954517+0000","last_undegraded":"2024-09-21T03:25:07.954517+0000","last_fullsized":"2024-09-21T03:25:07.954517+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:24.677842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.942986+0000","last_change":"2024-09-21T03:25:05.953058+0000","last_active":"2024-09-21T03:25:06.942986+0000","last_peered":"2024-09-21T03:25:06.942986+0000","last_clean":"2024-09-21T03:25:06.942986+0000","last_became_active":"2024-09-21T03:25:05.952512+0000","last_became_peered":"2024-09-21T03:25:05.952512+0000","last_unstale":"2024-09-21T03:25:06.942986+0000","last_undegraded":"2024-09-21T03:25:06.942986+0000","last_fullsized":"2024-09-21T03:25:06.942986+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:34.953614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.944325+0000","last_change":"2024-09-21T03:25:05.944325+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.944325+0000","last_undegraded":"2024-09-21T03:25:05.944325+0000","last_fullsized":"2024-09-21T03:25:05.944325+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.963735+0000","last_change":"2024-09-21T03:25:05.960646+0000","last_active":"2024-09-21T03:25:05.963735+0000","last_peered":"2024-09-21T03:25:05.963735+0000","last_clean":"2024-09-21T03:25:05.963735+0000","last_became_active":"2024-09-21T03:25:05.959992+0000","last_became_peered":"2024-09-21T03:25:05.959992+0000","last_unstale":"2024-09-21T03:25:05.963735+0000","last_undegraded":"2024-09-21T03:25:05.963735+0000","last_fullsized":"2024-09-21T03:25:05.963735+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:23.072517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.964593+0000","last_change":"2024-09-21T03:25:06.962590+0000","last_active":"2024-09-21T03:25:06.964593+0000","last_peered":"2024-09-21T03:25:06.964593+0000","last_clean":"2024-09-21T03:25:06.964593+0000","last_became_active":"2024-09-21T03:25:06.962295+0000","last_became_peered":"2024-09-21T03:25:06.962295+0000","last_unstale":"2024-09-21T03:25:06.964593+0000","last_undegraded":"2024-09-21T03:25:06.964593+0000","last_fullsized":"2024-09-21T03:25:06.964593+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:04:58.099896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.947269+0000","last_change":"2024-09-21T03:25:05.955078+0000","last_active":"2024-09-21T03:25:06.947269+0000","last_peered":"2024-09-21T03:25:06.947269+0000","last_clean":"2024-09-21T03:25:06.947269+0000","last_became_active":"2024-09-21T03:25:05.954784+0000","last_became_peered":"2024-09-21T03:25:05.954784+0000","last_unstale":"2024-09-21T03:25:06.947269+0000","last_undegraded":"2024-09-21T03:25:06.947269+0000","last_fullsized":"2024-09-21T03:25:06.947269+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:15:08.648155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":266,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954464+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:25:07.954464+0000","last_peered":"2024-09-21T03:25:07.954464+0000","last_clean":"2024-09-21T03:25:07.954464+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:25:07.954464+0000","last_undegraded":"2024-09-21T03:25:07.954464+0000","last_fullsized":"2024-09-21T03:25:07.954464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":686,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509527,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33020,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338820,"statfs":{"total":96636764160,"available":96602951680,"internally_reserved":0,"allocated":1875968,"data_stored":1131075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509526,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32456,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":1290240,"data_stored":546461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509525,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1282048,"data_stored":540695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509525,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32436,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339404,"statfs":{"total":96636764160,"available":96603549696,"internally_reserved":0,"allocated":1273856,"data_stored":540091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509526,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32456,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":1290240,"data_stored":541773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509526,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1273856,"data_stored":540091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509526,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36600,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335240,"statfs":{"total":96636764160,"available":96599285760,"internally_reserved":0,"allocated":1282048,"data_stored":540215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574933,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33000,"kb_used_data":1800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338840,"statfs":{"total":96636764160,"available":96602972160,"internally_reserved":0,"allocated":1843200,"data_stored":1117409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:25:10.676 INFO:tasks.ceph.ceph_manager.ceph:PG 17.3f is not active+clean 2024-09-21T03:25:10.676 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:25:05.957598+0000', 'last_change': '2024-09-21T03:25:05.957598+0000', 'last_active': '2024-09-21T03:25:05.927023+0000', 'last_peered': '2024-09-21T03:25:05.927023+0000', 'last_clean': '2024-09-21T03:25:05.927023+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:05.957598+0000', 'last_undegraded': '2024-09-21T03:25:05.957598+0000', 'last_fullsized': '2024-09-21T03:25:05.957598+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:25:10.676 INFO:tasks.ceph.ceph_manager.ceph:PG 17.3c is not active+clean 2024-09-21T03:25:10.676 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:25:05.957630+0000', 'last_change': '2024-09-21T03:25:05.957630+0000', 'last_active': '2024-09-21T03:25:05.927023+0000', 'last_peered': '2024-09-21T03:25:05.927023+0000', 'last_clean': '2024-09-21T03:25:05.927023+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:05.957630+0000', 'last_undegraded': '2024-09-21T03:25:05.957630+0000', 'last_fullsized': '2024-09-21T03:25:05.957630+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:25:10.676 INFO:tasks.ceph.ceph_manager.ceph:PG 17.37 is not active+clean 2024-09-21T03:25:10.676 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:25:05.957055+0000', 'last_change': '2024-09-21T03:25:05.957055+0000', 'last_active': '2024-09-21T03:25:05.927023+0000', 'last_peered': '2024-09-21T03:25:05.927023+0000', 'last_clean': '2024-09-21T03:25:05.927023+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:05.957055+0000', 'last_undegraded': '2024-09-21T03:25:05.957055+0000', 'last_fullsized': '2024-09-21T03:25:05.957055+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:25:10.676 INFO:tasks.ceph.ceph_manager.ceph:PG 17.36 is not active+clean 2024-09-21T03:25:10.676 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:25:05.956508+0000', 'last_change': '2024-09-21T03:25:05.956508+0000', 'last_active': '2024-09-21T03:25:05.927023+0000', 'last_peered': '2024-09-21T03:25:05.927023+0000', 'last_clean': '2024-09-21T03:25:05.927023+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:05.956508+0000', 'last_undegraded': '2024-09-21T03:25:05.956508+0000', 'last_fullsized': '2024-09-21T03:25:05.956508+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:25:10.676 INFO:tasks.ceph.ceph_manager.ceph:PG 17.34 is not active+clean 2024-09-21T03:25:10.677 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:25:05.956841+0000', 'last_change': '2024-09-21T03:25:05.956841+0000', 'last_active': '2024-09-21T03:25:05.927023+0000', 'last_peered': '2024-09-21T03:25:05.927023+0000', 'last_clean': '2024-09-21T03:25:05.927023+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:05.956841+0000', 'last_undegraded': '2024-09-21T03:25:05.956841+0000', 'last_fullsized': '2024-09-21T03:25:05.956841+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:25:10.677 INFO:tasks.ceph.ceph_manager.ceph:PG 17.30 is not active+clean 2024-09-21T03:25:10.677 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:25:05.954927+0000', 'last_change': '2024-09-21T03:25:05.954927+0000', 'last_active': '2024-09-21T03:25:05.927023+0000', 'last_peered': '2024-09-21T03:25:05.927023+0000', 'last_clean': '2024-09-21T03:25:05.927023+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:05.954927+0000', 'last_undegraded': '2024-09-21T03:25:05.954927+0000', 'last_fullsized': '2024-09-21T03:25:05.954927+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:25:10.677 INFO:tasks.ceph.ceph_manager.ceph:PG 17.26 is not active+clean 2024-09-21T03:25:10.677 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:25:05.953063+0000', 'last_change': '2024-09-21T03:25:05.953063+0000', 'last_active': '2024-09-21T03:25:05.927023+0000', 'last_peered': '2024-09-21T03:25:05.927023+0000', 'last_clean': '2024-09-21T03:25:05.927023+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:05.953063+0000', 'last_undegraded': '2024-09-21T03:25:05.953063+0000', 'last_fullsized': '2024-09-21T03:25:05.953063+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:25:10.677 INFO:tasks.ceph.ceph_manager.ceph:PG 17.21 is not active+clean 2024-09-21T03:25:10.677 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:25:05.951900+0000', 'last_change': '2024-09-21T03:25:05.951900+0000', 'last_active': '2024-09-21T03:25:05.927023+0000', 'last_peered': '2024-09-21T03:25:05.927023+0000', 'last_clean': '2024-09-21T03:25:05.927023+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:05.951900+0000', 'last_undegraded': '2024-09-21T03:25:05.951900+0000', 'last_fullsized': '2024-09-21T03:25:05.951900+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:25:10.677 INFO:tasks.ceph.ceph_manager.ceph:PG 17.1a is not active+clean 2024-09-21T03:25:10.677 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:25:05.951678+0000', 'last_change': '2024-09-21T03:25:05.951678+0000', 'last_active': '2024-09-21T03:25:05.927023+0000', 'last_peered': '2024-09-21T03:25:05.927023+0000', 'last_clean': '2024-09-21T03:25:05.927023+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:05.951678+0000', 'last_undegraded': '2024-09-21T03:25:05.951678+0000', 'last_fullsized': '2024-09-21T03:25:05.951678+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:25:10.677 INFO:tasks.ceph.ceph_manager.ceph:PG 17.18 is not active+clean 2024-09-21T03:25:10.677 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:25:05.954176+0000', 'last_change': '2024-09-21T03:25:05.954176+0000', 'last_active': '2024-09-21T03:25:05.927023+0000', 'last_peered': '2024-09-21T03:25:05.927023+0000', 'last_clean': '2024-09-21T03:25:05.927023+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:05.954176+0000', 'last_undegraded': '2024-09-21T03:25:05.954176+0000', 'last_fullsized': '2024-09-21T03:25:05.954176+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:25:10.678 INFO:tasks.ceph.ceph_manager.ceph:PG 17.b is not active+clean 2024-09-21T03:25:10.678 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:25:05.951118+0000', 'last_change': '2024-09-21T03:25:05.951118+0000', 'last_active': '2024-09-21T03:25:05.927023+0000', 'last_peered': '2024-09-21T03:25:05.927023+0000', 'last_clean': '2024-09-21T03:25:05.927023+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:05.951118+0000', 'last_undegraded': '2024-09-21T03:25:05.951118+0000', 'last_fullsized': '2024-09-21T03:25:05.951118+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:25:10.678 INFO:tasks.ceph.ceph_manager.ceph:PG 17.7 is not active+clean 2024-09-21T03:25:10.678 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:25:05.950577+0000', 'last_change': '2024-09-21T03:25:05.950577+0000', 'last_active': '2024-09-21T03:25:05.927023+0000', 'last_peered': '2024-09-21T03:25:05.927023+0000', 'last_clean': '2024-09-21T03:25:05.927023+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:05.950577+0000', 'last_undegraded': '2024-09-21T03:25:05.950577+0000', 'last_fullsized': '2024-09-21T03:25:05.950577+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:25:10.678 INFO:tasks.ceph.ceph_manager.ceph:PG 17.4 is not active+clean 2024-09-21T03:25:10.678 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:25:05.946336+0000', 'last_change': '2024-09-21T03:25:05.946336+0000', 'last_active': '2024-09-21T03:25:05.927023+0000', 'last_peered': '2024-09-21T03:25:05.927023+0000', 'last_clean': '2024-09-21T03:25:05.927023+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:05.946336+0000', 'last_undegraded': '2024-09-21T03:25:05.946336+0000', 'last_fullsized': '2024-09-21T03:25:05.946336+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:25:10.678 INFO:tasks.ceph.ceph_manager.ceph:PG 17.1 is not active+clean 2024-09-21T03:25:10.678 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 102, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:25:05.944325+0000', 'last_change': '2024-09-21T03:25:05.944325+0000', 'last_active': '2024-09-21T03:25:05.927023+0000', 'last_peered': '2024-09-21T03:25:05.927023+0000', 'last_clean': '2024-09-21T03:25:05.927023+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:05.944325+0000', 'last_undegraded': '2024-09-21T03:25:05.944325+0000', 'last_fullsized': '2024-09-21T03:25:05.944325+0000', 'mapping_epoch': 102, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 102, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:05.927023+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:25:10.679 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T03:25:10.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.822+0000 7fbff1b8b640 1 -- 172.21.15.105:0/4285502607 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfec0cff70 msgr2=0x7fbfec15c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:10.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.822+0000 7fbff1b8b640 1 --2- 172.21.15.105:0/4285502607 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfec0cff70 0x7fbfec15c830 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc005fd0 tx=0x7fbfdc02a820 comp rx=0 tx=0).stop 2024-09-21T03:25:10.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.822+0000 7fbff1b8b640 1 -- 172.21.15.105:0/4285502607 shutdown_connections 2024-09-21T03:25:10.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.822+0000 7fbff1b8b640 1 --2- 172.21.15.105:0/4285502607 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfec0b4530 0x7fbfec0d0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:10.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.822+0000 7fbff1b8b640 1 --2- 172.21.15.105:0/4285502607 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfec0cff70 0x7fbfec15c830 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:10.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.822+0000 7fbff1b8b640 1 -- 172.21.15.105:0/4285502607 >> 172.21.15.105:0/4285502607 conn(0x7fbfec0cee20 msgr2=0x7fbfec0cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:10.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.822+0000 7fbff1b8b640 1 -- 172.21.15.105:0/4285502607 shutdown_connections 2024-09-21T03:25:10.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.822+0000 7fbff1b8b640 1 -- 172.21.15.105:0/4285502607 wait complete. 2024-09-21T03:25:10.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.823+0000 7fbff1b8b640 1 Processor -- start 2024-09-21T03:25:10.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.824+0000 7fbff1b8b640 1 -- start start 2024-09-21T03:25:10.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.825+0000 7fbff1b8b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfec0cff70 0x7fbfec151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:10.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.825+0000 7fbff1b8b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfec160c90 0x7fbfec0c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:10.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.825+0000 7fbff1b8b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfec0c8870 0x7fbfec0cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:10.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.825+0000 7fbff1b8b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbfec0d1730 con 0x7fbfec0cff70 2024-09-21T03:25:10.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.825+0000 7fbff1b8b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbfec0d15b0 con 0x7fbfec160c90 2024-09-21T03:25:10.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.825+0000 7fbff1b8b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbfec0d18b0 con 0x7fbfec0c8870 2024-09-21T03:25:10.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.825+0000 7fbfeb7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfec0cff70 0x7fbfec151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:10.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.825+0000 7fbfeb7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfec0cff70 0x7fbfec151450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:44848/0 (socket says 172.21.15.105:44848) 2024-09-21T03:25:10.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.825+0000 7fbfeb7fe640 1 -- 172.21.15.105:0/1805287726 learned_addr learned my addr 172.21.15.105:0/1805287726 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:10.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.825+0000 7fbfebfff640 1 --2- 172.21.15.105:0/1805287726 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfec0c8870 0x7fbfec0cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:10.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.825+0000 7fbfeaffd640 1 --2- 172.21.15.105:0/1805287726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfec160c90 0x7fbfec0c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:10.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.825+0000 7fbfeb7fe640 1 -- 172.21.15.105:0/1805287726 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfec0c8870 msgr2=0x7fbfec0cb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:10.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.825+0000 7fbfeb7fe640 1 --2- 172.21.15.105:0/1805287726 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfec0c8870 0x7fbfec0cb2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:10.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.825+0000 7fbfeb7fe640 1 -- 172.21.15.105:0/1805287726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfec160c90 msgr2=0x7fbfec0c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:10.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.825+0000 7fbfeb7fe640 1 --2- 172.21.15.105:0/1805287726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfec160c90 0x7fbfec0c8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:10.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.825+0000 7fbfeb7fe640 1 -- 172.21.15.105:0/1805287726 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfec0c80d0 con 0x7fbfec0cff70 2024-09-21T03:25:10.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.825+0000 7fbfebfff640 1 --2- 172.21.15.105:0/1805287726 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfec0c8870 0x7fbfec0cb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:25:10.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.825+0000 7fbfeaffd640 1 --2- 172.21.15.105:0/1805287726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfec160c90 0x7fbfec0c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:25:10.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.825+0000 7fbfeb7fe640 1 --2- 172.21.15.105:0/1805287726 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfec0cff70 0x7fbfec151450 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc02ae10 tx=0x7fbfdc032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:10.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.826+0000 7fbfd3fff640 1 -- 172.21.15.105:0/1805287726 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc037040 con 0x7fbfec0cff70 2024-09-21T03:25:10.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.826+0000 7fbfd3fff640 1 -- 172.21.15.105:0/1805287726 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbfdc042070 con 0x7fbfec0cff70 2024-09-21T03:25:10.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.826+0000 7fbff1b8b640 1 -- 172.21.15.105:0/1805287726 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfec0b1830 con 0x7fbfec0cff70 2024-09-21T03:25:10.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.826+0000 7fbfd3fff640 1 -- 172.21.15.105:0/1805287726 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc004280 con 0x7fbfec0cff70 2024-09-21T03:25:10.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.826+0000 7fbff1b8b640 1 -- 172.21.15.105:0/1805287726 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfec0b1df0 con 0x7fbfec0cff70 2024-09-21T03:25:10.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.827+0000 7fbff1b8b640 1 -- 172.21.15.105:0/1805287726 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfec0d1dd0 con 0x7fbfec0cff70 2024-09-21T03:25:10.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.827+0000 7fbfd3fff640 1 -- 172.21.15.105:0/1805287726 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbfdc004420 con 0x7fbfec0cff70 2024-09-21T03:25:10.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.828+0000 7fbfd3fff640 1 --2- 172.21.15.105:0/1805287726 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbfd8078b90 0x7fbfd807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:10.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.828+0000 7fbfd3fff640 1 -- 172.21.15.105:0/1805287726 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7fbfdc0bbce0 con 0x7fbfec0cff70 2024-09-21T03:25:10.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.828+0000 7fbfeaffd640 1 --2- 172.21.15.105:0/1805287726 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbfd8078b90 0x7fbfd807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:10.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.829+0000 7fbfeaffd640 1 --2- 172.21.15.105:0/1805287726 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbfd8078b90 0x7fbfd807b0a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0000f60 tx=0x7fbfe0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:10.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:10.832+0000 7fbfd3fff640 1 -- 172.21.15.105:0/1805287726 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbfdc084120 con 0x7fbfec0cff70 2024-09-21T03:25:11.083 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.082+0000 7fbff1b8b640 1 -- 172.21.15.105:0/1805287726 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fbfec0b6900 con 0x7fbfec0cff70 2024-09-21T03:25:11.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.082+0000 7fbfd3fff640 1 -- 172.21.15.105:0/1805287726 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1562 (secure 0 0 0) 0x7fbfdc083a20 con 0x7fbfec0cff70 2024-09-21T03:25:11.084 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:11.084 INFO:teuthology.orchestra.run.smithi105.stdout:{"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":426,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":104,"num_osds":8,"num_up_osds":8,"osd_up_since":1726888698,"num_in_osds":8,"osd_in_since":1726888688,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":83},{"state_name":"creating+peering","count":14}],"num_pgs":97,"num_pools":3,"num_objects":16,"data_bytes":591054,"bytes_used":271208448,"bytes_avail":772822904832,"bytes_total":773094113280,"inactive_pgs_ratio":0.14432989060878754,"write_bytes_sec":2067,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":65,"btime":"2024-09-21T03:25:08:950897+0000","id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"a","status":"up:active","gid":7164}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2024-09-21T03:24:55.383365+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T03:25:11.086 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.085+0000 7fbff1b8b640 1 -- 172.21.15.105:0/1805287726 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbfd8078b90 msgr2=0x7fbfd807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:11.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.085+0000 7fbff1b8b640 1 --2- 172.21.15.105:0/1805287726 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbfd8078b90 0x7fbfd807b0a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0000f60 tx=0x7fbfe0009040 comp rx=0 tx=0).stop 2024-09-21T03:25:11.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.085+0000 7fbff1b8b640 1 -- 172.21.15.105:0/1805287726 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfec0cff70 msgr2=0x7fbfec151450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:11.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.085+0000 7fbff1b8b640 1 --2- 172.21.15.105:0/1805287726 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfec0cff70 0x7fbfec151450 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc02ae10 tx=0x7fbfdc032d10 comp rx=0 tx=0).stop 2024-09-21T03:25:11.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.085+0000 7fbff1b8b640 1 -- 172.21.15.105:0/1805287726 shutdown_connections 2024-09-21T03:25:11.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.085+0000 7fbff1b8b640 1 --2- 172.21.15.105:0/1805287726 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbfd8078b90 0x7fbfd807b0a0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:11.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.085+0000 7fbff1b8b640 1 --2- 172.21.15.105:0/1805287726 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfec0c8870 0x7fbfec0cb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:11.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.085+0000 7fbff1b8b640 1 --2- 172.21.15.105:0/1805287726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfec160c90 0x7fbfec0c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:11.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.085+0000 7fbff1b8b640 1 --2- 172.21.15.105:0/1805287726 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfec0cff70 0x7fbfec151450 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:11.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.085+0000 7fbff1b8b640 1 -- 172.21.15.105:0/1805287726 >> 172.21.15.105:0/1805287726 conn(0x7fbfec0cee20 msgr2=0x7fbfec159eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:11.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.085+0000 7fbff1b8b640 1 -- 172.21.15.105:0/1805287726 shutdown_connections 2024-09-21T03:25:11.087 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.085+0000 7fbff1b8b640 1 -- 172.21.15.105:0/1805287726 wait complete. 2024-09-21T03:25:11.098 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-21T03:25:11.098 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:25:11.210 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.208+0000 7fe26fa63640 1 -- 172.21.15.105:0/2650732854 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe254003a50 msgr2=0x7fe254003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:11.210 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.208+0000 7fe26fa63640 1 --2- 172.21.15.105:0/2650732854 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe254003a50 0x7fe254003ec0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fe264009b50 tx=0x7fe254005830 comp rx=0 tx=0).stop 2024-09-21T03:25:11.211 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.208+0000 7fe26fa63640 1 -- 172.21.15.105:0/2650732854 shutdown_connections 2024-09-21T03:25:11.211 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.208+0000 7fe26fa63640 1 --2- 172.21.15.105:0/2650732854 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe254003a50 0x7fe254003ec0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:11.211 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.208+0000 7fe26fa63640 1 -- 172.21.15.105:0/2650732854 >> 172.21.15.105:0/2650732854 conn(0x7fe268072ae0 msgr2=0x7fe268072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:11.211 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.209+0000 7fe26fa63640 1 -- 172.21.15.105:0/2650732854 shutdown_connections 2024-09-21T03:25:11.211 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.209+0000 7fe26fa63640 1 -- 172.21.15.105:0/2650732854 wait complete. 2024-09-21T03:25:11.212 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.210+0000 7fe26fa63640 1 Processor -- start 2024-09-21T03:25:11.212 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.210+0000 7fe26fa63640 1 -- start start 2024-09-21T03:25:11.214 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.212+0000 7fe26fa63640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe254003a50 0x7fe26806f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:11.214 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.212+0000 7fe26fa63640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2680b1330 0x7fe2680cc090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:11.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.212+0000 7fe26fa63640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe268159500 0x7fe268159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:11.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.212+0000 7fe26fa63640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe26815c860 con 0x7fe2680b1330 2024-09-21T03:25:11.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.212+0000 7fe26fa63640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe26815c6e0 con 0x7fe268159500 2024-09-21T03:25:11.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.212+0000 7fe26fa63640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe26815c9e0 con 0x7fe254003a50 2024-09-21T03:25:11.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.212+0000 7fe26cffe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2680b1330 0x7fe2680cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:11.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.212+0000 7fe26cffe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2680b1330 0x7fe2680cc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:44868/0 (socket says 172.21.15.105:44868) 2024-09-21T03:25:11.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.212+0000 7fe26cffe640 1 -- 172.21.15.105:0/4054387780 learned_addr learned my addr 172.21.15.105:0/4054387780 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:11.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.212+0000 7fe26d7ff640 1 --2- 172.21.15.105:0/4054387780 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe254003a50 0x7fe26806f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:11.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.212+0000 7fe26e000640 1 --2- 172.21.15.105:0/4054387780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe268159500 0x7fe268159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:11.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.212+0000 7fe26cffe640 1 -- 172.21.15.105:0/4054387780 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe254003a50 msgr2=0x7fe26806f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:11.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.212+0000 7fe26cffe640 1 --2- 172.21.15.105:0/4054387780 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe254003a50 0x7fe26806f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:11.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.212+0000 7fe26cffe640 1 -- 172.21.15.105:0/4054387780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe268159500 msgr2=0x7fe268159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:11.216 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.212+0000 7fe26cffe640 1 --2- 172.21.15.105:0/4054387780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe268159500 0x7fe268159910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:11.216 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.212+0000 7fe26cffe640 1 -- 172.21.15.105:0/4054387780 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe268159e50 con 0x7fe2680b1330 2024-09-21T03:25:11.216 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.212+0000 7fe26cffe640 1 --2- 172.21.15.105:0/4054387780 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2680b1330 0x7fe2680cc090 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fe258004e50 tx=0x7fe258001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:11.216 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.212+0000 7fe25dffb640 1 -- 172.21.15.105:0/4054387780 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe258015020 con 0x7fe2680b1330 2024-09-21T03:25:11.216 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.212+0000 7fe25dffb640 1 -- 172.21.15.105:0/4054387780 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe258011960 con 0x7fe2680b1330 2024-09-21T03:25:11.216 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.212+0000 7fe26fa63640 1 -- 172.21.15.105:0/4054387780 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe26814cf40 con 0x7fe2680b1330 2024-09-21T03:25:11.216 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.212+0000 7fe25dffb640 1 -- 172.21.15.105:0/4054387780 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe258001d40 con 0x7fe2680b1330 2024-09-21T03:25:11.216 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.213+0000 7fe26fa63640 1 -- 172.21.15.105:0/4054387780 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe26814d500 con 0x7fe2680b1330 2024-09-21T03:25:11.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.214+0000 7fe26fa63640 1 -- 172.21.15.105:0/4054387780 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe26806f8b0 con 0x7fe2680b1330 2024-09-21T03:25:11.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.214+0000 7fe25dffb640 1 -- 172.21.15.105:0/4054387780 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe258018020 con 0x7fe2680b1330 2024-09-21T03:25:11.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.215+0000 7fe25dffb640 1 --2- 172.21.15.105:0/4054387780 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe24c078bc0 0x7fe24c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:11.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.215+0000 7fe25dffb640 1 -- 172.21.15.105:0/4054387780 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7fe25809b5e0 con 0x7fe2680b1330 2024-09-21T03:25:11.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.215+0000 7fe26d7ff640 1 --2- 172.21.15.105:0/4054387780 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe24c078bc0 0x7fe24c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:11.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.215+0000 7fe26d7ff640 1 --2- 172.21.15.105:0/4054387780 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe24c078bc0 0x7fe24c07b0d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe264035000 tx=0x7fe2640046c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:11.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.219+0000 7fe25dffb640 1 -- 172.21.15.105:0/4054387780 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe25801f020 con 0x7fe2680b1330 2024-09-21T03:25:11.393 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.391+0000 7fe26fa63640 1 -- 172.21.15.105:0/4054387780 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe2680cdf30 con 0x7fe24c078bc0 2024-09-21T03:25:11.397 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.396+0000 7fe25dffb640 1 -- 172.21.15.105:0/4054387780 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251298 (secure 0 0 0) 0x7fe2680cdf30 con 0x7fe24c078bc0 2024-09-21T03:25:11.401 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:11.402 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:25:11.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.399+0000 7fe26fa63640 1 -- 172.21.15.105:0/4054387780 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe24c078bc0 msgr2=0x7fe24c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:11.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.399+0000 7fe26fa63640 1 --2- 172.21.15.105:0/4054387780 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe24c078bc0 0x7fe24c07b0d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe264035000 tx=0x7fe2640046c0 comp rx=0 tx=0).stop 2024-09-21T03:25:11.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.399+0000 7fe26fa63640 1 -- 172.21.15.105:0/4054387780 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2680b1330 msgr2=0x7fe2680cc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:11.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.399+0000 7fe26fa63640 1 --2- 172.21.15.105:0/4054387780 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2680b1330 0x7fe2680cc090 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fe258004e50 tx=0x7fe258001630 comp rx=0 tx=0).stop 2024-09-21T03:25:11.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.399+0000 7fe26fa63640 1 -- 172.21.15.105:0/4054387780 shutdown_connections 2024-09-21T03:25:11.404 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.399+0000 7fe26fa63640 1 --2- 172.21.15.105:0/4054387780 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe24c078bc0 0x7fe24c07b0d0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:11.404 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.399+0000 7fe26fa63640 1 --2- 172.21.15.105:0/4054387780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe268159500 0x7fe268159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:11.404 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.399+0000 7fe26fa63640 1 --2- 172.21.15.105:0/4054387780 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2680b1330 0x7fe2680cc090 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:11.404 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.399+0000 7fe26fa63640 1 --2- 172.21.15.105:0/4054387780 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe254003a50 0x7fe26806f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:11.404 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.399+0000 7fe26fa63640 1 -- 172.21.15.105:0/4054387780 >> 172.21.15.105:0/4054387780 conn(0x7fe268072ae0 msgr2=0x7fe2680b6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:11.404 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.399+0000 7fe26fa63640 1 -- 172.21.15.105:0/4054387780 shutdown_connections 2024-09-21T03:25:11.404 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:11.399+0000 7fe26fa63640 1 -- 172.21.15.105:0/4054387780 wait complete. 2024-09-21T03:25:11.412 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":305,"stamp":"2024-09-21T03:25:11.387146+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591054,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":134,"num_write_kb":1637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":134,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":264852,"kb_used_data":11144,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754709868,"statfs":{"total":773094113280,"available":772822904832,"internally_reserved":0,"allocated":11411456,"data_stored":5497810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":686,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001562"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.957598+0000","last_change":"2024-09-21T03:25:05.957598+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.957598+0000","last_undegraded":"2024-09-21T03:25:05.957598+0000","last_fullsized":"2024-09-21T03:25:05.957598+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958208+0000","last_change":"2024-09-21T03:25:06.960292+0000","last_active":"2024-09-21T03:25:07.958208+0000","last_peered":"2024-09-21T03:25:07.958208+0000","last_clean":"2024-09-21T03:25:07.958208+0000","last_became_active":"2024-09-21T03:25:06.959916+0000","last_became_peered":"2024-09-21T03:25:06.959916+0000","last_unstale":"2024-09-21T03:25:07.958208+0000","last_undegraded":"2024-09-21T03:25:07.958208+0000","last_fullsized":"2024-09-21T03:25:07.958208+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:46.004543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954544+0000","last_change":"2024-09-21T03:25:06.950883+0000","last_active":"2024-09-21T03:25:07.954544+0000","last_peered":"2024-09-21T03:25:07.954544+0000","last_clean":"2024-09-21T03:25:07.954544+0000","last_became_active":"2024-09-21T03:25:06.948632+0000","last_became_peered":"2024-09-21T03:25:06.948632+0000","last_unstale":"2024-09-21T03:25:07.954544+0000","last_undegraded":"2024-09-21T03:25:07.954544+0000","last_fullsized":"2024-09-21T03:25:07.954544+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:46.652368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.957630+0000","last_change":"2024-09-21T03:25:05.957630+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.957630+0000","last_undegraded":"2024-09-21T03:25:05.957630+0000","last_fullsized":"2024-09-21T03:25:05.957630+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.955650+0000","last_change":"2024-09-21T03:25:06.953631+0000","last_active":"2024-09-21T03:25:06.955650+0000","last_peered":"2024-09-21T03:25:06.955650+0000","last_clean":"2024-09-21T03:25:06.955650+0000","last_became_active":"2024-09-21T03:25:06.953277+0000","last_became_peered":"2024-09-21T03:25:06.953277+0000","last_unstale":"2024-09-21T03:25:06.955650+0000","last_undegraded":"2024-09-21T03:25:06.955650+0000","last_fullsized":"2024-09-21T03:25:06.955650+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:41.069474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.959528+0000","last_change":"2024-09-21T03:25:06.957920+0000","last_active":"2024-09-21T03:25:06.959528+0000","last_peered":"2024-09-21T03:25:06.959528+0000","last_clean":"2024-09-21T03:25:06.959528+0000","last_became_active":"2024-09-21T03:25:06.957312+0000","last_became_peered":"2024-09-21T03:25:06.957312+0000","last_unstale":"2024-09-21T03:25:06.959528+0000","last_undegraded":"2024-09-21T03:25:06.959528+0000","last_fullsized":"2024-09-21T03:25:06.959528+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:59:38.300937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.961126+0000","last_change":"2024-09-21T03:25:06.955776+0000","last_active":"2024-09-21T03:25:06.961126+0000","last_peered":"2024-09-21T03:25:06.961126+0000","last_clean":"2024-09-21T03:25:06.961126+0000","last_became_active":"2024-09-21T03:25:06.955407+0000","last_became_peered":"2024-09-21T03:25:06.955407+0000","last_unstale":"2024-09-21T03:25:06.961126+0000","last_undegraded":"2024-09-21T03:25:06.961126+0000","last_fullsized":"2024-09-21T03:25:06.961126+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:12.663157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954048+0000","last_change":"2024-09-21T03:25:06.958844+0000","last_active":"2024-09-21T03:25:07.954048+0000","last_peered":"2024-09-21T03:25:07.954048+0000","last_clean":"2024-09-21T03:25:07.954048+0000","last_became_active":"2024-09-21T03:25:06.958516+0000","last_became_peered":"2024-09-21T03:25:06.958516+0000","last_unstale":"2024-09-21T03:25:07.954048+0000","last_undegraded":"2024-09-21T03:25:07.954048+0000","last_fullsized":"2024-09-21T03:25:07.954048+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:13.569228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.957055+0000","last_change":"2024-09-21T03:25:05.957055+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.957055+0000","last_undegraded":"2024-09-21T03:25:05.957055+0000","last_fullsized":"2024-09-21T03:25:05.957055+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.956508+0000","last_change":"2024-09-21T03:25:05.956508+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.956508+0000","last_undegraded":"2024-09-21T03:25:05.956508+0000","last_fullsized":"2024-09-21T03:25:05.956508+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.959300+0000","last_change":"2024-09-21T03:25:06.951779+0000","last_active":"2024-09-21T03:25:07.959300+0000","last_peered":"2024-09-21T03:25:07.959300+0000","last_clean":"2024-09-21T03:25:07.959300+0000","last_became_active":"2024-09-21T03:25:06.951424+0000","last_became_peered":"2024-09-21T03:25:06.951424+0000","last_unstale":"2024-09-21T03:25:07.959300+0000","last_undegraded":"2024-09-21T03:25:07.959300+0000","last_fullsized":"2024-09-21T03:25:07.959300+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:45.933380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.956841+0000","last_change":"2024-09-21T03:25:05.956841+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.956841+0000","last_undegraded":"2024-09-21T03:25:05.956841+0000","last_fullsized":"2024-09-21T03:25:05.956841+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954480+0000","last_change":"2024-09-21T03:25:06.957896+0000","last_active":"2024-09-21T03:25:07.954480+0000","last_peered":"2024-09-21T03:25:07.954480+0000","last_clean":"2024-09-21T03:25:07.954480+0000","last_became_active":"2024-09-21T03:25:06.957553+0000","last_became_peered":"2024-09-21T03:25:06.957553+0000","last_unstale":"2024-09-21T03:25:07.954480+0000","last_undegraded":"2024-09-21T03:25:07.954480+0000","last_fullsized":"2024-09-21T03:25:07.954480+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:57.501083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954067+0000","last_change":"2024-09-21T03:25:06.956034+0000","last_active":"2024-09-21T03:25:07.954067+0000","last_peered":"2024-09-21T03:25:07.954067+0000","last_clean":"2024-09-21T03:25:07.954067+0000","last_became_active":"2024-09-21T03:25:06.955669+0000","last_became_peered":"2024-09-21T03:25:06.955669+0000","last_unstale":"2024-09-21T03:25:07.954067+0000","last_undegraded":"2024-09-21T03:25:07.954067+0000","last_fullsized":"2024-09-21T03:25:07.954067+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:33.027782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.961407+0000","last_change":"2024-09-21T03:25:06.955229+0000","last_active":"2024-09-21T03:25:06.961407+0000","last_peered":"2024-09-21T03:25:06.961407+0000","last_clean":"2024-09-21T03:25:06.961407+0000","last_became_active":"2024-09-21T03:25:06.954918+0000","last_became_peered":"2024-09-21T03:25:06.954918+0000","last_unstale":"2024-09-21T03:25:06.961407+0000","last_undegraded":"2024-09-21T03:25:06.961407+0000","last_fullsized":"2024-09-21T03:25:06.961407+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:53:15.188760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.954927+0000","last_change":"2024-09-21T03:25:05.954927+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.954927+0000","last_undegraded":"2024-09-21T03:25:05.954927+0000","last_fullsized":"2024-09-21T03:25:05.954927+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958041+0000","last_change":"2024-09-21T03:25:06.948574+0000","last_active":"2024-09-21T03:25:07.958041+0000","last_peered":"2024-09-21T03:25:07.958041+0000","last_clean":"2024-09-21T03:25:07.958041+0000","last_became_active":"2024-09-21T03:25:06.948291+0000","last_became_peered":"2024-09-21T03:25:06.948291+0000","last_unstale":"2024-09-21T03:25:07.958041+0000","last_undegraded":"2024-09-21T03:25:07.958041+0000","last_fullsized":"2024-09-21T03:25:07.958041+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:23.103570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958690+0000","last_change":"2024-09-21T03:25:06.943830+0000","last_active":"2024-09-21T03:25:07.958690+0000","last_peered":"2024-09-21T03:25:07.958690+0000","last_clean":"2024-09-21T03:25:07.958690+0000","last_became_active":"2024-09-21T03:25:06.943492+0000","last_became_peered":"2024-09-21T03:25:06.943492+0000","last_unstale":"2024-09-21T03:25:07.958690+0000","last_undegraded":"2024-09-21T03:25:07.958690+0000","last_fullsized":"2024-09-21T03:25:07.958690+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:58.003935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954528+0000","last_change":"2024-09-21T03:25:06.956428+0000","last_active":"2024-09-21T03:25:07.954528+0000","last_peered":"2024-09-21T03:25:07.954528+0000","last_clean":"2024-09-21T03:25:07.954528+0000","last_became_active":"2024-09-21T03:25:06.955989+0000","last_became_peered":"2024-09-21T03:25:06.955989+0000","last_unstale":"2024-09-21T03:25:07.954528+0000","last_undegraded":"2024-09-21T03:25:07.954528+0000","last_fullsized":"2024-09-21T03:25:07.954528+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:05.806487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958257+0000","last_change":"2024-09-21T03:25:06.946863+0000","last_active":"2024-09-21T03:25:07.958257+0000","last_peered":"2024-09-21T03:25:07.958257+0000","last_clean":"2024-09-21T03:25:07.958257+0000","last_became_active":"2024-09-21T03:25:06.946516+0000","last_became_peered":"2024-09-21T03:25:06.946516+0000","last_unstale":"2024-09-21T03:25:07.958257+0000","last_undegraded":"2024-09-21T03:25:07.958257+0000","last_fullsized":"2024-09-21T03:25:07.958257+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:14.835962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.959036+0000","last_change":"2024-09-21T03:25:06.952971+0000","last_active":"2024-09-21T03:25:07.959036+0000","last_peered":"2024-09-21T03:25:07.959036+0000","last_clean":"2024-09-21T03:25:07.959036+0000","last_became_active":"2024-09-21T03:25:06.952598+0000","last_became_peered":"2024-09-21T03:25:06.952598+0000","last_unstale":"2024-09-21T03:25:07.959036+0000","last_undegraded":"2024-09-21T03:25:07.959036+0000","last_fullsized":"2024-09-21T03:25:07.959036+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:11.279234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.957889+0000","last_change":"2024-09-21T03:25:06.953872+0000","last_active":"2024-09-21T03:25:06.957889+0000","last_peered":"2024-09-21T03:25:06.957889+0000","last_clean":"2024-09-21T03:25:06.957889+0000","last_became_active":"2024-09-21T03:25:06.953516+0000","last_became_peered":"2024-09-21T03:25:06.953516+0000","last_unstale":"2024-09-21T03:25:06.957889+0000","last_undegraded":"2024-09-21T03:25:06.957889+0000","last_fullsized":"2024-09-21T03:25:06.957889+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:49.780931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.957699+0000","last_change":"2024-09-21T03:25:06.946898+0000","last_active":"2024-09-21T03:25:07.957699+0000","last_peered":"2024-09-21T03:25:07.957699+0000","last_clean":"2024-09-21T03:25:07.957699+0000","last_became_active":"2024-09-21T03:25:06.946529+0000","last_became_peered":"2024-09-21T03:25:06.946529+0000","last_unstale":"2024-09-21T03:25:07.957699+0000","last_undegraded":"2024-09-21T03:25:07.957699+0000","last_fullsized":"2024-09-21T03:25:07.957699+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:28.581453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.964617+0000","last_change":"2024-09-21T03:25:06.963339+0000","last_active":"2024-09-21T03:25:06.964617+0000","last_peered":"2024-09-21T03:25:06.964617+0000","last_clean":"2024-09-21T03:25:06.964617+0000","last_became_active":"2024-09-21T03:25:06.963052+0000","last_became_peered":"2024-09-21T03:25:06.963052+0000","last_unstale":"2024-09-21T03:25:06.964617+0000","last_undegraded":"2024-09-21T03:25:06.964617+0000","last_fullsized":"2024-09-21T03:25:06.964617+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:45.382063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958302+0000","last_change":"2024-09-21T03:25:06.947798+0000","last_active":"2024-09-21T03:25:07.958302+0000","last_peered":"2024-09-21T03:25:07.958302+0000","last_clean":"2024-09-21T03:25:07.958302+0000","last_became_active":"2024-09-21T03:25:06.947494+0000","last_became_peered":"2024-09-21T03:25:06.947494+0000","last_unstale":"2024-09-21T03:25:07.958302+0000","last_undegraded":"2024-09-21T03:25:07.958302+0000","last_fullsized":"2024-09-21T03:25:07.958302+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:58.003935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.953063+0000","last_change":"2024-09-21T03:25:05.953063+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.953063+0000","last_undegraded":"2024-09-21T03:25:05.953063+0000","last_fullsized":"2024-09-21T03:25:05.953063+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.966709+0000","last_change":"2024-09-21T03:25:06.965906+0000","last_active":"2024-09-21T03:25:06.966709+0000","last_peered":"2024-09-21T03:25:06.966709+0000","last_clean":"2024-09-21T03:25:06.966709+0000","last_became_active":"2024-09-21T03:25:06.965595+0000","last_became_peered":"2024-09-21T03:25:06.965595+0000","last_unstale":"2024-09-21T03:25:06.966709+0000","last_undegraded":"2024-09-21T03:25:06.966709+0000","last_fullsized":"2024-09-21T03:25:06.966709+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:32.430160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.974231+0000","last_change":"2024-09-21T03:25:06.972998+0000","last_active":"2024-09-21T03:25:06.974231+0000","last_peered":"2024-09-21T03:25:06.974231+0000","last_clean":"2024-09-21T03:25:06.974231+0000","last_became_active":"2024-09-21T03:25:06.972535+0000","last_became_peered":"2024-09-21T03:25:06.972535+0000","last_unstale":"2024-09-21T03:25:06.974231+0000","last_undegraded":"2024-09-21T03:25:06.974231+0000","last_fullsized":"2024-09-21T03:25:06.974231+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:23.886522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958517+0000","last_change":"2024-09-21T03:25:06.949102+0000","last_active":"2024-09-21T03:25:07.958517+0000","last_peered":"2024-09-21T03:25:07.958517+0000","last_clean":"2024-09-21T03:25:07.958517+0000","last_became_active":"2024-09-21T03:25:06.947993+0000","last_became_peered":"2024-09-21T03:25:06.947993+0000","last_unstale":"2024-09-21T03:25:07.958517+0000","last_undegraded":"2024-09-21T03:25:07.958517+0000","last_fullsized":"2024-09-21T03:25:07.958517+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:13.975782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.964008+0000","last_change":"2024-09-21T03:25:06.956996+0000","last_active":"2024-09-21T03:25:06.964008+0000","last_peered":"2024-09-21T03:25:06.964008+0000","last_clean":"2024-09-21T03:25:06.964008+0000","last_became_active":"2024-09-21T03:25:06.956687+0000","last_became_peered":"2024-09-21T03:25:06.956687+0000","last_unstale":"2024-09-21T03:25:06.964008+0000","last_undegraded":"2024-09-21T03:25:06.964008+0000","last_fullsized":"2024-09-21T03:25:06.964008+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:08.899356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.951900+0000","last_change":"2024-09-21T03:25:05.951900+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.951900+0000","last_undegraded":"2024-09-21T03:25:05.951900+0000","last_fullsized":"2024-09-21T03:25:05.951900+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.960078+0000","last_change":"2024-09-21T03:25:06.956017+0000","last_active":"2024-09-21T03:25:06.960078+0000","last_peered":"2024-09-21T03:25:06.960078+0000","last_clean":"2024-09-21T03:25:06.960078+0000","last_became_active":"2024-09-21T03:25:06.955640+0000","last_became_peered":"2024-09-21T03:25:06.955640+0000","last_unstale":"2024-09-21T03:25:06.960078+0000","last_undegraded":"2024-09-21T03:25:06.960078+0000","last_fullsized":"2024-09-21T03:25:06.960078+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:08.286393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.958319+0000","last_change":"2024-09-21T03:25:06.956659+0000","last_active":"2024-09-21T03:25:06.958319+0000","last_peered":"2024-09-21T03:25:06.958319+0000","last_clean":"2024-09-21T03:25:06.958319+0000","last_became_active":"2024-09-21T03:25:06.956166+0000","last_became_peered":"2024-09-21T03:25:06.956166+0000","last_unstale":"2024-09-21T03:25:06.958319+0000","last_undegraded":"2024-09-21T03:25:06.958319+0000","last_fullsized":"2024-09-21T03:25:06.958319+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:34.288116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"103'4","reported_seq":17,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.969661+0000","last_change":"2024-09-21T03:25:05.950693+0000","last_active":"2024-09-21T03:25:06.969661+0000","last_peered":"2024-09-21T03:25:06.969661+0000","last_clean":"2024-09-21T03:25:06.969661+0000","last_became_active":"2024-09-21T03:25:05.950331+0000","last_became_peered":"2024-09-21T03:25:05.950331+0000","last_unstale":"2024-09-21T03:25:06.969661+0000","last_undegraded":"2024-09-21T03:25:06.969661+0000","last_fullsized":"2024-09-21T03:25:06.969661+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:59.771445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958729+0000","last_change":"2024-09-21T03:25:06.946964+0000","last_active":"2024-09-21T03:25:07.958729+0000","last_peered":"2024-09-21T03:25:07.958729+0000","last_clean":"2024-09-21T03:25:07.958729+0000","last_became_active":"2024-09-21T03:25:06.945956+0000","last_became_peered":"2024-09-21T03:25:06.945956+0000","last_unstale":"2024-09-21T03:25:07.958729+0000","last_undegraded":"2024-09-21T03:25:07.958729+0000","last_fullsized":"2024-09-21T03:25:07.958729+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:49.780931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954228+0000","last_change":"2024-09-21T03:25:05.948457+0000","last_active":"2024-09-21T03:25:07.954228+0000","last_peered":"2024-09-21T03:25:07.954228+0000","last_clean":"2024-09-21T03:25:07.954228+0000","last_became_active":"2024-09-21T03:25:05.948136+0000","last_became_peered":"2024-09-21T03:25:05.948136+0000","last_unstale":"2024-09-21T03:25:07.954228+0000","last_undegraded":"2024-09-21T03:25:07.954228+0000","last_fullsized":"2024-09-21T03:25:07.954228+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:27.577914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.959487+0000","last_change":"2024-09-21T03:25:06.957624+0000","last_active":"2024-09-21T03:25:06.959487+0000","last_peered":"2024-09-21T03:25:06.959487+0000","last_clean":"2024-09-21T03:25:06.959487+0000","last_became_active":"2024-09-21T03:25:06.957274+0000","last_became_peered":"2024-09-21T03:25:06.957274+0000","last_unstale":"2024-09-21T03:25:06.959487+0000","last_undegraded":"2024-09-21T03:25:06.959487+0000","last_fullsized":"2024-09-21T03:25:06.959487+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:09.843286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.967196+0000","last_change":"2024-09-21T03:25:05.956340+0000","last_active":"2024-09-21T03:25:06.967196+0000","last_peered":"2024-09-21T03:25:06.967196+0000","last_clean":"2024-09-21T03:25:06.967196+0000","last_became_active":"2024-09-21T03:25:05.956023+0000","last_became_peered":"2024-09-21T03:25:05.956023+0000","last_unstale":"2024-09-21T03:25:06.967196+0000","last_undegraded":"2024-09-21T03:25:06.967196+0000","last_fullsized":"2024-09-21T03:25:06.967196+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:16.344677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954681+0000","last_change":"2024-09-21T03:25:06.954812+0000","last_active":"2024-09-21T03:25:07.954681+0000","last_peered":"2024-09-21T03:25:07.954681+0000","last_clean":"2024-09-21T03:25:07.954681+0000","last_became_active":"2024-09-21T03:25:06.954324+0000","last_became_peered":"2024-09-21T03:25:06.954324+0000","last_unstale":"2024-09-21T03:25:07.954681+0000","last_undegraded":"2024-09-21T03:25:07.954681+0000","last_fullsized":"2024-09-21T03:25:07.954681+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:31.650403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.967394+0000","last_change":"2024-09-21T03:25:05.951073+0000","last_active":"2024-09-21T03:25:06.967394+0000","last_peered":"2024-09-21T03:25:06.967394+0000","last_clean":"2024-09-21T03:25:06.967394+0000","last_became_active":"2024-09-21T03:25:05.950749+0000","last_became_peered":"2024-09-21T03:25:05.950749+0000","last_unstale":"2024-09-21T03:25:06.967394+0000","last_undegraded":"2024-09-21T03:25:06.967394+0000","last_fullsized":"2024-09-21T03:25:06.967394+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:07.037456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.951678+0000","last_change":"2024-09-21T03:25:05.951678+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.951678+0000","last_undegraded":"2024-09-21T03:25:05.951678+0000","last_fullsized":"2024-09-21T03:25:05.951678+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"103'1","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.966866+0000","last_change":"2024-09-21T03:25:05.952018+0000","last_active":"2024-09-21T03:25:06.966866+0000","last_peered":"2024-09-21T03:25:06.966866+0000","last_clean":"2024-09-21T03:25:06.966866+0000","last_became_active":"2024-09-21T03:25:05.951683+0000","last_became_peered":"2024-09-21T03:25:05.951683+0000","last_unstale":"2024-09-21T03:25:06.966866+0000","last_undegraded":"2024-09-21T03:25:06.966866+0000","last_fullsized":"2024-09-21T03:25:06.966866+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:06:17.348336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958896+0000","last_change":"2024-09-21T03:25:06.960288+0000","last_active":"2024-09-21T03:25:07.958896+0000","last_peered":"2024-09-21T03:25:07.958896+0000","last_clean":"2024-09-21T03:25:07.958896+0000","last_became_active":"2024-09-21T03:25:06.959943+0000","last_became_peered":"2024-09-21T03:25:06.959943+0000","last_unstale":"2024-09-21T03:25:07.958896+0000","last_undegraded":"2024-09-21T03:25:07.958896+0000","last_fullsized":"2024-09-21T03:25:07.958896+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:49.944202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"103'1","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.967731+0000","last_change":"2024-09-21T03:25:05.948442+0000","last_active":"2024-09-21T03:25:06.967731+0000","last_peered":"2024-09-21T03:25:06.967731+0000","last_clean":"2024-09-21T03:25:06.967731+0000","last_became_active":"2024-09-21T03:25:05.947682+0000","last_became_peered":"2024-09-21T03:25:05.947682+0000","last_unstale":"2024-09-21T03:25:06.967731+0000","last_undegraded":"2024-09-21T03:25:06.967731+0000","last_fullsized":"2024-09-21T03:25:06.967731+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:57.000396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.954176+0000","last_change":"2024-09-21T03:25:05.954176+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.954176+0000","last_undegraded":"2024-09-21T03:25:05.954176+0000","last_fullsized":"2024-09-21T03:25:05.954176+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.957616+0000","last_change":"2024-09-21T03:25:05.954213+0000","last_active":"2024-09-21T03:25:07.957616+0000","last_peered":"2024-09-21T03:25:07.957616+0000","last_clean":"2024-09-21T03:25:07.957616+0000","last_became_active":"2024-09-21T03:25:05.953869+0000","last_became_peered":"2024-09-21T03:25:05.953869+0000","last_unstale":"2024-09-21T03:25:07.957616+0000","last_undegraded":"2024-09-21T03:25:07.957616+0000","last_fullsized":"2024-09-21T03:25:07.957616+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:07.895817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.961160+0000","last_change":"2024-09-21T03:25:06.955915+0000","last_active":"2024-09-21T03:25:06.961160+0000","last_peered":"2024-09-21T03:25:06.961160+0000","last_clean":"2024-09-21T03:25:06.961160+0000","last_became_active":"2024-09-21T03:25:06.955458+0000","last_became_peered":"2024-09-21T03:25:06.955458+0000","last_unstale":"2024-09-21T03:25:06.961160+0000","last_undegraded":"2024-09-21T03:25:06.961160+0000","last_fullsized":"2024-09-21T03:25:06.961160+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:10.995084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.961676+0000","last_change":"2024-09-21T03:25:05.960268+0000","last_active":"2024-09-21T03:25:05.961676+0000","last_peered":"2024-09-21T03:25:05.961676+0000","last_clean":"2024-09-21T03:25:05.961676+0000","last_became_active":"2024-09-21T03:25:05.959378+0000","last_became_peered":"2024-09-21T03:25:05.959378+0000","last_unstale":"2024-09-21T03:25:05.961676+0000","last_undegraded":"2024-09-21T03:25:05.961676+0000","last_fullsized":"2024-09-21T03:25:05.961676+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:13.516789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.961224+0000","last_change":"2024-09-21T03:25:06.954630+0000","last_active":"2024-09-21T03:25:06.961224+0000","last_peered":"2024-09-21T03:25:06.961224+0000","last_clean":"2024-09-21T03:25:06.961224+0000","last_became_active":"2024-09-21T03:25:06.953583+0000","last_became_peered":"2024-09-21T03:25:06.953583+0000","last_unstale":"2024-09-21T03:25:06.961224+0000","last_undegraded":"2024-09-21T03:25:06.961224+0000","last_fullsized":"2024-09-21T03:25:06.961224+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:33.610686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.942545+0000","last_change":"2024-09-21T03:25:05.954201+0000","last_active":"2024-09-21T03:25:06.942545+0000","last_peered":"2024-09-21T03:25:06.942545+0000","last_clean":"2024-09-21T03:25:06.942545+0000","last_became_active":"2024-09-21T03:25:05.953878+0000","last_became_peered":"2024-09-21T03:25:05.953878+0000","last_unstale":"2024-09-21T03:25:06.942545+0000","last_undegraded":"2024-09-21T03:25:06.942545+0000","last_fullsized":"2024-09-21T03:25:06.942545+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:05.935127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958898+0000","last_change":"2024-09-21T03:25:06.968378+0000","last_active":"2024-09-21T03:25:07.958898+0000","last_peered":"2024-09-21T03:25:07.958898+0000","last_clean":"2024-09-21T03:25:07.958898+0000","last_became_active":"2024-09-21T03:25:06.967606+0000","last_became_peered":"2024-09-21T03:25:06.967606+0000","last_unstale":"2024-09-21T03:25:07.958898+0000","last_undegraded":"2024-09-21T03:25:07.958898+0000","last_fullsized":"2024-09-21T03:25:07.958898+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:13.975782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.944468+0000","last_change":"2024-09-21T03:25:05.946765+0000","last_active":"2024-09-21T03:25:06.944468+0000","last_peered":"2024-09-21T03:25:06.944468+0000","last_clean":"2024-09-21T03:25:06.944468+0000","last_became_active":"2024-09-21T03:25:05.946454+0000","last_became_peered":"2024-09-21T03:25:05.946454+0000","last_unstale":"2024-09-21T03:25:06.944468+0000","last_undegraded":"2024-09-21T03:25:06.944468+0000","last_fullsized":"2024-09-21T03:25:06.944468+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:22.100031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.964558+0000","last_change":"2024-09-21T03:25:06.960519+0000","last_active":"2024-09-21T03:25:06.964558+0000","last_peered":"2024-09-21T03:25:06.964558+0000","last_clean":"2024-09-21T03:25:06.964558+0000","last_became_active":"2024-09-21T03:25:06.960164+0000","last_became_peered":"2024-09-21T03:25:06.960164+0000","last_unstale":"2024-09-21T03:25:06.964558+0000","last_undegraded":"2024-09-21T03:25:06.964558+0000","last_fullsized":"2024-09-21T03:25:06.964558+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:59:33.809395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.956794+0000","last_change":"2024-09-21T03:25:05.953557+0000","last_active":"2024-09-21T03:25:05.956794+0000","last_peered":"2024-09-21T03:25:05.956794+0000","last_clean":"2024-09-21T03:25:05.956794+0000","last_became_active":"2024-09-21T03:25:05.953163+0000","last_became_peered":"2024-09-21T03:25:05.953163+0000","last_unstale":"2024-09-21T03:25:05.956794+0000","last_undegraded":"2024-09-21T03:25:05.956794+0000","last_fullsized":"2024-09-21T03:25:05.956794+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:50:42.745888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.956692+0000","last_change":"2024-09-21T03:25:06.954185+0000","last_active":"2024-09-21T03:25:06.956692+0000","last_peered":"2024-09-21T03:25:06.956692+0000","last_clean":"2024-09-21T03:25:06.956692+0000","last_became_active":"2024-09-21T03:25:06.953834+0000","last_became_peered":"2024-09-21T03:25:06.953834+0000","last_unstale":"2024-09-21T03:25:06.956692+0000","last_undegraded":"2024-09-21T03:25:06.956692+0000","last_fullsized":"2024-09-21T03:25:06.956692+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:27:48.468098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.961437+0000","last_change":"2024-09-21T03:25:05.959732+0000","last_active":"2024-09-21T03:25:05.961437+0000","last_peered":"2024-09-21T03:25:05.961437+0000","last_clean":"2024-09-21T03:25:05.961437+0000","last_became_active":"2024-09-21T03:25:05.959393+0000","last_became_peered":"2024-09-21T03:25:05.959393+0000","last_unstale":"2024-09-21T03:25:05.961437+0000","last_undegraded":"2024-09-21T03:25:05.961437+0000","last_fullsized":"2024-09-21T03:25:05.961437+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:54.217867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.964650+0000","last_change":"2024-09-21T03:25:06.959029+0000","last_active":"2024-09-21T03:25:06.964650+0000","last_peered":"2024-09-21T03:25:06.964650+0000","last_clean":"2024-09-21T03:25:06.964650+0000","last_became_active":"2024-09-21T03:25:06.958443+0000","last_became_peered":"2024-09-21T03:25:06.958443+0000","last_unstale":"2024-09-21T03:25:06.964650+0000","last_undegraded":"2024-09-21T03:25:06.964650+0000","last_fullsized":"2024-09-21T03:25:06.964650+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:41:16.872769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.967401+0000","last_change":"2024-09-21T03:25:05.946740+0000","last_active":"2024-09-21T03:25:06.967401+0000","last_peered":"2024-09-21T03:25:06.967401+0000","last_clean":"2024-09-21T03:25:06.967401+0000","last_became_active":"2024-09-21T03:25:05.946438+0000","last_became_peered":"2024-09-21T03:25:05.946438+0000","last_unstale":"2024-09-21T03:25:06.967401+0000","last_undegraded":"2024-09-21T03:25:06.967401+0000","last_fullsized":"2024-09-21T03:25:06.967401+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:27.205093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.958138+0000","last_change":"2024-09-21T03:25:06.954978+0000","last_active":"2024-09-21T03:25:06.958138+0000","last_peered":"2024-09-21T03:25:06.958138+0000","last_clean":"2024-09-21T03:25:06.958138+0000","last_became_active":"2024-09-21T03:25:06.954688+0000","last_became_peered":"2024-09-21T03:25:06.954688+0000","last_unstale":"2024-09-21T03:25:06.958138+0000","last_undegraded":"2024-09-21T03:25:06.958138+0000","last_fullsized":"2024-09-21T03:25:06.958138+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:03.305218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958184+0000","last_change":"2024-09-21T03:25:05.960010+0000","last_active":"2024-09-21T03:25:07.958184+0000","last_peered":"2024-09-21T03:25:07.958184+0000","last_clean":"2024-09-21T03:25:07.958184+0000","last_became_active":"2024-09-21T03:25:05.959699+0000","last_became_peered":"2024-09-21T03:25:05.959699+0000","last_unstale":"2024-09-21T03:25:07.958184+0000","last_undegraded":"2024-09-21T03:25:07.958184+0000","last_fullsized":"2024-09-21T03:25:07.958184+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:33.984094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.957851+0000","last_change":"2024-09-21T03:25:06.954255+0000","last_active":"2024-09-21T03:25:06.957851+0000","last_peered":"2024-09-21T03:25:06.957851+0000","last_clean":"2024-09-21T03:25:06.957851+0000","last_became_active":"2024-09-21T03:25:06.953960+0000","last_became_peered":"2024-09-21T03:25:06.953960+0000","last_unstale":"2024-09-21T03:25:06.957851+0000","last_undegraded":"2024-09-21T03:25:06.957851+0000","last_fullsized":"2024-09-21T03:25:06.957851+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:13.975782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"103'8","reported_seq":21,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.971415+0000","last_change":"2024-09-21T03:25:05.962238+0000","last_active":"2024-09-21T03:25:06.971415+0000","last_peered":"2024-09-21T03:25:06.971415+0000","last_clean":"2024-09-21T03:25:06.971415+0000","last_became_active":"2024-09-21T03:25:05.961869+0000","last_became_peered":"2024-09-21T03:25:05.961869+0000","last_unstale":"2024-09-21T03:25:06.971415+0000","last_undegraded":"2024-09-21T03:25:06.971415+0000","last_fullsized":"2024-09-21T03:25:06.971415+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:13.594419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.974579+0000","last_change":"2024-09-21T03:25:06.973378+0000","last_active":"2024-09-21T03:25:06.974579+0000","last_peered":"2024-09-21T03:25:06.974579+0000","last_clean":"2024-09-21T03:25:06.974579+0000","last_became_active":"2024-09-21T03:25:06.972937+0000","last_became_peered":"2024-09-21T03:25:06.972937+0000","last_unstale":"2024-09-21T03:25:06.974579+0000","last_undegraded":"2024-09-21T03:25:06.974579+0000","last_fullsized":"2024-09-21T03:25:06.974579+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:20.822035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.957250+0000","last_change":"2024-09-21T03:25:05.953632+0000","last_active":"2024-09-21T03:25:05.957250+0000","last_peered":"2024-09-21T03:25:05.957250+0000","last_clean":"2024-09-21T03:25:05.957250+0000","last_became_active":"2024-09-21T03:25:05.952747+0000","last_became_peered":"2024-09-21T03:25:05.952747+0000","last_unstale":"2024-09-21T03:25:05.957250+0000","last_undegraded":"2024-09-21T03:25:05.957250+0000","last_fullsized":"2024-09-21T03:25:05.957250+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:16.897123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.973787+0000","last_change":"2024-09-21T03:25:06.971849+0000","last_active":"2024-09-21T03:25:06.973787+0000","last_peered":"2024-09-21T03:25:06.973787+0000","last_clean":"2024-09-21T03:25:06.973787+0000","last_became_active":"2024-09-21T03:25:06.971533+0000","last_became_peered":"2024-09-21T03:25:06.971533+0000","last_unstale":"2024-09-21T03:25:06.973787+0000","last_undegraded":"2024-09-21T03:25:06.973787+0000","last_fullsized":"2024-09-21T03:25:06.973787+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:37.012007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.973664+0000","last_change":"2024-09-21T03:25:05.949862+0000","last_active":"2024-09-21T03:25:06.973664+0000","last_peered":"2024-09-21T03:25:06.973664+0000","last_clean":"2024-09-21T03:25:06.973664+0000","last_became_active":"2024-09-21T03:25:05.949503+0000","last_became_peered":"2024-09-21T03:25:05.949503+0000","last_unstale":"2024-09-21T03:25:06.973664+0000","last_undegraded":"2024-09-21T03:25:06.973664+0000","last_fullsized":"2024-09-21T03:25:06.973664+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:48.375833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954331+0000","last_change":"2024-09-21T03:25:06.968263+0000","last_active":"2024-09-21T03:25:07.954331+0000","last_peered":"2024-09-21T03:25:07.954331+0000","last_clean":"2024-09-21T03:25:07.954331+0000","last_became_active":"2024-09-21T03:25:06.967957+0000","last_became_peered":"2024-09-21T03:25:06.967957+0000","last_unstale":"2024-09-21T03:25:07.954331+0000","last_undegraded":"2024-09-21T03:25:07.954331+0000","last_fullsized":"2024-09-21T03:25:07.954331+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:38.224056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958389+0000","last_change":"2024-09-21T03:25:05.951962+0000","last_active":"2024-09-21T03:25:07.958389+0000","last_peered":"2024-09-21T03:25:07.958389+0000","last_clean":"2024-09-21T03:25:07.958389+0000","last_became_active":"2024-09-21T03:25:05.951676+0000","last_became_peered":"2024-09-21T03:25:05.951676+0000","last_unstale":"2024-09-21T03:25:07.958389+0000","last_undegraded":"2024-09-21T03:25:07.958389+0000","last_fullsized":"2024-09-21T03:25:07.958389+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:14:33.126090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954791+0000","last_change":"2024-09-21T03:25:06.958748+0000","last_active":"2024-09-21T03:25:07.954791+0000","last_peered":"2024-09-21T03:25:07.954791+0000","last_clean":"2024-09-21T03:25:07.954791+0000","last_became_active":"2024-09-21T03:25:06.958412+0000","last_became_peered":"2024-09-21T03:25:06.958412+0000","last_unstale":"2024-09-21T03:25:07.954791+0000","last_undegraded":"2024-09-21T03:25:07.954791+0000","last_fullsized":"2024-09-21T03:25:07.954791+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:02.237215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.945527+0000","last_change":"2024-09-21T03:25:05.955181+0000","last_active":"2024-09-21T03:25:06.945527+0000","last_peered":"2024-09-21T03:25:06.945527+0000","last_clean":"2024-09-21T03:25:06.945527+0000","last_became_active":"2024-09-21T03:25:05.954828+0000","last_became_peered":"2024-09-21T03:25:05.954828+0000","last_unstale":"2024-09-21T03:25:06.945527+0000","last_undegraded":"2024-09-21T03:25:06.945527+0000","last_fullsized":"2024-09-21T03:25:06.945527+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:35.311555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954227+0000","last_change":"2024-09-21T03:25:06.957965+0000","last_active":"2024-09-21T03:25:07.954227+0000","last_peered":"2024-09-21T03:25:07.954227+0000","last_clean":"2024-09-21T03:25:07.954227+0000","last_became_active":"2024-09-21T03:25:06.957637+0000","last_became_peered":"2024-09-21T03:25:06.957637+0000","last_unstale":"2024-09-21T03:25:07.954227+0000","last_undegraded":"2024-09-21T03:25:07.954227+0000","last_fullsized":"2024-09-21T03:25:07.954227+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:34.326915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.968385+0000","last_change":"2024-09-21T03:25:05.949798+0000","last_active":"2024-09-21T03:25:06.968385+0000","last_peered":"2024-09-21T03:25:06.968385+0000","last_clean":"2024-09-21T03:25:06.968385+0000","last_became_active":"2024-09-21T03:25:05.949522+0000","last_became_peered":"2024-09-21T03:25:05.949522+0000","last_unstale":"2024-09-21T03:25:06.968385+0000","last_undegraded":"2024-09-21T03:25:06.968385+0000","last_fullsized":"2024-09-21T03:25:06.968385+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:20.522015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.951118+0000","last_change":"2024-09-21T03:25:05.951118+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.951118+0000","last_undegraded":"2024-09-21T03:25:05.951118+0000","last_fullsized":"2024-09-21T03:25:05.951118+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.943364+0000","last_change":"2024-09-21T03:25:05.951055+0000","last_active":"2024-09-21T03:25:06.943364+0000","last_peered":"2024-09-21T03:25:06.943364+0000","last_clean":"2024-09-21T03:25:06.943364+0000","last_became_active":"2024-09-21T03:25:05.950689+0000","last_became_peered":"2024-09-21T03:25:05.950689+0000","last_unstale":"2024-09-21T03:25:06.943364+0000","last_undegraded":"2024-09-21T03:25:06.943364+0000","last_fullsized":"2024-09-21T03:25:06.943364+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:14.630887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954221+0000","last_change":"2024-09-21T03:25:06.957927+0000","last_active":"2024-09-21T03:25:07.954221+0000","last_peered":"2024-09-21T03:25:07.954221+0000","last_clean":"2024-09-21T03:25:07.954221+0000","last_became_active":"2024-09-21T03:25:06.956714+0000","last_became_peered":"2024-09-21T03:25:06.956714+0000","last_unstale":"2024-09-21T03:25:07.954221+0000","last_undegraded":"2024-09-21T03:25:07.954221+0000","last_fullsized":"2024-09-21T03:25:07.954221+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:28.910067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.943454+0000","last_change":"2024-09-21T03:25:05.949024+0000","last_active":"2024-09-21T03:25:06.943454+0000","last_peered":"2024-09-21T03:25:06.943454+0000","last_clean":"2024-09-21T03:25:06.943454+0000","last_became_active":"2024-09-21T03:25:05.948664+0000","last_became_peered":"2024-09-21T03:25:05.948664+0000","last_unstale":"2024-09-21T03:25:06.943454+0000","last_undegraded":"2024-09-21T03:25:06.943454+0000","last_fullsized":"2024-09-21T03:25:06.943454+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:10.198642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.970949+0000","last_change":"2024-09-21T03:25:06.966457+0000","last_active":"2024-09-21T03:25:06.970949+0000","last_peered":"2024-09-21T03:25:06.970949+0000","last_clean":"2024-09-21T03:25:06.970949+0000","last_became_active":"2024-09-21T03:25:06.965905+0000","last_became_peered":"2024-09-21T03:25:06.965905+0000","last_unstale":"2024-09-21T03:25:06.970949+0000","last_undegraded":"2024-09-21T03:25:06.970949+0000","last_fullsized":"2024-09-21T03:25:06.970949+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:28:33.939280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.964155+0000","last_change":"2024-09-21T03:25:05.961466+0000","last_active":"2024-09-21T03:25:05.964155+0000","last_peered":"2024-09-21T03:25:05.964155+0000","last_clean":"2024-09-21T03:25:05.964155+0000","last_became_active":"2024-09-21T03:25:05.961148+0000","last_became_peered":"2024-09-21T03:25:05.961148+0000","last_unstale":"2024-09-21T03:25:05.964155+0000","last_undegraded":"2024-09-21T03:25:05.964155+0000","last_fullsized":"2024-09-21T03:25:05.964155+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:07.109585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958987+0000","last_change":"2024-09-21T03:25:06.970004+0000","last_active":"2024-09-21T03:25:07.958987+0000","last_peered":"2024-09-21T03:25:07.958987+0000","last_clean":"2024-09-21T03:25:07.958987+0000","last_became_active":"2024-09-21T03:25:06.969612+0000","last_became_peered":"2024-09-21T03:25:06.969612+0000","last_unstale":"2024-09-21T03:25:07.958987+0000","last_undegraded":"2024-09-21T03:25:07.958987+0000","last_fullsized":"2024-09-21T03:25:07.958987+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:03.305218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.972709+0000","last_change":"2024-09-21T03:25:05.955665+0000","last_active":"2024-09-21T03:25:06.972709+0000","last_peered":"2024-09-21T03:25:06.972709+0000","last_clean":"2024-09-21T03:25:06.972709+0000","last_became_active":"2024-09-21T03:25:05.955365+0000","last_became_peered":"2024-09-21T03:25:05.955365+0000","last_unstale":"2024-09-21T03:25:06.972709+0000","last_undegraded":"2024-09-21T03:25:06.972709+0000","last_fullsized":"2024-09-21T03:25:06.972709+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:45.001004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.950577+0000","last_change":"2024-09-21T03:25:05.950577+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.950577+0000","last_undegraded":"2024-09-21T03:25:05.950577+0000","last_fullsized":"2024-09-21T03:25:05.950577+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958997+0000","last_change":"2024-09-21T03:25:05.949208+0000","last_active":"2024-09-21T03:25:07.958997+0000","last_peered":"2024-09-21T03:25:07.958997+0000","last_clean":"2024-09-21T03:25:07.958997+0000","last_became_active":"2024-09-21T03:25:05.948664+0000","last_became_peered":"2024-09-21T03:25:05.948664+0000","last_unstale":"2024-09-21T03:25:07.958997+0000","last_undegraded":"2024-09-21T03:25:07.958997+0000","last_fullsized":"2024-09-21T03:25:07.958997+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:20.392815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.946336+0000","last_change":"2024-09-21T03:25:05.946336+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.946336+0000","last_undegraded":"2024-09-21T03:25:05.946336+0000","last_fullsized":"2024-09-21T03:25:05.946336+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.964175+0000","last_change":"2024-09-21T03:25:05.961517+0000","last_active":"2024-09-21T03:25:05.964175+0000","last_peered":"2024-09-21T03:25:05.964175+0000","last_clean":"2024-09-21T03:25:05.964175+0000","last_became_active":"2024-09-21T03:25:05.961159+0000","last_became_peered":"2024-09-21T03:25:05.961159+0000","last_unstale":"2024-09-21T03:25:05.964175+0000","last_undegraded":"2024-09-21T03:25:05.964175+0000","last_fullsized":"2024-09-21T03:25:05.964175+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:17:42.357829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958256+0000","last_change":"2024-09-21T03:25:06.968024+0000","last_active":"2024-09-21T03:25:07.958256+0000","last_peered":"2024-09-21T03:25:07.958256+0000","last_clean":"2024-09-21T03:25:07.958256+0000","last_became_active":"2024-09-21T03:25:06.967584+0000","last_became_peered":"2024-09-21T03:25:06.967584+0000","last_unstale":"2024-09-21T03:25:07.958256+0000","last_undegraded":"2024-09-21T03:25:07.958256+0000","last_fullsized":"2024-09-21T03:25:07.958256+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:14.835962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.947689+0000","last_change":"2024-09-21T03:25:05.953316+0000","last_active":"2024-09-21T03:25:06.947689+0000","last_peered":"2024-09-21T03:25:06.947689+0000","last_clean":"2024-09-21T03:25:06.947689+0000","last_became_active":"2024-09-21T03:25:05.953009+0000","last_became_peered":"2024-09-21T03:25:05.953009+0000","last_unstale":"2024-09-21T03:25:06.947689+0000","last_undegraded":"2024-09-21T03:25:06.947689+0000","last_fullsized":"2024-09-21T03:25:06.947689+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:13.832422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958341+0000","last_change":"2024-09-21T03:25:06.957735+0000","last_active":"2024-09-21T03:25:07.958341+0000","last_peered":"2024-09-21T03:25:07.958341+0000","last_clean":"2024-09-21T03:25:07.958341+0000","last_became_active":"2024-09-21T03:25:06.957327+0000","last_became_peered":"2024-09-21T03:25:06.957327+0000","last_unstale":"2024-09-21T03:25:07.958341+0000","last_undegraded":"2024-09-21T03:25:07.958341+0000","last_fullsized":"2024-09-21T03:25:07.958341+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:49.780931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.945223+0000","last_change":"2024-09-21T03:25:05.949661+0000","last_active":"2024-09-21T03:25:06.945223+0000","last_peered":"2024-09-21T03:25:06.945223+0000","last_clean":"2024-09-21T03:25:06.945223+0000","last_became_active":"2024-09-21T03:25:05.949336+0000","last_became_peered":"2024-09-21T03:25:05.949336+0000","last_unstale":"2024-09-21T03:25:06.945223+0000","last_undegraded":"2024-09-21T03:25:06.945223+0000","last_fullsized":"2024-09-21T03:25:06.945223+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:48.750266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958762+0000","last_change":"2024-09-21T03:25:06.948815+0000","last_active":"2024-09-21T03:25:07.958762+0000","last_peered":"2024-09-21T03:25:07.958762+0000","last_clean":"2024-09-21T03:25:07.958762+0000","last_became_active":"2024-09-21T03:25:06.948415+0000","last_became_peered":"2024-09-21T03:25:06.948415+0000","last_unstale":"2024-09-21T03:25:07.958762+0000","last_undegraded":"2024-09-21T03:25:07.958762+0000","last_fullsized":"2024-09-21T03:25:07.958762+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:03.305218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958470+0000","last_change":"2024-09-21T03:25:05.945536+0000","last_active":"2024-09-21T03:25:07.958470+0000","last_peered":"2024-09-21T03:25:07.958470+0000","last_clean":"2024-09-21T03:25:07.958470+0000","last_became_active":"2024-09-21T03:25:05.945162+0000","last_became_peered":"2024-09-21T03:25:05.945162+0000","last_unstale":"2024-09-21T03:25:07.958470+0000","last_undegraded":"2024-09-21T03:25:07.958470+0000","last_fullsized":"2024-09-21T03:25:07.958470+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:09.991545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954517+0000","last_change":"2024-09-21T03:25:06.957533+0000","last_active":"2024-09-21T03:25:07.954517+0000","last_peered":"2024-09-21T03:25:07.954517+0000","last_clean":"2024-09-21T03:25:07.954517+0000","last_became_active":"2024-09-21T03:25:06.957214+0000","last_became_peered":"2024-09-21T03:25:06.957214+0000","last_unstale":"2024-09-21T03:25:07.954517+0000","last_undegraded":"2024-09-21T03:25:07.954517+0000","last_fullsized":"2024-09-21T03:25:07.954517+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:24.677842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.942986+0000","last_change":"2024-09-21T03:25:05.953058+0000","last_active":"2024-09-21T03:25:06.942986+0000","last_peered":"2024-09-21T03:25:06.942986+0000","last_clean":"2024-09-21T03:25:06.942986+0000","last_became_active":"2024-09-21T03:25:05.952512+0000","last_became_peered":"2024-09-21T03:25:05.952512+0000","last_unstale":"2024-09-21T03:25:06.942986+0000","last_undegraded":"2024-09-21T03:25:06.942986+0000","last_fullsized":"2024-09-21T03:25:06.942986+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:34.953614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":1,"reported_epoch":102,"state":"creating+peering","last_fresh":"2024-09-21T03:25:05.944325+0000","last_change":"2024-09-21T03:25:05.944325+0000","last_active":"2024-09-21T03:25:05.927023+0000","last_peered":"2024-09-21T03:25:05.927023+0000","last_clean":"2024-09-21T03:25:05.927023+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:05.944325+0000","last_undegraded":"2024-09-21T03:25:05.944325+0000","last_fullsized":"2024-09-21T03:25:05.944325+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-21T03:25:05.963735+0000","last_change":"2024-09-21T03:25:05.960646+0000","last_active":"2024-09-21T03:25:05.963735+0000","last_peered":"2024-09-21T03:25:05.963735+0000","last_clean":"2024-09-21T03:25:05.963735+0000","last_became_active":"2024-09-21T03:25:05.959992+0000","last_became_peered":"2024-09-21T03:25:05.959992+0000","last_unstale":"2024-09-21T03:25:05.963735+0000","last_undegraded":"2024-09-21T03:25:05.963735+0000","last_fullsized":"2024-09-21T03:25:05.963735+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:23.072517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.964593+0000","last_change":"2024-09-21T03:25:06.962590+0000","last_active":"2024-09-21T03:25:06.964593+0000","last_peered":"2024-09-21T03:25:06.964593+0000","last_clean":"2024-09-21T03:25:06.964593+0000","last_became_active":"2024-09-21T03:25:06.962295+0000","last_became_peered":"2024-09-21T03:25:06.962295+0000","last_unstale":"2024-09-21T03:25:06.964593+0000","last_undegraded":"2024-09-21T03:25:06.964593+0000","last_fullsized":"2024-09-21T03:25:06.964593+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:04:58.099896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.947269+0000","last_change":"2024-09-21T03:25:05.955078+0000","last_active":"2024-09-21T03:25:06.947269+0000","last_peered":"2024-09-21T03:25:06.947269+0000","last_clean":"2024-09-21T03:25:06.947269+0000","last_became_active":"2024-09-21T03:25:05.954784+0000","last_became_peered":"2024-09-21T03:25:05.954784+0000","last_unstale":"2024-09-21T03:25:06.947269+0000","last_undegraded":"2024-09-21T03:25:06.947269+0000","last_fullsized":"2024-09-21T03:25:06.947269+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:15:08.648155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":266,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954464+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:25:07.954464+0000","last_peered":"2024-09-21T03:25:07.954464+0000","last_clean":"2024-09-21T03:25:07.954464+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:25:07.954464+0000","last_undegraded":"2024-09-21T03:25:07.954464+0000","last_fullsized":"2024-09-21T03:25:07.954464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":686,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509527,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33020,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338820,"statfs":{"total":96636764160,"available":96602951680,"internally_reserved":0,"allocated":1875968,"data_stored":1131075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509526,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32456,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":1290240,"data_stored":546461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509525,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1282048,"data_stored":540695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509525,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32436,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339404,"statfs":{"total":96636764160,"available":96603549696,"internally_reserved":0,"allocated":1273856,"data_stored":540091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509526,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32456,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":1290240,"data_stored":541773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509526,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1273856,"data_stored":540091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509526,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36600,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335240,"statfs":{"total":96636764160,"available":96599285760,"internally_reserved":0,"allocated":1282048,"data_stored":540215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574933,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33000,"kb_used_data":1800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338840,"statfs":{"total":96636764160,"available":96602972160,"internally_reserved":0,"allocated":1843200,"data_stored":1117409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:25:14.416 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:25:14.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.542+0000 7f7b7999d640 1 -- 172.21.15.105:0/1609689291 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b740d2af0 msgr2=0x7f7b740b5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:14.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.542+0000 7f7b7999d640 1 --2- 172.21.15.105:0/1609689291 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b740d2af0 0x7f7b740b5560 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7b64005fd0 tx=0x7f7b6402a5d0 comp rx=0 tx=0).stop 2024-09-21T03:25:14.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.542+0000 7f7b7999d640 1 -- 172.21.15.105:0/1609689291 shutdown_connections 2024-09-21T03:25:14.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.542+0000 7f7b7999d640 1 --2- 172.21.15.105:0/1609689291 >> v2:172.21.15.162:3300/0 conn(0x7f7b740b3b60 0x7f7b740cfb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:14.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.542+0000 7f7b7999d640 1 --2- 172.21.15.105:0/1609689291 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b740d2af0 0x7f7b740b5560 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:14.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.542+0000 7f7b7999d640 1 -- 172.21.15.105:0/1609689291 >> 172.21.15.105:0/1609689291 conn(0x7f7b7409d690 msgr2=0x7f7b740d4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:14.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.542+0000 7f7b7999d640 1 -- 172.21.15.105:0/1609689291 shutdown_connections 2024-09-21T03:25:14.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.542+0000 7f7b7999d640 1 -- 172.21.15.105:0/1609689291 wait complete. 2024-09-21T03:25:14.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.544+0000 7f7b7999d640 1 Processor -- start 2024-09-21T03:25:14.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.544+0000 7f7b7999d640 1 -- start start 2024-09-21T03:25:14.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.546+0000 7f7b7999d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b740b3b60 0x7f7b7409e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:14.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.546+0000 7f7b7999d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b740d0090 0x7f7b7409e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:14.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.546+0000 7f7b7999d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b740d2af0 0x7f7b7409ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:14.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.546+0000 7f7b7999d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7b740d0830 con 0x7f7b740b3b60 2024-09-21T03:25:14.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.546+0000 7f7b7999d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7b740d06b0 con 0x7f7b740d0090 2024-09-21T03:25:14.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.546+0000 7f7b7999d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7b740d13d0 con 0x7f7b740d2af0 2024-09-21T03:25:14.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.546+0000 7f7b7899b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b740b3b60 0x7f7b7409e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:14.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.546+0000 7f7b7899b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b740b3b60 0x7f7b7409e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51488/0 (socket says 172.21.15.105:51488) 2024-09-21T03:25:14.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.546+0000 7f7b7899b640 1 -- 172.21.15.105:0/2275734897 learned_addr learned my addr 172.21.15.105:0/2275734897 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:14.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.546+0000 7f7b73fff640 1 --2- 172.21.15.105:0/2275734897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b740d0090 0x7f7b7409e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:14.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.546+0000 7f7b7919c640 1 --2- 172.21.15.105:0/2275734897 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b740d2af0 0x7f7b7409ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:14.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.546+0000 7f7b7899b640 1 -- 172.21.15.105:0/2275734897 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b740d2af0 msgr2=0x7f7b7409ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:14.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.546+0000 7f7b7899b640 1 --2- 172.21.15.105:0/2275734897 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b740d2af0 0x7f7b7409ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:14.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.546+0000 7f7b7899b640 1 -- 172.21.15.105:0/2275734897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b740d0090 msgr2=0x7f7b7409e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:14.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.546+0000 7f7b7899b640 1 --2- 172.21.15.105:0/2275734897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b740d0090 0x7f7b7409e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:14.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.546+0000 7f7b7899b640 1 -- 172.21.15.105:0/2275734897 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b740cdd60 con 0x7f7b740b3b60 2024-09-21T03:25:14.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.547+0000 7f7b7899b640 1 --2- 172.21.15.105:0/2275734897 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b740b3b60 0x7f7b7409e1b0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f7b64034040 tx=0x7f7b640035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:14.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.547+0000 7f7b717fa640 1 -- 172.21.15.105:0/2275734897 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6403e030 con 0x7f7b740b3b60 2024-09-21T03:25:14.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.547+0000 7f7b717fa640 1 -- 172.21.15.105:0/2275734897 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b64003ae0 con 0x7f7b740b3b60 2024-09-21T03:25:14.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.547+0000 7f7b717fa640 1 -- 172.21.15.105:0/2275734897 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b64035040 con 0x7f7b740b3b60 2024-09-21T03:25:14.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.547+0000 7f7b7999d640 1 -- 172.21.15.105:0/2275734897 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b740cc360 con 0x7f7b740b3b60 2024-09-21T03:25:14.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.547+0000 7f7b7999d640 1 -- 172.21.15.105:0/2275734897 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b740cc920 con 0x7f7b740b3b60 2024-09-21T03:25:14.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.548+0000 7f7b7999d640 1 -- 172.21.15.105:0/2275734897 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b740d18f0 con 0x7f7b740b3b60 2024-09-21T03:25:14.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.548+0000 7f7b717fa640 1 -- 172.21.15.105:0/2275734897 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7b64041030 con 0x7f7b740b3b60 2024-09-21T03:25:14.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.549+0000 7f7b717fa640 1 --2- 172.21.15.105:0/2275734897 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7b60078bc0 0x7f7b6007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:14.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.549+0000 7f7b717fa640 1 -- 172.21.15.105:0/2275734897 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f7b640bb1e0 con 0x7f7b740b3b60 2024-09-21T03:25:14.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.549+0000 7f7b73fff640 1 --2- 172.21.15.105:0/2275734897 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7b60078bc0 0x7f7b6007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:14.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.550+0000 7f7b73fff640 1 --2- 172.21.15.105:0/2275734897 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7b60078bc0 0x7f7b6007b0d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f7b740b92e0 tx=0x7f7b68005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:14.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.554+0000 7f7b717fa640 1 -- 172.21.15.105:0/2275734897 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7b64082f50 con 0x7f7b740b3b60 2024-09-21T03:25:14.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.728+0000 7f7b7999d640 1 -- 172.21.15.105:0/2275734897 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7b740cdb10 con 0x7f7b60078bc0 2024-09-21T03:25:14.734 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.733+0000 7f7b717fa640 1 -- 172.21.15.105:0/2275734897 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252468 (secure 0 0 0) 0x7f7b740cdb10 con 0x7f7b60078bc0 2024-09-21T03:25:14.737 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:14.738 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:25:14.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.736+0000 7f7b7999d640 1 -- 172.21.15.105:0/2275734897 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7b60078bc0 msgr2=0x7f7b6007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:14.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.736+0000 7f7b7999d640 1 --2- 172.21.15.105:0/2275734897 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7b60078bc0 0x7f7b6007b0d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f7b740b92e0 tx=0x7f7b68005f90 comp rx=0 tx=0).stop 2024-09-21T03:25:14.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.736+0000 7f7b7999d640 1 -- 172.21.15.105:0/2275734897 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b740b3b60 msgr2=0x7f7b7409e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:14.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.736+0000 7f7b7999d640 1 --2- 172.21.15.105:0/2275734897 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b740b3b60 0x7f7b7409e1b0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f7b64034040 tx=0x7f7b640035f0 comp rx=0 tx=0).stop 2024-09-21T03:25:14.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.736+0000 7f7b7999d640 1 -- 172.21.15.105:0/2275734897 shutdown_connections 2024-09-21T03:25:14.740 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.736+0000 7f7b7999d640 1 --2- 172.21.15.105:0/2275734897 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7b60078bc0 0x7f7b6007b0d0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:14.740 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.736+0000 7f7b7999d640 1 --2- 172.21.15.105:0/2275734897 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b740d2af0 0x7f7b7409ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:14.740 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.736+0000 7f7b7999d640 1 --2- 172.21.15.105:0/2275734897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b740d0090 0x7f7b7409e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:14.740 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.736+0000 7f7b7999d640 1 --2- 172.21.15.105:0/2275734897 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b740b3b60 0x7f7b7409e1b0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:14.740 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.736+0000 7f7b7999d640 1 -- 172.21.15.105:0/2275734897 >> 172.21.15.105:0/2275734897 conn(0x7f7b7409d690 msgr2=0x7f7b7406e210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:14.740 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.736+0000 7f7b7999d640 1 -- 172.21.15.105:0/2275734897 shutdown_connections 2024-09-21T03:25:14.740 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.736+0000 7f7b7999d640 1 -- 172.21.15.105:0/2275734897 wait complete. 2024-09-21T03:25:14.749 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":306,"stamp":"2024-09-21T03:25:13.387518+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":143,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":264896,"kb_used_data":11200,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754709824,"statfs":{"total":773094113280,"available":772822859776,"internally_reserved":0,"allocated":11468800,"data_stored":5518884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.453482"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:09.427882+0000","last_change":"2024-09-21T03:25:06.966430+0000","last_active":"2024-09-21T03:25:09.427882+0000","last_peered":"2024-09-21T03:25:09.427882+0000","last_clean":"2024-09-21T03:25:09.427882+0000","last_became_active":"2024-09-21T03:25:06.965547+0000","last_became_peered":"2024-09-21T03:25:06.965547+0000","last_unstale":"2024-09-21T03:25:09.427882+0000","last_undegraded":"2024-09-21T03:25:09.427882+0000","last_fullsized":"2024-09-21T03:25:09.427882+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:08.541922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958208+0000","last_change":"2024-09-21T03:25:06.960292+0000","last_active":"2024-09-21T03:25:07.958208+0000","last_peered":"2024-09-21T03:25:07.958208+0000","last_clean":"2024-09-21T03:25:07.958208+0000","last_became_active":"2024-09-21T03:25:06.959916+0000","last_became_peered":"2024-09-21T03:25:06.959916+0000","last_unstale":"2024-09-21T03:25:07.958208+0000","last_undegraded":"2024-09-21T03:25:07.958208+0000","last_fullsized":"2024-09-21T03:25:07.958208+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:46.004543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954544+0000","last_change":"2024-09-21T03:25:06.950883+0000","last_active":"2024-09-21T03:25:07.954544+0000","last_peered":"2024-09-21T03:25:07.954544+0000","last_clean":"2024-09-21T03:25:07.954544+0000","last_became_active":"2024-09-21T03:25:06.948632+0000","last_became_peered":"2024-09-21T03:25:06.948632+0000","last_unstale":"2024-09-21T03:25:07.954544+0000","last_undegraded":"2024-09-21T03:25:07.954544+0000","last_fullsized":"2024-09-21T03:25:07.954544+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:51:46.652368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:09.427955+0000","last_change":"2024-09-21T03:25:06.969565+0000","last_active":"2024-09-21T03:25:09.427955+0000","last_peered":"2024-09-21T03:25:09.427955+0000","last_clean":"2024-09-21T03:25:09.427955+0000","last_became_active":"2024-09-21T03:25:06.967344+0000","last_became_peered":"2024-09-21T03:25:06.967344+0000","last_unstale":"2024-09-21T03:25:09.427955+0000","last_undegraded":"2024-09-21T03:25:09.427955+0000","last_fullsized":"2024-09-21T03:25:09.427955+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:57:10.367284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.955650+0000","last_change":"2024-09-21T03:25:06.953631+0000","last_active":"2024-09-21T03:25:06.955650+0000","last_peered":"2024-09-21T03:25:06.955650+0000","last_clean":"2024-09-21T03:25:06.955650+0000","last_became_active":"2024-09-21T03:25:06.953277+0000","last_became_peered":"2024-09-21T03:25:06.953277+0000","last_unstale":"2024-09-21T03:25:06.955650+0000","last_undegraded":"2024-09-21T03:25:06.955650+0000","last_fullsized":"2024-09-21T03:25:06.955650+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:16:41.069474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.959528+0000","last_change":"2024-09-21T03:25:06.957920+0000","last_active":"2024-09-21T03:25:06.959528+0000","last_peered":"2024-09-21T03:25:06.959528+0000","last_clean":"2024-09-21T03:25:06.959528+0000","last_became_active":"2024-09-21T03:25:06.957312+0000","last_became_peered":"2024-09-21T03:25:06.957312+0000","last_unstale":"2024-09-21T03:25:06.959528+0000","last_undegraded":"2024-09-21T03:25:06.959528+0000","last_fullsized":"2024-09-21T03:25:06.959528+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:59:38.300937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.961126+0000","last_change":"2024-09-21T03:25:06.955776+0000","last_active":"2024-09-21T03:25:06.961126+0000","last_peered":"2024-09-21T03:25:06.961126+0000","last_clean":"2024-09-21T03:25:06.961126+0000","last_became_active":"2024-09-21T03:25:06.955407+0000","last_became_peered":"2024-09-21T03:25:06.955407+0000","last_unstale":"2024-09-21T03:25:06.961126+0000","last_undegraded":"2024-09-21T03:25:06.961126+0000","last_fullsized":"2024-09-21T03:25:06.961126+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:12.663157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954048+0000","last_change":"2024-09-21T03:25:06.958844+0000","last_active":"2024-09-21T03:25:07.954048+0000","last_peered":"2024-09-21T03:25:07.954048+0000","last_clean":"2024-09-21T03:25:07.954048+0000","last_became_active":"2024-09-21T03:25:06.958516+0000","last_became_peered":"2024-09-21T03:25:06.958516+0000","last_unstale":"2024-09-21T03:25:07.954048+0000","last_undegraded":"2024-09-21T03:25:07.954048+0000","last_fullsized":"2024-09-21T03:25:07.954048+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:13.569228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:09.428072+0000","last_change":"2024-09-21T03:25:06.966141+0000","last_active":"2024-09-21T03:25:09.428072+0000","last_peered":"2024-09-21T03:25:09.428072+0000","last_clean":"2024-09-21T03:25:09.428072+0000","last_became_active":"2024-09-21T03:25:06.965240+0000","last_became_peered":"2024-09-21T03:25:06.965240+0000","last_unstale":"2024-09-21T03:25:09.428072+0000","last_undegraded":"2024-09-21T03:25:09.428072+0000","last_fullsized":"2024-09-21T03:25:09.428072+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:12.304045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:09.427727+0000","last_change":"2024-09-21T03:25:06.970051+0000","last_active":"2024-09-21T03:25:09.427727+0000","last_peered":"2024-09-21T03:25:09.427727+0000","last_clean":"2024-09-21T03:25:09.427727+0000","last_became_active":"2024-09-21T03:25:06.969367+0000","last_became_peered":"2024-09-21T03:25:06.969367+0000","last_unstale":"2024-09-21T03:25:09.427727+0000","last_undegraded":"2024-09-21T03:25:09.427727+0000","last_fullsized":"2024-09-21T03:25:09.427727+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:20.655634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.959300+0000","last_change":"2024-09-21T03:25:06.951779+0000","last_active":"2024-09-21T03:25:07.959300+0000","last_peered":"2024-09-21T03:25:07.959300+0000","last_clean":"2024-09-21T03:25:07.959300+0000","last_became_active":"2024-09-21T03:25:06.951424+0000","last_became_peered":"2024-09-21T03:25:06.951424+0000","last_unstale":"2024-09-21T03:25:07.959300+0000","last_undegraded":"2024-09-21T03:25:07.959300+0000","last_fullsized":"2024-09-21T03:25:07.959300+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:45.933380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:09.428141+0000","last_change":"2024-09-21T03:25:06.967840+0000","last_active":"2024-09-21T03:25:09.428141+0000","last_peered":"2024-09-21T03:25:09.428141+0000","last_clean":"2024-09-21T03:25:09.428141+0000","last_became_active":"2024-09-21T03:25:06.966998+0000","last_became_peered":"2024-09-21T03:25:06.966998+0000","last_unstale":"2024-09-21T03:25:09.428141+0000","last_undegraded":"2024-09-21T03:25:09.428141+0000","last_fullsized":"2024-09-21T03:25:09.428141+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:12.126270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954480+0000","last_change":"2024-09-21T03:25:06.957896+0000","last_active":"2024-09-21T03:25:07.954480+0000","last_peered":"2024-09-21T03:25:07.954480+0000","last_clean":"2024-09-21T03:25:07.954480+0000","last_became_active":"2024-09-21T03:25:06.957553+0000","last_became_peered":"2024-09-21T03:25:06.957553+0000","last_unstale":"2024-09-21T03:25:07.954480+0000","last_undegraded":"2024-09-21T03:25:07.954480+0000","last_fullsized":"2024-09-21T03:25:07.954480+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:57.501083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954067+0000","last_change":"2024-09-21T03:25:06.956034+0000","last_active":"2024-09-21T03:25:07.954067+0000","last_peered":"2024-09-21T03:25:07.954067+0000","last_clean":"2024-09-21T03:25:07.954067+0000","last_became_active":"2024-09-21T03:25:06.955669+0000","last_became_peered":"2024-09-21T03:25:06.955669+0000","last_unstale":"2024-09-21T03:25:07.954067+0000","last_undegraded":"2024-09-21T03:25:07.954067+0000","last_fullsized":"2024-09-21T03:25:07.954067+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:33.027782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.961407+0000","last_change":"2024-09-21T03:25:06.955229+0000","last_active":"2024-09-21T03:25:06.961407+0000","last_peered":"2024-09-21T03:25:06.961407+0000","last_clean":"2024-09-21T03:25:06.961407+0000","last_became_active":"2024-09-21T03:25:06.954918+0000","last_became_peered":"2024-09-21T03:25:06.954918+0000","last_unstale":"2024-09-21T03:25:06.961407+0000","last_undegraded":"2024-09-21T03:25:06.961407+0000","last_fullsized":"2024-09-21T03:25:06.961407+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:53:15.188760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:09.427369+0000","last_change":"2024-09-21T03:25:06.968036+0000","last_active":"2024-09-21T03:25:09.427369+0000","last_peered":"2024-09-21T03:25:09.427369+0000","last_clean":"2024-09-21T03:25:09.427369+0000","last_became_active":"2024-09-21T03:25:06.966666+0000","last_became_peered":"2024-09-21T03:25:06.966666+0000","last_unstale":"2024-09-21T03:25:09.427369+0000","last_undegraded":"2024-09-21T03:25:09.427369+0000","last_fullsized":"2024-09-21T03:25:09.427369+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:25.229197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958041+0000","last_change":"2024-09-21T03:25:06.948574+0000","last_active":"2024-09-21T03:25:07.958041+0000","last_peered":"2024-09-21T03:25:07.958041+0000","last_clean":"2024-09-21T03:25:07.958041+0000","last_became_active":"2024-09-21T03:25:06.948291+0000","last_became_peered":"2024-09-21T03:25:06.948291+0000","last_unstale":"2024-09-21T03:25:07.958041+0000","last_undegraded":"2024-09-21T03:25:07.958041+0000","last_fullsized":"2024-09-21T03:25:07.958041+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:23.103570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958690+0000","last_change":"2024-09-21T03:25:06.943830+0000","last_active":"2024-09-21T03:25:07.958690+0000","last_peered":"2024-09-21T03:25:07.958690+0000","last_clean":"2024-09-21T03:25:07.958690+0000","last_became_active":"2024-09-21T03:25:06.943492+0000","last_became_peered":"2024-09-21T03:25:06.943492+0000","last_unstale":"2024-09-21T03:25:07.958690+0000","last_undegraded":"2024-09-21T03:25:07.958690+0000","last_fullsized":"2024-09-21T03:25:07.958690+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:58.003935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954528+0000","last_change":"2024-09-21T03:25:06.956428+0000","last_active":"2024-09-21T03:25:07.954528+0000","last_peered":"2024-09-21T03:25:07.954528+0000","last_clean":"2024-09-21T03:25:07.954528+0000","last_became_active":"2024-09-21T03:25:06.955989+0000","last_became_peered":"2024-09-21T03:25:06.955989+0000","last_unstale":"2024-09-21T03:25:07.954528+0000","last_undegraded":"2024-09-21T03:25:07.954528+0000","last_fullsized":"2024-09-21T03:25:07.954528+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:05.806487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958257+0000","last_change":"2024-09-21T03:25:06.946863+0000","last_active":"2024-09-21T03:25:07.958257+0000","last_peered":"2024-09-21T03:25:07.958257+0000","last_clean":"2024-09-21T03:25:07.958257+0000","last_became_active":"2024-09-21T03:25:06.946516+0000","last_became_peered":"2024-09-21T03:25:06.946516+0000","last_unstale":"2024-09-21T03:25:07.958257+0000","last_undegraded":"2024-09-21T03:25:07.958257+0000","last_fullsized":"2024-09-21T03:25:07.958257+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:14.835962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.959036+0000","last_change":"2024-09-21T03:25:06.952971+0000","last_active":"2024-09-21T03:25:07.959036+0000","last_peered":"2024-09-21T03:25:07.959036+0000","last_clean":"2024-09-21T03:25:07.959036+0000","last_became_active":"2024-09-21T03:25:06.952598+0000","last_became_peered":"2024-09-21T03:25:06.952598+0000","last_unstale":"2024-09-21T03:25:07.959036+0000","last_undegraded":"2024-09-21T03:25:07.959036+0000","last_fullsized":"2024-09-21T03:25:07.959036+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:11.279234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.957889+0000","last_change":"2024-09-21T03:25:06.953872+0000","last_active":"2024-09-21T03:25:06.957889+0000","last_peered":"2024-09-21T03:25:06.957889+0000","last_clean":"2024-09-21T03:25:06.957889+0000","last_became_active":"2024-09-21T03:25:06.953516+0000","last_became_peered":"2024-09-21T03:25:06.953516+0000","last_unstale":"2024-09-21T03:25:06.957889+0000","last_undegraded":"2024-09-21T03:25:06.957889+0000","last_fullsized":"2024-09-21T03:25:06.957889+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:49.780931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.957699+0000","last_change":"2024-09-21T03:25:06.946898+0000","last_active":"2024-09-21T03:25:07.957699+0000","last_peered":"2024-09-21T03:25:07.957699+0000","last_clean":"2024-09-21T03:25:07.957699+0000","last_became_active":"2024-09-21T03:25:06.946529+0000","last_became_peered":"2024-09-21T03:25:06.946529+0000","last_unstale":"2024-09-21T03:25:07.957699+0000","last_undegraded":"2024-09-21T03:25:07.957699+0000","last_fullsized":"2024-09-21T03:25:07.957699+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:28.581453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.964617+0000","last_change":"2024-09-21T03:25:06.963339+0000","last_active":"2024-09-21T03:25:06.964617+0000","last_peered":"2024-09-21T03:25:06.964617+0000","last_clean":"2024-09-21T03:25:06.964617+0000","last_became_active":"2024-09-21T03:25:06.963052+0000","last_became_peered":"2024-09-21T03:25:06.963052+0000","last_unstale":"2024-09-21T03:25:06.964617+0000","last_undegraded":"2024-09-21T03:25:06.964617+0000","last_fullsized":"2024-09-21T03:25:06.964617+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:56:45.382063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958302+0000","last_change":"2024-09-21T03:25:06.947798+0000","last_active":"2024-09-21T03:25:07.958302+0000","last_peered":"2024-09-21T03:25:07.958302+0000","last_clean":"2024-09-21T03:25:07.958302+0000","last_became_active":"2024-09-21T03:25:06.947494+0000","last_became_peered":"2024-09-21T03:25:06.947494+0000","last_unstale":"2024-09-21T03:25:07.958302+0000","last_undegraded":"2024-09-21T03:25:07.958302+0000","last_fullsized":"2024-09-21T03:25:07.958302+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:58.003935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:09.427975+0000","last_change":"2024-09-21T03:25:06.969713+0000","last_active":"2024-09-21T03:25:09.427975+0000","last_peered":"2024-09-21T03:25:09.427975+0000","last_clean":"2024-09-21T03:25:09.427975+0000","last_became_active":"2024-09-21T03:25:06.969053+0000","last_became_peered":"2024-09-21T03:25:06.969053+0000","last_unstale":"2024-09-21T03:25:09.427975+0000","last_undegraded":"2024-09-21T03:25:09.427975+0000","last_fullsized":"2024-09-21T03:25:09.427975+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:03.560032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.966709+0000","last_change":"2024-09-21T03:25:06.965906+0000","last_active":"2024-09-21T03:25:06.966709+0000","last_peered":"2024-09-21T03:25:06.966709+0000","last_clean":"2024-09-21T03:25:06.966709+0000","last_became_active":"2024-09-21T03:25:06.965595+0000","last_became_peered":"2024-09-21T03:25:06.965595+0000","last_unstale":"2024-09-21T03:25:06.966709+0000","last_undegraded":"2024-09-21T03:25:06.966709+0000","last_fullsized":"2024-09-21T03:25:06.966709+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:32.430160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.974231+0000","last_change":"2024-09-21T03:25:06.972998+0000","last_active":"2024-09-21T03:25:06.974231+0000","last_peered":"2024-09-21T03:25:06.974231+0000","last_clean":"2024-09-21T03:25:06.974231+0000","last_became_active":"2024-09-21T03:25:06.972535+0000","last_became_peered":"2024-09-21T03:25:06.972535+0000","last_unstale":"2024-09-21T03:25:06.974231+0000","last_undegraded":"2024-09-21T03:25:06.974231+0000","last_fullsized":"2024-09-21T03:25:06.974231+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:23.886522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958517+0000","last_change":"2024-09-21T03:25:06.949102+0000","last_active":"2024-09-21T03:25:07.958517+0000","last_peered":"2024-09-21T03:25:07.958517+0000","last_clean":"2024-09-21T03:25:07.958517+0000","last_became_active":"2024-09-21T03:25:06.947993+0000","last_became_peered":"2024-09-21T03:25:06.947993+0000","last_unstale":"2024-09-21T03:25:07.958517+0000","last_undegraded":"2024-09-21T03:25:07.958517+0000","last_fullsized":"2024-09-21T03:25:07.958517+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:13.975782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.964008+0000","last_change":"2024-09-21T03:25:06.956996+0000","last_active":"2024-09-21T03:25:06.964008+0000","last_peered":"2024-09-21T03:25:06.964008+0000","last_clean":"2024-09-21T03:25:06.964008+0000","last_became_active":"2024-09-21T03:25:06.956687+0000","last_became_peered":"2024-09-21T03:25:06.956687+0000","last_unstale":"2024-09-21T03:25:06.964008+0000","last_undegraded":"2024-09-21T03:25:06.964008+0000","last_fullsized":"2024-09-21T03:25:06.964008+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:08.899356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:09.427427+0000","last_change":"2024-09-21T03:25:06.964413+0000","last_active":"2024-09-21T03:25:09.427427+0000","last_peered":"2024-09-21T03:25:09.427427+0000","last_clean":"2024-09-21T03:25:09.427427+0000","last_became_active":"2024-09-21T03:25:06.963816+0000","last_became_peered":"2024-09-21T03:25:06.963816+0000","last_unstale":"2024-09-21T03:25:09.427427+0000","last_undegraded":"2024-09-21T03:25:09.427427+0000","last_fullsized":"2024-09-21T03:25:09.427427+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:27:32.151055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.960078+0000","last_change":"2024-09-21T03:25:06.956017+0000","last_active":"2024-09-21T03:25:06.960078+0000","last_peered":"2024-09-21T03:25:06.960078+0000","last_clean":"2024-09-21T03:25:06.960078+0000","last_became_active":"2024-09-21T03:25:06.955640+0000","last_became_peered":"2024-09-21T03:25:06.955640+0000","last_unstale":"2024-09-21T03:25:06.960078+0000","last_undegraded":"2024-09-21T03:25:06.960078+0000","last_fullsized":"2024-09-21T03:25:06.960078+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:49:08.286393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.958319+0000","last_change":"2024-09-21T03:25:06.956659+0000","last_active":"2024-09-21T03:25:06.958319+0000","last_peered":"2024-09-21T03:25:06.958319+0000","last_clean":"2024-09-21T03:25:06.958319+0000","last_became_active":"2024-09-21T03:25:06.956166+0000","last_became_peered":"2024-09-21T03:25:06.956166+0000","last_unstale":"2024-09-21T03:25:06.958319+0000","last_undegraded":"2024-09-21T03:25:06.958319+0000","last_fullsized":"2024-09-21T03:25:06.958319+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:34.288116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"103'4","reported_seq":17,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.969661+0000","last_change":"2024-09-21T03:25:05.950693+0000","last_active":"2024-09-21T03:25:06.969661+0000","last_peered":"2024-09-21T03:25:06.969661+0000","last_clean":"2024-09-21T03:25:06.969661+0000","last_became_active":"2024-09-21T03:25:05.950331+0000","last_became_peered":"2024-09-21T03:25:05.950331+0000","last_unstale":"2024-09-21T03:25:06.969661+0000","last_undegraded":"2024-09-21T03:25:06.969661+0000","last_fullsized":"2024-09-21T03:25:06.969661+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:59.771445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958729+0000","last_change":"2024-09-21T03:25:06.946964+0000","last_active":"2024-09-21T03:25:07.958729+0000","last_peered":"2024-09-21T03:25:07.958729+0000","last_clean":"2024-09-21T03:25:07.958729+0000","last_became_active":"2024-09-21T03:25:06.945956+0000","last_became_peered":"2024-09-21T03:25:06.945956+0000","last_unstale":"2024-09-21T03:25:07.958729+0000","last_undegraded":"2024-09-21T03:25:07.958729+0000","last_fullsized":"2024-09-21T03:25:07.958729+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:49.780931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954228+0000","last_change":"2024-09-21T03:25:05.948457+0000","last_active":"2024-09-21T03:25:07.954228+0000","last_peered":"2024-09-21T03:25:07.954228+0000","last_clean":"2024-09-21T03:25:07.954228+0000","last_became_active":"2024-09-21T03:25:05.948136+0000","last_became_peered":"2024-09-21T03:25:05.948136+0000","last_unstale":"2024-09-21T03:25:07.954228+0000","last_undegraded":"2024-09-21T03:25:07.954228+0000","last_fullsized":"2024-09-21T03:25:07.954228+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:27.577914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.959487+0000","last_change":"2024-09-21T03:25:06.957624+0000","last_active":"2024-09-21T03:25:06.959487+0000","last_peered":"2024-09-21T03:25:06.959487+0000","last_clean":"2024-09-21T03:25:06.959487+0000","last_became_active":"2024-09-21T03:25:06.957274+0000","last_became_peered":"2024-09-21T03:25:06.957274+0000","last_unstale":"2024-09-21T03:25:06.959487+0000","last_undegraded":"2024-09-21T03:25:06.959487+0000","last_fullsized":"2024-09-21T03:25:06.959487+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:09.843286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.967196+0000","last_change":"2024-09-21T03:25:05.956340+0000","last_active":"2024-09-21T03:25:06.967196+0000","last_peered":"2024-09-21T03:25:06.967196+0000","last_clean":"2024-09-21T03:25:06.967196+0000","last_became_active":"2024-09-21T03:25:05.956023+0000","last_became_peered":"2024-09-21T03:25:05.956023+0000","last_unstale":"2024-09-21T03:25:06.967196+0000","last_undegraded":"2024-09-21T03:25:06.967196+0000","last_fullsized":"2024-09-21T03:25:06.967196+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:16.344677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954681+0000","last_change":"2024-09-21T03:25:06.954812+0000","last_active":"2024-09-21T03:25:07.954681+0000","last_peered":"2024-09-21T03:25:07.954681+0000","last_clean":"2024-09-21T03:25:07.954681+0000","last_became_active":"2024-09-21T03:25:06.954324+0000","last_became_peered":"2024-09-21T03:25:06.954324+0000","last_unstale":"2024-09-21T03:25:07.954681+0000","last_undegraded":"2024-09-21T03:25:07.954681+0000","last_fullsized":"2024-09-21T03:25:07.954681+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:31.650403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.967394+0000","last_change":"2024-09-21T03:25:05.951073+0000","last_active":"2024-09-21T03:25:06.967394+0000","last_peered":"2024-09-21T03:25:06.967394+0000","last_clean":"2024-09-21T03:25:06.967394+0000","last_became_active":"2024-09-21T03:25:05.950749+0000","last_became_peered":"2024-09-21T03:25:05.950749+0000","last_unstale":"2024-09-21T03:25:06.967394+0000","last_undegraded":"2024-09-21T03:25:06.967394+0000","last_fullsized":"2024-09-21T03:25:06.967394+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:07.037456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:09.427400+0000","last_change":"2024-09-21T03:25:06.963632+0000","last_active":"2024-09-21T03:25:09.427400+0000","last_peered":"2024-09-21T03:25:09.427400+0000","last_clean":"2024-09-21T03:25:09.427400+0000","last_became_active":"2024-09-21T03:25:06.963327+0000","last_became_peered":"2024-09-21T03:25:06.963327+0000","last_unstale":"2024-09-21T03:25:09.427400+0000","last_undegraded":"2024-09-21T03:25:09.427400+0000","last_fullsized":"2024-09-21T03:25:09.427400+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:04.303358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"103'1","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.966866+0000","last_change":"2024-09-21T03:25:05.952018+0000","last_active":"2024-09-21T03:25:06.966866+0000","last_peered":"2024-09-21T03:25:06.966866+0000","last_clean":"2024-09-21T03:25:06.966866+0000","last_became_active":"2024-09-21T03:25:05.951683+0000","last_became_peered":"2024-09-21T03:25:05.951683+0000","last_unstale":"2024-09-21T03:25:06.966866+0000","last_undegraded":"2024-09-21T03:25:06.966866+0000","last_fullsized":"2024-09-21T03:25:06.966866+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:06:17.348336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958896+0000","last_change":"2024-09-21T03:25:06.960288+0000","last_active":"2024-09-21T03:25:07.958896+0000","last_peered":"2024-09-21T03:25:07.958896+0000","last_clean":"2024-09-21T03:25:07.958896+0000","last_became_active":"2024-09-21T03:25:06.959943+0000","last_became_peered":"2024-09-21T03:25:06.959943+0000","last_unstale":"2024-09-21T03:25:07.958896+0000","last_undegraded":"2024-09-21T03:25:07.958896+0000","last_fullsized":"2024-09-21T03:25:07.958896+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:49.944202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"103'1","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.967731+0000","last_change":"2024-09-21T03:25:05.948442+0000","last_active":"2024-09-21T03:25:06.967731+0000","last_peered":"2024-09-21T03:25:06.967731+0000","last_clean":"2024-09-21T03:25:06.967731+0000","last_became_active":"2024-09-21T03:25:05.947682+0000","last_became_peered":"2024-09-21T03:25:05.947682+0000","last_unstale":"2024-09-21T03:25:06.967731+0000","last_undegraded":"2024-09-21T03:25:06.967731+0000","last_fullsized":"2024-09-21T03:25:06.967731+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:24:57.000396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:09.427424+0000","last_change":"2024-09-21T03:25:06.966819+0000","last_active":"2024-09-21T03:25:09.427424+0000","last_peered":"2024-09-21T03:25:09.427424+0000","last_clean":"2024-09-21T03:25:09.427424+0000","last_became_active":"2024-09-21T03:25:06.966223+0000","last_became_peered":"2024-09-21T03:25:06.966223+0000","last_unstale":"2024-09-21T03:25:09.427424+0000","last_undegraded":"2024-09-21T03:25:09.427424+0000","last_fullsized":"2024-09-21T03:25:09.427424+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:25.069228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.957616+0000","last_change":"2024-09-21T03:25:05.954213+0000","last_active":"2024-09-21T03:25:07.957616+0000","last_peered":"2024-09-21T03:25:07.957616+0000","last_clean":"2024-09-21T03:25:07.957616+0000","last_became_active":"2024-09-21T03:25:05.953869+0000","last_became_peered":"2024-09-21T03:25:05.953869+0000","last_unstale":"2024-09-21T03:25:07.957616+0000","last_undegraded":"2024-09-21T03:25:07.957616+0000","last_fullsized":"2024-09-21T03:25:07.957616+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:07.895817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.961160+0000","last_change":"2024-09-21T03:25:06.955915+0000","last_active":"2024-09-21T03:25:06.961160+0000","last_peered":"2024-09-21T03:25:06.961160+0000","last_clean":"2024-09-21T03:25:06.961160+0000","last_became_active":"2024-09-21T03:25:06.955458+0000","last_became_peered":"2024-09-21T03:25:06.955458+0000","last_unstale":"2024-09-21T03:25:06.961160+0000","last_undegraded":"2024-09-21T03:25:06.961160+0000","last_fullsized":"2024-09-21T03:25:06.961160+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:10.995084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:09.427676+0000","last_change":"2024-09-21T03:25:05.960268+0000","last_active":"2024-09-21T03:25:09.427676+0000","last_peered":"2024-09-21T03:25:09.427676+0000","last_clean":"2024-09-21T03:25:09.427676+0000","last_became_active":"2024-09-21T03:25:05.959378+0000","last_became_peered":"2024-09-21T03:25:05.959378+0000","last_unstale":"2024-09-21T03:25:09.427676+0000","last_undegraded":"2024-09-21T03:25:09.427676+0000","last_fullsized":"2024-09-21T03:25:09.427676+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:29:20.114225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.961224+0000","last_change":"2024-09-21T03:25:06.954630+0000","last_active":"2024-09-21T03:25:06.961224+0000","last_peered":"2024-09-21T03:25:06.961224+0000","last_clean":"2024-09-21T03:25:06.961224+0000","last_became_active":"2024-09-21T03:25:06.953583+0000","last_became_peered":"2024-09-21T03:25:06.953583+0000","last_unstale":"2024-09-21T03:25:06.961224+0000","last_undegraded":"2024-09-21T03:25:06.961224+0000","last_fullsized":"2024-09-21T03:25:06.961224+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:33.610686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.942545+0000","last_change":"2024-09-21T03:25:05.954201+0000","last_active":"2024-09-21T03:25:06.942545+0000","last_peered":"2024-09-21T03:25:06.942545+0000","last_clean":"2024-09-21T03:25:06.942545+0000","last_became_active":"2024-09-21T03:25:05.953878+0000","last_became_peered":"2024-09-21T03:25:05.953878+0000","last_unstale":"2024-09-21T03:25:06.942545+0000","last_undegraded":"2024-09-21T03:25:06.942545+0000","last_fullsized":"2024-09-21T03:25:06.942545+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:05.935127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958898+0000","last_change":"2024-09-21T03:25:06.968378+0000","last_active":"2024-09-21T03:25:07.958898+0000","last_peered":"2024-09-21T03:25:07.958898+0000","last_clean":"2024-09-21T03:25:07.958898+0000","last_became_active":"2024-09-21T03:25:06.967606+0000","last_became_peered":"2024-09-21T03:25:06.967606+0000","last_unstale":"2024-09-21T03:25:07.958898+0000","last_undegraded":"2024-09-21T03:25:07.958898+0000","last_fullsized":"2024-09-21T03:25:07.958898+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:13.975782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.944468+0000","last_change":"2024-09-21T03:25:05.946765+0000","last_active":"2024-09-21T03:25:06.944468+0000","last_peered":"2024-09-21T03:25:06.944468+0000","last_clean":"2024-09-21T03:25:06.944468+0000","last_became_active":"2024-09-21T03:25:05.946454+0000","last_became_peered":"2024-09-21T03:25:05.946454+0000","last_unstale":"2024-09-21T03:25:06.944468+0000","last_undegraded":"2024-09-21T03:25:06.944468+0000","last_fullsized":"2024-09-21T03:25:06.944468+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:22.100031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.964558+0000","last_change":"2024-09-21T03:25:06.960519+0000","last_active":"2024-09-21T03:25:06.964558+0000","last_peered":"2024-09-21T03:25:06.964558+0000","last_clean":"2024-09-21T03:25:06.964558+0000","last_became_active":"2024-09-21T03:25:06.960164+0000","last_became_peered":"2024-09-21T03:25:06.960164+0000","last_unstale":"2024-09-21T03:25:06.964558+0000","last_undegraded":"2024-09-21T03:25:06.964558+0000","last_fullsized":"2024-09-21T03:25:06.964558+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:59:33.809395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"103'3","reported_seq":18,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:09.427680+0000","last_change":"2024-09-21T03:25:05.953557+0000","last_active":"2024-09-21T03:25:09.427680+0000","last_peered":"2024-09-21T03:25:09.427680+0000","last_clean":"2024-09-21T03:25:09.427680+0000","last_became_active":"2024-09-21T03:25:05.953163+0000","last_became_peered":"2024-09-21T03:25:05.953163+0000","last_unstale":"2024-09-21T03:25:09.427680+0000","last_undegraded":"2024-09-21T03:25:09.427680+0000","last_fullsized":"2024-09-21T03:25:09.427680+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:35.445781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.956692+0000","last_change":"2024-09-21T03:25:06.954185+0000","last_active":"2024-09-21T03:25:06.956692+0000","last_peered":"2024-09-21T03:25:06.956692+0000","last_clean":"2024-09-21T03:25:06.956692+0000","last_became_active":"2024-09-21T03:25:06.953834+0000","last_became_peered":"2024-09-21T03:25:06.953834+0000","last_unstale":"2024-09-21T03:25:06.956692+0000","last_undegraded":"2024-09-21T03:25:06.956692+0000","last_fullsized":"2024-09-21T03:25:06.956692+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:27:48.468098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"103'6","reported_seq":21,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:09.428300+0000","last_change":"2024-09-21T03:25:05.959732+0000","last_active":"2024-09-21T03:25:09.428300+0000","last_peered":"2024-09-21T03:25:09.428300+0000","last_clean":"2024-09-21T03:25:09.428300+0000","last_became_active":"2024-09-21T03:25:05.959393+0000","last_became_peered":"2024-09-21T03:25:05.959393+0000","last_unstale":"2024-09-21T03:25:09.428300+0000","last_undegraded":"2024-09-21T03:25:09.428300+0000","last_fullsized":"2024-09-21T03:25:09.428300+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:15.140643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.964650+0000","last_change":"2024-09-21T03:25:06.959029+0000","last_active":"2024-09-21T03:25:06.964650+0000","last_peered":"2024-09-21T03:25:06.964650+0000","last_clean":"2024-09-21T03:25:06.964650+0000","last_became_active":"2024-09-21T03:25:06.958443+0000","last_became_peered":"2024-09-21T03:25:06.958443+0000","last_unstale":"2024-09-21T03:25:06.964650+0000","last_undegraded":"2024-09-21T03:25:06.964650+0000","last_fullsized":"2024-09-21T03:25:06.964650+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:41:16.872769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.967401+0000","last_change":"2024-09-21T03:25:05.946740+0000","last_active":"2024-09-21T03:25:06.967401+0000","last_peered":"2024-09-21T03:25:06.967401+0000","last_clean":"2024-09-21T03:25:06.967401+0000","last_became_active":"2024-09-21T03:25:05.946438+0000","last_became_peered":"2024-09-21T03:25:05.946438+0000","last_unstale":"2024-09-21T03:25:06.967401+0000","last_undegraded":"2024-09-21T03:25:06.967401+0000","last_fullsized":"2024-09-21T03:25:06.967401+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:27.205093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.958138+0000","last_change":"2024-09-21T03:25:06.954978+0000","last_active":"2024-09-21T03:25:06.958138+0000","last_peered":"2024-09-21T03:25:06.958138+0000","last_clean":"2024-09-21T03:25:06.958138+0000","last_became_active":"2024-09-21T03:25:06.954688+0000","last_became_peered":"2024-09-21T03:25:06.954688+0000","last_unstale":"2024-09-21T03:25:06.958138+0000","last_undegraded":"2024-09-21T03:25:06.958138+0000","last_fullsized":"2024-09-21T03:25:06.958138+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:03.305218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958184+0000","last_change":"2024-09-21T03:25:05.960010+0000","last_active":"2024-09-21T03:25:07.958184+0000","last_peered":"2024-09-21T03:25:07.958184+0000","last_clean":"2024-09-21T03:25:07.958184+0000","last_became_active":"2024-09-21T03:25:05.959699+0000","last_became_peered":"2024-09-21T03:25:05.959699+0000","last_unstale":"2024-09-21T03:25:07.958184+0000","last_undegraded":"2024-09-21T03:25:07.958184+0000","last_fullsized":"2024-09-21T03:25:07.958184+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:33.984094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.957851+0000","last_change":"2024-09-21T03:25:06.954255+0000","last_active":"2024-09-21T03:25:06.957851+0000","last_peered":"2024-09-21T03:25:06.957851+0000","last_clean":"2024-09-21T03:25:06.957851+0000","last_became_active":"2024-09-21T03:25:06.953960+0000","last_became_peered":"2024-09-21T03:25:06.953960+0000","last_unstale":"2024-09-21T03:25:06.957851+0000","last_undegraded":"2024-09-21T03:25:06.957851+0000","last_fullsized":"2024-09-21T03:25:06.957851+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:13.975782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"103'8","reported_seq":21,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.971415+0000","last_change":"2024-09-21T03:25:05.962238+0000","last_active":"2024-09-21T03:25:06.971415+0000","last_peered":"2024-09-21T03:25:06.971415+0000","last_clean":"2024-09-21T03:25:06.971415+0000","last_became_active":"2024-09-21T03:25:05.961869+0000","last_became_peered":"2024-09-21T03:25:05.961869+0000","last_unstale":"2024-09-21T03:25:06.971415+0000","last_undegraded":"2024-09-21T03:25:06.971415+0000","last_fullsized":"2024-09-21T03:25:06.971415+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:13.594419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.974579+0000","last_change":"2024-09-21T03:25:06.973378+0000","last_active":"2024-09-21T03:25:06.974579+0000","last_peered":"2024-09-21T03:25:06.974579+0000","last_clean":"2024-09-21T03:25:06.974579+0000","last_became_active":"2024-09-21T03:25:06.972937+0000","last_became_peered":"2024-09-21T03:25:06.972937+0000","last_unstale":"2024-09-21T03:25:06.974579+0000","last_undegraded":"2024-09-21T03:25:06.974579+0000","last_fullsized":"2024-09-21T03:25:06.974579+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:20.822035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:09.428274+0000","last_change":"2024-09-21T03:25:05.953632+0000","last_active":"2024-09-21T03:25:09.428274+0000","last_peered":"2024-09-21T03:25:09.428274+0000","last_clean":"2024-09-21T03:25:09.428274+0000","last_became_active":"2024-09-21T03:25:05.952747+0000","last_became_peered":"2024-09-21T03:25:05.952747+0000","last_unstale":"2024-09-21T03:25:09.428274+0000","last_undegraded":"2024-09-21T03:25:09.428274+0000","last_fullsized":"2024-09-21T03:25:09.428274+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:15:45.944858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.973787+0000","last_change":"2024-09-21T03:25:06.971849+0000","last_active":"2024-09-21T03:25:06.973787+0000","last_peered":"2024-09-21T03:25:06.973787+0000","last_clean":"2024-09-21T03:25:06.973787+0000","last_became_active":"2024-09-21T03:25:06.971533+0000","last_became_peered":"2024-09-21T03:25:06.971533+0000","last_unstale":"2024-09-21T03:25:06.973787+0000","last_undegraded":"2024-09-21T03:25:06.973787+0000","last_fullsized":"2024-09-21T03:25:06.973787+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:37.012007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.973664+0000","last_change":"2024-09-21T03:25:05.949862+0000","last_active":"2024-09-21T03:25:06.973664+0000","last_peered":"2024-09-21T03:25:06.973664+0000","last_clean":"2024-09-21T03:25:06.973664+0000","last_became_active":"2024-09-21T03:25:05.949503+0000","last_became_peered":"2024-09-21T03:25:05.949503+0000","last_unstale":"2024-09-21T03:25:06.973664+0000","last_undegraded":"2024-09-21T03:25:06.973664+0000","last_fullsized":"2024-09-21T03:25:06.973664+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:48.375833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954331+0000","last_change":"2024-09-21T03:25:06.968263+0000","last_active":"2024-09-21T03:25:07.954331+0000","last_peered":"2024-09-21T03:25:07.954331+0000","last_clean":"2024-09-21T03:25:07.954331+0000","last_became_active":"2024-09-21T03:25:06.967957+0000","last_became_peered":"2024-09-21T03:25:06.967957+0000","last_unstale":"2024-09-21T03:25:07.954331+0000","last_undegraded":"2024-09-21T03:25:07.954331+0000","last_fullsized":"2024-09-21T03:25:07.954331+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:54:38.224056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"103'1","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958389+0000","last_change":"2024-09-21T03:25:05.951962+0000","last_active":"2024-09-21T03:25:07.958389+0000","last_peered":"2024-09-21T03:25:07.958389+0000","last_clean":"2024-09-21T03:25:07.958389+0000","last_became_active":"2024-09-21T03:25:05.951676+0000","last_became_peered":"2024-09-21T03:25:05.951676+0000","last_unstale":"2024-09-21T03:25:07.958389+0000","last_undegraded":"2024-09-21T03:25:07.958389+0000","last_fullsized":"2024-09-21T03:25:07.958389+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:14:33.126090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954791+0000","last_change":"2024-09-21T03:25:06.958748+0000","last_active":"2024-09-21T03:25:07.954791+0000","last_peered":"2024-09-21T03:25:07.954791+0000","last_clean":"2024-09-21T03:25:07.954791+0000","last_became_active":"2024-09-21T03:25:06.958412+0000","last_became_peered":"2024-09-21T03:25:06.958412+0000","last_unstale":"2024-09-21T03:25:07.954791+0000","last_undegraded":"2024-09-21T03:25:07.954791+0000","last_fullsized":"2024-09-21T03:25:07.954791+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:02.237215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.945527+0000","last_change":"2024-09-21T03:25:05.955181+0000","last_active":"2024-09-21T03:25:06.945527+0000","last_peered":"2024-09-21T03:25:06.945527+0000","last_clean":"2024-09-21T03:25:06.945527+0000","last_became_active":"2024-09-21T03:25:05.954828+0000","last_became_peered":"2024-09-21T03:25:05.954828+0000","last_unstale":"2024-09-21T03:25:06.945527+0000","last_undegraded":"2024-09-21T03:25:06.945527+0000","last_fullsized":"2024-09-21T03:25:06.945527+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:35.311555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954227+0000","last_change":"2024-09-21T03:25:06.957965+0000","last_active":"2024-09-21T03:25:07.954227+0000","last_peered":"2024-09-21T03:25:07.954227+0000","last_clean":"2024-09-21T03:25:07.954227+0000","last_became_active":"2024-09-21T03:25:06.957637+0000","last_became_peered":"2024-09-21T03:25:06.957637+0000","last_unstale":"2024-09-21T03:25:07.954227+0000","last_undegraded":"2024-09-21T03:25:07.954227+0000","last_fullsized":"2024-09-21T03:25:07.954227+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:34.326915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.968385+0000","last_change":"2024-09-21T03:25:05.949798+0000","last_active":"2024-09-21T03:25:06.968385+0000","last_peered":"2024-09-21T03:25:06.968385+0000","last_clean":"2024-09-21T03:25:06.968385+0000","last_became_active":"2024-09-21T03:25:05.949522+0000","last_became_peered":"2024-09-21T03:25:05.949522+0000","last_unstale":"2024-09-21T03:25:06.968385+0000","last_undegraded":"2024-09-21T03:25:06.968385+0000","last_fullsized":"2024-09-21T03:25:06.968385+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:20.522015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:09.427958+0000","last_change":"2024-09-21T03:25:06.970029+0000","last_active":"2024-09-21T03:25:09.427958+0000","last_peered":"2024-09-21T03:25:09.427958+0000","last_clean":"2024-09-21T03:25:09.427958+0000","last_became_active":"2024-09-21T03:25:06.969698+0000","last_became_peered":"2024-09-21T03:25:06.969698+0000","last_unstale":"2024-09-21T03:25:09.427958+0000","last_undegraded":"2024-09-21T03:25:09.427958+0000","last_fullsized":"2024-09-21T03:25:09.427958+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:42:50.912826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.943364+0000","last_change":"2024-09-21T03:25:05.951055+0000","last_active":"2024-09-21T03:25:06.943364+0000","last_peered":"2024-09-21T03:25:06.943364+0000","last_clean":"2024-09-21T03:25:06.943364+0000","last_became_active":"2024-09-21T03:25:05.950689+0000","last_became_peered":"2024-09-21T03:25:05.950689+0000","last_unstale":"2024-09-21T03:25:06.943364+0000","last_undegraded":"2024-09-21T03:25:06.943364+0000","last_fullsized":"2024-09-21T03:25:06.943364+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:46:14.630887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954221+0000","last_change":"2024-09-21T03:25:06.957927+0000","last_active":"2024-09-21T03:25:07.954221+0000","last_peered":"2024-09-21T03:25:07.954221+0000","last_clean":"2024-09-21T03:25:07.954221+0000","last_became_active":"2024-09-21T03:25:06.956714+0000","last_became_peered":"2024-09-21T03:25:06.956714+0000","last_unstale":"2024-09-21T03:25:07.954221+0000","last_undegraded":"2024-09-21T03:25:07.954221+0000","last_fullsized":"2024-09-21T03:25:07.954221+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:28.910067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.943454+0000","last_change":"2024-09-21T03:25:05.949024+0000","last_active":"2024-09-21T03:25:06.943454+0000","last_peered":"2024-09-21T03:25:06.943454+0000","last_clean":"2024-09-21T03:25:06.943454+0000","last_became_active":"2024-09-21T03:25:05.948664+0000","last_became_peered":"2024-09-21T03:25:05.948664+0000","last_unstale":"2024-09-21T03:25:06.943454+0000","last_undegraded":"2024-09-21T03:25:06.943454+0000","last_fullsized":"2024-09-21T03:25:06.943454+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:10.198642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.970949+0000","last_change":"2024-09-21T03:25:06.966457+0000","last_active":"2024-09-21T03:25:06.970949+0000","last_peered":"2024-09-21T03:25:06.970949+0000","last_clean":"2024-09-21T03:25:06.970949+0000","last_became_active":"2024-09-21T03:25:06.965905+0000","last_became_peered":"2024-09-21T03:25:06.965905+0000","last_unstale":"2024-09-21T03:25:06.970949+0000","last_undegraded":"2024-09-21T03:25:06.970949+0000","last_fullsized":"2024-09-21T03:25:06.970949+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:28:33.939280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:09.427701+0000","last_change":"2024-09-21T03:25:05.961466+0000","last_active":"2024-09-21T03:25:09.427701+0000","last_peered":"2024-09-21T03:25:09.427701+0000","last_clean":"2024-09-21T03:25:09.427701+0000","last_became_active":"2024-09-21T03:25:05.961148+0000","last_became_peered":"2024-09-21T03:25:05.961148+0000","last_unstale":"2024-09-21T03:25:09.427701+0000","last_undegraded":"2024-09-21T03:25:09.427701+0000","last_fullsized":"2024-09-21T03:25:09.427701+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:05.184275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958987+0000","last_change":"2024-09-21T03:25:06.970004+0000","last_active":"2024-09-21T03:25:07.958987+0000","last_peered":"2024-09-21T03:25:07.958987+0000","last_clean":"2024-09-21T03:25:07.958987+0000","last_became_active":"2024-09-21T03:25:06.969612+0000","last_became_peered":"2024-09-21T03:25:06.969612+0000","last_unstale":"2024-09-21T03:25:07.958987+0000","last_undegraded":"2024-09-21T03:25:07.958987+0000","last_fullsized":"2024-09-21T03:25:07.958987+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:03.305218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"103'2","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.972709+0000","last_change":"2024-09-21T03:25:05.955665+0000","last_active":"2024-09-21T03:25:06.972709+0000","last_peered":"2024-09-21T03:25:06.972709+0000","last_clean":"2024-09-21T03:25:06.972709+0000","last_became_active":"2024-09-21T03:25:05.955365+0000","last_became_peered":"2024-09-21T03:25:05.955365+0000","last_unstale":"2024-09-21T03:25:06.972709+0000","last_undegraded":"2024-09-21T03:25:06.972709+0000","last_fullsized":"2024-09-21T03:25:06.972709+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:45.001004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:09.428114+0000","last_change":"2024-09-21T03:25:06.966725+0000","last_active":"2024-09-21T03:25:09.428114+0000","last_peered":"2024-09-21T03:25:09.428114+0000","last_clean":"2024-09-21T03:25:09.428114+0000","last_became_active":"2024-09-21T03:25:06.965871+0000","last_became_peered":"2024-09-21T03:25:06.965871+0000","last_unstale":"2024-09-21T03:25:09.428114+0000","last_undegraded":"2024-09-21T03:25:09.428114+0000","last_fullsized":"2024-09-21T03:25:09.428114+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:30.411572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958997+0000","last_change":"2024-09-21T03:25:05.949208+0000","last_active":"2024-09-21T03:25:07.958997+0000","last_peered":"2024-09-21T03:25:07.958997+0000","last_clean":"2024-09-21T03:25:07.958997+0000","last_became_active":"2024-09-21T03:25:05.948664+0000","last_became_peered":"2024-09-21T03:25:05.948664+0000","last_unstale":"2024-09-21T03:25:07.958997+0000","last_undegraded":"2024-09-21T03:25:07.958997+0000","last_fullsized":"2024-09-21T03:25:07.958997+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:17:20.392815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:09.428266+0000","last_change":"2024-09-21T03:25:06.968973+0000","last_active":"2024-09-21T03:25:09.428266+0000","last_peered":"2024-09-21T03:25:09.428266+0000","last_clean":"2024-09-21T03:25:09.428266+0000","last_became_active":"2024-09-21T03:25:06.967034+0000","last_became_peered":"2024-09-21T03:25:06.967034+0000","last_unstale":"2024-09-21T03:25:09.428266+0000","last_undegraded":"2024-09-21T03:25:09.428266+0000","last_fullsized":"2024-09-21T03:25:09.428266+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:08:57.411029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:09.427882+0000","last_change":"2024-09-21T03:25:05.961517+0000","last_active":"2024-09-21T03:25:09.427882+0000","last_peered":"2024-09-21T03:25:09.427882+0000","last_clean":"2024-09-21T03:25:09.427882+0000","last_became_active":"2024-09-21T03:25:05.961159+0000","last_became_peered":"2024-09-21T03:25:05.961159+0000","last_unstale":"2024-09-21T03:25:09.427882+0000","last_undegraded":"2024-09-21T03:25:09.427882+0000","last_fullsized":"2024-09-21T03:25:09.427882+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:48.764868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958256+0000","last_change":"2024-09-21T03:25:06.968024+0000","last_active":"2024-09-21T03:25:07.958256+0000","last_peered":"2024-09-21T03:25:07.958256+0000","last_clean":"2024-09-21T03:25:07.958256+0000","last_became_active":"2024-09-21T03:25:06.967584+0000","last_became_peered":"2024-09-21T03:25:06.967584+0000","last_unstale":"2024-09-21T03:25:07.958256+0000","last_undegraded":"2024-09-21T03:25:07.958256+0000","last_fullsized":"2024-09-21T03:25:07.958256+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:14.835962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.947689+0000","last_change":"2024-09-21T03:25:05.953316+0000","last_active":"2024-09-21T03:25:06.947689+0000","last_peered":"2024-09-21T03:25:06.947689+0000","last_clean":"2024-09-21T03:25:06.947689+0000","last_became_active":"2024-09-21T03:25:05.953009+0000","last_became_peered":"2024-09-21T03:25:05.953009+0000","last_unstale":"2024-09-21T03:25:06.947689+0000","last_undegraded":"2024-09-21T03:25:06.947689+0000","last_fullsized":"2024-09-21T03:25:06.947689+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:13.832422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958341+0000","last_change":"2024-09-21T03:25:06.957735+0000","last_active":"2024-09-21T03:25:07.958341+0000","last_peered":"2024-09-21T03:25:07.958341+0000","last_clean":"2024-09-21T03:25:07.958341+0000","last_became_active":"2024-09-21T03:25:06.957327+0000","last_became_peered":"2024-09-21T03:25:06.957327+0000","last_unstale":"2024-09-21T03:25:07.958341+0000","last_undegraded":"2024-09-21T03:25:07.958341+0000","last_fullsized":"2024-09-21T03:25:07.958341+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:49.780931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.945223+0000","last_change":"2024-09-21T03:25:05.949661+0000","last_active":"2024-09-21T03:25:06.945223+0000","last_peered":"2024-09-21T03:25:06.945223+0000","last_clean":"2024-09-21T03:25:06.945223+0000","last_became_active":"2024-09-21T03:25:05.949336+0000","last_became_peered":"2024-09-21T03:25:05.949336+0000","last_unstale":"2024-09-21T03:25:06.945223+0000","last_undegraded":"2024-09-21T03:25:06.945223+0000","last_fullsized":"2024-09-21T03:25:06.945223+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:48.750266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958762+0000","last_change":"2024-09-21T03:25:06.948815+0000","last_active":"2024-09-21T03:25:07.958762+0000","last_peered":"2024-09-21T03:25:07.958762+0000","last_clean":"2024-09-21T03:25:07.958762+0000","last_became_active":"2024-09-21T03:25:06.948415+0000","last_became_peered":"2024-09-21T03:25:06.948415+0000","last_unstale":"2024-09-21T03:25:07.958762+0000","last_undegraded":"2024-09-21T03:25:07.958762+0000","last_fullsized":"2024-09-21T03:25:07.958762+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:03.305218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.958470+0000","last_change":"2024-09-21T03:25:05.945536+0000","last_active":"2024-09-21T03:25:07.958470+0000","last_peered":"2024-09-21T03:25:07.958470+0000","last_clean":"2024-09-21T03:25:07.958470+0000","last_became_active":"2024-09-21T03:25:05.945162+0000","last_became_peered":"2024-09-21T03:25:05.945162+0000","last_unstale":"2024-09-21T03:25:07.958470+0000","last_undegraded":"2024-09-21T03:25:07.958470+0000","last_fullsized":"2024-09-21T03:25:07.958470+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:09.991545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954517+0000","last_change":"2024-09-21T03:25:06.957533+0000","last_active":"2024-09-21T03:25:07.954517+0000","last_peered":"2024-09-21T03:25:07.954517+0000","last_clean":"2024-09-21T03:25:07.954517+0000","last_became_active":"2024-09-21T03:25:06.957214+0000","last_became_peered":"2024-09-21T03:25:06.957214+0000","last_unstale":"2024-09-21T03:25:07.954517+0000","last_undegraded":"2024-09-21T03:25:07.954517+0000","last_fullsized":"2024-09-21T03:25:07.954517+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:02:24.677842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.942986+0000","last_change":"2024-09-21T03:25:05.953058+0000","last_active":"2024-09-21T03:25:06.942986+0000","last_peered":"2024-09-21T03:25:06.942986+0000","last_clean":"2024-09-21T03:25:06.942986+0000","last_became_active":"2024-09-21T03:25:05.952512+0000","last_became_peered":"2024-09-21T03:25:05.952512+0000","last_unstale":"2024-09-21T03:25:06.942986+0000","last_undegraded":"2024-09-21T03:25:06.942986+0000","last_fullsized":"2024-09-21T03:25:06.942986+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:34.953614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:09.427561+0000","last_change":"2024-09-21T03:25:06.964134+0000","last_active":"2024-09-21T03:25:09.427561+0000","last_peered":"2024-09-21T03:25:09.427561+0000","last_clean":"2024-09-21T03:25:09.427561+0000","last_became_active":"2024-09-21T03:25:06.963462+0000","last_became_peered":"2024-09-21T03:25:06.963462+0000","last_unstale":"2024-09-21T03:25:09.427561+0000","last_undegraded":"2024-09-21T03:25:09.427561+0000","last_fullsized":"2024-09-21T03:25:09.427561+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:26:42.941063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:09.427879+0000","last_change":"2024-09-21T03:25:05.960646+0000","last_active":"2024-09-21T03:25:09.427879+0000","last_peered":"2024-09-21T03:25:09.427879+0000","last_clean":"2024-09-21T03:25:09.427879+0000","last_became_active":"2024-09-21T03:25:05.959992+0000","last_became_peered":"2024-09-21T03:25:05.959992+0000","last_unstale":"2024-09-21T03:25:09.427879+0000","last_undegraded":"2024-09-21T03:25:09.427879+0000","last_fullsized":"2024-09-21T03:25:09.427879+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:30:46.216855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":10,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.964593+0000","last_change":"2024-09-21T03:25:06.962590+0000","last_active":"2024-09-21T03:25:06.964593+0000","last_peered":"2024-09-21T03:25:06.964593+0000","last_clean":"2024-09-21T03:25:06.964593+0000","last_became_active":"2024-09-21T03:25:06.962295+0000","last_became_peered":"2024-09-21T03:25:06.962295+0000","last_unstale":"2024-09-21T03:25:06.964593+0000","last_undegraded":"2024-09-21T03:25:06.964593+0000","last_fullsized":"2024-09-21T03:25:06.964593+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:05.927023+0000","last_clean_scrub_stamp":"2024-09-21T03:25:05.927023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:04:58.099896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":13,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-21T03:25:06.947269+0000","last_change":"2024-09-21T03:25:05.955078+0000","last_active":"2024-09-21T03:25:06.947269+0000","last_peered":"2024-09-21T03:25:06.947269+0000","last_clean":"2024-09-21T03:25:06.947269+0000","last_became_active":"2024-09-21T03:25:05.954784+0000","last_became_peered":"2024-09-21T03:25:05.954784+0000","last_unstale":"2024-09-21T03:25:06.947269+0000","last_undegraded":"2024-09-21T03:25:06.947269+0000","last_fullsized":"2024-09-21T03:25:06.947269+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:04.923483+0000","last_clean_scrub_stamp":"2024-09-21T03:25:04.923483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:15:08.648155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":266,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-21T03:25:07.954464+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:25:07.954464+0000","last_peered":"2024-09-21T03:25:07.954464+0000","last_clean":"2024-09-21T03:25:07.954464+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:25:07.954464+0000","last_undegraded":"2024-09-21T03:25:07.954464+0000","last_fullsized":"2024-09-21T03:25:07.954464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509527,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33020,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338820,"statfs":{"total":96636764160,"available":96602951680,"internally_reserved":0,"allocated":1875968,"data_stored":1131075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509526,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32456,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":1290240,"data_stored":546461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509525,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1282048,"data_stored":540695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509525,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32436,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339404,"statfs":{"total":96636764160,"available":96603549696,"internally_reserved":0,"allocated":1273856,"data_stored":540091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509526,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32456,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":1290240,"data_stored":541773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509526,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1273856,"data_stored":540091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509526,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36600,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335240,"statfs":{"total":96636764160,"available":96599285760,"internally_reserved":0,"allocated":1282048,"data_stored":540215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574934,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33044,"kb_used_data":1856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338796,"statfs":{"total":96636764160,"available":96602927104,"internally_reserved":0,"allocated":1900544,"data_stored":1138483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:25:14.752 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T03:25:14.753 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T03:25:14.910 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.908+0000 7eff4701d640 1 -- 172.21.15.105:0/1683988744 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff28003fd0 msgr2=0x7eff28004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:14.910 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.908+0000 7eff4701d640 1 --2- 172.21.15.105:0/1683988744 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff28003fd0 0x7eff28004800 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7eff34009b20 tx=0x7eff28005830 comp rx=0 tx=0).stop 2024-09-21T03:25:14.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.908+0000 7eff455ba640 1 -- 172.21.15.105:0/1683988744 reap_dead start 2024-09-21T03:25:14.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.908+0000 7eff4701d640 1 -- 172.21.15.105:0/1683988744 shutdown_connections 2024-09-21T03:25:14.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.908+0000 7eff4701d640 1 -- 172.21.15.105:0/1683988744 >> 172.21.15.105:0/1683988744 conn(0x7eff4006d4f0 msgr2=0x7eff40071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:14.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.908+0000 7eff4701d640 1 -- 172.21.15.105:0/1683988744 shutdown_connections 2024-09-21T03:25:14.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.908+0000 7eff4701d640 1 -- 172.21.15.105:0/1683988744 wait complete. 2024-09-21T03:25:14.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.910+0000 7eff4701d640 1 Processor -- start 2024-09-21T03:25:14.912 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.910+0000 7eff4701d640 1 -- start start 2024-09-21T03:25:14.914 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.912+0000 7eff4701d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff28003fd0 0x7eff400b66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:14.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.912+0000 7eff4701d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff401f75a0 0x7eff400c5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:14.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.912+0000 7eff4701d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff4015ab40 0x7eff4015af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:14.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.912+0000 7eff4701d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7eff400cf530 con 0x7eff28003fd0 2024-09-21T03:25:14.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.912+0000 7eff4701d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7eff400cf3b0 con 0x7eff401f75a0 2024-09-21T03:25:14.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.912+0000 7eff4701d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7eff400d0530 con 0x7eff4015ab40 2024-09-21T03:25:14.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.912+0000 7eff44db9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff28003fd0 0x7eff400b66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:14.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.912+0000 7eff44db9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff28003fd0 0x7eff400b66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51508/0 (socket says 172.21.15.105:51508) 2024-09-21T03:25:14.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.912+0000 7eff44db9640 1 -- 172.21.15.105:0/367801215 learned_addr learned my addr 172.21.15.105:0/367801215 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:14.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.912+0000 7eff3ffff640 1 --2- 172.21.15.105:0/367801215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff401f75a0 0x7eff400c5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:14.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.912+0000 7eff455ba640 1 --2- 172.21.15.105:0/367801215 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff4015ab40 0x7eff4015af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:14.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.912+0000 7eff44db9640 1 -- 172.21.15.105:0/367801215 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff4015ab40 msgr2=0x7eff4015af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:14.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.912+0000 7eff44db9640 1 --2- 172.21.15.105:0/367801215 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff4015ab40 0x7eff4015af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:14.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.912+0000 7eff44db9640 1 -- 172.21.15.105:0/367801215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff401f75a0 msgr2=0x7eff400c5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:14.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.912+0000 7eff44db9640 1 --2- 172.21.15.105:0/367801215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff401f75a0 0x7eff400c5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:14.916 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.912+0000 7eff44db9640 1 -- 172.21.15.105:0/367801215 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff4015b490 con 0x7eff28003fd0 2024-09-21T03:25:14.916 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.912+0000 7eff455ba640 1 --2- 172.21.15.105:0/367801215 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff4015ab40 0x7eff4015af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:25:14.916 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.912+0000 7eff44db9640 1 --2- 172.21.15.105:0/367801215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff28003fd0 0x7eff400b66d0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7eff30000fb0 tx=0x7eff3000eab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:14.916 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.912+0000 7eff3d7fa640 1 -- 172.21.15.105:0/367801215 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff30015070 con 0x7eff28003fd0 2024-09-21T03:25:14.916 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.912+0000 7eff3d7fa640 1 -- 172.21.15.105:0/367801215 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff30010980 con 0x7eff28003fd0 2024-09-21T03:25:14.916 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.912+0000 7eff3d7fa640 1 -- 172.21.15.105:0/367801215 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff30010d50 con 0x7eff28003fd0 2024-09-21T03:25:14.916 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.912+0000 7eff4701d640 1 -- 172.21.15.105:0/367801215 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff401f3490 con 0x7eff28003fd0 2024-09-21T03:25:14.916 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.912+0000 7eff4701d640 1 -- 172.21.15.105:0/367801215 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff401f3a50 con 0x7eff28003fd0 2024-09-21T03:25:14.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.913+0000 7eff4701d640 1 -- 172.21.15.105:0/367801215 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff40156f10 con 0x7eff28003fd0 2024-09-21T03:25:14.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.914+0000 7eff3d7fa640 1 -- 172.21.15.105:0/367801215 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7eff30018070 con 0x7eff28003fd0 2024-09-21T03:25:14.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.915+0000 7eff3d7fa640 1 --2- 172.21.15.105:0/367801215 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7eff2c078bc0 0x7eff2c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:14.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.915+0000 7eff3d7fa640 1 -- 172.21.15.105:0/367801215 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7eff3009b150 con 0x7eff28003fd0 2024-09-21T03:25:14.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.915+0000 7eff3ffff640 1 --2- 172.21.15.105:0/367801215 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7eff2c078bc0 0x7eff2c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:14.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.916+0000 7eff3ffff640 1 --2- 172.21.15.105:0/367801215 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7eff2c078bc0 0x7eff2c07b0d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7eff34035000 tx=0x7eff340046c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:14.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:14.920+0000 7eff3d7fa640 1 -- 172.21.15.105:0/367801215 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7eff4015b490 con 0x7eff28003fd0 2024-09-21T03:25:15.172 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.170+0000 7eff4701d640 1 -- 172.21.15.105:0/367801215 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7eff4015ba50 con 0x7eff28003fd0 2024-09-21T03:25:15.176 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.175+0000 7eff3d7fa640 1 -- 172.21.15.105:0/367801215 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) ==== 190+0+147 (secure 0 0 0) 0x7eff30062f40 con 0x7eff28003fd0 2024-09-21T03:25:15.177 INFO:teuthology.orchestra.run.smithi105.stdout:[client.0] 2024-09-21T03:25:15.177 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQDIOu5mughoJxAAhY0bzJmq+oNyzCdtafkC9w== 2024-09-21T03:25:15.177 INFO:teuthology.orchestra.run.smithi105.stdout: caps mds = "allow" 2024-09-21T03:25:15.177 INFO:teuthology.orchestra.run.smithi105.stdout: caps mon = "allow r" 2024-09-21T03:25:15.177 INFO:teuthology.orchestra.run.smithi105.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T03:25:15.177 INFO:teuthology.orchestra.run.smithi105.stderr:updated caps for client.0 2024-09-21T03:25:15.179 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.177+0000 7eff4701d640 1 -- 172.21.15.105:0/367801215 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7eff2c078bc0 msgr2=0x7eff2c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:15.179 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.177+0000 7eff4701d640 1 --2- 172.21.15.105:0/367801215 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7eff2c078bc0 0x7eff2c07b0d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7eff34035000 tx=0x7eff340046c0 comp rx=0 tx=0).stop 2024-09-21T03:25:15.179 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.177+0000 7eff4701d640 1 -- 172.21.15.105:0/367801215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff28003fd0 msgr2=0x7eff400b66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:15.179 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.177+0000 7eff4701d640 1 --2- 172.21.15.105:0/367801215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff28003fd0 0x7eff400b66d0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7eff30000fb0 tx=0x7eff3000eab0 comp rx=0 tx=0).stop 2024-09-21T03:25:15.179 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.177+0000 7eff4701d640 1 -- 172.21.15.105:0/367801215 shutdown_connections 2024-09-21T03:25:15.180 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.177+0000 7eff4701d640 1 --2- 172.21.15.105:0/367801215 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7eff2c078bc0 0x7eff2c07b0d0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:15.180 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.177+0000 7eff4701d640 1 --2- 172.21.15.105:0/367801215 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff4015ab40 0x7eff4015af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:15.180 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.177+0000 7eff4701d640 1 --2- 172.21.15.105:0/367801215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff401f75a0 0x7eff400c5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:15.180 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.177+0000 7eff4701d640 1 --2- 172.21.15.105:0/367801215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff28003fd0 0x7eff400b66d0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:15.180 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.177+0000 7eff4701d640 1 -- 172.21.15.105:0/367801215 >> 172.21.15.105:0/367801215 conn(0x7eff4006d4f0 msgr2=0x7eff4015d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:15.180 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.177+0000 7eff4701d640 1 -- 172.21.15.105:0/367801215 shutdown_connections 2024-09-21T03:25:15.180 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.177+0000 7eff4701d640 1 -- 172.21.15.105:0/367801215 wait complete. 2024-09-21T03:25:15.190 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:25:15.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.300+0000 7f13212fa640 1 -- 172.21.15.105:0/4056763704 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f131c0b9b70 msgr2=0x7f131c0cf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:15.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.300+0000 7f13212fa640 1 --2- 172.21.15.105:0/4056763704 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f131c0b9b70 0x7f131c0cf090 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f1304005fd0 tx=0x7f130402a5d0 comp rx=0 tx=0).stop 2024-09-21T03:25:15.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.300+0000 7f13212fa640 1 -- 172.21.15.105:0/4056763704 shutdown_connections 2024-09-21T03:25:15.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.300+0000 7f13212fa640 1 --2- 172.21.15.105:0/4056763704 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f131c0b9b70 0x7f131c0cf090 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:15.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.300+0000 7f13212fa640 1 --2- 172.21.15.105:0/4056763704 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f131c0d2ed0 0x7f131c0d1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:15.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.300+0000 7f13212fa640 1 -- 172.21.15.105:0/4056763704 >> 172.21.15.105:0/4056763704 conn(0x7f131c08bfc0 msgr2=0x7f131c09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:15.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.300+0000 7f13212fa640 1 -- 172.21.15.105:0/4056763704 shutdown_connections 2024-09-21T03:25:15.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.300+0000 7f13212fa640 1 -- 172.21.15.105:0/4056763704 wait complete. 2024-09-21T03:25:15.303 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.301+0000 7f13212fa640 1 Processor -- start 2024-09-21T03:25:15.303 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.302+0000 7f13212fa640 1 -- start start 2024-09-21T03:25:15.306 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.303+0000 7f13212fa640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f131c0b9b70 0x7f131c0ca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:15.306 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.303+0000 7f13212fa640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f131c0cf5d0 0x7f131c14f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:15.306 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.303+0000 7f13212fa640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f131c0d2ed0 0x7f131c14fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:15.306 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.303+0000 7f13212fa640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f131c0d4940 con 0x7f131c0d2ed0 2024-09-21T03:25:15.306 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.303+0000 7f13212fa640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f131c0cfde0 con 0x7f131c0b9b70 2024-09-21T03:25:15.306 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.303+0000 7f13212fa640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f131c0d4ac0 con 0x7f131c0cf5d0 2024-09-21T03:25:15.306 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.303+0000 7f131b7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f131c0d2ed0 0x7f131c14fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:15.306 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.303+0000 7f131b7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f131c0d2ed0 0x7f131c14fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51518/0 (socket says 172.21.15.105:51518) 2024-09-21T03:25:15.306 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.303+0000 7f131b7fe640 1 -- 172.21.15.105:0/3307879124 learned_addr learned my addr 172.21.15.105:0/3307879124 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:15.306 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.303+0000 7f13127fc640 1 --2- 172.21.15.105:0/3307879124 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f131c0cf5d0 0x7f131c14f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:15.306 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.303+0000 7f131affd640 1 --2- 172.21.15.105:0/3307879124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f131c0b9b70 0x7f131c0ca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:15.307 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.303+0000 7f131b7fe640 1 -- 172.21.15.105:0/3307879124 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f131c0cf5d0 msgr2=0x7f131c14f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:15.307 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.303+0000 7f131b7fe640 1 --2- 172.21.15.105:0/3307879124 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f131c0cf5d0 0x7f131c14f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:15.307 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.303+0000 7f131b7fe640 1 -- 172.21.15.105:0/3307879124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f131c0b9b70 msgr2=0x7f131c0ca2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:15.307 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.303+0000 7f131b7fe640 1 --2- 172.21.15.105:0/3307879124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f131c0b9b70 0x7f131c0ca2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:15.307 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.303+0000 7f131b7fe640 1 -- 172.21.15.105:0/3307879124 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f131c1f61a0 con 0x7f131c0d2ed0 2024-09-21T03:25:15.307 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.304+0000 7f131b7fe640 1 --2- 172.21.15.105:0/3307879124 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f131c0d2ed0 0x7f131c14fd30 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f131400c730 tx=0x7f131400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:15.307 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.304+0000 7f1313fff640 1 -- 172.21.15.105:0/3307879124 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1314003b70 con 0x7f131c0d2ed0 2024-09-21T03:25:15.307 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.304+0000 7f1313fff640 1 -- 172.21.15.105:0/3307879124 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1314003d30 con 0x7f131c0d2ed0 2024-09-21T03:25:15.307 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.304+0000 7f1313fff640 1 -- 172.21.15.105:0/3307879124 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13140052d0 con 0x7f131c0d2ed0 2024-09-21T03:25:15.307 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.304+0000 7f13212fa640 1 -- 172.21.15.105:0/3307879124 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f131c1f6480 con 0x7f131c0d2ed0 2024-09-21T03:25:15.307 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.304+0000 7f13212fa640 1 -- 172.21.15.105:0/3307879124 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f131c1f6a40 con 0x7f131c0d2ed0 2024-09-21T03:25:15.308 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.305+0000 7f13212fa640 1 -- 172.21.15.105:0/3307879124 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f131c0d5070 con 0x7f131c0d2ed0 2024-09-21T03:25:15.308 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.305+0000 7f1313fff640 1 -- 172.21.15.105:0/3307879124 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1314005680 con 0x7f131c0d2ed0 2024-09-21T03:25:15.308 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.306+0000 7f1313fff640 1 --2- 172.21.15.105:0/3307879124 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f12fc078b90 0x7f12fc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:15.308 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.306+0000 7f1313fff640 1 -- 172.21.15.105:0/3307879124 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f131409ac60 con 0x7f131c0d2ed0 2024-09-21T03:25:15.308 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.306+0000 7f131affd640 1 --2- 172.21.15.105:0/3307879124 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f12fc078b90 0x7f12fc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:15.309 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.307+0000 7f131affd640 1 --2- 172.21.15.105:0/3307879124 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f12fc078b90 0x7f12fc07b0a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f130c006fd0 tx=0x7f130c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:15.312 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.310+0000 7f1313fff640 1 -- 172.21.15.105:0/3307879124 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f13140631c0 con 0x7f131c0d2ed0 2024-09-21T03:25:15.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.523+0000 7f13212fa640 1 -- 172.21.15.105:0/3307879124 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f131c0b4020 con 0x7f131c0d2ed0 2024-09-21T03:25:15.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.524+0000 7f1313fff640 1 -- 172.21.15.105:0/3307879124 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) ==== 94+0+5234 (secure 0 0 0) 0x7f1314062ac0 con 0x7f131c0d2ed0 2024-09-21T03:25:15.526 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:15.526 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":65,"btime":"2024-09-21T03:25:08:950897+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5996,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/1026486886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1026486886},{"type":"v1","addr":"172.21.15.162:6836","nonce":1026486886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1085304139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1085304139},{"type":"v1","addr":"172.21.15.162:6837","nonce":1085304139}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":7161,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/569907499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":569907499},{"type":"v1","addr":"172.21.15.105:6833","nonce":569907499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:25:06.305459+0000","modified":"2024-09-21T03:25:08.303256+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7164},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7164":{"gid":7164,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/2917579803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2917579803},{"type":"v1","addr":"172.21.15.105:6835","nonce":2917579803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7164,"qdb_cluster":[7164]},"id":8}]} 2024-09-21T03:25:15.526 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 65 2024-09-21T03:25:15.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.526+0000 7f13212fa640 1 -- 172.21.15.105:0/3307879124 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f12fc078b90 msgr2=0x7f12fc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:15.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.526+0000 7f13212fa640 1 --2- 172.21.15.105:0/3307879124 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f12fc078b90 0x7f12fc07b0a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f130c006fd0 tx=0x7f130c008040 comp rx=0 tx=0).stop 2024-09-21T03:25:15.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.526+0000 7f13212fa640 1 -- 172.21.15.105:0/3307879124 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f131c0d2ed0 msgr2=0x7f131c14fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:15.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.526+0000 7f13212fa640 1 --2- 172.21.15.105:0/3307879124 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f131c0d2ed0 0x7f131c14fd30 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f131400c730 tx=0x7f131400cbf0 comp rx=0 tx=0).stop 2024-09-21T03:25:15.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.526+0000 7f13212fa640 1 -- 172.21.15.105:0/3307879124 shutdown_connections 2024-09-21T03:25:15.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.526+0000 7f13212fa640 1 --2- 172.21.15.105:0/3307879124 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f12fc078b90 0x7f12fc07b0a0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:15.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.526+0000 7f13212fa640 1 --2- 172.21.15.105:0/3307879124 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f131c0d2ed0 0x7f131c14fd30 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:15.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.526+0000 7f13212fa640 1 --2- 172.21.15.105:0/3307879124 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f131c0cf5d0 0x7f131c14f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:15.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.526+0000 7f13212fa640 1 --2- 172.21.15.105:0/3307879124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f131c0b9b70 0x7f131c0ca2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:15.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.526+0000 7f13212fa640 1 -- 172.21.15.105:0/3307879124 >> 172.21.15.105:0/3307879124 conn(0x7f131c08bfc0 msgr2=0x7f131c06f790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:15.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.526+0000 7f13212fa640 1 -- 172.21.15.105:0/3307879124 shutdown_connections 2024-09-21T03:25:15.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:15.526+0000 7f13212fa640 1 -- 172.21.15.105:0/3307879124 wait complete. 2024-09-21T03:25:15.941 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 65, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T03:25:06.305459+0000', 'modified': '2024-09-21T03:25:08.303256+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7164}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7164': {'gid': 7164, 'name': 'a', 'rank': 0, 'incarnation': 63, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.105:6835/2917579803', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6834', 'nonce': 2917579803}, {'type': 'v1', 'addr': '172.21.15.105:6835', 'nonce': 2917579803}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7164, 'qdb_cluster': [7164]} 2024-09-21T03:25:15.941 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T03:25:15.942 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-21T03:25:16.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.055+0000 7fd3faeb6640 1 -- 172.21.15.105:0/2261182534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3f40b51c0 msgr2=0x7fd3f415c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:16.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.055+0000 7fd3faeb6640 1 --2- 172.21.15.105:0/2261182534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3f40b51c0 0x7fd3f415c6e0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4005fd0 tx=0x7fd3e402aa90 comp rx=0 tx=0).stop 2024-09-21T03:25:16.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.055+0000 7fd3faeb6640 1 -- 172.21.15.105:0/2261182534 shutdown_connections 2024-09-21T03:25:16.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.055+0000 7fd3faeb6640 1 --2- 172.21.15.105:0/2261182534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3f40b51c0 0x7fd3f415c6e0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.055+0000 7fd3faeb6640 1 -- 172.21.15.105:0/2261182534 >> 172.21.15.105:0/2261182534 conn(0x7fd3f4072ae0 msgr2=0x7fd3f4072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:16.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.055+0000 7fd3faeb6640 1 -- 172.21.15.105:0/2261182534 shutdown_connections 2024-09-21T03:25:16.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.055+0000 7fd3faeb6640 1 -- 172.21.15.105:0/2261182534 wait complete. 2024-09-21T03:25:16.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.057+0000 7fd3faeb6640 1 Processor -- start 2024-09-21T03:25:16.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.057+0000 7fd3faeb6640 1 -- start start 2024-09-21T03:25:16.061 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.058+0000 7fd3faeb6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3f40b51c0 0x7fd3f41e9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:16.061 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.058+0000 7fd3faeb6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd3f40ccbd0 0x7fd3f415a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:16.061 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.058+0000 7fd3faeb6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3f40d1490 0x7fd3f40c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:16.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.058+0000 7fd3faeb6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f40cf480 con 0x7fd3f40b51c0 2024-09-21T03:25:16.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.058+0000 7fd3faeb6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f40cf300 con 0x7fd3f40d1490 2024-09-21T03:25:16.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.058+0000 7fd3faeb6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd3f40cf600 con 0x7fd3f40ccbd0 2024-09-21T03:25:16.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.058+0000 7fd3f8c52640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3f40b51c0 0x7fd3f41e9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:16.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.058+0000 7fd3f8c52640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3f40b51c0 0x7fd3f41e9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51544/0 (socket says 172.21.15.105:51544) 2024-09-21T03:25:16.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.058+0000 7fd3f8c52640 1 -- 172.21.15.105:0/3363769361 learned_addr learned my addr 172.21.15.105:0/3363769361 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:16.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.059+0000 7fd3f9453640 1 --2- 172.21.15.105:0/3363769361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3f40d1490 0x7fd3f40c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:16.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.059+0000 7fd3f3fff640 1 --2- 172.21.15.105:0/3363769361 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd3f40ccbd0 0x7fd3f415a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:16.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.059+0000 7fd3f8c52640 1 -- 172.21.15.105:0/3363769361 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd3f40ccbd0 msgr2=0x7fd3f415a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:16.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.059+0000 7fd3f8c52640 1 --2- 172.21.15.105:0/3363769361 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd3f40ccbd0 0x7fd3f415a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.059+0000 7fd3f8c52640 1 -- 172.21.15.105:0/3363769361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3f40d1490 msgr2=0x7fd3f40c7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:16.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.059+0000 7fd3f8c52640 1 --2- 172.21.15.105:0/3363769361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3f40d1490 0x7fd3f40c7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.059+0000 7fd3f8c52640 1 -- 172.21.15.105:0/3363769361 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3f40cbf40 con 0x7fd3f40b51c0 2024-09-21T03:25:16.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.059+0000 7fd3f9453640 1 --2- 172.21.15.105:0/3363769361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3f40d1490 0x7fd3f40c7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:25:16.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.059+0000 7fd3f8c52640 1 --2- 172.21.15.105:0/3363769361 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3f40b51c0 0x7fd3f41e9730 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4000f80 tx=0x7fd3e4003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:16.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.059+0000 7fd3f17fa640 1 -- 172.21.15.105:0/3363769361 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e4044070 con 0x7fd3f40b51c0 2024-09-21T03:25:16.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.059+0000 7fd3f17fa640 1 -- 172.21.15.105:0/3363769361 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd3e4004250 con 0x7fd3f40b51c0 2024-09-21T03:25:16.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.059+0000 7fd3faeb6640 1 -- 172.21.15.105:0/3363769361 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3f41f37c0 con 0x7fd3f40b51c0 2024-09-21T03:25:16.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.059+0000 7fd3f17fa640 1 -- 172.21.15.105:0/3363769361 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e4004680 con 0x7fd3f40b51c0 2024-09-21T03:25:16.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.059+0000 7fd3faeb6640 1 -- 172.21.15.105:0/3363769361 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3f41f3d80 con 0x7fd3f40b51c0 2024-09-21T03:25:16.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.061+0000 7fd3f17fa640 1 -- 172.21.15.105:0/3363769361 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd3e4047070 con 0x7fd3f40b51c0 2024-09-21T03:25:16.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.062+0000 7fd3f17fa640 1 --2- 172.21.15.105:0/3363769361 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd3e0078bc0 0x7fd3e007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:16.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.062+0000 7fd3f17fa640 1 -- 172.21.15.105:0/3363769361 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7fd3e40bbce0 con 0x7fd3f40b51c0 2024-09-21T03:25:16.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.062+0000 7fd3f3fff640 1 --2- 172.21.15.105:0/3363769361 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd3e0078bc0 0x7fd3e007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:16.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.062+0000 7fd401e1e740 1 Processor -- start 2024-09-21T03:25:16.065 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.062+0000 7fd401e1e740 1 -- start start 2024-09-21T03:25:16.065 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.062+0000 7fd3f3fff640 1 --2- 172.21.15.105:0/3363769361 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd3e0078bc0 0x7fd3e007b0d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd3f415bb50 tx=0x7fd3e8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:16.067 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.063+0000 7fd401e1e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab3020b270 0x55ab305dcfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:16.067 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.063+0000 7fd401e1e740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ab301e23b0 0x55ab305dd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:16.067 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.063+0000 7fd401e1e740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab301ea590 0x55ab305fa3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:16.067 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.063+0000 7fd401e1e740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55ab30525820 con 0x55ab301ea590 2024-09-21T03:25:16.067 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.063+0000 7fd401e1e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ab30514c50 con 0x55ab3020b270 2024-09-21T03:25:16.067 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.063+0000 7fd401e1e740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55ab30518a60 con 0x55ab301e23b0 2024-09-21T03:25:16.068 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.064+0000 7fd3f9453640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab301ea590 0x55ab305fa3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:16.068 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.064+0000 7fd3f9453640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab301ea590 0x55ab305fa3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51552/0 (socket says 172.21.15.105:51552) 2024-09-21T03:25:16.068 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.064+0000 7fd3f9453640 1 -- 172.21.15.105:0/2039682978 learned_addr learned my addr 172.21.15.105:0/2039682978 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:16.068 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.064+0000 7fd3f3fff640 1 --2- 172.21.15.105:0/2039682978 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ab301e23b0 0x55ab305dd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:16.068 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.064+0000 7fd3f8c52640 1 --2- 172.21.15.105:0/2039682978 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab3020b270 0x55ab305dcfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:16.068 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.064+0000 7fd3f9453640 1 -- 172.21.15.105:0/2039682978 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ab301e23b0 msgr2=0x55ab305dd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:25:16.068 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.064+0000 7fd3f9453640 1 --2- 172.21.15.105:0/2039682978 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ab301e23b0 0x55ab305dd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.068 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.064+0000 7fd3f9453640 1 -- 172.21.15.105:0/2039682978 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab3020b270 msgr2=0x55ab305dcfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:25:16.068 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.064+0000 7fd3f9453640 1 --2- 172.21.15.105:0/2039682978 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab3020b270 0x55ab305dcfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.068 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.064+0000 7fd3f9453640 1 -- 172.21.15.105:0/2039682978 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab30276850 con 0x55ab301ea590 2024-09-21T03:25:16.068 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.064+0000 7fd3f9453640 1 --2- 172.21.15.105:0/2039682978 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab301ea590 0x55ab305fa3e0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec00b760 tx=0x7fd3ec00bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f07dadbc543f76cf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:16.068 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.064+0000 7fd3da7fc640 1 -- 172.21.15.105:0/2039682978 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec004020 con 0x55ab301ea590 2024-09-21T03:25:16.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.064+0000 7fd3da7fc640 1 -- 172.21.15.105:0/2039682978 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd3ec0042b0 con 0x55ab301ea590 2024-09-21T03:25:16.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.064+0000 7fd3da7fc640 1 -- 172.21.15.105:0/2039682978 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec00d950 con 0x55ab301ea590 2024-09-21T03:25:16.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.065+0000 7fd401e1e740 1 -- 172.21.15.105:0/2039682978 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab301ea590 msgr2=0x55ab305fa3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:16.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.065+0000 7fd401e1e740 1 --2- 172.21.15.105:0/2039682978 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab301ea590 0x55ab305fa3e0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec00b760 tx=0x7fd3ec00bc20 comp rx=0 tx=0).stop 2024-09-21T03:25:16.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.065+0000 7fd401e1e740 1 -- 172.21.15.105:0/2039682978 shutdown_connections 2024-09-21T03:25:16.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.065+0000 7fd401e1e740 1 --2- 172.21.15.105:0/2039682978 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab301ea590 0x55ab305fa3e0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.065+0000 7fd401e1e740 1 --2- 172.21.15.105:0/2039682978 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ab301e23b0 0x55ab305dd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.065+0000 7fd401e1e740 1 --2- 172.21.15.105:0/2039682978 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab3020b270 0x55ab305dcfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.065+0000 7fd401e1e740 1 -- 172.21.15.105:0/2039682978 >> 172.21.15.105:0/2039682978 conn(0x55ab301ff3c0 msgr2=0x55ab305b3260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:16.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.065+0000 7fd401e1e740 1 -- 172.21.15.105:0/2039682978 shutdown_connections 2024-09-21T03:25:16.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.065+0000 7fd401e1e740 1 -- 172.21.15.105:0/2039682978 wait complete. 2024-09-21T03:25:16.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.066+0000 7fd401e1e740 1 -- start start 2024-09-21T03:25:16.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.066+0000 7fd401e1e740 1 Processor -- start 2024-09-21T03:25:16.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.067+0000 7fd401e1e740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab301e23b0 0x55ab30609e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:16.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.068+0000 7fd401e1e740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ab301ea590 0x55ab305ac2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:16.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.068+0000 7fd401e1e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab3020b270 0x55ab305ac7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:16.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.068+0000 7fd401e1e740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55ab30285620 con 0x55ab301e23b0 2024-09-21T03:25:16.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.068+0000 7fd401e1e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ab304ba5f0 con 0x55ab3020b270 2024-09-21T03:25:16.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.068+0000 7fd401e1e740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55ab305dda20 con 0x55ab301ea590 2024-09-21T03:25:16.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.068+0000 7fd401e1e740 10 client.0 _ll_register_callbacks cb 0x55ab304be0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:25:16.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.068+0000 7fd3f8c52640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab301e23b0 0x55ab30609e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:16.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.068+0000 7fd3f8c52640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab301e23b0 0x55ab30609e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51558/0 (socket says 172.21.15.105:51558) 2024-09-21T03:25:16.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.068+0000 7fd3f8c52640 1 -- 172.21.15.105:0/3222511607 learned_addr learned my addr 172.21.15.105:0/3222511607 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:16.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.068+0000 7fd3f9453640 1 --2- 172.21.15.105:0/3222511607 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab3020b270 0x55ab305ac7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:16.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.068+0000 7fd3f3fff640 1 --2- 172.21.15.105:0/3222511607 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ab301ea590 0x55ab305ac2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:16.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.068+0000 7fd3f8c52640 1 -- 172.21.15.105:0/3222511607 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ab301ea590 msgr2=0x55ab305ac2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:25:16.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.068+0000 7fd3f8c52640 1 --2- 172.21.15.105:0/3222511607 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ab301ea590 0x55ab305ac2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.068+0000 7fd3f8c52640 1 -- 172.21.15.105:0/3222511607 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab3020b270 msgr2=0x55ab305ac7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:25:16.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.068+0000 7fd3f8c52640 1 --2- 172.21.15.105:0/3222511607 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab3020b270 0x55ab305ac7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.068+0000 7fd3f8c52640 1 -- 172.21.15.105:0/3222511607 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab302ed6b0 con 0x55ab301e23b0 2024-09-21T03:25:16.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.068+0000 7fd3f8c52640 1 --2- 172.21.15.105:0/3222511607 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab301e23b0 0x55ab30609e30 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fd3e40ba230 tx=0x7fd3e40840d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edcfbbf60b3efd2e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:16.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.068+0000 7fd3d37fe640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-21T03:25:16.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.068+0000 7fd3d37fe640 1 -- 172.21.15.105:0/3222511607 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e4099dd0 con 0x55ab301e23b0 2024-09-21T03:25:16.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.068+0000 7fd3d37fe640 1 -- 172.21.15.105:0/3222511607 <== mon.0 v2:172.21.15.105:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7fd3e4004b40 con 0x55ab301e23b0 2024-09-21T03:25:16.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.068+0000 7fd401e1e740 1 -- 172.21.15.105:0/3222511607 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3ec0042b0 con 0x55ab301e23b0 2024-09-21T03:25:16.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.068+0000 7fd3d37fe640 1 -- 172.21.15.105:0/3222511607 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) ==== 24+0+0 (secure 0 0 0) 0x7fd3e40841b0 con 0x55ab301e23b0 2024-09-21T03:25:16.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.068+0000 7fd401e1e740 10 client.7329 fetch_fsmap learned FSMap version 65 2024-09-21T03:25:16.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.068+0000 7fd401e1e740 1 -- 172.21.15.105:0/3222511607 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) -- 0x55ab305eeec0 con 0x55ab301e23b0 2024-09-21T03:25:16.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.069+0000 7fd3d37fe640 1 -- 172.21.15.105:0/3222511607 <== mon.0 v2:172.21.15.105:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd3ec0042b0 con 0x55ab301e23b0 2024-09-21T03:25:16.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.069+0000 7fd3d37fe640 1 -- 172.21.15.105:0/3222511607 <== mon.0 v2:172.21.15.105:3300/0 5 ==== fsmap(e 65) ==== 3502+0+0 (secure 0 0 0) 0x7fd3e407f400 con 0x55ab301e23b0 2024-09-21T03:25:16.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.069+0000 7fd401e1e740 10 client.7329 fetch_fsmap finished waiting for FSMap version 65 2024-09-21T03:25:16.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.069+0000 7fd401e1e740 10 client.7329 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T03:25:16.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.069+0000 7fd401e1e740 20 client.7329 populate_metadata read hostname 'smithi105' 2024-09-21T03:25:16.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.069+0000 7fd401e1e740 1 --2- 172.21.15.105:0/3222511607 >> [v2:172.21.15.105:6834/2917579803,v1:172.21.15.105:6835/2917579803] conn(0x55ab301c9e40 0x55ab30614950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:16.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.069+0000 7fd401e1e740 4 client.7329 mds_command: new command op to 7164 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:25:16.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.069+0000 7fd401e1e740 1 -- 172.21.15.105:0/3222511607 --> [v2:172.21.15.105:6834/2917579803,v1:172.21.15.105:6835/2917579803] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab30527770 con 0x55ab301c9e40 2024-09-21T03:25:16.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.069+0000 7fd3f3fff640 1 --2- 172.21.15.105:0/3222511607 >> [v2:172.21.15.105:6834/2917579803,v1:172.21.15.105:6835/2917579803] conn(0x55ab301c9e40 0x55ab30614950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:16.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.069+0000 7fd3d37fe640 10 client.7329 ms_handle_connect on v2:172.21.15.105:6834/2917579803 2024-09-21T03:25:16.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.069+0000 7fd3f3fff640 1 --2- 172.21.15.105:0/3222511607 >> [v2:172.21.15.105:6834/2917579803,v1:172.21.15.105:6835/2917579803] conn(0x55ab301c9e40 0x55ab30614950 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4faef75b9128ab48 server_cookie=78f54df27dcd63ea in_seq=0 out_seq=0 2024-09-21T03:25:16.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.070+0000 7fd3d37fe640 1 -- 172.21.15.105:0/3222511607 <== mds.0 v2:172.21.15.105:6834/2917579803 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ab30527770 con 0x55ab301c9e40 2024-09-21T03:25:16.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.070+0000 7fd3d37fe640 10 client.7329 handle_command_reply: tid=0 2024-09-21T03:25:16.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.070+0000 7fd401e1e740 1 client.7329 shutdown 2024-09-21T03:25:16.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.070+0000 7fd401e1e740 1 -- 172.21.15.105:0/3222511607 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab301e23b0 msgr2=0x55ab30609e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:16.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.070+0000 7fd401e1e740 1 --2- 172.21.15.105:0/3222511607 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab301e23b0 0x55ab30609e30 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fd3e40ba230 tx=0x7fd3e40840d0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.070+0000 7fd401e1e740 1 -- 172.21.15.105:0/3222511607 shutdown_connections 2024-09-21T03:25:16.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.070+0000 7fd401e1e740 1 --2- 172.21.15.105:0/3222511607 >> [v2:172.21.15.105:6834/2917579803,v1:172.21.15.105:6835/2917579803] conn(0x55ab301c9e40 0x55ab30614950 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.070+0000 7fd401e1e740 1 --2- 172.21.15.105:0/3222511607 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab3020b270 0x55ab305ac7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.070+0000 7fd401e1e740 1 --2- 172.21.15.105:0/3222511607 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ab301ea590 0x55ab305ac2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.070+0000 7fd3d37fe640 0 client.7329 ms_handle_reset on v2:172.21.15.105:6834/2917579803 2024-09-21T03:25:16.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.070+0000 7fd401e1e740 1 --2- 172.21.15.105:0/3222511607 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab301e23b0 0x55ab30609e30 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.070+0000 7fd401e1e740 1 -- 172.21.15.105:0/3222511607 >> 172.21.15.105:0/3222511607 conn(0x55ab301ff3c0 msgr2=0x55ab305b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:16.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.070+0000 7fd401e1e740 1 -- 172.21.15.105:0/3222511607 shutdown_connections 2024-09-21T03:25:16.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.070+0000 7fd401e1e740 1 -- 172.21.15.105:0/3222511607 wait complete. 2024-09-21T03:25:16.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.070+0000 7fd401e1e740 20 client.7329 trim_cache size 0 max 16384 2024-09-21T03:25:16.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.088+0000 7fd401e1e740 1 Processor -- start 2024-09-21T03:25:16.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.088+0000 7fd401e1e740 1 -- start start 2024-09-21T03:25:16.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.090+0000 7fd401e1e740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ab301e23b0 0x55ab305b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:16.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.090+0000 7fd401e1e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab301ea590 0x55ab305f1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:16.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.090+0000 7fd401e1e740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab3020b270 0x55ab306099d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:16.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.090+0000 7fd401e1e740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f41ff1b0 con 0x55ab3020b270 2024-09-21T03:25:16.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.090+0000 7fd401e1e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f40ca620 con 0x55ab301ea590 2024-09-21T03:25:16.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.090+0000 7fd401e1e740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd3f40cac70 con 0x55ab301e23b0 2024-09-21T03:25:16.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.090+0000 7fd3f9453640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab3020b270 0x55ab306099d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:16.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.090+0000 7fd3f9453640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab3020b270 0x55ab306099d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51568/0 (socket says 172.21.15.105:51568) 2024-09-21T03:25:16.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.090+0000 7fd3f9453640 1 -- 172.21.15.105:0/3378547221 learned_addr learned my addr 172.21.15.105:0/3378547221 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:16.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.090+0000 7fd3f3fff640 1 --2- 172.21.15.105:0/3378547221 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab301ea590 0x55ab305f1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:16.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.090+0000 7fd3f8c52640 1 --2- 172.21.15.105:0/3378547221 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ab301e23b0 0x55ab305b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:16.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.090+0000 7fd3f9453640 1 -- 172.21.15.105:0/3378547221 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ab301e23b0 msgr2=0x55ab305b43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:25:16.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.090+0000 7fd3f9453640 1 --2- 172.21.15.105:0/3378547221 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ab301e23b0 0x55ab305b43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.090+0000 7fd3f9453640 1 -- 172.21.15.105:0/3378547221 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab301ea590 msgr2=0x55ab305f1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:25:16.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.090+0000 7fd3f9453640 1 --2- 172.21.15.105:0/3378547221 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab301ea590 0x55ab305f1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.090+0000 7fd3f9453640 1 -- 172.21.15.105:0/3378547221 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab305ee510 con 0x55ab3020b270 2024-09-21T03:25:16.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.090+0000 7fd3f9453640 1 --2- 172.21.15.105:0/3378547221 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab3020b270 0x55ab306099d0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec006fd0 tx=0x7fd3ec0046f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24e6fe94df0d85e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:16.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.090+0000 7fd3d9ffb640 1 -- 172.21.15.105:0/3378547221 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec0043b0 con 0x55ab3020b270 2024-09-21T03:25:16.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.090+0000 7fd3d9ffb640 1 -- 172.21.15.105:0/3378547221 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd3ec023070 con 0x55ab3020b270 2024-09-21T03:25:16.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.090+0000 7fd3d9ffb640 1 -- 172.21.15.105:0/3378547221 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec00dbb0 con 0x55ab3020b270 2024-09-21T03:25:16.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.091+0000 7fd401e1e740 1 -- 172.21.15.105:0/3378547221 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab3020b270 msgr2=0x55ab306099d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:16.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.091+0000 7fd401e1e740 1 --2- 172.21.15.105:0/3378547221 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab3020b270 0x55ab306099d0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec006fd0 tx=0x7fd3ec0046f0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.091+0000 7fd401e1e740 1 -- 172.21.15.105:0/3378547221 shutdown_connections 2024-09-21T03:25:16.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.091+0000 7fd401e1e740 1 --2- 172.21.15.105:0/3378547221 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab3020b270 0x55ab306099d0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.091+0000 7fd401e1e740 1 --2- 172.21.15.105:0/3378547221 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab301ea590 0x55ab305f1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.091+0000 7fd401e1e740 1 --2- 172.21.15.105:0/3378547221 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ab301e23b0 0x55ab305b43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.091+0000 7fd401e1e740 1 -- 172.21.15.105:0/3378547221 >> 172.21.15.105:0/3378547221 conn(0x55ab301ff3c0 msgr2=0x55ab305f8540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:16.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.091+0000 7fd401e1e740 1 -- 172.21.15.105:0/3378547221 shutdown_connections 2024-09-21T03:25:16.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.091+0000 7fd401e1e740 1 -- 172.21.15.105:0/3378547221 wait complete. 2024-09-21T03:25:16.096 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.092+0000 7fd401e1e740 1 -- start start 2024-09-21T03:25:16.096 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.092+0000 7fd401e1e740 1 Processor -- start 2024-09-21T03:25:16.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.094+0000 7fd401e1e740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab301e23b0 0x55ab3066da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:16.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.094+0000 7fd401e1e740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ab301ea590 0x55ab305d9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:16.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.094+0000 7fd401e1e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab3020b270 0x55ab305d9f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:16.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.094+0000 7fd401e1e740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55ab305f83c0 con 0x55ab301e23b0 2024-09-21T03:25:16.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.094+0000 7fd401e1e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ab3060a370 con 0x55ab3020b270 2024-09-21T03:25:16.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.094+0000 7fd401e1e740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55ab3060a760 con 0x55ab301ea590 2024-09-21T03:25:16.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.094+0000 7fd401e1e740 10 client.0 _ll_register_callbacks cb 0x7fd3e4009540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:25:16.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.094+0000 7fd3f8c52640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab301e23b0 0x55ab3066da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:16.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.094+0000 7fd3f8c52640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab301e23b0 0x55ab3066da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51578/0 (socket says 172.21.15.105:51578) 2024-09-21T03:25:16.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.094+0000 7fd3f8c52640 1 -- 172.21.15.105:0/2069376424 learned_addr learned my addr 172.21.15.105:0/2069376424 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:16.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.094+0000 7fd3f9453640 1 --2- 172.21.15.105:0/2069376424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab3020b270 0x55ab305d9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:16.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.094+0000 7fd3f3fff640 1 --2- 172.21.15.105:0/2069376424 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ab301ea590 0x55ab305d9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:16.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.094+0000 7fd3f8c52640 1 -- 172.21.15.105:0/2069376424 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ab301ea590 msgr2=0x55ab305d9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:25:16.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.094+0000 7fd3f8c52640 1 --2- 172.21.15.105:0/2069376424 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ab301ea590 0x55ab305d9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.094+0000 7fd3f8c52640 1 -- 172.21.15.105:0/2069376424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab3020b270 msgr2=0x55ab305d9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:25:16.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.094+0000 7fd3f8c52640 1 --2- 172.21.15.105:0/2069376424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab3020b270 0x55ab305d9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.101 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.094+0000 7fd3f8c52640 1 -- 172.21.15.105:0/2069376424 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab305ae1f0 con 0x55ab301e23b0 2024-09-21T03:25:16.101 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.094+0000 7fd3f8c52640 1 --2- 172.21.15.105:0/2069376424 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab301e23b0 0x55ab3066da90 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4083390 tx=0x7fd3e4099de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5634d141f287c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:16.101 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.094+0000 7fd3d37fe640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-21T03:25:16.101 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.094+0000 7fd3d37fe640 1 -- 172.21.15.105:0/2069376424 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e4004820 con 0x55ab301e23b0 2024-09-21T03:25:16.101 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.094+0000 7fd3d37fe640 1 -- 172.21.15.105:0/2069376424 <== mon.0 v2:172.21.15.105:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7fd3e4004b40 con 0x55ab301e23b0 2024-09-21T03:25:16.101 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.094+0000 7fd401e1e740 1 -- 172.21.15.105:0/2069376424 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3ec023070 con 0x55ab301e23b0 2024-09-21T03:25:16.101 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.094+0000 7fd3d37fe640 1 -- 172.21.15.105:0/2069376424 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) ==== 24+0+0 (secure 0 0 0) 0x7fd3e4083ab0 con 0x55ab301e23b0 2024-09-21T03:25:16.101 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.094+0000 7fd401e1e740 10 client.7335 fetch_fsmap learned FSMap version 65 2024-09-21T03:25:16.101 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.094+0000 7fd401e1e740 1 -- 172.21.15.105:0/2069376424 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) -- 0x55ab30670dd0 con 0x55ab301e23b0 2024-09-21T03:25:16.101 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.095+0000 7fd3d37fe640 1 -- 172.21.15.105:0/2069376424 <== mon.0 v2:172.21.15.105:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd3ec023070 con 0x55ab301e23b0 2024-09-21T03:25:16.101 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.095+0000 7fd3d37fe640 1 -- 172.21.15.105:0/2069376424 <== mon.0 v2:172.21.15.105:3300/0 5 ==== fsmap(e 65) ==== 3502+0+0 (secure 0 0 0) 0x7fd3e4089720 con 0x55ab301e23b0 2024-09-21T03:25:16.101 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.095+0000 7fd401e1e740 10 client.7335 fetch_fsmap finished waiting for FSMap version 65 2024-09-21T03:25:16.101 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.095+0000 7fd401e1e740 10 client.7335 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T03:25:16.102 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.095+0000 7fd401e1e740 20 client.7335 populate_metadata read hostname 'smithi105' 2024-09-21T03:25:16.102 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.095+0000 7fd401e1e740 1 --2- 172.21.15.105:0/2069376424 >> [v2:172.21.15.105:6834/2917579803,v1:172.21.15.105:6835/2917579803] conn(0x55ab3060b6e0 0x55ab305c8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:16.102 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.095+0000 7fd401e1e740 4 client.7335 mds_command: new command op to 7164 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T03:25:16.102 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.095+0000 7fd401e1e740 1 -- 172.21.15.105:0/2069376424 --> [v2:172.21.15.105:6834/2917579803,v1:172.21.15.105:6835/2917579803] -- command(tid 0: {"prefix": "status"}) -- 0x55ab30523220 con 0x55ab3060b6e0 2024-09-21T03:25:16.102 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.095+0000 7fd3f3fff640 1 --2- 172.21.15.105:0/2069376424 >> [v2:172.21.15.105:6834/2917579803,v1:172.21.15.105:6835/2917579803] conn(0x55ab3060b6e0 0x55ab305c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:16.102 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.095+0000 7fd3d37fe640 10 client.7335 ms_handle_connect on v2:172.21.15.105:6834/2917579803 2024-09-21T03:25:16.102 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.095+0000 7fd3f3fff640 1 --2- 172.21.15.105:0/2069376424 >> [v2:172.21.15.105:6834/2917579803,v1:172.21.15.105:6835/2917579803] conn(0x55ab3060b6e0 0x55ab305c8200 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a71659bc3c63dcec server_cookie=c7a2061f9dfb40de in_seq=0 out_seq=0 2024-09-21T03:25:16.102 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.096+0000 7fd3d37fe640 1 -- 172.21.15.105:0/2069376424 <== mds.0 v2:172.21.15.105:6834/2917579803 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x55ab30523220 con 0x55ab3060b6e0 2024-09-21T03:25:16.102 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.096+0000 7fd3d37fe640 10 client.7335 handle_command_reply: tid=0 2024-09-21T03:25:16.102 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.096+0000 7fd401e1e740 1 client.7335 shutdown 2024-09-21T03:25:16.102 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.096+0000 7fd401e1e740 1 -- 172.21.15.105:0/2069376424 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab301e23b0 msgr2=0x55ab3066da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:16.102 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.096+0000 7fd401e1e740 1 --2- 172.21.15.105:0/2069376424 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab301e23b0 0x55ab3066da90 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4083390 tx=0x7fd3e4099de0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.102 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.096+0000 7fd401e1e740 1 -- 172.21.15.105:0/2069376424 shutdown_connections 2024-09-21T03:25:16.103 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.096+0000 7fd401e1e740 1 --2- 172.21.15.105:0/2069376424 >> [v2:172.21.15.105:6834/2917579803,v1:172.21.15.105:6835/2917579803] conn(0x55ab3060b6e0 0x55ab305c8200 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.103 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.096+0000 7fd401e1e740 1 --2- 172.21.15.105:0/2069376424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab3020b270 0x55ab305d9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.103 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.096+0000 7fd401e1e740 1 --2- 172.21.15.105:0/2069376424 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55ab301ea590 0x55ab305d9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.103 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.096+0000 7fd3d37fe640 0 client.7335 ms_handle_reset on v2:172.21.15.105:6834/2917579803 2024-09-21T03:25:16.103 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.096+0000 7fd401e1e740 1 --2- 172.21.15.105:0/2069376424 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55ab301e23b0 0x55ab3066da90 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.103 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.096+0000 7fd401e1e740 1 -- 172.21.15.105:0/2069376424 >> 172.21.15.105:0/2069376424 conn(0x55ab301ff3c0 msgr2=0x55ab305b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:16.103 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.096+0000 7fd401e1e740 1 -- 172.21.15.105:0/2069376424 shutdown_connections 2024-09-21T03:25:16.103 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.096+0000 7fd401e1e740 1 -- 172.21.15.105:0/2069376424 wait complete. 2024-09-21T03:25:16.103 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.096+0000 7fd401e1e740 20 client.7335 trim_cache size 0 max 16384 2024-09-21T03:25:16.103 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-21T03:25:16.104 INFO:teuthology.orchestra.run.smithi105.stdout: "cluster_fsid": "29d80f4f-e5de-4b26-8384-24c2d8019945", 2024-09-21T03:25:16.104 INFO:teuthology.orchestra.run.smithi105.stdout: "whoami": 0, 2024-09-21T03:25:16.104 INFO:teuthology.orchestra.run.smithi105.stdout: "id": 7164, 2024-09-21T03:25:16.104 INFO:teuthology.orchestra.run.smithi105.stdout: "want_state": "up:active", 2024-09-21T03:25:16.104 INFO:teuthology.orchestra.run.smithi105.stdout: "state": "up:active", 2024-09-21T03:25:16.104 INFO:teuthology.orchestra.run.smithi105.stdout: "fs_name": "cephfs", 2024-09-21T03:25:16.104 INFO:teuthology.orchestra.run.smithi105.stdout: "rank_uptime": 9.1616227529999996, 2024-09-21T03:25:16.104 INFO:teuthology.orchestra.run.smithi105.stdout: "mdsmap_epoch": 65, 2024-09-21T03:25:16.104 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_epoch": 104, 2024-09-21T03:25:16.104 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_epoch_barrier": 104, 2024-09-21T03:25:16.104 INFO:teuthology.orchestra.run.smithi105.stdout: "uptime": 13.854594172000001 2024-09-21T03:25:16.104 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-21T03:25:16.105 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.096+0000 7fd3faeb6640 1 -- 172.21.15.105:0/3363769361 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd3e0078bc0 msgr2=0x7fd3e007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:16.105 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.096+0000 7fd3faeb6640 1 --2- 172.21.15.105:0/3363769361 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd3e0078bc0 0x7fd3e007b0d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd3f415bb50 tx=0x7fd3e8009040 comp rx=0 tx=0).stop 2024-09-21T03:25:16.105 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.096+0000 7fd3faeb6640 1 -- 172.21.15.105:0/3363769361 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3f40b51c0 msgr2=0x7fd3f41e9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:16.105 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.096+0000 7fd3faeb6640 1 --2- 172.21.15.105:0/3363769361 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3f40b51c0 0x7fd3f41e9730 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4000f80 tx=0x7fd3e4003f10 comp rx=0 tx=0).stop 2024-09-21T03:25:16.105 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.097+0000 7fd3faeb6640 1 -- 172.21.15.105:0/3363769361 shutdown_connections 2024-09-21T03:25:16.106 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.097+0000 7fd3faeb6640 1 --2- 172.21.15.105:0/3363769361 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd3e0078bc0 0x7fd3e007b0d0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.106 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.097+0000 7fd3faeb6640 1 --2- 172.21.15.105:0/3363769361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3f40d1490 0x7fd3f40c7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.106 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.097+0000 7fd3faeb6640 1 --2- 172.21.15.105:0/3363769361 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd3f40ccbd0 0x7fd3f415a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.106 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.097+0000 7fd3faeb6640 1 --2- 172.21.15.105:0/3363769361 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3f40b51c0 0x7fd3f41e9730 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.106 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.097+0000 7fd3faeb6640 1 -- 172.21.15.105:0/3363769361 >> 172.21.15.105:0/3363769361 conn(0x7fd3f4072ae0 msgr2=0x7fd3f415f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:16.106 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.097+0000 7fd3faeb6640 1 -- 172.21.15.105:0/3363769361 shutdown_connections 2024-09-21T03:25:16.106 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.097+0000 7fd3faeb6640 1 -- 172.21.15.105:0/3363769361 wait complete. 2024-09-21T03:25:16.109 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T03:25:16.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.220+0000 7f5f8a9c6640 1 -- 172.21.15.105:0/656573731 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5f6c004800 msgr2=0x7f5f6c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:16.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.220+0000 7f5f8a9c6640 1 --2- 172.21.15.105:0/656573731 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5f6c004800 0x7f5f6c004c10 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f5f7800bb50 tx=0x7f5f6c005830 comp rx=0 tx=0).stop 2024-09-21T03:25:16.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.220+0000 7f5f88f63640 1 -- 172.21.15.105:0/656573731 reap_dead start 2024-09-21T03:25:16.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.220+0000 7f5f8a9c6640 1 -- 172.21.15.105:0/656573731 shutdown_connections 2024-09-21T03:25:16.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.220+0000 7f5f8a9c6640 1 -- 172.21.15.105:0/656573731 >> 172.21.15.105:0/656573731 conn(0x7f5f8406def0 msgr2=0x7f5f8406e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:16.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.220+0000 7f5f8a9c6640 1 -- 172.21.15.105:0/656573731 shutdown_connections 2024-09-21T03:25:16.223 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.220+0000 7f5f8a9c6640 1 -- 172.21.15.105:0/656573731 wait complete. 2024-09-21T03:25:16.223 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.222+0000 7f5f8a9c6640 1 Processor -- start 2024-09-21T03:25:16.223 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.222+0000 7f5f8a9c6640 1 -- start start 2024-09-21T03:25:16.226 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.223+0000 7f5f8a9c6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f6c004800 0x7f5f84150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:16.227 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.223+0000 7f5f8a9c6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5f84156bb0 0x7f5f840b2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:16.227 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.223+0000 7f5f8a9c6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f840b2790 0x7f5f841f3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:16.227 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.223+0000 7f5f8a9c6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5f84070b00 con 0x7f5f84156bb0 2024-09-21T03:25:16.227 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.223+0000 7f5f8a9c6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5f84070980 con 0x7f5f840b2790 2024-09-21T03:25:16.227 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.223+0000 7f5f8a9c6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5f84070c80 con 0x7f5f6c004800 2024-09-21T03:25:16.227 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.223+0000 7f5f837fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5f84156bb0 0x7f5f840b2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:16.227 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.223+0000 7f5f837fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5f84156bb0 0x7f5f840b2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51602/0 (socket says 172.21.15.105:51602) 2024-09-21T03:25:16.227 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.223+0000 7f5f837fe640 1 -- 172.21.15.105:0/2770756652 learned_addr learned my addr 172.21.15.105:0/2770756652 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:16.227 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.223+0000 7f5f83fff640 1 --2- 172.21.15.105:0/2770756652 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f6c004800 0x7f5f84150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:16.227 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.223+0000 7f5f88f63640 1 --2- 172.21.15.105:0/2770756652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f840b2790 0x7f5f841f3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:16.227 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.224+0000 7f5f837fe640 1 -- 172.21.15.105:0/2770756652 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f6c004800 msgr2=0x7f5f84150d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:16.228 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.224+0000 7f5f837fe640 1 --2- 172.21.15.105:0/2770756652 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f6c004800 0x7f5f84150d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.228 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.224+0000 7f5f837fe640 1 -- 172.21.15.105:0/2770756652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f840b2790 msgr2=0x7f5f841f3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:16.228 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.224+0000 7f5f837fe640 1 --2- 172.21.15.105:0/2770756652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f840b2790 0x7f5f841f3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.228 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.224+0000 7f5f837fe640 1 -- 172.21.15.105:0/2770756652 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f841563e0 con 0x7f5f84156bb0 2024-09-21T03:25:16.228 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.224+0000 7f5f837fe640 1 --2- 172.21.15.105:0/2770756652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5f84156bb0 0x7f5f840b2250 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f5f7800baf0 tx=0x7f5f780058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:16.228 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.224+0000 7f5f80ff9640 1 -- 172.21.15.105:0/2770756652 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7804a070 con 0x7f5f84156bb0 2024-09-21T03:25:16.228 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.224+0000 7f5f80ff9640 1 -- 172.21.15.105:0/2770756652 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f7803b8b0 con 0x7f5f84156bb0 2024-09-21T03:25:16.228 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.224+0000 7f5f80ff9640 1 -- 172.21.15.105:0/2770756652 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f78035040 con 0x7f5f84156bb0 2024-09-21T03:25:16.228 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.224+0000 7f5f8a9c6640 1 -- 172.21.15.105:0/2770756652 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f840b2ba0 con 0x7f5f84156bb0 2024-09-21T03:25:16.228 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.224+0000 7f5f8a9c6640 1 -- 172.21.15.105:0/2770756652 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f8415b010 con 0x7f5f84156bb0 2024-09-21T03:25:16.228 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.225+0000 7f5f8a9c6640 1 -- 172.21.15.105:0/2770756652 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f8406fe30 con 0x7f5f84156bb0 2024-09-21T03:25:16.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.226+0000 7f5f80ff9640 1 -- 172.21.15.105:0/2770756652 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5f7804d070 con 0x7f5f84156bb0 2024-09-21T03:25:16.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.226+0000 7f5f80ff9640 1 --2- 172.21.15.105:0/2770756652 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5f70078bc0 0x7f5f7007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:16.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.226+0000 7f5f80ff9640 1 -- 172.21.15.105:0/2770756652 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f5f780bdb70 con 0x7f5f84156bb0 2024-09-21T03:25:16.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.226+0000 7f5f83fff640 1 --2- 172.21.15.105:0/2770756652 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5f70078bc0 0x7f5f7007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:16.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.227+0000 7f5f83fff640 1 --2- 172.21.15.105:0/2770756652 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5f70078bc0 0x7f5f7007b0d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f5f74006bf0 tx=0x7f5f740067a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:16.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.231+0000 7f5f80ff9640 1 -- 172.21.15.105:0/2770756652 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5f840b2ba0 con 0x7f5f84156bb0 2024-09-21T03:25:16.445 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.443+0000 7f5f8a9c6640 1 -- 172.21.15.105:0/2770756652 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5f840d0dd0 con 0x7f5f84156bb0 2024-09-21T03:25:16.445 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.443+0000 7f5f80ff9640 1 -- 172.21.15.105:0/2770756652 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v65) ==== 53+0+73 (secure 0 0 0) 0x7f5f841563e0 con 0x7f5f84156bb0 2024-09-21T03:25:16.445 INFO:teuthology.orchestra.run.smithi105.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T03:25:16.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.445+0000 7f5f8a9c6640 1 -- 172.21.15.105:0/2770756652 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5f70078bc0 msgr2=0x7f5f7007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:16.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.446+0000 7f5f8a9c6640 1 --2- 172.21.15.105:0/2770756652 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5f70078bc0 0x7f5f7007b0d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f5f74006bf0 tx=0x7f5f740067a0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.446+0000 7f5f8a9c6640 1 -- 172.21.15.105:0/2770756652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5f84156bb0 msgr2=0x7f5f840b2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:16.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.446+0000 7f5f8a9c6640 1 --2- 172.21.15.105:0/2770756652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5f84156bb0 0x7f5f840b2250 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f5f7800baf0 tx=0x7f5f780058d0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.446+0000 7f5f8a9c6640 1 -- 172.21.15.105:0/2770756652 shutdown_connections 2024-09-21T03:25:16.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.446+0000 7f5f8a9c6640 1 --2- 172.21.15.105:0/2770756652 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5f70078bc0 0x7f5f7007b0d0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.446+0000 7f5f8a9c6640 1 --2- 172.21.15.105:0/2770756652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f840b2790 0x7f5f841f3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.446+0000 7f5f8a9c6640 1 --2- 172.21.15.105:0/2770756652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5f84156bb0 0x7f5f840b2250 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.446+0000 7f5f8a9c6640 1 --2- 172.21.15.105:0/2770756652 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f6c004800 0x7f5f84150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.446+0000 7f5f8a9c6640 1 -- 172.21.15.105:0/2770756652 >> 172.21.15.105:0/2770756652 conn(0x7f5f8406def0 msgr2=0x7f5f84153cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:16.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.446+0000 7f5f8a9c6640 1 -- 172.21.15.105:0/2770756652 shutdown_connections 2024-09-21T03:25:16.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16.446+0000 7f5f8a9c6640 1 -- 172.21.15.105:0/2770756652 wait complete. 2024-09-21T03:25:16.459 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T03:25:16.459 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T03:25:16.459 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi105.front.sepia.ceph.com 2024-09-21T03:25:16.459 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T03:25:16.459 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T03:25:16.459 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T03:25:16.459 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T03:25:16.459 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T03:25:16.459 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:25:16.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:25:16.460 DEBUG:teuthology.orchestra.run.smithi105:> ip addr 2024-09-21T03:25:16.475 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T03:25:16.476 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T03:25:16.476 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T03:25:16.476 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:25:16.476 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2024-09-21T03:25:16.476 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:25:16.476 INFO:teuthology.orchestra.run.smithi105.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:25:16.476 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b8 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:25:16.476 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f0 2024-09-21T03:25:16.476 INFO:teuthology.orchestra.run.smithi105.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:25:16.476 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b9 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:25:16.476 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f1 2024-09-21T03:25:16.476 INFO:teuthology.orchestra.run.smithi105.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:25:16.476 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:28 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:25:16.476 INFO:teuthology.orchestra.run.smithi105.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T03:25:16.477 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:29 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:25:16.477 INFO:teuthology.orchestra.run.smithi105.stdout: inet 172.21.15.105/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T03:25:16.477 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft 42391sec preferred_lft 42391sec 2024-09-21T03:25:16.477 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::ec4:7aff:fe8f:d429/64 scope link noprefixroute 2024-09-21T03:25:16.477 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:25:16.477 INFO:teuthology.orchestra.run.smithi105.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T03:25:16.477 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 86:15:ed:f2:4e:d8 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:25:16.477 INFO:teuthology.orchestra.run.smithi105.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T03:25:16.477 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:25:16.477 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::80db:6aff:fece:44c2/64 scope link 2024-09-21T03:25:16.477 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:25:16.477 INFO:teuthology.orchestra.run.smithi105.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:25:16.477 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 86:15:ed:f2:4e:d8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T03:25:16.477 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::8415:edff:fef2:4ed8/64 scope link 2024-09-21T03:25:16.477 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:25:16.478 INFO:teuthology.orchestra.run.smithi105.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:25:16.478 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether a2:e9:7c:d4:c7:c7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T03:25:16.478 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::a0e9:7cff:fed4:c7c7/64 scope link 2024-09-21T03:25:16.478 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:25:16.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:25:16.478 DEBUG:teuthology.orchestra.run.smithi105:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T03:25:16.539 INFO:teuthology.orchestra.run.smithi105.stdout:1 2024-09-21T03:25:16.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:25:16.541 DEBUG:teuthology.orchestra.run.smithi105:> route 2024-09-21T03:25:16.597 INFO:teuthology.orchestra.run.smithi105.stdout:Kernel IP routing table 2024-09-21T03:25:16.597 INFO:teuthology.orchestra.run.smithi105.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T03:25:16.597 INFO:teuthology.orchestra.run.smithi105.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T03:25:16.597 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T03:25:16.597 INFO:teuthology.orchestra.run.smithi105.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T03:25:16.598 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:25:16.598 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-21T03:25:16.598 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T03:25:16.598 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T03:25:16.598 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T03:25:16.598 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-21T03:25:16.685 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:25:16.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:25:16.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:25:16.723 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-09-21T03:25:16.739 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T03:25:16.739 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T03:25:16.739 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:25:16.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:25:16.739 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set brx.0 up 2024-09-21T03:25:16.804 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:25:16.804 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T03:25:16.859 INFO:teuthology.orchestra.run.smithi105.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:25:16.860 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:25:16.860 DEBUG:teuthology.orchestra.run.smithi105:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T03:25:16.914 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-21T03:25:16.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:25:16.914 DEBUG:teuthology.orchestra.run.smithi105:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:25:17.008 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:25:17.008 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T03:25:17.008 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2024-09-21T03:25:17.019 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:25:17.019 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T03:25:17.019 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2024-09-21T03:25:17.019 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:25:17.019 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:25:17.025 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:25:17.025 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T03:25:17.025 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2024-09-21T03:25:17.025 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:25:17.025 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:25:17.025 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-21T03:25:17.025 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-21T03:25:17.025 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=29d80f4f-e5de-4b26-8384-24c2d8019945" will pass to kernel 2024-09-21T03:25:17.026 INFO:teuthology.orchestra.run.smithi105.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T03:25:17.026 INFO:teuthology.orchestra.run.smithi105.stdout: You just mounted a file system that supports labels which does not 2024-09-21T03:25:17.026 INFO:teuthology.orchestra.run.smithi105.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T03:25:17.026 INFO:teuthology.orchestra.run.smithi105.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T03:25:17.026 INFO:teuthology.orchestra.run.smithi105.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T03:25:17.027 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T03:25:17.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:25:17.027 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T03:25:17.052 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:25:17.142 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:25:17.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:25:17.153 INFO:teuthology.orchestra.run.smithi105.stdout:client6098 2024-09-21T03:25:17.153 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:25:17.153 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:25:17.169 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T03:25:17.323 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.321+0000 7f462f027640 1 -- 172.21.15.105:0/3293948595 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4610004800 msgr2=0x7f4610004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:17.323 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.321+0000 7f462f027640 1 --2- 172.21.15.105:0/3293948595 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4610004800 0x7f4610004c10 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f4618009b50 tx=0x7f4610005830 comp rx=0 tx=0).stop 2024-09-21T03:25:17.324 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.321+0000 7f462d5c4640 1 -- 172.21.15.105:0/3293948595 reap_dead start 2024-09-21T03:25:17.324 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.321+0000 7f462f027640 1 -- 172.21.15.105:0/3293948595 shutdown_connections 2024-09-21T03:25:17.324 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.321+0000 7f462f027640 1 -- 172.21.15.105:0/3293948595 >> 172.21.15.105:0/3293948595 conn(0x7f46280d15f0 msgr2=0x7f4628073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:17.324 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.321+0000 7f462f027640 1 -- 172.21.15.105:0/3293948595 shutdown_connections 2024-09-21T03:25:17.324 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.321+0000 7f462f027640 1 -- 172.21.15.105:0/3293948595 wait complete. 2024-09-21T03:25:17.324 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.323+0000 7f462f027640 1 Processor -- start 2024-09-21T03:25:17.324 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.323+0000 7f462f027640 1 -- start start 2024-09-21T03:25:17.327 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.324+0000 7f462f027640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4610004800 0x7f46281f9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:17.327 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.324+0000 7f462f027640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46281f6090 0x7f46280b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:17.327 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.324+0000 7f462f027640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46281f8d70 0x7f46281f9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:17.327 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.324+0000 7f462f027640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f46280d0780 con 0x7f4610004800 2024-09-21T03:25:17.327 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.324+0000 7f462f027640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4628073e50 con 0x7f46281f6090 2024-09-21T03:25:17.327 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.324+0000 7f462f027640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f46281f6790 con 0x7f46281f8d70 2024-09-21T03:25:17.328 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.324+0000 7f462cdc3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4610004800 0x7f46281f9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:17.328 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.324+0000 7f462cdc3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4610004800 0x7f46281f9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51628/0 (socket says 172.21.15.105:51628) 2024-09-21T03:25:17.328 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.324+0000 7f462cdc3640 1 -- 172.21.15.105:0/755029812 learned_addr learned my addr 172.21.15.105:0/755029812 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:17.328 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.325+0000 7f461ffff640 1 --2- 172.21.15.105:0/755029812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46281f6090 0x7f46280b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:17.328 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.325+0000 7f462d5c4640 1 --2- 172.21.15.105:0/755029812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46281f8d70 0x7f46281f9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:17.328 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.325+0000 7f462cdc3640 1 -- 172.21.15.105:0/755029812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46281f8d70 msgr2=0x7f46281f9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:17.328 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.325+0000 7f462cdc3640 1 --2- 172.21.15.105:0/755029812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46281f8d70 0x7f46281f9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:17.328 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.325+0000 7f462cdc3640 1 -- 172.21.15.105:0/755029812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46281f6090 msgr2=0x7f46280b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:17.328 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.325+0000 7f462cdc3640 1 --2- 172.21.15.105:0/755029812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46281f6090 0x7f46280b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:17.328 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.325+0000 7f462cdc3640 1 -- 172.21.15.105:0/755029812 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46281f96c0 con 0x7f4610004800 2024-09-21T03:25:17.328 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.325+0000 7f461ffff640 1 --2- 172.21.15.105:0/755029812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46281f6090 0x7f46280b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:25:17.328 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.325+0000 7f462cdc3640 1 --2- 172.21.15.105:0/755029812 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4610004800 0x7f46281f9910 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f4624001eb0 tx=0x7f462400ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:17.328 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.325+0000 7f461d7fa640 1 -- 172.21.15.105:0/755029812 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4624015070 con 0x7f4610004800 2024-09-21T03:25:17.328 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.325+0000 7f461d7fa640 1 -- 172.21.15.105:0/755029812 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f462400ca60 con 0x7f4610004800 2024-09-21T03:25:17.329 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.325+0000 7f462f027640 1 -- 172.21.15.105:0/755029812 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46280cca50 con 0x7f4610004800 2024-09-21T03:25:17.329 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.325+0000 7f461d7fa640 1 -- 172.21.15.105:0/755029812 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4624011460 con 0x7f4610004800 2024-09-21T03:25:17.329 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.325+0000 7f462f027640 1 -- 172.21.15.105:0/755029812 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46280cd010 con 0x7f4610004800 2024-09-21T03:25:17.329 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.326+0000 7f462f027640 1 -- 172.21.15.105:0/755029812 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46280743e0 con 0x7f4610004800 2024-09-21T03:25:17.329 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.327+0000 7f461d7fa640 1 -- 172.21.15.105:0/755029812 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4624018070 con 0x7f4610004800 2024-09-21T03:25:17.330 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.327+0000 7f461d7fa640 1 --2- 172.21.15.105:0/755029812 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4614078bc0 0x7f461407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:17.330 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.328+0000 7f461d7fa640 1 -- 172.21.15.105:0/755029812 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f462409b1f0 con 0x7f4610004800 2024-09-21T03:25:17.330 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.328+0000 7f461ffff640 1 --2- 172.21.15.105:0/755029812 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4614078bc0 0x7f461407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:17.330 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.328+0000 7f461ffff640 1 --2- 172.21.15.105:0/755029812 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4614078bc0 0x7f461407b0d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4618035000 tx=0x7f461802d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:17.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.332+0000 7f461d7fa640 1 -- 172.21.15.105:0/755029812 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f46281f96c0 con 0x7f4610004800 2024-09-21T03:25:17.548 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.547+0000 7f462f027640 1 -- 172.21.15.105:0/755029812 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f46281f64a0 con 0x7f4610004800 2024-09-21T03:25:17.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.547+0000 7f461d7fa640 1 -- 172.21.15.105:0/755029812 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v65) ==== 53+0+73 (secure 0 0 0) 0x7f4624063640 con 0x7f4610004800 2024-09-21T03:25:17.549 INFO:teuthology.orchestra.run.smithi105.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T03:25:17.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.549+0000 7f462f027640 1 -- 172.21.15.105:0/755029812 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4614078bc0 msgr2=0x7f461407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:17.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.549+0000 7f462f027640 1 --2- 172.21.15.105:0/755029812 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4614078bc0 0x7f461407b0d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4618035000 tx=0x7f461802d040 comp rx=0 tx=0).stop 2024-09-21T03:25:17.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.549+0000 7f462f027640 1 -- 172.21.15.105:0/755029812 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4610004800 msgr2=0x7f46281f9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:17.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.549+0000 7f462f027640 1 --2- 172.21.15.105:0/755029812 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4610004800 0x7f46281f9910 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f4624001eb0 tx=0x7f462400ea90 comp rx=0 tx=0).stop 2024-09-21T03:25:17.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.549+0000 7f462f027640 1 -- 172.21.15.105:0/755029812 shutdown_connections 2024-09-21T03:25:17.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.549+0000 7f462f027640 1 --2- 172.21.15.105:0/755029812 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4614078bc0 0x7f461407b0d0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:17.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.549+0000 7f462f027640 1 --2- 172.21.15.105:0/755029812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46281f8d70 0x7f46281f9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:17.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.549+0000 7f462f027640 1 --2- 172.21.15.105:0/755029812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46281f6090 0x7f46280b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:17.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.549+0000 7f462f027640 1 --2- 172.21.15.105:0/755029812 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4610004800 0x7f46281f9910 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:17.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.549+0000 7f462f027640 1 -- 172.21.15.105:0/755029812 >> 172.21.15.105:0/755029812 conn(0x7f46280d15f0 msgr2=0x7f46280b3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:17.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.549+0000 7f462f027640 1 -- 172.21.15.105:0/755029812 shutdown_connections 2024-09-21T03:25:17.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:17.549+0000 7f462f027640 1 -- 172.21.15.105:0/755029812 wait complete. 2024-09-21T03:25:17.562 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T03:25:17.562 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T03:25:17.562 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2024-09-21T03:25:17.562 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-21T03:25:17.562 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T03:25:17.562 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T03:25:17.562 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T03:25:17.562 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T03:25:17.563 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T03:25:17.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:25:17.563 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2024-09-21T03:25:17.583 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T03:25:17.583 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T03:25:17.583 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T03:25:17.583 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:25:17.583 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-09-21T03:25:17.583 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:25:17.583 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:25:17.583 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:25:17.583 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f0 2024-09-21T03:25:17.583 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:25:17.583 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:25:17.583 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f1 2024-09-21T03:25:17.584 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:25:17.584 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:25:17.584 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T03:25:17.584 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:25:17.584 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T03:25:17.584 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42383sec preferred_lft 42383sec 2024-09-21T03:25:17.584 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::ec4:7aff:fe88:7f41/64 scope link noprefixroute 2024-09-21T03:25:17.584 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:25:17.584 INFO:teuthology.orchestra.run.smithi162.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T03:25:17.584 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 32:ad:10:1b:86:54 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:25:17.584 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T03:25:17.584 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:25:17.584 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::c03a:6bff:febf:f5a9/64 scope link 2024-09-21T03:25:17.584 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:25:17.584 INFO:teuthology.orchestra.run.smithi162.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:25:17.585 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 32:ad:10:1b:86:54 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T03:25:17.585 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::30ad:10ff:fe1b:8654/64 scope link 2024-09-21T03:25:17.585 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:25:17.585 INFO:teuthology.orchestra.run.smithi162.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:25:17.585 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 6a:62:2d:53:ae:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-21T03:25:17.585 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::6862:2dff:fe53:aec0/64 scope link 2024-09-21T03:25:17.585 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:25:17.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:25:17.585 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T03:25:17.652 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-09-21T03:25:17.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:25:17.654 DEBUG:teuthology.orchestra.run.smithi162:> route 2024-09-21T03:25:17.713 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2024-09-21T03:25:17.713 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T03:25:17.713 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T03:25:17.713 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T03:25:17.713 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T03:25:17.713 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:25:17.713 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-09-21T03:25:17.713 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T03:25:17.714 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T03:25:17.714 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T03:25:17.714 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-09-21T03:25:17.806 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:25:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:25:17.840 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:25:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:25:17.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:25:17.846 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-09-21T03:25:17.862 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-21T03:25:17.862 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-21T03:25:17.862 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T03:25:17.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:25:17.862 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.0 up 2024-09-21T03:25:17.927 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:25:17.927 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-21T03:25:17.984 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-21T03:25:17.984 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:25:17.985 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-21T03:25:18.039 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-21T03:25:18.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:25:18.040 DEBUG:teuthology.orchestra.run.smithi162:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:25:18.134 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:25:18.134 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T03:25:18.134 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-21T03:25:18.145 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:25:18.145 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T03:25:18.145 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-21T03:25:18.145 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:25:18.145 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:25:18.151 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:25:18.151 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T03:25:18.151 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-21T03:25:18.151 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:25:18.151 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:25:18.151 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-21T03:25:18.151 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-21T03:25:18.151 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=29d80f4f-e5de-4b26-8384-24c2d8019945" will pass to kernel 2024-09-21T03:25:18.152 INFO:teuthology.orchestra.run.smithi162.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-21T03:25:18.152 INFO:teuthology.orchestra.run.smithi162.stdout: You just mounted a file system that supports labels which does not 2024-09-21T03:25:18.152 INFO:teuthology.orchestra.run.smithi162.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T03:25:18.152 INFO:teuthology.orchestra.run.smithi162.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T03:25:18.152 INFO:teuthology.orchestra.run.smithi162.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T03:25:18.153 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T03:25:18.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:25:18.154 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-21T03:25:18.178 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:25:18.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:25:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:25:18.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:25:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:25:18.275 INFO:teuthology.orchestra.run.smithi162.stdout:client7350 2024-09-21T03:25:18.275 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:25:18.275 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:25:18.291 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_cache_memory_limit 1K 2024-09-21T03:25:18.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.419+0000 7f96081ba640 1 -- 172.21.15.105:0/3830949755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96000d0240 msgr2=0x7f96000cdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:18.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.419+0000 7f96081ba640 1 --2- 172.21.15.105:0/3830949755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96000d0240 0x7f96000cdc10 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f96000cfd80 tx=0x7f95fc02a4d0 comp rx=0 tx=0).stop 2024-09-21T03:25:18.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.419+0000 7f96081ba640 1 -- 172.21.15.105:0/3830949755 shutdown_connections 2024-09-21T03:25:18.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.419+0000 7f96081ba640 1 --2- 172.21.15.105:0/3830949755 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f960015d0d0 0x7f960015d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:18.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.419+0000 7f96081ba640 1 --2- 172.21.15.105:0/3830949755 >> v2:172.21.15.162:3300/0 conn(0x7f960006cde0 0x7f960006d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:18.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.419+0000 7f96081ba640 1 --2- 172.21.15.105:0/3830949755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96000d0240 0x7f96000cdc10 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:18.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.419+0000 7f96081ba640 1 -- 172.21.15.105:0/3830949755 >> 172.21.15.105:0/3830949755 conn(0x7f960006def0 msgr2=0x7f960006e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:18.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.419+0000 7f96081ba640 1 -- 172.21.15.105:0/3830949755 shutdown_connections 2024-09-21T03:25:18.422 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.419+0000 7f96081ba640 1 -- 172.21.15.105:0/3830949755 wait complete. 2024-09-21T03:25:18.422 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.421+0000 7f96081ba640 1 Processor -- start 2024-09-21T03:25:18.422 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.421+0000 7f96081ba640 1 -- start start 2024-09-21T03:25:18.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.422+0000 7f96081ba640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f960006cde0 0x7f9600159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:18.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.422+0000 7f96081ba640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96000d0240 0x7f96001f57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:18.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.422+0000 7f96081ba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f960015d0d0 0x7f96001f5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:18.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.422+0000 7f96081ba640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f96001605d0 con 0x7f960006cde0 2024-09-21T03:25:18.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.422+0000 7f96081ba640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9600160450 con 0x7f960015d0d0 2024-09-21T03:25:18.426 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.422+0000 7f96081ba640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9600160750 con 0x7f96000d0240 2024-09-21T03:25:18.426 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.422+0000 7f9605f56640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f960006cde0 0x7f9600159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:18.426 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.422+0000 7f9605f56640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f960006cde0 0x7f9600159d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51648/0 (socket says 172.21.15.105:51648) 2024-09-21T03:25:18.426 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.422+0000 7f9605f56640 1 -- 172.21.15.105:0/1300685266 learned_addr learned my addr 172.21.15.105:0/1300685266 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:18.426 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.422+0000 7f9605755640 1 --2- 172.21.15.105:0/1300685266 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96000d0240 0x7f96001f57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:18.426 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.422+0000 7f9606757640 1 --2- 172.21.15.105:0/1300685266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f960015d0d0 0x7f96001f5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:18.426 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.423+0000 7f9605f56640 1 -- 172.21.15.105:0/1300685266 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96000d0240 msgr2=0x7f96001f57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:18.426 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.423+0000 7f9605f56640 1 --2- 172.21.15.105:0/1300685266 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96000d0240 0x7f96001f57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:18.426 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.423+0000 7f9605f56640 1 -- 172.21.15.105:0/1300685266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f960015d0d0 msgr2=0x7f96001f5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:18.426 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.423+0000 7f9605f56640 1 --2- 172.21.15.105:0/1300685266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f960015d0d0 0x7f96001f5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:18.426 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.423+0000 7f9605f56640 1 -- 172.21.15.105:0/1300685266 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9600146950 con 0x7f960006cde0 2024-09-21T03:25:18.426 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.423+0000 7f9605f56640 1 --2- 172.21.15.105:0/1300685266 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f960006cde0 0x7f9600159d80 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f95fc034040 tx=0x7f95fc0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:18.426 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.423+0000 7f95f67fc640 1 -- 172.21.15.105:0/1300685266 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc03e030 con 0x7f960006cde0 2024-09-21T03:25:18.427 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.423+0000 7f95f67fc640 1 -- 172.21.15.105:0/1300685266 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95fc0047a0 con 0x7f960006cde0 2024-09-21T03:25:18.427 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.423+0000 7f96081ba640 1 -- 172.21.15.105:0/1300685266 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96001f6590 con 0x7f960006cde0 2024-09-21T03:25:18.427 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.423+0000 7f95f67fc640 1 -- 172.21.15.105:0/1300685266 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc035040 con 0x7f960006cde0 2024-09-21T03:25:18.427 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.423+0000 7f96081ba640 1 -- 172.21.15.105:0/1300685266 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9600155260 con 0x7f960006cde0 2024-09-21T03:25:18.427 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.424+0000 7f96081ba640 1 -- 172.21.15.105:0/1300685266 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f960015fe40 con 0x7f960006cde0 2024-09-21T03:25:18.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.425+0000 7f95f67fc640 1 -- 172.21.15.105:0/1300685266 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f95fc041030 con 0x7f960006cde0 2024-09-21T03:25:18.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.425+0000 7f95f67fc640 1 --2- 172.21.15.105:0/1300685266 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f95e4078b90 0x7f95e407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:18.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.426+0000 7f95f67fc640 1 -- 172.21.15.105:0/1300685266 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f95fc0bb8a0 con 0x7f960006cde0 2024-09-21T03:25:18.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.426+0000 7f9605755640 1 --2- 172.21.15.105:0/1300685266 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f95e4078b90 0x7f95e407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:18.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.426+0000 7f9605755640 1 --2- 172.21.15.105:0/1300685266 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f95e4078b90 0x7f95e407b0a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f96000b5240 tx=0x7f95f000a2d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:18.430 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.429+0000 7f95f67fc640 1 -- 172.21.15.105:0/1300685266 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f95fc083800 con 0x7f960006cde0 2024-09-21T03:25:18.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.608+0000 7f96081ba640 1 -- 172.21.15.105:0/1300685266 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command([{prefix=config set, name=mds_cache_memory_limit}] v 0) -- 0x7f96000b4590 con 0x7f960006cde0 2024-09-21T03:25:18.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.612+0000 7f95f67fc640 1 -- 172.21.15.105:0/1300685266 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_cache_memory_limit}]=0 v52)=0 v52) ==== 121+0+0 (secure 0 0 0) 0x7f95fc088230 con 0x7f960006cde0 2024-09-21T03:25:18.616 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.615+0000 7f96081ba640 1 -- 172.21.15.105:0/1300685266 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f95e4078b90 msgr2=0x7f95e407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:18.617 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.615+0000 7f96081ba640 1 --2- 172.21.15.105:0/1300685266 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f95e4078b90 0x7f95e407b0a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f96000b5240 tx=0x7f95f000a2d0 comp rx=0 tx=0).stop 2024-09-21T03:25:18.617 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.615+0000 7f96081ba640 1 -- 172.21.15.105:0/1300685266 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f960006cde0 msgr2=0x7f9600159d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:18.617 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.615+0000 7f96081ba640 1 --2- 172.21.15.105:0/1300685266 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f960006cde0 0x7f9600159d80 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f95fc034040 tx=0x7f95fc0039e0 comp rx=0 tx=0).stop 2024-09-21T03:25:18.617 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.615+0000 7f96081ba640 1 -- 172.21.15.105:0/1300685266 shutdown_connections 2024-09-21T03:25:18.617 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.615+0000 7f96081ba640 1 --2- 172.21.15.105:0/1300685266 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f95e4078b90 0x7f95e407b0a0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:18.617 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.615+0000 7f96081ba640 1 --2- 172.21.15.105:0/1300685266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f960015d0d0 0x7f96001f5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:18.617 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.615+0000 7f96081ba640 1 --2- 172.21.15.105:0/1300685266 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96000d0240 0x7f96001f57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:18.617 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.615+0000 7f96081ba640 1 --2- 172.21.15.105:0/1300685266 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f960006cde0 0x7f9600159d80 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:18.617 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.615+0000 7f96081ba640 1 -- 172.21.15.105:0/1300685266 >> 172.21.15.105:0/1300685266 conn(0x7f960006def0 msgr2=0x7f96000ccda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:18.617 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.615+0000 7f96081ba640 1 -- 172.21.15.105:0/1300685266 shutdown_connections 2024-09-21T03:25:18.617 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.615+0000 7f96081ba640 1 -- 172.21.15.105:0/1300685266 wait complete. 2024-09-21T03:25:18.628 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_recall_max_caps 400 2024-09-21T03:25:18.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.742+0000 7fca301da640 1 -- 172.21.15.105:0/1348374119 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca14005250 msgr2=0x7fca1400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:18.745 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.742+0000 7fca301da640 1 --2- 172.21.15.105:0/1348374119 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca14005250 0x7fca1400b9c0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fca280c3c20 tx=0x7fca14005830 comp rx=0 tx=0).stop 2024-09-21T03:25:18.745 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.743+0000 7fca301da640 1 -- 172.21.15.105:0/1348374119 shutdown_connections 2024-09-21T03:25:18.745 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.743+0000 7fca301da640 1 --2- 172.21.15.105:0/1348374119 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca14005250 0x7fca1400b9c0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:18.745 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.743+0000 7fca301da640 1 -- 172.21.15.105:0/1348374119 >> 172.21.15.105:0/1348374119 conn(0x7fca280b1cb0 msgr2=0x7fca280b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:18.745 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.743+0000 7fca301da640 1 -- 172.21.15.105:0/1348374119 shutdown_connections 2024-09-21T03:25:18.745 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.743+0000 7fca301da640 1 -- 172.21.15.105:0/1348374119 wait complete. 2024-09-21T03:25:18.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.744+0000 7fca301da640 1 Processor -- start 2024-09-21T03:25:18.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.744+0000 7fca301da640 1 -- start start 2024-09-21T03:25:18.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.746+0000 7fca301da640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca14005250 0x7fca2814d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:18.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.746+0000 7fca301da640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca281f3610 0x7fca280c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:18.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.746+0000 7fca301da640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca2809c1e0 0x7fca2809c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:18.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.746+0000 7fca301da640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fca280ca9a0 con 0x7fca2809c1e0 2024-09-21T03:25:18.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.746+0000 7fca301da640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fca2815c380 con 0x7fca14005250 2024-09-21T03:25:18.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.746+0000 7fca301da640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fca280cab20 con 0x7fca281f3610 2024-09-21T03:25:18.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.746+0000 7fca2e777640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca2809c1e0 0x7fca2809c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:18.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.746+0000 7fca2e777640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca2809c1e0 0x7fca2809c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51658/0 (socket says 172.21.15.105:51658) 2024-09-21T03:25:18.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.746+0000 7fca2df76640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca14005250 0x7fca2814d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:18.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.746+0000 7fca2e777640 1 -- 172.21.15.105:0/2346785474 learned_addr learned my addr 172.21.15.105:0/2346785474 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:18.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.746+0000 7fca2d775640 1 --2- 172.21.15.105:0/2346785474 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca281f3610 0x7fca280c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:18.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.746+0000 7fca2e777640 1 -- 172.21.15.105:0/2346785474 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca281f3610 msgr2=0x7fca280c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:18.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.746+0000 7fca2e777640 1 --2- 172.21.15.105:0/2346785474 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca281f3610 0x7fca280c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:18.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.746+0000 7fca2e777640 1 -- 172.21.15.105:0/2346785474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca14005250 msgr2=0x7fca2814d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:18.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.746+0000 7fca2e777640 1 --2- 172.21.15.105:0/2346785474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca14005250 0x7fca2814d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:18.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.746+0000 7fca2e777640 1 -- 172.21.15.105:0/2346785474 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca281f40e0 con 0x7fca2809c1e0 2024-09-21T03:25:18.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.746+0000 7fca2e777640 1 --2- 172.21.15.105:0/2346785474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca2809c1e0 0x7fca2809c5f0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fca2002c910 tx=0x7fca20001750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:18.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.746+0000 7fca1e7fc640 1 -- 172.21.15.105:0/2346785474 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca20035680 con 0x7fca2809c1e0 2024-09-21T03:25:18.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.746+0000 7fca1e7fc640 1 -- 172.21.15.105:0/2346785474 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca20035930 con 0x7fca2809c1e0 2024-09-21T03:25:18.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.746+0000 7fca301da640 1 -- 172.21.15.105:0/2346785474 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca281f43c0 con 0x7fca2809c1e0 2024-09-21T03:25:18.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.746+0000 7fca1e7fc640 1 -- 172.21.15.105:0/2346785474 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca20035d80 con 0x7fca2809c1e0 2024-09-21T03:25:18.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.746+0000 7fca301da640 1 -- 172.21.15.105:0/2346785474 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca2814dcd0 con 0x7fca2809c1e0 2024-09-21T03:25:18.751 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.748+0000 7fca301da640 1 -- 172.21.15.105:0/2346785474 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca280cf160 con 0x7fca2809c1e0 2024-09-21T03:25:18.751 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.748+0000 7fca1e7fc640 1 -- 172.21.15.105:0/2346785474 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fca20006030 con 0x7fca2809c1e0 2024-09-21T03:25:18.751 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.749+0000 7fca1e7fc640 1 --2- 172.21.15.105:0/2346785474 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fca0c078b90 0x7fca0c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:18.751 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.749+0000 7fca1e7fc640 1 -- 172.21.15.105:0/2346785474 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7fca200bb360 con 0x7fca2809c1e0 2024-09-21T03:25:18.751 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.749+0000 7fca2df76640 1 --2- 172.21.15.105:0/2346785474 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fca0c078b90 0x7fca0c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:18.751 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.749+0000 7fca2df76640 1 --2- 172.21.15.105:0/2346785474 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fca0c078b90 0x7fca0c07b0a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fca24006680 tx=0x7fca24006b70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:18.755 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.753+0000 7fca1e7fc640 1 -- 172.21.15.105:0/2346785474 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fca280cb2f0 con 0x7fca2809c1e0 2024-09-21T03:25:18.930 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.928+0000 7fca301da640 1 -- 172.21.15.105:0/2346785474 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command([{prefix=config set, name=mds_recall_max_caps}] v 0) -- 0x7fca281f3e70 con 0x7fca2809c1e0 2024-09-21T03:25:18.933 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.932+0000 7fca1e7fc640 1 -- 172.21.15.105:0/2346785474 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_recall_max_caps}]=0 v53)=0 v53) ==== 119+0+0 (secure 0 0 0) 0x7fca200837e0 con 0x7fca2809c1e0 2024-09-21T03:25:18.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.935+0000 7fca301da640 1 -- 172.21.15.105:0/2346785474 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fca0c078b90 msgr2=0x7fca0c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:18.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.935+0000 7fca301da640 1 --2- 172.21.15.105:0/2346785474 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fca0c078b90 0x7fca0c07b0a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fca24006680 tx=0x7fca24006b70 comp rx=0 tx=0).stop 2024-09-21T03:25:18.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.935+0000 7fca301da640 1 -- 172.21.15.105:0/2346785474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca2809c1e0 msgr2=0x7fca2809c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:18.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.935+0000 7fca301da640 1 --2- 172.21.15.105:0/2346785474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca2809c1e0 0x7fca2809c5f0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fca2002c910 tx=0x7fca20001750 comp rx=0 tx=0).stop 2024-09-21T03:25:18.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.935+0000 7fca301da640 1 -- 172.21.15.105:0/2346785474 shutdown_connections 2024-09-21T03:25:18.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.935+0000 7fca301da640 1 --2- 172.21.15.105:0/2346785474 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fca0c078b90 0x7fca0c07b0a0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:18.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.935+0000 7fca301da640 1 --2- 172.21.15.105:0/2346785474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca2809c1e0 0x7fca2809c5f0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:18.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.935+0000 7fca301da640 1 --2- 172.21.15.105:0/2346785474 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca281f3610 0x7fca280c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:18.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.935+0000 7fca301da640 1 --2- 172.21.15.105:0/2346785474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca14005250 0x7fca2814d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:18.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.935+0000 7fca301da640 1 -- 172.21.15.105:0/2346785474 >> 172.21.15.105:0/2346785474 conn(0x7fca280b1cb0 msgr2=0x7fca280b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:18.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.935+0000 7fca301da640 1 -- 172.21.15.105:0/2346785474 shutdown_connections 2024-09-21T03:25:18.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:18.935+0000 7fca301da640 1 -- 172.21.15.105:0/2346785474 wait complete. 2024-09-21T03:25:18.948 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_recall_warning_threshold 800 2024-09-21T03:25:19.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.062+0000 7fe59a962640 1 -- 172.21.15.105:0/977011490 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe57c005250 msgr2=0x7fe57c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:19.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.062+0000 7fe59a962640 1 --2- 172.21.15.105:0/977011490 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe57c005250 0x7fe57c00b9c0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fe58c001dc0 tx=0x7fe57c005830 comp rx=0 tx=0).stop 2024-09-21T03:25:19.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.062+0000 7fe59a962640 1 -- 172.21.15.105:0/977011490 shutdown_connections 2024-09-21T03:25:19.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.062+0000 7fe59a962640 1 --2- 172.21.15.105:0/977011490 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe57c005250 0x7fe57c00b9c0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:19.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.062+0000 7fe59a962640 1 -- 172.21.15.105:0/977011490 >> 172.21.15.105:0/977011490 conn(0x7fe594072ae0 msgr2=0x7fe594072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:19.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.062+0000 7fe59a962640 1 -- 172.21.15.105:0/977011490 shutdown_connections 2024-09-21T03:25:19.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.062+0000 7fe59a962640 1 -- 172.21.15.105:0/977011490 wait complete. 2024-09-21T03:25:19.065 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.064+0000 7fe59a962640 1 Processor -- start 2024-09-21T03:25:19.065 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.064+0000 7fe59a962640 1 -- start start 2024-09-21T03:25:19.068 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.065+0000 7fe59a962640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe57c005250 0x7fe59415a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:19.068 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.065+0000 7fe59a962640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5940a94a0 0x7fe5940b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:19.068 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.065+0000 7fe59a962640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5940c72a0 0x7fe5940c76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:19.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.065+0000 7fe59a962640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe5940d1a60 con 0x7fe5940a94a0 2024-09-21T03:25:19.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.065+0000 7fe59a962640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe5940d18e0 con 0x7fe57c005250 2024-09-21T03:25:19.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.065+0000 7fe59a962640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe5940d1100 con 0x7fe5940c72a0 2024-09-21T03:25:19.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.065+0000 7fe5937fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5940a94a0 0x7fe5940b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:19.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.065+0000 7fe5937fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5940a94a0 0x7fe5940b12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51688/0 (socket says 172.21.15.105:51688) 2024-09-21T03:25:19.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.065+0000 7fe5937fe640 1 -- 172.21.15.105:0/4008987543 learned_addr learned my addr 172.21.15.105:0/4008987543 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:19.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.066+0000 7fe593fff640 1 --2- 172.21.15.105:0/4008987543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe57c005250 0x7fe59415a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:19.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.066+0000 7fe598eff640 1 --2- 172.21.15.105:0/4008987543 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5940c72a0 0x7fe5940c76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:19.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.066+0000 7fe5937fe640 1 -- 172.21.15.105:0/4008987543 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5940c72a0 msgr2=0x7fe5940c76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:19.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.066+0000 7fe5937fe640 1 --2- 172.21.15.105:0/4008987543 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5940c72a0 0x7fe5940c76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:19.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.066+0000 7fe5937fe640 1 -- 172.21.15.105:0/4008987543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe57c005250 msgr2=0x7fe59415a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:19.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.066+0000 7fe5937fe640 1 --2- 172.21.15.105:0/4008987543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe57c005250 0x7fe59415a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:19.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.066+0000 7fe5937fe640 1 -- 172.21.15.105:0/4008987543 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe594159810 con 0x7fe5940a94a0 2024-09-21T03:25:19.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.066+0000 7fe593fff640 1 --2- 172.21.15.105:0/4008987543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe57c005250 0x7fe59415a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:25:19.070 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.066+0000 7fe5937fe640 1 --2- 172.21.15.105:0/4008987543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5940a94a0 0x7fe5940b12f0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fe588011ab0 tx=0x7fe588011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:19.070 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.066+0000 7fe590ff9640 1 -- 172.21.15.105:0/4008987543 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe58801e070 con 0x7fe5940a94a0 2024-09-21T03:25:19.070 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.066+0000 7fe590ff9640 1 -- 172.21.15.105:0/4008987543 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe58800fe70 con 0x7fe5940a94a0 2024-09-21T03:25:19.070 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.066+0000 7fe59a962640 1 -- 172.21.15.105:0/4008987543 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe594159ad0 con 0x7fe5940a94a0 2024-09-21T03:25:19.070 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.066+0000 7fe590ff9640 1 -- 172.21.15.105:0/4008987543 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe588004270 con 0x7fe5940a94a0 2024-09-21T03:25:19.070 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.066+0000 7fe59a962640 1 -- 172.21.15.105:0/4008987543 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5940c7d70 con 0x7fe5940a94a0 2024-09-21T03:25:19.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.067+0000 7fe59a962640 1 -- 172.21.15.105:0/4008987543 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5940cdf30 con 0x7fe5940a94a0 2024-09-21T03:25:19.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.068+0000 7fe590ff9640 1 -- 172.21.15.105:0/4008987543 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe588021070 con 0x7fe5940a94a0 2024-09-21T03:25:19.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.068+0000 7fe590ff9640 1 --2- 172.21.15.105:0/4008987543 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe580078b90 0x7fe58007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:19.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.069+0000 7fe590ff9640 1 -- 172.21.15.105:0/4008987543 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7fe58809b680 con 0x7fe5940a94a0 2024-09-21T03:25:19.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.069+0000 7fe593fff640 1 --2- 172.21.15.105:0/4008987543 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe580078b90 0x7fe58007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:19.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.069+0000 7fe593fff640 1 --2- 172.21.15.105:0/4008987543 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe580078b90 0x7fe58007b0a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe584001860 tx=0x7fe584001110 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:19.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.073+0000 7fe590ff9640 1 -- 172.21.15.105:0/4008987543 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe5940cdf30 con 0x7fe5940a94a0 2024-09-21T03:25:19.251 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.249+0000 7fe59a962640 1 -- 172.21.15.105:0/4008987543 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command([{prefix=config set, name=mds_recall_warning_threshold}] v 0) -- 0x7fe59415c9d0 con 0x7fe5940a94a0 2024-09-21T03:25:19.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.253+0000 7fe590ff9640 1 -- 172.21.15.105:0/4008987543 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_recall_warning_threshold}]=0 v54)=0 v54) ==== 128+0+0 (secure 0 0 0) 0x7fe588063590 con 0x7fe5940a94a0 2024-09-21T03:25:19.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.256+0000 7fe59a962640 1 -- 172.21.15.105:0/4008987543 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe580078b90 msgr2=0x7fe58007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:19.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.256+0000 7fe59a962640 1 --2- 172.21.15.105:0/4008987543 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe580078b90 0x7fe58007b0a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe584001860 tx=0x7fe584001110 comp rx=0 tx=0).stop 2024-09-21T03:25:19.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.256+0000 7fe59a962640 1 -- 172.21.15.105:0/4008987543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5940a94a0 msgr2=0x7fe5940b12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:19.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.256+0000 7fe59a962640 1 --2- 172.21.15.105:0/4008987543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5940a94a0 0x7fe5940b12f0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fe588011ab0 tx=0x7fe588011f70 comp rx=0 tx=0).stop 2024-09-21T03:25:19.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.256+0000 7fe59a962640 1 -- 172.21.15.105:0/4008987543 shutdown_connections 2024-09-21T03:25:19.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.256+0000 7fe59a962640 1 --2- 172.21.15.105:0/4008987543 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe580078b90 0x7fe58007b0a0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:19.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.256+0000 7fe59a962640 1 --2- 172.21.15.105:0/4008987543 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5940c72a0 0x7fe5940c76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:19.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.256+0000 7fe59a962640 1 --2- 172.21.15.105:0/4008987543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5940a94a0 0x7fe5940b12f0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:19.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.256+0000 7fe59a962640 1 --2- 172.21.15.105:0/4008987543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe57c005250 0x7fe59415a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:19.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.256+0000 7fe59a962640 1 -- 172.21.15.105:0/4008987543 >> 172.21.15.105:0/4008987543 conn(0x7fe594072ae0 msgr2=0x7fe5940b3660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:19.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.256+0000 7fe59a962640 1 -- 172.21.15.105:0/4008987543 shutdown_connections 2024-09-21T03:25:19.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.256+0000 7fe59a962640 1 -- 172.21.15.105:0/4008987543 wait complete. 2024-09-21T03:25:19.269 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_min_caps_per_client 2024-09-21T03:25:19.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.382+0000 7fd00372b640 1 -- 172.21.15.105:0/932604179 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcffc0b9b60 msgr2=0x7fcffc0d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:19.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.382+0000 7fd00372b640 1 --2- 172.21.15.105:0/932604179 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcffc0b9b60 0x7fcffc0d0fb0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fcffc0d43c0 tx=0x7fcfec02a980 comp rx=0 tx=0).stop 2024-09-21T03:25:19.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.382+0000 7fd00372b640 1 -- 172.21.15.105:0/932604179 shutdown_connections 2024-09-21T03:25:19.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.382+0000 7fd00372b640 1 --2- 172.21.15.105:0/932604179 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcffc162430 0x7fcffc162840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:19.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.382+0000 7fd00372b640 1 --2- 172.21.15.105:0/932604179 >> v2:172.21.15.162:3300/0 conn(0x7fcffc0b3a10 0x7fcffc0d14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:19.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.382+0000 7fd00372b640 1 --2- 172.21.15.105:0/932604179 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcffc0b9b60 0x7fcffc0d0fb0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:19.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.382+0000 7fd00372b640 1 -- 172.21.15.105:0/932604179 >> 172.21.15.105:0/932604179 conn(0x7fcffc09d8f0 msgr2=0x7fcffc0d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:19.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.382+0000 7fd00372b640 1 -- 172.21.15.105:0/932604179 shutdown_connections 2024-09-21T03:25:19.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.382+0000 7fd00372b640 1 -- 172.21.15.105:0/932604179 wait complete. 2024-09-21T03:25:19.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.384+0000 7fd00372b640 1 Processor -- start 2024-09-21T03:25:19.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.384+0000 7fd00372b640 1 -- start start 2024-09-21T03:25:19.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.385+0000 7fd00372b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcffc0b3a10 0x7fcffc1571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:19.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.385+0000 7fd00372b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcffc0b9b60 0x7fcffc0b6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:19.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.385+0000 7fd00372b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcffc162430 0x7fcffc15f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:19.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.385+0000 7fd00372b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcffc163110 con 0x7fcffc0b9b60 2024-09-21T03:25:19.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.385+0000 7fd00372b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcffc162f90 con 0x7fcffc0b3a10 2024-09-21T03:25:19.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.385+0000 7fd00372b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcffc163290 con 0x7fcffc162430 2024-09-21T03:25:19.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.385+0000 7fd000cc6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcffc0b9b60 0x7fcffc0b6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:19.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.385+0000 7fd000cc6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcffc0b9b60 0x7fcffc0b6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51714/0 (socket says 172.21.15.105:51714) 2024-09-21T03:25:19.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.385+0000 7fd000cc6640 1 -- 172.21.15.105:0/3527282267 learned_addr learned my addr 172.21.15.105:0/3527282267 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:19.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.385+0000 7fd0014c7640 1 --2- 172.21.15.105:0/3527282267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcffc0b3a10 0x7fcffc1571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:19.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.386+0000 7fd001cc8640 1 --2- 172.21.15.105:0/3527282267 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcffc162430 0x7fcffc15f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:19.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.386+0000 7fd000cc6640 1 -- 172.21.15.105:0/3527282267 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcffc162430 msgr2=0x7fcffc15f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:19.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.386+0000 7fd000cc6640 1 --2- 172.21.15.105:0/3527282267 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcffc162430 0x7fcffc15f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:19.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.386+0000 7fd000cc6640 1 -- 172.21.15.105:0/3527282267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcffc0b3a10 msgr2=0x7fcffc1571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:19.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.386+0000 7fd000cc6640 1 --2- 172.21.15.105:0/3527282267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcffc0b3a10 0x7fcffc1571f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:19.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.386+0000 7fd000cc6640 1 -- 172.21.15.105:0/3527282267 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcffc156430 con 0x7fcffc0b9b60 2024-09-21T03:25:19.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.386+0000 7fd000cc6640 1 --2- 172.21.15.105:0/3527282267 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcffc0b9b60 0x7fcffc0b6820 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fcff000d750 tx=0x7fcff000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:19.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.386+0000 7fcff9ffb640 1 -- 172.21.15.105:0/3527282267 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff0017070 con 0x7fcffc0b9b60 2024-09-21T03:25:19.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.386+0000 7fcff9ffb640 1 -- 172.21.15.105:0/3527282267 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcff0009cc0 con 0x7fcffc0b9b60 2024-09-21T03:25:19.390 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.386+0000 7fcff9ffb640 1 -- 172.21.15.105:0/3527282267 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff00106c0 con 0x7fcffc0b9b60 2024-09-21T03:25:19.390 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.386+0000 7fd00372b640 1 -- 172.21.15.105:0/3527282267 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcffc156710 con 0x7fcffc0b9b60 2024-09-21T03:25:19.390 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.386+0000 7fd00372b640 1 -- 172.21.15.105:0/3527282267 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcffc160360 con 0x7fcffc0b9b60 2024-09-21T03:25:19.390 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.387+0000 7fd00372b640 1 -- 172.21.15.105:0/3527282267 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcffc162840 con 0x7fcffc0b9b60 2024-09-21T03:25:19.391 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.388+0000 7fcff9ffb640 1 -- 172.21.15.105:0/3527282267 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcff001a070 con 0x7fcffc0b9b60 2024-09-21T03:25:19.391 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.389+0000 7fcff9ffb640 1 --2- 172.21.15.105:0/3527282267 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcfe8078b90 0x7fcfe807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:19.391 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.389+0000 7fcff9ffb640 1 -- 172.21.15.105:0/3527282267 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7fcff009ac70 con 0x7fcffc0b9b60 2024-09-21T03:25:19.391 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.389+0000 7fd0014c7640 1 --2- 172.21.15.105:0/3527282267 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcfe8078b90 0x7fcfe807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:19.391 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.390+0000 7fd0014c7640 1 --2- 172.21.15.105:0/3527282267 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcfe8078b90 0x7fcfe807b0a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fcfec035000 tx=0x7fcfec004ab0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:19.395 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.393+0000 7fcff9ffb640 1 -- 172.21.15.105:0/3527282267 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fcff000de60 con 0x7fcffc0b9b60 2024-09-21T03:25:19.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.570+0000 7fd00372b640 1 -- 172.21.15.105:0/3527282267 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_min_caps_per_client"} v 0) -- 0x7fcffc0b49f0 con 0x7fcffc0b9b60 2024-09-21T03:25:19.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.570+0000 7fcff9ffb640 1 -- 172.21.15.105:0/3527282267 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_min_caps_per_client"}]=0 v54) ==== 106+0+4 (secure 0 0 0) 0x7fcff0062b80 con 0x7fcffc0b9b60 2024-09-21T03:25:19.572 INFO:teuthology.orchestra.run.smithi105.stdout:100 2024-09-21T03:25:19.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.573+0000 7fd00372b640 1 -- 172.21.15.105:0/3527282267 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcfe8078b90 msgr2=0x7fcfe807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:19.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.573+0000 7fd00372b640 1 --2- 172.21.15.105:0/3527282267 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcfe8078b90 0x7fcfe807b0a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fcfec035000 tx=0x7fcfec004ab0 comp rx=0 tx=0).stop 2024-09-21T03:25:19.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.573+0000 7fd00372b640 1 -- 172.21.15.105:0/3527282267 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcffc0b9b60 msgr2=0x7fcffc0b6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:19.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.573+0000 7fd00372b640 1 --2- 172.21.15.105:0/3527282267 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcffc0b9b60 0x7fcffc0b6820 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fcff000d750 tx=0x7fcff000dc10 comp rx=0 tx=0).stop 2024-09-21T03:25:19.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.573+0000 7fd00372b640 1 -- 172.21.15.105:0/3527282267 shutdown_connections 2024-09-21T03:25:19.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.573+0000 7fd00372b640 1 --2- 172.21.15.105:0/3527282267 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcfe8078b90 0x7fcfe807b0a0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:19.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.573+0000 7fd00372b640 1 --2- 172.21.15.105:0/3527282267 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcffc162430 0x7fcffc15f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:19.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.573+0000 7fd00372b640 1 --2- 172.21.15.105:0/3527282267 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcffc0b9b60 0x7fcffc0b6820 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:19.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.573+0000 7fd00372b640 1 --2- 172.21.15.105:0/3527282267 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcffc0b3a10 0x7fcffc1571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:19.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.573+0000 7fd00372b640 1 -- 172.21.15.105:0/3527282267 >> 172.21.15.105:0/3527282267 conn(0x7fcffc09d8f0 msgr2=0x7fcffc0b3260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:19.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.573+0000 7fd00372b640 1 -- 172.21.15.105:0/3527282267 shutdown_connections 2024-09-21T03:25:19.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.573+0000 7fd00372b640 1 -- 172.21.15.105:0/3527282267 wait complete. 2024-09-21T03:25:19.586 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_min_caps_working_set 100 2024-09-21T03:25:19.703 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.701+0000 7fe4c9263640 1 -- 172.21.15.105:0/839604280 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4c40cab80 msgr2=0x7fe4c415b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:19.703 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.701+0000 7fe4c9263640 1 --2- 172.21.15.105:0/839604280 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4c40cab80 0x7fe4c415b5c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4009820 tx=0x7fe4b402a480 comp rx=0 tx=0).stop 2024-09-21T03:25:19.703 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.701+0000 7fe4c9263640 1 -- 172.21.15.105:0/839604280 shutdown_connections 2024-09-21T03:25:19.703 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.701+0000 7fe4c9263640 1 --2- 172.21.15.105:0/839604280 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4c40c64e0 0x7fe4c40c68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:19.703 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.701+0000 7fe4c9263640 1 --2- 172.21.15.105:0/839604280 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4c40cab80 0x7fe4c415b5c0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:19.703 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.701+0000 7fe4c9263640 1 -- 172.21.15.105:0/839604280 >> 172.21.15.105:0/839604280 conn(0x7fe4c40d0530 msgr2=0x7fe4c40d0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:19.703 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.701+0000 7fe4c9263640 1 -- 172.21.15.105:0/839604280 shutdown_connections 2024-09-21T03:25:19.703 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.701+0000 7fe4c9263640 1 -- 172.21.15.105:0/839604280 wait complete. 2024-09-21T03:25:19.704 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.702+0000 7fe4c9263640 1 Processor -- start 2024-09-21T03:25:19.704 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.702+0000 7fe4c9263640 1 -- start start 2024-09-21T03:25:19.707 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.704+0000 7fe4c9263640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4c40c64e0 0x7fe4c40b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:19.707 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.704+0000 7fe4c9263640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4c40cab80 0x7fe4c4146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:19.707 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.704+0000 7fe4c9263640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4c415c620 0x7fe4c40c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:19.707 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.704+0000 7fe4c9263640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c40ce490 con 0x7fe4c40cab80 2024-09-21T03:25:19.707 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.704+0000 7fe4c9263640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c40ce310 con 0x7fe4c40c64e0 2024-09-21T03:25:19.707 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.704+0000 7fe4c9263640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe4c40ce610 con 0x7fe4c415c620 2024-09-21T03:25:19.707 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.704+0000 7fe4bbfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4c40cab80 0x7fe4c4146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:19.707 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.704+0000 7fe4bbfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4c40cab80 0x7fe4c4146fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51722/0 (socket says 172.21.15.105:51722) 2024-09-21T03:25:19.707 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.704+0000 7fe4bbfff640 1 -- 172.21.15.105:0/3653381653 learned_addr learned my addr 172.21.15.105:0/3653381653 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:19.707 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.704+0000 7fe4c2ffd640 1 --2- 172.21.15.105:0/3653381653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4c40c64e0 0x7fe4c40b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:19.708 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.704+0000 7fe4c37fe640 1 --2- 172.21.15.105:0/3653381653 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4c415c620 0x7fe4c40c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:19.708 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.704+0000 7fe4bbfff640 1 -- 172.21.15.105:0/3653381653 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4c415c620 msgr2=0x7fe4c40c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:19.708 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.704+0000 7fe4bbfff640 1 --2- 172.21.15.105:0/3653381653 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4c415c620 0x7fe4c40c53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:19.708 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.704+0000 7fe4bbfff640 1 -- 172.21.15.105:0/3653381653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4c40c64e0 msgr2=0x7fe4c40b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:19.708 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.704+0000 7fe4bbfff640 1 --2- 172.21.15.105:0/3653381653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4c40c64e0 0x7fe4c40b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:19.708 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.704+0000 7fe4bbfff640 1 -- 172.21.15.105:0/3653381653 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c40b6210 con 0x7fe4c40cab80 2024-09-21T03:25:19.708 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.704+0000 7fe4bbfff640 1 --2- 172.21.15.105:0/3653381653 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4c40cab80 0x7fe4c4146fc0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac00c3d0 tx=0x7fe4ac00c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:19.708 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.705+0000 7fe4bb7fe640 1 -- 172.21.15.105:0/3653381653 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac011790 con 0x7fe4c40cab80 2024-09-21T03:25:19.708 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.705+0000 7fe4c9263640 1 -- 172.21.15.105:0/3653381653 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4c4147880 con 0x7fe4c40cab80 2024-09-21T03:25:19.708 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.705+0000 7fe4bb7fe640 1 -- 172.21.15.105:0/3653381653 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe4ac017070 con 0x7fe4c40cab80 2024-09-21T03:25:19.708 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.705+0000 7fe4bb7fe640 1 -- 172.21.15.105:0/3653381653 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac011cc0 con 0x7fe4c40cab80 2024-09-21T03:25:19.708 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.705+0000 7fe4c9263640 1 -- 172.21.15.105:0/3653381653 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4c4147500 con 0x7fe4c40cab80 2024-09-21T03:25:19.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.706+0000 7fe4c9263640 1 -- 172.21.15.105:0/3653381653 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4c40c68f0 con 0x7fe4c40cab80 2024-09-21T03:25:19.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.706+0000 7fe4bb7fe640 1 -- 172.21.15.105:0/3653381653 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe4ac01c460 con 0x7fe4c40cab80 2024-09-21T03:25:19.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.707+0000 7fe4bb7fe640 1 --2- 172.21.15.105:0/3653381653 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe4a4078b90 0x7fe4a407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:19.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.707+0000 7fe4bb7fe640 1 -- 172.21.15.105:0/3653381653 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7fe4ac09a980 con 0x7fe4c40cab80 2024-09-21T03:25:19.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.707+0000 7fe4c2ffd640 1 --2- 172.21.15.105:0/3653381653 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe4a4078b90 0x7fe4a407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:19.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.708+0000 7fe4c2ffd640 1 --2- 172.21.15.105:0/3653381653 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe4a4078b90 0x7fe4a407b0a0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4034000 tx=0x7fe4b4004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:19.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.712+0000 7fe4bb7fe640 1 -- 172.21.15.105:0/3653381653 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe4c40c6e30 con 0x7fe4c40cab80 2024-09-21T03:25:19.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.891+0000 7fe4c9263640 1 -- 172.21.15.105:0/3653381653 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command([{prefix=config set, name=mds_min_caps_working_set}] v 0) -- 0x7fe4c40696c0 con 0x7fe4c40cab80 2024-09-21T03:25:19.896 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.895+0000 7fe4bb7fe640 1 -- 172.21.15.105:0/3653381653 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_min_caps_working_set}]=0 v55)=0 v55) ==== 124+0+0 (secure 0 0 0) 0x7fe4ac062dd0 con 0x7fe4c40cab80 2024-09-21T03:25:19.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.897+0000 7fe4c9263640 1 -- 172.21.15.105:0/3653381653 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe4a4078b90 msgr2=0x7fe4a407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:19.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.897+0000 7fe4c9263640 1 --2- 172.21.15.105:0/3653381653 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe4a4078b90 0x7fe4a407b0a0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4034000 tx=0x7fe4b4004730 comp rx=0 tx=0).stop 2024-09-21T03:25:19.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.897+0000 7fe4c9263640 1 -- 172.21.15.105:0/3653381653 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4c40cab80 msgr2=0x7fe4c4146fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:19.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.897+0000 7fe4c9263640 1 --2- 172.21.15.105:0/3653381653 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4c40cab80 0x7fe4c4146fc0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac00c3d0 tx=0x7fe4ac00c7d0 comp rx=0 tx=0).stop 2024-09-21T03:25:19.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.897+0000 7fe4c9263640 1 -- 172.21.15.105:0/3653381653 shutdown_connections 2024-09-21T03:25:19.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.897+0000 7fe4c9263640 1 --2- 172.21.15.105:0/3653381653 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe4a4078b90 0x7fe4a407b0a0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:19.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.897+0000 7fe4c9263640 1 --2- 172.21.15.105:0/3653381653 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4c415c620 0x7fe4c40c53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:19.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.897+0000 7fe4c9263640 1 --2- 172.21.15.105:0/3653381653 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4c40cab80 0x7fe4c4146fc0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:19.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.897+0000 7fe4c9263640 1 --2- 172.21.15.105:0/3653381653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4c40c64e0 0x7fe4c40b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:19.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.897+0000 7fe4c9263640 1 -- 172.21.15.105:0/3653381653 >> 172.21.15.105:0/3653381653 conn(0x7fe4c40d0530 msgr2=0x7fe4c415a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:19.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.897+0000 7fe4c9263640 1 -- 172.21.15.105:0/3653381653 shutdown_connections 2024-09-21T03:25:19.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:19.897+0000 7fe4c9263640 1 -- 172.21.15.105:0/3653381653 wait complete. 2024-09-21T03:25:19.910 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_max_caps_per_client 2024-09-21T03:25:20.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.023+0000 7f1b9387e640 1 -- 172.21.15.105:0/1533209921 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1b8c1570e0 msgr2=0x7f1b8c0d1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:20.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.023+0000 7f1b9387e640 1 --2- 172.21.15.105:0/1533209921 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1b8c1570e0 0x7f1b8c0d1f20 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c071d80 tx=0x7f1b8802a530 comp rx=0 tx=0).stop 2024-09-21T03:25:20.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.023+0000 7f1b9387e640 1 -- 172.21.15.105:0/1533209921 shutdown_connections 2024-09-21T03:25:20.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.023+0000 7f1b9387e640 1 --2- 172.21.15.105:0/1533209921 >> v2:172.21.15.162:3300/0 conn(0x7f1b8c0d2460 0x7f1b8c15d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:20.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.023+0000 7f1b9387e640 1 --2- 172.21.15.105:0/1533209921 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1b8c1570e0 0x7f1b8c0d1f20 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:20.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.023+0000 7f1b9387e640 1 -- 172.21.15.105:0/1533209921 >> 172.21.15.105:0/1533209921 conn(0x7f1b8c06d550 msgr2=0x7f1b8c071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:20.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.023+0000 7f1b9387e640 1 -- 172.21.15.105:0/1533209921 shutdown_connections 2024-09-21T03:25:20.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.023+0000 7f1b9387e640 1 -- 172.21.15.105:0/1533209921 wait complete. 2024-09-21T03:25:20.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.024+0000 7f1b9387e640 1 Processor -- start 2024-09-21T03:25:20.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.024+0000 7f1b9387e640 1 -- start start 2024-09-21T03:25:20.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.026+0000 7f1b9387e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b8c0d2460 0x7f1b8c14dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:20.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.026+0000 7f1b9387e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1b8c1570e0 0x7f1b8c14cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:20.029 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.026+0000 7f1b9387e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1b8c15d670 0x7f1b8c0b2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:20.029 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.026+0000 7f1b9387e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8c0b7d20 con 0x7f1b8c15d670 2024-09-21T03:25:20.029 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.026+0000 7f1b9387e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8c0b7ba0 con 0x7f1b8c0d2460 2024-09-21T03:25:20.029 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.026+0000 7f1b9387e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1b8c0b7ea0 con 0x7f1b8c1570e0 2024-09-21T03:25:20.029 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.026+0000 7f1b91e1b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1b8c15d670 0x7f1b8c0b2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:20.029 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.026+0000 7f1b91e1b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1b8c15d670 0x7f1b8c0b2e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51738/0 (socket says 172.21.15.105:51738) 2024-09-21T03:25:20.029 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.026+0000 7f1b91e1b640 1 -- 172.21.15.105:0/124824916 learned_addr learned my addr 172.21.15.105:0/124824916 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:20.029 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.026+0000 7f1b90e19640 1 --2- 172.21.15.105:0/124824916 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1b8c1570e0 0x7f1b8c14cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:20.029 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.026+0000 7f1b9161a640 1 --2- 172.21.15.105:0/124824916 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b8c0d2460 0x7f1b8c14dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:20.029 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.026+0000 7f1b91e1b640 1 -- 172.21.15.105:0/124824916 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1b8c1570e0 msgr2=0x7f1b8c14cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:20.029 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.026+0000 7f1b91e1b640 1 --2- 172.21.15.105:0/124824916 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1b8c1570e0 0x7f1b8c14cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:20.029 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.026+0000 7f1b91e1b640 1 -- 172.21.15.105:0/124824916 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b8c0d2460 msgr2=0x7f1b8c14dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:20.029 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.026+0000 7f1b91e1b640 1 --2- 172.21.15.105:0/124824916 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b8c0d2460 0x7f1b8c14dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:20.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.026+0000 7f1b91e1b640 1 -- 172.21.15.105:0/124824916 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b8c0b1da0 con 0x7f1b8c15d670 2024-09-21T03:25:20.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.026+0000 7f1b91e1b640 1 --2- 172.21.15.105:0/124824916 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1b8c15d670 0x7f1b8c0b2e40 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f1b8400c730 tx=0x7f1b8400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:20.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.026+0000 7f1b81ffb640 1 -- 172.21.15.105:0/124824916 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b84017070 con 0x7f1b8c15d670 2024-09-21T03:25:20.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.026+0000 7f1b81ffb640 1 -- 172.21.15.105:0/124824916 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b84003c60 con 0x7f1b8c15d670 2024-09-21T03:25:20.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.026+0000 7f1b9387e640 1 -- 172.21.15.105:0/124824916 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b8c0b2080 con 0x7f1b8c15d670 2024-09-21T03:25:20.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.026+0000 7f1b81ffb640 1 -- 172.21.15.105:0/124824916 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b840052d0 con 0x7f1b8c15d670 2024-09-21T03:25:20.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.027+0000 7f1b9387e640 1 -- 172.21.15.105:0/124824916 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b8c0b2640 con 0x7f1b8c15d670 2024-09-21T03:25:20.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.028+0000 7f1b9387e640 1 -- 172.21.15.105:0/124824916 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b8c15d130 con 0x7f1b8c15d670 2024-09-21T03:25:20.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.028+0000 7f1b81ffb640 1 -- 172.21.15.105:0/124824916 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1b8401a070 con 0x7f1b8c15d670 2024-09-21T03:25:20.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.029+0000 7f1b81ffb640 1 --2- 172.21.15.105:0/124824916 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1b70078b90 0x7f1b7007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:20.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.029+0000 7f1b81ffb640 1 -- 172.21.15.105:0/124824916 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f1b8409a3e0 con 0x7f1b8c15d670 2024-09-21T03:25:20.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.029+0000 7f1b9161a640 1 --2- 172.21.15.105:0/124824916 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1b70078b90 0x7f1b7007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:20.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.030+0000 7f1b9161a640 1 --2- 172.21.15.105:0/124824916 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1b70078b90 0x7f1b7007b0a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1b88034000 tx=0x7f1b88004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:20.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.034+0000 7f1b81ffb640 1 -- 172.21.15.105:0/124824916 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1b8c0d2870 con 0x7f1b8c15d670 2024-09-21T03:25:20.212 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.210+0000 7f1b9387e640 1 -- 172.21.15.105:0/124824916 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_max_caps_per_client"} v 0) -- 0x7f1b8c15f2c0 con 0x7f1b8c15d670 2024-09-21T03:25:20.212 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.211+0000 7f1b81ffb640 1 -- 172.21.15.105:0/124824916 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_max_caps_per_client"}]=0 v55) ==== 106+0+8 (secure 0 0 0) 0x7f1b840627a0 con 0x7f1b8c15d670 2024-09-21T03:25:20.213 INFO:teuthology.orchestra.run.smithi105.stdout:1048576 2024-09-21T03:25:20.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.213+0000 7f1b9387e640 1 -- 172.21.15.105:0/124824916 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1b70078b90 msgr2=0x7f1b7007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:20.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.213+0000 7f1b9387e640 1 --2- 172.21.15.105:0/124824916 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1b70078b90 0x7f1b7007b0a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1b88034000 tx=0x7f1b88004730 comp rx=0 tx=0).stop 2024-09-21T03:25:20.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.213+0000 7f1b9387e640 1 -- 172.21.15.105:0/124824916 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1b8c15d670 msgr2=0x7f1b8c0b2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:20.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.213+0000 7f1b9387e640 1 --2- 172.21.15.105:0/124824916 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1b8c15d670 0x7f1b8c0b2e40 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f1b8400c730 tx=0x7f1b8400cbf0 comp rx=0 tx=0).stop 2024-09-21T03:25:20.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.213+0000 7f1b9387e640 1 -- 172.21.15.105:0/124824916 shutdown_connections 2024-09-21T03:25:20.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.213+0000 7f1b9387e640 1 --2- 172.21.15.105:0/124824916 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1b70078b90 0x7f1b7007b0a0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:20.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.213+0000 7f1b9387e640 1 --2- 172.21.15.105:0/124824916 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1b8c15d670 0x7f1b8c0b2e40 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:20.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.213+0000 7f1b9387e640 1 --2- 172.21.15.105:0/124824916 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1b8c1570e0 0x7f1b8c14cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:20.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.213+0000 7f1b9387e640 1 --2- 172.21.15.105:0/124824916 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b8c0d2460 0x7f1b8c14dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:20.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.213+0000 7f1b9387e640 1 -- 172.21.15.105:0/124824916 >> 172.21.15.105:0/124824916 conn(0x7f1b8c06d550 msgr2=0x7f1b8c0d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:20.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.213+0000 7f1b9387e640 1 -- 172.21.15.105:0/124824916 shutdown_connections 2024-09-21T03:25:20.215 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.213+0000 7f1b9387e640 1 -- 172.21.15.105:0/124824916 wait complete. 2024-09-21T03:25:20.226 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_recall_warning_decay_rate 2024-09-21T03:25:20.340 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.338+0000 7f58e9b8b640 1 -- 172.21.15.105:0/4099538125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58e415c6f0 msgr2=0x7f58e40ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:20.340 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.338+0000 7f58e9b8b640 1 --2- 172.21.15.105:0/4099538125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58e415c6f0 0x7f58e40ceb50 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f58e4070810 tx=0x7f58d802a5f0 comp rx=0 tx=0).stop 2024-09-21T03:25:20.341 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.338+0000 7f58e9b8b640 1 -- 172.21.15.105:0/4099538125 shutdown_connections 2024-09-21T03:25:20.341 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.338+0000 7f58e9b8b640 1 --2- 172.21.15.105:0/4099538125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58e415c6f0 0x7f58e40ceb50 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:20.341 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.338+0000 7f58e9b8b640 1 --2- 172.21.15.105:0/4099538125 >> v2:172.21.15.162:3300/0 conn(0x7f58e40d1d40 0x7f58e40b5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:20.341 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.338+0000 7f58e9b8b640 1 -- 172.21.15.105:0/4099538125 >> 172.21.15.105:0/4099538125 conn(0x7f58e40b3f10 msgr2=0x7f58e40b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:20.341 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.339+0000 7f58e9b8b640 1 -- 172.21.15.105:0/4099538125 shutdown_connections 2024-09-21T03:25:20.341 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.339+0000 7f58e9b8b640 1 -- 172.21.15.105:0/4099538125 wait complete. 2024-09-21T03:25:20.341 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.340+0000 7f58e9b8b640 1 Processor -- start 2024-09-21T03:25:20.342 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.340+0000 7f58e9b8b640 1 -- start start 2024-09-21T03:25:20.344 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.342+0000 7f58e9b8b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58e40ccba0 0x7f58e4155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:20.345 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.342+0000 7f58e9b8b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58e40d1d40 0x7f58e40cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:20.345 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.342+0000 7f58e9b8b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58e415c6f0 0x7f58e415a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:20.345 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.342+0000 7f58e9b8b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f58e40d11f0 con 0x7f58e40d1d40 2024-09-21T03:25:20.345 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.342+0000 7f58e9b8b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f58e40d1070 con 0x7f58e40ccba0 2024-09-21T03:25:20.345 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.342+0000 7f58e9b8b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f58e40d1370 con 0x7f58e415c6f0 2024-09-21T03:25:20.345 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.342+0000 7f58e2ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58e40d1d40 0x7f58e40cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:20.345 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.342+0000 7f58e2ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58e40d1d40 0x7f58e40cbbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51764/0 (socket says 172.21.15.105:51764) 2024-09-21T03:25:20.345 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.342+0000 7f58e2ffd640 1 -- 172.21.15.105:0/2135812495 learned_addr learned my addr 172.21.15.105:0/2135812495 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:20.345 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.342+0000 7f58e37fe640 1 --2- 172.21.15.105:0/2135812495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58e40ccba0 0x7f58e4155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:20.345 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.342+0000 7f58e3fff640 1 --2- 172.21.15.105:0/2135812495 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58e415c6f0 0x7f58e415a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:20.345 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.342+0000 7f58e2ffd640 1 -- 172.21.15.105:0/2135812495 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58e415c6f0 msgr2=0x7f58e415a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:20.345 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.342+0000 7f58e2ffd640 1 --2- 172.21.15.105:0/2135812495 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58e415c6f0 0x7f58e415a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:20.345 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.342+0000 7f58e2ffd640 1 -- 172.21.15.105:0/2135812495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58e40ccba0 msgr2=0x7f58e4155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:20.346 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.342+0000 7f58e2ffd640 1 --2- 172.21.15.105:0/2135812495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58e40ccba0 0x7f58e4155980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:20.346 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.342+0000 7f58e2ffd640 1 -- 172.21.15.105:0/2135812495 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e40ca920 con 0x7f58e40d1d40 2024-09-21T03:25:20.346 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.342+0000 7f58e2ffd640 1 --2- 172.21.15.105:0/2135812495 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58e40d1d40 0x7f58e40cbbd0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f58d8034040 tx=0x7f58d8003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:20.346 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.342+0000 7f58cbfff640 1 -- 172.21.15.105:0/2135812495 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d803e030 con 0x7f58e40d1d40 2024-09-21T03:25:20.346 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.343+0000 7f58cbfff640 1 -- 172.21.15.105:0/2135812495 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f58d8003e00 con 0x7f58e40d1d40 2024-09-21T03:25:20.346 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.343+0000 7f58e9b8b640 1 -- 172.21.15.105:0/2135812495 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58e40cac00 con 0x7f58e40d1d40 2024-09-21T03:25:20.346 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.343+0000 7f58cbfff640 1 -- 172.21.15.105:0/2135812495 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d8035040 con 0x7f58e40d1d40 2024-09-21T03:25:20.346 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.343+0000 7f58e9b8b640 1 -- 172.21.15.105:0/2135812495 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58e40cb1c0 con 0x7f58e40d1d40 2024-09-21T03:25:20.347 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.343+0000 7f58e9b8b640 1 -- 172.21.15.105:0/2135812495 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58e40d1870 con 0x7f58e40d1d40 2024-09-21T03:25:20.347 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.344+0000 7f58cbfff640 1 -- 172.21.15.105:0/2135812495 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f58d8041030 con 0x7f58e40d1d40 2024-09-21T03:25:20.348 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.345+0000 7f58cbfff640 1 --2- 172.21.15.105:0/2135812495 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f58d0078bc0 0x7f58d007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:20.348 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.345+0000 7f58cbfff640 1 -- 172.21.15.105:0/2135812495 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f58d80bb4b0 con 0x7f58e40d1d40 2024-09-21T03:25:20.348 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.345+0000 7f58e37fe640 1 --2- 172.21.15.105:0/2135812495 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f58d0078bc0 0x7f58d007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:20.348 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.346+0000 7f58e37fe640 1 --2- 172.21.15.105:0/2135812495 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f58d0078bc0 0x7f58d007b0d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f58d4005fd0 tx=0x7f58d40095e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:20.351 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.349+0000 7f58cbfff640 1 -- 172.21.15.105:0/2135812495 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f58d80832b0 con 0x7f58e40d1d40 2024-09-21T03:25:20.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.528+0000 7f58e9b8b640 1 -- 172.21.15.105:0/2135812495 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_recall_warning_decay_rate"} v 0) -- 0x7f58e40b7f70 con 0x7f58e40d1d40 2024-09-21T03:25:20.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.529+0000 7f58cbfff640 1 -- 172.21.15.105:0/2135812495 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_recall_warning_decay_rate"}]=0 v55) ==== 112+0+10 (secure 0 0 0) 0x7f58d8087ce0 con 0x7f58e40d1d40 2024-09-21T03:25:20.530 INFO:teuthology.orchestra.run.smithi105.stdout:60.000000 2024-09-21T03:25:20.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.531+0000 7f58e9b8b640 1 -- 172.21.15.105:0/2135812495 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f58d0078bc0 msgr2=0x7f58d007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:20.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.531+0000 7f58e9b8b640 1 --2- 172.21.15.105:0/2135812495 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f58d0078bc0 0x7f58d007b0d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f58d4005fd0 tx=0x7f58d40095e0 comp rx=0 tx=0).stop 2024-09-21T03:25:20.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.531+0000 7f58e9b8b640 1 -- 172.21.15.105:0/2135812495 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58e40d1d40 msgr2=0x7f58e40cbbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:20.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.531+0000 7f58e9b8b640 1 --2- 172.21.15.105:0/2135812495 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58e40d1d40 0x7f58e40cbbd0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f58d8034040 tx=0x7f58d8003910 comp rx=0 tx=0).stop 2024-09-21T03:25:20.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.531+0000 7f58e9b8b640 1 -- 172.21.15.105:0/2135812495 shutdown_connections 2024-09-21T03:25:20.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.531+0000 7f58e9b8b640 1 --2- 172.21.15.105:0/2135812495 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f58d0078bc0 0x7f58d007b0d0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:20.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.531+0000 7f58e9b8b640 1 --2- 172.21.15.105:0/2135812495 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f58e415c6f0 0x7f58e415a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:20.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.531+0000 7f58e9b8b640 1 --2- 172.21.15.105:0/2135812495 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58e40d1d40 0x7f58e40cbbd0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:20.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.531+0000 7f58e9b8b640 1 --2- 172.21.15.105:0/2135812495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58e40ccba0 0x7f58e4155980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:20.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.531+0000 7f58e9b8b640 1 -- 172.21.15.105:0/2135812495 >> 172.21.15.105:0/2135812495 conn(0x7f58e40b3f10 msgr2=0x7f58e40b7010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:20.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.531+0000 7f58e9b8b640 1 -- 172.21.15.105:0/2135812495 shutdown_connections 2024-09-21T03:25:20.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.531+0000 7f58e9b8b640 1 -- 172.21.15.105:0/2135812495 wait complete. 2024-09-21T03:25:20.544 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:25:20.544 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:25:20.559 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:25:20.647 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:25:20.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:25:20.654 INFO:teuthology.orchestra.run.smithi105.stdout:client6098 2024-09-21T03:25:20.654 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:25:20.655 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:25:20.670 DEBUG:teuthology.orchestra.run.smithi105:> stdin-killer -- python3 -c ' 2024-09-21T03:25:20.671 DEBUG:teuthology.orchestra.run.smithi105:> import fcntl 2024-09-21T03:25:20.671 DEBUG:teuthology.orchestra.run.smithi105:> import sys 2024-09-21T03:25:20.671 DEBUG:teuthology.orchestra.run.smithi105:> import time 2024-09-21T03:25:20.671 DEBUG:teuthology.orchestra.run.smithi105:> import os 2024-09-21T03:25:20.671 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-21T03:25:20.671 DEBUG:teuthology.orchestra.run.smithi105:> fcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK) 2024-09-21T03:25:20.671 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-21T03:25:20.671 DEBUG:teuthology.orchestra.run.smithi105:> n = 800 2024-09-21T03:25:20.671 DEBUG:teuthology.orchestra.run.smithi105:> abs_path = "/home/ubuntu/cephtest/mnt.0/subdir" 2024-09-21T03:25:20.671 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-21T03:25:20.671 DEBUG:teuthology.orchestra.run.smithi105:> if not os.path.exists(abs_path): 2024-09-21T03:25:20.671 DEBUG:teuthology.orchestra.run.smithi105:> os.makedirs(abs_path) 2024-09-21T03:25:20.671 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-21T03:25:20.671 DEBUG:teuthology.orchestra.run.smithi105:> handles = [] 2024-09-21T03:25:20.672 DEBUG:teuthology.orchestra.run.smithi105:> for i in range(0, n): 2024-09-21T03:25:20.672 DEBUG:teuthology.orchestra.run.smithi105:> fname = "file_"+str(i) 2024-09-21T03:25:20.672 DEBUG:teuthology.orchestra.run.smithi105:> path = os.path.join(abs_path, fname) 2024-09-21T03:25:20.672 DEBUG:teuthology.orchestra.run.smithi105:> handles.append(open(path, '"'"'w'"'"')) 2024-09-21T03:25:20.672 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-21T03:25:20.672 DEBUG:teuthology.orchestra.run.smithi105:> print("waiting with handles open", file=sys.stderr) 2024-09-21T03:25:20.672 DEBUG:teuthology.orchestra.run.smithi105:> while True: 2024-09-21T03:25:20.672 DEBUG:teuthology.orchestra.run.smithi105:> print("open_n_background: keeping files open", file=sys.stderr) 2024-09-21T03:25:20.672 DEBUG:teuthology.orchestra.run.smithi105:> try: 2024-09-21T03:25:20.672 DEBUG:teuthology.orchestra.run.smithi105:> if os.read(0, 4096) == b"": 2024-09-21T03:25:20.672 DEBUG:teuthology.orchestra.run.smithi105:> break 2024-09-21T03:25:20.672 DEBUG:teuthology.orchestra.run.smithi105:> except BlockingIOError: 2024-09-21T03:25:20.672 DEBUG:teuthology.orchestra.run.smithi105:> pass 2024-09-21T03:25:20.672 DEBUG:teuthology.orchestra.run.smithi105:> time.sleep(2) 2024-09-21T03:25:20.672 DEBUG:teuthology.orchestra.run.smithi105:> print("stdin closed, goodbye!", file=sys.stderr) 2024-09-21T03:25:20.672 DEBUG:teuthology.orchestra.run.smithi105:> ' 2024-09-21T03:25:20.717 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:25:20.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.829+0000 7ffa97820640 1 -- 172.21.15.105:0/2585993816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa9015c580 msgr2=0x7ffa90070540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:20.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.829+0000 7ffa97820640 1 --2- 172.21.15.105:0/2585993816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa9015c580 0x7ffa90070540 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7ffa80009830 tx=0x7ffa8002a510 comp rx=0 tx=0).stop 2024-09-21T03:25:20.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.829+0000 7ffa97820640 1 -- 172.21.15.105:0/2585993816 shutdown_connections 2024-09-21T03:25:20.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.829+0000 7ffa97820640 1 --2- 172.21.15.105:0/2585993816 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa9015c580 0x7ffa90070540 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:20.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.829+0000 7ffa97820640 1 -- 172.21.15.105:0/2585993816 >> 172.21.15.105:0/2585993816 conn(0x7ffa9006def0 msgr2=0x7ffa9006e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:20.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.829+0000 7ffa97820640 1 -- 172.21.15.105:0/2585993816 shutdown_connections 2024-09-21T03:25:20.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.829+0000 7ffa97820640 1 -- 172.21.15.105:0/2585993816 wait complete. 2024-09-21T03:25:20.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.831+0000 7ffa97820640 1 Processor -- start 2024-09-21T03:25:20.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.831+0000 7ffa97820640 1 -- start start 2024-09-21T03:25:20.835 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.833+0000 7ffa97820640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa90074420 0x7ffa901f8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:20.835 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.833+0000 7ffa97820640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa90155ce0 0x7ffa901f5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:20.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.833+0000 7ffa97820640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa900c64c0 0x7ffa900c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:20.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.833+0000 7ffa97820640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ffa900b5290 con 0x7ffa900c64c0 2024-09-21T03:25:20.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.833+0000 7ffa97820640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ffa900b5110 con 0x7ffa90155ce0 2024-09-21T03:25:20.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.833+0000 7ffa97820640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ffa900b5410 con 0x7ffa90074420 2024-09-21T03:25:20.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.833+0000 7ffa95dbd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa900c64c0 0x7ffa900c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:20.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.833+0000 7ffa95dbd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa900c64c0 0x7ffa900c6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51782/0 (socket says 172.21.15.105:51782) 2024-09-21T03:25:20.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.833+0000 7ffa95dbd640 1 -- 172.21.15.105:0/4245554243 learned_addr learned my addr 172.21.15.105:0/4245554243 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:20.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.833+0000 7ffa94dbb640 1 --2- 172.21.15.105:0/4245554243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa90155ce0 0x7ffa901f5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:20.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.833+0000 7ffa955bc640 1 --2- 172.21.15.105:0/4245554243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa90074420 0x7ffa901f8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:20.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.833+0000 7ffa95dbd640 1 -- 172.21.15.105:0/4245554243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa90074420 msgr2=0x7ffa901f8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:20.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.833+0000 7ffa95dbd640 1 --2- 172.21.15.105:0/4245554243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa90074420 0x7ffa901f8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:20.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.833+0000 7ffa95dbd640 1 -- 172.21.15.105:0/4245554243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa90155ce0 msgr2=0x7ffa901f5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:20.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.833+0000 7ffa95dbd640 1 --2- 172.21.15.105:0/4245554243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa90155ce0 0x7ffa901f5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:20.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.833+0000 7ffa95dbd640 1 -- 172.21.15.105:0/4245554243 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa901f6050 con 0x7ffa900c64c0 2024-09-21T03:25:20.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.833+0000 7ffa94dbb640 1 --2- 172.21.15.105:0/4245554243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa90155ce0 0x7ffa901f5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:25:20.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.833+0000 7ffa95dbd640 1 --2- 172.21.15.105:0/4245554243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa900c64c0 0x7ffa900c6d00 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7ffa8800c760 tx=0x7ffa8800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:20.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.833+0000 7ffa85ffb640 1 -- 172.21.15.105:0/4245554243 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa88003da0 con 0x7ffa900c64c0 2024-09-21T03:25:20.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.833+0000 7ffa85ffb640 1 -- 172.21.15.105:0/4245554243 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa8800ce10 con 0x7ffa900c64c0 2024-09-21T03:25:20.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.833+0000 7ffa85ffb640 1 -- 172.21.15.105:0/4245554243 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa880052d0 con 0x7ffa900c64c0 2024-09-21T03:25:20.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.833+0000 7ffa97820640 1 -- 172.21.15.105:0/4245554243 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa901f9060 con 0x7ffa900c64c0 2024-09-21T03:25:20.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.834+0000 7ffa97820640 1 -- 172.21.15.105:0/4245554243 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa901f5310 con 0x7ffa900c64c0 2024-09-21T03:25:20.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.835+0000 7ffa97820640 1 -- 172.21.15.105:0/4245554243 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa901f8dd0 con 0x7ffa900c64c0 2024-09-21T03:25:20.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.835+0000 7ffa85ffb640 1 -- 172.21.15.105:0/4245554243 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ffa88005470 con 0x7ffa900c64c0 2024-09-21T03:25:20.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.836+0000 7ffa85ffb640 1 --2- 172.21.15.105:0/4245554243 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ffa74078b90 0x7ffa7407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:20.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.836+0000 7ffa85ffb640 1 -- 172.21.15.105:0/4245554243 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7ffa8809aa90 con 0x7ffa900c64c0 2024-09-21T03:25:20.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.836+0000 7ffa955bc640 1 --2- 172.21.15.105:0/4245554243 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ffa74078b90 0x7ffa7407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:20.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.837+0000 7ffa955bc640 1 --2- 172.21.15.105:0/4245554243 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ffa74078b90 0x7ffa7407b0a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c006fd0 tx=0x7ffa8c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:20.842 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:20.841+0000 7ffa85ffb640 1 -- 172.21.15.105:0/4245554243 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ffa88062ee0 con 0x7ffa900c64c0 2024-09-21T03:25:21.115 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:21.114+0000 7ffa97820640 1 -- 172.21.15.105:0/4245554243 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffa9015c580 con 0x7ffa900c64c0 2024-09-21T03:25:21.116 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:21.114+0000 7ffa85ffb640 1 -- 172.21.15.105:0/4245554243 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) ==== 94+0+5234 (secure 0 0 0) 0x7ffa880627e0 con 0x7ffa900c64c0 2024-09-21T03:25:21.116 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:21.116 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":65,"btime":"2024-09-21T03:25:08:950897+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5996,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/1026486886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1026486886},{"type":"v1","addr":"172.21.15.162:6836","nonce":1026486886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1085304139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1085304139},{"type":"v1","addr":"172.21.15.162:6837","nonce":1085304139}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":7161,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/569907499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":569907499},{"type":"v1","addr":"172.21.15.105:6833","nonce":569907499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:25:06.305459+0000","modified":"2024-09-21T03:25:08.303256+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7164},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7164":{"gid":7164,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/2917579803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2917579803},{"type":"v1","addr":"172.21.15.105:6835","nonce":2917579803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7164,"qdb_cluster":[7164]},"id":8}]} 2024-09-21T03:25:21.117 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 65 2024-09-21T03:25:21.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:21.117+0000 7ffa97820640 1 -- 172.21.15.105:0/4245554243 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ffa74078b90 msgr2=0x7ffa7407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:21.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:21.117+0000 7ffa97820640 1 --2- 172.21.15.105:0/4245554243 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ffa74078b90 0x7ffa7407b0a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c006fd0 tx=0x7ffa8c008040 comp rx=0 tx=0).stop 2024-09-21T03:25:21.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:21.117+0000 7ffa97820640 1 -- 172.21.15.105:0/4245554243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa900c64c0 msgr2=0x7ffa900c6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:21.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:21.117+0000 7ffa97820640 1 --2- 172.21.15.105:0/4245554243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa900c64c0 0x7ffa900c6d00 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7ffa8800c760 tx=0x7ffa8800cc20 comp rx=0 tx=0).stop 2024-09-21T03:25:21.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:21.117+0000 7ffa97820640 1 -- 172.21.15.105:0/4245554243 shutdown_connections 2024-09-21T03:25:21.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:21.117+0000 7ffa97820640 1 --2- 172.21.15.105:0/4245554243 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ffa74078b90 0x7ffa7407b0a0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:21.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:21.117+0000 7ffa97820640 1 --2- 172.21.15.105:0/4245554243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa900c64c0 0x7ffa900c6d00 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:21.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:21.117+0000 7ffa97820640 1 --2- 172.21.15.105:0/4245554243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa90155ce0 0x7ffa901f5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:21.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:21.117+0000 7ffa97820640 1 --2- 172.21.15.105:0/4245554243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa90074420 0x7ffa901f8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:21.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:21.117+0000 7ffa97820640 1 -- 172.21.15.105:0/4245554243 >> 172.21.15.105:0/4245554243 conn(0x7ffa9006def0 msgr2=0x7ffa9006e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:21.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:21.117+0000 7ffa97820640 1 -- 172.21.15.105:0/4245554243 shutdown_connections 2024-09-21T03:25:21.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:21.117+0000 7ffa97820640 1 -- 172.21.15.105:0/4245554243 wait complete. 2024-09-21T03:25:21.130 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-21T03:25:21.260 INFO:teuthology.orchestra.run.smithi105.stdout:[{"id":7350,"entity":{"name":{"type":"client","num":7350},"addr":{"type":"v1","addr":"172.21.15.162:0","nonce":1047057538}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":3.102936771,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.9906902816694023,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.7350 v1:172.21.15.162:0/1047057538","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi162","kernel_version":"5.14.0-508.el9.x86_64","root":"/"}},{"id":6098,"entity":{"name":{"type":"client","num":6098},"addr":{"type":"v1","addr":"172.21.15.105:0","nonce":1954970807}},"state":"open","num_leases":1,"num_caps":503,"request_load_avg":525,"uptime":4.2289138260000003,"requests_in_flight":416,"num_completed_requests":85,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":82.706159308023643,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":72.022557983007317,"halflife":1.5},"recall_caps_throttle2o":{"value":54.231228288217416,"halflife":0.5},"session_cache_liveness":{"value":1006.4221753942976,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":29,"last_trim_completed_flushes_tid":0,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.6098 v1:172.21.15.105:0/1954970807","completed_requests":[{"tid":29,"created_ino":"0x10000000001"},{"tid":30,"created_ino":"0x100000001f6"},{"tid":31,"created_ino":"0x100000001f7"},{"tid":32,"created_ino":"0x100000001f8"},{"tid":33,"created_ino":"0x100000001f9"},{"tid":34,"created_ino":"0x100000001fa"},{"tid":35,"created_ino":"0x100000001fb"},{"tid":36,"created_ino":"0x100000001fc"},{"tid":37,"created_ino":"0x100000001fd"},{"tid":38,"created_ino":"0x100000001fe"},{"tid":39,"created_ino":"0x100000001ff"},{"tid":40,"created_ino":"0x10000000200"},{"tid":41,"created_ino":"0x10000000201"},{"tid":42,"created_ino":"0x10000000202"},{"tid":43,"created_ino":"0x10000000203"},{"tid":44,"created_ino":"0x10000000204"},{"tid":45,"created_ino":"0x10000000205"},{"tid":46,"created_ino":"0x10000000206"},{"tid":47,"created_ino":"0x10000000207"},{"tid":48,"created_ino":"0x10000000208"},{"tid":49,"created_ino":"0x10000000209"},{"tid":50,"created_ino":"0x1000000020a"},{"tid":51,"created_ino":"0x1000000020b"},{"tid":52,"created_ino":"0x1000000020c"},{"tid":53,"created_ino":"0x1000000020d"},{"tid":54,"created_ino":"0x1000000020e"},{"tid":55,"created_ino":"0x1000000020f"},{"tid":56,"created_ino":"0x10000000210"},{"tid":57,"created_ino":"0x10000000211"},{"tid":58,"created_ino":"0x10000000212"},{"tid":59,"created_ino":"0x10000000213"},{"tid":60,"created_ino":"0x10000000214"},{"tid":61,"created_ino":"0x10000000215"},{"tid":62,"created_ino":"0x10000000216"},{"tid":63,"created_ino":"0x10000000217"},{"tid":64,"created_ino":"0x10000000218"},{"tid":65,"created_ino":"0x10000000219"},{"tid":66,"created_ino":"0x1000000021a"},{"tid":67,"created_ino":"0x1000000021b"},{"tid":68,"created_ino":"0x1000000021c"},{"tid":69,"created_ino":"0x1000000021d"},{"tid":70,"created_ino":"0x1000000021e"},{"tid":71,"created_ino":"0x1000000021f"},{"tid":72,"created_ino":"0x10000000220"},{"tid":73,"created_ino":"0x10000000221"},{"tid":74,"created_ino":"0x10000000222"},{"tid":75,"created_ino":"0x10000000223"},{"tid":76,"created_ino":"0x10000000224"},{"tid":77,"created_ino":"0x10000000225"},{"tid":78,"created_ino":"0x10000000226"},{"tid":79,"created_ino":"0x10000000227"},{"tid":80,"created_ino":"0x10000000228"},{"tid":81,"created_ino":"0x10000000229"},{"tid":82,"created_ino":"0x1000000022a"},{"tid":83,"created_ino":"0x1000000022b"},{"tid":84,"created_ino":"0x1000000022c"},{"tid":85,"created_ino":"0x1000000022d"},{"tid":86,"created_ino":"0x1000000022e"},{"tid":87,"created_ino":"0x1000000022f"},{"tid":88,"created_ino":"0x10000000230"},{"tid":89,"created_ino":"0x10000000231"},{"tid":90,"created_ino":"0x10000000232"},{"tid":91,"created_ino":"0x10000000233"},{"tid":92,"created_ino":"0x10000000234"},{"tid":93,"created_ino":"0x10000000235"},{"tid":94,"created_ino":"0x10000000236"},{"tid":95,"created_ino":"0x10000000237"},{"tid":96,"created_ino":"0x10000000238"},{"tid":97,"created_ino":"0x10000000239"},{"tid":98,"created_ino":"0x1000000023a"},{"tid":99,"created_ino":"0x1000000023b"},{"tid":100,"created_ino":"0x1000000023c"},{"tid":101,"created_ino":"0x1000000023d"},{"tid":102,"created_ino":"0x1000000023e"},{"tid":103,"created_ino":"0x1000000023f"},{"tid":104,"created_ino":"0x10000000240"},{"tid":105,"created_ino":"0x10000000241"},{"tid":106,"created_ino":"0x10000000242"},{"tid":107,"created_ino":"0x10000000243"},{"tid":108,"created_ino":"0x10000000244"},{"tid":109,"created_ino":"0x10000000245"},{"tid":110,"created_ino":"0x10000000246"},{"tid":111,"created_ino":"0x10000000247"},{"tid":112,"created_ino":"0x10000000248"},{"tid":113,"created_ino":"0x10000000249"}],"prealloc_inos":[{"start":"0x10000000002","length":500},{"start":"0x1000000024a","length":917}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi105","kernel_version":"5.14.0-508.el9.x86_64","root":"/"}}] 2024-09-21T03:25:21.261 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi162", "kernel_version": "5.14.0-508.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.162:0", "nonce": 1047057538, "type": "v1" }, "name": { "num": 7350, "type": "client" } }, "id": 7350, "inst": "client.7350 v1:172.21.15.162:0/1047057538", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.9906902816694023 }, "state": "open", "uptime": 3.102936771 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi105", "kernel_version": "5.14.0-508.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [ { "created_ino": "0x10000000001", "tid": 29 }, { "created_ino": "0x100000001f6", "tid": 30 }, { "created_ino": "0x100000001f7", "tid": 31 }, { "created_ino": "0x100000001f8", "tid": 32 }, { "created_ino": "0x100000001f9", "tid": 33 }, { "created_ino": "0x100000001fa", "tid": 34 }, { "created_ino": "0x100000001fb", "tid": 35 }, { "created_ino": "0x100000001fc", "tid": 36 }, { "created_ino": "0x100000001fd", "tid": 37 }, { "created_ino": "0x100000001fe", "tid": 38 }, { "created_ino": "0x100000001ff", "tid": 39 }, { "created_ino": "0x10000000200", "tid": 40 }, { "created_ino": "0x10000000201", "tid": 41 }, { "created_ino": "0x10000000202", "tid": 42 }, { "created_ino": "0x10000000203", "tid": 43 }, { "created_ino": "0x10000000204", "tid": 44 }, { "created_ino": "0x10000000205", "tid": 45 }, { "created_ino": "0x10000000206", "tid": 46 }, { "created_ino": "0x10000000207", "tid": 47 }, { "created_ino": "0x10000000208", "tid": 48 }, { "created_ino": "0x10000000209", "tid": 49 }, { "created_ino": "0x1000000020a", "tid": 50 }, { "created_ino": "0x1000000020b", "tid": 51 }, { "created_ino": "0x1000000020c", "tid": 52 }, { "created_ino": "0x1000000020d", "tid": 53 }, { "created_ino": "0x1000000020e", "tid": 54 }, { "created_ino": "0x1000000020f", "tid": 55 }, { "created_ino": "0x10000000210", "tid": 56 }, { "created_ino": "0x10000000211", "tid": 57 }, { "created_ino": "0x10000000212", "tid": 58 }, { "created_ino": "0x10000000213", "tid": 59 }, { "created_ino": "0x10000000214", "tid": 60 }, { "created_ino": "0x10000000215", "tid": 61 }, { "created_ino": "0x10000000216", "tid": 62 }, { "created_ino": "0x10000000217", "tid": 63 }, { "created_ino": "0x10000000218", "tid": 64 }, { "created_ino": "0x10000000219", "tid": 65 }, { "created_ino": "0x1000000021a", "tid": 66 }, { "created_ino": "0x1000000021b", "tid": 67 }, { "created_ino": "0x1000000021c", "tid": 68 }, { "created_ino": "0x1000000021d", "tid": 69 }, { "created_ino": "0x1000000021e", "tid": 70 }, { "created_ino": "0x1000000021f", "tid": 71 }, { "created_ino": "0x10000000220", "tid": 72 }, { "created_ino": "0x10000000221", "tid": 73 }, { "created_ino": "0x10000000222", "tid": 74 }, { "created_ino": "0x10000000223", "tid": 75 }, { "created_ino": "0x10000000224", "tid": 76 }, { "created_ino": "0x10000000225", "tid": 77 }, { "created_ino": "0x10000000226", "tid": 78 }, { "created_ino": "0x10000000227", "tid": 79 }, { "created_ino": "0x10000000228", "tid": 80 }, { "created_ino": "0x10000000229", "tid": 81 }, { "created_ino": "0x1000000022a", "tid": 82 }, { "created_ino": "0x1000000022b", "tid": 83 }, { "created_ino": "0x1000000022c", "tid": 84 }, { "created_ino": "0x1000000022d", "tid": 85 }, { "created_ino": "0x1000000022e", "tid": 86 }, { "created_ino": "0x1000000022f", "tid": 87 }, { "created_ino": "0x10000000230", "tid": 88 }, { "created_ino": "0x10000000231", "tid": 89 }, { "created_ino": "0x10000000232", "tid": 90 }, { "created_ino": "0x10000000233", "tid": 91 }, { "created_ino": "0x10000000234", "tid": 92 }, { "created_ino": "0x10000000235", "tid": 93 }, { "created_ino": "0x10000000236", "tid": 94 }, { "created_ino": "0x10000000237", "tid": 95 }, { "created_ino": "0x10000000238", "tid": 96 }, { "created_ino": "0x10000000239", "tid": 97 }, { "created_ino": "0x1000000023a", "tid": 98 }, { "created_ino": "0x1000000023b", "tid": 99 }, { "created_ino": "0x1000000023c", "tid": 100 }, { "created_ino": "0x1000000023d", "tid": 101 }, { "created_ino": "0x1000000023e", "tid": 102 }, { "created_ino": "0x1000000023f", "tid": 103 }, { "created_ino": "0x10000000240", "tid": 104 }, { "created_ino": "0x10000000241", "tid": 105 }, { "created_ino": "0x10000000242", "tid": 106 }, { "created_ino": "0x10000000243", "tid": 107 }, { "created_ino": "0x10000000244", "tid": 108 }, { "created_ino": "0x10000000245", "tid": 109 }, { "created_ino": "0x10000000246", "tid": 110 }, { "created_ino": "0x10000000247", "tid": 111 }, { "created_ino": "0x10000000248", "tid": 112 }, { "created_ino": "0x10000000249", "tid": 113 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "172.21.15.105:0", "nonce": 1954970807, "type": "v1" }, "name": { "num": 6098, "type": "client" } }, "id": 6098, "inst": "client.6098 v1:172.21.15.105:0/1954970807", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 29, "num_caps": 503, "num_completed_flushes": 0, "num_completed_requests": 85, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000002" }, { "length": 917, "start": "0x1000000024a" } ], "recall_caps": { "halflife": 60, "value": 82.70615930802364 }, "recall_caps_throttle": { "halflife": 1.5, "value": 72.02255798300732 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 54.231228288217416 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 525, "requests_in_flight": 416, "session_cache_liveness": { "halflife": 300, "value": 1006.4221753942976 }, "state": "open", "uptime": 4.228913826 } ] 2024-09-21T03:25:21.261 DEBUG:tasks.ceph_test_case:wait_until_equal: 503 != 802, waiting (timeout=600)... 2024-09-21T03:25:21.671 INFO:teuthology.orchestra.run.smithi105.stderr:waiting with handles open 2024-09-21T03:25:21.671 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:25:23.673 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:25:25.674 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:25:26.262 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:25:26.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.385+0000 7f1fb5b4a640 1 -- 172.21.15.105:0/170151384 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fb00cf320 msgr2=0x7f1fb00d0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:26.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.385+0000 7f1fb5b4a640 1 --2- 172.21.15.105:0/170151384 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fb00cf320 0x7f1fb00d0980 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0074af0 tx=0x7f1fa802a8b0 comp rx=0 tx=0).stop 2024-09-21T03:25:26.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.385+0000 7f1fb5b4a640 1 -- 172.21.15.105:0/170151384 shutdown_connections 2024-09-21T03:25:26.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.385+0000 7f1fb5b4a640 1 --2- 172.21.15.105:0/170151384 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fb00cf320 0x7f1fb00d0980 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:26.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.385+0000 7f1fb5b4a640 1 --2- 172.21.15.105:0/170151384 >> v2:172.21.15.162:3300/0 conn(0x7f1fb01600b0 0x7f1fb00ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:26.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.385+0000 7f1fb5b4a640 1 -- 172.21.15.105:0/170151384 >> 172.21.15.105:0/170151384 conn(0x7f1fb006d4f0 msgr2=0x7f1fb0071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:26.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.385+0000 7f1fb5b4a640 1 -- 172.21.15.105:0/170151384 shutdown_connections 2024-09-21T03:25:26.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.385+0000 7f1fb5b4a640 1 -- 172.21.15.105:0/170151384 wait complete. 2024-09-21T03:25:26.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.387+0000 7f1fb5b4a640 1 Processor -- start 2024-09-21T03:25:26.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.387+0000 7f1fb5b4a640 1 -- start start 2024-09-21T03:25:26.391 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.388+0000 7f1fb5b4a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fb00b7cc0 0x7f1fb00b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:26.391 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.388+0000 7f1fb5b4a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fb00cf320 0x7f1fb00b0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:26.391 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.388+0000 7f1fb5b4a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fb01600b0 0x7f1fb00cb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:26.391 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.388+0000 7f1fb5b4a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb00d13c0 con 0x7f1fb01600b0 2024-09-21T03:25:26.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.388+0000 7f1fb5b4a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb00d1240 con 0x7f1fb00b7cc0 2024-09-21T03:25:26.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.388+0000 7f1fb5b4a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1fb00d1540 con 0x7f1fb00cf320 2024-09-21T03:25:26.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.389+0000 7f1faffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fb01600b0 0x7f1fb00cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:26.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.389+0000 7f1faffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fb01600b0 0x7f1fb00cb590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:60058/0 (socket says 172.21.15.105:60058) 2024-09-21T03:25:26.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.389+0000 7f1faffff640 1 -- 172.21.15.105:0/1612279861 learned_addr learned my addr 172.21.15.105:0/1612279861 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:26.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.389+0000 7f1fa7fff640 1 --2- 172.21.15.105:0/1612279861 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fb00cf320 0x7f1fb00b0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:26.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.389+0000 7f1faf7fe640 1 --2- 172.21.15.105:0/1612279861 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fb00b7cc0 0x7f1fb00b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:26.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.389+0000 7f1faffff640 1 -- 172.21.15.105:0/1612279861 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fb00cf320 msgr2=0x7f1fb00b0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:26.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.389+0000 7f1faffff640 1 --2- 172.21.15.105:0/1612279861 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fb00cf320 0x7f1fb00b0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:26.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.389+0000 7f1faffff640 1 -- 172.21.15.105:0/1612279861 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fb00b7cc0 msgr2=0x7f1fb00b43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:26.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.389+0000 7f1faffff640 1 --2- 172.21.15.105:0/1612279861 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fb00b7cc0 0x7f1fb00b43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:26.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.389+0000 7f1faffff640 1 -- 172.21.15.105:0/1612279861 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fb00ca7d0 con 0x7f1fb01600b0 2024-09-21T03:25:26.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.389+0000 7f1faffff640 1 --2- 172.21.15.105:0/1612279861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fb01600b0 0x7f1fb00cb590 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8005fd0 tx=0x7f1fa80316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:26.393 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.389+0000 7f1facff9640 1 -- 172.21.15.105:0/1612279861 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8031990 con 0x7f1fb01600b0 2024-09-21T03:25:26.393 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.389+0000 7f1facff9640 1 -- 172.21.15.105:0/1612279861 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1fa8031c20 con 0x7f1fb01600b0 2024-09-21T03:25:26.393 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.389+0000 7f1facff9640 1 -- 172.21.15.105:0/1612279861 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8033070 con 0x7f1fb01600b0 2024-09-21T03:25:26.393 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.389+0000 7f1fb5b4a640 1 -- 172.21.15.105:0/1612279861 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fb00caab0 con 0x7f1fb01600b0 2024-09-21T03:25:26.393 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.389+0000 7f1fb5b4a640 1 -- 172.21.15.105:0/1612279861 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fb00cb070 con 0x7f1fb01600b0 2024-09-21T03:25:26.393 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.390+0000 7f1fb5b4a640 1 -- 172.21.15.105:0/1612279861 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fb00d1a60 con 0x7f1fb01600b0 2024-09-21T03:25:26.394 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.391+0000 7f1facff9640 1 -- 172.21.15.105:0/1612279861 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1fa8033210 con 0x7f1fb01600b0 2024-09-21T03:25:26.394 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.392+0000 7f1facff9640 1 --2- 172.21.15.105:0/1612279861 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1f90078bc0 0x7f1f9007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:26.394 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.392+0000 7f1facff9640 1 -- 172.21.15.105:0/1612279861 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f1fa80bc2b0 con 0x7f1fb01600b0 2024-09-21T03:25:26.394 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.392+0000 7f1faf7fe640 1 --2- 172.21.15.105:0/1612279861 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1f90078bc0 0x7f1f9007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:26.394 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.392+0000 7f1faf7fe640 1 --2- 172.21.15.105:0/1612279861 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1f90078bc0 0x7f1f9007b0d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f1fa000bb00 tx=0x7f1fa0005e30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:26.398 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.396+0000 7f1facff9640 1 -- 172.21.15.105:0/1612279861 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1fa803f030 con 0x7f1fb01600b0 2024-09-21T03:25:26.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.611+0000 7f1fb5b4a640 1 -- 172.21.15.105:0/1612279861 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1fb015bbc0 con 0x7f1fb01600b0 2024-09-21T03:25:26.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.611+0000 7f1facff9640 1 -- 172.21.15.105:0/1612279861 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5234 (secure 0 0 0) 0x7f1fa80846f0 con 0x7f1fb01600b0 2024-09-21T03:25:26.613 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:26.613 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":66,"btime":"2024-09-21T03:25:23:903940+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5996,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/1026486886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1026486886},{"type":"v1","addr":"172.21.15.162:6836","nonce":1026486886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1085304139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1085304139},{"type":"v1","addr":"172.21.15.162:6837","nonce":1085304139}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":7161,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/569907499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":569907499},{"type":"v1","addr":"172.21.15.105:6833","nonce":569907499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:25:06.305459+0000","modified":"2024-09-21T03:25:22.978021+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7164},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7164":{"gid":7164,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":7,"addr":"172.21.15.105:6835/2917579803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2917579803},{"type":"v1","addr":"172.21.15.105:6835","nonce":2917579803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7164,"qdb_cluster":[7164]},"id":8}]} 2024-09-21T03:25:26.613 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 66 2024-09-21T03:25:26.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.614+0000 7f1fb5b4a640 1 -- 172.21.15.105:0/1612279861 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1f90078bc0 msgr2=0x7f1f9007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:26.616 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.614+0000 7f1fb5b4a640 1 --2- 172.21.15.105:0/1612279861 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1f90078bc0 0x7f1f9007b0d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f1fa000bb00 tx=0x7f1fa0005e30 comp rx=0 tx=0).stop 2024-09-21T03:25:26.616 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.614+0000 7f1fb5b4a640 1 -- 172.21.15.105:0/1612279861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fb01600b0 msgr2=0x7f1fb00cb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:26.616 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.614+0000 7f1fb5b4a640 1 --2- 172.21.15.105:0/1612279861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fb01600b0 0x7f1fb00cb590 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8005fd0 tx=0x7f1fa80316d0 comp rx=0 tx=0).stop 2024-09-21T03:25:26.616 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.614+0000 7f1fb5b4a640 1 -- 172.21.15.105:0/1612279861 shutdown_connections 2024-09-21T03:25:26.616 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.614+0000 7f1fb5b4a640 1 --2- 172.21.15.105:0/1612279861 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1f90078bc0 0x7f1f9007b0d0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:26.616 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.614+0000 7f1fb5b4a640 1 --2- 172.21.15.105:0/1612279861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fb01600b0 0x7f1fb00cb590 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:26.616 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.614+0000 7f1fb5b4a640 1 --2- 172.21.15.105:0/1612279861 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1fb00cf320 0x7f1fb00b0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:26.616 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.614+0000 7f1fb5b4a640 1 --2- 172.21.15.105:0/1612279861 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fb00b7cc0 0x7f1fb00b43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:26.616 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.614+0000 7f1fb5b4a640 1 -- 172.21.15.105:0/1612279861 >> 172.21.15.105:0/1612279861 conn(0x7f1fb006d4f0 msgr2=0x7f1fb015a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:26.616 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.614+0000 7f1fb5b4a640 1 -- 172.21.15.105:0/1612279861 shutdown_connections 2024-09-21T03:25:26.616 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.614+0000 7f1fb5b4a640 1 -- 172.21.15.105:0/1612279861 wait complete. 2024-09-21T03:25:26.626 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-21T03:25:26.753 INFO:teuthology.orchestra.run.smithi105.stdout:[{"id":7350,"entity":{"name":{"type":"client","num":7350},"addr":{"type":"v1","addr":"172.21.15.162:0","nonce":1047057538}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":8.5948249229999991,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.9529812941887084,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.7350 v1:172.21.15.162:0/1047057538","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi162","kernel_version":"5.14.0-508.el9.x86_64","root":"/"}},{"id":6098,"entity":{"name":{"type":"client","num":6098},"addr":{"type":"v1","addr":"172.21.15.105:0","nonce":1954970807}},"state":"open","num_leases":1,"num_caps":802,"request_load_avg":775,"uptime":9.7208019780000008,"requests_in_flight":0,"num_completed_requests":299,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":2014.2770214504471,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":679.44172235896849,"halflife":1.5},"recall_caps_throttle2o":{"value":176.69550057123229,"halflife":0.5},"session_cache_liveness":{"value":1584.5309924201579,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":530,"last_trim_completed_flushes_tid":0,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.6098 v1:172.21.15.105:0/1954970807","completed_requests":[{"tid":530,"created_ino":"0x100000003e9"},{"tid":531,"created_ino":"0x100000003ea"},{"tid":532,"created_ino":"0x100000003eb"},{"tid":533,"created_ino":"0x100000003ec"},{"tid":534,"created_ino":"0x100000003ed"},{"tid":535,"created_ino":"0x100000003ee"},{"tid":536,"created_ino":"0x100000003ef"},{"tid":537,"created_ino":"0x100000003f0"},{"tid":538,"created_ino":"0x100000003f1"},{"tid":539,"created_ino":"0x100000003f2"},{"tid":540,"created_ino":"0x100000003f3"},{"tid":541,"created_ino":"0x100000003f4"},{"tid":542,"created_ino":"0x100000003f5"},{"tid":543,"created_ino":"0x100000003f6"},{"tid":544,"created_ino":"0x100000003f7"},{"tid":545,"created_ino":"0x100000003f8"},{"tid":546,"created_ino":"0x100000003f9"},{"tid":547,"created_ino":"0x100000003fa"},{"tid":548,"created_ino":"0x100000003fb"},{"tid":549,"created_ino":"0x100000003fc"},{"tid":550,"created_ino":"0x100000003fd"},{"tid":551,"created_ino":"0x100000003fe"},{"tid":552,"created_ino":"0x100000003ff"},{"tid":553,"created_ino":"0x10000000400"},{"tid":554,"created_ino":"0x10000000401"},{"tid":555,"created_ino":"0x10000000402"},{"tid":556,"created_ino":"0x10000000403"},{"tid":557,"created_ino":"0x10000000404"},{"tid":558,"created_ino":"0x10000000405"},{"tid":559,"created_ino":"0x10000000406"},{"tid":560,"created_ino":"0x10000000407"},{"tid":561,"created_ino":"0x10000000408"},{"tid":562,"created_ino":"0x10000000409"},{"tid":563,"created_ino":"0x1000000040a"},{"tid":564,"created_ino":"0x1000000040b"},{"tid":565,"created_ino":"0x1000000040c"},{"tid":566,"created_ino":"0x1000000040d"},{"tid":567,"created_ino":"0x1000000040e"},{"tid":568,"created_ino":"0x1000000040f"},{"tid":569,"created_ino":"0x10000000410"},{"tid":570,"created_ino":"0x10000000411"},{"tid":571,"created_ino":"0x10000000412"},{"tid":572,"created_ino":"0x10000000413"},{"tid":573,"created_ino":"0x10000000414"},{"tid":574,"created_ino":"0x10000000415"},{"tid":575,"created_ino":"0x10000000416"},{"tid":576,"created_ino":"0x10000000417"},{"tid":577,"created_ino":"0x10000000418"},{"tid":578,"created_ino":"0x10000000419"},{"tid":579,"created_ino":"0x1000000041a"},{"tid":580,"created_ino":"0x1000000041b"},{"tid":581,"created_ino":"0x1000000041c"},{"tid":582,"created_ino":"0x1000000041d"},{"tid":583,"created_ino":"0x1000000041e"},{"tid":584,"created_ino":"0x1000000041f"},{"tid":585,"created_ino":"0x10000000420"},{"tid":586,"created_ino":"0x10000000421"},{"tid":587,"created_ino":"0x10000000422"},{"tid":588,"created_ino":"0x10000000423"},{"tid":589,"created_ino":"0x10000000424"},{"tid":590,"created_ino":"0x10000000425"},{"tid":591,"created_ino":"0x10000000426"},{"tid":592,"created_ino":"0x10000000427"},{"tid":593,"created_ino":"0x10000000428"},{"tid":594,"created_ino":"0x10000000429"},{"tid":595,"created_ino":"0x1000000042a"},{"tid":596,"created_ino":"0x1000000042b"},{"tid":597,"created_ino":"0x1000000042c"},{"tid":598,"created_ino":"0x1000000042d"},{"tid":599,"created_ino":"0x1000000042e"},{"tid":600,"created_ino":"0x1000000042f"},{"tid":601,"created_ino":"0x10000000430"},{"tid":602,"created_ino":"0x10000000431"},{"tid":603,"created_ino":"0x10000000432"},{"tid":604,"created_ino":"0x10000000433"},{"tid":605,"created_ino":"0x10000000434"},{"tid":606,"created_ino":"0x10000000435"},{"tid":607,"created_ino":"0x10000000436"},{"tid":608,"created_ino":"0x10000000437"},{"tid":609,"created_ino":"0x10000000438"},{"tid":610,"created_ino":"0x10000000439"},{"tid":611,"created_ino":"0x1000000043a"},{"tid":612,"created_ino":"0x1000000043b"},{"tid":613,"created_ino":"0x1000000043c"},{"tid":614,"created_ino":"0x1000000043d"},{"tid":615,"created_ino":"0x1000000043e"},{"tid":616,"created_ino":"0x1000000043f"},{"tid":617,"created_ino":"0x10000000440"},{"tid":618,"created_ino":"0x10000000441"},{"tid":619,"created_ino":"0x10000000442"},{"tid":620,"created_ino":"0x10000000443"},{"tid":621,"created_ino":"0x10000000444"},{"tid":622,"created_ino":"0x10000000445"},{"tid":623,"created_ino":"0x10000000446"},{"tid":624,"created_ino":"0x10000000447"},{"tid":625,"created_ino":"0x10000000448"},{"tid":626,"created_ino":"0x10000000449"},{"tid":627,"created_ino":"0x1000000044a"},{"tid":628,"created_ino":"0x1000000044b"},{"tid":629,"created_ino":"0x1000000044c"},{"tid":630,"created_ino":"0x1000000044d"},{"tid":631,"created_ino":"0x1000000044e"},{"tid":632,"created_ino":"0x1000000044f"},{"tid":633,"created_ino":"0x10000000450"},{"tid":634,"created_ino":"0x10000000451"},{"tid":635,"created_ino":"0x10000000452"},{"tid":636,"created_ino":"0x10000000453"},{"tid":637,"created_ino":"0x10000000454"},{"tid":638,"created_ino":"0x10000000455"},{"tid":639,"created_ino":"0x10000000456"},{"tid":640,"created_ino":"0x10000000457"},{"tid":641,"created_ino":"0x10000000458"},{"tid":642,"created_ino":"0x10000000459"},{"tid":643,"created_ino":"0x1000000045a"},{"tid":644,"created_ino":"0x1000000045b"},{"tid":645,"created_ino":"0x1000000045c"},{"tid":646,"created_ino":"0x1000000045d"},{"tid":647,"created_ino":"0x1000000045e"},{"tid":648,"created_ino":"0x1000000045f"},{"tid":649,"created_ino":"0x10000000460"},{"tid":650,"created_ino":"0x10000000461"},{"tid":651,"created_ino":"0x10000000462"},{"tid":652,"created_ino":"0x10000000463"},{"tid":653,"created_ino":"0x10000000464"},{"tid":654,"created_ino":"0x10000000465"},{"tid":655,"created_ino":"0x10000000466"},{"tid":656,"created_ino":"0x10000000467"},{"tid":657,"created_ino":"0x10000000468"},{"tid":658,"created_ino":"0x10000000469"},{"tid":659,"created_ino":"0x1000000046a"},{"tid":660,"created_ino":"0x1000000046b"},{"tid":661,"created_ino":"0x1000000046c"},{"tid":662,"created_ino":"0x1000000046d"},{"tid":663,"created_ino":"0x1000000046e"},{"tid":664,"created_ino":"0x1000000046f"},{"tid":665,"created_ino":"0x10000000470"},{"tid":666,"created_ino":"0x10000000471"},{"tid":667,"created_ino":"0x10000000472"},{"tid":668,"created_ino":"0x10000000473"},{"tid":669,"created_ino":"0x10000000474"},{"tid":670,"created_ino":"0x10000000475"},{"tid":671,"created_ino":"0x10000000476"},{"tid":672,"created_ino":"0x10000000477"},{"tid":673,"created_ino":"0x10000000478"},{"tid":674,"created_ino":"0x10000000479"},{"tid":675,"created_ino":"0x1000000047a"},{"tid":676,"created_ino":"0x1000000047b"},{"tid":677,"created_ino":"0x1000000047c"},{"tid":678,"created_ino":"0x1000000047d"},{"tid":679,"created_ino":"0x1000000047e"},{"tid":680,"created_ino":"0x1000000047f"},{"tid":681,"created_ino":"0x10000000480"},{"tid":682,"created_ino":"0x10000000481"},{"tid":683,"created_ino":"0x10000000482"},{"tid":684,"created_ino":"0x10000000483"},{"tid":685,"created_ino":"0x10000000484"},{"tid":686,"created_ino":"0x10000000485"},{"tid":687,"created_ino":"0x10000000486"},{"tid":688,"created_ino":"0x10000000487"},{"tid":689,"created_ino":"0x10000000488"},{"tid":690,"created_ino":"0x10000000489"},{"tid":691,"created_ino":"0x1000000048a"},{"tid":692,"created_ino":"0x1000000048b"},{"tid":693,"created_ino":"0x1000000048c"},{"tid":694,"created_ino":"0x1000000048d"},{"tid":695,"created_ino":"0x1000000048e"},{"tid":696,"created_ino":"0x1000000048f"},{"tid":697,"created_ino":"0x10000000490"},{"tid":698,"created_ino":"0x10000000491"},{"tid":699,"created_ino":"0x10000000492"},{"tid":700,"created_ino":"0x10000000493"},{"tid":701,"created_ino":"0x10000000494"},{"tid":702,"created_ino":"0x10000000495"},{"tid":703,"created_ino":"0x10000000496"},{"tid":704,"created_ino":"0x10000000497"},{"tid":705,"created_ino":"0x10000000498"},{"tid":706,"created_ino":"0x10000000499"},{"tid":707,"created_ino":"0x1000000049a"},{"tid":708,"created_ino":"0x1000000049b"},{"tid":709,"created_ino":"0x1000000049c"},{"tid":710,"created_ino":"0x1000000049d"},{"tid":711,"created_ino":"0x1000000049e"},{"tid":712,"created_ino":"0x1000000049f"},{"tid":713,"created_ino":"0x100000004a0"},{"tid":714,"created_ino":"0x100000004a1"},{"tid":715,"created_ino":"0x100000004a2"},{"tid":716,"created_ino":"0x100000004a3"},{"tid":717,"created_ino":"0x100000004a4"},{"tid":718,"created_ino":"0x100000004a5"},{"tid":719,"created_ino":"0x100000004a6"},{"tid":720,"created_ino":"0x100000004a7"},{"tid":721,"created_ino":"0x100000004a8"},{"tid":722,"created_ino":"0x100000004a9"},{"tid":723,"created_ino":"0x100000004aa"},{"tid":724,"created_ino":"0x100000004ab"},{"tid":725,"created_ino":"0x100000004ac"},{"tid":726,"created_ino":"0x100000004ad"},{"tid":727,"created_ino":"0x100000004ae"},{"tid":728,"created_ino":"0x100000004af"},{"tid":729,"created_ino":"0x100000004b0"},{"tid":730,"created_ino":"0x100000004b1"},{"tid":731,"created_ino":"0x100000004b2"},{"tid":732,"created_ino":"0x100000004b3"},{"tid":733,"created_ino":"0x100000004b4"},{"tid":734,"created_ino":"0x100000004b5"},{"tid":735,"created_ino":"0x100000004b6"},{"tid":736,"created_ino":"0x100000004b7"},{"tid":737,"created_ino":"0x100000004b8"},{"tid":738,"created_ino":"0x100000004b9"},{"tid":739,"created_ino":"0x100000004ba"},{"tid":740,"created_ino":"0x100000004bb"},{"tid":741,"created_ino":"0x100000004bc"},{"tid":742,"created_ino":"0x100000004bd"},{"tid":743,"created_ino":"0x100000004be"},{"tid":744,"created_ino":"0x100000004bf"},{"tid":745,"created_ino":"0x100000004c0"},{"tid":746,"created_ino":"0x100000004c1"},{"tid":747,"created_ino":"0x100000004c2"},{"tid":748,"created_ino":"0x100000004c3"},{"tid":749,"created_ino":"0x100000004c4"},{"tid":750,"created_ino":"0x100000004c5"},{"tid":751,"created_ino":"0x100000004c6"},{"tid":752,"created_ino":"0x100000004c7"},{"tid":753,"created_ino":"0x100000004c8"},{"tid":754,"created_ino":"0x100000004c9"},{"tid":755,"created_ino":"0x100000004ca"},{"tid":756,"created_ino":"0x100000004cb"},{"tid":757,"created_ino":"0x100000004cc"},{"tid":758,"created_ino":"0x100000004cd"},{"tid":759,"created_ino":"0x100000004ce"},{"tid":760,"created_ino":"0x100000004cf"},{"tid":761,"created_ino":"0x100000004d0"},{"tid":762,"created_ino":"0x100000004d1"},{"tid":763,"created_ino":"0x100000004d2"},{"tid":764,"created_ino":"0x100000004d3"},{"tid":765,"created_ino":"0x100000004d4"},{"tid":766,"created_ino":"0x100000004d5"},{"tid":767,"created_ino":"0x100000004d6"},{"tid":768,"created_ino":"0x100000004d7"},{"tid":769,"created_ino":"0x100000004d8"},{"tid":770,"created_ino":"0x100000004d9"},{"tid":771,"created_ino":"0x100000004da"},{"tid":772,"created_ino":"0x100000004db"},{"tid":773,"created_ino":"0x100000004dc"},{"tid":774,"created_ino":"0x100000004dd"},{"tid":775,"created_ino":"0x100000004de"},{"tid":776,"created_ino":"0x100000004df"},{"tid":777,"created_ino":"0x100000004e0"},{"tid":778,"created_ino":"0x100000004e1"},{"tid":779,"created_ino":"0x100000004e2"},{"tid":780,"created_ino":"0x100000004e3"},{"tid":781,"created_ino":"0x100000004e4"},{"tid":782,"created_ino":"0x100000004e5"},{"tid":783,"created_ino":"0x100000004e6"},{"tid":784,"created_ino":"0x100000004e7"},{"tid":785,"created_ino":"0x100000004e8"},{"tid":786,"created_ino":"0x100000004e9"},{"tid":787,"created_ino":"0x100000004ea"},{"tid":788,"created_ino":"0x100000004eb"},{"tid":789,"created_ino":"0x100000004ec"},{"tid":790,"created_ino":"0x100000004ed"},{"tid":791,"created_ino":"0x100000004ee"},{"tid":792,"created_ino":"0x100000004ef"},{"tid":793,"created_ino":"0x100000004f0"},{"tid":794,"created_ino":"0x100000004f1"},{"tid":795,"created_ino":"0x100000004f2"},{"tid":796,"created_ino":"0x100000004f3"},{"tid":797,"created_ino":"0x100000004f4"},{"tid":798,"created_ino":"0x100000004f5"},{"tid":799,"created_ino":"0x100000004f6"},{"tid":800,"created_ino":"0x100000004f7"},{"tid":801,"created_ino":"0x100000004f8"},{"tid":802,"created_ino":"0x100000004f9"},{"tid":803,"created_ino":"0x100000004fa"},{"tid":804,"created_ino":"0x100000004fb"},{"tid":805,"created_ino":"0x100000004fc"},{"tid":806,"created_ino":"0x100000004fd"},{"tid":807,"created_ino":"0x100000004fe"},{"tid":808,"created_ino":"0x100000004ff"},{"tid":809,"created_ino":"0x10000000500"},{"tid":810,"created_ino":"0x10000000501"},{"tid":811,"created_ino":"0x10000000502"},{"tid":812,"created_ino":"0x10000000503"},{"tid":813,"created_ino":"0x10000000504"},{"tid":814,"created_ino":"0x10000000505"},{"tid":815,"created_ino":"0x10000000506"},{"tid":816,"created_ino":"0x10000000507"},{"tid":817,"created_ino":"0x10000000508"},{"tid":818,"created_ino":"0x10000000509"},{"tid":819,"created_ino":"0x1000000050a"},{"tid":820,"created_ino":"0x1000000050b"},{"tid":821,"created_ino":"0x1000000050c"},{"tid":822,"created_ino":"0x1000000050d"},{"tid":823,"created_ino":"0x1000000050e"},{"tid":824,"created_ino":"0x1000000050f"},{"tid":825,"created_ino":"0x10000000510"},{"tid":826,"created_ino":"0x10000000511"},{"tid":827,"created_ino":"0x10000000512"},{"tid":828,"created_ino":"0x10000000513"}],"prealloc_inos":[{"start":"0x10000000002","length":500},{"start":"0x10000000514","length":203},{"start":"0x100000005e0","length":501}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi105","kernel_version":"5.14.0-508.el9.x86_64","root":"/"}}] 2024-09-21T03:25:26.755 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi162", "kernel_version": "5.14.0-508.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.162:0", "nonce": 1047057538, "type": "v1" }, "name": { "num": 7350, "type": "client" } }, "id": 7350, "inst": "client.7350 v1:172.21.15.162:0/1047057538", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.9529812941887084 }, "state": "open", "uptime": 8.594824923 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi105", "kernel_version": "5.14.0-508.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [ { "created_ino": "0x100000003e9", "tid": 530 }, { "created_ino": "0x100000003ea", "tid": 531 }, { "created_ino": "0x100000003eb", "tid": 532 }, { "created_ino": "0x100000003ec", "tid": 533 }, { "created_ino": "0x100000003ed", "tid": 534 }, { "created_ino": "0x100000003ee", "tid": 535 }, { "created_ino": "0x100000003ef", "tid": 536 }, { "created_ino": "0x100000003f0", "tid": 537 }, { "created_ino": "0x100000003f1", "tid": 538 }, { "created_ino": "0x100000003f2", "tid": 539 }, { "created_ino": "0x100000003f3", "tid": 540 }, { "created_ino": "0x100000003f4", "tid": 541 }, { "created_ino": "0x100000003f5", "tid": 542 }, { "created_ino": "0x100000003f6", "tid": 543 }, { "created_ino": "0x100000003f7", "tid": 544 }, { "created_ino": "0x100000003f8", "tid": 545 }, { "created_ino": "0x100000003f9", "tid": 546 }, { "created_ino": "0x100000003fa", "tid": 547 }, { "created_ino": "0x100000003fb", "tid": 548 }, { "created_ino": "0x100000003fc", "tid": 549 }, { "created_ino": "0x100000003fd", "tid": 550 }, { "created_ino": "0x100000003fe", "tid": 551 }, { "created_ino": "0x100000003ff", "tid": 552 }, { "created_ino": "0x10000000400", "tid": 553 }, { "created_ino": "0x10000000401", "tid": 554 }, { "created_ino": "0x10000000402", "tid": 555 }, { "created_ino": "0x10000000403", "tid": 556 }, { "created_ino": "0x10000000404", "tid": 557 }, { "created_ino": "0x10000000405", "tid": 558 }, { "created_ino": "0x10000000406", "tid": 559 }, { "created_ino": "0x10000000407", "tid": 560 }, { "created_ino": "0x10000000408", "tid": 561 }, { "created_ino": "0x10000000409", "tid": 562 }, { "created_ino": "0x1000000040a", "tid": 563 }, { "created_ino": "0x1000000040b", "tid": 564 }, { "created_ino": "0x1000000040c", "tid": 565 }, { "created_ino": "0x1000000040d", "tid": 566 }, { "created_ino": "0x1000000040e", "tid": 567 }, { "created_ino": "0x1000000040f", "tid": 568 }, { "created_ino": "0x10000000410", "tid": 569 }, { "created_ino": "0x10000000411", "tid": 570 }, { "created_ino": "0x10000000412", "tid": 571 }, { "created_ino": "0x10000000413", "tid": 572 }, { "created_ino": "0x10000000414", "tid": 573 }, { "created_ino": "0x10000000415", "tid": 574 }, { "created_ino": "0x10000000416", "tid": 575 }, { "created_ino": "0x10000000417", "tid": 576 }, { "created_ino": "0x10000000418", "tid": 577 }, { "created_ino": "0x10000000419", "tid": 578 }, { "created_ino": "0x1000000041a", "tid": 579 }, { "created_ino": "0x1000000041b", "tid": 580 }, { "created_ino": "0x1000000041c", "tid": 581 }, { "created_ino": "0x1000000041d", "tid": 582 }, { "created_ino": "0x1000000041e", "tid": 583 }, { "created_ino": "0x1000000041f", "tid": 584 }, { "created_ino": "0x10000000420", "tid": 585 }, { "created_ino": "0x10000000421", "tid": 586 }, { "created_ino": "0x10000000422", "tid": 587 }, { "created_ino": "0x10000000423", "tid": 588 }, { "created_ino": "0x10000000424", "tid": 589 }, { "created_ino": "0x10000000425", "tid": 590 }, { "created_ino": "0x10000000426", "tid": 591 }, { "created_ino": "0x10000000427", "tid": 592 }, { "created_ino": "0x10000000428", "tid": 593 }, { "created_ino": "0x10000000429", "tid": 594 }, { "created_ino": "0x1000000042a", "tid": 595 }, { "created_ino": "0x1000000042b", "tid": 596 }, { "created_ino": "0x1000000042c", "tid": 597 }, { "created_ino": "0x1000000042d", "tid": 598 }, { "created_ino": "0x1000000042e", "tid": 599 }, { "created_ino": "0x1000000042f", "tid": 600 }, { "created_ino": "0x10000000430", "tid": 601 }, { "created_ino": "0x10000000431", "tid": 602 }, { "created_ino": "0x10000000432", "tid": 603 }, { "created_ino": "0x10000000433", "tid": 604 }, { "created_ino": "0x10000000434", "tid": 605 }, { "created_ino": "0x10000000435", "tid": 606 }, { "created_ino": "0x10000000436", "tid": 607 }, { "created_ino": "0x10000000437", "tid": 608 }, { "created_ino": "0x10000000438", "tid": 609 }, { "created_ino": "0x10000000439", "tid": 610 }, { "created_ino": "0x1000000043a", "tid": 611 }, { "created_ino": "0x1000000043b", "tid": 612 }, { "created_ino": "0x1000000043c", "tid": 613 }, { "created_ino": "0x1000000043d", "tid": 614 }, { "created_ino": "0x1000000043e", "tid": 615 }, { "created_ino": "0x1000000043f", "tid": 616 }, { "created_ino": "0x10000000440", "tid": 617 }, { "created_ino": "0x10000000441", "tid": 618 }, { "created_ino": "0x10000000442", "tid": 619 }, { "created_ino": "0x10000000443", "tid": 620 }, { "created_ino": "0x10000000444", "tid": 621 }, { "created_ino": "0x10000000445", "tid": 622 }, { "created_ino": "0x10000000446", "tid": 623 }, { "created_ino": "0x10000000447", "tid": 624 }, { "created_ino": "0x10000000448", "tid": 625 }, { "created_ino": "0x10000000449", "tid": 626 }, { "created_ino": "0x1000000044a", "tid": 627 }, { "created_ino": "0x1000000044b", "tid": 628 }, { "created_ino": "0x1000000044c", "tid": 629 }, { "created_ino": "0x1000000044d", "tid": 630 }, { "created_ino": "0x1000000044e", "tid": 631 }, { "created_ino": "0x1000000044f", "tid": 632 }, { "created_ino": "0x10000000450", "tid": 633 }, { "created_ino": "0x10000000451", "tid": 634 }, { "created_ino": "0x10000000452", "tid": 635 }, { "created_ino": "0x10000000453", "tid": 636 }, { "created_ino": "0x10000000454", "tid": 637 }, { "created_ino": "0x10000000455", "tid": 638 }, { "created_ino": "0x10000000456", "tid": 639 }, { "created_ino": "0x10000000457", "tid": 640 }, { "created_ino": "0x10000000458", "tid": 641 }, { "created_ino": "0x10000000459", "tid": 642 }, { "created_ino": "0x1000000045a", "tid": 643 }, { "created_ino": "0x1000000045b", "tid": 644 }, { "created_ino": "0x1000000045c", "tid": 645 }, { "created_ino": "0x1000000045d", "tid": 646 }, { "created_ino": "0x1000000045e", "tid": 647 }, { "created_ino": "0x1000000045f", "tid": 648 }, { "created_ino": "0x10000000460", "tid": 649 }, { "created_ino": "0x10000000461", "tid": 650 }, { "created_ino": "0x10000000462", "tid": 651 }, { "created_ino": "0x10000000463", "tid": 652 }, { "created_ino": "0x10000000464", "tid": 653 }, { "created_ino": "0x10000000465", "tid": 654 }, { "created_ino": "0x10000000466", "tid": 655 }, { "created_ino": "0x10000000467", "tid": 656 }, { "created_ino": "0x10000000468", "tid": 657 }, { "created_ino": "0x10000000469", "tid": 658 }, { "created_ino": "0x1000000046a", "tid": 659 }, { "created_ino": "0x1000000046b", "tid": 660 }, { "created_ino": "0x1000000046c", "tid": 661 }, { "created_ino": "0x1000000046d", "tid": 662 }, { "created_ino": "0x1000000046e", "tid": 663 }, { "created_ino": "0x1000000046f", "tid": 664 }, { "created_ino": "0x10000000470", "tid": 665 }, { "created_ino": "0x10000000471", "tid": 666 }, { "created_ino": "0x10000000472", "tid": 667 }, { "created_ino": "0x10000000473", "tid": 668 }, { "created_ino": "0x10000000474", "tid": 669 }, { "created_ino": "0x10000000475", "tid": 670 }, { "created_ino": "0x10000000476", "tid": 671 }, { "created_ino": "0x10000000477", "tid": 672 }, { "created_ino": "0x10000000478", "tid": 673 }, { "created_ino": "0x10000000479", "tid": 674 }, { "created_ino": "0x1000000047a", "tid": 675 }, { "created_ino": "0x1000000047b", "tid": 676 }, { "created_ino": "0x1000000047c", "tid": 677 }, { "created_ino": "0x1000000047d", "tid": 678 }, { "created_ino": "0x1000000047e", "tid": 679 }, { "created_ino": "0x1000000047f", "tid": 680 }, { "created_ino": "0x10000000480", "tid": 681 }, { "created_ino": "0x10000000481", "tid": 682 }, { "created_ino": "0x10000000482", "tid": 683 }, { "created_ino": "0x10000000483", "tid": 684 }, { "created_ino": "0x10000000484", "tid": 685 }, { "created_ino": "0x10000000485", "tid": 686 }, { "created_ino": "0x10000000486", "tid": 687 }, { "created_ino": "0x10000000487", "tid": 688 }, { "created_ino": "0x10000000488", "tid": 689 }, { "created_ino": "0x10000000489", "tid": 690 }, { "created_ino": "0x1000000048a", "tid": 691 }, { "created_ino": "0x1000000048b", "tid": 692 }, { "created_ino": "0x1000000048c", "tid": 693 }, { "created_ino": "0x1000000048d", "tid": 694 }, { "created_ino": "0x1000000048e", "tid": 695 }, { "created_ino": "0x1000000048f", "tid": 696 }, { "created_ino": "0x10000000490", "tid": 697 }, { "created_ino": "0x10000000491", "tid": 698 }, { "created_ino": "0x10000000492", "tid": 699 }, { "created_ino": "0x10000000493", "tid": 700 }, { "created_ino": "0x10000000494", "tid": 701 }, { "created_ino": "0x10000000495", "tid": 702 }, { "created_ino": "0x10000000496", "tid": 703 }, { "created_ino": "0x10000000497", "tid": 704 }, { "created_ino": "0x10000000498", "tid": 705 }, { "created_ino": "0x10000000499", "tid": 706 }, { "created_ino": "0x1000000049a", "tid": 707 }, { "created_ino": "0x1000000049b", "tid": 708 }, { "created_ino": "0x1000000049c", "tid": 709 }, { "created_ino": "0x1000000049d", "tid": 710 }, { "created_ino": "0x1000000049e", "tid": 711 }, { "created_ino": "0x1000000049f", "tid": 712 }, { "created_ino": "0x100000004a0", "tid": 713 }, { "created_ino": "0x100000004a1", "tid": 714 }, { "created_ino": "0x100000004a2", "tid": 715 }, { "created_ino": "0x100000004a3", "tid": 716 }, { "created_ino": "0x100000004a4", "tid": 717 }, { "created_ino": "0x100000004a5", "tid": 718 }, { "created_ino": "0x100000004a6", "tid": 719 }, { "created_ino": "0x100000004a7", "tid": 720 }, { "created_ino": "0x100000004a8", "tid": 721 }, { "created_ino": "0x100000004a9", "tid": 722 }, { "created_ino": "0x100000004aa", "tid": 723 }, { "created_ino": "0x100000004ab", "tid": 724 }, { "created_ino": "0x100000004ac", "tid": 725 }, { "created_ino": "0x100000004ad", "tid": 726 }, { "created_ino": "0x100000004ae", "tid": 727 }, { "created_ino": "0x100000004af", "tid": 728 }, { "created_ino": "0x100000004b0", "tid": 729 }, { "created_ino": "0x100000004b1", "tid": 730 }, { "created_ino": "0x100000004b2", "tid": 731 }, { "created_ino": "0x100000004b3", "tid": 732 }, { "created_ino": "0x100000004b4", "tid": 733 }, { "created_ino": "0x100000004b5", "tid": 734 }, { "created_ino": "0x100000004b6", "tid": 735 }, { "created_ino": "0x100000004b7", "tid": 736 }, { "created_ino": "0x100000004b8", "tid": 737 }, { "created_ino": "0x100000004b9", "tid": 738 }, { "created_ino": "0x100000004ba", "tid": 739 }, { "created_ino": "0x100000004bb", "tid": 740 }, { "created_ino": "0x100000004bc", "tid": 741 }, { "created_ino": "0x100000004bd", "tid": 742 }, { "created_ino": "0x100000004be", "tid": 743 }, { "created_ino": "0x100000004bf", "tid": 744 }, { "created_ino": "0x100000004c0", "tid": 745 }, { "created_ino": "0x100000004c1", "tid": 746 }, { "created_ino": "0x100000004c2", "tid": 747 }, { "created_ino": "0x100000004c3", "tid": 748 }, { "created_ino": "0x100000004c4", "tid": 749 }, { "created_ino": "0x100000004c5", "tid": 750 }, { "created_ino": "0x100000004c6", "tid": 751 }, { "created_ino": "0x100000004c7", "tid": 752 }, { "created_ino": "0x100000004c8", "tid": 753 }, { "created_ino": "0x100000004c9", "tid": 754 }, { "created_ino": "0x100000004ca", "tid": 755 }, { "created_ino": "0x100000004cb", "tid": 756 }, { "created_ino": "0x100000004cc", "tid": 757 }, { "created_ino": "0x100000004cd", "tid": 758 }, { "created_ino": "0x100000004ce", "tid": 759 }, { "created_ino": "0x100000004cf", "tid": 760 }, { "created_ino": "0x100000004d0", "tid": 761 }, { "created_ino": "0x100000004d1", "tid": 762 }, { "created_ino": "0x100000004d2", "tid": 763 }, { "created_ino": "0x100000004d3", "tid": 764 }, { "created_ino": "0x100000004d4", "tid": 765 }, { "created_ino": "0x100000004d5", "tid": 766 }, { "created_ino": "0x100000004d6", "tid": 767 }, { "created_ino": "0x100000004d7", "tid": 768 }, { "created_ino": "0x100000004d8", "tid": 769 }, { "created_ino": "0x100000004d9", "tid": 770 }, { "created_ino": "0x100000004da", "tid": 771 }, { "created_ino": "0x100000004db", "tid": 772 }, { "created_ino": "0x100000004dc", "tid": 773 }, { "created_ino": "0x100000004dd", "tid": 774 }, { "created_ino": "0x100000004de", "tid": 775 }, { "created_ino": "0x100000004df", "tid": 776 }, { "created_ino": "0x100000004e0", "tid": 777 }, { "created_ino": "0x100000004e1", "tid": 778 }, { "created_ino": "0x100000004e2", "tid": 779 }, { "created_ino": "0x100000004e3", "tid": 780 }, { "created_ino": "0x100000004e4", "tid": 781 }, { "created_ino": "0x100000004e5", "tid": 782 }, { "created_ino": "0x100000004e6", "tid": 783 }, { "created_ino": "0x100000004e7", "tid": 784 }, { "created_ino": "0x100000004e8", "tid": 785 }, { "created_ino": "0x100000004e9", "tid": 786 }, { "created_ino": "0x100000004ea", "tid": 787 }, { "created_ino": "0x100000004eb", "tid": 788 }, { "created_ino": "0x100000004ec", "tid": 789 }, { "created_ino": "0x100000004ed", "tid": 790 }, { "created_ino": "0x100000004ee", "tid": 791 }, { "created_ino": "0x100000004ef", "tid": 792 }, { "created_ino": "0x100000004f0", "tid": 793 }, { "created_ino": "0x100000004f1", "tid": 794 }, { "created_ino": "0x100000004f2", "tid": 795 }, { "created_ino": "0x100000004f3", "tid": 796 }, { "created_ino": "0x100000004f4", "tid": 797 }, { "created_ino": "0x100000004f5", "tid": 798 }, { "created_ino": "0x100000004f6", "tid": 799 }, { "created_ino": "0x100000004f7", "tid": 800 }, { "created_ino": "0x100000004f8", "tid": 801 }, { "created_ino": "0x100000004f9", "tid": 802 }, { "created_ino": "0x100000004fa", "tid": 803 }, { "created_ino": "0x100000004fb", "tid": 804 }, { "created_ino": "0x100000004fc", "tid": 805 }, { "created_ino": "0x100000004fd", "tid": 806 }, { "created_ino": "0x100000004fe", "tid": 807 }, { "created_ino": "0x100000004ff", "tid": 808 }, { "created_ino": "0x10000000500", "tid": 809 }, { "created_ino": "0x10000000501", "tid": 810 }, { "created_ino": "0x10000000502", "tid": 811 }, { "created_ino": "0x10000000503", "tid": 812 }, { "created_ino": "0x10000000504", "tid": 813 }, { "created_ino": "0x10000000505", "tid": 814 }, { "created_ino": "0x10000000506", "tid": 815 }, { "created_ino": "0x10000000507", "tid": 816 }, { "created_ino": "0x10000000508", "tid": 817 }, { "created_ino": "0x10000000509", "tid": 818 }, { "created_ino": "0x1000000050a", "tid": 819 }, { "created_ino": "0x1000000050b", "tid": 820 }, { "created_ino": "0x1000000050c", "tid": 821 }, { "created_ino": "0x1000000050d", "tid": 822 }, { "created_ino": "0x1000000050e", "tid": 823 }, { "created_ino": "0x1000000050f", "tid": 824 }, { "created_ino": "0x10000000510", "tid": 825 }, { "created_ino": "0x10000000511", "tid": 826 }, { "created_ino": "0x10000000512", "tid": 827 }, { "created_ino": "0x10000000513", "tid": 828 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "172.21.15.105:0", "nonce": 1954970807, "type": "v1" }, "name": { "num": 6098, "type": "client" } }, "id": 6098, "inst": "client.6098 v1:172.21.15.105:0/1954970807", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 530, "num_caps": 802, "num_completed_flushes": 0, "num_completed_requests": 299, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000002" }, { "length": 203, "start": "0x10000000514" }, { "length": 501, "start": "0x100000005e0" } ], "recall_caps": { "halflife": 60, "value": 2014.2770214504471 }, "recall_caps_throttle": { "halflife": 1.5, "value": 679.4417223589685 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 176.6955005712323 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 775, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 1584.5309924201579 }, "state": "open", "uptime": 9.720801978 } ] 2024-09-21T03:25:26.756 INFO:tasks.ceph_test_case:waiting 120.0s for health warning matching MDS_CLIENT_RECALL 2024-09-21T03:25:26.756 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T03:25:26.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.866+0000 7fa8b7207640 1 -- 172.21.15.105:0/1029931242 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa8b015c580 msgr2=0x7fa8b0070540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:26.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.866+0000 7fa8b7207640 1 --2- 172.21.15.105:0/1029931242 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa8b015c580 0x7fa8b0070540 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa898009830 tx=0x7fa89802a510 comp rx=0 tx=0).stop 2024-09-21T03:25:26.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.866+0000 7fa8b7207640 1 -- 172.21.15.105:0/1029931242 shutdown_connections 2024-09-21T03:25:26.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.866+0000 7fa8b7207640 1 --2- 172.21.15.105:0/1029931242 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa8b015c580 0x7fa8b0070540 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:26.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.866+0000 7fa8b7207640 1 --2- 172.21.15.105:0/1029931242 >> v2:172.21.15.162:3300/0 conn(0x7fa8b0155ce0 0x7fa8b00b45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:26.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.866+0000 7fa8b7207640 1 -- 172.21.15.105:0/1029931242 >> 172.21.15.105:0/1029931242 conn(0x7fa8b006def0 msgr2=0x7fa8b006e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:26.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.866+0000 7fa8b7207640 1 -- 172.21.15.105:0/1029931242 shutdown_connections 2024-09-21T03:25:26.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.866+0000 7fa8b7207640 1 -- 172.21.15.105:0/1029931242 wait complete. 2024-09-21T03:25:26.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.867+0000 7fa8b7207640 1 Processor -- start 2024-09-21T03:25:26.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.867+0000 7fa8b7207640 1 -- start start 2024-09-21T03:25:26.872 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.869+0000 7fa8b7207640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8b0074420 0x7fa8b01504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:26.872 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.869+0000 7fa8b7207640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa8b0155ce0 0x7fa8b01493c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:26.872 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.869+0000 7fa8b7207640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8b0150a30 0x7fa8b0149900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:26.872 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.869+0000 7fa8b7207640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b00b5060 con 0x7fa8b0074420 2024-09-21T03:25:26.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.869+0000 7fa8b7207640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b00b4ee0 con 0x7fa8b0150a30 2024-09-21T03:25:26.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.869+0000 7fa8b7207640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa8b00b51e0 con 0x7fa8b0155ce0 2024-09-21T03:25:26.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.869+0000 7fa8b4fa3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8b0074420 0x7fa8b01504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:26.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.869+0000 7fa8b4fa3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8b0074420 0x7fa8b01504f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:60066/0 (socket says 172.21.15.105:60066) 2024-09-21T03:25:26.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.869+0000 7fa8b4fa3640 1 -- 172.21.15.105:0/894445848 learned_addr learned my addr 172.21.15.105:0/894445848 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:26.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.869+0000 7fa8b57a4640 1 --2- 172.21.15.105:0/894445848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8b0150a30 0x7fa8b0149900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:26.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.869+0000 7fa8affff640 1 --2- 172.21.15.105:0/894445848 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa8b0155ce0 0x7fa8b01493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:26.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.869+0000 7fa8b4fa3640 1 -- 172.21.15.105:0/894445848 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa8b0155ce0 msgr2=0x7fa8b01493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:26.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.869+0000 7fa8b4fa3640 1 --2- 172.21.15.105:0/894445848 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa8b0155ce0 0x7fa8b01493c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:26.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.869+0000 7fa8b4fa3640 1 -- 172.21.15.105:0/894445848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8b0150a30 msgr2=0x7fa8b0149900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:26.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.869+0000 7fa8b4fa3640 1 --2- 172.21.15.105:0/894445848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8b0150a30 0x7fa8b0149900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:26.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.869+0000 7fa8b4fa3640 1 -- 172.21.15.105:0/894445848 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8b014a710 con 0x7fa8b0074420 2024-09-21T03:25:26.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.870+0000 7fa8b4fa3640 1 --2- 172.21.15.105:0/894445848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8b0074420 0x7fa8b01504f0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000ede0 tx=0x7fa8a000c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:26.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.870+0000 7fa8ad7fa640 1 -- 172.21.15.105:0/894445848 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a0016070 con 0x7fa8b0074420 2024-09-21T03:25:26.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.870+0000 7fa8b7207640 1 -- 172.21.15.105:0/894445848 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8b014a9f0 con 0x7fa8b0074420 2024-09-21T03:25:26.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.870+0000 7fa8ad7fa640 1 -- 172.21.15.105:0/894445848 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa8a0011780 con 0x7fa8b0074420 2024-09-21T03:25:26.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.870+0000 7fa8ad7fa640 1 -- 172.21.15.105:0/894445848 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a0011bd0 con 0x7fa8b0074420 2024-09-21T03:25:26.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.870+0000 7fa8b7207640 1 -- 172.21.15.105:0/894445848 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8b014afb0 con 0x7fa8b0074420 2024-09-21T03:25:26.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.871+0000 7fa8b7207640 1 -- 172.21.15.105:0/894445848 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8b00b5700 con 0x7fa8b0074420 2024-09-21T03:25:26.875 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.872+0000 7fa8ad7fa640 1 -- 172.21.15.105:0/894445848 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa8a0019070 con 0x7fa8b0074420 2024-09-21T03:25:26.875 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.872+0000 7fa8ad7fa640 1 --2- 172.21.15.105:0/894445848 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa890078b90 0x7fa89007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:26.875 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.872+0000 7fa8ad7fa640 1 -- 172.21.15.105:0/894445848 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7fa8a009d750 con 0x7fa8b0074420 2024-09-21T03:25:26.875 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.872+0000 7fa8affff640 1 --2- 172.21.15.105:0/894445848 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa890078b90 0x7fa89007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:26.875 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.873+0000 7fa8affff640 1 --2- 172.21.15.105:0/894445848 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa890078b90 0x7fa89007b0a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa898034000 tx=0x7fa898004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:26.878 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:26.877+0000 7fa8ad7fa640 1 -- 172.21.15.105:0/894445848 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa8a0065550 con 0x7fa8b0074420 2024-09-21T03:25:27.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:27.089+0000 7fa8b7207640 1 -- 172.21.15.105:0/894445848 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa8b01e6f90 con 0x7fa8b0074420 2024-09-21T03:25:27.091 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:27.089+0000 7fa8ad7fa640 1 -- 172.21.15.105:0/894445848 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7fa8a0069f80 con 0x7fa8b0074420 2024-09-21T03:25:27.091 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:27.091 INFO:teuthology.orchestra.run.smithi105.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-21T03:25:27.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:27.091+0000 7fa8b7207640 1 -- 172.21.15.105:0/894445848 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa890078b90 msgr2=0x7fa89007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:27.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:27.091+0000 7fa8b7207640 1 --2- 172.21.15.105:0/894445848 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa890078b90 0x7fa89007b0a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa898034000 tx=0x7fa898004730 comp rx=0 tx=0).stop 2024-09-21T03:25:27.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:27.091+0000 7fa8b7207640 1 -- 172.21.15.105:0/894445848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8b0074420 msgr2=0x7fa8b01504f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:27.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:27.091+0000 7fa8b7207640 1 --2- 172.21.15.105:0/894445848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8b0074420 0x7fa8b01504f0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000ede0 tx=0x7fa8a000c640 comp rx=0 tx=0).stop 2024-09-21T03:25:27.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:27.091+0000 7fa8b7207640 1 -- 172.21.15.105:0/894445848 shutdown_connections 2024-09-21T03:25:27.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:27.091+0000 7fa8b7207640 1 --2- 172.21.15.105:0/894445848 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa890078b90 0x7fa89007b0a0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:27.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:27.091+0000 7fa8b7207640 1 --2- 172.21.15.105:0/894445848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8b0150a30 0x7fa8b0149900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:27.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:27.091+0000 7fa8b7207640 1 --2- 172.21.15.105:0/894445848 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa8b0155ce0 0x7fa8b01493c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:27.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:27.091+0000 7fa8b7207640 1 --2- 172.21.15.105:0/894445848 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8b0074420 0x7fa8b01504f0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:27.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:27.091+0000 7fa8b7207640 1 -- 172.21.15.105:0/894445848 >> 172.21.15.105:0/894445848 conn(0x7fa8b006def0 msgr2=0x7fa8b015d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:27.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:27.091+0000 7fa8b7207640 1 -- 172.21.15.105:0/894445848 shutdown_connections 2024-09-21T03:25:27.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:27.091+0000 7fa8b7207640 1 -- 172.21.15.105:0/894445848 wait complete. 2024-09-21T03:25:27.104 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-21T03:25:27.104 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-21T03:25:27.248 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:25:27.250 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:25:27.675 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:25:29.677 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:25:31.680 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:25:32.104 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T03:25:32.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.227+0000 7f7a94169640 1 -- 172.21.15.105:0/1646119127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a8c162040 msgr2=0x7f7a8c06cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:32.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.227+0000 7f7a94169640 1 --2- 172.21.15.105:0/1646119127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a8c162040 0x7f7a8c06cde0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c06de30 tx=0x7f7a8802a530 comp rx=0 tx=0).stop 2024-09-21T03:25:32.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.227+0000 7f7a94169640 1 -- 172.21.15.105:0/1646119127 shutdown_connections 2024-09-21T03:25:32.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.227+0000 7f7a94169640 1 --2- 172.21.15.105:0/1646119127 >> v2:172.21.15.162:3300/0 conn(0x7f7a8c0b4570 0x7f7a8c06d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:32.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.227+0000 7f7a94169640 1 --2- 172.21.15.105:0/1646119127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a8c162040 0x7f7a8c06cde0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:32.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.227+0000 7f7a94169640 1 -- 172.21.15.105:0/1646119127 >> 172.21.15.105:0/1646119127 conn(0x7f7a8c0cdcc0 msgr2=0x7f7a8c0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:32.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.227+0000 7f7a94169640 1 -- 172.21.15.105:0/1646119127 shutdown_connections 2024-09-21T03:25:32.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.228+0000 7f7a94169640 1 -- 172.21.15.105:0/1646119127 wait complete. 2024-09-21T03:25:32.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.229+0000 7f7a94169640 1 Processor -- start 2024-09-21T03:25:32.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.229+0000 7f7a94169640 1 -- start start 2024-09-21T03:25:32.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.230+0000 7f7a94169640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a8c073f00 0x7f7a8c0cad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:32.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.230+0000 7f7a94169640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a8c0b4570 0x7f7a8c0aef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:32.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.230+0000 7f7a94169640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a8c0af4c0 0x7f7a8c15f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:32.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.230+0000 7f7a94169640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7a8c0b4100 con 0x7f7a8c0b4570 2024-09-21T03:25:32.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.230+0000 7f7a94169640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7a8c0b0560 con 0x7f7a8c073f00 2024-09-21T03:25:32.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.230+0000 7f7a94169640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7a8c0b4280 con 0x7f7a8c0af4c0 2024-09-21T03:25:32.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.231+0000 7f7a91704640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a8c0b4570 0x7f7a8c0aef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:32.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.231+0000 7f7a91704640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a8c0b4570 0x7f7a8c0aef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56376/0 (socket says 172.21.15.105:56376) 2024-09-21T03:25:32.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.231+0000 7f7a91704640 1 -- 172.21.15.105:0/3805746040 learned_addr learned my addr 172.21.15.105:0/3805746040 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:32.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.231+0000 7f7a91f05640 1 --2- 172.21.15.105:0/3805746040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a8c073f00 0x7f7a8c0cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:32.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.231+0000 7f7a92706640 1 --2- 172.21.15.105:0/3805746040 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a8c0af4c0 0x7f7a8c15f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:32.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.231+0000 7f7a91704640 1 -- 172.21.15.105:0/3805746040 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a8c0af4c0 msgr2=0x7f7a8c15f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:32.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.231+0000 7f7a91704640 1 --2- 172.21.15.105:0/3805746040 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a8c0af4c0 0x7f7a8c15f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:32.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.231+0000 7f7a91704640 1 -- 172.21.15.105:0/3805746040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a8c073f00 msgr2=0x7f7a8c0cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:32.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.231+0000 7f7a91704640 1 --2- 172.21.15.105:0/3805746040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a8c073f00 0x7f7a8c0cad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:32.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.231+0000 7f7a91704640 1 -- 172.21.15.105:0/3805746040 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a8c0af8d0 con 0x7f7a8c0b4570 2024-09-21T03:25:32.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.231+0000 7f7a92706640 1 --2- 172.21.15.105:0/3805746040 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a8c0af4c0 0x7f7a8c15f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:25:32.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.231+0000 7f7a91704640 1 --2- 172.21.15.105:0/3805746040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a8c0b4570 0x7f7a8c0aef80 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c00c970 tx=0x7f7a7c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:32.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.231+0000 7f7a827fc640 1 -- 172.21.15.105:0/3805746040 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c007bb0 con 0x7f7a8c0b4570 2024-09-21T03:25:32.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.231+0000 7f7a827fc640 1 -- 172.21.15.105:0/3805746040 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7a7c007e40 con 0x7f7a8c0b4570 2024-09-21T03:25:32.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.231+0000 7f7a94169640 1 -- 172.21.15.105:0/3805746040 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a8c14d690 con 0x7f7a8c0b4570 2024-09-21T03:25:32.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.231+0000 7f7a827fc640 1 -- 172.21.15.105:0/3805746040 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c005280 con 0x7f7a8c0b4570 2024-09-21T03:25:32.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.231+0000 7f7a94169640 1 -- 172.21.15.105:0/3805746040 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a8c14dc50 con 0x7f7a8c0b4570 2024-09-21T03:25:32.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.233+0000 7f7a94169640 1 -- 172.21.15.105:0/3805746040 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a8c074be0 con 0x7f7a8c0b4570 2024-09-21T03:25:32.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.233+0000 7f7a827fc640 1 -- 172.21.15.105:0/3805746040 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7a7c005420 con 0x7f7a8c0b4570 2024-09-21T03:25:32.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.234+0000 7f7a827fc640 1 --2- 172.21.15.105:0/3805746040 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7a70078bc0 0x7f7a7007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:32.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.234+0000 7f7a827fc640 1 -- 172.21.15.105:0/3805746040 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f7a7c09b180 con 0x7f7a8c0b4570 2024-09-21T03:25:32.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.234+0000 7f7a91f05640 1 --2- 172.21.15.105:0/3805746040 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7a70078bc0 0x7f7a7007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:32.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.235+0000 7f7a91f05640 1 --2- 172.21.15.105:0/3805746040 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7a70078bc0 0x7f7a7007b0d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7a88034000 tx=0x7f7a88004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:32.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.238+0000 7f7a827fc640 1 -- 172.21.15.105:0/3805746040 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7a8c0af8d0 con 0x7f7a8c0b4570 2024-09-21T03:25:32.451 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.449+0000 7f7a94169640 1 -- 172.21.15.105:0/3805746040 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7a8c0cea20 con 0x7f7a8c0b4570 2024-09-21T03:25:32.451 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.450+0000 7f7a827fc640 1 -- 172.21.15.105:0/3805746040 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+316 (secure 0 0 0) 0x7f7a7c014030 con 0x7f7a8c0b4570 2024-09-21T03:25:32.452 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:32.452 INFO:teuthology.orchestra.run.smithi105.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false},"MDS_CLIENT_RECALL":{"severity":"HEALTH_WARN","summary":{"message":"1 clients failing to respond to cache pressure","count":1},"muted":false}},"mutes":[]} 2024-09-21T03:25:32.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.452+0000 7f7a94169640 1 -- 172.21.15.105:0/3805746040 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7a70078bc0 msgr2=0x7f7a7007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:32.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.452+0000 7f7a94169640 1 --2- 172.21.15.105:0/3805746040 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7a70078bc0 0x7f7a7007b0d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7a88034000 tx=0x7f7a88004730 comp rx=0 tx=0).stop 2024-09-21T03:25:32.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.452+0000 7f7a94169640 1 -- 172.21.15.105:0/3805746040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a8c0b4570 msgr2=0x7f7a8c0aef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:32.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.452+0000 7f7a94169640 1 --2- 172.21.15.105:0/3805746040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a8c0b4570 0x7f7a8c0aef80 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c00c970 tx=0x7f7a7c00ce30 comp rx=0 tx=0).stop 2024-09-21T03:25:32.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.452+0000 7f7a94169640 1 -- 172.21.15.105:0/3805746040 shutdown_connections 2024-09-21T03:25:32.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.452+0000 7f7a94169640 1 --2- 172.21.15.105:0/3805746040 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7a70078bc0 0x7f7a7007b0d0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:32.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.452+0000 7f7a94169640 1 --2- 172.21.15.105:0/3805746040 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a8c0af4c0 0x7f7a8c15f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:32.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.452+0000 7f7a94169640 1 --2- 172.21.15.105:0/3805746040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a8c0b4570 0x7f7a8c0aef80 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:32.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.452+0000 7f7a94169640 1 --2- 172.21.15.105:0/3805746040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a8c073f00 0x7f7a8c0cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:32.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.452+0000 7f7a94169640 1 -- 172.21.15.105:0/3805746040 >> 172.21.15.105:0/3805746040 conn(0x7f7a8c0cdcc0 msgr2=0x7f7a8c06d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:32.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.452+0000 7f7a94169640 1 -- 172.21.15.105:0/3805746040 shutdown_connections 2024-09-21T03:25:32.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.452+0000 7f7a94169640 1 -- 172.21.15.105:0/3805746040 wait complete. 2024-09-21T03:25:32.464 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-21T03:25:32.465 INFO:tasks.ceph_test_case:waiting 120.0s for health warning matching MDS_CACHE_OVERSIZED 2024-09-21T03:25:32.465 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T03:25:32.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.575+0000 7f29c2bba640 1 -- 172.21.15.105:0/673607919 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29a4003a00 msgr2=0x7f29a4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:32.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.575+0000 7f29c2bba640 1 --2- 172.21.15.105:0/673607919 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29a4003a00 0x7f29a4003e70 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f29b8009b50 tx=0x7f29a4005830 comp rx=0 tx=0).stop 2024-09-21T03:25:32.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.575+0000 7f29c1157640 1 -- 172.21.15.105:0/673607919 reap_dead start 2024-09-21T03:25:32.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.575+0000 7f29c2bba640 1 -- 172.21.15.105:0/673607919 shutdown_connections 2024-09-21T03:25:32.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.575+0000 7f29c2bba640 1 -- 172.21.15.105:0/673607919 >> 172.21.15.105:0/673607919 conn(0x7f29bc09d8f0 msgr2=0x7f29bc0d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:32.577 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.575+0000 7f29c2bba640 1 -- 172.21.15.105:0/673607919 shutdown_connections 2024-09-21T03:25:32.578 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.575+0000 7f29c2bba640 1 -- 172.21.15.105:0/673607919 wait complete. 2024-09-21T03:25:32.578 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.577+0000 7f29c2bba640 1 Processor -- start 2024-09-21T03:25:32.578 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.577+0000 7f29c2bba640 1 -- start start 2024-09-21T03:25:32.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.578+0000 7f29c2bba640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29a4003a00 0x7f29bc1eac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:32.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.578+0000 7f29c2bba640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29bc1e8470 0x7f29bc1f5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:32.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.578+0000 7f29c2bba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29bc160080 0x7f29bc160490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:32.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.578+0000 7f29c2bba640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f29bc163080 con 0x7f29bc1e8470 2024-09-21T03:25:32.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.578+0000 7f29c2bba640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f29bc0d1fa0 con 0x7f29bc160080 2024-09-21T03:25:32.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.578+0000 7f29c2bba640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f29bc163200 con 0x7f29a4003a00 2024-09-21T03:25:32.581 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.578+0000 7f29b3fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29bc1e8470 0x7f29bc1f5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:32.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.578+0000 7f29b3fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29bc1e8470 0x7f29bc1f5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56394/0 (socket says 172.21.15.105:56394) 2024-09-21T03:25:32.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.578+0000 7f29b3fff640 1 -- 172.21.15.105:0/290960230 learned_addr learned my addr 172.21.15.105:0/290960230 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:32.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.579+0000 7f29c0956640 1 --2- 172.21.15.105:0/290960230 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29a4003a00 0x7f29bc1eac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:32.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.579+0000 7f29c1157640 1 --2- 172.21.15.105:0/290960230 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29bc160080 0x7f29bc160490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:32.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.579+0000 7f29b3fff640 1 -- 172.21.15.105:0/290960230 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29a4003a00 msgr2=0x7f29bc1eac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:32.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.579+0000 7f29b3fff640 1 --2- 172.21.15.105:0/290960230 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29a4003a00 0x7f29bc1eac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:32.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.579+0000 7f29b3fff640 1 -- 172.21.15.105:0/290960230 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29bc160080 msgr2=0x7f29bc160490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:32.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.579+0000 7f29b3fff640 1 --2- 172.21.15.105:0/290960230 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29bc160080 0x7f29bc160490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:32.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.579+0000 7f29b3fff640 1 -- 172.21.15.105:0/290960230 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29bc1e8b20 con 0x7f29bc1e8470 2024-09-21T03:25:32.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.579+0000 7f29b3fff640 1 --2- 172.21.15.105:0/290960230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29bc1e8470 0x7f29bc1f5810 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f29ac00e5c0 tx=0x7f29ac00ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:32.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.579+0000 7f29b17fa640 1 -- 172.21.15.105:0/290960230 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ac015070 con 0x7f29bc1e8470 2024-09-21T03:25:32.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.579+0000 7f29b17fa640 1 -- 172.21.15.105:0/290960230 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f29ac00caa0 con 0x7f29bc1e8470 2024-09-21T03:25:32.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.579+0000 7f29c2bba640 1 -- 172.21.15.105:0/290960230 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29bc160d30 con 0x7f29bc1e8470 2024-09-21T03:25:32.583 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.579+0000 7f29b17fa640 1 -- 172.21.15.105:0/290960230 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ac011460 con 0x7f29bc1e8470 2024-09-21T03:25:32.583 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.579+0000 7f29c2bba640 1 -- 172.21.15.105:0/290960230 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29bc1612f0 con 0x7f29bc1e8470 2024-09-21T03:25:32.583 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.580+0000 7f29c2bba640 1 -- 172.21.15.105:0/290960230 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29bc0d1230 con 0x7f29bc1e8470 2024-09-21T03:25:32.584 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.581+0000 7f29b17fa640 1 -- 172.21.15.105:0/290960230 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f29ac018070 con 0x7f29bc1e8470 2024-09-21T03:25:32.584 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.581+0000 7f29b17fa640 1 --2- 172.21.15.105:0/290960230 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f29a8078bc0 0x7f29a807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:32.584 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.581+0000 7f29b17fa640 1 -- 172.21.15.105:0/290960230 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f29ac09b080 con 0x7f29bc1e8470 2024-09-21T03:25:32.584 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.582+0000 7f29c0956640 1 --2- 172.21.15.105:0/290960230 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f29a8078bc0 0x7f29a807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:32.584 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.582+0000 7f29c0956640 1 --2- 172.21.15.105:0/290960230 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f29a8078bc0 0x7f29a807b0d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f29b8009b50 tx=0x7f29b802d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:32.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.586+0000 7f29b17fa640 1 -- 172.21.15.105:0/290960230 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f29bc0d1900 con 0x7f29bc1e8470 2024-09-21T03:25:32.801 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.800+0000 7f29c2bba640 1 -- 172.21.15.105:0/290960230 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f29bc0ba0d0 con 0x7f29bc1e8470 2024-09-21T03:25:32.802 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.800+0000 7f29b17fa640 1 -- 172.21.15.105:0/290960230 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+316 (secure 0 0 0) 0x7f29ac063560 con 0x7f29bc1e8470 2024-09-21T03:25:32.802 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:32.802 INFO:teuthology.orchestra.run.smithi105.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false},"MDS_CLIENT_RECALL":{"severity":"HEALTH_WARN","summary":{"message":"1 clients failing to respond to cache pressure","count":1},"muted":false}},"mutes":[]} 2024-09-21T03:25:32.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.802+0000 7f29c2bba640 1 -- 172.21.15.105:0/290960230 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f29a8078bc0 msgr2=0x7f29a807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:32.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.802+0000 7f29c2bba640 1 --2- 172.21.15.105:0/290960230 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f29a8078bc0 0x7f29a807b0d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f29b8009b50 tx=0x7f29b802d040 comp rx=0 tx=0).stop 2024-09-21T03:25:32.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.802+0000 7f29c2bba640 1 -- 172.21.15.105:0/290960230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29bc1e8470 msgr2=0x7f29bc1f5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:32.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.802+0000 7f29c2bba640 1 --2- 172.21.15.105:0/290960230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29bc1e8470 0x7f29bc1f5810 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f29ac00e5c0 tx=0x7f29ac00ea80 comp rx=0 tx=0).stop 2024-09-21T03:25:32.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.802+0000 7f29c2bba640 1 -- 172.21.15.105:0/290960230 shutdown_connections 2024-09-21T03:25:32.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.802+0000 7f29c2bba640 1 --2- 172.21.15.105:0/290960230 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f29a8078bc0 0x7f29a807b0d0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:32.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.802+0000 7f29c2bba640 1 --2- 172.21.15.105:0/290960230 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29bc160080 0x7f29bc160490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:32.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.802+0000 7f29c2bba640 1 --2- 172.21.15.105:0/290960230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29bc1e8470 0x7f29bc1f5810 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:32.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.802+0000 7f29c2bba640 1 --2- 172.21.15.105:0/290960230 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29a4003a00 0x7f29bc1eac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:32.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.802+0000 7f29c2bba640 1 -- 172.21.15.105:0/290960230 >> 172.21.15.105:0/290960230 conn(0x7f29bc09d8f0 msgr2=0x7f29bc0b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:32.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.802+0000 7f29c2bba640 1 -- 172.21.15.105:0/290960230 shutdown_connections 2024-09-21T03:25:32.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32.803+0000 7f29c2bba640 1 -- 172.21.15.105:0/290960230 wait complete. 2024-09-21T03:25:32.815 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-21T03:25:32.815 INFO:tasks.cephfs.test_client_limits:Terminating process holding files open 2024-09-21T03:25:32.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:32 stdin-killer INFO: expiration expected; waiting 5 seconds for command to complete 2024-09-21T03:25:33.681 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:25:33.682 INFO:teuthology.orchestra.run.smithi105.stderr:stdin closed, goodbye! 2024-09-21T03:25:33.696 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:25:33.705 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:25:33.870 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:33.868+0000 7f5ff8532640 1 -- 172.21.15.105:0/755195144 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5fd8005300 msgr2=0x7f5fd800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:33.870 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:33.868+0000 7f5ff8532640 1 --2- 172.21.15.105:0/755195144 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5fd8005300 0x7f5fd800b9c0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8001d90 tx=0x7f5fd8005830 comp rx=0 tx=0).stop 2024-09-21T03:25:33.870 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:33.868+0000 7f5ff8532640 1 -- 172.21.15.105:0/755195144 shutdown_connections 2024-09-21T03:25:33.870 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:33.868+0000 7f5ff8532640 1 --2- 172.21.15.105:0/755195144 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5fd8005300 0x7f5fd800b9c0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:33.870 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:33.868+0000 7f5ff8532640 1 -- 172.21.15.105:0/755195144 >> 172.21.15.105:0/755195144 conn(0x7f5ff00d15f0 msgr2=0x7f5ff0073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:33.870 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:33.868+0000 7f5ff8532640 1 -- 172.21.15.105:0/755195144 shutdown_connections 2024-09-21T03:25:33.870 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:33.868+0000 7f5ff8532640 1 -- 172.21.15.105:0/755195144 wait complete. 2024-09-21T03:25:33.871 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:33.870+0000 7f5ff8532640 1 Processor -- start 2024-09-21T03:25:33.871 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:33.870+0000 7f5ff8532640 1 -- start start 2024-09-21T03:25:33.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:33.871+0000 7f5ff8532640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5fd8005300 0x7f5ff01f5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:33.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:33.871+0000 7f5ff8532640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ff01e7a80 0x7f5ff01f5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:33.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:33.871+0000 7f5ff8532640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ff0070e60 0x7f5ff0071270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:33.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:33.871+0000 7f5ff8532640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff00b5680 con 0x7f5fd8005300 2024-09-21T03:25:33.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:33.871+0000 7f5ff8532640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff01429f0 con 0x7f5ff0070e60 2024-09-21T03:25:33.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:33.871+0000 7f5ff8532640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5ff00b5800 con 0x7f5ff01e7a80 2024-09-21T03:25:33.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:33.871+0000 7f5ff62ce640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5fd8005300 0x7f5ff01f5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:33.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:33.871+0000 7f5ff62ce640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5fd8005300 0x7f5ff01f5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56410/0 (socket says 172.21.15.105:56410) 2024-09-21T03:25:33.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:33.871+0000 7f5ff62ce640 1 -- 172.21.15.105:0/696252652 learned_addr learned my addr 172.21.15.105:0/696252652 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:33.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:33.871+0000 7f5ff5acd640 1 --2- 172.21.15.105:0/696252652 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ff01e7a80 0x7f5ff01f5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:33.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:33.871+0000 7f5ff6acf640 1 --2- 172.21.15.105:0/696252652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ff0070e60 0x7f5ff0071270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:33.875 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:33.871+0000 7f5ff62ce640 1 -- 172.21.15.105:0/696252652 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ff01e7a80 msgr2=0x7f5ff01f5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:33.875 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:33.871+0000 7f5ff62ce640 1 --2- 172.21.15.105:0/696252652 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ff01e7a80 0x7f5ff01f5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:33.875 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:33.871+0000 7f5ff62ce640 1 -- 172.21.15.105:0/696252652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ff0070e60 msgr2=0x7f5ff0071270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:33.875 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:33.871+0000 7f5ff62ce640 1 --2- 172.21.15.105:0/696252652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ff0070e60 0x7f5ff0071270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:33.875 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:33.871+0000 7f5ff62ce640 1 -- 172.21.15.105:0/696252652 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff00717b0 con 0x7f5fd8005300 2024-09-21T03:25:33.875 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:33.871+0000 7f5ff6acf640 1 --2- 172.21.15.105:0/696252652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ff0070e60 0x7f5ff0071270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:25:33.875 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:33.872+0000 7f5ff62ce640 1 --2- 172.21.15.105:0/696252652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5fd8005300 0x7f5ff01f5410 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0003f80 tx=0x7f5fe000ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:33.875 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:33.872+0000 7f5feeffd640 1 -- 172.21.15.105:0/696252652 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe0010a60 con 0x7f5fd8005300 2024-09-21T03:25:33.875 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:33.872+0000 7f5feeffd640 1 -- 172.21.15.105:0/696252652 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5fe0015070 con 0x7f5fd8005300 2024-09-21T03:25:33.875 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:33.872+0000 7f5feeffd640 1 -- 172.21.15.105:0/696252652 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe0010e80 con 0x7f5fd8005300 2024-09-21T03:25:33.875 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:33.872+0000 7f5ff8532640 1 -- 172.21.15.105:0/696252652 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ff00709c0 con 0x7f5fd8005300 2024-09-21T03:25:33.875 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:33.872+0000 7f5ff8532640 1 -- 172.21.15.105:0/696252652 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ff01e6cc0 con 0x7f5fd8005300 2024-09-21T03:25:33.876 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:33.873+0000 7f5ff8532640 1 -- 172.21.15.105:0/696252652 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ff00696c0 con 0x7f5fd8005300 2024-09-21T03:25:33.876 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:33.874+0000 7f5feeffd640 1 -- 172.21.15.105:0/696252652 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5fe001a470 con 0x7f5fd8005300 2024-09-21T03:25:33.876 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:33.874+0000 7f5feeffd640 1 --2- 172.21.15.105:0/696252652 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5fdc078b90 0x7f5fdc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:33.876 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:33.874+0000 7f5feeffd640 1 -- 172.21.15.105:0/696252652 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f5fe009b850 con 0x7f5fd8005300 2024-09-21T03:25:33.876 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:33.874+0000 7f5ff5acd640 1 --2- 172.21.15.105:0/696252652 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5fdc078b90 0x7f5fdc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:33.877 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:33.875+0000 7f5ff5acd640 1 --2- 172.21.15.105:0/696252652 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5fdc078b90 0x7f5fdc07b0a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0070c20 tx=0x7f5fe40067a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:33.880 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:33.879+0000 7f5feeffd640 1 -- 172.21.15.105:0/696252652 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5ff00717b0 con 0x7f5fd8005300 2024-09-21T03:25:34.103 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.102+0000 7f5ff8532640 1 -- 172.21.15.105:0/696252652 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ff00b5d60 con 0x7f5fd8005300 2024-09-21T03:25:34.104 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.103+0000 7f5feeffd640 1 -- 172.21.15.105:0/696252652 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) ==== 94+0+5234 (secure 0 0 0) 0x7f5fe0063ca0 con 0x7f5fd8005300 2024-09-21T03:25:34.104 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:34.104 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":67,"btime":"2024-09-21T03:25:31:461798+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5996,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/1026486886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1026486886},{"type":"v1","addr":"172.21.15.162:6836","nonce":1026486886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1085304139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1085304139},{"type":"v1","addr":"172.21.15.162:6837","nonce":1085304139}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":7161,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/569907499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":569907499},{"type":"v1","addr":"172.21.15.105:6833","nonce":569907499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:25:06.305459+0000","modified":"2024-09-21T03:25:30.978526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7164},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7164":{"gid":7164,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":9,"addr":"172.21.15.105:6835/2917579803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2917579803},{"type":"v1","addr":"172.21.15.105:6835","nonce":2917579803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7164,"qdb_cluster":[7164]},"id":8}]} 2024-09-21T03:25:34.105 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 67 2024-09-21T03:25:34.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.105+0000 7f5ff8532640 1 -- 172.21.15.105:0/696252652 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5fdc078b90 msgr2=0x7f5fdc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:34.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.105+0000 7f5ff8532640 1 --2- 172.21.15.105:0/696252652 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5fdc078b90 0x7f5fdc07b0a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0070c20 tx=0x7f5fe40067a0 comp rx=0 tx=0).stop 2024-09-21T03:25:34.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.105+0000 7f5ff8532640 1 -- 172.21.15.105:0/696252652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5fd8005300 msgr2=0x7f5ff01f5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:34.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.105+0000 7f5ff8532640 1 --2- 172.21.15.105:0/696252652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5fd8005300 0x7f5ff01f5410 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0003f80 tx=0x7f5fe000ba40 comp rx=0 tx=0).stop 2024-09-21T03:25:34.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.105+0000 7f5ff8532640 1 -- 172.21.15.105:0/696252652 shutdown_connections 2024-09-21T03:25:34.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.105+0000 7f5ff8532640 1 --2- 172.21.15.105:0/696252652 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5fdc078b90 0x7f5fdc07b0a0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:34.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.105+0000 7f5ff8532640 1 --2- 172.21.15.105:0/696252652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ff0070e60 0x7f5ff0071270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:34.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.105+0000 7f5ff8532640 1 --2- 172.21.15.105:0/696252652 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ff01e7a80 0x7f5ff01f5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:34.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.105+0000 7f5ff8532640 1 --2- 172.21.15.105:0/696252652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5fd8005300 0x7f5ff01f5410 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:34.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.105+0000 7f5ff8532640 1 -- 172.21.15.105:0/696252652 >> 172.21.15.105:0/696252652 conn(0x7f5ff00d15f0 msgr2=0x7f5ff0141820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:34.108 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.105+0000 7f5ff8532640 1 -- 172.21.15.105:0/696252652 shutdown_connections 2024-09-21T03:25:34.108 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.105+0000 7f5ff8532640 1 -- 172.21.15.105:0/696252652 wait complete. 2024-09-21T03:25:34.118 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-21T03:25:34.242 INFO:teuthology.orchestra.run.smithi105.stdout:[{"id":7350,"entity":{"name":{"type":"client","num":7350},"addr":{"type":"v1","addr":"172.21.15.162:0","nonce":1047057538}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":16.084672394999998,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.9023189228742399,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.7350 v1:172.21.15.162:0/1047057538","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi162","kernel_version":"5.14.0-508.el9.x86_64","root":"/"}},{"id":6098,"entity":{"name":{"type":"client","num":6098},"addr":{"type":"v1","addr":"172.21.15.105:0","nonce":1954970807}},"state":"open","num_leases":1,"num_caps":402,"request_load_avg":711,"uptime":17.210649449999998,"requests_in_flight":0,"num_completed_requests":299,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":4512.2538905753427,"halflife":60},"release_caps":{"value":399.27106624211751,"halflife":60},"recall_caps_throttle":{"value":946.1649285913594,"halflife":1.5},"recall_caps_throttle2o":{"value":360.25808983880341,"halflife":0.5},"session_cache_liveness":{"value":1557.3462291250933,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":530,"last_trim_completed_flushes_tid":0,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.6098 v1:172.21.15.105:0/1954970807","completed_requests":[{"tid":530,"created_ino":"0x100000003e9"},{"tid":531,"created_ino":"0x100000003ea"},{"tid":532,"created_ino":"0x100000003eb"},{"tid":533,"created_ino":"0x100000003ec"},{"tid":534,"created_ino":"0x100000003ed"},{"tid":535,"created_ino":"0x100000003ee"},{"tid":536,"created_ino":"0x100000003ef"},{"tid":537,"created_ino":"0x100000003f0"},{"tid":538,"created_ino":"0x100000003f1"},{"tid":539,"created_ino":"0x100000003f2"},{"tid":540,"created_ino":"0x100000003f3"},{"tid":541,"created_ino":"0x100000003f4"},{"tid":542,"created_ino":"0x100000003f5"},{"tid":543,"created_ino":"0x100000003f6"},{"tid":544,"created_ino":"0x100000003f7"},{"tid":545,"created_ino":"0x100000003f8"},{"tid":546,"created_ino":"0x100000003f9"},{"tid":547,"created_ino":"0x100000003fa"},{"tid":548,"created_ino":"0x100000003fb"},{"tid":549,"created_ino":"0x100000003fc"},{"tid":550,"created_ino":"0x100000003fd"},{"tid":551,"created_ino":"0x100000003fe"},{"tid":552,"created_ino":"0x100000003ff"},{"tid":553,"created_ino":"0x10000000400"},{"tid":554,"created_ino":"0x10000000401"},{"tid":555,"created_ino":"0x10000000402"},{"tid":556,"created_ino":"0x10000000403"},{"tid":557,"created_ino":"0x10000000404"},{"tid":558,"created_ino":"0x10000000405"},{"tid":559,"created_ino":"0x10000000406"},{"tid":560,"created_ino":"0x10000000407"},{"tid":561,"created_ino":"0x10000000408"},{"tid":562,"created_ino":"0x10000000409"},{"tid":563,"created_ino":"0x1000000040a"},{"tid":564,"created_ino":"0x1000000040b"},{"tid":565,"created_ino":"0x1000000040c"},{"tid":566,"created_ino":"0x1000000040d"},{"tid":567,"created_ino":"0x1000000040e"},{"tid":568,"created_ino":"0x1000000040f"},{"tid":569,"created_ino":"0x10000000410"},{"tid":570,"created_ino":"0x10000000411"},{"tid":571,"created_ino":"0x10000000412"},{"tid":572,"created_ino":"0x10000000413"},{"tid":573,"created_ino":"0x10000000414"},{"tid":574,"created_ino":"0x10000000415"},{"tid":575,"created_ino":"0x10000000416"},{"tid":576,"created_ino":"0x10000000417"},{"tid":577,"created_ino":"0x10000000418"},{"tid":578,"created_ino":"0x10000000419"},{"tid":579,"created_ino":"0x1000000041a"},{"tid":580,"created_ino":"0x1000000041b"},{"tid":581,"created_ino":"0x1000000041c"},{"tid":582,"created_ino":"0x1000000041d"},{"tid":583,"created_ino":"0x1000000041e"},{"tid":584,"created_ino":"0x1000000041f"},{"tid":585,"created_ino":"0x10000000420"},{"tid":586,"created_ino":"0x10000000421"},{"tid":587,"created_ino":"0x10000000422"},{"tid":588,"created_ino":"0x10000000423"},{"tid":589,"created_ino":"0x10000000424"},{"tid":590,"created_ino":"0x10000000425"},{"tid":591,"created_ino":"0x10000000426"},{"tid":592,"created_ino":"0x10000000427"},{"tid":593,"created_ino":"0x10000000428"},{"tid":594,"created_ino":"0x10000000429"},{"tid":595,"created_ino":"0x1000000042a"},{"tid":596,"created_ino":"0x1000000042b"},{"tid":597,"created_ino":"0x1000000042c"},{"tid":598,"created_ino":"0x1000000042d"},{"tid":599,"created_ino":"0x1000000042e"},{"tid":600,"created_ino":"0x1000000042f"},{"tid":601,"created_ino":"0x10000000430"},{"tid":602,"created_ino":"0x10000000431"},{"tid":603,"created_ino":"0x10000000432"},{"tid":604,"created_ino":"0x10000000433"},{"tid":605,"created_ino":"0x10000000434"},{"tid":606,"created_ino":"0x10000000435"},{"tid":607,"created_ino":"0x10000000436"},{"tid":608,"created_ino":"0x10000000437"},{"tid":609,"created_ino":"0x10000000438"},{"tid":610,"created_ino":"0x10000000439"},{"tid":611,"created_ino":"0x1000000043a"},{"tid":612,"created_ino":"0x1000000043b"},{"tid":613,"created_ino":"0x1000000043c"},{"tid":614,"created_ino":"0x1000000043d"},{"tid":615,"created_ino":"0x1000000043e"},{"tid":616,"created_ino":"0x1000000043f"},{"tid":617,"created_ino":"0x10000000440"},{"tid":618,"created_ino":"0x10000000441"},{"tid":619,"created_ino":"0x10000000442"},{"tid":620,"created_ino":"0x10000000443"},{"tid":621,"created_ino":"0x10000000444"},{"tid":622,"created_ino":"0x10000000445"},{"tid":623,"created_ino":"0x10000000446"},{"tid":624,"created_ino":"0x10000000447"},{"tid":625,"created_ino":"0x10000000448"},{"tid":626,"created_ino":"0x10000000449"},{"tid":627,"created_ino":"0x1000000044a"},{"tid":628,"created_ino":"0x1000000044b"},{"tid":629,"created_ino":"0x1000000044c"},{"tid":630,"created_ino":"0x1000000044d"},{"tid":631,"created_ino":"0x1000000044e"},{"tid":632,"created_ino":"0x1000000044f"},{"tid":633,"created_ino":"0x10000000450"},{"tid":634,"created_ino":"0x10000000451"},{"tid":635,"created_ino":"0x10000000452"},{"tid":636,"created_ino":"0x10000000453"},{"tid":637,"created_ino":"0x10000000454"},{"tid":638,"created_ino":"0x10000000455"},{"tid":639,"created_ino":"0x10000000456"},{"tid":640,"created_ino":"0x10000000457"},{"tid":641,"created_ino":"0x10000000458"},{"tid":642,"created_ino":"0x10000000459"},{"tid":643,"created_ino":"0x1000000045a"},{"tid":644,"created_ino":"0x1000000045b"},{"tid":645,"created_ino":"0x1000000045c"},{"tid":646,"created_ino":"0x1000000045d"},{"tid":647,"created_ino":"0x1000000045e"},{"tid":648,"created_ino":"0x1000000045f"},{"tid":649,"created_ino":"0x10000000460"},{"tid":650,"created_ino":"0x10000000461"},{"tid":651,"created_ino":"0x10000000462"},{"tid":652,"created_ino":"0x10000000463"},{"tid":653,"created_ino":"0x10000000464"},{"tid":654,"created_ino":"0x10000000465"},{"tid":655,"created_ino":"0x10000000466"},{"tid":656,"created_ino":"0x10000000467"},{"tid":657,"created_ino":"0x10000000468"},{"tid":658,"created_ino":"0x10000000469"},{"tid":659,"created_ino":"0x1000000046a"},{"tid":660,"created_ino":"0x1000000046b"},{"tid":661,"created_ino":"0x1000000046c"},{"tid":662,"created_ino":"0x1000000046d"},{"tid":663,"created_ino":"0x1000000046e"},{"tid":664,"created_ino":"0x1000000046f"},{"tid":665,"created_ino":"0x10000000470"},{"tid":666,"created_ino":"0x10000000471"},{"tid":667,"created_ino":"0x10000000472"},{"tid":668,"created_ino":"0x10000000473"},{"tid":669,"created_ino":"0x10000000474"},{"tid":670,"created_ino":"0x10000000475"},{"tid":671,"created_ino":"0x10000000476"},{"tid":672,"created_ino":"0x10000000477"},{"tid":673,"created_ino":"0x10000000478"},{"tid":674,"created_ino":"0x10000000479"},{"tid":675,"created_ino":"0x1000000047a"},{"tid":676,"created_ino":"0x1000000047b"},{"tid":677,"created_ino":"0x1000000047c"},{"tid":678,"created_ino":"0x1000000047d"},{"tid":679,"created_ino":"0x1000000047e"},{"tid":680,"created_ino":"0x1000000047f"},{"tid":681,"created_ino":"0x10000000480"},{"tid":682,"created_ino":"0x10000000481"},{"tid":683,"created_ino":"0x10000000482"},{"tid":684,"created_ino":"0x10000000483"},{"tid":685,"created_ino":"0x10000000484"},{"tid":686,"created_ino":"0x10000000485"},{"tid":687,"created_ino":"0x10000000486"},{"tid":688,"created_ino":"0x10000000487"},{"tid":689,"created_ino":"0x10000000488"},{"tid":690,"created_ino":"0x10000000489"},{"tid":691,"created_ino":"0x1000000048a"},{"tid":692,"created_ino":"0x1000000048b"},{"tid":693,"created_ino":"0x1000000048c"},{"tid":694,"created_ino":"0x1000000048d"},{"tid":695,"created_ino":"0x1000000048e"},{"tid":696,"created_ino":"0x1000000048f"},{"tid":697,"created_ino":"0x10000000490"},{"tid":698,"created_ino":"0x10000000491"},{"tid":699,"created_ino":"0x10000000492"},{"tid":700,"created_ino":"0x10000000493"},{"tid":701,"created_ino":"0x10000000494"},{"tid":702,"created_ino":"0x10000000495"},{"tid":703,"created_ino":"0x10000000496"},{"tid":704,"created_ino":"0x10000000497"},{"tid":705,"created_ino":"0x10000000498"},{"tid":706,"created_ino":"0x10000000499"},{"tid":707,"created_ino":"0x1000000049a"},{"tid":708,"created_ino":"0x1000000049b"},{"tid":709,"created_ino":"0x1000000049c"},{"tid":710,"created_ino":"0x1000000049d"},{"tid":711,"created_ino":"0x1000000049e"},{"tid":712,"created_ino":"0x1000000049f"},{"tid":713,"created_ino":"0x100000004a0"},{"tid":714,"created_ino":"0x100000004a1"},{"tid":715,"created_ino":"0x100000004a2"},{"tid":716,"created_ino":"0x100000004a3"},{"tid":717,"created_ino":"0x100000004a4"},{"tid":718,"created_ino":"0x100000004a5"},{"tid":719,"created_ino":"0x100000004a6"},{"tid":720,"created_ino":"0x100000004a7"},{"tid":721,"created_ino":"0x100000004a8"},{"tid":722,"created_ino":"0x100000004a9"},{"tid":723,"created_ino":"0x100000004aa"},{"tid":724,"created_ino":"0x100000004ab"},{"tid":725,"created_ino":"0x100000004ac"},{"tid":726,"created_ino":"0x100000004ad"},{"tid":727,"created_ino":"0x100000004ae"},{"tid":728,"created_ino":"0x100000004af"},{"tid":729,"created_ino":"0x100000004b0"},{"tid":730,"created_ino":"0x100000004b1"},{"tid":731,"created_ino":"0x100000004b2"},{"tid":732,"created_ino":"0x100000004b3"},{"tid":733,"created_ino":"0x100000004b4"},{"tid":734,"created_ino":"0x100000004b5"},{"tid":735,"created_ino":"0x100000004b6"},{"tid":736,"created_ino":"0x100000004b7"},{"tid":737,"created_ino":"0x100000004b8"},{"tid":738,"created_ino":"0x100000004b9"},{"tid":739,"created_ino":"0x100000004ba"},{"tid":740,"created_ino":"0x100000004bb"},{"tid":741,"created_ino":"0x100000004bc"},{"tid":742,"created_ino":"0x100000004bd"},{"tid":743,"created_ino":"0x100000004be"},{"tid":744,"created_ino":"0x100000004bf"},{"tid":745,"created_ino":"0x100000004c0"},{"tid":746,"created_ino":"0x100000004c1"},{"tid":747,"created_ino":"0x100000004c2"},{"tid":748,"created_ino":"0x100000004c3"},{"tid":749,"created_ino":"0x100000004c4"},{"tid":750,"created_ino":"0x100000004c5"},{"tid":751,"created_ino":"0x100000004c6"},{"tid":752,"created_ino":"0x100000004c7"},{"tid":753,"created_ino":"0x100000004c8"},{"tid":754,"created_ino":"0x100000004c9"},{"tid":755,"created_ino":"0x100000004ca"},{"tid":756,"created_ino":"0x100000004cb"},{"tid":757,"created_ino":"0x100000004cc"},{"tid":758,"created_ino":"0x100000004cd"},{"tid":759,"created_ino":"0x100000004ce"},{"tid":760,"created_ino":"0x100000004cf"},{"tid":761,"created_ino":"0x100000004d0"},{"tid":762,"created_ino":"0x100000004d1"},{"tid":763,"created_ino":"0x100000004d2"},{"tid":764,"created_ino":"0x100000004d3"},{"tid":765,"created_ino":"0x100000004d4"},{"tid":766,"created_ino":"0x100000004d5"},{"tid":767,"created_ino":"0x100000004d6"},{"tid":768,"created_ino":"0x100000004d7"},{"tid":769,"created_ino":"0x100000004d8"},{"tid":770,"created_ino":"0x100000004d9"},{"tid":771,"created_ino":"0x100000004da"},{"tid":772,"created_ino":"0x100000004db"},{"tid":773,"created_ino":"0x100000004dc"},{"tid":774,"created_ino":"0x100000004dd"},{"tid":775,"created_ino":"0x100000004de"},{"tid":776,"created_ino":"0x100000004df"},{"tid":777,"created_ino":"0x100000004e0"},{"tid":778,"created_ino":"0x100000004e1"},{"tid":779,"created_ino":"0x100000004e2"},{"tid":780,"created_ino":"0x100000004e3"},{"tid":781,"created_ino":"0x100000004e4"},{"tid":782,"created_ino":"0x100000004e5"},{"tid":783,"created_ino":"0x100000004e6"},{"tid":784,"created_ino":"0x100000004e7"},{"tid":785,"created_ino":"0x100000004e8"},{"tid":786,"created_ino":"0x100000004e9"},{"tid":787,"created_ino":"0x100000004ea"},{"tid":788,"created_ino":"0x100000004eb"},{"tid":789,"created_ino":"0x100000004ec"},{"tid":790,"created_ino":"0x100000004ed"},{"tid":791,"created_ino":"0x100000004ee"},{"tid":792,"created_ino":"0x100000004ef"},{"tid":793,"created_ino":"0x100000004f0"},{"tid":794,"created_ino":"0x100000004f1"},{"tid":795,"created_ino":"0x100000004f2"},{"tid":796,"created_ino":"0x100000004f3"},{"tid":797,"created_ino":"0x100000004f4"},{"tid":798,"created_ino":"0x100000004f5"},{"tid":799,"created_ino":"0x100000004f6"},{"tid":800,"created_ino":"0x100000004f7"},{"tid":801,"created_ino":"0x100000004f8"},{"tid":802,"created_ino":"0x100000004f9"},{"tid":803,"created_ino":"0x100000004fa"},{"tid":804,"created_ino":"0x100000004fb"},{"tid":805,"created_ino":"0x100000004fc"},{"tid":806,"created_ino":"0x100000004fd"},{"tid":807,"created_ino":"0x100000004fe"},{"tid":808,"created_ino":"0x100000004ff"},{"tid":809,"created_ino":"0x10000000500"},{"tid":810,"created_ino":"0x10000000501"},{"tid":811,"created_ino":"0x10000000502"},{"tid":812,"created_ino":"0x10000000503"},{"tid":813,"created_ino":"0x10000000504"},{"tid":814,"created_ino":"0x10000000505"},{"tid":815,"created_ino":"0x10000000506"},{"tid":816,"created_ino":"0x10000000507"},{"tid":817,"created_ino":"0x10000000508"},{"tid":818,"created_ino":"0x10000000509"},{"tid":819,"created_ino":"0x1000000050a"},{"tid":820,"created_ino":"0x1000000050b"},{"tid":821,"created_ino":"0x1000000050c"},{"tid":822,"created_ino":"0x1000000050d"},{"tid":823,"created_ino":"0x1000000050e"},{"tid":824,"created_ino":"0x1000000050f"},{"tid":825,"created_ino":"0x10000000510"},{"tid":826,"created_ino":"0x10000000511"},{"tid":827,"created_ino":"0x10000000512"},{"tid":828,"created_ino":"0x10000000513"}],"prealloc_inos":[{"start":"0x10000000002","length":500},{"start":"0x10000000514","length":203},{"start":"0x100000005e0","length":501}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi105","kernel_version":"5.14.0-508.el9.x86_64","root":"/"}}] 2024-09-21T03:25:34.244 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi162", "kernel_version": "5.14.0-508.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.162:0", "nonce": 1047057538, "type": "v1" }, "name": { "num": 7350, "type": "client" } }, "id": 7350, "inst": "client.7350 v1:172.21.15.162:0/1047057538", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.90231892287424 }, "state": "open", "uptime": 16.084672395 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi105", "kernel_version": "5.14.0-508.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [ { "created_ino": "0x100000003e9", "tid": 530 }, { "created_ino": "0x100000003ea", "tid": 531 }, { "created_ino": "0x100000003eb", "tid": 532 }, { "created_ino": "0x100000003ec", "tid": 533 }, { "created_ino": "0x100000003ed", "tid": 534 }, { "created_ino": "0x100000003ee", "tid": 535 }, { "created_ino": "0x100000003ef", "tid": 536 }, { "created_ino": "0x100000003f0", "tid": 537 }, { "created_ino": "0x100000003f1", "tid": 538 }, { "created_ino": "0x100000003f2", "tid": 539 }, { "created_ino": "0x100000003f3", "tid": 540 }, { "created_ino": "0x100000003f4", "tid": 541 }, { "created_ino": "0x100000003f5", "tid": 542 }, { "created_ino": "0x100000003f6", "tid": 543 }, { "created_ino": "0x100000003f7", "tid": 544 }, { "created_ino": "0x100000003f8", "tid": 545 }, { "created_ino": "0x100000003f9", "tid": 546 }, { "created_ino": "0x100000003fa", "tid": 547 }, { "created_ino": "0x100000003fb", "tid": 548 }, { "created_ino": "0x100000003fc", "tid": 549 }, { "created_ino": "0x100000003fd", "tid": 550 }, { "created_ino": "0x100000003fe", "tid": 551 }, { "created_ino": "0x100000003ff", "tid": 552 }, { "created_ino": "0x10000000400", "tid": 553 }, { "created_ino": "0x10000000401", "tid": 554 }, { "created_ino": "0x10000000402", "tid": 555 }, { "created_ino": "0x10000000403", "tid": 556 }, { "created_ino": "0x10000000404", "tid": 557 }, { "created_ino": "0x10000000405", "tid": 558 }, { "created_ino": "0x10000000406", "tid": 559 }, { "created_ino": "0x10000000407", "tid": 560 }, { "created_ino": "0x10000000408", "tid": 561 }, { "created_ino": "0x10000000409", "tid": 562 }, { "created_ino": "0x1000000040a", "tid": 563 }, { "created_ino": "0x1000000040b", "tid": 564 }, { "created_ino": "0x1000000040c", "tid": 565 }, { "created_ino": "0x1000000040d", "tid": 566 }, { "created_ino": "0x1000000040e", "tid": 567 }, { "created_ino": "0x1000000040f", "tid": 568 }, { "created_ino": "0x10000000410", "tid": 569 }, { "created_ino": "0x10000000411", "tid": 570 }, { "created_ino": "0x10000000412", "tid": 571 }, { "created_ino": "0x10000000413", "tid": 572 }, { "created_ino": "0x10000000414", "tid": 573 }, { "created_ino": "0x10000000415", "tid": 574 }, { "created_ino": "0x10000000416", "tid": 575 }, { "created_ino": "0x10000000417", "tid": 576 }, { "created_ino": "0x10000000418", "tid": 577 }, { "created_ino": "0x10000000419", "tid": 578 }, { "created_ino": "0x1000000041a", "tid": 579 }, { "created_ino": "0x1000000041b", "tid": 580 }, { "created_ino": "0x1000000041c", "tid": 581 }, { "created_ino": "0x1000000041d", "tid": 582 }, { "created_ino": "0x1000000041e", "tid": 583 }, { "created_ino": "0x1000000041f", "tid": 584 }, { "created_ino": "0x10000000420", "tid": 585 }, { "created_ino": "0x10000000421", "tid": 586 }, { "created_ino": "0x10000000422", "tid": 587 }, { "created_ino": "0x10000000423", "tid": 588 }, { "created_ino": "0x10000000424", "tid": 589 }, { "created_ino": "0x10000000425", "tid": 590 }, { "created_ino": "0x10000000426", "tid": 591 }, { "created_ino": "0x10000000427", "tid": 592 }, { "created_ino": "0x10000000428", "tid": 593 }, { "created_ino": "0x10000000429", "tid": 594 }, { "created_ino": "0x1000000042a", "tid": 595 }, { "created_ino": "0x1000000042b", "tid": 596 }, { "created_ino": "0x1000000042c", "tid": 597 }, { "created_ino": "0x1000000042d", "tid": 598 }, { "created_ino": "0x1000000042e", "tid": 599 }, { "created_ino": "0x1000000042f", "tid": 600 }, { "created_ino": "0x10000000430", "tid": 601 }, { "created_ino": "0x10000000431", "tid": 602 }, { "created_ino": "0x10000000432", "tid": 603 }, { "created_ino": "0x10000000433", "tid": 604 }, { "created_ino": "0x10000000434", "tid": 605 }, { "created_ino": "0x10000000435", "tid": 606 }, { "created_ino": "0x10000000436", "tid": 607 }, { "created_ino": "0x10000000437", "tid": 608 }, { "created_ino": "0x10000000438", "tid": 609 }, { "created_ino": "0x10000000439", "tid": 610 }, { "created_ino": "0x1000000043a", "tid": 611 }, { "created_ino": "0x1000000043b", "tid": 612 }, { "created_ino": "0x1000000043c", "tid": 613 }, { "created_ino": "0x1000000043d", "tid": 614 }, { "created_ino": "0x1000000043e", "tid": 615 }, { "created_ino": "0x1000000043f", "tid": 616 }, { "created_ino": "0x10000000440", "tid": 617 }, { "created_ino": "0x10000000441", "tid": 618 }, { "created_ino": "0x10000000442", "tid": 619 }, { "created_ino": "0x10000000443", "tid": 620 }, { "created_ino": "0x10000000444", "tid": 621 }, { "created_ino": "0x10000000445", "tid": 622 }, { "created_ino": "0x10000000446", "tid": 623 }, { "created_ino": "0x10000000447", "tid": 624 }, { "created_ino": "0x10000000448", "tid": 625 }, { "created_ino": "0x10000000449", "tid": 626 }, { "created_ino": "0x1000000044a", "tid": 627 }, { "created_ino": "0x1000000044b", "tid": 628 }, { "created_ino": "0x1000000044c", "tid": 629 }, { "created_ino": "0x1000000044d", "tid": 630 }, { "created_ino": "0x1000000044e", "tid": 631 }, { "created_ino": "0x1000000044f", "tid": 632 }, { "created_ino": "0x10000000450", "tid": 633 }, { "created_ino": "0x10000000451", "tid": 634 }, { "created_ino": "0x10000000452", "tid": 635 }, { "created_ino": "0x10000000453", "tid": 636 }, { "created_ino": "0x10000000454", "tid": 637 }, { "created_ino": "0x10000000455", "tid": 638 }, { "created_ino": "0x10000000456", "tid": 639 }, { "created_ino": "0x10000000457", "tid": 640 }, { "created_ino": "0x10000000458", "tid": 641 }, { "created_ino": "0x10000000459", "tid": 642 }, { "created_ino": "0x1000000045a", "tid": 643 }, { "created_ino": "0x1000000045b", "tid": 644 }, { "created_ino": "0x1000000045c", "tid": 645 }, { "created_ino": "0x1000000045d", "tid": 646 }, { "created_ino": "0x1000000045e", "tid": 647 }, { "created_ino": "0x1000000045f", "tid": 648 }, { "created_ino": "0x10000000460", "tid": 649 }, { "created_ino": "0x10000000461", "tid": 650 }, { "created_ino": "0x10000000462", "tid": 651 }, { "created_ino": "0x10000000463", "tid": 652 }, { "created_ino": "0x10000000464", "tid": 653 }, { "created_ino": "0x10000000465", "tid": 654 }, { "created_ino": "0x10000000466", "tid": 655 }, { "created_ino": "0x10000000467", "tid": 656 }, { "created_ino": "0x10000000468", "tid": 657 }, { "created_ino": "0x10000000469", "tid": 658 }, { "created_ino": "0x1000000046a", "tid": 659 }, { "created_ino": "0x1000000046b", "tid": 660 }, { "created_ino": "0x1000000046c", "tid": 661 }, { "created_ino": "0x1000000046d", "tid": 662 }, { "created_ino": "0x1000000046e", "tid": 663 }, { "created_ino": "0x1000000046f", "tid": 664 }, { "created_ino": "0x10000000470", "tid": 665 }, { "created_ino": "0x10000000471", "tid": 666 }, { "created_ino": "0x10000000472", "tid": 667 }, { "created_ino": "0x10000000473", "tid": 668 }, { "created_ino": "0x10000000474", "tid": 669 }, { "created_ino": "0x10000000475", "tid": 670 }, { "created_ino": "0x10000000476", "tid": 671 }, { "created_ino": "0x10000000477", "tid": 672 }, { "created_ino": "0x10000000478", "tid": 673 }, { "created_ino": "0x10000000479", "tid": 674 }, { "created_ino": "0x1000000047a", "tid": 675 }, { "created_ino": "0x1000000047b", "tid": 676 }, { "created_ino": "0x1000000047c", "tid": 677 }, { "created_ino": "0x1000000047d", "tid": 678 }, { "created_ino": "0x1000000047e", "tid": 679 }, { "created_ino": "0x1000000047f", "tid": 680 }, { "created_ino": "0x10000000480", "tid": 681 }, { "created_ino": "0x10000000481", "tid": 682 }, { "created_ino": "0x10000000482", "tid": 683 }, { "created_ino": "0x10000000483", "tid": 684 }, { "created_ino": "0x10000000484", "tid": 685 }, { "created_ino": "0x10000000485", "tid": 686 }, { "created_ino": "0x10000000486", "tid": 687 }, { "created_ino": "0x10000000487", "tid": 688 }, { "created_ino": "0x10000000488", "tid": 689 }, { "created_ino": "0x10000000489", "tid": 690 }, { "created_ino": "0x1000000048a", "tid": 691 }, { "created_ino": "0x1000000048b", "tid": 692 }, { "created_ino": "0x1000000048c", "tid": 693 }, { "created_ino": "0x1000000048d", "tid": 694 }, { "created_ino": "0x1000000048e", "tid": 695 }, { "created_ino": "0x1000000048f", "tid": 696 }, { "created_ino": "0x10000000490", "tid": 697 }, { "created_ino": "0x10000000491", "tid": 698 }, { "created_ino": "0x10000000492", "tid": 699 }, { "created_ino": "0x10000000493", "tid": 700 }, { "created_ino": "0x10000000494", "tid": 701 }, { "created_ino": "0x10000000495", "tid": 702 }, { "created_ino": "0x10000000496", "tid": 703 }, { "created_ino": "0x10000000497", "tid": 704 }, { "created_ino": "0x10000000498", "tid": 705 }, { "created_ino": "0x10000000499", "tid": 706 }, { "created_ino": "0x1000000049a", "tid": 707 }, { "created_ino": "0x1000000049b", "tid": 708 }, { "created_ino": "0x1000000049c", "tid": 709 }, { "created_ino": "0x1000000049d", "tid": 710 }, { "created_ino": "0x1000000049e", "tid": 711 }, { "created_ino": "0x1000000049f", "tid": 712 }, { "created_ino": "0x100000004a0", "tid": 713 }, { "created_ino": "0x100000004a1", "tid": 714 }, { "created_ino": "0x100000004a2", "tid": 715 }, { "created_ino": "0x100000004a3", "tid": 716 }, { "created_ino": "0x100000004a4", "tid": 717 }, { "created_ino": "0x100000004a5", "tid": 718 }, { "created_ino": "0x100000004a6", "tid": 719 }, { "created_ino": "0x100000004a7", "tid": 720 }, { "created_ino": "0x100000004a8", "tid": 721 }, { "created_ino": "0x100000004a9", "tid": 722 }, { "created_ino": "0x100000004aa", "tid": 723 }, { "created_ino": "0x100000004ab", "tid": 724 }, { "created_ino": "0x100000004ac", "tid": 725 }, { "created_ino": "0x100000004ad", "tid": 726 }, { "created_ino": "0x100000004ae", "tid": 727 }, { "created_ino": "0x100000004af", "tid": 728 }, { "created_ino": "0x100000004b0", "tid": 729 }, { "created_ino": "0x100000004b1", "tid": 730 }, { "created_ino": "0x100000004b2", "tid": 731 }, { "created_ino": "0x100000004b3", "tid": 732 }, { "created_ino": "0x100000004b4", "tid": 733 }, { "created_ino": "0x100000004b5", "tid": 734 }, { "created_ino": "0x100000004b6", "tid": 735 }, { "created_ino": "0x100000004b7", "tid": 736 }, { "created_ino": "0x100000004b8", "tid": 737 }, { "created_ino": "0x100000004b9", "tid": 738 }, { "created_ino": "0x100000004ba", "tid": 739 }, { "created_ino": "0x100000004bb", "tid": 740 }, { "created_ino": "0x100000004bc", "tid": 741 }, { "created_ino": "0x100000004bd", "tid": 742 }, { "created_ino": "0x100000004be", "tid": 743 }, { "created_ino": "0x100000004bf", "tid": 744 }, { "created_ino": "0x100000004c0", "tid": 745 }, { "created_ino": "0x100000004c1", "tid": 746 }, { "created_ino": "0x100000004c2", "tid": 747 }, { "created_ino": "0x100000004c3", "tid": 748 }, { "created_ino": "0x100000004c4", "tid": 749 }, { "created_ino": "0x100000004c5", "tid": 750 }, { "created_ino": "0x100000004c6", "tid": 751 }, { "created_ino": "0x100000004c7", "tid": 752 }, { "created_ino": "0x100000004c8", "tid": 753 }, { "created_ino": "0x100000004c9", "tid": 754 }, { "created_ino": "0x100000004ca", "tid": 755 }, { "created_ino": "0x100000004cb", "tid": 756 }, { "created_ino": "0x100000004cc", "tid": 757 }, { "created_ino": "0x100000004cd", "tid": 758 }, { "created_ino": "0x100000004ce", "tid": 759 }, { "created_ino": "0x100000004cf", "tid": 760 }, { "created_ino": "0x100000004d0", "tid": 761 }, { "created_ino": "0x100000004d1", "tid": 762 }, { "created_ino": "0x100000004d2", "tid": 763 }, { "created_ino": "0x100000004d3", "tid": 764 }, { "created_ino": "0x100000004d4", "tid": 765 }, { "created_ino": "0x100000004d5", "tid": 766 }, { "created_ino": "0x100000004d6", "tid": 767 }, { "created_ino": "0x100000004d7", "tid": 768 }, { "created_ino": "0x100000004d8", "tid": 769 }, { "created_ino": "0x100000004d9", "tid": 770 }, { "created_ino": "0x100000004da", "tid": 771 }, { "created_ino": "0x100000004db", "tid": 772 }, { "created_ino": "0x100000004dc", "tid": 773 }, { "created_ino": "0x100000004dd", "tid": 774 }, { "created_ino": "0x100000004de", "tid": 775 }, { "created_ino": "0x100000004df", "tid": 776 }, { "created_ino": "0x100000004e0", "tid": 777 }, { "created_ino": "0x100000004e1", "tid": 778 }, { "created_ino": "0x100000004e2", "tid": 779 }, { "created_ino": "0x100000004e3", "tid": 780 }, { "created_ino": "0x100000004e4", "tid": 781 }, { "created_ino": "0x100000004e5", "tid": 782 }, { "created_ino": "0x100000004e6", "tid": 783 }, { "created_ino": "0x100000004e7", "tid": 784 }, { "created_ino": "0x100000004e8", "tid": 785 }, { "created_ino": "0x100000004e9", "tid": 786 }, { "created_ino": "0x100000004ea", "tid": 787 }, { "created_ino": "0x100000004eb", "tid": 788 }, { "created_ino": "0x100000004ec", "tid": 789 }, { "created_ino": "0x100000004ed", "tid": 790 }, { "created_ino": "0x100000004ee", "tid": 791 }, { "created_ino": "0x100000004ef", "tid": 792 }, { "created_ino": "0x100000004f0", "tid": 793 }, { "created_ino": "0x100000004f1", "tid": 794 }, { "created_ino": "0x100000004f2", "tid": 795 }, { "created_ino": "0x100000004f3", "tid": 796 }, { "created_ino": "0x100000004f4", "tid": 797 }, { "created_ino": "0x100000004f5", "tid": 798 }, { "created_ino": "0x100000004f6", "tid": 799 }, { "created_ino": "0x100000004f7", "tid": 800 }, { "created_ino": "0x100000004f8", "tid": 801 }, { "created_ino": "0x100000004f9", "tid": 802 }, { "created_ino": "0x100000004fa", "tid": 803 }, { "created_ino": "0x100000004fb", "tid": 804 }, { "created_ino": "0x100000004fc", "tid": 805 }, { "created_ino": "0x100000004fd", "tid": 806 }, { "created_ino": "0x100000004fe", "tid": 807 }, { "created_ino": "0x100000004ff", "tid": 808 }, { "created_ino": "0x10000000500", "tid": 809 }, { "created_ino": "0x10000000501", "tid": 810 }, { "created_ino": "0x10000000502", "tid": 811 }, { "created_ino": "0x10000000503", "tid": 812 }, { "created_ino": "0x10000000504", "tid": 813 }, { "created_ino": "0x10000000505", "tid": 814 }, { "created_ino": "0x10000000506", "tid": 815 }, { "created_ino": "0x10000000507", "tid": 816 }, { "created_ino": "0x10000000508", "tid": 817 }, { "created_ino": "0x10000000509", "tid": 818 }, { "created_ino": "0x1000000050a", "tid": 819 }, { "created_ino": "0x1000000050b", "tid": 820 }, { "created_ino": "0x1000000050c", "tid": 821 }, { "created_ino": "0x1000000050d", "tid": 822 }, { "created_ino": "0x1000000050e", "tid": 823 }, { "created_ino": "0x1000000050f", "tid": 824 }, { "created_ino": "0x10000000510", "tid": 825 }, { "created_ino": "0x10000000511", "tid": 826 }, { "created_ino": "0x10000000512", "tid": 827 }, { "created_ino": "0x10000000513", "tid": 828 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "172.21.15.105:0", "nonce": 1954970807, "type": "v1" }, "name": { "num": 6098, "type": "client" } }, "id": 6098, "inst": "client.6098 v1:172.21.15.105:0/1954970807", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 530, "num_caps": 402, "num_completed_flushes": 0, "num_completed_requests": 299, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000002" }, { "length": 203, "start": "0x10000000514" }, { "length": 501, "start": "0x100000005e0" } ], "recall_caps": { "halflife": 60, "value": 4512.253890575343 }, "recall_caps_throttle": { "halflife": 1.5, "value": 946.1649285913594 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 360.2580898388034 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 399.2710662421175 }, "request_load_avg": 711, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 1557.3462291250933 }, "state": "open", "uptime": 17.21064945 } ] 2024-09-21T03:25:34.245 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-21T03:25:34.245 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T03:25:34.245 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T03:25:34.289 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T03:25:34.336 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T03:25:34.336 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T03:25:34.336 DEBUG:tasks.cephfs.mount:terminating RemoteProcess(client=, args=['stdin-killer', '--', 'python3', '-c', '\nimport fcntl\nimport sys\nimport time\nimport os\n\nfcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK)\n\nn = 800\nabs_path = "/home/ubuntu/cephtest/mnt.0/subdir"\n\nif not os.path.exists(abs_path):\n os.makedirs(abs_path)\n\nhandles = []\nfor i in range(0, n):\n fname = "file_"+str(i)\n path = os.path.join(abs_path, fname)\n handles.append(open(path, \'w\'))\n\nprint("waiting with handles open", file=sys.stderr)\nwhile True:\n print("open_n_background: keeping files open", file=sys.stderr)\n try:\n if os.read(0, 4096) == b"":\n break\n except BlockingIOError:\n pass\n time.sleep(2)\nprint("stdin closed, goodbye!", file=sys.stderr)\n'], check_status=True, hostname='smithi105') 2024-09-21T03:25:34.337 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:25:34.337 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:25:34.352 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:25:34.352 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:25:34.408 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T03:25:34.562 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.560+0000 7f913742e640 1 -- 172.21.15.105:0/1779052047 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91300b7cc0 msgr2=0x7f91300cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:34.562 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.560+0000 7f913742e640 1 --2- 172.21.15.105:0/1779052047 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91300b7cc0 0x7f91300cec10 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f9130074af0 tx=0x7f912002a530 comp rx=0 tx=0).stop 2024-09-21T03:25:34.562 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.560+0000 7f913742e640 1 -- 172.21.15.105:0/1779052047 shutdown_connections 2024-09-21T03:25:34.562 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.560+0000 7f913742e640 1 --2- 172.21.15.105:0/1779052047 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91300b7cc0 0x7f91300cec10 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:34.562 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.560+0000 7f913742e640 1 --2- 172.21.15.105:0/1779052047 >> v2:172.21.15.162:3300/0 conn(0x7f91301600b0 0x7f91300ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:34.562 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.560+0000 7f913742e640 1 -- 172.21.15.105:0/1779052047 >> 172.21.15.105:0/1779052047 conn(0x7f913006d4f0 msgr2=0x7f9130071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:34.562 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.560+0000 7f913742e640 1 -- 172.21.15.105:0/1779052047 shutdown_connections 2024-09-21T03:25:34.562 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.560+0000 7f913742e640 1 -- 172.21.15.105:0/1779052047 wait complete. 2024-09-21T03:25:34.563 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.562+0000 7f913742e640 1 Processor -- start 2024-09-21T03:25:34.563 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.562+0000 7f913742e640 1 -- start start 2024-09-21T03:25:34.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.563+0000 7f913742e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91300b7cc0 0x7f913014c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:34.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.563+0000 7f913742e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91300cf150 0x7f91300a95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:34.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.563+0000 7f913742e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91301600b0 0x7f91300b6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:34.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.563+0000 7f913742e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f91300b4460 con 0x7f91301600b0 2024-09-21T03:25:34.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.563+0000 7f913742e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f91300d1ba0 con 0x7f91300b7cc0 2024-09-21T03:25:34.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.563+0000 7f913742e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f91300b45e0 con 0x7f91300cf150 2024-09-21T03:25:34.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.563+0000 7f91359cb640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91301600b0 0x7f91300b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:34.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.563+0000 7f91359cb640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91301600b0 0x7f91300b6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56434/0 (socket says 172.21.15.105:56434) 2024-09-21T03:25:34.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.563+0000 7f91359cb640 1 -- 172.21.15.105:0/3428874016 learned_addr learned my addr 172.21.15.105:0/3428874016 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:34.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.563+0000 7f91351ca640 1 --2- 172.21.15.105:0/3428874016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91300b7cc0 0x7f913014c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:34.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.563+0000 7f91359cb640 1 -- 172.21.15.105:0/3428874016 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91300cf150 msgr2=0x7f91300a95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:34.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.563+0000 7f91359cb640 1 --2- 172.21.15.105:0/3428874016 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91300cf150 0x7f91300a95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:34.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.563+0000 7f91359cb640 1 -- 172.21.15.105:0/3428874016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91300b7cc0 msgr2=0x7f913014c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:34.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.563+0000 7f91359cb640 1 --2- 172.21.15.105:0/3428874016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91300b7cc0 0x7f913014c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:34.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.563+0000 7f91359cb640 1 -- 172.21.15.105:0/3428874016 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91300caf70 con 0x7f91301600b0 2024-09-21T03:25:34.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.563+0000 7f91351ca640 1 --2- 172.21.15.105:0/3428874016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91300b7cc0 0x7f913014c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:25:34.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.564+0000 7f91359cb640 1 --2- 172.21.15.105:0/3428874016 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91301600b0 0x7f91300b6610 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f912800cb10 tx=0x7f912800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:34.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.564+0000 7f9125ffb640 1 -- 172.21.15.105:0/3428874016 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9128016020 con 0x7f91301600b0 2024-09-21T03:25:34.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.564+0000 7f9125ffb640 1 -- 172.21.15.105:0/3428874016 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f912800ad00 con 0x7f91301600b0 2024-09-21T03:25:34.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.564+0000 7f913742e640 1 -- 172.21.15.105:0/3428874016 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91300cb250 con 0x7f91301600b0 2024-09-21T03:25:34.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.564+0000 7f9125ffb640 1 -- 172.21.15.105:0/3428874016 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9128012680 con 0x7f91301600b0 2024-09-21T03:25:34.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.564+0000 7f913742e640 1 -- 172.21.15.105:0/3428874016 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91300cb810 con 0x7f91301600b0 2024-09-21T03:25:34.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.565+0000 7f913742e640 1 -- 172.21.15.105:0/3428874016 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91300cace0 con 0x7f91301600b0 2024-09-21T03:25:34.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.566+0000 7f9125ffb640 1 -- 172.21.15.105:0/3428874016 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9128019020 con 0x7f91301600b0 2024-09-21T03:25:34.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.566+0000 7f9125ffb640 1 --2- 172.21.15.105:0/3428874016 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9114078b90 0x7f911407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:34.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.566+0000 7f9125ffb640 1 -- 172.21.15.105:0/3428874016 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f912809b380 con 0x7f91301600b0 2024-09-21T03:25:34.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.566+0000 7f91351ca640 1 --2- 172.21.15.105:0/3428874016 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9114078b90 0x7f911407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:34.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.567+0000 7f91351ca640 1 --2- 172.21.15.105:0/3428874016 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9114078b90 0x7f911407b0a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f912c00a870 tx=0x7f912c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:34.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.571+0000 7f9125ffb640 1 -- 172.21.15.105:0/3428874016 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9128020020 con 0x7f91301600b0 2024-09-21T03:25:34.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.757+0000 7f913742e640 1 -- 172.21.15.105:0/3428874016 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f91300cec10 con 0x7f91301600b0 2024-09-21T03:25:34.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.758+0000 7f9125ffb640 1 -- 172.21.15.105:0/3428874016 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v104) ==== 80+0+0 (secure 0 0 0) 0x7f91280637c0 con 0x7f91301600b0 2024-09-21T03:25:34.759 INFO:teuthology.orchestra.run.smithi105.stderr:listed 0 entries 2024-09-21T03:25:34.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.760+0000 7f913742e640 1 -- 172.21.15.105:0/3428874016 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9114078b90 msgr2=0x7f911407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:34.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.760+0000 7f913742e640 1 --2- 172.21.15.105:0/3428874016 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9114078b90 0x7f911407b0a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f912c00a870 tx=0x7f912c008040 comp rx=0 tx=0).stop 2024-09-21T03:25:34.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.760+0000 7f913742e640 1 -- 172.21.15.105:0/3428874016 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91301600b0 msgr2=0x7f91300b6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:34.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.760+0000 7f913742e640 1 --2- 172.21.15.105:0/3428874016 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91301600b0 0x7f91300b6610 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f912800cb10 tx=0x7f912800a060 comp rx=0 tx=0).stop 2024-09-21T03:25:34.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.760+0000 7f913742e640 1 -- 172.21.15.105:0/3428874016 shutdown_connections 2024-09-21T03:25:34.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.760+0000 7f913742e640 1 --2- 172.21.15.105:0/3428874016 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9114078b90 0x7f911407b0a0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:34.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.760+0000 7f913742e640 1 --2- 172.21.15.105:0/3428874016 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91301600b0 0x7f91300b6610 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:34.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.760+0000 7f913742e640 1 --2- 172.21.15.105:0/3428874016 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91300cf150 0x7f91300a95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:34.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.760+0000 7f913742e640 1 --2- 172.21.15.105:0/3428874016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91300b7cc0 0x7f913014c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:34.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.760+0000 7f913742e640 1 -- 172.21.15.105:0/3428874016 >> 172.21.15.105:0/3428874016 conn(0x7f913006d4f0 msgr2=0x7f91300b3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:34.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.760+0000 7f913742e640 1 -- 172.21.15.105:0/3428874016 shutdown_connections 2024-09-21T03:25:34.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:34.760+0000 7f913742e640 1 -- 172.21.15.105:0/3428874016 wait complete. 2024-09-21T03:25:34.773 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T03:25:34.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:25:34.773 DEBUG:teuthology.orchestra.run.smithi105:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T03:25:34.990 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi105.front.sepia.ceph.com 2024-09-21T03:25:34.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:25:34.990 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T03:25:35.006 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T03:25:35.006 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:25:35.006 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:25:35.023 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:25:35.023 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:25:35.080 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T03:25:35.192 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.191+0000 7f96aad52640 1 -- 172.21.15.105:0/1640672837 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96a41600b0 msgr2=0x7f96a40ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:35.193 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.191+0000 7f96aad52640 1 --2- 172.21.15.105:0/1640672837 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96a41600b0 0x7f96a40ccbc0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f96a4074fd0 tx=0x7f969402a560 comp rx=0 tx=0).stop 2024-09-21T03:25:35.193 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.191+0000 7f96aad52640 1 -- 172.21.15.105:0/1640672837 shutdown_connections 2024-09-21T03:25:35.193 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.191+0000 7f96aad52640 1 --2- 172.21.15.105:0/1640672837 >> v2:172.21.15.162:3300/0 conn(0x7f96a40cf150 0x7f96a40b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:35.193 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.191+0000 7f96aad52640 1 --2- 172.21.15.105:0/1640672837 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96a40b7cc0 0x7f96a40cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:35.193 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.191+0000 7f96aad52640 1 --2- 172.21.15.105:0/1640672837 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96a41600b0 0x7f96a40ccbc0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:35.193 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.191+0000 7f96aad52640 1 -- 172.21.15.105:0/1640672837 >> 172.21.15.105:0/1640672837 conn(0x7f96a406d4f0 msgr2=0x7f96a4071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:35.193 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.191+0000 7f96aad52640 1 -- 172.21.15.105:0/1640672837 shutdown_connections 2024-09-21T03:25:35.193 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.191+0000 7f96aad52640 1 -- 172.21.15.105:0/1640672837 wait complete. 2024-09-21T03:25:35.194 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.192+0000 7f96aad52640 1 Processor -- start 2024-09-21T03:25:35.194 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.192+0000 7f96aad52640 1 -- start start 2024-09-21T03:25:35.197 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.194+0000 7f96aad52640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96a40b7cc0 0x7f96a4146990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:35.197 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.194+0000 7f96aad52640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96a40cf150 0x7f96a4146ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:35.197 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.194+0000 7f96aad52640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96a41600b0 0x7f96a4147410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:35.197 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.194+0000 7f96aad52640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f96a40b4620 con 0x7f96a40cf150 2024-09-21T03:25:35.197 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.194+0000 7f96aad52640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f96a40b44a0 con 0x7f96a41600b0 2024-09-21T03:25:35.197 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.194+0000 7f96aad52640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f96a40b47a0 con 0x7f96a40b7cc0 2024-09-21T03:25:35.197 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.194+0000 7f96a3fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96a40cf150 0x7f96a4146ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:35.197 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.194+0000 7f96a3fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96a40cf150 0x7f96a4146ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56454/0 (socket says 172.21.15.105:56454) 2024-09-21T03:25:35.197 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.194+0000 7f96a3fff640 1 -- 172.21.15.105:0/229380435 learned_addr learned my addr 172.21.15.105:0/229380435 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:35.197 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.194+0000 7f96a8aee640 1 --2- 172.21.15.105:0/229380435 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96a40b7cc0 0x7f96a4146990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:35.197 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.194+0000 7f96a92ef640 1 --2- 172.21.15.105:0/229380435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96a41600b0 0x7f96a4147410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:35.197 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.194+0000 7f96a3fff640 1 -- 172.21.15.105:0/229380435 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96a40b7cc0 msgr2=0x7f96a4146990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:35.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.194+0000 7f96a3fff640 1 --2- 172.21.15.105:0/229380435 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96a40b7cc0 0x7f96a4146990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:35.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.194+0000 7f96a3fff640 1 -- 172.21.15.105:0/229380435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96a41600b0 msgr2=0x7f96a4147410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:35.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.194+0000 7f96a3fff640 1 --2- 172.21.15.105:0/229380435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96a41600b0 0x7f96a4147410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:35.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.194+0000 7f96a3fff640 1 -- 172.21.15.105:0/229380435 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a41543f0 con 0x7f96a40cf150 2024-09-21T03:25:35.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.195+0000 7f96a3fff640 1 --2- 172.21.15.105:0/229380435 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96a40cf150 0x7f96a4146ed0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f969800d650 tx=0x7f969800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:35.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.195+0000 7f96a17fa640 1 -- 172.21.15.105:0/229380435 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9698017070 con 0x7f96a40cf150 2024-09-21T03:25:35.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.195+0000 7f96a17fa640 1 -- 172.21.15.105:0/229380435 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9698005310 con 0x7f96a40cf150 2024-09-21T03:25:35.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.195+0000 7f96aad52640 1 -- 172.21.15.105:0/229380435 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96a40b6460 con 0x7f96a40cf150 2024-09-21T03:25:35.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.195+0000 7f96a17fa640 1 -- 172.21.15.105:0/229380435 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9698009820 con 0x7f96a40cf150 2024-09-21T03:25:35.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.195+0000 7f96aad52640 1 -- 172.21.15.105:0/229380435 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96a40b6a20 con 0x7f96a40cf150 2024-09-21T03:25:35.199 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.196+0000 7f96aad52640 1 -- 172.21.15.105:0/229380435 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96a40b6c20 con 0x7f96a40cf150 2024-09-21T03:25:35.199 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.197+0000 7f96a17fa640 1 -- 172.21.15.105:0/229380435 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f96980099c0 con 0x7f96a40cf150 2024-09-21T03:25:35.199 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.197+0000 7f96a17fa640 1 --2- 172.21.15.105:0/229380435 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9690078bc0 0x7f969007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:35.199 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.197+0000 7f96a17fa640 1 -- 172.21.15.105:0/229380435 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f969809b060 con 0x7f96a40cf150 2024-09-21T03:25:35.199 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.197+0000 7f96a8aee640 1 --2- 172.21.15.105:0/229380435 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9690078bc0 0x7f969007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:35.199 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.198+0000 7f96a8aee640 1 --2- 172.21.15.105:0/229380435 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9690078bc0 0x7f969007b0d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f9694033000 tx=0x7f9694004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:35.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.201+0000 7f96a17fa640 1 -- 172.21.15.105:0/229380435 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f96a40b6c20 con 0x7f96a40cf150 2024-09-21T03:25:35.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.387+0000 7f96aad52640 1 -- 172.21.15.105:0/229380435 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f96a40b3d50 con 0x7f96a40cf150 2024-09-21T03:25:35.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.387+0000 7f96a17fa640 1 -- 172.21.15.105:0/229380435 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v104) ==== 80+0+0 (secure 0 0 0) 0x7f9698062fc0 con 0x7f96a40cf150 2024-09-21T03:25:35.389 INFO:teuthology.orchestra.run.smithi105.stderr:listed 0 entries 2024-09-21T03:25:35.391 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.389+0000 7f96aad52640 1 -- 172.21.15.105:0/229380435 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9690078bc0 msgr2=0x7f969007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:35.391 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.389+0000 7f96aad52640 1 --2- 172.21.15.105:0/229380435 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9690078bc0 0x7f969007b0d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f9694033000 tx=0x7f9694004730 comp rx=0 tx=0).stop 2024-09-21T03:25:35.391 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.389+0000 7f96aad52640 1 -- 172.21.15.105:0/229380435 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96a40cf150 msgr2=0x7f96a4146ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:35.391 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.389+0000 7f96aad52640 1 --2- 172.21.15.105:0/229380435 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96a40cf150 0x7f96a4146ed0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f969800d650 tx=0x7f969800db10 comp rx=0 tx=0).stop 2024-09-21T03:25:35.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.390+0000 7f96aad52640 1 -- 172.21.15.105:0/229380435 shutdown_connections 2024-09-21T03:25:35.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.390+0000 7f96aad52640 1 --2- 172.21.15.105:0/229380435 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9690078bc0 0x7f969007b0d0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:35.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.390+0000 7f96aad52640 1 --2- 172.21.15.105:0/229380435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96a41600b0 0x7f96a4147410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:35.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.390+0000 7f96aad52640 1 --2- 172.21.15.105:0/229380435 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96a40cf150 0x7f96a4146ed0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:35.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.390+0000 7f96aad52640 1 --2- 172.21.15.105:0/229380435 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96a40b7cc0 0x7f96a4146990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:35.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.390+0000 7f96aad52640 1 -- 172.21.15.105:0/229380435 >> 172.21.15.105:0/229380435 conn(0x7f96a406d4f0 msgr2=0x7f96a40b2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:35.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.390+0000 7f96aad52640 1 -- 172.21.15.105:0/229380435 shutdown_connections 2024-09-21T03:25:35.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.390+0000 7f96aad52640 1 -- 172.21.15.105:0/229380435 wait complete. 2024-09-21T03:25:35.402 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-21T03:25:35.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:25:35.402 DEBUG:teuthology.orchestra.run.smithi162:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-21T03:25:35.433 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2024-09-21T03:25:35.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:25:35.433 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-21T03:25:35.490 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T03:25:35.490 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:25:35.490 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:25:35.506 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T03:25:35.506 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T03:25:35.506 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:25:35.506 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:25:35.547 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=452 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T03:25:35.547 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:25:35.659 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.657+0000 7efc084be640 1 -- 172.21.15.105:0/1342009015 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efbec003a00 msgr2=0x7efbec003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:35.660 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.657+0000 7efc084be640 1 --2- 172.21.15.105:0/1342009015 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efbec003a00 0x7efbec003e70 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0013d0 tx=0x7efbec005830 comp rx=0 tx=0).stop 2024-09-21T03:25:35.660 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.657+0000 7efc06a5b640 1 -- 172.21.15.105:0/1342009015 reap_dead start 2024-09-21T03:25:35.660 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.658+0000 7efc084be640 1 -- 172.21.15.105:0/1342009015 shutdown_connections 2024-09-21T03:25:35.660 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.658+0000 7efc084be640 1 -- 172.21.15.105:0/1342009015 >> 172.21.15.105:0/1342009015 conn(0x7efc000b1cb0 msgr2=0x7efc000b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:35.660 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.658+0000 7efc084be640 1 -- 172.21.15.105:0/1342009015 shutdown_connections 2024-09-21T03:25:35.660 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.658+0000 7efc084be640 1 -- 172.21.15.105:0/1342009015 wait complete. 2024-09-21T03:25:35.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.659+0000 7efc084be640 1 Processor -- start 2024-09-21T03:25:35.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.659+0000 7efc084be640 1 -- start start 2024-09-21T03:25:35.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.661+0000 7efc084be640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efbec003a00 0x7efc000b3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:35.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.661+0000 7efc084be640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efc00158200 0x7efc0015e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:35.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.661+0000 7efc084be640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc0015cf30 0x7efc0015d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:35.664 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.661+0000 7efc084be640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efc000cbb80 con 0x7efc0015cf30 2024-09-21T03:25:35.664 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.661+0000 7efc084be640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efc000cba00 con 0x7efbec003a00 2024-09-21T03:25:35.664 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.661+0000 7efc084be640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7efc000cbd00 con 0x7efc00158200 2024-09-21T03:25:35.664 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.661+0000 7efc06a5b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc0015cf30 0x7efc0015d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:35.664 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.661+0000 7efc06a5b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc0015cf30 0x7efc0015d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56476/0 (socket says 172.21.15.105:56476) 2024-09-21T03:25:35.664 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.661+0000 7efc06a5b640 1 -- 172.21.15.105:0/1409830620 learned_addr learned my addr 172.21.15.105:0/1409830620 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:35.664 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.661+0000 7efc0625a640 1 --2- 172.21.15.105:0/1409830620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efbec003a00 0x7efc000b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:35.664 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.661+0000 7efc05a59640 1 --2- 172.21.15.105:0/1409830620 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efc00158200 0x7efc0015e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:35.664 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.661+0000 7efc06a5b640 1 -- 172.21.15.105:0/1409830620 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efc00158200 msgr2=0x7efc0015e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:35.664 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.661+0000 7efc06a5b640 1 --2- 172.21.15.105:0/1409830620 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efc00158200 0x7efc0015e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:35.664 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.661+0000 7efc06a5b640 1 -- 172.21.15.105:0/1409830620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efbec003a00 msgr2=0x7efc000b3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:35.664 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.661+0000 7efc06a5b640 1 --2- 172.21.15.105:0/1409830620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efbec003a00 0x7efc000b3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:35.664 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.661+0000 7efc06a5b640 1 -- 172.21.15.105:0/1409830620 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc001594b0 con 0x7efc0015cf30 2024-09-21T03:25:35.664 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.661+0000 7efc06a5b640 1 --2- 172.21.15.105:0/1409830620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc0015cf30 0x7efc0015d340 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7efc00070c10 tx=0x7efbf8011d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:35.665 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.661+0000 7efbf6ffd640 1 -- 172.21.15.105:0/1409830620 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf8004240 con 0x7efc0015cf30 2024-09-21T03:25:35.665 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.661+0000 7efbf6ffd640 1 -- 172.21.15.105:0/1409830620 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efbf80043e0 con 0x7efc0015cf30 2024-09-21T03:25:35.665 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.661+0000 7efbf6ffd640 1 -- 172.21.15.105:0/1409830620 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf800eac0 con 0x7efc0015cf30 2024-09-21T03:25:35.665 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.661+0000 7efc084be640 1 -- 172.21.15.105:0/1409830620 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc00157440 con 0x7efc0015cf30 2024-09-21T03:25:35.665 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.661+0000 7efc084be640 1 -- 172.21.15.105:0/1409830620 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc00157a00 con 0x7efc0015cf30 2024-09-21T03:25:35.666 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.662+0000 7efc084be640 1 -- 172.21.15.105:0/1409830620 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc000735b0 con 0x7efc0015cf30 2024-09-21T03:25:35.666 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.663+0000 7efbf6ffd640 1 -- 172.21.15.105:0/1409830620 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efbf800ec60 con 0x7efc0015cf30 2024-09-21T03:25:35.666 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.663+0000 7efbf6ffd640 1 --2- 172.21.15.105:0/1409830620 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efbe4078b90 0x7efbe407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:35.666 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.664+0000 7efbf6ffd640 1 -- 172.21.15.105:0/1409830620 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7efbf809d3c0 con 0x7efc0015cf30 2024-09-21T03:25:35.666 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.664+0000 7efc0625a640 1 --2- 172.21.15.105:0/1409830620 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efbe4078b90 0x7efbe407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:35.666 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.664+0000 7efc0625a640 1 --2- 172.21.15.105:0/1409830620 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efbe4078b90 0x7efbe407b0a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7efbfc033000 tx=0x7efbfc001db0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:35.669 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.668+0000 7efbf6ffd640 1 -- 172.21.15.105:0/1409830620 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7efbf8065800 con 0x7efc0015cf30 2024-09-21T03:25:35.881 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.880+0000 7efc084be640 1 -- 172.21.15.105:0/1409830620 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc00070140 con 0x7efc0015cf30 2024-09-21T03:25:35.882 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.880+0000 7efbf6ffd640 1 -- 172.21.15.105:0/1409830620 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) ==== 94+0+5234 (secure 0 0 0) 0x7efbf8065100 con 0x7efc0015cf30 2024-09-21T03:25:35.882 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:35.883 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":67,"btime":"2024-09-21T03:25:31:461798+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5996,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/1026486886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1026486886},{"type":"v1","addr":"172.21.15.162:6836","nonce":1026486886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1085304139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1085304139},{"type":"v1","addr":"172.21.15.162:6837","nonce":1085304139}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":7161,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/569907499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":569907499},{"type":"v1","addr":"172.21.15.105:6833","nonce":569907499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:25:06.305459+0000","modified":"2024-09-21T03:25:30.978526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7164},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7164":{"gid":7164,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":9,"addr":"172.21.15.105:6835/2917579803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2917579803},{"type":"v1","addr":"172.21.15.105:6835","nonce":2917579803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7164,"qdb_cluster":[7164]},"id":8}]} 2024-09-21T03:25:35.883 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 67 2024-09-21T03:25:35.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.883+0000 7efc084be640 1 -- 172.21.15.105:0/1409830620 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efbe4078b90 msgr2=0x7efbe407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:35.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.883+0000 7efc084be640 1 --2- 172.21.15.105:0/1409830620 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efbe4078b90 0x7efbe407b0a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7efbfc033000 tx=0x7efbfc001db0 comp rx=0 tx=0).stop 2024-09-21T03:25:35.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.883+0000 7efc084be640 1 -- 172.21.15.105:0/1409830620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc0015cf30 msgr2=0x7efc0015d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:35.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.883+0000 7efc084be640 1 --2- 172.21.15.105:0/1409830620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc0015cf30 0x7efc0015d340 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7efc00070c10 tx=0x7efbf8011d30 comp rx=0 tx=0).stop 2024-09-21T03:25:35.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.883+0000 7efc084be640 1 -- 172.21.15.105:0/1409830620 shutdown_connections 2024-09-21T03:25:35.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.883+0000 7efc084be640 1 --2- 172.21.15.105:0/1409830620 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efbe4078b90 0x7efbe407b0a0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:35.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.883+0000 7efc084be640 1 --2- 172.21.15.105:0/1409830620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc0015cf30 0x7efc0015d340 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:35.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.883+0000 7efc084be640 1 --2- 172.21.15.105:0/1409830620 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efc00158200 0x7efc0015e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:35.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.883+0000 7efc084be640 1 --2- 172.21.15.105:0/1409830620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efbec003a00 0x7efc000b3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:35.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.883+0000 7efc084be640 1 -- 172.21.15.105:0/1409830620 >> 172.21.15.105:0/1409830620 conn(0x7efc000b1cb0 msgr2=0x7efc000d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:35.886 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.883+0000 7efc084be640 1 -- 172.21.15.105:0/1409830620 shutdown_connections 2024-09-21T03:25:35.886 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:35.883+0000 7efc084be640 1 -- 172.21.15.105:0/1409830620 wait complete. 2024-09-21T03:25:35.895 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:25:36.008 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.006+0000 7fdf9a569640 1 -- 172.21.15.105:0/2759217913 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf940b7cc0 msgr2=0x7fdf940cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:36.008 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.006+0000 7fdf9a569640 1 --2- 172.21.15.105:0/2759217913 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf940b7cc0 0x7fdf940cec10 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fdf88005fd0 tx=0x7fdf8802a5d0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.008 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.006+0000 7fdf9a569640 1 -- 172.21.15.105:0/2759217913 shutdown_connections 2024-09-21T03:25:36.008 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.006+0000 7fdf9a569640 1 --2- 172.21.15.105:0/2759217913 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf940b7cc0 0x7fdf940cec10 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.008 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.006+0000 7fdf9a569640 1 --2- 172.21.15.105:0/2759217913 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf941600b0 0x7fdf940ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.008 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.006+0000 7fdf9a569640 1 -- 172.21.15.105:0/2759217913 >> 172.21.15.105:0/2759217913 conn(0x7fdf9406d4f0 msgr2=0x7fdf94071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:36.009 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.006+0000 7fdf9a569640 1 -- 172.21.15.105:0/2759217913 shutdown_connections 2024-09-21T03:25:36.009 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.006+0000 7fdf9a569640 1 -- 172.21.15.105:0/2759217913 wait complete. 2024-09-21T03:25:36.009 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.008+0000 7fdf9a569640 1 Processor -- start 2024-09-21T03:25:36.009 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.008+0000 7fdf9a569640 1 -- start start 2024-09-21T03:25:36.012 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.009+0000 7fdf9a569640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf940b7cc0 0x7fdf9414e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:36.012 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.009+0000 7fdf9a569640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf940cf150 0x7fdf9406f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:36.012 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.009+0000 7fdf9a569640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf941600b0 0x7fdf940b64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:36.012 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.009+0000 7fdf9a569640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdf940b4460 con 0x7fdf940cf150 2024-09-21T03:25:36.013 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.009+0000 7fdf9a569640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdf940d1be0 con 0x7fdf940b7cc0 2024-09-21T03:25:36.013 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.009+0000 7fdf9a569640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdf940b45e0 con 0x7fdf941600b0 2024-09-21T03:25:36.013 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.009+0000 7fdf937fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf940cf150 0x7fdf9406f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:36.013 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.009+0000 7fdf937fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf940cf150 0x7fdf9406f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56502/0 (socket says 172.21.15.105:56502) 2024-09-21T03:25:36.013 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.009+0000 7fdf937fe640 1 -- 172.21.15.105:0/1245964966 learned_addr learned my addr 172.21.15.105:0/1245964966 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:36.013 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.010+0000 7fdf93fff640 1 --2- 172.21.15.105:0/1245964966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf940b7cc0 0x7fdf9414e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:36.013 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.010+0000 7fdf98b06640 1 --2- 172.21.15.105:0/1245964966 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf941600b0 0x7fdf940b64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:36.013 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.010+0000 7fdf937fe640 1 -- 172.21.15.105:0/1245964966 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf941600b0 msgr2=0x7fdf940b64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:36.013 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.010+0000 7fdf937fe640 1 --2- 172.21.15.105:0/1245964966 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf941600b0 0x7fdf940b64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.013 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.010+0000 7fdf937fe640 1 -- 172.21.15.105:0/1245964966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf940b7cc0 msgr2=0x7fdf9414e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:36.013 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.010+0000 7fdf937fe640 1 --2- 172.21.15.105:0/1245964966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf940b7cc0 0x7fdf9414e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.013 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.010+0000 7fdf937fe640 1 -- 172.21.15.105:0/1245964966 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf9406ee90 con 0x7fdf940cf150 2024-09-21T03:25:36.013 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.010+0000 7fdf937fe640 1 --2- 172.21.15.105:0/1245964966 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf940cf150 0x7fdf9406f310 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fdf88006010 tx=0x7fdf880038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:36.013 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.010+0000 7fdf90ff9640 1 -- 172.21.15.105:0/1245964966 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8803e030 con 0x7fdf940cf150 2024-09-21T03:25:36.014 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.010+0000 7fdf90ff9640 1 -- 172.21.15.105:0/1245964966 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf88003ca0 con 0x7fdf940cf150 2024-09-21T03:25:36.014 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.010+0000 7fdf90ff9640 1 -- 172.21.15.105:0/1245964966 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf88035040 con 0x7fdf940cf150 2024-09-21T03:25:36.014 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.010+0000 7fdf9a569640 1 -- 172.21.15.105:0/1245964966 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf9406e0d0 con 0x7fdf940cf150 2024-09-21T03:25:36.014 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.010+0000 7fdf9a569640 1 -- 172.21.15.105:0/1245964966 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf9406e690 con 0x7fdf940cf150 2024-09-21T03:25:36.015 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.011+0000 7fdf9a569640 1 -- 172.21.15.105:0/1245964966 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf940b4b20 con 0x7fdf940cf150 2024-09-21T03:25:36.015 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.012+0000 7fdf90ff9640 1 -- 172.21.15.105:0/1245964966 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdf88041030 con 0x7fdf940cf150 2024-09-21T03:25:36.015 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.012+0000 7fdf90ff9640 1 --2- 172.21.15.105:0/1245964966 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdf80078bc0 0x7fdf8007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:36.015 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.012+0000 7fdf90ff9640 1 -- 172.21.15.105:0/1245964966 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7fdf880bb290 con 0x7fdf940cf150 2024-09-21T03:25:36.015 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.013+0000 7fdf93fff640 1 --2- 172.21.15.105:0/1245964966 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdf80078bc0 0x7fdf8007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:36.015 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.013+0000 7fdf93fff640 1 --2- 172.21.15.105:0/1245964966 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdf80078bc0 0x7fdf8007b0d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fdf8400bb50 tx=0x7fdf8400b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:36.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.017+0000 7fdf90ff9640 1 -- 172.21.15.105:0/1245964966 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fdf88083080 con 0x7fdf940cf150 2024-09-21T03:25:36.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.227+0000 7fdf9a569640 1 -- 172.21.15.105:0/1245964966 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf940cecd0 con 0x7fdf940cf150 2024-09-21T03:25:36.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.228+0000 7fdf90ff9640 1 -- 172.21.15.105:0/1245964966 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) ==== 94+0+5234 (secure 0 0 0) 0x7fdf88087ab0 con 0x7fdf940cf150 2024-09-21T03:25:36.230 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:36.230 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":67,"btime":"2024-09-21T03:25:31:461798+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5996,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/1026486886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1026486886},{"type":"v1","addr":"172.21.15.162:6836","nonce":1026486886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1085304139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1085304139},{"type":"v1","addr":"172.21.15.162:6837","nonce":1085304139}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":7161,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/569907499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":569907499},{"type":"v1","addr":"172.21.15.105:6833","nonce":569907499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:25:06.305459+0000","modified":"2024-09-21T03:25:30.978526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7164},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7164":{"gid":7164,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":9,"addr":"172.21.15.105:6835/2917579803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2917579803},{"type":"v1","addr":"172.21.15.105:6835","nonce":2917579803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7164,"qdb_cluster":[7164]},"id":8}]} 2024-09-21T03:25:36.230 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 67 2024-09-21T03:25:36.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.230+0000 7fdf9a569640 1 -- 172.21.15.105:0/1245964966 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdf80078bc0 msgr2=0x7fdf8007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:36.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.230+0000 7fdf9a569640 1 --2- 172.21.15.105:0/1245964966 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdf80078bc0 0x7fdf8007b0d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fdf8400bb50 tx=0x7fdf8400b2e0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.230+0000 7fdf9a569640 1 -- 172.21.15.105:0/1245964966 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf940cf150 msgr2=0x7fdf9406f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:36.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.230+0000 7fdf9a569640 1 --2- 172.21.15.105:0/1245964966 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf940cf150 0x7fdf9406f310 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fdf88006010 tx=0x7fdf880038a0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.230+0000 7fdf9a569640 1 -- 172.21.15.105:0/1245964966 shutdown_connections 2024-09-21T03:25:36.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.230+0000 7fdf9a569640 1 --2- 172.21.15.105:0/1245964966 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdf80078bc0 0x7fdf8007b0d0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.230+0000 7fdf9a569640 1 --2- 172.21.15.105:0/1245964966 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf941600b0 0x7fdf940b64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.230+0000 7fdf9a569640 1 --2- 172.21.15.105:0/1245964966 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf940cf150 0x7fdf9406f310 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.230+0000 7fdf9a569640 1 --2- 172.21.15.105:0/1245964966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf940b7cc0 0x7fdf9414e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.230+0000 7fdf9a569640 1 -- 172.21.15.105:0/1245964966 >> 172.21.15.105:0/1245964966 conn(0x7fdf9406d4f0 msgr2=0x7fdf940b3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:36.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.230+0000 7fdf9a569640 1 -- 172.21.15.105:0/1245964966 shutdown_connections 2024-09-21T03:25:36.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.230+0000 7fdf9a569640 1 -- 172.21.15.105:0/1245964966 wait complete. 2024-09-21T03:25:36.243 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:25:36.355 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.353+0000 7fe8c5a70640 1 -- 172.21.15.105:0/880480179 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8c00ca800 msgr2=0x7fe8c00cba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:36.355 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.353+0000 7fe8c5a70640 1 --2- 172.21.15.105:0/880480179 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8c00ca800 0x7fe8c00cba00 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0009830 tx=0x7fe8b002a510 comp rx=0 tx=0).stop 2024-09-21T03:25:36.355 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.353+0000 7fe8c5a70640 1 -- 172.21.15.105:0/880480179 shutdown_connections 2024-09-21T03:25:36.355 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.353+0000 7fe8c5a70640 1 --2- 172.21.15.105:0/880480179 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8c00706b0 0x7fe8c00735b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.355 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.353+0000 7fe8c5a70640 1 --2- 172.21.15.105:0/880480179 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8c00ca800 0x7fe8c00cba00 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.355 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.353+0000 7fe8c5a70640 1 -- 172.21.15.105:0/880480179 >> 172.21.15.105:0/880480179 conn(0x7fe8c00b1cb0 msgr2=0x7fe8c00b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:36.355 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.353+0000 7fe8c5a70640 1 -- 172.21.15.105:0/880480179 shutdown_connections 2024-09-21T03:25:36.355 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.353+0000 7fe8c5a70640 1 -- 172.21.15.105:0/880480179 wait complete. 2024-09-21T03:25:36.356 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.354+0000 7fe8c5a70640 1 Processor -- start 2024-09-21T03:25:36.356 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.355+0000 7fe8c5a70640 1 -- start start 2024-09-21T03:25:36.359 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.356+0000 7fe8c5a70640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8c00ca800 0x7fe8c015e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:36.359 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.356+0000 7fe8c5a70640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8c00cad30 0x7fe8c00c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:36.359 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.356+0000 7fe8c5a70640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8c01f56f0 0x7fe8c01f5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:36.359 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.356+0000 7fe8c5a70640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c0073f00 con 0x7fe8c01f56f0 2024-09-21T03:25:36.359 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.356+0000 7fe8c5a70640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c0073d80 con 0x7fe8c00ca800 2024-09-21T03:25:36.359 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.356+0000 7fe8c5a70640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe8c0074080 con 0x7fe8c00cad30 2024-09-21T03:25:36.359 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.356+0000 7fe8bffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8c01f56f0 0x7fe8c01f5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:36.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.356+0000 7fe8bffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8c01f56f0 0x7fe8c01f5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56518/0 (socket says 172.21.15.105:56518) 2024-09-21T03:25:36.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.356+0000 7fe8bffff640 1 -- 172.21.15.105:0/4076280592 learned_addr learned my addr 172.21.15.105:0/4076280592 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:36.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.356+0000 7fe8bf7fe640 1 --2- 172.21.15.105:0/4076280592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8c00ca800 0x7fe8c015e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:36.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.356+0000 7fe8beffd640 1 --2- 172.21.15.105:0/4076280592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8c00cad30 0x7fe8c00c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:36.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.356+0000 7fe8bffff640 1 -- 172.21.15.105:0/4076280592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8c00cad30 msgr2=0x7fe8c00c3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:36.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.356+0000 7fe8bffff640 1 --2- 172.21.15.105:0/4076280592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8c00cad30 0x7fe8c00c3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.356+0000 7fe8bffff640 1 -- 172.21.15.105:0/4076280592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8c00ca800 msgr2=0x7fe8c015e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:36.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.356+0000 7fe8bffff640 1 --2- 172.21.15.105:0/4076280592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8c00ca800 0x7fe8c015e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.356+0000 7fe8bffff640 1 -- 172.21.15.105:0/4076280592 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c00c5a50 con 0x7fe8c01f56f0 2024-09-21T03:25:36.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.357+0000 7fe8bffff640 1 --2- 172.21.15.105:0/4076280592 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8c01f56f0 0x7fe8c01f5b00 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fe8b800e990 tx=0x7fe8b800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:36.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.357+0000 7fe8a7fff640 1 -- 172.21.15.105:0/4076280592 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b8004d20 con 0x7fe8c01f56f0 2024-09-21T03:25:36.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.357+0000 7fe8a7fff640 1 -- 172.21.15.105:0/4076280592 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8b800caa0 con 0x7fe8c01f56f0 2024-09-21T03:25:36.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.357+0000 7fe8c5a70640 1 -- 172.21.15.105:0/4076280592 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8c01f6040 con 0x7fe8c01f56f0 2024-09-21T03:25:36.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.357+0000 7fe8a7fff640 1 -- 172.21.15.105:0/4076280592 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b8005020 con 0x7fe8c01f56f0 2024-09-21T03:25:36.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.357+0000 7fe8c5a70640 1 -- 172.21.15.105:0/4076280592 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8c00c6020 con 0x7fe8c01f56f0 2024-09-21T03:25:36.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.358+0000 7fe8c5a70640 1 -- 172.21.15.105:0/4076280592 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8c00745e0 con 0x7fe8c01f56f0 2024-09-21T03:25:36.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.359+0000 7fe8a7fff640 1 -- 172.21.15.105:0/4076280592 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe8b80051c0 con 0x7fe8c01f56f0 2024-09-21T03:25:36.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.359+0000 7fe8a7fff640 1 --2- 172.21.15.105:0/4076280592 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe8ac078b90 0x7fe8ac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:36.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.359+0000 7fe8a7fff640 1 -- 172.21.15.105:0/4076280592 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7fe8b809b480 con 0x7fe8c01f56f0 2024-09-21T03:25:36.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.360+0000 7fe8bf7fe640 1 --2- 172.21.15.105:0/4076280592 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe8ac078b90 0x7fe8ac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:36.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.360+0000 7fe8bf7fe640 1 --2- 172.21.15.105:0/4076280592 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe8ac078b90 0x7fe8ac07b0a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0034000 tx=0x7fe8b0004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:36.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.364+0000 7fe8a7fff640 1 -- 172.21.15.105:0/4076280592 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe8b8016030 con 0x7fe8c01f56f0 2024-09-21T03:25:36.542 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.540+0000 7fe8c5a70640 1 -- 172.21.15.105:0/4076280592 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe8c00b23a0 con 0x7fe8c01f56f0 2024-09-21T03:25:36.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.542+0000 7fe8a7fff640 1 -- 172.21.15.105:0/4076280592 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) ==== 74+0+16759 (secure 0 0 0) 0x7fe8b8063390 con 0x7fe8c01f56f0 2024-09-21T03:25:36.543 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:36.544 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":104,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:25:07.945542+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:25:03.944314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-21T03:25:05.269304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:25:36.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.544+0000 7fe8c5a70640 1 -- 172.21.15.105:0/4076280592 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe8ac078b90 msgr2=0x7fe8ac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:36.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.544+0000 7fe8c5a70640 1 --2- 172.21.15.105:0/4076280592 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe8ac078b90 0x7fe8ac07b0a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0034000 tx=0x7fe8b0004730 comp rx=0 tx=0).stop 2024-09-21T03:25:36.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.544+0000 7fe8c5a70640 1 -- 172.21.15.105:0/4076280592 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8c01f56f0 msgr2=0x7fe8c01f5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:36.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.544+0000 7fe8c5a70640 1 --2- 172.21.15.105:0/4076280592 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8c01f56f0 0x7fe8c01f5b00 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fe8b800e990 tx=0x7fe8b800ee50 comp rx=0 tx=0).stop 2024-09-21T03:25:36.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.544+0000 7fe8c5a70640 1 -- 172.21.15.105:0/4076280592 shutdown_connections 2024-09-21T03:25:36.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.544+0000 7fe8c5a70640 1 --2- 172.21.15.105:0/4076280592 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe8ac078b90 0x7fe8ac07b0a0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.544+0000 7fe8c5a70640 1 --2- 172.21.15.105:0/4076280592 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8c01f56f0 0x7fe8c01f5b00 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.544+0000 7fe8c5a70640 1 --2- 172.21.15.105:0/4076280592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe8c00cad30 0x7fe8c00c3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.544+0000 7fe8c5a70640 1 --2- 172.21.15.105:0/4076280592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8c00ca800 0x7fe8c015e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.544+0000 7fe8c5a70640 1 -- 172.21.15.105:0/4076280592 >> 172.21.15.105:0/4076280592 conn(0x7fe8c00b1cb0 msgr2=0x7fe8c00aefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:36.547 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.544+0000 7fe8c5a70640 1 -- 172.21.15.105:0/4076280592 shutdown_connections 2024-09-21T03:25:36.547 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.544+0000 7fe8c5a70640 1 -- 172.21.15.105:0/4076280592 wait complete. 2024-09-21T03:25:36.557 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T03:25:36.557 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:25:36.669 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.667+0000 7f2c87be4640 1 -- 172.21.15.105:0/118060051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c800d2740 msgr2=0x7f2c800b5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:36.669 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.667+0000 7f2c87be4640 1 --2- 172.21.15.105:0/118060051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c800d2740 0x7f2c800b5430 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2c78005fd0 tx=0x7f2c7802a8b0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.669 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.667+0000 7f2c87be4640 1 -- 172.21.15.105:0/118060051 shutdown_connections 2024-09-21T03:25:36.669 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.667+0000 7f2c87be4640 1 --2- 172.21.15.105:0/118060051 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c8015e940 0x7f2c800d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.669 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.667+0000 7f2c87be4640 1 --2- 172.21.15.105:0/118060051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c800d2740 0x7f2c800b5430 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.669 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.667+0000 7f2c87be4640 1 -- 172.21.15.105:0/118060051 >> 172.21.15.105:0/118060051 conn(0x7f2c800b3f10 msgr2=0x7f2c800b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:36.669 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.667+0000 7f2c87be4640 1 -- 172.21.15.105:0/118060051 shutdown_connections 2024-09-21T03:25:36.669 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.667+0000 7f2c87be4640 1 -- 172.21.15.105:0/118060051 wait complete. 2024-09-21T03:25:36.670 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.669+0000 7f2c87be4640 1 Processor -- start 2024-09-21T03:25:36.670 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.669+0000 7f2c87be4640 1 -- start start 2024-09-21T03:25:36.673 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.670+0000 7f2c87be4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c800d0340 0x7f2c80156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:36.673 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.670+0000 7f2c87be4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c800d2740 0x7f2c80150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:36.673 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.670+0000 7f2c87be4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c8015e940 0x7f2c800cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:36.673 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.670+0000 7f2c87be4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2c800b5f50 con 0x7f2c8015e940 2024-09-21T03:25:36.673 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.670+0000 7f2c87be4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2c800b5dd0 con 0x7f2c800d0340 2024-09-21T03:25:36.673 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.670+0000 7f2c87be4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2c800b60d0 con 0x7f2c800d2740 2024-09-21T03:25:36.673 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.670+0000 7f2c86181640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c8015e940 0x7f2c800cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:36.673 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.670+0000 7f2c86181640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c8015e940 0x7f2c800cbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56520/0 (socket says 172.21.15.105:56520) 2024-09-21T03:25:36.673 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.670+0000 7f2c86181640 1 -- 172.21.15.105:0/110268705 learned_addr learned my addr 172.21.15.105:0/110268705 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:36.673 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.670+0000 7f2c85980640 1 --2- 172.21.15.105:0/110268705 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c800d0340 0x7f2c80156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:36.674 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.670+0000 7f2c8517f640 1 --2- 172.21.15.105:0/110268705 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c800d2740 0x7f2c80150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:36.674 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.670+0000 7f2c86181640 1 -- 172.21.15.105:0/110268705 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c800d2740 msgr2=0x7f2c80150370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:36.674 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.670+0000 7f2c86181640 1 --2- 172.21.15.105:0/110268705 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c800d2740 0x7f2c80150370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.674 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.670+0000 7f2c86181640 1 -- 172.21.15.105:0/110268705 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c800d0340 msgr2=0x7f2c80156c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:36.674 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.670+0000 7f2c86181640 1 --2- 172.21.15.105:0/110268705 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c800d0340 0x7f2c80156c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.674 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.670+0000 7f2c86181640 1 -- 172.21.15.105:0/110268705 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c800afa80 con 0x7f2c8015e940 2024-09-21T03:25:36.674 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.671+0000 7f2c86181640 1 --2- 172.21.15.105:0/110268705 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c8015e940 0x7f2c800cbaa0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f2c78009cd0 tx=0x7f2c78033f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:36.674 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.671+0000 7f2c767fc640 1 -- 172.21.15.105:0/110268705 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c78031990 con 0x7f2c8015e940 2024-09-21T03:25:36.674 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.671+0000 7f2c767fc640 1 -- 172.21.15.105:0/110268705 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c78031c20 con 0x7f2c8015e940 2024-09-21T03:25:36.674 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.671+0000 7f2c767fc640 1 -- 172.21.15.105:0/110268705 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c780330d0 con 0x7f2c8015e940 2024-09-21T03:25:36.674 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.671+0000 7f2c87be4640 1 -- 172.21.15.105:0/110268705 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c800c69a0 con 0x7f2c8015e940 2024-09-21T03:25:36.674 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.671+0000 7f2c87be4640 1 -- 172.21.15.105:0/110268705 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c800cb2a0 con 0x7f2c8015e940 2024-09-21T03:25:36.675 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.672+0000 7f2c87be4640 1 -- 172.21.15.105:0/110268705 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c800b65f0 con 0x7f2c8015e940 2024-09-21T03:25:36.675 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.673+0000 7f2c767fc640 1 -- 172.21.15.105:0/110268705 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2c78033270 con 0x7f2c8015e940 2024-09-21T03:25:36.675 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.673+0000 7f2c767fc640 1 --2- 172.21.15.105:0/110268705 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2c64078b90 0x7f2c6407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:36.675 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.673+0000 7f2c767fc640 1 -- 172.21.15.105:0/110268705 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f2c780bbce0 con 0x7f2c8015e940 2024-09-21T03:25:36.675 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.674+0000 7f2c85980640 1 --2- 172.21.15.105:0/110268705 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2c64078b90 0x7f2c6407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:36.676 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.674+0000 7f2c85980640 1 --2- 172.21.15.105:0/110268705 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2c64078b90 0x7f2c6407b0a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f2c8006ed10 tx=0x7f2c7c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:36.679 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.678+0000 7f2c767fc640 1 -- 172.21.15.105:0/110268705 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2c7804a070 con 0x7f2c8015e940 2024-09-21T03:25:36.889 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.887+0000 7f2c87be4640 1 -- 172.21.15.105:0/110268705 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2c800b2020 con 0x7f2c8015e940 2024-09-21T03:25:36.890 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.888+0000 7f2c767fc640 1 -- 172.21.15.105:0/110268705 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) ==== 94+0+5234 (secure 0 0 0) 0x7f2c7803f030 con 0x7f2c8015e940 2024-09-21T03:25:36.890 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:36.890 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":67,"btime":"2024-09-21T03:25:31:461798+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5996,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/1026486886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1026486886},{"type":"v1","addr":"172.21.15.162:6836","nonce":1026486886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1085304139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1085304139},{"type":"v1","addr":"172.21.15.162:6837","nonce":1085304139}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":7161,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/569907499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":569907499},{"type":"v1","addr":"172.21.15.105:6833","nonce":569907499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:25:06.305459+0000","modified":"2024-09-21T03:25:30.978526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7164},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7164":{"gid":7164,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":9,"addr":"172.21.15.105:6835/2917579803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2917579803},{"type":"v1","addr":"172.21.15.105:6835","nonce":2917579803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7164,"qdb_cluster":[7164]},"id":8}]} 2024-09-21T03:25:36.890 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 67 2024-09-21T03:25:36.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.890+0000 7f2c87be4640 1 -- 172.21.15.105:0/110268705 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2c64078b90 msgr2=0x7f2c6407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:36.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.890+0000 7f2c87be4640 1 --2- 172.21.15.105:0/110268705 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2c64078b90 0x7f2c6407b0a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f2c8006ed10 tx=0x7f2c7c009040 comp rx=0 tx=0).stop 2024-09-21T03:25:36.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.890+0000 7f2c87be4640 1 -- 172.21.15.105:0/110268705 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c8015e940 msgr2=0x7f2c800cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:36.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.890+0000 7f2c87be4640 1 --2- 172.21.15.105:0/110268705 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c8015e940 0x7f2c800cbaa0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f2c78009cd0 tx=0x7f2c78033f70 comp rx=0 tx=0).stop 2024-09-21T03:25:36.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.890+0000 7f2c87be4640 1 -- 172.21.15.105:0/110268705 shutdown_connections 2024-09-21T03:25:36.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.890+0000 7f2c87be4640 1 --2- 172.21.15.105:0/110268705 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2c64078b90 0x7f2c6407b0a0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.890+0000 7f2c87be4640 1 --2- 172.21.15.105:0/110268705 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c8015e940 0x7f2c800cbaa0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.890+0000 7f2c87be4640 1 --2- 172.21.15.105:0/110268705 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c800d2740 0x7f2c80150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.890+0000 7f2c87be4640 1 --2- 172.21.15.105:0/110268705 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c800d0340 0x7f2c80156c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.890+0000 7f2c87be4640 1 -- 172.21.15.105:0/110268705 >> 172.21.15.105:0/110268705 conn(0x7f2c800b3f10 msgr2=0x7f2c800b7910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:36.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.890+0000 7f2c87be4640 1 -- 172.21.15.105:0/110268705 shutdown_connections 2024-09-21T03:25:36.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:36.890+0000 7f2c87be4640 1 -- 172.21.15.105:0/110268705 wait complete. 2024-09-21T03:25:36.903 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:25:37.014 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.012+0000 7efc19e5c640 1 -- 172.21.15.105:0/3524397714 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc14144270 msgr2=0x7efc140b5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:37.014 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.012+0000 7efc19e5c640 1 --2- 172.21.15.105:0/3524397714 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc14144270 0x7efc140b5680 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7efc140b60f0 tx=0x7efc0402aa30 comp rx=0 tx=0).stop 2024-09-21T03:25:37.014 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.012+0000 7efc19e5c640 1 -- 172.21.15.105:0/3524397714 shutdown_connections 2024-09-21T03:25:37.014 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.012+0000 7efc19e5c640 1 --2- 172.21.15.105:0/3524397714 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efc14142680 0x7efc14074390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:37.014 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.012+0000 7efc19e5c640 1 --2- 172.21.15.105:0/3524397714 >> v2:172.21.15.162:3300/0 conn(0x7efc14142270 0x7efc14073e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:37.014 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.012+0000 7efc19e5c640 1 --2- 172.21.15.105:0/3524397714 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc14144270 0x7efc140b5680 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:37.014 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.012+0000 7efc19e5c640 1 -- 172.21.15.105:0/3524397714 >> 172.21.15.105:0/3524397714 conn(0x7efc140d15f0 msgr2=0x7efc14073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:37.014 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.012+0000 7efc19e5c640 1 -- 172.21.15.105:0/3524397714 shutdown_connections 2024-09-21T03:25:37.014 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.012+0000 7efc19e5c640 1 -- 172.21.15.105:0/3524397714 wait complete. 2024-09-21T03:25:37.015 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.014+0000 7efc19e5c640 1 Processor -- start 2024-09-21T03:25:37.015 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.014+0000 7efc19e5c640 1 -- start start 2024-09-21T03:25:37.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.015+0000 7efc19e5c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc14142270 0x7efc1415e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:37.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.015+0000 7efc19e5c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efc14142680 0x7efc141f3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:37.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.015+0000 7efc19e5c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc14144270 0x7efc141f6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:37.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.015+0000 7efc19e5c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efc140cfe60 con 0x7efc14144270 2024-09-21T03:25:37.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.015+0000 7efc19e5c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efc140b5dd0 con 0x7efc14142270 2024-09-21T03:25:37.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.015+0000 7efc19e5c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7efc140cffe0 con 0x7efc14142680 2024-09-21T03:25:37.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.015+0000 7efc13fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc14144270 0x7efc141f6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:37.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.015+0000 7efc13fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc14144270 0x7efc141f6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56550/0 (socket says 172.21.15.105:56550) 2024-09-21T03:25:37.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.015+0000 7efc13fff640 1 -- 172.21.15.105:0/2214576987 learned_addr learned my addr 172.21.15.105:0/2214576987 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:37.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.015+0000 7efc13fff640 1 -- 172.21.15.105:0/2214576987 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efc14142680 msgr2=0x7efc141f3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:37.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.015+0000 7efc13fff640 1 --2- 172.21.15.105:0/2214576987 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efc14142680 0x7efc141f3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:37.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.015+0000 7efc13fff640 1 -- 172.21.15.105:0/2214576987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc14142270 msgr2=0x7efc1415e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:37.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.015+0000 7efc137fe640 1 --2- 172.21.15.105:0/2214576987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc14142270 0x7efc1415e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:37.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.015+0000 7efc13fff640 1 --2- 172.21.15.105:0/2214576987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc14142270 0x7efc1415e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:37.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.015+0000 7efc13fff640 1 -- 172.21.15.105:0/2214576987 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc141f43c0 con 0x7efc14144270 2024-09-21T03:25:37.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.015+0000 7efc137fe640 1 --2- 172.21.15.105:0/2214576987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc14142270 0x7efc1415e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:25:37.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.016+0000 7efc13fff640 1 --2- 172.21.15.105:0/2214576987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc14144270 0x7efc141f6160 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7efc0c00c920 tx=0x7efc0c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:37.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.016+0000 7efbfbfff640 1 -- 172.21.15.105:0/2214576987 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0c007bb0 con 0x7efc14144270 2024-09-21T03:25:37.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.016+0000 7efbfbfff640 1 -- 172.21.15.105:0/2214576987 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc0c007e40 con 0x7efc14144270 2024-09-21T03:25:37.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.016+0000 7efc19e5c640 1 -- 172.21.15.105:0/2214576987 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc141562d0 con 0x7efc14144270 2024-09-21T03:25:37.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.016+0000 7efbfbfff640 1 -- 172.21.15.105:0/2214576987 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0c005280 con 0x7efc14144270 2024-09-21T03:25:37.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.016+0000 7efc19e5c640 1 -- 172.21.15.105:0/2214576987 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc14156890 con 0x7efc14144270 2024-09-21T03:25:37.020 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.017+0000 7efc19e5c640 1 -- 172.21.15.105:0/2214576987 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc141f4130 con 0x7efc14144270 2024-09-21T03:25:37.020 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.017+0000 7efbfbfff640 1 -- 172.21.15.105:0/2214576987 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efc0c005420 con 0x7efc14144270 2024-09-21T03:25:37.020 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.018+0000 7efbfbfff640 1 --2- 172.21.15.105:0/2214576987 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efc00078b90 0x7efc0007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:37.020 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.018+0000 7efbfbfff640 1 -- 172.21.15.105:0/2214576987 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7efc0c09b0d0 con 0x7efc14144270 2024-09-21T03:25:37.020 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.018+0000 7efc137fe640 1 --2- 172.21.15.105:0/2214576987 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efc00078b90 0x7efc0007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:37.020 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.019+0000 7efc137fe640 1 --2- 172.21.15.105:0/2214576987 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efc00078b90 0x7efc0007b0a0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7efc04035000 tx=0x7efc04004ab0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:37.024 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.022+0000 7efbfbfff640 1 -- 172.21.15.105:0/2214576987 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7efc0c014030 con 0x7efc14144270 2024-09-21T03:25:37.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.233+0000 7efc19e5c640 1 -- 172.21.15.105:0/2214576987 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc140b5680 con 0x7efc14144270 2024-09-21T03:25:37.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.234+0000 7efbfbfff640 1 -- 172.21.15.105:0/2214576987 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) ==== 94+0+5234 (secure 0 0 0) 0x7efc0c0634f0 con 0x7efc14144270 2024-09-21T03:25:37.236 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:37.236 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":67,"btime":"2024-09-21T03:25:31:461798+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5996,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/1026486886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1026486886},{"type":"v1","addr":"172.21.15.162:6836","nonce":1026486886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1085304139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1085304139},{"type":"v1","addr":"172.21.15.162:6837","nonce":1085304139}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":7161,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/569907499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":569907499},{"type":"v1","addr":"172.21.15.105:6833","nonce":569907499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:25:06.305459+0000","modified":"2024-09-21T03:25:30.978526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7164},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7164":{"gid":7164,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":9,"addr":"172.21.15.105:6835/2917579803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2917579803},{"type":"v1","addr":"172.21.15.105:6835","nonce":2917579803}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7164,"qdb_cluster":[7164]},"id":8}]} 2024-09-21T03:25:37.236 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 67 2024-09-21T03:25:37.238 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.236+0000 7efc19e5c640 1 -- 172.21.15.105:0/2214576987 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efc00078b90 msgr2=0x7efc0007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:37.238 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.236+0000 7efc19e5c640 1 --2- 172.21.15.105:0/2214576987 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efc00078b90 0x7efc0007b0a0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7efc04035000 tx=0x7efc04004ab0 comp rx=0 tx=0).stop 2024-09-21T03:25:37.238 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.236+0000 7efc19e5c640 1 -- 172.21.15.105:0/2214576987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc14144270 msgr2=0x7efc141f6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:37.238 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.236+0000 7efc19e5c640 1 --2- 172.21.15.105:0/2214576987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc14144270 0x7efc141f6160 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7efc0c00c920 tx=0x7efc0c00cde0 comp rx=0 tx=0).stop 2024-09-21T03:25:37.238 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.236+0000 7efc19e5c640 1 -- 172.21.15.105:0/2214576987 shutdown_connections 2024-09-21T03:25:37.239 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.236+0000 7efc19e5c640 1 --2- 172.21.15.105:0/2214576987 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efc00078b90 0x7efc0007b0a0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:37.239 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.236+0000 7efc19e5c640 1 --2- 172.21.15.105:0/2214576987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc14144270 0x7efc141f6160 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:37.239 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.236+0000 7efc19e5c640 1 --2- 172.21.15.105:0/2214576987 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efc14142680 0x7efc141f3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:37.239 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.236+0000 7efc19e5c640 1 --2- 172.21.15.105:0/2214576987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc14142270 0x7efc1415e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:37.239 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.236+0000 7efc19e5c640 1 -- 172.21.15.105:0/2214576987 >> 172.21.15.105:0/2214576987 conn(0x7efc140d15f0 msgr2=0x7efc1406f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:37.239 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.236+0000 7efc19e5c640 1 -- 172.21.15.105:0/2214576987 shutdown_connections 2024-09-21T03:25:37.239 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.236+0000 7efc19e5c640 1 -- 172.21.15.105:0/2214576987 wait complete. 2024-09-21T03:25:37.249 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:25:37.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.358+0000 7fbafb998640 1 -- 172.21.15.105:0/131724970 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbaf40b66b0 msgr2=0x7fbaf406eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:37.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.358+0000 7fbafb998640 1 --2- 172.21.15.105:0/131724970 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbaf40b66b0 0x7fbaf406eab0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fbaec009830 tx=0x7fbaec02a440 comp rx=0 tx=0).stop 2024-09-21T03:25:37.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.358+0000 7fbafb998640 1 -- 172.21.15.105:0/131724970 shutdown_connections 2024-09-21T03:25:37.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.358+0000 7fbafb998640 1 --2- 172.21.15.105:0/131724970 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbaf40b66b0 0x7fbaf406eab0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:37.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.358+0000 7fbafb998640 1 --2- 172.21.15.105:0/131724970 >> v2:172.21.15.162:3300/0 conn(0x7fbaf40b9b60 0x7fbaf40d4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:37.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.358+0000 7fbafb998640 1 -- 172.21.15.105:0/131724970 >> 172.21.15.105:0/131724970 conn(0x7fbaf409d7f0 msgr2=0x7fbaf40d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:37.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.358+0000 7fbafb998640 1 -- 172.21.15.105:0/131724970 shutdown_connections 2024-09-21T03:25:37.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.358+0000 7fbafb998640 1 -- 172.21.15.105:0/131724970 wait complete. 2024-09-21T03:25:37.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.360+0000 7fbafb998640 1 Processor -- start 2024-09-21T03:25:37.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.360+0000 7fbafb998640 1 -- start start 2024-09-21T03:25:37.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.361+0000 7fbafb998640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbaf40b9b60 0x7fbaf41f2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:37.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.361+0000 7fbafb998640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbaf40cf540 0x7fbaf415ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:37.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.361+0000 7fbafb998640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbaf40cab00 0x7fbaf415f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:37.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.361+0000 7fbafb998640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf406f600 con 0x7fbaf40b9b60 2024-09-21T03:25:37.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.361+0000 7fbafb998640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf406f480 con 0x7fbaf40cf540 2024-09-21T03:25:37.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.361+0000 7fbafb998640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbaf406f780 con 0x7fbaf40cab00 2024-09-21T03:25:37.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.361+0000 7fbaf9734640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbaf40b9b60 0x7fbaf41f2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:37.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.361+0000 7fbaf9734640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbaf40b9b60 0x7fbaf41f2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56560/0 (socket says 172.21.15.105:56560) 2024-09-21T03:25:37.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.361+0000 7fbaf9734640 1 -- 172.21.15.105:0/3526975107 learned_addr learned my addr 172.21.15.105:0/3526975107 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:37.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.362+0000 7fbaf8f33640 1 --2- 172.21.15.105:0/3526975107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbaf40cf540 0x7fbaf415ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:37.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.362+0000 7fbaf9f35640 1 --2- 172.21.15.105:0/3526975107 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbaf40cab00 0x7fbaf415f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:37.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.362+0000 7fbaf9734640 1 -- 172.21.15.105:0/3526975107 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbaf40cab00 msgr2=0x7fbaf415f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:37.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.362+0000 7fbaf9734640 1 --2- 172.21.15.105:0/3526975107 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbaf40cab00 0x7fbaf415f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:37.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.362+0000 7fbaf9734640 1 -- 172.21.15.105:0/3526975107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbaf40cf540 msgr2=0x7fbaf415ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:37.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.362+0000 7fbaf9734640 1 --2- 172.21.15.105:0/3526975107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbaf40cf540 0x7fbaf415ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:37.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.362+0000 7fbaf9734640 1 -- 172.21.15.105:0/3526975107 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf4160140 con 0x7fbaf40b9b60 2024-09-21T03:25:37.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.362+0000 7fbaf8f33640 1 --2- 172.21.15.105:0/3526975107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbaf40cf540 0x7fbaf415ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:25:37.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.362+0000 7fbaf9734640 1 --2- 172.21.15.105:0/3526975107 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbaf40b9b60 0x7fbaf41f2a20 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fbaf000da50 tx=0x7fbaf000df10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:37.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.362+0000 7fbae9ffb640 1 -- 172.21.15.105:0/3526975107 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf0017070 con 0x7fbaf40b9b60 2024-09-21T03:25:37.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.362+0000 7fbae9ffb640 1 -- 172.21.15.105:0/3526975107 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbaf0010460 con 0x7fbaf40b9b60 2024-09-21T03:25:37.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.362+0000 7fbafb998640 1 -- 172.21.15.105:0/3526975107 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaf41f5fe0 con 0x7fbaf40b9b60 2024-09-21T03:25:37.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.362+0000 7fbae9ffb640 1 -- 172.21.15.105:0/3526975107 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf00108b0 con 0x7fbaf40b9b60 2024-09-21T03:25:37.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.362+0000 7fbafb998640 1 -- 172.21.15.105:0/3526975107 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaf41e7240 con 0x7fbaf40b9b60 2024-09-21T03:25:37.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.363+0000 7fbafb998640 1 -- 172.21.15.105:0/3526975107 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaf406fce0 con 0x7fbaf40b9b60 2024-09-21T03:25:37.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.364+0000 7fbae9ffb640 1 -- 172.21.15.105:0/3526975107 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbaf001a070 con 0x7fbaf40b9b60 2024-09-21T03:25:37.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.365+0000 7fbae9ffb640 1 --2- 172.21.15.105:0/3526975107 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbad8078b90 0x7fbad807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:37.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.365+0000 7fbae9ffb640 1 -- 172.21.15.105:0/3526975107 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7fbaf009b590 con 0x7fbaf40b9b60 2024-09-21T03:25:37.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.365+0000 7fbaf8f33640 1 --2- 172.21.15.105:0/3526975107 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbad8078b90 0x7fbad807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:37.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.365+0000 7fbaf8f33640 1 --2- 172.21.15.105:0/3526975107 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbad8078b90 0x7fbad807b0a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fbaf40b9950 tx=0x7fbae4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:37.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.368+0000 7fbae9ffb640 1 -- 172.21.15.105:0/3526975107 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbaf0063b40 con 0x7fbaf40b9b60 2024-09-21T03:25:37.548 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.547+0000 7fbafb998640 1 -- 172.21.15.105:0/3526975107 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbaf40b3ac0 con 0x7fbaf40b9b60 2024-09-21T03:25:37.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.548+0000 7fbae9ffb640 1 -- 172.21.15.105:0/3526975107 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) ==== 74+0+16759 (secure 0 0 0) 0x7fbaf0063440 con 0x7fbaf40b9b60 2024-09-21T03:25:37.550 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:37.550 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":104,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:25:07.945542+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:25:03.944314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-21T03:25:05.269304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:25:37.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.550+0000 7fbafb998640 1 -- 172.21.15.105:0/3526975107 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbad8078b90 msgr2=0x7fbad807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:37.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.550+0000 7fbafb998640 1 --2- 172.21.15.105:0/3526975107 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbad8078b90 0x7fbad807b0a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fbaf40b9950 tx=0x7fbae4009040 comp rx=0 tx=0).stop 2024-09-21T03:25:37.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.550+0000 7fbafb998640 1 -- 172.21.15.105:0/3526975107 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbaf40b9b60 msgr2=0x7fbaf41f2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:37.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.550+0000 7fbafb998640 1 --2- 172.21.15.105:0/3526975107 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbaf40b9b60 0x7fbaf41f2a20 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fbaf000da50 tx=0x7fbaf000df10 comp rx=0 tx=0).stop 2024-09-21T03:25:37.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.550+0000 7fbafb998640 1 -- 172.21.15.105:0/3526975107 shutdown_connections 2024-09-21T03:25:37.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.550+0000 7fbafb998640 1 --2- 172.21.15.105:0/3526975107 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbad8078b90 0x7fbad807b0a0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:37.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.550+0000 7fbafb998640 1 --2- 172.21.15.105:0/3526975107 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbaf40cab00 0x7fbaf415f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:37.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.550+0000 7fbafb998640 1 --2- 172.21.15.105:0/3526975107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbaf40cf540 0x7fbaf415ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:37.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.550+0000 7fbafb998640 1 --2- 172.21.15.105:0/3526975107 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbaf40b9b60 0x7fbaf41f2a20 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:37.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.550+0000 7fbafb998640 1 -- 172.21.15.105:0/3526975107 >> 172.21.15.105:0/3526975107 conn(0x7fbaf409d7f0 msgr2=0x7fbaf40b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:37.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.551+0000 7fbafb998640 1 -- 172.21.15.105:0/3526975107 shutdown_connections 2024-09-21T03:25:37.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.551+0000 7fbafb998640 1 -- 172.21.15.105:0/3526975107 wait complete. 2024-09-21T03:25:37.563 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T03:25:37.677 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.675+0000 7fb0007a9640 1 -- 172.21.15.105:0/2657077818 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafe4003c10 msgr2=0x7fafe4004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:37.677 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.675+0000 7fb0007a9640 1 --2- 172.21.15.105:0/2657077818 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafe4003c10 0x7fafe4004060 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7faff4006fb0 tx=0x7fafe4005830 comp rx=0 tx=0).stop 2024-09-21T03:25:37.677 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.675+0000 7faffed46640 1 -- 172.21.15.105:0/2657077818 reap_dead start 2024-09-21T03:25:37.677 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.675+0000 7fb0007a9640 1 -- 172.21.15.105:0/2657077818 shutdown_connections 2024-09-21T03:25:37.677 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.675+0000 7fb0007a9640 1 -- 172.21.15.105:0/2657077818 >> 172.21.15.105:0/2657077818 conn(0x7faff808bfc0 msgr2=0x7faff809d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:37.677 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.675+0000 7fb0007a9640 1 -- 172.21.15.105:0/2657077818 shutdown_connections 2024-09-21T03:25:37.678 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.675+0000 7fb0007a9640 1 -- 172.21.15.105:0/2657077818 wait complete. 2024-09-21T03:25:37.678 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.677+0000 7fb0007a9640 1 Processor -- start 2024-09-21T03:25:37.678 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.677+0000 7fb0007a9640 1 -- start start 2024-09-21T03:25:37.681 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.678+0000 7fb0007a9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafe4003c10 0x7faff80c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:37.681 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.678+0000 7fb0007a9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faff81f9290 0x7faff81f96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:37.681 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.678+0000 7fb0007a9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faff80b7650 0x7faff80b7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:37.681 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.678+0000 7fb0007a9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7faff80cfd70 con 0x7faff80b7650 2024-09-21T03:25:37.681 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.678+0000 7fb0007a9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faff80cfbf0 con 0x7fafe4003c10 2024-09-21T03:25:37.681 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.678+0000 7fb0007a9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faff80b8990 con 0x7faff81f9290 2024-09-21T03:25:37.681 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.678+0000 7faffed46640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faff80b7650 0x7faff80b7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:37.681 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.678+0000 7faffed46640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faff80b7650 0x7faff80b7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56572/0 (socket says 172.21.15.105:56572) 2024-09-21T03:25:37.682 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.678+0000 7faffed46640 1 -- 172.21.15.105:0/3612805024 learned_addr learned my addr 172.21.15.105:0/3612805024 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:37.682 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.679+0000 7faffe545640 1 --2- 172.21.15.105:0/3612805024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafe4003c10 0x7faff80c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:37.682 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.679+0000 7faffed46640 1 -- 172.21.15.105:0/3612805024 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faff81f9290 msgr2=0x7faff81f96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:37.682 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.679+0000 7faffdd44640 1 --2- 172.21.15.105:0/3612805024 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faff81f9290 0x7faff81f96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:37.682 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.679+0000 7faffed46640 1 --2- 172.21.15.105:0/3612805024 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faff81f9290 0x7faff81f96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:37.682 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.679+0000 7faffed46640 1 -- 172.21.15.105:0/3612805024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafe4003c10 msgr2=0x7faff80c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:37.682 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.679+0000 7faffed46640 1 --2- 172.21.15.105:0/3612805024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafe4003c10 0x7faff80c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:37.682 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.679+0000 7faffed46640 1 -- 172.21.15.105:0/3612805024 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faff81f9be0 con 0x7faff80b7650 2024-09-21T03:25:37.682 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.679+0000 7faffe545640 1 --2- 172.21.15.105:0/3612805024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafe4003c10 0x7faff80c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:25:37.682 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.679+0000 7faffed46640 1 --2- 172.21.15.105:0/3612805024 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faff80b7650 0x7faff80b7a60 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7faff80a2440 tx=0x7faff0001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:37.682 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.679+0000 7fafeeffd640 1 -- 172.21.15.105:0/3612805024 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff0017070 con 0x7faff80b7650 2024-09-21T03:25:37.682 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.679+0000 7fafeeffd640 1 -- 172.21.15.105:0/3612805024 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faff00109a0 con 0x7faff80b7650 2024-09-21T03:25:37.683 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.679+0000 7fafeeffd640 1 -- 172.21.15.105:0/3612805024 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff0010df0 con 0x7faff80b7650 2024-09-21T03:25:37.683 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.679+0000 7fb0007a9640 1 -- 172.21.15.105:0/3612805024 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faff80cb9e0 con 0x7faff80b7650 2024-09-21T03:25:37.683 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.679+0000 7fb0007a9640 1 -- 172.21.15.105:0/3612805024 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faff80cdde0 con 0x7faff80b7650 2024-09-21T03:25:37.684 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.680+0000 7fb0007a9640 1 -- 172.21.15.105:0/3612805024 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faff81630e0 con 0x7faff80b7650 2024-09-21T03:25:37.684 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.681+0000 7fafeeffd640 1 -- 172.21.15.105:0/3612805024 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faff001a070 con 0x7faff80b7650 2024-09-21T03:25:37.684 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.681+0000 7fafeeffd640 1 --2- 172.21.15.105:0/3612805024 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fafdc078b90 0x7fafdc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:37.684 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.681+0000 7fafeeffd640 1 -- 172.21.15.105:0/3612805024 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7faff009abf0 con 0x7faff80b7650 2024-09-21T03:25:37.684 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.681+0000 7faffe545640 1 --2- 172.21.15.105:0/3612805024 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fafdc078b90 0x7fafdc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:37.684 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.682+0000 7faffe545640 1 --2- 172.21.15.105:0/3612805024 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fafdc078b90 0x7fafdc07b0a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7faff4033000 tx=0x7faff402d000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:37.687 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.686+0000 7fafeeffd640 1 -- 172.21.15.105:0/3612805024 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7faff81f9be0 con 0x7faff80b7650 2024-09-21T03:25:37.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.898+0000 7fb0007a9640 1 -- 172.21.15.105:0/3612805024 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7faff80cd8f0 con 0x7faff80b7650 2024-09-21T03:25:37.900 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:37.898+0000 7fafeeffd640 1 -- 172.21.15.105:0/3612805024 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=-1 MDS has one of two health warnings which could extend recovery: MDS_TRIM or MDS_CACHE_OVERSIZED. MDS failover is not recommended since it might cause unexpected file system unavailability. If you wish to proceed, pass --yes-i-really-mean-it v67) ==== 316+0+0 (secure 0 0 0) 0x7faff00630c0 con 0x7faff80b7650 2024-09-21T03:25:37.900 INFO:teuthology.orchestra.run.smithi105.stderr:Error EPERM: MDS has one of two health warnings which could extend recovery: MDS_TRIM or MDS_CACHE_OVERSIZED. MDS failover is not recommended since it might cause unexpected file system unavailability. If you wish to proceed, pass --yes-i-really-mean-it 2024-09-21T03:25:37.905 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:25:37.905 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs --yes-i-really-mean-it 2024-09-21T03:25:38.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.020+0000 7f02ed5ff640 1 -- 172.21.15.105:0/3189781982 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02e80d0280 msgr2=0x7f02e80d0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:38.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.020+0000 7f02ed5ff640 1 --2- 172.21.15.105:0/3189781982 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02e80d0280 0x7f02e80d0e60 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f02e80b3c30 tx=0x7f02e002ab40 comp rx=0 tx=0).stop 2024-09-21T03:25:38.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.020+0000 7f02ed5ff640 1 -- 172.21.15.105:0/3189781982 shutdown_connections 2024-09-21T03:25:38.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.020+0000 7f02ed5ff640 1 --2- 172.21.15.105:0/3189781982 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02e80d0280 0x7f02e80d0e60 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.020+0000 7f02ed5ff640 1 --2- 172.21.15.105:0/3189781982 >> v2:172.21.15.162:3300/0 conn(0x7f02e809b140 0x7f02e80b7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.020+0000 7f02ed5ff640 1 -- 172.21.15.105:0/3189781982 >> 172.21.15.105:0/3189781982 conn(0x7f02e80b3c60 msgr2=0x7f02e80b4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:38.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.020+0000 7f02ed5ff640 1 -- 172.21.15.105:0/3189781982 shutdown_connections 2024-09-21T03:25:38.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.020+0000 7f02ed5ff640 1 -- 172.21.15.105:0/3189781982 wait complete. 2024-09-21T03:25:38.023 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.021+0000 7f02ed5ff640 1 Processor -- start 2024-09-21T03:25:38.023 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.022+0000 7f02ed5ff640 1 -- start start 2024-09-21T03:25:38.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.023+0000 7f02ed5ff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02e809b140 0x7f02e815b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:38.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.023+0000 7f02ed5ff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02e80ce780 0x7f02e80c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:38.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.023+0000 7f02ed5ff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02e80d0280 0x7f02e80c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:38.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.023+0000 7f02ed5ff640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f02e80afe20 con 0x7f02e80d0280 2024-09-21T03:25:38.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.023+0000 7f02ed5ff640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f02e80afca0 con 0x7f02e80ce780 2024-09-21T03:25:38.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.023+0000 7f02ed5ff640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f02e80affa0 con 0x7f02e809b140 2024-09-21T03:25:38.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.023+0000 7f02e77fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02e80d0280 0x7f02e80c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:38.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.023+0000 7f02e77fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02e80d0280 0x7f02e80c83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56588/0 (socket says 172.21.15.105:56588) 2024-09-21T03:25:38.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.023+0000 7f02e77fe640 1 -- 172.21.15.105:0/4095126440 learned_addr learned my addr 172.21.15.105:0/4095126440 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:38.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.023+0000 7f02de7fc640 1 --2- 172.21.15.105:0/4095126440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02e80ce780 0x7f02e80c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:38.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.023+0000 7f02e6ffd640 1 --2- 172.21.15.105:0/4095126440 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02e809b140 0x7f02e815b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:38.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.023+0000 7f02e77fe640 1 -- 172.21.15.105:0/4095126440 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02e809b140 msgr2=0x7f02e815b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:38.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.023+0000 7f02e77fe640 1 --2- 172.21.15.105:0/4095126440 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02e809b140 0x7f02e815b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.023+0000 7f02e77fe640 1 -- 172.21.15.105:0/4095126440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02e80ce780 msgr2=0x7f02e80c7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:38.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.023+0000 7f02e77fe640 1 --2- 172.21.15.105:0/4095126440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02e80ce780 0x7f02e80c7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.023+0000 7f02e77fe640 1 -- 172.21.15.105:0/4095126440 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e81f37e0 con 0x7f02e80d0280 2024-09-21T03:25:38.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.023+0000 7f02e6ffd640 1 --2- 172.21.15.105:0/4095126440 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02e809b140 0x7f02e815b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:25:38.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.024+0000 7f02e77fe640 1 --2- 172.21.15.105:0/4095126440 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02e80d0280 0x7f02e80c83b0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f02e0009d60 tx=0x7f02e002c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:38.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.024+0000 7f02dffff640 1 -- 172.21.15.105:0/4095126440 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e0044070 con 0x7f02e80d0280 2024-09-21T03:25:38.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.024+0000 7f02dffff640 1 -- 172.21.15.105:0/4095126440 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f02e0004250 con 0x7f02e80d0280 2024-09-21T03:25:38.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.024+0000 7f02ed5ff640 1 -- 172.21.15.105:0/4095126440 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02e81f3ac0 con 0x7f02e80d0280 2024-09-21T03:25:38.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.024+0000 7f02dffff640 1 -- 172.21.15.105:0/4095126440 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e0004660 con 0x7f02e80d0280 2024-09-21T03:25:38.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.024+0000 7f02ed5ff640 1 -- 172.21.15.105:0/4095126440 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02e815dd20 con 0x7f02e80d0280 2024-09-21T03:25:38.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.025+0000 7f02ed5ff640 1 -- 172.21.15.105:0/4095126440 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02e80b04c0 con 0x7f02e80d0280 2024-09-21T03:25:38.029 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.025+0000 7f02dffff640 1 -- 172.21.15.105:0/4095126440 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f02e0036400 con 0x7f02e80d0280 2024-09-21T03:25:38.029 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.026+0000 7f02dffff640 1 --2- 172.21.15.105:0/4095126440 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f02c8078b90 0x7f02c807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:38.029 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.026+0000 7f02dffff640 1 -- 172.21.15.105:0/4095126440 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f02e00bb490 con 0x7f02e80d0280 2024-09-21T03:25:38.029 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.026+0000 7f02e6ffd640 1 --2- 172.21.15.105:0/4095126440 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f02c8078b90 0x7f02c807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:38.029 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.027+0000 7f02e6ffd640 1 --2- 172.21.15.105:0/4095126440 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f02c8078b90 0x7f02c807b0a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f02d8007fd0 tx=0x7f02d8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:38.032 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.031+0000 7f02dffff640 1 -- 172.21.15.105:0/4095126440 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f02e0032030 con 0x7f02e80d0280 2024-09-21T03:25:38.245 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.243+0000 7f02ed5ff640 1 -- 172.21.15.105:0/4095126440 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f02e815f350 con 0x7f02e80d0280 2024-09-21T03:25:38.245 INFO:tasks.ceph.mon.a.smithi105.stderr:2024-09-21T03:25:38.244+0000 7f25819ea640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T03:25:38.247 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.245+0000 7f02dffff640 1 -- 172.21.15.105:0/4095126440 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v68) ==== 191+0+0 (secure 0 0 0) 0x7f02e0083310 con 0x7f02e80d0280 2024-09-21T03:25:38.247 INFO:teuthology.orchestra.run.smithi105.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T03:25:38.251 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.249+0000 7f02ed5ff640 1 -- 172.21.15.105:0/4095126440 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f02c8078b90 msgr2=0x7f02c807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:38.251 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.249+0000 7f02ed5ff640 1 --2- 172.21.15.105:0/4095126440 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f02c8078b90 0x7f02c807b0a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f02d8007fd0 tx=0x7f02d8009040 comp rx=0 tx=0).stop 2024-09-21T03:25:38.251 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.249+0000 7f02ed5ff640 1 -- 172.21.15.105:0/4095126440 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02e80d0280 msgr2=0x7f02e80c83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:38.251 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.249+0000 7f02ed5ff640 1 --2- 172.21.15.105:0/4095126440 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02e80d0280 0x7f02e80c83b0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f02e0009d60 tx=0x7f02e002c8b0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.251 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.249+0000 7f02ed5ff640 1 -- 172.21.15.105:0/4095126440 shutdown_connections 2024-09-21T03:25:38.251 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.249+0000 7f02ed5ff640 1 --2- 172.21.15.105:0/4095126440 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f02c8078b90 0x7f02c807b0a0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.251 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.249+0000 7f02ed5ff640 1 --2- 172.21.15.105:0/4095126440 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02e80d0280 0x7f02e80c83b0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.251 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.249+0000 7f02ed5ff640 1 --2- 172.21.15.105:0/4095126440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02e80ce780 0x7f02e80c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.251 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.249+0000 7f02ed5ff640 1 --2- 172.21.15.105:0/4095126440 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02e809b140 0x7f02e815b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.249+0000 7f02ed5ff640 1 -- 172.21.15.105:0/4095126440 >> 172.21.15.105:0/4095126440 conn(0x7f02e80b3c60 msgr2=0x7f02e80b3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:38.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.249+0000 7f02ed5ff640 1 -- 172.21.15.105:0/4095126440 shutdown_connections 2024-09-21T03:25:38.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.249+0000 7f02ed5ff640 1 -- 172.21.15.105:0/4095126440 wait complete. 2024-09-21T03:25:38.263 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T03:25:38.312 INFO:tasks.ceph.mds.a.smithi105.stdout:starting mds.a at 2024-09-21T03:25:38.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.378+0000 7f371a027640 1 -- 172.21.15.105:0/3521766 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37140cad30 msgr2=0x7f371406ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:38.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.378+0000 7f371a027640 1 --2- 172.21.15.105:0/3521766 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37140cad30 0x7f371406ffa0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f36fc005fd0 tx=0x7f36fc02a530 comp rx=0 tx=0).stop 2024-09-21T03:25:38.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.378+0000 7f371a027640 1 -- 172.21.15.105:0/3521766 shutdown_connections 2024-09-21T03:25:38.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.378+0000 7f371a027640 1 --2- 172.21.15.105:0/3521766 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37140cad30 0x7f371406ffa0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.378+0000 7f371a027640 1 --2- 172.21.15.105:0/3521766 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37140ca800 0x7f37140cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.378+0000 7f371a027640 1 -- 172.21.15.105:0/3521766 >> 172.21.15.105:0/3521766 conn(0x7f37140b1cb0 msgr2=0x7f37140b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:38.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.378+0000 7f371a027640 1 -- 172.21.15.105:0/3521766 shutdown_connections 2024-09-21T03:25:38.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.378+0000 7f371a027640 1 -- 172.21.15.105:0/3521766 wait complete. 2024-09-21T03:25:38.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.380+0000 7f371a027640 1 Processor -- start 2024-09-21T03:25:38.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.380+0000 7f371a027640 1 -- start start 2024-09-21T03:25:38.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.381+0000 7f371a027640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37140704e0 0x7f371414d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:38.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.381+0000 7f371a027640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37140ca800 0x7f3714150230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:38.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.381+0000 7f371a027640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37140cad30 0x7f37140c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:38.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.381+0000 7f371a027640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f37140ccf40 con 0x7f37140ca800 2024-09-21T03:25:38.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.381+0000 7f371a027640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f37140747d0 con 0x7f37140cad30 2024-09-21T03:25:38.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.381+0000 7f371a027640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f37140cd0c0 con 0x7f37140704e0 2024-09-21T03:25:38.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.381+0000 7f3712ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37140ca800 0x7f3714150230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:38.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.381+0000 7f3712ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37140ca800 0x7f3714150230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56610/0 (socket says 172.21.15.105:56610) 2024-09-21T03:25:38.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.381+0000 7f3712ffd640 1 -- 172.21.15.105:0/810718439 learned_addr learned my addr 172.21.15.105:0/810718439 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:38.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.382+0000 7f37137fe640 1 --2- 172.21.15.105:0/810718439 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37140704e0 0x7f371414d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:38.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.382+0000 7f3713fff640 1 --2- 172.21.15.105:0/810718439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37140cad30 0x7f37140c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:38.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.382+0000 7f3712ffd640 1 -- 172.21.15.105:0/810718439 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37140704e0 msgr2=0x7f371414d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:38.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.382+0000 7f3712ffd640 1 --2- 172.21.15.105:0/810718439 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37140704e0 0x7f371414d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.382+0000 7f3712ffd640 1 -- 172.21.15.105:0/810718439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37140cad30 msgr2=0x7f37140c9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:38.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.382+0000 7f3712ffd640 1 --2- 172.21.15.105:0/810718439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37140cad30 0x7f37140c9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.382+0000 7f3712ffd640 1 -- 172.21.15.105:0/810718439 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37141f4150 con 0x7f37140ca800 2024-09-21T03:25:38.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.382+0000 7f3712ffd640 1 --2- 172.21.15.105:0/810718439 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37140ca800 0x7f3714150230 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f36fc034040 tx=0x7f36fc003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:38.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.382+0000 7f370bfff640 1 -- 172.21.15.105:0/810718439 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36fc03e030 con 0x7f37140ca800 2024-09-21T03:25:38.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.382+0000 7f370bfff640 1 -- 172.21.15.105:0/810718439 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f36fc0047a0 con 0x7f37140ca800 2024-09-21T03:25:38.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.382+0000 7f371a027640 1 -- 172.21.15.105:0/810718439 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3714150fa0 con 0x7f37140ca800 2024-09-21T03:25:38.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.382+0000 7f370bfff640 1 -- 172.21.15.105:0/810718439 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36fc035040 con 0x7f37140ca800 2024-09-21T03:25:38.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.382+0000 7f371a027640 1 -- 172.21.15.105:0/810718439 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37141f3670 con 0x7f37140ca800 2024-09-21T03:25:38.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.383+0000 7f371a027640 1 -- 172.21.15.105:0/810718439 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3714150d10 con 0x7f37140ca800 2024-09-21T03:25:38.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.384+0000 7f370bfff640 1 -- 172.21.15.105:0/810718439 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f36fc041030 con 0x7f37140ca800 2024-09-21T03:25:38.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.384+0000 7f370bfff640 1 --2- 172.21.15.105:0/810718439 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f36f4078b90 0x7f36f407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:38.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.385+0000 7f370bfff640 1 -- 172.21.15.105:0/810718439 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5795+0+0 (secure 0 0 0) 0x7f36fc0bb620 con 0x7f37140ca800 2024-09-21T03:25:38.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.385+0000 7f37137fe640 1 --2- 172.21.15.105:0/810718439 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f36f4078b90 0x7f36f407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:38.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.385+0000 7f37137fe640 1 --2- 172.21.15.105:0/810718439 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f36f4078b90 0x7f36f407b0a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f37140cb250 tx=0x7f370400a570 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:38.390 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.389+0000 7f370bfff640 1 -- 172.21.15.105:0/810718439 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f37140708f0 con 0x7f37140ca800 2024-09-21T03:25:38.606 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:38.605+0000 7f371a027640 1 -- 172.21.15.105:0/810718439 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f37140cd650 con 0x7f37140ca800 2024-09-21T03:25:39.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.247+0000 7f370bfff640 1 -- 172.21.15.105:0/810718439 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v69) ==== 104+0+0 (secure 0 0 0) 0x7f36fc0833b0 con 0x7f37140ca800 2024-09-21T03:25:39.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.251+0000 7f371a027640 1 -- 172.21.15.105:0/810718439 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f36f4078b90 msgr2=0x7f36f407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:39.253 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.251+0000 7f371a027640 1 --2- 172.21.15.105:0/810718439 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f36f4078b90 0x7f36f407b0a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f37140cb250 tx=0x7f370400a570 comp rx=0 tx=0).stop 2024-09-21T03:25:39.253 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.251+0000 7f371a027640 1 -- 172.21.15.105:0/810718439 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37140ca800 msgr2=0x7f3714150230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:39.253 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.251+0000 7f371a027640 1 --2- 172.21.15.105:0/810718439 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37140ca800 0x7f3714150230 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f36fc034040 tx=0x7f36fc003970 comp rx=0 tx=0).stop 2024-09-21T03:25:39.253 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.251+0000 7f371a027640 1 -- 172.21.15.105:0/810718439 shutdown_connections 2024-09-21T03:25:39.253 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.251+0000 7f371a027640 1 --2- 172.21.15.105:0/810718439 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f36f4078b90 0x7f36f407b0a0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:39.253 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.251+0000 7f371a027640 1 --2- 172.21.15.105:0/810718439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37140cad30 0x7f37140c9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:39.253 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.251+0000 7f371a027640 1 --2- 172.21.15.105:0/810718439 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37140ca800 0x7f3714150230 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:39.253 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.251+0000 7f371a027640 1 --2- 172.21.15.105:0/810718439 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37140704e0 0x7f371414d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:39.253 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.251+0000 7f371a027640 1 -- 172.21.15.105:0/810718439 >> 172.21.15.105:0/810718439 conn(0x7f37140b1cb0 msgr2=0x7f37140cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:39.253 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.251+0000 7f371a027640 1 -- 172.21.15.105:0/810718439 shutdown_connections 2024-09-21T03:25:39.253 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.251+0000 7f371a027640 1 -- 172.21.15.105:0/810718439 wait complete. 2024-09-21T03:25:39.265 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T03:25:39.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.383+0000 7f7538a38640 1 -- 172.21.15.105:0/234920292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75340d1d60 msgr2=0x7f753415c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:39.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.383+0000 7f7538a38640 1 --2- 172.21.15.105:0/234920292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75340d1d60 0x7f753415c5e0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f75340d33f0 tx=0x7f752402a460 comp rx=0 tx=0).stop 2024-09-21T03:25:39.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.383+0000 7f7538a38640 1 -- 172.21.15.105:0/234920292 shutdown_connections 2024-09-21T03:25:39.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.383+0000 7f7538a38640 1 --2- 172.21.15.105:0/234920292 >> v2:172.21.15.162:3300/0 conn(0x7f7534160660 0x7f75340ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:39.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.383+0000 7f7538a38640 1 --2- 172.21.15.105:0/234920292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75340d1d60 0x7f753415c5e0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:39.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.383+0000 7f7538a38640 1 -- 172.21.15.105:0/234920292 >> 172.21.15.105:0/234920292 conn(0x7f75340b3ea0 msgr2=0x7f75340b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:39.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.383+0000 7f7538a38640 1 -- 172.21.15.105:0/234920292 shutdown_connections 2024-09-21T03:25:39.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.383+0000 7f7538a38640 1 -- 172.21.15.105:0/234920292 wait complete. 2024-09-21T03:25:39.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.385+0000 7f7538a38640 1 Processor -- start 2024-09-21T03:25:39.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.385+0000 7f7538a38640 1 -- start start 2024-09-21T03:25:39.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.386+0000 7f7538a38640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75340d1d60 0x7f753415a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:39.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.386+0000 7f7538a38640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7534160250 0x7f75340ae130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:39.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.386+0000 7f7538a38640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7534160660 0x7f75341f8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:39.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.386+0000 7f7538a38640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f75340d0040 con 0x7f75340d1d60 2024-09-21T03:25:39.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.386+0000 7f7538a38640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f75340cfec0 con 0x7f7534160660 2024-09-21T03:25:39.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.386+0000 7f7538a38640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f75340d01c0 con 0x7f7534160250 2024-09-21T03:25:39.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.386+0000 7f753259c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75340d1d60 0x7f753415a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:39.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.386+0000 7f753259c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75340d1d60 0x7f753415a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56630/0 (socket says 172.21.15.105:56630) 2024-09-21T03:25:39.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.386+0000 7f753259c640 1 -- 172.21.15.105:0/686143348 learned_addr learned my addr 172.21.15.105:0/686143348 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:39.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.386+0000 7f753259c640 1 -- 172.21.15.105:0/686143348 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7534160250 msgr2=0x7f75340ae130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:39.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.386+0000 7f753259c640 1 --2- 172.21.15.105:0/686143348 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7534160250 0x7f75340ae130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:39.390 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.386+0000 7f753259c640 1 -- 172.21.15.105:0/686143348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7534160660 msgr2=0x7f75341f8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:39.390 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.386+0000 7f753259c640 1 --2- 172.21.15.105:0/686143348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7534160660 0x7f75341f8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:39.390 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.386+0000 7f753259c640 1 -- 172.21.15.105:0/686143348 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75340b0890 con 0x7f75340d1d60 2024-09-21T03:25:39.390 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.387+0000 7f753259c640 1 --2- 172.21.15.105:0/686143348 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75340d1d60 0x7f753415a3c0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f7524034040 tx=0x7f75240039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:39.390 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.387+0000 7f7522ffd640 1 -- 172.21.15.105:0/686143348 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752403e030 con 0x7f75340d1d60 2024-09-21T03:25:39.390 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.387+0000 7f7522ffd640 1 -- 172.21.15.105:0/686143348 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75240047a0 con 0x7f75340d1d60 2024-09-21T03:25:39.390 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.387+0000 7f7538a38640 1 -- 172.21.15.105:0/686143348 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75340b0d00 con 0x7f75340d1d60 2024-09-21T03:25:39.390 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.387+0000 7f7522ffd640 1 -- 172.21.15.105:0/686143348 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7524035040 con 0x7f75340d1d60 2024-09-21T03:25:39.390 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.387+0000 7f7538a38640 1 -- 172.21.15.105:0/686143348 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75340b12c0 con 0x7f75340d1d60 2024-09-21T03:25:39.391 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.388+0000 7f7538a38640 1 -- 172.21.15.105:0/686143348 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75340d0730 con 0x7f75340d1d60 2024-09-21T03:25:39.391 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.388+0000 7f7522ffd640 1 -- 172.21.15.105:0/686143348 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7524041030 con 0x7f75340d1d60 2024-09-21T03:25:39.391 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.389+0000 7f7522ffd640 1 --2- 172.21.15.105:0/686143348 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7514078b90 0x7f751407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:39.391 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.389+0000 7f7522ffd640 1 -- 172.21.15.105:0/686143348 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5795+0+0 (secure 0 0 0) 0x7f75240bb610 con 0x7f75340d1d60 2024-09-21T03:25:39.391 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.390+0000 7f7531d9b640 1 --2- 172.21.15.105:0/686143348 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7514078b90 0x7f751407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:39.391 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.390+0000 7f7531d9b640 1 --2- 172.21.15.105:0/686143348 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7514078b90 0x7f751407b0a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f75340cc850 tx=0x7f7528006ba0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:39.395 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.394+0000 7f7522ffd640 1 -- 172.21.15.105:0/686143348 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f75240839f0 con 0x7f75340d1d60 2024-09-21T03:25:39.574 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:39.572+0000 7f7538a38640 1 -- 172.21.15.105:0/686143348 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7534050f60 con 0x7f75340d1d60 2024-09-21T03:25:40.547 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.546+0000 7f7522ffd640 1 -- 172.21.15.105:0/686143348 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v106) ==== 181+0+0 (secure 0 0 0) 0x7f75240832f0 con 0x7f75340d1d60 2024-09-21T03:25:40.548 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_metadata' removed 2024-09-21T03:25:40.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.550+0000 7f7538a38640 1 -- 172.21.15.105:0/686143348 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7514078b90 msgr2=0x7f751407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:40.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.550+0000 7f7538a38640 1 --2- 172.21.15.105:0/686143348 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7514078b90 0x7f751407b0a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f75340cc850 tx=0x7f7528006ba0 comp rx=0 tx=0).stop 2024-09-21T03:25:40.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.550+0000 7f7538a38640 1 -- 172.21.15.105:0/686143348 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75340d1d60 msgr2=0x7f753415a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:40.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.550+0000 7f7538a38640 1 --2- 172.21.15.105:0/686143348 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75340d1d60 0x7f753415a3c0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f7524034040 tx=0x7f75240039e0 comp rx=0 tx=0).stop 2024-09-21T03:25:40.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.550+0000 7f7538a38640 1 -- 172.21.15.105:0/686143348 shutdown_connections 2024-09-21T03:25:40.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.550+0000 7f7538a38640 1 --2- 172.21.15.105:0/686143348 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7514078b90 0x7f751407b0a0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:40.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.550+0000 7f7538a38640 1 --2- 172.21.15.105:0/686143348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7534160660 0x7f75341f8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:40.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.550+0000 7f7538a38640 1 --2- 172.21.15.105:0/686143348 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7534160250 0x7f75340ae130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:40.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.550+0000 7f7538a38640 1 --2- 172.21.15.105:0/686143348 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75340d1d60 0x7f753415a3c0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:40.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.550+0000 7f7538a38640 1 -- 172.21.15.105:0/686143348 >> 172.21.15.105:0/686143348 conn(0x7f75340b3ea0 msgr2=0x7f7534072600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:40.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.550+0000 7f7538a38640 1 -- 172.21.15.105:0/686143348 shutdown_connections 2024-09-21T03:25:40.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.550+0000 7f7538a38640 1 -- 172.21.15.105:0/686143348 wait complete. 2024-09-21T03:25:40.566 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T03:25:40.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.685+0000 7f233108b640 1 -- 172.21.15.105:0/104316200 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f232c0ccc60 msgr2=0x7f232c0cd070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:40.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.685+0000 7f233108b640 1 --2- 172.21.15.105:0/104316200 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f232c0ccc60 0x7f232c0cd070 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f2320005fd0 tx=0x7f232002a5d0 comp rx=0 tx=0).stop 2024-09-21T03:25:40.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.685+0000 7f233108b640 1 -- 172.21.15.105:0/104316200 shutdown_connections 2024-09-21T03:25:40.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.685+0000 7f233108b640 1 --2- 172.21.15.105:0/104316200 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f232c0c5ec0 0x7f232c0c62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:40.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.685+0000 7f233108b640 1 --2- 172.21.15.105:0/104316200 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f232c0ccc60 0x7f232c0cd070 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:40.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.685+0000 7f233108b640 1 -- 172.21.15.105:0/104316200 >> 172.21.15.105:0/104316200 conn(0x7f232c0710b0 msgr2=0x7f232c0714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:40.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.685+0000 7f233108b640 1 -- 172.21.15.105:0/104316200 shutdown_connections 2024-09-21T03:25:40.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.686+0000 7f233108b640 1 -- 172.21.15.105:0/104316200 wait complete. 2024-09-21T03:25:40.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.688+0000 7f233108b640 1 Processor -- start 2024-09-21T03:25:40.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.688+0000 7f233108b640 1 -- start start 2024-09-21T03:25:40.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.689+0000 7f233108b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f232c0c5ec0 0x7f232c0aa120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:40.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.689+0000 7f233108b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f232c0ccc60 0x7f232c14f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:40.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.689+0000 7f233108b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f232c15c6f0 0x7f232c152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:40.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.689+0000 7f233108b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f232c0c6990 con 0x7f232c0c5ec0 2024-09-21T03:25:40.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.689+0000 7f233108b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f232c0c6810 con 0x7f232c0ccc60 2024-09-21T03:25:40.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.689+0000 7f233108b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f232c0c6b10 con 0x7f232c15c6f0 2024-09-21T03:25:40.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.689+0000 7f232ad9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f232c0c5ec0 0x7f232c0aa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:40.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.689+0000 7f232ad9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f232c0c5ec0 0x7f232c0aa120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:56652/0 (socket says 172.21.15.105:56652) 2024-09-21T03:25:40.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.689+0000 7f232ad9d640 1 -- 172.21.15.105:0/2337089999 learned_addr learned my addr 172.21.15.105:0/2337089999 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:40.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.689+0000 7f232a59c640 1 --2- 172.21.15.105:0/2337089999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f232c0ccc60 0x7f232c14f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:40.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.689+0000 7f232b59e640 1 --2- 172.21.15.105:0/2337089999 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f232c15c6f0 0x7f232c152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:40.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.689+0000 7f232ad9d640 1 -- 172.21.15.105:0/2337089999 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f232c15c6f0 msgr2=0x7f232c152090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:40.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.689+0000 7f232ad9d640 1 --2- 172.21.15.105:0/2337089999 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f232c15c6f0 0x7f232c152090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:40.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.689+0000 7f232ad9d640 1 -- 172.21.15.105:0/2337089999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f232c0ccc60 msgr2=0x7f232c14f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:40.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.689+0000 7f232ad9d640 1 --2- 172.21.15.105:0/2337089999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f232c0ccc60 0x7f232c14f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:40.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.689+0000 7f232ad9d640 1 -- 172.21.15.105:0/2337089999 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f232c152da0 con 0x7f232c0c5ec0 2024-09-21T03:25:40.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.690+0000 7f232ad9d640 1 --2- 172.21.15.105:0/2337089999 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f232c0c5ec0 0x7f232c0aa120 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f231c00c3c0 tx=0x7f231c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:40.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.690+0000 7f23137fe640 1 -- 172.21.15.105:0/2337089999 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231c017070 con 0x7f232c0c5ec0 2024-09-21T03:25:40.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.690+0000 7f23137fe640 1 -- 172.21.15.105:0/2337089999 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f231c0035f0 con 0x7f232c0c5ec0 2024-09-21T03:25:40.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.690+0000 7f233108b640 1 -- 172.21.15.105:0/2337089999 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f232c0a9640 con 0x7f232c0c5ec0 2024-09-21T03:25:40.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.690+0000 7f23137fe640 1 -- 172.21.15.105:0/2337089999 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231c003a80 con 0x7f232c0c5ec0 2024-09-21T03:25:40.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.690+0000 7f233108b640 1 -- 172.21.15.105:0/2337089999 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f232c0a9c00 con 0x7f232c0c5ec0 2024-09-21T03:25:40.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.691+0000 7f233108b640 1 -- 172.21.15.105:0/2337089999 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f232c06a670 con 0x7f232c0c5ec0 2024-09-21T03:25:40.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.691+0000 7f23137fe640 1 -- 172.21.15.105:0/2337089999 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f231c01a070 con 0x7f232c0c5ec0 2024-09-21T03:25:40.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.692+0000 7f23137fe640 1 --2- 172.21.15.105:0/2337089999 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2318078b90 0x7f231807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:40.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.692+0000 7f23137fe640 1 -- 172.21.15.105:0/2337089999 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5357+0+0 (secure 0 0 0) 0x7f231c099dd0 con 0x7f232c0c5ec0 2024-09-21T03:25:40.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.692+0000 7f232a59c640 1 --2- 172.21.15.105:0/2337089999 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2318078b90 0x7f231807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:40.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.693+0000 7f232a59c640 1 --2- 172.21.15.105:0/2337089999 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2318078b90 0x7f231807b0a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f2320033000 tx=0x7f2320004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:40.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.696+0000 7f23137fe640 1 -- 172.21.15.105:0/2337089999 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f232c06a670 con 0x7f232c0c5ec0 2024-09-21T03:25:40.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:40.873+0000 7f233108b640 1 -- 172.21.15.105:0/2337089999 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f232c0c6fe0 con 0x7f232c0c5ec0 2024-09-21T03:25:41.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.552+0000 7f23137fe640 1 -- 172.21.15.105:0/2337089999 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v107) ==== 169+0+0 (secure 0 0 0) 0x7f231c09b0d0 con 0x7f232c0c5ec0 2024-09-21T03:25:41.554 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_data' removed 2024-09-21T03:25:41.556 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.555+0000 7f233108b640 1 -- 172.21.15.105:0/2337089999 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2318078b90 msgr2=0x7f231807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:41.556 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.555+0000 7f233108b640 1 --2- 172.21.15.105:0/2337089999 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2318078b90 0x7f231807b0a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f2320033000 tx=0x7f2320004730 comp rx=0 tx=0).stop 2024-09-21T03:25:41.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.555+0000 7f233108b640 1 -- 172.21.15.105:0/2337089999 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f232c0c5ec0 msgr2=0x7f232c0aa120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:41.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.555+0000 7f233108b640 1 --2- 172.21.15.105:0/2337089999 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f232c0c5ec0 0x7f232c0aa120 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f231c00c3c0 tx=0x7f231c00c880 comp rx=0 tx=0).stop 2024-09-21T03:25:41.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.555+0000 7f233108b640 1 -- 172.21.15.105:0/2337089999 shutdown_connections 2024-09-21T03:25:41.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.555+0000 7f233108b640 1 --2- 172.21.15.105:0/2337089999 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2318078b90 0x7f231807b0a0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:41.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.555+0000 7f233108b640 1 --2- 172.21.15.105:0/2337089999 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f232c15c6f0 0x7f232c152090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:41.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.555+0000 7f233108b640 1 --2- 172.21.15.105:0/2337089999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f232c0ccc60 0x7f232c14f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:41.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.555+0000 7f233108b640 1 --2- 172.21.15.105:0/2337089999 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f232c0c5ec0 0x7f232c0aa120 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:41.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.555+0000 7f233108b640 1 -- 172.21.15.105:0/2337089999 >> 172.21.15.105:0/2337089999 conn(0x7f232c0710b0 msgr2=0x7f232c15b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:41.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.555+0000 7f233108b640 1 -- 172.21.15.105:0/2337089999 shutdown_connections 2024-09-21T03:25:41.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.555+0000 7f233108b640 1 -- 172.21.15.105:0/2337089999 wait complete. 2024-09-21T03:25:41.570 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-21T03:25:41.687 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.685+0000 7f9ce868b640 1 -- 172.21.15.105:0/613722658 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ce00b9b60 msgr2=0x7f9ce00d4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:41.687 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.685+0000 7f9ce868b640 1 --2- 172.21.15.105:0/613722658 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ce00b9b60 0x7f9ce00d4d80 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc0098e0 tx=0x7f9cdc02a480 comp rx=0 tx=0).stop 2024-09-21T03:25:41.687 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.685+0000 7f9ce868b640 1 -- 172.21.15.105:0/613722658 shutdown_connections 2024-09-21T03:25:41.687 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.685+0000 7f9ce868b640 1 --2- 172.21.15.105:0/613722658 >> v2:172.21.15.162:3300/0 conn(0x7f9ce00cf540 0x7f9ce00b5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:41.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.685+0000 7f9ce868b640 1 --2- 172.21.15.105:0/613722658 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ce00b9b60 0x7f9ce00d4d80 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:41.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.685+0000 7f9ce868b640 1 -- 172.21.15.105:0/613722658 >> 172.21.15.105:0/613722658 conn(0x7f9ce009d7f0 msgr2=0x7f9ce00d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:41.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.685+0000 7f9ce868b640 1 -- 172.21.15.105:0/613722658 shutdown_connections 2024-09-21T03:25:41.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.685+0000 7f9ce868b640 1 -- 172.21.15.105:0/613722658 wait complete. 2024-09-21T03:25:41.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.687+0000 7f9ce868b640 1 Processor -- start 2024-09-21T03:25:41.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.687+0000 7f9ce868b640 1 -- start start 2024-09-21T03:25:41.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.688+0000 7f9ce868b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ce00b64e0 0x7f9ce01f5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:41.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.688+0000 7f9ce868b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9ce00b9b60 0x7f9ce015d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:41.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.688+0000 7f9ce868b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ce00cf540 0x7f9ce00cdf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:41.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.688+0000 7f9ce868b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce00d2e40 con 0x7f9ce00b64e0 2024-09-21T03:25:41.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.688+0000 7f9ce868b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce00d2cc0 con 0x7f9ce00cf540 2024-09-21T03:25:41.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.688+0000 7f9ce868b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9ce00d2fc0 con 0x7f9ce00b9b60 2024-09-21T03:25:41.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.688+0000 7f9ce6427640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ce00b64e0 0x7f9ce01f5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:41.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.688+0000 7f9ce6427640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ce00b64e0 0x7f9ce01f5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:38690/0 (socket says 172.21.15.105:38690) 2024-09-21T03:25:41.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.688+0000 7f9ce6427640 1 -- 172.21.15.105:0/3395541470 learned_addr learned my addr 172.21.15.105:0/3395541470 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:41.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.689+0000 7f9ce6c28640 1 --2- 172.21.15.105:0/3395541470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ce00cf540 0x7f9ce00cdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:41.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.689+0000 7f9ce5c26640 1 --2- 172.21.15.105:0/3395541470 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9ce00b9b60 0x7f9ce015d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:41.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.689+0000 7f9ce6427640 1 -- 172.21.15.105:0/3395541470 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9ce00b9b60 msgr2=0x7f9ce015d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:41.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.689+0000 7f9ce6427640 1 --2- 172.21.15.105:0/3395541470 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9ce00b9b60 0x7f9ce015d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:41.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.689+0000 7f9ce6427640 1 -- 172.21.15.105:0/3395541470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ce00cf540 msgr2=0x7f9ce00cdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:41.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.689+0000 7f9ce6427640 1 --2- 172.21.15.105:0/3395541470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ce00cf540 0x7f9ce00cdf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:41.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.689+0000 7f9ce6427640 1 -- 172.21.15.105:0/3395541470 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce0160490 con 0x7f9ce00b64e0 2024-09-21T03:25:41.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.689+0000 7f9ce6427640 1 --2- 172.21.15.105:0/3395541470 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ce00b64e0 0x7f9ce01f5ba0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc02aa70 tx=0x7f9cdc004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:41.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.689+0000 7f9cd6ffd640 1 -- 172.21.15.105:0/3395541470 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc031d60 con 0x7f9ce00b64e0 2024-09-21T03:25:41.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.689+0000 7f9cd6ffd640 1 -- 172.21.15.105:0/3395541470 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9cdc0330d0 con 0x7f9ce00b64e0 2024-09-21T03:25:41.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.689+0000 7f9ce868b640 1 -- 172.21.15.105:0/3395541470 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ce01f91d0 con 0x7f9ce00b64e0 2024-09-21T03:25:41.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.689+0000 7f9cd6ffd640 1 -- 172.21.15.105:0/3395541470 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc033520 con 0x7f9ce00b64e0 2024-09-21T03:25:41.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.689+0000 7f9ce868b640 1 -- 172.21.15.105:0/3395541470 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ce0160a50 con 0x7f9ce00b64e0 2024-09-21T03:25:41.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.690+0000 7f9ce868b640 1 -- 172.21.15.105:0/3395541470 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ce00d4d80 con 0x7f9ce00b64e0 2024-09-21T03:25:41.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.691+0000 7f9cd6ffd640 1 -- 172.21.15.105:0/3395541470 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9cdc03b410 con 0x7f9ce00b64e0 2024-09-21T03:25:41.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.691+0000 7f9cd6ffd640 1 --2- 172.21.15.105:0/3395541470 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9cc4078bc0 0x7f9cc407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:41.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.691+0000 7f9cd6ffd640 1 -- 172.21.15.105:0/3395541470 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 4943+0+0 (secure 0 0 0) 0x7f9cdc0bbee0 con 0x7f9ce00b64e0 2024-09-21T03:25:41.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.691+0000 7f9ce5c26640 1 --2- 172.21.15.105:0/3395541470 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9cc4078bc0 0x7f9cc407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:41.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.692+0000 7f9ce5c26640 1 --2- 172.21.15.105:0/3395541470 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9cc4078bc0 0x7f9cc407b0d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f9ce015a530 tx=0x7f9cd0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:41.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.696+0000 7f9cd6ffd640 1 -- 172.21.15.105:0/3395541470 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9cdc03f030 con 0x7f9ce00b64e0 2024-09-21T03:25:41.895 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.893+0000 7f9ce868b640 1 -- 172.21.15.105:0/3395541470 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f9ce00d4770 con 0x7f9ce00b64e0 2024-09-21T03:25:41.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.897+0000 7f9cd6ffd640 1 -- 172.21.15.105:0/3395541470 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v56) ==== 71+0+0 (secure 0 0 0) 0x7f9ce00b68f0 con 0x7f9ce00b64e0 2024-09-21T03:25:41.901 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.899+0000 7f9ce868b640 1 -- 172.21.15.105:0/3395541470 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9cc4078bc0 msgr2=0x7f9cc407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:41.901 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.899+0000 7f9ce868b640 1 --2- 172.21.15.105:0/3395541470 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9cc4078bc0 0x7f9cc407b0d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f9ce015a530 tx=0x7f9cd0008040 comp rx=0 tx=0).stop 2024-09-21T03:25:41.901 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.899+0000 7f9ce868b640 1 -- 172.21.15.105:0/3395541470 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ce00b64e0 msgr2=0x7f9ce01f5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:41.902 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.899+0000 7f9ce868b640 1 --2- 172.21.15.105:0/3395541470 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ce00b64e0 0x7f9ce01f5ba0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc02aa70 tx=0x7f9cdc004ac0 comp rx=0 tx=0).stop 2024-09-21T03:25:41.902 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.899+0000 7f9ce868b640 1 -- 172.21.15.105:0/3395541470 shutdown_connections 2024-09-21T03:25:41.902 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.899+0000 7f9ce868b640 1 --2- 172.21.15.105:0/3395541470 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9cc4078bc0 0x7f9cc407b0d0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:41.902 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.899+0000 7f9ce868b640 1 --2- 172.21.15.105:0/3395541470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ce00cf540 0x7f9ce00cdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:41.902 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.899+0000 7f9ce868b640 1 --2- 172.21.15.105:0/3395541470 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9ce00b9b60 0x7f9ce015d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:41.902 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.899+0000 7f9ce868b640 1 --2- 172.21.15.105:0/3395541470 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ce00b64e0 0x7f9ce01f5ba0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:41.902 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.899+0000 7f9ce868b640 1 -- 172.21.15.105:0/3395541470 >> 172.21.15.105:0/3395541470 conn(0x7f9ce009d7f0 msgr2=0x7f9ce0161a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:41.902 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.899+0000 7f9ce868b640 1 -- 172.21.15.105:0/3395541470 shutdown_connections 2024-09-21T03:25:41.902 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:41.899+0000 7f9ce868b640 1 -- 172.21.15.105:0/3395541470 wait complete. 2024-09-21T03:25:41.912 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin' 2024-09-21T03:25:42.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.024+0000 7fbd5a838640 1 -- 172.21.15.105:0/1519413353 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd3c004d40 msgr2=0x7fbd3c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:42.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.024+0000 7fbd5a838640 1 --2- 172.21.15.105:0/1519413353 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd3c004d40 0x7fbd3c005190 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c001e10 tx=0x7fbd3c005830 comp rx=0 tx=0).stop 2024-09-21T03:25:42.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.024+0000 7fbd58dd5640 1 -- 172.21.15.105:0/1519413353 reap_dead start 2024-09-21T03:25:42.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.024+0000 7fbd5a838640 1 -- 172.21.15.105:0/1519413353 shutdown_connections 2024-09-21T03:25:42.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.024+0000 7fbd5a838640 1 -- 172.21.15.105:0/1519413353 >> 172.21.15.105:0/1519413353 conn(0x7fbd5406d4f0 msgr2=0x7fbd54071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:42.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.024+0000 7fbd5a838640 1 -- 172.21.15.105:0/1519413353 shutdown_connections 2024-09-21T03:25:42.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.024+0000 7fbd5a838640 1 -- 172.21.15.105:0/1519413353 wait complete. 2024-09-21T03:25:42.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.025+0000 7fbd5a838640 1 Processor -- start 2024-09-21T03:25:42.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.026+0000 7fbd5a838640 1 -- start start 2024-09-21T03:25:42.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.027+0000 7fbd5a838640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd3c004d40 0x7fbd54153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:42.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.027+0000 7fbd5a838640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd5414a310 0x7fbd541f7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:42.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.027+0000 7fbd5a838640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd541f7560 0x7fbd541554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:42.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.027+0000 7fbd5a838640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbd540d1210 con 0x7fbd5414a310 2024-09-21T03:25:42.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.027+0000 7fbd5a838640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbd540d1090 con 0x7fbd3c004d40 2024-09-21T03:25:42.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.027+0000 7fbd5a838640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbd540d1390 con 0x7fbd541f7560 2024-09-21T03:25:42.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.027+0000 7fbd537fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd5414a310 0x7fbd541f7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:42.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.027+0000 7fbd537fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd5414a310 0x7fbd541f7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:38714/0 (socket says 172.21.15.105:38714) 2024-09-21T03:25:42.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.027+0000 7fbd537fe640 1 -- 172.21.15.105:0/1732849499 learned_addr learned my addr 172.21.15.105:0/1732849499 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:42.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.027+0000 7fbd537fe640 1 -- 172.21.15.105:0/1732849499 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd541f7560 msgr2=0x7fbd541554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:42.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.027+0000 7fbd537fe640 1 --2- 172.21.15.105:0/1732849499 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd541f7560 0x7fbd541554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:42.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.027+0000 7fbd537fe640 1 -- 172.21.15.105:0/1732849499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd3c004d40 msgr2=0x7fbd54153a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:42.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.027+0000 7fbd537fe640 1 --2- 172.21.15.105:0/1732849499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd3c004d40 0x7fbd54153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:42.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.027+0000 7fbd537fe640 1 -- 172.21.15.105:0/1732849499 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd540b33d0 con 0x7fbd5414a310 2024-09-21T03:25:42.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.027+0000 7fbd537fe640 1 --2- 172.21.15.105:0/1732849499 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd5414a310 0x7fbd541f7020 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fbd48011a60 tx=0x7fbd48011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:42.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.028+0000 7fbd50ff9640 1 -- 172.21.15.105:0/1732849499 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4801e070 con 0x7fbd5414a310 2024-09-21T03:25:42.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.028+0000 7fbd50ff9640 1 -- 172.21.15.105:0/1732849499 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd48004460 con 0x7fbd5414a310 2024-09-21T03:25:42.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.028+0000 7fbd5a838640 1 -- 172.21.15.105:0/1732849499 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd540b36b0 con 0x7fbd5414a310 2024-09-21T03:25:42.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.028+0000 7fbd50ff9640 1 -- 172.21.15.105:0/1732849499 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4800fc00 con 0x7fbd5414a310 2024-09-21T03:25:42.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.028+0000 7fbd5a838640 1 -- 172.21.15.105:0/1732849499 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd5414ac90 con 0x7fbd5414a310 2024-09-21T03:25:42.032 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.029+0000 7fbd5a838640 1 -- 172.21.15.105:0/1732849499 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd54160b20 con 0x7fbd5414a310 2024-09-21T03:25:42.032 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.029+0000 7fbd50ff9640 1 -- 172.21.15.105:0/1732849499 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbd48021070 con 0x7fbd5414a310 2024-09-21T03:25:42.032 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.030+0000 7fbd50ff9640 1 --2- 172.21.15.105:0/1732849499 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbd40078b90 0x7fbd4007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:42.032 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.030+0000 7fbd50ff9640 1 -- 172.21.15.105:0/1732849499 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 4943+0+0 (secure 0 0 0) 0x7fbd4809b370 con 0x7fbd5414a310 2024-09-21T03:25:42.032 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.030+0000 7fbd53fff640 1 --2- 172.21.15.105:0/1732849499 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbd40078b90 0x7fbd4007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:42.032 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.031+0000 7fbd53fff640 1 --2- 172.21.15.105:0/1732849499 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbd40078b90 0x7fbd4007b0a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fbd44000fd0 tx=0x7fbd440014f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:42.036 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.034+0000 7fbd50ff9640 1 -- 172.21.15.105:0/1732849499 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbd48063580 con 0x7fbd5414a310 2024-09-21T03:25:42.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.280+0000 7fbd5a838640 1 -- 172.21.15.105:0/1732849499 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin"]} v 0) -- 0x7fbd540d1920 con 0x7fbd5414a310 2024-09-21T03:25:42.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.552+0000 7fbd50ff9640 1 -- 172.21.15.105:0/1732849499 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin"]}]=0 v360) ==== 143+0+0 (secure 0 0 0) 0x7fbd48067fb0 con 0x7fbd5414a310 2024-09-21T03:25:42.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.554+0000 7fbd5a838640 1 -- 172.21.15.105:0/1732849499 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbd40078b90 msgr2=0x7fbd4007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:42.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.554+0000 7fbd5a838640 1 --2- 172.21.15.105:0/1732849499 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbd40078b90 0x7fbd4007b0a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fbd44000fd0 tx=0x7fbd440014f0 comp rx=0 tx=0).stop 2024-09-21T03:25:42.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.554+0000 7fbd5a838640 1 -- 172.21.15.105:0/1732849499 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd5414a310 msgr2=0x7fbd541f7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:42.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.554+0000 7fbd5a838640 1 --2- 172.21.15.105:0/1732849499 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd5414a310 0x7fbd541f7020 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fbd48011a60 tx=0x7fbd48011f20 comp rx=0 tx=0).stop 2024-09-21T03:25:42.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.555+0000 7fbd5a838640 1 -- 172.21.15.105:0/1732849499 shutdown_connections 2024-09-21T03:25:42.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.555+0000 7fbd5a838640 1 --2- 172.21.15.105:0/1732849499 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbd40078b90 0x7fbd4007b0a0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:42.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.555+0000 7fbd5a838640 1 --2- 172.21.15.105:0/1732849499 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd541f7560 0x7fbd541554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:42.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.555+0000 7fbd5a838640 1 --2- 172.21.15.105:0/1732849499 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd5414a310 0x7fbd541f7020 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:42.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.555+0000 7fbd5a838640 1 --2- 172.21.15.105:0/1732849499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd3c004d40 0x7fbd54153a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:42.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.555+0000 7fbd5a838640 1 -- 172.21.15.105:0/1732849499 >> 172.21.15.105:0/1732849499 conn(0x7fbd5406d4f0 msgr2=0x7fbd5415f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:42.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.555+0000 7fbd5a838640 1 -- 172.21.15.105:0/1732849499 shutdown_connections 2024-09-21T03:25:42.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.555+0000 7fbd5a838640 1 -- 172.21.15.105:0/1732849499 wait complete. 2024-09-21T03:25:42.568 INFO:tasks.cephfs_test_runner:test_client_pin (tasks.cephfs.test_client_limits.TestClientLimits) ... ok 2024-09-21T03:25:42.569 INFO:tasks.cephfs_test_runner:Starting test: test_client_pin_mincaps (tasks.cephfs.test_client_limits.TestClientLimits) 2024-09-21T03:25:42.569 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:25:42.683 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.680+0000 7fb1ecb8b640 1 -- 172.21.15.105:0/2595655401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1d0003a00 msgr2=0x7fb1d0003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:42.683 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.680+0000 7fb1ecb8b640 1 --2- 172.21.15.105:0/2595655401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1d0003a00 0x7fb1d0003e50 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fb1d800baf0 tx=0x7fb1d0005830 comp rx=0 tx=0).stop 2024-09-21T03:25:42.684 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.680+0000 7fb1ecb8b640 1 -- 172.21.15.105:0/2595655401 shutdown_connections 2024-09-21T03:25:42.684 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.680+0000 7fb1ecb8b640 1 --2- 172.21.15.105:0/2595655401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1d0003a00 0x7fb1d0003e50 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:42.684 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.680+0000 7fb1ecb8b640 1 -- 172.21.15.105:0/2595655401 >> 172.21.15.105:0/2595655401 conn(0x7fb1e80cdcb0 msgr2=0x7fb1e80ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:42.684 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.681+0000 7fb1ecb8b640 1 -- 172.21.15.105:0/2595655401 shutdown_connections 2024-09-21T03:25:42.684 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.681+0000 7fb1ecb8b640 1 -- 172.21.15.105:0/2595655401 wait complete. 2024-09-21T03:25:42.685 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.682+0000 7fb1ecb8b640 1 Processor -- start 2024-09-21T03:25:42.685 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.683+0000 7fb1ecb8b640 1 -- start start 2024-09-21T03:25:42.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.684+0000 7fb1ecb8b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1d0003a00 0x7fb1e806cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:42.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.684+0000 7fb1ecb8b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1e81e4740 0x7fb1e815aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:42.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.684+0000 7fb1ecb8b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1e80cc630 0x7fb1e80cca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:42.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.684+0000 7fb1ecb8b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e80cf4c0 con 0x7fb1d0003a00 2024-09-21T03:25:42.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.684+0000 7fb1ecb8b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e80cf340 con 0x7fb1e81e4740 2024-09-21T03:25:42.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.684+0000 7fb1ecb8b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb1e8071650 con 0x7fb1e80cc630 2024-09-21T03:25:42.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.684+0000 7fb1e659c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1d0003a00 0x7fb1e806cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:42.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.684+0000 7fb1e659c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1d0003a00 0x7fb1e806cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:38740/0 (socket says 172.21.15.105:38740) 2024-09-21T03:25:42.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.684+0000 7fb1e659c640 1 -- 172.21.15.105:0/672306709 learned_addr learned my addr 172.21.15.105:0/672306709 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:42.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.684+0000 7fb1e6d9d640 1 --2- 172.21.15.105:0/672306709 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1e80cc630 0x7fb1e80cca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:42.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.684+0000 7fb1e5d9b640 1 --2- 172.21.15.105:0/672306709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1e81e4740 0x7fb1e815aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:42.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.684+0000 7fb1e659c640 1 -- 172.21.15.105:0/672306709 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1e80cc630 msgr2=0x7fb1e80cca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:42.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.684+0000 7fb1e659c640 1 --2- 172.21.15.105:0/672306709 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1e80cc630 0x7fb1e80cca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:42.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.684+0000 7fb1e659c640 1 -- 172.21.15.105:0/672306709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1e81e4740 msgr2=0x7fb1e815aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:42.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.684+0000 7fb1e659c640 1 --2- 172.21.15.105:0/672306709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1e81e4740 0x7fb1e815aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:42.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.684+0000 7fb1e659c640 1 -- 172.21.15.105:0/672306709 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e80ccf80 con 0x7fb1d0003a00 2024-09-21T03:25:42.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.684+0000 7fb1e6d9d640 1 --2- 172.21.15.105:0/672306709 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1e80cc630 0x7fb1e80cca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:25:42.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.684+0000 7fb1e5d9b640 1 --2- 172.21.15.105:0/672306709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1e81e4740 0x7fb1e815aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:25:42.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.684+0000 7fb1e659c640 1 --2- 172.21.15.105:0/672306709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1d0003a00 0x7fb1e806cde0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fb1d800ba40 tx=0x7fb1d8032740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:42.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.685+0000 7fb1d6ffd640 1 -- 172.21.15.105:0/672306709 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d8041070 con 0x7fb1d0003a00 2024-09-21T03:25:42.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.685+0000 7fb1d6ffd640 1 -- 172.21.15.105:0/672306709 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1d8032e30 con 0x7fb1d0003a00 2024-09-21T03:25:42.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.685+0000 7fb1ecb8b640 1 -- 172.21.15.105:0/672306709 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1e80c9170 con 0x7fb1d0003a00 2024-09-21T03:25:42.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.685+0000 7fb1d6ffd640 1 -- 172.21.15.105:0/672306709 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d8004270 con 0x7fb1d0003a00 2024-09-21T03:25:42.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.685+0000 7fb1ecb8b640 1 -- 172.21.15.105:0/672306709 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1e80c9430 con 0x7fb1d0003a00 2024-09-21T03:25:42.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.686+0000 7fb1ecb8b640 1 -- 172.21.15.105:0/672306709 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1e8071bb0 con 0x7fb1d0003a00 2024-09-21T03:25:42.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.686+0000 7fb1d6ffd640 1 -- 172.21.15.105:0/672306709 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb1d80035f0 con 0x7fb1d0003a00 2024-09-21T03:25:42.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.687+0000 7fb1d6ffd640 1 --2- 172.21.15.105:0/672306709 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb1c8078b90 0x7fb1c807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:42.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.687+0000 7fb1d6ffd640 1 -- 172.21.15.105:0/672306709 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 4943+0+0 (secure 0 0 0) 0x7fb1d80bb470 con 0x7fb1d0003a00 2024-09-21T03:25:42.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.687+0000 7fb1e5d9b640 1 --2- 172.21.15.105:0/672306709 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb1c8078b90 0x7fb1c807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:42.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.688+0000 7fb1e5d9b640 1 --2- 172.21.15.105:0/672306709 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb1c8078b90 0x7fb1c807b0a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb1e806dbc0 tx=0x7fb1dc006b70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:42.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.691+0000 7fb1d6ffd640 1 -- 172.21.15.105:0/672306709 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb1d804b060 con 0x7fb1d0003a00 2024-09-21T03:25:42.870 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.868+0000 7fb1ecb8b640 1 -- 172.21.15.105:0/672306709 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb1e80d1240 con 0x7fb1d0003a00 2024-09-21T03:25:42.871 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.868+0000 7fb1d6ffd640 1 -- 172.21.15.105:0/672306709 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) ==== 74+0+13116 (secure 0 0 0) 0x7fb1e80ccf80 con 0x7fb1d0003a00 2024-09-21T03:25:42.871 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:42.871 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":107,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:25:41.547082+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.105:6835/2917579803":"2024-09-22T03:25:38.244679+0000","172.21.15.105:6834/2917579803":"2024-09-22T03:25:38.244679+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:25:42.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.871+0000 7fb1ecb8b640 1 -- 172.21.15.105:0/672306709 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb1c8078b90 msgr2=0x7fb1c807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:42.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.871+0000 7fb1ecb8b640 1 --2- 172.21.15.105:0/672306709 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb1c8078b90 0x7fb1c807b0a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb1e806dbc0 tx=0x7fb1dc006b70 comp rx=0 tx=0).stop 2024-09-21T03:25:42.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.871+0000 7fb1ecb8b640 1 -- 172.21.15.105:0/672306709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1d0003a00 msgr2=0x7fb1e806cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:42.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.871+0000 7fb1ecb8b640 1 --2- 172.21.15.105:0/672306709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1d0003a00 0x7fb1e806cde0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fb1d800ba40 tx=0x7fb1d8032740 comp rx=0 tx=0).stop 2024-09-21T03:25:42.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.871+0000 7fb1ecb8b640 1 -- 172.21.15.105:0/672306709 shutdown_connections 2024-09-21T03:25:42.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.871+0000 7fb1ecb8b640 1 --2- 172.21.15.105:0/672306709 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb1c8078b90 0x7fb1c807b0a0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:42.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.871+0000 7fb1ecb8b640 1 --2- 172.21.15.105:0/672306709 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1e80cc630 0x7fb1e80cca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:42.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.871+0000 7fb1ecb8b640 1 --2- 172.21.15.105:0/672306709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1e81e4740 0x7fb1e815aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:42.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.871+0000 7fb1ecb8b640 1 --2- 172.21.15.105:0/672306709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1d0003a00 0x7fb1e806cde0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:42.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.871+0000 7fb1ecb8b640 1 -- 172.21.15.105:0/672306709 >> 172.21.15.105:0/672306709 conn(0x7fb1e80cdcb0 msgr2=0x7fb1e8068f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:42.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.871+0000 7fb1ecb8b640 1 -- 172.21.15.105:0/672306709 shutdown_connections 2024-09-21T03:25:42.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.871+0000 7fb1ecb8b640 1 -- 172.21.15.105:0/672306709 wait complete. 2024-09-21T03:25:42.884 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T03:18:19.296947+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T03:25:42.885 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T03:25:43.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.997+0000 7f5da623f640 1 -- 172.21.15.105:0/2959401959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5da00ca800 msgr2=0x7f5da00cba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:43.001 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.997+0000 7f5da623f640 1 --2- 172.21.15.105:0/2959401959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5da00ca800 0x7f5da00cba00 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f5d88005fd0 tx=0x7f5d8802a5d0 comp rx=0 tx=0).stop 2024-09-21T03:25:43.001 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.998+0000 7f5da623f640 1 -- 172.21.15.105:0/2959401959 shutdown_connections 2024-09-21T03:25:43.001 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.998+0000 7f5da623f640 1 --2- 172.21.15.105:0/2959401959 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5da00706b0 0x7f5da00735b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:43.001 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.998+0000 7f5da623f640 1 --2- 172.21.15.105:0/2959401959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5da00ca800 0x7f5da00cba00 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:43.001 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.998+0000 7f5da623f640 1 -- 172.21.15.105:0/2959401959 >> 172.21.15.105:0/2959401959 conn(0x7f5da00b1cb0 msgr2=0x7f5da00b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:43.001 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.998+0000 7f5da623f640 1 -- 172.21.15.105:0/2959401959 shutdown_connections 2024-09-21T03:25:43.001 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.998+0000 7f5da623f640 1 -- 172.21.15.105:0/2959401959 wait complete. 2024-09-21T03:25:43.002 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:42.999+0000 7f5da623f640 1 Processor -- start 2024-09-21T03:25:43.002 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.000+0000 7f5da623f640 1 -- start start 2024-09-21T03:25:43.005 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.001+0000 7f5da623f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5da00ca800 0x7f5da015e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:43.005 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.001+0000 7f5da623f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5da00cad30 0x7f5da014db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:43.005 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.001+0000 7f5da623f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5da01f5a00 0x7f5da01f5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:43.005 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.001+0000 7f5da623f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5da0073f00 con 0x7f5da01f5a00 2024-09-21T03:25:43.005 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.001+0000 7f5da623f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5da0073d80 con 0x7f5da00cad30 2024-09-21T03:25:43.005 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.001+0000 7f5da623f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5da0074080 con 0x7f5da00ca800 2024-09-21T03:25:43.006 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.001+0000 7f5d9ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5da01f5a00 0x7f5da01f5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:43.006 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.001+0000 7f5d9ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5da01f5a00 0x7f5da01f5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:38756/0 (socket says 172.21.15.105:38756) 2024-09-21T03:25:43.006 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.001+0000 7f5d9ffff640 1 -- 172.21.15.105:0/1005004202 learned_addr learned my addr 172.21.15.105:0/1005004202 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:43.006 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.001+0000 7f5d9f7fe640 1 --2- 172.21.15.105:0/1005004202 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5da00ca800 0x7f5da015e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:43.006 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.001+0000 7f5d9effd640 1 --2- 172.21.15.105:0/1005004202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5da00cad30 0x7f5da014db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:43.006 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.001+0000 7f5d9ffff640 1 -- 172.21.15.105:0/1005004202 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5da00ca800 msgr2=0x7f5da015e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:43.006 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.001+0000 7f5d9ffff640 1 --2- 172.21.15.105:0/1005004202 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5da00ca800 0x7f5da015e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:43.006 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.001+0000 7f5d9ffff640 1 -- 172.21.15.105:0/1005004202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5da00cad30 msgr2=0x7f5da014db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:43.006 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.001+0000 7f5d9ffff640 1 --2- 172.21.15.105:0/1005004202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5da00cad30 0x7f5da014db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:43.006 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.001+0000 7f5d9ffff640 1 -- 172.21.15.105:0/1005004202 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5da014e0b0 con 0x7f5da01f5a00 2024-09-21T03:25:43.006 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.001+0000 7f5d9f7fe640 1 --2- 172.21.15.105:0/1005004202 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5da00ca800 0x7f5da015e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:25:43.006 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.001+0000 7f5d9ffff640 1 --2- 172.21.15.105:0/1005004202 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5da01f5a00 0x7f5da01f5e10 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f5d9800e990 tx=0x7f5d9800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:43.006 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.001+0000 7f5d97fff640 1 -- 172.21.15.105:0/1005004202 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d98004d20 con 0x7f5da01f5a00 2024-09-21T03:25:43.007 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.001+0000 7f5d97fff640 1 -- 172.21.15.105:0/1005004202 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d9800caa0 con 0x7f5da01f5a00 2024-09-21T03:25:43.007 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.001+0000 7f5da623f640 1 -- 172.21.15.105:0/1005004202 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5da015d2f0 con 0x7f5da01f5a00 2024-09-21T03:25:43.007 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.002+0000 7f5d97fff640 1 -- 172.21.15.105:0/1005004202 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d98005020 con 0x7f5da01f5a00 2024-09-21T03:25:43.007 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.002+0000 7f5da623f640 1 -- 172.21.15.105:0/1005004202 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5da015d8b0 con 0x7f5da01f5a00 2024-09-21T03:25:43.007 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.002+0000 7f5da623f640 1 -- 172.21.15.105:0/1005004202 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5da00745e0 con 0x7f5da01f5a00 2024-09-21T03:25:43.007 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.003+0000 7f5d97fff640 1 -- 172.21.15.105:0/1005004202 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5d980051c0 con 0x7f5da01f5a00 2024-09-21T03:25:43.008 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.004+0000 7f5d97fff640 1 --2- 172.21.15.105:0/1005004202 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5d80078bc0 0x7f5d8007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:43.008 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.004+0000 7f5d97fff640 1 -- 172.21.15.105:0/1005004202 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 4943+0+0 (secure 0 0 0) 0x7f5d9809b320 con 0x7f5da01f5a00 2024-09-21T03:25:43.008 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.004+0000 7f5d9f7fe640 1 --2- 172.21.15.105:0/1005004202 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5d80078bc0 0x7f5d8007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:43.008 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.005+0000 7f5d9f7fe640 1 --2- 172.21.15.105:0/1005004202 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5d80078bc0 0x7f5d8007b0d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f5d88033000 tx=0x7f5d88004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:43.011 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.008+0000 7f5d97fff640 1 -- 172.21.15.105:0/1005004202 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5da014e0b0 con 0x7f5da01f5a00 2024-09-21T03:25:43.187 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.184+0000 7f5da623f640 1 -- 172.21.15.105:0/1005004202 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5da00cbd00 con 0x7f5da01f5a00 2024-09-21T03:25:43.187 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.184+0000 7f5d97fff640 1 -- 172.21.15.105:0/1005004202 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v107) ==== 93+0+10 (secure 0 0 0) 0x7f5d98016030 con 0x7f5da01f5a00 2024-09-21T03:25:43.187 INFO:teuthology.orchestra.run.smithi105.stdout:pg_num: 1 2024-09-21T03:25:43.190 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.186+0000 7f5da623f640 1 -- 172.21.15.105:0/1005004202 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5d80078bc0 msgr2=0x7f5d8007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:43.190 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.186+0000 7f5da623f640 1 --2- 172.21.15.105:0/1005004202 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5d80078bc0 0x7f5d8007b0d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f5d88033000 tx=0x7f5d88004730 comp rx=0 tx=0).stop 2024-09-21T03:25:43.190 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.186+0000 7f5da623f640 1 -- 172.21.15.105:0/1005004202 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5da01f5a00 msgr2=0x7f5da01f5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:43.190 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.186+0000 7f5da623f640 1 --2- 172.21.15.105:0/1005004202 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5da01f5a00 0x7f5da01f5e10 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f5d9800e990 tx=0x7f5d9800ee50 comp rx=0 tx=0).stop 2024-09-21T03:25:43.190 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.186+0000 7f5da623f640 1 -- 172.21.15.105:0/1005004202 shutdown_connections 2024-09-21T03:25:43.190 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.186+0000 7f5da623f640 1 --2- 172.21.15.105:0/1005004202 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5d80078bc0 0x7f5d8007b0d0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:43.190 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.186+0000 7f5da623f640 1 --2- 172.21.15.105:0/1005004202 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5da01f5a00 0x7f5da01f5e10 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:43.190 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.186+0000 7f5da623f640 1 --2- 172.21.15.105:0/1005004202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5da00cad30 0x7f5da014db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:43.191 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.186+0000 7f5da623f640 1 --2- 172.21.15.105:0/1005004202 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5da00ca800 0x7f5da015e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:43.191 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.186+0000 7f5da623f640 1 -- 172.21.15.105:0/1005004202 >> 172.21.15.105:0/1005004202 conn(0x7f5da00b1cb0 msgr2=0x7f5da00d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:43.191 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.187+0000 7f5da623f640 1 -- 172.21.15.105:0/1005004202 shutdown_connections 2024-09-21T03:25:43.191 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.187+0000 7f5da623f640 1 -- 172.21.15.105:0/1005004202 wait complete. 2024-09-21T03:25:43.200 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_mincaps' 2024-09-21T03:25:43.312 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.309+0000 7f1e1c894640 1 -- 172.21.15.105:0/2939711677 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e18162f60 msgr2=0x7f1e18165380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:43.312 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.309+0000 7f1e1c894640 1 --2- 172.21.15.105:0/2939711677 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e18162f60 0x7f1e18165380 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f1e18072990 tx=0x7f1e1002a4b0 comp rx=0 tx=0).stop 2024-09-21T03:25:43.312 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.309+0000 7f1e1c894640 1 -- 172.21.15.105:0/2939711677 shutdown_connections 2024-09-21T03:25:43.313 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.309+0000 7f1e1c894640 1 --2- 172.21.15.105:0/2939711677 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e18162f60 0x7f1e18165380 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:43.313 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.309+0000 7f1e1c894640 1 --2- 172.21.15.105:0/2939711677 >> v2:172.21.15.162:3300/0 conn(0x7f1e180b6680 0x7f1e180b0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:43.313 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.309+0000 7f1e1c894640 1 -- 172.21.15.105:0/2939711677 >> 172.21.15.105:0/2939711677 conn(0x7f1e180d12a0 msgr2=0x7f1e180d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:43.313 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.309+0000 7f1e1c894640 1 -- 172.21.15.105:0/2939711677 shutdown_connections 2024-09-21T03:25:43.313 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.309+0000 7f1e1c894640 1 -- 172.21.15.105:0/2939711677 wait complete. 2024-09-21T03:25:43.313 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.311+0000 7f1e1c894640 1 Processor -- start 2024-09-21T03:25:43.314 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.311+0000 7f1e1c894640 1 -- start start 2024-09-21T03:25:43.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.312+0000 7f1e1c894640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e180b6100 0x7f1e18158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:43.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.312+0000 7f1e1c894640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e180b6680 0x7f1e180ae970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:43.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.312+0000 7f1e1c894640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e18162f60 0x7f1e18158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:43.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.312+0000 7f1e1c894640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1e18165a40 con 0x7f1e18162f60 2024-09-21T03:25:43.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.312+0000 7f1e1c894640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1e181658c0 con 0x7f1e180b6680 2024-09-21T03:25:43.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.312+0000 7f1e1c894640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1e18165bc0 con 0x7f1e180b6100 2024-09-21T03:25:43.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.313+0000 7f1e16d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e18162f60 0x7f1e18158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:43.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.313+0000 7f1e16d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e18162f60 0x7f1e18158360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:38786/0 (socket says 172.21.15.105:38786) 2024-09-21T03:25:43.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.313+0000 7f1e16d9d640 1 -- 172.21.15.105:0/701055741 learned_addr learned my addr 172.21.15.105:0/701055741 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:43.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.313+0000 7f1e15d9b640 1 --2- 172.21.15.105:0/701055741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e180b6680 0x7f1e180ae970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:43.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.313+0000 7f1e1659c640 1 --2- 172.21.15.105:0/701055741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e180b6100 0x7f1e18158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:43.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.313+0000 7f1e16d9d640 1 -- 172.21.15.105:0/701055741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e180b6100 msgr2=0x7f1e18158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:43.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.313+0000 7f1e16d9d640 1 --2- 172.21.15.105:0/701055741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e180b6100 0x7f1e18158ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:43.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.313+0000 7f1e16d9d640 1 -- 172.21.15.105:0/701055741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e180b6680 msgr2=0x7f1e180ae970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:43.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.313+0000 7f1e16d9d640 1 --2- 172.21.15.105:0/701055741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e180b6680 0x7f1e180ae970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:43.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.313+0000 7f1e16d9d640 1 -- 172.21.15.105:0/701055741 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e181588a0 con 0x7f1e18162f60 2024-09-21T03:25:43.318 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.313+0000 7f1e16d9d640 1 --2- 172.21.15.105:0/701055741 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e18162f60 0x7f1e18158360 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f1e10005fd0 tx=0x7f1e100039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:43.318 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.313+0000 7f1e0effd640 1 -- 172.21.15.105:0/701055741 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e1003e030 con 0x7f1e18162f60 2024-09-21T03:25:43.318 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.313+0000 7f1e0effd640 1 -- 172.21.15.105:0/701055741 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e100047a0 con 0x7f1e18162f60 2024-09-21T03:25:43.318 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.313+0000 7f1e0effd640 1 -- 172.21.15.105:0/701055741 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e10035040 con 0x7f1e18162f60 2024-09-21T03:25:43.318 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.313+0000 7f1e1c894640 1 -- 172.21.15.105:0/701055741 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e1815c1e0 con 0x7f1e18162f60 2024-09-21T03:25:43.318 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.313+0000 7f1e1c894640 1 -- 172.21.15.105:0/701055741 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e1815bc20 con 0x7f1e18162f60 2024-09-21T03:25:43.319 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.314+0000 7f1e1c894640 1 -- 172.21.15.105:0/701055741 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e180aefc0 con 0x7f1e18162f60 2024-09-21T03:25:43.319 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.315+0000 7f1e0effd640 1 -- 172.21.15.105:0/701055741 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1e10041030 con 0x7f1e18162f60 2024-09-21T03:25:43.319 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.316+0000 7f1e0effd640 1 --2- 172.21.15.105:0/701055741 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1df8078b90 0x7f1df807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:43.319 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.316+0000 7f1e0effd640 1 -- 172.21.15.105:0/701055741 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 4943+0+0 (secure 0 0 0) 0x7f1e100bb370 con 0x7f1e18162f60 2024-09-21T03:25:43.319 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.316+0000 7f1e1659c640 1 --2- 172.21.15.105:0/701055741 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1df8078b90 0x7f1df807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:43.319 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.316+0000 7f1e1659c640 1 --2- 172.21.15.105:0/701055741 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1df8078b90 0x7f1df807b0a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f1e180ceda0 tx=0x7f1e080094f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:43.323 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.320+0000 7f1e0effd640 1 -- 172.21.15.105:0/701055741 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1e10083ab0 con 0x7f1e18162f60 2024-09-21T03:25:43.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:43.572+0000 7f1e1c894640 1 -- 172.21.15.105:0/701055741 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_mincaps"]} v 0) -- 0x7f1e180b0de0 con 0x7f1e18162f60 2024-09-21T03:25:44.562 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.559+0000 7f1e0effd640 1 -- 172.21.15.105:0/701055741 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_mincaps"]}]=0 v362) ==== 154+0+0 (secure 0 0 0) 0x7f1e100833b0 con 0x7f1e18162f60 2024-09-21T03:25:44.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.562+0000 7f1e1c894640 1 -- 172.21.15.105:0/701055741 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1df8078b90 msgr2=0x7f1df807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:44.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.562+0000 7f1e1c894640 1 --2- 172.21.15.105:0/701055741 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1df8078b90 0x7f1df807b0a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f1e180ceda0 tx=0x7f1e080094f0 comp rx=0 tx=0).stop 2024-09-21T03:25:44.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.562+0000 7f1e1c894640 1 -- 172.21.15.105:0/701055741 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e18162f60 msgr2=0x7f1e18158360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:44.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.562+0000 7f1e1c894640 1 --2- 172.21.15.105:0/701055741 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e18162f60 0x7f1e18158360 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f1e10005fd0 tx=0x7f1e100039e0 comp rx=0 tx=0).stop 2024-09-21T03:25:44.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.562+0000 7f1e1c894640 1 -- 172.21.15.105:0/701055741 shutdown_connections 2024-09-21T03:25:44.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.562+0000 7f1e1c894640 1 --2- 172.21.15.105:0/701055741 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1df8078b90 0x7f1df807b0a0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:44.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.562+0000 7f1e1c894640 1 --2- 172.21.15.105:0/701055741 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e18162f60 0x7f1e18158360 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:44.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.562+0000 7f1e1c894640 1 --2- 172.21.15.105:0/701055741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e180b6680 0x7f1e180ae970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:44.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.562+0000 7f1e1c894640 1 --2- 172.21.15.105:0/701055741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e180b6100 0x7f1e18158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:44.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.562+0000 7f1e1c894640 1 -- 172.21.15.105:0/701055741 >> 172.21.15.105:0/701055741 conn(0x7f1e180d12a0 msgr2=0x7f1e18071480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:44.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.562+0000 7f1e1c894640 1 -- 172.21.15.105:0/701055741 shutdown_connections 2024-09-21T03:25:44.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.563+0000 7f1e1c894640 1 -- 172.21.15.105:0/701055741 wait complete. 2024-09-21T03:25:44.579 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T03:25:44.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.695+0000 7f3554558640 1 -- 172.21.15.105:0/4018462129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f354c162f60 msgr2=0x7f354c165380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:44.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.695+0000 7f3554558640 1 --2- 172.21.15.105:0/4018462129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f354c162f60 0x7f354c165380 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f3544009830 tx=0x7f354402a510 comp rx=0 tx=0).stop 2024-09-21T03:25:44.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.695+0000 7f3554558640 1 -- 172.21.15.105:0/4018462129 shutdown_connections 2024-09-21T03:25:44.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.695+0000 7f3554558640 1 --2- 172.21.15.105:0/4018462129 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f354c0b6100 0x7f354c0b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:44.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.695+0000 7f3554558640 1 --2- 172.21.15.105:0/4018462129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f354c162f60 0x7f354c165380 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:44.699 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.695+0000 7f3554558640 1 -- 172.21.15.105:0/4018462129 >> 172.21.15.105:0/4018462129 conn(0x7f354c0d12a0 msgr2=0x7f354c0d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:44.699 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.695+0000 7f3554558640 1 -- 172.21.15.105:0/4018462129 shutdown_connections 2024-09-21T03:25:44.699 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.695+0000 7f3554558640 1 -- 172.21.15.105:0/4018462129 wait complete. 2024-09-21T03:25:44.699 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.697+0000 7f3554558640 1 Processor -- start 2024-09-21T03:25:44.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.697+0000 7f3554558640 1 -- start start 2024-09-21T03:25:44.703 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.698+0000 7f3554558640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f354c0b6100 0x7f354c1f7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:44.703 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.698+0000 7f3554558640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f354c0b6680 0x7f354c159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:44.703 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.698+0000 7f3554558640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f354c162f60 0x7f354c0ae150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:44.703 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.698+0000 7f3554558640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f354c165a40 con 0x7f354c0b6100 2024-09-21T03:25:44.703 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.698+0000 7f3554558640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f354c1658c0 con 0x7f354c0b6680 2024-09-21T03:25:44.703 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.698+0000 7f3554558640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f354c165bc0 con 0x7f354c162f60 2024-09-21T03:25:44.703 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.698+0000 7f35522f4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f354c0b6100 0x7f354c1f7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:44.704 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.698+0000 7f35522f4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f354c0b6100 0x7f354c1f7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:38794/0 (socket says 172.21.15.105:38794) 2024-09-21T03:25:44.704 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.698+0000 7f35522f4640 1 -- 172.21.15.105:0/1479966040 learned_addr learned my addr 172.21.15.105:0/1479966040 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:44.704 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.698+0000 7f3551af3640 1 --2- 172.21.15.105:0/1479966040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f354c0b6680 0x7f354c159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:44.704 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.698+0000 7f3552af5640 1 --2- 172.21.15.105:0/1479966040 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f354c162f60 0x7f354c0ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:44.704 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.699+0000 7f35522f4640 1 -- 172.21.15.105:0/1479966040 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f354c162f60 msgr2=0x7f354c0ae150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:44.704 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.699+0000 7f35522f4640 1 --2- 172.21.15.105:0/1479966040 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f354c162f60 0x7f354c0ae150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:44.704 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.699+0000 7f35522f4640 1 -- 172.21.15.105:0/1479966040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f354c0b6680 msgr2=0x7f354c159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:44.704 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.699+0000 7f35522f4640 1 --2- 172.21.15.105:0/1479966040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f354c0b6680 0x7f354c159ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:44.704 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.699+0000 7f35522f4640 1 -- 172.21.15.105:0/1479966040 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f354c1f3c30 con 0x7f354c0b6100 2024-09-21T03:25:44.704 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.699+0000 7f35522f4640 1 --2- 172.21.15.105:0/1479966040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f354c0b6100 0x7f354c1f7b20 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f354800ca70 tx=0x7f354800cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:44.704 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.699+0000 7f3542ffd640 1 -- 172.21.15.105:0/1479966040 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3548016070 con 0x7f354c0b6100 2024-09-21T03:25:44.704 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.699+0000 7f3542ffd640 1 -- 172.21.15.105:0/1479966040 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3548004d40 con 0x7f354c0b6100 2024-09-21T03:25:44.704 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.699+0000 7f3542ffd640 1 -- 172.21.15.105:0/1479966040 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354800ac30 con 0x7f354c0b6100 2024-09-21T03:25:44.705 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.699+0000 7f3554558640 1 -- 172.21.15.105:0/1479966040 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f354c163f20 con 0x7f354c0b6100 2024-09-21T03:25:44.705 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.699+0000 7f3554558640 1 -- 172.21.15.105:0/1479966040 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f354c1f41b0 con 0x7f354c0b6100 2024-09-21T03:25:44.705 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.700+0000 7f3554558640 1 -- 172.21.15.105:0/1479966040 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f354c0b0de0 con 0x7f354c0b6100 2024-09-21T03:25:44.705 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.701+0000 7f3542ffd640 1 -- 172.21.15.105:0/1479966040 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3548005030 con 0x7f354c0b6100 2024-09-21T03:25:44.705 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.701+0000 7f3542ffd640 1 --2- 172.21.15.105:0/1479966040 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3530078b90 0x7f353007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:44.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.701+0000 7f3542ffd640 1 -- 172.21.15.105:0/1479966040 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 4943+0+0 (secure 0 0 0) 0x7f354809a9b0 con 0x7f354c0b6100 2024-09-21T03:25:44.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.701+0000 7f3551af3640 1 --2- 172.21.15.105:0/1479966040 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3530078b90 0x7f353007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:44.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.702+0000 7f3551af3640 1 --2- 172.21.15.105:0/1479966040 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3530078b90 0x7f353007b0a0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f354c165590 tx=0x7f353c005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:44.708 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.706+0000 7f3542ffd640 1 -- 172.21.15.105:0/1479966040 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3548020020 con 0x7f354c0b6100 2024-09-21T03:25:44.884 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.882+0000 7f3554558640 1 -- 172.21.15.105:0/1479966040 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f354c0cc6e0 con 0x7f354c0b6100 2024-09-21T03:25:44.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.882+0000 7f3542ffd640 1 -- 172.21.15.105:0/1479966040 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v56) ==== 59+0+2294 (secure 0 0 0) 0x7f3548062aa0 con 0x7f354c0b6100 2024-09-21T03:25:44.885 INFO:teuthology.orchestra.run.smithi105.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T03:25:44.885 INFO:teuthology.orchestra.run.smithi105.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T03:25:44.885 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced client_mount_timeout 30 2024-09-21T03:25:44.885 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced debug_client 20/20 2024-09-21T03:25:44.885 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced debug_mgr 20/20 2024-09-21T03:25:44.885 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced debug_ms 1/1 2024-09-21T03:25:44.885 INFO:teuthology.orchestra.run.smithi105.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T03:25:44.885 INFO:teuthology.orchestra.run.smithi105.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T03:25:44.885 INFO:teuthology.orchestra.run.smithi105.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 7291.545169 2024-09-21T03:25:44.886 INFO:teuthology.orchestra.run.smithi105.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5080.142035 2024-09-21T03:25:44.886 INFO:teuthology.orchestra.run.smithi105.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5120.988640 2024-09-21T03:25:44.886 INFO:teuthology.orchestra.run.smithi105.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4938.196268 2024-09-21T03:25:44.886 INFO:teuthology.orchestra.run.smithi105.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4906.316728 2024-09-21T03:25:44.886 INFO:teuthology.orchestra.run.smithi105.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4701.273858 2024-09-21T03:25:44.886 INFO:teuthology.orchestra.run.smithi105.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4947.710044 2024-09-21T03:25:44.886 INFO:teuthology.orchestra.run.smithi105.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5174.949063 2024-09-21T03:25:44.886 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced debug_mds 20/20 2024-09-21T03:25:44.886 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T03:25:44.886 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced debug_ms 2/2 2024-09-21T03:25:44.886 INFO:teuthology.orchestra.run.smithi105.stdout:mds dev mds_debug_frag true 2024-09-21T03:25:44.886 INFO:teuthology.orchestra.run.smithi105.stdout:mds dev mds_debug_scatterstat true 2024-09-21T03:25:44.886 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T03:25:44.886 INFO:teuthology.orchestra.run.smithi105.stdout:mds dev mds_verify_scatter true 2024-09-21T03:25:44.887 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T03:25:44.887 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T03:25:44.887 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T03:25:44.887 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced client_mount_timeout 600 2024-09-21T03:25:44.887 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced debug_client 20/20 2024-09-21T03:25:44.887 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced debug_ms 1/1 2024-09-21T03:25:44.887 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T03:25:44.887 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T03:25:44.888 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.884+0000 7f3554558640 1 -- 172.21.15.105:0/1479966040 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3530078b90 msgr2=0x7f353007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:44.888 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.884+0000 7f3554558640 1 --2- 172.21.15.105:0/1479966040 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3530078b90 0x7f353007b0a0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f354c165590 tx=0x7f353c005f90 comp rx=0 tx=0).stop 2024-09-21T03:25:44.888 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.884+0000 7f3554558640 1 -- 172.21.15.105:0/1479966040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f354c0b6100 msgr2=0x7f354c1f7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:44.888 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.884+0000 7f3554558640 1 --2- 172.21.15.105:0/1479966040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f354c0b6100 0x7f354c1f7b20 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f354800ca70 tx=0x7f354800cf30 comp rx=0 tx=0).stop 2024-09-21T03:25:44.888 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.884+0000 7f3554558640 1 -- 172.21.15.105:0/1479966040 shutdown_connections 2024-09-21T03:25:44.888 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.884+0000 7f3554558640 1 --2- 172.21.15.105:0/1479966040 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3530078b90 0x7f353007b0a0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:44.888 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.884+0000 7f3554558640 1 --2- 172.21.15.105:0/1479966040 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f354c162f60 0x7f354c0ae150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:44.888 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.884+0000 7f3554558640 1 --2- 172.21.15.105:0/1479966040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f354c0b6680 0x7f354c159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:44.888 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.884+0000 7f3554558640 1 --2- 172.21.15.105:0/1479966040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f354c0b6100 0x7f354c1f7b20 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:44.888 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.884+0000 7f3554558640 1 -- 172.21.15.105:0/1479966040 >> 172.21.15.105:0/1479966040 conn(0x7f354c0d12a0 msgr2=0x7f354c0714f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:44.889 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.884+0000 7f3554558640 1 -- 172.21.15.105:0/1479966040 shutdown_connections 2024-09-21T03:25:44.889 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:44.884+0000 7f3554558640 1 -- 172.21.15.105:0/1479966040 wait complete. 2024-09-21T03:25:44.898 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T03:25:45.013 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.010+0000 7f7a98870640 1 -- 172.21.15.105:0/2803589982 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a94142680 msgr2=0x7f7a94074390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:45.014 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.010+0000 7f7a98870640 1 --2- 172.21.15.105:0/2803589982 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a94142680 0x7f7a94074390 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f7a9413ed90 tx=0x7f7a8c02aa30 comp rx=0 tx=0).stop 2024-09-21T03:25:45.014 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.010+0000 7f7a98870640 1 -- 172.21.15.105:0/2803589982 shutdown_connections 2024-09-21T03:25:45.014 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.010+0000 7f7a98870640 1 --2- 172.21.15.105:0/2803589982 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a94142680 0x7f7a94074390 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:45.014 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.010+0000 7f7a98870640 1 --2- 172.21.15.105:0/2803589982 >> v2:172.21.15.162:3300/0 conn(0x7f7a94142270 0x7f7a94073e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:45.014 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.010+0000 7f7a98870640 1 --2- 172.21.15.105:0/2803589982 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a94144270 0x7f7a940b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:45.014 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.010+0000 7f7a98870640 1 -- 172.21.15.105:0/2803589982 >> 172.21.15.105:0/2803589982 conn(0x7f7a940d15f0 msgr2=0x7f7a94073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:45.014 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.011+0000 7f7a98870640 1 -- 172.21.15.105:0/2803589982 shutdown_connections 2024-09-21T03:25:45.014 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.011+0000 7f7a98870640 1 -- 172.21.15.105:0/2803589982 wait complete. 2024-09-21T03:25:45.015 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.013+0000 7f7a98870640 1 Processor -- start 2024-09-21T03:25:45.015 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.013+0000 7f7a98870640 1 -- start start 2024-09-21T03:25:45.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.014+0000 7f7a98870640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a94142270 0x7f7a940c9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:45.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.014+0000 7f7a98870640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a94142680 0x7f7a9413e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:45.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.014+0000 7f7a98870640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a94144270 0x7f7a9415ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:45.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.014+0000 7f7a98870640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7a940cfe60 con 0x7f7a94142270 2024-09-21T03:25:45.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.014+0000 7f7a98870640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7a940b5dd0 con 0x7f7a94142680 2024-09-21T03:25:45.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.014+0000 7f7a98870640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7a940cffe0 con 0x7f7a94144270 2024-09-21T03:25:45.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.014+0000 7f7a9259c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a94142270 0x7f7a940c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:45.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.014+0000 7f7a9259c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a94142270 0x7f7a940c9340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:38816/0 (socket says 172.21.15.105:38816) 2024-09-21T03:25:45.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.014+0000 7f7a9259c640 1 -- 172.21.15.105:0/2926247443 learned_addr learned my addr 172.21.15.105:0/2926247443 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:45.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.014+0000 7f7a92d9d640 1 --2- 172.21.15.105:0/2926247443 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a94144270 0x7f7a9415ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:45.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.014+0000 7f7a89d9b640 1 --2- 172.21.15.105:0/2926247443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a94142680 0x7f7a9413e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:45.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.014+0000 7f7a9259c640 1 -- 172.21.15.105:0/2926247443 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a94144270 msgr2=0x7f7a9415ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:45.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.014+0000 7f7a9259c640 1 --2- 172.21.15.105:0/2926247443 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a94144270 0x7f7a9415ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:45.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.014+0000 7f7a9259c640 1 -- 172.21.15.105:0/2926247443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a94142680 msgr2=0x7f7a9413e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:45.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.014+0000 7f7a9259c640 1 --2- 172.21.15.105:0/2926247443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a94142680 0x7f7a9413e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:45.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.014+0000 7f7a9259c640 1 -- 172.21.15.105:0/2926247443 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a940c8580 con 0x7f7a94142270 2024-09-21T03:25:45.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.014+0000 7f7a92d9d640 1 --2- 172.21.15.105:0/2926247443 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a94144270 0x7f7a9415ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:25:45.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.015+0000 7f7a9259c640 1 --2- 172.21.15.105:0/2926247443 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a94142270 0x7f7a940c9340 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f7a8400d6d0 tx=0x7f7a8400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:45.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.015+0000 7f7a8b7fe640 1 -- 172.21.15.105:0/2926247443 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a84017070 con 0x7f7a94142270 2024-09-21T03:25:45.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.015+0000 7f7a8b7fe640 1 -- 172.21.15.105:0/2926247443 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7a84005330 con 0x7f7a94142270 2024-09-21T03:25:45.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.015+0000 7f7a98870640 1 -- 172.21.15.105:0/2926247443 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a940c8860 con 0x7f7a94142270 2024-09-21T03:25:45.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.015+0000 7f7a8b7fe640 1 -- 172.21.15.105:0/2926247443 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a84009820 con 0x7f7a94142270 2024-09-21T03:25:45.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.015+0000 7f7a98870640 1 -- 172.21.15.105:0/2926247443 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a940c8e20 con 0x7f7a94142270 2024-09-21T03:25:45.020 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.016+0000 7f7a98870640 1 -- 172.21.15.105:0/2926247443 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a940b5680 con 0x7f7a94142270 2024-09-21T03:25:45.020 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.016+0000 7f7a8b7fe640 1 -- 172.21.15.105:0/2926247443 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7a84009bd0 con 0x7f7a94142270 2024-09-21T03:25:45.020 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.017+0000 7f7a8b7fe640 1 --2- 172.21.15.105:0/2926247443 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7a74078b90 0x7f7a7407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:45.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.017+0000 7f7a8b7fe640 1 -- 172.21.15.105:0/2926247443 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 4943+0+0 (secure 0 0 0) 0x7f7a8409ab90 con 0x7f7a94142270 2024-09-21T03:25:45.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.017+0000 7f7a89d9b640 1 --2- 172.21.15.105:0/2926247443 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7a74078b90 0x7f7a7407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:45.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.018+0000 7f7a89d9b640 1 --2- 172.21.15.105:0/2926247443 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7a74078b90 0x7f7a7407b0a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c005fd0 tx=0x7f7a7c005850 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:45.024 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.022+0000 7f7a8b7fe640 1 -- 172.21.15.105:0/2926247443 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7a840633f0 con 0x7f7a94142270 2024-09-21T03:25:45.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.197+0000 7f7a98870640 1 -- 172.21.15.105:0/2926247443 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f7a94075f00 con 0x7f7a94142270 2024-09-21T03:25:45.205 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.203+0000 7f7a8b7fe640 1 -- 172.21.15.105:0/2926247443 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v57)=0 v57) ==== 122+0+0 (secure 0 0 0) 0x7f7a84062cf0 con 0x7f7a94142270 2024-09-21T03:25:45.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.205+0000 7f7a98870640 1 -- 172.21.15.105:0/2926247443 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7a74078b90 msgr2=0x7f7a7407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:45.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.205+0000 7f7a98870640 1 --2- 172.21.15.105:0/2926247443 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7a74078b90 0x7f7a7407b0a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c005fd0 tx=0x7f7a7c005850 comp rx=0 tx=0).stop 2024-09-21T03:25:45.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.205+0000 7f7a98870640 1 -- 172.21.15.105:0/2926247443 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a94142270 msgr2=0x7f7a940c9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:45.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.205+0000 7f7a98870640 1 --2- 172.21.15.105:0/2926247443 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a94142270 0x7f7a940c9340 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f7a8400d6d0 tx=0x7f7a8400db90 comp rx=0 tx=0).stop 2024-09-21T03:25:45.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.205+0000 7f7a98870640 1 -- 172.21.15.105:0/2926247443 shutdown_connections 2024-09-21T03:25:45.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.205+0000 7f7a98870640 1 --2- 172.21.15.105:0/2926247443 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7a74078b90 0x7f7a7407b0a0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:45.209 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.205+0000 7f7a98870640 1 --2- 172.21.15.105:0/2926247443 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a94144270 0x7f7a9415ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:45.209 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.205+0000 7f7a98870640 1 --2- 172.21.15.105:0/2926247443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a94142680 0x7f7a9413e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:45.209 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.205+0000 7f7a98870640 1 --2- 172.21.15.105:0/2926247443 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a94142270 0x7f7a940c9340 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:45.209 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.205+0000 7f7a98870640 1 -- 172.21.15.105:0/2926247443 >> 172.21.15.105:0/2926247443 conn(0x7f7a940d15f0 msgr2=0x7f7a9406fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:45.209 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.205+0000 7f7a98870640 1 -- 172.21.15.105:0/2926247443 shutdown_connections 2024-09-21T03:25:45.209 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.205+0000 7f7a98870640 1 -- 172.21.15.105:0/2926247443 wait complete. 2024-09-21T03:25:45.219 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T03:25:45.219 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T03:25:45.254 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T03:25:45.310 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T03:25:45.310 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:25:45.310 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:25:45.326 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T03:25:45.326 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:25:45.326 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:25:45.344 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=452 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T03:25:45.344 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:25:45.344 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:25:45.381 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T03:25:45.381 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:25:45.381 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:25:45.402 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=452 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T03:25:45.403 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T03:25:45.403 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:25:45.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.530+0000 7f479d9ba640 1 -- 172.21.15.105:0/3034577240 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47980b9b60 msgr2=0x7f47980d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:45.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.530+0000 7f479d9ba640 1 --2- 172.21.15.105:0/3034577240 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47980b9b60 0x7f47980d0fb0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f4788005fd0 tx=0x7f478802a5f0 comp rx=0 tx=0).stop 2024-09-21T03:25:45.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.531+0000 7f479d9ba640 1 -- 172.21.15.105:0/3034577240 shutdown_connections 2024-09-21T03:25:45.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.531+0000 7f479d9ba640 1 --2- 172.21.15.105:0/3034577240 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47980b9b60 0x7f47980d0fb0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:45.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.531+0000 7f479d9ba640 1 -- 172.21.15.105:0/3034577240 >> 172.21.15.105:0/3034577240 conn(0x7f479809d8f0 msgr2=0x7f47980d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:45.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.531+0000 7f479d9ba640 1 -- 172.21.15.105:0/3034577240 shutdown_connections 2024-09-21T03:25:45.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.531+0000 7f479d9ba640 1 -- 172.21.15.105:0/3034577240 wait complete. 2024-09-21T03:25:45.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.532+0000 7f479d9ba640 1 Processor -- start 2024-09-21T03:25:45.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.532+0000 7f479d9ba640 1 -- start start 2024-09-21T03:25:45.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.534+0000 7f479d9ba640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47980b3a10 0x7f4798150040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:45.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.534+0000 7f479d9ba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47980b9b60 0x7f47980ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:45.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.534+0000 7f479d9ba640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47980d14f0 0x7f479815f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:45.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.534+0000 7f479d9ba640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f47980d1f10 con 0x7f47980b3a10 2024-09-21T03:25:45.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.534+0000 7f479d9ba640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f47980d1d90 con 0x7f47980b9b60 2024-09-21T03:25:45.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.534+0000 7f479d9ba640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f479816a5a0 con 0x7f47980d14f0 2024-09-21T03:25:45.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.534+0000 7f4796ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47980b3a10 0x7f4798150040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:45.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.534+0000 7f4796ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47980b3a10 0x7f4798150040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:38826/0 (socket says 172.21.15.105:38826) 2024-09-21T03:25:45.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.534+0000 7f4796ffd640 1 -- 172.21.15.105:0/580558262 learned_addr learned my addr 172.21.15.105:0/580558262 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:45.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.534+0000 7f47967fc640 1 --2- 172.21.15.105:0/580558262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47980b9b60 0x7f47980ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:45.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.534+0000 7f47977fe640 1 --2- 172.21.15.105:0/580558262 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47980d14f0 0x7f479815f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:45.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.534+0000 7f4796ffd640 1 -- 172.21.15.105:0/580558262 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47980d14f0 msgr2=0x7f479815f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:45.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.534+0000 7f4796ffd640 1 --2- 172.21.15.105:0/580558262 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47980d14f0 0x7f479815f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:45.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.534+0000 7f4796ffd640 1 -- 172.21.15.105:0/580558262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47980b9b60 msgr2=0x7f47980ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:45.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.534+0000 7f4796ffd640 1 --2- 172.21.15.105:0/580558262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47980b9b60 0x7f47980ca980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:45.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.534+0000 7f4796ffd640 1 -- 172.21.15.105:0/580558262 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47981610d0 con 0x7f47980b3a10 2024-09-21T03:25:45.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.534+0000 7f47967fc640 1 --2- 172.21.15.105:0/580558262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47980b9b60 0x7f47980ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:25:45.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.534+0000 7f47977fe640 1 --2- 172.21.15.105:0/580558262 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47980d14f0 0x7f479815f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:25:45.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.534+0000 7f4796ffd640 1 --2- 172.21.15.105:0/580558262 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47980b3a10 0x7f4798150040 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f47880099f0 tx=0x7f4788003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:45.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.534+0000 7f477ffff640 1 -- 172.21.15.105:0/580558262 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f478803e030 con 0x7f47980b3a10 2024-09-21T03:25:45.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.535+0000 7f477ffff640 1 -- 172.21.15.105:0/580558262 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4788003e20 con 0x7f47980b3a10 2024-09-21T03:25:45.540 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.535+0000 7f477ffff640 1 -- 172.21.15.105:0/580558262 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4788035040 con 0x7f47980b3a10 2024-09-21T03:25:45.540 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.535+0000 7f479d9ba640 1 -- 172.21.15.105:0/580558262 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47981613b0 con 0x7f47980b3a10 2024-09-21T03:25:45.540 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.535+0000 7f479d9ba640 1 -- 172.21.15.105:0/580558262 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4798160490 con 0x7f47980b3a10 2024-09-21T03:25:45.540 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.536+0000 7f479d9ba640 1 -- 172.21.15.105:0/580558262 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47980ba0d0 con 0x7f47980b3a10 2024-09-21T03:25:45.541 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.536+0000 7f477ffff640 1 -- 172.21.15.105:0/580558262 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4788041030 con 0x7f47980b3a10 2024-09-21T03:25:45.541 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.537+0000 7f477ffff640 1 --2- 172.21.15.105:0/580558262 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4784078bc0 0x7f478407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:45.541 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.537+0000 7f477ffff640 1 -- 172.21.15.105:0/580558262 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 4943+0+0 (secure 0 0 0) 0x7f47880bb320 con 0x7f47980b3a10 2024-09-21T03:25:45.541 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.537+0000 7f47967fc640 1 --2- 172.21.15.105:0/580558262 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4784078bc0 0x7f478407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:45.541 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.538+0000 7f47967fc640 1 --2- 172.21.15.105:0/580558262 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4784078bc0 0x7f478407b0d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f47980c7db0 tx=0x7f478c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:45.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.541+0000 7f477ffff640 1 -- 172.21.15.105:0/580558262 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4788083a60 con 0x7f47980b3a10 2024-09-21T03:25:45.756 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.753+0000 7f479d9ba640 1 -- 172.21.15.105:0/580558262 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f479806eb00 con 0x7f47980b3a10 2024-09-21T03:25:45.756 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.753+0000 7f477ffff640 1 -- 172.21.15.105:0/580558262 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+3920 (secure 0 0 0) 0x7f4788083360 con 0x7f47980b3a10 2024-09-21T03:25:45.756 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:45.757 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":69,"btime":"2024-09-21T03:25:39:246566+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5996,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/1026486886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1026486886},{"type":"v1","addr":"172.21.15.162:6836","nonce":1026486886}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1085304139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1085304139},{"type":"v1","addr":"172.21.15.162:6837","nonce":1085304139}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":7161,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/569907499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":569907499},{"type":"v1","addr":"172.21.15.105:6833","nonce":569907499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":61},{"gid":7506,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3799555191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3799555191},{"type":"v1","addr":"172.21.15.105:6835","nonce":3799555191}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69}],"filesystems":[]} 2024-09-21T03:25:45.757 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 69 2024-09-21T03:25:45.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.755+0000 7f479d9ba640 1 -- 172.21.15.105:0/580558262 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4784078bc0 msgr2=0x7f478407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:45.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.755+0000 7f479d9ba640 1 --2- 172.21.15.105:0/580558262 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4784078bc0 0x7f478407b0d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f47980c7db0 tx=0x7f478c009040 comp rx=0 tx=0).stop 2024-09-21T03:25:45.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.755+0000 7f479d9ba640 1 -- 172.21.15.105:0/580558262 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47980b3a10 msgr2=0x7f4798150040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:45.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.755+0000 7f479d9ba640 1 --2- 172.21.15.105:0/580558262 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47980b3a10 0x7f4798150040 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f47880099f0 tx=0x7f4788003910 comp rx=0 tx=0).stop 2024-09-21T03:25:45.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.756+0000 7f479d9ba640 1 -- 172.21.15.105:0/580558262 shutdown_connections 2024-09-21T03:25:45.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.756+0000 7f479d9ba640 1 --2- 172.21.15.105:0/580558262 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4784078bc0 0x7f478407b0d0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:45.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.756+0000 7f479d9ba640 1 --2- 172.21.15.105:0/580558262 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47980d14f0 0x7f479815f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:45.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.756+0000 7f479d9ba640 1 --2- 172.21.15.105:0/580558262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47980b9b60 0x7f47980ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:45.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.756+0000 7f479d9ba640 1 --2- 172.21.15.105:0/580558262 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47980b3a10 0x7f4798150040 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:45.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.756+0000 7f479d9ba640 1 -- 172.21.15.105:0/580558262 >> 172.21.15.105:0/580558262 conn(0x7f479809d8f0 msgr2=0x7f4798169710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:45.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.756+0000 7f479d9ba640 1 -- 172.21.15.105:0/580558262 shutdown_connections 2024-09-21T03:25:45.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.756+0000 7f479d9ba640 1 -- 172.21.15.105:0/580558262 wait complete. 2024-09-21T03:25:45.769 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T03:25:45.769 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-21T03:25:45.770 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T03:25:45.770 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:25:45.770 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T03:25:45.770 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T03:25:45.770 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T03:25:45.770 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:25:45.770 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T03:25:45.771 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T03:25:45.771 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T03:25:45.771 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:25:45.771 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T03:25:45.771 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T03:25:45.771 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T03:25:45.771 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:25:45.781 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T03:25:45.781 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T03:25:45.783 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T03:25:45.783 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T03:25:45.785 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T03:25:45.786 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T03:25:45.786 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T03:25:45.786 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T03:25:45.825 INFO:tasks.ceph.mds.c:Started 2024-09-21T03:25:45.826 DEBUG:teuthology.parallel:result is None 2024-09-21T03:25:45.827 INFO:tasks.ceph.mds.a:Started 2024-09-21T03:25:45.827 DEBUG:teuthology.parallel:result is None 2024-09-21T03:25:45.828 INFO:tasks.ceph.mds.b:Started 2024-09-21T03:25:45.828 DEBUG:teuthology.parallel:result is None 2024-09-21T03:25:45.829 INFO:tasks.ceph.mds.d:Started 2024-09-21T03:25:45.829 DEBUG:teuthology.parallel:result is None 2024-09-21T03:25:45.829 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T03:25:45.911 INFO:tasks.ceph.mds.c.smithi105.stdout:starting mds.c at 2024-09-21T03:25:45.911 INFO:tasks.ceph.mds.a.smithi105.stdout:starting mds.a at 2024-09-21T03:25:45.923 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-09-21T03:25:45.924 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-09-21T03:25:45.924 INFO:tasks.ceph.mds.d.smithi162.stderr:2024-09-21T03:25:45.923+0000 7f7ab183c640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-21T03:25:45.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.945+0000 7f7b309da640 1 -- 172.21.15.105:0/907421933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b2c0b6100 msgr2=0x7f7b2c0b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:45.948 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.945+0000 7f7b309da640 1 --2- 172.21.15.105:0/907421933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b2c0b6100 0x7f7b2c0b1320 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c0739d0 tx=0x7f7b2002a5c0 comp rx=0 tx=0).stop 2024-09-21T03:25:45.948 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.945+0000 7f7b309da640 1 -- 172.21.15.105:0/907421933 shutdown_connections 2024-09-21T03:25:45.948 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.945+0000 7f7b309da640 1 --2- 172.21.15.105:0/907421933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b2c161f50 0x7f7b2c164370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:45.948 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.945+0000 7f7b309da640 1 --2- 172.21.15.105:0/907421933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b2c0b6100 0x7f7b2c0b1320 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:45.948 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.945+0000 7f7b309da640 1 --2- 172.21.15.105:0/907421933 >> v2:172.21.15.162:3300/0 conn(0x7f7b2c0b6680 0x7f7b2c0b0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:45.948 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.945+0000 7f7b309da640 1 -- 172.21.15.105:0/907421933 >> 172.21.15.105:0/907421933 conn(0x7f7b2c0d12a0 msgr2=0x7f7b2c0d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:45.948 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.945+0000 7f7b309da640 1 -- 172.21.15.105:0/907421933 shutdown_connections 2024-09-21T03:25:45.948 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.945+0000 7f7b309da640 1 -- 172.21.15.105:0/907421933 wait complete. 2024-09-21T03:25:45.949 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.947+0000 7f7b309da640 1 Processor -- start 2024-09-21T03:25:45.949 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.947+0000 7f7b309da640 1 -- start start 2024-09-21T03:25:45.952 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.948+0000 7f7b309da640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b2c0b6100 0x7f7b2c15d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:45.952 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.948+0000 7f7b309da640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b2c0b6680 0x7f7b2c1f5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:45.952 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.948+0000 7f7b309da640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b2c161f50 0x7f7b2c1633b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:45.952 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.948+0000 7f7b309da640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2c1648b0 con 0x7f7b2c0b6680 2024-09-21T03:25:45.952 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.948+0000 7f7b309da640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2c0b20d0 con 0x7f7b2c161f50 2024-09-21T03:25:45.952 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.948+0000 7f7b309da640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7b2c164a30 con 0x7f7b2c0b6100 2024-09-21T03:25:45.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.948+0000 7f7b29d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b2c0b6680 0x7f7b2c1f5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:45.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.948+0000 7f7b29d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b2c0b6680 0x7f7b2c1f5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:38870/0 (socket says 172.21.15.105:38870) 2024-09-21T03:25:45.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.948+0000 7f7b29d9b640 1 -- 172.21.15.105:0/3259177794 learned_addr learned my addr 172.21.15.105:0/3259177794 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:45.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.949+0000 7f7b2ad9d640 1 --2- 172.21.15.105:0/3259177794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b2c161f50 0x7f7b2c1633b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:45.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.949+0000 7f7b2a59c640 1 --2- 172.21.15.105:0/3259177794 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b2c0b6100 0x7f7b2c15d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:45.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.949+0000 7f7b29d9b640 1 -- 172.21.15.105:0/3259177794 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b2c0b6100 msgr2=0x7f7b2c15d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:45.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.949+0000 7f7b29d9b640 1 --2- 172.21.15.105:0/3259177794 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b2c0b6100 0x7f7b2c15d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:45.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.949+0000 7f7b29d9b640 1 -- 172.21.15.105:0/3259177794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b2c161f50 msgr2=0x7f7b2c1633b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:45.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.949+0000 7f7b29d9b640 1 --2- 172.21.15.105:0/3259177794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b2c161f50 0x7f7b2c1633b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:45.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.949+0000 7f7b29d9b640 1 -- 172.21.15.105:0/3259177794 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b2c15dd80 con 0x7f7b2c0b6680 2024-09-21T03:25:45.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.949+0000 7f7b29d9b640 1 --2- 172.21.15.105:0/3259177794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b2c0b6680 0x7f7b2c1f5d80 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f7b20009230 tx=0x7f7b200038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:45.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.949+0000 7f7b1affd640 1 -- 172.21.15.105:0/3259177794 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b2003e030 con 0x7f7b2c0b6680 2024-09-21T03:25:45.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.949+0000 7f7b1affd640 1 -- 172.21.15.105:0/3259177794 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b20003ca0 con 0x7f7b2c0b6680 2024-09-21T03:25:45.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.949+0000 7f7b309da640 1 -- 172.21.15.105:0/3259177794 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b2c15c7a0 con 0x7f7b2c0b6680 2024-09-21T03:25:45.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.949+0000 7f7b1affd640 1 -- 172.21.15.105:0/3259177794 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b20035040 con 0x7f7b2c0b6680 2024-09-21T03:25:45.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.949+0000 7f7b309da640 1 -- 172.21.15.105:0/3259177794 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b2c15cd60 con 0x7f7b2c0b6680 2024-09-21T03:25:45.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.950+0000 7f7b309da640 1 -- 172.21.15.105:0/3259177794 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b2c06a6f0 con 0x7f7b2c0b6680 2024-09-21T03:25:45.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.951+0000 7f7b1affd640 1 -- 172.21.15.105:0/3259177794 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7b20041030 con 0x7f7b2c0b6680 2024-09-21T03:25:45.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.951+0000 7f7b1affd640 1 --2- 172.21.15.105:0/3259177794 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7b0c078b90 0x7f7b0c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:45.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.952+0000 7f7b1affd640 1 -- 172.21.15.105:0/3259177794 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 4943+0+0 (secure 0 0 0) 0x7f7b200bb450 con 0x7f7b2c0b6680 2024-09-21T03:25:45.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.952+0000 7f7b2a59c640 1 --2- 172.21.15.105:0/3259177794 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7b0c078b90 0x7f7b0c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:45.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.952+0000 7f7b2a59c640 1 --2- 172.21.15.105:0/3259177794 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7b0c078b90 0x7f7b0c07b0a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c0ceda0 tx=0x7f7b1c005f30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:45.959 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:45.956+0000 7f7b1affd640 1 -- 172.21.15.105:0/3259177794 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7b2c06a6f0 con 0x7f7b2c0b6680 2024-09-21T03:25:46.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:46.146+0000 7f7b309da640 1 -- 172.21.15.105:0/3259177794 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f7b2c0b0de0 con 0x7f7b2c0b6680 2024-09-21T03:25:47.227 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.224+0000 7f7b1affd640 1 -- 172.21.15.105:0/3259177794 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v112) ==== 97+0+0 (secure 0 0 0) 0x7f7b20083b90 con 0x7f7b2c0b6680 2024-09-21T03:25:47.227 INFO:teuthology.orchestra.run.smithi105.stderr: removed all blocklist entries 2024-09-21T03:25:47.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.228+0000 7f7b309da640 1 -- 172.21.15.105:0/3259177794 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7b0c078b90 msgr2=0x7f7b0c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:47.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.228+0000 7f7b309da640 1 --2- 172.21.15.105:0/3259177794 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7b0c078b90 0x7f7b0c07b0a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c0ceda0 tx=0x7f7b1c005f30 comp rx=0 tx=0).stop 2024-09-21T03:25:47.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.228+0000 7f7b309da640 1 -- 172.21.15.105:0/3259177794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b2c0b6680 msgr2=0x7f7b2c1f5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:47.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.228+0000 7f7b309da640 1 --2- 172.21.15.105:0/3259177794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b2c0b6680 0x7f7b2c1f5d80 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f7b20009230 tx=0x7f7b200038a0 comp rx=0 tx=0).stop 2024-09-21T03:25:47.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.228+0000 7f7b309da640 1 -- 172.21.15.105:0/3259177794 shutdown_connections 2024-09-21T03:25:47.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.228+0000 7f7b309da640 1 --2- 172.21.15.105:0/3259177794 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7b0c078b90 0x7f7b0c07b0a0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:47.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.228+0000 7f7b309da640 1 --2- 172.21.15.105:0/3259177794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b2c161f50 0x7f7b2c1633b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:47.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.228+0000 7f7b309da640 1 --2- 172.21.15.105:0/3259177794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b2c0b6680 0x7f7b2c1f5d80 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:47.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.228+0000 7f7b309da640 1 --2- 172.21.15.105:0/3259177794 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b2c0b6100 0x7f7b2c15d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:47.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.228+0000 7f7b309da640 1 -- 172.21.15.105:0/3259177794 >> 172.21.15.105:0/3259177794 conn(0x7f7b2c0d12a0 msgr2=0x7f7b2c161630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:47.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.228+0000 7f7b309da640 1 -- 172.21.15.105:0/3259177794 shutdown_connections 2024-09-21T03:25:47.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.228+0000 7f7b309da640 1 -- 172.21.15.105:0/3259177794 wait complete. 2024-09-21T03:25:47.244 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T03:25:47.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.359+0000 7fd75e9c3640 1 -- 172.21.15.105:0/1856757777 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7581570e0 msgr2=0x7fd7580d1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:47.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.359+0000 7fd75e9c3640 1 --2- 172.21.15.105:0/1856757777 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7581570e0 0x7fd7580d1f20 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fd748005fd0 tx=0x7fd74802a530 comp rx=0 tx=0).stop 2024-09-21T03:25:47.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.359+0000 7fd75e9c3640 1 -- 172.21.15.105:0/1856757777 shutdown_connections 2024-09-21T03:25:47.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.359+0000 7fd75e9c3640 1 --2- 172.21.15.105:0/1856757777 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7580d2460 0x7fd75815d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:47.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.359+0000 7fd75e9c3640 1 --2- 172.21.15.105:0/1856757777 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7581570e0 0x7fd7580d1f20 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:47.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.359+0000 7fd75e9c3640 1 -- 172.21.15.105:0/1856757777 >> 172.21.15.105:0/1856757777 conn(0x7fd75806d550 msgr2=0x7fd758071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:47.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.359+0000 7fd75e9c3640 1 -- 172.21.15.105:0/1856757777 shutdown_connections 2024-09-21T03:25:47.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.359+0000 7fd75e9c3640 1 -- 172.21.15.105:0/1856757777 wait complete. 2024-09-21T03:25:47.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.361+0000 7fd75e9c3640 1 Processor -- start 2024-09-21T03:25:47.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.361+0000 7fd75e9c3640 1 -- start start 2024-09-21T03:25:47.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.362+0000 7fd75e9c3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7580d2460 0x7fd7581577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:47.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.362+0000 7fd75e9c3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7581570e0 0x7fd7581f7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:47.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.362+0000 7fd75e9c3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd75815d670 0x7fd7580c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:47.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.362+0000 7fd75e9c3640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd7580b7f30 con 0x7fd75815d670 2024-09-21T03:25:47.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.362+0000 7fd75e9c3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd7580b7db0 con 0x7fd7581570e0 2024-09-21T03:25:47.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.362+0000 7fd75e9c3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd7580b80b0 con 0x7fd7580d2460 2024-09-21T03:25:47.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.363+0000 7fd75cf60640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd75815d670 0x7fd7580c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:47.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.363+0000 7fd75cf60640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd75815d670 0x7fd7580c8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:38886/0 (socket says 172.21.15.105:38886) 2024-09-21T03:25:47.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.363+0000 7fd75cf60640 1 -- 172.21.15.105:0/3901995002 learned_addr learned my addr 172.21.15.105:0/3901995002 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:47.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.363+0000 7fd757fff640 1 --2- 172.21.15.105:0/3901995002 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7580d2460 0x7fd7581577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:47.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.363+0000 7fd7577fe640 1 --2- 172.21.15.105:0/3901995002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7581570e0 0x7fd7581f7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:47.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.363+0000 7fd75cf60640 1 -- 172.21.15.105:0/3901995002 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7580d2460 msgr2=0x7fd7581577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:47.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.363+0000 7fd75cf60640 1 --2- 172.21.15.105:0/3901995002 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7580d2460 0x7fd7581577f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:47.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.363+0000 7fd75cf60640 1 -- 172.21.15.105:0/3901995002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7581570e0 msgr2=0x7fd7581f7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:47.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.363+0000 7fd75cf60640 1 --2- 172.21.15.105:0/3901995002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7581570e0 0x7fd7581f7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:47.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.363+0000 7fd75cf60640 1 -- 172.21.15.105:0/3901995002 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7581497c0 con 0x7fd75815d670 2024-09-21T03:25:47.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.363+0000 7fd7577fe640 1 --2- 172.21.15.105:0/3901995002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7581570e0 0x7fd7581f7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:25:47.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.363+0000 7fd75cf60640 1 --2- 172.21.15.105:0/3901995002 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd75815d670 0x7fd7580c8000 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fd75000b9e0 tx=0x7fd75000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:47.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.363+0000 7fd754ff9640 1 -- 172.21.15.105:0/3901995002 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd750003b70 con 0x7fd75815d670 2024-09-21T03:25:47.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.363+0000 7fd754ff9640 1 -- 172.21.15.105:0/3901995002 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd750003e00 con 0x7fd75815d670 2024-09-21T03:25:47.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.363+0000 7fd75e9c3640 1 -- 172.21.15.105:0/3901995002 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd758148a00 con 0x7fd75815d670 2024-09-21T03:25:47.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.363+0000 7fd754ff9640 1 -- 172.21.15.105:0/3901995002 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75000cb80 con 0x7fd75815d670 2024-09-21T03:25:47.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.363+0000 7fd75e9c3640 1 -- 172.21.15.105:0/3901995002 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd758148fc0 con 0x7fd75815d670 2024-09-21T03:25:47.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.364+0000 7fd75e9c3640 1 -- 172.21.15.105:0/3901995002 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd75815d130 con 0x7fd75815d670 2024-09-21T03:25:47.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.365+0000 7fd754ff9640 1 -- 172.21.15.105:0/3901995002 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd750004000 con 0x7fd75815d670 2024-09-21T03:25:47.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.365+0000 7fd754ff9640 1 --2- 172.21.15.105:0/3901995002 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd744078bc0 0x7fd74407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:47.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.365+0000 7fd754ff9640 1 -- 172.21.15.105:0/3901995002 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 4857+0+0 (secure 0 0 0) 0x7fd75009a8c0 con 0x7fd75815d670 2024-09-21T03:25:47.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.366+0000 7fd757fff640 1 --2- 172.21.15.105:0/3901995002 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd744078bc0 0x7fd74407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:47.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.366+0000 7fd757fff640 1 --2- 172.21.15.105:0/3901995002 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd744078bc0 0x7fd74407b0d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd748033000 tx=0x7fd748004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:47.372 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.370+0000 7fd754ff9640 1 -- 172.21.15.105:0/3901995002 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd750063050 con 0x7fd75815d670 2024-09-21T03:25:47.616 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.614+0000 7fd75e9c3640 1 -- 172.21.15.105:0/3901995002 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fd7581f7df0 con 0x7fd75815d670 2024-09-21T03:25:47.617 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.614+0000 7fd754ff9640 1 -- 172.21.15.105:0/3901995002 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) ==== 80+0+5304 (secure 0 0 0) 0x7fd750062950 con 0x7fd75815d670 2024-09-21T03:25:47.617 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:47.617 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-21T03:25:47.617 INFO:teuthology.orchestra.run.smithi105.stdout: "auth_dump": [ 2024-09-21T03:25:47.617 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:25:47.617 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mds.a", 2024-09-21T03:25:47.617 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mtIIZDhAAJIXLpzTFBOFhnOwLzsdL6w==", 2024-09-21T03:25:47.618 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:25:47.618 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:25:47.618 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:25:47.618 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:25:47.618 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:25:47.618 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:47.618 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:25:47.618 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:25:47.618 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mds.b", 2024-09-21T03:25:47.618 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mGKANGxAAeAuUYMtLP7GXKfIELR7qMA==", 2024-09-21T03:25:47.618 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:25:47.618 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:25:47.618 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:25:47.618 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:25:47.619 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:25:47.619 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:47.619 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:25:47.619 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:25:47.619 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mds.c", 2024-09-21T03:25:47.619 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mwQzQFRAAElYtgnIdYzzkeg8AtiU+kA==", 2024-09-21T03:25:47.619 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:25:47.619 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:25:47.619 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:25:47.619 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:25:47.619 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:25:47.619 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:47.619 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:25:47.619 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:25:47.620 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mds.d", 2024-09-21T03:25:47.620 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mZkWyIhAAu4XWptFcbDrYjozzrgMcGQ==", 2024-09-21T03:25:47.620 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:25:47.620 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:25:47.620 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:25:47.620 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:25:47.620 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:25:47.620 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:47.620 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:25:47.620 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:25:47.620 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.0", 2024-09-21T03:25:47.620 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDMOu5mrSk2BRAAuEPjuEeUJEI3Sa2fiLaJyw==", 2024-09-21T03:25:47.620 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:25:47.620 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:25:47.620 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:25:47.620 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:25:47.621 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:47.621 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:25:47.621 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:25:47.621 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.1", 2024-09-21T03:25:47.621 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDPOu5mAT4UCBAAase7NV3ARBSu4QloaQdlzA==", 2024-09-21T03:25:47.621 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:25:47.621 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:25:47.621 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:25:47.621 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:25:47.621 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:47.621 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:25:47.621 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:25:47.621 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.2", 2024-09-21T03:25:47.621 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDSOu5ma4LRChAASottrmolMcagbspeyGVzBQ==", 2024-09-21T03:25:47.621 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:25:47.621 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:25:47.622 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:25:47.622 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:25:47.622 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:47.622 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:25:47.622 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:25:47.622 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.3", 2024-09-21T03:25:47.622 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDVOu5mD5RWHBAAKuNr4F3GA0EP566aQ07ZVw==", 2024-09-21T03:25:47.622 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:25:47.622 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:25:47.622 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:25:47.622 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:25:47.622 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:47.622 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:25:47.623 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:25:47.623 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.4", 2024-09-21T03:25:47.623 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDcOu5m++UBChAAqmgoPBQ/as4tc+UQPwaflg==", 2024-09-21T03:25:47.623 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:25:47.623 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:25:47.623 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:25:47.623 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:25:47.623 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:47.623 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:25:47.623 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:25:47.623 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.5", 2024-09-21T03:25:47.623 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDfOu5maYYZKRAA1ungglTU3TW1B/XNRjBuZQ==", 2024-09-21T03:25:47.623 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:25:47.623 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:25:47.624 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:25:47.624 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:25:47.624 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:47.624 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:25:47.624 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:25:47.624 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.6", 2024-09-21T03:25:47.624 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDjOu5mmwIqHBAAf6oNdLNkmM9yufP8XA2+og==", 2024-09-21T03:25:47.624 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:25:47.624 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:25:47.624 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:25:47.624 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:25:47.624 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:47.624 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:25:47.624 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:25:47.625 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.7", 2024-09-21T03:25:47.625 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDmOu5mtCciHhAAPTnZubJ+7mGXcXZykCWxHg==", 2024-09-21T03:25:47.625 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:25:47.625 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:25:47.625 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:25:47.625 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:25:47.625 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:47.625 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:25:47.625 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:25:47.625 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.0", 2024-09-21T03:25:47.625 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mughoJxAAhY0bzJmq+oNyzCdtafkC9w==", 2024-09-21T03:25:47.625 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:25:47.625 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:25:47.625 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow r", 2024-09-21T03:25:47.626 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-21T03:25:47.626 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:47.626 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:25:47.626 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:25:47.626 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.1", 2024-09-21T03:25:47.626 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5m4Vn2LhAAnEa/01ql5quuRCVHOVwB7w==", 2024-09-21T03:25:47.626 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:25:47.626 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:25:47.626 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow r", 2024-09-21T03:25:47.626 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow rw", 2024-09-21T03:25:47.626 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow rwx" 2024-09-21T03:25:47.626 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:47.626 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:25:47.626 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:25:47.627 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.2", 2024-09-21T03:25:47.627 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mKi0mKxAAoetnL61ujgtg2cvscdjCLQ==", 2024-09-21T03:25:47.627 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:25:47.627 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:25:47.627 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow r", 2024-09-21T03:25:47.627 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow rw", 2024-09-21T03:25:47.627 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow rwx" 2024-09-21T03:25:47.627 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:47.627 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:25:47.627 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:25:47.627 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.3", 2024-09-21T03:25:47.627 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mWZDAMhAAs4BuFHMSkJa6+piN/FeeXQ==", 2024-09-21T03:25:47.627 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:25:47.627 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:25:47.628 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow r", 2024-09-21T03:25:47.628 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow rw", 2024-09-21T03:25:47.628 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow rwx" 2024-09-21T03:25:47.628 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:47.628 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:25:47.628 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:25:47.628 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.admin", 2024-09-21T03:25:47.628 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDHOu5m4JRYLBAAgZ8nh5VIiWhuZ4+vrnmngw==", 2024-09-21T03:25:47.628 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:25:47.628 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow *", 2024-09-21T03:25:47.628 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:25:47.628 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:25:47.628 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:25:47.628 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:47.628 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:25:47.629 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:25:47.629 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mgr.x", 2024-09-21T03:25:47.629 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5m92lTChAAQ61muQmc6uBs7b5mq3Zt8g==", 2024-09-21T03:25:47.629 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:25:47.629 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow *", 2024-09-21T03:25:47.629 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile mgr", 2024-09-21T03:25:47.629 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:25:47.629 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:47.629 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:25:47.629 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:25:47.629 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mgr.y", 2024-09-21T03:25:47.629 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mh07bBRAAflFF00xr1ew4zttUi5TGng==", 2024-09-21T03:25:47.629 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:25:47.629 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow *", 2024-09-21T03:25:47.629 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile mgr", 2024-09-21T03:25:47.630 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:25:47.630 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:47.630 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:47.630 INFO:teuthology.orchestra.run.smithi105.stdout: ] 2024-09-21T03:25:47.630 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-21T03:25:47.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.616+0000 7fd75e9c3640 1 -- 172.21.15.105:0/3901995002 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd744078bc0 msgr2=0x7fd74407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:47.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.616+0000 7fd75e9c3640 1 --2- 172.21.15.105:0/3901995002 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd744078bc0 0x7fd74407b0d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd748033000 tx=0x7fd748004730 comp rx=0 tx=0).stop 2024-09-21T03:25:47.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.616+0000 7fd75e9c3640 1 -- 172.21.15.105:0/3901995002 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd75815d670 msgr2=0x7fd7580c8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:47.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.616+0000 7fd75e9c3640 1 --2- 172.21.15.105:0/3901995002 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd75815d670 0x7fd7580c8000 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fd75000b9e0 tx=0x7fd75000bea0 comp rx=0 tx=0).stop 2024-09-21T03:25:47.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.616+0000 7fd75e9c3640 1 -- 172.21.15.105:0/3901995002 shutdown_connections 2024-09-21T03:25:47.631 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.616+0000 7fd75e9c3640 1 --2- 172.21.15.105:0/3901995002 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd744078bc0 0x7fd74407b0d0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:47.632 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.616+0000 7fd75e9c3640 1 --2- 172.21.15.105:0/3901995002 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd75815d670 0x7fd7580c8000 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:47.632 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.616+0000 7fd75e9c3640 1 --2- 172.21.15.105:0/3901995002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7581570e0 0x7fd7581f7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:47.632 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.616+0000 7fd75e9c3640 1 --2- 172.21.15.105:0/3901995002 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7580d2460 0x7fd7581577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:47.632 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.616+0000 7fd75e9c3640 1 -- 172.21.15.105:0/3901995002 >> 172.21.15.105:0/3901995002 conn(0x7fd75806d550 msgr2=0x7fd7580b55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:47.632 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.616+0000 7fd75e9c3640 1 -- 172.21.15.105:0/3901995002 shutdown_connections 2024-09-21T03:25:47.632 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.617+0000 7fd75e9c3640 1 -- 172.21.15.105:0/3901995002 wait complete. 2024-09-21T03:25:47.632 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T03:25:47.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.740+0000 7f734718b640 1 -- 172.21.15.105:0/515571916 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7328003a00 msgr2=0x7f7328003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:47.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.740+0000 7f734718b640 1 --2- 172.21.15.105:0/515571916 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7328003a00 0x7f7328003e70 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f733c009b20 tx=0x7f7328005830 comp rx=0 tx=0).stop 2024-09-21T03:25:47.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.740+0000 7f7345728640 1 -- 172.21.15.105:0/515571916 reap_dead start 2024-09-21T03:25:47.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.740+0000 7f734718b640 1 -- 172.21.15.105:0/515571916 shutdown_connections 2024-09-21T03:25:47.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.740+0000 7f734718b640 1 -- 172.21.15.105:0/515571916 >> 172.21.15.105:0/515571916 conn(0x7f73400b1cb0 msgr2=0x7f73400b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:47.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.740+0000 7f734718b640 1 -- 172.21.15.105:0/515571916 shutdown_connections 2024-09-21T03:25:47.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.740+0000 7f734718b640 1 -- 172.21.15.105:0/515571916 wait complete. 2024-09-21T03:25:47.745 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.742+0000 7f734718b640 1 Processor -- start 2024-09-21T03:25:47.745 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.742+0000 7f734718b640 1 -- start start 2024-09-21T03:25:47.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.744+0000 7f734718b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7328003a00 0x7f73401f2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:47.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.744+0000 7f734718b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73400c9880 0x7f73400b4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:47.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.744+0000 7f734718b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73400b4ba0 0x7f73401f56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:47.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.744+0000 7f734718b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f73400cba00 con 0x7f73400c9880 2024-09-21T03:25:47.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.744+0000 7f734718b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f73400747d0 con 0x7f73400b4ba0 2024-09-21T03:25:47.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.744+0000 7f734718b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f73400cbb80 con 0x7f7328003a00 2024-09-21T03:25:47.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.744+0000 7f7337fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73400c9880 0x7f73400b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:47.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.744+0000 7f7337fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73400c9880 0x7f73400b4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:38894/0 (socket says 172.21.15.105:38894) 2024-09-21T03:25:47.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.744+0000 7f7337fff640 1 -- 172.21.15.105:0/1807862833 learned_addr learned my addr 172.21.15.105:0/1807862833 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:47.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.744+0000 7f7344f27640 1 --2- 172.21.15.105:0/1807862833 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7328003a00 0x7f73401f2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:47.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.744+0000 7f7345728640 1 --2- 172.21.15.105:0/1807862833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73400b4ba0 0x7f73401f56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:47.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.744+0000 7f7337fff640 1 -- 172.21.15.105:0/1807862833 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7328003a00 msgr2=0x7f73401f2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:47.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.744+0000 7f7337fff640 1 --2- 172.21.15.105:0/1807862833 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7328003a00 0x7f73401f2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:47.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.744+0000 7f7337fff640 1 -- 172.21.15.105:0/1807862833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73400b4ba0 msgr2=0x7f73401f56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:47.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.744+0000 7f7337fff640 1 --2- 172.21.15.105:0/1807862833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73400b4ba0 0x7f73401f56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:47.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.744+0000 7f7337fff640 1 -- 172.21.15.105:0/1807862833 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73400b4fb0 con 0x7f73400c9880 2024-09-21T03:25:47.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.744+0000 7f7337fff640 1 --2- 172.21.15.105:0/1807862833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73400c9880 0x7f73400b4660 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f7330011a80 tx=0x7f7330011f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:47.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.744+0000 7f73357fa640 1 -- 172.21.15.105:0/1807862833 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733000fe10 con 0x7f73400c9880 2024-09-21T03:25:47.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.744+0000 7f73357fa640 1 -- 172.21.15.105:0/1807862833 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7330016070 con 0x7f73400c9880 2024-09-21T03:25:47.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.744+0000 7f734718b640 1 -- 172.21.15.105:0/1807862833 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73400c5010 con 0x7f73400c9880 2024-09-21T03:25:47.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.744+0000 7f73357fa640 1 -- 172.21.15.105:0/1807862833 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7330012780 con 0x7f73400c9880 2024-09-21T03:25:47.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.744+0000 7f734718b640 1 -- 172.21.15.105:0/1807862833 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73401f8ed0 con 0x7f73400c9880 2024-09-21T03:25:47.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.745+0000 7f734718b640 1 -- 172.21.15.105:0/1807862833 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73400743a0 con 0x7f73400c9880 2024-09-21T03:25:47.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.746+0000 7f73357fa640 1 -- 172.21.15.105:0/1807862833 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7330018030 con 0x7f73400c9880 2024-09-21T03:25:47.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.747+0000 7f73357fa640 1 --2- 172.21.15.105:0/1807862833 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f732c078bc0 0x7f732c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:47.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.747+0000 7f73357fa640 1 -- 172.21.15.105:0/1807862833 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 4857+0+0 (secure 0 0 0) 0x7f733009b130 con 0x7f73400c9880 2024-09-21T03:25:47.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.747+0000 7f7344f27640 1 --2- 172.21.15.105:0/1807862833 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f732c078bc0 0x7f732c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:47.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.747+0000 7f7344f27640 1 --2- 172.21.15.105:0/1807862833 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f732c078bc0 0x7f732c07b0d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f733c009b20 tx=0x7f733c02d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:47.753 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.751+0000 7f73357fa640 1 -- 172.21.15.105:0/1807862833 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f73400b4fb0 con 0x7f73400c9880 2024-09-21T03:25:47.932 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.929+0000 7f734718b640 1 -- 172.21.15.105:0/1807862833 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f73400cd7c0 con 0x7f73400c9880 2024-09-21T03:25:47.932 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.929+0000 7f73357fa640 1 -- 172.21.15.105:0/1807862833 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v112) ==== 84+0+65 (secure 0 0 0) 0x7f7330063300 con 0x7f73400c9880 2024-09-21T03:25:47.932 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:47.932 INFO:teuthology.orchestra.run.smithi105.stdout:[ 2024-09-21T03:25:47.932 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:25:47.932 INFO:teuthology.orchestra.run.smithi105.stdout: "poolnum": 1, 2024-09-21T03:25:47.932 INFO:teuthology.orchestra.run.smithi105.stdout: "poolname": ".mgr" 2024-09-21T03:25:47.932 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:25:47.932 INFO:teuthology.orchestra.run.smithi105.stdout:] 2024-09-21T03:25:47.934 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.931+0000 7f734718b640 1 -- 172.21.15.105:0/1807862833 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f732c078bc0 msgr2=0x7f732c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:47.934 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.931+0000 7f734718b640 1 --2- 172.21.15.105:0/1807862833 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f732c078bc0 0x7f732c07b0d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f733c009b20 tx=0x7f733c02d040 comp rx=0 tx=0).stop 2024-09-21T03:25:47.934 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.931+0000 7f734718b640 1 -- 172.21.15.105:0/1807862833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73400c9880 msgr2=0x7f73400b4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:47.934 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.931+0000 7f734718b640 1 --2- 172.21.15.105:0/1807862833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73400c9880 0x7f73400b4660 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f7330011a80 tx=0x7f7330011f40 comp rx=0 tx=0).stop 2024-09-21T03:25:47.935 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.931+0000 7f734718b640 1 -- 172.21.15.105:0/1807862833 shutdown_connections 2024-09-21T03:25:47.935 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.931+0000 7f734718b640 1 --2- 172.21.15.105:0/1807862833 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f732c078bc0 0x7f732c07b0d0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:47.935 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.931+0000 7f734718b640 1 --2- 172.21.15.105:0/1807862833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73400b4ba0 0x7f73401f56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:47.935 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.931+0000 7f734718b640 1 --2- 172.21.15.105:0/1807862833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73400c9880 0x7f73400b4660 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:47.935 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.931+0000 7f734718b640 1 --2- 172.21.15.105:0/1807862833 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7328003a00 0x7f73401f2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:47.935 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.931+0000 7f734718b640 1 -- 172.21.15.105:0/1807862833 >> 172.21.15.105:0/1807862833 conn(0x7f73400b1cb0 msgr2=0x7f734015b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:47.935 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.931+0000 7f734718b640 1 -- 172.21.15.105:0/1807862833 shutdown_connections 2024-09-21T03:25:47.935 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:47.931+0000 7f734718b640 1 -- 172.21.15.105:0/1807862833 wait complete. 2024-09-21T03:25:47.945 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T03:25:47.945 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T03:25:48.061 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:48.059+0000 7fa3d9c9b640 1 -- 172.21.15.105:0/2330080762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3d40d0340 msgr2=0x7fa3d40ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:48.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:48.059+0000 7fa3d9c9b640 1 --2- 172.21.15.105:0/2330080762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3d40d0340 0x7fa3d40ccbc0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc005fd0 tx=0x7fa3cc02a5d0 comp rx=0 tx=0).stop 2024-09-21T03:25:48.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:48.059+0000 7fa3d9c9b640 1 -- 172.21.15.105:0/2330080762 shutdown_connections 2024-09-21T03:25:48.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:48.059+0000 7fa3d9c9b640 1 --2- 172.21.15.105:0/2330080762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3d40d0340 0x7fa3d40ccbc0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:48.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:48.059+0000 7fa3d9c9b640 1 --2- 172.21.15.105:0/2330080762 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3d41601c0 0x7fa3d40d1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:48.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:48.059+0000 7fa3d9c9b640 1 -- 172.21.15.105:0/2330080762 >> 172.21.15.105:0/2330080762 conn(0x7fa3d4072a90 msgr2=0x7fa3d4072ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:48.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:48.059+0000 7fa3d9c9b640 1 -- 172.21.15.105:0/2330080762 shutdown_connections 2024-09-21T03:25:48.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:48.059+0000 7fa3d9c9b640 1 -- 172.21.15.105:0/2330080762 wait complete. 2024-09-21T03:25:48.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:48.060+0000 7fa3d9c9b640 1 Processor -- start 2024-09-21T03:25:48.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:48.061+0000 7fa3d9c9b640 1 -- start start 2024-09-21T03:25:48.066 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:48.062+0000 7fa3d9c9b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3d40cff30 0x7fa3d40b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:48.066 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:48.062+0000 7fa3d9c9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3d40d0340 0x7fa3d4152320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:48.066 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:48.062+0000 7fa3d9c9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3d41601c0 0x7fa3d41f6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:48.066 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:48.062+0000 7fa3d9c9b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d415d460 con 0x7fa3d40d0340 2024-09-21T03:25:48.066 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:48.062+0000 7fa3d9c9b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d415d2e0 con 0x7fa3d41601c0 2024-09-21T03:25:48.066 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:48.062+0000 7fa3d9c9b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa3d415d5e0 con 0x7fa3d40cff30 2024-09-21T03:25:48.067 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:48.062+0000 7fa3d2ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3d40d0340 0x7fa3d4152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:48.067 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:48.062+0000 7fa3d2ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3d40d0340 0x7fa3d4152320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:38912/0 (socket says 172.21.15.105:38912) 2024-09-21T03:25:48.067 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:48.062+0000 7fa3d2ffd640 1 -- 172.21.15.105:0/1964474437 learned_addr learned my addr 172.21.15.105:0/1964474437 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:48.067 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:48.062+0000 7fa3d3fff640 1 --2- 172.21.15.105:0/1964474437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3d41601c0 0x7fa3d41f6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:48.067 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:48.062+0000 7fa3d37fe640 1 --2- 172.21.15.105:0/1964474437 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3d40cff30 0x7fa3d40b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:48.067 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:48.062+0000 7fa3d2ffd640 1 -- 172.21.15.105:0/1964474437 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3d40cff30 msgr2=0x7fa3d40b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:48.067 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:48.062+0000 7fa3d2ffd640 1 --2- 172.21.15.105:0/1964474437 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3d40cff30 0x7fa3d40b6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:48.067 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:48.062+0000 7fa3d2ffd640 1 -- 172.21.15.105:0/1964474437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3d41601c0 msgr2=0x7fa3d41f6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:48.067 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:48.062+0000 7fa3d2ffd640 1 --2- 172.21.15.105:0/1964474437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3d41601c0 0x7fa3d41f6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:48.067 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:48.062+0000 7fa3d2ffd640 1 -- 172.21.15.105:0/1964474437 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d41f7da0 con 0x7fa3d40d0340 2024-09-21T03:25:48.067 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:48.063+0000 7fa3d2ffd640 1 --2- 172.21.15.105:0/1964474437 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3d40d0340 0x7fa3d4152320 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fa3c800c370 tx=0x7fa3c800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:48.067 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:48.063+0000 7fa3bbfff640 1 -- 172.21.15.105:0/1964474437 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c8017070 con 0x7fa3d40d0340 2024-09-21T03:25:48.067 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:48.063+0000 7fa3bbfff640 1 -- 172.21.15.105:0/1964474437 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa3c80053c0 con 0x7fa3d40d0340 2024-09-21T03:25:48.068 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:48.063+0000 7fa3d9c9b640 1 -- 172.21.15.105:0/1964474437 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3d41f7ac0 con 0x7fa3d40d0340 2024-09-21T03:25:48.068 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:48.063+0000 7fa3bbfff640 1 -- 172.21.15.105:0/1964474437 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c8003850 con 0x7fa3d40d0340 2024-09-21T03:25:48.068 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:48.063+0000 7fa3d9c9b640 1 -- 172.21.15.105:0/1964474437 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3d40b6560 con 0x7fa3d40d0340 2024-09-21T03:25:48.068 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:48.064+0000 7fa3d9c9b640 1 -- 172.21.15.105:0/1964474437 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3d41f7830 con 0x7fa3d40d0340 2024-09-21T03:25:48.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:48.065+0000 7fa3bbfff640 1 -- 172.21.15.105:0/1964474437 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa3c801a070 con 0x7fa3d40d0340 2024-09-21T03:25:48.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:48.065+0000 7fa3bbfff640 1 --2- 172.21.15.105:0/1964474437 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa3c0078b90 0x7fa3c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:48.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:48.065+0000 7fa3bbfff640 1 -- 172.21.15.105:0/1964474437 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 4857+0+0 (secure 0 0 0) 0x7fa3c8099c80 con 0x7fa3d40d0340 2024-09-21T03:25:48.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:48.065+0000 7fa3d37fe640 1 --2- 172.21.15.105:0/1964474437 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa3c0078b90 0x7fa3c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:48.069 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:48.066+0000 7fa3d37fe640 1 --2- 172.21.15.105:0/1964474437 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa3c0078b90 0x7fa3c007b0a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4005fd0 tx=0x7fa3c4009500 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:48.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:48.070+0000 7fa3bbfff640 1 -- 172.21.15.105:0/1964474437 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa3c8061dd0 con 0x7fa3d40d0340 2024-09-21T03:25:48.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:48.247+0000 7fa3d9c9b640 1 -- 172.21.15.105:0/1964474437 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fa3d415da90 con 0x7fa3d40d0340 2024-09-21T03:25:49.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.227+0000 7fa3bbfff640 1 -- 172.21.15.105:0/1964474437 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v113) ==== 138+0+0 (secure 0 0 0) 0x7fa3c8066800 con 0x7fa3d40d0340 2024-09-21T03:25:49.230 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_metadata' created 2024-09-21T03:25:49.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.230+0000 7fa3d9c9b640 1 -- 172.21.15.105:0/1964474437 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa3c0078b90 msgr2=0x7fa3c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:49.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.230+0000 7fa3d9c9b640 1 --2- 172.21.15.105:0/1964474437 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa3c0078b90 0x7fa3c007b0a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4005fd0 tx=0x7fa3c4009500 comp rx=0 tx=0).stop 2024-09-21T03:25:49.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.230+0000 7fa3d9c9b640 1 -- 172.21.15.105:0/1964474437 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3d40d0340 msgr2=0x7fa3d4152320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:49.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.230+0000 7fa3d9c9b640 1 --2- 172.21.15.105:0/1964474437 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3d40d0340 0x7fa3d4152320 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fa3c800c370 tx=0x7fa3c800c830 comp rx=0 tx=0).stop 2024-09-21T03:25:49.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.230+0000 7fa3d9c9b640 1 -- 172.21.15.105:0/1964474437 shutdown_connections 2024-09-21T03:25:49.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.230+0000 7fa3d9c9b640 1 --2- 172.21.15.105:0/1964474437 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa3c0078b90 0x7fa3c007b0a0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:49.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.230+0000 7fa3d9c9b640 1 --2- 172.21.15.105:0/1964474437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3d41601c0 0x7fa3d41f6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:49.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.230+0000 7fa3d9c9b640 1 --2- 172.21.15.105:0/1964474437 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3d40d0340 0x7fa3d4152320 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:49.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.230+0000 7fa3d9c9b640 1 --2- 172.21.15.105:0/1964474437 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3d40cff30 0x7fa3d40b6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:49.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.230+0000 7fa3d9c9b640 1 -- 172.21.15.105:0/1964474437 >> 172.21.15.105:0/1964474437 conn(0x7fa3d4072a90 msgr2=0x7fa3d40d2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:49.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.230+0000 7fa3d9c9b640 1 -- 172.21.15.105:0/1964474437 shutdown_connections 2024-09-21T03:25:49.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.230+0000 7fa3d9c9b640 1 -- 172.21.15.105:0/1964474437 wait complete. 2024-09-21T03:25:49.250 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T03:25:49.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.373+0000 7f733aa84640 1 -- 172.21.15.105:0/2164037582 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f731c004d40 msgr2=0x7f731c005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:49.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.373+0000 7f733aa84640 1 --2- 172.21.15.105:0/2164037582 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f731c004d40 0x7f731c005150 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f732c006fd0 tx=0x7f731c005830 comp rx=0 tx=0).stop 2024-09-21T03:25:49.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.373+0000 7f7339021640 1 -- 172.21.15.105:0/2164037582 reap_dead start 2024-09-21T03:25:49.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.373+0000 7f733aa84640 1 -- 172.21.15.105:0/2164037582 shutdown_connections 2024-09-21T03:25:49.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.373+0000 7f733aa84640 1 -- 172.21.15.105:0/2164037582 >> 172.21.15.105:0/2164037582 conn(0x7f73340b3f10 msgr2=0x7f73340b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:49.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.373+0000 7f733aa84640 1 -- 172.21.15.105:0/2164037582 shutdown_connections 2024-09-21T03:25:49.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.373+0000 7f733aa84640 1 -- 172.21.15.105:0/2164037582 wait complete. 2024-09-21T03:25:49.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.374+0000 7f733aa84640 1 Processor -- start 2024-09-21T03:25:49.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.374+0000 7f733aa84640 1 -- start start 2024-09-21T03:25:49.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.376+0000 7f733aa84640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f731c004d40 0x7f7334158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:49.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.376+0000 7f733aa84640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7334159420 0x7f73341f6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:49.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.376+0000 7f733aa84640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73341f6cb0 0x7f73341e5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:49.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.376+0000 7f733aa84640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f73340cfb80 con 0x7f7334159420 2024-09-21T03:25:49.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.376+0000 7f733aa84640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f73340cfa00 con 0x7f73341f6cb0 2024-09-21T03:25:49.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.376+0000 7f733aa84640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f73340d1520 con 0x7f731c004d40 2024-09-21T03:25:49.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.376+0000 7f732bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7334159420 0x7f73341f6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:49.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.376+0000 7f732bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7334159420 0x7f73341f6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:38918/0 (socket says 172.21.15.105:38918) 2024-09-21T03:25:49.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.376+0000 7f732bfff640 1 -- 172.21.15.105:0/214820053 learned_addr learned my addr 172.21.15.105:0/214820053 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:49.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.376+0000 7f7339021640 1 --2- 172.21.15.105:0/214820053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73341f6cb0 0x7f73341e5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:49.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.376+0000 7f7338820640 1 --2- 172.21.15.105:0/214820053 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f731c004d40 0x7f7334158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:49.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.376+0000 7f732bfff640 1 -- 172.21.15.105:0/214820053 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f731c004d40 msgr2=0x7f7334158cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:49.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.376+0000 7f732bfff640 1 --2- 172.21.15.105:0/214820053 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f731c004d40 0x7f7334158cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:49.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.376+0000 7f732bfff640 1 -- 172.21.15.105:0/214820053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73341f6cb0 msgr2=0x7f73341e5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:49.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.376+0000 7f732bfff640 1 --2- 172.21.15.105:0/214820053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73341f6cb0 0x7f73341e5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:49.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.376+0000 7f732bfff640 1 -- 172.21.15.105:0/214820053 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73341591f0 con 0x7f7334159420 2024-09-21T03:25:49.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.376+0000 7f7339021640 1 --2- 172.21.15.105:0/214820053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73341f6cb0 0x7f73341e5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:25:49.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.376+0000 7f7338820640 1 --2- 172.21.15.105:0/214820053 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f731c004d40 0x7f7334158cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:25:49.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.376+0000 7f732bfff640 1 --2- 172.21.15.105:0/214820053 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7334159420 0x7f73341f6770 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f7324011b10 tx=0x7f7324009e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:49.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.377+0000 7f73297fa640 1 -- 172.21.15.105:0/214820053 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f732401e070 con 0x7f7334159420 2024-09-21T03:25:49.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.377+0000 7f73297fa640 1 -- 172.21.15.105:0/214820053 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f732400fe40 con 0x7f7334159420 2024-09-21T03:25:49.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.377+0000 7f733aa84640 1 -- 172.21.15.105:0/214820053 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73340c68b0 con 0x7f7334159420 2024-09-21T03:25:49.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.377+0000 7f73297fa640 1 -- 172.21.15.105:0/214820053 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73240042b0 con 0x7f7334159420 2024-09-21T03:25:49.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.377+0000 7f733aa84640 1 -- 172.21.15.105:0/214820053 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73341f32f0 con 0x7f7334159420 2024-09-21T03:25:49.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.378+0000 7f733aa84640 1 -- 172.21.15.105:0/214820053 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f733415c7a0 con 0x7f7334159420 2024-09-21T03:25:49.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.379+0000 7f73297fa640 1 -- 172.21.15.105:0/214820053 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7324021070 con 0x7f7334159420 2024-09-21T03:25:49.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.379+0000 7f73297fa640 1 --2- 172.21.15.105:0/214820053 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7320078b90 0x7f732007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:49.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.379+0000 7f73297fa640 1 -- 172.21.15.105:0/214820053 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5227+0+0 (secure 0 0 0) 0x7f732409bd80 con 0x7f7334159420 2024-09-21T03:25:49.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.379+0000 7f7338820640 1 --2- 172.21.15.105:0/214820053 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7320078b90 0x7f732007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:49.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.380+0000 7f7338820640 1 --2- 172.21.15.105:0/214820053 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7320078b90 0x7f732007b0a0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f7330009bc0 tx=0x7f7330005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:49.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.383+0000 7f73297fa640 1 -- 172.21.15.105:0/214820053 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7324063e30 con 0x7f7334159420 2024-09-21T03:25:49.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:49.561+0000 7f733aa84640 1 -- 172.21.15.105:0/214820053 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f73341f74c0 con 0x7f7334159420 2024-09-21T03:25:50.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.233+0000 7f73297fa640 1 -- 172.21.15.105:0/214820053 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v114) ==== 170+0+0 (secure 0 0 0) 0x7f7324068860 con 0x7f7334159420 2024-09-21T03:25:50.236 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_data' created 2024-09-21T03:25:50.239 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.236+0000 7f733aa84640 1 -- 172.21.15.105:0/214820053 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7320078b90 msgr2=0x7f732007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:50.239 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.236+0000 7f733aa84640 1 --2- 172.21.15.105:0/214820053 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7320078b90 0x7f732007b0a0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f7330009bc0 tx=0x7f7330005f90 comp rx=0 tx=0).stop 2024-09-21T03:25:50.239 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.236+0000 7f733aa84640 1 -- 172.21.15.105:0/214820053 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7334159420 msgr2=0x7f73341f6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:50.239 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.236+0000 7f733aa84640 1 --2- 172.21.15.105:0/214820053 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7334159420 0x7f73341f6770 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f7324011b10 tx=0x7f7324009e40 comp rx=0 tx=0).stop 2024-09-21T03:25:50.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.236+0000 7f733aa84640 1 -- 172.21.15.105:0/214820053 shutdown_connections 2024-09-21T03:25:50.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.236+0000 7f733aa84640 1 --2- 172.21.15.105:0/214820053 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7320078b90 0x7f732007b0a0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:50.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.236+0000 7f733aa84640 1 --2- 172.21.15.105:0/214820053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73341f6cb0 0x7f73341e5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:50.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.236+0000 7f733aa84640 1 --2- 172.21.15.105:0/214820053 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7334159420 0x7f73341f6770 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:50.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.236+0000 7f733aa84640 1 --2- 172.21.15.105:0/214820053 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f731c004d40 0x7f7334158cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:50.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.236+0000 7f733aa84640 1 -- 172.21.15.105:0/214820053 >> 172.21.15.105:0/214820053 conn(0x7f73340b3f10 msgr2=0x7f73340cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:50.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.236+0000 7f733aa84640 1 -- 172.21.15.105:0/214820053 shutdown_connections 2024-09-21T03:25:50.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.236+0000 7f733aa84640 1 -- 172.21.15.105:0/214820053 wait complete. 2024-09-21T03:25:50.260 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T03:25:50.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.373+0000 7f138fad3640 1 -- 172.21.15.105:0/645123653 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f138806f4d0 msgr2=0x7f13880d0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:50.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.373+0000 7f138fad3640 1 --2- 172.21.15.105:0/645123653 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f138806f4d0 0x7f13880d0180 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1380005fd0 tx=0x7f138002a5d0 comp rx=0 tx=0).stop 2024-09-21T03:25:50.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.373+0000 7f138fad3640 1 -- 172.21.15.105:0/645123653 shutdown_connections 2024-09-21T03:25:50.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.373+0000 7f138fad3640 1 --2- 172.21.15.105:0/645123653 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f138806f4d0 0x7f13880d0180 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:50.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.373+0000 7f138fad3640 1 --2- 172.21.15.105:0/645123653 >> v2:172.21.15.162:3300/0 conn(0x7f138815f4d0 0x7f138806ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:50.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.373+0000 7f138fad3640 1 -- 172.21.15.105:0/645123653 >> 172.21.15.105:0/645123653 conn(0x7f138806d4f0 msgr2=0x7f1388071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:50.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.373+0000 7f138fad3640 1 -- 172.21.15.105:0/645123653 shutdown_connections 2024-09-21T03:25:50.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.373+0000 7f138fad3640 1 -- 172.21.15.105:0/645123653 wait complete. 2024-09-21T03:25:50.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.375+0000 7f138fad3640 1 Processor -- start 2024-09-21T03:25:50.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.375+0000 7f138fad3640 1 -- start start 2024-09-21T03:25:50.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.376+0000 7f138fad3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f138806f4d0 0x7f13880b1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:50.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.376+0000 7f138fad3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f138815f0c0 0x7f13880b3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:50.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.376+0000 7f138fad3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f138815f4d0 0x7f13880b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:50.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.376+0000 7f138fad3640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f13880d0b00 con 0x7f138815f0c0 2024-09-21T03:25:50.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.376+0000 7f138fad3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f13880d0980 con 0x7f138815f4d0 2024-09-21T03:25:50.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.376+0000 7f138fad3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1388162030 con 0x7f138806f4d0 2024-09-21T03:25:50.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.376+0000 7f138d06e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f138815f0c0 0x7f13880b3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:50.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.376+0000 7f138d06e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f138815f0c0 0x7f13880b3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:38926/0 (socket says 172.21.15.105:38926) 2024-09-21T03:25:50.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.376+0000 7f138d06e640 1 -- 172.21.15.105:0/2463313822 learned_addr learned my addr 172.21.15.105:0/2463313822 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:50.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.376+0000 7f138e070640 1 --2- 172.21.15.105:0/2463313822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f138815f4d0 0x7f13880b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:50.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.376+0000 7f138d86f640 1 --2- 172.21.15.105:0/2463313822 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f138806f4d0 0x7f13880b1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:50.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.377+0000 7f138d06e640 1 -- 172.21.15.105:0/2463313822 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f138806f4d0 msgr2=0x7f13880b1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:50.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.377+0000 7f138d06e640 1 --2- 172.21.15.105:0/2463313822 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f138806f4d0 0x7f13880b1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:50.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.377+0000 7f138d06e640 1 -- 172.21.15.105:0/2463313822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f138815f4d0 msgr2=0x7f13880b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:50.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.377+0000 7f138d06e640 1 --2- 172.21.15.105:0/2463313822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f138815f4d0 0x7f13880b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:50.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.377+0000 7f138d06e640 1 -- 172.21.15.105:0/2463313822 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13880b6a90 con 0x7f138815f0c0 2024-09-21T03:25:50.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.377+0000 7f138d06e640 1 --2- 172.21.15.105:0/2463313822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f138815f0c0 0x7f13880b3b90 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f137800e9f0 tx=0x7f137800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:50.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.377+0000 7f137e7fc640 1 -- 172.21.15.105:0/2463313822 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f137800cd80 con 0x7f138815f0c0 2024-09-21T03:25:50.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.377+0000 7f137e7fc640 1 -- 172.21.15.105:0/2463313822 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1378004020 con 0x7f138815f0c0 2024-09-21T03:25:50.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.377+0000 7f138fad3640 1 -- 172.21.15.105:0/2463313822 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13880b16c0 con 0x7f138815f0c0 2024-09-21T03:25:50.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.377+0000 7f137e7fc640 1 -- 172.21.15.105:0/2463313822 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1378004450 con 0x7f138815f0c0 2024-09-21T03:25:50.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.377+0000 7f138fad3640 1 -- 172.21.15.105:0/2463313822 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13880b7030 con 0x7f138815f0c0 2024-09-21T03:25:50.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.378+0000 7f138fad3640 1 -- 172.21.15.105:0/2463313822 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13880b60a0 con 0x7f138815f0c0 2024-09-21T03:25:50.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.379+0000 7f137e7fc640 1 -- 172.21.15.105:0/2463313822 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f13780035f0 con 0x7f138815f0c0 2024-09-21T03:25:50.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.380+0000 7f137e7fc640 1 --2- 172.21.15.105:0/2463313822 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f136c078b90 0x7f136c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:50.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.380+0000 7f137e7fc640 1 -- 172.21.15.105:0/2463313822 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5609+0+0 (secure 0 0 0) 0x7f137809b610 con 0x7f138815f0c0 2024-09-21T03:25:50.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.380+0000 7f138d86f640 1 --2- 172.21.15.105:0/2463313822 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f136c078b90 0x7f136c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:50.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.380+0000 7f138d86f640 1 --2- 172.21.15.105:0/2463313822 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f136c078b90 0x7f136c07b0a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f138815fab0 tx=0x7f1384009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:50.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.384+0000 7f137e7fc640 1 -- 172.21.15.105:0/2463313822 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1378063580 con 0x7f138815f0c0 2024-09-21T03:25:50.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:50.595+0000 7f138fad3640 1 -- 172.21.15.105:0/2463313822 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f13880d0180 con 0x7f138815f0c0 2024-09-21T03:25:51.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.234+0000 7f137e7fc640 1 -- 172.21.15.105:0/2463313822 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v71) ==== 174+0+0 (secure 0 0 0) 0x7f1378067fb0 con 0x7f138815f0c0 2024-09-21T03:25:51.237 INFO:teuthology.orchestra.run.smithi105.stderr:new fs with metadata pool 18 and data pool 19 2024-09-21T03:25:51.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.237+0000 7f138fad3640 1 -- 172.21.15.105:0/2463313822 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f136c078b90 msgr2=0x7f136c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:51.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.237+0000 7f138fad3640 1 --2- 172.21.15.105:0/2463313822 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f136c078b90 0x7f136c07b0a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f138815fab0 tx=0x7f1384009040 comp rx=0 tx=0).stop 2024-09-21T03:25:51.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.237+0000 7f138fad3640 1 -- 172.21.15.105:0/2463313822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f138815f0c0 msgr2=0x7f13880b3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:51.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.237+0000 7f138fad3640 1 --2- 172.21.15.105:0/2463313822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f138815f0c0 0x7f13880b3b90 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f137800e9f0 tx=0x7f137800eeb0 comp rx=0 tx=0).stop 2024-09-21T03:25:51.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.237+0000 7f138fad3640 1 -- 172.21.15.105:0/2463313822 shutdown_connections 2024-09-21T03:25:51.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.237+0000 7f138fad3640 1 --2- 172.21.15.105:0/2463313822 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f136c078b90 0x7f136c07b0a0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:51.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.237+0000 7f138fad3640 1 --2- 172.21.15.105:0/2463313822 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f138815f4d0 0x7f13880b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:51.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.237+0000 7f138fad3640 1 --2- 172.21.15.105:0/2463313822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f138815f0c0 0x7f13880b3b90 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:51.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.237+0000 7f138fad3640 1 --2- 172.21.15.105:0/2463313822 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f138806f4d0 0x7f13880b1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:51.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.237+0000 7f138fad3640 1 -- 172.21.15.105:0/2463313822 >> 172.21.15.105:0/2463313822 conn(0x7f138806d4f0 msgr2=0x7f13881600a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:51.241 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.237+0000 7f138fad3640 1 -- 172.21.15.105:0/2463313822 shutdown_connections 2024-09-21T03:25:51.241 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.237+0000 7f138fad3640 1 -- 172.21.15.105:0/2463313822 wait complete. 2024-09-21T03:25:51.261 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:25:51.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.375+0000 7f1d3e551640 1 -- 172.21.15.105:0/3153803673 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d3815d840 msgr2=0x7f1d380b7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:51.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.375+0000 7f1d3e551640 1 --2- 172.21.15.105:0/3153803673 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d3815d840 0x7f1d380b7490 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f1d30005fd0 tx=0x7f1d3002aa90 comp rx=0 tx=0).stop 2024-09-21T03:25:51.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.375+0000 7f1d3e551640 1 -- 172.21.15.105:0/3153803673 shutdown_connections 2024-09-21T03:25:51.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.375+0000 7f1d3e551640 1 --2- 172.21.15.105:0/3153803673 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d3815d840 0x7f1d380b7490 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:51.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.375+0000 7f1d3e551640 1 --2- 172.21.15.105:0/3153803673 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d381570e0 0x7f1d380d1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:51.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.375+0000 7f1d3e551640 1 -- 172.21.15.105:0/3153803673 >> 172.21.15.105:0/3153803673 conn(0x7f1d3806d550 msgr2=0x7f1d38071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:51.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.375+0000 7f1d3e551640 1 -- 172.21.15.105:0/3153803673 shutdown_connections 2024-09-21T03:25:51.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.375+0000 7f1d3e551640 1 -- 172.21.15.105:0/3153803673 wait complete. 2024-09-21T03:25:51.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.377+0000 7f1d3e551640 1 Processor -- start 2024-09-21T03:25:51.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.377+0000 7f1d3e551640 1 -- start start 2024-09-21T03:25:51.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.378+0000 7f1d3e551640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d380d2460 0x7f1d380b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:51.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.378+0000 7f1d3e551640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d381570e0 0x7f1d380b3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:51.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.378+0000 7f1d3e551640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d3815d840 0x7f1d381f72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:51.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.378+0000 7f1d3e551640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1d380b7d60 con 0x7f1d380d2460 2024-09-21T03:25:51.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.378+0000 7f1d3e551640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1d380b7be0 con 0x7f1d3815d840 2024-09-21T03:25:51.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.378+0000 7f1d3e551640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1d380b7ee0 con 0x7f1d381570e0 2024-09-21T03:25:51.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.378+0000 7f1d37fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d380d2460 0x7f1d380b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:51.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.378+0000 7f1d37fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d380d2460 0x7f1d380b2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:38944/0 (socket says 172.21.15.105:38944) 2024-09-21T03:25:51.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.378+0000 7f1d37fff640 1 -- 172.21.15.105:0/3749122011 learned_addr learned my addr 172.21.15.105:0/3749122011 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:51.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.379+0000 7f1d377fe640 1 --2- 172.21.15.105:0/3749122011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d381570e0 0x7f1d380b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:51.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.379+0000 7f1d37fff640 1 -- 172.21.15.105:0/3749122011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d381570e0 msgr2=0x7f1d380b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:51.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.379+0000 7f1d37fff640 1 --2- 172.21.15.105:0/3749122011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d381570e0 0x7f1d380b3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:51.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.379+0000 7f1d37fff640 1 -- 172.21.15.105:0/3749122011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d3815d840 msgr2=0x7f1d381f72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:51.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.379+0000 7f1d37fff640 1 --2- 172.21.15.105:0/3749122011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d3815d840 0x7f1d381f72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:51.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.379+0000 7f1d37fff640 1 -- 172.21.15.105:0/3749122011 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d380c97b0 con 0x7f1d380d2460 2024-09-21T03:25:51.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.379+0000 7f1d37fff640 1 --2- 172.21.15.105:0/3749122011 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d380d2460 0x7f1d380b2df0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f1d2800e790 tx=0x7f1d2800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:51.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.379+0000 7f1d34ff9640 1 -- 172.21.15.105:0/3749122011 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d2800eea0 con 0x7f1d380d2460 2024-09-21T03:25:51.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.379+0000 7f1d34ff9640 1 -- 172.21.15.105:0/3749122011 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d2800cdb0 con 0x7f1d380d2460 2024-09-21T03:25:51.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.379+0000 7f1d3e551640 1 -- 172.21.15.105:0/3749122011 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d380cb910 con 0x7f1d380d2460 2024-09-21T03:25:51.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.379+0000 7f1d34ff9640 1 -- 172.21.15.105:0/3749122011 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d28010690 con 0x7f1d380d2460 2024-09-21T03:25:51.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.379+0000 7f1d3e551640 1 -- 172.21.15.105:0/3749122011 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d380cbed0 con 0x7f1d380d2460 2024-09-21T03:25:51.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.380+0000 7f1d3e551640 1 -- 172.21.15.105:0/3749122011 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d380d1f20 con 0x7f1d380d2460 2024-09-21T03:25:51.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.381+0000 7f1d34ff9640 1 -- 172.21.15.105:0/3749122011 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1d28010830 con 0x7f1d380d2460 2024-09-21T03:25:51.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.381+0000 7f1d34ff9640 1 --2- 172.21.15.105:0/3749122011 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1d24078b90 0x7f1d2407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:51.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.382+0000 7f1d34ff9640 1 -- 172.21.15.105:0/3749122011 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7f1d2809b700 con 0x7f1d380d2460 2024-09-21T03:25:51.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.382+0000 7f1d377fe640 1 --2- 172.21.15.105:0/3749122011 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1d24078b90 0x7f1d2407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:51.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.382+0000 7f1d377fe640 1 --2- 172.21.15.105:0/3749122011 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1d24078b90 0x7f1d2407b0a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f1d380b1b00 tx=0x7f1d2c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:51.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.386+0000 7f1d34ff9640 1 -- 172.21.15.105:0/3749122011 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1d28063bd0 con 0x7f1d380d2460 2024-09-21T03:25:51.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.562+0000 7f1d3e551640 1 -- 172.21.15.105:0/3749122011 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1d380d1930 con 0x7f1d380d2460 2024-09-21T03:25:51.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.563+0000 7f1d34ff9640 1 -- 172.21.15.105:0/3749122011 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) ==== 74+0+16824 (secure 0 0 0) 0x7f1d280634d0 con 0x7f1d380d2460 2024-09-21T03:25:51.566 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:51.566 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":115,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:25:50.598210+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:25:48.253350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-21T03:25:49.567236+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:25:51.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.565+0000 7f1d3e551640 1 -- 172.21.15.105:0/3749122011 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1d24078b90 msgr2=0x7f1d2407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:51.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.565+0000 7f1d3e551640 1 --2- 172.21.15.105:0/3749122011 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1d24078b90 0x7f1d2407b0a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f1d380b1b00 tx=0x7f1d2c009040 comp rx=0 tx=0).stop 2024-09-21T03:25:51.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.565+0000 7f1d3e551640 1 -- 172.21.15.105:0/3749122011 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d380d2460 msgr2=0x7f1d380b2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:51.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.565+0000 7f1d3e551640 1 --2- 172.21.15.105:0/3749122011 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d380d2460 0x7f1d380b2df0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f1d2800e790 tx=0x7f1d2800ec50 comp rx=0 tx=0).stop 2024-09-21T03:25:51.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.565+0000 7f1d3e551640 1 -- 172.21.15.105:0/3749122011 shutdown_connections 2024-09-21T03:25:51.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.565+0000 7f1d3e551640 1 --2- 172.21.15.105:0/3749122011 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1d24078b90 0x7f1d2407b0a0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:51.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.565+0000 7f1d3e551640 1 --2- 172.21.15.105:0/3749122011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d3815d840 0x7f1d381f72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:51.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.565+0000 7f1d3e551640 1 --2- 172.21.15.105:0/3749122011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d381570e0 0x7f1d380b3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:51.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.565+0000 7f1d3e551640 1 --2- 172.21.15.105:0/3749122011 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d380d2460 0x7f1d380b2df0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:51.568 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.565+0000 7f1d3e551640 1 -- 172.21.15.105:0/3749122011 >> 172.21.15.105:0/3749122011 conn(0x7f1d3806d550 msgr2=0x7f1d380c7e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:51.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.565+0000 7f1d3e551640 1 -- 172.21.15.105:0/3749122011 shutdown_connections 2024-09-21T03:25:51.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.565+0000 7f1d3e551640 1 -- 172.21.15.105:0/3749122011 wait complete. 2024-09-21T03:25:51.579 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:25:51.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.688+0000 7fa72d4b2640 1 -- 172.21.15.105:0/3119534396 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7280b9b60 msgr2=0x7fa7280d4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:51.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.688+0000 7fa72d4b2640 1 --2- 172.21.15.105:0/3119534396 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7280b9b60 0x7fa7280d4d80 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fa718009820 tx=0x7fa71802a440 comp rx=0 tx=0).stop 2024-09-21T03:25:51.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.688+0000 7fa72d4b2640 1 -- 172.21.15.105:0/3119534396 shutdown_connections 2024-09-21T03:25:51.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.688+0000 7fa72d4b2640 1 --2- 172.21.15.105:0/3119534396 >> v2:172.21.15.162:3300/0 conn(0x7fa7280b66b0 0x7fa72806eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:51.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.688+0000 7fa72d4b2640 1 --2- 172.21.15.105:0/3119534396 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7280b9b60 0x7fa7280d4d80 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:51.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.688+0000 7fa72d4b2640 1 -- 172.21.15.105:0/3119534396 >> 172.21.15.105:0/3119534396 conn(0x7fa72809d7f0 msgr2=0x7fa7280d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:51.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.688+0000 7fa72d4b2640 1 -- 172.21.15.105:0/3119534396 shutdown_connections 2024-09-21T03:25:51.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.688+0000 7fa72d4b2640 1 -- 172.21.15.105:0/3119534396 wait complete. 2024-09-21T03:25:51.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.690+0000 7fa72d4b2640 1 Processor -- start 2024-09-21T03:25:51.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.690+0000 7fa72d4b2640 1 -- start start 2024-09-21T03:25:51.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.691+0000 7fa72d4b2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7280b9b60 0x7fa7281f6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:51.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.691+0000 7fa72d4b2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7280cf540 0x7fa7280c9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:51.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.691+0000 7fa72d4b2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7281f4da0 0x7fa7281460f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:51.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.691+0000 7fa72d4b2640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa72806f600 con 0x7fa7281f4da0 2024-09-21T03:25:51.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.691+0000 7fa72d4b2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa72806f480 con 0x7fa7280cf540 2024-09-21T03:25:51.699 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.691+0000 7fa72d4b2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa72806f780 con 0x7fa7280b9b60 2024-09-21T03:25:51.699 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.691+0000 7fa7277fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7281f4da0 0x7fa7281460f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:51.699 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.691+0000 7fa7277fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7281f4da0 0x7fa7281460f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:37772/0 (socket says 172.21.15.105:37772) 2024-09-21T03:25:51.699 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.691+0000 7fa7277fe640 1 -- 172.21.15.105:0/222533947 learned_addr learned my addr 172.21.15.105:0/222533947 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:51.699 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.691+0000 7fa726ffd640 1 --2- 172.21.15.105:0/222533947 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7280b9b60 0x7fa7281f6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:51.699 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.691+0000 7fa71e7fc640 1 --2- 172.21.15.105:0/222533947 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7280cf540 0x7fa7280c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:51.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.692+0000 7fa7277fe640 1 -- 172.21.15.105:0/222533947 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7280b9b60 msgr2=0x7fa7281f6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:51.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.692+0000 7fa7277fe640 1 --2- 172.21.15.105:0/222533947 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7280b9b60 0x7fa7281f6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:51.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.692+0000 7fa7277fe640 1 -- 172.21.15.105:0/222533947 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7280cf540 msgr2=0x7fa7280c9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:51.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.692+0000 7fa7277fe640 1 --2- 172.21.15.105:0/222533947 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7280cf540 0x7fa7280c9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:51.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.692+0000 7fa7277fe640 1 -- 172.21.15.105:0/222533947 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7281f6550 con 0x7fa7281f4da0 2024-09-21T03:25:51.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.692+0000 7fa71e7fc640 1 --2- 172.21.15.105:0/222533947 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7280cf540 0x7fa7280c9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:25:51.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.692+0000 7fa726ffd640 1 --2- 172.21.15.105:0/222533947 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7280b9b60 0x7fa7281f6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:25:51.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.692+0000 7fa7277fe640 1 --2- 172.21.15.105:0/222533947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7281f4da0 0x7fa7281460f0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fa72000e990 tx=0x7fa72000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:51.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.692+0000 7fa71ffff640 1 -- 172.21.15.105:0/222533947 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa720004d20 con 0x7fa7281f4da0 2024-09-21T03:25:51.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.692+0000 7fa71ffff640 1 -- 172.21.15.105:0/222533947 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa72000caa0 con 0x7fa7281f4da0 2024-09-21T03:25:51.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.692+0000 7fa72d4b2640 1 -- 172.21.15.105:0/222533947 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7280c8360 con 0x7fa7281f4da0 2024-09-21T03:25:51.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.692+0000 7fa71ffff640 1 -- 172.21.15.105:0/222533947 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa720005020 con 0x7fa7281f4da0 2024-09-21T03:25:51.702 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.692+0000 7fa72d4b2640 1 -- 172.21.15.105:0/222533947 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7280c8920 con 0x7fa7281f4da0 2024-09-21T03:25:51.702 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.693+0000 7fa72d4b2640 1 -- 172.21.15.105:0/222533947 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa72806fcc0 con 0x7fa7281f4da0 2024-09-21T03:25:51.702 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.694+0000 7fa71ffff640 1 -- 172.21.15.105:0/222533947 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa7200051c0 con 0x7fa7281f4da0 2024-09-21T03:25:51.702 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.694+0000 7fa71ffff640 1 --2- 172.21.15.105:0/222533947 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa708078b90 0x7fa70807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:51.702 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.694+0000 7fa71ffff640 1 -- 172.21.15.105:0/222533947 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7fa72009b660 con 0x7fa7281f4da0 2024-09-21T03:25:51.702 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.694+0000 7fa726ffd640 1 --2- 172.21.15.105:0/222533947 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa708078b90 0x7fa70807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:51.703 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.695+0000 7fa726ffd640 1 --2- 172.21.15.105:0/222533947 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa708078b90 0x7fa70807b0a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fa718034000 tx=0x7fa718004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:51.703 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.699+0000 7fa71ffff640 1 -- 172.21.15.105:0/222533947 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa7281f6550 con 0x7fa7281f4da0 2024-09-21T03:25:51.879 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.877+0000 7fa72d4b2640 1 -- 172.21.15.105:0/222533947 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa7280d1c20 con 0x7fa7281f4da0 2024-09-21T03:25:51.881 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.878+0000 7fa71ffff640 1 -- 172.21.15.105:0/222533947 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) ==== 74+0+16824 (secure 0 0 0) 0x7fa720016030 con 0x7fa7281f4da0 2024-09-21T03:25:51.881 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:51.881 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":115,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:25:50.598210+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:25:48.253350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-21T03:25:49.567236+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:25:51.883 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.881+0000 7fa72d4b2640 1 -- 172.21.15.105:0/222533947 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa708078b90 msgr2=0x7fa70807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:51.883 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.881+0000 7fa72d4b2640 1 --2- 172.21.15.105:0/222533947 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa708078b90 0x7fa70807b0a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fa718034000 tx=0x7fa718004730 comp rx=0 tx=0).stop 2024-09-21T03:25:51.883 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.881+0000 7fa72d4b2640 1 -- 172.21.15.105:0/222533947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7281f4da0 msgr2=0x7fa7281460f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:51.883 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.881+0000 7fa72d4b2640 1 --2- 172.21.15.105:0/222533947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7281f4da0 0x7fa7281460f0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fa72000e990 tx=0x7fa72000ee50 comp rx=0 tx=0).stop 2024-09-21T03:25:51.884 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.881+0000 7fa72d4b2640 1 -- 172.21.15.105:0/222533947 shutdown_connections 2024-09-21T03:25:51.884 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.881+0000 7fa72d4b2640 1 --2- 172.21.15.105:0/222533947 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa708078b90 0x7fa70807b0a0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:51.884 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.881+0000 7fa72d4b2640 1 --2- 172.21.15.105:0/222533947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7281f4da0 0x7fa7281460f0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:51.884 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.881+0000 7fa72d4b2640 1 --2- 172.21.15.105:0/222533947 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7280cf540 0x7fa7280c9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:51.884 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.881+0000 7fa72d4b2640 1 --2- 172.21.15.105:0/222533947 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7280b9b60 0x7fa7281f6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:51.884 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.881+0000 7fa72d4b2640 1 -- 172.21.15.105:0/222533947 >> 172.21.15.105:0/222533947 conn(0x7fa72809d7f0 msgr2=0x7fa7280b63d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:51.884 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.881+0000 7fa72d4b2640 1 -- 172.21.15.105:0/222533947 shutdown_connections 2024-09-21T03:25:51.884 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:51.881+0000 7fa72d4b2640 1 -- 172.21.15.105:0/222533947 wait complete. 2024-09-21T03:25:51.895 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T03:25:52.011 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.008+0000 7fc4cf48b640 1 -- 172.21.15.105:0/2320022847 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4b4003a00 msgr2=0x7fc4b4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:52.011 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.008+0000 7fc4cf48b640 1 --2- 172.21.15.105:0/2320022847 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4b4003a00 0x7fc4b4003e70 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4009b50 tx=0x7fc4b4005830 comp rx=0 tx=0).stop 2024-09-21T03:25:52.011 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.008+0000 7fc4cda28640 1 -- 172.21.15.105:0/2320022847 reap_dead start 2024-09-21T03:25:52.011 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.008+0000 7fc4cf48b640 1 -- 172.21.15.105:0/2320022847 shutdown_connections 2024-09-21T03:25:52.011 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.008+0000 7fc4cf48b640 1 -- 172.21.15.105:0/2320022847 >> 172.21.15.105:0/2320022847 conn(0x7fc4c80d15f0 msgr2=0x7fc4c8073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:52.011 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.008+0000 7fc4cf48b640 1 -- 172.21.15.105:0/2320022847 shutdown_connections 2024-09-21T03:25:52.012 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.008+0000 7fc4cf48b640 1 -- 172.21.15.105:0/2320022847 wait complete. 2024-09-21T03:25:52.012 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.010+0000 7fc4cf48b640 1 Processor -- start 2024-09-21T03:25:52.012 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.010+0000 7fc4cf48b640 1 -- start start 2024-09-21T03:25:52.015 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.011+0000 7fc4cf48b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4b4003a00 0x7fc4c81f26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:52.015 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.011+0000 7fc4cf48b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4c80cc130 0x7fc4c815d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:52.015 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.011+0000 7fc4cf48b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4c80cc540 0x7fc4c815db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:52.015 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.011+0000 7fc4cf48b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c80746e0 con 0x7fc4c80cc540 2024-09-21T03:25:52.015 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.011+0000 7fc4cf48b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c8074560 con 0x7fc4b4003a00 2024-09-21T03:25:52.015 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.011+0000 7fc4cf48b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc4c8142680 con 0x7fc4c80cc130 2024-09-21T03:25:52.015 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.011+0000 7fc4cda28640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4c80cc540 0x7fc4c815db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:52.015 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.011+0000 7fc4cda28640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4c80cc540 0x7fc4c815db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:37794/0 (socket says 172.21.15.105:37794) 2024-09-21T03:25:52.016 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.011+0000 7fc4cda28640 1 -- 172.21.15.105:0/3308106886 learned_addr learned my addr 172.21.15.105:0/3308106886 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:52.016 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.011+0000 7fc4cd227640 1 --2- 172.21.15.105:0/3308106886 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4b4003a00 0x7fc4c81f26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:52.016 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.011+0000 7fc4cca26640 1 --2- 172.21.15.105:0/3308106886 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4c80cc130 0x7fc4c815d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:52.016 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.011+0000 7fc4cda28640 1 -- 172.21.15.105:0/3308106886 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4c80cc130 msgr2=0x7fc4c815d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:52.016 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.011+0000 7fc4cda28640 1 --2- 172.21.15.105:0/3308106886 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4c80cc130 0x7fc4c815d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:52.016 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.012+0000 7fc4cda28640 1 -- 172.21.15.105:0/3308106886 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4b4003a00 msgr2=0x7fc4c81f26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:52.016 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.012+0000 7fc4cda28640 1 --2- 172.21.15.105:0/3308106886 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4b4003a00 0x7fc4c81f26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:52.016 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.012+0000 7fc4cda28640 1 -- 172.21.15.105:0/3308106886 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4c81f7330 con 0x7fc4c80cc540 2024-09-21T03:25:52.016 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.012+0000 7fc4cca26640 1 --2- 172.21.15.105:0/3308106886 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4c80cc130 0x7fc4c815d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:25:52.016 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.012+0000 7fc4cda28640 1 --2- 172.21.15.105:0/3308106886 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4c80cc540 0x7fc4c815db40 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fc4c815f160 tx=0x7fc4c000f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:52.016 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.012+0000 7fc4bdffb640 1 -- 172.21.15.105:0/3308106886 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c0004b20 con 0x7fc4c80cc540 2024-09-21T03:25:52.016 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.012+0000 7fc4bdffb640 1 -- 172.21.15.105:0/3308106886 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc4c0004cc0 con 0x7fc4c80cc540 2024-09-21T03:25:52.016 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.012+0000 7fc4bdffb640 1 -- 172.21.15.105:0/3308106886 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c0003bd0 con 0x7fc4c80cc540 2024-09-21T03:25:52.017 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.012+0000 7fc4cf48b640 1 -- 172.21.15.105:0/3308106886 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4c80ccc80 con 0x7fc4c80cc540 2024-09-21T03:25:52.017 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.012+0000 7fc4cf48b640 1 -- 172.21.15.105:0/3308106886 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4c8151c90 con 0x7fc4c80cc540 2024-09-21T03:25:52.017 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.013+0000 7fc4cf48b640 1 -- 172.21.15.105:0/3308106886 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4c80b5680 con 0x7fc4c80cc540 2024-09-21T03:25:52.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.014+0000 7fc4bdffb640 1 -- 172.21.15.105:0/3308106886 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc4c0004030 con 0x7fc4c80cc540 2024-09-21T03:25:52.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.014+0000 7fc4bdffb640 1 --2- 172.21.15.105:0/3308106886 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc4ac078b90 0x7fc4ac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:52.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.014+0000 7fc4bdffb640 1 -- 172.21.15.105:0/3308106886 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7fc4c009b200 con 0x7fc4c80cc540 2024-09-21T03:25:52.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.014+0000 7fc4cd227640 1 --2- 172.21.15.105:0/3308106886 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc4ac078b90 0x7fc4ac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:52.018 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.015+0000 7fc4cd227640 1 --2- 172.21.15.105:0/3308106886 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc4ac078b90 0x7fc4ac07b0a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4035000 tx=0x7fc4c402d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:52.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.019+0000 7fc4bdffb640 1 -- 172.21.15.105:0/3308106886 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc4c0062ff0 con 0x7fc4c80cc540 2024-09-21T03:25:52.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.232+0000 7fc4cf48b640 1 -- 172.21.15.105:0/3308106886 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc4c80cca10 con 0x7fc4c80cc540 2024-09-21T03:25:52.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.257+0000 7fc4bdffb640 1 -- 172.21.15.105:0/3308106886 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v72) ==== 118+0+0 (secure 0 0 0) 0x7fc4c009b020 con 0x7fc4c80cc540 2024-09-21T03:25:52.262 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.259+0000 7fc4cf48b640 1 -- 172.21.15.105:0/3308106886 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc4ac078b90 msgr2=0x7fc4ac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:52.262 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.259+0000 7fc4cf48b640 1 --2- 172.21.15.105:0/3308106886 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc4ac078b90 0x7fc4ac07b0a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4035000 tx=0x7fc4c402d040 comp rx=0 tx=0).stop 2024-09-21T03:25:52.262 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.259+0000 7fc4cf48b640 1 -- 172.21.15.105:0/3308106886 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4c80cc540 msgr2=0x7fc4c815db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:52.262 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.259+0000 7fc4cf48b640 1 --2- 172.21.15.105:0/3308106886 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4c80cc540 0x7fc4c815db40 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fc4c815f160 tx=0x7fc4c000f3c0 comp rx=0 tx=0).stop 2024-09-21T03:25:52.262 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.259+0000 7fc4cf48b640 1 -- 172.21.15.105:0/3308106886 shutdown_connections 2024-09-21T03:25:52.262 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.259+0000 7fc4cf48b640 1 --2- 172.21.15.105:0/3308106886 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc4ac078b90 0x7fc4ac07b0a0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:52.262 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.259+0000 7fc4cf48b640 1 --2- 172.21.15.105:0/3308106886 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4c80cc540 0x7fc4c815db40 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:52.262 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.259+0000 7fc4cf48b640 1 --2- 172.21.15.105:0/3308106886 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4c80cc130 0x7fc4c815d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:52.263 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.259+0000 7fc4cf48b640 1 --2- 172.21.15.105:0/3308106886 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4b4003a00 0x7fc4c81f26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:52.263 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.259+0000 7fc4cf48b640 1 -- 172.21.15.105:0/3308106886 >> 172.21.15.105:0/3308106886 conn(0x7fc4c80d15f0 msgr2=0x7fc4c815bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:52.263 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.259+0000 7fc4cf48b640 1 -- 172.21.15.105:0/3308106886 shutdown_connections 2024-09-21T03:25:52.263 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.259+0000 7fc4cf48b640 1 -- 172.21.15.105:0/3308106886 wait complete. 2024-09-21T03:25:52.273 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T03:25:52.273 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T03:25:52.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.387+0000 7ff91f3a1640 1 -- 172.21.15.105:0/3515932979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff918156f40 msgr2=0x7ff91815d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:52.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.387+0000 7ff91f3a1640 1 --2- 172.21.15.105:0/3515932979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff918156f40 0x7ff91815d8f0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7ff918074b10 tx=0x7ff90802a540 comp rx=0 tx=0).stop 2024-09-21T03:25:52.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.387+0000 7ff91f3a1640 1 -- 172.21.15.105:0/3515932979 shutdown_connections 2024-09-21T03:25:52.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.387+0000 7ff91f3a1640 1 --2- 172.21.15.105:0/3515932979 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9180cecf0 0x7ff9180cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:52.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.387+0000 7ff91f3a1640 1 --2- 172.21.15.105:0/3515932979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff918156f40 0x7ff91815d8f0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:52.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.387+0000 7ff91f3a1640 1 --2- 172.21.15.105:0/3515932979 >> v2:172.21.15.162:3300/0 conn(0x7ff9180cd3a0 0x7ff918160f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:52.390 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.387+0000 7ff91f3a1640 1 -- 172.21.15.105:0/3515932979 >> 172.21.15.105:0/3515932979 conn(0x7ff91806d550 msgr2=0x7ff918071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:52.390 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.387+0000 7ff91f3a1640 1 -- 172.21.15.105:0/3515932979 shutdown_connections 2024-09-21T03:25:52.390 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.387+0000 7ff91f3a1640 1 -- 172.21.15.105:0/3515932979 wait complete. 2024-09-21T03:25:52.390 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.389+0000 7ff91f3a1640 1 Processor -- start 2024-09-21T03:25:52.390 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.389+0000 7ff91f3a1640 1 -- start start 2024-09-21T03:25:52.393 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.390+0000 7ff91f3a1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9180cd3a0 0x7ff9181f68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:52.393 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.390+0000 7ff91f3a1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9180cecf0 0x7ff91815b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:52.393 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.390+0000 7ff91f3a1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff918156f40 0x7ff91815bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:52.394 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.390+0000 7ff91f3a1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff9180d0750 con 0x7ff9180cd3a0 2024-09-21T03:25:52.394 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.390+0000 7ff91f3a1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff9180d05d0 con 0x7ff918156f40 2024-09-21T03:25:52.394 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.390+0000 7ff91f3a1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff9180d08d0 con 0x7ff9180cecf0 2024-09-21T03:25:52.394 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.390+0000 7ff91d13d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9180cd3a0 0x7ff9181f68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:52.394 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.390+0000 7ff91d13d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9180cd3a0 0x7ff9181f68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:37808/0 (socket says 172.21.15.105:37808) 2024-09-21T03:25:52.394 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.390+0000 7ff91d13d640 1 -- 172.21.15.105:0/218569709 learned_addr learned my addr 172.21.15.105:0/218569709 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:52.394 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.391+0000 7ff91d93e640 1 --2- 172.21.15.105:0/218569709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff918156f40 0x7ff91815bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:52.394 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.391+0000 7ff91c93c640 1 --2- 172.21.15.105:0/218569709 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9180cecf0 0x7ff91815b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:52.394 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.391+0000 7ff91d13d640 1 -- 172.21.15.105:0/218569709 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9180cecf0 msgr2=0x7ff91815b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:52.394 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.391+0000 7ff91d13d640 1 --2- 172.21.15.105:0/218569709 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9180cecf0 0x7ff91815b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:52.394 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.391+0000 7ff91d13d640 1 -- 172.21.15.105:0/218569709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff918156f40 msgr2=0x7ff91815bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:52.394 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.391+0000 7ff91d13d640 1 --2- 172.21.15.105:0/218569709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff918156f40 0x7ff91815bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:52.394 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.391+0000 7ff91d13d640 1 -- 172.21.15.105:0/218569709 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff91806e670 con 0x7ff9180cd3a0 2024-09-21T03:25:52.394 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.391+0000 7ff91d13d640 1 --2- 172.21.15.105:0/218569709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9180cd3a0 0x7ff9181f68d0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7ff91400d720 tx=0x7ff91400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:52.395 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.391+0000 7ff90dffb640 1 -- 172.21.15.105:0/218569709 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff914017070 con 0x7ff9180cd3a0 2024-09-21T03:25:52.395 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.391+0000 7ff90dffb640 1 -- 172.21.15.105:0/218569709 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff914009ab0 con 0x7ff9180cd3a0 2024-09-21T03:25:52.395 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.391+0000 7ff91f3a1640 1 -- 172.21.15.105:0/218569709 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9180cc6c0 con 0x7ff9180cd3a0 2024-09-21T03:25:52.395 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.391+0000 7ff90dffb640 1 -- 172.21.15.105:0/218569709 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff914010460 con 0x7ff9180cd3a0 2024-09-21T03:25:52.395 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.391+0000 7ff91f3a1640 1 -- 172.21.15.105:0/218569709 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9180ca3d0 con 0x7ff9180cd3a0 2024-09-21T03:25:52.395 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.392+0000 7ff91f3a1640 1 -- 172.21.15.105:0/218569709 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9180d0e40 con 0x7ff9180cd3a0 2024-09-21T03:25:52.396 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.393+0000 7ff90dffb640 1 -- 172.21.15.105:0/218569709 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff91401a070 con 0x7ff9180cd3a0 2024-09-21T03:25:52.396 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.394+0000 7ff90dffb640 1 --2- 172.21.15.105:0/218569709 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff8fc078bc0 0x7ff8fc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:52.396 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.394+0000 7ff90dffb640 1 -- 172.21.15.105:0/218569709 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7ff91409b170 con 0x7ff9180cd3a0 2024-09-21T03:25:52.396 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.394+0000 7ff91c93c640 1 --2- 172.21.15.105:0/218569709 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff8fc078bc0 0x7ff8fc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:52.396 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.395+0000 7ff91c93c640 1 --2- 172.21.15.105:0/218569709 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff8fc078bc0 0x7ff8fc07b0d0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff908033000 tx=0x7ff908004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:52.399 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.397+0000 7ff90dffb640 1 -- 172.21.15.105:0/218569709 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff914063720 con 0x7ff9180cd3a0 2024-09-21T03:25:52.615 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:52.612+0000 7ff91f3a1640 1 -- 172.21.15.105:0/218569709 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ff9180cf3e0 con 0x7ff9180cd3a0 2024-09-21T03:25:53.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.259+0000 7ff90dffb640 1 -- 172.21.15.105:0/218569709 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v73) ==== 122+0+0 (secure 0 0 0) 0x7ff914063020 con 0x7ff9180cd3a0 2024-09-21T03:25:53.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.263+0000 7ff91f3a1640 1 -- 172.21.15.105:0/218569709 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff8fc078bc0 msgr2=0x7ff8fc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:53.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.263+0000 7ff91f3a1640 1 --2- 172.21.15.105:0/218569709 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff8fc078bc0 0x7ff8fc07b0d0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff908033000 tx=0x7ff908004730 comp rx=0 tx=0).stop 2024-09-21T03:25:53.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.263+0000 7ff91f3a1640 1 -- 172.21.15.105:0/218569709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9180cd3a0 msgr2=0x7ff9181f68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:53.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.263+0000 7ff91f3a1640 1 --2- 172.21.15.105:0/218569709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9180cd3a0 0x7ff9181f68d0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7ff91400d720 tx=0x7ff91400dbe0 comp rx=0 tx=0).stop 2024-09-21T03:25:53.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.263+0000 7ff91f3a1640 1 -- 172.21.15.105:0/218569709 shutdown_connections 2024-09-21T03:25:53.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.263+0000 7ff91f3a1640 1 --2- 172.21.15.105:0/218569709 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff8fc078bc0 0x7ff8fc07b0d0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:53.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.263+0000 7ff91f3a1640 1 --2- 172.21.15.105:0/218569709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff918156f40 0x7ff91815bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:53.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.263+0000 7ff91f3a1640 1 --2- 172.21.15.105:0/218569709 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9180cecf0 0x7ff91815b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:53.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.263+0000 7ff91f3a1640 1 --2- 172.21.15.105:0/218569709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9180cd3a0 0x7ff9181f68d0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:53.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.263+0000 7ff91f3a1640 1 -- 172.21.15.105:0/218569709 >> 172.21.15.105:0/218569709 conn(0x7ff91806d550 msgr2=0x7ff9180b64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:53.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.263+0000 7ff91f3a1640 1 -- 172.21.15.105:0/218569709 shutdown_connections 2024-09-21T03:25:53.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.263+0000 7ff91f3a1640 1 -- 172.21.15.105:0/218569709 wait complete. 2024-09-21T03:25:53.279 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T03:25:53.279 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:25:53.396 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.394+0000 7fa549c8b640 1 -- 172.21.15.105:0/2777049553 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa530003a00 msgr2=0x7fa530003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:53.396 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.394+0000 7fa549c8b640 1 --2- 172.21.15.105:0/2777049553 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa530003a00 0x7fa530003e70 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fa52c00c260 tx=0x7fa530005830 comp rx=0 tx=0).stop 2024-09-21T03:25:53.396 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.394+0000 7fa543fff640 1 -- 172.21.15.105:0/2777049553 reap_dead start 2024-09-21T03:25:53.396 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.394+0000 7fa549c8b640 1 -- 172.21.15.105:0/2777049553 shutdown_connections 2024-09-21T03:25:53.396 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.394+0000 7fa549c8b640 1 -- 172.21.15.105:0/2777049553 >> 172.21.15.105:0/2777049553 conn(0x7fa54406d4f0 msgr2=0x7fa544071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:53.396 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.394+0000 7fa549c8b640 1 -- 172.21.15.105:0/2777049553 shutdown_connections 2024-09-21T03:25:53.396 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.394+0000 7fa549c8b640 1 -- 172.21.15.105:0/2777049553 wait complete. 2024-09-21T03:25:53.397 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.396+0000 7fa549c8b640 1 Processor -- start 2024-09-21T03:25:53.397 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.396+0000 7fa549c8b640 1 -- start start 2024-09-21T03:25:53.400 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.397+0000 7fa549c8b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa530003a00 0x7fa5441507c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:53.400 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.397+0000 7fa549c8b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa544151120 0x7fa544151530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:53.400 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.397+0000 7fa549c8b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa544151a70 0x7fa5440c9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:53.400 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.397+0000 7fa549c8b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa5440d0e50 con 0x7fa544151a70 2024-09-21T03:25:53.400 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.397+0000 7fa549c8b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa5440d0cd0 con 0x7fa530003a00 2024-09-21T03:25:53.400 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.397+0000 7fa549c8b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa5440d0fd0 con 0x7fa544151120 2024-09-21T03:25:53.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.397+0000 7fa543fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa544151a70 0x7fa5440c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:53.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.397+0000 7fa543fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa544151a70 0x7fa5440c9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:37818/0 (socket says 172.21.15.105:37818) 2024-09-21T03:25:53.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.397+0000 7fa543fff640 1 -- 172.21.15.105:0/2254359806 learned_addr learned my addr 172.21.15.105:0/2254359806 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:53.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.397+0000 7fa5437fe640 1 --2- 172.21.15.105:0/2254359806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa530003a00 0x7fa5441507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:53.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.397+0000 7fa542ffd640 1 --2- 172.21.15.105:0/2254359806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa544151120 0x7fa544151530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:53.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.398+0000 7fa543fff640 1 -- 172.21.15.105:0/2254359806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa544151120 msgr2=0x7fa544151530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:53.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.398+0000 7fa543fff640 1 --2- 172.21.15.105:0/2254359806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa544151120 0x7fa544151530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:53.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.398+0000 7fa543fff640 1 -- 172.21.15.105:0/2254359806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa530003a00 msgr2=0x7fa5441507c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:53.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.398+0000 7fa543fff640 1 --2- 172.21.15.105:0/2254359806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa530003a00 0x7fa5441507c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:53.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.398+0000 7fa543fff640 1 -- 172.21.15.105:0/2254359806 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5440cba20 con 0x7fa544151a70 2024-09-21T03:25:53.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.398+0000 7fa543fff640 1 --2- 172.21.15.105:0/2254359806 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa544151a70 0x7fa5440c9530 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fa53c005fd0 tx=0x7fa53c011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:53.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.398+0000 7fa53bfff640 1 -- 172.21.15.105:0/2254359806 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53c004b20 con 0x7fa544151a70 2024-09-21T03:25:53.401 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.398+0000 7fa53bfff640 1 -- 172.21.15.105:0/2254359806 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa53c004cc0 con 0x7fa544151a70 2024-09-21T03:25:53.402 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.398+0000 7fa53bfff640 1 -- 172.21.15.105:0/2254359806 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53c003bd0 con 0x7fa544151a70 2024-09-21T03:25:53.402 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.398+0000 7fa549c8b640 1 -- 172.21.15.105:0/2254359806 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5440cbd00 con 0x7fa544151a70 2024-09-21T03:25:53.402 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.398+0000 7fa549c8b640 1 -- 172.21.15.105:0/2254359806 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa544156050 con 0x7fa544151a70 2024-09-21T03:25:53.402 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.399+0000 7fa549c8b640 1 -- 172.21.15.105:0/2254359806 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa544161160 con 0x7fa544151a70 2024-09-21T03:25:53.402 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.400+0000 7fa53bfff640 1 -- 172.21.15.105:0/2254359806 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa53c004030 con 0x7fa544151a70 2024-09-21T03:25:53.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.401+0000 7fa53bfff640 1 --2- 172.21.15.105:0/2254359806 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa524078b90 0x7fa52407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:53.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.401+0000 7fa53bfff640 1 -- 172.21.15.105:0/2254359806 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7fa53c09bd40 con 0x7fa544151a70 2024-09-21T03:25:53.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.401+0000 7fa5437fe640 1 --2- 172.21.15.105:0/2254359806 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa524078b90 0x7fa52407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:53.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.402+0000 7fa5437fe640 1 --2- 172.21.15.105:0/2254359806 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa524078b90 0x7fa52407b0a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fa52c033000 tx=0x7fa52c038040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:53.406 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.405+0000 7fa53bfff640 1 -- 172.21.15.105:0/2254359806 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa544161160 con 0x7fa544151a70 2024-09-21T03:25:53.616 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.614+0000 7fa549c8b640 1 -- 172.21.15.105:0/2254359806 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa5440cb7b0 con 0x7fa544151a70 2024-09-21T03:25:53.617 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.615+0000 7fa53bfff640 1 -- 172.21.15.105:0/2254359806 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) ==== 94+0+5237 (secure 0 0 0) 0x7fa53c0642a0 con 0x7fa544151a70 2024-09-21T03:25:53.617 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:53.617 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":73,"btime":"2024-09-21T03:25:53:258473+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6233,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/2073653576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2073653576},{"type":"v1","addr":"172.21.15.162:6837","nonce":2073653576}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":70},{"gid":6850,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2714893724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2714893724},{"type":"v1","addr":"172.21.15.162:6836","nonce":2714893724}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":70},{"gid":7590,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/2972986125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2972986125},{"type":"v1","addr":"172.21.15.105:6834","nonce":2972986125}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":70}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:25:50.598171+0000","modified":"2024-09-21T03:25:52.613928+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7593":{"gid":7593,"name":"a","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/3941149960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":3941149960},{"type":"v1","addr":"172.21.15.105:6835","nonce":3941149960}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7593,"qdb_cluster":[7593]},"id":9}]} 2024-09-21T03:25:53.617 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 73 2024-09-21T03:25:53.619 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.617+0000 7fa549c8b640 1 -- 172.21.15.105:0/2254359806 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa524078b90 msgr2=0x7fa52407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:53.619 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.617+0000 7fa549c8b640 1 --2- 172.21.15.105:0/2254359806 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa524078b90 0x7fa52407b0a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fa52c033000 tx=0x7fa52c038040 comp rx=0 tx=0).stop 2024-09-21T03:25:53.619 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.617+0000 7fa549c8b640 1 -- 172.21.15.105:0/2254359806 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa544151a70 msgr2=0x7fa5440c9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:53.619 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.617+0000 7fa549c8b640 1 --2- 172.21.15.105:0/2254359806 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa544151a70 0x7fa5440c9530 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fa53c005fd0 tx=0x7fa53c011ef0 comp rx=0 tx=0).stop 2024-09-21T03:25:53.620 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.617+0000 7fa549c8b640 1 -- 172.21.15.105:0/2254359806 shutdown_connections 2024-09-21T03:25:53.620 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.617+0000 7fa549c8b640 1 --2- 172.21.15.105:0/2254359806 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa524078b90 0x7fa52407b0a0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:53.620 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.617+0000 7fa549c8b640 1 --2- 172.21.15.105:0/2254359806 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa544151a70 0x7fa5440c9530 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:53.620 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.617+0000 7fa549c8b640 1 --2- 172.21.15.105:0/2254359806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa544151120 0x7fa544151530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:53.620 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.617+0000 7fa549c8b640 1 --2- 172.21.15.105:0/2254359806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa530003a00 0x7fa5441507c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:53.620 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.617+0000 7fa549c8b640 1 -- 172.21.15.105:0/2254359806 >> 172.21.15.105:0/2254359806 conn(0x7fa54406d4f0 msgr2=0x7fa5440b3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:53.620 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.617+0000 7fa549c8b640 1 -- 172.21.15.105:0/2254359806 shutdown_connections 2024-09-21T03:25:53.620 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.617+0000 7fa549c8b640 1 -- 172.21.15.105:0/2254359806 wait complete. 2024-09-21T03:25:53.631 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:25:53.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.741+0000 7fd070827640 1 -- 172.21.15.105:0/2444051462 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd06c0cf270 msgr2=0x7fd06c072850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:53.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.741+0000 7fd070827640 1 --2- 172.21.15.105:0/2444051462 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd06c0cf270 0x7fd06c072850 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fd06c0747a0 tx=0x7fd06402a4d0 comp rx=0 tx=0).stop 2024-09-21T03:25:53.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.741+0000 7fd070827640 1 -- 172.21.15.105:0/2444051462 shutdown_connections 2024-09-21T03:25:53.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.741+0000 7fd070827640 1 --2- 172.21.15.105:0/2444051462 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd06c0cf270 0x7fd06c072850 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:53.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.741+0000 7fd070827640 1 --2- 172.21.15.105:0/2444051462 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd06c0b7fe0 0x7fd06c0ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:53.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.741+0000 7fd070827640 1 --2- 172.21.15.105:0/2444051462 >> v2:172.21.15.162:3300/0 conn(0x7fd06c0cd360 0x7fd06c15c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:53.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.741+0000 7fd070827640 1 -- 172.21.15.105:0/2444051462 >> 172.21.15.105:0/2444051462 conn(0x7fd06c0710b0 msgr2=0x7fd06c0714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:53.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.741+0000 7fd070827640 1 -- 172.21.15.105:0/2444051462 shutdown_connections 2024-09-21T03:25:53.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.741+0000 7fd070827640 1 -- 172.21.15.105:0/2444051462 wait complete. 2024-09-21T03:25:53.745 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.743+0000 7fd070827640 1 Processor -- start 2024-09-21T03:25:53.745 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.743+0000 7fd070827640 1 -- start start 2024-09-21T03:25:53.747 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.744+0000 7fd070827640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd06c0b7fe0 0x7fd06c1f6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:53.747 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.744+0000 7fd070827640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd06c0cd360 0x7fd06c14c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:53.747 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.744+0000 7fd070827640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd06c0cf270 0x7fd06c1f3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:53.747 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.745+0000 7fd070827640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd06c073120 con 0x7fd06c0cd360 2024-09-21T03:25:53.747 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.745+0000 7fd070827640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd06c072fa0 con 0x7fd06c0b7fe0 2024-09-21T03:25:53.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.745+0000 7fd070827640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd06c0732a0 con 0x7fd06c0cf270 2024-09-21T03:25:53.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.745+0000 7fd069d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd06c0cd360 0x7fd06c14c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:53.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.745+0000 7fd069d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd06c0cd360 0x7fd06c14c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:37842/0 (socket says 172.21.15.105:37842) 2024-09-21T03:25:53.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.745+0000 7fd069d9b640 1 -- 172.21.15.105:0/775047102 learned_addr learned my addr 172.21.15.105:0/775047102 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:53.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.745+0000 7fd06a59c640 1 --2- 172.21.15.105:0/775047102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd06c0b7fe0 0x7fd06c1f6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:53.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.745+0000 7fd06ad9d640 1 --2- 172.21.15.105:0/775047102 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd06c0cf270 0x7fd06c1f3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:53.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.745+0000 7fd069d9b640 1 -- 172.21.15.105:0/775047102 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd06c0cf270 msgr2=0x7fd06c1f3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:53.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.745+0000 7fd069d9b640 1 --2- 172.21.15.105:0/775047102 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd06c0cf270 0x7fd06c1f3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:53.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.745+0000 7fd069d9b640 1 -- 172.21.15.105:0/775047102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd06c0b7fe0 msgr2=0x7fd06c1f6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:53.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.745+0000 7fd069d9b640 1 --2- 172.21.15.105:0/775047102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd06c0b7fe0 0x7fd06c1f6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:53.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.745+0000 7fd069d9b640 1 -- 172.21.15.105:0/775047102 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd06c1f7440 con 0x7fd06c0cd360 2024-09-21T03:25:53.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.745+0000 7fd069d9b640 1 --2- 172.21.15.105:0/775047102 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd06c0cd360 0x7fd06c14c740 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fd06000d770 tx=0x7fd06000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:53.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.745+0000 7fd05affd640 1 -- 172.21.15.105:0/775047102 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd060017070 con 0x7fd06c0cd360 2024-09-21T03:25:53.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.745+0000 7fd05affd640 1 -- 172.21.15.105:0/775047102 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd060009d20 con 0x7fd06c0cd360 2024-09-21T03:25:53.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.745+0000 7fd070827640 1 -- 172.21.15.105:0/775047102 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd06c1f7720 con 0x7fd06c0cd360 2024-09-21T03:25:53.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.745+0000 7fd05affd640 1 -- 172.21.15.105:0/775047102 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0600106c0 con 0x7fd06c0cd360 2024-09-21T03:25:53.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.745+0000 7fd070827640 1 -- 172.21.15.105:0/775047102 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd06c1f43c0 con 0x7fd06c0cd360 2024-09-21T03:25:53.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.746+0000 7fd070827640 1 -- 172.21.15.105:0/775047102 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd06c1f34a0 con 0x7fd06c0cd360 2024-09-21T03:25:53.749 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.748+0000 7fd05affd640 1 -- 172.21.15.105:0/775047102 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd06001a070 con 0x7fd06c0cd360 2024-09-21T03:25:53.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.748+0000 7fd05affd640 1 --2- 172.21.15.105:0/775047102 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd04c078b90 0x7fd04c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:53.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.748+0000 7fd05affd640 1 -- 172.21.15.105:0/775047102 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7fd06009b1c0 con 0x7fd06c0cd360 2024-09-21T03:25:53.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.748+0000 7fd06a59c640 1 --2- 172.21.15.105:0/775047102 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd04c078b90 0x7fd04c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:53.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.749+0000 7fd06a59c640 1 --2- 172.21.15.105:0/775047102 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd04c078b90 0x7fd04c07b0a0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fd05c005fd0 tx=0x7fd05c0095e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:53.753 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.752+0000 7fd05affd640 1 -- 172.21.15.105:0/775047102 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd06c1f34a0 con 0x7fd06c0cd360 2024-09-21T03:25:53.931 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.929+0000 7fd070827640 1 -- 172.21.15.105:0/775047102 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd06c1f71d0 con 0x7fd06c0cd360 2024-09-21T03:25:53.932 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.930+0000 7fd05affd640 1 -- 172.21.15.105:0/775047102 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) ==== 74+0+16811 (secure 0 0 0) 0x7fd060063120 con 0x7fd06c0cd360 2024-09-21T03:25:53.932 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:53.932 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":116,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:25:52.236150+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:25:48.253350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-21T03:25:49.567236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:25:53.934 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.933+0000 7fd070827640 1 -- 172.21.15.105:0/775047102 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd04c078b90 msgr2=0x7fd04c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:53.935 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.933+0000 7fd070827640 1 --2- 172.21.15.105:0/775047102 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd04c078b90 0x7fd04c07b0a0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fd05c005fd0 tx=0x7fd05c0095e0 comp rx=0 tx=0).stop 2024-09-21T03:25:53.935 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.933+0000 7fd070827640 1 -- 172.21.15.105:0/775047102 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd06c0cd360 msgr2=0x7fd06c14c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:53.935 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.933+0000 7fd070827640 1 --2- 172.21.15.105:0/775047102 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd06c0cd360 0x7fd06c14c740 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fd06000d770 tx=0x7fd06000dc30 comp rx=0 tx=0).stop 2024-09-21T03:25:53.935 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.933+0000 7fd070827640 1 -- 172.21.15.105:0/775047102 shutdown_connections 2024-09-21T03:25:53.935 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.933+0000 7fd070827640 1 --2- 172.21.15.105:0/775047102 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd04c078b90 0x7fd04c07b0a0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:53.935 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.933+0000 7fd070827640 1 --2- 172.21.15.105:0/775047102 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd06c0cf270 0x7fd06c1f3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:53.935 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.933+0000 7fd070827640 1 --2- 172.21.15.105:0/775047102 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd06c0cd360 0x7fd06c14c740 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:53.935 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.933+0000 7fd070827640 1 --2- 172.21.15.105:0/775047102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd06c0b7fe0 0x7fd06c1f6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:53.935 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.933+0000 7fd070827640 1 -- 172.21.15.105:0/775047102 >> 172.21.15.105:0/775047102 conn(0x7fd06c0710b0 msgr2=0x7fd06c15b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:53.935 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.933+0000 7fd070827640 1 -- 172.21.15.105:0/775047102 shutdown_connections 2024-09-21T03:25:53.935 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:53.933+0000 7fd070827640 1 -- 172.21.15.105:0/775047102 wait complete. 2024-09-21T03:25:53.946 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T03:25:53.946 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:25:54.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.057+0000 7f82d77c6640 1 -- 172.21.15.105:0/1430422735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82d00cad30 msgr2=0x7f82d006ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:54.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.057+0000 7f82d77c6640 1 --2- 172.21.15.105:0/1430422735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82d00cad30 0x7f82d006ffa0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f82c0005fd0 tx=0x7f82c002a5d0 comp rx=0 tx=0).stop 2024-09-21T03:25:54.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.057+0000 7f82d77c6640 1 -- 172.21.15.105:0/1430422735 shutdown_connections 2024-09-21T03:25:54.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.057+0000 7f82d77c6640 1 --2- 172.21.15.105:0/1430422735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82d00cad30 0x7f82d006ffa0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:54.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.057+0000 7f82d77c6640 1 --2- 172.21.15.105:0/1430422735 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82d00ca800 0x7f82d00cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:54.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.057+0000 7f82d77c6640 1 -- 172.21.15.105:0/1430422735 >> 172.21.15.105:0/1430422735 conn(0x7f82d00b1cb0 msgr2=0x7f82d00b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:54.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.057+0000 7f82d77c6640 1 -- 172.21.15.105:0/1430422735 shutdown_connections 2024-09-21T03:25:54.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.057+0000 7f82d77c6640 1 -- 172.21.15.105:0/1430422735 wait complete. 2024-09-21T03:25:54.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.059+0000 7f82d77c6640 1 Processor -- start 2024-09-21T03:25:54.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.059+0000 7f82d77c6640 1 -- start start 2024-09-21T03:25:54.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.060+0000 7f82d77c6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82d00704e0 0x7f82d0159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:54.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.060+0000 7f82d77c6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82d00ca800 0x7f82d01e84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:54.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.060+0000 7f82d77c6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82d00cad30 0x7f82d01e89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:54.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.060+0000 7f82d77c6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f82d00ccf40 con 0x7f82d00704e0 2024-09-21T03:25:54.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.060+0000 7f82d77c6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f82d00747d0 con 0x7f82d00ca800 2024-09-21T03:25:54.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.060+0000 7f82d77c6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f82d00cd0c0 con 0x7f82d00cad30 2024-09-21T03:25:54.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.060+0000 7f82d5562640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82d00704e0 0x7f82d0159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:54.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.060+0000 7f82d5562640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82d00704e0 0x7f82d0159f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:37866/0 (socket says 172.21.15.105:37866) 2024-09-21T03:25:54.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.060+0000 7f82d5562640 1 -- 172.21.15.105:0/618388679 learned_addr learned my addr 172.21.15.105:0/618388679 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:54.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.060+0000 7f82d4d61640 1 --2- 172.21.15.105:0/618388679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82d00ca800 0x7f82d01e84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:54.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.060+0000 7f82d5d63640 1 --2- 172.21.15.105:0/618388679 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82d00cad30 0x7f82d01e89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:54.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.060+0000 7f82d5562640 1 -- 172.21.15.105:0/618388679 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82d00cad30 msgr2=0x7f82d01e89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:54.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.060+0000 7f82d5562640 1 --2- 172.21.15.105:0/618388679 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82d00cad30 0x7f82d01e89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:54.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.060+0000 7f82d5562640 1 -- 172.21.15.105:0/618388679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82d00ca800 msgr2=0x7f82d01e84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:54.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.060+0000 7f82d5562640 1 --2- 172.21.15.105:0/618388679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82d00ca800 0x7f82d01e84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:54.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.060+0000 7f82d5562640 1 -- 172.21.15.105:0/618388679 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d01f9c00 con 0x7f82d00704e0 2024-09-21T03:25:54.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.061+0000 7f82d5562640 1 --2- 172.21.15.105:0/618388679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82d00704e0 0x7f82d0159f50 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f82cc00d700 tx=0x7f82cc00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:54.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.061+0000 7f82c5ffb640 1 -- 172.21.15.105:0/618388679 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc017070 con 0x7f82d00704e0 2024-09-21T03:25:54.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.061+0000 7f82c5ffb640 1 -- 172.21.15.105:0/618388679 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f82cc004310 con 0x7f82d00704e0 2024-09-21T03:25:54.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.061+0000 7f82d77c6640 1 -- 172.21.15.105:0/618388679 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82d01f5b40 con 0x7f82d00704e0 2024-09-21T03:25:54.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.061+0000 7f82c5ffb640 1 -- 172.21.15.105:0/618388679 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc009a80 con 0x7f82d00704e0 2024-09-21T03:25:54.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.061+0000 7f82d77c6640 1 -- 172.21.15.105:0/618388679 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82d01f6100 con 0x7f82d00704e0 2024-09-21T03:25:54.065 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.062+0000 7f82d77c6640 1 -- 172.21.15.105:0/618388679 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82d00cd650 con 0x7f82d00704e0 2024-09-21T03:25:54.065 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.063+0000 7f82c5ffb640 1 -- 172.21.15.105:0/618388679 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f82cc009c20 con 0x7f82d00704e0 2024-09-21T03:25:54.065 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.063+0000 7f82c5ffb640 1 --2- 172.21.15.105:0/618388679 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f82b4078bc0 0x7f82b407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:54.065 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.064+0000 7f82c5ffb640 1 -- 172.21.15.105:0/618388679 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7f82cc09ad00 con 0x7f82d00704e0 2024-09-21T03:25:54.065 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.064+0000 7f82d4d61640 1 --2- 172.21.15.105:0/618388679 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f82b4078bc0 0x7f82b407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:54.066 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.064+0000 7f82d4d61640 1 --2- 172.21.15.105:0/618388679 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f82b4078bc0 0x7f82b407b0d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f82c0033000 tx=0x7f82c0004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:54.070 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.068+0000 7f82c5ffb640 1 -- 172.21.15.105:0/618388679 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f82cc0631d0 con 0x7f82d00704e0 2024-09-21T03:25:54.244 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.243+0000 7f82d77c6640 1 -- 172.21.15.105:0/618388679 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f82d015ed50 con 0x7f82b4078bc0 2024-09-21T03:25:54.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.248+0000 7f82c5ffb640 1 -- 172.21.15.105:0/618388679 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+238792 (secure 0 0 0) 0x7f82c00055c0 con 0x7f82b4078bc0 2024-09-21T03:25:54.252 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:54.252 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:25:54.254 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.251+0000 7f82d77c6640 1 -- 172.21.15.105:0/618388679 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f82b4078bc0 msgr2=0x7f82b407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:54.254 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.251+0000 7f82d77c6640 1 --2- 172.21.15.105:0/618388679 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f82b4078bc0 0x7f82b407b0d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f82c0033000 tx=0x7f82c0004730 comp rx=0 tx=0).stop 2024-09-21T03:25:54.254 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.251+0000 7f82d77c6640 1 -- 172.21.15.105:0/618388679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82d00704e0 msgr2=0x7f82d0159f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:54.254 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.251+0000 7f82d77c6640 1 --2- 172.21.15.105:0/618388679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82d00704e0 0x7f82d0159f50 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f82cc00d700 tx=0x7f82cc00dbc0 comp rx=0 tx=0).stop 2024-09-21T03:25:54.254 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.251+0000 7f82d77c6640 1 -- 172.21.15.105:0/618388679 shutdown_connections 2024-09-21T03:25:54.254 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.251+0000 7f82d77c6640 1 --2- 172.21.15.105:0/618388679 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f82b4078bc0 0x7f82b407b0d0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:54.254 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.251+0000 7f82d77c6640 1 --2- 172.21.15.105:0/618388679 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82d00cad30 0x7f82d01e89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:54.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.251+0000 7f82d77c6640 1 --2- 172.21.15.105:0/618388679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82d00ca800 0x7f82d01e84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:54.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.251+0000 7f82d77c6640 1 --2- 172.21.15.105:0/618388679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82d00704e0 0x7f82d0159f50 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:54.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.251+0000 7f82d77c6640 1 -- 172.21.15.105:0/618388679 >> 172.21.15.105:0/618388679 conn(0x7f82d00b1cb0 msgr2=0x7f82d00b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:54.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.251+0000 7f82d77c6640 1 -- 172.21.15.105:0/618388679 shutdown_connections 2024-09-21T03:25:54.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.251+0000 7f82d77c6640 1 -- 172.21.15.105:0/618388679 wait complete. 2024-09-21T03:25:54.264 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":338,"stamp":"2024-09-21T03:25:53.398875+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":107,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":20,"acting":20,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":269932,"kb_used_data":12064,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754704788,"statfs":{"total":773094113280,"available":772817702912,"internally_reserved":0,"allocated":12353536,"data_stored":5910740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.165894"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-21T03:25:51.261118+0000","last_change":"2024-09-21T03:25:51.258646+0000","last_active":"2024-09-21T03:25:51.261118+0000","last_peered":"2024-09-21T03:25:51.261118+0000","last_clean":"2024-09-21T03:25:51.261118+0000","last_became_active":"2024-09-21T03:25:51.258369+0000","last_became_peered":"2024-09-21T03:25:51.258369+0000","last_unstale":"2024-09-21T03:25:51.261118+0000","last_undegraded":"2024-09-21T03:25:51.261118+0000","last_fullsized":"2024-09-21T03:25:51.261118+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:27.385892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-21T03:25:51.262356+0000","last_change":"2024-09-21T03:25:51.260227+0000","last_active":"2024-09-21T03:25:51.262356+0000","last_peered":"2024-09-21T03:25:51.262356+0000","last_clean":"2024-09-21T03:25:51.262356+0000","last_became_active":"2024-09-21T03:25:51.259914+0000","last_became_peered":"2024-09-21T03:25:51.259914+0000","last_unstale":"2024-09-21T03:25:51.262356+0000","last_undegraded":"2024-09-21T03:25:51.262356+0000","last_fullsized":"2024-09-21T03:25:51.262356+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:01.563835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-21T03:25:51.265984+0000","last_change":"2024-09-21T03:25:51.261227+0000","last_active":"2024-09-21T03:25:51.265984+0000","last_peered":"2024-09-21T03:25:51.265984+0000","last_clean":"2024-09-21T03:25:51.265984+0000","last_became_active":"2024-09-21T03:25:51.260891+0000","last_became_peered":"2024-09-21T03:25:51.260891+0000","last_unstale":"2024-09-21T03:25:51.265984+0000","last_undegraded":"2024-09-21T03:25:51.265984+0000","last_fullsized":"2024-09-21T03:25:51.265984+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:22:44.855315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-21T03:25:51.266098+0000","last_change":"2024-09-21T03:25:51.262058+0000","last_active":"2024-09-21T03:25:51.266098+0000","last_peered":"2024-09-21T03:25:51.266098+0000","last_clean":"2024-09-21T03:25:51.266098+0000","last_became_active":"2024-09-21T03:25:51.261722+0000","last_became_peered":"2024-09-21T03:25:51.261722+0000","last_unstale":"2024-09-21T03:25:51.266098+0000","last_undegraded":"2024-09-21T03:25:51.266098+0000","last_fullsized":"2024-09-21T03:25:51.266098+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:15.521544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1d","version":"115'2","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-21T03:25:51.271213+0000","last_change":"2024-09-21T03:25:50.247877+0000","last_active":"2024-09-21T03:25:51.271213+0000","last_peered":"2024-09-21T03:25:51.271213+0000","last_clean":"2024-09-21T03:25:51.271213+0000","last_became_active":"2024-09-21T03:25:50.247575+0000","last_became_peered":"2024-09-21T03:25:50.247575+0000","last_unstale":"2024-09-21T03:25:51.271213+0000","last_undegraded":"2024-09-21T03:25:51.271213+0000","last_fullsized":"2024-09-21T03:25:51.271213+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:38.761687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.e","version":"115'2","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-21T03:25:51.263507+0000","last_change":"2024-09-21T03:25:50.249322+0000","last_active":"2024-09-21T03:25:51.263507+0000","last_peered":"2024-09-21T03:25:51.263507+0000","last_clean":"2024-09-21T03:25:51.263507+0000","last_became_active":"2024-09-21T03:25:50.249036+0000","last_became_peered":"2024-09-21T03:25:50.249036+0000","last_unstale":"2024-09-21T03:25:51.263507+0000","last_undegraded":"2024-09-21T03:25:51.263507+0000","last_fullsized":"2024-09-21T03:25:51.263507+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:57.753544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-21T03:25:51.247530+0000","last_change":"2024-09-21T03:25:50.248647+0000","last_active":"2024-09-21T03:25:51.247530+0000","last_peered":"2024-09-21T03:25:51.247530+0000","last_clean":"2024-09-21T03:25:51.247530+0000","last_became_active":"2024-09-21T03:25:50.248231+0000","last_became_peered":"2024-09-21T03:25:50.248231+0000","last_unstale":"2024-09-21T03:25:51.247530+0000","last_undegraded":"2024-09-21T03:25:51.247530+0000","last_fullsized":"2024-09-21T03:25:51.247530+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:05.855445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-21T03:25:51.247851+0000","last_change":"2024-09-21T03:25:50.259220+0000","last_active":"2024-09-21T03:25:51.247851+0000","last_peered":"2024-09-21T03:25:51.247851+0000","last_clean":"2024-09-21T03:25:51.247851+0000","last_became_active":"2024-09-21T03:25:50.258897+0000","last_became_peered":"2024-09-21T03:25:50.258897+0000","last_unstale":"2024-09-21T03:25:51.247851+0000","last_undegraded":"2024-09-21T03:25:51.247851+0000","last_fullsized":"2024-09-21T03:25:51.247851+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:22.679163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-21T03:25:51.248354+0000","last_change":"2024-09-21T03:25:50.252759+0000","last_active":"2024-09-21T03:25:51.248354+0000","last_peered":"2024-09-21T03:25:51.248354+0000","last_clean":"2024-09-21T03:25:51.248354+0000","last_became_active":"2024-09-21T03:25:50.252445+0000","last_became_peered":"2024-09-21T03:25:50.252445+0000","last_unstale":"2024-09-21T03:25:51.248354+0000","last_undegraded":"2024-09-21T03:25:51.248354+0000","last_fullsized":"2024-09-21T03:25:51.248354+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:10.447482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":278,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-21T03:25:47.262025+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:25:47.262025+0000","last_peered":"2024-09-21T03:25:47.262025+0000","last_clean":"2024-09-21T03:25:47.262025+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:25:47.262025+0000","last_undegraded":"2024-09-21T03:25:47.262025+0000","last_fullsized":"2024-09-21T03:25:47.262025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":8,"acting":8,"num_store_stats":1},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":10,"acting":10,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509535,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33132,"kb_used_data":1940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338708,"statfs":{"total":96636764160,"available":96602836992,"internally_reserved":0,"allocated":1986560,"data_stored":1180107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32564,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1392640,"data_stored":589739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509533,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32552,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339288,"statfs":{"total":96636764160,"available":96603430912,"internally_reserved":0,"allocated":1392640,"data_stored":589739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509533,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32560,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1392640,"data_stored":589739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32552,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339288,"statfs":{"total":96636764160,"available":96603430912,"internally_reserved":0,"allocated":1392640,"data_stored":589739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36708,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335132,"statfs":{"total":96636764160,"available":96599175168,"internally_reserved":0,"allocated":1392640,"data_stored":589739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36708,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335132,"statfs":{"total":96636764160,"available":96599175168,"internally_reserved":0,"allocated":1392640,"data_stored":589739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574942,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33156,"kb_used_data":1964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338684,"statfs":{"total":96636764160,"available":96602812416,"internally_reserved":0,"allocated":2011136,"data_stored":1192199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:25:54.268 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:25:54.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.414+0000 7f04199cf640 1 -- 172.21.15.105:0/2573798384 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f04140b51c0 msgr2=0x7f041415c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:54.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.414+0000 7f04199cf640 1 --2- 172.21.15.105:0/2573798384 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f04140b51c0 0x7f041415c6e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0404005fd0 tx=0x7f040402a5d0 comp rx=0 tx=0).stop 2024-09-21T03:25:54.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.414+0000 7f04199cf640 1 -- 172.21.15.105:0/2573798384 shutdown_connections 2024-09-21T03:25:54.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.414+0000 7f04199cf640 1 --2- 172.21.15.105:0/2573798384 >> v2:172.21.15.162:3300/0 conn(0x7f04140ccbd0 0x7f04140d0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:54.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.414+0000 7f04199cf640 1 --2- 172.21.15.105:0/2573798384 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f04140b51c0 0x7f041415c6e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:54.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.414+0000 7f04199cf640 1 -- 172.21.15.105:0/2573798384 >> 172.21.15.105:0/2573798384 conn(0x7f0414072ae0 msgr2=0x7f0414072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:54.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.414+0000 7f04199cf640 1 -- 172.21.15.105:0/2573798384 shutdown_connections 2024-09-21T03:25:54.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.414+0000 7f04199cf640 1 -- 172.21.15.105:0/2573798384 wait complete. 2024-09-21T03:25:54.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.416+0000 7f04199cf640 1 Processor -- start 2024-09-21T03:25:54.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.416+0000 7f04199cf640 1 -- start start 2024-09-21T03:25:54.420 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.417+0000 7f04199cf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04140b51c0 0x7f04140cba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:54.420 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.417+0000 7f04199cf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04140ccbd0 0x7f04140ac1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:54.420 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.417+0000 7f04199cf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f04140d12c0 0x7f04141f2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:54.420 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.417+0000 7f04199cf640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0414160a60 con 0x7f04140b51c0 2024-09-21T03:25:54.420 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.417+0000 7f04199cf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f04140d1a20 con 0x7f04140ccbd0 2024-09-21T03:25:54.420 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.417+0000 7f04199cf640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0414160be0 con 0x7f04140d12c0 2024-09-21T03:25:54.420 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.417+0000 7f0412ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04140b51c0 0x7f04140cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:54.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.418+0000 7f0412ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04140b51c0 0x7f04140cba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:37874/0 (socket says 172.21.15.105:37874) 2024-09-21T03:25:54.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.418+0000 7f0412ffd640 1 -- 172.21.15.105:0/4071021935 learned_addr learned my addr 172.21.15.105:0/4071021935 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:54.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.418+0000 7f040a7fc640 1 --2- 172.21.15.105:0/4071021935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04140ccbd0 0x7f04140ac1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:54.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.418+0000 7f04137fe640 1 --2- 172.21.15.105:0/4071021935 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f04140d12c0 0x7f04141f2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:54.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.418+0000 7f0412ffd640 1 -- 172.21.15.105:0/4071021935 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f04140d12c0 msgr2=0x7f04141f2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:54.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.418+0000 7f0412ffd640 1 --2- 172.21.15.105:0/4071021935 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f04140d12c0 0x7f04141f2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:54.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.418+0000 7f0412ffd640 1 -- 172.21.15.105:0/4071021935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04140ccbd0 msgr2=0x7f04140ac1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:54.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.418+0000 7f0412ffd640 1 --2- 172.21.15.105:0/4071021935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04140ccbd0 0x7f04140ac1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:54.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.418+0000 7f0412ffd640 1 -- 172.21.15.105:0/4071021935 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04140b0a70 con 0x7f04140b51c0 2024-09-21T03:25:54.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.418+0000 7f0412ffd640 1 --2- 172.21.15.105:0/4071021935 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04140b51c0 0x7f04140cba30 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f0404034040 tx=0x7f0404005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:54.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.418+0000 7f0410ff9640 1 -- 172.21.15.105:0/4071021935 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040403e030 con 0x7f04140b51c0 2024-09-21T03:25:54.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.418+0000 7f0410ff9640 1 -- 172.21.15.105:0/4071021935 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0404003a70 con 0x7f04140b51c0 2024-09-21T03:25:54.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.418+0000 7f0410ff9640 1 -- 172.21.15.105:0/4071021935 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0404035040 con 0x7f04140b51c0 2024-09-21T03:25:54.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.418+0000 7f04199cf640 1 -- 172.21.15.105:0/4071021935 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f041414d0d0 con 0x7f04140b51c0 2024-09-21T03:25:54.422 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.418+0000 7f04199cf640 1 -- 172.21.15.105:0/4071021935 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f041414d690 con 0x7f04140b51c0 2024-09-21T03:25:54.422 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.419+0000 7f04199cf640 1 -- 172.21.15.105:0/4071021935 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0414161090 con 0x7f04140b51c0 2024-09-21T03:25:54.422 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.420+0000 7f0410ff9640 1 -- 172.21.15.105:0/4071021935 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0404041030 con 0x7f04140b51c0 2024-09-21T03:25:54.422 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.420+0000 7f0410ff9640 1 --2- 172.21.15.105:0/4071021935 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f03f4078b90 0x7f03f407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:54.423 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.421+0000 7f0410ff9640 1 -- 172.21.15.105:0/4071021935 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7f04040bb030 con 0x7f04140b51c0 2024-09-21T03:25:54.423 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.421+0000 7f040a7fc640 1 --2- 172.21.15.105:0/4071021935 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f03f4078b90 0x7f03f407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:54.423 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.421+0000 7f040a7fc640 1 --2- 172.21.15.105:0/4071021935 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f03f4078b90 0x7f03f407b0a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0414151170 tx=0x7f03fc005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:54.426 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.425+0000 7f0410ff9640 1 -- 172.21.15.105:0/4071021935 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0404082eb0 con 0x7f04140b51c0 2024-09-21T03:25:54.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.600+0000 7f04199cf640 1 -- 172.21.15.105:0/4071021935 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f04140ac730 con 0x7f03f4078b90 2024-09-21T03:25:54.606 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.605+0000 7f0410ff9640 1 -- 172.21.15.105:0/4071021935 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+238792 (secure 0 0 0) 0x7f04140ac730 con 0x7f03f4078b90 2024-09-21T03:25:54.609 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:54.610 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:25:54.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.608+0000 7f04199cf640 1 -- 172.21.15.105:0/4071021935 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f03f4078b90 msgr2=0x7f03f407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:54.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.608+0000 7f04199cf640 1 --2- 172.21.15.105:0/4071021935 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f03f4078b90 0x7f03f407b0a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0414151170 tx=0x7f03fc005f90 comp rx=0 tx=0).stop 2024-09-21T03:25:54.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.608+0000 7f04199cf640 1 -- 172.21.15.105:0/4071021935 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04140b51c0 msgr2=0x7f04140cba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:54.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.608+0000 7f04199cf640 1 --2- 172.21.15.105:0/4071021935 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04140b51c0 0x7f04140cba30 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f0404034040 tx=0x7f0404005770 comp rx=0 tx=0).stop 2024-09-21T03:25:54.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.608+0000 7f04199cf640 1 -- 172.21.15.105:0/4071021935 shutdown_connections 2024-09-21T03:25:54.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.608+0000 7f04199cf640 1 --2- 172.21.15.105:0/4071021935 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f03f4078b90 0x7f03f407b0a0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:54.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.608+0000 7f04199cf640 1 --2- 172.21.15.105:0/4071021935 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f04140d12c0 0x7f04141f2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:54.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.608+0000 7f04199cf640 1 --2- 172.21.15.105:0/4071021935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04140ccbd0 0x7f04140ac1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:54.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.608+0000 7f04199cf640 1 --2- 172.21.15.105:0/4071021935 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04140b51c0 0x7f04140cba30 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:54.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.608+0000 7f04199cf640 1 -- 172.21.15.105:0/4071021935 >> 172.21.15.105:0/4071021935 conn(0x7f0414072ae0 msgr2=0x7f04140b5860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:54.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.608+0000 7f04199cf640 1 -- 172.21.15.105:0/4071021935 shutdown_connections 2024-09-21T03:25:54.612 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.608+0000 7f04199cf640 1 -- 172.21.15.105:0/4071021935 wait complete. 2024-09-21T03:25:54.621 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":338,"stamp":"2024-09-21T03:25:53.398875+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":107,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":20,"acting":20,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":269932,"kb_used_data":12064,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754704788,"statfs":{"total":773094113280,"available":772817702912,"internally_reserved":0,"allocated":12353536,"data_stored":5910740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.165894"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-21T03:25:51.261118+0000","last_change":"2024-09-21T03:25:51.258646+0000","last_active":"2024-09-21T03:25:51.261118+0000","last_peered":"2024-09-21T03:25:51.261118+0000","last_clean":"2024-09-21T03:25:51.261118+0000","last_became_active":"2024-09-21T03:25:51.258369+0000","last_became_peered":"2024-09-21T03:25:51.258369+0000","last_unstale":"2024-09-21T03:25:51.261118+0000","last_undegraded":"2024-09-21T03:25:51.261118+0000","last_fullsized":"2024-09-21T03:25:51.261118+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:27.385892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-21T03:25:51.262356+0000","last_change":"2024-09-21T03:25:51.260227+0000","last_active":"2024-09-21T03:25:51.262356+0000","last_peered":"2024-09-21T03:25:51.262356+0000","last_clean":"2024-09-21T03:25:51.262356+0000","last_became_active":"2024-09-21T03:25:51.259914+0000","last_became_peered":"2024-09-21T03:25:51.259914+0000","last_unstale":"2024-09-21T03:25:51.262356+0000","last_undegraded":"2024-09-21T03:25:51.262356+0000","last_fullsized":"2024-09-21T03:25:51.262356+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:01.563835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-21T03:25:51.265984+0000","last_change":"2024-09-21T03:25:51.261227+0000","last_active":"2024-09-21T03:25:51.265984+0000","last_peered":"2024-09-21T03:25:51.265984+0000","last_clean":"2024-09-21T03:25:51.265984+0000","last_became_active":"2024-09-21T03:25:51.260891+0000","last_became_peered":"2024-09-21T03:25:51.260891+0000","last_unstale":"2024-09-21T03:25:51.265984+0000","last_undegraded":"2024-09-21T03:25:51.265984+0000","last_fullsized":"2024-09-21T03:25:51.265984+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:22:44.855315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-21T03:25:51.266098+0000","last_change":"2024-09-21T03:25:51.262058+0000","last_active":"2024-09-21T03:25:51.266098+0000","last_peered":"2024-09-21T03:25:51.266098+0000","last_clean":"2024-09-21T03:25:51.266098+0000","last_became_active":"2024-09-21T03:25:51.261722+0000","last_became_peered":"2024-09-21T03:25:51.261722+0000","last_unstale":"2024-09-21T03:25:51.266098+0000","last_undegraded":"2024-09-21T03:25:51.266098+0000","last_fullsized":"2024-09-21T03:25:51.266098+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:15.521544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1d","version":"115'2","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-21T03:25:51.271213+0000","last_change":"2024-09-21T03:25:50.247877+0000","last_active":"2024-09-21T03:25:51.271213+0000","last_peered":"2024-09-21T03:25:51.271213+0000","last_clean":"2024-09-21T03:25:51.271213+0000","last_became_active":"2024-09-21T03:25:50.247575+0000","last_became_peered":"2024-09-21T03:25:50.247575+0000","last_unstale":"2024-09-21T03:25:51.271213+0000","last_undegraded":"2024-09-21T03:25:51.271213+0000","last_fullsized":"2024-09-21T03:25:51.271213+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:38.761687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.e","version":"115'2","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-21T03:25:51.263507+0000","last_change":"2024-09-21T03:25:50.249322+0000","last_active":"2024-09-21T03:25:51.263507+0000","last_peered":"2024-09-21T03:25:51.263507+0000","last_clean":"2024-09-21T03:25:51.263507+0000","last_became_active":"2024-09-21T03:25:50.249036+0000","last_became_peered":"2024-09-21T03:25:50.249036+0000","last_unstale":"2024-09-21T03:25:51.263507+0000","last_undegraded":"2024-09-21T03:25:51.263507+0000","last_fullsized":"2024-09-21T03:25:51.263507+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:57.753544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-21T03:25:51.247530+0000","last_change":"2024-09-21T03:25:50.248647+0000","last_active":"2024-09-21T03:25:51.247530+0000","last_peered":"2024-09-21T03:25:51.247530+0000","last_clean":"2024-09-21T03:25:51.247530+0000","last_became_active":"2024-09-21T03:25:50.248231+0000","last_became_peered":"2024-09-21T03:25:50.248231+0000","last_unstale":"2024-09-21T03:25:51.247530+0000","last_undegraded":"2024-09-21T03:25:51.247530+0000","last_fullsized":"2024-09-21T03:25:51.247530+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:05.855445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-21T03:25:51.247851+0000","last_change":"2024-09-21T03:25:50.259220+0000","last_active":"2024-09-21T03:25:51.247851+0000","last_peered":"2024-09-21T03:25:51.247851+0000","last_clean":"2024-09-21T03:25:51.247851+0000","last_became_active":"2024-09-21T03:25:50.258897+0000","last_became_peered":"2024-09-21T03:25:50.258897+0000","last_unstale":"2024-09-21T03:25:51.247851+0000","last_undegraded":"2024-09-21T03:25:51.247851+0000","last_fullsized":"2024-09-21T03:25:51.247851+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:22.679163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-21T03:25:51.248354+0000","last_change":"2024-09-21T03:25:50.252759+0000","last_active":"2024-09-21T03:25:51.248354+0000","last_peered":"2024-09-21T03:25:51.248354+0000","last_clean":"2024-09-21T03:25:51.248354+0000","last_became_active":"2024-09-21T03:25:50.252445+0000","last_became_peered":"2024-09-21T03:25:50.252445+0000","last_unstale":"2024-09-21T03:25:51.248354+0000","last_undegraded":"2024-09-21T03:25:51.248354+0000","last_fullsized":"2024-09-21T03:25:51.248354+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:10.447482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":278,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-21T03:25:47.262025+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:25:47.262025+0000","last_peered":"2024-09-21T03:25:47.262025+0000","last_clean":"2024-09-21T03:25:47.262025+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:25:47.262025+0000","last_undegraded":"2024-09-21T03:25:47.262025+0000","last_fullsized":"2024-09-21T03:25:47.262025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":8,"acting":8,"num_store_stats":1},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":10,"acting":10,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509535,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33132,"kb_used_data":1940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338708,"statfs":{"total":96636764160,"available":96602836992,"internally_reserved":0,"allocated":1986560,"data_stored":1180107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32564,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1392640,"data_stored":589739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509533,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32552,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339288,"statfs":{"total":96636764160,"available":96603430912,"internally_reserved":0,"allocated":1392640,"data_stored":589739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509533,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32560,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1392640,"data_stored":589739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32552,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339288,"statfs":{"total":96636764160,"available":96603430912,"internally_reserved":0,"allocated":1392640,"data_stored":589739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36708,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335132,"statfs":{"total":96636764160,"available":96599175168,"internally_reserved":0,"allocated":1392640,"data_stored":589739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36708,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335132,"statfs":{"total":96636764160,"available":96599175168,"internally_reserved":0,"allocated":1392640,"data_stored":589739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574942,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33156,"kb_used_data":1964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338684,"statfs":{"total":96636764160,"available":96602812416,"internally_reserved":0,"allocated":2011136,"data_stored":1192199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:25:54.624 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:25:54.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.772+0000 7f6a7a513640 1 -- 172.21.15.105:0/2905892594 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a740b7cc0 msgr2=0x7f6a740cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:54.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.772+0000 7f6a7a513640 1 --2- 172.21.15.105:0/2905892594 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a740b7cc0 0x7f6a740cec10 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f6a68005fd0 tx=0x7f6a6802a5d0 comp rx=0 tx=0).stop 2024-09-21T03:25:54.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.772+0000 7f6a7a513640 1 -- 172.21.15.105:0/2905892594 shutdown_connections 2024-09-21T03:25:54.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.772+0000 7f6a7a513640 1 --2- 172.21.15.105:0/2905892594 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a740b7cc0 0x7f6a740cec10 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:54.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.772+0000 7f6a7a513640 1 --2- 172.21.15.105:0/2905892594 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a741600b0 0x7f6a740ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:54.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.772+0000 7f6a7a513640 1 -- 172.21.15.105:0/2905892594 >> 172.21.15.105:0/2905892594 conn(0x7f6a7406d4f0 msgr2=0x7f6a74071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:54.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.772+0000 7f6a7a513640 1 -- 172.21.15.105:0/2905892594 shutdown_connections 2024-09-21T03:25:54.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.772+0000 7f6a7a513640 1 -- 172.21.15.105:0/2905892594 wait complete. 2024-09-21T03:25:54.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.773+0000 7f6a7a513640 1 Processor -- start 2024-09-21T03:25:54.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.774+0000 7f6a7a513640 1 -- start start 2024-09-21T03:25:54.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.775+0000 7f6a7a513640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a740b7cc0 0x7f6a7406f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:54.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.775+0000 7f6a7a513640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a740cf150 0x7f6a740cc970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:54.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.775+0000 7f6a7a513640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a741600b0 0x7f6a741e7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:54.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.775+0000 7f6a7a513640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6a740b4460 con 0x7f6a741600b0 2024-09-21T03:25:54.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.775+0000 7f6a7a513640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6a740d1ba0 con 0x7f6a740cf150 2024-09-21T03:25:54.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.775+0000 7f6a7a513640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6a740b45e0 con 0x7f6a740b7cc0 2024-09-21T03:25:54.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.775+0000 7f6a78ab0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a741600b0 0x7f6a741e7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:54.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.775+0000 7f6a78ab0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a741600b0 0x7f6a741e7040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:37892/0 (socket says 172.21.15.105:37892) 2024-09-21T03:25:54.778 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.775+0000 7f6a78ab0640 1 -- 172.21.15.105:0/948913614 learned_addr learned my addr 172.21.15.105:0/948913614 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:54.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.775+0000 7f6a73fff640 1 --2- 172.21.15.105:0/948913614 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a740b7cc0 0x7f6a7406f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:54.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.775+0000 7f6a737fe640 1 --2- 172.21.15.105:0/948913614 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a740cf150 0x7f6a740cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:54.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.775+0000 7f6a78ab0640 1 -- 172.21.15.105:0/948913614 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a740b7cc0 msgr2=0x7f6a7406f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:54.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.775+0000 7f6a78ab0640 1 --2- 172.21.15.105:0/948913614 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a740b7cc0 0x7f6a7406f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:54.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.775+0000 7f6a78ab0640 1 -- 172.21.15.105:0/948913614 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a740cf150 msgr2=0x7f6a740cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:54.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.775+0000 7f6a78ab0640 1 --2- 172.21.15.105:0/948913614 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a740cf150 0x7f6a740cc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:54.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.775+0000 7f6a78ab0640 1 -- 172.21.15.105:0/948913614 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a7406ee30 con 0x7f6a741600b0 2024-09-21T03:25:54.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.775+0000 7f6a737fe640 1 --2- 172.21.15.105:0/948913614 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a740cf150 0x7f6a740cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:25:54.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.776+0000 7f6a78ab0640 1 --2- 172.21.15.105:0/948913614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a741600b0 0x7f6a741e7040 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c00c780 tx=0x7f6a6c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:54.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.776+0000 7f6a70ff9640 1 -- 172.21.15.105:0/948913614 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c003b70 con 0x7f6a741600b0 2024-09-21T03:25:54.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.776+0000 7f6a70ff9640 1 -- 172.21.15.105:0/948913614 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a6c003d30 con 0x7f6a741600b0 2024-09-21T03:25:54.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.776+0000 7f6a7a513640 1 -- 172.21.15.105:0/948913614 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a7406e070 con 0x7f6a741600b0 2024-09-21T03:25:54.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.776+0000 7f6a70ff9640 1 -- 172.21.15.105:0/948913614 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c0052d0 con 0x7f6a741600b0 2024-09-21T03:25:54.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.776+0000 7f6a7a513640 1 -- 172.21.15.105:0/948913614 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a7406e630 con 0x7f6a741600b0 2024-09-21T03:25:54.780 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.777+0000 7f6a7a513640 1 -- 172.21.15.105:0/948913614 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a740d0050 con 0x7f6a741600b0 2024-09-21T03:25:54.780 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.778+0000 7f6a70ff9640 1 -- 172.21.15.105:0/948913614 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6a6c005470 con 0x7f6a741600b0 2024-09-21T03:25:54.780 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.778+0000 7f6a70ff9640 1 --2- 172.21.15.105:0/948913614 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6a60078bc0 0x7f6a6007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:54.780 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.778+0000 7f6a70ff9640 1 -- 172.21.15.105:0/948913614 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7f6a6c09a920 con 0x7f6a741600b0 2024-09-21T03:25:54.781 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.778+0000 7f6a73fff640 1 --2- 172.21.15.105:0/948913614 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6a60078bc0 0x7f6a6007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:54.781 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.779+0000 7f6a73fff640 1 --2- 172.21.15.105:0/948913614 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6a60078bc0 0x7f6a6007b0d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f6a6400bb50 tx=0x7f6a6400b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:54.784 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.783+0000 7f6a70ff9640 1 -- 172.21.15.105:0/948913614 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6a740d0050 con 0x7f6a741600b0 2024-09-21T03:25:54.957 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.955+0000 7f6a7a513640 1 -- 172.21.15.105:0/948913614 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6a740cec10 con 0x7f6a60078bc0 2024-09-21T03:25:54.961 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.960+0000 7f6a70ff9640 1 -- 172.21.15.105:0/948913614 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+238792 (secure 0 0 0) 0x7f6a740cec10 con 0x7f6a60078bc0 2024-09-21T03:25:54.964 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:54.965 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:25:54.966 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.963+0000 7f6a7a513640 1 -- 172.21.15.105:0/948913614 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6a60078bc0 msgr2=0x7f6a6007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:54.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.963+0000 7f6a7a513640 1 --2- 172.21.15.105:0/948913614 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6a60078bc0 0x7f6a6007b0d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f6a6400bb50 tx=0x7f6a6400b2e0 comp rx=0 tx=0).stop 2024-09-21T03:25:54.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.963+0000 7f6a7a513640 1 -- 172.21.15.105:0/948913614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a741600b0 msgr2=0x7f6a741e7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:54.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.963+0000 7f6a7a513640 1 --2- 172.21.15.105:0/948913614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a741600b0 0x7f6a741e7040 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c00c780 tx=0x7f6a6c00cc40 comp rx=0 tx=0).stop 2024-09-21T03:25:54.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.963+0000 7f6a7a513640 1 -- 172.21.15.105:0/948913614 shutdown_connections 2024-09-21T03:25:54.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.963+0000 7f6a7a513640 1 --2- 172.21.15.105:0/948913614 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6a60078bc0 0x7f6a6007b0d0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:54.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.963+0000 7f6a7a513640 1 --2- 172.21.15.105:0/948913614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a741600b0 0x7f6a741e7040 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:54.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.963+0000 7f6a7a513640 1 --2- 172.21.15.105:0/948913614 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a740cf150 0x7f6a740cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:54.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.963+0000 7f6a7a513640 1 --2- 172.21.15.105:0/948913614 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a740b7cc0 0x7f6a7406f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:54.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.963+0000 7f6a7a513640 1 -- 172.21.15.105:0/948913614 >> 172.21.15.105:0/948913614 conn(0x7f6a7406d4f0 msgr2=0x7f6a7415b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:54.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.963+0000 7f6a7a513640 1 -- 172.21.15.105:0/948913614 shutdown_connections 2024-09-21T03:25:54.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:54.963+0000 7f6a7a513640 1 -- 172.21.15.105:0/948913614 wait complete. 2024-09-21T03:25:54.976 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":338,"stamp":"2024-09-21T03:25:53.398875+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":107,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":20,"acting":20,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":269932,"kb_used_data":12064,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754704788,"statfs":{"total":773094113280,"available":772817702912,"internally_reserved":0,"allocated":12353536,"data_stored":5910740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.165894"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-21T03:25:51.261118+0000","last_change":"2024-09-21T03:25:51.258646+0000","last_active":"2024-09-21T03:25:51.261118+0000","last_peered":"2024-09-21T03:25:51.261118+0000","last_clean":"2024-09-21T03:25:51.261118+0000","last_became_active":"2024-09-21T03:25:51.258369+0000","last_became_peered":"2024-09-21T03:25:51.258369+0000","last_unstale":"2024-09-21T03:25:51.261118+0000","last_undegraded":"2024-09-21T03:25:51.261118+0000","last_fullsized":"2024-09-21T03:25:51.261118+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:27.385892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-21T03:25:51.262356+0000","last_change":"2024-09-21T03:25:51.260227+0000","last_active":"2024-09-21T03:25:51.262356+0000","last_peered":"2024-09-21T03:25:51.262356+0000","last_clean":"2024-09-21T03:25:51.262356+0000","last_became_active":"2024-09-21T03:25:51.259914+0000","last_became_peered":"2024-09-21T03:25:51.259914+0000","last_unstale":"2024-09-21T03:25:51.262356+0000","last_undegraded":"2024-09-21T03:25:51.262356+0000","last_fullsized":"2024-09-21T03:25:51.262356+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:01.563835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-21T03:25:51.265984+0000","last_change":"2024-09-21T03:25:51.261227+0000","last_active":"2024-09-21T03:25:51.265984+0000","last_peered":"2024-09-21T03:25:51.265984+0000","last_clean":"2024-09-21T03:25:51.265984+0000","last_became_active":"2024-09-21T03:25:51.260891+0000","last_became_peered":"2024-09-21T03:25:51.260891+0000","last_unstale":"2024-09-21T03:25:51.265984+0000","last_undegraded":"2024-09-21T03:25:51.265984+0000","last_fullsized":"2024-09-21T03:25:51.265984+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:22:44.855315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-21T03:25:51.266098+0000","last_change":"2024-09-21T03:25:51.262058+0000","last_active":"2024-09-21T03:25:51.266098+0000","last_peered":"2024-09-21T03:25:51.266098+0000","last_clean":"2024-09-21T03:25:51.266098+0000","last_became_active":"2024-09-21T03:25:51.261722+0000","last_became_peered":"2024-09-21T03:25:51.261722+0000","last_unstale":"2024-09-21T03:25:51.266098+0000","last_undegraded":"2024-09-21T03:25:51.266098+0000","last_fullsized":"2024-09-21T03:25:51.266098+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:15.521544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1d","version":"115'2","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-21T03:25:51.271213+0000","last_change":"2024-09-21T03:25:50.247877+0000","last_active":"2024-09-21T03:25:51.271213+0000","last_peered":"2024-09-21T03:25:51.271213+0000","last_clean":"2024-09-21T03:25:51.271213+0000","last_became_active":"2024-09-21T03:25:50.247575+0000","last_became_peered":"2024-09-21T03:25:50.247575+0000","last_unstale":"2024-09-21T03:25:51.271213+0000","last_undegraded":"2024-09-21T03:25:51.271213+0000","last_fullsized":"2024-09-21T03:25:51.271213+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:38.761687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.e","version":"115'2","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-21T03:25:51.263507+0000","last_change":"2024-09-21T03:25:50.249322+0000","last_active":"2024-09-21T03:25:51.263507+0000","last_peered":"2024-09-21T03:25:51.263507+0000","last_clean":"2024-09-21T03:25:51.263507+0000","last_became_active":"2024-09-21T03:25:50.249036+0000","last_became_peered":"2024-09-21T03:25:50.249036+0000","last_unstale":"2024-09-21T03:25:51.263507+0000","last_undegraded":"2024-09-21T03:25:51.263507+0000","last_fullsized":"2024-09-21T03:25:51.263507+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:57.753544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-21T03:25:51.247530+0000","last_change":"2024-09-21T03:25:50.248647+0000","last_active":"2024-09-21T03:25:51.247530+0000","last_peered":"2024-09-21T03:25:51.247530+0000","last_clean":"2024-09-21T03:25:51.247530+0000","last_became_active":"2024-09-21T03:25:50.248231+0000","last_became_peered":"2024-09-21T03:25:50.248231+0000","last_unstale":"2024-09-21T03:25:51.247530+0000","last_undegraded":"2024-09-21T03:25:51.247530+0000","last_fullsized":"2024-09-21T03:25:51.247530+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:05.855445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-21T03:25:51.247851+0000","last_change":"2024-09-21T03:25:50.259220+0000","last_active":"2024-09-21T03:25:51.247851+0000","last_peered":"2024-09-21T03:25:51.247851+0000","last_clean":"2024-09-21T03:25:51.247851+0000","last_became_active":"2024-09-21T03:25:50.258897+0000","last_became_peered":"2024-09-21T03:25:50.258897+0000","last_unstale":"2024-09-21T03:25:51.247851+0000","last_undegraded":"2024-09-21T03:25:51.247851+0000","last_fullsized":"2024-09-21T03:25:51.247851+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:22.679163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-21T03:25:51.248354+0000","last_change":"2024-09-21T03:25:50.252759+0000","last_active":"2024-09-21T03:25:51.248354+0000","last_peered":"2024-09-21T03:25:51.248354+0000","last_clean":"2024-09-21T03:25:51.248354+0000","last_became_active":"2024-09-21T03:25:50.252445+0000","last_became_peered":"2024-09-21T03:25:50.252445+0000","last_unstale":"2024-09-21T03:25:51.248354+0000","last_undegraded":"2024-09-21T03:25:51.248354+0000","last_fullsized":"2024-09-21T03:25:51.248354+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:10.447482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:50.229682+0000","last_change":"2024-09-21T03:25:50.229682+0000","last_active":"2024-09-21T03:25:50.229682+0000","last_peered":"2024-09-21T03:25:50.229682+0000","last_clean":"2024-09-21T03:25:50.229682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:50.229682+0000","last_undegraded":"2024-09-21T03:25:50.229682+0000","last_fullsized":"2024-09-21T03:25:50.229682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T03:25:49.227905+0000","last_change":"2024-09-21T03:25:49.227905+0000","last_active":"2024-09-21T03:25:49.227905+0000","last_peered":"2024-09-21T03:25:49.227905+0000","last_clean":"2024-09-21T03:25:49.227905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:25:49.227905+0000","last_undegraded":"2024-09-21T03:25:49.227905+0000","last_fullsized":"2024-09-21T03:25:49.227905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":278,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-21T03:25:47.262025+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:25:47.262025+0000","last_peered":"2024-09-21T03:25:47.262025+0000","last_clean":"2024-09-21T03:25:47.262025+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:25:47.262025+0000","last_undegraded":"2024-09-21T03:25:47.262025+0000","last_fullsized":"2024-09-21T03:25:47.262025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":8,"acting":8,"num_store_stats":1},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":10,"acting":10,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509535,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33132,"kb_used_data":1940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338708,"statfs":{"total":96636764160,"available":96602836992,"internally_reserved":0,"allocated":1986560,"data_stored":1180107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32564,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1392640,"data_stored":589739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509533,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32552,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339288,"statfs":{"total":96636764160,"available":96603430912,"internally_reserved":0,"allocated":1392640,"data_stored":589739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509533,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32560,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1392640,"data_stored":589739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32552,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339288,"statfs":{"total":96636764160,"available":96603430912,"internally_reserved":0,"allocated":1392640,"data_stored":589739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36708,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335132,"statfs":{"total":96636764160,"available":96599175168,"internally_reserved":0,"allocated":1392640,"data_stored":589739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36708,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335132,"statfs":{"total":96636764160,"available":96599175168,"internally_reserved":0,"allocated":1392640,"data_stored":589739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574942,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33156,"kb_used_data":1964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338684,"statfs":{"total":96636764160,"available":96602812416,"internally_reserved":0,"allocated":2011136,"data_stored":1192199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:25:54.979 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3f is not active+clean 2024-09-21T03:25:54.979 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.979 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3e is not active+clean 2024-09-21T03:25:54.979 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.979 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3d is not active+clean 2024-09-21T03:25:54.980 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.980 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3c is not active+clean 2024-09-21T03:25:54.980 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.980 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3b is not active+clean 2024-09-21T03:25:54.980 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.980 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3a is not active+clean 2024-09-21T03:25:54.980 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.980 INFO:tasks.ceph.ceph_manager.ceph:PG 19.39 is not active+clean 2024-09-21T03:25:54.980 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.980 INFO:tasks.ceph.ceph_manager.ceph:PG 19.38 is not active+clean 2024-09-21T03:25:54.980 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.981 INFO:tasks.ceph.ceph_manager.ceph:PG 19.37 is not active+clean 2024-09-21T03:25:54.981 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.981 INFO:tasks.ceph.ceph_manager.ceph:PG 19.36 is not active+clean 2024-09-21T03:25:54.981 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.981 INFO:tasks.ceph.ceph_manager.ceph:PG 19.34 is not active+clean 2024-09-21T03:25:54.981 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.981 INFO:tasks.ceph.ceph_manager.ceph:PG 19.33 is not active+clean 2024-09-21T03:25:54.981 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.981 INFO:tasks.ceph.ceph_manager.ceph:PG 19.32 is not active+clean 2024-09-21T03:25:54.981 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.981 INFO:tasks.ceph.ceph_manager.ceph:PG 19.31 is not active+clean 2024-09-21T03:25:54.981 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.982 INFO:tasks.ceph.ceph_manager.ceph:PG 19.30 is not active+clean 2024-09-21T03:25:54.982 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.982 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2f is not active+clean 2024-09-21T03:25:54.982 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.982 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2e is not active+clean 2024-09-21T03:25:54.982 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.982 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2c is not active+clean 2024-09-21T03:25:54.982 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.982 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2b is not active+clean 2024-09-21T03:25:54.982 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.982 INFO:tasks.ceph.ceph_manager.ceph:PG 19.29 is not active+clean 2024-09-21T03:25:54.983 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.983 INFO:tasks.ceph.ceph_manager.ceph:PG 19.27 is not active+clean 2024-09-21T03:25:54.983 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.983 INFO:tasks.ceph.ceph_manager.ceph:PG 19.26 is not active+clean 2024-09-21T03:25:54.983 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.983 INFO:tasks.ceph.ceph_manager.ceph:PG 19.25 is not active+clean 2024-09-21T03:25:54.983 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.983 INFO:tasks.ceph.ceph_manager.ceph:PG 19.24 is not active+clean 2024-09-21T03:25:54.983 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.983 INFO:tasks.ceph.ceph_manager.ceph:PG 19.23 is not active+clean 2024-09-21T03:25:54.983 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.983 INFO:tasks.ceph.ceph_manager.ceph:PG 19.22 is not active+clean 2024-09-21T03:25:54.984 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.984 INFO:tasks.ceph.ceph_manager.ceph:PG 19.21 is not active+clean 2024-09-21T03:25:54.984 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.984 INFO:tasks.ceph.ceph_manager.ceph:PG 19.20 is not active+clean 2024-09-21T03:25:54.984 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.984 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1e is not active+clean 2024-09-21T03:25:54.984 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.984 INFO:tasks.ceph.ceph_manager.ceph:PG 18.1f is not active+clean 2024-09-21T03:25:54.984 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:49.227905+0000', 'last_change': '2024-09-21T03:25:49.227905+0000', 'last_active': '2024-09-21T03:25:49.227905+0000', 'last_peered': '2024-09-21T03:25:49.227905+0000', 'last_clean': '2024-09-21T03:25:49.227905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:49.227905+0000', 'last_undegraded': '2024-09-21T03:25:49.227905+0000', 'last_fullsized': '2024-09-21T03:25:49.227905+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.984 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1f is not active+clean 2024-09-21T03:25:54.984 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.984 INFO:tasks.ceph.ceph_manager.ceph:PG 18.1e is not active+clean 2024-09-21T03:25:54.984 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:49.227905+0000', 'last_change': '2024-09-21T03:25:49.227905+0000', 'last_active': '2024-09-21T03:25:49.227905+0000', 'last_peered': '2024-09-21T03:25:49.227905+0000', 'last_clean': '2024-09-21T03:25:49.227905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:49.227905+0000', 'last_undegraded': '2024-09-21T03:25:49.227905+0000', 'last_fullsized': '2024-09-21T03:25:49.227905+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.985 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1c is not active+clean 2024-09-21T03:25:54.985 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.985 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1d is not active+clean 2024-09-21T03:25:54.985 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.985 INFO:tasks.ceph.ceph_manager.ceph:PG 18.1c is not active+clean 2024-09-21T03:25:54.985 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:49.227905+0000', 'last_change': '2024-09-21T03:25:49.227905+0000', 'last_active': '2024-09-21T03:25:49.227905+0000', 'last_peered': '2024-09-21T03:25:49.227905+0000', 'last_clean': '2024-09-21T03:25:49.227905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:49.227905+0000', 'last_undegraded': '2024-09-21T03:25:49.227905+0000', 'last_fullsized': '2024-09-21T03:25:49.227905+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.985 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1a is not active+clean 2024-09-21T03:25:54.985 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.985 INFO:tasks.ceph.ceph_manager.ceph:PG 18.1b is not active+clean 2024-09-21T03:25:54.985 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:49.227905+0000', 'last_change': '2024-09-21T03:25:49.227905+0000', 'last_active': '2024-09-21T03:25:49.227905+0000', 'last_peered': '2024-09-21T03:25:49.227905+0000', 'last_clean': '2024-09-21T03:25:49.227905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:49.227905+0000', 'last_undegraded': '2024-09-21T03:25:49.227905+0000', 'last_fullsized': '2024-09-21T03:25:49.227905+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.985 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1b is not active+clean 2024-09-21T03:25:54.985 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.986 INFO:tasks.ceph.ceph_manager.ceph:PG 18.1a is not active+clean 2024-09-21T03:25:54.986 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:49.227905+0000', 'last_change': '2024-09-21T03:25:49.227905+0000', 'last_active': '2024-09-21T03:25:49.227905+0000', 'last_peered': '2024-09-21T03:25:49.227905+0000', 'last_clean': '2024-09-21T03:25:49.227905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:49.227905+0000', 'last_undegraded': '2024-09-21T03:25:49.227905+0000', 'last_fullsized': '2024-09-21T03:25:49.227905+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.986 INFO:tasks.ceph.ceph_manager.ceph:PG 19.18 is not active+clean 2024-09-21T03:25:54.986 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.986 INFO:tasks.ceph.ceph_manager.ceph:PG 18.19 is not active+clean 2024-09-21T03:25:54.986 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:49.227905+0000', 'last_change': '2024-09-21T03:25:49.227905+0000', 'last_active': '2024-09-21T03:25:49.227905+0000', 'last_peered': '2024-09-21T03:25:49.227905+0000', 'last_clean': '2024-09-21T03:25:49.227905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:49.227905+0000', 'last_undegraded': '2024-09-21T03:25:49.227905+0000', 'last_fullsized': '2024-09-21T03:25:49.227905+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.986 INFO:tasks.ceph.ceph_manager.ceph:PG 19.19 is not active+clean 2024-09-21T03:25:54.986 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.986 INFO:tasks.ceph.ceph_manager.ceph:PG 18.18 is not active+clean 2024-09-21T03:25:54.986 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:49.227905+0000', 'last_change': '2024-09-21T03:25:49.227905+0000', 'last_active': '2024-09-21T03:25:49.227905+0000', 'last_peered': '2024-09-21T03:25:49.227905+0000', 'last_clean': '2024-09-21T03:25:49.227905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:49.227905+0000', 'last_undegraded': '2024-09-21T03:25:49.227905+0000', 'last_fullsized': '2024-09-21T03:25:49.227905+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.986 INFO:tasks.ceph.ceph_manager.ceph:PG 19.16 is not active+clean 2024-09-21T03:25:54.986 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.987 INFO:tasks.ceph.ceph_manager.ceph:PG 18.17 is not active+clean 2024-09-21T03:25:54.987 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:49.227905+0000', 'last_change': '2024-09-21T03:25:49.227905+0000', 'last_active': '2024-09-21T03:25:49.227905+0000', 'last_peered': '2024-09-21T03:25:49.227905+0000', 'last_clean': '2024-09-21T03:25:49.227905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:49.227905+0000', 'last_undegraded': '2024-09-21T03:25:49.227905+0000', 'last_fullsized': '2024-09-21T03:25:49.227905+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.987 INFO:tasks.ceph.ceph_manager.ceph:PG 19.17 is not active+clean 2024-09-21T03:25:54.987 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.987 INFO:tasks.ceph.ceph_manager.ceph:PG 18.16 is not active+clean 2024-09-21T03:25:54.987 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:49.227905+0000', 'last_change': '2024-09-21T03:25:49.227905+0000', 'last_active': '2024-09-21T03:25:49.227905+0000', 'last_peered': '2024-09-21T03:25:49.227905+0000', 'last_clean': '2024-09-21T03:25:49.227905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:49.227905+0000', 'last_undegraded': '2024-09-21T03:25:49.227905+0000', 'last_fullsized': '2024-09-21T03:25:49.227905+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.987 INFO:tasks.ceph.ceph_manager.ceph:PG 19.14 is not active+clean 2024-09-21T03:25:54.987 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.987 INFO:tasks.ceph.ceph_manager.ceph:PG 18.15 is not active+clean 2024-09-21T03:25:54.987 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:49.227905+0000', 'last_change': '2024-09-21T03:25:49.227905+0000', 'last_active': '2024-09-21T03:25:49.227905+0000', 'last_peered': '2024-09-21T03:25:49.227905+0000', 'last_clean': '2024-09-21T03:25:49.227905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:49.227905+0000', 'last_undegraded': '2024-09-21T03:25:49.227905+0000', 'last_fullsized': '2024-09-21T03:25:49.227905+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.987 INFO:tasks.ceph.ceph_manager.ceph:PG 19.15 is not active+clean 2024-09-21T03:25:54.987 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.988 INFO:tasks.ceph.ceph_manager.ceph:PG 18.14 is not active+clean 2024-09-21T03:25:54.988 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:49.227905+0000', 'last_change': '2024-09-21T03:25:49.227905+0000', 'last_active': '2024-09-21T03:25:49.227905+0000', 'last_peered': '2024-09-21T03:25:49.227905+0000', 'last_clean': '2024-09-21T03:25:49.227905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:49.227905+0000', 'last_undegraded': '2024-09-21T03:25:49.227905+0000', 'last_fullsized': '2024-09-21T03:25:49.227905+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.988 INFO:tasks.ceph.ceph_manager.ceph:PG 19.13 is not active+clean 2024-09-21T03:25:54.988 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.988 INFO:tasks.ceph.ceph_manager.ceph:PG 18.12 is not active+clean 2024-09-21T03:25:54.988 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:49.227905+0000', 'last_change': '2024-09-21T03:25:49.227905+0000', 'last_active': '2024-09-21T03:25:49.227905+0000', 'last_peered': '2024-09-21T03:25:49.227905+0000', 'last_clean': '2024-09-21T03:25:49.227905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:49.227905+0000', 'last_undegraded': '2024-09-21T03:25:49.227905+0000', 'last_fullsized': '2024-09-21T03:25:49.227905+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.988 INFO:tasks.ceph.ceph_manager.ceph:PG 19.10 is not active+clean 2024-09-21T03:25:54.988 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.988 INFO:tasks.ceph.ceph_manager.ceph:PG 18.11 is not active+clean 2024-09-21T03:25:54.988 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:49.227905+0000', 'last_change': '2024-09-21T03:25:49.227905+0000', 'last_active': '2024-09-21T03:25:49.227905+0000', 'last_peered': '2024-09-21T03:25:49.227905+0000', 'last_clean': '2024-09-21T03:25:49.227905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:49.227905+0000', 'last_undegraded': '2024-09-21T03:25:49.227905+0000', 'last_fullsized': '2024-09-21T03:25:49.227905+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.988 INFO:tasks.ceph.ceph_manager.ceph:PG 19.11 is not active+clean 2024-09-21T03:25:54.989 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.989 INFO:tasks.ceph.ceph_manager.ceph:PG 18.10 is not active+clean 2024-09-21T03:25:54.989 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:49.227905+0000', 'last_change': '2024-09-21T03:25:49.227905+0000', 'last_active': '2024-09-21T03:25:49.227905+0000', 'last_peered': '2024-09-21T03:25:49.227905+0000', 'last_clean': '2024-09-21T03:25:49.227905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:49.227905+0000', 'last_undegraded': '2024-09-21T03:25:49.227905+0000', 'last_fullsized': '2024-09-21T03:25:49.227905+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.989 INFO:tasks.ceph.ceph_manager.ceph:PG 19.e is not active+clean 2024-09-21T03:25:54.989 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.989 INFO:tasks.ceph.ceph_manager.ceph:PG 18.f is not active+clean 2024-09-21T03:25:54.989 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:49.227905+0000', 'last_change': '2024-09-21T03:25:49.227905+0000', 'last_active': '2024-09-21T03:25:49.227905+0000', 'last_peered': '2024-09-21T03:25:49.227905+0000', 'last_clean': '2024-09-21T03:25:49.227905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:49.227905+0000', 'last_undegraded': '2024-09-21T03:25:49.227905+0000', 'last_fullsized': '2024-09-21T03:25:49.227905+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.989 INFO:tasks.ceph.ceph_manager.ceph:PG 19.f is not active+clean 2024-09-21T03:25:54.989 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.989 INFO:tasks.ceph.ceph_manager.ceph:PG 19.c is not active+clean 2024-09-21T03:25:54.989 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.989 INFO:tasks.ceph.ceph_manager.ceph:PG 18.d is not active+clean 2024-09-21T03:25:54.990 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:49.227905+0000', 'last_change': '2024-09-21T03:25:49.227905+0000', 'last_active': '2024-09-21T03:25:49.227905+0000', 'last_peered': '2024-09-21T03:25:49.227905+0000', 'last_clean': '2024-09-21T03:25:49.227905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:49.227905+0000', 'last_undegraded': '2024-09-21T03:25:49.227905+0000', 'last_fullsized': '2024-09-21T03:25:49.227905+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.990 INFO:tasks.ceph.ceph_manager.ceph:PG 19.d is not active+clean 2024-09-21T03:25:54.990 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.990 INFO:tasks.ceph.ceph_manager.ceph:PG 18.c is not active+clean 2024-09-21T03:25:54.990 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:49.227905+0000', 'last_change': '2024-09-21T03:25:49.227905+0000', 'last_active': '2024-09-21T03:25:49.227905+0000', 'last_peered': '2024-09-21T03:25:49.227905+0000', 'last_clean': '2024-09-21T03:25:49.227905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:49.227905+0000', 'last_undegraded': '2024-09-21T03:25:49.227905+0000', 'last_fullsized': '2024-09-21T03:25:49.227905+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.990 INFO:tasks.ceph.ceph_manager.ceph:PG 19.a is not active+clean 2024-09-21T03:25:54.990 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.990 INFO:tasks.ceph.ceph_manager.ceph:PG 18.b is not active+clean 2024-09-21T03:25:54.990 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:49.227905+0000', 'last_change': '2024-09-21T03:25:49.227905+0000', 'last_active': '2024-09-21T03:25:49.227905+0000', 'last_peered': '2024-09-21T03:25:49.227905+0000', 'last_clean': '2024-09-21T03:25:49.227905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:49.227905+0000', 'last_undegraded': '2024-09-21T03:25:49.227905+0000', 'last_fullsized': '2024-09-21T03:25:49.227905+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.990 INFO:tasks.ceph.ceph_manager.ceph:PG 19.b is not active+clean 2024-09-21T03:25:54.990 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.991 INFO:tasks.ceph.ceph_manager.ceph:PG 18.a is not active+clean 2024-09-21T03:25:54.991 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:49.227905+0000', 'last_change': '2024-09-21T03:25:49.227905+0000', 'last_active': '2024-09-21T03:25:49.227905+0000', 'last_peered': '2024-09-21T03:25:49.227905+0000', 'last_clean': '2024-09-21T03:25:49.227905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:49.227905+0000', 'last_undegraded': '2024-09-21T03:25:49.227905+0000', 'last_fullsized': '2024-09-21T03:25:49.227905+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.991 INFO:tasks.ceph.ceph_manager.ceph:PG 19.8 is not active+clean 2024-09-21T03:25:54.991 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.991 INFO:tasks.ceph.ceph_manager.ceph:PG 18.9 is not active+clean 2024-09-21T03:25:54.991 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:49.227905+0000', 'last_change': '2024-09-21T03:25:49.227905+0000', 'last_active': '2024-09-21T03:25:49.227905+0000', 'last_peered': '2024-09-21T03:25:49.227905+0000', 'last_clean': '2024-09-21T03:25:49.227905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:49.227905+0000', 'last_undegraded': '2024-09-21T03:25:49.227905+0000', 'last_fullsized': '2024-09-21T03:25:49.227905+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.991 INFO:tasks.ceph.ceph_manager.ceph:PG 19.9 is not active+clean 2024-09-21T03:25:54.991 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.991 INFO:tasks.ceph.ceph_manager.ceph:PG 19.6 is not active+clean 2024-09-21T03:25:54.991 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.991 INFO:tasks.ceph.ceph_manager.ceph:PG 18.7 is not active+clean 2024-09-21T03:25:54.992 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:49.227905+0000', 'last_change': '2024-09-21T03:25:49.227905+0000', 'last_active': '2024-09-21T03:25:49.227905+0000', 'last_peered': '2024-09-21T03:25:49.227905+0000', 'last_clean': '2024-09-21T03:25:49.227905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:49.227905+0000', 'last_undegraded': '2024-09-21T03:25:49.227905+0000', 'last_fullsized': '2024-09-21T03:25:49.227905+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.992 INFO:tasks.ceph.ceph_manager.ceph:PG 19.7 is not active+clean 2024-09-21T03:25:54.992 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.992 INFO:tasks.ceph.ceph_manager.ceph:PG 18.6 is not active+clean 2024-09-21T03:25:54.992 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:49.227905+0000', 'last_change': '2024-09-21T03:25:49.227905+0000', 'last_active': '2024-09-21T03:25:49.227905+0000', 'last_peered': '2024-09-21T03:25:49.227905+0000', 'last_clean': '2024-09-21T03:25:49.227905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:49.227905+0000', 'last_undegraded': '2024-09-21T03:25:49.227905+0000', 'last_fullsized': '2024-09-21T03:25:49.227905+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.992 INFO:tasks.ceph.ceph_manager.ceph:PG 19.4 is not active+clean 2024-09-21T03:25:54.992 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.992 INFO:tasks.ceph.ceph_manager.ceph:PG 18.5 is not active+clean 2024-09-21T03:25:54.992 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:49.227905+0000', 'last_change': '2024-09-21T03:25:49.227905+0000', 'last_active': '2024-09-21T03:25:49.227905+0000', 'last_peered': '2024-09-21T03:25:49.227905+0000', 'last_clean': '2024-09-21T03:25:49.227905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:49.227905+0000', 'last_undegraded': '2024-09-21T03:25:49.227905+0000', 'last_fullsized': '2024-09-21T03:25:49.227905+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.992 INFO:tasks.ceph.ceph_manager.ceph:PG 19.5 is not active+clean 2024-09-21T03:25:54.992 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.992 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2 is not active+clean 2024-09-21T03:25:54.993 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.993 INFO:tasks.ceph.ceph_manager.ceph:PG 18.3 is not active+clean 2024-09-21T03:25:54.993 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:49.227905+0000', 'last_change': '2024-09-21T03:25:49.227905+0000', 'last_active': '2024-09-21T03:25:49.227905+0000', 'last_peered': '2024-09-21T03:25:49.227905+0000', 'last_clean': '2024-09-21T03:25:49.227905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:49.227905+0000', 'last_undegraded': '2024-09-21T03:25:49.227905+0000', 'last_fullsized': '2024-09-21T03:25:49.227905+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.993 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3 is not active+clean 2024-09-21T03:25:54.993 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.993 INFO:tasks.ceph.ceph_manager.ceph:PG 18.2 is not active+clean 2024-09-21T03:25:54.993 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:49.227905+0000', 'last_change': '2024-09-21T03:25:49.227905+0000', 'last_active': '2024-09-21T03:25:49.227905+0000', 'last_peered': '2024-09-21T03:25:49.227905+0000', 'last_clean': '2024-09-21T03:25:49.227905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:49.227905+0000', 'last_undegraded': '2024-09-21T03:25:49.227905+0000', 'last_fullsized': '2024-09-21T03:25:49.227905+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.993 INFO:tasks.ceph.ceph_manager.ceph:PG 19.0 is not active+clean 2024-09-21T03:25:54.993 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.993 INFO:tasks.ceph.ceph_manager.ceph:PG 18.1 is not active+clean 2024-09-21T03:25:54.993 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:49.227905+0000', 'last_change': '2024-09-21T03:25:49.227905+0000', 'last_active': '2024-09-21T03:25:49.227905+0000', 'last_peered': '2024-09-21T03:25:49.227905+0000', 'last_clean': '2024-09-21T03:25:49.227905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:49.227905+0000', 'last_undegraded': '2024-09-21T03:25:49.227905+0000', 'last_fullsized': '2024-09-21T03:25:49.227905+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.994 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1 is not active+clean 2024-09-21T03:25:54.994 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.994 INFO:tasks.ceph.ceph_manager.ceph:PG 19.12 is not active+clean 2024-09-21T03:25:54.994 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:50.229682+0000', 'last_change': '2024-09-21T03:25:50.229682+0000', 'last_active': '2024-09-21T03:25:50.229682+0000', 'last_peered': '2024-09-21T03:25:50.229682+0000', 'last_clean': '2024-09-21T03:25:50.229682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:50.229682+0000', 'last_undegraded': '2024-09-21T03:25:50.229682+0000', 'last_fullsized': '2024-09-21T03:25:50.229682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:50.229682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.994 INFO:tasks.ceph.ceph_manager.ceph:PG 18.13 is not active+clean 2024-09-21T03:25:54.994 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T03:25:49.227905+0000', 'last_change': '2024-09-21T03:25:49.227905+0000', 'last_active': '2024-09-21T03:25:49.227905+0000', 'last_peered': '2024-09-21T03:25:49.227905+0000', 'last_clean': '2024-09-21T03:25:49.227905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:25:49.227905+0000', 'last_undegraded': '2024-09-21T03:25:49.227905+0000', 'last_fullsized': '2024-09-21T03:25:49.227905+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'last_clean_scrub_stamp': '2024-09-21T03:25:49.227905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T03:25:54.994 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T03:25:55.128 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.126+0000 7fcf8a7c3640 1 -- 172.21.15.105:0/1644782695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf840cff40 msgr2=0x7fcf8415d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:55.128 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.126+0000 7fcf8a7c3640 1 --2- 172.21.15.105:0/1644782695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf840cff40 0x7fcf8415d7d0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fcf74009830 tx=0x7fcf7402a510 comp rx=0 tx=0).stop 2024-09-21T03:25:55.129 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.126+0000 7fcf8a7c3640 1 -- 172.21.15.105:0/1644782695 shutdown_connections 2024-09-21T03:25:55.129 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.126+0000 7fcf8a7c3640 1 --2- 172.21.15.105:0/1644782695 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf840cd370 0x7fcf8415dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:55.129 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.126+0000 7fcf8a7c3640 1 --2- 172.21.15.105:0/1644782695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf840cff40 0x7fcf8415d7d0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:55.129 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.126+0000 7fcf8a7c3640 1 -- 172.21.15.105:0/1644782695 >> 172.21.15.105:0/1644782695 conn(0x7fcf8406d230 msgr2=0x7fcf8406d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:55.129 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.126+0000 7fcf8a7c3640 1 -- 172.21.15.105:0/1644782695 shutdown_connections 2024-09-21T03:25:55.129 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.127+0000 7fcf8a7c3640 1 -- 172.21.15.105:0/1644782695 wait complete. 2024-09-21T03:25:55.130 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.128+0000 7fcf8a7c3640 1 Processor -- start 2024-09-21T03:25:55.130 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.128+0000 7fcf8a7c3640 1 -- start start 2024-09-21T03:25:55.132 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.130+0000 7fcf8a7c3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf840cff40 0x7fcf841f9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:55.133 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.130+0000 7fcf8a7c3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf8415c8b0 0x7fcf84151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:55.133 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.130+0000 7fcf8a7c3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf841e72c0 0x7fcf841e76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:55.133 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.130+0000 7fcf8a7c3640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8415eb10 con 0x7fcf840cff40 2024-09-21T03:25:55.133 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.130+0000 7fcf8a7c3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8415e990 con 0x7fcf8415c8b0 2024-09-21T03:25:55.133 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.130+0000 7fcf8a7c3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcf8415ec90 con 0x7fcf841e72c0 2024-09-21T03:25:55.133 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.130+0000 7fcf83fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf840cff40 0x7fcf841f9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:55.133 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.130+0000 7fcf83fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf840cff40 0x7fcf841f9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:37902/0 (socket says 172.21.15.105:37902) 2024-09-21T03:25:55.133 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.130+0000 7fcf83fff640 1 -- 172.21.15.105:0/1947881091 learned_addr learned my addr 172.21.15.105:0/1947881091 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:55.133 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.130+0000 7fcf88d60640 1 --2- 172.21.15.105:0/1947881091 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf841e72c0 0x7fcf841e76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:55.133 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.130+0000 7fcf837fe640 1 --2- 172.21.15.105:0/1947881091 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf8415c8b0 0x7fcf84151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:55.133 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.130+0000 7fcf83fff640 1 -- 172.21.15.105:0/1947881091 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf841e72c0 msgr2=0x7fcf841e76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:55.133 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.130+0000 7fcf83fff640 1 --2- 172.21.15.105:0/1947881091 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf841e72c0 0x7fcf841e76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:55.133 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.130+0000 7fcf83fff640 1 -- 172.21.15.105:0/1947881091 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf8415c8b0 msgr2=0x7fcf84151770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:55.134 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.130+0000 7fcf83fff640 1 --2- 172.21.15.105:0/1947881091 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf8415c8b0 0x7fcf84151770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:55.134 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.130+0000 7fcf83fff640 1 -- 172.21.15.105:0/1947881091 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf841e7c10 con 0x7fcf840cff40 2024-09-21T03:25:55.134 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.130+0000 7fcf837fe640 1 --2- 172.21.15.105:0/1947881091 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf8415c8b0 0x7fcf84151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:25:55.134 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.130+0000 7fcf83fff640 1 --2- 172.21.15.105:0/1947881091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf840cff40 0x7fcf841f9000 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fcf7402ab00 tx=0x7fcf74033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:55.134 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.130+0000 7fcf80ff9640 1 -- 172.21.15.105:0/1947881091 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf74031d60 con 0x7fcf840cff40 2024-09-21T03:25:55.134 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.131+0000 7fcf80ff9640 1 -- 172.21.15.105:0/1947881091 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf74033e10 con 0x7fcf840cff40 2024-09-21T03:25:55.134 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.131+0000 7fcf8a7c3640 1 -- 172.21.15.105:0/1947881091 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf841f5270 con 0x7fcf840cff40 2024-09-21T03:25:55.134 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.131+0000 7fcf80ff9640 1 -- 172.21.15.105:0/1947881091 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf74005260 con 0x7fcf840cff40 2024-09-21T03:25:55.134 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.131+0000 7fcf8a7c3640 1 -- 172.21.15.105:0/1947881091 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf841f5830 con 0x7fcf840cff40 2024-09-21T03:25:55.135 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.131+0000 7fcf8a7c3640 1 -- 172.21.15.105:0/1947881091 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf840cde30 con 0x7fcf840cff40 2024-09-21T03:25:55.135 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.132+0000 7fcf80ff9640 1 -- 172.21.15.105:0/1947881091 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcf74005400 con 0x7fcf840cff40 2024-09-21T03:25:55.135 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.133+0000 7fcf80ff9640 1 --2- 172.21.15.105:0/1947881091 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcf70078bc0 0x7fcf7007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:55.135 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.133+0000 7fcf80ff9640 1 -- 172.21.15.105:0/1947881091 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7fcf740bbf40 con 0x7fcf840cff40 2024-09-21T03:25:55.135 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.133+0000 7fcf837fe640 1 --2- 172.21.15.105:0/1947881091 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcf70078bc0 0x7fcf7007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:55.135 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.133+0000 7fcf837fe640 1 --2- 172.21.15.105:0/1947881091 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcf70078bc0 0x7fcf7007b0d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fcf840cd0d0 tx=0x7fcf78009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:55.139 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.137+0000 7fcf80ff9640 1 -- 172.21.15.105:0/1947881091 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fcf840cde30 con 0x7fcf840cff40 2024-09-21T03:25:55.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.383+0000 7fcf8a7c3640 1 -- 172.21.15.105:0/1947881091 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fcf8415f220 con 0x7fcf840cff40 2024-09-21T03:25:55.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.383+0000 7fcf80ff9640 1 -- 172.21.15.105:0/1947881091 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1548 (secure 0 0 0) 0x7fcf841e7c10 con 0x7fcf840cff40 2024-09-21T03:25:55.385 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:55.385 INFO:teuthology.orchestra.run.smithi105.stdout:{"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":470,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":116,"num_osds":8,"num_up_osds":8,"osd_up_since":1726888698,"num_in_osds":8,"osd_in_since":1726888688,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":87},{"state_name":"active+clean","count":10}],"num_pgs":97,"num_pools":3,"num_objects":4,"data_bytes":590368,"bytes_used":276410368,"bytes_avail":772817702912,"bytes_total":773094113280,"unknown_pgs_ratio":0.89690721035003662,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":73,"btime":"2024-09-21T03:25:53:258473+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":7593}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2024-09-21T03:24:55.383365+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T03:25:55.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.385+0000 7fcf8a7c3640 1 -- 172.21.15.105:0/1947881091 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcf70078bc0 msgr2=0x7fcf7007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:55.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.385+0000 7fcf8a7c3640 1 --2- 172.21.15.105:0/1947881091 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcf70078bc0 0x7fcf7007b0d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fcf840cd0d0 tx=0x7fcf78009040 comp rx=0 tx=0).stop 2024-09-21T03:25:55.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.385+0000 7fcf8a7c3640 1 -- 172.21.15.105:0/1947881091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf840cff40 msgr2=0x7fcf841f9000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:55.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.385+0000 7fcf8a7c3640 1 --2- 172.21.15.105:0/1947881091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf840cff40 0x7fcf841f9000 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fcf7402ab00 tx=0x7fcf74033c20 comp rx=0 tx=0).stop 2024-09-21T03:25:55.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.385+0000 7fcf8a7c3640 1 -- 172.21.15.105:0/1947881091 shutdown_connections 2024-09-21T03:25:55.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.385+0000 7fcf8a7c3640 1 --2- 172.21.15.105:0/1947881091 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcf70078bc0 0x7fcf7007b0d0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:55.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.385+0000 7fcf8a7c3640 1 --2- 172.21.15.105:0/1947881091 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf841e72c0 0x7fcf841e76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:55.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.385+0000 7fcf8a7c3640 1 --2- 172.21.15.105:0/1947881091 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf8415c8b0 0x7fcf84151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:55.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.385+0000 7fcf8a7c3640 1 --2- 172.21.15.105:0/1947881091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf840cff40 0x7fcf841f9000 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:55.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.385+0000 7fcf8a7c3640 1 -- 172.21.15.105:0/1947881091 >> 172.21.15.105:0/1947881091 conn(0x7fcf8406d230 msgr2=0x7fcf84071180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:55.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.386+0000 7fcf8a7c3640 1 -- 172.21.15.105:0/1947881091 shutdown_connections 2024-09-21T03:25:55.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.386+0000 7fcf8a7c3640 1 -- 172.21.15.105:0/1947881091 wait complete. 2024-09-21T03:25:55.398 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-21T03:25:55.399 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:25:55.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.510+0000 7f2c49f6a640 1 -- 172.21.15.105:0/609875940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c440b7cc0 msgr2=0x7f2c440d0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:55.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.510+0000 7f2c49f6a640 1 --2- 172.21.15.105:0/609875940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c440b7cc0 0x7f2c440d0980 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c005fd0 tx=0x7f2c3c02aa90 comp rx=0 tx=0).stop 2024-09-21T03:25:55.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.510+0000 7f2c49f6a640 1 -- 172.21.15.105:0/609875940 shutdown_connections 2024-09-21T03:25:55.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.510+0000 7f2c49f6a640 1 --2- 172.21.15.105:0/609875940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c440b7cc0 0x7f2c440d0980 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:55.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.510+0000 7f2c49f6a640 1 --2- 172.21.15.105:0/609875940 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c440cf320 0x7f2c440ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:55.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.510+0000 7f2c49f6a640 1 -- 172.21.15.105:0/609875940 >> 172.21.15.105:0/609875940 conn(0x7f2c4406d4f0 msgr2=0x7f2c44071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:55.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.510+0000 7f2c49f6a640 1 -- 172.21.15.105:0/609875940 shutdown_connections 2024-09-21T03:25:55.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.510+0000 7f2c49f6a640 1 -- 172.21.15.105:0/609875940 wait complete. 2024-09-21T03:25:55.513 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.512+0000 7f2c49f6a640 1 Processor -- start 2024-09-21T03:25:55.513 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.512+0000 7f2c49f6a640 1 -- start start 2024-09-21T03:25:55.516 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.513+0000 7f2c49f6a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c440b7cc0 0x7f2c440b0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:55.516 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.513+0000 7f2c49f6a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c440cf320 0x7f2c440b1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:55.516 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.513+0000 7f2c49f6a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c441600b0 0x7f2c440cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:55.516 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.513+0000 7f2c49f6a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2c440d1470 con 0x7f2c440b7cc0 2024-09-21T03:25:55.516 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.513+0000 7f2c49f6a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2c440d12f0 con 0x7f2c441600b0 2024-09-21T03:25:55.516 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.513+0000 7f2c49f6a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2c440d15f0 con 0x7f2c440cf320 2024-09-21T03:25:55.516 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.513+0000 7f2c437fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c440b7cc0 0x7f2c440b0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:55.516 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.513+0000 7f2c437fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c440b7cc0 0x7f2c440b0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:37920/0 (socket says 172.21.15.105:37920) 2024-09-21T03:25:55.516 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.513+0000 7f2c437fe640 1 -- 172.21.15.105:0/3407295341 learned_addr learned my addr 172.21.15.105:0/3407295341 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:55.517 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.514+0000 7f2c42ffd640 1 --2- 172.21.15.105:0/3407295341 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c440cf320 0x7f2c440b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:55.517 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.514+0000 7f2c43fff640 1 --2- 172.21.15.105:0/3407295341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c441600b0 0x7f2c440cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:55.517 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.514+0000 7f2c437fe640 1 -- 172.21.15.105:0/3407295341 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c440cf320 msgr2=0x7f2c440b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:55.517 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.514+0000 7f2c437fe640 1 --2- 172.21.15.105:0/3407295341 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c440cf320 0x7f2c440b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:55.517 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.514+0000 7f2c437fe640 1 -- 172.21.15.105:0/3407295341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c441600b0 msgr2=0x7f2c440cb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:55.517 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.514+0000 7f2c437fe640 1 --2- 172.21.15.105:0/3407295341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c441600b0 0x7f2c440cb3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:55.517 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.514+0000 7f2c437fe640 1 -- 172.21.15.105:0/3407295341 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c441574e0 con 0x7f2c440b7cc0 2024-09-21T03:25:55.517 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.514+0000 7f2c42ffd640 1 --2- 172.21.15.105:0/3407295341 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c440cf320 0x7f2c440b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:25:55.517 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.514+0000 7f2c437fe640 1 --2- 172.21.15.105:0/3407295341 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c440b7cc0 0x7f2c440b0b10 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f2c3400c340 tx=0x7f2c3400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:55.517 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.514+0000 7f2c2bfff640 1 -- 172.21.15.105:0/3407295341 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c34017070 con 0x7f2c440b7cc0 2024-09-21T03:25:55.517 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.514+0000 7f2c2bfff640 1 -- 172.21.15.105:0/3407295341 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c340053c0 con 0x7f2c440b7cc0 2024-09-21T03:25:55.517 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.514+0000 7f2c49f6a640 1 -- 172.21.15.105:0/3407295341 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c4406f190 con 0x7f2c440b7cc0 2024-09-21T03:25:55.517 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.514+0000 7f2c2bfff640 1 -- 172.21.15.105:0/3407295341 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c34003850 con 0x7f2c440b7cc0 2024-09-21T03:25:55.517 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.514+0000 7f2c49f6a640 1 -- 172.21.15.105:0/3407295341 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c4406f750 con 0x7f2c440b7cc0 2024-09-21T03:25:55.518 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.515+0000 7f2c49f6a640 1 -- 172.21.15.105:0/3407295341 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c4415eee0 con 0x7f2c440b7cc0 2024-09-21T03:25:55.518 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.516+0000 7f2c2bfff640 1 -- 172.21.15.105:0/3407295341 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2c3401a070 con 0x7f2c440b7cc0 2024-09-21T03:25:55.518 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.516+0000 7f2c2bfff640 1 --2- 172.21.15.105:0/3407295341 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2c30078b90 0x7f2c3007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:55.518 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.516+0000 7f2c2bfff640 1 -- 172.21.15.105:0/3407295341 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7f2c3409a180 con 0x7f2c440b7cc0 2024-09-21T03:25:55.518 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.516+0000 7f2c42ffd640 1 --2- 172.21.15.105:0/3407295341 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2c30078b90 0x7f2c3007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:55.519 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.517+0000 7f2c42ffd640 1 --2- 172.21.15.105:0/3407295341 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2c30078b90 0x7f2c3007b0a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2c38005fd0 tx=0x7f2c3800f360 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:55.522 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.521+0000 7f2c2bfff640 1 -- 172.21.15.105:0/3407295341 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2c4415eee0 con 0x7f2c440b7cc0 2024-09-21T03:25:55.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.693+0000 7f2c49f6a640 1 -- 172.21.15.105:0/3407295341 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2c440d1b80 con 0x7f2c30078b90 2024-09-21T03:25:55.699 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.698+0000 7f2c2bfff640 1 -- 172.21.15.105:0/3407295341 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252465 (secure 0 0 0) 0x7f2c440d1b80 con 0x7f2c30078b90 2024-09-21T03:25:55.703 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:55.704 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:25:55.705 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.701+0000 7f2c49f6a640 1 -- 172.21.15.105:0/3407295341 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2c30078b90 msgr2=0x7f2c3007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:55.705 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.701+0000 7f2c49f6a640 1 --2- 172.21.15.105:0/3407295341 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2c30078b90 0x7f2c3007b0a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2c38005fd0 tx=0x7f2c3800f360 comp rx=0 tx=0).stop 2024-09-21T03:25:55.705 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.701+0000 7f2c49f6a640 1 -- 172.21.15.105:0/3407295341 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c440b7cc0 msgr2=0x7f2c440b0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:55.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.701+0000 7f2c49f6a640 1 --2- 172.21.15.105:0/3407295341 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c440b7cc0 0x7f2c440b0b10 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f2c3400c340 tx=0x7f2c3400c800 comp rx=0 tx=0).stop 2024-09-21T03:25:55.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.701+0000 7f2c49f6a640 1 -- 172.21.15.105:0/3407295341 shutdown_connections 2024-09-21T03:25:55.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.701+0000 7f2c49f6a640 1 --2- 172.21.15.105:0/3407295341 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2c30078b90 0x7f2c3007b0a0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:55.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.701+0000 7f2c49f6a640 1 --2- 172.21.15.105:0/3407295341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c441600b0 0x7f2c440cb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:55.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.701+0000 7f2c49f6a640 1 --2- 172.21.15.105:0/3407295341 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c440cf320 0x7f2c440b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:55.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.701+0000 7f2c49f6a640 1 --2- 172.21.15.105:0/3407295341 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c440b7cc0 0x7f2c440b0b10 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:55.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.701+0000 7f2c49f6a640 1 -- 172.21.15.105:0/3407295341 >> 172.21.15.105:0/3407295341 conn(0x7f2c4406d4f0 msgr2=0x7f2c44071250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:55.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.701+0000 7f2c49f6a640 1 -- 172.21.15.105:0/3407295341 shutdown_connections 2024-09-21T03:25:55.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:55.701+0000 7f2c49f6a640 1 -- 172.21.15.105:0/3407295341 wait complete. 2024-09-21T03:25:55.714 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":339,"stamp":"2024-09-21T03:25:55.399318+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":73,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":270296,"kb_used_data":12452,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754704424,"statfs":{"total":773094113280,"available":772817330176,"internally_reserved":0,"allocated":12750848,"data_stored":6085429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001567"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.000736+0000","last_change":"2024-09-21T03:25:51.248711+0000","last_active":"2024-09-21T03:25:53.000736+0000","last_peered":"2024-09-21T03:25:53.000736+0000","last_clean":"2024-09-21T03:25:53.000736+0000","last_became_active":"2024-09-21T03:25:51.248393+0000","last_became_peered":"2024-09-21T03:25:51.248393+0000","last_unstale":"2024-09-21T03:25:53.000736+0000","last_undegraded":"2024-09-21T03:25:53.000736+0000","last_fullsized":"2024-09-21T03:25:53.000736+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:37.875421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.162004+0000","last_change":"2024-09-21T03:25:51.259088+0000","last_active":"2024-09-21T03:25:53.162004+0000","last_peered":"2024-09-21T03:25:53.162004+0000","last_clean":"2024-09-21T03:25:53.162004+0000","last_became_active":"2024-09-21T03:25:51.258797+0000","last_became_peered":"2024-09-21T03:25:51.258797+0000","last_unstale":"2024-09-21T03:25:53.162004+0000","last_undegraded":"2024-09-21T03:25:53.162004+0000","last_fullsized":"2024-09-21T03:25:53.162004+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:41.362098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.241749+0000","last_change":"2024-09-21T03:25:51.252204+0000","last_active":"2024-09-21T03:25:52.241749+0000","last_peered":"2024-09-21T03:25:52.241749+0000","last_clean":"2024-09-21T03:25:52.241749+0000","last_became_active":"2024-09-21T03:25:51.251882+0000","last_became_peered":"2024-09-21T03:25:51.251882+0000","last_unstale":"2024-09-21T03:25:52.241749+0000","last_undegraded":"2024-09-21T03:25:52.241749+0000","last_fullsized":"2024-09-21T03:25:52.241749+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:31:04.488847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.000550+0000","last_change":"2024-09-21T03:25:51.265602+0000","last_active":"2024-09-21T03:25:53.000550+0000","last_peered":"2024-09-21T03:25:53.000550+0000","last_clean":"2024-09-21T03:25:53.000550+0000","last_became_active":"2024-09-21T03:25:51.265312+0000","last_became_peered":"2024-09-21T03:25:51.265312+0000","last_unstale":"2024-09-21T03:25:53.000550+0000","last_undegraded":"2024-09-21T03:25:53.000550+0000","last_fullsized":"2024-09-21T03:25:53.000550+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:22:21.670042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.163122+0000","last_change":"2024-09-21T03:25:51.265962+0000","last_active":"2024-09-21T03:25:53.163122+0000","last_peered":"2024-09-21T03:25:53.163122+0000","last_clean":"2024-09-21T03:25:53.163122+0000","last_became_active":"2024-09-21T03:25:51.265587+0000","last_became_peered":"2024-09-21T03:25:51.265587+0000","last_unstale":"2024-09-21T03:25:53.163122+0000","last_undegraded":"2024-09-21T03:25:53.163122+0000","last_fullsized":"2024-09-21T03:25:53.163122+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:06.104515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.162410+0000","last_change":"2024-09-21T03:25:51.244606+0000","last_active":"2024-09-21T03:25:53.162410+0000","last_peered":"2024-09-21T03:25:53.162410+0000","last_clean":"2024-09-21T03:25:53.162410+0000","last_became_active":"2024-09-21T03:25:51.244242+0000","last_became_peered":"2024-09-21T03:25:51.244242+0000","last_unstale":"2024-09-21T03:25:53.162410+0000","last_undegraded":"2024-09-21T03:25:53.162410+0000","last_fullsized":"2024-09-21T03:25:53.162410+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:32.888760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.162314+0000","last_change":"2024-09-21T03:25:51.247674+0000","last_active":"2024-09-21T03:25:53.162314+0000","last_peered":"2024-09-21T03:25:53.162314+0000","last_clean":"2024-09-21T03:25:53.162314+0000","last_became_active":"2024-09-21T03:25:51.247348+0000","last_became_peered":"2024-09-21T03:25:51.247348+0000","last_unstale":"2024-09-21T03:25:53.162314+0000","last_undegraded":"2024-09-21T03:25:53.162314+0000","last_fullsized":"2024-09-21T03:25:53.162314+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:13:45.519668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.241312+0000","last_change":"2024-09-21T03:25:51.263685+0000","last_active":"2024-09-21T03:25:52.241312+0000","last_peered":"2024-09-21T03:25:52.241312+0000","last_clean":"2024-09-21T03:25:52.241312+0000","last_became_active":"2024-09-21T03:25:51.263179+0000","last_became_peered":"2024-09-21T03:25:51.263179+0000","last_unstale":"2024-09-21T03:25:52.241312+0000","last_undegraded":"2024-09-21T03:25:52.241312+0000","last_fullsized":"2024-09-21T03:25:52.241312+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:43.738361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.241720+0000","last_change":"2024-09-21T03:25:51.260833+0000","last_active":"2024-09-21T03:25:52.241720+0000","last_peered":"2024-09-21T03:25:52.241720+0000","last_clean":"2024-09-21T03:25:52.241720+0000","last_became_active":"2024-09-21T03:25:51.260493+0000","last_became_peered":"2024-09-21T03:25:51.260493+0000","last_unstale":"2024-09-21T03:25:52.241720+0000","last_undegraded":"2024-09-21T03:25:52.241720+0000","last_fullsized":"2024-09-21T03:25:52.241720+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:32:22.536643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.161928+0000","last_change":"2024-09-21T03:25:51.258814+0000","last_active":"2024-09-21T03:25:53.161928+0000","last_peered":"2024-09-21T03:25:53.161928+0000","last_clean":"2024-09-21T03:25:53.161928+0000","last_became_active":"2024-09-21T03:25:51.258509+0000","last_became_peered":"2024-09-21T03:25:51.258509+0000","last_unstale":"2024-09-21T03:25:53.161928+0000","last_undegraded":"2024-09-21T03:25:53.161928+0000","last_fullsized":"2024-09-21T03:25:53.161928+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:15.953062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-21T03:25:51.261118+0000","last_change":"2024-09-21T03:25:51.258646+0000","last_active":"2024-09-21T03:25:51.261118+0000","last_peered":"2024-09-21T03:25:51.261118+0000","last_clean":"2024-09-21T03:25:51.261118+0000","last_became_active":"2024-09-21T03:25:51.258369+0000","last_became_peered":"2024-09-21T03:25:51.258369+0000","last_unstale":"2024-09-21T03:25:51.261118+0000","last_undegraded":"2024-09-21T03:25:51.261118+0000","last_fullsized":"2024-09-21T03:25:51.261118+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:27.385892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.242596+0000","last_change":"2024-09-21T03:25:51.259705+0000","last_active":"2024-09-21T03:25:52.242596+0000","last_peered":"2024-09-21T03:25:52.242596+0000","last_clean":"2024-09-21T03:25:52.242596+0000","last_became_active":"2024-09-21T03:25:51.259402+0000","last_became_peered":"2024-09-21T03:25:51.259402+0000","last_unstale":"2024-09-21T03:25:52.242596+0000","last_undegraded":"2024-09-21T03:25:52.242596+0000","last_fullsized":"2024-09-21T03:25:52.242596+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:23.214183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.000660+0000","last_change":"2024-09-21T03:25:51.252978+0000","last_active":"2024-09-21T03:25:53.000660+0000","last_peered":"2024-09-21T03:25:53.000660+0000","last_clean":"2024-09-21T03:25:53.000660+0000","last_became_active":"2024-09-21T03:25:51.252596+0000","last_became_peered":"2024-09-21T03:25:51.252596+0000","last_unstale":"2024-09-21T03:25:53.000660+0000","last_undegraded":"2024-09-21T03:25:53.000660+0000","last_fullsized":"2024-09-21T03:25:53.000660+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:18.432289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.161758+0000","last_change":"2024-09-21T03:25:51.267105+0000","last_active":"2024-09-21T03:25:53.161758+0000","last_peered":"2024-09-21T03:25:53.161758+0000","last_clean":"2024-09-21T03:25:53.161758+0000","last_became_active":"2024-09-21T03:25:51.266806+0000","last_became_peered":"2024-09-21T03:25:51.266806+0000","last_unstale":"2024-09-21T03:25:53.161758+0000","last_undegraded":"2024-09-21T03:25:53.161758+0000","last_fullsized":"2024-09-21T03:25:53.161758+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:03:08.980502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.000449+0000","last_change":"2024-09-21T03:25:51.256958+0000","last_active":"2024-09-21T03:25:53.000449+0000","last_peered":"2024-09-21T03:25:53.000449+0000","last_clean":"2024-09-21T03:25:53.000449+0000","last_became_active":"2024-09-21T03:25:51.256655+0000","last_became_peered":"2024-09-21T03:25:51.256655+0000","last_unstale":"2024-09-21T03:25:53.000449+0000","last_undegraded":"2024-09-21T03:25:53.000449+0000","last_fullsized":"2024-09-21T03:25:53.000449+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:18.036095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.239406+0000","last_change":"2024-09-21T03:25:51.266793+0000","last_active":"2024-09-21T03:25:52.239406+0000","last_peered":"2024-09-21T03:25:52.239406+0000","last_clean":"2024-09-21T03:25:52.239406+0000","last_became_active":"2024-09-21T03:25:51.266490+0000","last_became_peered":"2024-09-21T03:25:51.266490+0000","last_unstale":"2024-09-21T03:25:52.239406+0000","last_undegraded":"2024-09-21T03:25:52.239406+0000","last_fullsized":"2024-09-21T03:25:52.239406+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:47.178687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.163329+0000","last_change":"2024-09-21T03:25:51.254400+0000","last_active":"2024-09-21T03:25:53.163329+0000","last_peered":"2024-09-21T03:25:53.163329+0000","last_clean":"2024-09-21T03:25:53.163329+0000","last_became_active":"2024-09-21T03:25:51.254054+0000","last_became_peered":"2024-09-21T03:25:51.254054+0000","last_unstale":"2024-09-21T03:25:53.163329+0000","last_undegraded":"2024-09-21T03:25:53.163329+0000","last_fullsized":"2024-09-21T03:25:53.163329+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:37.216000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.239921+0000","last_change":"2024-09-21T03:25:51.260628+0000","last_active":"2024-09-21T03:25:52.239921+0000","last_peered":"2024-09-21T03:25:52.239921+0000","last_clean":"2024-09-21T03:25:52.239921+0000","last_became_active":"2024-09-21T03:25:51.260324+0000","last_became_peered":"2024-09-21T03:25:51.260324+0000","last_unstale":"2024-09-21T03:25:52.239921+0000","last_undegraded":"2024-09-21T03:25:52.239921+0000","last_fullsized":"2024-09-21T03:25:52.239921+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:56:58.779262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-21T03:25:51.262356+0000","last_change":"2024-09-21T03:25:51.260227+0000","last_active":"2024-09-21T03:25:51.262356+0000","last_peered":"2024-09-21T03:25:51.262356+0000","last_clean":"2024-09-21T03:25:51.262356+0000","last_became_active":"2024-09-21T03:25:51.259914+0000","last_became_peered":"2024-09-21T03:25:51.259914+0000","last_unstale":"2024-09-21T03:25:51.262356+0000","last_undegraded":"2024-09-21T03:25:51.262356+0000","last_fullsized":"2024-09-21T03:25:51.262356+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:01.563835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.239693+0000","last_change":"2024-09-21T03:25:51.263624+0000","last_active":"2024-09-21T03:25:52.239693+0000","last_peered":"2024-09-21T03:25:52.239693+0000","last_clean":"2024-09-21T03:25:52.239693+0000","last_became_active":"2024-09-21T03:25:51.263335+0000","last_became_peered":"2024-09-21T03:25:51.263335+0000","last_unstale":"2024-09-21T03:25:52.239693+0000","last_undegraded":"2024-09-21T03:25:52.239693+0000","last_fullsized":"2024-09-21T03:25:52.239693+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:37.427842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.162820+0000","last_change":"2024-09-21T03:25:51.265326+0000","last_active":"2024-09-21T03:25:53.162820+0000","last_peered":"2024-09-21T03:25:53.162820+0000","last_clean":"2024-09-21T03:25:53.162820+0000","last_became_active":"2024-09-21T03:25:51.264885+0000","last_became_peered":"2024-09-21T03:25:51.264885+0000","last_unstale":"2024-09-21T03:25:53.162820+0000","last_undegraded":"2024-09-21T03:25:53.162820+0000","last_fullsized":"2024-09-21T03:25:53.162820+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:53.273250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-21T03:25:51.265984+0000","last_change":"2024-09-21T03:25:51.261227+0000","last_active":"2024-09-21T03:25:51.265984+0000","last_peered":"2024-09-21T03:25:51.265984+0000","last_clean":"2024-09-21T03:25:51.265984+0000","last_became_active":"2024-09-21T03:25:51.260891+0000","last_became_peered":"2024-09-21T03:25:51.260891+0000","last_unstale":"2024-09-21T03:25:51.265984+0000","last_undegraded":"2024-09-21T03:25:51.265984+0000","last_fullsized":"2024-09-21T03:25:51.265984+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:22:44.855315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.242621+0000","last_change":"2024-09-21T03:25:51.259809+0000","last_active":"2024-09-21T03:25:52.242621+0000","last_peered":"2024-09-21T03:25:52.242621+0000","last_clean":"2024-09-21T03:25:52.242621+0000","last_became_active":"2024-09-21T03:25:51.259427+0000","last_became_peered":"2024-09-21T03:25:51.259427+0000","last_unstale":"2024-09-21T03:25:52.242621+0000","last_undegraded":"2024-09-21T03:25:52.242621+0000","last_fullsized":"2024-09-21T03:25:52.242621+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:48.043712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":10,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-21T03:25:51.266098+0000","last_change":"2024-09-21T03:25:51.262058+0000","last_active":"2024-09-21T03:25:51.266098+0000","last_peered":"2024-09-21T03:25:51.266098+0000","last_clean":"2024-09-21T03:25:51.266098+0000","last_became_active":"2024-09-21T03:25:51.261722+0000","last_became_peered":"2024-09-21T03:25:51.261722+0000","last_unstale":"2024-09-21T03:25:51.266098+0000","last_undegraded":"2024-09-21T03:25:51.266098+0000","last_fullsized":"2024-09-21T03:25:51.266098+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:15.521544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.162011+0000","last_change":"2024-09-21T03:25:51.267166+0000","last_active":"2024-09-21T03:25:53.162011+0000","last_peered":"2024-09-21T03:25:53.162011+0000","last_clean":"2024-09-21T03:25:53.162011+0000","last_became_active":"2024-09-21T03:25:51.266841+0000","last_became_peered":"2024-09-21T03:25:51.266841+0000","last_unstale":"2024-09-21T03:25:53.162011+0000","last_undegraded":"2024-09-21T03:25:53.162011+0000","last_fullsized":"2024-09-21T03:25:53.162011+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:30:30.557034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.239957+0000","last_change":"2024-09-21T03:25:51.270460+0000","last_active":"2024-09-21T03:25:52.239957+0000","last_peered":"2024-09-21T03:25:52.239957+0000","last_clean":"2024-09-21T03:25:52.239957+0000","last_became_active":"2024-09-21T03:25:51.270158+0000","last_became_peered":"2024-09-21T03:25:51.270158+0000","last_unstale":"2024-09-21T03:25:52.239957+0000","last_undegraded":"2024-09-21T03:25:52.239957+0000","last_fullsized":"2024-09-21T03:25:52.239957+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:20.868178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.000566+0000","last_change":"2024-09-21T03:25:51.250414+0000","last_active":"2024-09-21T03:25:53.000566+0000","last_peered":"2024-09-21T03:25:53.000566+0000","last_clean":"2024-09-21T03:25:53.000566+0000","last_became_active":"2024-09-21T03:25:51.250100+0000","last_became_peered":"2024-09-21T03:25:51.250100+0000","last_unstale":"2024-09-21T03:25:53.000566+0000","last_undegraded":"2024-09-21T03:25:53.000566+0000","last_fullsized":"2024-09-21T03:25:53.000566+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:53.223583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.241545+0000","last_change":"2024-09-21T03:25:51.264438+0000","last_active":"2024-09-21T03:25:52.241545+0000","last_peered":"2024-09-21T03:25:52.241545+0000","last_clean":"2024-09-21T03:25:52.241545+0000","last_became_active":"2024-09-21T03:25:51.264068+0000","last_became_peered":"2024-09-21T03:25:51.264068+0000","last_unstale":"2024-09-21T03:25:52.241545+0000","last_undegraded":"2024-09-21T03:25:52.241545+0000","last_fullsized":"2024-09-21T03:25:52.241545+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:35.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.000664+0000","last_change":"2024-09-21T03:25:51.252934+0000","last_active":"2024-09-21T03:25:53.000664+0000","last_peered":"2024-09-21T03:25:53.000664+0000","last_clean":"2024-09-21T03:25:53.000664+0000","last_became_active":"2024-09-21T03:25:51.252221+0000","last_became_peered":"2024-09-21T03:25:51.252221+0000","last_unstale":"2024-09-21T03:25:53.000664+0000","last_undegraded":"2024-09-21T03:25:53.000664+0000","last_fullsized":"2024-09-21T03:25:53.000664+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:03:49.678365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.000395+0000","last_change":"2024-09-21T03:25:51.252018+0000","last_active":"2024-09-21T03:25:53.000395+0000","last_peered":"2024-09-21T03:25:53.000395+0000","last_clean":"2024-09-21T03:25:53.000395+0000","last_became_active":"2024-09-21T03:25:51.251698+0000","last_became_peered":"2024-09-21T03:25:51.251698+0000","last_unstale":"2024-09-21T03:25:53.000395+0000","last_undegraded":"2024-09-21T03:25:53.000395+0000","last_fullsized":"2024-09-21T03:25:53.000395+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:27:46.578658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.162840+0000","last_change":"2024-09-21T03:25:51.270602+0000","last_active":"2024-09-21T03:25:53.162840+0000","last_peered":"2024-09-21T03:25:53.162840+0000","last_clean":"2024-09-21T03:25:53.162840+0000","last_became_active":"2024-09-21T03:25:51.270260+0000","last_became_peered":"2024-09-21T03:25:51.270260+0000","last_unstale":"2024-09-21T03:25:53.162840+0000","last_undegraded":"2024-09-21T03:25:53.162840+0000","last_fullsized":"2024-09-21T03:25:53.162840+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:56:58.779262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.162187+0000","last_change":"2024-09-21T03:25:51.259013+0000","last_active":"2024-09-21T03:25:53.162187+0000","last_peered":"2024-09-21T03:25:53.162187+0000","last_clean":"2024-09-21T03:25:53.162187+0000","last_became_active":"2024-09-21T03:25:51.258651+0000","last_became_peered":"2024-09-21T03:25:51.258651+0000","last_unstale":"2024-09-21T03:25:53.162187+0000","last_undegraded":"2024-09-21T03:25:53.162187+0000","last_fullsized":"2024-09-21T03:25:53.162187+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:10.839121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.240131+0000","last_change":"2024-09-21T03:25:51.269188+0000","last_active":"2024-09-21T03:25:52.240131+0000","last_peered":"2024-09-21T03:25:52.240131+0000","last_clean":"2024-09-21T03:25:52.240131+0000","last_became_active":"2024-09-21T03:25:51.268902+0000","last_became_peered":"2024-09-21T03:25:51.268902+0000","last_unstale":"2024-09-21T03:25:52.240131+0000","last_undegraded":"2024-09-21T03:25:52.240131+0000","last_fullsized":"2024-09-21T03:25:52.240131+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:49.373550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"115'4","reported_seq":19,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.163001+0000","last_change":"2024-09-21T03:25:50.257497+0000","last_active":"2024-09-21T03:25:53.163001+0000","last_peered":"2024-09-21T03:25:53.163001+0000","last_clean":"2024-09-21T03:25:53.163001+0000","last_became_active":"2024-09-21T03:25:50.257090+0000","last_became_peered":"2024-09-21T03:25:50.257090+0000","last_unstale":"2024-09-21T03:25:53.163001+0000","last_undegraded":"2024-09-21T03:25:53.163001+0000","last_fullsized":"2024-09-21T03:25:53.163001+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:47.041935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.241984+0000","last_change":"2024-09-21T03:25:51.251971+0000","last_active":"2024-09-21T03:25:52.241984+0000","last_peered":"2024-09-21T03:25:52.241984+0000","last_clean":"2024-09-21T03:25:52.241984+0000","last_became_active":"2024-09-21T03:25:51.250772+0000","last_became_peered":"2024-09-21T03:25:51.250772+0000","last_unstale":"2024-09-21T03:25:52.241984+0000","last_undegraded":"2024-09-21T03:25:52.241984+0000","last_fullsized":"2024-09-21T03:25:52.241984+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:31.157143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"115'1","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.241688+0000","last_change":"2024-09-21T03:25:50.251806+0000","last_active":"2024-09-21T03:25:52.241688+0000","last_peered":"2024-09-21T03:25:52.241688+0000","last_clean":"2024-09-21T03:25:52.241688+0000","last_became_active":"2024-09-21T03:25:50.251430+0000","last_became_peered":"2024-09-21T03:25:50.251430+0000","last_unstale":"2024-09-21T03:25:52.241688+0000","last_undegraded":"2024-09-21T03:25:52.241688+0000","last_fullsized":"2024-09-21T03:25:52.241688+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:57.276665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.162909+0000","last_change":"2024-09-21T03:25:51.262931+0000","last_active":"2024-09-21T03:25:53.162909+0000","last_peered":"2024-09-21T03:25:53.162909+0000","last_clean":"2024-09-21T03:25:53.162909+0000","last_became_active":"2024-09-21T03:25:51.262629+0000","last_became_peered":"2024-09-21T03:25:51.262629+0000","last_unstale":"2024-09-21T03:25:53.162909+0000","last_undegraded":"2024-09-21T03:25:53.162909+0000","last_fullsized":"2024-09-21T03:25:53.162909+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:20.868178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"115'2","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-21T03:25:51.271213+0000","last_change":"2024-09-21T03:25:50.247877+0000","last_active":"2024-09-21T03:25:51.271213+0000","last_peered":"2024-09-21T03:25:51.271213+0000","last_clean":"2024-09-21T03:25:51.271213+0000","last_became_active":"2024-09-21T03:25:50.247575+0000","last_became_peered":"2024-09-21T03:25:50.247575+0000","last_unstale":"2024-09-21T03:25:51.271213+0000","last_undegraded":"2024-09-21T03:25:51.271213+0000","last_fullsized":"2024-09-21T03:25:51.271213+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:38.761687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.162599+0000","last_change":"2024-09-21T03:25:51.261731+0000","last_active":"2024-09-21T03:25:53.162599+0000","last_peered":"2024-09-21T03:25:53.162599+0000","last_clean":"2024-09-21T03:25:53.162599+0000","last_became_active":"2024-09-21T03:25:51.261401+0000","last_became_peered":"2024-09-21T03:25:51.261401+0000","last_unstale":"2024-09-21T03:25:53.162599+0000","last_undegraded":"2024-09-21T03:25:53.162599+0000","last_fullsized":"2024-09-21T03:25:53.162599+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:52.195251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"115'2","reported_seq":17,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.161834+0000","last_change":"2024-09-21T03:25:50.259794+0000","last_active":"2024-09-21T03:25:53.161834+0000","last_peered":"2024-09-21T03:25:53.161834+0000","last_clean":"2024-09-21T03:25:53.161834+0000","last_became_active":"2024-09-21T03:25:50.259475+0000","last_became_peered":"2024-09-21T03:25:50.259475+0000","last_unstale":"2024-09-21T03:25:53.161834+0000","last_undegraded":"2024-09-21T03:25:53.161834+0000","last_fullsized":"2024-09-21T03:25:53.161834+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:41.304817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.239471+0000","last_change":"2024-09-21T03:25:51.261280+0000","last_active":"2024-09-21T03:25:52.239471+0000","last_peered":"2024-09-21T03:25:52.239471+0000","last_clean":"2024-09-21T03:25:52.239471+0000","last_became_active":"2024-09-21T03:25:51.260983+0000","last_became_peered":"2024-09-21T03:25:51.260983+0000","last_unstale":"2024-09-21T03:25:52.239471+0000","last_undegraded":"2024-09-21T03:25:52.239471+0000","last_fullsized":"2024-09-21T03:25:52.239471+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:07:06.578903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"115'1","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.161545+0000","last_change":"2024-09-21T03:25:50.257059+0000","last_active":"2024-09-21T03:25:53.161545+0000","last_peered":"2024-09-21T03:25:53.161545+0000","last_clean":"2024-09-21T03:25:53.161545+0000","last_became_active":"2024-09-21T03:25:50.256756+0000","last_became_peered":"2024-09-21T03:25:50.256756+0000","last_unstale":"2024-09-21T03:25:53.161545+0000","last_undegraded":"2024-09-21T03:25:53.161545+0000","last_fullsized":"2024-09-21T03:25:53.161545+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:11.882336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.162601+0000","last_change":"2024-09-21T03:25:51.255113+0000","last_active":"2024-09-21T03:25:53.162601+0000","last_peered":"2024-09-21T03:25:53.162601+0000","last_clean":"2024-09-21T03:25:53.162601+0000","last_became_active":"2024-09-21T03:25:51.253298+0000","last_became_peered":"2024-09-21T03:25:51.253298+0000","last_unstale":"2024-09-21T03:25:53.162601+0000","last_undegraded":"2024-09-21T03:25:53.162601+0000","last_fullsized":"2024-09-21T03:25:53.162601+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:40.423688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"115'1","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.239448+0000","last_change":"2024-09-21T03:25:50.254775+0000","last_active":"2024-09-21T03:25:52.239448+0000","last_peered":"2024-09-21T03:25:52.239448+0000","last_clean":"2024-09-21T03:25:52.239448+0000","last_became_active":"2024-09-21T03:25:50.254451+0000","last_became_peered":"2024-09-21T03:25:50.254451+0000","last_unstale":"2024-09-21T03:25:52.239448+0000","last_undegraded":"2024-09-21T03:25:52.239448+0000","last_fullsized":"2024-09-21T03:25:52.239448+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:22.212406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.241750+0000","last_change":"2024-09-21T03:25:51.263161+0000","last_active":"2024-09-21T03:25:52.241750+0000","last_peered":"2024-09-21T03:25:52.241750+0000","last_clean":"2024-09-21T03:25:52.241750+0000","last_became_active":"2024-09-21T03:25:51.262855+0000","last_became_peered":"2024-09-21T03:25:51.262855+0000","last_unstale":"2024-09-21T03:25:52.241750+0000","last_undegraded":"2024-09-21T03:25:52.241750+0000","last_fullsized":"2024-09-21T03:25:52.241750+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:13:45.519668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.162202+0000","last_change":"2024-09-21T03:25:50.252058+0000","last_active":"2024-09-21T03:25:53.162202+0000","last_peered":"2024-09-21T03:25:53.162202+0000","last_clean":"2024-09-21T03:25:53.162202+0000","last_became_active":"2024-09-21T03:25:50.251634+0000","last_became_peered":"2024-09-21T03:25:50.251634+0000","last_unstale":"2024-09-21T03:25:53.162202+0000","last_undegraded":"2024-09-21T03:25:53.162202+0000","last_fullsized":"2024-09-21T03:25:53.162202+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:49.710904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.161564+0000","last_change":"2024-09-21T03:25:51.265511+0000","last_active":"2024-09-21T03:25:53.161564+0000","last_peered":"2024-09-21T03:25:53.161564+0000","last_clean":"2024-09-21T03:25:53.161564+0000","last_became_active":"2024-09-21T03:25:51.265212+0000","last_became_peered":"2024-09-21T03:25:51.265212+0000","last_unstale":"2024-09-21T03:25:53.161564+0000","last_undegraded":"2024-09-21T03:25:53.161564+0000","last_fullsized":"2024-09-21T03:25:53.161564+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:18.629574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.161792+0000","last_change":"2024-09-21T03:25:50.255796+0000","last_active":"2024-09-21T03:25:53.161792+0000","last_peered":"2024-09-21T03:25:53.161792+0000","last_clean":"2024-09-21T03:25:53.161792+0000","last_became_active":"2024-09-21T03:25:50.255502+0000","last_became_peered":"2024-09-21T03:25:50.255502+0000","last_unstale":"2024-09-21T03:25:53.161792+0000","last_undegraded":"2024-09-21T03:25:53.161792+0000","last_fullsized":"2024-09-21T03:25:53.161792+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:19.414720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.000614+0000","last_change":"2024-09-21T03:25:51.260939+0000","last_active":"2024-09-21T03:25:53.000614+0000","last_peered":"2024-09-21T03:25:53.000614+0000","last_clean":"2024-09-21T03:25:53.000614+0000","last_became_active":"2024-09-21T03:25:51.260629+0000","last_became_peered":"2024-09-21T03:25:51.260629+0000","last_unstale":"2024-09-21T03:25:53.000614+0000","last_undegraded":"2024-09-21T03:25:53.000614+0000","last_fullsized":"2024-09-21T03:25:53.000614+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:19.290293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.242168+0000","last_change":"2024-09-21T03:25:50.257409+0000","last_active":"2024-09-21T03:25:52.242168+0000","last_peered":"2024-09-21T03:25:52.242168+0000","last_clean":"2024-09-21T03:25:52.242168+0000","last_became_active":"2024-09-21T03:25:50.257064+0000","last_became_peered":"2024-09-21T03:25:50.257064+0000","last_unstale":"2024-09-21T03:25:52.242168+0000","last_undegraded":"2024-09-21T03:25:52.242168+0000","last_fullsized":"2024-09-21T03:25:52.242168+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:42:00.173652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.242431+0000","last_change":"2024-09-21T03:25:51.263360+0000","last_active":"2024-09-21T03:25:52.242431+0000","last_peered":"2024-09-21T03:25:52.242431+0000","last_clean":"2024-09-21T03:25:52.242431+0000","last_became_active":"2024-09-21T03:25:51.263044+0000","last_became_peered":"2024-09-21T03:25:51.263044+0000","last_unstale":"2024-09-21T03:25:52.242431+0000","last_undegraded":"2024-09-21T03:25:52.242431+0000","last_fullsized":"2024-09-21T03:25:52.242431+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:50.712681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.240067+0000","last_change":"2024-09-21T03:25:50.254039+0000","last_active":"2024-09-21T03:25:52.240067+0000","last_peered":"2024-09-21T03:25:52.240067+0000","last_clean":"2024-09-21T03:25:52.240067+0000","last_became_active":"2024-09-21T03:25:50.252998+0000","last_became_peered":"2024-09-21T03:25:50.252998+0000","last_unstale":"2024-09-21T03:25:52.240067+0000","last_undegraded":"2024-09-21T03:25:52.240067+0000","last_fullsized":"2024-09-21T03:25:52.240067+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:35.866871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.163166+0000","last_change":"2024-09-21T03:25:51.267312+0000","last_active":"2024-09-21T03:25:53.163166+0000","last_peered":"2024-09-21T03:25:53.163166+0000","last_clean":"2024-09-21T03:25:53.163166+0000","last_became_active":"2024-09-21T03:25:51.266588+0000","last_became_peered":"2024-09-21T03:25:51.266588+0000","last_unstale":"2024-09-21T03:25:53.163166+0000","last_undegraded":"2024-09-21T03:25:53.163166+0000","last_fullsized":"2024-09-21T03:25:53.163166+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:14.715706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"115'3","reported_seq":18,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.241116+0000","last_change":"2024-09-21T03:25:50.255470+0000","last_active":"2024-09-21T03:25:52.241116+0000","last_peered":"2024-09-21T03:25:52.241116+0000","last_clean":"2024-09-21T03:25:52.241116+0000","last_became_active":"2024-09-21T03:25:50.255109+0000","last_became_peered":"2024-09-21T03:25:50.255109+0000","last_unstale":"2024-09-21T03:25:52.241116+0000","last_undegraded":"2024-09-21T03:25:52.241116+0000","last_fullsized":"2024-09-21T03:25:52.241116+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:51.586215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.163030+0000","last_change":"2024-09-21T03:25:51.262580+0000","last_active":"2024-09-21T03:25:53.163030+0000","last_peered":"2024-09-21T03:25:53.163030+0000","last_clean":"2024-09-21T03:25:53.163030+0000","last_became_active":"2024-09-21T03:25:51.262131+0000","last_became_peered":"2024-09-21T03:25:51.262131+0000","last_unstale":"2024-09-21T03:25:53.163030+0000","last_undegraded":"2024-09-21T03:25:53.163030+0000","last_fullsized":"2024-09-21T03:25:53.163030+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:49.373550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"115'6","reported_seq":21,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.241954+0000","last_change":"2024-09-21T03:25:50.247502+0000","last_active":"2024-09-21T03:25:52.241954+0000","last_peered":"2024-09-21T03:25:52.241954+0000","last_clean":"2024-09-21T03:25:52.241954+0000","last_became_active":"2024-09-21T03:25:50.247158+0000","last_became_peered":"2024-09-21T03:25:50.247158+0000","last_unstale":"2024-09-21T03:25:52.241954+0000","last_undegraded":"2024-09-21T03:25:52.241954+0000","last_fullsized":"2024-09-21T03:25:52.241954+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:21.524938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.000829+0000","last_change":"2024-09-21T03:25:51.257293+0000","last_active":"2024-09-21T03:25:53.000829+0000","last_peered":"2024-09-21T03:25:53.000829+0000","last_clean":"2024-09-21T03:25:53.000829+0000","last_became_active":"2024-09-21T03:25:51.256920+0000","last_became_peered":"2024-09-21T03:25:51.256920+0000","last_unstale":"2024-09-21T03:25:53.000829+0000","last_undegraded":"2024-09-21T03:25:53.000829+0000","last_fullsized":"2024-09-21T03:25:53.000829+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:50:00.670075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.000638+0000","last_change":"2024-09-21T03:25:50.243715+0000","last_active":"2024-09-21T03:25:53.000638+0000","last_peered":"2024-09-21T03:25:53.000638+0000","last_clean":"2024-09-21T03:25:53.000638+0000","last_became_active":"2024-09-21T03:25:50.243412+0000","last_became_peered":"2024-09-21T03:25:50.243412+0000","last_unstale":"2024-09-21T03:25:53.000638+0000","last_undegraded":"2024-09-21T03:25:53.000638+0000","last_fullsized":"2024-09-21T03:25:53.000638+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:08.891716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.161945+0000","last_change":"2024-09-21T03:25:51.262648+0000","last_active":"2024-09-21T03:25:53.161945+0000","last_peered":"2024-09-21T03:25:53.161945+0000","last_clean":"2024-09-21T03:25:53.161945+0000","last_became_active":"2024-09-21T03:25:51.262296+0000","last_became_peered":"2024-09-21T03:25:51.262296+0000","last_unstale":"2024-09-21T03:25:53.161945+0000","last_undegraded":"2024-09-21T03:25:53.161945+0000","last_fullsized":"2024-09-21T03:25:53.161945+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:52:30.955027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.161789+0000","last_change":"2024-09-21T03:25:50.257405+0000","last_active":"2024-09-21T03:25:53.161789+0000","last_peered":"2024-09-21T03:25:53.161789+0000","last_clean":"2024-09-21T03:25:53.161789+0000","last_became_active":"2024-09-21T03:25:50.257089+0000","last_became_peered":"2024-09-21T03:25:50.257089+0000","last_unstale":"2024-09-21T03:25:53.161789+0000","last_undegraded":"2024-09-21T03:25:53.161789+0000","last_fullsized":"2024-09-21T03:25:53.161789+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:58.136844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.242308+0000","last_change":"2024-09-21T03:25:51.260148+0000","last_active":"2024-09-21T03:25:52.242308+0000","last_peered":"2024-09-21T03:25:52.242308+0000","last_clean":"2024-09-21T03:25:52.242308+0000","last_became_active":"2024-09-21T03:25:51.259845+0000","last_became_peered":"2024-09-21T03:25:51.259845+0000","last_unstale":"2024-09-21T03:25:52.242308+0000","last_undegraded":"2024-09-21T03:25:52.242308+0000","last_fullsized":"2024-09-21T03:25:52.242308+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:52.798221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"115'8","reported_seq":23,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.241880+0000","last_change":"2024-09-21T03:25:50.248824+0000","last_active":"2024-09-21T03:25:52.241880+0000","last_peered":"2024-09-21T03:25:52.241880+0000","last_clean":"2024-09-21T03:25:52.241880+0000","last_became_active":"2024-09-21T03:25:50.248492+0000","last_became_peered":"2024-09-21T03:25:50.248492+0000","last_unstale":"2024-09-21T03:25:52.241880+0000","last_undegraded":"2024-09-21T03:25:52.241880+0000","last_fullsized":"2024-09-21T03:25:52.241880+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:40.801965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.242042+0000","last_change":"2024-09-21T03:25:51.251500+0000","last_active":"2024-09-21T03:25:52.242042+0000","last_peered":"2024-09-21T03:25:52.242042+0000","last_clean":"2024-09-21T03:25:52.242042+0000","last_became_active":"2024-09-21T03:25:51.251164+0000","last_became_peered":"2024-09-21T03:25:51.251164+0000","last_unstale":"2024-09-21T03:25:52.242042+0000","last_undegraded":"2024-09-21T03:25:52.242042+0000","last_fullsized":"2024-09-21T03:25:52.242042+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:36:18.465160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"115'1","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.242292+0000","last_change":"2024-09-21T03:25:50.252017+0000","last_active":"2024-09-21T03:25:52.242292+0000","last_peered":"2024-09-21T03:25:52.242292+0000","last_clean":"2024-09-21T03:25:52.242292+0000","last_became_active":"2024-09-21T03:25:50.251469+0000","last_became_peered":"2024-09-21T03:25:50.251469+0000","last_unstale":"2024-09-21T03:25:52.242292+0000","last_undegraded":"2024-09-21T03:25:52.242292+0000","last_fullsized":"2024-09-21T03:25:52.242292+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:41.400779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.241962+0000","last_change":"2024-09-21T03:25:51.261811+0000","last_active":"2024-09-21T03:25:52.241962+0000","last_peered":"2024-09-21T03:25:52.241962+0000","last_clean":"2024-09-21T03:25:52.241962+0000","last_became_active":"2024-09-21T03:25:51.261492+0000","last_became_peered":"2024-09-21T03:25:51.261492+0000","last_unstale":"2024-09-21T03:25:52.241962+0000","last_undegraded":"2024-09-21T03:25:52.241962+0000","last_fullsized":"2024-09-21T03:25:52.241962+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:02.604215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"115'2","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-21T03:25:51.263507+0000","last_change":"2024-09-21T03:25:50.249322+0000","last_active":"2024-09-21T03:25:51.263507+0000","last_peered":"2024-09-21T03:25:51.263507+0000","last_clean":"2024-09-21T03:25:51.263507+0000","last_became_active":"2024-09-21T03:25:50.249036+0000","last_became_peered":"2024-09-21T03:25:50.249036+0000","last_unstale":"2024-09-21T03:25:51.263507+0000","last_undegraded":"2024-09-21T03:25:51.263507+0000","last_fullsized":"2024-09-21T03:25:51.263507+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:57.753544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.239703+0000","last_change":"2024-09-21T03:25:51.267850+0000","last_active":"2024-09-21T03:25:52.239703+0000","last_peered":"2024-09-21T03:25:52.239703+0000","last_clean":"2024-09-21T03:25:52.239703+0000","last_became_active":"2024-09-21T03:25:51.267429+0000","last_became_peered":"2024-09-21T03:25:51.267429+0000","last_unstale":"2024-09-21T03:25:52.239703+0000","last_undegraded":"2024-09-21T03:25:52.239703+0000","last_fullsized":"2024-09-21T03:25:52.239703+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:52.195251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"115'1","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.162881+0000","last_change":"2024-09-21T03:25:50.247667+0000","last_active":"2024-09-21T03:25:53.162881+0000","last_peered":"2024-09-21T03:25:53.162881+0000","last_clean":"2024-09-21T03:25:53.162881+0000","last_became_active":"2024-09-21T03:25:50.247341+0000","last_became_peered":"2024-09-21T03:25:50.247341+0000","last_unstale":"2024-09-21T03:25:53.162881+0000","last_undegraded":"2024-09-21T03:25:53.162881+0000","last_fullsized":"2024-09-21T03:25:53.162881+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:03:00.055617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.161943+0000","last_change":"2024-09-21T03:25:51.264901+0000","last_active":"2024-09-21T03:25:53.161943+0000","last_peered":"2024-09-21T03:25:53.161943+0000","last_clean":"2024-09-21T03:25:53.161943+0000","last_became_active":"2024-09-21T03:25:51.264581+0000","last_became_peered":"2024-09-21T03:25:51.264581+0000","last_unstale":"2024-09-21T03:25:53.161943+0000","last_undegraded":"2024-09-21T03:25:53.161943+0000","last_fullsized":"2024-09-21T03:25:53.161943+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:39.003787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.241316+0000","last_change":"2024-09-21T03:25:50.251065+0000","last_active":"2024-09-21T03:25:52.241316+0000","last_peered":"2024-09-21T03:25:52.241316+0000","last_clean":"2024-09-21T03:25:52.241316+0000","last_became_active":"2024-09-21T03:25:50.250740+0000","last_became_peered":"2024-09-21T03:25:50.250740+0000","last_unstale":"2024-09-21T03:25:52.241316+0000","last_undegraded":"2024-09-21T03:25:52.241316+0000","last_fullsized":"2024-09-21T03:25:52.241316+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:17.110278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.000516+0000","last_change":"2024-09-21T03:25:51.252552+0000","last_active":"2024-09-21T03:25:53.000516+0000","last_peered":"2024-09-21T03:25:53.000516+0000","last_clean":"2024-09-21T03:25:53.000516+0000","last_became_active":"2024-09-21T03:25:51.252089+0000","last_became_peered":"2024-09-21T03:25:51.252089+0000","last_unstale":"2024-09-21T03:25:53.000516+0000","last_undegraded":"2024-09-21T03:25:53.000516+0000","last_fullsized":"2024-09-21T03:25:53.000516+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:32.712249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"115'2","reported_seq":17,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.241394+0000","last_change":"2024-09-21T03:25:50.257644+0000","last_active":"2024-09-21T03:25:52.241394+0000","last_peered":"2024-09-21T03:25:52.241394+0000","last_clean":"2024-09-21T03:25:52.241394+0000","last_became_active":"2024-09-21T03:25:50.257328+0000","last_became_peered":"2024-09-21T03:25:50.257328+0000","last_unstale":"2024-09-21T03:25:52.241394+0000","last_undegraded":"2024-09-21T03:25:52.241394+0000","last_fullsized":"2024-09-21T03:25:52.241394+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:04.123553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.162794+0000","last_change":"2024-09-21T03:25:51.245680+0000","last_active":"2024-09-21T03:25:53.162794+0000","last_peered":"2024-09-21T03:25:53.162794+0000","last_clean":"2024-09-21T03:25:53.162794+0000","last_became_active":"2024-09-21T03:25:51.245331+0000","last_became_peered":"2024-09-21T03:25:51.245331+0000","last_unstale":"2024-09-21T03:25:53.162794+0000","last_undegraded":"2024-09-21T03:25:53.162794+0000","last_fullsized":"2024-09-21T03:25:53.162794+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:22.731203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.239560+0000","last_change":"2024-09-21T03:25:50.254124+0000","last_active":"2024-09-21T03:25:52.239560+0000","last_peered":"2024-09-21T03:25:52.239560+0000","last_clean":"2024-09-21T03:25:52.239560+0000","last_became_active":"2024-09-21T03:25:50.253240+0000","last_became_peered":"2024-09-21T03:25:50.253240+0000","last_unstale":"2024-09-21T03:25:52.239560+0000","last_undegraded":"2024-09-21T03:25:52.239560+0000","last_fullsized":"2024-09-21T03:25:52.239560+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:47.041935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.161627+0000","last_change":"2024-09-21T03:25:51.255448+0000","last_active":"2024-09-21T03:25:53.161627+0000","last_peered":"2024-09-21T03:25:53.161627+0000","last_clean":"2024-09-21T03:25:53.161627+0000","last_became_active":"2024-09-21T03:25:51.255144+0000","last_became_peered":"2024-09-21T03:25:51.255144+0000","last_unstale":"2024-09-21T03:25:53.161627+0000","last_undegraded":"2024-09-21T03:25:53.161627+0000","last_fullsized":"2024-09-21T03:25:53.161627+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:41.803742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.239351+0000","last_change":"2024-09-21T03:25:50.253793+0000","last_active":"2024-09-21T03:25:52.239351+0000","last_peered":"2024-09-21T03:25:52.239351+0000","last_clean":"2024-09-21T03:25:52.239351+0000","last_became_active":"2024-09-21T03:25:50.253462+0000","last_became_peered":"2024-09-21T03:25:50.253462+0000","last_unstale":"2024-09-21T03:25:52.239351+0000","last_undegraded":"2024-09-21T03:25:52.239351+0000","last_fullsized":"2024-09-21T03:25:52.239351+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:21:35.409282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.162572+0000","last_change":"2024-09-21T03:25:51.270597+0000","last_active":"2024-09-21T03:25:53.162572+0000","last_peered":"2024-09-21T03:25:53.162572+0000","last_clean":"2024-09-21T03:25:53.162572+0000","last_became_active":"2024-09-21T03:25:51.270219+0000","last_became_peered":"2024-09-21T03:25:51.270219+0000","last_unstale":"2024-09-21T03:25:53.162572+0000","last_undegraded":"2024-09-21T03:25:53.162572+0000","last_fullsized":"2024-09-21T03:25:53.162572+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:37.427842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-21T03:25:51.247530+0000","last_change":"2024-09-21T03:25:50.248647+0000","last_active":"2024-09-21T03:25:51.247530+0000","last_peered":"2024-09-21T03:25:51.247530+0000","last_clean":"2024-09-21T03:25:51.247530+0000","last_became_active":"2024-09-21T03:25:50.248231+0000","last_became_peered":"2024-09-21T03:25:50.248231+0000","last_unstale":"2024-09-21T03:25:51.247530+0000","last_undegraded":"2024-09-21T03:25:51.247530+0000","last_fullsized":"2024-09-21T03:25:51.247530+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:05.855445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.163365+0000","last_change":"2024-09-21T03:25:51.263360+0000","last_active":"2024-09-21T03:25:53.163365+0000","last_peered":"2024-09-21T03:25:53.163365+0000","last_clean":"2024-09-21T03:25:53.163365+0000","last_became_active":"2024-09-21T03:25:51.263044+0000","last_became_peered":"2024-09-21T03:25:51.263044+0000","last_unstale":"2024-09-21T03:25:53.163365+0000","last_undegraded":"2024-09-21T03:25:53.163365+0000","last_fullsized":"2024-09-21T03:25:53.163365+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:13:52.677686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"115'2","reported_seq":17,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.000823+0000","last_change":"2024-09-21T03:25:50.252739+0000","last_active":"2024-09-21T03:25:53.000823+0000","last_peered":"2024-09-21T03:25:53.000823+0000","last_clean":"2024-09-21T03:25:53.000823+0000","last_became_active":"2024-09-21T03:25:50.251400+0000","last_became_peered":"2024-09-21T03:25:50.251400+0000","last_unstale":"2024-09-21T03:25:53.000823+0000","last_undegraded":"2024-09-21T03:25:53.000823+0000","last_fullsized":"2024-09-21T03:25:53.000823+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:51.945355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.000766+0000","last_change":"2024-09-21T03:25:51.257809+0000","last_active":"2024-09-21T03:25:53.000766+0000","last_peered":"2024-09-21T03:25:53.000766+0000","last_clean":"2024-09-21T03:25:53.000766+0000","last_became_active":"2024-09-21T03:25:51.257420+0000","last_became_peered":"2024-09-21T03:25:51.257420+0000","last_unstale":"2024-09-21T03:25:53.000766+0000","last_undegraded":"2024-09-21T03:25:53.000766+0000","last_fullsized":"2024-09-21T03:25:53.000766+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:45.200469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"116'1","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.241761+0000","last_change":"2024-09-21T03:25:50.253741+0000","last_active":"2024-09-21T03:25:53.241761+0000","last_peered":"2024-09-21T03:25:53.241761+0000","last_clean":"2024-09-21T03:25:53.241761+0000","last_became_active":"2024-09-21T03:25:50.253397+0000","last_became_peered":"2024-09-21T03:25:50.253397+0000","last_unstale":"2024-09-21T03:25:53.241761+0000","last_undegraded":"2024-09-21T03:25:53.241761+0000","last_fullsized":"2024-09-21T03:25:53.241761+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:22.212406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.161881+0000","last_change":"2024-09-21T03:25:51.267998+0000","last_active":"2024-09-21T03:25:53.161881+0000","last_peered":"2024-09-21T03:25:53.161881+0000","last_clean":"2024-09-21T03:25:53.161881+0000","last_became_active":"2024-09-21T03:25:51.267681+0000","last_became_peered":"2024-09-21T03:25:51.267681+0000","last_unstale":"2024-09-21T03:25:53.161881+0000","last_undegraded":"2024-09-21T03:25:53.161881+0000","last_fullsized":"2024-09-21T03:25:53.161881+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:50.109146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.162035+0000","last_change":"2024-09-21T03:25:50.257326+0000","last_active":"2024-09-21T03:25:53.162035+0000","last_peered":"2024-09-21T03:25:53.162035+0000","last_clean":"2024-09-21T03:25:53.162035+0000","last_became_active":"2024-09-21T03:25:50.257040+0000","last_became_peered":"2024-09-21T03:25:50.257040+0000","last_unstale":"2024-09-21T03:25:53.162035+0000","last_undegraded":"2024-09-21T03:25:53.162035+0000","last_fullsized":"2024-09-21T03:25:53.162035+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:29.305425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.163432+0000","last_change":"2024-09-21T03:25:51.246875+0000","last_active":"2024-09-21T03:25:53.163432+0000","last_peered":"2024-09-21T03:25:53.163432+0000","last_clean":"2024-09-21T03:25:53.163432+0000","last_became_active":"2024-09-21T03:25:51.246228+0000","last_became_peered":"2024-09-21T03:25:51.246228+0000","last_unstale":"2024-09-21T03:25:53.163432+0000","last_undegraded":"2024-09-21T03:25:53.163432+0000","last_fullsized":"2024-09-21T03:25:53.163432+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:00:03.939528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-21T03:25:51.247851+0000","last_change":"2024-09-21T03:25:50.259220+0000","last_active":"2024-09-21T03:25:51.247851+0000","last_peered":"2024-09-21T03:25:51.247851+0000","last_clean":"2024-09-21T03:25:51.247851+0000","last_became_active":"2024-09-21T03:25:50.258897+0000","last_became_peered":"2024-09-21T03:25:50.258897+0000","last_unstale":"2024-09-21T03:25:51.247851+0000","last_undegraded":"2024-09-21T03:25:51.247851+0000","last_fullsized":"2024-09-21T03:25:51.247851+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:22.679163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.162321+0000","last_change":"2024-09-21T03:25:51.263655+0000","last_active":"2024-09-21T03:25:53.162321+0000","last_peered":"2024-09-21T03:25:53.162321+0000","last_clean":"2024-09-21T03:25:53.162321+0000","last_became_active":"2024-09-21T03:25:51.263356+0000","last_became_peered":"2024-09-21T03:25:51.263356+0000","last_unstale":"2024-09-21T03:25:53.162321+0000","last_undegraded":"2024-09-21T03:25:53.162321+0000","last_fullsized":"2024-09-21T03:25:53.162321+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:07:06.578903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.161865+0000","last_change":"2024-09-21T03:25:50.256607+0000","last_active":"2024-09-21T03:25:53.161865+0000","last_peered":"2024-09-21T03:25:53.161865+0000","last_clean":"2024-09-21T03:25:53.161865+0000","last_became_active":"2024-09-21T03:25:50.256305+0000","last_became_peered":"2024-09-21T03:25:50.256305+0000","last_unstale":"2024-09-21T03:25:53.161865+0000","last_undegraded":"2024-09-21T03:25:53.161865+0000","last_fullsized":"2024-09-21T03:25:53.161865+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:06.404453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.241929+0000","last_change":"2024-09-21T03:25:51.266551+0000","last_active":"2024-09-21T03:25:52.241929+0000","last_peered":"2024-09-21T03:25:52.241929+0000","last_clean":"2024-09-21T03:25:52.241929+0000","last_became_active":"2024-09-21T03:25:51.266218+0000","last_became_peered":"2024-09-21T03:25:51.266218+0000","last_unstale":"2024-09-21T03:25:52.241929+0000","last_undegraded":"2024-09-21T03:25:52.241929+0000","last_fullsized":"2024-09-21T03:25:52.241929+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:35.806102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.162663+0000","last_change":"2024-09-21T03:25:50.254226+0000","last_active":"2024-09-21T03:25:53.162663+0000","last_peered":"2024-09-21T03:25:53.162663+0000","last_clean":"2024-09-21T03:25:53.162663+0000","last_became_active":"2024-09-21T03:25:50.253882+0000","last_became_peered":"2024-09-21T03:25:50.253882+0000","last_unstale":"2024-09-21T03:25:53.162663+0000","last_undegraded":"2024-09-21T03:25:53.162663+0000","last_fullsized":"2024-09-21T03:25:53.162663+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:51.796445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.239820+0000","last_change":"2024-09-21T03:25:51.264905+0000","last_active":"2024-09-21T03:25:52.239820+0000","last_peered":"2024-09-21T03:25:52.239820+0000","last_clean":"2024-09-21T03:25:52.239820+0000","last_became_active":"2024-09-21T03:25:51.262340+0000","last_became_peered":"2024-09-21T03:25:51.262340+0000","last_unstale":"2024-09-21T03:25:52.239820+0000","last_undegraded":"2024-09-21T03:25:52.239820+0000","last_fullsized":"2024-09-21T03:25:52.239820+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:53.273250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.239459+0000","last_change":"2024-09-21T03:25:50.252271+0000","last_active":"2024-09-21T03:25:52.239459+0000","last_peered":"2024-09-21T03:25:52.239459+0000","last_clean":"2024-09-21T03:25:52.239459+0000","last_became_active":"2024-09-21T03:25:50.251962+0000","last_became_peered":"2024-09-21T03:25:50.251962+0000","last_unstale":"2024-09-21T03:25:52.239459+0000","last_undegraded":"2024-09-21T03:25:52.239459+0000","last_fullsized":"2024-09-21T03:25:52.239459+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:51.711857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.161630+0000","last_change":"2024-09-21T03:25:51.266237+0000","last_active":"2024-09-21T03:25:53.161630+0000","last_peered":"2024-09-21T03:25:53.161630+0000","last_clean":"2024-09-21T03:25:53.161630+0000","last_became_active":"2024-09-21T03:25:51.265947+0000","last_became_peered":"2024-09-21T03:25:51.265947+0000","last_unstale":"2024-09-21T03:25:53.161630+0000","last_undegraded":"2024-09-21T03:25:53.161630+0000","last_fullsized":"2024-09-21T03:25:53.161630+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:22.526715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-21T03:25:51.248354+0000","last_change":"2024-09-21T03:25:50.252759+0000","last_active":"2024-09-21T03:25:51.248354+0000","last_peered":"2024-09-21T03:25:51.248354+0000","last_clean":"2024-09-21T03:25:51.248354+0000","last_became_active":"2024-09-21T03:25:50.252445+0000","last_became_peered":"2024-09-21T03:25:50.252445+0000","last_unstale":"2024-09-21T03:25:51.248354+0000","last_undegraded":"2024-09-21T03:25:51.248354+0000","last_fullsized":"2024-09-21T03:25:51.248354+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:10.447482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.162240+0000","last_change":"2024-09-21T03:25:51.268134+0000","last_active":"2024-09-21T03:25:53.162240+0000","last_peered":"2024-09-21T03:25:53.162240+0000","last_clean":"2024-09-21T03:25:53.162240+0000","last_became_active":"2024-09-21T03:25:51.267825+0000","last_became_peered":"2024-09-21T03:25:51.267825+0000","last_unstale":"2024-09-21T03:25:53.162240+0000","last_undegraded":"2024-09-21T03:25:53.162240+0000","last_fullsized":"2024-09-21T03:25:53.162240+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:47.178687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"115'2","reported_seq":17,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.163194+0000","last_change":"2024-09-21T03:25:50.257816+0000","last_active":"2024-09-21T03:25:53.163194+0000","last_peered":"2024-09-21T03:25:53.163194+0000","last_clean":"2024-09-21T03:25:53.163194+0000","last_became_active":"2024-09-21T03:25:50.257162+0000","last_became_peered":"2024-09-21T03:25:50.257162+0000","last_unstale":"2024-09-21T03:25:53.163194+0000","last_undegraded":"2024-09-21T03:25:53.163194+0000","last_fullsized":"2024-09-21T03:25:53.163194+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:21:35.409282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":286,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.161983+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:25:53.161983+0000","last_peered":"2024-09-21T03:25:53.161983+0000","last_clean":"2024-09-21T03:25:53.161983+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:25:53.161983+0000","last_undegraded":"2024-09-21T03:25:53.161983+0000","last_fullsized":"2024-09-21T03:25:53.161983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509536,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33200,"kb_used_data":2012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338640,"statfs":{"total":96636764160,"available":96602767360,"internally_reserved":0,"allocated":2060288,"data_stored":1207524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509535,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32612,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339228,"statfs":{"total":96636764160,"available":96603369472,"internally_reserved":0,"allocated":1454080,"data_stored":616518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509534,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1449984,"data_stored":615018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1445888,"data_stored":614976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509535,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1449984,"data_stored":615066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509535,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36756,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335084,"statfs":{"total":96636764160,"available":96599126016,"internally_reserved":0,"allocated":1437696,"data_stored":609222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509535,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36756,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335084,"statfs":{"total":96636764160,"available":96599126016,"internally_reserved":0,"allocated":1441792,"data_stored":614906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574942,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33156,"kb_used_data":1964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338684,"statfs":{"total":96636764160,"available":96602812416,"internally_reserved":0,"allocated":2011136,"data_stored":1192199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:25:56.576 INFO:tasks.ceph.mds.a.smithi105.stderr:2024-09-21T03:25:56.575+0000 7ff25c14f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T03:25:57.503 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:25:57.506 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:25:58.719 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:25:58.844 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:58.843+0000 7f69173f1640 1 -- 172.21.15.105:0/2679598981 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f691006cde0 msgr2=0x7f691006d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:58.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:58.843+0000 7f69173f1640 1 --2- 172.21.15.105:0/2679598981 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f691006cde0 0x7f691006d1f0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f69100cf590 tx=0x7f690802aac0 comp rx=0 tx=0).stop 2024-09-21T03:25:58.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:58.843+0000 7f69173f1640 1 -- 172.21.15.105:0/2679598981 shutdown_connections 2024-09-21T03:25:58.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:58.843+0000 7f69173f1640 1 --2- 172.21.15.105:0/2679598981 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f691006cde0 0x7f691006d1f0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:58.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:58.843+0000 7f69173f1640 1 --2- 172.21.15.105:0/2679598981 >> v2:172.21.15.162:3300/0 conn(0x7f691015c570 0x7f691015f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:58.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:58.843+0000 7f69173f1640 1 -- 172.21.15.105:0/2679598981 >> 172.21.15.105:0/2679598981 conn(0x7f69100cdcb0 msgr2=0x7f69100ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:58.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:58.843+0000 7f69173f1640 1 -- 172.21.15.105:0/2679598981 shutdown_connections 2024-09-21T03:25:58.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:58.843+0000 7f69173f1640 1 -- 172.21.15.105:0/2679598981 wait complete. 2024-09-21T03:25:58.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:58.845+0000 7f69173f1640 1 Processor -- start 2024-09-21T03:25:58.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:58.845+0000 7f69173f1640 1 -- start start 2024-09-21T03:25:58.849 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:58.846+0000 7f69173f1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f691006cde0 0x7f691014ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:58.849 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:58.846+0000 7f69173f1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69100701b0 0x7f691014b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:58.849 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:58.846+0000 7f69173f1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f691015c570 0x7f69101f9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:58.849 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:58.846+0000 7f69173f1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f69100b3350 con 0x7f69100701b0 2024-09-21T03:25:58.849 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:58.846+0000 7f69173f1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f69100b31d0 con 0x7f691006cde0 2024-09-21T03:25:58.849 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:58.846+0000 7f69173f1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f69100b34d0 con 0x7f691015c570 2024-09-21T03:25:58.849 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:58.846+0000 7f691498c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69100701b0 0x7f691014b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:58.849 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:58.846+0000 7f691498c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69100701b0 0x7f691014b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:37938/0 (socket says 172.21.15.105:37938) 2024-09-21T03:25:58.849 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:58.846+0000 7f691498c640 1 -- 172.21.15.105:0/172505602 learned_addr learned my addr 172.21.15.105:0/172505602 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:58.849 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:58.846+0000 7f691518d640 1 --2- 172.21.15.105:0/172505602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f691006cde0 0x7f691014ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:58.850 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:58.846+0000 7f691598e640 1 --2- 172.21.15.105:0/172505602 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f691015c570 0x7f69101f9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:58.850 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:58.846+0000 7f691498c640 1 -- 172.21.15.105:0/172505602 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f691015c570 msgr2=0x7f69101f9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:58.850 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:58.846+0000 7f691498c640 1 --2- 172.21.15.105:0/172505602 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f691015c570 0x7f69101f9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:58.850 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:58.846+0000 7f691498c640 1 -- 172.21.15.105:0/172505602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f691006cde0 msgr2=0x7f691014ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:58.850 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:58.846+0000 7f691498c640 1 --2- 172.21.15.105:0/172505602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f691006cde0 0x7f691014ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:58.850 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:58.846+0000 7f691498c640 1 -- 172.21.15.105:0/172505602 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6910155b00 con 0x7f69100701b0 2024-09-21T03:25:58.850 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:58.846+0000 7f691598e640 1 --2- 172.21.15.105:0/172505602 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f691015c570 0x7f69101f9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:25:58.850 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:58.846+0000 7f691498c640 1 --2- 172.21.15.105:0/172505602 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69100701b0 0x7f691014b040 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f690000d6a0 tx=0x7f690000db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:58.850 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:58.847+0000 7f6905ffb640 1 -- 172.21.15.105:0/172505602 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6900017070 con 0x7f69100701b0 2024-09-21T03:25:58.850 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:58.847+0000 7f6905ffb640 1 -- 172.21.15.105:0/172505602 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6900005310 con 0x7f69100701b0 2024-09-21T03:25:58.850 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:58.847+0000 7f6905ffb640 1 -- 172.21.15.105:0/172505602 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69000097c0 con 0x7f69100701b0 2024-09-21T03:25:58.850 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:58.847+0000 7f69173f1640 1 -- 172.21.15.105:0/172505602 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6910155de0 con 0x7f69100701b0 2024-09-21T03:25:58.850 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:58.847+0000 7f69173f1640 1 -- 172.21.15.105:0/172505602 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69101563a0 con 0x7f69100701b0 2024-09-21T03:25:58.851 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:58.848+0000 7f69173f1640 1 -- 172.21.15.105:0/172505602 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f691014b610 con 0x7f69100701b0 2024-09-21T03:25:58.851 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:58.849+0000 7f6905ffb640 1 -- 172.21.15.105:0/172505602 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6900009960 con 0x7f69100701b0 2024-09-21T03:25:58.852 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:58.849+0000 7f6905ffb640 1 --2- 172.21.15.105:0/172505602 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f68f4078b90 0x7f68f407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:58.852 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:58.849+0000 7f6905ffb640 1 -- 172.21.15.105:0/172505602 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7f690009ad90 con 0x7f69100701b0 2024-09-21T03:25:58.852 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:58.849+0000 7f691518d640 1 --2- 172.21.15.105:0/172505602 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f68f4078b90 0x7f68f407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:58.852 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:58.850+0000 7f691518d640 1 --2- 172.21.15.105:0/172505602 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f68f4078b90 0x7f68f407b0a0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f691009f280 tx=0x7f690c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:58.855 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:58.854+0000 7f6905ffb640 1 -- 172.21.15.105:0/172505602 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6900063260 con 0x7f69100701b0 2024-09-21T03:25:59.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.026+0000 7f69173f1640 1 -- 172.21.15.105:0/172505602 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f69100b39e0 con 0x7f68f4078b90 2024-09-21T03:25:59.032 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.031+0000 7f6905ffb640 1 -- 172.21.15.105:0/172505602 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252454 (secure 0 0 0) 0x7f69100b39e0 con 0x7f68f4078b90 2024-09-21T03:25:59.035 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:59.036 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:25:59.037 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.034+0000 7f69173f1640 1 -- 172.21.15.105:0/172505602 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f68f4078b90 msgr2=0x7f68f407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:59.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.034+0000 7f69173f1640 1 --2- 172.21.15.105:0/172505602 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f68f4078b90 0x7f68f407b0a0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f691009f280 tx=0x7f690c009040 comp rx=0 tx=0).stop 2024-09-21T03:25:59.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.034+0000 7f69173f1640 1 -- 172.21.15.105:0/172505602 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69100701b0 msgr2=0x7f691014b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:59.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.034+0000 7f69173f1640 1 --2- 172.21.15.105:0/172505602 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69100701b0 0x7f691014b040 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f690000d6a0 tx=0x7f690000db60 comp rx=0 tx=0).stop 2024-09-21T03:25:59.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.034+0000 7f69173f1640 1 -- 172.21.15.105:0/172505602 shutdown_connections 2024-09-21T03:25:59.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.034+0000 7f69173f1640 1 --2- 172.21.15.105:0/172505602 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f68f4078b90 0x7f68f407b0a0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:59.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.034+0000 7f69173f1640 1 --2- 172.21.15.105:0/172505602 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f691015c570 0x7f69101f9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:59.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.034+0000 7f69173f1640 1 --2- 172.21.15.105:0/172505602 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69100701b0 0x7f691014b040 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:59.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.034+0000 7f69173f1640 1 --2- 172.21.15.105:0/172505602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f691006cde0 0x7f691014ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:59.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.034+0000 7f69173f1640 1 -- 172.21.15.105:0/172505602 >> 172.21.15.105:0/172505602 conn(0x7f69100cdcb0 msgr2=0x7f691015cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:59.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.034+0000 7f69173f1640 1 -- 172.21.15.105:0/172505602 shutdown_connections 2024-09-21T03:25:59.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.034+0000 7f69173f1640 1 -- 172.21.15.105:0/172505602 wait complete. 2024-09-21T03:25:59.047 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":340,"stamp":"2024-09-21T03:25:57.400018+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":93,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":270320,"kb_used_data":12476,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754704400,"statfs":{"total":773094113280,"available":772817305600,"internally_reserved":0,"allocated":12775424,"data_stored":6098504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.163879"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.000736+0000","last_change":"2024-09-21T03:25:51.248711+0000","last_active":"2024-09-21T03:25:53.000736+0000","last_peered":"2024-09-21T03:25:53.000736+0000","last_clean":"2024-09-21T03:25:53.000736+0000","last_became_active":"2024-09-21T03:25:51.248393+0000","last_became_peered":"2024-09-21T03:25:51.248393+0000","last_unstale":"2024-09-21T03:25:53.000736+0000","last_undegraded":"2024-09-21T03:25:53.000736+0000","last_fullsized":"2024-09-21T03:25:53.000736+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:37.875421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.162004+0000","last_change":"2024-09-21T03:25:51.259088+0000","last_active":"2024-09-21T03:25:53.162004+0000","last_peered":"2024-09-21T03:25:53.162004+0000","last_clean":"2024-09-21T03:25:53.162004+0000","last_became_active":"2024-09-21T03:25:51.258797+0000","last_became_peered":"2024-09-21T03:25:51.258797+0000","last_unstale":"2024-09-21T03:25:53.162004+0000","last_undegraded":"2024-09-21T03:25:53.162004+0000","last_fullsized":"2024-09-21T03:25:53.162004+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:41.362098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.241749+0000","last_change":"2024-09-21T03:25:51.252204+0000","last_active":"2024-09-21T03:25:52.241749+0000","last_peered":"2024-09-21T03:25:52.241749+0000","last_clean":"2024-09-21T03:25:52.241749+0000","last_became_active":"2024-09-21T03:25:51.251882+0000","last_became_peered":"2024-09-21T03:25:51.251882+0000","last_unstale":"2024-09-21T03:25:52.241749+0000","last_undegraded":"2024-09-21T03:25:52.241749+0000","last_fullsized":"2024-09-21T03:25:52.241749+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:31:04.488847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.000550+0000","last_change":"2024-09-21T03:25:51.265602+0000","last_active":"2024-09-21T03:25:53.000550+0000","last_peered":"2024-09-21T03:25:53.000550+0000","last_clean":"2024-09-21T03:25:53.000550+0000","last_became_active":"2024-09-21T03:25:51.265312+0000","last_became_peered":"2024-09-21T03:25:51.265312+0000","last_unstale":"2024-09-21T03:25:53.000550+0000","last_undegraded":"2024-09-21T03:25:53.000550+0000","last_fullsized":"2024-09-21T03:25:53.000550+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:22:21.670042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.163122+0000","last_change":"2024-09-21T03:25:51.265962+0000","last_active":"2024-09-21T03:25:53.163122+0000","last_peered":"2024-09-21T03:25:53.163122+0000","last_clean":"2024-09-21T03:25:53.163122+0000","last_became_active":"2024-09-21T03:25:51.265587+0000","last_became_peered":"2024-09-21T03:25:51.265587+0000","last_unstale":"2024-09-21T03:25:53.163122+0000","last_undegraded":"2024-09-21T03:25:53.163122+0000","last_fullsized":"2024-09-21T03:25:53.163122+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:06.104515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.162410+0000","last_change":"2024-09-21T03:25:51.244606+0000","last_active":"2024-09-21T03:25:53.162410+0000","last_peered":"2024-09-21T03:25:53.162410+0000","last_clean":"2024-09-21T03:25:53.162410+0000","last_became_active":"2024-09-21T03:25:51.244242+0000","last_became_peered":"2024-09-21T03:25:51.244242+0000","last_unstale":"2024-09-21T03:25:53.162410+0000","last_undegraded":"2024-09-21T03:25:53.162410+0000","last_fullsized":"2024-09-21T03:25:53.162410+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:32.888760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.162314+0000","last_change":"2024-09-21T03:25:51.247674+0000","last_active":"2024-09-21T03:25:53.162314+0000","last_peered":"2024-09-21T03:25:53.162314+0000","last_clean":"2024-09-21T03:25:53.162314+0000","last_became_active":"2024-09-21T03:25:51.247348+0000","last_became_peered":"2024-09-21T03:25:51.247348+0000","last_unstale":"2024-09-21T03:25:53.162314+0000","last_undegraded":"2024-09-21T03:25:53.162314+0000","last_fullsized":"2024-09-21T03:25:53.162314+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:13:45.519668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.241312+0000","last_change":"2024-09-21T03:25:51.263685+0000","last_active":"2024-09-21T03:25:52.241312+0000","last_peered":"2024-09-21T03:25:52.241312+0000","last_clean":"2024-09-21T03:25:52.241312+0000","last_became_active":"2024-09-21T03:25:51.263179+0000","last_became_peered":"2024-09-21T03:25:51.263179+0000","last_unstale":"2024-09-21T03:25:52.241312+0000","last_undegraded":"2024-09-21T03:25:52.241312+0000","last_fullsized":"2024-09-21T03:25:52.241312+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:20:43.738361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.241720+0000","last_change":"2024-09-21T03:25:51.260833+0000","last_active":"2024-09-21T03:25:52.241720+0000","last_peered":"2024-09-21T03:25:52.241720+0000","last_clean":"2024-09-21T03:25:52.241720+0000","last_became_active":"2024-09-21T03:25:51.260493+0000","last_became_peered":"2024-09-21T03:25:51.260493+0000","last_unstale":"2024-09-21T03:25:52.241720+0000","last_undegraded":"2024-09-21T03:25:52.241720+0000","last_fullsized":"2024-09-21T03:25:52.241720+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:32:22.536643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.161928+0000","last_change":"2024-09-21T03:25:51.258814+0000","last_active":"2024-09-21T03:25:53.161928+0000","last_peered":"2024-09-21T03:25:53.161928+0000","last_clean":"2024-09-21T03:25:53.161928+0000","last_became_active":"2024-09-21T03:25:51.258509+0000","last_became_peered":"2024-09-21T03:25:51.258509+0000","last_unstale":"2024-09-21T03:25:53.161928+0000","last_undegraded":"2024-09-21T03:25:53.161928+0000","last_fullsized":"2024-09-21T03:25:53.161928+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:15.953062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.334361+0000","last_change":"2024-09-21T03:25:51.258646+0000","last_active":"2024-09-21T03:25:52.334361+0000","last_peered":"2024-09-21T03:25:52.334361+0000","last_clean":"2024-09-21T03:25:52.334361+0000","last_became_active":"2024-09-21T03:25:51.258369+0000","last_became_peered":"2024-09-21T03:25:51.258369+0000","last_unstale":"2024-09-21T03:25:52.334361+0000","last_undegraded":"2024-09-21T03:25:52.334361+0000","last_fullsized":"2024-09-21T03:25:52.334361+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:41:50.711779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.242596+0000","last_change":"2024-09-21T03:25:51.259705+0000","last_active":"2024-09-21T03:25:52.242596+0000","last_peered":"2024-09-21T03:25:52.242596+0000","last_clean":"2024-09-21T03:25:52.242596+0000","last_became_active":"2024-09-21T03:25:51.259402+0000","last_became_peered":"2024-09-21T03:25:51.259402+0000","last_unstale":"2024-09-21T03:25:52.242596+0000","last_undegraded":"2024-09-21T03:25:52.242596+0000","last_fullsized":"2024-09-21T03:25:52.242596+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:23.214183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.000660+0000","last_change":"2024-09-21T03:25:51.252978+0000","last_active":"2024-09-21T03:25:53.000660+0000","last_peered":"2024-09-21T03:25:53.000660+0000","last_clean":"2024-09-21T03:25:53.000660+0000","last_became_active":"2024-09-21T03:25:51.252596+0000","last_became_peered":"2024-09-21T03:25:51.252596+0000","last_unstale":"2024-09-21T03:25:53.000660+0000","last_undegraded":"2024-09-21T03:25:53.000660+0000","last_fullsized":"2024-09-21T03:25:53.000660+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:18.432289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.161758+0000","last_change":"2024-09-21T03:25:51.267105+0000","last_active":"2024-09-21T03:25:53.161758+0000","last_peered":"2024-09-21T03:25:53.161758+0000","last_clean":"2024-09-21T03:25:53.161758+0000","last_became_active":"2024-09-21T03:25:51.266806+0000","last_became_peered":"2024-09-21T03:25:51.266806+0000","last_unstale":"2024-09-21T03:25:53.161758+0000","last_undegraded":"2024-09-21T03:25:53.161758+0000","last_fullsized":"2024-09-21T03:25:53.161758+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:03:08.980502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.000449+0000","last_change":"2024-09-21T03:25:51.256958+0000","last_active":"2024-09-21T03:25:53.000449+0000","last_peered":"2024-09-21T03:25:53.000449+0000","last_clean":"2024-09-21T03:25:53.000449+0000","last_became_active":"2024-09-21T03:25:51.256655+0000","last_became_peered":"2024-09-21T03:25:51.256655+0000","last_unstale":"2024-09-21T03:25:53.000449+0000","last_undegraded":"2024-09-21T03:25:53.000449+0000","last_fullsized":"2024-09-21T03:25:53.000449+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:18.036095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.239406+0000","last_change":"2024-09-21T03:25:51.266793+0000","last_active":"2024-09-21T03:25:52.239406+0000","last_peered":"2024-09-21T03:25:52.239406+0000","last_clean":"2024-09-21T03:25:52.239406+0000","last_became_active":"2024-09-21T03:25:51.266490+0000","last_became_peered":"2024-09-21T03:25:51.266490+0000","last_unstale":"2024-09-21T03:25:52.239406+0000","last_undegraded":"2024-09-21T03:25:52.239406+0000","last_fullsized":"2024-09-21T03:25:52.239406+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:47.178687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.163329+0000","last_change":"2024-09-21T03:25:51.254400+0000","last_active":"2024-09-21T03:25:53.163329+0000","last_peered":"2024-09-21T03:25:53.163329+0000","last_clean":"2024-09-21T03:25:53.163329+0000","last_became_active":"2024-09-21T03:25:51.254054+0000","last_became_peered":"2024-09-21T03:25:51.254054+0000","last_unstale":"2024-09-21T03:25:53.163329+0000","last_undegraded":"2024-09-21T03:25:53.163329+0000","last_fullsized":"2024-09-21T03:25:53.163329+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:37.216000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.239921+0000","last_change":"2024-09-21T03:25:51.260628+0000","last_active":"2024-09-21T03:25:52.239921+0000","last_peered":"2024-09-21T03:25:52.239921+0000","last_clean":"2024-09-21T03:25:52.239921+0000","last_became_active":"2024-09-21T03:25:51.260324+0000","last_became_peered":"2024-09-21T03:25:51.260324+0000","last_unstale":"2024-09-21T03:25:52.239921+0000","last_undegraded":"2024-09-21T03:25:52.239921+0000","last_fullsized":"2024-09-21T03:25:52.239921+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:56:58.779262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.334366+0000","last_change":"2024-09-21T03:25:51.260227+0000","last_active":"2024-09-21T03:25:52.334366+0000","last_peered":"2024-09-21T03:25:52.334366+0000","last_clean":"2024-09-21T03:25:52.334366+0000","last_became_active":"2024-09-21T03:25:51.259914+0000","last_became_peered":"2024-09-21T03:25:51.259914+0000","last_unstale":"2024-09-21T03:25:52.334366+0000","last_undegraded":"2024-09-21T03:25:52.334366+0000","last_fullsized":"2024-09-21T03:25:52.334366+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:08.295626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.239693+0000","last_change":"2024-09-21T03:25:51.263624+0000","last_active":"2024-09-21T03:25:52.239693+0000","last_peered":"2024-09-21T03:25:52.239693+0000","last_clean":"2024-09-21T03:25:52.239693+0000","last_became_active":"2024-09-21T03:25:51.263335+0000","last_became_peered":"2024-09-21T03:25:51.263335+0000","last_unstale":"2024-09-21T03:25:52.239693+0000","last_undegraded":"2024-09-21T03:25:52.239693+0000","last_fullsized":"2024-09-21T03:25:52.239693+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:37.427842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.162820+0000","last_change":"2024-09-21T03:25:51.265326+0000","last_active":"2024-09-21T03:25:53.162820+0000","last_peered":"2024-09-21T03:25:53.162820+0000","last_clean":"2024-09-21T03:25:53.162820+0000","last_became_active":"2024-09-21T03:25:51.264885+0000","last_became_peered":"2024-09-21T03:25:51.264885+0000","last_unstale":"2024-09-21T03:25:53.162820+0000","last_undegraded":"2024-09-21T03:25:53.162820+0000","last_fullsized":"2024-09-21T03:25:53.162820+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:53.273250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.334144+0000","last_change":"2024-09-21T03:25:51.261227+0000","last_active":"2024-09-21T03:25:52.334144+0000","last_peered":"2024-09-21T03:25:52.334144+0000","last_clean":"2024-09-21T03:25:52.334144+0000","last_became_active":"2024-09-21T03:25:51.260891+0000","last_became_peered":"2024-09-21T03:25:51.260891+0000","last_unstale":"2024-09-21T03:25:52.334144+0000","last_undegraded":"2024-09-21T03:25:52.334144+0000","last_fullsized":"2024-09-21T03:25:52.334144+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:38.403387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.242621+0000","last_change":"2024-09-21T03:25:51.259809+0000","last_active":"2024-09-21T03:25:52.242621+0000","last_peered":"2024-09-21T03:25:52.242621+0000","last_clean":"2024-09-21T03:25:52.242621+0000","last_became_active":"2024-09-21T03:25:51.259427+0000","last_became_peered":"2024-09-21T03:25:51.259427+0000","last_unstale":"2024-09-21T03:25:52.242621+0000","last_undegraded":"2024-09-21T03:25:52.242621+0000","last_fullsized":"2024-09-21T03:25:52.242621+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:48.043712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.334079+0000","last_change":"2024-09-21T03:25:51.262058+0000","last_active":"2024-09-21T03:25:52.334079+0000","last_peered":"2024-09-21T03:25:52.334079+0000","last_clean":"2024-09-21T03:25:52.334079+0000","last_became_active":"2024-09-21T03:25:51.261722+0000","last_became_peered":"2024-09-21T03:25:51.261722+0000","last_unstale":"2024-09-21T03:25:52.334079+0000","last_undegraded":"2024-09-21T03:25:52.334079+0000","last_fullsized":"2024-09-21T03:25:52.334079+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:36.374384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.162011+0000","last_change":"2024-09-21T03:25:51.267166+0000","last_active":"2024-09-21T03:25:53.162011+0000","last_peered":"2024-09-21T03:25:53.162011+0000","last_clean":"2024-09-21T03:25:53.162011+0000","last_became_active":"2024-09-21T03:25:51.266841+0000","last_became_peered":"2024-09-21T03:25:51.266841+0000","last_unstale":"2024-09-21T03:25:53.162011+0000","last_undegraded":"2024-09-21T03:25:53.162011+0000","last_fullsized":"2024-09-21T03:25:53.162011+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:30:30.557034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.239957+0000","last_change":"2024-09-21T03:25:51.270460+0000","last_active":"2024-09-21T03:25:52.239957+0000","last_peered":"2024-09-21T03:25:52.239957+0000","last_clean":"2024-09-21T03:25:52.239957+0000","last_became_active":"2024-09-21T03:25:51.270158+0000","last_became_peered":"2024-09-21T03:25:51.270158+0000","last_unstale":"2024-09-21T03:25:52.239957+0000","last_undegraded":"2024-09-21T03:25:52.239957+0000","last_fullsized":"2024-09-21T03:25:52.239957+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:20.868178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.000566+0000","last_change":"2024-09-21T03:25:51.250414+0000","last_active":"2024-09-21T03:25:53.000566+0000","last_peered":"2024-09-21T03:25:53.000566+0000","last_clean":"2024-09-21T03:25:53.000566+0000","last_became_active":"2024-09-21T03:25:51.250100+0000","last_became_peered":"2024-09-21T03:25:51.250100+0000","last_unstale":"2024-09-21T03:25:53.000566+0000","last_undegraded":"2024-09-21T03:25:53.000566+0000","last_fullsized":"2024-09-21T03:25:53.000566+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:53.223583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.241545+0000","last_change":"2024-09-21T03:25:51.264438+0000","last_active":"2024-09-21T03:25:52.241545+0000","last_peered":"2024-09-21T03:25:52.241545+0000","last_clean":"2024-09-21T03:25:52.241545+0000","last_became_active":"2024-09-21T03:25:51.264068+0000","last_became_peered":"2024-09-21T03:25:51.264068+0000","last_unstale":"2024-09-21T03:25:52.241545+0000","last_undegraded":"2024-09-21T03:25:52.241545+0000","last_fullsized":"2024-09-21T03:25:52.241545+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:32:35.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.000664+0000","last_change":"2024-09-21T03:25:51.252934+0000","last_active":"2024-09-21T03:25:53.000664+0000","last_peered":"2024-09-21T03:25:53.000664+0000","last_clean":"2024-09-21T03:25:53.000664+0000","last_became_active":"2024-09-21T03:25:51.252221+0000","last_became_peered":"2024-09-21T03:25:51.252221+0000","last_unstale":"2024-09-21T03:25:53.000664+0000","last_undegraded":"2024-09-21T03:25:53.000664+0000","last_fullsized":"2024-09-21T03:25:53.000664+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:03:49.678365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.000395+0000","last_change":"2024-09-21T03:25:51.252018+0000","last_active":"2024-09-21T03:25:53.000395+0000","last_peered":"2024-09-21T03:25:53.000395+0000","last_clean":"2024-09-21T03:25:53.000395+0000","last_became_active":"2024-09-21T03:25:51.251698+0000","last_became_peered":"2024-09-21T03:25:51.251698+0000","last_unstale":"2024-09-21T03:25:53.000395+0000","last_undegraded":"2024-09-21T03:25:53.000395+0000","last_fullsized":"2024-09-21T03:25:53.000395+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:27:46.578658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.162840+0000","last_change":"2024-09-21T03:25:51.270602+0000","last_active":"2024-09-21T03:25:53.162840+0000","last_peered":"2024-09-21T03:25:53.162840+0000","last_clean":"2024-09-21T03:25:53.162840+0000","last_became_active":"2024-09-21T03:25:51.270260+0000","last_became_peered":"2024-09-21T03:25:51.270260+0000","last_unstale":"2024-09-21T03:25:53.162840+0000","last_undegraded":"2024-09-21T03:25:53.162840+0000","last_fullsized":"2024-09-21T03:25:53.162840+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:56:58.779262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.162187+0000","last_change":"2024-09-21T03:25:51.259013+0000","last_active":"2024-09-21T03:25:53.162187+0000","last_peered":"2024-09-21T03:25:53.162187+0000","last_clean":"2024-09-21T03:25:53.162187+0000","last_became_active":"2024-09-21T03:25:51.258651+0000","last_became_peered":"2024-09-21T03:25:51.258651+0000","last_unstale":"2024-09-21T03:25:53.162187+0000","last_undegraded":"2024-09-21T03:25:53.162187+0000","last_fullsized":"2024-09-21T03:25:53.162187+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:10.839121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.240131+0000","last_change":"2024-09-21T03:25:51.269188+0000","last_active":"2024-09-21T03:25:52.240131+0000","last_peered":"2024-09-21T03:25:52.240131+0000","last_clean":"2024-09-21T03:25:52.240131+0000","last_became_active":"2024-09-21T03:25:51.268902+0000","last_became_peered":"2024-09-21T03:25:51.268902+0000","last_unstale":"2024-09-21T03:25:52.240131+0000","last_undegraded":"2024-09-21T03:25:52.240131+0000","last_fullsized":"2024-09-21T03:25:52.240131+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:49.373550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"115'4","reported_seq":19,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.163001+0000","last_change":"2024-09-21T03:25:50.257497+0000","last_active":"2024-09-21T03:25:53.163001+0000","last_peered":"2024-09-21T03:25:53.163001+0000","last_clean":"2024-09-21T03:25:53.163001+0000","last_became_active":"2024-09-21T03:25:50.257090+0000","last_became_peered":"2024-09-21T03:25:50.257090+0000","last_unstale":"2024-09-21T03:25:53.163001+0000","last_undegraded":"2024-09-21T03:25:53.163001+0000","last_fullsized":"2024-09-21T03:25:53.163001+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:47.041935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.241984+0000","last_change":"2024-09-21T03:25:51.251971+0000","last_active":"2024-09-21T03:25:52.241984+0000","last_peered":"2024-09-21T03:25:52.241984+0000","last_clean":"2024-09-21T03:25:52.241984+0000","last_became_active":"2024-09-21T03:25:51.250772+0000","last_became_peered":"2024-09-21T03:25:51.250772+0000","last_unstale":"2024-09-21T03:25:52.241984+0000","last_undegraded":"2024-09-21T03:25:52.241984+0000","last_fullsized":"2024-09-21T03:25:52.241984+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:31.157143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"115'1","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.241688+0000","last_change":"2024-09-21T03:25:50.251806+0000","last_active":"2024-09-21T03:25:52.241688+0000","last_peered":"2024-09-21T03:25:52.241688+0000","last_clean":"2024-09-21T03:25:52.241688+0000","last_became_active":"2024-09-21T03:25:50.251430+0000","last_became_peered":"2024-09-21T03:25:50.251430+0000","last_unstale":"2024-09-21T03:25:52.241688+0000","last_undegraded":"2024-09-21T03:25:52.241688+0000","last_fullsized":"2024-09-21T03:25:52.241688+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:57.276665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.162909+0000","last_change":"2024-09-21T03:25:51.262931+0000","last_active":"2024-09-21T03:25:53.162909+0000","last_peered":"2024-09-21T03:25:53.162909+0000","last_clean":"2024-09-21T03:25:53.162909+0000","last_became_active":"2024-09-21T03:25:51.262629+0000","last_became_peered":"2024-09-21T03:25:51.262629+0000","last_unstale":"2024-09-21T03:25:53.162909+0000","last_undegraded":"2024-09-21T03:25:53.162909+0000","last_fullsized":"2024-09-21T03:25:53.162909+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:17:20.868178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"115'2","reported_seq":17,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.334529+0000","last_change":"2024-09-21T03:25:50.247877+0000","last_active":"2024-09-21T03:25:52.334529+0000","last_peered":"2024-09-21T03:25:52.334529+0000","last_clean":"2024-09-21T03:25:52.334529+0000","last_became_active":"2024-09-21T03:25:50.247575+0000","last_became_peered":"2024-09-21T03:25:50.247575+0000","last_unstale":"2024-09-21T03:25:52.334529+0000","last_undegraded":"2024-09-21T03:25:52.334529+0000","last_fullsized":"2024-09-21T03:25:52.334529+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:38.761687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.162599+0000","last_change":"2024-09-21T03:25:51.261731+0000","last_active":"2024-09-21T03:25:53.162599+0000","last_peered":"2024-09-21T03:25:53.162599+0000","last_clean":"2024-09-21T03:25:53.162599+0000","last_became_active":"2024-09-21T03:25:51.261401+0000","last_became_peered":"2024-09-21T03:25:51.261401+0000","last_unstale":"2024-09-21T03:25:53.162599+0000","last_undegraded":"2024-09-21T03:25:53.162599+0000","last_fullsized":"2024-09-21T03:25:53.162599+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:52.195251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"115'2","reported_seq":17,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.161834+0000","last_change":"2024-09-21T03:25:50.259794+0000","last_active":"2024-09-21T03:25:53.161834+0000","last_peered":"2024-09-21T03:25:53.161834+0000","last_clean":"2024-09-21T03:25:53.161834+0000","last_became_active":"2024-09-21T03:25:50.259475+0000","last_became_peered":"2024-09-21T03:25:50.259475+0000","last_unstale":"2024-09-21T03:25:53.161834+0000","last_undegraded":"2024-09-21T03:25:53.161834+0000","last_fullsized":"2024-09-21T03:25:53.161834+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:41.304817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.239471+0000","last_change":"2024-09-21T03:25:51.261280+0000","last_active":"2024-09-21T03:25:52.239471+0000","last_peered":"2024-09-21T03:25:52.239471+0000","last_clean":"2024-09-21T03:25:52.239471+0000","last_became_active":"2024-09-21T03:25:51.260983+0000","last_became_peered":"2024-09-21T03:25:51.260983+0000","last_unstale":"2024-09-21T03:25:52.239471+0000","last_undegraded":"2024-09-21T03:25:52.239471+0000","last_fullsized":"2024-09-21T03:25:52.239471+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:07:06.578903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"115'1","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.161545+0000","last_change":"2024-09-21T03:25:50.257059+0000","last_active":"2024-09-21T03:25:53.161545+0000","last_peered":"2024-09-21T03:25:53.161545+0000","last_clean":"2024-09-21T03:25:53.161545+0000","last_became_active":"2024-09-21T03:25:50.256756+0000","last_became_peered":"2024-09-21T03:25:50.256756+0000","last_unstale":"2024-09-21T03:25:53.161545+0000","last_undegraded":"2024-09-21T03:25:53.161545+0000","last_fullsized":"2024-09-21T03:25:53.161545+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:11.882336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.162601+0000","last_change":"2024-09-21T03:25:51.255113+0000","last_active":"2024-09-21T03:25:53.162601+0000","last_peered":"2024-09-21T03:25:53.162601+0000","last_clean":"2024-09-21T03:25:53.162601+0000","last_became_active":"2024-09-21T03:25:51.253298+0000","last_became_peered":"2024-09-21T03:25:51.253298+0000","last_unstale":"2024-09-21T03:25:53.162601+0000","last_undegraded":"2024-09-21T03:25:53.162601+0000","last_fullsized":"2024-09-21T03:25:53.162601+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:40.423688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"115'1","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.239448+0000","last_change":"2024-09-21T03:25:50.254775+0000","last_active":"2024-09-21T03:25:52.239448+0000","last_peered":"2024-09-21T03:25:52.239448+0000","last_clean":"2024-09-21T03:25:52.239448+0000","last_became_active":"2024-09-21T03:25:50.254451+0000","last_became_peered":"2024-09-21T03:25:50.254451+0000","last_unstale":"2024-09-21T03:25:52.239448+0000","last_undegraded":"2024-09-21T03:25:52.239448+0000","last_fullsized":"2024-09-21T03:25:52.239448+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:22.212406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.241750+0000","last_change":"2024-09-21T03:25:51.263161+0000","last_active":"2024-09-21T03:25:52.241750+0000","last_peered":"2024-09-21T03:25:52.241750+0000","last_clean":"2024-09-21T03:25:52.241750+0000","last_became_active":"2024-09-21T03:25:51.262855+0000","last_became_peered":"2024-09-21T03:25:51.262855+0000","last_unstale":"2024-09-21T03:25:52.241750+0000","last_undegraded":"2024-09-21T03:25:52.241750+0000","last_fullsized":"2024-09-21T03:25:52.241750+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:13:45.519668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.162202+0000","last_change":"2024-09-21T03:25:50.252058+0000","last_active":"2024-09-21T03:25:53.162202+0000","last_peered":"2024-09-21T03:25:53.162202+0000","last_clean":"2024-09-21T03:25:53.162202+0000","last_became_active":"2024-09-21T03:25:50.251634+0000","last_became_peered":"2024-09-21T03:25:50.251634+0000","last_unstale":"2024-09-21T03:25:53.162202+0000","last_undegraded":"2024-09-21T03:25:53.162202+0000","last_fullsized":"2024-09-21T03:25:53.162202+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:49.710904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.161564+0000","last_change":"2024-09-21T03:25:51.265511+0000","last_active":"2024-09-21T03:25:53.161564+0000","last_peered":"2024-09-21T03:25:53.161564+0000","last_clean":"2024-09-21T03:25:53.161564+0000","last_became_active":"2024-09-21T03:25:51.265212+0000","last_became_peered":"2024-09-21T03:25:51.265212+0000","last_unstale":"2024-09-21T03:25:53.161564+0000","last_undegraded":"2024-09-21T03:25:53.161564+0000","last_fullsized":"2024-09-21T03:25:53.161564+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:18.629574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.161792+0000","last_change":"2024-09-21T03:25:50.255796+0000","last_active":"2024-09-21T03:25:53.161792+0000","last_peered":"2024-09-21T03:25:53.161792+0000","last_clean":"2024-09-21T03:25:53.161792+0000","last_became_active":"2024-09-21T03:25:50.255502+0000","last_became_peered":"2024-09-21T03:25:50.255502+0000","last_unstale":"2024-09-21T03:25:53.161792+0000","last_undegraded":"2024-09-21T03:25:53.161792+0000","last_fullsized":"2024-09-21T03:25:53.161792+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:19.414720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.000614+0000","last_change":"2024-09-21T03:25:51.260939+0000","last_active":"2024-09-21T03:25:53.000614+0000","last_peered":"2024-09-21T03:25:53.000614+0000","last_clean":"2024-09-21T03:25:53.000614+0000","last_became_active":"2024-09-21T03:25:51.260629+0000","last_became_peered":"2024-09-21T03:25:51.260629+0000","last_unstale":"2024-09-21T03:25:53.000614+0000","last_undegraded":"2024-09-21T03:25:53.000614+0000","last_fullsized":"2024-09-21T03:25:53.000614+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:19.290293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.242168+0000","last_change":"2024-09-21T03:25:50.257409+0000","last_active":"2024-09-21T03:25:52.242168+0000","last_peered":"2024-09-21T03:25:52.242168+0000","last_clean":"2024-09-21T03:25:52.242168+0000","last_became_active":"2024-09-21T03:25:50.257064+0000","last_became_peered":"2024-09-21T03:25:50.257064+0000","last_unstale":"2024-09-21T03:25:52.242168+0000","last_undegraded":"2024-09-21T03:25:52.242168+0000","last_fullsized":"2024-09-21T03:25:52.242168+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:42:00.173652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.242431+0000","last_change":"2024-09-21T03:25:51.263360+0000","last_active":"2024-09-21T03:25:52.242431+0000","last_peered":"2024-09-21T03:25:52.242431+0000","last_clean":"2024-09-21T03:25:52.242431+0000","last_became_active":"2024-09-21T03:25:51.263044+0000","last_became_peered":"2024-09-21T03:25:51.263044+0000","last_unstale":"2024-09-21T03:25:52.242431+0000","last_undegraded":"2024-09-21T03:25:52.242431+0000","last_fullsized":"2024-09-21T03:25:52.242431+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:31:50.712681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.240067+0000","last_change":"2024-09-21T03:25:50.254039+0000","last_active":"2024-09-21T03:25:52.240067+0000","last_peered":"2024-09-21T03:25:52.240067+0000","last_clean":"2024-09-21T03:25:52.240067+0000","last_became_active":"2024-09-21T03:25:50.252998+0000","last_became_peered":"2024-09-21T03:25:50.252998+0000","last_unstale":"2024-09-21T03:25:52.240067+0000","last_undegraded":"2024-09-21T03:25:52.240067+0000","last_fullsized":"2024-09-21T03:25:52.240067+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:35.866871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.163166+0000","last_change":"2024-09-21T03:25:51.267312+0000","last_active":"2024-09-21T03:25:53.163166+0000","last_peered":"2024-09-21T03:25:53.163166+0000","last_clean":"2024-09-21T03:25:53.163166+0000","last_became_active":"2024-09-21T03:25:51.266588+0000","last_became_peered":"2024-09-21T03:25:51.266588+0000","last_unstale":"2024-09-21T03:25:53.163166+0000","last_undegraded":"2024-09-21T03:25:53.163166+0000","last_fullsized":"2024-09-21T03:25:53.163166+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:14.715706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"115'3","reported_seq":18,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.241116+0000","last_change":"2024-09-21T03:25:50.255470+0000","last_active":"2024-09-21T03:25:52.241116+0000","last_peered":"2024-09-21T03:25:52.241116+0000","last_clean":"2024-09-21T03:25:52.241116+0000","last_became_active":"2024-09-21T03:25:50.255109+0000","last_became_peered":"2024-09-21T03:25:50.255109+0000","last_unstale":"2024-09-21T03:25:52.241116+0000","last_undegraded":"2024-09-21T03:25:52.241116+0000","last_fullsized":"2024-09-21T03:25:52.241116+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:51.586215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.163030+0000","last_change":"2024-09-21T03:25:51.262580+0000","last_active":"2024-09-21T03:25:53.163030+0000","last_peered":"2024-09-21T03:25:53.163030+0000","last_clean":"2024-09-21T03:25:53.163030+0000","last_became_active":"2024-09-21T03:25:51.262131+0000","last_became_peered":"2024-09-21T03:25:51.262131+0000","last_unstale":"2024-09-21T03:25:53.163030+0000","last_undegraded":"2024-09-21T03:25:53.163030+0000","last_fullsized":"2024-09-21T03:25:53.163030+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:49.373550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"115'6","reported_seq":21,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.241954+0000","last_change":"2024-09-21T03:25:50.247502+0000","last_active":"2024-09-21T03:25:52.241954+0000","last_peered":"2024-09-21T03:25:52.241954+0000","last_clean":"2024-09-21T03:25:52.241954+0000","last_became_active":"2024-09-21T03:25:50.247158+0000","last_became_peered":"2024-09-21T03:25:50.247158+0000","last_unstale":"2024-09-21T03:25:52.241954+0000","last_undegraded":"2024-09-21T03:25:52.241954+0000","last_fullsized":"2024-09-21T03:25:52.241954+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:21.524938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.000829+0000","last_change":"2024-09-21T03:25:51.257293+0000","last_active":"2024-09-21T03:25:53.000829+0000","last_peered":"2024-09-21T03:25:53.000829+0000","last_clean":"2024-09-21T03:25:53.000829+0000","last_became_active":"2024-09-21T03:25:51.256920+0000","last_became_peered":"2024-09-21T03:25:51.256920+0000","last_unstale":"2024-09-21T03:25:53.000829+0000","last_undegraded":"2024-09-21T03:25:53.000829+0000","last_fullsized":"2024-09-21T03:25:53.000829+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:50:00.670075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.000638+0000","last_change":"2024-09-21T03:25:50.243715+0000","last_active":"2024-09-21T03:25:53.000638+0000","last_peered":"2024-09-21T03:25:53.000638+0000","last_clean":"2024-09-21T03:25:53.000638+0000","last_became_active":"2024-09-21T03:25:50.243412+0000","last_became_peered":"2024-09-21T03:25:50.243412+0000","last_unstale":"2024-09-21T03:25:53.000638+0000","last_undegraded":"2024-09-21T03:25:53.000638+0000","last_fullsized":"2024-09-21T03:25:53.000638+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:08.891716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.161945+0000","last_change":"2024-09-21T03:25:51.262648+0000","last_active":"2024-09-21T03:25:53.161945+0000","last_peered":"2024-09-21T03:25:53.161945+0000","last_clean":"2024-09-21T03:25:53.161945+0000","last_became_active":"2024-09-21T03:25:51.262296+0000","last_became_peered":"2024-09-21T03:25:51.262296+0000","last_unstale":"2024-09-21T03:25:53.161945+0000","last_undegraded":"2024-09-21T03:25:53.161945+0000","last_fullsized":"2024-09-21T03:25:53.161945+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:52:30.955027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.161789+0000","last_change":"2024-09-21T03:25:50.257405+0000","last_active":"2024-09-21T03:25:53.161789+0000","last_peered":"2024-09-21T03:25:53.161789+0000","last_clean":"2024-09-21T03:25:53.161789+0000","last_became_active":"2024-09-21T03:25:50.257089+0000","last_became_peered":"2024-09-21T03:25:50.257089+0000","last_unstale":"2024-09-21T03:25:53.161789+0000","last_undegraded":"2024-09-21T03:25:53.161789+0000","last_fullsized":"2024-09-21T03:25:53.161789+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:58.136844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.242308+0000","last_change":"2024-09-21T03:25:51.260148+0000","last_active":"2024-09-21T03:25:52.242308+0000","last_peered":"2024-09-21T03:25:52.242308+0000","last_clean":"2024-09-21T03:25:52.242308+0000","last_became_active":"2024-09-21T03:25:51.259845+0000","last_became_peered":"2024-09-21T03:25:51.259845+0000","last_unstale":"2024-09-21T03:25:52.242308+0000","last_undegraded":"2024-09-21T03:25:52.242308+0000","last_fullsized":"2024-09-21T03:25:52.242308+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:52.798221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"115'8","reported_seq":23,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.241880+0000","last_change":"2024-09-21T03:25:50.248824+0000","last_active":"2024-09-21T03:25:52.241880+0000","last_peered":"2024-09-21T03:25:52.241880+0000","last_clean":"2024-09-21T03:25:52.241880+0000","last_became_active":"2024-09-21T03:25:50.248492+0000","last_became_peered":"2024-09-21T03:25:50.248492+0000","last_unstale":"2024-09-21T03:25:52.241880+0000","last_undegraded":"2024-09-21T03:25:52.241880+0000","last_fullsized":"2024-09-21T03:25:52.241880+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:40.801965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.242042+0000","last_change":"2024-09-21T03:25:51.251500+0000","last_active":"2024-09-21T03:25:52.242042+0000","last_peered":"2024-09-21T03:25:52.242042+0000","last_clean":"2024-09-21T03:25:52.242042+0000","last_became_active":"2024-09-21T03:25:51.251164+0000","last_became_peered":"2024-09-21T03:25:51.251164+0000","last_unstale":"2024-09-21T03:25:52.242042+0000","last_undegraded":"2024-09-21T03:25:52.242042+0000","last_fullsized":"2024-09-21T03:25:52.242042+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:36:18.465160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"115'1","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.242292+0000","last_change":"2024-09-21T03:25:50.252017+0000","last_active":"2024-09-21T03:25:52.242292+0000","last_peered":"2024-09-21T03:25:52.242292+0000","last_clean":"2024-09-21T03:25:52.242292+0000","last_became_active":"2024-09-21T03:25:50.251469+0000","last_became_peered":"2024-09-21T03:25:50.251469+0000","last_unstale":"2024-09-21T03:25:52.242292+0000","last_undegraded":"2024-09-21T03:25:52.242292+0000","last_fullsized":"2024-09-21T03:25:52.242292+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:41.400779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.241962+0000","last_change":"2024-09-21T03:25:51.261811+0000","last_active":"2024-09-21T03:25:52.241962+0000","last_peered":"2024-09-21T03:25:52.241962+0000","last_clean":"2024-09-21T03:25:52.241962+0000","last_became_active":"2024-09-21T03:25:51.261492+0000","last_became_peered":"2024-09-21T03:25:51.261492+0000","last_unstale":"2024-09-21T03:25:52.241962+0000","last_undegraded":"2024-09-21T03:25:52.241962+0000","last_fullsized":"2024-09-21T03:25:52.241962+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:02.604215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"115'2","reported_seq":17,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.334442+0000","last_change":"2024-09-21T03:25:50.249322+0000","last_active":"2024-09-21T03:25:52.334442+0000","last_peered":"2024-09-21T03:25:52.334442+0000","last_clean":"2024-09-21T03:25:52.334442+0000","last_became_active":"2024-09-21T03:25:50.249036+0000","last_became_peered":"2024-09-21T03:25:50.249036+0000","last_unstale":"2024-09-21T03:25:52.334442+0000","last_undegraded":"2024-09-21T03:25:52.334442+0000","last_fullsized":"2024-09-21T03:25:52.334442+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:57.753544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.239703+0000","last_change":"2024-09-21T03:25:51.267850+0000","last_active":"2024-09-21T03:25:52.239703+0000","last_peered":"2024-09-21T03:25:52.239703+0000","last_clean":"2024-09-21T03:25:52.239703+0000","last_became_active":"2024-09-21T03:25:51.267429+0000","last_became_peered":"2024-09-21T03:25:51.267429+0000","last_unstale":"2024-09-21T03:25:52.239703+0000","last_undegraded":"2024-09-21T03:25:52.239703+0000","last_fullsized":"2024-09-21T03:25:52.239703+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:52.195251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"115'1","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.162881+0000","last_change":"2024-09-21T03:25:50.247667+0000","last_active":"2024-09-21T03:25:53.162881+0000","last_peered":"2024-09-21T03:25:53.162881+0000","last_clean":"2024-09-21T03:25:53.162881+0000","last_became_active":"2024-09-21T03:25:50.247341+0000","last_became_peered":"2024-09-21T03:25:50.247341+0000","last_unstale":"2024-09-21T03:25:53.162881+0000","last_undegraded":"2024-09-21T03:25:53.162881+0000","last_fullsized":"2024-09-21T03:25:53.162881+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:03:00.055617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.161943+0000","last_change":"2024-09-21T03:25:51.264901+0000","last_active":"2024-09-21T03:25:53.161943+0000","last_peered":"2024-09-21T03:25:53.161943+0000","last_clean":"2024-09-21T03:25:53.161943+0000","last_became_active":"2024-09-21T03:25:51.264581+0000","last_became_peered":"2024-09-21T03:25:51.264581+0000","last_unstale":"2024-09-21T03:25:53.161943+0000","last_undegraded":"2024-09-21T03:25:53.161943+0000","last_fullsized":"2024-09-21T03:25:53.161943+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:39.003787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.241316+0000","last_change":"2024-09-21T03:25:50.251065+0000","last_active":"2024-09-21T03:25:52.241316+0000","last_peered":"2024-09-21T03:25:52.241316+0000","last_clean":"2024-09-21T03:25:52.241316+0000","last_became_active":"2024-09-21T03:25:50.250740+0000","last_became_peered":"2024-09-21T03:25:50.250740+0000","last_unstale":"2024-09-21T03:25:52.241316+0000","last_undegraded":"2024-09-21T03:25:52.241316+0000","last_fullsized":"2024-09-21T03:25:52.241316+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:17.110278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.000516+0000","last_change":"2024-09-21T03:25:51.252552+0000","last_active":"2024-09-21T03:25:53.000516+0000","last_peered":"2024-09-21T03:25:53.000516+0000","last_clean":"2024-09-21T03:25:53.000516+0000","last_became_active":"2024-09-21T03:25:51.252089+0000","last_became_peered":"2024-09-21T03:25:51.252089+0000","last_unstale":"2024-09-21T03:25:53.000516+0000","last_undegraded":"2024-09-21T03:25:53.000516+0000","last_fullsized":"2024-09-21T03:25:53.000516+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:32.712249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"115'2","reported_seq":17,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.241394+0000","last_change":"2024-09-21T03:25:50.257644+0000","last_active":"2024-09-21T03:25:52.241394+0000","last_peered":"2024-09-21T03:25:52.241394+0000","last_clean":"2024-09-21T03:25:52.241394+0000","last_became_active":"2024-09-21T03:25:50.257328+0000","last_became_peered":"2024-09-21T03:25:50.257328+0000","last_unstale":"2024-09-21T03:25:52.241394+0000","last_undegraded":"2024-09-21T03:25:52.241394+0000","last_fullsized":"2024-09-21T03:25:52.241394+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:04.123553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.162794+0000","last_change":"2024-09-21T03:25:51.245680+0000","last_active":"2024-09-21T03:25:53.162794+0000","last_peered":"2024-09-21T03:25:53.162794+0000","last_clean":"2024-09-21T03:25:53.162794+0000","last_became_active":"2024-09-21T03:25:51.245331+0000","last_became_peered":"2024-09-21T03:25:51.245331+0000","last_unstale":"2024-09-21T03:25:53.162794+0000","last_undegraded":"2024-09-21T03:25:53.162794+0000","last_fullsized":"2024-09-21T03:25:53.162794+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:27:22.731203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.239560+0000","last_change":"2024-09-21T03:25:50.254124+0000","last_active":"2024-09-21T03:25:52.239560+0000","last_peered":"2024-09-21T03:25:52.239560+0000","last_clean":"2024-09-21T03:25:52.239560+0000","last_became_active":"2024-09-21T03:25:50.253240+0000","last_became_peered":"2024-09-21T03:25:50.253240+0000","last_unstale":"2024-09-21T03:25:52.239560+0000","last_undegraded":"2024-09-21T03:25:52.239560+0000","last_fullsized":"2024-09-21T03:25:52.239560+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:47.041935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.161627+0000","last_change":"2024-09-21T03:25:51.255448+0000","last_active":"2024-09-21T03:25:53.161627+0000","last_peered":"2024-09-21T03:25:53.161627+0000","last_clean":"2024-09-21T03:25:53.161627+0000","last_became_active":"2024-09-21T03:25:51.255144+0000","last_became_peered":"2024-09-21T03:25:51.255144+0000","last_unstale":"2024-09-21T03:25:53.161627+0000","last_undegraded":"2024-09-21T03:25:53.161627+0000","last_fullsized":"2024-09-21T03:25:53.161627+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:41.803742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.239351+0000","last_change":"2024-09-21T03:25:50.253793+0000","last_active":"2024-09-21T03:25:52.239351+0000","last_peered":"2024-09-21T03:25:52.239351+0000","last_clean":"2024-09-21T03:25:52.239351+0000","last_became_active":"2024-09-21T03:25:50.253462+0000","last_became_peered":"2024-09-21T03:25:50.253462+0000","last_unstale":"2024-09-21T03:25:52.239351+0000","last_undegraded":"2024-09-21T03:25:52.239351+0000","last_fullsized":"2024-09-21T03:25:52.239351+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:21:35.409282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.162572+0000","last_change":"2024-09-21T03:25:51.270597+0000","last_active":"2024-09-21T03:25:53.162572+0000","last_peered":"2024-09-21T03:25:53.162572+0000","last_clean":"2024-09-21T03:25:53.162572+0000","last_became_active":"2024-09-21T03:25:51.270219+0000","last_became_peered":"2024-09-21T03:25:51.270219+0000","last_unstale":"2024-09-21T03:25:53.162572+0000","last_undegraded":"2024-09-21T03:25:53.162572+0000","last_fullsized":"2024-09-21T03:25:53.162572+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:57:37.427842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.334003+0000","last_change":"2024-09-21T03:25:50.248647+0000","last_active":"2024-09-21T03:25:52.334003+0000","last_peered":"2024-09-21T03:25:52.334003+0000","last_clean":"2024-09-21T03:25:52.334003+0000","last_became_active":"2024-09-21T03:25:50.248231+0000","last_became_peered":"2024-09-21T03:25:50.248231+0000","last_unstale":"2024-09-21T03:25:52.334003+0000","last_undegraded":"2024-09-21T03:25:52.334003+0000","last_fullsized":"2024-09-21T03:25:52.334003+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:05.855445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.163365+0000","last_change":"2024-09-21T03:25:51.263360+0000","last_active":"2024-09-21T03:25:53.163365+0000","last_peered":"2024-09-21T03:25:53.163365+0000","last_clean":"2024-09-21T03:25:53.163365+0000","last_became_active":"2024-09-21T03:25:51.263044+0000","last_became_peered":"2024-09-21T03:25:51.263044+0000","last_unstale":"2024-09-21T03:25:53.163365+0000","last_undegraded":"2024-09-21T03:25:53.163365+0000","last_fullsized":"2024-09-21T03:25:53.163365+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:13:52.677686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"115'2","reported_seq":17,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.000823+0000","last_change":"2024-09-21T03:25:50.252739+0000","last_active":"2024-09-21T03:25:53.000823+0000","last_peered":"2024-09-21T03:25:53.000823+0000","last_clean":"2024-09-21T03:25:53.000823+0000","last_became_active":"2024-09-21T03:25:50.251400+0000","last_became_peered":"2024-09-21T03:25:50.251400+0000","last_unstale":"2024-09-21T03:25:53.000823+0000","last_undegraded":"2024-09-21T03:25:53.000823+0000","last_fullsized":"2024-09-21T03:25:53.000823+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:51.945355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.000766+0000","last_change":"2024-09-21T03:25:51.257809+0000","last_active":"2024-09-21T03:25:53.000766+0000","last_peered":"2024-09-21T03:25:53.000766+0000","last_clean":"2024-09-21T03:25:53.000766+0000","last_became_active":"2024-09-21T03:25:51.257420+0000","last_became_peered":"2024-09-21T03:25:51.257420+0000","last_unstale":"2024-09-21T03:25:53.000766+0000","last_undegraded":"2024-09-21T03:25:53.000766+0000","last_fullsized":"2024-09-21T03:25:53.000766+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:03:45.200469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"116'1","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.241761+0000","last_change":"2024-09-21T03:25:50.253741+0000","last_active":"2024-09-21T03:25:53.241761+0000","last_peered":"2024-09-21T03:25:53.241761+0000","last_clean":"2024-09-21T03:25:53.241761+0000","last_became_active":"2024-09-21T03:25:50.253397+0000","last_became_peered":"2024-09-21T03:25:50.253397+0000","last_unstale":"2024-09-21T03:25:53.241761+0000","last_undegraded":"2024-09-21T03:25:53.241761+0000","last_fullsized":"2024-09-21T03:25:53.241761+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:22.212406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.161881+0000","last_change":"2024-09-21T03:25:51.267998+0000","last_active":"2024-09-21T03:25:53.161881+0000","last_peered":"2024-09-21T03:25:53.161881+0000","last_clean":"2024-09-21T03:25:53.161881+0000","last_became_active":"2024-09-21T03:25:51.267681+0000","last_became_peered":"2024-09-21T03:25:51.267681+0000","last_unstale":"2024-09-21T03:25:53.161881+0000","last_undegraded":"2024-09-21T03:25:53.161881+0000","last_fullsized":"2024-09-21T03:25:53.161881+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:50.109146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.162035+0000","last_change":"2024-09-21T03:25:50.257326+0000","last_active":"2024-09-21T03:25:53.162035+0000","last_peered":"2024-09-21T03:25:53.162035+0000","last_clean":"2024-09-21T03:25:53.162035+0000","last_became_active":"2024-09-21T03:25:50.257040+0000","last_became_peered":"2024-09-21T03:25:50.257040+0000","last_unstale":"2024-09-21T03:25:53.162035+0000","last_undegraded":"2024-09-21T03:25:53.162035+0000","last_fullsized":"2024-09-21T03:25:53.162035+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:29.305425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.163432+0000","last_change":"2024-09-21T03:25:51.246875+0000","last_active":"2024-09-21T03:25:53.163432+0000","last_peered":"2024-09-21T03:25:53.163432+0000","last_clean":"2024-09-21T03:25:53.163432+0000","last_became_active":"2024-09-21T03:25:51.246228+0000","last_became_peered":"2024-09-21T03:25:51.246228+0000","last_unstale":"2024-09-21T03:25:53.163432+0000","last_undegraded":"2024-09-21T03:25:53.163432+0000","last_fullsized":"2024-09-21T03:25:53.163432+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:00:03.939528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.334677+0000","last_change":"2024-09-21T03:25:50.259220+0000","last_active":"2024-09-21T03:25:52.334677+0000","last_peered":"2024-09-21T03:25:52.334677+0000","last_clean":"2024-09-21T03:25:52.334677+0000","last_became_active":"2024-09-21T03:25:50.258897+0000","last_became_peered":"2024-09-21T03:25:50.258897+0000","last_unstale":"2024-09-21T03:25:52.334677+0000","last_undegraded":"2024-09-21T03:25:52.334677+0000","last_fullsized":"2024-09-21T03:25:52.334677+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:22.679163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.162321+0000","last_change":"2024-09-21T03:25:51.263655+0000","last_active":"2024-09-21T03:25:53.162321+0000","last_peered":"2024-09-21T03:25:53.162321+0000","last_clean":"2024-09-21T03:25:53.162321+0000","last_became_active":"2024-09-21T03:25:51.263356+0000","last_became_peered":"2024-09-21T03:25:51.263356+0000","last_unstale":"2024-09-21T03:25:53.162321+0000","last_undegraded":"2024-09-21T03:25:53.162321+0000","last_fullsized":"2024-09-21T03:25:53.162321+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:07:06.578903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.161865+0000","last_change":"2024-09-21T03:25:50.256607+0000","last_active":"2024-09-21T03:25:53.161865+0000","last_peered":"2024-09-21T03:25:53.161865+0000","last_clean":"2024-09-21T03:25:53.161865+0000","last_became_active":"2024-09-21T03:25:50.256305+0000","last_became_peered":"2024-09-21T03:25:50.256305+0000","last_unstale":"2024-09-21T03:25:53.161865+0000","last_undegraded":"2024-09-21T03:25:53.161865+0000","last_fullsized":"2024-09-21T03:25:53.161865+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:06.404453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.241929+0000","last_change":"2024-09-21T03:25:51.266551+0000","last_active":"2024-09-21T03:25:52.241929+0000","last_peered":"2024-09-21T03:25:52.241929+0000","last_clean":"2024-09-21T03:25:52.241929+0000","last_became_active":"2024-09-21T03:25:51.266218+0000","last_became_peered":"2024-09-21T03:25:51.266218+0000","last_unstale":"2024-09-21T03:25:52.241929+0000","last_undegraded":"2024-09-21T03:25:52.241929+0000","last_fullsized":"2024-09-21T03:25:52.241929+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:35.806102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.162663+0000","last_change":"2024-09-21T03:25:50.254226+0000","last_active":"2024-09-21T03:25:53.162663+0000","last_peered":"2024-09-21T03:25:53.162663+0000","last_clean":"2024-09-21T03:25:53.162663+0000","last_became_active":"2024-09-21T03:25:50.253882+0000","last_became_peered":"2024-09-21T03:25:50.253882+0000","last_unstale":"2024-09-21T03:25:53.162663+0000","last_undegraded":"2024-09-21T03:25:53.162663+0000","last_fullsized":"2024-09-21T03:25:53.162663+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:51.796445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.239820+0000","last_change":"2024-09-21T03:25:51.264905+0000","last_active":"2024-09-21T03:25:52.239820+0000","last_peered":"2024-09-21T03:25:52.239820+0000","last_clean":"2024-09-21T03:25:52.239820+0000","last_became_active":"2024-09-21T03:25:51.262340+0000","last_became_peered":"2024-09-21T03:25:51.262340+0000","last_unstale":"2024-09-21T03:25:52.239820+0000","last_undegraded":"2024-09-21T03:25:52.239820+0000","last_fullsized":"2024-09-21T03:25:52.239820+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:48:53.273250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.239459+0000","last_change":"2024-09-21T03:25:50.252271+0000","last_active":"2024-09-21T03:25:52.239459+0000","last_peered":"2024-09-21T03:25:52.239459+0000","last_clean":"2024-09-21T03:25:52.239459+0000","last_became_active":"2024-09-21T03:25:50.251962+0000","last_became_peered":"2024-09-21T03:25:50.251962+0000","last_unstale":"2024-09-21T03:25:52.239459+0000","last_undegraded":"2024-09-21T03:25:52.239459+0000","last_fullsized":"2024-09-21T03:25:52.239459+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:41:51.711857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.161630+0000","last_change":"2024-09-21T03:25:51.266237+0000","last_active":"2024-09-21T03:25:53.161630+0000","last_peered":"2024-09-21T03:25:53.161630+0000","last_clean":"2024-09-21T03:25:53.161630+0000","last_became_active":"2024-09-21T03:25:51.265947+0000","last_became_peered":"2024-09-21T03:25:51.265947+0000","last_unstale":"2024-09-21T03:25:53.161630+0000","last_undegraded":"2024-09-21T03:25:53.161630+0000","last_fullsized":"2024-09-21T03:25:53.161630+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:22.526715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:52.334123+0000","last_change":"2024-09-21T03:25:50.252759+0000","last_active":"2024-09-21T03:25:52.334123+0000","last_peered":"2024-09-21T03:25:52.334123+0000","last_clean":"2024-09-21T03:25:52.334123+0000","last_became_active":"2024-09-21T03:25:50.252445+0000","last_became_peered":"2024-09-21T03:25:50.252445+0000","last_unstale":"2024-09-21T03:25:52.334123+0000","last_undegraded":"2024-09-21T03:25:52.334123+0000","last_fullsized":"2024-09-21T03:25:52.334123+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:10.447482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.162240+0000","last_change":"2024-09-21T03:25:51.268134+0000","last_active":"2024-09-21T03:25:53.162240+0000","last_peered":"2024-09-21T03:25:53.162240+0000","last_clean":"2024-09-21T03:25:53.162240+0000","last_became_active":"2024-09-21T03:25:51.267825+0000","last_became_peered":"2024-09-21T03:25:51.267825+0000","last_unstale":"2024-09-21T03:25:53.162240+0000","last_undegraded":"2024-09-21T03:25:53.162240+0000","last_fullsized":"2024-09-21T03:25:53.162240+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:50.229682+0000","last_clean_scrub_stamp":"2024-09-21T03:25:50.229682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:47.178687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"115'2","reported_seq":17,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.163194+0000","last_change":"2024-09-21T03:25:50.257816+0000","last_active":"2024-09-21T03:25:53.163194+0000","last_peered":"2024-09-21T03:25:53.163194+0000","last_clean":"2024-09-21T03:25:53.163194+0000","last_became_active":"2024-09-21T03:25:50.257162+0000","last_became_peered":"2024-09-21T03:25:50.257162+0000","last_unstale":"2024-09-21T03:25:53.163194+0000","last_undegraded":"2024-09-21T03:25:53.163194+0000","last_fullsized":"2024-09-21T03:25:53.163194+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:25:49.227905+0000","last_clean_scrub_stamp":"2024-09-21T03:25:49.227905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:21:35.409282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":286,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-21T03:25:53.161983+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:25:53.161983+0000","last_peered":"2024-09-21T03:25:53.161983+0000","last_clean":"2024-09-21T03:25:53.161983+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:25:53.161983+0000","last_undegraded":"2024-09-21T03:25:53.161983+0000","last_fullsized":"2024-09-21T03:25:53.161983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509536,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33200,"kb_used_data":2012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338640,"statfs":{"total":96636764160,"available":96602767360,"internally_reserved":0,"allocated":2060288,"data_stored":1207524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509535,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32612,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339228,"statfs":{"total":96636764160,"available":96603369472,"internally_reserved":0,"allocated":1454080,"data_stored":616518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509534,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1449984,"data_stored":615018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1445888,"data_stored":614976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509535,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1449984,"data_stored":615066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509535,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36756,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335084,"statfs":{"total":96636764160,"available":96599126016,"internally_reserved":0,"allocated":1437696,"data_stored":609222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509535,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36756,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335084,"statfs":{"total":96636764160,"available":96599126016,"internally_reserved":0,"allocated":1441792,"data_stored":614906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574943,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33180,"kb_used_data":1988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338660,"statfs":{"total":96636764160,"available":96602787840,"internally_reserved":0,"allocated":2035712,"data_stored":1205274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:25:59.050 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T03:25:59.050 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T03:25:59.207 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.205+0000 7f14469a8640 1 -- 172.21.15.105:0/1780266288 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14400ccb70 msgr2=0x7f1440156f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:59.207 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.205+0000 7f14469a8640 1 --2- 172.21.15.105:0/1780266288 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14400ccb70 0x7f1440156f10 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f1434005fd0 tx=0x7f143402a710 comp rx=0 tx=0).stop 2024-09-21T03:25:59.207 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.205+0000 7f14469a8640 1 -- 172.21.15.105:0/1780266288 shutdown_connections 2024-09-21T03:25:59.207 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.205+0000 7f14469a8640 1 --2- 172.21.15.105:0/1780266288 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14400ccb70 0x7f1440156f10 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:59.207 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.205+0000 7f14469a8640 1 -- 172.21.15.105:0/1780266288 >> 172.21.15.105:0/1780266288 conn(0x7f144006d4f0 msgr2=0x7f1440071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:59.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.205+0000 7f14469a8640 1 -- 172.21.15.105:0/1780266288 shutdown_connections 2024-09-21T03:25:59.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.205+0000 7f14469a8640 1 -- 172.21.15.105:0/1780266288 wait complete. 2024-09-21T03:25:59.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.207+0000 7f14469a8640 1 Processor -- start 2024-09-21T03:25:59.209 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.207+0000 7f14469a8640 1 -- start start 2024-09-21T03:25:59.211 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.208+0000 7f14469a8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14400ccb70 0x7f144014c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:59.211 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.208+0000 7f14469a8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14400cec50 0x7f14400b7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:59.211 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.208+0000 7f14469a8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1440161020 0x7f14400b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:59.211 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.208+0000 7f14469a8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f14400d0a60 con 0x7f1440161020 2024-09-21T03:25:59.212 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.208+0000 7f14469a8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f14400d08e0 con 0x7f14400cec50 2024-09-21T03:25:59.212 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.208+0000 7f14469a8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f14400d0be0 con 0x7f14400ccb70 2024-09-21T03:25:59.212 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.209+0000 7f1444f45640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1440161020 0x7f14400b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:59.212 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.209+0000 7f1444f45640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1440161020 0x7f14400b7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:37958/0 (socket says 172.21.15.105:37958) 2024-09-21T03:25:59.212 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.209+0000 7f1444f45640 1 -- 172.21.15.105:0/1296143581 learned_addr learned my addr 172.21.15.105:0/1296143581 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:59.212 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.209+0000 7f143f7fe640 1 --2- 172.21.15.105:0/1296143581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14400cec50 0x7f14400b7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:59.212 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.209+0000 7f143ffff640 1 --2- 172.21.15.105:0/1296143581 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14400ccb70 0x7f144014c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:59.212 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.209+0000 7f1444f45640 1 -- 172.21.15.105:0/1296143581 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14400ccb70 msgr2=0x7f144014c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:59.212 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.209+0000 7f1444f45640 1 --2- 172.21.15.105:0/1296143581 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14400ccb70 0x7f144014c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:59.212 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.209+0000 7f1444f45640 1 -- 172.21.15.105:0/1296143581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14400cec50 msgr2=0x7f14400b7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:59.212 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.209+0000 7f1444f45640 1 --2- 172.21.15.105:0/1296143581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14400cec50 0x7f14400b7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:59.212 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.209+0000 7f1444f45640 1 -- 172.21.15.105:0/1296143581 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14401f7080 con 0x7f1440161020 2024-09-21T03:25:59.212 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.209+0000 7f143ffff640 1 --2- 172.21.15.105:0/1296143581 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14400ccb70 0x7f144014c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:25:59.212 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.209+0000 7f1444f45640 1 --2- 172.21.15.105:0/1296143581 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1440161020 0x7f14400b7b60 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f143800c730 tx=0x7f143800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:59.213 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.209+0000 7f143cff9640 1 -- 172.21.15.105:0/1296143581 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1438003b70 con 0x7f1440161020 2024-09-21T03:25:59.213 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.209+0000 7f143cff9640 1 -- 172.21.15.105:0/1296143581 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1438003d10 con 0x7f1440161020 2024-09-21T03:25:59.213 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.209+0000 7f143cff9640 1 -- 172.21.15.105:0/1296143581 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143800aab0 con 0x7f1440161020 2024-09-21T03:25:59.213 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.209+0000 7f14469a8640 1 -- 172.21.15.105:0/1296143581 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14401f7360 con 0x7f1440161020 2024-09-21T03:25:59.213 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.209+0000 7f14469a8640 1 -- 172.21.15.105:0/1296143581 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14400ca2c0 con 0x7f1440161020 2024-09-21T03:25:59.214 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.210+0000 7f14469a8640 1 -- 172.21.15.105:0/1296143581 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1440155250 con 0x7f1440161020 2024-09-21T03:25:59.214 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.211+0000 7f143cff9640 1 -- 172.21.15.105:0/1296143581 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f143800ac50 con 0x7f1440161020 2024-09-21T03:25:59.214 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.211+0000 7f143cff9640 1 --2- 172.21.15.105:0/1296143581 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f142c078bc0 0x7f142c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:59.214 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.212+0000 7f143cff9640 1 -- 172.21.15.105:0/1296143581 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7f143809aa10 con 0x7f1440161020 2024-09-21T03:25:59.214 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.212+0000 7f143ffff640 1 --2- 172.21.15.105:0/1296143581 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f142c078bc0 0x7f142c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:59.214 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.212+0000 7f143ffff640 1 --2- 172.21.15.105:0/1296143581 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f142c078bc0 0x7f142c07b0d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1430000f60 tx=0x7f1430009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:59.217 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.216+0000 7f143cff9640 1 -- 172.21.15.105:0/1296143581 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1438062ee0 con 0x7f1440161020 2024-09-21T03:25:59.467 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.465+0000 7f14469a8640 1 -- 172.21.15.105:0/1296143581 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f1440156f10 con 0x7f1440161020 2024-09-21T03:25:59.471 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.470+0000 7f143cff9640 1 -- 172.21.15.105:0/1296143581 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) ==== 190+0+147 (secure 0 0 0) 0x7f14380627e0 con 0x7f1440161020 2024-09-21T03:25:59.471 INFO:teuthology.orchestra.run.smithi105.stdout:[client.0] 2024-09-21T03:25:59.472 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQDIOu5mughoJxAAhY0bzJmq+oNyzCdtafkC9w== 2024-09-21T03:25:59.472 INFO:teuthology.orchestra.run.smithi105.stdout: caps mds = "allow" 2024-09-21T03:25:59.472 INFO:teuthology.orchestra.run.smithi105.stdout: caps mon = "allow r" 2024-09-21T03:25:59.472 INFO:teuthology.orchestra.run.smithi105.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T03:25:59.472 INFO:teuthology.orchestra.run.smithi105.stderr:updated caps for client.0 2024-09-21T03:25:59.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.472+0000 7f14469a8640 1 -- 172.21.15.105:0/1296143581 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f142c078bc0 msgr2=0x7f142c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:59.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.472+0000 7f14469a8640 1 --2- 172.21.15.105:0/1296143581 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f142c078bc0 0x7f142c07b0d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1430000f60 tx=0x7f1430009040 comp rx=0 tx=0).stop 2024-09-21T03:25:59.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.472+0000 7f14469a8640 1 -- 172.21.15.105:0/1296143581 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1440161020 msgr2=0x7f14400b7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:59.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.472+0000 7f14469a8640 1 --2- 172.21.15.105:0/1296143581 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1440161020 0x7f14400b7b60 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f143800c730 tx=0x7f143800cbf0 comp rx=0 tx=0).stop 2024-09-21T03:25:59.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.472+0000 7f14469a8640 1 -- 172.21.15.105:0/1296143581 shutdown_connections 2024-09-21T03:25:59.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.472+0000 7f14469a8640 1 --2- 172.21.15.105:0/1296143581 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f142c078bc0 0x7f142c07b0d0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:59.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.472+0000 7f14469a8640 1 --2- 172.21.15.105:0/1296143581 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1440161020 0x7f14400b7b60 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:59.475 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.472+0000 7f14469a8640 1 --2- 172.21.15.105:0/1296143581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14400cec50 0x7f14400b7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:59.475 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.472+0000 7f14469a8640 1 --2- 172.21.15.105:0/1296143581 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14400ccb70 0x7f144014c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:59.475 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.472+0000 7f14469a8640 1 -- 172.21.15.105:0/1296143581 >> 172.21.15.105:0/1296143581 conn(0x7f144006d4f0 msgr2=0x7f144015eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:59.475 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.472+0000 7f14469a8640 1 -- 172.21.15.105:0/1296143581 shutdown_connections 2024-09-21T03:25:59.475 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.472+0000 7f14469a8640 1 -- 172.21.15.105:0/1296143581 wait complete. 2024-09-21T03:25:59.485 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:25:59.597 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.595+0000 7fb901700640 1 -- 172.21.15.105:0/1901714930 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8fc0d2ed0 msgr2=0x7fb8fc0d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:59.597 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.595+0000 7fb901700640 1 --2- 172.21.15.105:0/1901714930 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8fc0d2ed0 0x7fb8fc0d1a80 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc0d32e0 tx=0x7fb8ec02a5f0 comp rx=0 tx=0).stop 2024-09-21T03:25:59.597 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.595+0000 7fb901700640 1 -- 172.21.15.105:0/1901714930 shutdown_connections 2024-09-21T03:25:59.597 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.595+0000 7fb901700640 1 --2- 172.21.15.105:0/1901714930 >> v2:172.21.15.162:3300/0 conn(0x7fb8fc0cf7a0 0x7fb8fc1626e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:59.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.595+0000 7fb901700640 1 --2- 172.21.15.105:0/1901714930 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8fc0d2ed0 0x7fb8fc0d1a80 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:59.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.595+0000 7fb901700640 1 -- 172.21.15.105:0/1901714930 >> 172.21.15.105:0/1901714930 conn(0x7fb8fc08bfc0 msgr2=0x7fb8fc09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:59.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.595+0000 7fb901700640 1 -- 172.21.15.105:0/1901714930 shutdown_connections 2024-09-21T03:25:59.598 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.595+0000 7fb901700640 1 -- 172.21.15.105:0/1901714930 wait complete. 2024-09-21T03:25:59.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.597+0000 7fb901700640 1 Processor -- start 2024-09-21T03:25:59.599 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.597+0000 7fb901700640 1 -- start start 2024-09-21T03:25:59.601 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.599+0000 7fb901700640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8fc0b9b70 0x7fb8fc0c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:59.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.599+0000 7fb901700640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8fc0cf7a0 0x7fb8fc151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:59.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.599+0000 7fb901700640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8fc0d2ed0 0x7fb8fc160a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:59.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.599+0000 7fb901700640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb8fc162c20 con 0x7fb8fc0cf7a0 2024-09-21T03:25:59.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.599+0000 7fb901700640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb8fc0cfea0 con 0x7fb8fc0d2ed0 2024-09-21T03:25:59.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.599+0000 7fb901700640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb8fc162da0 con 0x7fb8fc0b9b70 2024-09-21T03:25:59.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.599+0000 7fb8fa7fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8fc0cf7a0 0x7fb8fc151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:59.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.599+0000 7fb8fa7fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8fc0cf7a0 0x7fb8fc151cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:37976/0 (socket says 172.21.15.105:37976) 2024-09-21T03:25:59.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.599+0000 7fb8fa7fc640 1 -- 172.21.15.105:0/1872870167 learned_addr learned my addr 172.21.15.105:0/1872870167 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:25:59.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.599+0000 7fb8faffd640 1 --2- 172.21.15.105:0/1872870167 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8fc0b9b70 0x7fb8fc0c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:59.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.599+0000 7fb8fb7fe640 1 --2- 172.21.15.105:0/1872870167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8fc0d2ed0 0x7fb8fc160a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:59.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.599+0000 7fb8fa7fc640 1 -- 172.21.15.105:0/1872870167 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8fc0b9b70 msgr2=0x7fb8fc0c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:59.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.599+0000 7fb8fa7fc640 1 --2- 172.21.15.105:0/1872870167 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8fc0b9b70 0x7fb8fc0c8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:59.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.599+0000 7fb8fa7fc640 1 -- 172.21.15.105:0/1872870167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8fc0d2ed0 msgr2=0x7fb8fc160a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:59.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.599+0000 7fb8fa7fc640 1 --2- 172.21.15.105:0/1872870167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8fc0d2ed0 0x7fb8fc160a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:59.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.599+0000 7fb8fa7fc640 1 -- 172.21.15.105:0/1872870167 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8fc0caeb0 con 0x7fb8fc0cf7a0 2024-09-21T03:25:59.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.599+0000 7fb8fa7fc640 1 --2- 172.21.15.105:0/1872870167 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8fc0cf7a0 0x7fb8fc151cb0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fb8f000c3f0 tx=0x7fb8f000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:59.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.599+0000 7fb8e37fe640 1 -- 172.21.15.105:0/1872870167 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f0017070 con 0x7fb8fc0cf7a0 2024-09-21T03:25:59.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.599+0000 7fb8e37fe640 1 -- 172.21.15.105:0/1872870167 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb8f00035f0 con 0x7fb8fc0cf7a0 2024-09-21T03:25:59.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.599+0000 7fb8e37fe640 1 -- 172.21.15.105:0/1872870167 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f0003a40 con 0x7fb8fc0cf7a0 2024-09-21T03:25:59.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.599+0000 7fb901700640 1 -- 172.21.15.105:0/1872870167 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8fc1e9940 con 0x7fb8fc0cf7a0 2024-09-21T03:25:59.603 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.600+0000 7fb901700640 1 -- 172.21.15.105:0/1872870167 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8fc0c9120 con 0x7fb8fc0cf7a0 2024-09-21T03:25:59.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.600+0000 7fb901700640 1 -- 172.21.15.105:0/1872870167 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8fc1e9e60 con 0x7fb8fc0cf7a0 2024-09-21T03:25:59.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.601+0000 7fb8e37fe640 1 -- 172.21.15.105:0/1872870167 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb8f001a070 con 0x7fb8fc0cf7a0 2024-09-21T03:25:59.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.602+0000 7fb8e37fe640 1 --2- 172.21.15.105:0/1872870167 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb8e8078bc0 0x7fb8e807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:59.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.602+0000 7fb8e37fe640 1 -- 172.21.15.105:0/1872870167 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7fb8f009a090 con 0x7fb8fc0cf7a0 2024-09-21T03:25:59.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.602+0000 7fb8faffd640 1 --2- 172.21.15.105:0/1872870167 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb8e8078bc0 0x7fb8e807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:59.604 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.602+0000 7fb8faffd640 1 --2- 172.21.15.105:0/1872870167 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb8e8078bc0 0x7fb8e807b0d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec034000 tx=0x7fb8ec004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:59.607 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.606+0000 7fb8e37fe640 1 -- 172.21.15.105:0/1872870167 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb8fc1e9e60 con 0x7fb8fc0cf7a0 2024-09-21T03:25:59.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.818+0000 7fb901700640 1 -- 172.21.15.105:0/1872870167 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb8fc1632c0 con 0x7fb8fc0cf7a0 2024-09-21T03:25:59.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.819+0000 7fb8e37fe640 1 -- 172.21.15.105:0/1872870167 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) ==== 94+0+5237 (secure 0 0 0) 0x7fb8f00624d0 con 0x7fb8fc0cf7a0 2024-09-21T03:25:59.820 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:25:59.820 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":73,"btime":"2024-09-21T03:25:53:258473+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6233,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/2073653576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2073653576},{"type":"v1","addr":"172.21.15.162:6837","nonce":2073653576}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":70},{"gid":6850,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2714893724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2714893724},{"type":"v1","addr":"172.21.15.162:6836","nonce":2714893724}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":70},{"gid":7590,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/2972986125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2972986125},{"type":"v1","addr":"172.21.15.105:6834","nonce":2972986125}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":70}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:25:50.598171+0000","modified":"2024-09-21T03:25:52.613928+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7593":{"gid":7593,"name":"a","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/3941149960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":3941149960},{"type":"v1","addr":"172.21.15.105:6835","nonce":3941149960}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7593,"qdb_cluster":[7593]},"id":9}]} 2024-09-21T03:25:59.821 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 73 2024-09-21T03:25:59.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.821+0000 7fb901700640 1 -- 172.21.15.105:0/1872870167 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb8e8078bc0 msgr2=0x7fb8e807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:59.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.821+0000 7fb901700640 1 --2- 172.21.15.105:0/1872870167 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb8e8078bc0 0x7fb8e807b0d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec034000 tx=0x7fb8ec004730 comp rx=0 tx=0).stop 2024-09-21T03:25:59.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.821+0000 7fb901700640 1 -- 172.21.15.105:0/1872870167 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8fc0cf7a0 msgr2=0x7fb8fc151cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:59.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.821+0000 7fb901700640 1 --2- 172.21.15.105:0/1872870167 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8fc0cf7a0 0x7fb8fc151cb0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fb8f000c3f0 tx=0x7fb8f000c8b0 comp rx=0 tx=0).stop 2024-09-21T03:25:59.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.821+0000 7fb901700640 1 -- 172.21.15.105:0/1872870167 shutdown_connections 2024-09-21T03:25:59.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.821+0000 7fb901700640 1 --2- 172.21.15.105:0/1872870167 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb8e8078bc0 0x7fb8e807b0d0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:59.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.821+0000 7fb901700640 1 --2- 172.21.15.105:0/1872870167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8fc0d2ed0 0x7fb8fc160a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:59.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.821+0000 7fb901700640 1 --2- 172.21.15.105:0/1872870167 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8fc0cf7a0 0x7fb8fc151cb0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:59.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.821+0000 7fb901700640 1 --2- 172.21.15.105:0/1872870167 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8fc0b9b70 0x7fb8fc0c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:59.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.821+0000 7fb901700640 1 -- 172.21.15.105:0/1872870167 >> 172.21.15.105:0/1872870167 conn(0x7fb8fc08bfc0 msgr2=0x7fb8fc06dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:59.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.821+0000 7fb901700640 1 -- 172.21.15.105:0/1872870167 shutdown_connections 2024-09-21T03:25:59.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:25:59.821+0000 7fb901700640 1 -- 172.21.15.105:0/1872870167 wait complete. 2024-09-21T03:26:00.236 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 73, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T03:25:50.598171+0000', 'modified': '2024-09-21T03:25:52.613928+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7593}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7593': {'gid': 7593, 'name': 'a', 'rank': 0, 'incarnation': 71, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.105:6835/3941149960', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6833', 'nonce': 3941149960}, {'type': 'v1', 'addr': '172.21.15.105:6835', 'nonce': 3941149960}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7593, 'qdb_cluster': [7593]} 2024-09-21T03:26:00.236 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T03:26:00.236 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-21T03:26:00.359 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.357+0000 7f2db8f4a640 1 -- 172.21.15.105:0/2147370863 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d9c003a00 msgr2=0x7f2d9c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:00.359 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.357+0000 7f2db8f4a640 1 --2- 172.21.15.105:0/2147370863 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d9c003a00 0x7f2d9c003e30 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f2da400c560 tx=0x7f2d9c005830 comp rx=0 tx=0).stop 2024-09-21T03:26:00.359 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.357+0000 7f2db8f4a640 1 -- 172.21.15.105:0/2147370863 shutdown_connections 2024-09-21T03:26:00.359 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.357+0000 7f2db8f4a640 1 --2- 172.21.15.105:0/2147370863 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d9c003a00 0x7f2d9c003e30 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:00.359 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.357+0000 7f2db8f4a640 1 -- 172.21.15.105:0/2147370863 >> 172.21.15.105:0/2147370863 conn(0x7f2db40b3f10 msgr2=0x7f2db40b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:00.359 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.357+0000 7f2db8f4a640 1 -- 172.21.15.105:0/2147370863 shutdown_connections 2024-09-21T03:26:00.359 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.357+0000 7f2db8f4a640 1 -- 172.21.15.105:0/2147370863 wait complete. 2024-09-21T03:26:00.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.359+0000 7f2db8f4a640 1 Processor -- start 2024-09-21T03:26:00.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.359+0000 7f2db8f4a640 1 -- start start 2024-09-21T03:26:00.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.360+0000 7f2db8f4a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2d9c003a00 0x7f2db40c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:00.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.360+0000 7f2db8f4a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2db41f3af0 0x7f2db4146220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:00.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.360+0000 7f2db8f4a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2db41441d0 0x7f2db41445e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:00.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.360+0000 7f2db8f4a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2db40cd340 con 0x7f2db41f3af0 2024-09-21T03:26:00.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.360+0000 7f2db8f4a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2db40cd1c0 con 0x7f2db41441d0 2024-09-21T03:26:00.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.360+0000 7f2db8f4a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2db40cd4c0 con 0x7f2d9c003a00 2024-09-21T03:26:00.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.360+0000 7f2db1d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2db41f3af0 0x7f2db4146220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:00.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.360+0000 7f2db1d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2db41f3af0 0x7f2db4146220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:37982/0 (socket says 172.21.15.105:37982) 2024-09-21T03:26:00.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.360+0000 7f2db1d9b640 1 -- 172.21.15.105:0/2643266864 learned_addr learned my addr 172.21.15.105:0/2643266864 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:00.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.360+0000 7f2db2d9d640 1 --2- 172.21.15.105:0/2643266864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2db41441d0 0x7f2db41445e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:00.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.360+0000 7f2db259c640 1 --2- 172.21.15.105:0/2643266864 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2d9c003a00 0x7f2db40c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:00.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.360+0000 7f2db1d9b640 1 -- 172.21.15.105:0/2643266864 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2d9c003a00 msgr2=0x7f2db40c8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:00.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.360+0000 7f2db1d9b640 1 --2- 172.21.15.105:0/2643266864 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2d9c003a00 0x7f2db40c8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:00.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.360+0000 7f2db1d9b640 1 -- 172.21.15.105:0/2643266864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2db41441d0 msgr2=0x7f2db41445e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:00.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.360+0000 7f2db1d9b640 1 --2- 172.21.15.105:0/2643266864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2db41441d0 0x7f2db41445e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:00.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.360+0000 7f2db1d9b640 1 -- 172.21.15.105:0/2643266864 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2db41f3070 con 0x7f2db41f3af0 2024-09-21T03:26:00.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.361+0000 7f2db1d9b640 1 --2- 172.21.15.105:0/2643266864 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2db41f3af0 0x7f2db4146220 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f2da8011b10 tx=0x7f2da8009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:00.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.361+0000 7f2da2ffd640 1 -- 172.21.15.105:0/2643266864 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da800fc80 con 0x7f2db41f3af0 2024-09-21T03:26:00.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.361+0000 7f2da2ffd640 1 -- 172.21.15.105:0/2643266864 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2da800fe20 con 0x7f2db41f3af0 2024-09-21T03:26:00.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.361+0000 7f2da2ffd640 1 -- 172.21.15.105:0/2643266864 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da8004280 con 0x7f2db41f3af0 2024-09-21T03:26:00.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.361+0000 7f2db8f4a640 1 -- 172.21.15.105:0/2643266864 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2db4146d20 con 0x7f2db41f3af0 2024-09-21T03:26:00.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.361+0000 7f2db8f4a640 1 -- 172.21.15.105:0/2643266864 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2db41f32f0 con 0x7f2db41f3af0 2024-09-21T03:26:00.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.362+0000 7f2da2ffd640 1 -- 172.21.15.105:0/2643266864 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2da80035f0 con 0x7f2db41f3af0 2024-09-21T03:26:00.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.363+0000 7f2da2ffd640 1 --2- 172.21.15.105:0/2643266864 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2d94078b90 0x7f2d9407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:00.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.363+0000 7f2da2ffd640 1 -- 172.21.15.105:0/2643266864 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7f2da809b6a0 con 0x7f2db41f3af0 2024-09-21T03:26:00.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.363+0000 7f2db259c640 1 --2- 172.21.15.105:0/2643266864 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2d94078b90 0x7f2d9407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:00.365 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.364+0000 7f2db259c640 1 --2- 172.21.15.105:0/2643266864 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2d94078b90 0x7f2d9407b0a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2da4033000 tx=0x7f2da402d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:00.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.364+0000 7f2dbfeb4740 1 Processor -- start 2024-09-21T03:26:00.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.364+0000 7f2dbfeb4740 1 -- start start 2024-09-21T03:26:00.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.365+0000 7f2dbfeb4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5ef747270 0x55e5efb18fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:00.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.365+0000 7f2dbfeb4740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e5ef71e3b0 0x55e5efb194e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:00.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.365+0000 7f2dbfeb4740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e5ef726590 0x55e5efb363e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:00.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.365+0000 7f2dbfeb4740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55e5efa61820 con 0x55e5ef726590 2024-09-21T03:26:00.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.365+0000 7f2dbfeb4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e5efa50c50 con 0x55e5ef747270 2024-09-21T03:26:00.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.365+0000 7f2dbfeb4740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55e5efa54a60 con 0x55e5ef71e3b0 2024-09-21T03:26:00.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.365+0000 7f2db2d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e5ef726590 0x55e5efb363e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:00.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.365+0000 7f2db2d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e5ef726590 0x55e5efb363e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:37990/0 (socket says 172.21.15.105:37990) 2024-09-21T03:26:00.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.365+0000 7f2db2d9d640 1 -- 172.21.15.105:0/466255273 learned_addr learned my addr 172.21.15.105:0/466255273 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:00.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.366+0000 7f2db259c640 1 --2- 172.21.15.105:0/466255273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5ef747270 0x55e5efb18fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:00.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.366+0000 7f2db1d9b640 1 --2- 172.21.15.105:0/466255273 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e5ef71e3b0 0x55e5efb194e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:00.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.366+0000 7f2db2d9d640 1 -- 172.21.15.105:0/466255273 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e5ef71e3b0 msgr2=0x55e5efb194e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:26:00.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.366+0000 7f2db2d9d640 1 --2- 172.21.15.105:0/466255273 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e5ef71e3b0 0x55e5efb194e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:00.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.366+0000 7f2db2d9d640 1 -- 172.21.15.105:0/466255273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5ef747270 msgr2=0x55e5efb18fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:26:00.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.366+0000 7f2db2d9d640 1 --2- 172.21.15.105:0/466255273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5ef747270 0x55e5efb18fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:00.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.366+0000 7f2db2d9d640 1 -- 172.21.15.105:0/466255273 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5ef7b2850 con 0x55e5ef726590 2024-09-21T03:26:00.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.366+0000 7f2db2d9d640 1 --2- 172.21.15.105:0/466255273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e5ef726590 0x55e5efb363e0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f2db40c9370 tx=0x7f2dac0049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4377c22548f8597f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:00.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.366+0000 7f2d93fff640 1 -- 172.21.15.105:0/466255273 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dac001560 con 0x55e5ef726590 2024-09-21T03:26:00.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.366+0000 7f2d93fff640 1 -- 172.21.15.105:0/466255273 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2dac016070 con 0x55e5ef726590 2024-09-21T03:26:00.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.366+0000 7f2d93fff640 1 -- 172.21.15.105:0/466255273 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dac001a90 con 0x55e5ef726590 2024-09-21T03:26:00.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.367+0000 7f2dbfeb4740 1 -- 172.21.15.105:0/466255273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e5ef726590 msgr2=0x55e5efb363e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:00.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.367+0000 7f2dbfeb4740 1 --2- 172.21.15.105:0/466255273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e5ef726590 0x55e5efb363e0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f2db40c9370 tx=0x7f2dac0049d0 comp rx=0 tx=0).stop 2024-09-21T03:26:00.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.367+0000 7f2dbfeb4740 1 -- 172.21.15.105:0/466255273 shutdown_connections 2024-09-21T03:26:00.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.367+0000 7f2dbfeb4740 1 --2- 172.21.15.105:0/466255273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e5ef726590 0x55e5efb363e0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:00.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.367+0000 7f2dbfeb4740 1 --2- 172.21.15.105:0/466255273 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e5ef71e3b0 0x55e5efb194e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:00.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.367+0000 7f2dbfeb4740 1 --2- 172.21.15.105:0/466255273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5ef747270 0x55e5efb18fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:00.371 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.367+0000 7f2dbfeb4740 1 -- 172.21.15.105:0/466255273 >> 172.21.15.105:0/466255273 conn(0x55e5ef73b3c0 msgr2=0x55e5efaef260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:00.371 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.367+0000 7f2dbfeb4740 1 -- 172.21.15.105:0/466255273 shutdown_connections 2024-09-21T03:26:00.371 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.367+0000 7f2dbfeb4740 1 -- 172.21.15.105:0/466255273 wait complete. 2024-09-21T03:26:00.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.368+0000 7f2dbfeb4740 1 -- start start 2024-09-21T03:26:00.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.368+0000 7f2dbfeb4740 1 Processor -- start 2024-09-21T03:26:00.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.369+0000 7f2dbfeb4740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e5ef71e3b0 0x55e5efaf8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:00.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.369+0000 7f2dbfeb4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5ef726590 0x55e5efaed680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:00.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.369+0000 7f2dbfeb4740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e5ef747270 0x55e5efae82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:00.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.369+0000 7f2dbfeb4740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55e5ef7c1620 con 0x55e5ef747270 2024-09-21T03:26:00.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.370+0000 7f2dbfeb4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e5ef9f65f0 con 0x55e5ef726590 2024-09-21T03:26:00.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.370+0000 7f2dbfeb4740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55e5efb2c700 con 0x55e5ef71e3b0 2024-09-21T03:26:00.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.370+0000 7f2dbfeb4740 10 client.0 _ll_register_callbacks cb 0x55e5ef9fa0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:26:00.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.370+0000 7f2db2d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e5ef747270 0x55e5efae82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:00.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.370+0000 7f2db2d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e5ef747270 0x55e5efae82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:37994/0 (socket says 172.21.15.105:37994) 2024-09-21T03:26:00.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.370+0000 7f2db2d9d640 1 -- 172.21.15.105:0/481562387 learned_addr learned my addr 172.21.15.105:0/481562387 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:00.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.370+0000 7f2db259c640 1 --2- 172.21.15.105:0/481562387 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e5ef71e3b0 0x55e5efaf8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:00.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.370+0000 7f2db1d9b640 1 --2- 172.21.15.105:0/481562387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5ef726590 0x55e5efaed680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:00.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.370+0000 7f2db2d9d640 1 -- 172.21.15.105:0/481562387 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e5ef71e3b0 msgr2=0x55e5efaf8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:26:00.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.370+0000 7f2db2d9d640 1 --2- 172.21.15.105:0/481562387 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e5ef71e3b0 0x55e5efaf8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:00.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.370+0000 7f2db2d9d640 1 -- 172.21.15.105:0/481562387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5ef726590 msgr2=0x55e5efaed680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:26:00.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.370+0000 7f2db2d9d640 1 --2- 172.21.15.105:0/481562387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5ef726590 0x55e5efaed680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:00.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.370+0000 7f2db2d9d640 1 -- 172.21.15.105:0/481562387 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5ef8296b0 con 0x55e5ef747270 2024-09-21T03:26:00.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.370+0000 7f2db2d9d640 1 --2- 172.21.15.105:0/481562387 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e5ef747270 0x55e5efae82a0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f2db40ce3e0 tx=0x7f2dac001590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1094b3de63072c7a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:00.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.370+0000 7f2d917fa640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-21T03:26:00.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.370+0000 7f2d917fa640 1 -- 172.21.15.105:0/481562387 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dac02a060 con 0x55e5ef747270 2024-09-21T03:26:00.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.370+0000 7f2d917fa640 1 -- 172.21.15.105:0/481562387 <== mon.0 v2:172.21.15.105:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7f2dac001cc0 con 0x55e5ef747270 2024-09-21T03:26:00.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.370+0000 7f2dbfeb4740 1 -- 172.21.15.105:0/481562387 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2dac016070 con 0x55e5ef747270 2024-09-21T03:26:00.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.370+0000 7f2d917fa640 1 -- 172.21.15.105:0/481562387 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7f2dac030050 con 0x55e5ef747270 2024-09-21T03:26:00.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.370+0000 7f2dbfeb4740 10 client.7761 fetch_fsmap learned FSMap version 73 2024-09-21T03:26:00.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.370+0000 7f2dbfeb4740 1 -- 172.21.15.105:0/481562387 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) -- 0x55e5efaedbc0 con 0x55e5ef747270 2024-09-21T03:26:00.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.371+0000 7f2d917fa640 1 -- 172.21.15.105:0/481562387 <== mon.0 v2:172.21.15.105:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2dac016070 con 0x55e5ef747270 2024-09-21T03:26:00.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.371+0000 7f2d917fa640 1 -- 172.21.15.105:0/481562387 <== mon.0 v2:172.21.15.105:3300/0 5 ==== fsmap(e 73) ==== 3502+0+0 (secure 0 0 0) 0x7f2dac033020 con 0x55e5ef747270 2024-09-21T03:26:00.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.371+0000 7f2dbfeb4740 10 client.7761 fetch_fsmap finished waiting for FSMap version 73 2024-09-21T03:26:00.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.371+0000 7f2dbfeb4740 10 client.7761 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T03:26:00.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.371+0000 7f2dbfeb4740 20 client.7761 populate_metadata read hostname 'smithi105' 2024-09-21T03:26:00.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.371+0000 7f2dbfeb4740 1 --2- 172.21.15.105:0/481562387 >> [v2:172.21.15.105:6833/3941149960,v1:172.21.15.105:6835/3941149960] conn(0x55e5ef705e40 0x55e5efb2b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:00.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.371+0000 7f2dbfeb4740 4 client.7761 mds_command: new command op to 7593 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:26:00.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.371+0000 7f2dbfeb4740 1 -- 172.21.15.105:0/481562387 --> [v2:172.21.15.105:6833/3941149960,v1:172.21.15.105:6835/3941149960] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e5efa63770 con 0x55e5ef705e40 2024-09-21T03:26:00.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.371+0000 7f2db259c640 1 --2- 172.21.15.105:0/481562387 >> [v2:172.21.15.105:6833/3941149960,v1:172.21.15.105:6835/3941149960] conn(0x55e5ef705e40 0x55e5efb2b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:00.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.371+0000 7f2d917fa640 10 client.7761 ms_handle_connect on v2:172.21.15.105:6833/3941149960 2024-09-21T03:26:00.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.371+0000 7f2db259c640 1 --2- 172.21.15.105:0/481562387 >> [v2:172.21.15.105:6833/3941149960,v1:172.21.15.105:6835/3941149960] conn(0x55e5ef705e40 0x55e5efb2b500 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c314ed771993e1fe server_cookie=30152d1bbc34d111 in_seq=0 out_seq=0 2024-09-21T03:26:00.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.372+0000 7f2d917fa640 1 -- 172.21.15.105:0/481562387 <== mds.0 v2:172.21.15.105:6833/3941149960 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e5efa63770 con 0x55e5ef705e40 2024-09-21T03:26:00.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.372+0000 7f2d917fa640 10 client.7761 handle_command_reply: tid=0 2024-09-21T03:26:00.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.372+0000 7f2dbfeb4740 1 client.7761 shutdown 2024-09-21T03:26:00.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.372+0000 7f2dbfeb4740 1 -- 172.21.15.105:0/481562387 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e5ef747270 msgr2=0x55e5efae82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:00.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.372+0000 7f2dbfeb4740 1 --2- 172.21.15.105:0/481562387 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e5ef747270 0x55e5efae82a0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f2db40ce3e0 tx=0x7f2dac001590 comp rx=0 tx=0).stop 2024-09-21T03:26:00.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.372+0000 7f2dbfeb4740 1 -- 172.21.15.105:0/481562387 shutdown_connections 2024-09-21T03:26:00.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.372+0000 7f2dbfeb4740 1 --2- 172.21.15.105:0/481562387 >> [v2:172.21.15.105:6833/3941149960,v1:172.21.15.105:6835/3941149960] conn(0x55e5ef705e40 0x55e5efb2b500 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:00.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.372+0000 7f2dbfeb4740 1 --2- 172.21.15.105:0/481562387 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e5ef747270 0x55e5efae82a0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:00.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.372+0000 7f2dbfeb4740 1 --2- 172.21.15.105:0/481562387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5ef726590 0x55e5efaed680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:00.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.372+0000 7f2dbfeb4740 1 --2- 172.21.15.105:0/481562387 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e5ef71e3b0 0x55e5efaf8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:00.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.372+0000 7f2d917fa640 0 client.7761 ms_handle_reset on v2:172.21.15.105:6833/3941149960 2024-09-21T03:26:00.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.372+0000 7f2dbfeb4740 1 -- 172.21.15.105:0/481562387 >> 172.21.15.105:0/481562387 conn(0x55e5ef73b3c0 msgr2=0x55e5efae9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:00.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.372+0000 7f2dbfeb4740 1 -- 172.21.15.105:0/481562387 shutdown_connections 2024-09-21T03:26:00.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.372+0000 7f2dbfeb4740 1 -- 172.21.15.105:0/481562387 wait complete. 2024-09-21T03:26:00.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.373+0000 7f2dbfeb4740 20 client.7761 trim_cache size 0 max 16384 2024-09-21T03:26:00.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.391+0000 7f2dbfeb4740 1 Processor -- start 2024-09-21T03:26:00.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.391+0000 7f2dbfeb4740 1 -- start start 2024-09-21T03:26:00.395 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.392+0000 7f2dbfeb4740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e5ef71e3b0 0x55e5efb56780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:00.395 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.392+0000 7f2dbfeb4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5ef726590 0x55e5efaeceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:00.396 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.392+0000 7f2dbfeb4740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e5ef747270 0x55e5efb075d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:00.396 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.392+0000 7f2dbfeb4740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2db41ff180 con 0x55e5ef71e3b0 2024-09-21T03:26:00.396 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.392+0000 7f2dbfeb4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2db41552f0 con 0x55e5ef726590 2024-09-21T03:26:00.396 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.392+0000 7f2dbfeb4740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2db41feb60 con 0x55e5ef747270 2024-09-21T03:26:00.396 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.392+0000 7f2db259c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e5ef71e3b0 0x55e5efb56780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:00.396 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.392+0000 7f2db259c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e5ef71e3b0 0x55e5efb56780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:38004/0 (socket says 172.21.15.105:38004) 2024-09-21T03:26:00.396 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.392+0000 7f2db259c640 1 -- 172.21.15.105:0/16470707 learned_addr learned my addr 172.21.15.105:0/16470707 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:00.396 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.392+0000 7f2db2d9d640 1 --2- 172.21.15.105:0/16470707 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e5ef747270 0x55e5efb075d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:00.396 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.392+0000 7f2db259c640 1 -- 172.21.15.105:0/16470707 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e5ef747270 msgr2=0x55e5efb075d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:26:00.396 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.392+0000 7f2db259c640 1 --2- 172.21.15.105:0/16470707 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e5ef747270 0x55e5efb075d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:00.396 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.392+0000 7f2db1d9b640 1 --2- 172.21.15.105:0/16470707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5ef726590 0x55e5efaeceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:00.396 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.392+0000 7f2db259c640 1 -- 172.21.15.105:0/16470707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5ef726590 msgr2=0x55e5efaeceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:26:00.396 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.392+0000 7f2db259c640 1 --2- 172.21.15.105:0/16470707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5ef726590 0x55e5efaeceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:00.397 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.392+0000 7f2db259c640 1 -- 172.21.15.105:0/16470707 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5efb46570 con 0x55e5ef71e3b0 2024-09-21T03:26:00.397 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.392+0000 7f2db2d9d640 1 --2- 172.21.15.105:0/16470707 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e5ef747270 0x55e5efb075d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:26:00.397 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.392+0000 7f2db1d9b640 1 --2- 172.21.15.105:0/16470707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5ef726590 0x55e5efaeceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:26:00.397 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.393+0000 7f2db259c640 1 --2- 172.21.15.105:0/16470707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e5ef71e3b0 0x55e5efb56780 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f2da400c680 tx=0x7f2d9c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4634273c7b289b99 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:00.397 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.393+0000 7f2d937fe640 1 -- 172.21.15.105:0/16470707 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da4006050 con 0x55e5ef71e3b0 2024-09-21T03:26:00.397 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.393+0000 7f2d937fe640 1 -- 172.21.15.105:0/16470707 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2da40061f0 con 0x55e5ef71e3b0 2024-09-21T03:26:00.397 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.393+0000 7f2d937fe640 1 -- 172.21.15.105:0/16470707 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da4006600 con 0x55e5ef71e3b0 2024-09-21T03:26:00.397 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.394+0000 7f2dbfeb4740 1 -- 172.21.15.105:0/16470707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e5ef71e3b0 msgr2=0x55e5efb56780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:00.397 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.394+0000 7f2dbfeb4740 1 --2- 172.21.15.105:0/16470707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e5ef71e3b0 0x55e5efb56780 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f2da400c680 tx=0x7f2d9c005830 comp rx=0 tx=0).stop 2024-09-21T03:26:00.397 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.394+0000 7f2dbfeb4740 1 -- 172.21.15.105:0/16470707 shutdown_connections 2024-09-21T03:26:00.397 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.394+0000 7f2dbfeb4740 1 --2- 172.21.15.105:0/16470707 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e5ef747270 0x55e5efb075d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:00.397 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.394+0000 7f2dbfeb4740 1 --2- 172.21.15.105:0/16470707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5ef726590 0x55e5efaeceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:00.397 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.394+0000 7f2dbfeb4740 1 --2- 172.21.15.105:0/16470707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e5ef71e3b0 0x55e5efb56780 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:00.397 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.394+0000 7f2dbfeb4740 1 -- 172.21.15.105:0/16470707 >> 172.21.15.105:0/16470707 conn(0x55e5ef73b3c0 msgr2=0x55e5efae4a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:00.398 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.394+0000 7f2dbfeb4740 1 -- 172.21.15.105:0/16470707 shutdown_connections 2024-09-21T03:26:00.398 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.394+0000 7f2dbfeb4740 1 -- 172.21.15.105:0/16470707 wait complete. 2024-09-21T03:26:00.402 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.395+0000 7f2dbfeb4740 1 -- start start 2024-09-21T03:26:00.402 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.395+0000 7f2dbfeb4740 1 Processor -- start 2024-09-21T03:26:00.402 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.396+0000 7f2dbfeb4740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e5ef71e3b0 0x55e5efba0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:00.402 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.396+0000 7f2dbfeb4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5ef726590 0x55e5efbba6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:00.402 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.396+0000 7f2dbfeb4740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e5ef747270 0x55e5efbbac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:00.402 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.396+0000 7f2dbfeb4740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55e5efb461c0 con 0x55e5ef747270 2024-09-21T03:26:00.402 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.396+0000 7f2dbfeb4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e5efb2c440 con 0x55e5ef726590 2024-09-21T03:26:00.402 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.396+0000 7f2dbfeb4740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55e5efb46750 con 0x55e5ef71e3b0 2024-09-21T03:26:00.402 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.396+0000 7f2dbfeb4740 10 client.0 _ll_register_callbacks cb 0x7f2d9c004700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:26:00.402 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.396+0000 7f2db2d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e5ef747270 0x55e5efbbac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:00.402 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.396+0000 7f2db2d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e5ef747270 0x55e5efbbac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:38018/0 (socket says 172.21.15.105:38018) 2024-09-21T03:26:00.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.396+0000 7f2db2d9d640 1 -- 172.21.15.105:0/769452722 learned_addr learned my addr 172.21.15.105:0/769452722 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:00.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.397+0000 7f2db259c640 1 --2- 172.21.15.105:0/769452722 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e5ef71e3b0 0x55e5efba0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:00.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.397+0000 7f2db1d9b640 1 --2- 172.21.15.105:0/769452722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5ef726590 0x55e5efbba6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:00.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.397+0000 7f2db2d9d640 1 -- 172.21.15.105:0/769452722 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e5ef71e3b0 msgr2=0x55e5efba0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:26:00.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.397+0000 7f2db2d9d640 1 --2- 172.21.15.105:0/769452722 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e5ef71e3b0 0x55e5efba0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:00.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.397+0000 7f2db2d9d640 1 -- 172.21.15.105:0/769452722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5ef726590 msgr2=0x55e5efbba6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:26:00.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.397+0000 7f2db2d9d640 1 --2- 172.21.15.105:0/769452722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5ef726590 0x55e5efbba6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:00.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.397+0000 7f2db2d9d640 1 -- 172.21.15.105:0/769452722 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5efb41c30 con 0x55e5ef747270 2024-09-21T03:26:00.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.397+0000 7f2db259c640 1 --2- 172.21.15.105:0/769452722 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e5ef71e3b0 0x55e5efba0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:26:00.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.397+0000 7f2db1d9b640 1 --2- 172.21.15.105:0/769452722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5ef726590 0x55e5efbba6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:26:00.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.397+0000 7f2db2d9d640 1 --2- 172.21.15.105:0/769452722 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e5ef747270 0x55e5efbbac00 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f2dac001d70 tx=0x7f2dac001da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f433d6d91df0f25a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:00.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.397+0000 7f2d917fa640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-21T03:26:00.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.397+0000 7f2d917fa640 1 -- 172.21.15.105:0/769452722 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dac039060 con 0x55e5ef747270 2024-09-21T03:26:00.403 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.397+0000 7f2d917fa640 1 -- 172.21.15.105:0/769452722 <== mon.0 v2:172.21.15.105:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7f2dac01bc40 con 0x55e5ef747270 2024-09-21T03:26:00.404 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.397+0000 7f2dbfeb4740 1 -- 172.21.15.105:0/769452722 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2da40061f0 con 0x55e5ef747270 2024-09-21T03:26:00.404 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.397+0000 7f2d917fa640 1 -- 172.21.15.105:0/769452722 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7f2dac01be40 con 0x55e5ef747270 2024-09-21T03:26:00.404 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.397+0000 7f2dbfeb4740 10 client.7767 fetch_fsmap learned FSMap version 73 2024-09-21T03:26:00.404 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.397+0000 7f2dbfeb4740 1 -- 172.21.15.105:0/769452722 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) -- 0x55e5efbbb200 con 0x55e5ef747270 2024-09-21T03:26:00.404 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.397+0000 7f2d917fa640 1 -- 172.21.15.105:0/769452722 <== mon.0 v2:172.21.15.105:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2da40061f0 con 0x55e5ef747270 2024-09-21T03:26:00.404 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.397+0000 7f2d917fa640 1 -- 172.21.15.105:0/769452722 <== mon.0 v2:172.21.15.105:3300/0 5 ==== fsmap(e 73) ==== 3502+0+0 (secure 0 0 0) 0x7f2dac033070 con 0x55e5ef747270 2024-09-21T03:26:00.404 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.397+0000 7f2dbfeb4740 10 client.7767 fetch_fsmap finished waiting for FSMap version 73 2024-09-21T03:26:00.404 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.397+0000 7f2dbfeb4740 10 client.7767 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T03:26:00.404 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.397+0000 7f2dbfeb4740 20 client.7767 populate_metadata read hostname 'smithi105' 2024-09-21T03:26:00.404 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.397+0000 7f2dbfeb4740 1 --2- 172.21.15.105:0/769452722 >> [v2:172.21.15.105:6833/3941149960,v1:172.21.15.105:6835/3941149960] conn(0x55e5efaef490 0x55e5efb072e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:00.404 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.397+0000 7f2dbfeb4740 4 client.7767 mds_command: new command op to 7593 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T03:26:00.404 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.397+0000 7f2dbfeb4740 1 -- 172.21.15.105:0/769452722 --> [v2:172.21.15.105:6833/3941149960,v1:172.21.15.105:6835/3941149960] -- command(tid 0: {"prefix": "status"}) -- 0x55e5efa5f220 con 0x55e5efaef490 2024-09-21T03:26:00.404 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.398+0000 7f2db259c640 1 --2- 172.21.15.105:0/769452722 >> [v2:172.21.15.105:6833/3941149960,v1:172.21.15.105:6835/3941149960] conn(0x55e5efaef490 0x55e5efb072e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:00.404 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.398+0000 7f2d917fa640 10 client.7767 ms_handle_connect on v2:172.21.15.105:6833/3941149960 2024-09-21T03:26:00.405 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.398+0000 7f2db259c640 1 --2- 172.21.15.105:0/769452722 >> [v2:172.21.15.105:6833/3941149960,v1:172.21.15.105:6835/3941149960] conn(0x55e5efaef490 0x55e5efb072e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff4c9cbf805f25dd server_cookie=4ff6c42fe3ba9e7f in_seq=0 out_seq=0 2024-09-21T03:26:00.405 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.398+0000 7f2d917fa640 1 -- 172.21.15.105:0/769452722 <== mds.0 v2:172.21.15.105:6833/3941149960 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x55e5efa5f220 con 0x55e5efaef490 2024-09-21T03:26:00.405 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.398+0000 7f2d917fa640 10 client.7767 handle_command_reply: tid=0 2024-09-21T03:26:00.405 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.398+0000 7f2dbfeb4740 1 client.7767 shutdown 2024-09-21T03:26:00.405 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.398+0000 7f2dbfeb4740 1 -- 172.21.15.105:0/769452722 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e5ef747270 msgr2=0x55e5efbbac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:00.405 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.398+0000 7f2dbfeb4740 1 --2- 172.21.15.105:0/769452722 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e5ef747270 0x55e5efbbac00 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f2dac001d70 tx=0x7f2dac001da0 comp rx=0 tx=0).stop 2024-09-21T03:26:00.405 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.398+0000 7f2dbfeb4740 1 -- 172.21.15.105:0/769452722 shutdown_connections 2024-09-21T03:26:00.405 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.398+0000 7f2dbfeb4740 1 --2- 172.21.15.105:0/769452722 >> [v2:172.21.15.105:6833/3941149960,v1:172.21.15.105:6835/3941149960] conn(0x55e5efaef490 0x55e5efb072e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:00.405 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.398+0000 7f2dbfeb4740 1 --2- 172.21.15.105:0/769452722 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e5ef747270 0x55e5efbbac00 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:00.405 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.398+0000 7f2d917fa640 0 client.7767 ms_handle_reset on v2:172.21.15.105:6833/3941149960 2024-09-21T03:26:00.405 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.398+0000 7f2dbfeb4740 1 --2- 172.21.15.105:0/769452722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e5ef726590 0x55e5efbba6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:00.405 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.398+0000 7f2dbfeb4740 1 --2- 172.21.15.105:0/769452722 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55e5ef71e3b0 0x55e5efba0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:00.405 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.398+0000 7f2dbfeb4740 1 -- 172.21.15.105:0/769452722 >> 172.21.15.105:0/769452722 conn(0x55e5ef73b3c0 msgr2=0x55e5efae4a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:00.406 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.399+0000 7f2dbfeb4740 1 -- 172.21.15.105:0/769452722 shutdown_connections 2024-09-21T03:26:00.406 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.399+0000 7f2dbfeb4740 1 -- 172.21.15.105:0/769452722 wait complete. 2024-09-21T03:26:00.406 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.399+0000 7f2dbfeb4740 20 client.7767 trim_cache size 0 max 16384 2024-09-21T03:26:00.406 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-21T03:26:00.406 INFO:teuthology.orchestra.run.smithi105.stdout: "cluster_fsid": "29d80f4f-e5de-4b26-8384-24c2d8019945", 2024-09-21T03:26:00.406 INFO:teuthology.orchestra.run.smithi105.stdout: "whoami": 0, 2024-09-21T03:26:00.406 INFO:teuthology.orchestra.run.smithi105.stdout: "id": 7593, 2024-09-21T03:26:00.406 INFO:teuthology.orchestra.run.smithi105.stdout: "want_state": "up:active", 2024-09-21T03:26:00.406 INFO:teuthology.orchestra.run.smithi105.stdout: "state": "up:active", 2024-09-21T03:26:00.407 INFO:teuthology.orchestra.run.smithi105.stdout: "fs_name": "cephfs", 2024-09-21T03:26:00.407 INFO:teuthology.orchestra.run.smithi105.stdout: "rank_uptime": 9.1626163120000008, 2024-09-21T03:26:00.407 INFO:teuthology.orchestra.run.smithi105.stdout: "mdsmap_epoch": 73, 2024-09-21T03:26:00.407 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_epoch": 116, 2024-09-21T03:26:00.407 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_epoch_barrier": 116, 2024-09-21T03:26:00.407 INFO:teuthology.orchestra.run.smithi105.stdout: "uptime": 14.487024995000001 2024-09-21T03:26:00.407 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-21T03:26:00.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.399+0000 7f2db8f4a640 1 -- 172.21.15.105:0/2643266864 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2d94078b90 msgr2=0x7f2d9407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:00.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.399+0000 7f2db8f4a640 1 --2- 172.21.15.105:0/2643266864 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2d94078b90 0x7f2d9407b0a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2da4033000 tx=0x7f2da402d040 comp rx=0 tx=0).stop 2024-09-21T03:26:00.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.399+0000 7f2db8f4a640 1 -- 172.21.15.105:0/2643266864 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2db41f3af0 msgr2=0x7f2db4146220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:00.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.399+0000 7f2db8f4a640 1 --2- 172.21.15.105:0/2643266864 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2db41f3af0 0x7f2db4146220 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f2da8011b10 tx=0x7f2da8009f10 comp rx=0 tx=0).stop 2024-09-21T03:26:00.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.399+0000 7f2db8f4a640 1 -- 172.21.15.105:0/2643266864 shutdown_connections 2024-09-21T03:26:00.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.399+0000 7f2db8f4a640 1 --2- 172.21.15.105:0/2643266864 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2d94078b90 0x7f2d9407b0a0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:00.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.399+0000 7f2db8f4a640 1 --2- 172.21.15.105:0/2643266864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2db41441d0 0x7f2db41445e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:00.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.399+0000 7f2db8f4a640 1 --2- 172.21.15.105:0/2643266864 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2db41f3af0 0x7f2db4146220 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:00.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.399+0000 7f2db8f4a640 1 --2- 172.21.15.105:0/2643266864 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2d9c003a00 0x7f2db40c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:00.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.399+0000 7f2db8f4a640 1 -- 172.21.15.105:0/2643266864 >> 172.21.15.105:0/2643266864 conn(0x7f2db40b3f10 msgr2=0x7f2db40b6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:00.409 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.399+0000 7f2db8f4a640 1 -- 172.21.15.105:0/2643266864 shutdown_connections 2024-09-21T03:26:00.409 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.399+0000 7f2db8f4a640 1 -- 172.21.15.105:0/2643266864 wait complete. 2024-09-21T03:26:00.412 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T03:26:00.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.523+0000 7f23b4a84640 1 -- 172.21.15.105:0/2183784201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23b00b3710 msgr2=0x7f23b006e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:00.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.523+0000 7f23b4a84640 1 --2- 172.21.15.105:0/2183784201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23b00b3710 0x7f23b006e7f0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f23a8009830 tx=0x7f23a802a510 comp rx=0 tx=0).stop 2024-09-21T03:26:00.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.523+0000 7f23b4a84640 1 -- 172.21.15.105:0/2183784201 shutdown_connections 2024-09-21T03:26:00.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.523+0000 7f23b4a84640 1 --2- 172.21.15.105:0/2183784201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23b00b3710 0x7f23b006e7f0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:00.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.523+0000 7f23b4a84640 1 -- 172.21.15.105:0/2183784201 >> 172.21.15.105:0/2183784201 conn(0x7f23b009d7f0 msgr2=0x7f23b00d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:00.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.523+0000 7f23b4a84640 1 -- 172.21.15.105:0/2183784201 shutdown_connections 2024-09-21T03:26:00.526 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.523+0000 7f23b4a84640 1 -- 172.21.15.105:0/2183784201 wait complete. 2024-09-21T03:26:00.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.525+0000 7f23b4a84640 1 Processor -- start 2024-09-21T03:26:00.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.525+0000 7f23b4a84640 1 -- start start 2024-09-21T03:26:00.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.526+0000 7f23b4a84640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23b00b3710 0x7f23b015b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:00.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.526+0000 7f23b4a84640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23b00b9970 0x7f23b00cda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:00.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.526+0000 7f23b4a84640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23b015b9b0 0x7f23b00cdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:00.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.526+0000 7f23b4a84640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f23b006ed30 con 0x7f23b00b3710 2024-09-21T03:26:00.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.526+0000 7f23b4a84640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f23b00d5010 con 0x7f23b015b9b0 2024-09-21T03:26:00.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.526+0000 7f23b4a84640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f23b006eeb0 con 0x7f23b00b9970 2024-09-21T03:26:00.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.527+0000 7f23ae59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23b00b3710 0x7f23b015b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:00.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.527+0000 7f23ae59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23b00b3710 0x7f23b015b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:38046/0 (socket says 172.21.15.105:38046) 2024-09-21T03:26:00.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.527+0000 7f23ae59c640 1 -- 172.21.15.105:0/2625414071 learned_addr learned my addr 172.21.15.105:0/2625414071 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:00.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.527+0000 7f23aed9d640 1 --2- 172.21.15.105:0/2625414071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23b015b9b0 0x7f23b00cdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:00.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.527+0000 7f23add9b640 1 --2- 172.21.15.105:0/2625414071 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23b00b9970 0x7f23b00cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:00.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.527+0000 7f23ae59c640 1 -- 172.21.15.105:0/2625414071 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23b00b9970 msgr2=0x7f23b00cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:00.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.527+0000 7f23ae59c640 1 --2- 172.21.15.105:0/2625414071 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23b00b9970 0x7f23b00cda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:00.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.527+0000 7f23ae59c640 1 -- 172.21.15.105:0/2625414071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23b015b9b0 msgr2=0x7f23b00cdfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:00.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.527+0000 7f23ae59c640 1 --2- 172.21.15.105:0/2625414071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23b015b9b0 0x7f23b00cdfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:00.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.527+0000 7f23ae59c640 1 -- 172.21.15.105:0/2625414071 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23b015b7b0 con 0x7f23b00b3710 2024-09-21T03:26:00.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.527+0000 7f23aed9d640 1 --2- 172.21.15.105:0/2625414071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23b015b9b0 0x7f23b00cdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:26:00.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.527+0000 7f23add9b640 1 --2- 172.21.15.105:0/2625414071 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23b00b9970 0x7f23b00cda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:26:00.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.527+0000 7f23ae59c640 1 --2- 172.21.15.105:0/2625414071 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23b00b3710 0x7f23b015b270 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f23a000ba50 tx=0x7f23a000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:00.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.527+0000 7f239effd640 1 -- 172.21.15.105:0/2625414071 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a0019070 con 0x7f23b00b3710 2024-09-21T03:26:00.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.527+0000 7f239effd640 1 -- 172.21.15.105:0/2625414071 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23a000cd10 con 0x7f23b00b3710 2024-09-21T03:26:00.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.527+0000 7f23b4a84640 1 -- 172.21.15.105:0/2625414071 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23b01f99e0 con 0x7f23b00b3710 2024-09-21T03:26:00.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.527+0000 7f239effd640 1 -- 172.21.15.105:0/2625414071 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a00146a0 con 0x7f23b00b3710 2024-09-21T03:26:00.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.527+0000 7f23b4a84640 1 -- 172.21.15.105:0/2625414071 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23b00c84d0 con 0x7f23b00b3710 2024-09-21T03:26:00.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.528+0000 7f23b4a84640 1 -- 172.21.15.105:0/2625414071 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23b01f68f0 con 0x7f23b00b3710 2024-09-21T03:26:00.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.529+0000 7f239effd640 1 -- 172.21.15.105:0/2625414071 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f23a001c070 con 0x7f23b00b3710 2024-09-21T03:26:00.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.530+0000 7f239effd640 1 --2- 172.21.15.105:0/2625414071 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2390078b90 0x7f239007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:00.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.530+0000 7f239effd640 1 -- 172.21.15.105:0/2625414071 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7f23a009a960 con 0x7f23b00b3710 2024-09-21T03:26:00.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.530+0000 7f23add9b640 1 --2- 172.21.15.105:0/2625414071 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2390078b90 0x7f239007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:00.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.530+0000 7f23add9b640 1 --2- 172.21.15.105:0/2625414071 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2390078b90 0x7f239007b0a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f23b00c7dc0 tx=0x7f23a4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:00.535 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.534+0000 7f239effd640 1 -- 172.21.15.105:0/2625414071 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f23b015b7b0 con 0x7f23b00b3710 2024-09-21T03:26:00.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.752+0000 7f23b4a84640 1 -- 172.21.15.105:0/2625414071 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f23b00a24d0 con 0x7f23b00b3710 2024-09-21T03:26:00.755 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.753+0000 7f239effd640 1 -- 172.21.15.105:0/2625414071 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v73) ==== 53+0+73 (secure 0 0 0) 0x7f23a00627e0 con 0x7f23b00b3710 2024-09-21T03:26:00.755 INFO:teuthology.orchestra.run.smithi105.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T03:26:00.757 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.755+0000 7f23b4a84640 1 -- 172.21.15.105:0/2625414071 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2390078b90 msgr2=0x7f239007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:00.757 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.755+0000 7f23b4a84640 1 --2- 172.21.15.105:0/2625414071 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2390078b90 0x7f239007b0a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f23b00c7dc0 tx=0x7f23a4009040 comp rx=0 tx=0).stop 2024-09-21T03:26:00.757 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.755+0000 7f23b4a84640 1 -- 172.21.15.105:0/2625414071 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23b00b3710 msgr2=0x7f23b015b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:00.757 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.755+0000 7f23b4a84640 1 --2- 172.21.15.105:0/2625414071 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23b00b3710 0x7f23b015b270 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f23a000ba50 tx=0x7f23a000bf10 comp rx=0 tx=0).stop 2024-09-21T03:26:00.757 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.755+0000 7f23b4a84640 1 -- 172.21.15.105:0/2625414071 shutdown_connections 2024-09-21T03:26:00.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.755+0000 7f23b4a84640 1 --2- 172.21.15.105:0/2625414071 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2390078b90 0x7f239007b0a0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:00.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.755+0000 7f23b4a84640 1 --2- 172.21.15.105:0/2625414071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23b015b9b0 0x7f23b00cdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:00.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.755+0000 7f23b4a84640 1 --2- 172.21.15.105:0/2625414071 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23b00b9970 0x7f23b00cda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:00.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.755+0000 7f23b4a84640 1 --2- 172.21.15.105:0/2625414071 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23b00b3710 0x7f23b015b270 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:00.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.755+0000 7f23b4a84640 1 -- 172.21.15.105:0/2625414071 >> 172.21.15.105:0/2625414071 conn(0x7f23b009d7f0 msgr2=0x7f23b00b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:00.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.755+0000 7f23b4a84640 1 -- 172.21.15.105:0/2625414071 shutdown_connections 2024-09-21T03:26:00.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00.755+0000 7f23b4a84640 1 -- 172.21.15.105:0/2625414071 wait complete. 2024-09-21T03:26:00.768 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T03:26:00.768 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T03:26:00.768 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi105.front.sepia.ceph.com 2024-09-21T03:26:00.769 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T03:26:00.769 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T03:26:00.769 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T03:26:00.769 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T03:26:00.769 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T03:26:00.769 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:26:00.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:26:00.769 DEBUG:teuthology.orchestra.run.smithi105:> ip addr 2024-09-21T03:26:00.785 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T03:26:00.785 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T03:26:00.785 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T03:26:00.785 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:26:00.785 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2024-09-21T03:26:00.785 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:26:00.785 INFO:teuthology.orchestra.run.smithi105.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:26:00.785 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b8 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:26:00.785 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f0 2024-09-21T03:26:00.785 INFO:teuthology.orchestra.run.smithi105.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:26:00.786 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b9 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:26:00.786 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f1 2024-09-21T03:26:00.786 INFO:teuthology.orchestra.run.smithi105.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:26:00.786 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:28 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:26:00.786 INFO:teuthology.orchestra.run.smithi105.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T03:26:00.786 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:29 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:26:00.786 INFO:teuthology.orchestra.run.smithi105.stdout: inet 172.21.15.105/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T03:26:00.786 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft 42347sec preferred_lft 42347sec 2024-09-21T03:26:00.786 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::ec4:7aff:fe8f:d429/64 scope link noprefixroute 2024-09-21T03:26:00.786 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:26:00.786 INFO:teuthology.orchestra.run.smithi105.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T03:26:00.786 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 86:15:ed:f2:4e:d8 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:26:00.786 INFO:teuthology.orchestra.run.smithi105.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T03:26:00.786 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:26:00.787 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::80db:6aff:fece:44c2/64 scope link 2024-09-21T03:26:00.787 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:26:00.787 INFO:teuthology.orchestra.run.smithi105.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:26:00.787 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 86:15:ed:f2:4e:d8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T03:26:00.787 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::8415:edff:fef2:4ed8/64 scope link 2024-09-21T03:26:00.787 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:26:00.787 INFO:teuthology.orchestra.run.smithi105.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:26:00.787 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether a2:e9:7c:d4:c7:c7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T03:26:00.787 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::a0e9:7cff:fed4:c7c7/64 scope link 2024-09-21T03:26:00.787 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:26:00.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:26:00.788 DEBUG:teuthology.orchestra.run.smithi105:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T03:26:00.848 INFO:teuthology.orchestra.run.smithi105.stdout:1 2024-09-21T03:26:00.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:26:00.850 DEBUG:teuthology.orchestra.run.smithi105:> route 2024-09-21T03:26:00.906 INFO:teuthology.orchestra.run.smithi105.stdout:Kernel IP routing table 2024-09-21T03:26:00.906 INFO:teuthology.orchestra.run.smithi105.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T03:26:00.906 INFO:teuthology.orchestra.run.smithi105.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T03:26:00.906 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T03:26:00.906 INFO:teuthology.orchestra.run.smithi105.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T03:26:00.907 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:26:00.907 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-21T03:26:00.907 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T03:26:00.907 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T03:26:00.907 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T03:26:00.907 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-21T03:26:00.994 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:26:01.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:26:01.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:26:01.032 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-09-21T03:26:01.047 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T03:26:01.047 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T03:26:01.047 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:26:01.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:26:01.047 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set brx.0 up 2024-09-21T03:26:01.113 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:26:01.113 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T03:26:01.168 INFO:teuthology.orchestra.run.smithi105.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:26:01.169 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:26:01.169 DEBUG:teuthology.orchestra.run.smithi105:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T03:26:01.223 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-21T03:26:01.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:26:01.223 DEBUG:teuthology.orchestra.run.smithi105:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:26:01.317 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:26:01.317 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T03:26:01.317 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2024-09-21T03:26:01.328 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:26:01.328 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T03:26:01.328 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2024-09-21T03:26:01.328 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:26:01.328 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:26:01.334 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:26:01.334 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T03:26:01.334 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2024-09-21T03:26:01.335 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:26:01.335 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:26:01.335 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-21T03:26:01.335 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-21T03:26:01.335 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=29d80f4f-e5de-4b26-8384-24c2d8019945" will pass to kernel 2024-09-21T03:26:01.335 INFO:teuthology.orchestra.run.smithi105.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T03:26:01.335 INFO:teuthology.orchestra.run.smithi105.stdout: You just mounted a file system that supports labels which does not 2024-09-21T03:26:01.335 INFO:teuthology.orchestra.run.smithi105.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T03:26:01.335 INFO:teuthology.orchestra.run.smithi105.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T03:26:01.335 INFO:teuthology.orchestra.run.smithi105.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T03:26:01.337 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T03:26:01.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:26:01.337 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T03:26:01.367 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:26:01.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:26:01.462 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:26:01.469 INFO:teuthology.orchestra.run.smithi105.stdout:client6341 2024-09-21T03:26:01.469 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:26:01.469 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:26:01.485 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T03:26:01.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.635+0000 7fa6d7db0640 1 -- 172.21.15.105:0/4271289966 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6d00b7cc0 msgr2=0x7fa6d00d0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:01.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.635+0000 7fa6d7db0640 1 --2- 172.21.15.105:0/4271289966 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6d00b7cc0 0x7fa6d00d0980 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fa6d00ce1b0 tx=0x7fa6c802aac0 comp rx=0 tx=0).stop 2024-09-21T03:26:01.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.635+0000 7fa6d7db0640 1 -- 172.21.15.105:0/4271289966 shutdown_connections 2024-09-21T03:26:01.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.635+0000 7fa6d7db0640 1 --2- 172.21.15.105:0/4271289966 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6d00b7cc0 0x7fa6d00d0980 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:01.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.635+0000 7fa6d7db0640 1 --2- 172.21.15.105:0/4271289966 >> v2:172.21.15.162:3300/0 conn(0x7fa6d00cf320 0x7fa6d00ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:01.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.635+0000 7fa6d7db0640 1 -- 172.21.15.105:0/4271289966 >> 172.21.15.105:0/4271289966 conn(0x7fa6d006d4f0 msgr2=0x7fa6d0071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:01.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.635+0000 7fa6d7db0640 1 -- 172.21.15.105:0/4271289966 shutdown_connections 2024-09-21T03:26:01.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.635+0000 7fa6d7db0640 1 -- 172.21.15.105:0/4271289966 wait complete. 2024-09-21T03:26:01.639 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.637+0000 7fa6d7db0640 1 Processor -- start 2024-09-21T03:26:01.639 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.637+0000 7fa6d7db0640 1 -- start start 2024-09-21T03:26:01.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.638+0000 7fa6d7db0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6d00b7cc0 0x7fa6d014c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:01.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.638+0000 7fa6d7db0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6d00cf320 0x7fa6d014ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:01.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.638+0000 7fa6d7db0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6d01600b0 0x7fa6d00cb550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:01.642 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.638+0000 7fa6d7db0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d00d13c0 con 0x7fa6d00cf320 2024-09-21T03:26:01.642 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.638+0000 7fa6d7db0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d00d1240 con 0x7fa6d00b7cc0 2024-09-21T03:26:01.642 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.638+0000 7fa6d7db0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa6d00d1540 con 0x7fa6d01600b0 2024-09-21T03:26:01.642 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.638+0000 7fa6d534b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6d00cf320 0x7fa6d014ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:01.642 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.639+0000 7fa6d534b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6d00cf320 0x7fa6d014ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:39000/0 (socket says 172.21.15.105:39000) 2024-09-21T03:26:01.642 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.639+0000 7fa6d534b640 1 -- 172.21.15.105:0/3513678343 learned_addr learned my addr 172.21.15.105:0/3513678343 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:01.642 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.639+0000 7fa6d5b4c640 1 --2- 172.21.15.105:0/3513678343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6d00b7cc0 0x7fa6d014c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:01.642 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.639+0000 7fa6d634d640 1 --2- 172.21.15.105:0/3513678343 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6d01600b0 0x7fa6d00cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:01.642 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.639+0000 7fa6d534b640 1 -- 172.21.15.105:0/3513678343 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6d01600b0 msgr2=0x7fa6d00cb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:01.642 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.639+0000 7fa6d534b640 1 --2- 172.21.15.105:0/3513678343 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6d01600b0 0x7fa6d00cb550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:01.642 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.639+0000 7fa6d534b640 1 -- 172.21.15.105:0/3513678343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6d00b7cc0 msgr2=0x7fa6d014c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:01.642 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.639+0000 7fa6d534b640 1 --2- 172.21.15.105:0/3513678343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6d00b7cc0 0x7fa6d014c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:01.643 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.639+0000 7fa6d534b640 1 -- 172.21.15.105:0/3513678343 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d00aa4b0 con 0x7fa6d00cf320 2024-09-21T03:26:01.643 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.639+0000 7fa6d5b4c640 1 --2- 172.21.15.105:0/3513678343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6d00b7cc0 0x7fa6d014c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:26:01.643 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.639+0000 7fa6d534b640 1 --2- 172.21.15.105:0/3513678343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6d00cf320 0x7fa6d014ec20 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fa6c000b410 tx=0x7fa6c000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:01.643 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.639+0000 7fa6c67fc640 1 -- 172.21.15.105:0/3513678343 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c0015020 con 0x7fa6d00cf320 2024-09-21T03:26:01.643 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.639+0000 7fa6c67fc640 1 -- 172.21.15.105:0/3513678343 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa6c0011940 con 0x7fa6d00cf320 2024-09-21T03:26:01.643 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.639+0000 7fa6d7db0640 1 -- 172.21.15.105:0/3513678343 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6d014c540 con 0x7fa6d00cf320 2024-09-21T03:26:01.643 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.639+0000 7fa6c67fc640 1 -- 172.21.15.105:0/3513678343 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c0011d90 con 0x7fa6d00cf320 2024-09-21T03:26:01.643 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.639+0000 7fa6d7db0640 1 -- 172.21.15.105:0/3513678343 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6d00a99d0 con 0x7fa6d00cf320 2024-09-21T03:26:01.643 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.640+0000 7fa6d7db0640 1 -- 172.21.15.105:0/3513678343 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6d014f700 con 0x7fa6d00cf320 2024-09-21T03:26:01.644 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.641+0000 7fa6c67fc640 1 -- 172.21.15.105:0/3513678343 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa6c0018020 con 0x7fa6d00cf320 2024-09-21T03:26:01.644 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.641+0000 7fa6c67fc640 1 --2- 172.21.15.105:0/3513678343 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa6b4078b90 0x7fa6b407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:01.644 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.641+0000 7fa6c67fc640 1 -- 172.21.15.105:0/3513678343 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7fa6c009ace0 con 0x7fa6d00cf320 2024-09-21T03:26:01.644 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.642+0000 7fa6d5b4c640 1 --2- 172.21.15.105:0/3513678343 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa6b4078b90 0x7fa6b407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:01.644 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.642+0000 7fa6d5b4c640 1 --2- 172.21.15.105:0/3513678343 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa6b4078b90 0x7fa6b407b0a0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc0016a0 tx=0x7fa6cc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:01.647 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.646+0000 7fa6c67fc640 1 -- 172.21.15.105:0/3513678343 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa6c001f020 con 0x7fa6d00cf320 2024-09-21T03:26:01.860 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.858+0000 7fa6d7db0640 1 -- 172.21.15.105:0/3513678343 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa6d00d1ad0 con 0x7fa6d00cf320 2024-09-21T03:26:01.860 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.859+0000 7fa6c67fc640 1 -- 172.21.15.105:0/3513678343 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v73) ==== 53+0+73 (secure 0 0 0) 0x7fa6c0063120 con 0x7fa6d00cf320 2024-09-21T03:26:01.861 INFO:teuthology.orchestra.run.smithi105.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T03:26:01.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.861+0000 7fa6d7db0640 1 -- 172.21.15.105:0/3513678343 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa6b4078b90 msgr2=0x7fa6b407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:01.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.861+0000 7fa6d7db0640 1 --2- 172.21.15.105:0/3513678343 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa6b4078b90 0x7fa6b407b0a0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc0016a0 tx=0x7fa6cc009040 comp rx=0 tx=0).stop 2024-09-21T03:26:01.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.861+0000 7fa6d7db0640 1 -- 172.21.15.105:0/3513678343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6d00cf320 msgr2=0x7fa6d014ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:01.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.861+0000 7fa6d7db0640 1 --2- 172.21.15.105:0/3513678343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6d00cf320 0x7fa6d014ec20 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fa6c000b410 tx=0x7fa6c000b8d0 comp rx=0 tx=0).stop 2024-09-21T03:26:01.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.861+0000 7fa6d7db0640 1 -- 172.21.15.105:0/3513678343 shutdown_connections 2024-09-21T03:26:01.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.861+0000 7fa6d7db0640 1 --2- 172.21.15.105:0/3513678343 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa6b4078b90 0x7fa6b407b0a0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:01.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.861+0000 7fa6d7db0640 1 --2- 172.21.15.105:0/3513678343 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6d01600b0 0x7fa6d00cb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:01.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.861+0000 7fa6d7db0640 1 --2- 172.21.15.105:0/3513678343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6d00cf320 0x7fa6d014ec20 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:01.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.861+0000 7fa6d7db0640 1 --2- 172.21.15.105:0/3513678343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6d00b7cc0 0x7fa6d014c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:01.864 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.861+0000 7fa6d7db0640 1 -- 172.21.15.105:0/3513678343 >> 172.21.15.105:0/3513678343 conn(0x7fa6d006d4f0 msgr2=0x7fa6d00b58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:01.864 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.861+0000 7fa6d7db0640 1 -- 172.21.15.105:0/3513678343 shutdown_connections 2024-09-21T03:26:01.864 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:01.861+0000 7fa6d7db0640 1 -- 172.21.15.105:0/3513678343 wait complete. 2024-09-21T03:26:01.874 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T03:26:01.874 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T03:26:01.874 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2024-09-21T03:26:01.874 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-21T03:26:01.874 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T03:26:01.874 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T03:26:01.874 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T03:26:01.874 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T03:26:01.874 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T03:26:01.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:26:01.875 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2024-09-21T03:26:01.895 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T03:26:01.895 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T03:26:01.895 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T03:26:01.895 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:26:01.895 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-09-21T03:26:01.895 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:26:01.895 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:26:01.895 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:26:01.895 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f0 2024-09-21T03:26:01.895 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:26:01.896 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:26:01.896 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f1 2024-09-21T03:26:01.896 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:26:01.896 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:26:01.896 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T03:26:01.896 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:26:01.896 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T03:26:01.896 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42338sec preferred_lft 42338sec 2024-09-21T03:26:01.896 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::ec4:7aff:fe88:7f41/64 scope link noprefixroute 2024-09-21T03:26:01.896 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:26:01.896 INFO:teuthology.orchestra.run.smithi162.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T03:26:01.896 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 32:ad:10:1b:86:54 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:26:01.896 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T03:26:01.896 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:26:01.897 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::c03a:6bff:febf:f5a9/64 scope link 2024-09-21T03:26:01.897 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:26:01.897 INFO:teuthology.orchestra.run.smithi162.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:26:01.897 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 32:ad:10:1b:86:54 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T03:26:01.897 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::30ad:10ff:fe1b:8654/64 scope link 2024-09-21T03:26:01.897 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:26:01.897 INFO:teuthology.orchestra.run.smithi162.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:26:01.897 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 6a:62:2d:53:ae:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-21T03:26:01.897 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::6862:2dff:fe53:aec0/64 scope link 2024-09-21T03:26:01.897 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:26:01.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:26:01.898 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T03:26:01.964 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-09-21T03:26:01.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:26:01.966 DEBUG:teuthology.orchestra.run.smithi162:> route 2024-09-21T03:26:02.025 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2024-09-21T03:26:02.025 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T03:26:02.025 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T03:26:02.025 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T03:26:02.025 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T03:26:02.025 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:26:02.025 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-09-21T03:26:02.025 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T03:26:02.026 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T03:26:02.026 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T03:26:02.026 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-09-21T03:26:02.118 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:26:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:26:02.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:26:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:26:02.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:26:02.159 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-09-21T03:26:02.174 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-21T03:26:02.174 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-21T03:26:02.175 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T03:26:02.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:26:02.175 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.0 up 2024-09-21T03:26:02.240 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:26:02.240 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-21T03:26:02.296 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-21T03:26:02.296 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:26:02.296 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-21T03:26:02.351 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-21T03:26:02.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:26:02.351 DEBUG:teuthology.orchestra.run.smithi162:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:26:02.445 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:26:02.445 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T03:26:02.446 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-21T03:26:02.456 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:26:02.456 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T03:26:02.456 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-21T03:26:02.456 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:26:02.456 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:26:02.467 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:26:02.467 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T03:26:02.468 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-21T03:26:02.468 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:26:02.468 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:26:02.468 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-21T03:26:02.468 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-21T03:26:02.468 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=29d80f4f-e5de-4b26-8384-24c2d8019945" will pass to kernel 2024-09-21T03:26:02.468 INFO:teuthology.orchestra.run.smithi162.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-21T03:26:02.468 INFO:teuthology.orchestra.run.smithi162.stdout: You just mounted a file system that supports labels which does not 2024-09-21T03:26:02.469 INFO:teuthology.orchestra.run.smithi162.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T03:26:02.469 INFO:teuthology.orchestra.run.smithi162.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T03:26:02.469 INFO:teuthology.orchestra.run.smithi162.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T03:26:02.470 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T03:26:02.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:26:02.470 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-21T03:26:02.495 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:26:02.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:26:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:26:02.585 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:26:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:26:02.590 INFO:teuthology.orchestra.run.smithi162.stdout:client7788 2024-09-21T03:26:02.590 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:26:02.591 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:26:02.606 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_cache_memory_limit 1K 2024-09-21T03:26:02.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.729+0000 7f48141a1640 1 -- 172.21.15.105:0/1590946407 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f480c0cd360 msgr2=0x7f480c15c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:02.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.729+0000 7f48141a1640 1 --2- 172.21.15.105:0/1590946407 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f480c0cd360 0x7f480c15c6a0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f480c0d22c0 tx=0x7f47fc02a4f0 comp rx=0 tx=0).stop 2024-09-21T03:26:02.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.729+0000 7f48141a1640 1 -- 172.21.15.105:0/1590946407 shutdown_connections 2024-09-21T03:26:02.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.729+0000 7f48141a1640 1 --2- 172.21.15.105:0/1590946407 >> v2:172.21.15.162:3300/0 conn(0x7f480c0b7fe0 0x7f480c0ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:02.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.729+0000 7f48141a1640 1 --2- 172.21.15.105:0/1590946407 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f480c0cd360 0x7f480c15c6a0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:02.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.729+0000 7f48141a1640 1 -- 172.21.15.105:0/1590946407 >> 172.21.15.105:0/1590946407 conn(0x7f480c0710b0 msgr2=0x7f480c0714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:02.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.729+0000 7f48141a1640 1 -- 172.21.15.105:0/1590946407 shutdown_connections 2024-09-21T03:26:02.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.730+0000 7f48141a1640 1 -- 172.21.15.105:0/1590946407 wait complete. 2024-09-21T03:26:02.733 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.731+0000 7f48141a1640 1 Processor -- start 2024-09-21T03:26:02.733 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.731+0000 7f48141a1640 1 -- start start 2024-09-21T03:26:02.735 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.733+0000 7f48141a1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f480c0b7fe0 0x7f480c0c9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:02.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.733+0000 7f48141a1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f480c0cd360 0x7f480c0c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:02.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.733+0000 7f48141a1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f480c0cf270 0x7f480c159060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:02.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.733+0000 7f48141a1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f480c072f60 con 0x7f480c0cf270 2024-09-21T03:26:02.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.733+0000 7f48141a1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f480c0d13b0 con 0x7f480c0b7fe0 2024-09-21T03:26:02.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.733+0000 7f48141a1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f480c0730e0 con 0x7f480c0cd360 2024-09-21T03:26:02.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.733+0000 7f481273e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f480c0cf270 0x7f480c159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:02.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.733+0000 7f4811f3d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f480c0b7fe0 0x7f480c0c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:02.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.733+0000 7f481273e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f480c0cf270 0x7f480c159060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:39028/0 (socket says 172.21.15.105:39028) 2024-09-21T03:26:02.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.733+0000 7f481273e640 1 -- 172.21.15.105:0/262391663 learned_addr learned my addr 172.21.15.105:0/262391663 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:02.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.733+0000 7f481173c640 1 --2- 172.21.15.105:0/262391663 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f480c0cd360 0x7f480c0c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:02.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.733+0000 7f481273e640 1 -- 172.21.15.105:0/262391663 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f480c0cd360 msgr2=0x7f480c0c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:02.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.733+0000 7f481273e640 1 --2- 172.21.15.105:0/262391663 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f480c0cd360 0x7f480c0c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:02.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.733+0000 7f481273e640 1 -- 172.21.15.105:0/262391663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f480c0b7fe0 msgr2=0x7f480c0c9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:02.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.733+0000 7f481273e640 1 --2- 172.21.15.105:0/262391663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f480c0b7fe0 0x7f480c0c9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:02.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.733+0000 7f481273e640 1 -- 172.21.15.105:0/262391663 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f480c0c5e10 con 0x7f480c0cf270 2024-09-21T03:26:02.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.733+0000 7f481273e640 1 --2- 172.21.15.105:0/262391663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f480c0cf270 0x7f480c159060 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f480400b990 tx=0x7f480400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:02.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.733+0000 7f48027fc640 1 -- 172.21.15.105:0/262391663 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4804019070 con 0x7f480c0cf270 2024-09-21T03:26:02.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.733+0000 7f48027fc640 1 -- 172.21.15.105:0/262391663 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f480400cc90 con 0x7f480c0cf270 2024-09-21T03:26:02.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.733+0000 7f48141a1640 1 -- 172.21.15.105:0/262391663 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f480c0c8870 con 0x7f480c0cf270 2024-09-21T03:26:02.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.733+0000 7f48027fc640 1 -- 172.21.15.105:0/262391663 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48040146a0 con 0x7f480c0cf270 2024-09-21T03:26:02.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.733+0000 7f48141a1640 1 -- 172.21.15.105:0/262391663 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f480c0c60b0 con 0x7f480c0cf270 2024-09-21T03:26:02.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.734+0000 7f48141a1640 1 -- 172.21.15.105:0/262391663 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f480c0cd820 con 0x7f480c0cf270 2024-09-21T03:26:02.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.735+0000 7f48027fc640 1 -- 172.21.15.105:0/262391663 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f480401c070 con 0x7f480c0cf270 2024-09-21T03:26:02.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.736+0000 7f48027fc640 1 --2- 172.21.15.105:0/262391663 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f47f0078b90 0x7f47f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:02.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.736+0000 7f48027fc640 1 -- 172.21.15.105:0/262391663 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7f480409a950 con 0x7f480c0cf270 2024-09-21T03:26:02.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.736+0000 7f4811f3d640 1 --2- 172.21.15.105:0/262391663 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f47f0078b90 0x7f47f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:02.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.737+0000 7f4811f3d640 1 --2- 172.21.15.105:0/262391663 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f47f0078b90 0x7f47f007b0a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f47fc033000 tx=0x7f47fc004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:02.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.740+0000 7f48027fc640 1 -- 172.21.15.105:0/262391663 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f480c0cd820 con 0x7f480c0cf270 2024-09-21T03:26:02.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.918+0000 7f48141a1640 1 -- 172.21.15.105:0/262391663 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command([{prefix=config set, name=mds_cache_memory_limit}] v 0) -- 0x7f480c0c9b60 con 0x7f480c0cf270 2024-09-21T03:26:02.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.922+0000 7f48027fc640 1 -- 172.21.15.105:0/262391663 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_cache_memory_limit}]=0 v58)=0 v58) ==== 121+0+0 (secure 0 0 0) 0x7f48040627d0 con 0x7f480c0cf270 2024-09-21T03:26:02.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.925+0000 7f48141a1640 1 -- 172.21.15.105:0/262391663 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f47f0078b90 msgr2=0x7f47f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:02.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.925+0000 7f48141a1640 1 --2- 172.21.15.105:0/262391663 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f47f0078b90 0x7f47f007b0a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f47fc033000 tx=0x7f47fc004730 comp rx=0 tx=0).stop 2024-09-21T03:26:02.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.925+0000 7f48141a1640 1 -- 172.21.15.105:0/262391663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f480c0cf270 msgr2=0x7f480c159060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:02.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.925+0000 7f48141a1640 1 --2- 172.21.15.105:0/262391663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f480c0cf270 0x7f480c159060 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f480400b990 tx=0x7f480400be50 comp rx=0 tx=0).stop 2024-09-21T03:26:02.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.925+0000 7f48141a1640 1 -- 172.21.15.105:0/262391663 shutdown_connections 2024-09-21T03:26:02.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.925+0000 7f48141a1640 1 --2- 172.21.15.105:0/262391663 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f47f0078b90 0x7f47f007b0a0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:02.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.925+0000 7f48141a1640 1 --2- 172.21.15.105:0/262391663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f480c0cf270 0x7f480c159060 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:02.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.925+0000 7f48141a1640 1 --2- 172.21.15.105:0/262391663 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f480c0cd360 0x7f480c0c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:02.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.925+0000 7f48141a1640 1 --2- 172.21.15.105:0/262391663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f480c0b7fe0 0x7f480c0c9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:02.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.925+0000 7f48141a1640 1 -- 172.21.15.105:0/262391663 >> 172.21.15.105:0/262391663 conn(0x7f480c0710b0 msgr2=0x7f480c0b5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:02.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.925+0000 7f48141a1640 1 -- 172.21.15.105:0/262391663 shutdown_connections 2024-09-21T03:26:02.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:02.925+0000 7f48141a1640 1 -- 172.21.15.105:0/262391663 wait complete. 2024-09-21T03:26:02.938 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_recall_max_caps 100 2024-09-21T03:26:03.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.053+0000 7f516e539640 1 -- 172.21.15.105:0/248018362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51680cf360 msgr2=0x7f5168156f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:03.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.053+0000 7f516e539640 1 --2- 172.21.15.105:0/248018362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51680cf360 0x7f5168156f10 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5160005fd0 tx=0x7f516002a960 comp rx=0 tx=0).stop 2024-09-21T03:26:03.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.053+0000 7f516e539640 1 -- 172.21.15.105:0/248018362 shutdown_connections 2024-09-21T03:26:03.055 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.053+0000 7f516e539640 1 --2- 172.21.15.105:0/248018362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51680cf360 0x7f5168156f10 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:03.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.053+0000 7f516e539640 1 -- 172.21.15.105:0/248018362 >> 172.21.15.105:0/248018362 conn(0x7f516806d4f0 msgr2=0x7f5168071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:03.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.053+0000 7f516e539640 1 -- 172.21.15.105:0/248018362 shutdown_connections 2024-09-21T03:26:03.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.053+0000 7f516e539640 1 -- 172.21.15.105:0/248018362 wait complete. 2024-09-21T03:26:03.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.055+0000 7f516e539640 1 Processor -- start 2024-09-21T03:26:03.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.055+0000 7f516e539640 1 -- start start 2024-09-21T03:26:03.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.056+0000 7f516e539640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f51680ccb70 0x7f51681f7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:03.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.056+0000 7f516e539640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51680cf360 0x7f516814c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:03.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.056+0000 7f516e539640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5168161020 0x7f51680b34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:03.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.056+0000 7f516e539640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f51680d0a60 con 0x7f51680ccb70 2024-09-21T03:26:03.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.056+0000 7f516e539640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f51680d08e0 con 0x7f51680cf360 2024-09-21T03:26:03.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.056+0000 7f516e539640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f51680d0be0 con 0x7f5168161020 2024-09-21T03:26:03.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.056+0000 7f5167fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f51680ccb70 0x7f51681f7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:03.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.056+0000 7f5167fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f51680ccb70 0x7f51681f7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:39040/0 (socket says 172.21.15.105:39040) 2024-09-21T03:26:03.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.056+0000 7f5167fff640 1 -- 172.21.15.105:0/37872683 learned_addr learned my addr 172.21.15.105:0/37872683 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:03.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.057+0000 7f516cad6640 1 --2- 172.21.15.105:0/37872683 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5168161020 0x7f51680b34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:03.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.057+0000 7f515ffff640 1 --2- 172.21.15.105:0/37872683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51680cf360 0x7f516814c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:03.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.057+0000 7f5167fff640 1 -- 172.21.15.105:0/37872683 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5168161020 msgr2=0x7f51680b34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:03.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.057+0000 7f5167fff640 1 --2- 172.21.15.105:0/37872683 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5168161020 0x7f51680b34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:03.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.057+0000 7f5167fff640 1 -- 172.21.15.105:0/37872683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51680cf360 msgr2=0x7f516814c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:03.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.057+0000 7f5167fff640 1 --2- 172.21.15.105:0/37872683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51680cf360 0x7f516814c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:03.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.057+0000 7f5167fff640 1 -- 172.21.15.105:0/37872683 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51681f4060 con 0x7f51680ccb70 2024-09-21T03:26:03.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.057+0000 7f5167fff640 1 --2- 172.21.15.105:0/37872683 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f51680ccb70 0x7f51681f7e20 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f515800c400 tx=0x7f515800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:03.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.057+0000 7f51657fa640 1 -- 172.21.15.105:0/37872683 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5158017070 con 0x7f51680ccb70 2024-09-21T03:26:03.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.057+0000 7f516e539640 1 -- 172.21.15.105:0/37872683 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51681f4340 con 0x7f51680ccb70 2024-09-21T03:26:03.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.057+0000 7f51657fa640 1 -- 172.21.15.105:0/37872683 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51580053c0 con 0x7f51680ccb70 2024-09-21T03:26:03.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.057+0000 7f51657fa640 1 -- 172.21.15.105:0/37872683 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5158003850 con 0x7f51680ccb70 2024-09-21T03:26:03.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.057+0000 7f516e539640 1 -- 172.21.15.105:0/37872683 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51681f4900 con 0x7f51680ccb70 2024-09-21T03:26:03.061 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.058+0000 7f516e539640 1 -- 172.21.15.105:0/37872683 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5168156f10 con 0x7f51680ccb70 2024-09-21T03:26:03.061 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.059+0000 7f51657fa640 1 -- 172.21.15.105:0/37872683 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f515801a070 con 0x7f51680ccb70 2024-09-21T03:26:03.061 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.059+0000 7f51657fa640 1 --2- 172.21.15.105:0/37872683 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5148078bc0 0x7f514807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:03.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.059+0000 7f51657fa640 1 -- 172.21.15.105:0/37872683 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7f515809a0a0 con 0x7f51680ccb70 2024-09-21T03:26:03.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.060+0000 7f515ffff640 1 --2- 172.21.15.105:0/37872683 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5148078bc0 0x7f514807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:03.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.060+0000 7f515ffff640 1 --2- 172.21.15.105:0/37872683 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5148078bc0 0x7f514807b0d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f516814e440 tx=0x7f5150001690 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:03.065 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.064+0000 7f51657fa640 1 -- 172.21.15.105:0/37872683 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5158061e10 con 0x7f51680ccb70 2024-09-21T03:26:03.246 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.244+0000 7f516e539640 1 -- 172.21.15.105:0/37872683 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command([{prefix=config set, name=mds_recall_max_caps}] v 0) -- 0x7f51680d1510 con 0x7f51680ccb70 2024-09-21T03:26:03.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.248+0000 7f51657fa640 1 -- 172.21.15.105:0/37872683 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_recall_max_caps}]=0 v59)=0 v59) ==== 119+0+0 (secure 0 0 0) 0x7f5158066840 con 0x7f51680ccb70 2024-09-21T03:26:03.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.250+0000 7f516e539640 1 -- 172.21.15.105:0/37872683 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5148078bc0 msgr2=0x7f514807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:03.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.250+0000 7f516e539640 1 --2- 172.21.15.105:0/37872683 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5148078bc0 0x7f514807b0d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f516814e440 tx=0x7f5150001690 comp rx=0 tx=0).stop 2024-09-21T03:26:03.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.250+0000 7f516e539640 1 -- 172.21.15.105:0/37872683 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f51680ccb70 msgr2=0x7f51681f7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:03.253 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.250+0000 7f516e539640 1 --2- 172.21.15.105:0/37872683 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f51680ccb70 0x7f51681f7e20 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f515800c400 tx=0x7f515800c8c0 comp rx=0 tx=0).stop 2024-09-21T03:26:03.253 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.250+0000 7f516e539640 1 -- 172.21.15.105:0/37872683 shutdown_connections 2024-09-21T03:26:03.253 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.250+0000 7f516e539640 1 --2- 172.21.15.105:0/37872683 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5148078bc0 0x7f514807b0d0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:03.253 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.250+0000 7f516e539640 1 --2- 172.21.15.105:0/37872683 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5168161020 0x7f51680b34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:03.253 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.250+0000 7f516e539640 1 --2- 172.21.15.105:0/37872683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51680cf360 0x7f516814c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:03.253 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.250+0000 7f516e539640 1 --2- 172.21.15.105:0/37872683 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f51680ccb70 0x7f51681f7e20 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:03.253 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.250+0000 7f516e539640 1 -- 172.21.15.105:0/37872683 >> 172.21.15.105:0/37872683 conn(0x7f516806d4f0 msgr2=0x7f51680b5fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:03.253 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.250+0000 7f516e539640 1 -- 172.21.15.105:0/37872683 shutdown_connections 2024-09-21T03:26:03.253 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.250+0000 7f516e539640 1 -- 172.21.15.105:0/37872683 wait complete. 2024-09-21T03:26:03.263 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_recall_warning_threshold 200 2024-09-21T03:26:03.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.376+0000 7f894eb19640 1 -- 172.21.15.105:0/3279720552 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8930004800 msgr2=0x7f8930004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:03.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.376+0000 7f894eb19640 1 --2- 172.21.15.105:0/3279720552 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8930004800 0x7f8930004c10 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f893c00bb20 tx=0x7f8930005830 comp rx=0 tx=0).stop 2024-09-21T03:26:03.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.376+0000 7f894d0b6640 1 -- 172.21.15.105:0/3279720552 reap_dead start 2024-09-21T03:26:03.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.376+0000 7f894eb19640 1 -- 172.21.15.105:0/3279720552 shutdown_connections 2024-09-21T03:26:03.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.376+0000 7f894eb19640 1 -- 172.21.15.105:0/3279720552 >> 172.21.15.105:0/3279720552 conn(0x7f89480b3f10 msgr2=0x7f89480b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:03.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.376+0000 7f894eb19640 1 -- 172.21.15.105:0/3279720552 shutdown_connections 2024-09-21T03:26:03.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.376+0000 7f894eb19640 1 -- 172.21.15.105:0/3279720552 wait complete. 2024-09-21T03:26:03.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.378+0000 7f894eb19640 1 Processor -- start 2024-09-21T03:26:03.380 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.378+0000 7f894eb19640 1 -- start start 2024-09-21T03:26:03.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.380+0000 7f894eb19640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8930004800 0x7f89481f7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:03.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.380+0000 7f894eb19640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89480cc1c0 0x7f894815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:03.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.380+0000 7f894eb19640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f894815aa00 0x7f8948154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:03.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.380+0000 7f894eb19640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f89480d1520 con 0x7f89480cc1c0 2024-09-21T03:26:03.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.380+0000 7f894eb19640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f89480cfc40 con 0x7f8930004800 2024-09-21T03:26:03.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.380+0000 7f894eb19640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f89480d16a0 con 0x7f894815aa00 2024-09-21T03:26:03.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.380+0000 7f8947fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89480cc1c0 0x7f894815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:03.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.380+0000 7f8947fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89480cc1c0 0x7f894815a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:39054/0 (socket says 172.21.15.105:39054) 2024-09-21T03:26:03.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.380+0000 7f8947fff640 1 -- 172.21.15.105:0/674196218 learned_addr learned my addr 172.21.15.105:0/674196218 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:03.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.380+0000 7f894c8b5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8930004800 0x7f89481f7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:03.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.380+0000 7f894d0b6640 1 --2- 172.21.15.105:0/674196218 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f894815aa00 0x7f8948154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:03.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.380+0000 7f8947fff640 1 -- 172.21.15.105:0/674196218 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f894815aa00 msgr2=0x7f8948154750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:03.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.380+0000 7f8947fff640 1 --2- 172.21.15.105:0/674196218 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f894815aa00 0x7f8948154750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:03.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.380+0000 7f8947fff640 1 -- 172.21.15.105:0/674196218 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8930004800 msgr2=0x7f89481f7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:03.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.380+0000 7f8947fff640 1 --2- 172.21.15.105:0/674196218 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8930004800 0x7f89481f7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:03.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.380+0000 7f8947fff640 1 -- 172.21.15.105:0/674196218 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89481f7d70 con 0x7f89480cc1c0 2024-09-21T03:26:03.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.380+0000 7f8947fff640 1 --2- 172.21.15.105:0/674196218 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89480cc1c0 0x7f894815a4c0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f893c034040 tx=0x7f893c005870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:03.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.380+0000 7f89457fa640 1 -- 172.21.15.105:0/674196218 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f893c040070 con 0x7f89480cc1c0 2024-09-21T03:26:03.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.380+0000 7f89457fa640 1 -- 172.21.15.105:0/674196218 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f893c004030 con 0x7f89480cc1c0 2024-09-21T03:26:03.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.380+0000 7f894eb19640 1 -- 172.21.15.105:0/674196218 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f894815ae10 con 0x7f89480cc1c0 2024-09-21T03:26:03.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.380+0000 7f89457fa640 1 -- 172.21.15.105:0/674196218 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f893c035040 con 0x7f89480cc1c0 2024-09-21T03:26:03.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.381+0000 7f894eb19640 1 -- 172.21.15.105:0/674196218 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8948156e70 con 0x7f89480cc1c0 2024-09-21T03:26:03.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.382+0000 7f894eb19640 1 -- 172.21.15.105:0/674196218 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89480d1be0 con 0x7f89480cc1c0 2024-09-21T03:26:03.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.382+0000 7f89457fa640 1 -- 172.21.15.105:0/674196218 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f893c038020 con 0x7f89480cc1c0 2024-09-21T03:26:03.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.383+0000 7f89457fa640 1 --2- 172.21.15.105:0/674196218 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8934078b90 0x7f893407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:03.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.383+0000 7f89457fa640 1 -- 172.21.15.105:0/674196218 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7f893c0bb930 con 0x7f89480cc1c0 2024-09-21T03:26:03.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.383+0000 7f894c8b5640 1 --2- 172.21.15.105:0/674196218 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8934078b90 0x7f893407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:03.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.383+0000 7f894c8b5640 1 --2- 172.21.15.105:0/674196218 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8934078b90 0x7f893407b0a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f8938006c10 tx=0x7f89380067a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:03.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.387+0000 7f89457fa640 1 -- 172.21.15.105:0/674196218 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f894815ae10 con 0x7f89480cc1c0 2024-09-21T03:26:03.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.564+0000 7f894eb19640 1 -- 172.21.15.105:0/674196218 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command([{prefix=config set, name=mds_recall_warning_threshold}] v 0) -- 0x7f8948156920 con 0x7f89480cc1c0 2024-09-21T03:26:03.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.567+0000 7f89457fa640 1 -- 172.21.15.105:0/674196218 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_recall_warning_threshold}]=0 v60)=0 v60) ==== 128+0+0 (secure 0 0 0) 0x7f89481f7d70 con 0x7f89480cc1c0 2024-09-21T03:26:03.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.570+0000 7f894eb19640 1 -- 172.21.15.105:0/674196218 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8934078b90 msgr2=0x7f893407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:03.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.570+0000 7f894eb19640 1 --2- 172.21.15.105:0/674196218 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8934078b90 0x7f893407b0a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f8938006c10 tx=0x7f89380067a0 comp rx=0 tx=0).stop 2024-09-21T03:26:03.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.570+0000 7f894eb19640 1 -- 172.21.15.105:0/674196218 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89480cc1c0 msgr2=0x7f894815a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:03.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.570+0000 7f894eb19640 1 --2- 172.21.15.105:0/674196218 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89480cc1c0 0x7f894815a4c0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f893c034040 tx=0x7f893c005870 comp rx=0 tx=0).stop 2024-09-21T03:26:03.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.570+0000 7f894eb19640 1 -- 172.21.15.105:0/674196218 shutdown_connections 2024-09-21T03:26:03.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.570+0000 7f894eb19640 1 --2- 172.21.15.105:0/674196218 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8934078b90 0x7f893407b0a0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:03.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.570+0000 7f894eb19640 1 --2- 172.21.15.105:0/674196218 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f894815aa00 0x7f8948154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:03.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.570+0000 7f894eb19640 1 --2- 172.21.15.105:0/674196218 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89480cc1c0 0x7f894815a4c0 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:03.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.570+0000 7f894eb19640 1 --2- 172.21.15.105:0/674196218 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8930004800 0x7f89481f7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:03.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.570+0000 7f894eb19640 1 -- 172.21.15.105:0/674196218 >> 172.21.15.105:0/674196218 conn(0x7f89480b3f10 msgr2=0x7f894815f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:03.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.570+0000 7f894eb19640 1 -- 172.21.15.105:0/674196218 shutdown_connections 2024-09-21T03:26:03.573 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.570+0000 7f894eb19640 1 -- 172.21.15.105:0/674196218 wait complete. 2024-09-21T03:26:03.583 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_min_caps_per_client 2024-09-21T03:26:03.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.695+0000 7f9d05e8b640 1 -- 172.21.15.105:0/1163406307 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d000caee0 msgr2=0x7f9d0006ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:03.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.695+0000 7f9d05e8b640 1 --2- 172.21.15.105:0/1163406307 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d000caee0 0x7f9d0006ee90 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f9d00072c00 tx=0x7f9cf802aac0 comp rx=0 tx=0).stop 2024-09-21T03:26:03.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.695+0000 7f9d05e8b640 1 -- 172.21.15.105:0/1163406307 shutdown_connections 2024-09-21T03:26:03.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.695+0000 7f9d05e8b640 1 --2- 172.21.15.105:0/1163406307 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d000caee0 0x7f9d0006ee90 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:03.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.695+0000 7f9d05e8b640 1 --2- 172.21.15.105:0/1163406307 >> v2:172.21.15.162:3300/0 conn(0x7f9d0015bf20 0x7f9d000ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:03.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.695+0000 7f9d05e8b640 1 -- 172.21.15.105:0/1163406307 >> 172.21.15.105:0/1163406307 conn(0x7f9d000b1cb0 msgr2=0x7f9d000b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:03.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.695+0000 7f9d05e8b640 1 -- 172.21.15.105:0/1163406307 shutdown_connections 2024-09-21T03:26:03.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.695+0000 7f9d05e8b640 1 -- 172.21.15.105:0/1163406307 wait complete. 2024-09-21T03:26:03.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.697+0000 7f9d05e8b640 1 Processor -- start 2024-09-21T03:26:03.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.697+0000 7f9d05e8b640 1 -- start start 2024-09-21T03:26:03.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.698+0000 7f9d05e8b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d000caee0 0x7f9d0014de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:03.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.698+0000 7f9d05e8b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d000cfb00 0x7f9d001f2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:03.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.698+0000 7f9d05e8b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d0015bf20 0x7f9d000b05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:03.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.698+0000 7f9d05e8b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9d000704e0 con 0x7f9d000cfb00 2024-09-21T03:26:03.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.698+0000 7f9d05e8b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9d00070660 con 0x7f9d000caee0 2024-09-21T03:26:03.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.698+0000 7f9d05e8b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9d000707e0 con 0x7f9d0015bf20 2024-09-21T03:26:03.702 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.698+0000 7f9cfeffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d000cfb00 0x7f9d001f2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:03.702 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.698+0000 7f9cfeffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d000cfb00 0x7f9d001f2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:39072/0 (socket says 172.21.15.105:39072) 2024-09-21T03:26:03.702 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.699+0000 7f9cfeffd640 1 -- 172.21.15.105:0/4055341460 learned_addr learned my addr 172.21.15.105:0/4055341460 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:03.702 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.699+0000 7f9cff7fe640 1 --2- 172.21.15.105:0/4055341460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d000caee0 0x7f9d0014de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:03.702 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.699+0000 7f9cfffff640 1 --2- 172.21.15.105:0/4055341460 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d0015bf20 0x7f9d000b05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:03.702 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.699+0000 7f9cfeffd640 1 -- 172.21.15.105:0/4055341460 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d0015bf20 msgr2=0x7f9d000b05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:03.702 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.699+0000 7f9cfeffd640 1 --2- 172.21.15.105:0/4055341460 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d0015bf20 0x7f9d000b05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:03.702 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.699+0000 7f9cfeffd640 1 -- 172.21.15.105:0/4055341460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d000caee0 msgr2=0x7f9d0014de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:03.702 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.699+0000 7f9cfeffd640 1 --2- 172.21.15.105:0/4055341460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d000caee0 0x7f9d0014de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:03.702 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.699+0000 7f9cfeffd640 1 -- 172.21.15.105:0/4055341460 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d001f3570 con 0x7f9d000cfb00 2024-09-21T03:26:03.702 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.699+0000 7f9cfeffd640 1 --2- 172.21.15.105:0/4055341460 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d000cfb00 0x7f9d001f2a00 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f9ce800d720 tx=0x7f9ce800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:03.702 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.699+0000 7f9cf7fff640 1 -- 172.21.15.105:0/4055341460 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce8017070 con 0x7f9d000cfb00 2024-09-21T03:26:03.702 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.699+0000 7f9cf7fff640 1 -- 172.21.15.105:0/4055341460 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ce8009ab0 con 0x7f9d000cfb00 2024-09-21T03:26:03.702 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.699+0000 7f9d05e8b640 1 -- 172.21.15.105:0/4055341460 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d001f3850 con 0x7f9d000cfb00 2024-09-21T03:26:03.703 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.699+0000 7f9cf7fff640 1 -- 172.21.15.105:0/4055341460 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce8010460 con 0x7f9d000cfb00 2024-09-21T03:26:03.703 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.699+0000 7f9d05e8b640 1 -- 172.21.15.105:0/4055341460 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d0009d9c0 con 0x7f9d000cfb00 2024-09-21T03:26:03.703 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.700+0000 7f9d05e8b640 1 -- 172.21.15.105:0/4055341460 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d000ad7a0 con 0x7f9d000cfb00 2024-09-21T03:26:03.703 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.701+0000 7f9cf7fff640 1 -- 172.21.15.105:0/4055341460 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9ce801a070 con 0x7f9d000cfb00 2024-09-21T03:26:03.704 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.702+0000 7f9cf7fff640 1 --2- 172.21.15.105:0/4055341460 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9ce0078b90 0x7f9ce007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:03.704 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.702+0000 7f9cf7fff640 1 -- 172.21.15.105:0/4055341460 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7f9ce809b250 con 0x7f9d000cfb00 2024-09-21T03:26:03.704 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.702+0000 7f9cff7fe640 1 --2- 172.21.15.105:0/4055341460 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9ce0078b90 0x7f9ce007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:03.704 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.702+0000 7f9cff7fe640 1 --2- 172.21.15.105:0/4055341460 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9ce0078b90 0x7f9ce007b0a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f9cf00015e0 tx=0x7f9cf0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:03.707 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.705+0000 7f9cf7fff640 1 -- 172.21.15.105:0/4055341460 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9ce8063770 con 0x7f9d000cfb00 2024-09-21T03:26:03.884 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.882+0000 7f9d05e8b640 1 -- 172.21.15.105:0/4055341460 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_min_caps_per_client"} v 0) -- 0x7f9d001f3300 con 0x7f9d000cfb00 2024-09-21T03:26:03.884 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.883+0000 7f9cf7fff640 1 -- 172.21.15.105:0/4055341460 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_min_caps_per_client"}]=0 v60) ==== 106+0+4 (secure 0 0 0) 0x7f9ce8063070 con 0x7f9d000cfb00 2024-09-21T03:26:03.884 INFO:teuthology.orchestra.run.smithi105.stdout:100 2024-09-21T03:26:03.887 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.885+0000 7f9d05e8b640 1 -- 172.21.15.105:0/4055341460 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9ce0078b90 msgr2=0x7f9ce007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:03.887 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.885+0000 7f9d05e8b640 1 --2- 172.21.15.105:0/4055341460 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9ce0078b90 0x7f9ce007b0a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f9cf00015e0 tx=0x7f9cf0009040 comp rx=0 tx=0).stop 2024-09-21T03:26:03.887 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.885+0000 7f9d05e8b640 1 -- 172.21.15.105:0/4055341460 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d000cfb00 msgr2=0x7f9d001f2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:03.887 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.885+0000 7f9d05e8b640 1 --2- 172.21.15.105:0/4055341460 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d000cfb00 0x7f9d001f2a00 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f9ce800d720 tx=0x7f9ce800dbe0 comp rx=0 tx=0).stop 2024-09-21T03:26:03.887 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.885+0000 7f9d05e8b640 1 -- 172.21.15.105:0/4055341460 shutdown_connections 2024-09-21T03:26:03.887 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.885+0000 7f9d05e8b640 1 --2- 172.21.15.105:0/4055341460 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9ce0078b90 0x7f9ce007b0a0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:03.887 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.885+0000 7f9d05e8b640 1 --2- 172.21.15.105:0/4055341460 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d0015bf20 0x7f9d000b05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:03.887 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.885+0000 7f9d05e8b640 1 --2- 172.21.15.105:0/4055341460 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d000cfb00 0x7f9d001f2a00 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:03.887 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.885+0000 7f9d05e8b640 1 --2- 172.21.15.105:0/4055341460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d000caee0 0x7f9d0014de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:03.887 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.885+0000 7f9d05e8b640 1 -- 172.21.15.105:0/4055341460 >> 172.21.15.105:0/4055341460 conn(0x7f9d000b1cb0 msgr2=0x7f9d000ca270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:03.887 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.885+0000 7f9d05e8b640 1 -- 172.21.15.105:0/4055341460 shutdown_connections 2024-09-21T03:26:03.887 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:03.885+0000 7f9d05e8b640 1 -- 172.21.15.105:0/4055341460 wait complete. 2024-09-21T03:26:03.898 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_min_caps_working_set 100 2024-09-21T03:26:04.015 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.013+0000 7f8a26a3f640 1 -- 172.21.15.105:0/2650967537 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a08004020 msgr2=0x7f8a08004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:04.016 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.013+0000 7f8a26a3f640 1 --2- 172.21.15.105:0/2650967537 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a08004020 0x7f8a08004800 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f8a14009b20 tx=0x7f8a08005830 comp rx=0 tx=0).stop 2024-09-21T03:26:04.016 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.013+0000 7f8a24fdc640 1 -- 172.21.15.105:0/2650967537 reap_dead start 2024-09-21T03:26:04.016 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.014+0000 7f8a26a3f640 1 -- 172.21.15.105:0/2650967537 shutdown_connections 2024-09-21T03:26:04.016 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.014+0000 7f8a26a3f640 1 -- 172.21.15.105:0/2650967537 >> 172.21.15.105:0/2650967537 conn(0x7f8a200cdcb0 msgr2=0x7f8a200ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:04.016 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.014+0000 7f8a26a3f640 1 -- 172.21.15.105:0/2650967537 shutdown_connections 2024-09-21T03:26:04.016 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.014+0000 7f8a26a3f640 1 -- 172.21.15.105:0/2650967537 wait complete. 2024-09-21T03:26:04.017 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.015+0000 7f8a26a3f640 1 Processor -- start 2024-09-21T03:26:04.017 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.015+0000 7f8a26a3f640 1 -- start start 2024-09-21T03:26:04.020 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.017+0000 7f8a26a3f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a08004020 0x7f8a201f0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:04.020 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.017+0000 7f8a26a3f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a2015a1b0 0x7f8a200ca880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:04.020 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.017+0000 7f8a26a3f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a2009dba0 0x7f8a2009dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:04.020 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.017+0000 7f8a26a3f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8a200b3450 con 0x7f8a2009dba0 2024-09-21T03:26:04.020 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.017+0000 7f8a26a3f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8a200b32d0 con 0x7f8a2015a1b0 2024-09-21T03:26:04.020 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.017+0000 7f8a26a3f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8a20071d80 con 0x7f8a08004020 2024-09-21T03:26:04.020 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.017+0000 7f8a24fdc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a2009dba0 0x7f8a2009dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:04.020 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.017+0000 7f8a24fdc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a2009dba0 0x7f8a2009dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:39082/0 (socket says 172.21.15.105:39082) 2024-09-21T03:26:04.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.017+0000 7f8a24fdc640 1 -- 172.21.15.105:0/3413165065 learned_addr learned my addr 172.21.15.105:0/3413165065 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:04.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.017+0000 7f8a1ffff640 1 --2- 172.21.15.105:0/3413165065 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a08004020 0x7f8a201f0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:04.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.017+0000 7f8a1f7fe640 1 --2- 172.21.15.105:0/3413165065 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a2015a1b0 0x7f8a200ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:04.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.017+0000 7f8a24fdc640 1 -- 172.21.15.105:0/3413165065 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a08004020 msgr2=0x7f8a201f0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:04.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.017+0000 7f8a24fdc640 1 --2- 172.21.15.105:0/3413165065 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a08004020 0x7f8a201f0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:04.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.017+0000 7f8a24fdc640 1 -- 172.21.15.105:0/3413165065 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a2015a1b0 msgr2=0x7f8a200ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:04.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.017+0000 7f8a24fdc640 1 --2- 172.21.15.105:0/3413165065 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a2015a1b0 0x7f8a200ca880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:04.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.017+0000 7f8a24fdc640 1 -- 172.21.15.105:0/3413165065 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a2009e4f0 con 0x7f8a2009dba0 2024-09-21T03:26:04.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.017+0000 7f8a24fdc640 1 --2- 172.21.15.105:0/3413165065 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a2009dba0 0x7f8a2009dfb0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f8a18005fd0 tx=0x7f8a1800b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:04.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.017+0000 7f8a1cff9640 1 -- 172.21.15.105:0/3413165065 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a18003b70 con 0x7f8a2009dba0 2024-09-21T03:26:04.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.017+0000 7f8a1cff9640 1 -- 172.21.15.105:0/3413165065 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a1800be50 con 0x7f8a2009dba0 2024-09-21T03:26:04.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.017+0000 7f8a26a3f640 1 -- 172.21.15.105:0/3413165065 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a201f1810 con 0x7f8a2009dba0 2024-09-21T03:26:04.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.017+0000 7f8a1cff9640 1 -- 172.21.15.105:0/3413165065 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a18004030 con 0x7f8a2009dba0 2024-09-21T03:26:04.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.018+0000 7f8a26a3f640 1 -- 172.21.15.105:0/3413165065 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a201f1dd0 con 0x7f8a2009dba0 2024-09-21T03:26:04.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.018+0000 7f8a26a3f640 1 -- 172.21.15.105:0/3413165065 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a20071650 con 0x7f8a2009dba0 2024-09-21T03:26:04.023 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.019+0000 7f8a1cff9640 1 -- 172.21.15.105:0/3413165065 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8a180041d0 con 0x7f8a2009dba0 2024-09-21T03:26:04.023 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.020+0000 7f8a1cff9640 1 --2- 172.21.15.105:0/3413165065 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8a0c078b90 0x7f8a0c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:04.023 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.020+0000 7f8a1cff9640 1 -- 172.21.15.105:0/3413165065 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7f8a1809f830 con 0x7f8a2009dba0 2024-09-21T03:26:04.023 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.020+0000 7f8a1ffff640 1 --2- 172.21.15.105:0/3413165065 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8a0c078b90 0x7f8a0c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:04.023 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.020+0000 7f8a1ffff640 1 --2- 172.21.15.105:0/3413165065 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8a0c078b90 0x7f8a0c07b0a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f8a10001eb0 tx=0x7f8a1000e040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:04.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.024+0000 7f8a1cff9640 1 -- 172.21.15.105:0/3413165065 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8a18021060 con 0x7f8a2009dba0 2024-09-21T03:26:04.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.200+0000 7f8a26a3f640 1 -- 172.21.15.105:0/3413165065 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command([{prefix=config set, name=mds_min_caps_working_set}] v 0) -- 0x7f8a201f15a0 con 0x7f8a2009dba0 2024-09-21T03:26:04.206 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.204+0000 7f8a1cff9640 1 -- 172.21.15.105:0/3413165065 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_min_caps_working_set}]=0 v61)=0 v61) ==== 124+0+0 (secure 0 0 0) 0x7f8a2009e4f0 con 0x7f8a2009dba0 2024-09-21T03:26:04.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.207+0000 7f8a26a3f640 1 -- 172.21.15.105:0/3413165065 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8a0c078b90 msgr2=0x7f8a0c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:04.209 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.207+0000 7f8a26a3f640 1 --2- 172.21.15.105:0/3413165065 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8a0c078b90 0x7f8a0c07b0a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f8a10001eb0 tx=0x7f8a1000e040 comp rx=0 tx=0).stop 2024-09-21T03:26:04.209 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.207+0000 7f8a26a3f640 1 -- 172.21.15.105:0/3413165065 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a2009dba0 msgr2=0x7f8a2009dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:04.209 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.207+0000 7f8a26a3f640 1 --2- 172.21.15.105:0/3413165065 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a2009dba0 0x7f8a2009dfb0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f8a18005fd0 tx=0x7f8a1800b690 comp rx=0 tx=0).stop 2024-09-21T03:26:04.209 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.207+0000 7f8a26a3f640 1 -- 172.21.15.105:0/3413165065 shutdown_connections 2024-09-21T03:26:04.209 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.207+0000 7f8a26a3f640 1 --2- 172.21.15.105:0/3413165065 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8a0c078b90 0x7f8a0c07b0a0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:04.209 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.207+0000 7f8a26a3f640 1 --2- 172.21.15.105:0/3413165065 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a2009dba0 0x7f8a2009dfb0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:04.209 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.207+0000 7f8a26a3f640 1 --2- 172.21.15.105:0/3413165065 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a2015a1b0 0x7f8a200ca880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:04.209 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.207+0000 7f8a26a3f640 1 --2- 172.21.15.105:0/3413165065 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a08004020 0x7f8a201f0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:04.209 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.207+0000 7f8a26a3f640 1 -- 172.21.15.105:0/3413165065 >> 172.21.15.105:0/3413165065 conn(0x7f8a200cdcb0 msgr2=0x7f8a200b00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:04.209 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.207+0000 7f8a26a3f640 1 -- 172.21.15.105:0/3413165065 shutdown_connections 2024-09-21T03:26:04.209 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.207+0000 7f8a26a3f640 1 -- 172.21.15.105:0/3413165065 wait complete. 2024-09-21T03:26:04.220 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_max_caps_per_client 2024-09-21T03:26:04.336 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.334+0000 7f95527a8640 1 -- 172.21.15.105:0/749949817 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f954c15c830 msgr2=0x7f954c160c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:04.336 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.334+0000 7f95527a8640 1 --2- 172.21.15.105:0/749949817 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f954c15c830 0x7f954c160c90 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f9544005fd0 tx=0x7f954402a820 comp rx=0 tx=0).stop 2024-09-21T03:26:04.337 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.334+0000 7f95527a8640 1 -- 172.21.15.105:0/749949817 shutdown_connections 2024-09-21T03:26:04.338 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.334+0000 7f95527a8640 1 --2- 172.21.15.105:0/749949817 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f954c15c830 0x7f954c160c90 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:04.338 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.334+0000 7f95527a8640 1 -- 172.21.15.105:0/749949817 >> 172.21.15.105:0/749949817 conn(0x7f954c0cee20 msgr2=0x7f954c0cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:04.338 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.334+0000 7f95527a8640 1 -- 172.21.15.105:0/749949817 shutdown_connections 2024-09-21T03:26:04.338 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.334+0000 7f95527a8640 1 -- 172.21.15.105:0/749949817 wait complete. 2024-09-21T03:26:04.338 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.336+0000 7f95527a8640 1 Processor -- start 2024-09-21T03:26:04.338 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.336+0000 7f95527a8640 1 -- start start 2024-09-21T03:26:04.340 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.337+0000 7f95527a8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f954c0cff70 0x7f954c1f2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:04.340 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.337+0000 7f95527a8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f954c15c830 0x7f954c0b7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:04.340 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.337+0000 7f95527a8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f954c15ab10 0x7f954c15af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:04.340 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.337+0000 7f95527a8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f954c0d1930 con 0x7f954c15ab10 2024-09-21T03:26:04.340 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.337+0000 7f95527a8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f954c0d17b0 con 0x7f954c15c830 2024-09-21T03:26:04.341 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.337+0000 7f95527a8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f954c0d1ab0 con 0x7f954c0cff70 2024-09-21T03:26:04.341 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.338+0000 7f9550d45640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f954c15ab10 0x7f954c15af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:04.341 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.338+0000 7f9550d45640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f954c15ab10 0x7f954c15af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:39098/0 (socket says 172.21.15.105:39098) 2024-09-21T03:26:04.341 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.338+0000 7f9550d45640 1 -- 172.21.15.105:0/1654231088 learned_addr learned my addr 172.21.15.105:0/1654231088 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:04.341 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.338+0000 7f954b7fe640 1 --2- 172.21.15.105:0/1654231088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f954c15c830 0x7f954c0b7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:04.341 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.338+0000 7f954bfff640 1 --2- 172.21.15.105:0/1654231088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f954c0cff70 0x7f954c1f2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:04.341 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.338+0000 7f9550d45640 1 -- 172.21.15.105:0/1654231088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f954c0cff70 msgr2=0x7f954c1f2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:04.341 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.338+0000 7f9550d45640 1 --2- 172.21.15.105:0/1654231088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f954c0cff70 0x7f954c1f2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:04.341 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.338+0000 7f9550d45640 1 -- 172.21.15.105:0/1654231088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f954c15c830 msgr2=0x7f954c0b7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:04.341 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.338+0000 7f9550d45640 1 --2- 172.21.15.105:0/1654231088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f954c15c830 0x7f954c0b7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:04.341 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.338+0000 7f9550d45640 1 -- 172.21.15.105:0/1654231088 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f954c15b460 con 0x7f954c15ab10 2024-09-21T03:26:04.341 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.338+0000 7f9550d45640 1 --2- 172.21.15.105:0/1654231088 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f954c15ab10 0x7f954c15af20 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f9544006010 tx=0x7f9544032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:04.341 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.338+0000 7f9548ff9640 1 -- 172.21.15.105:0/1654231088 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9544037040 con 0x7f954c15ab10 2024-09-21T03:26:04.342 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.338+0000 7f9548ff9640 1 -- 172.21.15.105:0/1654231088 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9544042070 con 0x7f954c15ab10 2024-09-21T03:26:04.342 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.338+0000 7f95527a8640 1 -- 172.21.15.105:0/1654231088 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f954c1f6c90 con 0x7f954c15ab10 2024-09-21T03:26:04.342 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.338+0000 7f9548ff9640 1 -- 172.21.15.105:0/1654231088 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95440042a0 con 0x7f954c15ab10 2024-09-21T03:26:04.342 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.338+0000 7f95527a8640 1 -- 172.21.15.105:0/1654231088 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f954c1f7250 con 0x7f954c15ab10 2024-09-21T03:26:04.343 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.339+0000 7f95527a8640 1 -- 172.21.15.105:0/1654231088 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f954c160c90 con 0x7f954c15ab10 2024-09-21T03:26:04.343 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.340+0000 7f9548ff9640 1 -- 172.21.15.105:0/1654231088 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9544004440 con 0x7f954c15ab10 2024-09-21T03:26:04.343 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.341+0000 7f9548ff9640 1 --2- 172.21.15.105:0/1654231088 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9538078b90 0x7f953807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:04.343 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.341+0000 7f9548ff9640 1 -- 172.21.15.105:0/1654231088 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7f95440bbb80 con 0x7f954c15ab10 2024-09-21T03:26:04.343 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.341+0000 7f954bfff640 1 --2- 172.21.15.105:0/1654231088 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9538078b90 0x7f953807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:04.343 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.342+0000 7f954bfff640 1 --2- 172.21.15.105:0/1654231088 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9538078b90 0x7f953807b0a0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f953c007fd0 tx=0x7f953c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:04.347 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.346+0000 7f9548ff9640 1 -- 172.21.15.105:0/1654231088 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f954c15b460 con 0x7f954c15ab10 2024-09-21T03:26:04.524 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.522+0000 7f95527a8640 1 -- 172.21.15.105:0/1654231088 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_max_caps_per_client"} v 0) -- 0x7f954c15bf30 con 0x7f954c15ab10 2024-09-21T03:26:04.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.523+0000 7f9548ff9640 1 -- 172.21.15.105:0/1654231088 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_max_caps_per_client"}]=0 v61) ==== 106+0+8 (secure 0 0 0) 0x7f9544083fc0 con 0x7f954c15ab10 2024-09-21T03:26:04.525 INFO:teuthology.orchestra.run.smithi105.stdout:1048576 2024-09-21T03:26:04.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.525+0000 7f95527a8640 1 -- 172.21.15.105:0/1654231088 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9538078b90 msgr2=0x7f953807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:04.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.525+0000 7f95527a8640 1 --2- 172.21.15.105:0/1654231088 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9538078b90 0x7f953807b0a0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f953c007fd0 tx=0x7f953c009040 comp rx=0 tx=0).stop 2024-09-21T03:26:04.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.525+0000 7f95527a8640 1 -- 172.21.15.105:0/1654231088 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f954c15ab10 msgr2=0x7f954c15af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:04.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.525+0000 7f95527a8640 1 --2- 172.21.15.105:0/1654231088 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f954c15ab10 0x7f954c15af20 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f9544006010 tx=0x7f9544032c90 comp rx=0 tx=0).stop 2024-09-21T03:26:04.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.525+0000 7f95527a8640 1 -- 172.21.15.105:0/1654231088 shutdown_connections 2024-09-21T03:26:04.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.525+0000 7f95527a8640 1 --2- 172.21.15.105:0/1654231088 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9538078b90 0x7f953807b0a0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:04.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.525+0000 7f95527a8640 1 --2- 172.21.15.105:0/1654231088 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f954c15ab10 0x7f954c15af20 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:04.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.525+0000 7f95527a8640 1 --2- 172.21.15.105:0/1654231088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f954c15c830 0x7f954c0b7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:04.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.525+0000 7f95527a8640 1 --2- 172.21.15.105:0/1654231088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f954c0cff70 0x7f954c1f2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:04.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.525+0000 7f95527a8640 1 -- 172.21.15.105:0/1654231088 >> 172.21.15.105:0/1654231088 conn(0x7f954c0cee20 msgr2=0x7f954c152730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:04.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.525+0000 7f95527a8640 1 -- 172.21.15.105:0/1654231088 shutdown_connections 2024-09-21T03:26:04.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.525+0000 7f95527a8640 1 -- 172.21.15.105:0/1654231088 wait complete. 2024-09-21T03:26:04.538 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_recall_warning_decay_rate 2024-09-21T03:26:04.654 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.652+0000 7f0a19464640 1 -- 172.21.15.105:0/2100514793 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a00004800 msgr2=0x7f0a00004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:04.654 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.652+0000 7f0a19464640 1 --2- 172.21.15.105:0/2100514793 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a00004800 0x7f0a00004c10 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f09fc009b00 tx=0x7f0a00005830 comp rx=0 tx=0).stop 2024-09-21T03:26:04.654 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.652+0000 7f0a137fe640 1 -- 172.21.15.105:0/2100514793 reap_dead start 2024-09-21T03:26:04.654 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.652+0000 7f0a19464640 1 -- 172.21.15.105:0/2100514793 shutdown_connections 2024-09-21T03:26:04.654 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.652+0000 7f0a19464640 1 -- 172.21.15.105:0/2100514793 >> 172.21.15.105:0/2100514793 conn(0x7f0a1408bfc0 msgr2=0x7f0a1409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:04.654 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.652+0000 7f0a19464640 1 -- 172.21.15.105:0/2100514793 shutdown_connections 2024-09-21T03:26:04.654 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.652+0000 7f0a19464640 1 -- 172.21.15.105:0/2100514793 wait complete. 2024-09-21T03:26:04.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.654+0000 7f0a19464640 1 Processor -- start 2024-09-21T03:26:04.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.654+0000 7f0a19464640 1 -- start start 2024-09-21T03:26:04.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.655+0000 7f0a19464640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a00004800 0x7f0a141f7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:04.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.655+0000 7f0a19464640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a140b2b50 0x7f0a140cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:04.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.655+0000 7f0a19464640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a140cbb00 0x7f0a140cbf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:04.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.655+0000 7f0a19464640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0a140d36c0 con 0x7f0a140cbb00 2024-09-21T03:26:04.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.655+0000 7f0a19464640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0a140d3540 con 0x7f0a00004800 2024-09-21T03:26:04.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.655+0000 7f0a19464640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0a140cf4f0 con 0x7f0a140b2b50 2024-09-21T03:26:04.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.655+0000 7f0a137fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a140cbb00 0x7f0a140cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:04.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.655+0000 7f0a137fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a140cbb00 0x7f0a140cbf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:39124/0 (socket says 172.21.15.105:39124) 2024-09-21T03:26:04.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.655+0000 7f0a137fe640 1 -- 172.21.15.105:0/3545412332 learned_addr learned my addr 172.21.15.105:0/3545412332 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:04.659 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.655+0000 7f0a12ffd640 1 --2- 172.21.15.105:0/3545412332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a00004800 0x7f0a141f7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:04.659 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.655+0000 7f0a0a7fc640 1 --2- 172.21.15.105:0/3545412332 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a140b2b50 0x7f0a140cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:04.659 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.655+0000 7f0a137fe640 1 -- 172.21.15.105:0/3545412332 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a140b2b50 msgr2=0x7f0a140cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:04.659 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.655+0000 7f0a137fe640 1 --2- 172.21.15.105:0/3545412332 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a140b2b50 0x7f0a140cb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:04.659 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.655+0000 7f0a137fe640 1 -- 172.21.15.105:0/3545412332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a00004800 msgr2=0x7f0a141f7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:04.659 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.655+0000 7f0a137fe640 1 --2- 172.21.15.105:0/3545412332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a00004800 0x7f0a141f7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:04.659 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.655+0000 7f0a137fe640 1 -- 172.21.15.105:0/3545412332 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a140b3060 con 0x7f0a140cbb00 2024-09-21T03:26:04.659 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.656+0000 7f0a137fe640 1 --2- 172.21.15.105:0/3545412332 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a140cbb00 0x7f0a140cbf10 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f0a140ba0d0 tx=0x7f0a0c006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:04.659 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.656+0000 7f0a0bfff640 1 -- 172.21.15.105:0/3545412332 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c011900 con 0x7f0a140cbb00 2024-09-21T03:26:04.659 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.656+0000 7f0a0bfff640 1 -- 172.21.15.105:0/3545412332 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a0c018070 con 0x7f0a140cbb00 2024-09-21T03:26:04.659 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.656+0000 7f0a19464640 1 -- 172.21.15.105:0/3545412332 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a140cd640 con 0x7f0a140cbb00 2024-09-21T03:26:04.659 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.656+0000 7f0a0bfff640 1 -- 172.21.15.105:0/3545412332 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c011cc0 con 0x7f0a140cbb00 2024-09-21T03:26:04.660 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.656+0000 7f0a19464640 1 -- 172.21.15.105:0/3545412332 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a140cdc00 con 0x7f0a140cbb00 2024-09-21T03:26:04.660 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.657+0000 7f0a19464640 1 -- 172.21.15.105:0/3545412332 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a1406e170 con 0x7f0a140cbb00 2024-09-21T03:26:04.660 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.657+0000 7f0a0bfff640 1 -- 172.21.15.105:0/3545412332 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0a0c01d460 con 0x7f0a140cbb00 2024-09-21T03:26:04.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.658+0000 7f0a0bfff640 1 --2- 172.21.15.105:0/3545412332 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f09f4078b90 0x7f09f407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:04.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.658+0000 7f0a0bfff640 1 -- 172.21.15.105:0/3545412332 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7f0a0c09b3e0 con 0x7f0a140cbb00 2024-09-21T03:26:04.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.658+0000 7f0a12ffd640 1 --2- 172.21.15.105:0/3545412332 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f09f4078b90 0x7f09f407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:04.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.659+0000 7f0a12ffd640 1 --2- 172.21.15.105:0/3545412332 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f09f4078b90 0x7f09f407b0a0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f0a04001010 tx=0x7f0a04001d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:04.664 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.662+0000 7f0a0bfff640 1 -- 172.21.15.105:0/3545412332 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0a0c0638b0 con 0x7f0a140cbb00 2024-09-21T03:26:04.844 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.842+0000 7f0a19464640 1 -- 172.21.15.105:0/3545412332 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_recall_warning_decay_rate"} v 0) -- 0x7f0a140cecc0 con 0x7f0a140cbb00 2024-09-21T03:26:04.844 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.842+0000 7f0a0bfff640 1 -- 172.21.15.105:0/3545412332 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_recall_warning_decay_rate"}]=0 v61) ==== 112+0+10 (secure 0 0 0) 0x7f0a0c068e20 con 0x7f0a140cbb00 2024-09-21T03:26:04.844 INFO:teuthology.orchestra.run.smithi105.stdout:60.000000 2024-09-21T03:26:04.847 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.845+0000 7f0a19464640 1 -- 172.21.15.105:0/3545412332 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f09f4078b90 msgr2=0x7f09f407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:04.847 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.845+0000 7f0a19464640 1 --2- 172.21.15.105:0/3545412332 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f09f4078b90 0x7f09f407b0a0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f0a04001010 tx=0x7f0a04001d40 comp rx=0 tx=0).stop 2024-09-21T03:26:04.847 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.845+0000 7f0a19464640 1 -- 172.21.15.105:0/3545412332 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a140cbb00 msgr2=0x7f0a140cbf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:04.847 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.845+0000 7f0a19464640 1 --2- 172.21.15.105:0/3545412332 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a140cbb00 0x7f0a140cbf10 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f0a140ba0d0 tx=0x7f0a0c006430 comp rx=0 tx=0).stop 2024-09-21T03:26:04.847 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.845+0000 7f0a19464640 1 -- 172.21.15.105:0/3545412332 shutdown_connections 2024-09-21T03:26:04.847 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.845+0000 7f0a19464640 1 --2- 172.21.15.105:0/3545412332 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f09f4078b90 0x7f09f407b0a0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:04.847 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.845+0000 7f0a19464640 1 --2- 172.21.15.105:0/3545412332 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a140cbb00 0x7f0a140cbf10 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:04.847 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.845+0000 7f0a19464640 1 --2- 172.21.15.105:0/3545412332 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a140b2b50 0x7f0a140cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:04.847 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.845+0000 7f0a19464640 1 --2- 172.21.15.105:0/3545412332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a00004800 0x7f0a141f7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:04.847 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.845+0000 7f0a19464640 1 -- 172.21.15.105:0/3545412332 >> 172.21.15.105:0/3545412332 conn(0x7f0a1408bfc0 msgr2=0x7f0a140b17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:04.847 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.845+0000 7f0a19464640 1 -- 172.21.15.105:0/3545412332 shutdown_connections 2024-09-21T03:26:04.847 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04.845+0000 7f0a19464640 1 -- 172.21.15.105:0/3545412332 wait complete. 2024-09-21T03:26:04.858 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:26:04.858 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:26:04.873 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:26:04.961 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:26:04.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:26:04.969 INFO:teuthology.orchestra.run.smithi105.stdout:client6341 2024-09-21T03:26:04.969 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:26:04.969 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:26:04.985 DEBUG:teuthology.orchestra.run.smithi105:> stdin-killer -- python3 -c ' 2024-09-21T03:26:04.985 DEBUG:teuthology.orchestra.run.smithi105:> import fcntl 2024-09-21T03:26:04.985 DEBUG:teuthology.orchestra.run.smithi105:> import sys 2024-09-21T03:26:04.985 DEBUG:teuthology.orchestra.run.smithi105:> import time 2024-09-21T03:26:04.985 DEBUG:teuthology.orchestra.run.smithi105:> import os 2024-09-21T03:26:04.986 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-21T03:26:04.986 DEBUG:teuthology.orchestra.run.smithi105:> fcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK) 2024-09-21T03:26:04.986 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-21T03:26:04.986 DEBUG:teuthology.orchestra.run.smithi105:> n = 200 2024-09-21T03:26:04.986 DEBUG:teuthology.orchestra.run.smithi105:> abs_path = "/home/ubuntu/cephtest/mnt.0/subdir" 2024-09-21T03:26:04.986 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-21T03:26:04.986 DEBUG:teuthology.orchestra.run.smithi105:> if not os.path.exists(abs_path): 2024-09-21T03:26:04.986 DEBUG:teuthology.orchestra.run.smithi105:> os.makedirs(abs_path) 2024-09-21T03:26:04.986 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-21T03:26:04.986 DEBUG:teuthology.orchestra.run.smithi105:> handles = [] 2024-09-21T03:26:04.986 DEBUG:teuthology.orchestra.run.smithi105:> for i in range(0, n): 2024-09-21T03:26:04.986 DEBUG:teuthology.orchestra.run.smithi105:> fname = "file_"+str(i) 2024-09-21T03:26:04.986 DEBUG:teuthology.orchestra.run.smithi105:> path = os.path.join(abs_path, fname) 2024-09-21T03:26:04.986 DEBUG:teuthology.orchestra.run.smithi105:> handles.append(open(path, '"'"'w'"'"')) 2024-09-21T03:26:04.986 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-21T03:26:04.987 DEBUG:teuthology.orchestra.run.smithi105:> print("waiting with handles open", file=sys.stderr) 2024-09-21T03:26:04.987 DEBUG:teuthology.orchestra.run.smithi105:> while True: 2024-09-21T03:26:04.987 DEBUG:teuthology.orchestra.run.smithi105:> print("open_n_background: keeping files open", file=sys.stderr) 2024-09-21T03:26:04.987 DEBUG:teuthology.orchestra.run.smithi105:> try: 2024-09-21T03:26:04.987 DEBUG:teuthology.orchestra.run.smithi105:> if os.read(0, 4096) == b"": 2024-09-21T03:26:04.987 DEBUG:teuthology.orchestra.run.smithi105:> break 2024-09-21T03:26:04.987 DEBUG:teuthology.orchestra.run.smithi105:> except BlockingIOError: 2024-09-21T03:26:04.987 DEBUG:teuthology.orchestra.run.smithi105:> pass 2024-09-21T03:26:04.987 DEBUG:teuthology.orchestra.run.smithi105:> time.sleep(2) 2024-09-21T03:26:04.987 DEBUG:teuthology.orchestra.run.smithi105:> print("stdin closed, goodbye!", file=sys.stderr) 2024-09-21T03:26:04.987 DEBUG:teuthology.orchestra.run.smithi105:> ' 2024-09-21T03:26:05.027 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:26:05.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.141+0000 7ff423294640 1 -- 172.21.15.105:0/1021004932 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff41c0b6680 msgr2=0x7ff41c0b0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:05.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.141+0000 7ff423294640 1 --2- 172.21.15.105:0/1021004932 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff41c0b6680 0x7ff41c0b0de0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7ff41c072990 tx=0x7ff41802a560 comp rx=0 tx=0).stop 2024-09-21T03:26:05.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.141+0000 7ff423294640 1 -- 172.21.15.105:0/1021004932 shutdown_connections 2024-09-21T03:26:05.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.141+0000 7ff423294640 1 --2- 172.21.15.105:0/1021004932 >> v2:172.21.15.162:3300/0 conn(0x7ff41c162f60 0x7ff41c165380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:05.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.141+0000 7ff423294640 1 --2- 172.21.15.105:0/1021004932 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff41c0b6680 0x7ff41c0b0de0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:05.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.141+0000 7ff423294640 1 -- 172.21.15.105:0/1021004932 >> 172.21.15.105:0/1021004932 conn(0x7ff41c0d12a0 msgr2=0x7ff41c0d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:05.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.141+0000 7ff423294640 1 -- 172.21.15.105:0/1021004932 shutdown_connections 2024-09-21T03:26:05.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.142+0000 7ff423294640 1 -- 172.21.15.105:0/1021004932 wait complete. 2024-09-21T03:26:05.145 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.143+0000 7ff423294640 1 Processor -- start 2024-09-21T03:26:05.145 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.143+0000 7ff423294640 1 -- start start 2024-09-21T03:26:05.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.145+0000 7ff423294640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff41c0b6100 0x7ff41c0c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:05.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.145+0000 7ff423294640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff41c0b6680 0x7ff41c1535a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:05.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.145+0000 7ff423294640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff41c162f60 0x7ff41c0cc540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:05.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.145+0000 7ff423294640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff41c165a40 con 0x7ff41c0b6100 2024-09-21T03:26:05.148 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.145+0000 7ff423294640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff41c1658c0 con 0x7ff41c162f60 2024-09-21T03:26:05.148 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.145+0000 7ff423294640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff41c165bc0 con 0x7ff41c0b6680 2024-09-21T03:26:05.148 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.145+0000 7ff421030640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff41c0b6100 0x7ff41c0c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:05.148 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.145+0000 7ff421030640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff41c0b6100 0x7ff41c0c9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:39130/0 (socket says 172.21.15.105:39130) 2024-09-21T03:26:05.148 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.145+0000 7ff421030640 1 -- 172.21.15.105:0/2352283466 learned_addr learned my addr 172.21.15.105:0/2352283466 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:05.148 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.145+0000 7ff421831640 1 --2- 172.21.15.105:0/2352283466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff41c162f60 0x7ff41c0cc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:05.148 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.145+0000 7ff42082f640 1 --2- 172.21.15.105:0/2352283466 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff41c0b6680 0x7ff41c1535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:05.148 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.145+0000 7ff421030640 1 -- 172.21.15.105:0/2352283466 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff41c0b6680 msgr2=0x7ff41c1535a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:05.148 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.145+0000 7ff421030640 1 --2- 172.21.15.105:0/2352283466 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff41c0b6680 0x7ff41c1535a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:05.148 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.145+0000 7ff421030640 1 -- 172.21.15.105:0/2352283466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff41c162f60 msgr2=0x7ff41c0cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:05.148 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.145+0000 7ff421030640 1 --2- 172.21.15.105:0/2352283466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff41c162f60 0x7ff41c0cc540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:05.148 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.145+0000 7ff421030640 1 -- 172.21.15.105:0/2352283466 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff41c09f1e0 con 0x7ff41c0b6100 2024-09-21T03:26:05.148 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.145+0000 7ff421030640 1 --2- 172.21.15.105:0/2352283466 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff41c0b6100 0x7ff41c0c9db0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7ff4180099d0 tx=0x7ff4180052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:05.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.145+0000 7ff411ffb640 1 -- 172.21.15.105:0/2352283466 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff418005cf0 con 0x7ff41c0b6100 2024-09-21T03:26:05.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.145+0000 7ff411ffb640 1 -- 172.21.15.105:0/2352283466 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff418031c40 con 0x7ff41c0b6100 2024-09-21T03:26:05.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.145+0000 7ff411ffb640 1 -- 172.21.15.105:0/2352283466 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff418033330 con 0x7ff41c0b6100 2024-09-21T03:26:05.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.145+0000 7ff423294640 1 -- 172.21.15.105:0/2352283466 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff41c09e940 con 0x7ff41c0b6100 2024-09-21T03:26:05.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.146+0000 7ff423294640 1 -- 172.21.15.105:0/2352283466 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff41c09ef00 con 0x7ff41c0b6100 2024-09-21T03:26:05.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.147+0000 7ff423294640 1 -- 172.21.15.105:0/2352283466 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff41c0b0de0 con 0x7ff41c0b6100 2024-09-21T03:26:05.150 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.148+0000 7ff411ffb640 1 -- 172.21.15.105:0/2352283466 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff4180334d0 con 0x7ff41c0b6100 2024-09-21T03:26:05.150 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.149+0000 7ff411ffb640 1 --2- 172.21.15.105:0/2352283466 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff400078bc0 0x7ff40007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:05.150 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.149+0000 7ff411ffb640 1 -- 172.21.15.105:0/2352283466 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7ff4180bc520 con 0x7ff41c0b6100 2024-09-21T03:26:05.151 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.149+0000 7ff42082f640 1 --2- 172.21.15.105:0/2352283466 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff400078bc0 0x7ff40007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:05.151 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.150+0000 7ff42082f640 1 --2- 172.21.15.105:0/2352283466 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff400078bc0 0x7ff40007b0d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ff41c070cd0 tx=0x7ff40c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:05.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.153+0000 7ff411ffb640 1 -- 172.21.15.105:0/2352283466 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff418051020 con 0x7ff41c0b6100 2024-09-21T03:26:05.239 INFO:teuthology.orchestra.run.smithi105.stderr:waiting with handles open 2024-09-21T03:26:05.240 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:26:05.404 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.403+0000 7ff423294640 1 -- 172.21.15.105:0/2352283466 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff41c0b5d20 con 0x7ff41c0b6100 2024-09-21T03:26:05.405 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.403+0000 7ff411ffb640 1 -- 172.21.15.105:0/2352283466 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) ==== 94+0+5237 (secure 0 0 0) 0x7ff41803f030 con 0x7ff41c0b6100 2024-09-21T03:26:05.405 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:26:05.405 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":73,"btime":"2024-09-21T03:25:53:258473+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6233,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/2073653576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2073653576},{"type":"v1","addr":"172.21.15.162:6837","nonce":2073653576}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":70},{"gid":6850,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2714893724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2714893724},{"type":"v1","addr":"172.21.15.162:6836","nonce":2714893724}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":70},{"gid":7590,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/2972986125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2972986125},{"type":"v1","addr":"172.21.15.105:6834","nonce":2972986125}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":70}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:25:50.598171+0000","modified":"2024-09-21T03:25:52.613928+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7593":{"gid":7593,"name":"a","rank":0,"incarnation":71,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/3941149960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":3941149960},{"type":"v1","addr":"172.21.15.105:6835","nonce":3941149960}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7593,"qdb_cluster":[7593]},"id":9}]} 2024-09-21T03:26:05.405 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 73 2024-09-21T03:26:05.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.405+0000 7ff423294640 1 -- 172.21.15.105:0/2352283466 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff400078bc0 msgr2=0x7ff40007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:05.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.405+0000 7ff423294640 1 --2- 172.21.15.105:0/2352283466 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff400078bc0 0x7ff40007b0d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ff41c070cd0 tx=0x7ff40c009040 comp rx=0 tx=0).stop 2024-09-21T03:26:05.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.405+0000 7ff423294640 1 -- 172.21.15.105:0/2352283466 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff41c0b6100 msgr2=0x7ff41c0c9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:05.407 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.405+0000 7ff423294640 1 --2- 172.21.15.105:0/2352283466 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff41c0b6100 0x7ff41c0c9db0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7ff4180099d0 tx=0x7ff4180052f0 comp rx=0 tx=0).stop 2024-09-21T03:26:05.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.405+0000 7ff423294640 1 -- 172.21.15.105:0/2352283466 shutdown_connections 2024-09-21T03:26:05.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.405+0000 7ff423294640 1 --2- 172.21.15.105:0/2352283466 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff400078bc0 0x7ff40007b0d0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:05.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.405+0000 7ff423294640 1 --2- 172.21.15.105:0/2352283466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff41c162f60 0x7ff41c0cc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:05.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.405+0000 7ff423294640 1 --2- 172.21.15.105:0/2352283466 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff41c0b6680 0x7ff41c1535a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:05.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.405+0000 7ff423294640 1 --2- 172.21.15.105:0/2352283466 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff41c0b6100 0x7ff41c0c9db0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:05.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.405+0000 7ff423294640 1 -- 172.21.15.105:0/2352283466 >> 172.21.15.105:0/2352283466 conn(0x7ff41c0d12a0 msgr2=0x7ff41c06ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:05.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.405+0000 7ff423294640 1 -- 172.21.15.105:0/2352283466 shutdown_connections 2024-09-21T03:26:05.408 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.405+0000 7ff423294640 1 -- 172.21.15.105:0/2352283466 wait complete. 2024-09-21T03:26:05.418 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-21T03:26:05.544 INFO:teuthology.orchestra.run.smithi105.stdout:[{"id":7788,"entity":{"name":{"type":"client","num":7788},"addr":{"type":"v1","addr":"172.21.15.162:0","nonce":3437489813}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":3.0759373600000002,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.9908906171884437,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.7788 v1:172.21.15.162:0/3437489813","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi162","kernel_version":"5.14.0-508.el9.x86_64","root":"/"}},{"id":6341,"entity":{"name":{"type":"client","num":6341},"addr":{"type":"v1","addr":"172.21.15.105:0","nonce":330640395}},"state":"open","num_leases":1,"num_caps":202,"request_load_avg":226,"uptime":4.2039143899999996,"requests_in_flight":200,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":99.665546231265552,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":87.458505652355413,"halflife":1.5},"recall_caps_throttle2o":{"value":66.89692535985769,"halflife":0.5},"session_cache_liveness":{"value":404.64976062411557,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":29,"last_trim_completed_flushes_tid":0,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.6341 v1:172.21.15.105:0/330640395","completed_requests":[],"prealloc_inos":[{"start":"0x10000000001","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi105","kernel_version":"5.14.0-508.el9.x86_64","root":"/"}}] 2024-09-21T03:26:05.544 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi162", "kernel_version": "5.14.0-508.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.162:0", "nonce": 3437489813, "type": "v1" }, "name": { "num": 7788, "type": "client" } }, "id": 7788, "inst": "client.7788 v1:172.21.15.162:0/3437489813", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.9908906171884437 }, "state": "open", "uptime": 3.07593736 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi105", "kernel_version": "5.14.0-508.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "172.21.15.105:0", "nonce": 330640395, "type": "v1" }, "name": { "num": 6341, "type": "client" } }, "id": 6341, "inst": "client.6341 v1:172.21.15.105:0/330640395", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 29, "num_caps": 202, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 1000, "start": "0x10000000001" } ], "recall_caps": { "halflife": 60, "value": 99.66554623126555 }, "recall_caps_throttle": { "halflife": 1.5, "value": 87.45850565235541 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 66.89692535985769 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 226, "requests_in_flight": 200, "session_cache_liveness": { "halflife": 300, "value": 404.6497606241156 }, "state": "open", "uptime": 4.20391439 } ] 2024-09-21T03:26:05.545 INFO:tasks.ceph_test_case:waiting 120.0s for health warning matching MDS_CLIENT_RECALL 2024-09-21T03:26:05.545 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T03:26:05.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.654+0000 7efe8952b640 1 -- 172.21.15.105:0/1646687221 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe6c004000 msgr2=0x7efe6c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:05.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.654+0000 7efe8952b640 1 --2- 172.21.15.105:0/1646687221 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe6c004000 0x7efe6c004800 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7efe7800c2e0 tx=0x7efe6c005830 comp rx=0 tx=0).stop 2024-09-21T03:26:05.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.654+0000 7efe837fe640 1 -- 172.21.15.105:0/1646687221 reap_dead start 2024-09-21T03:26:05.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.654+0000 7efe8952b640 1 -- 172.21.15.105:0/1646687221 shutdown_connections 2024-09-21T03:26:05.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.654+0000 7efe8952b640 1 -- 172.21.15.105:0/1646687221 >> 172.21.15.105:0/1646687221 conn(0x7efe84072ae0 msgr2=0x7efe84072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:05.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.654+0000 7efe8952b640 1 -- 172.21.15.105:0/1646687221 shutdown_connections 2024-09-21T03:26:05.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.654+0000 7efe8952b640 1 -- 172.21.15.105:0/1646687221 wait complete. 2024-09-21T03:26:05.657 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.656+0000 7efe8952b640 1 Processor -- start 2024-09-21T03:26:05.657 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.656+0000 7efe8952b640 1 -- start start 2024-09-21T03:26:05.660 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.657+0000 7efe8952b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe6c004000 0x7efe841f30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:05.660 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.657+0000 7efe8952b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe841f3600 0x7efe840cb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:05.660 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.657+0000 7efe8952b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe840cb970 0x7efe840ac4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:05.660 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.657+0000 7efe8952b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efe8415c860 con 0x7efe841f3600 2024-09-21T03:26:05.660 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.657+0000 7efe8952b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efe8415c6e0 con 0x7efe840cb970 2024-09-21T03:26:05.660 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.657+0000 7efe8952b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7efe8415c9e0 con 0x7efe6c004000 2024-09-21T03:26:05.660 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.657+0000 7efe827fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe841f3600 0x7efe840cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:05.660 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.657+0000 7efe827fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe841f3600 0x7efe840cb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:39142/0 (socket says 172.21.15.105:39142) 2024-09-21T03:26:05.660 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.657+0000 7efe827fc640 1 -- 172.21.15.105:0/1457323360 learned_addr learned my addr 172.21.15.105:0/1457323360 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:05.660 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.657+0000 7efe82ffd640 1 --2- 172.21.15.105:0/1457323360 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe6c004000 0x7efe841f30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:05.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.657+0000 7efe837fe640 1 --2- 172.21.15.105:0/1457323360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe840cb970 0x7efe840ac4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:05.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.657+0000 7efe827fc640 1 -- 172.21.15.105:0/1457323360 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe6c004000 msgr2=0x7efe841f30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:05.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.657+0000 7efe827fc640 1 --2- 172.21.15.105:0/1457323360 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe6c004000 0x7efe841f30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:05.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.657+0000 7efe827fc640 1 -- 172.21.15.105:0/1457323360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe840cb970 msgr2=0x7efe840ac4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:05.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.657+0000 7efe827fc640 1 --2- 172.21.15.105:0/1457323360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe840cb970 0x7efe840ac4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:05.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.657+0000 7efe827fc640 1 -- 172.21.15.105:0/1457323360 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe8414f700 con 0x7efe841f3600 2024-09-21T03:26:05.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.657+0000 7efe82ffd640 1 --2- 172.21.15.105:0/1457323360 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe6c004000 0x7efe841f30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:26:05.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.657+0000 7efe837fe640 1 --2- 172.21.15.105:0/1457323360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe840cb970 0x7efe840ac4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:26:05.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.658+0000 7efe827fc640 1 --2- 172.21.15.105:0/1457323360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe841f3600 0x7efe840cb430 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7efe7802b130 tx=0x7efe78004bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:05.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.658+0000 7efe6b7fe640 1 -- 172.21.15.105:0/1457323360 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe78031040 con 0x7efe841f3600 2024-09-21T03:26:05.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.658+0000 7efe6b7fe640 1 -- 172.21.15.105:0/1457323360 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe78006420 con 0x7efe841f3600 2024-09-21T03:26:05.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.658+0000 7efe6b7fe640 1 -- 172.21.15.105:0/1457323360 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe78006c70 con 0x7efe841f3600 2024-09-21T03:26:05.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.658+0000 7efe8952b640 1 -- 172.21.15.105:0/1457323360 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe840ab710 con 0x7efe841f3600 2024-09-21T03:26:05.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.658+0000 7efe8952b640 1 -- 172.21.15.105:0/1457323360 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe840abcd0 con 0x7efe841f3600 2024-09-21T03:26:05.662 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.659+0000 7efe8952b640 1 -- 172.21.15.105:0/1457323360 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe840cebf0 con 0x7efe841f3600 2024-09-21T03:26:05.662 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.659+0000 7efe6b7fe640 1 -- 172.21.15.105:0/1457323360 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efe78034070 con 0x7efe841f3600 2024-09-21T03:26:05.662 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.660+0000 7efe6b7fe640 1 --2- 172.21.15.105:0/1457323360 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efe70078b90 0x7efe7007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:05.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.660+0000 7efe6b7fe640 1 -- 172.21.15.105:0/1457323360 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7efe780bb010 con 0x7efe841f3600 2024-09-21T03:26:05.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.660+0000 7efe82ffd640 1 --2- 172.21.15.105:0/1457323360 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efe70078b90 0x7efe7007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:05.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.661+0000 7efe82ffd640 1 --2- 172.21.15.105:0/1457323360 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efe70078b90 0x7efe7007b0a0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7efe74009b40 tx=0x7efe74005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:05.666 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.664+0000 7efe6b7fe640 1 -- 172.21.15.105:0/1457323360 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7efe78083450 con 0x7efe841f3600 2024-09-21T03:26:05.881 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.879+0000 7efe8952b640 1 -- 172.21.15.105:0/1457323360 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7efe8415fa10 con 0x7efe841f3600 2024-09-21T03:26:05.881 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.879+0000 7efe6b7fe640 1 -- 172.21.15.105:0/1457323360 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7efe78082d50 con 0x7efe841f3600 2024-09-21T03:26:05.881 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:26:05.881 INFO:teuthology.orchestra.run.smithi105.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T03:26:05.883 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.881+0000 7efe8952b640 1 -- 172.21.15.105:0/1457323360 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efe70078b90 msgr2=0x7efe7007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:05.883 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.881+0000 7efe8952b640 1 --2- 172.21.15.105:0/1457323360 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efe70078b90 0x7efe7007b0a0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7efe74009b40 tx=0x7efe74005f90 comp rx=0 tx=0).stop 2024-09-21T03:26:05.883 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.881+0000 7efe8952b640 1 -- 172.21.15.105:0/1457323360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe841f3600 msgr2=0x7efe840cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:05.884 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.881+0000 7efe8952b640 1 --2- 172.21.15.105:0/1457323360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe841f3600 0x7efe840cb430 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7efe7802b130 tx=0x7efe78004bc0 comp rx=0 tx=0).stop 2024-09-21T03:26:05.884 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.881+0000 7efe8952b640 1 -- 172.21.15.105:0/1457323360 shutdown_connections 2024-09-21T03:26:05.884 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.881+0000 7efe8952b640 1 --2- 172.21.15.105:0/1457323360 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efe70078b90 0x7efe7007b0a0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:05.884 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.881+0000 7efe8952b640 1 --2- 172.21.15.105:0/1457323360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe840cb970 0x7efe840ac4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:05.884 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.881+0000 7efe8952b640 1 --2- 172.21.15.105:0/1457323360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe841f3600 0x7efe840cb430 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:05.884 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.881+0000 7efe8952b640 1 --2- 172.21.15.105:0/1457323360 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe6c004000 0x7efe841f30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:05.884 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.881+0000 7efe8952b640 1 -- 172.21.15.105:0/1457323360 >> 172.21.15.105:0/1457323360 conn(0x7efe84072ae0 msgr2=0x7efe840b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:05.884 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.881+0000 7efe8952b640 1 -- 172.21.15.105:0/1457323360 shutdown_connections 2024-09-21T03:26:05.884 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:05.882+0000 7efe8952b640 1 -- 172.21.15.105:0/1457323360 wait complete. 2024-09-21T03:26:05.894 DEBUG:tasks.ceph_test_case:Not expected number of summary strings ([]) 2024-09-21T03:26:05.894 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-21T03:26:07.242 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:26:09.244 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:26:10.895 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T03:26:11.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.019+0000 7fc65613a640 1 -- 172.21.15.105:0/1090391793 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc65015bf20 msgr2=0x7fc6500ca9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:11.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.019+0000 7fc65613a640 1 --2- 172.21.15.105:0/1090391793 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc65015bf20 0x7fc6500ca9a0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7fc638009900 tx=0x7fc63802a610 comp rx=0 tx=0).stop 2024-09-21T03:26:11.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.019+0000 7fc65613a640 1 -- 172.21.15.105:0/1090391793 shutdown_connections 2024-09-21T03:26:11.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.019+0000 7fc65613a640 1 --2- 172.21.15.105:0/1090391793 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc6500caee0 0x7fc65006ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:11.021 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.019+0000 7fc65613a640 1 --2- 172.21.15.105:0/1090391793 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc65015bf20 0x7fc6500ca9a0 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:11.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.019+0000 7fc65613a640 1 -- 172.21.15.105:0/1090391793 >> 172.21.15.105:0/1090391793 conn(0x7fc6500b1cb0 msgr2=0x7fc6500b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:11.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.019+0000 7fc65613a640 1 -- 172.21.15.105:0/1090391793 shutdown_connections 2024-09-21T03:26:11.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.019+0000 7fc65613a640 1 -- 172.21.15.105:0/1090391793 wait complete. 2024-09-21T03:26:11.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.021+0000 7fc65613a640 1 Processor -- start 2024-09-21T03:26:11.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.021+0000 7fc65613a640 1 -- start start 2024-09-21T03:26:11.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.022+0000 7fc65613a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc6500caee0 0x7fc65009d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:11.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.022+0000 7fc65613a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6500cfb00 0x7fc6500c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:11.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.022+0000 7fc65613a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc65015bf20 0x7fc6500c4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:11.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.022+0000 7fc65613a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc65006f3d0 con 0x7fc6500cfb00 2024-09-21T03:26:11.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.022+0000 7fc65613a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc65006f550 con 0x7fc65015bf20 2024-09-21T03:26:11.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.022+0000 7fc65613a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc65006f6d0 con 0x7fc6500caee0 2024-09-21T03:26:11.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.022+0000 7fc64effd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6500cfb00 0x7fc6500c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:11.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.022+0000 7fc64effd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6500cfb00 0x7fc6500c5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:39170/0 (socket says 172.21.15.105:39170) 2024-09-21T03:26:11.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.022+0000 7fc64effd640 1 -- 172.21.15.105:0/2675154293 learned_addr learned my addr 172.21.15.105:0/2675154293 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:11.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.023+0000 7fc64f7fe640 1 --2- 172.21.15.105:0/2675154293 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc6500caee0 0x7fc65009d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:11.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.023+0000 7fc64ffff640 1 --2- 172.21.15.105:0/2675154293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc65015bf20 0x7fc6500c4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:11.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.023+0000 7fc64effd640 1 -- 172.21.15.105:0/2675154293 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc6500caee0 msgr2=0x7fc65009d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:11.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.023+0000 7fc64effd640 1 --2- 172.21.15.105:0/2675154293 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc6500caee0 0x7fc65009d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:11.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.023+0000 7fc64effd640 1 -- 172.21.15.105:0/2675154293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc65015bf20 msgr2=0x7fc6500c4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:11.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.023+0000 7fc64effd640 1 --2- 172.21.15.105:0/2675154293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc65015bf20 0x7fc6500c4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:11.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.023+0000 7fc64effd640 1 -- 172.21.15.105:0/2675154293 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6500c9b80 con 0x7fc6500cfb00 2024-09-21T03:26:11.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.023+0000 7fc64ffff640 1 --2- 172.21.15.105:0/2675154293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc65015bf20 0x7fc6500c4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:26:11.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.023+0000 7fc64effd640 1 --2- 172.21.15.105:0/2675154293 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6500cfb00 0x7fc6500c5f40 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fc638034040 tx=0x7fc6380038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:11.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.023+0000 7fc647fff640 1 -- 172.21.15.105:0/2675154293 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc638035040 con 0x7fc6500cfb00 2024-09-21T03:26:11.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.023+0000 7fc647fff640 1 -- 172.21.15.105:0/2675154293 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc638005600 con 0x7fc6500cfb00 2024-09-21T03:26:11.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.023+0000 7fc65613a640 1 -- 172.21.15.105:0/2675154293 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6501511d0 con 0x7fc6500cfb00 2024-09-21T03:26:11.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.023+0000 7fc647fff640 1 -- 172.21.15.105:0/2675154293 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc638003ea0 con 0x7fc6500cfb00 2024-09-21T03:26:11.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.023+0000 7fc65613a640 1 -- 172.21.15.105:0/2675154293 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc65009cce0 con 0x7fc6500cfb00 2024-09-21T03:26:11.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.024+0000 7fc65613a640 1 -- 172.21.15.105:0/2675154293 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6500b2310 con 0x7fc6500cfb00 2024-09-21T03:26:11.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.025+0000 7fc647fff640 1 -- 172.21.15.105:0/2675154293 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc638004a00 con 0x7fc6500cfb00 2024-09-21T03:26:11.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.025+0000 7fc647fff640 1 --2- 172.21.15.105:0/2675154293 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc630078b90 0x7fc63007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:11.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.025+0000 7fc647fff640 1 -- 172.21.15.105:0/2675154293 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5767+0+0 (secure 0 0 0) 0x7fc6380bd390 con 0x7fc6500cfb00 2024-09-21T03:26:11.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.026+0000 7fc64f7fe640 1 --2- 172.21.15.105:0/2675154293 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc630078b90 0x7fc63007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:11.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.026+0000 7fc64f7fe640 1 --2- 172.21.15.105:0/2675154293 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc630078b90 0x7fc63007b0a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc640001720 tx=0x7fc640009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:11.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.030+0000 7fc647fff640 1 -- 172.21.15.105:0/2675154293 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc6380858b0 con 0x7fc6500cfb00 2024-09-21T03:26:11.243 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.241+0000 7fc65613a640 1 -- 172.21.15.105:0/2675154293 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc65014de20 con 0x7fc6500cfb00 2024-09-21T03:26:11.243 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.242+0000 7fc647fff640 1 -- 172.21.15.105:0/2675154293 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7fc63808ae20 con 0x7fc6500cfb00 2024-09-21T03:26:11.244 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:26:11.244 INFO:teuthology.orchestra.run.smithi105.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-21T03:26:11.246 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.244+0000 7fc65613a640 1 -- 172.21.15.105:0/2675154293 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc630078b90 msgr2=0x7fc63007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:11.246 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.244+0000 7fc65613a640 1 --2- 172.21.15.105:0/2675154293 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc630078b90 0x7fc63007b0a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc640001720 tx=0x7fc640009040 comp rx=0 tx=0).stop 2024-09-21T03:26:11.246 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.244+0000 7fc65613a640 1 -- 172.21.15.105:0/2675154293 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6500cfb00 msgr2=0x7fc6500c5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:11.246 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.244+0000 7fc65613a640 1 --2- 172.21.15.105:0/2675154293 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6500cfb00 0x7fc6500c5f40 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fc638034040 tx=0x7fc6380038a0 comp rx=0 tx=0).stop 2024-09-21T03:26:11.246 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.244+0000 7fc65613a640 1 -- 172.21.15.105:0/2675154293 shutdown_connections 2024-09-21T03:26:11.246 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.244+0000 7fc65613a640 1 --2- 172.21.15.105:0/2675154293 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc630078b90 0x7fc63007b0a0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:11.246 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.244+0000 7fc65613a640 1 --2- 172.21.15.105:0/2675154293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc65015bf20 0x7fc6500c4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:11.247 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:26:11.247 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.244+0000 7fc65613a640 1 --2- 172.21.15.105:0/2675154293 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6500cfb00 0x7fc6500c5f40 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:11.247 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.244+0000 7fc65613a640 1 --2- 172.21.15.105:0/2675154293 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc6500caee0 0x7fc65009d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:11.247 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.244+0000 7fc65613a640 1 -- 172.21.15.105:0/2675154293 >> 172.21.15.105:0/2675154293 conn(0x7fc6500b1cb0 msgr2=0x7fc6500ae0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:11.248 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.244+0000 7fc65613a640 1 -- 172.21.15.105:0/2675154293 shutdown_connections 2024-09-21T03:26:11.248 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:11.244+0000 7fc65613a640 1 -- 172.21.15.105:0/2675154293 wait complete. 2024-09-21T03:26:11.257 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-21T03:26:11.257 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-21T03:26:13.248 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:26:15.250 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:26:16.258 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T03:26:16.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.382+0000 7f4cb0158640 1 -- 172.21.15.105:0/705419761 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c94004800 msgr2=0x7f4c94004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:16.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.382+0000 7f4cb0158640 1 --2- 172.21.15.105:0/705419761 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c94004800 0x7f4c94004c10 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f4c980016c0 tx=0x7f4c94005830 comp rx=0 tx=0).stop 2024-09-21T03:26:16.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.382+0000 7f4cb0158640 1 -- 172.21.15.105:0/705419761 shutdown_connections 2024-09-21T03:26:16.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.382+0000 7f4cb0158640 1 --2- 172.21.15.105:0/705419761 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c94004800 0x7f4c94004c10 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:16.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.382+0000 7f4cb0158640 1 -- 172.21.15.105:0/705419761 >> 172.21.15.105:0/705419761 conn(0x7f4ca80b2160 msgr2=0x7f4ca80b2570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:16.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.382+0000 7f4cb0158640 1 -- 172.21.15.105:0/705419761 shutdown_connections 2024-09-21T03:26:16.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.382+0000 7f4cb0158640 1 -- 172.21.15.105:0/705419761 wait complete. 2024-09-21T03:26:16.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.384+0000 7f4cb0158640 1 Processor -- start 2024-09-21T03:26:16.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.384+0000 7f4cb0158640 1 -- start start 2024-09-21T03:26:16.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.385+0000 7f4cb0158640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c94004800 0x7f4ca8141f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:16.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.385+0000 7f4cb0158640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ca815c040 0x7f4ca815b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:16.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.385+0000 7f4cb0158640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ca813e090 0x7f4ca813e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:16.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.385+0000 7f4cb0158640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca80cf640 con 0x7f4ca813e090 2024-09-21T03:26:16.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.385+0000 7f4cb0158640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca80cdb90 con 0x7f4c94004800 2024-09-21T03:26:16.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.385+0000 7f4cb0158640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4ca8073280 con 0x7f4ca815c040 2024-09-21T03:26:16.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.385+0000 7f4cae6f5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ca813e090 0x7f4ca813e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:16.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.385+0000 7f4cae6f5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ca813e090 0x7f4ca813e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:37654/0 (socket says 172.21.15.105:37654) 2024-09-21T03:26:16.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.385+0000 7f4cae6f5640 1 -- 172.21.15.105:0/187516666 learned_addr learned my addr 172.21.15.105:0/187516666 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:16.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.385+0000 7f4cadef4640 1 --2- 172.21.15.105:0/187516666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c94004800 0x7f4ca8141f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:16.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.385+0000 7f4cad6f3640 1 --2- 172.21.15.105:0/187516666 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ca815c040 0x7f4ca815b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:16.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.385+0000 7f4cae6f5640 1 -- 172.21.15.105:0/187516666 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ca815c040 msgr2=0x7f4ca815b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:16.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.385+0000 7f4cae6f5640 1 --2- 172.21.15.105:0/187516666 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ca815c040 0x7f4ca815b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:16.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.385+0000 7f4cae6f5640 1 -- 172.21.15.105:0/187516666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c94004800 msgr2=0x7f4ca8141f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:16.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.385+0000 7f4cae6f5640 1 --2- 172.21.15.105:0/187516666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c94004800 0x7f4ca8141f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:16.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.385+0000 7f4cae6f5640 1 -- 172.21.15.105:0/187516666 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca813e9e0 con 0x7f4ca813e090 2024-09-21T03:26:16.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.386+0000 7f4cae6f5640 1 --2- 172.21.15.105:0/187516666 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ca813e090 0x7f4ca813e4a0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0000f80 tx=0x7f4ca0006420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:16.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.386+0000 7f4c9e7fc640 1 -- 172.21.15.105:0/187516666 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca0011930 con 0x7f4ca813e090 2024-09-21T03:26:16.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.386+0000 7f4c9e7fc640 1 -- 172.21.15.105:0/187516666 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ca0017070 con 0x7f4ca813e090 2024-09-21T03:26:16.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.386+0000 7f4cb0158640 1 -- 172.21.15.105:0/187516666 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ca815bcf0 con 0x7f4ca813e090 2024-09-21T03:26:16.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.386+0000 7f4c9e7fc640 1 -- 172.21.15.105:0/187516666 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca0011e60 con 0x7f4ca813e090 2024-09-21T03:26:16.389 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.386+0000 7f4cb0158640 1 -- 172.21.15.105:0/187516666 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ca8070a90 con 0x7f4ca813e090 2024-09-21T03:26:16.390 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.387+0000 7f4cb0158640 1 -- 172.21.15.105:0/187516666 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ca81426c0 con 0x7f4ca813e090 2024-09-21T03:26:16.390 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.388+0000 7f4c9e7fc640 1 -- 172.21.15.105:0/187516666 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4ca001c460 con 0x7f4ca813e090 2024-09-21T03:26:16.390 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.388+0000 7f4c9e7fc640 1 --2- 172.21.15.105:0/187516666 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4c8c078b90 0x7f4c8c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:16.390 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.388+0000 7f4c9e7fc640 1 -- 172.21.15.105:0/187516666 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5767+0+0 (secure 0 0 0) 0x7f4ca009b6b0 con 0x7f4ca813e090 2024-09-21T03:26:16.391 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.388+0000 7f4cadef4640 1 --2- 172.21.15.105:0/187516666 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4c8c078b90 0x7f4c8c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:16.391 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.389+0000 7f4cadef4640 1 --2- 172.21.15.105:0/187516666 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4c8c078b90 0x7f4c8c07b0a0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4009cd0 tx=0x7f4ca4005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:16.394 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.393+0000 7f4c9e7fc640 1 -- 172.21.15.105:0/187516666 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4ca813e9e0 con 0x7f4ca813e090 2024-09-21T03:26:16.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.608+0000 7f4cb0158640 1 -- 172.21.15.105:0/187516666 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4ca8076820 con 0x7f4ca813e090 2024-09-21T03:26:16.610 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.609+0000 7f4c9e7fc640 1 -- 172.21.15.105:0/187516666 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+316 (secure 0 0 0) 0x7f4ca8076820 con 0x7f4ca813e090 2024-09-21T03:26:16.610 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:26:16.611 INFO:teuthology.orchestra.run.smithi105.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false},"MDS_CLIENT_RECALL":{"severity":"HEALTH_WARN","summary":{"message":"1 clients failing to respond to cache pressure","count":1},"muted":false}},"mutes":[]} 2024-09-21T03:26:16.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.611+0000 7f4cb0158640 1 -- 172.21.15.105:0/187516666 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4c8c078b90 msgr2=0x7f4c8c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:16.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.611+0000 7f4cb0158640 1 --2- 172.21.15.105:0/187516666 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4c8c078b90 0x7f4c8c07b0a0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4009cd0 tx=0x7f4ca4005f90 comp rx=0 tx=0).stop 2024-09-21T03:26:16.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.611+0000 7f4cb0158640 1 -- 172.21.15.105:0/187516666 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ca813e090 msgr2=0x7f4ca813e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:16.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.611+0000 7f4cb0158640 1 --2- 172.21.15.105:0/187516666 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ca813e090 0x7f4ca813e4a0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0000f80 tx=0x7f4ca0006420 comp rx=0 tx=0).stop 2024-09-21T03:26:16.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.611+0000 7f4cb0158640 1 -- 172.21.15.105:0/187516666 shutdown_connections 2024-09-21T03:26:16.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.611+0000 7f4cb0158640 1 --2- 172.21.15.105:0/187516666 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4c8c078b90 0x7f4c8c07b0a0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:16.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.611+0000 7f4cb0158640 1 --2- 172.21.15.105:0/187516666 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ca813e090 0x7f4ca813e4a0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:16.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.611+0000 7f4cb0158640 1 --2- 172.21.15.105:0/187516666 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ca815c040 0x7f4ca815b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:16.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.611+0000 7f4cb0158640 1 --2- 172.21.15.105:0/187516666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c94004800 0x7f4ca8141f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:16.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.611+0000 7f4cb0158640 1 -- 172.21.15.105:0/187516666 >> 172.21.15.105:0/187516666 conn(0x7f4ca80b2160 msgr2=0x7f4ca815cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:16.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.611+0000 7f4cb0158640 1 -- 172.21.15.105:0/187516666 shutdown_connections 2024-09-21T03:26:16.613 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.611+0000 7f4cb0158640 1 -- 172.21.15.105:0/187516666 wait complete. 2024-09-21T03:26:16.624 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2024-09-21T03:26:16.624 INFO:tasks.ceph_test_case:waiting 120.0s for health warning matching MDS_CACHE_OVERSIZED 2024-09-21T03:26:16.624 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T03:26:16.735 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.734+0000 7f8e7d0de640 1 -- 172.21.15.105:0/2059553676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e780cd360 msgr2=0x7f8e7815c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:16.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.734+0000 7f8e7d0de640 1 --2- 172.21.15.105:0/2059553676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e780cd360 0x7f8e7815c6a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8e68005fd0 tx=0x7f8e6802a540 comp rx=0 tx=0).stop 2024-09-21T03:26:16.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.734+0000 7f8e7d0de640 1 -- 172.21.15.105:0/2059553676 shutdown_connections 2024-09-21T03:26:16.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.734+0000 7f8e7d0de640 1 --2- 172.21.15.105:0/2059553676 >> v2:172.21.15.162:3300/0 conn(0x7f8e780cf440 0x7f8e780d0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:16.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.734+0000 7f8e7d0de640 1 --2- 172.21.15.105:0/2059553676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e780cd360 0x7f8e7815c6a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:16.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.734+0000 7f8e7d0de640 1 -- 172.21.15.105:0/2059553676 >> 172.21.15.105:0/2059553676 conn(0x7f8e780710b0 msgr2=0x7f8e780714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:16.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.734+0000 7f8e7d0de640 1 -- 172.21.15.105:0/2059553676 shutdown_connections 2024-09-21T03:26:16.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.734+0000 7f8e7d0de640 1 -- 172.21.15.105:0/2059553676 wait complete. 2024-09-21T03:26:16.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.736+0000 7f8e7d0de640 1 Processor -- start 2024-09-21T03:26:16.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.736+0000 7f8e7d0de640 1 -- start start 2024-09-21T03:26:16.740 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.737+0000 7f8e7d0de640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e780b7fe0 0x7f8e7815f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:16.740 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.737+0000 7f8e7d0de640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e780cd360 0x7f8e7814a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:16.740 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.737+0000 7f8e7d0de640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e781f77c0 0x7f8e781e6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:16.740 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.737+0000 7f8e7d0de640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8e780d0b70 con 0x7f8e780cd360 2024-09-21T03:26:16.740 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.737+0000 7f8e7d0de640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8e780d09f0 con 0x7f8e780b7fe0 2024-09-21T03:26:16.740 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.737+0000 7f8e7d0de640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8e780d0cf0 con 0x7f8e781f77c0 2024-09-21T03:26:16.740 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.737+0000 7f8e6e59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e780cd360 0x7f8e7814a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:16.740 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.737+0000 7f8e6e59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e780cd360 0x7f8e7814a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:37668/0 (socket says 172.21.15.105:37668) 2024-09-21T03:26:16.740 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.737+0000 7f8e6e59c640 1 -- 172.21.15.105:0/3479538833 learned_addr learned my addr 172.21.15.105:0/3479538833 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:16.740 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.737+0000 7f8e76d9d640 1 --2- 172.21.15.105:0/3479538833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e780b7fe0 0x7f8e7815f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:16.740 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.737+0000 7f8e7759e640 1 --2- 172.21.15.105:0/3479538833 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e781f77c0 0x7f8e781e6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:16.740 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.737+0000 7f8e6e59c640 1 -- 172.21.15.105:0/3479538833 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e781f77c0 msgr2=0x7f8e781e6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:16.740 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.737+0000 7f8e6e59c640 1 --2- 172.21.15.105:0/3479538833 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e781f77c0 0x7f8e781e6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:16.741 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.738+0000 7f8e6e59c640 1 -- 172.21.15.105:0/3479538833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e780b7fe0 msgr2=0x7f8e7815f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:16.741 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.738+0000 7f8e6e59c640 1 --2- 172.21.15.105:0/3479538833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e780b7fe0 0x7f8e7815f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:16.741 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.738+0000 7f8e6e59c640 1 -- 172.21.15.105:0/3479538833 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e781f44c0 con 0x7f8e780cd360 2024-09-21T03:26:16.741 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.738+0000 7f8e6e59c640 1 --2- 172.21.15.105:0/3479538833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e780cd360 0x7f8e7814a080 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f8e6000c400 tx=0x7f8e6000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:16.741 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.738+0000 7f8e6ffff640 1 -- 172.21.15.105:0/3479538833 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e60017070 con 0x7f8e780cd360 2024-09-21T03:26:16.741 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.738+0000 7f8e6ffff640 1 -- 172.21.15.105:0/3479538833 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e600053c0 con 0x7f8e780cd360 2024-09-21T03:26:16.741 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.738+0000 7f8e7d0de640 1 -- 172.21.15.105:0/3479538833 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e7814cc60 con 0x7f8e780cd360 2024-09-21T03:26:16.741 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.738+0000 7f8e6ffff640 1 -- 172.21.15.105:0/3479538833 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e60003850 con 0x7f8e780cd360 2024-09-21T03:26:16.741 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.738+0000 7f8e7d0de640 1 -- 172.21.15.105:0/3479538833 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e7814d220 con 0x7f8e780cd360 2024-09-21T03:26:16.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.739+0000 7f8e7d0de640 1 -- 172.21.15.105:0/3479538833 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e780d1210 con 0x7f8e780cd360 2024-09-21T03:26:16.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.740+0000 7f8e6ffff640 1 -- 172.21.15.105:0/3479538833 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8e6001a070 con 0x7f8e780cd360 2024-09-21T03:26:16.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.740+0000 7f8e6ffff640 1 --2- 172.21.15.105:0/3479538833 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8e58078bc0 0x7f8e5807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:16.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.740+0000 7f8e6ffff640 1 -- 172.21.15.105:0/3479538833 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5767+0+0 (secure 0 0 0) 0x7f8e6009a200 con 0x7f8e780cd360 2024-09-21T03:26:16.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.741+0000 7f8e76d9d640 1 --2- 172.21.15.105:0/3479538833 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8e58078bc0 0x7f8e5807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:16.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.741+0000 7f8e76d9d640 1 --2- 172.21.15.105:0/3479538833 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8e58078bc0 0x7f8e5807b0d0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f8e68033000 tx=0x7f8e68004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:16.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.745+0000 7f8e6ffff640 1 -- 172.21.15.105:0/3479538833 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8e60062580 con 0x7f8e780cd360 2024-09-21T03:26:16.960 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.958+0000 7f8e7d0de640 1 -- 172.21.15.105:0/3479538833 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8e780b6790 con 0x7f8e780cd360 2024-09-21T03:26:16.960 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.958+0000 7f8e6ffff640 1 -- 172.21.15.105:0/3479538833 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+316 (secure 0 0 0) 0x7f8e60061e80 con 0x7f8e780cd360 2024-09-21T03:26:16.960 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:26:16.960 INFO:teuthology.orchestra.run.smithi105.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false},"MDS_CLIENT_RECALL":{"severity":"HEALTH_WARN","summary":{"message":"1 clients failing to respond to cache pressure","count":1},"muted":false}},"mutes":[]} 2024-09-21T03:26:16.962 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.960+0000 7f8e7d0de640 1 -- 172.21.15.105:0/3479538833 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8e58078bc0 msgr2=0x7f8e5807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:16.962 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.960+0000 7f8e7d0de640 1 --2- 172.21.15.105:0/3479538833 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8e58078bc0 0x7f8e5807b0d0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f8e68033000 tx=0x7f8e68004730 comp rx=0 tx=0).stop 2024-09-21T03:26:16.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.960+0000 7f8e7d0de640 1 -- 172.21.15.105:0/3479538833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e780cd360 msgr2=0x7f8e7814a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:16.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.960+0000 7f8e7d0de640 1 --2- 172.21.15.105:0/3479538833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e780cd360 0x7f8e7814a080 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f8e6000c400 tx=0x7f8e6000c8c0 comp rx=0 tx=0).stop 2024-09-21T03:26:16.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.960+0000 7f8e7d0de640 1 -- 172.21.15.105:0/3479538833 shutdown_connections 2024-09-21T03:26:16.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.960+0000 7f8e7d0de640 1 --2- 172.21.15.105:0/3479538833 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8e58078bc0 0x7f8e5807b0d0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:16.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.960+0000 7f8e7d0de640 1 --2- 172.21.15.105:0/3479538833 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e781f77c0 0x7f8e781e6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:16.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.960+0000 7f8e7d0de640 1 --2- 172.21.15.105:0/3479538833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e780cd360 0x7f8e7814a080 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:16.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.960+0000 7f8e7d0de640 1 --2- 172.21.15.105:0/3479538833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e780b7fe0 0x7f8e7815f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:16.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.960+0000 7f8e7d0de640 1 -- 172.21.15.105:0/3479538833 >> 172.21.15.105:0/3479538833 conn(0x7f8e780710b0 msgr2=0x7f8e780b21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:16.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.961+0000 7f8e7d0de640 1 -- 172.21.15.105:0/3479538833 shutdown_connections 2024-09-21T03:26:16.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16.961+0000 7f8e7d0de640 1 -- 172.21.15.105:0/3479538833 wait complete. 2024-09-21T03:26:16.973 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-21T03:26:16.973 INFO:tasks.cephfs.test_client_limits:Terminating process holding files open 2024-09-21T03:26:16.974 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:16 stdin-killer INFO: expiration expected; waiting 5 seconds for command to complete 2024-09-21T03:26:17.250 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:26:17.250 INFO:teuthology.orchestra.run.smithi105.stderr:stdin closed, goodbye! 2024-09-21T03:26:17.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:26:17.262 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:26:17.415 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.413+0000 7f1e14971640 1 -- 172.21.15.105:0/3436709260 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e10144270 msgr2=0x7f1e100b5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:17.415 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.413+0000 7f1e14971640 1 --2- 172.21.15.105:0/3436709260 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e10144270 0x7f1e100b5680 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f1e100cdd10 tx=0x7f1e0002a5f0 comp rx=0 tx=0).stop 2024-09-21T03:26:17.415 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.413+0000 7f1e14971640 1 -- 172.21.15.105:0/3436709260 shutdown_connections 2024-09-21T03:26:17.415 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.413+0000 7f1e14971640 1 --2- 172.21.15.105:0/3436709260 >> v2:172.21.15.162:3300/0 conn(0x7f1e10074560 0x7f1e100cfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:17.415 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.413+0000 7f1e14971640 1 --2- 172.21.15.105:0/3436709260 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e10144270 0x7f1e100b5680 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:17.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.413+0000 7f1e14971640 1 -- 172.21.15.105:0/3436709260 >> 172.21.15.105:0/3436709260 conn(0x7f1e100d15f0 msgr2=0x7f1e10073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:17.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.413+0000 7f1e14971640 1 -- 172.21.15.105:0/3436709260 shutdown_connections 2024-09-21T03:26:17.416 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.413+0000 7f1e14971640 1 -- 172.21.15.105:0/3436709260 wait complete. 2024-09-21T03:26:17.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.415+0000 7f1e14971640 1 Processor -- start 2024-09-21T03:26:17.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.415+0000 7f1e14971640 1 -- start start 2024-09-21T03:26:17.419 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.417+0000 7f1e14971640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e10142270 0x7f1e101f3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:17.420 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.417+0000 7f1e14971640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e10144270 0x7f1e101416f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:17.420 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.417+0000 7f1e14971640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e1012e7d0 0x7f1e10129a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:17.420 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.417+0000 7f1e14971640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1e10142800 con 0x7f1e10144270 2024-09-21T03:26:17.420 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.417+0000 7f1e14971640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1e10142680 con 0x7f1e10142270 2024-09-21T03:26:17.420 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.417+0000 7f1e14971640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1e10142980 con 0x7f1e1012e7d0 2024-09-21T03:26:17.420 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.417+0000 7f1e05d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e10144270 0x7f1e101416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:17.420 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.417+0000 7f1e05d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e10144270 0x7f1e101416f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:37682/0 (socket says 172.21.15.105:37682) 2024-09-21T03:26:17.420 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.417+0000 7f1e05d9b640 1 -- 172.21.15.105:0/915124933 learned_addr learned my addr 172.21.15.105:0/915124933 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:17.420 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.417+0000 7f1e0e59c640 1 --2- 172.21.15.105:0/915124933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e10142270 0x7f1e101f3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:17.420 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.417+0000 7f1e0ed9d640 1 --2- 172.21.15.105:0/915124933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e1012e7d0 0x7f1e10129a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:17.420 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.417+0000 7f1e05d9b640 1 -- 172.21.15.105:0/915124933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e1012e7d0 msgr2=0x7f1e10129a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:17.420 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.417+0000 7f1e05d9b640 1 --2- 172.21.15.105:0/915124933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e1012e7d0 0x7f1e10129a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:17.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.417+0000 7f1e05d9b640 1 -- 172.21.15.105:0/915124933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e10142270 msgr2=0x7f1e101f3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:17.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.417+0000 7f1e05d9b640 1 --2- 172.21.15.105:0/915124933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e10142270 0x7f1e101f3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:17.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.417+0000 7f1e05d9b640 1 -- 172.21.15.105:0/915124933 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e101f4310 con 0x7f1e10144270 2024-09-21T03:26:17.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.417+0000 7f1e05d9b640 1 --2- 172.21.15.105:0/915124933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e10144270 0x7f1e101416f0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f1df800c3d0 tx=0x7f1df800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:17.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.417+0000 7f1e077fe640 1 -- 172.21.15.105:0/915124933 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df8017070 con 0x7f1e10144270 2024-09-21T03:26:17.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.417+0000 7f1e077fe640 1 -- 172.21.15.105:0/915124933 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1df80053c0 con 0x7f1e10144270 2024-09-21T03:26:17.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.417+0000 7f1e14971640 1 -- 172.21.15.105:0/915124933 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e101e6280 con 0x7f1e10144270 2024-09-21T03:26:17.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.417+0000 7f1e077fe640 1 -- 172.21.15.105:0/915124933 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df8003850 con 0x7f1e10144270 2024-09-21T03:26:17.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.418+0000 7f1e14971640 1 -- 172.21.15.105:0/915124933 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e101e6840 con 0x7f1e10144270 2024-09-21T03:26:17.422 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.418+0000 7f1e14971640 1 -- 172.21.15.105:0/915124933 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e100d0640 con 0x7f1e10144270 2024-09-21T03:26:17.422 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.419+0000 7f1e077fe640 1 -- 172.21.15.105:0/915124933 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1df801a070 con 0x7f1e10144270 2024-09-21T03:26:17.422 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.420+0000 7f1e077fe640 1 --2- 172.21.15.105:0/915124933 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1df0078bc0 0x7f1df007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:17.422 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.420+0000 7f1e077fe640 1 -- 172.21.15.105:0/915124933 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5767+0+0 (secure 0 0 0) 0x7f1df809a050 con 0x7f1e10144270 2024-09-21T03:26:17.422 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.420+0000 7f1e0e59c640 1 --2- 172.21.15.105:0/915124933 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1df0078bc0 0x7f1df007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:17.422 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.420+0000 7f1e0e59c640 1 --2- 172.21.15.105:0/915124933 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1df0078bc0 0x7f1df007b0d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f1e00033000 tx=0x7f1e00004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:17.426 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.424+0000 7f1e077fe640 1 -- 172.21.15.105:0/915124933 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1e101f4310 con 0x7f1e10144270 2024-09-21T03:26:17.636 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.635+0000 7f1e14971640 1 -- 172.21.15.105:0/915124933 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1e1015fe30 con 0x7f1e10144270 2024-09-21T03:26:17.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.635+0000 7f1e077fe640 1 -- 172.21.15.105:0/915124933 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5237 (secure 0 0 0) 0x7f1df8061e00 con 0x7f1e10144270 2024-09-21T03:26:17.637 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:26:17.637 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":75,"btime":"2024-09-21T03:26:11:467030+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6233,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/2073653576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2073653576},{"type":"v1","addr":"172.21.15.162:6837","nonce":2073653576}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":70},{"gid":6850,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2714893724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2714893724},{"type":"v1","addr":"172.21.15.162:6836","nonce":2714893724}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":70},{"gid":7590,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/2972986125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2972986125},{"type":"v1","addr":"172.21.15.105:6834","nonce":2972986125}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":70}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:25:50.598171+0000","modified":"2024-09-21T03:26:11.275296+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7593":{"gid":7593,"name":"a","rank":0,"incarnation":71,"state":"up:active","state_seq":8,"addr":"172.21.15.105:6835/3941149960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":3941149960},{"type":"v1","addr":"172.21.15.105:6835","nonce":3941149960}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7593,"qdb_cluster":[7593]},"id":9}]} 2024-09-21T03:26:17.638 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 75 2024-09-21T03:26:17.639 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.637+0000 7f1e14971640 1 -- 172.21.15.105:0/915124933 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1df0078bc0 msgr2=0x7f1df007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:17.639 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.637+0000 7f1e14971640 1 --2- 172.21.15.105:0/915124933 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1df0078bc0 0x7f1df007b0d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f1e00033000 tx=0x7f1e00004730 comp rx=0 tx=0).stop 2024-09-21T03:26:17.640 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.637+0000 7f1e14971640 1 -- 172.21.15.105:0/915124933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e10144270 msgr2=0x7f1e101416f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:17.640 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.637+0000 7f1e14971640 1 --2- 172.21.15.105:0/915124933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e10144270 0x7f1e101416f0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f1df800c3d0 tx=0x7f1df800c890 comp rx=0 tx=0).stop 2024-09-21T03:26:17.640 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.637+0000 7f1e14971640 1 -- 172.21.15.105:0/915124933 shutdown_connections 2024-09-21T03:26:17.640 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.637+0000 7f1e14971640 1 --2- 172.21.15.105:0/915124933 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1df0078bc0 0x7f1df007b0d0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:17.640 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.637+0000 7f1e14971640 1 --2- 172.21.15.105:0/915124933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e1012e7d0 0x7f1e10129a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:17.640 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.637+0000 7f1e14971640 1 --2- 172.21.15.105:0/915124933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e10144270 0x7f1e101416f0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:17.640 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.637+0000 7f1e14971640 1 --2- 172.21.15.105:0/915124933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e10142270 0x7f1e101f3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:17.640 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.637+0000 7f1e14971640 1 -- 172.21.15.105:0/915124933 >> 172.21.15.105:0/915124933 conn(0x7f1e100d15f0 msgr2=0x7f1e101432a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:17.640 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.638+0000 7f1e14971640 1 -- 172.21.15.105:0/915124933 shutdown_connections 2024-09-21T03:26:17.640 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:17.638+0000 7f1e14971640 1 -- 172.21.15.105:0/915124933 wait complete. 2024-09-21T03:26:17.651 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-21T03:26:17.775 INFO:teuthology.orchestra.run.smithi105.stdout:[{"id":7788,"entity":{"name":{"type":"client","num":7788},"addr":{"type":"v1","addr":"172.21.15.162:0","nonce":3437489813}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":15.306688284,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.9075539865413664,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.7788 v1:172.21.15.162:0/3437489813","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi162","kernel_version":"5.14.0-508.el9.x86_64","root":"/"}},{"id":6341,"entity":{"name":{"type":"client","num":6341},"addr":{"type":"v1","addr":"172.21.15.105:0","nonce":330640395}},"state":"open","num_leases":1,"num_caps":202,"request_load_avg":196,"uptime":16.434665314,"requests_in_flight":0,"num_completed_requests":200,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":1206.8422462034091,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":212.4488061574306,"halflife":1.5},"recall_caps_throttle2o":{"value":65.294740612900284,"halflife":0.5},"session_cache_liveness":{"value":393.37480879245669,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":29,"last_trim_completed_flushes_tid":0,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.6341 v1:172.21.15.105:0/330640395","completed_requests":[{"tid":29,"created_ino":"0x10000000001"},{"tid":30,"created_ino":"0x100000001f6"},{"tid":31,"created_ino":"0x100000001f7"},{"tid":32,"created_ino":"0x100000001f8"},{"tid":33,"created_ino":"0x100000001f9"},{"tid":34,"created_ino":"0x100000001fa"},{"tid":35,"created_ino":"0x100000001fb"},{"tid":36,"created_ino":"0x100000001fc"},{"tid":37,"created_ino":"0x100000001fd"},{"tid":38,"created_ino":"0x100000001fe"},{"tid":39,"created_ino":"0x100000001ff"},{"tid":40,"created_ino":"0x10000000200"},{"tid":41,"created_ino":"0x10000000201"},{"tid":42,"created_ino":"0x10000000202"},{"tid":43,"created_ino":"0x10000000203"},{"tid":44,"created_ino":"0x10000000204"},{"tid":45,"created_ino":"0x10000000205"},{"tid":46,"created_ino":"0x10000000206"},{"tid":47,"created_ino":"0x10000000207"},{"tid":48,"created_ino":"0x10000000208"},{"tid":49,"created_ino":"0x10000000209"},{"tid":50,"created_ino":"0x1000000020a"},{"tid":51,"created_ino":"0x1000000020b"},{"tid":52,"created_ino":"0x1000000020c"},{"tid":53,"created_ino":"0x1000000020d"},{"tid":54,"created_ino":"0x1000000020e"},{"tid":55,"created_ino":"0x1000000020f"},{"tid":56,"created_ino":"0x10000000210"},{"tid":57,"created_ino":"0x10000000211"},{"tid":58,"created_ino":"0x10000000212"},{"tid":59,"created_ino":"0x10000000213"},{"tid":60,"created_ino":"0x10000000214"},{"tid":61,"created_ino":"0x10000000215"},{"tid":62,"created_ino":"0x10000000216"},{"tid":63,"created_ino":"0x10000000217"},{"tid":64,"created_ino":"0x10000000218"},{"tid":65,"created_ino":"0x10000000219"},{"tid":66,"created_ino":"0x1000000021a"},{"tid":67,"created_ino":"0x1000000021b"},{"tid":68,"created_ino":"0x1000000021c"},{"tid":69,"created_ino":"0x1000000021d"},{"tid":70,"created_ino":"0x1000000021e"},{"tid":71,"created_ino":"0x1000000021f"},{"tid":72,"created_ino":"0x10000000220"},{"tid":73,"created_ino":"0x10000000221"},{"tid":74,"created_ino":"0x10000000222"},{"tid":75,"created_ino":"0x10000000223"},{"tid":76,"created_ino":"0x10000000224"},{"tid":77,"created_ino":"0x10000000225"},{"tid":78,"created_ino":"0x10000000226"},{"tid":79,"created_ino":"0x10000000227"},{"tid":80,"created_ino":"0x10000000228"},{"tid":81,"created_ino":"0x10000000229"},{"tid":82,"created_ino":"0x1000000022a"},{"tid":83,"created_ino":"0x1000000022b"},{"tid":84,"created_ino":"0x1000000022c"},{"tid":85,"created_ino":"0x1000000022d"},{"tid":86,"created_ino":"0x1000000022e"},{"tid":87,"created_ino":"0x1000000022f"},{"tid":88,"created_ino":"0x10000000230"},{"tid":89,"created_ino":"0x10000000231"},{"tid":90,"created_ino":"0x10000000232"},{"tid":91,"created_ino":"0x10000000233"},{"tid":92,"created_ino":"0x10000000234"},{"tid":93,"created_ino":"0x10000000235"},{"tid":94,"created_ino":"0x10000000236"},{"tid":95,"created_ino":"0x10000000237"},{"tid":96,"created_ino":"0x10000000238"},{"tid":97,"created_ino":"0x10000000239"},{"tid":98,"created_ino":"0x1000000023a"},{"tid":99,"created_ino":"0x1000000023b"},{"tid":100,"created_ino":"0x1000000023c"},{"tid":101,"created_ino":"0x1000000023d"},{"tid":102,"created_ino":"0x1000000023e"},{"tid":103,"created_ino":"0x1000000023f"},{"tid":104,"created_ino":"0x10000000240"},{"tid":105,"created_ino":"0x10000000241"},{"tid":106,"created_ino":"0x10000000242"},{"tid":107,"created_ino":"0x10000000243"},{"tid":108,"created_ino":"0x10000000244"},{"tid":109,"created_ino":"0x10000000245"},{"tid":110,"created_ino":"0x10000000246"},{"tid":111,"created_ino":"0x10000000247"},{"tid":112,"created_ino":"0x10000000248"},{"tid":113,"created_ino":"0x10000000249"},{"tid":114,"created_ino":"0x1000000024a"},{"tid":115,"created_ino":"0x1000000024b"},{"tid":116,"created_ino":"0x1000000024c"},{"tid":117,"created_ino":"0x1000000024d"},{"tid":118,"created_ino":"0x1000000024e"},{"tid":119,"created_ino":"0x1000000024f"},{"tid":120,"created_ino":"0x10000000250"},{"tid":121,"created_ino":"0x10000000251"},{"tid":122,"created_ino":"0x10000000252"},{"tid":123,"created_ino":"0x10000000253"},{"tid":124,"created_ino":"0x10000000254"},{"tid":125,"created_ino":"0x10000000255"},{"tid":126,"created_ino":"0x10000000256"},{"tid":127,"created_ino":"0x10000000257"},{"tid":128,"created_ino":"0x10000000258"},{"tid":129,"created_ino":"0x10000000259"},{"tid":130,"created_ino":"0x1000000025a"},{"tid":131,"created_ino":"0x1000000025b"},{"tid":132,"created_ino":"0x1000000025c"},{"tid":133,"created_ino":"0x1000000025d"},{"tid":134,"created_ino":"0x1000000025e"},{"tid":135,"created_ino":"0x1000000025f"},{"tid":136,"created_ino":"0x10000000260"},{"tid":137,"created_ino":"0x10000000261"},{"tid":138,"created_ino":"0x10000000262"},{"tid":139,"created_ino":"0x10000000263"},{"tid":140,"created_ino":"0x10000000264"},{"tid":141,"created_ino":"0x10000000265"},{"tid":142,"created_ino":"0x10000000266"},{"tid":143,"created_ino":"0x10000000267"},{"tid":144,"created_ino":"0x10000000268"},{"tid":145,"created_ino":"0x10000000269"},{"tid":146,"created_ino":"0x1000000026a"},{"tid":147,"created_ino":"0x1000000026b"},{"tid":148,"created_ino":"0x1000000026c"},{"tid":149,"created_ino":"0x1000000026d"},{"tid":150,"created_ino":"0x1000000026e"},{"tid":151,"created_ino":"0x1000000026f"},{"tid":152,"created_ino":"0x10000000270"},{"tid":153,"created_ino":"0x10000000271"},{"tid":154,"created_ino":"0x10000000272"},{"tid":155,"created_ino":"0x10000000273"},{"tid":156,"created_ino":"0x10000000274"},{"tid":157,"created_ino":"0x10000000275"},{"tid":158,"created_ino":"0x10000000276"},{"tid":159,"created_ino":"0x10000000277"},{"tid":160,"created_ino":"0x10000000278"},{"tid":161,"created_ino":"0x10000000279"},{"tid":162,"created_ino":"0x1000000027a"},{"tid":163,"created_ino":"0x1000000027b"},{"tid":164,"created_ino":"0x1000000027c"},{"tid":165,"created_ino":"0x1000000027d"},{"tid":166,"created_ino":"0x1000000027e"},{"tid":167,"created_ino":"0x1000000027f"},{"tid":168,"created_ino":"0x10000000280"},{"tid":169,"created_ino":"0x10000000281"},{"tid":170,"created_ino":"0x10000000282"},{"tid":171,"created_ino":"0x10000000283"},{"tid":172,"created_ino":"0x10000000284"},{"tid":173,"created_ino":"0x10000000285"},{"tid":174,"created_ino":"0x10000000286"},{"tid":175,"created_ino":"0x10000000287"},{"tid":176,"created_ino":"0x10000000288"},{"tid":177,"created_ino":"0x10000000289"},{"tid":178,"created_ino":"0x1000000028a"},{"tid":179,"created_ino":"0x1000000028b"},{"tid":180,"created_ino":"0x1000000028c"},{"tid":181,"created_ino":"0x1000000028d"},{"tid":182,"created_ino":"0x1000000028e"},{"tid":183,"created_ino":"0x1000000028f"},{"tid":184,"created_ino":"0x10000000290"},{"tid":185,"created_ino":"0x10000000291"},{"tid":186,"created_ino":"0x10000000292"},{"tid":187,"created_ino":"0x10000000293"},{"tid":188,"created_ino":"0x10000000294"},{"tid":189,"created_ino":"0x10000000295"},{"tid":190,"created_ino":"0x10000000296"},{"tid":191,"created_ino":"0x10000000297"},{"tid":192,"created_ino":"0x10000000298"},{"tid":193,"created_ino":"0x10000000299"},{"tid":194,"created_ino":"0x1000000029a"},{"tid":195,"created_ino":"0x1000000029b"},{"tid":196,"created_ino":"0x1000000029c"},{"tid":197,"created_ino":"0x1000000029d"},{"tid":198,"created_ino":"0x1000000029e"},{"tid":199,"created_ino":"0x1000000029f"},{"tid":200,"created_ino":"0x100000002a0"},{"tid":201,"created_ino":"0x100000002a1"},{"tid":202,"created_ino":"0x100000002a2"},{"tid":203,"created_ino":"0x100000002a3"},{"tid":204,"created_ino":"0x100000002a4"},{"tid":205,"created_ino":"0x100000002a5"},{"tid":206,"created_ino":"0x100000002a6"},{"tid":207,"created_ino":"0x100000002a7"},{"tid":208,"created_ino":"0x100000002a8"},{"tid":209,"created_ino":"0x100000002a9"},{"tid":210,"created_ino":"0x100000002aa"},{"tid":211,"created_ino":"0x100000002ab"},{"tid":212,"created_ino":"0x100000002ac"},{"tid":213,"created_ino":"0x100000002ad"},{"tid":214,"created_ino":"0x100000002ae"},{"tid":215,"created_ino":"0x100000002af"},{"tid":216,"created_ino":"0x100000002b0"},{"tid":217,"created_ino":"0x100000002b1"},{"tid":218,"created_ino":"0x100000002b2"},{"tid":219,"created_ino":"0x100000002b3"},{"tid":220,"created_ino":"0x100000002b4"},{"tid":221,"created_ino":"0x100000002b5"},{"tid":222,"created_ino":"0x100000002b6"},{"tid":223,"created_ino":"0x100000002b7"},{"tid":224,"created_ino":"0x100000002b8"},{"tid":225,"created_ino":"0x100000002b9"},{"tid":226,"created_ino":"0x100000002ba"},{"tid":227,"created_ino":"0x100000002bb"},{"tid":228,"created_ino":"0x100000002bc"}],"prealloc_inos":[{"start":"0x10000000002","length":500},{"start":"0x100000002bd","length":802}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi105","kernel_version":"5.14.0-508.el9.x86_64","root":"/"}}] 2024-09-21T03:26:17.777 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi162", "kernel_version": "5.14.0-508.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.162:0", "nonce": 3437489813, "type": "v1" }, "name": { "num": 7788, "type": "client" } }, "id": 7788, "inst": "client.7788 v1:172.21.15.162:0/3437489813", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.9075539865413664 }, "state": "open", "uptime": 15.306688284 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi105", "kernel_version": "5.14.0-508.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [ { "created_ino": "0x10000000001", "tid": 29 }, { "created_ino": "0x100000001f6", "tid": 30 }, { "created_ino": "0x100000001f7", "tid": 31 }, { "created_ino": "0x100000001f8", "tid": 32 }, { "created_ino": "0x100000001f9", "tid": 33 }, { "created_ino": "0x100000001fa", "tid": 34 }, { "created_ino": "0x100000001fb", "tid": 35 }, { "created_ino": "0x100000001fc", "tid": 36 }, { "created_ino": "0x100000001fd", "tid": 37 }, { "created_ino": "0x100000001fe", "tid": 38 }, { "created_ino": "0x100000001ff", "tid": 39 }, { "created_ino": "0x10000000200", "tid": 40 }, { "created_ino": "0x10000000201", "tid": 41 }, { "created_ino": "0x10000000202", "tid": 42 }, { "created_ino": "0x10000000203", "tid": 43 }, { "created_ino": "0x10000000204", "tid": 44 }, { "created_ino": "0x10000000205", "tid": 45 }, { "created_ino": "0x10000000206", "tid": 46 }, { "created_ino": "0x10000000207", "tid": 47 }, { "created_ino": "0x10000000208", "tid": 48 }, { "created_ino": "0x10000000209", "tid": 49 }, { "created_ino": "0x1000000020a", "tid": 50 }, { "created_ino": "0x1000000020b", "tid": 51 }, { "created_ino": "0x1000000020c", "tid": 52 }, { "created_ino": "0x1000000020d", "tid": 53 }, { "created_ino": "0x1000000020e", "tid": 54 }, { "created_ino": "0x1000000020f", "tid": 55 }, { "created_ino": "0x10000000210", "tid": 56 }, { "created_ino": "0x10000000211", "tid": 57 }, { "created_ino": "0x10000000212", "tid": 58 }, { "created_ino": "0x10000000213", "tid": 59 }, { "created_ino": "0x10000000214", "tid": 60 }, { "created_ino": "0x10000000215", "tid": 61 }, { "created_ino": "0x10000000216", "tid": 62 }, { "created_ino": "0x10000000217", "tid": 63 }, { "created_ino": "0x10000000218", "tid": 64 }, { "created_ino": "0x10000000219", "tid": 65 }, { "created_ino": "0x1000000021a", "tid": 66 }, { "created_ino": "0x1000000021b", "tid": 67 }, { "created_ino": "0x1000000021c", "tid": 68 }, { "created_ino": "0x1000000021d", "tid": 69 }, { "created_ino": "0x1000000021e", "tid": 70 }, { "created_ino": "0x1000000021f", "tid": 71 }, { "created_ino": "0x10000000220", "tid": 72 }, { "created_ino": "0x10000000221", "tid": 73 }, { "created_ino": "0x10000000222", "tid": 74 }, { "created_ino": "0x10000000223", "tid": 75 }, { "created_ino": "0x10000000224", "tid": 76 }, { "created_ino": "0x10000000225", "tid": 77 }, { "created_ino": "0x10000000226", "tid": 78 }, { "created_ino": "0x10000000227", "tid": 79 }, { "created_ino": "0x10000000228", "tid": 80 }, { "created_ino": "0x10000000229", "tid": 81 }, { "created_ino": "0x1000000022a", "tid": 82 }, { "created_ino": "0x1000000022b", "tid": 83 }, { "created_ino": "0x1000000022c", "tid": 84 }, { "created_ino": "0x1000000022d", "tid": 85 }, { "created_ino": "0x1000000022e", "tid": 86 }, { "created_ino": "0x1000000022f", "tid": 87 }, { "created_ino": "0x10000000230", "tid": 88 }, { "created_ino": "0x10000000231", "tid": 89 }, { "created_ino": "0x10000000232", "tid": 90 }, { "created_ino": "0x10000000233", "tid": 91 }, { "created_ino": "0x10000000234", "tid": 92 }, { "created_ino": "0x10000000235", "tid": 93 }, { "created_ino": "0x10000000236", "tid": 94 }, { "created_ino": "0x10000000237", "tid": 95 }, { "created_ino": "0x10000000238", "tid": 96 }, { "created_ino": "0x10000000239", "tid": 97 }, { "created_ino": "0x1000000023a", "tid": 98 }, { "created_ino": "0x1000000023b", "tid": 99 }, { "created_ino": "0x1000000023c", "tid": 100 }, { "created_ino": "0x1000000023d", "tid": 101 }, { "created_ino": "0x1000000023e", "tid": 102 }, { "created_ino": "0x1000000023f", "tid": 103 }, { "created_ino": "0x10000000240", "tid": 104 }, { "created_ino": "0x10000000241", "tid": 105 }, { "created_ino": "0x10000000242", "tid": 106 }, { "created_ino": "0x10000000243", "tid": 107 }, { "created_ino": "0x10000000244", "tid": 108 }, { "created_ino": "0x10000000245", "tid": 109 }, { "created_ino": "0x10000000246", "tid": 110 }, { "created_ino": "0x10000000247", "tid": 111 }, { "created_ino": "0x10000000248", "tid": 112 }, { "created_ino": "0x10000000249", "tid": 113 }, { "created_ino": "0x1000000024a", "tid": 114 }, { "created_ino": "0x1000000024b", "tid": 115 }, { "created_ino": "0x1000000024c", "tid": 116 }, { "created_ino": "0x1000000024d", "tid": 117 }, { "created_ino": "0x1000000024e", "tid": 118 }, { "created_ino": "0x1000000024f", "tid": 119 }, { "created_ino": "0x10000000250", "tid": 120 }, { "created_ino": "0x10000000251", "tid": 121 }, { "created_ino": "0x10000000252", "tid": 122 }, { "created_ino": "0x10000000253", "tid": 123 }, { "created_ino": "0x10000000254", "tid": 124 }, { "created_ino": "0x10000000255", "tid": 125 }, { "created_ino": "0x10000000256", "tid": 126 }, { "created_ino": "0x10000000257", "tid": 127 }, { "created_ino": "0x10000000258", "tid": 128 }, { "created_ino": "0x10000000259", "tid": 129 }, { "created_ino": "0x1000000025a", "tid": 130 }, { "created_ino": "0x1000000025b", "tid": 131 }, { "created_ino": "0x1000000025c", "tid": 132 }, { "created_ino": "0x1000000025d", "tid": 133 }, { "created_ino": "0x1000000025e", "tid": 134 }, { "created_ino": "0x1000000025f", "tid": 135 }, { "created_ino": "0x10000000260", "tid": 136 }, { "created_ino": "0x10000000261", "tid": 137 }, { "created_ino": "0x10000000262", "tid": 138 }, { "created_ino": "0x10000000263", "tid": 139 }, { "created_ino": "0x10000000264", "tid": 140 }, { "created_ino": "0x10000000265", "tid": 141 }, { "created_ino": "0x10000000266", "tid": 142 }, { "created_ino": "0x10000000267", "tid": 143 }, { "created_ino": "0x10000000268", "tid": 144 }, { "created_ino": "0x10000000269", "tid": 145 }, { "created_ino": "0x1000000026a", "tid": 146 }, { "created_ino": "0x1000000026b", "tid": 147 }, { "created_ino": "0x1000000026c", "tid": 148 }, { "created_ino": "0x1000000026d", "tid": 149 }, { "created_ino": "0x1000000026e", "tid": 150 }, { "created_ino": "0x1000000026f", "tid": 151 }, { "created_ino": "0x10000000270", "tid": 152 }, { "created_ino": "0x10000000271", "tid": 153 }, { "created_ino": "0x10000000272", "tid": 154 }, { "created_ino": "0x10000000273", "tid": 155 }, { "created_ino": "0x10000000274", "tid": 156 }, { "created_ino": "0x10000000275", "tid": 157 }, { "created_ino": "0x10000000276", "tid": 158 }, { "created_ino": "0x10000000277", "tid": 159 }, { "created_ino": "0x10000000278", "tid": 160 }, { "created_ino": "0x10000000279", "tid": 161 }, { "created_ino": "0x1000000027a", "tid": 162 }, { "created_ino": "0x1000000027b", "tid": 163 }, { "created_ino": "0x1000000027c", "tid": 164 }, { "created_ino": "0x1000000027d", "tid": 165 }, { "created_ino": "0x1000000027e", "tid": 166 }, { "created_ino": "0x1000000027f", "tid": 167 }, { "created_ino": "0x10000000280", "tid": 168 }, { "created_ino": "0x10000000281", "tid": 169 }, { "created_ino": "0x10000000282", "tid": 170 }, { "created_ino": "0x10000000283", "tid": 171 }, { "created_ino": "0x10000000284", "tid": 172 }, { "created_ino": "0x10000000285", "tid": 173 }, { "created_ino": "0x10000000286", "tid": 174 }, { "created_ino": "0x10000000287", "tid": 175 }, { "created_ino": "0x10000000288", "tid": 176 }, { "created_ino": "0x10000000289", "tid": 177 }, { "created_ino": "0x1000000028a", "tid": 178 }, { "created_ino": "0x1000000028b", "tid": 179 }, { "created_ino": "0x1000000028c", "tid": 180 }, { "created_ino": "0x1000000028d", "tid": 181 }, { "created_ino": "0x1000000028e", "tid": 182 }, { "created_ino": "0x1000000028f", "tid": 183 }, { "created_ino": "0x10000000290", "tid": 184 }, { "created_ino": "0x10000000291", "tid": 185 }, { "created_ino": "0x10000000292", "tid": 186 }, { "created_ino": "0x10000000293", "tid": 187 }, { "created_ino": "0x10000000294", "tid": 188 }, { "created_ino": "0x10000000295", "tid": 189 }, { "created_ino": "0x10000000296", "tid": 190 }, { "created_ino": "0x10000000297", "tid": 191 }, { "created_ino": "0x10000000298", "tid": 192 }, { "created_ino": "0x10000000299", "tid": 193 }, { "created_ino": "0x1000000029a", "tid": 194 }, { "created_ino": "0x1000000029b", "tid": 195 }, { "created_ino": "0x1000000029c", "tid": 196 }, { "created_ino": "0x1000000029d", "tid": 197 }, { "created_ino": "0x1000000029e", "tid": 198 }, { "created_ino": "0x1000000029f", "tid": 199 }, { "created_ino": "0x100000002a0", "tid": 200 }, { "created_ino": "0x100000002a1", "tid": 201 }, { "created_ino": "0x100000002a2", "tid": 202 }, { "created_ino": "0x100000002a3", "tid": 203 }, { "created_ino": "0x100000002a4", "tid": 204 }, { "created_ino": "0x100000002a5", "tid": 205 }, { "created_ino": "0x100000002a6", "tid": 206 }, { "created_ino": "0x100000002a7", "tid": 207 }, { "created_ino": "0x100000002a8", "tid": 208 }, { "created_ino": "0x100000002a9", "tid": 209 }, { "created_ino": "0x100000002aa", "tid": 210 }, { "created_ino": "0x100000002ab", "tid": 211 }, { "created_ino": "0x100000002ac", "tid": 212 }, { "created_ino": "0x100000002ad", "tid": 213 }, { "created_ino": "0x100000002ae", "tid": 214 }, { "created_ino": "0x100000002af", "tid": 215 }, { "created_ino": "0x100000002b0", "tid": 216 }, { "created_ino": "0x100000002b1", "tid": 217 }, { "created_ino": "0x100000002b2", "tid": 218 }, { "created_ino": "0x100000002b3", "tid": 219 }, { "created_ino": "0x100000002b4", "tid": 220 }, { "created_ino": "0x100000002b5", "tid": 221 }, { "created_ino": "0x100000002b6", "tid": 222 }, { "created_ino": "0x100000002b7", "tid": 223 }, { "created_ino": "0x100000002b8", "tid": 224 }, { "created_ino": "0x100000002b9", "tid": 225 }, { "created_ino": "0x100000002ba", "tid": 226 }, { "created_ino": "0x100000002bb", "tid": 227 }, { "created_ino": "0x100000002bc", "tid": 228 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "172.21.15.105:0", "nonce": 330640395, "type": "v1" }, "name": { "num": 6341, "type": "client" } }, "id": 6341, "inst": "client.6341 v1:172.21.15.105:0/330640395", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 29, "num_caps": 202, "num_completed_flushes": 0, "num_completed_requests": 200, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000002" }, { "length": 802, "start": "0x100000002bd" } ], "recall_caps": { "halflife": 60, "value": 1206.842246203409 }, "recall_caps_throttle": { "halflife": 1.5, "value": 212.4488061574306 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 65.29474061290028 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 196, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 393.3748087924567 }, "state": "open", "uptime": 16.434665314 } ] 2024-09-21T03:26:17.777 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-21T03:26:17.777 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T03:26:17.777 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T03:26:17.814 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T03:26:17.859 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T03:26:17.859 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T03:26:17.859 DEBUG:tasks.cephfs.mount:terminating RemoteProcess(client=, args=['stdin-killer', '--', 'python3', '-c', '\nimport fcntl\nimport sys\nimport time\nimport os\n\nfcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK)\n\nn = 200\nabs_path = "/home/ubuntu/cephtest/mnt.0/subdir"\n\nif not os.path.exists(abs_path):\n os.makedirs(abs_path)\n\nhandles = []\nfor i in range(0, n):\n fname = "file_"+str(i)\n path = os.path.join(abs_path, fname)\n handles.append(open(path, \'w\'))\n\nprint("waiting with handles open", file=sys.stderr)\nwhile True:\n print("open_n_background: keeping files open", file=sys.stderr)\n try:\n if os.read(0, 4096) == b"":\n break\n except BlockingIOError:\n pass\n time.sleep(2)\nprint("stdin closed, goodbye!", file=sys.stderr)\n'], check_status=True, hostname='smithi105') 2024-09-21T03:26:17.860 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:26:17.860 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:26:17.876 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:26:17.876 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:26:17.932 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T03:26:18.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.082+0000 7f295118b640 1 -- 172.21.15.105:0/1282689883 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f294c0cf270 msgr2=0x7f294c072850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:18.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.082+0000 7f295118b640 1 --2- 172.21.15.105:0/1282689883 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f294c0cf270 0x7f294c072850 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f294c0725c0 tx=0x7f294402a4d0 comp rx=0 tx=0).stop 2024-09-21T03:26:18.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.082+0000 7f295118b640 1 -- 172.21.15.105:0/1282689883 shutdown_connections 2024-09-21T03:26:18.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.082+0000 7f295118b640 1 --2- 172.21.15.105:0/1282689883 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f294c0cf270 0x7f294c072850 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:18.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.082+0000 7f295118b640 1 --2- 172.21.15.105:0/1282689883 >> v2:172.21.15.162:3300/0 conn(0x7f294c0b7fe0 0x7f294c0ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:18.084 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.082+0000 7f295118b640 1 --2- 172.21.15.105:0/1282689883 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f294c0cd360 0x7f294c15c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:18.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.082+0000 7f295118b640 1 -- 172.21.15.105:0/1282689883 >> 172.21.15.105:0/1282689883 conn(0x7f294c0710b0 msgr2=0x7f294c0714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:18.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.082+0000 7f295118b640 1 -- 172.21.15.105:0/1282689883 shutdown_connections 2024-09-21T03:26:18.085 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.082+0000 7f295118b640 1 -- 172.21.15.105:0/1282689883 wait complete. 2024-09-21T03:26:18.086 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.084+0000 7f295118b640 1 Processor -- start 2024-09-21T03:26:18.086 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.084+0000 7f295118b640 1 -- start start 2024-09-21T03:26:18.091 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.085+0000 7f295118b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f294c0b7fe0 0x7f294c15e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:18.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.085+0000 7f295118b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f294c0cd360 0x7f294c1f3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:18.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.085+0000 7f295118b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f294c0cf270 0x7f294c0cb460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:18.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.085+0000 7f295118b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f294c073120 con 0x7f294c0cf270 2024-09-21T03:26:18.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.085+0000 7f295118b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f294c072fa0 con 0x7f294c0b7fe0 2024-09-21T03:26:18.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.085+0000 7f295118b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f294c0732a0 con 0x7f294c0cd360 2024-09-21T03:26:18.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.086+0000 7f294b59e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f294c0cf270 0x7f294c0cb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:18.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.086+0000 7f294b59e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f294c0cf270 0x7f294c0cb460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:37694/0 (socket says 172.21.15.105:37694) 2024-09-21T03:26:18.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.086+0000 7f294b59e640 1 -- 172.21.15.105:0/19039443 learned_addr learned my addr 172.21.15.105:0/19039443 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:18.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.086+0000 7f294a59c640 1 --2- 172.21.15.105:0/19039443 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f294c0cd360 0x7f294c1f3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:18.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.086+0000 7f294ad9d640 1 --2- 172.21.15.105:0/19039443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f294c0b7fe0 0x7f294c15e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:18.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.086+0000 7f294b59e640 1 -- 172.21.15.105:0/19039443 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f294c0cd360 msgr2=0x7f294c1f3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:18.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.086+0000 7f294b59e640 1 --2- 172.21.15.105:0/19039443 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f294c0cd360 0x7f294c1f3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:18.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.086+0000 7f294b59e640 1 -- 172.21.15.105:0/19039443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f294c0b7fe0 msgr2=0x7f294c15e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:18.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.086+0000 7f294b59e640 1 --2- 172.21.15.105:0/19039443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f294c0b7fe0 0x7f294c15e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:18.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.086+0000 7f294b59e640 1 -- 172.21.15.105:0/19039443 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f294c15cf10 con 0x7f294c0cf270 2024-09-21T03:26:18.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.086+0000 7f294b59e640 1 --2- 172.21.15.105:0/19039443 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f294c0cf270 0x7f294c0cb460 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f2944034040 tx=0x7f29440039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:18.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.086+0000 7f29337fe640 1 -- 172.21.15.105:0/19039443 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f294403e030 con 0x7f294c0cf270 2024-09-21T03:26:18.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.086+0000 7f29337fe640 1 -- 172.21.15.105:0/19039443 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f29440047a0 con 0x7f294c0cf270 2024-09-21T03:26:18.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.086+0000 7f295118b640 1 -- 172.21.15.105:0/19039443 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f294c15d1f0 con 0x7f294c0cf270 2024-09-21T03:26:18.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.086+0000 7f29337fe640 1 -- 172.21.15.105:0/19039443 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2944035040 con 0x7f294c0cf270 2024-09-21T03:26:18.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.086+0000 7f295118b640 1 -- 172.21.15.105:0/19039443 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f294c0aa090 con 0x7f294c0cf270 2024-09-21T03:26:18.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.087+0000 7f295118b640 1 -- 172.21.15.105:0/19039443 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f294c15c6a0 con 0x7f294c0cf270 2024-09-21T03:26:18.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.088+0000 7f29337fe640 1 -- 172.21.15.105:0/19039443 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2944041030 con 0x7f294c0cf270 2024-09-21T03:26:18.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.089+0000 7f29337fe640 1 --2- 172.21.15.105:0/19039443 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2938078b90 0x7f293807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:18.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.089+0000 7f29337fe640 1 -- 172.21.15.105:0/19039443 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5767+0+0 (secure 0 0 0) 0x7f29440bb5b0 con 0x7f294c0cf270 2024-09-21T03:26:18.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.089+0000 7f294ad9d640 1 --2- 172.21.15.105:0/19039443 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2938078b90 0x7f293807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:18.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.090+0000 7f294ad9d640 1 --2- 172.21.15.105:0/19039443 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2938078b90 0x7f293807b0a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f293c009f20 tx=0x7f293c0094f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:18.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.093+0000 7f29337fe640 1 -- 172.21.15.105:0/19039443 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2944083a40 con 0x7f294c0cf270 2024-09-21T03:26:18.298 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.297+0000 7f295118b640 1 -- 172.21.15.105:0/19039443 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f294c15ee90 con 0x7f294c0cf270 2024-09-21T03:26:18.299 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.297+0000 7f29337fe640 1 -- 172.21.15.105:0/19039443 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v118) ==== 80+0+0 (secure 0 0 0) 0x7f2944083340 con 0x7f294c0cf270 2024-09-21T03:26:18.299 INFO:teuthology.orchestra.run.smithi105.stderr:listed 0 entries 2024-09-21T03:26:18.301 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.299+0000 7f295118b640 1 -- 172.21.15.105:0/19039443 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2938078b90 msgr2=0x7f293807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:18.301 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.299+0000 7f295118b640 1 --2- 172.21.15.105:0/19039443 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2938078b90 0x7f293807b0a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f293c009f20 tx=0x7f293c0094f0 comp rx=0 tx=0).stop 2024-09-21T03:26:18.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.299+0000 7f295118b640 1 -- 172.21.15.105:0/19039443 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f294c0cf270 msgr2=0x7f294c0cb460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:18.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.299+0000 7f295118b640 1 --2- 172.21.15.105:0/19039443 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f294c0cf270 0x7f294c0cb460 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f2944034040 tx=0x7f29440039e0 comp rx=0 tx=0).stop 2024-09-21T03:26:18.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.300+0000 7f295118b640 1 -- 172.21.15.105:0/19039443 shutdown_connections 2024-09-21T03:26:18.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.300+0000 7f295118b640 1 --2- 172.21.15.105:0/19039443 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2938078b90 0x7f293807b0a0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:18.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.300+0000 7f295118b640 1 --2- 172.21.15.105:0/19039443 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f294c0cf270 0x7f294c0cb460 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:18.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.300+0000 7f295118b640 1 --2- 172.21.15.105:0/19039443 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f294c0cd360 0x7f294c1f3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:18.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.300+0000 7f295118b640 1 --2- 172.21.15.105:0/19039443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f294c0b7fe0 0x7f294c15e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:18.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.300+0000 7f295118b640 1 -- 172.21.15.105:0/19039443 >> 172.21.15.105:0/19039443 conn(0x7f294c0710b0 msgr2=0x7f294c0b6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:18.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.300+0000 7f295118b640 1 -- 172.21.15.105:0/19039443 shutdown_connections 2024-09-21T03:26:18.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.300+0000 7f295118b640 1 -- 172.21.15.105:0/19039443 wait complete. 2024-09-21T03:26:18.312 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T03:26:18.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:26:18.313 DEBUG:teuthology.orchestra.run.smithi105:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T03:26:18.415 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi105.front.sepia.ceph.com 2024-09-21T03:26:18.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:26:18.415 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T03:26:18.430 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T03:26:18.430 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:26:18.431 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:26:18.448 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:26:18.448 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:26:18.505 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T03:26:18.619 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.617+0000 7fc35e07e640 1 -- 172.21.15.105:0/2944226241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc35806cde0 msgr2=0x7fc35806d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:18.619 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.617+0000 7fc35e07e640 1 --2- 172.21.15.105:0/2944226241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc35806cde0 0x7fc35806d1f0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fc3580cf230 tx=0x7fc34c02a4d0 comp rx=0 tx=0).stop 2024-09-21T03:26:18.619 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.617+0000 7fc35e07e640 1 -- 172.21.15.105:0/2944226241 shutdown_connections 2024-09-21T03:26:18.619 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.617+0000 7fc35e07e640 1 --2- 172.21.15.105:0/2944226241 >> v2:172.21.15.162:3300/0 conn(0x7fc35815d0d0 0x7fc35815d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:18.619 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.617+0000 7fc35e07e640 1 --2- 172.21.15.105:0/2944226241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc35806cde0 0x7fc35806d1f0 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:18.619 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.617+0000 7fc35e07e640 1 --2- 172.21.15.105:0/2944226241 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3580d0240 0x7fc3580cdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:18.620 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.617+0000 7fc35e07e640 1 -- 172.21.15.105:0/2944226241 >> 172.21.15.105:0/2944226241 conn(0x7fc35806def0 msgr2=0x7fc35806e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:18.620 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.617+0000 7fc35e07e640 1 -- 172.21.15.105:0/2944226241 shutdown_connections 2024-09-21T03:26:18.620 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.617+0000 7fc35e07e640 1 -- 172.21.15.105:0/2944226241 wait complete. 2024-09-21T03:26:18.620 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.619+0000 7fc35e07e640 1 Processor -- start 2024-09-21T03:26:18.620 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.619+0000 7fc35e07e640 1 -- start start 2024-09-21T03:26:18.623 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.620+0000 7fc35e07e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc35806cde0 0x7fc3580cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:18.623 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.620+0000 7fc35e07e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3580d0240 0x7fc3581f6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:18.624 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.620+0000 7fc35e07e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc35815d0d0 0x7fc3581f7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:18.624 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.620+0000 7fc35e07e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc3581605d0 con 0x7fc35815d0d0 2024-09-21T03:26:18.624 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.620+0000 7fc35e07e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc358160450 con 0x7fc35806cde0 2024-09-21T03:26:18.624 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.620+0000 7fc35e07e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc358160750 con 0x7fc3580d0240 2024-09-21T03:26:18.624 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.620+0000 7fc357fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc35815d0d0 0x7fc3581f7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:18.624 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.620+0000 7fc357fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc35815d0d0 0x7fc3581f7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:37706/0 (socket says 172.21.15.105:37706) 2024-09-21T03:26:18.624 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.620+0000 7fc357fff640 1 -- 172.21.15.105:0/1875925636 learned_addr learned my addr 172.21.15.105:0/1875925636 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:18.624 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.621+0000 7fc3577fe640 1 --2- 172.21.15.105:0/1875925636 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc35806cde0 0x7fc3580cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:18.624 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.621+0000 7fc356ffd640 1 --2- 172.21.15.105:0/1875925636 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3580d0240 0x7fc3581f6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:18.624 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.621+0000 7fc357fff640 1 -- 172.21.15.105:0/1875925636 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3580d0240 msgr2=0x7fc3581f6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:18.624 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.621+0000 7fc357fff640 1 --2- 172.21.15.105:0/1875925636 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3580d0240 0x7fc3581f6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:18.624 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.621+0000 7fc357fff640 1 -- 172.21.15.105:0/1875925636 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc35806cde0 msgr2=0x7fc3580cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:18.625 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.621+0000 7fc357fff640 1 --2- 172.21.15.105:0/1875925636 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc35806cde0 0x7fc3580cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:18.625 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.621+0000 7fc357fff640 1 -- 172.21.15.105:0/1875925636 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3581e6b10 con 0x7fc35815d0d0 2024-09-21T03:26:18.625 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.621+0000 7fc356ffd640 1 --2- 172.21.15.105:0/1875925636 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3580d0240 0x7fc3581f6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:26:18.625 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.621+0000 7fc357fff640 1 --2- 172.21.15.105:0/1875925636 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc35815d0d0 0x7fc3581f7160 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fc35000e990 tx=0x7fc35000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:18.625 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.621+0000 7fc33ffff640 1 -- 172.21.15.105:0/1875925636 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc350004d20 con 0x7fc35815d0d0 2024-09-21T03:26:18.625 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.621+0000 7fc33ffff640 1 -- 172.21.15.105:0/1875925636 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc35000caa0 con 0x7fc35815d0d0 2024-09-21T03:26:18.625 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.621+0000 7fc33ffff640 1 -- 172.21.15.105:0/1875925636 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc350005020 con 0x7fc35815d0d0 2024-09-21T03:26:18.625 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.621+0000 7fc35e07e640 1 -- 172.21.15.105:0/1875925636 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3581e6df0 con 0x7fc35815d0d0 2024-09-21T03:26:18.625 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.621+0000 7fc35e07e640 1 -- 172.21.15.105:0/1875925636 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3581e73b0 con 0x7fc35815d0d0 2024-09-21T03:26:18.626 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.622+0000 7fc35e07e640 1 -- 172.21.15.105:0/1875925636 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3580cd760 con 0x7fc35815d0d0 2024-09-21T03:26:18.626 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.623+0000 7fc33ffff640 1 -- 172.21.15.105:0/1875925636 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc3500051c0 con 0x7fc35815d0d0 2024-09-21T03:26:18.626 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.623+0000 7fc33ffff640 1 --2- 172.21.15.105:0/1875925636 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc344078b90 0x7fc34407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:18.626 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.624+0000 7fc33ffff640 1 -- 172.21.15.105:0/1875925636 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5767+0+0 (secure 0 0 0) 0x7fc35009b730 con 0x7fc35815d0d0 2024-09-21T03:26:18.626 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.624+0000 7fc3577fe640 1 --2- 172.21.15.105:0/1875925636 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc344078b90 0x7fc34407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:18.626 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.624+0000 7fc3577fe640 1 --2- 172.21.15.105:0/1875925636 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc344078b90 0x7fc34407b0a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fc348005fd0 tx=0x7fc348005850 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:18.629 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.628+0000 7fc33ffff640 1 -- 172.21.15.105:0/1875925636 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc350016030 con 0x7fc35815d0d0 2024-09-21T03:26:18.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.815+0000 7fc35e07e640 1 -- 172.21.15.105:0/1875925636 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc358159ae0 con 0x7fc35815d0d0 2024-09-21T03:26:18.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.816+0000 7fc33ffff640 1 -- 172.21.15.105:0/1875925636 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v118) ==== 80+0+0 (secure 0 0 0) 0x7fc350063aa0 con 0x7fc35815d0d0 2024-09-21T03:26:18.817 INFO:teuthology.orchestra.run.smithi105.stderr:listed 0 entries 2024-09-21T03:26:18.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.818+0000 7fc35e07e640 1 -- 172.21.15.105:0/1875925636 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc344078b90 msgr2=0x7fc34407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:18.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.818+0000 7fc35e07e640 1 --2- 172.21.15.105:0/1875925636 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc344078b90 0x7fc34407b0a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fc348005fd0 tx=0x7fc348005850 comp rx=0 tx=0).stop 2024-09-21T03:26:18.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.818+0000 7fc35e07e640 1 -- 172.21.15.105:0/1875925636 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc35815d0d0 msgr2=0x7fc3581f7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:18.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.818+0000 7fc35e07e640 1 --2- 172.21.15.105:0/1875925636 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc35815d0d0 0x7fc3581f7160 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fc35000e990 tx=0x7fc35000ee50 comp rx=0 tx=0).stop 2024-09-21T03:26:18.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.818+0000 7fc35e07e640 1 -- 172.21.15.105:0/1875925636 shutdown_connections 2024-09-21T03:26:18.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.818+0000 7fc35e07e640 1 --2- 172.21.15.105:0/1875925636 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc344078b90 0x7fc34407b0a0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:18.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.818+0000 7fc35e07e640 1 --2- 172.21.15.105:0/1875925636 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc35815d0d0 0x7fc3581f7160 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:18.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.818+0000 7fc35e07e640 1 --2- 172.21.15.105:0/1875925636 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3580d0240 0x7fc3581f6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:18.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.818+0000 7fc35e07e640 1 --2- 172.21.15.105:0/1875925636 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc35806cde0 0x7fc3580cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:18.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.818+0000 7fc35e07e640 1 -- 172.21.15.105:0/1875925636 >> 172.21.15.105:0/1875925636 conn(0x7fc35806def0 msgr2=0x7fc35815e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:18.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.818+0000 7fc35e07e640 1 -- 172.21.15.105:0/1875925636 shutdown_connections 2024-09-21T03:26:18.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:18.818+0000 7fc35e07e640 1 -- 172.21.15.105:0/1875925636 wait complete. 2024-09-21T03:26:18.830 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-21T03:26:18.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:26:18.831 DEBUG:teuthology.orchestra.run.smithi162:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-21T03:26:18.861 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2024-09-21T03:26:18.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:26:18.862 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-21T03:26:18.919 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T03:26:18.919 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:26:18.919 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:26:18.935 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T03:26:18.935 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T03:26:18.935 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:26:18.935 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:26:18.976 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=452 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T03:26:18.977 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:26:19.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.086+0000 7f22493c3640 1 -- 172.21.15.105:0/3139160897 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22440d3870 msgr2=0x7f22440ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:19.088 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.086+0000 7f22493c3640 1 --2- 172.21.15.105:0/3139160897 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22440d3870 0x7f22440ceb40 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f22440ba570 tx=0x7f223402a9c0 comp rx=0 tx=0).stop 2024-09-21T03:26:19.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.086+0000 7f22493c3640 1 -- 172.21.15.105:0/3139160897 shutdown_connections 2024-09-21T03:26:19.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.086+0000 7f22493c3640 1 --2- 172.21.15.105:0/3139160897 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22440d3870 0x7f22440ceb40 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:19.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.086+0000 7f22493c3640 1 --2- 172.21.15.105:0/3139160897 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f224406f4b0 0x7f22440d3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:19.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.086+0000 7f22493c3640 1 --2- 172.21.15.105:0/3139160897 >> v2:172.21.15.162:3300/0 conn(0x7f224406e170 0x7f22440b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:19.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.086+0000 7f22493c3640 1 -- 172.21.15.105:0/3139160897 >> 172.21.15.105:0/3139160897 conn(0x7f224408bfc0 msgr2=0x7f224409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:19.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.086+0000 7f22493c3640 1 -- 172.21.15.105:0/3139160897 shutdown_connections 2024-09-21T03:26:19.089 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.086+0000 7f22493c3640 1 -- 172.21.15.105:0/3139160897 wait complete. 2024-09-21T03:26:19.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.088+0000 7f22493c3640 1 Processor -- start 2024-09-21T03:26:19.090 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.088+0000 7f22493c3640 1 -- start start 2024-09-21T03:26:19.092 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.090+0000 7f22493c3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f224406f4b0 0x7f22440a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:19.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.090+0000 7f22493c3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22440d3870 0x7f224409ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:19.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.090+0000 7f22493c3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2244155910 0x7f22440ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:19.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.090+0000 7f22493c3640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f22440cf490 con 0x7f22440d3870 2024-09-21T03:26:19.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.090+0000 7f22493c3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f22440cf310 con 0x7f224406f4b0 2024-09-21T03:26:19.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.090+0000 7f22493c3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f22440d0ce0 con 0x7f2244155910 2024-09-21T03:26:19.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.090+0000 7f22427fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22440d3870 0x7f224409ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:19.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.090+0000 7f22427fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22440d3870 0x7f224409ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:37732/0 (socket says 172.21.15.105:37732) 2024-09-21T03:26:19.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.090+0000 7f22427fc640 1 -- 172.21.15.105:0/1525781251 learned_addr learned my addr 172.21.15.105:0/1525781251 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:19.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.090+0000 7f2242ffd640 1 --2- 172.21.15.105:0/1525781251 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f224406f4b0 0x7f22440a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:19.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.090+0000 7f22437fe640 1 --2- 172.21.15.105:0/1525781251 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2244155910 0x7f22440ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:19.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.090+0000 7f22427fc640 1 -- 172.21.15.105:0/1525781251 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2244155910 msgr2=0x7f22440ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:19.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.090+0000 7f22427fc640 1 --2- 172.21.15.105:0/1525781251 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2244155910 0x7f22440ccae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:19.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.090+0000 7f22427fc640 1 -- 172.21.15.105:0/1525781251 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f224406f4b0 msgr2=0x7f22440a1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:19.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.090+0000 7f22427fc640 1 --2- 172.21.15.105:0/1525781251 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f224406f4b0 0x7f22440a1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:19.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.090+0000 7f22427fc640 1 -- 172.21.15.105:0/1525781251 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22440a20b0 con 0x7f22440d3870 2024-09-21T03:26:19.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.090+0000 7f22427fc640 1 --2- 172.21.15.105:0/1525781251 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22440d3870 0x7f224409ebe0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f223800d750 tx=0x7f223800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:19.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.090+0000 7f222b7fe640 1 -- 172.21.15.105:0/1525781251 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2238017070 con 0x7f22440d3870 2024-09-21T03:26:19.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.090+0000 7f222b7fe640 1 -- 172.21.15.105:0/1525781251 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2238009cc0 con 0x7f22440d3870 2024-09-21T03:26:19.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.090+0000 7f22493c3640 1 -- 172.21.15.105:0/1525781251 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f224409f120 con 0x7f22440d3870 2024-09-21T03:26:19.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.090+0000 7f222b7fe640 1 -- 172.21.15.105:0/1525781251 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f223800de60 con 0x7f22440d3870 2024-09-21T03:26:19.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.090+0000 7f22493c3640 1 -- 172.21.15.105:0/1525781251 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22440a0db0 con 0x7f22440d3870 2024-09-21T03:26:19.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.091+0000 7f22493c3640 1 -- 172.21.15.105:0/1525781251 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f224409f3a0 con 0x7f22440d3870 2024-09-21T03:26:19.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.092+0000 7f222b7fe640 1 -- 172.21.15.105:0/1525781251 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f223801a070 con 0x7f22440d3870 2024-09-21T03:26:19.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.093+0000 7f222b7fe640 1 --2- 172.21.15.105:0/1525781251 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2230078b90 0x7f223007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:19.096 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.093+0000 7f222b7fe640 1 -- 172.21.15.105:0/1525781251 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5767+0+0 (secure 0 0 0) 0x7f223809ad30 con 0x7f22440d3870 2024-09-21T03:26:19.096 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.093+0000 7f2242ffd640 1 --2- 172.21.15.105:0/1525781251 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2230078b90 0x7f223007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:19.096 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.093+0000 7f2242ffd640 1 --2- 172.21.15.105:0/1525781251 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2230078b90 0x7f223007b0a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f223c009b30 tx=0x7f223c005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:19.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.097+0000 7f222b7fe640 1 -- 172.21.15.105:0/1525781251 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2238062b80 con 0x7f22440d3870 2024-09-21T03:26:19.312 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.310+0000 7f22493c3640 1 -- 172.21.15.105:0/1525781251 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f224406e170 con 0x7f22440d3870 2024-09-21T03:26:19.315 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.311+0000 7f222b7fe640 1 -- 172.21.15.105:0/1525781251 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5237 (secure 0 0 0) 0x7f22380675b0 con 0x7f22440d3870 2024-09-21T03:26:19.315 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:26:19.315 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":75,"btime":"2024-09-21T03:26:11:467030+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6233,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/2073653576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2073653576},{"type":"v1","addr":"172.21.15.162:6837","nonce":2073653576}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":70},{"gid":6850,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2714893724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2714893724},{"type":"v1","addr":"172.21.15.162:6836","nonce":2714893724}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":70},{"gid":7590,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/2972986125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2972986125},{"type":"v1","addr":"172.21.15.105:6834","nonce":2972986125}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":70}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:25:50.598171+0000","modified":"2024-09-21T03:26:11.275296+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7593":{"gid":7593,"name":"a","rank":0,"incarnation":71,"state":"up:active","state_seq":8,"addr":"172.21.15.105:6835/3941149960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":3941149960},{"type":"v1","addr":"172.21.15.105:6835","nonce":3941149960}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7593,"qdb_cluster":[7593]},"id":9}]} 2024-09-21T03:26:19.316 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 75 2024-09-21T03:26:19.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.313+0000 7f22493c3640 1 -- 172.21.15.105:0/1525781251 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2230078b90 msgr2=0x7f223007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:19.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.313+0000 7f22493c3640 1 --2- 172.21.15.105:0/1525781251 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2230078b90 0x7f223007b0a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f223c009b30 tx=0x7f223c005f90 comp rx=0 tx=0).stop 2024-09-21T03:26:19.316 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.313+0000 7f22493c3640 1 -- 172.21.15.105:0/1525781251 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22440d3870 msgr2=0x7f224409ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:19.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.313+0000 7f22493c3640 1 --2- 172.21.15.105:0/1525781251 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22440d3870 0x7f224409ebe0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f223800d750 tx=0x7f223800dc10 comp rx=0 tx=0).stop 2024-09-21T03:26:19.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.313+0000 7f22493c3640 1 -- 172.21.15.105:0/1525781251 shutdown_connections 2024-09-21T03:26:19.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.313+0000 7f22493c3640 1 --2- 172.21.15.105:0/1525781251 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2230078b90 0x7f223007b0a0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:19.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.313+0000 7f22493c3640 1 --2- 172.21.15.105:0/1525781251 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2244155910 0x7f22440ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:19.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.313+0000 7f22493c3640 1 --2- 172.21.15.105:0/1525781251 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22440d3870 0x7f224409ebe0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:19.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.313+0000 7f22493c3640 1 --2- 172.21.15.105:0/1525781251 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f224406f4b0 0x7f22440a1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:19.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.313+0000 7f22493c3640 1 -- 172.21.15.105:0/1525781251 >> 172.21.15.105:0/1525781251 conn(0x7f224408bfc0 msgr2=0x7f22440b5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:19.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.313+0000 7f22493c3640 1 -- 172.21.15.105:0/1525781251 shutdown_connections 2024-09-21T03:26:19.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.313+0000 7f22493c3640 1 -- 172.21.15.105:0/1525781251 wait complete. 2024-09-21T03:26:19.326 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:26:19.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.437+0000 7f537c532640 1 -- 172.21.15.105:0/3877981046 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5374074420 msgr2=0x7f537406fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:19.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.437+0000 7f537c532640 1 --2- 172.21.15.105:0/3877981046 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5374074420 0x7f537406fe30 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f5374073910 tx=0x7f536402aa30 comp rx=0 tx=0).stop 2024-09-21T03:26:19.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.437+0000 7f537c532640 1 -- 172.21.15.105:0/3877981046 shutdown_connections 2024-09-21T03:26:19.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.437+0000 7f537c532640 1 --2- 172.21.15.105:0/3877981046 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5374155ce0 0x7f53740708b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:19.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.437+0000 7f537c532640 1 --2- 172.21.15.105:0/3877981046 >> v2:172.21.15.162:3300/0 conn(0x7f537415c580 0x7f5374070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:19.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.437+0000 7f537c532640 1 --2- 172.21.15.105:0/3877981046 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5374074420 0x7f537406fe30 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:19.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.437+0000 7f537c532640 1 -- 172.21.15.105:0/3877981046 >> 172.21.15.105:0/3877981046 conn(0x7f537406def0 msgr2=0x7f537406e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:19.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.437+0000 7f537c532640 1 -- 172.21.15.105:0/3877981046 shutdown_connections 2024-09-21T03:26:19.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.437+0000 7f537c532640 1 -- 172.21.15.105:0/3877981046 wait complete. 2024-09-21T03:26:19.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.439+0000 7f537c532640 1 Processor -- start 2024-09-21T03:26:19.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.439+0000 7f537c532640 1 -- start start 2024-09-21T03:26:19.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.440+0000 7f537c532640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5374074420 0x7f537414e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:19.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.440+0000 7f537c532640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5374155ce0 0x7f53741396d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:19.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.440+0000 7f537c532640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53741f2090 0x7f53741f24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:19.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.440+0000 7f537c532640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f537415fa00 con 0x7f53741f2090 2024-09-21T03:26:19.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.440+0000 7f537c532640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f537415f880 con 0x7f5374155ce0 2024-09-21T03:26:19.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.440+0000 7f537c532640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f537415fb80 con 0x7f5374074420 2024-09-21T03:26:19.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.440+0000 7f537aacf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53741f2090 0x7f53741f24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:19.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.440+0000 7f537aacf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53741f2090 0x7f53741f24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:37748/0 (socket says 172.21.15.105:37748) 2024-09-21T03:26:19.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.440+0000 7f537aacf640 1 -- 172.21.15.105:0/3664982969 learned_addr learned my addr 172.21.15.105:0/3664982969 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:19.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.440+0000 7f537a2ce640 1 --2- 172.21.15.105:0/3664982969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5374074420 0x7f537414e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:19.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.440+0000 7f5379acd640 1 --2- 172.21.15.105:0/3664982969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5374155ce0 0x7f53741396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:19.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.441+0000 7f537aacf640 1 -- 172.21.15.105:0/3664982969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5374074420 msgr2=0x7f537414e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:19.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.441+0000 7f537aacf640 1 --2- 172.21.15.105:0/3664982969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5374074420 0x7f537414e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:19.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.441+0000 7f537aacf640 1 -- 172.21.15.105:0/3664982969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5374155ce0 msgr2=0x7f53741396d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:19.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.441+0000 7f537aacf640 1 --2- 172.21.15.105:0/3664982969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5374155ce0 0x7f53741396d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:19.445 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.441+0000 7f537aacf640 1 -- 172.21.15.105:0/3664982969 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5374150570 con 0x7f53741f2090 2024-09-21T03:26:19.445 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.441+0000 7f537aacf640 1 --2- 172.21.15.105:0/3664982969 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53741f2090 0x7f53741f24a0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f536c00a720 tx=0x7f536c00abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:19.445 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.441+0000 7f5372ffd640 1 -- 172.21.15.105:0/3664982969 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f536c007bb0 con 0x7f53741f2090 2024-09-21T03:26:19.445 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.441+0000 7f5372ffd640 1 -- 172.21.15.105:0/3664982969 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f536c007e40 con 0x7f53741f2090 2024-09-21T03:26:19.445 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.441+0000 7f537c532640 1 -- 172.21.15.105:0/3664982969 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5374150850 con 0x7f53741f2090 2024-09-21T03:26:19.445 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.441+0000 7f5372ffd640 1 -- 172.21.15.105:0/3664982969 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f536c005280 con 0x7f53741f2090 2024-09-21T03:26:19.445 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.441+0000 7f537c532640 1 -- 172.21.15.105:0/3664982969 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53741f29e0 con 0x7f53741f2090 2024-09-21T03:26:19.445 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.442+0000 7f537c532640 1 -- 172.21.15.105:0/3664982969 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f537415c580 con 0x7f53741f2090 2024-09-21T03:26:19.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.443+0000 7f5372ffd640 1 -- 172.21.15.105:0/3664982969 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f536c00c050 con 0x7f53741f2090 2024-09-21T03:26:19.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.443+0000 7f5372ffd640 1 --2- 172.21.15.105:0/3664982969 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5360078bc0 0x7f536007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:19.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.444+0000 7f5372ffd640 1 -- 172.21.15.105:0/3664982969 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5767+0+0 (secure 0 0 0) 0x7f536c09b110 con 0x7f53741f2090 2024-09-21T03:26:19.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.444+0000 7f537a2ce640 1 --2- 172.21.15.105:0/3664982969 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5360078bc0 0x7f536007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:19.446 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.444+0000 7f537a2ce640 1 --2- 172.21.15.105:0/3664982969 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5360078bc0 0x7f536007b0d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5364035000 tx=0x7f5364004ab0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:19.450 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.448+0000 7f5372ffd640 1 -- 172.21.15.105:0/3664982969 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f536c013030 con 0x7f53741f2090 2024-09-21T03:26:19.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.661+0000 7f537c532640 1 -- 172.21.15.105:0/3664982969 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f537413a040 con 0x7f53741f2090 2024-09-21T03:26:19.664 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.662+0000 7f5372ffd640 1 -- 172.21.15.105:0/3664982969 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5238 (secure 0 0 0) 0x7f536c063510 con 0x7f53741f2090 2024-09-21T03:26:19.664 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:26:19.664 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":76,"btime":"2024-09-21T03:26:19:488955+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6233,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/2073653576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2073653576},{"type":"v1","addr":"172.21.15.162:6837","nonce":2073653576}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":70},{"gid":6850,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2714893724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2714893724},{"type":"v1","addr":"172.21.15.162:6836","nonce":2714893724}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":70},{"gid":7590,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/2972986125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2972986125},{"type":"v1","addr":"172.21.15.105:6834","nonce":2972986125}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":70}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:25:50.598171+0000","modified":"2024-09-21T03:26:19.275327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7593":{"gid":7593,"name":"a","rank":0,"incarnation":71,"state":"up:active","state_seq":10,"addr":"172.21.15.105:6835/3941149960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":3941149960},{"type":"v1","addr":"172.21.15.105:6835","nonce":3941149960}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7593,"qdb_cluster":[7593]},"id":9}]} 2024-09-21T03:26:19.664 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 76 2024-09-21T03:26:19.666 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.664+0000 7f537c532640 1 -- 172.21.15.105:0/3664982969 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5360078bc0 msgr2=0x7f536007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:19.666 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.664+0000 7f537c532640 1 --2- 172.21.15.105:0/3664982969 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5360078bc0 0x7f536007b0d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5364035000 tx=0x7f5364004ab0 comp rx=0 tx=0).stop 2024-09-21T03:26:19.667 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.664+0000 7f537c532640 1 -- 172.21.15.105:0/3664982969 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53741f2090 msgr2=0x7f53741f24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:19.667 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.664+0000 7f537c532640 1 --2- 172.21.15.105:0/3664982969 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53741f2090 0x7f53741f24a0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f536c00a720 tx=0x7f536c00abe0 comp rx=0 tx=0).stop 2024-09-21T03:26:19.667 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.664+0000 7f537c532640 1 -- 172.21.15.105:0/3664982969 shutdown_connections 2024-09-21T03:26:19.667 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.664+0000 7f537c532640 1 --2- 172.21.15.105:0/3664982969 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5360078bc0 0x7f536007b0d0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:19.667 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.664+0000 7f537c532640 1 --2- 172.21.15.105:0/3664982969 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53741f2090 0x7f53741f24a0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:19.667 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.664+0000 7f537c532640 1 --2- 172.21.15.105:0/3664982969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5374155ce0 0x7f53741396d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:19.667 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.664+0000 7f537c532640 1 --2- 172.21.15.105:0/3664982969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5374074420 0x7f537414e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:19.667 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.664+0000 7f537c532640 1 -- 172.21.15.105:0/3664982969 >> 172.21.15.105:0/3664982969 conn(0x7f537406def0 msgr2=0x7f537414aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:19.667 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.664+0000 7f537c532640 1 -- 172.21.15.105:0/3664982969 shutdown_connections 2024-09-21T03:26:19.667 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.664+0000 7f537c532640 1 -- 172.21.15.105:0/3664982969 wait complete. 2024-09-21T03:26:19.677 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:26:19.789 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.787+0000 7fbe7cf8b640 1 -- 172.21.15.105:0/2492034845 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe780b3db0 msgr2=0x7fbe780b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:19.789 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.787+0000 7fbe7cf8b640 1 --2- 172.21.15.105:0/2492034845 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe780b3db0 0x7fbe780b8c10 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fbe70005fd0 tx=0x7fbe7002aa90 comp rx=0 tx=0).stop 2024-09-21T03:26:19.790 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.787+0000 7fbe7cf8b640 1 -- 172.21.15.105:0/2492034845 shutdown_connections 2024-09-21T03:26:19.790 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.787+0000 7fbe7cf8b640 1 --2- 172.21.15.105:0/2492034845 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe780b3db0 0x7fbe780b8c10 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:19.790 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.787+0000 7fbe7cf8b640 1 -- 172.21.15.105:0/2492034845 >> 172.21.15.105:0/2492034845 conn(0x7fbe7808bfc0 msgr2=0x7fbe7809d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:19.790 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.787+0000 7fbe7cf8b640 1 -- 172.21.15.105:0/2492034845 shutdown_connections 2024-09-21T03:26:19.790 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.787+0000 7fbe7cf8b640 1 -- 172.21.15.105:0/2492034845 wait complete. 2024-09-21T03:26:19.791 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.789+0000 7fbe7cf8b640 1 Processor -- start 2024-09-21T03:26:19.791 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.789+0000 7fbe7cf8b640 1 -- start start 2024-09-21T03:26:19.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.791+0000 7fbe7cf8b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe780b39a0 0x7fbe78159870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:19.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.791+0000 7fbe7cf8b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe780b3db0 0x7fbe780cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:19.794 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.791+0000 7fbe7cf8b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe780d4ad0 0x7fbe780b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:19.794 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.791+0000 7fbe7cf8b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbe780b9520 con 0x7fbe780b3db0 2024-09-21T03:26:19.794 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.791+0000 7fbe7cf8b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbe780b93a0 con 0x7fbe780b39a0 2024-09-21T03:26:19.794 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.791+0000 7fbe7cf8b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbe780b96a0 con 0x7fbe780d4ad0 2024-09-21T03:26:19.794 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.791+0000 7fbe75d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe780b3db0 0x7fbe780cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:19.794 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.791+0000 7fbe75d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe780b3db0 0x7fbe780cfdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:37764/0 (socket says 172.21.15.105:37764) 2024-09-21T03:26:19.794 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.791+0000 7fbe75d9b640 1 -- 172.21.15.105:0/3625462290 learned_addr learned my addr 172.21.15.105:0/3625462290 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:19.794 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.791+0000 7fbe76d9d640 1 --2- 172.21.15.105:0/3625462290 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe780d4ad0 0x7fbe780b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:19.794 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.791+0000 7fbe7659c640 1 --2- 172.21.15.105:0/3625462290 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe780b39a0 0x7fbe78159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:19.794 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.791+0000 7fbe75d9b640 1 -- 172.21.15.105:0/3625462290 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe780d4ad0 msgr2=0x7fbe780b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:19.794 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.791+0000 7fbe75d9b640 1 --2- 172.21.15.105:0/3625462290 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe780d4ad0 0x7fbe780b29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:19.794 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.791+0000 7fbe75d9b640 1 -- 172.21.15.105:0/3625462290 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe780b39a0 msgr2=0x7fbe78159870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:19.794 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.791+0000 7fbe75d9b640 1 --2- 172.21.15.105:0/3625462290 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe780b39a0 0x7fbe78159870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:19.795 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.791+0000 7fbe75d9b640 1 -- 172.21.15.105:0/3625462290 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe781f02e0 con 0x7fbe780b3db0 2024-09-21T03:26:19.795 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.791+0000 7fbe75d9b640 1 --2- 172.21.15.105:0/3625462290 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe780b3db0 0x7fbe780cfdb0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c00c3a0 tx=0x7fbe6c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:19.795 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.791+0000 7fbe66ffd640 1 -- 172.21.15.105:0/3625462290 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c017070 con 0x7fbe780b3db0 2024-09-21T03:26:19.795 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.791+0000 7fbe66ffd640 1 -- 172.21.15.105:0/3625462290 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe6c0035f0 con 0x7fbe780b3db0 2024-09-21T03:26:19.795 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.791+0000 7fbe7cf8b640 1 -- 172.21.15.105:0/3625462290 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe781f60b0 con 0x7fbe780b3db0 2024-09-21T03:26:19.795 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.791+0000 7fbe66ffd640 1 -- 172.21.15.105:0/3625462290 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c003a40 con 0x7fbe780b3db0 2024-09-21T03:26:19.795 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.791+0000 7fbe7cf8b640 1 -- 172.21.15.105:0/3625462290 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe781f6670 con 0x7fbe780b3db0 2024-09-21T03:26:19.796 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.792+0000 7fbe7cf8b640 1 -- 172.21.15.105:0/3625462290 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe780d06c0 con 0x7fbe780b3db0 2024-09-21T03:26:19.796 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.793+0000 7fbe66ffd640 1 -- 172.21.15.105:0/3625462290 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbe6c01a070 con 0x7fbe780b3db0 2024-09-21T03:26:19.796 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.794+0000 7fbe66ffd640 1 --2- 172.21.15.105:0/3625462290 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbe58078b90 0x7fbe5807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:19.796 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.794+0000 7fbe66ffd640 1 -- 172.21.15.105:0/3625462290 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5767+0+0 (secure 0 0 0) 0x7fbe6c09a100 con 0x7fbe780b3db0 2024-09-21T03:26:19.796 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.794+0000 7fbe7659c640 1 --2- 172.21.15.105:0/3625462290 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbe58078b90 0x7fbe5807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:19.796 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.795+0000 7fbe7659c640 1 --2- 172.21.15.105:0/3625462290 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbe58078b90 0x7fbe5807b0a0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbe780a24d0 tx=0x7fbe68008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:19.800 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.798+0000 7fbe66ffd640 1 -- 172.21.15.105:0/3625462290 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbe780d3460 con 0x7fbe780b3db0 2024-09-21T03:26:19.979 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.977+0000 7fbe7cf8b640 1 -- 172.21.15.105:0/3625462290 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbe780d43c0 con 0x7fbe780b3db0 2024-09-21T03:26:19.980 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.978+0000 7fbe66ffd640 1 -- 172.21.15.105:0/3625462290 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) ==== 74+0+16852 (secure 0 0 0) 0x7fbe6c062480 con 0x7fbe780b3db0 2024-09-21T03:26:19.980 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:26:19.980 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":118,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:26:11.467195+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:25:48.253350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-21T03:25:49.567236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.a","mappings":[{"from":2,"to":0}]},{"pgid":"19.22","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:26:19.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.980+0000 7fbe7cf8b640 1 -- 172.21.15.105:0/3625462290 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbe58078b90 msgr2=0x7fbe5807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:19.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.980+0000 7fbe7cf8b640 1 --2- 172.21.15.105:0/3625462290 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbe58078b90 0x7fbe5807b0a0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbe780a24d0 tx=0x7fbe68008040 comp rx=0 tx=0).stop 2024-09-21T03:26:19.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.980+0000 7fbe7cf8b640 1 -- 172.21.15.105:0/3625462290 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe780b3db0 msgr2=0x7fbe780cfdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:19.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.980+0000 7fbe7cf8b640 1 --2- 172.21.15.105:0/3625462290 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe780b3db0 0x7fbe780cfdb0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c00c3a0 tx=0x7fbe6c00c860 comp rx=0 tx=0).stop 2024-09-21T03:26:19.983 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.980+0000 7fbe7cf8b640 1 -- 172.21.15.105:0/3625462290 shutdown_connections 2024-09-21T03:26:19.983 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.980+0000 7fbe7cf8b640 1 --2- 172.21.15.105:0/3625462290 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbe58078b90 0x7fbe5807b0a0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:19.983 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.980+0000 7fbe7cf8b640 1 --2- 172.21.15.105:0/3625462290 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe780d4ad0 0x7fbe780b29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:19.983 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.980+0000 7fbe7cf8b640 1 --2- 172.21.15.105:0/3625462290 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe780b3db0 0x7fbe780cfdb0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:19.983 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.980+0000 7fbe7cf8b640 1 --2- 172.21.15.105:0/3625462290 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe780b39a0 0x7fbe78159870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:19.983 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.980+0000 7fbe7cf8b640 1 -- 172.21.15.105:0/3625462290 >> 172.21.15.105:0/3625462290 conn(0x7fbe7808bfc0 msgr2=0x7fbe780b7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:19.983 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.980+0000 7fbe7cf8b640 1 -- 172.21.15.105:0/3625462290 shutdown_connections 2024-09-21T03:26:19.983 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:19.980+0000 7fbe7cf8b640 1 -- 172.21.15.105:0/3625462290 wait complete. 2024-09-21T03:26:19.993 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T03:26:19.993 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:26:20.106 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.104+0000 7fc613ded640 1 -- 172.21.15.105:0/2722573305 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5f8004800 msgr2=0x7fc5f8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:20.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.104+0000 7fc613ded640 1 --2- 172.21.15.105:0/2722573305 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5f8004800 0x7fc5f8004c10 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc009b50 tx=0x7fc5f8005830 comp rx=0 tx=0).stop 2024-09-21T03:26:20.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.104+0000 7fc613ded640 1 -- 172.21.15.105:0/2722573305 shutdown_connections 2024-09-21T03:26:20.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.104+0000 7fc613ded640 1 --2- 172.21.15.105:0/2722573305 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5f8004800 0x7fc5f8004c10 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:20.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.104+0000 7fc613ded640 1 -- 172.21.15.105:0/2722573305 >> 172.21.15.105:0/2722573305 conn(0x7fc60c0cd530 msgr2=0x7fc60c0cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:20.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.104+0000 7fc613ded640 1 -- 172.21.15.105:0/2722573305 shutdown_connections 2024-09-21T03:26:20.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.104+0000 7fc613ded640 1 -- 172.21.15.105:0/2722573305 wait complete. 2024-09-21T03:26:20.108 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.106+0000 7fc613ded640 1 Processor -- start 2024-09-21T03:26:20.108 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.106+0000 7fc613ded640 1 -- start start 2024-09-21T03:26:20.110 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.107+0000 7fc613ded640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5f8004800 0x7fc60c0b5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:20.110 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.107+0000 7fc613ded640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc60c06d660 0x7fc60c159f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:20.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.107+0000 7fc613ded640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc60c06da70 0x7fc60c15a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:20.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.107+0000 7fc613ded640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc60c0c9f60 con 0x7fc60c06da70 2024-09-21T03:26:20.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.107+0000 7fc613ded640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc60c0c9de0 con 0x7fc5f8004800 2024-09-21T03:26:20.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.107+0000 7fc613ded640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc60c0ca0e0 con 0x7fc60c06d660 2024-09-21T03:26:20.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.108+0000 7fc61238a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc60c06da70 0x7fc60c15a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:20.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.108+0000 7fc61238a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc60c06da70 0x7fc60c15a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:37788/0 (socket says 172.21.15.105:37788) 2024-09-21T03:26:20.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.108+0000 7fc61238a640 1 -- 172.21.15.105:0/2126098236 learned_addr learned my addr 172.21.15.105:0/2126098236 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:20.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.108+0000 7fc611b89640 1 --2- 172.21.15.105:0/2126098236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5f8004800 0x7fc60c0b5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:20.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.108+0000 7fc611388640 1 --2- 172.21.15.105:0/2126098236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc60c06d660 0x7fc60c159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:20.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.108+0000 7fc61238a640 1 -- 172.21.15.105:0/2126098236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc60c06d660 msgr2=0x7fc60c159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:20.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.108+0000 7fc61238a640 1 --2- 172.21.15.105:0/2126098236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc60c06d660 0x7fc60c159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:20.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.108+0000 7fc61238a640 1 -- 172.21.15.105:0/2126098236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5f8004800 msgr2=0x7fc60c0b5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:20.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.108+0000 7fc61238a640 1 --2- 172.21.15.105:0/2126098236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5f8004800 0x7fc60c0b5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:20.111 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.108+0000 7fc61238a640 1 -- 172.21.15.105:0/2126098236 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc60c1f59a0 con 0x7fc60c06da70 2024-09-21T03:26:20.112 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.108+0000 7fc611388640 1 --2- 172.21.15.105:0/2126098236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc60c06d660 0x7fc60c159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:26:20.112 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.108+0000 7fc61238a640 1 --2- 172.21.15.105:0/2126098236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc60c06da70 0x7fc60c15a4d0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fc60c072970 tx=0x7fc604006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:20.112 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.108+0000 7fc6027fc640 1 -- 172.21.15.105:0/2126098236 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc604011840 con 0x7fc60c06da70 2024-09-21T03:26:20.112 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.108+0000 7fc6027fc640 1 -- 172.21.15.105:0/2126098236 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc604018070 con 0x7fc60c06da70 2024-09-21T03:26:20.112 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.108+0000 7fc613ded640 1 -- 172.21.15.105:0/2126098236 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc60c1f5c80 con 0x7fc60c06da70 2024-09-21T03:26:20.112 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.108+0000 7fc6027fc640 1 -- 172.21.15.105:0/2126098236 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc604011c80 con 0x7fc60c06da70 2024-09-21T03:26:20.112 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.108+0000 7fc613ded640 1 -- 172.21.15.105:0/2126098236 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc60c1f6240 con 0x7fc60c06da70 2024-09-21T03:26:20.113 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.109+0000 7fc613ded640 1 -- 172.21.15.105:0/2126098236 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc60c0b5fb0 con 0x7fc60c06da70 2024-09-21T03:26:20.113 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.111+0000 7fc6027fc640 1 -- 172.21.15.105:0/2126098236 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc604027430 con 0x7fc60c06da70 2024-09-21T03:26:20.113 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.111+0000 7fc6027fc640 1 --2- 172.21.15.105:0/2126098236 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc5f0078b90 0x7fc5f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:20.113 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.111+0000 7fc6027fc640 1 -- 172.21.15.105:0/2126098236 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5767+0+0 (secure 0 0 0) 0x7fc60409c040 con 0x7fc60c06da70 2024-09-21T03:26:20.113 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.112+0000 7fc611b89640 1 --2- 172.21.15.105:0/2126098236 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc5f0078b90 0x7fc5f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:20.113 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.112+0000 7fc611b89640 1 --2- 172.21.15.105:0/2126098236 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc5f0078b90 0x7fc5f007b0a0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fc608001050 tx=0x7fc608006910 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:20.116 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.115+0000 7fc6027fc640 1 -- 172.21.15.105:0/2126098236 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc604011e20 con 0x7fc60c06da70 2024-09-21T03:26:20.327 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.325+0000 7fc613ded640 1 -- 172.21.15.105:0/2126098236 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc60c163040 con 0x7fc60c06da70 2024-09-21T03:26:20.327 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.326+0000 7fc6027fc640 1 -- 172.21.15.105:0/2126098236 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5238 (secure 0 0 0) 0x7fc604064520 con 0x7fc60c06da70 2024-09-21T03:26:20.327 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:26:20.327 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":76,"btime":"2024-09-21T03:26:19:488955+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6233,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/2073653576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2073653576},{"type":"v1","addr":"172.21.15.162:6837","nonce":2073653576}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":70},{"gid":6850,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2714893724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2714893724},{"type":"v1","addr":"172.21.15.162:6836","nonce":2714893724}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":70},{"gid":7590,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/2972986125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2972986125},{"type":"v1","addr":"172.21.15.105:6834","nonce":2972986125}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":70}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:25:50.598171+0000","modified":"2024-09-21T03:26:19.275327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7593":{"gid":7593,"name":"a","rank":0,"incarnation":71,"state":"up:active","state_seq":10,"addr":"172.21.15.105:6835/3941149960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":3941149960},{"type":"v1","addr":"172.21.15.105:6835","nonce":3941149960}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7593,"qdb_cluster":[7593]},"id":9}]} 2024-09-21T03:26:20.328 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 76 2024-09-21T03:26:20.330 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.328+0000 7fc613ded640 1 -- 172.21.15.105:0/2126098236 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc5f0078b90 msgr2=0x7fc5f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:20.330 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.328+0000 7fc613ded640 1 --2- 172.21.15.105:0/2126098236 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc5f0078b90 0x7fc5f007b0a0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fc608001050 tx=0x7fc608006910 comp rx=0 tx=0).stop 2024-09-21T03:26:20.330 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.328+0000 7fc613ded640 1 -- 172.21.15.105:0/2126098236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc60c06da70 msgr2=0x7fc60c15a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:20.330 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.328+0000 7fc613ded640 1 --2- 172.21.15.105:0/2126098236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc60c06da70 0x7fc60c15a4d0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fc60c072970 tx=0x7fc604006430 comp rx=0 tx=0).stop 2024-09-21T03:26:20.330 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.328+0000 7fc613ded640 1 -- 172.21.15.105:0/2126098236 shutdown_connections 2024-09-21T03:26:20.330 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.328+0000 7fc613ded640 1 --2- 172.21.15.105:0/2126098236 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc5f0078b90 0x7fc5f007b0a0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:20.330 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.328+0000 7fc613ded640 1 --2- 172.21.15.105:0/2126098236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc60c06da70 0x7fc60c15a4d0 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:20.330 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.328+0000 7fc613ded640 1 --2- 172.21.15.105:0/2126098236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc60c06d660 0x7fc60c159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:20.330 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.328+0000 7fc613ded640 1 --2- 172.21.15.105:0/2126098236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5f8004800 0x7fc60c0b5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:20.331 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.328+0000 7fc613ded640 1 -- 172.21.15.105:0/2126098236 >> 172.21.15.105:0/2126098236 conn(0x7fc60c0cd530 msgr2=0x7fc60c0cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:20.331 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.328+0000 7fc613ded640 1 -- 172.21.15.105:0/2126098236 shutdown_connections 2024-09-21T03:26:20.331 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.328+0000 7fc613ded640 1 -- 172.21.15.105:0/2126098236 wait complete. 2024-09-21T03:26:20.341 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:26:20.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.451+0000 7f6cd7dc3640 1 -- 172.21.15.105:0/2799554700 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6cd01600b0 msgr2=0x7f6cd00ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:20.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.451+0000 7f6cd7dc3640 1 --2- 172.21.15.105:0/2799554700 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6cd01600b0 0x7f6cd00ccbc0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f6cd00ce1b0 tx=0x7f6ccc02a560 comp rx=0 tx=0).stop 2024-09-21T03:26:20.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.451+0000 7f6cd7dc3640 1 -- 172.21.15.105:0/2799554700 shutdown_connections 2024-09-21T03:26:20.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.451+0000 7f6cd7dc3640 1 --2- 172.21.15.105:0/2799554700 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6cd00cf150 0x7f6cd00b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:20.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.451+0000 7f6cd7dc3640 1 --2- 172.21.15.105:0/2799554700 >> v2:172.21.15.162:3300/0 conn(0x7f6cd00b7cc0 0x7f6cd00cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:20.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.451+0000 7f6cd7dc3640 1 --2- 172.21.15.105:0/2799554700 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6cd01600b0 0x7f6cd00ccbc0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:20.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.451+0000 7f6cd7dc3640 1 -- 172.21.15.105:0/2799554700 >> 172.21.15.105:0/2799554700 conn(0x7f6cd006d4f0 msgr2=0x7f6cd0071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:20.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.451+0000 7f6cd7dc3640 1 -- 172.21.15.105:0/2799554700 shutdown_connections 2024-09-21T03:26:20.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.451+0000 7f6cd7dc3640 1 -- 172.21.15.105:0/2799554700 wait complete. 2024-09-21T03:26:20.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.453+0000 7f6cd7dc3640 1 Processor -- start 2024-09-21T03:26:20.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.453+0000 7f6cd7dc3640 1 -- start start 2024-09-21T03:26:20.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.454+0000 7f6cd7dc3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6cd00b7cc0 0x7f6cd01595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:20.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.454+0000 7f6cd7dc3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cd00cf150 0x7f6cd00ab120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:20.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.454+0000 7f6cd7dc3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6cd01600b0 0x7f6cd00ab660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:20.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.454+0000 7f6cd7dc3640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd00b4620 con 0x7f6cd01600b0 2024-09-21T03:26:20.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.454+0000 7f6cd7dc3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd00b44a0 con 0x7f6cd00cf150 2024-09-21T03:26:20.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.454+0000 7f6cd7dc3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6cd00b47a0 con 0x7f6cd00b7cc0 2024-09-21T03:26:20.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.454+0000 7f6cd6360640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6cd01600b0 0x7f6cd00ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:20.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.454+0000 7f6cd6360640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6cd01600b0 0x7f6cd00ab660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:37810/0 (socket says 172.21.15.105:37810) 2024-09-21T03:26:20.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.454+0000 7f6cd6360640 1 -- 172.21.15.105:0/3403566042 learned_addr learned my addr 172.21.15.105:0/3403566042 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:20.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.454+0000 7f6cd5b5f640 1 --2- 172.21.15.105:0/3403566042 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6cd00b7cc0 0x7f6cd01595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:20.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.455+0000 7f6cd6360640 1 -- 172.21.15.105:0/3403566042 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6cd00b7cc0 msgr2=0x7f6cd01595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:20.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.455+0000 7f6cd6360640 1 --2- 172.21.15.105:0/3403566042 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6cd00b7cc0 0x7f6cd01595b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:20.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.455+0000 7f6cd6360640 1 -- 172.21.15.105:0/3403566042 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cd00cf150 msgr2=0x7f6cd00ab120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:20.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.455+0000 7f6cd535e640 1 --2- 172.21.15.105:0/3403566042 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cd00cf150 0x7f6cd00ab120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:20.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.455+0000 7f6cd6360640 1 --2- 172.21.15.105:0/3403566042 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cd00cf150 0x7f6cd00ab120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:20.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.455+0000 7f6cd6360640 1 -- 172.21.15.105:0/3403566042 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd00aa7f0 con 0x7f6cd01600b0 2024-09-21T03:26:20.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.455+0000 7f6cd6360640 1 --2- 172.21.15.105:0/3403566042 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6cd01600b0 0x7f6cd00ab660 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f6cc800e9c0 tx=0x7f6cc800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:20.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.455+0000 7f6cc67fc640 1 -- 172.21.15.105:0/3403566042 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc8004d20 con 0x7f6cd01600b0 2024-09-21T03:26:20.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.455+0000 7f6cc67fc640 1 -- 172.21.15.105:0/3403566042 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6cc800cb20 con 0x7f6cd01600b0 2024-09-21T03:26:20.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.455+0000 7f6cd7dc3640 1 -- 172.21.15.105:0/3403566042 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cd00a9f50 con 0x7f6cd01600b0 2024-09-21T03:26:20.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.455+0000 7f6cc67fc640 1 -- 172.21.15.105:0/3403566042 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc8005020 con 0x7f6cd01600b0 2024-09-21T03:26:20.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.455+0000 7f6cd7dc3640 1 -- 172.21.15.105:0/3403566042 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cd00aa510 con 0x7f6cd01600b0 2024-09-21T03:26:20.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.456+0000 7f6cd7dc3640 1 -- 172.21.15.105:0/3403566042 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cd00b3d50 con 0x7f6cd01600b0 2024-09-21T03:26:20.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.457+0000 7f6cc67fc640 1 -- 172.21.15.105:0/3403566042 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6cc80051c0 con 0x7f6cd01600b0 2024-09-21T03:26:20.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.457+0000 7f6cc67fc640 1 --2- 172.21.15.105:0/3403566042 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6cb4078bc0 0x7f6cb407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:20.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.457+0000 7f6cc67fc640 1 -- 172.21.15.105:0/3403566042 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5767+0+0 (secure 0 0 0) 0x7f6cc809b5b0 con 0x7f6cd01600b0 2024-09-21T03:26:20.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.457+0000 7f6cd5b5f640 1 --2- 172.21.15.105:0/3403566042 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6cb4078bc0 0x7f6cb407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:20.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.458+0000 7f6cd5b5f640 1 --2- 172.21.15.105:0/3403566042 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6cb4078bc0 0x7f6cb407b0d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc033000 tx=0x7f6ccc004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:20.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.462+0000 7f6cc67fc640 1 -- 172.21.15.105:0/3403566042 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6cc8016030 con 0x7f6cd01600b0 2024-09-21T03:26:20.674 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.672+0000 7f6cd7dc3640 1 -- 172.21.15.105:0/3403566042 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6cd00cc990 con 0x7f6cd01600b0 2024-09-21T03:26:20.675 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.673+0000 7f6cc67fc640 1 -- 172.21.15.105:0/3403566042 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5238 (secure 0 0 0) 0x7f6cc8063a20 con 0x7f6cd01600b0 2024-09-21T03:26:20.675 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:26:20.675 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":76,"btime":"2024-09-21T03:26:19:488955+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6233,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/2073653576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2073653576},{"type":"v1","addr":"172.21.15.162:6837","nonce":2073653576}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":70},{"gid":6850,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2714893724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2714893724},{"type":"v1","addr":"172.21.15.162:6836","nonce":2714893724}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":70},{"gid":7590,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/2972986125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2972986125},{"type":"v1","addr":"172.21.15.105:6834","nonce":2972986125}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":70}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:25:50.598171+0000","modified":"2024-09-21T03:26:19.275327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7593},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7593":{"gid":7593,"name":"a","rank":0,"incarnation":71,"state":"up:active","state_seq":10,"addr":"172.21.15.105:6835/3941149960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":3941149960},{"type":"v1","addr":"172.21.15.105:6835","nonce":3941149960}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7593,"qdb_cluster":[7593]},"id":9}]} 2024-09-21T03:26:20.675 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 76 2024-09-21T03:26:20.677 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.675+0000 7f6cd7dc3640 1 -- 172.21.15.105:0/3403566042 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6cb4078bc0 msgr2=0x7f6cb407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:20.677 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.675+0000 7f6cd7dc3640 1 --2- 172.21.15.105:0/3403566042 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6cb4078bc0 0x7f6cb407b0d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc033000 tx=0x7f6ccc004730 comp rx=0 tx=0).stop 2024-09-21T03:26:20.677 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.675+0000 7f6cd7dc3640 1 -- 172.21.15.105:0/3403566042 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6cd01600b0 msgr2=0x7f6cd00ab660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:20.677 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.675+0000 7f6cd7dc3640 1 --2- 172.21.15.105:0/3403566042 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6cd01600b0 0x7f6cd00ab660 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f6cc800e9c0 tx=0x7f6cc800ee80 comp rx=0 tx=0).stop 2024-09-21T03:26:20.677 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.675+0000 7f6cd7dc3640 1 -- 172.21.15.105:0/3403566042 shutdown_connections 2024-09-21T03:26:20.677 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.675+0000 7f6cd7dc3640 1 --2- 172.21.15.105:0/3403566042 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6cb4078bc0 0x7f6cb407b0d0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:20.677 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.675+0000 7f6cd7dc3640 1 --2- 172.21.15.105:0/3403566042 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6cd01600b0 0x7f6cd00ab660 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:20.677 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.675+0000 7f6cd7dc3640 1 --2- 172.21.15.105:0/3403566042 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cd00cf150 0x7f6cd00ab120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:20.677 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.675+0000 7f6cd7dc3640 1 --2- 172.21.15.105:0/3403566042 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6cd00b7cc0 0x7f6cd01595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:20.677 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.675+0000 7f6cd7dc3640 1 -- 172.21.15.105:0/3403566042 >> 172.21.15.105:0/3403566042 conn(0x7f6cd006d4f0 msgr2=0x7f6cd00b32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:20.677 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.675+0000 7f6cd7dc3640 1 -- 172.21.15.105:0/3403566042 shutdown_connections 2024-09-21T03:26:20.678 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.675+0000 7f6cd7dc3640 1 -- 172.21.15.105:0/3403566042 wait complete. 2024-09-21T03:26:20.688 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:26:20.799 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.798+0000 7f0a63707640 1 -- 172.21.15.105:0/467424343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a5c0b5710 msgr2=0x7f0a5c0b4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:20.800 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.798+0000 7f0a63707640 1 --2- 172.21.15.105:0/467424343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a5c0b5710 0x7f0a5c0b4090 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c005fd0 tx=0x7f0a4c02a4a0 comp rx=0 tx=0).stop 2024-09-21T03:26:20.800 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.798+0000 7f0a63707640 1 -- 172.21.15.105:0/467424343 shutdown_connections 2024-09-21T03:26:20.800 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.798+0000 7f0a63707640 1 --2- 172.21.15.105:0/467424343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a5c0b5710 0x7f0a5c0b4090 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:20.800 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.798+0000 7f0a63707640 1 --2- 172.21.15.105:0/467424343 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a5c075170 0x7f0a5c0b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:20.800 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.798+0000 7f0a63707640 1 -- 172.21.15.105:0/467424343 >> 172.21.15.105:0/467424343 conn(0x7f0a5c0cdcc0 msgr2=0x7f0a5c0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:20.800 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.798+0000 7f0a63707640 1 -- 172.21.15.105:0/467424343 shutdown_connections 2024-09-21T03:26:20.800 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.798+0000 7f0a63707640 1 -- 172.21.15.105:0/467424343 wait complete. 2024-09-21T03:26:20.801 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.799+0000 7f0a63707640 1 Processor -- start 2024-09-21T03:26:20.801 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.800+0000 7f0a63707640 1 -- start start 2024-09-21T03:26:20.803 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.801+0000 7f0a63707640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a5c0b45d0 0x7f0a5c09d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:20.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.801+0000 7f0a63707640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a5c0b5710 0x7f0a5c159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:20.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.801+0000 7f0a63707640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a5c09aa30 0x7f0a5c09ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:20.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.801+0000 7f0a63707640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5c0b3960 con 0x7f0a5c0b5710 2024-09-21T03:26:20.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.801+0000 7f0a63707640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5c0b37e0 con 0x7f0a5c09aa30 2024-09-21T03:26:20.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.801+0000 7f0a63707640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0a5c0b3ae0 con 0x7f0a5c0b45d0 2024-09-21T03:26:20.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.801+0000 7f0a60ca2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a5c0b5710 0x7f0a5c159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:20.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.801+0000 7f0a60ca2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a5c0b5710 0x7f0a5c159300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:37822/0 (socket says 172.21.15.105:37822) 2024-09-21T03:26:20.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.801+0000 7f0a60ca2640 1 -- 172.21.15.105:0/1537259461 learned_addr learned my addr 172.21.15.105:0/1537259461 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:20.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.801+0000 7f0a614a3640 1 --2- 172.21.15.105:0/1537259461 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a5c0b45d0 0x7f0a5c09d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:20.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.801+0000 7f0a61ca4640 1 --2- 172.21.15.105:0/1537259461 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a5c09aa30 0x7f0a5c09ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:20.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.801+0000 7f0a60ca2640 1 -- 172.21.15.105:0/1537259461 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a5c0b45d0 msgr2=0x7f0a5c09d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:20.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.801+0000 7f0a60ca2640 1 --2- 172.21.15.105:0/1537259461 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a5c0b45d0 0x7f0a5c09d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:20.804 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.801+0000 7f0a60ca2640 1 -- 172.21.15.105:0/1537259461 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a5c09aa30 msgr2=0x7f0a5c09ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:20.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.801+0000 7f0a60ca2640 1 --2- 172.21.15.105:0/1537259461 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a5c09aa30 0x7f0a5c09ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:20.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.801+0000 7f0a60ca2640 1 -- 172.21.15.105:0/1537259461 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a5c09b380 con 0x7f0a5c0b5710 2024-09-21T03:26:20.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.801+0000 7f0a61ca4640 1 --2- 172.21.15.105:0/1537259461 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a5c09aa30 0x7f0a5c09ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:26:20.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.801+0000 7f0a60ca2640 1 --2- 172.21.15.105:0/1537259461 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a5c0b5710 0x7f0a5c159300 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c034040 tx=0x7f0a4c0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:20.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.801+0000 7f0a51ffb640 1 -- 172.21.15.105:0/1537259461 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c03e030 con 0x7f0a5c0b5710 2024-09-21T03:26:20.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.801+0000 7f0a51ffb640 1 -- 172.21.15.105:0/1537259461 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a4c0047a0 con 0x7f0a5c0b5710 2024-09-21T03:26:20.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.802+0000 7f0a51ffb640 1 -- 172.21.15.105:0/1537259461 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c035040 con 0x7f0a5c0b5710 2024-09-21T03:26:20.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.802+0000 7f0a63707640 1 -- 172.21.15.105:0/1537259461 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a5c09e2f0 con 0x7f0a5c0b5710 2024-09-21T03:26:20.805 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.802+0000 7f0a63707640 1 -- 172.21.15.105:0/1537259461 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a5c09e8b0 con 0x7f0a5c0b5710 2024-09-21T03:26:20.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.803+0000 7f0a63707640 1 -- 172.21.15.105:0/1537259461 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a5c075170 con 0x7f0a5c0b5710 2024-09-21T03:26:20.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.804+0000 7f0a51ffb640 1 -- 172.21.15.105:0/1537259461 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0a4c041030 con 0x7f0a5c0b5710 2024-09-21T03:26:20.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.804+0000 7f0a51ffb640 1 --2- 172.21.15.105:0/1537259461 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0a40078b90 0x7f0a4007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:20.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.804+0000 7f0a51ffb640 1 -- 172.21.15.105:0/1537259461 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5767+0+0 (secure 0 0 0) 0x7f0a4c0bb680 con 0x7f0a5c0b5710 2024-09-21T03:26:20.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.804+0000 7f0a614a3640 1 --2- 172.21.15.105:0/1537259461 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0a40078b90 0x7f0a4007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:20.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.805+0000 7f0a614a3640 1 --2- 172.21.15.105:0/1537259461 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0a40078b90 0x7f0a4007b0a0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f0a58005d70 tx=0x7f0a58005d00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:20.810 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.809+0000 7f0a51ffb640 1 -- 172.21.15.105:0/1537259461 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0a5c09b380 con 0x7f0a5c0b5710 2024-09-21T03:26:20.988 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.986+0000 7f0a63707640 1 -- 172.21.15.105:0/1537259461 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0a5c0b54f0 con 0x7f0a5c0b5710 2024-09-21T03:26:20.989 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.987+0000 7f0a51ffb640 1 -- 172.21.15.105:0/1537259461 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) ==== 74+0+16852 (secure 0 0 0) 0x7f0a4c083a80 con 0x7f0a5c0b5710 2024-09-21T03:26:20.990 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:26:20.990 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":118,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:26:11.467195+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:25:48.253350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-21T03:25:49.567236+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.a","mappings":[{"from":2,"to":0}]},{"pgid":"19.22","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:26:20.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.990+0000 7f0a63707640 1 -- 172.21.15.105:0/1537259461 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0a40078b90 msgr2=0x7f0a4007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:20.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.990+0000 7f0a63707640 1 --2- 172.21.15.105:0/1537259461 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0a40078b90 0x7f0a4007b0a0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f0a58005d70 tx=0x7f0a58005d00 comp rx=0 tx=0).stop 2024-09-21T03:26:20.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.990+0000 7f0a63707640 1 -- 172.21.15.105:0/1537259461 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a5c0b5710 msgr2=0x7f0a5c159300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:20.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.990+0000 7f0a63707640 1 --2- 172.21.15.105:0/1537259461 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a5c0b5710 0x7f0a5c159300 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c034040 tx=0x7f0a4c0039e0 comp rx=0 tx=0).stop 2024-09-21T03:26:20.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.990+0000 7f0a63707640 1 -- 172.21.15.105:0/1537259461 shutdown_connections 2024-09-21T03:26:20.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.990+0000 7f0a63707640 1 --2- 172.21.15.105:0/1537259461 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0a40078b90 0x7f0a4007b0a0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:20.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.990+0000 7f0a63707640 1 --2- 172.21.15.105:0/1537259461 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a5c09aa30 0x7f0a5c09ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:20.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.990+0000 7f0a63707640 1 --2- 172.21.15.105:0/1537259461 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a5c0b5710 0x7f0a5c159300 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:20.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.990+0000 7f0a63707640 1 --2- 172.21.15.105:0/1537259461 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a5c0b45d0 0x7f0a5c09d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:20.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.990+0000 7f0a63707640 1 -- 172.21.15.105:0/1537259461 >> 172.21.15.105:0/1537259461 conn(0x7f0a5c0cdcc0 msgr2=0x7f0a5c15b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:20.993 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.990+0000 7f0a63707640 1 -- 172.21.15.105:0/1537259461 shutdown_connections 2024-09-21T03:26:20.993 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:20.990+0000 7f0a63707640 1 -- 172.21.15.105:0/1537259461 wait complete. 2024-09-21T03:26:21.003 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T03:26:21.116 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.114+0000 7fd7c6f8b640 1 -- 172.21.15.105:0/304360003 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7a80062b0 msgr2=0x7fd7a800cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:21.116 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.114+0000 7fd7c6f8b640 1 --2- 172.21.15.105:0/304360003 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7a80062b0 0x7fd7a800cad0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8005fd0 tx=0x7fd7a8006940 comp rx=0 tx=0).stop 2024-09-21T03:26:21.116 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.114+0000 7fd7c5528640 1 -- 172.21.15.105:0/304360003 reap_dead start 2024-09-21T03:26:21.116 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.114+0000 7fd7c6f8b640 1 -- 172.21.15.105:0/304360003 shutdown_connections 2024-09-21T03:26:21.117 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.114+0000 7fd7c6f8b640 1 -- 172.21.15.105:0/304360003 >> 172.21.15.105:0/304360003 conn(0x7fd7c00b1cb0 msgr2=0x7fd7c00b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:21.117 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.114+0000 7fd7c6f8b640 1 -- 172.21.15.105:0/304360003 shutdown_connections 2024-09-21T03:26:21.117 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.114+0000 7fd7c6f8b640 1 -- 172.21.15.105:0/304360003 wait complete. 2024-09-21T03:26:21.117 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.116+0000 7fd7c6f8b640 1 Processor -- start 2024-09-21T03:26:21.117 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.116+0000 7fd7c6f8b640 1 -- start start 2024-09-21T03:26:21.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.117+0000 7fd7c6f8b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7a80062b0 0x7fd7c014e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:21.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.117+0000 7fd7c6f8b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7c00c9ed0 0x7fd7c009cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:21.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.117+0000 7fd7c6f8b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7c01598f0 0x7fd7c009d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:21.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.117+0000 7fd7c6f8b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c00cb230 con 0x7fd7a80062b0 2024-09-21T03:26:21.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.117+0000 7fd7c6f8b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c00cb0b0 con 0x7fd7c00c9ed0 2024-09-21T03:26:21.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.117+0000 7fd7c6f8b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd7c00ccba0 con 0x7fd7c01598f0 2024-09-21T03:26:21.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.118+0000 7fd7c4d27640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7a80062b0 0x7fd7c014e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:21.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.118+0000 7fd7c4d27640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7a80062b0 0x7fd7c014e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:37844/0 (socket says 172.21.15.105:37844) 2024-09-21T03:26:21.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.118+0000 7fd7c4d27640 1 -- 172.21.15.105:0/2855398163 learned_addr learned my addr 172.21.15.105:0/2855398163 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:21.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.118+0000 7fd7c5528640 1 --2- 172.21.15.105:0/2855398163 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7c01598f0 0x7fd7c009d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:21.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.118+0000 7fd7bffff640 1 --2- 172.21.15.105:0/2855398163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7c00c9ed0 0x7fd7c009cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:21.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.118+0000 7fd7c4d27640 1 -- 172.21.15.105:0/2855398163 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7c01598f0 msgr2=0x7fd7c009d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:21.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.118+0000 7fd7c4d27640 1 --2- 172.21.15.105:0/2855398163 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7c01598f0 0x7fd7c009d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:21.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.118+0000 7fd7c4d27640 1 -- 172.21.15.105:0/2855398163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7c00c9ed0 msgr2=0x7fd7c009cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:21.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.118+0000 7fd7c4d27640 1 --2- 172.21.15.105:0/2855398163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7c00c9ed0 0x7fd7c009cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:21.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.118+0000 7fd7c4d27640 1 -- 172.21.15.105:0/2855398163 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7c015f750 con 0x7fd7a80062b0 2024-09-21T03:26:21.121 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.118+0000 7fd7c4d27640 1 --2- 172.21.15.105:0/2855398163 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7a80062b0 0x7fd7c014e510 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0006600 tx=0x7fd7b00039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:21.122 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.118+0000 7fd7bd7fa640 1 -- 172.21.15.105:0/2855398163 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b0015070 con 0x7fd7a80062b0 2024-09-21T03:26:21.122 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.118+0000 7fd7bd7fa640 1 -- 172.21.15.105:0/2855398163 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7b0011900 con 0x7fd7a80062b0 2024-09-21T03:26:21.122 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.118+0000 7fd7c6f8b640 1 -- 172.21.15.105:0/2855398163 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7c015ce50 con 0x7fd7a80062b0 2024-09-21T03:26:21.122 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.118+0000 7fd7bd7fa640 1 -- 172.21.15.105:0/2855398163 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b0011d50 con 0x7fd7a80062b0 2024-09-21T03:26:21.122 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.118+0000 7fd7c6f8b640 1 -- 172.21.15.105:0/2855398163 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7c00c72e0 con 0x7fd7a80062b0 2024-09-21T03:26:21.122 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.119+0000 7fd7c6f8b640 1 -- 172.21.15.105:0/2855398163 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7c015d370 con 0x7fd7a80062b0 2024-09-21T03:26:21.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.120+0000 7fd7bd7fa640 1 -- 172.21.15.105:0/2855398163 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd7b0018070 con 0x7fd7a80062b0 2024-09-21T03:26:21.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.121+0000 7fd7bd7fa640 1 --2- 172.21.15.105:0/2855398163 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd7ac078bc0 0x7fd7ac07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:21.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.121+0000 7fd7bd7fa640 1 -- 172.21.15.105:0/2855398163 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5767+0+0 (secure 0 0 0) 0x7fd7b009b9e0 con 0x7fd7a80062b0 2024-09-21T03:26:21.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.121+0000 7fd7bffff640 1 --2- 172.21.15.105:0/2855398163 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd7ac078bc0 0x7fd7ac07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:21.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.122+0000 7fd7bffff640 1 --2- 172.21.15.105:0/2855398163 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd7ac078bc0 0x7fd7ac07b0d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd7c00adde0 tx=0x7fd7b4006cf0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:21.127 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.125+0000 7fd7bd7fa640 1 -- 172.21.15.105:0/2855398163 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd7c015d370 con 0x7fd7a80062b0 2024-09-21T03:26:21.338 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.336+0000 7fd7c6f8b640 1 -- 172.21.15.105:0/2855398163 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd7c00cd130 con 0x7fd7a80062b0 2024-09-21T03:26:21.339 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.337+0000 7fd7bd7fa640 1 -- 172.21.15.105:0/2855398163 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=-1 MDS has one of two health warnings which could extend recovery: MDS_TRIM or MDS_CACHE_OVERSIZED. MDS failover is not recommended since it might cause unexpected file system unavailability. If you wish to proceed, pass --yes-i-really-mean-it v76) ==== 316+0+0 (secure 0 0 0) 0x7fd7b00638b0 con 0x7fd7a80062b0 2024-09-21T03:26:21.339 INFO:teuthology.orchestra.run.smithi105.stderr:Error EPERM: MDS has one of two health warnings which could extend recovery: MDS_TRIM or MDS_CACHE_OVERSIZED. MDS failover is not recommended since it might cause unexpected file system unavailability. If you wish to proceed, pass --yes-i-really-mean-it 2024-09-21T03:26:21.344 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:26:21.344 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs --yes-i-really-mean-it 2024-09-21T03:26:21.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.457+0000 7f0fffc5c640 1 -- 172.21.15.105:0/1133167229 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ff815b530 msgr2=0x7f0ff80ce560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:21.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.457+0000 7f0fffc5c640 1 --2- 172.21.15.105:0/1133167229 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ff815b530 0x7f0ff80ce560 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8069970 tx=0x7f0fe802a4d0 comp rx=0 tx=0).stop 2024-09-21T03:26:21.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.457+0000 7f0fffc5c640 1 -- 172.21.15.105:0/1133167229 shutdown_connections 2024-09-21T03:26:21.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.457+0000 7f0fffc5c640 1 --2- 172.21.15.105:0/1133167229 >> v2:172.21.15.162:3300/0 conn(0x7f0ff80ceaa0 0x7f0ff8073820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:21.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.457+0000 7f0fffc5c640 1 --2- 172.21.15.105:0/1133167229 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ff815b530 0x7f0ff80ce560 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:21.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.457+0000 7f0fffc5c640 1 --2- 172.21.15.105:0/1133167229 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ff80caad0 0x7f0ff815c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:21.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.457+0000 7f0fffc5c640 1 -- 172.21.15.105:0/1133167229 >> 172.21.15.105:0/1133167229 conn(0x7f0ff806cde0 msgr2=0x7f0ff806d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:21.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.457+0000 7f0fffc5c640 1 -- 172.21.15.105:0/1133167229 shutdown_connections 2024-09-21T03:26:21.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.457+0000 7f0fffc5c640 1 -- 172.21.15.105:0/1133167229 wait complete. 2024-09-21T03:26:21.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.459+0000 7f0fffc5c640 1 Processor -- start 2024-09-21T03:26:21.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.459+0000 7f0fffc5c640 1 -- start start 2024-09-21T03:26:21.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.460+0000 7f0fffc5c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ff80caad0 0x7f0ff813f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:21.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.460+0000 7f0fffc5c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ff80ceaa0 0x7f0ff80b1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:21.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.460+0000 7f0fffc5c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ff815b530 0x7f0ff80c9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:21.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.460+0000 7f0fffc5c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff80c64e0 con 0x7f0ff80caad0 2024-09-21T03:26:21.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.460+0000 7f0fffc5c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff8074080 con 0x7f0ff815b530 2024-09-21T03:26:21.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.460+0000 7f0fffc5c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0ff80c6660 con 0x7f0ff80ceaa0 2024-09-21T03:26:21.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.460+0000 7f0ffd9f8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ff80caad0 0x7f0ff813f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:21.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.460+0000 7f0ffd9f8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ff80caad0 0x7f0ff813f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:39698/0 (socket says 172.21.15.105:39698) 2024-09-21T03:26:21.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.460+0000 7f0ffd9f8640 1 -- 172.21.15.105:0/1365297241 learned_addr learned my addr 172.21.15.105:0/1365297241 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:21.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.460+0000 7f0ffd1f7640 1 --2- 172.21.15.105:0/1365297241 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ff80ceaa0 0x7f0ff80b1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:21.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.460+0000 7f0ffe1f9640 1 --2- 172.21.15.105:0/1365297241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ff815b530 0x7f0ff80c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:21.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.460+0000 7f0ffd9f8640 1 -- 172.21.15.105:0/1365297241 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ff80ceaa0 msgr2=0x7f0ff80b1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:21.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.460+0000 7f0ffd9f8640 1 --2- 172.21.15.105:0/1365297241 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ff80ceaa0 0x7f0ff80b1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:21.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.460+0000 7f0ffd9f8640 1 -- 172.21.15.105:0/1365297241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ff815b530 msgr2=0x7f0ff80c9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:21.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.460+0000 7f0ffd9f8640 1 --2- 172.21.15.105:0/1365297241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ff815b530 0x7f0ff80c9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:21.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.461+0000 7f0ffd9f8640 1 -- 172.21.15.105:0/1365297241 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff813fb80 con 0x7f0ff80caad0 2024-09-21T03:26:21.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.461+0000 7f0ffd9f8640 1 --2- 172.21.15.105:0/1365297241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ff80caad0 0x7f0ff813f640 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f0ff400e7f0 tx=0x7f0ff400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:21.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.461+0000 7f0fee7fc640 1 -- 172.21.15.105:0/1365297241 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff400eea0 con 0x7f0ff80caad0 2024-09-21T03:26:21.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.461+0000 7f0fee7fc640 1 -- 172.21.15.105:0/1365297241 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ff400ccc0 con 0x7f0ff80caad0 2024-09-21T03:26:21.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.461+0000 7f0fffc5c640 1 -- 172.21.15.105:0/1365297241 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ff80b1f90 con 0x7f0ff80caad0 2024-09-21T03:26:21.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.461+0000 7f0fee7fc640 1 -- 172.21.15.105:0/1365297241 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff4005280 con 0x7f0ff80caad0 2024-09-21T03:26:21.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.461+0000 7f0fffc5c640 1 -- 172.21.15.105:0/1365297241 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ff8142510 con 0x7f0ff80caad0 2024-09-21T03:26:21.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.462+0000 7f0fffc5c640 1 -- 172.21.15.105:0/1365297241 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ff80c6b80 con 0x7f0ff80caad0 2024-09-21T03:26:21.466 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.463+0000 7f0fee7fc640 1 -- 172.21.15.105:0/1365297241 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0ff4005420 con 0x7f0ff80caad0 2024-09-21T03:26:21.466 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.463+0000 7f0fee7fc640 1 --2- 172.21.15.105:0/1365297241 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0fdc078bc0 0x7f0fdc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:21.466 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.463+0000 7f0fee7fc640 1 -- 172.21.15.105:0/1365297241 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5767+0+0 (secure 0 0 0) 0x7f0ff409b680 con 0x7f0ff80caad0 2024-09-21T03:26:21.466 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.463+0000 7f0ffd1f7640 1 --2- 172.21.15.105:0/1365297241 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0fdc078bc0 0x7f0fdc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:21.466 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.464+0000 7f0ffd1f7640 1 --2- 172.21.15.105:0/1365297241 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0fdc078bc0 0x7f0fdc07b0d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8033000 tx=0x7f0fe8004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:21.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.468+0000 7f0fee7fc640 1 -- 172.21.15.105:0/1365297241 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0ff80b1f90 con 0x7f0ff80caad0 2024-09-21T03:26:21.682 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.681+0000 7f0fffc5c640 1 -- 172.21.15.105:0/1365297241 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f0ff80ce1e0 con 0x7f0ff80caad0 2024-09-21T03:26:21.683 INFO:tasks.ceph.mon.a.smithi105.stderr:2024-09-21T03:26:21.681+0000 7f25819ea640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T03:26:21.684 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.683+0000 7f0fee7fc640 1 -- 172.21.15.105:0/1365297241 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v77) ==== 191+0+0 (secure 0 0 0) 0x7f0ff4063b10 con 0x7f0ff80caad0 2024-09-21T03:26:21.684 INFO:teuthology.orchestra.run.smithi105.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T03:26:21.687 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.685+0000 7f0fffc5c640 1 -- 172.21.15.105:0/1365297241 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0fdc078bc0 msgr2=0x7f0fdc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:21.687 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.685+0000 7f0fffc5c640 1 --2- 172.21.15.105:0/1365297241 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0fdc078bc0 0x7f0fdc07b0d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8033000 tx=0x7f0fe8004730 comp rx=0 tx=0).stop 2024-09-21T03:26:21.687 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.685+0000 7f0fffc5c640 1 -- 172.21.15.105:0/1365297241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ff80caad0 msgr2=0x7f0ff813f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:21.687 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.685+0000 7f0fffc5c640 1 --2- 172.21.15.105:0/1365297241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ff80caad0 0x7f0ff813f640 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f0ff400e7f0 tx=0x7f0ff400ecb0 comp rx=0 tx=0).stop 2024-09-21T03:26:21.687 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.685+0000 7f0fffc5c640 1 -- 172.21.15.105:0/1365297241 shutdown_connections 2024-09-21T03:26:21.687 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.685+0000 7f0fffc5c640 1 --2- 172.21.15.105:0/1365297241 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0fdc078bc0 0x7f0fdc07b0d0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:21.687 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.685+0000 7f0fffc5c640 1 --2- 172.21.15.105:0/1365297241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ff815b530 0x7f0ff80c9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:21.687 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.685+0000 7f0fffc5c640 1 --2- 172.21.15.105:0/1365297241 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ff80ceaa0 0x7f0ff80b1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:21.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.685+0000 7f0fffc5c640 1 --2- 172.21.15.105:0/1365297241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ff80caad0 0x7f0ff813f640 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:21.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.685+0000 7f0fffc5c640 1 -- 172.21.15.105:0/1365297241 >> 172.21.15.105:0/1365297241 conn(0x7f0ff806cde0 msgr2=0x7f0ff80b5b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:21.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.685+0000 7f0fffc5c640 1 -- 172.21.15.105:0/1365297241 shutdown_connections 2024-09-21T03:26:21.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.685+0000 7f0fffc5c640 1 -- 172.21.15.105:0/1365297241 wait complete. 2024-09-21T03:26:21.698 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T03:26:21.748 INFO:tasks.ceph.mds.a.smithi105.stdout:starting mds.a at 2024-09-21T03:26:21.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.813+0000 7f228ee8c640 1 -- 172.21.15.105:0/3256988380 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22880d12c0 msgr2=0x7f22880d16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:21.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.813+0000 7f228ee8c640 1 --2- 172.21.15.105:0/3256988380 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22880d12c0 0x7f22880d16d0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f22880cfef0 tx=0x7f228002aa30 comp rx=0 tx=0).stop 2024-09-21T03:26:21.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.813+0000 7f228ee8c640 1 -- 172.21.15.105:0/3256988380 shutdown_connections 2024-09-21T03:26:21.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.813+0000 7f228ee8c640 1 --2- 172.21.15.105:0/3256988380 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22880d12c0 0x7f22880d16d0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:21.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.813+0000 7f228ee8c640 1 --2- 172.21.15.105:0/3256988380 >> v2:172.21.15.162:3300/0 conn(0x7f22880ccbd0 0x7f22880d0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:21.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.813+0000 7f228ee8c640 1 --2- 172.21.15.105:0/3256988380 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22880b51c0 0x7f228815c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:21.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.813+0000 7f228ee8c640 1 -- 172.21.15.105:0/3256988380 >> 172.21.15.105:0/3256988380 conn(0x7f2288072ae0 msgr2=0x7f2288072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:21.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.813+0000 7f228ee8c640 1 -- 172.21.15.105:0/3256988380 shutdown_connections 2024-09-21T03:26:21.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.813+0000 7f228ee8c640 1 -- 172.21.15.105:0/3256988380 wait complete. 2024-09-21T03:26:21.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.815+0000 7f228ee8c640 1 Processor -- start 2024-09-21T03:26:21.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.815+0000 7f228ee8c640 1 -- start start 2024-09-21T03:26:21.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.817+0000 7f228ee8c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22880b51c0 0x7f22880caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:21.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.817+0000 7f228ee8c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22880ccbd0 0x7f22880c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:21.819 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.817+0000 7f228ee8c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22880d12c0 0x7f22881f6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:21.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.817+0000 7f228ee8c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2288160790 con 0x7f22880d12c0 2024-09-21T03:26:21.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.817+0000 7f228ee8c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2288160610 con 0x7f22880ccbd0 2024-09-21T03:26:21.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.817+0000 7f228ee8c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2288160910 con 0x7f22880b51c0 2024-09-21T03:26:21.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.817+0000 7f228d429640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22880d12c0 0x7f22881f6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:21.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.817+0000 7f228d429640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22880d12c0 0x7f22881f6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:39724/0 (socket says 172.21.15.105:39724) 2024-09-21T03:26:21.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.817+0000 7f228d429640 1 -- 172.21.15.105:0/361773802 learned_addr learned my addr 172.21.15.105:0/361773802 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:21.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.817+0000 7f228cc28640 1 --2- 172.21.15.105:0/361773802 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22880b51c0 0x7f22880caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:21.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.817+0000 7f2287fff640 1 --2- 172.21.15.105:0/361773802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22880ccbd0 0x7f22880c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:21.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.817+0000 7f228d429640 1 -- 172.21.15.105:0/361773802 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22880b51c0 msgr2=0x7f22880caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:21.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.817+0000 7f228d429640 1 --2- 172.21.15.105:0/361773802 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22880b51c0 0x7f22880caa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:21.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.817+0000 7f228d429640 1 -- 172.21.15.105:0/361773802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22880ccbd0 msgr2=0x7f22880c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:21.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.817+0000 7f228d429640 1 --2- 172.21.15.105:0/361773802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22880ccbd0 0x7f22880c8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:21.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.817+0000 7f228d429640 1 -- 172.21.15.105:0/361773802 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22880cb510 con 0x7f22880d12c0 2024-09-21T03:26:21.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.817+0000 7f228d429640 1 --2- 172.21.15.105:0/361773802 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22880d12c0 0x7f22881f6830 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f2280009d60 tx=0x7f2280003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:21.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.817+0000 7f22857fa640 1 -- 172.21.15.105:0/361773802 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2280033050 con 0x7f22880d12c0 2024-09-21T03:26:21.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.817+0000 7f22857fa640 1 -- 172.21.15.105:0/361773802 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2280004450 con 0x7f22880d12c0 2024-09-21T03:26:21.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.817+0000 7f22857fa640 1 -- 172.21.15.105:0/361773802 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2280038450 con 0x7f22880d12c0 2024-09-21T03:26:21.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.817+0000 7f228ee8c640 1 -- 172.21.15.105:0/361773802 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22880cb7f0 con 0x7f22880d12c0 2024-09-21T03:26:21.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.818+0000 7f228ee8c640 1 -- 172.21.15.105:0/361773802 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22880cbdb0 con 0x7f22880d12c0 2024-09-21T03:26:21.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.819+0000 7f228ee8c640 1 -- 172.21.15.105:0/361773802 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22880cb280 con 0x7f22880d12c0 2024-09-21T03:26:21.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.819+0000 7f22857fa640 1 -- 172.21.15.105:0/361773802 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2280036070 con 0x7f22880d12c0 2024-09-21T03:26:21.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.820+0000 7f22857fa640 1 --2- 172.21.15.105:0/361773802 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2274078b90 0x7f227407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:21.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.820+0000 7f22857fa640 1 -- 172.21.15.105:0/361773802 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5853+0+0 (secure 0 0 0) 0x7f22800bc180 con 0x7f22880d12c0 2024-09-21T03:26:21.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.820+0000 7f228cc28640 1 --2- 172.21.15.105:0/361773802 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2274078b90 0x7f227407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:21.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.821+0000 7f228cc28640 1 --2- 172.21.15.105:0/361773802 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2274078b90 0x7f227407b0a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f2278005fd0 tx=0x7f227800b260 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:21.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:21.824+0000 7f22857fa640 1 -- 172.21.15.105:0/361773802 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2280083ee0 con 0x7f22880d12c0 2024-09-21T03:26:22.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.037+0000 7f228ee8c640 1 -- 172.21.15.105:0/361773802 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f22880d0d80 con 0x7f22880d12c0 2024-09-21T03:26:22.686 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.685+0000 7f22857fa640 1 -- 172.21.15.105:0/361773802 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v78) ==== 104+0+0 (secure 0 0 0) 0x7f2280088910 con 0x7f22880d12c0 2024-09-21T03:26:22.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.687+0000 7f228ee8c640 1 -- 172.21.15.105:0/361773802 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2274078b90 msgr2=0x7f227407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:22.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.687+0000 7f228ee8c640 1 --2- 172.21.15.105:0/361773802 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2274078b90 0x7f227407b0a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f2278005fd0 tx=0x7f227800b260 comp rx=0 tx=0).stop 2024-09-21T03:26:22.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.687+0000 7f228ee8c640 1 -- 172.21.15.105:0/361773802 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22880d12c0 msgr2=0x7f22881f6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:22.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.687+0000 7f228ee8c640 1 --2- 172.21.15.105:0/361773802 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22880d12c0 0x7f22881f6830 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f2280009d60 tx=0x7f2280003f10 comp rx=0 tx=0).stop 2024-09-21T03:26:22.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.687+0000 7f228ee8c640 1 -- 172.21.15.105:0/361773802 shutdown_connections 2024-09-21T03:26:22.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.687+0000 7f228ee8c640 1 --2- 172.21.15.105:0/361773802 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2274078b90 0x7f227407b0a0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:22.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.687+0000 7f228ee8c640 1 --2- 172.21.15.105:0/361773802 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22880d12c0 0x7f22881f6830 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:22.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.687+0000 7f228ee8c640 1 --2- 172.21.15.105:0/361773802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22880ccbd0 0x7f22880c8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:22.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.687+0000 7f228ee8c640 1 --2- 172.21.15.105:0/361773802 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22880b51c0 0x7f22880caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:22.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.687+0000 7f228ee8c640 1 -- 172.21.15.105:0/361773802 >> 172.21.15.105:0/361773802 conn(0x7f2288072ae0 msgr2=0x7f2288068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:22.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.687+0000 7f228ee8c640 1 -- 172.21.15.105:0/361773802 shutdown_connections 2024-09-21T03:26:22.690 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.687+0000 7f228ee8c640 1 -- 172.21.15.105:0/361773802 wait complete. 2024-09-21T03:26:22.701 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T03:26:22.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.819+0000 7f69cd686640 1 -- 172.21.15.105:0/3666497703 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69c80d0ef0 msgr2=0x7f69c80d1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:22.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.819+0000 7f69cd686640 1 --2- 172.21.15.105:0/3666497703 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69c80d0ef0 0x7f69c80d1300 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f69c80d1bb0 tx=0x7f69c002a980 comp rx=0 tx=0).stop 2024-09-21T03:26:22.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.819+0000 7f69cd686640 1 -- 172.21.15.105:0/3666497703 shutdown_connections 2024-09-21T03:26:22.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.819+0000 7f69cd686640 1 --2- 172.21.15.105:0/3666497703 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69c80d0ef0 0x7f69c80d1300 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:22.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.819+0000 7f69cd686640 1 --2- 172.21.15.105:0/3666497703 >> v2:172.21.15.162:3300/0 conn(0x7f69c80cf540 0x7f69c815e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:22.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.819+0000 7f69cd686640 1 -- 172.21.15.105:0/3666497703 >> 172.21.15.105:0/3666497703 conn(0x7f69c808dc50 msgr2=0x7f69c809d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:22.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.819+0000 7f69cd686640 1 -- 172.21.15.105:0/3666497703 shutdown_connections 2024-09-21T03:26:22.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.819+0000 7f69cd686640 1 -- 172.21.15.105:0/3666497703 wait complete. 2024-09-21T03:26:22.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.821+0000 7f69cd686640 1 Processor -- start 2024-09-21T03:26:22.823 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.821+0000 7f69cd686640 1 -- start start 2024-09-21T03:26:22.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.822+0000 7f69cd686640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69c806fa70 0x7f69c81f96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:22.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.823+0000 7f69cd686640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69c80cf540 0x7f69c815a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:22.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.823+0000 7f69cd686640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69c80d0ef0 0x7f69c81e8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:22.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.823+0000 7f69cd686640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f69c8162b20 con 0x7f69c80d0ef0 2024-09-21T03:26:22.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.823+0000 7f69cd686640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f69c81629a0 con 0x7f69c806fa70 2024-09-21T03:26:22.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.823+0000 7f69cd686640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f69c8162ca0 con 0x7f69c80cf540 2024-09-21T03:26:22.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.823+0000 7f69c77fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69c80d0ef0 0x7f69c81e8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:22.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.823+0000 7f69c77fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69c80d0ef0 0x7f69c81e8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:39734/0 (socket says 172.21.15.105:39734) 2024-09-21T03:26:22.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.823+0000 7f69c77fe640 1 -- 172.21.15.105:0/1961569534 learned_addr learned my addr 172.21.15.105:0/1961569534 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:22.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.823+0000 7f69be7fc640 1 --2- 172.21.15.105:0/1961569534 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69c80cf540 0x7f69c815a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:22.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.823+0000 7f69c6ffd640 1 --2- 172.21.15.105:0/1961569534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69c806fa70 0x7f69c81f96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:22.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.823+0000 7f69c77fe640 1 -- 172.21.15.105:0/1961569534 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69c80cf540 msgr2=0x7f69c815a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:22.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.823+0000 7f69c77fe640 1 --2- 172.21.15.105:0/1961569534 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69c80cf540 0x7f69c815a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:22.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.823+0000 7f69c77fe640 1 -- 172.21.15.105:0/1961569534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69c806fa70 msgr2=0x7f69c81f96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:22.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.823+0000 7f69c77fe640 1 --2- 172.21.15.105:0/1961569534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69c806fa70 0x7f69c81f96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:22.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.823+0000 7f69c77fe640 1 -- 172.21.15.105:0/1961569534 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69c815ad70 con 0x7f69c80d0ef0 2024-09-21T03:26:22.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.823+0000 7f69c77fe640 1 --2- 172.21.15.105:0/1961569534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69c80d0ef0 0x7f69c81e8090 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f69c0009d60 tx=0x7f69c0003ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:22.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.823+0000 7f69bffff640 1 -- 172.21.15.105:0/1961569534 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c0034040 con 0x7f69c80d0ef0 2024-09-21T03:26:22.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.823+0000 7f69bffff640 1 -- 172.21.15.105:0/1961569534 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69c0004640 con 0x7f69c80d0ef0 2024-09-21T03:26:22.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.823+0000 7f69bffff640 1 -- 172.21.15.105:0/1961569534 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c0045480 con 0x7f69c80d0ef0 2024-09-21T03:26:22.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.823+0000 7f69cd686640 1 -- 172.21.15.105:0/1961569534 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69c81ea5e0 con 0x7f69c80d0ef0 2024-09-21T03:26:22.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.823+0000 7f69cd686640 1 -- 172.21.15.105:0/1961569534 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69c81eaba0 con 0x7f69c80d0ef0 2024-09-21T03:26:22.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.824+0000 7f69cd686640 1 -- 172.21.15.105:0/1961569534 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69c8163170 con 0x7f69c80d0ef0 2024-09-21T03:26:22.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.825+0000 7f69bffff640 1 -- 172.21.15.105:0/1961569534 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f69c0037020 con 0x7f69c80d0ef0 2024-09-21T03:26:22.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.825+0000 7f69bffff640 1 --2- 172.21.15.105:0/1961569534 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f69a8078bc0 0x7f69a807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:22.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.826+0000 7f69bffff640 1 -- 172.21.15.105:0/1961569534 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5853+0+0 (secure 0 0 0) 0x7f69c00bc560 con 0x7f69c80d0ef0 2024-09-21T03:26:22.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.826+0000 7f69c6ffd640 1 --2- 172.21.15.105:0/1961569534 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f69a8078bc0 0x7f69a807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:22.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.826+0000 7f69c6ffd640 1 --2- 172.21.15.105:0/1961569534 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f69a8078bc0 0x7f69a807b0d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f69b8006fd0 tx=0x7f69b8009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:22.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:22.830+0000 7f69bffff640 1 -- 172.21.15.105:0/1961569534 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f69c80d1840 con 0x7f69c80d0ef0 2024-09-21T03:26:23.012 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.011+0000 7f69cd686640 1 -- 172.21.15.105:0/1961569534 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f69c80b6c60 con 0x7f69c80d0ef0 2024-09-21T03:26:23.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.692+0000 7f69bffff640 1 -- 172.21.15.105:0/1961569534 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v120) ==== 181+0+0 (secure 0 0 0) 0x7f69c0084350 con 0x7f69c80d0ef0 2024-09-21T03:26:23.694 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_metadata' removed 2024-09-21T03:26:23.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.695+0000 7f69cd686640 1 -- 172.21.15.105:0/1961569534 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f69a8078bc0 msgr2=0x7f69a807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:23.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.695+0000 7f69cd686640 1 --2- 172.21.15.105:0/1961569534 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f69a8078bc0 0x7f69a807b0d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f69b8006fd0 tx=0x7f69b8009060 comp rx=0 tx=0).stop 2024-09-21T03:26:23.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.695+0000 7f69cd686640 1 -- 172.21.15.105:0/1961569534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69c80d0ef0 msgr2=0x7f69c81e8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:23.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.695+0000 7f69cd686640 1 --2- 172.21.15.105:0/1961569534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69c80d0ef0 0x7f69c81e8090 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f69c0009d60 tx=0x7f69c0003ef0 comp rx=0 tx=0).stop 2024-09-21T03:26:23.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.695+0000 7f69cd686640 1 -- 172.21.15.105:0/1961569534 shutdown_connections 2024-09-21T03:26:23.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.695+0000 7f69cd686640 1 --2- 172.21.15.105:0/1961569534 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f69a8078bc0 0x7f69a807b0d0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:23.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.695+0000 7f69cd686640 1 --2- 172.21.15.105:0/1961569534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69c80d0ef0 0x7f69c81e8090 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:23.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.695+0000 7f69cd686640 1 --2- 172.21.15.105:0/1961569534 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69c80cf540 0x7f69c815a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:23.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.695+0000 7f69cd686640 1 --2- 172.21.15.105:0/1961569534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69c806fa70 0x7f69c81f96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:23.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.695+0000 7f69cd686640 1 -- 172.21.15.105:0/1961569534 >> 172.21.15.105:0/1961569534 conn(0x7f69c808dc50 msgr2=0x7f69c806e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:23.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.695+0000 7f69cd686640 1 -- 172.21.15.105:0/1961569534 shutdown_connections 2024-09-21T03:26:23.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.695+0000 7f69cd686640 1 -- 172.21.15.105:0/1961569534 wait complete. 2024-09-21T03:26:23.708 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T03:26:23.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.823+0000 7f00f6cb4640 1 -- 172.21.15.105:0/1371560695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00f006f1d0 msgr2=0x7f00f015f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:23.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.823+0000 7f00f6cb4640 1 --2- 172.21.15.105:0/1371560695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00f006f1d0 0x7f00f015f090 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f00ec005fd0 tx=0x7f00ec02a410 comp rx=0 tx=0).stop 2024-09-21T03:26:23.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.823+0000 7f00f6cb4640 1 -- 172.21.15.105:0/1371560695 shutdown_connections 2024-09-21T03:26:23.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.823+0000 7f00f6cb4640 1 --2- 172.21.15.105:0/1371560695 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00f00743a0 0x7f00f00747b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:23.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.823+0000 7f00f6cb4640 1 --2- 172.21.15.105:0/1371560695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00f006f1d0 0x7f00f015f090 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:23.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.823+0000 7f00f6cb4640 1 -- 172.21.15.105:0/1371560695 >> 172.21.15.105:0/1371560695 conn(0x7f00f00d0130 msgr2=0x7f00f00d0540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:23.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.823+0000 7f00f6cb4640 1 -- 172.21.15.105:0/1371560695 shutdown_connections 2024-09-21T03:26:23.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.823+0000 7f00f6cb4640 1 -- 172.21.15.105:0/1371560695 wait complete. 2024-09-21T03:26:23.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.825+0000 7f00f6cb4640 1 Processor -- start 2024-09-21T03:26:23.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.825+0000 7f00f6cb4640 1 -- start start 2024-09-21T03:26:23.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.827+0000 7f00f6cb4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00f006f1d0 0x7f00f00b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:23.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.827+0000 7f00f6cb4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00f00743a0 0x7f00f0159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:23.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.827+0000 7f00f6cb4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00f015b660 0x7f00f01515d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:23.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.827+0000 7f00f6cb4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f00f0074cf0 con 0x7f00f015b660 2024-09-21T03:26:23.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.827+0000 7f00f6cb4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f00f006efc0 con 0x7f00f006f1d0 2024-09-21T03:26:23.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.827+0000 7f00f6cb4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f00f0074e70 con 0x7f00f00743a0 2024-09-21T03:26:23.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.827+0000 7f00f5251640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00f015b660 0x7f00f01515d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:23.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.827+0000 7f00f5251640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00f015b660 0x7f00f01515d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:39748/0 (socket says 172.21.15.105:39748) 2024-09-21T03:26:23.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.827+0000 7f00f5251640 1 -- 172.21.15.105:0/2265747301 learned_addr learned my addr 172.21.15.105:0/2265747301 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:23.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.827+0000 7f00f4a50640 1 --2- 172.21.15.105:0/2265747301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00f006f1d0 0x7f00f00b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:23.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.827+0000 7f00e7fff640 1 --2- 172.21.15.105:0/2265747301 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00f00743a0 0x7f00f0159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:23.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.827+0000 7f00f5251640 1 -- 172.21.15.105:0/2265747301 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00f00743a0 msgr2=0x7f00f0159bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:23.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.827+0000 7f00f5251640 1 --2- 172.21.15.105:0/2265747301 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00f00743a0 0x7f00f0159bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:23.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.827+0000 7f00f5251640 1 -- 172.21.15.105:0/2265747301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00f006f1d0 msgr2=0x7f00f00b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:23.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.827+0000 7f00f5251640 1 --2- 172.21.15.105:0/2265747301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00f006f1d0 0x7f00f00b4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:23.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.827+0000 7f00f5251640 1 -- 172.21.15.105:0/2265747301 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00f00b5850 con 0x7f00f015b660 2024-09-21T03:26:23.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.827+0000 7f00f5251640 1 --2- 172.21.15.105:0/2265747301 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00f015b660 0x7f00f01515d0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f00e800ca80 tx=0x7f00e800cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:23.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.827+0000 7f00e57fa640 1 -- 172.21.15.105:0/2265747301 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e8007d90 con 0x7f00f015b660 2024-09-21T03:26:23.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.827+0000 7f00e57fa640 1 -- 172.21.15.105:0/2265747301 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f00e8004c30 con 0x7f00f015b660 2024-09-21T03:26:23.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.827+0000 7f00f6cb4640 1 -- 172.21.15.105:0/2265747301 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00f00c6570 con 0x7f00f015b660 2024-09-21T03:26:23.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.827+0000 7f00e57fa640 1 -- 172.21.15.105:0/2265747301 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e8005280 con 0x7f00f015b660 2024-09-21T03:26:23.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.827+0000 7f00f6cb4640 1 -- 172.21.15.105:0/2265747301 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00f00c6b30 con 0x7f00f015b660 2024-09-21T03:26:23.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.828+0000 7f00f6cb4640 1 -- 172.21.15.105:0/2265747301 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00f0075340 con 0x7f00f015b660 2024-09-21T03:26:23.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.829+0000 7f00e57fa640 1 -- 172.21.15.105:0/2265747301 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f00e8005420 con 0x7f00f015b660 2024-09-21T03:26:23.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.830+0000 7f00e57fa640 1 --2- 172.21.15.105:0/2265747301 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f00dc078b90 0x7f00dc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:23.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.830+0000 7f00e57fa640 1 -- 172.21.15.105:0/2265747301 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5415+0+0 (secure 0 0 0) 0x7f00e809b5c0 con 0x7f00f015b660 2024-09-21T03:26:23.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.830+0000 7f00f4a50640 1 --2- 172.21.15.105:0/2265747301 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f00dc078b90 0x7f00dc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:23.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.839+0000 7f00e57fa640 1 -- 172.21.15.105:0/2265747301 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f00e8014070 con 0x7f00f015b660 2024-09-21T03:26:23.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:23.839+0000 7f00f4a50640 1 --2- 172.21.15.105:0/2265747301 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f00dc078b90 0x7f00dc07b0a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f00ec033000 tx=0x7f00ec004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:24.019 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.018+0000 7f00f6cb4640 1 -- 172.21.15.105:0/2265747301 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f00f015aef0 con 0x7f00f015b660 2024-09-21T03:26:24.696 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.694+0000 7f00e57fa640 1 -- 172.21.15.105:0/2265747301 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v121) ==== 169+0+0 (secure 0 0 0) 0x7f00e8063560 con 0x7f00f015b660 2024-09-21T03:26:24.696 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_data' removed 2024-09-21T03:26:24.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.698+0000 7f00f6cb4640 1 -- 172.21.15.105:0/2265747301 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f00dc078b90 msgr2=0x7f00dc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:24.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.698+0000 7f00f6cb4640 1 --2- 172.21.15.105:0/2265747301 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f00dc078b90 0x7f00dc07b0a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f00ec033000 tx=0x7f00ec004730 comp rx=0 tx=0).stop 2024-09-21T03:26:24.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.698+0000 7f00f6cb4640 1 -- 172.21.15.105:0/2265747301 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00f015b660 msgr2=0x7f00f01515d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:24.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.698+0000 7f00f6cb4640 1 --2- 172.21.15.105:0/2265747301 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00f015b660 0x7f00f01515d0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f00e800ca80 tx=0x7f00e800cf40 comp rx=0 tx=0).stop 2024-09-21T03:26:24.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.698+0000 7f00f6cb4640 1 -- 172.21.15.105:0/2265747301 shutdown_connections 2024-09-21T03:26:24.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.698+0000 7f00f6cb4640 1 --2- 172.21.15.105:0/2265747301 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f00dc078b90 0x7f00dc07b0a0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:24.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.698+0000 7f00f6cb4640 1 --2- 172.21.15.105:0/2265747301 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00f015b660 0x7f00f01515d0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:24.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.698+0000 7f00f6cb4640 1 --2- 172.21.15.105:0/2265747301 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00f00743a0 0x7f00f0159bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:24.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.698+0000 7f00f6cb4640 1 --2- 172.21.15.105:0/2265747301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00f006f1d0 0x7f00f00b4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:24.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.698+0000 7f00f6cb4640 1 -- 172.21.15.105:0/2265747301 >> 172.21.15.105:0/2265747301 conn(0x7f00f00d0130 msgr2=0x7f00f00d0540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:24.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.698+0000 7f00f6cb4640 1 -- 172.21.15.105:0/2265747301 shutdown_connections 2024-09-21T03:26:24.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.698+0000 7f00f6cb4640 1 -- 172.21.15.105:0/2265747301 wait complete. 2024-09-21T03:26:24.713 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-21T03:26:24.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.829+0000 7fbf9b2b6640 1 -- 172.21.15.105:0/2658221798 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf941600b0 msgr2=0x7fbf940ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:24.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.829+0000 7fbf9b2b6640 1 --2- 172.21.15.105:0/2658221798 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf941600b0 0x7fbf940ccbc0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fbf940ce1b0 tx=0x7fbf8402aac0 comp rx=0 tx=0).stop 2024-09-21T03:26:24.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.829+0000 7fbf9b2b6640 1 -- 172.21.15.105:0/2658221798 shutdown_connections 2024-09-21T03:26:24.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.829+0000 7fbf9b2b6640 1 --2- 172.21.15.105:0/2658221798 >> v2:172.21.15.162:3300/0 conn(0x7fbf940b7cc0 0x7fbf940cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:24.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.829+0000 7fbf9b2b6640 1 --2- 172.21.15.105:0/2658221798 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf941600b0 0x7fbf940ccbc0 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:24.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.829+0000 7fbf9b2b6640 1 -- 172.21.15.105:0/2658221798 >> 172.21.15.105:0/2658221798 conn(0x7fbf9406d4f0 msgr2=0x7fbf94071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:24.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.829+0000 7fbf9b2b6640 1 -- 172.21.15.105:0/2658221798 shutdown_connections 2024-09-21T03:26:24.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.829+0000 7fbf9b2b6640 1 -- 172.21.15.105:0/2658221798 wait complete. 2024-09-21T03:26:24.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.831+0000 7fbf9b2b6640 1 Processor -- start 2024-09-21T03:26:24.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.831+0000 7fbf9b2b6640 1 -- start start 2024-09-21T03:26:24.835 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.832+0000 7fbf9b2b6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf940b7cc0 0x7fbf940a9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:24.835 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.832+0000 7fbf9b2b6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbf940cf150 0x7fbf941f76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:24.835 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.832+0000 7fbf9b2b6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf941600b0 0x7fbf940b6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:24.835 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.832+0000 7fbf9b2b6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbf940b4460 con 0x7fbf940b7cc0 2024-09-21T03:26:24.835 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.832+0000 7fbf9b2b6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbf940d1ba0 con 0x7fbf941600b0 2024-09-21T03:26:24.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.832+0000 7fbf9b2b6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbf940b45e0 con 0x7fbf940cf150 2024-09-21T03:26:24.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.832+0000 7fbf99052640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf940b7cc0 0x7fbf940a9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:24.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.832+0000 7fbf99052640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf940b7cc0 0x7fbf940a9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:39764/0 (socket says 172.21.15.105:39764) 2024-09-21T03:26:24.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.832+0000 7fbf99052640 1 -- 172.21.15.105:0/3982322188 learned_addr learned my addr 172.21.15.105:0/3982322188 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:24.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.832+0000 7fbf99853640 1 --2- 172.21.15.105:0/3982322188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf941600b0 0x7fbf940b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:24.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.832+0000 7fbf98851640 1 --2- 172.21.15.105:0/3982322188 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbf940cf150 0x7fbf941f76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:24.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.832+0000 7fbf99052640 1 -- 172.21.15.105:0/3982322188 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbf940cf150 msgr2=0x7fbf941f76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:24.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.832+0000 7fbf99052640 1 --2- 172.21.15.105:0/3982322188 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbf940cf150 0x7fbf941f76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:24.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.832+0000 7fbf99052640 1 -- 172.21.15.105:0/3982322188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf941600b0 msgr2=0x7fbf940b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:24.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.832+0000 7fbf99052640 1 --2- 172.21.15.105:0/3982322188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf941600b0 0x7fbf940b6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:24.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.832+0000 7fbf99052640 1 -- 172.21.15.105:0/3982322188 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf94149120 con 0x7fbf940b7cc0 2024-09-21T03:26:24.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.832+0000 7fbf98851640 1 --2- 172.21.15.105:0/3982322188 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbf940cf150 0x7fbf941f76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:26:24.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.833+0000 7fbf99052640 1 --2- 172.21.15.105:0/3982322188 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf940b7cc0 0x7fbf940a9630 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fbf84009bf0 tx=0x7fbf84003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:24.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.833+0000 7fbf91ffb640 1 -- 172.21.15.105:0/3982322188 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf84044070 con 0x7fbf940b7cc0 2024-09-21T03:26:24.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.833+0000 7fbf91ffb640 1 -- 172.21.15.105:0/3982322188 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf84004250 con 0x7fbf940b7cc0 2024-09-21T03:26:24.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.833+0000 7fbf9b2b6640 1 -- 172.21.15.105:0/3982322188 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf941f3de0 con 0x7fbf940b7cc0 2024-09-21T03:26:24.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.833+0000 7fbf91ffb640 1 -- 172.21.15.105:0/3982322188 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf84004680 con 0x7fbf940b7cc0 2024-09-21T03:26:24.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.833+0000 7fbf9b2b6640 1 -- 172.21.15.105:0/3982322188 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf941f43a0 con 0x7fbf940b7cc0 2024-09-21T03:26:24.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.834+0000 7fbf9b2b6640 1 -- 172.21.15.105:0/3982322188 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf940b4b20 con 0x7fbf940b7cc0 2024-09-21T03:26:24.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.835+0000 7fbf91ffb640 1 -- 172.21.15.105:0/3982322188 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbf84036400 con 0x7fbf940b7cc0 2024-09-21T03:26:24.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.835+0000 7fbf91ffb640 1 --2- 172.21.15.105:0/3982322188 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbf80078bc0 0x7fbf8007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:24.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.835+0000 7fbf91ffb640 1 -- 172.21.15.105:0/3982322188 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 4943+0+0 (secure 0 0 0) 0x7fbf840bb170 con 0x7fbf940b7cc0 2024-09-21T03:26:24.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.836+0000 7fbf98851640 1 --2- 172.21.15.105:0/3982322188 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbf80078bc0 0x7fbf8007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:24.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.836+0000 7fbf98851640 1 --2- 172.21.15.105:0/3982322188 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbf80078bc0 0x7fbf8007b0d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fbf940a9550 tx=0x7fbf88005f10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:24.843 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:24.841+0000 7fbf91ffb640 1 -- 172.21.15.105:0/3982322188 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbf84032030 con 0x7fbf940b7cc0 2024-09-21T03:26:25.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.021+0000 7fbf9b2b6640 1 -- 172.21.15.105:0/3982322188 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7fbf9415c050 con 0x7fbf940b7cc0 2024-09-21T03:26:25.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.026+0000 7fbf91ffb640 1 -- 172.21.15.105:0/3982322188 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v62) ==== 71+0+0 (secure 0 0 0) 0x7fbf84004820 con 0x7fbf940b7cc0 2024-09-21T03:26:25.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.029+0000 7fbf9b2b6640 1 -- 172.21.15.105:0/3982322188 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbf80078bc0 msgr2=0x7fbf8007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:25.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.029+0000 7fbf9b2b6640 1 --2- 172.21.15.105:0/3982322188 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbf80078bc0 0x7fbf8007b0d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fbf940a9550 tx=0x7fbf88005f10 comp rx=0 tx=0).stop 2024-09-21T03:26:25.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.029+0000 7fbf9b2b6640 1 -- 172.21.15.105:0/3982322188 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf940b7cc0 msgr2=0x7fbf940a9630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:25.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.029+0000 7fbf9b2b6640 1 --2- 172.21.15.105:0/3982322188 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf940b7cc0 0x7fbf940a9630 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fbf84009bf0 tx=0x7fbf84003f10 comp rx=0 tx=0).stop 2024-09-21T03:26:25.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.029+0000 7fbf9b2b6640 1 -- 172.21.15.105:0/3982322188 shutdown_connections 2024-09-21T03:26:25.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.029+0000 7fbf9b2b6640 1 --2- 172.21.15.105:0/3982322188 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fbf80078bc0 0x7fbf8007b0d0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:25.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.029+0000 7fbf9b2b6640 1 --2- 172.21.15.105:0/3982322188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf941600b0 0x7fbf940b6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:25.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.029+0000 7fbf9b2b6640 1 --2- 172.21.15.105:0/3982322188 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbf940cf150 0x7fbf941f76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:25.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.029+0000 7fbf9b2b6640 1 --2- 172.21.15.105:0/3982322188 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf940b7cc0 0x7fbf940a9630 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:25.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.029+0000 7fbf9b2b6640 1 -- 172.21.15.105:0/3982322188 >> 172.21.15.105:0/3982322188 conn(0x7fbf9406d4f0 msgr2=0x7fbf940b3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:25.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.029+0000 7fbf9b2b6640 1 -- 172.21.15.105:0/3982322188 shutdown_connections 2024-09-21T03:26:25.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.029+0000 7fbf9b2b6640 1 -- 172.21.15.105:0/3982322188 wait complete. 2024-09-21T03:26:25.041 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_mincaps' 2024-09-21T03:26:25.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.152+0000 7f489b719640 1 -- 172.21.15.105:0/484720211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48940b5fa0 msgr2=0x7f48940b63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:25.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.152+0000 7f489b719640 1 --2- 172.21.15.105:0/484720211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48940b5fa0 0x7f48940b63b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4884005fd0 tx=0x7f488402a5d0 comp rx=0 tx=0).stop 2024-09-21T03:26:25.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.152+0000 7f489b719640 1 -- 172.21.15.105:0/484720211 shutdown_connections 2024-09-21T03:26:25.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.152+0000 7f489b719640 1 --2- 172.21.15.105:0/484720211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48940b5fa0 0x7f48940b63b0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:25.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.152+0000 7f489b719640 1 --2- 172.21.15.105:0/484720211 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48940b9970 0x7f48940b3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:25.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.152+0000 7f489b719640 1 -- 172.21.15.105:0/484720211 >> 172.21.15.105:0/484720211 conn(0x7f489409d7f0 msgr2=0x7f48940d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:25.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.152+0000 7f489b719640 1 -- 172.21.15.105:0/484720211 shutdown_connections 2024-09-21T03:26:25.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.152+0000 7f489b719640 1 -- 172.21.15.105:0/484720211 wait complete. 2024-09-21T03:26:25.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.154+0000 7f489b719640 1 Processor -- start 2024-09-21T03:26:25.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.154+0000 7f489b719640 1 -- start start 2024-09-21T03:26:25.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.155+0000 7f489b719640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48940b5fa0 0x7f48940ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:25.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.155+0000 7f489b719640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48940b9970 0x7f489415d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:25.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.155+0000 7f489b719640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f48940ced80 0x7f4894161690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:25.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.155+0000 7f489b719640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f489406f270 con 0x7f48940ced80 2024-09-21T03:26:25.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.155+0000 7f489b719640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f489406f0f0 con 0x7f48940b9970 2024-09-21T03:26:25.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.155+0000 7f489b719640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f489406f3f0 con 0x7f48940b5fa0 2024-09-21T03:26:25.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.156+0000 7f4899cb6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f48940ced80 0x7f4894161690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:25.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.156+0000 7f4899cb6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f48940ced80 0x7f4894161690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:39776/0 (socket says 172.21.15.105:39776) 2024-09-21T03:26:25.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.156+0000 7f4899cb6640 1 -- 172.21.15.105:0/3593744214 learned_addr learned my addr 172.21.15.105:0/3593744214 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:25.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.156+0000 7f4898cb4640 1 --2- 172.21.15.105:0/3593744214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48940b9970 0x7f489415d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:25.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.156+0000 7f48994b5640 1 --2- 172.21.15.105:0/3593744214 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48940b5fa0 0x7f48940ce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:25.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.156+0000 7f4899cb6640 1 -- 172.21.15.105:0/3593744214 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48940b5fa0 msgr2=0x7f48940ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:25.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.156+0000 7f4899cb6640 1 --2- 172.21.15.105:0/3593744214 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48940b5fa0 0x7f48940ce3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:25.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.156+0000 7f4899cb6640 1 -- 172.21.15.105:0/3593744214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48940b9970 msgr2=0x7f489415d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:25.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.156+0000 7f4899cb6640 1 --2- 172.21.15.105:0/3593744214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48940b9970 0x7f489415d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:25.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.156+0000 7f4899cb6640 1 -- 172.21.15.105:0/3593744214 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48941f6660 con 0x7f48940ced80 2024-09-21T03:26:25.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.156+0000 7f4899cb6640 1 --2- 172.21.15.105:0/3593744214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f48940ced80 0x7f4894161690 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f488c002230 tx=0x7f488c00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:25.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.156+0000 7f4889ffb640 1 -- 172.21.15.105:0/3593744214 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488c003b70 con 0x7f48940ced80 2024-09-21T03:26:25.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.156+0000 7f4889ffb640 1 -- 172.21.15.105:0/3593744214 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f488c003d10 con 0x7f48940ced80 2024-09-21T03:26:25.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.156+0000 7f489b719640 1 -- 172.21.15.105:0/3593744214 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48941f6380 con 0x7f48940ced80 2024-09-21T03:26:25.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.156+0000 7f4889ffb640 1 -- 172.21.15.105:0/3593744214 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488c005330 con 0x7f48940ced80 2024-09-21T03:26:25.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.157+0000 7f489b719640 1 -- 172.21.15.105:0/3593744214 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f489415f670 con 0x7f48940ced80 2024-09-21T03:26:25.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.157+0000 7f489b719640 1 -- 172.21.15.105:0/3593744214 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48940cfc40 con 0x7f48940ced80 2024-09-21T03:26:25.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.158+0000 7f4889ffb640 1 -- 172.21.15.105:0/3593744214 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f488c0056e0 con 0x7f48940ced80 2024-09-21T03:26:25.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.159+0000 7f4889ffb640 1 --2- 172.21.15.105:0/3593744214 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4878078b90 0x7f487807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:25.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.159+0000 7f4889ffb640 1 -- 172.21.15.105:0/3593744214 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 4943+0+0 (secure 0 0 0) 0x7f488c09a910 con 0x7f48940ced80 2024-09-21T03:26:25.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.159+0000 7f48994b5640 1 --2- 172.21.15.105:0/3593744214 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4878078b90 0x7f487807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:25.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.160+0000 7f48994b5640 1 --2- 172.21.15.105:0/3593744214 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4878078b90 0x7f487807b0a0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f4890009b90 tx=0x7f4890005f30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:25.165 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.163+0000 7f4889ffb640 1 -- 172.21.15.105:0/3593744214 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f48940b68f0 con 0x7f48940ced80 2024-09-21T03:26:25.419 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.417+0000 7f489b719640 1 -- 172.21.15.105:0/3593744214 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_mincaps"]} v 0) -- 0x7f48940d2990 con 0x7f48940ced80 2024-09-21T03:26:25.704 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.703+0000 7f4889ffb640 1 -- 172.21.15.105:0/3593744214 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_mincaps"]}]=0 v396) ==== 151+0+0 (secure 0 0 0) 0x7f488c0630e0 con 0x7f48940ced80 2024-09-21T03:26:25.707 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.705+0000 7f489b719640 1 -- 172.21.15.105:0/3593744214 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4878078b90 msgr2=0x7f487807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:25.707 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.705+0000 7f489b719640 1 --2- 172.21.15.105:0/3593744214 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4878078b90 0x7f487807b0a0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f4890009b90 tx=0x7f4890005f30 comp rx=0 tx=0).stop 2024-09-21T03:26:25.707 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.705+0000 7f489b719640 1 -- 172.21.15.105:0/3593744214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f48940ced80 msgr2=0x7f4894161690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:25.707 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.705+0000 7f489b719640 1 --2- 172.21.15.105:0/3593744214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f48940ced80 0x7f4894161690 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f488c002230 tx=0x7f488c00cb90 comp rx=0 tx=0).stop 2024-09-21T03:26:25.707 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.705+0000 7f489b719640 1 -- 172.21.15.105:0/3593744214 shutdown_connections 2024-09-21T03:26:25.707 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.705+0000 7f489b719640 1 --2- 172.21.15.105:0/3593744214 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4878078b90 0x7f487807b0a0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:25.707 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.705+0000 7f489b719640 1 --2- 172.21.15.105:0/3593744214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f48940ced80 0x7f4894161690 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:25.708 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.705+0000 7f489b719640 1 --2- 172.21.15.105:0/3593744214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48940b9970 0x7f489415d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:25.708 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.705+0000 7f489b719640 1 --2- 172.21.15.105:0/3593744214 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48940b5fa0 0x7f48940ce3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:25.708 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.705+0000 7f489b719640 1 -- 172.21.15.105:0/3593744214 >> 172.21.15.105:0/3593744214 conn(0x7f489409d7f0 msgr2=0x7f48940d1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:25.708 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.705+0000 7f489b719640 1 -- 172.21.15.105:0/3593744214 shutdown_connections 2024-09-21T03:26:25.708 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.705+0000 7f489b719640 1 -- 172.21.15.105:0/3593744214 wait complete. 2024-09-21T03:26:25.719 INFO:tasks.cephfs_test_runner:test_client_pin_mincaps (tasks.cephfs.test_client_limits.TestClientLimits) ... ok 2024-09-21T03:26:25.719 INFO:tasks.cephfs_test_runner:Starting test: test_client_pin_root (tasks.cephfs.test_client_limits.TestClientLimits) 2024-09-21T03:26:25.719 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:26:25.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.832+0000 7f2bab0be640 1 -- 172.21.15.105:0/2904076370 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b8c004800 msgr2=0x7f2b8c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:25.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.832+0000 7f2bab0be640 1 --2- 172.21.15.105:0/2904076370 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b8c004800 0x7f2b8c004c10 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f2b94009b20 tx=0x7f2b8c005830 comp rx=0 tx=0).stop 2024-09-21T03:26:25.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.832+0000 7f2bab0be640 1 -- 172.21.15.105:0/2904076370 shutdown_connections 2024-09-21T03:26:25.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.832+0000 7f2bab0be640 1 --2- 172.21.15.105:0/2904076370 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b8c004800 0x7f2b8c004c10 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:25.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.832+0000 7f2bab0be640 1 -- 172.21.15.105:0/2904076370 >> 172.21.15.105:0/2904076370 conn(0x7f2ba406def0 msgr2=0x7f2ba406e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:25.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.832+0000 7f2bab0be640 1 -- 172.21.15.105:0/2904076370 shutdown_connections 2024-09-21T03:26:25.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.832+0000 7f2bab0be640 1 -- 172.21.15.105:0/2904076370 wait complete. 2024-09-21T03:26:25.835 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.834+0000 7f2bab0be640 1 Processor -- start 2024-09-21T03:26:25.835 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.834+0000 7f2bab0be640 1 -- start start 2024-09-21T03:26:25.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.835+0000 7f2bab0be640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b8c004800 0x7f2ba41487e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:25.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.835+0000 7f2bab0be640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ba4145560 0x7f2ba406cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:25.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.835+0000 7f2bab0be640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ba406d320 0x7f2ba41561e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:25.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.835+0000 7f2bab0be640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba40702d0 con 0x7f2ba406d320 2024-09-21T03:26:25.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.835+0000 7f2bab0be640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba4070150 con 0x7f2ba4145560 2024-09-21T03:26:25.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.835+0000 7f2bab0be640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2ba4070450 con 0x7f2b8c004800 2024-09-21T03:26:25.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.835+0000 7f2ba965b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ba406d320 0x7f2ba41561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:25.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.836+0000 7f2ba965b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ba406d320 0x7f2ba41561e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:39790/0 (socket says 172.21.15.105:39790) 2024-09-21T03:26:25.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.836+0000 7f2ba965b640 1 -- 172.21.15.105:0/2749979240 learned_addr learned my addr 172.21.15.105:0/2749979240 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:25.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.836+0000 7f2ba8e5a640 1 --2- 172.21.15.105:0/2749979240 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b8c004800 0x7f2ba41487e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:25.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.836+0000 7f2b9bfff640 1 --2- 172.21.15.105:0/2749979240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ba4145560 0x7f2ba406cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:25.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.836+0000 7f2ba965b640 1 -- 172.21.15.105:0/2749979240 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b8c004800 msgr2=0x7f2ba41487e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:25.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.836+0000 7f2ba965b640 1 --2- 172.21.15.105:0/2749979240 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b8c004800 0x7f2ba41487e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:25.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.836+0000 7f2ba965b640 1 -- 172.21.15.105:0/2749979240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ba4145560 msgr2=0x7f2ba406cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:25.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.836+0000 7f2ba965b640 1 --2- 172.21.15.105:0/2749979240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ba4145560 0x7f2ba406cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:25.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.836+0000 7f2ba965b640 1 -- 172.21.15.105:0/2749979240 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ba406d730 con 0x7f2ba406d320 2024-09-21T03:26:25.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.836+0000 7f2ba965b640 1 --2- 172.21.15.105:0/2749979240 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ba406d320 0x7f2ba41561e0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4074340 tx=0x7f2b9c00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:25.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.836+0000 7f2b997fa640 1 -- 172.21.15.105:0/2749979240 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c00cc20 con 0x7f2ba406d320 2024-09-21T03:26:25.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.836+0000 7f2b997fa640 1 -- 172.21.15.105:0/2749979240 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b9c018070 con 0x7f2ba406d320 2024-09-21T03:26:25.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.836+0000 7f2bab0be640 1 -- 172.21.15.105:0/2749979240 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ba4148d20 con 0x7f2ba406d320 2024-09-21T03:26:25.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.836+0000 7f2b997fa640 1 -- 172.21.15.105:0/2749979240 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c0116c0 con 0x7f2ba406d320 2024-09-21T03:26:25.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.836+0000 7f2bab0be640 1 -- 172.21.15.105:0/2749979240 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ba40cc070 con 0x7f2ba406d320 2024-09-21T03:26:25.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.837+0000 7f2bab0be640 1 -- 172.21.15.105:0/2749979240 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ba40cbb00 con 0x7f2ba406d320 2024-09-21T03:26:25.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.838+0000 7f2b997fa640 1 -- 172.21.15.105:0/2749979240 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2b9c011860 con 0x7f2ba406d320 2024-09-21T03:26:25.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.838+0000 7f2b997fa640 1 --2- 172.21.15.105:0/2749979240 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2b90078b90 0x7f2b9007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:25.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.838+0000 7f2b997fa640 1 -- 172.21.15.105:0/2749979240 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 4943+0+0 (secure 0 0 0) 0x7f2b9c09af40 con 0x7f2ba406d320 2024-09-21T03:26:25.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.839+0000 7f2ba8e5a640 1 --2- 172.21.15.105:0/2749979240 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2b90078b90 0x7f2b9007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:25.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.839+0000 7f2ba8e5a640 1 --2- 172.21.15.105:0/2749979240 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2b90078b90 0x7f2b9007b0a0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0000c00 tx=0x7f2ba0006ce0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:25.844 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:25.843+0000 7f2b997fa640 1 -- 172.21.15.105:0/2749979240 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2ba406d730 con 0x7f2ba406d320 2024-09-21T03:26:26.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.020+0000 7f2bab0be640 1 -- 172.21.15.105:0/2749979240 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2ba40709b0 con 0x7f2ba406d320 2024-09-21T03:26:26.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.021+0000 7f2b997fa640 1 -- 172.21.15.105:0/2749979240 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v121) ==== 74+0+13116 (secure 0 0 0) 0x7f2b9c063030 con 0x7f2ba406d320 2024-09-21T03:26:26.022 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:26:26.023 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":121,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:26:24.693567+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.105:6835/3941149960":"2024-09-22T03:26:21.682275+0000","172.21.15.105:6833/3941149960":"2024-09-22T03:26:21.682275+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:26:26.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.023+0000 7f2bab0be640 1 -- 172.21.15.105:0/2749979240 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2b90078b90 msgr2=0x7f2b9007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:26.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.023+0000 7f2bab0be640 1 --2- 172.21.15.105:0/2749979240 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2b90078b90 0x7f2b9007b0a0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0000c00 tx=0x7f2ba0006ce0 comp rx=0 tx=0).stop 2024-09-21T03:26:26.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.023+0000 7f2bab0be640 1 -- 172.21.15.105:0/2749979240 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ba406d320 msgr2=0x7f2ba41561e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:26.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.023+0000 7f2bab0be640 1 --2- 172.21.15.105:0/2749979240 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ba406d320 0x7f2ba41561e0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4074340 tx=0x7f2b9c00ed90 comp rx=0 tx=0).stop 2024-09-21T03:26:26.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.023+0000 7f2bab0be640 1 -- 172.21.15.105:0/2749979240 shutdown_connections 2024-09-21T03:26:26.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.023+0000 7f2bab0be640 1 --2- 172.21.15.105:0/2749979240 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2b90078b90 0x7f2b9007b0a0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:26.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.023+0000 7f2bab0be640 1 --2- 172.21.15.105:0/2749979240 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ba406d320 0x7f2ba41561e0 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:26.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.023+0000 7f2bab0be640 1 --2- 172.21.15.105:0/2749979240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ba4145560 0x7f2ba406cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:26.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.023+0000 7f2bab0be640 1 --2- 172.21.15.105:0/2749979240 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b8c004800 0x7f2ba41487e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:26.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.023+0000 7f2bab0be640 1 -- 172.21.15.105:0/2749979240 >> 172.21.15.105:0/2749979240 conn(0x7f2ba406def0 msgr2=0x7f2ba40cf7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:26.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.023+0000 7f2bab0be640 1 -- 172.21.15.105:0/2749979240 shutdown_connections 2024-09-21T03:26:26.026 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.023+0000 7f2bab0be640 1 -- 172.21.15.105:0/2749979240 wait complete. 2024-09-21T03:26:26.037 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T03:18:19.296947+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T03:26:26.037 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T03:26:26.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.150+0000 7fdc5f225640 1 -- 172.21.15.105:0/3027890355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc5815cd50 msgr2=0x7fdc5815d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:26.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.150+0000 7fdc5f225640 1 --2- 172.21.15.105:0/3027890355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc5815cd50 0x7fdc5815d160 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fdc58072f30 tx=0x7fdc5002a980 comp rx=0 tx=0).stop 2024-09-21T03:26:26.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.150+0000 7fdc5f225640 1 -- 172.21.15.105:0/3027890355 shutdown_connections 2024-09-21T03:26:26.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.150+0000 7fdc5f225640 1 --2- 172.21.15.105:0/3027890355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc5815cd50 0x7fdc5815d160 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:26.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.150+0000 7fdc5f225640 1 --2- 172.21.15.105:0/3027890355 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc5806cde0 0x7fdc5806d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:26.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.150+0000 7fdc5f225640 1 --2- 172.21.15.105:0/3027890355 >> v2:172.21.15.162:3300/0 conn(0x7fdc5806e470 0x7fdc58070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:26.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.150+0000 7fdc5f225640 1 -- 172.21.15.105:0/3027890355 >> 172.21.15.105:0/3027890355 conn(0x7fdc580cd530 msgr2=0x7fdc580cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:26.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.150+0000 7fdc5f225640 1 -- 172.21.15.105:0/3027890355 shutdown_connections 2024-09-21T03:26:26.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.150+0000 7fdc5f225640 1 -- 172.21.15.105:0/3027890355 wait complete. 2024-09-21T03:26:26.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.152+0000 7fdc5f225640 1 Processor -- start 2024-09-21T03:26:26.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.152+0000 7fdc5f225640 1 -- start start 2024-09-21T03:26:26.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.154+0000 7fdc5f225640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc5806cde0 0x7fdc581f9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:26.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.154+0000 7fdc5f225640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc5806e470 0x7fdc581f6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:26.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.154+0000 7fdc5f225640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc5815cd50 0x7fdc581566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:26.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.154+0000 7fdc5f225640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdc580cbb70 con 0x7fdc5806cde0 2024-09-21T03:26:26.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.154+0000 7fdc5f225640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdc580cb9f0 con 0x7fdc5806e470 2024-09-21T03:26:26.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.154+0000 7fdc5f225640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdc5815d6a0 con 0x7fdc5815cd50 2024-09-21T03:26:26.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.154+0000 7fdc5cfc1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc5806cde0 0x7fdc581f9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:26.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.154+0000 7fdc5cfc1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc5806cde0 0x7fdc581f9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:39806/0 (socket says 172.21.15.105:39806) 2024-09-21T03:26:26.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.154+0000 7fdc5cfc1640 1 -- 172.21.15.105:0/2086862947 learned_addr learned my addr 172.21.15.105:0/2086862947 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:26.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.154+0000 7fdc57fff640 1 --2- 172.21.15.105:0/2086862947 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc5806e470 0x7fdc581f6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:26.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.154+0000 7fdc5d7c2640 1 --2- 172.21.15.105:0/2086862947 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc5815cd50 0x7fdc581566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:26.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.154+0000 7fdc5cfc1640 1 -- 172.21.15.105:0/2086862947 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc5815cd50 msgr2=0x7fdc581566e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:26.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.154+0000 7fdc5cfc1640 1 --2- 172.21.15.105:0/2086862947 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc5815cd50 0x7fdc581566e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:26.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.154+0000 7fdc5cfc1640 1 -- 172.21.15.105:0/2086862947 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc5806e470 msgr2=0x7fdc581f6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:26.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.154+0000 7fdc5cfc1640 1 --2- 172.21.15.105:0/2086862947 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc5806e470 0x7fdc581f6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:26.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.154+0000 7fdc5cfc1640 1 -- 172.21.15.105:0/2086862947 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc581f6a50 con 0x7fdc5806cde0 2024-09-21T03:26:26.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.154+0000 7fdc5cfc1640 1 --2- 172.21.15.105:0/2086862947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc5806cde0 0x7fdc581f9160 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c00d6d0 tx=0x7fdc4c00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:26.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.154+0000 7fdc557fa640 1 -- 172.21.15.105:0/2086862947 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c017070 con 0x7fdc5806cde0 2024-09-21T03:26:26.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.155+0000 7fdc557fa640 1 -- 172.21.15.105:0/2086862947 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc4c004310 con 0x7fdc5806cde0 2024-09-21T03:26:26.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.155+0000 7fdc5f225640 1 -- 172.21.15.105:0/2086862947 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc581f9a60 con 0x7fdc5806cde0 2024-09-21T03:26:26.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.155+0000 7fdc557fa640 1 -- 172.21.15.105:0/2086862947 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c009a80 con 0x7fdc5806cde0 2024-09-21T03:26:26.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.155+0000 7fdc5f225640 1 -- 172.21.15.105:0/2086862947 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc581f5d10 con 0x7fdc5806cde0 2024-09-21T03:26:26.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.156+0000 7fdc5f225640 1 -- 172.21.15.105:0/2086862947 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc5815db00 con 0x7fdc5806cde0 2024-09-21T03:26:26.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.156+0000 7fdc557fa640 1 -- 172.21.15.105:0/2086862947 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdc4c0035f0 con 0x7fdc5806cde0 2024-09-21T03:26:26.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.157+0000 7fdc557fa640 1 --2- 172.21.15.105:0/2086862947 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdc3c078b90 0x7fdc3c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:26.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.157+0000 7fdc557fa640 1 -- 172.21.15.105:0/2086862947 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 4943+0+0 (secure 0 0 0) 0x7fdc4c09ac80 con 0x7fdc5806cde0 2024-09-21T03:26:26.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.157+0000 7fdc57fff640 1 --2- 172.21.15.105:0/2086862947 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdc3c078b90 0x7fdc3c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:26.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.158+0000 7fdc57fff640 1 --2- 172.21.15.105:0/2086862947 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdc3c078b90 0x7fdc3c07b0a0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fdc580cff80 tx=0x7fdc4400b260 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:26.163 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.161+0000 7fdc557fa640 1 -- 172.21.15.105:0/2086862947 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fdc4c062d70 con 0x7fdc5806cde0 2024-09-21T03:26:26.339 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.338+0000 7fdc5f225640 1 -- 172.21.15.105:0/2086862947 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdc580b63c0 con 0x7fdc5806cde0 2024-09-21T03:26:26.340 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.338+0000 7fdc557fa640 1 -- 172.21.15.105:0/2086862947 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v121) ==== 93+0+10 (secure 0 0 0) 0x7fdc4c0677a0 con 0x7fdc5806cde0 2024-09-21T03:26:26.340 INFO:teuthology.orchestra.run.smithi105.stdout:pg_num: 1 2024-09-21T03:26:26.343 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.341+0000 7fdc5f225640 1 -- 172.21.15.105:0/2086862947 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdc3c078b90 msgr2=0x7fdc3c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:26.343 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.341+0000 7fdc5f225640 1 --2- 172.21.15.105:0/2086862947 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdc3c078b90 0x7fdc3c07b0a0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fdc580cff80 tx=0x7fdc4400b260 comp rx=0 tx=0).stop 2024-09-21T03:26:26.343 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.341+0000 7fdc5f225640 1 -- 172.21.15.105:0/2086862947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc5806cde0 msgr2=0x7fdc581f9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:26.343 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.341+0000 7fdc5f225640 1 --2- 172.21.15.105:0/2086862947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc5806cde0 0x7fdc581f9160 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c00d6d0 tx=0x7fdc4c00db90 comp rx=0 tx=0).stop 2024-09-21T03:26:26.343 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.341+0000 7fdc5f225640 1 -- 172.21.15.105:0/2086862947 shutdown_connections 2024-09-21T03:26:26.343 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.341+0000 7fdc5f225640 1 --2- 172.21.15.105:0/2086862947 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdc3c078b90 0x7fdc3c07b0a0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:26.343 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.341+0000 7fdc5f225640 1 --2- 172.21.15.105:0/2086862947 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc5815cd50 0x7fdc581566e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:26.343 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.341+0000 7fdc5f225640 1 --2- 172.21.15.105:0/2086862947 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc5806e470 0x7fdc581f6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:26.343 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.341+0000 7fdc5f225640 1 --2- 172.21.15.105:0/2086862947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc5806cde0 0x7fdc581f9160 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:26.343 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.341+0000 7fdc5f225640 1 -- 172.21.15.105:0/2086862947 >> 172.21.15.105:0/2086862947 conn(0x7fdc580cd530 msgr2=0x7fdc580b1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:26.344 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.341+0000 7fdc5f225640 1 -- 172.21.15.105:0/2086862947 shutdown_connections 2024-09-21T03:26:26.344 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.341+0000 7fdc5f225640 1 -- 172.21.15.105:0/2086862947 wait complete. 2024-09-21T03:26:26.353 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_root' 2024-09-21T03:26:26.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.463+0000 7fa5adcbd640 1 -- 172.21.15.105:0/2292582875 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5a815b8f0 msgr2=0x7fa5a80cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:26.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.463+0000 7fa5adcbd640 1 --2- 172.21.15.105:0/2292582875 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5a815b8f0 0x7fa5a80cf130 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8072af0 tx=0x7fa59802a530 comp rx=0 tx=0).stop 2024-09-21T03:26:26.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.463+0000 7fa5adcbd640 1 -- 172.21.15.105:0/2292582875 shutdown_connections 2024-09-21T03:26:26.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.463+0000 7fa5adcbd640 1 --2- 172.21.15.105:0/2292582875 >> v2:172.21.15.162:3300/0 conn(0x7fa5a80b0520 0x7fa5a8071650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:26.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.463+0000 7fa5adcbd640 1 --2- 172.21.15.105:0/2292582875 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5a815b8f0 0x7fa5a80cf130 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:26.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.463+0000 7fa5adcbd640 1 -- 172.21.15.105:0/2292582875 >> 172.21.15.105:0/2292582875 conn(0x7fa5a80cdcb0 msgr2=0x7fa5a80ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:26.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.463+0000 7fa5adcbd640 1 -- 172.21.15.105:0/2292582875 shutdown_connections 2024-09-21T03:26:26.466 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.463+0000 7fa5adcbd640 1 -- 172.21.15.105:0/2292582875 wait complete. 2024-09-21T03:26:26.467 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.465+0000 7fa5adcbd640 1 Processor -- start 2024-09-21T03:26:26.467 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.465+0000 7fa5adcbd640 1 -- start start 2024-09-21T03:26:26.470 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.466+0000 7fa5adcbd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5a80b0520 0x7fa5a809e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:26.470 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.467+0000 7fa5adcbd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5a80b2cb0 0x7fa5a81f9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:26.470 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.467+0000 7fa5adcbd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa5a815b8f0 0x7fa5a80af190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:26.470 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.467+0000 7fa5adcbd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a80ae120 con 0x7fa5a80b0520 2024-09-21T03:26:26.470 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.467+0000 7fa5adcbd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a80adfa0 con 0x7fa5a80b2cb0 2024-09-21T03:26:26.470 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.467+0000 7fa5adcbd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa5a80ae2a0 con 0x7fa5a815b8f0 2024-09-21T03:26:26.470 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.467+0000 7fa5a77fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5a80b0520 0x7fa5a809e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:26.470 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.467+0000 7fa5a77fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5a80b0520 0x7fa5a809e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:39826/0 (socket says 172.21.15.105:39826) 2024-09-21T03:26:26.470 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.467+0000 7fa5a77fe640 1 -- 172.21.15.105:0/1689348079 learned_addr learned my addr 172.21.15.105:0/1689348079 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:26.470 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.467+0000 7fa5a6ffd640 1 --2- 172.21.15.105:0/1689348079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5a80b2cb0 0x7fa5a81f9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:26.470 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.467+0000 7fa5a7fff640 1 --2- 172.21.15.105:0/1689348079 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa5a815b8f0 0x7fa5a80af190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:26.470 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.467+0000 7fa5a77fe640 1 -- 172.21.15.105:0/1689348079 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa5a815b8f0 msgr2=0x7fa5a80af190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:26.470 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.467+0000 7fa5a77fe640 1 --2- 172.21.15.105:0/1689348079 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa5a815b8f0 0x7fa5a80af190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:26.471 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.467+0000 7fa5a77fe640 1 -- 172.21.15.105:0/1689348079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5a80b2cb0 msgr2=0x7fa5a81f9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:26.471 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.467+0000 7fa5a77fe640 1 --2- 172.21.15.105:0/1689348079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5a80b2cb0 0x7fa5a81f9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:26.471 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.467+0000 7fa5a77fe640 1 -- 172.21.15.105:0/1689348079 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5a81fd500 con 0x7fa5a80b0520 2024-09-21T03:26:26.471 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.467+0000 7fa5a77fe640 1 --2- 172.21.15.105:0/1689348079 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5a80b0520 0x7fa5a809e500 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fa598009780 tx=0x7fa598033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:26.471 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.467+0000 7fa59ffff640 1 -- 172.21.15.105:0/1689348079 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa598031d60 con 0x7fa5a80b0520 2024-09-21T03:26:26.471 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.467+0000 7fa59ffff640 1 -- 172.21.15.105:0/1689348079 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa598033e10 con 0x7fa5a80b0520 2024-09-21T03:26:26.471 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.467+0000 7fa5adcbd640 1 -- 172.21.15.105:0/1689348079 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5a81fd970 con 0x7fa5a80b0520 2024-09-21T03:26:26.471 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.467+0000 7fa59ffff640 1 -- 172.21.15.105:0/1689348079 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa598005260 con 0x7fa5a80b0520 2024-09-21T03:26:26.471 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.467+0000 7fa5adcbd640 1 -- 172.21.15.105:0/1689348079 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5a81fdf30 con 0x7fa5a80b0520 2024-09-21T03:26:26.472 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.469+0000 7fa5adcbd640 1 -- 172.21.15.105:0/1689348079 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5a80b0300 con 0x7fa5a80b0520 2024-09-21T03:26:26.472 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.469+0000 7fa59ffff640 1 -- 172.21.15.105:0/1689348079 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa598005400 con 0x7fa5a80b0520 2024-09-21T03:26:26.472 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.470+0000 7fa59ffff640 1 --2- 172.21.15.105:0/1689348079 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa588078b90 0x7fa58807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:26.472 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.470+0000 7fa59ffff640 1 -- 172.21.15.105:0/1689348079 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 4943+0+0 (secure 0 0 0) 0x7fa5980bbbb0 con 0x7fa5a80b0520 2024-09-21T03:26:26.472 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.470+0000 7fa5a6ffd640 1 --2- 172.21.15.105:0/1689348079 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa588078b90 0x7fa58807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:26.473 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.471+0000 7fa5a6ffd640 1 --2- 172.21.15.105:0/1689348079 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa588078b90 0x7fa58807b0a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa5a81e8d60 tx=0x7fa59000b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:26.476 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.475+0000 7fa59ffff640 1 -- 172.21.15.105:0/1689348079 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa59803f030 con 0x7fa5a80b0520 2024-09-21T03:26:26.721 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:26.720+0000 7fa5adcbd640 1 -- 172.21.15.105:0/1689348079 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_root"]} v 0) -- 0x7fa5a80b1a60 con 0x7fa5a80b0520 2024-09-21T03:26:27.564 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:26:27.567 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:26:27.714 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.712+0000 7fa59ffff640 1 -- 172.21.15.105:0/1689348079 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_root"]}]=0 v398) ==== 151+0+0 (secure 0 0 0) 0x7fa598083d30 con 0x7fa5a80b0520 2024-09-21T03:26:27.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.715+0000 7fa5adcbd640 1 -- 172.21.15.105:0/1689348079 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa588078b90 msgr2=0x7fa58807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:27.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.715+0000 7fa5adcbd640 1 --2- 172.21.15.105:0/1689348079 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa588078b90 0x7fa58807b0a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa5a81e8d60 tx=0x7fa59000b2e0 comp rx=0 tx=0).stop 2024-09-21T03:26:27.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.715+0000 7fa5adcbd640 1 -- 172.21.15.105:0/1689348079 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5a80b0520 msgr2=0x7fa5a809e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:27.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.715+0000 7fa5adcbd640 1 --2- 172.21.15.105:0/1689348079 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5a80b0520 0x7fa5a809e500 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fa598009780 tx=0x7fa598033c20 comp rx=0 tx=0).stop 2024-09-21T03:26:27.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.715+0000 7fa5adcbd640 1 -- 172.21.15.105:0/1689348079 shutdown_connections 2024-09-21T03:26:27.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.715+0000 7fa5adcbd640 1 --2- 172.21.15.105:0/1689348079 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa588078b90 0x7fa58807b0a0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:27.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.715+0000 7fa5adcbd640 1 --2- 172.21.15.105:0/1689348079 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa5a815b8f0 0x7fa5a80af190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:27.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.715+0000 7fa5adcbd640 1 --2- 172.21.15.105:0/1689348079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5a80b2cb0 0x7fa5a81f9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:27.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.715+0000 7fa5adcbd640 1 --2- 172.21.15.105:0/1689348079 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5a80b0520 0x7fa5a809e500 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:27.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.715+0000 7fa5adcbd640 1 -- 172.21.15.105:0/1689348079 >> 172.21.15.105:0/1689348079 conn(0x7fa5a80cdcb0 msgr2=0x7fa5a80b0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:27.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.715+0000 7fa5adcbd640 1 -- 172.21.15.105:0/1689348079 shutdown_connections 2024-09-21T03:26:27.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.715+0000 7fa5adcbd640 1 -- 172.21.15.105:0/1689348079 wait complete. 2024-09-21T03:26:27.731 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T03:26:27.850 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.848+0000 7f8360bad640 1 -- 172.21.15.105:0/3850449002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f835c1570e0 msgr2=0x7f835c0d1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:27.851 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.848+0000 7f8360bad640 1 --2- 172.21.15.105:0/3850449002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f835c1570e0 0x7f835c0d1f20 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f834c005fd0 tx=0x7f834c02a8b0 comp rx=0 tx=0).stop 2024-09-21T03:26:27.851 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.848+0000 7f8360bad640 1 -- 172.21.15.105:0/3850449002 shutdown_connections 2024-09-21T03:26:27.851 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.848+0000 7f8360bad640 1 --2- 172.21.15.105:0/3850449002 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f835c15d840 0x7f835c0b7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:27.851 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.848+0000 7f8360bad640 1 --2- 172.21.15.105:0/3850449002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f835c1570e0 0x7f835c0d1f20 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:27.851 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.848+0000 7f8360bad640 1 -- 172.21.15.105:0/3850449002 >> 172.21.15.105:0/3850449002 conn(0x7f835c06d550 msgr2=0x7f835c071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:27.851 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.848+0000 7f8360bad640 1 -- 172.21.15.105:0/3850449002 shutdown_connections 2024-09-21T03:26:27.851 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.848+0000 7f8360bad640 1 -- 172.21.15.105:0/3850449002 wait complete. 2024-09-21T03:26:27.852 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.850+0000 7f8360bad640 1 Processor -- start 2024-09-21T03:26:27.852 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.850+0000 7f8360bad640 1 -- start start 2024-09-21T03:26:27.855 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.852+0000 7f8360bad640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f835c0d2460 0x7f835c1f75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:27.855 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.852+0000 7f8360bad640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f835c1570e0 0x7f835c0c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:27.855 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.852+0000 7f8360bad640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f835c15d840 0x7f835c153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:27.855 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.852+0000 7f8360bad640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f835c0b7d60 con 0x7f835c0d2460 2024-09-21T03:26:27.855 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.852+0000 7f8360bad640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f835c0b7be0 con 0x7f835c15d840 2024-09-21T03:26:27.855 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.852+0000 7f8360bad640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f835c0b7ee0 con 0x7f835c1570e0 2024-09-21T03:26:27.855 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.852+0000 7f835a59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f835c0d2460 0x7f835c1f75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:27.855 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.852+0000 7f835a59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f835c0d2460 0x7f835c1f75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:39832/0 (socket says 172.21.15.105:39832) 2024-09-21T03:26:27.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.852+0000 7f835a59c640 1 -- 172.21.15.105:0/3092581751 learned_addr learned my addr 172.21.15.105:0/3092581751 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:27.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.852+0000 7f8359d9b640 1 --2- 172.21.15.105:0/3092581751 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f835c1570e0 0x7f835c0c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:27.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.852+0000 7f835ad9d640 1 --2- 172.21.15.105:0/3092581751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f835c15d840 0x7f835c153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:27.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.852+0000 7f835a59c640 1 -- 172.21.15.105:0/3092581751 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f835c1570e0 msgr2=0x7f835c0c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:27.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.852+0000 7f835a59c640 1 --2- 172.21.15.105:0/3092581751 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f835c1570e0 0x7f835c0c7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:27.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.852+0000 7f835a59c640 1 -- 172.21.15.105:0/3092581751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f835c15d840 msgr2=0x7f835c153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:27.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.852+0000 7f835a59c640 1 --2- 172.21.15.105:0/3092581751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f835c15d840 0x7f835c153540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:27.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.852+0000 7f835a59c640 1 -- 172.21.15.105:0/3092581751 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f835c153a80 con 0x7f835c0d2460 2024-09-21T03:26:27.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.852+0000 7f835a59c640 1 --2- 172.21.15.105:0/3092581751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f835c0d2460 0x7f835c1f75d0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f834c000f80 tx=0x7f834c003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:27.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.852+0000 7f834affd640 1 -- 172.21.15.105:0/3092581751 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c031990 con 0x7f835c0d2460 2024-09-21T03:26:27.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.853+0000 7f834affd640 1 -- 172.21.15.105:0/3092581751 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f834c031c20 con 0x7f835c0d2460 2024-09-21T03:26:27.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.853+0000 7f8360bad640 1 -- 172.21.15.105:0/3092581751 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f835c1f8480 con 0x7f835c0d2460 2024-09-21T03:26:27.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.853+0000 7f834affd640 1 -- 172.21.15.105:0/3092581751 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c0330d0 con 0x7f835c0d2460 2024-09-21T03:26:27.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.853+0000 7f8360bad640 1 -- 172.21.15.105:0/3092581751 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f835c1f7be0 con 0x7f835c0d2460 2024-09-21T03:26:27.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.854+0000 7f8360bad640 1 -- 172.21.15.105:0/3092581751 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f835c0d1f20 con 0x7f835c0d2460 2024-09-21T03:26:27.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.854+0000 7f834affd640 1 -- 172.21.15.105:0/3092581751 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f834c033270 con 0x7f835c0d2460 2024-09-21T03:26:27.858 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.855+0000 7f834affd640 1 --2- 172.21.15.105:0/3092581751 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f833c078bc0 0x7f833c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:27.858 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.855+0000 7f834affd640 1 -- 172.21.15.105:0/3092581751 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 4943+0+0 (secure 0 0 0) 0x7f834c0bbe70 con 0x7f835c0d2460 2024-09-21T03:26:27.858 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.855+0000 7f8359d9b640 1 --2- 172.21.15.105:0/3092581751 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f833c078bc0 0x7f833c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:27.858 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.855+0000 7f8359d9b640 1 --2- 172.21.15.105:0/3092581751 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f833c078bc0 0x7f833c07b0d0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f835c150520 tx=0x7f8350009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:27.861 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:27.859+0000 7f834affd640 1 -- 172.21.15.105:0/3092581751 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f835c153a80 con 0x7f835c0d2460 2024-09-21T03:26:28.037 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.035+0000 7f8360bad640 1 -- 172.21.15.105:0/3092581751 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f835c15ec90 con 0x7f835c0d2460 2024-09-21T03:26:28.037 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.036+0000 7f834affd640 1 -- 172.21.15.105:0/3092581751 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v62) ==== 59+0+2294 (secure 0 0 0) 0x7f834c03f030 con 0x7f835c0d2460 2024-09-21T03:26:28.038 INFO:teuthology.orchestra.run.smithi105.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T03:26:28.038 INFO:teuthology.orchestra.run.smithi105.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T03:26:28.038 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced client_mount_timeout 30 2024-09-21T03:26:28.038 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced debug_client 20/20 2024-09-21T03:26:28.038 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced debug_mgr 20/20 2024-09-21T03:26:28.038 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced debug_ms 1/1 2024-09-21T03:26:28.038 INFO:teuthology.orchestra.run.smithi105.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T03:26:28.038 INFO:teuthology.orchestra.run.smithi105.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T03:26:28.038 INFO:teuthology.orchestra.run.smithi105.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 7291.545169 2024-09-21T03:26:28.038 INFO:teuthology.orchestra.run.smithi105.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5080.142035 2024-09-21T03:26:28.039 INFO:teuthology.orchestra.run.smithi105.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5120.988640 2024-09-21T03:26:28.039 INFO:teuthology.orchestra.run.smithi105.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4938.196268 2024-09-21T03:26:28.039 INFO:teuthology.orchestra.run.smithi105.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4906.316728 2024-09-21T03:26:28.039 INFO:teuthology.orchestra.run.smithi105.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4701.273858 2024-09-21T03:26:28.039 INFO:teuthology.orchestra.run.smithi105.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4947.710044 2024-09-21T03:26:28.039 INFO:teuthology.orchestra.run.smithi105.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5174.949063 2024-09-21T03:26:28.039 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced debug_mds 20/20 2024-09-21T03:26:28.039 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T03:26:28.039 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced debug_ms 2/2 2024-09-21T03:26:28.039 INFO:teuthology.orchestra.run.smithi105.stdout:mds dev mds_debug_frag true 2024-09-21T03:26:28.039 INFO:teuthology.orchestra.run.smithi105.stdout:mds dev mds_debug_scatterstat true 2024-09-21T03:26:28.039 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T03:26:28.039 INFO:teuthology.orchestra.run.smithi105.stdout:mds dev mds_verify_scatter true 2024-09-21T03:26:28.039 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T03:26:28.040 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T03:26:28.040 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T03:26:28.040 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced client_mount_timeout 600 2024-09-21T03:26:28.040 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced debug_client 20/20 2024-09-21T03:26:28.040 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced debug_ms 1/1 2024-09-21T03:26:28.040 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T03:26:28.040 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T03:26:28.041 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.038+0000 7f8360bad640 1 -- 172.21.15.105:0/3092581751 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f833c078bc0 msgr2=0x7f833c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:28.041 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.038+0000 7f8360bad640 1 --2- 172.21.15.105:0/3092581751 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f833c078bc0 0x7f833c07b0d0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f835c150520 tx=0x7f8350009040 comp rx=0 tx=0).stop 2024-09-21T03:26:28.041 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.038+0000 7f8360bad640 1 -- 172.21.15.105:0/3092581751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f835c0d2460 msgr2=0x7f835c1f75d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:28.041 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.038+0000 7f8360bad640 1 --2- 172.21.15.105:0/3092581751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f835c0d2460 0x7f835c1f75d0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f834c000f80 tx=0x7f834c003970 comp rx=0 tx=0).stop 2024-09-21T03:26:28.041 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.038+0000 7f8360bad640 1 -- 172.21.15.105:0/3092581751 shutdown_connections 2024-09-21T03:26:28.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.038+0000 7f8360bad640 1 --2- 172.21.15.105:0/3092581751 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f833c078bc0 0x7f833c07b0d0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:28.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.038+0000 7f8360bad640 1 --2- 172.21.15.105:0/3092581751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f835c15d840 0x7f835c153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:28.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.038+0000 7f8360bad640 1 --2- 172.21.15.105:0/3092581751 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f835c1570e0 0x7f835c0c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:28.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.038+0000 7f8360bad640 1 --2- 172.21.15.105:0/3092581751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f835c0d2460 0x7f835c1f75d0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:28.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.038+0000 7f8360bad640 1 -- 172.21.15.105:0/3092581751 >> 172.21.15.105:0/3092581751 conn(0x7f835c06d550 msgr2=0x7f835c0b6530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:28.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.038+0000 7f8360bad640 1 -- 172.21.15.105:0/3092581751 shutdown_connections 2024-09-21T03:26:28.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.038+0000 7f8360bad640 1 -- 172.21.15.105:0/3092581751 wait complete. 2024-09-21T03:26:28.051 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T03:26:28.167 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.165+0000 7fdbc82d3640 1 -- 172.21.15.105:0/1546570767 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbc0070030 msgr2=0x7fdbc0074640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:28.167 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.165+0000 7fdbc82d3640 1 --2- 172.21.15.105:0/1546570767 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbc0070030 0x7fdbc0074640 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fdbc00b4b40 tx=0x7fdbb002a560 comp rx=0 tx=0).stop 2024-09-21T03:26:28.167 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.165+0000 7fdbc82d3640 1 -- 172.21.15.105:0/1546570767 shutdown_connections 2024-09-21T03:26:28.168 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.165+0000 7fdbc82d3640 1 --2- 172.21.15.105:0/1546570767 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbc0070030 0x7fdbc0074640 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:28.168 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.165+0000 7fdbc82d3640 1 --2- 172.21.15.105:0/1546570767 >> v2:172.21.15.162:3300/0 conn(0x7fdbc0070440 0x7fdbc0074b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:28.168 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.165+0000 7fdbc82d3640 1 -- 172.21.15.105:0/1546570767 >> 172.21.15.105:0/1546570767 conn(0x7fdbc00b1cb0 msgr2=0x7fdbc00b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:28.168 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.165+0000 7fdbc82d3640 1 -- 172.21.15.105:0/1546570767 shutdown_connections 2024-09-21T03:26:28.168 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.165+0000 7fdbc82d3640 1 -- 172.21.15.105:0/1546570767 wait complete. 2024-09-21T03:26:28.168 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.167+0000 7fdbc82d3640 1 Processor -- start 2024-09-21T03:26:28.168 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.167+0000 7fdbc82d3640 1 -- start start 2024-09-21T03:26:28.171 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.168+0000 7fdbc82d3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdbc0070030 0x7fdbc01f7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:28.171 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.168+0000 7fdbc82d3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbc0070440 0x7fdbc01f4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:28.171 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.168+0000 7fdbc82d3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdbc0073170 0x7fdbc0147e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:28.172 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.168+0000 7fdbc82d3640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc00b39f0 con 0x7fdbc0070440 2024-09-21T03:26:28.172 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.168+0000 7fdbc82d3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc00b3870 con 0x7fdbc0073170 2024-09-21T03:26:28.172 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.168+0000 7fdbc82d3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdbc00b3b70 con 0x7fdbc0070030 2024-09-21T03:26:28.172 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.168+0000 7fdbc586e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbc0070440 0x7fdbc01f4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:28.172 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.168+0000 7fdbc586e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbc0070440 0x7fdbc01f4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:39850/0 (socket says 172.21.15.105:39850) 2024-09-21T03:26:28.172 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.168+0000 7fdbc586e640 1 -- 172.21.15.105:0/349659160 learned_addr learned my addr 172.21.15.105:0/349659160 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:28.172 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.169+0000 7fdbc586e640 1 -- 172.21.15.105:0/349659160 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdbc0070030 msgr2=0x7fdbc01f7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:28.172 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.169+0000 7fdbc586e640 1 --2- 172.21.15.105:0/349659160 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdbc0070030 0x7fdbc01f7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:28.172 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.169+0000 7fdbc586e640 1 -- 172.21.15.105:0/349659160 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdbc0073170 msgr2=0x7fdbc0147e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:28.172 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.169+0000 7fdbc586e640 1 --2- 172.21.15.105:0/349659160 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdbc0073170 0x7fdbc0147e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:28.172 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.169+0000 7fdbc586e640 1 -- 172.21.15.105:0/349659160 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbc01e5250 con 0x7fdbc0070440 2024-09-21T03:26:28.172 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.169+0000 7fdbc586e640 1 --2- 172.21.15.105:0/349659160 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbc0070440 0x7fdbc01f4350 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0000c00 tx=0x7fdbb0003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:28.172 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.169+0000 7fdbb6ffd640 1 -- 172.21.15.105:0/349659160 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb003e030 con 0x7fdbc0070440 2024-09-21T03:26:28.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.169+0000 7fdbb6ffd640 1 -- 172.21.15.105:0/349659160 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdbb0003e00 con 0x7fdbc0070440 2024-09-21T03:26:28.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.169+0000 7fdbc82d3640 1 -- 172.21.15.105:0/349659160 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbc01e5530 con 0x7fdbc0070440 2024-09-21T03:26:28.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.169+0000 7fdbb6ffd640 1 -- 172.21.15.105:0/349659160 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb0035040 con 0x7fdbc0070440 2024-09-21T03:26:28.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.169+0000 7fdbc82d3640 1 -- 172.21.15.105:0/349659160 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbc009b490 con 0x7fdbc0070440 2024-09-21T03:26:28.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.170+0000 7fdbc82d3640 1 -- 172.21.15.105:0/349659160 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbc00b40d0 con 0x7fdbc0070440 2024-09-21T03:26:28.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.171+0000 7fdbb6ffd640 1 -- 172.21.15.105:0/349659160 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdbb0041030 con 0x7fdbc0070440 2024-09-21T03:26:28.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.171+0000 7fdbb6ffd640 1 --2- 172.21.15.105:0/349659160 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdba4078b90 0x7fdba407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:28.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.171+0000 7fdbb6ffd640 1 -- 172.21.15.105:0/349659160 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 4943+0+0 (secure 0 0 0) 0x7fdbb00bb6c0 con 0x7fdbc0070440 2024-09-21T03:26:28.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.172+0000 7fdbc606f640 1 --2- 172.21.15.105:0/349659160 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdba4078b90 0x7fdba407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:28.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.172+0000 7fdbc606f640 1 --2- 172.21.15.105:0/349659160 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdba4078b90 0x7fdba407b0a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc006fd0 tx=0x7fdbbc006bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:28.177 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.175+0000 7fdbb6ffd640 1 -- 172.21.15.105:0/349659160 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fdbb0083ee0 con 0x7fdbc0070440 2024-09-21T03:26:28.353 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.351+0000 7fdbc82d3640 1 -- 172.21.15.105:0/349659160 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fdbc00c3860 con 0x7fdbc0070440 2024-09-21T03:26:28.357 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.355+0000 7fdbb6ffd640 1 -- 172.21.15.105:0/349659160 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v63)=0 v63) ==== 122+0+0 (secure 0 0 0) 0x7fdbb00837e0 con 0x7fdbc0070440 2024-09-21T03:26:28.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.358+0000 7fdbc82d3640 1 -- 172.21.15.105:0/349659160 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdba4078b90 msgr2=0x7fdba407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:28.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.358+0000 7fdbc82d3640 1 --2- 172.21.15.105:0/349659160 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdba4078b90 0x7fdba407b0a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc006fd0 tx=0x7fdbbc006bc0 comp rx=0 tx=0).stop 2024-09-21T03:26:28.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.358+0000 7fdbc82d3640 1 -- 172.21.15.105:0/349659160 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbc0070440 msgr2=0x7fdbc01f4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:28.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.358+0000 7fdbc82d3640 1 --2- 172.21.15.105:0/349659160 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbc0070440 0x7fdbc01f4350 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0000c00 tx=0x7fdbb0003910 comp rx=0 tx=0).stop 2024-09-21T03:26:28.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.358+0000 7fdbc82d3640 1 -- 172.21.15.105:0/349659160 shutdown_connections 2024-09-21T03:26:28.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.358+0000 7fdbc82d3640 1 --2- 172.21.15.105:0/349659160 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdba4078b90 0x7fdba407b0a0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:28.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.358+0000 7fdbc82d3640 1 --2- 172.21.15.105:0/349659160 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdbc0073170 0x7fdbc0147e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:28.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.358+0000 7fdbc82d3640 1 --2- 172.21.15.105:0/349659160 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbc0070440 0x7fdbc01f4350 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:28.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.358+0000 7fdbc82d3640 1 --2- 172.21.15.105:0/349659160 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdbc0070030 0x7fdbc01f7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:28.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.358+0000 7fdbc82d3640 1 -- 172.21.15.105:0/349659160 >> 172.21.15.105:0/349659160 conn(0x7fdbc00b1cb0 msgr2=0x7fdbc00afb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:28.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.358+0000 7fdbc82d3640 1 -- 172.21.15.105:0/349659160 shutdown_connections 2024-09-21T03:26:28.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.358+0000 7fdbc82d3640 1 -- 172.21.15.105:0/349659160 wait complete. 2024-09-21T03:26:28.370 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T03:26:28.371 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T03:26:28.411 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T03:26:28.460 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T03:26:28.460 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:26:28.461 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:26:28.476 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T03:26:28.477 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:26:28.477 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:26:28.495 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=452 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T03:26:28.495 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:26:28.495 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:26:28.534 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T03:26:28.535 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:26:28.535 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:26:28.553 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=452 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T03:26:28.553 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T03:26:28.554 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:26:28.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.686+0000 7f26b3c5c640 1 -- 172.21.15.105:0/105697148 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f26ac0d1a80 msgr2=0x7f26ac0cf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:28.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.686+0000 7f26b3c5c640 1 --2- 172.21.15.105:0/105697148 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f26ac0d1a80 0x7f26ac0cf090 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f269c005fd0 tx=0x7f269c02a5d0 comp rx=0 tx=0).stop 2024-09-21T03:26:28.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.686+0000 7f26b3c5c640 1 -- 172.21.15.105:0/105697148 shutdown_connections 2024-09-21T03:26:28.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.686+0000 7f26b3c5c640 1 --2- 172.21.15.105:0/105697148 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f26ac0d1a80 0x7f26ac0cf090 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:28.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.686+0000 7f26b3c5c640 1 --2- 172.21.15.105:0/105697148 >> v2:172.21.15.162:3300/0 conn(0x7f26ac0cf5d0 0x7f26ac0cf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:28.688 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.686+0000 7f26b3c5c640 1 -- 172.21.15.105:0/105697148 >> 172.21.15.105:0/105697148 conn(0x7f26ac08bfc0 msgr2=0x7f26ac09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:28.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.686+0000 7f26b3c5c640 1 -- 172.21.15.105:0/105697148 shutdown_connections 2024-09-21T03:26:28.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.686+0000 7f26b3c5c640 1 -- 172.21.15.105:0/105697148 wait complete. 2024-09-21T03:26:28.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.688+0000 7f26b3c5c640 1 Processor -- start 2024-09-21T03:26:28.689 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.688+0000 7f26b3c5c640 1 -- start start 2024-09-21T03:26:28.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.689+0000 7f26b3c5c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26ac0cf5d0 0x7f26ac14e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:28.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.689+0000 7f26b3c5c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26ac0d1a80 0x7f26ac1f90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:28.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.689+0000 7f26b3c5c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f26ac0d2ed0 0x7f26ac1f9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:28.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.689+0000 7f26b3c5c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f26ac162cb0 con 0x7f26ac0d1a80 2024-09-21T03:26:28.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.689+0000 7f26b3c5c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f26ac162b30 con 0x7f26ac0cf5d0 2024-09-21T03:26:28.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.689+0000 7f26b3c5c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f26ac162e30 con 0x7f26ac0d2ed0 2024-09-21T03:26:28.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.689+0000 7f26b11f7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26ac0d1a80 0x7f26ac1f90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:28.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.689+0000 7f26b11f7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26ac0d1a80 0x7f26ac1f90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:39866/0 (socket says 172.21.15.105:39866) 2024-09-21T03:26:28.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.689+0000 7f26b11f7640 1 -- 172.21.15.105:0/4275986980 learned_addr learned my addr 172.21.15.105:0/4275986980 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:28.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.689+0000 7f26b21f9640 1 --2- 172.21.15.105:0/4275986980 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f26ac0d2ed0 0x7f26ac1f9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:28.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.689+0000 7f26b19f8640 1 --2- 172.21.15.105:0/4275986980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26ac0cf5d0 0x7f26ac14e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:28.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.689+0000 7f26b11f7640 1 -- 172.21.15.105:0/4275986980 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f26ac0d2ed0 msgr2=0x7f26ac1f9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:28.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.689+0000 7f26b11f7640 1 --2- 172.21.15.105:0/4275986980 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f26ac0d2ed0 0x7f26ac1f9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:28.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.689+0000 7f26b11f7640 1 -- 172.21.15.105:0/4275986980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26ac0cf5d0 msgr2=0x7f26ac14e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:28.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.689+0000 7f26b11f7640 1 --2- 172.21.15.105:0/4275986980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26ac0cf5d0 0x7f26ac14e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:28.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.689+0000 7f26b11f7640 1 -- 172.21.15.105:0/4275986980 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26ac1f9eb0 con 0x7f26ac0d1a80 2024-09-21T03:26:28.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.690+0000 7f26b11f7640 1 --2- 172.21.15.105:0/4275986980 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26ac0d1a80 0x7f26ac1f90f0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f269c000c00 tx=0x7f269c0035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:28.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.690+0000 7f26a27fc640 1 -- 172.21.15.105:0/4275986980 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269c03e030 con 0x7f26ac0d1a80 2024-09-21T03:26:28.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.690+0000 7f26a27fc640 1 -- 172.21.15.105:0/4275986980 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f269c003ae0 con 0x7f26ac0d1a80 2024-09-21T03:26:28.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.690+0000 7f26b3c5c640 1 -- 172.21.15.105:0/4275986980 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26ac150d50 con 0x7f26ac0d1a80 2024-09-21T03:26:28.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.690+0000 7f26a27fc640 1 -- 172.21.15.105:0/4275986980 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269c035040 con 0x7f26ac0d1a80 2024-09-21T03:26:28.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.690+0000 7f26b3c5c640 1 -- 172.21.15.105:0/4275986980 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26ac151310 con 0x7f26ac0d1a80 2024-09-21T03:26:28.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.691+0000 7f26b3c5c640 1 -- 172.21.15.105:0/4275986980 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26ac1f9c00 con 0x7f26ac0d1a80 2024-09-21T03:26:28.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.692+0000 7f26a27fc640 1 -- 172.21.15.105:0/4275986980 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f269c041030 con 0x7f26ac0d1a80 2024-09-21T03:26:28.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.692+0000 7f26a27fc640 1 --2- 172.21.15.105:0/4275986980 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2690078bc0 0x7f269007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:28.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.692+0000 7f26a27fc640 1 -- 172.21.15.105:0/4275986980 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 4943+0+0 (secure 0 0 0) 0x7f269c0baee0 con 0x7f26ac0d1a80 2024-09-21T03:26:28.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.692+0000 7f26b19f8640 1 --2- 172.21.15.105:0/4275986980 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2690078bc0 0x7f269007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:28.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.693+0000 7f26b19f8640 1 --2- 172.21.15.105:0/4275986980 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2690078bc0 0x7f269007b0d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f26a8007fd0 tx=0x7f26a8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:28.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.696+0000 7f26a27fc640 1 -- 172.21.15.105:0/4275986980 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f269c082fe0 con 0x7f26ac0d1a80 2024-09-21T03:26:28.912 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.910+0000 7f26b3c5c640 1 -- 172.21.15.105:0/4275986980 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f26ac1633c0 con 0x7f26ac0d1a80 2024-09-21T03:26:28.912 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.910+0000 7f26a27fc640 1 -- 172.21.15.105:0/4275986980 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) ==== 94+0+3923 (secure 0 0 0) 0x7f269c087a10 con 0x7f26ac0d1a80 2024-09-21T03:26:28.913 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:26:28.913 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":78,"btime":"2024-09-21T03:26:22:684085+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6233,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/2073653576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2073653576},{"type":"v1","addr":"172.21.15.162:6837","nonce":2073653576}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":70},{"gid":6850,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2714893724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2714893724},{"type":"v1","addr":"172.21.15.162:6836","nonce":2714893724}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":70},{"gid":7590,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/2972986125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2972986125},{"type":"v1","addr":"172.21.15.105:6834","nonce":2972986125}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":70},{"gid":7938,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1572139316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":1572139316},{"type":"v1","addr":"172.21.15.105:6835","nonce":1572139316}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[]} 2024-09-21T03:26:28.913 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 78 2024-09-21T03:26:28.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.913+0000 7f26b3c5c640 1 -- 172.21.15.105:0/4275986980 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2690078bc0 msgr2=0x7f269007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:28.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.913+0000 7f26b3c5c640 1 --2- 172.21.15.105:0/4275986980 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2690078bc0 0x7f269007b0d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f26a8007fd0 tx=0x7f26a8009040 comp rx=0 tx=0).stop 2024-09-21T03:26:28.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.913+0000 7f26b3c5c640 1 -- 172.21.15.105:0/4275986980 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26ac0d1a80 msgr2=0x7f26ac1f90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:28.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.913+0000 7f26b3c5c640 1 --2- 172.21.15.105:0/4275986980 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26ac0d1a80 0x7f26ac1f90f0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f269c000c00 tx=0x7f269c0035f0 comp rx=0 tx=0).stop 2024-09-21T03:26:28.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.913+0000 7f26b3c5c640 1 -- 172.21.15.105:0/4275986980 shutdown_connections 2024-09-21T03:26:28.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.913+0000 7f26b3c5c640 1 --2- 172.21.15.105:0/4275986980 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2690078bc0 0x7f269007b0d0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:28.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.913+0000 7f26b3c5c640 1 --2- 172.21.15.105:0/4275986980 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f26ac0d2ed0 0x7f26ac1f9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:28.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.913+0000 7f26b3c5c640 1 --2- 172.21.15.105:0/4275986980 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26ac0d1a80 0x7f26ac1f90f0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:28.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.913+0000 7f26b3c5c640 1 --2- 172.21.15.105:0/4275986980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26ac0cf5d0 0x7f26ac14e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:28.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.913+0000 7f26b3c5c640 1 -- 172.21.15.105:0/4275986980 >> 172.21.15.105:0/4275986980 conn(0x7f26ac08bfc0 msgr2=0x7f26ac06eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:28.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.913+0000 7f26b3c5c640 1 -- 172.21.15.105:0/4275986980 shutdown_connections 2024-09-21T03:26:28.916 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:28.913+0000 7f26b3c5c640 1 -- 172.21.15.105:0/4275986980 wait complete. 2024-09-21T03:26:28.926 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T03:26:28.926 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-21T03:26:28.926 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T03:26:28.926 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:26:28.926 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T03:26:28.926 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T03:26:28.927 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T03:26:28.927 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:26:28.927 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T03:26:28.927 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T03:26:28.927 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T03:26:28.927 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:26:28.927 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T03:26:28.927 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T03:26:28.927 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T03:26:28.928 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:26:28.936 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T03:26:28.937 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T03:26:28.938 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T03:26:28.939 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T03:26:28.939 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T03:26:28.940 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T03:26:28.940 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T03:26:28.940 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T03:26:28.980 INFO:tasks.ceph.mds.c:Started 2024-09-21T03:26:28.981 DEBUG:teuthology.parallel:result is None 2024-09-21T03:26:28.981 INFO:tasks.ceph.mds.a:Started 2024-09-21T03:26:28.982 DEBUG:teuthology.parallel:result is None 2024-09-21T03:26:28.983 INFO:tasks.ceph.mds.d:Started 2024-09-21T03:26:28.983 DEBUG:teuthology.parallel:result is None 2024-09-21T03:26:28.984 INFO:tasks.ceph.mds.b:Started 2024-09-21T03:26:28.984 DEBUG:teuthology.parallel:result is None 2024-09-21T03:26:28.984 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T03:26:29.075 INFO:tasks.ceph.mds.a.smithi105.stdout:starting mds.a at 2024-09-21T03:26:29.079 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-09-21T03:26:29.080 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-09-21T03:26:29.081 INFO:tasks.ceph.mds.c.smithi105.stdout:starting mds.c at 2024-09-21T03:26:29.117 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.115+0000 7fad1d32b640 1 -- 172.21.15.105:0/1313866857 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad180d2ed0 msgr2=0x7fad180d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:29.117 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.115+0000 7fad1d32b640 1 --2- 172.21.15.105:0/1313866857 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad180d2ed0 0x7fad180d1a80 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7fad080098e0 tx=0x7fad0802a5d0 comp rx=0 tx=0).stop 2024-09-21T03:26:29.118 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.116+0000 7fad1d32b640 1 -- 172.21.15.105:0/1313866857 shutdown_connections 2024-09-21T03:26:29.118 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.116+0000 7fad1d32b640 1 --2- 172.21.15.105:0/1313866857 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad180b9b70 0x7fad180cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:29.118 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.116+0000 7fad1d32b640 1 --2- 172.21.15.105:0/1313866857 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad180d2ed0 0x7fad180d1a80 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:29.118 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.116+0000 7fad1d32b640 1 -- 172.21.15.105:0/1313866857 >> 172.21.15.105:0/1313866857 conn(0x7fad1808bfc0 msgr2=0x7fad1809d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:29.118 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.116+0000 7fad1d32b640 1 -- 172.21.15.105:0/1313866857 shutdown_connections 2024-09-21T03:26:29.118 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.116+0000 7fad1d32b640 1 -- 172.21.15.105:0/1313866857 wait complete. 2024-09-21T03:26:29.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.117+0000 7fad1d32b640 1 Processor -- start 2024-09-21T03:26:29.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.117+0000 7fad1d32b640 1 -- start start 2024-09-21T03:26:29.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.119+0000 7fad1d32b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad180b9b70 0x7fad180c95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:29.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.119+0000 7fad1d32b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad180cf5d0 0x7fad180b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:29.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.119+0000 7fad1d32b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad180d2ed0 0x7fad180b8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:29.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.119+0000 7fad1d32b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fad180d4940 con 0x7fad180cf5d0 2024-09-21T03:26:29.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.119+0000 7fad1d32b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fad180cfde0 con 0x7fad180d2ed0 2024-09-21T03:26:29.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.119+0000 7fad1d32b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fad180d4ac0 con 0x7fad180b9b70 2024-09-21T03:26:29.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.119+0000 7fad167fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad180cf5d0 0x7fad180b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:29.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.119+0000 7fad167fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad180cf5d0 0x7fad180b8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:39916/0 (socket says 172.21.15.105:39916) 2024-09-21T03:26:29.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.119+0000 7fad167fc640 1 -- 172.21.15.105:0/534309890 learned_addr learned my addr 172.21.15.105:0/534309890 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:29.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.119+0000 7fad16ffd640 1 --2- 172.21.15.105:0/534309890 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad180b9b70 0x7fad180c95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:29.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.119+0000 7fad177fe640 1 --2- 172.21.15.105:0/534309890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad180d2ed0 0x7fad180b8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:29.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.119+0000 7fad167fc640 1 -- 172.21.15.105:0/534309890 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad180b9b70 msgr2=0x7fad180c95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:29.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.119+0000 7fad167fc640 1 --2- 172.21.15.105:0/534309890 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad180b9b70 0x7fad180c95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:29.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.119+0000 7fad167fc640 1 -- 172.21.15.105:0/534309890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad180d2ed0 msgr2=0x7fad180b8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:29.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.119+0000 7fad167fc640 1 --2- 172.21.15.105:0/534309890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad180d2ed0 0x7fad180b8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:29.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.119+0000 7fad167fc640 1 -- 172.21.15.105:0/534309890 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad181f9c90 con 0x7fad180cf5d0 2024-09-21T03:26:29.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.119+0000 7fad167fc640 1 --2- 172.21.15.105:0/534309890 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad180cf5d0 0x7fad180b8a90 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fad0c00d720 tx=0x7fad0c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:29.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.119+0000 7facff7fe640 1 -- 172.21.15.105:0/534309890 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0c009c30 con 0x7fad180cf5d0 2024-09-21T03:26:29.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.120+0000 7facff7fe640 1 -- 172.21.15.105:0/534309890 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad0c00de30 con 0x7fad180cf5d0 2024-09-21T03:26:29.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.120+0000 7fad1d32b640 1 -- 172.21.15.105:0/534309890 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad180c9b10 con 0x7fad180cf5d0 2024-09-21T03:26:29.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.120+0000 7facff7fe640 1 -- 172.21.15.105:0/534309890 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0c004290 con 0x7fad180cf5d0 2024-09-21T03:26:29.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.120+0000 7fad1d32b640 1 -- 172.21.15.105:0/534309890 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad180cb7d0 con 0x7fad180cf5d0 2024-09-21T03:26:29.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.120+0000 7fad1d32b640 1 -- 172.21.15.105:0/534309890 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad180d5050 con 0x7fad180cf5d0 2024-09-21T03:26:29.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.121+0000 7facff7fe640 1 -- 172.21.15.105:0/534309890 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fad0c0035f0 con 0x7fad180cf5d0 2024-09-21T03:26:29.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.122+0000 7facff7fe640 1 --2- 172.21.15.105:0/534309890 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fad04078b90 0x7fad0407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:29.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.122+0000 7facff7fe640 1 -- 172.21.15.105:0/534309890 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 4943+0+0 (secure 0 0 0) 0x7fad0c09ab50 con 0x7fad180cf5d0 2024-09-21T03:26:29.127 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.122+0000 7fad16ffd640 1 --2- 172.21.15.105:0/534309890 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fad04078b90 0x7fad0407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:29.127 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.122+0000 7fad16ffd640 1 --2- 172.21.15.105:0/534309890 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fad04078b90 0x7fad0407b0a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fad08034000 tx=0x7fad08004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:29.128 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.126+0000 7facff7fe640 1 -- 172.21.15.105:0/534309890 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fad0c017020 con 0x7fad180cf5d0 2024-09-21T03:26:29.317 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.316+0000 7fad1d32b640 1 -- 172.21.15.105:0/534309890 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fad180b4020 con 0x7fad180cf5d0 2024-09-21T03:26:29.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.731+0000 7facff7fe640 1 -- 172.21.15.105:0/534309890 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v123) ==== 97+0+0 (secure 0 0 0) 0x7fad0c062cd0 con 0x7fad180cf5d0 2024-09-21T03:26:29.733 INFO:teuthology.orchestra.run.smithi105.stderr: removed all blocklist entries 2024-09-21T03:26:29.735 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.733+0000 7fad1d32b640 1 -- 172.21.15.105:0/534309890 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fad04078b90 msgr2=0x7fad0407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:29.735 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.733+0000 7fad1d32b640 1 --2- 172.21.15.105:0/534309890 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fad04078b90 0x7fad0407b0a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fad08034000 tx=0x7fad08004730 comp rx=0 tx=0).stop 2024-09-21T03:26:29.735 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.733+0000 7fad1d32b640 1 -- 172.21.15.105:0/534309890 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad180cf5d0 msgr2=0x7fad180b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:29.735 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.733+0000 7fad1d32b640 1 --2- 172.21.15.105:0/534309890 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad180cf5d0 0x7fad180b8a90 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fad0c00d720 tx=0x7fad0c00dbe0 comp rx=0 tx=0).stop 2024-09-21T03:26:29.735 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.733+0000 7fad1d32b640 1 -- 172.21.15.105:0/534309890 shutdown_connections 2024-09-21T03:26:29.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.733+0000 7fad1d32b640 1 --2- 172.21.15.105:0/534309890 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fad04078b90 0x7fad0407b0a0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:29.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.733+0000 7fad1d32b640 1 --2- 172.21.15.105:0/534309890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad180d2ed0 0x7fad180b8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:29.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.733+0000 7fad1d32b640 1 --2- 172.21.15.105:0/534309890 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad180cf5d0 0x7fad180b8a90 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:29.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.733+0000 7fad1d32b640 1 --2- 172.21.15.105:0/534309890 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad180b9b70 0x7fad180c95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:29.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.733+0000 7fad1d32b640 1 -- 172.21.15.105:0/534309890 >> 172.21.15.105:0/534309890 conn(0x7fad1808bfc0 msgr2=0x7fad1806dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:29.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.733+0000 7fad1d32b640 1 -- 172.21.15.105:0/534309890 shutdown_connections 2024-09-21T03:26:29.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.733+0000 7fad1d32b640 1 -- 172.21.15.105:0/534309890 wait complete. 2024-09-21T03:26:29.747 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T03:26:29.862 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.860+0000 7fe37ef32640 1 -- 172.21.15.105:0/3371060776 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3780cf440 msgr2=0x7fe37815c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:29.862 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.860+0000 7fe37ef32640 1 --2- 172.21.15.105:0/3371060776 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3780cf440 0x7fe37815c6a0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fe3780cc8f0 tx=0x7fe36c02a560 comp rx=0 tx=0).stop 2024-09-21T03:26:29.862 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.860+0000 7fe37ef32640 1 -- 172.21.15.105:0/3371060776 shutdown_connections 2024-09-21T03:26:29.862 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.860+0000 7fe37ef32640 1 --2- 172.21.15.105:0/3371060776 >> v2:172.21.15.162:3300/0 conn(0x7fe3780b7fe0 0x7fe3780d0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:29.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.860+0000 7fe37ef32640 1 --2- 172.21.15.105:0/3371060776 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3780cf440 0x7fe37815c6a0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:29.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.860+0000 7fe37ef32640 1 -- 172.21.15.105:0/3371060776 >> 172.21.15.105:0/3371060776 conn(0x7fe3780710b0 msgr2=0x7fe3780714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:29.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.860+0000 7fe37ef32640 1 -- 172.21.15.105:0/3371060776 shutdown_connections 2024-09-21T03:26:29.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.860+0000 7fe37ef32640 1 -- 172.21.15.105:0/3371060776 wait complete. 2024-09-21T03:26:29.864 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.862+0000 7fe37ef32640 1 Processor -- start 2024-09-21T03:26:29.864 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.862+0000 7fe37ef32640 1 -- start start 2024-09-21T03:26:29.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.863+0000 7fe37ef32640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3780b7fe0 0x7fe3780c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:29.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.863+0000 7fe37ef32640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3780cd360 0x7fe3781476f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:29.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.863+0000 7fe37ef32640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe378157530 0x7fe378157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:29.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.863+0000 7fe37ef32640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe3780d0b40 con 0x7fe378157530 2024-09-21T03:26:29.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.863+0000 7fe37ef32640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe3780d09c0 con 0x7fe3780cd360 2024-09-21T03:26:29.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.863+0000 7fe37ef32640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe3780d0cc0 con 0x7fe3780b7fe0 2024-09-21T03:26:29.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.864+0000 7fe37d4cf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe378157530 0x7fe378157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:29.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.864+0000 7fe37d4cf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe378157530 0x7fe378157940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:39924/0 (socket says 172.21.15.105:39924) 2024-09-21T03:26:29.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.864+0000 7fe37d4cf640 1 -- 172.21.15.105:0/3536850721 learned_addr learned my addr 172.21.15.105:0/3536850721 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:29.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.864+0000 7fe377fff640 1 --2- 172.21.15.105:0/3536850721 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3780cd360 0x7fe3781476f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:29.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.864+0000 7fe37ccce640 1 --2- 172.21.15.105:0/3536850721 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3780b7fe0 0x7fe3780c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:29.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.864+0000 7fe37d4cf640 1 -- 172.21.15.105:0/3536850721 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3780b7fe0 msgr2=0x7fe3780c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:29.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.864+0000 7fe37d4cf640 1 --2- 172.21.15.105:0/3536850721 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3780b7fe0 0x7fe3780c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:29.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.864+0000 7fe37d4cf640 1 -- 172.21.15.105:0/3536850721 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3780cd360 msgr2=0x7fe3781476f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:29.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.864+0000 7fe37d4cf640 1 --2- 172.21.15.105:0/3536850721 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3780cd360 0x7fe3781476f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:29.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.864+0000 7fe37d4cf640 1 -- 172.21.15.105:0/3536850721 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe378147c30 con 0x7fe378157530 2024-09-21T03:26:29.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.864+0000 7fe37d4cf640 1 --2- 172.21.15.105:0/3536850721 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe378157530 0x7fe378157940 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fe37000e960 tx=0x7fe37000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:29.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.864+0000 7fe3757fa640 1 -- 172.21.15.105:0/3536850721 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe370004d20 con 0x7fe378157530 2024-09-21T03:26:29.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.864+0000 7fe3757fa640 1 -- 172.21.15.105:0/3536850721 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe37000cb20 con 0x7fe378157530 2024-09-21T03:26:29.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.864+0000 7fe37ef32640 1 -- 172.21.15.105:0/3536850721 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3780c91e0 con 0x7fe378157530 2024-09-21T03:26:29.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.864+0000 7fe3757fa640 1 -- 172.21.15.105:0/3536850721 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe370005020 con 0x7fe378157530 2024-09-21T03:26:29.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.864+0000 7fe37ef32640 1 -- 172.21.15.105:0/3536850721 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3780c97a0 con 0x7fe378157530 2024-09-21T03:26:29.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.865+0000 7fe37ef32640 1 -- 172.21.15.105:0/3536850721 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe378158010 con 0x7fe378157530 2024-09-21T03:26:29.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.866+0000 7fe3757fa640 1 -- 172.21.15.105:0/3536850721 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe3700051c0 con 0x7fe378157530 2024-09-21T03:26:29.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.867+0000 7fe3757fa640 1 --2- 172.21.15.105:0/3536850721 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe364078b90 0x7fe36407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:29.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.867+0000 7fe3757fa640 1 -- 172.21.15.105:0/3536850721 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 4857+0+0 (secure 0 0 0) 0x7fe37009b160 con 0x7fe378157530 2024-09-21T03:26:29.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.867+0000 7fe37ccce640 1 --2- 172.21.15.105:0/3536850721 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe364078b90 0x7fe36407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:29.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.867+0000 7fe37ccce640 1 --2- 172.21.15.105:0/3536850721 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe364078b90 0x7fe36407b0a0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fe368001720 tx=0x7fe368009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:29.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:29.871+0000 7fe3757fa640 1 -- 172.21.15.105:0/3536850721 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe370016030 con 0x7fe378157530 2024-09-21T03:26:30.116 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.114+0000 7fe37ef32640 1 -- 172.21.15.105:0/3536850721 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fe37806a5e0 con 0x7fe378157530 2024-09-21T03:26:30.116 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.115+0000 7fe3757fa640 1 -- 172.21.15.105:0/3536850721 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) ==== 80+0+5304 (secure 0 0 0) 0x7fe37806a5e0 con 0x7fe378157530 2024-09-21T03:26:30.117 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:26:30.117 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-21T03:26:30.117 INFO:teuthology.orchestra.run.smithi105.stdout: "auth_dump": [ 2024-09-21T03:26:30.117 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:26:30.117 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mds.a", 2024-09-21T03:26:30.117 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mtIIZDhAAJIXLpzTFBOFhnOwLzsdL6w==", 2024-09-21T03:26:30.117 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:26:30.117 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:26:30.117 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:26:30.117 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:26:30.117 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:26:30.117 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:26:30.118 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:26:30.118 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:26:30.118 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mds.b", 2024-09-21T03:26:30.118 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mGKANGxAAeAuUYMtLP7GXKfIELR7qMA==", 2024-09-21T03:26:30.118 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:26:30.118 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:26:30.118 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:26:30.118 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:26:30.118 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:26:30.118 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:26:30.118 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:26:30.118 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:26:30.118 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mds.c", 2024-09-21T03:26:30.118 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mwQzQFRAAElYtgnIdYzzkeg8AtiU+kA==", 2024-09-21T03:26:30.119 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:26:30.119 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:26:30.119 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:26:30.119 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:26:30.119 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:26:30.119 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:26:30.119 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:26:30.119 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:26:30.119 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mds.d", 2024-09-21T03:26:30.119 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mZkWyIhAAu4XWptFcbDrYjozzrgMcGQ==", 2024-09-21T03:26:30.119 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:26:30.119 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:26:30.119 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:26:30.119 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:26:30.120 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:26:30.120 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:26:30.120 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:26:30.120 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:26:30.120 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.0", 2024-09-21T03:26:30.120 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDMOu5mrSk2BRAAuEPjuEeUJEI3Sa2fiLaJyw==", 2024-09-21T03:26:30.120 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:26:30.120 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:26:30.120 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:26:30.120 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:26:30.120 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:26:30.120 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:26:30.120 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:26:30.120 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.1", 2024-09-21T03:26:30.121 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDPOu5mAT4UCBAAase7NV3ARBSu4QloaQdlzA==", 2024-09-21T03:26:30.121 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:26:30.121 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:26:30.121 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:26:30.121 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:26:30.121 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:26:30.121 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:26:30.121 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:26:30.121 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.2", 2024-09-21T03:26:30.121 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDSOu5ma4LRChAASottrmolMcagbspeyGVzBQ==", 2024-09-21T03:26:30.121 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:26:30.121 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:26:30.121 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:26:30.121 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:26:30.121 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:26:30.122 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:26:30.122 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:26:30.122 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.3", 2024-09-21T03:26:30.122 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDVOu5mD5RWHBAAKuNr4F3GA0EP566aQ07ZVw==", 2024-09-21T03:26:30.122 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:26:30.122 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:26:30.122 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:26:30.122 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:26:30.122 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:26:30.122 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:26:30.122 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:26:30.122 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.4", 2024-09-21T03:26:30.122 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDcOu5m++UBChAAqmgoPBQ/as4tc+UQPwaflg==", 2024-09-21T03:26:30.123 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:26:30.123 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:26:30.123 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:26:30.123 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:26:30.123 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:26:30.123 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:26:30.123 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:26:30.123 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.5", 2024-09-21T03:26:30.123 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDfOu5maYYZKRAA1ungglTU3TW1B/XNRjBuZQ==", 2024-09-21T03:26:30.123 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:26:30.123 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:26:30.123 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:26:30.123 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:26:30.123 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:26:30.124 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:26:30.124 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:26:30.124 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.6", 2024-09-21T03:26:30.124 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDjOu5mmwIqHBAAf6oNdLNkmM9yufP8XA2+og==", 2024-09-21T03:26:30.124 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:26:30.124 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:26:30.124 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:26:30.124 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:26:30.124 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:26:30.124 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:26:30.124 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:26:30.124 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.7", 2024-09-21T03:26:30.124 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDmOu5mtCciHhAAPTnZubJ+7mGXcXZykCWxHg==", 2024-09-21T03:26:30.124 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:26:30.124 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:26:30.125 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:26:30.125 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:26:30.125 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:26:30.125 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:26:30.125 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:26:30.125 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.0", 2024-09-21T03:26:30.125 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mughoJxAAhY0bzJmq+oNyzCdtafkC9w==", 2024-09-21T03:26:30.125 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:26:30.125 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:26:30.125 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow r", 2024-09-21T03:26:30.125 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-21T03:26:30.125 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:26:30.125 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:26:30.125 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:26:30.126 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.1", 2024-09-21T03:26:30.126 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5m4Vn2LhAAnEa/01ql5quuRCVHOVwB7w==", 2024-09-21T03:26:30.126 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:26:30.126 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:26:30.126 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow r", 2024-09-21T03:26:30.126 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow rw", 2024-09-21T03:26:30.126 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow rwx" 2024-09-21T03:26:30.126 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:26:30.126 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:26:30.126 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:26:30.126 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.2", 2024-09-21T03:26:30.126 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mKi0mKxAAoetnL61ujgtg2cvscdjCLQ==", 2024-09-21T03:26:30.126 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:26:30.126 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:26:30.126 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow r", 2024-09-21T03:26:30.127 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow rw", 2024-09-21T03:26:30.127 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow rwx" 2024-09-21T03:26:30.127 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:26:30.127 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:26:30.127 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:26:30.127 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.3", 2024-09-21T03:26:30.127 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mWZDAMhAAs4BuFHMSkJa6+piN/FeeXQ==", 2024-09-21T03:26:30.127 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:26:30.127 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:26:30.127 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow r", 2024-09-21T03:26:30.127 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow rw", 2024-09-21T03:26:30.127 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow rwx" 2024-09-21T03:26:30.127 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:26:30.127 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:26:30.127 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:26:30.128 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.admin", 2024-09-21T03:26:30.128 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDHOu5m4JRYLBAAgZ8nh5VIiWhuZ4+vrnmngw==", 2024-09-21T03:26:30.128 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:26:30.128 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow *", 2024-09-21T03:26:30.128 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:26:30.128 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:26:30.128 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:26:30.128 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:26:30.128 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:26:30.128 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:26:30.128 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mgr.x", 2024-09-21T03:26:30.128 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5m92lTChAAQ61muQmc6uBs7b5mq3Zt8g==", 2024-09-21T03:26:30.128 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:26:30.129 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow *", 2024-09-21T03:26:30.129 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile mgr", 2024-09-21T03:26:30.129 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:26:30.129 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:26:30.129 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:26:30.129 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:26:30.129 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mgr.y", 2024-09-21T03:26:30.129 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mh07bBRAAflFF00xr1ew4zttUi5TGng==", 2024-09-21T03:26:30.129 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:26:30.129 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow *", 2024-09-21T03:26:30.129 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile mgr", 2024-09-21T03:26:30.129 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:26:30.129 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:26:30.129 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:26:30.129 INFO:teuthology.orchestra.run.smithi105.stdout: ] 2024-09-21T03:26:30.130 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-21T03:26:30.131 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.117+0000 7fe37ef32640 1 -- 172.21.15.105:0/3536850721 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe364078b90 msgr2=0x7fe36407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:30.131 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.117+0000 7fe37ef32640 1 --2- 172.21.15.105:0/3536850721 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe364078b90 0x7fe36407b0a0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fe368001720 tx=0x7fe368009040 comp rx=0 tx=0).stop 2024-09-21T03:26:30.131 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.117+0000 7fe37ef32640 1 -- 172.21.15.105:0/3536850721 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe378157530 msgr2=0x7fe378157940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:30.131 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.117+0000 7fe37ef32640 1 --2- 172.21.15.105:0/3536850721 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe378157530 0x7fe378157940 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fe37000e960 tx=0x7fe37000ee20 comp rx=0 tx=0).stop 2024-09-21T03:26:30.131 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.117+0000 7fe37ef32640 1 -- 172.21.15.105:0/3536850721 shutdown_connections 2024-09-21T03:26:30.131 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.117+0000 7fe37ef32640 1 --2- 172.21.15.105:0/3536850721 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe364078b90 0x7fe36407b0a0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:30.131 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.117+0000 7fe37ef32640 1 --2- 172.21.15.105:0/3536850721 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe378157530 0x7fe378157940 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:30.131 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.117+0000 7fe37ef32640 1 --2- 172.21.15.105:0/3536850721 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3780cd360 0x7fe3781476f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:30.131 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.117+0000 7fe37ef32640 1 --2- 172.21.15.105:0/3536850721 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3780b7fe0 0x7fe3780c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:30.132 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.117+0000 7fe37ef32640 1 -- 172.21.15.105:0/3536850721 >> 172.21.15.105:0/3536850721 conn(0x7fe3780710b0 msgr2=0x7fe3780b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:30.132 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.117+0000 7fe37ef32640 1 -- 172.21.15.105:0/3536850721 shutdown_connections 2024-09-21T03:26:30.132 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.117+0000 7fe37ef32640 1 -- 172.21.15.105:0/3536850721 wait complete. 2024-09-21T03:26:30.132 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T03:26:30.245 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.243+0000 7fc64d9a1640 1 -- 172.21.15.105:0/4032619024 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc6480ceb40 msgr2=0x7fc6480cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:30.245 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.243+0000 7fc64d9a1640 1 --2- 172.21.15.105:0/4032619024 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc6480ceb40 0x7fc6480cef50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc640005fd0 tx=0x7fc64002a820 comp rx=0 tx=0).stop 2024-09-21T03:26:30.245 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.243+0000 7fc64d9a1640 1 -- 172.21.15.105:0/4032619024 shutdown_connections 2024-09-21T03:26:30.245 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.243+0000 7fc64d9a1640 1 --2- 172.21.15.105:0/4032619024 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc6480ceb40 0x7fc6480cef50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:30.245 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.243+0000 7fc64d9a1640 1 --2- 172.21.15.105:0/4032619024 >> v2:172.21.15.162:3300/0 conn(0x7fc64806e170 0x7fc6480b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:30.245 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.243+0000 7fc64d9a1640 1 -- 172.21.15.105:0/4032619024 >> 172.21.15.105:0/4032619024 conn(0x7fc64808bfc0 msgr2=0x7fc64809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:30.245 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.243+0000 7fc64d9a1640 1 -- 172.21.15.105:0/4032619024 shutdown_connections 2024-09-21T03:26:30.245 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.243+0000 7fc64d9a1640 1 -- 172.21.15.105:0/4032619024 wait complete. 2024-09-21T03:26:30.246 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.245+0000 7fc64d9a1640 1 Processor -- start 2024-09-21T03:26:30.246 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.245+0000 7fc64d9a1640 1 -- start start 2024-09-21T03:26:30.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.246+0000 7fc64d9a1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc64806f4b0 0x7fc6481f5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:30.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.246+0000 7fc64d9a1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6480ceb40 0x7fc64815c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:30.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.246+0000 7fc64d9a1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6480cddd0 0x7fc6480ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:30.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.246+0000 7fc64d9a1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc6480d0e60 con 0x7fc6480cddd0 2024-09-21T03:26:30.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.246+0000 7fc64d9a1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc6480d0ce0 con 0x7fc6480ceb40 2024-09-21T03:26:30.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.246+0000 7fc64d9a1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc6480d0fe0 con 0x7fc64806f4b0 2024-09-21T03:26:30.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.246+0000 7fc6477fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6480cddd0 0x7fc6480ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:30.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.246+0000 7fc6477fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6480cddd0 0x7fc6480ce1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:39940/0 (socket says 172.21.15.105:39940) 2024-09-21T03:26:30.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.246+0000 7fc6477fe640 1 -- 172.21.15.105:0/1304986918 learned_addr learned my addr 172.21.15.105:0/1304986918 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:30.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.246+0000 7fc646ffd640 1 --2- 172.21.15.105:0/1304986918 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc64806f4b0 0x7fc6481f5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:30.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.246+0000 7fc63e7fc640 1 --2- 172.21.15.105:0/1304986918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6480ceb40 0x7fc64815c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:30.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.247+0000 7fc6477fe640 1 -- 172.21.15.105:0/1304986918 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc64806f4b0 msgr2=0x7fc6481f5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:30.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.247+0000 7fc6477fe640 1 --2- 172.21.15.105:0/1304986918 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc64806f4b0 0x7fc6481f5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:30.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.247+0000 7fc6477fe640 1 -- 172.21.15.105:0/1304986918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6480ceb40 msgr2=0x7fc64815c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:30.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.247+0000 7fc6477fe640 1 --2- 172.21.15.105:0/1304986918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6480ceb40 0x7fc64815c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:30.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.247+0000 7fc6477fe640 1 -- 172.21.15.105:0/1304986918 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6481f6430 con 0x7fc6480cddd0 2024-09-21T03:26:30.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.247+0000 7fc6477fe640 1 --2- 172.21.15.105:0/1304986918 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6480cddd0 0x7fc6480ce1e0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fc640009b30 tx=0x7fc640032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:30.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.247+0000 7fc644ff9640 1 -- 172.21.15.105:0/1304986918 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc640037040 con 0x7fc6480cddd0 2024-09-21T03:26:30.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.247+0000 7fc644ff9640 1 -- 172.21.15.105:0/1304986918 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc640042070 con 0x7fc6480cddd0 2024-09-21T03:26:30.251 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.247+0000 7fc64d9a1640 1 -- 172.21.15.105:0/1304986918 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6480ce720 con 0x7fc6480cddd0 2024-09-21T03:26:30.251 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.247+0000 7fc644ff9640 1 -- 172.21.15.105:0/1304986918 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc640003e60 con 0x7fc6480cddd0 2024-09-21T03:26:30.251 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.247+0000 7fc64d9a1640 1 -- 172.21.15.105:0/1304986918 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6480cb9d0 con 0x7fc6480cddd0 2024-09-21T03:26:30.251 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.248+0000 7fc64d9a1640 1 -- 172.21.15.105:0/1304986918 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6480d1510 con 0x7fc6480cddd0 2024-09-21T03:26:30.251 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.249+0000 7fc644ff9640 1 -- 172.21.15.105:0/1304986918 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc640004280 con 0x7fc6480cddd0 2024-09-21T03:26:30.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.250+0000 7fc644ff9640 1 --2- 172.21.15.105:0/1304986918 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc628078b90 0x7fc62807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:30.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.250+0000 7fc644ff9640 1 -- 172.21.15.105:0/1304986918 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 4857+0+0 (secure 0 0 0) 0x7fc6400bb660 con 0x7fc6480cddd0 2024-09-21T03:26:30.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.250+0000 7fc646ffd640 1 --2- 172.21.15.105:0/1304986918 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc628078b90 0x7fc62807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:30.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.250+0000 7fc646ffd640 1 --2- 172.21.15.105:0/1304986918 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc628078b90 0x7fc62807b0a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc6380095f0 tx=0x7fc638005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:30.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.254+0000 7fc644ff9640 1 -- 172.21.15.105:0/1304986918 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc6480ce720 con 0x7fc6480cddd0 2024-09-21T03:26:30.434 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.432+0000 7fc64d9a1640 1 -- 172.21.15.105:0/1304986918 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fc6480b8af0 con 0x7fc6480cddd0 2024-09-21T03:26:30.434 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.433+0000 7fc644ff9640 1 -- 172.21.15.105:0/1304986918 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v125) ==== 84+0+65 (secure 0 0 0) 0x7fc6481f6430 con 0x7fc6480cddd0 2024-09-21T03:26:30.435 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:26:30.435 INFO:teuthology.orchestra.run.smithi105.stdout:[ 2024-09-21T03:26:30.435 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:26:30.435 INFO:teuthology.orchestra.run.smithi105.stdout: "poolnum": 1, 2024-09-21T03:26:30.435 INFO:teuthology.orchestra.run.smithi105.stdout: "poolname": ".mgr" 2024-09-21T03:26:30.435 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:26:30.435 INFO:teuthology.orchestra.run.smithi105.stdout:] 2024-09-21T03:26:30.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.435+0000 7fc64d9a1640 1 -- 172.21.15.105:0/1304986918 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc628078b90 msgr2=0x7fc62807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:30.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.435+0000 7fc64d9a1640 1 --2- 172.21.15.105:0/1304986918 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc628078b90 0x7fc62807b0a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc6380095f0 tx=0x7fc638005f90 comp rx=0 tx=0).stop 2024-09-21T03:26:30.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.435+0000 7fc64d9a1640 1 -- 172.21.15.105:0/1304986918 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6480cddd0 msgr2=0x7fc6480ce1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:30.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.435+0000 7fc64d9a1640 1 --2- 172.21.15.105:0/1304986918 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6480cddd0 0x7fc6480ce1e0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fc640009b30 tx=0x7fc640032d10 comp rx=0 tx=0).stop 2024-09-21T03:26:30.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.435+0000 7fc64d9a1640 1 -- 172.21.15.105:0/1304986918 shutdown_connections 2024-09-21T03:26:30.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.435+0000 7fc64d9a1640 1 --2- 172.21.15.105:0/1304986918 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc628078b90 0x7fc62807b0a0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:30.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.435+0000 7fc64d9a1640 1 --2- 172.21.15.105:0/1304986918 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6480cddd0 0x7fc6480ce1e0 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:30.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.435+0000 7fc64d9a1640 1 --2- 172.21.15.105:0/1304986918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6480ceb40 0x7fc64815c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:30.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.435+0000 7fc64d9a1640 1 --2- 172.21.15.105:0/1304986918 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc64806f4b0 0x7fc6481f5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:30.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.435+0000 7fc64d9a1640 1 -- 172.21.15.105:0/1304986918 >> 172.21.15.105:0/1304986918 conn(0x7fc64808bfc0 msgr2=0x7fc6480b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:30.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.435+0000 7fc64d9a1640 1 -- 172.21.15.105:0/1304986918 shutdown_connections 2024-09-21T03:26:30.438 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.435+0000 7fc64d9a1640 1 -- 172.21.15.105:0/1304986918 wait complete. 2024-09-21T03:26:30.448 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T03:26:30.448 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T03:26:30.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.562+0000 7f2029f5f640 1 -- 172.21.15.105:0/3765120668 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f200c003a50 msgr2=0x7f200c003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:30.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.562+0000 7f2029f5f640 1 --2- 172.21.15.105:0/3765120668 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f200c003a50 0x7f200c003ec0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f201400c610 tx=0x7f200c005830 comp rx=0 tx=0).stop 2024-09-21T03:26:30.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.562+0000 7f2023fff640 1 -- 172.21.15.105:0/3765120668 reap_dead start 2024-09-21T03:26:30.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.562+0000 7f2029f5f640 1 -- 172.21.15.105:0/3765120668 shutdown_connections 2024-09-21T03:26:30.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.562+0000 7f2029f5f640 1 -- 172.21.15.105:0/3765120668 >> 172.21.15.105:0/3765120668 conn(0x7f202409aa30 msgr2=0x7f20240b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:30.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.562+0000 7f2029f5f640 1 -- 172.21.15.105:0/3765120668 shutdown_connections 2024-09-21T03:26:30.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.562+0000 7f2029f5f640 1 -- 172.21.15.105:0/3765120668 wait complete. 2024-09-21T03:26:30.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.564+0000 7f2029f5f640 1 Processor -- start 2024-09-21T03:26:30.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.564+0000 7f2029f5f640 1 -- start start 2024-09-21T03:26:30.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.566+0000 7f2029f5f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f200c003a50 0x7f202415c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:30.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.566+0000 7f2029f5f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20241f6570 0x7f20241f3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:30.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.566+0000 7f2029f5f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20240ca350 0x7f20240c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:30.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.566+0000 7f2029f5f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f20240b46e0 con 0x7f20240ca350 2024-09-21T03:26:30.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.566+0000 7f2029f5f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f20240b4560 con 0x7f20241f6570 2024-09-21T03:26:30.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.566+0000 7f2029f5f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f20240b4860 con 0x7f200c003a50 2024-09-21T03:26:30.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.566+0000 7f2023fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20240ca350 0x7f20240c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:30.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.566+0000 7f2023fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20240ca350 0x7f20240c82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:39950/0 (socket says 172.21.15.105:39950) 2024-09-21T03:26:30.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.566+0000 7f2023fff640 1 -- 172.21.15.105:0/2915495913 learned_addr learned my addr 172.21.15.105:0/2915495913 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:30.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.566+0000 7f2022ffd640 1 --2- 172.21.15.105:0/2915495913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20241f6570 0x7f20241f3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:30.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.566+0000 7f20237fe640 1 --2- 172.21.15.105:0/2915495913 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f200c003a50 0x7f202415c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:30.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.566+0000 7f2023fff640 1 -- 172.21.15.105:0/2915495913 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f200c003a50 msgr2=0x7f202415c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:30.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.566+0000 7f2023fff640 1 --2- 172.21.15.105:0/2915495913 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f200c003a50 0x7f202415c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:30.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.566+0000 7f2023fff640 1 -- 172.21.15.105:0/2915495913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20241f6570 msgr2=0x7f20241f3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:30.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.566+0000 7f2023fff640 1 --2- 172.21.15.105:0/2915495913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20241f6570 0x7f20241f3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:30.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.566+0000 7f2023fff640 1 -- 172.21.15.105:0/2915495913 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20241f6d80 con 0x7f20240ca350 2024-09-21T03:26:30.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.566+0000 7f20237fe640 1 --2- 172.21.15.105:0/2915495913 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f200c003a50 0x7f202415c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:26:30.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.566+0000 7f2023fff640 1 --2- 172.21.15.105:0/2915495913 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20240ca350 0x7f20240c82b0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f200c004780 tx=0x7f201c011bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:30.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.566+0000 7f200bfff640 1 -- 172.21.15.105:0/2915495913 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201c00f920 con 0x7f20240ca350 2024-09-21T03:26:30.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.566+0000 7f200bfff640 1 -- 172.21.15.105:0/2915495913 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f201c00fae0 con 0x7f20240ca350 2024-09-21T03:26:30.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.566+0000 7f2029f5f640 1 -- 172.21.15.105:0/2915495913 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20241f7060 con 0x7f20240ca350 2024-09-21T03:26:30.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.566+0000 7f200bfff640 1 -- 172.21.15.105:0/2915495913 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201c005020 con 0x7f20240ca350 2024-09-21T03:26:30.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.567+0000 7f2029f5f640 1 -- 172.21.15.105:0/2915495913 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20241f3370 con 0x7f20240ca350 2024-09-21T03:26:30.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.568+0000 7f2029f5f640 1 -- 172.21.15.105:0/2915495913 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20241f6af0 con 0x7f20240ca350 2024-09-21T03:26:30.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.568+0000 7f200bfff640 1 -- 172.21.15.105:0/2915495913 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f201c0051c0 con 0x7f20240ca350 2024-09-21T03:26:30.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.569+0000 7f200bfff640 1 --2- 172.21.15.105:0/2915495913 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2010078b90 0x7f201007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:30.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.569+0000 7f200bfff640 1 -- 172.21.15.105:0/2915495913 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 4857+0+0 (secure 0 0 0) 0x7f201c09b310 con 0x7f20240ca350 2024-09-21T03:26:30.571 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.569+0000 7f20237fe640 1 --2- 172.21.15.105:0/2915495913 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2010078b90 0x7f201007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:30.572 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.570+0000 7f20237fe640 1 --2- 172.21.15.105:0/2915495913 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2010078b90 0x7f201007b0a0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f2014033000 tx=0x7f201402d070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:30.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.574+0000 7f200bfff640 1 -- 172.21.15.105:0/2915495913 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f201c011e20 con 0x7f20240ca350 2024-09-21T03:26:30.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:30.752+0000 7f2029f5f640 1 -- 172.21.15.105:0/2915495913 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f20240cfbf0 con 0x7f20240ca350 2024-09-21T03:26:31.740 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.738+0000 7f200bfff640 1 -- 172.21.15.105:0/2915495913 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v126) ==== 138+0+0 (secure 0 0 0) 0x7f201c063b30 con 0x7f20240ca350 2024-09-21T03:26:31.741 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_metadata' created 2024-09-21T03:26:31.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.741+0000 7f2029f5f640 1 -- 172.21.15.105:0/2915495913 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2010078b90 msgr2=0x7f201007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:31.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.741+0000 7f2029f5f640 1 --2- 172.21.15.105:0/2915495913 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2010078b90 0x7f201007b0a0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f2014033000 tx=0x7f201402d070 comp rx=0 tx=0).stop 2024-09-21T03:26:31.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.741+0000 7f2029f5f640 1 -- 172.21.15.105:0/2915495913 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20240ca350 msgr2=0x7f20240c82b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:31.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.741+0000 7f2029f5f640 1 --2- 172.21.15.105:0/2915495913 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20240ca350 0x7f20240c82b0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f200c004780 tx=0x7f201c011bd0 comp rx=0 tx=0).stop 2024-09-21T03:26:31.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.741+0000 7f2029f5f640 1 -- 172.21.15.105:0/2915495913 shutdown_connections 2024-09-21T03:26:31.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.741+0000 7f2029f5f640 1 --2- 172.21.15.105:0/2915495913 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2010078b90 0x7f201007b0a0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:31.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.741+0000 7f2029f5f640 1 --2- 172.21.15.105:0/2915495913 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20240ca350 0x7f20240c82b0 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:31.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.741+0000 7f2029f5f640 1 --2- 172.21.15.105:0/2915495913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f20241f6570 0x7f20241f3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:31.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.741+0000 7f2029f5f640 1 --2- 172.21.15.105:0/2915495913 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f200c003a50 0x7f202415c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:31.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.741+0000 7f2029f5f640 1 -- 172.21.15.105:0/2915495913 >> 172.21.15.105:0/2915495913 conn(0x7f202409aa30 msgr2=0x7f20240b6120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:31.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.741+0000 7f2029f5f640 1 -- 172.21.15.105:0/2915495913 shutdown_connections 2024-09-21T03:26:31.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.741+0000 7f2029f5f640 1 -- 172.21.15.105:0/2915495913 wait complete. 2024-09-21T03:26:31.762 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T03:26:31.887 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.884+0000 7f6032324640 1 -- 172.21.15.105:0/1404481439 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f602c06e470 msgr2=0x7f602c070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:31.888 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.884+0000 7f6032324640 1 --2- 172.21.15.105:0/1404481439 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f602c06e470 0x7f602c070ee0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f601c005fd0 tx=0x7f601c02a540 comp rx=0 tx=0).stop 2024-09-21T03:26:31.888 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.885+0000 7f6032324640 1 -- 172.21.15.105:0/1404481439 shutdown_connections 2024-09-21T03:26:31.888 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.885+0000 7f6032324640 1 --2- 172.21.15.105:0/1404481439 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f602c160340 0x7f602c160750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:31.888 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.885+0000 7f6032324640 1 --2- 172.21.15.105:0/1404481439 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f602c06e470 0x7f602c070ee0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:31.888 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.885+0000 7f6032324640 1 -- 172.21.15.105:0/1404481439 >> 172.21.15.105:0/1404481439 conn(0x7f602c0cd530 msgr2=0x7f602c0cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:31.888 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.885+0000 7f6032324640 1 -- 172.21.15.105:0/1404481439 shutdown_connections 2024-09-21T03:26:31.888 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.885+0000 7f6032324640 1 -- 172.21.15.105:0/1404481439 wait complete. 2024-09-21T03:26:31.889 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.886+0000 7f6032324640 1 Processor -- start 2024-09-21T03:26:31.889 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.887+0000 7f6032324640 1 -- start start 2024-09-21T03:26:31.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.888+0000 7f6032324640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f602c06cde0 0x7f602c0c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:31.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.888+0000 7f6032324640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f602c06e470 0x7f602c152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:31.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.888+0000 7f6032324640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f602c160340 0x7f602c1e71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:31.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.888+0000 7f6032324640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f602c0715e0 con 0x7f602c06e470 2024-09-21T03:26:31.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.888+0000 7f6032324640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f602c0cbc00 con 0x7f602c160340 2024-09-21T03:26:31.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.888+0000 7f6032324640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f602c160c90 con 0x7f602c06cde0 2024-09-21T03:26:31.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.888+0000 7f602b7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f602c06e470 0x7f602c152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:31.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.888+0000 7f602b7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f602c06e470 0x7f602c152c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40964/0 (socket says 172.21.15.105:40964) 2024-09-21T03:26:31.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.888+0000 7f602b7fe640 1 -- 172.21.15.105:0/4076909828 learned_addr learned my addr 172.21.15.105:0/4076909828 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:31.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.888+0000 7f602bfff640 1 --2- 172.21.15.105:0/4076909828 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f602c06cde0 0x7f602c0c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:31.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.888+0000 7f60308c1640 1 --2- 172.21.15.105:0/4076909828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f602c160340 0x7f602c1e71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:31.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.888+0000 7f602b7fe640 1 -- 172.21.15.105:0/4076909828 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f602c06cde0 msgr2=0x7f602c0c6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:31.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.888+0000 7f602b7fe640 1 --2- 172.21.15.105:0/4076909828 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f602c06cde0 0x7f602c0c6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:31.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.888+0000 7f602b7fe640 1 -- 172.21.15.105:0/4076909828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f602c160340 msgr2=0x7f602c1e71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:31.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.888+0000 7f602b7fe640 1 --2- 172.21.15.105:0/4076909828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f602c160340 0x7f602c1e71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:31.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.888+0000 7f602b7fe640 1 -- 172.21.15.105:0/4076909828 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f602c1536f0 con 0x7f602c06e470 2024-09-21T03:26:31.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.888+0000 7f602b7fe640 1 --2- 172.21.15.105:0/4076909828 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f602c06e470 0x7f602c152c40 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f602000c370 tx=0x7f602000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:31.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.889+0000 7f6028ff9640 1 -- 172.21.15.105:0/4076909828 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6020017070 con 0x7f602c06e470 2024-09-21T03:26:31.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.889+0000 7f6028ff9640 1 -- 172.21.15.105:0/4076909828 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f60200053c0 con 0x7f602c06e470 2024-09-21T03:26:31.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.889+0000 7f6032324640 1 -- 172.21.15.105:0/4076909828 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f602c0c59d0 con 0x7f602c06e470 2024-09-21T03:26:31.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.889+0000 7f6028ff9640 1 -- 172.21.15.105:0/4076909828 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6020003850 con 0x7f602c06e470 2024-09-21T03:26:31.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.889+0000 7f6032324640 1 -- 172.21.15.105:0/4076909828 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f602c0c5f70 con 0x7f602c06e470 2024-09-21T03:26:31.894 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.890+0000 7f6032324640 1 -- 172.21.15.105:0/4076909828 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f602c1610e0 con 0x7f602c06e470 2024-09-21T03:26:31.894 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.891+0000 7f6028ff9640 1 -- 172.21.15.105:0/4076909828 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f602001a070 con 0x7f602c06e470 2024-09-21T03:26:31.894 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.891+0000 7f6028ff9640 1 --2- 172.21.15.105:0/4076909828 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6018078b90 0x7f601807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:31.894 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.891+0000 7f6028ff9640 1 -- 172.21.15.105:0/4076909828 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 5227+0+0 (secure 0 0 0) 0x7f602009a2b0 con 0x7f602c06e470 2024-09-21T03:26:31.894 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.892+0000 7f602bfff640 1 --2- 172.21.15.105:0/4076909828 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6018078b90 0x7f601807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:31.894 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.892+0000 7f602bfff640 1 --2- 172.21.15.105:0/4076909828 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6018078b90 0x7f601807b0a0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f601c033000 tx=0x7f601c004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:31.898 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:31.895+0000 7f6028ff9640 1 -- 172.21.15.105:0/4076909828 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6020021020 con 0x7f602c06e470 2024-09-21T03:26:32.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.073+0000 7f6032324640 1 -- 172.21.15.105:0/4076909828 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f602c0cae70 con 0x7f602c06e470 2024-09-21T03:26:32.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.740+0000 7f6028ff9640 1 -- 172.21.15.105:0/4076909828 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v127) ==== 170+0+0 (secure 0 0 0) 0x7f602009a0d0 con 0x7f602c06e470 2024-09-21T03:26:32.743 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_data' created 2024-09-21T03:26:32.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.743+0000 7f6032324640 1 -- 172.21.15.105:0/4076909828 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6018078b90 msgr2=0x7f601807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:32.746 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.743+0000 7f6032324640 1 --2- 172.21.15.105:0/4076909828 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6018078b90 0x7f601807b0a0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f601c033000 tx=0x7f601c004730 comp rx=0 tx=0).stop 2024-09-21T03:26:32.747 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.743+0000 7f6032324640 1 -- 172.21.15.105:0/4076909828 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f602c06e470 msgr2=0x7f602c152c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:32.747 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.743+0000 7f6032324640 1 --2- 172.21.15.105:0/4076909828 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f602c06e470 0x7f602c152c40 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f602000c370 tx=0x7f602000c830 comp rx=0 tx=0).stop 2024-09-21T03:26:32.747 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.744+0000 7f6032324640 1 -- 172.21.15.105:0/4076909828 shutdown_connections 2024-09-21T03:26:32.747 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.744+0000 7f6032324640 1 --2- 172.21.15.105:0/4076909828 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6018078b90 0x7f601807b0a0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:32.747 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.744+0000 7f6032324640 1 --2- 172.21.15.105:0/4076909828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f602c160340 0x7f602c1e71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:32.747 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.744+0000 7f6032324640 1 --2- 172.21.15.105:0/4076909828 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f602c06e470 0x7f602c152c40 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:32.747 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.744+0000 7f6032324640 1 --2- 172.21.15.105:0/4076909828 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f602c06cde0 0x7f602c0c6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:32.747 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.744+0000 7f6032324640 1 -- 172.21.15.105:0/4076909828 >> 172.21.15.105:0/4076909828 conn(0x7f602c0cd530 msgr2=0x7f602c06d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:32.747 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.744+0000 7f6032324640 1 -- 172.21.15.105:0/4076909828 shutdown_connections 2024-09-21T03:26:32.747 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.744+0000 7f6032324640 1 -- 172.21.15.105:0/4076909828 wait complete. 2024-09-21T03:26:32.770 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T03:26:32.889 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.886+0000 7fe489ba1640 1 -- 172.21.15.105:0/4109809820 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe46c004230 msgr2=0x7fe46c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:32.889 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.886+0000 7fe489ba1640 1 --2- 172.21.15.105:0/4109809820 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe46c004230 0x7fe46c004800 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fe478009b50 tx=0x7fe46c005830 comp rx=0 tx=0).stop 2024-09-21T03:26:32.889 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.886+0000 7fe483fff640 1 -- 172.21.15.105:0/4109809820 reap_dead start 2024-09-21T03:26:32.889 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.886+0000 7fe489ba1640 1 -- 172.21.15.105:0/4109809820 shutdown_connections 2024-09-21T03:26:32.889 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.886+0000 7fe489ba1640 1 -- 172.21.15.105:0/4109809820 >> 172.21.15.105:0/4109809820 conn(0x7fe4840cdcb0 msgr2=0x7fe4840ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:32.889 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.886+0000 7fe489ba1640 1 -- 172.21.15.105:0/4109809820 shutdown_connections 2024-09-21T03:26:32.889 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.886+0000 7fe489ba1640 1 -- 172.21.15.105:0/4109809820 wait complete. 2024-09-21T03:26:32.890 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.887+0000 7fe489ba1640 1 Processor -- start 2024-09-21T03:26:32.890 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.888+0000 7fe489ba1640 1 -- start start 2024-09-21T03:26:32.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.889+0000 7fe489ba1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe46c004230 0x7fe4840cce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:32.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.889+0000 7fe489ba1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4840cd350 0x7fe484150d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:32.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.889+0000 7fe489ba1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe484151240 0x7fe484151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:32.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.889+0000 7fe489ba1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe484071dc0 con 0x7fe484151240 2024-09-21T03:26:32.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.889+0000 7fe489ba1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe484071c40 con 0x7fe4840cd350 2024-09-21T03:26:32.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.889+0000 7fe489ba1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe4840adfa0 con 0x7fe46c004230 2024-09-21T03:26:32.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.889+0000 7fe483fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe484151240 0x7fe484151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:32.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.889+0000 7fe483fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe484151240 0x7fe484151650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40986/0 (socket says 172.21.15.105:40986) 2024-09-21T03:26:32.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.889+0000 7fe483fff640 1 -- 172.21.15.105:0/1057641587 learned_addr learned my addr 172.21.15.105:0/1057641587 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:32.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.889+0000 7fe4837fe640 1 --2- 172.21.15.105:0/1057641587 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe46c004230 0x7fe4840cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:32.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.889+0000 7fe482ffd640 1 --2- 172.21.15.105:0/1057641587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4840cd350 0x7fe484150d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:32.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.889+0000 7fe483fff640 1 -- 172.21.15.105:0/1057641587 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe46c004230 msgr2=0x7fe4840cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:32.894 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.889+0000 7fe483fff640 1 --2- 172.21.15.105:0/1057641587 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe46c004230 0x7fe4840cce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:32.894 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.889+0000 7fe483fff640 1 -- 172.21.15.105:0/1057641587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4840cd350 msgr2=0x7fe484150d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:32.894 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.889+0000 7fe483fff640 1 --2- 172.21.15.105:0/1057641587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4840cd350 0x7fe484150d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:32.894 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.889+0000 7fe483fff640 1 -- 172.21.15.105:0/1057641587 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4840cd760 con 0x7fe484151240 2024-09-21T03:26:32.894 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.890+0000 7fe483fff640 1 --2- 172.21.15.105:0/1057641587 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe484151240 0x7fe484151650 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fe484073d10 tx=0x7fe47c006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:32.894 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.890+0000 7fe46bfff640 1 -- 172.21.15.105:0/1057641587 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47c011900 con 0x7fe484151240 2024-09-21T03:26:32.894 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.890+0000 7fe46bfff640 1 -- 172.21.15.105:0/1057641587 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe47c011aa0 con 0x7fe484151240 2024-09-21T03:26:32.894 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.890+0000 7fe489ba1640 1 -- 172.21.15.105:0/1057641587 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4840c9510 con 0x7fe484151240 2024-09-21T03:26:32.894 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.890+0000 7fe46bfff640 1 -- 172.21.15.105:0/1057641587 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47c010420 con 0x7fe484151240 2024-09-21T03:26:32.894 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.890+0000 7fe489ba1640 1 -- 172.21.15.105:0/1057641587 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4840c97d0 con 0x7fe484151240 2024-09-21T03:26:32.895 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.891+0000 7fe489ba1640 1 -- 172.21.15.105:0/1057641587 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4840ae500 con 0x7fe484151240 2024-09-21T03:26:32.895 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.892+0000 7fe46bfff640 1 -- 172.21.15.105:0/1057641587 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe47c0105c0 con 0x7fe484151240 2024-09-21T03:26:32.895 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.892+0000 7fe46bfff640 1 --2- 172.21.15.105:0/1057641587 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe470078b90 0x7fe47007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:32.895 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.892+0000 7fe46bfff640 1 -- 172.21.15.105:0/1057641587 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5609+0+0 (secure 0 0 0) 0x7fe47c09be80 con 0x7fe484151240 2024-09-21T03:26:32.895 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.893+0000 7fe4837fe640 1 --2- 172.21.15.105:0/1057641587 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe470078b90 0x7fe47007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:32.896 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.893+0000 7fe4837fe640 1 --2- 172.21.15.105:0/1057641587 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe470078b90 0x7fe47007b0a0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fe474001050 tx=0x7fe474006720 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:32.899 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:32.897+0000 7fe46bfff640 1 -- 172.21.15.105:0/1057641587 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe4840cd760 con 0x7fe484151240 2024-09-21T03:26:33.112 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.110+0000 7fe489ba1640 1 -- 172.21.15.105:0/1057641587 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe484151c20 con 0x7fe484151240 2024-09-21T03:26:33.767 INFO:teuthology.orchestra.run.smithi105.stderr:new fs with metadata pool 20 and data pool 21 2024-09-21T03:26:33.767 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.764+0000 7fe46bfff640 1 -- 172.21.15.105:0/1057641587 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 20 and data pool 21 v81) ==== 174+0+0 (secure 0 0 0) 0x7fe47c063e40 con 0x7fe484151240 2024-09-21T03:26:33.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.771+0000 7fe489ba1640 1 -- 172.21.15.105:0/1057641587 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe470078b90 msgr2=0x7fe47007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:33.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.771+0000 7fe489ba1640 1 --2- 172.21.15.105:0/1057641587 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe470078b90 0x7fe47007b0a0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fe474001050 tx=0x7fe474006720 comp rx=0 tx=0).stop 2024-09-21T03:26:33.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.772+0000 7fe489ba1640 1 -- 172.21.15.105:0/1057641587 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe484151240 msgr2=0x7fe484151650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:33.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.772+0000 7fe489ba1640 1 --2- 172.21.15.105:0/1057641587 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe484151240 0x7fe484151650 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fe484073d10 tx=0x7fe47c006430 comp rx=0 tx=0).stop 2024-09-21T03:26:33.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.772+0000 7fe489ba1640 1 -- 172.21.15.105:0/1057641587 shutdown_connections 2024-09-21T03:26:33.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.772+0000 7fe489ba1640 1 --2- 172.21.15.105:0/1057641587 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe470078b90 0x7fe47007b0a0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:33.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.772+0000 7fe489ba1640 1 --2- 172.21.15.105:0/1057641587 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe484151240 0x7fe484151650 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:33.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.772+0000 7fe489ba1640 1 --2- 172.21.15.105:0/1057641587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4840cd350 0x7fe484150d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:33.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.772+0000 7fe489ba1640 1 --2- 172.21.15.105:0/1057641587 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe46c004230 0x7fe4840cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:33.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.772+0000 7fe489ba1640 1 -- 172.21.15.105:0/1057641587 >> 172.21.15.105:0/1057641587 conn(0x7fe4840cdcb0 msgr2=0x7fe4840af870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:33.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.774+0000 7fe489ba1640 1 -- 172.21.15.105:0/1057641587 shutdown_connections 2024-09-21T03:26:33.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.774+0000 7fe489ba1640 1 -- 172.21.15.105:0/1057641587 wait complete. 2024-09-21T03:26:33.798 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:26:33.914 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.911+0000 7f817477b640 1 -- 172.21.15.105:0/3149966096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f816c15f9b0 msgr2=0x7f816c0ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:33.914 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.911+0000 7f817477b640 1 --2- 172.21.15.105:0/3149966096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f816c15f9b0 0x7f816c0ce680 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f8164005fd0 tx=0x7f816402a530 comp rx=0 tx=0).stop 2024-09-21T03:26:33.914 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.911+0000 7f817477b640 1 -- 172.21.15.105:0/3149966096 shutdown_connections 2024-09-21T03:26:33.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.911+0000 7f817477b640 1 --2- 172.21.15.105:0/3149966096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f816c15f9b0 0x7f816c0ce680 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:33.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.911+0000 7f817477b640 1 --2- 172.21.15.105:0/3149966096 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f816c075fa0 0x7f816c070e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:33.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.911+0000 7f817477b640 1 -- 172.21.15.105:0/3149966096 >> 172.21.15.105:0/3149966096 conn(0x7f816c0cd530 msgr2=0x7f816c0cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:33.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.911+0000 7f817477b640 1 -- 172.21.15.105:0/3149966096 shutdown_connections 2024-09-21T03:26:33.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.911+0000 7f817477b640 1 -- 172.21.15.105:0/3149966096 wait complete. 2024-09-21T03:26:33.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.913+0000 7f817477b640 1 Processor -- start 2024-09-21T03:26:33.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.913+0000 7f817477b640 1 -- start start 2024-09-21T03:26:33.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.914+0000 7f817477b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f816c06e100 0x7f816c1540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:33.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.914+0000 7f817477b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f816c075fa0 0x7f816c0b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:33.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.914+0000 7f817477b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f816c0c9de0 0x7f816c0ca1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:33.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.914+0000 7f817477b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f816c0cf090 con 0x7f816c06e100 2024-09-21T03:26:33.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.914+0000 7f817477b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f816c0cef10 con 0x7f816c0c9de0 2024-09-21T03:26:33.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.914+0000 7f817477b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f816c0cf210 con 0x7f816c075fa0 2024-09-21T03:26:33.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.914+0000 7f8172517640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f816c06e100 0x7f816c1540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:33.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.914+0000 7f8172517640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f816c06e100 0x7f816c1540a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41004/0 (socket says 172.21.15.105:41004) 2024-09-21T03:26:33.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.914+0000 7f8172517640 1 -- 172.21.15.105:0/1298572627 learned_addr learned my addr 172.21.15.105:0/1298572627 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:33.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.914+0000 7f8172d18640 1 --2- 172.21.15.105:0/1298572627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f816c0c9de0 0x7f816c0ca1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:33.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.914+0000 7f8171d16640 1 --2- 172.21.15.105:0/1298572627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f816c075fa0 0x7f816c0b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:33.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.915+0000 7f8172517640 1 -- 172.21.15.105:0/1298572627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f816c075fa0 msgr2=0x7f816c0b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:33.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.915+0000 7f8172517640 1 --2- 172.21.15.105:0/1298572627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f816c075fa0 0x7f816c0b54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:33.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.915+0000 7f8172517640 1 -- 172.21.15.105:0/1298572627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f816c0c9de0 msgr2=0x7f816c0ca1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:33.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.915+0000 7f8172517640 1 --2- 172.21.15.105:0/1298572627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f816c0c9de0 0x7f816c0ca1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:33.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.915+0000 7f8172517640 1 -- 172.21.15.105:0/1298572627 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f816c0b3b00 con 0x7f816c06e100 2024-09-21T03:26:33.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.915+0000 7f8172d18640 1 --2- 172.21.15.105:0/1298572627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f816c0c9de0 0x7f816c0ca1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:26:33.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.915+0000 7f8171d16640 1 --2- 172.21.15.105:0/1298572627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f816c075fa0 0x7f816c0b54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:26:33.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.915+0000 7f8172517640 1 --2- 172.21.15.105:0/1298572627 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f816c06e100 0x7f816c1540a0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f815c00ba50 tx=0x7f815c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:33.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.915+0000 7f816affd640 1 -- 172.21.15.105:0/1298572627 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815c019070 con 0x7f816c06e100 2024-09-21T03:26:33.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.915+0000 7f816affd640 1 -- 172.21.15.105:0/1298572627 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f815c00ccf0 con 0x7f816c06e100 2024-09-21T03:26:33.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.915+0000 7f817477b640 1 -- 172.21.15.105:0/1298572627 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f816c0ca730 con 0x7f816c06e100 2024-09-21T03:26:33.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.915+0000 7f816affd640 1 -- 172.21.15.105:0/1298572627 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815c0146a0 con 0x7f816c06e100 2024-09-21T03:26:33.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.915+0000 7f817477b640 1 -- 172.21.15.105:0/1298572627 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f816c1f60d0 con 0x7f816c06e100 2024-09-21T03:26:33.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.916+0000 7f817477b640 1 -- 172.21.15.105:0/1298572627 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f816c0cf740 con 0x7f816c06e100 2024-09-21T03:26:33.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.917+0000 7f816affd640 1 -- 172.21.15.105:0/1298572627 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f815c01c070 con 0x7f816c06e100 2024-09-21T03:26:33.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.917+0000 7f816affd640 1 --2- 172.21.15.105:0/1298572627 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8158078bc0 0x7f815807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:33.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.918+0000 7f816affd640 1 -- 172.21.15.105:0/1298572627 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7f815c09aad0 con 0x7f816c06e100 2024-09-21T03:26:33.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.918+0000 7f8171d16640 1 --2- 172.21.15.105:0/1298572627 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8158078bc0 0x7f815807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:33.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.918+0000 7f8171d16640 1 --2- 172.21.15.105:0/1298572627 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8158078bc0 0x7f815807b0d0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f816c15b2c0 tx=0x7f8160008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:33.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:33.922+0000 7f816affd640 1 -- 172.21.15.105:0/1298572627 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f816c0ca730 con 0x7f816c06e100 2024-09-21T03:26:34.103 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.100+0000 7f817477b640 1 -- 172.21.15.105:0/1298572627 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f816c160120 con 0x7f816c06e100 2024-09-21T03:26:34.104 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.101+0000 7f816affd640 1 -- 172.21.15.105:0/1298572627 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) ==== 74+0+16824 (secure 0 0 0) 0x7f815c062fa0 con 0x7f816c06e100 2024-09-21T03:26:34.104 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:26:34.105 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":128,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:26:33.112268+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:26:30.757426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-21T03:26:32.079246+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:26:34.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.104+0000 7f817477b640 1 -- 172.21.15.105:0/1298572627 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8158078bc0 msgr2=0x7f815807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:34.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.104+0000 7f817477b640 1 --2- 172.21.15.105:0/1298572627 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8158078bc0 0x7f815807b0d0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f816c15b2c0 tx=0x7f8160008040 comp rx=0 tx=0).stop 2024-09-21T03:26:34.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.104+0000 7f817477b640 1 -- 172.21.15.105:0/1298572627 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f816c06e100 msgr2=0x7f816c1540a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:34.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.104+0000 7f817477b640 1 --2- 172.21.15.105:0/1298572627 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f816c06e100 0x7f816c1540a0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f815c00ba50 tx=0x7f815c00bf10 comp rx=0 tx=0).stop 2024-09-21T03:26:34.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.104+0000 7f817477b640 1 -- 172.21.15.105:0/1298572627 shutdown_connections 2024-09-21T03:26:34.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.104+0000 7f817477b640 1 --2- 172.21.15.105:0/1298572627 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8158078bc0 0x7f815807b0d0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:34.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.104+0000 7f817477b640 1 --2- 172.21.15.105:0/1298572627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f816c0c9de0 0x7f816c0ca1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:34.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.104+0000 7f817477b640 1 --2- 172.21.15.105:0/1298572627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f816c075fa0 0x7f816c0b54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:34.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.104+0000 7f817477b640 1 --2- 172.21.15.105:0/1298572627 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f816c06e100 0x7f816c1540a0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:34.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.104+0000 7f817477b640 1 -- 172.21.15.105:0/1298572627 >> 172.21.15.105:0/1298572627 conn(0x7f816c0cd530 msgr2=0x7f816c15b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:34.108 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.104+0000 7f817477b640 1 -- 172.21.15.105:0/1298572627 shutdown_connections 2024-09-21T03:26:34.108 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.104+0000 7f817477b640 1 -- 172.21.15.105:0/1298572627 wait complete. 2024-09-21T03:26:34.118 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:26:34.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.227+0000 7fdbb20f9640 1 -- 172.21.15.105:0/1752192486 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbac0cf440 msgr2=0x7fdbac15c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:34.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.227+0000 7fdbb20f9640 1 --2- 172.21.15.105:0/1752192486 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbac0cf440 0x7fdbac15c6a0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fdbac0cc8f0 tx=0x7fdba002a560 comp rx=0 tx=0).stop 2024-09-21T03:26:34.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.227+0000 7fdbb20f9640 1 -- 172.21.15.105:0/1752192486 shutdown_connections 2024-09-21T03:26:34.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.227+0000 7fdbb20f9640 1 --2- 172.21.15.105:0/1752192486 >> v2:172.21.15.162:3300/0 conn(0x7fdbac0b7fe0 0x7fdbac0d0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:34.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.227+0000 7fdbb20f9640 1 --2- 172.21.15.105:0/1752192486 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbac0cf440 0x7fdbac15c6a0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:34.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.227+0000 7fdbb20f9640 1 -- 172.21.15.105:0/1752192486 >> 172.21.15.105:0/1752192486 conn(0x7fdbac0710b0 msgr2=0x7fdbac0714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:34.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.227+0000 7fdbb20f9640 1 -- 172.21.15.105:0/1752192486 shutdown_connections 2024-09-21T03:26:34.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.227+0000 7fdbb20f9640 1 -- 172.21.15.105:0/1752192486 wait complete. 2024-09-21T03:26:34.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.229+0000 7fdbb20f9640 1 Processor -- start 2024-09-21T03:26:34.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.229+0000 7fdbb20f9640 1 -- start start 2024-09-21T03:26:34.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.230+0000 7fdbb20f9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdbac0b7fe0 0x7fdbac15ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:34.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.230+0000 7fdbb20f9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdbac0cd360 0x7fdbac06ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:34.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.230+0000 7fdbb20f9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbac15b3f0 0x7fdbac06f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:34.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.230+0000 7fdbb20f9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdbac0d0b40 con 0x7fdbac15b3f0 2024-09-21T03:26:34.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.230+0000 7fdbb20f9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdbac0d09c0 con 0x7fdbac0b7fe0 2024-09-21T03:26:34.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.230+0000 7fdbb20f9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdbac0d0cc0 con 0x7fdbac0cd360 2024-09-21T03:26:34.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.231+0000 7fdbabfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbac15b3f0 0x7fdbac06f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:34.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.231+0000 7fdbabfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbac15b3f0 0x7fdbac06f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41026/0 (socket says 172.21.15.105:41026) 2024-09-21T03:26:34.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.231+0000 7fdbabfff640 1 -- 172.21.15.105:0/3769926145 learned_addr learned my addr 172.21.15.105:0/3769926145 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:34.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.231+0000 7fdbab7fe640 1 --2- 172.21.15.105:0/3769926145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdbac0b7fe0 0x7fdbac15ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:34.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.231+0000 7fdbaaffd640 1 --2- 172.21.15.105:0/3769926145 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdbac0cd360 0x7fdbac06ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:34.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.231+0000 7fdbabfff640 1 -- 172.21.15.105:0/3769926145 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdbac0cd360 msgr2=0x7fdbac06ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:34.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.231+0000 7fdbabfff640 1 --2- 172.21.15.105:0/3769926145 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdbac0cd360 0x7fdbac06ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:34.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.231+0000 7fdbabfff640 1 -- 172.21.15.105:0/3769926145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdbac0b7fe0 msgr2=0x7fdbac15ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:34.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.231+0000 7fdbabfff640 1 --2- 172.21.15.105:0/3769926145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdbac0b7fe0 0x7fdbac15ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:34.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.231+0000 7fdbabfff640 1 -- 172.21.15.105:0/3769926145 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbac1f9080 con 0x7fdbac15b3f0 2024-09-21T03:26:34.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.231+0000 7fdbabfff640 1 --2- 172.21.15.105:0/3769926145 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbac15b3f0 0x7fdbac06f4d0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fdba400cab0 tx=0x7fdba400cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:34.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.231+0000 7fdb93fff640 1 -- 172.21.15.105:0/3769926145 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba4007d90 con 0x7fdbac15b3f0 2024-09-21T03:26:34.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.231+0000 7fdb93fff640 1 -- 172.21.15.105:0/3769926145 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdba400f540 con 0x7fdbac15b3f0 2024-09-21T03:26:34.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.231+0000 7fdbb20f9640 1 -- 172.21.15.105:0/3769926145 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbac1f9360 con 0x7fdbac15b3f0 2024-09-21T03:26:34.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.231+0000 7fdb93fff640 1 -- 172.21.15.105:0/3769926145 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba400f990 con 0x7fdbac15b3f0 2024-09-21T03:26:34.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.231+0000 7fdbb20f9640 1 -- 172.21.15.105:0/3769926145 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbac1f9920 con 0x7fdbac15b3f0 2024-09-21T03:26:34.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.232+0000 7fdbb20f9640 1 -- 172.21.15.105:0/3769926145 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbac0d1170 con 0x7fdbac15b3f0 2024-09-21T03:26:34.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.233+0000 7fdb93fff640 1 -- 172.21.15.105:0/3769926145 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdba400fb30 con 0x7fdbac15b3f0 2024-09-21T03:26:34.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.233+0000 7fdb93fff640 1 --2- 172.21.15.105:0/3769926145 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdb98078b90 0x7fdb9807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:34.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.234+0000 7fdb93fff640 1 -- 172.21.15.105:0/3769926145 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7fdba409b730 con 0x7fdbac15b3f0 2024-09-21T03:26:34.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.234+0000 7fdbab7fe640 1 --2- 172.21.15.105:0/3769926145 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdb98078b90 0x7fdb9807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:34.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.234+0000 7fdbab7fe640 1 --2- 172.21.15.105:0/3769926145 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdb98078b90 0x7fdb9807b0a0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c0015e0 tx=0x7fdb9c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:34.241 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.238+0000 7fdb93fff640 1 -- 172.21.15.105:0/3769926145 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fdba4014070 con 0x7fdbac15b3f0 2024-09-21T03:26:34.418 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.416+0000 7fdbb20f9640 1 -- 172.21.15.105:0/3769926145 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdbac06ea70 con 0x7fdbac15b3f0 2024-09-21T03:26:34.419 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.417+0000 7fdb93fff640 1 -- 172.21.15.105:0/3769926145 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) ==== 74+0+16824 (secure 0 0 0) 0x7fdba400fe20 con 0x7fdbac15b3f0 2024-09-21T03:26:34.420 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:26:34.420 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":128,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:26:33.112268+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:26:30.757426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-21T03:26:32.079246+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:26:34.422 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.419+0000 7fdbb20f9640 1 -- 172.21.15.105:0/3769926145 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdb98078b90 msgr2=0x7fdb9807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:34.422 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.419+0000 7fdbb20f9640 1 --2- 172.21.15.105:0/3769926145 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdb98078b90 0x7fdb9807b0a0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c0015e0 tx=0x7fdb9c009040 comp rx=0 tx=0).stop 2024-09-21T03:26:34.422 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.419+0000 7fdbb20f9640 1 -- 172.21.15.105:0/3769926145 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbac15b3f0 msgr2=0x7fdbac06f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:34.422 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.419+0000 7fdbb20f9640 1 --2- 172.21.15.105:0/3769926145 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbac15b3f0 0x7fdbac06f4d0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fdba400cab0 tx=0x7fdba400cf70 comp rx=0 tx=0).stop 2024-09-21T03:26:34.422 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.419+0000 7fdbb20f9640 1 -- 172.21.15.105:0/3769926145 shutdown_connections 2024-09-21T03:26:34.422 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.419+0000 7fdbb20f9640 1 --2- 172.21.15.105:0/3769926145 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdb98078b90 0x7fdb9807b0a0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:34.422 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.419+0000 7fdbb20f9640 1 --2- 172.21.15.105:0/3769926145 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbac15b3f0 0x7fdbac06f4d0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:34.422 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.419+0000 7fdbb20f9640 1 --2- 172.21.15.105:0/3769926145 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdbac0cd360 0x7fdbac06ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:34.422 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.419+0000 7fdbb20f9640 1 --2- 172.21.15.105:0/3769926145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdbac0b7fe0 0x7fdbac15ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:34.422 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.419+0000 7fdbb20f9640 1 -- 172.21.15.105:0/3769926145 >> 172.21.15.105:0/3769926145 conn(0x7fdbac0710b0 msgr2=0x7fdbac0d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:34.423 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.419+0000 7fdbb20f9640 1 -- 172.21.15.105:0/3769926145 shutdown_connections 2024-09-21T03:26:34.423 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.419+0000 7fdbb20f9640 1 -- 172.21.15.105:0/3769926145 wait complete. 2024-09-21T03:26:34.433 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T03:26:34.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.546+0000 7f7d1c769640 1 -- 172.21.15.105:0/1393221575 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d140ccb70 msgr2=0x7f7d14156f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:34.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.546+0000 7f7d1c769640 1 --2- 172.21.15.105:0/1393221575 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d140ccb70 0x7f7d14156f10 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f7d140720a0 tx=0x7f7d0402a680 comp rx=0 tx=0).stop 2024-09-21T03:26:34.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.546+0000 7f7d1c769640 1 -- 172.21.15.105:0/1393221575 shutdown_connections 2024-09-21T03:26:34.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.546+0000 7f7d1c769640 1 --2- 172.21.15.105:0/1393221575 >> v2:172.21.15.162:3300/0 conn(0x7f7d140cec50 0x7f7d140cf060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:34.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.546+0000 7f7d1c769640 1 --2- 172.21.15.105:0/1393221575 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d140ccb70 0x7f7d14156f10 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:34.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.546+0000 7f7d1c769640 1 -- 172.21.15.105:0/1393221575 >> 172.21.15.105:0/1393221575 conn(0x7f7d1406d4f0 msgr2=0x7f7d14071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:34.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.546+0000 7f7d1c769640 1 -- 172.21.15.105:0/1393221575 shutdown_connections 2024-09-21T03:26:34.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.546+0000 7f7d1c769640 1 -- 172.21.15.105:0/1393221575 wait complete. 2024-09-21T03:26:34.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.548+0000 7f7d1c769640 1 Processor -- start 2024-09-21T03:26:34.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.548+0000 7f7d1c769640 1 -- start start 2024-09-21T03:26:34.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.549+0000 7f7d1c769640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d140ccb70 0x7f7d1415c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:34.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.549+0000 7f7d1c769640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d140cec50 0x7f7d141f45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:34.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.549+0000 7f7d1c769640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d14161020 0x7f7d14159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:34.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.549+0000 7f7d1c769640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7d140d08c0 con 0x7f7d14161020 2024-09-21T03:26:34.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.549+0000 7f7d1c769640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7d140d0740 con 0x7f7d140ccb70 2024-09-21T03:26:34.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.549+0000 7f7d1c769640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7d140d0a40 con 0x7f7d140cec50 2024-09-21T03:26:34.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.549+0000 7f7d1ad06640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d14161020 0x7f7d14159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:34.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.549+0000 7f7d1ad06640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d14161020 0x7f7d14159130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41040/0 (socket says 172.21.15.105:41040) 2024-09-21T03:26:34.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.549+0000 7f7d1ad06640 1 -- 172.21.15.105:0/620451072 learned_addr learned my addr 172.21.15.105:0/620451072 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:34.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.550+0000 7f7d1a505640 1 --2- 172.21.15.105:0/620451072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d140ccb70 0x7f7d1415c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:34.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.550+0000 7f7d19d04640 1 --2- 172.21.15.105:0/620451072 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d140cec50 0x7f7d141f45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:34.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.550+0000 7f7d1ad06640 1 -- 172.21.15.105:0/620451072 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d140cec50 msgr2=0x7f7d141f45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:34.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.550+0000 7f7d1ad06640 1 --2- 172.21.15.105:0/620451072 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d140cec50 0x7f7d141f45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:34.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.550+0000 7f7d1ad06640 1 -- 172.21.15.105:0/620451072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d140ccb70 msgr2=0x7f7d1415c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:34.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.550+0000 7f7d1ad06640 1 --2- 172.21.15.105:0/620451072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d140ccb70 0x7f7d1415c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:34.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.550+0000 7f7d1ad06640 1 -- 172.21.15.105:0/620451072 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d1415b0a0 con 0x7f7d14161020 2024-09-21T03:26:34.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.550+0000 7f7d1ad06640 1 --2- 172.21.15.105:0/620451072 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d14161020 0x7f7d14159130 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c00e960 tx=0x7f7d0c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:34.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.550+0000 7f7d0affd640 1 -- 172.21.15.105:0/620451072 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c004d20 con 0x7f7d14161020 2024-09-21T03:26:34.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.550+0000 7f7d0affd640 1 -- 172.21.15.105:0/620451072 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d0c00cac0 con 0x7f7d14161020 2024-09-21T03:26:34.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.550+0000 7f7d0affd640 1 -- 172.21.15.105:0/620451072 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c005020 con 0x7f7d14161020 2024-09-21T03:26:34.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.550+0000 7f7d1c769640 1 -- 172.21.15.105:0/620451072 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d1415b380 con 0x7f7d14161020 2024-09-21T03:26:34.556 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.550+0000 7f7d1c769640 1 -- 172.21.15.105:0/620451072 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d1415b940 con 0x7f7d14161020 2024-09-21T03:26:34.556 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.551+0000 7f7d1c769640 1 -- 172.21.15.105:0/620451072 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d140694f0 con 0x7f7d14161020 2024-09-21T03:26:34.556 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.552+0000 7f7d0affd640 1 -- 172.21.15.105:0/620451072 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7d0c0051c0 con 0x7f7d14161020 2024-09-21T03:26:34.556 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.552+0000 7f7d0affd640 1 --2- 172.21.15.105:0/620451072 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7cf8078b90 0x7f7cf807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:34.556 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.552+0000 7f7d0affd640 1 -- 172.21.15.105:0/620451072 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7f7d0c09b5d0 con 0x7f7d14161020 2024-09-21T03:26:34.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.553+0000 7f7d1a505640 1 --2- 172.21.15.105:0/620451072 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7cf8078b90 0x7f7cf807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:34.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.553+0000 7f7d1a505640 1 --2- 172.21.15.105:0/620451072 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7cf8078b90 0x7f7cf807b0a0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f7d100015e0 tx=0x7f7d10009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:34.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.557+0000 7f7d0affd640 1 -- 172.21.15.105:0/620451072 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7d140694f0 con 0x7f7d14161020 2024-09-21T03:26:34.776 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:34.773+0000 7f7d1c769640 1 -- 172.21.15.105:0/620451072 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f7d140d0fd0 con 0x7f7d14161020 2024-09-21T03:26:35.736 INFO:tasks.ceph.mds.b.smithi162.stderr:2024-09-21T03:26:35.735+0000 7fb0afacd640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T03:26:35.777 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.775+0000 7f7d0affd640 1 -- 172.21.15.105:0/620451072 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v83) ==== 118+0+0 (secure 0 0 0) 0x7f7d0c016030 con 0x7f7d14161020 2024-09-21T03:26:35.781 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.778+0000 7f7d1c769640 1 -- 172.21.15.105:0/620451072 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7cf8078b90 msgr2=0x7f7cf807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:35.781 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.778+0000 7f7d1c769640 1 --2- 172.21.15.105:0/620451072 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7cf8078b90 0x7f7cf807b0a0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f7d100015e0 tx=0x7f7d10009040 comp rx=0 tx=0).stop 2024-09-21T03:26:35.781 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.778+0000 7f7d1c769640 1 -- 172.21.15.105:0/620451072 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d14161020 msgr2=0x7f7d14159130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:35.781 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.778+0000 7f7d1c769640 1 --2- 172.21.15.105:0/620451072 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d14161020 0x7f7d14159130 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c00e960 tx=0x7f7d0c00ee20 comp rx=0 tx=0).stop 2024-09-21T03:26:35.781 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.778+0000 7f7d1c769640 1 -- 172.21.15.105:0/620451072 shutdown_connections 2024-09-21T03:26:35.781 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.778+0000 7f7d1c769640 1 --2- 172.21.15.105:0/620451072 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7cf8078b90 0x7f7cf807b0a0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:35.781 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.778+0000 7f7d1c769640 1 --2- 172.21.15.105:0/620451072 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d14161020 0x7f7d14159130 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:35.781 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.778+0000 7f7d1c769640 1 --2- 172.21.15.105:0/620451072 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d140cec50 0x7f7d141f45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:35.781 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.778+0000 7f7d1c769640 1 --2- 172.21.15.105:0/620451072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d140ccb70 0x7f7d1415c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:35.781 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.778+0000 7f7d1c769640 1 -- 172.21.15.105:0/620451072 >> 172.21.15.105:0/620451072 conn(0x7f7d1406d4f0 msgr2=0x7f7d140b7310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:35.781 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.778+0000 7f7d1c769640 1 -- 172.21.15.105:0/620451072 shutdown_connections 2024-09-21T03:26:35.781 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.778+0000 7f7d1c769640 1 -- 172.21.15.105:0/620451072 wait complete. 2024-09-21T03:26:35.794 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T03:26:35.795 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T03:26:35.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.912+0000 7fb0490fa640 1 -- 172.21.15.105:0/2189352302 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb0440d2310 msgr2=0x7fb0440d2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:35.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.912+0000 7fb0490fa640 1 --2- 172.21.15.105:0/2189352302 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb0440d2310 0x7fb0440d2720 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fb044070810 tx=0x7fb03c02a980 comp rx=0 tx=0).stop 2024-09-21T03:26:35.915 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.912+0000 7fb0490fa640 1 -- 172.21.15.105:0/2189352302 shutdown_connections 2024-09-21T03:26:35.916 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.912+0000 7fb0490fa640 1 --2- 172.21.15.105:0/2189352302 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb0440d2310 0x7fb0440d2720 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:35.916 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.912+0000 7fb0490fa640 1 --2- 172.21.15.105:0/2189352302 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb0440b5210 0x7fb0440cf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:35.916 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.912+0000 7fb0490fa640 1 --2- 172.21.15.105:0/2189352302 >> v2:172.21.15.162:3300/0 conn(0x7fb0440ccbe0 0x7fb04415c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:35.916 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.912+0000 7fb0490fa640 1 -- 172.21.15.105:0/2189352302 >> 172.21.15.105:0/2189352302 conn(0x7fb0440b3f10 msgr2=0x7fb0440b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:35.916 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.912+0000 7fb0490fa640 1 -- 172.21.15.105:0/2189352302 shutdown_connections 2024-09-21T03:26:35.916 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.912+0000 7fb0490fa640 1 -- 172.21.15.105:0/2189352302 wait complete. 2024-09-21T03:26:35.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.914+0000 7fb0490fa640 1 Processor -- start 2024-09-21T03:26:35.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.914+0000 7fb0490fa640 1 -- start start 2024-09-21T03:26:35.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.916+0000 7fb0490fa640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb0440b5210 0x7fb0441f7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:35.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.916+0000 7fb0490fa640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0440ccbe0 0x7fb0440b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:35.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.916+0000 7fb0490fa640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb0440d2310 0x7fb0440b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:35.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.916+0000 7fb0490fa640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb0440d16a0 con 0x7fb0440b5210 2024-09-21T03:26:35.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.916+0000 7fb0490fa640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb0440d1520 con 0x7fb0440ccbe0 2024-09-21T03:26:35.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.916+0000 7fb0490fa640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb0440d1820 con 0x7fb0440d2310 2024-09-21T03:26:35.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.916+0000 7fb042d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb0440b5210 0x7fb0441f7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:35.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.916+0000 7fb042d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb0440b5210 0x7fb0441f7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41048/0 (socket says 172.21.15.105:41048) 2024-09-21T03:26:35.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.916+0000 7fb042d9d640 1 -- 172.21.15.105:0/514299033 learned_addr learned my addr 172.21.15.105:0/514299033 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:35.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.916+0000 7fb03bfff640 1 --2- 172.21.15.105:0/514299033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0440ccbe0 0x7fb0440b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:35.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.916+0000 7fb04359e640 1 --2- 172.21.15.105:0/514299033 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb0440d2310 0x7fb0440b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:35.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.916+0000 7fb042d9d640 1 -- 172.21.15.105:0/514299033 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb0440d2310 msgr2=0x7fb0440b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:35.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.916+0000 7fb042d9d640 1 --2- 172.21.15.105:0/514299033 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb0440d2310 0x7fb0440b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:35.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.916+0000 7fb042d9d640 1 -- 172.21.15.105:0/514299033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0440ccbe0 msgr2=0x7fb0440b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:35.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.916+0000 7fb042d9d640 1 --2- 172.21.15.105:0/514299033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0440ccbe0 0x7fb0440b0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:35.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.916+0000 7fb042d9d640 1 -- 172.21.15.105:0/514299033 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0441564f0 con 0x7fb0440b5210 2024-09-21T03:26:35.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.916+0000 7fb04359e640 1 --2- 172.21.15.105:0/514299033 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb0440d2310 0x7fb0440b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:26:35.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.916+0000 7fb042d9d640 1 --2- 172.21.15.105:0/514299033 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb0440b5210 0x7fb0441f7790 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fb03400d740 tx=0x7fb03400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:35.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.916+0000 7fb03b7fe640 1 -- 172.21.15.105:0/514299033 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb034017070 con 0x7fb0440b5210 2024-09-21T03:26:35.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.916+0000 7fb03b7fe640 1 -- 172.21.15.105:0/514299033 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb034009d20 con 0x7fb0440b5210 2024-09-21T03:26:35.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.917+0000 7fb0490fa640 1 -- 172.21.15.105:0/514299033 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0441567d0 con 0x7fb0440b5210 2024-09-21T03:26:35.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.917+0000 7fb03b7fe640 1 -- 172.21.15.105:0/514299033 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0340106c0 con 0x7fb0440b5210 2024-09-21T03:26:35.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.917+0000 7fb0490fa640 1 -- 172.21.15.105:0/514299033 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb044156d90 con 0x7fb0440b5210 2024-09-21T03:26:35.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.918+0000 7fb0490fa640 1 -- 172.21.15.105:0/514299033 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0440d1db0 con 0x7fb0440b5210 2024-09-21T03:26:35.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.918+0000 7fb03b7fe640 1 -- 172.21.15.105:0/514299033 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb03401a070 con 0x7fb0440b5210 2024-09-21T03:26:35.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.919+0000 7fb03b7fe640 1 --2- 172.21.15.105:0/514299033 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb024078b90 0x7fb02407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:35.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.919+0000 7fb03b7fe640 1 -- 172.21.15.105:0/514299033 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7fb03409ad90 con 0x7fb0440b5210 2024-09-21T03:26:35.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.919+0000 7fb03bfff640 1 --2- 172.21.15.105:0/514299033 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb024078b90 0x7fb02407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:35.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.920+0000 7fb03bfff640 1 --2- 172.21.15.105:0/514299033 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb024078b90 0x7fb02407b0a0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fb0440b1540 tx=0x7fb02c005ef0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:35.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:35.923+0000 7fb03b7fe640 1 -- 172.21.15.105:0/514299033 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb034062ca0 con 0x7fb0440b5210 2024-09-21T03:26:36.139 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.137+0000 7fb0490fa640 1 -- 172.21.15.105:0/514299033 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb0440b79c0 con 0x7fb0440b5210 2024-09-21T03:26:36.783 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.781+0000 7fb03b7fe640 1 -- 172.21.15.105:0/514299033 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v84) ==== 122+0+0 (secure 0 0 0) 0x7fb0340676d0 con 0x7fb0440b5210 2024-09-21T03:26:36.787 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.783+0000 7fb0490fa640 1 -- 172.21.15.105:0/514299033 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb024078b90 msgr2=0x7fb02407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:36.787 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.783+0000 7fb0490fa640 1 --2- 172.21.15.105:0/514299033 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb024078b90 0x7fb02407b0a0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fb0440b1540 tx=0x7fb02c005ef0 comp rx=0 tx=0).stop 2024-09-21T03:26:36.787 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.784+0000 7fb0490fa640 1 -- 172.21.15.105:0/514299033 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb0440b5210 msgr2=0x7fb0441f7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:36.787 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.784+0000 7fb0490fa640 1 --2- 172.21.15.105:0/514299033 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb0440b5210 0x7fb0441f7790 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fb03400d740 tx=0x7fb03400dc00 comp rx=0 tx=0).stop 2024-09-21T03:26:36.787 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.784+0000 7fb0490fa640 1 -- 172.21.15.105:0/514299033 shutdown_connections 2024-09-21T03:26:36.787 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.784+0000 7fb0490fa640 1 --2- 172.21.15.105:0/514299033 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb024078b90 0x7fb02407b0a0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:36.787 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.784+0000 7fb0490fa640 1 --2- 172.21.15.105:0/514299033 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb0440d2310 0x7fb0440b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:36.787 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.784+0000 7fb0490fa640 1 --2- 172.21.15.105:0/514299033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0440ccbe0 0x7fb0440b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:36.787 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.784+0000 7fb0490fa640 1 --2- 172.21.15.105:0/514299033 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb0440b5210 0x7fb0441f7790 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:36.787 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.784+0000 7fb0490fa640 1 -- 172.21.15.105:0/514299033 >> 172.21.15.105:0/514299033 conn(0x7fb0440b3f10 msgr2=0x7fb0440b1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:36.787 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.784+0000 7fb0490fa640 1 -- 172.21.15.105:0/514299033 shutdown_connections 2024-09-21T03:26:36.787 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.784+0000 7fb0490fa640 1 -- 172.21.15.105:0/514299033 wait complete. 2024-09-21T03:26:36.800 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T03:26:36.800 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:26:36.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.915+0000 7f27b4569640 1 -- 172.21.15.105:0/4263774475 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27ac0cfeb0 msgr2=0x7f27ac0d02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:36.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.915+0000 7f27b4569640 1 --2- 172.21.15.105:0/4263774475 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27ac0cfeb0 0x7f27ac0d02c0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f27ac15f310 tx=0x7f27a402aa30 comp rx=0 tx=0).stop 2024-09-21T03:26:36.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.915+0000 7f27b4569640 1 -- 172.21.15.105:0/4263774475 shutdown_connections 2024-09-21T03:26:36.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.915+0000 7f27b4569640 1 --2- 172.21.15.105:0/4263774475 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27ac0cfeb0 0x7f27ac0d02c0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:36.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.915+0000 7f27b4569640 1 --2- 172.21.15.105:0/4263774475 >> v2:172.21.15.162:3300/0 conn(0x7f27ac0705d0 0x7f27ac0b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:36.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.915+0000 7f27b4569640 1 -- 172.21.15.105:0/4263774475 >> 172.21.15.105:0/4263774475 conn(0x7f27ac0cdcc0 msgr2=0x7f27ac0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:36.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.915+0000 7f27b4569640 1 -- 172.21.15.105:0/4263774475 shutdown_connections 2024-09-21T03:26:36.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.915+0000 7f27b4569640 1 -- 172.21.15.105:0/4263774475 wait complete. 2024-09-21T03:26:36.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.917+0000 7f27b4569640 1 Processor -- start 2024-09-21T03:26:36.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.917+0000 7f27b4569640 1 -- start start 2024-09-21T03:26:36.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.918+0000 7f27b4569640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27ac0b4090 0x7f27ac15cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:36.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.918+0000 7f27b4569640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27ac0cfeb0 0x7f27ac1f5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:36.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.918+0000 7f27b4569640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27ac15d450 0x7f27ac1f5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:36.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.918+0000 7f27b4569640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f27ac0b4a30 con 0x7f27ac0b4090 2024-09-21T03:26:36.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.918+0000 7f27b4569640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f27ac0b48b0 con 0x7f27ac15d450 2024-09-21T03:26:36.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.918+0000 7f27b4569640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f27ac0b4bb0 con 0x7f27ac0cfeb0 2024-09-21T03:26:36.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.918+0000 7f27b2305640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27ac0b4090 0x7f27ac15cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:36.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.919+0000 7f27b2305640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27ac0b4090 0x7f27ac15cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41076/0 (socket says 172.21.15.105:41076) 2024-09-21T03:26:36.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.919+0000 7f27b2305640 1 -- 172.21.15.105:0/1846081078 learned_addr learned my addr 172.21.15.105:0/1846081078 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:36.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.919+0000 7f27b1b04640 1 --2- 172.21.15.105:0/1846081078 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27ac0cfeb0 0x7f27ac1f5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:36.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.919+0000 7f27b2b06640 1 --2- 172.21.15.105:0/1846081078 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27ac15d450 0x7f27ac1f5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:36.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.919+0000 7f27b2305640 1 -- 172.21.15.105:0/1846081078 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27ac0cfeb0 msgr2=0x7f27ac1f5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:36.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.919+0000 7f27b2305640 1 --2- 172.21.15.105:0/1846081078 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27ac0cfeb0 0x7f27ac1f5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:36.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.919+0000 7f27b2305640 1 -- 172.21.15.105:0/1846081078 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27ac15d450 msgr2=0x7f27ac1f5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:36.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.919+0000 7f27b2305640 1 --2- 172.21.15.105:0/1846081078 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27ac15d450 0x7f27ac1f5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:36.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.919+0000 7f27b2305640 1 -- 172.21.15.105:0/1846081078 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27ac0cb4b0 con 0x7f27ac0b4090 2024-09-21T03:26:36.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.919+0000 7f27b2b06640 1 --2- 172.21.15.105:0/1846081078 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27ac15d450 0x7f27ac1f5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:26:36.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.919+0000 7f27b2305640 1 --2- 172.21.15.105:0/1846081078 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27ac0b4090 0x7f27ac15cd30 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f27a800d9c0 tx=0x7f27a800de80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:36.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.919+0000 7f27a2ffd640 1 -- 172.21.15.105:0/1846081078 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a801b070 con 0x7f27ac0b4090 2024-09-21T03:26:36.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.919+0000 7f27a2ffd640 1 -- 172.21.15.105:0/1846081078 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f27a800ee30 con 0x7f27ac0b4090 2024-09-21T03:26:36.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.919+0000 7f27a2ffd640 1 -- 172.21.15.105:0/1846081078 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a8016680 con 0x7f27ac0b4090 2024-09-21T03:26:36.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.919+0000 7f27b4569640 1 -- 172.21.15.105:0/1846081078 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27ac1f6900 con 0x7f27ac0b4090 2024-09-21T03:26:36.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.919+0000 7f27b4569640 1 -- 172.21.15.105:0/1846081078 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27ac09ec90 con 0x7f27ac0b4090 2024-09-21T03:26:36.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.920+0000 7f27b4569640 1 -- 172.21.15.105:0/1846081078 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27ac0b50e0 con 0x7f27ac0b4090 2024-09-21T03:26:36.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.921+0000 7f27a2ffd640 1 -- 172.21.15.105:0/1846081078 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f27a801f3f0 con 0x7f27ac0b4090 2024-09-21T03:26:36.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.922+0000 7f27a2ffd640 1 --2- 172.21.15.105:0/1846081078 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2790078bc0 0x7f279007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:36.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.922+0000 7f27a2ffd640 1 -- 172.21.15.105:0/1846081078 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7f27a809c960 con 0x7f27ac0b4090 2024-09-21T03:26:36.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.922+0000 7f27b1b04640 1 --2- 172.21.15.105:0/1846081078 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2790078bc0 0x7f279007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:36.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.923+0000 7f27b1b04640 1 --2- 172.21.15.105:0/1846081078 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2790078bc0 0x7f279007b0d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f27ac0cb2a0 tx=0x7f279c009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:36.929 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:36.926+0000 7f27a2ffd640 1 -- 172.21.15.105:0/1846081078 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f27ac0cb4b0 con 0x7f27ac0b4090 2024-09-21T03:26:37.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.138+0000 7f27b4569640 1 -- 172.21.15.105:0/1846081078 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f27ac0b11c0 con 0x7f27ac0b4090 2024-09-21T03:26:37.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.138+0000 7f27a2ffd640 1 -- 172.21.15.105:0/1846081078 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) ==== 94+0+5233 (secure 0 0 0) 0x7f27a80647e0 con 0x7f27ac0b4090 2024-09-21T03:26:37.141 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:26:37.141 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":84,"btime":"2024-09-21T03:26:36:777245+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6494,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2298697835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2298697835},{"type":"v1","addr":"172.21.15.162:6836","nonce":2298697835}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":6500,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/680091076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":680091076},{"type":"v1","addr":"172.21.15.105:6835","nonce":680091076}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8013,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/4094879618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":4094879618},{"type":"v1","addr":"172.21.15.105:6833","nonce":4094879618}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:26:33.112228+0000","modified":"2024-09-21T03:26:36.139331+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8022},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8022":{"gid":8022,"name":"b","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6837/712373587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":712373587},{"type":"v1","addr":"172.21.15.162:6837","nonce":712373587}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8022,"qdb_cluster":[8022]},"id":10}]} 2024-09-21T03:26:37.141 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 84 2024-09-21T03:26:37.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.140+0000 7f27b4569640 1 -- 172.21.15.105:0/1846081078 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2790078bc0 msgr2=0x7f279007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:37.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.140+0000 7f27b4569640 1 --2- 172.21.15.105:0/1846081078 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2790078bc0 0x7f279007b0d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f27ac0cb2a0 tx=0x7f279c009060 comp rx=0 tx=0).stop 2024-09-21T03:26:37.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.140+0000 7f27b4569640 1 -- 172.21.15.105:0/1846081078 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27ac0b4090 msgr2=0x7f27ac15cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:37.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.140+0000 7f27b4569640 1 --2- 172.21.15.105:0/1846081078 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27ac0b4090 0x7f27ac15cd30 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f27a800d9c0 tx=0x7f27a800de80 comp rx=0 tx=0).stop 2024-09-21T03:26:37.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.140+0000 7f27b4569640 1 -- 172.21.15.105:0/1846081078 shutdown_connections 2024-09-21T03:26:37.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.140+0000 7f27b4569640 1 --2- 172.21.15.105:0/1846081078 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2790078bc0 0x7f279007b0d0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:37.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.140+0000 7f27b4569640 1 --2- 172.21.15.105:0/1846081078 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27ac15d450 0x7f27ac1f5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:37.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.140+0000 7f27b4569640 1 --2- 172.21.15.105:0/1846081078 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27ac0cfeb0 0x7f27ac1f5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:37.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.140+0000 7f27b4569640 1 --2- 172.21.15.105:0/1846081078 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27ac0b4090 0x7f27ac15cd30 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:37.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.140+0000 7f27b4569640 1 -- 172.21.15.105:0/1846081078 >> 172.21.15.105:0/1846081078 conn(0x7f27ac0cdcc0 msgr2=0x7f27ac15e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:37.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.140+0000 7f27b4569640 1 -- 172.21.15.105:0/1846081078 shutdown_connections 2024-09-21T03:26:37.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.140+0000 7f27b4569640 1 -- 172.21.15.105:0/1846081078 wait complete. 2024-09-21T03:26:37.155 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:26:37.267 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.264+0000 7f1208ded640 1 -- 172.21.15.105:0/2529947046 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11f0003a50 msgr2=0x7f11f0003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:37.267 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.264+0000 7f1208ded640 1 --2- 172.21.15.105:0/2529947046 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11f0003a50 0x7f11f0003ec0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f11f40016c0 tx=0x7f11f0005830 comp rx=0 tx=0).stop 2024-09-21T03:26:37.267 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.264+0000 7f1208ded640 1 -- 172.21.15.105:0/2529947046 shutdown_connections 2024-09-21T03:26:37.267 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.264+0000 7f1208ded640 1 --2- 172.21.15.105:0/2529947046 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11f0003a50 0x7f11f0003ec0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:37.268 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.264+0000 7f1208ded640 1 -- 172.21.15.105:0/2529947046 >> 172.21.15.105:0/2529947046 conn(0x7f12040cdcb0 msgr2=0x7f12040ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:37.268 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.264+0000 7f1208ded640 1 -- 172.21.15.105:0/2529947046 shutdown_connections 2024-09-21T03:26:37.268 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.264+0000 7f1208ded640 1 -- 172.21.15.105:0/2529947046 wait complete. 2024-09-21T03:26:37.269 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.266+0000 7f1208ded640 1 Processor -- start 2024-09-21T03:26:37.269 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.266+0000 7f1208ded640 1 -- start start 2024-09-21T03:26:37.272 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.268+0000 7f1208ded640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11f0003a50 0x7f12041555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:37.272 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.268+0000 7f1208ded640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12041577e0 0x7f1204157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:37.272 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.268+0000 7f1208ded640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12040b1c30 0x7f12040b2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:37.272 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.268+0000 7f1208ded640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f12040713d0 con 0x7f12040b1c30 2024-09-21T03:26:37.272 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.268+0000 7f1208ded640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1204071250 con 0x7f12041577e0 2024-09-21T03:26:37.272 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.268+0000 7f1208ded640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1204071550 con 0x7f11f0003a50 2024-09-21T03:26:37.272 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.268+0000 7f1202d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12040b1c30 0x7f12040b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:37.272 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.268+0000 7f1202d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12040b1c30 0x7f12040b2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41080/0 (socket says 172.21.15.105:41080) 2024-09-21T03:26:37.272 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.268+0000 7f1202d9d640 1 -- 172.21.15.105:0/3783734518 learned_addr learned my addr 172.21.15.105:0/3783734518 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:37.272 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.268+0000 7f120259c640 1 --2- 172.21.15.105:0/3783734518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11f0003a50 0x7f12041555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:37.272 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.268+0000 7f11f9d9b640 1 --2- 172.21.15.105:0/3783734518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12041577e0 0x7f1204157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:37.272 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.268+0000 7f1202d9d640 1 -- 172.21.15.105:0/3783734518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11f0003a50 msgr2=0x7f12041555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:37.273 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.268+0000 7f1202d9d640 1 --2- 172.21.15.105:0/3783734518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11f0003a50 0x7f12041555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:37.273 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.268+0000 7f1202d9d640 1 -- 172.21.15.105:0/3783734518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12041577e0 msgr2=0x7f1204157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:37.273 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.268+0000 7f1202d9d640 1 --2- 172.21.15.105:0/3783734518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12041577e0 0x7f1204157bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:37.273 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.268+0000 7f1202d9d640 1 -- 172.21.15.105:0/3783734518 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12041560f0 con 0x7f12040b1c30 2024-09-21T03:26:37.273 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.268+0000 7f1202d9d640 1 --2- 172.21.15.105:0/3783734518 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12040b1c30 0x7f12040b2040 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f11fc005fd0 tx=0x7f11fc004700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:37.273 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.268+0000 7f11fb7fe640 1 -- 172.21.15.105:0/3783734518 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11fc004b20 con 0x7f12040b1c30 2024-09-21T03:26:37.273 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.268+0000 7f11fb7fe640 1 -- 172.21.15.105:0/3783734518 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11fc004cc0 con 0x7f12040b1c30 2024-09-21T03:26:37.273 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.268+0000 7f1208ded640 1 -- 172.21.15.105:0/3783734518 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12041563d0 con 0x7f12040b1c30 2024-09-21T03:26:37.273 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.269+0000 7f11fb7fe640 1 -- 172.21.15.105:0/3783734518 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11fc010ce0 con 0x7f12040b1c30 2024-09-21T03:26:37.273 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.269+0000 7f1208ded640 1 -- 172.21.15.105:0/3783734518 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1204156990 con 0x7f12040b1c30 2024-09-21T03:26:37.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.269+0000 7f1208ded640 1 -- 172.21.15.105:0/3783734518 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f120406d060 con 0x7f12040b1c30 2024-09-21T03:26:37.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.270+0000 7f11fb7fe640 1 -- 172.21.15.105:0/3783734518 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f11fc01c020 con 0x7f12040b1c30 2024-09-21T03:26:37.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.271+0000 7f11fb7fe640 1 --2- 172.21.15.105:0/3783734518 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f11e4078b90 0x7f11e407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:37.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.271+0000 7f11fb7fe640 1 -- 172.21.15.105:0/3783734518 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7f11fc09b340 con 0x7f12040b1c30 2024-09-21T03:26:37.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.271+0000 7f120259c640 1 --2- 172.21.15.105:0/3783734518 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f11e4078b90 0x7f11e407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:37.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.272+0000 7f120259c640 1 --2- 172.21.15.105:0/3783734518 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f11e4078b90 0x7f11e407b0a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f11f4032000 tx=0x7f11f402c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:37.278 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.275+0000 7f11fb7fe640 1 -- 172.21.15.105:0/3783734518 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f11fc0631c0 con 0x7f12040b1c30 2024-09-21T03:26:37.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.454+0000 7f1208ded640 1 -- 172.21.15.105:0/3783734518 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f12040b4df0 con 0x7f12040b1c30 2024-09-21T03:26:37.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.455+0000 7f11fb7fe640 1 -- 172.21.15.105:0/3783734518 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) ==== 74+0+16811 (secure 0 0 0) 0x7f11fc067bf0 con 0x7f12040b1c30 2024-09-21T03:26:37.458 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:26:37.459 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":129,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:26:34.761871+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:26:30.757426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-21T03:26:32.079246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:26:37.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.458+0000 7f1208ded640 1 -- 172.21.15.105:0/3783734518 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f11e4078b90 msgr2=0x7f11e407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:37.461 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.458+0000 7f1208ded640 1 --2- 172.21.15.105:0/3783734518 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f11e4078b90 0x7f11e407b0a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f11f4032000 tx=0x7f11f402c040 comp rx=0 tx=0).stop 2024-09-21T03:26:37.461 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.458+0000 7f1208ded640 1 -- 172.21.15.105:0/3783734518 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12040b1c30 msgr2=0x7f12040b2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:37.461 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.458+0000 7f1208ded640 1 --2- 172.21.15.105:0/3783734518 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12040b1c30 0x7f12040b2040 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f11fc005fd0 tx=0x7f11fc004700 comp rx=0 tx=0).stop 2024-09-21T03:26:37.461 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.458+0000 7f1208ded640 1 -- 172.21.15.105:0/3783734518 shutdown_connections 2024-09-21T03:26:37.461 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.458+0000 7f1208ded640 1 --2- 172.21.15.105:0/3783734518 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f11e4078b90 0x7f11e407b0a0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:37.461 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.458+0000 7f1208ded640 1 --2- 172.21.15.105:0/3783734518 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12040b1c30 0x7f12040b2040 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:37.461 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.458+0000 7f1208ded640 1 --2- 172.21.15.105:0/3783734518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12041577e0 0x7f1204157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:37.461 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.458+0000 7f1208ded640 1 --2- 172.21.15.105:0/3783734518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11f0003a50 0x7f12041555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:37.461 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.458+0000 7f1208ded640 1 -- 172.21.15.105:0/3783734518 >> 172.21.15.105:0/3783734518 conn(0x7f12040cdcb0 msgr2=0x7f12040ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:37.461 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.458+0000 7f1208ded640 1 -- 172.21.15.105:0/3783734518 shutdown_connections 2024-09-21T03:26:37.461 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.458+0000 7f1208ded640 1 -- 172.21.15.105:0/3783734518 wait complete. 2024-09-21T03:26:37.472 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T03:26:37.472 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:26:37.583 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.581+0000 7f2c6095e640 1 -- 172.21.15.105:0/300193536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c5c072ff0 msgr2=0x7f2c5c073400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:37.584 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.581+0000 7f2c6095e640 1 --2- 172.21.15.105:0/300193536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c5c072ff0 0x7f2c5c073400 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f2c54005fd0 tx=0x7f2c5402aa90 comp rx=0 tx=0).stop 2024-09-21T03:26:37.584 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.581+0000 7f2c6095e640 1 -- 172.21.15.105:0/300193536 shutdown_connections 2024-09-21T03:26:37.584 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.581+0000 7f2c6095e640 1 --2- 172.21.15.105:0/300193536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c5c072ff0 0x7f2c5c073400 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:37.584 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.581+0000 7f2c6095e640 1 --2- 172.21.15.105:0/300193536 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c5c0af780 0x7f2c5c0b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:37.584 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.581+0000 7f2c6095e640 1 -- 172.21.15.105:0/300193536 >> 172.21.15.105:0/300193536 conn(0x7f2c5c06d7d0 msgr2=0x7f2c5c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:37.584 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.581+0000 7f2c6095e640 1 -- 172.21.15.105:0/300193536 shutdown_connections 2024-09-21T03:26:37.584 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.581+0000 7f2c6095e640 1 -- 172.21.15.105:0/300193536 wait complete. 2024-09-21T03:26:37.585 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.583+0000 7f2c6095e640 1 Processor -- start 2024-09-21T03:26:37.585 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.583+0000 7f2c6095e640 1 -- start start 2024-09-21T03:26:37.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.584+0000 7f2c6095e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c5c072ff0 0x7f2c5c1f3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:37.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.584+0000 7f2c6095e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c5c0af780 0x7f2c5c0ad810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:37.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.584+0000 7f2c6095e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c5c0cd3e0 0x7f2c5c15af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:37.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.584+0000 7f2c6095e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2c5c073d10 con 0x7f2c5c072ff0 2024-09-21T03:26:37.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.584+0000 7f2c6095e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2c5c073b90 con 0x7f2c5c0af780 2024-09-21T03:26:37.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.584+0000 7f2c6095e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2c5c15f930 con 0x7f2c5c0cd3e0 2024-09-21T03:26:37.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.584+0000 7f2c5a59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c5c072ff0 0x7f2c5c1f3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:37.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.584+0000 7f2c5a59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c5c072ff0 0x7f2c5c1f3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41096/0 (socket says 172.21.15.105:41096) 2024-09-21T03:26:37.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.584+0000 7f2c5a59c640 1 -- 172.21.15.105:0/4105283934 learned_addr learned my addr 172.21.15.105:0/4105283934 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:37.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.584+0000 7f2c51d9b640 1 --2- 172.21.15.105:0/4105283934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c5c0af780 0x7f2c5c0ad810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:37.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.584+0000 7f2c5ad9d640 1 --2- 172.21.15.105:0/4105283934 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c5c0cd3e0 0x7f2c5c15af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:37.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.584+0000 7f2c5a59c640 1 -- 172.21.15.105:0/4105283934 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c5c0cd3e0 msgr2=0x7f2c5c15af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:37.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.584+0000 7f2c5a59c640 1 --2- 172.21.15.105:0/4105283934 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c5c0cd3e0 0x7f2c5c15af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:37.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.584+0000 7f2c5a59c640 1 -- 172.21.15.105:0/4105283934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c5c0af780 msgr2=0x7f2c5c0ad810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:37.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.584+0000 7f2c5a59c640 1 --2- 172.21.15.105:0/4105283934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c5c0af780 0x7f2c5c0ad810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:37.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.585+0000 7f2c5a59c640 1 -- 172.21.15.105:0/4105283934 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c5c1f6f30 con 0x7f2c5c072ff0 2024-09-21T03:26:37.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.585+0000 7f2c5a59c640 1 --2- 172.21.15.105:0/4105283934 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c5c072ff0 0x7f2c5c1f3610 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00d6d0 tx=0x7f2c4c00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:37.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.585+0000 7f2c537fe640 1 -- 172.21.15.105:0/4105283934 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c017070 con 0x7f2c5c072ff0 2024-09-21T03:26:37.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.585+0000 7f2c537fe640 1 -- 172.21.15.105:0/4105283934 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c4c005330 con 0x7f2c5c072ff0 2024-09-21T03:26:37.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.585+0000 7f2c537fe640 1 -- 172.21.15.105:0/4105283934 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c009820 con 0x7f2c5c072ff0 2024-09-21T03:26:37.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.585+0000 7f2c6095e640 1 -- 172.21.15.105:0/4105283934 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c5c1f7210 con 0x7f2c5c072ff0 2024-09-21T03:26:37.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.585+0000 7f2c6095e640 1 -- 172.21.15.105:0/4105283934 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c5c1f77d0 con 0x7f2c5c072ff0 2024-09-21T03:26:37.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.586+0000 7f2c6095e640 1 -- 172.21.15.105:0/4105283934 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c5c073400 con 0x7f2c5c072ff0 2024-09-21T03:26:37.591 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.587+0000 7f2c537fe640 1 -- 172.21.15.105:0/4105283934 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2c4c0099c0 con 0x7f2c5c072ff0 2024-09-21T03:26:37.591 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.587+0000 7f2c537fe640 1 --2- 172.21.15.105:0/4105283934 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2c3c078bc0 0x7f2c3c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:37.591 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.587+0000 7f2c537fe640 1 -- 172.21.15.105:0/4105283934 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7f2c4c09adc0 con 0x7f2c5c072ff0 2024-09-21T03:26:37.591 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.587+0000 7f2c51d9b640 1 --2- 172.21.15.105:0/4105283934 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2c3c078bc0 0x7f2c3c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:37.591 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.588+0000 7f2c51d9b640 1 --2- 172.21.15.105:0/4105283934 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2c3c078bc0 0x7f2c3c07b0d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c06ff30 tx=0x7f2c44009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:37.594 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.591+0000 7f2c537fe640 1 -- 172.21.15.105:0/4105283934 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2c4c062b30 con 0x7f2c5c072ff0 2024-09-21T03:26:37.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.762+0000 7f2c6095e640 1 -- 172.21.15.105:0/4105283934 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2c5c0b0d10 con 0x7f2c3c078bc0 2024-09-21T03:26:37.769 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.767+0000 7f2c537fe640 1 -- 172.21.15.105:0/4105283934 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247546 (secure 0 0 0) 0x7f2c5c0b0d10 con 0x7f2c3c078bc0 2024-09-21T03:26:37.772 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:26:37.773 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:26:37.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.769+0000 7f2c6095e640 1 -- 172.21.15.105:0/4105283934 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2c3c078bc0 msgr2=0x7f2c3c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:37.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.769+0000 7f2c6095e640 1 --2- 172.21.15.105:0/4105283934 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2c3c078bc0 0x7f2c3c07b0d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c06ff30 tx=0x7f2c44009040 comp rx=0 tx=0).stop 2024-09-21T03:26:37.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.769+0000 7f2c6095e640 1 -- 172.21.15.105:0/4105283934 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c5c072ff0 msgr2=0x7f2c5c1f3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:37.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.769+0000 7f2c6095e640 1 --2- 172.21.15.105:0/4105283934 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c5c072ff0 0x7f2c5c1f3610 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00d6d0 tx=0x7f2c4c00db90 comp rx=0 tx=0).stop 2024-09-21T03:26:37.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.770+0000 7f2c6095e640 1 -- 172.21.15.105:0/4105283934 shutdown_connections 2024-09-21T03:26:37.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.770+0000 7f2c6095e640 1 --2- 172.21.15.105:0/4105283934 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2c3c078bc0 0x7f2c3c07b0d0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:37.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.770+0000 7f2c6095e640 1 --2- 172.21.15.105:0/4105283934 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c5c0cd3e0 0x7f2c5c15af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:37.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.770+0000 7f2c6095e640 1 --2- 172.21.15.105:0/4105283934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c5c0af780 0x7f2c5c0ad810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:37.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.770+0000 7f2c6095e640 1 --2- 172.21.15.105:0/4105283934 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c5c072ff0 0x7f2c5c1f3610 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:37.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.770+0000 7f2c6095e640 1 -- 172.21.15.105:0/4105283934 >> 172.21.15.105:0/4105283934 conn(0x7f2c5c06d7d0 msgr2=0x7f2c5c0cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:37.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.770+0000 7f2c6095e640 1 -- 172.21.15.105:0/4105283934 shutdown_connections 2024-09-21T03:26:37.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.770+0000 7f2c6095e640 1 -- 172.21.15.105:0/4105283934 wait complete. 2024-09-21T03:26:37.783 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":373,"stamp":"2024-09-21T03:26:37.411055+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":108,"num_write_kb":1631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":271432,"kb_used_data":13584,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754703288,"statfs":{"total":773094113280,"available":772816166912,"internally_reserved":0,"allocated":13910016,"data_stored":6612905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.669930"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.753441+0000","last_change":"2024-09-21T03:26:32.753441+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.753441+0000","last_undegraded":"2024-09-21T03:26:32.753441+0000","last_fullsized":"2024-09-21T03:26:32.753441+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749709+0000","last_change":"2024-09-21T03:26:32.749709+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749709+0000","last_undegraded":"2024-09-21T03:26:32.749709+0000","last_fullsized":"2024-09-21T03:26:32.749709+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751495+0000","last_change":"2024-09-21T03:26:32.751495+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751495+0000","last_undegraded":"2024-09-21T03:26:32.751495+0000","last_fullsized":"2024-09-21T03:26:32.751495+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.747033+0000","last_change":"2024-09-21T03:26:32.747033+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.747033+0000","last_undegraded":"2024-09-21T03:26:32.747033+0000","last_fullsized":"2024-09-21T03:26:32.747033+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.752535+0000","last_change":"2024-09-21T03:26:32.752535+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.752535+0000","last_undegraded":"2024-09-21T03:26:32.752535+0000","last_fullsized":"2024-09-21T03:26:32.752535+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.752456+0000","last_change":"2024-09-21T03:26:32.752456+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.752456+0000","last_undegraded":"2024-09-21T03:26:32.752456+0000","last_fullsized":"2024-09-21T03:26:32.752456+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.958840+0000","last_change":"2024-09-21T03:26:33.778224+0000","last_active":"2024-09-21T03:26:34.958840+0000","last_peered":"2024-09-21T03:26:34.958840+0000","last_clean":"2024-09-21T03:26:34.958840+0000","last_became_active":"2024-09-21T03:26:33.777885+0000","last_became_peered":"2024-09-21T03:26:33.777885+0000","last_unstale":"2024-09-21T03:26:34.958840+0000","last_undegraded":"2024-09-21T03:26:34.958840+0000","last_fullsized":"2024-09-21T03:26:34.958840+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:47.764557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751924+0000","last_change":"2024-09-21T03:26:32.751924+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751924+0000","last_undegraded":"2024-09-21T03:26:32.751924+0000","last_fullsized":"2024-09-21T03:26:32.751924+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.753085+0000","last_change":"2024-09-21T03:26:32.753085+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.753085+0000","last_undegraded":"2024-09-21T03:26:32.753085+0000","last_fullsized":"2024-09-21T03:26:32.753085+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.752886+0000","last_change":"2024-09-21T03:26:32.752886+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.752886+0000","last_undegraded":"2024-09-21T03:26:32.752886+0000","last_fullsized":"2024-09-21T03:26:32.752886+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751340+0000","last_change":"2024-09-21T03:26:32.751340+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751340+0000","last_undegraded":"2024-09-21T03:26:32.751340+0000","last_fullsized":"2024-09-21T03:26:32.751340+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751532+0000","last_change":"2024-09-21T03:26:32.751532+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751532+0000","last_undegraded":"2024-09-21T03:26:32.751532+0000","last_fullsized":"2024-09-21T03:26:32.751532+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.752050+0000","last_change":"2024-09-21T03:26:32.752050+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.752050+0000","last_undegraded":"2024-09-21T03:26:32.752050+0000","last_fullsized":"2024-09-21T03:26:32.752050+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.748249+0000","last_change":"2024-09-21T03:26:32.748249+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.748249+0000","last_undegraded":"2024-09-21T03:26:32.748249+0000","last_fullsized":"2024-09-21T03:26:32.748249+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.748727+0000","last_change":"2024-09-21T03:26:32.748727+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.748727+0000","last_undegraded":"2024-09-21T03:26:32.748727+0000","last_fullsized":"2024-09-21T03:26:32.748727+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750304+0000","last_change":"2024-09-21T03:26:32.750304+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750304+0000","last_undegraded":"2024-09-21T03:26:32.750304+0000","last_fullsized":"2024-09-21T03:26:32.750304+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749863+0000","last_change":"2024-09-21T03:26:32.749863+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749863+0000","last_undegraded":"2024-09-21T03:26:32.749863+0000","last_fullsized":"2024-09-21T03:26:32.749863+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751293+0000","last_change":"2024-09-21T03:26:32.751293+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751293+0000","last_undegraded":"2024-09-21T03:26:32.751293+0000","last_fullsized":"2024-09-21T03:26:32.751293+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750791+0000","last_change":"2024-09-21T03:26:32.750791+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750791+0000","last_undegraded":"2024-09-21T03:26:32.750791+0000","last_fullsized":"2024-09-21T03:26:32.750791+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749980+0000","last_change":"2024-09-21T03:26:32.749980+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749980+0000","last_undegraded":"2024-09-21T03:26:32.749980+0000","last_fullsized":"2024-09-21T03:26:32.749980+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749140+0000","last_change":"2024-09-21T03:26:32.749140+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749140+0000","last_undegraded":"2024-09-21T03:26:32.749140+0000","last_fullsized":"2024-09-21T03:26:32.749140+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.747627+0000","last_change":"2024-09-21T03:26:32.747627+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.747627+0000","last_undegraded":"2024-09-21T03:26:32.747627+0000","last_fullsized":"2024-09-21T03:26:32.747627+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.746033+0000","last_change":"2024-09-21T03:26:32.746033+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.746033+0000","last_undegraded":"2024-09-21T03:26:32.746033+0000","last_fullsized":"2024-09-21T03:26:32.746033+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750847+0000","last_change":"2024-09-21T03:26:32.750847+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750847+0000","last_undegraded":"2024-09-21T03:26:32.750847+0000","last_fullsized":"2024-09-21T03:26:32.750847+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751882+0000","last_change":"2024-09-21T03:26:32.751882+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751882+0000","last_undegraded":"2024-09-21T03:26:32.751882+0000","last_fullsized":"2024-09-21T03:26:32.751882+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750209+0000","last_change":"2024-09-21T03:26:32.750209+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750209+0000","last_undegraded":"2024-09-21T03:26:32.750209+0000","last_fullsized":"2024-09-21T03:26:32.750209+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.754270+0000","last_change":"2024-09-21T03:26:32.754270+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.754270+0000","last_undegraded":"2024-09-21T03:26:32.754270+0000","last_fullsized":"2024-09-21T03:26:32.754270+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959021+0000","last_change":"2024-09-21T03:26:33.768428+0000","last_active":"2024-09-21T03:26:34.959021+0000","last_peered":"2024-09-21T03:26:34.959021+0000","last_clean":"2024-09-21T03:26:34.959021+0000","last_became_active":"2024-09-21T03:26:33.768104+0000","last_became_peered":"2024-09-21T03:26:33.768104+0000","last_unstale":"2024-09-21T03:26:34.959021+0000","last_undegraded":"2024-09-21T03:26:34.959021+0000","last_fullsized":"2024-09-21T03:26:34.959021+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:09.772044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750908+0000","last_change":"2024-09-21T03:26:32.750908+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750908+0000","last_undegraded":"2024-09-21T03:26:32.750908+0000","last_fullsized":"2024-09-21T03:26:32.750908+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.747099+0000","last_change":"2024-09-21T03:26:32.747099+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.747099+0000","last_undegraded":"2024-09-21T03:26:32.747099+0000","last_fullsized":"2024-09-21T03:26:32.747099+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749457+0000","last_change":"2024-09-21T03:26:32.749457+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749457+0000","last_undegraded":"2024-09-21T03:26:32.749457+0000","last_fullsized":"2024-09-21T03:26:32.749457+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749762+0000","last_change":"2024-09-21T03:26:32.749762+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749762+0000","last_undegraded":"2024-09-21T03:26:32.749762+0000","last_fullsized":"2024-09-21T03:26:32.749762+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750324+0000","last_change":"2024-09-21T03:26:32.750324+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750324+0000","last_undegraded":"2024-09-21T03:26:32.750324+0000","last_fullsized":"2024-09-21T03:26:32.750324+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.769210+0000","last_change":"2024-09-21T03:26:32.765626+0000","last_active":"2024-09-21T03:26:32.769210+0000","last_peered":"2024-09-21T03:26:32.769210+0000","last_clean":"2024-09-21T03:26:32.769210+0000","last_became_active":"2024-09-21T03:26:32.764896+0000","last_became_peered":"2024-09-21T03:26:32.764896+0000","last_unstale":"2024-09-21T03:26:32.769210+0000","last_undegraded":"2024-09-21T03:26:32.769210+0000","last_fullsized":"2024-09-21T03:26:32.769210+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:19:34.668326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.752601+0000","last_change":"2024-09-21T03:26:32.752601+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.752601+0000","last_undegraded":"2024-09-21T03:26:32.752601+0000","last_fullsized":"2024-09-21T03:26:32.752601+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.765917+0000","last_change":"2024-09-21T03:26:32.763786+0000","last_active":"2024-09-21T03:26:32.765917+0000","last_peered":"2024-09-21T03:26:32.765917+0000","last_clean":"2024-09-21T03:26:32.765917+0000","last_became_active":"2024-09-21T03:26:32.763296+0000","last_became_peered":"2024-09-21T03:26:32.763296+0000","last_unstale":"2024-09-21T03:26:32.765917+0000","last_undegraded":"2024-09-21T03:26:32.765917+0000","last_fullsized":"2024-09-21T03:26:32.765917+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:43.499221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749686+0000","last_change":"2024-09-21T03:26:32.749686+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749686+0000","last_undegraded":"2024-09-21T03:26:32.749686+0000","last_fullsized":"2024-09-21T03:26:32.749686+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.762230+0000","last_change":"2024-09-21T03:26:32.760363+0000","last_active":"2024-09-21T03:26:32.762230+0000","last_peered":"2024-09-21T03:26:32.762230+0000","last_clean":"2024-09-21T03:26:32.762230+0000","last_became_active":"2024-09-21T03:26:32.760059+0000","last_became_peered":"2024-09-21T03:26:32.760059+0000","last_unstale":"2024-09-21T03:26:32.762230+0000","last_undegraded":"2024-09-21T03:26:32.762230+0000","last_fullsized":"2024-09-21T03:26:32.762230+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:44:38.489230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749592+0000","last_change":"2024-09-21T03:26:32.749592+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749592+0000","last_undegraded":"2024-09-21T03:26:32.749592+0000","last_fullsized":"2024-09-21T03:26:32.749592+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.754950+0000","last_change":"2024-09-21T03:26:32.754258+0000","last_active":"2024-09-21T03:26:32.754950+0000","last_peered":"2024-09-21T03:26:32.754950+0000","last_clean":"2024-09-21T03:26:32.754950+0000","last_became_active":"2024-09-21T03:26:32.753929+0000","last_became_peered":"2024-09-21T03:26:32.753929+0000","last_unstale":"2024-09-21T03:26:32.754950+0000","last_undegraded":"2024-09-21T03:26:32.754950+0000","last_fullsized":"2024-09-21T03:26:32.754950+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:39.364503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750511+0000","last_change":"2024-09-21T03:26:32.750511+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750511+0000","last_undegraded":"2024-09-21T03:26:32.750511+0000","last_fullsized":"2024-09-21T03:26:32.750511+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.767740+0000","last_change":"2024-09-21T03:26:32.765736+0000","last_active":"2024-09-21T03:26:32.767740+0000","last_peered":"2024-09-21T03:26:32.767740+0000","last_clean":"2024-09-21T03:26:32.767740+0000","last_became_active":"2024-09-21T03:26:32.765227+0000","last_became_peered":"2024-09-21T03:26:32.765227+0000","last_unstale":"2024-09-21T03:26:32.767740+0000","last_undegraded":"2024-09-21T03:26:32.767740+0000","last_fullsized":"2024-09-21T03:26:32.767740+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:15.751411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.747045+0000","last_change":"2024-09-21T03:26:32.747045+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.747045+0000","last_undegraded":"2024-09-21T03:26:32.747045+0000","last_fullsized":"2024-09-21T03:26:32.747045+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.769146+0000","last_change":"2024-09-21T03:26:32.765921+0000","last_active":"2024-09-21T03:26:32.769146+0000","last_peered":"2024-09-21T03:26:32.769146+0000","last_clean":"2024-09-21T03:26:32.769146+0000","last_became_active":"2024-09-21T03:26:32.765525+0000","last_became_peered":"2024-09-21T03:26:32.765525+0000","last_unstale":"2024-09-21T03:26:32.769146+0000","last_undegraded":"2024-09-21T03:26:32.769146+0000","last_fullsized":"2024-09-21T03:26:32.769146+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:28.033917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750553+0000","last_change":"2024-09-21T03:26:32.750553+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750553+0000","last_undegraded":"2024-09-21T03:26:32.750553+0000","last_fullsized":"2024-09-21T03:26:32.750553+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.765567+0000","last_change":"2024-09-21T03:26:32.763337+0000","last_active":"2024-09-21T03:26:32.765567+0000","last_peered":"2024-09-21T03:26:32.765567+0000","last_clean":"2024-09-21T03:26:32.765567+0000","last_became_active":"2024-09-21T03:26:32.763033+0000","last_became_peered":"2024-09-21T03:26:32.763033+0000","last_unstale":"2024-09-21T03:26:32.765567+0000","last_undegraded":"2024-09-21T03:26:32.765567+0000","last_fullsized":"2024-09-21T03:26:32.765567+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:39.782991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750673+0000","last_change":"2024-09-21T03:26:32.750673+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750673+0000","last_undegraded":"2024-09-21T03:26:32.750673+0000","last_fullsized":"2024-09-21T03:26:32.750673+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.760991+0000","last_change":"2024-09-21T03:26:32.758610+0000","last_active":"2024-09-21T03:26:32.760991+0000","last_peered":"2024-09-21T03:26:32.760991+0000","last_clean":"2024-09-21T03:26:32.760991+0000","last_became_active":"2024-09-21T03:26:32.758254+0000","last_became_peered":"2024-09-21T03:26:32.758254+0000","last_unstale":"2024-09-21T03:26:32.760991+0000","last_undegraded":"2024-09-21T03:26:32.760991+0000","last_fullsized":"2024-09-21T03:26:32.760991+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:21.051537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.752545+0000","last_change":"2024-09-21T03:26:32.752545+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.752545+0000","last_undegraded":"2024-09-21T03:26:32.752545+0000","last_fullsized":"2024-09-21T03:26:32.752545+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.765878+0000","last_change":"2024-09-21T03:26:32.763498+0000","last_active":"2024-09-21T03:26:32.765878+0000","last_peered":"2024-09-21T03:26:32.765878+0000","last_clean":"2024-09-21T03:26:32.765878+0000","last_became_active":"2024-09-21T03:26:32.763195+0000","last_became_peered":"2024-09-21T03:26:32.763195+0000","last_unstale":"2024-09-21T03:26:32.765878+0000","last_undegraded":"2024-09-21T03:26:32.765878+0000","last_fullsized":"2024-09-21T03:26:32.765878+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:42.291015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749304+0000","last_change":"2024-09-21T03:26:32.749304+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749304+0000","last_undegraded":"2024-09-21T03:26:32.749304+0000","last_fullsized":"2024-09-21T03:26:32.749304+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.765017+0000","last_change":"2024-09-21T03:26:32.763210+0000","last_active":"2024-09-21T03:26:32.765017+0000","last_peered":"2024-09-21T03:26:32.765017+0000","last_clean":"2024-09-21T03:26:32.765017+0000","last_became_active":"2024-09-21T03:26:32.762766+0000","last_became_peered":"2024-09-21T03:26:32.762766+0000","last_unstale":"2024-09-21T03:26:32.765017+0000","last_undegraded":"2024-09-21T03:26:32.765017+0000","last_fullsized":"2024-09-21T03:26:32.765017+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:42.291015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.753733+0000","last_change":"2024-09-21T03:26:32.753733+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.753733+0000","last_undegraded":"2024-09-21T03:26:32.753733+0000","last_fullsized":"2024-09-21T03:26:32.753733+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"128'6","reported_seq":21,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959389+0000","last_change":"2024-09-21T03:26:32.759495+0000","last_active":"2024-09-21T03:26:34.959389+0000","last_peered":"2024-09-21T03:26:34.959389+0000","last_clean":"2024-09-21T03:26:34.959389+0000","last_became_active":"2024-09-21T03:26:32.759122+0000","last_became_peered":"2024-09-21T03:26:32.759122+0000","last_unstale":"2024-09-21T03:26:34.959389+0000","last_undegraded":"2024-09-21T03:26:34.959389+0000","last_fullsized":"2024-09-21T03:26:34.959389+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:20.416584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750961+0000","last_change":"2024-09-21T03:26:32.750961+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750961+0000","last_undegraded":"2024-09-21T03:26:32.750961+0000","last_fullsized":"2024-09-21T03:26:32.750961+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.763828+0000","last_change":"2024-09-21T03:26:32.760470+0000","last_active":"2024-09-21T03:26:32.763828+0000","last_peered":"2024-09-21T03:26:32.763828+0000","last_clean":"2024-09-21T03:26:32.763828+0000","last_became_active":"2024-09-21T03:26:32.760171+0000","last_became_peered":"2024-09-21T03:26:32.760171+0000","last_unstale":"2024-09-21T03:26:32.763828+0000","last_undegraded":"2024-09-21T03:26:32.763828+0000","last_fullsized":"2024-09-21T03:26:32.763828+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:39.364503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749138+0000","last_change":"2024-09-21T03:26:32.749138+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749138+0000","last_undegraded":"2024-09-21T03:26:32.749138+0000","last_fullsized":"2024-09-21T03:26:32.749138+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.764078+0000","last_change":"2024-09-21T03:26:32.762314+0000","last_active":"2024-09-21T03:26:32.764078+0000","last_peered":"2024-09-21T03:26:32.764078+0000","last_clean":"2024-09-21T03:26:32.764078+0000","last_became_active":"2024-09-21T03:26:32.762003+0000","last_became_peered":"2024-09-21T03:26:32.762003+0000","last_unstale":"2024-09-21T03:26:32.764078+0000","last_undegraded":"2024-09-21T03:26:32.764078+0000","last_fullsized":"2024-09-21T03:26:32.764078+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:21.051537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750769+0000","last_change":"2024-09-21T03:26:32.750769+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750769+0000","last_undegraded":"2024-09-21T03:26:32.750769+0000","last_fullsized":"2024-09-21T03:26:32.750769+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.763283+0000","last_change":"2024-09-21T03:26:32.756831+0000","last_active":"2024-09-21T03:26:32.763283+0000","last_peered":"2024-09-21T03:26:32.763283+0000","last_clean":"2024-09-21T03:26:32.763283+0000","last_became_active":"2024-09-21T03:26:32.756494+0000","last_became_peered":"2024-09-21T03:26:32.756494+0000","last_unstale":"2024-09-21T03:26:32.763283+0000","last_undegraded":"2024-09-21T03:26:32.763283+0000","last_fullsized":"2024-09-21T03:26:32.763283+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:14.393309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749907+0000","last_change":"2024-09-21T03:26:32.749907+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749907+0000","last_undegraded":"2024-09-21T03:26:32.749907+0000","last_fullsized":"2024-09-21T03:26:32.749907+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.766637+0000","last_change":"2024-09-21T03:26:32.764507+0000","last_active":"2024-09-21T03:26:32.766637+0000","last_peered":"2024-09-21T03:26:32.766637+0000","last_clean":"2024-09-21T03:26:32.766637+0000","last_became_active":"2024-09-21T03:26:32.764170+0000","last_became_peered":"2024-09-21T03:26:32.764170+0000","last_unstale":"2024-09-21T03:26:32.766637+0000","last_undegraded":"2024-09-21T03:26:32.766637+0000","last_fullsized":"2024-09-21T03:26:32.766637+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:29.112426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749546+0000","last_change":"2024-09-21T03:26:32.749546+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749546+0000","last_undegraded":"2024-09-21T03:26:32.749546+0000","last_fullsized":"2024-09-21T03:26:32.749546+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.762427+0000","last_change":"2024-09-21T03:26:32.761374+0000","last_active":"2024-09-21T03:26:32.762427+0000","last_peered":"2024-09-21T03:26:32.762427+0000","last_clean":"2024-09-21T03:26:32.762427+0000","last_became_active":"2024-09-21T03:26:32.761046+0000","last_became_peered":"2024-09-21T03:26:32.761046+0000","last_unstale":"2024-09-21T03:26:32.762427+0000","last_undegraded":"2024-09-21T03:26:32.762427+0000","last_fullsized":"2024-09-21T03:26:32.762427+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:29:36.028915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751405+0000","last_change":"2024-09-21T03:26:32.751405+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751405+0000","last_undegraded":"2024-09-21T03:26:32.751405+0000","last_fullsized":"2024-09-21T03:26:32.751405+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.766127+0000","last_change":"2024-09-21T03:26:32.765118+0000","last_active":"2024-09-21T03:26:32.766127+0000","last_peered":"2024-09-21T03:26:32.766127+0000","last_clean":"2024-09-21T03:26:32.766127+0000","last_became_active":"2024-09-21T03:26:32.764807+0000","last_became_peered":"2024-09-21T03:26:32.764807+0000","last_unstale":"2024-09-21T03:26:32.766127+0000","last_undegraded":"2024-09-21T03:26:32.766127+0000","last_fullsized":"2024-09-21T03:26:32.766127+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:38:44.642701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751162+0000","last_change":"2024-09-21T03:26:32.751162+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751162+0000","last_undegraded":"2024-09-21T03:26:32.751162+0000","last_fullsized":"2024-09-21T03:26:32.751162+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.767748+0000","last_change":"2024-09-21T03:26:32.766023+0000","last_active":"2024-09-21T03:26:32.767748+0000","last_peered":"2024-09-21T03:26:32.767748+0000","last_clean":"2024-09-21T03:26:32.767748+0000","last_became_active":"2024-09-21T03:26:32.765690+0000","last_became_peered":"2024-09-21T03:26:32.765690+0000","last_unstale":"2024-09-21T03:26:32.767748+0000","last_undegraded":"2024-09-21T03:26:32.767748+0000","last_fullsized":"2024-09-21T03:26:32.767748+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:07:37.086442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749087+0000","last_change":"2024-09-21T03:26:32.749087+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749087+0000","last_undegraded":"2024-09-21T03:26:32.749087+0000","last_fullsized":"2024-09-21T03:26:32.749087+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.765989+0000","last_change":"2024-09-21T03:26:32.761613+0000","last_active":"2024-09-21T03:26:32.765989+0000","last_peered":"2024-09-21T03:26:32.765989+0000","last_clean":"2024-09-21T03:26:32.765989+0000","last_became_active":"2024-09-21T03:26:32.761327+0000","last_became_peered":"2024-09-21T03:26:32.761327+0000","last_unstale":"2024-09-21T03:26:32.765989+0000","last_undegraded":"2024-09-21T03:26:32.765989+0000","last_fullsized":"2024-09-21T03:26:32.765989+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:43:56.089219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.746196+0000","last_change":"2024-09-21T03:26:32.746196+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.746196+0000","last_undegraded":"2024-09-21T03:26:32.746196+0000","last_fullsized":"2024-09-21T03:26:32.746196+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"128'2","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959425+0000","last_change":"2024-09-21T03:26:32.764098+0000","last_active":"2024-09-21T03:26:34.959425+0000","last_peered":"2024-09-21T03:26:34.959425+0000","last_clean":"2024-09-21T03:26:34.959425+0000","last_became_active":"2024-09-21T03:26:32.763369+0000","last_became_peered":"2024-09-21T03:26:32.763369+0000","last_unstale":"2024-09-21T03:26:34.959425+0000","last_undegraded":"2024-09-21T03:26:34.959425+0000","last_fullsized":"2024-09-21T03:26:34.959425+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:55.678113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959291+0000","last_change":"2024-09-21T03:26:33.778124+0000","last_active":"2024-09-21T03:26:34.959291+0000","last_peered":"2024-09-21T03:26:34.959291+0000","last_clean":"2024-09-21T03:26:34.959291+0000","last_became_active":"2024-09-21T03:26:33.777780+0000","last_became_peered":"2024-09-21T03:26:33.777780+0000","last_unstale":"2024-09-21T03:26:34.959291+0000","last_undegraded":"2024-09-21T03:26:34.959291+0000","last_fullsized":"2024-09-21T03:26:34.959291+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:20.865258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.766725+0000","last_change":"2024-09-21T03:26:32.764723+0000","last_active":"2024-09-21T03:26:32.766725+0000","last_peered":"2024-09-21T03:26:32.766725+0000","last_clean":"2024-09-21T03:26:32.766725+0000","last_became_active":"2024-09-21T03:26:32.764235+0000","last_became_peered":"2024-09-21T03:26:32.764235+0000","last_unstale":"2024-09-21T03:26:32.766725+0000","last_undegraded":"2024-09-21T03:26:32.766725+0000","last_fullsized":"2024-09-21T03:26:32.766725+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:43.499221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.746748+0000","last_change":"2024-09-21T03:26:32.746748+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.746748+0000","last_undegraded":"2024-09-21T03:26:32.746748+0000","last_fullsized":"2024-09-21T03:26:32.746748+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.771880+0000","last_change":"2024-09-21T03:26:32.767045+0000","last_active":"2024-09-21T03:26:32.771880+0000","last_peered":"2024-09-21T03:26:32.771880+0000","last_clean":"2024-09-21T03:26:32.771880+0000","last_became_active":"2024-09-21T03:26:32.766543+0000","last_became_peered":"2024-09-21T03:26:32.766543+0000","last_unstale":"2024-09-21T03:26:32.771880+0000","last_undegraded":"2024-09-21T03:26:32.771880+0000","last_fullsized":"2024-09-21T03:26:32.771880+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:37.061012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.958608+0000","last_change":"2024-09-21T03:26:33.778377+0000","last_active":"2024-09-21T03:26:34.958608+0000","last_peered":"2024-09-21T03:26:34.958608+0000","last_clean":"2024-09-21T03:26:34.958608+0000","last_became_active":"2024-09-21T03:26:33.778077+0000","last_became_peered":"2024-09-21T03:26:33.778077+0000","last_unstale":"2024-09-21T03:26:34.958608+0000","last_undegraded":"2024-09-21T03:26:34.958608+0000","last_fullsized":"2024-09-21T03:26:34.958608+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:22.283748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.764892+0000","last_change":"2024-09-21T03:26:32.763204+0000","last_active":"2024-09-21T03:26:32.764892+0000","last_peered":"2024-09-21T03:26:32.764892+0000","last_clean":"2024-09-21T03:26:32.764892+0000","last_became_active":"2024-09-21T03:26:32.762314+0000","last_became_peered":"2024-09-21T03:26:32.762314+0000","last_unstale":"2024-09-21T03:26:32.764892+0000","last_undegraded":"2024-09-21T03:26:32.764892+0000","last_fullsized":"2024-09-21T03:26:32.764892+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:44:38.489230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751643+0000","last_change":"2024-09-21T03:26:32.751643+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751643+0000","last_undegraded":"2024-09-21T03:26:32.751643+0000","last_fullsized":"2024-09-21T03:26:32.751643+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.764979+0000","last_change":"2024-09-21T03:26:32.763095+0000","last_active":"2024-09-21T03:26:32.764979+0000","last_peered":"2024-09-21T03:26:32.764979+0000","last_clean":"2024-09-21T03:26:32.764979+0000","last_became_active":"2024-09-21T03:26:32.762758+0000","last_became_peered":"2024-09-21T03:26:32.762758+0000","last_unstale":"2024-09-21T03:26:32.764979+0000","last_undegraded":"2024-09-21T03:26:32.764979+0000","last_fullsized":"2024-09-21T03:26:32.764979+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:43.159607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.752344+0000","last_change":"2024-09-21T03:26:32.752344+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.752344+0000","last_undegraded":"2024-09-21T03:26:32.752344+0000","last_fullsized":"2024-09-21T03:26:32.752344+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.753832+0000","last_change":"2024-09-21T03:26:32.752528+0000","last_active":"2024-09-21T03:26:32.753832+0000","last_peered":"2024-09-21T03:26:32.753832+0000","last_clean":"2024-09-21T03:26:32.753832+0000","last_became_active":"2024-09-21T03:26:32.752205+0000","last_became_peered":"2024-09-21T03:26:32.752205+0000","last_unstale":"2024-09-21T03:26:32.753832+0000","last_undegraded":"2024-09-21T03:26:32.753832+0000","last_fullsized":"2024-09-21T03:26:32.753832+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:27.024217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751797+0000","last_change":"2024-09-21T03:26:32.751797+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751797+0000","last_undegraded":"2024-09-21T03:26:32.751797+0000","last_fullsized":"2024-09-21T03:26:32.751797+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.762171+0000","last_change":"2024-09-21T03:26:32.758409+0000","last_active":"2024-09-21T03:26:32.762171+0000","last_peered":"2024-09-21T03:26:32.762171+0000","last_clean":"2024-09-21T03:26:32.762171+0000","last_became_active":"2024-09-21T03:26:32.758112+0000","last_became_peered":"2024-09-21T03:26:32.758112+0000","last_unstale":"2024-09-21T03:26:32.762171+0000","last_undegraded":"2024-09-21T03:26:32.762171+0000","last_fullsized":"2024-09-21T03:26:32.762171+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:08:21.928238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.748534+0000","last_change":"2024-09-21T03:26:32.748534+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.748534+0000","last_undegraded":"2024-09-21T03:26:32.748534+0000","last_fullsized":"2024-09-21T03:26:32.748534+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.764765+0000","last_change":"2024-09-21T03:26:32.761270+0000","last_active":"2024-09-21T03:26:32.764765+0000","last_peered":"2024-09-21T03:26:32.764765+0000","last_clean":"2024-09-21T03:26:32.764765+0000","last_became_active":"2024-09-21T03:26:32.760986+0000","last_became_peered":"2024-09-21T03:26:32.760986+0000","last_unstale":"2024-09-21T03:26:32.764765+0000","last_undegraded":"2024-09-21T03:26:32.764765+0000","last_fullsized":"2024-09-21T03:26:32.764765+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:04.235753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.753998+0000","last_change":"2024-09-21T03:26:32.753998+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.753998+0000","last_undegraded":"2024-09-21T03:26:32.753998+0000","last_fullsized":"2024-09-21T03:26:32.753998+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959509+0000","last_change":"2024-09-21T03:26:32.763753+0000","last_active":"2024-09-21T03:26:34.959509+0000","last_peered":"2024-09-21T03:26:34.959509+0000","last_clean":"2024-09-21T03:26:34.959509+0000","last_became_active":"2024-09-21T03:26:32.762836+0000","last_became_peered":"2024-09-21T03:26:32.762836+0000","last_unstale":"2024-09-21T03:26:34.959509+0000","last_undegraded":"2024-09-21T03:26:34.959509+0000","last_fullsized":"2024-09-21T03:26:34.959509+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:51.853935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751544+0000","last_change":"2024-09-21T03:26:32.751544+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751544+0000","last_undegraded":"2024-09-21T03:26:32.751544+0000","last_fullsized":"2024-09-21T03:26:32.751544+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.769158+0000","last_change":"2024-09-21T03:26:32.764798+0000","last_active":"2024-09-21T03:26:32.769158+0000","last_peered":"2024-09-21T03:26:32.769158+0000","last_clean":"2024-09-21T03:26:32.769158+0000","last_became_active":"2024-09-21T03:26:32.764469+0000","last_became_peered":"2024-09-21T03:26:32.764469+0000","last_unstale":"2024-09-21T03:26:32.769158+0000","last_undegraded":"2024-09-21T03:26:32.769158+0000","last_fullsized":"2024-09-21T03:26:32.769158+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:38:44.642701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750392+0000","last_change":"2024-09-21T03:26:32.750392+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750392+0000","last_undegraded":"2024-09-21T03:26:32.750392+0000","last_fullsized":"2024-09-21T03:26:32.750392+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.761576+0000","last_change":"2024-09-21T03:26:32.757614+0000","last_active":"2024-09-21T03:26:32.761576+0000","last_peered":"2024-09-21T03:26:32.761576+0000","last_clean":"2024-09-21T03:26:32.761576+0000","last_became_active":"2024-09-21T03:26:32.757332+0000","last_became_peered":"2024-09-21T03:26:32.757332+0000","last_unstale":"2024-09-21T03:26:32.761576+0000","last_undegraded":"2024-09-21T03:26:32.761576+0000","last_fullsized":"2024-09-21T03:26:32.761576+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:01:59.982817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750113+0000","last_change":"2024-09-21T03:26:32.750113+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750113+0000","last_undegraded":"2024-09-21T03:26:32.750113+0000","last_fullsized":"2024-09-21T03:26:32.750113+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.765761+0000","last_change":"2024-09-21T03:26:32.762505+0000","last_active":"2024-09-21T03:26:32.765761+0000","last_peered":"2024-09-21T03:26:32.765761+0000","last_clean":"2024-09-21T03:26:32.765761+0000","last_became_active":"2024-09-21T03:26:32.762188+0000","last_became_peered":"2024-09-21T03:26:32.762188+0000","last_unstale":"2024-09-21T03:26:32.765761+0000","last_undegraded":"2024-09-21T03:26:32.765761+0000","last_fullsized":"2024-09-21T03:26:32.765761+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:43.159607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959254+0000","last_change":"2024-09-21T03:26:33.778553+0000","last_active":"2024-09-21T03:26:34.959254+0000","last_peered":"2024-09-21T03:26:34.959254+0000","last_clean":"2024-09-21T03:26:34.959254+0000","last_became_active":"2024-09-21T03:26:33.777840+0000","last_became_peered":"2024-09-21T03:26:33.777840+0000","last_unstale":"2024-09-21T03:26:34.959254+0000","last_undegraded":"2024-09-21T03:26:34.959254+0000","last_fullsized":"2024-09-21T03:26:34.959254+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:54.479070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.769337+0000","last_change":"2024-09-21T03:26:32.767343+0000","last_active":"2024-09-21T03:26:32.769337+0000","last_peered":"2024-09-21T03:26:32.769337+0000","last_clean":"2024-09-21T03:26:32.769337+0000","last_became_active":"2024-09-21T03:26:32.767009+0000","last_became_peered":"2024-09-21T03:26:32.767009+0000","last_unstale":"2024-09-21T03:26:32.769337+0000","last_undegraded":"2024-09-21T03:26:32.769337+0000","last_fullsized":"2024-09-21T03:26:32.769337+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:15.581950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":309,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.753238+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:26:32.753238+0000","last_peered":"2024-09-21T03:26:32.753238+0000","last_clean":"2024-09-21T03:26:32.753238+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:26:32.753238+0000","last_undegraded":"2024-09-21T03:26:32.753238+0000","last_fullsized":"2024-09-21T03:26:32.753238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509544,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33320,"kb_used_data":2128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338520,"statfs":{"total":96636764160,"available":96602644480,"internally_reserved":0,"allocated":2179072,"data_stored":1267549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509543,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32736,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339104,"statfs":{"total":96636764160,"available":96603242496,"internally_reserved":0,"allocated":1585152,"data_stored":677181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509542,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32740,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339100,"statfs":{"total":96636764160,"available":96603238400,"internally_reserved":0,"allocated":1585152,"data_stored":677181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509542,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32736,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339104,"statfs":{"total":96636764160,"available":96603242496,"internally_reserved":0,"allocated":1585152,"data_stored":677181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509543,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32740,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339100,"statfs":{"total":96636764160,"available":96603238400,"internally_reserved":0,"allocated":1585152,"data_stored":677181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509543,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36900,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334940,"statfs":{"total":96636764160,"available":96598978560,"internally_reserved":0,"allocated":1585152,"data_stored":677181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509543,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36900,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334940,"statfs":{"total":96636764160,"available":96598978560,"internally_reserved":0,"allocated":1585152,"data_stored":677181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574951,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33360,"kb_used_data":2168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338480,"statfs":{"total":96636764160,"available":96602603520,"internally_reserved":0,"allocated":2220032,"data_stored":1282270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:26:37.788 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:26:37.936 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.933+0000 7f7e38ccc640 1 -- 172.21.15.105:0/2059243977 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e340d12c0 msgr2=0x7f7e340d16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:37.936 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.933+0000 7f7e38ccc640 1 --2- 172.21.15.105:0/2059243977 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e340d12c0 0x7f7e340d16d0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c005fd0 tx=0x7f7e2c02a5d0 comp rx=0 tx=0).stop 2024-09-21T03:26:37.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.933+0000 7f7e38ccc640 1 -- 172.21.15.105:0/2059243977 shutdown_connections 2024-09-21T03:26:37.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.933+0000 7f7e38ccc640 1 --2- 172.21.15.105:0/2059243977 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e340d12c0 0x7f7e340d16d0 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:37.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.933+0000 7f7e38ccc640 1 --2- 172.21.15.105:0/2059243977 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e340ccbd0 0x7f7e340d0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:37.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.933+0000 7f7e38ccc640 1 -- 172.21.15.105:0/2059243977 >> 172.21.15.105:0/2059243977 conn(0x7f7e34072ae0 msgr2=0x7f7e34072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:37.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.933+0000 7f7e38ccc640 1 -- 172.21.15.105:0/2059243977 shutdown_connections 2024-09-21T03:26:37.937 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.933+0000 7f7e38ccc640 1 -- 172.21.15.105:0/2059243977 wait complete. 2024-09-21T03:26:37.938 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.935+0000 7f7e38ccc640 1 Processor -- start 2024-09-21T03:26:37.938 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.935+0000 7f7e38ccc640 1 -- start start 2024-09-21T03:26:37.940 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.937+0000 7f7e38ccc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e340b51c0 0x7f7e340a9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:37.940 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.937+0000 7f7e38ccc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e340ccbd0 0x7f7e341f5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:37.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.937+0000 7f7e38ccc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e340d12c0 0x7f7e341f5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:37.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.937+0000 7f7e38ccc640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7e340cf220 con 0x7f7e340ccbd0 2024-09-21T03:26:37.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.937+0000 7f7e38ccc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7e340cf0a0 con 0x7f7e340b51c0 2024-09-21T03:26:37.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.937+0000 7f7e38ccc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7e340cf3a0 con 0x7f7e340d12c0 2024-09-21T03:26:37.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.937+0000 7f7e31d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e340ccbd0 0x7f7e341f5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:37.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.937+0000 7f7e31d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e340ccbd0 0x7f7e341f5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41114/0 (socket says 172.21.15.105:41114) 2024-09-21T03:26:37.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.937+0000 7f7e31d9b640 1 -- 172.21.15.105:0/875331620 learned_addr learned my addr 172.21.15.105:0/875331620 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:37.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.937+0000 7f7e3259c640 1 --2- 172.21.15.105:0/875331620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e340b51c0 0x7f7e340a9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:37.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.937+0000 7f7e32d9d640 1 --2- 172.21.15.105:0/875331620 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e340d12c0 0x7f7e341f5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:37.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.937+0000 7f7e31d9b640 1 -- 172.21.15.105:0/875331620 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e340d12c0 msgr2=0x7f7e341f5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:37.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.937+0000 7f7e31d9b640 1 --2- 172.21.15.105:0/875331620 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e340d12c0 0x7f7e341f5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:37.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.937+0000 7f7e31d9b640 1 -- 172.21.15.105:0/875331620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e340b51c0 msgr2=0x7f7e340a9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:37.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.937+0000 7f7e31d9b640 1 --2- 172.21.15.105:0/875331620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e340b51c0 0x7f7e340a9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:37.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.937+0000 7f7e31d9b640 1 -- 172.21.15.105:0/875331620 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e340aa8e0 con 0x7f7e340ccbd0 2024-09-21T03:26:37.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.937+0000 7f7e3259c640 1 --2- 172.21.15.105:0/875331620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e340b51c0 0x7f7e340a9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:26:37.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.937+0000 7f7e31d9b640 1 --2- 172.21.15.105:0/875331620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e340ccbd0 0x7f7e341f5910 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f7e2800d700 tx=0x7f7e2800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:37.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.937+0000 7f7e22ffd640 1 -- 172.21.15.105:0/875331620 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e28017070 con 0x7f7e340ccbd0 2024-09-21T03:26:37.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.937+0000 7f7e22ffd640 1 -- 172.21.15.105:0/875331620 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e28009b10 con 0x7f7e340ccbd0 2024-09-21T03:26:37.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.937+0000 7f7e38ccc640 1 -- 172.21.15.105:0/875331620 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e3415ced0 con 0x7f7e340ccbd0 2024-09-21T03:26:37.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.937+0000 7f7e22ffd640 1 -- 172.21.15.105:0/875331620 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e28010460 con 0x7f7e340ccbd0 2024-09-21T03:26:37.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.938+0000 7f7e38ccc640 1 -- 172.21.15.105:0/875331620 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e3415d490 con 0x7f7e340ccbd0 2024-09-21T03:26:37.943 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.939+0000 7f7e38ccc640 1 -- 172.21.15.105:0/875331620 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e340cf850 con 0x7f7e340ccbd0 2024-09-21T03:26:37.943 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.939+0000 7f7e22ffd640 1 -- 172.21.15.105:0/875331620 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7e2801a070 con 0x7f7e340ccbd0 2024-09-21T03:26:37.943 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.940+0000 7f7e22ffd640 1 --2- 172.21.15.105:0/875331620 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7e14078bc0 0x7f7e1407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:37.943 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.940+0000 7f7e22ffd640 1 -- 172.21.15.105:0/875331620 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7f7e2809ae50 con 0x7f7e340ccbd0 2024-09-21T03:26:37.943 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.940+0000 7f7e3259c640 1 --2- 172.21.15.105:0/875331620 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7e14078bc0 0x7f7e1407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:37.944 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.941+0000 7f7e3259c640 1 --2- 172.21.15.105:0/875331620 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7e14078bc0 0x7f7e1407b0d0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f7e24001d10 tx=0x7f7e24009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:37.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:37.944+0000 7f7e22ffd640 1 -- 172.21.15.105:0/875331620 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7e28063290 con 0x7f7e340ccbd0 2024-09-21T03:26:38.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.122+0000 7f7e38ccc640 1 -- 172.21.15.105:0/875331620 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7e340aa670 con 0x7f7e14078bc0 2024-09-21T03:26:38.129 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.127+0000 7f7e22ffd640 1 -- 172.21.15.105:0/875331620 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247546 (secure 0 0 0) 0x7f7e340aa670 con 0x7f7e14078bc0 2024-09-21T03:26:38.132 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:26:38.133 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:26:38.134 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.130+0000 7f7e38ccc640 1 -- 172.21.15.105:0/875331620 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7e14078bc0 msgr2=0x7f7e1407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:38.134 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.130+0000 7f7e38ccc640 1 --2- 172.21.15.105:0/875331620 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7e14078bc0 0x7f7e1407b0d0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f7e24001d10 tx=0x7f7e24009040 comp rx=0 tx=0).stop 2024-09-21T03:26:38.134 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.130+0000 7f7e38ccc640 1 -- 172.21.15.105:0/875331620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e340ccbd0 msgr2=0x7f7e341f5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:38.134 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.130+0000 7f7e38ccc640 1 --2- 172.21.15.105:0/875331620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e340ccbd0 0x7f7e341f5910 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f7e2800d700 tx=0x7f7e2800dbc0 comp rx=0 tx=0).stop 2024-09-21T03:26:38.135 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.130+0000 7f7e38ccc640 1 -- 172.21.15.105:0/875331620 shutdown_connections 2024-09-21T03:26:38.135 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.130+0000 7f7e38ccc640 1 --2- 172.21.15.105:0/875331620 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7e14078bc0 0x7f7e1407b0d0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:38.135 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.130+0000 7f7e38ccc640 1 --2- 172.21.15.105:0/875331620 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7e340d12c0 0x7f7e341f5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:38.135 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.130+0000 7f7e38ccc640 1 --2- 172.21.15.105:0/875331620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e340ccbd0 0x7f7e341f5910 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:38.135 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.130+0000 7f7e38ccc640 1 --2- 172.21.15.105:0/875331620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e340b51c0 0x7f7e340a9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:38.135 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.130+0000 7f7e38ccc640 1 -- 172.21.15.105:0/875331620 >> 172.21.15.105:0/875331620 conn(0x7f7e34072ae0 msgr2=0x7f7e340ca290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:38.135 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.130+0000 7f7e38ccc640 1 -- 172.21.15.105:0/875331620 shutdown_connections 2024-09-21T03:26:38.135 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.130+0000 7f7e38ccc640 1 -- 172.21.15.105:0/875331620 wait complete. 2024-09-21T03:26:38.143 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":373,"stamp":"2024-09-21T03:26:37.411055+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":108,"num_write_kb":1631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":271432,"kb_used_data":13584,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754703288,"statfs":{"total":773094113280,"available":772816166912,"internally_reserved":0,"allocated":13910016,"data_stored":6612905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.669930"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.753441+0000","last_change":"2024-09-21T03:26:32.753441+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.753441+0000","last_undegraded":"2024-09-21T03:26:32.753441+0000","last_fullsized":"2024-09-21T03:26:32.753441+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749709+0000","last_change":"2024-09-21T03:26:32.749709+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749709+0000","last_undegraded":"2024-09-21T03:26:32.749709+0000","last_fullsized":"2024-09-21T03:26:32.749709+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751495+0000","last_change":"2024-09-21T03:26:32.751495+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751495+0000","last_undegraded":"2024-09-21T03:26:32.751495+0000","last_fullsized":"2024-09-21T03:26:32.751495+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.747033+0000","last_change":"2024-09-21T03:26:32.747033+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.747033+0000","last_undegraded":"2024-09-21T03:26:32.747033+0000","last_fullsized":"2024-09-21T03:26:32.747033+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.752535+0000","last_change":"2024-09-21T03:26:32.752535+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.752535+0000","last_undegraded":"2024-09-21T03:26:32.752535+0000","last_fullsized":"2024-09-21T03:26:32.752535+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.752456+0000","last_change":"2024-09-21T03:26:32.752456+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.752456+0000","last_undegraded":"2024-09-21T03:26:32.752456+0000","last_fullsized":"2024-09-21T03:26:32.752456+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.958840+0000","last_change":"2024-09-21T03:26:33.778224+0000","last_active":"2024-09-21T03:26:34.958840+0000","last_peered":"2024-09-21T03:26:34.958840+0000","last_clean":"2024-09-21T03:26:34.958840+0000","last_became_active":"2024-09-21T03:26:33.777885+0000","last_became_peered":"2024-09-21T03:26:33.777885+0000","last_unstale":"2024-09-21T03:26:34.958840+0000","last_undegraded":"2024-09-21T03:26:34.958840+0000","last_fullsized":"2024-09-21T03:26:34.958840+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:47.764557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751924+0000","last_change":"2024-09-21T03:26:32.751924+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751924+0000","last_undegraded":"2024-09-21T03:26:32.751924+0000","last_fullsized":"2024-09-21T03:26:32.751924+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.753085+0000","last_change":"2024-09-21T03:26:32.753085+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.753085+0000","last_undegraded":"2024-09-21T03:26:32.753085+0000","last_fullsized":"2024-09-21T03:26:32.753085+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.752886+0000","last_change":"2024-09-21T03:26:32.752886+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.752886+0000","last_undegraded":"2024-09-21T03:26:32.752886+0000","last_fullsized":"2024-09-21T03:26:32.752886+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751340+0000","last_change":"2024-09-21T03:26:32.751340+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751340+0000","last_undegraded":"2024-09-21T03:26:32.751340+0000","last_fullsized":"2024-09-21T03:26:32.751340+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751532+0000","last_change":"2024-09-21T03:26:32.751532+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751532+0000","last_undegraded":"2024-09-21T03:26:32.751532+0000","last_fullsized":"2024-09-21T03:26:32.751532+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.752050+0000","last_change":"2024-09-21T03:26:32.752050+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.752050+0000","last_undegraded":"2024-09-21T03:26:32.752050+0000","last_fullsized":"2024-09-21T03:26:32.752050+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.748249+0000","last_change":"2024-09-21T03:26:32.748249+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.748249+0000","last_undegraded":"2024-09-21T03:26:32.748249+0000","last_fullsized":"2024-09-21T03:26:32.748249+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.748727+0000","last_change":"2024-09-21T03:26:32.748727+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.748727+0000","last_undegraded":"2024-09-21T03:26:32.748727+0000","last_fullsized":"2024-09-21T03:26:32.748727+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750304+0000","last_change":"2024-09-21T03:26:32.750304+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750304+0000","last_undegraded":"2024-09-21T03:26:32.750304+0000","last_fullsized":"2024-09-21T03:26:32.750304+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749863+0000","last_change":"2024-09-21T03:26:32.749863+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749863+0000","last_undegraded":"2024-09-21T03:26:32.749863+0000","last_fullsized":"2024-09-21T03:26:32.749863+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751293+0000","last_change":"2024-09-21T03:26:32.751293+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751293+0000","last_undegraded":"2024-09-21T03:26:32.751293+0000","last_fullsized":"2024-09-21T03:26:32.751293+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750791+0000","last_change":"2024-09-21T03:26:32.750791+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750791+0000","last_undegraded":"2024-09-21T03:26:32.750791+0000","last_fullsized":"2024-09-21T03:26:32.750791+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749980+0000","last_change":"2024-09-21T03:26:32.749980+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749980+0000","last_undegraded":"2024-09-21T03:26:32.749980+0000","last_fullsized":"2024-09-21T03:26:32.749980+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749140+0000","last_change":"2024-09-21T03:26:32.749140+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749140+0000","last_undegraded":"2024-09-21T03:26:32.749140+0000","last_fullsized":"2024-09-21T03:26:32.749140+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.747627+0000","last_change":"2024-09-21T03:26:32.747627+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.747627+0000","last_undegraded":"2024-09-21T03:26:32.747627+0000","last_fullsized":"2024-09-21T03:26:32.747627+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.746033+0000","last_change":"2024-09-21T03:26:32.746033+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.746033+0000","last_undegraded":"2024-09-21T03:26:32.746033+0000","last_fullsized":"2024-09-21T03:26:32.746033+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750847+0000","last_change":"2024-09-21T03:26:32.750847+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750847+0000","last_undegraded":"2024-09-21T03:26:32.750847+0000","last_fullsized":"2024-09-21T03:26:32.750847+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751882+0000","last_change":"2024-09-21T03:26:32.751882+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751882+0000","last_undegraded":"2024-09-21T03:26:32.751882+0000","last_fullsized":"2024-09-21T03:26:32.751882+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750209+0000","last_change":"2024-09-21T03:26:32.750209+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750209+0000","last_undegraded":"2024-09-21T03:26:32.750209+0000","last_fullsized":"2024-09-21T03:26:32.750209+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.754270+0000","last_change":"2024-09-21T03:26:32.754270+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.754270+0000","last_undegraded":"2024-09-21T03:26:32.754270+0000","last_fullsized":"2024-09-21T03:26:32.754270+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959021+0000","last_change":"2024-09-21T03:26:33.768428+0000","last_active":"2024-09-21T03:26:34.959021+0000","last_peered":"2024-09-21T03:26:34.959021+0000","last_clean":"2024-09-21T03:26:34.959021+0000","last_became_active":"2024-09-21T03:26:33.768104+0000","last_became_peered":"2024-09-21T03:26:33.768104+0000","last_unstale":"2024-09-21T03:26:34.959021+0000","last_undegraded":"2024-09-21T03:26:34.959021+0000","last_fullsized":"2024-09-21T03:26:34.959021+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:09.772044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750908+0000","last_change":"2024-09-21T03:26:32.750908+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750908+0000","last_undegraded":"2024-09-21T03:26:32.750908+0000","last_fullsized":"2024-09-21T03:26:32.750908+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.747099+0000","last_change":"2024-09-21T03:26:32.747099+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.747099+0000","last_undegraded":"2024-09-21T03:26:32.747099+0000","last_fullsized":"2024-09-21T03:26:32.747099+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749457+0000","last_change":"2024-09-21T03:26:32.749457+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749457+0000","last_undegraded":"2024-09-21T03:26:32.749457+0000","last_fullsized":"2024-09-21T03:26:32.749457+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749762+0000","last_change":"2024-09-21T03:26:32.749762+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749762+0000","last_undegraded":"2024-09-21T03:26:32.749762+0000","last_fullsized":"2024-09-21T03:26:32.749762+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750324+0000","last_change":"2024-09-21T03:26:32.750324+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750324+0000","last_undegraded":"2024-09-21T03:26:32.750324+0000","last_fullsized":"2024-09-21T03:26:32.750324+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.769210+0000","last_change":"2024-09-21T03:26:32.765626+0000","last_active":"2024-09-21T03:26:32.769210+0000","last_peered":"2024-09-21T03:26:32.769210+0000","last_clean":"2024-09-21T03:26:32.769210+0000","last_became_active":"2024-09-21T03:26:32.764896+0000","last_became_peered":"2024-09-21T03:26:32.764896+0000","last_unstale":"2024-09-21T03:26:32.769210+0000","last_undegraded":"2024-09-21T03:26:32.769210+0000","last_fullsized":"2024-09-21T03:26:32.769210+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:19:34.668326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.752601+0000","last_change":"2024-09-21T03:26:32.752601+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.752601+0000","last_undegraded":"2024-09-21T03:26:32.752601+0000","last_fullsized":"2024-09-21T03:26:32.752601+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.765917+0000","last_change":"2024-09-21T03:26:32.763786+0000","last_active":"2024-09-21T03:26:32.765917+0000","last_peered":"2024-09-21T03:26:32.765917+0000","last_clean":"2024-09-21T03:26:32.765917+0000","last_became_active":"2024-09-21T03:26:32.763296+0000","last_became_peered":"2024-09-21T03:26:32.763296+0000","last_unstale":"2024-09-21T03:26:32.765917+0000","last_undegraded":"2024-09-21T03:26:32.765917+0000","last_fullsized":"2024-09-21T03:26:32.765917+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:43.499221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749686+0000","last_change":"2024-09-21T03:26:32.749686+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749686+0000","last_undegraded":"2024-09-21T03:26:32.749686+0000","last_fullsized":"2024-09-21T03:26:32.749686+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.762230+0000","last_change":"2024-09-21T03:26:32.760363+0000","last_active":"2024-09-21T03:26:32.762230+0000","last_peered":"2024-09-21T03:26:32.762230+0000","last_clean":"2024-09-21T03:26:32.762230+0000","last_became_active":"2024-09-21T03:26:32.760059+0000","last_became_peered":"2024-09-21T03:26:32.760059+0000","last_unstale":"2024-09-21T03:26:32.762230+0000","last_undegraded":"2024-09-21T03:26:32.762230+0000","last_fullsized":"2024-09-21T03:26:32.762230+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:44:38.489230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749592+0000","last_change":"2024-09-21T03:26:32.749592+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749592+0000","last_undegraded":"2024-09-21T03:26:32.749592+0000","last_fullsized":"2024-09-21T03:26:32.749592+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.754950+0000","last_change":"2024-09-21T03:26:32.754258+0000","last_active":"2024-09-21T03:26:32.754950+0000","last_peered":"2024-09-21T03:26:32.754950+0000","last_clean":"2024-09-21T03:26:32.754950+0000","last_became_active":"2024-09-21T03:26:32.753929+0000","last_became_peered":"2024-09-21T03:26:32.753929+0000","last_unstale":"2024-09-21T03:26:32.754950+0000","last_undegraded":"2024-09-21T03:26:32.754950+0000","last_fullsized":"2024-09-21T03:26:32.754950+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:39.364503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750511+0000","last_change":"2024-09-21T03:26:32.750511+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750511+0000","last_undegraded":"2024-09-21T03:26:32.750511+0000","last_fullsized":"2024-09-21T03:26:32.750511+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.767740+0000","last_change":"2024-09-21T03:26:32.765736+0000","last_active":"2024-09-21T03:26:32.767740+0000","last_peered":"2024-09-21T03:26:32.767740+0000","last_clean":"2024-09-21T03:26:32.767740+0000","last_became_active":"2024-09-21T03:26:32.765227+0000","last_became_peered":"2024-09-21T03:26:32.765227+0000","last_unstale":"2024-09-21T03:26:32.767740+0000","last_undegraded":"2024-09-21T03:26:32.767740+0000","last_fullsized":"2024-09-21T03:26:32.767740+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:15.751411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.747045+0000","last_change":"2024-09-21T03:26:32.747045+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.747045+0000","last_undegraded":"2024-09-21T03:26:32.747045+0000","last_fullsized":"2024-09-21T03:26:32.747045+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.769146+0000","last_change":"2024-09-21T03:26:32.765921+0000","last_active":"2024-09-21T03:26:32.769146+0000","last_peered":"2024-09-21T03:26:32.769146+0000","last_clean":"2024-09-21T03:26:32.769146+0000","last_became_active":"2024-09-21T03:26:32.765525+0000","last_became_peered":"2024-09-21T03:26:32.765525+0000","last_unstale":"2024-09-21T03:26:32.769146+0000","last_undegraded":"2024-09-21T03:26:32.769146+0000","last_fullsized":"2024-09-21T03:26:32.769146+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:28.033917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750553+0000","last_change":"2024-09-21T03:26:32.750553+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750553+0000","last_undegraded":"2024-09-21T03:26:32.750553+0000","last_fullsized":"2024-09-21T03:26:32.750553+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.765567+0000","last_change":"2024-09-21T03:26:32.763337+0000","last_active":"2024-09-21T03:26:32.765567+0000","last_peered":"2024-09-21T03:26:32.765567+0000","last_clean":"2024-09-21T03:26:32.765567+0000","last_became_active":"2024-09-21T03:26:32.763033+0000","last_became_peered":"2024-09-21T03:26:32.763033+0000","last_unstale":"2024-09-21T03:26:32.765567+0000","last_undegraded":"2024-09-21T03:26:32.765567+0000","last_fullsized":"2024-09-21T03:26:32.765567+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:39.782991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750673+0000","last_change":"2024-09-21T03:26:32.750673+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750673+0000","last_undegraded":"2024-09-21T03:26:32.750673+0000","last_fullsized":"2024-09-21T03:26:32.750673+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.760991+0000","last_change":"2024-09-21T03:26:32.758610+0000","last_active":"2024-09-21T03:26:32.760991+0000","last_peered":"2024-09-21T03:26:32.760991+0000","last_clean":"2024-09-21T03:26:32.760991+0000","last_became_active":"2024-09-21T03:26:32.758254+0000","last_became_peered":"2024-09-21T03:26:32.758254+0000","last_unstale":"2024-09-21T03:26:32.760991+0000","last_undegraded":"2024-09-21T03:26:32.760991+0000","last_fullsized":"2024-09-21T03:26:32.760991+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:21.051537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.752545+0000","last_change":"2024-09-21T03:26:32.752545+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.752545+0000","last_undegraded":"2024-09-21T03:26:32.752545+0000","last_fullsized":"2024-09-21T03:26:32.752545+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.765878+0000","last_change":"2024-09-21T03:26:32.763498+0000","last_active":"2024-09-21T03:26:32.765878+0000","last_peered":"2024-09-21T03:26:32.765878+0000","last_clean":"2024-09-21T03:26:32.765878+0000","last_became_active":"2024-09-21T03:26:32.763195+0000","last_became_peered":"2024-09-21T03:26:32.763195+0000","last_unstale":"2024-09-21T03:26:32.765878+0000","last_undegraded":"2024-09-21T03:26:32.765878+0000","last_fullsized":"2024-09-21T03:26:32.765878+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:42.291015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749304+0000","last_change":"2024-09-21T03:26:32.749304+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749304+0000","last_undegraded":"2024-09-21T03:26:32.749304+0000","last_fullsized":"2024-09-21T03:26:32.749304+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.765017+0000","last_change":"2024-09-21T03:26:32.763210+0000","last_active":"2024-09-21T03:26:32.765017+0000","last_peered":"2024-09-21T03:26:32.765017+0000","last_clean":"2024-09-21T03:26:32.765017+0000","last_became_active":"2024-09-21T03:26:32.762766+0000","last_became_peered":"2024-09-21T03:26:32.762766+0000","last_unstale":"2024-09-21T03:26:32.765017+0000","last_undegraded":"2024-09-21T03:26:32.765017+0000","last_fullsized":"2024-09-21T03:26:32.765017+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:42.291015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.753733+0000","last_change":"2024-09-21T03:26:32.753733+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.753733+0000","last_undegraded":"2024-09-21T03:26:32.753733+0000","last_fullsized":"2024-09-21T03:26:32.753733+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"128'6","reported_seq":21,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959389+0000","last_change":"2024-09-21T03:26:32.759495+0000","last_active":"2024-09-21T03:26:34.959389+0000","last_peered":"2024-09-21T03:26:34.959389+0000","last_clean":"2024-09-21T03:26:34.959389+0000","last_became_active":"2024-09-21T03:26:32.759122+0000","last_became_peered":"2024-09-21T03:26:32.759122+0000","last_unstale":"2024-09-21T03:26:34.959389+0000","last_undegraded":"2024-09-21T03:26:34.959389+0000","last_fullsized":"2024-09-21T03:26:34.959389+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:20.416584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750961+0000","last_change":"2024-09-21T03:26:32.750961+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750961+0000","last_undegraded":"2024-09-21T03:26:32.750961+0000","last_fullsized":"2024-09-21T03:26:32.750961+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.763828+0000","last_change":"2024-09-21T03:26:32.760470+0000","last_active":"2024-09-21T03:26:32.763828+0000","last_peered":"2024-09-21T03:26:32.763828+0000","last_clean":"2024-09-21T03:26:32.763828+0000","last_became_active":"2024-09-21T03:26:32.760171+0000","last_became_peered":"2024-09-21T03:26:32.760171+0000","last_unstale":"2024-09-21T03:26:32.763828+0000","last_undegraded":"2024-09-21T03:26:32.763828+0000","last_fullsized":"2024-09-21T03:26:32.763828+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:39.364503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749138+0000","last_change":"2024-09-21T03:26:32.749138+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749138+0000","last_undegraded":"2024-09-21T03:26:32.749138+0000","last_fullsized":"2024-09-21T03:26:32.749138+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.764078+0000","last_change":"2024-09-21T03:26:32.762314+0000","last_active":"2024-09-21T03:26:32.764078+0000","last_peered":"2024-09-21T03:26:32.764078+0000","last_clean":"2024-09-21T03:26:32.764078+0000","last_became_active":"2024-09-21T03:26:32.762003+0000","last_became_peered":"2024-09-21T03:26:32.762003+0000","last_unstale":"2024-09-21T03:26:32.764078+0000","last_undegraded":"2024-09-21T03:26:32.764078+0000","last_fullsized":"2024-09-21T03:26:32.764078+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:21.051537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750769+0000","last_change":"2024-09-21T03:26:32.750769+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750769+0000","last_undegraded":"2024-09-21T03:26:32.750769+0000","last_fullsized":"2024-09-21T03:26:32.750769+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.763283+0000","last_change":"2024-09-21T03:26:32.756831+0000","last_active":"2024-09-21T03:26:32.763283+0000","last_peered":"2024-09-21T03:26:32.763283+0000","last_clean":"2024-09-21T03:26:32.763283+0000","last_became_active":"2024-09-21T03:26:32.756494+0000","last_became_peered":"2024-09-21T03:26:32.756494+0000","last_unstale":"2024-09-21T03:26:32.763283+0000","last_undegraded":"2024-09-21T03:26:32.763283+0000","last_fullsized":"2024-09-21T03:26:32.763283+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:14.393309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749907+0000","last_change":"2024-09-21T03:26:32.749907+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749907+0000","last_undegraded":"2024-09-21T03:26:32.749907+0000","last_fullsized":"2024-09-21T03:26:32.749907+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.766637+0000","last_change":"2024-09-21T03:26:32.764507+0000","last_active":"2024-09-21T03:26:32.766637+0000","last_peered":"2024-09-21T03:26:32.766637+0000","last_clean":"2024-09-21T03:26:32.766637+0000","last_became_active":"2024-09-21T03:26:32.764170+0000","last_became_peered":"2024-09-21T03:26:32.764170+0000","last_unstale":"2024-09-21T03:26:32.766637+0000","last_undegraded":"2024-09-21T03:26:32.766637+0000","last_fullsized":"2024-09-21T03:26:32.766637+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:29.112426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749546+0000","last_change":"2024-09-21T03:26:32.749546+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749546+0000","last_undegraded":"2024-09-21T03:26:32.749546+0000","last_fullsized":"2024-09-21T03:26:32.749546+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.762427+0000","last_change":"2024-09-21T03:26:32.761374+0000","last_active":"2024-09-21T03:26:32.762427+0000","last_peered":"2024-09-21T03:26:32.762427+0000","last_clean":"2024-09-21T03:26:32.762427+0000","last_became_active":"2024-09-21T03:26:32.761046+0000","last_became_peered":"2024-09-21T03:26:32.761046+0000","last_unstale":"2024-09-21T03:26:32.762427+0000","last_undegraded":"2024-09-21T03:26:32.762427+0000","last_fullsized":"2024-09-21T03:26:32.762427+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:29:36.028915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751405+0000","last_change":"2024-09-21T03:26:32.751405+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751405+0000","last_undegraded":"2024-09-21T03:26:32.751405+0000","last_fullsized":"2024-09-21T03:26:32.751405+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.766127+0000","last_change":"2024-09-21T03:26:32.765118+0000","last_active":"2024-09-21T03:26:32.766127+0000","last_peered":"2024-09-21T03:26:32.766127+0000","last_clean":"2024-09-21T03:26:32.766127+0000","last_became_active":"2024-09-21T03:26:32.764807+0000","last_became_peered":"2024-09-21T03:26:32.764807+0000","last_unstale":"2024-09-21T03:26:32.766127+0000","last_undegraded":"2024-09-21T03:26:32.766127+0000","last_fullsized":"2024-09-21T03:26:32.766127+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:38:44.642701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751162+0000","last_change":"2024-09-21T03:26:32.751162+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751162+0000","last_undegraded":"2024-09-21T03:26:32.751162+0000","last_fullsized":"2024-09-21T03:26:32.751162+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.767748+0000","last_change":"2024-09-21T03:26:32.766023+0000","last_active":"2024-09-21T03:26:32.767748+0000","last_peered":"2024-09-21T03:26:32.767748+0000","last_clean":"2024-09-21T03:26:32.767748+0000","last_became_active":"2024-09-21T03:26:32.765690+0000","last_became_peered":"2024-09-21T03:26:32.765690+0000","last_unstale":"2024-09-21T03:26:32.767748+0000","last_undegraded":"2024-09-21T03:26:32.767748+0000","last_fullsized":"2024-09-21T03:26:32.767748+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:07:37.086442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749087+0000","last_change":"2024-09-21T03:26:32.749087+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749087+0000","last_undegraded":"2024-09-21T03:26:32.749087+0000","last_fullsized":"2024-09-21T03:26:32.749087+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.765989+0000","last_change":"2024-09-21T03:26:32.761613+0000","last_active":"2024-09-21T03:26:32.765989+0000","last_peered":"2024-09-21T03:26:32.765989+0000","last_clean":"2024-09-21T03:26:32.765989+0000","last_became_active":"2024-09-21T03:26:32.761327+0000","last_became_peered":"2024-09-21T03:26:32.761327+0000","last_unstale":"2024-09-21T03:26:32.765989+0000","last_undegraded":"2024-09-21T03:26:32.765989+0000","last_fullsized":"2024-09-21T03:26:32.765989+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:43:56.089219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.746196+0000","last_change":"2024-09-21T03:26:32.746196+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.746196+0000","last_undegraded":"2024-09-21T03:26:32.746196+0000","last_fullsized":"2024-09-21T03:26:32.746196+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"128'2","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959425+0000","last_change":"2024-09-21T03:26:32.764098+0000","last_active":"2024-09-21T03:26:34.959425+0000","last_peered":"2024-09-21T03:26:34.959425+0000","last_clean":"2024-09-21T03:26:34.959425+0000","last_became_active":"2024-09-21T03:26:32.763369+0000","last_became_peered":"2024-09-21T03:26:32.763369+0000","last_unstale":"2024-09-21T03:26:34.959425+0000","last_undegraded":"2024-09-21T03:26:34.959425+0000","last_fullsized":"2024-09-21T03:26:34.959425+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:55.678113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959291+0000","last_change":"2024-09-21T03:26:33.778124+0000","last_active":"2024-09-21T03:26:34.959291+0000","last_peered":"2024-09-21T03:26:34.959291+0000","last_clean":"2024-09-21T03:26:34.959291+0000","last_became_active":"2024-09-21T03:26:33.777780+0000","last_became_peered":"2024-09-21T03:26:33.777780+0000","last_unstale":"2024-09-21T03:26:34.959291+0000","last_undegraded":"2024-09-21T03:26:34.959291+0000","last_fullsized":"2024-09-21T03:26:34.959291+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:20.865258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.766725+0000","last_change":"2024-09-21T03:26:32.764723+0000","last_active":"2024-09-21T03:26:32.766725+0000","last_peered":"2024-09-21T03:26:32.766725+0000","last_clean":"2024-09-21T03:26:32.766725+0000","last_became_active":"2024-09-21T03:26:32.764235+0000","last_became_peered":"2024-09-21T03:26:32.764235+0000","last_unstale":"2024-09-21T03:26:32.766725+0000","last_undegraded":"2024-09-21T03:26:32.766725+0000","last_fullsized":"2024-09-21T03:26:32.766725+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:43.499221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.746748+0000","last_change":"2024-09-21T03:26:32.746748+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.746748+0000","last_undegraded":"2024-09-21T03:26:32.746748+0000","last_fullsized":"2024-09-21T03:26:32.746748+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.771880+0000","last_change":"2024-09-21T03:26:32.767045+0000","last_active":"2024-09-21T03:26:32.771880+0000","last_peered":"2024-09-21T03:26:32.771880+0000","last_clean":"2024-09-21T03:26:32.771880+0000","last_became_active":"2024-09-21T03:26:32.766543+0000","last_became_peered":"2024-09-21T03:26:32.766543+0000","last_unstale":"2024-09-21T03:26:32.771880+0000","last_undegraded":"2024-09-21T03:26:32.771880+0000","last_fullsized":"2024-09-21T03:26:32.771880+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:37.061012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.958608+0000","last_change":"2024-09-21T03:26:33.778377+0000","last_active":"2024-09-21T03:26:34.958608+0000","last_peered":"2024-09-21T03:26:34.958608+0000","last_clean":"2024-09-21T03:26:34.958608+0000","last_became_active":"2024-09-21T03:26:33.778077+0000","last_became_peered":"2024-09-21T03:26:33.778077+0000","last_unstale":"2024-09-21T03:26:34.958608+0000","last_undegraded":"2024-09-21T03:26:34.958608+0000","last_fullsized":"2024-09-21T03:26:34.958608+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:22.283748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.764892+0000","last_change":"2024-09-21T03:26:32.763204+0000","last_active":"2024-09-21T03:26:32.764892+0000","last_peered":"2024-09-21T03:26:32.764892+0000","last_clean":"2024-09-21T03:26:32.764892+0000","last_became_active":"2024-09-21T03:26:32.762314+0000","last_became_peered":"2024-09-21T03:26:32.762314+0000","last_unstale":"2024-09-21T03:26:32.764892+0000","last_undegraded":"2024-09-21T03:26:32.764892+0000","last_fullsized":"2024-09-21T03:26:32.764892+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:44:38.489230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751643+0000","last_change":"2024-09-21T03:26:32.751643+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751643+0000","last_undegraded":"2024-09-21T03:26:32.751643+0000","last_fullsized":"2024-09-21T03:26:32.751643+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.764979+0000","last_change":"2024-09-21T03:26:32.763095+0000","last_active":"2024-09-21T03:26:32.764979+0000","last_peered":"2024-09-21T03:26:32.764979+0000","last_clean":"2024-09-21T03:26:32.764979+0000","last_became_active":"2024-09-21T03:26:32.762758+0000","last_became_peered":"2024-09-21T03:26:32.762758+0000","last_unstale":"2024-09-21T03:26:32.764979+0000","last_undegraded":"2024-09-21T03:26:32.764979+0000","last_fullsized":"2024-09-21T03:26:32.764979+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:43.159607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.752344+0000","last_change":"2024-09-21T03:26:32.752344+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.752344+0000","last_undegraded":"2024-09-21T03:26:32.752344+0000","last_fullsized":"2024-09-21T03:26:32.752344+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.753832+0000","last_change":"2024-09-21T03:26:32.752528+0000","last_active":"2024-09-21T03:26:32.753832+0000","last_peered":"2024-09-21T03:26:32.753832+0000","last_clean":"2024-09-21T03:26:32.753832+0000","last_became_active":"2024-09-21T03:26:32.752205+0000","last_became_peered":"2024-09-21T03:26:32.752205+0000","last_unstale":"2024-09-21T03:26:32.753832+0000","last_undegraded":"2024-09-21T03:26:32.753832+0000","last_fullsized":"2024-09-21T03:26:32.753832+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:27.024217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751797+0000","last_change":"2024-09-21T03:26:32.751797+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751797+0000","last_undegraded":"2024-09-21T03:26:32.751797+0000","last_fullsized":"2024-09-21T03:26:32.751797+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.762171+0000","last_change":"2024-09-21T03:26:32.758409+0000","last_active":"2024-09-21T03:26:32.762171+0000","last_peered":"2024-09-21T03:26:32.762171+0000","last_clean":"2024-09-21T03:26:32.762171+0000","last_became_active":"2024-09-21T03:26:32.758112+0000","last_became_peered":"2024-09-21T03:26:32.758112+0000","last_unstale":"2024-09-21T03:26:32.762171+0000","last_undegraded":"2024-09-21T03:26:32.762171+0000","last_fullsized":"2024-09-21T03:26:32.762171+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:08:21.928238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.748534+0000","last_change":"2024-09-21T03:26:32.748534+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.748534+0000","last_undegraded":"2024-09-21T03:26:32.748534+0000","last_fullsized":"2024-09-21T03:26:32.748534+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.764765+0000","last_change":"2024-09-21T03:26:32.761270+0000","last_active":"2024-09-21T03:26:32.764765+0000","last_peered":"2024-09-21T03:26:32.764765+0000","last_clean":"2024-09-21T03:26:32.764765+0000","last_became_active":"2024-09-21T03:26:32.760986+0000","last_became_peered":"2024-09-21T03:26:32.760986+0000","last_unstale":"2024-09-21T03:26:32.764765+0000","last_undegraded":"2024-09-21T03:26:32.764765+0000","last_fullsized":"2024-09-21T03:26:32.764765+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:04.235753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.753998+0000","last_change":"2024-09-21T03:26:32.753998+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.753998+0000","last_undegraded":"2024-09-21T03:26:32.753998+0000","last_fullsized":"2024-09-21T03:26:32.753998+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959509+0000","last_change":"2024-09-21T03:26:32.763753+0000","last_active":"2024-09-21T03:26:34.959509+0000","last_peered":"2024-09-21T03:26:34.959509+0000","last_clean":"2024-09-21T03:26:34.959509+0000","last_became_active":"2024-09-21T03:26:32.762836+0000","last_became_peered":"2024-09-21T03:26:32.762836+0000","last_unstale":"2024-09-21T03:26:34.959509+0000","last_undegraded":"2024-09-21T03:26:34.959509+0000","last_fullsized":"2024-09-21T03:26:34.959509+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:51.853935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751544+0000","last_change":"2024-09-21T03:26:32.751544+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751544+0000","last_undegraded":"2024-09-21T03:26:32.751544+0000","last_fullsized":"2024-09-21T03:26:32.751544+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.769158+0000","last_change":"2024-09-21T03:26:32.764798+0000","last_active":"2024-09-21T03:26:32.769158+0000","last_peered":"2024-09-21T03:26:32.769158+0000","last_clean":"2024-09-21T03:26:32.769158+0000","last_became_active":"2024-09-21T03:26:32.764469+0000","last_became_peered":"2024-09-21T03:26:32.764469+0000","last_unstale":"2024-09-21T03:26:32.769158+0000","last_undegraded":"2024-09-21T03:26:32.769158+0000","last_fullsized":"2024-09-21T03:26:32.769158+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:38:44.642701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750392+0000","last_change":"2024-09-21T03:26:32.750392+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750392+0000","last_undegraded":"2024-09-21T03:26:32.750392+0000","last_fullsized":"2024-09-21T03:26:32.750392+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.761576+0000","last_change":"2024-09-21T03:26:32.757614+0000","last_active":"2024-09-21T03:26:32.761576+0000","last_peered":"2024-09-21T03:26:32.761576+0000","last_clean":"2024-09-21T03:26:32.761576+0000","last_became_active":"2024-09-21T03:26:32.757332+0000","last_became_peered":"2024-09-21T03:26:32.757332+0000","last_unstale":"2024-09-21T03:26:32.761576+0000","last_undegraded":"2024-09-21T03:26:32.761576+0000","last_fullsized":"2024-09-21T03:26:32.761576+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:01:59.982817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750113+0000","last_change":"2024-09-21T03:26:32.750113+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750113+0000","last_undegraded":"2024-09-21T03:26:32.750113+0000","last_fullsized":"2024-09-21T03:26:32.750113+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.765761+0000","last_change":"2024-09-21T03:26:32.762505+0000","last_active":"2024-09-21T03:26:32.765761+0000","last_peered":"2024-09-21T03:26:32.765761+0000","last_clean":"2024-09-21T03:26:32.765761+0000","last_became_active":"2024-09-21T03:26:32.762188+0000","last_became_peered":"2024-09-21T03:26:32.762188+0000","last_unstale":"2024-09-21T03:26:32.765761+0000","last_undegraded":"2024-09-21T03:26:32.765761+0000","last_fullsized":"2024-09-21T03:26:32.765761+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:43.159607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959254+0000","last_change":"2024-09-21T03:26:33.778553+0000","last_active":"2024-09-21T03:26:34.959254+0000","last_peered":"2024-09-21T03:26:34.959254+0000","last_clean":"2024-09-21T03:26:34.959254+0000","last_became_active":"2024-09-21T03:26:33.777840+0000","last_became_peered":"2024-09-21T03:26:33.777840+0000","last_unstale":"2024-09-21T03:26:34.959254+0000","last_undegraded":"2024-09-21T03:26:34.959254+0000","last_fullsized":"2024-09-21T03:26:34.959254+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:54.479070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.769337+0000","last_change":"2024-09-21T03:26:32.767343+0000","last_active":"2024-09-21T03:26:32.769337+0000","last_peered":"2024-09-21T03:26:32.769337+0000","last_clean":"2024-09-21T03:26:32.769337+0000","last_became_active":"2024-09-21T03:26:32.767009+0000","last_became_peered":"2024-09-21T03:26:32.767009+0000","last_unstale":"2024-09-21T03:26:32.769337+0000","last_undegraded":"2024-09-21T03:26:32.769337+0000","last_fullsized":"2024-09-21T03:26:32.769337+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:15.581950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":309,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.753238+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:26:32.753238+0000","last_peered":"2024-09-21T03:26:32.753238+0000","last_clean":"2024-09-21T03:26:32.753238+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:26:32.753238+0000","last_undegraded":"2024-09-21T03:26:32.753238+0000","last_fullsized":"2024-09-21T03:26:32.753238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509544,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33320,"kb_used_data":2128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338520,"statfs":{"total":96636764160,"available":96602644480,"internally_reserved":0,"allocated":2179072,"data_stored":1267549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509543,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32736,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339104,"statfs":{"total":96636764160,"available":96603242496,"internally_reserved":0,"allocated":1585152,"data_stored":677181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509542,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32740,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339100,"statfs":{"total":96636764160,"available":96603238400,"internally_reserved":0,"allocated":1585152,"data_stored":677181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509542,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32736,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339104,"statfs":{"total":96636764160,"available":96603242496,"internally_reserved":0,"allocated":1585152,"data_stored":677181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509543,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32740,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339100,"statfs":{"total":96636764160,"available":96603238400,"internally_reserved":0,"allocated":1585152,"data_stored":677181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509543,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36900,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334940,"statfs":{"total":96636764160,"available":96598978560,"internally_reserved":0,"allocated":1585152,"data_stored":677181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509543,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36900,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334940,"statfs":{"total":96636764160,"available":96598978560,"internally_reserved":0,"allocated":1585152,"data_stored":677181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574951,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33360,"kb_used_data":2168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338480,"statfs":{"total":96636764160,"available":96602603520,"internally_reserved":0,"allocated":2220032,"data_stored":1282270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:26:38.147 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:26:38.297 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.294+0000 7f70064de640 1 -- 172.21.15.105:0/1531715283 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fe8004800 msgr2=0x7f6fe8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:38.297 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.294+0000 7f70064de640 1 --2- 172.21.15.105:0/1531715283 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fe8004800 0x7f6fe8004c10 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f6ff4009b50 tx=0x7f6fe8005830 comp rx=0 tx=0).stop 2024-09-21T03:26:38.298 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.294+0000 7f70064de640 1 -- 172.21.15.105:0/1531715283 shutdown_connections 2024-09-21T03:26:38.298 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.294+0000 7f70064de640 1 --2- 172.21.15.105:0/1531715283 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fe8004800 0x7f6fe8004c10 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:38.298 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.294+0000 7f70064de640 1 -- 172.21.15.105:0/1531715283 >> 172.21.15.105:0/1531715283 conn(0x7f70000b3f10 msgr2=0x7f70000b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:38.298 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.294+0000 7f70064de640 1 -- 172.21.15.105:0/1531715283 shutdown_connections 2024-09-21T03:26:38.298 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.294+0000 7f70064de640 1 -- 172.21.15.105:0/1531715283 wait complete. 2024-09-21T03:26:38.299 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.296+0000 7f70064de640 1 Processor -- start 2024-09-21T03:26:38.299 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.296+0000 7f70064de640 1 -- start start 2024-09-21T03:26:38.301 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.298+0000 7f70064de640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fe8004800 0x7f70000cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:38.301 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.298+0000 7f70064de640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70001f2f20 0x7f70001567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:38.301 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.298+0000 7f70064de640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7000156e90 0x7f70000cace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:38.301 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.298+0000 7f70064de640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f70000cd340 con 0x7f7000156e90 2024-09-21T03:26:38.301 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.298+0000 7f70064de640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f70000cd1c0 con 0x7f6fe8004800 2024-09-21T03:26:38.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.298+0000 7f70064de640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f70000cd4c0 con 0x7f70001f2f20 2024-09-21T03:26:38.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.298+0000 7f7004a7b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7000156e90 0x7f70000cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:38.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.298+0000 7f7004a7b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7000156e90 0x7f70000cace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41138/0 (socket says 172.21.15.105:41138) 2024-09-21T03:26:38.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.298+0000 7f7004a7b640 1 -- 172.21.15.105:0/261614205 learned_addr learned my addr 172.21.15.105:0/261614205 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:38.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.298+0000 7f6ffffff640 1 --2- 172.21.15.105:0/261614205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fe8004800 0x7f70000cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:38.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.298+0000 7f6fff7fe640 1 --2- 172.21.15.105:0/261614205 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70001f2f20 0x7f70001567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:38.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.298+0000 7f7004a7b640 1 -- 172.21.15.105:0/261614205 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70001f2f20 msgr2=0x7f70001567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:38.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.298+0000 7f7004a7b640 1 --2- 172.21.15.105:0/261614205 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70001f2f20 0x7f70001567a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:38.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.298+0000 7f7004a7b640 1 -- 172.21.15.105:0/261614205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fe8004800 msgr2=0x7f70000cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:38.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.298+0000 7f7004a7b640 1 --2- 172.21.15.105:0/261614205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fe8004800 0x7f70000cbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:38.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.298+0000 7f7004a7b640 1 -- 172.21.15.105:0/261614205 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70001f3700 con 0x7f7000156e90 2024-09-21T03:26:38.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.298+0000 7f7004a7b640 1 --2- 172.21.15.105:0/261614205 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7000156e90 0x7f70000cace0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f6ff80013d0 tx=0x7f6ff8006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:38.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.298+0000 7f6ffcff9640 1 -- 172.21.15.105:0/261614205 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff800fab0 con 0x7f7000156e90 2024-09-21T03:26:38.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.298+0000 7f6ffcff9640 1 -- 172.21.15.105:0/261614205 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ff800fc70 con 0x7f7000156e90 2024-09-21T03:26:38.302 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.298+0000 7f70064de640 1 -- 172.21.15.105:0/261614205 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70001f39e0 con 0x7f7000156e90 2024-09-21T03:26:38.303 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.298+0000 7f6ffcff9640 1 -- 172.21.15.105:0/261614205 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff8011690 con 0x7f7000156e90 2024-09-21T03:26:38.303 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.298+0000 7f70064de640 1 -- 172.21.15.105:0/261614205 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70000ca7c0 con 0x7f7000156e90 2024-09-21T03:26:38.303 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.299+0000 7f70064de640 1 -- 172.21.15.105:0/261614205 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70001f3450 con 0x7f7000156e90 2024-09-21T03:26:38.303 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.300+0000 7f6ffcff9640 1 -- 172.21.15.105:0/261614205 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6ff8011830 con 0x7f7000156e90 2024-09-21T03:26:38.303 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.301+0000 7f6ffcff9640 1 --2- 172.21.15.105:0/261614205 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6fec078b90 0x7f6fec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:38.304 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.301+0000 7f6ffcff9640 1 -- 172.21.15.105:0/261614205 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7f6ff809b500 con 0x7f7000156e90 2024-09-21T03:26:38.304 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.301+0000 7f6ffffff640 1 --2- 172.21.15.105:0/261614205 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6fec078b90 0x7f6fec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:38.304 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.301+0000 7f6ffffff640 1 --2- 172.21.15.105:0/261614205 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6fec078b90 0x7f6fec07b0a0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f7000052910 tx=0x7f6ff0006ce0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:38.308 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.305+0000 7f6ffcff9640 1 -- 172.21.15.105:0/261614205 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6ff800fe60 con 0x7f7000156e90 2024-09-21T03:26:38.480 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.478+0000 7f70064de640 1 -- 172.21.15.105:0/261614205 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f70000ced10 con 0x7f6fec078b90 2024-09-21T03:26:38.484 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.483+0000 7f6ffcff9640 1 -- 172.21.15.105:0/261614205 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247546 (secure 0 0 0) 0x7f70000ced10 con 0x7f6fec078b90 2024-09-21T03:26:38.487 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:26:38.488 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:26:38.489 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.485+0000 7f70064de640 1 -- 172.21.15.105:0/261614205 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6fec078b90 msgr2=0x7f6fec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:38.490 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.485+0000 7f70064de640 1 --2- 172.21.15.105:0/261614205 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6fec078b90 0x7f6fec07b0a0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f7000052910 tx=0x7f6ff0006ce0 comp rx=0 tx=0).stop 2024-09-21T03:26:38.490 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.485+0000 7f70064de640 1 -- 172.21.15.105:0/261614205 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7000156e90 msgr2=0x7f70000cace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:38.490 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.485+0000 7f70064de640 1 --2- 172.21.15.105:0/261614205 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7000156e90 0x7f70000cace0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f6ff80013d0 tx=0x7f6ff8006720 comp rx=0 tx=0).stop 2024-09-21T03:26:38.490 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.485+0000 7f70064de640 1 -- 172.21.15.105:0/261614205 shutdown_connections 2024-09-21T03:26:38.490 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.485+0000 7f70064de640 1 --2- 172.21.15.105:0/261614205 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6fec078b90 0x7f6fec07b0a0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:38.490 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.485+0000 7f70064de640 1 --2- 172.21.15.105:0/261614205 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7000156e90 0x7f70000cace0 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:38.490 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.485+0000 7f70064de640 1 --2- 172.21.15.105:0/261614205 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70001f2f20 0x7f70001567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:38.490 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.485+0000 7f70064de640 1 --2- 172.21.15.105:0/261614205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fe8004800 0x7f70000cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:38.490 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.485+0000 7f70064de640 1 -- 172.21.15.105:0/261614205 >> 172.21.15.105:0/261614205 conn(0x7f70000b3f10 msgr2=0x7f700015a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:38.490 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.485+0000 7f70064de640 1 -- 172.21.15.105:0/261614205 shutdown_connections 2024-09-21T03:26:38.490 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.485+0000 7f70064de640 1 -- 172.21.15.105:0/261614205 wait complete. 2024-09-21T03:26:38.499 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":373,"stamp":"2024-09-21T03:26:37.411055+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":108,"num_write_kb":1631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":271432,"kb_used_data":13584,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754703288,"statfs":{"total":773094113280,"available":772816166912,"internally_reserved":0,"allocated":13910016,"data_stored":6612905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.669930"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.753441+0000","last_change":"2024-09-21T03:26:32.753441+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.753441+0000","last_undegraded":"2024-09-21T03:26:32.753441+0000","last_fullsized":"2024-09-21T03:26:32.753441+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749709+0000","last_change":"2024-09-21T03:26:32.749709+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749709+0000","last_undegraded":"2024-09-21T03:26:32.749709+0000","last_fullsized":"2024-09-21T03:26:32.749709+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751495+0000","last_change":"2024-09-21T03:26:32.751495+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751495+0000","last_undegraded":"2024-09-21T03:26:32.751495+0000","last_fullsized":"2024-09-21T03:26:32.751495+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.747033+0000","last_change":"2024-09-21T03:26:32.747033+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.747033+0000","last_undegraded":"2024-09-21T03:26:32.747033+0000","last_fullsized":"2024-09-21T03:26:32.747033+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.752535+0000","last_change":"2024-09-21T03:26:32.752535+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.752535+0000","last_undegraded":"2024-09-21T03:26:32.752535+0000","last_fullsized":"2024-09-21T03:26:32.752535+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.752456+0000","last_change":"2024-09-21T03:26:32.752456+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.752456+0000","last_undegraded":"2024-09-21T03:26:32.752456+0000","last_fullsized":"2024-09-21T03:26:32.752456+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.958840+0000","last_change":"2024-09-21T03:26:33.778224+0000","last_active":"2024-09-21T03:26:34.958840+0000","last_peered":"2024-09-21T03:26:34.958840+0000","last_clean":"2024-09-21T03:26:34.958840+0000","last_became_active":"2024-09-21T03:26:33.777885+0000","last_became_peered":"2024-09-21T03:26:33.777885+0000","last_unstale":"2024-09-21T03:26:34.958840+0000","last_undegraded":"2024-09-21T03:26:34.958840+0000","last_fullsized":"2024-09-21T03:26:34.958840+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:47.764557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751924+0000","last_change":"2024-09-21T03:26:32.751924+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751924+0000","last_undegraded":"2024-09-21T03:26:32.751924+0000","last_fullsized":"2024-09-21T03:26:32.751924+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.753085+0000","last_change":"2024-09-21T03:26:32.753085+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.753085+0000","last_undegraded":"2024-09-21T03:26:32.753085+0000","last_fullsized":"2024-09-21T03:26:32.753085+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.752886+0000","last_change":"2024-09-21T03:26:32.752886+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.752886+0000","last_undegraded":"2024-09-21T03:26:32.752886+0000","last_fullsized":"2024-09-21T03:26:32.752886+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751340+0000","last_change":"2024-09-21T03:26:32.751340+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751340+0000","last_undegraded":"2024-09-21T03:26:32.751340+0000","last_fullsized":"2024-09-21T03:26:32.751340+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751532+0000","last_change":"2024-09-21T03:26:32.751532+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751532+0000","last_undegraded":"2024-09-21T03:26:32.751532+0000","last_fullsized":"2024-09-21T03:26:32.751532+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.752050+0000","last_change":"2024-09-21T03:26:32.752050+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.752050+0000","last_undegraded":"2024-09-21T03:26:32.752050+0000","last_fullsized":"2024-09-21T03:26:32.752050+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.748249+0000","last_change":"2024-09-21T03:26:32.748249+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.748249+0000","last_undegraded":"2024-09-21T03:26:32.748249+0000","last_fullsized":"2024-09-21T03:26:32.748249+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.748727+0000","last_change":"2024-09-21T03:26:32.748727+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.748727+0000","last_undegraded":"2024-09-21T03:26:32.748727+0000","last_fullsized":"2024-09-21T03:26:32.748727+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750304+0000","last_change":"2024-09-21T03:26:32.750304+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750304+0000","last_undegraded":"2024-09-21T03:26:32.750304+0000","last_fullsized":"2024-09-21T03:26:32.750304+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749863+0000","last_change":"2024-09-21T03:26:32.749863+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749863+0000","last_undegraded":"2024-09-21T03:26:32.749863+0000","last_fullsized":"2024-09-21T03:26:32.749863+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751293+0000","last_change":"2024-09-21T03:26:32.751293+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751293+0000","last_undegraded":"2024-09-21T03:26:32.751293+0000","last_fullsized":"2024-09-21T03:26:32.751293+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750791+0000","last_change":"2024-09-21T03:26:32.750791+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750791+0000","last_undegraded":"2024-09-21T03:26:32.750791+0000","last_fullsized":"2024-09-21T03:26:32.750791+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749980+0000","last_change":"2024-09-21T03:26:32.749980+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749980+0000","last_undegraded":"2024-09-21T03:26:32.749980+0000","last_fullsized":"2024-09-21T03:26:32.749980+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749140+0000","last_change":"2024-09-21T03:26:32.749140+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749140+0000","last_undegraded":"2024-09-21T03:26:32.749140+0000","last_fullsized":"2024-09-21T03:26:32.749140+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.747627+0000","last_change":"2024-09-21T03:26:32.747627+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.747627+0000","last_undegraded":"2024-09-21T03:26:32.747627+0000","last_fullsized":"2024-09-21T03:26:32.747627+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.746033+0000","last_change":"2024-09-21T03:26:32.746033+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.746033+0000","last_undegraded":"2024-09-21T03:26:32.746033+0000","last_fullsized":"2024-09-21T03:26:32.746033+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750847+0000","last_change":"2024-09-21T03:26:32.750847+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750847+0000","last_undegraded":"2024-09-21T03:26:32.750847+0000","last_fullsized":"2024-09-21T03:26:32.750847+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751882+0000","last_change":"2024-09-21T03:26:32.751882+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751882+0000","last_undegraded":"2024-09-21T03:26:32.751882+0000","last_fullsized":"2024-09-21T03:26:32.751882+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750209+0000","last_change":"2024-09-21T03:26:32.750209+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750209+0000","last_undegraded":"2024-09-21T03:26:32.750209+0000","last_fullsized":"2024-09-21T03:26:32.750209+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.754270+0000","last_change":"2024-09-21T03:26:32.754270+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.754270+0000","last_undegraded":"2024-09-21T03:26:32.754270+0000","last_fullsized":"2024-09-21T03:26:32.754270+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959021+0000","last_change":"2024-09-21T03:26:33.768428+0000","last_active":"2024-09-21T03:26:34.959021+0000","last_peered":"2024-09-21T03:26:34.959021+0000","last_clean":"2024-09-21T03:26:34.959021+0000","last_became_active":"2024-09-21T03:26:33.768104+0000","last_became_peered":"2024-09-21T03:26:33.768104+0000","last_unstale":"2024-09-21T03:26:34.959021+0000","last_undegraded":"2024-09-21T03:26:34.959021+0000","last_fullsized":"2024-09-21T03:26:34.959021+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:09.772044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750908+0000","last_change":"2024-09-21T03:26:32.750908+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750908+0000","last_undegraded":"2024-09-21T03:26:32.750908+0000","last_fullsized":"2024-09-21T03:26:32.750908+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.747099+0000","last_change":"2024-09-21T03:26:32.747099+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.747099+0000","last_undegraded":"2024-09-21T03:26:32.747099+0000","last_fullsized":"2024-09-21T03:26:32.747099+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749457+0000","last_change":"2024-09-21T03:26:32.749457+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749457+0000","last_undegraded":"2024-09-21T03:26:32.749457+0000","last_fullsized":"2024-09-21T03:26:32.749457+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749762+0000","last_change":"2024-09-21T03:26:32.749762+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749762+0000","last_undegraded":"2024-09-21T03:26:32.749762+0000","last_fullsized":"2024-09-21T03:26:32.749762+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750324+0000","last_change":"2024-09-21T03:26:32.750324+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750324+0000","last_undegraded":"2024-09-21T03:26:32.750324+0000","last_fullsized":"2024-09-21T03:26:32.750324+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.769210+0000","last_change":"2024-09-21T03:26:32.765626+0000","last_active":"2024-09-21T03:26:32.769210+0000","last_peered":"2024-09-21T03:26:32.769210+0000","last_clean":"2024-09-21T03:26:32.769210+0000","last_became_active":"2024-09-21T03:26:32.764896+0000","last_became_peered":"2024-09-21T03:26:32.764896+0000","last_unstale":"2024-09-21T03:26:32.769210+0000","last_undegraded":"2024-09-21T03:26:32.769210+0000","last_fullsized":"2024-09-21T03:26:32.769210+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:19:34.668326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.752601+0000","last_change":"2024-09-21T03:26:32.752601+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.752601+0000","last_undegraded":"2024-09-21T03:26:32.752601+0000","last_fullsized":"2024-09-21T03:26:32.752601+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.765917+0000","last_change":"2024-09-21T03:26:32.763786+0000","last_active":"2024-09-21T03:26:32.765917+0000","last_peered":"2024-09-21T03:26:32.765917+0000","last_clean":"2024-09-21T03:26:32.765917+0000","last_became_active":"2024-09-21T03:26:32.763296+0000","last_became_peered":"2024-09-21T03:26:32.763296+0000","last_unstale":"2024-09-21T03:26:32.765917+0000","last_undegraded":"2024-09-21T03:26:32.765917+0000","last_fullsized":"2024-09-21T03:26:32.765917+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:43.499221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749686+0000","last_change":"2024-09-21T03:26:32.749686+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749686+0000","last_undegraded":"2024-09-21T03:26:32.749686+0000","last_fullsized":"2024-09-21T03:26:32.749686+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.762230+0000","last_change":"2024-09-21T03:26:32.760363+0000","last_active":"2024-09-21T03:26:32.762230+0000","last_peered":"2024-09-21T03:26:32.762230+0000","last_clean":"2024-09-21T03:26:32.762230+0000","last_became_active":"2024-09-21T03:26:32.760059+0000","last_became_peered":"2024-09-21T03:26:32.760059+0000","last_unstale":"2024-09-21T03:26:32.762230+0000","last_undegraded":"2024-09-21T03:26:32.762230+0000","last_fullsized":"2024-09-21T03:26:32.762230+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:44:38.489230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749592+0000","last_change":"2024-09-21T03:26:32.749592+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749592+0000","last_undegraded":"2024-09-21T03:26:32.749592+0000","last_fullsized":"2024-09-21T03:26:32.749592+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.754950+0000","last_change":"2024-09-21T03:26:32.754258+0000","last_active":"2024-09-21T03:26:32.754950+0000","last_peered":"2024-09-21T03:26:32.754950+0000","last_clean":"2024-09-21T03:26:32.754950+0000","last_became_active":"2024-09-21T03:26:32.753929+0000","last_became_peered":"2024-09-21T03:26:32.753929+0000","last_unstale":"2024-09-21T03:26:32.754950+0000","last_undegraded":"2024-09-21T03:26:32.754950+0000","last_fullsized":"2024-09-21T03:26:32.754950+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:39.364503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750511+0000","last_change":"2024-09-21T03:26:32.750511+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750511+0000","last_undegraded":"2024-09-21T03:26:32.750511+0000","last_fullsized":"2024-09-21T03:26:32.750511+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.767740+0000","last_change":"2024-09-21T03:26:32.765736+0000","last_active":"2024-09-21T03:26:32.767740+0000","last_peered":"2024-09-21T03:26:32.767740+0000","last_clean":"2024-09-21T03:26:32.767740+0000","last_became_active":"2024-09-21T03:26:32.765227+0000","last_became_peered":"2024-09-21T03:26:32.765227+0000","last_unstale":"2024-09-21T03:26:32.767740+0000","last_undegraded":"2024-09-21T03:26:32.767740+0000","last_fullsized":"2024-09-21T03:26:32.767740+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:15.751411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.747045+0000","last_change":"2024-09-21T03:26:32.747045+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.747045+0000","last_undegraded":"2024-09-21T03:26:32.747045+0000","last_fullsized":"2024-09-21T03:26:32.747045+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.769146+0000","last_change":"2024-09-21T03:26:32.765921+0000","last_active":"2024-09-21T03:26:32.769146+0000","last_peered":"2024-09-21T03:26:32.769146+0000","last_clean":"2024-09-21T03:26:32.769146+0000","last_became_active":"2024-09-21T03:26:32.765525+0000","last_became_peered":"2024-09-21T03:26:32.765525+0000","last_unstale":"2024-09-21T03:26:32.769146+0000","last_undegraded":"2024-09-21T03:26:32.769146+0000","last_fullsized":"2024-09-21T03:26:32.769146+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:28.033917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750553+0000","last_change":"2024-09-21T03:26:32.750553+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750553+0000","last_undegraded":"2024-09-21T03:26:32.750553+0000","last_fullsized":"2024-09-21T03:26:32.750553+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.765567+0000","last_change":"2024-09-21T03:26:32.763337+0000","last_active":"2024-09-21T03:26:32.765567+0000","last_peered":"2024-09-21T03:26:32.765567+0000","last_clean":"2024-09-21T03:26:32.765567+0000","last_became_active":"2024-09-21T03:26:32.763033+0000","last_became_peered":"2024-09-21T03:26:32.763033+0000","last_unstale":"2024-09-21T03:26:32.765567+0000","last_undegraded":"2024-09-21T03:26:32.765567+0000","last_fullsized":"2024-09-21T03:26:32.765567+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:39.782991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750673+0000","last_change":"2024-09-21T03:26:32.750673+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750673+0000","last_undegraded":"2024-09-21T03:26:32.750673+0000","last_fullsized":"2024-09-21T03:26:32.750673+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.760991+0000","last_change":"2024-09-21T03:26:32.758610+0000","last_active":"2024-09-21T03:26:32.760991+0000","last_peered":"2024-09-21T03:26:32.760991+0000","last_clean":"2024-09-21T03:26:32.760991+0000","last_became_active":"2024-09-21T03:26:32.758254+0000","last_became_peered":"2024-09-21T03:26:32.758254+0000","last_unstale":"2024-09-21T03:26:32.760991+0000","last_undegraded":"2024-09-21T03:26:32.760991+0000","last_fullsized":"2024-09-21T03:26:32.760991+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:21.051537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.752545+0000","last_change":"2024-09-21T03:26:32.752545+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.752545+0000","last_undegraded":"2024-09-21T03:26:32.752545+0000","last_fullsized":"2024-09-21T03:26:32.752545+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.765878+0000","last_change":"2024-09-21T03:26:32.763498+0000","last_active":"2024-09-21T03:26:32.765878+0000","last_peered":"2024-09-21T03:26:32.765878+0000","last_clean":"2024-09-21T03:26:32.765878+0000","last_became_active":"2024-09-21T03:26:32.763195+0000","last_became_peered":"2024-09-21T03:26:32.763195+0000","last_unstale":"2024-09-21T03:26:32.765878+0000","last_undegraded":"2024-09-21T03:26:32.765878+0000","last_fullsized":"2024-09-21T03:26:32.765878+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:42.291015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749304+0000","last_change":"2024-09-21T03:26:32.749304+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749304+0000","last_undegraded":"2024-09-21T03:26:32.749304+0000","last_fullsized":"2024-09-21T03:26:32.749304+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.765017+0000","last_change":"2024-09-21T03:26:32.763210+0000","last_active":"2024-09-21T03:26:32.765017+0000","last_peered":"2024-09-21T03:26:32.765017+0000","last_clean":"2024-09-21T03:26:32.765017+0000","last_became_active":"2024-09-21T03:26:32.762766+0000","last_became_peered":"2024-09-21T03:26:32.762766+0000","last_unstale":"2024-09-21T03:26:32.765017+0000","last_undegraded":"2024-09-21T03:26:32.765017+0000","last_fullsized":"2024-09-21T03:26:32.765017+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:42.291015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.753733+0000","last_change":"2024-09-21T03:26:32.753733+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.753733+0000","last_undegraded":"2024-09-21T03:26:32.753733+0000","last_fullsized":"2024-09-21T03:26:32.753733+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"128'6","reported_seq":21,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959389+0000","last_change":"2024-09-21T03:26:32.759495+0000","last_active":"2024-09-21T03:26:34.959389+0000","last_peered":"2024-09-21T03:26:34.959389+0000","last_clean":"2024-09-21T03:26:34.959389+0000","last_became_active":"2024-09-21T03:26:32.759122+0000","last_became_peered":"2024-09-21T03:26:32.759122+0000","last_unstale":"2024-09-21T03:26:34.959389+0000","last_undegraded":"2024-09-21T03:26:34.959389+0000","last_fullsized":"2024-09-21T03:26:34.959389+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:20.416584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750961+0000","last_change":"2024-09-21T03:26:32.750961+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750961+0000","last_undegraded":"2024-09-21T03:26:32.750961+0000","last_fullsized":"2024-09-21T03:26:32.750961+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.763828+0000","last_change":"2024-09-21T03:26:32.760470+0000","last_active":"2024-09-21T03:26:32.763828+0000","last_peered":"2024-09-21T03:26:32.763828+0000","last_clean":"2024-09-21T03:26:32.763828+0000","last_became_active":"2024-09-21T03:26:32.760171+0000","last_became_peered":"2024-09-21T03:26:32.760171+0000","last_unstale":"2024-09-21T03:26:32.763828+0000","last_undegraded":"2024-09-21T03:26:32.763828+0000","last_fullsized":"2024-09-21T03:26:32.763828+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:39.364503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749138+0000","last_change":"2024-09-21T03:26:32.749138+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749138+0000","last_undegraded":"2024-09-21T03:26:32.749138+0000","last_fullsized":"2024-09-21T03:26:32.749138+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.764078+0000","last_change":"2024-09-21T03:26:32.762314+0000","last_active":"2024-09-21T03:26:32.764078+0000","last_peered":"2024-09-21T03:26:32.764078+0000","last_clean":"2024-09-21T03:26:32.764078+0000","last_became_active":"2024-09-21T03:26:32.762003+0000","last_became_peered":"2024-09-21T03:26:32.762003+0000","last_unstale":"2024-09-21T03:26:32.764078+0000","last_undegraded":"2024-09-21T03:26:32.764078+0000","last_fullsized":"2024-09-21T03:26:32.764078+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:21.051537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750769+0000","last_change":"2024-09-21T03:26:32.750769+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750769+0000","last_undegraded":"2024-09-21T03:26:32.750769+0000","last_fullsized":"2024-09-21T03:26:32.750769+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.763283+0000","last_change":"2024-09-21T03:26:32.756831+0000","last_active":"2024-09-21T03:26:32.763283+0000","last_peered":"2024-09-21T03:26:32.763283+0000","last_clean":"2024-09-21T03:26:32.763283+0000","last_became_active":"2024-09-21T03:26:32.756494+0000","last_became_peered":"2024-09-21T03:26:32.756494+0000","last_unstale":"2024-09-21T03:26:32.763283+0000","last_undegraded":"2024-09-21T03:26:32.763283+0000","last_fullsized":"2024-09-21T03:26:32.763283+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:14.393309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749907+0000","last_change":"2024-09-21T03:26:32.749907+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749907+0000","last_undegraded":"2024-09-21T03:26:32.749907+0000","last_fullsized":"2024-09-21T03:26:32.749907+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.766637+0000","last_change":"2024-09-21T03:26:32.764507+0000","last_active":"2024-09-21T03:26:32.766637+0000","last_peered":"2024-09-21T03:26:32.766637+0000","last_clean":"2024-09-21T03:26:32.766637+0000","last_became_active":"2024-09-21T03:26:32.764170+0000","last_became_peered":"2024-09-21T03:26:32.764170+0000","last_unstale":"2024-09-21T03:26:32.766637+0000","last_undegraded":"2024-09-21T03:26:32.766637+0000","last_fullsized":"2024-09-21T03:26:32.766637+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:29.112426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749546+0000","last_change":"2024-09-21T03:26:32.749546+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749546+0000","last_undegraded":"2024-09-21T03:26:32.749546+0000","last_fullsized":"2024-09-21T03:26:32.749546+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.762427+0000","last_change":"2024-09-21T03:26:32.761374+0000","last_active":"2024-09-21T03:26:32.762427+0000","last_peered":"2024-09-21T03:26:32.762427+0000","last_clean":"2024-09-21T03:26:32.762427+0000","last_became_active":"2024-09-21T03:26:32.761046+0000","last_became_peered":"2024-09-21T03:26:32.761046+0000","last_unstale":"2024-09-21T03:26:32.762427+0000","last_undegraded":"2024-09-21T03:26:32.762427+0000","last_fullsized":"2024-09-21T03:26:32.762427+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:29:36.028915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751405+0000","last_change":"2024-09-21T03:26:32.751405+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751405+0000","last_undegraded":"2024-09-21T03:26:32.751405+0000","last_fullsized":"2024-09-21T03:26:32.751405+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.766127+0000","last_change":"2024-09-21T03:26:32.765118+0000","last_active":"2024-09-21T03:26:32.766127+0000","last_peered":"2024-09-21T03:26:32.766127+0000","last_clean":"2024-09-21T03:26:32.766127+0000","last_became_active":"2024-09-21T03:26:32.764807+0000","last_became_peered":"2024-09-21T03:26:32.764807+0000","last_unstale":"2024-09-21T03:26:32.766127+0000","last_undegraded":"2024-09-21T03:26:32.766127+0000","last_fullsized":"2024-09-21T03:26:32.766127+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:38:44.642701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751162+0000","last_change":"2024-09-21T03:26:32.751162+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751162+0000","last_undegraded":"2024-09-21T03:26:32.751162+0000","last_fullsized":"2024-09-21T03:26:32.751162+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.767748+0000","last_change":"2024-09-21T03:26:32.766023+0000","last_active":"2024-09-21T03:26:32.767748+0000","last_peered":"2024-09-21T03:26:32.767748+0000","last_clean":"2024-09-21T03:26:32.767748+0000","last_became_active":"2024-09-21T03:26:32.765690+0000","last_became_peered":"2024-09-21T03:26:32.765690+0000","last_unstale":"2024-09-21T03:26:32.767748+0000","last_undegraded":"2024-09-21T03:26:32.767748+0000","last_fullsized":"2024-09-21T03:26:32.767748+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:07:37.086442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749087+0000","last_change":"2024-09-21T03:26:32.749087+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749087+0000","last_undegraded":"2024-09-21T03:26:32.749087+0000","last_fullsized":"2024-09-21T03:26:32.749087+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.765989+0000","last_change":"2024-09-21T03:26:32.761613+0000","last_active":"2024-09-21T03:26:32.765989+0000","last_peered":"2024-09-21T03:26:32.765989+0000","last_clean":"2024-09-21T03:26:32.765989+0000","last_became_active":"2024-09-21T03:26:32.761327+0000","last_became_peered":"2024-09-21T03:26:32.761327+0000","last_unstale":"2024-09-21T03:26:32.765989+0000","last_undegraded":"2024-09-21T03:26:32.765989+0000","last_fullsized":"2024-09-21T03:26:32.765989+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:43:56.089219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.746196+0000","last_change":"2024-09-21T03:26:32.746196+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.746196+0000","last_undegraded":"2024-09-21T03:26:32.746196+0000","last_fullsized":"2024-09-21T03:26:32.746196+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"128'2","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959425+0000","last_change":"2024-09-21T03:26:32.764098+0000","last_active":"2024-09-21T03:26:34.959425+0000","last_peered":"2024-09-21T03:26:34.959425+0000","last_clean":"2024-09-21T03:26:34.959425+0000","last_became_active":"2024-09-21T03:26:32.763369+0000","last_became_peered":"2024-09-21T03:26:32.763369+0000","last_unstale":"2024-09-21T03:26:34.959425+0000","last_undegraded":"2024-09-21T03:26:34.959425+0000","last_fullsized":"2024-09-21T03:26:34.959425+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:55.678113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959291+0000","last_change":"2024-09-21T03:26:33.778124+0000","last_active":"2024-09-21T03:26:34.959291+0000","last_peered":"2024-09-21T03:26:34.959291+0000","last_clean":"2024-09-21T03:26:34.959291+0000","last_became_active":"2024-09-21T03:26:33.777780+0000","last_became_peered":"2024-09-21T03:26:33.777780+0000","last_unstale":"2024-09-21T03:26:34.959291+0000","last_undegraded":"2024-09-21T03:26:34.959291+0000","last_fullsized":"2024-09-21T03:26:34.959291+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:20.865258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.766725+0000","last_change":"2024-09-21T03:26:32.764723+0000","last_active":"2024-09-21T03:26:32.766725+0000","last_peered":"2024-09-21T03:26:32.766725+0000","last_clean":"2024-09-21T03:26:32.766725+0000","last_became_active":"2024-09-21T03:26:32.764235+0000","last_became_peered":"2024-09-21T03:26:32.764235+0000","last_unstale":"2024-09-21T03:26:32.766725+0000","last_undegraded":"2024-09-21T03:26:32.766725+0000","last_fullsized":"2024-09-21T03:26:32.766725+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:43.499221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.746748+0000","last_change":"2024-09-21T03:26:32.746748+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.746748+0000","last_undegraded":"2024-09-21T03:26:32.746748+0000","last_fullsized":"2024-09-21T03:26:32.746748+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.771880+0000","last_change":"2024-09-21T03:26:32.767045+0000","last_active":"2024-09-21T03:26:32.771880+0000","last_peered":"2024-09-21T03:26:32.771880+0000","last_clean":"2024-09-21T03:26:32.771880+0000","last_became_active":"2024-09-21T03:26:32.766543+0000","last_became_peered":"2024-09-21T03:26:32.766543+0000","last_unstale":"2024-09-21T03:26:32.771880+0000","last_undegraded":"2024-09-21T03:26:32.771880+0000","last_fullsized":"2024-09-21T03:26:32.771880+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:37.061012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.958608+0000","last_change":"2024-09-21T03:26:33.778377+0000","last_active":"2024-09-21T03:26:34.958608+0000","last_peered":"2024-09-21T03:26:34.958608+0000","last_clean":"2024-09-21T03:26:34.958608+0000","last_became_active":"2024-09-21T03:26:33.778077+0000","last_became_peered":"2024-09-21T03:26:33.778077+0000","last_unstale":"2024-09-21T03:26:34.958608+0000","last_undegraded":"2024-09-21T03:26:34.958608+0000","last_fullsized":"2024-09-21T03:26:34.958608+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:22.283748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.764892+0000","last_change":"2024-09-21T03:26:32.763204+0000","last_active":"2024-09-21T03:26:32.764892+0000","last_peered":"2024-09-21T03:26:32.764892+0000","last_clean":"2024-09-21T03:26:32.764892+0000","last_became_active":"2024-09-21T03:26:32.762314+0000","last_became_peered":"2024-09-21T03:26:32.762314+0000","last_unstale":"2024-09-21T03:26:32.764892+0000","last_undegraded":"2024-09-21T03:26:32.764892+0000","last_fullsized":"2024-09-21T03:26:32.764892+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:44:38.489230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751643+0000","last_change":"2024-09-21T03:26:32.751643+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751643+0000","last_undegraded":"2024-09-21T03:26:32.751643+0000","last_fullsized":"2024-09-21T03:26:32.751643+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.764979+0000","last_change":"2024-09-21T03:26:32.763095+0000","last_active":"2024-09-21T03:26:32.764979+0000","last_peered":"2024-09-21T03:26:32.764979+0000","last_clean":"2024-09-21T03:26:32.764979+0000","last_became_active":"2024-09-21T03:26:32.762758+0000","last_became_peered":"2024-09-21T03:26:32.762758+0000","last_unstale":"2024-09-21T03:26:32.764979+0000","last_undegraded":"2024-09-21T03:26:32.764979+0000","last_fullsized":"2024-09-21T03:26:32.764979+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:43.159607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.752344+0000","last_change":"2024-09-21T03:26:32.752344+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.752344+0000","last_undegraded":"2024-09-21T03:26:32.752344+0000","last_fullsized":"2024-09-21T03:26:32.752344+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.753832+0000","last_change":"2024-09-21T03:26:32.752528+0000","last_active":"2024-09-21T03:26:32.753832+0000","last_peered":"2024-09-21T03:26:32.753832+0000","last_clean":"2024-09-21T03:26:32.753832+0000","last_became_active":"2024-09-21T03:26:32.752205+0000","last_became_peered":"2024-09-21T03:26:32.752205+0000","last_unstale":"2024-09-21T03:26:32.753832+0000","last_undegraded":"2024-09-21T03:26:32.753832+0000","last_fullsized":"2024-09-21T03:26:32.753832+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:27.024217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751797+0000","last_change":"2024-09-21T03:26:32.751797+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751797+0000","last_undegraded":"2024-09-21T03:26:32.751797+0000","last_fullsized":"2024-09-21T03:26:32.751797+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.762171+0000","last_change":"2024-09-21T03:26:32.758409+0000","last_active":"2024-09-21T03:26:32.762171+0000","last_peered":"2024-09-21T03:26:32.762171+0000","last_clean":"2024-09-21T03:26:32.762171+0000","last_became_active":"2024-09-21T03:26:32.758112+0000","last_became_peered":"2024-09-21T03:26:32.758112+0000","last_unstale":"2024-09-21T03:26:32.762171+0000","last_undegraded":"2024-09-21T03:26:32.762171+0000","last_fullsized":"2024-09-21T03:26:32.762171+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:08:21.928238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.748534+0000","last_change":"2024-09-21T03:26:32.748534+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.748534+0000","last_undegraded":"2024-09-21T03:26:32.748534+0000","last_fullsized":"2024-09-21T03:26:32.748534+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.764765+0000","last_change":"2024-09-21T03:26:32.761270+0000","last_active":"2024-09-21T03:26:32.764765+0000","last_peered":"2024-09-21T03:26:32.764765+0000","last_clean":"2024-09-21T03:26:32.764765+0000","last_became_active":"2024-09-21T03:26:32.760986+0000","last_became_peered":"2024-09-21T03:26:32.760986+0000","last_unstale":"2024-09-21T03:26:32.764765+0000","last_undegraded":"2024-09-21T03:26:32.764765+0000","last_fullsized":"2024-09-21T03:26:32.764765+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:04.235753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.753998+0000","last_change":"2024-09-21T03:26:32.753998+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.753998+0000","last_undegraded":"2024-09-21T03:26:32.753998+0000","last_fullsized":"2024-09-21T03:26:32.753998+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959509+0000","last_change":"2024-09-21T03:26:32.763753+0000","last_active":"2024-09-21T03:26:34.959509+0000","last_peered":"2024-09-21T03:26:34.959509+0000","last_clean":"2024-09-21T03:26:34.959509+0000","last_became_active":"2024-09-21T03:26:32.762836+0000","last_became_peered":"2024-09-21T03:26:32.762836+0000","last_unstale":"2024-09-21T03:26:34.959509+0000","last_undegraded":"2024-09-21T03:26:34.959509+0000","last_fullsized":"2024-09-21T03:26:34.959509+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:51.853935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751544+0000","last_change":"2024-09-21T03:26:32.751544+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751544+0000","last_undegraded":"2024-09-21T03:26:32.751544+0000","last_fullsized":"2024-09-21T03:26:32.751544+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.769158+0000","last_change":"2024-09-21T03:26:32.764798+0000","last_active":"2024-09-21T03:26:32.769158+0000","last_peered":"2024-09-21T03:26:32.769158+0000","last_clean":"2024-09-21T03:26:32.769158+0000","last_became_active":"2024-09-21T03:26:32.764469+0000","last_became_peered":"2024-09-21T03:26:32.764469+0000","last_unstale":"2024-09-21T03:26:32.769158+0000","last_undegraded":"2024-09-21T03:26:32.769158+0000","last_fullsized":"2024-09-21T03:26:32.769158+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:38:44.642701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750392+0000","last_change":"2024-09-21T03:26:32.750392+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750392+0000","last_undegraded":"2024-09-21T03:26:32.750392+0000","last_fullsized":"2024-09-21T03:26:32.750392+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.761576+0000","last_change":"2024-09-21T03:26:32.757614+0000","last_active":"2024-09-21T03:26:32.761576+0000","last_peered":"2024-09-21T03:26:32.761576+0000","last_clean":"2024-09-21T03:26:32.761576+0000","last_became_active":"2024-09-21T03:26:32.757332+0000","last_became_peered":"2024-09-21T03:26:32.757332+0000","last_unstale":"2024-09-21T03:26:32.761576+0000","last_undegraded":"2024-09-21T03:26:32.761576+0000","last_fullsized":"2024-09-21T03:26:32.761576+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:01:59.982817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750113+0000","last_change":"2024-09-21T03:26:32.750113+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750113+0000","last_undegraded":"2024-09-21T03:26:32.750113+0000","last_fullsized":"2024-09-21T03:26:32.750113+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.765761+0000","last_change":"2024-09-21T03:26:32.762505+0000","last_active":"2024-09-21T03:26:32.765761+0000","last_peered":"2024-09-21T03:26:32.765761+0000","last_clean":"2024-09-21T03:26:32.765761+0000","last_became_active":"2024-09-21T03:26:32.762188+0000","last_became_peered":"2024-09-21T03:26:32.762188+0000","last_unstale":"2024-09-21T03:26:32.765761+0000","last_undegraded":"2024-09-21T03:26:32.765761+0000","last_fullsized":"2024-09-21T03:26:32.765761+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:43.159607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959254+0000","last_change":"2024-09-21T03:26:33.778553+0000","last_active":"2024-09-21T03:26:34.959254+0000","last_peered":"2024-09-21T03:26:34.959254+0000","last_clean":"2024-09-21T03:26:34.959254+0000","last_became_active":"2024-09-21T03:26:33.777840+0000","last_became_peered":"2024-09-21T03:26:33.777840+0000","last_unstale":"2024-09-21T03:26:34.959254+0000","last_undegraded":"2024-09-21T03:26:34.959254+0000","last_fullsized":"2024-09-21T03:26:34.959254+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:54.479070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.769337+0000","last_change":"2024-09-21T03:26:32.767343+0000","last_active":"2024-09-21T03:26:32.769337+0000","last_peered":"2024-09-21T03:26:32.769337+0000","last_clean":"2024-09-21T03:26:32.769337+0000","last_became_active":"2024-09-21T03:26:32.767009+0000","last_became_peered":"2024-09-21T03:26:32.767009+0000","last_unstale":"2024-09-21T03:26:32.769337+0000","last_undegraded":"2024-09-21T03:26:32.769337+0000","last_fullsized":"2024-09-21T03:26:32.769337+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:15.581950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":309,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.753238+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:26:32.753238+0000","last_peered":"2024-09-21T03:26:32.753238+0000","last_clean":"2024-09-21T03:26:32.753238+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:26:32.753238+0000","last_undegraded":"2024-09-21T03:26:32.753238+0000","last_fullsized":"2024-09-21T03:26:32.753238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509544,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33320,"kb_used_data":2128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338520,"statfs":{"total":96636764160,"available":96602644480,"internally_reserved":0,"allocated":2179072,"data_stored":1267549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509543,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32736,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339104,"statfs":{"total":96636764160,"available":96603242496,"internally_reserved":0,"allocated":1585152,"data_stored":677181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509542,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32740,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339100,"statfs":{"total":96636764160,"available":96603238400,"internally_reserved":0,"allocated":1585152,"data_stored":677181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509542,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32736,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339104,"statfs":{"total":96636764160,"available":96603242496,"internally_reserved":0,"allocated":1585152,"data_stored":677181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509543,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32740,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339100,"statfs":{"total":96636764160,"available":96603238400,"internally_reserved":0,"allocated":1585152,"data_stored":677181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509543,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36900,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334940,"statfs":{"total":96636764160,"available":96598978560,"internally_reserved":0,"allocated":1585152,"data_stored":677181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509543,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36900,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334940,"statfs":{"total":96636764160,"available":96598978560,"internally_reserved":0,"allocated":1585152,"data_stored":677181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574951,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33360,"kb_used_data":2168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338480,"statfs":{"total":96636764160,"available":96602603520,"internally_reserved":0,"allocated":2220032,"data_stored":1282270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:26:38.502 INFO:tasks.ceph.ceph_manager.ceph:PG 21.3f is not active+clean 2024-09-21T03:26:38.502 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.753441+0000', 'last_change': '2024-09-21T03:26:32.753441+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.753441+0000', 'last_undegraded': '2024-09-21T03:26:32.753441+0000', 'last_fullsized': '2024-09-21T03:26:32.753441+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T03:26:38.503 INFO:tasks.ceph.ceph_manager.ceph:PG 21.3e is not active+clean 2024-09-21T03:26:38.503 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.749709+0000', 'last_change': '2024-09-21T03:26:32.749709+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.749709+0000', 'last_undegraded': '2024-09-21T03:26:32.749709+0000', 'last_fullsized': '2024-09-21T03:26:32.749709+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T03:26:38.503 INFO:tasks.ceph.ceph_manager.ceph:PG 21.3d is not active+clean 2024-09-21T03:26:38.503 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.751495+0000', 'last_change': '2024-09-21T03:26:32.751495+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.751495+0000', 'last_undegraded': '2024-09-21T03:26:32.751495+0000', 'last_fullsized': '2024-09-21T03:26:32.751495+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T03:26:38.503 INFO:tasks.ceph.ceph_manager.ceph:PG 21.3c is not active+clean 2024-09-21T03:26:38.503 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.747033+0000', 'last_change': '2024-09-21T03:26:32.747033+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.747033+0000', 'last_undegraded': '2024-09-21T03:26:32.747033+0000', 'last_fullsized': '2024-09-21T03:26:32.747033+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T03:26:38.503 INFO:tasks.ceph.ceph_manager.ceph:PG 21.3b is not active+clean 2024-09-21T03:26:38.503 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.752535+0000', 'last_change': '2024-09-21T03:26:32.752535+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.752535+0000', 'last_undegraded': '2024-09-21T03:26:32.752535+0000', 'last_fullsized': '2024-09-21T03:26:32.752535+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T03:26:38.503 INFO:tasks.ceph.ceph_manager.ceph:PG 21.3a is not active+clean 2024-09-21T03:26:38.503 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.752456+0000', 'last_change': '2024-09-21T03:26:32.752456+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.752456+0000', 'last_undegraded': '2024-09-21T03:26:32.752456+0000', 'last_fullsized': '2024-09-21T03:26:32.752456+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T03:26:38.503 INFO:tasks.ceph.ceph_manager.ceph:PG 21.38 is not active+clean 2024-09-21T03:26:38.503 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.751924+0000', 'last_change': '2024-09-21T03:26:32.751924+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.751924+0000', 'last_undegraded': '2024-09-21T03:26:32.751924+0000', 'last_fullsized': '2024-09-21T03:26:32.751924+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T03:26:38.504 INFO:tasks.ceph.ceph_manager.ceph:PG 21.37 is not active+clean 2024-09-21T03:26:38.504 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.753085+0000', 'last_change': '2024-09-21T03:26:32.753085+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.753085+0000', 'last_undegraded': '2024-09-21T03:26:32.753085+0000', 'last_fullsized': '2024-09-21T03:26:32.753085+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T03:26:38.504 INFO:tasks.ceph.ceph_manager.ceph:PG 21.36 is not active+clean 2024-09-21T03:26:38.504 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.752886+0000', 'last_change': '2024-09-21T03:26:32.752886+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.752886+0000', 'last_undegraded': '2024-09-21T03:26:32.752886+0000', 'last_fullsized': '2024-09-21T03:26:32.752886+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T03:26:38.504 INFO:tasks.ceph.ceph_manager.ceph:PG 21.35 is not active+clean 2024-09-21T03:26:38.504 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.751340+0000', 'last_change': '2024-09-21T03:26:32.751340+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.751340+0000', 'last_undegraded': '2024-09-21T03:26:32.751340+0000', 'last_fullsized': '2024-09-21T03:26:32.751340+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T03:26:38.504 INFO:tasks.ceph.ceph_manager.ceph:PG 21.34 is not active+clean 2024-09-21T03:26:38.504 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.751532+0000', 'last_change': '2024-09-21T03:26:32.751532+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.751532+0000', 'last_undegraded': '2024-09-21T03:26:32.751532+0000', 'last_fullsized': '2024-09-21T03:26:32.751532+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T03:26:38.504 INFO:tasks.ceph.ceph_manager.ceph:PG 21.33 is not active+clean 2024-09-21T03:26:38.504 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.752050+0000', 'last_change': '2024-09-21T03:26:32.752050+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.752050+0000', 'last_undegraded': '2024-09-21T03:26:32.752050+0000', 'last_fullsized': '2024-09-21T03:26:32.752050+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T03:26:38.504 INFO:tasks.ceph.ceph_manager.ceph:PG 21.32 is not active+clean 2024-09-21T03:26:38.504 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.748249+0000', 'last_change': '2024-09-21T03:26:32.748249+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.748249+0000', 'last_undegraded': '2024-09-21T03:26:32.748249+0000', 'last_fullsized': '2024-09-21T03:26:32.748249+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T03:26:38.505 INFO:tasks.ceph.ceph_manager.ceph:PG 21.31 is not active+clean 2024-09-21T03:26:38.505 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.748727+0000', 'last_change': '2024-09-21T03:26:32.748727+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.748727+0000', 'last_undegraded': '2024-09-21T03:26:32.748727+0000', 'last_fullsized': '2024-09-21T03:26:32.748727+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T03:26:38.505 INFO:tasks.ceph.ceph_manager.ceph:PG 21.30 is not active+clean 2024-09-21T03:26:38.505 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.750304+0000', 'last_change': '2024-09-21T03:26:32.750304+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.750304+0000', 'last_undegraded': '2024-09-21T03:26:32.750304+0000', 'last_fullsized': '2024-09-21T03:26:32.750304+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T03:26:38.505 INFO:tasks.ceph.ceph_manager.ceph:PG 21.2f is not active+clean 2024-09-21T03:26:38.505 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.749863+0000', 'last_change': '2024-09-21T03:26:32.749863+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.749863+0000', 'last_undegraded': '2024-09-21T03:26:32.749863+0000', 'last_fullsized': '2024-09-21T03:26:32.749863+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T03:26:38.505 INFO:tasks.ceph.ceph_manager.ceph:PG 21.2e is not active+clean 2024-09-21T03:26:38.505 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.751293+0000', 'last_change': '2024-09-21T03:26:32.751293+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.751293+0000', 'last_undegraded': '2024-09-21T03:26:32.751293+0000', 'last_fullsized': '2024-09-21T03:26:32.751293+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T03:26:38.505 INFO:tasks.ceph.ceph_manager.ceph:PG 21.2d is not active+clean 2024-09-21T03:26:38.505 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.750791+0000', 'last_change': '2024-09-21T03:26:32.750791+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.750791+0000', 'last_undegraded': '2024-09-21T03:26:32.750791+0000', 'last_fullsized': '2024-09-21T03:26:32.750791+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T03:26:38.505 INFO:tasks.ceph.ceph_manager.ceph:PG 21.2c is not active+clean 2024-09-21T03:26:38.505 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.749980+0000', 'last_change': '2024-09-21T03:26:32.749980+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.749980+0000', 'last_undegraded': '2024-09-21T03:26:32.749980+0000', 'last_fullsized': '2024-09-21T03:26:32.749980+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T03:26:38.505 INFO:tasks.ceph.ceph_manager.ceph:PG 21.2b is not active+clean 2024-09-21T03:26:38.506 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.749140+0000', 'last_change': '2024-09-21T03:26:32.749140+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.749140+0000', 'last_undegraded': '2024-09-21T03:26:32.749140+0000', 'last_fullsized': '2024-09-21T03:26:32.749140+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T03:26:38.506 INFO:tasks.ceph.ceph_manager.ceph:PG 21.2a is not active+clean 2024-09-21T03:26:38.506 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.747627+0000', 'last_change': '2024-09-21T03:26:32.747627+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.747627+0000', 'last_undegraded': '2024-09-21T03:26:32.747627+0000', 'last_fullsized': '2024-09-21T03:26:32.747627+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T03:26:38.506 INFO:tasks.ceph.ceph_manager.ceph:PG 21.29 is not active+clean 2024-09-21T03:26:38.506 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.746033+0000', 'last_change': '2024-09-21T03:26:32.746033+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.746033+0000', 'last_undegraded': '2024-09-21T03:26:32.746033+0000', 'last_fullsized': '2024-09-21T03:26:32.746033+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T03:26:38.506 INFO:tasks.ceph.ceph_manager.ceph:PG 21.28 is not active+clean 2024-09-21T03:26:38.506 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.750847+0000', 'last_change': '2024-09-21T03:26:32.750847+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.750847+0000', 'last_undegraded': '2024-09-21T03:26:32.750847+0000', 'last_fullsized': '2024-09-21T03:26:32.750847+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T03:26:38.506 INFO:tasks.ceph.ceph_manager.ceph:PG 21.27 is not active+clean 2024-09-21T03:26:38.506 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.751882+0000', 'last_change': '2024-09-21T03:26:32.751882+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.751882+0000', 'last_undegraded': '2024-09-21T03:26:32.751882+0000', 'last_fullsized': '2024-09-21T03:26:32.751882+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T03:26:38.506 INFO:tasks.ceph.ceph_manager.ceph:PG 21.26 is not active+clean 2024-09-21T03:26:38.506 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.750209+0000', 'last_change': '2024-09-21T03:26:32.750209+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.750209+0000', 'last_undegraded': '2024-09-21T03:26:32.750209+0000', 'last_fullsized': '2024-09-21T03:26:32.750209+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T03:26:38.506 INFO:tasks.ceph.ceph_manager.ceph:PG 21.25 is not active+clean 2024-09-21T03:26:38.507 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.754270+0000', 'last_change': '2024-09-21T03:26:32.754270+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.754270+0000', 'last_undegraded': '2024-09-21T03:26:32.754270+0000', 'last_fullsized': '2024-09-21T03:26:32.754270+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T03:26:38.507 INFO:tasks.ceph.ceph_manager.ceph:PG 21.23 is not active+clean 2024-09-21T03:26:38.507 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.750908+0000', 'last_change': '2024-09-21T03:26:32.750908+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.750908+0000', 'last_undegraded': '2024-09-21T03:26:32.750908+0000', 'last_fullsized': '2024-09-21T03:26:32.750908+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T03:26:38.507 INFO:tasks.ceph.ceph_manager.ceph:PG 21.22 is not active+clean 2024-09-21T03:26:38.507 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.747099+0000', 'last_change': '2024-09-21T03:26:32.747099+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.747099+0000', 'last_undegraded': '2024-09-21T03:26:32.747099+0000', 'last_fullsized': '2024-09-21T03:26:32.747099+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T03:26:38.507 INFO:tasks.ceph.ceph_manager.ceph:PG 21.21 is not active+clean 2024-09-21T03:26:38.507 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.749457+0000', 'last_change': '2024-09-21T03:26:32.749457+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.749457+0000', 'last_undegraded': '2024-09-21T03:26:32.749457+0000', 'last_fullsized': '2024-09-21T03:26:32.749457+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T03:26:38.507 INFO:tasks.ceph.ceph_manager.ceph:PG 21.20 is not active+clean 2024-09-21T03:26:38.507 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.749762+0000', 'last_change': '2024-09-21T03:26:32.749762+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.749762+0000', 'last_undegraded': '2024-09-21T03:26:32.749762+0000', 'last_fullsized': '2024-09-21T03:26:32.749762+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T03:26:38.507 INFO:tasks.ceph.ceph_manager.ceph:PG 21.1e is not active+clean 2024-09-21T03:26:38.507 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.750324+0000', 'last_change': '2024-09-21T03:26:32.750324+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.750324+0000', 'last_undegraded': '2024-09-21T03:26:32.750324+0000', 'last_fullsized': '2024-09-21T03:26:32.750324+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T03:26:38.507 INFO:tasks.ceph.ceph_manager.ceph:PG 21.1f is not active+clean 2024-09-21T03:26:38.508 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.752601+0000', 'last_change': '2024-09-21T03:26:32.752601+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.752601+0000', 'last_undegraded': '2024-09-21T03:26:32.752601+0000', 'last_fullsized': '2024-09-21T03:26:32.752601+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T03:26:38.508 INFO:tasks.ceph.ceph_manager.ceph:PG 21.1c is not active+clean 2024-09-21T03:26:38.508 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.749686+0000', 'last_change': '2024-09-21T03:26:32.749686+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.749686+0000', 'last_undegraded': '2024-09-21T03:26:32.749686+0000', 'last_fullsized': '2024-09-21T03:26:32.749686+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T03:26:38.508 INFO:tasks.ceph.ceph_manager.ceph:PG 21.1d is not active+clean 2024-09-21T03:26:38.508 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.749592+0000', 'last_change': '2024-09-21T03:26:32.749592+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.749592+0000', 'last_undegraded': '2024-09-21T03:26:32.749592+0000', 'last_fullsized': '2024-09-21T03:26:32.749592+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T03:26:38.508 INFO:tasks.ceph.ceph_manager.ceph:PG 21.1a is not active+clean 2024-09-21T03:26:38.508 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.750511+0000', 'last_change': '2024-09-21T03:26:32.750511+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.750511+0000', 'last_undegraded': '2024-09-21T03:26:32.750511+0000', 'last_fullsized': '2024-09-21T03:26:32.750511+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T03:26:38.508 INFO:tasks.ceph.ceph_manager.ceph:PG 21.1b is not active+clean 2024-09-21T03:26:38.508 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.747045+0000', 'last_change': '2024-09-21T03:26:32.747045+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.747045+0000', 'last_undegraded': '2024-09-21T03:26:32.747045+0000', 'last_fullsized': '2024-09-21T03:26:32.747045+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T03:26:38.508 INFO:tasks.ceph.ceph_manager.ceph:PG 21.18 is not active+clean 2024-09-21T03:26:38.508 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.750553+0000', 'last_change': '2024-09-21T03:26:32.750553+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.750553+0000', 'last_undegraded': '2024-09-21T03:26:32.750553+0000', 'last_fullsized': '2024-09-21T03:26:32.750553+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T03:26:38.509 INFO:tasks.ceph.ceph_manager.ceph:PG 21.19 is not active+clean 2024-09-21T03:26:38.509 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.750673+0000', 'last_change': '2024-09-21T03:26:32.750673+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.750673+0000', 'last_undegraded': '2024-09-21T03:26:32.750673+0000', 'last_fullsized': '2024-09-21T03:26:32.750673+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T03:26:38.509 INFO:tasks.ceph.ceph_manager.ceph:PG 21.16 is not active+clean 2024-09-21T03:26:38.509 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.752545+0000', 'last_change': '2024-09-21T03:26:32.752545+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.752545+0000', 'last_undegraded': '2024-09-21T03:26:32.752545+0000', 'last_fullsized': '2024-09-21T03:26:32.752545+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T03:26:38.509 INFO:tasks.ceph.ceph_manager.ceph:PG 21.17 is not active+clean 2024-09-21T03:26:38.509 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.749304+0000', 'last_change': '2024-09-21T03:26:32.749304+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.749304+0000', 'last_undegraded': '2024-09-21T03:26:32.749304+0000', 'last_fullsized': '2024-09-21T03:26:32.749304+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T03:26:38.509 INFO:tasks.ceph.ceph_manager.ceph:PG 21.15 is not active+clean 2024-09-21T03:26:38.509 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.753733+0000', 'last_change': '2024-09-21T03:26:32.753733+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.753733+0000', 'last_undegraded': '2024-09-21T03:26:32.753733+0000', 'last_fullsized': '2024-09-21T03:26:32.753733+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T03:26:38.509 INFO:tasks.ceph.ceph_manager.ceph:PG 21.12 is not active+clean 2024-09-21T03:26:38.509 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.750961+0000', 'last_change': '2024-09-21T03:26:32.750961+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.750961+0000', 'last_undegraded': '2024-09-21T03:26:32.750961+0000', 'last_fullsized': '2024-09-21T03:26:32.750961+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T03:26:38.509 INFO:tasks.ceph.ceph_manager.ceph:PG 21.13 is not active+clean 2024-09-21T03:26:38.509 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.749138+0000', 'last_change': '2024-09-21T03:26:32.749138+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.749138+0000', 'last_undegraded': '2024-09-21T03:26:32.749138+0000', 'last_fullsized': '2024-09-21T03:26:32.749138+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T03:26:38.510 INFO:tasks.ceph.ceph_manager.ceph:PG 21.10 is not active+clean 2024-09-21T03:26:38.510 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.750769+0000', 'last_change': '2024-09-21T03:26:32.750769+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.750769+0000', 'last_undegraded': '2024-09-21T03:26:32.750769+0000', 'last_fullsized': '2024-09-21T03:26:32.750769+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T03:26:38.510 INFO:tasks.ceph.ceph_manager.ceph:PG 21.11 is not active+clean 2024-09-21T03:26:38.510 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.749907+0000', 'last_change': '2024-09-21T03:26:32.749907+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.749907+0000', 'last_undegraded': '2024-09-21T03:26:32.749907+0000', 'last_fullsized': '2024-09-21T03:26:32.749907+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T03:26:38.510 INFO:tasks.ceph.ceph_manager.ceph:PG 21.e is not active+clean 2024-09-21T03:26:38.510 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.749546+0000', 'last_change': '2024-09-21T03:26:32.749546+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.749546+0000', 'last_undegraded': '2024-09-21T03:26:32.749546+0000', 'last_fullsized': '2024-09-21T03:26:32.749546+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T03:26:38.510 INFO:tasks.ceph.ceph_manager.ceph:PG 21.f is not active+clean 2024-09-21T03:26:38.510 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.751405+0000', 'last_change': '2024-09-21T03:26:32.751405+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.751405+0000', 'last_undegraded': '2024-09-21T03:26:32.751405+0000', 'last_fullsized': '2024-09-21T03:26:32.751405+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T03:26:38.510 INFO:tasks.ceph.ceph_manager.ceph:PG 21.c is not active+clean 2024-09-21T03:26:38.510 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.751162+0000', 'last_change': '2024-09-21T03:26:32.751162+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.751162+0000', 'last_undegraded': '2024-09-21T03:26:32.751162+0000', 'last_fullsized': '2024-09-21T03:26:32.751162+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T03:26:38.510 INFO:tasks.ceph.ceph_manager.ceph:PG 21.d is not active+clean 2024-09-21T03:26:38.511 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.749087+0000', 'last_change': '2024-09-21T03:26:32.749087+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.749087+0000', 'last_undegraded': '2024-09-21T03:26:32.749087+0000', 'last_fullsized': '2024-09-21T03:26:32.749087+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T03:26:38.511 INFO:tasks.ceph.ceph_manager.ceph:PG 21.a is not active+clean 2024-09-21T03:26:38.511 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.746196+0000', 'last_change': '2024-09-21T03:26:32.746196+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.746196+0000', 'last_undegraded': '2024-09-21T03:26:32.746196+0000', 'last_fullsized': '2024-09-21T03:26:32.746196+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T03:26:38.511 INFO:tasks.ceph.ceph_manager.ceph:PG 21.8 is not active+clean 2024-09-21T03:26:38.511 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.746748+0000', 'last_change': '2024-09-21T03:26:32.746748+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.746748+0000', 'last_undegraded': '2024-09-21T03:26:32.746748+0000', 'last_fullsized': '2024-09-21T03:26:32.746748+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T03:26:38.511 INFO:tasks.ceph.ceph_manager.ceph:PG 21.6 is not active+clean 2024-09-21T03:26:38.511 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.751643+0000', 'last_change': '2024-09-21T03:26:32.751643+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.751643+0000', 'last_undegraded': '2024-09-21T03:26:32.751643+0000', 'last_fullsized': '2024-09-21T03:26:32.751643+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T03:26:38.511 INFO:tasks.ceph.ceph_manager.ceph:PG 21.7 is not active+clean 2024-09-21T03:26:38.511 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.752344+0000', 'last_change': '2024-09-21T03:26:32.752344+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.752344+0000', 'last_undegraded': '2024-09-21T03:26:32.752344+0000', 'last_fullsized': '2024-09-21T03:26:32.752344+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T03:26:38.511 INFO:tasks.ceph.ceph_manager.ceph:PG 21.4 is not active+clean 2024-09-21T03:26:38.511 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.751797+0000', 'last_change': '2024-09-21T03:26:32.751797+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.751797+0000', 'last_undegraded': '2024-09-21T03:26:32.751797+0000', 'last_fullsized': '2024-09-21T03:26:32.751797+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T03:26:38.511 INFO:tasks.ceph.ceph_manager.ceph:PG 21.5 is not active+clean 2024-09-21T03:26:38.511 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.748534+0000', 'last_change': '2024-09-21T03:26:32.748534+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.748534+0000', 'last_undegraded': '2024-09-21T03:26:32.748534+0000', 'last_fullsized': '2024-09-21T03:26:32.748534+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T03:26:38.512 INFO:tasks.ceph.ceph_manager.ceph:PG 21.2 is not active+clean 2024-09-21T03:26:38.512 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.753998+0000', 'last_change': '2024-09-21T03:26:32.753998+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.753998+0000', 'last_undegraded': '2024-09-21T03:26:32.753998+0000', 'last_fullsized': '2024-09-21T03:26:32.753998+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T03:26:38.512 INFO:tasks.ceph.ceph_manager.ceph:PG 21.3 is not active+clean 2024-09-21T03:26:38.512 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.751544+0000', 'last_change': '2024-09-21T03:26:32.751544+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.751544+0000', 'last_undegraded': '2024-09-21T03:26:32.751544+0000', 'last_fullsized': '2024-09-21T03:26:32.751544+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T03:26:38.512 INFO:tasks.ceph.ceph_manager.ceph:PG 21.0 is not active+clean 2024-09-21T03:26:38.512 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.750392+0000', 'last_change': '2024-09-21T03:26:32.750392+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.750392+0000', 'last_undegraded': '2024-09-21T03:26:32.750392+0000', 'last_fullsized': '2024-09-21T03:26:32.750392+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T03:26:38.512 INFO:tasks.ceph.ceph_manager.ceph:PG 21.1 is not active+clean 2024-09-21T03:26:38.512 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:26:32.750113+0000', 'last_change': '2024-09-21T03:26:32.750113+0000', 'last_active': '2024-09-21T03:26:32.739794+0000', 'last_peered': '2024-09-21T03:26:32.739794+0000', 'last_clean': '2024-09-21T03:26:32.739794+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:26:32.750113+0000', 'last_undegraded': '2024-09-21T03:26:32.750113+0000', 'last_fullsized': '2024-09-21T03:26:32.750113+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'last_clean_scrub_stamp': '2024-09-21T03:26:32.739794+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T03:26:38.512 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T03:26:38.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.647+0000 7f730e84d640 1 -- 172.21.15.105:0/3176389111 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73080d1490 msgr2=0x7f73080cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:38.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.647+0000 7f730e84d640 1 --2- 172.21.15.105:0/3176389111 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73080d1490 0x7f73080cebf0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7300005fd0 tx=0x7f730002a8b0 comp rx=0 tx=0).stop 2024-09-21T03:26:38.651 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.647+0000 7f730e84d640 1 -- 172.21.15.105:0/3176389111 shutdown_connections 2024-09-21T03:26:38.651 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.647+0000 7f730e84d640 1 --2- 172.21.15.105:0/3176389111 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73080d1490 0x7f73080cebf0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:38.651 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.647+0000 7f730e84d640 1 --2- 172.21.15.105:0/3176389111 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73080b51c0 0x7f730815c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:38.651 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.647+0000 7f730e84d640 1 -- 172.21.15.105:0/3176389111 >> 172.21.15.105:0/3176389111 conn(0x7f7308072ae0 msgr2=0x7f7308072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:38.651 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.647+0000 7f730e84d640 1 -- 172.21.15.105:0/3176389111 shutdown_connections 2024-09-21T03:26:38.651 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.648+0000 7f730e84d640 1 -- 172.21.15.105:0/3176389111 wait complete. 2024-09-21T03:26:38.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.649+0000 7f730e84d640 1 Processor -- start 2024-09-21T03:26:38.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.649+0000 7f730e84d640 1 -- start start 2024-09-21T03:26:38.654 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.651+0000 7f730e84d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73080b51c0 0x7f73081597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:38.654 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.651+0000 7f730e84d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73080ccbd0 0x7f7308147e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:38.654 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.651+0000 7f730e84d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73080d1490 0x7f7308148890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:38.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.651+0000 7f730e84d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f73080cf2b0 con 0x7f73080d1490 2024-09-21T03:26:38.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.651+0000 7f730e84d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f73080cf130 con 0x7f73080ccbd0 2024-09-21T03:26:38.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.651+0000 7f730e84d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f73080cf430 con 0x7f73080b51c0 2024-09-21T03:26:38.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.651+0000 7f730cdea640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73080d1490 0x7f7308148890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:38.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.651+0000 7f730cdea640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73080d1490 0x7f7308148890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41142/0 (socket says 172.21.15.105:41142) 2024-09-21T03:26:38.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.651+0000 7f730cdea640 1 -- 172.21.15.105:0/3412582561 learned_addr learned my addr 172.21.15.105:0/3412582561 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:38.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.651+0000 7f7307fff640 1 --2- 172.21.15.105:0/3412582561 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73080b51c0 0x7f73081597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:38.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.651+0000 7f73077fe640 1 --2- 172.21.15.105:0/3412582561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73080ccbd0 0x7f7308147e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:38.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.651+0000 7f730cdea640 1 -- 172.21.15.105:0/3412582561 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73080b51c0 msgr2=0x7f73081597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:38.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.651+0000 7f730cdea640 1 --2- 172.21.15.105:0/3412582561 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73080b51c0 0x7f73081597b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:38.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.651+0000 7f730cdea640 1 -- 172.21.15.105:0/3412582561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73080ccbd0 msgr2=0x7f7308147e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:38.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.651+0000 7f730cdea640 1 --2- 172.21.15.105:0/3412582561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73080ccbd0 0x7f7308147e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:38.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.651+0000 7f730cdea640 1 -- 172.21.15.105:0/3412582561 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7308158270 con 0x7f73080d1490 2024-09-21T03:26:38.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.651+0000 7f730cdea640 1 --2- 172.21.15.105:0/3412582561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73080d1490 0x7f7308148890 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f7300009cd0 tx=0x7f7300033f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:38.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.651+0000 7f7304ff9640 1 -- 172.21.15.105:0/3412582561 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7300031990 con 0x7f73080d1490 2024-09-21T03:26:38.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.652+0000 7f7304ff9640 1 -- 172.21.15.105:0/3412582561 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7300031c20 con 0x7f73080d1490 2024-09-21T03:26:38.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.652+0000 7f730e84d640 1 -- 172.21.15.105:0/3412582561 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7308158710 con 0x7f73080d1490 2024-09-21T03:26:38.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.652+0000 7f7304ff9640 1 -- 172.21.15.105:0/3412582561 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73000330d0 con 0x7f73080d1490 2024-09-21T03:26:38.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.652+0000 7f730e84d640 1 -- 172.21.15.105:0/3412582561 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7308158cd0 con 0x7f73080d1490 2024-09-21T03:26:38.657 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.652+0000 7f730e84d640 1 -- 172.21.15.105:0/3412582561 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73080cf880 con 0x7f73080d1490 2024-09-21T03:26:38.657 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.653+0000 7f7304ff9640 1 -- 172.21.15.105:0/3412582561 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7300033270 con 0x7f73080d1490 2024-09-21T03:26:38.657 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.654+0000 7f7304ff9640 1 --2- 172.21.15.105:0/3412582561 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f72f4078bc0 0x7f72f407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:38.657 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.654+0000 7f7304ff9640 1 -- 172.21.15.105:0/3412582561 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7f73000bbfe0 con 0x7f73080d1490 2024-09-21T03:26:38.657 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.654+0000 7f7307fff640 1 --2- 172.21.15.105:0/3412582561 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f72f4078bc0 0x7f72f407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:38.657 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.655+0000 7f7307fff640 1 --2- 172.21.15.105:0/3412582561 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f72f4078bc0 0x7f72f407b0d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f72f8009b30 tx=0x7f72f8005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:38.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.659+0000 7f7304ff9640 1 -- 172.21.15.105:0/3412582561 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f730003f030 con 0x7f73080d1490 2024-09-21T03:26:38.908 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.906+0000 7f730e84d640 1 -- 172.21.15.105:0/3412582561 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f7308158440 con 0x7f73080d1490 2024-09-21T03:26:38.909 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.906+0000 7f7304ff9640 1 -- 172.21.15.105:0/3412582561 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1562 (secure 0 0 0) 0x7f73000317b0 con 0x7f73080d1490 2024-09-21T03:26:38.909 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:26:38.909 INFO:teuthology.orchestra.run.smithi105.stdout:{"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":514,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":129,"num_osds":8,"num_up_osds":8,"osd_up_since":1726888698,"num_in_osds":8,"osd_in_since":1726888688,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":59},{"state_name":"active+clean","count":38}],"num_pgs":97,"num_pools":3,"num_objects":7,"data_bytes":591980,"bytes_used":277946368,"bytes_avail":772816166912,"bytes_total":773094113280,"inactive_pgs_ratio":0.60824739933013916,"write_bytes_sec":541,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":84,"btime":"2024-09-21T03:26:36:777245+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"b","status":"up:active","gid":8022}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2024-09-21T03:24:55.383365+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T03:26:38.912 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.908+0000 7f730e84d640 1 -- 172.21.15.105:0/3412582561 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f72f4078bc0 msgr2=0x7f72f407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:38.912 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.908+0000 7f730e84d640 1 --2- 172.21.15.105:0/3412582561 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f72f4078bc0 0x7f72f407b0d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f72f8009b30 tx=0x7f72f8005f90 comp rx=0 tx=0).stop 2024-09-21T03:26:38.912 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.908+0000 7f730e84d640 1 -- 172.21.15.105:0/3412582561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73080d1490 msgr2=0x7f7308148890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:38.912 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.908+0000 7f730e84d640 1 --2- 172.21.15.105:0/3412582561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73080d1490 0x7f7308148890 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f7300009cd0 tx=0x7f7300033f70 comp rx=0 tx=0).stop 2024-09-21T03:26:38.912 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.908+0000 7f730e84d640 1 -- 172.21.15.105:0/3412582561 shutdown_connections 2024-09-21T03:26:38.912 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.908+0000 7f730e84d640 1 --2- 172.21.15.105:0/3412582561 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f72f4078bc0 0x7f72f407b0d0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:38.912 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.908+0000 7f730e84d640 1 --2- 172.21.15.105:0/3412582561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73080d1490 0x7f7308148890 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:38.912 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.908+0000 7f730e84d640 1 --2- 172.21.15.105:0/3412582561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73080ccbd0 0x7f7308147e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:38.912 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.908+0000 7f730e84d640 1 --2- 172.21.15.105:0/3412582561 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73080b51c0 0x7f73081597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:38.913 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.908+0000 7f730e84d640 1 -- 172.21.15.105:0/3412582561 >> 172.21.15.105:0/3412582561 conn(0x7f7308072ae0 msgr2=0x7f73080b68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:38.913 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.909+0000 7f730e84d640 1 -- 172.21.15.105:0/3412582561 shutdown_connections 2024-09-21T03:26:38.913 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:38.909+0000 7f730e84d640 1 -- 172.21.15.105:0/3412582561 wait complete. 2024-09-21T03:26:38.922 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-21T03:26:38.923 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:26:39.037 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.033+0000 7f2f6ed13640 1 -- 172.21.15.105:0/3316539720 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f50004d40 msgr2=0x7f2f50005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:39.037 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.033+0000 7f2f6ed13640 1 --2- 172.21.15.105:0/3316539720 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f50004d40 0x7f2f50005150 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f2f680cb830 tx=0x7f2f50005830 comp rx=0 tx=0).stop 2024-09-21T03:26:39.037 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.033+0000 7f2f6d2b0640 1 -- 172.21.15.105:0/3316539720 reap_dead start 2024-09-21T03:26:39.037 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.033+0000 7f2f6ed13640 1 -- 172.21.15.105:0/3316539720 shutdown_connections 2024-09-21T03:26:39.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.033+0000 7f2f6ed13640 1 -- 172.21.15.105:0/3316539720 >> 172.21.15.105:0/3316539720 conn(0x7f2f680cdcb0 msgr2=0x7f2f680ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:39.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.034+0000 7f2f6ed13640 1 -- 172.21.15.105:0/3316539720 shutdown_connections 2024-09-21T03:26:39.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.034+0000 7f2f6ed13640 1 -- 172.21.15.105:0/3316539720 wait complete. 2024-09-21T03:26:39.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.035+0000 7f2f6ed13640 1 Processor -- start 2024-09-21T03:26:39.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.035+0000 7f2f6ed13640 1 -- start start 2024-09-21T03:26:39.043 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.037+0000 7f2f6ed13640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f50004d40 0x7f2f681e1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:39.044 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.037+0000 7f2f6ed13640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f6814d810 0x7f2f6809e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:39.044 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.037+0000 7f2f6ed13640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f6809e5d0 0x7f2f681e4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:39.044 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.037+0000 7f2f6ed13640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2f68071ba0 con 0x7f2f6809e5d0 2024-09-21T03:26:39.044 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.037+0000 7f2f6ed13640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2f68071a20 con 0x7f2f50004d40 2024-09-21T03:26:39.044 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.037+0000 7f2f6ed13640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2f68071d20 con 0x7f2f6814d810 2024-09-21T03:26:39.044 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.037+0000 7f2f6d2b0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f6809e5d0 0x7f2f681e4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:39.044 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.037+0000 7f2f6d2b0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f6809e5d0 0x7f2f681e4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:41162/0 (socket says 172.21.15.105:41162) 2024-09-21T03:26:39.044 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.037+0000 7f2f6d2b0640 1 -- 172.21.15.105:0/840883174 learned_addr learned my addr 172.21.15.105:0/840883174 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:39.044 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.037+0000 7f2f6caaf640 1 --2- 172.21.15.105:0/840883174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f50004d40 0x7f2f681e1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:39.044 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.037+0000 7f2f67fff640 1 --2- 172.21.15.105:0/840883174 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f6814d810 0x7f2f6809e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:39.044 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.037+0000 7f2f6d2b0640 1 -- 172.21.15.105:0/840883174 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f6814d810 msgr2=0x7f2f6809e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:39.045 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.037+0000 7f2f6d2b0640 1 --2- 172.21.15.105:0/840883174 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f6814d810 0x7f2f6809e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:39.045 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.037+0000 7f2f6d2b0640 1 -- 172.21.15.105:0/840883174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f50004d40 msgr2=0x7f2f681e1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:39.045 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.037+0000 7f2f6d2b0640 1 --2- 172.21.15.105:0/840883174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f50004d40 0x7f2f681e1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:39.045 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.037+0000 7f2f6d2b0640 1 -- 172.21.15.105:0/840883174 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f681e0cd0 con 0x7f2f6809e5d0 2024-09-21T03:26:39.045 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.037+0000 7f2f6caaf640 1 --2- 172.21.15.105:0/840883174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f50004d40 0x7f2f681e1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:26:39.045 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.037+0000 7f2f6d2b0640 1 --2- 172.21.15.105:0/840883174 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f6809e5d0 0x7f2f681e4660 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f2f60002230 tx=0x7f2f60034bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:39.045 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.037+0000 7f2f657fa640 1 -- 172.21.15.105:0/840883174 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f60038040 con 0x7f2f6809e5d0 2024-09-21T03:26:39.045 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.037+0000 7f2f657fa640 1 -- 172.21.15.105:0/840883174 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f6002bbe0 con 0x7f2f6809e5d0 2024-09-21T03:26:39.045 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.037+0000 7f2f6ed13640 1 -- 172.21.15.105:0/840883174 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f681e0fb0 con 0x7f2f6809e5d0 2024-09-21T03:26:39.045 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.037+0000 7f2f657fa640 1 -- 172.21.15.105:0/840883174 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f60004b20 con 0x7f2f6809e5d0 2024-09-21T03:26:39.046 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.038+0000 7f2f6ed13640 1 -- 172.21.15.105:0/840883174 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f681e1570 con 0x7f2f6809e5d0 2024-09-21T03:26:39.046 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.038+0000 7f2f6ed13640 1 -- 172.21.15.105:0/840883174 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f6809eb70 con 0x7f2f6809e5d0 2024-09-21T03:26:39.046 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.039+0000 7f2f657fa640 1 -- 172.21.15.105:0/840883174 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2f60044020 con 0x7f2f6809e5d0 2024-09-21T03:26:39.046 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.040+0000 7f2f657fa640 1 --2- 172.21.15.105:0/840883174 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2f54078b90 0x7f2f5407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:39.046 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.040+0000 7f2f657fa640 1 -- 172.21.15.105:0/840883174 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7f2f600bb350 con 0x7f2f6809e5d0 2024-09-21T03:26:39.046 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.040+0000 7f2f6caaf640 1 --2- 172.21.15.105:0/840883174 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2f54078b90 0x7f2f5407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:39.046 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.040+0000 7f2f6caaf640 1 --2- 172.21.15.105:0/840883174 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2f54078b90 0x7f2f5407b0a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f2f58000f60 tx=0x7f2f58000ed0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:39.047 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.044+0000 7f2f657fa640 1 -- 172.21.15.105:0/840883174 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2f6002bdb0 con 0x7f2f6809e5d0 2024-09-21T03:26:39.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.218+0000 7f2f6ed13640 1 -- 172.21.15.105:0/840883174 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2f680b30c0 con 0x7f2f54078b90 2024-09-21T03:26:39.225 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.223+0000 7f2f657fa640 1 -- 172.21.15.105:0/840883174 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247546 (secure 0 0 0) 0x7f2f680b30c0 con 0x7f2f54078b90 2024-09-21T03:26:39.229 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:26:39.230 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:26:39.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.226+0000 7f2f6ed13640 1 -- 172.21.15.105:0/840883174 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2f54078b90 msgr2=0x7f2f5407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:39.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.226+0000 7f2f6ed13640 1 --2- 172.21.15.105:0/840883174 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2f54078b90 0x7f2f5407b0a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f2f58000f60 tx=0x7f2f58000ed0 comp rx=0 tx=0).stop 2024-09-21T03:26:39.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.226+0000 7f2f6ed13640 1 -- 172.21.15.105:0/840883174 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f6809e5d0 msgr2=0x7f2f681e4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:39.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.226+0000 7f2f6ed13640 1 --2- 172.21.15.105:0/840883174 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f6809e5d0 0x7f2f681e4660 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f2f60002230 tx=0x7f2f60034bb0 comp rx=0 tx=0).stop 2024-09-21T03:26:39.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.226+0000 7f2f6ed13640 1 -- 172.21.15.105:0/840883174 shutdown_connections 2024-09-21T03:26:39.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.226+0000 7f2f6ed13640 1 --2- 172.21.15.105:0/840883174 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2f54078b90 0x7f2f5407b0a0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:39.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.226+0000 7f2f6ed13640 1 --2- 172.21.15.105:0/840883174 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f6809e5d0 0x7f2f681e4660 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:39.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.226+0000 7f2f6ed13640 1 --2- 172.21.15.105:0/840883174 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2f6814d810 0x7f2f6809e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:39.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.226+0000 7f2f6ed13640 1 --2- 172.21.15.105:0/840883174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f50004d40 0x7f2f681e1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:39.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.226+0000 7f2f6ed13640 1 -- 172.21.15.105:0/840883174 >> 172.21.15.105:0/840883174 conn(0x7f2f680cdcb0 msgr2=0x7f2f680b0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:39.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.226+0000 7f2f6ed13640 1 -- 172.21.15.105:0/840883174 shutdown_connections 2024-09-21T03:26:39.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:39.226+0000 7f2f6ed13640 1 -- 172.21.15.105:0/840883174 wait complete. 2024-09-21T03:26:39.240 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":373,"stamp":"2024-09-21T03:26:37.411055+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":108,"num_write_kb":1631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":271432,"kb_used_data":13584,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754703288,"statfs":{"total":773094113280,"available":772816166912,"internally_reserved":0,"allocated":13910016,"data_stored":6612905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.669930"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.753441+0000","last_change":"2024-09-21T03:26:32.753441+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.753441+0000","last_undegraded":"2024-09-21T03:26:32.753441+0000","last_fullsized":"2024-09-21T03:26:32.753441+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749709+0000","last_change":"2024-09-21T03:26:32.749709+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749709+0000","last_undegraded":"2024-09-21T03:26:32.749709+0000","last_fullsized":"2024-09-21T03:26:32.749709+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751495+0000","last_change":"2024-09-21T03:26:32.751495+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751495+0000","last_undegraded":"2024-09-21T03:26:32.751495+0000","last_fullsized":"2024-09-21T03:26:32.751495+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.747033+0000","last_change":"2024-09-21T03:26:32.747033+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.747033+0000","last_undegraded":"2024-09-21T03:26:32.747033+0000","last_fullsized":"2024-09-21T03:26:32.747033+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.752535+0000","last_change":"2024-09-21T03:26:32.752535+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.752535+0000","last_undegraded":"2024-09-21T03:26:32.752535+0000","last_fullsized":"2024-09-21T03:26:32.752535+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.752456+0000","last_change":"2024-09-21T03:26:32.752456+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.752456+0000","last_undegraded":"2024-09-21T03:26:32.752456+0000","last_fullsized":"2024-09-21T03:26:32.752456+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.958840+0000","last_change":"2024-09-21T03:26:33.778224+0000","last_active":"2024-09-21T03:26:34.958840+0000","last_peered":"2024-09-21T03:26:34.958840+0000","last_clean":"2024-09-21T03:26:34.958840+0000","last_became_active":"2024-09-21T03:26:33.777885+0000","last_became_peered":"2024-09-21T03:26:33.777885+0000","last_unstale":"2024-09-21T03:26:34.958840+0000","last_undegraded":"2024-09-21T03:26:34.958840+0000","last_fullsized":"2024-09-21T03:26:34.958840+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:47.764557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751924+0000","last_change":"2024-09-21T03:26:32.751924+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751924+0000","last_undegraded":"2024-09-21T03:26:32.751924+0000","last_fullsized":"2024-09-21T03:26:32.751924+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.753085+0000","last_change":"2024-09-21T03:26:32.753085+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.753085+0000","last_undegraded":"2024-09-21T03:26:32.753085+0000","last_fullsized":"2024-09-21T03:26:32.753085+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.752886+0000","last_change":"2024-09-21T03:26:32.752886+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.752886+0000","last_undegraded":"2024-09-21T03:26:32.752886+0000","last_fullsized":"2024-09-21T03:26:32.752886+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751340+0000","last_change":"2024-09-21T03:26:32.751340+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751340+0000","last_undegraded":"2024-09-21T03:26:32.751340+0000","last_fullsized":"2024-09-21T03:26:32.751340+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751532+0000","last_change":"2024-09-21T03:26:32.751532+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751532+0000","last_undegraded":"2024-09-21T03:26:32.751532+0000","last_fullsized":"2024-09-21T03:26:32.751532+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.752050+0000","last_change":"2024-09-21T03:26:32.752050+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.752050+0000","last_undegraded":"2024-09-21T03:26:32.752050+0000","last_fullsized":"2024-09-21T03:26:32.752050+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.748249+0000","last_change":"2024-09-21T03:26:32.748249+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.748249+0000","last_undegraded":"2024-09-21T03:26:32.748249+0000","last_fullsized":"2024-09-21T03:26:32.748249+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.748727+0000","last_change":"2024-09-21T03:26:32.748727+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.748727+0000","last_undegraded":"2024-09-21T03:26:32.748727+0000","last_fullsized":"2024-09-21T03:26:32.748727+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750304+0000","last_change":"2024-09-21T03:26:32.750304+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750304+0000","last_undegraded":"2024-09-21T03:26:32.750304+0000","last_fullsized":"2024-09-21T03:26:32.750304+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749863+0000","last_change":"2024-09-21T03:26:32.749863+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749863+0000","last_undegraded":"2024-09-21T03:26:32.749863+0000","last_fullsized":"2024-09-21T03:26:32.749863+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751293+0000","last_change":"2024-09-21T03:26:32.751293+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751293+0000","last_undegraded":"2024-09-21T03:26:32.751293+0000","last_fullsized":"2024-09-21T03:26:32.751293+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750791+0000","last_change":"2024-09-21T03:26:32.750791+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750791+0000","last_undegraded":"2024-09-21T03:26:32.750791+0000","last_fullsized":"2024-09-21T03:26:32.750791+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749980+0000","last_change":"2024-09-21T03:26:32.749980+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749980+0000","last_undegraded":"2024-09-21T03:26:32.749980+0000","last_fullsized":"2024-09-21T03:26:32.749980+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749140+0000","last_change":"2024-09-21T03:26:32.749140+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749140+0000","last_undegraded":"2024-09-21T03:26:32.749140+0000","last_fullsized":"2024-09-21T03:26:32.749140+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.747627+0000","last_change":"2024-09-21T03:26:32.747627+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.747627+0000","last_undegraded":"2024-09-21T03:26:32.747627+0000","last_fullsized":"2024-09-21T03:26:32.747627+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.746033+0000","last_change":"2024-09-21T03:26:32.746033+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.746033+0000","last_undegraded":"2024-09-21T03:26:32.746033+0000","last_fullsized":"2024-09-21T03:26:32.746033+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750847+0000","last_change":"2024-09-21T03:26:32.750847+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750847+0000","last_undegraded":"2024-09-21T03:26:32.750847+0000","last_fullsized":"2024-09-21T03:26:32.750847+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751882+0000","last_change":"2024-09-21T03:26:32.751882+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751882+0000","last_undegraded":"2024-09-21T03:26:32.751882+0000","last_fullsized":"2024-09-21T03:26:32.751882+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750209+0000","last_change":"2024-09-21T03:26:32.750209+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750209+0000","last_undegraded":"2024-09-21T03:26:32.750209+0000","last_fullsized":"2024-09-21T03:26:32.750209+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.754270+0000","last_change":"2024-09-21T03:26:32.754270+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.754270+0000","last_undegraded":"2024-09-21T03:26:32.754270+0000","last_fullsized":"2024-09-21T03:26:32.754270+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959021+0000","last_change":"2024-09-21T03:26:33.768428+0000","last_active":"2024-09-21T03:26:34.959021+0000","last_peered":"2024-09-21T03:26:34.959021+0000","last_clean":"2024-09-21T03:26:34.959021+0000","last_became_active":"2024-09-21T03:26:33.768104+0000","last_became_peered":"2024-09-21T03:26:33.768104+0000","last_unstale":"2024-09-21T03:26:34.959021+0000","last_undegraded":"2024-09-21T03:26:34.959021+0000","last_fullsized":"2024-09-21T03:26:34.959021+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:09.772044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750908+0000","last_change":"2024-09-21T03:26:32.750908+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750908+0000","last_undegraded":"2024-09-21T03:26:32.750908+0000","last_fullsized":"2024-09-21T03:26:32.750908+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.747099+0000","last_change":"2024-09-21T03:26:32.747099+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.747099+0000","last_undegraded":"2024-09-21T03:26:32.747099+0000","last_fullsized":"2024-09-21T03:26:32.747099+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749457+0000","last_change":"2024-09-21T03:26:32.749457+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749457+0000","last_undegraded":"2024-09-21T03:26:32.749457+0000","last_fullsized":"2024-09-21T03:26:32.749457+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749762+0000","last_change":"2024-09-21T03:26:32.749762+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749762+0000","last_undegraded":"2024-09-21T03:26:32.749762+0000","last_fullsized":"2024-09-21T03:26:32.749762+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750324+0000","last_change":"2024-09-21T03:26:32.750324+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750324+0000","last_undegraded":"2024-09-21T03:26:32.750324+0000","last_fullsized":"2024-09-21T03:26:32.750324+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.769210+0000","last_change":"2024-09-21T03:26:32.765626+0000","last_active":"2024-09-21T03:26:32.769210+0000","last_peered":"2024-09-21T03:26:32.769210+0000","last_clean":"2024-09-21T03:26:32.769210+0000","last_became_active":"2024-09-21T03:26:32.764896+0000","last_became_peered":"2024-09-21T03:26:32.764896+0000","last_unstale":"2024-09-21T03:26:32.769210+0000","last_undegraded":"2024-09-21T03:26:32.769210+0000","last_fullsized":"2024-09-21T03:26:32.769210+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:19:34.668326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.752601+0000","last_change":"2024-09-21T03:26:32.752601+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.752601+0000","last_undegraded":"2024-09-21T03:26:32.752601+0000","last_fullsized":"2024-09-21T03:26:32.752601+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.765917+0000","last_change":"2024-09-21T03:26:32.763786+0000","last_active":"2024-09-21T03:26:32.765917+0000","last_peered":"2024-09-21T03:26:32.765917+0000","last_clean":"2024-09-21T03:26:32.765917+0000","last_became_active":"2024-09-21T03:26:32.763296+0000","last_became_peered":"2024-09-21T03:26:32.763296+0000","last_unstale":"2024-09-21T03:26:32.765917+0000","last_undegraded":"2024-09-21T03:26:32.765917+0000","last_fullsized":"2024-09-21T03:26:32.765917+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:43.499221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749686+0000","last_change":"2024-09-21T03:26:32.749686+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749686+0000","last_undegraded":"2024-09-21T03:26:32.749686+0000","last_fullsized":"2024-09-21T03:26:32.749686+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.762230+0000","last_change":"2024-09-21T03:26:32.760363+0000","last_active":"2024-09-21T03:26:32.762230+0000","last_peered":"2024-09-21T03:26:32.762230+0000","last_clean":"2024-09-21T03:26:32.762230+0000","last_became_active":"2024-09-21T03:26:32.760059+0000","last_became_peered":"2024-09-21T03:26:32.760059+0000","last_unstale":"2024-09-21T03:26:32.762230+0000","last_undegraded":"2024-09-21T03:26:32.762230+0000","last_fullsized":"2024-09-21T03:26:32.762230+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:44:38.489230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749592+0000","last_change":"2024-09-21T03:26:32.749592+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749592+0000","last_undegraded":"2024-09-21T03:26:32.749592+0000","last_fullsized":"2024-09-21T03:26:32.749592+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.754950+0000","last_change":"2024-09-21T03:26:32.754258+0000","last_active":"2024-09-21T03:26:32.754950+0000","last_peered":"2024-09-21T03:26:32.754950+0000","last_clean":"2024-09-21T03:26:32.754950+0000","last_became_active":"2024-09-21T03:26:32.753929+0000","last_became_peered":"2024-09-21T03:26:32.753929+0000","last_unstale":"2024-09-21T03:26:32.754950+0000","last_undegraded":"2024-09-21T03:26:32.754950+0000","last_fullsized":"2024-09-21T03:26:32.754950+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:39.364503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750511+0000","last_change":"2024-09-21T03:26:32.750511+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750511+0000","last_undegraded":"2024-09-21T03:26:32.750511+0000","last_fullsized":"2024-09-21T03:26:32.750511+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.767740+0000","last_change":"2024-09-21T03:26:32.765736+0000","last_active":"2024-09-21T03:26:32.767740+0000","last_peered":"2024-09-21T03:26:32.767740+0000","last_clean":"2024-09-21T03:26:32.767740+0000","last_became_active":"2024-09-21T03:26:32.765227+0000","last_became_peered":"2024-09-21T03:26:32.765227+0000","last_unstale":"2024-09-21T03:26:32.767740+0000","last_undegraded":"2024-09-21T03:26:32.767740+0000","last_fullsized":"2024-09-21T03:26:32.767740+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:15.751411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.747045+0000","last_change":"2024-09-21T03:26:32.747045+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.747045+0000","last_undegraded":"2024-09-21T03:26:32.747045+0000","last_fullsized":"2024-09-21T03:26:32.747045+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.769146+0000","last_change":"2024-09-21T03:26:32.765921+0000","last_active":"2024-09-21T03:26:32.769146+0000","last_peered":"2024-09-21T03:26:32.769146+0000","last_clean":"2024-09-21T03:26:32.769146+0000","last_became_active":"2024-09-21T03:26:32.765525+0000","last_became_peered":"2024-09-21T03:26:32.765525+0000","last_unstale":"2024-09-21T03:26:32.769146+0000","last_undegraded":"2024-09-21T03:26:32.769146+0000","last_fullsized":"2024-09-21T03:26:32.769146+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:28.033917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750553+0000","last_change":"2024-09-21T03:26:32.750553+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750553+0000","last_undegraded":"2024-09-21T03:26:32.750553+0000","last_fullsized":"2024-09-21T03:26:32.750553+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.765567+0000","last_change":"2024-09-21T03:26:32.763337+0000","last_active":"2024-09-21T03:26:32.765567+0000","last_peered":"2024-09-21T03:26:32.765567+0000","last_clean":"2024-09-21T03:26:32.765567+0000","last_became_active":"2024-09-21T03:26:32.763033+0000","last_became_peered":"2024-09-21T03:26:32.763033+0000","last_unstale":"2024-09-21T03:26:32.765567+0000","last_undegraded":"2024-09-21T03:26:32.765567+0000","last_fullsized":"2024-09-21T03:26:32.765567+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:41:39.782991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750673+0000","last_change":"2024-09-21T03:26:32.750673+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750673+0000","last_undegraded":"2024-09-21T03:26:32.750673+0000","last_fullsized":"2024-09-21T03:26:32.750673+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.760991+0000","last_change":"2024-09-21T03:26:32.758610+0000","last_active":"2024-09-21T03:26:32.760991+0000","last_peered":"2024-09-21T03:26:32.760991+0000","last_clean":"2024-09-21T03:26:32.760991+0000","last_became_active":"2024-09-21T03:26:32.758254+0000","last_became_peered":"2024-09-21T03:26:32.758254+0000","last_unstale":"2024-09-21T03:26:32.760991+0000","last_undegraded":"2024-09-21T03:26:32.760991+0000","last_fullsized":"2024-09-21T03:26:32.760991+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:21.051537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.752545+0000","last_change":"2024-09-21T03:26:32.752545+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.752545+0000","last_undegraded":"2024-09-21T03:26:32.752545+0000","last_fullsized":"2024-09-21T03:26:32.752545+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.765878+0000","last_change":"2024-09-21T03:26:32.763498+0000","last_active":"2024-09-21T03:26:32.765878+0000","last_peered":"2024-09-21T03:26:32.765878+0000","last_clean":"2024-09-21T03:26:32.765878+0000","last_became_active":"2024-09-21T03:26:32.763195+0000","last_became_peered":"2024-09-21T03:26:32.763195+0000","last_unstale":"2024-09-21T03:26:32.765878+0000","last_undegraded":"2024-09-21T03:26:32.765878+0000","last_fullsized":"2024-09-21T03:26:32.765878+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:42.291015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749304+0000","last_change":"2024-09-21T03:26:32.749304+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749304+0000","last_undegraded":"2024-09-21T03:26:32.749304+0000","last_fullsized":"2024-09-21T03:26:32.749304+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.765017+0000","last_change":"2024-09-21T03:26:32.763210+0000","last_active":"2024-09-21T03:26:32.765017+0000","last_peered":"2024-09-21T03:26:32.765017+0000","last_clean":"2024-09-21T03:26:32.765017+0000","last_became_active":"2024-09-21T03:26:32.762766+0000","last_became_peered":"2024-09-21T03:26:32.762766+0000","last_unstale":"2024-09-21T03:26:32.765017+0000","last_undegraded":"2024-09-21T03:26:32.765017+0000","last_fullsized":"2024-09-21T03:26:32.765017+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:42.291015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.753733+0000","last_change":"2024-09-21T03:26:32.753733+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.753733+0000","last_undegraded":"2024-09-21T03:26:32.753733+0000","last_fullsized":"2024-09-21T03:26:32.753733+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"128'6","reported_seq":21,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959389+0000","last_change":"2024-09-21T03:26:32.759495+0000","last_active":"2024-09-21T03:26:34.959389+0000","last_peered":"2024-09-21T03:26:34.959389+0000","last_clean":"2024-09-21T03:26:34.959389+0000","last_became_active":"2024-09-21T03:26:32.759122+0000","last_became_peered":"2024-09-21T03:26:32.759122+0000","last_unstale":"2024-09-21T03:26:34.959389+0000","last_undegraded":"2024-09-21T03:26:34.959389+0000","last_fullsized":"2024-09-21T03:26:34.959389+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:20.416584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750961+0000","last_change":"2024-09-21T03:26:32.750961+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750961+0000","last_undegraded":"2024-09-21T03:26:32.750961+0000","last_fullsized":"2024-09-21T03:26:32.750961+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.763828+0000","last_change":"2024-09-21T03:26:32.760470+0000","last_active":"2024-09-21T03:26:32.763828+0000","last_peered":"2024-09-21T03:26:32.763828+0000","last_clean":"2024-09-21T03:26:32.763828+0000","last_became_active":"2024-09-21T03:26:32.760171+0000","last_became_peered":"2024-09-21T03:26:32.760171+0000","last_unstale":"2024-09-21T03:26:32.763828+0000","last_undegraded":"2024-09-21T03:26:32.763828+0000","last_fullsized":"2024-09-21T03:26:32.763828+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:39.364503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749138+0000","last_change":"2024-09-21T03:26:32.749138+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749138+0000","last_undegraded":"2024-09-21T03:26:32.749138+0000","last_fullsized":"2024-09-21T03:26:32.749138+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.764078+0000","last_change":"2024-09-21T03:26:32.762314+0000","last_active":"2024-09-21T03:26:32.764078+0000","last_peered":"2024-09-21T03:26:32.764078+0000","last_clean":"2024-09-21T03:26:32.764078+0000","last_became_active":"2024-09-21T03:26:32.762003+0000","last_became_peered":"2024-09-21T03:26:32.762003+0000","last_unstale":"2024-09-21T03:26:32.764078+0000","last_undegraded":"2024-09-21T03:26:32.764078+0000","last_fullsized":"2024-09-21T03:26:32.764078+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:21.051537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750769+0000","last_change":"2024-09-21T03:26:32.750769+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750769+0000","last_undegraded":"2024-09-21T03:26:32.750769+0000","last_fullsized":"2024-09-21T03:26:32.750769+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.763283+0000","last_change":"2024-09-21T03:26:32.756831+0000","last_active":"2024-09-21T03:26:32.763283+0000","last_peered":"2024-09-21T03:26:32.763283+0000","last_clean":"2024-09-21T03:26:32.763283+0000","last_became_active":"2024-09-21T03:26:32.756494+0000","last_became_peered":"2024-09-21T03:26:32.756494+0000","last_unstale":"2024-09-21T03:26:32.763283+0000","last_undegraded":"2024-09-21T03:26:32.763283+0000","last_fullsized":"2024-09-21T03:26:32.763283+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:16:14.393309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749907+0000","last_change":"2024-09-21T03:26:32.749907+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749907+0000","last_undegraded":"2024-09-21T03:26:32.749907+0000","last_fullsized":"2024-09-21T03:26:32.749907+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.766637+0000","last_change":"2024-09-21T03:26:32.764507+0000","last_active":"2024-09-21T03:26:32.766637+0000","last_peered":"2024-09-21T03:26:32.766637+0000","last_clean":"2024-09-21T03:26:32.766637+0000","last_became_active":"2024-09-21T03:26:32.764170+0000","last_became_peered":"2024-09-21T03:26:32.764170+0000","last_unstale":"2024-09-21T03:26:32.766637+0000","last_undegraded":"2024-09-21T03:26:32.766637+0000","last_fullsized":"2024-09-21T03:26:32.766637+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:29.112426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749546+0000","last_change":"2024-09-21T03:26:32.749546+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749546+0000","last_undegraded":"2024-09-21T03:26:32.749546+0000","last_fullsized":"2024-09-21T03:26:32.749546+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.762427+0000","last_change":"2024-09-21T03:26:32.761374+0000","last_active":"2024-09-21T03:26:32.762427+0000","last_peered":"2024-09-21T03:26:32.762427+0000","last_clean":"2024-09-21T03:26:32.762427+0000","last_became_active":"2024-09-21T03:26:32.761046+0000","last_became_peered":"2024-09-21T03:26:32.761046+0000","last_unstale":"2024-09-21T03:26:32.762427+0000","last_undegraded":"2024-09-21T03:26:32.762427+0000","last_fullsized":"2024-09-21T03:26:32.762427+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:29:36.028915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751405+0000","last_change":"2024-09-21T03:26:32.751405+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751405+0000","last_undegraded":"2024-09-21T03:26:32.751405+0000","last_fullsized":"2024-09-21T03:26:32.751405+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.766127+0000","last_change":"2024-09-21T03:26:32.765118+0000","last_active":"2024-09-21T03:26:32.766127+0000","last_peered":"2024-09-21T03:26:32.766127+0000","last_clean":"2024-09-21T03:26:32.766127+0000","last_became_active":"2024-09-21T03:26:32.764807+0000","last_became_peered":"2024-09-21T03:26:32.764807+0000","last_unstale":"2024-09-21T03:26:32.766127+0000","last_undegraded":"2024-09-21T03:26:32.766127+0000","last_fullsized":"2024-09-21T03:26:32.766127+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:38:44.642701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751162+0000","last_change":"2024-09-21T03:26:32.751162+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751162+0000","last_undegraded":"2024-09-21T03:26:32.751162+0000","last_fullsized":"2024-09-21T03:26:32.751162+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.767748+0000","last_change":"2024-09-21T03:26:32.766023+0000","last_active":"2024-09-21T03:26:32.767748+0000","last_peered":"2024-09-21T03:26:32.767748+0000","last_clean":"2024-09-21T03:26:32.767748+0000","last_became_active":"2024-09-21T03:26:32.765690+0000","last_became_peered":"2024-09-21T03:26:32.765690+0000","last_unstale":"2024-09-21T03:26:32.767748+0000","last_undegraded":"2024-09-21T03:26:32.767748+0000","last_fullsized":"2024-09-21T03:26:32.767748+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:07:37.086442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.749087+0000","last_change":"2024-09-21T03:26:32.749087+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.749087+0000","last_undegraded":"2024-09-21T03:26:32.749087+0000","last_fullsized":"2024-09-21T03:26:32.749087+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.765989+0000","last_change":"2024-09-21T03:26:32.761613+0000","last_active":"2024-09-21T03:26:32.765989+0000","last_peered":"2024-09-21T03:26:32.765989+0000","last_clean":"2024-09-21T03:26:32.765989+0000","last_became_active":"2024-09-21T03:26:32.761327+0000","last_became_peered":"2024-09-21T03:26:32.761327+0000","last_unstale":"2024-09-21T03:26:32.765989+0000","last_undegraded":"2024-09-21T03:26:32.765989+0000","last_fullsized":"2024-09-21T03:26:32.765989+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:43:56.089219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.746196+0000","last_change":"2024-09-21T03:26:32.746196+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.746196+0000","last_undegraded":"2024-09-21T03:26:32.746196+0000","last_fullsized":"2024-09-21T03:26:32.746196+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"128'2","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959425+0000","last_change":"2024-09-21T03:26:32.764098+0000","last_active":"2024-09-21T03:26:34.959425+0000","last_peered":"2024-09-21T03:26:34.959425+0000","last_clean":"2024-09-21T03:26:34.959425+0000","last_became_active":"2024-09-21T03:26:32.763369+0000","last_became_peered":"2024-09-21T03:26:32.763369+0000","last_unstale":"2024-09-21T03:26:34.959425+0000","last_undegraded":"2024-09-21T03:26:34.959425+0000","last_fullsized":"2024-09-21T03:26:34.959425+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:55.678113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959291+0000","last_change":"2024-09-21T03:26:33.778124+0000","last_active":"2024-09-21T03:26:34.959291+0000","last_peered":"2024-09-21T03:26:34.959291+0000","last_clean":"2024-09-21T03:26:34.959291+0000","last_became_active":"2024-09-21T03:26:33.777780+0000","last_became_peered":"2024-09-21T03:26:33.777780+0000","last_unstale":"2024-09-21T03:26:34.959291+0000","last_undegraded":"2024-09-21T03:26:34.959291+0000","last_fullsized":"2024-09-21T03:26:34.959291+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:20.865258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.766725+0000","last_change":"2024-09-21T03:26:32.764723+0000","last_active":"2024-09-21T03:26:32.766725+0000","last_peered":"2024-09-21T03:26:32.766725+0000","last_clean":"2024-09-21T03:26:32.766725+0000","last_became_active":"2024-09-21T03:26:32.764235+0000","last_became_peered":"2024-09-21T03:26:32.764235+0000","last_unstale":"2024-09-21T03:26:32.766725+0000","last_undegraded":"2024-09-21T03:26:32.766725+0000","last_fullsized":"2024-09-21T03:26:32.766725+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:43.499221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.746748+0000","last_change":"2024-09-21T03:26:32.746748+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.746748+0000","last_undegraded":"2024-09-21T03:26:32.746748+0000","last_fullsized":"2024-09-21T03:26:32.746748+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.771880+0000","last_change":"2024-09-21T03:26:32.767045+0000","last_active":"2024-09-21T03:26:32.771880+0000","last_peered":"2024-09-21T03:26:32.771880+0000","last_clean":"2024-09-21T03:26:32.771880+0000","last_became_active":"2024-09-21T03:26:32.766543+0000","last_became_peered":"2024-09-21T03:26:32.766543+0000","last_unstale":"2024-09-21T03:26:32.771880+0000","last_undegraded":"2024-09-21T03:26:32.771880+0000","last_fullsized":"2024-09-21T03:26:32.771880+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:37.061012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.958608+0000","last_change":"2024-09-21T03:26:33.778377+0000","last_active":"2024-09-21T03:26:34.958608+0000","last_peered":"2024-09-21T03:26:34.958608+0000","last_clean":"2024-09-21T03:26:34.958608+0000","last_became_active":"2024-09-21T03:26:33.778077+0000","last_became_peered":"2024-09-21T03:26:33.778077+0000","last_unstale":"2024-09-21T03:26:34.958608+0000","last_undegraded":"2024-09-21T03:26:34.958608+0000","last_fullsized":"2024-09-21T03:26:34.958608+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:22.283748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.764892+0000","last_change":"2024-09-21T03:26:32.763204+0000","last_active":"2024-09-21T03:26:32.764892+0000","last_peered":"2024-09-21T03:26:32.764892+0000","last_clean":"2024-09-21T03:26:32.764892+0000","last_became_active":"2024-09-21T03:26:32.762314+0000","last_became_peered":"2024-09-21T03:26:32.762314+0000","last_unstale":"2024-09-21T03:26:32.764892+0000","last_undegraded":"2024-09-21T03:26:32.764892+0000","last_fullsized":"2024-09-21T03:26:32.764892+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:44:38.489230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751643+0000","last_change":"2024-09-21T03:26:32.751643+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751643+0000","last_undegraded":"2024-09-21T03:26:32.751643+0000","last_fullsized":"2024-09-21T03:26:32.751643+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.764979+0000","last_change":"2024-09-21T03:26:32.763095+0000","last_active":"2024-09-21T03:26:32.764979+0000","last_peered":"2024-09-21T03:26:32.764979+0000","last_clean":"2024-09-21T03:26:32.764979+0000","last_became_active":"2024-09-21T03:26:32.762758+0000","last_became_peered":"2024-09-21T03:26:32.762758+0000","last_unstale":"2024-09-21T03:26:32.764979+0000","last_undegraded":"2024-09-21T03:26:32.764979+0000","last_fullsized":"2024-09-21T03:26:32.764979+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:43.159607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.752344+0000","last_change":"2024-09-21T03:26:32.752344+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.752344+0000","last_undegraded":"2024-09-21T03:26:32.752344+0000","last_fullsized":"2024-09-21T03:26:32.752344+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.753832+0000","last_change":"2024-09-21T03:26:32.752528+0000","last_active":"2024-09-21T03:26:32.753832+0000","last_peered":"2024-09-21T03:26:32.753832+0000","last_clean":"2024-09-21T03:26:32.753832+0000","last_became_active":"2024-09-21T03:26:32.752205+0000","last_became_peered":"2024-09-21T03:26:32.752205+0000","last_unstale":"2024-09-21T03:26:32.753832+0000","last_undegraded":"2024-09-21T03:26:32.753832+0000","last_fullsized":"2024-09-21T03:26:32.753832+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:27.024217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751797+0000","last_change":"2024-09-21T03:26:32.751797+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751797+0000","last_undegraded":"2024-09-21T03:26:32.751797+0000","last_fullsized":"2024-09-21T03:26:32.751797+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.762171+0000","last_change":"2024-09-21T03:26:32.758409+0000","last_active":"2024-09-21T03:26:32.762171+0000","last_peered":"2024-09-21T03:26:32.762171+0000","last_clean":"2024-09-21T03:26:32.762171+0000","last_became_active":"2024-09-21T03:26:32.758112+0000","last_became_peered":"2024-09-21T03:26:32.758112+0000","last_unstale":"2024-09-21T03:26:32.762171+0000","last_undegraded":"2024-09-21T03:26:32.762171+0000","last_fullsized":"2024-09-21T03:26:32.762171+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:08:21.928238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.748534+0000","last_change":"2024-09-21T03:26:32.748534+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.748534+0000","last_undegraded":"2024-09-21T03:26:32.748534+0000","last_fullsized":"2024-09-21T03:26:32.748534+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.764765+0000","last_change":"2024-09-21T03:26:32.761270+0000","last_active":"2024-09-21T03:26:32.764765+0000","last_peered":"2024-09-21T03:26:32.764765+0000","last_clean":"2024-09-21T03:26:32.764765+0000","last_became_active":"2024-09-21T03:26:32.760986+0000","last_became_peered":"2024-09-21T03:26:32.760986+0000","last_unstale":"2024-09-21T03:26:32.764765+0000","last_undegraded":"2024-09-21T03:26:32.764765+0000","last_fullsized":"2024-09-21T03:26:32.764765+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:04.235753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.753998+0000","last_change":"2024-09-21T03:26:32.753998+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.753998+0000","last_undegraded":"2024-09-21T03:26:32.753998+0000","last_fullsized":"2024-09-21T03:26:32.753998+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959509+0000","last_change":"2024-09-21T03:26:32.763753+0000","last_active":"2024-09-21T03:26:34.959509+0000","last_peered":"2024-09-21T03:26:34.959509+0000","last_clean":"2024-09-21T03:26:34.959509+0000","last_became_active":"2024-09-21T03:26:32.762836+0000","last_became_peered":"2024-09-21T03:26:32.762836+0000","last_unstale":"2024-09-21T03:26:34.959509+0000","last_undegraded":"2024-09-21T03:26:34.959509+0000","last_fullsized":"2024-09-21T03:26:34.959509+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:51.853935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.751544+0000","last_change":"2024-09-21T03:26:32.751544+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.751544+0000","last_undegraded":"2024-09-21T03:26:32.751544+0000","last_fullsized":"2024-09-21T03:26:32.751544+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.769158+0000","last_change":"2024-09-21T03:26:32.764798+0000","last_active":"2024-09-21T03:26:32.769158+0000","last_peered":"2024-09-21T03:26:32.769158+0000","last_clean":"2024-09-21T03:26:32.769158+0000","last_became_active":"2024-09-21T03:26:32.764469+0000","last_became_peered":"2024-09-21T03:26:32.764469+0000","last_unstale":"2024-09-21T03:26:32.769158+0000","last_undegraded":"2024-09-21T03:26:32.769158+0000","last_fullsized":"2024-09-21T03:26:32.769158+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:38:44.642701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750392+0000","last_change":"2024-09-21T03:26:32.750392+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750392+0000","last_undegraded":"2024-09-21T03:26:32.750392+0000","last_fullsized":"2024-09-21T03:26:32.750392+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.761576+0000","last_change":"2024-09-21T03:26:32.757614+0000","last_active":"2024-09-21T03:26:32.761576+0000","last_peered":"2024-09-21T03:26:32.761576+0000","last_clean":"2024-09-21T03:26:32.761576+0000","last_became_active":"2024-09-21T03:26:32.757332+0000","last_became_peered":"2024-09-21T03:26:32.757332+0000","last_unstale":"2024-09-21T03:26:32.761576+0000","last_undegraded":"2024-09-21T03:26:32.761576+0000","last_fullsized":"2024-09-21T03:26:32.761576+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:01:59.982817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-21T03:26:32.750113+0000","last_change":"2024-09-21T03:26:32.750113+0000","last_active":"2024-09-21T03:26:32.739794+0000","last_peered":"2024-09-21T03:26:32.739794+0000","last_clean":"2024-09-21T03:26:32.739794+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:26:32.750113+0000","last_undegraded":"2024-09-21T03:26:32.750113+0000","last_fullsized":"2024-09-21T03:26:32.750113+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.765761+0000","last_change":"2024-09-21T03:26:32.762505+0000","last_active":"2024-09-21T03:26:32.765761+0000","last_peered":"2024-09-21T03:26:32.765761+0000","last_clean":"2024-09-21T03:26:32.765761+0000","last_became_active":"2024-09-21T03:26:32.762188+0000","last_became_peered":"2024-09-21T03:26:32.762188+0000","last_unstale":"2024-09-21T03:26:32.765761+0000","last_undegraded":"2024-09-21T03:26:32.765761+0000","last_fullsized":"2024-09-21T03:26:32.765761+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:43.159607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959254+0000","last_change":"2024-09-21T03:26:33.778553+0000","last_active":"2024-09-21T03:26:34.959254+0000","last_peered":"2024-09-21T03:26:34.959254+0000","last_clean":"2024-09-21T03:26:34.959254+0000","last_became_active":"2024-09-21T03:26:33.777840+0000","last_became_peered":"2024-09-21T03:26:33.777840+0000","last_unstale":"2024-09-21T03:26:34.959254+0000","last_undegraded":"2024-09-21T03:26:34.959254+0000","last_fullsized":"2024-09-21T03:26:34.959254+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:54.479070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":10,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.769337+0000","last_change":"2024-09-21T03:26:32.767343+0000","last_active":"2024-09-21T03:26:32.769337+0000","last_peered":"2024-09-21T03:26:32.769337+0000","last_clean":"2024-09-21T03:26:32.769337+0000","last_became_active":"2024-09-21T03:26:32.767009+0000","last_became_peered":"2024-09-21T03:26:32.767009+0000","last_unstale":"2024-09-21T03:26:32.769337+0000","last_undegraded":"2024-09-21T03:26:32.769337+0000","last_fullsized":"2024-09-21T03:26:32.769337+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:15.581950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":309,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T03:26:32.753238+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:26:32.753238+0000","last_peered":"2024-09-21T03:26:32.753238+0000","last_clean":"2024-09-21T03:26:32.753238+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:26:32.753238+0000","last_undegraded":"2024-09-21T03:26:32.753238+0000","last_fullsized":"2024-09-21T03:26:32.753238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509544,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33320,"kb_used_data":2128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338520,"statfs":{"total":96636764160,"available":96602644480,"internally_reserved":0,"allocated":2179072,"data_stored":1267549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509543,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32736,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339104,"statfs":{"total":96636764160,"available":96603242496,"internally_reserved":0,"allocated":1585152,"data_stored":677181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509542,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32740,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339100,"statfs":{"total":96636764160,"available":96603238400,"internally_reserved":0,"allocated":1585152,"data_stored":677181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509542,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32736,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339104,"statfs":{"total":96636764160,"available":96603242496,"internally_reserved":0,"allocated":1585152,"data_stored":677181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509543,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32740,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339100,"statfs":{"total":96636764160,"available":96603238400,"internally_reserved":0,"allocated":1585152,"data_stored":677181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509543,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36900,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334940,"statfs":{"total":96636764160,"available":96598978560,"internally_reserved":0,"allocated":1585152,"data_stored":677181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509543,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36900,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334940,"statfs":{"total":96636764160,"available":96598978560,"internally_reserved":0,"allocated":1585152,"data_stored":677181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574951,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33360,"kb_used_data":2168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338480,"statfs":{"total":96636764160,"available":96602603520,"internally_reserved":0,"allocated":2220032,"data_stored":1282270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:26:42.245 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:26:42.371 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.369+0000 7f0e3a55e640 1 -- 172.21.15.105:0/2721262151 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e3406f4b0 msgr2=0x7f0e340d3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:42.371 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.369+0000 7f0e3a55e640 1 --2- 172.21.15.105:0/2721262151 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e3406f4b0 0x7f0e340d3330 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f0e3408d9b0 tx=0x7f0e2802a4f0 comp rx=0 tx=0).stop 2024-09-21T03:26:42.371 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.369+0000 7f0e3a55e640 1 -- 172.21.15.105:0/2721262151 shutdown_connections 2024-09-21T03:26:42.372 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.369+0000 7f0e3a55e640 1 --2- 172.21.15.105:0/2721262151 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e3406f4b0 0x7f0e340d3330 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:42.372 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.369+0000 7f0e3a55e640 1 --2- 172.21.15.105:0/2721262151 >> v2:172.21.15.162:3300/0 conn(0x7f0e3406e170 0x7f0e340b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:42.372 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.369+0000 7f0e3a55e640 1 -- 172.21.15.105:0/2721262151 >> 172.21.15.105:0/2721262151 conn(0x7f0e3408bfc0 msgr2=0x7f0e3409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:42.372 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.369+0000 7f0e3a55e640 1 -- 172.21.15.105:0/2721262151 shutdown_connections 2024-09-21T03:26:42.372 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.369+0000 7f0e3a55e640 1 -- 172.21.15.105:0/2721262151 wait complete. 2024-09-21T03:26:42.372 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.371+0000 7f0e3a55e640 1 Processor -- start 2024-09-21T03:26:42.373 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.371+0000 7f0e3a55e640 1 -- start start 2024-09-21T03:26:42.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.373+0000 7f0e3a55e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e3406f4b0 0x7f0e34160450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:42.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.373+0000 7f0e3a55e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e340d3870 0x7f0e3415dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:42.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.373+0000 7f0e3a55e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e340ce5f0 0x7f0e340cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:42.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.373+0000 7f0e3a55e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0e340d0ce0 con 0x7f0e3406f4b0 2024-09-21T03:26:42.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.373+0000 7f0e3a55e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0e340d0e60 con 0x7f0e340d3870 2024-09-21T03:26:42.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.373+0000 7f0e3a55e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0e340d0fe0 con 0x7f0e340ce5f0 2024-09-21T03:26:42.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.373+0000 7f0e33fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e3406f4b0 0x7f0e34160450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:42.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.373+0000 7f0e33fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e3406f4b0 0x7f0e34160450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:46262/0 (socket says 172.21.15.105:46262) 2024-09-21T03:26:42.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.373+0000 7f0e33fff640 1 -- 172.21.15.105:0/2253621599 learned_addr learned my addr 172.21.15.105:0/2253621599 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:42.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.373+0000 7f0e337fe640 1 --2- 172.21.15.105:0/2253621599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e340d3870 0x7f0e3415dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:42.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.373+0000 7f0e38afb640 1 --2- 172.21.15.105:0/2253621599 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e340ce5f0 0x7f0e340cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:42.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.373+0000 7f0e33fff640 1 -- 172.21.15.105:0/2253621599 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e340ce5f0 msgr2=0x7f0e340cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:42.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.373+0000 7f0e33fff640 1 --2- 172.21.15.105:0/2253621599 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e340ce5f0 0x7f0e340cddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:42.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.373+0000 7f0e33fff640 1 -- 172.21.15.105:0/2253621599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e340d3870 msgr2=0x7f0e3415dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:42.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.373+0000 7f0e33fff640 1 --2- 172.21.15.105:0/2253621599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e340d3870 0x7f0e3415dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:42.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.373+0000 7f0e33fff640 1 -- 172.21.15.105:0/2253621599 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e341f6660 con 0x7f0e3406f4b0 2024-09-21T03:26:42.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.373+0000 7f0e33fff640 1 --2- 172.21.15.105:0/2253621599 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e3406f4b0 0x7f0e34160450 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f0e2400b410 tx=0x7f0e2400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:42.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.373+0000 7f0e30ff9640 1 -- 172.21.15.105:0/2253621599 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e24015020 con 0x7f0e3406f4b0 2024-09-21T03:26:42.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.373+0000 7f0e30ff9640 1 -- 172.21.15.105:0/2253621599 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e24011940 con 0x7f0e3406f4b0 2024-09-21T03:26:42.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.373+0000 7f0e3a55e640 1 -- 172.21.15.105:0/2253621599 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e3415f970 con 0x7f0e3406f4b0 2024-09-21T03:26:42.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.373+0000 7f0e30ff9640 1 -- 172.21.15.105:0/2253621599 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e24011d90 con 0x7f0e3406f4b0 2024-09-21T03:26:42.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.374+0000 7f0e3a55e640 1 -- 172.21.15.105:0/2253621599 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e3415ff30 con 0x7f0e3406f4b0 2024-09-21T03:26:42.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.375+0000 7f0e3a55e640 1 -- 172.21.15.105:0/2253621599 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e34051080 con 0x7f0e3406f4b0 2024-09-21T03:26:42.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.375+0000 7f0e30ff9640 1 -- 172.21.15.105:0/2253621599 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0e24018020 con 0x7f0e3406f4b0 2024-09-21T03:26:42.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.376+0000 7f0e30ff9640 1 --2- 172.21.15.105:0/2253621599 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0e20078b90 0x7f0e2007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:42.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.376+0000 7f0e30ff9640 1 -- 172.21.15.105:0/2253621599 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7f0e2409ab10 con 0x7f0e3406f4b0 2024-09-21T03:26:42.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.376+0000 7f0e337fe640 1 --2- 172.21.15.105:0/2253621599 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0e20078b90 0x7f0e2007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:42.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.376+0000 7f0e337fe640 1 --2- 172.21.15.105:0/2253621599 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0e20078b90 0x7f0e2007b0a0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0e28033000 tx=0x7f0e28004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:42.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.380+0000 7f0e30ff9640 1 -- 172.21.15.105:0/2253621599 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0e34051080 con 0x7f0e3406f4b0 2024-09-21T03:26:42.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.553+0000 7f0e3a55e640 1 -- 172.21.15.105:0/2253621599 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0e340d1580 con 0x7f0e20078b90 2024-09-21T03:26:42.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.558+0000 7f0e30ff9640 1 -- 172.21.15.105:0/2253621599 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252476 (secure 0 0 0) 0x7f0e340d1580 con 0x7f0e20078b90 2024-09-21T03:26:42.562 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:26:42.563 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:26:42.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.561+0000 7f0e3a55e640 1 -- 172.21.15.105:0/2253621599 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0e20078b90 msgr2=0x7f0e2007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:42.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.561+0000 7f0e3a55e640 1 --2- 172.21.15.105:0/2253621599 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0e20078b90 0x7f0e2007b0a0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0e28033000 tx=0x7f0e28004730 comp rx=0 tx=0).stop 2024-09-21T03:26:42.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.561+0000 7f0e3a55e640 1 -- 172.21.15.105:0/2253621599 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e3406f4b0 msgr2=0x7f0e34160450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:42.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.561+0000 7f0e3a55e640 1 --2- 172.21.15.105:0/2253621599 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e3406f4b0 0x7f0e34160450 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f0e2400b410 tx=0x7f0e2400b8d0 comp rx=0 tx=0).stop 2024-09-21T03:26:42.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.561+0000 7f0e3a55e640 1 -- 172.21.15.105:0/2253621599 shutdown_connections 2024-09-21T03:26:42.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.561+0000 7f0e3a55e640 1 --2- 172.21.15.105:0/2253621599 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0e20078b90 0x7f0e2007b0a0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:42.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.561+0000 7f0e3a55e640 1 --2- 172.21.15.105:0/2253621599 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e340ce5f0 0x7f0e340cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:42.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.561+0000 7f0e3a55e640 1 --2- 172.21.15.105:0/2253621599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e340d3870 0x7f0e3415dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:42.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.561+0000 7f0e3a55e640 1 --2- 172.21.15.105:0/2253621599 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e3406f4b0 0x7f0e34160450 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:42.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.561+0000 7f0e3a55e640 1 -- 172.21.15.105:0/2253621599 >> 172.21.15.105:0/2253621599 conn(0x7f0e3408bfc0 msgr2=0x7f0e340b89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:42.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.561+0000 7f0e3a55e640 1 -- 172.21.15.105:0/2253621599 shutdown_connections 2024-09-21T03:26:42.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.561+0000 7f0e3a55e640 1 -- 172.21.15.105:0/2253621599 wait complete. 2024-09-21T03:26:42.574 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":375,"stamp":"2024-09-21T03:26:41.412226+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":271652,"kb_used_data":13800,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754703068,"statfs":{"total":773094113280,"available":772815941632,"internally_reserved":0,"allocated":14131200,"data_stored":6707604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002168"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.765880+0000","last_change":"2024-09-21T03:26:33.773474+0000","last_active":"2024-09-21T03:26:34.765880+0000","last_peered":"2024-09-21T03:26:34.765880+0000","last_clean":"2024-09-21T03:26:34.765880+0000","last_became_active":"2024-09-21T03:26:33.773126+0000","last_became_peered":"2024-09-21T03:26:33.773126+0000","last_unstale":"2024-09-21T03:26:34.765880+0000","last_undegraded":"2024-09-21T03:26:34.765880+0000","last_fullsized":"2024-09-21T03:26:34.765880+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:26.197192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.958746+0000","last_change":"2024-09-21T03:26:33.766511+0000","last_active":"2024-09-21T03:26:34.958746+0000","last_peered":"2024-09-21T03:26:34.958746+0000","last_clean":"2024-09-21T03:26:34.958746+0000","last_became_active":"2024-09-21T03:26:33.766185+0000","last_became_peered":"2024-09-21T03:26:33.766185+0000","last_unstale":"2024-09-21T03:26:34.958746+0000","last_undegraded":"2024-09-21T03:26:34.958746+0000","last_fullsized":"2024-09-21T03:26:34.958746+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:41:55.824088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.770310+0000","last_change":"2024-09-21T03:26:33.773679+0000","last_active":"2024-09-21T03:26:34.770310+0000","last_peered":"2024-09-21T03:26:34.770310+0000","last_clean":"2024-09-21T03:26:34.770310+0000","last_became_active":"2024-09-21T03:26:33.773362+0000","last_became_peered":"2024-09-21T03:26:33.773362+0000","last_unstale":"2024-09-21T03:26:34.770310+0000","last_undegraded":"2024-09-21T03:26:34.770310+0000","last_fullsized":"2024-09-21T03:26:34.770310+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:26:26.947357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959120+0000","last_change":"2024-09-21T03:26:33.772792+0000","last_active":"2024-09-21T03:26:34.959120+0000","last_peered":"2024-09-21T03:26:34.959120+0000","last_clean":"2024-09-21T03:26:34.959120+0000","last_became_active":"2024-09-21T03:26:33.772491+0000","last_became_peered":"2024-09-21T03:26:33.772491+0000","last_unstale":"2024-09-21T03:26:34.959120+0000","last_undegraded":"2024-09-21T03:26:34.959120+0000","last_fullsized":"2024-09-21T03:26:34.959120+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:57.306644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.769733+0000","last_change":"2024-09-21T03:26:33.780757+0000","last_active":"2024-09-21T03:26:34.769733+0000","last_peered":"2024-09-21T03:26:34.769733+0000","last_clean":"2024-09-21T03:26:34.769733+0000","last_became_active":"2024-09-21T03:26:33.780441+0000","last_became_peered":"2024-09-21T03:26:33.780441+0000","last_unstale":"2024-09-21T03:26:34.769733+0000","last_undegraded":"2024-09-21T03:26:34.769733+0000","last_fullsized":"2024-09-21T03:26:34.769733+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:02:00.988380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.765445+0000","last_change":"2024-09-21T03:26:33.783573+0000","last_active":"2024-09-21T03:26:34.765445+0000","last_peered":"2024-09-21T03:26:34.765445+0000","last_clean":"2024-09-21T03:26:34.765445+0000","last_became_active":"2024-09-21T03:26:33.783232+0000","last_became_peered":"2024-09-21T03:26:33.783232+0000","last_unstale":"2024-09-21T03:26:34.765445+0000","last_undegraded":"2024-09-21T03:26:34.765445+0000","last_fullsized":"2024-09-21T03:26:34.765445+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:22.073536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.958840+0000","last_change":"2024-09-21T03:26:33.778224+0000","last_active":"2024-09-21T03:26:34.958840+0000","last_peered":"2024-09-21T03:26:34.958840+0000","last_clean":"2024-09-21T03:26:34.958840+0000","last_became_active":"2024-09-21T03:26:33.777885+0000","last_became_peered":"2024-09-21T03:26:33.777885+0000","last_unstale":"2024-09-21T03:26:34.958840+0000","last_undegraded":"2024-09-21T03:26:34.958840+0000","last_fullsized":"2024-09-21T03:26:34.958840+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:49:47.764557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.765255+0000","last_change":"2024-09-21T03:26:33.772430+0000","last_active":"2024-09-21T03:26:34.765255+0000","last_peered":"2024-09-21T03:26:34.765255+0000","last_clean":"2024-09-21T03:26:34.765255+0000","last_became_active":"2024-09-21T03:26:33.772168+0000","last_became_peered":"2024-09-21T03:26:33.772168+0000","last_unstale":"2024-09-21T03:26:34.765255+0000","last_undegraded":"2024-09-21T03:26:34.765255+0000","last_fullsized":"2024-09-21T03:26:34.765255+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:32.951636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.958656+0000","last_change":"2024-09-21T03:26:33.774996+0000","last_active":"2024-09-21T03:26:34.958656+0000","last_peered":"2024-09-21T03:26:34.958656+0000","last_clean":"2024-09-21T03:26:34.958656+0000","last_became_active":"2024-09-21T03:26:33.774498+0000","last_became_peered":"2024-09-21T03:26:33.774498+0000","last_unstale":"2024-09-21T03:26:34.958656+0000","last_undegraded":"2024-09-21T03:26:34.958656+0000","last_fullsized":"2024-09-21T03:26:34.958656+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:34:56.082467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.775308+0000","last_change":"2024-09-21T03:26:33.781446+0000","last_active":"2024-09-21T03:26:34.775308+0000","last_peered":"2024-09-21T03:26:34.775308+0000","last_clean":"2024-09-21T03:26:34.775308+0000","last_became_active":"2024-09-21T03:26:33.781157+0000","last_became_peered":"2024-09-21T03:26:33.781157+0000","last_unstale":"2024-09-21T03:26:34.775308+0000","last_undegraded":"2024-09-21T03:26:34.775308+0000","last_fullsized":"2024-09-21T03:26:34.775308+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:13.553957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.765759+0000","last_change":"2024-09-21T03:26:33.772408+0000","last_active":"2024-09-21T03:26:34.765759+0000","last_peered":"2024-09-21T03:26:34.765759+0000","last_clean":"2024-09-21T03:26:34.765759+0000","last_became_active":"2024-09-21T03:26:33.772130+0000","last_became_peered":"2024-09-21T03:26:33.772130+0000","last_unstale":"2024-09-21T03:26:34.765759+0000","last_undegraded":"2024-09-21T03:26:34.765759+0000","last_fullsized":"2024-09-21T03:26:34.765759+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:38.267294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.775110+0000","last_change":"2024-09-21T03:26:33.784557+0000","last_active":"2024-09-21T03:26:34.775110+0000","last_peered":"2024-09-21T03:26:34.775110+0000","last_clean":"2024-09-21T03:26:34.775110+0000","last_became_active":"2024-09-21T03:26:33.784237+0000","last_became_peered":"2024-09-21T03:26:33.784237+0000","last_unstale":"2024-09-21T03:26:34.775110+0000","last_undegraded":"2024-09-21T03:26:34.775110+0000","last_fullsized":"2024-09-21T03:26:34.775110+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:13:33.066896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.770548+0000","last_change":"2024-09-21T03:26:33.778253+0000","last_active":"2024-09-21T03:26:34.770548+0000","last_peered":"2024-09-21T03:26:34.770548+0000","last_clean":"2024-09-21T03:26:34.770548+0000","last_became_active":"2024-09-21T03:26:33.776400+0000","last_became_peered":"2024-09-21T03:26:33.776400+0000","last_unstale":"2024-09-21T03:26:34.770548+0000","last_undegraded":"2024-09-21T03:26:34.770548+0000","last_fullsized":"2024-09-21T03:26:34.770548+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:44:39.494793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.958778+0000","last_change":"2024-09-21T03:26:33.779406+0000","last_active":"2024-09-21T03:26:34.958778+0000","last_peered":"2024-09-21T03:26:34.958778+0000","last_clean":"2024-09-21T03:26:34.958778+0000","last_became_active":"2024-09-21T03:26:33.778754+0000","last_became_peered":"2024-09-21T03:26:33.778754+0000","last_unstale":"2024-09-21T03:26:34.958778+0000","last_undegraded":"2024-09-21T03:26:34.958778+0000","last_fullsized":"2024-09-21T03:26:34.958778+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:01:40.179380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.774922+0000","last_change":"2024-09-21T03:26:33.775005+0000","last_active":"2024-09-21T03:26:34.774922+0000","last_peered":"2024-09-21T03:26:34.774922+0000","last_clean":"2024-09-21T03:26:34.774922+0000","last_became_active":"2024-09-21T03:26:33.774707+0000","last_became_peered":"2024-09-21T03:26:33.774707+0000","last_unstale":"2024-09-21T03:26:34.774922+0000","last_undegraded":"2024-09-21T03:26:34.774922+0000","last_fullsized":"2024-09-21T03:26:34.774922+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:56:43.620306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959443+0000","last_change":"2024-09-21T03:26:33.775048+0000","last_active":"2024-09-21T03:26:34.959443+0000","last_peered":"2024-09-21T03:26:34.959443+0000","last_clean":"2024-09-21T03:26:34.959443+0000","last_became_active":"2024-09-21T03:26:33.774517+0000","last_became_peered":"2024-09-21T03:26:33.774517+0000","last_unstale":"2024-09-21T03:26:34.959443+0000","last_undegraded":"2024-09-21T03:26:34.959443+0000","last_fullsized":"2024-09-21T03:26:34.959443+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:29.049986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.775519+0000","last_change":"2024-09-21T03:26:33.777907+0000","last_active":"2024-09-21T03:26:34.775519+0000","last_peered":"2024-09-21T03:26:34.775519+0000","last_clean":"2024-09-21T03:26:34.775519+0000","last_became_active":"2024-09-21T03:26:33.777490+0000","last_became_peered":"2024-09-21T03:26:33.777490+0000","last_unstale":"2024-09-21T03:26:34.775519+0000","last_undegraded":"2024-09-21T03:26:34.775519+0000","last_fullsized":"2024-09-21T03:26:34.775519+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:17.183507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.769572+0000","last_change":"2024-09-21T03:26:33.773347+0000","last_active":"2024-09-21T03:26:34.769572+0000","last_peered":"2024-09-21T03:26:34.769572+0000","last_clean":"2024-09-21T03:26:34.769572+0000","last_became_active":"2024-09-21T03:26:33.772983+0000","last_became_peered":"2024-09-21T03:26:33.772983+0000","last_unstale":"2024-09-21T03:26:34.769572+0000","last_undegraded":"2024-09-21T03:26:34.769572+0000","last_fullsized":"2024-09-21T03:26:34.769572+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:47.216164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.765995+0000","last_change":"2024-09-21T03:26:33.771192+0000","last_active":"2024-09-21T03:26:34.765995+0000","last_peered":"2024-09-21T03:26:34.765995+0000","last_clean":"2024-09-21T03:26:34.765995+0000","last_became_active":"2024-09-21T03:26:33.770855+0000","last_became_peered":"2024-09-21T03:26:33.770855+0000","last_unstale":"2024-09-21T03:26:34.765995+0000","last_undegraded":"2024-09-21T03:26:34.765995+0000","last_fullsized":"2024-09-21T03:26:34.765995+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:54:21.984616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959969+0000","last_change":"2024-09-21T03:26:33.770101+0000","last_active":"2024-09-21T03:26:34.959969+0000","last_peered":"2024-09-21T03:26:34.959969+0000","last_clean":"2024-09-21T03:26:34.959969+0000","last_became_active":"2024-09-21T03:26:33.769370+0000","last_became_peered":"2024-09-21T03:26:33.769370+0000","last_unstale":"2024-09-21T03:26:34.959969+0000","last_undegraded":"2024-09-21T03:26:34.959969+0000","last_fullsized":"2024-09-21T03:26:34.959969+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:31:46.998959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.775169+0000","last_change":"2024-09-21T03:26:33.778551+0000","last_active":"2024-09-21T03:26:34.775169+0000","last_peered":"2024-09-21T03:26:34.775169+0000","last_clean":"2024-09-21T03:26:34.775169+0000","last_became_active":"2024-09-21T03:26:33.778206+0000","last_became_peered":"2024-09-21T03:26:33.778206+0000","last_unstale":"2024-09-21T03:26:34.775169+0000","last_undegraded":"2024-09-21T03:26:34.775169+0000","last_fullsized":"2024-09-21T03:26:34.775169+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:05:29.953073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.958842+0000","last_change":"2024-09-21T03:26:33.763813+0000","last_active":"2024-09-21T03:26:34.958842+0000","last_peered":"2024-09-21T03:26:34.958842+0000","last_clean":"2024-09-21T03:26:34.958842+0000","last_became_active":"2024-09-21T03:26:33.763434+0000","last_became_peered":"2024-09-21T03:26:33.763434+0000","last_unstale":"2024-09-21T03:26:34.958842+0000","last_undegraded":"2024-09-21T03:26:34.958842+0000","last_fullsized":"2024-09-21T03:26:34.958842+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:43.099658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.958747+0000","last_change":"2024-09-21T03:26:33.772738+0000","last_active":"2024-09-21T03:26:34.958747+0000","last_peered":"2024-09-21T03:26:34.958747+0000","last_clean":"2024-09-21T03:26:34.958747+0000","last_became_active":"2024-09-21T03:26:33.772423+0000","last_became_peered":"2024-09-21T03:26:33.772423+0000","last_unstale":"2024-09-21T03:26:34.958747+0000","last_undegraded":"2024-09-21T03:26:34.958747+0000","last_fullsized":"2024-09-21T03:26:34.958747+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:25.118437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.774752+0000","last_change":"2024-09-21T03:26:33.784135+0000","last_active":"2024-09-21T03:26:34.774752+0000","last_peered":"2024-09-21T03:26:34.774752+0000","last_clean":"2024-09-21T03:26:34.774752+0000","last_became_active":"2024-09-21T03:26:33.783814+0000","last_became_peered":"2024-09-21T03:26:33.783814+0000","last_unstale":"2024-09-21T03:26:34.774752+0000","last_undegraded":"2024-09-21T03:26:34.774752+0000","last_fullsized":"2024-09-21T03:26:34.774752+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:12.729536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959888+0000","last_change":"2024-09-21T03:26:33.774996+0000","last_active":"2024-09-21T03:26:34.959888+0000","last_peered":"2024-09-21T03:26:34.959888+0000","last_clean":"2024-09-21T03:26:34.959888+0000","last_became_active":"2024-09-21T03:26:33.774645+0000","last_became_peered":"2024-09-21T03:26:33.774645+0000","last_unstale":"2024-09-21T03:26:34.959888+0000","last_undegraded":"2024-09-21T03:26:34.959888+0000","last_fullsized":"2024-09-21T03:26:34.959888+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:21:26.248473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.765551+0000","last_change":"2024-09-21T03:26:33.770500+0000","last_active":"2024-09-21T03:26:34.765551+0000","last_peered":"2024-09-21T03:26:34.765551+0000","last_clean":"2024-09-21T03:26:34.765551+0000","last_became_active":"2024-09-21T03:26:33.770180+0000","last_became_peered":"2024-09-21T03:26:33.770180+0000","last_unstale":"2024-09-21T03:26:34.765551+0000","last_undegraded":"2024-09-21T03:26:34.765551+0000","last_fullsized":"2024-09-21T03:26:34.765551+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:23:17.751984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959856+0000","last_change":"2024-09-21T03:26:33.790215+0000","last_active":"2024-09-21T03:26:34.959856+0000","last_peered":"2024-09-21T03:26:34.959856+0000","last_clean":"2024-09-21T03:26:34.959856+0000","last_became_active":"2024-09-21T03:26:33.789832+0000","last_became_peered":"2024-09-21T03:26:33.789832+0000","last_unstale":"2024-09-21T03:26:34.959856+0000","last_undegraded":"2024-09-21T03:26:34.959856+0000","last_fullsized":"2024-09-21T03:26:34.959856+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:46.793453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959021+0000","last_change":"2024-09-21T03:26:33.768428+0000","last_active":"2024-09-21T03:26:34.959021+0000","last_peered":"2024-09-21T03:26:34.959021+0000","last_clean":"2024-09-21T03:26:34.959021+0000","last_became_active":"2024-09-21T03:26:33.768104+0000","last_became_peered":"2024-09-21T03:26:33.768104+0000","last_unstale":"2024-09-21T03:26:34.959021+0000","last_undegraded":"2024-09-21T03:26:34.959021+0000","last_fullsized":"2024-09-21T03:26:34.959021+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:36:09.772044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.765419+0000","last_change":"2024-09-21T03:26:33.769089+0000","last_active":"2024-09-21T03:26:34.765419+0000","last_peered":"2024-09-21T03:26:34.765419+0000","last_clean":"2024-09-21T03:26:34.765419+0000","last_became_active":"2024-09-21T03:26:33.768766+0000","last_became_peered":"2024-09-21T03:26:33.768766+0000","last_unstale":"2024-09-21T03:26:34.765419+0000","last_undegraded":"2024-09-21T03:26:34.765419+0000","last_fullsized":"2024-09-21T03:26:34.765419+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:32.257359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959402+0000","last_change":"2024-09-21T03:26:33.768400+0000","last_active":"2024-09-21T03:26:34.959402+0000","last_peered":"2024-09-21T03:26:34.959402+0000","last_clean":"2024-09-21T03:26:34.959402+0000","last_became_active":"2024-09-21T03:26:33.767381+0000","last_became_peered":"2024-09-21T03:26:33.767381+0000","last_unstale":"2024-09-21T03:26:34.959402+0000","last_undegraded":"2024-09-21T03:26:34.959402+0000","last_fullsized":"2024-09-21T03:26:34.959402+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:32.630320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.958601+0000","last_change":"2024-09-21T03:26:33.784028+0000","last_active":"2024-09-21T03:26:34.958601+0000","last_peered":"2024-09-21T03:26:34.958601+0000","last_clean":"2024-09-21T03:26:34.958601+0000","last_became_active":"2024-09-21T03:26:33.783669+0000","last_became_peered":"2024-09-21T03:26:33.783669+0000","last_unstale":"2024-09-21T03:26:34.958601+0000","last_undegraded":"2024-09-21T03:26:34.958601+0000","last_fullsized":"2024-09-21T03:26:34.958601+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:53.720126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959349+0000","last_change":"2024-09-21T03:26:33.779184+0000","last_active":"2024-09-21T03:26:34.959349+0000","last_peered":"2024-09-21T03:26:34.959349+0000","last_clean":"2024-09-21T03:26:34.959349+0000","last_became_active":"2024-09-21T03:26:33.778904+0000","last_became_peered":"2024-09-21T03:26:33.778904+0000","last_unstale":"2024-09-21T03:26:34.959349+0000","last_undegraded":"2024-09-21T03:26:34.959349+0000","last_fullsized":"2024-09-21T03:26:34.959349+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:23.872209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.775438+0000","last_change":"2024-09-21T03:26:33.785566+0000","last_active":"2024-09-21T03:26:34.775438+0000","last_peered":"2024-09-21T03:26:34.775438+0000","last_clean":"2024-09-21T03:26:34.775438+0000","last_became_active":"2024-09-21T03:26:33.785221+0000","last_became_peered":"2024-09-21T03:26:33.785221+0000","last_unstale":"2024-09-21T03:26:34.775438+0000","last_undegraded":"2024-09-21T03:26:34.775438+0000","last_fullsized":"2024-09-21T03:26:34.775438+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:07.417771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"128'4","reported_seq":19,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.775304+0000","last_change":"2024-09-21T03:26:32.765626+0000","last_active":"2024-09-21T03:26:34.775304+0000","last_peered":"2024-09-21T03:26:34.775304+0000","last_clean":"2024-09-21T03:26:34.775304+0000","last_became_active":"2024-09-21T03:26:32.764896+0000","last_became_peered":"2024-09-21T03:26:32.764896+0000","last_unstale":"2024-09-21T03:26:34.775304+0000","last_undegraded":"2024-09-21T03:26:34.775304+0000","last_fullsized":"2024-09-21T03:26:34.775304+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:34:56.587734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.958949+0000","last_change":"2024-09-21T03:26:33.767522+0000","last_active":"2024-09-21T03:26:34.958949+0000","last_peered":"2024-09-21T03:26:34.958949+0000","last_clean":"2024-09-21T03:26:34.958949+0000","last_became_active":"2024-09-21T03:26:33.767247+0000","last_became_peered":"2024-09-21T03:26:33.767247+0000","last_unstale":"2024-09-21T03:26:34.958949+0000","last_undegraded":"2024-09-21T03:26:34.958949+0000","last_fullsized":"2024-09-21T03:26:34.958949+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:28.831758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"128'1","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.958930+0000","last_change":"2024-09-21T03:26:32.763786+0000","last_active":"2024-09-21T03:26:34.958930+0000","last_peered":"2024-09-21T03:26:34.958930+0000","last_clean":"2024-09-21T03:26:34.958930+0000","last_became_active":"2024-09-21T03:26:32.763296+0000","last_became_peered":"2024-09-21T03:26:32.763296+0000","last_unstale":"2024-09-21T03:26:34.958930+0000","last_undegraded":"2024-09-21T03:26:34.958930+0000","last_fullsized":"2024-09-21T03:26:34.958930+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:45:39.339674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.765544+0000","last_change":"2024-09-21T03:26:33.765729+0000","last_active":"2024-09-21T03:26:34.765544+0000","last_peered":"2024-09-21T03:26:34.765544+0000","last_clean":"2024-09-21T03:26:34.765544+0000","last_became_active":"2024-09-21T03:26:33.765409+0000","last_became_peered":"2024-09-21T03:26:33.765409+0000","last_unstale":"2024-09-21T03:26:34.765544+0000","last_undegraded":"2024-09-21T03:26:34.765544+0000","last_fullsized":"2024-09-21T03:26:34.765544+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:14:20.886720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"128'2","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959045+0000","last_change":"2024-09-21T03:26:32.760363+0000","last_active":"2024-09-21T03:26:34.959045+0000","last_peered":"2024-09-21T03:26:34.959045+0000","last_clean":"2024-09-21T03:26:34.959045+0000","last_became_active":"2024-09-21T03:26:32.760059+0000","last_became_peered":"2024-09-21T03:26:32.760059+0000","last_unstale":"2024-09-21T03:26:34.959045+0000","last_undegraded":"2024-09-21T03:26:34.959045+0000","last_fullsized":"2024-09-21T03:26:34.959045+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:31.251796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.775099+0000","last_change":"2024-09-21T03:26:33.782604+0000","last_active":"2024-09-21T03:26:34.775099+0000","last_peered":"2024-09-21T03:26:34.775099+0000","last_clean":"2024-09-21T03:26:34.775099+0000","last_became_active":"2024-09-21T03:26:33.782291+0000","last_became_peered":"2024-09-21T03:26:33.782291+0000","last_unstale":"2024-09-21T03:26:34.775099+0000","last_undegraded":"2024-09-21T03:26:34.775099+0000","last_fullsized":"2024-09-21T03:26:34.775099+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:29:25.345612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"128'2","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959200+0000","last_change":"2024-09-21T03:26:32.754258+0000","last_active":"2024-09-21T03:26:34.959200+0000","last_peered":"2024-09-21T03:26:34.959200+0000","last_clean":"2024-09-21T03:26:34.959200+0000","last_became_active":"2024-09-21T03:26:32.753929+0000","last_became_peered":"2024-09-21T03:26:32.753929+0000","last_unstale":"2024-09-21T03:26:34.959200+0000","last_undegraded":"2024-09-21T03:26:34.959200+0000","last_fullsized":"2024-09-21T03:26:34.959200+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:31.946073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959147+0000","last_change":"2024-09-21T03:26:33.784106+0000","last_active":"2024-09-21T03:26:34.959147+0000","last_peered":"2024-09-21T03:26:34.959147+0000","last_clean":"2024-09-21T03:26:34.959147+0000","last_became_active":"2024-09-21T03:26:33.783688+0000","last_became_peered":"2024-09-21T03:26:33.783688+0000","last_unstale":"2024-09-21T03:26:34.959147+0000","last_undegraded":"2024-09-21T03:26:34.959147+0000","last_fullsized":"2024-09-21T03:26:34.959147+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:03.641842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"128'1","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959456+0000","last_change":"2024-09-21T03:26:32.765736+0000","last_active":"2024-09-21T03:26:34.959456+0000","last_peered":"2024-09-21T03:26:34.959456+0000","last_clean":"2024-09-21T03:26:34.959456+0000","last_became_active":"2024-09-21T03:26:32.765227+0000","last_became_peered":"2024-09-21T03:26:32.765227+0000","last_unstale":"2024-09-21T03:26:34.959456+0000","last_undegraded":"2024-09-21T03:26:34.959456+0000","last_fullsized":"2024-09-21T03:26:34.959456+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:11.740588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959063+0000","last_change":"2024-09-21T03:26:33.773810+0000","last_active":"2024-09-21T03:26:34.959063+0000","last_peered":"2024-09-21T03:26:34.959063+0000","last_clean":"2024-09-21T03:26:34.959063+0000","last_became_active":"2024-09-21T03:26:33.772672+0000","last_became_peered":"2024-09-21T03:26:33.772672+0000","last_unstale":"2024-09-21T03:26:34.959063+0000","last_undegraded":"2024-09-21T03:26:34.959063+0000","last_fullsized":"2024-09-21T03:26:34.959063+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:26:26.947357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"128'1","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.768564+0000","last_change":"2024-09-21T03:26:32.765921+0000","last_active":"2024-09-21T03:26:34.768564+0000","last_peered":"2024-09-21T03:26:34.768564+0000","last_clean":"2024-09-21T03:26:34.768564+0000","last_became_active":"2024-09-21T03:26:32.765525+0000","last_became_peered":"2024-09-21T03:26:32.765525+0000","last_unstale":"2024-09-21T03:26:34.768564+0000","last_undegraded":"2024-09-21T03:26:34.768564+0000","last_fullsized":"2024-09-21T03:26:34.768564+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:56:52.343670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959452+0000","last_change":"2024-09-21T03:26:33.772532+0000","last_active":"2024-09-21T03:26:34.959452+0000","last_peered":"2024-09-21T03:26:34.959452+0000","last_clean":"2024-09-21T03:26:34.959452+0000","last_became_active":"2024-09-21T03:26:33.772232+0000","last_became_peered":"2024-09-21T03:26:33.772232+0000","last_unstale":"2024-09-21T03:26:34.959452+0000","last_undegraded":"2024-09-21T03:26:34.959452+0000","last_fullsized":"2024-09-21T03:26:34.959452+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:58:12.729536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959836+0000","last_change":"2024-09-21T03:26:32.763337+0000","last_active":"2024-09-21T03:26:34.959836+0000","last_peered":"2024-09-21T03:26:34.959836+0000","last_clean":"2024-09-21T03:26:34.959836+0000","last_became_active":"2024-09-21T03:26:32.763033+0000","last_became_peered":"2024-09-21T03:26:32.763033+0000","last_unstale":"2024-09-21T03:26:34.959836+0000","last_undegraded":"2024-09-21T03:26:34.959836+0000","last_fullsized":"2024-09-21T03:26:34.959836+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:39.376437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.769303+0000","last_change":"2024-09-21T03:26:33.780885+0000","last_active":"2024-09-21T03:26:34.769303+0000","last_peered":"2024-09-21T03:26:34.769303+0000","last_clean":"2024-09-21T03:26:34.769303+0000","last_became_active":"2024-09-21T03:26:33.778901+0000","last_became_peered":"2024-09-21T03:26:33.778901+0000","last_unstale":"2024-09-21T03:26:34.769303+0000","last_undegraded":"2024-09-21T03:26:34.769303+0000","last_fullsized":"2024-09-21T03:26:34.769303+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:03.768420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.958558+0000","last_change":"2024-09-21T03:26:32.758610+0000","last_active":"2024-09-21T03:26:34.958558+0000","last_peered":"2024-09-21T03:26:34.958558+0000","last_clean":"2024-09-21T03:26:34.958558+0000","last_became_active":"2024-09-21T03:26:32.758254+0000","last_became_peered":"2024-09-21T03:26:32.758254+0000","last_unstale":"2024-09-21T03:26:34.958558+0000","last_undegraded":"2024-09-21T03:26:34.958558+0000","last_fullsized":"2024-09-21T03:26:34.958558+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:06:15.581950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.769065+0000","last_change":"2024-09-21T03:26:33.776039+0000","last_active":"2024-09-21T03:26:34.769065+0000","last_peered":"2024-09-21T03:26:34.769065+0000","last_clean":"2024-09-21T03:26:34.769065+0000","last_became_active":"2024-09-21T03:26:33.775724+0000","last_became_peered":"2024-09-21T03:26:33.775724+0000","last_unstale":"2024-09-21T03:26:34.769065+0000","last_undegraded":"2024-09-21T03:26:34.769065+0000","last_fullsized":"2024-09-21T03:26:34.769065+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:26.356141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959114+0000","last_change":"2024-09-21T03:26:32.763498+0000","last_active":"2024-09-21T03:26:34.959114+0000","last_peered":"2024-09-21T03:26:34.959114+0000","last_clean":"2024-09-21T03:26:34.959114+0000","last_became_active":"2024-09-21T03:26:32.763195+0000","last_became_peered":"2024-09-21T03:26:32.763195+0000","last_unstale":"2024-09-21T03:26:34.959114+0000","last_undegraded":"2024-09-21T03:26:34.959114+0000","last_fullsized":"2024-09-21T03:26:34.959114+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:40.195826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.775390+0000","last_change":"2024-09-21T03:26:33.777560+0000","last_active":"2024-09-21T03:26:34.775390+0000","last_peered":"2024-09-21T03:26:34.775390+0000","last_clean":"2024-09-21T03:26:34.775390+0000","last_became_active":"2024-09-21T03:26:33.777130+0000","last_became_peered":"2024-09-21T03:26:33.777130+0000","last_unstale":"2024-09-21T03:26:34.775390+0000","last_undegraded":"2024-09-21T03:26:34.775390+0000","last_fullsized":"2024-09-21T03:26:34.775390+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:29:38.652698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.775697+0000","last_change":"2024-09-21T03:26:32.763210+0000","last_active":"2024-09-21T03:26:34.775697+0000","last_peered":"2024-09-21T03:26:34.775697+0000","last_clean":"2024-09-21T03:26:34.775697+0000","last_became_active":"2024-09-21T03:26:32.762766+0000","last_became_peered":"2024-09-21T03:26:32.762766+0000","last_unstale":"2024-09-21T03:26:34.775697+0000","last_undegraded":"2024-09-21T03:26:34.775697+0000","last_fullsized":"2024-09-21T03:26:34.775697+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:05:21.371507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959866+0000","last_change":"2024-09-21T03:26:33.770082+0000","last_active":"2024-09-21T03:26:34.959866+0000","last_peered":"2024-09-21T03:26:34.959866+0000","last_clean":"2024-09-21T03:26:34.959866+0000","last_became_active":"2024-09-21T03:26:33.769742+0000","last_became_peered":"2024-09-21T03:26:33.769742+0000","last_unstale":"2024-09-21T03:26:34.959866+0000","last_undegraded":"2024-09-21T03:26:34.959866+0000","last_fullsized":"2024-09-21T03:26:34.959866+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:40.949518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"128'6","reported_seq":21,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959389+0000","last_change":"2024-09-21T03:26:32.759495+0000","last_active":"2024-09-21T03:26:34.959389+0000","last_peered":"2024-09-21T03:26:34.959389+0000","last_clean":"2024-09-21T03:26:34.959389+0000","last_became_active":"2024-09-21T03:26:32.759122+0000","last_became_peered":"2024-09-21T03:26:32.759122+0000","last_unstale":"2024-09-21T03:26:34.959389+0000","last_undegraded":"2024-09-21T03:26:34.959389+0000","last_fullsized":"2024-09-21T03:26:34.959389+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:20.416584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.770442+0000","last_change":"2024-09-21T03:26:33.778003+0000","last_active":"2024-09-21T03:26:34.770442+0000","last_peered":"2024-09-21T03:26:34.770442+0000","last_clean":"2024-09-21T03:26:34.770442+0000","last_became_active":"2024-09-21T03:26:33.777671+0000","last_became_peered":"2024-09-21T03:26:33.777671+0000","last_unstale":"2024-09-21T03:26:34.770442+0000","last_undegraded":"2024-09-21T03:26:34.770442+0000","last_fullsized":"2024-09-21T03:26:34.770442+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:57.306644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"128'2","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.769866+0000","last_change":"2024-09-21T03:26:32.760470+0000","last_active":"2024-09-21T03:26:34.769866+0000","last_peered":"2024-09-21T03:26:34.769866+0000","last_clean":"2024-09-21T03:26:34.769866+0000","last_became_active":"2024-09-21T03:26:32.760171+0000","last_became_peered":"2024-09-21T03:26:32.760171+0000","last_unstale":"2024-09-21T03:26:34.769866+0000","last_undegraded":"2024-09-21T03:26:34.769866+0000","last_fullsized":"2024-09-21T03:26:34.769866+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:18.932391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959236+0000","last_change":"2024-09-21T03:26:33.766736+0000","last_active":"2024-09-21T03:26:34.959236+0000","last_peered":"2024-09-21T03:26:34.959236+0000","last_clean":"2024-09-21T03:26:34.959236+0000","last_became_active":"2024-09-21T03:26:33.766422+0000","last_became_peered":"2024-09-21T03:26:33.766422+0000","last_unstale":"2024-09-21T03:26:34.959236+0000","last_undegraded":"2024-09-21T03:26:34.959236+0000","last_fullsized":"2024-09-21T03:26:34.959236+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:56:43.620306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.770604+0000","last_change":"2024-09-21T03:26:32.762314+0000","last_active":"2024-09-21T03:26:34.770604+0000","last_peered":"2024-09-21T03:26:34.770604+0000","last_clean":"2024-09-21T03:26:34.770604+0000","last_became_active":"2024-09-21T03:26:32.762003+0000","last_became_peered":"2024-09-21T03:26:32.762003+0000","last_unstale":"2024-09-21T03:26:34.770604+0000","last_undegraded":"2024-09-21T03:26:34.770604+0000","last_fullsized":"2024-09-21T03:26:34.770604+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:40.283811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.770398+0000","last_change":"2024-09-21T03:26:33.776427+0000","last_active":"2024-09-21T03:26:34.770398+0000","last_peered":"2024-09-21T03:26:34.770398+0000","last_clean":"2024-09-21T03:26:34.770398+0000","last_became_active":"2024-09-21T03:26:33.775886+0000","last_became_peered":"2024-09-21T03:26:33.775886+0000","last_unstale":"2024-09-21T03:26:34.770398+0000","last_undegraded":"2024-09-21T03:26:34.770398+0000","last_fullsized":"2024-09-21T03:26:34.770398+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:22.057100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.765185+0000","last_change":"2024-09-21T03:26:32.756831+0000","last_active":"2024-09-21T03:26:34.765185+0000","last_peered":"2024-09-21T03:26:34.765185+0000","last_clean":"2024-09-21T03:26:34.765185+0000","last_became_active":"2024-09-21T03:26:32.756494+0000","last_became_peered":"2024-09-21T03:26:32.756494+0000","last_unstale":"2024-09-21T03:26:34.765185+0000","last_undegraded":"2024-09-21T03:26:34.765185+0000","last_fullsized":"2024-09-21T03:26:34.765185+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:14:18.720549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.768815+0000","last_change":"2024-09-21T03:26:33.779847+0000","last_active":"2024-09-21T03:26:34.768815+0000","last_peered":"2024-09-21T03:26:34.768815+0000","last_clean":"2024-09-21T03:26:34.768815+0000","last_became_active":"2024-09-21T03:26:33.779480+0000","last_became_peered":"2024-09-21T03:26:33.779480+0000","last_unstale":"2024-09-21T03:26:34.768815+0000","last_undegraded":"2024-09-21T03:26:34.768815+0000","last_fullsized":"2024-09-21T03:26:34.768815+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:01:40.179380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"128'8","reported_seq":23,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959611+0000","last_change":"2024-09-21T03:26:32.764507+0000","last_active":"2024-09-21T03:26:34.959611+0000","last_peered":"2024-09-21T03:26:34.959611+0000","last_clean":"2024-09-21T03:26:34.959611+0000","last_became_active":"2024-09-21T03:26:32.764170+0000","last_became_peered":"2024-09-21T03:26:32.764170+0000","last_unstale":"2024-09-21T03:26:34.959611+0000","last_undegraded":"2024-09-21T03:26:34.959611+0000","last_fullsized":"2024-09-21T03:26:34.959611+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:50:27.819210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.775567+0000","last_change":"2024-09-21T03:26:33.779644+0000","last_active":"2024-09-21T03:26:34.775567+0000","last_peered":"2024-09-21T03:26:34.775567+0000","last_clean":"2024-09-21T03:26:34.775567+0000","last_became_active":"2024-09-21T03:26:33.779352+0000","last_became_peered":"2024-09-21T03:26:33.779352+0000","last_unstale":"2024-09-21T03:26:34.775567+0000","last_undegraded":"2024-09-21T03:26:34.775567+0000","last_fullsized":"2024-09-21T03:26:34.775567+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:02.563961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"128'1","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.768571+0000","last_change":"2024-09-21T03:26:32.761374+0000","last_active":"2024-09-21T03:26:34.768571+0000","last_peered":"2024-09-21T03:26:34.768571+0000","last_clean":"2024-09-21T03:26:34.768571+0000","last_became_active":"2024-09-21T03:26:32.761046+0000","last_became_peered":"2024-09-21T03:26:32.761046+0000","last_unstale":"2024-09-21T03:26:34.768571+0000","last_undegraded":"2024-09-21T03:26:34.768571+0000","last_fullsized":"2024-09-21T03:26:34.768571+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:27.024217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959962+0000","last_change":"2024-09-21T03:26:33.777701+0000","last_active":"2024-09-21T03:26:34.959962+0000","last_peered":"2024-09-21T03:26:34.959962+0000","last_clean":"2024-09-21T03:26:34.959962+0000","last_became_active":"2024-09-21T03:26:33.777249+0000","last_became_peered":"2024-09-21T03:26:33.777249+0000","last_unstale":"2024-09-21T03:26:34.959962+0000","last_undegraded":"2024-09-21T03:26:34.959962+0000","last_fullsized":"2024-09-21T03:26:34.959962+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:33:05.046755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"128'2","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959059+0000","last_change":"2024-09-21T03:26:32.765118+0000","last_active":"2024-09-21T03:26:34.959059+0000","last_peered":"2024-09-21T03:26:34.959059+0000","last_clean":"2024-09-21T03:26:34.959059+0000","last_became_active":"2024-09-21T03:26:32.764807+0000","last_became_peered":"2024-09-21T03:26:32.764807+0000","last_unstale":"2024-09-21T03:26:34.959059+0000","last_undegraded":"2024-09-21T03:26:34.959059+0000","last_fullsized":"2024-09-21T03:26:34.959059+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:48.124371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.769302+0000","last_change":"2024-09-21T03:26:33.781782+0000","last_active":"2024-09-21T03:26:34.769302+0000","last_peered":"2024-09-21T03:26:34.769302+0000","last_clean":"2024-09-21T03:26:34.769302+0000","last_became_active":"2024-09-21T03:26:33.781464+0000","last_became_peered":"2024-09-21T03:26:33.781464+0000","last_unstale":"2024-09-21T03:26:34.769302+0000","last_undegraded":"2024-09-21T03:26:34.769302+0000","last_fullsized":"2024-09-21T03:26:34.769302+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:10:25.118437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"128'1","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.960112+0000","last_change":"2024-09-21T03:26:32.766023+0000","last_active":"2024-09-21T03:26:34.960112+0000","last_peered":"2024-09-21T03:26:34.960112+0000","last_clean":"2024-09-21T03:26:34.960112+0000","last_became_active":"2024-09-21T03:26:32.765690+0000","last_became_peered":"2024-09-21T03:26:32.765690+0000","last_unstale":"2024-09-21T03:26:34.960112+0000","last_undegraded":"2024-09-21T03:26:34.960112+0000","last_fullsized":"2024-09-21T03:26:34.960112+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:58.834991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.765780+0000","last_change":"2024-09-21T03:26:33.784184+0000","last_active":"2024-09-21T03:26:34.765780+0000","last_peered":"2024-09-21T03:26:34.765780+0000","last_clean":"2024-09-21T03:26:34.765780+0000","last_became_active":"2024-09-21T03:26:33.783222+0000","last_became_peered":"2024-09-21T03:26:33.783222+0000","last_unstale":"2024-09-21T03:26:34.765780+0000","last_undegraded":"2024-09-21T03:26:34.765780+0000","last_fullsized":"2024-09-21T03:26:34.765780+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:45:27.928339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.958890+0000","last_change":"2024-09-21T03:26:32.761613+0000","last_active":"2024-09-21T03:26:34.958890+0000","last_peered":"2024-09-21T03:26:34.958890+0000","last_clean":"2024-09-21T03:26:34.958890+0000","last_became_active":"2024-09-21T03:26:32.761327+0000","last_became_peered":"2024-09-21T03:26:32.761327+0000","last_unstale":"2024-09-21T03:26:34.958890+0000","last_undegraded":"2024-09-21T03:26:34.958890+0000","last_fullsized":"2024-09-21T03:26:34.958890+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:37.061012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959206+0000","last_change":"2024-09-21T03:26:33.770777+0000","last_active":"2024-09-21T03:26:34.959206+0000","last_peered":"2024-09-21T03:26:34.959206+0000","last_clean":"2024-09-21T03:26:34.959206+0000","last_became_active":"2024-09-21T03:26:33.769928+0000","last_became_peered":"2024-09-21T03:26:33.769928+0000","last_unstale":"2024-09-21T03:26:34.959206+0000","last_undegraded":"2024-09-21T03:26:34.959206+0000","last_fullsized":"2024-09-21T03:26:34.959206+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:46:43.682715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"128'2","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959425+0000","last_change":"2024-09-21T03:26:32.764098+0000","last_active":"2024-09-21T03:26:34.959425+0000","last_peered":"2024-09-21T03:26:34.959425+0000","last_clean":"2024-09-21T03:26:34.959425+0000","last_became_active":"2024-09-21T03:26:32.763369+0000","last_became_peered":"2024-09-21T03:26:32.763369+0000","last_unstale":"2024-09-21T03:26:34.959425+0000","last_undegraded":"2024-09-21T03:26:34.959425+0000","last_fullsized":"2024-09-21T03:26:34.959425+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:55.678113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959291+0000","last_change":"2024-09-21T03:26:33.778124+0000","last_active":"2024-09-21T03:26:34.959291+0000","last_peered":"2024-09-21T03:26:34.959291+0000","last_clean":"2024-09-21T03:26:34.959291+0000","last_became_active":"2024-09-21T03:26:33.777780+0000","last_became_peered":"2024-09-21T03:26:33.777780+0000","last_unstale":"2024-09-21T03:26:34.959291+0000","last_undegraded":"2024-09-21T03:26:34.959291+0000","last_fullsized":"2024-09-21T03:26:34.959291+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:22:20.865258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.774803+0000","last_change":"2024-09-21T03:26:32.764723+0000","last_active":"2024-09-21T03:26:34.774803+0000","last_peered":"2024-09-21T03:26:34.774803+0000","last_clean":"2024-09-21T03:26:34.774803+0000","last_became_active":"2024-09-21T03:26:32.764235+0000","last_became_peered":"2024-09-21T03:26:32.764235+0000","last_unstale":"2024-09-21T03:26:34.774803+0000","last_undegraded":"2024-09-21T03:26:34.774803+0000","last_fullsized":"2024-09-21T03:26:34.774803+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:45:39.339674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.958549+0000","last_change":"2024-09-21T03:26:33.773508+0000","last_active":"2024-09-21T03:26:34.958549+0000","last_peered":"2024-09-21T03:26:34.958549+0000","last_clean":"2024-09-21T03:26:34.958549+0000","last_became_active":"2024-09-21T03:26:33.773223+0000","last_became_peered":"2024-09-21T03:26:33.773223+0000","last_unstale":"2024-09-21T03:26:34.958549+0000","last_undegraded":"2024-09-21T03:26:34.958549+0000","last_fullsized":"2024-09-21T03:26:34.958549+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:51.603139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.774796+0000","last_change":"2024-09-21T03:26:32.767045+0000","last_active":"2024-09-21T03:26:34.774796+0000","last_peered":"2024-09-21T03:26:34.774796+0000","last_clean":"2024-09-21T03:26:34.774796+0000","last_became_active":"2024-09-21T03:26:32.766543+0000","last_became_peered":"2024-09-21T03:26:32.766543+0000","last_unstale":"2024-09-21T03:26:34.774796+0000","last_undegraded":"2024-09-21T03:26:34.774796+0000","last_fullsized":"2024-09-21T03:26:34.774796+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:18:03.428105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.958608+0000","last_change":"2024-09-21T03:26:33.778377+0000","last_active":"2024-09-21T03:26:34.958608+0000","last_peered":"2024-09-21T03:26:34.958608+0000","last_clean":"2024-09-21T03:26:34.958608+0000","last_became_active":"2024-09-21T03:26:33.778077+0000","last_became_peered":"2024-09-21T03:26:33.778077+0000","last_unstale":"2024-09-21T03:26:34.958608+0000","last_undegraded":"2024-09-21T03:26:34.958608+0000","last_fullsized":"2024-09-21T03:26:34.958608+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:22.283748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.769201+0000","last_change":"2024-09-21T03:26:32.763204+0000","last_active":"2024-09-21T03:26:34.769201+0000","last_peered":"2024-09-21T03:26:34.769201+0000","last_clean":"2024-09-21T03:26:34.769201+0000","last_became_active":"2024-09-21T03:26:32.762314+0000","last_became_peered":"2024-09-21T03:26:32.762314+0000","last_unstale":"2024-09-21T03:26:34.769201+0000","last_undegraded":"2024-09-21T03:26:34.769201+0000","last_fullsized":"2024-09-21T03:26:34.769201+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:18:33.699801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.769367+0000","last_change":"2024-09-21T03:26:33.777683+0000","last_active":"2024-09-21T03:26:34.769367+0000","last_peered":"2024-09-21T03:26:34.769367+0000","last_clean":"2024-09-21T03:26:34.769367+0000","last_became_active":"2024-09-21T03:26:33.777368+0000","last_became_peered":"2024-09-21T03:26:33.777368+0000","last_unstale":"2024-09-21T03:26:34.769367+0000","last_undegraded":"2024-09-21T03:26:34.769367+0000","last_fullsized":"2024-09-21T03:26:34.769367+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:11.498248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"128'2","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.775539+0000","last_change":"2024-09-21T03:26:32.763095+0000","last_active":"2024-09-21T03:26:34.775539+0000","last_peered":"2024-09-21T03:26:34.775539+0000","last_clean":"2024-09-21T03:26:34.775539+0000","last_became_active":"2024-09-21T03:26:32.762758+0000","last_became_peered":"2024-09-21T03:26:32.762758+0000","last_unstale":"2024-09-21T03:26:34.775539+0000","last_undegraded":"2024-09-21T03:26:34.775539+0000","last_fullsized":"2024-09-21T03:26:34.775539+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:57.602436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.770538+0000","last_change":"2024-09-21T03:26:33.780924+0000","last_active":"2024-09-21T03:26:34.770538+0000","last_peered":"2024-09-21T03:26:34.770538+0000","last_clean":"2024-09-21T03:26:34.770538+0000","last_became_active":"2024-09-21T03:26:33.780582+0000","last_became_peered":"2024-09-21T03:26:33.780582+0000","last_unstale":"2024-09-21T03:26:34.770538+0000","last_undegraded":"2024-09-21T03:26:34.770538+0000","last_fullsized":"2024-09-21T03:26:34.770538+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:46:43.682715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"129'1","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.765627+0000","last_change":"2024-09-21T03:26:32.752528+0000","last_active":"2024-09-21T03:26:34.765627+0000","last_peered":"2024-09-21T03:26:34.765627+0000","last_clean":"2024-09-21T03:26:34.765627+0000","last_became_active":"2024-09-21T03:26:32.752205+0000","last_became_peered":"2024-09-21T03:26:32.752205+0000","last_unstale":"2024-09-21T03:26:34.765627+0000","last_undegraded":"2024-09-21T03:26:34.765627+0000","last_fullsized":"2024-09-21T03:26:34.765627+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:00:45.444078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.958718+0000","last_change":"2024-09-21T03:26:33.766979+0000","last_active":"2024-09-21T03:26:34.958718+0000","last_peered":"2024-09-21T03:26:34.958718+0000","last_clean":"2024-09-21T03:26:34.958718+0000","last_became_active":"2024-09-21T03:26:33.766651+0000","last_became_peered":"2024-09-21T03:26:33.766651+0000","last_unstale":"2024-09-21T03:26:34.958718+0000","last_undegraded":"2024-09-21T03:26:34.958718+0000","last_fullsized":"2024-09-21T03:26:34.958718+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:47.574803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.766152+0000","last_change":"2024-09-21T03:26:32.758409+0000","last_active":"2024-09-21T03:26:34.766152+0000","last_peered":"2024-09-21T03:26:34.766152+0000","last_clean":"2024-09-21T03:26:34.766152+0000","last_became_active":"2024-09-21T03:26:32.758112+0000","last_became_peered":"2024-09-21T03:26:32.758112+0000","last_unstale":"2024-09-21T03:26:34.766152+0000","last_undegraded":"2024-09-21T03:26:34.766152+0000","last_fullsized":"2024-09-21T03:26:34.766152+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:00:55.271621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.766054+0000","last_change":"2024-09-21T03:26:33.763613+0000","last_active":"2024-09-21T03:26:34.766054+0000","last_peered":"2024-09-21T03:26:34.766054+0000","last_clean":"2024-09-21T03:26:34.766054+0000","last_became_active":"2024-09-21T03:26:33.763289+0000","last_became_peered":"2024-09-21T03:26:33.763289+0000","last_unstale":"2024-09-21T03:26:34.766054+0000","last_undegraded":"2024-09-21T03:26:34.766054+0000","last_fullsized":"2024-09-21T03:26:34.766054+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:23.354533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.765607+0000","last_change":"2024-09-21T03:26:32.761270+0000","last_active":"2024-09-21T03:26:34.765607+0000","last_peered":"2024-09-21T03:26:34.765607+0000","last_clean":"2024-09-21T03:26:34.765607+0000","last_became_active":"2024-09-21T03:26:32.760986+0000","last_became_peered":"2024-09-21T03:26:32.760986+0000","last_unstale":"2024-09-21T03:26:34.765607+0000","last_undegraded":"2024-09-21T03:26:34.765607+0000","last_fullsized":"2024-09-21T03:26:34.765607+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:34.182235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959621+0000","last_change":"2024-09-21T03:26:33.777319+0000","last_active":"2024-09-21T03:26:34.959621+0000","last_peered":"2024-09-21T03:26:34.959621+0000","last_clean":"2024-09-21T03:26:34.959621+0000","last_became_active":"2024-09-21T03:26:33.777011+0000","last_became_peered":"2024-09-21T03:26:33.777011+0000","last_unstale":"2024-09-21T03:26:34.959621+0000","last_undegraded":"2024-09-21T03:26:34.959621+0000","last_fullsized":"2024-09-21T03:26:34.959621+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:56:06.787095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959509+0000","last_change":"2024-09-21T03:26:32.763753+0000","last_active":"2024-09-21T03:26:34.959509+0000","last_peered":"2024-09-21T03:26:34.959509+0000","last_clean":"2024-09-21T03:26:34.959509+0000","last_became_active":"2024-09-21T03:26:32.762836+0000","last_became_peered":"2024-09-21T03:26:32.762836+0000","last_unstale":"2024-09-21T03:26:34.959509+0000","last_undegraded":"2024-09-21T03:26:34.959509+0000","last_fullsized":"2024-09-21T03:26:34.959509+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:35:51.853935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.770309+0000","last_change":"2024-09-21T03:26:33.788053+0000","last_active":"2024-09-21T03:26:34.770309+0000","last_peered":"2024-09-21T03:26:34.770309+0000","last_clean":"2024-09-21T03:26:34.770309+0000","last_became_active":"2024-09-21T03:26:33.787676+0000","last_became_peered":"2024-09-21T03:26:33.787676+0000","last_unstale":"2024-09-21T03:26:34.770309+0000","last_undegraded":"2024-09-21T03:26:34.770309+0000","last_fullsized":"2024-09-21T03:26:34.770309+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:40.370065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.774942+0000","last_change":"2024-09-21T03:26:32.764798+0000","last_active":"2024-09-21T03:26:34.774942+0000","last_peered":"2024-09-21T03:26:34.774942+0000","last_clean":"2024-09-21T03:26:34.774942+0000","last_became_active":"2024-09-21T03:26:32.764469+0000","last_became_peered":"2024-09-21T03:26:32.764469+0000","last_unstale":"2024-09-21T03:26:34.774942+0000","last_undegraded":"2024-09-21T03:26:34.774942+0000","last_fullsized":"2024-09-21T03:26:34.774942+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:48.124371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.775330+0000","last_change":"2024-09-21T03:26:33.774945+0000","last_active":"2024-09-21T03:26:34.775330+0000","last_peered":"2024-09-21T03:26:34.775330+0000","last_clean":"2024-09-21T03:26:34.775330+0000","last_became_active":"2024-09-21T03:26:33.774613+0000","last_became_peered":"2024-09-21T03:26:33.774613+0000","last_unstale":"2024-09-21T03:26:34.775330+0000","last_undegraded":"2024-09-21T03:26:34.775330+0000","last_fullsized":"2024-09-21T03:26:34.775330+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:37.199093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.770346+0000","last_change":"2024-09-21T03:26:32.757614+0000","last_active":"2024-09-21T03:26:34.770346+0000","last_peered":"2024-09-21T03:26:34.770346+0000","last_clean":"2024-09-21T03:26:34.770346+0000","last_became_active":"2024-09-21T03:26:32.757332+0000","last_became_peered":"2024-09-21T03:26:32.757332+0000","last_unstale":"2024-09-21T03:26:34.770346+0000","last_undegraded":"2024-09-21T03:26:34.770346+0000","last_fullsized":"2024-09-21T03:26:34.770346+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:34.777799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.769213+0000","last_change":"2024-09-21T03:26:33.777011+0000","last_active":"2024-09-21T03:26:34.769213+0000","last_peered":"2024-09-21T03:26:34.769213+0000","last_clean":"2024-09-21T03:26:34.769213+0000","last_became_active":"2024-09-21T03:26:33.776647+0000","last_became_peered":"2024-09-21T03:26:33.776647+0000","last_unstale":"2024-09-21T03:26:34.769213+0000","last_undegraded":"2024-09-21T03:26:34.769213+0000","last_fullsized":"2024-09-21T03:26:34.769213+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:43:53.426061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.958493+0000","last_change":"2024-09-21T03:26:32.762505+0000","last_active":"2024-09-21T03:26:34.958493+0000","last_peered":"2024-09-21T03:26:34.958493+0000","last_clean":"2024-09-21T03:26:34.958493+0000","last_became_active":"2024-09-21T03:26:32.762188+0000","last_became_peered":"2024-09-21T03:26:32.762188+0000","last_unstale":"2024-09-21T03:26:34.958493+0000","last_undegraded":"2024-09-21T03:26:34.958493+0000","last_fullsized":"2024-09-21T03:26:34.958493+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:19:34.668326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.959254+0000","last_change":"2024-09-21T03:26:33.778553+0000","last_active":"2024-09-21T03:26:34.959254+0000","last_peered":"2024-09-21T03:26:34.959254+0000","last_clean":"2024-09-21T03:26:34.959254+0000","last_became_active":"2024-09-21T03:26:33.777840+0000","last_became_peered":"2024-09-21T03:26:33.777840+0000","last_unstale":"2024-09-21T03:26:34.959254+0000","last_undegraded":"2024-09-21T03:26:34.959254+0000","last_fullsized":"2024-09-21T03:26:34.959254+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:32.739794+0000","last_clean_scrub_stamp":"2024-09-21T03:26:32.739794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:05:54.479070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"128'3","reported_seq":18,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.770535+0000","last_change":"2024-09-21T03:26:32.767343+0000","last_active":"2024-09-21T03:26:34.770535+0000","last_peered":"2024-09-21T03:26:34.770535+0000","last_clean":"2024-09-21T03:26:34.770535+0000","last_became_active":"2024-09-21T03:26:32.767009+0000","last_became_peered":"2024-09-21T03:26:32.767009+0000","last_unstale":"2024-09-21T03:26:34.770535+0000","last_undegraded":"2024-09-21T03:26:34.770535+0000","last_fullsized":"2024-09-21T03:26:34.770535+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:26:31.734231+0000","last_clean_scrub_stamp":"2024-09-21T03:26:31.734231+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:07:48.083452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":313,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-21T03:26:34.775115+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:26:34.775115+0000","last_peered":"2024-09-21T03:26:34.775115+0000","last_clean":"2024-09-21T03:26:34.775115+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:26:34.775115+0000","last_undegraded":"2024-09-21T03:26:34.775115+0000","last_fullsized":"2024-09-21T03:26:34.775115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509545,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33352,"kb_used_data":2160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338488,"statfs":{"total":96636764160,"available":96602611712,"internally_reserved":0,"allocated":2211840,"data_stored":1281276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509544,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32780,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339060,"statfs":{"total":96636764160,"available":96603197440,"internally_reserved":0,"allocated":1622016,"data_stored":690402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509543,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32768,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339072,"statfs":{"total":96636764160,"available":96603209728,"internally_reserved":0,"allocated":1613824,"data_stored":690278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509543,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32768,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339072,"statfs":{"total":96636764160,"available":96603209728,"internally_reserved":0,"allocated":1609728,"data_stored":690256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509544,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32764,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339076,"statfs":{"total":96636764160,"available":96603213824,"internally_reserved":0,"allocated":1613824,"data_stored":690346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509544,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36936,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334904,"statfs":{"total":96636764160,"available":96598941696,"internally_reserved":0,"allocated":1626112,"data_stored":691938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509544,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36924,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334916,"statfs":{"total":96636764160,"available":96598953984,"internally_reserved":0,"allocated":1613824,"data_stored":690838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574951,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33360,"kb_used_data":2168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338480,"statfs":{"total":96636764160,"available":96602603520,"internally_reserved":0,"allocated":2220032,"data_stored":1282270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:26:42.578 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T03:26:42.578 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T03:26:42.733 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.731+0000 7ff0a9bad640 1 -- 172.21.15.105:0/2241920317 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0a40cad30 msgr2=0x7ff0a40735b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:42.733 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.731+0000 7ff0a9bad640 1 --2- 172.21.15.105:0/2241920317 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0a40cad30 0x7ff0a40735b0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7ff0a409e2e0 tx=0x7ff09c02a5f0 comp rx=0 tx=0).stop 2024-09-21T03:26:42.734 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.731+0000 7ff0a9bad640 1 -- 172.21.15.105:0/2241920317 shutdown_connections 2024-09-21T03:26:42.734 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.731+0000 7ff0a9bad640 1 --2- 172.21.15.105:0/2241920317 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0a40cad30 0x7ff0a40735b0 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:42.734 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.731+0000 7ff0a9bad640 1 --2- 172.21.15.105:0/2241920317 >> v2:172.21.15.162:3300/0 conn(0x7ff0a40706b0 0x7ff0a40cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:42.734 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.731+0000 7ff0a9bad640 1 -- 172.21.15.105:0/2241920317 >> 172.21.15.105:0/2241920317 conn(0x7ff0a40b1cb0 msgr2=0x7ff0a40b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:42.734 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.732+0000 7ff0a9bad640 1 -- 172.21.15.105:0/2241920317 shutdown_connections 2024-09-21T03:26:42.734 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.732+0000 7ff0a9bad640 1 -- 172.21.15.105:0/2241920317 wait complete. 2024-09-21T03:26:42.735 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.733+0000 7ff0a9bad640 1 Processor -- start 2024-09-21T03:26:42.735 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.733+0000 7ff0a9bad640 1 -- start start 2024-09-21T03:26:42.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.735+0000 7ff0a9bad640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0a40ca800 0x7ff0a415a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:42.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.735+0000 7ff0a9bad640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0a40cad30 0x7ff0a40c64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:42.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.735+0000 7ff0a9bad640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0a40c3c30 0x7ff0a415e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:42.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.735+0000 7ff0a9bad640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a4073ec0 con 0x7ff0a40cad30 2024-09-21T03:26:42.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.735+0000 7ff0a9bad640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a4073d40 con 0x7ff0a40ca800 2024-09-21T03:26:42.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.735+0000 7ff0a9bad640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff0a4074040 con 0x7ff0a40c3c30 2024-09-21T03:26:42.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.735+0000 7ff0a2ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0a40cad30 0x7ff0a40c64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:42.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.735+0000 7ff0a2ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0a40cad30 0x7ff0a40c64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:46282/0 (socket says 172.21.15.105:46282) 2024-09-21T03:26:42.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.735+0000 7ff0a2ffd640 1 -- 172.21.15.105:0/703436953 learned_addr learned my addr 172.21.15.105:0/703436953 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:42.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.735+0000 7ff0a37fe640 1 --2- 172.21.15.105:0/703436953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0a40ca800 0x7ff0a415a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:42.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.735+0000 7ff0a3fff640 1 --2- 172.21.15.105:0/703436953 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0a40c3c30 0x7ff0a415e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:42.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.735+0000 7ff0a2ffd640 1 -- 172.21.15.105:0/703436953 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0a40c3c30 msgr2=0x7ff0a415e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:42.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.735+0000 7ff0a2ffd640 1 --2- 172.21.15.105:0/703436953 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0a40c3c30 0x7ff0a415e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:42.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.735+0000 7ff0a2ffd640 1 -- 172.21.15.105:0/703436953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0a40ca800 msgr2=0x7ff0a415a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:42.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.735+0000 7ff0a2ffd640 1 --2- 172.21.15.105:0/703436953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0a40ca800 0x7ff0a415a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:42.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.735+0000 7ff0a2ffd640 1 -- 172.21.15.105:0/703436953 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a40c4f00 con 0x7ff0a40cad30 2024-09-21T03:26:42.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.735+0000 7ff0a2ffd640 1 --2- 172.21.15.105:0/703436953 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0a40cad30 0x7ff0a40c64c0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7ff09800d700 tx=0x7ff09800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:42.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.735+0000 7ff08bfff640 1 -- 172.21.15.105:0/703436953 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff098017070 con 0x7ff0a40cad30 2024-09-21T03:26:42.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.735+0000 7ff08bfff640 1 -- 172.21.15.105:0/703436953 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff098005310 con 0x7ff0a40cad30 2024-09-21T03:26:42.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.735+0000 7ff08bfff640 1 -- 172.21.15.105:0/703436953 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff098009820 con 0x7ff0a40cad30 2024-09-21T03:26:42.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.735+0000 7ff0a9bad640 1 -- 172.21.15.105:0/703436953 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0a40c4380 con 0x7ff0a40cad30 2024-09-21T03:26:42.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.736+0000 7ff0a9bad640 1 -- 172.21.15.105:0/703436953 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0a40c4940 con 0x7ff0a40cad30 2024-09-21T03:26:42.740 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.736+0000 7ff0a9bad640 1 -- 172.21.15.105:0/703436953 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0a40745d0 con 0x7ff0a40cad30 2024-09-21T03:26:42.740 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.737+0000 7ff08bfff640 1 -- 172.21.15.105:0/703436953 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff0980099c0 con 0x7ff0a40cad30 2024-09-21T03:26:42.740 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.738+0000 7ff08bfff640 1 --2- 172.21.15.105:0/703436953 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff090078b90 0x7ff09007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:42.740 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.738+0000 7ff08bfff640 1 -- 172.21.15.105:0/703436953 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7ff09809ada0 con 0x7ff0a40cad30 2024-09-21T03:26:42.740 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.738+0000 7ff0a37fe640 1 --2- 172.21.15.105:0/703436953 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff090078b90 0x7ff09007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:42.740 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.738+0000 7ff0a37fe640 1 --2- 172.21.15.105:0/703436953 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff090078b90 0x7ff09007b0a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ff0a40cb250 tx=0x7ff094009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:42.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.742+0000 7ff08bfff640 1 -- 172.21.15.105:0/703436953 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff098062b90 con 0x7ff0a40cad30 2024-09-21T03:26:42.989 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.988+0000 7ff0a9bad640 1 -- 172.21.15.105:0/703436953 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7ff0a406ddf0 con 0x7ff0a40cad30 2024-09-21T03:26:42.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.990+0000 7ff08bfff640 1 -- 172.21.15.105:0/703436953 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) ==== 190+0+147 (secure 0 0 0) 0x7ff0980675c0 con 0x7ff0a40cad30 2024-09-21T03:26:42.992 INFO:teuthology.orchestra.run.smithi105.stdout:[client.0] 2024-09-21T03:26:42.992 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQDIOu5mughoJxAAhY0bzJmq+oNyzCdtafkC9w== 2024-09-21T03:26:42.992 INFO:teuthology.orchestra.run.smithi105.stdout: caps mds = "allow" 2024-09-21T03:26:42.993 INFO:teuthology.orchestra.run.smithi105.stdout: caps mon = "allow r" 2024-09-21T03:26:42.993 INFO:teuthology.orchestra.run.smithi105.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T03:26:42.993 INFO:teuthology.orchestra.run.smithi105.stderr:updated caps for client.0 2024-09-21T03:26:42.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.993+0000 7ff0a9bad640 1 -- 172.21.15.105:0/703436953 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff090078b90 msgr2=0x7ff09007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:42.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.993+0000 7ff0a9bad640 1 --2- 172.21.15.105:0/703436953 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff090078b90 0x7ff09007b0a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ff0a40cb250 tx=0x7ff094009040 comp rx=0 tx=0).stop 2024-09-21T03:26:42.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.993+0000 7ff0a9bad640 1 -- 172.21.15.105:0/703436953 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0a40cad30 msgr2=0x7ff0a40c64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:42.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.993+0000 7ff0a9bad640 1 --2- 172.21.15.105:0/703436953 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0a40cad30 0x7ff0a40c64c0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7ff09800d700 tx=0x7ff09800dbc0 comp rx=0 tx=0).stop 2024-09-21T03:26:42.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.993+0000 7ff0a9bad640 1 -- 172.21.15.105:0/703436953 shutdown_connections 2024-09-21T03:26:42.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.993+0000 7ff0a9bad640 1 --2- 172.21.15.105:0/703436953 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff090078b90 0x7ff09007b0a0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:42.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.993+0000 7ff0a9bad640 1 --2- 172.21.15.105:0/703436953 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0a40c3c30 0x7ff0a415e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:42.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.993+0000 7ff0a9bad640 1 --2- 172.21.15.105:0/703436953 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0a40cad30 0x7ff0a40c64c0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:42.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.993+0000 7ff0a9bad640 1 --2- 172.21.15.105:0/703436953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0a40ca800 0x7ff0a415a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:42.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.993+0000 7ff0a9bad640 1 -- 172.21.15.105:0/703436953 >> 172.21.15.105:0/703436953 conn(0x7ff0a40b1cb0 msgr2=0x7ff0a40af210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:42.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.993+0000 7ff0a9bad640 1 -- 172.21.15.105:0/703436953 shutdown_connections 2024-09-21T03:26:42.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:42.993+0000 7ff0a9bad640 1 -- 172.21.15.105:0/703436953 wait complete. 2024-09-21T03:26:43.006 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:26:43.118 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.116+0000 7f78f4c84640 1 -- 172.21.15.105:0/1649792704 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78f006e170 msgr2=0x7f78f00b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:43.118 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.116+0000 7f78f4c84640 1 --2- 172.21.15.105:0/1649792704 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78f006e170 0x7f78f00b3540 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f78f008d9b0 tx=0x7f78e002a4f0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.118 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.116+0000 7f78f4c84640 1 -- 172.21.15.105:0/1649792704 shutdown_connections 2024-09-21T03:26:43.118 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.116+0000 7f78f4c84640 1 --2- 172.21.15.105:0/1649792704 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f78f00d3870 0x7f78f00ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.118 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.116+0000 7f78f4c84640 1 --2- 172.21.15.105:0/1649792704 >> v2:172.21.15.162:3300/0 conn(0x7f78f006f4b0 0x7f78f00d3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.116+0000 7f78f4c84640 1 --2- 172.21.15.105:0/1649792704 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78f006e170 0x7f78f00b3540 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.116+0000 7f78f4c84640 1 -- 172.21.15.105:0/1649792704 >> 172.21.15.105:0/1649792704 conn(0x7f78f008bfc0 msgr2=0x7f78f009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:43.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.116+0000 7f78f4c84640 1 -- 172.21.15.105:0/1649792704 shutdown_connections 2024-09-21T03:26:43.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.116+0000 7f78f4c84640 1 -- 172.21.15.105:0/1649792704 wait complete. 2024-09-21T03:26:43.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.118+0000 7f78f4c84640 1 Processor -- start 2024-09-21T03:26:43.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.118+0000 7f78f4c84640 1 -- start start 2024-09-21T03:26:43.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.119+0000 7f78f4c84640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78f006f4b0 0x7f78f015ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:43.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.119+0000 7f78f4c84640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f78f00d3870 0x7f78f00ce210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:43.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.119+0000 7f78f4c84640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78f01f6130 0x7f78f01ea2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:43.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.119+0000 7f78f4c84640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f78f00cf490 con 0x7f78f006f4b0 2024-09-21T03:26:43.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.119+0000 7f78f4c84640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f78f00cf310 con 0x7f78f01f6130 2024-09-21T03:26:43.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.119+0000 7f78f4c84640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f78f00d0ce0 con 0x7f78f00d3870 2024-09-21T03:26:43.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.120+0000 7f78ee59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78f006f4b0 0x7f78f015ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:43.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.120+0000 7f78ee59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78f006f4b0 0x7f78f015ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:46300/0 (socket says 172.21.15.105:46300) 2024-09-21T03:26:43.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.120+0000 7f78ee59c640 1 -- 172.21.15.105:0/177082745 learned_addr learned my addr 172.21.15.105:0/177082745 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:43.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.120+0000 7f78eed9d640 1 --2- 172.21.15.105:0/177082745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78f01f6130 0x7f78f01ea2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:43.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.120+0000 7f78edd9b640 1 --2- 172.21.15.105:0/177082745 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f78f00d3870 0x7f78f00ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:43.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.120+0000 7f78ee59c640 1 -- 172.21.15.105:0/177082745 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f78f00d3870 msgr2=0x7f78f00ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:43.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.120+0000 7f78ee59c640 1 --2- 172.21.15.105:0/177082745 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f78f00d3870 0x7f78f00ce210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.120+0000 7f78ee59c640 1 -- 172.21.15.105:0/177082745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78f01f6130 msgr2=0x7f78f01ea2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:43.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.120+0000 7f78ee59c640 1 --2- 172.21.15.105:0/177082745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78f01f6130 0x7f78f01ea2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.120+0000 7f78ee59c640 1 -- 172.21.15.105:0/177082745 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78f01e8ae0 con 0x7f78f006f4b0 2024-09-21T03:26:43.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.120+0000 7f78ee59c640 1 --2- 172.21.15.105:0/177082745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78f006f4b0 0x7f78f015ec50 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f78e0034040 tx=0x7f78e00038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:43.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.120+0000 7f78deffd640 1 -- 172.21.15.105:0/177082745 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e003e030 con 0x7f78f006f4b0 2024-09-21T03:26:43.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.120+0000 7f78deffd640 1 -- 172.21.15.105:0/177082745 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f78e0003d90 con 0x7f78f006f4b0 2024-09-21T03:26:43.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.120+0000 7f78f4c84640 1 -- 172.21.15.105:0/177082745 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78f01f5650 con 0x7f78f006f4b0 2024-09-21T03:26:43.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.120+0000 7f78deffd640 1 -- 172.21.15.105:0/177082745 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e0035040 con 0x7f78f006f4b0 2024-09-21T03:26:43.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.120+0000 7f78f4c84640 1 -- 172.21.15.105:0/177082745 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78f01e7e00 con 0x7f78f006f4b0 2024-09-21T03:26:43.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.121+0000 7f78f4c84640 1 -- 172.21.15.105:0/177082745 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78f006e170 con 0x7f78f006f4b0 2024-09-21T03:26:43.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.122+0000 7f78deffd640 1 -- 172.21.15.105:0/177082745 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f78e0041030 con 0x7f78f006f4b0 2024-09-21T03:26:43.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.122+0000 7f78deffd640 1 --2- 172.21.15.105:0/177082745 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f78d0078b90 0x7f78d007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:43.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.122+0000 7f78deffd640 1 -- 172.21.15.105:0/177082745 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7f78e00bb3d0 con 0x7f78f006f4b0 2024-09-21T03:26:43.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.123+0000 7f78edd9b640 1 --2- 172.21.15.105:0/177082745 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f78d0078b90 0x7f78d007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:43.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.123+0000 7f78edd9b640 1 --2- 172.21.15.105:0/177082745 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f78d0078b90 0x7f78d007b0a0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f78f01e85b0 tx=0x7f78e400b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:43.128 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.127+0000 7f78deffd640 1 -- 172.21.15.105:0/177082745 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f78e0083250 con 0x7f78f006f4b0 2024-09-21T03:26:43.341 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.339+0000 7f78f4c84640 1 -- 172.21.15.105:0/177082745 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78f00c7da0 con 0x7f78f006f4b0 2024-09-21T03:26:43.341 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.340+0000 7f78deffd640 1 -- 172.21.15.105:0/177082745 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) ==== 94+0+5233 (secure 0 0 0) 0x7f78e0087c80 con 0x7f78f006f4b0 2024-09-21T03:26:43.342 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:26:43.342 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":84,"btime":"2024-09-21T03:26:36:777245+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6494,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2298697835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2298697835},{"type":"v1","addr":"172.21.15.162:6836","nonce":2298697835}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":6500,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/680091076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":680091076},{"type":"v1","addr":"172.21.15.105:6835","nonce":680091076}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8013,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/4094879618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":4094879618},{"type":"v1","addr":"172.21.15.105:6833","nonce":4094879618}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:26:33.112228+0000","modified":"2024-09-21T03:26:36.139331+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8022},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8022":{"gid":8022,"name":"b","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6837/712373587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":712373587},{"type":"v1","addr":"172.21.15.162:6837","nonce":712373587}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8022,"qdb_cluster":[8022]},"id":10}]} 2024-09-21T03:26:43.342 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 84 2024-09-21T03:26:43.344 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.342+0000 7f78f4c84640 1 -- 172.21.15.105:0/177082745 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f78d0078b90 msgr2=0x7f78d007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:43.344 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.342+0000 7f78f4c84640 1 --2- 172.21.15.105:0/177082745 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f78d0078b90 0x7f78d007b0a0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f78f01e85b0 tx=0x7f78e400b2e0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.344 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.342+0000 7f78f4c84640 1 -- 172.21.15.105:0/177082745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78f006f4b0 msgr2=0x7f78f015ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:43.344 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.342+0000 7f78f4c84640 1 --2- 172.21.15.105:0/177082745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78f006f4b0 0x7f78f015ec50 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f78e0034040 tx=0x7f78e00038a0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.344 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.342+0000 7f78f4c84640 1 -- 172.21.15.105:0/177082745 shutdown_connections 2024-09-21T03:26:43.344 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.342+0000 7f78f4c84640 1 --2- 172.21.15.105:0/177082745 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f78d0078b90 0x7f78d007b0a0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.344 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.342+0000 7f78f4c84640 1 --2- 172.21.15.105:0/177082745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78f01f6130 0x7f78f01ea2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.345 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.342+0000 7f78f4c84640 1 --2- 172.21.15.105:0/177082745 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f78f00d3870 0x7f78f00ce210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.345 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.342+0000 7f78f4c84640 1 --2- 172.21.15.105:0/177082745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78f006f4b0 0x7f78f015ec50 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.345 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.342+0000 7f78f4c84640 1 -- 172.21.15.105:0/177082745 >> 172.21.15.105:0/177082745 conn(0x7f78f008bfc0 msgr2=0x7f78f00d3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:43.345 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.342+0000 7f78f4c84640 1 -- 172.21.15.105:0/177082745 shutdown_connections 2024-09-21T03:26:43.345 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.342+0000 7f78f4c84640 1 -- 172.21.15.105:0/177082745 wait complete. 2024-09-21T03:26:43.757 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 84, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T03:26:33.112228+0000', 'modified': '2024-09-21T03:26:36.139331+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8022}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8022': {'gid': 8022, 'name': 'b', 'rank': 0, 'incarnation': 81, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.162:6837/712373587', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6834', 'nonce': 712373587}, {'type': 'v1', 'addr': '172.21.15.162:6837', 'nonce': 712373587}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8022, 'qdb_cluster': [8022]} 2024-09-21T03:26:43.758 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T03:26:43.758 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-21T03:26:43.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.872+0000 7f43de0cc640 1 -- 172.21.15.105:0/510060828 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43c4004d90 msgr2=0x7f43c4005240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:43.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.872+0000 7f43de0cc640 1 --2- 172.21.15.105:0/510060828 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43c4004d90 0x7f43c4005240 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f43d80b3c10 tx=0x7f43c4005830 comp rx=0 tx=0).stop 2024-09-21T03:26:43.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.872+0000 7f43d7fff640 1 -- 172.21.15.105:0/510060828 reap_dead start 2024-09-21T03:26:43.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.872+0000 7f43de0cc640 1 -- 172.21.15.105:0/510060828 shutdown_connections 2024-09-21T03:26:43.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.872+0000 7f43de0cc640 1 -- 172.21.15.105:0/510060828 >> 172.21.15.105:0/510060828 conn(0x7f43d808bfc0 msgr2=0x7f43d809d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:43.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.872+0000 7f43de0cc640 1 -- 172.21.15.105:0/510060828 shutdown_connections 2024-09-21T03:26:43.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.872+0000 7f43de0cc640 1 -- 172.21.15.105:0/510060828 wait complete. 2024-09-21T03:26:43.875 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.874+0000 7f43de0cc640 1 Processor -- start 2024-09-21T03:26:43.875 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.874+0000 7f43de0cc640 1 -- start start 2024-09-21T03:26:43.878 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.875+0000 7f43de0cc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43c4004d90 0x7f43d80c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:43.878 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.875+0000 7f43de0cc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43d81f9150 0x7f43d81f9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:43.878 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.875+0000 7f43de0cc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f43d8150890 0x7f43d8150ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:43.878 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.875+0000 7f43de0cc640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f43d80cfd70 con 0x7f43c4004d90 2024-09-21T03:26:43.878 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.875+0000 7f43de0cc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f43d80cfbf0 con 0x7f43d81f9150 2024-09-21T03:26:43.878 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.875+0000 7f43de0cc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f43d8160690 con 0x7f43d8150890 2024-09-21T03:26:43.878 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.875+0000 7f43d77fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43c4004d90 0x7f43d80c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:43.878 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.875+0000 7f43d77fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43c4004d90 0x7f43d80c8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:46328/0 (socket says 172.21.15.105:46328) 2024-09-21T03:26:43.878 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.875+0000 7f43d77fe640 1 -- 172.21.15.105:0/1650974234 learned_addr learned my addr 172.21.15.105:0/1650974234 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:43.878 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.875+0000 7f43d7fff640 1 --2- 172.21.15.105:0/1650974234 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f43d8150890 0x7f43d8150ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:43.878 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.875+0000 7f43d6ffd640 1 --2- 172.21.15.105:0/1650974234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43d81f9150 0x7f43d81f9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:43.879 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.876+0000 7f43d77fe640 1 -- 172.21.15.105:0/1650974234 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f43d8150890 msgr2=0x7f43d8150ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:43.879 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.876+0000 7f43d77fe640 1 --2- 172.21.15.105:0/1650974234 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f43d8150890 0x7f43d8150ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.879 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.876+0000 7f43d77fe640 1 -- 172.21.15.105:0/1650974234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43d81f9150 msgr2=0x7f43d81f9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:43.879 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.876+0000 7f43d77fe640 1 --2- 172.21.15.105:0/1650974234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43d81f9150 0x7f43d81f9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.879 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.876+0000 7f43d77fe640 1 -- 172.21.15.105:0/1650974234 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43d815e890 con 0x7f43c4004d90 2024-09-21T03:26:43.879 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.876+0000 7f43d77fe640 1 --2- 172.21.15.105:0/1650974234 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43c4004d90 0x7f43d80c8b00 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f43c8006340 tx=0x7f43c8006740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:43.879 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.876+0000 7f43cffff640 1 -- 172.21.15.105:0/1650974234 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c8015070 con 0x7f43c4004d90 2024-09-21T03:26:43.879 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.876+0000 7f43cffff640 1 -- 172.21.15.105:0/1650974234 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f43c800fce0 con 0x7f43c4004d90 2024-09-21T03:26:43.879 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.876+0000 7f43de0cc640 1 -- 172.21.15.105:0/1650974234 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43d80c95c0 con 0x7f43c4004d90 2024-09-21T03:26:43.879 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.876+0000 7f43cffff640 1 -- 172.21.15.105:0/1650974234 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c8011690 con 0x7f43c4004d90 2024-09-21T03:26:43.879 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.876+0000 7f43de0cc640 1 -- 172.21.15.105:0/1650974234 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43d815eb50 con 0x7f43c4004d90 2024-09-21T03:26:43.880 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.878+0000 7f43cffff640 1 -- 172.21.15.105:0/1650974234 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f43c8011830 con 0x7f43c4004d90 2024-09-21T03:26:43.880 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.878+0000 7f43cffff640 1 --2- 172.21.15.105:0/1650974234 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f43b8078b90 0x7f43b807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:43.880 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.878+0000 7f43cffff640 1 -- 172.21.15.105:0/1650974234 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7f43c809bbe0 con 0x7f43c4004d90 2024-09-21T03:26:43.880 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.878+0000 7f43d6ffd640 1 --2- 172.21.15.105:0/1650974234 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f43b8078b90 0x7f43b807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:43.881 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.879+0000 7f43d6ffd640 1 --2- 172.21.15.105:0/1650974234 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f43b8078b90 0x7f43b807b0a0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f43d815d830 tx=0x7f43c0005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:43.881 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.879+0000 7f43e503b740 1 Processor -- start 2024-09-21T03:26:43.881 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.879+0000 7f43e503b740 1 -- start start 2024-09-21T03:26:43.884 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.881+0000 7f43e503b740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55821a4f8270 0x55821a8c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:43.884 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.881+0000 7f43e503b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55821a4cf3b0 0x55821a8ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:43.884 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.881+0000 7f43e503b740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55821a4d7590 0x55821a8e73e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:43.884 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.881+0000 7f43e503b740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55821a812820 con 0x55821a4d7590 2024-09-21T03:26:43.884 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.881+0000 7f43e503b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55821a801c50 con 0x55821a4cf3b0 2024-09-21T03:26:43.884 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.881+0000 7f43e503b740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55821a805a60 con 0x55821a4f8270 2024-09-21T03:26:43.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.881+0000 7f43d7fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55821a4d7590 0x55821a8e73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:43.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.881+0000 7f43d7fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55821a4d7590 0x55821a8e73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:46340/0 (socket says 172.21.15.105:46340) 2024-09-21T03:26:43.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.881+0000 7f43d7fff640 1 -- 172.21.15.105:0/1625981948 learned_addr learned my addr 172.21.15.105:0/1625981948 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:43.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.881+0000 7f43d6ffd640 1 --2- 172.21.15.105:0/1625981948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55821a4cf3b0 0x55821a8ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:43.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.881+0000 7f43d77fe640 1 --2- 172.21.15.105:0/1625981948 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55821a4f8270 0x55821a8c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:43.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.881+0000 7f43d7fff640 1 -- 172.21.15.105:0/1625981948 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55821a4f8270 msgr2=0x55821a8c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:26:43.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.881+0000 7f43d7fff640 1 --2- 172.21.15.105:0/1625981948 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55821a4f8270 0x55821a8c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.881+0000 7f43d7fff640 1 -- 172.21.15.105:0/1625981948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55821a4cf3b0 msgr2=0x55821a8ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:26:43.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.881+0000 7f43d7fff640 1 --2- 172.21.15.105:0/1625981948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55821a4cf3b0 0x55821a8ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.881+0000 7f43d7fff640 1 -- 172.21.15.105:0/1625981948 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55821a563850 con 0x55821a4d7590 2024-09-21T03:26:43.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.881+0000 7f43d7fff640 1 --2- 172.21.15.105:0/1625981948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55821a4d7590 0x55821a8e73e0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f43d002b070 tx=0x7f43d00019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d69889a017d2e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:43.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.882+0000 7f43cd7fa640 1 -- 172.21.15.105:0/1625981948 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d0032040 con 0x55821a4d7590 2024-09-21T03:26:43.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.882+0000 7f43cd7fa640 1 -- 172.21.15.105:0/1625981948 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f43d00014f0 con 0x55821a4d7590 2024-09-21T03:26:43.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.882+0000 7f43cd7fa640 1 -- 172.21.15.105:0/1625981948 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d0006140 con 0x55821a4d7590 2024-09-21T03:26:43.886 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.882+0000 7f43e503b740 1 -- 172.21.15.105:0/1625981948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55821a4d7590 msgr2=0x55821a8e73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:43.886 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.882+0000 7f43e503b740 1 --2- 172.21.15.105:0/1625981948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55821a4d7590 0x55821a8e73e0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f43d002b070 tx=0x7f43d00019b0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.886 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.882+0000 7f43e503b740 1 -- 172.21.15.105:0/1625981948 shutdown_connections 2024-09-21T03:26:43.886 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.882+0000 7f43e503b740 1 --2- 172.21.15.105:0/1625981948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55821a4d7590 0x55821a8e73e0 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.886 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.882+0000 7f43e503b740 1 --2- 172.21.15.105:0/1625981948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55821a4cf3b0 0x55821a8ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.886 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.882+0000 7f43e503b740 1 --2- 172.21.15.105:0/1625981948 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55821a4f8270 0x55821a8c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.886 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.882+0000 7f43e503b740 1 -- 172.21.15.105:0/1625981948 >> 172.21.15.105:0/1625981948 conn(0x55821a4ec3c0 msgr2=0x55821a8a0260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:43.886 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.883+0000 7f43e503b740 1 -- 172.21.15.105:0/1625981948 shutdown_connections 2024-09-21T03:26:43.886 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.883+0000 7f43e503b740 1 -- 172.21.15.105:0/1625981948 wait complete. 2024-09-21T03:26:43.890 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.883+0000 7f43e503b740 1 -- start start 2024-09-21T03:26:43.890 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.884+0000 7f43e503b740 1 Processor -- start 2024-09-21T03:26:43.890 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.885+0000 7f43e503b740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55821a4cf3b0 0x55821a8e57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:43.890 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.885+0000 7f43e503b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55821a4d7590 0x55821a8b8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:43.890 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.885+0000 7f43e503b740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55821a4f8270 0x55821a8de3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:43.890 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.885+0000 7f43e503b740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55821a572620 con 0x55821a4f8270 2024-09-21T03:26:43.890 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.885+0000 7f43e503b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55821a7a75f0 con 0x55821a4d7590 2024-09-21T03:26:43.890 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.885+0000 7f43e503b740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55821a8dbee0 con 0x55821a4cf3b0 2024-09-21T03:26:43.891 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.885+0000 7f43e503b740 10 client.0 _ll_register_callbacks cb 0x55821a7ab0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:26:43.891 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.885+0000 7f43d7fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55821a4f8270 0x55821a8de3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:43.891 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.885+0000 7f43d7fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55821a4f8270 0x55821a8de3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:46350/0 (socket says 172.21.15.105:46350) 2024-09-21T03:26:43.891 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.885+0000 7f43d7fff640 1 -- 172.21.15.105:0/2556873755 learned_addr learned my addr 172.21.15.105:0/2556873755 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:43.891 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.885+0000 7f43d77fe640 1 --2- 172.21.15.105:0/2556873755 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55821a4cf3b0 0x55821a8e57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:43.891 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.885+0000 7f43d6ffd640 1 --2- 172.21.15.105:0/2556873755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55821a4d7590 0x55821a8b8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:43.891 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.885+0000 7f43d7fff640 1 -- 172.21.15.105:0/2556873755 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55821a4cf3b0 msgr2=0x55821a8e57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:26:43.891 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.885+0000 7f43d7fff640 1 --2- 172.21.15.105:0/2556873755 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55821a4cf3b0 0x55821a8e57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.891 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.885+0000 7f43d7fff640 1 -- 172.21.15.105:0/2556873755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55821a4d7590 msgr2=0x55821a8b8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:26:43.891 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.885+0000 7f43d7fff640 1 --2- 172.21.15.105:0/2556873755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55821a4d7590 0x55821a8b8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.891 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.885+0000 7f43d7fff640 1 -- 172.21.15.105:0/2556873755 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55821a5da6b0 con 0x55821a4f8270 2024-09-21T03:26:43.891 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.885+0000 7f43d7fff640 1 --2- 172.21.15.105:0/2556873755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55821a4f8270 0x55821a8de3d0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f43d003e040 tx=0x7f43d0006520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e078f9cecad2a6d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:43.891 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.885+0000 7f43b67fc640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-21T03:26:43.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.886+0000 7f43b67fc640 1 -- 172.21.15.105:0/2556873755 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d0032050 con 0x55821a4f8270 2024-09-21T03:26:43.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.886+0000 7f43b67fc640 1 -- 172.21.15.105:0/2556873755 <== mon.0 v2:172.21.15.105:3300/0 2 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7f43d00037f0 con 0x55821a4f8270 2024-09-21T03:26:43.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.886+0000 7f43e503b740 1 -- 172.21.15.105:0/2556873755 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43d00014f0 con 0x55821a4f8270 2024-09-21T03:26:43.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.886+0000 7f43b67fc640 1 -- 172.21.15.105:0/2556873755 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f43d0050050 con 0x55821a4f8270 2024-09-21T03:26:43.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.886+0000 7f43e503b740 10 client.8154 fetch_fsmap learned FSMap version 84 2024-09-21T03:26:43.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.886+0000 7f43e503b740 1 -- 172.21.15.105:0/2556873755 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) -- 0x55821a8dbc20 con 0x55821a4f8270 2024-09-21T03:26:43.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.886+0000 7f43b67fc640 1 -- 172.21.15.105:0/2556873755 <== mon.0 v2:172.21.15.105:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f43d00014f0 con 0x55821a4f8270 2024-09-21T03:26:43.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.886+0000 7f43b67fc640 1 -- 172.21.15.105:0/2556873755 <== mon.0 v2:172.21.15.105:3300/0 5 ==== fsmap(e 84) ==== 3502+0+0 (secure 0 0 0) 0x7f43d0053020 con 0x55821a4f8270 2024-09-21T03:26:43.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.886+0000 7f43e503b740 10 client.8154 fetch_fsmap finished waiting for FSMap version 84 2024-09-21T03:26:43.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.886+0000 7f43e503b740 10 client.8154 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T03:26:43.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.886+0000 7f43e503b740 20 client.8154 populate_metadata read hostname 'smithi105' 2024-09-21T03:26:43.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.886+0000 7f43e503b740 1 --2- 172.21.15.105:0/2556873755 >> [v2:172.21.15.162:6834/712373587,v1:172.21.15.162:6837/712373587] conn(0x55821a4b6e40 0x55821a8f75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:43.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.886+0000 7f43e503b740 4 client.8154 mds_command: new command op to 8022 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:26:43.892 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.886+0000 7f43e503b740 1 -- 172.21.15.105:0/2556873755 --> [v2:172.21.15.162:6834/712373587,v1:172.21.15.162:6837/712373587] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55821a814770 con 0x55821a4b6e40 2024-09-21T03:26:43.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.886+0000 7f43d77fe640 1 --2- 172.21.15.105:0/2556873755 >> [v2:172.21.15.162:6834/712373587,v1:172.21.15.162:6837/712373587] conn(0x55821a4b6e40 0x55821a8f75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:43.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.887+0000 7f43b67fc640 10 client.8154 ms_handle_connect on v2:172.21.15.162:6834/712373587 2024-09-21T03:26:43.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.887+0000 7f43d77fe640 1 --2- 172.21.15.105:0/2556873755 >> [v2:172.21.15.162:6834/712373587,v1:172.21.15.162:6837/712373587] conn(0x55821a4b6e40 0x55821a8f75e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9388c2fea152fbf1 server_cookie=2e3742c023223e34 in_seq=0 out_seq=0 2024-09-21T03:26:43.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.888+0000 7f43b67fc640 1 -- 172.21.15.105:0/2556873755 <== mds.0 v2:172.21.15.162:6834/712373587 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55821a814770 con 0x55821a4b6e40 2024-09-21T03:26:43.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.888+0000 7f43b67fc640 10 client.8154 handle_command_reply: tid=0 2024-09-21T03:26:43.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.888+0000 7f43e503b740 1 client.8154 shutdown 2024-09-21T03:26:43.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.888+0000 7f43e503b740 1 -- 172.21.15.105:0/2556873755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55821a4f8270 msgr2=0x55821a8de3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:43.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.888+0000 7f43e503b740 1 --2- 172.21.15.105:0/2556873755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55821a4f8270 0x55821a8de3d0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f43d003e040 tx=0x7f43d0006520 comp rx=0 tx=0).stop 2024-09-21T03:26:43.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.888+0000 7f43e503b740 1 -- 172.21.15.105:0/2556873755 shutdown_connections 2024-09-21T03:26:43.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.888+0000 7f43e503b740 1 --2- 172.21.15.105:0/2556873755 >> [v2:172.21.15.162:6834/712373587,v1:172.21.15.162:6837/712373587] conn(0x55821a4b6e40 0x55821a8f75e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.888+0000 7f43e503b740 1 --2- 172.21.15.105:0/2556873755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55821a4f8270 0x55821a8de3d0 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.888+0000 7f43e503b740 1 --2- 172.21.15.105:0/2556873755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55821a4d7590 0x55821a8b8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.893 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.888+0000 7f43e503b740 1 --2- 172.21.15.105:0/2556873755 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55821a4cf3b0 0x55821a8e57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.894 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.888+0000 7f43b67fc640 0 client.8154 ms_handle_reset on v2:172.21.15.162:6834/712373587 2024-09-21T03:26:43.894 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.888+0000 7f43e503b740 1 -- 172.21.15.105:0/2556873755 >> 172.21.15.105:0/2556873755 conn(0x55821a4ec3c0 msgr2=0x55821a8c7120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:43.894 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.888+0000 7f43e503b740 1 -- 172.21.15.105:0/2556873755 shutdown_connections 2024-09-21T03:26:43.894 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.888+0000 7f43e503b740 1 -- 172.21.15.105:0/2556873755 wait complete. 2024-09-21T03:26:43.894 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.888+0000 7f43e503b740 20 client.8154 trim_cache size 0 max 16384 2024-09-21T03:26:43.907 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.906+0000 7f43e503b740 1 Processor -- start 2024-09-21T03:26:43.908 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.906+0000 7f43e503b740 1 -- start start 2024-09-21T03:26:43.910 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.907+0000 7f43e503b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55821a4cf3b0 0x55821a8e1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:43.910 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.907+0000 7f43e503b740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55821a4d7590 0x55821a8b96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:43.910 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.907+0000 7f43e503b740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55821a4f8270 0x55821a8b9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:43.910 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.907+0000 7f43e503b740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f43d8201800 con 0x55821a4d7590 2024-09-21T03:26:43.910 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.907+0000 7f43e503b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f43d815ff10 con 0x55821a4cf3b0 2024-09-21T03:26:43.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.907+0000 7f43e503b740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f43d8201300 con 0x55821a4f8270 2024-09-21T03:26:43.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.908+0000 7f43d6ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55821a4d7590 0x55821a8b96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:43.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.908+0000 7f43d6ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55821a4d7590 0x55821a8b96f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:46356/0 (socket says 172.21.15.105:46356) 2024-09-21T03:26:43.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.908+0000 7f43d6ffd640 1 -- 172.21.15.105:0/1890483418 learned_addr learned my addr 172.21.15.105:0/1890483418 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:43.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.908+0000 7f43d77fe640 1 --2- 172.21.15.105:0/1890483418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55821a4cf3b0 0x55821a8e1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:43.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.908+0000 7f43d7fff640 1 --2- 172.21.15.105:0/1890483418 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55821a4f8270 0x55821a8b9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:43.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.908+0000 7f43d6ffd640 1 -- 172.21.15.105:0/1890483418 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55821a4f8270 msgr2=0x55821a8b9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:26:43.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.908+0000 7f43d6ffd640 1 --2- 172.21.15.105:0/1890483418 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55821a4f8270 0x55821a8b9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.908+0000 7f43d6ffd640 1 -- 172.21.15.105:0/1890483418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55821a4cf3b0 msgr2=0x55821a8e1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:26:43.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.908+0000 7f43d6ffd640 1 --2- 172.21.15.105:0/1890483418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55821a4cf3b0 0x55821a8e1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.908+0000 7f43d6ffd640 1 -- 172.21.15.105:0/1890483418 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55821a89ac20 con 0x55821a4d7590 2024-09-21T03:26:43.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.908+0000 7f43d6ffd640 1 --2- 172.21.15.105:0/1890483418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55821a4d7590 0x55821a8b96f0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f43d80b7120 tx=0x7f43c001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1f402542dbd6230 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:43.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.908+0000 7f43ccff9640 1 -- 172.21.15.105:0/1890483418 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c002f070 con 0x55821a4d7590 2024-09-21T03:26:43.912 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.908+0000 7f43ccff9640 1 -- 172.21.15.105:0/1890483418 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f43c0003c00 con 0x55821a4d7590 2024-09-21T03:26:43.912 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.908+0000 7f43ccff9640 1 -- 172.21.15.105:0/1890483418 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c001f430 con 0x55821a4d7590 2024-09-21T03:26:43.916 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.909+0000 7f43e503b740 1 -- 172.21.15.105:0/1890483418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55821a4d7590 msgr2=0x55821a8b96f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:43.916 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.909+0000 7f43e503b740 1 --2- 172.21.15.105:0/1890483418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55821a4d7590 0x55821a8b96f0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f43d80b7120 tx=0x7f43c001b000 comp rx=0 tx=0).stop 2024-09-21T03:26:43.916 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.909+0000 7f43e503b740 1 -- 172.21.15.105:0/1890483418 shutdown_connections 2024-09-21T03:26:43.916 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.909+0000 7f43e503b740 1 --2- 172.21.15.105:0/1890483418 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55821a4f8270 0x55821a8b9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.916 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.909+0000 7f43e503b740 1 --2- 172.21.15.105:0/1890483418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55821a4d7590 0x55821a8b96f0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.916 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.909+0000 7f43e503b740 1 --2- 172.21.15.105:0/1890483418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55821a4cf3b0 0x55821a8e1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.916 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.909+0000 7f43e503b740 1 -- 172.21.15.105:0/1890483418 >> 172.21.15.105:0/1890483418 conn(0x55821a4ec3c0 msgr2=0x55821a8db2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:43.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.909+0000 7f43e503b740 1 -- 172.21.15.105:0/1890483418 shutdown_connections 2024-09-21T03:26:43.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.909+0000 7f43e503b740 1 -- 172.21.15.105:0/1890483418 wait complete. 2024-09-21T03:26:43.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.910+0000 7f43e503b740 1 -- start start 2024-09-21T03:26:43.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.910+0000 7f43e503b740 1 Processor -- start 2024-09-21T03:26:43.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.911+0000 7f43e503b740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55821a4cf3b0 0x55821a961660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:43.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.911+0000 7f43e503b740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55821a4d7590 0x55821a8c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:43.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.911+0000 7f43e503b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55821a4f8270 0x55821a8c7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:43.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.911+0000 7f43e503b740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55821a8f3ff0 con 0x55821a4d7590 2024-09-21T03:26:43.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.911+0000 7f43e503b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55821a572620 con 0x55821a4f8270 2024-09-21T03:26:43.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.911+0000 7f43e503b740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55821a8dfb50 con 0x55821a4cf3b0 2024-09-21T03:26:43.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.911+0000 7f43e503b740 10 client.0 _ll_register_callbacks cb 0x7f43c00098c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:26:43.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.912+0000 7f43d6ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55821a4d7590 0x55821a8c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:43.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.912+0000 7f43d6ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55821a4d7590 0x55821a8c6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:46364/0 (socket says 172.21.15.105:46364) 2024-09-21T03:26:43.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.912+0000 7f43d6ffd640 1 -- 172.21.15.105:0/4022280731 learned_addr learned my addr 172.21.15.105:0/4022280731 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:43.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.912+0000 7f43d77fe640 1 --2- 172.21.15.105:0/4022280731 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55821a4cf3b0 0x55821a961660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:43.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.912+0000 7f43d7fff640 1 --2- 172.21.15.105:0/4022280731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55821a4f8270 0x55821a8c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:43.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.912+0000 7f43d6ffd640 1 -- 172.21.15.105:0/4022280731 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55821a4cf3b0 msgr2=0x55821a961660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:26:43.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.912+0000 7f43d6ffd640 1 --2- 172.21.15.105:0/4022280731 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55821a4cf3b0 0x55821a961660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.912+0000 7f43d6ffd640 1 -- 172.21.15.105:0/4022280731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55821a4f8270 msgr2=0x55821a8c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:26:43.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.912+0000 7f43d6ffd640 1 --2- 172.21.15.105:0/4022280731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55821a4f8270 0x55821a8c7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.912+0000 7f43d6ffd640 1 -- 172.21.15.105:0/4022280731 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55821a964290 con 0x55821a4d7590 2024-09-21T03:26:43.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.912+0000 7f43d6ffd640 1 --2- 172.21.15.105:0/4022280731 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55821a4d7590 0x55821a8c6ee0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f43c002d040 tx=0x7f43c001f960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a34870ff44ea458 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:43.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.912+0000 7f43b67fc640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-21T03:26:43.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.912+0000 7f43b67fc640 1 -- 172.21.15.105:0/4022280731 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c002f050 con 0x55821a4d7590 2024-09-21T03:26:43.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.912+0000 7f43b67fc640 1 -- 172.21.15.105:0/4022280731 <== mon.0 v2:172.21.15.105:3300/0 2 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7f43c001fd50 con 0x55821a4d7590 2024-09-21T03:26:43.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.912+0000 7f43e503b740 1 -- 172.21.15.105:0/4022280731 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43c0003c00 con 0x55821a4d7590 2024-09-21T03:26:43.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.912+0000 7f43b67fc640 1 -- 172.21.15.105:0/4022280731 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7f43c0043050 con 0x55821a4d7590 2024-09-21T03:26:43.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.912+0000 7f43e503b740 10 client.8160 fetch_fsmap learned FSMap version 84 2024-09-21T03:26:43.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.912+0000 7f43e503b740 1 -- 172.21.15.105:0/4022280731 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) -- 0x55821a961ba0 con 0x55821a4d7590 2024-09-21T03:26:43.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.912+0000 7f43b67fc640 1 -- 172.21.15.105:0/4022280731 <== mon.0 v2:172.21.15.105:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f43c0003c00 con 0x55821a4d7590 2024-09-21T03:26:43.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.913+0000 7f43b67fc640 1 -- 172.21.15.105:0/4022280731 <== mon.0 v2:172.21.15.105:3300/0 5 ==== fsmap(e 84) ==== 3502+0+0 (secure 0 0 0) 0x7f43c0046020 con 0x55821a4d7590 2024-09-21T03:26:43.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.913+0000 7f43e503b740 10 client.8160 fetch_fsmap finished waiting for FSMap version 84 2024-09-21T03:26:43.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.913+0000 7f43e503b740 10 client.8160 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T03:26:43.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.913+0000 7f43e503b740 20 client.8160 populate_metadata read hostname 'smithi105' 2024-09-21T03:26:43.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.913+0000 7f43e503b740 1 --2- 172.21.15.105:0/4022280731 >> [v2:172.21.15.162:6834/712373587,v1:172.21.15.162:6837/712373587] conn(0x55821a968230 0x55821a899200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:43.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.913+0000 7f43e503b740 4 client.8160 mds_command: new command op to 8022 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T03:26:43.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.913+0000 7f43e503b740 1 -- 172.21.15.105:0/4022280731 --> [v2:172.21.15.162:6834/712373587,v1:172.21.15.162:6837/712373587] -- command(tid 0: {"prefix": "status"}) -- 0x55821a810220 con 0x55821a968230 2024-09-21T03:26:43.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.913+0000 7f43d77fe640 1 --2- 172.21.15.105:0/4022280731 >> [v2:172.21.15.162:6834/712373587,v1:172.21.15.162:6837/712373587] conn(0x55821a968230 0x55821a899200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:43.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.913+0000 7f43b67fc640 10 client.8160 ms_handle_connect on v2:172.21.15.162:6834/712373587 2024-09-21T03:26:43.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.913+0000 7f43d77fe640 1 --2- 172.21.15.105:0/4022280731 >> [v2:172.21.15.162:6834/712373587,v1:172.21.15.162:6837/712373587] conn(0x55821a968230 0x55821a899200 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47daebb2cbe5c966 server_cookie=c894050db962bca2 in_seq=0 out_seq=0 2024-09-21T03:26:43.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.913+0000 7f43b67fc640 1 -- 172.21.15.105:0/4022280731 <== mds.0 v2:172.21.15.162:6834/712373587 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x55821a810220 con 0x55821a968230 2024-09-21T03:26:43.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.913+0000 7f43b67fc640 10 client.8160 handle_command_reply: tid=0 2024-09-21T03:26:43.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.913+0000 7f43e503b740 1 client.8160 shutdown 2024-09-21T03:26:43.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.914+0000 7f43e503b740 1 -- 172.21.15.105:0/4022280731 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55821a4d7590 msgr2=0x55821a8c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:43.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.914+0000 7f43e503b740 1 --2- 172.21.15.105:0/4022280731 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55821a4d7590 0x55821a8c6ee0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f43c002d040 tx=0x7f43c001f960 comp rx=0 tx=0).stop 2024-09-21T03:26:43.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.914+0000 7f43e503b740 1 -- 172.21.15.105:0/4022280731 shutdown_connections 2024-09-21T03:26:43.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.914+0000 7f43e503b740 1 --2- 172.21.15.105:0/4022280731 >> [v2:172.21.15.162:6834/712373587,v1:172.21.15.162:6837/712373587] conn(0x55821a968230 0x55821a899200 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.914+0000 7f43e503b740 1 --2- 172.21.15.105:0/4022280731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55821a4f8270 0x55821a8c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.914+0000 7f43e503b740 1 --2- 172.21.15.105:0/4022280731 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55821a4d7590 0x55821a8c6ee0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.914+0000 7f43b67fc640 0 client.8160 ms_handle_reset on v2:172.21.15.162:6834/712373587 2024-09-21T03:26:43.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.914+0000 7f43e503b740 1 --2- 172.21.15.105:0/4022280731 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55821a4cf3b0 0x55821a961660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.914+0000 7f43e503b740 1 -- 172.21.15.105:0/4022280731 >> 172.21.15.105:0/4022280731 conn(0x55821a4ec3c0 msgr2=0x55821a895920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:43.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.914+0000 7f43e503b740 1 -- 172.21.15.105:0/4022280731 shutdown_connections 2024-09-21T03:26:43.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.914+0000 7f43e503b740 1 -- 172.21.15.105:0/4022280731 wait complete. 2024-09-21T03:26:43.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.914+0000 7f43e503b740 20 client.8160 trim_cache size 0 max 16384 2024-09-21T03:26:43.921 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-21T03:26:43.921 INFO:teuthology.orchestra.run.smithi105.stdout: "cluster_fsid": "29d80f4f-e5de-4b26-8384-24c2d8019945", 2024-09-21T03:26:43.921 INFO:teuthology.orchestra.run.smithi105.stdout: "whoami": 0, 2024-09-21T03:26:43.921 INFO:teuthology.orchestra.run.smithi105.stdout: "id": 8022, 2024-09-21T03:26:43.921 INFO:teuthology.orchestra.run.smithi105.stdout: "want_state": "up:active", 2024-09-21T03:26:43.921 INFO:teuthology.orchestra.run.smithi105.stdout: "state": "up:active", 2024-09-21T03:26:43.921 INFO:teuthology.orchestra.run.smithi105.stdout: "fs_name": "cephfs", 2024-09-21T03:26:43.921 INFO:teuthology.orchestra.run.smithi105.stdout: "rank_uptime": 10.151017598999999, 2024-09-21T03:26:43.921 INFO:teuthology.orchestra.run.smithi105.stdout: "mdsmap_epoch": 84, 2024-09-21T03:26:43.921 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_epoch": 129, 2024-09-21T03:26:43.922 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_epoch_barrier": 129, 2024-09-21T03:26:43.922 INFO:teuthology.orchestra.run.smithi105.stdout: "uptime": 14.834076230000001 2024-09-21T03:26:43.922 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-21T03:26:43.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.914+0000 7f43de0cc640 1 -- 172.21.15.105:0/1650974234 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f43b8078b90 msgr2=0x7f43b807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:43.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.914+0000 7f43de0cc640 1 --2- 172.21.15.105:0/1650974234 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f43b8078b90 0x7f43b807b0a0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f43d815d830 tx=0x7f43c0005f90 comp rx=0 tx=0).stop 2024-09-21T03:26:43.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.914+0000 7f43de0cc640 1 -- 172.21.15.105:0/1650974234 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43c4004d90 msgr2=0x7f43d80c8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:43.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.914+0000 7f43de0cc640 1 --2- 172.21.15.105:0/1650974234 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43c4004d90 0x7f43d80c8b00 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f43c8006340 tx=0x7f43c8006740 comp rx=0 tx=0).stop 2024-09-21T03:26:43.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.914+0000 7f43de0cc640 1 -- 172.21.15.105:0/1650974234 shutdown_connections 2024-09-21T03:26:43.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.914+0000 7f43de0cc640 1 --2- 172.21.15.105:0/1650974234 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f43b8078b90 0x7f43b807b0a0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.914+0000 7f43de0cc640 1 --2- 172.21.15.105:0/1650974234 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f43d8150890 0x7f43d8150ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.914+0000 7f43de0cc640 1 --2- 172.21.15.105:0/1650974234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43d81f9150 0x7f43d81f9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.914+0000 7f43de0cc640 1 --2- 172.21.15.105:0/1650974234 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43c4004d90 0x7f43d80c8b00 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:43.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.914+0000 7f43de0cc640 1 -- 172.21.15.105:0/1650974234 >> 172.21.15.105:0/1650974234 conn(0x7f43d808bfc0 msgr2=0x7f43d806dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:43.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.914+0000 7f43de0cc640 1 -- 172.21.15.105:0/1650974234 shutdown_connections 2024-09-21T03:26:43.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:43.914+0000 7f43de0cc640 1 -- 172.21.15.105:0/1650974234 wait complete. 2024-09-21T03:26:43.927 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T03:26:44.040 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.038+0000 7fec0962e640 1 -- 172.21.15.105:0/2169074165 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7febec0053f0 msgr2=0x7febec00ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:44.040 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.038+0000 7fec0962e640 1 --2- 172.21.15.105:0/2169074165 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7febec0053f0 0x7febec00ba70 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7febfc001d90 tx=0x7febec005830 comp rx=0 tx=0).stop 2024-09-21T03:26:44.040 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.038+0000 7fec0962e640 1 -- 172.21.15.105:0/2169074165 shutdown_connections 2024-09-21T03:26:44.040 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.038+0000 7fec0962e640 1 --2- 172.21.15.105:0/2169074165 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7febec0053f0 0x7febec00ba70 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:44.040 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.038+0000 7fec0962e640 1 -- 172.21.15.105:0/2169074165 >> 172.21.15.105:0/2169074165 conn(0x7fec0409d7f0 msgr2=0x7fec040d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:44.040 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.038+0000 7fec0962e640 1 -- 172.21.15.105:0/2169074165 shutdown_connections 2024-09-21T03:26:44.040 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.038+0000 7fec0962e640 1 -- 172.21.15.105:0/2169074165 wait complete. 2024-09-21T03:26:44.041 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.040+0000 7fec0962e640 1 Processor -- start 2024-09-21T03:26:44.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.040+0000 7fec0962e640 1 -- start start 2024-09-21T03:26:44.044 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.041+0000 7fec0962e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec0415d090 0x7fec0415d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:44.044 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.041+0000 7fec0962e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec040cdeb0 0x7fec040ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:44.044 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.041+0000 7fec0962e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec040d1640 0x7fec040d1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:44.044 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.041+0000 7fec0962e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fec040b6120 con 0x7fec0415d090 2024-09-21T03:26:44.044 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.041+0000 7fec0962e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fec040b5fa0 con 0x7fec040cdeb0 2024-09-21T03:26:44.044 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.041+0000 7fec0962e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fec040b62a0 con 0x7fec040d1640 2024-09-21T03:26:44.045 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.041+0000 7fec02ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec0415d090 0x7fec0415d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:44.045 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.041+0000 7fec02ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec0415d090 0x7fec0415d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:46370/0 (socket says 172.21.15.105:46370) 2024-09-21T03:26:44.045 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.041+0000 7fec02ffd640 1 -- 172.21.15.105:0/1714845206 learned_addr learned my addr 172.21.15.105:0/1714845206 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:44.045 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.042+0000 7fec037fe640 1 --2- 172.21.15.105:0/1714845206 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec040d1640 0x7fec040d1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:44.045 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.042+0000 7fec027fc640 1 --2- 172.21.15.105:0/1714845206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec040cdeb0 0x7fec040ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:44.045 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.042+0000 7fec02ffd640 1 -- 172.21.15.105:0/1714845206 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec040d1640 msgr2=0x7fec040d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:44.045 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.042+0000 7fec02ffd640 1 --2- 172.21.15.105:0/1714845206 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec040d1640 0x7fec040d1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:44.045 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.042+0000 7fec02ffd640 1 -- 172.21.15.105:0/1714845206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec040cdeb0 msgr2=0x7fec040ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:44.045 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.042+0000 7fec02ffd640 1 --2- 172.21.15.105:0/1714845206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec040cdeb0 0x7fec040ce2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:44.045 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.042+0000 7fec02ffd640 1 -- 172.21.15.105:0/1714845206 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec040d1f90 con 0x7fec0415d090 2024-09-21T03:26:44.045 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.042+0000 7fec037fe640 1 --2- 172.21.15.105:0/1714845206 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec040d1640 0x7fec040d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:26:44.045 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.042+0000 7fec027fc640 1 --2- 172.21.15.105:0/1714845206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec040cdeb0 0x7fec040ce2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:26:44.045 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.042+0000 7fec02ffd640 1 --2- 172.21.15.105:0/1714845206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec0415d090 0x7fec0415d910 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7febf4005f00 tx=0x7febf4011f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:44.046 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.042+0000 7febeb7fe640 1 -- 172.21.15.105:0/1714845206 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf400fc70 con 0x7fec0415d090 2024-09-21T03:26:44.046 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.042+0000 7febeb7fe640 1 -- 172.21.15.105:0/1714845206 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7febf400fe10 con 0x7fec0415d090 2024-09-21T03:26:44.046 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.042+0000 7febeb7fe640 1 -- 172.21.15.105:0/1714845206 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf4004290 con 0x7fec0415d090 2024-09-21T03:26:44.046 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.042+0000 7fec0962e640 1 -- 172.21.15.105:0/1714845206 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec0415de50 con 0x7fec0415d090 2024-09-21T03:26:44.046 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.042+0000 7fec0962e640 1 -- 172.21.15.105:0/1714845206 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec041f90a0 con 0x7fec0415d090 2024-09-21T03:26:44.047 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.043+0000 7fec0962e640 1 -- 172.21.15.105:0/1714845206 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec040b67b0 con 0x7fec0415d090 2024-09-21T03:26:44.047 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.044+0000 7febeb7fe640 1 -- 172.21.15.105:0/1714845206 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7febf40035f0 con 0x7fec0415d090 2024-09-21T03:26:44.047 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.044+0000 7febeb7fe640 1 --2- 172.21.15.105:0/1714845206 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7febf0078b90 0x7febf007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:44.047 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.044+0000 7febeb7fe640 1 -- 172.21.15.105:0/1714845206 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7febf409b710 con 0x7fec0415d090 2024-09-21T03:26:44.047 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.045+0000 7fec027fc640 1 --2- 172.21.15.105:0/1714845206 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7febf0078b90 0x7febf007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:44.047 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.045+0000 7fec027fc640 1 --2- 172.21.15.105:0/1714845206 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7febf0078b90 0x7febf007b0a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7febf8001240 tx=0x7febf8006720 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:44.050 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.049+0000 7febeb7fe640 1 -- 172.21.15.105:0/1714845206 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fec040d1f90 con 0x7fec0415d090 2024-09-21T03:26:44.266 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.265+0000 7fec0962e640 1 -- 172.21.15.105:0/1714845206 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fec040d3fb0 con 0x7fec0415d090 2024-09-21T03:26:44.267 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.265+0000 7febeb7fe640 1 -- 172.21.15.105:0/1714845206 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v84) ==== 53+0+73 (secure 0 0 0) 0x7febf4063c70 con 0x7fec0415d090 2024-09-21T03:26:44.267 INFO:teuthology.orchestra.run.smithi105.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T03:26:44.269 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.268+0000 7fec0962e640 1 -- 172.21.15.105:0/1714845206 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7febf0078b90 msgr2=0x7febf007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:44.270 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.268+0000 7fec0962e640 1 --2- 172.21.15.105:0/1714845206 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7febf0078b90 0x7febf007b0a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7febf8001240 tx=0x7febf8006720 comp rx=0 tx=0).stop 2024-09-21T03:26:44.270 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.268+0000 7fec0962e640 1 -- 172.21.15.105:0/1714845206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec0415d090 msgr2=0x7fec0415d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:44.270 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.268+0000 7fec0962e640 1 --2- 172.21.15.105:0/1714845206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec0415d090 0x7fec0415d910 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7febf4005f00 tx=0x7febf4011f40 comp rx=0 tx=0).stop 2024-09-21T03:26:44.270 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.268+0000 7fec0962e640 1 -- 172.21.15.105:0/1714845206 shutdown_connections 2024-09-21T03:26:44.270 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.268+0000 7fec0962e640 1 --2- 172.21.15.105:0/1714845206 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7febf0078b90 0x7febf007b0a0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:44.270 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.268+0000 7fec0962e640 1 --2- 172.21.15.105:0/1714845206 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec040d1640 0x7fec040d1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:44.270 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.268+0000 7fec0962e640 1 --2- 172.21.15.105:0/1714845206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec040cdeb0 0x7fec040ce2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:44.270 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.268+0000 7fec0962e640 1 --2- 172.21.15.105:0/1714845206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec0415d090 0x7fec0415d910 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:44.270 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.268+0000 7fec0962e640 1 -- 172.21.15.105:0/1714845206 >> 172.21.15.105:0/1714845206 conn(0x7fec0409d7f0 msgr2=0x7fec040b7790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:44.270 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.268+0000 7fec0962e640 1 -- 172.21.15.105:0/1714845206 shutdown_connections 2024-09-21T03:26:44.270 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44.268+0000 7fec0962e640 1 -- 172.21.15.105:0/1714845206 wait complete. 2024-09-21T03:26:44.280 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T03:26:44.280 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T03:26:44.280 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi105.front.sepia.ceph.com 2024-09-21T03:26:44.281 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T03:26:44.281 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T03:26:44.281 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T03:26:44.281 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T03:26:44.281 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T03:26:44.281 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:26:44.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:26:44.281 DEBUG:teuthology.orchestra.run.smithi105:> ip addr 2024-09-21T03:26:44.297 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T03:26:44.297 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T03:26:44.297 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T03:26:44.297 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:26:44.297 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2024-09-21T03:26:44.297 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:26:44.297 INFO:teuthology.orchestra.run.smithi105.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:26:44.298 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b8 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:26:44.298 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f0 2024-09-21T03:26:44.298 INFO:teuthology.orchestra.run.smithi105.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:26:44.298 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b9 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:26:44.298 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f1 2024-09-21T03:26:44.298 INFO:teuthology.orchestra.run.smithi105.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:26:44.298 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:28 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:26:44.298 INFO:teuthology.orchestra.run.smithi105.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T03:26:44.298 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:29 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:26:44.298 INFO:teuthology.orchestra.run.smithi105.stdout: inet 172.21.15.105/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T03:26:44.298 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft 42303sec preferred_lft 42303sec 2024-09-21T03:26:44.298 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::ec4:7aff:fe8f:d429/64 scope link noprefixroute 2024-09-21T03:26:44.299 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:26:44.299 INFO:teuthology.orchestra.run.smithi105.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T03:26:44.299 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 86:15:ed:f2:4e:d8 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:26:44.299 INFO:teuthology.orchestra.run.smithi105.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T03:26:44.299 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:26:44.299 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::80db:6aff:fece:44c2/64 scope link 2024-09-21T03:26:44.299 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:26:44.299 INFO:teuthology.orchestra.run.smithi105.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:26:44.299 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 86:15:ed:f2:4e:d8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T03:26:44.299 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::8415:edff:fef2:4ed8/64 scope link 2024-09-21T03:26:44.299 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:26:44.299 INFO:teuthology.orchestra.run.smithi105.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:26:44.299 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether a2:e9:7c:d4:c7:c7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T03:26:44.299 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::a0e9:7cff:fed4:c7c7/64 scope link 2024-09-21T03:26:44.300 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:26:44.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:26:44.300 DEBUG:teuthology.orchestra.run.smithi105:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T03:26:44.360 INFO:teuthology.orchestra.run.smithi105.stdout:1 2024-09-21T03:26:44.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:26:44.362 DEBUG:teuthology.orchestra.run.smithi105:> route 2024-09-21T03:26:44.419 INFO:teuthology.orchestra.run.smithi105.stdout:Kernel IP routing table 2024-09-21T03:26:44.419 INFO:teuthology.orchestra.run.smithi105.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T03:26:44.419 INFO:teuthology.orchestra.run.smithi105.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T03:26:44.419 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T03:26:44.419 INFO:teuthology.orchestra.run.smithi105.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T03:26:44.420 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:26:44.420 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-21T03:26:44.420 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T03:26:44.420 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T03:26:44.420 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T03:26:44.420 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-21T03:26:44.507 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:26:44.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:26:44.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:26:44.545 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-09-21T03:26:44.560 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T03:26:44.560 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T03:26:44.560 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:26:44.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:26:44.561 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set brx.0 up 2024-09-21T03:26:44.625 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:26:44.625 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T03:26:44.681 INFO:teuthology.orchestra.run.smithi105.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:26:44.681 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:26:44.681 DEBUG:teuthology.orchestra.run.smithi105:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T03:26:44.737 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-21T03:26:44.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:26:44.737 DEBUG:teuthology.orchestra.run.smithi105:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:26:44.831 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:26:44.832 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T03:26:44.832 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2024-09-21T03:26:44.842 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:26:44.842 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T03:26:44.842 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2024-09-21T03:26:44.842 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:26:44.843 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:26:44.848 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:26:44.848 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T03:26:44.848 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2024-09-21T03:26:44.849 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:26:44.849 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:26:44.849 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-21T03:26:44.849 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-21T03:26:44.849 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=29d80f4f-e5de-4b26-8384-24c2d8019945" will pass to kernel 2024-09-21T03:26:44.849 INFO:teuthology.orchestra.run.smithi105.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T03:26:44.849 INFO:teuthology.orchestra.run.smithi105.stdout: You just mounted a file system that supports labels which does not 2024-09-21T03:26:44.850 INFO:teuthology.orchestra.run.smithi105.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T03:26:44.850 INFO:teuthology.orchestra.run.smithi105.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T03:26:44.850 INFO:teuthology.orchestra.run.smithi105.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T03:26:44.851 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T03:26:44.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:26:44.851 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T03:26:44.876 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:26:44.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:26:44.973 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:26:44.979 INFO:teuthology.orchestra.run.smithi105.stdout:client8169 2024-09-21T03:26:44.980 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:26:44.980 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:26:44.995 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T03:26:45.148 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.146+0000 7f9fa74b6640 1 -- 172.21.15.105:0/1948593111 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9fa00cfb00 msgr2=0x7f9fa015bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:45.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.146+0000 7f9fa74b6640 1 --2- 172.21.15.105:0/1948593111 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9fa00cfb00 0x7f9fa015bf20 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f9fa00cdc20 tx=0x7f9f9c02a530 comp rx=0 tx=0).stop 2024-09-21T03:26:45.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.146+0000 7f9fa74b6640 1 -- 172.21.15.105:0/1948593111 shutdown_connections 2024-09-21T03:26:45.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.146+0000 7f9fa74b6640 1 --2- 172.21.15.105:0/1948593111 >> v2:172.21.15.162:3300/0 conn(0x7f9fa00cb0b0 0x7f9fa006ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:45.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.146+0000 7f9fa74b6640 1 --2- 172.21.15.105:0/1948593111 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9fa00cfb00 0x7f9fa015bf20 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:45.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.146+0000 7f9fa74b6640 1 -- 172.21.15.105:0/1948593111 >> 172.21.15.105:0/1948593111 conn(0x7f9fa00b1cb0 msgr2=0x7f9fa00b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:45.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.147+0000 7f9fa74b6640 1 -- 172.21.15.105:0/1948593111 shutdown_connections 2024-09-21T03:26:45.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.147+0000 7f9fa74b6640 1 -- 172.21.15.105:0/1948593111 wait complete. 2024-09-21T03:26:45.150 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.148+0000 7f9fa74b6640 1 Processor -- start 2024-09-21T03:26:45.150 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.148+0000 7f9fa74b6640 1 -- start start 2024-09-21T03:26:45.152 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.150+0000 7f9fa74b6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9fa00cf160 0x7f9fa0159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:45.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.150+0000 7f9fa74b6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9fa00cfb00 0x7f9fa009c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:45.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.150+0000 7f9fa74b6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9fa015a770 0x7f9fa009cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:45.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.150+0000 7f9fa74b6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa00ccba0 con 0x7f9fa00cf160 2024-09-21T03:26:45.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.150+0000 7f9fa74b6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa00cf780 con 0x7f9fa015a770 2024-09-21T03:26:45.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.150+0000 7f9fa74b6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9fa00ccd20 con 0x7f9fa00cfb00 2024-09-21T03:26:45.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.150+0000 7f9fa5252640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9fa00cf160 0x7f9fa0159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:45.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.150+0000 7f9fa5252640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9fa00cf160 0x7f9fa0159af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:46386/0 (socket says 172.21.15.105:46386) 2024-09-21T03:26:45.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.150+0000 7f9fa5252640 1 -- 172.21.15.105:0/1998330627 learned_addr learned my addr 172.21.15.105:0/1998330627 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:45.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.150+0000 7f9fa5252640 1 -- 172.21.15.105:0/1998330627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9fa00cfb00 msgr2=0x7f9fa009c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:45.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.150+0000 7f9fa4a51640 1 --2- 172.21.15.105:0/1998330627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9fa00cfb00 0x7f9fa009c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:45.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.150+0000 7f9fa5a53640 1 --2- 172.21.15.105:0/1998330627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9fa015a770 0x7f9fa009cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:45.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.150+0000 7f9fa5252640 1 --2- 172.21.15.105:0/1998330627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9fa00cfb00 0x7f9fa009c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:45.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.150+0000 7f9fa5252640 1 -- 172.21.15.105:0/1998330627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9fa015a770 msgr2=0x7f9fa009cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:45.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.150+0000 7f9fa5252640 1 --2- 172.21.15.105:0/1998330627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9fa015a770 0x7f9fa009cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:45.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.150+0000 7f9fa5252640 1 -- 172.21.15.105:0/1998330627 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa015a030 con 0x7f9fa00cf160 2024-09-21T03:26:45.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.150+0000 7f9fa5a53640 1 --2- 172.21.15.105:0/1998330627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9fa015a770 0x7f9fa009cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:26:45.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.150+0000 7f9fa4a51640 1 --2- 172.21.15.105:0/1998330627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9fa00cfb00 0x7f9fa009c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:26:45.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.150+0000 7f9fa5252640 1 --2- 172.21.15.105:0/1998330627 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9fa00cf160 0x7f9fa0159af0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c009780 tx=0x7f9f9c0316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:45.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.150+0000 7f9f95ffb640 1 -- 172.21.15.105:0/1998330627 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c003b80 con 0x7f9fa00cf160 2024-09-21T03:26:45.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.150+0000 7f9f95ffb640 1 -- 172.21.15.105:0/1998330627 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f9c003e10 con 0x7f9fa00cf160 2024-09-21T03:26:45.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.150+0000 7f9f95ffb640 1 -- 172.21.15.105:0/1998330627 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c005280 con 0x7f9fa00cf160 2024-09-21T03:26:45.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.150+0000 7f9fa74b6640 1 -- 172.21.15.105:0/1998330627 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fa009d570 con 0x7f9fa00cf160 2024-09-21T03:26:45.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.151+0000 7f9fa74b6640 1 -- 172.21.15.105:0/1998330627 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fa009db30 con 0x7f9fa00cf160 2024-09-21T03:26:45.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.151+0000 7f9fa74b6640 1 -- 172.21.15.105:0/1998330627 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fa0076820 con 0x7f9fa00cf160 2024-09-21T03:26:45.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.152+0000 7f9f95ffb640 1 -- 172.21.15.105:0/1998330627 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9f9c005420 con 0x7f9fa00cf160 2024-09-21T03:26:45.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.153+0000 7f9f95ffb640 1 --2- 172.21.15.105:0/1998330627 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9f84078bc0 0x7f9f8407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:45.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.153+0000 7f9f95ffb640 1 -- 172.21.15.105:0/1998330627 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7f9f9c0be740 con 0x7f9fa00cf160 2024-09-21T03:26:45.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.153+0000 7f9fa4a51640 1 --2- 172.21.15.105:0/1998330627 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9f84078bc0 0x7f9f8407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:45.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.154+0000 7f9fa4a51640 1 --2- 172.21.15.105:0/1998330627 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9f84078bc0 0x7f9f8407b0d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f9fa015c630 tx=0x7f9f90009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:45.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.157+0000 7f9f95ffb640 1 -- 172.21.15.105:0/1998330627 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9f9c041030 con 0x7f9fa00cf160 2024-09-21T03:26:45.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.369+0000 7f9fa74b6640 1 -- 172.21.15.105:0/1998330627 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9fa015ce20 con 0x7f9fa00cf160 2024-09-21T03:26:45.371 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.369+0000 7f9f95ffb640 1 -- 172.21.15.105:0/1998330627 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v84) ==== 53+0+73 (secure 0 0 0) 0x7f9f9c086ca0 con 0x7f9fa00cf160 2024-09-21T03:26:45.371 INFO:teuthology.orchestra.run.smithi105.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T03:26:45.373 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.371+0000 7f9fa74b6640 1 -- 172.21.15.105:0/1998330627 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9f84078bc0 msgr2=0x7f9f8407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:45.373 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.371+0000 7f9fa74b6640 1 --2- 172.21.15.105:0/1998330627 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9f84078bc0 0x7f9f8407b0d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f9fa015c630 tx=0x7f9f90009040 comp rx=0 tx=0).stop 2024-09-21T03:26:45.373 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.371+0000 7f9fa74b6640 1 -- 172.21.15.105:0/1998330627 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9fa00cf160 msgr2=0x7f9fa0159af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:45.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.371+0000 7f9fa74b6640 1 --2- 172.21.15.105:0/1998330627 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9fa00cf160 0x7f9fa0159af0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c009780 tx=0x7f9f9c0316d0 comp rx=0 tx=0).stop 2024-09-21T03:26:45.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.371+0000 7f9fa74b6640 1 -- 172.21.15.105:0/1998330627 shutdown_connections 2024-09-21T03:26:45.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.371+0000 7f9fa74b6640 1 --2- 172.21.15.105:0/1998330627 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9f84078bc0 0x7f9f8407b0d0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:45.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.371+0000 7f9fa74b6640 1 --2- 172.21.15.105:0/1998330627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9fa015a770 0x7f9fa009cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:45.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.371+0000 7f9fa74b6640 1 --2- 172.21.15.105:0/1998330627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9fa00cfb00 0x7f9fa009c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:45.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.371+0000 7f9fa74b6640 1 --2- 172.21.15.105:0/1998330627 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9fa00cf160 0x7f9fa0159af0 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:45.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.371+0000 7f9fa74b6640 1 -- 172.21.15.105:0/1998330627 >> 172.21.15.105:0/1998330627 conn(0x7f9fa00b1cb0 msgr2=0x7f9fa00ae980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:45.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.371+0000 7f9fa74b6640 1 -- 172.21.15.105:0/1998330627 shutdown_connections 2024-09-21T03:26:45.374 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:45.372+0000 7f9fa74b6640 1 -- 172.21.15.105:0/1998330627 wait complete. 2024-09-21T03:26:45.384 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T03:26:45.384 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T03:26:45.384 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2024-09-21T03:26:45.384 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-21T03:26:45.385 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T03:26:45.385 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T03:26:45.385 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T03:26:45.385 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T03:26:45.385 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T03:26:45.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:26:45.385 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2024-09-21T03:26:45.405 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T03:26:45.405 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T03:26:45.405 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T03:26:45.405 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:26:45.405 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-09-21T03:26:45.405 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:26:45.406 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:26:45.406 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:26:45.406 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f0 2024-09-21T03:26:45.406 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:26:45.406 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:26:45.406 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f1 2024-09-21T03:26:45.406 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:26:45.406 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:26:45.406 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T03:26:45.406 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:26:45.406 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T03:26:45.406 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42295sec preferred_lft 42295sec 2024-09-21T03:26:45.406 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::ec4:7aff:fe88:7f41/64 scope link noprefixroute 2024-09-21T03:26:45.406 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:26:45.407 INFO:teuthology.orchestra.run.smithi162.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T03:26:45.407 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 32:ad:10:1b:86:54 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:26:45.407 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T03:26:45.407 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:26:45.407 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::c03a:6bff:febf:f5a9/64 scope link 2024-09-21T03:26:45.407 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:26:45.407 INFO:teuthology.orchestra.run.smithi162.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:26:45.407 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 32:ad:10:1b:86:54 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T03:26:45.407 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::30ad:10ff:fe1b:8654/64 scope link 2024-09-21T03:26:45.407 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:26:45.407 INFO:teuthology.orchestra.run.smithi162.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:26:45.407 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 6a:62:2d:53:ae:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-21T03:26:45.407 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::6862:2dff:fe53:aec0/64 scope link 2024-09-21T03:26:45.407 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:26:45.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:26:45.408 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T03:26:45.473 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-09-21T03:26:45.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:26:45.475 DEBUG:teuthology.orchestra.run.smithi162:> route 2024-09-21T03:26:45.534 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2024-09-21T03:26:45.534 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T03:26:45.534 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T03:26:45.534 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T03:26:45.534 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T03:26:45.535 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:26:45.535 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-09-21T03:26:45.535 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T03:26:45.535 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T03:26:45.535 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T03:26:45.535 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-09-21T03:26:45.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:26:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:26:45.660 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:26:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:26:45.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:26:45.666 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-09-21T03:26:45.681 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-21T03:26:45.681 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-21T03:26:45.681 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T03:26:45.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:26:45.681 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.0 up 2024-09-21T03:26:45.747 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:26:45.747 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-21T03:26:45.803 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-21T03:26:45.803 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:26:45.803 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-21T03:26:45.859 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-21T03:26:45.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:26:45.859 DEBUG:teuthology.orchestra.run.smithi162:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:26:45.953 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:26:45.954 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T03:26:45.954 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-21T03:26:45.964 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:26:45.964 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T03:26:45.965 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-21T03:26:45.965 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:26:45.965 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:26:45.971 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:26:45.971 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T03:26:45.971 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-21T03:26:45.971 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:26:45.972 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:26:45.972 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-21T03:26:45.972 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-21T03:26:45.972 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=29d80f4f-e5de-4b26-8384-24c2d8019945" will pass to kernel 2024-09-21T03:26:45.972 INFO:teuthology.orchestra.run.smithi162.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-21T03:26:45.972 INFO:teuthology.orchestra.run.smithi162.stdout: You just mounted a file system that supports labels which does not 2024-09-21T03:26:45.972 INFO:teuthology.orchestra.run.smithi162.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T03:26:45.972 INFO:teuthology.orchestra.run.smithi162.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T03:26:45.973 INFO:teuthology.orchestra.run.smithi162.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T03:26:45.974 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T03:26:45.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:26:45.974 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-21T03:26:45.999 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:26:46.088 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:26:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:26:46.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:26:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:26:46.095 INFO:teuthology.orchestra.run.smithi162.stdout:client8181 2024-09-21T03:26:46.095 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:26:46.095 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:26:46.111 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_cache_memory_limit 1K 2024-09-21T03:26:46.228 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.226+0000 7f7852998640 1 -- 172.21.15.105:0/3264111097 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f784c0d2430 msgr2=0x7f784c0cf040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:46.228 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.226+0000 7f7852998640 1 --2- 172.21.15.105:0/3264111097 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f784c0d2430 0x7f784c0cf040 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f783c005fd0 tx=0x7f783c02a670 comp rx=0 tx=0).stop 2024-09-21T03:26:46.228 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.226+0000 7f7852998640 1 -- 172.21.15.105:0/3264111097 shutdown_connections 2024-09-21T03:26:46.228 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.226+0000 7f7852998640 1 --2- 172.21.15.105:0/3264111097 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f784c0d2430 0x7f784c0cf040 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:46.228 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.226+0000 7f7852998640 1 -- 172.21.15.105:0/3264111097 >> 172.21.15.105:0/3264111097 conn(0x7f784c09d880 msgr2=0x7f784c08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:46.228 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.226+0000 7f7852998640 1 -- 172.21.15.105:0/3264111097 shutdown_connections 2024-09-21T03:26:46.228 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.226+0000 7f7852998640 1 -- 172.21.15.105:0/3264111097 wait complete. 2024-09-21T03:26:46.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.228+0000 7f7852998640 1 Processor -- start 2024-09-21T03:26:46.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.228+0000 7f7852998640 1 -- start start 2024-09-21T03:26:46.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.229+0000 7f7852998640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f784c0b4a50 0x7f784c14e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:46.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.229+0000 7f7852998640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f784c0d0c70 0x7f784c150600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:46.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.229+0000 7f7852998640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f784c0d2430 0x7f784c150b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:46.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.229+0000 7f7852998640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f784c0b5570 con 0x7f784c0d0c70 2024-09-21T03:26:46.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.229+0000 7f7852998640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f784c1624d0 con 0x7f784c0b4a50 2024-09-21T03:26:46.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.229+0000 7f7852998640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f784c0b56f0 con 0x7f784c0d2430 2024-09-21T03:26:46.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.229+0000 7f784b7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f784c0d0c70 0x7f784c150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:46.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.229+0000 7f784b7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f784c0d0c70 0x7f784c150600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:46406/0 (socket says 172.21.15.105:46406) 2024-09-21T03:26:46.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.229+0000 7f784b7fe640 1 -- 172.21.15.105:0/1199351779 learned_addr learned my addr 172.21.15.105:0/1199351779 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:46.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.229+0000 7f784bfff640 1 --2- 172.21.15.105:0/1199351779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f784c0b4a50 0x7f784c14e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:46.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.229+0000 7f7850f35640 1 --2- 172.21.15.105:0/1199351779 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f784c0d2430 0x7f784c150b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:46.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.230+0000 7f784b7fe640 1 -- 172.21.15.105:0/1199351779 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f784c0d2430 msgr2=0x7f784c150b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:46.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.230+0000 7f784b7fe640 1 --2- 172.21.15.105:0/1199351779 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f784c0d2430 0x7f784c150b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:46.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.230+0000 7f784b7fe640 1 -- 172.21.15.105:0/1199351779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f784c0b4a50 msgr2=0x7f784c14e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:46.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.230+0000 7f784b7fe640 1 --2- 172.21.15.105:0/1199351779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f784c0b4a50 0x7f784c14e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:46.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.230+0000 7f784b7fe640 1 -- 172.21.15.105:0/1199351779 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f784c14f560 con 0x7f784c0d0c70 2024-09-21T03:26:46.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.230+0000 7f784bfff640 1 --2- 172.21.15.105:0/1199351779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f784c0b4a50 0x7f784c14e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:26:46.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.230+0000 7f784b7fe640 1 --2- 172.21.15.105:0/1199351779 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f784c0d0c70 0x7f784c150600 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f784000c3a0 tx=0x7f784000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:46.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.230+0000 7f7848ff9640 1 -- 172.21.15.105:0/1199351779 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7840017070 con 0x7f784c0d0c70 2024-09-21T03:26:46.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.230+0000 7f7848ff9640 1 -- 172.21.15.105:0/1199351779 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f78400053c0 con 0x7f784c0d0c70 2024-09-21T03:26:46.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.230+0000 7f7848ff9640 1 -- 172.21.15.105:0/1199351779 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7840003850 con 0x7f784c0d0c70 2024-09-21T03:26:46.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.230+0000 7f7852998640 1 -- 172.21.15.105:0/1199351779 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f784c14f840 con 0x7f784c0d0c70 2024-09-21T03:26:46.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.230+0000 7f7852998640 1 -- 172.21.15.105:0/1199351779 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f784c14fe00 con 0x7f784c0d0c70 2024-09-21T03:26:46.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.231+0000 7f7852998640 1 -- 172.21.15.105:0/1199351779 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f784c0cf040 con 0x7f784c0d0c70 2024-09-21T03:26:46.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.232+0000 7f7848ff9640 1 -- 172.21.15.105:0/1199351779 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f784001a070 con 0x7f784c0d0c70 2024-09-21T03:26:46.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.232+0000 7f7848ff9640 1 --2- 172.21.15.105:0/1199351779 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7838078b90 0x7f783807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:46.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.232+0000 7f7848ff9640 1 -- 172.21.15.105:0/1199351779 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7f784009a450 con 0x7f784c0d0c70 2024-09-21T03:26:46.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.233+0000 7f784bfff640 1 --2- 172.21.15.105:0/1199351779 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7838078b90 0x7f783807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:46.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.233+0000 7f784bfff640 1 --2- 172.21.15.105:0/1199351779 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7838078b90 0x7f783807b0a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f783c033000 tx=0x7f783c004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:46.238 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.236+0000 7f7848ff9640 1 -- 172.21.15.105:0/1199351779 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7840021020 con 0x7f784c0d0c70 2024-09-21T03:26:46.418 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.416+0000 7f7852998640 1 -- 172.21.15.105:0/1199351779 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command([{prefix=config set, name=mds_cache_memory_limit}] v 0) -- 0x7f784c0b51e0 con 0x7f784c0d0c70 2024-09-21T03:26:46.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.420+0000 7f7848ff9640 1 -- 172.21.15.105:0/1199351779 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_cache_memory_limit}]=0 v64)=0 v64) ==== 121+0+0 (secure 0 0 0) 0x7f7840062970 con 0x7f784c0d0c70 2024-09-21T03:26:46.424 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.422+0000 7f7852998640 1 -- 172.21.15.105:0/1199351779 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7838078b90 msgr2=0x7f783807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:46.424 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.422+0000 7f7852998640 1 --2- 172.21.15.105:0/1199351779 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7838078b90 0x7f783807b0a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f783c033000 tx=0x7f783c004730 comp rx=0 tx=0).stop 2024-09-21T03:26:46.424 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.422+0000 7f7852998640 1 -- 172.21.15.105:0/1199351779 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f784c0d0c70 msgr2=0x7f784c150600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:46.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.422+0000 7f7852998640 1 --2- 172.21.15.105:0/1199351779 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f784c0d0c70 0x7f784c150600 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f784000c3a0 tx=0x7f784000c860 comp rx=0 tx=0).stop 2024-09-21T03:26:46.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.422+0000 7f7852998640 1 -- 172.21.15.105:0/1199351779 shutdown_connections 2024-09-21T03:26:46.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.422+0000 7f7852998640 1 --2- 172.21.15.105:0/1199351779 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7838078b90 0x7f783807b0a0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:46.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.422+0000 7f7852998640 1 --2- 172.21.15.105:0/1199351779 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f784c0d2430 0x7f784c150b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:46.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.422+0000 7f7852998640 1 --2- 172.21.15.105:0/1199351779 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f784c0d0c70 0x7f784c150600 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:46.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.422+0000 7f7852998640 1 --2- 172.21.15.105:0/1199351779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f784c0b4a50 0x7f784c14e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:46.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.423+0000 7f7852998640 1 -- 172.21.15.105:0/1199351779 >> 172.21.15.105:0/1199351779 conn(0x7f784c09d880 msgr2=0x7f784c15f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:46.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.423+0000 7f7852998640 1 -- 172.21.15.105:0/1199351779 shutdown_connections 2024-09-21T03:26:46.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.423+0000 7f7852998640 1 -- 172.21.15.105:0/1199351779 wait complete. 2024-09-21T03:26:46.436 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_recall_max_caps 200 2024-09-21T03:26:46.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.550+0000 7f5deaba8640 1 -- 172.21.15.105:0/3403996754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5de41600a0 msgr2=0x7f5de4071250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:46.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.550+0000 7f5deaba8640 1 --2- 172.21.15.105:0/3403996754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5de41600a0 0x7f5de4071250 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4009830 tx=0x7f5dd402a640 comp rx=0 tx=0).stop 2024-09-21T03:26:46.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.550+0000 7f5deaba8640 1 -- 172.21.15.105:0/3403996754 shutdown_connections 2024-09-21T03:26:46.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.550+0000 7f5deaba8640 1 --2- 172.21.15.105:0/3403996754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5de41600a0 0x7f5de4071250 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:46.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.550+0000 7f5deaba8640 1 -- 172.21.15.105:0/3403996754 >> 172.21.15.105:0/3403996754 conn(0x7f5de40cdcb0 msgr2=0x7f5de40ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:46.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.550+0000 7f5deaba8640 1 -- 172.21.15.105:0/3403996754 shutdown_connections 2024-09-21T03:26:46.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.550+0000 7f5deaba8640 1 -- 172.21.15.105:0/3403996754 wait complete. 2024-09-21T03:26:46.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.551+0000 7f5deaba8640 1 Processor -- start 2024-09-21T03:26:46.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.552+0000 7f5deaba8640 1 -- start start 2024-09-21T03:26:46.556 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.553+0000 7f5deaba8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5de40ce7d0 0x7f5de414b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:46.556 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.553+0000 7f5deaba8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5de41600a0 0x7f5de414bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:46.556 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.553+0000 7f5deaba8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5de40b25f0 0x7f5de414c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:46.556 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.553+0000 7f5deaba8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5de40d0540 con 0x7f5de41600a0 2024-09-21T03:26:46.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.553+0000 7f5deaba8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5de40d03c0 con 0x7f5de40ce7d0 2024-09-21T03:26:46.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.553+0000 7f5deaba8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5de40d06c0 con 0x7f5de40b25f0 2024-09-21T03:26:46.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.553+0000 7f5de3fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5de41600a0 0x7f5de414bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:46.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.553+0000 7f5de8944640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5de40ce7d0 0x7f5de414b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:46.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.553+0000 7f5de3fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5de41600a0 0x7f5de414bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:46426/0 (socket says 172.21.15.105:46426) 2024-09-21T03:26:46.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.553+0000 7f5de3fff640 1 -- 172.21.15.105:0/2221777936 learned_addr learned my addr 172.21.15.105:0/2221777936 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:46.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.553+0000 7f5de9145640 1 --2- 172.21.15.105:0/2221777936 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5de40b25f0 0x7f5de414c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:46.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.553+0000 7f5de3fff640 1 -- 172.21.15.105:0/2221777936 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5de40b25f0 msgr2=0x7f5de414c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:46.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.553+0000 7f5de3fff640 1 --2- 172.21.15.105:0/2221777936 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5de40b25f0 0x7f5de414c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:46.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.553+0000 7f5de3fff640 1 -- 172.21.15.105:0/2221777936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5de40ce7d0 msgr2=0x7f5de414b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:46.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.553+0000 7f5de3fff640 1 --2- 172.21.15.105:0/2221777936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5de40ce7d0 0x7f5de414b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:46.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.553+0000 7f5de3fff640 1 -- 172.21.15.105:0/2221777936 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5de40b2bb0 con 0x7f5de41600a0 2024-09-21T03:26:46.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.554+0000 7f5de3fff640 1 --2- 172.21.15.105:0/2221777936 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5de41600a0 0x7f5de414bdc0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f5dd800c400 tx=0x7f5dd800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:46.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.554+0000 7f5de17fa640 1 -- 172.21.15.105:0/2221777936 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd8011790 con 0x7f5de41600a0 2024-09-21T03:26:46.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.554+0000 7f5de17fa640 1 -- 172.21.15.105:0/2221777936 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5dd8017070 con 0x7f5de41600a0 2024-09-21T03:26:46.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.554+0000 7f5deaba8640 1 -- 172.21.15.105:0/2221777936 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5de40b2e90 con 0x7f5de41600a0 2024-09-21T03:26:46.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.554+0000 7f5de17fa640 1 -- 172.21.15.105:0/2221777936 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd8011ce0 con 0x7f5de41600a0 2024-09-21T03:26:46.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.554+0000 7f5deaba8640 1 -- 172.21.15.105:0/2221777936 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5de40b3450 con 0x7f5de41600a0 2024-09-21T03:26:46.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.555+0000 7f5deaba8640 1 -- 172.21.15.105:0/2221777936 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5de4071250 con 0x7f5de41600a0 2024-09-21T03:26:46.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.556+0000 7f5de17fa640 1 -- 172.21.15.105:0/2221777936 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5dd801c460 con 0x7f5de41600a0 2024-09-21T03:26:46.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.556+0000 7f5de17fa640 1 --2- 172.21.15.105:0/2221777936 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5dd0078bf0 0x7f5dd007b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:46.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.556+0000 7f5de17fa640 1 -- 172.21.15.105:0/2221777936 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7f5dd809aa70 con 0x7f5de41600a0 2024-09-21T03:26:46.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.556+0000 7f5de8944640 1 --2- 172.21.15.105:0/2221777936 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5dd0078bf0 0x7f5dd007b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:46.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.557+0000 7f5de8944640 1 --2- 172.21.15.105:0/2221777936 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5dd0078bf0 0x7f5dd007b100 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4034000 tx=0x7f5dd4004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:46.562 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.561+0000 7f5de17fa640 1 -- 172.21.15.105:0/2221777936 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5dd80627e0 con 0x7f5de41600a0 2024-09-21T03:26:46.745 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.743+0000 7f5deaba8640 1 -- 172.21.15.105:0/2221777936 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command([{prefix=config set, name=mds_recall_max_caps}] v 0) -- 0x7f5de40ae040 con 0x7f5de41600a0 2024-09-21T03:26:46.748 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.747+0000 7f5de17fa640 1 -- 172.21.15.105:0/2221777936 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_recall_max_caps}]=0 v65)=0 v65) ==== 119+0+0 (secure 0 0 0) 0x7f5dd8067210 con 0x7f5de41600a0 2024-09-21T03:26:46.751 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.749+0000 7f5deaba8640 1 -- 172.21.15.105:0/2221777936 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5dd0078bf0 msgr2=0x7f5dd007b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:46.751 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.749+0000 7f5deaba8640 1 --2- 172.21.15.105:0/2221777936 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5dd0078bf0 0x7f5dd007b100 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4034000 tx=0x7f5dd4004730 comp rx=0 tx=0).stop 2024-09-21T03:26:46.751 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.749+0000 7f5deaba8640 1 -- 172.21.15.105:0/2221777936 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5de41600a0 msgr2=0x7f5de414bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:46.751 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.749+0000 7f5deaba8640 1 --2- 172.21.15.105:0/2221777936 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5de41600a0 0x7f5de414bdc0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f5dd800c400 tx=0x7f5dd800c8c0 comp rx=0 tx=0).stop 2024-09-21T03:26:46.751 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.749+0000 7f5deaba8640 1 -- 172.21.15.105:0/2221777936 shutdown_connections 2024-09-21T03:26:46.751 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.749+0000 7f5deaba8640 1 --2- 172.21.15.105:0/2221777936 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5dd0078bf0 0x7f5dd007b100 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:46.752 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.749+0000 7f5deaba8640 1 --2- 172.21.15.105:0/2221777936 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5de40b25f0 0x7f5de414c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:46.752 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.749+0000 7f5deaba8640 1 --2- 172.21.15.105:0/2221777936 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5de41600a0 0x7f5de414bdc0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:46.752 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.749+0000 7f5deaba8640 1 --2- 172.21.15.105:0/2221777936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5de40ce7d0 0x7f5de414b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:46.752 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.749+0000 7f5deaba8640 1 -- 172.21.15.105:0/2221777936 >> 172.21.15.105:0/2221777936 conn(0x7f5de40cdcb0 msgr2=0x7f5de415a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:46.752 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.749+0000 7f5deaba8640 1 -- 172.21.15.105:0/2221777936 shutdown_connections 2024-09-21T03:26:46.752 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.749+0000 7f5deaba8640 1 -- 172.21.15.105:0/2221777936 wait complete. 2024-09-21T03:26:46.763 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_recall_warning_threshold 400 2024-09-21T03:26:46.880 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.878+0000 7effec362640 1 -- 172.21.15.105:0/3810915081 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effe415c7a0 msgr2=0x7effe40cf680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:46.880 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.878+0000 7effec362640 1 --2- 172.21.15.105:0/3810915081 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effe415c7a0 0x7effe40cf680 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7effd4009830 tx=0x7effd402a530 comp rx=0 tx=0).stop 2024-09-21T03:26:46.880 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.878+0000 7effec362640 1 -- 172.21.15.105:0/3810915081 shutdown_connections 2024-09-21T03:26:46.880 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.878+0000 7effec362640 1 --2- 172.21.15.105:0/3810915081 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effe415c7a0 0x7effe40cf680 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:46.880 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.878+0000 7effec362640 1 -- 172.21.15.105:0/3810915081 >> 172.21.15.105:0/3810915081 conn(0x7effe40b3f10 msgr2=0x7effe40b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:46.880 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.878+0000 7effec362640 1 -- 172.21.15.105:0/3810915081 shutdown_connections 2024-09-21T03:26:46.881 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.878+0000 7effec362640 1 -- 172.21.15.105:0/3810915081 wait complete. 2024-09-21T03:26:46.881 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.880+0000 7effec362640 1 Processor -- start 2024-09-21T03:26:46.881 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.880+0000 7effec362640 1 -- start start 2024-09-21T03:26:46.884 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.881+0000 7effec362640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effe40ccbe0 0x7effe4148530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:46.884 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.881+0000 7effec362640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effe40d2310 0x7effe41e4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:46.884 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.881+0000 7effec362640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effe415c7a0 0x7effe41e5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:46.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.881+0000 7effec362640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7effe40d19f0 con 0x7effe40d2310 2024-09-21T03:26:46.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.881+0000 7effec362640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7effe40d1870 con 0x7effe415c7a0 2024-09-21T03:26:46.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.881+0000 7effec362640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7effe40d1b70 con 0x7effe40ccbe0 2024-09-21T03:26:46.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.881+0000 7effe98fd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effe40d2310 0x7effe41e4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:46.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.881+0000 7effe98fd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effe40d2310 0x7effe41e4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:46438/0 (socket says 172.21.15.105:46438) 2024-09-21T03:26:46.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.881+0000 7effe98fd640 1 -- 172.21.15.105:0/794784095 learned_addr learned my addr 172.21.15.105:0/794784095 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:46.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.881+0000 7effea8ff640 1 --2- 172.21.15.105:0/794784095 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effe415c7a0 0x7effe41e5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:46.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.881+0000 7effea0fe640 1 --2- 172.21.15.105:0/794784095 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effe40ccbe0 0x7effe4148530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:46.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.882+0000 7effe98fd640 1 -- 172.21.15.105:0/794784095 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effe40ccbe0 msgr2=0x7effe4148530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:46.885 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.882+0000 7effe98fd640 1 --2- 172.21.15.105:0/794784095 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effe40ccbe0 0x7effe4148530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:46.886 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.882+0000 7effe98fd640 1 -- 172.21.15.105:0/794784095 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effe415c7a0 msgr2=0x7effe41e5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:46.886 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.882+0000 7effe98fd640 1 --2- 172.21.15.105:0/794784095 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effe415c7a0 0x7effe41e5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:46.886 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.882+0000 7effe98fd640 1 -- 172.21.15.105:0/794784095 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effe40c9fe0 con 0x7effe40d2310 2024-09-21T03:26:46.886 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.882+0000 7effea8ff640 1 --2- 172.21.15.105:0/794784095 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effe415c7a0 0x7effe41e5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:26:46.886 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.882+0000 7effea0fe640 1 --2- 172.21.15.105:0/794784095 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effe40ccbe0 0x7effe4148530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:26:46.886 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.882+0000 7effe98fd640 1 --2- 172.21.15.105:0/794784095 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effe40d2310 0x7effe41e4f50 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7effd4009950 tx=0x7effd4033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:46.886 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.882+0000 7effdaffd640 1 -- 172.21.15.105:0/794784095 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd4031d60 con 0x7effe40d2310 2024-09-21T03:26:46.886 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.882+0000 7effec362640 1 -- 172.21.15.105:0/794784095 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effe40ca2c0 con 0x7effe40d2310 2024-09-21T03:26:46.886 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.882+0000 7effdaffd640 1 -- 172.21.15.105:0/794784095 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7effd4033e10 con 0x7effe40d2310 2024-09-21T03:26:46.887 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.882+0000 7effdaffd640 1 -- 172.21.15.105:0/794784095 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd4033310 con 0x7effe40d2310 2024-09-21T03:26:46.887 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.882+0000 7effec362640 1 -- 172.21.15.105:0/794784095 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effe40ca880 con 0x7effe40d2310 2024-09-21T03:26:46.887 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.883+0000 7effec362640 1 -- 172.21.15.105:0/794784095 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effe40cf680 con 0x7effe40d2310 2024-09-21T03:26:46.888 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.884+0000 7effdaffd640 1 -- 172.21.15.105:0/794784095 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7effd40334b0 con 0x7effe40d2310 2024-09-21T03:26:46.888 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.884+0000 7effdaffd640 1 --2- 172.21.15.105:0/794784095 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7effc8078b90 0x7effc807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:46.888 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.884+0000 7effdaffd640 1 -- 172.21.15.105:0/794784095 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7effd40bc160 con 0x7effe40d2310 2024-09-21T03:26:46.888 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.884+0000 7effea0fe640 1 --2- 172.21.15.105:0/794784095 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7effc8078b90 0x7effc807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:46.888 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.885+0000 7effea0fe640 1 --2- 172.21.15.105:0/794784095 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7effc8078b90 0x7effc807b0a0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7effe00046b0 tx=0x7effe0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:46.890 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:46.889+0000 7effdaffd640 1 -- 172.21.15.105:0/794784095 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7effd403f030 con 0x7effe40d2310 2024-09-21T03:26:47.065 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.063+0000 7effec362640 1 -- 172.21.15.105:0/794784095 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command([{prefix=config set, name=mds_recall_warning_threshold}] v 0) -- 0x7effe40cd5e0 con 0x7effe40d2310 2024-09-21T03:26:47.068 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.067+0000 7effdaffd640 1 -- 172.21.15.105:0/794784095 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_recall_warning_threshold}]=0 v66)=0 v66) ==== 128+0+0 (secure 0 0 0) 0x7effd40845b0 con 0x7effe40d2310 2024-09-21T03:26:47.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.069+0000 7effec362640 1 -- 172.21.15.105:0/794784095 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7effc8078b90 msgr2=0x7effc807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:47.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.069+0000 7effec362640 1 --2- 172.21.15.105:0/794784095 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7effc8078b90 0x7effc807b0a0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7effe00046b0 tx=0x7effe0009040 comp rx=0 tx=0).stop 2024-09-21T03:26:47.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.069+0000 7effec362640 1 -- 172.21.15.105:0/794784095 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effe40d2310 msgr2=0x7effe41e4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:47.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.069+0000 7effec362640 1 --2- 172.21.15.105:0/794784095 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effe40d2310 0x7effe41e4f50 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7effd4009950 tx=0x7effd4033c20 comp rx=0 tx=0).stop 2024-09-21T03:26:47.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.069+0000 7effec362640 1 -- 172.21.15.105:0/794784095 shutdown_connections 2024-09-21T03:26:47.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.069+0000 7effec362640 1 --2- 172.21.15.105:0/794784095 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7effc8078b90 0x7effc807b0a0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:47.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.069+0000 7effec362640 1 --2- 172.21.15.105:0/794784095 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7effe415c7a0 0x7effe41e5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:47.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.069+0000 7effec362640 1 --2- 172.21.15.105:0/794784095 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effe40d2310 0x7effe41e4f50 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:47.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.069+0000 7effec362640 1 --2- 172.21.15.105:0/794784095 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7effe40ccbe0 0x7effe4148530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:47.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.069+0000 7effec362640 1 -- 172.21.15.105:0/794784095 >> 172.21.15.105:0/794784095 conn(0x7effe40b3f10 msgr2=0x7effe40b6aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:47.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.069+0000 7effec362640 1 -- 172.21.15.105:0/794784095 shutdown_connections 2024-09-21T03:26:47.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.069+0000 7effec362640 1 -- 172.21.15.105:0/794784095 wait complete. 2024-09-21T03:26:47.082 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_min_caps_per_client 2024-09-21T03:26:47.197 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.195+0000 7fa2fb24d640 1 -- 172.21.15.105:0/206142891 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2f40ccba0 msgr2=0x7fa2f40ccfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:47.197 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.195+0000 7fa2fb24d640 1 --2- 172.21.15.105:0/206142891 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2f40ccba0 0x7fa2f40ccfb0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec009830 tx=0x7fa2ec02a510 comp rx=0 tx=0).stop 2024-09-21T03:26:47.197 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.195+0000 7fa2fb24d640 1 -- 172.21.15.105:0/206142891 shutdown_connections 2024-09-21T03:26:47.197 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.195+0000 7fa2fb24d640 1 --2- 172.21.15.105:0/206142891 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2f40ccba0 0x7fa2f40ccfb0 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:47.197 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.195+0000 7fa2fb24d640 1 --2- 172.21.15.105:0/206142891 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2f40b5210 0x7fa2f40ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:47.197 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.195+0000 7fa2fb24d640 1 -- 172.21.15.105:0/206142891 >> 172.21.15.105:0/206142891 conn(0x7fa2f40b3f10 msgr2=0x7fa2f40b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:47.197 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.195+0000 7fa2fb24d640 1 -- 172.21.15.105:0/206142891 shutdown_connections 2024-09-21T03:26:47.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.195+0000 7fa2fb24d640 1 -- 172.21.15.105:0/206142891 wait complete. 2024-09-21T03:26:47.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.197+0000 7fa2fb24d640 1 Processor -- start 2024-09-21T03:26:47.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.197+0000 7fa2fb24d640 1 -- start start 2024-09-21T03:26:47.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.198+0000 7fa2fb24d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2f40b5210 0x7fa2f41f77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:47.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.198+0000 7fa2fb24d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2f40ccba0 0x7fa2f414a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:47.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.198+0000 7fa2fb24d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2f40d1d40 0x7fa2f41f6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:47.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.198+0000 7fa2fb24d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f40d1300 con 0x7fa2f40d1d40 2024-09-21T03:26:47.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.198+0000 7fa2fb24d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f40d1180 con 0x7fa2f40b5210 2024-09-21T03:26:47.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.198+0000 7fa2fb24d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa2f40d1480 con 0x7fa2f40ccba0 2024-09-21T03:26:47.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.198+0000 7fa2f97ea640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2f40d1d40 0x7fa2f41f6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:47.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.198+0000 7fa2f97ea640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2f40d1d40 0x7fa2f41f6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:46454/0 (socket says 172.21.15.105:46454) 2024-09-21T03:26:47.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.198+0000 7fa2f97ea640 1 -- 172.21.15.105:0/3756810964 learned_addr learned my addr 172.21.15.105:0/3756810964 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:47.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.198+0000 7fa2f3fff640 1 --2- 172.21.15.105:0/3756810964 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2f40ccba0 0x7fa2f414a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:47.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.198+0000 7fa2f8fe9640 1 --2- 172.21.15.105:0/3756810964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2f40b5210 0x7fa2f41f77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:47.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.199+0000 7fa2f97ea640 1 -- 172.21.15.105:0/3756810964 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2f40ccba0 msgr2=0x7fa2f414a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:47.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.199+0000 7fa2f97ea640 1 --2- 172.21.15.105:0/3756810964 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2f40ccba0 0x7fa2f414a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:47.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.199+0000 7fa2f97ea640 1 -- 172.21.15.105:0/3756810964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2f40b5210 msgr2=0x7fa2f41f77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:47.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.199+0000 7fa2f97ea640 1 --2- 172.21.15.105:0/3756810964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2f40b5210 0x7fa2f41f77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:47.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.199+0000 7fa2f97ea640 1 -- 172.21.15.105:0/3756810964 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f4154890 con 0x7fa2f40d1d40 2024-09-21T03:26:47.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.199+0000 7fa2f97ea640 1 --2- 172.21.15.105:0/3756810964 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2f40d1d40 0x7fa2f41f6c50 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec009950 tx=0x7fa2ec033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:47.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.199+0000 7fa2f17fa640 1 -- 172.21.15.105:0/3756810964 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec031b50 con 0x7fa2f40d1d40 2024-09-21T03:26:47.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.199+0000 7fa2f17fa640 1 -- 172.21.15.105:0/3756810964 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa2ec031de0 con 0x7fa2f40d1d40 2024-09-21T03:26:47.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.199+0000 7fa2fb24d640 1 -- 172.21.15.105:0/3756810964 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2f4154b30 con 0x7fa2f40d1d40 2024-09-21T03:26:47.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.199+0000 7fa2f17fa640 1 -- 172.21.15.105:0/3756810964 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec005280 con 0x7fa2f40d1d40 2024-09-21T03:26:47.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.199+0000 7fa2fb24d640 1 -- 172.21.15.105:0/3756810964 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2f40c97c0 con 0x7fa2f40d1d40 2024-09-21T03:26:47.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.200+0000 7fa2fb24d640 1 -- 172.21.15.105:0/3756810964 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2f40d19c0 con 0x7fa2f40d1d40 2024-09-21T03:26:47.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.201+0000 7fa2f17fa640 1 -- 172.21.15.105:0/3756810964 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa2ec005420 con 0x7fa2f40d1d40 2024-09-21T03:26:47.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.201+0000 7fa2f17fa640 1 --2- 172.21.15.105:0/3756810964 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa2d4078b90 0x7fa2d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:47.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.202+0000 7fa2f17fa640 1 -- 172.21.15.105:0/3756810964 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7fa2ec0bbdb0 con 0x7fa2f40d1d40 2024-09-21T03:26:47.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.202+0000 7fa2f8fe9640 1 --2- 172.21.15.105:0/3756810964 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa2d4078b90 0x7fa2d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:47.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.202+0000 7fa2f8fe9640 1 --2- 172.21.15.105:0/3756810964 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa2d4078b90 0x7fa2d407b0a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fa2e40012e0 tx=0x7fa2e4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:47.207 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.206+0000 7fa2f17fa640 1 -- 172.21.15.105:0/3756810964 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa2ec03f030 con 0x7fa2f40d1d40 2024-09-21T03:26:47.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.383+0000 7fa2fb24d640 1 -- 172.21.15.105:0/3756810964 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_min_caps_per_client"} v 0) -- 0x7fa2f40cd2b0 con 0x7fa2f40d1d40 2024-09-21T03:26:47.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.383+0000 7fa2f17fa640 1 -- 172.21.15.105:0/3756810964 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_min_caps_per_client"}]=0 v66) ==== 106+0+4 (secure 0 0 0) 0x7fa2ec031770 con 0x7fa2f40d1d40 2024-09-21T03:26:47.385 INFO:teuthology.orchestra.run.smithi105.stdout:100 2024-09-21T03:26:47.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.385+0000 7fa2fb24d640 1 -- 172.21.15.105:0/3756810964 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa2d4078b90 msgr2=0x7fa2d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:47.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.385+0000 7fa2fb24d640 1 --2- 172.21.15.105:0/3756810964 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa2d4078b90 0x7fa2d407b0a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fa2e40012e0 tx=0x7fa2e4009040 comp rx=0 tx=0).stop 2024-09-21T03:26:47.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.385+0000 7fa2fb24d640 1 -- 172.21.15.105:0/3756810964 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2f40d1d40 msgr2=0x7fa2f41f6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:47.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.385+0000 7fa2fb24d640 1 --2- 172.21.15.105:0/3756810964 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2f40d1d40 0x7fa2f41f6c50 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec009950 tx=0x7fa2ec033ba0 comp rx=0 tx=0).stop 2024-09-21T03:26:47.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.385+0000 7fa2fb24d640 1 -- 172.21.15.105:0/3756810964 shutdown_connections 2024-09-21T03:26:47.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.385+0000 7fa2fb24d640 1 --2- 172.21.15.105:0/3756810964 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa2d4078b90 0x7fa2d407b0a0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:47.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.385+0000 7fa2fb24d640 1 --2- 172.21.15.105:0/3756810964 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2f40d1d40 0x7fa2f41f6c50 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:47.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.385+0000 7fa2fb24d640 1 --2- 172.21.15.105:0/3756810964 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2f40ccba0 0x7fa2f414a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:47.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.385+0000 7fa2fb24d640 1 --2- 172.21.15.105:0/3756810964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2f40b5210 0x7fa2f41f77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:47.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.385+0000 7fa2fb24d640 1 -- 172.21.15.105:0/3756810964 >> 172.21.15.105:0/3756810964 conn(0x7fa2f40b3f10 msgr2=0x7fa2f40b6ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:47.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.385+0000 7fa2fb24d640 1 -- 172.21.15.105:0/3756810964 shutdown_connections 2024-09-21T03:26:47.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.385+0000 7fa2fb24d640 1 -- 172.21.15.105:0/3756810964 wait complete. 2024-09-21T03:26:47.398 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_min_caps_working_set 100 2024-09-21T03:26:47.516 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.513+0000 7fcb40782640 1 -- 172.21.15.105:0/3193628767 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb380cfeb0 msgr2=0x7fcb380d02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:47.516 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.513+0000 7fcb40782640 1 --2- 172.21.15.105:0/3193628767 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb380cfeb0 0x7fcb380d02c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcb30009830 tx=0x7fcb3002a510 comp rx=0 tx=0).stop 2024-09-21T03:26:47.516 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.514+0000 7fcb40782640 1 -- 172.21.15.105:0/3193628767 shutdown_connections 2024-09-21T03:26:47.516 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.514+0000 7fcb40782640 1 --2- 172.21.15.105:0/3193628767 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb380cfeb0 0x7fcb380d02c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:47.516 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.514+0000 7fcb40782640 1 --2- 172.21.15.105:0/3193628767 >> v2:172.21.15.162:3300/0 conn(0x7fcb380b4090 0x7fcb380b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:47.516 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.514+0000 7fcb40782640 1 -- 172.21.15.105:0/3193628767 >> 172.21.15.105:0/3193628767 conn(0x7fcb380cdcc0 msgr2=0x7fcb380ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:47.516 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.514+0000 7fcb40782640 1 -- 172.21.15.105:0/3193628767 shutdown_connections 2024-09-21T03:26:47.516 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.514+0000 7fcb40782640 1 -- 172.21.15.105:0/3193628767 wait complete. 2024-09-21T03:26:47.517 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.515+0000 7fcb40782640 1 Processor -- start 2024-09-21T03:26:47.517 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.515+0000 7fcb40782640 1 -- start start 2024-09-21T03:26:47.520 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.517+0000 7fcb40782640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcb3806fec0 0x7fcb381f1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:47.520 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.517+0000 7fcb40782640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb380b4090 0x7fcb381e6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:47.520 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.517+0000 7fcb40782640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb380cfeb0 0x7fcb380b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:47.520 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.517+0000 7fcb40782640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcb380b4a30 con 0x7fcb3806fec0 2024-09-21T03:26:47.520 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.517+0000 7fcb40782640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcb380b48b0 con 0x7fcb380b4090 2024-09-21T03:26:47.520 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.517+0000 7fcb40782640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcb380b4bb0 con 0x7fcb380cfeb0 2024-09-21T03:26:47.520 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.517+0000 7fcb3e51e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcb3806fec0 0x7fcb381f1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:47.520 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.517+0000 7fcb3e51e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcb3806fec0 0x7fcb381f1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:46458/0 (socket says 172.21.15.105:46458) 2024-09-21T03:26:47.520 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.517+0000 7fcb3e51e640 1 -- 172.21.15.105:0/4274236487 learned_addr learned my addr 172.21.15.105:0/4274236487 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:47.520 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.517+0000 7fcb3ed1f640 1 --2- 172.21.15.105:0/4274236487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb380cfeb0 0x7fcb380b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:47.520 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.517+0000 7fcb3dd1d640 1 --2- 172.21.15.105:0/4274236487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb380b4090 0x7fcb381e6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:47.520 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.517+0000 7fcb3e51e640 1 -- 172.21.15.105:0/4274236487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb380cfeb0 msgr2=0x7fcb380b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:47.520 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.517+0000 7fcb3e51e640 1 --2- 172.21.15.105:0/4274236487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb380cfeb0 0x7fcb380b0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:47.521 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.517+0000 7fcb3e51e640 1 -- 172.21.15.105:0/4274236487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb380b4090 msgr2=0x7fcb381e6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:47.521 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.517+0000 7fcb3e51e640 1 --2- 172.21.15.105:0/4274236487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb380b4090 0x7fcb381e6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:47.521 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.517+0000 7fcb3e51e640 1 -- 172.21.15.105:0/4274236487 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb381e5ac0 con 0x7fcb3806fec0 2024-09-21T03:26:47.521 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.517+0000 7fcb3e51e640 1 --2- 172.21.15.105:0/4274236487 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcb3806fec0 0x7fcb381f1e20 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fcb2800ec40 tx=0x7fcb2800b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:47.521 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.517+0000 7fcb36ffd640 1 -- 172.21.15.105:0/4274236487 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2801c070 con 0x7fcb3806fec0 2024-09-21T03:26:47.521 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.517+0000 7fcb36ffd640 1 -- 172.21.15.105:0/4274236487 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb28017410 con 0x7fcb3806fec0 2024-09-21T03:26:47.521 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.517+0000 7fcb40782640 1 -- 172.21.15.105:0/4274236487 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb381e5f10 con 0x7fcb3806fec0 2024-09-21T03:26:47.521 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.517+0000 7fcb36ffd640 1 -- 172.21.15.105:0/4274236487 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2800be60 con 0x7fcb3806fec0 2024-09-21T03:26:47.521 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.517+0000 7fcb40782640 1 -- 172.21.15.105:0/4274236487 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb381e4f90 con 0x7fcb3806fec0 2024-09-21T03:26:47.522 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.519+0000 7fcb40782640 1 -- 172.21.15.105:0/4274236487 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb380b5060 con 0x7fcb3806fec0 2024-09-21T03:26:47.522 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.519+0000 7fcb36ffd640 1 -- 172.21.15.105:0/4274236487 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcb2801f070 con 0x7fcb3806fec0 2024-09-21T03:26:47.522 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.519+0000 7fcb36ffd640 1 --2- 172.21.15.105:0/4274236487 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcb24078bc0 0x7fcb2407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:47.522 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.520+0000 7fcb36ffd640 1 -- 172.21.15.105:0/4274236487 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7fcb2809cbf0 con 0x7fcb3806fec0 2024-09-21T03:26:47.522 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.520+0000 7fcb3dd1d640 1 --2- 172.21.15.105:0/4274236487 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcb24078bc0 0x7fcb2407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:47.522 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.520+0000 7fcb3dd1d640 1 --2- 172.21.15.105:0/4274236487 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcb24078bc0 0x7fcb2407b0d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c007fd0 tx=0x7fcb2c001390 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:47.526 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.524+0000 7fcb36ffd640 1 -- 172.21.15.105:0/4274236487 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fcb381e5ac0 con 0x7fcb3806fec0 2024-09-21T03:26:47.703 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.701+0000 7fcb40782640 1 -- 172.21.15.105:0/4274236487 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command([{prefix=config set, name=mds_min_caps_working_set}] v 0) -- 0x7fcb380af4a0 con 0x7fcb3806fec0 2024-09-21T03:26:47.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.705+0000 7fcb36ffd640 1 -- 172.21.15.105:0/4274236487 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_min_caps_working_set}]=0 v67)=0 v67) ==== 124+0+0 (secure 0 0 0) 0x7fcb280649e0 con 0x7fcb3806fec0 2024-09-21T03:26:47.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.707+0000 7fcb40782640 1 -- 172.21.15.105:0/4274236487 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcb24078bc0 msgr2=0x7fcb2407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:47.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.707+0000 7fcb40782640 1 --2- 172.21.15.105:0/4274236487 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcb24078bc0 0x7fcb2407b0d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c007fd0 tx=0x7fcb2c001390 comp rx=0 tx=0).stop 2024-09-21T03:26:47.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.707+0000 7fcb40782640 1 -- 172.21.15.105:0/4274236487 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcb3806fec0 msgr2=0x7fcb381f1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:47.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.707+0000 7fcb40782640 1 --2- 172.21.15.105:0/4274236487 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcb3806fec0 0x7fcb381f1e20 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fcb2800ec40 tx=0x7fcb2800b690 comp rx=0 tx=0).stop 2024-09-21T03:26:47.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.707+0000 7fcb40782640 1 -- 172.21.15.105:0/4274236487 shutdown_connections 2024-09-21T03:26:47.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.707+0000 7fcb40782640 1 --2- 172.21.15.105:0/4274236487 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcb24078bc0 0x7fcb2407b0d0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:47.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.707+0000 7fcb40782640 1 --2- 172.21.15.105:0/4274236487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb380cfeb0 0x7fcb380b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:47.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.707+0000 7fcb40782640 1 --2- 172.21.15.105:0/4274236487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb380b4090 0x7fcb381e6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:47.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.707+0000 7fcb40782640 1 --2- 172.21.15.105:0/4274236487 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcb3806fec0 0x7fcb381f1e20 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:47.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.707+0000 7fcb40782640 1 -- 172.21.15.105:0/4274236487 >> 172.21.15.105:0/4274236487 conn(0x7fcb380cdcc0 msgr2=0x7fcb380ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:47.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.707+0000 7fcb40782640 1 -- 172.21.15.105:0/4274236487 shutdown_connections 2024-09-21T03:26:47.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.707+0000 7fcb40782640 1 -- 172.21.15.105:0/4274236487 wait complete. 2024-09-21T03:26:47.720 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_max_caps_per_client 2024-09-21T03:26:47.835 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.833+0000 7f49e123f640 1 -- 172.21.15.105:0/2082149011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49dc0d2630 msgr2=0x7f49dc15d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:47.835 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.833+0000 7f49e123f640 1 --2- 172.21.15.105:0/2082149011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49dc0d2630 0x7f49dc15d130 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f49c4009830 tx=0x7f49c402a510 comp rx=0 tx=0).stop 2024-09-21T03:26:47.835 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.833+0000 7f49e123f640 1 -- 172.21.15.105:0/2082149011 shutdown_connections 2024-09-21T03:26:47.835 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.833+0000 7f49e123f640 1 --2- 172.21.15.105:0/2082149011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49dc0d2630 0x7f49dc15d130 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:47.835 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.833+0000 7f49e123f640 1 --2- 172.21.15.105:0/2082149011 >> v2:172.21.15.162:3300/0 conn(0x7f49dc15d670 0x7f49dc0b7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:47.835 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.833+0000 7f49e123f640 1 -- 172.21.15.105:0/2082149011 >> 172.21.15.105:0/2082149011 conn(0x7f49dc06d550 msgr2=0x7f49dc071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:47.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.833+0000 7f49e123f640 1 -- 172.21.15.105:0/2082149011 shutdown_connections 2024-09-21T03:26:47.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.833+0000 7f49e123f640 1 -- 172.21.15.105:0/2082149011 wait complete. 2024-09-21T03:26:47.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.835+0000 7f49e123f640 1 Processor -- start 2024-09-21T03:26:47.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.835+0000 7f49e123f640 1 -- start start 2024-09-21T03:26:47.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.836+0000 7f49e123f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49dc1570e0 0x7f49dc0cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:47.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.836+0000 7f49e123f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49dc15d670 0x7f49dc15ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:47.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.836+0000 7f49e123f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49dc1f3cf0 0x7f49dc15f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:47.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.836+0000 7f49e123f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f49dc0b7d60 con 0x7f49dc1f3cf0 2024-09-21T03:26:47.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.836+0000 7f49e123f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f49dc0b7be0 con 0x7f49dc15d670 2024-09-21T03:26:47.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.836+0000 7f49e123f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f49dc0b7ee0 con 0x7f49dc1570e0 2024-09-21T03:26:47.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.837+0000 7f49db59e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49dc1f3cf0 0x7f49dc15f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:47.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.837+0000 7f49db59e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49dc1f3cf0 0x7f49dc15f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:46462/0 (socket says 172.21.15.105:46462) 2024-09-21T03:26:47.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.837+0000 7f49db59e640 1 -- 172.21.15.105:0/102883401 learned_addr learned my addr 172.21.15.105:0/102883401 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:47.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.837+0000 7f49d259c640 1 --2- 172.21.15.105:0/102883401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49dc15d670 0x7f49dc15ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:47.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.837+0000 7f49dad9d640 1 --2- 172.21.15.105:0/102883401 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49dc1570e0 0x7f49dc0cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:47.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.837+0000 7f49db59e640 1 -- 172.21.15.105:0/102883401 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49dc1570e0 msgr2=0x7f49dc0cb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:47.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.837+0000 7f49db59e640 1 --2- 172.21.15.105:0/102883401 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49dc1570e0 0x7f49dc0cb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:47.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.837+0000 7f49db59e640 1 -- 172.21.15.105:0/102883401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49dc15d670 msgr2=0x7f49dc15ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:47.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.837+0000 7f49db59e640 1 --2- 172.21.15.105:0/102883401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49dc15d670 0x7f49dc15ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:47.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.837+0000 7f49db59e640 1 -- 172.21.15.105:0/102883401 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49dc1f4220 con 0x7f49dc1f3cf0 2024-09-21T03:26:47.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.837+0000 7f49db59e640 1 --2- 172.21.15.105:0/102883401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49dc1f3cf0 0x7f49dc15f160 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f49d400ea40 tx=0x7f49d400ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:47.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.837+0000 7f49d3fff640 1 -- 172.21.15.105:0/102883401 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d400ce40 con 0x7f49dc1f3cf0 2024-09-21T03:26:47.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.837+0000 7f49d3fff640 1 -- 172.21.15.105:0/102883401 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f49d4004c10 con 0x7f49dc1f3cf0 2024-09-21T03:26:47.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.837+0000 7f49d3fff640 1 -- 172.21.15.105:0/102883401 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d4005020 con 0x7f49dc1f3cf0 2024-09-21T03:26:47.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.837+0000 7f49e123f640 1 -- 172.21.15.105:0/102883401 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49dc1f4500 con 0x7f49dc1f3cf0 2024-09-21T03:26:47.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.837+0000 7f49e123f640 1 -- 172.21.15.105:0/102883401 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49dc1f4ac0 con 0x7f49dc1f3cf0 2024-09-21T03:26:47.842 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.838+0000 7f49e123f640 1 -- 172.21.15.105:0/102883401 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49dc1611d0 con 0x7f49dc1f3cf0 2024-09-21T03:26:47.842 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.839+0000 7f49d3fff640 1 -- 172.21.15.105:0/102883401 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f49d40051c0 con 0x7f49dc1f3cf0 2024-09-21T03:26:47.842 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.840+0000 7f49d3fff640 1 --2- 172.21.15.105:0/102883401 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f49bc078b90 0x7f49bc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:47.842 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.840+0000 7f49d3fff640 1 -- 172.21.15.105:0/102883401 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7f49d409ba30 con 0x7f49dc1f3cf0 2024-09-21T03:26:47.842 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.840+0000 7f49dad9d640 1 --2- 172.21.15.105:0/102883401 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f49bc078b90 0x7f49bc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:47.842 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.841+0000 7f49dad9d640 1 --2- 172.21.15.105:0/102883401 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f49bc078b90 0x7f49bc07b0a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f49cc007fd0 tx=0x7f49cc001370 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:47.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:47.844+0000 7f49d3fff640 1 -- 172.21.15.105:0/102883401 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f49dc1611d0 con 0x7f49dc1f3cf0 2024-09-21T03:26:48.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.023+0000 7f49e123f640 1 -- 172.21.15.105:0/102883401 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_max_caps_per_client"} v 0) -- 0x7f49dc0c5ad0 con 0x7f49dc1f3cf0 2024-09-21T03:26:48.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.024+0000 7f49d3fff640 1 -- 172.21.15.105:0/102883401 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_max_caps_per_client"}]=0 v67) ==== 106+0+8 (secure 0 0 0) 0x7f49dc0c5ad0 con 0x7f49dc1f3cf0 2024-09-21T03:26:48.026 INFO:teuthology.orchestra.run.smithi105.stdout:1048576 2024-09-21T03:26:48.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.026+0000 7f49e123f640 1 -- 172.21.15.105:0/102883401 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f49bc078b90 msgr2=0x7f49bc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:48.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.026+0000 7f49e123f640 1 --2- 172.21.15.105:0/102883401 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f49bc078b90 0x7f49bc07b0a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f49cc007fd0 tx=0x7f49cc001370 comp rx=0 tx=0).stop 2024-09-21T03:26:48.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.026+0000 7f49e123f640 1 -- 172.21.15.105:0/102883401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49dc1f3cf0 msgr2=0x7f49dc15f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:48.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.026+0000 7f49e123f640 1 --2- 172.21.15.105:0/102883401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49dc1f3cf0 0x7f49dc15f160 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f49d400ea40 tx=0x7f49d400ef00 comp rx=0 tx=0).stop 2024-09-21T03:26:48.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.026+0000 7f49e123f640 1 -- 172.21.15.105:0/102883401 shutdown_connections 2024-09-21T03:26:48.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.026+0000 7f49e123f640 1 --2- 172.21.15.105:0/102883401 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f49bc078b90 0x7f49bc07b0a0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:48.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.026+0000 7f49e123f640 1 --2- 172.21.15.105:0/102883401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49dc1f3cf0 0x7f49dc15f160 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:48.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.026+0000 7f49e123f640 1 --2- 172.21.15.105:0/102883401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49dc15d670 0x7f49dc15ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:48.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.026+0000 7f49e123f640 1 --2- 172.21.15.105:0/102883401 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49dc1570e0 0x7f49dc0cb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:48.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.026+0000 7f49e123f640 1 -- 172.21.15.105:0/102883401 >> 172.21.15.105:0/102883401 conn(0x7f49dc06d550 msgr2=0x7f49dc1566d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:48.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.026+0000 7f49e123f640 1 -- 172.21.15.105:0/102883401 shutdown_connections 2024-09-21T03:26:48.029 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.026+0000 7f49e123f640 1 -- 172.21.15.105:0/102883401 wait complete. 2024-09-21T03:26:48.039 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_recall_warning_decay_rate 2024-09-21T03:26:48.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.152+0000 7f4abc532640 1 -- 172.21.15.105:0/1369928334 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ab41600b0 msgr2=0x7f4ab40ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:48.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.152+0000 7f4abc532640 1 --2- 172.21.15.105:0/1369928334 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ab41600b0 0x7f4ab40ccbc0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0009830 tx=0x7f4ab002a510 comp rx=0 tx=0).stop 2024-09-21T03:26:48.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.152+0000 7f4abc532640 1 -- 172.21.15.105:0/1369928334 shutdown_connections 2024-09-21T03:26:48.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.152+0000 7f4abc532640 1 --2- 172.21.15.105:0/1369928334 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ab41600b0 0x7f4ab40ccbc0 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:48.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.152+0000 7f4abc532640 1 -- 172.21.15.105:0/1369928334 >> 172.21.15.105:0/1369928334 conn(0x7f4ab406d4f0 msgr2=0x7f4ab4071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:48.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.152+0000 7f4abc532640 1 -- 172.21.15.105:0/1369928334 shutdown_connections 2024-09-21T03:26:48.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.152+0000 7f4abc532640 1 -- 172.21.15.105:0/1369928334 wait complete. 2024-09-21T03:26:48.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.154+0000 7f4abc532640 1 Processor -- start 2024-09-21T03:26:48.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.154+0000 7f4abc532640 1 -- start start 2024-09-21T03:26:48.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.155+0000 7f4abc532640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ab40b7cc0 0x7f4ab40cb800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:48.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.155+0000 7f4abc532640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ab40cf320 0x7f4ab40cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:48.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.155+0000 7f4abc532640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ab41600b0 0x7f4ab40b2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:48.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.155+0000 7f4abc532640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab40d15b0 con 0x7f4ab41600b0 2024-09-21T03:26:48.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.155+0000 7f4abc532640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab40d1430 con 0x7f4ab40cf320 2024-09-21T03:26:48.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.155+0000 7f4abc532640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4ab40d1730 con 0x7f4ab40b7cc0 2024-09-21T03:26:48.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.155+0000 7f4abaacf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ab41600b0 0x7f4ab40b2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:48.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.155+0000 7f4abaacf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ab41600b0 0x7f4ab40b2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:46478/0 (socket says 172.21.15.105:46478) 2024-09-21T03:26:48.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.155+0000 7f4abaacf640 1 -- 172.21.15.105:0/1326501911 learned_addr learned my addr 172.21.15.105:0/1326501911 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:48.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.155+0000 7f4ab9acd640 1 --2- 172.21.15.105:0/1326501911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ab40cf320 0x7f4ab40cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:48.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.155+0000 7f4aba2ce640 1 --2- 172.21.15.105:0/1326501911 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ab40b7cc0 0x7f4ab40cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:48.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.155+0000 7f4abaacf640 1 -- 172.21.15.105:0/1326501911 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ab40b7cc0 msgr2=0x7f4ab40cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:48.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.155+0000 7f4abaacf640 1 --2- 172.21.15.105:0/1326501911 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ab40b7cc0 0x7f4ab40cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:48.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.155+0000 7f4abaacf640 1 -- 172.21.15.105:0/1326501911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ab40cf320 msgr2=0x7f4ab40cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:48.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.155+0000 7f4abaacf640 1 --2- 172.21.15.105:0/1326501911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ab40cf320 0x7f4ab40cbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:48.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.156+0000 7f4abaacf640 1 -- 172.21.15.105:0/1326501911 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ab40b3f90 con 0x7f4ab41600b0 2024-09-21T03:26:48.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.156+0000 7f4aba2ce640 1 --2- 172.21.15.105:0/1326501911 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ab40b7cc0 0x7f4ab40cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:26:48.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.156+0000 7f4abaacf640 1 --2- 172.21.15.105:0/1326501911 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ab41600b0 0x7f4ab40b2f10 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f4aac00ba10 tx=0x7f4aac00bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:48.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.156+0000 7f4aaaffd640 1 -- 172.21.15.105:0/1326501911 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aac019070 con 0x7f4ab41600b0 2024-09-21T03:26:48.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.156+0000 7f4aaaffd640 1 -- 172.21.15.105:0/1326501911 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4aac00cc30 con 0x7f4ab41600b0 2024-09-21T03:26:48.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.156+0000 7f4abc532640 1 -- 172.21.15.105:0/1326501911 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ab4150cb0 con 0x7f4ab41600b0 2024-09-21T03:26:48.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.156+0000 7f4aaaffd640 1 -- 172.21.15.105:0/1326501911 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aac0146a0 con 0x7f4ab41600b0 2024-09-21T03:26:48.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.156+0000 7f4abc532640 1 -- 172.21.15.105:0/1326501911 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ab4158cb0 con 0x7f4ab41600b0 2024-09-21T03:26:48.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.157+0000 7f4abc532640 1 -- 172.21.15.105:0/1326501911 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ab40ccbc0 con 0x7f4ab41600b0 2024-09-21T03:26:48.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.158+0000 7f4aaaffd640 1 -- 172.21.15.105:0/1326501911 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4aac01c070 con 0x7f4ab41600b0 2024-09-21T03:26:48.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.158+0000 7f4aaaffd640 1 --2- 172.21.15.105:0/1326501911 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4a98078b90 0x7f4a9807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:48.162 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.158+0000 7f4aaaffd640 1 -- 172.21.15.105:0/1326501911 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7f4aac09aa50 con 0x7f4ab41600b0 2024-09-21T03:26:48.162 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.158+0000 7f4aba2ce640 1 --2- 172.21.15.105:0/1326501911 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4a98078b90 0x7f4a9807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:48.162 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.159+0000 7f4aba2ce640 1 --2- 172.21.15.105:0/1326501911 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4a98078b90 0x7f4a9807b0a0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0034000 tx=0x7f4ab0004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:48.164 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.163+0000 7f4aaaffd640 1 -- 172.21.15.105:0/1326501911 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4aac00ce20 con 0x7f4ab41600b0 2024-09-21T03:26:48.343 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.342+0000 7f4abc532640 1 -- 172.21.15.105:0/1326501911 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_recall_warning_decay_rate"} v 0) -- 0x7f4ab4144eb0 con 0x7f4ab41600b0 2024-09-21T03:26:48.344 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.342+0000 7f4aaaffd640 1 -- 172.21.15.105:0/1326501911 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_recall_warning_decay_rate"}]=0 v67) ==== 112+0+10 (secure 0 0 0) 0x7f4aac062f20 con 0x7f4ab41600b0 2024-09-21T03:26:48.344 INFO:teuthology.orchestra.run.smithi105.stdout:60.000000 2024-09-21T03:26:48.346 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.344+0000 7f4abc532640 1 -- 172.21.15.105:0/1326501911 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4a98078b90 msgr2=0x7f4a9807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:48.346 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.344+0000 7f4abc532640 1 --2- 172.21.15.105:0/1326501911 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4a98078b90 0x7f4a9807b0a0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0034000 tx=0x7f4ab0004730 comp rx=0 tx=0).stop 2024-09-21T03:26:48.346 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.344+0000 7f4abc532640 1 -- 172.21.15.105:0/1326501911 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ab41600b0 msgr2=0x7f4ab40b2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:48.346 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.344+0000 7f4abc532640 1 --2- 172.21.15.105:0/1326501911 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ab41600b0 0x7f4ab40b2f10 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f4aac00ba10 tx=0x7f4aac00bed0 comp rx=0 tx=0).stop 2024-09-21T03:26:48.346 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.344+0000 7f4abc532640 1 -- 172.21.15.105:0/1326501911 shutdown_connections 2024-09-21T03:26:48.346 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.344+0000 7f4abc532640 1 --2- 172.21.15.105:0/1326501911 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4a98078b90 0x7f4a9807b0a0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:48.347 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.344+0000 7f4abc532640 1 --2- 172.21.15.105:0/1326501911 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ab41600b0 0x7f4ab40b2f10 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:48.347 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.344+0000 7f4abc532640 1 --2- 172.21.15.105:0/1326501911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ab40cf320 0x7f4ab40cbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:48.347 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.344+0000 7f4abc532640 1 --2- 172.21.15.105:0/1326501911 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ab40b7cc0 0x7f4ab40cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:48.347 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.344+0000 7f4abc532640 1 -- 172.21.15.105:0/1326501911 >> 172.21.15.105:0/1326501911 conn(0x7f4ab406d4f0 msgr2=0x7f4ab415e940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:48.347 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.344+0000 7f4abc532640 1 -- 172.21.15.105:0/1326501911 shutdown_connections 2024-09-21T03:26:48.347 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.344+0000 7f4abc532640 1 -- 172.21.15.105:0/1326501911 wait complete. 2024-09-21T03:26:48.357 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:26:48.357 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:26:48.373 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:26:48.462 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:26:48.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:26:48.469 INFO:teuthology.orchestra.run.smithi105.stdout:client8169 2024-09-21T03:26:48.469 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:26:48.469 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:26:48.485 DEBUG:teuthology.orchestra.run.smithi105:> stdin-killer -- python3 -c ' 2024-09-21T03:26:48.486 DEBUG:teuthology.orchestra.run.smithi105:> import fcntl 2024-09-21T03:26:48.486 DEBUG:teuthology.orchestra.run.smithi105:> import sys 2024-09-21T03:26:48.486 DEBUG:teuthology.orchestra.run.smithi105:> import time 2024-09-21T03:26:48.486 DEBUG:teuthology.orchestra.run.smithi105:> import os 2024-09-21T03:26:48.486 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-21T03:26:48.486 DEBUG:teuthology.orchestra.run.smithi105:> fcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK) 2024-09-21T03:26:48.486 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-21T03:26:48.486 DEBUG:teuthology.orchestra.run.smithi105:> n = 400 2024-09-21T03:26:48.486 DEBUG:teuthology.orchestra.run.smithi105:> abs_path = "/home/ubuntu/cephtest/mnt.0/." 2024-09-21T03:26:48.486 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-21T03:26:48.486 DEBUG:teuthology.orchestra.run.smithi105:> if not os.path.exists(abs_path): 2024-09-21T03:26:48.486 DEBUG:teuthology.orchestra.run.smithi105:> os.makedirs(abs_path) 2024-09-21T03:26:48.486 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-21T03:26:48.487 DEBUG:teuthology.orchestra.run.smithi105:> handles = [] 2024-09-21T03:26:48.487 DEBUG:teuthology.orchestra.run.smithi105:> for i in range(0, n): 2024-09-21T03:26:48.487 DEBUG:teuthology.orchestra.run.smithi105:> fname = "file_"+str(i) 2024-09-21T03:26:48.487 DEBUG:teuthology.orchestra.run.smithi105:> path = os.path.join(abs_path, fname) 2024-09-21T03:26:48.487 DEBUG:teuthology.orchestra.run.smithi105:> handles.append(open(path, '"'"'w'"'"')) 2024-09-21T03:26:48.487 DEBUG:teuthology.orchestra.run.smithi105:> 2024-09-21T03:26:48.487 DEBUG:teuthology.orchestra.run.smithi105:> print("waiting with handles open", file=sys.stderr) 2024-09-21T03:26:48.487 DEBUG:teuthology.orchestra.run.smithi105:> while True: 2024-09-21T03:26:48.487 DEBUG:teuthology.orchestra.run.smithi105:> print("open_n_background: keeping files open", file=sys.stderr) 2024-09-21T03:26:48.487 DEBUG:teuthology.orchestra.run.smithi105:> try: 2024-09-21T03:26:48.487 DEBUG:teuthology.orchestra.run.smithi105:> if os.read(0, 4096) == b"": 2024-09-21T03:26:48.487 DEBUG:teuthology.orchestra.run.smithi105:> break 2024-09-21T03:26:48.487 DEBUG:teuthology.orchestra.run.smithi105:> except BlockingIOError: 2024-09-21T03:26:48.487 DEBUG:teuthology.orchestra.run.smithi105:> pass 2024-09-21T03:26:48.487 DEBUG:teuthology.orchestra.run.smithi105:> time.sleep(2) 2024-09-21T03:26:48.488 DEBUG:teuthology.orchestra.run.smithi105:> print("stdin closed, goodbye!", file=sys.stderr) 2024-09-21T03:26:48.488 DEBUG:teuthology.orchestra.run.smithi105:> ' 2024-09-21T03:26:48.528 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:26:48.643 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.641+0000 7fe96b932640 1 -- 172.21.15.105:0/3954626678 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe96409aa30 msgr2=0x7fe9640ccad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:48.643 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.641+0000 7fe96b932640 1 --2- 172.21.15.105:0/3954626678 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe96409aa30 0x7fe9640ccad0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fe95c005fd0 tx=0x7fe95c02aa90 comp rx=0 tx=0).stop 2024-09-21T03:26:48.643 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.641+0000 7fe96b932640 1 -- 172.21.15.105:0/3954626678 shutdown_connections 2024-09-21T03:26:48.643 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.641+0000 7fe96b932640 1 --2- 172.21.15.105:0/3954626678 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe96409aa30 0x7fe9640ccad0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:48.643 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.641+0000 7fe96b932640 1 --2- 172.21.15.105:0/3954626678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9640cf520 0x7fe9640ae1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:48.643 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.641+0000 7fe96b932640 1 -- 172.21.15.105:0/3954626678 >> 172.21.15.105:0/3954626678 conn(0x7fe964074170 msgr2=0x7fe9640b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:48.643 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.641+0000 7fe96b932640 1 -- 172.21.15.105:0/3954626678 shutdown_connections 2024-09-21T03:26:48.644 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.641+0000 7fe96b932640 1 -- 172.21.15.105:0/3954626678 wait complete. 2024-09-21T03:26:48.644 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.643+0000 7fe96b932640 1 Processor -- start 2024-09-21T03:26:48.644 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.643+0000 7fe96b932640 1 -- start start 2024-09-21T03:26:48.647 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.644+0000 7fe96b932640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe96409aa30 0x7fe9641f95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:48.647 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.644+0000 7fe96b932640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe96415b900 0x7fe9640712f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:48.647 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.644+0000 7fe96b932640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe96415e950 0x7fe964071830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:48.647 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.644+0000 7fe96b932640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe9640cd190 con 0x7fe96415b900 2024-09-21T03:26:48.647 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.644+0000 7fe96b932640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe9640cd010 con 0x7fe96409aa30 2024-09-21T03:26:48.647 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.644+0000 7fe96b932640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe9640cd310 con 0x7fe96415e950 2024-09-21T03:26:48.647 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.644+0000 7fe968ecd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe96415b900 0x7fe9640712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:48.647 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.644+0000 7fe968ecd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe96415b900 0x7fe9640712f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:46496/0 (socket says 172.21.15.105:46496) 2024-09-21T03:26:48.647 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.644+0000 7fe968ecd640 1 -- 172.21.15.105:0/1937087525 learned_addr learned my addr 172.21.15.105:0/1937087525 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:48.647 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.644+0000 7fe969ecf640 1 --2- 172.21.15.105:0/1937087525 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe96415e950 0x7fe964071830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:48.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.644+0000 7fe9696ce640 1 --2- 172.21.15.105:0/1937087525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe96409aa30 0x7fe9641f95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:48.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.644+0000 7fe968ecd640 1 -- 172.21.15.105:0/1937087525 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe96415e950 msgr2=0x7fe964071830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:48.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.644+0000 7fe968ecd640 1 --2- 172.21.15.105:0/1937087525 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe96415e950 0x7fe964071830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:48.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.644+0000 7fe968ecd640 1 -- 172.21.15.105:0/1937087525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe96409aa30 msgr2=0x7fe9641f95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:48.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.644+0000 7fe968ecd640 1 --2- 172.21.15.105:0/1937087525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe96409aa30 0x7fe9641f95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:48.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.644+0000 7fe968ecd640 1 -- 172.21.15.105:0/1937087525 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9641f55e0 con 0x7fe96415b900 2024-09-21T03:26:48.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.645+0000 7fe968ecd640 1 --2- 172.21.15.105:0/1937087525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe96415b900 0x7fe9640712f0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fe95800e7f0 tx=0x7fe95800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:48.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.645+0000 7fe955ffb640 1 -- 172.21.15.105:0/1937087525 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe95800eea0 con 0x7fe96415b900 2024-09-21T03:26:48.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.645+0000 7fe955ffb640 1 -- 172.21.15.105:0/1937087525 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe95800cdb0 con 0x7fe96415b900 2024-09-21T03:26:48.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.645+0000 7fe96b932640 1 -- 172.21.15.105:0/1937087525 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9641e68c0 con 0x7fe96415b900 2024-09-21T03:26:48.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.645+0000 7fe955ffb640 1 -- 172.21.15.105:0/1937087525 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe958010690 con 0x7fe96415b900 2024-09-21T03:26:48.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.645+0000 7fe96b932640 1 -- 172.21.15.105:0/1937087525 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9641f5b80 con 0x7fe96415b900 2024-09-21T03:26:48.649 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.646+0000 7fe96b932640 1 -- 172.21.15.105:0/1937087525 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9640ccad0 con 0x7fe96415b900 2024-09-21T03:26:48.649 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.647+0000 7fe955ffb640 1 -- 172.21.15.105:0/1937087525 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe958010830 con 0x7fe96415b900 2024-09-21T03:26:48.649 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.647+0000 7fe955ffb640 1 --2- 172.21.15.105:0/1937087525 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe948078b90 0x7fe94807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:48.649 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.647+0000 7fe955ffb640 1 -- 172.21.15.105:0/1937087525 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7fe95809b550 con 0x7fe96415b900 2024-09-21T03:26:48.649 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.648+0000 7fe9696ce640 1 --2- 172.21.15.105:0/1937087525 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe948078b90 0x7fe94807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:48.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.648+0000 7fe9696ce640 1 --2- 172.21.15.105:0/1937087525 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe948078b90 0x7fe94807b0a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fe960001720 tx=0x7fe960009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:48.653 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.652+0000 7fe955ffb640 1 -- 172.21.15.105:0/1937087525 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe9580633d0 con 0x7fe96415b900 2024-09-21T03:26:48.876 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.874+0000 7fe96b932640 1 -- 172.21.15.105:0/1937087525 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe9641e6650 con 0x7fe96415b900 2024-09-21T03:26:48.876 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.875+0000 7fe955ffb640 1 -- 172.21.15.105:0/1937087525 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) ==== 94+0+5233 (secure 0 0 0) 0x7fe958067e00 con 0x7fe96415b900 2024-09-21T03:26:48.877 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:26:48.877 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":84,"btime":"2024-09-21T03:26:36:777245+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6494,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2298697835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2298697835},{"type":"v1","addr":"172.21.15.162:6836","nonce":2298697835}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":6500,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/680091076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":680091076},{"type":"v1","addr":"172.21.15.105:6835","nonce":680091076}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8013,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/4094879618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":4094879618},{"type":"v1","addr":"172.21.15.105:6833","nonce":4094879618}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:26:33.112228+0000","modified":"2024-09-21T03:26:36.139331+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8022},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8022":{"gid":8022,"name":"b","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6837/712373587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":712373587},{"type":"v1","addr":"172.21.15.162:6837","nonce":712373587}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8022,"qdb_cluster":[8022]},"id":10}]} 2024-09-21T03:26:48.877 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 84 2024-09-21T03:26:48.879 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.877+0000 7fe96b932640 1 -- 172.21.15.105:0/1937087525 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe948078b90 msgr2=0x7fe94807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:48.879 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.877+0000 7fe96b932640 1 --2- 172.21.15.105:0/1937087525 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe948078b90 0x7fe94807b0a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fe960001720 tx=0x7fe960009040 comp rx=0 tx=0).stop 2024-09-21T03:26:48.879 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.877+0000 7fe96b932640 1 -- 172.21.15.105:0/1937087525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe96415b900 msgr2=0x7fe9640712f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:48.879 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.877+0000 7fe96b932640 1 --2- 172.21.15.105:0/1937087525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe96415b900 0x7fe9640712f0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fe95800e7f0 tx=0x7fe95800ecb0 comp rx=0 tx=0).stop 2024-09-21T03:26:48.879 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.877+0000 7fe96b932640 1 -- 172.21.15.105:0/1937087525 shutdown_connections 2024-09-21T03:26:48.880 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.877+0000 7fe96b932640 1 --2- 172.21.15.105:0/1937087525 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe948078b90 0x7fe94807b0a0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:48.880 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.877+0000 7fe96b932640 1 --2- 172.21.15.105:0/1937087525 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe96415e950 0x7fe964071830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:48.880 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.878+0000 7fe96b932640 1 --2- 172.21.15.105:0/1937087525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe96415b900 0x7fe9640712f0 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:48.880 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.878+0000 7fe96b932640 1 --2- 172.21.15.105:0/1937087525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe96409aa30 0x7fe9641f95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:48.880 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.878+0000 7fe96b932640 1 -- 172.21.15.105:0/1937087525 >> 172.21.15.105:0/1937087525 conn(0x7fe964074170 msgr2=0x7fe9640b2640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:48.880 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.878+0000 7fe96b932640 1 -- 172.21.15.105:0/1937087525 shutdown_connections 2024-09-21T03:26:48.880 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:48.878+0000 7fe96b932640 1 -- 172.21.15.105:0/1937087525 wait complete. 2024-09-21T03:26:48.891 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json session ls 2024-09-21T03:26:48.918 INFO:teuthology.orchestra.run.smithi105.stderr:waiting with handles open 2024-09-21T03:26:48.918 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:26:49.019 INFO:teuthology.orchestra.run.smithi162.stdout:[{"id":8181,"entity":{"name":{"type":"client","num":8181},"addr":{"type":"v1","addr":"172.21.15.162:0","nonce":3532941168}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":3.0429373879999999,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.9910702639614035,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.8181 v1:172.21.15.162:0/3532941168","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi162","kernel_version":"5.14.0-508.el9.x86_64","root":"/"}},{"id":8169,"entity":{"name":{"type":"client","num":8169},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":934085144}},"state":"open","num_leases":400,"num_caps":401,"request_load_avg":424,"uptime":4.1649143000000004,"requests_in_flight":399,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":122.66653606133627,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":110.3429818625936,"halflife":1.5},"recall_caps_throttle2o":{"value":88.802240863475205,"halflife":0.5},"session_cache_liveness":{"value":1201.2826510186412,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":29,"last_trim_completed_flushes_tid":0,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.8169 v1:192.168.0.1:0/934085144","completed_requests":[],"prealloc_inos":[{"start":"0x10000000001","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi105","kernel_version":"5.14.0-508.el9.x86_64","root":"/"}}] 2024-09-21T03:26:49.020 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi162", "kernel_version": "5.14.0-508.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.162:0", "nonce": 3532941168, "type": "v1" }, "name": { "num": 8181, "type": "client" } }, "id": 8181, "inst": "client.8181 v1:172.21.15.162:0/3532941168", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.9910702639614035 }, "state": "open", "uptime": 3.042937388 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi105", "kernel_version": "5.14.0-508.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 934085144, "type": "v1" }, "name": { "num": 8169, "type": "client" } }, "id": 8169, "inst": "client.8169 v1:192.168.0.1:0/934085144", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 29, "num_caps": 401, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 400, "prealloc_inos": [ { "length": 1000, "start": "0x10000000001" } ], "recall_caps": { "halflife": 60, "value": 122.66653606133627 }, "recall_caps_throttle": { "halflife": 1.5, "value": 110.3429818625936 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 88.8022408634752 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 424, "requests_in_flight": 399, "session_cache_liveness": { "halflife": 300, "value": 1201.2826510186412 }, "state": "open", "uptime": 4.1649143 } ] 2024-09-21T03:26:49.020 INFO:tasks.ceph_test_case:waiting 120.0s for health warning matching MDS_CLIENT_RECALL 2024-09-21T03:26:49.020 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T03:26:49.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.134+0000 7f7fe869b640 1 -- 172.21.15.105:0/3427986084 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fe015c770 msgr2=0x7f7fe006d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:49.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.134+0000 7f7fe869b640 1 --2- 172.21.15.105:0/3427986084 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fe015c770 0x7f7fe006d7f0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0009900 tx=0x7f7fd002a580 comp rx=0 tx=0).stop 2024-09-21T03:26:49.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.134+0000 7f7fe869b640 1 -- 172.21.15.105:0/3427986084 shutdown_connections 2024-09-21T03:26:49.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.134+0000 7f7fe869b640 1 --2- 172.21.15.105:0/3427986084 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fe015c770 0x7f7fe006d7f0 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:49.136 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.134+0000 7f7fe869b640 1 --2- 172.21.15.105:0/3427986084 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fe00af6a0 0x7f7fe00ce5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:49.137 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.134+0000 7f7fe869b640 1 -- 172.21.15.105:0/3427986084 >> 172.21.15.105:0/3427986084 conn(0x7f7fe00cd480 msgr2=0x7f7fe00cd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:49.137 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.134+0000 7f7fe869b640 1 -- 172.21.15.105:0/3427986084 shutdown_connections 2024-09-21T03:26:49.137 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.134+0000 7f7fe869b640 1 -- 172.21.15.105:0/3427986084 wait complete. 2024-09-21T03:26:49.137 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.136+0000 7f7fe869b640 1 Processor -- start 2024-09-21T03:26:49.137 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.136+0000 7f7fe869b640 1 -- start start 2024-09-21T03:26:49.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.137+0000 7f7fe869b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fe00af6a0 0x7f7fe01f2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:49.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.137+0000 7f7fe869b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fe00afbf0 0x7f7fe015dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:49.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.137+0000 7f7fe869b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fe015c770 0x7f7fe014b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:49.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.137+0000 7f7fe869b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe0160b20 con 0x7f7fe00afbf0 2024-09-21T03:26:49.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.137+0000 7f7fe869b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe006dd30 con 0x7f7fe00af6a0 2024-09-21T03:26:49.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.137+0000 7f7fe869b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7fe014a570 con 0x7f7fe015c770 2024-09-21T03:26:49.140 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.137+0000 7f7fe5c36640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fe00afbf0 0x7f7fe015dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:49.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.137+0000 7f7fe5c36640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fe00afbf0 0x7f7fe015dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:46510/0 (socket says 172.21.15.105:46510) 2024-09-21T03:26:49.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.137+0000 7f7fe5c36640 1 -- 172.21.15.105:0/2034264677 learned_addr learned my addr 172.21.15.105:0/2034264677 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:49.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.137+0000 7f7fe6437640 1 --2- 172.21.15.105:0/2034264677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fe00af6a0 0x7f7fe01f2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:49.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.137+0000 7f7fe6c38640 1 --2- 172.21.15.105:0/2034264677 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fe015c770 0x7f7fe014b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:49.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.138+0000 7f7fe5c36640 1 -- 172.21.15.105:0/2034264677 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fe015c770 msgr2=0x7f7fe014b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:49.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.138+0000 7f7fe5c36640 1 --2- 172.21.15.105:0/2034264677 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fe015c770 0x7f7fe014b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:49.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.138+0000 7f7fe5c36640 1 -- 172.21.15.105:0/2034264677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fe00af6a0 msgr2=0x7f7fe01f2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:49.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.138+0000 7f7fe5c36640 1 --2- 172.21.15.105:0/2034264677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fe00af6a0 0x7f7fe01f2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:49.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.138+0000 7f7fe5c36640 1 -- 172.21.15.105:0/2034264677 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe015e7d0 con 0x7f7fe00afbf0 2024-09-21T03:26:49.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.138+0000 7f7fe5c36640 1 --2- 172.21.15.105:0/2034264677 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fe00afbf0 0x7f7fe015dcd0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0000c00 tx=0x7f7fd0003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:49.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.138+0000 7f7fd6ffd640 1 -- 172.21.15.105:0/2034264677 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd003e030 con 0x7f7fe00afbf0 2024-09-21T03:26:49.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.138+0000 7f7fd6ffd640 1 -- 172.21.15.105:0/2034264677 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7fd0003d10 con 0x7f7fe00afbf0 2024-09-21T03:26:49.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.138+0000 7f7fd6ffd640 1 -- 172.21.15.105:0/2034264677 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0035040 con 0x7f7fe00afbf0 2024-09-21T03:26:49.142 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.138+0000 7f7fe869b640 1 -- 172.21.15.105:0/2034264677 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fe015eab0 con 0x7f7fe00afbf0 2024-09-21T03:26:49.142 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.138+0000 7f7fe869b640 1 -- 172.21.15.105:0/2034264677 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fe015f070 con 0x7f7fe00afbf0 2024-09-21T03:26:49.142 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.139+0000 7f7fe869b640 1 -- 172.21.15.105:0/2034264677 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fe015e4f0 con 0x7f7fe00afbf0 2024-09-21T03:26:49.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.140+0000 7f7fd6ffd640 1 -- 172.21.15.105:0/2034264677 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7fd0041030 con 0x7f7fe00afbf0 2024-09-21T03:26:49.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.140+0000 7f7fd6ffd640 1 --2- 172.21.15.105:0/2034264677 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7fc4078b90 0x7f7fc407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:49.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.141+0000 7f7fd6ffd640 1 -- 172.21.15.105:0/2034264677 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7f7fd00bb380 con 0x7f7fe00afbf0 2024-09-21T03:26:49.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.141+0000 7f7fe6437640 1 --2- 172.21.15.105:0/2034264677 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7fc4078b90 0x7f7fc407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:49.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.141+0000 7f7fe6437640 1 --2- 172.21.15.105:0/2034264677 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7fc4078b90 0x7f7fc407b0a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc009b30 tx=0x7f7fdc005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:49.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.145+0000 7f7fd6ffd640 1 -- 172.21.15.105:0/2034264677 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7fd0083180 con 0x7f7fe00afbf0 2024-09-21T03:26:49.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.361+0000 7f7fe869b640 1 -- 172.21.15.105:0/2034264677 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7fe00ce5b0 con 0x7f7fe00afbf0 2024-09-21T03:26:49.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.361+0000 7f7fd6ffd640 1 -- 172.21.15.105:0/2034264677 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f7fd0087bb0 con 0x7f7fe00afbf0 2024-09-21T03:26:49.363 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:26:49.363 INFO:teuthology.orchestra.run.smithi105.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T03:26:49.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.364+0000 7f7fe869b640 1 -- 172.21.15.105:0/2034264677 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7fc4078b90 msgr2=0x7f7fc407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:49.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.364+0000 7f7fe869b640 1 --2- 172.21.15.105:0/2034264677 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7fc4078b90 0x7f7fc407b0a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc009b30 tx=0x7f7fdc005f90 comp rx=0 tx=0).stop 2024-09-21T03:26:49.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.364+0000 7f7fe869b640 1 -- 172.21.15.105:0/2034264677 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fe00afbf0 msgr2=0x7f7fe015dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:49.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.364+0000 7f7fe869b640 1 --2- 172.21.15.105:0/2034264677 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fe00afbf0 0x7f7fe015dcd0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0000c00 tx=0x7f7fd0003820 comp rx=0 tx=0).stop 2024-09-21T03:26:49.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.364+0000 7f7fe869b640 1 -- 172.21.15.105:0/2034264677 shutdown_connections 2024-09-21T03:26:49.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.364+0000 7f7fe869b640 1 --2- 172.21.15.105:0/2034264677 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7fc4078b90 0x7f7fc407b0a0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:49.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.364+0000 7f7fe869b640 1 --2- 172.21.15.105:0/2034264677 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fe015c770 0x7f7fe014b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:49.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.364+0000 7f7fe869b640 1 --2- 172.21.15.105:0/2034264677 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fe00afbf0 0x7f7fe015dcd0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:49.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.364+0000 7f7fe869b640 1 --2- 172.21.15.105:0/2034264677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fe00af6a0 0x7f7fe01f2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:49.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.364+0000 7f7fe869b640 1 -- 172.21.15.105:0/2034264677 >> 172.21.15.105:0/2034264677 conn(0x7f7fe00cd480 msgr2=0x7f7fe0159180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:49.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.364+0000 7f7fe869b640 1 -- 172.21.15.105:0/2034264677 shutdown_connections 2024-09-21T03:26:49.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:49.364+0000 7f7fe869b640 1 -- 172.21.15.105:0/2034264677 wait complete. 2024-09-21T03:26:49.377 DEBUG:tasks.ceph_test_case:Not expected number of summary strings ([]) 2024-09-21T03:26:49.377 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-21T03:26:50.920 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:26:52.922 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:26:54.378 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T03:26:54.506 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.504+0000 7f7b6220a640 1 -- 172.21.15.105:0/304023542 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b5c0af780 msgr2=0x7f7b5c0b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:54.506 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.504+0000 7f7b6220a640 1 --2- 172.21.15.105:0/304023542 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b5c0af780 0x7f7b5c0b39c0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c005fd0 tx=0x7f7b4c02a5d0 comp rx=0 tx=0).stop 2024-09-21T03:26:54.506 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.504+0000 7f7b6220a640 1 -- 172.21.15.105:0/304023542 shutdown_connections 2024-09-21T03:26:54.506 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.504+0000 7f7b6220a640 1 --2- 172.21.15.105:0/304023542 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b5c0af780 0x7f7b5c0b39c0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:54.506 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.504+0000 7f7b6220a640 1 -- 172.21.15.105:0/304023542 >> 172.21.15.105:0/304023542 conn(0x7f7b5c06d7d0 msgr2=0x7f7b5c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:54.506 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.504+0000 7f7b6220a640 1 -- 172.21.15.105:0/304023542 shutdown_connections 2024-09-21T03:26:54.506 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.504+0000 7f7b6220a640 1 -- 172.21.15.105:0/304023542 wait complete. 2024-09-21T03:26:54.507 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.506+0000 7f7b6220a640 1 Processor -- start 2024-09-21T03:26:54.507 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.506+0000 7f7b6220a640 1 -- start start 2024-09-21T03:26:54.510 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.507+0000 7f7b6220a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b5c072ff0 0x7f7b5c158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:54.510 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.507+0000 7f7b6220a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b5c0af780 0x7f7b5c1586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:54.510 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.507+0000 7f7b6220a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b5c0cd3e0 0x7f7b5c14f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:54.510 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.507+0000 7f7b6220a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5c166bf0 con 0x7f7b5c072ff0 2024-09-21T03:26:54.511 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.507+0000 7f7b6220a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5c0cda00 con 0x7f7b5c0af780 2024-09-21T03:26:54.511 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.507+0000 7f7b6220a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7b5c166d70 con 0x7f7b5c0cd3e0 2024-09-21T03:26:54.511 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.507+0000 7f7b5b7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b5c072ff0 0x7f7b5c158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:54.511 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.507+0000 7f7b5b7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b5c072ff0 0x7f7b5c158190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51902/0 (socket says 172.21.15.105:51902) 2024-09-21T03:26:54.511 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.507+0000 7f7b5b7fe640 1 -- 172.21.15.105:0/2248061830 learned_addr learned my addr 172.21.15.105:0/2248061830 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:54.511 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.507+0000 7f7b5affd640 1 --2- 172.21.15.105:0/2248061830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b5c0af780 0x7f7b5c1586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:54.511 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.507+0000 7f7b5bfff640 1 --2- 172.21.15.105:0/2248061830 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b5c0cd3e0 0x7f7b5c14f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:54.511 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.507+0000 7f7b5b7fe640 1 -- 172.21.15.105:0/2248061830 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b5c0cd3e0 msgr2=0x7f7b5c14f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:54.511 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.507+0000 7f7b5b7fe640 1 --2- 172.21.15.105:0/2248061830 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b5c0cd3e0 0x7f7b5c14f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:54.511 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.507+0000 7f7b5b7fe640 1 -- 172.21.15.105:0/2248061830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b5c0af780 msgr2=0x7f7b5c1586d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:54.511 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.507+0000 7f7b5b7fe640 1 --2- 172.21.15.105:0/2248061830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b5c0af780 0x7f7b5c1586d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:54.511 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.507+0000 7f7b5b7fe640 1 -- 172.21.15.105:0/2248061830 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b5c1415b0 con 0x7f7b5c072ff0 2024-09-21T03:26:54.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.507+0000 7f7b5bfff640 1 --2- 172.21.15.105:0/2248061830 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b5c0cd3e0 0x7f7b5c14f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:26:54.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.508+0000 7f7b5b7fe640 1 --2- 172.21.15.105:0/2248061830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b5c072ff0 0x7f7b5c158190 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c034040 tx=0x7f7b4c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:54.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.508+0000 7f7b43fff640 1 -- 172.21.15.105:0/2248061830 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c03e030 con 0x7f7b5c072ff0 2024-09-21T03:26:54.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.508+0000 7f7b43fff640 1 -- 172.21.15.105:0/2248061830 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b4c003ca0 con 0x7f7b5c072ff0 2024-09-21T03:26:54.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.508+0000 7f7b6220a640 1 -- 172.21.15.105:0/2248061830 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b5c09d7a0 con 0x7f7b5c072ff0 2024-09-21T03:26:54.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.508+0000 7f7b43fff640 1 -- 172.21.15.105:0/2248061830 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c035040 con 0x7f7b5c072ff0 2024-09-21T03:26:54.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.508+0000 7f7b6220a640 1 -- 172.21.15.105:0/2248061830 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b5c1f73e0 con 0x7f7b5c072ff0 2024-09-21T03:26:54.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.509+0000 7f7b6220a640 1 -- 172.21.15.105:0/2248061830 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b5c0b39c0 con 0x7f7b5c072ff0 2024-09-21T03:26:54.513 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.510+0000 7f7b43fff640 1 -- 172.21.15.105:0/2248061830 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7b4c041030 con 0x7f7b5c072ff0 2024-09-21T03:26:54.513 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.510+0000 7f7b43fff640 1 --2- 172.21.15.105:0/2248061830 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7b48078b90 0x7f7b4807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:54.513 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.510+0000 7f7b43fff640 1 -- 172.21.15.105:0/2248061830 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7f7b4c0bb480 con 0x7f7b5c072ff0 2024-09-21T03:26:54.513 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.510+0000 7f7b5affd640 1 --2- 172.21.15.105:0/2248061830 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7b48078b90 0x7f7b4807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:54.513 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.511+0000 7f7b5affd640 1 --2- 172.21.15.105:0/2248061830 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7b48078b90 0x7f7b4807b0a0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c0afe40 tx=0x7f7b50009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:54.516 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.515+0000 7f7b43fff640 1 -- 172.21.15.105:0/2248061830 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7b4c0838c0 con 0x7f7b5c072ff0 2024-09-21T03:26:54.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.726+0000 7f7b6220a640 1 -- 172.21.15.105:0/2248061830 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7b5c157ab0 con 0x7f7b5c072ff0 2024-09-21T03:26:54.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.726+0000 7f7b43fff640 1 -- 172.21.15.105:0/2248061830 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f7b4c0831c0 con 0x7f7b5c072ff0 2024-09-21T03:26:54.728 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:26:54.728 INFO:teuthology.orchestra.run.smithi105.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-21T03:26:54.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.728+0000 7f7b6220a640 1 -- 172.21.15.105:0/2248061830 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7b48078b90 msgr2=0x7f7b4807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:54.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.728+0000 7f7b6220a640 1 --2- 172.21.15.105:0/2248061830 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7b48078b90 0x7f7b4807b0a0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c0afe40 tx=0x7f7b50009040 comp rx=0 tx=0).stop 2024-09-21T03:26:54.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.728+0000 7f7b6220a640 1 -- 172.21.15.105:0/2248061830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b5c072ff0 msgr2=0x7f7b5c158190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:54.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.728+0000 7f7b6220a640 1 --2- 172.21.15.105:0/2248061830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b5c072ff0 0x7f7b5c158190 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c034040 tx=0x7f7b4c0038a0 comp rx=0 tx=0).stop 2024-09-21T03:26:54.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.728+0000 7f7b6220a640 1 -- 172.21.15.105:0/2248061830 shutdown_connections 2024-09-21T03:26:54.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.728+0000 7f7b6220a640 1 --2- 172.21.15.105:0/2248061830 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7b48078b90 0x7f7b4807b0a0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:54.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.728+0000 7f7b6220a640 1 --2- 172.21.15.105:0/2248061830 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b5c0cd3e0 0x7f7b5c14f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:54.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.728+0000 7f7b6220a640 1 --2- 172.21.15.105:0/2248061830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b5c0af780 0x7f7b5c1586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:54.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.728+0000 7f7b6220a640 1 --2- 172.21.15.105:0/2248061830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b5c072ff0 0x7f7b5c158190 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:54.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.728+0000 7f7b6220a640 1 -- 172.21.15.105:0/2248061830 >> 172.21.15.105:0/2248061830 conn(0x7f7b5c06d7d0 msgr2=0x7f7b5c070180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:54.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.728+0000 7f7b6220a640 1 -- 172.21.15.105:0/2248061830 shutdown_connections 2024-09-21T03:26:54.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:54.728+0000 7f7b6220a640 1 -- 172.21.15.105:0/2248061830 wait complete. 2024-09-21T03:26:54.741 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-21T03:26:54.741 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-21T03:26:54.924 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:26:56.927 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:26:57.702 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:26:57.705 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:26:58.929 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:26:59.743 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T03:26:59.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:59.867+0000 7f4d084f9640 1 -- 172.21.15.105:0/3627786193 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d000cfb00 msgr2=0x7f4d0015bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:59.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:59.867+0000 7f4d084f9640 1 --2- 172.21.15.105:0/3627786193 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d000cfb00 0x7f4d0015bf20 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc009830 tx=0x7f4cfc02a510 comp rx=0 tx=0).stop 2024-09-21T03:26:59.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:59.867+0000 7f4d084f9640 1 -- 172.21.15.105:0/3627786193 shutdown_connections 2024-09-21T03:26:59.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:59.867+0000 7f4d084f9640 1 --2- 172.21.15.105:0/3627786193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d000cb0b0 0x7f4d0006ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:59.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:59.867+0000 7f4d084f9640 1 --2- 172.21.15.105:0/3627786193 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d000cfb00 0x7f4d0015bf20 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:59.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:59.867+0000 7f4d084f9640 1 -- 172.21.15.105:0/3627786193 >> 172.21.15.105:0/3627786193 conn(0x7f4d000b1cb0 msgr2=0x7f4d000b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:59.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:59.867+0000 7f4d084f9640 1 -- 172.21.15.105:0/3627786193 shutdown_connections 2024-09-21T03:26:59.869 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:59.867+0000 7f4d084f9640 1 -- 172.21.15.105:0/3627786193 wait complete. 2024-09-21T03:26:59.870 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:59.869+0000 7f4d084f9640 1 Processor -- start 2024-09-21T03:26:59.870 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:59.869+0000 7f4d084f9640 1 -- start start 2024-09-21T03:26:59.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:59.870+0000 7f4d084f9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d000cf160 0x7f4d000ae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:59.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:59.870+0000 7f4d084f9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d000cfb00 0x7f4d000ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:59.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:59.870+0000 7f4d084f9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d0015a6f0 0x7f4d0015c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:59.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:59.870+0000 7f4d084f9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0006f3d0 con 0x7f4d0015a6f0 2024-09-21T03:26:59.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:59.870+0000 7f4d084f9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4d000cf780 con 0x7f4d000cfb00 2024-09-21T03:26:59.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:59.870+0000 7f4d084f9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4d0006f550 con 0x7f4d000cf160 2024-09-21T03:26:59.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:59.870+0000 7f4d06a96640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d0015a6f0 0x7f4d0015c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:59.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:59.870+0000 7f4d06a96640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d0015a6f0 0x7f4d0015c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51920/0 (socket says 172.21.15.105:51920) 2024-09-21T03:26:59.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:59.870+0000 7f4d06a96640 1 -- 172.21.15.105:0/1943042039 learned_addr learned my addr 172.21.15.105:0/1943042039 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:26:59.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:59.870+0000 7f4d06295640 1 --2- 172.21.15.105:0/1943042039 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d000cf160 0x7f4d000ae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:59.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:59.870+0000 7f4d05a94640 1 --2- 172.21.15.105:0/1943042039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d000cfb00 0x7f4d000ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:59.873 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:59.870+0000 7f4d06a96640 1 -- 172.21.15.105:0/1943042039 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d000cf160 msgr2=0x7f4d000ae0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:59.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:59.870+0000 7f4d06a96640 1 --2- 172.21.15.105:0/1943042039 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d000cf160 0x7f4d000ae0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:59.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:59.870+0000 7f4d06a96640 1 -- 172.21.15.105:0/1943042039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d000cfb00 msgr2=0x7f4d000ae5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:59.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:59.870+0000 7f4d06a96640 1 --2- 172.21.15.105:0/1943042039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d000cfb00 0x7f4d000ae5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:59.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:59.870+0000 7f4d06a96640 1 -- 172.21.15.105:0/1943042039 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d001f1e30 con 0x7f4d0015a6f0 2024-09-21T03:26:59.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:59.871+0000 7f4d06a96640 1 --2- 172.21.15.105:0/1943042039 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d0015a6f0 0x7f4d0015c580 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f4cf800cad0 tx=0x7f4cf800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:59.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:59.871+0000 7f4cf6ffd640 1 -- 172.21.15.105:0/1943042039 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf800ae20 con 0x7f4d0015a6f0 2024-09-21T03:26:59.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:59.871+0000 7f4cf6ffd640 1 -- 172.21.15.105:0/1943042039 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4cf800f540 con 0x7f4d0015a6f0 2024-09-21T03:26:59.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:59.871+0000 7f4cf6ffd640 1 -- 172.21.15.105:0/1943042039 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf800f990 con 0x7f4d0015a6f0 2024-09-21T03:26:59.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:59.871+0000 7f4d084f9640 1 -- 172.21.15.105:0/1943042039 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d001f20f0 con 0x7f4d0015a6f0 2024-09-21T03:26:59.874 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:59.871+0000 7f4d084f9640 1 -- 172.21.15.105:0/1943042039 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d001f26b0 con 0x7f4d0015a6f0 2024-09-21T03:26:59.875 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:59.872+0000 7f4d084f9640 1 -- 172.21.15.105:0/1943042039 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d0015acd0 con 0x7f4d0015a6f0 2024-09-21T03:26:59.875 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:59.873+0000 7f4cf6ffd640 1 -- 172.21.15.105:0/1943042039 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4cf800fb30 con 0x7f4d0015a6f0 2024-09-21T03:26:59.875 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:59.873+0000 7f4cf6ffd640 1 --2- 172.21.15.105:0/1943042039 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4ce4078b90 0x7f4ce407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:59.875 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:59.873+0000 7f4cf6ffd640 1 -- 172.21.15.105:0/1943042039 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7f4cf809b790 con 0x7f4d0015a6f0 2024-09-21T03:26:59.875 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:59.873+0000 7f4d06295640 1 --2- 172.21.15.105:0/1943042039 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4ce4078b90 0x7f4ce407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:59.876 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:59.874+0000 7f4d06295640 1 --2- 172.21.15.105:0/1943042039 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4ce4078b90 0x7f4ce407b0a0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc034000 tx=0x7f4cfc004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:59.879 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:26:59.878+0000 7f4cf6ffd640 1 -- 172.21.15.105:0/1943042039 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4cf8014030 con 0x7f4d0015a6f0 2024-09-21T03:27:00.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.091+0000 7f4d084f9640 1 -- 172.21.15.105:0/1943042039 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4d0015a3c0 con 0x7f4d0015a6f0 2024-09-21T03:27:00.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.092+0000 7f4cf6ffd640 1 -- 172.21.15.105:0/1943042039 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+316 (secure 0 0 0) 0x7f4cf800fe20 con 0x7f4d0015a6f0 2024-09-21T03:27:00.094 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:27:00.094 INFO:teuthology.orchestra.run.smithi105.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false},"MDS_CLIENT_RECALL":{"severity":"HEALTH_WARN","summary":{"message":"1 clients failing to respond to cache pressure","count":1},"muted":false}},"mutes":[]} 2024-09-21T03:27:00.096 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.094+0000 7f4d084f9640 1 -- 172.21.15.105:0/1943042039 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4ce4078b90 msgr2=0x7f4ce407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:00.096 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.094+0000 7f4d084f9640 1 --2- 172.21.15.105:0/1943042039 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4ce4078b90 0x7f4ce407b0a0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc034000 tx=0x7f4cfc004730 comp rx=0 tx=0).stop 2024-09-21T03:27:00.096 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.094+0000 7f4d084f9640 1 -- 172.21.15.105:0/1943042039 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d0015a6f0 msgr2=0x7f4d0015c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:00.096 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.094+0000 7f4d084f9640 1 --2- 172.21.15.105:0/1943042039 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d0015a6f0 0x7f4d0015c580 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f4cf800cad0 tx=0x7f4cf800cf90 comp rx=0 tx=0).stop 2024-09-21T03:27:00.096 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.094+0000 7f4d084f9640 1 -- 172.21.15.105:0/1943042039 shutdown_connections 2024-09-21T03:27:00.096 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.094+0000 7f4d084f9640 1 --2- 172.21.15.105:0/1943042039 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4ce4078b90 0x7f4ce407b0a0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:00.096 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.094+0000 7f4d084f9640 1 --2- 172.21.15.105:0/1943042039 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d0015a6f0 0x7f4d0015c580 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:00.096 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.094+0000 7f4d084f9640 1 --2- 172.21.15.105:0/1943042039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d000cfb00 0x7f4d000ae5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:00.097 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.094+0000 7f4d084f9640 1 --2- 172.21.15.105:0/1943042039 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d000cf160 0x7f4d000ae0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:00.097 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.094+0000 7f4d084f9640 1 -- 172.21.15.105:0/1943042039 >> 172.21.15.105:0/1943042039 conn(0x7f4d000b1cb0 msgr2=0x7f4d000b3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:00.097 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.094+0000 7f4d084f9640 1 -- 172.21.15.105:0/1943042039 shutdown_connections 2024-09-21T03:27:00.097 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.094+0000 7f4d084f9640 1 -- 172.21.15.105:0/1943042039 wait complete. 2024-09-21T03:27:00.108 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2024-09-21T03:27:00.108 INFO:tasks.ceph_test_case:waiting 120.0s for health warning matching MDS_CACHE_OVERSIZED 2024-09-21T03:27:00.108 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T03:27:00.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.219+0000 7fd7ae6b6640 1 -- 172.21.15.105:0/1324821571 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7a80ca800 msgr2=0x7fd7a80cba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:00.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.219+0000 7fd7ae6b6640 1 --2- 172.21.15.105:0/1324821571 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7a80ca800 0x7fd7a80cba00 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fd798009830 tx=0x7fd79802a5c0 comp rx=0 tx=0).stop 2024-09-21T03:27:00.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.219+0000 7fd7ae6b6640 1 -- 172.21.15.105:0/1324821571 shutdown_connections 2024-09-21T03:27:00.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.219+0000 7fd7ae6b6640 1 --2- 172.21.15.105:0/1324821571 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7a80ca800 0x7fd7a80cba00 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:00.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.219+0000 7fd7ae6b6640 1 -- 172.21.15.105:0/1324821571 >> 172.21.15.105:0/1324821571 conn(0x7fd7a80b1cb0 msgr2=0x7fd7a80b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:00.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.219+0000 7fd7ae6b6640 1 -- 172.21.15.105:0/1324821571 shutdown_connections 2024-09-21T03:27:00.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.219+0000 7fd7ae6b6640 1 -- 172.21.15.105:0/1324821571 wait complete. 2024-09-21T03:27:00.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.220+0000 7fd7ae6b6640 1 Processor -- start 2024-09-21T03:27:00.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.221+0000 7fd7ae6b6640 1 -- start start 2024-09-21T03:27:00.225 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.222+0000 7fd7ae6b6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7a80ca800 0x7fd7a81597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:00.225 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.222+0000 7fd7ae6b6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7a80cad30 0x7fd7a809d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:00.225 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.222+0000 7fd7ae6b6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7a809d9f0 0x7fd7a815a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:00.225 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.222+0000 7fd7ae6b6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a80740c0 con 0x7fd7a80ca800 2024-09-21T03:27:00.225 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.222+0000 7fd7ae6b6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a8073f40 con 0x7fd7a80cad30 2024-09-21T03:27:00.225 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.222+0000 7fd7ae6b6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd7a8074240 con 0x7fd7a809d9f0 2024-09-21T03:27:00.225 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.222+0000 7fd7a7fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7a80ca800 0x7fd7a81597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:00.225 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.222+0000 7fd7a7fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7a80ca800 0x7fd7a81597e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51932/0 (socket says 172.21.15.105:51932) 2024-09-21T03:27:00.225 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.222+0000 7fd7a7fff640 1 -- 172.21.15.105:0/918930970 learned_addr learned my addr 172.21.15.105:0/918930970 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:00.225 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.222+0000 7fd7a77fe640 1 --2- 172.21.15.105:0/918930970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7a80cad30 0x7fd7a809d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:00.226 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.222+0000 7fd7acc53640 1 --2- 172.21.15.105:0/918930970 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7a809d9f0 0x7fd7a815a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:00.226 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.222+0000 7fd7a7fff640 1 -- 172.21.15.105:0/918930970 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7a809d9f0 msgr2=0x7fd7a815a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:00.226 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.222+0000 7fd7a7fff640 1 --2- 172.21.15.105:0/918930970 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7a809d9f0 0x7fd7a815a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:00.226 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.222+0000 7fd7a7fff640 1 -- 172.21.15.105:0/918930970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7a80cad30 msgr2=0x7fd7a809d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:00.226 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.222+0000 7fd7a7fff640 1 --2- 172.21.15.105:0/918930970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7a80cad30 0x7fd7a809d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:00.226 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.222+0000 7fd7a7fff640 1 -- 172.21.15.105:0/918930970 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7a815c1c0 con 0x7fd7a80ca800 2024-09-21T03:27:00.226 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.223+0000 7fd7a7fff640 1 --2- 172.21.15.105:0/918930970 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7a80ca800 0x7fd7a81597e0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fd798009950 tx=0x7fd798033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:00.226 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.223+0000 7fd7a4ff9640 1 -- 172.21.15.105:0/918930970 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd798031d60 con 0x7fd7a80ca800 2024-09-21T03:27:00.226 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.223+0000 7fd7a4ff9640 1 -- 172.21.15.105:0/918930970 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd798033e10 con 0x7fd7a80ca800 2024-09-21T03:27:00.226 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.223+0000 7fd7ae6b6640 1 -- 172.21.15.105:0/918930970 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7a815c4a0 con 0x7fd7a80ca800 2024-09-21T03:27:00.226 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.223+0000 7fd7a4ff9640 1 -- 172.21.15.105:0/918930970 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7980332b0 con 0x7fd7a80ca800 2024-09-21T03:27:00.226 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.223+0000 7fd7ae6b6640 1 -- 172.21.15.105:0/918930970 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7a815ca60 con 0x7fd7a80ca800 2024-09-21T03:27:00.227 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.224+0000 7fd7ae6b6640 1 -- 172.21.15.105:0/918930970 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7a815ce40 con 0x7fd7a80ca800 2024-09-21T03:27:00.227 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.224+0000 7fd7a4ff9640 1 -- 172.21.15.105:0/918930970 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd798033450 con 0x7fd7a80ca800 2024-09-21T03:27:00.227 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.225+0000 7fd7a4ff9640 1 --2- 172.21.15.105:0/918930970 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd794078b90 0x7fd79407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:00.227 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.225+0000 7fd7a4ff9640 1 -- 172.21.15.105:0/918930970 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7fd7980bc100 con 0x7fd7a80ca800 2024-09-21T03:27:00.228 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.225+0000 7fd7a77fe640 1 --2- 172.21.15.105:0/918930970 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd794078b90 0x7fd79407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:00.228 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.226+0000 7fd7a77fe640 1 --2- 172.21.15.105:0/918930970 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd794078b90 0x7fd79407b0a0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fd7a80af360 tx=0x7fd79c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:00.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.230+0000 7fd7a4ff9640 1 -- 172.21.15.105:0/918930970 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd7a815ce40 con 0x7fd7a80ca800 2024-09-21T03:27:00.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.442+0000 7fd7ae6b6640 1 -- 172.21.15.105:0/918930970 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd7a80747d0 con 0x7fd7a80ca800 2024-09-21T03:27:00.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.443+0000 7fd7a4ff9640 1 -- 172.21.15.105:0/918930970 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+316 (secure 0 0 0) 0x7fd79803f030 con 0x7fd7a80ca800 2024-09-21T03:27:00.445 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:27:00.445 INFO:teuthology.orchestra.run.smithi105.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false},"MDS_CLIENT_RECALL":{"severity":"HEALTH_WARN","summary":{"message":"1 clients failing to respond to cache pressure","count":1},"muted":false}},"mutes":[]} 2024-09-21T03:27:00.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.445+0000 7fd7ae6b6640 1 -- 172.21.15.105:0/918930970 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd794078b90 msgr2=0x7fd79407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:00.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.445+0000 7fd7ae6b6640 1 --2- 172.21.15.105:0/918930970 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd794078b90 0x7fd79407b0a0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fd7a80af360 tx=0x7fd79c009040 comp rx=0 tx=0).stop 2024-09-21T03:27:00.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.445+0000 7fd7ae6b6640 1 -- 172.21.15.105:0/918930970 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7a80ca800 msgr2=0x7fd7a81597e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:00.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.445+0000 7fd7ae6b6640 1 --2- 172.21.15.105:0/918930970 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7a80ca800 0x7fd7a81597e0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fd798009950 tx=0x7fd798033c20 comp rx=0 tx=0).stop 2024-09-21T03:27:00.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.445+0000 7fd7ae6b6640 1 -- 172.21.15.105:0/918930970 shutdown_connections 2024-09-21T03:27:00.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.445+0000 7fd7ae6b6640 1 --2- 172.21.15.105:0/918930970 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd794078b90 0x7fd79407b0a0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:00.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.445+0000 7fd7ae6b6640 1 --2- 172.21.15.105:0/918930970 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7a809d9f0 0x7fd7a815a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:00.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.445+0000 7fd7ae6b6640 1 --2- 172.21.15.105:0/918930970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7a80cad30 0x7fd7a809d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:00.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.445+0000 7fd7ae6b6640 1 --2- 172.21.15.105:0/918930970 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7a80ca800 0x7fd7a81597e0 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:00.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.445+0000 7fd7ae6b6640 1 -- 172.21.15.105:0/918930970 >> 172.21.15.105:0/918930970 conn(0x7fd7a80b1cb0 msgr2=0x7fd7a815b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:00.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.445+0000 7fd7ae6b6640 1 -- 172.21.15.105:0/918930970 shutdown_connections 2024-09-21T03:27:00.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00.445+0000 7fd7ae6b6640 1 -- 172.21.15.105:0/918930970 wait complete. 2024-09-21T03:27:00.458 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-21T03:27:00.458 INFO:tasks.cephfs.test_client_limits:Terminating process holding files open 2024-09-21T03:27:00.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00 stdin-killer INFO: expiration expected; waiting 5 seconds for command to complete 2024-09-21T03:27:00.930 INFO:teuthology.orchestra.run.smithi105.stderr:open_n_background: keeping files open 2024-09-21T03:27:00.930 INFO:teuthology.orchestra.run.smithi105.stderr:stdin closed, goodbye! 2024-09-21T03:27:00.938 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:27:00.944 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:27:01.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.097+0000 7f6f41eb6640 1 -- 172.21.15.105:0/2790003339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f3c0cff70 msgr2=0x7f6f3c15c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:01.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.097+0000 7f6f41eb6640 1 --2- 172.21.15.105:0/2790003339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f3c0cff70 0x7f6f3c15c830 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c009830 tx=0x7f6f2c02a480 comp rx=0 tx=0).stop 2024-09-21T03:27:01.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.098+0000 7f6f41eb6640 1 -- 172.21.15.105:0/2790003339 shutdown_connections 2024-09-21T03:27:01.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.098+0000 7f6f41eb6640 1 --2- 172.21.15.105:0/2790003339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f3c0cff70 0x7f6f3c15c830 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:01.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.098+0000 7f6f41eb6640 1 -- 172.21.15.105:0/2790003339 >> 172.21.15.105:0/2790003339 conn(0x7f6f3c0cee20 msgr2=0x7f6f3c0cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:01.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.098+0000 7f6f41eb6640 1 -- 172.21.15.105:0/2790003339 shutdown_connections 2024-09-21T03:27:01.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.098+0000 7f6f41eb6640 1 -- 172.21.15.105:0/2790003339 wait complete. 2024-09-21T03:27:01.101 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.099+0000 7f6f41eb6640 1 Processor -- start 2024-09-21T03:27:01.101 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.100+0000 7f6f41eb6640 1 -- start start 2024-09-21T03:27:01.104 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.101+0000 7f6f41eb6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f3c0cff70 0x7f6f3c1f5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:01.104 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.101+0000 7f6f41eb6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f3c160c90 0x7f6f3c1579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:01.104 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.101+0000 7f6f41eb6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f3c157ee0 0x7f6f3c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:01.104 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.101+0000 7f6f41eb6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6f3c0d1900 con 0x7f6f3c0cff70 2024-09-21T03:27:01.104 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.101+0000 7f6f41eb6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6f3c0d1780 con 0x7f6f3c157ee0 2024-09-21T03:27:01.104 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.101+0000 7f6f41eb6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6f3c0d1a80 con 0x7f6f3c160c90 2024-09-21T03:27:01.105 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.101+0000 7f6f3b7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f3c0cff70 0x7f6f3c1f5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:01.105 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.101+0000 7f6f3b7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f3c0cff70 0x7f6f3c1f5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:51950/0 (socket says 172.21.15.105:51950) 2024-09-21T03:27:01.105 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.101+0000 7f6f3b7fe640 1 -- 172.21.15.105:0/3390135741 learned_addr learned my addr 172.21.15.105:0/3390135741 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:01.105 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.101+0000 7f6f3bfff640 1 --2- 172.21.15.105:0/3390135741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f3c157ee0 0x7f6f3c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:01.105 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.101+0000 7f6f3affd640 1 --2- 172.21.15.105:0/3390135741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f3c160c90 0x7f6f3c1579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:01.105 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.101+0000 7f6f3b7fe640 1 -- 172.21.15.105:0/3390135741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f3c160c90 msgr2=0x7f6f3c1579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:01.105 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.101+0000 7f6f3b7fe640 1 --2- 172.21.15.105:0/3390135741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f3c160c90 0x7f6f3c1579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:01.105 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.101+0000 7f6f3b7fe640 1 -- 172.21.15.105:0/3390135741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f3c157ee0 msgr2=0x7f6f3c06f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:01.105 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.101+0000 7f6f3b7fe640 1 --2- 172.21.15.105:0/3390135741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f3c157ee0 0x7f6f3c06f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:01.105 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.101+0000 7f6f3b7fe640 1 -- 172.21.15.105:0/3390135741 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f3c0b6250 con 0x7f6f3c0cff70 2024-09-21T03:27:01.105 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.101+0000 7f6f3affd640 1 --2- 172.21.15.105:0/3390135741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f3c160c90 0x7f6f3c1579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:27:01.105 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.101+0000 7f6f3b7fe640 1 --2- 172.21.15.105:0/3390135741 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f3c0cff70 0x7f6f3c1f5a00 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c000c00 tx=0x7f6f2c033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:01.105 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.101+0000 7f6f23fff640 1 -- 172.21.15.105:0/3390135741 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c031d60 con 0x7f6f3c0cff70 2024-09-21T03:27:01.106 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.102+0000 7f6f23fff640 1 -- 172.21.15.105:0/3390135741 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f2c0330d0 con 0x7f6f3c0cff70 2024-09-21T03:27:01.106 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.102+0000 7f6f41eb6640 1 -- 172.21.15.105:0/3390135741 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f3c1f88c0 con 0x7f6f3c0cff70 2024-09-21T03:27:01.106 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.102+0000 7f6f23fff640 1 -- 172.21.15.105:0/3390135741 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c033520 con 0x7f6f3c0cff70 2024-09-21T03:27:01.106 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.102+0000 7f6f41eb6640 1 -- 172.21.15.105:0/3390135741 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f3c1f8e80 con 0x7f6f3c0cff70 2024-09-21T03:27:01.106 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.103+0000 7f6f41eb6640 1 -- 172.21.15.105:0/3390135741 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f3c0b6420 con 0x7f6f3c0cff70 2024-09-21T03:27:01.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.103+0000 7f6f23fff640 1 -- 172.21.15.105:0/3390135741 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6f2c0035f0 con 0x7f6f3c0cff70 2024-09-21T03:27:01.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.104+0000 7f6f23fff640 1 --2- 172.21.15.105:0/3390135741 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6f28078b90 0x7f6f2807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:01.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.104+0000 7f6f23fff640 1 -- 172.21.15.105:0/3390135741 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7f6f2c0bc260 con 0x7f6f3c0cff70 2024-09-21T03:27:01.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.104+0000 7f6f3affd640 1 --2- 172.21.15.105:0/3390135741 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6f28078b90 0x7f6f2807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:01.107 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.105+0000 7f6f3affd640 1 --2- 172.21.15.105:0/3390135741 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6f28078b90 0x7f6f2807b0a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f6f30000f60 tx=0x7f6f30009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:01.110 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.108+0000 7f6f23fff640 1 -- 172.21.15.105:0/3390135741 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6f2c03f030 con 0x7f6f3c0cff70 2024-09-21T03:27:01.322 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.320+0000 7f6f41eb6640 1 -- 172.21.15.105:0/3390135741 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6f3c15c830 con 0x7f6f3c0cff70 2024-09-21T03:27:01.323 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.321+0000 7f6f23fff640 1 -- 172.21.15.105:0/3390135741 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5233 (secure 0 0 0) 0x7f6f2c0840e0 con 0x7f6f3c0cff70 2024-09-21T03:27:01.323 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:27:01.323 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":86,"btime":"2024-09-21T03:26:58:479758+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6494,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2298697835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2298697835},{"type":"v1","addr":"172.21.15.162:6836","nonce":2298697835}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":6500,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/680091076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":680091076},{"type":"v1","addr":"172.21.15.105:6835","nonce":680091076}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8013,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/4094879618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":4094879618},{"type":"v1","addr":"172.21.15.105:6833","nonce":4094879618}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:26:33.112228+0000","modified":"2024-09-21T03:26:57.793673+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8022},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8022":{"gid":8022,"name":"b","rank":0,"incarnation":81,"state":"up:active","state_seq":9,"addr":"172.21.15.162:6837/712373587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":712373587},{"type":"v1","addr":"172.21.15.162:6837","nonce":712373587}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8022,"qdb_cluster":[8022]},"id":10}]} 2024-09-21T03:27:01.323 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 86 2024-09-21T03:27:01.325 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.323+0000 7f6f41eb6640 1 -- 172.21.15.105:0/3390135741 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6f28078b90 msgr2=0x7f6f2807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:01.325 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.323+0000 7f6f41eb6640 1 --2- 172.21.15.105:0/3390135741 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6f28078b90 0x7f6f2807b0a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f6f30000f60 tx=0x7f6f30009040 comp rx=0 tx=0).stop 2024-09-21T03:27:01.325 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.323+0000 7f6f41eb6640 1 -- 172.21.15.105:0/3390135741 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f3c0cff70 msgr2=0x7f6f3c1f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:01.325 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.323+0000 7f6f41eb6640 1 --2- 172.21.15.105:0/3390135741 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f3c0cff70 0x7f6f3c1f5a00 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c000c00 tx=0x7f6f2c033d60 comp rx=0 tx=0).stop 2024-09-21T03:27:01.325 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.323+0000 7f6f41eb6640 1 -- 172.21.15.105:0/3390135741 shutdown_connections 2024-09-21T03:27:01.325 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.323+0000 7f6f41eb6640 1 --2- 172.21.15.105:0/3390135741 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6f28078b90 0x7f6f2807b0a0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:01.325 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.323+0000 7f6f41eb6640 1 --2- 172.21.15.105:0/3390135741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f3c157ee0 0x7f6f3c06f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:01.325 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.323+0000 7f6f41eb6640 1 --2- 172.21.15.105:0/3390135741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f3c160c90 0x7f6f3c1579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:01.325 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.323+0000 7f6f41eb6640 1 --2- 172.21.15.105:0/3390135741 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f3c0cff70 0x7f6f3c1f5a00 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:01.325 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.323+0000 7f6f41eb6640 1 -- 172.21.15.105:0/3390135741 >> 172.21.15.105:0/3390135741 conn(0x7f6f3c0cee20 msgr2=0x7f6f3c0d23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:01.325 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.323+0000 7f6f41eb6640 1 -- 172.21.15.105:0/3390135741 shutdown_connections 2024-09-21T03:27:01.325 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.323+0000 7f6f41eb6640 1 -- 172.21.15.105:0/3390135741 wait complete. 2024-09-21T03:27:01.336 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json session ls 2024-09-21T03:27:01.476 INFO:teuthology.orchestra.run.smithi162.stdout:[{"id":8181,"entity":{"name":{"type":"client","num":8181},"addr":{"type":"v1","addr":"172.21.15.162:0","nonce":3532941168}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":15.499681068999999,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.9062107415049754,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.8181 v1:172.21.15.162:0/3532941168","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi162","kernel_version":"5.14.0-508.el9.x86_64","root":"/"}},{"id":8169,"entity":{"name":{"type":"client","num":8169},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":934085144}},"state":"open","num_leases":400,"num_caps":401,"request_load_avg":367,"uptime":16.621657980999998,"requests_in_flight":0,"num_completed_requests":399,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":2342.4292622186676,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":392.53065839785643,"halflife":1.5},"recall_caps_throttle2o":{"value":103.16445759948454,"halflife":0.5},"session_cache_liveness":{"value":1167.2011139418014,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":29,"last_trim_completed_flushes_tid":0,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.8169 v1:192.168.0.1:0/934085144","completed_requests":[{"tid":29,"created_ino":"0x10000000001"},{"tid":30,"created_ino":"0x100000001f6"},{"tid":31,"created_ino":"0x100000001f7"},{"tid":32,"created_ino":"0x100000001f8"},{"tid":33,"created_ino":"0x100000001f9"},{"tid":34,"created_ino":"0x100000001fa"},{"tid":35,"created_ino":"0x100000001fb"},{"tid":36,"created_ino":"0x100000001fc"},{"tid":37,"created_ino":"0x100000001fd"},{"tid":38,"created_ino":"0x100000001fe"},{"tid":39,"created_ino":"0x100000001ff"},{"tid":40,"created_ino":"0x10000000200"},{"tid":41,"created_ino":"0x10000000201"},{"tid":42,"created_ino":"0x10000000202"},{"tid":43,"created_ino":"0x10000000203"},{"tid":44,"created_ino":"0x10000000204"},{"tid":45,"created_ino":"0x10000000205"},{"tid":46,"created_ino":"0x10000000206"},{"tid":47,"created_ino":"0x10000000207"},{"tid":48,"created_ino":"0x10000000208"},{"tid":49,"created_ino":"0x10000000209"},{"tid":50,"created_ino":"0x1000000020a"},{"tid":51,"created_ino":"0x1000000020b"},{"tid":52,"created_ino":"0x1000000020c"},{"tid":53,"created_ino":"0x1000000020d"},{"tid":54,"created_ino":"0x1000000020e"},{"tid":55,"created_ino":"0x1000000020f"},{"tid":56,"created_ino":"0x10000000210"},{"tid":57,"created_ino":"0x10000000211"},{"tid":58,"created_ino":"0x10000000212"},{"tid":59,"created_ino":"0x10000000213"},{"tid":60,"created_ino":"0x10000000214"},{"tid":61,"created_ino":"0x10000000215"},{"tid":62,"created_ino":"0x10000000216"},{"tid":63,"created_ino":"0x10000000217"},{"tid":64,"created_ino":"0x10000000218"},{"tid":65,"created_ino":"0x10000000219"},{"tid":66,"created_ino":"0x1000000021a"},{"tid":67,"created_ino":"0x1000000021b"},{"tid":68,"created_ino":"0x1000000021c"},{"tid":69,"created_ino":"0x1000000021d"},{"tid":70,"created_ino":"0x1000000021e"},{"tid":71,"created_ino":"0x1000000021f"},{"tid":72,"created_ino":"0x10000000220"},{"tid":73,"created_ino":"0x10000000221"},{"tid":74,"created_ino":"0x10000000222"},{"tid":75,"created_ino":"0x10000000223"},{"tid":76,"created_ino":"0x10000000224"},{"tid":77,"created_ino":"0x10000000225"},{"tid":78,"created_ino":"0x10000000226"},{"tid":79,"created_ino":"0x10000000227"},{"tid":80,"created_ino":"0x10000000228"},{"tid":81,"created_ino":"0x10000000229"},{"tid":82,"created_ino":"0x1000000022a"},{"tid":83,"created_ino":"0x1000000022b"},{"tid":84,"created_ino":"0x1000000022c"},{"tid":85,"created_ino":"0x1000000022d"},{"tid":86,"created_ino":"0x1000000022e"},{"tid":87,"created_ino":"0x1000000022f"},{"tid":88,"created_ino":"0x10000000230"},{"tid":89,"created_ino":"0x10000000231"},{"tid":90,"created_ino":"0x10000000232"},{"tid":91,"created_ino":"0x10000000233"},{"tid":92,"created_ino":"0x10000000234"},{"tid":93,"created_ino":"0x10000000235"},{"tid":94,"created_ino":"0x10000000236"},{"tid":95,"created_ino":"0x10000000237"},{"tid":96,"created_ino":"0x10000000238"},{"tid":97,"created_ino":"0x10000000239"},{"tid":98,"created_ino":"0x1000000023a"},{"tid":99,"created_ino":"0x1000000023b"},{"tid":100,"created_ino":"0x1000000023c"},{"tid":101,"created_ino":"0x1000000023d"},{"tid":102,"created_ino":"0x1000000023e"},{"tid":103,"created_ino":"0x1000000023f"},{"tid":104,"created_ino":"0x10000000240"},{"tid":105,"created_ino":"0x10000000241"},{"tid":106,"created_ino":"0x10000000242"},{"tid":107,"created_ino":"0x10000000243"},{"tid":108,"created_ino":"0x10000000244"},{"tid":109,"created_ino":"0x10000000245"},{"tid":110,"created_ino":"0x10000000246"},{"tid":111,"created_ino":"0x10000000247"},{"tid":112,"created_ino":"0x10000000248"},{"tid":113,"created_ino":"0x10000000249"},{"tid":114,"created_ino":"0x1000000024a"},{"tid":115,"created_ino":"0x1000000024b"},{"tid":116,"created_ino":"0x1000000024c"},{"tid":117,"created_ino":"0x1000000024d"},{"tid":118,"created_ino":"0x1000000024e"},{"tid":119,"created_ino":"0x1000000024f"},{"tid":120,"created_ino":"0x10000000250"},{"tid":121,"created_ino":"0x10000000251"},{"tid":122,"created_ino":"0x10000000252"},{"tid":123,"created_ino":"0x10000000253"},{"tid":124,"created_ino":"0x10000000254"},{"tid":125,"created_ino":"0x10000000255"},{"tid":126,"created_ino":"0x10000000256"},{"tid":127,"created_ino":"0x10000000257"},{"tid":128,"created_ino":"0x10000000258"},{"tid":129,"created_ino":"0x10000000259"},{"tid":130,"created_ino":"0x1000000025a"},{"tid":131,"created_ino":"0x1000000025b"},{"tid":132,"created_ino":"0x1000000025c"},{"tid":133,"created_ino":"0x1000000025d"},{"tid":134,"created_ino":"0x1000000025e"},{"tid":135,"created_ino":"0x1000000025f"},{"tid":136,"created_ino":"0x10000000260"},{"tid":137,"created_ino":"0x10000000261"},{"tid":138,"created_ino":"0x10000000262"},{"tid":139,"created_ino":"0x10000000263"},{"tid":140,"created_ino":"0x10000000264"},{"tid":141,"created_ino":"0x10000000265"},{"tid":142,"created_ino":"0x10000000266"},{"tid":143,"created_ino":"0x10000000267"},{"tid":144,"created_ino":"0x10000000268"},{"tid":145,"created_ino":"0x10000000269"},{"tid":146,"created_ino":"0x1000000026a"},{"tid":147,"created_ino":"0x1000000026b"},{"tid":148,"created_ino":"0x1000000026c"},{"tid":149,"created_ino":"0x1000000026d"},{"tid":150,"created_ino":"0x1000000026e"},{"tid":151,"created_ino":"0x1000000026f"},{"tid":152,"created_ino":"0x10000000270"},{"tid":153,"created_ino":"0x10000000271"},{"tid":154,"created_ino":"0x10000000272"},{"tid":155,"created_ino":"0x10000000273"},{"tid":156,"created_ino":"0x10000000274"},{"tid":157,"created_ino":"0x10000000275"},{"tid":158,"created_ino":"0x10000000276"},{"tid":159,"created_ino":"0x10000000277"},{"tid":160,"created_ino":"0x10000000278"},{"tid":161,"created_ino":"0x10000000279"},{"tid":162,"created_ino":"0x1000000027a"},{"tid":163,"created_ino":"0x1000000027b"},{"tid":164,"created_ino":"0x1000000027c"},{"tid":165,"created_ino":"0x1000000027d"},{"tid":166,"created_ino":"0x1000000027e"},{"tid":167,"created_ino":"0x1000000027f"},{"tid":168,"created_ino":"0x10000000280"},{"tid":169,"created_ino":"0x10000000281"},{"tid":170,"created_ino":"0x10000000282"},{"tid":171,"created_ino":"0x10000000283"},{"tid":172,"created_ino":"0x10000000284"},{"tid":173,"created_ino":"0x10000000285"},{"tid":174,"created_ino":"0x10000000286"},{"tid":175,"created_ino":"0x10000000287"},{"tid":176,"created_ino":"0x10000000288"},{"tid":177,"created_ino":"0x10000000289"},{"tid":178,"created_ino":"0x1000000028a"},{"tid":179,"created_ino":"0x1000000028b"},{"tid":180,"created_ino":"0x1000000028c"},{"tid":181,"created_ino":"0x1000000028d"},{"tid":182,"created_ino":"0x1000000028e"},{"tid":183,"created_ino":"0x1000000028f"},{"tid":184,"created_ino":"0x10000000290"},{"tid":185,"created_ino":"0x10000000291"},{"tid":186,"created_ino":"0x10000000292"},{"tid":187,"created_ino":"0x10000000293"},{"tid":188,"created_ino":"0x10000000294"},{"tid":189,"created_ino":"0x10000000295"},{"tid":190,"created_ino":"0x10000000296"},{"tid":191,"created_ino":"0x10000000297"},{"tid":192,"created_ino":"0x10000000298"},{"tid":193,"created_ino":"0x10000000299"},{"tid":194,"created_ino":"0x1000000029a"},{"tid":195,"created_ino":"0x1000000029b"},{"tid":196,"created_ino":"0x1000000029c"},{"tid":197,"created_ino":"0x1000000029d"},{"tid":198,"created_ino":"0x1000000029e"},{"tid":199,"created_ino":"0x1000000029f"},{"tid":200,"created_ino":"0x100000002a0"},{"tid":201,"created_ino":"0x100000002a1"},{"tid":202,"created_ino":"0x100000002a2"},{"tid":203,"created_ino":"0x100000002a3"},{"tid":204,"created_ino":"0x100000002a4"},{"tid":205,"created_ino":"0x100000002a5"},{"tid":206,"created_ino":"0x100000002a6"},{"tid":207,"created_ino":"0x100000002a7"},{"tid":208,"created_ino":"0x100000002a8"},{"tid":209,"created_ino":"0x100000002a9"},{"tid":210,"created_ino":"0x100000002aa"},{"tid":211,"created_ino":"0x100000002ab"},{"tid":212,"created_ino":"0x100000002ac"},{"tid":213,"created_ino":"0x100000002ad"},{"tid":214,"created_ino":"0x100000002ae"},{"tid":215,"created_ino":"0x100000002af"},{"tid":216,"created_ino":"0x100000002b0"},{"tid":217,"created_ino":"0x100000002b1"},{"tid":218,"created_ino":"0x100000002b2"},{"tid":219,"created_ino":"0x100000002b3"},{"tid":220,"created_ino":"0x100000002b4"},{"tid":221,"created_ino":"0x100000002b5"},{"tid":222,"created_ino":"0x100000002b6"},{"tid":223,"created_ino":"0x100000002b7"},{"tid":224,"created_ino":"0x100000002b8"},{"tid":225,"created_ino":"0x100000002b9"},{"tid":226,"created_ino":"0x100000002ba"},{"tid":227,"created_ino":"0x100000002bb"},{"tid":228,"created_ino":"0x100000002bc"},{"tid":229,"created_ino":"0x100000002bd"},{"tid":230,"created_ino":"0x100000002be"},{"tid":231,"created_ino":"0x100000002bf"},{"tid":232,"created_ino":"0x100000002c0"},{"tid":233,"created_ino":"0x100000002c1"},{"tid":234,"created_ino":"0x100000002c2"},{"tid":235,"created_ino":"0x100000002c3"},{"tid":236,"created_ino":"0x100000002c4"},{"tid":237,"created_ino":"0x100000002c5"},{"tid":238,"created_ino":"0x100000002c6"},{"tid":239,"created_ino":"0x100000002c7"},{"tid":240,"created_ino":"0x100000002c8"},{"tid":241,"created_ino":"0x100000002c9"},{"tid":242,"created_ino":"0x100000002ca"},{"tid":243,"created_ino":"0x100000002cb"},{"tid":244,"created_ino":"0x100000002cc"},{"tid":245,"created_ino":"0x100000002cd"},{"tid":246,"created_ino":"0x100000002ce"},{"tid":247,"created_ino":"0x100000002cf"},{"tid":248,"created_ino":"0x100000002d0"},{"tid":249,"created_ino":"0x100000002d1"},{"tid":250,"created_ino":"0x100000002d2"},{"tid":251,"created_ino":"0x100000002d3"},{"tid":252,"created_ino":"0x100000002d4"},{"tid":253,"created_ino":"0x100000002d5"},{"tid":254,"created_ino":"0x100000002d6"},{"tid":255,"created_ino":"0x100000002d7"},{"tid":256,"created_ino":"0x100000002d8"},{"tid":257,"created_ino":"0x100000002d9"},{"tid":258,"created_ino":"0x100000002da"},{"tid":259,"created_ino":"0x100000002db"},{"tid":260,"created_ino":"0x100000002dc"},{"tid":261,"created_ino":"0x100000002dd"},{"tid":262,"created_ino":"0x100000002de"},{"tid":263,"created_ino":"0x100000002df"},{"tid":264,"created_ino":"0x100000002e0"},{"tid":265,"created_ino":"0x100000002e1"},{"tid":266,"created_ino":"0x100000002e2"},{"tid":267,"created_ino":"0x100000002e3"},{"tid":268,"created_ino":"0x100000002e4"},{"tid":269,"created_ino":"0x100000002e5"},{"tid":270,"created_ino":"0x100000002e6"},{"tid":271,"created_ino":"0x100000002e7"},{"tid":272,"created_ino":"0x100000002e8"},{"tid":273,"created_ino":"0x100000002e9"},{"tid":274,"created_ino":"0x100000002ea"},{"tid":275,"created_ino":"0x100000002eb"},{"tid":276,"created_ino":"0x100000002ec"},{"tid":277,"created_ino":"0x100000002ed"},{"tid":278,"created_ino":"0x100000002ee"},{"tid":279,"created_ino":"0x100000002ef"},{"tid":280,"created_ino":"0x100000002f0"},{"tid":281,"created_ino":"0x100000002f1"},{"tid":282,"created_ino":"0x100000002f2"},{"tid":283,"created_ino":"0x100000002f3"},{"tid":284,"created_ino":"0x100000002f4"},{"tid":285,"created_ino":"0x100000002f5"},{"tid":286,"created_ino":"0x100000002f6"},{"tid":287,"created_ino":"0x100000002f7"},{"tid":288,"created_ino":"0x100000002f8"},{"tid":289,"created_ino":"0x100000002f9"},{"tid":290,"created_ino":"0x100000002fa"},{"tid":291,"created_ino":"0x100000002fb"},{"tid":292,"created_ino":"0x100000002fc"},{"tid":293,"created_ino":"0x100000002fd"},{"tid":294,"created_ino":"0x100000002fe"},{"tid":295,"created_ino":"0x100000002ff"},{"tid":296,"created_ino":"0x10000000300"},{"tid":297,"created_ino":"0x10000000301"},{"tid":298,"created_ino":"0x10000000302"},{"tid":299,"created_ino":"0x10000000303"},{"tid":300,"created_ino":"0x10000000304"},{"tid":301,"created_ino":"0x10000000305"},{"tid":302,"created_ino":"0x10000000306"},{"tid":303,"created_ino":"0x10000000307"},{"tid":304,"created_ino":"0x10000000308"},{"tid":305,"created_ino":"0x10000000309"},{"tid":306,"created_ino":"0x1000000030a"},{"tid":307,"created_ino":"0x1000000030b"},{"tid":308,"created_ino":"0x1000000030c"},{"tid":309,"created_ino":"0x1000000030d"},{"tid":310,"created_ino":"0x1000000030e"},{"tid":311,"created_ino":"0x1000000030f"},{"tid":312,"created_ino":"0x10000000310"},{"tid":313,"created_ino":"0x10000000311"},{"tid":314,"created_ino":"0x10000000312"},{"tid":315,"created_ino":"0x10000000313"},{"tid":316,"created_ino":"0x10000000314"},{"tid":317,"created_ino":"0x10000000315"},{"tid":318,"created_ino":"0x10000000316"},{"tid":319,"created_ino":"0x10000000317"},{"tid":320,"created_ino":"0x10000000318"},{"tid":321,"created_ino":"0x10000000319"},{"tid":322,"created_ino":"0x1000000031a"},{"tid":323,"created_ino":"0x1000000031b"},{"tid":324,"created_ino":"0x1000000031c"},{"tid":325,"created_ino":"0x1000000031d"},{"tid":326,"created_ino":"0x1000000031e"},{"tid":327,"created_ino":"0x1000000031f"},{"tid":328,"created_ino":"0x10000000320"},{"tid":329,"created_ino":"0x10000000321"},{"tid":330,"created_ino":"0x10000000322"},{"tid":331,"created_ino":"0x10000000323"},{"tid":332,"created_ino":"0x10000000324"},{"tid":333,"created_ino":"0x10000000325"},{"tid":334,"created_ino":"0x10000000326"},{"tid":335,"created_ino":"0x10000000327"},{"tid":336,"created_ino":"0x10000000328"},{"tid":337,"created_ino":"0x10000000329"},{"tid":338,"created_ino":"0x1000000032a"},{"tid":339,"created_ino":"0x1000000032b"},{"tid":340,"created_ino":"0x1000000032c"},{"tid":341,"created_ino":"0x1000000032d"},{"tid":342,"created_ino":"0x1000000032e"},{"tid":343,"created_ino":"0x1000000032f"},{"tid":344,"created_ino":"0x10000000330"},{"tid":345,"created_ino":"0x10000000331"},{"tid":346,"created_ino":"0x10000000332"},{"tid":347,"created_ino":"0x10000000333"},{"tid":348,"created_ino":"0x10000000334"},{"tid":349,"created_ino":"0x10000000335"},{"tid":350,"created_ino":"0x10000000336"},{"tid":351,"created_ino":"0x10000000337"},{"tid":352,"created_ino":"0x10000000338"},{"tid":353,"created_ino":"0x10000000339"},{"tid":354,"created_ino":"0x1000000033a"},{"tid":355,"created_ino":"0x1000000033b"},{"tid":356,"created_ino":"0x1000000033c"},{"tid":357,"created_ino":"0x1000000033d"},{"tid":358,"created_ino":"0x1000000033e"},{"tid":359,"created_ino":"0x1000000033f"},{"tid":360,"created_ino":"0x10000000340"},{"tid":361,"created_ino":"0x10000000341"},{"tid":362,"created_ino":"0x10000000342"},{"tid":363,"created_ino":"0x10000000343"},{"tid":364,"created_ino":"0x10000000344"},{"tid":365,"created_ino":"0x10000000345"},{"tid":366,"created_ino":"0x10000000346"},{"tid":367,"created_ino":"0x10000000347"},{"tid":368,"created_ino":"0x10000000348"},{"tid":369,"created_ino":"0x10000000349"},{"tid":370,"created_ino":"0x1000000034a"},{"tid":371,"created_ino":"0x1000000034b"},{"tid":372,"created_ino":"0x1000000034c"},{"tid":373,"created_ino":"0x1000000034d"},{"tid":374,"created_ino":"0x1000000034e"},{"tid":375,"created_ino":"0x1000000034f"},{"tid":376,"created_ino":"0x10000000350"},{"tid":377,"created_ino":"0x10000000351"},{"tid":378,"created_ino":"0x10000000352"},{"tid":379,"created_ino":"0x10000000353"},{"tid":380,"created_ino":"0x10000000354"},{"tid":381,"created_ino":"0x10000000355"},{"tid":382,"created_ino":"0x10000000356"},{"tid":383,"created_ino":"0x10000000357"},{"tid":384,"created_ino":"0x10000000358"},{"tid":385,"created_ino":"0x10000000359"},{"tid":386,"created_ino":"0x1000000035a"},{"tid":387,"created_ino":"0x1000000035b"},{"tid":388,"created_ino":"0x1000000035c"},{"tid":389,"created_ino":"0x1000000035d"},{"tid":390,"created_ino":"0x1000000035e"},{"tid":391,"created_ino":"0x1000000035f"},{"tid":392,"created_ino":"0x10000000360"},{"tid":393,"created_ino":"0x10000000361"},{"tid":394,"created_ino":"0x10000000362"},{"tid":395,"created_ino":"0x10000000363"},{"tid":396,"created_ino":"0x10000000364"},{"tid":397,"created_ino":"0x10000000365"},{"tid":398,"created_ino":"0x10000000366"},{"tid":399,"created_ino":"0x10000000367"},{"tid":400,"created_ino":"0x10000000368"},{"tid":401,"created_ino":"0x10000000369"},{"tid":402,"created_ino":"0x1000000036a"},{"tid":403,"created_ino":"0x1000000036b"},{"tid":404,"created_ino":"0x1000000036c"},{"tid":405,"created_ino":"0x1000000036d"},{"tid":406,"created_ino":"0x1000000036e"},{"tid":407,"created_ino":"0x1000000036f"},{"tid":408,"created_ino":"0x10000000370"},{"tid":409,"created_ino":"0x10000000371"},{"tid":410,"created_ino":"0x10000000372"},{"tid":411,"created_ino":"0x10000000373"},{"tid":412,"created_ino":"0x10000000374"},{"tid":413,"created_ino":"0x10000000375"},{"tid":414,"created_ino":"0x10000000376"},{"tid":415,"created_ino":"0x10000000377"},{"tid":416,"created_ino":"0x10000000378"},{"tid":417,"created_ino":"0x10000000379"},{"tid":418,"created_ino":"0x1000000037a"},{"tid":419,"created_ino":"0x1000000037b"},{"tid":420,"created_ino":"0x1000000037c"},{"tid":421,"created_ino":"0x1000000037d"},{"tid":422,"created_ino":"0x1000000037e"},{"tid":423,"created_ino":"0x1000000037f"},{"tid":424,"created_ino":"0x10000000380"},{"tid":425,"created_ino":"0x10000000381"},{"tid":426,"created_ino":"0x10000000382"},{"tid":427,"created_ino":"0x10000000383"}],"prealloc_inos":[{"start":"0x10000000002","length":500},{"start":"0x10000000384","length":603}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi105","kernel_version":"5.14.0-508.el9.x86_64","root":"/"}}] 2024-09-21T03:27:01.479 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi162", "kernel_version": "5.14.0-508.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.162:0", "nonce": 3532941168, "type": "v1" }, "name": { "num": 8181, "type": "client" } }, "id": 8181, "inst": "client.8181 v1:172.21.15.162:0/3532941168", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.9062107415049754 }, "state": "open", "uptime": 15.499681069 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi105", "kernel_version": "5.14.0-508.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [ { "created_ino": "0x10000000001", "tid": 29 }, { "created_ino": "0x100000001f6", "tid": 30 }, { "created_ino": "0x100000001f7", "tid": 31 }, { "created_ino": "0x100000001f8", "tid": 32 }, { "created_ino": "0x100000001f9", "tid": 33 }, { "created_ino": "0x100000001fa", "tid": 34 }, { "created_ino": "0x100000001fb", "tid": 35 }, { "created_ino": "0x100000001fc", "tid": 36 }, { "created_ino": "0x100000001fd", "tid": 37 }, { "created_ino": "0x100000001fe", "tid": 38 }, { "created_ino": "0x100000001ff", "tid": 39 }, { "created_ino": "0x10000000200", "tid": 40 }, { "created_ino": "0x10000000201", "tid": 41 }, { "created_ino": "0x10000000202", "tid": 42 }, { "created_ino": "0x10000000203", "tid": 43 }, { "created_ino": "0x10000000204", "tid": 44 }, { "created_ino": "0x10000000205", "tid": 45 }, { "created_ino": "0x10000000206", "tid": 46 }, { "created_ino": "0x10000000207", "tid": 47 }, { "created_ino": "0x10000000208", "tid": 48 }, { "created_ino": "0x10000000209", "tid": 49 }, { "created_ino": "0x1000000020a", "tid": 50 }, { "created_ino": "0x1000000020b", "tid": 51 }, { "created_ino": "0x1000000020c", "tid": 52 }, { "created_ino": "0x1000000020d", "tid": 53 }, { "created_ino": "0x1000000020e", "tid": 54 }, { "created_ino": "0x1000000020f", "tid": 55 }, { "created_ino": "0x10000000210", "tid": 56 }, { "created_ino": "0x10000000211", "tid": 57 }, { "created_ino": "0x10000000212", "tid": 58 }, { "created_ino": "0x10000000213", "tid": 59 }, { "created_ino": "0x10000000214", "tid": 60 }, { "created_ino": "0x10000000215", "tid": 61 }, { "created_ino": "0x10000000216", "tid": 62 }, { "created_ino": "0x10000000217", "tid": 63 }, { "created_ino": "0x10000000218", "tid": 64 }, { "created_ino": "0x10000000219", "tid": 65 }, { "created_ino": "0x1000000021a", "tid": 66 }, { "created_ino": "0x1000000021b", "tid": 67 }, { "created_ino": "0x1000000021c", "tid": 68 }, { "created_ino": "0x1000000021d", "tid": 69 }, { "created_ino": "0x1000000021e", "tid": 70 }, { "created_ino": "0x1000000021f", "tid": 71 }, { "created_ino": "0x10000000220", "tid": 72 }, { "created_ino": "0x10000000221", "tid": 73 }, { "created_ino": "0x10000000222", "tid": 74 }, { "created_ino": "0x10000000223", "tid": 75 }, { "created_ino": "0x10000000224", "tid": 76 }, { "created_ino": "0x10000000225", "tid": 77 }, { "created_ino": "0x10000000226", "tid": 78 }, { "created_ino": "0x10000000227", "tid": 79 }, { "created_ino": "0x10000000228", "tid": 80 }, { "created_ino": "0x10000000229", "tid": 81 }, { "created_ino": "0x1000000022a", "tid": 82 }, { "created_ino": "0x1000000022b", "tid": 83 }, { "created_ino": "0x1000000022c", "tid": 84 }, { "created_ino": "0x1000000022d", "tid": 85 }, { "created_ino": "0x1000000022e", "tid": 86 }, { "created_ino": "0x1000000022f", "tid": 87 }, { "created_ino": "0x10000000230", "tid": 88 }, { "created_ino": "0x10000000231", "tid": 89 }, { "created_ino": "0x10000000232", "tid": 90 }, { "created_ino": "0x10000000233", "tid": 91 }, { "created_ino": "0x10000000234", "tid": 92 }, { "created_ino": "0x10000000235", "tid": 93 }, { "created_ino": "0x10000000236", "tid": 94 }, { "created_ino": "0x10000000237", "tid": 95 }, { "created_ino": "0x10000000238", "tid": 96 }, { "created_ino": "0x10000000239", "tid": 97 }, { "created_ino": "0x1000000023a", "tid": 98 }, { "created_ino": "0x1000000023b", "tid": 99 }, { "created_ino": "0x1000000023c", "tid": 100 }, { "created_ino": "0x1000000023d", "tid": 101 }, { "created_ino": "0x1000000023e", "tid": 102 }, { "created_ino": "0x1000000023f", "tid": 103 }, { "created_ino": "0x10000000240", "tid": 104 }, { "created_ino": "0x10000000241", "tid": 105 }, { "created_ino": "0x10000000242", "tid": 106 }, { "created_ino": "0x10000000243", "tid": 107 }, { "created_ino": "0x10000000244", "tid": 108 }, { "created_ino": "0x10000000245", "tid": 109 }, { "created_ino": "0x10000000246", "tid": 110 }, { "created_ino": "0x10000000247", "tid": 111 }, { "created_ino": "0x10000000248", "tid": 112 }, { "created_ino": "0x10000000249", "tid": 113 }, { "created_ino": "0x1000000024a", "tid": 114 }, { "created_ino": "0x1000000024b", "tid": 115 }, { "created_ino": "0x1000000024c", "tid": 116 }, { "created_ino": "0x1000000024d", "tid": 117 }, { "created_ino": "0x1000000024e", "tid": 118 }, { "created_ino": "0x1000000024f", "tid": 119 }, { "created_ino": "0x10000000250", "tid": 120 }, { "created_ino": "0x10000000251", "tid": 121 }, { "created_ino": "0x10000000252", "tid": 122 }, { "created_ino": "0x10000000253", "tid": 123 }, { "created_ino": "0x10000000254", "tid": 124 }, { "created_ino": "0x10000000255", "tid": 125 }, { "created_ino": "0x10000000256", "tid": 126 }, { "created_ino": "0x10000000257", "tid": 127 }, { "created_ino": "0x10000000258", "tid": 128 }, { "created_ino": "0x10000000259", "tid": 129 }, { "created_ino": "0x1000000025a", "tid": 130 }, { "created_ino": "0x1000000025b", "tid": 131 }, { "created_ino": "0x1000000025c", "tid": 132 }, { "created_ino": "0x1000000025d", "tid": 133 }, { "created_ino": "0x1000000025e", "tid": 134 }, { "created_ino": "0x1000000025f", "tid": 135 }, { "created_ino": "0x10000000260", "tid": 136 }, { "created_ino": "0x10000000261", "tid": 137 }, { "created_ino": "0x10000000262", "tid": 138 }, { "created_ino": "0x10000000263", "tid": 139 }, { "created_ino": "0x10000000264", "tid": 140 }, { "created_ino": "0x10000000265", "tid": 141 }, { "created_ino": "0x10000000266", "tid": 142 }, { "created_ino": "0x10000000267", "tid": 143 }, { "created_ino": "0x10000000268", "tid": 144 }, { "created_ino": "0x10000000269", "tid": 145 }, { "created_ino": "0x1000000026a", "tid": 146 }, { "created_ino": "0x1000000026b", "tid": 147 }, { "created_ino": "0x1000000026c", "tid": 148 }, { "created_ino": "0x1000000026d", "tid": 149 }, { "created_ino": "0x1000000026e", "tid": 150 }, { "created_ino": "0x1000000026f", "tid": 151 }, { "created_ino": "0x10000000270", "tid": 152 }, { "created_ino": "0x10000000271", "tid": 153 }, { "created_ino": "0x10000000272", "tid": 154 }, { "created_ino": "0x10000000273", "tid": 155 }, { "created_ino": "0x10000000274", "tid": 156 }, { "created_ino": "0x10000000275", "tid": 157 }, { "created_ino": "0x10000000276", "tid": 158 }, { "created_ino": "0x10000000277", "tid": 159 }, { "created_ino": "0x10000000278", "tid": 160 }, { "created_ino": "0x10000000279", "tid": 161 }, { "created_ino": "0x1000000027a", "tid": 162 }, { "created_ino": "0x1000000027b", "tid": 163 }, { "created_ino": "0x1000000027c", "tid": 164 }, { "created_ino": "0x1000000027d", "tid": 165 }, { "created_ino": "0x1000000027e", "tid": 166 }, { "created_ino": "0x1000000027f", "tid": 167 }, { "created_ino": "0x10000000280", "tid": 168 }, { "created_ino": "0x10000000281", "tid": 169 }, { "created_ino": "0x10000000282", "tid": 170 }, { "created_ino": "0x10000000283", "tid": 171 }, { "created_ino": "0x10000000284", "tid": 172 }, { "created_ino": "0x10000000285", "tid": 173 }, { "created_ino": "0x10000000286", "tid": 174 }, { "created_ino": "0x10000000287", "tid": 175 }, { "created_ino": "0x10000000288", "tid": 176 }, { "created_ino": "0x10000000289", "tid": 177 }, { "created_ino": "0x1000000028a", "tid": 178 }, { "created_ino": "0x1000000028b", "tid": 179 }, { "created_ino": "0x1000000028c", "tid": 180 }, { "created_ino": "0x1000000028d", "tid": 181 }, { "created_ino": "0x1000000028e", "tid": 182 }, { "created_ino": "0x1000000028f", "tid": 183 }, { "created_ino": "0x10000000290", "tid": 184 }, { "created_ino": "0x10000000291", "tid": 185 }, { "created_ino": "0x10000000292", "tid": 186 }, { "created_ino": "0x10000000293", "tid": 187 }, { "created_ino": "0x10000000294", "tid": 188 }, { "created_ino": "0x10000000295", "tid": 189 }, { "created_ino": "0x10000000296", "tid": 190 }, { "created_ino": "0x10000000297", "tid": 191 }, { "created_ino": "0x10000000298", "tid": 192 }, { "created_ino": "0x10000000299", "tid": 193 }, { "created_ino": "0x1000000029a", "tid": 194 }, { "created_ino": "0x1000000029b", "tid": 195 }, { "created_ino": "0x1000000029c", "tid": 196 }, { "created_ino": "0x1000000029d", "tid": 197 }, { "created_ino": "0x1000000029e", "tid": 198 }, { "created_ino": "0x1000000029f", "tid": 199 }, { "created_ino": "0x100000002a0", "tid": 200 }, { "created_ino": "0x100000002a1", "tid": 201 }, { "created_ino": "0x100000002a2", "tid": 202 }, { "created_ino": "0x100000002a3", "tid": 203 }, { "created_ino": "0x100000002a4", "tid": 204 }, { "created_ino": "0x100000002a5", "tid": 205 }, { "created_ino": "0x100000002a6", "tid": 206 }, { "created_ino": "0x100000002a7", "tid": 207 }, { "created_ino": "0x100000002a8", "tid": 208 }, { "created_ino": "0x100000002a9", "tid": 209 }, { "created_ino": "0x100000002aa", "tid": 210 }, { "created_ino": "0x100000002ab", "tid": 211 }, { "created_ino": "0x100000002ac", "tid": 212 }, { "created_ino": "0x100000002ad", "tid": 213 }, { "created_ino": "0x100000002ae", "tid": 214 }, { "created_ino": "0x100000002af", "tid": 215 }, { "created_ino": "0x100000002b0", "tid": 216 }, { "created_ino": "0x100000002b1", "tid": 217 }, { "created_ino": "0x100000002b2", "tid": 218 }, { "created_ino": "0x100000002b3", "tid": 219 }, { "created_ino": "0x100000002b4", "tid": 220 }, { "created_ino": "0x100000002b5", "tid": 221 }, { "created_ino": "0x100000002b6", "tid": 222 }, { "created_ino": "0x100000002b7", "tid": 223 }, { "created_ino": "0x100000002b8", "tid": 224 }, { "created_ino": "0x100000002b9", "tid": 225 }, { "created_ino": "0x100000002ba", "tid": 226 }, { "created_ino": "0x100000002bb", "tid": 227 }, { "created_ino": "0x100000002bc", "tid": 228 }, { "created_ino": "0x100000002bd", "tid": 229 }, { "created_ino": "0x100000002be", "tid": 230 }, { "created_ino": "0x100000002bf", "tid": 231 }, { "created_ino": "0x100000002c0", "tid": 232 }, { "created_ino": "0x100000002c1", "tid": 233 }, { "created_ino": "0x100000002c2", "tid": 234 }, { "created_ino": "0x100000002c3", "tid": 235 }, { "created_ino": "0x100000002c4", "tid": 236 }, { "created_ino": "0x100000002c5", "tid": 237 }, { "created_ino": "0x100000002c6", "tid": 238 }, { "created_ino": "0x100000002c7", "tid": 239 }, { "created_ino": "0x100000002c8", "tid": 240 }, { "created_ino": "0x100000002c9", "tid": 241 }, { "created_ino": "0x100000002ca", "tid": 242 }, { "created_ino": "0x100000002cb", "tid": 243 }, { "created_ino": "0x100000002cc", "tid": 244 }, { "created_ino": "0x100000002cd", "tid": 245 }, { "created_ino": "0x100000002ce", "tid": 246 }, { "created_ino": "0x100000002cf", "tid": 247 }, { "created_ino": "0x100000002d0", "tid": 248 }, { "created_ino": "0x100000002d1", "tid": 249 }, { "created_ino": "0x100000002d2", "tid": 250 }, { "created_ino": "0x100000002d3", "tid": 251 }, { "created_ino": "0x100000002d4", "tid": 252 }, { "created_ino": "0x100000002d5", "tid": 253 }, { "created_ino": "0x100000002d6", "tid": 254 }, { "created_ino": "0x100000002d7", "tid": 255 }, { "created_ino": "0x100000002d8", "tid": 256 }, { "created_ino": "0x100000002d9", "tid": 257 }, { "created_ino": "0x100000002da", "tid": 258 }, { "created_ino": "0x100000002db", "tid": 259 }, { "created_ino": "0x100000002dc", "tid": 260 }, { "created_ino": "0x100000002dd", "tid": 261 }, { "created_ino": "0x100000002de", "tid": 262 }, { "created_ino": "0x100000002df", "tid": 263 }, { "created_ino": "0x100000002e0", "tid": 264 }, { "created_ino": "0x100000002e1", "tid": 265 }, { "created_ino": "0x100000002e2", "tid": 266 }, { "created_ino": "0x100000002e3", "tid": 267 }, { "created_ino": "0x100000002e4", "tid": 268 }, { "created_ino": "0x100000002e5", "tid": 269 }, { "created_ino": "0x100000002e6", "tid": 270 }, { "created_ino": "0x100000002e7", "tid": 271 }, { "created_ino": "0x100000002e8", "tid": 272 }, { "created_ino": "0x100000002e9", "tid": 273 }, { "created_ino": "0x100000002ea", "tid": 274 }, { "created_ino": "0x100000002eb", "tid": 275 }, { "created_ino": "0x100000002ec", "tid": 276 }, { "created_ino": "0x100000002ed", "tid": 277 }, { "created_ino": "0x100000002ee", "tid": 278 }, { "created_ino": "0x100000002ef", "tid": 279 }, { "created_ino": "0x100000002f0", "tid": 280 }, { "created_ino": "0x100000002f1", "tid": 281 }, { "created_ino": "0x100000002f2", "tid": 282 }, { "created_ino": "0x100000002f3", "tid": 283 }, { "created_ino": "0x100000002f4", "tid": 284 }, { "created_ino": "0x100000002f5", "tid": 285 }, { "created_ino": "0x100000002f6", "tid": 286 }, { "created_ino": "0x100000002f7", "tid": 287 }, { "created_ino": "0x100000002f8", "tid": 288 }, { "created_ino": "0x100000002f9", "tid": 289 }, { "created_ino": "0x100000002fa", "tid": 290 }, { "created_ino": "0x100000002fb", "tid": 291 }, { "created_ino": "0x100000002fc", "tid": 292 }, { "created_ino": "0x100000002fd", "tid": 293 }, { "created_ino": "0x100000002fe", "tid": 294 }, { "created_ino": "0x100000002ff", "tid": 295 }, { "created_ino": "0x10000000300", "tid": 296 }, { "created_ino": "0x10000000301", "tid": 297 }, { "created_ino": "0x10000000302", "tid": 298 }, { "created_ino": "0x10000000303", "tid": 299 }, { "created_ino": "0x10000000304", "tid": 300 }, { "created_ino": "0x10000000305", "tid": 301 }, { "created_ino": "0x10000000306", "tid": 302 }, { "created_ino": "0x10000000307", "tid": 303 }, { "created_ino": "0x10000000308", "tid": 304 }, { "created_ino": "0x10000000309", "tid": 305 }, { "created_ino": "0x1000000030a", "tid": 306 }, { "created_ino": "0x1000000030b", "tid": 307 }, { "created_ino": "0x1000000030c", "tid": 308 }, { "created_ino": "0x1000000030d", "tid": 309 }, { "created_ino": "0x1000000030e", "tid": 310 }, { "created_ino": "0x1000000030f", "tid": 311 }, { "created_ino": "0x10000000310", "tid": 312 }, { "created_ino": "0x10000000311", "tid": 313 }, { "created_ino": "0x10000000312", "tid": 314 }, { "created_ino": "0x10000000313", "tid": 315 }, { "created_ino": "0x10000000314", "tid": 316 }, { "created_ino": "0x10000000315", "tid": 317 }, { "created_ino": "0x10000000316", "tid": 318 }, { "created_ino": "0x10000000317", "tid": 319 }, { "created_ino": "0x10000000318", "tid": 320 }, { "created_ino": "0x10000000319", "tid": 321 }, { "created_ino": "0x1000000031a", "tid": 322 }, { "created_ino": "0x1000000031b", "tid": 323 }, { "created_ino": "0x1000000031c", "tid": 324 }, { "created_ino": "0x1000000031d", "tid": 325 }, { "created_ino": "0x1000000031e", "tid": 326 }, { "created_ino": "0x1000000031f", "tid": 327 }, { "created_ino": "0x10000000320", "tid": 328 }, { "created_ino": "0x10000000321", "tid": 329 }, { "created_ino": "0x10000000322", "tid": 330 }, { "created_ino": "0x10000000323", "tid": 331 }, { "created_ino": "0x10000000324", "tid": 332 }, { "created_ino": "0x10000000325", "tid": 333 }, { "created_ino": "0x10000000326", "tid": 334 }, { "created_ino": "0x10000000327", "tid": 335 }, { "created_ino": "0x10000000328", "tid": 336 }, { "created_ino": "0x10000000329", "tid": 337 }, { "created_ino": "0x1000000032a", "tid": 338 }, { "created_ino": "0x1000000032b", "tid": 339 }, { "created_ino": "0x1000000032c", "tid": 340 }, { "created_ino": "0x1000000032d", "tid": 341 }, { "created_ino": "0x1000000032e", "tid": 342 }, { "created_ino": "0x1000000032f", "tid": 343 }, { "created_ino": "0x10000000330", "tid": 344 }, { "created_ino": "0x10000000331", "tid": 345 }, { "created_ino": "0x10000000332", "tid": 346 }, { "created_ino": "0x10000000333", "tid": 347 }, { "created_ino": "0x10000000334", "tid": 348 }, { "created_ino": "0x10000000335", "tid": 349 }, { "created_ino": "0x10000000336", "tid": 350 }, { "created_ino": "0x10000000337", "tid": 351 }, { "created_ino": "0x10000000338", "tid": 352 }, { "created_ino": "0x10000000339", "tid": 353 }, { "created_ino": "0x1000000033a", "tid": 354 }, { "created_ino": "0x1000000033b", "tid": 355 }, { "created_ino": "0x1000000033c", "tid": 356 }, { "created_ino": "0x1000000033d", "tid": 357 }, { "created_ino": "0x1000000033e", "tid": 358 }, { "created_ino": "0x1000000033f", "tid": 359 }, { "created_ino": "0x10000000340", "tid": 360 }, { "created_ino": "0x10000000341", "tid": 361 }, { "created_ino": "0x10000000342", "tid": 362 }, { "created_ino": "0x10000000343", "tid": 363 }, { "created_ino": "0x10000000344", "tid": 364 }, { "created_ino": "0x10000000345", "tid": 365 }, { "created_ino": "0x10000000346", "tid": 366 }, { "created_ino": "0x10000000347", "tid": 367 }, { "created_ino": "0x10000000348", "tid": 368 }, { "created_ino": "0x10000000349", "tid": 369 }, { "created_ino": "0x1000000034a", "tid": 370 }, { "created_ino": "0x1000000034b", "tid": 371 }, { "created_ino": "0x1000000034c", "tid": 372 }, { "created_ino": "0x1000000034d", "tid": 373 }, { "created_ino": "0x1000000034e", "tid": 374 }, { "created_ino": "0x1000000034f", "tid": 375 }, { "created_ino": "0x10000000350", "tid": 376 }, { "created_ino": "0x10000000351", "tid": 377 }, { "created_ino": "0x10000000352", "tid": 378 }, { "created_ino": "0x10000000353", "tid": 379 }, { "created_ino": "0x10000000354", "tid": 380 }, { "created_ino": "0x10000000355", "tid": 381 }, { "created_ino": "0x10000000356", "tid": 382 }, { "created_ino": "0x10000000357", "tid": 383 }, { "created_ino": "0x10000000358", "tid": 384 }, { "created_ino": "0x10000000359", "tid": 385 }, { "created_ino": "0x1000000035a", "tid": 386 }, { "created_ino": "0x1000000035b", "tid": 387 }, { "created_ino": "0x1000000035c", "tid": 388 }, { "created_ino": "0x1000000035d", "tid": 389 }, { "created_ino": "0x1000000035e", "tid": 390 }, { "created_ino": "0x1000000035f", "tid": 391 }, { "created_ino": "0x10000000360", "tid": 392 }, { "created_ino": "0x10000000361", "tid": 393 }, { "created_ino": "0x10000000362", "tid": 394 }, { "created_ino": "0x10000000363", "tid": 395 }, { "created_ino": "0x10000000364", "tid": 396 }, { "created_ino": "0x10000000365", "tid": 397 }, { "created_ino": "0x10000000366", "tid": 398 }, { "created_ino": "0x10000000367", "tid": 399 }, { "created_ino": "0x10000000368", "tid": 400 }, { "created_ino": "0x10000000369", "tid": 401 }, { "created_ino": "0x1000000036a", "tid": 402 }, { "created_ino": "0x1000000036b", "tid": 403 }, { "created_ino": "0x1000000036c", "tid": 404 }, { "created_ino": "0x1000000036d", "tid": 405 }, { "created_ino": "0x1000000036e", "tid": 406 }, { "created_ino": "0x1000000036f", "tid": 407 }, { "created_ino": "0x10000000370", "tid": 408 }, { "created_ino": "0x10000000371", "tid": 409 }, { "created_ino": "0x10000000372", "tid": 410 }, { "created_ino": "0x10000000373", "tid": 411 }, { "created_ino": "0x10000000374", "tid": 412 }, { "created_ino": "0x10000000375", "tid": 413 }, { "created_ino": "0x10000000376", "tid": 414 }, { "created_ino": "0x10000000377", "tid": 415 }, { "created_ino": "0x10000000378", "tid": 416 }, { "created_ino": "0x10000000379", "tid": 417 }, { "created_ino": "0x1000000037a", "tid": 418 }, { "created_ino": "0x1000000037b", "tid": 419 }, { "created_ino": "0x1000000037c", "tid": 420 }, { "created_ino": "0x1000000037d", "tid": 421 }, { "created_ino": "0x1000000037e", "tid": 422 }, { "created_ino": "0x1000000037f", "tid": 423 }, { "created_ino": "0x10000000380", "tid": 424 }, { "created_ino": "0x10000000381", "tid": 425 }, { "created_ino": "0x10000000382", "tid": 426 }, { "created_ino": "0x10000000383", "tid": 427 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 934085144, "type": "v1" }, "name": { "num": 8169, "type": "client" } }, "id": 8169, "inst": "client.8169 v1:192.168.0.1:0/934085144", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 29, "num_caps": 401, "num_completed_flushes": 0, "num_completed_requests": 399, "num_leases": 400, "prealloc_inos": [ { "length": 500, "start": "0x10000000002" }, { "length": 603, "start": "0x10000000384" } ], "recall_caps": { "halflife": 60, "value": 2342.4292622186676 }, "recall_caps_throttle": { "halflife": 1.5, "value": 392.5306583978564 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 103.16445759948454 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 367, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 1167.2011139418014 }, "state": "open", "uptime": 16.621657981 } ] 2024-09-21T03:27:01.479 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-21T03:27:01.479 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T03:27:01.480 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T03:27:01.530 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T03:27:01.585 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T03:27:01.585 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T03:27:01.585 DEBUG:tasks.cephfs.mount:terminating RemoteProcess(client=, args=['stdin-killer', '--', 'python3', '-c', '\nimport fcntl\nimport sys\nimport time\nimport os\n\nfcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK)\n\nn = 400\nabs_path = "/home/ubuntu/cephtest/mnt.0/."\n\nif not os.path.exists(abs_path):\n os.makedirs(abs_path)\n\nhandles = []\nfor i in range(0, n):\n fname = "file_"+str(i)\n path = os.path.join(abs_path, fname)\n handles.append(open(path, \'w\'))\n\nprint("waiting with handles open", file=sys.stderr)\nwhile True:\n print("open_n_background: keeping files open", file=sys.stderr)\n try:\n if os.read(0, 4096) == b"":\n break\n except BlockingIOError:\n pass\n time.sleep(2)\nprint("stdin closed, goodbye!", file=sys.stderr)\n'], check_status=True, hostname='smithi105') 2024-09-21T03:27:01.586 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:27:01.586 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:27:01.601 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:27:01.602 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:27:01.657 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T03:27:01.811 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.809+0000 7fb5aec70640 1 -- 172.21.15.105:0/3480912204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5a8155ce0 msgr2=0x7fb5a80b45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:01.812 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.809+0000 7fb5aec70640 1 --2- 172.21.15.105:0/3480912204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5a8155ce0 0x7fb5a80b45a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0005fd0 tx=0x7fb5a002a8b0 comp rx=0 tx=0).stop 2024-09-21T03:27:01.812 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.809+0000 7fb5aec70640 1 -- 172.21.15.105:0/3480912204 shutdown_connections 2024-09-21T03:27:01.812 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.809+0000 7fb5aec70640 1 --2- 172.21.15.105:0/3480912204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5a8155ce0 0x7fb5a80b45a0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:01.812 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.810+0000 7fb5aec70640 1 --2- 172.21.15.105:0/3480912204 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb5a815c580 0x7fb5a8070540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:01.812 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.810+0000 7fb5aec70640 1 -- 172.21.15.105:0/3480912204 >> 172.21.15.105:0/3480912204 conn(0x7fb5a806def0 msgr2=0x7fb5a806e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:01.812 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.810+0000 7fb5aec70640 1 -- 172.21.15.105:0/3480912204 shutdown_connections 2024-09-21T03:27:01.812 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.810+0000 7fb5aec70640 1 -- 172.21.15.105:0/3480912204 wait complete. 2024-09-21T03:27:01.813 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.811+0000 7fb5aec70640 1 Processor -- start 2024-09-21T03:27:01.813 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.811+0000 7fb5aec70640 1 -- start start 2024-09-21T03:27:01.815 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.813+0000 7fb5aec70640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5a8074420 0x7fb5a81376f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:01.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.813+0000 7fb5aec70640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5a8155ce0 0x7fb5a81538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:01.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.813+0000 7fb5aec70640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb5a8153e00 0x7fb5a8139780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:01.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.813+0000 7fb5aec70640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a80b5060 con 0x7fb5a8155ce0 2024-09-21T03:27:01.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.813+0000 7fb5aec70640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a80b4ee0 con 0x7fb5a8074420 2024-09-21T03:27:01.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.813+0000 7fb5aec70640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb5a80b51e0 con 0x7fb5a8153e00 2024-09-21T03:27:01.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.813+0000 7fb59ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5a8155ce0 0x7fb5a81538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:01.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.813+0000 7fb59ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5a8155ce0 0x7fb5a81538c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:57934/0 (socket says 172.21.15.105:57934) 2024-09-21T03:27:01.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.813+0000 7fb59ffff640 1 -- 172.21.15.105:0/1937913510 learned_addr learned my addr 172.21.15.105:0/1937913510 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:01.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.813+0000 7fb5ad20d640 1 --2- 172.21.15.105:0/1937913510 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb5a8153e00 0x7fb5a8139780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:01.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.813+0000 7fb5aca0c640 1 --2- 172.21.15.105:0/1937913510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5a8074420 0x7fb5a81376f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:01.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.813+0000 7fb59ffff640 1 -- 172.21.15.105:0/1937913510 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb5a8153e00 msgr2=0x7fb5a8139780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:01.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.813+0000 7fb59ffff640 1 --2- 172.21.15.105:0/1937913510 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb5a8153e00 0x7fb5a8139780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:01.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.813+0000 7fb59ffff640 1 -- 172.21.15.105:0/1937913510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5a8074420 msgr2=0x7fb5a81376f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:01.816 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.813+0000 7fb59ffff640 1 --2- 172.21.15.105:0/1937913510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5a8074420 0x7fb5a81376f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:01.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.813+0000 7fb59ffff640 1 -- 172.21.15.105:0/1937913510 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a8153130 con 0x7fb5a8155ce0 2024-09-21T03:27:01.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.813+0000 7fb59ffff640 1 --2- 172.21.15.105:0/1937913510 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5a8155ce0 0x7fb5a81538c0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fb59800e9f0 tx=0x7fb59800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:01.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.813+0000 7fb59d7fa640 1 -- 172.21.15.105:0/1937913510 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb59800cd80 con 0x7fb5a8155ce0 2024-09-21T03:27:01.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.814+0000 7fb5aec70640 1 -- 172.21.15.105:0/1937913510 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5a814edb0 con 0x7fb5a8155ce0 2024-09-21T03:27:01.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.814+0000 7fb59d7fa640 1 -- 172.21.15.105:0/1937913510 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb598004020 con 0x7fb5a8155ce0 2024-09-21T03:27:01.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.814+0000 7fb59d7fa640 1 -- 172.21.15.105:0/1937913510 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb598004470 con 0x7fb5a8155ce0 2024-09-21T03:27:01.817 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.814+0000 7fb5aec70640 1 -- 172.21.15.105:0/1937913510 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5a81533a0 con 0x7fb5a8155ce0 2024-09-21T03:27:01.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.814+0000 7fb5aec70640 1 -- 172.21.15.105:0/1937913510 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5a80b5700 con 0x7fb5a8155ce0 2024-09-21T03:27:01.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.815+0000 7fb59d7fa640 1 -- 172.21.15.105:0/1937913510 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb5980035f0 con 0x7fb5a8155ce0 2024-09-21T03:27:01.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.816+0000 7fb59d7fa640 1 --2- 172.21.15.105:0/1937913510 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb594078b90 0x7fb59407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:01.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.816+0000 7fb59d7fa640 1 -- 172.21.15.105:0/1937913510 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7fb59809b5c0 con 0x7fb5a8155ce0 2024-09-21T03:27:01.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.816+0000 7fb5aca0c640 1 --2- 172.21.15.105:0/1937913510 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb594078b90 0x7fb59407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:01.818 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.817+0000 7fb5aca0c640 1 --2- 172.21.15.105:0/1937913510 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb594078b90 0x7fb59407b0a0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4007fd0 tx=0x7fb5a4001370 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:01.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:01.820+0000 7fb59d7fa640 1 -- 172.21.15.105:0/1937913510 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb598063330 con 0x7fb5a8155ce0 2024-09-21T03:27:02.011 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.008+0000 7fb5aec70640 1 -- 172.21.15.105:0/1937913510 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb5a80d1580 con 0x7fb5a8155ce0 2024-09-21T03:27:02.011 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.008+0000 7fb59d7fa640 1 -- 172.21.15.105:0/1937913510 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v129) ==== 80+0+0 (secure 0 0 0) 0x7fb598067d60 con 0x7fb5a8155ce0 2024-09-21T03:27:02.011 INFO:teuthology.orchestra.run.smithi105.stderr:listed 0 entries 2024-09-21T03:27:02.012 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.010+0000 7fb5aec70640 1 -- 172.21.15.105:0/1937913510 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb594078b90 msgr2=0x7fb59407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:02.012 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.010+0000 7fb5aec70640 1 --2- 172.21.15.105:0/1937913510 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb594078b90 0x7fb59407b0a0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4007fd0 tx=0x7fb5a4001370 comp rx=0 tx=0).stop 2024-09-21T03:27:02.012 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.010+0000 7fb5aec70640 1 -- 172.21.15.105:0/1937913510 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5a8155ce0 msgr2=0x7fb5a81538c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:02.012 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.010+0000 7fb5aec70640 1 --2- 172.21.15.105:0/1937913510 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5a8155ce0 0x7fb5a81538c0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fb59800e9f0 tx=0x7fb59800eeb0 comp rx=0 tx=0).stop 2024-09-21T03:27:02.012 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.010+0000 7fb5aec70640 1 -- 172.21.15.105:0/1937913510 shutdown_connections 2024-09-21T03:27:02.012 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.010+0000 7fb5aec70640 1 --2- 172.21.15.105:0/1937913510 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb594078b90 0x7fb59407b0a0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:02.013 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.010+0000 7fb5aec70640 1 --2- 172.21.15.105:0/1937913510 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb5a8153e00 0x7fb5a8139780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:02.013 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.010+0000 7fb5aec70640 1 --2- 172.21.15.105:0/1937913510 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5a8155ce0 0x7fb5a81538c0 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:02.013 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.010+0000 7fb5aec70640 1 --2- 172.21.15.105:0/1937913510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5a8074420 0x7fb5a81376f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:02.013 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.010+0000 7fb5aec70640 1 -- 172.21.15.105:0/1937913510 >> 172.21.15.105:0/1937913510 conn(0x7fb5a806def0 msgr2=0x7fb5a80cf9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:02.013 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.010+0000 7fb5aec70640 1 -- 172.21.15.105:0/1937913510 shutdown_connections 2024-09-21T03:27:02.013 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.010+0000 7fb5aec70640 1 -- 172.21.15.105:0/1937913510 wait complete. 2024-09-21T03:27:02.023 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T03:27:02.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:27:02.023 DEBUG:teuthology.orchestra.run.smithi105:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T03:27:02.152 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi105.front.sepia.ceph.com 2024-09-21T03:27:02.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:27:02.152 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T03:27:02.170 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T03:27:02.170 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:27:02.171 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:27:02.186 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:27:02.186 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:27:02.242 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T03:27:02.357 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.355+0000 7f5fd0c94640 1 -- 172.21.15.105:0/1579223316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5fcc0d2630 msgr2=0x7f5fcc15d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:02.357 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.355+0000 7f5fd0c94640 1 --2- 172.21.15.105:0/1579223316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5fcc0d2630 0x7f5fcc15d130 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc074e30 tx=0x7f5fb402a530 comp rx=0 tx=0).stop 2024-09-21T03:27:02.357 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.355+0000 7f5fd0c94640 1 -- 172.21.15.105:0/1579223316 shutdown_connections 2024-09-21T03:27:02.357 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.355+0000 7f5fd0c94640 1 --2- 172.21.15.105:0/1579223316 >> v2:172.21.15.162:3300/0 conn(0x7f5fcc15d670 0x7f5fcc0b7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:02.357 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.355+0000 7f5fd0c94640 1 --2- 172.21.15.105:0/1579223316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5fcc0d2630 0x7f5fcc15d130 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:02.358 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.355+0000 7f5fd0c94640 1 -- 172.21.15.105:0/1579223316 >> 172.21.15.105:0/1579223316 conn(0x7f5fcc06d550 msgr2=0x7f5fcc071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:02.358 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.355+0000 7f5fd0c94640 1 -- 172.21.15.105:0/1579223316 shutdown_connections 2024-09-21T03:27:02.358 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.355+0000 7f5fd0c94640 1 -- 172.21.15.105:0/1579223316 wait complete. 2024-09-21T03:27:02.358 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.357+0000 7f5fd0c94640 1 Processor -- start 2024-09-21T03:27:02.359 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.357+0000 7f5fd0c94640 1 -- start start 2024-09-21T03:27:02.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.358+0000 7f5fd0c94640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5fcc1570e0 0x7f5fcc1e8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:02.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.358+0000 7f5fd0c94640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5fcc15d670 0x7f5fcc14be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:02.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.358+0000 7f5fd0c94640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5fcc0b4290 0x7f5fcc0b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:02.361 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.358+0000 7f5fd0c94640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5fcc0b7d60 con 0x7f5fcc1570e0 2024-09-21T03:27:02.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.358+0000 7f5fd0c94640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5fcc0b7be0 con 0x7f5fcc0b4290 2024-09-21T03:27:02.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.358+0000 7f5fd0c94640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5fcc0b7ee0 con 0x7f5fcc15d670 2024-09-21T03:27:02.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.358+0000 7f5fca59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5fcc1570e0 0x7f5fcc1e8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:02.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.359+0000 7f5fca59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5fcc1570e0 0x7f5fcc1e8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:57948/0 (socket says 172.21.15.105:57948) 2024-09-21T03:27:02.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.359+0000 7f5fca59c640 1 -- 172.21.15.105:0/1987741491 learned_addr learned my addr 172.21.15.105:0/1987741491 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:02.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.359+0000 7f5fcad9d640 1 --2- 172.21.15.105:0/1987741491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5fcc0b4290 0x7f5fcc0b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:02.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.359+0000 7f5fca59c640 1 -- 172.21.15.105:0/1987741491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5fcc15d670 msgr2=0x7f5fcc14be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:02.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.359+0000 7f5fca59c640 1 --2- 172.21.15.105:0/1987741491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5fcc15d670 0x7f5fcc14be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:02.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.359+0000 7f5fca59c640 1 -- 172.21.15.105:0/1987741491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5fcc0b4290 msgr2=0x7f5fcc0b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:02.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.359+0000 7f5fca59c640 1 --2- 172.21.15.105:0/1987741491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5fcc0b4290 0x7f5fcc0b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:02.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.359+0000 7f5fca59c640 1 -- 172.21.15.105:0/1987741491 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fcc1e80f0 con 0x7f5fcc1570e0 2024-09-21T03:27:02.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.359+0000 7f5fcad9d640 1 --2- 172.21.15.105:0/1987741491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5fcc0b4290 0x7f5fcc0b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:27:02.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.359+0000 7f5fca59c640 1 --2- 172.21.15.105:0/1987741491 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5fcc1570e0 0x7f5fcc1e8f10 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc00c7d0 tx=0x7f5fbc00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:02.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.359+0000 7f5fc2ffd640 1 -- 172.21.15.105:0/1987741491 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc017070 con 0x7f5fcc1570e0 2024-09-21T03:27:02.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.359+0000 7f5fc2ffd640 1 -- 172.21.15.105:0/1987741491 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5fbc005070 con 0x7f5fcc1570e0 2024-09-21T03:27:02.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.359+0000 7f5fc2ffd640 1 -- 172.21.15.105:0/1987741491 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc0054a0 con 0x7f5fcc1570e0 2024-09-21T03:27:02.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.359+0000 7f5fd0c94640 1 -- 172.21.15.105:0/1987741491 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fcc1e83d0 con 0x7f5fcc1570e0 2024-09-21T03:27:02.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.359+0000 7f5fd0c94640 1 -- 172.21.15.105:0/1987741491 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fcc1e8990 con 0x7f5fcc1570e0 2024-09-21T03:27:02.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.360+0000 7f5fd0c94640 1 -- 172.21.15.105:0/1987741491 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fcc15d130 con 0x7f5fcc1570e0 2024-09-21T03:27:02.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.361+0000 7f5fc2ffd640 1 -- 172.21.15.105:0/1987741491 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5fbc01a070 con 0x7f5fcc1570e0 2024-09-21T03:27:02.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.362+0000 7f5fc2ffd640 1 --2- 172.21.15.105:0/1987741491 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5fac078bc0 0x7f5fac07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:02.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.362+0000 7f5fc2ffd640 1 -- 172.21.15.105:0/1987741491 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7f5fbc09a280 con 0x7f5fcc1570e0 2024-09-21T03:27:02.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.362+0000 7f5fc9d9b640 1 --2- 172.21.15.105:0/1987741491 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5fac078bc0 0x7f5fac07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:02.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.363+0000 7f5fc9d9b640 1 --2- 172.21.15.105:0/1987741491 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5fac078bc0 0x7f5fac07b0d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4034000 tx=0x7f5fb40046c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:02.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.366+0000 7f5fc2ffd640 1 -- 172.21.15.105:0/1987741491 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5fbc0627e0 con 0x7f5fcc1570e0 2024-09-21T03:27:02.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.555+0000 7f5fd0c94640 1 -- 172.21.15.105:0/1987741491 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5fcc0d0ee0 con 0x7f5fcc1570e0 2024-09-21T03:27:02.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.555+0000 7f5fc2ffd640 1 -- 172.21.15.105:0/1987741491 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v129) ==== 80+0+0 (secure 0 0 0) 0x7f5fbc0620e0 con 0x7f5fcc1570e0 2024-09-21T03:27:02.557 INFO:teuthology.orchestra.run.smithi105.stderr:listed 0 entries 2024-09-21T03:27:02.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.557+0000 7f5fd0c94640 1 -- 172.21.15.105:0/1987741491 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5fac078bc0 msgr2=0x7f5fac07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:02.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.557+0000 7f5fd0c94640 1 --2- 172.21.15.105:0/1987741491 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5fac078bc0 0x7f5fac07b0d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4034000 tx=0x7f5fb40046c0 comp rx=0 tx=0).stop 2024-09-21T03:27:02.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.557+0000 7f5fd0c94640 1 -- 172.21.15.105:0/1987741491 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5fcc1570e0 msgr2=0x7f5fcc1e8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:02.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.557+0000 7f5fd0c94640 1 --2- 172.21.15.105:0/1987741491 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5fcc1570e0 0x7f5fcc1e8f10 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc00c7d0 tx=0x7f5fbc00cc90 comp rx=0 tx=0).stop 2024-09-21T03:27:02.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.557+0000 7f5fd0c94640 1 -- 172.21.15.105:0/1987741491 shutdown_connections 2024-09-21T03:27:02.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.557+0000 7f5fd0c94640 1 --2- 172.21.15.105:0/1987741491 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5fac078bc0 0x7f5fac07b0d0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:02.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.557+0000 7f5fd0c94640 1 --2- 172.21.15.105:0/1987741491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5fcc0b4290 0x7f5fcc0b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:02.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.557+0000 7f5fd0c94640 1 --2- 172.21.15.105:0/1987741491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5fcc15d670 0x7f5fcc14be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:02.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.557+0000 7f5fd0c94640 1 --2- 172.21.15.105:0/1987741491 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5fcc1570e0 0x7f5fcc1e8f10 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:02.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.557+0000 7f5fd0c94640 1 -- 172.21.15.105:0/1987741491 >> 172.21.15.105:0/1987741491 conn(0x7f5fcc06d550 msgr2=0x7f5fcc0d1400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:02.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.557+0000 7f5fd0c94640 1 -- 172.21.15.105:0/1987741491 shutdown_connections 2024-09-21T03:27:02.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.557+0000 7f5fd0c94640 1 -- 172.21.15.105:0/1987741491 wait complete. 2024-09-21T03:27:02.570 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-21T03:27:02.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:27:02.570 DEBUG:teuthology.orchestra.run.smithi162:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-21T03:27:02.599 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2024-09-21T03:27:02.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:27:02.599 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-21T03:27:02.655 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T03:27:02.655 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:27:02.655 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:27:02.671 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T03:27:02.671 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T03:27:02.671 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:27:02.671 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:27:02.710 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=452 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T03:27:02.711 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:27:02.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.822+0000 7f5a44390640 1 -- 172.21.15.105:0/3996750092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a3c0b7fe0 msgr2=0x7f5a3c0d0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:02.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.822+0000 7f5a44390640 1 --2- 172.21.15.105:0/3996750092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a3c0b7fe0 0x7f5a3c0d0190 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f5a38005fd0 tx=0x7f5a3802a540 comp rx=0 tx=0).stop 2024-09-21T03:27:02.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.822+0000 7f5a44390640 1 -- 172.21.15.105:0/3996750092 shutdown_connections 2024-09-21T03:27:02.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.822+0000 7f5a44390640 1 --2- 172.21.15.105:0/3996750092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a3c0b7fe0 0x7f5a3c0d0190 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:02.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.822+0000 7f5a44390640 1 --2- 172.21.15.105:0/3996750092 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a3c0cf440 0x7f5a3c15c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:02.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.822+0000 7f5a44390640 1 -- 172.21.15.105:0/3996750092 >> 172.21.15.105:0/3996750092 conn(0x7f5a3c0710b0 msgr2=0x7f5a3c0714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:02.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.822+0000 7f5a44390640 1 -- 172.21.15.105:0/3996750092 shutdown_connections 2024-09-21T03:27:02.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.822+0000 7f5a44390640 1 -- 172.21.15.105:0/3996750092 wait complete. 2024-09-21T03:27:02.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.824+0000 7f5a44390640 1 Processor -- start 2024-09-21T03:27:02.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.824+0000 7f5a44390640 1 -- start start 2024-09-21T03:27:02.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.825+0000 7f5a44390640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a3c0b7fe0 0x7f5a3c1497c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:02.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.825+0000 7f5a44390640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a3c0cd360 0x7f5a3c0cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:02.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.825+0000 7f5a44390640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a3c1f6150 0x7f5a3c1f6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:02.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.825+0000 7f5a44390640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3c0d0b70 con 0x7f5a3c1f6150 2024-09-21T03:27:02.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.825+0000 7f5a44390640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3c0d09f0 con 0x7f5a3c0cd360 2024-09-21T03:27:02.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.825+0000 7f5a44390640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5a3c0d0cf0 con 0x7f5a3c0b7fe0 2024-09-21T03:27:02.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.826+0000 7f5a4292d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a3c1f6150 0x7f5a3c1f6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:02.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.826+0000 7f5a4292d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a3c1f6150 0x7f5a3c1f6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:57964/0 (socket says 172.21.15.105:57964) 2024-09-21T03:27:02.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.826+0000 7f5a4292d640 1 -- 172.21.15.105:0/3574720317 learned_addr learned my addr 172.21.15.105:0/3574720317 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:02.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.826+0000 7f5a4292d640 1 -- 172.21.15.105:0/3574720317 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a3c0b7fe0 msgr2=0x7f5a3c1497c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T03:27:02.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.826+0000 7f5a4292d640 1 --2- 172.21.15.105:0/3574720317 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a3c0b7fe0 0x7f5a3c1497c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:02.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.826+0000 7f5a4292d640 1 -- 172.21.15.105:0/3574720317 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a3c0cd360 msgr2=0x7f5a3c0cafe0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T03:27:02.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.826+0000 7f5a4292d640 1 --2- 172.21.15.105:0/3574720317 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a3c0cd360 0x7f5a3c0cafe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:02.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.826+0000 7f5a4292d640 1 -- 172.21.15.105:0/3574720317 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a3c1f6aa0 con 0x7f5a3c1f6150 2024-09-21T03:27:02.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.826+0000 7f5a4292d640 1 --2- 172.21.15.105:0/3574720317 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a3c1f6150 0x7f5a3c1f6560 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f5a38006010 tx=0x7f5a38003890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:02.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.826+0000 7f5a32ffd640 1 -- 172.21.15.105:0/3574720317 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a3803e030 con 0x7f5a3c1f6150 2024-09-21T03:27:02.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.826+0000 7f5a32ffd640 1 -- 172.21.15.105:0/3574720317 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a38003d80 con 0x7f5a3c1f6150 2024-09-21T03:27:02.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.826+0000 7f5a44390640 1 -- 172.21.15.105:0/3574720317 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a3c15ce10 con 0x7f5a3c1f6150 2024-09-21T03:27:02.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.826+0000 7f5a32ffd640 1 -- 172.21.15.105:0/3574720317 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a38035040 con 0x7f5a3c1f6150 2024-09-21T03:27:02.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.826+0000 7f5a44390640 1 -- 172.21.15.105:0/3574720317 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a3c0cba30 con 0x7f5a3c1f6150 2024-09-21T03:27:02.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.827+0000 7f5a44390640 1 -- 172.21.15.105:0/3574720317 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a3c0d1210 con 0x7f5a3c1f6150 2024-09-21T03:27:02.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.828+0000 7f5a32ffd640 1 -- 172.21.15.105:0/3574720317 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5a38041030 con 0x7f5a3c1f6150 2024-09-21T03:27:02.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.828+0000 7f5a32ffd640 1 --2- 172.21.15.105:0/3574720317 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5a20078bc0 0x7f5a2007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:02.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.828+0000 7f5a32ffd640 1 -- 172.21.15.105:0/3574720317 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7f5a380bb840 con 0x7f5a3c1f6150 2024-09-21T03:27:02.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.829+0000 7f5a4212c640 1 --2- 172.21.15.105:0/3574720317 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5a20078bc0 0x7f5a2007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:02.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.829+0000 7f5a4212c640 1 --2- 172.21.15.105:0/3574720317 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5a20078bc0 0x7f5a2007b0d0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f5a34001b80 tx=0x7f5a34007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:02.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:02.833+0000 7f5a32ffd640 1 -- 172.21.15.105:0/3574720317 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5a3c1f6aa0 con 0x7f5a3c1f6150 2024-09-21T03:27:03.046 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.045+0000 7f5a44390640 1 -- 172.21.15.105:0/3574720317 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a3c0cb750 con 0x7f5a3c1f6150 2024-09-21T03:27:03.047 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.045+0000 7f5a32ffd640 1 -- 172.21.15.105:0/3574720317 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5233 (secure 0 0 0) 0x7f5a38083c80 con 0x7f5a3c1f6150 2024-09-21T03:27:03.047 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:27:03.047 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":86,"btime":"2024-09-21T03:26:58:479758+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6494,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2298697835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2298697835},{"type":"v1","addr":"172.21.15.162:6836","nonce":2298697835}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":6500,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/680091076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":680091076},{"type":"v1","addr":"172.21.15.105:6835","nonce":680091076}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8013,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/4094879618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":4094879618},{"type":"v1","addr":"172.21.15.105:6833","nonce":4094879618}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:26:33.112228+0000","modified":"2024-09-21T03:26:57.793673+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8022},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8022":{"gid":8022,"name":"b","rank":0,"incarnation":81,"state":"up:active","state_seq":9,"addr":"172.21.15.162:6837/712373587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":712373587},{"type":"v1","addr":"172.21.15.162:6837","nonce":712373587}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8022,"qdb_cluster":[8022]},"id":10}]} 2024-09-21T03:27:03.047 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 86 2024-09-21T03:27:03.049 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.047+0000 7f5a44390640 1 -- 172.21.15.105:0/3574720317 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5a20078bc0 msgr2=0x7f5a2007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:03.049 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.047+0000 7f5a44390640 1 --2- 172.21.15.105:0/3574720317 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5a20078bc0 0x7f5a2007b0d0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f5a34001b80 tx=0x7f5a34007d30 comp rx=0 tx=0).stop 2024-09-21T03:27:03.049 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.047+0000 7f5a44390640 1 -- 172.21.15.105:0/3574720317 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a3c1f6150 msgr2=0x7f5a3c1f6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:03.050 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.047+0000 7f5a44390640 1 --2- 172.21.15.105:0/3574720317 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a3c1f6150 0x7f5a3c1f6560 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f5a38006010 tx=0x7f5a38003890 comp rx=0 tx=0).stop 2024-09-21T03:27:03.050 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.047+0000 7f5a44390640 1 -- 172.21.15.105:0/3574720317 shutdown_connections 2024-09-21T03:27:03.050 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.047+0000 7f5a44390640 1 --2- 172.21.15.105:0/3574720317 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5a20078bc0 0x7f5a2007b0d0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:03.050 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.047+0000 7f5a44390640 1 --2- 172.21.15.105:0/3574720317 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a3c1f6150 0x7f5a3c1f6560 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:03.050 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.047+0000 7f5a44390640 1 --2- 172.21.15.105:0/3574720317 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a3c0cd360 0x7f5a3c0cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:03.050 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.047+0000 7f5a44390640 1 --2- 172.21.15.105:0/3574720317 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a3c0b7fe0 0x7f5a3c1497c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:03.050 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.047+0000 7f5a44390640 1 -- 172.21.15.105:0/3574720317 >> 172.21.15.105:0/3574720317 conn(0x7f5a3c0710b0 msgr2=0x7f5a3c0b5810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:03.050 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.047+0000 7f5a44390640 1 -- 172.21.15.105:0/3574720317 shutdown_connections 2024-09-21T03:27:03.050 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.047+0000 7f5a44390640 1 -- 172.21.15.105:0/3574720317 wait complete. 2024-09-21T03:27:03.061 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:27:03.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.172+0000 7f5f69e94640 1 -- 172.21.15.105:0/251080602 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5f4c003c60 msgr2=0x7f5f4c0040b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:03.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.172+0000 7f5f69e94640 1 --2- 172.21.15.105:0/251080602 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5f4c003c60 0x7f5f4c0040b0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f5f5400c750 tx=0x7f5f4c005830 comp rx=0 tx=0).stop 2024-09-21T03:27:03.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.172+0000 7f5f63fff640 1 -- 172.21.15.105:0/251080602 reap_dead start 2024-09-21T03:27:03.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.172+0000 7f5f69e94640 1 -- 172.21.15.105:0/251080602 shutdown_connections 2024-09-21T03:27:03.175 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.172+0000 7f5f69e94640 1 -- 172.21.15.105:0/251080602 >> 172.21.15.105:0/251080602 conn(0x7f5f640cdcb0 msgr2=0x7f5f640ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:03.175 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.172+0000 7f5f69e94640 1 -- 172.21.15.105:0/251080602 shutdown_connections 2024-09-21T03:27:03.175 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.172+0000 7f5f69e94640 1 -- 172.21.15.105:0/251080602 wait complete. 2024-09-21T03:27:03.175 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.174+0000 7f5f69e94640 1 Processor -- start 2024-09-21T03:27:03.176 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.174+0000 7f5f69e94640 1 -- start start 2024-09-21T03:27:03.178 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.175+0000 7f5f69e94640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5f4c003c60 0x7f5f640caf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:03.179 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.175+0000 7f5f69e94640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f6414b120 0x7f5f6414b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:03.179 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.175+0000 7f5f69e94640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f641f22d0 0x7f5f641f26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:03.179 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.175+0000 7f5f69e94640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5f640b3450 con 0x7f5f4c003c60 2024-09-21T03:27:03.179 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.175+0000 7f5f69e94640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5f640b32d0 con 0x7f5f641f22d0 2024-09-21T03:27:03.179 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.175+0000 7f5f69e94640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5f640adfa0 con 0x7f5f6414b120 2024-09-21T03:27:03.179 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.175+0000 7f5f637fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5f4c003c60 0x7f5f640caf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:03.179 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.175+0000 7f5f637fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5f4c003c60 0x7f5f640caf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:57976/0 (socket says 172.21.15.105:57976) 2024-09-21T03:27:03.179 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.175+0000 7f5f637fe640 1 -- 172.21.15.105:0/508058237 learned_addr learned my addr 172.21.15.105:0/508058237 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:03.179 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.175+0000 7f5f63fff640 1 --2- 172.21.15.105:0/508058237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f641f22d0 0x7f5f641f26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:03.179 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.175+0000 7f5f62ffd640 1 --2- 172.21.15.105:0/508058237 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f6414b120 0x7f5f6414b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:03.180 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.176+0000 7f5f637fe640 1 -- 172.21.15.105:0/508058237 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f6414b120 msgr2=0x7f5f6414b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:03.180 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.176+0000 7f5f637fe640 1 --2- 172.21.15.105:0/508058237 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f6414b120 0x7f5f6414b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:03.180 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.176+0000 7f5f637fe640 1 -- 172.21.15.105:0/508058237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f641f22d0 msgr2=0x7f5f641f26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:03.180 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.176+0000 7f5f637fe640 1 --2- 172.21.15.105:0/508058237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f641f22d0 0x7f5f641f26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:03.180 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.176+0000 7f5f637fe640 1 -- 172.21.15.105:0/508058237 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f6414bce0 con 0x7f5f4c003c60 2024-09-21T03:27:03.180 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.176+0000 7f5f637fe640 1 --2- 172.21.15.105:0/508058237 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5f4c003c60 0x7f5f640caf70 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f5f5400c330 tx=0x7f5f5400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:03.180 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.176+0000 7f5f4bfff640 1 -- 172.21.15.105:0/508058237 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f54005de0 con 0x7f5f4c003c60 2024-09-21T03:27:03.180 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.176+0000 7f5f4bfff640 1 -- 172.21.15.105:0/508058237 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f5402b910 con 0x7f5f4c003c60 2024-09-21T03:27:03.180 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.176+0000 7f5f4bfff640 1 -- 172.21.15.105:0/508058237 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f5402bd40 con 0x7f5f4c003c60 2024-09-21T03:27:03.180 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.176+0000 7f5f69e94640 1 -- 172.21.15.105:0/508058237 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f6414bfc0 con 0x7f5f4c003c60 2024-09-21T03:27:03.180 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.176+0000 7f5f69e94640 1 -- 172.21.15.105:0/508058237 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f6409c3b0 con 0x7f5f4c003c60 2024-09-21T03:27:03.181 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.177+0000 7f5f69e94640 1 -- 172.21.15.105:0/508058237 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f640ae4b0 con 0x7f5f4c003c60 2024-09-21T03:27:03.181 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.178+0000 7f5f4bfff640 1 -- 172.21.15.105:0/508058237 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5f54006030 con 0x7f5f4c003c60 2024-09-21T03:27:03.181 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.178+0000 7f5f4bfff640 1 --2- 172.21.15.105:0/508058237 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5f50078b90 0x7f5f5007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:03.182 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.178+0000 7f5f4bfff640 1 -- 172.21.15.105:0/508058237 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7f5f540bacc0 con 0x7f5f4c003c60 2024-09-21T03:27:03.182 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.178+0000 7f5f62ffd640 1 --2- 172.21.15.105:0/508058237 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5f50078b90 0x7f5f5007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:03.182 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.179+0000 7f5f62ffd640 1 --2- 172.21.15.105:0/508058237 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5f50078b90 0x7f5f5007b0a0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f5f640693c0 tx=0x7f5f58006c10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:03.184 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.183+0000 7f5f4bfff640 1 -- 172.21.15.105:0/508058237 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5f54048030 con 0x7f5f4c003c60 2024-09-21T03:27:03.395 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.394+0000 7f5f69e94640 1 -- 172.21.15.105:0/508058237 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5f64069110 con 0x7f5f4c003c60 2024-09-21T03:27:03.396 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.395+0000 7f5f4bfff640 1 -- 172.21.15.105:0/508058237 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5233 (secure 0 0 0) 0x7f5f640b3600 con 0x7f5f4c003c60 2024-09-21T03:27:03.396 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:27:03.396 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":86,"btime":"2024-09-21T03:26:58:479758+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6494,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2298697835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2298697835},{"type":"v1","addr":"172.21.15.162:6836","nonce":2298697835}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":6500,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/680091076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":680091076},{"type":"v1","addr":"172.21.15.105:6835","nonce":680091076}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8013,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/4094879618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":4094879618},{"type":"v1","addr":"172.21.15.105:6833","nonce":4094879618}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:26:33.112228+0000","modified":"2024-09-21T03:26:57.793673+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8022},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8022":{"gid":8022,"name":"b","rank":0,"incarnation":81,"state":"up:active","state_seq":9,"addr":"172.21.15.162:6837/712373587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":712373587},{"type":"v1","addr":"172.21.15.162:6837","nonce":712373587}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8022,"qdb_cluster":[8022]},"id":10}]} 2024-09-21T03:27:03.397 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 86 2024-09-21T03:27:03.399 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.397+0000 7f5f69e94640 1 -- 172.21.15.105:0/508058237 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5f50078b90 msgr2=0x7f5f5007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:03.399 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.397+0000 7f5f69e94640 1 --2- 172.21.15.105:0/508058237 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5f50078b90 0x7f5f5007b0a0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f5f640693c0 tx=0x7f5f58006c10 comp rx=0 tx=0).stop 2024-09-21T03:27:03.399 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.397+0000 7f5f69e94640 1 -- 172.21.15.105:0/508058237 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5f4c003c60 msgr2=0x7f5f640caf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:03.399 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.397+0000 7f5f69e94640 1 --2- 172.21.15.105:0/508058237 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5f4c003c60 0x7f5f640caf70 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f5f5400c330 tx=0x7f5f5400c3a0 comp rx=0 tx=0).stop 2024-09-21T03:27:03.399 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.397+0000 7f5f69e94640 1 -- 172.21.15.105:0/508058237 shutdown_connections 2024-09-21T03:27:03.399 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.397+0000 7f5f69e94640 1 --2- 172.21.15.105:0/508058237 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5f50078b90 0x7f5f5007b0a0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:03.399 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.397+0000 7f5f69e94640 1 --2- 172.21.15.105:0/508058237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f641f22d0 0x7f5f641f26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:03.399 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.397+0000 7f5f69e94640 1 --2- 172.21.15.105:0/508058237 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f6414b120 0x7f5f6414b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:03.399 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.397+0000 7f5f69e94640 1 --2- 172.21.15.105:0/508058237 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5f4c003c60 0x7f5f640caf70 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:03.399 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.397+0000 7f5f69e94640 1 -- 172.21.15.105:0/508058237 >> 172.21.15.105:0/508058237 conn(0x7f5f640cdcb0 msgr2=0x7f5f640b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:03.399 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.397+0000 7f5f69e94640 1 -- 172.21.15.105:0/508058237 shutdown_connections 2024-09-21T03:27:03.400 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.397+0000 7f5f69e94640 1 -- 172.21.15.105:0/508058237 wait complete. 2024-09-21T03:27:03.410 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:27:03.523 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.521+0000 7f4171341640 1 -- 172.21.15.105:0/866736309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4158003c10 msgr2=0x7f4158004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:03.523 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.521+0000 7f4171341640 1 --2- 172.21.15.105:0/866736309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4158003c10 0x7f4158004060 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f415c009ed0 tx=0x7f4158005830 comp rx=0 tx=0).stop 2024-09-21T03:27:03.523 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.521+0000 7f416b7fe640 1 -- 172.21.15.105:0/866736309 reap_dead start 2024-09-21T03:27:03.523 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.521+0000 7f4171341640 1 -- 172.21.15.105:0/866736309 shutdown_connections 2024-09-21T03:27:03.523 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.521+0000 7f4171341640 1 -- 172.21.15.105:0/866736309 >> 172.21.15.105:0/866736309 conn(0x7f416c09d8f0 msgr2=0x7f416c0d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:03.523 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.521+0000 7f4171341640 1 -- 172.21.15.105:0/866736309 shutdown_connections 2024-09-21T03:27:03.523 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.521+0000 7f4171341640 1 -- 172.21.15.105:0/866736309 wait complete. 2024-09-21T03:27:03.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.523+0000 7f4171341640 1 Processor -- start 2024-09-21T03:27:03.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.523+0000 7f4171341640 1 -- start start 2024-09-21T03:27:03.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.525+0000 7f4171341640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4158003c10 0x7f416c14a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:03.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.525+0000 7f4171341640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f416c0b6c50 0x7f416c14ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:03.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.525+0000 7f4171341640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f416c0b4000 0x7f416c0ca590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:03.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.525+0000 7f4171341640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f416c0d1f10 con 0x7f416c0b6c50 2024-09-21T03:27:03.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.525+0000 7f4171341640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f416c0d1d90 con 0x7f4158003c10 2024-09-21T03:27:03.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.525+0000 7f4171341640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f416c0d0fb0 con 0x7f416c0b4000 2024-09-21T03:27:03.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.525+0000 7f416a7fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f416c0b6c50 0x7f416c14ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:03.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.525+0000 7f416a7fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f416c0b6c50 0x7f416c14ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58002/0 (socket says 172.21.15.105:58002) 2024-09-21T03:27:03.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.525+0000 7f416a7fc640 1 -- 172.21.15.105:0/519803290 learned_addr learned my addr 172.21.15.105:0/519803290 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:03.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.525+0000 7f416affd640 1 --2- 172.21.15.105:0/519803290 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4158003c10 0x7f416c14a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:03.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.525+0000 7f416b7fe640 1 --2- 172.21.15.105:0/519803290 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f416c0b4000 0x7f416c0ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:03.528 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.525+0000 7f416a7fc640 1 -- 172.21.15.105:0/519803290 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f416c0b4000 msgr2=0x7f416c0ca590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:03.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.525+0000 7f416a7fc640 1 --2- 172.21.15.105:0/519803290 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f416c0b4000 0x7f416c0ca590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:03.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.525+0000 7f416a7fc640 1 -- 172.21.15.105:0/519803290 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4158003c10 msgr2=0x7f416c14a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:03.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.525+0000 7f416a7fc640 1 --2- 172.21.15.105:0/519803290 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4158003c10 0x7f416c14a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:03.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.525+0000 7f416a7fc640 1 -- 172.21.15.105:0/519803290 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f416c0b5e90 con 0x7f416c0b6c50 2024-09-21T03:27:03.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.525+0000 7f416a7fc640 1 --2- 172.21.15.105:0/519803290 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f416c0b6c50 0x7f416c14ad70 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f41540010e0 tx=0x7f41540039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:03.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.525+0000 7f41637fe640 1 -- 172.21.15.105:0/519803290 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4154015070 con 0x7f416c0b6c50 2024-09-21T03:27:03.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.525+0000 7f41637fe640 1 -- 172.21.15.105:0/519803290 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f415400fa40 con 0x7f416c0b6c50 2024-09-21T03:27:03.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.525+0000 7f41637fe640 1 -- 172.21.15.105:0/519803290 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415400fe90 con 0x7f416c0b6c50 2024-09-21T03:27:03.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.525+0000 7f4171341640 1 -- 172.21.15.105:0/519803290 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f416c0b6170 con 0x7f416c0b6c50 2024-09-21T03:27:03.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.525+0000 7f4171341640 1 -- 172.21.15.105:0/519803290 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f416c1604f0 con 0x7f416c0b6c50 2024-09-21T03:27:03.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.526+0000 7f4171341640 1 -- 172.21.15.105:0/519803290 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f416c162bf0 con 0x7f416c0b6c50 2024-09-21T03:27:03.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.527+0000 7f41637fe640 1 -- 172.21.15.105:0/519803290 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4154011430 con 0x7f416c0b6c50 2024-09-21T03:27:03.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.528+0000 7f41637fe640 1 --2- 172.21.15.105:0/519803290 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f414c078d30 0x7f414c07b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:03.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.528+0000 7f41637fe640 1 -- 172.21.15.105:0/519803290 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7f415409bb60 con 0x7f416c0b6c50 2024-09-21T03:27:03.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.528+0000 7f416affd640 1 --2- 172.21.15.105:0/519803290 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f414c078d30 0x7f414c07b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:03.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.528+0000 7f416affd640 1 --2- 172.21.15.105:0/519803290 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f414c078d30 0x7f414c07b240 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f415c035000 tx=0x7f415c004a40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:03.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.532+0000 7f41637fe640 1 -- 172.21.15.105:0/519803290 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f416c0d1900 con 0x7f416c0b6c50 2024-09-21T03:27:03.712 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.710+0000 7f4171341640 1 -- 172.21.15.105:0/519803290 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f416c0ba0d0 con 0x7f416c0b6c50 2024-09-21T03:27:03.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.712+0000 7f41637fe640 1 -- 172.21.15.105:0/519803290 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) ==== 74+0+16811 (secure 0 0 0) 0x7f4154064040 con 0x7f416c0b6c50 2024-09-21T03:27:03.713 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:27:03.714 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":129,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:26:34.761871+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:26:30.757426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-21T03:26:32.079246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:27:03.716 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.714+0000 7f4171341640 1 -- 172.21.15.105:0/519803290 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f414c078d30 msgr2=0x7f414c07b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:03.716 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.714+0000 7f4171341640 1 --2- 172.21.15.105:0/519803290 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f414c078d30 0x7f414c07b240 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f415c035000 tx=0x7f415c004a40 comp rx=0 tx=0).stop 2024-09-21T03:27:03.716 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.714+0000 7f4171341640 1 -- 172.21.15.105:0/519803290 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f416c0b6c50 msgr2=0x7f416c14ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:03.716 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.714+0000 7f4171341640 1 --2- 172.21.15.105:0/519803290 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f416c0b6c50 0x7f416c14ad70 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f41540010e0 tx=0x7f41540039c0 comp rx=0 tx=0).stop 2024-09-21T03:27:03.716 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.714+0000 7f4171341640 1 -- 172.21.15.105:0/519803290 shutdown_connections 2024-09-21T03:27:03.716 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.714+0000 7f4171341640 1 --2- 172.21.15.105:0/519803290 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f414c078d30 0x7f414c07b240 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:03.716 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.714+0000 7f4171341640 1 --2- 172.21.15.105:0/519803290 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f416c0b4000 0x7f416c0ca590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:03.716 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.714+0000 7f4171341640 1 --2- 172.21.15.105:0/519803290 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f416c0b6c50 0x7f416c14ad70 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:03.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.714+0000 7f4171341640 1 --2- 172.21.15.105:0/519803290 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4158003c10 0x7f416c14a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:03.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.714+0000 7f4171341640 1 -- 172.21.15.105:0/519803290 >> 172.21.15.105:0/519803290 conn(0x7f416c09d8f0 msgr2=0x7f416c06ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:03.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.714+0000 7f4171341640 1 -- 172.21.15.105:0/519803290 shutdown_connections 2024-09-21T03:27:03.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.714+0000 7f4171341640 1 -- 172.21.15.105:0/519803290 wait complete. 2024-09-21T03:27:03.727 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T03:27:03.728 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:27:03.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.838+0000 7faa8d82e640 1 -- 172.21.15.105:0/2530314353 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa880b3540 msgr2=0x7faa880d3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:03.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.838+0000 7faa8d82e640 1 --2- 172.21.15.105:0/2530314353 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa880b3540 0x7faa880d3330 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7faa7c009900 tx=0x7faa7c02a580 comp rx=0 tx=0).stop 2024-09-21T03:27:03.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.838+0000 7faa8d82e640 1 -- 172.21.15.105:0/2530314353 shutdown_connections 2024-09-21T03:27:03.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.838+0000 7faa8d82e640 1 --2- 172.21.15.105:0/2530314353 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa880d3870 0x7faa880ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:03.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.838+0000 7faa8d82e640 1 --2- 172.21.15.105:0/2530314353 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa880b3540 0x7faa880d3330 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:03.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.838+0000 7faa8d82e640 1 -- 172.21.15.105:0/2530314353 >> 172.21.15.105:0/2530314353 conn(0x7faa8808bfc0 msgr2=0x7faa8809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:03.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.838+0000 7faa8d82e640 1 -- 172.21.15.105:0/2530314353 shutdown_connections 2024-09-21T03:27:03.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.838+0000 7faa8d82e640 1 -- 172.21.15.105:0/2530314353 wait complete. 2024-09-21T03:27:03.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.839+0000 7faa8d82e640 1 Processor -- start 2024-09-21T03:27:03.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.840+0000 7faa8d82e640 1 -- start start 2024-09-21T03:27:03.844 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.841+0000 7faa8d82e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa880b3540 0x7faa880a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:03.844 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.841+0000 7faa8d82e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa880d3870 0x7faa880a0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:03.844 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.841+0000 7faa8d82e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa880cac90 0x7faa880a05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:03.844 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.841+0000 7faa8d82e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7faa880d0e60 con 0x7faa880b3540 2024-09-21T03:27:03.844 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.841+0000 7faa8d82e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faa880d0ce0 con 0x7faa880cac90 2024-09-21T03:27:03.844 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.841+0000 7faa8d82e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faa880d0fe0 con 0x7faa880d3870 2024-09-21T03:27:03.844 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.841+0000 7faa86ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa880b3540 0x7faa880a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:03.844 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.841+0000 7faa86ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa880b3540 0x7faa880a1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58018/0 (socket says 172.21.15.105:58018) 2024-09-21T03:27:03.844 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.841+0000 7faa86ffd640 1 -- 172.21.15.105:0/3573508978 learned_addr learned my addr 172.21.15.105:0/3573508978 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:03.844 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.841+0000 7faa877fe640 1 --2- 172.21.15.105:0/3573508978 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa880cac90 0x7faa880a05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:03.844 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.841+0000 7faa867fc640 1 --2- 172.21.15.105:0/3573508978 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa880d3870 0x7faa880a0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:03.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.841+0000 7faa86ffd640 1 -- 172.21.15.105:0/3573508978 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa880d3870 msgr2=0x7faa880a0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:03.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.841+0000 7faa86ffd640 1 --2- 172.21.15.105:0/3573508978 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa880d3870 0x7faa880a0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:03.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.841+0000 7faa86ffd640 1 -- 172.21.15.105:0/3573508978 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa880cac90 msgr2=0x7faa880a05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:03.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.841+0000 7faa86ffd640 1 --2- 172.21.15.105:0/3573508978 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa880cac90 0x7faa880a05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:03.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.841+0000 7faa86ffd640 1 -- 172.21.15.105:0/3573508978 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa880c9bf0 con 0x7faa880b3540 2024-09-21T03:27:03.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.841+0000 7faa877fe640 1 --2- 172.21.15.105:0/3573508978 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa880cac90 0x7faa880a05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:27:03.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.842+0000 7faa86ffd640 1 --2- 172.21.15.105:0/3573508978 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa880b3540 0x7faa880a1740 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7faa7800c3a0 tx=0x7faa7800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:03.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.842+0000 7faa6ffff640 1 -- 172.21.15.105:0/3573508978 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa780052d0 con 0x7faa880b3540 2024-09-21T03:27:03.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.842+0000 7faa6ffff640 1 -- 172.21.15.105:0/3573508978 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa78007020 con 0x7faa880b3540 2024-09-21T03:27:03.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.842+0000 7faa8d82e640 1 -- 172.21.15.105:0/3573508978 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa880c9ed0 con 0x7faa880b3540 2024-09-21T03:27:03.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.842+0000 7faa6ffff640 1 -- 172.21.15.105:0/3573508978 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa78007470 con 0x7faa880b3540 2024-09-21T03:27:03.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.842+0000 7faa8d82e640 1 -- 172.21.15.105:0/3573508978 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa880ca490 con 0x7faa880b3540 2024-09-21T03:27:03.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.843+0000 7faa8d82e640 1 -- 172.21.15.105:0/3573508978 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa880b1f20 con 0x7faa880b3540 2024-09-21T03:27:03.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.844+0000 7faa6ffff640 1 -- 172.21.15.105:0/3573508978 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faa780067d0 con 0x7faa880b3540 2024-09-21T03:27:03.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.844+0000 7faa6ffff640 1 --2- 172.21.15.105:0/3573508978 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7faa74078bc0 0x7faa7407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:03.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.844+0000 7faa6ffff640 1 -- 172.21.15.105:0/3573508978 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7faa7809a190 con 0x7faa880b3540 2024-09-21T03:27:03.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.844+0000 7faa867fc640 1 --2- 172.21.15.105:0/3573508978 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7faa74078bc0 0x7faa7407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:03.847 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.845+0000 7faa867fc640 1 --2- 172.21.15.105:0/3573508978 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7faa74078bc0 0x7faa7407b0d0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7faa7c033000 tx=0x7faa7c004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:03.850 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:03.849+0000 7faa6ffff640 1 -- 172.21.15.105:0/3573508978 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7faa880b1f20 con 0x7faa880b3540 2024-09-21T03:27:04.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.061+0000 7faa8d82e640 1 -- 172.21.15.105:0/3573508978 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faa880d1540 con 0x7faa880b3540 2024-09-21T03:27:04.063 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.061+0000 7faa6ffff640 1 -- 172.21.15.105:0/3573508978 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5233 (secure 0 0 0) 0x7faa78062660 con 0x7faa880b3540 2024-09-21T03:27:04.063 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:27:04.063 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":86,"btime":"2024-09-21T03:26:58:479758+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6494,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2298697835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2298697835},{"type":"v1","addr":"172.21.15.162:6836","nonce":2298697835}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":6500,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/680091076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":680091076},{"type":"v1","addr":"172.21.15.105:6835","nonce":680091076}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8013,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/4094879618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":4094879618},{"type":"v1","addr":"172.21.15.105:6833","nonce":4094879618}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:26:33.112228+0000","modified":"2024-09-21T03:26:57.793673+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8022},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8022":{"gid":8022,"name":"b","rank":0,"incarnation":81,"state":"up:active","state_seq":9,"addr":"172.21.15.162:6837/712373587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":712373587},{"type":"v1","addr":"172.21.15.162:6837","nonce":712373587}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8022,"qdb_cluster":[8022]},"id":10}]} 2024-09-21T03:27:04.064 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 86 2024-09-21T03:27:04.065 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.063+0000 7faa8d82e640 1 -- 172.21.15.105:0/3573508978 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7faa74078bc0 msgr2=0x7faa7407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:04.066 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.063+0000 7faa8d82e640 1 --2- 172.21.15.105:0/3573508978 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7faa74078bc0 0x7faa7407b0d0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7faa7c033000 tx=0x7faa7c004730 comp rx=0 tx=0).stop 2024-09-21T03:27:04.066 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.064+0000 7faa8d82e640 1 -- 172.21.15.105:0/3573508978 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa880b3540 msgr2=0x7faa880a1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:04.066 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.064+0000 7faa8d82e640 1 --2- 172.21.15.105:0/3573508978 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa880b3540 0x7faa880a1740 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7faa7800c3a0 tx=0x7faa7800c860 comp rx=0 tx=0).stop 2024-09-21T03:27:04.066 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.064+0000 7faa8d82e640 1 -- 172.21.15.105:0/3573508978 shutdown_connections 2024-09-21T03:27:04.066 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.064+0000 7faa8d82e640 1 --2- 172.21.15.105:0/3573508978 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7faa74078bc0 0x7faa7407b0d0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:04.066 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.064+0000 7faa8d82e640 1 --2- 172.21.15.105:0/3573508978 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa880cac90 0x7faa880a05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:04.066 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.064+0000 7faa8d82e640 1 --2- 172.21.15.105:0/3573508978 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa880d3870 0x7faa880a0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:04.066 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.064+0000 7faa8d82e640 1 --2- 172.21.15.105:0/3573508978 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa880b3540 0x7faa880a1740 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:04.066 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.064+0000 7faa8d82e640 1 -- 172.21.15.105:0/3573508978 >> 172.21.15.105:0/3573508978 conn(0x7faa8808bfc0 msgr2=0x7faa88160500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:04.066 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.064+0000 7faa8d82e640 1 -- 172.21.15.105:0/3573508978 shutdown_connections 2024-09-21T03:27:04.066 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.064+0000 7faa8d82e640 1 -- 172.21.15.105:0/3573508978 wait complete. 2024-09-21T03:27:04.077 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:27:04.189 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.187+0000 7f3439b12640 1 -- 172.21.15.105:0/3301961209 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3434070440 msgr2=0x7f3434074b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:04.189 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.187+0000 7f3439b12640 1 --2- 172.21.15.105:0/3301961209 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3434070440 0x7f3434074b80 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f3434070e70 tx=0x7f342c02a980 comp rx=0 tx=0).stop 2024-09-21T03:27:04.189 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.187+0000 7f3439b12640 1 -- 172.21.15.105:0/3301961209 shutdown_connections 2024-09-21T03:27:04.189 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.187+0000 7f3439b12640 1 --2- 172.21.15.105:0/3301961209 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3434070440 0x7f3434074b80 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:04.189 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.187+0000 7f3439b12640 1 --2- 172.21.15.105:0/3301961209 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3434070030 0x7f3434074640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:04.189 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.187+0000 7f3439b12640 1 --2- 172.21.15.105:0/3301961209 >> v2:172.21.15.162:3300/0 conn(0x7f3434073170 0x7f343415c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:04.190 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.187+0000 7f3439b12640 1 -- 172.21.15.105:0/3301961209 >> 172.21.15.105:0/3301961209 conn(0x7f34340b1cb0 msgr2=0x7f34340b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:04.190 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.187+0000 7f3439b12640 1 -- 172.21.15.105:0/3301961209 shutdown_connections 2024-09-21T03:27:04.190 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.187+0000 7f3439b12640 1 -- 172.21.15.105:0/3301961209 wait complete. 2024-09-21T03:27:04.190 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.189+0000 7f3439b12640 1 Processor -- start 2024-09-21T03:27:04.190 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.189+0000 7f3439b12640 1 -- start start 2024-09-21T03:27:04.193 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.190+0000 7f3439b12640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3434070030 0x7f343409d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:04.193 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.190+0000 7f3439b12640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3434070440 0x7f34341f6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:04.193 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.190+0000 7f3439b12640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3434073170 0x7f34341f7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:04.193 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.190+0000 7f3439b12640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f343406f690 con 0x7f3434070030 2024-09-21T03:27:04.193 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.190+0000 7f3439b12640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f343406f510 con 0x7f3434070440 2024-09-21T03:27:04.194 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.190+0000 7f3439b12640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f343406f810 con 0x7f3434073170 2024-09-21T03:27:04.194 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.190+0000 7f34337fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3434070030 0x7f343409d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:04.194 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.190+0000 7f34337fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3434070030 0x7f343409d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58030/0 (socket says 172.21.15.105:58030) 2024-09-21T03:27:04.194 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.190+0000 7f34337fe640 1 -- 172.21.15.105:0/2219218065 learned_addr learned my addr 172.21.15.105:0/2219218065 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:04.194 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.191+0000 7f3432ffd640 1 --2- 172.21.15.105:0/2219218065 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3434070440 0x7f34341f6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:04.194 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.191+0000 7f3433fff640 1 --2- 172.21.15.105:0/2219218065 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3434073170 0x7f34341f7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:04.194 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.191+0000 7f34337fe640 1 -- 172.21.15.105:0/2219218065 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3434073170 msgr2=0x7f34341f7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:04.194 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.191+0000 7f34337fe640 1 --2- 172.21.15.105:0/2219218065 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3434073170 0x7f34341f7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:04.194 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.191+0000 7f34337fe640 1 -- 172.21.15.105:0/2219218065 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3434070440 msgr2=0x7f34341f6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:04.194 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.191+0000 7f34337fe640 1 --2- 172.21.15.105:0/2219218065 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3434070440 0x7f34341f6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:04.194 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.191+0000 7f34337fe640 1 -- 172.21.15.105:0/2219218065 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f343409d6c0 con 0x7f3434070030 2024-09-21T03:27:04.194 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.191+0000 7f3433fff640 1 --2- 172.21.15.105:0/2219218065 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3434073170 0x7f34341f7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:27:04.194 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.191+0000 7f34337fe640 1 --2- 172.21.15.105:0/2219218065 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3434070030 0x7f343409d180 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f342400d7a0 tx=0x7f342400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:04.194 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.191+0000 7f341bfff640 1 -- 172.21.15.105:0/2219218065 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3424017070 con 0x7f3434070030 2024-09-21T03:27:04.195 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.191+0000 7f341bfff640 1 -- 172.21.15.105:0/2219218065 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3424009d20 con 0x7f3434070030 2024-09-21T03:27:04.195 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.191+0000 7f3439b12640 1 -- 172.21.15.105:0/2219218065 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34340c4530 con 0x7f3434070030 2024-09-21T03:27:04.195 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.191+0000 7f341bfff640 1 -- 172.21.15.105:0/2219218065 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3424004280 con 0x7f3434070030 2024-09-21T03:27:04.195 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.191+0000 7f3439b12640 1 -- 172.21.15.105:0/2219218065 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34340c4af0 con 0x7f3434070030 2024-09-21T03:27:04.196 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.192+0000 7f3439b12640 1 -- 172.21.15.105:0/2219218065 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f343415f3d0 con 0x7f3434070030 2024-09-21T03:27:04.196 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.193+0000 7f341bfff640 1 -- 172.21.15.105:0/2219218065 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3424005020 con 0x7f3434070030 2024-09-21T03:27:04.196 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.193+0000 7f341bfff640 1 --2- 172.21.15.105:0/2219218065 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3420078b90 0x7f342007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:04.196 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.194+0000 7f341bfff640 1 -- 172.21.15.105:0/2219218065 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7f342409b090 con 0x7f3434070030 2024-09-21T03:27:04.196 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.194+0000 7f3432ffd640 1 --2- 172.21.15.105:0/2219218065 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3420078b90 0x7f342007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:04.196 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.194+0000 7f3432ffd640 1 --2- 172.21.15.105:0/2219218065 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3420078b90 0x7f342007b0a0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f343415aa00 tx=0x7f342800b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:04.199 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.198+0000 7f341bfff640 1 -- 172.21.15.105:0/2219218065 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3424020020 con 0x7f3434070030 2024-09-21T03:27:04.411 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.410+0000 7f3439b12640 1 -- 172.21.15.105:0/2219218065 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f34340c3860 con 0x7f3434070030 2024-09-21T03:27:04.412 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.410+0000 7f341bfff640 1 -- 172.21.15.105:0/2219218065 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5233 (secure 0 0 0) 0x7f34240634d0 con 0x7f3434070030 2024-09-21T03:27:04.412 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:27:04.412 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":86,"btime":"2024-09-21T03:26:58:479758+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6494,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2298697835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2298697835},{"type":"v1","addr":"172.21.15.162:6836","nonce":2298697835}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":6500,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/680091076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":680091076},{"type":"v1","addr":"172.21.15.105:6835","nonce":680091076}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8013,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/4094879618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":4094879618},{"type":"v1","addr":"172.21.15.105:6833","nonce":4094879618}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:26:33.112228+0000","modified":"2024-09-21T03:26:57.793673+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8022},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8022":{"gid":8022,"name":"b","rank":0,"incarnation":81,"state":"up:active","state_seq":9,"addr":"172.21.15.162:6837/712373587","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":712373587},{"type":"v1","addr":"172.21.15.162:6837","nonce":712373587}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8022,"qdb_cluster":[8022]},"id":10}]} 2024-09-21T03:27:04.413 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 86 2024-09-21T03:27:04.414 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.412+0000 7f3439b12640 1 -- 172.21.15.105:0/2219218065 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3420078b90 msgr2=0x7f342007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:04.414 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.412+0000 7f3439b12640 1 --2- 172.21.15.105:0/2219218065 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3420078b90 0x7f342007b0a0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f343415aa00 tx=0x7f342800b2e0 comp rx=0 tx=0).stop 2024-09-21T03:27:04.415 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.412+0000 7f3439b12640 1 -- 172.21.15.105:0/2219218065 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3434070030 msgr2=0x7f343409d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:04.415 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.412+0000 7f3439b12640 1 --2- 172.21.15.105:0/2219218065 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3434070030 0x7f343409d180 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f342400d7a0 tx=0x7f342400dc60 comp rx=0 tx=0).stop 2024-09-21T03:27:04.415 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.412+0000 7f3439b12640 1 -- 172.21.15.105:0/2219218065 shutdown_connections 2024-09-21T03:27:04.415 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.412+0000 7f3439b12640 1 --2- 172.21.15.105:0/2219218065 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3420078b90 0x7f342007b0a0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:04.415 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.413+0000 7f3439b12640 1 --2- 172.21.15.105:0/2219218065 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3434073170 0x7f34341f7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:04.415 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.413+0000 7f3439b12640 1 --2- 172.21.15.105:0/2219218065 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3434070440 0x7f34341f6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:04.415 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.413+0000 7f3439b12640 1 --2- 172.21.15.105:0/2219218065 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3434070030 0x7f343409d180 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:04.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.413+0000 7f3439b12640 1 -- 172.21.15.105:0/2219218065 >> 172.21.15.105:0/2219218065 conn(0x7f34340b1cb0 msgr2=0x7f34340ad230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:04.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.413+0000 7f3439b12640 1 -- 172.21.15.105:0/2219218065 shutdown_connections 2024-09-21T03:27:04.417 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.413+0000 7f3439b12640 1 -- 172.21.15.105:0/2219218065 wait complete. 2024-09-21T03:27:04.426 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:27:04.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.536+0000 7efebd3ed640 1 -- 172.21.15.105:0/677499678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efeb80afc00 msgr2=0x7efeb815f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:04.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.536+0000 7efebd3ed640 1 --2- 172.21.15.105:0/677499678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efeb80afc00 0x7efeb815f260 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7efea8005fd0 tx=0x7efea802a820 comp rx=0 tx=0).stop 2024-09-21T03:27:04.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.536+0000 7efebd3ed640 1 -- 172.21.15.105:0/677499678 shutdown_connections 2024-09-21T03:27:04.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.536+0000 7efebd3ed640 1 --2- 172.21.15.105:0/677499678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efeb80afc00 0x7efeb815f260 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:04.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.536+0000 7efebd3ed640 1 --2- 172.21.15.105:0/677499678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efeb80b4e70 0x7efeb80cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:04.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.536+0000 7efebd3ed640 1 -- 172.21.15.105:0/677499678 >> 172.21.15.105:0/677499678 conn(0x7efeb80d0a20 msgr2=0x7efeb80d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:04.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.536+0000 7efebd3ed640 1 -- 172.21.15.105:0/677499678 shutdown_connections 2024-09-21T03:27:04.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.536+0000 7efebd3ed640 1 -- 172.21.15.105:0/677499678 wait complete. 2024-09-21T03:27:04.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.538+0000 7efebd3ed640 1 Processor -- start 2024-09-21T03:27:04.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.538+0000 7efebd3ed640 1 -- start start 2024-09-21T03:27:04.541 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.539+0000 7efebd3ed640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efeb80afc00 0x7efeb81f2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:04.542 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.539+0000 7efebd3ed640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efeb80b4e70 0x7efeb814b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:04.542 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.539+0000 7efebd3ed640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efeb80ccf50 0x7efeb8157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:04.542 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.539+0000 7efebd3ed640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efeb815fb70 con 0x7efeb80ccf50 2024-09-21T03:27:04.542 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.539+0000 7efebd3ed640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efeb815f9f0 con 0x7efeb80b4e70 2024-09-21T03:27:04.542 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.539+0000 7efebd3ed640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7efeb815fcf0 con 0x7efeb80afc00 2024-09-21T03:27:04.542 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.539+0000 7efeb77fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efeb80ccf50 0x7efeb8157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:04.542 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.539+0000 7efeb77fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efeb80ccf50 0x7efeb8157650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58038/0 (socket says 172.21.15.105:58038) 2024-09-21T03:27:04.542 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.539+0000 7efeb77fe640 1 -- 172.21.15.105:0/2871084454 learned_addr learned my addr 172.21.15.105:0/2871084454 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:04.542 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.539+0000 7efeb67fc640 1 --2- 172.21.15.105:0/2871084454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efeb80b4e70 0x7efeb814b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:04.542 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.539+0000 7efeb6ffd640 1 --2- 172.21.15.105:0/2871084454 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efeb80afc00 0x7efeb81f2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:04.542 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.539+0000 7efeb77fe640 1 -- 172.21.15.105:0/2871084454 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efeb80afc00 msgr2=0x7efeb81f2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:04.542 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.539+0000 7efeb77fe640 1 --2- 172.21.15.105:0/2871084454 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efeb80afc00 0x7efeb81f2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:04.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.539+0000 7efeb77fe640 1 -- 172.21.15.105:0/2871084454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efeb80b4e70 msgr2=0x7efeb814b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:04.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.539+0000 7efeb77fe640 1 --2- 172.21.15.105:0/2871084454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efeb80b4e70 0x7efeb814b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:04.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.539+0000 7efeb77fe640 1 -- 172.21.15.105:0/2871084454 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb81f2d00 con 0x7efeb80ccf50 2024-09-21T03:27:04.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.540+0000 7efeb77fe640 1 --2- 172.21.15.105:0/2871084454 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efeb80ccf50 0x7efeb8157650 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7efea8006010 tx=0x7efea8032be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:04.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.540+0000 7efe9f7fe640 1 -- 172.21.15.105:0/2871084454 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea8037040 con 0x7efeb80ccf50 2024-09-21T03:27:04.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.540+0000 7efebd3ed640 1 -- 172.21.15.105:0/2871084454 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeb81f2fe0 con 0x7efeb80ccf50 2024-09-21T03:27:04.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.540+0000 7efe9f7fe640 1 -- 172.21.15.105:0/2871084454 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efea8042070 con 0x7efeb80ccf50 2024-09-21T03:27:04.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.540+0000 7efe9f7fe640 1 -- 172.21.15.105:0/2871084454 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea8003e40 con 0x7efeb80ccf50 2024-09-21T03:27:04.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.540+0000 7efebd3ed640 1 -- 172.21.15.105:0/2871084454 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeb81f2780 con 0x7efeb80ccf50 2024-09-21T03:27:04.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.541+0000 7efebd3ed640 1 -- 172.21.15.105:0/2871084454 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efeb81f2a70 con 0x7efeb80ccf50 2024-09-21T03:27:04.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.541+0000 7efe9f7fe640 1 -- 172.21.15.105:0/2871084454 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efea8004040 con 0x7efeb80ccf50 2024-09-21T03:27:04.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.542+0000 7efe9f7fe640 1 --2- 172.21.15.105:0/2871084454 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efea4078bc0 0x7efea407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:04.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.542+0000 7efe9f7fe640 1 -- 172.21.15.105:0/2871084454 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7efea80bb980 con 0x7efeb80ccf50 2024-09-21T03:27:04.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.542+0000 7efeb6ffd640 1 --2- 172.21.15.105:0/2871084454 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efea4078bc0 0x7efea407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:04.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.543+0000 7efeb6ffd640 1 --2- 172.21.15.105:0/2871084454 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efea4078bc0 0x7efea407b0d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7efeb0005fd0 tx=0x7efeb0009260 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:04.548 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.546+0000 7efe9f7fe640 1 -- 172.21.15.105:0/2871084454 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7efea8083d40 con 0x7efeb80ccf50 2024-09-21T03:27:04.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.725+0000 7efebd3ed640 1 -- 172.21.15.105:0/2871084454 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efeb815f260 con 0x7efeb80ccf50 2024-09-21T03:27:04.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.727+0000 7efe9f7fe640 1 -- 172.21.15.105:0/2871084454 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) ==== 74+0+16811 (secure 0 0 0) 0x7efea8083640 con 0x7efeb80ccf50 2024-09-21T03:27:04.728 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:27:04.729 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":129,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:26:34.761871+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:26:30.757426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-21T03:26:32.079246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:27:04.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.729+0000 7efebd3ed640 1 -- 172.21.15.105:0/2871084454 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efea4078bc0 msgr2=0x7efea407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:04.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.729+0000 7efebd3ed640 1 --2- 172.21.15.105:0/2871084454 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efea4078bc0 0x7efea407b0d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7efeb0005fd0 tx=0x7efeb0009260 comp rx=0 tx=0).stop 2024-09-21T03:27:04.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.729+0000 7efebd3ed640 1 -- 172.21.15.105:0/2871084454 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efeb80ccf50 msgr2=0x7efeb8157650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:04.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.729+0000 7efebd3ed640 1 --2- 172.21.15.105:0/2871084454 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efeb80ccf50 0x7efeb8157650 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7efea8006010 tx=0x7efea8032be0 comp rx=0 tx=0).stop 2024-09-21T03:27:04.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.729+0000 7efebd3ed640 1 -- 172.21.15.105:0/2871084454 shutdown_connections 2024-09-21T03:27:04.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.729+0000 7efebd3ed640 1 --2- 172.21.15.105:0/2871084454 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efea4078bc0 0x7efea407b0d0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:04.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.729+0000 7efebd3ed640 1 --2- 172.21.15.105:0/2871084454 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efeb80ccf50 0x7efeb8157650 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:04.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.729+0000 7efebd3ed640 1 --2- 172.21.15.105:0/2871084454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efeb80b4e70 0x7efeb814b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:04.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.729+0000 7efebd3ed640 1 --2- 172.21.15.105:0/2871084454 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efeb80afc00 0x7efeb81f2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:04.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.729+0000 7efebd3ed640 1 -- 172.21.15.105:0/2871084454 >> 172.21.15.105:0/2871084454 conn(0x7efeb80d0a20 msgr2=0x7efeb815d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:04.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.729+0000 7efebd3ed640 1 -- 172.21.15.105:0/2871084454 shutdown_connections 2024-09-21T03:27:04.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.729+0000 7efebd3ed640 1 -- 172.21.15.105:0/2871084454 wait complete. 2024-09-21T03:27:04.742 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T03:27:04.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.854+0000 7f1122d2b640 1 -- 172.21.15.105:0/1064799423 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f111c160c90 msgr2=0x7f111c0b3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:04.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.854+0000 7f1122d2b640 1 --2- 172.21.15.105:0/1064799423 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f111c160c90 0x7f111c0b3e20 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f111c073b20 tx=0x7f111002a4d0 comp rx=0 tx=0).stop 2024-09-21T03:27:04.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.854+0000 7f1122d2b640 1 -- 172.21.15.105:0/1064799423 shutdown_connections 2024-09-21T03:27:04.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.854+0000 7f1122d2b640 1 --2- 172.21.15.105:0/1064799423 >> v2:172.21.15.162:3300/0 conn(0x7f111c0b4360 0x7f111c0727e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:04.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.854+0000 7f1122d2b640 1 --2- 172.21.15.105:0/1064799423 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f111c160c90 0x7f111c0b3e20 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:04.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.854+0000 7f1122d2b640 1 --2- 172.21.15.105:0/1064799423 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f111c0cff70 0x7f111c15c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:04.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.854+0000 7f1122d2b640 1 -- 172.21.15.105:0/1064799423 >> 172.21.15.105:0/1064799423 conn(0x7f111c0cee20 msgr2=0x7f111c0cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:04.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.854+0000 7f1122d2b640 1 -- 172.21.15.105:0/1064799423 shutdown_connections 2024-09-21T03:27:04.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.854+0000 7f1122d2b640 1 -- 172.21.15.105:0/1064799423 wait complete. 2024-09-21T03:27:04.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.856+0000 7f1122d2b640 1 Processor -- start 2024-09-21T03:27:04.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.856+0000 7f1122d2b640 1 -- start start 2024-09-21T03:27:04.860 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.857+0000 7f1122d2b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f111c0b4360 0x7f111c1483c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:04.860 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.857+0000 7f1122d2b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f111c0cff70 0x7f111c0b7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:04.860 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.857+0000 7f1122d2b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f111c160c90 0x7f111c151260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:04.860 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.857+0000 7f1122d2b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f111c073160 con 0x7f111c160c90 2024-09-21T03:27:04.860 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.857+0000 7f1122d2b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f111c072fe0 con 0x7f111c0cff70 2024-09-21T03:27:04.860 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.857+0000 7f1122d2b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f111c0732e0 con 0x7f111c0b4360 2024-09-21T03:27:04.860 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.857+0000 7f11212c8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f111c160c90 0x7f111c151260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:04.860 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.857+0000 7f11212c8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f111c160c90 0x7f111c151260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58056/0 (socket says 172.21.15.105:58056) 2024-09-21T03:27:04.860 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.857+0000 7f11212c8640 1 -- 172.21.15.105:0/3291979159 learned_addr learned my addr 172.21.15.105:0/3291979159 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:04.861 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.857+0000 7f1120ac7640 1 --2- 172.21.15.105:0/3291979159 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f111c0b4360 0x7f111c1483c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:04.861 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.857+0000 7f111bfff640 1 --2- 172.21.15.105:0/3291979159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f111c0cff70 0x7f111c0b7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:04.861 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.858+0000 7f11212c8640 1 -- 172.21.15.105:0/3291979159 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f111c0b4360 msgr2=0x7f111c1483c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:04.861 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.858+0000 7f11212c8640 1 --2- 172.21.15.105:0/3291979159 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f111c0b4360 0x7f111c1483c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:04.861 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.858+0000 7f11212c8640 1 -- 172.21.15.105:0/3291979159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f111c0cff70 msgr2=0x7f111c0b7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:04.861 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.858+0000 7f11212c8640 1 --2- 172.21.15.105:0/3291979159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f111c0cff70 0x7f111c0b7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:04.861 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.858+0000 7f11212c8640 1 -- 172.21.15.105:0/3291979159 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f111c0b8040 con 0x7f111c160c90 2024-09-21T03:27:04.861 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.858+0000 7f11212c8640 1 --2- 172.21.15.105:0/3291979159 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f111c160c90 0x7f111c151260 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f111400e960 tx=0x7f111400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:04.861 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.858+0000 7f11197fa640 1 -- 172.21.15.105:0/3291979159 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1114004d20 con 0x7f111c160c90 2024-09-21T03:27:04.861 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.858+0000 7f11197fa640 1 -- 172.21.15.105:0/3291979159 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f111400ca60 con 0x7f111c160c90 2024-09-21T03:27:04.861 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.858+0000 7f1122d2b640 1 -- 172.21.15.105:0/3291979159 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f111c0b63a0 con 0x7f111c160c90 2024-09-21T03:27:04.861 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.858+0000 7f11197fa640 1 -- 172.21.15.105:0/3291979159 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1114005020 con 0x7f111c160c90 2024-09-21T03:27:04.861 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.858+0000 7f1122d2b640 1 -- 172.21.15.105:0/3291979159 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f111c0b6960 con 0x7f111c160c90 2024-09-21T03:27:04.862 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.859+0000 7f1122d2b640 1 -- 172.21.15.105:0/3291979159 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f111c0727e0 con 0x7f111c160c90 2024-09-21T03:27:04.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.860+0000 7f11197fa640 1 -- 172.21.15.105:0/3291979159 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f11140051c0 con 0x7f111c160c90 2024-09-21T03:27:04.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.860+0000 7f11197fa640 1 --2- 172.21.15.105:0/3291979159 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1108078bc0 0x7f110807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:04.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.860+0000 7f11197fa640 1 -- 172.21.15.105:0/3291979159 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7f111409b4a0 con 0x7f111c160c90 2024-09-21T03:27:04.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.861+0000 7f1120ac7640 1 --2- 172.21.15.105:0/3291979159 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1108078bc0 0x7f110807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:04.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.861+0000 7f1120ac7640 1 --2- 172.21.15.105:0/3291979159 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1108078bc0 0x7f110807b0d0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f110c004630 tx=0x7f110c00b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:04.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:04.865+0000 7f11197fa640 1 -- 172.21.15.105:0/3291979159 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1114016030 con 0x7f111c160c90 2024-09-21T03:27:05.078 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.077+0000 7f1122d2b640 1 -- 172.21.15.105:0/3291979159 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f111c15c0e0 con 0x7f111c160c90 2024-09-21T03:27:05.079 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.077+0000 7f11197fa640 1 -- 172.21.15.105:0/3291979159 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=-1 MDS has one of two health warnings which could extend recovery: MDS_TRIM or MDS_CACHE_OVERSIZED. MDS failover is not recommended since it might cause unexpected file system unavailability. If you wish to proceed, pass --yes-i-really-mean-it v86) ==== 316+0+0 (secure 0 0 0) 0x7f1114063320 con 0x7f111c160c90 2024-09-21T03:27:05.079 INFO:teuthology.orchestra.run.smithi105.stderr:Error EPERM: MDS has one of two health warnings which could extend recovery: MDS_TRIM or MDS_CACHE_OVERSIZED. MDS failover is not recommended since it might cause unexpected file system unavailability. If you wish to proceed, pass --yes-i-really-mean-it 2024-09-21T03:27:05.084 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:27:05.085 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs --yes-i-really-mean-it 2024-09-21T03:27:05.199 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.197+0000 7f039364d640 1 -- 172.21.15.105:0/711135087 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f038c0b4530 msgr2=0x7f038c0d0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:05.199 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.197+0000 7f039364d640 1 --2- 172.21.15.105:0/711135087 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f038c0b4530 0x7f038c0d0bf0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f0384005fd0 tx=0x7f038402aa10 comp rx=0 tx=0).stop 2024-09-21T03:27:05.199 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.197+0000 7f039364d640 1 -- 172.21.15.105:0/711135087 shutdown_connections 2024-09-21T03:27:05.199 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.197+0000 7f039364d640 1 --2- 172.21.15.105:0/711135087 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f038c0b4530 0x7f038c0d0bf0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:05.199 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.197+0000 7f039364d640 1 --2- 172.21.15.105:0/711135087 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f038c0cff70 0x7f038c15c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:05.199 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.197+0000 7f039364d640 1 -- 172.21.15.105:0/711135087 >> 172.21.15.105:0/711135087 conn(0x7f038c0cee20 msgr2=0x7f038c0cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:05.199 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.197+0000 7f039364d640 1 -- 172.21.15.105:0/711135087 shutdown_connections 2024-09-21T03:27:05.199 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.197+0000 7f039364d640 1 -- 172.21.15.105:0/711135087 wait complete. 2024-09-21T03:27:05.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.199+0000 7f039364d640 1 Processor -- start 2024-09-21T03:27:05.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.199+0000 7f039364d640 1 -- start start 2024-09-21T03:27:05.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.200+0000 7f039364d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f038c0cff70 0x7f038c1f4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:05.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.200+0000 7f039364d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f038c160c90 0x7f038c155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:05.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.200+0000 7f039364d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f038c155fb0 0x7f038c06eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:05.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.200+0000 7f039364d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f038c0d17d0 con 0x7f038c155fb0 2024-09-21T03:27:05.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.200+0000 7f039364d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f038c0d1650 con 0x7f038c0cff70 2024-09-21T03:27:05.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.200+0000 7f039364d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f038c0d1950 con 0x7f038c160c90 2024-09-21T03:27:05.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.200+0000 7f0391bea640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f038c155fb0 0x7f038c06eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:05.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.200+0000 7f0391bea640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f038c155fb0 0x7f038c06eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58072/0 (socket says 172.21.15.105:58072) 2024-09-21T03:27:05.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.200+0000 7f0391bea640 1 -- 172.21.15.105:0/1581364201 learned_addr learned my addr 172.21.15.105:0/1581364201 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:05.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.200+0000 7f03913e9640 1 --2- 172.21.15.105:0/1581364201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f038c0cff70 0x7f038c1f4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:05.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.200+0000 7f0390be8640 1 --2- 172.21.15.105:0/1581364201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f038c160c90 0x7f038c155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:05.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.201+0000 7f0391bea640 1 -- 172.21.15.105:0/1581364201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f038c160c90 msgr2=0x7f038c155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:05.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.201+0000 7f0391bea640 1 --2- 172.21.15.105:0/1581364201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f038c160c90 0x7f038c155a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:05.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.201+0000 7f0391bea640 1 -- 172.21.15.105:0/1581364201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f038c0cff70 msgr2=0x7f038c1f4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:05.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.201+0000 7f0391bea640 1 --2- 172.21.15.105:0/1581364201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f038c0cff70 0x7f038c1f4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:05.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.201+0000 7f0391bea640 1 -- 172.21.15.105:0/1581364201 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f038c1563c0 con 0x7f038c155fb0 2024-09-21T03:27:05.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.201+0000 7f0391bea640 1 --2- 172.21.15.105:0/1581364201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f038c155fb0 0x7f038c06eb50 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f0384006010 tx=0x7f0384003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:05.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.201+0000 7f0381ffb640 1 -- 172.21.15.105:0/1581364201 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0384046070 con 0x7f038c155fb0 2024-09-21T03:27:05.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.201+0000 7f0381ffb640 1 -- 172.21.15.105:0/1581364201 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0384004540 con 0x7f038c155fb0 2024-09-21T03:27:05.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.201+0000 7f039364d640 1 -- 172.21.15.105:0/1581364201 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f038c15b960 con 0x7f038c155fb0 2024-09-21T03:27:05.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.201+0000 7f0381ffb640 1 -- 172.21.15.105:0/1581364201 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0384033070 con 0x7f038c155fb0 2024-09-21T03:27:05.204 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.201+0000 7f039364d640 1 -- 172.21.15.105:0/1581364201 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f038c06e350 con 0x7f038c155fb0 2024-09-21T03:27:05.205 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.202+0000 7f039364d640 1 -- 172.21.15.105:0/1581364201 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f038c0d1e00 con 0x7f038c155fb0 2024-09-21T03:27:05.205 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.203+0000 7f0381ffb640 1 -- 172.21.15.105:0/1581364201 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0384049070 con 0x7f038c155fb0 2024-09-21T03:27:05.205 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.203+0000 7f0381ffb640 1 --2- 172.21.15.105:0/1581364201 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0370078bc0 0x7f037007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:05.205 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.203+0000 7f0381ffb640 1 -- 172.21.15.105:0/1581364201 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7f03840bbe20 con 0x7f038c155fb0 2024-09-21T03:27:05.205 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.204+0000 7f03913e9640 1 --2- 172.21.15.105:0/1581364201 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0370078bc0 0x7f037007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:05.206 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.204+0000 7f03913e9640 1 --2- 172.21.15.105:0/1581364201 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0370078bc0 0x7f037007b0d0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f0388005fd0 tx=0x7f0388005850 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:05.209 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.208+0000 7f0381ffb640 1 -- 172.21.15.105:0/1581364201 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f038c1563c0 con 0x7f038c155fb0 2024-09-21T03:27:05.421 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.420+0000 7f039364d640 1 -- 172.21.15.105:0/1581364201 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f038c1520d0 con 0x7f038c155fb0 2024-09-21T03:27:05.422 INFO:tasks.ceph.mon.a.smithi105.stderr:2024-09-21T03:27:05.421+0000 7f25819ea640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T03:27:05.424 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.422+0000 7f0381ffb640 1 -- 172.21.15.105:0/1581364201 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v87) ==== 191+0+0 (secure 0 0 0) 0x7f038403e070 con 0x7f038c155fb0 2024-09-21T03:27:05.424 INFO:teuthology.orchestra.run.smithi105.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T03:27:05.427 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.424+0000 7f039364d640 1 -- 172.21.15.105:0/1581364201 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0370078bc0 msgr2=0x7f037007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:05.427 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.424+0000 7f039364d640 1 --2- 172.21.15.105:0/1581364201 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0370078bc0 0x7f037007b0d0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f0388005fd0 tx=0x7f0388005850 comp rx=0 tx=0).stop 2024-09-21T03:27:05.427 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.424+0000 7f039364d640 1 -- 172.21.15.105:0/1581364201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f038c155fb0 msgr2=0x7f038c06eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:05.427 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.424+0000 7f039364d640 1 --2- 172.21.15.105:0/1581364201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f038c155fb0 0x7f038c06eb50 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f0384006010 tx=0x7f0384003f10 comp rx=0 tx=0).stop 2024-09-21T03:27:05.427 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.424+0000 7f039364d640 1 -- 172.21.15.105:0/1581364201 shutdown_connections 2024-09-21T03:27:05.427 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.424+0000 7f039364d640 1 --2- 172.21.15.105:0/1581364201 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0370078bc0 0x7f037007b0d0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:05.427 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.424+0000 7f039364d640 1 --2- 172.21.15.105:0/1581364201 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f038c155fb0 0x7f038c06eb50 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:05.427 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.425+0000 7f039364d640 1 --2- 172.21.15.105:0/1581364201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f038c160c90 0x7f038c155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:05.427 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.425+0000 7f039364d640 1 --2- 172.21.15.105:0/1581364201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f038c0cff70 0x7f038c1f4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:05.427 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.425+0000 7f039364d640 1 -- 172.21.15.105:0/1581364201 >> 172.21.15.105:0/1581364201 conn(0x7f038c0cee20 msgr2=0x7f038c1516b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:05.427 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.425+0000 7f039364d640 1 -- 172.21.15.105:0/1581364201 shutdown_connections 2024-09-21T03:27:05.427 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.425+0000 7f039364d640 1 -- 172.21.15.105:0/1581364201 wait complete. 2024-09-21T03:27:05.437 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T03:27:05.494 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-09-21T03:27:05.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.550+0000 7fc7d6c94640 1 -- 172.21.15.105:0/1823997183 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7d0070440 msgr2=0x7fc7d0074b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:05.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.550+0000 7fc7d6c94640 1 --2- 172.21.15.105:0/1823997183 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7d0070440 0x7fc7d0074b80 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fc7d00710f0 tx=0x7fc7c802aac0 comp rx=0 tx=0).stop 2024-09-21T03:27:05.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.550+0000 7fc7d6c94640 1 -- 172.21.15.105:0/1823997183 shutdown_connections 2024-09-21T03:27:05.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.550+0000 7fc7d6c94640 1 --2- 172.21.15.105:0/1823997183 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7d0070440 0x7fc7d0074b80 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:05.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.550+0000 7fc7d6c94640 1 --2- 172.21.15.105:0/1823997183 >> v2:172.21.15.162:3300/0 conn(0x7fc7d0070030 0x7fc7d0074640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:05.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.550+0000 7fc7d6c94640 1 -- 172.21.15.105:0/1823997183 >> 172.21.15.105:0/1823997183 conn(0x7fc7d00b1cb0 msgr2=0x7fc7d00b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:05.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.550+0000 7fc7d6c94640 1 -- 172.21.15.105:0/1823997183 shutdown_connections 2024-09-21T03:27:05.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.550+0000 7fc7d6c94640 1 -- 172.21.15.105:0/1823997183 wait complete. 2024-09-21T03:27:05.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.552+0000 7fc7d6c94640 1 Processor -- start 2024-09-21T03:27:05.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.552+0000 7fc7d6c94640 1 -- start start 2024-09-21T03:27:05.556 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.554+0000 7fc7d6c94640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7d0070030 0x7fc7d00c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:05.556 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.554+0000 7fc7d6c94640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7d0070440 0x7fc7d01535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:05.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.554+0000 7fc7d6c94640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7d0073170 0x7fc7d00cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:05.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.554+0000 7fc7d6c94640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d00b3a40 con 0x7fc7d0073170 2024-09-21T03:27:05.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.554+0000 7fc7d6c94640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d00b38c0 con 0x7fc7d0070030 2024-09-21T03:27:05.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.554+0000 7fc7d6c94640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc7d00b3bc0 con 0x7fc7d0070440 2024-09-21T03:27:05.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.554+0000 7fc7d5231640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7d0073170 0x7fc7d00cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:05.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.554+0000 7fc7d5231640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7d0073170 0x7fc7d00cb0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58084/0 (socket says 172.21.15.105:58084) 2024-09-21T03:27:05.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.554+0000 7fc7d4a30640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7d0070030 0x7fc7d00c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:05.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.554+0000 7fc7d5231640 1 -- 172.21.15.105:0/1882767683 learned_addr learned my addr 172.21.15.105:0/1882767683 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:05.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.554+0000 7fc7cffff640 1 --2- 172.21.15.105:0/1882767683 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7d0070440 0x7fc7d01535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:05.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.554+0000 7fc7d5231640 1 -- 172.21.15.105:0/1882767683 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7d0070440 msgr2=0x7fc7d01535f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:05.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.554+0000 7fc7d5231640 1 --2- 172.21.15.105:0/1882767683 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7d0070440 0x7fc7d01535f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:05.557 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.554+0000 7fc7d5231640 1 -- 172.21.15.105:0/1882767683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7d0070030 msgr2=0x7fc7d00c7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:05.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.554+0000 7fc7d5231640 1 --2- 172.21.15.105:0/1882767683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7d0070030 0x7fc7d00c7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:05.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.554+0000 7fc7d5231640 1 -- 172.21.15.105:0/1882767683 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7d0153b30 con 0x7fc7d0073170 2024-09-21T03:27:05.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.554+0000 7fc7d5231640 1 --2- 172.21.15.105:0/1882767683 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7d0073170 0x7fc7d00cb0f0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fc7c802b0b0 tx=0x7fc7c8003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:05.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.554+0000 7fc7cd7fa640 1 -- 172.21.15.105:0/1882767683 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8004250 con 0x7fc7d0073170 2024-09-21T03:27:05.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.555+0000 7fc7cd7fa640 1 -- 172.21.15.105:0/1882767683 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc7c80043f0 con 0x7fc7d0073170 2024-09-21T03:27:05.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.555+0000 7fc7d6c94640 1 -- 172.21.15.105:0/1882767683 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7d01f64b0 con 0x7fc7d0073170 2024-09-21T03:27:05.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.555+0000 7fc7cd7fa640 1 -- 172.21.15.105:0/1882767683 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8004820 con 0x7fc7d0073170 2024-09-21T03:27:05.558 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.555+0000 7fc7d6c94640 1 -- 172.21.15.105:0/1882767683 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7d00c83f0 con 0x7fc7d0073170 2024-09-21T03:27:05.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.555+0000 7fc7d6c94640 1 -- 172.21.15.105:0/1882767683 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7d00c8650 con 0x7fc7d0073170 2024-09-21T03:27:05.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.556+0000 7fc7cd7fa640 1 -- 172.21.15.105:0/1882767683 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc7c8049430 con 0x7fc7d0073170 2024-09-21T03:27:05.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.557+0000 7fc7cd7fa640 1 --2- 172.21.15.105:0/1882767683 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc7b4078bc0 0x7fc7b407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:05.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.557+0000 7fc7cd7fa640 1 -- 172.21.15.105:0/1882767683 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5795+0+0 (secure 0 0 0) 0x7fc7c80bbaf0 con 0x7fc7d0073170 2024-09-21T03:27:05.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.557+0000 7fc7d4a30640 1 --2- 172.21.15.105:0/1882767683 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc7b4078bc0 0x7fc7b407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:05.559 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.557+0000 7fc7d4a30640 1 --2- 172.21.15.105:0/1882767683 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc7b4078bc0 0x7fc7b407b0d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4001720 tx=0x7fc7c4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:05.563 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.561+0000 7fc7cd7fa640 1 -- 172.21.15.105:0/1882767683 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc7d0153b30 con 0x7fc7d0073170 2024-09-21T03:27:05.779 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:05.777+0000 7fc7d6c94640 1 -- 172.21.15.105:0/1882767683 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fc7d00b40e0 con 0x7fc7d0073170 2024-09-21T03:27:06.425 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.424+0000 7fc7cd7fa640 1 -- 172.21.15.105:0/1882767683 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v88) ==== 104+0+0 (secure 0 0 0) 0x7fc7c8032030 con 0x7fc7d0073170 2024-09-21T03:27:06.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.426+0000 7fc7d6c94640 1 -- 172.21.15.105:0/1882767683 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc7b4078bc0 msgr2=0x7fc7b407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:06.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.426+0000 7fc7d6c94640 1 --2- 172.21.15.105:0/1882767683 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc7b4078bc0 0x7fc7b407b0d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4001720 tx=0x7fc7c4009040 comp rx=0 tx=0).stop 2024-09-21T03:27:06.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.426+0000 7fc7d6c94640 1 -- 172.21.15.105:0/1882767683 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7d0073170 msgr2=0x7fc7d00cb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:06.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.426+0000 7fc7d6c94640 1 --2- 172.21.15.105:0/1882767683 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7d0073170 0x7fc7d00cb0f0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fc7c802b0b0 tx=0x7fc7c8003f10 comp rx=0 tx=0).stop 2024-09-21T03:27:06.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.426+0000 7fc7d6c94640 1 -- 172.21.15.105:0/1882767683 shutdown_connections 2024-09-21T03:27:06.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.426+0000 7fc7d6c94640 1 --2- 172.21.15.105:0/1882767683 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc7b4078bc0 0x7fc7b407b0d0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:06.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.426+0000 7fc7d6c94640 1 --2- 172.21.15.105:0/1882767683 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7d0073170 0x7fc7d00cb0f0 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:06.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.426+0000 7fc7d6c94640 1 --2- 172.21.15.105:0/1882767683 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7d0070440 0x7fc7d01535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:06.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.426+0000 7fc7d6c94640 1 --2- 172.21.15.105:0/1882767683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7d0070030 0x7fc7d00c7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:06.428 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.426+0000 7fc7d6c94640 1 -- 172.21.15.105:0/1882767683 >> 172.21.15.105:0/1882767683 conn(0x7fc7d00b1cb0 msgr2=0x7fc7d015ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:06.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.426+0000 7fc7d6c94640 1 -- 172.21.15.105:0/1882767683 shutdown_connections 2024-09-21T03:27:06.429 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.426+0000 7fc7d6c94640 1 -- 172.21.15.105:0/1882767683 wait complete. 2024-09-21T03:27:06.440 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T03:27:06.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.558+0000 7f9196ba1640 1 -- 172.21.15.105:0/1442117283 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f917c004d40 msgr2=0x7f917c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:06.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.558+0000 7f9196ba1640 1 --2- 172.21.15.105:0/1442117283 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f917c004d40 0x7f917c005210 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f9188001d90 tx=0x7f917c005830 comp rx=0 tx=0).stop 2024-09-21T03:27:06.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.558+0000 7f919513e640 1 -- 172.21.15.105:0/1442117283 reap_dead start 2024-09-21T03:27:06.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.558+0000 7f9196ba1640 1 -- 172.21.15.105:0/1442117283 shutdown_connections 2024-09-21T03:27:06.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.558+0000 7f9196ba1640 1 -- 172.21.15.105:0/1442117283 >> 172.21.15.105:0/1442117283 conn(0x7f919006d550 msgr2=0x7f9190071110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:06.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.558+0000 7f9196ba1640 1 -- 172.21.15.105:0/1442117283 shutdown_connections 2024-09-21T03:27:06.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.558+0000 7f9196ba1640 1 -- 172.21.15.105:0/1442117283 wait complete. 2024-09-21T03:27:06.561 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.560+0000 7f9196ba1640 1 Processor -- start 2024-09-21T03:27:06.561 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.560+0000 7f9196ba1640 1 -- start start 2024-09-21T03:27:06.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.561+0000 7f9196ba1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9190149390 0x7f919006f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:06.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.561+0000 7f9196ba1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91900cc090 0x7f91900ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:06.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.561+0000 7f9196ba1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91900cc4a0 0x7f919015b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:06.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.561+0000 7f9196ba1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f91900d05c0 con 0x7f91900cc090 2024-09-21T03:27:06.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.561+0000 7f9196ba1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9190161290 con 0x7f91900cc4a0 2024-09-21T03:27:06.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.561+0000 7f9196ba1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f91900d0740 con 0x7f9190149390 2024-09-21T03:27:06.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.561+0000 7f918ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91900cc090 0x7f91900ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:06.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.561+0000 7f918ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91900cc090 0x7f91900ca500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58100/0 (socket says 172.21.15.105:58100) 2024-09-21T03:27:06.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.561+0000 7f918ffff640 1 -- 172.21.15.105:0/481932360 learned_addr learned my addr 172.21.15.105:0/481932360 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:06.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.561+0000 7f919493d640 1 --2- 172.21.15.105:0/481932360 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9190149390 0x7f919006f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:06.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.561+0000 7f918ffff640 1 -- 172.21.15.105:0/481932360 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9190149390 msgr2=0x7f919006f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:06.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.561+0000 7f918ffff640 1 --2- 172.21.15.105:0/481932360 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9190149390 0x7f919006f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:06.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.561+0000 7f918ffff640 1 -- 172.21.15.105:0/481932360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91900cc4a0 msgr2=0x7f919015b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:06.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.561+0000 7f919513e640 1 --2- 172.21.15.105:0/481932360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91900cc4a0 0x7f919015b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:06.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.561+0000 7f918ffff640 1 --2- 172.21.15.105:0/481932360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91900cc4a0 0x7f919015b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:06.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.561+0000 7f918ffff640 1 -- 172.21.15.105:0/481932360 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f919006fed0 con 0x7f91900cc090 2024-09-21T03:27:06.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.562+0000 7f918ffff640 1 --2- 172.21.15.105:0/481932360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91900cc090 0x7f91900ca500 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f9180011ae0 tx=0x7f9180009e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:06.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.562+0000 7f918d7fa640 1 -- 172.21.15.105:0/481932360 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918001e070 con 0x7f91900cc090 2024-09-21T03:27:06.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.562+0000 7f918d7fa640 1 -- 172.21.15.105:0/481932360 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9180004460 con 0x7f91900cc090 2024-09-21T03:27:06.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.562+0000 7f9196ba1640 1 -- 172.21.15.105:0/481932360 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f919006e8f0 con 0x7f91900cc090 2024-09-21T03:27:06.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.562+0000 7f918d7fa640 1 -- 172.21.15.105:0/481932360 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918000fc60 con 0x7f91900cc090 2024-09-21T03:27:06.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.562+0000 7f9196ba1640 1 -- 172.21.15.105:0/481932360 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f919006eeb0 con 0x7f91900cc090 2024-09-21T03:27:06.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.563+0000 7f9196ba1640 1 -- 172.21.15.105:0/481932360 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91900d0c10 con 0x7f91900cc090 2024-09-21T03:27:06.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.564+0000 7f918d7fa640 1 -- 172.21.15.105:0/481932360 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9180021070 con 0x7f91900cc090 2024-09-21T03:27:06.566 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.564+0000 7f918d7fa640 1 --2- 172.21.15.105:0/481932360 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9170078b90 0x7f917007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:06.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.564+0000 7f918d7fa640 1 -- 172.21.15.105:0/481932360 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5795+0+0 (secure 0 0 0) 0x7f918009b770 con 0x7f91900cc090 2024-09-21T03:27:06.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.564+0000 7f919493d640 1 --2- 172.21.15.105:0/481932360 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9170078b90 0x7f917007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:06.567 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.565+0000 7f919493d640 1 --2- 172.21.15.105:0/481932360 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9170078b90 0x7f917007b0a0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f9178000fb0 tx=0x7f91780067a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:06.570 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.569+0000 7f918d7fa640 1 -- 172.21.15.105:0/481932360 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f9180063590 con 0x7f91900cc090 2024-09-21T03:27:06.751 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:06.749+0000 7f9196ba1640 1 -- 172.21.15.105:0/481932360 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9190068da0 con 0x7f91900cc090 2024-09-21T03:27:07.514 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.512+0000 7f918d7fa640 1 -- 172.21.15.105:0/481932360 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v131) ==== 181+0+0 (secure 0 0 0) 0x7f9180067fc0 con 0x7f91900cc090 2024-09-21T03:27:07.514 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_metadata' removed 2024-09-21T03:27:07.518 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.516+0000 7f9196ba1640 1 -- 172.21.15.105:0/481932360 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9170078b90 msgr2=0x7f917007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:07.518 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.516+0000 7f9196ba1640 1 --2- 172.21.15.105:0/481932360 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9170078b90 0x7f917007b0a0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f9178000fb0 tx=0x7f91780067a0 comp rx=0 tx=0).stop 2024-09-21T03:27:07.518 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.516+0000 7f9196ba1640 1 -- 172.21.15.105:0/481932360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91900cc090 msgr2=0x7f91900ca500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:07.518 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.516+0000 7f9196ba1640 1 --2- 172.21.15.105:0/481932360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91900cc090 0x7f91900ca500 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f9180011ae0 tx=0x7f9180009e40 comp rx=0 tx=0).stop 2024-09-21T03:27:07.518 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.516+0000 7f9196ba1640 1 -- 172.21.15.105:0/481932360 shutdown_connections 2024-09-21T03:27:07.518 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.516+0000 7f9196ba1640 1 --2- 172.21.15.105:0/481932360 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9170078b90 0x7f917007b0a0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:07.518 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.516+0000 7f9196ba1640 1 --2- 172.21.15.105:0/481932360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91900cc4a0 0x7f919015b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:07.518 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.516+0000 7f9196ba1640 1 --2- 172.21.15.105:0/481932360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91900cc090 0x7f91900ca500 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:07.518 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.516+0000 7f9196ba1640 1 --2- 172.21.15.105:0/481932360 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9190149390 0x7f919006f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:07.518 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.516+0000 7f9196ba1640 1 -- 172.21.15.105:0/481932360 >> 172.21.15.105:0/481932360 conn(0x7f919006d550 msgr2=0x7f91900b5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:07.519 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.516+0000 7f9196ba1640 1 -- 172.21.15.105:0/481932360 shutdown_connections 2024-09-21T03:27:07.519 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.517+0000 7f9196ba1640 1 -- 172.21.15.105:0/481932360 wait complete. 2024-09-21T03:27:07.531 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T03:27:07.651 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.649+0000 7f059735e640 1 -- 172.21.15.105:0/2708856342 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f057c004800 msgr2=0x7f057c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:07.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.649+0000 7f059735e640 1 --2- 172.21.15.105:0/2708856342 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f057c004800 0x7f057c004c10 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f05900cc8f0 tx=0x7f057c005830 comp rx=0 tx=0).stop 2024-09-21T03:27:07.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.649+0000 7f05958fb640 1 -- 172.21.15.105:0/2708856342 reap_dead start 2024-09-21T03:27:07.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.649+0000 7f059735e640 1 -- 172.21.15.105:0/2708856342 shutdown_connections 2024-09-21T03:27:07.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.650+0000 7f059735e640 1 -- 172.21.15.105:0/2708856342 >> 172.21.15.105:0/2708856342 conn(0x7f05900b3ea0 msgr2=0x7f05900b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:07.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.650+0000 7f059735e640 1 -- 172.21.15.105:0/2708856342 shutdown_connections 2024-09-21T03:27:07.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.650+0000 7f059735e640 1 -- 172.21.15.105:0/2708856342 wait complete. 2024-09-21T03:27:07.653 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.651+0000 7f059735e640 1 Processor -- start 2024-09-21T03:27:07.653 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.651+0000 7f059735e640 1 -- start start 2024-09-21T03:27:07.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.653+0000 7f059735e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f057c004800 0x7f05901f3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:07.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.653+0000 7f059735e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05900b5e60 0x7f0590157950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:07.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.653+0000 7f059735e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05900c7df0 0x7f05900c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:07.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.653+0000 7f059735e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f059015da50 con 0x7f057c004800 2024-09-21T03:27:07.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.653+0000 7f059735e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f059015d8d0 con 0x7f05900b5e60 2024-09-21T03:27:07.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.653+0000 7f059735e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f059015dbd0 con 0x7f05900c7df0 2024-09-21T03:27:07.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.653+0000 7f05950fa640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f057c004800 0x7f05901f3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:07.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.653+0000 7f05950fa640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f057c004800 0x7f05901f3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58112/0 (socket says 172.21.15.105:58112) 2024-09-21T03:27:07.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.653+0000 7f05950fa640 1 -- 172.21.15.105:0/1643491953 learned_addr learned my addr 172.21.15.105:0/1643491953 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:07.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.653+0000 7f05948f9640 1 --2- 172.21.15.105:0/1643491953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05900b5e60 0x7f0590157950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:07.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.653+0000 7f05958fb640 1 --2- 172.21.15.105:0/1643491953 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05900c7df0 0x7f05900c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:07.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.653+0000 7f05950fa640 1 -- 172.21.15.105:0/1643491953 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05900c7df0 msgr2=0x7f05900c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:07.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.653+0000 7f05950fa640 1 --2- 172.21.15.105:0/1643491953 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05900c7df0 0x7f05900c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:07.657 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.653+0000 7f05950fa640 1 -- 172.21.15.105:0/1643491953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05900b5e60 msgr2=0x7f0590157950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:07.657 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.653+0000 7f05950fa640 1 --2- 172.21.15.105:0/1643491953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05900b5e60 0x7f0590157950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:07.657 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.653+0000 7f05950fa640 1 -- 172.21.15.105:0/1643491953 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05901f41f0 con 0x7f057c004800 2024-09-21T03:27:07.657 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.653+0000 7f05950fa640 1 --2- 172.21.15.105:0/1643491953 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f057c004800 0x7f05901f3cb0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f058c011820 tx=0x7f058c011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:07.657 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.653+0000 7f0585ffb640 1 -- 172.21.15.105:0/1643491953 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f058c00fd50 con 0x7f057c004800 2024-09-21T03:27:07.657 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.653+0000 7f0585ffb640 1 -- 172.21.15.105:0/1643491953 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f058c016070 con 0x7f057c004800 2024-09-21T03:27:07.657 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.653+0000 7f0585ffb640 1 -- 172.21.15.105:0/1643491953 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f058c012690 con 0x7f057c004800 2024-09-21T03:27:07.657 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.653+0000 7f059735e640 1 -- 172.21.15.105:0/1643491953 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05900c8740 con 0x7f057c004800 2024-09-21T03:27:07.657 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.654+0000 7f059735e640 1 -- 172.21.15.105:0/1643491953 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05900b5380 con 0x7f057c004800 2024-09-21T03:27:07.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.655+0000 7f059735e640 1 -- 172.21.15.105:0/1643491953 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f059015c5e0 con 0x7f057c004800 2024-09-21T03:27:07.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.655+0000 7f0585ffb640 1 -- 172.21.15.105:0/1643491953 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f058c018030 con 0x7f057c004800 2024-09-21T03:27:07.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.656+0000 7f0585ffb640 1 --2- 172.21.15.105:0/1643491953 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0574078b90 0x7f057407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:07.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.656+0000 7f0585ffb640 1 -- 172.21.15.105:0/1643491953 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5357+0+0 (secure 0 0 0) 0x7f058c09b2f0 con 0x7f057c004800 2024-09-21T03:27:07.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.656+0000 7f05948f9640 1 --2- 172.21.15.105:0/1643491953 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0574078b90 0x7f057407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:07.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.657+0000 7f05948f9640 1 --2- 172.21.15.105:0/1643491953 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0574078b90 0x7f057407b0a0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f0580035000 tx=0x7f058002d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:07.662 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.661+0000 7f0585ffb640 1 -- 172.21.15.105:0/1643491953 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f05900c8740 con 0x7f057c004800 2024-09-21T03:27:07.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:07.837+0000 7f059735e640 1 -- 172.21.15.105:0/1643491953 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f05900b43e0 con 0x7f057c004800 2024-09-21T03:27:08.520 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.518+0000 7f0585ffb640 1 -- 172.21.15.105:0/1643491953 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v132) ==== 169+0+0 (secure 0 0 0) 0x7f05901f41f0 con 0x7f057c004800 2024-09-21T03:27:08.520 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_data' removed 2024-09-21T03:27:08.524 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.522+0000 7f059735e640 1 -- 172.21.15.105:0/1643491953 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0574078b90 msgr2=0x7f057407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:08.524 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.522+0000 7f059735e640 1 --2- 172.21.15.105:0/1643491953 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0574078b90 0x7f057407b0a0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f0580035000 tx=0x7f058002d040 comp rx=0 tx=0).stop 2024-09-21T03:27:08.524 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.522+0000 7f059735e640 1 -- 172.21.15.105:0/1643491953 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f057c004800 msgr2=0x7f05901f3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:08.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.522+0000 7f059735e640 1 --2- 172.21.15.105:0/1643491953 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f057c004800 0x7f05901f3cb0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f058c011820 tx=0x7f058c011c20 comp rx=0 tx=0).stop 2024-09-21T03:27:08.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.522+0000 7f059735e640 1 -- 172.21.15.105:0/1643491953 shutdown_connections 2024-09-21T03:27:08.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.522+0000 7f059735e640 1 --2- 172.21.15.105:0/1643491953 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0574078b90 0x7f057407b0a0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:08.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.522+0000 7f059735e640 1 --2- 172.21.15.105:0/1643491953 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05900c7df0 0x7f05900c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:08.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.522+0000 7f059735e640 1 --2- 172.21.15.105:0/1643491953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05900b5e60 0x7f0590157950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:08.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.522+0000 7f059735e640 1 --2- 172.21.15.105:0/1643491953 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f057c004800 0x7f05901f3cb0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:08.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.522+0000 7f059735e640 1 -- 172.21.15.105:0/1643491953 >> 172.21.15.105:0/1643491953 conn(0x7f05900b3ea0 msgr2=0x7f05900b1f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:08.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.523+0000 7f059735e640 1 -- 172.21.15.105:0/1643491953 shutdown_connections 2024-09-21T03:27:08.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.523+0000 7f059735e640 1 -- 172.21.15.105:0/1643491953 wait complete. 2024-09-21T03:27:08.537 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-21T03:27:08.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.650+0000 7f2420ad5640 1 -- 172.21.15.105:0/3790147628 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2404003a30 msgr2=0x7f2404003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:08.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.650+0000 7f2420ad5640 1 --2- 172.21.15.105:0/3790147628 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2404003a30 0x7f2404003ea0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f240c00c4a0 tx=0x7f2404005830 comp rx=0 tx=0).stop 2024-09-21T03:27:08.653 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.650+0000 7f241ad9d640 1 -- 172.21.15.105:0/3790147628 reap_dead start 2024-09-21T03:27:08.653 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.650+0000 7f2420ad5640 1 -- 172.21.15.105:0/3790147628 shutdown_connections 2024-09-21T03:27:08.653 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.650+0000 7f2420ad5640 1 -- 172.21.15.105:0/3790147628 >> 172.21.15.105:0/3790147628 conn(0x7f241c06d7d0 msgr2=0x7f241c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:08.653 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.650+0000 7f2420ad5640 1 -- 172.21.15.105:0/3790147628 shutdown_connections 2024-09-21T03:27:08.653 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.650+0000 7f2420ad5640 1 -- 172.21.15.105:0/3790147628 wait complete. 2024-09-21T03:27:08.654 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.652+0000 7f2420ad5640 1 Processor -- start 2024-09-21T03:27:08.654 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.652+0000 7f2420ad5640 1 -- start start 2024-09-21T03:27:08.657 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.654+0000 7f2420ad5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2404003a30 0x7f241c1412b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:08.657 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.654+0000 7f2420ad5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f241c153ca0 0x7f241c1592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:08.657 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.654+0000 7f2420ad5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f241c159820 0x7f241c09ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:08.657 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.654+0000 7f2420ad5640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f241c163d20 con 0x7f241c153ca0 2024-09-21T03:27:08.657 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.654+0000 7f2420ad5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f241c163ba0 con 0x7f2404003a30 2024-09-21T03:27:08.657 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.654+0000 7f2420ad5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f241c163ea0 con 0x7f241c159820 2024-09-21T03:27:08.657 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.654+0000 7f2419d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f241c153ca0 0x7f241c1592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:08.657 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.654+0000 7f2419d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f241c153ca0 0x7f241c1592e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58138/0 (socket says 172.21.15.105:58138) 2024-09-21T03:27:08.657 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.654+0000 7f2419d9b640 1 -- 172.21.15.105:0/911553916 learned_addr learned my addr 172.21.15.105:0/911553916 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:08.657 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.654+0000 7f241a59c640 1 --2- 172.21.15.105:0/911553916 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2404003a30 0x7f241c1412b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:08.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.654+0000 7f241ad9d640 1 --2- 172.21.15.105:0/911553916 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f241c159820 0x7f241c09ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:08.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.654+0000 7f2419d9b640 1 -- 172.21.15.105:0/911553916 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f241c159820 msgr2=0x7f241c09ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:08.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.654+0000 7f2419d9b640 1 --2- 172.21.15.105:0/911553916 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f241c159820 0x7f241c09ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:08.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.654+0000 7f2419d9b640 1 -- 172.21.15.105:0/911553916 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2404003a30 msgr2=0x7f241c1412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:08.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.654+0000 7f2419d9b640 1 --2- 172.21.15.105:0/911553916 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2404003a30 0x7f241c1412b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:08.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.654+0000 7f2419d9b640 1 -- 172.21.15.105:0/911553916 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f241c159c30 con 0x7f241c153ca0 2024-09-21T03:27:08.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.654+0000 7f241ad9d640 1 --2- 172.21.15.105:0/911553916 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f241c159820 0x7f241c09ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:27:08.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.654+0000 7f241a59c640 1 --2- 172.21.15.105:0/911553916 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2404003a30 0x7f241c1412b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:27:08.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.654+0000 7f2419d9b640 1 --2- 172.21.15.105:0/911553916 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f241c153ca0 0x7f241c1592e0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f2410004e50 tx=0x7f2410001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:08.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.654+0000 7f240affd640 1 -- 172.21.15.105:0/911553916 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2410001d40 con 0x7f241c153ca0 2024-09-21T03:27:08.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.654+0000 7f240affd640 1 -- 172.21.15.105:0/911553916 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2410016070 con 0x7f241c153ca0 2024-09-21T03:27:08.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.654+0000 7f2420ad5640 1 -- 172.21.15.105:0/911553916 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f241c1447d0 con 0x7f241c153ca0 2024-09-21T03:27:08.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.654+0000 7f240affd640 1 -- 172.21.15.105:0/911553916 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2410010ac0 con 0x7f241c153ca0 2024-09-21T03:27:08.659 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.655+0000 7f2420ad5640 1 -- 172.21.15.105:0/911553916 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f241c09c4d0 con 0x7f241c153ca0 2024-09-21T03:27:08.659 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.655+0000 7f2420ad5640 1 -- 172.21.15.105:0/911553916 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f241c0b4d90 con 0x7f241c153ca0 2024-09-21T03:27:08.659 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.656+0000 7f240affd640 1 -- 172.21.15.105:0/911553916 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2410010c60 con 0x7f241c153ca0 2024-09-21T03:27:08.659 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.657+0000 7f240affd640 1 --2- 172.21.15.105:0/911553916 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f23fc078bc0 0x7f23fc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:08.659 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.657+0000 7f240affd640 1 -- 172.21.15.105:0/911553916 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 4943+0+0 (secure 0 0 0) 0x7f241009b1e0 con 0x7f241c153ca0 2024-09-21T03:27:08.660 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.657+0000 7f241a59c640 1 --2- 172.21.15.105:0/911553916 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f23fc078bc0 0x7f23fc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:08.660 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.657+0000 7f241a59c640 1 --2- 172.21.15.105:0/911553916 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f23fc078bc0 0x7f23fc07b0d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f240c033000 tx=0x7f241c0cdae0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:08.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.661+0000 7f240affd640 1 -- 172.21.15.105:0/911553916 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f241c159c30 con 0x7f241c153ca0 2024-09-21T03:27:08.849 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.847+0000 7f2420ad5640 1 -- 172.21.15.105:0/911553916 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f241c15b3d0 con 0x7f241c153ca0 2024-09-21T03:27:08.852 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.851+0000 7f240affd640 1 -- 172.21.15.105:0/911553916 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v68) ==== 71+0+0 (secure 0 0 0) 0x7f241c073240 con 0x7f241c153ca0 2024-09-21T03:27:08.855 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.853+0000 7f2420ad5640 1 -- 172.21.15.105:0/911553916 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f23fc078bc0 msgr2=0x7f23fc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:08.855 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.853+0000 7f2420ad5640 1 --2- 172.21.15.105:0/911553916 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f23fc078bc0 0x7f23fc07b0d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f240c033000 tx=0x7f241c0cdae0 comp rx=0 tx=0).stop 2024-09-21T03:27:08.855 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.853+0000 7f2420ad5640 1 -- 172.21.15.105:0/911553916 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f241c153ca0 msgr2=0x7f241c1592e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:08.855 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.853+0000 7f2420ad5640 1 --2- 172.21.15.105:0/911553916 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f241c153ca0 0x7f241c1592e0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f2410004e50 tx=0x7f2410001630 comp rx=0 tx=0).stop 2024-09-21T03:27:08.855 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.853+0000 7f2420ad5640 1 -- 172.21.15.105:0/911553916 shutdown_connections 2024-09-21T03:27:08.855 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.853+0000 7f2420ad5640 1 --2- 172.21.15.105:0/911553916 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f23fc078bc0 0x7f23fc07b0d0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:08.855 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.853+0000 7f2420ad5640 1 --2- 172.21.15.105:0/911553916 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f241c159820 0x7f241c09ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:08.855 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.853+0000 7f2420ad5640 1 --2- 172.21.15.105:0/911553916 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f241c153ca0 0x7f241c1592e0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:08.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.853+0000 7f2420ad5640 1 --2- 172.21.15.105:0/911553916 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2404003a30 0x7f241c1412b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:08.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.853+0000 7f2420ad5640 1 -- 172.21.15.105:0/911553916 >> 172.21.15.105:0/911553916 conn(0x7f241c06d7d0 msgr2=0x7f241c0cc730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:08.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.853+0000 7f2420ad5640 1 -- 172.21.15.105:0/911553916 shutdown_connections 2024-09-21T03:27:08.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.853+0000 7f2420ad5640 1 -- 172.21.15.105:0/911553916 wait complete. 2024-09-21T03:27:08.866 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_root' 2024-09-21T03:27:08.980 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.978+0000 7ff9933ad640 1 -- 172.21.15.105:0/2065731723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff98c15d670 msgr2=0x7ff98c0b7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:08.980 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.978+0000 7ff9933ad640 1 --2- 172.21.15.105:0/2065731723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff98c15d670 0x7ff98c0b7490 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7ff98c071d80 tx=0x7ff98402aa30 comp rx=0 tx=0).stop 2024-09-21T03:27:08.980 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.978+0000 7ff9933ad640 1 -- 172.21.15.105:0/2065731723 shutdown_connections 2024-09-21T03:27:08.980 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.978+0000 7ff9933ad640 1 --2- 172.21.15.105:0/2065731723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff98c15d670 0x7ff98c0b7490 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:08.980 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.978+0000 7ff9933ad640 1 --2- 172.21.15.105:0/2065731723 >> v2:172.21.15.162:3300/0 conn(0x7ff98c0d2630 0x7ff98c15d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:08.980 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.978+0000 7ff9933ad640 1 -- 172.21.15.105:0/2065731723 >> 172.21.15.105:0/2065731723 conn(0x7ff98c06d550 msgr2=0x7ff98c071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:08.980 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.978+0000 7ff9933ad640 1 -- 172.21.15.105:0/2065731723 shutdown_connections 2024-09-21T03:27:08.980 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.978+0000 7ff9933ad640 1 -- 172.21.15.105:0/2065731723 wait complete. 2024-09-21T03:27:08.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.980+0000 7ff9933ad640 1 Processor -- start 2024-09-21T03:27:08.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.980+0000 7ff9933ad640 1 -- start start 2024-09-21T03:27:08.984 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.981+0000 7ff9933ad640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff98c1570e0 0x7ff98c156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:08.984 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.981+0000 7ff9933ad640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff98c15d670 0x7ff98c1e85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:08.984 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.981+0000 7ff9933ad640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff98c15bf50 0x7ff98c1e8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:08.984 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.981+0000 7ff9933ad640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff98c0b7d60 con 0x7ff98c15bf50 2024-09-21T03:27:08.984 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.981+0000 7ff9933ad640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff98c0b7be0 con 0x7ff98c15d670 2024-09-21T03:27:08.984 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.981+0000 7ff9933ad640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff98c0b7ee0 con 0x7ff98c1570e0 2024-09-21T03:27:08.984 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.981+0000 7ff99194a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff98c15bf50 0x7ff98c1e8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:08.984 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.981+0000 7ff99194a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff98c15bf50 0x7ff98c1e8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58156/0 (socket says 172.21.15.105:58156) 2024-09-21T03:27:08.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.981+0000 7ff99194a640 1 -- 172.21.15.105:0/3896088513 learned_addr learned my addr 172.21.15.105:0/3896088513 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:08.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.981+0000 7ff990948640 1 --2- 172.21.15.105:0/3896088513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff98c15d670 0x7ff98c1e85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:08.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.981+0000 7ff991149640 1 --2- 172.21.15.105:0/3896088513 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff98c1570e0 0x7ff98c156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:08.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.981+0000 7ff99194a640 1 -- 172.21.15.105:0/3896088513 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff98c1570e0 msgr2=0x7ff98c156850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:08.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.981+0000 7ff99194a640 1 --2- 172.21.15.105:0/3896088513 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff98c1570e0 0x7ff98c156850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:08.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.981+0000 7ff99194a640 1 -- 172.21.15.105:0/3896088513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff98c15d670 msgr2=0x7ff98c1e85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:08.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.981+0000 7ff99194a640 1 --2- 172.21.15.105:0/3896088513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff98c15d670 0x7ff98c1e85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:08.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.981+0000 7ff99194a640 1 -- 172.21.15.105:0/3896088513 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff98c0ca200 con 0x7ff98c15bf50 2024-09-21T03:27:08.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.981+0000 7ff991149640 1 --2- 172.21.15.105:0/3896088513 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff98c1570e0 0x7ff98c156850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:27:08.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.981+0000 7ff990948640 1 --2- 172.21.15.105:0/3896088513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff98c15d670 0x7ff98c1e85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:27:08.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.981+0000 7ff99194a640 1 --2- 172.21.15.105:0/3896088513 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff98c15bf50 0x7ff98c1e8b00 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7ff984005fd0 tx=0x7ff984003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:08.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.982+0000 7ff981ffb640 1 -- 172.21.15.105:0/3896088513 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff984033050 con 0x7ff98c15bf50 2024-09-21T03:27:08.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.982+0000 7ff981ffb640 1 -- 172.21.15.105:0/3896088513 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff9840045f0 con 0x7ff98c15bf50 2024-09-21T03:27:08.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.982+0000 7ff981ffb640 1 -- 172.21.15.105:0/3896088513 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff984038450 con 0x7ff98c15bf50 2024-09-21T03:27:08.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.982+0000 7ff9933ad640 1 -- 172.21.15.105:0/3896088513 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff98c1f3920 con 0x7ff98c15bf50 2024-09-21T03:27:08.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.982+0000 7ff9933ad640 1 -- 172.21.15.105:0/3896088513 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff98c0cc4d0 con 0x7ff98c15bf50 2024-09-21T03:27:08.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.983+0000 7ff9933ad640 1 -- 172.21.15.105:0/3896088513 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff98c15d130 con 0x7ff98c15bf50 2024-09-21T03:27:08.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.984+0000 7ff981ffb640 1 -- 172.21.15.105:0/3896088513 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff984036070 con 0x7ff98c15bf50 2024-09-21T03:27:08.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.984+0000 7ff981ffb640 1 --2- 172.21.15.105:0/3896088513 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff970078b90 0x7ff97007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:08.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.984+0000 7ff981ffb640 1 -- 172.21.15.105:0/3896088513 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 4943+0+0 (secure 0 0 0) 0x7ff9840bbf80 con 0x7ff98c15bf50 2024-09-21T03:27:08.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.984+0000 7ff991149640 1 --2- 172.21.15.105:0/3896088513 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff970078b90 0x7ff97007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:08.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.985+0000 7ff991149640 1 --2- 172.21.15.105:0/3896088513 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff970078b90 0x7ff97007b0a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ff98800a810 tx=0x7ff988008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:08.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:08.989+0000 7ff981ffb640 1 -- 172.21.15.105:0/3896088513 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff9840847e0 con 0x7ff98c15bf50 2024-09-21T03:27:09.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.235+0000 7ff9933ad640 1 -- 172.21.15.105:0/3896088513 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_root"]} v 0) -- 0x7ff98c0b6b60 con 0x7ff98c15bf50 2024-09-21T03:27:09.521 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.520+0000 7ff981ffb640 1 -- 172.21.15.105:0/3896088513 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_root"]}]=0 v436) ==== 148+0+0 (secure 0 0 0) 0x7ff9840840e0 con 0x7ff98c15bf50 2024-09-21T03:27:09.524 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.522+0000 7ff9933ad640 1 -- 172.21.15.105:0/3896088513 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff970078b90 msgr2=0x7ff97007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:09.524 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.522+0000 7ff9933ad640 1 --2- 172.21.15.105:0/3896088513 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff970078b90 0x7ff97007b0a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ff98800a810 tx=0x7ff988008040 comp rx=0 tx=0).stop 2024-09-21T03:27:09.524 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.522+0000 7ff9933ad640 1 -- 172.21.15.105:0/3896088513 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff98c15bf50 msgr2=0x7ff98c1e8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:09.524 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.522+0000 7ff9933ad640 1 --2- 172.21.15.105:0/3896088513 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff98c15bf50 0x7ff98c1e8b00 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7ff984005fd0 tx=0x7ff984003f90 comp rx=0 tx=0).stop 2024-09-21T03:27:09.524 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.522+0000 7ff9933ad640 1 -- 172.21.15.105:0/3896088513 shutdown_connections 2024-09-21T03:27:09.524 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.522+0000 7ff9933ad640 1 --2- 172.21.15.105:0/3896088513 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff970078b90 0x7ff97007b0a0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:09.524 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.522+0000 7ff9933ad640 1 --2- 172.21.15.105:0/3896088513 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff98c15bf50 0x7ff98c1e8b00 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:09.524 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.522+0000 7ff9933ad640 1 --2- 172.21.15.105:0/3896088513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff98c15d670 0x7ff98c1e85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:09.524 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.522+0000 7ff9933ad640 1 --2- 172.21.15.105:0/3896088513 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff98c1570e0 0x7ff98c156850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:09.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.522+0000 7ff9933ad640 1 -- 172.21.15.105:0/3896088513 >> 172.21.15.105:0/3896088513 conn(0x7ff98c06d550 msgr2=0x7ff98c0d1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:09.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.522+0000 7ff9933ad640 1 -- 172.21.15.105:0/3896088513 shutdown_connections 2024-09-21T03:27:09.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.522+0000 7ff9933ad640 1 -- 172.21.15.105:0/3896088513 wait complete. 2024-09-21T03:27:09.537 INFO:tasks.cephfs_test_runner:test_client_pin_root (tasks.cephfs.test_client_limits.TestClientLimits) ... ok 2024-09-21T03:27:09.538 INFO:tasks.cephfs_test_runner:Starting test: test_client_release_bug (tasks.cephfs.test_client_limits.TestClientLimits) When a client has a bug (which we will simulate) preventing it from releasing caps, 2024-09-21T03:27:09.538 INFO:tasks.cephfs_test_runner:test_client_release_bug (tasks.cephfs.test_client_limits.TestClientLimits) 2024-09-21T03:27:09.538 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:27:09.651 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.649+0000 7f0115da8640 1 -- 172.21.15.105:0/3713986002 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01100cf540 msgr2=0x7f01100b5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:09.651 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.649+0000 7f0115da8640 1 --2- 172.21.15.105:0/3713986002 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01100cf540 0x7f01100b5fa0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f0104005fd0 tx=0x7f010402a930 comp rx=0 tx=0).stop 2024-09-21T03:27:09.651 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.649+0000 7f0115da8640 1 -- 172.21.15.105:0/3713986002 shutdown_connections 2024-09-21T03:27:09.651 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.649+0000 7f0115da8640 1 --2- 172.21.15.105:0/3713986002 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01100cf540 0x7f01100b5fa0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:09.651 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.649+0000 7f0115da8640 1 --2- 172.21.15.105:0/3713986002 >> v2:172.21.15.162:3300/0 conn(0x7f01100b9b60 0x7f01100d4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:09.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.649+0000 7f0115da8640 1 -- 172.21.15.105:0/3713986002 >> 172.21.15.105:0/3713986002 conn(0x7f011009d7f0 msgr2=0x7f01100d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:09.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.649+0000 7f0115da8640 1 -- 172.21.15.105:0/3713986002 shutdown_connections 2024-09-21T03:27:09.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.649+0000 7f0115da8640 1 -- 172.21.15.105:0/3713986002 wait complete. 2024-09-21T03:27:09.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.651+0000 7f0115da8640 1 Processor -- start 2024-09-21T03:27:09.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.651+0000 7f0115da8640 1 -- start start 2024-09-21T03:27:09.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.652+0000 7f0115da8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01100b64e0 0x7f01100a1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:09.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.652+0000 7f0115da8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01100b9b60 0x7f01100cc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:09.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.652+0000 7f0115da8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f01100cf540 0x7f01100ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:09.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.652+0000 7f0115da8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f01100d2e40 con 0x7f01100b64e0 2024-09-21T03:27:09.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.652+0000 7f0115da8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f01100d2cc0 con 0x7f01100b9b60 2024-09-21T03:27:09.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.652+0000 7f0115da8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f01100d2fc0 con 0x7f01100cf540 2024-09-21T03:27:09.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.652+0000 7f010f7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01100b64e0 0x7f01100a1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:09.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.652+0000 7f010f7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01100b64e0 0x7f01100a1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58178/0 (socket says 172.21.15.105:58178) 2024-09-21T03:27:09.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.652+0000 7f010f7fe640 1 -- 172.21.15.105:0/3536115365 learned_addr learned my addr 172.21.15.105:0/3536115365 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:09.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.653+0000 7f010effd640 1 --2- 172.21.15.105:0/3536115365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01100b9b60 0x7f01100cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:09.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.653+0000 7f010ffff640 1 --2- 172.21.15.105:0/3536115365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f01100cf540 0x7f01100ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:09.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.653+0000 7f010f7fe640 1 -- 172.21.15.105:0/3536115365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f01100cf540 msgr2=0x7f01100ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:09.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.653+0000 7f010f7fe640 1 --2- 172.21.15.105:0/3536115365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f01100cf540 0x7f01100ccb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:09.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.653+0000 7f010f7fe640 1 -- 172.21.15.105:0/3536115365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01100b9b60 msgr2=0x7f01100cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:09.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.653+0000 7f010f7fe640 1 --2- 172.21.15.105:0/3536115365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01100b9b60 0x7f01100cc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:09.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.653+0000 7f010f7fe640 1 -- 172.21.15.105:0/3536115365 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01100c93d0 con 0x7f01100b64e0 2024-09-21T03:27:09.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.653+0000 7f010f7fe640 1 --2- 172.21.15.105:0/3536115365 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01100b64e0 0x7f01100a1be0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f010000c970 tx=0x7f010000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:09.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.653+0000 7f00f7fff640 1 -- 172.21.15.105:0/3536115365 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0100007bb0 con 0x7f01100b64e0 2024-09-21T03:27:09.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.653+0000 7f00f7fff640 1 -- 172.21.15.105:0/3536115365 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0100007d50 con 0x7f01100b64e0 2024-09-21T03:27:09.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.653+0000 7f0115da8640 1 -- 172.21.15.105:0/3536115365 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01100c96b0 con 0x7f01100b64e0 2024-09-21T03:27:09.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.653+0000 7f00f7fff640 1 -- 172.21.15.105:0/3536115365 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0100005290 con 0x7f01100b64e0 2024-09-21T03:27:09.657 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.653+0000 7f0115da8640 1 -- 172.21.15.105:0/3536115365 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01100c9c70 con 0x7f01100b64e0 2024-09-21T03:27:09.657 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.654+0000 7f0115da8640 1 -- 172.21.15.105:0/3536115365 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01100d4d80 con 0x7f01100b64e0 2024-09-21T03:27:09.657 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.655+0000 7f00f7fff640 1 -- 172.21.15.105:0/3536115365 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0100005430 con 0x7f01100b64e0 2024-09-21T03:27:09.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.655+0000 7f00f7fff640 1 --2- 172.21.15.105:0/3536115365 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f00fc078bc0 0x7f00fc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:09.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.655+0000 7f00f7fff640 1 -- 172.21.15.105:0/3536115365 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 4943+0+0 (secure 0 0 0) 0x7f010009aef0 con 0x7f01100b64e0 2024-09-21T03:27:09.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.656+0000 7f010effd640 1 --2- 172.21.15.105:0/3536115365 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f00fc078bc0 0x7f00fc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:09.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.656+0000 7f010effd640 1 --2- 172.21.15.105:0/3536115365 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f00fc078bc0 0x7f00fc07b0d0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f0104035000 tx=0x7f0104004ab0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:09.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.660+0000 7f00f7fff640 1 -- 172.21.15.105:0/3536115365 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0100014070 con 0x7f01100b64e0 2024-09-21T03:27:09.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.838+0000 7f0115da8640 1 -- 172.21.15.105:0/3536115365 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f01100d3fb0 con 0x7f01100b64e0 2024-09-21T03:27:09.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.838+0000 7f00f7fff640 1 -- 172.21.15.105:0/3536115365 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) ==== 74+0+13114 (secure 0 0 0) 0x7f0100063640 con 0x7f01100b64e0 2024-09-21T03:27:09.840 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:27:09.840 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":132,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:27:08.513796+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.162:6837/712373587":"2024-09-22T03:27:05.421559+0000","172.21.15.162:6834/712373587":"2024-09-22T03:27:05.421559+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:27:09.842 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.840+0000 7f0115da8640 1 -- 172.21.15.105:0/3536115365 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f00fc078bc0 msgr2=0x7f00fc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:09.842 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.840+0000 7f0115da8640 1 --2- 172.21.15.105:0/3536115365 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f00fc078bc0 0x7f00fc07b0d0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f0104035000 tx=0x7f0104004ab0 comp rx=0 tx=0).stop 2024-09-21T03:27:09.843 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.840+0000 7f0115da8640 1 -- 172.21.15.105:0/3536115365 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01100b64e0 msgr2=0x7f01100a1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:09.843 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.840+0000 7f0115da8640 1 --2- 172.21.15.105:0/3536115365 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01100b64e0 0x7f01100a1be0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f010000c970 tx=0x7f010000ce30 comp rx=0 tx=0).stop 2024-09-21T03:27:09.843 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.840+0000 7f0115da8640 1 -- 172.21.15.105:0/3536115365 shutdown_connections 2024-09-21T03:27:09.843 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.840+0000 7f0115da8640 1 --2- 172.21.15.105:0/3536115365 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f00fc078bc0 0x7f00fc07b0d0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:09.843 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.840+0000 7f0115da8640 1 --2- 172.21.15.105:0/3536115365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f01100cf540 0x7f01100ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:09.843 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.840+0000 7f0115da8640 1 --2- 172.21.15.105:0/3536115365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01100b9b60 0x7f01100cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:09.843 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.840+0000 7f0115da8640 1 --2- 172.21.15.105:0/3536115365 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01100b64e0 0x7f01100a1be0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:09.843 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.840+0000 7f0115da8640 1 -- 172.21.15.105:0/3536115365 >> 172.21.15.105:0/3536115365 conn(0x7f011009d7f0 msgr2=0x7f01100d36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:09.843 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.841+0000 7f0115da8640 1 -- 172.21.15.105:0/3536115365 shutdown_connections 2024-09-21T03:27:09.843 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.841+0000 7f0115da8640 1 -- 172.21.15.105:0/3536115365 wait complete. 2024-09-21T03:27:09.854 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T03:18:19.296947+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T03:27:09.854 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T03:27:09.971 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.969+0000 7fe2725cc640 1 -- 172.21.15.105:0/3655727305 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe26c0b3e20 msgr2=0x7fe26c0b4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:09.971 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.969+0000 7fe2725cc640 1 --2- 172.21.15.105:0/3655727305 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe26c0b3e20 0x7fe26c0b4230 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fe264005fd0 tx=0x7fe26402aa00 comp rx=0 tx=0).stop 2024-09-21T03:27:09.971 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.969+0000 7fe2725cc640 1 -- 172.21.15.105:0/3655727305 shutdown_connections 2024-09-21T03:27:09.971 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.969+0000 7fe2725cc640 1 --2- 172.21.15.105:0/3655727305 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe26c0b3e20 0x7fe26c0b4230 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:09.972 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.969+0000 7fe2725cc640 1 --2- 172.21.15.105:0/3655727305 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe26c15c930 0x7fe26c0d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:09.972 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.969+0000 7fe2725cc640 1 -- 172.21.15.105:0/3655727305 >> 172.21.15.105:0/3655727305 conn(0x7fe26c0cee20 msgr2=0x7fe26c0cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:09.972 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.969+0000 7fe2725cc640 1 -- 172.21.15.105:0/3655727305 shutdown_connections 2024-09-21T03:27:09.972 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.969+0000 7fe2725cc640 1 -- 172.21.15.105:0/3655727305 wait complete. 2024-09-21T03:27:09.972 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.971+0000 7fe2725cc640 1 Processor -- start 2024-09-21T03:27:09.973 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.971+0000 7fe2725cc640 1 -- start start 2024-09-21T03:27:09.975 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.972+0000 7fe2725cc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe26c0b3e20 0x7fe26c0cae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:09.975 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.972+0000 7fe2725cc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe26c0cff70 0x7fe26c1f53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:09.976 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.972+0000 7fe2725cc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe26c15c930 0x7fe26c157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:09.976 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.972+0000 7fe2725cc640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe26c0c64d0 con 0x7fe26c0b3e20 2024-09-21T03:27:09.976 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.972+0000 7fe2725cc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe26c0c6350 con 0x7fe26c15c930 2024-09-21T03:27:09.976 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.972+0000 7fe2725cc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe26c0c6650 con 0x7fe26c0cff70 2024-09-21T03:27:09.976 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.972+0000 7fe26bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe26c0b3e20 0x7fe26c0cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:09.976 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.972+0000 7fe26bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe26c0b3e20 0x7fe26c0cae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58200/0 (socket says 172.21.15.105:58200) 2024-09-21T03:27:09.976 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.972+0000 7fe26bfff640 1 -- 172.21.15.105:0/3487250843 learned_addr learned my addr 172.21.15.105:0/3487250843 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:09.976 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.972+0000 7fe270b69640 1 --2- 172.21.15.105:0/3487250843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe26c15c930 0x7fe26c157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:09.976 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.972+0000 7fe26b7fe640 1 --2- 172.21.15.105:0/3487250843 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe26c0cff70 0x7fe26c1f53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:09.976 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.972+0000 7fe26bfff640 1 -- 172.21.15.105:0/3487250843 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe26c0cff70 msgr2=0x7fe26c1f53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:09.977 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.972+0000 7fe26bfff640 1 --2- 172.21.15.105:0/3487250843 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe26c0cff70 0x7fe26c1f53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:09.977 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.972+0000 7fe26bfff640 1 -- 172.21.15.105:0/3487250843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe26c15c930 msgr2=0x7fe26c157170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:09.977 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.972+0000 7fe26bfff640 1 --2- 172.21.15.105:0/3487250843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe26c15c930 0x7fe26c157170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:09.977 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.972+0000 7fe26bfff640 1 -- 172.21.15.105:0/3487250843 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe26c0b6430 con 0x7fe26c0b3e20 2024-09-21T03:27:09.977 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.972+0000 7fe270b69640 1 --2- 172.21.15.105:0/3487250843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe26c15c930 0x7fe26c157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:27:09.977 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.973+0000 7fe26bfff640 1 --2- 172.21.15.105:0/3487250843 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe26c0b3e20 0x7fe26c0cae80 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fe25c00c390 tx=0x7fe25c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:09.977 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.973+0000 7fe268ff9640 1 -- 172.21.15.105:0/3487250843 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25c011790 con 0x7fe26c0b3e20 2024-09-21T03:27:09.977 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.973+0000 7fe268ff9640 1 -- 172.21.15.105:0/3487250843 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe25c017070 con 0x7fe26c0b3e20 2024-09-21T03:27:09.977 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.973+0000 7fe2725cc640 1 -- 172.21.15.105:0/3487250843 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe26c1f5c20 con 0x7fe26c0b3e20 2024-09-21T03:27:09.977 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.973+0000 7fe268ff9640 1 -- 172.21.15.105:0/3487250843 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25c011cc0 con 0x7fe26c0b3e20 2024-09-21T03:27:09.977 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.973+0000 7fe2725cc640 1 -- 172.21.15.105:0/3487250843 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe26c1f61e0 con 0x7fe26c0b3e20 2024-09-21T03:27:09.978 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.974+0000 7fe2725cc640 1 -- 172.21.15.105:0/3487250843 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe26c0c6b60 con 0x7fe26c0b3e20 2024-09-21T03:27:09.978 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.975+0000 7fe268ff9640 1 -- 172.21.15.105:0/3487250843 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe25c01c460 con 0x7fe26c0b3e20 2024-09-21T03:27:09.979 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.975+0000 7fe268ff9640 1 --2- 172.21.15.105:0/3487250843 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe258078bc0 0x7fe25807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:09.979 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.975+0000 7fe268ff9640 1 -- 172.21.15.105:0/3487250843 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 4943+0+0 (secure 0 0 0) 0x7fe25c09a730 con 0x7fe26c0b3e20 2024-09-21T03:27:09.979 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.976+0000 7fe26b7fe640 1 --2- 172.21.15.105:0/3487250843 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe258078bc0 0x7fe25807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:09.979 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.976+0000 7fe26b7fe640 1 --2- 172.21.15.105:0/3487250843 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe258078bc0 0x7fe25807b0d0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fe26c0b4640 tx=0x7fe26000b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:09.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:09.980+0000 7fe268ff9640 1 -- 172.21.15.105:0/3487250843 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe25c062e70 con 0x7fe26c0b3e20 2024-09-21T03:27:10.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.156+0000 7fe2725cc640 1 -- 172.21.15.105:0/3487250843 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe26c0700e0 con 0x7fe26c0b3e20 2024-09-21T03:27:10.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.156+0000 7fe268ff9640 1 -- 172.21.15.105:0/3487250843 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v132) ==== 93+0+10 (secure 0 0 0) 0x7fe25c062770 con 0x7fe26c0b3e20 2024-09-21T03:27:10.158 INFO:teuthology.orchestra.run.smithi105.stdout:pg_num: 1 2024-09-21T03:27:10.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.158+0000 7fe2725cc640 1 -- 172.21.15.105:0/3487250843 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe258078bc0 msgr2=0x7fe25807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:10.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.158+0000 7fe2725cc640 1 --2- 172.21.15.105:0/3487250843 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe258078bc0 0x7fe25807b0d0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fe26c0b4640 tx=0x7fe26000b2e0 comp rx=0 tx=0).stop 2024-09-21T03:27:10.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.158+0000 7fe2725cc640 1 -- 172.21.15.105:0/3487250843 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe26c0b3e20 msgr2=0x7fe26c0cae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:10.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.158+0000 7fe2725cc640 1 --2- 172.21.15.105:0/3487250843 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe26c0b3e20 0x7fe26c0cae80 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fe25c00c390 tx=0x7fe25c00c850 comp rx=0 tx=0).stop 2024-09-21T03:27:10.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.158+0000 7fe2725cc640 1 -- 172.21.15.105:0/3487250843 shutdown_connections 2024-09-21T03:27:10.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.158+0000 7fe2725cc640 1 --2- 172.21.15.105:0/3487250843 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe258078bc0 0x7fe25807b0d0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:10.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.158+0000 7fe2725cc640 1 --2- 172.21.15.105:0/3487250843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe26c15c930 0x7fe26c157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:10.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.158+0000 7fe2725cc640 1 --2- 172.21.15.105:0/3487250843 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe26c0cff70 0x7fe26c1f53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:10.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.158+0000 7fe2725cc640 1 --2- 172.21.15.105:0/3487250843 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe26c0b3e20 0x7fe26c0cae80 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:10.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.158+0000 7fe2725cc640 1 -- 172.21.15.105:0/3487250843 >> 172.21.15.105:0/3487250843 conn(0x7fe26c0cee20 msgr2=0x7fe26c0c6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:10.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.158+0000 7fe2725cc640 1 -- 172.21.15.105:0/3487250843 shutdown_connections 2024-09-21T03:27:10.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.158+0000 7fe2725cc640 1 -- 172.21.15.105:0/3487250843 wait complete. 2024-09-21T03:27:10.171 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_release_bug' 2024-09-21T03:27:10.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.282+0000 7ff8b0cf9640 1 -- 172.21.15.105:0/1035520755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8ac0705d0 msgr2=0x7ff8ac0b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:10.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.282+0000 7ff8b0cf9640 1 --2- 172.21.15.105:0/1035520755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8ac0705d0 0x7ff8ac0b3550 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0005fd0 tx=0x7ff8a002a5d0 comp rx=0 tx=0).stop 2024-09-21T03:27:10.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.282+0000 7ff8b0cf9640 1 -- 172.21.15.105:0/1035520755 shutdown_connections 2024-09-21T03:27:10.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.282+0000 7ff8b0cf9640 1 --2- 172.21.15.105:0/1035520755 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8ac0cfeb0 0x7ff8ac0d02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:10.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.282+0000 7ff8b0cf9640 1 --2- 172.21.15.105:0/1035520755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8ac0705d0 0x7ff8ac0b3550 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:10.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.282+0000 7ff8b0cf9640 1 -- 172.21.15.105:0/1035520755 >> 172.21.15.105:0/1035520755 conn(0x7ff8ac0cdcc0 msgr2=0x7ff8ac0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:10.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.282+0000 7ff8b0cf9640 1 -- 172.21.15.105:0/1035520755 shutdown_connections 2024-09-21T03:27:10.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.282+0000 7ff8b0cf9640 1 -- 172.21.15.105:0/1035520755 wait complete. 2024-09-21T03:27:10.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.284+0000 7ff8b0cf9640 1 Processor -- start 2024-09-21T03:27:10.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.284+0000 7ff8b0cf9640 1 -- start start 2024-09-21T03:27:10.288 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.285+0000 7ff8b0cf9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8ac0b4090 0x7ff8ac14e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:10.288 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.285+0000 7ff8b0cf9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8ac0cfeb0 0x7ff8ac0b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:10.288 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.285+0000 7ff8b0cf9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8ac0cc6e0 0x7ff8ac0ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:10.288 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.285+0000 7ff8b0cf9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff8ac0b4a30 con 0x7ff8ac0b4090 2024-09-21T03:27:10.288 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.285+0000 7ff8b0cf9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff8ac0b48b0 con 0x7ff8ac0cfeb0 2024-09-21T03:27:10.288 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.285+0000 7ff8b0cf9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff8ac0b4bb0 con 0x7ff8ac0cc6e0 2024-09-21T03:27:10.288 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.285+0000 7ff8aa59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8ac0b4090 0x7ff8ac14e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:10.288 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.285+0000 7ff8aa59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8ac0b4090 0x7ff8ac14e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:58220/0 (socket says 172.21.15.105:58220) 2024-09-21T03:27:10.288 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.285+0000 7ff8aa59c640 1 -- 172.21.15.105:0/451419147 learned_addr learned my addr 172.21.15.105:0/451419147 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:10.288 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.285+0000 7ff8aad9d640 1 --2- 172.21.15.105:0/451419147 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8ac0cc6e0 0x7ff8ac0ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:10.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.285+0000 7ff8a9d9b640 1 --2- 172.21.15.105:0/451419147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8ac0cfeb0 0x7ff8ac0b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:10.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.285+0000 7ff8aa59c640 1 -- 172.21.15.105:0/451419147 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8ac0cc6e0 msgr2=0x7ff8ac0ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:10.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.285+0000 7ff8aa59c640 1 --2- 172.21.15.105:0/451419147 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8ac0cc6e0 0x7ff8ac0ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:10.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.285+0000 7ff8aa59c640 1 -- 172.21.15.105:0/451419147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8ac0cfeb0 msgr2=0x7ff8ac0b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:10.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.285+0000 7ff8aa59c640 1 --2- 172.21.15.105:0/451419147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8ac0cfeb0 0x7ff8ac0b24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:10.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.285+0000 7ff8aa59c640 1 -- 172.21.15.105:0/451419147 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8ac0cd030 con 0x7ff8ac0b4090 2024-09-21T03:27:10.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.285+0000 7ff8aad9d640 1 --2- 172.21.15.105:0/451419147 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8ac0cc6e0 0x7ff8ac0ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:27:10.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.285+0000 7ff8a9d9b640 1 --2- 172.21.15.105:0/451419147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8ac0cfeb0 0x7ff8ac0b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:27:10.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.286+0000 7ff8aa59c640 1 --2- 172.21.15.105:0/451419147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8ac0b4090 0x7ff8ac14e3e0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7ff89c00c3d0 tx=0x7ff89c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:10.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.286+0000 7ff89affd640 1 -- 172.21.15.105:0/451419147 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff89c017070 con 0x7ff8ac0b4090 2024-09-21T03:27:10.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.286+0000 7ff89affd640 1 -- 172.21.15.105:0/451419147 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff89c0053c0 con 0x7ff8ac0b4090 2024-09-21T03:27:10.290 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.286+0000 7ff89affd640 1 -- 172.21.15.105:0/451419147 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff89c003850 con 0x7ff8ac0b4090 2024-09-21T03:27:10.290 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.286+0000 7ff8b0cf9640 1 -- 172.21.15.105:0/451419147 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8ac14ee00 con 0x7ff8ac0b4090 2024-09-21T03:27:10.290 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.286+0000 7ff8b0cf9640 1 -- 172.21.15.105:0/451419147 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8ac14f3c0 con 0x7ff8ac0b4090 2024-09-21T03:27:10.291 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.287+0000 7ff8b0cf9640 1 -- 172.21.15.105:0/451419147 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8ac0d0ee0 con 0x7ff8ac0b4090 2024-09-21T03:27:10.291 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.287+0000 7ff89affd640 1 -- 172.21.15.105:0/451419147 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff89c01a070 con 0x7ff8ac0b4090 2024-09-21T03:27:10.291 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.288+0000 7ff89affd640 1 --2- 172.21.15.105:0/451419147 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff88c078b90 0x7ff88c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:10.291 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.288+0000 7ff89affd640 1 -- 172.21.15.105:0/451419147 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 4943+0+0 (secure 0 0 0) 0x7ff89c099ce0 con 0x7ff8ac0b4090 2024-09-21T03:27:10.291 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.288+0000 7ff8a9d9b640 1 --2- 172.21.15.105:0/451419147 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff88c078b90 0x7ff88c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:10.291 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.289+0000 7ff8a9d9b640 1 --2- 172.21.15.105:0/451419147 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff88c078b90 0x7ff88c07b0a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0033000 tx=0x7ff8a0004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:10.294 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.292+0000 7ff89affd640 1 -- 172.21.15.105:0/451419147 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff8ac0d0ee0 con 0x7ff8ac0b4090 2024-09-21T03:27:10.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:10.537+0000 7ff8b0cf9640 1 -- 172.21.15.105:0/451419147 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_release_bug"]} v 0) -- 0x7ff8ac0b5060 con 0x7ff8ac0b4090 2024-09-21T03:27:11.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.527+0000 7ff89affd640 1 -- 172.21.15.105:0/451419147 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_release_bug"]}]=0 v438) ==== 154+0+0 (secure 0 0 0) 0x7ff8ac0cd030 con 0x7ff8ac0b4090 2024-09-21T03:27:11.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.530+0000 7ff8b0cf9640 1 -- 172.21.15.105:0/451419147 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff88c078b90 msgr2=0x7ff88c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:11.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.530+0000 7ff8b0cf9640 1 --2- 172.21.15.105:0/451419147 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff88c078b90 0x7ff88c07b0a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0033000 tx=0x7ff8a0004730 comp rx=0 tx=0).stop 2024-09-21T03:27:11.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.530+0000 7ff8b0cf9640 1 -- 172.21.15.105:0/451419147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8ac0b4090 msgr2=0x7ff8ac14e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:11.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.530+0000 7ff8b0cf9640 1 --2- 172.21.15.105:0/451419147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8ac0b4090 0x7ff8ac14e3e0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7ff89c00c3d0 tx=0x7ff89c00c890 comp rx=0 tx=0).stop 2024-09-21T03:27:11.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.530+0000 7ff8b0cf9640 1 -- 172.21.15.105:0/451419147 shutdown_connections 2024-09-21T03:27:11.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.530+0000 7ff8b0cf9640 1 --2- 172.21.15.105:0/451419147 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff88c078b90 0x7ff88c07b0a0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:11.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.530+0000 7ff8b0cf9640 1 --2- 172.21.15.105:0/451419147 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8ac0cc6e0 0x7ff8ac0ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:11.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.530+0000 7ff8b0cf9640 1 --2- 172.21.15.105:0/451419147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8ac0cfeb0 0x7ff8ac0b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:11.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.530+0000 7ff8b0cf9640 1 --2- 172.21.15.105:0/451419147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8ac0b4090 0x7ff8ac14e3e0 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:11.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.530+0000 7ff8b0cf9640 1 -- 172.21.15.105:0/451419147 >> 172.21.15.105:0/451419147 conn(0x7ff8ac0cdcc0 msgr2=0x7ff8ac0af280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:11.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.530+0000 7ff8b0cf9640 1 -- 172.21.15.105:0/451419147 shutdown_connections 2024-09-21T03:27:11.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.530+0000 7ff8b0cf9640 1 -- 172.21.15.105:0/451419147 wait complete. 2024-09-21T03:27:11.546 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T03:27:11.666 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.664+0000 7fcbb7dba640 1 -- 172.21.15.105:0/2547388083 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbb00d1d40 msgr2=0x7fcbb00b5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:11.666 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.664+0000 7fcbb7dba640 1 --2- 172.21.15.105:0/2547388083 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbb00d1d40 0x7fcbb00b5210 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0072650 tx=0x7fcbac02a5f0 comp rx=0 tx=0).stop 2024-09-21T03:27:11.666 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.664+0000 7fcbb7dba640 1 -- 172.21.15.105:0/2547388083 shutdown_connections 2024-09-21T03:27:11.666 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.664+0000 7fcbb7dba640 1 --2- 172.21.15.105:0/2547388083 >> v2:172.21.15.162:3300/0 conn(0x7fcbb00ccba0 0x7fcbb00ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:11.666 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.664+0000 7fcbb7dba640 1 --2- 172.21.15.105:0/2547388083 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbb00d1d40 0x7fcbb00b5210 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:11.666 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.664+0000 7fcbb7dba640 1 -- 172.21.15.105:0/2547388083 >> 172.21.15.105:0/2547388083 conn(0x7fcbb00b3f10 msgr2=0x7fcbb00b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:11.666 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.664+0000 7fcbb7dba640 1 -- 172.21.15.105:0/2547388083 shutdown_connections 2024-09-21T03:27:11.667 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.664+0000 7fcbb7dba640 1 -- 172.21.15.105:0/2547388083 wait complete. 2024-09-21T03:27:11.667 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.666+0000 7fcbb7dba640 1 Processor -- start 2024-09-21T03:27:11.667 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.666+0000 7fcbb7dba640 1 -- start start 2024-09-21T03:27:11.669 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.667+0000 7fcbb7dba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbb00ccba0 0x7fcbb0152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:11.670 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.667+0000 7fcbb7dba640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbb00d1d40 0x7fcbb006ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:11.670 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.667+0000 7fcbb7dba640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbb015c6f0 0x7fcbb006f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:11.670 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.667+0000 7fcbb7dba640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb00d11f0 con 0x7fcbb015c6f0 2024-09-21T03:27:11.670 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.667+0000 7fcbb7dba640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb00d1070 con 0x7fcbb00ccba0 2024-09-21T03:27:11.670 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.667+0000 7fcbb7dba640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcbb00d1370 con 0x7fcbb00d1d40 2024-09-21T03:27:11.670 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.667+0000 7fcbb6357640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbb015c6f0 0x7fcbb006f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:11.670 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.667+0000 7fcbb6357640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbb015c6f0 0x7fcbb006f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:55458/0 (socket says 172.21.15.105:55458) 2024-09-21T03:27:11.670 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.667+0000 7fcbb6357640 1 -- 172.21.15.105:0/1979476973 learned_addr learned my addr 172.21.15.105:0/1979476973 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:11.670 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.667+0000 7fcbb6357640 1 -- 172.21.15.105:0/1979476973 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbb00d1d40 msgr2=0x7fcbb006ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:11.670 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.667+0000 7fcbb6357640 1 --2- 172.21.15.105:0/1979476973 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbb00d1d40 0x7fcbb006ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:11.670 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.667+0000 7fcbb6357640 1 -- 172.21.15.105:0/1979476973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbb00ccba0 msgr2=0x7fcbb0152300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:11.670 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.667+0000 7fcbb6357640 1 --2- 172.21.15.105:0/1979476973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbb00ccba0 0x7fcbb0152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:11.670 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.667+0000 7fcbb6357640 1 -- 172.21.15.105:0/1979476973 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbb0153140 con 0x7fcbb015c6f0 2024-09-21T03:27:11.671 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.667+0000 7fcbb6357640 1 --2- 172.21.15.105:0/1979476973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbb015c6f0 0x7fcbb006f470 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7fcba800b970 tx=0x7fcba800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:11.671 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.668+0000 7fcba67fc640 1 -- 172.21.15.105:0/1979476973 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba8019070 con 0x7fcbb015c6f0 2024-09-21T03:27:11.671 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.668+0000 7fcba67fc640 1 -- 172.21.15.105:0/1979476973 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcba800cc50 con 0x7fcbb015c6f0 2024-09-21T03:27:11.671 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.668+0000 7fcbb7dba640 1 -- 172.21.15.105:0/1979476973 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbb006e170 con 0x7fcbb015c6f0 2024-09-21T03:27:11.671 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.668+0000 7fcba67fc640 1 -- 172.21.15.105:0/1979476973 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba80146a0 con 0x7fcbb015c6f0 2024-09-21T03:27:11.671 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.668+0000 7fcbb7dba640 1 -- 172.21.15.105:0/1979476973 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbb006e730 con 0x7fcbb015c6f0 2024-09-21T03:27:11.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.669+0000 7fcbb7dba640 1 -- 172.21.15.105:0/1979476973 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbb00d1890 con 0x7fcbb015c6f0 2024-09-21T03:27:11.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.669+0000 7fcba67fc640 1 -- 172.21.15.105:0/1979476973 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcba801c070 con 0x7fcbb015c6f0 2024-09-21T03:27:11.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.670+0000 7fcba67fc640 1 --2- 172.21.15.105:0/1979476973 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcb94078b90 0x7fcb9407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:11.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.670+0000 7fcba67fc640 1 -- 172.21.15.105:0/1979476973 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 4943+0+0 (secure 0 0 0) 0x7fcba809a6d0 con 0x7fcbb015c6f0 2024-09-21T03:27:11.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.671+0000 7fcbb5b56640 1 --2- 172.21.15.105:0/1979476973 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcb94078b90 0x7fcb9407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:11.673 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.671+0000 7fcbb5b56640 1 --2- 172.21.15.105:0/1979476973 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcb94078b90 0x7fcb9407b0a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fcbac033000 tx=0x7fcbac0046c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:11.676 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.675+0000 7fcba67fc640 1 -- 172.21.15.105:0/1979476973 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fcba8062f30 con 0x7fcbb015c6f0 2024-09-21T03:27:11.852 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.851+0000 7fcbb7dba640 1 -- 172.21.15.105:0/1979476973 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fcbb0153d50 con 0x7fcbb015c6f0 2024-09-21T03:27:11.853 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.851+0000 7fcba67fc640 1 -- 172.21.15.105:0/1979476973 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v68) ==== 59+0+2294 (secure 0 0 0) 0x7fcba8062830 con 0x7fcbb015c6f0 2024-09-21T03:27:11.853 INFO:teuthology.orchestra.run.smithi105.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T03:27:11.853 INFO:teuthology.orchestra.run.smithi105.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T03:27:11.853 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced client_mount_timeout 30 2024-09-21T03:27:11.853 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced debug_client 20/20 2024-09-21T03:27:11.853 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced debug_mgr 20/20 2024-09-21T03:27:11.854 INFO:teuthology.orchestra.run.smithi105.stdout:mgr advanced debug_ms 1/1 2024-09-21T03:27:11.854 INFO:teuthology.orchestra.run.smithi105.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T03:27:11.854 INFO:teuthology.orchestra.run.smithi105.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T03:27:11.854 INFO:teuthology.orchestra.run.smithi105.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 7291.545169 2024-09-21T03:27:11.854 INFO:teuthology.orchestra.run.smithi105.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5080.142035 2024-09-21T03:27:11.854 INFO:teuthology.orchestra.run.smithi105.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 5120.988640 2024-09-21T03:27:11.854 INFO:teuthology.orchestra.run.smithi105.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4938.196268 2024-09-21T03:27:11.854 INFO:teuthology.orchestra.run.smithi105.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4906.316728 2024-09-21T03:27:11.854 INFO:teuthology.orchestra.run.smithi105.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4701.273858 2024-09-21T03:27:11.854 INFO:teuthology.orchestra.run.smithi105.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4947.710044 2024-09-21T03:27:11.854 INFO:teuthology.orchestra.run.smithi105.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5174.949063 2024-09-21T03:27:11.854 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced debug_mds 20/20 2024-09-21T03:27:11.854 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T03:27:11.855 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced debug_ms 2/2 2024-09-21T03:27:11.855 INFO:teuthology.orchestra.run.smithi105.stdout:mds dev mds_debug_frag true 2024-09-21T03:27:11.855 INFO:teuthology.orchestra.run.smithi105.stdout:mds dev mds_debug_scatterstat true 2024-09-21T03:27:11.855 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T03:27:11.855 INFO:teuthology.orchestra.run.smithi105.stdout:mds dev mds_verify_scatter true 2024-09-21T03:27:11.855 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T03:27:11.855 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T03:27:11.855 INFO:teuthology.orchestra.run.smithi105.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T03:27:11.855 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced client_mount_timeout 600 2024-09-21T03:27:11.855 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced debug_client 20/20 2024-09-21T03:27:11.855 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced debug_ms 1/1 2024-09-21T03:27:11.855 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T03:27:11.855 INFO:teuthology.orchestra.run.smithi105.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T03:27:11.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.853+0000 7fcbb7dba640 1 -- 172.21.15.105:0/1979476973 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcb94078b90 msgr2=0x7fcb9407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:11.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.853+0000 7fcbb7dba640 1 --2- 172.21.15.105:0/1979476973 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcb94078b90 0x7fcb9407b0a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fcbac033000 tx=0x7fcbac0046c0 comp rx=0 tx=0).stop 2024-09-21T03:27:11.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.853+0000 7fcbb7dba640 1 -- 172.21.15.105:0/1979476973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbb015c6f0 msgr2=0x7fcbb006f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:11.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.853+0000 7fcbb7dba640 1 --2- 172.21.15.105:0/1979476973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbb015c6f0 0x7fcbb006f470 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7fcba800b970 tx=0x7fcba800be30 comp rx=0 tx=0).stop 2024-09-21T03:27:11.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.854+0000 7fcbb7dba640 1 -- 172.21.15.105:0/1979476973 shutdown_connections 2024-09-21T03:27:11.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.854+0000 7fcbb7dba640 1 --2- 172.21.15.105:0/1979476973 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fcb94078b90 0x7fcb9407b0a0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:11.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.854+0000 7fcbb7dba640 1 --2- 172.21.15.105:0/1979476973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbb015c6f0 0x7fcbb006f470 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:11.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.854+0000 7fcbb7dba640 1 --2- 172.21.15.105:0/1979476973 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbb00d1d40 0x7fcbb006ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:11.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.854+0000 7fcbb7dba640 1 --2- 172.21.15.105:0/1979476973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbb00ccba0 0x7fcbb0152300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:11.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.854+0000 7fcbb7dba640 1 -- 172.21.15.105:0/1979476973 >> 172.21.15.105:0/1979476973 conn(0x7fcbb00b3f10 msgr2=0x7fcbb0068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:11.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.854+0000 7fcbb7dba640 1 -- 172.21.15.105:0/1979476973 shutdown_connections 2024-09-21T03:27:11.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.854+0000 7fcbb7dba640 1 -- 172.21.15.105:0/1979476973 wait complete. 2024-09-21T03:27:11.866 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T03:27:11.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.979+0000 7f25b218b640 1 -- 172.21.15.105:0/3451408229 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f25ac070af0 msgr2=0x7f25ac070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:11.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.979+0000 7f25b218b640 1 --2- 172.21.15.105:0/3451408229 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f25ac070af0 0x7f25ac070f00 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f25a4009900 tx=0x7f25a402a580 comp rx=0 tx=0).stop 2024-09-21T03:27:11.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.979+0000 7f25b218b640 1 -- 172.21.15.105:0/3451408229 shutdown_connections 2024-09-21T03:27:11.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.979+0000 7f25b218b640 1 --2- 172.21.15.105:0/3451408229 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f25ac070af0 0x7f25ac070f00 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:11.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.979+0000 7f25b218b640 1 --2- 172.21.15.105:0/3451408229 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25ac0b4090 0x7f25ac0b44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:11.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.979+0000 7f25b218b640 1 -- 172.21.15.105:0/3451408229 >> 172.21.15.105:0/3451408229 conn(0x7f25ac0cdcc0 msgr2=0x7f25ac0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:11.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.979+0000 7f25b218b640 1 -- 172.21.15.105:0/3451408229 shutdown_connections 2024-09-21T03:27:11.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.979+0000 7f25b218b640 1 -- 172.21.15.105:0/3451408229 wait complete. 2024-09-21T03:27:11.983 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.981+0000 7f25b218b640 1 Processor -- start 2024-09-21T03:27:11.983 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.981+0000 7f25b218b640 1 -- start start 2024-09-21T03:27:11.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.983+0000 7f25b218b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f25ac070af0 0x7f25ac15ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:11.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.983+0000 7f25b218b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25ac0b4090 0x7f25ac154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:11.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.983+0000 7f25b218b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25ac154970 0x7f25ac0ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:11.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.983+0000 7f25b218b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f25ac0718d0 con 0x7f25ac070af0 2024-09-21T03:27:11.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.983+0000 7f25b218b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f25ac071750 con 0x7f25ac154970 2024-09-21T03:27:11.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.983+0000 7f25b218b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f25ac071a50 con 0x7f25ac0b4090 2024-09-21T03:27:11.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.983+0000 7f25ab7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f25ac070af0 0x7f25ac15ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:11.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.983+0000 7f25ab7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f25ac070af0 0x7f25ac15ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:55482/0 (socket says 172.21.15.105:55482) 2024-09-21T03:27:11.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.983+0000 7f25ab7fe640 1 -- 172.21.15.105:0/3363075772 learned_addr learned my addr 172.21.15.105:0/3363075772 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:11.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.983+0000 7f25abfff640 1 --2- 172.21.15.105:0/3363075772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25ac154970 0x7f25ac0ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:11.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.983+0000 7f25aaffd640 1 --2- 172.21.15.105:0/3363075772 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25ac0b4090 0x7f25ac154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:11.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.983+0000 7f25ab7fe640 1 -- 172.21.15.105:0/3363075772 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25ac0b4090 msgr2=0x7f25ac154430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:11.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.983+0000 7f25ab7fe640 1 --2- 172.21.15.105:0/3363075772 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25ac0b4090 0x7f25ac154430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:11.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.983+0000 7f25ab7fe640 1 -- 172.21.15.105:0/3363075772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25ac154970 msgr2=0x7f25ac0ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:11.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.983+0000 7f25ab7fe640 1 --2- 172.21.15.105:0/3363075772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25ac154970 0x7f25ac0ccec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:11.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.983+0000 7f25ab7fe640 1 -- 172.21.15.105:0/3363075772 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25ac15b700 con 0x7f25ac070af0 2024-09-21T03:27:11.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.983+0000 7f25ab7fe640 1 --2- 172.21.15.105:0/3363075772 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f25ac070af0 0x7f25ac15ad90 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f259c00c730 tx=0x7f259c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:11.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.983+0000 7f2593fff640 1 -- 172.21.15.105:0/3363075772 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259c003b70 con 0x7f25ac070af0 2024-09-21T03:27:11.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.983+0000 7f2593fff640 1 -- 172.21.15.105:0/3363075772 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f259c003d30 con 0x7f25ac070af0 2024-09-21T03:27:11.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.983+0000 7f25b218b640 1 -- 172.21.15.105:0/3363075772 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25ac15b9e0 con 0x7f25ac070af0 2024-09-21T03:27:11.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.983+0000 7f2593fff640 1 -- 172.21.15.105:0/3363075772 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259c00aab0 con 0x7f25ac070af0 2024-09-21T03:27:11.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.983+0000 7f25b218b640 1 -- 172.21.15.105:0/3363075772 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25ac09d350 con 0x7f25ac070af0 2024-09-21T03:27:11.988 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.984+0000 7f25b218b640 1 -- 172.21.15.105:0/3363075772 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25ac075170 con 0x7f25ac070af0 2024-09-21T03:27:11.988 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.985+0000 7f2593fff640 1 -- 172.21.15.105:0/3363075772 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f259c00ac50 con 0x7f25ac070af0 2024-09-21T03:27:11.988 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.986+0000 7f2593fff640 1 --2- 172.21.15.105:0/3363075772 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2598078b90 0x7f259807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:11.988 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.986+0000 7f2593fff640 1 -- 172.21.15.105:0/3363075772 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 4943+0+0 (secure 0 0 0) 0x7f259c09a6a0 con 0x7f25ac070af0 2024-09-21T03:27:11.988 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.986+0000 7f25aaffd640 1 --2- 172.21.15.105:0/3363075772 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2598078b90 0x7f259807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:11.988 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.986+0000 7f25aaffd640 1 --2- 172.21.15.105:0/3363075772 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2598078b90 0x7f259807b0a0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f25ac1530f0 tx=0x7f25a000b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:11.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:11.990+0000 7f2593fff640 1 -- 172.21.15.105:0/3363075772 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f259c062820 con 0x7f25ac070af0 2024-09-21T03:27:12.168 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.167+0000 7f25b218b640 1 -- 172.21.15.105:0/3363075772 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f25ac09f250 con 0x7f25ac070af0 2024-09-21T03:27:12.172 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.171+0000 7f2593fff640 1 -- 172.21.15.105:0/3363075772 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v69)=0 v69) ==== 122+0+0 (secure 0 0 0) 0x7f259c067250 con 0x7f25ac070af0 2024-09-21T03:27:12.175 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.173+0000 7f25b218b640 1 -- 172.21.15.105:0/3363075772 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2598078b90 msgr2=0x7f259807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:12.175 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.173+0000 7f25b218b640 1 --2- 172.21.15.105:0/3363075772 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2598078b90 0x7f259807b0a0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f25ac1530f0 tx=0x7f25a000b2e0 comp rx=0 tx=0).stop 2024-09-21T03:27:12.175 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.173+0000 7f25b218b640 1 -- 172.21.15.105:0/3363075772 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f25ac070af0 msgr2=0x7f25ac15ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:12.175 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.173+0000 7f25b218b640 1 --2- 172.21.15.105:0/3363075772 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f25ac070af0 0x7f25ac15ad90 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f259c00c730 tx=0x7f259c00cbf0 comp rx=0 tx=0).stop 2024-09-21T03:27:12.175 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.173+0000 7f25b218b640 1 -- 172.21.15.105:0/3363075772 shutdown_connections 2024-09-21T03:27:12.175 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.173+0000 7f25b218b640 1 --2- 172.21.15.105:0/3363075772 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2598078b90 0x7f259807b0a0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:12.175 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.173+0000 7f25b218b640 1 --2- 172.21.15.105:0/3363075772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25ac154970 0x7f25ac0ccec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:12.175 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.173+0000 7f25b218b640 1 --2- 172.21.15.105:0/3363075772 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25ac0b4090 0x7f25ac154430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:12.175 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.173+0000 7f25b218b640 1 --2- 172.21.15.105:0/3363075772 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f25ac070af0 0x7f25ac15ad90 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:12.175 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.173+0000 7f25b218b640 1 -- 172.21.15.105:0/3363075772 >> 172.21.15.105:0/3363075772 conn(0x7f25ac0cdcc0 msgr2=0x7f25ac0b1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:12.175 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.173+0000 7f25b218b640 1 -- 172.21.15.105:0/3363075772 shutdown_connections 2024-09-21T03:27:12.176 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.173+0000 7f25b218b640 1 -- 172.21.15.105:0/3363075772 wait complete. 2024-09-21T03:27:12.186 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T03:27:12.186 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T03:27:12.229 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T03:27:12.279 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T03:27:12.279 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:27:12.279 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:27:12.295 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T03:27:12.295 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:27:12.295 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:27:12.313 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=452 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T03:27:12.314 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:27:12.314 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:27:12.351 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T03:27:12.351 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:27:12.351 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:27:12.371 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=452 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T03:27:12.371 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T03:27:12.371 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:27:12.503 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.501+0000 7f8b700bd640 1 -- 172.21.15.105:0/3226745034 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b54004800 msgr2=0x7f8b54004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:12.503 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.501+0000 7f8b700bd640 1 --2- 172.21.15.105:0/3226745034 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b54004800 0x7f8b54004c10 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c009b20 tx=0x7f8b54005830 comp rx=0 tx=0).stop 2024-09-21T03:27:12.503 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.501+0000 7f8b6e65a640 1 -- 172.21.15.105:0/3226745034 reap_dead start 2024-09-21T03:27:12.504 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.501+0000 7f8b700bd640 1 -- 172.21.15.105:0/3226745034 shutdown_connections 2024-09-21T03:27:12.504 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.501+0000 7f8b700bd640 1 -- 172.21.15.105:0/3226745034 >> 172.21.15.105:0/3226745034 conn(0x7f8b6806d4f0 msgr2=0x7f8b68071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:12.504 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.502+0000 7f8b700bd640 1 -- 172.21.15.105:0/3226745034 shutdown_connections 2024-09-21T03:27:12.504 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.502+0000 7f8b700bd640 1 -- 172.21.15.105:0/3226745034 wait complete. 2024-09-21T03:27:12.505 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.503+0000 7f8b700bd640 1 Processor -- start 2024-09-21T03:27:12.505 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.503+0000 7f8b700bd640 1 -- start start 2024-09-21T03:27:12.508 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.504+0000 7f8b700bd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b54004800 0x7f8b6815c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:12.508 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.505+0000 7f8b700bd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b68155740 0x7f8b6814c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:12.508 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.505+0000 7f8b700bd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b68156c20 0x7f8b680b6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:12.508 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.505+0000 7f8b700bd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8b680ccbc0 con 0x7f8b68156c20 2024-09-21T03:27:12.508 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.505+0000 7f8b700bd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8b680d1c90 con 0x7f8b54004800 2024-09-21T03:27:12.508 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.505+0000 7f8b700bd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8b680ccd40 con 0x7f8b68155740 2024-09-21T03:27:12.508 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.505+0000 7f8b6e65a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b68156c20 0x7f8b680b6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:12.508 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.505+0000 7f8b6e65a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b68156c20 0x7f8b680b6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:55510/0 (socket says 172.21.15.105:55510) 2024-09-21T03:27:12.508 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.505+0000 7f8b6e65a640 1 -- 172.21.15.105:0/3795798027 learned_addr learned my addr 172.21.15.105:0/3795798027 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:12.508 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.505+0000 7f8b6de59640 1 --2- 172.21.15.105:0/3795798027 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b54004800 0x7f8b6815c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:12.508 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.505+0000 7f8b6d658640 1 --2- 172.21.15.105:0/3795798027 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b68155740 0x7f8b6814c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:12.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.505+0000 7f8b6e65a640 1 -- 172.21.15.105:0/3795798027 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b68155740 msgr2=0x7f8b6814c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:12.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.505+0000 7f8b6e65a640 1 --2- 172.21.15.105:0/3795798027 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b68155740 0x7f8b6814c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:12.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.505+0000 7f8b6e65a640 1 -- 172.21.15.105:0/3795798027 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b54004800 msgr2=0x7f8b6815c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:12.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.505+0000 7f8b6e65a640 1 --2- 172.21.15.105:0/3795798027 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b54004800 0x7f8b6815c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:12.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.505+0000 7f8b6e65a640 1 -- 172.21.15.105:0/3795798027 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b6814cc30 con 0x7f8b68156c20 2024-09-21T03:27:12.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.505+0000 7f8b6e65a640 1 --2- 172.21.15.105:0/3795798027 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b68156c20 0x7f8b680b6a70 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f8b68074af0 tx=0x7f8b6000eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:12.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.505+0000 7f8b5a7fc640 1 -- 172.21.15.105:0/3795798027 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6000c970 con 0x7f8b68156c20 2024-09-21T03:27:12.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.505+0000 7f8b5a7fc640 1 -- 172.21.15.105:0/3795798027 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b60018070 con 0x7f8b68156c20 2024-09-21T03:27:12.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.505+0000 7f8b700bd640 1 -- 172.21.15.105:0/3795798027 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b6815f550 con 0x7f8b68156c20 2024-09-21T03:27:12.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.505+0000 7f8b5a7fc640 1 -- 172.21.15.105:0/3795798027 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b60011460 con 0x7f8b68156c20 2024-09-21T03:27:12.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.505+0000 7f8b700bd640 1 -- 172.21.15.105:0/3795798027 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b68156420 con 0x7f8b68156c20 2024-09-21T03:27:12.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.506+0000 7f8b700bd640 1 -- 172.21.15.105:0/3795798027 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b680cec10 con 0x7f8b68156c20 2024-09-21T03:27:12.510 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.507+0000 7f8b5a7fc640 1 -- 172.21.15.105:0/3795798027 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8b60011600 con 0x7f8b68156c20 2024-09-21T03:27:12.510 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.507+0000 7f8b5a7fc640 1 --2- 172.21.15.105:0/3795798027 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8b4c078b90 0x7f8b4c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:12.510 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.507+0000 7f8b5a7fc640 1 -- 172.21.15.105:0/3795798027 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 4943+0+0 (secure 0 0 0) 0x7f8b6009acc0 con 0x7f8b68156c20 2024-09-21T03:27:12.510 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.508+0000 7f8b6de59640 1 --2- 172.21.15.105:0/3795798027 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8b4c078b90 0x7f8b4c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:12.510 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.508+0000 7f8b6de59640 1 --2- 172.21.15.105:0/3795798027 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8b4c078b90 0x7f8b4c07b0a0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f8b64009460 tx=0x7f8b64009530 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:12.513 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.512+0000 7f8b5a7fc640 1 -- 172.21.15.105:0/3795798027 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8b60062e40 con 0x7f8b68156c20 2024-09-21T03:27:12.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.725+0000 7f8b700bd640 1 -- 172.21.15.105:0/3795798027 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b6815c080 con 0x7f8b68156c20 2024-09-21T03:27:12.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.725+0000 7f8b5a7fc640 1 -- 172.21.15.105:0/3795798027 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) ==== 94+0+3920 (secure 0 0 0) 0x7f8b60067870 con 0x7f8b68156c20 2024-09-21T03:27:12.727 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:27:12.727 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":88,"btime":"2024-09-21T03:27:06:423404+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6494,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2298697835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2298697835},{"type":"v1","addr":"172.21.15.162:6836","nonce":2298697835}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":6500,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/680091076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":680091076},{"type":"v1","addr":"172.21.15.105:6835","nonce":680091076}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":7432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3833287662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3833287662},{"type":"v1","addr":"172.21.15.162:6837","nonce":3833287662}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88},{"gid":8013,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/4094879618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":4094879618},{"type":"v1","addr":"172.21.15.105:6833","nonce":4094879618}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[]} 2024-09-21T03:27:12.727 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 88 2024-09-21T03:27:12.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.727+0000 7f8b700bd640 1 -- 172.21.15.105:0/3795798027 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8b4c078b90 msgr2=0x7f8b4c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:12.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.727+0000 7f8b700bd640 1 --2- 172.21.15.105:0/3795798027 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8b4c078b90 0x7f8b4c07b0a0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f8b64009460 tx=0x7f8b64009530 comp rx=0 tx=0).stop 2024-09-21T03:27:12.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.727+0000 7f8b700bd640 1 -- 172.21.15.105:0/3795798027 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b68156c20 msgr2=0x7f8b680b6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:12.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.727+0000 7f8b700bd640 1 --2- 172.21.15.105:0/3795798027 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b68156c20 0x7f8b680b6a70 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f8b68074af0 tx=0x7f8b6000eae0 comp rx=0 tx=0).stop 2024-09-21T03:27:12.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.727+0000 7f8b700bd640 1 -- 172.21.15.105:0/3795798027 shutdown_connections 2024-09-21T03:27:12.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.727+0000 7f8b700bd640 1 --2- 172.21.15.105:0/3795798027 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8b4c078b90 0x7f8b4c07b0a0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:12.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.727+0000 7f8b700bd640 1 --2- 172.21.15.105:0/3795798027 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b68156c20 0x7f8b680b6a70 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:12.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.727+0000 7f8b700bd640 1 --2- 172.21.15.105:0/3795798027 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b68155740 0x7f8b6814c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:12.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.727+0000 7f8b700bd640 1 --2- 172.21.15.105:0/3795798027 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b54004800 0x7f8b6815c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:12.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.727+0000 7f8b700bd640 1 -- 172.21.15.105:0/3795798027 >> 172.21.15.105:0/3795798027 conn(0x7f8b6806d4f0 msgr2=0x7f8b680b53b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:12.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.728+0000 7f8b700bd640 1 -- 172.21.15.105:0/3795798027 shutdown_connections 2024-09-21T03:27:12.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.728+0000 7f8b700bd640 1 -- 172.21.15.105:0/3795798027 wait complete. 2024-09-21T03:27:12.741 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T03:27:12.741 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-21T03:27:12.741 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T03:27:12.741 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:27:12.741 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T03:27:12.741 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T03:27:12.741 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T03:27:12.742 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:27:12.742 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T03:27:12.742 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T03:27:12.742 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T03:27:12.742 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:27:12.742 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T03:27:12.742 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T03:27:12.742 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T03:27:12.743 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:27:12.750 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T03:27:12.750 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T03:27:12.751 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T03:27:12.751 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T03:27:12.755 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T03:27:12.755 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T03:27:12.757 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T03:27:12.757 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T03:27:12.793 INFO:tasks.ceph.mds.a:Started 2024-09-21T03:27:12.793 DEBUG:teuthology.parallel:result is None 2024-09-21T03:27:12.794 INFO:tasks.ceph.mds.c:Started 2024-09-21T03:27:12.794 DEBUG:teuthology.parallel:result is None 2024-09-21T03:27:12.799 INFO:tasks.ceph.mds.d:Started 2024-09-21T03:27:12.799 DEBUG:teuthology.parallel:result is None 2024-09-21T03:27:12.801 INFO:tasks.ceph.mds.b:Started 2024-09-21T03:27:12.801 DEBUG:teuthology.parallel:result is None 2024-09-21T03:27:12.801 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T03:27:12.878 INFO:tasks.ceph.mds.c.smithi105.stdout:starting mds.c at 2024-09-21T03:27:12.879 INFO:tasks.ceph.mds.a.smithi105.stdout:starting mds.a at 2024-09-21T03:27:12.898 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-09-21T03:27:12.898 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-09-21T03:27:12.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.919+0000 7f4a4f72b640 1 -- 172.21.15.105:0/323227877 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a48155ce0 msgr2=0x7f4a480b45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:12.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.919+0000 7f4a4f72b640 1 --2- 172.21.15.105:0/323227877 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a48155ce0 0x7f4a480b45a0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f4a40005fd0 tx=0x7f4a4002aa90 comp rx=0 tx=0).stop 2024-09-21T03:27:12.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.919+0000 7f4a4f72b640 1 -- 172.21.15.105:0/323227877 shutdown_connections 2024-09-21T03:27:12.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.919+0000 7f4a4f72b640 1 --2- 172.21.15.105:0/323227877 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a48155ce0 0x7f4a480b45a0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:12.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.919+0000 7f4a4f72b640 1 --2- 172.21.15.105:0/323227877 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a48074420 0x7f4a4806fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:12.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.919+0000 7f4a4f72b640 1 -- 172.21.15.105:0/323227877 >> 172.21.15.105:0/323227877 conn(0x7f4a4806def0 msgr2=0x7f4a4806e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:12.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.919+0000 7f4a4f72b640 1 -- 172.21.15.105:0/323227877 shutdown_connections 2024-09-21T03:27:12.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.919+0000 7f4a4f72b640 1 -- 172.21.15.105:0/323227877 wait complete. 2024-09-21T03:27:12.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.921+0000 7f4a4f72b640 1 Processor -- start 2024-09-21T03:27:12.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.921+0000 7f4a4f72b640 1 -- start start 2024-09-21T03:27:12.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.922+0000 7f4a4f72b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a48074420 0x7f4a48158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:12.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.922+0000 7f4a4f72b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a48155ce0 0x7f4a481f0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:12.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.922+0000 7f4a4f72b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a48159c30 0x7f4a480c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:12.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.923+0000 7f4a4f72b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4a480b5000 con 0x7f4a48074420 2024-09-21T03:27:12.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.923+0000 7f4a4f72b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4a480b4e80 con 0x7f4a48155ce0 2024-09-21T03:27:12.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.923+0000 7f4a4f72b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4a480b5180 con 0x7f4a48159c30 2024-09-21T03:27:12.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.923+0000 7f4a4d4c7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a48074420 0x7f4a48158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:12.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.923+0000 7f4a4d4c7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a48074420 0x7f4a48158be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:55566/0 (socket says 172.21.15.105:55566) 2024-09-21T03:27:12.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.923+0000 7f4a4d4c7640 1 -- 172.21.15.105:0/3407945628 learned_addr learned my addr 172.21.15.105:0/3407945628 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:12.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.923+0000 7f4a4ccc6640 1 --2- 172.21.15.105:0/3407945628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a48155ce0 0x7f4a481f0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:12.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.923+0000 7f4a4dcc8640 1 --2- 172.21.15.105:0/3407945628 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a48159c30 0x7f4a480c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:12.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.923+0000 7f4a4d4c7640 1 -- 172.21.15.105:0/3407945628 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a48159c30 msgr2=0x7f4a480c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:12.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.923+0000 7f4a4d4c7640 1 --2- 172.21.15.105:0/3407945628 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a48159c30 0x7f4a480c69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:12.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.923+0000 7f4a4d4c7640 1 -- 172.21.15.105:0/3407945628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a48155ce0 msgr2=0x7f4a481f0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:12.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.923+0000 7f4a4d4c7640 1 --2- 172.21.15.105:0/3407945628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a48155ce0 0x7f4a481f0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:12.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.923+0000 7f4a4d4c7640 1 -- 172.21.15.105:0/3407945628 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a480c6200 con 0x7f4a48074420 2024-09-21T03:27:12.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.923+0000 7f4a4d4c7640 1 --2- 172.21.15.105:0/3407945628 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a48074420 0x7f4a48158be0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f4a44010a80 tx=0x7f4a44010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:12.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.923+0000 7f4a3dffb640 1 -- 172.21.15.105:0/3407945628 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a4401a030 con 0x7f4a48074420 2024-09-21T03:27:12.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.923+0000 7f4a3dffb640 1 -- 172.21.15.105:0/3407945628 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a4400ea90 con 0x7f4a48074420 2024-09-21T03:27:12.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.923+0000 7f4a4f72b640 1 -- 172.21.15.105:0/3407945628 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a481f14a0 con 0x7f4a48074420 2024-09-21T03:27:12.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.923+0000 7f4a3dffb640 1 -- 172.21.15.105:0/3407945628 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a44004020 con 0x7f4a48074420 2024-09-21T03:27:12.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.924+0000 7f4a4f72b640 1 -- 172.21.15.105:0/3407945628 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a480c64c0 con 0x7f4a48074420 2024-09-21T03:27:12.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.925+0000 7f4a4f72b640 1 -- 172.21.15.105:0/3407945628 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a480b56a0 con 0x7f4a48074420 2024-09-21T03:27:12.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.925+0000 7f4a3dffb640 1 -- 172.21.15.105:0/3407945628 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4a4401d070 con 0x7f4a48074420 2024-09-21T03:27:12.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.926+0000 7f4a3dffb640 1 --2- 172.21.15.105:0/3407945628 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4a2c078b90 0x7f4a2c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:12.928 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.926+0000 7f4a3dffb640 1 -- 172.21.15.105:0/3407945628 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 4943+0+0 (secure 0 0 0) 0x7f4a4409cff0 con 0x7f4a48074420 2024-09-21T03:27:12.929 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.926+0000 7f4a4ccc6640 1 --2- 172.21.15.105:0/3407945628 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4a2c078b90 0x7f4a2c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:12.929 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.926+0000 7f4a4ccc6640 1 --2- 172.21.15.105:0/3407945628 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4a2c078b90 0x7f4a2c07b0a0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f4a38007fd0 tx=0x7f4a38009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:12.932 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:12.930+0000 7f4a3dffb640 1 -- 172.21.15.105:0/3407945628 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4a44012040 con 0x7f4a48074420 2024-09-21T03:27:12.959 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-09-21T03:27:12.959 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-09-21T03:27:13.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.119+0000 7f4a4f72b640 1 -- 172.21.15.105:0/3407945628 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f4a480cf240 con 0x7f4a48074420 2024-09-21T03:27:13.540 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.539+0000 7f4a3dffb640 1 -- 172.21.15.105:0/3407945628 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v134) ==== 97+0+0 (secure 0 0 0) 0x7f4a440650e0 con 0x7f4a48074420 2024-09-21T03:27:13.541 INFO:teuthology.orchestra.run.smithi105.stderr: removed all blocklist entries 2024-09-21T03:27:13.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.542+0000 7f4a4f72b640 1 -- 172.21.15.105:0/3407945628 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4a2c078b90 msgr2=0x7f4a2c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:13.543 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.542+0000 7f4a4f72b640 1 --2- 172.21.15.105:0/3407945628 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4a2c078b90 0x7f4a2c07b0a0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f4a38007fd0 tx=0x7f4a38009040 comp rx=0 tx=0).stop 2024-09-21T03:27:13.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.542+0000 7f4a4f72b640 1 -- 172.21.15.105:0/3407945628 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a48074420 msgr2=0x7f4a48158be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:13.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.542+0000 7f4a4f72b640 1 --2- 172.21.15.105:0/3407945628 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a48074420 0x7f4a48158be0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f4a44010a80 tx=0x7f4a44010f40 comp rx=0 tx=0).stop 2024-09-21T03:27:13.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.542+0000 7f4a4f72b640 1 -- 172.21.15.105:0/3407945628 shutdown_connections 2024-09-21T03:27:13.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.542+0000 7f4a4f72b640 1 --2- 172.21.15.105:0/3407945628 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4a2c078b90 0x7f4a2c07b0a0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:13.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.542+0000 7f4a4f72b640 1 --2- 172.21.15.105:0/3407945628 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a48159c30 0x7f4a480c69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:13.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.542+0000 7f4a4f72b640 1 --2- 172.21.15.105:0/3407945628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a48155ce0 0x7f4a481f0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:13.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.542+0000 7f4a4f72b640 1 --2- 172.21.15.105:0/3407945628 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a48074420 0x7f4a48158be0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:13.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.542+0000 7f4a4f72b640 1 -- 172.21.15.105:0/3407945628 >> 172.21.15.105:0/3407945628 conn(0x7f4a4806def0 msgr2=0x7f4a480b3740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:13.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.542+0000 7f4a4f72b640 1 -- 172.21.15.105:0/3407945628 shutdown_connections 2024-09-21T03:27:13.544 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.542+0000 7f4a4f72b640 1 -- 172.21.15.105:0/3407945628 wait complete. 2024-09-21T03:27:13.555 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T03:27:13.668 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.666+0000 7f8e07f62640 1 -- 172.21.15.105:0/1884190833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e000cf320 msgr2=0x7f8e000d0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:13.668 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.666+0000 7f8e07f62640 1 --2- 172.21.15.105:0/1884190833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e000cf320 0x7f8e000d0980 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f8e00074af0 tx=0x7f8df802aac0 comp rx=0 tx=0).stop 2024-09-21T03:27:13.668 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.666+0000 7f8e07f62640 1 -- 172.21.15.105:0/1884190833 shutdown_connections 2024-09-21T03:27:13.668 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.666+0000 7f8e07f62640 1 --2- 172.21.15.105:0/1884190833 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e000cf320 0x7f8e000d0980 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:13.668 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.666+0000 7f8e07f62640 1 --2- 172.21.15.105:0/1884190833 >> v2:172.21.15.162:3300/0 conn(0x7f8e001600b0 0x7f8e000ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:13.668 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.666+0000 7f8e07f62640 1 -- 172.21.15.105:0/1884190833 >> 172.21.15.105:0/1884190833 conn(0x7f8e0006d4f0 msgr2=0x7f8e00071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:13.668 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.666+0000 7f8e07f62640 1 -- 172.21.15.105:0/1884190833 shutdown_connections 2024-09-21T03:27:13.668 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.666+0000 7f8e07f62640 1 -- 172.21.15.105:0/1884190833 wait complete. 2024-09-21T03:27:13.669 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.668+0000 7f8e07f62640 1 Processor -- start 2024-09-21T03:27:13.669 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.668+0000 7f8e07f62640 1 -- start start 2024-09-21T03:27:13.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.669+0000 7f8e07f62640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e000b7cc0 0x7f8e00156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:13.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.669+0000 7f8e07f62640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e000cf320 0x7f8e000d2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:13.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.669+0000 7f8e07f62640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e001600b0 0x7f8e000d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:13.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.669+0000 7f8e07f62640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8e000d13c0 con 0x7f8e001600b0 2024-09-21T03:27:13.672 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.669+0000 7f8e07f62640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8e000d1240 con 0x7f8e000cf320 2024-09-21T03:27:13.673 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.669+0000 7f8e07f62640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8e000d1540 con 0x7f8e000b7cc0 2024-09-21T03:27:13.673 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.669+0000 7f8e064ff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e001600b0 0x7f8e000d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:13.673 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.669+0000 7f8e064ff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e001600b0 0x7f8e000d27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:55588/0 (socket says 172.21.15.105:55588) 2024-09-21T03:27:13.673 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.669+0000 7f8e064ff640 1 -- 172.21.15.105:0/4010250776 learned_addr learned my addr 172.21.15.105:0/4010250776 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:13.673 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.669+0000 7f8e05cfe640 1 --2- 172.21.15.105:0/4010250776 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e000b7cc0 0x7f8e00156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:13.673 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.669+0000 7f8e054fd640 1 --2- 172.21.15.105:0/4010250776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e000cf320 0x7f8e000d2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:13.673 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.670+0000 7f8e064ff640 1 -- 172.21.15.105:0/4010250776 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e000b7cc0 msgr2=0x7f8e00156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:13.673 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.670+0000 7f8e064ff640 1 --2- 172.21.15.105:0/4010250776 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e000b7cc0 0x7f8e00156960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:13.673 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.670+0000 7f8e064ff640 1 -- 172.21.15.105:0/4010250776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e000cf320 msgr2=0x7f8e000d2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:13.673 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.670+0000 7f8e064ff640 1 --2- 172.21.15.105:0/4010250776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e000cf320 0x7f8e000d2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:13.673 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.670+0000 7f8e064ff640 1 -- 172.21.15.105:0/4010250776 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e000b24a0 con 0x7f8e001600b0 2024-09-21T03:27:13.673 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.670+0000 7f8e064ff640 1 --2- 172.21.15.105:0/4010250776 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e001600b0 0x7f8e000d27a0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f8df8009d60 tx=0x7f8df8003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:13.674 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.670+0000 7f8df67fc640 1 -- 172.21.15.105:0/4010250776 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df8044070 con 0x7f8e001600b0 2024-09-21T03:27:13.674 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.670+0000 7f8df67fc640 1 -- 172.21.15.105:0/4010250776 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8df8004250 con 0x7f8e001600b0 2024-09-21T03:27:13.674 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.670+0000 7f8df67fc640 1 -- 172.21.15.105:0/4010250776 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df8004680 con 0x7f8e001600b0 2024-09-21T03:27:13.674 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.670+0000 7f8e07f62640 1 -- 172.21.15.105:0/4010250776 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e000b2780 con 0x7f8e001600b0 2024-09-21T03:27:13.674 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.670+0000 7f8e07f62640 1 -- 172.21.15.105:0/4010250776 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e000b4190 con 0x7f8e001600b0 2024-09-21T03:27:13.675 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.671+0000 7f8e07f62640 1 -- 172.21.15.105:0/4010250776 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e000b21f0 con 0x7f8e001600b0 2024-09-21T03:27:13.675 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.672+0000 7f8df67fc640 1 -- 172.21.15.105:0/4010250776 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8df8036400 con 0x7f8e001600b0 2024-09-21T03:27:13.675 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.672+0000 7f8df67fc640 1 --2- 172.21.15.105:0/4010250776 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8de4078bc0 0x7f8de407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:13.675 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.672+0000 7f8df67fc640 1 -- 172.21.15.105:0/4010250776 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 4857+0+0 (secure 0 0 0) 0x7f8df80bb050 con 0x7f8e001600b0 2024-09-21T03:27:13.675 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.672+0000 7f8e05cfe640 1 --2- 172.21.15.105:0/4010250776 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8de4078bc0 0x7f8de407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:13.675 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.673+0000 7f8e05cfe640 1 --2- 172.21.15.105:0/4010250776 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8de4078bc0 0x7f8de407b0d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc00bb50 tx=0x7f8dfc00b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:13.678 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.677+0000 7f8df67fc640 1 -- 172.21.15.105:0/4010250776 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8df8032030 con 0x7f8e001600b0 2024-09-21T03:27:13.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.921+0000 7f8e07f62640 1 -- 172.21.15.105:0/4010250776 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f8e000d1ad0 con 0x7f8e001600b0 2024-09-21T03:27:13.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.921+0000 7f8df67fc640 1 -- 172.21.15.105:0/4010250776 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) ==== 80+0+5304 (secure 0 0 0) 0x7f8df8004820 con 0x7f8e001600b0 2024-09-21T03:27:13.923 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:27:13.924 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-21T03:27:13.924 INFO:teuthology.orchestra.run.smithi105.stdout: "auth_dump": [ 2024-09-21T03:27:13.924 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:27:13.924 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mds.a", 2024-09-21T03:27:13.924 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mtIIZDhAAJIXLpzTFBOFhnOwLzsdL6w==", 2024-09-21T03:27:13.924 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:27:13.924 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:27:13.924 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:27:13.924 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:27:13.924 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:27:13.924 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:27:13.924 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:27:13.924 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:27:13.925 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mds.b", 2024-09-21T03:27:13.925 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mGKANGxAAeAuUYMtLP7GXKfIELR7qMA==", 2024-09-21T03:27:13.925 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:27:13.925 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:27:13.925 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:27:13.925 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:27:13.925 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:27:13.925 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:27:13.925 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:27:13.925 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:27:13.925 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mds.c", 2024-09-21T03:27:13.925 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mwQzQFRAAElYtgnIdYzzkeg8AtiU+kA==", 2024-09-21T03:27:13.925 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:27:13.925 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:27:13.926 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:27:13.926 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:27:13.926 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:27:13.926 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:27:13.926 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:27:13.926 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:27:13.926 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mds.d", 2024-09-21T03:27:13.926 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mZkWyIhAAu4XWptFcbDrYjozzrgMcGQ==", 2024-09-21T03:27:13.926 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:27:13.926 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:27:13.926 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:27:13.926 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:27:13.926 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:27:13.927 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:27:13.927 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:27:13.927 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:27:13.927 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.0", 2024-09-21T03:27:13.927 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDMOu5mrSk2BRAAuEPjuEeUJEI3Sa2fiLaJyw==", 2024-09-21T03:27:13.927 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:27:13.927 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:27:13.927 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:27:13.927 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:27:13.927 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:27:13.927 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:27:13.927 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:27:13.927 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.1", 2024-09-21T03:27:13.927 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDPOu5mAT4UCBAAase7NV3ARBSu4QloaQdlzA==", 2024-09-21T03:27:13.928 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:27:13.928 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:27:13.928 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:27:13.928 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:27:13.928 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:27:13.928 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:27:13.928 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:27:13.928 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.2", 2024-09-21T03:27:13.928 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDSOu5ma4LRChAASottrmolMcagbspeyGVzBQ==", 2024-09-21T03:27:13.928 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:27:13.928 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:27:13.928 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:27:13.928 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:27:13.928 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:27:13.929 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:27:13.929 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:27:13.929 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.3", 2024-09-21T03:27:13.929 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDVOu5mD5RWHBAAKuNr4F3GA0EP566aQ07ZVw==", 2024-09-21T03:27:13.929 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:27:13.929 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:27:13.929 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:27:13.929 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:27:13.929 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:27:13.929 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:27:13.929 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:27:13.929 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.4", 2024-09-21T03:27:13.929 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDcOu5m++UBChAAqmgoPBQ/as4tc+UQPwaflg==", 2024-09-21T03:27:13.929 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:27:13.930 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:27:13.930 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:27:13.930 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:27:13.930 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:27:13.930 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:27:13.930 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:27:13.930 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.5", 2024-09-21T03:27:13.930 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDfOu5maYYZKRAA1ungglTU3TW1B/XNRjBuZQ==", 2024-09-21T03:27:13.930 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:27:13.930 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:27:13.930 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:27:13.930 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:27:13.930 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:27:13.931 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:27:13.931 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:27:13.931 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.6", 2024-09-21T03:27:13.931 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDjOu5mmwIqHBAAf6oNdLNkmM9yufP8XA2+og==", 2024-09-21T03:27:13.931 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:27:13.931 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:27:13.931 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:27:13.931 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:27:13.931 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:27:13.931 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:27:13.931 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:27:13.931 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "osd.7", 2024-09-21T03:27:13.931 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDmOu5mtCciHhAAPTnZubJ+7mGXcXZykCWxHg==", 2024-09-21T03:27:13.931 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:27:13.932 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow profile osd", 2024-09-21T03:27:13.932 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile osd", 2024-09-21T03:27:13.932 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:27:13.932 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:27:13.932 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:27:13.932 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:27:13.932 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.0", 2024-09-21T03:27:13.932 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mughoJxAAhY0bzJmq+oNyzCdtafkC9w==", 2024-09-21T03:27:13.932 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:27:13.932 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:27:13.932 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow r", 2024-09-21T03:27:13.932 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-21T03:27:13.932 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:27:13.932 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:27:13.933 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:27:13.933 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.1", 2024-09-21T03:27:13.933 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5m4Vn2LhAAnEa/01ql5quuRCVHOVwB7w==", 2024-09-21T03:27:13.933 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:27:13.933 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:27:13.933 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow r", 2024-09-21T03:27:13.933 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow rw", 2024-09-21T03:27:13.933 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow rwx" 2024-09-21T03:27:13.933 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:27:13.933 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:27:13.933 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:27:13.933 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.2", 2024-09-21T03:27:13.933 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mKi0mKxAAoetnL61ujgtg2cvscdjCLQ==", 2024-09-21T03:27:13.933 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:27:13.934 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:27:13.934 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow r", 2024-09-21T03:27:13.934 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow rw", 2024-09-21T03:27:13.934 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow rwx" 2024-09-21T03:27:13.934 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:27:13.934 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:27:13.934 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:27:13.934 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.3", 2024-09-21T03:27:13.934 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mWZDAMhAAs4BuFHMSkJa6+piN/FeeXQ==", 2024-09-21T03:27:13.934 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:27:13.934 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow", 2024-09-21T03:27:13.934 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow r", 2024-09-21T03:27:13.934 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow rw", 2024-09-21T03:27:13.934 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow rwx" 2024-09-21T03:27:13.935 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:27:13.935 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:27:13.935 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:27:13.935 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "client.admin", 2024-09-21T03:27:13.935 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDHOu5m4JRYLBAAgZ8nh5VIiWhuZ4+vrnmngw==", 2024-09-21T03:27:13.935 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:27:13.935 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow *", 2024-09-21T03:27:13.935 INFO:teuthology.orchestra.run.smithi105.stdout: "mgr": "allow *", 2024-09-21T03:27:13.935 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow *", 2024-09-21T03:27:13.935 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:27:13.935 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:27:13.935 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:27:13.935 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:27:13.935 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mgr.x", 2024-09-21T03:27:13.936 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5m92lTChAAQ61muQmc6uBs7b5mq3Zt8g==", 2024-09-21T03:27:13.936 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:27:13.936 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow *", 2024-09-21T03:27:13.936 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile mgr", 2024-09-21T03:27:13.936 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:27:13.936 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:27:13.936 INFO:teuthology.orchestra.run.smithi105.stdout: }, 2024-09-21T03:27:13.936 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:27:13.936 INFO:teuthology.orchestra.run.smithi105.stdout: "entity": "mgr.y", 2024-09-21T03:27:13.936 INFO:teuthology.orchestra.run.smithi105.stdout: "key": "AQDIOu5mh07bBRAAflFF00xr1ew4zttUi5TGng==", 2024-09-21T03:27:13.936 INFO:teuthology.orchestra.run.smithi105.stdout: "caps": { 2024-09-21T03:27:13.936 INFO:teuthology.orchestra.run.smithi105.stdout: "mds": "allow *", 2024-09-21T03:27:13.936 INFO:teuthology.orchestra.run.smithi105.stdout: "mon": "allow profile mgr", 2024-09-21T03:27:13.936 INFO:teuthology.orchestra.run.smithi105.stdout: "osd": "allow *" 2024-09-21T03:27:13.937 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:27:13.937 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:27:13.937 INFO:teuthology.orchestra.run.smithi105.stdout: ] 2024-09-21T03:27:13.937 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-21T03:27:13.938 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.924+0000 7f8e07f62640 1 -- 172.21.15.105:0/4010250776 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8de4078bc0 msgr2=0x7f8de407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:13.938 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.924+0000 7f8e07f62640 1 --2- 172.21.15.105:0/4010250776 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8de4078bc0 0x7f8de407b0d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc00bb50 tx=0x7f8dfc00b2e0 comp rx=0 tx=0).stop 2024-09-21T03:27:13.938 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.924+0000 7f8e07f62640 1 -- 172.21.15.105:0/4010250776 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e001600b0 msgr2=0x7f8e000d27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:13.938 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.924+0000 7f8e07f62640 1 --2- 172.21.15.105:0/4010250776 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e001600b0 0x7f8e000d27a0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f8df8009d60 tx=0x7f8df8003f10 comp rx=0 tx=0).stop 2024-09-21T03:27:13.938 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.924+0000 7f8e07f62640 1 -- 172.21.15.105:0/4010250776 shutdown_connections 2024-09-21T03:27:13.939 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.924+0000 7f8e07f62640 1 --2- 172.21.15.105:0/4010250776 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8de4078bc0 0x7f8de407b0d0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:13.939 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.924+0000 7f8e07f62640 1 --2- 172.21.15.105:0/4010250776 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e001600b0 0x7f8e000d27a0 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:13.939 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.924+0000 7f8e07f62640 1 --2- 172.21.15.105:0/4010250776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e000cf320 0x7f8e000d2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:13.939 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.924+0000 7f8e07f62640 1 --2- 172.21.15.105:0/4010250776 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e000b7cc0 0x7f8e00156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:13.939 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.924+0000 7f8e07f62640 1 -- 172.21.15.105:0/4010250776 >> 172.21.15.105:0/4010250776 conn(0x7f8e0006d4f0 msgr2=0x7f8e00071440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:13.939 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.924+0000 7f8e07f62640 1 -- 172.21.15.105:0/4010250776 shutdown_connections 2024-09-21T03:27:13.939 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:13.924+0000 7f8e07f62640 1 -- 172.21.15.105:0/4010250776 wait complete. 2024-09-21T03:27:13.939 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T03:27:14.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.050+0000 7fe738e8b640 1 -- 172.21.15.105:0/1212831079 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe720005250 msgr2=0x7fe72000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:14.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.050+0000 7fe738e8b640 1 --2- 172.21.15.105:0/1212831079 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe720005250 0x7fe72000b9c0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fe7340b0630 tx=0x7fe720005830 comp rx=0 tx=0).stop 2024-09-21T03:27:14.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.050+0000 7fe738e8b640 1 -- 172.21.15.105:0/1212831079 shutdown_connections 2024-09-21T03:27:14.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.050+0000 7fe738e8b640 1 --2- 172.21.15.105:0/1212831079 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe720005250 0x7fe72000b9c0 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:14.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.050+0000 7fe738e8b640 1 -- 172.21.15.105:0/1212831079 >> 172.21.15.105:0/1212831079 conn(0x7fe734074170 msgr2=0x7fe7340b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:14.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.050+0000 7fe738e8b640 1 -- 172.21.15.105:0/1212831079 shutdown_connections 2024-09-21T03:27:14.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.050+0000 7fe738e8b640 1 -- 172.21.15.105:0/1212831079 wait complete. 2024-09-21T03:27:14.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.052+0000 7fe738e8b640 1 Processor -- start 2024-09-21T03:27:14.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.052+0000 7fe738e8b640 1 -- start start 2024-09-21T03:27:14.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.053+0000 7fe738e8b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe720005250 0x7fe7340b13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:14.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.053+0000 7fe738e8b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe734153530 0x7fe7340b1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:14.056 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.053+0000 7fe738e8b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe734143f60 0x7fe734144370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:14.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.053+0000 7fe738e8b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe7340ae1b0 con 0x7fe720005250 2024-09-21T03:27:14.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.053+0000 7fe738e8b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe7340ae330 con 0x7fe734153530 2024-09-21T03:27:14.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.053+0000 7fe738e8b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe7340ae4b0 con 0x7fe734143f60 2024-09-21T03:27:14.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.053+0000 7fe73259c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe720005250 0x7fe7340b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:14.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.053+0000 7fe73259c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe720005250 0x7fe7340b13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:55600/0 (socket says 172.21.15.105:55600) 2024-09-21T03:27:14.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.053+0000 7fe73259c640 1 -- 172.21.15.105:0/4089423596 learned_addr learned my addr 172.21.15.105:0/4089423596 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:14.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.053+0000 7fe729d9b640 1 --2- 172.21.15.105:0/4089423596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe734153530 0x7fe7340b1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:14.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.053+0000 7fe732d9d640 1 --2- 172.21.15.105:0/4089423596 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe734143f60 0x7fe734144370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:14.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.054+0000 7fe73259c640 1 -- 172.21.15.105:0/4089423596 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe734143f60 msgr2=0x7fe734144370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:14.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.054+0000 7fe73259c640 1 --2- 172.21.15.105:0/4089423596 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe734143f60 0x7fe734144370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:14.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.054+0000 7fe73259c640 1 -- 172.21.15.105:0/4089423596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe734153530 msgr2=0x7fe7340b1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:14.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.054+0000 7fe73259c640 1 --2- 172.21.15.105:0/4089423596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe734153530 0x7fe7340b1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:14.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.054+0000 7fe73259c640 1 -- 172.21.15.105:0/4089423596 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7341f1410 con 0x7fe720005250 2024-09-21T03:27:14.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.054+0000 7fe732d9d640 1 --2- 172.21.15.105:0/4089423596 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe734143f60 0x7fe734144370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:27:14.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.054+0000 7fe729d9b640 1 --2- 172.21.15.105:0/4089423596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe734153530 0x7fe7340b1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:27:14.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.054+0000 7fe73259c640 1 --2- 172.21.15.105:0/4089423596 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe720005250 0x7fe7340b13d0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fe724011ab0 tx=0x7fe724011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:14.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.054+0000 7fe72b7fe640 1 -- 172.21.15.105:0/4089423596 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72401e070 con 0x7fe720005250 2024-09-21T03:27:14.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.054+0000 7fe72b7fe640 1 -- 172.21.15.105:0/4089423596 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe72400fe70 con 0x7fe720005250 2024-09-21T03:27:14.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.054+0000 7fe72b7fe640 1 -- 172.21.15.105:0/4089423596 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7240042b0 con 0x7fe720005250 2024-09-21T03:27:14.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.054+0000 7fe738e8b640 1 -- 172.21.15.105:0/4089423596 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7341f16f0 con 0x7fe720005250 2024-09-21T03:27:14.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.054+0000 7fe738e8b640 1 -- 172.21.15.105:0/4089423596 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7341f1cb0 con 0x7fe720005250 2024-09-21T03:27:14.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.055+0000 7fe738e8b640 1 -- 172.21.15.105:0/4089423596 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7340cf100 con 0x7fe720005250 2024-09-21T03:27:14.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.056+0000 7fe72b7fe640 1 -- 172.21.15.105:0/4089423596 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe724021070 con 0x7fe720005250 2024-09-21T03:27:14.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.056+0000 7fe72b7fe640 1 --2- 172.21.15.105:0/4089423596 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe714078bc0 0x7fe71407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:14.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.056+0000 7fe72b7fe640 1 -- 172.21.15.105:0/4089423596 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 4857+0+0 (secure 0 0 0) 0x7fe72409b370 con 0x7fe720005250 2024-09-21T03:27:14.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.056+0000 7fe729d9b640 1 --2- 172.21.15.105:0/4089423596 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe714078bc0 0x7fe71407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:14.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.057+0000 7fe729d9b640 1 --2- 172.21.15.105:0/4089423596 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe714078bc0 0x7fe71407b0d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fe7340af8c0 tx=0x7fe71c006b70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:14.062 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.060+0000 7fe72b7fe640 1 -- 172.21.15.105:0/4089423596 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe724063540 con 0x7fe720005250 2024-09-21T03:27:14.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.238+0000 7fe738e8b640 1 -- 172.21.15.105:0/4089423596 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fe7340b5a70 con 0x7fe720005250 2024-09-21T03:27:14.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.238+0000 7fe72b7fe640 1 -- 172.21.15.105:0/4089423596 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v136) ==== 84+0+65 (secure 0 0 0) 0x7fe724067f70 con 0x7fe720005250 2024-09-21T03:27:14.240 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:27:14.240 INFO:teuthology.orchestra.run.smithi105.stdout:[ 2024-09-21T03:27:14.240 INFO:teuthology.orchestra.run.smithi105.stdout: { 2024-09-21T03:27:14.240 INFO:teuthology.orchestra.run.smithi105.stdout: "poolnum": 1, 2024-09-21T03:27:14.240 INFO:teuthology.orchestra.run.smithi105.stdout: "poolname": ".mgr" 2024-09-21T03:27:14.240 INFO:teuthology.orchestra.run.smithi105.stdout: } 2024-09-21T03:27:14.240 INFO:teuthology.orchestra.run.smithi105.stdout:] 2024-09-21T03:27:14.242 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.240+0000 7fe738e8b640 1 -- 172.21.15.105:0/4089423596 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe714078bc0 msgr2=0x7fe71407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:14.242 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.240+0000 7fe738e8b640 1 --2- 172.21.15.105:0/4089423596 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe714078bc0 0x7fe71407b0d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fe7340af8c0 tx=0x7fe71c006b70 comp rx=0 tx=0).stop 2024-09-21T03:27:14.242 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.240+0000 7fe738e8b640 1 -- 172.21.15.105:0/4089423596 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe720005250 msgr2=0x7fe7340b13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:14.242 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.240+0000 7fe738e8b640 1 --2- 172.21.15.105:0/4089423596 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe720005250 0x7fe7340b13d0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fe724011ab0 tx=0x7fe724011f70 comp rx=0 tx=0).stop 2024-09-21T03:27:14.242 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.240+0000 7fe738e8b640 1 -- 172.21.15.105:0/4089423596 shutdown_connections 2024-09-21T03:27:14.242 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.240+0000 7fe738e8b640 1 --2- 172.21.15.105:0/4089423596 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe714078bc0 0x7fe71407b0d0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:14.243 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.240+0000 7fe738e8b640 1 --2- 172.21.15.105:0/4089423596 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe734143f60 0x7fe734144370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:14.243 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.240+0000 7fe738e8b640 1 --2- 172.21.15.105:0/4089423596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe734153530 0x7fe7340b1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:14.243 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.240+0000 7fe738e8b640 1 --2- 172.21.15.105:0/4089423596 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe720005250 0x7fe7340b13d0 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:14.243 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.240+0000 7fe738e8b640 1 -- 172.21.15.105:0/4089423596 >> 172.21.15.105:0/4089423596 conn(0x7fe734074170 msgr2=0x7fe7340b5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:14.243 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.240+0000 7fe738e8b640 1 -- 172.21.15.105:0/4089423596 shutdown_connections 2024-09-21T03:27:14.243 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.240+0000 7fe738e8b640 1 -- 172.21.15.105:0/4089423596 wait complete. 2024-09-21T03:27:14.253 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T03:27:14.254 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T03:27:14.371 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.369+0000 7f37fd10b640 1 -- 172.21.15.105:0/644607959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37e0004800 msgr2=0x7f37e0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:14.371 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.369+0000 7f37fd10b640 1 --2- 172.21.15.105:0/644607959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37e0004800 0x7f37e0004c10 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f37ec009b20 tx=0x7f37e0005830 comp rx=0 tx=0).stop 2024-09-21T03:27:14.371 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.369+0000 7f37f759e640 1 -- 172.21.15.105:0/644607959 reap_dead start 2024-09-21T03:27:14.372 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.369+0000 7f37fd10b640 1 -- 172.21.15.105:0/644607959 shutdown_connections 2024-09-21T03:27:14.372 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.369+0000 7f37fd10b640 1 -- 172.21.15.105:0/644607959 >> 172.21.15.105:0/644607959 conn(0x7f37f80b3ea0 msgr2=0x7f37f80b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:14.372 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.369+0000 7f37fd10b640 1 -- 172.21.15.105:0/644607959 shutdown_connections 2024-09-21T03:27:14.372 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.369+0000 7f37fd10b640 1 -- 172.21.15.105:0/644607959 wait complete. 2024-09-21T03:27:14.373 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.371+0000 7f37fd10b640 1 Processor -- start 2024-09-21T03:27:14.373 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.371+0000 7f37fd10b640 1 -- start start 2024-09-21T03:27:14.375 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.373+0000 7f37fd10b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37e0004800 0x7f37f806f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:14.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.373+0000 7f37fd10b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37f80cb940 0x7f37f8158220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:14.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.373+0000 7f37fd10b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37f81f5ad0 0x7f37f81f5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:14.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.373+0000 7f37fd10b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f37f815ed40 con 0x7f37f80cb940 2024-09-21T03:27:14.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.373+0000 7f37fd10b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f37f815ebc0 con 0x7f37e0004800 2024-09-21T03:27:14.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.373+0000 7f37fd10b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f37f815eec0 con 0x7f37f81f5ad0 2024-09-21T03:27:14.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.373+0000 7f37f659c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37f80cb940 0x7f37f8158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:14.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.373+0000 7f37f659c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37f80cb940 0x7f37f8158220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:55622/0 (socket says 172.21.15.105:55622) 2024-09-21T03:27:14.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.373+0000 7f37f659c640 1 -- 172.21.15.105:0/3756442553 learned_addr learned my addr 172.21.15.105:0/3756442553 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:14.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.373+0000 7f37f6d9d640 1 --2- 172.21.15.105:0/3756442553 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37e0004800 0x7f37f806f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:14.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.373+0000 7f37f759e640 1 --2- 172.21.15.105:0/3756442553 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37f81f5ad0 0x7f37f81f5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:14.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.373+0000 7f37f659c640 1 -- 172.21.15.105:0/3756442553 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37f81f5ad0 msgr2=0x7f37f81f5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:14.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.373+0000 7f37f659c640 1 --2- 172.21.15.105:0/3756442553 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37f81f5ad0 0x7f37f81f5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:14.376 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.373+0000 7f37f659c640 1 -- 172.21.15.105:0/3756442553 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37e0004800 msgr2=0x7f37f806f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:14.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.373+0000 7f37f659c640 1 --2- 172.21.15.105:0/3756442553 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37e0004800 0x7f37f806f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:14.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.373+0000 7f37f659c640 1 -- 172.21.15.105:0/3756442553 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37f81f9400 con 0x7f37f80cb940 2024-09-21T03:27:14.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.373+0000 7f37f659c640 1 --2- 172.21.15.105:0/3756442553 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37f80cb940 0x7f37f8158220 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f37ec009c40 tx=0x7f37ec033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:14.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.373+0000 7f37df7fe640 1 -- 172.21.15.105:0/3756442553 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ec043070 con 0x7f37f80cb940 2024-09-21T03:27:14.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.373+0000 7f37df7fe640 1 -- 172.21.15.105:0/3756442553 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f37ec004120 con 0x7f37f80cb940 2024-09-21T03:27:14.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.373+0000 7f37fd10b640 1 -- 172.21.15.105:0/3756442553 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37f81f6720 con 0x7f37f80cb940 2024-09-21T03:27:14.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.373+0000 7f37df7fe640 1 -- 172.21.15.105:0/3756442553 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ec038040 con 0x7f37f80cb940 2024-09-21T03:27:14.377 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.374+0000 7f37fd10b640 1 -- 172.21.15.105:0/3756442553 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37f80cb140 con 0x7f37f80cb940 2024-09-21T03:27:14.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.375+0000 7f37fd10b640 1 -- 172.21.15.105:0/3756442553 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37f815f450 con 0x7f37f80cb940 2024-09-21T03:27:14.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.375+0000 7f37df7fe640 1 -- 172.21.15.105:0/3756442553 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f37ec046070 con 0x7f37f80cb940 2024-09-21T03:27:14.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.376+0000 7f37df7fe640 1 --2- 172.21.15.105:0/3756442553 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f37e4078b90 0x7f37e407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:14.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.376+0000 7f37df7fe640 1 -- 172.21.15.105:0/3756442553 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 4857+0+0 (secure 0 0 0) 0x7f37ec0bafc0 con 0x7f37f80cb940 2024-09-21T03:27:14.378 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.376+0000 7f37f6d9d640 1 --2- 172.21.15.105:0/3756442553 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f37e4078b90 0x7f37e407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:14.379 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.377+0000 7f37f6d9d640 1 --2- 172.21.15.105:0/3756442553 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f37e4078b90 0x7f37e407b0a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f37e8000f80 tx=0x7f37e8006ef0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:14.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.381+0000 7f37df7fe640 1 -- 172.21.15.105:0/3756442553 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f37ec083190 con 0x7f37f80cb940 2024-09-21T03:27:14.562 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:14.560+0000 7f37fd10b640 1 -- 172.21.15.105:0/3756442553 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f37f815b520 con 0x7f37f80cb940 2024-09-21T03:27:15.551 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.549+0000 7f37df7fe640 1 -- 172.21.15.105:0/3756442553 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v137) ==== 138+0+0 (secure 0 0 0) 0x7f37ec087bc0 con 0x7f37f80cb940 2024-09-21T03:27:15.551 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_metadata' created 2024-09-21T03:27:15.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.552+0000 7f37fd10b640 1 -- 172.21.15.105:0/3756442553 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f37e4078b90 msgr2=0x7f37e407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:15.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.552+0000 7f37fd10b640 1 --2- 172.21.15.105:0/3756442553 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f37e4078b90 0x7f37e407b0a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f37e8000f80 tx=0x7f37e8006ef0 comp rx=0 tx=0).stop 2024-09-21T03:27:15.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.552+0000 7f37fd10b640 1 -- 172.21.15.105:0/3756442553 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37f80cb940 msgr2=0x7f37f8158220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:15.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.552+0000 7f37fd10b640 1 --2- 172.21.15.105:0/3756442553 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37f80cb940 0x7f37f8158220 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f37ec009c40 tx=0x7f37ec033670 comp rx=0 tx=0).stop 2024-09-21T03:27:15.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.552+0000 7f37fd10b640 1 -- 172.21.15.105:0/3756442553 shutdown_connections 2024-09-21T03:27:15.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.552+0000 7f37fd10b640 1 --2- 172.21.15.105:0/3756442553 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f37e4078b90 0x7f37e407b0a0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:15.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.552+0000 7f37fd10b640 1 --2- 172.21.15.105:0/3756442553 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37f81f5ad0 0x7f37f81f5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:15.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.552+0000 7f37fd10b640 1 --2- 172.21.15.105:0/3756442553 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37f80cb940 0x7f37f8158220 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:15.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.552+0000 7f37fd10b640 1 --2- 172.21.15.105:0/3756442553 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37e0004800 0x7f37f806f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:15.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.552+0000 7f37fd10b640 1 -- 172.21.15.105:0/3756442553 >> 172.21.15.105:0/3756442553 conn(0x7f37f80b3ea0 msgr2=0x7f37f81e87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:15.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.552+0000 7f37fd10b640 1 -- 172.21.15.105:0/3756442553 shutdown_connections 2024-09-21T03:27:15.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.552+0000 7f37fd10b640 1 -- 172.21.15.105:0/3756442553 wait complete. 2024-09-21T03:27:15.571 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T03:27:15.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.693+0000 7f47cadad640 1 -- 172.21.15.105:0/3991452254 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47c40b3540 msgr2=0x7f47c40d3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:15.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.693+0000 7f47cadad640 1 --2- 172.21.15.105:0/3991452254 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47c40b3540 0x7f47c40d3330 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f47c40ba090 tx=0x7f47b802a560 comp rx=0 tx=0).stop 2024-09-21T03:27:15.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.693+0000 7f47cadad640 1 -- 172.21.15.105:0/3991452254 shutdown_connections 2024-09-21T03:27:15.696 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.693+0000 7f47cadad640 1 --2- 172.21.15.105:0/3991452254 >> v2:172.21.15.162:3300/0 conn(0x7f47c40d3870 0x7f47c40ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:15.696 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.693+0000 7f47cadad640 1 --2- 172.21.15.105:0/3991452254 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47c40b3540 0x7f47c40d3330 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:15.696 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.693+0000 7f47cadad640 1 -- 172.21.15.105:0/3991452254 >> 172.21.15.105:0/3991452254 conn(0x7f47c408bfc0 msgr2=0x7f47c409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:15.696 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.693+0000 7f47cadad640 1 -- 172.21.15.105:0/3991452254 shutdown_connections 2024-09-21T03:27:15.696 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.693+0000 7f47cadad640 1 -- 172.21.15.105:0/3991452254 wait complete. 2024-09-21T03:27:15.696 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.695+0000 7f47cadad640 1 Processor -- start 2024-09-21T03:27:15.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.695+0000 7f47cadad640 1 -- start start 2024-09-21T03:27:15.699 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.696+0000 7f47cadad640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47c40b3540 0x7f47c40ce430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:15.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.696+0000 7f47cadad640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47c40d3870 0x7f47c40c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:15.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.696+0000 7f47cadad640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47c40ccea0 0x7f47c40c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:15.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.696+0000 7f47cadad640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f47c40d0ce0 con 0x7f47c40ccea0 2024-09-21T03:27:15.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.696+0000 7f47cadad640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f47c40cf490 con 0x7f47c40d3870 2024-09-21T03:27:15.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.696+0000 7f47cadad640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f47c40d0e60 con 0x7f47c40b3540 2024-09-21T03:27:15.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.697+0000 7f47c934a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47c40ccea0 0x7f47c40c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:15.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.697+0000 7f47c934a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47c40ccea0 0x7f47c40c8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:55640/0 (socket says 172.21.15.105:55640) 2024-09-21T03:27:15.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.697+0000 7f47c934a640 1 -- 172.21.15.105:0/2358158371 learned_addr learned my addr 172.21.15.105:0/2358158371 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:15.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.697+0000 7f47c3fff640 1 --2- 172.21.15.105:0/2358158371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47c40d3870 0x7f47c40c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:15.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.697+0000 7f47c8b49640 1 --2- 172.21.15.105:0/2358158371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47c40b3540 0x7f47c40ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:15.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.697+0000 7f47c934a640 1 -- 172.21.15.105:0/2358158371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47c40b3540 msgr2=0x7f47c40ce430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:15.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.697+0000 7f47c934a640 1 --2- 172.21.15.105:0/2358158371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47c40b3540 0x7f47c40ce430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:15.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.697+0000 7f47c934a640 1 -- 172.21.15.105:0/2358158371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47c40d3870 msgr2=0x7f47c40c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:15.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.697+0000 7f47c934a640 1 --2- 172.21.15.105:0/2358158371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47c40d3870 0x7f47c40c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:15.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.697+0000 7f47c934a640 1 -- 172.21.15.105:0/2358158371 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c40cd390 con 0x7f47c40ccea0 2024-09-21T03:27:15.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.697+0000 7f47c934a640 1 --2- 172.21.15.105:0/2358158371 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47c40ccea0 0x7f47c40c8c40 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f47bc00b410 tx=0x7f47bc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:15.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.697+0000 7f47c17fa640 1 -- 172.21.15.105:0/2358158371 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47bc015020 con 0x7f47c40ccea0 2024-09-21T03:27:15.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.697+0000 7f47c17fa640 1 -- 172.21.15.105:0/2358158371 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47bc011940 con 0x7f47c40ccea0 2024-09-21T03:27:15.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.697+0000 7f47cadad640 1 -- 172.21.15.105:0/2358158371 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47c40cd670 con 0x7f47c40ccea0 2024-09-21T03:27:15.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.697+0000 7f47c17fa640 1 -- 172.21.15.105:0/2358158371 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47bc011d90 con 0x7f47c40ccea0 2024-09-21T03:27:15.701 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.697+0000 7f47cadad640 1 -- 172.21.15.105:0/2358158371 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47c40cdc30 con 0x7f47c40ccea0 2024-09-21T03:27:15.702 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.698+0000 7f47cadad640 1 -- 172.21.15.105:0/2358158371 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47c406e170 con 0x7f47c40ccea0 2024-09-21T03:27:15.702 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.699+0000 7f47c17fa640 1 -- 172.21.15.105:0/2358158371 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f47bc018020 con 0x7f47c40ccea0 2024-09-21T03:27:15.702 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.700+0000 7f47c17fa640 1 --2- 172.21.15.105:0/2358158371 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f47b0078bc0 0x7f47b007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:15.702 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.700+0000 7f47c17fa640 1 -- 172.21.15.105:0/2358158371 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5227+0+0 (secure 0 0 0) 0x7f47bc09aa10 con 0x7f47c40ccea0 2024-09-21T03:27:15.702 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.700+0000 7f47c8b49640 1 --2- 172.21.15.105:0/2358158371 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f47b0078bc0 0x7f47b007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:15.702 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.700+0000 7f47c8b49640 1 --2- 172.21.15.105:0/2358158371 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f47b0078bc0 0x7f47b007b0d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f47b4001e20 tx=0x7f47b4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:15.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.705+0000 7f47c17fa640 1 -- 172.21.15.105:0/2358158371 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f47bc01f020 con 0x7f47c40ccea0 2024-09-21T03:27:15.883 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:15.882+0000 7f47cadad640 1 -- 172.21.15.105:0/2358158371 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f47c406cde0 con 0x7f47c40ccea0 2024-09-21T03:27:16.560 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.558+0000 7f47c17fa640 1 -- 172.21.15.105:0/2358158371 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v138) ==== 170+0+0 (secure 0 0 0) 0x7f47bc062960 con 0x7f47c40ccea0 2024-09-21T03:27:16.560 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_data' created 2024-09-21T03:27:16.563 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.562+0000 7f47cadad640 1 -- 172.21.15.105:0/2358158371 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f47b0078bc0 msgr2=0x7f47b007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:16.563 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.562+0000 7f47cadad640 1 --2- 172.21.15.105:0/2358158371 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f47b0078bc0 0x7f47b007b0d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f47b4001e20 tx=0x7f47b4009040 comp rx=0 tx=0).stop 2024-09-21T03:27:16.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.562+0000 7f47cadad640 1 -- 172.21.15.105:0/2358158371 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47c40ccea0 msgr2=0x7f47c40c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:16.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.562+0000 7f47cadad640 1 --2- 172.21.15.105:0/2358158371 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47c40ccea0 0x7f47c40c8c40 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f47bc00b410 tx=0x7f47bc00b8d0 comp rx=0 tx=0).stop 2024-09-21T03:27:16.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.562+0000 7f47cadad640 1 -- 172.21.15.105:0/2358158371 shutdown_connections 2024-09-21T03:27:16.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.562+0000 7f47cadad640 1 --2- 172.21.15.105:0/2358158371 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f47b0078bc0 0x7f47b007b0d0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:16.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.562+0000 7f47cadad640 1 --2- 172.21.15.105:0/2358158371 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47c40ccea0 0x7f47c40c8c40 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:16.564 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.562+0000 7f47cadad640 1 --2- 172.21.15.105:0/2358158371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47c40d3870 0x7f47c40c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:16.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.562+0000 7f47cadad640 1 --2- 172.21.15.105:0/2358158371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47c40b3540 0x7f47c40ce430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:16.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.562+0000 7f47cadad640 1 -- 172.21.15.105:0/2358158371 >> 172.21.15.105:0/2358158371 conn(0x7f47c408bfc0 msgr2=0x7f47c406f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:16.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.563+0000 7f47cadad640 1 -- 172.21.15.105:0/2358158371 shutdown_connections 2024-09-21T03:27:16.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.564+0000 7f47cadad640 1 -- 172.21.15.105:0/2358158371 wait complete. 2024-09-21T03:27:16.591 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T03:27:16.708 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.707+0000 7fe9cad01640 1 -- 172.21.15.105:0/986884101 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9c40ccbe0 msgr2=0x7fe9c415c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:16.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.707+0000 7fe9cad01640 1 --2- 172.21.15.105:0/986884101 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9c40ccbe0 0x7fe9c415c7a0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4073be0 tx=0x7fe9c002a560 comp rx=0 tx=0).stop 2024-09-21T03:27:16.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.707+0000 7fe9cad01640 1 -- 172.21.15.105:0/986884101 shutdown_connections 2024-09-21T03:27:16.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.707+0000 7fe9cad01640 1 --2- 172.21.15.105:0/986884101 >> v2:172.21.15.162:3300/0 conn(0x7fe9c40d2310 0x7fe9c40d2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:16.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.707+0000 7fe9cad01640 1 --2- 172.21.15.105:0/986884101 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9c40ccbe0 0x7fe9c415c7a0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:16.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.707+0000 7fe9cad01640 1 -- 172.21.15.105:0/986884101 >> 172.21.15.105:0/986884101 conn(0x7fe9c40b3f10 msgr2=0x7fe9c40b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:16.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.707+0000 7fe9cad01640 1 -- 172.21.15.105:0/986884101 shutdown_connections 2024-09-21T03:27:16.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.707+0000 7fe9cad01640 1 -- 172.21.15.105:0/986884101 wait complete. 2024-09-21T03:27:16.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.708+0000 7fe9cad01640 1 Processor -- start 2024-09-21T03:27:16.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.709+0000 7fe9cad01640 1 -- start start 2024-09-21T03:27:16.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.710+0000 7fe9cad01640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9c40b5210 0x7fe9c41f3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:16.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.710+0000 7fe9cad01640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9c40ccbe0 0x7fe9c4149c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:16.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.710+0000 7fe9cad01640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9c40d2310 0x7fe9c414a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:16.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.710+0000 7fe9cad01640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c40d18b0 con 0x7fe9c40d2310 2024-09-21T03:27:16.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.710+0000 7fe9cad01640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c40d1730 con 0x7fe9c40ccbe0 2024-09-21T03:27:16.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.710+0000 7fe9cad01640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe9c40d1a30 con 0x7fe9c40b5210 2024-09-21T03:27:16.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.710+0000 7fe9c929e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9c40d2310 0x7fe9c414a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:16.714 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.710+0000 7fe9c929e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9c40d2310 0x7fe9c414a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:55654/0 (socket says 172.21.15.105:55654) 2024-09-21T03:27:16.714 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.710+0000 7fe9c929e640 1 -- 172.21.15.105:0/1068277481 learned_addr learned my addr 172.21.15.105:0/1068277481 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:16.714 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.710+0000 7fe9bbfff640 1 --2- 172.21.15.105:0/1068277481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9c40ccbe0 0x7fe9c4149c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:16.714 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.710+0000 7fe9c8a9d640 1 --2- 172.21.15.105:0/1068277481 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9c40b5210 0x7fe9c41f3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:16.714 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.710+0000 7fe9c929e640 1 -- 172.21.15.105:0/1068277481 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9c40b5210 msgr2=0x7fe9c41f3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:16.714 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.710+0000 7fe9c929e640 1 --2- 172.21.15.105:0/1068277481 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9c40b5210 0x7fe9c41f3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:16.714 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.710+0000 7fe9c929e640 1 -- 172.21.15.105:0/1068277481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9c40ccbe0 msgr2=0x7fe9c4149c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:16.714 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.710+0000 7fe9c929e640 1 --2- 172.21.15.105:0/1068277481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9c40ccbe0 0x7fe9c4149c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:16.714 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.710+0000 7fe9c929e640 1 -- 172.21.15.105:0/1068277481 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c40cbec0 con 0x7fe9c40d2310 2024-09-21T03:27:16.714 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.711+0000 7fe9c929e640 1 --2- 172.21.15.105:0/1068277481 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9c40d2310 0x7fe9c414a1a0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc00e960 tx=0x7fe9bc00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:16.714 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.711+0000 7fe9b97fa640 1 -- 172.21.15.105:0/1068277481 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc004d20 con 0x7fe9c40d2310 2024-09-21T03:27:16.714 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.711+0000 7fe9b97fa640 1 -- 172.21.15.105:0/1068277481 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9bc00cac0 con 0x7fe9c40d2310 2024-09-21T03:27:16.714 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.711+0000 7fe9cad01640 1 -- 172.21.15.105:0/1068277481 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9c4147c00 con 0x7fe9c40d2310 2024-09-21T03:27:16.715 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.711+0000 7fe9b97fa640 1 -- 172.21.15.105:0/1068277481 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc005020 con 0x7fe9c40d2310 2024-09-21T03:27:16.715 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.711+0000 7fe9cad01640 1 -- 172.21.15.105:0/1068277481 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9c41481c0 con 0x7fe9c40d2310 2024-09-21T03:27:16.715 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.712+0000 7fe9cad01640 1 -- 172.21.15.105:0/1068277481 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9c40d1f50 con 0x7fe9c40d2310 2024-09-21T03:27:16.716 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.713+0000 7fe9b97fa640 1 -- 172.21.15.105:0/1068277481 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe9bc0051c0 con 0x7fe9c40d2310 2024-09-21T03:27:16.716 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.713+0000 7fe9b97fa640 1 --2- 172.21.15.105:0/1068277481 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe9b0078b90 0x7fe9b007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:16.716 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.713+0000 7fe9b97fa640 1 -- 172.21.15.105:0/1068277481 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5609+0+0 (secure 0 0 0) 0x7fe9bc09b470 con 0x7fe9c40d2310 2024-09-21T03:27:16.716 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.713+0000 7fe9c8a9d640 1 --2- 172.21.15.105:0/1068277481 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe9b0078b90 0x7fe9b007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:16.716 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.714+0000 7fe9c8a9d640 1 --2- 172.21.15.105:0/1068277481 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe9b0078b90 0x7fe9b007b0a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0033000 tx=0x7fe9c0004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:16.719 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.718+0000 7fe9b97fa640 1 -- 172.21.15.105:0/1068277481 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe9bc016030 con 0x7fe9c40d2310 2024-09-21T03:27:16.932 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:16.931+0000 7fe9cad01640 1 -- 172.21.15.105:0/1068277481 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe9c40cd5e0 con 0x7fe9c40d2310 2024-09-21T03:27:17.580 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.578+0000 7fe9b97fa640 1 -- 172.21.15.105:0/1068277481 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 22 and data pool 23 v91) ==== 174+0+0 (secure 0 0 0) 0x7fe9bc099e20 con 0x7fe9c40d2310 2024-09-21T03:27:17.582 INFO:teuthology.orchestra.run.smithi105.stderr:new fs with metadata pool 22 and data pool 23 2024-09-21T03:27:17.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.586+0000 7fe9cad01640 1 -- 172.21.15.105:0/1068277481 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe9b0078b90 msgr2=0x7fe9b007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:17.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.586+0000 7fe9cad01640 1 --2- 172.21.15.105:0/1068277481 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe9b0078b90 0x7fe9b007b0a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0033000 tx=0x7fe9c0004730 comp rx=0 tx=0).stop 2024-09-21T03:27:17.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.586+0000 7fe9cad01640 1 -- 172.21.15.105:0/1068277481 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9c40d2310 msgr2=0x7fe9c414a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:17.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.586+0000 7fe9cad01640 1 --2- 172.21.15.105:0/1068277481 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9c40d2310 0x7fe9c414a1a0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc00e960 tx=0x7fe9bc00ee20 comp rx=0 tx=0).stop 2024-09-21T03:27:17.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.587+0000 7fe9cad01640 1 -- 172.21.15.105:0/1068277481 shutdown_connections 2024-09-21T03:27:17.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.587+0000 7fe9cad01640 1 --2- 172.21.15.105:0/1068277481 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe9b0078b90 0x7fe9b007b0a0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:17.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.587+0000 7fe9cad01640 1 --2- 172.21.15.105:0/1068277481 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9c40d2310 0x7fe9c414a1a0 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:17.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.587+0000 7fe9cad01640 1 --2- 172.21.15.105:0/1068277481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9c40ccbe0 0x7fe9c4149c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:17.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.587+0000 7fe9cad01640 1 --2- 172.21.15.105:0/1068277481 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9c40b5210 0x7fe9c41f3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:17.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.587+0000 7fe9cad01640 1 -- 172.21.15.105:0/1068277481 >> 172.21.15.105:0/1068277481 conn(0x7fe9c40b3f10 msgr2=0x7fe9c40b64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:17.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.589+0000 7fe9cad01640 1 -- 172.21.15.105:0/1068277481 shutdown_connections 2024-09-21T03:27:17.591 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.590+0000 7fe9cad01640 1 -- 172.21.15.105:0/1068277481 wait complete. 2024-09-21T03:27:17.605 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:27:17.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.716+0000 7f9833825640 1 -- 172.21.15.105:0/109321137 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f982c0cd3e0 msgr2=0x7f982c070180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:17.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.716+0000 7f9833825640 1 --2- 172.21.15.105:0/109321137 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f982c0cd3e0 0x7f982c070180 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f981c005fd0 tx=0x7f981c02a530 comp rx=0 tx=0).stop 2024-09-21T03:27:17.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.716+0000 7f9833825640 1 -- 172.21.15.105:0/109321137 shutdown_connections 2024-09-21T03:27:17.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.716+0000 7f9833825640 1 --2- 172.21.15.105:0/109321137 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f982c0cd3e0 0x7f982c070180 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:17.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.716+0000 7f9833825640 1 --2- 172.21.15.105:0/109321137 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f982c0af780 0x7f982c0b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:17.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.716+0000 7f9833825640 1 -- 172.21.15.105:0/109321137 >> 172.21.15.105:0/109321137 conn(0x7f982c06d7d0 msgr2=0x7f982c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:17.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.716+0000 7f9833825640 1 -- 172.21.15.105:0/109321137 shutdown_connections 2024-09-21T03:27:17.719 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.716+0000 7f9833825640 1 -- 172.21.15.105:0/109321137 wait complete. 2024-09-21T03:27:17.719 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.718+0000 7f9833825640 1 Processor -- start 2024-09-21T03:27:17.719 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.718+0000 7f9833825640 1 -- start start 2024-09-21T03:27:17.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.719+0000 7f9833825640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f982c0706c0 0x7f982c1e82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:17.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.719+0000 7f9833825640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f982c0af780 0x7f982c0afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:17.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.719+0000 7f9833825640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f982c0cd3e0 0x7f982c0b0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:17.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.719+0000 7f9833825640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f982c073b80 con 0x7f982c0706c0 2024-09-21T03:27:17.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.719+0000 7f9833825640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f982c073a00 con 0x7f982c0cd3e0 2024-09-21T03:27:17.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.719+0000 7f9833825640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f982c1e6a80 con 0x7f982c0af780 2024-09-21T03:27:17.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.719+0000 7f98315c1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f982c0706c0 0x7f982c1e82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:17.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.719+0000 7f98315c1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f982c0706c0 0x7f982c1e82e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:55664/0 (socket says 172.21.15.105:55664) 2024-09-21T03:27:17.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.719+0000 7f98315c1640 1 -- 172.21.15.105:0/2047934588 learned_addr learned my addr 172.21.15.105:0/2047934588 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:17.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.719+0000 7f9831dc2640 1 --2- 172.21.15.105:0/2047934588 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f982c0cd3e0 0x7f982c0b0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:17.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.719+0000 7f9830dc0640 1 --2- 172.21.15.105:0/2047934588 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f982c0af780 0x7f982c0afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:17.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.719+0000 7f98315c1640 1 -- 172.21.15.105:0/2047934588 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f982c0af780 msgr2=0x7f982c0afbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:17.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.719+0000 7f98315c1640 1 --2- 172.21.15.105:0/2047934588 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f982c0af780 0x7f982c0afbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:17.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.719+0000 7f98315c1640 1 -- 172.21.15.105:0/2047934588 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f982c0cd3e0 msgr2=0x7f982c0b0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:17.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.719+0000 7f98315c1640 1 --2- 172.21.15.105:0/2047934588 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f982c0cd3e0 0x7f982c0b0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:17.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.719+0000 7f98315c1640 1 -- 172.21.15.105:0/2047934588 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f982c159a80 con 0x7f982c0706c0 2024-09-21T03:27:17.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.719+0000 7f9831dc2640 1 --2- 172.21.15.105:0/2047934588 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f982c0cd3e0 0x7f982c0b0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:27:17.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.719+0000 7f98315c1640 1 --2- 172.21.15.105:0/2047934588 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f982c0706c0 0x7f982c1e82e0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f982800d6d0 tx=0x7f982800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:17.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.720+0000 7f9821ffb640 1 -- 172.21.15.105:0/2047934588 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9828017070 con 0x7f982c0706c0 2024-09-21T03:27:17.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.720+0000 7f9821ffb640 1 -- 172.21.15.105:0/2047934588 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9828005330 con 0x7f982c0706c0 2024-09-21T03:27:17.724 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.720+0000 7f9833825640 1 -- 172.21.15.105:0/2047934588 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f982c1e6750 con 0x7f982c0706c0 2024-09-21T03:27:17.724 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.720+0000 7f9821ffb640 1 -- 172.21.15.105:0/2047934588 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9828009820 con 0x7f982c0706c0 2024-09-21T03:27:17.724 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.720+0000 7f9833825640 1 -- 172.21.15.105:0/2047934588 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f982c1f2ae0 con 0x7f982c0706c0 2024-09-21T03:27:17.724 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.721+0000 7f9833825640 1 -- 172.21.15.105:0/2047934588 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f982c0b39c0 con 0x7f982c0706c0 2024-09-21T03:27:17.725 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.722+0000 7f9821ffb640 1 -- 172.21.15.105:0/2047934588 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9828009bd0 con 0x7f982c0706c0 2024-09-21T03:27:17.725 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.722+0000 7f9821ffb640 1 --2- 172.21.15.105:0/2047934588 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9810078bc0 0x7f981007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:17.725 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.722+0000 7f9821ffb640 1 -- 172.21.15.105:0/2047934588 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7f982809b060 con 0x7f982c0706c0 2024-09-21T03:27:17.725 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.722+0000 7f9830dc0640 1 --2- 172.21.15.105:0/2047934588 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9810078bc0 0x7f981007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:17.725 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.723+0000 7f9830dc0640 1 --2- 172.21.15.105:0/2047934588 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9810078bc0 0x7f981007b0d0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f981c033000 tx=0x7f981c004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:17.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.727+0000 7f9821ffb640 1 -- 172.21.15.105:0/2047934588 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f98280634a0 con 0x7f982c0706c0 2024-09-21T03:27:17.907 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.905+0000 7f9833825640 1 -- 172.21.15.105:0/2047934588 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f982c0ae320 con 0x7f982c0706c0 2024-09-21T03:27:17.908 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.906+0000 7f9821ffb640 1 -- 172.21.15.105:0/2047934588 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) ==== 74+0+16816 (secure 0 0 0) 0x7f9828062da0 con 0x7f982c0706c0 2024-09-21T03:27:17.908 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:27:17.908 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":139,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:27:16.932423+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:27:14.565415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-21T03:27:15.886597+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:27:17.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.908+0000 7f9833825640 1 -- 172.21.15.105:0/2047934588 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9810078bc0 msgr2=0x7f981007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:17.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.908+0000 7f9833825640 1 --2- 172.21.15.105:0/2047934588 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9810078bc0 0x7f981007b0d0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f981c033000 tx=0x7f981c004730 comp rx=0 tx=0).stop 2024-09-21T03:27:17.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.908+0000 7f9833825640 1 -- 172.21.15.105:0/2047934588 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f982c0706c0 msgr2=0x7f982c1e82e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:17.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.908+0000 7f9833825640 1 --2- 172.21.15.105:0/2047934588 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f982c0706c0 0x7f982c1e82e0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f982800d6d0 tx=0x7f982800db90 comp rx=0 tx=0).stop 2024-09-21T03:27:17.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.909+0000 7f9833825640 1 -- 172.21.15.105:0/2047934588 shutdown_connections 2024-09-21T03:27:17.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.909+0000 7f9833825640 1 --2- 172.21.15.105:0/2047934588 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f9810078bc0 0x7f981007b0d0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:17.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.909+0000 7f9833825640 1 --2- 172.21.15.105:0/2047934588 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f982c0cd3e0 0x7f982c0b0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:17.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.909+0000 7f9833825640 1 --2- 172.21.15.105:0/2047934588 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f982c0af780 0x7f982c0afbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:17.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.909+0000 7f9833825640 1 --2- 172.21.15.105:0/2047934588 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f982c0706c0 0x7f982c1e82e0 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:17.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.909+0000 7f9833825640 1 -- 172.21.15.105:0/2047934588 >> 172.21.15.105:0/2047934588 conn(0x7f982c06d7d0 msgr2=0x7f982c0b14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:17.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.909+0000 7f9833825640 1 -- 172.21.15.105:0/2047934588 shutdown_connections 2024-09-21T03:27:17.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:17.909+0000 7f9833825640 1 -- 172.21.15.105:0/2047934588 wait complete. 2024-09-21T03:27:17.922 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:27:18.034 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.032+0000 7fd5ebb82640 1 -- 172.21.15.105:0/3089782770 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5e40ccba0 msgr2=0x7fd5e40ccfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:18.034 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.032+0000 7fd5ebb82640 1 --2- 172.21.15.105:0/3089782770 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5e40ccba0 0x7fd5e40ccfb0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fd5e40709b0 tx=0x7fd5dc02a560 comp rx=0 tx=0).stop 2024-09-21T03:27:18.034 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.032+0000 7fd5ebb82640 1 -- 172.21.15.105:0/3089782770 shutdown_connections 2024-09-21T03:27:18.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.032+0000 7fd5ebb82640 1 --2- 172.21.15.105:0/3089782770 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5e40ccba0 0x7fd5e40ccfb0 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:18.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.032+0000 7fd5ebb82640 1 --2- 172.21.15.105:0/3089782770 >> v2:172.21.15.162:3300/0 conn(0x7fd5e415c6f0 0x7fd5e40ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:18.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.032+0000 7fd5ebb82640 1 --2- 172.21.15.105:0/3089782770 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5e40d1d40 0x7fd5e40b5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:18.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.032+0000 7fd5ebb82640 1 -- 172.21.15.105:0/3089782770 >> 172.21.15.105:0/3089782770 conn(0x7fd5e40b3f10 msgr2=0x7fd5e40b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:18.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.032+0000 7fd5ebb82640 1 -- 172.21.15.105:0/3089782770 shutdown_connections 2024-09-21T03:27:18.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.032+0000 7fd5ebb82640 1 -- 172.21.15.105:0/3089782770 wait complete. 2024-09-21T03:27:18.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.034+0000 7fd5ebb82640 1 Processor -- start 2024-09-21T03:27:18.035 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.034+0000 7fd5ebb82640 1 -- start start 2024-09-21T03:27:18.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.035+0000 7fd5ebb82640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5e40ccba0 0x7fd5e4154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:18.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.035+0000 7fd5ebb82640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5e40d1d40 0x7fd5e41560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:18.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.035+0000 7fd5ebb82640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5e415c6f0 0x7fd5e4156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:18.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.035+0000 7fd5ebb82640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e40d11f0 con 0x7fd5e40ccba0 2024-09-21T03:27:18.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.035+0000 7fd5ebb82640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e40d1070 con 0x7fd5e40d1d40 2024-09-21T03:27:18.038 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.035+0000 7fd5ebb82640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd5e40d1370 con 0x7fd5e415c6f0 2024-09-21T03:27:18.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.035+0000 7fd5e991e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5e40ccba0 0x7fd5e4154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:18.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.035+0000 7fd5e991e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5e40ccba0 0x7fd5e4154c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:55682/0 (socket says 172.21.15.105:55682) 2024-09-21T03:27:18.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.035+0000 7fd5e991e640 1 -- 172.21.15.105:0/3994400633 learned_addr learned my addr 172.21.15.105:0/3994400633 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:18.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.035+0000 7fd5e911d640 1 --2- 172.21.15.105:0/3994400633 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5e40d1d40 0x7fd5e41560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:18.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.035+0000 7fd5ea11f640 1 --2- 172.21.15.105:0/3994400633 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5e415c6f0 0x7fd5e4156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:18.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.036+0000 7fd5e991e640 1 -- 172.21.15.105:0/3994400633 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5e415c6f0 msgr2=0x7fd5e4156620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:18.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.036+0000 7fd5e991e640 1 --2- 172.21.15.105:0/3994400633 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5e415c6f0 0x7fd5e4156620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:18.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.036+0000 7fd5e991e640 1 -- 172.21.15.105:0/3994400633 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5e40d1d40 msgr2=0x7fd5e41560e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:18.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.036+0000 7fd5e991e640 1 --2- 172.21.15.105:0/3994400633 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5e40d1d40 0x7fd5e41560e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:18.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.036+0000 7fd5e991e640 1 -- 172.21.15.105:0/3994400633 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e41f77d0 con 0x7fd5e40ccba0 2024-09-21T03:27:18.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.036+0000 7fd5ea11f640 1 --2- 172.21.15.105:0/3994400633 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5e415c6f0 0x7fd5e4156620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:27:18.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.036+0000 7fd5e911d640 1 --2- 172.21.15.105:0/3994400633 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5e40d1d40 0x7fd5e41560e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:27:18.039 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.036+0000 7fd5e991e640 1 --2- 172.21.15.105:0/3994400633 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5e40ccba0 0x7fd5e4154c50 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0005fd0 tx=0x7fd5e000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:18.040 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.036+0000 7fd5da7fc640 1 -- 172.21.15.105:0/3994400633 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e000f450 con 0x7fd5e40ccba0 2024-09-21T03:27:18.040 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.036+0000 7fd5da7fc640 1 -- 172.21.15.105:0/3994400633 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd5e000f6e0 con 0x7fd5e40ccba0 2024-09-21T03:27:18.040 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.036+0000 7fd5ebb82640 1 -- 172.21.15.105:0/3994400633 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5e41f6c50 con 0x7fd5e40ccba0 2024-09-21T03:27:18.040 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.036+0000 7fd5da7fc640 1 -- 172.21.15.105:0/3994400633 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e000fb10 con 0x7fd5e40ccba0 2024-09-21T03:27:18.040 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.036+0000 7fd5ebb82640 1 -- 172.21.15.105:0/3994400633 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5e41f7210 con 0x7fd5e40ccba0 2024-09-21T03:27:18.041 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.037+0000 7fd5ebb82640 1 -- 172.21.15.105:0/3994400633 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5e40d1900 con 0x7fd5e40ccba0 2024-09-21T03:27:18.041 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.038+0000 7fd5da7fc640 1 -- 172.21.15.105:0/3994400633 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd5e000fcb0 con 0x7fd5e40ccba0 2024-09-21T03:27:18.041 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.038+0000 7fd5da7fc640 1 --2- 172.21.15.105:0/3994400633 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd5c8078bc0 0x7fd5c807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:18.041 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.038+0000 7fd5da7fc640 1 -- 172.21.15.105:0/3994400633 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7fd5e009b760 con 0x7fd5e40ccba0 2024-09-21T03:27:18.041 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.038+0000 7fd5e911d640 1 --2- 172.21.15.105:0/3994400633 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd5c8078bc0 0x7fd5c807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:18.041 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.039+0000 7fd5e911d640 1 --2- 172.21.15.105:0/3994400633 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd5c8078bc0 0x7fd5c807b0d0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4005fd0 tx=0x7fd5d4005e20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:18.044 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.043+0000 7fd5da7fc640 1 -- 172.21.15.105:0/3994400633 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd5e0014030 con 0x7fd5e40ccba0 2024-09-21T03:27:18.221 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.220+0000 7fd5ebb82640 1 -- 172.21.15.105:0/3994400633 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd5e40d01b0 con 0x7fd5e40ccba0 2024-09-21T03:27:18.222 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.221+0000 7fd5da7fc640 1 -- 172.21.15.105:0/3994400633 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) ==== 74+0+16816 (secure 0 0 0) 0x7fd5e0063c30 con 0x7fd5e40ccba0 2024-09-21T03:27:18.223 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:27:18.223 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":139,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:27:16.932423+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:27:14.565415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-21T03:27:15.886597+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:27:18.225 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.223+0000 7fd5ebb82640 1 -- 172.21.15.105:0/3994400633 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd5c8078bc0 msgr2=0x7fd5c807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:18.225 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.223+0000 7fd5ebb82640 1 --2- 172.21.15.105:0/3994400633 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd5c8078bc0 0x7fd5c807b0d0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4005fd0 tx=0x7fd5d4005e20 comp rx=0 tx=0).stop 2024-09-21T03:27:18.225 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.223+0000 7fd5ebb82640 1 -- 172.21.15.105:0/3994400633 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5e40ccba0 msgr2=0x7fd5e4154c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:18.225 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.223+0000 7fd5ebb82640 1 --2- 172.21.15.105:0/3994400633 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5e40ccba0 0x7fd5e4154c50 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0005fd0 tx=0x7fd5e000a620 comp rx=0 tx=0).stop 2024-09-21T03:27:18.225 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.223+0000 7fd5ebb82640 1 -- 172.21.15.105:0/3994400633 shutdown_connections 2024-09-21T03:27:18.225 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.223+0000 7fd5ebb82640 1 --2- 172.21.15.105:0/3994400633 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd5c8078bc0 0x7fd5c807b0d0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:18.226 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.223+0000 7fd5ebb82640 1 --2- 172.21.15.105:0/3994400633 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5e415c6f0 0x7fd5e4156620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:18.226 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.223+0000 7fd5ebb82640 1 --2- 172.21.15.105:0/3994400633 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5e40d1d40 0x7fd5e41560e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:18.226 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.223+0000 7fd5ebb82640 1 --2- 172.21.15.105:0/3994400633 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5e40ccba0 0x7fd5e4154c50 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:18.226 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.223+0000 7fd5ebb82640 1 -- 172.21.15.105:0/3994400633 >> 172.21.15.105:0/3994400633 conn(0x7fd5e40b3f10 msgr2=0x7fd5e40b7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:18.226 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.223+0000 7fd5ebb82640 1 -- 172.21.15.105:0/3994400633 shutdown_connections 2024-09-21T03:27:18.226 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.223+0000 7fd5ebb82640 1 -- 172.21.15.105:0/3994400633 wait complete. 2024-09-21T03:27:18.236 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T03:27:18.352 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.350+0000 7f3ce2ac4640 1 -- 172.21.15.105:0/2224691746 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3cc4004800 msgr2=0x7f3cc4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:18.352 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.350+0000 7f3ce2ac4640 1 --2- 172.21.15.105:0/2224691746 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3cc4004800 0x7f3cc4004c10 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc0b6180 tx=0x7f3cc4005830 comp rx=0 tx=0).stop 2024-09-21T03:27:18.352 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.350+0000 7f3ce1061640 1 -- 172.21.15.105:0/2224691746 reap_dead start 2024-09-21T03:27:18.352 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.350+0000 7f3ce2ac4640 1 -- 172.21.15.105:0/2224691746 shutdown_connections 2024-09-21T03:27:18.352 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.350+0000 7f3ce2ac4640 1 -- 172.21.15.105:0/2224691746 >> 172.21.15.105:0/2224691746 conn(0x7f3cdc0cd530 msgr2=0x7f3cdc0cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:18.352 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.350+0000 7f3ce2ac4640 1 -- 172.21.15.105:0/2224691746 shutdown_connections 2024-09-21T03:27:18.352 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.350+0000 7f3ce2ac4640 1 -- 172.21.15.105:0/2224691746 wait complete. 2024-09-21T03:27:18.353 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.352+0000 7f3ce2ac4640 1 Processor -- start 2024-09-21T03:27:18.353 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.352+0000 7f3ce2ac4640 1 -- start start 2024-09-21T03:27:18.356 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.353+0000 7f3ce2ac4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cc4004800 0x7f3cdc1f9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:18.356 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.353+0000 7f3ce2ac4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3cdc0b4450 0x7f3cdc149560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:18.356 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.353+0000 7f3ce2ac4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3cdc15b880 0x7f3cdc15bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:18.356 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.353+0000 7f3ce2ac4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3cdc0ced90 con 0x7f3cdc0b4450 2024-09-21T03:27:18.357 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.353+0000 7f3ce2ac4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3cdc15f540 con 0x7f3cc4004800 2024-09-21T03:27:18.357 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.353+0000 7f3ce2ac4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3cdc0cef10 con 0x7f3cdc15b880 2024-09-21T03:27:18.357 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.353+0000 7f3cd3fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3cdc0b4450 0x7f3cdc149560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:18.357 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.353+0000 7f3cd3fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3cdc0b4450 0x7f3cdc149560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:55696/0 (socket says 172.21.15.105:55696) 2024-09-21T03:27:18.357 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.353+0000 7f3cd3fff640 1 -- 172.21.15.105:0/4171458034 learned_addr learned my addr 172.21.15.105:0/4171458034 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:18.357 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.354+0000 7f3ce0860640 1 --2- 172.21.15.105:0/4171458034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cc4004800 0x7f3cdc1f9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:18.357 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.354+0000 7f3ce1061640 1 --2- 172.21.15.105:0/4171458034 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3cdc15b880 0x7f3cdc15bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:18.357 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.354+0000 7f3cd3fff640 1 -- 172.21.15.105:0/4171458034 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3cdc15b880 msgr2=0x7f3cdc15bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:18.357 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.354+0000 7f3cd3fff640 1 --2- 172.21.15.105:0/4171458034 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3cdc15b880 0x7f3cdc15bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:18.357 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.354+0000 7f3cd3fff640 1 -- 172.21.15.105:0/4171458034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cc4004800 msgr2=0x7f3cdc1f9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:18.357 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.354+0000 7f3cd3fff640 1 --2- 172.21.15.105:0/4171458034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cc4004800 0x7f3cdc1f9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:18.357 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.354+0000 7f3cd3fff640 1 -- 172.21.15.105:0/4171458034 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cdc15c1d0 con 0x7f3cdc0b4450 2024-09-21T03:27:18.357 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.354+0000 7f3ce0860640 1 --2- 172.21.15.105:0/4171458034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cc4004800 0x7f3cdc1f9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:27:18.358 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.354+0000 7f3cd3fff640 1 --2- 172.21.15.105:0/4171458034 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3cdc0b4450 0x7f3cdc149560 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc036040 tx=0x7f3ccc033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:18.358 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.354+0000 7f3cd17fa640 1 -- 172.21.15.105:0/4171458034 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc038050 con 0x7f3cdc0b4450 2024-09-21T03:27:18.358 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.354+0000 7f3cd17fa640 1 -- 172.21.15.105:0/4171458034 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ccc039040 con 0x7f3cdc0b4450 2024-09-21T03:27:18.358 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.354+0000 7f3ce2ac4640 1 -- 172.21.15.105:0/4171458034 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cdc0b5460 con 0x7f3cdc0b4450 2024-09-21T03:27:18.358 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.354+0000 7f3cd17fa640 1 -- 172.21.15.105:0/4171458034 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc033c30 con 0x7f3cdc0b4450 2024-09-21T03:27:18.358 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.354+0000 7f3ce2ac4640 1 -- 172.21.15.105:0/4171458034 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cdc0b4bc0 con 0x7f3cdc0b4450 2024-09-21T03:27:18.359 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.355+0000 7f3ce2ac4640 1 -- 172.21.15.105:0/4171458034 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cdc0b4930 con 0x7f3cdc0b4450 2024-09-21T03:27:18.359 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.356+0000 7f3cd17fa640 1 -- 172.21.15.105:0/4171458034 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3ccc004030 con 0x7f3cdc0b4450 2024-09-21T03:27:18.359 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.356+0000 7f3cd17fa640 1 --2- 172.21.15.105:0/4171458034 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3cc8078bc0 0x7f3cc807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:18.359 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.357+0000 7f3cd17fa640 1 -- 172.21.15.105:0/4171458034 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7f3ccc0bc8f0 con 0x7f3cdc0b4450 2024-09-21T03:27:18.359 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.357+0000 7f3ce0860640 1 --2- 172.21.15.105:0/4171458034 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3cc8078bc0 0x7f3cc807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:18.359 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.357+0000 7f3ce0860640 1 --2- 172.21.15.105:0/4171458034 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3cc8078bc0 0x7f3cc807b0d0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f3cd80020b0 tx=0x7f3cd8001980 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:18.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.360+0000 7f3cd17fa640 1 -- 172.21.15.105:0/4171458034 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3cdc15c1d0 con 0x7f3cdc0b4450 2024-09-21T03:27:18.579 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:18.577+0000 7f3ce2ac4640 1 -- 172.21.15.105:0/4171458034 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f3cdc0cf4a0 con 0x7f3cdc0b4450 2024-09-21T03:27:19.550 INFO:tasks.ceph.mds.a.smithi105.stderr:2024-09-21T03:27:19.549+0000 7f68787fe640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T03:27:19.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.586+0000 7f3cd17fa640 1 -- 172.21.15.105:0/4171458034 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v94) ==== 118+0+0 (secure 0 0 0) 0x7f3ccc084f40 con 0x7f3cdc0b4450 2024-09-21T03:27:19.591 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.589+0000 7f3ce2ac4640 1 -- 172.21.15.105:0/4171458034 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3cc8078bc0 msgr2=0x7f3cc807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:19.591 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.589+0000 7f3ce2ac4640 1 --2- 172.21.15.105:0/4171458034 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3cc8078bc0 0x7f3cc807b0d0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f3cd80020b0 tx=0x7f3cd8001980 comp rx=0 tx=0).stop 2024-09-21T03:27:19.591 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.589+0000 7f3ce2ac4640 1 -- 172.21.15.105:0/4171458034 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3cdc0b4450 msgr2=0x7f3cdc149560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:19.591 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.589+0000 7f3ce2ac4640 1 --2- 172.21.15.105:0/4171458034 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3cdc0b4450 0x7f3cdc149560 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc036040 tx=0x7f3ccc033670 comp rx=0 tx=0).stop 2024-09-21T03:27:19.591 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.589+0000 7f3ce2ac4640 1 -- 172.21.15.105:0/4171458034 shutdown_connections 2024-09-21T03:27:19.591 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.589+0000 7f3ce2ac4640 1 --2- 172.21.15.105:0/4171458034 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3cc8078bc0 0x7f3cc807b0d0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:19.591 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.589+0000 7f3ce2ac4640 1 --2- 172.21.15.105:0/4171458034 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3cdc15b880 0x7f3cdc15bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:19.591 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.589+0000 7f3ce2ac4640 1 --2- 172.21.15.105:0/4171458034 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3cdc0b4450 0x7f3cdc149560 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:19.591 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.589+0000 7f3ce2ac4640 1 --2- 172.21.15.105:0/4171458034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cc4004800 0x7f3cdc1f9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:19.591 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.589+0000 7f3ce2ac4640 1 -- 172.21.15.105:0/4171458034 >> 172.21.15.105:0/4171458034 conn(0x7f3cdc0cd530 msgr2=0x7f3cdc06e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:19.592 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.589+0000 7f3ce2ac4640 1 -- 172.21.15.105:0/4171458034 shutdown_connections 2024-09-21T03:27:19.592 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.589+0000 7f3ce2ac4640 1 -- 172.21.15.105:0/4171458034 wait complete. 2024-09-21T03:27:19.604 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T03:27:19.604 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T03:27:19.672 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-09-21T03:27:19.672 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-09-21T03:27:19.725 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.723+0000 7f0e02beb640 1 -- 172.21.15.105:0/1878911970 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0dfc06d4f0 msgr2=0x7f0dfc160420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:19.725 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.723+0000 7f0e02beb640 1 --2- 172.21.15.105:0/1878911970 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0dfc06d4f0 0x7f0dfc160420 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f0df4009830 tx=0x7f0df402a480 comp rx=0 tx=0).stop 2024-09-21T03:27:19.725 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.723+0000 7f0e02beb640 1 -- 172.21.15.105:0/1878911970 shutdown_connections 2024-09-21T03:27:19.725 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.723+0000 7f0e02beb640 1 --2- 172.21.15.105:0/1878911970 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0dfc06d4f0 0x7f0dfc160420 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:19.725 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.723+0000 7f0e02beb640 1 --2- 172.21.15.105:0/1878911970 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0dfc06e400 0x7f0dfc0cbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:19.725 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.723+0000 7f0e02beb640 1 -- 172.21.15.105:0/1878911970 >> 172.21.15.105:0/1878911970 conn(0x7f0dfc0cd530 msgr2=0x7f0dfc0cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:19.725 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.723+0000 7f0e02beb640 1 -- 172.21.15.105:0/1878911970 shutdown_connections 2024-09-21T03:27:19.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.723+0000 7f0e02beb640 1 -- 172.21.15.105:0/1878911970 wait complete. 2024-09-21T03:27:19.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.725+0000 7f0e02beb640 1 Processor -- start 2024-09-21T03:27:19.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.725+0000 7f0e02beb640 1 -- start start 2024-09-21T03:27:19.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.726+0000 7f0e02beb640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0dfc06d4f0 0x7f0dfc0c7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:19.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.726+0000 7f0e02beb640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0dfc06e400 0x7f0dfc152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:19.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.726+0000 7f0e02beb640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0dfc071210 0x7f0dfc1f4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:19.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.726+0000 7f0e02beb640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0dfc160ae0 con 0x7f0dfc06d4f0 2024-09-21T03:27:19.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.726+0000 7f0e02beb640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0dfc160960 con 0x7f0dfc071210 2024-09-21T03:27:19.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.726+0000 7f0e02beb640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0dfc160c60 con 0x7f0dfc06e400 2024-09-21T03:27:19.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.726+0000 7f0e00987640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0dfc06d4f0 0x7f0dfc0c7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:19.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.726+0000 7f0e00987640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0dfc06d4f0 0x7f0dfc0c7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:55712/0 (socket says 172.21.15.105:55712) 2024-09-21T03:27:19.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.726+0000 7f0e00987640 1 -- 172.21.15.105:0/335643244 learned_addr learned my addr 172.21.15.105:0/335643244 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:19.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.727+0000 7f0dfbfff640 1 --2- 172.21.15.105:0/335643244 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0dfc06e400 0x7f0dfc152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:19.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.727+0000 7f0e01188640 1 --2- 172.21.15.105:0/335643244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0dfc071210 0x7f0dfc1f4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:19.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.727+0000 7f0e00987640 1 -- 172.21.15.105:0/335643244 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0dfc06e400 msgr2=0x7f0dfc152230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:19.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.727+0000 7f0e00987640 1 --2- 172.21.15.105:0/335643244 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0dfc06e400 0x7f0dfc152230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:19.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.727+0000 7f0e00987640 1 -- 172.21.15.105:0/335643244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0dfc071210 msgr2=0x7f0dfc1f4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:19.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.727+0000 7f0e00987640 1 --2- 172.21.15.105:0/335643244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0dfc071210 0x7f0dfc1f4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:19.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.727+0000 7f0e00987640 1 -- 172.21.15.105:0/335643244 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dfc157920 con 0x7f0dfc06d4f0 2024-09-21T03:27:19.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.727+0000 7f0dfbfff640 1 --2- 172.21.15.105:0/335643244 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0dfc06e400 0x7f0dfc152230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:27:19.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.727+0000 7f0e00987640 1 --2- 172.21.15.105:0/335643244 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0dfc06d4f0 0x7f0dfc0c7060 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f0dec00c970 tx=0x7f0dec00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:19.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.727+0000 7f0df97fa640 1 -- 172.21.15.105:0/335643244 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dec007bb0 con 0x7f0dfc06d4f0 2024-09-21T03:27:19.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.727+0000 7f0df97fa640 1 -- 172.21.15.105:0/335643244 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0dec007e40 con 0x7f0dfc06d4f0 2024-09-21T03:27:19.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.727+0000 7f0e02beb640 1 -- 172.21.15.105:0/335643244 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dfc0c6580 con 0x7f0dfc06d4f0 2024-09-21T03:27:19.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.727+0000 7f0df97fa640 1 -- 172.21.15.105:0/335643244 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dec005280 con 0x7f0dfc06d4f0 2024-09-21T03:27:19.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.727+0000 7f0e02beb640 1 -- 172.21.15.105:0/335643244 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dfc0c6b40 con 0x7f0dfc06d4f0 2024-09-21T03:27:19.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.728+0000 7f0e02beb640 1 -- 172.21.15.105:0/335643244 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dfc161110 con 0x7f0dfc06d4f0 2024-09-21T03:27:19.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.729+0000 7f0df97fa640 1 -- 172.21.15.105:0/335643244 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0dec005420 con 0x7f0dfc06d4f0 2024-09-21T03:27:19.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.730+0000 7f0df97fa640 1 --2- 172.21.15.105:0/335643244 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0de8078bc0 0x7f0de807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:19.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.730+0000 7f0df97fa640 1 -- 172.21.15.105:0/335643244 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5709+0+0 (secure 0 0 0) 0x7f0dec09b240 con 0x7f0dfc06d4f0 2024-09-21T03:27:19.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.730+0000 7f0dfbfff640 1 --2- 172.21.15.105:0/335643244 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0de8078bc0 0x7f0de807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:19.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.730+0000 7f0dfbfff640 1 --2- 172.21.15.105:0/335643244 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0de8078bc0 0x7f0de807b0d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f0df0007fd0 tx=0x7f0df0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:19.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.734+0000 7f0df97fa640 1 -- 172.21.15.105:0/335643244 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0dec014030 con 0x7f0dfc06d4f0 2024-09-21T03:27:19.950 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:19.948+0000 7f0e02beb640 1 -- 172.21.15.105:0/335643244 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f0dfc0761d0 con 0x7f0dfc06d4f0 2024-09-21T03:27:20.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.588+0000 7f0df97fa640 1 -- 172.21.15.105:0/335643244 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v95) ==== 122+0+0 (secure 0 0 0) 0x7f0dec063740 con 0x7f0dfc06d4f0 2024-09-21T03:27:20.592 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.590+0000 7f0e02beb640 1 -- 172.21.15.105:0/335643244 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0de8078bc0 msgr2=0x7f0de807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:20.592 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.590+0000 7f0e02beb640 1 --2- 172.21.15.105:0/335643244 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0de8078bc0 0x7f0de807b0d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f0df0007fd0 tx=0x7f0df0009040 comp rx=0 tx=0).stop 2024-09-21T03:27:20.592 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.590+0000 7f0e02beb640 1 -- 172.21.15.105:0/335643244 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0dfc06d4f0 msgr2=0x7f0dfc0c7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:20.592 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.590+0000 7f0e02beb640 1 --2- 172.21.15.105:0/335643244 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0dfc06d4f0 0x7f0dfc0c7060 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f0dec00c970 tx=0x7f0dec00ce30 comp rx=0 tx=0).stop 2024-09-21T03:27:20.593 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.590+0000 7f0e02beb640 1 -- 172.21.15.105:0/335643244 shutdown_connections 2024-09-21T03:27:20.593 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.590+0000 7f0e02beb640 1 --2- 172.21.15.105:0/335643244 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0de8078bc0 0x7f0de807b0d0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:20.593 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.590+0000 7f0e02beb640 1 --2- 172.21.15.105:0/335643244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0dfc071210 0x7f0dfc1f4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:20.593 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.590+0000 7f0e02beb640 1 --2- 172.21.15.105:0/335643244 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0dfc06e400 0x7f0dfc152230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:20.593 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.590+0000 7f0e02beb640 1 --2- 172.21.15.105:0/335643244 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0dfc06d4f0 0x7f0dfc0c7060 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:20.593 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.590+0000 7f0e02beb640 1 -- 172.21.15.105:0/335643244 >> 172.21.15.105:0/335643244 conn(0x7f0dfc0cd530 msgr2=0x7f0dfc0b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:20.593 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.590+0000 7f0e02beb640 1 -- 172.21.15.105:0/335643244 shutdown_connections 2024-09-21T03:27:20.593 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.590+0000 7f0e02beb640 1 -- 172.21.15.105:0/335643244 wait complete. 2024-09-21T03:27:20.604 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T03:27:20.604 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:27:20.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.715+0000 7f8c3dab6640 1 -- 172.21.15.105:0/147354712 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c380cd3e0 msgr2=0x7f8c38070180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:20.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.715+0000 7f8c3dab6640 1 --2- 172.21.15.105:0/147354712 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c380cd3e0 0x7f8c38070180 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c005fd0 tx=0x7f8c2c02a4a0 comp rx=0 tx=0).stop 2024-09-21T03:27:20.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.715+0000 7f8c3dab6640 1 -- 172.21.15.105:0/147354712 shutdown_connections 2024-09-21T03:27:20.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.715+0000 7f8c3dab6640 1 --2- 172.21.15.105:0/147354712 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c380706c0 0x7f8c38072ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:20.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.715+0000 7f8c3dab6640 1 --2- 172.21.15.105:0/147354712 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c380cd3e0 0x7f8c38070180 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:20.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.715+0000 7f8c3dab6640 1 -- 172.21.15.105:0/147354712 >> 172.21.15.105:0/147354712 conn(0x7f8c3806d7d0 msgr2=0x7f8c380b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:20.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.715+0000 7f8c3dab6640 1 -- 172.21.15.105:0/147354712 shutdown_connections 2024-09-21T03:27:20.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.715+0000 7f8c3dab6640 1 -- 172.21.15.105:0/147354712 wait complete. 2024-09-21T03:27:20.719 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.717+0000 7f8c3dab6640 1 Processor -- start 2024-09-21T03:27:20.719 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.717+0000 7f8c3dab6640 1 -- start start 2024-09-21T03:27:20.721 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.719+0000 7f8c3dab6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c380706c0 0x7f8c3814c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:20.721 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.719+0000 7f8c3dab6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c380af780 0x7f8c381f2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:20.721 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.719+0000 7f8c3dab6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c380cd3e0 0x7f8c381f30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:20.721 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.719+0000 7f8c3dab6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8c38073b70 con 0x7f8c380cd3e0 2024-09-21T03:27:20.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.719+0000 7f8c3dab6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8c380739f0 con 0x7f8c380706c0 2024-09-21T03:27:20.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.719+0000 7f8c3dab6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8c38073cf0 con 0x7f8c380af780 2024-09-21T03:27:20.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.719+0000 7f8c37fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c380cd3e0 0x7f8c381f30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:20.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.719+0000 7f8c37fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c380cd3e0 0x7f8c381f30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:55724/0 (socket says 172.21.15.105:55724) 2024-09-21T03:27:20.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.719+0000 7f8c37fff640 1 -- 172.21.15.105:0/3117555802 learned_addr learned my addr 172.21.15.105:0/3117555802 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:20.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.719+0000 7f8c36ffd640 1 --2- 172.21.15.105:0/3117555802 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c380af780 0x7f8c381f2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:20.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.719+0000 7f8c377fe640 1 --2- 172.21.15.105:0/3117555802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c380706c0 0x7f8c3814c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:20.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.719+0000 7f8c37fff640 1 -- 172.21.15.105:0/3117555802 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c380af780 msgr2=0x7f8c381f2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:20.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.719+0000 7f8c37fff640 1 --2- 172.21.15.105:0/3117555802 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c380af780 0x7f8c381f2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:20.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.719+0000 7f8c37fff640 1 -- 172.21.15.105:0/3117555802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c380706c0 msgr2=0x7f8c3814c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:20.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.719+0000 7f8c37fff640 1 --2- 172.21.15.105:0/3117555802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c380706c0 0x7f8c3814c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:20.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.719+0000 7f8c37fff640 1 -- 172.21.15.105:0/3117555802 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c381f3910 con 0x7f8c380cd3e0 2024-09-21T03:27:20.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.719+0000 7f8c377fe640 1 --2- 172.21.15.105:0/3117555802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c380706c0 0x7f8c3814c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:27:20.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.719+0000 7f8c37fff640 1 --2- 172.21.15.105:0/3117555802 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c380cd3e0 0x7f8c381f30b0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f8c3000b9e0 tx=0x7f8c3000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:20.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.719+0000 7f8c1ffff640 1 -- 172.21.15.105:0/3117555802 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c30019070 con 0x7f8c380cd3e0 2024-09-21T03:27:20.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.719+0000 7f8c1ffff640 1 -- 172.21.15.105:0/3117555802 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c3000cc30 con 0x7f8c380cd3e0 2024-09-21T03:27:20.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.719+0000 7f8c3dab6640 1 -- 172.21.15.105:0/3117555802 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c3814f020 con 0x7f8c380cd3e0 2024-09-21T03:27:20.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.719+0000 7f8c1ffff640 1 -- 172.21.15.105:0/3117555802 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c300146a0 con 0x7f8c380cd3e0 2024-09-21T03:27:20.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.719+0000 7f8c3dab6640 1 -- 172.21.15.105:0/3117555802 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c3814f5e0 con 0x7f8c380cd3e0 2024-09-21T03:27:20.724 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.720+0000 7f8c3dab6640 1 -- 172.21.15.105:0/3117555802 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c381f3680 con 0x7f8c380cd3e0 2024-09-21T03:27:20.724 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.721+0000 7f8c1ffff640 1 -- 172.21.15.105:0/3117555802 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8c3001c070 con 0x7f8c380cd3e0 2024-09-21T03:27:20.724 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.721+0000 7f8c1ffff640 1 --2- 172.21.15.105:0/3117555802 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c24078b90 0x7f8c2407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:20.724 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.722+0000 7f8c1ffff640 1 -- 172.21.15.105:0/3117555802 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5709+0+0 (secure 0 0 0) 0x7f8c3009aa60 con 0x7f8c380cd3e0 2024-09-21T03:27:20.724 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.722+0000 7f8c377fe640 1 --2- 172.21.15.105:0/3117555802 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c24078b90 0x7f8c2407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:20.724 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.722+0000 7f8c377fe640 1 --2- 172.21.15.105:0/3117555802 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c24078b90 0x7f8c2407b0a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f8c2800a810 tx=0x7f8c28008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:20.727 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.726+0000 7f8c1ffff640 1 -- 172.21.15.105:0/3117555802 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8c3000ce20 con 0x7f8c380cd3e0 2024-09-21T03:27:20.940 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.938+0000 7f8c3dab6640 1 -- 172.21.15.105:0/3117555802 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8c38072ff0 con 0x7f8c380cd3e0 2024-09-21T03:27:20.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.938+0000 7f8c1ffff640 1 -- 172.21.15.105:0/3117555802 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5239 (secure 0 0 0) 0x7f8c30062e80 con 0x7f8c380cd3e0 2024-09-21T03:27:20.941 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:27:20.941 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":95,"btime":"2024-09-21T03:27:20:587314+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6752,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/1488182977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1488182977},{"type":"v1","addr":"172.21.15.162:6836","nonce":1488182977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":6755,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/2107181663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2107181663},{"type":"v1","addr":"172.21.15.162:6837","nonce":2107181663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":8427,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/3833164666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3833164666},{"type":"v1","addr":"172.21.15.105:6834","nonce":3833164666}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:27:16.932383+0000","modified":"2024-09-21T03:27:19.949827+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8430":{"gid":8430,"name":"a","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1315344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":1315344000},{"type":"v1","addr":"172.21.15.105:6835","nonce":1315344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8430,"qdb_cluster":[8430]},"id":11}]} 2024-09-21T03:27:20.941 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 95 2024-09-21T03:27:20.946 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.940+0000 7f8c3dab6640 1 -- 172.21.15.105:0/3117555802 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c24078b90 msgr2=0x7f8c2407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:20.946 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.940+0000 7f8c3dab6640 1 --2- 172.21.15.105:0/3117555802 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c24078b90 0x7f8c2407b0a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f8c2800a810 tx=0x7f8c28008040 comp rx=0 tx=0).stop 2024-09-21T03:27:20.946 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.940+0000 7f8c3dab6640 1 -- 172.21.15.105:0/3117555802 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c380cd3e0 msgr2=0x7f8c381f30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:20.946 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.940+0000 7f8c3dab6640 1 --2- 172.21.15.105:0/3117555802 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c380cd3e0 0x7f8c381f30b0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f8c3000b9e0 tx=0x7f8c3000bea0 comp rx=0 tx=0).stop 2024-09-21T03:27:20.946 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.940+0000 7f8c3dab6640 1 -- 172.21.15.105:0/3117555802 shutdown_connections 2024-09-21T03:27:20.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.940+0000 7f8c3dab6640 1 --2- 172.21.15.105:0/3117555802 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8c24078b90 0x7f8c2407b0a0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:20.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.940+0000 7f8c3dab6640 1 --2- 172.21.15.105:0/3117555802 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c380cd3e0 0x7f8c381f30b0 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:20.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.940+0000 7f8c3dab6640 1 --2- 172.21.15.105:0/3117555802 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c380af780 0x7f8c381f2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:20.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.940+0000 7f8c3dab6640 1 --2- 172.21.15.105:0/3117555802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c380706c0 0x7f8c3814c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:20.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.940+0000 7f8c3dab6640 1 -- 172.21.15.105:0/3117555802 >> 172.21.15.105:0/3117555802 conn(0x7f8c3806d7d0 msgr2=0x7f8c380aee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:20.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.940+0000 7f8c3dab6640 1 -- 172.21.15.105:0/3117555802 shutdown_connections 2024-09-21T03:27:20.947 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:20.940+0000 7f8c3dab6640 1 -- 172.21.15.105:0/3117555802 wait complete. 2024-09-21T03:27:20.954 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:27:21.066 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.064+0000 7efe31a15640 1 -- 172.21.15.105:0/74457656 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe18005350 msgr2=0x7efe1800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:21.067 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.064+0000 7efe31a15640 1 --2- 172.21.15.105:0/74457656 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe18005350 0x7efe1800b9c0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7efe24009b20 tx=0x7efe18005830 comp rx=0 tx=0).stop 2024-09-21T03:27:21.067 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.064+0000 7efe31a15640 1 -- 172.21.15.105:0/74457656 shutdown_connections 2024-09-21T03:27:21.067 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.064+0000 7efe31a15640 1 --2- 172.21.15.105:0/74457656 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe18005350 0x7efe1800b9c0 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:21.067 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.064+0000 7efe31a15640 1 -- 172.21.15.105:0/74457656 >> 172.21.15.105:0/74457656 conn(0x7efe2c0d12a0 msgr2=0x7efe2c0d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:21.067 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.064+0000 7efe31a15640 1 -- 172.21.15.105:0/74457656 shutdown_connections 2024-09-21T03:27:21.067 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.064+0000 7efe31a15640 1 -- 172.21.15.105:0/74457656 wait complete. 2024-09-21T03:27:21.068 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.065+0000 7efe31a15640 1 Processor -- start 2024-09-21T03:27:21.068 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.066+0000 7efe31a15640 1 -- start start 2024-09-21T03:27:21.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.067+0000 7efe31a15640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe18005350 0x7efe2c1d6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:21.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.067+0000 7efe31a15640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe2c1f5dd0 0x7efe2c06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:21.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.067+0000 7efe31a15640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe2c06d8f0 0x7efe2c1d62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:21.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.067+0000 7efe31a15640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efe2c0b0de0 con 0x7efe2c06d8f0 2024-09-21T03:27:21.071 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.067+0000 7efe31a15640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efe2c0b20d0 con 0x7efe2c1f5dd0 2024-09-21T03:27:21.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.067+0000 7efe31a15640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7efe2c0b0f60 con 0x7efe18005350 2024-09-21T03:27:21.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.067+0000 7efe2b7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe2c06d8f0 0x7efe2c1d62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:21.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.067+0000 7efe2b7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe2c06d8f0 0x7efe2c1d62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:55738/0 (socket says 172.21.15.105:55738) 2024-09-21T03:27:21.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.067+0000 7efe2b7fe640 1 -- 172.21.15.105:0/2901935570 learned_addr learned my addr 172.21.15.105:0/2901935570 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:21.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.067+0000 7efe2affd640 1 --2- 172.21.15.105:0/2901935570 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe18005350 0x7efe2c1d6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:21.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.067+0000 7efe2a7fc640 1 --2- 172.21.15.105:0/2901935570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe2c1f5dd0 0x7efe2c06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:21.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.067+0000 7efe2b7fe640 1 -- 172.21.15.105:0/2901935570 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe18005350 msgr2=0x7efe2c1d6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:21.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.067+0000 7efe2b7fe640 1 --2- 172.21.15.105:0/2901935570 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe18005350 0x7efe2c1d6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:21.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.067+0000 7efe2b7fe640 1 -- 172.21.15.105:0/2901935570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe2c1f5dd0 msgr2=0x7efe2c06d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:21.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.067+0000 7efe2b7fe640 1 --2- 172.21.15.105:0/2901935570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe2c1f5dd0 0x7efe2c06d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:21.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.067+0000 7efe2b7fe640 1 -- 172.21.15.105:0/2901935570 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe2c1f8aa0 con 0x7efe2c06d8f0 2024-09-21T03:27:21.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.068+0000 7efe2b7fe640 1 --2- 172.21.15.105:0/2901935570 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe2c06d8f0 0x7efe2c1d62e0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7efe24009c40 tx=0x7efe24009720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:21.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.068+0000 7efe23fff640 1 -- 172.21.15.105:0/2901935570 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe240035f0 con 0x7efe2c06d8f0 2024-09-21T03:27:21.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.068+0000 7efe23fff640 1 -- 172.21.15.105:0/2901935570 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe240037d0 con 0x7efe2c06d8f0 2024-09-21T03:27:21.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.068+0000 7efe31a15640 1 -- 172.21.15.105:0/2901935570 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe2c1f8d80 con 0x7efe2c06d8f0 2024-09-21T03:27:21.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.068+0000 7efe23fff640 1 -- 172.21.15.105:0/2901935570 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe24003a20 con 0x7efe2c06d8f0 2024-09-21T03:27:21.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.068+0000 7efe31a15640 1 -- 172.21.15.105:0/2901935570 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe2c1f9340 con 0x7efe2c06d8f0 2024-09-21T03:27:21.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.069+0000 7efe31a15640 1 -- 172.21.15.105:0/2901935570 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe2c0b40f0 con 0x7efe2c06d8f0 2024-09-21T03:27:21.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.069+0000 7efe23fff640 1 -- 172.21.15.105:0/2901935570 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efe24042020 con 0x7efe2c06d8f0 2024-09-21T03:27:21.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.070+0000 7efe23fff640 1 --2- 172.21.15.105:0/2901935570 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efe0c078b90 0x7efe0c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:21.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.070+0000 7efe23fff640 1 -- 172.21.15.105:0/2901935570 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5709+0+0 (secure 0 0 0) 0x7efe240bae30 con 0x7efe2c06d8f0 2024-09-21T03:27:21.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.070+0000 7efe2affd640 1 --2- 172.21.15.105:0/2901935570 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efe0c078b90 0x7efe0c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:21.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.070+0000 7efe2affd640 1 --2- 172.21.15.105:0/2901935570 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efe0c078b90 0x7efe0c07b0a0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7efe2c0ceda0 tx=0x7efe1c004a80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:21.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.074+0000 7efe23fff640 1 -- 172.21.15.105:0/2901935570 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7efe24082c20 con 0x7efe2c06d8f0 2024-09-21T03:27:21.253 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.251+0000 7efe31a15640 1 -- 172.21.15.105:0/2901935570 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efe2c1e5e80 con 0x7efe2c06d8f0 2024-09-21T03:27:21.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.252+0000 7efe23fff640 1 -- 172.21.15.105:0/2901935570 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) ==== 74+0+16803 (secure 0 0 0) 0x7efe24087650 con 0x7efe2c06d8f0 2024-09-21T03:27:21.255 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:27:21.255 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":140,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:27:18.574718+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:27:14.565415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-21T03:27:15.886597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:27:21.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.254+0000 7efe31a15640 1 -- 172.21.15.105:0/2901935570 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efe0c078b90 msgr2=0x7efe0c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:21.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.254+0000 7efe31a15640 1 --2- 172.21.15.105:0/2901935570 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efe0c078b90 0x7efe0c07b0a0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7efe2c0ceda0 tx=0x7efe1c004a80 comp rx=0 tx=0).stop 2024-09-21T03:27:21.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.254+0000 7efe31a15640 1 -- 172.21.15.105:0/2901935570 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe2c06d8f0 msgr2=0x7efe2c1d62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:21.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.254+0000 7efe31a15640 1 --2- 172.21.15.105:0/2901935570 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe2c06d8f0 0x7efe2c1d62e0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7efe24009c40 tx=0x7efe24009720 comp rx=0 tx=0).stop 2024-09-21T03:27:21.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.254+0000 7efe31a15640 1 -- 172.21.15.105:0/2901935570 shutdown_connections 2024-09-21T03:27:21.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.254+0000 7efe31a15640 1 --2- 172.21.15.105:0/2901935570 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efe0c078b90 0x7efe0c07b0a0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:21.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.254+0000 7efe31a15640 1 --2- 172.21.15.105:0/2901935570 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe2c06d8f0 0x7efe2c1d62e0 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:21.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.254+0000 7efe31a15640 1 --2- 172.21.15.105:0/2901935570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe2c1f5dd0 0x7efe2c06d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:21.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.254+0000 7efe31a15640 1 --2- 172.21.15.105:0/2901935570 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efe18005350 0x7efe2c1d6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:21.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.254+0000 7efe31a15640 1 -- 172.21.15.105:0/2901935570 >> 172.21.15.105:0/2901935570 conn(0x7efe2c0d12a0 msgr2=0x7efe2c070a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:21.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.254+0000 7efe31a15640 1 -- 172.21.15.105:0/2901935570 shutdown_connections 2024-09-21T03:27:21.258 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.254+0000 7efe31a15640 1 -- 172.21.15.105:0/2901935570 wait complete. 2024-09-21T03:27:21.269 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T03:27:21.269 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:27:21.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.378+0000 7ff9022c5640 1 -- 172.21.15.105:0/3633455929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8e4003a00 msgr2=0x7ff8e4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:21.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.378+0000 7ff9022c5640 1 --2- 172.21.15.105:0/3633455929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8e4003a00 0x7ff8e4003e70 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec00c260 tx=0x7ff8e4005830 comp rx=0 tx=0).stop 2024-09-21T03:27:21.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.378+0000 7ff900862640 1 -- 172.21.15.105:0/3633455929 reap_dead start 2024-09-21T03:27:21.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.378+0000 7ff9022c5640 1 -- 172.21.15.105:0/3633455929 shutdown_connections 2024-09-21T03:27:21.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.378+0000 7ff9022c5640 1 -- 172.21.15.105:0/3633455929 >> 172.21.15.105:0/3633455929 conn(0x7ff8fc06d7d0 msgr2=0x7ff8fc0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:21.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.378+0000 7ff9022c5640 1 -- 172.21.15.105:0/3633455929 shutdown_connections 2024-09-21T03:27:21.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.378+0000 7ff9022c5640 1 -- 172.21.15.105:0/3633455929 wait complete. 2024-09-21T03:27:21.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.380+0000 7ff9022c5640 1 Processor -- start 2024-09-21T03:27:21.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.380+0000 7ff9022c5640 1 -- start start 2024-09-21T03:27:21.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.381+0000 7ff9022c5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8e4003a00 0x7ff8fc15c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:21.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.382+0000 7ff9022c5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8fc154e30 0x7ff8fc156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:21.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.382+0000 7ff9022c5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8fc155240 0x7ff8fc156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:21.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.382+0000 7ff9022c5640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff8fc0735b0 con 0x7ff8fc155240 2024-09-21T03:27:21.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.382+0000 7ff9022c5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff8fc073430 con 0x7ff8e4003a00 2024-09-21T03:27:21.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.382+0000 7ff9022c5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff8fc073730 con 0x7ff8fc154e30 2024-09-21T03:27:21.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.382+0000 7ff900862640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8fc155240 0x7ff8fc156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:21.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.382+0000 7ff900862640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8fc155240 0x7ff8fc156da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:55748/0 (socket says 172.21.15.105:55748) 2024-09-21T03:27:21.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.382+0000 7ff900862640 1 -- 172.21.15.105:0/2464277769 learned_addr learned my addr 172.21.15.105:0/2464277769 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:21.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.382+0000 7ff8fbfff640 1 --2- 172.21.15.105:0/2464277769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8e4003a00 0x7ff8fc15c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:21.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.382+0000 7ff8fb7fe640 1 --2- 172.21.15.105:0/2464277769 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8fc154e30 0x7ff8fc156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:21.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.382+0000 7ff900862640 1 -- 172.21.15.105:0/2464277769 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8fc154e30 msgr2=0x7ff8fc156860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:21.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.382+0000 7ff900862640 1 --2- 172.21.15.105:0/2464277769 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8fc154e30 0x7ff8fc156860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:21.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.382+0000 7ff900862640 1 -- 172.21.15.105:0/2464277769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8e4003a00 msgr2=0x7ff8fc15c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:21.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.382+0000 7ff900862640 1 --2- 172.21.15.105:0/2464277769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8e4003a00 0x7ff8fc15c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:21.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.382+0000 7ff900862640 1 -- 172.21.15.105:0/2464277769 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8fc09b440 con 0x7ff8fc155240 2024-09-21T03:27:21.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.382+0000 7ff900862640 1 --2- 172.21.15.105:0/2464277769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8fc155240 0x7ff8fc156da0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc0ce0e0 tx=0x7ff8f4010ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:21.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.382+0000 7ff8f8ff9640 1 -- 172.21.15.105:0/2464277769 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f4003c40 con 0x7ff8fc155240 2024-09-21T03:27:21.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.382+0000 7ff8f8ff9640 1 -- 172.21.15.105:0/2464277769 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8f4003e00 con 0x7ff8fc155240 2024-09-21T03:27:21.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.382+0000 7ff9022c5640 1 -- 172.21.15.105:0/2464277769 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8fc09afd0 con 0x7ff8fc155240 2024-09-21T03:27:21.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.382+0000 7ff8f8ff9640 1 -- 172.21.15.105:0/2464277769 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f4004d80 con 0x7ff8fc155240 2024-09-21T03:27:21.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.382+0000 7ff9022c5640 1 -- 172.21.15.105:0/2464277769 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8fc09b9e0 con 0x7ff8fc155240 2024-09-21T03:27:21.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.383+0000 7ff9022c5640 1 -- 172.21.15.105:0/2464277769 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8fc09ad40 con 0x7ff8fc155240 2024-09-21T03:27:21.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.384+0000 7ff8f8ff9640 1 -- 172.21.15.105:0/2464277769 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff8f401c020 con 0x7ff8fc155240 2024-09-21T03:27:21.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.385+0000 7ff8f8ff9640 1 --2- 172.21.15.105:0/2464277769 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff8e8078b90 0x7ff8e807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:21.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.385+0000 7ff8f8ff9640 1 -- 172.21.15.105:0/2464277769 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5709+0+0 (secure 0 0 0) 0x7ff8f409af80 con 0x7ff8fc155240 2024-09-21T03:27:21.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.385+0000 7ff8fbfff640 1 --2- 172.21.15.105:0/2464277769 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff8e8078b90 0x7ff8e807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:21.388 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.386+0000 7ff8fbfff640 1 --2- 172.21.15.105:0/2464277769 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff8e8078b90 0x7ff8e807b0a0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec033000 tx=0x7ff8fc0cfd90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:21.392 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.389+0000 7ff8f8ff9640 1 -- 172.21.15.105:0/2464277769 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff8f4063450 con 0x7ff8fc155240 2024-09-21T03:27:21.565 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.562+0000 7ff9022c5640 1 -- 172.21.15.105:0/2464277769 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff8fc070180 con 0x7ff8e8078b90 2024-09-21T03:27:21.569 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.567+0000 7ff8f8ff9640 1 -- 172.21.15.105:0/2464277769 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251647 (secure 0 0 0) 0x7ff8ec082710 con 0x7ff8e8078b90 2024-09-21T03:27:21.572 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:27:21.574 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:27:21.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.570+0000 7ff9022c5640 1 -- 172.21.15.105:0/2464277769 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff8e8078b90 msgr2=0x7ff8e807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:21.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.570+0000 7ff9022c5640 1 --2- 172.21.15.105:0/2464277769 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff8e8078b90 0x7ff8e807b0a0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec033000 tx=0x7ff8fc0cfd90 comp rx=0 tx=0).stop 2024-09-21T03:27:21.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.570+0000 7ff9022c5640 1 -- 172.21.15.105:0/2464277769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8fc155240 msgr2=0x7ff8fc156da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:21.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.570+0000 7ff9022c5640 1 --2- 172.21.15.105:0/2464277769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8fc155240 0x7ff8fc156da0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc0ce0e0 tx=0x7ff8f4010ee0 comp rx=0 tx=0).stop 2024-09-21T03:27:21.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.571+0000 7ff9022c5640 1 -- 172.21.15.105:0/2464277769 shutdown_connections 2024-09-21T03:27:21.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.571+0000 7ff9022c5640 1 --2- 172.21.15.105:0/2464277769 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff8e8078b90 0x7ff8e807b0a0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:21.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.571+0000 7ff9022c5640 1 --2- 172.21.15.105:0/2464277769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8fc155240 0x7ff8fc156da0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:21.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.571+0000 7ff9022c5640 1 --2- 172.21.15.105:0/2464277769 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8fc154e30 0x7ff8fc156860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:21.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.571+0000 7ff9022c5640 1 --2- 172.21.15.105:0/2464277769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8e4003a00 0x7ff8fc15c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:21.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.571+0000 7ff9022c5640 1 -- 172.21.15.105:0/2464277769 >> 172.21.15.105:0/2464277769 conn(0x7ff8fc06d7d0 msgr2=0x7ff8fc1591b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:21.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.571+0000 7ff9022c5640 1 -- 172.21.15.105:0/2464277769 shutdown_connections 2024-09-21T03:27:21.576 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.571+0000 7ff9022c5640 1 -- 172.21.15.105:0/2464277769 wait complete. 2024-09-21T03:27:21.584 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":406,"stamp":"2024-09-21T03:27:21.423079+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":272680,"kb_used_data":14812,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754702040,"statfs":{"total":773094113280,"available":772814888960,"internally_reserved":0,"allocated":15167488,"data_stored":7156054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.870896"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583647+0000","last_change":"2024-09-21T03:27:17.581755+0000","last_active":"2024-09-21T03:27:18.583647+0000","last_peered":"2024-09-21T03:27:18.583647+0000","last_clean":"2024-09-21T03:27:18.583647+0000","last_became_active":"2024-09-21T03:27:17.581133+0000","last_became_peered":"2024-09-21T03:27:17.581133+0000","last_unstale":"2024-09-21T03:27:18.583647+0000","last_undegraded":"2024-09-21T03:27:18.583647+0000","last_fullsized":"2024-09-21T03:27:18.583647+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:43.005587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.586375+0000","last_change":"2024-09-21T03:27:17.573023+0000","last_active":"2024-09-21T03:27:18.586375+0000","last_peered":"2024-09-21T03:27:18.586375+0000","last_clean":"2024-09-21T03:27:18.586375+0000","last_became_active":"2024-09-21T03:27:17.572695+0000","last_became_peered":"2024-09-21T03:27:17.572695+0000","last_unstale":"2024-09-21T03:27:18.586375+0000","last_undegraded":"2024-09-21T03:27:18.586375+0000","last_fullsized":"2024-09-21T03:27:18.586375+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:03.003218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.592496+0000","last_change":"2024-09-21T03:27:17.586788+0000","last_active":"2024-09-21T03:27:17.592496+0000","last_peered":"2024-09-21T03:27:17.592496+0000","last_clean":"2024-09-21T03:27:17.592496+0000","last_became_active":"2024-09-21T03:27:17.586413+0000","last_became_peered":"2024-09-21T03:27:17.586413+0000","last_unstale":"2024-09-21T03:27:17.592496+0000","last_undegraded":"2024-09-21T03:27:17.592496+0000","last_fullsized":"2024-09-21T03:27:17.592496+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:13.401161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.584595+0000","last_change":"2024-09-21T03:27:17.580965+0000","last_active":"2024-09-21T03:27:17.584595+0000","last_peered":"2024-09-21T03:27:17.584595+0000","last_clean":"2024-09-21T03:27:17.584595+0000","last_became_active":"2024-09-21T03:27:17.580581+0000","last_became_peered":"2024-09-21T03:27:17.580581+0000","last_unstale":"2024-09-21T03:27:17.584595+0000","last_undegraded":"2024-09-21T03:27:17.584595+0000","last_fullsized":"2024-09-21T03:27:17.584595+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:34.308409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.586111+0000","last_change":"2024-09-21T03:27:17.585238+0000","last_active":"2024-09-21T03:27:18.586111+0000","last_peered":"2024-09-21T03:27:18.586111+0000","last_clean":"2024-09-21T03:27:18.586111+0000","last_became_active":"2024-09-21T03:27:17.583972+0000","last_became_peered":"2024-09-21T03:27:17.583972+0000","last_unstale":"2024-09-21T03:27:18.586111+0000","last_undegraded":"2024-09-21T03:27:18.586111+0000","last_fullsized":"2024-09-21T03:27:18.586111+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:29.413682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.584474+0000","last_change":"2024-09-21T03:27:17.580318+0000","last_active":"2024-09-21T03:27:17.584474+0000","last_peered":"2024-09-21T03:27:17.584474+0000","last_clean":"2024-09-21T03:27:17.584474+0000","last_became_active":"2024-09-21T03:27:17.580006+0000","last_became_peered":"2024-09-21T03:27:17.580006+0000","last_unstale":"2024-09-21T03:27:17.584474+0000","last_undegraded":"2024-09-21T03:27:17.584474+0000","last_fullsized":"2024-09-21T03:27:17.584474+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:45:23.305894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-21T03:27:16.570177+0000","last_change":"2024-09-21T03:27:16.570177+0000","last_active":"2024-09-21T03:27:16.550895+0000","last_peered":"2024-09-21T03:27:16.550895+0000","last_clean":"2024-09-21T03:27:16.550895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:27:16.570177+0000","last_undegraded":"2024-09-21T03:27:16.570177+0000","last_fullsized":"2024-09-21T03:27:16.570177+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585808+0000","last_change":"2024-09-21T03:27:17.586097+0000","last_active":"2024-09-21T03:27:18.585808+0000","last_peered":"2024-09-21T03:27:18.585808+0000","last_clean":"2024-09-21T03:27:18.585808+0000","last_became_active":"2024-09-21T03:27:17.585734+0000","last_became_peered":"2024-09-21T03:27:17.585734+0000","last_unstale":"2024-09-21T03:27:18.585808+0000","last_undegraded":"2024-09-21T03:27:18.585808+0000","last_fullsized":"2024-09-21T03:27:18.585808+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:21:44.303210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.586651+0000","last_change":"2024-09-21T03:27:17.586773+0000","last_active":"2024-09-21T03:27:18.586651+0000","last_peered":"2024-09-21T03:27:18.586651+0000","last_clean":"2024-09-21T03:27:18.586651+0000","last_became_active":"2024-09-21T03:27:17.586439+0000","last_became_peered":"2024-09-21T03:27:17.586439+0000","last_unstale":"2024-09-21T03:27:18.586651+0000","last_undegraded":"2024-09-21T03:27:18.586651+0000","last_fullsized":"2024-09-21T03:27:18.586651+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:34.474168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.586400+0000","last_change":"2024-09-21T03:27:17.577732+0000","last_active":"2024-09-21T03:27:18.586400+0000","last_peered":"2024-09-21T03:27:18.586400+0000","last_clean":"2024-09-21T03:27:18.586400+0000","last_became_active":"2024-09-21T03:27:17.577442+0000","last_became_peered":"2024-09-21T03:27:17.577442+0000","last_unstale":"2024-09-21T03:27:18.586400+0000","last_undegraded":"2024-09-21T03:27:18.586400+0000","last_fullsized":"2024-09-21T03:27:18.586400+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:18:21.010195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.586106+0000","last_change":"2024-09-21T03:27:17.585024+0000","last_active":"2024-09-21T03:27:18.586106+0000","last_peered":"2024-09-21T03:27:18.586106+0000","last_clean":"2024-09-21T03:27:18.586106+0000","last_became_active":"2024-09-21T03:27:17.584681+0000","last_became_peered":"2024-09-21T03:27:17.584681+0000","last_unstale":"2024-09-21T03:27:18.586106+0000","last_undegraded":"2024-09-21T03:27:18.586106+0000","last_fullsized":"2024-09-21T03:27:18.586106+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:16.877998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.586553+0000","last_change":"2024-09-21T03:27:17.573714+0000","last_active":"2024-09-21T03:27:18.586553+0000","last_peered":"2024-09-21T03:27:18.586553+0000","last_clean":"2024-09-21T03:27:18.586553+0000","last_became_active":"2024-09-21T03:27:17.573344+0000","last_became_peered":"2024-09-21T03:27:17.573344+0000","last_unstale":"2024-09-21T03:27:18.586553+0000","last_undegraded":"2024-09-21T03:27:18.586553+0000","last_fullsized":"2024-09-21T03:27:18.586553+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:16:50.560426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.583400+0000","last_change":"2024-09-21T03:27:17.580024+0000","last_active":"2024-09-21T03:27:17.583400+0000","last_peered":"2024-09-21T03:27:17.583400+0000","last_clean":"2024-09-21T03:27:17.583400+0000","last_became_active":"2024-09-21T03:27:17.579693+0000","last_became_peered":"2024-09-21T03:27:17.579693+0000","last_unstale":"2024-09-21T03:27:17.583400+0000","last_undegraded":"2024-09-21T03:27:17.583400+0000","last_fullsized":"2024-09-21T03:27:17.583400+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:27:17.606293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.579208+0000","last_change":"2024-09-21T03:27:17.573051+0000","last_active":"2024-09-21T03:27:17.579208+0000","last_peered":"2024-09-21T03:27:17.579208+0000","last_clean":"2024-09-21T03:27:17.579208+0000","last_became_active":"2024-09-21T03:27:17.572714+0000","last_became_peered":"2024-09-21T03:27:17.572714+0000","last_unstale":"2024-09-21T03:27:17.579208+0000","last_undegraded":"2024-09-21T03:27:17.579208+0000","last_fullsized":"2024-09-21T03:27:17.579208+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:31.027265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583130+0000","last_change":"2024-09-21T03:27:17.581234+0000","last_active":"2024-09-21T03:27:18.583130+0000","last_peered":"2024-09-21T03:27:18.583130+0000","last_clean":"2024-09-21T03:27:18.583130+0000","last_became_active":"2024-09-21T03:27:17.580865+0000","last_became_peered":"2024-09-21T03:27:17.580865+0000","last_unstale":"2024-09-21T03:27:18.583130+0000","last_undegraded":"2024-09-21T03:27:18.583130+0000","last_fullsized":"2024-09-21T03:27:18.583130+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:29:44.168728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-21T03:27:16.569726+0000","last_change":"2024-09-21T03:27:16.569726+0000","last_active":"2024-09-21T03:27:16.550895+0000","last_peered":"2024-09-21T03:27:16.550895+0000","last_clean":"2024-09-21T03:27:16.550895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:27:16.569726+0000","last_undegraded":"2024-09-21T03:27:16.569726+0000","last_fullsized":"2024-09-21T03:27:16.569726+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.587675+0000","last_change":"2024-09-21T03:27:17.585074+0000","last_active":"2024-09-21T03:27:17.587675+0000","last_peered":"2024-09-21T03:27:17.587675+0000","last_clean":"2024-09-21T03:27:17.587675+0000","last_became_active":"2024-09-21T03:27:17.584763+0000","last_became_peered":"2024-09-21T03:27:17.584763+0000","last_unstale":"2024-09-21T03:27:17.587675+0000","last_undegraded":"2024-09-21T03:27:17.587675+0000","last_fullsized":"2024-09-21T03:27:17.587675+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:16:05.884637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.581363+0000","last_change":"2024-09-21T03:27:17.576376+0000","last_active":"2024-09-21T03:27:17.581363+0000","last_peered":"2024-09-21T03:27:17.581363+0000","last_clean":"2024-09-21T03:27:17.581363+0000","last_became_active":"2024-09-21T03:27:17.576094+0000","last_became_peered":"2024-09-21T03:27:17.576094+0000","last_unstale":"2024-09-21T03:27:17.581363+0000","last_undegraded":"2024-09-21T03:27:17.581363+0000","last_fullsized":"2024-09-21T03:27:17.581363+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:56.640317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.588809+0000","last_change":"2024-09-21T03:27:17.585841+0000","last_active":"2024-09-21T03:27:17.588809+0000","last_peered":"2024-09-21T03:27:17.588809+0000","last_clean":"2024-09-21T03:27:17.588809+0000","last_became_active":"2024-09-21T03:27:17.585539+0000","last_became_peered":"2024-09-21T03:27:17.585539+0000","last_unstale":"2024-09-21T03:27:17.588809+0000","last_undegraded":"2024-09-21T03:27:17.588809+0000","last_fullsized":"2024-09-21T03:27:17.588809+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:01.563086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.580419+0000","last_change":"2024-09-21T03:27:17.575335+0000","last_active":"2024-09-21T03:27:17.580419+0000","last_peered":"2024-09-21T03:27:17.580419+0000","last_clean":"2024-09-21T03:27:17.580419+0000","last_became_active":"2024-09-21T03:27:17.573625+0000","last_became_peered":"2024-09-21T03:27:17.573625+0000","last_unstale":"2024-09-21T03:27:17.580419+0000","last_undegraded":"2024-09-21T03:27:17.580419+0000","last_fullsized":"2024-09-21T03:27:17.580419+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:10.758459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.587667+0000","last_change":"2024-09-21T03:27:17.585062+0000","last_active":"2024-09-21T03:27:17.587667+0000","last_peered":"2024-09-21T03:27:17.587667+0000","last_clean":"2024-09-21T03:27:17.587667+0000","last_became_active":"2024-09-21T03:27:17.584730+0000","last_became_peered":"2024-09-21T03:27:17.584730+0000","last_unstale":"2024-09-21T03:27:17.587667+0000","last_undegraded":"2024-09-21T03:27:17.587667+0000","last_fullsized":"2024-09-21T03:27:17.587667+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:16.068461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.586508+0000","last_change":"2024-09-21T03:27:17.577064+0000","last_active":"2024-09-21T03:27:18.586508+0000","last_peered":"2024-09-21T03:27:18.586508+0000","last_clean":"2024-09-21T03:27:18.586508+0000","last_became_active":"2024-09-21T03:27:17.576634+0000","last_became_peered":"2024-09-21T03:27:17.576634+0000","last_unstale":"2024-09-21T03:27:18.586508+0000","last_undegraded":"2024-09-21T03:27:18.586508+0000","last_fullsized":"2024-09-21T03:27:18.586508+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:42.013551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.584371+0000","last_change":"2024-09-21T03:27:17.578564+0000","last_active":"2024-09-21T03:27:17.584371+0000","last_peered":"2024-09-21T03:27:17.584371+0000","last_clean":"2024-09-21T03:27:17.584371+0000","last_became_active":"2024-09-21T03:27:17.578274+0000","last_became_peered":"2024-09-21T03:27:17.578274+0000","last_unstale":"2024-09-21T03:27:17.584371+0000","last_undegraded":"2024-09-21T03:27:17.584371+0000","last_fullsized":"2024-09-21T03:27:17.584371+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:05.868201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585847+0000","last_change":"2024-09-21T03:27:17.582077+0000","last_active":"2024-09-21T03:27:18.585847+0000","last_peered":"2024-09-21T03:27:18.585847+0000","last_clean":"2024-09-21T03:27:18.585847+0000","last_became_active":"2024-09-21T03:27:17.581735+0000","last_became_peered":"2024-09-21T03:27:17.581735+0000","last_unstale":"2024-09-21T03:27:18.585847+0000","last_undegraded":"2024-09-21T03:27:18.585847+0000","last_fullsized":"2024-09-21T03:27:18.585847+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:03.545497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.592798+0000","last_change":"2024-09-21T03:27:17.585639+0000","last_active":"2024-09-21T03:27:17.592798+0000","last_peered":"2024-09-21T03:27:17.592798+0000","last_clean":"2024-09-21T03:27:17.592798+0000","last_became_active":"2024-09-21T03:27:17.585334+0000","last_became_peered":"2024-09-21T03:27:17.585334+0000","last_unstale":"2024-09-21T03:27:17.592798+0000","last_undegraded":"2024-09-21T03:27:17.592798+0000","last_fullsized":"2024-09-21T03:27:17.592798+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:41.702167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-21T03:27:16.569388+0000","last_change":"2024-09-21T03:27:16.569388+0000","last_active":"2024-09-21T03:27:16.550895+0000","last_peered":"2024-09-21T03:27:16.550895+0000","last_clean":"2024-09-21T03:27:16.550895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:27:16.569388+0000","last_undegraded":"2024-09-21T03:27:16.569388+0000","last_fullsized":"2024-09-21T03:27:16.569388+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.592458+0000","last_change":"2024-09-21T03:27:17.584543+0000","last_active":"2024-09-21T03:27:17.592458+0000","last_peered":"2024-09-21T03:27:17.592458+0000","last_clean":"2024-09-21T03:27:17.592458+0000","last_became_active":"2024-09-21T03:27:17.584163+0000","last_became_peered":"2024-09-21T03:27:17.584163+0000","last_unstale":"2024-09-21T03:27:17.592458+0000","last_undegraded":"2024-09-21T03:27:17.592458+0000","last_fullsized":"2024-09-21T03:27:17.592458+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:59:25.012491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.586980+0000","last_change":"2024-09-21T03:27:17.584109+0000","last_active":"2024-09-21T03:27:17.586980+0000","last_peered":"2024-09-21T03:27:17.586980+0000","last_clean":"2024-09-21T03:27:17.586980+0000","last_became_active":"2024-09-21T03:27:17.583795+0000","last_became_peered":"2024-09-21T03:27:17.583795+0000","last_unstale":"2024-09-21T03:27:17.586980+0000","last_undegraded":"2024-09-21T03:27:17.586980+0000","last_fullsized":"2024-09-21T03:27:17.586980+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:02:40.150497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.592602+0000","last_change":"2024-09-21T03:27:17.584726+0000","last_active":"2024-09-21T03:27:17.592602+0000","last_peered":"2024-09-21T03:27:17.592602+0000","last_clean":"2024-09-21T03:27:17.592602+0000","last_became_active":"2024-09-21T03:27:17.584401+0000","last_became_peered":"2024-09-21T03:27:17.584401+0000","last_unstale":"2024-09-21T03:27:17.592602+0000","last_undegraded":"2024-09-21T03:27:17.592602+0000","last_fullsized":"2024-09-21T03:27:17.592602+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:47:17.066223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585339+0000","last_change":"2024-09-21T03:27:17.583387+0000","last_active":"2024-09-21T03:27:18.585339+0000","last_peered":"2024-09-21T03:27:18.585339+0000","last_clean":"2024-09-21T03:27:18.585339+0000","last_became_active":"2024-09-21T03:27:17.582898+0000","last_became_peered":"2024-09-21T03:27:17.582898+0000","last_unstale":"2024-09-21T03:27:18.585339+0000","last_undegraded":"2024-09-21T03:27:18.585339+0000","last_fullsized":"2024-09-21T03:27:18.585339+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:42.013551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.584662+0000","last_change":"2024-09-21T03:27:17.592422+0000","last_active":"2024-09-21T03:27:18.584662+0000","last_peered":"2024-09-21T03:27:18.584662+0000","last_clean":"2024-09-21T03:27:18.584662+0000","last_became_active":"2024-09-21T03:27:17.592093+0000","last_became_peered":"2024-09-21T03:27:17.592093+0000","last_unstale":"2024-09-21T03:27:18.584662+0000","last_undegraded":"2024-09-21T03:27:18.584662+0000","last_fullsized":"2024-09-21T03:27:18.584662+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:06:13.764175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.582876+0000","last_change":"2024-09-21T03:27:17.579122+0000","last_active":"2024-09-21T03:27:17.582876+0000","last_peered":"2024-09-21T03:27:17.582876+0000","last_clean":"2024-09-21T03:27:17.582876+0000","last_became_active":"2024-09-21T03:27:17.578841+0000","last_became_peered":"2024-09-21T03:27:17.578841+0000","last_unstale":"2024-09-21T03:27:17.582876+0000","last_undegraded":"2024-09-21T03:27:17.582876+0000","last_fullsized":"2024-09-21T03:27:17.582876+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:17.468257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-21T03:27:16.568441+0000","last_change":"2024-09-21T03:27:16.568441+0000","last_active":"2024-09-21T03:27:16.550895+0000","last_peered":"2024-09-21T03:27:16.550895+0000","last_clean":"2024-09-21T03:27:16.550895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:27:16.568441+0000","last_undegraded":"2024-09-21T03:27:16.568441+0000","last_fullsized":"2024-09-21T03:27:16.568441+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"139'4","reported_seq":19,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583565+0000","last_change":"2024-09-21T03:27:16.581015+0000","last_active":"2024-09-21T03:27:18.583565+0000","last_peered":"2024-09-21T03:27:18.583565+0000","last_clean":"2024-09-21T03:27:18.583565+0000","last_became_active":"2024-09-21T03:27:16.580691+0000","last_became_peered":"2024-09-21T03:27:16.580691+0000","last_unstale":"2024-09-21T03:27:18.583565+0000","last_undegraded":"2024-09-21T03:27:18.583565+0000","last_fullsized":"2024-09-21T03:27:18.583565+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:58:11.894626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585350+0000","last_change":"2024-09-21T03:27:17.584425+0000","last_active":"2024-09-21T03:27:18.585350+0000","last_peered":"2024-09-21T03:27:18.585350+0000","last_clean":"2024-09-21T03:27:18.585350+0000","last_became_active":"2024-09-21T03:27:17.584118+0000","last_became_peered":"2024-09-21T03:27:17.584118+0000","last_unstale":"2024-09-21T03:27:18.585350+0000","last_undegraded":"2024-09-21T03:27:18.585350+0000","last_fullsized":"2024-09-21T03:27:18.585350+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:51.069144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"139'1","reported_seq":16,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585028+0000","last_change":"2024-09-21T03:27:16.578107+0000","last_active":"2024-09-21T03:27:18.585028+0000","last_peered":"2024-09-21T03:27:18.585028+0000","last_clean":"2024-09-21T03:27:18.585028+0000","last_became_active":"2024-09-21T03:27:16.577745+0000","last_became_peered":"2024-09-21T03:27:16.577745+0000","last_unstale":"2024-09-21T03:27:18.585028+0000","last_undegraded":"2024-09-21T03:27:18.585028+0000","last_fullsized":"2024-09-21T03:27:18.585028+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:38.887631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.587168+0000","last_change":"2024-09-21T03:27:17.582825+0000","last_active":"2024-09-21T03:27:17.587168+0000","last_peered":"2024-09-21T03:27:17.587168+0000","last_clean":"2024-09-21T03:27:17.587168+0000","last_became_active":"2024-09-21T03:27:17.582405+0000","last_became_peered":"2024-09-21T03:27:17.582405+0000","last_unstale":"2024-09-21T03:27:17.587168+0000","last_undegraded":"2024-09-21T03:27:17.587168+0000","last_fullsized":"2024-09-21T03:27:17.587168+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:16.762738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"139'2","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.597455+0000","last_change":"2024-09-21T03:27:16.577605+0000","last_active":"2024-09-21T03:27:17.597455+0000","last_peered":"2024-09-21T03:27:17.597455+0000","last_clean":"2024-09-21T03:27:17.597455+0000","last_became_active":"2024-09-21T03:27:16.577310+0000","last_became_peered":"2024-09-21T03:27:16.577310+0000","last_unstale":"2024-09-21T03:27:17.597455+0000","last_undegraded":"2024-09-21T03:27:17.597455+0000","last_fullsized":"2024-09-21T03:27:17.597455+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:41.413162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.581303+0000","last_change":"2024-09-21T03:27:17.579293+0000","last_active":"2024-09-21T03:27:17.581303+0000","last_peered":"2024-09-21T03:27:17.581303+0000","last_clean":"2024-09-21T03:27:17.581303+0000","last_became_active":"2024-09-21T03:27:17.578780+0000","last_became_peered":"2024-09-21T03:27:17.578780+0000","last_unstale":"2024-09-21T03:27:17.581303+0000","last_undegraded":"2024-09-21T03:27:17.581303+0000","last_fullsized":"2024-09-21T03:27:17.581303+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:13.328076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"139'2","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.597487+0000","last_change":"2024-09-21T03:27:16.574950+0000","last_active":"2024-09-21T03:27:17.597487+0000","last_peered":"2024-09-21T03:27:17.597487+0000","last_clean":"2024-09-21T03:27:17.597487+0000","last_became_active":"2024-09-21T03:27:16.573561+0000","last_became_peered":"2024-09-21T03:27:16.573561+0000","last_unstale":"2024-09-21T03:27:17.597487+0000","last_undegraded":"2024-09-21T03:27:17.597487+0000","last_fullsized":"2024-09-21T03:27:17.597487+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:24.760299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-21T03:27:16.568774+0000","last_change":"2024-09-21T03:27:16.568774+0000","last_active":"2024-09-21T03:27:16.550895+0000","last_peered":"2024-09-21T03:27:16.550895+0000","last_clean":"2024-09-21T03:27:16.550895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:27:16.568774+0000","last_undegraded":"2024-09-21T03:27:16.568774+0000","last_fullsized":"2024-09-21T03:27:16.568774+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"139'1","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.596812+0000","last_change":"2024-09-21T03:27:16.579737+0000","last_active":"2024-09-21T03:27:17.596812+0000","last_peered":"2024-09-21T03:27:17.596812+0000","last_clean":"2024-09-21T03:27:17.596812+0000","last_became_active":"2024-09-21T03:27:16.579428+0000","last_became_peered":"2024-09-21T03:27:16.579428+0000","last_unstale":"2024-09-21T03:27:17.596812+0000","last_undegraded":"2024-09-21T03:27:17.596812+0000","last_fullsized":"2024-09-21T03:27:17.596812+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:02:22.984543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.586953+0000","last_change":"2024-09-21T03:27:17.583627+0000","last_active":"2024-09-21T03:27:17.586953+0000","last_peered":"2024-09-21T03:27:17.586953+0000","last_clean":"2024-09-21T03:27:17.586953+0000","last_became_active":"2024-09-21T03:27:17.583282+0000","last_became_peered":"2024-09-21T03:27:17.583282+0000","last_unstale":"2024-09-21T03:27:17.586953+0000","last_undegraded":"2024-09-21T03:27:17.586953+0000","last_fullsized":"2024-09-21T03:27:17.586953+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:15:39.847481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"139'1","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.597355+0000","last_change":"2024-09-21T03:27:16.574689+0000","last_active":"2024-09-21T03:27:17.597355+0000","last_peered":"2024-09-21T03:27:17.597355+0000","last_clean":"2024-09-21T03:27:17.597355+0000","last_became_active":"2024-09-21T03:27:16.574380+0000","last_became_peered":"2024-09-21T03:27:16.574380+0000","last_unstale":"2024-09-21T03:27:17.597355+0000","last_undegraded":"2024-09-21T03:27:17.597355+0000","last_fullsized":"2024-09-21T03:27:17.597355+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:03.610863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.589621+0000","last_change":"2024-09-21T03:27:17.586684+0000","last_active":"2024-09-21T03:27:17.589621+0000","last_peered":"2024-09-21T03:27:17.589621+0000","last_clean":"2024-09-21T03:27:17.589621+0000","last_became_active":"2024-09-21T03:27:17.586407+0000","last_became_peered":"2024-09-21T03:27:17.586407+0000","last_unstale":"2024-09-21T03:27:17.589621+0000","last_undegraded":"2024-09-21T03:27:17.589621+0000","last_fullsized":"2024-09-21T03:27:17.589621+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:18:37.794112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585775+0000","last_change":"2024-09-21T03:27:16.574797+0000","last_active":"2024-09-21T03:27:18.585775+0000","last_peered":"2024-09-21T03:27:18.585775+0000","last_clean":"2024-09-21T03:27:18.585775+0000","last_became_active":"2024-09-21T03:27:16.574469+0000","last_became_peered":"2024-09-21T03:27:16.574469+0000","last_unstale":"2024-09-21T03:27:18.585775+0000","last_undegraded":"2024-09-21T03:27:18.585775+0000","last_fullsized":"2024-09-21T03:27:18.585775+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:12.431154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.579396+0000","last_change":"2024-09-21T03:27:17.576792+0000","last_active":"2024-09-21T03:27:17.579396+0000","last_peered":"2024-09-21T03:27:17.579396+0000","last_clean":"2024-09-21T03:27:17.579396+0000","last_became_active":"2024-09-21T03:27:17.576477+0000","last_became_peered":"2024-09-21T03:27:17.576477+0000","last_unstale":"2024-09-21T03:27:17.579396+0000","last_undegraded":"2024-09-21T03:27:17.579396+0000","last_fullsized":"2024-09-21T03:27:17.579396+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:02:44.799481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-21T03:27:16.581906+0000","last_change":"2024-09-21T03:27:16.578176+0000","last_active":"2024-09-21T03:27:16.581906+0000","last_peered":"2024-09-21T03:27:16.581906+0000","last_clean":"2024-09-21T03:27:16.581906+0000","last_became_active":"2024-09-21T03:27:16.577886+0000","last_became_peered":"2024-09-21T03:27:16.577886+0000","last_unstale":"2024-09-21T03:27:16.581906+0000","last_undegraded":"2024-09-21T03:27:16.581906+0000","last_fullsized":"2024-09-21T03:27:16.581906+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:29:46.791624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.581935+0000","last_change":"2024-09-21T03:27:17.577247+0000","last_active":"2024-09-21T03:27:17.581935+0000","last_peered":"2024-09-21T03:27:17.581935+0000","last_clean":"2024-09-21T03:27:17.581935+0000","last_became_active":"2024-09-21T03:27:17.576950+0000","last_became_peered":"2024-09-21T03:27:17.576950+0000","last_unstale":"2024-09-21T03:27:17.581935+0000","last_undegraded":"2024-09-21T03:27:17.581935+0000","last_fullsized":"2024-09-21T03:27:17.581935+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:16.951026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.572137+0000","last_change":"2024-09-21T03:27:16.578096+0000","last_active":"2024-09-21T03:27:17.572137+0000","last_peered":"2024-09-21T03:27:17.572137+0000","last_clean":"2024-09-21T03:27:17.572137+0000","last_became_active":"2024-09-21T03:27:16.577770+0000","last_became_peered":"2024-09-21T03:27:16.577770+0000","last_unstale":"2024-09-21T03:27:17.572137+0000","last_undegraded":"2024-09-21T03:27:17.572137+0000","last_fullsized":"2024-09-21T03:27:17.572137+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:54.303412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.581766+0000","last_change":"2024-09-21T03:27:17.577763+0000","last_active":"2024-09-21T03:27:17.581766+0000","last_peered":"2024-09-21T03:27:17.581766+0000","last_clean":"2024-09-21T03:27:17.581766+0000","last_became_active":"2024-09-21T03:27:17.577479+0000","last_became_peered":"2024-09-21T03:27:17.577479+0000","last_unstale":"2024-09-21T03:27:17.581766+0000","last_undegraded":"2024-09-21T03:27:17.581766+0000","last_fullsized":"2024-09-21T03:27:17.581766+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:56:15.766800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"139'3","reported_seq":16,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.596848+0000","last_change":"2024-09-21T03:27:16.577153+0000","last_active":"2024-09-21T03:27:17.596848+0000","last_peered":"2024-09-21T03:27:17.596848+0000","last_clean":"2024-09-21T03:27:17.596848+0000","last_became_active":"2024-09-21T03:27:16.576867+0000","last_became_peered":"2024-09-21T03:27:16.576867+0000","last_unstale":"2024-09-21T03:27:17.596848+0000","last_undegraded":"2024-09-21T03:27:17.596848+0000","last_fullsized":"2024-09-21T03:27:17.596848+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:46.573583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585356+0000","last_change":"2024-09-21T03:27:17.583787+0000","last_active":"2024-09-21T03:27:18.585356+0000","last_peered":"2024-09-21T03:27:18.585356+0000","last_clean":"2024-09-21T03:27:18.585356+0000","last_became_active":"2024-09-21T03:27:17.583260+0000","last_became_peered":"2024-09-21T03:27:17.583260+0000","last_unstale":"2024-09-21T03:27:18.585356+0000","last_undegraded":"2024-09-21T03:27:18.585356+0000","last_fullsized":"2024-09-21T03:27:18.585356+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:51.228873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"139'6","reported_seq":21,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.584840+0000","last_change":"2024-09-21T03:27:16.571658+0000","last_active":"2024-09-21T03:27:18.584840+0000","last_peered":"2024-09-21T03:27:18.584840+0000","last_clean":"2024-09-21T03:27:18.584840+0000","last_became_active":"2024-09-21T03:27:16.571305+0000","last_became_peered":"2024-09-21T03:27:16.571305+0000","last_unstale":"2024-09-21T03:27:18.584840+0000","last_undegraded":"2024-09-21T03:27:18.584840+0000","last_fullsized":"2024-09-21T03:27:18.584840+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:30.379967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.578257+0000","last_change":"2024-09-21T03:27:17.573089+0000","last_active":"2024-09-21T03:27:17.578257+0000","last_peered":"2024-09-21T03:27:17.578257+0000","last_clean":"2024-09-21T03:27:17.578257+0000","last_became_active":"2024-09-21T03:27:17.572836+0000","last_became_peered":"2024-09-21T03:27:17.572836+0000","last_unstale":"2024-09-21T03:27:17.578257+0000","last_undegraded":"2024-09-21T03:27:17.578257+0000","last_fullsized":"2024-09-21T03:27:17.578257+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:44.827317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"139'2","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.597889+0000","last_change":"2024-09-21T03:27:16.572761+0000","last_active":"2024-09-21T03:27:17.597889+0000","last_peered":"2024-09-21T03:27:17.597889+0000","last_clean":"2024-09-21T03:27:17.597889+0000","last_became_active":"2024-09-21T03:27:16.572470+0000","last_became_peered":"2024-09-21T03:27:16.572470+0000","last_unstale":"2024-09-21T03:27:17.597889+0000","last_undegraded":"2024-09-21T03:27:17.597889+0000","last_fullsized":"2024-09-21T03:27:17.597889+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:40.398460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-21T03:27:16.567064+0000","last_change":"2024-09-21T03:27:16.567064+0000","last_active":"2024-09-21T03:27:16.550895+0000","last_peered":"2024-09-21T03:27:16.550895+0000","last_clean":"2024-09-21T03:27:16.550895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:27:16.567064+0000","last_undegraded":"2024-09-21T03:27:16.567064+0000","last_fullsized":"2024-09-21T03:27:16.567064+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.566307+0000","last_change":"2024-09-21T03:27:16.574985+0000","last_active":"2024-09-21T03:27:17.566307+0000","last_peered":"2024-09-21T03:27:17.566307+0000","last_clean":"2024-09-21T03:27:17.566307+0000","last_became_active":"2024-09-21T03:27:16.574650+0000","last_became_peered":"2024-09-21T03:27:16.574650+0000","last_unstale":"2024-09-21T03:27:17.566307+0000","last_undegraded":"2024-09-21T03:27:17.566307+0000","last_fullsized":"2024-09-21T03:27:17.566307+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:00.204114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.590179+0000","last_change":"2024-09-21T03:27:17.589346+0000","last_active":"2024-09-21T03:27:17.590179+0000","last_peered":"2024-09-21T03:27:17.590179+0000","last_clean":"2024-09-21T03:27:17.590179+0000","last_became_active":"2024-09-21T03:27:17.589034+0000","last_became_peered":"2024-09-21T03:27:17.589034+0000","last_unstale":"2024-09-21T03:27:17.590179+0000","last_undegraded":"2024-09-21T03:27:17.590179+0000","last_fullsized":"2024-09-21T03:27:17.590179+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:21:44.303210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.574173+0000","last_change":"2024-09-21T03:27:16.576083+0000","last_active":"2024-09-21T03:27:17.574173+0000","last_peered":"2024-09-21T03:27:17.574173+0000","last_clean":"2024-09-21T03:27:17.574173+0000","last_became_active":"2024-09-21T03:27:16.575789+0000","last_became_peered":"2024-09-21T03:27:16.575789+0000","last_unstale":"2024-09-21T03:27:17.574173+0000","last_undegraded":"2024-09-21T03:27:17.574173+0000","last_fullsized":"2024-09-21T03:27:17.574173+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:35.838462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.580459+0000","last_change":"2024-09-21T03:27:17.576643+0000","last_active":"2024-09-21T03:27:17.580459+0000","last_peered":"2024-09-21T03:27:17.580459+0000","last_clean":"2024-09-21T03:27:17.580459+0000","last_became_active":"2024-09-21T03:27:17.576339+0000","last_became_peered":"2024-09-21T03:27:17.576339+0000","last_unstale":"2024-09-21T03:27:17.580459+0000","last_undegraded":"2024-09-21T03:27:17.580459+0000","last_fullsized":"2024-09-21T03:27:17.580459+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:41.117745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"139'8","reported_seq":23,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.584534+0000","last_change":"2024-09-21T03:27:16.574966+0000","last_active":"2024-09-21T03:27:18.584534+0000","last_peered":"2024-09-21T03:27:18.584534+0000","last_clean":"2024-09-21T03:27:18.584534+0000","last_became_active":"2024-09-21T03:27:16.573876+0000","last_became_peered":"2024-09-21T03:27:16.573876+0000","last_unstale":"2024-09-21T03:27:18.584534+0000","last_undegraded":"2024-09-21T03:27:18.584534+0000","last_fullsized":"2024-09-21T03:27:18.584534+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:27.555326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.578547+0000","last_change":"2024-09-21T03:27:17.577237+0000","last_active":"2024-09-21T03:27:17.578547+0000","last_peered":"2024-09-21T03:27:17.578547+0000","last_clean":"2024-09-21T03:27:17.578547+0000","last_became_active":"2024-09-21T03:27:17.576428+0000","last_became_peered":"2024-09-21T03:27:17.576428+0000","last_unstale":"2024-09-21T03:27:17.578547+0000","last_undegraded":"2024-09-21T03:27:17.578547+0000","last_fullsized":"2024-09-21T03:27:17.578547+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:50:28.451810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"139'1","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.594994+0000","last_change":"2024-09-21T03:27:16.580043+0000","last_active":"2024-09-21T03:27:17.594994+0000","last_peered":"2024-09-21T03:27:17.594994+0000","last_clean":"2024-09-21T03:27:17.594994+0000","last_became_active":"2024-09-21T03:27:16.579642+0000","last_became_peered":"2024-09-21T03:27:16.579642+0000","last_unstale":"2024-09-21T03:27:17.594994+0000","last_undegraded":"2024-09-21T03:27:17.594994+0000","last_fullsized":"2024-09-21T03:27:17.594994+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:43.548214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.590698+0000","last_change":"2024-09-21T03:27:17.588315+0000","last_active":"2024-09-21T03:27:17.590698+0000","last_peered":"2024-09-21T03:27:17.590698+0000","last_clean":"2024-09-21T03:27:17.590698+0000","last_became_active":"2024-09-21T03:27:17.587763+0000","last_became_peered":"2024-09-21T03:27:17.587763+0000","last_unstale":"2024-09-21T03:27:17.590698+0000","last_undegraded":"2024-09-21T03:27:17.590698+0000","last_fullsized":"2024-09-21T03:27:17.590698+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:24.863592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"139'2","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.597586+0000","last_change":"2024-09-21T03:27:16.576595+0000","last_active":"2024-09-21T03:27:17.597586+0000","last_peered":"2024-09-21T03:27:17.597586+0000","last_clean":"2024-09-21T03:27:17.597586+0000","last_became_active":"2024-09-21T03:27:16.576288+0000","last_became_peered":"2024-09-21T03:27:16.576288+0000","last_unstale":"2024-09-21T03:27:17.597586+0000","last_undegraded":"2024-09-21T03:27:17.597586+0000","last_fullsized":"2024-09-21T03:27:17.597586+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:34.408303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.586957+0000","last_change":"2024-09-21T03:27:17.583424+0000","last_active":"2024-09-21T03:27:17.586957+0000","last_peered":"2024-09-21T03:27:17.586957+0000","last_clean":"2024-09-21T03:27:17.586957+0000","last_became_active":"2024-09-21T03:27:17.583133+0000","last_became_peered":"2024-09-21T03:27:17.583133+0000","last_unstale":"2024-09-21T03:27:17.586957+0000","last_undegraded":"2024-09-21T03:27:17.586957+0000","last_fullsized":"2024-09-21T03:27:17.586957+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:40.948966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"139'1","reported_seq":16,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583389+0000","last_change":"2024-09-21T03:27:16.580912+0000","last_active":"2024-09-21T03:27:18.583389+0000","last_peered":"2024-09-21T03:27:18.583389+0000","last_clean":"2024-09-21T03:27:18.583389+0000","last_became_active":"2024-09-21T03:27:16.580592+0000","last_became_peered":"2024-09-21T03:27:16.580592+0000","last_unstale":"2024-09-21T03:27:18.583389+0000","last_undegraded":"2024-09-21T03:27:18.583389+0000","last_fullsized":"2024-09-21T03:27:18.583389+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:41.558318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-21T03:27:16.566043+0000","last_change":"2024-09-21T03:27:16.566043+0000","last_active":"2024-09-21T03:27:16.550895+0000","last_peered":"2024-09-21T03:27:16.550895+0000","last_clean":"2024-09-21T03:27:16.550895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:27:16.566043+0000","last_undegraded":"2024-09-21T03:27:16.566043+0000","last_fullsized":"2024-09-21T03:27:16.566043+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583564+0000","last_change":"2024-09-21T03:27:16.576719+0000","last_active":"2024-09-21T03:27:18.583564+0000","last_peered":"2024-09-21T03:27:18.583564+0000","last_clean":"2024-09-21T03:27:18.583564+0000","last_became_active":"2024-09-21T03:27:16.576402+0000","last_became_peered":"2024-09-21T03:27:16.576402+0000","last_unstale":"2024-09-21T03:27:18.583564+0000","last_undegraded":"2024-09-21T03:27:18.583564+0000","last_fullsized":"2024-09-21T03:27:18.583564+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:41.780927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.580875+0000","last_change":"2024-09-21T03:27:17.578483+0000","last_active":"2024-09-21T03:27:17.580875+0000","last_peered":"2024-09-21T03:27:17.580875+0000","last_clean":"2024-09-21T03:27:17.580875+0000","last_became_active":"2024-09-21T03:27:17.578151+0000","last_became_peered":"2024-09-21T03:27:17.578151+0000","last_unstale":"2024-09-21T03:27:17.580875+0000","last_undegraded":"2024-09-21T03:27:17.580875+0000","last_fullsized":"2024-09-21T03:27:17.580875+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:16.441422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"139'2","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.597788+0000","last_change":"2024-09-21T03:27:16.577952+0000","last_active":"2024-09-21T03:27:17.597788+0000","last_peered":"2024-09-21T03:27:17.597788+0000","last_clean":"2024-09-21T03:27:17.597788+0000","last_became_active":"2024-09-21T03:27:16.576576+0000","last_became_peered":"2024-09-21T03:27:16.576576+0000","last_unstale":"2024-09-21T03:27:17.597788+0000","last_undegraded":"2024-09-21T03:27:17.597788+0000","last_fullsized":"2024-09-21T03:27:17.597788+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:12.431154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-21T03:27:16.566345+0000","last_change":"2024-09-21T03:27:16.566345+0000","last_active":"2024-09-21T03:27:16.550895+0000","last_peered":"2024-09-21T03:27:16.550895+0000","last_clean":"2024-09-21T03:27:16.550895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:27:16.566345+0000","last_undegraded":"2024-09-21T03:27:16.566345+0000","last_fullsized":"2024-09-21T03:27:16.566345+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583323+0000","last_change":"2024-09-21T03:27:16.577488+0000","last_active":"2024-09-21T03:27:18.583323+0000","last_peered":"2024-09-21T03:27:18.583323+0000","last_clean":"2024-09-21T03:27:18.583323+0000","last_became_active":"2024-09-21T03:27:16.577197+0000","last_became_peered":"2024-09-21T03:27:16.577197+0000","last_unstale":"2024-09-21T03:27:18.583323+0000","last_undegraded":"2024-09-21T03:27:18.583323+0000","last_fullsized":"2024-09-21T03:27:18.583323+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:17.944770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583365+0000","last_change":"2024-09-21T03:27:17.582910+0000","last_active":"2024-09-21T03:27:18.583365+0000","last_peered":"2024-09-21T03:27:18.583365+0000","last_clean":"2024-09-21T03:27:18.583365+0000","last_became_active":"2024-09-21T03:27:17.582582+0000","last_became_peered":"2024-09-21T03:27:17.582582+0000","last_unstale":"2024-09-21T03:27:18.583365+0000","last_undegraded":"2024-09-21T03:27:18.583365+0000","last_fullsized":"2024-09-21T03:27:18.583365+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:44.083723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.576051+0000","last_change":"2024-09-21T03:27:16.581246+0000","last_active":"2024-09-21T03:27:17.576051+0000","last_peered":"2024-09-21T03:27:17.576051+0000","last_clean":"2024-09-21T03:27:17.576051+0000","last_became_active":"2024-09-21T03:27:16.580919+0000","last_became_peered":"2024-09-21T03:27:16.580919+0000","last_unstale":"2024-09-21T03:27:17.576051+0000","last_undegraded":"2024-09-21T03:27:17.576051+0000","last_fullsized":"2024-09-21T03:27:17.576051+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:25.979160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.579424+0000","last_change":"2024-09-21T03:27:17.577791+0000","last_active":"2024-09-21T03:27:17.579424+0000","last_peered":"2024-09-21T03:27:17.579424+0000","last_clean":"2024-09-21T03:27:17.579424+0000","last_became_active":"2024-09-21T03:27:17.577502+0000","last_became_peered":"2024-09-21T03:27:17.577502+0000","last_unstale":"2024-09-21T03:27:17.579424+0000","last_undegraded":"2024-09-21T03:27:17.579424+0000","last_fullsized":"2024-09-21T03:27:17.579424+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:24.181167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583144+0000","last_change":"2024-09-21T03:27:16.578401+0000","last_active":"2024-09-21T03:27:18.583144+0000","last_peered":"2024-09-21T03:27:18.583144+0000","last_clean":"2024-09-21T03:27:18.583144+0000","last_became_active":"2024-09-21T03:27:16.578077+0000","last_became_peered":"2024-09-21T03:27:16.578077+0000","last_unstale":"2024-09-21T03:27:18.583144+0000","last_undegraded":"2024-09-21T03:27:18.583144+0000","last_fullsized":"2024-09-21T03:27:18.583144+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:44:50.471830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.582932+0000","last_change":"2024-09-21T03:27:17.578316+0000","last_active":"2024-09-21T03:27:17.582932+0000","last_peered":"2024-09-21T03:27:17.582932+0000","last_clean":"2024-09-21T03:27:17.582932+0000","last_became_active":"2024-09-21T03:27:17.578010+0000","last_became_peered":"2024-09-21T03:27:17.578010+0000","last_unstale":"2024-09-21T03:27:17.582932+0000","last_undegraded":"2024-09-21T03:27:17.582932+0000","last_fullsized":"2024-09-21T03:27:17.582932+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:17.101621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"139'2","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.595072+0000","last_change":"2024-09-21T03:27:16.578670+0000","last_active":"2024-09-21T03:27:17.595072+0000","last_peered":"2024-09-21T03:27:17.595072+0000","last_clean":"2024-09-21T03:27:17.595072+0000","last_became_active":"2024-09-21T03:27:16.578359+0000","last_became_peered":"2024-09-21T03:27:16.578359+0000","last_unstale":"2024-09-21T03:27:17.595072+0000","last_undegraded":"2024-09-21T03:27:17.595072+0000","last_fullsized":"2024-09-21T03:27:17.595072+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:52.045055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-21T03:27:16.568429+0000","last_change":"2024-09-21T03:27:16.568429+0000","last_active":"2024-09-21T03:27:16.550895+0000","last_peered":"2024-09-21T03:27:16.550895+0000","last_clean":"2024-09-21T03:27:16.550895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:27:16.568429+0000","last_undegraded":"2024-09-21T03:27:16.568429+0000","last_fullsized":"2024-09-21T03:27:16.568429+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"139'1","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.580468+0000","last_change":"2024-09-21T03:27:16.580402+0000","last_active":"2024-09-21T03:27:18.580468+0000","last_peered":"2024-09-21T03:27:18.580468+0000","last_clean":"2024-09-21T03:27:18.580468+0000","last_became_active":"2024-09-21T03:27:16.580078+0000","last_became_peered":"2024-09-21T03:27:16.580078+0000","last_unstale":"2024-09-21T03:27:18.580468+0000","last_undegraded":"2024-09-21T03:27:18.580468+0000","last_fullsized":"2024-09-21T03:27:18.580468+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:07.923601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.584403+0000","last_change":"2024-09-21T03:27:17.580829+0000","last_active":"2024-09-21T03:27:17.584403+0000","last_peered":"2024-09-21T03:27:17.584403+0000","last_clean":"2024-09-21T03:27:17.584403+0000","last_became_active":"2024-09-21T03:27:17.580540+0000","last_became_peered":"2024-09-21T03:27:17.580540+0000","last_unstale":"2024-09-21T03:27:17.584403+0000","last_undegraded":"2024-09-21T03:27:17.584403+0000","last_fullsized":"2024-09-21T03:27:17.584403+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:00.398615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.586553+0000","last_change":"2024-09-21T03:27:16.574812+0000","last_active":"2024-09-21T03:27:18.586553+0000","last_peered":"2024-09-21T03:27:18.586553+0000","last_clean":"2024-09-21T03:27:18.586553+0000","last_became_active":"2024-09-21T03:27:16.574396+0000","last_became_peered":"2024-09-21T03:27:16.574396+0000","last_unstale":"2024-09-21T03:27:18.586553+0000","last_undegraded":"2024-09-21T03:27:18.586553+0000","last_fullsized":"2024-09-21T03:27:18.586553+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:03.610863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.576793+0000","last_change":"2024-09-21T03:27:17.574712+0000","last_active":"2024-09-21T03:27:17.576793+0000","last_peered":"2024-09-21T03:27:17.576793+0000","last_clean":"2024-09-21T03:27:17.576793+0000","last_became_active":"2024-09-21T03:27:17.574402+0000","last_became_peered":"2024-09-21T03:27:17.574402+0000","last_unstale":"2024-09-21T03:27:17.576793+0000","last_undegraded":"2024-09-21T03:27:17.576793+0000","last_fullsized":"2024-09-21T03:27:17.576793+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:55.408707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.565551+0000","last_change":"2024-09-21T03:27:16.579174+0000","last_active":"2024-09-21T03:27:17.565551+0000","last_peered":"2024-09-21T03:27:17.565551+0000","last_clean":"2024-09-21T03:27:17.565551+0000","last_became_active":"2024-09-21T03:27:16.578865+0000","last_became_peered":"2024-09-21T03:27:16.578865+0000","last_unstale":"2024-09-21T03:27:17.565551+0000","last_undegraded":"2024-09-21T03:27:17.565551+0000","last_fullsized":"2024-09-21T03:27:17.565551+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:23.331344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.581875+0000","last_change":"2024-09-21T03:27:17.578034+0000","last_active":"2024-09-21T03:27:17.581875+0000","last_peered":"2024-09-21T03:27:17.581875+0000","last_clean":"2024-09-21T03:27:17.581875+0000","last_became_active":"2024-09-21T03:27:17.576925+0000","last_became_peered":"2024-09-21T03:27:17.576925+0000","last_unstale":"2024-09-21T03:27:17.581875+0000","last_undegraded":"2024-09-21T03:27:17.581875+0000","last_fullsized":"2024-09-21T03:27:17.581875+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:56.497686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.584884+0000","last_change":"2024-09-21T03:27:16.574672+0000","last_active":"2024-09-21T03:27:18.584884+0000","last_peered":"2024-09-21T03:27:18.584884+0000","last_clean":"2024-09-21T03:27:18.584884+0000","last_became_active":"2024-09-21T03:27:16.573040+0000","last_became_peered":"2024-09-21T03:27:16.573040+0000","last_unstale":"2024-09-21T03:27:18.584884+0000","last_undegraded":"2024-09-21T03:27:18.584884+0000","last_fullsized":"2024-09-21T03:27:18.584884+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:38.629252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585226+0000","last_change":"2024-09-21T03:27:17.591453+0000","last_active":"2024-09-21T03:27:18.585226+0000","last_peered":"2024-09-21T03:27:18.585226+0000","last_clean":"2024-09-21T03:27:18.585226+0000","last_became_active":"2024-09-21T03:27:17.591101+0000","last_became_peered":"2024-09-21T03:27:17.591101+0000","last_unstale":"2024-09-21T03:27:18.585226+0000","last_undegraded":"2024-09-21T03:27:18.585226+0000","last_fullsized":"2024-09-21T03:27:18.585226+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:57.365059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.574722+0000","last_change":"2024-09-21T03:27:16.571816+0000","last_active":"2024-09-21T03:27:17.574722+0000","last_peered":"2024-09-21T03:27:17.574722+0000","last_clean":"2024-09-21T03:27:17.574722+0000","last_became_active":"2024-09-21T03:27:16.571475+0000","last_became_peered":"2024-09-21T03:27:16.571475+0000","last_unstale":"2024-09-21T03:27:17.574722+0000","last_undegraded":"2024-09-21T03:27:17.574722+0000","last_fullsized":"2024-09-21T03:27:17.574722+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:16.998561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-21T03:27:16.566417+0000","last_change":"2024-09-21T03:27:16.566417+0000","last_active":"2024-09-21T03:27:16.550895+0000","last_peered":"2024-09-21T03:27:16.550895+0000","last_clean":"2024-09-21T03:27:16.550895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:27:16.566417+0000","last_undegraded":"2024-09-21T03:27:16.566417+0000","last_fullsized":"2024-09-21T03:27:16.566417+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585945+0000","last_change":"2024-09-21T03:27:16.573639+0000","last_active":"2024-09-21T03:27:18.585945+0000","last_peered":"2024-09-21T03:27:18.585945+0000","last_clean":"2024-09-21T03:27:18.585945+0000","last_became_active":"2024-09-21T03:27:16.573163+0000","last_became_peered":"2024-09-21T03:27:16.573163+0000","last_unstale":"2024-09-21T03:27:18.585945+0000","last_undegraded":"2024-09-21T03:27:18.585945+0000","last_fullsized":"2024-09-21T03:27:18.585945+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:35.838462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.580486+0000","last_change":"2024-09-21T03:27:17.578123+0000","last_active":"2024-09-21T03:27:17.580486+0000","last_peered":"2024-09-21T03:27:17.580486+0000","last_clean":"2024-09-21T03:27:17.580486+0000","last_became_active":"2024-09-21T03:27:17.577792+0000","last_became_peered":"2024-09-21T03:27:17.577792+0000","last_unstale":"2024-09-21T03:27:17.580486+0000","last_undegraded":"2024-09-21T03:27:17.580486+0000","last_fullsized":"2024-09-21T03:27:17.580486+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:27.493816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.584498+0000","last_change":"2024-09-21T03:27:16.574180+0000","last_active":"2024-09-21T03:27:18.584498+0000","last_peered":"2024-09-21T03:27:18.584498+0000","last_clean":"2024-09-21T03:27:18.584498+0000","last_became_active":"2024-09-21T03:27:16.573439+0000","last_became_peered":"2024-09-21T03:27:16.573439+0000","last_unstale":"2024-09-21T03:27:18.584498+0000","last_undegraded":"2024-09-21T03:27:18.584498+0000","last_fullsized":"2024-09-21T03:27:18.584498+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:36.525290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.582958+0000","last_change":"2024-09-21T03:27:17.578054+0000","last_active":"2024-09-21T03:27:17.582958+0000","last_peered":"2024-09-21T03:27:17.582958+0000","last_clean":"2024-09-21T03:27:17.582958+0000","last_became_active":"2024-09-21T03:27:17.577746+0000","last_became_peered":"2024-09-21T03:27:17.577746+0000","last_unstale":"2024-09-21T03:27:17.582958+0000","last_undegraded":"2024-09-21T03:27:17.582958+0000","last_fullsized":"2024-09-21T03:27:17.582958+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:14.491408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585346+0000","last_change":"2024-09-21T03:27:16.575356+0000","last_active":"2024-09-21T03:27:18.585346+0000","last_peered":"2024-09-21T03:27:18.585346+0000","last_clean":"2024-09-21T03:27:18.585346+0000","last_became_active":"2024-09-21T03:27:16.574933+0000","last_became_peered":"2024-09-21T03:27:16.574933+0000","last_unstale":"2024-09-21T03:27:18.585346+0000","last_undegraded":"2024-09-21T03:27:18.585346+0000","last_fullsized":"2024-09-21T03:27:18.585346+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:11.636922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":334,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583233+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:27:18.583233+0000","last_peered":"2024-09-21T03:27:18.583233+0000","last_clean":"2024-09-21T03:27:18.583233+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:27:18.583233+0000","last_undegraded":"2024-09-21T03:27:18.583233+0000","last_fullsized":"2024-09-21T03:27:18.583233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509553,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33512,"kb_used_data":2316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338328,"statfs":{"total":96636764160,"available":96602447872,"internally_reserved":0,"allocated":2371584,"data_stored":1346178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509552,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32900,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338940,"statfs":{"total":96636764160,"available":96603074560,"internally_reserved":0,"allocated":1744896,"data_stored":747178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509551,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32904,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338936,"statfs":{"total":96636764160,"available":96603070464,"internally_reserved":0,"allocated":1748992,"data_stored":747760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509551,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32912,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338928,"statfs":{"total":96636764160,"available":96603062272,"internally_reserved":0,"allocated":1757184,"data_stored":748838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509552,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32896,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338944,"statfs":{"total":96636764160,"available":96603078656,"internally_reserved":0,"allocated":1744896,"data_stored":747190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509552,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37056,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334784,"statfs":{"total":96636764160,"available":96598818816,"internally_reserved":0,"allocated":1744896,"data_stored":747246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509552,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37056,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334784,"statfs":{"total":96636764160,"available":96598818816,"internally_reserved":0,"allocated":1744896,"data_stored":747190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574959,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33444,"kb_used_data":2256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338396,"statfs":{"total":96636764160,"available":96602517504,"internally_reserved":0,"allocated":2310144,"data_stored":1324474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:27:21.589 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:27:21.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.734+0000 7f5a3fabd640 1 -- 172.21.15.105:0/1273354756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a3806cde0 msgr2=0x7f5a3806d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:21.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.734+0000 7f5a3fabd640 1 --2- 172.21.15.105:0/1273354756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a3806cde0 0x7f5a3806d1f0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f5a28005fd0 tx=0x7f5a2802a4a0 comp rx=0 tx=0).stop 2024-09-21T03:27:21.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.734+0000 7f5a3fabd640 1 -- 172.21.15.105:0/1273354756 shutdown_connections 2024-09-21T03:27:21.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.734+0000 7f5a3fabd640 1 --2- 172.21.15.105:0/1273354756 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a38160340 0x7f5a38160750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:21.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.734+0000 7f5a3fabd640 1 --2- 172.21.15.105:0/1273354756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a3806cde0 0x7f5a3806d1f0 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:21.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.734+0000 7f5a3fabd640 1 -- 172.21.15.105:0/1273354756 >> 172.21.15.105:0/1273354756 conn(0x7f5a380cd530 msgr2=0x7f5a380cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:21.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.734+0000 7f5a3fabd640 1 -- 172.21.15.105:0/1273354756 shutdown_connections 2024-09-21T03:27:21.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.734+0000 7f5a3fabd640 1 -- 172.21.15.105:0/1273354756 wait complete. 2024-09-21T03:27:21.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.736+0000 7f5a3fabd640 1 Processor -- start 2024-09-21T03:27:21.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.736+0000 7f5a3fabd640 1 -- start start 2024-09-21T03:27:21.741 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.737+0000 7f5a3fabd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a3806cde0 0x7f5a38146510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:21.741 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.737+0000 7f5a3fabd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a3806e470 0x7f5a380c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:21.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.737+0000 7f5a3fabd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a38160340 0x7f5a380ca320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:21.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.737+0000 7f5a3fabd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5a38160c90 con 0x7f5a38160340 2024-09-21T03:27:21.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.737+0000 7f5a3fabd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5a380cbc00 con 0x7f5a3806e470 2024-09-21T03:27:21.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.737+0000 7f5a3fabd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5a38160e10 con 0x7f5a3806cde0 2024-09-21T03:27:21.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.737+0000 7f5a3e05a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a38160340 0x7f5a380ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:21.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.737+0000 7f5a3e05a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a38160340 0x7f5a380ca320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40128/0 (socket says 172.21.15.105:40128) 2024-09-21T03:27:21.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.737+0000 7f5a3e05a640 1 -- 172.21.15.105:0/305642742 learned_addr learned my addr 172.21.15.105:0/305642742 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:21.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.737+0000 7f5a3d859640 1 --2- 172.21.15.105:0/305642742 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a3806cde0 0x7f5a38146510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:21.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.737+0000 7f5a3d058640 1 --2- 172.21.15.105:0/305642742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a3806e470 0x7f5a380c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:21.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.738+0000 7f5a3e05a640 1 -- 172.21.15.105:0/305642742 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a3806cde0 msgr2=0x7f5a38146510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:21.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.738+0000 7f5a3e05a640 1 --2- 172.21.15.105:0/305642742 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a3806cde0 0x7f5a38146510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:21.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.738+0000 7f5a3e05a640 1 -- 172.21.15.105:0/305642742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a3806e470 msgr2=0x7f5a380c9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:21.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.738+0000 7f5a3e05a640 1 --2- 172.21.15.105:0/305642742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a3806e470 0x7f5a380c9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:21.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.738+0000 7f5a3e05a640 1 -- 172.21.15.105:0/305642742 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a38146a50 con 0x7f5a38160340 2024-09-21T03:27:21.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.738+0000 7f5a3d859640 1 --2- 172.21.15.105:0/305642742 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a3806cde0 0x7f5a38146510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:27:21.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.738+0000 7f5a3d058640 1 --2- 172.21.15.105:0/305642742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a3806e470 0x7f5a380c9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:27:21.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.738+0000 7f5a3e05a640 1 --2- 172.21.15.105:0/305642742 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a38160340 0x7f5a380ca320 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f5a3000c970 tx=0x7f5a3000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:21.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.738+0000 7f5a2e7fc640 1 -- 172.21.15.105:0/305642742 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a30007bb0 con 0x7f5a38160340 2024-09-21T03:27:21.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.738+0000 7f5a2e7fc640 1 -- 172.21.15.105:0/305642742 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a3000f450 con 0x7f5a38160340 2024-09-21T03:27:21.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.738+0000 7f5a3fabd640 1 -- 172.21.15.105:0/305642742 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a381f9230 con 0x7f5a38160340 2024-09-21T03:27:21.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.738+0000 7f5a2e7fc640 1 -- 172.21.15.105:0/305642742 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a30007e60 con 0x7f5a38160340 2024-09-21T03:27:21.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.738+0000 7f5a3fabd640 1 -- 172.21.15.105:0/305642742 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a381f97f0 con 0x7f5a38160340 2024-09-21T03:27:21.743 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.739+0000 7f5a3fabd640 1 -- 172.21.15.105:0/305642742 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a3806d1f0 con 0x7f5a38160340 2024-09-21T03:27:21.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.740+0000 7f5a2e7fc640 1 -- 172.21.15.105:0/305642742 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5a3000f8a0 con 0x7f5a38160340 2024-09-21T03:27:21.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.740+0000 7f5a2e7fc640 1 --2- 172.21.15.105:0/305642742 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5a1c078bc0 0x7f5a1c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:21.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.740+0000 7f5a2e7fc640 1 -- 172.21.15.105:0/305642742 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5709+0+0 (secure 0 0 0) 0x7f5a3009b540 con 0x7f5a38160340 2024-09-21T03:27:21.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.741+0000 7f5a3d859640 1 --2- 172.21.15.105:0/305642742 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5a1c078bc0 0x7f5a1c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:21.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.741+0000 7f5a3d859640 1 --2- 172.21.15.105:0/305642742 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5a1c078bc0 0x7f5a1c07b0d0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f5a38073710 tx=0x7f5a34009550 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:21.747 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.745+0000 7f5a2e7fc640 1 -- 172.21.15.105:0/305642742 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5a30014030 con 0x7f5a38160340 2024-09-21T03:27:21.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.920+0000 7f5a3fabd640 1 -- 172.21.15.105:0/305642742 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5a381f8fc0 con 0x7f5a1c078bc0 2024-09-21T03:27:21.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.925+0000 7f5a2e7fc640 1 -- 172.21.15.105:0/305642742 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251647 (secure 0 0 0) 0x7f5a381f8fc0 con 0x7f5a1c078bc0 2024-09-21T03:27:21.930 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:27:21.931 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:27:21.932 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.928+0000 7f5a3fabd640 1 -- 172.21.15.105:0/305642742 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5a1c078bc0 msgr2=0x7f5a1c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:21.932 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.928+0000 7f5a3fabd640 1 --2- 172.21.15.105:0/305642742 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5a1c078bc0 0x7f5a1c07b0d0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f5a38073710 tx=0x7f5a34009550 comp rx=0 tx=0).stop 2024-09-21T03:27:21.932 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.928+0000 7f5a3fabd640 1 -- 172.21.15.105:0/305642742 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a38160340 msgr2=0x7f5a380ca320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:21.932 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.928+0000 7f5a3fabd640 1 --2- 172.21.15.105:0/305642742 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a38160340 0x7f5a380ca320 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f5a3000c970 tx=0x7f5a3000ce30 comp rx=0 tx=0).stop 2024-09-21T03:27:21.932 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.928+0000 7f5a3fabd640 1 -- 172.21.15.105:0/305642742 shutdown_connections 2024-09-21T03:27:21.933 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.928+0000 7f5a3fabd640 1 --2- 172.21.15.105:0/305642742 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f5a1c078bc0 0x7f5a1c07b0d0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:21.933 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.928+0000 7f5a3fabd640 1 --2- 172.21.15.105:0/305642742 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a38160340 0x7f5a380ca320 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:21.933 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.928+0000 7f5a3fabd640 1 --2- 172.21.15.105:0/305642742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a3806e470 0x7f5a380c9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:21.933 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.928+0000 7f5a3fabd640 1 --2- 172.21.15.105:0/305642742 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a3806cde0 0x7f5a38146510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:21.933 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.928+0000 7f5a3fabd640 1 -- 172.21.15.105:0/305642742 >> 172.21.15.105:0/305642742 conn(0x7f5a380cd530 msgr2=0x7f5a3815eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:21.933 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.928+0000 7f5a3fabd640 1 -- 172.21.15.105:0/305642742 shutdown_connections 2024-09-21T03:27:21.933 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:21.928+0000 7f5a3fabd640 1 -- 172.21.15.105:0/305642742 wait complete. 2024-09-21T03:27:21.941 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":406,"stamp":"2024-09-21T03:27:21.423079+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":272680,"kb_used_data":14812,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754702040,"statfs":{"total":773094113280,"available":772814888960,"internally_reserved":0,"allocated":15167488,"data_stored":7156054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.870896"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583647+0000","last_change":"2024-09-21T03:27:17.581755+0000","last_active":"2024-09-21T03:27:18.583647+0000","last_peered":"2024-09-21T03:27:18.583647+0000","last_clean":"2024-09-21T03:27:18.583647+0000","last_became_active":"2024-09-21T03:27:17.581133+0000","last_became_peered":"2024-09-21T03:27:17.581133+0000","last_unstale":"2024-09-21T03:27:18.583647+0000","last_undegraded":"2024-09-21T03:27:18.583647+0000","last_fullsized":"2024-09-21T03:27:18.583647+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:43.005587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.586375+0000","last_change":"2024-09-21T03:27:17.573023+0000","last_active":"2024-09-21T03:27:18.586375+0000","last_peered":"2024-09-21T03:27:18.586375+0000","last_clean":"2024-09-21T03:27:18.586375+0000","last_became_active":"2024-09-21T03:27:17.572695+0000","last_became_peered":"2024-09-21T03:27:17.572695+0000","last_unstale":"2024-09-21T03:27:18.586375+0000","last_undegraded":"2024-09-21T03:27:18.586375+0000","last_fullsized":"2024-09-21T03:27:18.586375+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:03.003218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.592496+0000","last_change":"2024-09-21T03:27:17.586788+0000","last_active":"2024-09-21T03:27:17.592496+0000","last_peered":"2024-09-21T03:27:17.592496+0000","last_clean":"2024-09-21T03:27:17.592496+0000","last_became_active":"2024-09-21T03:27:17.586413+0000","last_became_peered":"2024-09-21T03:27:17.586413+0000","last_unstale":"2024-09-21T03:27:17.592496+0000","last_undegraded":"2024-09-21T03:27:17.592496+0000","last_fullsized":"2024-09-21T03:27:17.592496+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:13.401161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.584595+0000","last_change":"2024-09-21T03:27:17.580965+0000","last_active":"2024-09-21T03:27:17.584595+0000","last_peered":"2024-09-21T03:27:17.584595+0000","last_clean":"2024-09-21T03:27:17.584595+0000","last_became_active":"2024-09-21T03:27:17.580581+0000","last_became_peered":"2024-09-21T03:27:17.580581+0000","last_unstale":"2024-09-21T03:27:17.584595+0000","last_undegraded":"2024-09-21T03:27:17.584595+0000","last_fullsized":"2024-09-21T03:27:17.584595+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:34.308409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.586111+0000","last_change":"2024-09-21T03:27:17.585238+0000","last_active":"2024-09-21T03:27:18.586111+0000","last_peered":"2024-09-21T03:27:18.586111+0000","last_clean":"2024-09-21T03:27:18.586111+0000","last_became_active":"2024-09-21T03:27:17.583972+0000","last_became_peered":"2024-09-21T03:27:17.583972+0000","last_unstale":"2024-09-21T03:27:18.586111+0000","last_undegraded":"2024-09-21T03:27:18.586111+0000","last_fullsized":"2024-09-21T03:27:18.586111+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:29.413682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.584474+0000","last_change":"2024-09-21T03:27:17.580318+0000","last_active":"2024-09-21T03:27:17.584474+0000","last_peered":"2024-09-21T03:27:17.584474+0000","last_clean":"2024-09-21T03:27:17.584474+0000","last_became_active":"2024-09-21T03:27:17.580006+0000","last_became_peered":"2024-09-21T03:27:17.580006+0000","last_unstale":"2024-09-21T03:27:17.584474+0000","last_undegraded":"2024-09-21T03:27:17.584474+0000","last_fullsized":"2024-09-21T03:27:17.584474+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:45:23.305894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-21T03:27:16.570177+0000","last_change":"2024-09-21T03:27:16.570177+0000","last_active":"2024-09-21T03:27:16.550895+0000","last_peered":"2024-09-21T03:27:16.550895+0000","last_clean":"2024-09-21T03:27:16.550895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:27:16.570177+0000","last_undegraded":"2024-09-21T03:27:16.570177+0000","last_fullsized":"2024-09-21T03:27:16.570177+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585808+0000","last_change":"2024-09-21T03:27:17.586097+0000","last_active":"2024-09-21T03:27:18.585808+0000","last_peered":"2024-09-21T03:27:18.585808+0000","last_clean":"2024-09-21T03:27:18.585808+0000","last_became_active":"2024-09-21T03:27:17.585734+0000","last_became_peered":"2024-09-21T03:27:17.585734+0000","last_unstale":"2024-09-21T03:27:18.585808+0000","last_undegraded":"2024-09-21T03:27:18.585808+0000","last_fullsized":"2024-09-21T03:27:18.585808+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:21:44.303210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.586651+0000","last_change":"2024-09-21T03:27:17.586773+0000","last_active":"2024-09-21T03:27:18.586651+0000","last_peered":"2024-09-21T03:27:18.586651+0000","last_clean":"2024-09-21T03:27:18.586651+0000","last_became_active":"2024-09-21T03:27:17.586439+0000","last_became_peered":"2024-09-21T03:27:17.586439+0000","last_unstale":"2024-09-21T03:27:18.586651+0000","last_undegraded":"2024-09-21T03:27:18.586651+0000","last_fullsized":"2024-09-21T03:27:18.586651+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:34.474168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.586400+0000","last_change":"2024-09-21T03:27:17.577732+0000","last_active":"2024-09-21T03:27:18.586400+0000","last_peered":"2024-09-21T03:27:18.586400+0000","last_clean":"2024-09-21T03:27:18.586400+0000","last_became_active":"2024-09-21T03:27:17.577442+0000","last_became_peered":"2024-09-21T03:27:17.577442+0000","last_unstale":"2024-09-21T03:27:18.586400+0000","last_undegraded":"2024-09-21T03:27:18.586400+0000","last_fullsized":"2024-09-21T03:27:18.586400+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:18:21.010195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.586106+0000","last_change":"2024-09-21T03:27:17.585024+0000","last_active":"2024-09-21T03:27:18.586106+0000","last_peered":"2024-09-21T03:27:18.586106+0000","last_clean":"2024-09-21T03:27:18.586106+0000","last_became_active":"2024-09-21T03:27:17.584681+0000","last_became_peered":"2024-09-21T03:27:17.584681+0000","last_unstale":"2024-09-21T03:27:18.586106+0000","last_undegraded":"2024-09-21T03:27:18.586106+0000","last_fullsized":"2024-09-21T03:27:18.586106+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:16.877998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.586553+0000","last_change":"2024-09-21T03:27:17.573714+0000","last_active":"2024-09-21T03:27:18.586553+0000","last_peered":"2024-09-21T03:27:18.586553+0000","last_clean":"2024-09-21T03:27:18.586553+0000","last_became_active":"2024-09-21T03:27:17.573344+0000","last_became_peered":"2024-09-21T03:27:17.573344+0000","last_unstale":"2024-09-21T03:27:18.586553+0000","last_undegraded":"2024-09-21T03:27:18.586553+0000","last_fullsized":"2024-09-21T03:27:18.586553+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:16:50.560426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.583400+0000","last_change":"2024-09-21T03:27:17.580024+0000","last_active":"2024-09-21T03:27:17.583400+0000","last_peered":"2024-09-21T03:27:17.583400+0000","last_clean":"2024-09-21T03:27:17.583400+0000","last_became_active":"2024-09-21T03:27:17.579693+0000","last_became_peered":"2024-09-21T03:27:17.579693+0000","last_unstale":"2024-09-21T03:27:17.583400+0000","last_undegraded":"2024-09-21T03:27:17.583400+0000","last_fullsized":"2024-09-21T03:27:17.583400+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:27:17.606293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.579208+0000","last_change":"2024-09-21T03:27:17.573051+0000","last_active":"2024-09-21T03:27:17.579208+0000","last_peered":"2024-09-21T03:27:17.579208+0000","last_clean":"2024-09-21T03:27:17.579208+0000","last_became_active":"2024-09-21T03:27:17.572714+0000","last_became_peered":"2024-09-21T03:27:17.572714+0000","last_unstale":"2024-09-21T03:27:17.579208+0000","last_undegraded":"2024-09-21T03:27:17.579208+0000","last_fullsized":"2024-09-21T03:27:17.579208+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:31.027265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583130+0000","last_change":"2024-09-21T03:27:17.581234+0000","last_active":"2024-09-21T03:27:18.583130+0000","last_peered":"2024-09-21T03:27:18.583130+0000","last_clean":"2024-09-21T03:27:18.583130+0000","last_became_active":"2024-09-21T03:27:17.580865+0000","last_became_peered":"2024-09-21T03:27:17.580865+0000","last_unstale":"2024-09-21T03:27:18.583130+0000","last_undegraded":"2024-09-21T03:27:18.583130+0000","last_fullsized":"2024-09-21T03:27:18.583130+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:29:44.168728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-21T03:27:16.569726+0000","last_change":"2024-09-21T03:27:16.569726+0000","last_active":"2024-09-21T03:27:16.550895+0000","last_peered":"2024-09-21T03:27:16.550895+0000","last_clean":"2024-09-21T03:27:16.550895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:27:16.569726+0000","last_undegraded":"2024-09-21T03:27:16.569726+0000","last_fullsized":"2024-09-21T03:27:16.569726+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.587675+0000","last_change":"2024-09-21T03:27:17.585074+0000","last_active":"2024-09-21T03:27:17.587675+0000","last_peered":"2024-09-21T03:27:17.587675+0000","last_clean":"2024-09-21T03:27:17.587675+0000","last_became_active":"2024-09-21T03:27:17.584763+0000","last_became_peered":"2024-09-21T03:27:17.584763+0000","last_unstale":"2024-09-21T03:27:17.587675+0000","last_undegraded":"2024-09-21T03:27:17.587675+0000","last_fullsized":"2024-09-21T03:27:17.587675+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:16:05.884637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.581363+0000","last_change":"2024-09-21T03:27:17.576376+0000","last_active":"2024-09-21T03:27:17.581363+0000","last_peered":"2024-09-21T03:27:17.581363+0000","last_clean":"2024-09-21T03:27:17.581363+0000","last_became_active":"2024-09-21T03:27:17.576094+0000","last_became_peered":"2024-09-21T03:27:17.576094+0000","last_unstale":"2024-09-21T03:27:17.581363+0000","last_undegraded":"2024-09-21T03:27:17.581363+0000","last_fullsized":"2024-09-21T03:27:17.581363+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:56.640317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.588809+0000","last_change":"2024-09-21T03:27:17.585841+0000","last_active":"2024-09-21T03:27:17.588809+0000","last_peered":"2024-09-21T03:27:17.588809+0000","last_clean":"2024-09-21T03:27:17.588809+0000","last_became_active":"2024-09-21T03:27:17.585539+0000","last_became_peered":"2024-09-21T03:27:17.585539+0000","last_unstale":"2024-09-21T03:27:17.588809+0000","last_undegraded":"2024-09-21T03:27:17.588809+0000","last_fullsized":"2024-09-21T03:27:17.588809+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:01.563086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.580419+0000","last_change":"2024-09-21T03:27:17.575335+0000","last_active":"2024-09-21T03:27:17.580419+0000","last_peered":"2024-09-21T03:27:17.580419+0000","last_clean":"2024-09-21T03:27:17.580419+0000","last_became_active":"2024-09-21T03:27:17.573625+0000","last_became_peered":"2024-09-21T03:27:17.573625+0000","last_unstale":"2024-09-21T03:27:17.580419+0000","last_undegraded":"2024-09-21T03:27:17.580419+0000","last_fullsized":"2024-09-21T03:27:17.580419+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:10.758459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.587667+0000","last_change":"2024-09-21T03:27:17.585062+0000","last_active":"2024-09-21T03:27:17.587667+0000","last_peered":"2024-09-21T03:27:17.587667+0000","last_clean":"2024-09-21T03:27:17.587667+0000","last_became_active":"2024-09-21T03:27:17.584730+0000","last_became_peered":"2024-09-21T03:27:17.584730+0000","last_unstale":"2024-09-21T03:27:17.587667+0000","last_undegraded":"2024-09-21T03:27:17.587667+0000","last_fullsized":"2024-09-21T03:27:17.587667+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:16.068461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.586508+0000","last_change":"2024-09-21T03:27:17.577064+0000","last_active":"2024-09-21T03:27:18.586508+0000","last_peered":"2024-09-21T03:27:18.586508+0000","last_clean":"2024-09-21T03:27:18.586508+0000","last_became_active":"2024-09-21T03:27:17.576634+0000","last_became_peered":"2024-09-21T03:27:17.576634+0000","last_unstale":"2024-09-21T03:27:18.586508+0000","last_undegraded":"2024-09-21T03:27:18.586508+0000","last_fullsized":"2024-09-21T03:27:18.586508+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:42.013551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.584371+0000","last_change":"2024-09-21T03:27:17.578564+0000","last_active":"2024-09-21T03:27:17.584371+0000","last_peered":"2024-09-21T03:27:17.584371+0000","last_clean":"2024-09-21T03:27:17.584371+0000","last_became_active":"2024-09-21T03:27:17.578274+0000","last_became_peered":"2024-09-21T03:27:17.578274+0000","last_unstale":"2024-09-21T03:27:17.584371+0000","last_undegraded":"2024-09-21T03:27:17.584371+0000","last_fullsized":"2024-09-21T03:27:17.584371+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:05.868201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585847+0000","last_change":"2024-09-21T03:27:17.582077+0000","last_active":"2024-09-21T03:27:18.585847+0000","last_peered":"2024-09-21T03:27:18.585847+0000","last_clean":"2024-09-21T03:27:18.585847+0000","last_became_active":"2024-09-21T03:27:17.581735+0000","last_became_peered":"2024-09-21T03:27:17.581735+0000","last_unstale":"2024-09-21T03:27:18.585847+0000","last_undegraded":"2024-09-21T03:27:18.585847+0000","last_fullsized":"2024-09-21T03:27:18.585847+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:03.545497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.592798+0000","last_change":"2024-09-21T03:27:17.585639+0000","last_active":"2024-09-21T03:27:17.592798+0000","last_peered":"2024-09-21T03:27:17.592798+0000","last_clean":"2024-09-21T03:27:17.592798+0000","last_became_active":"2024-09-21T03:27:17.585334+0000","last_became_peered":"2024-09-21T03:27:17.585334+0000","last_unstale":"2024-09-21T03:27:17.592798+0000","last_undegraded":"2024-09-21T03:27:17.592798+0000","last_fullsized":"2024-09-21T03:27:17.592798+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:41.702167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-21T03:27:16.569388+0000","last_change":"2024-09-21T03:27:16.569388+0000","last_active":"2024-09-21T03:27:16.550895+0000","last_peered":"2024-09-21T03:27:16.550895+0000","last_clean":"2024-09-21T03:27:16.550895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:27:16.569388+0000","last_undegraded":"2024-09-21T03:27:16.569388+0000","last_fullsized":"2024-09-21T03:27:16.569388+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.592458+0000","last_change":"2024-09-21T03:27:17.584543+0000","last_active":"2024-09-21T03:27:17.592458+0000","last_peered":"2024-09-21T03:27:17.592458+0000","last_clean":"2024-09-21T03:27:17.592458+0000","last_became_active":"2024-09-21T03:27:17.584163+0000","last_became_peered":"2024-09-21T03:27:17.584163+0000","last_unstale":"2024-09-21T03:27:17.592458+0000","last_undegraded":"2024-09-21T03:27:17.592458+0000","last_fullsized":"2024-09-21T03:27:17.592458+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:59:25.012491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.586980+0000","last_change":"2024-09-21T03:27:17.584109+0000","last_active":"2024-09-21T03:27:17.586980+0000","last_peered":"2024-09-21T03:27:17.586980+0000","last_clean":"2024-09-21T03:27:17.586980+0000","last_became_active":"2024-09-21T03:27:17.583795+0000","last_became_peered":"2024-09-21T03:27:17.583795+0000","last_unstale":"2024-09-21T03:27:17.586980+0000","last_undegraded":"2024-09-21T03:27:17.586980+0000","last_fullsized":"2024-09-21T03:27:17.586980+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:02:40.150497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.592602+0000","last_change":"2024-09-21T03:27:17.584726+0000","last_active":"2024-09-21T03:27:17.592602+0000","last_peered":"2024-09-21T03:27:17.592602+0000","last_clean":"2024-09-21T03:27:17.592602+0000","last_became_active":"2024-09-21T03:27:17.584401+0000","last_became_peered":"2024-09-21T03:27:17.584401+0000","last_unstale":"2024-09-21T03:27:17.592602+0000","last_undegraded":"2024-09-21T03:27:17.592602+0000","last_fullsized":"2024-09-21T03:27:17.592602+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:47:17.066223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585339+0000","last_change":"2024-09-21T03:27:17.583387+0000","last_active":"2024-09-21T03:27:18.585339+0000","last_peered":"2024-09-21T03:27:18.585339+0000","last_clean":"2024-09-21T03:27:18.585339+0000","last_became_active":"2024-09-21T03:27:17.582898+0000","last_became_peered":"2024-09-21T03:27:17.582898+0000","last_unstale":"2024-09-21T03:27:18.585339+0000","last_undegraded":"2024-09-21T03:27:18.585339+0000","last_fullsized":"2024-09-21T03:27:18.585339+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:42.013551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.584662+0000","last_change":"2024-09-21T03:27:17.592422+0000","last_active":"2024-09-21T03:27:18.584662+0000","last_peered":"2024-09-21T03:27:18.584662+0000","last_clean":"2024-09-21T03:27:18.584662+0000","last_became_active":"2024-09-21T03:27:17.592093+0000","last_became_peered":"2024-09-21T03:27:17.592093+0000","last_unstale":"2024-09-21T03:27:18.584662+0000","last_undegraded":"2024-09-21T03:27:18.584662+0000","last_fullsized":"2024-09-21T03:27:18.584662+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:06:13.764175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.582876+0000","last_change":"2024-09-21T03:27:17.579122+0000","last_active":"2024-09-21T03:27:17.582876+0000","last_peered":"2024-09-21T03:27:17.582876+0000","last_clean":"2024-09-21T03:27:17.582876+0000","last_became_active":"2024-09-21T03:27:17.578841+0000","last_became_peered":"2024-09-21T03:27:17.578841+0000","last_unstale":"2024-09-21T03:27:17.582876+0000","last_undegraded":"2024-09-21T03:27:17.582876+0000","last_fullsized":"2024-09-21T03:27:17.582876+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:17.468257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-21T03:27:16.568441+0000","last_change":"2024-09-21T03:27:16.568441+0000","last_active":"2024-09-21T03:27:16.550895+0000","last_peered":"2024-09-21T03:27:16.550895+0000","last_clean":"2024-09-21T03:27:16.550895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:27:16.568441+0000","last_undegraded":"2024-09-21T03:27:16.568441+0000","last_fullsized":"2024-09-21T03:27:16.568441+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"139'4","reported_seq":19,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583565+0000","last_change":"2024-09-21T03:27:16.581015+0000","last_active":"2024-09-21T03:27:18.583565+0000","last_peered":"2024-09-21T03:27:18.583565+0000","last_clean":"2024-09-21T03:27:18.583565+0000","last_became_active":"2024-09-21T03:27:16.580691+0000","last_became_peered":"2024-09-21T03:27:16.580691+0000","last_unstale":"2024-09-21T03:27:18.583565+0000","last_undegraded":"2024-09-21T03:27:18.583565+0000","last_fullsized":"2024-09-21T03:27:18.583565+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:58:11.894626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585350+0000","last_change":"2024-09-21T03:27:17.584425+0000","last_active":"2024-09-21T03:27:18.585350+0000","last_peered":"2024-09-21T03:27:18.585350+0000","last_clean":"2024-09-21T03:27:18.585350+0000","last_became_active":"2024-09-21T03:27:17.584118+0000","last_became_peered":"2024-09-21T03:27:17.584118+0000","last_unstale":"2024-09-21T03:27:18.585350+0000","last_undegraded":"2024-09-21T03:27:18.585350+0000","last_fullsized":"2024-09-21T03:27:18.585350+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:51.069144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"139'1","reported_seq":16,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585028+0000","last_change":"2024-09-21T03:27:16.578107+0000","last_active":"2024-09-21T03:27:18.585028+0000","last_peered":"2024-09-21T03:27:18.585028+0000","last_clean":"2024-09-21T03:27:18.585028+0000","last_became_active":"2024-09-21T03:27:16.577745+0000","last_became_peered":"2024-09-21T03:27:16.577745+0000","last_unstale":"2024-09-21T03:27:18.585028+0000","last_undegraded":"2024-09-21T03:27:18.585028+0000","last_fullsized":"2024-09-21T03:27:18.585028+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:38.887631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.587168+0000","last_change":"2024-09-21T03:27:17.582825+0000","last_active":"2024-09-21T03:27:17.587168+0000","last_peered":"2024-09-21T03:27:17.587168+0000","last_clean":"2024-09-21T03:27:17.587168+0000","last_became_active":"2024-09-21T03:27:17.582405+0000","last_became_peered":"2024-09-21T03:27:17.582405+0000","last_unstale":"2024-09-21T03:27:17.587168+0000","last_undegraded":"2024-09-21T03:27:17.587168+0000","last_fullsized":"2024-09-21T03:27:17.587168+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:16.762738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"139'2","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.597455+0000","last_change":"2024-09-21T03:27:16.577605+0000","last_active":"2024-09-21T03:27:17.597455+0000","last_peered":"2024-09-21T03:27:17.597455+0000","last_clean":"2024-09-21T03:27:17.597455+0000","last_became_active":"2024-09-21T03:27:16.577310+0000","last_became_peered":"2024-09-21T03:27:16.577310+0000","last_unstale":"2024-09-21T03:27:17.597455+0000","last_undegraded":"2024-09-21T03:27:17.597455+0000","last_fullsized":"2024-09-21T03:27:17.597455+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:41.413162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.581303+0000","last_change":"2024-09-21T03:27:17.579293+0000","last_active":"2024-09-21T03:27:17.581303+0000","last_peered":"2024-09-21T03:27:17.581303+0000","last_clean":"2024-09-21T03:27:17.581303+0000","last_became_active":"2024-09-21T03:27:17.578780+0000","last_became_peered":"2024-09-21T03:27:17.578780+0000","last_unstale":"2024-09-21T03:27:17.581303+0000","last_undegraded":"2024-09-21T03:27:17.581303+0000","last_fullsized":"2024-09-21T03:27:17.581303+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:13.328076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"139'2","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.597487+0000","last_change":"2024-09-21T03:27:16.574950+0000","last_active":"2024-09-21T03:27:17.597487+0000","last_peered":"2024-09-21T03:27:17.597487+0000","last_clean":"2024-09-21T03:27:17.597487+0000","last_became_active":"2024-09-21T03:27:16.573561+0000","last_became_peered":"2024-09-21T03:27:16.573561+0000","last_unstale":"2024-09-21T03:27:17.597487+0000","last_undegraded":"2024-09-21T03:27:17.597487+0000","last_fullsized":"2024-09-21T03:27:17.597487+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:24.760299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-21T03:27:16.568774+0000","last_change":"2024-09-21T03:27:16.568774+0000","last_active":"2024-09-21T03:27:16.550895+0000","last_peered":"2024-09-21T03:27:16.550895+0000","last_clean":"2024-09-21T03:27:16.550895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:27:16.568774+0000","last_undegraded":"2024-09-21T03:27:16.568774+0000","last_fullsized":"2024-09-21T03:27:16.568774+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"139'1","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.596812+0000","last_change":"2024-09-21T03:27:16.579737+0000","last_active":"2024-09-21T03:27:17.596812+0000","last_peered":"2024-09-21T03:27:17.596812+0000","last_clean":"2024-09-21T03:27:17.596812+0000","last_became_active":"2024-09-21T03:27:16.579428+0000","last_became_peered":"2024-09-21T03:27:16.579428+0000","last_unstale":"2024-09-21T03:27:17.596812+0000","last_undegraded":"2024-09-21T03:27:17.596812+0000","last_fullsized":"2024-09-21T03:27:17.596812+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:02:22.984543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.586953+0000","last_change":"2024-09-21T03:27:17.583627+0000","last_active":"2024-09-21T03:27:17.586953+0000","last_peered":"2024-09-21T03:27:17.586953+0000","last_clean":"2024-09-21T03:27:17.586953+0000","last_became_active":"2024-09-21T03:27:17.583282+0000","last_became_peered":"2024-09-21T03:27:17.583282+0000","last_unstale":"2024-09-21T03:27:17.586953+0000","last_undegraded":"2024-09-21T03:27:17.586953+0000","last_fullsized":"2024-09-21T03:27:17.586953+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:15:39.847481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"139'1","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.597355+0000","last_change":"2024-09-21T03:27:16.574689+0000","last_active":"2024-09-21T03:27:17.597355+0000","last_peered":"2024-09-21T03:27:17.597355+0000","last_clean":"2024-09-21T03:27:17.597355+0000","last_became_active":"2024-09-21T03:27:16.574380+0000","last_became_peered":"2024-09-21T03:27:16.574380+0000","last_unstale":"2024-09-21T03:27:17.597355+0000","last_undegraded":"2024-09-21T03:27:17.597355+0000","last_fullsized":"2024-09-21T03:27:17.597355+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:03.610863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.589621+0000","last_change":"2024-09-21T03:27:17.586684+0000","last_active":"2024-09-21T03:27:17.589621+0000","last_peered":"2024-09-21T03:27:17.589621+0000","last_clean":"2024-09-21T03:27:17.589621+0000","last_became_active":"2024-09-21T03:27:17.586407+0000","last_became_peered":"2024-09-21T03:27:17.586407+0000","last_unstale":"2024-09-21T03:27:17.589621+0000","last_undegraded":"2024-09-21T03:27:17.589621+0000","last_fullsized":"2024-09-21T03:27:17.589621+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:18:37.794112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585775+0000","last_change":"2024-09-21T03:27:16.574797+0000","last_active":"2024-09-21T03:27:18.585775+0000","last_peered":"2024-09-21T03:27:18.585775+0000","last_clean":"2024-09-21T03:27:18.585775+0000","last_became_active":"2024-09-21T03:27:16.574469+0000","last_became_peered":"2024-09-21T03:27:16.574469+0000","last_unstale":"2024-09-21T03:27:18.585775+0000","last_undegraded":"2024-09-21T03:27:18.585775+0000","last_fullsized":"2024-09-21T03:27:18.585775+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:12.431154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.579396+0000","last_change":"2024-09-21T03:27:17.576792+0000","last_active":"2024-09-21T03:27:17.579396+0000","last_peered":"2024-09-21T03:27:17.579396+0000","last_clean":"2024-09-21T03:27:17.579396+0000","last_became_active":"2024-09-21T03:27:17.576477+0000","last_became_peered":"2024-09-21T03:27:17.576477+0000","last_unstale":"2024-09-21T03:27:17.579396+0000","last_undegraded":"2024-09-21T03:27:17.579396+0000","last_fullsized":"2024-09-21T03:27:17.579396+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:02:44.799481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-21T03:27:16.581906+0000","last_change":"2024-09-21T03:27:16.578176+0000","last_active":"2024-09-21T03:27:16.581906+0000","last_peered":"2024-09-21T03:27:16.581906+0000","last_clean":"2024-09-21T03:27:16.581906+0000","last_became_active":"2024-09-21T03:27:16.577886+0000","last_became_peered":"2024-09-21T03:27:16.577886+0000","last_unstale":"2024-09-21T03:27:16.581906+0000","last_undegraded":"2024-09-21T03:27:16.581906+0000","last_fullsized":"2024-09-21T03:27:16.581906+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:29:46.791624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.581935+0000","last_change":"2024-09-21T03:27:17.577247+0000","last_active":"2024-09-21T03:27:17.581935+0000","last_peered":"2024-09-21T03:27:17.581935+0000","last_clean":"2024-09-21T03:27:17.581935+0000","last_became_active":"2024-09-21T03:27:17.576950+0000","last_became_peered":"2024-09-21T03:27:17.576950+0000","last_unstale":"2024-09-21T03:27:17.581935+0000","last_undegraded":"2024-09-21T03:27:17.581935+0000","last_fullsized":"2024-09-21T03:27:17.581935+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:16.951026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.572137+0000","last_change":"2024-09-21T03:27:16.578096+0000","last_active":"2024-09-21T03:27:17.572137+0000","last_peered":"2024-09-21T03:27:17.572137+0000","last_clean":"2024-09-21T03:27:17.572137+0000","last_became_active":"2024-09-21T03:27:16.577770+0000","last_became_peered":"2024-09-21T03:27:16.577770+0000","last_unstale":"2024-09-21T03:27:17.572137+0000","last_undegraded":"2024-09-21T03:27:17.572137+0000","last_fullsized":"2024-09-21T03:27:17.572137+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:54.303412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.581766+0000","last_change":"2024-09-21T03:27:17.577763+0000","last_active":"2024-09-21T03:27:17.581766+0000","last_peered":"2024-09-21T03:27:17.581766+0000","last_clean":"2024-09-21T03:27:17.581766+0000","last_became_active":"2024-09-21T03:27:17.577479+0000","last_became_peered":"2024-09-21T03:27:17.577479+0000","last_unstale":"2024-09-21T03:27:17.581766+0000","last_undegraded":"2024-09-21T03:27:17.581766+0000","last_fullsized":"2024-09-21T03:27:17.581766+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:56:15.766800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"139'3","reported_seq":16,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.596848+0000","last_change":"2024-09-21T03:27:16.577153+0000","last_active":"2024-09-21T03:27:17.596848+0000","last_peered":"2024-09-21T03:27:17.596848+0000","last_clean":"2024-09-21T03:27:17.596848+0000","last_became_active":"2024-09-21T03:27:16.576867+0000","last_became_peered":"2024-09-21T03:27:16.576867+0000","last_unstale":"2024-09-21T03:27:17.596848+0000","last_undegraded":"2024-09-21T03:27:17.596848+0000","last_fullsized":"2024-09-21T03:27:17.596848+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:46.573583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585356+0000","last_change":"2024-09-21T03:27:17.583787+0000","last_active":"2024-09-21T03:27:18.585356+0000","last_peered":"2024-09-21T03:27:18.585356+0000","last_clean":"2024-09-21T03:27:18.585356+0000","last_became_active":"2024-09-21T03:27:17.583260+0000","last_became_peered":"2024-09-21T03:27:17.583260+0000","last_unstale":"2024-09-21T03:27:18.585356+0000","last_undegraded":"2024-09-21T03:27:18.585356+0000","last_fullsized":"2024-09-21T03:27:18.585356+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:51.228873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"139'6","reported_seq":21,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.584840+0000","last_change":"2024-09-21T03:27:16.571658+0000","last_active":"2024-09-21T03:27:18.584840+0000","last_peered":"2024-09-21T03:27:18.584840+0000","last_clean":"2024-09-21T03:27:18.584840+0000","last_became_active":"2024-09-21T03:27:16.571305+0000","last_became_peered":"2024-09-21T03:27:16.571305+0000","last_unstale":"2024-09-21T03:27:18.584840+0000","last_undegraded":"2024-09-21T03:27:18.584840+0000","last_fullsized":"2024-09-21T03:27:18.584840+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:30.379967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.578257+0000","last_change":"2024-09-21T03:27:17.573089+0000","last_active":"2024-09-21T03:27:17.578257+0000","last_peered":"2024-09-21T03:27:17.578257+0000","last_clean":"2024-09-21T03:27:17.578257+0000","last_became_active":"2024-09-21T03:27:17.572836+0000","last_became_peered":"2024-09-21T03:27:17.572836+0000","last_unstale":"2024-09-21T03:27:17.578257+0000","last_undegraded":"2024-09-21T03:27:17.578257+0000","last_fullsized":"2024-09-21T03:27:17.578257+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:44.827317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"139'2","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.597889+0000","last_change":"2024-09-21T03:27:16.572761+0000","last_active":"2024-09-21T03:27:17.597889+0000","last_peered":"2024-09-21T03:27:17.597889+0000","last_clean":"2024-09-21T03:27:17.597889+0000","last_became_active":"2024-09-21T03:27:16.572470+0000","last_became_peered":"2024-09-21T03:27:16.572470+0000","last_unstale":"2024-09-21T03:27:17.597889+0000","last_undegraded":"2024-09-21T03:27:17.597889+0000","last_fullsized":"2024-09-21T03:27:17.597889+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:40.398460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-21T03:27:16.567064+0000","last_change":"2024-09-21T03:27:16.567064+0000","last_active":"2024-09-21T03:27:16.550895+0000","last_peered":"2024-09-21T03:27:16.550895+0000","last_clean":"2024-09-21T03:27:16.550895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:27:16.567064+0000","last_undegraded":"2024-09-21T03:27:16.567064+0000","last_fullsized":"2024-09-21T03:27:16.567064+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.566307+0000","last_change":"2024-09-21T03:27:16.574985+0000","last_active":"2024-09-21T03:27:17.566307+0000","last_peered":"2024-09-21T03:27:17.566307+0000","last_clean":"2024-09-21T03:27:17.566307+0000","last_became_active":"2024-09-21T03:27:16.574650+0000","last_became_peered":"2024-09-21T03:27:16.574650+0000","last_unstale":"2024-09-21T03:27:17.566307+0000","last_undegraded":"2024-09-21T03:27:17.566307+0000","last_fullsized":"2024-09-21T03:27:17.566307+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:00.204114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.590179+0000","last_change":"2024-09-21T03:27:17.589346+0000","last_active":"2024-09-21T03:27:17.590179+0000","last_peered":"2024-09-21T03:27:17.590179+0000","last_clean":"2024-09-21T03:27:17.590179+0000","last_became_active":"2024-09-21T03:27:17.589034+0000","last_became_peered":"2024-09-21T03:27:17.589034+0000","last_unstale":"2024-09-21T03:27:17.590179+0000","last_undegraded":"2024-09-21T03:27:17.590179+0000","last_fullsized":"2024-09-21T03:27:17.590179+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:21:44.303210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.574173+0000","last_change":"2024-09-21T03:27:16.576083+0000","last_active":"2024-09-21T03:27:17.574173+0000","last_peered":"2024-09-21T03:27:17.574173+0000","last_clean":"2024-09-21T03:27:17.574173+0000","last_became_active":"2024-09-21T03:27:16.575789+0000","last_became_peered":"2024-09-21T03:27:16.575789+0000","last_unstale":"2024-09-21T03:27:17.574173+0000","last_undegraded":"2024-09-21T03:27:17.574173+0000","last_fullsized":"2024-09-21T03:27:17.574173+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:35.838462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.580459+0000","last_change":"2024-09-21T03:27:17.576643+0000","last_active":"2024-09-21T03:27:17.580459+0000","last_peered":"2024-09-21T03:27:17.580459+0000","last_clean":"2024-09-21T03:27:17.580459+0000","last_became_active":"2024-09-21T03:27:17.576339+0000","last_became_peered":"2024-09-21T03:27:17.576339+0000","last_unstale":"2024-09-21T03:27:17.580459+0000","last_undegraded":"2024-09-21T03:27:17.580459+0000","last_fullsized":"2024-09-21T03:27:17.580459+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:41.117745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"139'8","reported_seq":23,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.584534+0000","last_change":"2024-09-21T03:27:16.574966+0000","last_active":"2024-09-21T03:27:18.584534+0000","last_peered":"2024-09-21T03:27:18.584534+0000","last_clean":"2024-09-21T03:27:18.584534+0000","last_became_active":"2024-09-21T03:27:16.573876+0000","last_became_peered":"2024-09-21T03:27:16.573876+0000","last_unstale":"2024-09-21T03:27:18.584534+0000","last_undegraded":"2024-09-21T03:27:18.584534+0000","last_fullsized":"2024-09-21T03:27:18.584534+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:27.555326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.578547+0000","last_change":"2024-09-21T03:27:17.577237+0000","last_active":"2024-09-21T03:27:17.578547+0000","last_peered":"2024-09-21T03:27:17.578547+0000","last_clean":"2024-09-21T03:27:17.578547+0000","last_became_active":"2024-09-21T03:27:17.576428+0000","last_became_peered":"2024-09-21T03:27:17.576428+0000","last_unstale":"2024-09-21T03:27:17.578547+0000","last_undegraded":"2024-09-21T03:27:17.578547+0000","last_fullsized":"2024-09-21T03:27:17.578547+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:50:28.451810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"139'1","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.594994+0000","last_change":"2024-09-21T03:27:16.580043+0000","last_active":"2024-09-21T03:27:17.594994+0000","last_peered":"2024-09-21T03:27:17.594994+0000","last_clean":"2024-09-21T03:27:17.594994+0000","last_became_active":"2024-09-21T03:27:16.579642+0000","last_became_peered":"2024-09-21T03:27:16.579642+0000","last_unstale":"2024-09-21T03:27:17.594994+0000","last_undegraded":"2024-09-21T03:27:17.594994+0000","last_fullsized":"2024-09-21T03:27:17.594994+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:43.548214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.590698+0000","last_change":"2024-09-21T03:27:17.588315+0000","last_active":"2024-09-21T03:27:17.590698+0000","last_peered":"2024-09-21T03:27:17.590698+0000","last_clean":"2024-09-21T03:27:17.590698+0000","last_became_active":"2024-09-21T03:27:17.587763+0000","last_became_peered":"2024-09-21T03:27:17.587763+0000","last_unstale":"2024-09-21T03:27:17.590698+0000","last_undegraded":"2024-09-21T03:27:17.590698+0000","last_fullsized":"2024-09-21T03:27:17.590698+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:24.863592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"139'2","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.597586+0000","last_change":"2024-09-21T03:27:16.576595+0000","last_active":"2024-09-21T03:27:17.597586+0000","last_peered":"2024-09-21T03:27:17.597586+0000","last_clean":"2024-09-21T03:27:17.597586+0000","last_became_active":"2024-09-21T03:27:16.576288+0000","last_became_peered":"2024-09-21T03:27:16.576288+0000","last_unstale":"2024-09-21T03:27:17.597586+0000","last_undegraded":"2024-09-21T03:27:17.597586+0000","last_fullsized":"2024-09-21T03:27:17.597586+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:34.408303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.586957+0000","last_change":"2024-09-21T03:27:17.583424+0000","last_active":"2024-09-21T03:27:17.586957+0000","last_peered":"2024-09-21T03:27:17.586957+0000","last_clean":"2024-09-21T03:27:17.586957+0000","last_became_active":"2024-09-21T03:27:17.583133+0000","last_became_peered":"2024-09-21T03:27:17.583133+0000","last_unstale":"2024-09-21T03:27:17.586957+0000","last_undegraded":"2024-09-21T03:27:17.586957+0000","last_fullsized":"2024-09-21T03:27:17.586957+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:40.948966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"139'1","reported_seq":16,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583389+0000","last_change":"2024-09-21T03:27:16.580912+0000","last_active":"2024-09-21T03:27:18.583389+0000","last_peered":"2024-09-21T03:27:18.583389+0000","last_clean":"2024-09-21T03:27:18.583389+0000","last_became_active":"2024-09-21T03:27:16.580592+0000","last_became_peered":"2024-09-21T03:27:16.580592+0000","last_unstale":"2024-09-21T03:27:18.583389+0000","last_undegraded":"2024-09-21T03:27:18.583389+0000","last_fullsized":"2024-09-21T03:27:18.583389+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:41.558318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-21T03:27:16.566043+0000","last_change":"2024-09-21T03:27:16.566043+0000","last_active":"2024-09-21T03:27:16.550895+0000","last_peered":"2024-09-21T03:27:16.550895+0000","last_clean":"2024-09-21T03:27:16.550895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:27:16.566043+0000","last_undegraded":"2024-09-21T03:27:16.566043+0000","last_fullsized":"2024-09-21T03:27:16.566043+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583564+0000","last_change":"2024-09-21T03:27:16.576719+0000","last_active":"2024-09-21T03:27:18.583564+0000","last_peered":"2024-09-21T03:27:18.583564+0000","last_clean":"2024-09-21T03:27:18.583564+0000","last_became_active":"2024-09-21T03:27:16.576402+0000","last_became_peered":"2024-09-21T03:27:16.576402+0000","last_unstale":"2024-09-21T03:27:18.583564+0000","last_undegraded":"2024-09-21T03:27:18.583564+0000","last_fullsized":"2024-09-21T03:27:18.583564+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:41.780927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.580875+0000","last_change":"2024-09-21T03:27:17.578483+0000","last_active":"2024-09-21T03:27:17.580875+0000","last_peered":"2024-09-21T03:27:17.580875+0000","last_clean":"2024-09-21T03:27:17.580875+0000","last_became_active":"2024-09-21T03:27:17.578151+0000","last_became_peered":"2024-09-21T03:27:17.578151+0000","last_unstale":"2024-09-21T03:27:17.580875+0000","last_undegraded":"2024-09-21T03:27:17.580875+0000","last_fullsized":"2024-09-21T03:27:17.580875+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:16.441422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"139'2","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.597788+0000","last_change":"2024-09-21T03:27:16.577952+0000","last_active":"2024-09-21T03:27:17.597788+0000","last_peered":"2024-09-21T03:27:17.597788+0000","last_clean":"2024-09-21T03:27:17.597788+0000","last_became_active":"2024-09-21T03:27:16.576576+0000","last_became_peered":"2024-09-21T03:27:16.576576+0000","last_unstale":"2024-09-21T03:27:17.597788+0000","last_undegraded":"2024-09-21T03:27:17.597788+0000","last_fullsized":"2024-09-21T03:27:17.597788+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:12.431154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-21T03:27:16.566345+0000","last_change":"2024-09-21T03:27:16.566345+0000","last_active":"2024-09-21T03:27:16.550895+0000","last_peered":"2024-09-21T03:27:16.550895+0000","last_clean":"2024-09-21T03:27:16.550895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:27:16.566345+0000","last_undegraded":"2024-09-21T03:27:16.566345+0000","last_fullsized":"2024-09-21T03:27:16.566345+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583323+0000","last_change":"2024-09-21T03:27:16.577488+0000","last_active":"2024-09-21T03:27:18.583323+0000","last_peered":"2024-09-21T03:27:18.583323+0000","last_clean":"2024-09-21T03:27:18.583323+0000","last_became_active":"2024-09-21T03:27:16.577197+0000","last_became_peered":"2024-09-21T03:27:16.577197+0000","last_unstale":"2024-09-21T03:27:18.583323+0000","last_undegraded":"2024-09-21T03:27:18.583323+0000","last_fullsized":"2024-09-21T03:27:18.583323+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:17.944770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583365+0000","last_change":"2024-09-21T03:27:17.582910+0000","last_active":"2024-09-21T03:27:18.583365+0000","last_peered":"2024-09-21T03:27:18.583365+0000","last_clean":"2024-09-21T03:27:18.583365+0000","last_became_active":"2024-09-21T03:27:17.582582+0000","last_became_peered":"2024-09-21T03:27:17.582582+0000","last_unstale":"2024-09-21T03:27:18.583365+0000","last_undegraded":"2024-09-21T03:27:18.583365+0000","last_fullsized":"2024-09-21T03:27:18.583365+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:44.083723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.576051+0000","last_change":"2024-09-21T03:27:16.581246+0000","last_active":"2024-09-21T03:27:17.576051+0000","last_peered":"2024-09-21T03:27:17.576051+0000","last_clean":"2024-09-21T03:27:17.576051+0000","last_became_active":"2024-09-21T03:27:16.580919+0000","last_became_peered":"2024-09-21T03:27:16.580919+0000","last_unstale":"2024-09-21T03:27:17.576051+0000","last_undegraded":"2024-09-21T03:27:17.576051+0000","last_fullsized":"2024-09-21T03:27:17.576051+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:25.979160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.579424+0000","last_change":"2024-09-21T03:27:17.577791+0000","last_active":"2024-09-21T03:27:17.579424+0000","last_peered":"2024-09-21T03:27:17.579424+0000","last_clean":"2024-09-21T03:27:17.579424+0000","last_became_active":"2024-09-21T03:27:17.577502+0000","last_became_peered":"2024-09-21T03:27:17.577502+0000","last_unstale":"2024-09-21T03:27:17.579424+0000","last_undegraded":"2024-09-21T03:27:17.579424+0000","last_fullsized":"2024-09-21T03:27:17.579424+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:24.181167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583144+0000","last_change":"2024-09-21T03:27:16.578401+0000","last_active":"2024-09-21T03:27:18.583144+0000","last_peered":"2024-09-21T03:27:18.583144+0000","last_clean":"2024-09-21T03:27:18.583144+0000","last_became_active":"2024-09-21T03:27:16.578077+0000","last_became_peered":"2024-09-21T03:27:16.578077+0000","last_unstale":"2024-09-21T03:27:18.583144+0000","last_undegraded":"2024-09-21T03:27:18.583144+0000","last_fullsized":"2024-09-21T03:27:18.583144+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:44:50.471830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.582932+0000","last_change":"2024-09-21T03:27:17.578316+0000","last_active":"2024-09-21T03:27:17.582932+0000","last_peered":"2024-09-21T03:27:17.582932+0000","last_clean":"2024-09-21T03:27:17.582932+0000","last_became_active":"2024-09-21T03:27:17.578010+0000","last_became_peered":"2024-09-21T03:27:17.578010+0000","last_unstale":"2024-09-21T03:27:17.582932+0000","last_undegraded":"2024-09-21T03:27:17.582932+0000","last_fullsized":"2024-09-21T03:27:17.582932+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:17.101621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"139'2","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.595072+0000","last_change":"2024-09-21T03:27:16.578670+0000","last_active":"2024-09-21T03:27:17.595072+0000","last_peered":"2024-09-21T03:27:17.595072+0000","last_clean":"2024-09-21T03:27:17.595072+0000","last_became_active":"2024-09-21T03:27:16.578359+0000","last_became_peered":"2024-09-21T03:27:16.578359+0000","last_unstale":"2024-09-21T03:27:17.595072+0000","last_undegraded":"2024-09-21T03:27:17.595072+0000","last_fullsized":"2024-09-21T03:27:17.595072+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:52.045055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-21T03:27:16.568429+0000","last_change":"2024-09-21T03:27:16.568429+0000","last_active":"2024-09-21T03:27:16.550895+0000","last_peered":"2024-09-21T03:27:16.550895+0000","last_clean":"2024-09-21T03:27:16.550895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:27:16.568429+0000","last_undegraded":"2024-09-21T03:27:16.568429+0000","last_fullsized":"2024-09-21T03:27:16.568429+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"139'1","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.580468+0000","last_change":"2024-09-21T03:27:16.580402+0000","last_active":"2024-09-21T03:27:18.580468+0000","last_peered":"2024-09-21T03:27:18.580468+0000","last_clean":"2024-09-21T03:27:18.580468+0000","last_became_active":"2024-09-21T03:27:16.580078+0000","last_became_peered":"2024-09-21T03:27:16.580078+0000","last_unstale":"2024-09-21T03:27:18.580468+0000","last_undegraded":"2024-09-21T03:27:18.580468+0000","last_fullsized":"2024-09-21T03:27:18.580468+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:07.923601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.584403+0000","last_change":"2024-09-21T03:27:17.580829+0000","last_active":"2024-09-21T03:27:17.584403+0000","last_peered":"2024-09-21T03:27:17.584403+0000","last_clean":"2024-09-21T03:27:17.584403+0000","last_became_active":"2024-09-21T03:27:17.580540+0000","last_became_peered":"2024-09-21T03:27:17.580540+0000","last_unstale":"2024-09-21T03:27:17.584403+0000","last_undegraded":"2024-09-21T03:27:17.584403+0000","last_fullsized":"2024-09-21T03:27:17.584403+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:00.398615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.586553+0000","last_change":"2024-09-21T03:27:16.574812+0000","last_active":"2024-09-21T03:27:18.586553+0000","last_peered":"2024-09-21T03:27:18.586553+0000","last_clean":"2024-09-21T03:27:18.586553+0000","last_became_active":"2024-09-21T03:27:16.574396+0000","last_became_peered":"2024-09-21T03:27:16.574396+0000","last_unstale":"2024-09-21T03:27:18.586553+0000","last_undegraded":"2024-09-21T03:27:18.586553+0000","last_fullsized":"2024-09-21T03:27:18.586553+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:03.610863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.576793+0000","last_change":"2024-09-21T03:27:17.574712+0000","last_active":"2024-09-21T03:27:17.576793+0000","last_peered":"2024-09-21T03:27:17.576793+0000","last_clean":"2024-09-21T03:27:17.576793+0000","last_became_active":"2024-09-21T03:27:17.574402+0000","last_became_peered":"2024-09-21T03:27:17.574402+0000","last_unstale":"2024-09-21T03:27:17.576793+0000","last_undegraded":"2024-09-21T03:27:17.576793+0000","last_fullsized":"2024-09-21T03:27:17.576793+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:55.408707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.565551+0000","last_change":"2024-09-21T03:27:16.579174+0000","last_active":"2024-09-21T03:27:17.565551+0000","last_peered":"2024-09-21T03:27:17.565551+0000","last_clean":"2024-09-21T03:27:17.565551+0000","last_became_active":"2024-09-21T03:27:16.578865+0000","last_became_peered":"2024-09-21T03:27:16.578865+0000","last_unstale":"2024-09-21T03:27:17.565551+0000","last_undegraded":"2024-09-21T03:27:17.565551+0000","last_fullsized":"2024-09-21T03:27:17.565551+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:23.331344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.581875+0000","last_change":"2024-09-21T03:27:17.578034+0000","last_active":"2024-09-21T03:27:17.581875+0000","last_peered":"2024-09-21T03:27:17.581875+0000","last_clean":"2024-09-21T03:27:17.581875+0000","last_became_active":"2024-09-21T03:27:17.576925+0000","last_became_peered":"2024-09-21T03:27:17.576925+0000","last_unstale":"2024-09-21T03:27:17.581875+0000","last_undegraded":"2024-09-21T03:27:17.581875+0000","last_fullsized":"2024-09-21T03:27:17.581875+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:56.497686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.584884+0000","last_change":"2024-09-21T03:27:16.574672+0000","last_active":"2024-09-21T03:27:18.584884+0000","last_peered":"2024-09-21T03:27:18.584884+0000","last_clean":"2024-09-21T03:27:18.584884+0000","last_became_active":"2024-09-21T03:27:16.573040+0000","last_became_peered":"2024-09-21T03:27:16.573040+0000","last_unstale":"2024-09-21T03:27:18.584884+0000","last_undegraded":"2024-09-21T03:27:18.584884+0000","last_fullsized":"2024-09-21T03:27:18.584884+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:38.629252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585226+0000","last_change":"2024-09-21T03:27:17.591453+0000","last_active":"2024-09-21T03:27:18.585226+0000","last_peered":"2024-09-21T03:27:18.585226+0000","last_clean":"2024-09-21T03:27:18.585226+0000","last_became_active":"2024-09-21T03:27:17.591101+0000","last_became_peered":"2024-09-21T03:27:17.591101+0000","last_unstale":"2024-09-21T03:27:18.585226+0000","last_undegraded":"2024-09-21T03:27:18.585226+0000","last_fullsized":"2024-09-21T03:27:18.585226+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:57.365059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.574722+0000","last_change":"2024-09-21T03:27:16.571816+0000","last_active":"2024-09-21T03:27:17.574722+0000","last_peered":"2024-09-21T03:27:17.574722+0000","last_clean":"2024-09-21T03:27:17.574722+0000","last_became_active":"2024-09-21T03:27:16.571475+0000","last_became_peered":"2024-09-21T03:27:16.571475+0000","last_unstale":"2024-09-21T03:27:17.574722+0000","last_undegraded":"2024-09-21T03:27:17.574722+0000","last_fullsized":"2024-09-21T03:27:17.574722+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:16.998561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-21T03:27:16.566417+0000","last_change":"2024-09-21T03:27:16.566417+0000","last_active":"2024-09-21T03:27:16.550895+0000","last_peered":"2024-09-21T03:27:16.550895+0000","last_clean":"2024-09-21T03:27:16.550895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:27:16.566417+0000","last_undegraded":"2024-09-21T03:27:16.566417+0000","last_fullsized":"2024-09-21T03:27:16.566417+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585945+0000","last_change":"2024-09-21T03:27:16.573639+0000","last_active":"2024-09-21T03:27:18.585945+0000","last_peered":"2024-09-21T03:27:18.585945+0000","last_clean":"2024-09-21T03:27:18.585945+0000","last_became_active":"2024-09-21T03:27:16.573163+0000","last_became_peered":"2024-09-21T03:27:16.573163+0000","last_unstale":"2024-09-21T03:27:18.585945+0000","last_undegraded":"2024-09-21T03:27:18.585945+0000","last_fullsized":"2024-09-21T03:27:18.585945+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:35.838462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.580486+0000","last_change":"2024-09-21T03:27:17.578123+0000","last_active":"2024-09-21T03:27:17.580486+0000","last_peered":"2024-09-21T03:27:17.580486+0000","last_clean":"2024-09-21T03:27:17.580486+0000","last_became_active":"2024-09-21T03:27:17.577792+0000","last_became_peered":"2024-09-21T03:27:17.577792+0000","last_unstale":"2024-09-21T03:27:17.580486+0000","last_undegraded":"2024-09-21T03:27:17.580486+0000","last_fullsized":"2024-09-21T03:27:17.580486+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:27.493816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.584498+0000","last_change":"2024-09-21T03:27:16.574180+0000","last_active":"2024-09-21T03:27:18.584498+0000","last_peered":"2024-09-21T03:27:18.584498+0000","last_clean":"2024-09-21T03:27:18.584498+0000","last_became_active":"2024-09-21T03:27:16.573439+0000","last_became_peered":"2024-09-21T03:27:16.573439+0000","last_unstale":"2024-09-21T03:27:18.584498+0000","last_undegraded":"2024-09-21T03:27:18.584498+0000","last_fullsized":"2024-09-21T03:27:18.584498+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:36.525290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.582958+0000","last_change":"2024-09-21T03:27:17.578054+0000","last_active":"2024-09-21T03:27:17.582958+0000","last_peered":"2024-09-21T03:27:17.582958+0000","last_clean":"2024-09-21T03:27:17.582958+0000","last_became_active":"2024-09-21T03:27:17.577746+0000","last_became_peered":"2024-09-21T03:27:17.577746+0000","last_unstale":"2024-09-21T03:27:17.582958+0000","last_undegraded":"2024-09-21T03:27:17.582958+0000","last_fullsized":"2024-09-21T03:27:17.582958+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:14.491408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585346+0000","last_change":"2024-09-21T03:27:16.575356+0000","last_active":"2024-09-21T03:27:18.585346+0000","last_peered":"2024-09-21T03:27:18.585346+0000","last_clean":"2024-09-21T03:27:18.585346+0000","last_became_active":"2024-09-21T03:27:16.574933+0000","last_became_peered":"2024-09-21T03:27:16.574933+0000","last_unstale":"2024-09-21T03:27:18.585346+0000","last_undegraded":"2024-09-21T03:27:18.585346+0000","last_fullsized":"2024-09-21T03:27:18.585346+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:11.636922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":334,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583233+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:27:18.583233+0000","last_peered":"2024-09-21T03:27:18.583233+0000","last_clean":"2024-09-21T03:27:18.583233+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:27:18.583233+0000","last_undegraded":"2024-09-21T03:27:18.583233+0000","last_fullsized":"2024-09-21T03:27:18.583233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509553,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33512,"kb_used_data":2316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338328,"statfs":{"total":96636764160,"available":96602447872,"internally_reserved":0,"allocated":2371584,"data_stored":1346178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509552,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32900,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338940,"statfs":{"total":96636764160,"available":96603074560,"internally_reserved":0,"allocated":1744896,"data_stored":747178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509551,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32904,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338936,"statfs":{"total":96636764160,"available":96603070464,"internally_reserved":0,"allocated":1748992,"data_stored":747760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509551,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32912,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338928,"statfs":{"total":96636764160,"available":96603062272,"internally_reserved":0,"allocated":1757184,"data_stored":748838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509552,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32896,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338944,"statfs":{"total":96636764160,"available":96603078656,"internally_reserved":0,"allocated":1744896,"data_stored":747190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509552,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37056,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334784,"statfs":{"total":96636764160,"available":96598818816,"internally_reserved":0,"allocated":1744896,"data_stored":747246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509552,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37056,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334784,"statfs":{"total":96636764160,"available":96598818816,"internally_reserved":0,"allocated":1744896,"data_stored":747190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574959,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33444,"kb_used_data":2256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338396,"statfs":{"total":96636764160,"available":96602517504,"internally_reserved":0,"allocated":2310144,"data_stored":1324474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:27:21.945 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:27:22.093 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.091+0000 7f71bd562640 1 -- 172.21.15.105:0/103964295 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71b80d2ed0 msgr2=0x7f71b80d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:22.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.091+0000 7f71bd562640 1 --2- 172.21.15.105:0/103964295 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71b80d2ed0 0x7f71b80d1a80 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f71a8005fd0 tx=0x7f71a802aab0 comp rx=0 tx=0).stop 2024-09-21T03:27:22.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.091+0000 7f71bd562640 1 -- 172.21.15.105:0/103964295 shutdown_connections 2024-09-21T03:27:22.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.091+0000 7f71bd562640 1 --2- 172.21.15.105:0/103964295 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71b80d2ed0 0x7f71b80d1a80 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:22.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.091+0000 7f71bd562640 1 -- 172.21.15.105:0/103964295 >> 172.21.15.105:0/103964295 conn(0x7f71b808bfc0 msgr2=0x7f71b809d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:22.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.091+0000 7f71bd562640 1 -- 172.21.15.105:0/103964295 shutdown_connections 2024-09-21T03:27:22.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.091+0000 7f71bd562640 1 -- 172.21.15.105:0/103964295 wait complete. 2024-09-21T03:27:22.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.092+0000 7f71bd562640 1 Processor -- start 2024-09-21T03:27:22.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.093+0000 7f71bd562640 1 -- start start 2024-09-21T03:27:22.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.094+0000 7f71bd562640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f71b80b9b70 0x7f71b815dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:22.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.094+0000 7f71bd562640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71b80cf7a0 0x7f71b80d3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:22.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.094+0000 7f71bd562640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71b80d2ed0 0x7f71b80d4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:22.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.094+0000 7f71bd562640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f71b8162f70 con 0x7f71b80cf7a0 2024-09-21T03:27:22.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.094+0000 7f71bd562640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f71b8162df0 con 0x7f71b80d2ed0 2024-09-21T03:27:22.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.094+0000 7f71bd562640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f71b81630f0 con 0x7f71b80b9b70 2024-09-21T03:27:22.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.094+0000 7f71b67fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71b80cf7a0 0x7f71b80d3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:22.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.094+0000 7f71b67fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71b80cf7a0 0x7f71b80d3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40136/0 (socket says 172.21.15.105:40136) 2024-09-21T03:27:22.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.094+0000 7f71b67fc640 1 -- 172.21.15.105:0/3818037966 learned_addr learned my addr 172.21.15.105:0/3818037966 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:22.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.094+0000 7f71b77fe640 1 --2- 172.21.15.105:0/3818037966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71b80d2ed0 0x7f71b80d4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:22.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.094+0000 7f71b6ffd640 1 --2- 172.21.15.105:0/3818037966 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f71b80b9b70 0x7f71b815dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:22.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.094+0000 7f71b67fc640 1 -- 172.21.15.105:0/3818037966 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f71b80b9b70 msgr2=0x7f71b815dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:22.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.094+0000 7f71b67fc640 1 --2- 172.21.15.105:0/3818037966 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f71b80b9b70 0x7f71b815dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:22.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.094+0000 7f71b67fc640 1 -- 172.21.15.105:0/3818037966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71b80d2ed0 msgr2=0x7f71b80d4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:22.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.094+0000 7f71b67fc640 1 --2- 172.21.15.105:0/3818037966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71b80d2ed0 0x7f71b80d4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:22.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.094+0000 7f71b67fc640 1 -- 172.21.15.105:0/3818037966 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71b80a1f80 con 0x7f71b80cf7a0 2024-09-21T03:27:22.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.094+0000 7f71b6ffd640 1 --2- 172.21.15.105:0/3818037966 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f71b80b9b70 0x7f71b815dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:27:22.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.094+0000 7f71b67fc640 1 --2- 172.21.15.105:0/3818037966 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71b80cf7a0 0x7f71b80d3ff0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f71ac00c3a0 tx=0x7f71ac00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:22.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.094+0000 7f719f7fe640 1 -- 172.21.15.105:0/3818037966 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ac017070 con 0x7f71b80cf7a0 2024-09-21T03:27:22.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.095+0000 7f719f7fe640 1 -- 172.21.15.105:0/3818037966 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71ac0053c0 con 0x7f71b80cf7a0 2024-09-21T03:27:22.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.095+0000 7f71bd562640 1 -- 172.21.15.105:0/3818037966 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71b81f95f0 con 0x7f71b80cf7a0 2024-09-21T03:27:22.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.095+0000 7f719f7fe640 1 -- 172.21.15.105:0/3818037966 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ac003850 con 0x7f71b80cf7a0 2024-09-21T03:27:22.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.095+0000 7f71bd562640 1 -- 172.21.15.105:0/3818037966 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71b81f9bb0 con 0x7f71b80cf7a0 2024-09-21T03:27:22.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.095+0000 7f71bd562640 1 -- 172.21.15.105:0/3818037966 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71b80d1a80 con 0x7f71b80cf7a0 2024-09-21T03:27:22.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.096+0000 7f719f7fe640 1 -- 172.21.15.105:0/3818037966 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f71ac01a070 con 0x7f71b80cf7a0 2024-09-21T03:27:22.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.097+0000 7f719f7fe640 1 --2- 172.21.15.105:0/3818037966 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f71a4078b90 0x7f71a407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:22.100 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.097+0000 7f719f7fe640 1 -- 172.21.15.105:0/3818037966 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5709+0+0 (secure 0 0 0) 0x7f71ac09a030 con 0x7f71b80cf7a0 2024-09-21T03:27:22.101 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.097+0000 7f71b6ffd640 1 --2- 172.21.15.105:0/3818037966 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f71a4078b90 0x7f71a407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:22.101 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.098+0000 7f71b6ffd640 1 --2- 172.21.15.105:0/3818037966 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f71a4078b90 0x7f71a407b0a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f71a8035000 tx=0x7f71a8038040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:22.104 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.101+0000 7f719f7fe640 1 -- 172.21.15.105:0/3818037966 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f71ac061e20 con 0x7f71b80cf7a0 2024-09-21T03:27:22.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.274+0000 7f71bd562640 1 -- 172.21.15.105:0/3818037966 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f71b80a1d10 con 0x7f71a4078b90 2024-09-21T03:27:22.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.279+0000 7f719f7fe640 1 -- 172.21.15.105:0/3818037966 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251647 (secure 0 0 0) 0x7f71b80a1d10 con 0x7f71a4078b90 2024-09-21T03:27:22.284 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:27:22.285 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:27:22.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.282+0000 7f71bd562640 1 -- 172.21.15.105:0/3818037966 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f71a4078b90 msgr2=0x7f71a407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:22.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.282+0000 7f71bd562640 1 --2- 172.21.15.105:0/3818037966 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f71a4078b90 0x7f71a407b0a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f71a8035000 tx=0x7f71a8038040 comp rx=0 tx=0).stop 2024-09-21T03:27:22.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.282+0000 7f71bd562640 1 -- 172.21.15.105:0/3818037966 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71b80cf7a0 msgr2=0x7f71b80d3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:22.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.282+0000 7f71bd562640 1 --2- 172.21.15.105:0/3818037966 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71b80cf7a0 0x7f71b80d3ff0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f71ac00c3a0 tx=0x7f71ac00c860 comp rx=0 tx=0).stop 2024-09-21T03:27:22.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.282+0000 7f71bd562640 1 -- 172.21.15.105:0/3818037966 shutdown_connections 2024-09-21T03:27:22.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.282+0000 7f71bd562640 1 --2- 172.21.15.105:0/3818037966 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f71a4078b90 0x7f71a407b0a0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:22.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.282+0000 7f71bd562640 1 --2- 172.21.15.105:0/3818037966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71b80d2ed0 0x7f71b80d4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:22.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.282+0000 7f71bd562640 1 --2- 172.21.15.105:0/3818037966 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71b80cf7a0 0x7f71b80d3ff0 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:22.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.282+0000 7f71bd562640 1 --2- 172.21.15.105:0/3818037966 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f71b80b9b70 0x7f71b815dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:22.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.282+0000 7f71bd562640 1 -- 172.21.15.105:0/3818037966 >> 172.21.15.105:0/3818037966 conn(0x7f71b808bfc0 msgr2=0x7f71b806edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:22.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.282+0000 7f71bd562640 1 -- 172.21.15.105:0/3818037966 shutdown_connections 2024-09-21T03:27:22.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.282+0000 7f71bd562640 1 -- 172.21.15.105:0/3818037966 wait complete. 2024-09-21T03:27:22.296 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":406,"stamp":"2024-09-21T03:27:21.423079+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":272680,"kb_used_data":14812,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754702040,"statfs":{"total":773094113280,"available":772814888960,"internally_reserved":0,"allocated":15167488,"data_stored":7156054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.870896"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583647+0000","last_change":"2024-09-21T03:27:17.581755+0000","last_active":"2024-09-21T03:27:18.583647+0000","last_peered":"2024-09-21T03:27:18.583647+0000","last_clean":"2024-09-21T03:27:18.583647+0000","last_became_active":"2024-09-21T03:27:17.581133+0000","last_became_peered":"2024-09-21T03:27:17.581133+0000","last_unstale":"2024-09-21T03:27:18.583647+0000","last_undegraded":"2024-09-21T03:27:18.583647+0000","last_fullsized":"2024-09-21T03:27:18.583647+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:43.005587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.586375+0000","last_change":"2024-09-21T03:27:17.573023+0000","last_active":"2024-09-21T03:27:18.586375+0000","last_peered":"2024-09-21T03:27:18.586375+0000","last_clean":"2024-09-21T03:27:18.586375+0000","last_became_active":"2024-09-21T03:27:17.572695+0000","last_became_peered":"2024-09-21T03:27:17.572695+0000","last_unstale":"2024-09-21T03:27:18.586375+0000","last_undegraded":"2024-09-21T03:27:18.586375+0000","last_fullsized":"2024-09-21T03:27:18.586375+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:03.003218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.592496+0000","last_change":"2024-09-21T03:27:17.586788+0000","last_active":"2024-09-21T03:27:17.592496+0000","last_peered":"2024-09-21T03:27:17.592496+0000","last_clean":"2024-09-21T03:27:17.592496+0000","last_became_active":"2024-09-21T03:27:17.586413+0000","last_became_peered":"2024-09-21T03:27:17.586413+0000","last_unstale":"2024-09-21T03:27:17.592496+0000","last_undegraded":"2024-09-21T03:27:17.592496+0000","last_fullsized":"2024-09-21T03:27:17.592496+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:13.401161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.584595+0000","last_change":"2024-09-21T03:27:17.580965+0000","last_active":"2024-09-21T03:27:17.584595+0000","last_peered":"2024-09-21T03:27:17.584595+0000","last_clean":"2024-09-21T03:27:17.584595+0000","last_became_active":"2024-09-21T03:27:17.580581+0000","last_became_peered":"2024-09-21T03:27:17.580581+0000","last_unstale":"2024-09-21T03:27:17.584595+0000","last_undegraded":"2024-09-21T03:27:17.584595+0000","last_fullsized":"2024-09-21T03:27:17.584595+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:34.308409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.586111+0000","last_change":"2024-09-21T03:27:17.585238+0000","last_active":"2024-09-21T03:27:18.586111+0000","last_peered":"2024-09-21T03:27:18.586111+0000","last_clean":"2024-09-21T03:27:18.586111+0000","last_became_active":"2024-09-21T03:27:17.583972+0000","last_became_peered":"2024-09-21T03:27:17.583972+0000","last_unstale":"2024-09-21T03:27:18.586111+0000","last_undegraded":"2024-09-21T03:27:18.586111+0000","last_fullsized":"2024-09-21T03:27:18.586111+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:29.413682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.584474+0000","last_change":"2024-09-21T03:27:17.580318+0000","last_active":"2024-09-21T03:27:17.584474+0000","last_peered":"2024-09-21T03:27:17.584474+0000","last_clean":"2024-09-21T03:27:17.584474+0000","last_became_active":"2024-09-21T03:27:17.580006+0000","last_became_peered":"2024-09-21T03:27:17.580006+0000","last_unstale":"2024-09-21T03:27:17.584474+0000","last_undegraded":"2024-09-21T03:27:17.584474+0000","last_fullsized":"2024-09-21T03:27:17.584474+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:45:23.305894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-21T03:27:16.570177+0000","last_change":"2024-09-21T03:27:16.570177+0000","last_active":"2024-09-21T03:27:16.550895+0000","last_peered":"2024-09-21T03:27:16.550895+0000","last_clean":"2024-09-21T03:27:16.550895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:27:16.570177+0000","last_undegraded":"2024-09-21T03:27:16.570177+0000","last_fullsized":"2024-09-21T03:27:16.570177+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585808+0000","last_change":"2024-09-21T03:27:17.586097+0000","last_active":"2024-09-21T03:27:18.585808+0000","last_peered":"2024-09-21T03:27:18.585808+0000","last_clean":"2024-09-21T03:27:18.585808+0000","last_became_active":"2024-09-21T03:27:17.585734+0000","last_became_peered":"2024-09-21T03:27:17.585734+0000","last_unstale":"2024-09-21T03:27:18.585808+0000","last_undegraded":"2024-09-21T03:27:18.585808+0000","last_fullsized":"2024-09-21T03:27:18.585808+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:21:44.303210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.586651+0000","last_change":"2024-09-21T03:27:17.586773+0000","last_active":"2024-09-21T03:27:18.586651+0000","last_peered":"2024-09-21T03:27:18.586651+0000","last_clean":"2024-09-21T03:27:18.586651+0000","last_became_active":"2024-09-21T03:27:17.586439+0000","last_became_peered":"2024-09-21T03:27:17.586439+0000","last_unstale":"2024-09-21T03:27:18.586651+0000","last_undegraded":"2024-09-21T03:27:18.586651+0000","last_fullsized":"2024-09-21T03:27:18.586651+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:34.474168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.586400+0000","last_change":"2024-09-21T03:27:17.577732+0000","last_active":"2024-09-21T03:27:18.586400+0000","last_peered":"2024-09-21T03:27:18.586400+0000","last_clean":"2024-09-21T03:27:18.586400+0000","last_became_active":"2024-09-21T03:27:17.577442+0000","last_became_peered":"2024-09-21T03:27:17.577442+0000","last_unstale":"2024-09-21T03:27:18.586400+0000","last_undegraded":"2024-09-21T03:27:18.586400+0000","last_fullsized":"2024-09-21T03:27:18.586400+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:18:21.010195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.586106+0000","last_change":"2024-09-21T03:27:17.585024+0000","last_active":"2024-09-21T03:27:18.586106+0000","last_peered":"2024-09-21T03:27:18.586106+0000","last_clean":"2024-09-21T03:27:18.586106+0000","last_became_active":"2024-09-21T03:27:17.584681+0000","last_became_peered":"2024-09-21T03:27:17.584681+0000","last_unstale":"2024-09-21T03:27:18.586106+0000","last_undegraded":"2024-09-21T03:27:18.586106+0000","last_fullsized":"2024-09-21T03:27:18.586106+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:16.877998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.586553+0000","last_change":"2024-09-21T03:27:17.573714+0000","last_active":"2024-09-21T03:27:18.586553+0000","last_peered":"2024-09-21T03:27:18.586553+0000","last_clean":"2024-09-21T03:27:18.586553+0000","last_became_active":"2024-09-21T03:27:17.573344+0000","last_became_peered":"2024-09-21T03:27:17.573344+0000","last_unstale":"2024-09-21T03:27:18.586553+0000","last_undegraded":"2024-09-21T03:27:18.586553+0000","last_fullsized":"2024-09-21T03:27:18.586553+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:16:50.560426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.583400+0000","last_change":"2024-09-21T03:27:17.580024+0000","last_active":"2024-09-21T03:27:17.583400+0000","last_peered":"2024-09-21T03:27:17.583400+0000","last_clean":"2024-09-21T03:27:17.583400+0000","last_became_active":"2024-09-21T03:27:17.579693+0000","last_became_peered":"2024-09-21T03:27:17.579693+0000","last_unstale":"2024-09-21T03:27:17.583400+0000","last_undegraded":"2024-09-21T03:27:17.583400+0000","last_fullsized":"2024-09-21T03:27:17.583400+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:27:17.606293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.579208+0000","last_change":"2024-09-21T03:27:17.573051+0000","last_active":"2024-09-21T03:27:17.579208+0000","last_peered":"2024-09-21T03:27:17.579208+0000","last_clean":"2024-09-21T03:27:17.579208+0000","last_became_active":"2024-09-21T03:27:17.572714+0000","last_became_peered":"2024-09-21T03:27:17.572714+0000","last_unstale":"2024-09-21T03:27:17.579208+0000","last_undegraded":"2024-09-21T03:27:17.579208+0000","last_fullsized":"2024-09-21T03:27:17.579208+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:31.027265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583130+0000","last_change":"2024-09-21T03:27:17.581234+0000","last_active":"2024-09-21T03:27:18.583130+0000","last_peered":"2024-09-21T03:27:18.583130+0000","last_clean":"2024-09-21T03:27:18.583130+0000","last_became_active":"2024-09-21T03:27:17.580865+0000","last_became_peered":"2024-09-21T03:27:17.580865+0000","last_unstale":"2024-09-21T03:27:18.583130+0000","last_undegraded":"2024-09-21T03:27:18.583130+0000","last_fullsized":"2024-09-21T03:27:18.583130+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:29:44.168728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-21T03:27:16.569726+0000","last_change":"2024-09-21T03:27:16.569726+0000","last_active":"2024-09-21T03:27:16.550895+0000","last_peered":"2024-09-21T03:27:16.550895+0000","last_clean":"2024-09-21T03:27:16.550895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:27:16.569726+0000","last_undegraded":"2024-09-21T03:27:16.569726+0000","last_fullsized":"2024-09-21T03:27:16.569726+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.587675+0000","last_change":"2024-09-21T03:27:17.585074+0000","last_active":"2024-09-21T03:27:17.587675+0000","last_peered":"2024-09-21T03:27:17.587675+0000","last_clean":"2024-09-21T03:27:17.587675+0000","last_became_active":"2024-09-21T03:27:17.584763+0000","last_became_peered":"2024-09-21T03:27:17.584763+0000","last_unstale":"2024-09-21T03:27:17.587675+0000","last_undegraded":"2024-09-21T03:27:17.587675+0000","last_fullsized":"2024-09-21T03:27:17.587675+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:16:05.884637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.581363+0000","last_change":"2024-09-21T03:27:17.576376+0000","last_active":"2024-09-21T03:27:17.581363+0000","last_peered":"2024-09-21T03:27:17.581363+0000","last_clean":"2024-09-21T03:27:17.581363+0000","last_became_active":"2024-09-21T03:27:17.576094+0000","last_became_peered":"2024-09-21T03:27:17.576094+0000","last_unstale":"2024-09-21T03:27:17.581363+0000","last_undegraded":"2024-09-21T03:27:17.581363+0000","last_fullsized":"2024-09-21T03:27:17.581363+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:56.640317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.588809+0000","last_change":"2024-09-21T03:27:17.585841+0000","last_active":"2024-09-21T03:27:17.588809+0000","last_peered":"2024-09-21T03:27:17.588809+0000","last_clean":"2024-09-21T03:27:17.588809+0000","last_became_active":"2024-09-21T03:27:17.585539+0000","last_became_peered":"2024-09-21T03:27:17.585539+0000","last_unstale":"2024-09-21T03:27:17.588809+0000","last_undegraded":"2024-09-21T03:27:17.588809+0000","last_fullsized":"2024-09-21T03:27:17.588809+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:01.563086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.580419+0000","last_change":"2024-09-21T03:27:17.575335+0000","last_active":"2024-09-21T03:27:17.580419+0000","last_peered":"2024-09-21T03:27:17.580419+0000","last_clean":"2024-09-21T03:27:17.580419+0000","last_became_active":"2024-09-21T03:27:17.573625+0000","last_became_peered":"2024-09-21T03:27:17.573625+0000","last_unstale":"2024-09-21T03:27:17.580419+0000","last_undegraded":"2024-09-21T03:27:17.580419+0000","last_fullsized":"2024-09-21T03:27:17.580419+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:10.758459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.587667+0000","last_change":"2024-09-21T03:27:17.585062+0000","last_active":"2024-09-21T03:27:17.587667+0000","last_peered":"2024-09-21T03:27:17.587667+0000","last_clean":"2024-09-21T03:27:17.587667+0000","last_became_active":"2024-09-21T03:27:17.584730+0000","last_became_peered":"2024-09-21T03:27:17.584730+0000","last_unstale":"2024-09-21T03:27:17.587667+0000","last_undegraded":"2024-09-21T03:27:17.587667+0000","last_fullsized":"2024-09-21T03:27:17.587667+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:16.068461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.586508+0000","last_change":"2024-09-21T03:27:17.577064+0000","last_active":"2024-09-21T03:27:18.586508+0000","last_peered":"2024-09-21T03:27:18.586508+0000","last_clean":"2024-09-21T03:27:18.586508+0000","last_became_active":"2024-09-21T03:27:17.576634+0000","last_became_peered":"2024-09-21T03:27:17.576634+0000","last_unstale":"2024-09-21T03:27:18.586508+0000","last_undegraded":"2024-09-21T03:27:18.586508+0000","last_fullsized":"2024-09-21T03:27:18.586508+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:42.013551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.584371+0000","last_change":"2024-09-21T03:27:17.578564+0000","last_active":"2024-09-21T03:27:17.584371+0000","last_peered":"2024-09-21T03:27:17.584371+0000","last_clean":"2024-09-21T03:27:17.584371+0000","last_became_active":"2024-09-21T03:27:17.578274+0000","last_became_peered":"2024-09-21T03:27:17.578274+0000","last_unstale":"2024-09-21T03:27:17.584371+0000","last_undegraded":"2024-09-21T03:27:17.584371+0000","last_fullsized":"2024-09-21T03:27:17.584371+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:05.868201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585847+0000","last_change":"2024-09-21T03:27:17.582077+0000","last_active":"2024-09-21T03:27:18.585847+0000","last_peered":"2024-09-21T03:27:18.585847+0000","last_clean":"2024-09-21T03:27:18.585847+0000","last_became_active":"2024-09-21T03:27:17.581735+0000","last_became_peered":"2024-09-21T03:27:17.581735+0000","last_unstale":"2024-09-21T03:27:18.585847+0000","last_undegraded":"2024-09-21T03:27:18.585847+0000","last_fullsized":"2024-09-21T03:27:18.585847+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:03.545497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.592798+0000","last_change":"2024-09-21T03:27:17.585639+0000","last_active":"2024-09-21T03:27:17.592798+0000","last_peered":"2024-09-21T03:27:17.592798+0000","last_clean":"2024-09-21T03:27:17.592798+0000","last_became_active":"2024-09-21T03:27:17.585334+0000","last_became_peered":"2024-09-21T03:27:17.585334+0000","last_unstale":"2024-09-21T03:27:17.592798+0000","last_undegraded":"2024-09-21T03:27:17.592798+0000","last_fullsized":"2024-09-21T03:27:17.592798+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:41.702167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-21T03:27:16.569388+0000","last_change":"2024-09-21T03:27:16.569388+0000","last_active":"2024-09-21T03:27:16.550895+0000","last_peered":"2024-09-21T03:27:16.550895+0000","last_clean":"2024-09-21T03:27:16.550895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:27:16.569388+0000","last_undegraded":"2024-09-21T03:27:16.569388+0000","last_fullsized":"2024-09-21T03:27:16.569388+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.592458+0000","last_change":"2024-09-21T03:27:17.584543+0000","last_active":"2024-09-21T03:27:17.592458+0000","last_peered":"2024-09-21T03:27:17.592458+0000","last_clean":"2024-09-21T03:27:17.592458+0000","last_became_active":"2024-09-21T03:27:17.584163+0000","last_became_peered":"2024-09-21T03:27:17.584163+0000","last_unstale":"2024-09-21T03:27:17.592458+0000","last_undegraded":"2024-09-21T03:27:17.592458+0000","last_fullsized":"2024-09-21T03:27:17.592458+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:59:25.012491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.586980+0000","last_change":"2024-09-21T03:27:17.584109+0000","last_active":"2024-09-21T03:27:17.586980+0000","last_peered":"2024-09-21T03:27:17.586980+0000","last_clean":"2024-09-21T03:27:17.586980+0000","last_became_active":"2024-09-21T03:27:17.583795+0000","last_became_peered":"2024-09-21T03:27:17.583795+0000","last_unstale":"2024-09-21T03:27:17.586980+0000","last_undegraded":"2024-09-21T03:27:17.586980+0000","last_fullsized":"2024-09-21T03:27:17.586980+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:02:40.150497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.592602+0000","last_change":"2024-09-21T03:27:17.584726+0000","last_active":"2024-09-21T03:27:17.592602+0000","last_peered":"2024-09-21T03:27:17.592602+0000","last_clean":"2024-09-21T03:27:17.592602+0000","last_became_active":"2024-09-21T03:27:17.584401+0000","last_became_peered":"2024-09-21T03:27:17.584401+0000","last_unstale":"2024-09-21T03:27:17.592602+0000","last_undegraded":"2024-09-21T03:27:17.592602+0000","last_fullsized":"2024-09-21T03:27:17.592602+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:47:17.066223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585339+0000","last_change":"2024-09-21T03:27:17.583387+0000","last_active":"2024-09-21T03:27:18.585339+0000","last_peered":"2024-09-21T03:27:18.585339+0000","last_clean":"2024-09-21T03:27:18.585339+0000","last_became_active":"2024-09-21T03:27:17.582898+0000","last_became_peered":"2024-09-21T03:27:17.582898+0000","last_unstale":"2024-09-21T03:27:18.585339+0000","last_undegraded":"2024-09-21T03:27:18.585339+0000","last_fullsized":"2024-09-21T03:27:18.585339+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:42.013551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.584662+0000","last_change":"2024-09-21T03:27:17.592422+0000","last_active":"2024-09-21T03:27:18.584662+0000","last_peered":"2024-09-21T03:27:18.584662+0000","last_clean":"2024-09-21T03:27:18.584662+0000","last_became_active":"2024-09-21T03:27:17.592093+0000","last_became_peered":"2024-09-21T03:27:17.592093+0000","last_unstale":"2024-09-21T03:27:18.584662+0000","last_undegraded":"2024-09-21T03:27:18.584662+0000","last_fullsized":"2024-09-21T03:27:18.584662+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:06:13.764175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.582876+0000","last_change":"2024-09-21T03:27:17.579122+0000","last_active":"2024-09-21T03:27:17.582876+0000","last_peered":"2024-09-21T03:27:17.582876+0000","last_clean":"2024-09-21T03:27:17.582876+0000","last_became_active":"2024-09-21T03:27:17.578841+0000","last_became_peered":"2024-09-21T03:27:17.578841+0000","last_unstale":"2024-09-21T03:27:17.582876+0000","last_undegraded":"2024-09-21T03:27:17.582876+0000","last_fullsized":"2024-09-21T03:27:17.582876+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:17.468257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-21T03:27:16.568441+0000","last_change":"2024-09-21T03:27:16.568441+0000","last_active":"2024-09-21T03:27:16.550895+0000","last_peered":"2024-09-21T03:27:16.550895+0000","last_clean":"2024-09-21T03:27:16.550895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:27:16.568441+0000","last_undegraded":"2024-09-21T03:27:16.568441+0000","last_fullsized":"2024-09-21T03:27:16.568441+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"139'4","reported_seq":19,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583565+0000","last_change":"2024-09-21T03:27:16.581015+0000","last_active":"2024-09-21T03:27:18.583565+0000","last_peered":"2024-09-21T03:27:18.583565+0000","last_clean":"2024-09-21T03:27:18.583565+0000","last_became_active":"2024-09-21T03:27:16.580691+0000","last_became_peered":"2024-09-21T03:27:16.580691+0000","last_unstale":"2024-09-21T03:27:18.583565+0000","last_undegraded":"2024-09-21T03:27:18.583565+0000","last_fullsized":"2024-09-21T03:27:18.583565+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:58:11.894626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585350+0000","last_change":"2024-09-21T03:27:17.584425+0000","last_active":"2024-09-21T03:27:18.585350+0000","last_peered":"2024-09-21T03:27:18.585350+0000","last_clean":"2024-09-21T03:27:18.585350+0000","last_became_active":"2024-09-21T03:27:17.584118+0000","last_became_peered":"2024-09-21T03:27:17.584118+0000","last_unstale":"2024-09-21T03:27:18.585350+0000","last_undegraded":"2024-09-21T03:27:18.585350+0000","last_fullsized":"2024-09-21T03:27:18.585350+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:51.069144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"139'1","reported_seq":16,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585028+0000","last_change":"2024-09-21T03:27:16.578107+0000","last_active":"2024-09-21T03:27:18.585028+0000","last_peered":"2024-09-21T03:27:18.585028+0000","last_clean":"2024-09-21T03:27:18.585028+0000","last_became_active":"2024-09-21T03:27:16.577745+0000","last_became_peered":"2024-09-21T03:27:16.577745+0000","last_unstale":"2024-09-21T03:27:18.585028+0000","last_undegraded":"2024-09-21T03:27:18.585028+0000","last_fullsized":"2024-09-21T03:27:18.585028+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:38.887631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.587168+0000","last_change":"2024-09-21T03:27:17.582825+0000","last_active":"2024-09-21T03:27:17.587168+0000","last_peered":"2024-09-21T03:27:17.587168+0000","last_clean":"2024-09-21T03:27:17.587168+0000","last_became_active":"2024-09-21T03:27:17.582405+0000","last_became_peered":"2024-09-21T03:27:17.582405+0000","last_unstale":"2024-09-21T03:27:17.587168+0000","last_undegraded":"2024-09-21T03:27:17.587168+0000","last_fullsized":"2024-09-21T03:27:17.587168+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:16.762738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"139'2","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.597455+0000","last_change":"2024-09-21T03:27:16.577605+0000","last_active":"2024-09-21T03:27:17.597455+0000","last_peered":"2024-09-21T03:27:17.597455+0000","last_clean":"2024-09-21T03:27:17.597455+0000","last_became_active":"2024-09-21T03:27:16.577310+0000","last_became_peered":"2024-09-21T03:27:16.577310+0000","last_unstale":"2024-09-21T03:27:17.597455+0000","last_undegraded":"2024-09-21T03:27:17.597455+0000","last_fullsized":"2024-09-21T03:27:17.597455+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:41.413162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.581303+0000","last_change":"2024-09-21T03:27:17.579293+0000","last_active":"2024-09-21T03:27:17.581303+0000","last_peered":"2024-09-21T03:27:17.581303+0000","last_clean":"2024-09-21T03:27:17.581303+0000","last_became_active":"2024-09-21T03:27:17.578780+0000","last_became_peered":"2024-09-21T03:27:17.578780+0000","last_unstale":"2024-09-21T03:27:17.581303+0000","last_undegraded":"2024-09-21T03:27:17.581303+0000","last_fullsized":"2024-09-21T03:27:17.581303+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:13.328076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"139'2","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.597487+0000","last_change":"2024-09-21T03:27:16.574950+0000","last_active":"2024-09-21T03:27:17.597487+0000","last_peered":"2024-09-21T03:27:17.597487+0000","last_clean":"2024-09-21T03:27:17.597487+0000","last_became_active":"2024-09-21T03:27:16.573561+0000","last_became_peered":"2024-09-21T03:27:16.573561+0000","last_unstale":"2024-09-21T03:27:17.597487+0000","last_undegraded":"2024-09-21T03:27:17.597487+0000","last_fullsized":"2024-09-21T03:27:17.597487+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:24.760299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-21T03:27:16.568774+0000","last_change":"2024-09-21T03:27:16.568774+0000","last_active":"2024-09-21T03:27:16.550895+0000","last_peered":"2024-09-21T03:27:16.550895+0000","last_clean":"2024-09-21T03:27:16.550895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:27:16.568774+0000","last_undegraded":"2024-09-21T03:27:16.568774+0000","last_fullsized":"2024-09-21T03:27:16.568774+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"139'1","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.596812+0000","last_change":"2024-09-21T03:27:16.579737+0000","last_active":"2024-09-21T03:27:17.596812+0000","last_peered":"2024-09-21T03:27:17.596812+0000","last_clean":"2024-09-21T03:27:17.596812+0000","last_became_active":"2024-09-21T03:27:16.579428+0000","last_became_peered":"2024-09-21T03:27:16.579428+0000","last_unstale":"2024-09-21T03:27:17.596812+0000","last_undegraded":"2024-09-21T03:27:17.596812+0000","last_fullsized":"2024-09-21T03:27:17.596812+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:02:22.984543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.586953+0000","last_change":"2024-09-21T03:27:17.583627+0000","last_active":"2024-09-21T03:27:17.586953+0000","last_peered":"2024-09-21T03:27:17.586953+0000","last_clean":"2024-09-21T03:27:17.586953+0000","last_became_active":"2024-09-21T03:27:17.583282+0000","last_became_peered":"2024-09-21T03:27:17.583282+0000","last_unstale":"2024-09-21T03:27:17.586953+0000","last_undegraded":"2024-09-21T03:27:17.586953+0000","last_fullsized":"2024-09-21T03:27:17.586953+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:15:39.847481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"139'1","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.597355+0000","last_change":"2024-09-21T03:27:16.574689+0000","last_active":"2024-09-21T03:27:17.597355+0000","last_peered":"2024-09-21T03:27:17.597355+0000","last_clean":"2024-09-21T03:27:17.597355+0000","last_became_active":"2024-09-21T03:27:16.574380+0000","last_became_peered":"2024-09-21T03:27:16.574380+0000","last_unstale":"2024-09-21T03:27:17.597355+0000","last_undegraded":"2024-09-21T03:27:17.597355+0000","last_fullsized":"2024-09-21T03:27:17.597355+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:03.610863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.589621+0000","last_change":"2024-09-21T03:27:17.586684+0000","last_active":"2024-09-21T03:27:17.589621+0000","last_peered":"2024-09-21T03:27:17.589621+0000","last_clean":"2024-09-21T03:27:17.589621+0000","last_became_active":"2024-09-21T03:27:17.586407+0000","last_became_peered":"2024-09-21T03:27:17.586407+0000","last_unstale":"2024-09-21T03:27:17.589621+0000","last_undegraded":"2024-09-21T03:27:17.589621+0000","last_fullsized":"2024-09-21T03:27:17.589621+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:18:37.794112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585775+0000","last_change":"2024-09-21T03:27:16.574797+0000","last_active":"2024-09-21T03:27:18.585775+0000","last_peered":"2024-09-21T03:27:18.585775+0000","last_clean":"2024-09-21T03:27:18.585775+0000","last_became_active":"2024-09-21T03:27:16.574469+0000","last_became_peered":"2024-09-21T03:27:16.574469+0000","last_unstale":"2024-09-21T03:27:18.585775+0000","last_undegraded":"2024-09-21T03:27:18.585775+0000","last_fullsized":"2024-09-21T03:27:18.585775+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:12.431154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.579396+0000","last_change":"2024-09-21T03:27:17.576792+0000","last_active":"2024-09-21T03:27:17.579396+0000","last_peered":"2024-09-21T03:27:17.579396+0000","last_clean":"2024-09-21T03:27:17.579396+0000","last_became_active":"2024-09-21T03:27:17.576477+0000","last_became_peered":"2024-09-21T03:27:17.576477+0000","last_unstale":"2024-09-21T03:27:17.579396+0000","last_undegraded":"2024-09-21T03:27:17.579396+0000","last_fullsized":"2024-09-21T03:27:17.579396+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:02:44.799481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-21T03:27:16.581906+0000","last_change":"2024-09-21T03:27:16.578176+0000","last_active":"2024-09-21T03:27:16.581906+0000","last_peered":"2024-09-21T03:27:16.581906+0000","last_clean":"2024-09-21T03:27:16.581906+0000","last_became_active":"2024-09-21T03:27:16.577886+0000","last_became_peered":"2024-09-21T03:27:16.577886+0000","last_unstale":"2024-09-21T03:27:16.581906+0000","last_undegraded":"2024-09-21T03:27:16.581906+0000","last_fullsized":"2024-09-21T03:27:16.581906+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:29:46.791624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.581935+0000","last_change":"2024-09-21T03:27:17.577247+0000","last_active":"2024-09-21T03:27:17.581935+0000","last_peered":"2024-09-21T03:27:17.581935+0000","last_clean":"2024-09-21T03:27:17.581935+0000","last_became_active":"2024-09-21T03:27:17.576950+0000","last_became_peered":"2024-09-21T03:27:17.576950+0000","last_unstale":"2024-09-21T03:27:17.581935+0000","last_undegraded":"2024-09-21T03:27:17.581935+0000","last_fullsized":"2024-09-21T03:27:17.581935+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:16.951026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.572137+0000","last_change":"2024-09-21T03:27:16.578096+0000","last_active":"2024-09-21T03:27:17.572137+0000","last_peered":"2024-09-21T03:27:17.572137+0000","last_clean":"2024-09-21T03:27:17.572137+0000","last_became_active":"2024-09-21T03:27:16.577770+0000","last_became_peered":"2024-09-21T03:27:16.577770+0000","last_unstale":"2024-09-21T03:27:17.572137+0000","last_undegraded":"2024-09-21T03:27:17.572137+0000","last_fullsized":"2024-09-21T03:27:17.572137+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:54.303412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.581766+0000","last_change":"2024-09-21T03:27:17.577763+0000","last_active":"2024-09-21T03:27:17.581766+0000","last_peered":"2024-09-21T03:27:17.581766+0000","last_clean":"2024-09-21T03:27:17.581766+0000","last_became_active":"2024-09-21T03:27:17.577479+0000","last_became_peered":"2024-09-21T03:27:17.577479+0000","last_unstale":"2024-09-21T03:27:17.581766+0000","last_undegraded":"2024-09-21T03:27:17.581766+0000","last_fullsized":"2024-09-21T03:27:17.581766+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:56:15.766800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"139'3","reported_seq":16,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.596848+0000","last_change":"2024-09-21T03:27:16.577153+0000","last_active":"2024-09-21T03:27:17.596848+0000","last_peered":"2024-09-21T03:27:17.596848+0000","last_clean":"2024-09-21T03:27:17.596848+0000","last_became_active":"2024-09-21T03:27:16.576867+0000","last_became_peered":"2024-09-21T03:27:16.576867+0000","last_unstale":"2024-09-21T03:27:17.596848+0000","last_undegraded":"2024-09-21T03:27:17.596848+0000","last_fullsized":"2024-09-21T03:27:17.596848+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:46.573583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585356+0000","last_change":"2024-09-21T03:27:17.583787+0000","last_active":"2024-09-21T03:27:18.585356+0000","last_peered":"2024-09-21T03:27:18.585356+0000","last_clean":"2024-09-21T03:27:18.585356+0000","last_became_active":"2024-09-21T03:27:17.583260+0000","last_became_peered":"2024-09-21T03:27:17.583260+0000","last_unstale":"2024-09-21T03:27:18.585356+0000","last_undegraded":"2024-09-21T03:27:18.585356+0000","last_fullsized":"2024-09-21T03:27:18.585356+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:51.228873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"139'6","reported_seq":21,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.584840+0000","last_change":"2024-09-21T03:27:16.571658+0000","last_active":"2024-09-21T03:27:18.584840+0000","last_peered":"2024-09-21T03:27:18.584840+0000","last_clean":"2024-09-21T03:27:18.584840+0000","last_became_active":"2024-09-21T03:27:16.571305+0000","last_became_peered":"2024-09-21T03:27:16.571305+0000","last_unstale":"2024-09-21T03:27:18.584840+0000","last_undegraded":"2024-09-21T03:27:18.584840+0000","last_fullsized":"2024-09-21T03:27:18.584840+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:30.379967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.578257+0000","last_change":"2024-09-21T03:27:17.573089+0000","last_active":"2024-09-21T03:27:17.578257+0000","last_peered":"2024-09-21T03:27:17.578257+0000","last_clean":"2024-09-21T03:27:17.578257+0000","last_became_active":"2024-09-21T03:27:17.572836+0000","last_became_peered":"2024-09-21T03:27:17.572836+0000","last_unstale":"2024-09-21T03:27:17.578257+0000","last_undegraded":"2024-09-21T03:27:17.578257+0000","last_fullsized":"2024-09-21T03:27:17.578257+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:44.827317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"139'2","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.597889+0000","last_change":"2024-09-21T03:27:16.572761+0000","last_active":"2024-09-21T03:27:17.597889+0000","last_peered":"2024-09-21T03:27:17.597889+0000","last_clean":"2024-09-21T03:27:17.597889+0000","last_became_active":"2024-09-21T03:27:16.572470+0000","last_became_peered":"2024-09-21T03:27:16.572470+0000","last_unstale":"2024-09-21T03:27:17.597889+0000","last_undegraded":"2024-09-21T03:27:17.597889+0000","last_fullsized":"2024-09-21T03:27:17.597889+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:40.398460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-21T03:27:16.567064+0000","last_change":"2024-09-21T03:27:16.567064+0000","last_active":"2024-09-21T03:27:16.550895+0000","last_peered":"2024-09-21T03:27:16.550895+0000","last_clean":"2024-09-21T03:27:16.550895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:27:16.567064+0000","last_undegraded":"2024-09-21T03:27:16.567064+0000","last_fullsized":"2024-09-21T03:27:16.567064+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.566307+0000","last_change":"2024-09-21T03:27:16.574985+0000","last_active":"2024-09-21T03:27:17.566307+0000","last_peered":"2024-09-21T03:27:17.566307+0000","last_clean":"2024-09-21T03:27:17.566307+0000","last_became_active":"2024-09-21T03:27:16.574650+0000","last_became_peered":"2024-09-21T03:27:16.574650+0000","last_unstale":"2024-09-21T03:27:17.566307+0000","last_undegraded":"2024-09-21T03:27:17.566307+0000","last_fullsized":"2024-09-21T03:27:17.566307+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:00.204114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.590179+0000","last_change":"2024-09-21T03:27:17.589346+0000","last_active":"2024-09-21T03:27:17.590179+0000","last_peered":"2024-09-21T03:27:17.590179+0000","last_clean":"2024-09-21T03:27:17.590179+0000","last_became_active":"2024-09-21T03:27:17.589034+0000","last_became_peered":"2024-09-21T03:27:17.589034+0000","last_unstale":"2024-09-21T03:27:17.590179+0000","last_undegraded":"2024-09-21T03:27:17.590179+0000","last_fullsized":"2024-09-21T03:27:17.590179+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:21:44.303210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.574173+0000","last_change":"2024-09-21T03:27:16.576083+0000","last_active":"2024-09-21T03:27:17.574173+0000","last_peered":"2024-09-21T03:27:17.574173+0000","last_clean":"2024-09-21T03:27:17.574173+0000","last_became_active":"2024-09-21T03:27:16.575789+0000","last_became_peered":"2024-09-21T03:27:16.575789+0000","last_unstale":"2024-09-21T03:27:17.574173+0000","last_undegraded":"2024-09-21T03:27:17.574173+0000","last_fullsized":"2024-09-21T03:27:17.574173+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:35.838462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.580459+0000","last_change":"2024-09-21T03:27:17.576643+0000","last_active":"2024-09-21T03:27:17.580459+0000","last_peered":"2024-09-21T03:27:17.580459+0000","last_clean":"2024-09-21T03:27:17.580459+0000","last_became_active":"2024-09-21T03:27:17.576339+0000","last_became_peered":"2024-09-21T03:27:17.576339+0000","last_unstale":"2024-09-21T03:27:17.580459+0000","last_undegraded":"2024-09-21T03:27:17.580459+0000","last_fullsized":"2024-09-21T03:27:17.580459+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:41.117745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"139'8","reported_seq":23,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.584534+0000","last_change":"2024-09-21T03:27:16.574966+0000","last_active":"2024-09-21T03:27:18.584534+0000","last_peered":"2024-09-21T03:27:18.584534+0000","last_clean":"2024-09-21T03:27:18.584534+0000","last_became_active":"2024-09-21T03:27:16.573876+0000","last_became_peered":"2024-09-21T03:27:16.573876+0000","last_unstale":"2024-09-21T03:27:18.584534+0000","last_undegraded":"2024-09-21T03:27:18.584534+0000","last_fullsized":"2024-09-21T03:27:18.584534+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:27.555326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.578547+0000","last_change":"2024-09-21T03:27:17.577237+0000","last_active":"2024-09-21T03:27:17.578547+0000","last_peered":"2024-09-21T03:27:17.578547+0000","last_clean":"2024-09-21T03:27:17.578547+0000","last_became_active":"2024-09-21T03:27:17.576428+0000","last_became_peered":"2024-09-21T03:27:17.576428+0000","last_unstale":"2024-09-21T03:27:17.578547+0000","last_undegraded":"2024-09-21T03:27:17.578547+0000","last_fullsized":"2024-09-21T03:27:17.578547+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:50:28.451810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"139'1","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.594994+0000","last_change":"2024-09-21T03:27:16.580043+0000","last_active":"2024-09-21T03:27:17.594994+0000","last_peered":"2024-09-21T03:27:17.594994+0000","last_clean":"2024-09-21T03:27:17.594994+0000","last_became_active":"2024-09-21T03:27:16.579642+0000","last_became_peered":"2024-09-21T03:27:16.579642+0000","last_unstale":"2024-09-21T03:27:17.594994+0000","last_undegraded":"2024-09-21T03:27:17.594994+0000","last_fullsized":"2024-09-21T03:27:17.594994+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:43.548214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.590698+0000","last_change":"2024-09-21T03:27:17.588315+0000","last_active":"2024-09-21T03:27:17.590698+0000","last_peered":"2024-09-21T03:27:17.590698+0000","last_clean":"2024-09-21T03:27:17.590698+0000","last_became_active":"2024-09-21T03:27:17.587763+0000","last_became_peered":"2024-09-21T03:27:17.587763+0000","last_unstale":"2024-09-21T03:27:17.590698+0000","last_undegraded":"2024-09-21T03:27:17.590698+0000","last_fullsized":"2024-09-21T03:27:17.590698+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:24.863592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"139'2","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.597586+0000","last_change":"2024-09-21T03:27:16.576595+0000","last_active":"2024-09-21T03:27:17.597586+0000","last_peered":"2024-09-21T03:27:17.597586+0000","last_clean":"2024-09-21T03:27:17.597586+0000","last_became_active":"2024-09-21T03:27:16.576288+0000","last_became_peered":"2024-09-21T03:27:16.576288+0000","last_unstale":"2024-09-21T03:27:17.597586+0000","last_undegraded":"2024-09-21T03:27:17.597586+0000","last_fullsized":"2024-09-21T03:27:17.597586+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:34.408303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.586957+0000","last_change":"2024-09-21T03:27:17.583424+0000","last_active":"2024-09-21T03:27:17.586957+0000","last_peered":"2024-09-21T03:27:17.586957+0000","last_clean":"2024-09-21T03:27:17.586957+0000","last_became_active":"2024-09-21T03:27:17.583133+0000","last_became_peered":"2024-09-21T03:27:17.583133+0000","last_unstale":"2024-09-21T03:27:17.586957+0000","last_undegraded":"2024-09-21T03:27:17.586957+0000","last_fullsized":"2024-09-21T03:27:17.586957+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:40.948966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"139'1","reported_seq":16,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583389+0000","last_change":"2024-09-21T03:27:16.580912+0000","last_active":"2024-09-21T03:27:18.583389+0000","last_peered":"2024-09-21T03:27:18.583389+0000","last_clean":"2024-09-21T03:27:18.583389+0000","last_became_active":"2024-09-21T03:27:16.580592+0000","last_became_peered":"2024-09-21T03:27:16.580592+0000","last_unstale":"2024-09-21T03:27:18.583389+0000","last_undegraded":"2024-09-21T03:27:18.583389+0000","last_fullsized":"2024-09-21T03:27:18.583389+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:41.558318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-21T03:27:16.566043+0000","last_change":"2024-09-21T03:27:16.566043+0000","last_active":"2024-09-21T03:27:16.550895+0000","last_peered":"2024-09-21T03:27:16.550895+0000","last_clean":"2024-09-21T03:27:16.550895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:27:16.566043+0000","last_undegraded":"2024-09-21T03:27:16.566043+0000","last_fullsized":"2024-09-21T03:27:16.566043+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583564+0000","last_change":"2024-09-21T03:27:16.576719+0000","last_active":"2024-09-21T03:27:18.583564+0000","last_peered":"2024-09-21T03:27:18.583564+0000","last_clean":"2024-09-21T03:27:18.583564+0000","last_became_active":"2024-09-21T03:27:16.576402+0000","last_became_peered":"2024-09-21T03:27:16.576402+0000","last_unstale":"2024-09-21T03:27:18.583564+0000","last_undegraded":"2024-09-21T03:27:18.583564+0000","last_fullsized":"2024-09-21T03:27:18.583564+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:41.780927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.580875+0000","last_change":"2024-09-21T03:27:17.578483+0000","last_active":"2024-09-21T03:27:17.580875+0000","last_peered":"2024-09-21T03:27:17.580875+0000","last_clean":"2024-09-21T03:27:17.580875+0000","last_became_active":"2024-09-21T03:27:17.578151+0000","last_became_peered":"2024-09-21T03:27:17.578151+0000","last_unstale":"2024-09-21T03:27:17.580875+0000","last_undegraded":"2024-09-21T03:27:17.580875+0000","last_fullsized":"2024-09-21T03:27:17.580875+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:16.441422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"139'2","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.597788+0000","last_change":"2024-09-21T03:27:16.577952+0000","last_active":"2024-09-21T03:27:17.597788+0000","last_peered":"2024-09-21T03:27:17.597788+0000","last_clean":"2024-09-21T03:27:17.597788+0000","last_became_active":"2024-09-21T03:27:16.576576+0000","last_became_peered":"2024-09-21T03:27:16.576576+0000","last_unstale":"2024-09-21T03:27:17.597788+0000","last_undegraded":"2024-09-21T03:27:17.597788+0000","last_fullsized":"2024-09-21T03:27:17.597788+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:12.431154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-21T03:27:16.566345+0000","last_change":"2024-09-21T03:27:16.566345+0000","last_active":"2024-09-21T03:27:16.550895+0000","last_peered":"2024-09-21T03:27:16.550895+0000","last_clean":"2024-09-21T03:27:16.550895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:27:16.566345+0000","last_undegraded":"2024-09-21T03:27:16.566345+0000","last_fullsized":"2024-09-21T03:27:16.566345+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583323+0000","last_change":"2024-09-21T03:27:16.577488+0000","last_active":"2024-09-21T03:27:18.583323+0000","last_peered":"2024-09-21T03:27:18.583323+0000","last_clean":"2024-09-21T03:27:18.583323+0000","last_became_active":"2024-09-21T03:27:16.577197+0000","last_became_peered":"2024-09-21T03:27:16.577197+0000","last_unstale":"2024-09-21T03:27:18.583323+0000","last_undegraded":"2024-09-21T03:27:18.583323+0000","last_fullsized":"2024-09-21T03:27:18.583323+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:17.944770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583365+0000","last_change":"2024-09-21T03:27:17.582910+0000","last_active":"2024-09-21T03:27:18.583365+0000","last_peered":"2024-09-21T03:27:18.583365+0000","last_clean":"2024-09-21T03:27:18.583365+0000","last_became_active":"2024-09-21T03:27:17.582582+0000","last_became_peered":"2024-09-21T03:27:17.582582+0000","last_unstale":"2024-09-21T03:27:18.583365+0000","last_undegraded":"2024-09-21T03:27:18.583365+0000","last_fullsized":"2024-09-21T03:27:18.583365+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:44.083723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.576051+0000","last_change":"2024-09-21T03:27:16.581246+0000","last_active":"2024-09-21T03:27:17.576051+0000","last_peered":"2024-09-21T03:27:17.576051+0000","last_clean":"2024-09-21T03:27:17.576051+0000","last_became_active":"2024-09-21T03:27:16.580919+0000","last_became_peered":"2024-09-21T03:27:16.580919+0000","last_unstale":"2024-09-21T03:27:17.576051+0000","last_undegraded":"2024-09-21T03:27:17.576051+0000","last_fullsized":"2024-09-21T03:27:17.576051+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:25.979160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.579424+0000","last_change":"2024-09-21T03:27:17.577791+0000","last_active":"2024-09-21T03:27:17.579424+0000","last_peered":"2024-09-21T03:27:17.579424+0000","last_clean":"2024-09-21T03:27:17.579424+0000","last_became_active":"2024-09-21T03:27:17.577502+0000","last_became_peered":"2024-09-21T03:27:17.577502+0000","last_unstale":"2024-09-21T03:27:17.579424+0000","last_undegraded":"2024-09-21T03:27:17.579424+0000","last_fullsized":"2024-09-21T03:27:17.579424+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:24.181167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583144+0000","last_change":"2024-09-21T03:27:16.578401+0000","last_active":"2024-09-21T03:27:18.583144+0000","last_peered":"2024-09-21T03:27:18.583144+0000","last_clean":"2024-09-21T03:27:18.583144+0000","last_became_active":"2024-09-21T03:27:16.578077+0000","last_became_peered":"2024-09-21T03:27:16.578077+0000","last_unstale":"2024-09-21T03:27:18.583144+0000","last_undegraded":"2024-09-21T03:27:18.583144+0000","last_fullsized":"2024-09-21T03:27:18.583144+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:44:50.471830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.582932+0000","last_change":"2024-09-21T03:27:17.578316+0000","last_active":"2024-09-21T03:27:17.582932+0000","last_peered":"2024-09-21T03:27:17.582932+0000","last_clean":"2024-09-21T03:27:17.582932+0000","last_became_active":"2024-09-21T03:27:17.578010+0000","last_became_peered":"2024-09-21T03:27:17.578010+0000","last_unstale":"2024-09-21T03:27:17.582932+0000","last_undegraded":"2024-09-21T03:27:17.582932+0000","last_fullsized":"2024-09-21T03:27:17.582932+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:17.101621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"139'2","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.595072+0000","last_change":"2024-09-21T03:27:16.578670+0000","last_active":"2024-09-21T03:27:17.595072+0000","last_peered":"2024-09-21T03:27:17.595072+0000","last_clean":"2024-09-21T03:27:17.595072+0000","last_became_active":"2024-09-21T03:27:16.578359+0000","last_became_peered":"2024-09-21T03:27:16.578359+0000","last_unstale":"2024-09-21T03:27:17.595072+0000","last_undegraded":"2024-09-21T03:27:17.595072+0000","last_fullsized":"2024-09-21T03:27:17.595072+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:52.045055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-21T03:27:16.568429+0000","last_change":"2024-09-21T03:27:16.568429+0000","last_active":"2024-09-21T03:27:16.550895+0000","last_peered":"2024-09-21T03:27:16.550895+0000","last_clean":"2024-09-21T03:27:16.550895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:27:16.568429+0000","last_undegraded":"2024-09-21T03:27:16.568429+0000","last_fullsized":"2024-09-21T03:27:16.568429+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"139'1","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.580468+0000","last_change":"2024-09-21T03:27:16.580402+0000","last_active":"2024-09-21T03:27:18.580468+0000","last_peered":"2024-09-21T03:27:18.580468+0000","last_clean":"2024-09-21T03:27:18.580468+0000","last_became_active":"2024-09-21T03:27:16.580078+0000","last_became_peered":"2024-09-21T03:27:16.580078+0000","last_unstale":"2024-09-21T03:27:18.580468+0000","last_undegraded":"2024-09-21T03:27:18.580468+0000","last_fullsized":"2024-09-21T03:27:18.580468+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:07.923601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.584403+0000","last_change":"2024-09-21T03:27:17.580829+0000","last_active":"2024-09-21T03:27:17.584403+0000","last_peered":"2024-09-21T03:27:17.584403+0000","last_clean":"2024-09-21T03:27:17.584403+0000","last_became_active":"2024-09-21T03:27:17.580540+0000","last_became_peered":"2024-09-21T03:27:17.580540+0000","last_unstale":"2024-09-21T03:27:17.584403+0000","last_undegraded":"2024-09-21T03:27:17.584403+0000","last_fullsized":"2024-09-21T03:27:17.584403+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:00.398615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.586553+0000","last_change":"2024-09-21T03:27:16.574812+0000","last_active":"2024-09-21T03:27:18.586553+0000","last_peered":"2024-09-21T03:27:18.586553+0000","last_clean":"2024-09-21T03:27:18.586553+0000","last_became_active":"2024-09-21T03:27:16.574396+0000","last_became_peered":"2024-09-21T03:27:16.574396+0000","last_unstale":"2024-09-21T03:27:18.586553+0000","last_undegraded":"2024-09-21T03:27:18.586553+0000","last_fullsized":"2024-09-21T03:27:18.586553+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:03.610863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.576793+0000","last_change":"2024-09-21T03:27:17.574712+0000","last_active":"2024-09-21T03:27:17.576793+0000","last_peered":"2024-09-21T03:27:17.576793+0000","last_clean":"2024-09-21T03:27:17.576793+0000","last_became_active":"2024-09-21T03:27:17.574402+0000","last_became_peered":"2024-09-21T03:27:17.574402+0000","last_unstale":"2024-09-21T03:27:17.576793+0000","last_undegraded":"2024-09-21T03:27:17.576793+0000","last_fullsized":"2024-09-21T03:27:17.576793+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:55.408707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.565551+0000","last_change":"2024-09-21T03:27:16.579174+0000","last_active":"2024-09-21T03:27:17.565551+0000","last_peered":"2024-09-21T03:27:17.565551+0000","last_clean":"2024-09-21T03:27:17.565551+0000","last_became_active":"2024-09-21T03:27:16.578865+0000","last_became_peered":"2024-09-21T03:27:16.578865+0000","last_unstale":"2024-09-21T03:27:17.565551+0000","last_undegraded":"2024-09-21T03:27:17.565551+0000","last_fullsized":"2024-09-21T03:27:17.565551+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:23.331344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.581875+0000","last_change":"2024-09-21T03:27:17.578034+0000","last_active":"2024-09-21T03:27:17.581875+0000","last_peered":"2024-09-21T03:27:17.581875+0000","last_clean":"2024-09-21T03:27:17.581875+0000","last_became_active":"2024-09-21T03:27:17.576925+0000","last_became_peered":"2024-09-21T03:27:17.576925+0000","last_unstale":"2024-09-21T03:27:17.581875+0000","last_undegraded":"2024-09-21T03:27:17.581875+0000","last_fullsized":"2024-09-21T03:27:17.581875+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:56.497686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.584884+0000","last_change":"2024-09-21T03:27:16.574672+0000","last_active":"2024-09-21T03:27:18.584884+0000","last_peered":"2024-09-21T03:27:18.584884+0000","last_clean":"2024-09-21T03:27:18.584884+0000","last_became_active":"2024-09-21T03:27:16.573040+0000","last_became_peered":"2024-09-21T03:27:16.573040+0000","last_unstale":"2024-09-21T03:27:18.584884+0000","last_undegraded":"2024-09-21T03:27:18.584884+0000","last_fullsized":"2024-09-21T03:27:18.584884+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:38.629252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585226+0000","last_change":"2024-09-21T03:27:17.591453+0000","last_active":"2024-09-21T03:27:18.585226+0000","last_peered":"2024-09-21T03:27:18.585226+0000","last_clean":"2024-09-21T03:27:18.585226+0000","last_became_active":"2024-09-21T03:27:17.591101+0000","last_became_peered":"2024-09-21T03:27:17.591101+0000","last_unstale":"2024-09-21T03:27:18.585226+0000","last_undegraded":"2024-09-21T03:27:18.585226+0000","last_fullsized":"2024-09-21T03:27:18.585226+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:57.365059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.574722+0000","last_change":"2024-09-21T03:27:16.571816+0000","last_active":"2024-09-21T03:27:17.574722+0000","last_peered":"2024-09-21T03:27:17.574722+0000","last_clean":"2024-09-21T03:27:17.574722+0000","last_became_active":"2024-09-21T03:27:16.571475+0000","last_became_peered":"2024-09-21T03:27:16.571475+0000","last_unstale":"2024-09-21T03:27:17.574722+0000","last_undegraded":"2024-09-21T03:27:17.574722+0000","last_fullsized":"2024-09-21T03:27:17.574722+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:16.998561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-21T03:27:16.566417+0000","last_change":"2024-09-21T03:27:16.566417+0000","last_active":"2024-09-21T03:27:16.550895+0000","last_peered":"2024-09-21T03:27:16.550895+0000","last_clean":"2024-09-21T03:27:16.550895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:27:16.566417+0000","last_undegraded":"2024-09-21T03:27:16.566417+0000","last_fullsized":"2024-09-21T03:27:16.566417+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585945+0000","last_change":"2024-09-21T03:27:16.573639+0000","last_active":"2024-09-21T03:27:18.585945+0000","last_peered":"2024-09-21T03:27:18.585945+0000","last_clean":"2024-09-21T03:27:18.585945+0000","last_became_active":"2024-09-21T03:27:16.573163+0000","last_became_peered":"2024-09-21T03:27:16.573163+0000","last_unstale":"2024-09-21T03:27:18.585945+0000","last_undegraded":"2024-09-21T03:27:18.585945+0000","last_fullsized":"2024-09-21T03:27:18.585945+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:35.838462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.580486+0000","last_change":"2024-09-21T03:27:17.578123+0000","last_active":"2024-09-21T03:27:17.580486+0000","last_peered":"2024-09-21T03:27:17.580486+0000","last_clean":"2024-09-21T03:27:17.580486+0000","last_became_active":"2024-09-21T03:27:17.577792+0000","last_became_peered":"2024-09-21T03:27:17.577792+0000","last_unstale":"2024-09-21T03:27:17.580486+0000","last_undegraded":"2024-09-21T03:27:17.580486+0000","last_fullsized":"2024-09-21T03:27:17.580486+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:27.493816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.584498+0000","last_change":"2024-09-21T03:27:16.574180+0000","last_active":"2024-09-21T03:27:18.584498+0000","last_peered":"2024-09-21T03:27:18.584498+0000","last_clean":"2024-09-21T03:27:18.584498+0000","last_became_active":"2024-09-21T03:27:16.573439+0000","last_became_peered":"2024-09-21T03:27:16.573439+0000","last_unstale":"2024-09-21T03:27:18.584498+0000","last_undegraded":"2024-09-21T03:27:18.584498+0000","last_fullsized":"2024-09-21T03:27:18.584498+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:36.525290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.582958+0000","last_change":"2024-09-21T03:27:17.578054+0000","last_active":"2024-09-21T03:27:17.582958+0000","last_peered":"2024-09-21T03:27:17.582958+0000","last_clean":"2024-09-21T03:27:17.582958+0000","last_became_active":"2024-09-21T03:27:17.577746+0000","last_became_peered":"2024-09-21T03:27:17.577746+0000","last_unstale":"2024-09-21T03:27:17.582958+0000","last_undegraded":"2024-09-21T03:27:17.582958+0000","last_fullsized":"2024-09-21T03:27:17.582958+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:14.491408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585346+0000","last_change":"2024-09-21T03:27:16.575356+0000","last_active":"2024-09-21T03:27:18.585346+0000","last_peered":"2024-09-21T03:27:18.585346+0000","last_clean":"2024-09-21T03:27:18.585346+0000","last_became_active":"2024-09-21T03:27:16.574933+0000","last_became_peered":"2024-09-21T03:27:16.574933+0000","last_unstale":"2024-09-21T03:27:18.585346+0000","last_undegraded":"2024-09-21T03:27:18.585346+0000","last_fullsized":"2024-09-21T03:27:18.585346+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:11.636922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":334,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583233+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:27:18.583233+0000","last_peered":"2024-09-21T03:27:18.583233+0000","last_clean":"2024-09-21T03:27:18.583233+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:27:18.583233+0000","last_undegraded":"2024-09-21T03:27:18.583233+0000","last_fullsized":"2024-09-21T03:27:18.583233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509553,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33512,"kb_used_data":2316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338328,"statfs":{"total":96636764160,"available":96602447872,"internally_reserved":0,"allocated":2371584,"data_stored":1346178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509552,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32900,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338940,"statfs":{"total":96636764160,"available":96603074560,"internally_reserved":0,"allocated":1744896,"data_stored":747178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509551,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32904,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338936,"statfs":{"total":96636764160,"available":96603070464,"internally_reserved":0,"allocated":1748992,"data_stored":747760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509551,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32912,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338928,"statfs":{"total":96636764160,"available":96603062272,"internally_reserved":0,"allocated":1757184,"data_stored":748838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509552,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32896,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338944,"statfs":{"total":96636764160,"available":96603078656,"internally_reserved":0,"allocated":1744896,"data_stored":747190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509552,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37056,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334784,"statfs":{"total":96636764160,"available":96598818816,"internally_reserved":0,"allocated":1744896,"data_stored":747246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509552,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37056,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334784,"statfs":{"total":96636764160,"available":96598818816,"internally_reserved":0,"allocated":1744896,"data_stored":747190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574959,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33444,"kb_used_data":2256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338396,"statfs":{"total":96636764160,"available":96602517504,"internally_reserved":0,"allocated":2310144,"data_stored":1324474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:27:22.300 INFO:tasks.ceph.ceph_manager.ceph:PG 23.39 is not active+clean 2024-09-21T03:27:22.300 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:27:16.570177+0000', 'last_change': '2024-09-21T03:27:16.570177+0000', 'last_active': '2024-09-21T03:27:16.550895+0000', 'last_peered': '2024-09-21T03:27:16.550895+0000', 'last_clean': '2024-09-21T03:27:16.550895+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:27:16.570177+0000', 'last_undegraded': '2024-09-21T03:27:16.570177+0000', 'last_fullsized': '2024-09-21T03:27:16.570177+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:27:16.550895+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:27:16.550895+0000', 'last_clean_scrub_stamp': '2024-09-21T03:27:16.550895+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:27:22.300 INFO:tasks.ceph.ceph_manager.ceph:PG 23.30 is not active+clean 2024-09-21T03:27:22.300 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:27:16.569726+0000', 'last_change': '2024-09-21T03:27:16.569726+0000', 'last_active': '2024-09-21T03:27:16.550895+0000', 'last_peered': '2024-09-21T03:27:16.550895+0000', 'last_clean': '2024-09-21T03:27:16.550895+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:27:16.569726+0000', 'last_undegraded': '2024-09-21T03:27:16.569726+0000', 'last_fullsized': '2024-09-21T03:27:16.569726+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:27:16.550895+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:27:16.550895+0000', 'last_clean_scrub_stamp': '2024-09-21T03:27:16.550895+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:27:22.300 INFO:tasks.ceph.ceph_manager.ceph:PG 23.26 is not active+clean 2024-09-21T03:27:22.300 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:27:16.569388+0000', 'last_change': '2024-09-21T03:27:16.569388+0000', 'last_active': '2024-09-21T03:27:16.550895+0000', 'last_peered': '2024-09-21T03:27:16.550895+0000', 'last_clean': '2024-09-21T03:27:16.550895+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:27:16.569388+0000', 'last_undegraded': '2024-09-21T03:27:16.569388+0000', 'last_fullsized': '2024-09-21T03:27:16.569388+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:27:16.550895+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:27:16.550895+0000', 'last_clean_scrub_stamp': '2024-09-21T03:27:16.550895+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:27:22.300 INFO:tasks.ceph.ceph_manager.ceph:PG 23.1e is not active+clean 2024-09-21T03:27:22.300 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:27:16.568441+0000', 'last_change': '2024-09-21T03:27:16.568441+0000', 'last_active': '2024-09-21T03:27:16.550895+0000', 'last_peered': '2024-09-21T03:27:16.550895+0000', 'last_clean': '2024-09-21T03:27:16.550895+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:27:16.568441+0000', 'last_undegraded': '2024-09-21T03:27:16.568441+0000', 'last_fullsized': '2024-09-21T03:27:16.568441+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:27:16.550895+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:27:16.550895+0000', 'last_clean_scrub_stamp': '2024-09-21T03:27:16.550895+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:27:22.300 INFO:tasks.ceph.ceph_manager.ceph:PG 23.1a is not active+clean 2024-09-21T03:27:22.300 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:27:16.568774+0000', 'last_change': '2024-09-21T03:27:16.568774+0000', 'last_active': '2024-09-21T03:27:16.550895+0000', 'last_peered': '2024-09-21T03:27:16.550895+0000', 'last_clean': '2024-09-21T03:27:16.550895+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:27:16.568774+0000', 'last_undegraded': '2024-09-21T03:27:16.568774+0000', 'last_fullsized': '2024-09-21T03:27:16.568774+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:27:16.550895+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:27:16.550895+0000', 'last_clean_scrub_stamp': '2024-09-21T03:27:16.550895+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:27:22.300 INFO:tasks.ceph.ceph_manager.ceph:PG 23.13 is not active+clean 2024-09-21T03:27:22.301 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:27:16.567064+0000', 'last_change': '2024-09-21T03:27:16.567064+0000', 'last_active': '2024-09-21T03:27:16.550895+0000', 'last_peered': '2024-09-21T03:27:16.550895+0000', 'last_clean': '2024-09-21T03:27:16.550895+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:27:16.567064+0000', 'last_undegraded': '2024-09-21T03:27:16.567064+0000', 'last_fullsized': '2024-09-21T03:27:16.567064+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:27:16.550895+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:27:16.550895+0000', 'last_clean_scrub_stamp': '2024-09-21T03:27:16.550895+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:27:22.301 INFO:tasks.ceph.ceph_manager.ceph:PG 23.d is not active+clean 2024-09-21T03:27:22.301 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:27:16.566043+0000', 'last_change': '2024-09-21T03:27:16.566043+0000', 'last_active': '2024-09-21T03:27:16.550895+0000', 'last_peered': '2024-09-21T03:27:16.550895+0000', 'last_clean': '2024-09-21T03:27:16.550895+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:27:16.566043+0000', 'last_undegraded': '2024-09-21T03:27:16.566043+0000', 'last_fullsized': '2024-09-21T03:27:16.566043+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:27:16.550895+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:27:16.550895+0000', 'last_clean_scrub_stamp': '2024-09-21T03:27:16.550895+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:27:22.301 INFO:tasks.ceph.ceph_manager.ceph:PG 23.b is not active+clean 2024-09-21T03:27:22.301 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:27:16.566345+0000', 'last_change': '2024-09-21T03:27:16.566345+0000', 'last_active': '2024-09-21T03:27:16.550895+0000', 'last_peered': '2024-09-21T03:27:16.550895+0000', 'last_clean': '2024-09-21T03:27:16.550895+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:27:16.566345+0000', 'last_undegraded': '2024-09-21T03:27:16.566345+0000', 'last_fullsized': '2024-09-21T03:27:16.566345+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:27:16.550895+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:27:16.550895+0000', 'last_clean_scrub_stamp': '2024-09-21T03:27:16.550895+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:27:22.301 INFO:tasks.ceph.ceph_manager.ceph:PG 23.7 is not active+clean 2024-09-21T03:27:22.301 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:27:16.568429+0000', 'last_change': '2024-09-21T03:27:16.568429+0000', 'last_active': '2024-09-21T03:27:16.550895+0000', 'last_peered': '2024-09-21T03:27:16.550895+0000', 'last_clean': '2024-09-21T03:27:16.550895+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:27:16.568429+0000', 'last_undegraded': '2024-09-21T03:27:16.568429+0000', 'last_fullsized': '2024-09-21T03:27:16.568429+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:27:16.550895+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:27:16.550895+0000', 'last_clean_scrub_stamp': '2024-09-21T03:27:16.550895+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:27:22.301 INFO:tasks.ceph.ceph_manager.ceph:PG 23.0 is not active+clean 2024-09-21T03:27:22.301 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-21T03:27:16.566417+0000', 'last_change': '2024-09-21T03:27:16.566417+0000', 'last_active': '2024-09-21T03:27:16.550895+0000', 'last_peered': '2024-09-21T03:27:16.550895+0000', 'last_clean': '2024-09-21T03:27:16.550895+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T03:27:16.566417+0000', 'last_undegraded': '2024-09-21T03:27:16.566417+0000', 'last_fullsized': '2024-09-21T03:27:16.566417+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:27:16.550895+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:27:16.550895+0000', 'last_clean_scrub_stamp': '2024-09-21T03:27:16.550895+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T03:27:22.302 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T03:27:22.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.444+0000 7f570610b640 1 -- 172.21.15.105:0/822208578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f570006f4b0 msgr2=0x7f57000d3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:22.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.444+0000 7f570610b640 1 --2- 172.21.15.105:0/822208578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f570006f4b0 0x7f57000d3330 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f57000c7ff0 tx=0x7f56f402a4f0 comp rx=0 tx=0).stop 2024-09-21T03:27:22.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.444+0000 7f570610b640 1 -- 172.21.15.105:0/822208578 shutdown_connections 2024-09-21T03:27:22.447 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.444+0000 7f570610b640 1 --2- 172.21.15.105:0/822208578 >> v2:172.21.15.162:3300/0 conn(0x7f57000d3870 0x7f57000ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:22.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.444+0000 7f570610b640 1 --2- 172.21.15.105:0/822208578 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f570006f4b0 0x7f57000d3330 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:22.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.444+0000 7f570610b640 1 --2- 172.21.15.105:0/822208578 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f570006e170 0x7f57000b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:22.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.444+0000 7f570610b640 1 -- 172.21.15.105:0/822208578 >> 172.21.15.105:0/822208578 conn(0x7f570008bfc0 msgr2=0x7f570009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:22.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.444+0000 7f570610b640 1 -- 172.21.15.105:0/822208578 shutdown_connections 2024-09-21T03:27:22.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.444+0000 7f570610b640 1 -- 172.21.15.105:0/822208578 wait complete. 2024-09-21T03:27:22.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.446+0000 7f570610b640 1 Processor -- start 2024-09-21T03:27:22.449 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.446+0000 7f570610b640 1 -- start start 2024-09-21T03:27:22.451 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.448+0000 7f570610b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f570006f4b0 0x7f570014e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:22.451 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.448+0000 7f570610b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57000d3870 0x7f570009e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:22.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.448+0000 7f570610b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f570009e710 0x7f57000b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:22.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.448+0000 7f570610b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f57000cf490 con 0x7f570006f4b0 2024-09-21T03:27:22.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.448+0000 7f570610b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f57000cf310 con 0x7f57000d3870 2024-09-21T03:27:22.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.448+0000 7f570610b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f57000d0ce0 con 0x7f570009e710 2024-09-21T03:27:22.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.448+0000 7f56ff7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f570006f4b0 0x7f570014e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:22.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.448+0000 7f56ff7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f570006f4b0 0x7f570014e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40158/0 (socket says 172.21.15.105:40158) 2024-09-21T03:27:22.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.448+0000 7f56ff7fe640 1 -- 172.21.15.105:0/1579699260 learned_addr learned my addr 172.21.15.105:0/1579699260 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:22.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.448+0000 7f56feffd640 1 --2- 172.21.15.105:0/1579699260 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57000d3870 0x7f570009e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:22.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.448+0000 7f56fffff640 1 --2- 172.21.15.105:0/1579699260 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f570009e710 0x7f57000b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:22.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.448+0000 7f56ff7fe640 1 -- 172.21.15.105:0/1579699260 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f570009e710 msgr2=0x7f57000b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:22.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.448+0000 7f56ff7fe640 1 --2- 172.21.15.105:0/1579699260 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f570009e710 0x7f57000b2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:22.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.448+0000 7f56ff7fe640 1 -- 172.21.15.105:0/1579699260 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57000d3870 msgr2=0x7f570009e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:22.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.448+0000 7f56ff7fe640 1 --2- 172.21.15.105:0/1579699260 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57000d3870 0x7f570009e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:22.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.448+0000 7f56ff7fe640 1 -- 172.21.15.105:0/1579699260 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57001f5010 con 0x7f570006f4b0 2024-09-21T03:27:22.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.448+0000 7f56ff7fe640 1 --2- 172.21.15.105:0/1579699260 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f570006f4b0 0x7f570014e450 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f56f000c970 tx=0x7f56f000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:22.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.448+0000 7f56e7fff640 1 -- 172.21.15.105:0/1579699260 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f0007bb0 con 0x7f570006f4b0 2024-09-21T03:27:22.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.448+0000 7f56e7fff640 1 -- 172.21.15.105:0/1579699260 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56f0005020 con 0x7f570006f4b0 2024-09-21T03:27:22.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.448+0000 7f56e7fff640 1 -- 172.21.15.105:0/1579699260 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f0007e60 con 0x7f570006f4b0 2024-09-21T03:27:22.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.448+0000 7f570610b640 1 -- 172.21.15.105:0/1579699260 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57001f52d0 con 0x7f570006f4b0 2024-09-21T03:27:22.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.449+0000 7f570610b640 1 -- 172.21.15.105:0/1579699260 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57001f5890 con 0x7f570006f4b0 2024-09-21T03:27:22.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.449+0000 7f570610b640 1 -- 172.21.15.105:0/1579699260 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f570006e170 con 0x7f570006f4b0 2024-09-21T03:27:22.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.450+0000 7f56e7fff640 1 -- 172.21.15.105:0/1579699260 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f56f0005470 con 0x7f570006f4b0 2024-09-21T03:27:22.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.450+0000 7f56e7fff640 1 --2- 172.21.15.105:0/1579699260 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f56ec078b90 0x7f56ec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:22.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.451+0000 7f56e7fff640 1 -- 172.21.15.105:0/1579699260 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5709+0+0 (secure 0 0 0) 0x7f56f009b050 con 0x7f570006f4b0 2024-09-21T03:27:22.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.451+0000 7f56feffd640 1 --2- 172.21.15.105:0/1579699260 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f56ec078b90 0x7f56ec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:22.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.451+0000 7f56feffd640 1 --2- 172.21.15.105:0/1579699260 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f56ec078b90 0x7f56ec07b0a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f56f4033000 tx=0x7f56f4004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:22.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.455+0000 7f56e7fff640 1 -- 172.21.15.105:0/1579699260 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f56f0014030 con 0x7f570006f4b0 2024-09-21T03:27:22.707 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.704+0000 7f570610b640 1 -- 172.21.15.105:0/1579699260 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f57000b9230 con 0x7f570006f4b0 2024-09-21T03:27:22.707 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.705+0000 7f56e7fff640 1 -- 172.21.15.105:0/1579699260 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1564 (secure 0 0 0) 0x7f56f0062f60 con 0x7f570006f4b0 2024-09-21T03:27:22.707 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:27:22.707 INFO:teuthology.orchestra.run.smithi105.stdout:{"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":557,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":140,"num_osds":8,"num_up_osds":8,"osd_up_since":1726888698,"num_in_osds":8,"osd_in_since":1726888688,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":87},{"state_name":"creating+peering","count":10}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":279224320,"bytes_avail":772814888960,"bytes_total":773094113280,"inactive_pgs_ratio":0.10309278219938278,"write_bytes_sec":2441,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":95,"btime":"2024-09-21T03:27:20:587314+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"a","status":"up:active","gid":8430}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2024-09-21T03:24:55.383365+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T03:27:22.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.707+0000 7f570610b640 1 -- 172.21.15.105:0/1579699260 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f56ec078b90 msgr2=0x7f56ec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:22.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.707+0000 7f570610b640 1 --2- 172.21.15.105:0/1579699260 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f56ec078b90 0x7f56ec07b0a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f56f4033000 tx=0x7f56f4004730 comp rx=0 tx=0).stop 2024-09-21T03:27:22.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.707+0000 7f570610b640 1 -- 172.21.15.105:0/1579699260 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f570006f4b0 msgr2=0x7f570014e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:22.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.707+0000 7f570610b640 1 --2- 172.21.15.105:0/1579699260 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f570006f4b0 0x7f570014e450 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f56f000c970 tx=0x7f56f000ce30 comp rx=0 tx=0).stop 2024-09-21T03:27:22.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.707+0000 7f570610b640 1 -- 172.21.15.105:0/1579699260 shutdown_connections 2024-09-21T03:27:22.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.707+0000 7f570610b640 1 --2- 172.21.15.105:0/1579699260 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f56ec078b90 0x7f56ec07b0a0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:22.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.707+0000 7f570610b640 1 --2- 172.21.15.105:0/1579699260 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f570009e710 0x7f57000b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:22.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.707+0000 7f570610b640 1 --2- 172.21.15.105:0/1579699260 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57000d3870 0x7f570009e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:22.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.707+0000 7f570610b640 1 --2- 172.21.15.105:0/1579699260 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f570006f4b0 0x7f570014e450 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:22.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.707+0000 7f570610b640 1 -- 172.21.15.105:0/1579699260 >> 172.21.15.105:0/1579699260 conn(0x7f570008bfc0 msgr2=0x7f57001617c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:22.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.707+0000 7f570610b640 1 -- 172.21.15.105:0/1579699260 shutdown_connections 2024-09-21T03:27:22.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.707+0000 7f570610b640 1 -- 172.21.15.105:0/1579699260 wait complete. 2024-09-21T03:27:22.721 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-21T03:27:22.721 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:27:22.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.831+0000 7f83280a4640 1 -- 172.21.15.105:0/2157156525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83201600b0 msgr2=0x7f83200ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:22.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.831+0000 7f83280a4640 1 --2- 172.21.15.105:0/2157156525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83201600b0 0x7f83200ccbc0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f831c009830 tx=0x7f831c02a510 comp rx=0 tx=0).stop 2024-09-21T03:27:22.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.831+0000 7f83280a4640 1 -- 172.21.15.105:0/2157156525 shutdown_connections 2024-09-21T03:27:22.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.831+0000 7f83280a4640 1 --2- 172.21.15.105:0/2157156525 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83200b7cc0 0x7f83200cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:22.835 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.831+0000 7f83280a4640 1 --2- 172.21.15.105:0/2157156525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83201600b0 0x7f83200ccbc0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:22.835 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.831+0000 7f83280a4640 1 -- 172.21.15.105:0/2157156525 >> 172.21.15.105:0/2157156525 conn(0x7f832006d4f0 msgr2=0x7f8320071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:22.835 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.831+0000 7f83280a4640 1 -- 172.21.15.105:0/2157156525 shutdown_connections 2024-09-21T03:27:22.835 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.831+0000 7f83280a4640 1 -- 172.21.15.105:0/2157156525 wait complete. 2024-09-21T03:27:22.835 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.833+0000 7f83280a4640 1 Processor -- start 2024-09-21T03:27:22.835 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.833+0000 7f83280a4640 1 -- start start 2024-09-21T03:27:22.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.834+0000 7f83280a4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83200b7cc0 0x7f83200a9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:22.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.834+0000 7f83280a4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83200cf150 0x7f832014f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:22.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.834+0000 7f83280a4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83201600b0 0x7f83200b6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:22.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.834+0000 7f83280a4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f83200b4460 con 0x7f83200cf150 2024-09-21T03:27:22.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.834+0000 7f83280a4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f83200d1ba0 con 0x7f83200b7cc0 2024-09-21T03:27:22.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.834+0000 7f83280a4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f83200b45e0 con 0x7f83201600b0 2024-09-21T03:27:22.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.834+0000 7f832563f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83200cf150 0x7f832014f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:22.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.834+0000 7f832563f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83200cf150 0x7f832014f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40166/0 (socket says 172.21.15.105:40166) 2024-09-21T03:27:22.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.834+0000 7f832563f640 1 -- 172.21.15.105:0/1115121133 learned_addr learned my addr 172.21.15.105:0/1115121133 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:22.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.835+0000 7f8325e40640 1 --2- 172.21.15.105:0/1115121133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83200b7cc0 0x7f83200a9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:22.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.835+0000 7f8326641640 1 --2- 172.21.15.105:0/1115121133 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83201600b0 0x7f83200b6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:22.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.835+0000 7f832563f640 1 -- 172.21.15.105:0/1115121133 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83201600b0 msgr2=0x7f83200b6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:22.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.835+0000 7f832563f640 1 --2- 172.21.15.105:0/1115121133 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83201600b0 0x7f83200b6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:22.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.835+0000 7f832563f640 1 -- 172.21.15.105:0/1115121133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83200b7cc0 msgr2=0x7f83200a9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:22.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.835+0000 7f832563f640 1 --2- 172.21.15.105:0/1115121133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83200b7cc0 0x7f83200a9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:22.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.835+0000 7f832563f640 1 -- 172.21.15.105:0/1115121133 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83201f7f50 con 0x7f83200cf150 2024-09-21T03:27:22.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.835+0000 7f832563f640 1 --2- 172.21.15.105:0/1115121133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83200cf150 0x7f832014f720 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f831000e9f0 tx=0x7f831000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:22.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.835+0000 7f83167fc640 1 -- 172.21.15.105:0/1115121133 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f831000cd80 con 0x7f83200cf150 2024-09-21T03:27:22.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.835+0000 7f83167fc640 1 -- 172.21.15.105:0/1115121133 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8310004020 con 0x7f83200cf150 2024-09-21T03:27:22.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.835+0000 7f83280a4640 1 -- 172.21.15.105:0/1115121133 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83200cade0 con 0x7f83200cf150 2024-09-21T03:27:22.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.835+0000 7f83167fc640 1 -- 172.21.15.105:0/1115121133 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8310004450 con 0x7f83200cf150 2024-09-21T03:27:22.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.835+0000 7f83280a4640 1 -- 172.21.15.105:0/1115121133 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83200cb080 con 0x7f83200cf150 2024-09-21T03:27:22.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.836+0000 7f83280a4640 1 -- 172.21.15.105:0/1115121133 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83200cec10 con 0x7f83200cf150 2024-09-21T03:27:22.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.837+0000 7f83167fc640 1 -- 172.21.15.105:0/1115121133 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f83100035f0 con 0x7f83200cf150 2024-09-21T03:27:22.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.837+0000 7f83167fc640 1 --2- 172.21.15.105:0/1115121133 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8304078bc0 0x7f830407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:22.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.838+0000 7f83167fc640 1 -- 172.21.15.105:0/1115121133 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5709+0+0 (secure 0 0 0) 0x7f831009b530 con 0x7f83200cf150 2024-09-21T03:27:22.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.838+0000 7f8325e40640 1 --2- 172.21.15.105:0/1115121133 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8304078bc0 0x7f830407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:22.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.838+0000 7f8325e40640 1 --2- 172.21.15.105:0/1115121133 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8304078bc0 0x7f830407b0d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f831c034000 tx=0x7f831c004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:22.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:22.842+0000 7f83167fc640 1 -- 172.21.15.105:0/1115121133 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f83100633c0 con 0x7f83200cf150 2024-09-21T03:27:23.017 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:23.014+0000 7f83280a4640 1 -- 172.21.15.105:0/1115121133 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f83201f7a20 con 0x7f8304078bc0 2024-09-21T03:27:23.022 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:23.019+0000 7f83167fc640 1 -- 172.21.15.105:0/1115121133 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251647 (secure 0 0 0) 0x7f83201f7a20 con 0x7f8304078bc0 2024-09-21T03:27:23.025 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:27:23.026 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:27:23.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:23.022+0000 7f83280a4640 1 -- 172.21.15.105:0/1115121133 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8304078bc0 msgr2=0x7f830407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:23.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:23.022+0000 7f83280a4640 1 --2- 172.21.15.105:0/1115121133 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8304078bc0 0x7f830407b0d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f831c034000 tx=0x7f831c004730 comp rx=0 tx=0).stop 2024-09-21T03:27:23.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:23.022+0000 7f83280a4640 1 -- 172.21.15.105:0/1115121133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83200cf150 msgr2=0x7f832014f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:23.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:23.022+0000 7f83280a4640 1 --2- 172.21.15.105:0/1115121133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83200cf150 0x7f832014f720 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f831000e9f0 tx=0x7f831000eeb0 comp rx=0 tx=0).stop 2024-09-21T03:27:23.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:23.022+0000 7f83280a4640 1 -- 172.21.15.105:0/1115121133 shutdown_connections 2024-09-21T03:27:23.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:23.022+0000 7f83280a4640 1 --2- 172.21.15.105:0/1115121133 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8304078bc0 0x7f830407b0d0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:23.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:23.022+0000 7f83280a4640 1 --2- 172.21.15.105:0/1115121133 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83201600b0 0x7f83200b6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:23.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:23.022+0000 7f83280a4640 1 --2- 172.21.15.105:0/1115121133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83200cf150 0x7f832014f720 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:23.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:23.022+0000 7f83280a4640 1 --2- 172.21.15.105:0/1115121133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83200b7cc0 0x7f83200a9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:23.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:23.022+0000 7f83280a4640 1 -- 172.21.15.105:0/1115121133 >> 172.21.15.105:0/1115121133 conn(0x7f832006d4f0 msgr2=0x7f83200b3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:23.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:23.023+0000 7f83280a4640 1 -- 172.21.15.105:0/1115121133 shutdown_connections 2024-09-21T03:27:23.029 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:23.023+0000 7f83280a4640 1 -- 172.21.15.105:0/1115121133 wait complete. 2024-09-21T03:27:23.036 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":406,"stamp":"2024-09-21T03:27:21.423079+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":272680,"kb_used_data":14812,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754702040,"statfs":{"total":773094113280,"available":772814888960,"internally_reserved":0,"allocated":15167488,"data_stored":7156054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.870896"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583647+0000","last_change":"2024-09-21T03:27:17.581755+0000","last_active":"2024-09-21T03:27:18.583647+0000","last_peered":"2024-09-21T03:27:18.583647+0000","last_clean":"2024-09-21T03:27:18.583647+0000","last_became_active":"2024-09-21T03:27:17.581133+0000","last_became_peered":"2024-09-21T03:27:17.581133+0000","last_unstale":"2024-09-21T03:27:18.583647+0000","last_undegraded":"2024-09-21T03:27:18.583647+0000","last_fullsized":"2024-09-21T03:27:18.583647+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:43.005587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.586375+0000","last_change":"2024-09-21T03:27:17.573023+0000","last_active":"2024-09-21T03:27:18.586375+0000","last_peered":"2024-09-21T03:27:18.586375+0000","last_clean":"2024-09-21T03:27:18.586375+0000","last_became_active":"2024-09-21T03:27:17.572695+0000","last_became_peered":"2024-09-21T03:27:17.572695+0000","last_unstale":"2024-09-21T03:27:18.586375+0000","last_undegraded":"2024-09-21T03:27:18.586375+0000","last_fullsized":"2024-09-21T03:27:18.586375+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:03.003218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.592496+0000","last_change":"2024-09-21T03:27:17.586788+0000","last_active":"2024-09-21T03:27:17.592496+0000","last_peered":"2024-09-21T03:27:17.592496+0000","last_clean":"2024-09-21T03:27:17.592496+0000","last_became_active":"2024-09-21T03:27:17.586413+0000","last_became_peered":"2024-09-21T03:27:17.586413+0000","last_unstale":"2024-09-21T03:27:17.592496+0000","last_undegraded":"2024-09-21T03:27:17.592496+0000","last_fullsized":"2024-09-21T03:27:17.592496+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:13.401161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.584595+0000","last_change":"2024-09-21T03:27:17.580965+0000","last_active":"2024-09-21T03:27:17.584595+0000","last_peered":"2024-09-21T03:27:17.584595+0000","last_clean":"2024-09-21T03:27:17.584595+0000","last_became_active":"2024-09-21T03:27:17.580581+0000","last_became_peered":"2024-09-21T03:27:17.580581+0000","last_unstale":"2024-09-21T03:27:17.584595+0000","last_undegraded":"2024-09-21T03:27:17.584595+0000","last_fullsized":"2024-09-21T03:27:17.584595+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:34.308409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.586111+0000","last_change":"2024-09-21T03:27:17.585238+0000","last_active":"2024-09-21T03:27:18.586111+0000","last_peered":"2024-09-21T03:27:18.586111+0000","last_clean":"2024-09-21T03:27:18.586111+0000","last_became_active":"2024-09-21T03:27:17.583972+0000","last_became_peered":"2024-09-21T03:27:17.583972+0000","last_unstale":"2024-09-21T03:27:18.586111+0000","last_undegraded":"2024-09-21T03:27:18.586111+0000","last_fullsized":"2024-09-21T03:27:18.586111+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:29.413682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.584474+0000","last_change":"2024-09-21T03:27:17.580318+0000","last_active":"2024-09-21T03:27:17.584474+0000","last_peered":"2024-09-21T03:27:17.584474+0000","last_clean":"2024-09-21T03:27:17.584474+0000","last_became_active":"2024-09-21T03:27:17.580006+0000","last_became_peered":"2024-09-21T03:27:17.580006+0000","last_unstale":"2024-09-21T03:27:17.584474+0000","last_undegraded":"2024-09-21T03:27:17.584474+0000","last_fullsized":"2024-09-21T03:27:17.584474+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:45:23.305894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-21T03:27:16.570177+0000","last_change":"2024-09-21T03:27:16.570177+0000","last_active":"2024-09-21T03:27:16.550895+0000","last_peered":"2024-09-21T03:27:16.550895+0000","last_clean":"2024-09-21T03:27:16.550895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:27:16.570177+0000","last_undegraded":"2024-09-21T03:27:16.570177+0000","last_fullsized":"2024-09-21T03:27:16.570177+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585808+0000","last_change":"2024-09-21T03:27:17.586097+0000","last_active":"2024-09-21T03:27:18.585808+0000","last_peered":"2024-09-21T03:27:18.585808+0000","last_clean":"2024-09-21T03:27:18.585808+0000","last_became_active":"2024-09-21T03:27:17.585734+0000","last_became_peered":"2024-09-21T03:27:17.585734+0000","last_unstale":"2024-09-21T03:27:18.585808+0000","last_undegraded":"2024-09-21T03:27:18.585808+0000","last_fullsized":"2024-09-21T03:27:18.585808+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:21:44.303210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.586651+0000","last_change":"2024-09-21T03:27:17.586773+0000","last_active":"2024-09-21T03:27:18.586651+0000","last_peered":"2024-09-21T03:27:18.586651+0000","last_clean":"2024-09-21T03:27:18.586651+0000","last_became_active":"2024-09-21T03:27:17.586439+0000","last_became_peered":"2024-09-21T03:27:17.586439+0000","last_unstale":"2024-09-21T03:27:18.586651+0000","last_undegraded":"2024-09-21T03:27:18.586651+0000","last_fullsized":"2024-09-21T03:27:18.586651+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:34.474168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.586400+0000","last_change":"2024-09-21T03:27:17.577732+0000","last_active":"2024-09-21T03:27:18.586400+0000","last_peered":"2024-09-21T03:27:18.586400+0000","last_clean":"2024-09-21T03:27:18.586400+0000","last_became_active":"2024-09-21T03:27:17.577442+0000","last_became_peered":"2024-09-21T03:27:17.577442+0000","last_unstale":"2024-09-21T03:27:18.586400+0000","last_undegraded":"2024-09-21T03:27:18.586400+0000","last_fullsized":"2024-09-21T03:27:18.586400+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:18:21.010195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.586106+0000","last_change":"2024-09-21T03:27:17.585024+0000","last_active":"2024-09-21T03:27:18.586106+0000","last_peered":"2024-09-21T03:27:18.586106+0000","last_clean":"2024-09-21T03:27:18.586106+0000","last_became_active":"2024-09-21T03:27:17.584681+0000","last_became_peered":"2024-09-21T03:27:17.584681+0000","last_unstale":"2024-09-21T03:27:18.586106+0000","last_undegraded":"2024-09-21T03:27:18.586106+0000","last_fullsized":"2024-09-21T03:27:18.586106+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:16.877998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.586553+0000","last_change":"2024-09-21T03:27:17.573714+0000","last_active":"2024-09-21T03:27:18.586553+0000","last_peered":"2024-09-21T03:27:18.586553+0000","last_clean":"2024-09-21T03:27:18.586553+0000","last_became_active":"2024-09-21T03:27:17.573344+0000","last_became_peered":"2024-09-21T03:27:17.573344+0000","last_unstale":"2024-09-21T03:27:18.586553+0000","last_undegraded":"2024-09-21T03:27:18.586553+0000","last_fullsized":"2024-09-21T03:27:18.586553+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:16:50.560426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.583400+0000","last_change":"2024-09-21T03:27:17.580024+0000","last_active":"2024-09-21T03:27:17.583400+0000","last_peered":"2024-09-21T03:27:17.583400+0000","last_clean":"2024-09-21T03:27:17.583400+0000","last_became_active":"2024-09-21T03:27:17.579693+0000","last_became_peered":"2024-09-21T03:27:17.579693+0000","last_unstale":"2024-09-21T03:27:17.583400+0000","last_undegraded":"2024-09-21T03:27:17.583400+0000","last_fullsized":"2024-09-21T03:27:17.583400+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:27:17.606293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.579208+0000","last_change":"2024-09-21T03:27:17.573051+0000","last_active":"2024-09-21T03:27:17.579208+0000","last_peered":"2024-09-21T03:27:17.579208+0000","last_clean":"2024-09-21T03:27:17.579208+0000","last_became_active":"2024-09-21T03:27:17.572714+0000","last_became_peered":"2024-09-21T03:27:17.572714+0000","last_unstale":"2024-09-21T03:27:17.579208+0000","last_undegraded":"2024-09-21T03:27:17.579208+0000","last_fullsized":"2024-09-21T03:27:17.579208+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:31.027265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583130+0000","last_change":"2024-09-21T03:27:17.581234+0000","last_active":"2024-09-21T03:27:18.583130+0000","last_peered":"2024-09-21T03:27:18.583130+0000","last_clean":"2024-09-21T03:27:18.583130+0000","last_became_active":"2024-09-21T03:27:17.580865+0000","last_became_peered":"2024-09-21T03:27:17.580865+0000","last_unstale":"2024-09-21T03:27:18.583130+0000","last_undegraded":"2024-09-21T03:27:18.583130+0000","last_fullsized":"2024-09-21T03:27:18.583130+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:29:44.168728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-21T03:27:16.569726+0000","last_change":"2024-09-21T03:27:16.569726+0000","last_active":"2024-09-21T03:27:16.550895+0000","last_peered":"2024-09-21T03:27:16.550895+0000","last_clean":"2024-09-21T03:27:16.550895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:27:16.569726+0000","last_undegraded":"2024-09-21T03:27:16.569726+0000","last_fullsized":"2024-09-21T03:27:16.569726+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.587675+0000","last_change":"2024-09-21T03:27:17.585074+0000","last_active":"2024-09-21T03:27:17.587675+0000","last_peered":"2024-09-21T03:27:17.587675+0000","last_clean":"2024-09-21T03:27:17.587675+0000","last_became_active":"2024-09-21T03:27:17.584763+0000","last_became_peered":"2024-09-21T03:27:17.584763+0000","last_unstale":"2024-09-21T03:27:17.587675+0000","last_undegraded":"2024-09-21T03:27:17.587675+0000","last_fullsized":"2024-09-21T03:27:17.587675+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:16:05.884637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.581363+0000","last_change":"2024-09-21T03:27:17.576376+0000","last_active":"2024-09-21T03:27:17.581363+0000","last_peered":"2024-09-21T03:27:17.581363+0000","last_clean":"2024-09-21T03:27:17.581363+0000","last_became_active":"2024-09-21T03:27:17.576094+0000","last_became_peered":"2024-09-21T03:27:17.576094+0000","last_unstale":"2024-09-21T03:27:17.581363+0000","last_undegraded":"2024-09-21T03:27:17.581363+0000","last_fullsized":"2024-09-21T03:27:17.581363+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:56.640317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.588809+0000","last_change":"2024-09-21T03:27:17.585841+0000","last_active":"2024-09-21T03:27:17.588809+0000","last_peered":"2024-09-21T03:27:17.588809+0000","last_clean":"2024-09-21T03:27:17.588809+0000","last_became_active":"2024-09-21T03:27:17.585539+0000","last_became_peered":"2024-09-21T03:27:17.585539+0000","last_unstale":"2024-09-21T03:27:17.588809+0000","last_undegraded":"2024-09-21T03:27:17.588809+0000","last_fullsized":"2024-09-21T03:27:17.588809+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:01.563086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.580419+0000","last_change":"2024-09-21T03:27:17.575335+0000","last_active":"2024-09-21T03:27:17.580419+0000","last_peered":"2024-09-21T03:27:17.580419+0000","last_clean":"2024-09-21T03:27:17.580419+0000","last_became_active":"2024-09-21T03:27:17.573625+0000","last_became_peered":"2024-09-21T03:27:17.573625+0000","last_unstale":"2024-09-21T03:27:17.580419+0000","last_undegraded":"2024-09-21T03:27:17.580419+0000","last_fullsized":"2024-09-21T03:27:17.580419+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:10.758459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.587667+0000","last_change":"2024-09-21T03:27:17.585062+0000","last_active":"2024-09-21T03:27:17.587667+0000","last_peered":"2024-09-21T03:27:17.587667+0000","last_clean":"2024-09-21T03:27:17.587667+0000","last_became_active":"2024-09-21T03:27:17.584730+0000","last_became_peered":"2024-09-21T03:27:17.584730+0000","last_unstale":"2024-09-21T03:27:17.587667+0000","last_undegraded":"2024-09-21T03:27:17.587667+0000","last_fullsized":"2024-09-21T03:27:17.587667+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:16.068461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.586508+0000","last_change":"2024-09-21T03:27:17.577064+0000","last_active":"2024-09-21T03:27:18.586508+0000","last_peered":"2024-09-21T03:27:18.586508+0000","last_clean":"2024-09-21T03:27:18.586508+0000","last_became_active":"2024-09-21T03:27:17.576634+0000","last_became_peered":"2024-09-21T03:27:17.576634+0000","last_unstale":"2024-09-21T03:27:18.586508+0000","last_undegraded":"2024-09-21T03:27:18.586508+0000","last_fullsized":"2024-09-21T03:27:18.586508+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:42.013551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.584371+0000","last_change":"2024-09-21T03:27:17.578564+0000","last_active":"2024-09-21T03:27:17.584371+0000","last_peered":"2024-09-21T03:27:17.584371+0000","last_clean":"2024-09-21T03:27:17.584371+0000","last_became_active":"2024-09-21T03:27:17.578274+0000","last_became_peered":"2024-09-21T03:27:17.578274+0000","last_unstale":"2024-09-21T03:27:17.584371+0000","last_undegraded":"2024-09-21T03:27:17.584371+0000","last_fullsized":"2024-09-21T03:27:17.584371+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:05.868201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585847+0000","last_change":"2024-09-21T03:27:17.582077+0000","last_active":"2024-09-21T03:27:18.585847+0000","last_peered":"2024-09-21T03:27:18.585847+0000","last_clean":"2024-09-21T03:27:18.585847+0000","last_became_active":"2024-09-21T03:27:17.581735+0000","last_became_peered":"2024-09-21T03:27:17.581735+0000","last_unstale":"2024-09-21T03:27:18.585847+0000","last_undegraded":"2024-09-21T03:27:18.585847+0000","last_fullsized":"2024-09-21T03:27:18.585847+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:03.545497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.592798+0000","last_change":"2024-09-21T03:27:17.585639+0000","last_active":"2024-09-21T03:27:17.592798+0000","last_peered":"2024-09-21T03:27:17.592798+0000","last_clean":"2024-09-21T03:27:17.592798+0000","last_became_active":"2024-09-21T03:27:17.585334+0000","last_became_peered":"2024-09-21T03:27:17.585334+0000","last_unstale":"2024-09-21T03:27:17.592798+0000","last_undegraded":"2024-09-21T03:27:17.592798+0000","last_fullsized":"2024-09-21T03:27:17.592798+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:18:41.702167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-21T03:27:16.569388+0000","last_change":"2024-09-21T03:27:16.569388+0000","last_active":"2024-09-21T03:27:16.550895+0000","last_peered":"2024-09-21T03:27:16.550895+0000","last_clean":"2024-09-21T03:27:16.550895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:27:16.569388+0000","last_undegraded":"2024-09-21T03:27:16.569388+0000","last_fullsized":"2024-09-21T03:27:16.569388+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.592458+0000","last_change":"2024-09-21T03:27:17.584543+0000","last_active":"2024-09-21T03:27:17.592458+0000","last_peered":"2024-09-21T03:27:17.592458+0000","last_clean":"2024-09-21T03:27:17.592458+0000","last_became_active":"2024-09-21T03:27:17.584163+0000","last_became_peered":"2024-09-21T03:27:17.584163+0000","last_unstale":"2024-09-21T03:27:17.592458+0000","last_undegraded":"2024-09-21T03:27:17.592458+0000","last_fullsized":"2024-09-21T03:27:17.592458+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:59:25.012491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.586980+0000","last_change":"2024-09-21T03:27:17.584109+0000","last_active":"2024-09-21T03:27:17.586980+0000","last_peered":"2024-09-21T03:27:17.586980+0000","last_clean":"2024-09-21T03:27:17.586980+0000","last_became_active":"2024-09-21T03:27:17.583795+0000","last_became_peered":"2024-09-21T03:27:17.583795+0000","last_unstale":"2024-09-21T03:27:17.586980+0000","last_undegraded":"2024-09-21T03:27:17.586980+0000","last_fullsized":"2024-09-21T03:27:17.586980+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:02:40.150497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.592602+0000","last_change":"2024-09-21T03:27:17.584726+0000","last_active":"2024-09-21T03:27:17.592602+0000","last_peered":"2024-09-21T03:27:17.592602+0000","last_clean":"2024-09-21T03:27:17.592602+0000","last_became_active":"2024-09-21T03:27:17.584401+0000","last_became_peered":"2024-09-21T03:27:17.584401+0000","last_unstale":"2024-09-21T03:27:17.592602+0000","last_undegraded":"2024-09-21T03:27:17.592602+0000","last_fullsized":"2024-09-21T03:27:17.592602+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:47:17.066223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585339+0000","last_change":"2024-09-21T03:27:17.583387+0000","last_active":"2024-09-21T03:27:18.585339+0000","last_peered":"2024-09-21T03:27:18.585339+0000","last_clean":"2024-09-21T03:27:18.585339+0000","last_became_active":"2024-09-21T03:27:17.582898+0000","last_became_peered":"2024-09-21T03:27:17.582898+0000","last_unstale":"2024-09-21T03:27:18.585339+0000","last_undegraded":"2024-09-21T03:27:18.585339+0000","last_fullsized":"2024-09-21T03:27:18.585339+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:42.013551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.584662+0000","last_change":"2024-09-21T03:27:17.592422+0000","last_active":"2024-09-21T03:27:18.584662+0000","last_peered":"2024-09-21T03:27:18.584662+0000","last_clean":"2024-09-21T03:27:18.584662+0000","last_became_active":"2024-09-21T03:27:17.592093+0000","last_became_peered":"2024-09-21T03:27:17.592093+0000","last_unstale":"2024-09-21T03:27:18.584662+0000","last_undegraded":"2024-09-21T03:27:18.584662+0000","last_fullsized":"2024-09-21T03:27:18.584662+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:06:13.764175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.582876+0000","last_change":"2024-09-21T03:27:17.579122+0000","last_active":"2024-09-21T03:27:17.582876+0000","last_peered":"2024-09-21T03:27:17.582876+0000","last_clean":"2024-09-21T03:27:17.582876+0000","last_became_active":"2024-09-21T03:27:17.578841+0000","last_became_peered":"2024-09-21T03:27:17.578841+0000","last_unstale":"2024-09-21T03:27:17.582876+0000","last_undegraded":"2024-09-21T03:27:17.582876+0000","last_fullsized":"2024-09-21T03:27:17.582876+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:17.468257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-21T03:27:16.568441+0000","last_change":"2024-09-21T03:27:16.568441+0000","last_active":"2024-09-21T03:27:16.550895+0000","last_peered":"2024-09-21T03:27:16.550895+0000","last_clean":"2024-09-21T03:27:16.550895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:27:16.568441+0000","last_undegraded":"2024-09-21T03:27:16.568441+0000","last_fullsized":"2024-09-21T03:27:16.568441+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"139'4","reported_seq":19,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583565+0000","last_change":"2024-09-21T03:27:16.581015+0000","last_active":"2024-09-21T03:27:18.583565+0000","last_peered":"2024-09-21T03:27:18.583565+0000","last_clean":"2024-09-21T03:27:18.583565+0000","last_became_active":"2024-09-21T03:27:16.580691+0000","last_became_peered":"2024-09-21T03:27:16.580691+0000","last_unstale":"2024-09-21T03:27:18.583565+0000","last_undegraded":"2024-09-21T03:27:18.583565+0000","last_fullsized":"2024-09-21T03:27:18.583565+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:58:11.894626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585350+0000","last_change":"2024-09-21T03:27:17.584425+0000","last_active":"2024-09-21T03:27:18.585350+0000","last_peered":"2024-09-21T03:27:18.585350+0000","last_clean":"2024-09-21T03:27:18.585350+0000","last_became_active":"2024-09-21T03:27:17.584118+0000","last_became_peered":"2024-09-21T03:27:17.584118+0000","last_unstale":"2024-09-21T03:27:18.585350+0000","last_undegraded":"2024-09-21T03:27:18.585350+0000","last_fullsized":"2024-09-21T03:27:18.585350+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:51.069144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"139'1","reported_seq":16,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585028+0000","last_change":"2024-09-21T03:27:16.578107+0000","last_active":"2024-09-21T03:27:18.585028+0000","last_peered":"2024-09-21T03:27:18.585028+0000","last_clean":"2024-09-21T03:27:18.585028+0000","last_became_active":"2024-09-21T03:27:16.577745+0000","last_became_peered":"2024-09-21T03:27:16.577745+0000","last_unstale":"2024-09-21T03:27:18.585028+0000","last_undegraded":"2024-09-21T03:27:18.585028+0000","last_fullsized":"2024-09-21T03:27:18.585028+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:38.887631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.587168+0000","last_change":"2024-09-21T03:27:17.582825+0000","last_active":"2024-09-21T03:27:17.587168+0000","last_peered":"2024-09-21T03:27:17.587168+0000","last_clean":"2024-09-21T03:27:17.587168+0000","last_became_active":"2024-09-21T03:27:17.582405+0000","last_became_peered":"2024-09-21T03:27:17.582405+0000","last_unstale":"2024-09-21T03:27:17.587168+0000","last_undegraded":"2024-09-21T03:27:17.587168+0000","last_fullsized":"2024-09-21T03:27:17.587168+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:16.762738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"139'2","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.597455+0000","last_change":"2024-09-21T03:27:16.577605+0000","last_active":"2024-09-21T03:27:17.597455+0000","last_peered":"2024-09-21T03:27:17.597455+0000","last_clean":"2024-09-21T03:27:17.597455+0000","last_became_active":"2024-09-21T03:27:16.577310+0000","last_became_peered":"2024-09-21T03:27:16.577310+0000","last_unstale":"2024-09-21T03:27:17.597455+0000","last_undegraded":"2024-09-21T03:27:17.597455+0000","last_fullsized":"2024-09-21T03:27:17.597455+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:41.413162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.581303+0000","last_change":"2024-09-21T03:27:17.579293+0000","last_active":"2024-09-21T03:27:17.581303+0000","last_peered":"2024-09-21T03:27:17.581303+0000","last_clean":"2024-09-21T03:27:17.581303+0000","last_became_active":"2024-09-21T03:27:17.578780+0000","last_became_peered":"2024-09-21T03:27:17.578780+0000","last_unstale":"2024-09-21T03:27:17.581303+0000","last_undegraded":"2024-09-21T03:27:17.581303+0000","last_fullsized":"2024-09-21T03:27:17.581303+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:13.328076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"139'2","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.597487+0000","last_change":"2024-09-21T03:27:16.574950+0000","last_active":"2024-09-21T03:27:17.597487+0000","last_peered":"2024-09-21T03:27:17.597487+0000","last_clean":"2024-09-21T03:27:17.597487+0000","last_became_active":"2024-09-21T03:27:16.573561+0000","last_became_peered":"2024-09-21T03:27:16.573561+0000","last_unstale":"2024-09-21T03:27:17.597487+0000","last_undegraded":"2024-09-21T03:27:17.597487+0000","last_fullsized":"2024-09-21T03:27:17.597487+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:24.760299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-21T03:27:16.568774+0000","last_change":"2024-09-21T03:27:16.568774+0000","last_active":"2024-09-21T03:27:16.550895+0000","last_peered":"2024-09-21T03:27:16.550895+0000","last_clean":"2024-09-21T03:27:16.550895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:27:16.568774+0000","last_undegraded":"2024-09-21T03:27:16.568774+0000","last_fullsized":"2024-09-21T03:27:16.568774+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"139'1","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.596812+0000","last_change":"2024-09-21T03:27:16.579737+0000","last_active":"2024-09-21T03:27:17.596812+0000","last_peered":"2024-09-21T03:27:17.596812+0000","last_clean":"2024-09-21T03:27:17.596812+0000","last_became_active":"2024-09-21T03:27:16.579428+0000","last_became_peered":"2024-09-21T03:27:16.579428+0000","last_unstale":"2024-09-21T03:27:17.596812+0000","last_undegraded":"2024-09-21T03:27:17.596812+0000","last_fullsized":"2024-09-21T03:27:17.596812+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:02:22.984543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.586953+0000","last_change":"2024-09-21T03:27:17.583627+0000","last_active":"2024-09-21T03:27:17.586953+0000","last_peered":"2024-09-21T03:27:17.586953+0000","last_clean":"2024-09-21T03:27:17.586953+0000","last_became_active":"2024-09-21T03:27:17.583282+0000","last_became_peered":"2024-09-21T03:27:17.583282+0000","last_unstale":"2024-09-21T03:27:17.586953+0000","last_undegraded":"2024-09-21T03:27:17.586953+0000","last_fullsized":"2024-09-21T03:27:17.586953+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:15:39.847481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"139'1","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.597355+0000","last_change":"2024-09-21T03:27:16.574689+0000","last_active":"2024-09-21T03:27:17.597355+0000","last_peered":"2024-09-21T03:27:17.597355+0000","last_clean":"2024-09-21T03:27:17.597355+0000","last_became_active":"2024-09-21T03:27:16.574380+0000","last_became_peered":"2024-09-21T03:27:16.574380+0000","last_unstale":"2024-09-21T03:27:17.597355+0000","last_undegraded":"2024-09-21T03:27:17.597355+0000","last_fullsized":"2024-09-21T03:27:17.597355+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:03.610863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.589621+0000","last_change":"2024-09-21T03:27:17.586684+0000","last_active":"2024-09-21T03:27:17.589621+0000","last_peered":"2024-09-21T03:27:17.589621+0000","last_clean":"2024-09-21T03:27:17.589621+0000","last_became_active":"2024-09-21T03:27:17.586407+0000","last_became_peered":"2024-09-21T03:27:17.586407+0000","last_unstale":"2024-09-21T03:27:17.589621+0000","last_undegraded":"2024-09-21T03:27:17.589621+0000","last_fullsized":"2024-09-21T03:27:17.589621+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:18:37.794112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585775+0000","last_change":"2024-09-21T03:27:16.574797+0000","last_active":"2024-09-21T03:27:18.585775+0000","last_peered":"2024-09-21T03:27:18.585775+0000","last_clean":"2024-09-21T03:27:18.585775+0000","last_became_active":"2024-09-21T03:27:16.574469+0000","last_became_peered":"2024-09-21T03:27:16.574469+0000","last_unstale":"2024-09-21T03:27:18.585775+0000","last_undegraded":"2024-09-21T03:27:18.585775+0000","last_fullsized":"2024-09-21T03:27:18.585775+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:12.431154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.579396+0000","last_change":"2024-09-21T03:27:17.576792+0000","last_active":"2024-09-21T03:27:17.579396+0000","last_peered":"2024-09-21T03:27:17.579396+0000","last_clean":"2024-09-21T03:27:17.579396+0000","last_became_active":"2024-09-21T03:27:17.576477+0000","last_became_peered":"2024-09-21T03:27:17.576477+0000","last_unstale":"2024-09-21T03:27:17.579396+0000","last_undegraded":"2024-09-21T03:27:17.579396+0000","last_fullsized":"2024-09-21T03:27:17.579396+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:02:44.799481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-21T03:27:16.581906+0000","last_change":"2024-09-21T03:27:16.578176+0000","last_active":"2024-09-21T03:27:16.581906+0000","last_peered":"2024-09-21T03:27:16.581906+0000","last_clean":"2024-09-21T03:27:16.581906+0000","last_became_active":"2024-09-21T03:27:16.577886+0000","last_became_peered":"2024-09-21T03:27:16.577886+0000","last_unstale":"2024-09-21T03:27:16.581906+0000","last_undegraded":"2024-09-21T03:27:16.581906+0000","last_fullsized":"2024-09-21T03:27:16.581906+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:29:46.791624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.581935+0000","last_change":"2024-09-21T03:27:17.577247+0000","last_active":"2024-09-21T03:27:17.581935+0000","last_peered":"2024-09-21T03:27:17.581935+0000","last_clean":"2024-09-21T03:27:17.581935+0000","last_became_active":"2024-09-21T03:27:17.576950+0000","last_became_peered":"2024-09-21T03:27:17.576950+0000","last_unstale":"2024-09-21T03:27:17.581935+0000","last_undegraded":"2024-09-21T03:27:17.581935+0000","last_fullsized":"2024-09-21T03:27:17.581935+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:16.951026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.572137+0000","last_change":"2024-09-21T03:27:16.578096+0000","last_active":"2024-09-21T03:27:17.572137+0000","last_peered":"2024-09-21T03:27:17.572137+0000","last_clean":"2024-09-21T03:27:17.572137+0000","last_became_active":"2024-09-21T03:27:16.577770+0000","last_became_peered":"2024-09-21T03:27:16.577770+0000","last_unstale":"2024-09-21T03:27:17.572137+0000","last_undegraded":"2024-09-21T03:27:17.572137+0000","last_fullsized":"2024-09-21T03:27:17.572137+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:54.303412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.581766+0000","last_change":"2024-09-21T03:27:17.577763+0000","last_active":"2024-09-21T03:27:17.581766+0000","last_peered":"2024-09-21T03:27:17.581766+0000","last_clean":"2024-09-21T03:27:17.581766+0000","last_became_active":"2024-09-21T03:27:17.577479+0000","last_became_peered":"2024-09-21T03:27:17.577479+0000","last_unstale":"2024-09-21T03:27:17.581766+0000","last_undegraded":"2024-09-21T03:27:17.581766+0000","last_fullsized":"2024-09-21T03:27:17.581766+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:56:15.766800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"139'3","reported_seq":16,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.596848+0000","last_change":"2024-09-21T03:27:16.577153+0000","last_active":"2024-09-21T03:27:17.596848+0000","last_peered":"2024-09-21T03:27:17.596848+0000","last_clean":"2024-09-21T03:27:17.596848+0000","last_became_active":"2024-09-21T03:27:16.576867+0000","last_became_peered":"2024-09-21T03:27:16.576867+0000","last_unstale":"2024-09-21T03:27:17.596848+0000","last_undegraded":"2024-09-21T03:27:17.596848+0000","last_fullsized":"2024-09-21T03:27:17.596848+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:46.573583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585356+0000","last_change":"2024-09-21T03:27:17.583787+0000","last_active":"2024-09-21T03:27:18.585356+0000","last_peered":"2024-09-21T03:27:18.585356+0000","last_clean":"2024-09-21T03:27:18.585356+0000","last_became_active":"2024-09-21T03:27:17.583260+0000","last_became_peered":"2024-09-21T03:27:17.583260+0000","last_unstale":"2024-09-21T03:27:18.585356+0000","last_undegraded":"2024-09-21T03:27:18.585356+0000","last_fullsized":"2024-09-21T03:27:18.585356+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:51.228873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"139'6","reported_seq":21,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.584840+0000","last_change":"2024-09-21T03:27:16.571658+0000","last_active":"2024-09-21T03:27:18.584840+0000","last_peered":"2024-09-21T03:27:18.584840+0000","last_clean":"2024-09-21T03:27:18.584840+0000","last_became_active":"2024-09-21T03:27:16.571305+0000","last_became_peered":"2024-09-21T03:27:16.571305+0000","last_unstale":"2024-09-21T03:27:18.584840+0000","last_undegraded":"2024-09-21T03:27:18.584840+0000","last_fullsized":"2024-09-21T03:27:18.584840+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:30.379967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.578257+0000","last_change":"2024-09-21T03:27:17.573089+0000","last_active":"2024-09-21T03:27:17.578257+0000","last_peered":"2024-09-21T03:27:17.578257+0000","last_clean":"2024-09-21T03:27:17.578257+0000","last_became_active":"2024-09-21T03:27:17.572836+0000","last_became_peered":"2024-09-21T03:27:17.572836+0000","last_unstale":"2024-09-21T03:27:17.578257+0000","last_undegraded":"2024-09-21T03:27:17.578257+0000","last_fullsized":"2024-09-21T03:27:17.578257+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:44.827317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"139'2","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.597889+0000","last_change":"2024-09-21T03:27:16.572761+0000","last_active":"2024-09-21T03:27:17.597889+0000","last_peered":"2024-09-21T03:27:17.597889+0000","last_clean":"2024-09-21T03:27:17.597889+0000","last_became_active":"2024-09-21T03:27:16.572470+0000","last_became_peered":"2024-09-21T03:27:16.572470+0000","last_unstale":"2024-09-21T03:27:17.597889+0000","last_undegraded":"2024-09-21T03:27:17.597889+0000","last_fullsized":"2024-09-21T03:27:17.597889+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:40.398460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-21T03:27:16.567064+0000","last_change":"2024-09-21T03:27:16.567064+0000","last_active":"2024-09-21T03:27:16.550895+0000","last_peered":"2024-09-21T03:27:16.550895+0000","last_clean":"2024-09-21T03:27:16.550895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:27:16.567064+0000","last_undegraded":"2024-09-21T03:27:16.567064+0000","last_fullsized":"2024-09-21T03:27:16.567064+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.566307+0000","last_change":"2024-09-21T03:27:16.574985+0000","last_active":"2024-09-21T03:27:17.566307+0000","last_peered":"2024-09-21T03:27:17.566307+0000","last_clean":"2024-09-21T03:27:17.566307+0000","last_became_active":"2024-09-21T03:27:16.574650+0000","last_became_peered":"2024-09-21T03:27:16.574650+0000","last_unstale":"2024-09-21T03:27:17.566307+0000","last_undegraded":"2024-09-21T03:27:17.566307+0000","last_fullsized":"2024-09-21T03:27:17.566307+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:00.204114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.590179+0000","last_change":"2024-09-21T03:27:17.589346+0000","last_active":"2024-09-21T03:27:17.590179+0000","last_peered":"2024-09-21T03:27:17.590179+0000","last_clean":"2024-09-21T03:27:17.590179+0000","last_became_active":"2024-09-21T03:27:17.589034+0000","last_became_peered":"2024-09-21T03:27:17.589034+0000","last_unstale":"2024-09-21T03:27:17.590179+0000","last_undegraded":"2024-09-21T03:27:17.590179+0000","last_fullsized":"2024-09-21T03:27:17.590179+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:21:44.303210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.574173+0000","last_change":"2024-09-21T03:27:16.576083+0000","last_active":"2024-09-21T03:27:17.574173+0000","last_peered":"2024-09-21T03:27:17.574173+0000","last_clean":"2024-09-21T03:27:17.574173+0000","last_became_active":"2024-09-21T03:27:16.575789+0000","last_became_peered":"2024-09-21T03:27:16.575789+0000","last_unstale":"2024-09-21T03:27:17.574173+0000","last_undegraded":"2024-09-21T03:27:17.574173+0000","last_fullsized":"2024-09-21T03:27:17.574173+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:35.838462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.580459+0000","last_change":"2024-09-21T03:27:17.576643+0000","last_active":"2024-09-21T03:27:17.580459+0000","last_peered":"2024-09-21T03:27:17.580459+0000","last_clean":"2024-09-21T03:27:17.580459+0000","last_became_active":"2024-09-21T03:27:17.576339+0000","last_became_peered":"2024-09-21T03:27:17.576339+0000","last_unstale":"2024-09-21T03:27:17.580459+0000","last_undegraded":"2024-09-21T03:27:17.580459+0000","last_fullsized":"2024-09-21T03:27:17.580459+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:41.117745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"139'8","reported_seq":23,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.584534+0000","last_change":"2024-09-21T03:27:16.574966+0000","last_active":"2024-09-21T03:27:18.584534+0000","last_peered":"2024-09-21T03:27:18.584534+0000","last_clean":"2024-09-21T03:27:18.584534+0000","last_became_active":"2024-09-21T03:27:16.573876+0000","last_became_peered":"2024-09-21T03:27:16.573876+0000","last_unstale":"2024-09-21T03:27:18.584534+0000","last_undegraded":"2024-09-21T03:27:18.584534+0000","last_fullsized":"2024-09-21T03:27:18.584534+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:27.555326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.578547+0000","last_change":"2024-09-21T03:27:17.577237+0000","last_active":"2024-09-21T03:27:17.578547+0000","last_peered":"2024-09-21T03:27:17.578547+0000","last_clean":"2024-09-21T03:27:17.578547+0000","last_became_active":"2024-09-21T03:27:17.576428+0000","last_became_peered":"2024-09-21T03:27:17.576428+0000","last_unstale":"2024-09-21T03:27:17.578547+0000","last_undegraded":"2024-09-21T03:27:17.578547+0000","last_fullsized":"2024-09-21T03:27:17.578547+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:50:28.451810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"139'1","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.594994+0000","last_change":"2024-09-21T03:27:16.580043+0000","last_active":"2024-09-21T03:27:17.594994+0000","last_peered":"2024-09-21T03:27:17.594994+0000","last_clean":"2024-09-21T03:27:17.594994+0000","last_became_active":"2024-09-21T03:27:16.579642+0000","last_became_peered":"2024-09-21T03:27:16.579642+0000","last_unstale":"2024-09-21T03:27:17.594994+0000","last_undegraded":"2024-09-21T03:27:17.594994+0000","last_fullsized":"2024-09-21T03:27:17.594994+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:43.548214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.590698+0000","last_change":"2024-09-21T03:27:17.588315+0000","last_active":"2024-09-21T03:27:17.590698+0000","last_peered":"2024-09-21T03:27:17.590698+0000","last_clean":"2024-09-21T03:27:17.590698+0000","last_became_active":"2024-09-21T03:27:17.587763+0000","last_became_peered":"2024-09-21T03:27:17.587763+0000","last_unstale":"2024-09-21T03:27:17.590698+0000","last_undegraded":"2024-09-21T03:27:17.590698+0000","last_fullsized":"2024-09-21T03:27:17.590698+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:24.863592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"139'2","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.597586+0000","last_change":"2024-09-21T03:27:16.576595+0000","last_active":"2024-09-21T03:27:17.597586+0000","last_peered":"2024-09-21T03:27:17.597586+0000","last_clean":"2024-09-21T03:27:17.597586+0000","last_became_active":"2024-09-21T03:27:16.576288+0000","last_became_peered":"2024-09-21T03:27:16.576288+0000","last_unstale":"2024-09-21T03:27:17.597586+0000","last_undegraded":"2024-09-21T03:27:17.597586+0000","last_fullsized":"2024-09-21T03:27:17.597586+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:34.408303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.586957+0000","last_change":"2024-09-21T03:27:17.583424+0000","last_active":"2024-09-21T03:27:17.586957+0000","last_peered":"2024-09-21T03:27:17.586957+0000","last_clean":"2024-09-21T03:27:17.586957+0000","last_became_active":"2024-09-21T03:27:17.583133+0000","last_became_peered":"2024-09-21T03:27:17.583133+0000","last_unstale":"2024-09-21T03:27:17.586957+0000","last_undegraded":"2024-09-21T03:27:17.586957+0000","last_fullsized":"2024-09-21T03:27:17.586957+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:40.948966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"139'1","reported_seq":16,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583389+0000","last_change":"2024-09-21T03:27:16.580912+0000","last_active":"2024-09-21T03:27:18.583389+0000","last_peered":"2024-09-21T03:27:18.583389+0000","last_clean":"2024-09-21T03:27:18.583389+0000","last_became_active":"2024-09-21T03:27:16.580592+0000","last_became_peered":"2024-09-21T03:27:16.580592+0000","last_unstale":"2024-09-21T03:27:18.583389+0000","last_undegraded":"2024-09-21T03:27:18.583389+0000","last_fullsized":"2024-09-21T03:27:18.583389+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:41.558318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-21T03:27:16.566043+0000","last_change":"2024-09-21T03:27:16.566043+0000","last_active":"2024-09-21T03:27:16.550895+0000","last_peered":"2024-09-21T03:27:16.550895+0000","last_clean":"2024-09-21T03:27:16.550895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:27:16.566043+0000","last_undegraded":"2024-09-21T03:27:16.566043+0000","last_fullsized":"2024-09-21T03:27:16.566043+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583564+0000","last_change":"2024-09-21T03:27:16.576719+0000","last_active":"2024-09-21T03:27:18.583564+0000","last_peered":"2024-09-21T03:27:18.583564+0000","last_clean":"2024-09-21T03:27:18.583564+0000","last_became_active":"2024-09-21T03:27:16.576402+0000","last_became_peered":"2024-09-21T03:27:16.576402+0000","last_unstale":"2024-09-21T03:27:18.583564+0000","last_undegraded":"2024-09-21T03:27:18.583564+0000","last_fullsized":"2024-09-21T03:27:18.583564+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:41.780927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.580875+0000","last_change":"2024-09-21T03:27:17.578483+0000","last_active":"2024-09-21T03:27:17.580875+0000","last_peered":"2024-09-21T03:27:17.580875+0000","last_clean":"2024-09-21T03:27:17.580875+0000","last_became_active":"2024-09-21T03:27:17.578151+0000","last_became_peered":"2024-09-21T03:27:17.578151+0000","last_unstale":"2024-09-21T03:27:17.580875+0000","last_undegraded":"2024-09-21T03:27:17.580875+0000","last_fullsized":"2024-09-21T03:27:17.580875+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:16.441422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"139'2","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.597788+0000","last_change":"2024-09-21T03:27:16.577952+0000","last_active":"2024-09-21T03:27:17.597788+0000","last_peered":"2024-09-21T03:27:17.597788+0000","last_clean":"2024-09-21T03:27:17.597788+0000","last_became_active":"2024-09-21T03:27:16.576576+0000","last_became_peered":"2024-09-21T03:27:16.576576+0000","last_unstale":"2024-09-21T03:27:17.597788+0000","last_undegraded":"2024-09-21T03:27:17.597788+0000","last_fullsized":"2024-09-21T03:27:17.597788+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:12.431154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-21T03:27:16.566345+0000","last_change":"2024-09-21T03:27:16.566345+0000","last_active":"2024-09-21T03:27:16.550895+0000","last_peered":"2024-09-21T03:27:16.550895+0000","last_clean":"2024-09-21T03:27:16.550895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:27:16.566345+0000","last_undegraded":"2024-09-21T03:27:16.566345+0000","last_fullsized":"2024-09-21T03:27:16.566345+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583323+0000","last_change":"2024-09-21T03:27:16.577488+0000","last_active":"2024-09-21T03:27:18.583323+0000","last_peered":"2024-09-21T03:27:18.583323+0000","last_clean":"2024-09-21T03:27:18.583323+0000","last_became_active":"2024-09-21T03:27:16.577197+0000","last_became_peered":"2024-09-21T03:27:16.577197+0000","last_unstale":"2024-09-21T03:27:18.583323+0000","last_undegraded":"2024-09-21T03:27:18.583323+0000","last_fullsized":"2024-09-21T03:27:18.583323+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:17.944770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583365+0000","last_change":"2024-09-21T03:27:17.582910+0000","last_active":"2024-09-21T03:27:18.583365+0000","last_peered":"2024-09-21T03:27:18.583365+0000","last_clean":"2024-09-21T03:27:18.583365+0000","last_became_active":"2024-09-21T03:27:17.582582+0000","last_became_peered":"2024-09-21T03:27:17.582582+0000","last_unstale":"2024-09-21T03:27:18.583365+0000","last_undegraded":"2024-09-21T03:27:18.583365+0000","last_fullsized":"2024-09-21T03:27:18.583365+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:44.083723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.576051+0000","last_change":"2024-09-21T03:27:16.581246+0000","last_active":"2024-09-21T03:27:17.576051+0000","last_peered":"2024-09-21T03:27:17.576051+0000","last_clean":"2024-09-21T03:27:17.576051+0000","last_became_active":"2024-09-21T03:27:16.580919+0000","last_became_peered":"2024-09-21T03:27:16.580919+0000","last_unstale":"2024-09-21T03:27:17.576051+0000","last_undegraded":"2024-09-21T03:27:17.576051+0000","last_fullsized":"2024-09-21T03:27:17.576051+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:25.979160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.579424+0000","last_change":"2024-09-21T03:27:17.577791+0000","last_active":"2024-09-21T03:27:17.579424+0000","last_peered":"2024-09-21T03:27:17.579424+0000","last_clean":"2024-09-21T03:27:17.579424+0000","last_became_active":"2024-09-21T03:27:17.577502+0000","last_became_peered":"2024-09-21T03:27:17.577502+0000","last_unstale":"2024-09-21T03:27:17.579424+0000","last_undegraded":"2024-09-21T03:27:17.579424+0000","last_fullsized":"2024-09-21T03:27:17.579424+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:24.181167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583144+0000","last_change":"2024-09-21T03:27:16.578401+0000","last_active":"2024-09-21T03:27:18.583144+0000","last_peered":"2024-09-21T03:27:18.583144+0000","last_clean":"2024-09-21T03:27:18.583144+0000","last_became_active":"2024-09-21T03:27:16.578077+0000","last_became_peered":"2024-09-21T03:27:16.578077+0000","last_unstale":"2024-09-21T03:27:18.583144+0000","last_undegraded":"2024-09-21T03:27:18.583144+0000","last_fullsized":"2024-09-21T03:27:18.583144+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:44:50.471830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.582932+0000","last_change":"2024-09-21T03:27:17.578316+0000","last_active":"2024-09-21T03:27:17.582932+0000","last_peered":"2024-09-21T03:27:17.582932+0000","last_clean":"2024-09-21T03:27:17.582932+0000","last_became_active":"2024-09-21T03:27:17.578010+0000","last_became_peered":"2024-09-21T03:27:17.578010+0000","last_unstale":"2024-09-21T03:27:17.582932+0000","last_undegraded":"2024-09-21T03:27:17.582932+0000","last_fullsized":"2024-09-21T03:27:17.582932+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:11:17.101621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"139'2","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.595072+0000","last_change":"2024-09-21T03:27:16.578670+0000","last_active":"2024-09-21T03:27:17.595072+0000","last_peered":"2024-09-21T03:27:17.595072+0000","last_clean":"2024-09-21T03:27:17.595072+0000","last_became_active":"2024-09-21T03:27:16.578359+0000","last_became_peered":"2024-09-21T03:27:16.578359+0000","last_unstale":"2024-09-21T03:27:17.595072+0000","last_undegraded":"2024-09-21T03:27:17.595072+0000","last_fullsized":"2024-09-21T03:27:17.595072+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:52.045055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-21T03:27:16.568429+0000","last_change":"2024-09-21T03:27:16.568429+0000","last_active":"2024-09-21T03:27:16.550895+0000","last_peered":"2024-09-21T03:27:16.550895+0000","last_clean":"2024-09-21T03:27:16.550895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:27:16.568429+0000","last_undegraded":"2024-09-21T03:27:16.568429+0000","last_fullsized":"2024-09-21T03:27:16.568429+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"139'1","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.580468+0000","last_change":"2024-09-21T03:27:16.580402+0000","last_active":"2024-09-21T03:27:18.580468+0000","last_peered":"2024-09-21T03:27:18.580468+0000","last_clean":"2024-09-21T03:27:18.580468+0000","last_became_active":"2024-09-21T03:27:16.580078+0000","last_became_peered":"2024-09-21T03:27:16.580078+0000","last_unstale":"2024-09-21T03:27:18.580468+0000","last_undegraded":"2024-09-21T03:27:18.580468+0000","last_fullsized":"2024-09-21T03:27:18.580468+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:07.923601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.584403+0000","last_change":"2024-09-21T03:27:17.580829+0000","last_active":"2024-09-21T03:27:17.584403+0000","last_peered":"2024-09-21T03:27:17.584403+0000","last_clean":"2024-09-21T03:27:17.584403+0000","last_became_active":"2024-09-21T03:27:17.580540+0000","last_became_peered":"2024-09-21T03:27:17.580540+0000","last_unstale":"2024-09-21T03:27:17.584403+0000","last_undegraded":"2024-09-21T03:27:17.584403+0000","last_fullsized":"2024-09-21T03:27:17.584403+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:07:00.398615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.586553+0000","last_change":"2024-09-21T03:27:16.574812+0000","last_active":"2024-09-21T03:27:18.586553+0000","last_peered":"2024-09-21T03:27:18.586553+0000","last_clean":"2024-09-21T03:27:18.586553+0000","last_became_active":"2024-09-21T03:27:16.574396+0000","last_became_peered":"2024-09-21T03:27:16.574396+0000","last_unstale":"2024-09-21T03:27:18.586553+0000","last_undegraded":"2024-09-21T03:27:18.586553+0000","last_fullsized":"2024-09-21T03:27:18.586553+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:03.610863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.576793+0000","last_change":"2024-09-21T03:27:17.574712+0000","last_active":"2024-09-21T03:27:17.576793+0000","last_peered":"2024-09-21T03:27:17.576793+0000","last_clean":"2024-09-21T03:27:17.576793+0000","last_became_active":"2024-09-21T03:27:17.574402+0000","last_became_peered":"2024-09-21T03:27:17.574402+0000","last_unstale":"2024-09-21T03:27:17.576793+0000","last_undegraded":"2024-09-21T03:27:17.576793+0000","last_fullsized":"2024-09-21T03:27:17.576793+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:55.408707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.565551+0000","last_change":"2024-09-21T03:27:16.579174+0000","last_active":"2024-09-21T03:27:17.565551+0000","last_peered":"2024-09-21T03:27:17.565551+0000","last_clean":"2024-09-21T03:27:17.565551+0000","last_became_active":"2024-09-21T03:27:16.578865+0000","last_became_peered":"2024-09-21T03:27:16.578865+0000","last_unstale":"2024-09-21T03:27:17.565551+0000","last_undegraded":"2024-09-21T03:27:17.565551+0000","last_fullsized":"2024-09-21T03:27:17.565551+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:23.331344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.581875+0000","last_change":"2024-09-21T03:27:17.578034+0000","last_active":"2024-09-21T03:27:17.581875+0000","last_peered":"2024-09-21T03:27:17.581875+0000","last_clean":"2024-09-21T03:27:17.581875+0000","last_became_active":"2024-09-21T03:27:17.576925+0000","last_became_peered":"2024-09-21T03:27:17.576925+0000","last_unstale":"2024-09-21T03:27:17.581875+0000","last_undegraded":"2024-09-21T03:27:17.581875+0000","last_fullsized":"2024-09-21T03:27:17.581875+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:56.497686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.584884+0000","last_change":"2024-09-21T03:27:16.574672+0000","last_active":"2024-09-21T03:27:18.584884+0000","last_peered":"2024-09-21T03:27:18.584884+0000","last_clean":"2024-09-21T03:27:18.584884+0000","last_became_active":"2024-09-21T03:27:16.573040+0000","last_became_peered":"2024-09-21T03:27:16.573040+0000","last_unstale":"2024-09-21T03:27:18.584884+0000","last_undegraded":"2024-09-21T03:27:18.584884+0000","last_fullsized":"2024-09-21T03:27:18.584884+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:38.629252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585226+0000","last_change":"2024-09-21T03:27:17.591453+0000","last_active":"2024-09-21T03:27:18.585226+0000","last_peered":"2024-09-21T03:27:18.585226+0000","last_clean":"2024-09-21T03:27:18.585226+0000","last_became_active":"2024-09-21T03:27:17.591101+0000","last_became_peered":"2024-09-21T03:27:17.591101+0000","last_unstale":"2024-09-21T03:27:18.585226+0000","last_undegraded":"2024-09-21T03:27:18.585226+0000","last_fullsized":"2024-09-21T03:27:18.585226+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:57.365059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.574722+0000","last_change":"2024-09-21T03:27:16.571816+0000","last_active":"2024-09-21T03:27:17.574722+0000","last_peered":"2024-09-21T03:27:17.574722+0000","last_clean":"2024-09-21T03:27:17.574722+0000","last_became_active":"2024-09-21T03:27:16.571475+0000","last_became_peered":"2024-09-21T03:27:16.571475+0000","last_unstale":"2024-09-21T03:27:17.574722+0000","last_undegraded":"2024-09-21T03:27:17.574722+0000","last_fullsized":"2024-09-21T03:27:17.574722+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:16.998561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-21T03:27:16.566417+0000","last_change":"2024-09-21T03:27:16.566417+0000","last_active":"2024-09-21T03:27:16.550895+0000","last_peered":"2024-09-21T03:27:16.550895+0000","last_clean":"2024-09-21T03:27:16.550895+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T03:27:16.566417+0000","last_undegraded":"2024-09-21T03:27:16.566417+0000","last_fullsized":"2024-09-21T03:27:16.566417+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585945+0000","last_change":"2024-09-21T03:27:16.573639+0000","last_active":"2024-09-21T03:27:18.585945+0000","last_peered":"2024-09-21T03:27:18.585945+0000","last_clean":"2024-09-21T03:27:18.585945+0000","last_became_active":"2024-09-21T03:27:16.573163+0000","last_became_peered":"2024-09-21T03:27:16.573163+0000","last_unstale":"2024-09-21T03:27:18.585945+0000","last_undegraded":"2024-09-21T03:27:18.585945+0000","last_fullsized":"2024-09-21T03:27:18.585945+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:35.838462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.580486+0000","last_change":"2024-09-21T03:27:17.578123+0000","last_active":"2024-09-21T03:27:17.580486+0000","last_peered":"2024-09-21T03:27:17.580486+0000","last_clean":"2024-09-21T03:27:17.580486+0000","last_became_active":"2024-09-21T03:27:17.577792+0000","last_became_peered":"2024-09-21T03:27:17.577792+0000","last_unstale":"2024-09-21T03:27:17.580486+0000","last_undegraded":"2024-09-21T03:27:17.580486+0000","last_fullsized":"2024-09-21T03:27:17.580486+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:27.493816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.584498+0000","last_change":"2024-09-21T03:27:16.574180+0000","last_active":"2024-09-21T03:27:18.584498+0000","last_peered":"2024-09-21T03:27:18.584498+0000","last_clean":"2024-09-21T03:27:18.584498+0000","last_became_active":"2024-09-21T03:27:16.573439+0000","last_became_peered":"2024-09-21T03:27:16.573439+0000","last_unstale":"2024-09-21T03:27:18.584498+0000","last_undegraded":"2024-09-21T03:27:18.584498+0000","last_fullsized":"2024-09-21T03:27:18.584498+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:36.525290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-21T03:27:17.582958+0000","last_change":"2024-09-21T03:27:17.578054+0000","last_active":"2024-09-21T03:27:17.582958+0000","last_peered":"2024-09-21T03:27:17.582958+0000","last_clean":"2024-09-21T03:27:17.582958+0000","last_became_active":"2024-09-21T03:27:17.577746+0000","last_became_peered":"2024-09-21T03:27:17.577746+0000","last_unstale":"2024-09-21T03:27:17.582958+0000","last_undegraded":"2024-09-21T03:27:17.582958+0000","last_fullsized":"2024-09-21T03:27:17.582958+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:14.491408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585346+0000","last_change":"2024-09-21T03:27:16.575356+0000","last_active":"2024-09-21T03:27:18.585346+0000","last_peered":"2024-09-21T03:27:18.585346+0000","last_clean":"2024-09-21T03:27:18.585346+0000","last_became_active":"2024-09-21T03:27:16.574933+0000","last_became_peered":"2024-09-21T03:27:16.574933+0000","last_unstale":"2024-09-21T03:27:18.585346+0000","last_undegraded":"2024-09-21T03:27:18.585346+0000","last_fullsized":"2024-09-21T03:27:18.585346+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:11.636922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":334,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583233+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:27:18.583233+0000","last_peered":"2024-09-21T03:27:18.583233+0000","last_clean":"2024-09-21T03:27:18.583233+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:27:18.583233+0000","last_undegraded":"2024-09-21T03:27:18.583233+0000","last_fullsized":"2024-09-21T03:27:18.583233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509553,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33512,"kb_used_data":2316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338328,"statfs":{"total":96636764160,"available":96602447872,"internally_reserved":0,"allocated":2371584,"data_stored":1346178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509552,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32900,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338940,"statfs":{"total":96636764160,"available":96603074560,"internally_reserved":0,"allocated":1744896,"data_stored":747178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509551,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32904,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338936,"statfs":{"total":96636764160,"available":96603070464,"internally_reserved":0,"allocated":1748992,"data_stored":747760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509551,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32912,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338928,"statfs":{"total":96636764160,"available":96603062272,"internally_reserved":0,"allocated":1757184,"data_stored":748838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509552,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32896,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338944,"statfs":{"total":96636764160,"available":96603078656,"internally_reserved":0,"allocated":1744896,"data_stored":747190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509552,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37056,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334784,"statfs":{"total":96636764160,"available":96598818816,"internally_reserved":0,"allocated":1744896,"data_stored":747246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509552,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37056,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334784,"statfs":{"total":96636764160,"available":96598818816,"internally_reserved":0,"allocated":1744896,"data_stored":747190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574959,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33444,"kb_used_data":2256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338396,"statfs":{"total":96636764160,"available":96602517504,"internally_reserved":0,"allocated":2310144,"data_stored":1324474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:27:26.041 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:27:26.168 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.165+0000 7fe0656a2640 1 -- 172.21.15.105:0/3877072572 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe04c004800 msgr2=0x7fe04c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:26.168 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.165+0000 7fe0656a2640 1 --2- 172.21.15.105:0/3877072572 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe04c004800 0x7fe04c004c10 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7fe048009b50 tx=0x7fe04c005830 comp rx=0 tx=0).stop 2024-09-21T03:27:26.168 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.165+0000 7fe0656a2640 1 -- 172.21.15.105:0/3877072572 shutdown_connections 2024-09-21T03:27:26.168 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.165+0000 7fe0656a2640 1 --2- 172.21.15.105:0/3877072572 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe04c004800 0x7fe04c004c10 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:26.168 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.165+0000 7fe0656a2640 1 -- 172.21.15.105:0/3877072572 >> 172.21.15.105:0/3877072572 conn(0x7fe060072ae0 msgr2=0x7fe060072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:26.169 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.165+0000 7fe0656a2640 1 -- 172.21.15.105:0/3877072572 shutdown_connections 2024-09-21T03:27:26.169 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.165+0000 7fe0656a2640 1 -- 172.21.15.105:0/3877072572 wait complete. 2024-09-21T03:27:26.169 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.167+0000 7fe0656a2640 1 Processor -- start 2024-09-21T03:27:26.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.167+0000 7fe0656a2640 1 -- start start 2024-09-21T03:27:26.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.168+0000 7fe0656a2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe04c004800 0x7fe06006f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:26.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.168+0000 7fe0656a2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe060158b50 0x7fe060153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:26.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.168+0000 7fe0656a2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe060158f60 0x7fe0600c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:26.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.168+0000 7fe0656a2640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe0600d1850 con 0x7fe04c004800 2024-09-21T03:27:26.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.168+0000 7fe0656a2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe0600d16d0 con 0x7fe060158b50 2024-09-21T03:27:26.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.168+0000 7fe0656a2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe0600d19d0 con 0x7fe060158f60 2024-09-21T03:27:26.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.168+0000 7fe05effd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe04c004800 0x7fe06006f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:26.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.169+0000 7fe05effd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe04c004800 0x7fe06006f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40190/0 (socket says 172.21.15.105:40190) 2024-09-21T03:27:26.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.169+0000 7fe05effd640 1 -- 172.21.15.105:0/3972632170 learned_addr learned my addr 172.21.15.105:0/3972632170 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:26.173 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.169+0000 7fe05e7fc640 1 --2- 172.21.15.105:0/3972632170 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe060158b50 0x7fe060153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:26.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.169+0000 7fe05f7fe640 1 --2- 172.21.15.105:0/3972632170 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe060158f60 0x7fe0600c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:26.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.169+0000 7fe05effd640 1 -- 172.21.15.105:0/3972632170 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe060158f60 msgr2=0x7fe0600c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:26.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.169+0000 7fe05effd640 1 --2- 172.21.15.105:0/3972632170 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe060158f60 0x7fe0600c41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:26.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.169+0000 7fe05effd640 1 -- 172.21.15.105:0/3972632170 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe060158b50 msgr2=0x7fe060153030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:26.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.169+0000 7fe05effd640 1 --2- 172.21.15.105:0/3972632170 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe060158b50 0x7fe060153030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:26.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.169+0000 7fe05effd640 1 -- 172.21.15.105:0/3972632170 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe06006e190 con 0x7fe04c004800 2024-09-21T03:27:26.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.169+0000 7fe05f7fe640 1 --2- 172.21.15.105:0/3972632170 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe060158f60 0x7fe0600c41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:27:26.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.169+0000 7fe05effd640 1 --2- 172.21.15.105:0/3972632170 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe04c004800 0x7fe06006f230 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fe05000e890 tx=0x7fe05000ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:26.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.169+0000 7fe0577fe640 1 -- 172.21.15.105:0/3972632170 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe050015070 con 0x7fe04c004800 2024-09-21T03:27:26.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.169+0000 7fe0577fe640 1 -- 172.21.15.105:0/3972632170 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe05000cd40 con 0x7fe04c004800 2024-09-21T03:27:26.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.169+0000 7fe0656a2640 1 -- 172.21.15.105:0/3972632170 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe06006e470 con 0x7fe04c004800 2024-09-21T03:27:26.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.169+0000 7fe0577fe640 1 -- 172.21.15.105:0/3972632170 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0500116c0 con 0x7fe04c004800 2024-09-21T03:27:26.174 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.169+0000 7fe0656a2640 1 -- 172.21.15.105:0/3972632170 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe06006ea30 con 0x7fe04c004800 2024-09-21T03:27:26.175 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.170+0000 7fe0656a2640 1 -- 172.21.15.105:0/3972632170 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe06015c910 con 0x7fe04c004800 2024-09-21T03:27:26.175 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.171+0000 7fe0577fe640 1 -- 172.21.15.105:0/3972632170 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe050018070 con 0x7fe04c004800 2024-09-21T03:27:26.175 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.171+0000 7fe0577fe640 1 --2- 172.21.15.105:0/3972632170 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe040078bc0 0x7fe04007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:26.176 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.172+0000 7fe0577fe640 1 -- 172.21.15.105:0/3972632170 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5709+0+0 (secure 0 0 0) 0x7fe05009b470 con 0x7fe04c004800 2024-09-21T03:27:26.176 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.172+0000 7fe05e7fc640 1 --2- 172.21.15.105:0/3972632170 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe040078bc0 0x7fe04007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:26.176 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.172+0000 7fe05e7fc640 1 --2- 172.21.15.105:0/3972632170 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe040078bc0 0x7fe04007b0d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fe048035000 tx=0x7fe0480046c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:26.178 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.176+0000 7fe0577fe640 1 -- 172.21.15.105:0/3972632170 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe050063260 con 0x7fe04c004800 2024-09-21T03:27:26.352 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.349+0000 7fe0656a2640 1 -- 172.21.15.105:0/3972632170 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe0600cfbc0 con 0x7fe040078bc0 2024-09-21T03:27:26.356 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.354+0000 7fe0577fe640 1 -- 172.21.15.105:0/3972632170 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252386 (secure 0 0 0) 0x7fe0600cfbc0 con 0x7fe040078bc0 2024-09-21T03:27:26.360 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:27:26.361 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:27:26.362 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.357+0000 7fe0656a2640 1 -- 172.21.15.105:0/3972632170 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe040078bc0 msgr2=0x7fe04007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:26.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.357+0000 7fe0656a2640 1 --2- 172.21.15.105:0/3972632170 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe040078bc0 0x7fe04007b0d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fe048035000 tx=0x7fe0480046c0 comp rx=0 tx=0).stop 2024-09-21T03:27:26.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.357+0000 7fe0656a2640 1 -- 172.21.15.105:0/3972632170 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe04c004800 msgr2=0x7fe06006f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:26.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.357+0000 7fe0656a2640 1 --2- 172.21.15.105:0/3972632170 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe04c004800 0x7fe06006f230 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fe05000e890 tx=0x7fe05000ed50 comp rx=0 tx=0).stop 2024-09-21T03:27:26.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.357+0000 7fe0656a2640 1 -- 172.21.15.105:0/3972632170 shutdown_connections 2024-09-21T03:27:26.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.357+0000 7fe0656a2640 1 --2- 172.21.15.105:0/3972632170 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe040078bc0 0x7fe04007b0d0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:26.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.357+0000 7fe0656a2640 1 --2- 172.21.15.105:0/3972632170 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe060158f60 0x7fe0600c41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:26.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.357+0000 7fe0656a2640 1 --2- 172.21.15.105:0/3972632170 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe060158b50 0x7fe060153030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:26.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.357+0000 7fe0656a2640 1 --2- 172.21.15.105:0/3972632170 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe04c004800 0x7fe06006f230 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:26.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.357+0000 7fe0656a2640 1 -- 172.21.15.105:0/3972632170 >> 172.21.15.105:0/3972632170 conn(0x7fe060072ae0 msgr2=0x7fe0600b7040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:26.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.358+0000 7fe0656a2640 1 -- 172.21.15.105:0/3972632170 shutdown_connections 2024-09-21T03:27:26.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.358+0000 7fe0656a2640 1 -- 172.21.15.105:0/3972632170 wait complete. 2024-09-21T03:27:26.372 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":408,"stamp":"2024-09-21T03:27:25.423956+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":272768,"kb_used_data":14920,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754701952,"statfs":{"total":773094113280,"available":772814798848,"internally_reserved":0,"allocated":15278080,"data_stored":7213204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002062"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583647+0000","last_change":"2024-09-21T03:27:17.581755+0000","last_active":"2024-09-21T03:27:18.583647+0000","last_peered":"2024-09-21T03:27:18.583647+0000","last_clean":"2024-09-21T03:27:18.583647+0000","last_became_active":"2024-09-21T03:27:17.581133+0000","last_became_peered":"2024-09-21T03:27:17.581133+0000","last_unstale":"2024-09-21T03:27:18.583647+0000","last_undegraded":"2024-09-21T03:27:18.583647+0000","last_fullsized":"2024-09-21T03:27:18.583647+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:43.005587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.586375+0000","last_change":"2024-09-21T03:27:17.573023+0000","last_active":"2024-09-21T03:27:18.586375+0000","last_peered":"2024-09-21T03:27:18.586375+0000","last_clean":"2024-09-21T03:27:18.586375+0000","last_became_active":"2024-09-21T03:27:17.572695+0000","last_became_peered":"2024-09-21T03:27:17.572695+0000","last_unstale":"2024-09-21T03:27:18.586375+0000","last_undegraded":"2024-09-21T03:27:18.586375+0000","last_fullsized":"2024-09-21T03:27:18.586375+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:03.003218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.664366+0000","last_change":"2024-09-21T03:27:17.586788+0000","last_active":"2024-09-21T03:27:18.664366+0000","last_peered":"2024-09-21T03:27:18.664366+0000","last_clean":"2024-09-21T03:27:18.664366+0000","last_became_active":"2024-09-21T03:27:17.586413+0000","last_became_peered":"2024-09-21T03:27:17.586413+0000","last_unstale":"2024-09-21T03:27:18.664366+0000","last_undegraded":"2024-09-21T03:27:18.664366+0000","last_fullsized":"2024-09-21T03:27:18.664366+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:18.004499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.165681+0000","last_change":"2024-09-21T03:27:17.580965+0000","last_active":"2024-09-21T03:27:19.165681+0000","last_peered":"2024-09-21T03:27:19.165681+0000","last_clean":"2024-09-21T03:27:19.165681+0000","last_became_active":"2024-09-21T03:27:17.580581+0000","last_became_peered":"2024-09-21T03:27:17.580581+0000","last_unstale":"2024-09-21T03:27:19.165681+0000","last_undegraded":"2024-09-21T03:27:19.165681+0000","last_fullsized":"2024-09-21T03:27:19.165681+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:06:13.764175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.586111+0000","last_change":"2024-09-21T03:27:17.585238+0000","last_active":"2024-09-21T03:27:18.586111+0000","last_peered":"2024-09-21T03:27:18.586111+0000","last_clean":"2024-09-21T03:27:18.586111+0000","last_became_active":"2024-09-21T03:27:17.583972+0000","last_became_peered":"2024-09-21T03:27:17.583972+0000","last_unstale":"2024-09-21T03:27:18.586111+0000","last_undegraded":"2024-09-21T03:27:18.586111+0000","last_fullsized":"2024-09-21T03:27:18.586111+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:29.413682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.166513+0000","last_change":"2024-09-21T03:27:17.580318+0000","last_active":"2024-09-21T03:27:19.166513+0000","last_peered":"2024-09-21T03:27:19.166513+0000","last_clean":"2024-09-21T03:27:19.166513+0000","last_became_active":"2024-09-21T03:27:17.580006+0000","last_became_peered":"2024-09-21T03:27:17.580006+0000","last_unstale":"2024-09-21T03:27:19.166513+0000","last_undegraded":"2024-09-21T03:27:19.166513+0000","last_fullsized":"2024-09-21T03:27:19.166513+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:16.360210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.165780+0000","last_change":"2024-09-21T03:27:17.587003+0000","last_active":"2024-09-21T03:27:19.165780+0000","last_peered":"2024-09-21T03:27:19.165780+0000","last_clean":"2024-09-21T03:27:19.165780+0000","last_became_active":"2024-09-21T03:27:17.586707+0000","last_became_peered":"2024-09-21T03:27:17.586707+0000","last_unstale":"2024-09-21T03:27:19.165780+0000","last_undegraded":"2024-09-21T03:27:19.165780+0000","last_fullsized":"2024-09-21T03:27:19.165780+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:28:29.980672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585808+0000","last_change":"2024-09-21T03:27:17.586097+0000","last_active":"2024-09-21T03:27:18.585808+0000","last_peered":"2024-09-21T03:27:18.585808+0000","last_clean":"2024-09-21T03:27:18.585808+0000","last_became_active":"2024-09-21T03:27:17.585734+0000","last_became_peered":"2024-09-21T03:27:17.585734+0000","last_unstale":"2024-09-21T03:27:18.585808+0000","last_undegraded":"2024-09-21T03:27:18.585808+0000","last_fullsized":"2024-09-21T03:27:18.585808+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:21:44.303210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.586651+0000","last_change":"2024-09-21T03:27:17.586773+0000","last_active":"2024-09-21T03:27:18.586651+0000","last_peered":"2024-09-21T03:27:18.586651+0000","last_clean":"2024-09-21T03:27:18.586651+0000","last_became_active":"2024-09-21T03:27:17.586439+0000","last_became_peered":"2024-09-21T03:27:17.586439+0000","last_unstale":"2024-09-21T03:27:18.586651+0000","last_undegraded":"2024-09-21T03:27:18.586651+0000","last_fullsized":"2024-09-21T03:27:18.586651+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:23:34.474168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.586400+0000","last_change":"2024-09-21T03:27:17.577732+0000","last_active":"2024-09-21T03:27:18.586400+0000","last_peered":"2024-09-21T03:27:18.586400+0000","last_clean":"2024-09-21T03:27:18.586400+0000","last_became_active":"2024-09-21T03:27:17.577442+0000","last_became_peered":"2024-09-21T03:27:17.577442+0000","last_unstale":"2024-09-21T03:27:18.586400+0000","last_undegraded":"2024-09-21T03:27:18.586400+0000","last_fullsized":"2024-09-21T03:27:18.586400+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:18:21.010195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.586106+0000","last_change":"2024-09-21T03:27:17.585024+0000","last_active":"2024-09-21T03:27:18.586106+0000","last_peered":"2024-09-21T03:27:18.586106+0000","last_clean":"2024-09-21T03:27:18.586106+0000","last_became_active":"2024-09-21T03:27:17.584681+0000","last_became_peered":"2024-09-21T03:27:17.584681+0000","last_unstale":"2024-09-21T03:27:18.586106+0000","last_undegraded":"2024-09-21T03:27:18.586106+0000","last_fullsized":"2024-09-21T03:27:18.586106+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:16.877998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.586553+0000","last_change":"2024-09-21T03:27:17.573714+0000","last_active":"2024-09-21T03:27:18.586553+0000","last_peered":"2024-09-21T03:27:18.586553+0000","last_clean":"2024-09-21T03:27:18.586553+0000","last_became_active":"2024-09-21T03:27:17.573344+0000","last_became_peered":"2024-09-21T03:27:17.573344+0000","last_unstale":"2024-09-21T03:27:18.586553+0000","last_undegraded":"2024-09-21T03:27:18.586553+0000","last_fullsized":"2024-09-21T03:27:18.586553+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:16:50.560426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.664547+0000","last_change":"2024-09-21T03:27:17.580024+0000","last_active":"2024-09-21T03:27:18.664547+0000","last_peered":"2024-09-21T03:27:18.664547+0000","last_clean":"2024-09-21T03:27:18.664547+0000","last_became_active":"2024-09-21T03:27:17.579693+0000","last_became_peered":"2024-09-21T03:27:17.579693+0000","last_unstale":"2024-09-21T03:27:18.664547+0000","last_undegraded":"2024-09-21T03:27:18.664547+0000","last_fullsized":"2024-09-21T03:27:18.664547+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:26.985098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.664123+0000","last_change":"2024-09-21T03:27:17.573051+0000","last_active":"2024-09-21T03:27:18.664123+0000","last_peered":"2024-09-21T03:27:18.664123+0000","last_clean":"2024-09-21T03:27:18.664123+0000","last_became_active":"2024-09-21T03:27:17.572714+0000","last_became_peered":"2024-09-21T03:27:17.572714+0000","last_unstale":"2024-09-21T03:27:18.664123+0000","last_undegraded":"2024-09-21T03:27:18.664123+0000","last_fullsized":"2024-09-21T03:27:18.664123+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:42.419101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583130+0000","last_change":"2024-09-21T03:27:17.581234+0000","last_active":"2024-09-21T03:27:18.583130+0000","last_peered":"2024-09-21T03:27:18.583130+0000","last_clean":"2024-09-21T03:27:18.583130+0000","last_became_active":"2024-09-21T03:27:17.580865+0000","last_became_peered":"2024-09-21T03:27:17.580865+0000","last_unstale":"2024-09-21T03:27:18.583130+0000","last_undegraded":"2024-09-21T03:27:18.583130+0000","last_fullsized":"2024-09-21T03:27:18.583130+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:29:44.168728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.165500+0000","last_change":"2024-09-21T03:27:17.590726+0000","last_active":"2024-09-21T03:27:19.165500+0000","last_peered":"2024-09-21T03:27:19.165500+0000","last_clean":"2024-09-21T03:27:19.165500+0000","last_became_active":"2024-09-21T03:27:17.590441+0000","last_became_peered":"2024-09-21T03:27:17.590441+0000","last_unstale":"2024-09-21T03:27:19.165500+0000","last_undegraded":"2024-09-21T03:27:19.165500+0000","last_fullsized":"2024-09-21T03:27:19.165500+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:42:18.828829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.164955+0000","last_change":"2024-09-21T03:27:17.585074+0000","last_active":"2024-09-21T03:27:19.164955+0000","last_peered":"2024-09-21T03:27:19.164955+0000","last_clean":"2024-09-21T03:27:19.164955+0000","last_became_active":"2024-09-21T03:27:17.584763+0000","last_became_peered":"2024-09-21T03:27:17.584763+0000","last_unstale":"2024-09-21T03:27:19.164955+0000","last_undegraded":"2024-09-21T03:27:19.164955+0000","last_fullsized":"2024-09-21T03:27:19.164955+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:15:04.697822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.165635+0000","last_change":"2024-09-21T03:27:17.576376+0000","last_active":"2024-09-21T03:27:19.165635+0000","last_peered":"2024-09-21T03:27:19.165635+0000","last_clean":"2024-09-21T03:27:19.165635+0000","last_became_active":"2024-09-21T03:27:17.576094+0000","last_became_peered":"2024-09-21T03:27:17.576094+0000","last_unstale":"2024-09-21T03:27:19.165635+0000","last_undegraded":"2024-09-21T03:27:19.165635+0000","last_fullsized":"2024-09-21T03:27:19.165635+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:05.225932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.165544+0000","last_change":"2024-09-21T03:27:17.585841+0000","last_active":"2024-09-21T03:27:19.165544+0000","last_peered":"2024-09-21T03:27:19.165544+0000","last_clean":"2024-09-21T03:27:19.165544+0000","last_became_active":"2024-09-21T03:27:17.585539+0000","last_became_peered":"2024-09-21T03:27:17.585539+0000","last_unstale":"2024-09-21T03:27:19.165544+0000","last_undegraded":"2024-09-21T03:27:19.165544+0000","last_fullsized":"2024-09-21T03:27:19.165544+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:46:11.739441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.664277+0000","last_change":"2024-09-21T03:27:17.575335+0000","last_active":"2024-09-21T03:27:18.664277+0000","last_peered":"2024-09-21T03:27:18.664277+0000","last_clean":"2024-09-21T03:27:18.664277+0000","last_became_active":"2024-09-21T03:27:17.573625+0000","last_became_peered":"2024-09-21T03:27:17.573625+0000","last_unstale":"2024-09-21T03:27:18.664277+0000","last_undegraded":"2024-09-21T03:27:18.664277+0000","last_fullsized":"2024-09-21T03:27:18.664277+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:04.616801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.165217+0000","last_change":"2024-09-21T03:27:17.585062+0000","last_active":"2024-09-21T03:27:19.165217+0000","last_peered":"2024-09-21T03:27:19.165217+0000","last_clean":"2024-09-21T03:27:19.165217+0000","last_became_active":"2024-09-21T03:27:17.584730+0000","last_became_peered":"2024-09-21T03:27:17.584730+0000","last_unstale":"2024-09-21T03:27:19.165217+0000","last_undegraded":"2024-09-21T03:27:19.165217+0000","last_fullsized":"2024-09-21T03:27:19.165217+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:06:22.078396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.586508+0000","last_change":"2024-09-21T03:27:17.577064+0000","last_active":"2024-09-21T03:27:18.586508+0000","last_peered":"2024-09-21T03:27:18.586508+0000","last_clean":"2024-09-21T03:27:18.586508+0000","last_became_active":"2024-09-21T03:27:17.576634+0000","last_became_peered":"2024-09-21T03:27:17.576634+0000","last_unstale":"2024-09-21T03:27:18.586508+0000","last_undegraded":"2024-09-21T03:27:18.586508+0000","last_fullsized":"2024-09-21T03:27:18.586508+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:42.013551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.166000+0000","last_change":"2024-09-21T03:27:17.578564+0000","last_active":"2024-09-21T03:27:19.166000+0000","last_peered":"2024-09-21T03:27:19.166000+0000","last_clean":"2024-09-21T03:27:19.166000+0000","last_became_active":"2024-09-21T03:27:17.578274+0000","last_became_peered":"2024-09-21T03:27:17.578274+0000","last_unstale":"2024-09-21T03:27:19.166000+0000","last_undegraded":"2024-09-21T03:27:19.166000+0000","last_fullsized":"2024-09-21T03:27:19.166000+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:10.008294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585847+0000","last_change":"2024-09-21T03:27:17.582077+0000","last_active":"2024-09-21T03:27:18.585847+0000","last_peered":"2024-09-21T03:27:18.585847+0000","last_clean":"2024-09-21T03:27:18.585847+0000","last_became_active":"2024-09-21T03:27:17.581735+0000","last_became_peered":"2024-09-21T03:27:17.581735+0000","last_unstale":"2024-09-21T03:27:18.585847+0000","last_undegraded":"2024-09-21T03:27:18.585847+0000","last_fullsized":"2024-09-21T03:27:18.585847+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:03.545497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.664559+0000","last_change":"2024-09-21T03:27:17.585639+0000","last_active":"2024-09-21T03:27:18.664559+0000","last_peered":"2024-09-21T03:27:18.664559+0000","last_clean":"2024-09-21T03:27:18.664559+0000","last_became_active":"2024-09-21T03:27:17.585334+0000","last_became_peered":"2024-09-21T03:27:17.585334+0000","last_unstale":"2024-09-21T03:27:18.664559+0000","last_undegraded":"2024-09-21T03:27:18.664559+0000","last_fullsized":"2024-09-21T03:27:18.664559+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:37.531228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.166969+0000","last_change":"2024-09-21T03:27:17.582082+0000","last_active":"2024-09-21T03:27:19.166969+0000","last_peered":"2024-09-21T03:27:19.166969+0000","last_clean":"2024-09-21T03:27:19.166969+0000","last_became_active":"2024-09-21T03:27:17.581811+0000","last_became_peered":"2024-09-21T03:27:17.581811+0000","last_unstale":"2024-09-21T03:27:19.166969+0000","last_undegraded":"2024-09-21T03:27:19.166969+0000","last_fullsized":"2024-09-21T03:27:19.166969+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:38.000861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.664589+0000","last_change":"2024-09-21T03:27:17.584543+0000","last_active":"2024-09-21T03:27:18.664589+0000","last_peered":"2024-09-21T03:27:18.664589+0000","last_clean":"2024-09-21T03:27:18.664589+0000","last_became_active":"2024-09-21T03:27:17.584163+0000","last_became_peered":"2024-09-21T03:27:17.584163+0000","last_unstale":"2024-09-21T03:27:18.664589+0000","last_undegraded":"2024-09-21T03:27:18.664589+0000","last_fullsized":"2024-09-21T03:27:18.664589+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:34.308409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.165929+0000","last_change":"2024-09-21T03:27:17.584109+0000","last_active":"2024-09-21T03:27:19.165929+0000","last_peered":"2024-09-21T03:27:19.165929+0000","last_clean":"2024-09-21T03:27:19.165929+0000","last_became_active":"2024-09-21T03:27:17.583795+0000","last_became_peered":"2024-09-21T03:27:17.583795+0000","last_unstale":"2024-09-21T03:27:19.165929+0000","last_undegraded":"2024-09-21T03:27:19.165929+0000","last_fullsized":"2024-09-21T03:27:19.165929+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:51.069144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.664505+0000","last_change":"2024-09-21T03:27:17.584726+0000","last_active":"2024-09-21T03:27:18.664505+0000","last_peered":"2024-09-21T03:27:18.664505+0000","last_clean":"2024-09-21T03:27:18.664505+0000","last_became_active":"2024-09-21T03:27:17.584401+0000","last_became_peered":"2024-09-21T03:27:17.584401+0000","last_unstale":"2024-09-21T03:27:18.664505+0000","last_undegraded":"2024-09-21T03:27:18.664505+0000","last_fullsized":"2024-09-21T03:27:18.664505+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:25.766238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585339+0000","last_change":"2024-09-21T03:27:17.583387+0000","last_active":"2024-09-21T03:27:18.585339+0000","last_peered":"2024-09-21T03:27:18.585339+0000","last_clean":"2024-09-21T03:27:18.585339+0000","last_became_active":"2024-09-21T03:27:17.582898+0000","last_became_peered":"2024-09-21T03:27:17.582898+0000","last_unstale":"2024-09-21T03:27:18.585339+0000","last_undegraded":"2024-09-21T03:27:18.585339+0000","last_fullsized":"2024-09-21T03:27:18.585339+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:42.013551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.584662+0000","last_change":"2024-09-21T03:27:17.592422+0000","last_active":"2024-09-21T03:27:18.584662+0000","last_peered":"2024-09-21T03:27:18.584662+0000","last_clean":"2024-09-21T03:27:18.584662+0000","last_became_active":"2024-09-21T03:27:17.592093+0000","last_became_peered":"2024-09-21T03:27:17.592093+0000","last_unstale":"2024-09-21T03:27:18.584662+0000","last_undegraded":"2024-09-21T03:27:18.584662+0000","last_fullsized":"2024-09-21T03:27:18.584662+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:06:13.764175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.164731+0000","last_change":"2024-09-21T03:27:17.579122+0000","last_active":"2024-09-21T03:27:19.164731+0000","last_peered":"2024-09-21T03:27:19.164731+0000","last_clean":"2024-09-21T03:27:19.164731+0000","last_became_active":"2024-09-21T03:27:17.578841+0000","last_became_peered":"2024-09-21T03:27:17.578841+0000","last_unstale":"2024-09-21T03:27:19.164731+0000","last_undegraded":"2024-09-21T03:27:19.164731+0000","last_fullsized":"2024-09-21T03:27:19.164731+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:17.242254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.167192+0000","last_change":"2024-09-21T03:27:17.579854+0000","last_active":"2024-09-21T03:27:19.167192+0000","last_peered":"2024-09-21T03:27:19.167192+0000","last_clean":"2024-09-21T03:27:19.167192+0000","last_became_active":"2024-09-21T03:27:17.579596+0000","last_became_peered":"2024-09-21T03:27:17.579596+0000","last_unstale":"2024-09-21T03:27:19.167192+0000","last_undegraded":"2024-09-21T03:27:19.167192+0000","last_fullsized":"2024-09-21T03:27:19.167192+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:47:00.986318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"139'4","reported_seq":19,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583565+0000","last_change":"2024-09-21T03:27:16.581015+0000","last_active":"2024-09-21T03:27:18.583565+0000","last_peered":"2024-09-21T03:27:18.583565+0000","last_clean":"2024-09-21T03:27:18.583565+0000","last_became_active":"2024-09-21T03:27:16.580691+0000","last_became_peered":"2024-09-21T03:27:16.580691+0000","last_unstale":"2024-09-21T03:27:18.583565+0000","last_undegraded":"2024-09-21T03:27:18.583565+0000","last_fullsized":"2024-09-21T03:27:18.583565+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:58:11.894626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585350+0000","last_change":"2024-09-21T03:27:17.584425+0000","last_active":"2024-09-21T03:27:18.585350+0000","last_peered":"2024-09-21T03:27:18.585350+0000","last_clean":"2024-09-21T03:27:18.585350+0000","last_became_active":"2024-09-21T03:27:17.584118+0000","last_became_peered":"2024-09-21T03:27:17.584118+0000","last_unstale":"2024-09-21T03:27:18.585350+0000","last_undegraded":"2024-09-21T03:27:18.585350+0000","last_fullsized":"2024-09-21T03:27:18.585350+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:51.069144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"139'1","reported_seq":16,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585028+0000","last_change":"2024-09-21T03:27:16.578107+0000","last_active":"2024-09-21T03:27:18.585028+0000","last_peered":"2024-09-21T03:27:18.585028+0000","last_clean":"2024-09-21T03:27:18.585028+0000","last_became_active":"2024-09-21T03:27:16.577745+0000","last_became_peered":"2024-09-21T03:27:16.577745+0000","last_unstale":"2024-09-21T03:27:18.585028+0000","last_undegraded":"2024-09-21T03:27:18.585028+0000","last_fullsized":"2024-09-21T03:27:18.585028+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:35:38.887631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.167016+0000","last_change":"2024-09-21T03:27:17.582825+0000","last_active":"2024-09-21T03:27:19.167016+0000","last_peered":"2024-09-21T03:27:19.167016+0000","last_clean":"2024-09-21T03:27:19.167016+0000","last_became_active":"2024-09-21T03:27:17.582405+0000","last_became_peered":"2024-09-21T03:27:17.582405+0000","last_unstale":"2024-09-21T03:27:19.167016+0000","last_undegraded":"2024-09-21T03:27:19.167016+0000","last_fullsized":"2024-09-21T03:27:19.167016+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:19.612253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"139'2","reported_seq":17,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.166550+0000","last_change":"2024-09-21T03:27:16.577605+0000","last_active":"2024-09-21T03:27:19.166550+0000","last_peered":"2024-09-21T03:27:19.166550+0000","last_clean":"2024-09-21T03:27:19.166550+0000","last_became_active":"2024-09-21T03:27:16.577310+0000","last_became_peered":"2024-09-21T03:27:16.577310+0000","last_unstale":"2024-09-21T03:27:19.166550+0000","last_undegraded":"2024-09-21T03:27:19.166550+0000","last_fullsized":"2024-09-21T03:27:19.166550+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:41.413162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.664699+0000","last_change":"2024-09-21T03:27:17.579293+0000","last_active":"2024-09-21T03:27:18.664699+0000","last_peered":"2024-09-21T03:27:18.664699+0000","last_clean":"2024-09-21T03:27:18.664699+0000","last_became_active":"2024-09-21T03:27:17.578780+0000","last_became_peered":"2024-09-21T03:27:17.578780+0000","last_unstale":"2024-09-21T03:27:18.664699+0000","last_undegraded":"2024-09-21T03:27:18.664699+0000","last_fullsized":"2024-09-21T03:27:18.664699+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:40.948966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"139'2","reported_seq":17,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.166417+0000","last_change":"2024-09-21T03:27:16.574950+0000","last_active":"2024-09-21T03:27:19.166417+0000","last_peered":"2024-09-21T03:27:19.166417+0000","last_clean":"2024-09-21T03:27:19.166417+0000","last_became_active":"2024-09-21T03:27:16.573561+0000","last_became_peered":"2024-09-21T03:27:16.573561+0000","last_unstale":"2024-09-21T03:27:19.166417+0000","last_undegraded":"2024-09-21T03:27:19.166417+0000","last_fullsized":"2024-09-21T03:27:19.166417+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:24.760299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.165515+0000","last_change":"2024-09-21T03:27:17.583574+0000","last_active":"2024-09-21T03:27:19.165515+0000","last_peered":"2024-09-21T03:27:19.165515+0000","last_clean":"2024-09-21T03:27:19.165515+0000","last_became_active":"2024-09-21T03:27:17.583292+0000","last_became_peered":"2024-09-21T03:27:17.583292+0000","last_unstale":"2024-09-21T03:27:19.165515+0000","last_undegraded":"2024-09-21T03:27:19.165515+0000","last_fullsized":"2024-09-21T03:27:19.165515+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:20:32.088276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"139'1","reported_seq":16,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.664710+0000","last_change":"2024-09-21T03:27:16.579737+0000","last_active":"2024-09-21T03:27:18.664710+0000","last_peered":"2024-09-21T03:27:18.664710+0000","last_clean":"2024-09-21T03:27:18.664710+0000","last_became_active":"2024-09-21T03:27:16.579428+0000","last_became_peered":"2024-09-21T03:27:16.579428+0000","last_unstale":"2024-09-21T03:27:18.664710+0000","last_undegraded":"2024-09-21T03:27:18.664710+0000","last_fullsized":"2024-09-21T03:27:18.664710+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:02:22.984543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.166055+0000","last_change":"2024-09-21T03:27:17.583627+0000","last_active":"2024-09-21T03:27:19.166055+0000","last_peered":"2024-09-21T03:27:19.166055+0000","last_clean":"2024-09-21T03:27:19.166055+0000","last_became_active":"2024-09-21T03:27:17.583282+0000","last_became_peered":"2024-09-21T03:27:17.583282+0000","last_unstale":"2024-09-21T03:27:19.166055+0000","last_undegraded":"2024-09-21T03:27:19.166055+0000","last_fullsized":"2024-09-21T03:27:19.166055+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:22.463799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"139'1","reported_seq":16,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.165273+0000","last_change":"2024-09-21T03:27:16.574689+0000","last_active":"2024-09-21T03:27:19.165273+0000","last_peered":"2024-09-21T03:27:19.165273+0000","last_clean":"2024-09-21T03:27:19.165273+0000","last_became_active":"2024-09-21T03:27:16.574380+0000","last_became_peered":"2024-09-21T03:27:16.574380+0000","last_unstale":"2024-09-21T03:27:19.165273+0000","last_undegraded":"2024-09-21T03:27:19.165273+0000","last_fullsized":"2024-09-21T03:27:19.165273+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:03.610863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.164761+0000","last_change":"2024-09-21T03:27:17.586684+0000","last_active":"2024-09-21T03:27:19.164761+0000","last_peered":"2024-09-21T03:27:19.164761+0000","last_clean":"2024-09-21T03:27:19.164761+0000","last_became_active":"2024-09-21T03:27:17.586407+0000","last_became_peered":"2024-09-21T03:27:17.586407+0000","last_unstale":"2024-09-21T03:27:19.164761+0000","last_undegraded":"2024-09-21T03:27:19.164761+0000","last_fullsized":"2024-09-21T03:27:19.164761+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:09.156713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585775+0000","last_change":"2024-09-21T03:27:16.574797+0000","last_active":"2024-09-21T03:27:18.585775+0000","last_peered":"2024-09-21T03:27:18.585775+0000","last_clean":"2024-09-21T03:27:18.585775+0000","last_became_active":"2024-09-21T03:27:16.574469+0000","last_became_peered":"2024-09-21T03:27:16.574469+0000","last_unstale":"2024-09-21T03:27:18.585775+0000","last_undegraded":"2024-09-21T03:27:18.585775+0000","last_fullsized":"2024-09-21T03:27:18.585775+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:12.431154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.166225+0000","last_change":"2024-09-21T03:27:17.576792+0000","last_active":"2024-09-21T03:27:19.166225+0000","last_peered":"2024-09-21T03:27:19.166225+0000","last_clean":"2024-09-21T03:27:19.166225+0000","last_became_active":"2024-09-21T03:27:17.576477+0000","last_became_peered":"2024-09-21T03:27:17.576477+0000","last_unstale":"2024-09-21T03:27:19.166225+0000","last_undegraded":"2024-09-21T03:27:19.166225+0000","last_fullsized":"2024-09-21T03:27:19.166225+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:55:05.795718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.165989+0000","last_change":"2024-09-21T03:27:16.578176+0000","last_active":"2024-09-21T03:27:19.165989+0000","last_peered":"2024-09-21T03:27:19.165989+0000","last_clean":"2024-09-21T03:27:19.165989+0000","last_became_active":"2024-09-21T03:27:16.577886+0000","last_became_peered":"2024-09-21T03:27:16.577886+0000","last_unstale":"2024-09-21T03:27:19.165989+0000","last_undegraded":"2024-09-21T03:27:19.165989+0000","last_fullsized":"2024-09-21T03:27:19.165989+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:49:28.002501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.164991+0000","last_change":"2024-09-21T03:27:17.577247+0000","last_active":"2024-09-21T03:27:19.164991+0000","last_peered":"2024-09-21T03:27:19.164991+0000","last_clean":"2024-09-21T03:27:19.164991+0000","last_became_active":"2024-09-21T03:27:17.576950+0000","last_became_peered":"2024-09-21T03:27:17.576950+0000","last_unstale":"2024-09-21T03:27:19.164991+0000","last_undegraded":"2024-09-21T03:27:19.164991+0000","last_fullsized":"2024-09-21T03:27:19.164991+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:12.611012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.166717+0000","last_change":"2024-09-21T03:27:16.578096+0000","last_active":"2024-09-21T03:27:19.166717+0000","last_peered":"2024-09-21T03:27:19.166717+0000","last_clean":"2024-09-21T03:27:19.166717+0000","last_became_active":"2024-09-21T03:27:16.577770+0000","last_became_peered":"2024-09-21T03:27:16.577770+0000","last_unstale":"2024-09-21T03:27:19.166717+0000","last_undegraded":"2024-09-21T03:27:19.166717+0000","last_fullsized":"2024-09-21T03:27:19.166717+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:54.303412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.166296+0000","last_change":"2024-09-21T03:27:17.577763+0000","last_active":"2024-09-21T03:27:19.166296+0000","last_peered":"2024-09-21T03:27:19.166296+0000","last_clean":"2024-09-21T03:27:19.166296+0000","last_became_active":"2024-09-21T03:27:17.577479+0000","last_became_peered":"2024-09-21T03:27:17.577479+0000","last_unstale":"2024-09-21T03:27:19.166296+0000","last_undegraded":"2024-09-21T03:27:19.166296+0000","last_fullsized":"2024-09-21T03:27:19.166296+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:50.693809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"139'3","reported_seq":18,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.165707+0000","last_change":"2024-09-21T03:27:16.577153+0000","last_active":"2024-09-21T03:27:19.165707+0000","last_peered":"2024-09-21T03:27:19.165707+0000","last_clean":"2024-09-21T03:27:19.165707+0000","last_became_active":"2024-09-21T03:27:16.576867+0000","last_became_peered":"2024-09-21T03:27:16.576867+0000","last_unstale":"2024-09-21T03:27:19.165707+0000","last_undegraded":"2024-09-21T03:27:19.165707+0000","last_fullsized":"2024-09-21T03:27:19.165707+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:46.573583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585356+0000","last_change":"2024-09-21T03:27:17.583787+0000","last_active":"2024-09-21T03:27:18.585356+0000","last_peered":"2024-09-21T03:27:18.585356+0000","last_clean":"2024-09-21T03:27:18.585356+0000","last_became_active":"2024-09-21T03:27:17.583260+0000","last_became_peered":"2024-09-21T03:27:17.583260+0000","last_unstale":"2024-09-21T03:27:18.585356+0000","last_undegraded":"2024-09-21T03:27:18.585356+0000","last_fullsized":"2024-09-21T03:27:18.585356+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:51.228873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"139'6","reported_seq":21,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.584840+0000","last_change":"2024-09-21T03:27:16.571658+0000","last_active":"2024-09-21T03:27:18.584840+0000","last_peered":"2024-09-21T03:27:18.584840+0000","last_clean":"2024-09-21T03:27:18.584840+0000","last_became_active":"2024-09-21T03:27:16.571305+0000","last_became_peered":"2024-09-21T03:27:16.571305+0000","last_unstale":"2024-09-21T03:27:18.584840+0000","last_undegraded":"2024-09-21T03:27:18.584840+0000","last_fullsized":"2024-09-21T03:27:18.584840+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:30.379967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.164938+0000","last_change":"2024-09-21T03:27:17.573089+0000","last_active":"2024-09-21T03:27:19.164938+0000","last_peered":"2024-09-21T03:27:19.164938+0000","last_clean":"2024-09-21T03:27:19.164938+0000","last_became_active":"2024-09-21T03:27:17.572836+0000","last_became_peered":"2024-09-21T03:27:17.572836+0000","last_unstale":"2024-09-21T03:27:19.164938+0000","last_undegraded":"2024-09-21T03:27:19.164938+0000","last_fullsized":"2024-09-21T03:27:19.164938+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:35.921481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"139'2","reported_seq":17,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.166234+0000","last_change":"2024-09-21T03:27:16.572761+0000","last_active":"2024-09-21T03:27:19.166234+0000","last_peered":"2024-09-21T03:27:19.166234+0000","last_clean":"2024-09-21T03:27:19.166234+0000","last_became_active":"2024-09-21T03:27:16.572470+0000","last_became_peered":"2024-09-21T03:27:16.572470+0000","last_unstale":"2024-09-21T03:27:19.166234+0000","last_undegraded":"2024-09-21T03:27:19.166234+0000","last_fullsized":"2024-09-21T03:27:19.166234+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:40.398460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.165708+0000","last_change":"2024-09-21T03:27:17.581354+0000","last_active":"2024-09-21T03:27:19.165708+0000","last_peered":"2024-09-21T03:27:19.165708+0000","last_clean":"2024-09-21T03:27:19.165708+0000","last_became_active":"2024-09-21T03:27:17.580851+0000","last_became_peered":"2024-09-21T03:27:17.580851+0000","last_unstale":"2024-09-21T03:27:19.165708+0000","last_undegraded":"2024-09-21T03:27:19.165708+0000","last_fullsized":"2024-09-21T03:27:19.165708+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:46.974246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.165105+0000","last_change":"2024-09-21T03:27:16.574985+0000","last_active":"2024-09-21T03:27:19.165105+0000","last_peered":"2024-09-21T03:27:19.165105+0000","last_clean":"2024-09-21T03:27:19.165105+0000","last_became_active":"2024-09-21T03:27:16.574650+0000","last_became_peered":"2024-09-21T03:27:16.574650+0000","last_unstale":"2024-09-21T03:27:19.165105+0000","last_undegraded":"2024-09-21T03:27:19.165105+0000","last_fullsized":"2024-09-21T03:27:19.165105+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:00.204114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.165006+0000","last_change":"2024-09-21T03:27:17.589346+0000","last_active":"2024-09-21T03:27:19.165006+0000","last_peered":"2024-09-21T03:27:19.165006+0000","last_clean":"2024-09-21T03:27:19.165006+0000","last_became_active":"2024-09-21T03:27:17.589034+0000","last_became_peered":"2024-09-21T03:27:17.589034+0000","last_unstale":"2024-09-21T03:27:19.165006+0000","last_undegraded":"2024-09-21T03:27:19.165006+0000","last_fullsized":"2024-09-21T03:27:19.165006+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:29.413682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.165020+0000","last_change":"2024-09-21T03:27:16.576083+0000","last_active":"2024-09-21T03:27:19.165020+0000","last_peered":"2024-09-21T03:27:19.165020+0000","last_clean":"2024-09-21T03:27:19.165020+0000","last_became_active":"2024-09-21T03:27:16.575789+0000","last_became_peered":"2024-09-21T03:27:16.575789+0000","last_unstale":"2024-09-21T03:27:19.165020+0000","last_undegraded":"2024-09-21T03:27:19.165020+0000","last_fullsized":"2024-09-21T03:27:19.165020+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:35.838462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.664083+0000","last_change":"2024-09-21T03:27:17.576643+0000","last_active":"2024-09-21T03:27:18.664083+0000","last_peered":"2024-09-21T03:27:18.664083+0000","last_clean":"2024-09-21T03:27:18.664083+0000","last_became_active":"2024-09-21T03:27:17.576339+0000","last_became_peered":"2024-09-21T03:27:17.576339+0000","last_unstale":"2024-09-21T03:27:18.664083+0000","last_undegraded":"2024-09-21T03:27:18.664083+0000","last_fullsized":"2024-09-21T03:27:18.664083+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:36.844400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"139'8","reported_seq":23,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.584534+0000","last_change":"2024-09-21T03:27:16.574966+0000","last_active":"2024-09-21T03:27:18.584534+0000","last_peered":"2024-09-21T03:27:18.584534+0000","last_clean":"2024-09-21T03:27:18.584534+0000","last_became_active":"2024-09-21T03:27:16.573876+0000","last_became_peered":"2024-09-21T03:27:16.573876+0000","last_unstale":"2024-09-21T03:27:18.584534+0000","last_undegraded":"2024-09-21T03:27:18.584534+0000","last_fullsized":"2024-09-21T03:27:18.584534+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:20:27.555326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.165678+0000","last_change":"2024-09-21T03:27:17.577237+0000","last_active":"2024-09-21T03:27:19.165678+0000","last_peered":"2024-09-21T03:27:19.165678+0000","last_clean":"2024-09-21T03:27:19.165678+0000","last_became_active":"2024-09-21T03:27:17.576428+0000","last_became_peered":"2024-09-21T03:27:17.576428+0000","last_unstale":"2024-09-21T03:27:19.165678+0000","last_undegraded":"2024-09-21T03:27:19.165678+0000","last_fullsized":"2024-09-21T03:27:19.165678+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:03.003218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"139'1","reported_seq":16,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.664559+0000","last_change":"2024-09-21T03:27:16.580043+0000","last_active":"2024-09-21T03:27:18.664559+0000","last_peered":"2024-09-21T03:27:18.664559+0000","last_clean":"2024-09-21T03:27:18.664559+0000","last_became_active":"2024-09-21T03:27:16.579642+0000","last_became_peered":"2024-09-21T03:27:16.579642+0000","last_unstale":"2024-09-21T03:27:18.664559+0000","last_undegraded":"2024-09-21T03:27:18.664559+0000","last_fullsized":"2024-09-21T03:27:18.664559+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:43.548214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.165236+0000","last_change":"2024-09-21T03:27:17.588315+0000","last_active":"2024-09-21T03:27:19.165236+0000","last_peered":"2024-09-21T03:27:19.165236+0000","last_clean":"2024-09-21T03:27:19.165236+0000","last_became_active":"2024-09-21T03:27:17.587763+0000","last_became_peered":"2024-09-21T03:27:17.587763+0000","last_unstale":"2024-09-21T03:27:19.165236+0000","last_undegraded":"2024-09-21T03:27:19.165236+0000","last_fullsized":"2024-09-21T03:27:19.165236+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:15.892326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"139'2","reported_seq":17,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.664401+0000","last_change":"2024-09-21T03:27:16.576595+0000","last_active":"2024-09-21T03:27:18.664401+0000","last_peered":"2024-09-21T03:27:18.664401+0000","last_clean":"2024-09-21T03:27:18.664401+0000","last_became_active":"2024-09-21T03:27:16.576288+0000","last_became_peered":"2024-09-21T03:27:16.576288+0000","last_unstale":"2024-09-21T03:27:18.664401+0000","last_undegraded":"2024-09-21T03:27:18.664401+0000","last_fullsized":"2024-09-21T03:27:18.664401+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:34.408303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.166242+0000","last_change":"2024-09-21T03:27:17.583424+0000","last_active":"2024-09-21T03:27:19.166242+0000","last_peered":"2024-09-21T03:27:19.166242+0000","last_clean":"2024-09-21T03:27:19.166242+0000","last_became_active":"2024-09-21T03:27:17.583133+0000","last_became_peered":"2024-09-21T03:27:17.583133+0000","last_unstale":"2024-09-21T03:27:19.166242+0000","last_undegraded":"2024-09-21T03:27:19.166242+0000","last_fullsized":"2024-09-21T03:27:19.166242+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:51.228873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"139'1","reported_seq":16,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583389+0000","last_change":"2024-09-21T03:27:16.580912+0000","last_active":"2024-09-21T03:27:18.583389+0000","last_peered":"2024-09-21T03:27:18.583389+0000","last_clean":"2024-09-21T03:27:18.583389+0000","last_became_active":"2024-09-21T03:27:16.580592+0000","last_became_peered":"2024-09-21T03:27:16.580592+0000","last_unstale":"2024-09-21T03:27:18.583389+0000","last_undegraded":"2024-09-21T03:27:18.583389+0000","last_fullsized":"2024-09-21T03:27:18.583389+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:41.558318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.166722+0000","last_change":"2024-09-21T03:27:17.587743+0000","last_active":"2024-09-21T03:27:19.166722+0000","last_peered":"2024-09-21T03:27:19.166722+0000","last_clean":"2024-09-21T03:27:19.166722+0000","last_became_active":"2024-09-21T03:27:17.587466+0000","last_became_peered":"2024-09-21T03:27:17.587466+0000","last_unstale":"2024-09-21T03:27:19.166722+0000","last_undegraded":"2024-09-21T03:27:19.166722+0000","last_fullsized":"2024-09-21T03:27:19.166722+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:28:20.078855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583564+0000","last_change":"2024-09-21T03:27:16.576719+0000","last_active":"2024-09-21T03:27:18.583564+0000","last_peered":"2024-09-21T03:27:18.583564+0000","last_clean":"2024-09-21T03:27:18.583564+0000","last_became_active":"2024-09-21T03:27:16.576402+0000","last_became_peered":"2024-09-21T03:27:16.576402+0000","last_unstale":"2024-09-21T03:27:18.583564+0000","last_undegraded":"2024-09-21T03:27:18.583564+0000","last_fullsized":"2024-09-21T03:27:18.583564+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:41.780927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.664144+0000","last_change":"2024-09-21T03:27:17.578483+0000","last_active":"2024-09-21T03:27:18.664144+0000","last_peered":"2024-09-21T03:27:18.664144+0000","last_clean":"2024-09-21T03:27:18.664144+0000","last_became_active":"2024-09-21T03:27:17.578151+0000","last_became_peered":"2024-09-21T03:27:17.578151+0000","last_unstale":"2024-09-21T03:27:18.664144+0000","last_undegraded":"2024-09-21T03:27:18.664144+0000","last_fullsized":"2024-09-21T03:27:18.664144+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:13.437092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"139'2","reported_seq":17,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.166359+0000","last_change":"2024-09-21T03:27:16.577952+0000","last_active":"2024-09-21T03:27:19.166359+0000","last_peered":"2024-09-21T03:27:19.166359+0000","last_clean":"2024-09-21T03:27:19.166359+0000","last_became_active":"2024-09-21T03:27:16.576576+0000","last_became_peered":"2024-09-21T03:27:16.576576+0000","last_unstale":"2024-09-21T03:27:19.166359+0000","last_undegraded":"2024-09-21T03:27:19.166359+0000","last_fullsized":"2024-09-21T03:27:19.166359+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:12.431154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.165936+0000","last_change":"2024-09-21T03:27:17.590371+0000","last_active":"2024-09-21T03:27:19.165936+0000","last_peered":"2024-09-21T03:27:19.165936+0000","last_clean":"2024-09-21T03:27:19.165936+0000","last_became_active":"2024-09-21T03:27:17.590067+0000","last_became_peered":"2024-09-21T03:27:17.590067+0000","last_unstale":"2024-09-21T03:27:19.165936+0000","last_undegraded":"2024-09-21T03:27:19.165936+0000","last_fullsized":"2024-09-21T03:27:19.165936+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:34:35.552677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583323+0000","last_change":"2024-09-21T03:27:16.577488+0000","last_active":"2024-09-21T03:27:18.583323+0000","last_peered":"2024-09-21T03:27:18.583323+0000","last_clean":"2024-09-21T03:27:18.583323+0000","last_became_active":"2024-09-21T03:27:16.577197+0000","last_became_peered":"2024-09-21T03:27:16.577197+0000","last_unstale":"2024-09-21T03:27:18.583323+0000","last_undegraded":"2024-09-21T03:27:18.583323+0000","last_fullsized":"2024-09-21T03:27:18.583323+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:08:17.944770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583365+0000","last_change":"2024-09-21T03:27:17.582910+0000","last_active":"2024-09-21T03:27:18.583365+0000","last_peered":"2024-09-21T03:27:18.583365+0000","last_clean":"2024-09-21T03:27:18.583365+0000","last_became_active":"2024-09-21T03:27:17.582582+0000","last_became_peered":"2024-09-21T03:27:17.582582+0000","last_unstale":"2024-09-21T03:27:18.583365+0000","last_undegraded":"2024-09-21T03:27:18.583365+0000","last_fullsized":"2024-09-21T03:27:18.583365+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:58:44.083723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.165135+0000","last_change":"2024-09-21T03:27:16.581246+0000","last_active":"2024-09-21T03:27:19.165135+0000","last_peered":"2024-09-21T03:27:19.165135+0000","last_clean":"2024-09-21T03:27:19.165135+0000","last_became_active":"2024-09-21T03:27:16.580919+0000","last_became_peered":"2024-09-21T03:27:16.580919+0000","last_unstale":"2024-09-21T03:27:19.165135+0000","last_undegraded":"2024-09-21T03:27:19.165135+0000","last_fullsized":"2024-09-21T03:27:19.165135+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:23:25.979160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.166456+0000","last_change":"2024-09-21T03:27:17.577791+0000","last_active":"2024-09-21T03:27:19.166456+0000","last_peered":"2024-09-21T03:27:19.166456+0000","last_clean":"2024-09-21T03:27:19.166456+0000","last_became_active":"2024-09-21T03:27:17.577502+0000","last_became_peered":"2024-09-21T03:27:17.577502+0000","last_unstale":"2024-09-21T03:27:19.166456+0000","last_undegraded":"2024-09-21T03:27:19.166456+0000","last_fullsized":"2024-09-21T03:27:19.166456+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:44:07.165635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583144+0000","last_change":"2024-09-21T03:27:16.578401+0000","last_active":"2024-09-21T03:27:18.583144+0000","last_peered":"2024-09-21T03:27:18.583144+0000","last_clean":"2024-09-21T03:27:18.583144+0000","last_became_active":"2024-09-21T03:27:16.578077+0000","last_became_peered":"2024-09-21T03:27:16.578077+0000","last_unstale":"2024-09-21T03:27:18.583144+0000","last_undegraded":"2024-09-21T03:27:18.583144+0000","last_fullsized":"2024-09-21T03:27:18.583144+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:44:50.471830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.166090+0000","last_change":"2024-09-21T03:27:17.578316+0000","last_active":"2024-09-21T03:27:19.166090+0000","last_peered":"2024-09-21T03:27:19.166090+0000","last_clean":"2024-09-21T03:27:19.166090+0000","last_became_active":"2024-09-21T03:27:17.578010+0000","last_became_peered":"2024-09-21T03:27:17.578010+0000","last_unstale":"2024-09-21T03:27:19.166090+0000","last_undegraded":"2024-09-21T03:27:19.166090+0000","last_fullsized":"2024-09-21T03:27:19.166090+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:23:33.688366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"139'2","reported_seq":17,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.165401+0000","last_change":"2024-09-21T03:27:16.578670+0000","last_active":"2024-09-21T03:27:19.165401+0000","last_peered":"2024-09-21T03:27:19.165401+0000","last_clean":"2024-09-21T03:27:19.165401+0000","last_became_active":"2024-09-21T03:27:16.578359+0000","last_became_peered":"2024-09-21T03:27:16.578359+0000","last_unstale":"2024-09-21T03:27:19.165401+0000","last_undegraded":"2024-09-21T03:27:19.165401+0000","last_fullsized":"2024-09-21T03:27:19.165401+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:52.045055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.167219+0000","last_change":"2024-09-21T03:27:17.584035+0000","last_active":"2024-09-21T03:27:19.167219+0000","last_peered":"2024-09-21T03:27:19.167219+0000","last_clean":"2024-09-21T03:27:19.167219+0000","last_became_active":"2024-09-21T03:27:17.583747+0000","last_became_peered":"2024-09-21T03:27:17.583747+0000","last_unstale":"2024-09-21T03:27:19.167219+0000","last_undegraded":"2024-09-21T03:27:19.167219+0000","last_fullsized":"2024-09-21T03:27:19.167219+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:21.253323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"139'1","reported_seq":16,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.664557+0000","last_change":"2024-09-21T03:27:16.580402+0000","last_active":"2024-09-21T03:27:18.664557+0000","last_peered":"2024-09-21T03:27:18.664557+0000","last_clean":"2024-09-21T03:27:18.664557+0000","last_became_active":"2024-09-21T03:27:16.580078+0000","last_became_peered":"2024-09-21T03:27:16.580078+0000","last_unstale":"2024-09-21T03:27:18.664557+0000","last_undegraded":"2024-09-21T03:27:18.664557+0000","last_fullsized":"2024-09-21T03:27:18.664557+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:11:07.923601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.167248+0000","last_change":"2024-09-21T03:27:17.580829+0000","last_active":"2024-09-21T03:27:19.167248+0000","last_peered":"2024-09-21T03:27:19.167248+0000","last_clean":"2024-09-21T03:27:19.167248+0000","last_became_active":"2024-09-21T03:27:17.580540+0000","last_became_peered":"2024-09-21T03:27:17.580540+0000","last_unstale":"2024-09-21T03:27:19.167248+0000","last_undegraded":"2024-09-21T03:27:19.167248+0000","last_fullsized":"2024-09-21T03:27:19.167248+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:24.272246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.586553+0000","last_change":"2024-09-21T03:27:16.574812+0000","last_active":"2024-09-21T03:27:18.586553+0000","last_peered":"2024-09-21T03:27:18.586553+0000","last_clean":"2024-09-21T03:27:18.586553+0000","last_became_active":"2024-09-21T03:27:16.574396+0000","last_became_peered":"2024-09-21T03:27:16.574396+0000","last_unstale":"2024-09-21T03:27:18.586553+0000","last_undegraded":"2024-09-21T03:27:18.586553+0000","last_fullsized":"2024-09-21T03:27:18.586553+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:03.610863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.166721+0000","last_change":"2024-09-21T03:27:17.574712+0000","last_active":"2024-09-21T03:27:19.166721+0000","last_peered":"2024-09-21T03:27:19.166721+0000","last_clean":"2024-09-21T03:27:19.166721+0000","last_became_active":"2024-09-21T03:27:17.574402+0000","last_became_peered":"2024-09-21T03:27:17.574402+0000","last_unstale":"2024-09-21T03:27:19.166721+0000","last_undegraded":"2024-09-21T03:27:19.166721+0000","last_fullsized":"2024-09-21T03:27:19.166721+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:30:10.089591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.166462+0000","last_change":"2024-09-21T03:27:16.579174+0000","last_active":"2024-09-21T03:27:19.166462+0000","last_peered":"2024-09-21T03:27:19.166462+0000","last_clean":"2024-09-21T03:27:19.166462+0000","last_became_active":"2024-09-21T03:27:16.578865+0000","last_became_peered":"2024-09-21T03:27:16.578865+0000","last_unstale":"2024-09-21T03:27:19.166462+0000","last_undegraded":"2024-09-21T03:27:19.166462+0000","last_fullsized":"2024-09-21T03:27:19.166462+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:21:23.331344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.165093+0000","last_change":"2024-09-21T03:27:17.578034+0000","last_active":"2024-09-21T03:27:19.165093+0000","last_peered":"2024-09-21T03:27:19.165093+0000","last_clean":"2024-09-21T03:27:19.165093+0000","last_became_active":"2024-09-21T03:27:17.576925+0000","last_became_peered":"2024-09-21T03:27:17.576925+0000","last_unstale":"2024-09-21T03:27:19.165093+0000","last_undegraded":"2024-09-21T03:27:19.165093+0000","last_fullsized":"2024-09-21T03:27:19.165093+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:21:26.316387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.584884+0000","last_change":"2024-09-21T03:27:16.574672+0000","last_active":"2024-09-21T03:27:18.584884+0000","last_peered":"2024-09-21T03:27:18.584884+0000","last_clean":"2024-09-21T03:27:18.584884+0000","last_became_active":"2024-09-21T03:27:16.573040+0000","last_became_peered":"2024-09-21T03:27:16.573040+0000","last_unstale":"2024-09-21T03:27:18.584884+0000","last_undegraded":"2024-09-21T03:27:18.584884+0000","last_fullsized":"2024-09-21T03:27:18.584884+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:38.629252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585226+0000","last_change":"2024-09-21T03:27:17.591453+0000","last_active":"2024-09-21T03:27:18.585226+0000","last_peered":"2024-09-21T03:27:18.585226+0000","last_clean":"2024-09-21T03:27:18.585226+0000","last_became_active":"2024-09-21T03:27:17.591101+0000","last_became_peered":"2024-09-21T03:27:17.591101+0000","last_unstale":"2024-09-21T03:27:18.585226+0000","last_undegraded":"2024-09-21T03:27:18.585226+0000","last_fullsized":"2024-09-21T03:27:18.585226+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:57.365059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.165398+0000","last_change":"2024-09-21T03:27:16.571816+0000","last_active":"2024-09-21T03:27:19.165398+0000","last_peered":"2024-09-21T03:27:19.165398+0000","last_clean":"2024-09-21T03:27:19.165398+0000","last_became_active":"2024-09-21T03:27:16.571475+0000","last_became_peered":"2024-09-21T03:27:16.571475+0000","last_unstale":"2024-09-21T03:27:19.165398+0000","last_undegraded":"2024-09-21T03:27:19.165398+0000","last_fullsized":"2024-09-21T03:27:19.165398+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:16.998561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.165823+0000","last_change":"2024-09-21T03:27:17.590751+0000","last_active":"2024-09-21T03:27:19.165823+0000","last_peered":"2024-09-21T03:27:19.165823+0000","last_clean":"2024-09-21T03:27:19.165823+0000","last_became_active":"2024-09-21T03:27:17.590156+0000","last_became_peered":"2024-09-21T03:27:17.590156+0000","last_unstale":"2024-09-21T03:27:19.165823+0000","last_undegraded":"2024-09-21T03:27:19.165823+0000","last_fullsized":"2024-09-21T03:27:19.165823+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:13:02.015409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585945+0000","last_change":"2024-09-21T03:27:16.573639+0000","last_active":"2024-09-21T03:27:18.585945+0000","last_peered":"2024-09-21T03:27:18.585945+0000","last_clean":"2024-09-21T03:27:18.585945+0000","last_became_active":"2024-09-21T03:27:16.573163+0000","last_became_peered":"2024-09-21T03:27:16.573163+0000","last_unstale":"2024-09-21T03:27:18.585945+0000","last_undegraded":"2024-09-21T03:27:18.585945+0000","last_fullsized":"2024-09-21T03:27:18.585945+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:19:35.838462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.664066+0000","last_change":"2024-09-21T03:27:17.578123+0000","last_active":"2024-09-21T03:27:18.664066+0000","last_peered":"2024-09-21T03:27:18.664066+0000","last_clean":"2024-09-21T03:27:18.664066+0000","last_became_active":"2024-09-21T03:27:17.577792+0000","last_became_peered":"2024-09-21T03:27:17.577792+0000","last_unstale":"2024-09-21T03:27:18.664066+0000","last_undegraded":"2024-09-21T03:27:18.664066+0000","last_fullsized":"2024-09-21T03:27:18.664066+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:41.404398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.584498+0000","last_change":"2024-09-21T03:27:16.574180+0000","last_active":"2024-09-21T03:27:18.584498+0000","last_peered":"2024-09-21T03:27:18.584498+0000","last_clean":"2024-09-21T03:27:18.584498+0000","last_became_active":"2024-09-21T03:27:16.573439+0000","last_became_peered":"2024-09-21T03:27:16.573439+0000","last_unstale":"2024-09-21T03:27:18.584498+0000","last_undegraded":"2024-09-21T03:27:18.584498+0000","last_fullsized":"2024-09-21T03:27:18.584498+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:36.525290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:19.165869+0000","last_change":"2024-09-21T03:27:17.578054+0000","last_active":"2024-09-21T03:27:19.165869+0000","last_peered":"2024-09-21T03:27:19.165869+0000","last_clean":"2024-09-21T03:27:19.165869+0000","last_became_active":"2024-09-21T03:27:17.577746+0000","last_became_peered":"2024-09-21T03:27:17.577746+0000","last_unstale":"2024-09-21T03:27:19.165869+0000","last_undegraded":"2024-09-21T03:27:19.165869+0000","last_fullsized":"2024-09-21T03:27:19.165869+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:16.550895+0000","last_clean_scrub_stamp":"2024-09-21T03:27:16.550895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:02.916165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.585346+0000","last_change":"2024-09-21T03:27:16.575356+0000","last_active":"2024-09-21T03:27:18.585346+0000","last_peered":"2024-09-21T03:27:18.585346+0000","last_clean":"2024-09-21T03:27:18.585346+0000","last_became_active":"2024-09-21T03:27:16.574933+0000","last_became_peered":"2024-09-21T03:27:16.574933+0000","last_unstale":"2024-09-21T03:27:18.585346+0000","last_undegraded":"2024-09-21T03:27:18.585346+0000","last_fullsized":"2024-09-21T03:27:18.585346+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:15.544957+0000","last_clean_scrub_stamp":"2024-09-21T03:27:15.544957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:11.636922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":334,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-21T03:27:18.583233+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:27:18.583233+0000","last_peered":"2024-09-21T03:27:18.583233+0000","last_clean":"2024-09-21T03:27:18.583233+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:27:18.583233+0000","last_undegraded":"2024-09-21T03:27:18.583233+0000","last_fullsized":"2024-09-21T03:27:18.583233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509554,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33512,"kb_used_data":2316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338328,"statfs":{"total":96636764160,"available":96602447872,"internally_reserved":0,"allocated":2371584,"data_stored":1346178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509553,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32904,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338936,"statfs":{"total":96636764160,"available":96603070464,"internally_reserved":0,"allocated":1757184,"data_stored":753478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509552,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32908,"kb_used_data":1720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338932,"statfs":{"total":96636764160,"available":96603066368,"internally_reserved":0,"allocated":1761280,"data_stored":754060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509552,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32916,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338924,"statfs":{"total":96636764160,"available":96603058176,"internally_reserved":0,"allocated":1769472,"data_stored":755138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509553,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32912,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338928,"statfs":{"total":96636764160,"available":96603062272,"internally_reserved":0,"allocated":1757184,"data_stored":753490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509553,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37072,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334768,"statfs":{"total":96636764160,"available":96598802432,"internally_reserved":0,"allocated":1757184,"data_stored":753546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509553,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37064,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334776,"statfs":{"total":96636764160,"available":96598810624,"internally_reserved":0,"allocated":1757184,"data_stored":753490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574960,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33480,"kb_used_data":2292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338360,"statfs":{"total":96636764160,"available":96602480640,"internally_reserved":0,"allocated":2347008,"data_stored":1343824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:27:26.375 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T03:27:26.376 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T03:27:26.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.528+0000 7f1bf8d69640 1 -- 172.21.15.105:0/4204629685 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1bf40d1490 msgr2=0x7f1bf41674d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:26.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.528+0000 7f1bf8d69640 1 --2- 172.21.15.105:0/4204629685 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1bf40d1490 0x7f1bf41674d0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f1bec005fd0 tx=0x7f1bec02aa90 comp rx=0 tx=0).stop 2024-09-21T03:27:26.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.528+0000 7f1bf8d69640 1 -- 172.21.15.105:0/4204629685 shutdown_connections 2024-09-21T03:27:26.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.528+0000 7f1bf8d69640 1 --2- 172.21.15.105:0/4204629685 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1bf40d1490 0x7f1bf41674d0 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:26.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.528+0000 7f1bf8d69640 1 -- 172.21.15.105:0/4204629685 >> 172.21.15.105:0/4204629685 conn(0x7f1bf4072ae0 msgr2=0x7f1bf4072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:26.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.528+0000 7f1bf8d69640 1 -- 172.21.15.105:0/4204629685 shutdown_connections 2024-09-21T03:27:26.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.528+0000 7f1bf8d69640 1 -- 172.21.15.105:0/4204629685 wait complete. 2024-09-21T03:27:26.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.530+0000 7f1bf8d69640 1 Processor -- start 2024-09-21T03:27:26.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.530+0000 7f1bf8d69640 1 -- start start 2024-09-21T03:27:26.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.531+0000 7f1bf8d69640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1bf40b51c0 0x7f1bf41525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:26.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.531+0000 7f1bf8d69640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1bf40ccbd0 0x7f1bf40b3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:26.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.531+0000 7f1bf8d69640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bf40d1490 0x7f1bf40b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:26.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.531+0000 7f1bf8d69640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf4167c20 con 0x7f1bf40b51c0 2024-09-21T03:27:26.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.531+0000 7f1bf8d69640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf40d1b50 con 0x7f1bf40d1490 2024-09-21T03:27:26.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.531+0000 7f1bf8d69640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1bf4167da0 con 0x7f1bf40ccbd0 2024-09-21T03:27:26.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.531+0000 7f1bf259c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1bf40b51c0 0x7f1bf41525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:26.538 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.532+0000 7f1bf259c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1bf40b51c0 0x7f1bf41525c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40210/0 (socket says 172.21.15.105:40210) 2024-09-21T03:27:26.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.532+0000 7f1bf259c640 1 -- 172.21.15.105:0/624868172 learned_addr learned my addr 172.21.15.105:0/624868172 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:26.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.532+0000 7f1bf2d9d640 1 --2- 172.21.15.105:0/624868172 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bf40d1490 0x7f1bf40b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:26.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.532+0000 7f1be9d9b640 1 --2- 172.21.15.105:0/624868172 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1bf40ccbd0 0x7f1bf40b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:26.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.532+0000 7f1bf259c640 1 -- 172.21.15.105:0/624868172 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1bf40ccbd0 msgr2=0x7f1bf40b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:26.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.532+0000 7f1bf259c640 1 --2- 172.21.15.105:0/624868172 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1bf40ccbd0 0x7f1bf40b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:26.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.532+0000 7f1bf259c640 1 -- 172.21.15.105:0/624868172 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bf40d1490 msgr2=0x7f1bf40b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:26.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.532+0000 7f1bf259c640 1 --2- 172.21.15.105:0/624868172 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bf40d1490 0x7f1bf40b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:26.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.532+0000 7f1bf259c640 1 -- 172.21.15.105:0/624868172 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bf4154240 con 0x7f1bf40b51c0 2024-09-21T03:27:26.539 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.532+0000 7f1bf259c640 1 --2- 172.21.15.105:0/624868172 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1bf40b51c0 0x7f1bf41525c0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f1be400b3e0 tx=0x7f1be400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:26.540 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.532+0000 7f1beb7fe640 1 -- 172.21.15.105:0/624868172 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be4015020 con 0x7f1bf40b51c0 2024-09-21T03:27:26.540 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.532+0000 7f1beb7fe640 1 -- 172.21.15.105:0/624868172 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1be4011940 con 0x7f1bf40b51c0 2024-09-21T03:27:26.540 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.532+0000 7f1beb7fe640 1 -- 172.21.15.105:0/624868172 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be4011d90 con 0x7f1bf40b51c0 2024-09-21T03:27:26.540 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.532+0000 7f1bf8d69640 1 -- 172.21.15.105:0/624868172 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bf40c6020 con 0x7f1bf40b51c0 2024-09-21T03:27:26.540 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.532+0000 7f1bf8d69640 1 -- 172.21.15.105:0/624868172 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bf415eeb0 con 0x7f1bf40b51c0 2024-09-21T03:27:26.540 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.533+0000 7f1bf8d69640 1 -- 172.21.15.105:0/624868172 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bf415c6e0 con 0x7f1bf40b51c0 2024-09-21T03:27:26.540 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.534+0000 7f1beb7fe640 1 -- 172.21.15.105:0/624868172 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1be4018020 con 0x7f1bf40b51c0 2024-09-21T03:27:26.540 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.534+0000 7f1beb7fe640 1 --2- 172.21.15.105:0/624868172 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1bd4078b90 0x7f1bd407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:26.540 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.534+0000 7f1beb7fe640 1 -- 172.21.15.105:0/624868172 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5709+0+0 (secure 0 0 0) 0x7f1be409abc0 con 0x7f1bf40b51c0 2024-09-21T03:27:26.540 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.535+0000 7f1be9d9b640 1 --2- 172.21.15.105:0/624868172 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1bd4078b90 0x7f1bd407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:26.540 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.535+0000 7f1be9d9b640 1 --2- 172.21.15.105:0/624868172 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1bd4078b90 0x7f1bd407b0a0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f1bf40c8310 tx=0x7f1bdc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:26.541 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.539+0000 7f1beb7fe640 1 -- 172.21.15.105:0/624868172 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1be401f020 con 0x7f1bf40b51c0 2024-09-21T03:27:26.790 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.787+0000 7f1bf8d69640 1 -- 172.21.15.105:0/624868172 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f1bf40b2b30 con 0x7f1bf40b51c0 2024-09-21T03:27:26.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.790+0000 7f1beb7fe640 1 -- 172.21.15.105:0/624868172 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) ==== 190+0+147 (secure 0 0 0) 0x7f1be4063090 con 0x7f1bf40b51c0 2024-09-21T03:27:26.793 INFO:teuthology.orchestra.run.smithi105.stdout:[client.0] 2024-09-21T03:27:26.793 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQDIOu5mughoJxAAhY0bzJmq+oNyzCdtafkC9w== 2024-09-21T03:27:26.793 INFO:teuthology.orchestra.run.smithi105.stdout: caps mds = "allow" 2024-09-21T03:27:26.794 INFO:teuthology.orchestra.run.smithi105.stdout: caps mon = "allow r" 2024-09-21T03:27:26.794 INFO:teuthology.orchestra.run.smithi105.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T03:27:26.794 INFO:teuthology.orchestra.run.smithi105.stderr:updated caps for client.0 2024-09-21T03:27:26.796 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.792+0000 7f1bf8d69640 1 -- 172.21.15.105:0/624868172 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1bd4078b90 msgr2=0x7f1bd407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:26.796 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.792+0000 7f1bf8d69640 1 --2- 172.21.15.105:0/624868172 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1bd4078b90 0x7f1bd407b0a0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f1bf40c8310 tx=0x7f1bdc009040 comp rx=0 tx=0).stop 2024-09-21T03:27:26.796 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.792+0000 7f1bf8d69640 1 -- 172.21.15.105:0/624868172 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1bf40b51c0 msgr2=0x7f1bf41525c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:26.796 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.792+0000 7f1bf8d69640 1 --2- 172.21.15.105:0/624868172 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1bf40b51c0 0x7f1bf41525c0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f1be400b3e0 tx=0x7f1be400b8a0 comp rx=0 tx=0).stop 2024-09-21T03:27:26.796 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.792+0000 7f1bf8d69640 1 -- 172.21.15.105:0/624868172 shutdown_connections 2024-09-21T03:27:26.796 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.792+0000 7f1bf8d69640 1 --2- 172.21.15.105:0/624868172 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1bd4078b90 0x7f1bd407b0a0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:26.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.792+0000 7f1bf8d69640 1 --2- 172.21.15.105:0/624868172 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bf40d1490 0x7f1bf40b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:26.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.792+0000 7f1bf8d69640 1 --2- 172.21.15.105:0/624868172 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1bf40ccbd0 0x7f1bf40b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:26.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.792+0000 7f1bf8d69640 1 --2- 172.21.15.105:0/624868172 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1bf40b51c0 0x7f1bf41525c0 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:26.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.793+0000 7f1bf8d69640 1 -- 172.21.15.105:0/624868172 >> 172.21.15.105:0/624868172 conn(0x7f1bf4072ae0 msgr2=0x7f1bf40b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:26.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.793+0000 7f1bf8d69640 1 -- 172.21.15.105:0/624868172 shutdown_connections 2024-09-21T03:27:26.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.793+0000 7f1bf8d69640 1 -- 172.21.15.105:0/624868172 wait complete. 2024-09-21T03:27:26.807 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:27:26.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.917+0000 7fd42a6b4640 1 -- 172.21.15.105:0/548477427 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4240ccbd0 msgr2=0x7fd4240d0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:26.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.917+0000 7fd42a6b4640 1 --2- 172.21.15.105:0/548477427 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4240ccbd0 0x7fd4240d0d80 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fd418009830 tx=0x7fd41802a5c0 comp rx=0 tx=0).stop 2024-09-21T03:27:26.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.917+0000 7fd42a6b4640 1 -- 172.21.15.105:0/548477427 shutdown_connections 2024-09-21T03:27:26.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.917+0000 7fd42a6b4640 1 --2- 172.21.15.105:0/548477427 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4240ccbd0 0x7fd4240d0d80 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:26.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.917+0000 7fd42a6b4640 1 -- 172.21.15.105:0/548477427 >> 172.21.15.105:0/548477427 conn(0x7fd424072ae0 msgr2=0x7fd424072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:26.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.917+0000 7fd42a6b4640 1 -- 172.21.15.105:0/548477427 shutdown_connections 2024-09-21T03:27:26.920 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.917+0000 7fd42a6b4640 1 -- 172.21.15.105:0/548477427 wait complete. 2024-09-21T03:27:26.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.918+0000 7fd42a6b4640 1 Processor -- start 2024-09-21T03:27:26.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.919+0000 7fd42a6b4640 1 -- start start 2024-09-21T03:27:26.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.920+0000 7fd42a6b4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4240b51c0 0x7fd4241e7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:26.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.920+0000 7fd42a6b4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4240ccbd0 0x7fd4241482d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:26.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.920+0000 7fd42a6b4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4240d12c0 0x7fd42415dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:26.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.920+0000 7fd42a6b4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd4240cf480 con 0x7fd4240ccbd0 2024-09-21T03:27:26.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.920+0000 7fd42a6b4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd4240cf300 con 0x7fd4240b51c0 2024-09-21T03:27:26.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.920+0000 7fd42a6b4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd4240cf600 con 0x7fd4240d12c0 2024-09-21T03:27:26.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.920+0000 7fd4237fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4240ccbd0 0x7fd4241482d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:26.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.920+0000 7fd4237fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4240ccbd0 0x7fd4241482d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40228/0 (socket says 172.21.15.105:40228) 2024-09-21T03:27:26.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.920+0000 7fd4237fe640 1 -- 172.21.15.105:0/2934672363 learned_addr learned my addr 172.21.15.105:0/2934672363 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:26.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.920+0000 7fd423fff640 1 --2- 172.21.15.105:0/2934672363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4240b51c0 0x7fd4241e7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:26.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.920+0000 7fd428c51640 1 --2- 172.21.15.105:0/2934672363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4240d12c0 0x7fd42415dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:26.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.920+0000 7fd4237fe640 1 -- 172.21.15.105:0/2934672363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4240d12c0 msgr2=0x7fd42415dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:26.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.920+0000 7fd4237fe640 1 --2- 172.21.15.105:0/2934672363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4240d12c0 0x7fd42415dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:26.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.920+0000 7fd4237fe640 1 -- 172.21.15.105:0/2934672363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4240b51c0 msgr2=0x7fd4241e7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:26.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.920+0000 7fd4237fe640 1 --2- 172.21.15.105:0/2934672363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4240b51c0 0x7fd4241e7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:26.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.920+0000 7fd4237fe640 1 -- 172.21.15.105:0/2934672363 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd42414e6e0 con 0x7fd4240ccbd0 2024-09-21T03:27:26.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.921+0000 7fd4237fe640 1 --2- 172.21.15.105:0/2934672363 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4240ccbd0 0x7fd4241482d0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fd418009950 tx=0x7fd418033c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:26.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.921+0000 7fd420ff9640 1 -- 172.21.15.105:0/2934672363 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd418031b60 con 0x7fd4240ccbd0 2024-09-21T03:27:26.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.921+0000 7fd420ff9640 1 -- 172.21.15.105:0/2934672363 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd418031df0 con 0x7fd4240ccbd0 2024-09-21T03:27:26.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.921+0000 7fd42a6b4640 1 -- 172.21.15.105:0/2934672363 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd42415ca40 con 0x7fd4240ccbd0 2024-09-21T03:27:26.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.921+0000 7fd420ff9640 1 -- 172.21.15.105:0/2934672363 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd418005280 con 0x7fd4240ccbd0 2024-09-21T03:27:26.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.921+0000 7fd42a6b4640 1 -- 172.21.15.105:0/2934672363 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd42415d000 con 0x7fd4240ccbd0 2024-09-21T03:27:26.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.922+0000 7fd42a6b4640 1 -- 172.21.15.105:0/2934672363 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd424147ff0 con 0x7fd4240ccbd0 2024-09-21T03:27:26.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.923+0000 7fd420ff9640 1 -- 172.21.15.105:0/2934672363 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd418005420 con 0x7fd4240ccbd0 2024-09-21T03:27:26.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.923+0000 7fd420ff9640 1 --2- 172.21.15.105:0/2934672363 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd410078b90 0x7fd41007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:26.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.923+0000 7fd420ff9640 1 -- 172.21.15.105:0/2934672363 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5709+0+0 (secure 0 0 0) 0x7fd4180bbf20 con 0x7fd4240ccbd0 2024-09-21T03:27:26.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.923+0000 7fd423fff640 1 --2- 172.21.15.105:0/2934672363 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd410078b90 0x7fd41007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:26.927 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.924+0000 7fd423fff640 1 --2- 172.21.15.105:0/2934672363 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd410078b90 0x7fd41007b0a0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fd414000f60 tx=0x7fd414009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:26.930 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:26.928+0000 7fd420ff9640 1 -- 172.21.15.105:0/2934672363 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd424147ff0 con 0x7fd4240ccbd0 2024-09-21T03:27:27.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.143+0000 7fd42a6b4640 1 -- 172.21.15.105:0/2934672363 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd4240cfa80 con 0x7fd4240ccbd0 2024-09-21T03:27:27.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.144+0000 7fd420ff9640 1 -- 172.21.15.105:0/2934672363 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5239 (secure 0 0 0) 0x7fd42414e6e0 con 0x7fd4240ccbd0 2024-09-21T03:27:27.147 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:27:27.147 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":95,"btime":"2024-09-21T03:27:20:587314+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6752,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/1488182977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1488182977},{"type":"v1","addr":"172.21.15.162:6836","nonce":1488182977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":6755,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/2107181663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2107181663},{"type":"v1","addr":"172.21.15.162:6837","nonce":2107181663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":8427,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/3833164666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3833164666},{"type":"v1","addr":"172.21.15.105:6834","nonce":3833164666}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:27:16.932383+0000","modified":"2024-09-21T03:27:19.949827+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8430":{"gid":8430,"name":"a","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1315344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":1315344000},{"type":"v1","addr":"172.21.15.105:6835","nonce":1315344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8430,"qdb_cluster":[8430]},"id":11}]} 2024-09-21T03:27:27.147 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 95 2024-09-21T03:27:27.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.146+0000 7fd42a6b4640 1 -- 172.21.15.105:0/2934672363 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd410078b90 msgr2=0x7fd41007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:27.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.146+0000 7fd42a6b4640 1 --2- 172.21.15.105:0/2934672363 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd410078b90 0x7fd41007b0a0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fd414000f60 tx=0x7fd414009040 comp rx=0 tx=0).stop 2024-09-21T03:27:27.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.146+0000 7fd42a6b4640 1 -- 172.21.15.105:0/2934672363 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4240ccbd0 msgr2=0x7fd4241482d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:27.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.146+0000 7fd42a6b4640 1 --2- 172.21.15.105:0/2934672363 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4240ccbd0 0x7fd4241482d0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fd418009950 tx=0x7fd418033c10 comp rx=0 tx=0).stop 2024-09-21T03:27:27.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.146+0000 7fd42a6b4640 1 -- 172.21.15.105:0/2934672363 shutdown_connections 2024-09-21T03:27:27.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.146+0000 7fd42a6b4640 1 --2- 172.21.15.105:0/2934672363 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fd410078b90 0x7fd41007b0a0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:27.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.146+0000 7fd42a6b4640 1 --2- 172.21.15.105:0/2934672363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4240d12c0 0x7fd42415dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:27.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.146+0000 7fd42a6b4640 1 --2- 172.21.15.105:0/2934672363 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4240ccbd0 0x7fd4241482d0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:27.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.146+0000 7fd42a6b4640 1 --2- 172.21.15.105:0/2934672363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4240b51c0 0x7fd4241e7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:27.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.146+0000 7fd42a6b4640 1 -- 172.21.15.105:0/2934672363 >> 172.21.15.105:0/2934672363 conn(0x7fd424072ae0 msgr2=0x7fd42415a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:27.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.146+0000 7fd42a6b4640 1 -- 172.21.15.105:0/2934672363 shutdown_connections 2024-09-21T03:27:27.149 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.146+0000 7fd42a6b4640 1 -- 172.21.15.105:0/2934672363 wait complete. 2024-09-21T03:27:27.565 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 95, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T03:27:16.932383+0000', 'modified': '2024-09-21T03:27:19.949827+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8430}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8430': {'gid': 8430, 'name': 'a', 'rank': 0, 'incarnation': 91, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.105:6835/1315344000', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6833', 'nonce': 1315344000}, {'type': 'v1', 'addr': '172.21.15.105:6835', 'nonce': 1315344000}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [23], 'metadata_pool': 22, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8430, 'qdb_cluster': [8430]} 2024-09-21T03:27:27.572 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T03:27:27.573 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-21T03:27:27.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.689+0000 7f8b35332640 1 -- 172.21.15.105:0/3313014823 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b1c003a00 msgr2=0x7f8b1c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:27.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.689+0000 7f8b35332640 1 --2- 172.21.15.105:0/3313014823 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b1c003a00 0x7f8b1c003e70 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f8b20009b80 tx=0x7f8b1c005830 comp rx=0 tx=0).stop 2024-09-21T03:27:27.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.689+0000 7f8b2f7fe640 1 -- 172.21.15.105:0/3313014823 reap_dead start 2024-09-21T03:27:27.692 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.689+0000 7f8b35332640 1 -- 172.21.15.105:0/3313014823 shutdown_connections 2024-09-21T03:27:27.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.689+0000 7f8b35332640 1 -- 172.21.15.105:0/3313014823 >> 172.21.15.105:0/3313014823 conn(0x7f8b3008bfc0 msgr2=0x7f8b3009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:27.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.689+0000 7f8b35332640 1 -- 172.21.15.105:0/3313014823 shutdown_connections 2024-09-21T03:27:27.693 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.689+0000 7f8b35332640 1 -- 172.21.15.105:0/3313014823 wait complete. 2024-09-21T03:27:27.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.691+0000 7f8b35332640 1 Processor -- start 2024-09-21T03:27:27.694 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.691+0000 7f8b35332640 1 -- start start 2024-09-21T03:27:27.696 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.693+0000 7f8b35332640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b1c003a00 0x7f8b300c9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:27.696 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.693+0000 7f8b35332640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b300c9ec0 0x7f8b301f52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:27.696 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.693+0000 7f8b35332640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b301f5810 0x7f8b300ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:27.696 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.693+0000 7f8b35332640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8b3006e2f0 con 0x7f8b300c9ec0 2024-09-21T03:27:27.696 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.693+0000 7f8b35332640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8b3006e170 con 0x7f8b1c003a00 2024-09-21T03:27:27.696 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.693+0000 7f8b35332640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8b300b3540 con 0x7f8b301f5810 2024-09-21T03:27:27.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.693+0000 7f8b2e7fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b300c9ec0 0x7f8b301f52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:27.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.693+0000 7f8b2e7fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b300c9ec0 0x7f8b301f52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40246/0 (socket says 172.21.15.105:40246) 2024-09-21T03:27:27.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.693+0000 7f8b2e7fc640 1 -- 172.21.15.105:0/1340476129 learned_addr learned my addr 172.21.15.105:0/1340476129 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:27.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.693+0000 7f8b2effd640 1 --2- 172.21.15.105:0/1340476129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b1c003a00 0x7f8b300c9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:27.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.693+0000 7f8b2f7fe640 1 --2- 172.21.15.105:0/1340476129 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b301f5810 0x7f8b300ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:27.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.693+0000 7f8b2e7fc640 1 -- 172.21.15.105:0/1340476129 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b301f5810 msgr2=0x7f8b300ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:27.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.693+0000 7f8b2e7fc640 1 --2- 172.21.15.105:0/1340476129 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b301f5810 0x7f8b300ccc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:27.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.693+0000 7f8b2e7fc640 1 -- 172.21.15.105:0/1340476129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b1c003a00 msgr2=0x7f8b300c9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:27.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.693+0000 7f8b2e7fc640 1 --2- 172.21.15.105:0/1340476129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b1c003a00 0x7f8b300c9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:27.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.693+0000 7f8b2e7fc640 1 -- 172.21.15.105:0/1340476129 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b300caf50 con 0x7f8b300c9ec0 2024-09-21T03:27:27.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.693+0000 7f8b2e7fc640 1 --2- 172.21.15.105:0/1340476129 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b300c9ec0 0x7f8b301f52d0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f8b18006630 tx=0x7f8b180039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:27.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.694+0000 7f8b277fe640 1 -- 172.21.15.105:0/1340476129 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b18015070 con 0x7f8b300c9ec0 2024-09-21T03:27:27.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.694+0000 7f8b277fe640 1 -- 172.21.15.105:0/1340476129 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b18011900 con 0x7f8b300c9ec0 2024-09-21T03:27:27.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.694+0000 7f8b35332640 1 -- 172.21.15.105:0/1340476129 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b300cc740 con 0x7f8b300c9ec0 2024-09-21T03:27:27.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.694+0000 7f8b277fe640 1 -- 172.21.15.105:0/1340476129 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b18011d50 con 0x7f8b300c9ec0 2024-09-21T03:27:27.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.694+0000 7f8b35332640 1 -- 172.21.15.105:0/1340476129 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b300ca990 con 0x7f8b300c9ec0 2024-09-21T03:27:27.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.696+0000 7f8b277fe640 1 -- 172.21.15.105:0/1340476129 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8b18018070 con 0x7f8b300c9ec0 2024-09-21T03:27:27.699 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.696+0000 7f8b277fe640 1 --2- 172.21.15.105:0/1340476129 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8b10078b90 0x7f8b1007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:27.699 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.696+0000 7f8b277fe640 1 -- 172.21.15.105:0/1340476129 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5709+0+0 (secure 0 0 0) 0x7f8b1809ba00 con 0x7f8b300c9ec0 2024-09-21T03:27:27.699 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.697+0000 7f8b2effd640 1 --2- 172.21.15.105:0/1340476129 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8b10078b90 0x7f8b1007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:27.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.697+0000 7f8b3c2a2740 1 Processor -- start 2024-09-21T03:27:27.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.697+0000 7f8b3c2a2740 1 -- start start 2024-09-21T03:27:27.700 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.697+0000 7f8b2effd640 1 --2- 172.21.15.105:0/1340476129 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8b10078b90 0x7f8b1007b0a0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f8b20035000 tx=0x7f8b200046c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:27.702 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.698+0000 7f8b3c2a2740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559a023c4270 0x559a02795fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:27.702 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.698+0000 7f8b3c2a2740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559a0239b3b0 0x559a027964e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:27.702 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.698+0000 7f8b3c2a2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559a023a3590 0x559a027b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:27.702 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.698+0000 7f8b3c2a2740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x559a026de820 con 0x559a023c4270 2024-09-21T03:27:27.702 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.698+0000 7f8b3c2a2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559a026cdc50 con 0x559a023a3590 2024-09-21T03:27:27.702 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.698+0000 7f8b3c2a2740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x559a026d1a60 con 0x559a0239b3b0 2024-09-21T03:27:27.702 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.698+0000 7f8b2effd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559a023c4270 0x559a02795fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:27.702 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.698+0000 7f8b2effd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559a023c4270 0x559a02795fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40260/0 (socket says 172.21.15.105:40260) 2024-09-21T03:27:27.702 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.698+0000 7f8b2effd640 1 -- 172.21.15.105:0/1831774252 learned_addr learned my addr 172.21.15.105:0/1831774252 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:27.702 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.699+0000 7f8b2e7fc640 1 --2- 172.21.15.105:0/1831774252 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559a0239b3b0 0x559a027964e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:27.702 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.699+0000 7f8b2f7fe640 1 --2- 172.21.15.105:0/1831774252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559a023a3590 0x559a027b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:27.703 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.699+0000 7f8b2effd640 1 -- 172.21.15.105:0/1831774252 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559a0239b3b0 msgr2=0x559a027964e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:27:27.703 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.699+0000 7f8b2effd640 1 --2- 172.21.15.105:0/1831774252 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559a0239b3b0 0x559a027964e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:27.703 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.699+0000 7f8b2effd640 1 -- 172.21.15.105:0/1831774252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559a023a3590 msgr2=0x559a027b33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:27:27.703 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.699+0000 7f8b2effd640 1 --2- 172.21.15.105:0/1831774252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559a023a3590 0x559a027b33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:27.703 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.699+0000 7f8b2effd640 1 -- 172.21.15.105:0/1831774252 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a0242f850 con 0x559a023c4270 2024-09-21T03:27:27.703 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.699+0000 7f8b2effd640 1 --2- 172.21.15.105:0/1831774252 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559a023c4270 0x559a02795fa0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f8b20009b80 tx=0x7f8b2002d050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b26bdad9c42d9539 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:27.703 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.699+0000 7f8b24ff9640 1 -- 172.21.15.105:0/1831774252 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b20038040 con 0x559a023c4270 2024-09-21T03:27:27.703 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.699+0000 7f8b24ff9640 1 -- 172.21.15.105:0/1831774252 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b2004f070 con 0x559a023c4270 2024-09-21T03:27:27.703 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.699+0000 7f8b24ff9640 1 -- 172.21.15.105:0/1831774252 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b20003810 con 0x559a023c4270 2024-09-21T03:27:27.704 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.700+0000 7f8b3c2a2740 1 -- 172.21.15.105:0/1831774252 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559a023c4270 msgr2=0x559a02795fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:27.704 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.700+0000 7f8b3c2a2740 1 --2- 172.21.15.105:0/1831774252 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559a023c4270 0x559a02795fa0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f8b20009b80 tx=0x7f8b2002d050 comp rx=0 tx=0).stop 2024-09-21T03:27:27.704 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.700+0000 7f8b3c2a2740 1 -- 172.21.15.105:0/1831774252 shutdown_connections 2024-09-21T03:27:27.704 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.700+0000 7f8b3c2a2740 1 --2- 172.21.15.105:0/1831774252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559a023a3590 0x559a027b33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:27.704 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.700+0000 7f8b3c2a2740 1 --2- 172.21.15.105:0/1831774252 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559a0239b3b0 0x559a027964e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:27.704 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.700+0000 7f8b3c2a2740 1 --2- 172.21.15.105:0/1831774252 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559a023c4270 0x559a02795fa0 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:27.704 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.700+0000 7f8b3c2a2740 1 -- 172.21.15.105:0/1831774252 >> 172.21.15.105:0/1831774252 conn(0x559a023b83c0 msgr2=0x559a0276c260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:27.705 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.700+0000 7f8b3c2a2740 1 -- 172.21.15.105:0/1831774252 shutdown_connections 2024-09-21T03:27:27.705 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.700+0000 7f8b3c2a2740 1 -- 172.21.15.105:0/1831774252 wait complete. 2024-09-21T03:27:27.705 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.701+0000 7f8b3c2a2740 1 -- start start 2024-09-21T03:27:27.705 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.701+0000 7f8b3c2a2740 1 Processor -- start 2024-09-21T03:27:27.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.702+0000 7f8b3c2a2740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559a0239b3b0 0x559a02780430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:27.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.702+0000 7f8b3c2a2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559a023a3590 0x559a027a8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:27.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.702+0000 7f8b3c2a2740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559a023c4270 0x559a027a8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:27.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.703+0000 7f8b3c2a2740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x559a0243e620 con 0x559a0239b3b0 2024-09-21T03:27:27.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.703+0000 7f8b3c2a2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559a026735f0 con 0x559a023a3590 2024-09-21T03:27:27.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.703+0000 7f8b3c2a2740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x559a02796a20 con 0x559a023c4270 2024-09-21T03:27:27.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.703+0000 7f8b3c2a2740 10 client.0 _ll_register_callbacks cb 0x559a026770a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:27:27.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.703+0000 7f8b2effd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559a0239b3b0 0x559a02780430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:27.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.703+0000 7f8b2effd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559a0239b3b0 0x559a02780430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40272/0 (socket says 172.21.15.105:40272) 2024-09-21T03:27:27.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.703+0000 7f8b2effd640 1 -- 172.21.15.105:0/3445014795 learned_addr learned my addr 172.21.15.105:0/3445014795 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:27.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.703+0000 7f8b2e7fc640 1 --2- 172.21.15.105:0/3445014795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559a023a3590 0x559a027a8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:27.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.703+0000 7f8b2f7fe640 1 --2- 172.21.15.105:0/3445014795 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559a023c4270 0x559a027a8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:27.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.703+0000 7f8b2effd640 1 -- 172.21.15.105:0/3445014795 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559a023c4270 msgr2=0x559a027a8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:27:27.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.703+0000 7f8b2effd640 1 --2- 172.21.15.105:0/3445014795 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559a023c4270 0x559a027a8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:27.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.703+0000 7f8b2effd640 1 -- 172.21.15.105:0/3445014795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559a023a3590 msgr2=0x559a027a8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:27:27.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.703+0000 7f8b2effd640 1 --2- 172.21.15.105:0/3445014795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559a023a3590 0x559a027a8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:27.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.703+0000 7f8b2effd640 1 -- 172.21.15.105:0/3445014795 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a024a66b0 con 0x559a0239b3b0 2024-09-21T03:27:27.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.703+0000 7f8b2effd640 1 --2- 172.21.15.105:0/3445014795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559a0239b3b0 0x559a02780430 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f8b20009ca0 tx=0x7f8b200039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cce92f4f0ea07c83 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:27.710 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.703+0000 7f8b0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-21T03:27:27.711 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.703+0000 7f8b0dffb640 1 -- 172.21.15.105:0/3445014795 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b20057020 con 0x559a0239b3b0 2024-09-21T03:27:27.711 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.703+0000 7f8b0dffb640 1 -- 172.21.15.105:0/3445014795 <== mon.0 v2:172.21.15.105:3300/0 2 ==== osd_map(140..140 src has 1..140) ==== 5709+0+0 (secure 0 0 0) 0x7f8b20003b40 con 0x559a0239b3b0 2024-09-21T03:27:27.711 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.703+0000 7f8b3c2a2740 1 -- 172.21.15.105:0/3445014795 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b2004f070 con 0x559a0239b3b0 2024-09-21T03:27:27.711 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.703+0000 7f8b0dffb640 1 -- 172.21.15.105:0/3445014795 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7f8b20061050 con 0x559a0239b3b0 2024-09-21T03:27:27.711 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.703+0000 7f8b3c2a2740 10 client.8589 fetch_fsmap learned FSMap version 95 2024-09-21T03:27:27.711 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.703+0000 7f8b3c2a2740 1 -- 172.21.15.105:0/3445014795 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) -- 0x559a02794160 con 0x559a0239b3b0 2024-09-21T03:27:27.711 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.704+0000 7f8b0dffb640 1 -- 172.21.15.105:0/3445014795 <== mon.0 v2:172.21.15.105:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b2004f070 con 0x559a0239b3b0 2024-09-21T03:27:27.711 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.704+0000 7f8b0dffb640 1 -- 172.21.15.105:0/3445014795 <== mon.0 v2:172.21.15.105:3300/0 5 ==== fsmap(e 95) ==== 3502+0+0 (secure 0 0 0) 0x7f8b20064020 con 0x559a0239b3b0 2024-09-21T03:27:27.711 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.704+0000 7f8b3c2a2740 10 client.8589 fetch_fsmap finished waiting for FSMap version 95 2024-09-21T03:27:27.711 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.704+0000 7f8b3c2a2740 10 client.8589 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T03:27:27.711 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.704+0000 7f8b3c2a2740 20 client.8589 populate_metadata read hostname 'smithi105' 2024-09-21T03:27:27.711 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.704+0000 7f8b3c2a2740 1 --2- 172.21.15.105:0/3445014795 >> [v2:172.21.15.105:6833/1315344000,v1:172.21.15.105:6835/1315344000] conn(0x559a02382e40 0x559a027835e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:27.711 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.704+0000 7f8b3c2a2740 4 client.8589 mds_command: new command op to 8430 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:27:27.712 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.704+0000 7f8b3c2a2740 1 -- 172.21.15.105:0/3445014795 --> [v2:172.21.15.105:6833/1315344000,v1:172.21.15.105:6835/1315344000] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a026e0770 con 0x559a02382e40 2024-09-21T03:27:27.712 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.704+0000 7f8b2e7fc640 1 --2- 172.21.15.105:0/3445014795 >> [v2:172.21.15.105:6833/1315344000,v1:172.21.15.105:6835/1315344000] conn(0x559a02382e40 0x559a027835e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:27.712 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.704+0000 7f8b0dffb640 10 client.8589 ms_handle_connect on v2:172.21.15.105:6833/1315344000 2024-09-21T03:27:27.712 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.704+0000 7f8b2e7fc640 1 --2- 172.21.15.105:0/3445014795 >> [v2:172.21.15.105:6833/1315344000,v1:172.21.15.105:6835/1315344000] conn(0x559a02382e40 0x559a027835e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34c2f835055f97bd server_cookie=7775e92ade682a36 in_seq=0 out_seq=0 2024-09-21T03:27:27.712 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.705+0000 7f8b0dffb640 1 -- 172.21.15.105:0/3445014795 <== mds.0 v2:172.21.15.105:6833/1315344000 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559a026e0770 con 0x559a02382e40 2024-09-21T03:27:27.712 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.705+0000 7f8b0dffb640 10 client.8589 handle_command_reply: tid=0 2024-09-21T03:27:27.712 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.705+0000 7f8b3c2a2740 1 client.8589 shutdown 2024-09-21T03:27:27.712 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.705+0000 7f8b3c2a2740 1 -- 172.21.15.105:0/3445014795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559a0239b3b0 msgr2=0x559a02780430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:27.712 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.705+0000 7f8b3c2a2740 1 --2- 172.21.15.105:0/3445014795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559a0239b3b0 0x559a02780430 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f8b20009ca0 tx=0x7f8b200039d0 comp rx=0 tx=0).stop 2024-09-21T03:27:27.712 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.705+0000 7f8b3c2a2740 1 -- 172.21.15.105:0/3445014795 shutdown_connections 2024-09-21T03:27:27.712 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.705+0000 7f8b3c2a2740 1 --2- 172.21.15.105:0/3445014795 >> [v2:172.21.15.105:6833/1315344000,v1:172.21.15.105:6835/1315344000] conn(0x559a02382e40 0x559a027835e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:27.712 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.705+0000 7f8b3c2a2740 1 --2- 172.21.15.105:0/3445014795 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559a023c4270 0x559a027a8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:27.712 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.705+0000 7f8b3c2a2740 1 --2- 172.21.15.105:0/3445014795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559a023a3590 0x559a027a8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:27.712 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.705+0000 7f8b0dffb640 0 client.8589 ms_handle_reset on v2:172.21.15.105:6833/1315344000 2024-09-21T03:27:27.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.705+0000 7f8b3c2a2740 1 --2- 172.21.15.105:0/3445014795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559a0239b3b0 0x559a02780430 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:27.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.705+0000 7f8b3c2a2740 1 -- 172.21.15.105:0/3445014795 >> 172.21.15.105:0/3445014795 conn(0x559a023b83c0 msgr2=0x559a027b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:27.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.705+0000 7f8b3c2a2740 1 -- 172.21.15.105:0/3445014795 shutdown_connections 2024-09-21T03:27:27.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.705+0000 7f8b3c2a2740 1 -- 172.21.15.105:0/3445014795 wait complete. 2024-09-21T03:27:27.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.706+0000 7f8b3c2a2740 20 client.8589 trim_cache size 0 max 16384 2024-09-21T03:27:27.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.724+0000 7f8b3c2a2740 1 Processor -- start 2024-09-21T03:27:27.726 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.724+0000 7f8b3c2a2740 1 -- start start 2024-09-21T03:27:27.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.725+0000 7f8b3c2a2740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559a0239b3b0 0x559a027815d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:27.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.725+0000 7f8b3c2a2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559a023a3590 0x559a027837b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:27.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.725+0000 7f8b3c2a2740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559a023c4270 0x559a0282ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:27.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.725+0000 7f8b3c2a2740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8b30201280 con 0x559a0239b3b0 2024-09-21T03:27:27.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.725+0000 7f8b3c2a2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8b302005c0 con 0x559a023a3590 2024-09-21T03:27:27.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.725+0000 7f8b3c2a2740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8b30200c10 con 0x559a023c4270 2024-09-21T03:27:27.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.725+0000 7f8b2effd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559a0239b3b0 0x559a027815d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:27.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.725+0000 7f8b2effd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559a0239b3b0 0x559a027815d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40288/0 (socket says 172.21.15.105:40288) 2024-09-21T03:27:27.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.725+0000 7f8b2effd640 1 -- 172.21.15.105:0/2357483437 learned_addr learned my addr 172.21.15.105:0/2357483437 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:27.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.725+0000 7f8b2e7fc640 1 --2- 172.21.15.105:0/2357483437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559a023a3590 0x559a027837b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:27.729 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.725+0000 7f8b2f7fe640 1 --2- 172.21.15.105:0/2357483437 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559a023c4270 0x559a0282ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:27.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.726+0000 7f8b2effd640 1 -- 172.21.15.105:0/2357483437 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559a023c4270 msgr2=0x559a0282ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:27:27.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.726+0000 7f8b2effd640 1 --2- 172.21.15.105:0/2357483437 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559a023c4270 0x559a0282ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:27.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.726+0000 7f8b2effd640 1 -- 172.21.15.105:0/2357483437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559a023a3590 msgr2=0x559a027837b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:27:27.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.726+0000 7f8b2effd640 1 --2- 172.21.15.105:0/2357483437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559a023a3590 0x559a027837b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:27.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.726+0000 7f8b2effd640 1 -- 172.21.15.105:0/2357483437 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a027b2260 con 0x559a0239b3b0 2024-09-21T03:27:27.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.726+0000 7f8b2effd640 1 --2- 172.21.15.105:0/2357483437 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559a0239b3b0 0x559a027815d0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f8b2003e4c0 tx=0x7f8b20004230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21507d25514ec12a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:27.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.726+0000 7f8b0ffff640 1 -- 172.21.15.105:0/2357483437 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b20057040 con 0x559a0239b3b0 2024-09-21T03:27:27.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.726+0000 7f8b0ffff640 1 -- 172.21.15.105:0/2357483437 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b2004f040 con 0x559a0239b3b0 2024-09-21T03:27:27.730 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.726+0000 7f8b0ffff640 1 -- 172.21.15.105:0/2357483437 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b20038070 con 0x559a0239b3b0 2024-09-21T03:27:27.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.727+0000 7f8b3c2a2740 1 -- 172.21.15.105:0/2357483437 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559a0239b3b0 msgr2=0x559a027815d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:27.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.727+0000 7f8b3c2a2740 1 --2- 172.21.15.105:0/2357483437 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559a0239b3b0 0x559a027815d0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f8b2003e4c0 tx=0x7f8b20004230 comp rx=0 tx=0).stop 2024-09-21T03:27:27.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.727+0000 7f8b3c2a2740 1 -- 172.21.15.105:0/2357483437 shutdown_connections 2024-09-21T03:27:27.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.727+0000 7f8b3c2a2740 1 --2- 172.21.15.105:0/2357483437 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559a023c4270 0x559a0282ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:27.731 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.727+0000 7f8b3c2a2740 1 --2- 172.21.15.105:0/2357483437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559a023a3590 0x559a027837b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:27.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.727+0000 7f8b3c2a2740 1 --2- 172.21.15.105:0/2357483437 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559a0239b3b0 0x559a027815d0 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:27.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.727+0000 7f8b3c2a2740 1 -- 172.21.15.105:0/2357483437 >> 172.21.15.105:0/2357483437 conn(0x559a023b83c0 msgr2=0x559a027b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:27.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.727+0000 7f8b3c2a2740 1 -- 172.21.15.105:0/2357483437 shutdown_connections 2024-09-21T03:27:27.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.727+0000 7f8b3c2a2740 1 -- 172.21.15.105:0/2357483437 wait complete. 2024-09-21T03:27:27.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.728+0000 7f8b3c2a2740 1 -- start start 2024-09-21T03:27:27.732 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.728+0000 7f8b3c2a2740 1 Processor -- start 2024-09-21T03:27:27.735 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.729+0000 7f8b3c2a2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559a0239b3b0 0x559a027c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:27.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.729+0000 7f8b3c2a2740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559a023a3590 0x559a02812ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:27.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.729+0000 7f8b3c2a2740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559a023c4270 0x559a027d3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:27.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.729+0000 7f8b3c2a2740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x559a0243e620 con 0x559a023a3590 2024-09-21T03:27:27.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.729+0000 7f8b3c2a2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559a026735f0 con 0x559a0239b3b0 2024-09-21T03:27:27.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.729+0000 7f8b3c2a2740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x559a027c3430 con 0x559a023c4270 2024-09-21T03:27:27.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.729+0000 7f8b3c2a2740 10 client.0 _ll_register_callbacks cb 0x7f8b280093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:27:27.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.729+0000 7f8b2e7fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559a023a3590 0x559a02812ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:27.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.729+0000 7f8b2e7fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559a023a3590 0x559a02812ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40302/0 (socket says 172.21.15.105:40302) 2024-09-21T03:27:27.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.729+0000 7f8b2e7fc640 1 -- 172.21.15.105:0/3908427636 learned_addr learned my addr 172.21.15.105:0/3908427636 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:27.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.729+0000 7f8b2effd640 1 --2- 172.21.15.105:0/3908427636 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559a0239b3b0 0x559a027c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:27.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.729+0000 7f8b2f7fe640 1 --2- 172.21.15.105:0/3908427636 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559a023c4270 0x559a027d3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:27.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.730+0000 7f8b2e7fc640 1 -- 172.21.15.105:0/3908427636 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559a023c4270 msgr2=0x559a027d3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:27:27.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.730+0000 7f8b2e7fc640 1 --2- 172.21.15.105:0/3908427636 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559a023c4270 0x559a027d3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:27.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.730+0000 7f8b2e7fc640 1 -- 172.21.15.105:0/3908427636 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559a0239b3b0 msgr2=0x559a027c9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:27:27.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.730+0000 7f8b2e7fc640 1 --2- 172.21.15.105:0/3908427636 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559a0239b3b0 0x559a027c9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:27.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.730+0000 7f8b2e7fc640 1 -- 172.21.15.105:0/3908427636 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a02819600 con 0x559a023a3590 2024-09-21T03:27:27.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.730+0000 7f8b2e7fc640 1 --2- 172.21.15.105:0/3908427636 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559a023a3590 0x559a02812ce0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f8b18006600 tx=0x7f8b1801c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d60c608734fca9b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:27.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.730+0000 7f8b0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.105:3300/0 2024-09-21T03:27:27.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.730+0000 7f8b0dffb640 1 -- 172.21.15.105:0/3908427636 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1801f040 con 0x559a023a3590 2024-09-21T03:27:27.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.730+0000 7f8b0dffb640 1 -- 172.21.15.105:0/3908427636 <== mon.0 v2:172.21.15.105:3300/0 2 ==== osd_map(140..140 src has 1..140) ==== 5709+0+0 (secure 0 0 0) 0x7f8b1806cce0 con 0x559a023a3590 2024-09-21T03:27:27.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.730+0000 7f8b3c2a2740 1 -- 172.21.15.105:0/3908427636 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b2004f040 con 0x559a023a3590 2024-09-21T03:27:27.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.730+0000 7f8b0dffb640 1 -- 172.21.15.105:0/3908427636 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7f8b180682c0 con 0x559a023a3590 2024-09-21T03:27:27.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.730+0000 7f8b3c2a2740 10 client.8595 fetch_fsmap learned FSMap version 95 2024-09-21T03:27:27.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.730+0000 7f8b3c2a2740 1 -- 172.21.15.105:0/3908427636 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,fsmap=95,monmap=2+}) -- 0x559a02813220 con 0x559a023a3590 2024-09-21T03:27:27.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.730+0000 7f8b0dffb640 1 -- 172.21.15.105:0/3908427636 <== mon.0 v2:172.21.15.105:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b2004f040 con 0x559a023a3590 2024-09-21T03:27:27.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.730+0000 7f8b0dffb640 1 -- 172.21.15.105:0/3908427636 <== mon.0 v2:172.21.15.105:3300/0 5 ==== fsmap(e 95) ==== 3502+0+0 (secure 0 0 0) 0x7f8b180841a0 con 0x559a023a3590 2024-09-21T03:27:27.737 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.730+0000 7f8b3c2a2740 10 client.8595 fetch_fsmap finished waiting for FSMap version 95 2024-09-21T03:27:27.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.730+0000 7f8b3c2a2740 10 client.8595 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T03:27:27.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.730+0000 7f8b3c2a2740 20 client.8595 populate_metadata read hostname 'smithi105' 2024-09-21T03:27:27.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.730+0000 7f8b3c2a2740 1 --2- 172.21.15.105:0/3908427636 >> [v2:172.21.15.105:6833/1315344000,v1:172.21.15.105:6835/1315344000] conn(0x559a02834210 0x559a027a7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:27.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.730+0000 7f8b3c2a2740 4 client.8595 mds_command: new command op to 8430 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T03:27:27.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.730+0000 7f8b3c2a2740 1 -- 172.21.15.105:0/3908427636 --> [v2:172.21.15.105:6833/1315344000,v1:172.21.15.105:6835/1315344000] -- command(tid 0: {"prefix": "status"}) -- 0x559a026dc220 con 0x559a02834210 2024-09-21T03:27:27.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.731+0000 7f8b2effd640 1 --2- 172.21.15.105:0/3908427636 >> [v2:172.21.15.105:6833/1315344000,v1:172.21.15.105:6835/1315344000] conn(0x559a02834210 0x559a027a7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:27.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.731+0000 7f8b0dffb640 10 client.8595 ms_handle_connect on v2:172.21.15.105:6833/1315344000 2024-09-21T03:27:27.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.731+0000 7f8b2effd640 1 --2- 172.21.15.105:0/3908427636 >> [v2:172.21.15.105:6833/1315344000,v1:172.21.15.105:6835/1315344000] conn(0x559a02834210 0x559a027a7b90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa385c3f2b9b16a server_cookie=15679457b0da410c in_seq=0 out_seq=0 2024-09-21T03:27:27.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.731+0000 7f8b0dffb640 1 -- 172.21.15.105:0/3908427636 <== mds.0 v2:172.21.15.105:6833/1315344000 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x559a026dc220 con 0x559a02834210 2024-09-21T03:27:27.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.731+0000 7f8b0dffb640 10 client.8595 handle_command_reply: tid=0 2024-09-21T03:27:27.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.731+0000 7f8b3c2a2740 1 client.8595 shutdown 2024-09-21T03:27:27.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.731+0000 7f8b3c2a2740 1 -- 172.21.15.105:0/3908427636 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559a023a3590 msgr2=0x559a02812ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:27.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.731+0000 7f8b3c2a2740 1 --2- 172.21.15.105:0/3908427636 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559a023a3590 0x559a02812ce0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f8b18006600 tx=0x7f8b1801c040 comp rx=0 tx=0).stop 2024-09-21T03:27:27.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.731+0000 7f8b3c2a2740 1 -- 172.21.15.105:0/3908427636 shutdown_connections 2024-09-21T03:27:27.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.731+0000 7f8b3c2a2740 1 --2- 172.21.15.105:0/3908427636 >> [v2:172.21.15.105:6833/1315344000,v1:172.21.15.105:6835/1315344000] conn(0x559a02834210 0x559a027a7b90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:27.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.731+0000 7f8b3c2a2740 1 --2- 172.21.15.105:0/3908427636 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x559a023c4270 0x559a027d3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:27.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.731+0000 7f8b3c2a2740 1 --2- 172.21.15.105:0/3908427636 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559a023a3590 0x559a02812ce0 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:27.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.731+0000 7f8b0dffb640 0 client.8595 ms_handle_reset on v2:172.21.15.105:6833/1315344000 2024-09-21T03:27:27.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.731+0000 7f8b3c2a2740 1 --2- 172.21.15.105:0/3908427636 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559a0239b3b0 0x559a027c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:27.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.731+0000 7f8b3c2a2740 1 -- 172.21.15.105:0/3908427636 >> 172.21.15.105:0/3908427636 conn(0x559a023b83c0 msgr2=0x559a027b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:27.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.731+0000 7f8b3c2a2740 1 -- 172.21.15.105:0/3908427636 shutdown_connections 2024-09-21T03:27:27.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.732+0000 7f8b3c2a2740 1 -- 172.21.15.105:0/3908427636 wait complete. 2024-09-21T03:27:27.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.732+0000 7f8b3c2a2740 20 client.8595 trim_cache size 0 max 16384 2024-09-21T03:27:27.739 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-21T03:27:27.739 INFO:teuthology.orchestra.run.smithi105.stdout: "cluster_fsid": "29d80f4f-e5de-4b26-8384-24c2d8019945", 2024-09-21T03:27:27.740 INFO:teuthology.orchestra.run.smithi105.stdout: "whoami": 0, 2024-09-21T03:27:27.740 INFO:teuthology.orchestra.run.smithi105.stdout: "id": 8430, 2024-09-21T03:27:27.740 INFO:teuthology.orchestra.run.smithi105.stdout: "want_state": "up:active", 2024-09-21T03:27:27.740 INFO:teuthology.orchestra.run.smithi105.stdout: "state": "up:active", 2024-09-21T03:27:27.740 INFO:teuthology.orchestra.run.smithi105.stdout: "fs_name": "cephfs", 2024-09-21T03:27:27.740 INFO:teuthology.orchestra.run.smithi105.stdout: "rank_uptime": 10.158090283, 2024-09-21T03:27:27.740 INFO:teuthology.orchestra.run.smithi105.stdout: "mdsmap_epoch": 95, 2024-09-21T03:27:27.740 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_epoch": 140, 2024-09-21T03:27:27.740 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_epoch_barrier": 140, 2024-09-21T03:27:27.740 INFO:teuthology.orchestra.run.smithi105.stdout: "uptime": 14.853517231 2024-09-21T03:27:27.740 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-21T03:27:27.741 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.732+0000 7f8b35332640 1 -- 172.21.15.105:0/1340476129 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8b10078b90 msgr2=0x7f8b1007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:27.741 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.732+0000 7f8b35332640 1 --2- 172.21.15.105:0/1340476129 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8b10078b90 0x7f8b1007b0a0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f8b20035000 tx=0x7f8b200046c0 comp rx=0 tx=0).stop 2024-09-21T03:27:27.741 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.732+0000 7f8b35332640 1 -- 172.21.15.105:0/1340476129 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b300c9ec0 msgr2=0x7f8b301f52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:27.741 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.732+0000 7f8b35332640 1 --2- 172.21.15.105:0/1340476129 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b300c9ec0 0x7f8b301f52d0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f8b18006630 tx=0x7f8b180039c0 comp rx=0 tx=0).stop 2024-09-21T03:27:27.741 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.732+0000 7f8b35332640 1 -- 172.21.15.105:0/1340476129 shutdown_connections 2024-09-21T03:27:27.741 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.732+0000 7f8b35332640 1 --2- 172.21.15.105:0/1340476129 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8b10078b90 0x7f8b1007b0a0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:27.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.732+0000 7f8b35332640 1 --2- 172.21.15.105:0/1340476129 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8b301f5810 0x7f8b300ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:27.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.732+0000 7f8b35332640 1 --2- 172.21.15.105:0/1340476129 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b300c9ec0 0x7f8b301f52d0 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:27.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.732+0000 7f8b35332640 1 --2- 172.21.15.105:0/1340476129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b1c003a00 0x7f8b300c9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:27.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.732+0000 7f8b35332640 1 -- 172.21.15.105:0/1340476129 >> 172.21.15.105:0/1340476129 conn(0x7f8b3008bfc0 msgr2=0x7f8b300b5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:27.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.732+0000 7f8b35332640 1 -- 172.21.15.105:0/1340476129 shutdown_connections 2024-09-21T03:27:27.742 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.732+0000 7f8b35332640 1 -- 172.21.15.105:0/1340476129 wait complete. 2024-09-21T03:27:27.746 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T03:27:27.782 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:27:27.791 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:27:27.861 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.858+0000 7f39bb939640 1 -- 172.21.15.105:0/3045174630 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39a0003fd0 msgr2=0x7f39a0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:27.861 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.858+0000 7f39bb939640 1 --2- 172.21.15.105:0/3045174630 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39a0003fd0 0x7f39a0004800 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f39a4009b50 tx=0x7f39a0005830 comp rx=0 tx=0).stop 2024-09-21T03:27:27.862 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.859+0000 7f39b9ed6640 1 -- 172.21.15.105:0/3045174630 reap_dead start 2024-09-21T03:27:27.862 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.859+0000 7f39bb939640 1 -- 172.21.15.105:0/3045174630 shutdown_connections 2024-09-21T03:27:27.862 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.859+0000 7f39bb939640 1 -- 172.21.15.105:0/3045174630 >> 172.21.15.105:0/3045174630 conn(0x7f39b408bfc0 msgr2=0x7f39b409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:27.862 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.859+0000 7f39bb939640 1 -- 172.21.15.105:0/3045174630 shutdown_connections 2024-09-21T03:27:27.862 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.859+0000 7f39bb939640 1 -- 172.21.15.105:0/3045174630 wait complete. 2024-09-21T03:27:27.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.860+0000 7f39bb939640 1 Processor -- start 2024-09-21T03:27:27.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.860+0000 7f39bb939640 1 -- start start 2024-09-21T03:27:27.865 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.862+0000 7f39bb939640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39a0003fd0 0x7f39b415d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:27.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.862+0000 7f39bb939640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39b41f59d0 0x7f39b41f5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:27.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.862+0000 7f39bb939640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39b4161900 0x7f39b4161d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:27.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.862+0000 7f39bb939640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f39b40d2740 con 0x7f39b41f59d0 2024-09-21T03:27:27.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.862+0000 7f39bb939640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f39b40d17b0 con 0x7f39a0003fd0 2024-09-21T03:27:27.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.862+0000 7f39bb939640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f39b40d28c0 con 0x7f39b4161900 2024-09-21T03:27:27.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.862+0000 7f39b8ed4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39b41f59d0 0x7f39b41f5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:27.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.862+0000 7f39b8ed4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39b41f59d0 0x7f39b41f5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40310/0 (socket says 172.21.15.105:40310) 2024-09-21T03:27:27.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.862+0000 7f39b8ed4640 1 -- 172.21.15.105:0/2863355711 learned_addr learned my addr 172.21.15.105:0/2863355711 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:27.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.862+0000 7f39b96d5640 1 --2- 172.21.15.105:0/2863355711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39a0003fd0 0x7f39b415d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:27.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.862+0000 7f39b9ed6640 1 --2- 172.21.15.105:0/2863355711 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39b4161900 0x7f39b4161d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:27.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.862+0000 7f39b8ed4640 1 -- 172.21.15.105:0/2863355711 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39b4161900 msgr2=0x7f39b4161d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:27.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.862+0000 7f39b8ed4640 1 --2- 172.21.15.105:0/2863355711 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39b4161900 0x7f39b4161d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:27.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.862+0000 7f39b8ed4640 1 -- 172.21.15.105:0/2863355711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39a0003fd0 msgr2=0x7f39b415d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:27.866 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.862+0000 7f39b8ed4640 1 --2- 172.21.15.105:0/2863355711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39a0003fd0 0x7f39b415d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:27.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.862+0000 7f39b8ed4640 1 -- 172.21.15.105:0/2863355711 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39b41f69a0 con 0x7f39b41f59d0 2024-09-21T03:27:27.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.862+0000 7f39b8ed4640 1 --2- 172.21.15.105:0/2863355711 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39b41f59d0 0x7f39b41f5de0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f39a4009a70 tx=0x7f39a4033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:27.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.863+0000 7f39a9ffb640 1 -- 172.21.15.105:0/2863355711 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a4038040 con 0x7f39b41f59d0 2024-09-21T03:27:27.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.863+0000 7f39a9ffb640 1 -- 172.21.15.105:0/2863355711 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39a4041070 con 0x7f39b41f59d0 2024-09-21T03:27:27.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.863+0000 7f39bb939640 1 -- 172.21.15.105:0/2863355711 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39b41f66c0 con 0x7f39b41f59d0 2024-09-21T03:27:27.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.863+0000 7f39a9ffb640 1 -- 172.21.15.105:0/2863355711 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a4033d70 con 0x7f39b41f59d0 2024-09-21T03:27:27.867 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.863+0000 7f39bb939640 1 -- 172.21.15.105:0/2863355711 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39b40c97c0 con 0x7f39b41f59d0 2024-09-21T03:27:27.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.864+0000 7f39bb939640 1 -- 172.21.15.105:0/2863355711 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39b40cfb70 con 0x7f39b41f59d0 2024-09-21T03:27:27.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.865+0000 7f39a9ffb640 1 -- 172.21.15.105:0/2863355711 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f39a4046460 con 0x7f39b41f59d0 2024-09-21T03:27:27.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.865+0000 7f39a9ffb640 1 --2- 172.21.15.105:0/2863355711 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3998078b90 0x7f399807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:27.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.865+0000 7f39a9ffb640 1 -- 172.21.15.105:0/2863355711 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5709+0+0 (secure 0 0 0) 0x7f39a40bb960 con 0x7f39b41f59d0 2024-09-21T03:27:27.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.865+0000 7f39b96d5640 1 --2- 172.21.15.105:0/2863355711 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3998078b90 0x7f399807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:27.868 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.866+0000 7f39b96d5640 1 --2- 172.21.15.105:0/2863355711 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3998078b90 0x7f399807b0a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f39b0001010 tx=0x7f39b00011c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:27.872 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:27.870+0000 7f39a9ffb640 1 -- 172.21.15.105:0/2863355711 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f39a40837e0 con 0x7f39b41f59d0 2024-09-21T03:27:28.094 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.092+0000 7f39bb939640 1 -- 172.21.15.105:0/2863355711 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f39b40b1f70 con 0x7f39b41f59d0 2024-09-21T03:27:28.095 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.092+0000 7f39a9ffb640 1 -- 172.21.15.105:0/2863355711 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v95) ==== 53+0+73 (secure 0 0 0) 0x7f39a4088210 con 0x7f39b41f59d0 2024-09-21T03:27:28.095 INFO:teuthology.orchestra.run.smithi105.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T03:27:28.097 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.094+0000 7f39bb939640 1 -- 172.21.15.105:0/2863355711 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3998078b90 msgr2=0x7f399807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:28.097 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.094+0000 7f39bb939640 1 --2- 172.21.15.105:0/2863355711 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3998078b90 0x7f399807b0a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f39b0001010 tx=0x7f39b00011c0 comp rx=0 tx=0).stop 2024-09-21T03:27:28.097 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.094+0000 7f39bb939640 1 -- 172.21.15.105:0/2863355711 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39b41f59d0 msgr2=0x7f39b41f5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:28.097 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.094+0000 7f39bb939640 1 --2- 172.21.15.105:0/2863355711 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39b41f59d0 0x7f39b41f5de0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f39a4009a70 tx=0x7f39a4033670 comp rx=0 tx=0).stop 2024-09-21T03:27:28.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.094+0000 7f39bb939640 1 -- 172.21.15.105:0/2863355711 shutdown_connections 2024-09-21T03:27:28.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.094+0000 7f39bb939640 1 --2- 172.21.15.105:0/2863355711 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f3998078b90 0x7f399807b0a0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:28.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.094+0000 7f39bb939640 1 --2- 172.21.15.105:0/2863355711 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39b4161900 0x7f39b4161d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:28.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.094+0000 7f39bb939640 1 --2- 172.21.15.105:0/2863355711 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39b41f59d0 0x7f39b41f5de0 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:28.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.094+0000 7f39bb939640 1 --2- 172.21.15.105:0/2863355711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39a0003fd0 0x7f39b415d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:28.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.094+0000 7f39bb939640 1 -- 172.21.15.105:0/2863355711 >> 172.21.15.105:0/2863355711 conn(0x7f39b408bfc0 msgr2=0x7f39b40b7680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:28.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.094+0000 7f39bb939640 1 -- 172.21.15.105:0/2863355711 shutdown_connections 2024-09-21T03:27:28.098 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.094+0000 7f39bb939640 1 -- 172.21.15.105:0/2863355711 wait complete. 2024-09-21T03:27:28.108 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T03:27:28.108 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T03:27:28.108 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi105.front.sepia.ceph.com 2024-09-21T03:27:28.108 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T03:27:28.108 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T03:27:28.108 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T03:27:28.108 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T03:27:28.109 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T03:27:28.109 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:27:28.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:27:28.109 DEBUG:teuthology.orchestra.run.smithi105:> ip addr 2024-09-21T03:27:28.124 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T03:27:28.125 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T03:27:28.125 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T03:27:28.125 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:27:28.125 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2024-09-21T03:27:28.125 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:27:28.125 INFO:teuthology.orchestra.run.smithi105.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:27:28.125 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b8 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:27:28.125 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f0 2024-09-21T03:27:28.125 INFO:teuthology.orchestra.run.smithi105.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:27:28.125 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b9 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:27:28.125 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f1 2024-09-21T03:27:28.125 INFO:teuthology.orchestra.run.smithi105.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:27:28.126 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:28 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:27:28.126 INFO:teuthology.orchestra.run.smithi105.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T03:27:28.126 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:29 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:27:28.126 INFO:teuthology.orchestra.run.smithi105.stdout: inet 172.21.15.105/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T03:27:28.126 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft 42259sec preferred_lft 42259sec 2024-09-21T03:27:28.126 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::ec4:7aff:fe8f:d429/64 scope link noprefixroute 2024-09-21T03:27:28.126 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:27:28.126 INFO:teuthology.orchestra.run.smithi105.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T03:27:28.126 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 86:15:ed:f2:4e:d8 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:27:28.126 INFO:teuthology.orchestra.run.smithi105.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T03:27:28.126 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:27:28.126 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::80db:6aff:fece:44c2/64 scope link 2024-09-21T03:27:28.126 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:27:28.127 INFO:teuthology.orchestra.run.smithi105.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:27:28.127 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 86:15:ed:f2:4e:d8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T03:27:28.127 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::8415:edff:fef2:4ed8/64 scope link 2024-09-21T03:27:28.127 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:27:28.127 INFO:teuthology.orchestra.run.smithi105.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:27:28.127 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether a2:e9:7c:d4:c7:c7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T03:27:28.127 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::a0e9:7cff:fed4:c7c7/64 scope link 2024-09-21T03:27:28.127 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:27:28.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:27:28.127 DEBUG:teuthology.orchestra.run.smithi105:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T03:27:28.188 INFO:teuthology.orchestra.run.smithi105.stdout:1 2024-09-21T03:27:28.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:27:28.189 DEBUG:teuthology.orchestra.run.smithi105:> route 2024-09-21T03:27:28.245 INFO:teuthology.orchestra.run.smithi105.stdout:Kernel IP routing table 2024-09-21T03:27:28.246 INFO:teuthology.orchestra.run.smithi105.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T03:27:28.246 INFO:teuthology.orchestra.run.smithi105.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T03:27:28.246 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T03:27:28.246 INFO:teuthology.orchestra.run.smithi105.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T03:27:28.246 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:27:28.246 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-21T03:27:28.246 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T03:27:28.246 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T03:27:28.246 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T03:27:28.246 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-21T03:27:28.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:27:28.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:27:28.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:27:28.375 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-09-21T03:27:28.390 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T03:27:28.390 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T03:27:28.391 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:27:28.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:27:28.391 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set brx.0 up 2024-09-21T03:27:28.456 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:27:28.457 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T03:27:28.512 INFO:teuthology.orchestra.run.smithi105.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:27:28.512 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:27:28.512 DEBUG:teuthology.orchestra.run.smithi105:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T03:27:28.567 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-21T03:27:28.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:27:28.568 DEBUG:teuthology.orchestra.run.smithi105:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:27:28.661 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:27:28.662 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T03:27:28.662 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2024-09-21T03:27:28.672 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:27:28.672 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T03:27:28.672 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2024-09-21T03:27:28.672 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:27:28.672 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:27:28.679 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-21T03:27:28.679 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-21T03:27:28.679 INFO:teuthology.orchestra.run.smithi105.stdout:invalid new device string format 2024-09-21T03:27:28.679 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:27:28.679 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:27:28.679 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-21T03:27:28.679 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-21T03:27:28.679 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=29d80f4f-e5de-4b26-8384-24c2d8019945" will pass to kernel 2024-09-21T03:27:28.679 INFO:teuthology.orchestra.run.smithi105.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T03:27:28.679 INFO:teuthology.orchestra.run.smithi105.stdout: You just mounted a file system that supports labels which does not 2024-09-21T03:27:28.680 INFO:teuthology.orchestra.run.smithi105.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T03:27:28.680 INFO:teuthology.orchestra.run.smithi105.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T03:27:28.680 INFO:teuthology.orchestra.run.smithi105.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T03:27:28.681 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T03:27:28.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:27:28.682 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T03:27:28.711 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:27:28.801 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:27:28.806 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:27:28.815 INFO:teuthology.orchestra.run.smithi105.stdout:client6854 2024-09-21T03:27:28.815 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:27:28.816 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:27:28.832 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T03:27:28.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.982+0000 7fb670607640 1 -- 172.21.15.105:0/371164525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb650004d40 msgr2=0x7fb650005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:28.985 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.982+0000 7fb670607640 1 --2- 172.21.15.105:0/371164525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb650004d40 0x7fb650005150 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fb668073230 tx=0x7fb650005830 comp rx=0 tx=0).stop 2024-09-21T03:27:28.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.982+0000 7fb66eba4640 1 -- 172.21.15.105:0/371164525 reap_dead start 2024-09-21T03:27:28.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.982+0000 7fb670607640 1 -- 172.21.15.105:0/371164525 shutdown_connections 2024-09-21T03:27:28.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.982+0000 7fb670607640 1 -- 172.21.15.105:0/371164525 >> 172.21.15.105:0/371164525 conn(0x7fb6680b2160 msgr2=0x7fb6680b2570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:28.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.983+0000 7fb670607640 1 -- 172.21.15.105:0/371164525 shutdown_connections 2024-09-21T03:27:28.986 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.983+0000 7fb670607640 1 -- 172.21.15.105:0/371164525 wait complete. 2024-09-21T03:27:28.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.984+0000 7fb670607640 1 Processor -- start 2024-09-21T03:27:28.987 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.984+0000 7fb670607640 1 -- start start 2024-09-21T03:27:28.989 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.986+0000 7fb670607640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb650004d40 0x7fb668146aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:28.989 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.986+0000 7fb670607640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6681f2ee0 0x7fb6681f32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:28.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.986+0000 7fb670607640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb668070c50 0x7fb668071060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:28.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.986+0000 7fb670607640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb6680ccb50 con 0x7fb6681f2ee0 2024-09-21T03:27:28.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.986+0000 7fb670607640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb6680cf6f0 con 0x7fb668070c50 2024-09-21T03:27:28.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.986+0000 7fb670607640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb6680b5250 con 0x7fb650004d40 2024-09-21T03:27:28.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.986+0000 7fb66dba2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6681f2ee0 0x7fb6681f32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:28.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.986+0000 7fb66dba2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6681f2ee0 0x7fb6681f32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40328/0 (socket says 172.21.15.105:40328) 2024-09-21T03:27:28.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.986+0000 7fb66dba2640 1 -- 172.21.15.105:0/2551925518 learned_addr learned my addr 172.21.15.105:0/2551925518 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:28.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.986+0000 7fb66eba4640 1 --2- 172.21.15.105:0/2551925518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb668070c50 0x7fb668071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:28.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.986+0000 7fb66e3a3640 1 --2- 172.21.15.105:0/2551925518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb650004d40 0x7fb668146aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:28.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.986+0000 7fb66dba2640 1 -- 172.21.15.105:0/2551925518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb650004d40 msgr2=0x7fb668146aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:28.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.986+0000 7fb66dba2640 1 --2- 172.21.15.105:0/2551925518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb650004d40 0x7fb668146aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:28.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.986+0000 7fb66dba2640 1 -- 172.21.15.105:0/2551925518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb668070c50 msgr2=0x7fb668071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:28.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.986+0000 7fb66dba2640 1 --2- 172.21.15.105:0/2551925518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb668070c50 0x7fb668071060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:28.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.986+0000 7fb66dba2640 1 -- 172.21.15.105:0/2551925518 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6680715a0 con 0x7fb6681f2ee0 2024-09-21T03:27:28.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.986+0000 7fb66e3a3640 1 --2- 172.21.15.105:0/2551925518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb650004d40 0x7fb668146aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:27:28.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.986+0000 7fb66dba2640 1 --2- 172.21.15.105:0/2551925518 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6681f2ee0 0x7fb6681f32f0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fb66815f010 tx=0x7fb65c0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:28.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.986+0000 7fb666ffd640 1 -- 172.21.15.105:0/2551925518 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb65c015070 con 0x7fb6681f2ee0 2024-09-21T03:27:28.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.986+0000 7fb666ffd640 1 -- 172.21.15.105:0/2551925518 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb65c011940 con 0x7fb6681f2ee0 2024-09-21T03:27:28.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.986+0000 7fb670607640 1 -- 172.21.15.105:0/2551925518 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb668146fe0 con 0x7fb6681f2ee0 2024-09-21T03:27:28.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.986+0000 7fb666ffd640 1 -- 172.21.15.105:0/2551925518 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb65c011d90 con 0x7fb6681f2ee0 2024-09-21T03:27:28.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.986+0000 7fb670607640 1 -- 172.21.15.105:0/2551925518 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6680a9530 con 0x7fb6681f2ee0 2024-09-21T03:27:28.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.988+0000 7fb670607640 1 -- 172.21.15.105:0/2551925518 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6680b4670 con 0x7fb6681f2ee0 2024-09-21T03:27:28.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.988+0000 7fb666ffd640 1 -- 172.21.15.105:0/2551925518 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb65c010420 con 0x7fb6681f2ee0 2024-09-21T03:27:28.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.988+0000 7fb666ffd640 1 --2- 172.21.15.105:0/2551925518 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb654078bc0 0x7fb65407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:28.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.989+0000 7fb666ffd640 1 -- 172.21.15.105:0/2551925518 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5709+0+0 (secure 0 0 0) 0x7fb65c09b910 con 0x7fb6681f2ee0 2024-09-21T03:27:28.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.989+0000 7fb66e3a3640 1 --2- 172.21.15.105:0/2551925518 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb654078bc0 0x7fb65407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:28.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.989+0000 7fb66e3a3640 1 --2- 172.21.15.105:0/2551925518 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb654078bc0 0x7fb65407b0d0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fb658005fd0 tx=0x7fb658009500 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:28.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:28.993+0000 7fb666ffd640 1 -- 172.21.15.105:0/2551925518 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb6680715a0 con 0x7fb6681f2ee0 2024-09-21T03:27:29.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:29.205+0000 7fb670607640 1 -- 172.21.15.105:0/2551925518 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb66815e8d0 con 0x7fb6681f2ee0 2024-09-21T03:27:29.208 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:29.206+0000 7fb666ffd640 1 -- 172.21.15.105:0/2551925518 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v95) ==== 53+0+73 (secure 0 0 0) 0x7fb6680ce370 con 0x7fb6681f2ee0 2024-09-21T03:27:29.209 INFO:teuthology.orchestra.run.smithi105.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T03:27:29.211 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:29.208+0000 7fb670607640 1 -- 172.21.15.105:0/2551925518 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb654078bc0 msgr2=0x7fb65407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:29.211 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:29.208+0000 7fb670607640 1 --2- 172.21.15.105:0/2551925518 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb654078bc0 0x7fb65407b0d0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fb658005fd0 tx=0x7fb658009500 comp rx=0 tx=0).stop 2024-09-21T03:27:29.211 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:29.208+0000 7fb670607640 1 -- 172.21.15.105:0/2551925518 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6681f2ee0 msgr2=0x7fb6681f32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:29.211 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:29.208+0000 7fb670607640 1 --2- 172.21.15.105:0/2551925518 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6681f2ee0 0x7fb6681f32f0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fb66815f010 tx=0x7fb65c0039e0 comp rx=0 tx=0).stop 2024-09-21T03:27:29.211 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:29.208+0000 7fb670607640 1 -- 172.21.15.105:0/2551925518 shutdown_connections 2024-09-21T03:27:29.211 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:29.208+0000 7fb670607640 1 --2- 172.21.15.105:0/2551925518 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fb654078bc0 0x7fb65407b0d0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:29.211 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:29.208+0000 7fb670607640 1 --2- 172.21.15.105:0/2551925518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb668070c50 0x7fb668071060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:29.212 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:29.208+0000 7fb670607640 1 --2- 172.21.15.105:0/2551925518 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6681f2ee0 0x7fb6681f32f0 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:29.212 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:29.208+0000 7fb670607640 1 --2- 172.21.15.105:0/2551925518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb650004d40 0x7fb668146aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:29.212 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:29.208+0000 7fb670607640 1 -- 172.21.15.105:0/2551925518 >> 172.21.15.105:0/2551925518 conn(0x7fb6680b2160 msgr2=0x7fb668159c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:29.212 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:29.208+0000 7fb670607640 1 -- 172.21.15.105:0/2551925518 shutdown_connections 2024-09-21T03:27:29.212 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:29.208+0000 7fb670607640 1 -- 172.21.15.105:0/2551925518 wait complete. 2024-09-21T03:27:29.221 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T03:27:29.221 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T03:27:29.221 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2024-09-21T03:27:29.221 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-21T03:27:29.221 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T03:27:29.222 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T03:27:29.222 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T03:27:29.222 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T03:27:29.222 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T03:27:29.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:27:29.222 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2024-09-21T03:27:29.242 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T03:27:29.242 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T03:27:29.242 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T03:27:29.242 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:27:29.242 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-09-21T03:27:29.242 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:27:29.242 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:27:29.242 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:27:29.242 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f0 2024-09-21T03:27:29.242 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:27:29.242 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:27:29.243 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f1 2024-09-21T03:27:29.243 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:27:29.243 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:27:29.243 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T03:27:29.243 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:27:29.243 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T03:27:29.243 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42251sec preferred_lft 42251sec 2024-09-21T03:27:29.243 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::ec4:7aff:fe88:7f41/64 scope link noprefixroute 2024-09-21T03:27:29.243 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:27:29.243 INFO:teuthology.orchestra.run.smithi162.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T03:27:29.243 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 32:ad:10:1b:86:54 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:27:29.243 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T03:27:29.243 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:27:29.243 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::c03a:6bff:febf:f5a9/64 scope link 2024-09-21T03:27:29.244 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:27:29.244 INFO:teuthology.orchestra.run.smithi162.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:27:29.244 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 32:ad:10:1b:86:54 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T03:27:29.244 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::30ad:10ff:fe1b:8654/64 scope link 2024-09-21T03:27:29.244 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:27:29.244 INFO:teuthology.orchestra.run.smithi162.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T03:27:29.244 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 6a:62:2d:53:ae:c0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-21T03:27:29.244 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::6862:2dff:fe53:aec0/64 scope link 2024-09-21T03:27:29.244 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:27:29.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:27:29.245 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T03:27:29.310 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-09-21T03:27:29.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:27:29.312 DEBUG:teuthology.orchestra.run.smithi162:> route 2024-09-21T03:27:29.369 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2024-09-21T03:27:29.369 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T03:27:29.369 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T03:27:29.370 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T03:27:29.370 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T03:27:29.370 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:27:29.370 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-09-21T03:27:29.370 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T03:27:29.370 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T03:27:29.370 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T03:27:29.370 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-09-21T03:27:29.462 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:27:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:27:29.495 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:27:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:27:29.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:27:29.502 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-09-21T03:27:29.517 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-21T03:27:29.517 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-21T03:27:29.517 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T03:27:29.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:27:29.518 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.0 up 2024-09-21T03:27:29.583 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:27:29.583 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-21T03:27:29.640 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-21T03:27:29.640 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:27:29.640 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-21T03:27:29.695 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-21T03:27:29.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:27:29.695 DEBUG:teuthology.orchestra.run.smithi162:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:27:29.789 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:27:29.789 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T03:27:29.789 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-21T03:27:29.800 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:27:29.800 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T03:27:29.801 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-21T03:27:29.801 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:27:29.801 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:27:29.819 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-21T03:27:29.820 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-21T03:27:29.820 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-21T03:27:29.820 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.105:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-21T03:27:29.820 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-21T03:27:29.820 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-21T03:27:29.820 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.105:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-21T03:27:29.820 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=29d80f4f-e5de-4b26-8384-24c2d8019945" will pass to kernel 2024-09-21T03:27:29.821 INFO:teuthology.orchestra.run.smithi162.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-21T03:27:29.821 INFO:teuthology.orchestra.run.smithi162.stdout: You just mounted a file system that supports labels which does not 2024-09-21T03:27:29.821 INFO:teuthology.orchestra.run.smithi162.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T03:27:29.821 INFO:teuthology.orchestra.run.smithi162.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T03:27:29.821 INFO:teuthology.orchestra.run.smithi162.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T03:27:29.822 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T03:27:29.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:27:29.822 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-21T03:27:29.847 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:27:29.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:27:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:27:29.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-21T03:27:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:27:29.943 INFO:teuthology.orchestra.run.smithi162.stdout:client8610 2024-09-21T03:27:29.944 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:27:29.944 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:27:29.959 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T03:27:29.959 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T03:27:30.009 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T03:27:30.053 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T03:27:30.053 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T03:27:30.053 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:27:30.053 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:27:30.070 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:27:30.071 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:27:30.126 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T03:27:30.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.277+0000 7f95dd924640 1 -- 172.21.15.105:0/576408933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95c4005350 msgr2=0x7f95c400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:30.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.277+0000 7f95dd924640 1 --2- 172.21.15.105:0/576408933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95c4005350 0x7f95c400b9c0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f95c8006fa0 tx=0x7f95c4005830 comp rx=0 tx=0).stop 2024-09-21T03:27:30.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.277+0000 7f95dd924640 1 -- 172.21.15.105:0/576408933 shutdown_connections 2024-09-21T03:27:30.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.277+0000 7f95dd924640 1 --2- 172.21.15.105:0/576408933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95c4005350 0x7f95c400b9c0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:30.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.277+0000 7f95dd924640 1 -- 172.21.15.105:0/576408933 >> 172.21.15.105:0/576408933 conn(0x7f95d806d7d0 msgr2=0x7f95d80b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:30.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.277+0000 7f95dd924640 1 -- 172.21.15.105:0/576408933 shutdown_connections 2024-09-21T03:27:30.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.277+0000 7f95dd924640 1 -- 172.21.15.105:0/576408933 wait complete. 2024-09-21T03:27:30.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.279+0000 7f95dd924640 1 Processor -- start 2024-09-21T03:27:30.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.279+0000 7f95dd924640 1 -- start start 2024-09-21T03:27:30.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.280+0000 7f95dd924640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95c4005350 0x7f95d815d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:30.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.280+0000 7f95dd924640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95d80b1520 0x7f95d81f63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:30.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.280+0000 7f95dd924640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95d815e660 0x7f95d815ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:30.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.280+0000 7f95dd924640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f95d80b3b40 con 0x7f95d815e660 2024-09-21T03:27:30.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.280+0000 7f95dd924640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f95d80b39c0 con 0x7f95c4005350 2024-09-21T03:27:30.284 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.280+0000 7f95dd924640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f95d80b3cc0 con 0x7f95d80b1520 2024-09-21T03:27:30.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.280+0000 7f95d77fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95d815e660 0x7f95d815ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:30.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.280+0000 7f95d77fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95d815e660 0x7f95d815ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40346/0 (socket says 172.21.15.105:40346) 2024-09-21T03:27:30.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.280+0000 7f95d77fe640 1 -- 172.21.15.105:0/4141186 learned_addr learned my addr 172.21.15.105:0/4141186 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:30.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.280+0000 7f95d6ffd640 1 --2- 172.21.15.105:0/4141186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95c4005350 0x7f95d815d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:30.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.280+0000 7f95d67fc640 1 --2- 172.21.15.105:0/4141186 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95d80b1520 0x7f95d81f63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:30.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.281+0000 7f95d77fe640 1 -- 172.21.15.105:0/4141186 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95d80b1520 msgr2=0x7f95d81f63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:30.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.281+0000 7f95d77fe640 1 --2- 172.21.15.105:0/4141186 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95d80b1520 0x7f95d81f63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:30.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.281+0000 7f95d77fe640 1 -- 172.21.15.105:0/4141186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95c4005350 msgr2=0x7f95d815d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:30.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.281+0000 7f95d77fe640 1 --2- 172.21.15.105:0/4141186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95c4005350 0x7f95d815d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:30.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.281+0000 7f95d77fe640 1 -- 172.21.15.105:0/4141186 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95d81f3820 con 0x7f95d815e660 2024-09-21T03:27:30.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.281+0000 7f95d77fe640 1 --2- 172.21.15.105:0/4141186 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95d815e660 0x7f95d815ea70 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f95c800c320 tx=0x7f95c8006c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:30.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.281+0000 7f95cffff640 1 -- 172.21.15.105:0/4141186 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c8032030 con 0x7f95d815e660 2024-09-21T03:27:30.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.281+0000 7f95cffff640 1 -- 172.21.15.105:0/4141186 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95c803b070 con 0x7f95d815e660 2024-09-21T03:27:30.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.281+0000 7f95cffff640 1 -- 172.21.15.105:0/4141186 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c8003b80 con 0x7f95d815e660 2024-09-21T03:27:30.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.281+0000 7f95dd924640 1 -- 172.21.15.105:0/4141186 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95d815efb0 con 0x7f95d815e660 2024-09-21T03:27:30.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.281+0000 7f95dd924640 1 -- 172.21.15.105:0/4141186 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95d81f3d70 con 0x7f95d815e660 2024-09-21T03:27:30.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.282+0000 7f95dd924640 1 -- 172.21.15.105:0/4141186 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95d8072ff0 con 0x7f95d815e660 2024-09-21T03:27:30.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.283+0000 7f95cffff640 1 -- 172.21.15.105:0/4141186 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f95c803d020 con 0x7f95d815e660 2024-09-21T03:27:30.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.283+0000 7f95cffff640 1 --2- 172.21.15.105:0/4141186 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f95b8078bc0 0x7f95b807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:30.286 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.283+0000 7f95cffff640 1 -- 172.21.15.105:0/4141186 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5709+0+0 (secure 0 0 0) 0x7f95c80ba5d0 con 0x7f95d815e660 2024-09-21T03:27:30.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.284+0000 7f95d6ffd640 1 --2- 172.21.15.105:0/4141186 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f95b8078bc0 0x7f95b807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:30.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.284+0000 7f95d6ffd640 1 --2- 172.21.15.105:0/4141186 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f95b8078bc0 0x7f95b807b0d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f95d0006180 tx=0x7f95d0006ef0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:30.290 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.289+0000 7f95cffff640 1 -- 172.21.15.105:0/4141186 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f95c8046030 con 0x7f95d815e660 2024-09-21T03:27:30.478 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.476+0000 7f95dd924640 1 -- 172.21.15.105:0/4141186 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f95d815d8d0 con 0x7f95d815e660 2024-09-21T03:27:30.479 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.476+0000 7f95cffff640 1 -- 172.21.15.105:0/4141186 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v140) ==== 80+0+0 (secure 0 0 0) 0x7f95d815efb0 con 0x7f95d815e660 2024-09-21T03:27:30.479 INFO:teuthology.orchestra.run.smithi105.stderr:listed 0 entries 2024-09-21T03:27:30.481 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.479+0000 7f95dd924640 1 -- 172.21.15.105:0/4141186 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f95b8078bc0 msgr2=0x7f95b807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:30.481 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.479+0000 7f95dd924640 1 --2- 172.21.15.105:0/4141186 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f95b8078bc0 0x7f95b807b0d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f95d0006180 tx=0x7f95d0006ef0 comp rx=0 tx=0).stop 2024-09-21T03:27:30.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.479+0000 7f95dd924640 1 -- 172.21.15.105:0/4141186 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95d815e660 msgr2=0x7f95d815ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:30.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.479+0000 7f95dd924640 1 --2- 172.21.15.105:0/4141186 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95d815e660 0x7f95d815ea70 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f95c800c320 tx=0x7f95c8006c60 comp rx=0 tx=0).stop 2024-09-21T03:27:30.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.479+0000 7f95dd924640 1 -- 172.21.15.105:0/4141186 shutdown_connections 2024-09-21T03:27:30.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.479+0000 7f95dd924640 1 --2- 172.21.15.105:0/4141186 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f95b8078bc0 0x7f95b807b0d0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:30.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.479+0000 7f95dd924640 1 --2- 172.21.15.105:0/4141186 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95d815e660 0x7f95d815ea70 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:30.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.479+0000 7f95dd924640 1 --2- 172.21.15.105:0/4141186 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95d80b1520 0x7f95d81f63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:30.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.479+0000 7f95dd924640 1 --2- 172.21.15.105:0/4141186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95c4005350 0x7f95d815d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:30.483 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.479+0000 7f95dd924640 1 -- 172.21.15.105:0/4141186 >> 172.21.15.105:0/4141186 conn(0x7f95d806d7d0 msgr2=0x7f95d8074430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:30.483 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.479+0000 7f95dd924640 1 -- 172.21.15.105:0/4141186 shutdown_connections 2024-09-21T03:27:30.483 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.479+0000 7f95dd924640 1 -- 172.21.15.105:0/4141186 wait complete. 2024-09-21T03:27:30.492 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T03:27:30.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:27:30.492 DEBUG:teuthology.orchestra.run.smithi105:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T03:27:30.520 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi105.front.sepia.ceph.com 2024-09-21T03:27:30.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:27:30.520 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T03:27:30.576 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T03:27:30.576 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:27:30.576 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:27:30.593 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:27:30.594 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:27:30.650 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T03:27:30.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.761+0000 7f6c644bd640 1 -- 172.21.15.105:0/1749155528 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c5c0cf7a0 msgr2=0x7f6c5c169a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:30.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.761+0000 7f6c644bd640 1 --2- 172.21.15.105:0/1749155528 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c5c0cf7a0 0x7f6c5c169a10 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f6c54005fd0 tx=0x7f6c5402a940 comp rx=0 tx=0).stop 2024-09-21T03:27:30.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.761+0000 7f6c644bd640 1 -- 172.21.15.105:0/1749155528 shutdown_connections 2024-09-21T03:27:30.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.761+0000 7f6c644bd640 1 --2- 172.21.15.105:0/1749155528 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c5c0cf7a0 0x7f6c5c169a10 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:30.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.761+0000 7f6c644bd640 1 -- 172.21.15.105:0/1749155528 >> 172.21.15.105:0/1749155528 conn(0x7f6c5c08bfc0 msgr2=0x7f6c5c09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:30.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.761+0000 7f6c644bd640 1 -- 172.21.15.105:0/1749155528 shutdown_connections 2024-09-21T03:27:30.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.761+0000 7f6c644bd640 1 -- 172.21.15.105:0/1749155528 wait complete. 2024-09-21T03:27:30.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.763+0000 7f6c644bd640 1 Processor -- start 2024-09-21T03:27:30.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.763+0000 7f6c644bd640 1 -- start start 2024-09-21T03:27:30.767 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.764+0000 7f6c644bd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c5c0cf7a0 0x7f6c5c15c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:30.767 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.764+0000 7f6c644bd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c5c0d1a80 0x7f6c5c0b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:30.767 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.764+0000 7f6c644bd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c5c0d2ed0 0x7f6c5c0b5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:30.767 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.764+0000 7f6c644bd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6c5c16a0d0 con 0x7f6c5c0d2ed0 2024-09-21T03:27:30.768 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.764+0000 7f6c644bd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6c5c169f50 con 0x7f6c5c0cf7a0 2024-09-21T03:27:30.768 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.764+0000 7f6c644bd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6c5c16a250 con 0x7f6c5c0d1a80 2024-09-21T03:27:30.768 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.765+0000 7f6c62a5a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c5c0d2ed0 0x7f6c5c0b5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:30.768 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.765+0000 7f6c62a5a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c5c0d2ed0 0x7f6c5c0b5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40356/0 (socket says 172.21.15.105:40356) 2024-09-21T03:27:30.768 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.765+0000 7f6c62a5a640 1 -- 172.21.15.105:0/79129407 learned_addr learned my addr 172.21.15.105:0/79129407 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:30.768 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.765+0000 7f6c62259640 1 --2- 172.21.15.105:0/79129407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c5c0cf7a0 0x7f6c5c15c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:30.768 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.765+0000 7f6c61a58640 1 --2- 172.21.15.105:0/79129407 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c5c0d1a80 0x7f6c5c0b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:30.768 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.765+0000 7f6c62a5a640 1 -- 172.21.15.105:0/79129407 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c5c0d1a80 msgr2=0x7f6c5c0b4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:30.768 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.765+0000 7f6c62a5a640 1 --2- 172.21.15.105:0/79129407 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c5c0d1a80 0x7f6c5c0b4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:30.768 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.765+0000 7f6c62a5a640 1 -- 172.21.15.105:0/79129407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c5c0cf7a0 msgr2=0x7f6c5c15c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:30.768 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.765+0000 7f6c62a5a640 1 --2- 172.21.15.105:0/79129407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c5c0cf7a0 0x7f6c5c15c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:30.768 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.765+0000 7f6c62a5a640 1 -- 172.21.15.105:0/79129407 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c5c1f9420 con 0x7f6c5c0d2ed0 2024-09-21T03:27:30.768 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.765+0000 7f6c62a5a640 1 --2- 172.21.15.105:0/79129407 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c5c0d2ed0 0x7f6c5c0b5170 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f6c54009cd0 tx=0x7f6c54031e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:30.768 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.765+0000 7f6c52ffd640 1 -- 172.21.15.105:0/79129407 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5403e070 con 0x7f6c5c0d2ed0 2024-09-21T03:27:30.769 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.765+0000 7f6c52ffd640 1 -- 172.21.15.105:0/79129407 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c54004540 con 0x7f6c5c0d2ed0 2024-09-21T03:27:30.769 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.765+0000 7f6c644bd640 1 -- 172.21.15.105:0/79129407 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c5c1f9700 con 0x7f6c5c0d2ed0 2024-09-21T03:27:30.769 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.765+0000 7f6c52ffd640 1 -- 172.21.15.105:0/79129407 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c54043460 con 0x7f6c5c0d2ed0 2024-09-21T03:27:30.769 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.765+0000 7f6c644bd640 1 -- 172.21.15.105:0/79129407 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c5c1f9cc0 con 0x7f6c5c0d2ed0 2024-09-21T03:27:30.769 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.766+0000 7f6c644bd640 1 -- 172.21.15.105:0/79129407 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c5c0d3cf0 con 0x7f6c5c0d2ed0 2024-09-21T03:27:30.769 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.767+0000 7f6c52ffd640 1 -- 172.21.15.105:0/79129407 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6c54043600 con 0x7f6c5c0d2ed0 2024-09-21T03:27:30.770 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.767+0000 7f6c52ffd640 1 --2- 172.21.15.105:0/79129407 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6c40078bc0 0x7f6c4007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:30.770 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.768+0000 7f6c52ffd640 1 -- 172.21.15.105:0/79129407 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5709+0+0 (secure 0 0 0) 0x7f6c540bca50 con 0x7f6c5c0d2ed0 2024-09-21T03:27:30.770 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.768+0000 7f6c62259640 1 --2- 172.21.15.105:0/79129407 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6c40078bc0 0x7f6c4007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:30.770 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.768+0000 7f6c62259640 1 --2- 172.21.15.105:0/79129407 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6c40078bc0 0x7f6c4007b0d0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f6c58007a50 tx=0x7f6c58009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:30.773 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.771+0000 7f6c52ffd640 1 -- 172.21.15.105:0/79129407 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6c54085090 con 0x7f6c5c0d2ed0 2024-09-21T03:27:30.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.962+0000 7f6c644bd640 1 -- 172.21.15.105:0/79129407 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6c5c0cf090 con 0x7f6c5c0d2ed0 2024-09-21T03:27:30.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.962+0000 7f6c52ffd640 1 -- 172.21.15.105:0/79129407 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v140) ==== 80+0+0 (secure 0 0 0) 0x7f6c54084990 con 0x7f6c5c0d2ed0 2024-09-21T03:27:30.964 INFO:teuthology.orchestra.run.smithi105.stderr:listed 0 entries 2024-09-21T03:27:30.966 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.964+0000 7f6c644bd640 1 -- 172.21.15.105:0/79129407 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6c40078bc0 msgr2=0x7f6c4007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:30.966 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.964+0000 7f6c644bd640 1 --2- 172.21.15.105:0/79129407 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6c40078bc0 0x7f6c4007b0d0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f6c58007a50 tx=0x7f6c58009040 comp rx=0 tx=0).stop 2024-09-21T03:27:30.966 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.964+0000 7f6c644bd640 1 -- 172.21.15.105:0/79129407 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c5c0d2ed0 msgr2=0x7f6c5c0b5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:30.966 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.964+0000 7f6c644bd640 1 --2- 172.21.15.105:0/79129407 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c5c0d2ed0 0x7f6c5c0b5170 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f6c54009cd0 tx=0x7f6c54031e20 comp rx=0 tx=0).stop 2024-09-21T03:27:30.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.964+0000 7f6c644bd640 1 -- 172.21.15.105:0/79129407 shutdown_connections 2024-09-21T03:27:30.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.964+0000 7f6c644bd640 1 --2- 172.21.15.105:0/79129407 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6c40078bc0 0x7f6c4007b0d0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:30.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.964+0000 7f6c644bd640 1 --2- 172.21.15.105:0/79129407 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c5c0d2ed0 0x7f6c5c0b5170 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:30.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.964+0000 7f6c644bd640 1 --2- 172.21.15.105:0/79129407 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c5c0d1a80 0x7f6c5c0b4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:30.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.964+0000 7f6c644bd640 1 --2- 172.21.15.105:0/79129407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c5c0cf7a0 0x7f6c5c15c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:30.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.964+0000 7f6c644bd640 1 -- 172.21.15.105:0/79129407 >> 172.21.15.105:0/79129407 conn(0x7f6c5c08bfc0 msgr2=0x7f6c5c0b10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:30.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.964+0000 7f6c644bd640 1 -- 172.21.15.105:0/79129407 shutdown_connections 2024-09-21T03:27:30.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:30.964+0000 7f6c644bd640 1 -- 172.21.15.105:0/79129407 wait complete. 2024-09-21T03:27:30.977 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-21T03:27:30.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:27:30.977 DEBUG:teuthology.orchestra.run.smithi162:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-21T03:27:31.006 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2024-09-21T03:27:31.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:27:31.007 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-21T03:27:31.062 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T03:27:31.062 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:27:31.062 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:27:31.078 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T03:27:31.078 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T03:27:31.078 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:27:31.079 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:27:31.118 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=452 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T03:27:31.118 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:27:31.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.229+0000 7f05aded3640 1 -- 172.21.15.105:0/761107074 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05a80cad30 msgr2=0x7f05a806ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:31.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.229+0000 7f05aded3640 1 --2- 172.21.15.105:0/761107074 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05a80cad30 0x7f05a806ffa0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f05a80c71a0 tx=0x7f059002a530 comp rx=0 tx=0).stop 2024-09-21T03:27:31.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.229+0000 7f05aded3640 1 -- 172.21.15.105:0/761107074 shutdown_connections 2024-09-21T03:27:31.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.229+0000 7f05aded3640 1 --2- 172.21.15.105:0/761107074 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05a80cad30 0x7f05a806ffa0 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:31.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.229+0000 7f05aded3640 1 --2- 172.21.15.105:0/761107074 >> v2:172.21.15.162:3300/0 conn(0x7f05a80ca800 0x7f05a80cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:31.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.229+0000 7f05aded3640 1 -- 172.21.15.105:0/761107074 >> 172.21.15.105:0/761107074 conn(0x7f05a80b1cb0 msgr2=0x7f05a80b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:31.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.229+0000 7f05aded3640 1 -- 172.21.15.105:0/761107074 shutdown_connections 2024-09-21T03:27:31.231 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.229+0000 7f05aded3640 1 -- 172.21.15.105:0/761107074 wait complete. 2024-09-21T03:27:31.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.231+0000 7f05aded3640 1 Processor -- start 2024-09-21T03:27:31.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.231+0000 7f05aded3640 1 -- start start 2024-09-21T03:27:31.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.232+0000 7f05aded3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05a80704e0 0x7f05a814de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:31.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.232+0000 7f05aded3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05a80ca800 0x7f05a8150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:31.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.232+0000 7f05aded3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05a80cad30 0x7f05a815e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:31.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.232+0000 7f05aded3640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f05a80ccf40 con 0x7f05a80704e0 2024-09-21T03:27:31.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.232+0000 7f05aded3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f05a8074810 con 0x7f05a80cad30 2024-09-21T03:27:31.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.232+0000 7f05aded3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f05a80cd0c0 con 0x7f05a80ca800 2024-09-21T03:27:31.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.232+0000 7f05a77fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05a80704e0 0x7f05a814de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:31.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.232+0000 7f05a77fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05a80704e0 0x7f05a814de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40366/0 (socket says 172.21.15.105:40366) 2024-09-21T03:27:31.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.232+0000 7f05a77fe640 1 -- 172.21.15.105:0/2414426557 learned_addr learned my addr 172.21.15.105:0/2414426557 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:31.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.233+0000 7f05a7fff640 1 --2- 172.21.15.105:0/2414426557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05a80cad30 0x7f05a815e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:31.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.233+0000 7f05a6ffd640 1 --2- 172.21.15.105:0/2414426557 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05a80ca800 0x7f05a8150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:31.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.233+0000 7f05a77fe640 1 -- 172.21.15.105:0/2414426557 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05a80ca800 msgr2=0x7f05a8150ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:31.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.233+0000 7f05a77fe640 1 --2- 172.21.15.105:0/2414426557 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05a80ca800 0x7f05a8150ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:31.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.233+0000 7f05a77fe640 1 -- 172.21.15.105:0/2414426557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05a80cad30 msgr2=0x7f05a815e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:31.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.233+0000 7f05a77fe640 1 --2- 172.21.15.105:0/2414426557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05a80cad30 0x7f05a815e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:31.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.233+0000 7f05a77fe640 1 -- 172.21.15.105:0/2414426557 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a8151530 con 0x7f05a80704e0 2024-09-21T03:27:31.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.233+0000 7f05a6ffd640 1 --2- 172.21.15.105:0/2414426557 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05a80ca800 0x7f05a8150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:27:31.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.233+0000 7f05a77fe640 1 --2- 172.21.15.105:0/2414426557 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05a80704e0 0x7f05a814de70 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f0598009270 tx=0x7f059800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:31.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.233+0000 7f059ffff640 1 -- 172.21.15.105:0/2414426557 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0598016070 con 0x7f05a80704e0 2024-09-21T03:27:31.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.233+0000 7f059ffff640 1 -- 172.21.15.105:0/2414426557 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f059800c970 con 0x7f05a80704e0 2024-09-21T03:27:31.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.233+0000 7f059ffff640 1 -- 172.21.15.105:0/2414426557 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059800cdc0 con 0x7f05a80704e0 2024-09-21T03:27:31.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.233+0000 7f05aded3640 1 -- 172.21.15.105:0/2414426557 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05a80c67e0 con 0x7f05a80704e0 2024-09-21T03:27:31.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.233+0000 7f05aded3640 1 -- 172.21.15.105:0/2414426557 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05a809c180 con 0x7f05a80704e0 2024-09-21T03:27:31.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.234+0000 7f05aded3640 1 -- 172.21.15.105:0/2414426557 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05a80cd5e0 con 0x7f05a80704e0 2024-09-21T03:27:31.238 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.235+0000 7f059ffff640 1 -- 172.21.15.105:0/2414426557 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0598019070 con 0x7f05a80704e0 2024-09-21T03:27:31.238 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.235+0000 7f059ffff640 1 --2- 172.21.15.105:0/2414426557 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0588078bc0 0x7f058807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:31.238 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.236+0000 7f059ffff640 1 -- 172.21.15.105:0/2414426557 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5709+0+0 (secure 0 0 0) 0x7f059809b3e0 con 0x7f05a80704e0 2024-09-21T03:27:31.238 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.236+0000 7f05a6ffd640 1 --2- 172.21.15.105:0/2414426557 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0588078bc0 0x7f058807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:31.238 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.236+0000 7f05a6ffd640 1 --2- 172.21.15.105:0/2414426557 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0588078bc0 0x7f058807b0d0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f0590034000 tx=0x7f0590004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:31.242 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.240+0000 7f059ffff640 1 -- 172.21.15.105:0/2414426557 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f05a8151530 con 0x7f05a80704e0 2024-09-21T03:27:31.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.454+0000 7f05aded3640 1 -- 172.21.15.105:0/2414426557 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f05a80b18d0 con 0x7f05a80704e0 2024-09-21T03:27:31.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.455+0000 7f059ffff640 1 -- 172.21.15.105:0/2414426557 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5239 (secure 0 0 0) 0x7f0598063270 con 0x7f05a80704e0 2024-09-21T03:27:31.456 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:27:31.457 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":95,"btime":"2024-09-21T03:27:20:587314+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6752,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/1488182977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1488182977},{"type":"v1","addr":"172.21.15.162:6836","nonce":1488182977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":6755,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/2107181663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2107181663},{"type":"v1","addr":"172.21.15.162:6837","nonce":2107181663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":8427,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/3833164666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3833164666},{"type":"v1","addr":"172.21.15.105:6834","nonce":3833164666}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:27:16.932383+0000","modified":"2024-09-21T03:27:19.949827+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8430":{"gid":8430,"name":"a","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1315344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":1315344000},{"type":"v1","addr":"172.21.15.105:6835","nonce":1315344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8430,"qdb_cluster":[8430]},"id":11}]} 2024-09-21T03:27:31.457 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 95 2024-09-21T03:27:31.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.457+0000 7f05aded3640 1 -- 172.21.15.105:0/2414426557 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0588078bc0 msgr2=0x7f058807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:31.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.457+0000 7f05aded3640 1 --2- 172.21.15.105:0/2414426557 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0588078bc0 0x7f058807b0d0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f0590034000 tx=0x7f0590004730 comp rx=0 tx=0).stop 2024-09-21T03:27:31.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.457+0000 7f05aded3640 1 -- 172.21.15.105:0/2414426557 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05a80704e0 msgr2=0x7f05a814de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:31.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.457+0000 7f05aded3640 1 --2- 172.21.15.105:0/2414426557 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05a80704e0 0x7f05a814de70 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f0598009270 tx=0x7f059800ee80 comp rx=0 tx=0).stop 2024-09-21T03:27:31.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.457+0000 7f05aded3640 1 -- 172.21.15.105:0/2414426557 shutdown_connections 2024-09-21T03:27:31.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.457+0000 7f05aded3640 1 --2- 172.21.15.105:0/2414426557 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f0588078bc0 0x7f058807b0d0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:31.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.457+0000 7f05aded3640 1 --2- 172.21.15.105:0/2414426557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05a80cad30 0x7f05a815e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:31.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.457+0000 7f05aded3640 1 --2- 172.21.15.105:0/2414426557 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f05a80ca800 0x7f05a8150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:31.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.457+0000 7f05aded3640 1 --2- 172.21.15.105:0/2414426557 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05a80704e0 0x7f05a814de70 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:31.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.457+0000 7f05aded3640 1 -- 172.21.15.105:0/2414426557 >> 172.21.15.105:0/2414426557 conn(0x7f05a80b1cb0 msgr2=0x7f05a80cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:31.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.457+0000 7f05aded3640 1 -- 172.21.15.105:0/2414426557 shutdown_connections 2024-09-21T03:27:31.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.457+0000 7f05aded3640 1 -- 172.21.15.105:0/2414426557 wait complete. 2024-09-21T03:27:31.470 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:27:31.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.580+0000 7f96e6a4a640 1 -- 172.21.15.105:0/2406513103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96e015c6f0 msgr2=0x7f96e00ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:31.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.580+0000 7f96e6a4a640 1 --2- 172.21.15.105:0/2406513103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96e015c6f0 0x7f96e00ceb50 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f96e0070810 tx=0x7f96d402a5f0 comp rx=0 tx=0).stop 2024-09-21T03:27:31.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.580+0000 7f96e6a4a640 1 -- 172.21.15.105:0/2406513103 shutdown_connections 2024-09-21T03:27:31.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.580+0000 7f96e6a4a640 1 --2- 172.21.15.105:0/2406513103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96e015c6f0 0x7f96e00ceb50 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:31.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.580+0000 7f96e6a4a640 1 --2- 172.21.15.105:0/2406513103 >> v2:172.21.15.162:3300/0 conn(0x7f96e00d1d40 0x7f96e00b5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:31.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.580+0000 7f96e6a4a640 1 -- 172.21.15.105:0/2406513103 >> 172.21.15.105:0/2406513103 conn(0x7f96e00b3f10 msgr2=0x7f96e00b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:31.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.580+0000 7f96e6a4a640 1 -- 172.21.15.105:0/2406513103 shutdown_connections 2024-09-21T03:27:31.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.580+0000 7f96e6a4a640 1 -- 172.21.15.105:0/2406513103 wait complete. 2024-09-21T03:27:31.583 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.582+0000 7f96e6a4a640 1 Processor -- start 2024-09-21T03:27:31.583 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.582+0000 7f96e6a4a640 1 -- start start 2024-09-21T03:27:31.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.583+0000 7f96e6a4a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96e00ccba0 0x7f96e00cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:31.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.583+0000 7f96e6a4a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96e00d1d40 0x7f96e015f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:31.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.583+0000 7f96e6a4a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96e015c6f0 0x7f96e0157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:31.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.583+0000 7f96e6a4a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f96e00d11f0 con 0x7f96e00ccba0 2024-09-21T03:27:31.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.583+0000 7f96e6a4a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f96e00d1070 con 0x7f96e00d1d40 2024-09-21T03:27:31.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.583+0000 7f96e6a4a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f96e00d1370 con 0x7f96e015c6f0 2024-09-21T03:27:31.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.583+0000 7f96dffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96e00ccba0 0x7f96e00cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:31.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.583+0000 7f96dffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96e00ccba0 0x7f96e00cb5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42048/0 (socket says 172.21.15.105:42048) 2024-09-21T03:27:31.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.583+0000 7f96dffff640 1 -- 172.21.15.105:0/2726546026 learned_addr learned my addr 172.21.15.105:0/2726546026 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:31.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.583+0000 7f96df7fe640 1 --2- 172.21.15.105:0/2726546026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96e00d1d40 0x7f96e015f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:31.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.583+0000 7f96e4fe7640 1 --2- 172.21.15.105:0/2726546026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96e015c6f0 0x7f96e0157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:31.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.583+0000 7f96dffff640 1 -- 172.21.15.105:0/2726546026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96e015c6f0 msgr2=0x7f96e0157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:31.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.583+0000 7f96dffff640 1 --2- 172.21.15.105:0/2726546026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96e015c6f0 0x7f96e0157de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:31.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.583+0000 7f96dffff640 1 -- 172.21.15.105:0/2726546026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96e00d1d40 msgr2=0x7f96e015f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:31.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.584+0000 7f96dffff640 1 --2- 172.21.15.105:0/2726546026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96e00d1d40 0x7f96e015f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:31.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.584+0000 7f96dffff640 1 -- 172.21.15.105:0/2726546026 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e01f6980 con 0x7f96e00ccba0 2024-09-21T03:27:31.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.584+0000 7f96dffff640 1 --2- 172.21.15.105:0/2726546026 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96e00ccba0 0x7f96e00cb5b0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f96d000d750 tx=0x7f96d000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:31.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.584+0000 7f96dcff9640 1 -- 172.21.15.105:0/2726546026 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d0017070 con 0x7f96e00ccba0 2024-09-21T03:27:31.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.584+0000 7f96dcff9640 1 -- 172.21.15.105:0/2726546026 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96d0004310 con 0x7f96e00ccba0 2024-09-21T03:27:31.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.584+0000 7f96e6a4a640 1 -- 172.21.15.105:0/2726546026 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96e01f6c60 con 0x7f96e00ccba0 2024-09-21T03:27:31.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.584+0000 7f96dcff9640 1 -- 172.21.15.105:0/2726546026 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d000de60 con 0x7f96e00ccba0 2024-09-21T03:27:31.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.584+0000 7f96e6a4a640 1 -- 172.21.15.105:0/2726546026 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96e01f7220 con 0x7f96e00ccba0 2024-09-21T03:27:31.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.585+0000 7f96e6a4a640 1 -- 172.21.15.105:0/2726546026 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96e00d1870 con 0x7f96e00ccba0 2024-09-21T03:27:31.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.586+0000 7f96dcff9640 1 -- 172.21.15.105:0/2726546026 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f96d0009c30 con 0x7f96e00ccba0 2024-09-21T03:27:31.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.586+0000 7f96dcff9640 1 --2- 172.21.15.105:0/2726546026 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f96cc078bc0 0x7f96cc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:31.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.586+0000 7f96dcff9640 1 -- 172.21.15.105:0/2726546026 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5709+0+0 (secure 0 0 0) 0x7f96d009b020 con 0x7f96e00ccba0 2024-09-21T03:27:31.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.586+0000 7f96df7fe640 1 --2- 172.21.15.105:0/2726546026 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f96cc078bc0 0x7f96cc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:31.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.587+0000 7f96df7fe640 1 --2- 172.21.15.105:0/2726546026 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f96cc078bc0 0x7f96cc07b0d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f96d4033000 tx=0x7f96d4004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:31.592 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.591+0000 7f96dcff9640 1 -- 172.21.15.105:0/2726546026 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f96d0020020 con 0x7f96e00ccba0 2024-09-21T03:27:31.807 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.805+0000 7f96e6a4a640 1 -- 172.21.15.105:0/2726546026 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f96e0069250 con 0x7f96e00ccba0 2024-09-21T03:27:31.808 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.807+0000 7f96dcff9640 1 -- 172.21.15.105:0/2726546026 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5239 (secure 0 0 0) 0x7f96d0062e10 con 0x7f96e00ccba0 2024-09-21T03:27:31.808 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:27:31.809 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":95,"btime":"2024-09-21T03:27:20:587314+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6752,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/1488182977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1488182977},{"type":"v1","addr":"172.21.15.162:6836","nonce":1488182977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":6755,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/2107181663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2107181663},{"type":"v1","addr":"172.21.15.162:6837","nonce":2107181663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":8427,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/3833164666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3833164666},{"type":"v1","addr":"172.21.15.105:6834","nonce":3833164666}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:27:16.932383+0000","modified":"2024-09-21T03:27:19.949827+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8430":{"gid":8430,"name":"a","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1315344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":1315344000},{"type":"v1","addr":"172.21.15.105:6835","nonce":1315344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8430,"qdb_cluster":[8430]},"id":11}]} 2024-09-21T03:27:31.809 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 95 2024-09-21T03:27:31.811 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.809+0000 7f96e6a4a640 1 -- 172.21.15.105:0/2726546026 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f96cc078bc0 msgr2=0x7f96cc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:31.812 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.809+0000 7f96e6a4a640 1 --2- 172.21.15.105:0/2726546026 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f96cc078bc0 0x7f96cc07b0d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f96d4033000 tx=0x7f96d4004730 comp rx=0 tx=0).stop 2024-09-21T03:27:31.812 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.809+0000 7f96e6a4a640 1 -- 172.21.15.105:0/2726546026 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96e00ccba0 msgr2=0x7f96e00cb5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:31.812 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.809+0000 7f96e6a4a640 1 --2- 172.21.15.105:0/2726546026 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96e00ccba0 0x7f96e00cb5b0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f96d000d750 tx=0x7f96d000dc10 comp rx=0 tx=0).stop 2024-09-21T03:27:31.812 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.809+0000 7f96e6a4a640 1 -- 172.21.15.105:0/2726546026 shutdown_connections 2024-09-21T03:27:31.812 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.809+0000 7f96e6a4a640 1 --2- 172.21.15.105:0/2726546026 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f96cc078bc0 0x7f96cc07b0d0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:31.812 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.809+0000 7f96e6a4a640 1 --2- 172.21.15.105:0/2726546026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96e015c6f0 0x7f96e0157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:31.812 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.809+0000 7f96e6a4a640 1 --2- 172.21.15.105:0/2726546026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96e00d1d40 0x7f96e015f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:31.812 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.809+0000 7f96e6a4a640 1 --2- 172.21.15.105:0/2726546026 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96e00ccba0 0x7f96e00cb5b0 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:31.812 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.809+0000 7f96e6a4a640 1 -- 172.21.15.105:0/2726546026 >> 172.21.15.105:0/2726546026 conn(0x7f96e00b3f10 msgr2=0x7f96e00b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:31.812 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.809+0000 7f96e6a4a640 1 -- 172.21.15.105:0/2726546026 shutdown_connections 2024-09-21T03:27:31.812 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.809+0000 7f96e6a4a640 1 -- 172.21.15.105:0/2726546026 wait complete. 2024-09-21T03:27:31.822 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:27:31.935 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.933+0000 7fc298ebd640 1 -- 172.21.15.105:0/1686380534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2940cf540 msgr2=0x7fc29406eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:31.935 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.933+0000 7fc298ebd640 1 --2- 172.21.15.105:0/1686380534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2940cf540 0x7fc29406eab0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7fc28c005fd0 tx=0x7fc28c02a480 comp rx=0 tx=0).stop 2024-09-21T03:27:31.935 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.933+0000 7fc298ebd640 1 -- 172.21.15.105:0/1686380534 shutdown_connections 2024-09-21T03:27:31.935 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.933+0000 7fc298ebd640 1 --2- 172.21.15.105:0/1686380534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2940cf540 0x7fc29406eab0 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:31.935 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.933+0000 7fc298ebd640 1 --2- 172.21.15.105:0/1686380534 >> v2:172.21.15.162:3300/0 conn(0x7fc2940b66b0 0x7fc2940d4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:31.935 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.933+0000 7fc298ebd640 1 -- 172.21.15.105:0/1686380534 >> 172.21.15.105:0/1686380534 conn(0x7fc29409d7f0 msgr2=0x7fc2940d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:31.935 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.933+0000 7fc298ebd640 1 -- 172.21.15.105:0/1686380534 shutdown_connections 2024-09-21T03:27:31.935 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.933+0000 7fc298ebd640 1 -- 172.21.15.105:0/1686380534 wait complete. 2024-09-21T03:27:31.936 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.935+0000 7fc298ebd640 1 Processor -- start 2024-09-21T03:27:31.936 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.935+0000 7fc298ebd640 1 -- start start 2024-09-21T03:27:31.939 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.936+0000 7fc298ebd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2940b9b60 0x7fc29415dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:31.939 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.936+0000 7fc298ebd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2940cf540 0x7fc2941548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:31.940 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.936+0000 7fc298ebd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2940cd7c0 0x7fc2940cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:31.940 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.936+0000 7fc298ebd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc29406f660 con 0x7fc2940cd7c0 2024-09-21T03:27:31.940 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.936+0000 7fc298ebd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc29406f4e0 con 0x7fc2940b9b60 2024-09-21T03:27:31.940 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.936+0000 7fc298ebd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc29406f7e0 con 0x7fc2940cf540 2024-09-21T03:27:31.940 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.936+0000 7fc292d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2940cd7c0 0x7fc2940cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:31.940 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.936+0000 7fc292d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2940cd7c0 0x7fc2940cdbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42064/0 (socket says 172.21.15.105:42064) 2024-09-21T03:27:31.940 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.936+0000 7fc292d9d640 1 -- 172.21.15.105:0/275383188 learned_addr learned my addr 172.21.15.105:0/275383188 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:31.940 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.936+0000 7fc29259c640 1 --2- 172.21.15.105:0/275383188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2940b9b60 0x7fc29415dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:31.940 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.936+0000 7fc291d9b640 1 --2- 172.21.15.105:0/275383188 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2940cf540 0x7fc2941548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:31.940 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.936+0000 7fc292d9d640 1 -- 172.21.15.105:0/275383188 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2940cf540 msgr2=0x7fc2941548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:31.940 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.936+0000 7fc292d9d640 1 --2- 172.21.15.105:0/275383188 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2940cf540 0x7fc2941548c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:31.940 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.936+0000 7fc292d9d640 1 -- 172.21.15.105:0/275383188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2940b9b60 msgr2=0x7fc29415dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:31.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.936+0000 7fc292d9d640 1 --2- 172.21.15.105:0/275383188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2940b9b60 0x7fc29415dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:31.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.936+0000 7fc292d9d640 1 -- 172.21.15.105:0/275383188 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2940ce110 con 0x7fc2940cd7c0 2024-09-21T03:27:31.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.936+0000 7fc291d9b640 1 --2- 172.21.15.105:0/275383188 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2940cf540 0x7fc2941548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:27:31.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.937+0000 7fc292d9d640 1 --2- 172.21.15.105:0/275383188 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2940cd7c0 0x7fc2940cdbd0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7fc28c006010 tx=0x7fc28c003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:31.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.937+0000 7fc28affd640 1 -- 172.21.15.105:0/275383188 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc28c03e030 con 0x7fc2940cd7c0 2024-09-21T03:27:31.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.937+0000 7fc28affd640 1 -- 172.21.15.105:0/275383188 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc28c003e50 con 0x7fc2940cd7c0 2024-09-21T03:27:31.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.937+0000 7fc28affd640 1 -- 172.21.15.105:0/275383188 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc28c035040 con 0x7fc2940cd7c0 2024-09-21T03:27:31.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.937+0000 7fc298ebd640 1 -- 172.21.15.105:0/275383188 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2940b2850 con 0x7fc2940cd7c0 2024-09-21T03:27:31.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.937+0000 7fc298ebd640 1 -- 172.21.15.105:0/275383188 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc294160420 con 0x7fc2940cd7c0 2024-09-21T03:27:31.941 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.938+0000 7fc298ebd640 1 -- 172.21.15.105:0/275383188 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2940b2ac0 con 0x7fc2940cd7c0 2024-09-21T03:27:31.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.938+0000 7fc28affd640 1 -- 172.21.15.105:0/275383188 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc28c041030 con 0x7fc2940cd7c0 2024-09-21T03:27:31.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.939+0000 7fc28affd640 1 --2- 172.21.15.105:0/275383188 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc274078b90 0x7fc27407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:31.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.939+0000 7fc28affd640 1 -- 172.21.15.105:0/275383188 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5709+0+0 (secure 0 0 0) 0x7fc28c0bb480 con 0x7fc2940cd7c0 2024-09-21T03:27:31.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.939+0000 7fc29259c640 1 --2- 172.21.15.105:0/275383188 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc274078b90 0x7fc27407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:31.942 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.940+0000 7fc29259c640 1 --2- 172.21.15.105:0/275383188 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc274078b90 0x7fc27407b0a0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fc284009fd0 tx=0x7fc28400d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:31.945 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:31.943+0000 7fc28affd640 1 -- 172.21.15.105:0/275383188 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc2940ce110 con 0x7fc2940cd7c0 2024-09-21T03:27:32.122 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.121+0000 7fc298ebd640 1 -- 172.21.15.105:0/275383188 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc294160660 con 0x7fc2940cd7c0 2024-09-21T03:27:32.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.122+0000 7fc28affd640 1 -- 172.21.15.105:0/275383188 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) ==== 74+0+16803 (secure 0 0 0) 0x7fc28c083300 con 0x7fc2940cd7c0 2024-09-21T03:27:32.124 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:27:32.124 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":140,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:27:18.574718+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:27:14.565415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-21T03:27:15.886597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:27:32.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.124+0000 7fc298ebd640 1 -- 172.21.15.105:0/275383188 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc274078b90 msgr2=0x7fc27407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:32.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.124+0000 7fc298ebd640 1 --2- 172.21.15.105:0/275383188 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc274078b90 0x7fc27407b0a0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fc284009fd0 tx=0x7fc28400d040 comp rx=0 tx=0).stop 2024-09-21T03:27:32.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.124+0000 7fc298ebd640 1 -- 172.21.15.105:0/275383188 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2940cd7c0 msgr2=0x7fc2940cdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:32.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.124+0000 7fc298ebd640 1 --2- 172.21.15.105:0/275383188 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2940cd7c0 0x7fc2940cdbd0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7fc28c006010 tx=0x7fc28c003960 comp rx=0 tx=0).stop 2024-09-21T03:27:32.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.124+0000 7fc298ebd640 1 -- 172.21.15.105:0/275383188 shutdown_connections 2024-09-21T03:27:32.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.124+0000 7fc298ebd640 1 --2- 172.21.15.105:0/275383188 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc274078b90 0x7fc27407b0a0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:32.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.124+0000 7fc298ebd640 1 --2- 172.21.15.105:0/275383188 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2940cd7c0 0x7fc2940cdbd0 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:32.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.124+0000 7fc298ebd640 1 --2- 172.21.15.105:0/275383188 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2940cf540 0x7fc2941548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:32.127 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.124+0000 7fc298ebd640 1 --2- 172.21.15.105:0/275383188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2940b9b60 0x7fc29415dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:32.127 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.124+0000 7fc298ebd640 1 -- 172.21.15.105:0/275383188 >> 172.21.15.105:0/275383188 conn(0x7fc29409d7f0 msgr2=0x7fc2940b7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:32.127 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.124+0000 7fc298ebd640 1 -- 172.21.15.105:0/275383188 shutdown_connections 2024-09-21T03:27:32.127 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.124+0000 7fc298ebd640 1 -- 172.21.15.105:0/275383188 wait complete. 2024-09-21T03:27:32.137 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T03:27:32.137 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:27:32.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.247+0000 7f6494119640 1 -- 172.21.15.105:0/1223267937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f648c1570e0 msgr2=0x7f648c0d1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:32.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.247+0000 7f6494119640 1 --2- 172.21.15.105:0/1223267937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f648c1570e0 0x7f648c0d1f20 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f648c071d80 tx=0x7f648802aa30 comp rx=0 tx=0).stop 2024-09-21T03:27:32.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.247+0000 7f6494119640 1 -- 172.21.15.105:0/1223267937 shutdown_connections 2024-09-21T03:27:32.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.247+0000 7f6494119640 1 --2- 172.21.15.105:0/1223267937 >> v2:172.21.15.162:3300/0 conn(0x7f648c0d2460 0x7f648c15d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:32.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.247+0000 7f6494119640 1 --2- 172.21.15.105:0/1223267937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f648c1570e0 0x7f648c0d1f20 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:32.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.247+0000 7f6494119640 1 -- 172.21.15.105:0/1223267937 >> 172.21.15.105:0/1223267937 conn(0x7f648c06d550 msgr2=0x7f648c071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:32.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.247+0000 7f6494119640 1 -- 172.21.15.105:0/1223267937 shutdown_connections 2024-09-21T03:27:32.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.247+0000 7f6494119640 1 -- 172.21.15.105:0/1223267937 wait complete. 2024-09-21T03:27:32.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.249+0000 7f6494119640 1 Processor -- start 2024-09-21T03:27:32.251 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.249+0000 7f6494119640 1 -- start start 2024-09-21T03:27:32.253 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.250+0000 7f6494119640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f648c0d2460 0x7f648c15ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:32.253 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.250+0000 7f6494119640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f648c1570e0 0x7f648c15bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:32.254 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.250+0000 7f6494119640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f648c15d670 0x7f648c0b3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:32.254 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.250+0000 7f6494119640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f648c0b7d20 con 0x7f648c1570e0 2024-09-21T03:27:32.254 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.250+0000 7f6494119640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f648c0b7ba0 con 0x7f648c0d2460 2024-09-21T03:27:32.254 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.250+0000 7f6494119640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f648c0b7ea0 con 0x7f648c15d670 2024-09-21T03:27:32.254 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.250+0000 7f64916b4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f648c1570e0 0x7f648c15bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:32.254 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.250+0000 7f64916b4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f648c1570e0 0x7f648c15bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42078/0 (socket says 172.21.15.105:42078) 2024-09-21T03:27:32.254 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.250+0000 7f64916b4640 1 -- 172.21.15.105:0/860974820 learned_addr learned my addr 172.21.15.105:0/860974820 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:32.254 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.250+0000 7f6491eb5640 1 --2- 172.21.15.105:0/860974820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f648c0d2460 0x7f648c15ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:32.254 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.251+0000 7f64926b6640 1 --2- 172.21.15.105:0/860974820 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f648c15d670 0x7f648c0b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:32.254 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.251+0000 7f64916b4640 1 -- 172.21.15.105:0/860974820 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f648c15d670 msgr2=0x7f648c0b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:32.254 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.251+0000 7f64916b4640 1 --2- 172.21.15.105:0/860974820 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f648c15d670 0x7f648c0b3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:32.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.251+0000 7f64916b4640 1 -- 172.21.15.105:0/860974820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f648c0d2460 msgr2=0x7f648c15ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:32.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.251+0000 7f64916b4640 1 --2- 172.21.15.105:0/860974820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f648c0d2460 0x7f648c15ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:32.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.251+0000 7f64916b4640 1 -- 172.21.15.105:0/860974820 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f648c0c7c10 con 0x7f648c1570e0 2024-09-21T03:27:32.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.251+0000 7f6491eb5640 1 --2- 172.21.15.105:0/860974820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f648c0d2460 0x7f648c15ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:27:32.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.251+0000 7f64926b6640 1 --2- 172.21.15.105:0/860974820 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f648c15d670 0x7f648c0b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:27:32.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.251+0000 7f64916b4640 1 --2- 172.21.15.105:0/860974820 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f648c1570e0 0x7f648c15bf60 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f647c00d700 tx=0x7f647c00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:32.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.251+0000 7f64827fc640 1 -- 172.21.15.105:0/860974820 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647c017070 con 0x7f648c1570e0 2024-09-21T03:27:32.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.251+0000 7f64827fc640 1 -- 172.21.15.105:0/860974820 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f647c005310 con 0x7f648c1570e0 2024-09-21T03:27:32.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.251+0000 7f64827fc640 1 -- 172.21.15.105:0/860974820 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647c009820 con 0x7f648c1570e0 2024-09-21T03:27:32.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.251+0000 7f6494119640 1 -- 172.21.15.105:0/860974820 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f648c0c7ef0 con 0x7f648c1570e0 2024-09-21T03:27:32.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.251+0000 7f6494119640 1 -- 172.21.15.105:0/860974820 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f648c0c84b0 con 0x7f648c1570e0 2024-09-21T03:27:32.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.252+0000 7f6494119640 1 -- 172.21.15.105:0/860974820 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f648c15d130 con 0x7f648c1570e0 2024-09-21T03:27:32.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.253+0000 7f64827fc640 1 -- 172.21.15.105:0/860974820 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f647c0099c0 con 0x7f648c1570e0 2024-09-21T03:27:32.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.253+0000 7f64827fc640 1 --2- 172.21.15.105:0/860974820 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6470078b90 0x7f647007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:32.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.253+0000 7f64827fc640 1 -- 172.21.15.105:0/860974820 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5709+0+0 (secure 0 0 0) 0x7f647c09aed0 con 0x7f648c1570e0 2024-09-21T03:27:32.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.254+0000 7f6491eb5640 1 --2- 172.21.15.105:0/860974820 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6470078b90 0x7f647007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:32.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.254+0000 7f6491eb5640 1 --2- 172.21.15.105:0/860974820 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6470078b90 0x7f647007b0a0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f6488035000 tx=0x7f6488004ab0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:32.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.258+0000 7f64827fc640 1 -- 172.21.15.105:0/860974820 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f647c063310 con 0x7f648c1570e0 2024-09-21T03:27:32.473 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.472+0000 7f6494119640 1 -- 172.21.15.105:0/860974820 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f648c068f50 con 0x7f648c1570e0 2024-09-21T03:27:32.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.472+0000 7f64827fc640 1 -- 172.21.15.105:0/860974820 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5239 (secure 0 0 0) 0x7f647c062c10 con 0x7f648c1570e0 2024-09-21T03:27:32.474 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:27:32.474 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":95,"btime":"2024-09-21T03:27:20:587314+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6752,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/1488182977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1488182977},{"type":"v1","addr":"172.21.15.162:6836","nonce":1488182977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":6755,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/2107181663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2107181663},{"type":"v1","addr":"172.21.15.162:6837","nonce":2107181663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":8427,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/3833164666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3833164666},{"type":"v1","addr":"172.21.15.105:6834","nonce":3833164666}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:27:16.932383+0000","modified":"2024-09-21T03:27:19.949827+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8430":{"gid":8430,"name":"a","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1315344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":1315344000},{"type":"v1","addr":"172.21.15.105:6835","nonce":1315344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8430,"qdb_cluster":[8430]},"id":11}]} 2024-09-21T03:27:32.474 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 95 2024-09-21T03:27:32.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.475+0000 7f6494119640 1 -- 172.21.15.105:0/860974820 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6470078b90 msgr2=0x7f647007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:32.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.475+0000 7f6494119640 1 --2- 172.21.15.105:0/860974820 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6470078b90 0x7f647007b0a0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f6488035000 tx=0x7f6488004ab0 comp rx=0 tx=0).stop 2024-09-21T03:27:32.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.475+0000 7f6494119640 1 -- 172.21.15.105:0/860974820 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f648c1570e0 msgr2=0x7f648c15bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:32.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.475+0000 7f6494119640 1 --2- 172.21.15.105:0/860974820 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f648c1570e0 0x7f648c15bf60 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f647c00d700 tx=0x7f647c00dbc0 comp rx=0 tx=0).stop 2024-09-21T03:27:32.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.475+0000 7f6494119640 1 -- 172.21.15.105:0/860974820 shutdown_connections 2024-09-21T03:27:32.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.475+0000 7f6494119640 1 --2- 172.21.15.105:0/860974820 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f6470078b90 0x7f647007b0a0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:32.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.475+0000 7f6494119640 1 --2- 172.21.15.105:0/860974820 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f648c15d670 0x7f648c0b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:32.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.475+0000 7f6494119640 1 --2- 172.21.15.105:0/860974820 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f648c1570e0 0x7f648c15bf60 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:32.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.475+0000 7f6494119640 1 --2- 172.21.15.105:0/860974820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f648c0d2460 0x7f648c15ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:32.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.475+0000 7f6494119640 1 -- 172.21.15.105:0/860974820 >> 172.21.15.105:0/860974820 conn(0x7f648c06d550 msgr2=0x7f648c0d0150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:32.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.475+0000 7f6494119640 1 -- 172.21.15.105:0/860974820 shutdown_connections 2024-09-21T03:27:32.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.475+0000 7f6494119640 1 -- 172.21.15.105:0/860974820 wait complete. 2024-09-21T03:27:32.487 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:27:32.601 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.599+0000 7fdbb97ed640 1 -- 172.21.15.105:0/19520422 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbb40d12c0 msgr2=0x7fdbb40d16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:32.601 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.599+0000 7fdbb97ed640 1 --2- 172.21.15.105:0/19520422 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbb40d12c0 0x7fdbb40d16d0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7fdbb40724e0 tx=0x7fdbac02a530 comp rx=0 tx=0).stop 2024-09-21T03:27:32.601 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.599+0000 7fdbb97ed640 1 -- 172.21.15.105:0/19520422 shutdown_connections 2024-09-21T03:27:32.601 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.599+0000 7fdbb97ed640 1 --2- 172.21.15.105:0/19520422 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbb40d12c0 0x7fdbb40d16d0 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:32.601 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.599+0000 7fdbb97ed640 1 --2- 172.21.15.105:0/19520422 >> v2:172.21.15.162:3300/0 conn(0x7fdbb40ccbd0 0x7fdbb40d0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:32.601 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.599+0000 7fdbb97ed640 1 -- 172.21.15.105:0/19520422 >> 172.21.15.105:0/19520422 conn(0x7fdbb4072ae0 msgr2=0x7fdbb4072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:32.601 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.599+0000 7fdbb97ed640 1 -- 172.21.15.105:0/19520422 shutdown_connections 2024-09-21T03:27:32.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.599+0000 7fdbb97ed640 1 -- 172.21.15.105:0/19520422 wait complete. 2024-09-21T03:27:32.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.601+0000 7fdbb97ed640 1 Processor -- start 2024-09-21T03:27:32.602 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.601+0000 7fdbb97ed640 1 -- start start 2024-09-21T03:27:32.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.602+0000 7fdbb97ed640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdbb40b51c0 0x7fdbb415c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:32.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.602+0000 7fdbb97ed640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdbb40ccbd0 0x7fdbb41f51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:32.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.602+0000 7fdbb97ed640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbb40d12c0 0x7fdbb415ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:32.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.602+0000 7fdbb97ed640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdbb40cf220 con 0x7fdbb40d12c0 2024-09-21T03:27:32.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.602+0000 7fdbb97ed640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdbb40cf0a0 con 0x7fdbb40ccbd0 2024-09-21T03:27:32.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.602+0000 7fdbb97ed640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdbb40cf3a0 con 0x7fdbb40b51c0 2024-09-21T03:27:32.605 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.602+0000 7fdbb37fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbb40d12c0 0x7fdbb415ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:32.606 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.602+0000 7fdbb37fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbb40d12c0 0x7fdbb415ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42090/0 (socket says 172.21.15.105:42090) 2024-09-21T03:27:32.606 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.602+0000 7fdbb37fe640 1 -- 172.21.15.105:0/2097375141 learned_addr learned my addr 172.21.15.105:0/2097375141 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:32.606 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.603+0000 7fdbb27fc640 1 --2- 172.21.15.105:0/2097375141 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdbb40ccbd0 0x7fdbb41f51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:32.606 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.603+0000 7fdbb2ffd640 1 --2- 172.21.15.105:0/2097375141 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdbb40b51c0 0x7fdbb415c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:32.606 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.603+0000 7fdbb37fe640 1 -- 172.21.15.105:0/2097375141 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdbb40b51c0 msgr2=0x7fdbb415c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:32.606 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.603+0000 7fdbb37fe640 1 --2- 172.21.15.105:0/2097375141 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdbb40b51c0 0x7fdbb415c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:32.606 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.603+0000 7fdbb37fe640 1 -- 172.21.15.105:0/2097375141 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdbb40ccbd0 msgr2=0x7fdbb41f51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:32.606 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.603+0000 7fdbb37fe640 1 --2- 172.21.15.105:0/2097375141 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdbb40ccbd0 0x7fdbb41f51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:32.606 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.603+0000 7fdbb37fe640 1 -- 172.21.15.105:0/2097375141 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbb4157000 con 0x7fdbb40d12c0 2024-09-21T03:27:32.606 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.603+0000 7fdbb2ffd640 1 --2- 172.21.15.105:0/2097375141 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdbb40b51c0 0x7fdbb415c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:27:32.606 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.603+0000 7fdbb37fe640 1 --2- 172.21.15.105:0/2097375141 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbb40d12c0 0x7fdbb415ebd0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fdbac02ab20 tx=0x7fdbac033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:32.606 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.603+0000 7fdbab7fe640 1 -- 172.21.15.105:0/2097375141 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbac031d60 con 0x7fdbb40d12c0 2024-09-21T03:27:32.606 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.603+0000 7fdbab7fe640 1 -- 172.21.15.105:0/2097375141 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdbac033e10 con 0x7fdbb40d12c0 2024-09-21T03:27:32.606 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.603+0000 7fdbb97ed640 1 -- 172.21.15.105:0/2097375141 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbb415f820 con 0x7fdbb40d12c0 2024-09-21T03:27:32.607 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.603+0000 7fdbab7fe640 1 -- 172.21.15.105:0/2097375141 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbac005280 con 0x7fdbb40d12c0 2024-09-21T03:27:32.607 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.603+0000 7fdbb97ed640 1 -- 172.21.15.105:0/2097375141 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbb41f6040 con 0x7fdbb40d12c0 2024-09-21T03:27:32.608 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.604+0000 7fdbb97ed640 1 -- 172.21.15.105:0/2097375141 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbb40cf850 con 0x7fdbb40d12c0 2024-09-21T03:27:32.608 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.605+0000 7fdbab7fe640 1 -- 172.21.15.105:0/2097375141 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdbac005420 con 0x7fdbb40d12c0 2024-09-21T03:27:32.608 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.605+0000 7fdbab7fe640 1 --2- 172.21.15.105:0/2097375141 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdb94078b90 0x7fdb9407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:32.608 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.605+0000 7fdbab7fe640 1 -- 172.21.15.105:0/2097375141 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5709+0+0 (secure 0 0 0) 0x7fdbac0bbe90 con 0x7fdbb40d12c0 2024-09-21T03:27:32.609 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.605+0000 7fdbb2ffd640 1 --2- 172.21.15.105:0/2097375141 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdb94078b90 0x7fdb9407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:32.609 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.606+0000 7fdbb2ffd640 1 --2- 172.21.15.105:0/2097375141 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdb94078b90 0x7fdb9407b0a0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fdba4007fd0 tx=0x7fdba4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:32.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.610+0000 7fdbab7fe640 1 -- 172.21.15.105:0/2097375141 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fdbac03f030 con 0x7fdbb40d12c0 2024-09-21T03:27:32.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.823+0000 7fdbb97ed640 1 -- 172.21.15.105:0/2097375141 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdbb41f5af0 con 0x7fdbb40d12c0 2024-09-21T03:27:32.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.824+0000 7fdbab7fe640 1 -- 172.21.15.105:0/2097375141 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5239 (secure 0 0 0) 0x7fdbac005d00 con 0x7fdbb40d12c0 2024-09-21T03:27:32.826 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:27:32.826 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":95,"btime":"2024-09-21T03:27:20:587314+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6752,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/1488182977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1488182977},{"type":"v1","addr":"172.21.15.162:6836","nonce":1488182977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":6755,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/2107181663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2107181663},{"type":"v1","addr":"172.21.15.162:6837","nonce":2107181663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":8427,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/3833164666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3833164666},{"type":"v1","addr":"172.21.15.105:6834","nonce":3833164666}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T03:27:16.932383+0000","modified":"2024-09-21T03:27:19.949827+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8430":{"gid":8430,"name":"a","rank":0,"incarnation":91,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1315344000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":1315344000},{"type":"v1","addr":"172.21.15.105:6835","nonce":1315344000}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8430,"qdb_cluster":[8430]},"id":11}]} 2024-09-21T03:27:32.826 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 95 2024-09-21T03:27:32.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.826+0000 7fdbb97ed640 1 -- 172.21.15.105:0/2097375141 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdb94078b90 msgr2=0x7fdb9407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:32.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.826+0000 7fdbb97ed640 1 --2- 172.21.15.105:0/2097375141 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdb94078b90 0x7fdb9407b0a0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fdba4007fd0 tx=0x7fdba4009040 comp rx=0 tx=0).stop 2024-09-21T03:27:32.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.826+0000 7fdbb97ed640 1 -- 172.21.15.105:0/2097375141 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbb40d12c0 msgr2=0x7fdbb415ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:32.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.826+0000 7fdbb97ed640 1 --2- 172.21.15.105:0/2097375141 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbb40d12c0 0x7fdbb415ebd0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fdbac02ab20 tx=0x7fdbac033c20 comp rx=0 tx=0).stop 2024-09-21T03:27:32.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.826+0000 7fdbb97ed640 1 -- 172.21.15.105:0/2097375141 shutdown_connections 2024-09-21T03:27:32.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.826+0000 7fdbb97ed640 1 --2- 172.21.15.105:0/2097375141 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdb94078b90 0x7fdb9407b0a0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:32.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.826+0000 7fdbb97ed640 1 --2- 172.21.15.105:0/2097375141 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbb40d12c0 0x7fdbb415ebd0 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:32.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.826+0000 7fdbb97ed640 1 --2- 172.21.15.105:0/2097375141 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdbb40ccbd0 0x7fdbb41f51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:32.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.826+0000 7fdbb97ed640 1 --2- 172.21.15.105:0/2097375141 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdbb40b51c0 0x7fdbb415c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:32.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.826+0000 7fdbb97ed640 1 -- 172.21.15.105:0/2097375141 >> 172.21.15.105:0/2097375141 conn(0x7fdbb4072ae0 msgr2=0x7fdbb415a580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:32.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.826+0000 7fdbb97ed640 1 -- 172.21.15.105:0/2097375141 shutdown_connections 2024-09-21T03:27:32.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.826+0000 7fdbb97ed640 1 -- 172.21.15.105:0/2097375141 wait complete. 2024-09-21T03:27:32.839 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:27:32.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.952+0000 7f4b5a107640 1 -- 172.21.15.105:0/922964983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b5406e170 msgr2=0x7f4b540b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:32.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.952+0000 7f4b5a107640 1 --2- 172.21.15.105:0/922964983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b5406e170 0x7f4b540b3540 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f4b44009860 tx=0x7f4b4402a4b0 comp rx=0 tx=0).stop 2024-09-21T03:27:32.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.952+0000 7f4b5a107640 1 -- 172.21.15.105:0/922964983 shutdown_connections 2024-09-21T03:27:32.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.952+0000 7f4b5a107640 1 --2- 172.21.15.105:0/922964983 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b5406f4b0 0x7f4b540d3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:32.955 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.952+0000 7f4b5a107640 1 --2- 172.21.15.105:0/922964983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b5406e170 0x7f4b540b3540 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:32.956 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.952+0000 7f4b5a107640 1 -- 172.21.15.105:0/922964983 >> 172.21.15.105:0/922964983 conn(0x7f4b5408bfc0 msgr2=0x7f4b5409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:32.956 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.952+0000 7f4b5a107640 1 -- 172.21.15.105:0/922964983 shutdown_connections 2024-09-21T03:27:32.956 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.952+0000 7f4b5a107640 1 -- 172.21.15.105:0/922964983 wait complete. 2024-09-21T03:27:32.961 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.954+0000 7f4b5a107640 1 Processor -- start 2024-09-21T03:27:32.961 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.954+0000 7f4b5a107640 1 -- start start 2024-09-21T03:27:32.961 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.955+0000 7f4b5a107640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b5406f4b0 0x7f4b541e9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:32.961 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.955+0000 7f4b5a107640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b540d3870 0x7f4b5414e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:32.961 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.955+0000 7f4b5a107640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b5414e8c0 0x7f4b5414ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:32.961 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.955+0000 7f4b5a107640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4b540d0e60 con 0x7f4b5406f4b0 2024-09-21T03:27:32.961 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.955+0000 7f4b5a107640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4b540d0ce0 con 0x7f4b5414e8c0 2024-09-21T03:27:32.961 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.955+0000 7f4b5a107640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4b540d0fe0 con 0x7f4b540d3870 2024-09-21T03:27:32.961 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.955+0000 7f4b537fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b5406f4b0 0x7f4b541e9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:32.962 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.955+0000 7f4b537fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b5406f4b0 0x7f4b541e9780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42094/0 (socket says 172.21.15.105:42094) 2024-09-21T03:27:32.962 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.955+0000 7f4b537fe640 1 -- 172.21.15.105:0/2335672792 learned_addr learned my addr 172.21.15.105:0/2335672792 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:32.962 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.955+0000 7f4b53fff640 1 --2- 172.21.15.105:0/2335672792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b5414e8c0 0x7f4b5414ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:32.962 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.955+0000 7f4b52ffd640 1 --2- 172.21.15.105:0/2335672792 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b540d3870 0x7f4b5414e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:32.962 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.955+0000 7f4b537fe640 1 -- 172.21.15.105:0/2335672792 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b540d3870 msgr2=0x7f4b5414e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:32.962 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.955+0000 7f4b537fe640 1 --2- 172.21.15.105:0/2335672792 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b540d3870 0x7f4b5414e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:32.962 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.955+0000 7f4b537fe640 1 -- 172.21.15.105:0/2335672792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b5414e8c0 msgr2=0x7f4b5414ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:32.962 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.955+0000 7f4b537fe640 1 --2- 172.21.15.105:0/2335672792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b5414e8c0 0x7f4b5414ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:32.962 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.955+0000 7f4b537fe640 1 -- 172.21.15.105:0/2335672792 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b541e8d10 con 0x7f4b5406f4b0 2024-09-21T03:27:32.962 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.955+0000 7f4b52ffd640 1 --2- 172.21.15.105:0/2335672792 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b540d3870 0x7f4b5414e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:27:32.962 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.956+0000 7f4b537fe640 1 --2- 172.21.15.105:0/2335672792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b5406f4b0 0x7f4b541e9780 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f4b4402aaa0 tx=0x7f4b44033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:32.962 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.956+0000 7f4b3bfff640 1 -- 172.21.15.105:0/2335672792 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b44031b50 con 0x7f4b5406f4b0 2024-09-21T03:27:32.962 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.956+0000 7f4b3bfff640 1 -- 172.21.15.105:0/2335672792 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4b44031de0 con 0x7f4b5406f4b0 2024-09-21T03:27:32.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.956+0000 7f4b5a107640 1 -- 172.21.15.105:0/2335672792 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b540cb8a0 con 0x7f4b5406f4b0 2024-09-21T03:27:32.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.956+0000 7f4b3bfff640 1 -- 172.21.15.105:0/2335672792 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b44033330 con 0x7f4b5406f4b0 2024-09-21T03:27:32.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.956+0000 7f4b5a107640 1 -- 172.21.15.105:0/2335672792 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b541e9260 con 0x7f4b5406f4b0 2024-09-21T03:27:32.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.957+0000 7f4b5a107640 1 -- 172.21.15.105:0/2335672792 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b540d1500 con 0x7f4b5406f4b0 2024-09-21T03:27:32.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.958+0000 7f4b3bfff640 1 -- 172.21.15.105:0/2335672792 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4b440334d0 con 0x7f4b5406f4b0 2024-09-21T03:27:32.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.958+0000 7f4b3bfff640 1 --2- 172.21.15.105:0/2335672792 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4b40078b90 0x7f4b4007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:32.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.958+0000 7f4b3bfff640 1 -- 172.21.15.105:0/2335672792 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5709+0+0 (secure 0 0 0) 0x7f4b440bc030 con 0x7f4b5406f4b0 2024-09-21T03:27:32.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.958+0000 7f4b52ffd640 1 --2- 172.21.15.105:0/2335672792 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4b40078b90 0x7f4b4007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:32.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.959+0000 7f4b52ffd640 1 --2- 172.21.15.105:0/2335672792 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4b40078b90 0x7f4b4007b0a0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f4b54076170 tx=0x7f4b48009260 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:32.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:32.963+0000 7f4b3bfff640 1 -- 172.21.15.105:0/2335672792 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4b4403f030 con 0x7f4b5406f4b0 2024-09-21T03:27:33.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.139+0000 7f4b5a107640 1 -- 172.21.15.105:0/2335672792 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4b5414e580 con 0x7f4b5406f4b0 2024-09-21T03:27:33.142 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.140+0000 7f4b3bfff640 1 -- 172.21.15.105:0/2335672792 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) ==== 74+0+16803 (secure 0 0 0) 0x7f4b44084480 con 0x7f4b5406f4b0 2024-09-21T03:27:33.142 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:27:33.143 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":140,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:27:18.574718+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:27:14.565415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-21T03:27:15.886597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:27:33.145 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.142+0000 7f4b5a107640 1 -- 172.21.15.105:0/2335672792 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4b40078b90 msgr2=0x7f4b4007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:33.145 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.142+0000 7f4b5a107640 1 --2- 172.21.15.105:0/2335672792 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4b40078b90 0x7f4b4007b0a0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f4b54076170 tx=0x7f4b48009260 comp rx=0 tx=0).stop 2024-09-21T03:27:33.145 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.142+0000 7f4b5a107640 1 -- 172.21.15.105:0/2335672792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b5406f4b0 msgr2=0x7f4b541e9780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:33.145 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.142+0000 7f4b5a107640 1 --2- 172.21.15.105:0/2335672792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b5406f4b0 0x7f4b541e9780 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f4b4402aaa0 tx=0x7f4b44033ba0 comp rx=0 tx=0).stop 2024-09-21T03:27:33.145 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.143+0000 7f4b5a107640 1 -- 172.21.15.105:0/2335672792 shutdown_connections 2024-09-21T03:27:33.145 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.143+0000 7f4b5a107640 1 --2- 172.21.15.105:0/2335672792 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4b40078b90 0x7f4b4007b0a0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:33.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.143+0000 7f4b5a107640 1 --2- 172.21.15.105:0/2335672792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b5414e8c0 0x7f4b5414ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:33.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.143+0000 7f4b5a107640 1 --2- 172.21.15.105:0/2335672792 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b540d3870 0x7f4b5414e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:33.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.143+0000 7f4b5a107640 1 --2- 172.21.15.105:0/2335672792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b5406f4b0 0x7f4b541e9780 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:33.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.143+0000 7f4b5a107640 1 -- 172.21.15.105:0/2335672792 >> 172.21.15.105:0/2335672792 conn(0x7f4b5408bfc0 msgr2=0x7f4b54161970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:33.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.143+0000 7f4b5a107640 1 -- 172.21.15.105:0/2335672792 shutdown_connections 2024-09-21T03:27:33.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.143+0000 7f4b5a107640 1 -- 172.21.15.105:0/2335672792 wait complete. 2024-09-21T03:27:33.156 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T03:27:33.269 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.267+0000 7f7266932640 1 -- 172.21.15.105:0/1792493561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72600b9970 msgr2=0x7f72600b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:33.271 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.267+0000 7f7266932640 1 --2- 172.21.15.105:0/1792493561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72600b9970 0x7f72600b3710 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f72600d3de0 tx=0x7f725002a5f0 comp rx=0 tx=0).stop 2024-09-21T03:27:33.271 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.267+0000 7f7266932640 1 -- 172.21.15.105:0/1792493561 shutdown_connections 2024-09-21T03:27:33.271 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.267+0000 7f7266932640 1 --2- 172.21.15.105:0/1792493561 >> v2:172.21.15.162:3300/0 conn(0x7f72600b5fa0 0x7f72600b63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:33.271 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.267+0000 7f7266932640 1 --2- 172.21.15.105:0/1792493561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72600b9970 0x7f72600b3710 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:33.271 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.267+0000 7f7266932640 1 -- 172.21.15.105:0/1792493561 >> 172.21.15.105:0/1792493561 conn(0x7f726009d7f0 msgr2=0x7f72600d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:33.271 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.267+0000 7f7266932640 1 -- 172.21.15.105:0/1792493561 shutdown_connections 2024-09-21T03:27:33.271 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.267+0000 7f7266932640 1 -- 172.21.15.105:0/1792493561 wait complete. 2024-09-21T03:27:33.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.269+0000 7f7266932640 1 Processor -- start 2024-09-21T03:27:33.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.269+0000 7f7266932640 1 -- start start 2024-09-21T03:27:33.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.270+0000 7f7266932640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72600b5fa0 0x7f7260155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:33.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.270+0000 7f7266932640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f72600b9970 0x7f7260161490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:33.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.270+0000 7f7266932640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72600ced80 0x7f72600b83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:33.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.270+0000 7f7266932640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f726006f270 con 0x7f72600ced80 2024-09-21T03:27:33.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.270+0000 7f7266932640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f726006f0f0 con 0x7f72600b5fa0 2024-09-21T03:27:33.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.270+0000 7f7266932640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f726006f3f0 con 0x7f72600b9970 2024-09-21T03:27:33.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.270+0000 7f7264ecf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72600ced80 0x7f72600b83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:33.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.270+0000 7f7264ecf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72600ced80 0x7f72600b83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42106/0 (socket says 172.21.15.105:42106) 2024-09-21T03:27:33.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.270+0000 7f7264ecf640 1 -- 172.21.15.105:0/676178752 learned_addr learned my addr 172.21.15.105:0/676178752 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:33.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.270+0000 7f725ffff640 1 --2- 172.21.15.105:0/676178752 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72600b5fa0 0x7f7260155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:33.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.270+0000 7f725f7fe640 1 --2- 172.21.15.105:0/676178752 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f72600b9970 0x7f7260161490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:33.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.271+0000 7f7264ecf640 1 -- 172.21.15.105:0/676178752 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f72600b9970 msgr2=0x7f7260161490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:33.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.271+0000 7f7264ecf640 1 --2- 172.21.15.105:0/676178752 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f72600b9970 0x7f7260161490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:33.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.271+0000 7f7264ecf640 1 -- 172.21.15.105:0/676178752 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72600b5fa0 msgr2=0x7f7260155920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:33.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.271+0000 7f7264ecf640 1 --2- 172.21.15.105:0/676178752 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72600b5fa0 0x7f7260155920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:33.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.271+0000 7f7264ecf640 1 -- 172.21.15.105:0/676178752 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72601619d0 con 0x7f72600ced80 2024-09-21T03:27:33.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.271+0000 7f725f7fe640 1 --2- 172.21.15.105:0/676178752 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f72600b9970 0x7f7260161490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:27:33.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.271+0000 7f7264ecf640 1 --2- 172.21.15.105:0/676178752 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72600ced80 0x7f72600b83c0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f725800c760 tx=0x7f725800cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:33.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.271+0000 7f725cff9640 1 -- 172.21.15.105:0/676178752 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7258003b70 con 0x7f72600ced80 2024-09-21T03:27:33.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.271+0000 7f725cff9640 1 -- 172.21.15.105:0/676178752 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7258003d10 con 0x7f72600ced80 2024-09-21T03:27:33.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.271+0000 7f7266932640 1 -- 172.21.15.105:0/676178752 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72600cb5f0 con 0x7f72600ced80 2024-09-21T03:27:33.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.271+0000 7f725cff9640 1 -- 172.21.15.105:0/676178752 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72580052d0 con 0x7f72600ced80 2024-09-21T03:27:33.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.271+0000 7f7266932640 1 -- 172.21.15.105:0/676178752 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72600cbbb0 con 0x7f72600ced80 2024-09-21T03:27:33.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.272+0000 7f7266932640 1 -- 172.21.15.105:0/676178752 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7260155e60 con 0x7f72600ced80 2024-09-21T03:27:33.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.273+0000 7f725cff9640 1 -- 172.21.15.105:0/676178752 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7258005470 con 0x7f72600ced80 2024-09-21T03:27:33.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.273+0000 7f725cff9640 1 --2- 172.21.15.105:0/676178752 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f724c078bc0 0x7f724c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:33.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.273+0000 7f725cff9640 1 -- 172.21.15.105:0/676178752 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5709+0+0 (secure 0 0 0) 0x7f725809a960 con 0x7f72600ced80 2024-09-21T03:27:33.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.273+0000 7f725ffff640 1 --2- 172.21.15.105:0/676178752 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f724c078bc0 0x7f724c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:33.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.274+0000 7f725ffff640 1 --2- 172.21.15.105:0/676178752 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f724c078bc0 0x7f724c07b0d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f7250034000 tx=0x7f7250004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:33.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.278+0000 7f725cff9640 1 -- 172.21.15.105:0/676178752 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f72600b68f0 con 0x7f72600ced80 2024-09-21T03:27:33.494 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.492+0000 7f7266932640 1 -- 172.21.15.105:0/676178752 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f72600cfc40 con 0x7f72600ced80 2024-09-21T03:27:33.494 INFO:tasks.ceph.mon.a.smithi105.stderr:2024-09-21T03:27:33.493+0000 7f25819ea640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T03:27:33.496 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.494+0000 7f725cff9640 1 -- 172.21.15.105:0/676178752 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v96) ==== 161+0+0 (secure 0 0 0) 0x7f7258062e30 con 0x7f72600ced80 2024-09-21T03:27:33.496 INFO:teuthology.orchestra.run.smithi105.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T03:27:33.499 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.497+0000 7f7266932640 1 -- 172.21.15.105:0/676178752 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f724c078bc0 msgr2=0x7f724c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:33.499 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.497+0000 7f7266932640 1 --2- 172.21.15.105:0/676178752 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f724c078bc0 0x7f724c07b0d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f7250034000 tx=0x7f7250004730 comp rx=0 tx=0).stop 2024-09-21T03:27:33.499 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.497+0000 7f7266932640 1 -- 172.21.15.105:0/676178752 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72600ced80 msgr2=0x7f72600b83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:33.499 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.497+0000 7f7266932640 1 --2- 172.21.15.105:0/676178752 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72600ced80 0x7f72600b83c0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f725800c760 tx=0x7f725800cb60 comp rx=0 tx=0).stop 2024-09-21T03:27:33.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.497+0000 7f7266932640 1 -- 172.21.15.105:0/676178752 shutdown_connections 2024-09-21T03:27:33.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.497+0000 7f7266932640 1 --2- 172.21.15.105:0/676178752 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f724c078bc0 0x7f724c07b0d0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:33.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.497+0000 7f7266932640 1 --2- 172.21.15.105:0/676178752 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72600ced80 0x7f72600b83c0 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:33.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.497+0000 7f7266932640 1 --2- 172.21.15.105:0/676178752 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f72600b9970 0x7f7260161490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:33.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.497+0000 7f7266932640 1 --2- 172.21.15.105:0/676178752 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72600b5fa0 0x7f7260155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:33.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.497+0000 7f7266932640 1 -- 172.21.15.105:0/676178752 >> 172.21.15.105:0/676178752 conn(0x7f726009d7f0 msgr2=0x7f72600b13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:33.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.497+0000 7f7266932640 1 -- 172.21.15.105:0/676178752 shutdown_connections 2024-09-21T03:27:33.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.497+0000 7f7266932640 1 -- 172.21.15.105:0/676178752 wait complete. 2024-09-21T03:27:33.500 INFO:tasks.ceph.mds.a.smithi105.stderr: -2252> 2024-09-21T03:27:19.549+0000 7f68787fe640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T03:27:33.510 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T03:27:33.553 INFO:tasks.ceph.mds.a.smithi105.stdout:starting mds.a at 2024-09-21T03:27:33.632 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.630+0000 7f320d45c640 1 -- 172.21.15.105:0/566101545 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32080d3870 msgr2=0x7f32080ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:33.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.630+0000 7f320d45c640 1 --2- 172.21.15.105:0/566101545 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32080d3870 0x7f32080ceb40 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f32080b70e0 tx=0x7f320002a9c0 comp rx=0 tx=0).stop 2024-09-21T03:27:33.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.630+0000 7f320d45c640 1 -- 172.21.15.105:0/566101545 shutdown_connections 2024-09-21T03:27:33.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.630+0000 7f320d45c640 1 --2- 172.21.15.105:0/566101545 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32080d3870 0x7f32080ceb40 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:33.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.630+0000 7f320d45c640 1 --2- 172.21.15.105:0/566101545 >> v2:172.21.15.162:3300/0 conn(0x7f320806f4b0 0x7f32080d3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:33.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.630+0000 7f320d45c640 1 --2- 172.21.15.105:0/566101545 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f320806e170 0x7f32080b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:33.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.630+0000 7f320d45c640 1 -- 172.21.15.105:0/566101545 >> 172.21.15.105:0/566101545 conn(0x7f320808bfc0 msgr2=0x7f320809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:33.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.630+0000 7f320d45c640 1 -- 172.21.15.105:0/566101545 shutdown_connections 2024-09-21T03:27:33.633 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.630+0000 7f320d45c640 1 -- 172.21.15.105:0/566101545 wait complete. 2024-09-21T03:27:33.634 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.632+0000 7f320d45c640 1 Processor -- start 2024-09-21T03:27:33.634 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.632+0000 7f320d45c640 1 -- start start 2024-09-21T03:27:33.636 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.633+0000 7f320d45c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f320806f4b0 0x7f32081f9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:33.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.633+0000 7f320d45c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32080d3870 0x7f32081589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:33.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.633+0000 7f320d45c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32080cd790 0x7f32080cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:33.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.634+0000 7f320d45c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f32080cf490 con 0x7f32080d3870 2024-09-21T03:27:33.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.634+0000 7f320d45c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f32080cf310 con 0x7f32080cd790 2024-09-21T03:27:33.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.634+0000 7f320d45c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f32080d0ce0 con 0x7f320806f4b0 2024-09-21T03:27:33.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.634+0000 7f31fe7fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32080d3870 0x7f32081589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:33.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.634+0000 7f31fe7fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32080d3870 0x7f32081589b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42146/0 (socket says 172.21.15.105:42146) 2024-09-21T03:27:33.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.634+0000 7f31fe7fc640 1 -- 172.21.15.105:0/1035005336 learned_addr learned my addr 172.21.15.105:0/1035005336 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:33.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.634+0000 7f3206ffd640 1 --2- 172.21.15.105:0/1035005336 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f320806f4b0 0x7f32081f9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:33.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.634+0000 7f32077fe640 1 --2- 172.21.15.105:0/1035005336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32080cd790 0x7f32080cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:33.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.634+0000 7f31fe7fc640 1 -- 172.21.15.105:0/1035005336 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f320806f4b0 msgr2=0x7f32081f9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:33.637 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.634+0000 7f31fe7fc640 1 --2- 172.21.15.105:0/1035005336 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f320806f4b0 0x7f32081f9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:33.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.634+0000 7f31fe7fc640 1 -- 172.21.15.105:0/1035005336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32080cd790 msgr2=0x7f32080cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:33.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.634+0000 7f31fe7fc640 1 --2- 172.21.15.105:0/1035005336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32080cd790 0x7f32080cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:33.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.634+0000 7f31fe7fc640 1 -- 172.21.15.105:0/1035005336 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32080ce0e0 con 0x7f32080d3870 2024-09-21T03:27:33.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.634+0000 7f31fe7fc640 1 --2- 172.21.15.105:0/1035005336 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32080d3870 0x7f32081589b0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f31f000d650 tx=0x7f31f000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:33.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.634+0000 7f31fffff640 1 -- 172.21.15.105:0/1035005336 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f0017070 con 0x7f32080d3870 2024-09-21T03:27:33.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.634+0000 7f31fffff640 1 -- 172.21.15.105:0/1035005336 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f31f0009b10 con 0x7f32080d3870 2024-09-21T03:27:33.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.634+0000 7f320d45c640 1 -- 172.21.15.105:0/1035005336 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32080c9630 con 0x7f32080d3870 2024-09-21T03:27:33.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.634+0000 7f31fffff640 1 -- 172.21.15.105:0/1035005336 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f0010460 con 0x7f32080d3870 2024-09-21T03:27:33.638 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.634+0000 7f320d45c640 1 -- 172.21.15.105:0/1035005336 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f320809ee40 con 0x7f32080d3870 2024-09-21T03:27:33.639 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.635+0000 7f320d45c640 1 -- 172.21.15.105:0/1035005336 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32080d07a0 con 0x7f32080d3870 2024-09-21T03:27:33.639 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.636+0000 7f31fffff640 1 -- 172.21.15.105:0/1035005336 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f31f001a070 con 0x7f32080d3870 2024-09-21T03:27:33.639 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.636+0000 7f31fffff640 1 --2- 172.21.15.105:0/1035005336 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f31e8078b90 0x7f31e807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:33.639 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.637+0000 7f31fffff640 1 -- 172.21.15.105:0/1035005336 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5795+0+0 (secure 0 0 0) 0x7f31f009ae30 con 0x7f32080d3870 2024-09-21T03:27:33.639 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.637+0000 7f3206ffd640 1 --2- 172.21.15.105:0/1035005336 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f31e8078b90 0x7f31e807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:33.640 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.637+0000 7f3206ffd640 1 --2- 172.21.15.105:0/1035005336 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f31e8078b90 0x7f31e807b0a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f31f8004630 tx=0x7f31f800b2e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:33.642 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.641+0000 7f31fffff640 1 -- 172.21.15.105:0/1035005336 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f32080ce0e0 con 0x7f32080d3870 2024-09-21T03:27:33.855 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:33.853+0000 7f320d45c640 1 -- 172.21.15.105:0/1035005336 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f320806e170 con 0x7f32080d3870 2024-09-21T03:27:34.497 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.496+0000 7f31fffff640 1 -- 172.21.15.105:0/1035005336 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v97) ==== 104+0+0 (secure 0 0 0) 0x7f31f0062bd0 con 0x7f32080d3870 2024-09-21T03:27:34.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.498+0000 7f320d45c640 1 -- 172.21.15.105:0/1035005336 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f31e8078b90 msgr2=0x7f31e807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:34.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.498+0000 7f320d45c640 1 --2- 172.21.15.105:0/1035005336 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f31e8078b90 0x7f31e807b0a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f31f8004630 tx=0x7f31f800b2e0 comp rx=0 tx=0).stop 2024-09-21T03:27:34.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.498+0000 7f320d45c640 1 -- 172.21.15.105:0/1035005336 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32080d3870 msgr2=0x7f32081589b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:34.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.498+0000 7f320d45c640 1 --2- 172.21.15.105:0/1035005336 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32080d3870 0x7f32081589b0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f31f000d650 tx=0x7f31f000db10 comp rx=0 tx=0).stop 2024-09-21T03:27:34.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.498+0000 7f320d45c640 1 -- 172.21.15.105:0/1035005336 shutdown_connections 2024-09-21T03:27:34.500 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.498+0000 7f320d45c640 1 --2- 172.21.15.105:0/1035005336 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f31e8078b90 0x7f31e807b0a0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:34.501 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.498+0000 7f320d45c640 1 --2- 172.21.15.105:0/1035005336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32080cd790 0x7f32080cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:34.501 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.498+0000 7f320d45c640 1 --2- 172.21.15.105:0/1035005336 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32080d3870 0x7f32081589b0 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:34.501 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.498+0000 7f320d45c640 1 --2- 172.21.15.105:0/1035005336 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f320806f4b0 0x7f32081f9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:34.501 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.498+0000 7f320d45c640 1 -- 172.21.15.105:0/1035005336 >> 172.21.15.105:0/1035005336 conn(0x7f320808bfc0 msgr2=0x7f32080b2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:34.501 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.498+0000 7f320d45c640 1 -- 172.21.15.105:0/1035005336 shutdown_connections 2024-09-21T03:27:34.501 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.498+0000 7f320d45c640 1 -- 172.21.15.105:0/1035005336 wait complete. 2024-09-21T03:27:34.513 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T03:27:34.674 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.672+0000 7f88a4c0e640 1 -- 172.21.15.105:0/4161071973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88a015ce50 msgr2=0x7f88a015d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:34.674 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.672+0000 7f88a4c0e640 1 --2- 172.21.15.105:0/4161071973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88a015ce50 0x7f88a015d260 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f88a00726b0 tx=0x7f889402a540 comp rx=0 tx=0).stop 2024-09-21T03:27:34.674 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.672+0000 7f88a4c0e640 1 -- 172.21.15.105:0/4161071973 shutdown_connections 2024-09-21T03:27:34.674 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.672+0000 7f88a4c0e640 1 --2- 172.21.15.105:0/4161071973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88a015ce50 0x7f88a015d260 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:34.675 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.672+0000 7f88a4c0e640 1 --2- 172.21.15.105:0/4161071973 >> v2:172.21.15.162:3300/0 conn(0x7f88a0152740 0x7f88a015c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:34.675 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.672+0000 7f88a4c0e640 1 -- 172.21.15.105:0/4161071973 >> 172.21.15.105:0/4161071973 conn(0x7f88a0073d90 msgr2=0x7f88a00741a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:34.675 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.672+0000 7f88a4c0e640 1 -- 172.21.15.105:0/4161071973 shutdown_connections 2024-09-21T03:27:34.675 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.672+0000 7f88a4c0e640 1 -- 172.21.15.105:0/4161071973 wait complete. 2024-09-21T03:27:34.676 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.674+0000 7f88a4c0e640 1 Processor -- start 2024-09-21T03:27:34.676 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.674+0000 7f88a4c0e640 1 -- start start 2024-09-21T03:27:34.678 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.676+0000 7f88a4c0e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88a00cf5e0 0x7f88a01565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:34.679 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.676+0000 7f88a4c0e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88a0152740 0x7f88a0154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:34.679 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.676+0000 7f88a4c0e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f88a015ce50 0x7f88a00b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:34.679 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.676+0000 7f88a4c0e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f88a00712a0 con 0x7f88a0152740 2024-09-21T03:27:34.679 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.676+0000 7f88a4c0e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f88a0071120 con 0x7f88a00cf5e0 2024-09-21T03:27:34.679 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.676+0000 7f88a4c0e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f88a00cf9f0 con 0x7f88a015ce50 2024-09-21T03:27:34.679 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.676+0000 7f889dd9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88a0152740 0x7f88a0154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:34.679 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.676+0000 7f889dd9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88a0152740 0x7f88a0154630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42160/0 (socket says 172.21.15.105:42160) 2024-09-21T03:27:34.679 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.676+0000 7f889dd9b640 1 -- 172.21.15.105:0/3845166164 learned_addr learned my addr 172.21.15.105:0/3845166164 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:34.679 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.676+0000 7f889e59c640 1 --2- 172.21.15.105:0/3845166164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88a00cf5e0 0x7f88a01565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:34.679 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.676+0000 7f889ed9d640 1 --2- 172.21.15.105:0/3845166164 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f88a015ce50 0x7f88a00b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:34.679 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.676+0000 7f889dd9b640 1 -- 172.21.15.105:0/3845166164 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f88a015ce50 msgr2=0x7f88a00b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:34.679 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.676+0000 7f889dd9b640 1 --2- 172.21.15.105:0/3845166164 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f88a015ce50 0x7f88a00b3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:34.680 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.676+0000 7f889dd9b640 1 -- 172.21.15.105:0/3845166164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88a00cf5e0 msgr2=0x7f88a01565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:34.680 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.676+0000 7f889dd9b640 1 --2- 172.21.15.105:0/3845166164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88a00cf5e0 0x7f88a01565c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:34.680 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.676+0000 7f889dd9b640 1 -- 172.21.15.105:0/3845166164 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88a0156b00 con 0x7f88a0152740 2024-09-21T03:27:34.680 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.676+0000 7f889dd9b640 1 --2- 172.21.15.105:0/3845166164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88a0152740 0x7f88a0154630 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f889402ab30 tx=0x7f88940049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:34.680 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.676+0000 7f888effd640 1 -- 172.21.15.105:0/3845166164 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8894031950 con 0x7f88a0152740 2024-09-21T03:27:34.680 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.676+0000 7f888effd640 1 -- 172.21.15.105:0/3845166164 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8894031be0 con 0x7f88a0152740 2024-09-21T03:27:34.680 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.677+0000 7f888effd640 1 -- 172.21.15.105:0/3845166164 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88940330d0 con 0x7f88a0152740 2024-09-21T03:27:34.680 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.677+0000 7f88a4c0e640 1 -- 172.21.15.105:0/3845166164 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88a0153590 con 0x7f88a0152740 2024-09-21T03:27:34.680 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.677+0000 7f88a4c0e640 1 -- 172.21.15.105:0/3845166164 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88a0153b50 con 0x7f88a0152740 2024-09-21T03:27:34.681 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.677+0000 7f88a4c0e640 1 -- 172.21.15.105:0/3845166164 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88a0153300 con 0x7f88a0152740 2024-09-21T03:27:34.681 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.678+0000 7f888effd640 1 -- 172.21.15.105:0/3845166164 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8894004020 con 0x7f88a0152740 2024-09-21T03:27:34.681 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.679+0000 7f888effd640 1 --2- 172.21.15.105:0/3845166164 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8880078b90 0x7f888007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:34.681 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.679+0000 7f888effd640 1 -- 172.21.15.105:0/3845166164 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5795+0+0 (secure 0 0 0) 0x7f88940bc150 con 0x7f88a0152740 2024-09-21T03:27:34.681 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.679+0000 7f889e59c640 1 --2- 172.21.15.105:0/3845166164 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8880078b90 0x7f888007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:34.681 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.679+0000 7f889e59c640 1 --2- 172.21.15.105:0/3845166164 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8880078b90 0x7f888007b0a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f8890005fd0 tx=0x7f88900095e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:34.685 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.683+0000 7f888effd640 1 -- 172.21.15.105:0/3845166164 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f889403f030 con 0x7f88a0152740 2024-09-21T03:27:34.863 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:34.862+0000 7f88a4c0e640 1 -- 172.21.15.105:0/3845166164 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f88a015c710 con 0x7f88a0152740 2024-09-21T03:27:35.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.824+0000 7f888effd640 1 -- 172.21.15.105:0/3845166164 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v142) ==== 181+0+0 (secure 0 0 0) 0x7f88a015cc50 con 0x7f88a0152740 2024-09-21T03:27:35.826 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_metadata' removed 2024-09-21T03:27:35.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.827+0000 7f88a4c0e640 1 -- 172.21.15.105:0/3845166164 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8880078b90 msgr2=0x7f888007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:35.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.827+0000 7f88a4c0e640 1 --2- 172.21.15.105:0/3845166164 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8880078b90 0x7f888007b0a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f8890005fd0 tx=0x7f88900095e0 comp rx=0 tx=0).stop 2024-09-21T03:27:35.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.827+0000 7f88a4c0e640 1 -- 172.21.15.105:0/3845166164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88a0152740 msgr2=0x7f88a0154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:35.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.827+0000 7f88a4c0e640 1 --2- 172.21.15.105:0/3845166164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88a0152740 0x7f88a0154630 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f889402ab30 tx=0x7f88940049d0 comp rx=0 tx=0).stop 2024-09-21T03:27:35.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.827+0000 7f88a4c0e640 1 -- 172.21.15.105:0/3845166164 shutdown_connections 2024-09-21T03:27:35.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.827+0000 7f88a4c0e640 1 --2- 172.21.15.105:0/3845166164 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8880078b90 0x7f888007b0a0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:35.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.827+0000 7f88a4c0e640 1 --2- 172.21.15.105:0/3845166164 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f88a015ce50 0x7f88a00b3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:35.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.827+0000 7f88a4c0e640 1 --2- 172.21.15.105:0/3845166164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88a0152740 0x7f88a0154630 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:35.829 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.827+0000 7f88a4c0e640 1 --2- 172.21.15.105:0/3845166164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88a00cf5e0 0x7f88a01565c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:35.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.827+0000 7f88a4c0e640 1 -- 172.21.15.105:0/3845166164 >> 172.21.15.105:0/3845166164 conn(0x7f88a0073d90 msgr2=0x7f88a0151b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:35.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.827+0000 7f88a4c0e640 1 -- 172.21.15.105:0/3845166164 shutdown_connections 2024-09-21T03:27:35.830 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.827+0000 7f88a4c0e640 1 -- 172.21.15.105:0/3845166164 wait complete. 2024-09-21T03:27:35.842 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T03:27:35.966 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.964+0000 7f1cf7c16640 1 -- 172.21.15.105:0/2197089829 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1cf00cf7e0 msgr2=0x7f1cf00cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:35.966 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.964+0000 7f1cf7c16640 1 --2- 172.21.15.105:0/2197089829 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1cf00cf7e0 0x7f1cf00cfbf0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0005fd0 tx=0x7f1ce002a5d0 comp rx=0 tx=0).stop 2024-09-21T03:27:35.966 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.964+0000 7f1cf7c16640 1 -- 172.21.15.105:0/2197089829 shutdown_connections 2024-09-21T03:27:35.966 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.964+0000 7f1cf7c16640 1 --2- 172.21.15.105:0/2197089829 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1cf00cf7e0 0x7f1cf00cfbf0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:35.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.964+0000 7f1cf7c16640 1 --2- 172.21.15.105:0/2197089829 >> v2:172.21.15.162:3300/0 conn(0x7f1cf00b4150 0x7f1cf00b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:35.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.964+0000 7f1cf7c16640 1 -- 172.21.15.105:0/2197089829 >> 172.21.15.105:0/2197089829 conn(0x7f1cf009aa30 msgr2=0x7f1cf00b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:35.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.964+0000 7f1cf7c16640 1 -- 172.21.15.105:0/2197089829 shutdown_connections 2024-09-21T03:27:35.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.964+0000 7f1cf7c16640 1 -- 172.21.15.105:0/2197089829 wait complete. 2024-09-21T03:27:35.967 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.966+0000 7f1cf7c16640 1 Processor -- start 2024-09-21T03:27:35.968 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.966+0000 7f1cf7c16640 1 -- start start 2024-09-21T03:27:35.970 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.967+0000 7f1cf7c16640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cf00b4150 0x7f1cf01f76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:35.970 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.967+0000 7f1cf7c16640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1cf00ce8d0 0x7f1cf006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:35.970 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.967+0000 7f1cf7c16640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1cf00cf7e0 0x7f1cf014fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:35.970 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.967+0000 7f1cf7c16640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf00b4c20 con 0x7f1cf00cf7e0 2024-09-21T03:27:35.970 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.967+0000 7f1cf7c16640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf00b4aa0 con 0x7f1cf00b4150 2024-09-21T03:27:35.970 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.967+0000 7f1cf7c16640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1cf00b4da0 con 0x7f1cf00ce8d0 2024-09-21T03:27:35.971 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.967+0000 7f1cf61b3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1cf00cf7e0 0x7f1cf014fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:35.971 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.967+0000 7f1cf61b3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1cf00cf7e0 0x7f1cf014fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42172/0 (socket says 172.21.15.105:42172) 2024-09-21T03:27:35.971 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.968+0000 7f1cf61b3640 1 -- 172.21.15.105:0/3863098948 learned_addr learned my addr 172.21.15.105:0/3863098948 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:35.971 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.968+0000 7f1cf51b1640 1 --2- 172.21.15.105:0/3863098948 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1cf00ce8d0 0x7f1cf006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:35.971 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.968+0000 7f1cf59b2640 1 --2- 172.21.15.105:0/3863098948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cf00b4150 0x7f1cf01f76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:35.971 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.968+0000 7f1cf61b3640 1 -- 172.21.15.105:0/3863098948 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1cf00ce8d0 msgr2=0x7f1cf006d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:35.971 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.968+0000 7f1cf61b3640 1 --2- 172.21.15.105:0/3863098948 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1cf00ce8d0 0x7f1cf006d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:35.971 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.968+0000 7f1cf61b3640 1 -- 172.21.15.105:0/3863098948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cf00b4150 msgr2=0x7f1cf01f76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:35.971 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.968+0000 7f1cf61b3640 1 --2- 172.21.15.105:0/3863098948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cf00b4150 0x7f1cf01f76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:35.971 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.968+0000 7f1cf61b3640 1 -- 172.21.15.105:0/3863098948 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cf01f7be0 con 0x7f1cf00cf7e0 2024-09-21T03:27:35.971 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.968+0000 7f1cf61b3640 1 --2- 172.21.15.105:0/3863098948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1cf00cf7e0 0x7f1cf014fda0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f1ce800ebf0 tx=0x7f1ce800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:35.971 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.968+0000 7f1ce67fc640 1 -- 172.21.15.105:0/3863098948 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce8003b70 con 0x7f1cf00cf7e0 2024-09-21T03:27:35.971 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.968+0000 7f1ce67fc640 1 -- 172.21.15.105:0/3863098948 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ce8003d10 con 0x7f1cf00cf7e0 2024-09-21T03:27:35.971 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.968+0000 7f1cf7c16640 1 -- 172.21.15.105:0/3863098948 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cf00b1f60 con 0x7f1cf00cf7e0 2024-09-21T03:27:35.972 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.968+0000 7f1ce67fc640 1 -- 172.21.15.105:0/3863098948 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce8004280 con 0x7f1cf00cf7e0 2024-09-21T03:27:35.972 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.968+0000 7f1cf7c16640 1 -- 172.21.15.105:0/3863098948 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cf00b2520 con 0x7f1cf00cf7e0 2024-09-21T03:27:35.972 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.969+0000 7f1cf7c16640 1 -- 172.21.15.105:0/3863098948 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cf00b5270 con 0x7f1cf00cf7e0 2024-09-21T03:27:35.973 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.970+0000 7f1ce67fc640 1 -- 172.21.15.105:0/3863098948 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1ce8004420 con 0x7f1cf00cf7e0 2024-09-21T03:27:35.973 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.970+0000 7f1ce67fc640 1 --2- 172.21.15.105:0/3863098948 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1cd4078b90 0x7f1cd407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:35.973 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.971+0000 7f1ce67fc640 1 -- 172.21.15.105:0/3863098948 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5357+0+0 (secure 0 0 0) 0x7f1ce809b780 con 0x7f1cf00cf7e0 2024-09-21T03:27:35.973 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.971+0000 7f1cf59b2640 1 --2- 172.21.15.105:0/3863098948 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1cd4078b90 0x7f1cd407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:35.973 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.971+0000 7f1cf59b2640 1 --2- 172.21.15.105:0/3863098948 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1cd4078b90 0x7f1cd407b0a0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f1cec001720 tx=0x7f1cec009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:35.976 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:35.975+0000 7f1ce67fc640 1 -- 172.21.15.105:0/3863098948 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1cf01f7be0 con 0x7f1cf00cf7e0 2024-09-21T03:27:36.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.154+0000 7f1cf7c16640 1 -- 172.21.15.105:0/3863098948 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1cf006ef00 con 0x7f1cf00cf7e0 2024-09-21T03:27:36.828 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.826+0000 7f1ce67fc640 1 -- 172.21.15.105:0/3863098948 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v143) ==== 169+0+0 (secure 0 0 0) 0x7f1ce80636d0 con 0x7f1cf00cf7e0 2024-09-21T03:27:36.828 INFO:teuthology.orchestra.run.smithi105.stderr:pool 'cephfs_data' removed 2024-09-21T03:27:36.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.829+0000 7f1cf7c16640 1 -- 172.21.15.105:0/3863098948 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1cd4078b90 msgr2=0x7f1cd407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:36.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.829+0000 7f1cf7c16640 1 --2- 172.21.15.105:0/3863098948 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1cd4078b90 0x7f1cd407b0a0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f1cec001720 tx=0x7f1cec009040 comp rx=0 tx=0).stop 2024-09-21T03:27:36.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.829+0000 7f1cf7c16640 1 -- 172.21.15.105:0/3863098948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1cf00cf7e0 msgr2=0x7f1cf014fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:36.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.829+0000 7f1cf7c16640 1 --2- 172.21.15.105:0/3863098948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1cf00cf7e0 0x7f1cf014fda0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f1ce800ebf0 tx=0x7f1ce800c6a0 comp rx=0 tx=0).stop 2024-09-21T03:27:36.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.829+0000 7f1cf7c16640 1 -- 172.21.15.105:0/3863098948 shutdown_connections 2024-09-21T03:27:36.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.829+0000 7f1cf7c16640 1 --2- 172.21.15.105:0/3863098948 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1cd4078b90 0x7f1cd407b0a0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:36.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.829+0000 7f1cf7c16640 1 --2- 172.21.15.105:0/3863098948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1cf00cf7e0 0x7f1cf014fda0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:36.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.829+0000 7f1cf7c16640 1 --2- 172.21.15.105:0/3863098948 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1cf00ce8d0 0x7f1cf006d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:36.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.829+0000 7f1cf7c16640 1 --2- 172.21.15.105:0/3863098948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cf00b4150 0x7f1cf01f76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:36.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.829+0000 7f1cf7c16640 1 -- 172.21.15.105:0/3863098948 >> 172.21.15.105:0/3863098948 conn(0x7f1cf009aa30 msgr2=0x7f1cf009b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:36.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.830+0000 7f1cf7c16640 1 -- 172.21.15.105:0/3863098948 shutdown_connections 2024-09-21T03:27:36.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.830+0000 7f1cf7c16640 1 -- 172.21.15.105:0/3863098948 wait complete. 2024-09-21T03:27:36.845 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-21T03:27:36.959 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.957+0000 7fe870919640 1 -- 172.21.15.105:0/1347669336 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe86c15c830 msgr2=0x7fe86c160c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:36.959 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.957+0000 7fe870919640 1 --2- 172.21.15.105:0/1347669336 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe86c15c830 0x7fe86c160c90 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7fe864005fd0 tx=0x7fe86402a8b0 comp rx=0 tx=0).stop 2024-09-21T03:27:36.959 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.957+0000 7fe870919640 1 -- 172.21.15.105:0/1347669336 shutdown_connections 2024-09-21T03:27:36.959 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.957+0000 7fe870919640 1 --2- 172.21.15.105:0/1347669336 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe86c15c830 0x7fe86c160c90 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:36.959 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.957+0000 7fe870919640 1 -- 172.21.15.105:0/1347669336 >> 172.21.15.105:0/1347669336 conn(0x7fe86c0cee20 msgr2=0x7fe86c0cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:36.959 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.957+0000 7fe870919640 1 -- 172.21.15.105:0/1347669336 shutdown_connections 2024-09-21T03:27:36.959 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.957+0000 7fe870919640 1 -- 172.21.15.105:0/1347669336 wait complete. 2024-09-21T03:27:36.960 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.959+0000 7fe870919640 1 Processor -- start 2024-09-21T03:27:36.960 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.959+0000 7fe870919640 1 -- start start 2024-09-21T03:27:36.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.960+0000 7fe870919640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe86c0cff70 0x7fe86c1533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:36.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.960+0000 7fe870919640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe86c15c830 0x7fe86c154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:36.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.960+0000 7fe870919640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe86c0b4090 0x7fe86c155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:36.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.960+0000 7fe870919640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe86c0d1900 con 0x7fe86c15c830 2024-09-21T03:27:36.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.960+0000 7fe870919640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe86c0d1780 con 0x7fe86c0b4090 2024-09-21T03:27:36.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.960+0000 7fe870919640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe86c0d1a80 con 0x7fe86c0cff70 2024-09-21T03:27:36.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.960+0000 7fe869d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe86c15c830 0x7fe86c154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:36.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.960+0000 7fe869d9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe86c15c830 0x7fe86c154430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42188/0 (socket says 172.21.15.105:42188) 2024-09-21T03:27:36.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.960+0000 7fe869d9b640 1 -- 172.21.15.105:0/1184142321 learned_addr learned my addr 172.21.15.105:0/1184142321 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:36.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.960+0000 7fe86ad9d640 1 --2- 172.21.15.105:0/1184142321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe86c0b4090 0x7fe86c155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:36.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.960+0000 7fe86a59c640 1 --2- 172.21.15.105:0/1184142321 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe86c0cff70 0x7fe86c1533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:36.963 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.960+0000 7fe869d9b640 1 -- 172.21.15.105:0/1184142321 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe86c0cff70 msgr2=0x7fe86c1533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:36.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.960+0000 7fe869d9b640 1 --2- 172.21.15.105:0/1184142321 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe86c0cff70 0x7fe86c1533b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:36.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.960+0000 7fe869d9b640 1 -- 172.21.15.105:0/1184142321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe86c0b4090 msgr2=0x7fe86c155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:36.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.960+0000 7fe869d9b640 1 --2- 172.21.15.105:0/1184142321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe86c0b4090 0x7fe86c155430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:36.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.960+0000 7fe869d9b640 1 -- 172.21.15.105:0/1184142321 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe86c0c67e0 con 0x7fe86c15c830 2024-09-21T03:27:36.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.961+0000 7fe869d9b640 1 --2- 172.21.15.105:0/1184142321 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe86c15c830 0x7fe86c154430 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fe86000c430 tx=0x7fe86000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:36.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.961+0000 7fe85affd640 1 -- 172.21.15.105:0/1184142321 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe860017070 con 0x7fe86c15c830 2024-09-21T03:27:36.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.961+0000 7fe85affd640 1 -- 172.21.15.105:0/1184142321 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8600053c0 con 0x7fe86c15c830 2024-09-21T03:27:36.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.961+0000 7fe870919640 1 -- 172.21.15.105:0/1184142321 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe86c0c6ac0 con 0x7fe86c15c830 2024-09-21T03:27:36.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.961+0000 7fe85affd640 1 -- 172.21.15.105:0/1184142321 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe860003850 con 0x7fe86c15c830 2024-09-21T03:27:36.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.961+0000 7fe870919640 1 -- 172.21.15.105:0/1184142321 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe86c154f10 con 0x7fe86c15c830 2024-09-21T03:27:36.965 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.962+0000 7fe870919640 1 -- 172.21.15.105:0/1184142321 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe86c15b290 con 0x7fe86c15c830 2024-09-21T03:27:36.965 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.963+0000 7fe85affd640 1 -- 172.21.15.105:0/1184142321 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe86001a070 con 0x7fe86c15c830 2024-09-21T03:27:36.965 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.963+0000 7fe85affd640 1 --2- 172.21.15.105:0/1184142321 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe84c078b90 0x7fe84c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:36.965 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.963+0000 7fe85affd640 1 -- 172.21.15.105:0/1184142321 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 4943+0+0 (secure 0 0 0) 0x7fe860099d90 con 0x7fe86c15c830 2024-09-21T03:27:36.965 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.963+0000 7fe86a59c640 1 --2- 172.21.15.105:0/1184142321 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe84c078b90 0x7fe84c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:36.966 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.964+0000 7fe86a59c640 1 --2- 172.21.15.105:0/1184142321 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe84c078b90 0x7fe84c07b0a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fe85c000f60 tx=0x7fe85c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:36.969 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:36.968+0000 7fe85affd640 1 -- 172.21.15.105:0/1184142321 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe860061e80 con 0x7fe86c15c830 2024-09-21T03:27:37.147 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.145+0000 7fe870919640 1 -- 172.21.15.105:0/1184142321 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7fe86c15afb0 con 0x7fe86c15c830 2024-09-21T03:27:37.151 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.149+0000 7fe85affd640 1 -- 172.21.15.105:0/1184142321 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v70) ==== 71+0+0 (secure 0 0 0) 0x7fe8600668b0 con 0x7fe86c15c830 2024-09-21T03:27:37.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.151+0000 7fe870919640 1 -- 172.21.15.105:0/1184142321 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe84c078b90 msgr2=0x7fe84c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:37.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.151+0000 7fe870919640 1 --2- 172.21.15.105:0/1184142321 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe84c078b90 0x7fe84c07b0a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fe85c000f60 tx=0x7fe85c009040 comp rx=0 tx=0).stop 2024-09-21T03:27:37.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.151+0000 7fe870919640 1 -- 172.21.15.105:0/1184142321 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe86c15c830 msgr2=0x7fe86c154430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:37.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.151+0000 7fe870919640 1 --2- 172.21.15.105:0/1184142321 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe86c15c830 0x7fe86c154430 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fe86000c430 tx=0x7fe86000c8f0 comp rx=0 tx=0).stop 2024-09-21T03:27:37.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.151+0000 7fe870919640 1 -- 172.21.15.105:0/1184142321 shutdown_connections 2024-09-21T03:27:37.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.151+0000 7fe870919640 1 --2- 172.21.15.105:0/1184142321 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fe84c078b90 0x7fe84c07b0a0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:37.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.152+0000 7fe870919640 1 --2- 172.21.15.105:0/1184142321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe86c0b4090 0x7fe86c155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:37.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.152+0000 7fe870919640 1 --2- 172.21.15.105:0/1184142321 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe86c15c830 0x7fe86c154430 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:37.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.152+0000 7fe870919640 1 --2- 172.21.15.105:0/1184142321 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe86c0cff70 0x7fe86c1533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:37.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.152+0000 7fe870919640 1 -- 172.21.15.105:0/1184142321 >> 172.21.15.105:0/1184142321 conn(0x7fe86c0cee20 msgr2=0x7fe86c156930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:37.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.152+0000 7fe870919640 1 -- 172.21.15.105:0/1184142321 shutdown_connections 2024-09-21T03:27:37.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.152+0000 7fe870919640 1 -- 172.21.15.105:0/1184142321 wait complete. 2024-09-21T03:27:37.164 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_release_bug' 2024-09-21T03:27:37.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.274+0000 7f756629b640 1 -- 172.21.15.105:0/1884262677 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75601600b0 msgr2=0x7f75600ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:37.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.274+0000 7f756629b640 1 --2- 172.21.15.105:0/1884262677 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75601600b0 0x7f75600ccbc0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f7560074fd0 tx=0x7f755002a560 comp rx=0 tx=0).stop 2024-09-21T03:27:37.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.274+0000 7f756629b640 1 -- 172.21.15.105:0/1884262677 shutdown_connections 2024-09-21T03:27:37.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.274+0000 7f756629b640 1 --2- 172.21.15.105:0/1884262677 >> v2:172.21.15.162:3300/0 conn(0x7f75600cf150 0x7f75600b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:37.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.274+0000 7f756629b640 1 --2- 172.21.15.105:0/1884262677 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75600b7cc0 0x7f75600cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:37.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.274+0000 7f756629b640 1 --2- 172.21.15.105:0/1884262677 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75601600b0 0x7f75600ccbc0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:37.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.274+0000 7f756629b640 1 -- 172.21.15.105:0/1884262677 >> 172.21.15.105:0/1884262677 conn(0x7f756006d4f0 msgr2=0x7f7560071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:37.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.274+0000 7f756629b640 1 -- 172.21.15.105:0/1884262677 shutdown_connections 2024-09-21T03:27:37.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.274+0000 7f756629b640 1 -- 172.21.15.105:0/1884262677 wait complete. 2024-09-21T03:27:37.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.275+0000 7f756629b640 1 Processor -- start 2024-09-21T03:27:37.277 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.276+0000 7f756629b640 1 -- start start 2024-09-21T03:27:37.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.277+0000 7f756629b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75600b7cc0 0x7f75600c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:37.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.277+0000 7f756629b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75600cf150 0x7f7560151740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:37.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.277+0000 7f756629b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75601600b0 0x7f75600cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:37.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.277+0000 7f756629b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f75600b4620 con 0x7f75600b7cc0 2024-09-21T03:27:37.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.277+0000 7f756629b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f75600b44a0 con 0x7f75601600b0 2024-09-21T03:27:37.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.277+0000 7f756629b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f75600b47a0 con 0x7f75600cf150 2024-09-21T03:27:37.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.277+0000 7f755ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75600b7cc0 0x7f75600c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:37.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.277+0000 7f755ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75600b7cc0 0x7f75600c9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42202/0 (socket says 172.21.15.105:42202) 2024-09-21T03:27:37.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.277+0000 7f755ffff640 1 -- 172.21.15.105:0/1285500053 learned_addr learned my addr 172.21.15.105:0/1285500053 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:37.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.277+0000 7f7564838640 1 --2- 172.21.15.105:0/1285500053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75601600b0 0x7f75600cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:37.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.277+0000 7f755ffff640 1 -- 172.21.15.105:0/1285500053 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75600cf150 msgr2=0x7f7560151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:37.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.277+0000 7f755f7fe640 1 --2- 172.21.15.105:0/1285500053 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75600cf150 0x7f7560151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:37.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.277+0000 7f755ffff640 1 --2- 172.21.15.105:0/1285500053 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75600cf150 0x7f7560151740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:37.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.277+0000 7f755ffff640 1 -- 172.21.15.105:0/1285500053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75601600b0 msgr2=0x7f75600cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:37.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.277+0000 7f755ffff640 1 --2- 172.21.15.105:0/1285500053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75601600b0 0x7f75600cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:37.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.277+0000 7f755ffff640 1 -- 172.21.15.105:0/1285500053 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75600ca280 con 0x7f75600b7cc0 2024-09-21T03:27:37.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.277+0000 7f7564838640 1 --2- 172.21.15.105:0/1285500053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75601600b0 0x7f75600cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:27:37.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.277+0000 7f755f7fe640 1 --2- 172.21.15.105:0/1285500053 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75600cf150 0x7f7560151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:27:37.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.278+0000 7f755ffff640 1 --2- 172.21.15.105:0/1285500053 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75600b7cc0 0x7f75600c9d40 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f7550000c00 tx=0x7f75500039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:37.281 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.278+0000 7f755cff9640 1 -- 172.21.15.105:0/1285500053 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755003e030 con 0x7f75600b7cc0 2024-09-21T03:27:37.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.278+0000 7f755cff9640 1 -- 172.21.15.105:0/1285500053 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75500047a0 con 0x7f75600b7cc0 2024-09-21T03:27:37.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.278+0000 7f755cff9640 1 -- 172.21.15.105:0/1285500053 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7550035040 con 0x7f75600b7cc0 2024-09-21T03:27:37.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.278+0000 7f756629b640 1 -- 172.21.15.105:0/1285500053 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7560151c80 con 0x7f75600b7cc0 2024-09-21T03:27:37.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.278+0000 7f756629b640 1 -- 172.21.15.105:0/1285500053 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75600caa50 con 0x7f75600b7cc0 2024-09-21T03:27:37.282 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.279+0000 7f756629b640 1 -- 172.21.15.105:0/1285500053 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75600b3d50 con 0x7f75600b7cc0 2024-09-21T03:27:37.283 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.280+0000 7f755cff9640 1 -- 172.21.15.105:0/1285500053 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7550041030 con 0x7f75600b7cc0 2024-09-21T03:27:37.283 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.280+0000 7f755cff9640 1 --2- 172.21.15.105:0/1285500053 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f754c078bc0 0x7f754c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:37.283 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.280+0000 7f755cff9640 1 -- 172.21.15.105:0/1285500053 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 4943+0+0 (secure 0 0 0) 0x7f75500bb730 con 0x7f75600b7cc0 2024-09-21T03:27:37.283 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.280+0000 7f755f7fe640 1 --2- 172.21.15.105:0/1285500053 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f754c078bc0 0x7f754c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:37.283 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.281+0000 7f755f7fe640 1 --2- 172.21.15.105:0/1285500053 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f754c078bc0 0x7f754c07b0d0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f75601f92a0 tx=0x7f7554005c00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:37.285 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.284+0000 7f755cff9640 1 -- 172.21.15.105:0/1285500053 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7550083f50 con 0x7f75600b7cc0 2024-09-21T03:27:37.530 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.528+0000 7f756629b640 1 -- 172.21.15.105:0/1285500053 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_release_bug"]} v 0) -- 0x7f75600ccd10 con 0x7f75600b7cc0 2024-09-21T03:27:37.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.839+0000 7f755cff9640 1 -- 172.21.15.105:0/1285500053 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_release_bug"]}]=0 v463) ==== 151+0+0 (secure 0 0 0) 0x7f7550083850 con 0x7f75600b7cc0 2024-09-21T03:27:37.844 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.842+0000 7f756629b640 1 -- 172.21.15.105:0/1285500053 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f754c078bc0 msgr2=0x7f754c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:37.844 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.842+0000 7f756629b640 1 --2- 172.21.15.105:0/1285500053 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f754c078bc0 0x7f754c07b0d0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f75601f92a0 tx=0x7f7554005c00 comp rx=0 tx=0).stop 2024-09-21T03:27:37.844 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.842+0000 7f756629b640 1 -- 172.21.15.105:0/1285500053 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75600b7cc0 msgr2=0x7f75600c9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:37.844 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.842+0000 7f756629b640 1 --2- 172.21.15.105:0/1285500053 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75600b7cc0 0x7f75600c9d40 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f7550000c00 tx=0x7f75500039e0 comp rx=0 tx=0).stop 2024-09-21T03:27:37.844 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.842+0000 7f756629b640 1 -- 172.21.15.105:0/1285500053 shutdown_connections 2024-09-21T03:27:37.844 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.842+0000 7f756629b640 1 --2- 172.21.15.105:0/1285500053 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f754c078bc0 0x7f754c07b0d0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:37.844 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.842+0000 7f756629b640 1 --2- 172.21.15.105:0/1285500053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75601600b0 0x7f75600cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:37.844 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.842+0000 7f756629b640 1 --2- 172.21.15.105:0/1285500053 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75600cf150 0x7f7560151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:37.844 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.842+0000 7f756629b640 1 --2- 172.21.15.105:0/1285500053 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75600b7cc0 0x7f75600c9d40 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:37.844 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.842+0000 7f756629b640 1 -- 172.21.15.105:0/1285500053 >> 172.21.15.105:0/1285500053 conn(0x7f756006d4f0 msgr2=0x7f75600d2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:37.844 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.842+0000 7f756629b640 1 -- 172.21.15.105:0/1285500053 shutdown_connections 2024-09-21T03:27:37.845 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:37.842+0000 7f756629b640 1 -- 172.21.15.105:0/1285500053 wait complete. 2024-09-21T03:27:37.855 INFO:tasks.cephfs_test_runner:When a client has a bug (which we will simulate) preventing it from releasing caps, ... skipped 'Require FUSE client to inject client release failure' 2024-09-21T03:27:37.855 INFO:tasks.cephfs_test_runner: 2024-09-21T03:27:37.855 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-21T03:27:37.855 INFO:tasks.cephfs_test_runner:Ran 10 tests in 523.051s 2024-09-21T03:27:37.855 INFO:tasks.cephfs_test_runner: 2024-09-21T03:27:37.855 INFO:tasks.cephfs_test_runner:OK (skipped=4) 2024-09-21T03:27:37.856 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-21T03:27:37.865 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-21T03:27:37.875 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-21T03:27:37.875 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:27:37.875 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:27:37.892 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T03:27:37.892 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-21T03:27:37.892 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:27:37.949 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T03:27:37.949 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:27:37.949 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:27:37.968 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=452 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T03:27:37.968 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-21T03:27:37.968 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:27:38.027 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=452 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T03:27:38.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:27:38.028 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-09-21T03:27:38.043 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T03:27:38.043 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T03:27:38.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:27:38.043 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T03:27:38.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:27:38.109 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T03:27:38.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:27:38.176 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link delete ceph-brx 2024-09-21T03:27:38.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:27:38.259 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-09-21T03:27:38.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:27:38.315 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link delete ceph-brx 2024-09-21T03:27:38.383 INFO:teuthology.orchestra.run.smithi105.stderr:Cannot find device "ceph-brx" 2024-09-21T03:27:38.384 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:27:38.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:27:38.385 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-09-21T03:27:38.404 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-21T03:27:38.404 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-21T03:27:38.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:27:38.405 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-21T03:27:38.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:27:38.475 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T03:27:38.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:27:38.545 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link delete ceph-brx 2024-09-21T03:27:38.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:27:38.641 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-09-21T03:27:38.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:27:38.657 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link delete ceph-brx 2024-09-21T03:27:38.726 INFO:teuthology.orchestra.run.smithi162.stderr:Cannot find device "ceph-brx" 2024-09-21T03:27:38.727 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:27:38.727 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-21T03:27:38.736 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T03:27:38.737 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:27:38.851 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:38.849+0000 7f232eaa2640 1 -- 172.21.15.105:0/139543458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23280d1d60 msgr2=0x7f232815c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:38.853 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:38.849+0000 7f232eaa2640 1 --2- 172.21.15.105:0/139543458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23280d1d60 0x7f232815c820 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f2324009830 tx=0x7f232402a530 comp rx=0 tx=0).stop 2024-09-21T03:27:38.853 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:38.849+0000 7f232eaa2640 1 -- 172.21.15.105:0/139543458 shutdown_connections 2024-09-21T03:27:38.853 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:38.849+0000 7f232eaa2640 1 --2- 172.21.15.105:0/139543458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23280d1d60 0x7f232815c820 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:38.853 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:38.849+0000 7f232eaa2640 1 -- 172.21.15.105:0/139543458 >> 172.21.15.105:0/139543458 conn(0x7f23280cedc0 msgr2=0x7f23280cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:38.853 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:38.849+0000 7f232eaa2640 1 -- 172.21.15.105:0/139543458 shutdown_connections 2024-09-21T03:27:38.854 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:38.849+0000 7f232eaa2640 1 -- 172.21.15.105:0/139543458 wait complete. 2024-09-21T03:27:38.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:38.851+0000 7f232eaa2640 1 Processor -- start 2024-09-21T03:27:38.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:38.851+0000 7f232eaa2640 1 -- start start 2024-09-21T03:27:38.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:38.852+0000 7f232eaa2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23280d1d60 0x7f232806fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:38.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:38.852+0000 7f232eaa2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f232815cd60 0x7f23281f9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:38.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:38.852+0000 7f232eaa2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23280b0da0 0x7f23280cb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:38.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:38.852+0000 7f232eaa2640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f23280d0ad0 con 0x7f232815cd60 2024-09-21T03:27:38.856 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:38.852+0000 7f232eaa2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f23280d0950 con 0x7f23280b0da0 2024-09-21T03:27:38.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:38.852+0000 7f232eaa2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f23280d0c50 con 0x7f23280d1d60 2024-09-21T03:27:38.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:38.852+0000 7f231ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f232815cd60 0x7f23281f9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:38.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:38.852+0000 7f231ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f232815cd60 0x7f23281f9670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42210/0 (socket says 172.21.15.105:42210) 2024-09-21T03:27:38.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:38.852+0000 7f231ffff640 1 -- 172.21.15.105:0/2166096232 learned_addr learned my addr 172.21.15.105:0/2166096232 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:38.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:38.853+0000 7f232d03f640 1 --2- 172.21.15.105:0/2166096232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23280b0da0 0x7f23280cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:38.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:38.853+0000 7f232c83e640 1 --2- 172.21.15.105:0/2166096232 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23280d1d60 0x7f232806fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:38.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:38.853+0000 7f231ffff640 1 -- 172.21.15.105:0/2166096232 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23280d1d60 msgr2=0x7f232806fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:38.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:38.853+0000 7f231ffff640 1 --2- 172.21.15.105:0/2166096232 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23280d1d60 0x7f232806fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:38.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:38.853+0000 7f231ffff640 1 -- 172.21.15.105:0/2166096232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23280b0da0 msgr2=0x7f23280cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:38.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:38.853+0000 7f231ffff640 1 --2- 172.21.15.105:0/2166096232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23280b0da0 0x7f23280cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:38.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:38.853+0000 7f231ffff640 1 -- 172.21.15.105:0/2166096232 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23281f8bd0 con 0x7f232815cd60 2024-09-21T03:27:38.857 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:38.853+0000 7f232d03f640 1 --2- 172.21.15.105:0/2166096232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23280b0da0 0x7f23280cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:27:38.858 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:38.853+0000 7f232c83e640 1 --2- 172.21.15.105:0/2166096232 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23280d1d60 0x7f232806fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:27:38.858 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:38.853+0000 7f231ffff640 1 --2- 172.21.15.105:0/2166096232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f232815cd60 0x7f23281f9670 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f231800c410 tx=0x7f231800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:38.858 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:38.853+0000 7f231d7fa640 1 -- 172.21.15.105:0/2166096232 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2318011790 con 0x7f232815cd60 2024-09-21T03:27:38.858 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:38.853+0000 7f231d7fa640 1 -- 172.21.15.105:0/2166096232 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2318017070 con 0x7f232815cd60 2024-09-21T03:27:38.858 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:38.853+0000 7f232eaa2640 1 -- 172.21.15.105:0/2166096232 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23281f61a0 con 0x7f232815cd60 2024-09-21T03:27:38.858 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:38.853+0000 7f231d7fa640 1 -- 172.21.15.105:0/2166096232 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2318011cc0 con 0x7f232815cd60 2024-09-21T03:27:38.858 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:38.853+0000 7f232eaa2640 1 -- 172.21.15.105:0/2166096232 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23281f9150 con 0x7f232815cd60 2024-09-21T03:27:38.858 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:38.854+0000 7f232eaa2640 1 -- 172.21.15.105:0/2166096232 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f232815c820 con 0x7f232815cd60 2024-09-21T03:27:38.859 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:38.855+0000 7f231d7fa640 1 -- 172.21.15.105:0/2166096232 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f231801c460 con 0x7f232815cd60 2024-09-21T03:27:38.859 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:38.855+0000 7f231d7fa640 1 --2- 172.21.15.105:0/2166096232 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2314078bc0 0x7f231407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:38.859 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:38.855+0000 7f231d7fa640 1 -- 172.21.15.105:0/2166096232 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 4943+0+0 (secure 0 0 0) 0x7f231809a8d0 con 0x7f232815cd60 2024-09-21T03:27:38.859 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:38.856+0000 7f232c83e640 1 --2- 172.21.15.105:0/2166096232 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2314078bc0 0x7f231407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:38.859 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:38.856+0000 7f232c83e640 1 --2- 172.21.15.105:0/2166096232 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2314078bc0 0x7f231407b0d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f2324034000 tx=0x7f2324004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:38.861 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:38.860+0000 7f231d7fa640 1 -- 172.21.15.105:0/2166096232 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2318063010 con 0x7f232815cd60 2024-09-21T03:27:39.036 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.035+0000 7f232eaa2640 1 -- 172.21.15.105:0/2166096232 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f232815b630 con 0x7f2314078bc0 2024-09-21T03:27:39.037 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.036+0000 7f231d7fa640 1 -- 172.21.15.105:0/2166096232 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13430 (secure 0 0 0) 0x7f232815b630 con 0x7f2314078bc0 2024-09-21T03:27:39.038 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:27:39.038 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:27:39.040 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.038+0000 7f232eaa2640 1 -- 172.21.15.105:0/2166096232 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2314078bc0 msgr2=0x7f231407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:39.040 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.038+0000 7f232eaa2640 1 --2- 172.21.15.105:0/2166096232 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2314078bc0 0x7f231407b0d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f2324034000 tx=0x7f2324004730 comp rx=0 tx=0).stop 2024-09-21T03:27:39.040 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.038+0000 7f232eaa2640 1 -- 172.21.15.105:0/2166096232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f232815cd60 msgr2=0x7f23281f9670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:39.040 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.038+0000 7f232eaa2640 1 --2- 172.21.15.105:0/2166096232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f232815cd60 0x7f23281f9670 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f231800c410 tx=0x7f231800c8d0 comp rx=0 tx=0).stop 2024-09-21T03:27:39.040 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.038+0000 7f232eaa2640 1 -- 172.21.15.105:0/2166096232 shutdown_connections 2024-09-21T03:27:39.040 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.038+0000 7f232eaa2640 1 --2- 172.21.15.105:0/2166096232 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f2314078bc0 0x7f231407b0d0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:39.040 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.038+0000 7f232eaa2640 1 --2- 172.21.15.105:0/2166096232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23280b0da0 0x7f23280cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:39.041 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.038+0000 7f232eaa2640 1 --2- 172.21.15.105:0/2166096232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f232815cd60 0x7f23281f9670 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:39.041 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.038+0000 7f232eaa2640 1 --2- 172.21.15.105:0/2166096232 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23280d1d60 0x7f232806fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:39.041 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.038+0000 7f232eaa2640 1 -- 172.21.15.105:0/2166096232 >> 172.21.15.105:0/2166096232 conn(0x7f23280cedc0 msgr2=0x7f232815f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:39.041 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.038+0000 7f232eaa2640 1 -- 172.21.15.105:0/2166096232 shutdown_connections 2024-09-21T03:27:39.041 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.038+0000 7f232eaa2640 1 -- 172.21.15.105:0/2166096232 wait complete. 2024-09-21T03:27:39.051 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":417,"stamp":"2024-09-21T03:27:37.427087+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":272784,"kb_used_data":14960,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754701936,"statfs":{"total":773094113280,"available":772814782464,"internally_reserved":0,"allocated":15319040,"data_stored":7234931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2410,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001557"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":336,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-21T03:27:33.499264+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:27:33.499264+0000","last_peered":"2024-09-21T03:27:33.499264+0000","last_clean":"2024-09-21T03:27:33.499264+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:27:33.499264+0000","last_undegraded":"2024-09-21T03:27:33.499264+0000","last_fullsized":"2024-09-21T03:27:33.499264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509556,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33500,"kb_used_data":2316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338340,"statfs":{"total":96636764160,"available":96602460160,"internally_reserved":0,"allocated":2371584,"data_stored":1347959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509555,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32904,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338936,"statfs":{"total":96636764160,"available":96603070464,"internally_reserved":0,"allocated":1757184,"data_stored":753478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509554,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32908,"kb_used_data":1720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338932,"statfs":{"total":96636764160,"available":96603066368,"internally_reserved":0,"allocated":1761280,"data_stored":754060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509554,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32912,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338928,"statfs":{"total":96636764160,"available":96603062272,"internally_reserved":0,"allocated":1769472,"data_stored":756919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509555,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32916,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338924,"statfs":{"total":96636764160,"available":96603058176,"internally_reserved":0,"allocated":1769472,"data_stored":759571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509555,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37072,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334768,"statfs":{"total":96636764160,"available":96598802432,"internally_reserved":0,"allocated":1757184,"data_stored":753546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509555,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37064,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334776,"statfs":{"total":96636764160,"available":96598810624,"internally_reserved":0,"allocated":1757184,"data_stored":753490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574963,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33508,"kb_used_data":2320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338332,"statfs":{"total":96636764160,"available":96602451968,"internally_reserved":0,"allocated":2375680,"data_stored":1355908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:27:39.052 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:27:39.165 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.163+0000 7ff9d77e4640 1 -- 172.21.15.105:0/1274522807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9d00cff40 msgr2=0x7ff9d015d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:39.165 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.163+0000 7ff9d77e4640 1 --2- 172.21.15.105:0/1274522807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9d00cff40 0x7ff9d015d7d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc009830 tx=0x7ff9cc02a510 comp rx=0 tx=0).stop 2024-09-21T03:27:39.165 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.163+0000 7ff9d77e4640 1 -- 172.21.15.105:0/1274522807 shutdown_connections 2024-09-21T03:27:39.165 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.163+0000 7ff9d77e4640 1 --2- 172.21.15.105:0/1274522807 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9d00cd370 0x7ff9d015dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:39.165 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.163+0000 7ff9d77e4640 1 --2- 172.21.15.105:0/1274522807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9d00cff40 0x7ff9d015d7d0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:39.165 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.163+0000 7ff9d77e4640 1 -- 172.21.15.105:0/1274522807 >> 172.21.15.105:0/1274522807 conn(0x7ff9d006d230 msgr2=0x7ff9d006d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:39.165 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.163+0000 7ff9d77e4640 1 -- 172.21.15.105:0/1274522807 shutdown_connections 2024-09-21T03:27:39.165 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.163+0000 7ff9d77e4640 1 -- 172.21.15.105:0/1274522807 wait complete. 2024-09-21T03:27:39.166 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.164+0000 7ff9d77e4640 1 Processor -- start 2024-09-21T03:27:39.166 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.165+0000 7ff9d77e4640 1 -- start start 2024-09-21T03:27:39.169 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.166+0000 7ff9d77e4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9d00cff40 0x7ff9d0151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:39.169 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.166+0000 7ff9d77e4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9d015c8b0 0x7ff9d0155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:39.169 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.166+0000 7ff9d77e4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9d00b7c00 0x7ff9d0155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:39.169 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.166+0000 7ff9d77e4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d015eb10 con 0x7ff9d00cff40 2024-09-21T03:27:39.169 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.166+0000 7ff9d77e4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d015e990 con 0x7ff9d00b7c00 2024-09-21T03:27:39.169 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.166+0000 7ff9d77e4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff9d015ec90 con 0x7ff9d015c8b0 2024-09-21T03:27:39.169 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.166+0000 7ff9d5580640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9d00cff40 0x7ff9d0151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:39.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.166+0000 7ff9d5580640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9d00cff40 0x7ff9d0151b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42226/0 (socket says 172.21.15.105:42226) 2024-09-21T03:27:39.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.166+0000 7ff9d5580640 1 -- 172.21.15.105:0/3017824337 learned_addr learned my addr 172.21.15.105:0/3017824337 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:39.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.166+0000 7ff9d5d81640 1 --2- 172.21.15.105:0/3017824337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9d00b7c00 0x7ff9d0155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:39.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.166+0000 7ff9d4d7f640 1 --2- 172.21.15.105:0/3017824337 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9d015c8b0 0x7ff9d0155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:39.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.166+0000 7ff9d5580640 1 -- 172.21.15.105:0/3017824337 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9d015c8b0 msgr2=0x7ff9d0155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:39.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.166+0000 7ff9d5580640 1 --2- 172.21.15.105:0/3017824337 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9d015c8b0 0x7ff9d0155610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:39.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.166+0000 7ff9d5580640 1 -- 172.21.15.105:0/3017824337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9d00b7c00 msgr2=0x7ff9d0155b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:39.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.166+0000 7ff9d5580640 1 --2- 172.21.15.105:0/3017824337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9d00b7c00 0x7ff9d0155b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:39.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.166+0000 7ff9d5580640 1 -- 172.21.15.105:0/3017824337 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9d00b76b0 con 0x7ff9d00cff40 2024-09-21T03:27:39.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.166+0000 7ff9d5580640 1 --2- 172.21.15.105:0/3017824337 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9d00cff40 0x7ff9d0151b00 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc009950 tx=0x7ff9cc033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:39.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.167+0000 7ff9c5ffb640 1 -- 172.21.15.105:0/3017824337 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc005c90 con 0x7ff9d00cff40 2024-09-21T03:27:39.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.167+0000 7ff9c5ffb640 1 -- 172.21.15.105:0/3017824337 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff9cc031e50 con 0x7ff9d00cff40 2024-09-21T03:27:39.170 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.167+0000 7ff9d77e4640 1 -- 172.21.15.105:0/3017824337 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9d0152040 con 0x7ff9d00cff40 2024-09-21T03:27:39.171 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.167+0000 7ff9c5ffb640 1 -- 172.21.15.105:0/3017824337 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc005260 con 0x7ff9d00cff40 2024-09-21T03:27:39.171 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.167+0000 7ff9d77e4640 1 -- 172.21.15.105:0/3017824337 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9d01e7710 con 0x7ff9d00cff40 2024-09-21T03:27:39.171 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.168+0000 7ff9d77e4640 1 -- 172.21.15.105:0/3017824337 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9d015f220 con 0x7ff9d00cff40 2024-09-21T03:27:39.172 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.169+0000 7ff9c5ffb640 1 -- 172.21.15.105:0/3017824337 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff9cc005400 con 0x7ff9d00cff40 2024-09-21T03:27:39.172 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.169+0000 7ff9c5ffb640 1 --2- 172.21.15.105:0/3017824337 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff9b4078b90 0x7ff9b407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:39.172 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.170+0000 7ff9c5ffb640 1 -- 172.21.15.105:0/3017824337 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 4943+0+0 (secure 0 0 0) 0x7ff9cc0bbb40 con 0x7ff9d00cff40 2024-09-21T03:27:39.172 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.170+0000 7ff9d4d7f640 1 --2- 172.21.15.105:0/3017824337 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff9b4078b90 0x7ff9b407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:39.172 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.170+0000 7ff9d4d7f640 1 --2- 172.21.15.105:0/3017824337 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff9b4078b90 0x7ff9b407b0a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7ff9d01e81f0 tx=0x7ff9c0007eb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:39.175 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.174+0000 7ff9c5ffb640 1 -- 172.21.15.105:0/3017824337 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff9cc03f030 con 0x7ff9d00cff40 2024-09-21T03:27:39.348 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.346+0000 7ff9d77e4640 1 -- 172.21.15.105:0/3017824337 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff9d00c8c60 con 0x7ff9b4078b90 2024-09-21T03:27:39.349 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.348+0000 7ff9c5ffb640 1 -- 172.21.15.105:0/3017824337 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13430 (secure 0 0 0) 0x7ff9d00c8c60 con 0x7ff9b4078b90 2024-09-21T03:27:39.349 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:27:39.350 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:27:39.352 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.350+0000 7ff9d77e4640 1 -- 172.21.15.105:0/3017824337 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff9b4078b90 msgr2=0x7ff9b407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:39.352 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.350+0000 7ff9d77e4640 1 --2- 172.21.15.105:0/3017824337 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff9b4078b90 0x7ff9b407b0a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7ff9d01e81f0 tx=0x7ff9c0007eb0 comp rx=0 tx=0).stop 2024-09-21T03:27:39.352 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.350+0000 7ff9d77e4640 1 -- 172.21.15.105:0/3017824337 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9d00cff40 msgr2=0x7ff9d0151b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:39.352 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.350+0000 7ff9d77e4640 1 --2- 172.21.15.105:0/3017824337 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9d00cff40 0x7ff9d0151b00 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc009950 tx=0x7ff9cc033c20 comp rx=0 tx=0).stop 2024-09-21T03:27:39.352 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.350+0000 7ff9d77e4640 1 -- 172.21.15.105:0/3017824337 shutdown_connections 2024-09-21T03:27:39.352 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.350+0000 7ff9d77e4640 1 --2- 172.21.15.105:0/3017824337 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff9b4078b90 0x7ff9b407b0a0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:39.352 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.350+0000 7ff9d77e4640 1 --2- 172.21.15.105:0/3017824337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9d00b7c00 0x7ff9d0155b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:39.352 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.350+0000 7ff9d77e4640 1 --2- 172.21.15.105:0/3017824337 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9d015c8b0 0x7ff9d0155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:39.353 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.350+0000 7ff9d77e4640 1 --2- 172.21.15.105:0/3017824337 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9d00cff40 0x7ff9d0151b00 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:39.353 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.350+0000 7ff9d77e4640 1 -- 172.21.15.105:0/3017824337 >> 172.21.15.105:0/3017824337 conn(0x7ff9d006d230 msgr2=0x7ff9d0068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:39.353 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.350+0000 7ff9d77e4640 1 -- 172.21.15.105:0/3017824337 shutdown_connections 2024-09-21T03:27:39.353 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.350+0000 7ff9d77e4640 1 -- 172.21.15.105:0/3017824337 wait complete. 2024-09-21T03:27:39.363 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":417,"stamp":"2024-09-21T03:27:37.427087+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":272784,"kb_used_data":14960,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754701936,"statfs":{"total":773094113280,"available":772814782464,"internally_reserved":0,"allocated":15319040,"data_stored":7234931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2410,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001557"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":336,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-21T03:27:33.499264+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:27:33.499264+0000","last_peered":"2024-09-21T03:27:33.499264+0000","last_clean":"2024-09-21T03:27:33.499264+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:27:33.499264+0000","last_undegraded":"2024-09-21T03:27:33.499264+0000","last_fullsized":"2024-09-21T03:27:33.499264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509556,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33500,"kb_used_data":2316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338340,"statfs":{"total":96636764160,"available":96602460160,"internally_reserved":0,"allocated":2371584,"data_stored":1347959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509555,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32904,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338936,"statfs":{"total":96636764160,"available":96603070464,"internally_reserved":0,"allocated":1757184,"data_stored":753478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509554,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32908,"kb_used_data":1720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338932,"statfs":{"total":96636764160,"available":96603066368,"internally_reserved":0,"allocated":1761280,"data_stored":754060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509554,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32912,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338928,"statfs":{"total":96636764160,"available":96603062272,"internally_reserved":0,"allocated":1769472,"data_stored":756919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509555,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32916,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338924,"statfs":{"total":96636764160,"available":96603058176,"internally_reserved":0,"allocated":1769472,"data_stored":759571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509555,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37072,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334768,"statfs":{"total":96636764160,"available":96598802432,"internally_reserved":0,"allocated":1757184,"data_stored":753546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509555,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37064,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334776,"statfs":{"total":96636764160,"available":96598810624,"internally_reserved":0,"allocated":1757184,"data_stored":753490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574963,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33508,"kb_used_data":2320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338332,"statfs":{"total":96636764160,"available":96602451968,"internally_reserved":0,"allocated":2375680,"data_stored":1355908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:27:39.364 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T03:27:39.364 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:27:39.476 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.474+0000 7faae7b58640 1 -- 172.21.15.105:0/1377507721 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faae00cfb00 msgr2=0x7faae015bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:39.476 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.474+0000 7faae7b58640 1 --2- 172.21.15.105:0/1377507721 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faae00cfb00 0x7faae015bf20 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7faae00cdc20 tx=0x7faad002aac0 comp rx=0 tx=0).stop 2024-09-21T03:27:39.476 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.474+0000 7faae7b58640 1 -- 172.21.15.105:0/1377507721 shutdown_connections 2024-09-21T03:27:39.476 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.474+0000 7faae7b58640 1 --2- 172.21.15.105:0/1377507721 >> v2:172.21.15.162:3300/0 conn(0x7faae00cb0b0 0x7faae006ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:39.476 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.474+0000 7faae7b58640 1 --2- 172.21.15.105:0/1377507721 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faae00cfb00 0x7faae015bf20 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:39.476 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.474+0000 7faae7b58640 1 -- 172.21.15.105:0/1377507721 >> 172.21.15.105:0/1377507721 conn(0x7faae00b1cb0 msgr2=0x7faae00b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:39.476 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.474+0000 7faae7b58640 1 -- 172.21.15.105:0/1377507721 shutdown_connections 2024-09-21T03:27:39.476 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.474+0000 7faae7b58640 1 -- 172.21.15.105:0/1377507721 wait complete. 2024-09-21T03:27:39.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.476+0000 7faae7b58640 1 Processor -- start 2024-09-21T03:27:39.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.476+0000 7faae7b58640 1 -- start start 2024-09-21T03:27:39.480 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.477+0000 7faae7b58640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faae00cf160 0x7faae009db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:39.480 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.477+0000 7faae7b58640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faae00cfb00 0x7faae01f5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:39.480 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.477+0000 7faae7b58640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faae0154500 0x7faae01f6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:39.480 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.477+0000 7faae7b58640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7faae006f3d0 con 0x7faae00cfb00 2024-09-21T03:27:39.480 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.477+0000 7faae7b58640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faae00cf780 con 0x7faae0154500 2024-09-21T03:27:39.480 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.477+0000 7faae7b58640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faae006f550 con 0x7faae00cf160 2024-09-21T03:27:39.480 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.477+0000 7faae50f3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faae00cfb00 0x7faae01f5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:39.481 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.477+0000 7faae50f3640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faae00cfb00 0x7faae01f5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42254/0 (socket says 172.21.15.105:42254) 2024-09-21T03:27:39.481 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.477+0000 7faae50f3640 1 -- 172.21.15.105:0/2073542973 learned_addr learned my addr 172.21.15.105:0/2073542973 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:39.481 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.477+0000 7faae60f5640 1 --2- 172.21.15.105:0/2073542973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faae0154500 0x7faae01f6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:39.481 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.477+0000 7faae58f4640 1 --2- 172.21.15.105:0/2073542973 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faae00cf160 0x7faae009db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:39.481 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.477+0000 7faae50f3640 1 -- 172.21.15.105:0/2073542973 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faae00cf160 msgr2=0x7faae009db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:39.481 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.477+0000 7faae50f3640 1 --2- 172.21.15.105:0/2073542973 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faae00cf160 0x7faae009db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:39.481 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.477+0000 7faae50f3640 1 -- 172.21.15.105:0/2073542973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faae0154500 msgr2=0x7faae01f6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:39.481 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.477+0000 7faae50f3640 1 --2- 172.21.15.105:0/2073542973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faae0154500 0x7faae01f6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:39.481 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.477+0000 7faae50f3640 1 -- 172.21.15.105:0/2073542973 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faae009e080 con 0x7faae00cfb00 2024-09-21T03:27:39.481 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.477+0000 7faae60f5640 1 --2- 172.21.15.105:0/2073542973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faae0154500 0x7faae01f6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:27:39.481 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.477+0000 7faae58f4640 1 --2- 172.21.15.105:0/2073542973 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faae00cf160 0x7faae009db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:27:39.481 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.478+0000 7faae50f3640 1 --2- 172.21.15.105:0/2073542973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faae00cfb00 0x7faae01f5c00 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7faad400c3f0 tx=0x7faad400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:39.481 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.478+0000 7faade7fc640 1 -- 172.21.15.105:0/2073542973 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad4017070 con 0x7faae00cfb00 2024-09-21T03:27:39.481 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.478+0000 7faade7fc640 1 -- 172.21.15.105:0/2073542973 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faad40035f0 con 0x7faae00cfb00 2024-09-21T03:27:39.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.478+0000 7faae7b58640 1 -- 172.21.15.105:0/2073542973 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faae01f6140 con 0x7faae00cfb00 2024-09-21T03:27:39.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.478+0000 7faade7fc640 1 -- 172.21.15.105:0/2073542973 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad4003a40 con 0x7faae00cfb00 2024-09-21T03:27:39.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.478+0000 7faae7b58640 1 -- 172.21.15.105:0/2073542973 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faae009d060 con 0x7faae00cfb00 2024-09-21T03:27:39.482 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.479+0000 7faae7b58640 1 -- 172.21.15.105:0/2073542973 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faae009b390 con 0x7faae00cfb00 2024-09-21T03:27:39.483 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.480+0000 7faade7fc640 1 -- 172.21.15.105:0/2073542973 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faad401a070 con 0x7faae00cfb00 2024-09-21T03:27:39.483 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.480+0000 7faade7fc640 1 --2- 172.21.15.105:0/2073542973 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7faacc078b90 0x7faacc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:39.483 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.480+0000 7faade7fc640 1 -- 172.21.15.105:0/2073542973 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 4943+0+0 (secure 0 0 0) 0x7faad409a0a0 con 0x7faae00cfb00 2024-09-21T03:27:39.483 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.481+0000 7faae58f4640 1 --2- 172.21.15.105:0/2073542973 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7faacc078b90 0x7faacc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:39.483 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.481+0000 7faae58f4640 1 --2- 172.21.15.105:0/2073542973 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7faacc078b90 0x7faacc07b0a0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7faad0035000 tx=0x7faad0004ab0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:39.485 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.484+0000 7faade7fc640 1 -- 172.21.15.105:0/2073542973 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7faad4021020 con 0x7faae00cfb00 2024-09-21T03:27:39.657 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.655+0000 7faae7b58640 1 -- 172.21.15.105:0/2073542973 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faae00cff10 con 0x7faacc078b90 2024-09-21T03:27:39.658 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.656+0000 7faade7fc640 1 -- 172.21.15.105:0/2073542973 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13470 (secure 0 0 0) 0x7faae00cff10 con 0x7faacc078b90 2024-09-21T03:27:39.659 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:27:39.659 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:27:39.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.659+0000 7faae7b58640 1 -- 172.21.15.105:0/2073542973 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7faacc078b90 msgr2=0x7faacc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:39.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.659+0000 7faae7b58640 1 --2- 172.21.15.105:0/2073542973 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7faacc078b90 0x7faacc07b0a0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7faad0035000 tx=0x7faad0004ab0 comp rx=0 tx=0).stop 2024-09-21T03:27:39.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.659+0000 7faae7b58640 1 -- 172.21.15.105:0/2073542973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faae00cfb00 msgr2=0x7faae01f5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:39.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.659+0000 7faae7b58640 1 --2- 172.21.15.105:0/2073542973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faae00cfb00 0x7faae01f5c00 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7faad400c3f0 tx=0x7faad400c8b0 comp rx=0 tx=0).stop 2024-09-21T03:27:39.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.659+0000 7faae7b58640 1 -- 172.21.15.105:0/2073542973 shutdown_connections 2024-09-21T03:27:39.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.659+0000 7faae7b58640 1 --2- 172.21.15.105:0/2073542973 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7faacc078b90 0x7faacc07b0a0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:39.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.659+0000 7faae7b58640 1 --2- 172.21.15.105:0/2073542973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faae0154500 0x7faae01f6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:39.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.659+0000 7faae7b58640 1 --2- 172.21.15.105:0/2073542973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faae00cfb00 0x7faae01f5c00 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:39.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.659+0000 7faae7b58640 1 --2- 172.21.15.105:0/2073542973 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faae00cf160 0x7faae009db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:39.661 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.659+0000 7faae7b58640 1 -- 172.21.15.105:0/2073542973 >> 172.21.15.105:0/2073542973 conn(0x7faae00b1cb0 msgr2=0x7faae00afca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:39.662 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.659+0000 7faae7b58640 1 -- 172.21.15.105:0/2073542973 shutdown_connections 2024-09-21T03:27:39.662 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.659+0000 7faae7b58640 1 -- 172.21.15.105:0/2073542973 wait complete. 2024-09-21T03:27:39.672 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":418,"stamp":"2024-09-21T03:27:39.427396+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":272992,"kb_used_data":15160,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754701728,"statfs":{"total":773094113280,"available":772814569472,"internally_reserved":0,"allocated":15523840,"data_stored":7332881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2410,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001451"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":338,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T03:27:35.829030+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:27:35.829030+0000","last_peered":"2024-09-21T03:27:35.829030+0000","last_clean":"2024-09-21T03:27:35.829030+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:27:35.829030+0000","last_undegraded":"2024-09-21T03:27:35.829030+0000","last_fullsized":"2024-09-21T03:27:35.829030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509557,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33508,"kb_used_data":2320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338332,"statfs":{"total":96636764160,"available":96602451968,"internally_reserved":0,"allocated":2375680,"data_stored":1355908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509556,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32948,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338892,"statfs":{"total":96636764160,"available":96603025408,"internally_reserved":0,"allocated":1798144,"data_stored":771105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509555,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32948,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338892,"statfs":{"total":96636764160,"available":96603025408,"internally_reserved":0,"allocated":1798144,"data_stored":771105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509555,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32944,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338896,"statfs":{"total":96636764160,"available":96603029504,"internally_reserved":0,"allocated":1798144,"data_stored":771105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509556,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32944,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338896,"statfs":{"total":96636764160,"available":96603029504,"internally_reserved":0,"allocated":1798144,"data_stored":771105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509556,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37088,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334752,"statfs":{"total":96636764160,"available":96598786048,"internally_reserved":0,"allocated":1781760,"data_stored":765540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509556,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37104,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334736,"statfs":{"total":96636764160,"available":96598769664,"internally_reserved":0,"allocated":1798144,"data_stored":771105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574963,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33508,"kb_used_data":2320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338332,"statfs":{"total":96636764160,"available":96602451968,"internally_reserved":0,"allocated":2375680,"data_stored":1355908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:27:39.673 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:27:39.787 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.785+0000 7ff56c40e640 1 -- 172.21.15.105:0/3242855498 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff564142270 msgr2=0x7ff564073e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:39.787 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.785+0000 7ff56c40e640 1 --2- 172.21.15.105:0/3242855498 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff564142270 0x7ff564073e50 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7ff554005fd0 tx=0x7ff55402a5d0 comp rx=0 tx=0).stop 2024-09-21T03:27:39.787 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.785+0000 7ff56c40e640 1 -- 172.21.15.105:0/3242855498 shutdown_connections 2024-09-21T03:27:39.788 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.785+0000 7ff56c40e640 1 --2- 172.21.15.105:0/3242855498 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff564142270 0x7ff564073e50 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:39.788 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.785+0000 7ff56c40e640 1 --2- 172.21.15.105:0/3242855498 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff564144270 0x7ff5640b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:39.788 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.785+0000 7ff56c40e640 1 -- 172.21.15.105:0/3242855498 >> 172.21.15.105:0/3242855498 conn(0x7ff5640d15f0 msgr2=0x7ff564073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:39.788 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.785+0000 7ff56c40e640 1 -- 172.21.15.105:0/3242855498 shutdown_connections 2024-09-21T03:27:39.788 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.785+0000 7ff56c40e640 1 -- 172.21.15.105:0/3242855498 wait complete. 2024-09-21T03:27:39.789 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.787+0000 7ff56c40e640 1 Processor -- start 2024-09-21T03:27:39.789 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.787+0000 7ff56c40e640 1 -- start start 2024-09-21T03:27:39.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.788+0000 7ff56c40e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff564142270 0x7ff5641f2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:39.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.788+0000 7ff56c40e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff564142680 0x7ff5641319b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:39.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.788+0000 7ff56c40e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff564144270 0x7ff564070e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:39.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.788+0000 7ff56c40e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff5640d06f0 con 0x7ff564142270 2024-09-21T03:27:39.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.788+0000 7ff56c40e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff5640d0570 con 0x7ff564142680 2024-09-21T03:27:39.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.788+0000 7ff56c40e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff5640d0870 con 0x7ff564144270 2024-09-21T03:27:39.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.788+0000 7ff56a1aa640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff564142270 0x7ff5641f2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:39.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.788+0000 7ff56a1aa640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff564142270 0x7ff5641f2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42268/0 (socket says 172.21.15.105:42268) 2024-09-21T03:27:39.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.788+0000 7ff56a1aa640 1 -- 172.21.15.105:0/2810067782 learned_addr learned my addr 172.21.15.105:0/2810067782 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:39.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.788+0000 7ff56a9ab640 1 --2- 172.21.15.105:0/2810067782 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff564144270 0x7ff564070e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:39.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.788+0000 7ff5699a9640 1 --2- 172.21.15.105:0/2810067782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff564142680 0x7ff5641319b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:39.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.788+0000 7ff56a1aa640 1 -- 172.21.15.105:0/2810067782 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff564144270 msgr2=0x7ff564070e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:39.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.788+0000 7ff56a1aa640 1 --2- 172.21.15.105:0/2810067782 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff564144270 0x7ff564070e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:39.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.788+0000 7ff56a1aa640 1 -- 172.21.15.105:0/2810067782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff564142680 msgr2=0x7ff5641319b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:39.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.788+0000 7ff56a1aa640 1 --2- 172.21.15.105:0/2810067782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff564142680 0x7ff5641319b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:39.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.788+0000 7ff56a1aa640 1 -- 172.21.15.105:0/2810067782 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff56415cd70 con 0x7ff564142270 2024-09-21T03:27:39.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.788+0000 7ff56a1aa640 1 --2- 172.21.15.105:0/2810067782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff564142270 0x7ff5641f2b80 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7ff56000d770 tx=0x7ff56000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:39.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.789+0000 7ff55affd640 1 -- 172.21.15.105:0/2810067782 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff560017070 con 0x7ff564142270 2024-09-21T03:27:39.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.789+0000 7ff55affd640 1 -- 172.21.15.105:0/2810067782 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff560009d20 con 0x7ff564142270 2024-09-21T03:27:39.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.789+0000 7ff56c40e640 1 -- 172.21.15.105:0/2810067782 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5641f30c0 con 0x7ff564142270 2024-09-21T03:27:39.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.789+0000 7ff55affd640 1 -- 172.21.15.105:0/2810067782 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5600106c0 con 0x7ff564142270 2024-09-21T03:27:39.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.789+0000 7ff56c40e640 1 -- 172.21.15.105:0/2810067782 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff56415d2c0 con 0x7ff564142270 2024-09-21T03:27:39.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.790+0000 7ff56c40e640 1 -- 172.21.15.105:0/2810067782 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff564074550 con 0x7ff564142270 2024-09-21T03:27:39.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.790+0000 7ff55affd640 1 -- 172.21.15.105:0/2810067782 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff56001a070 con 0x7ff564142270 2024-09-21T03:27:39.794 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.791+0000 7ff55affd640 1 --2- 172.21.15.105:0/2810067782 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff548078bc0 0x7ff54807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:39.794 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.791+0000 7ff55affd640 1 -- 172.21.15.105:0/2810067782 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 4943+0+0 (secure 0 0 0) 0x7ff56009ab40 con 0x7ff564142270 2024-09-21T03:27:39.794 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.791+0000 7ff5699a9640 1 --2- 172.21.15.105:0/2810067782 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff548078bc0 0x7ff54807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:39.794 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.792+0000 7ff5699a9640 1 --2- 172.21.15.105:0/2810067782 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff548078bc0 0x7ff54807b0d0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7ff554033000 tx=0x7ff554004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:39.797 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.796+0000 7ff55affd640 1 -- 172.21.15.105:0/2810067782 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff560062cc0 con 0x7ff564142270 2024-09-21T03:27:39.978 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.977+0000 7ff56c40e640 1 -- 172.21.15.105:0/2810067782 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff56415ea40 con 0x7ff564142270 2024-09-21T03:27:39.979 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.977+0000 7ff55affd640 1 -- 172.21.15.105:0/2810067782 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) ==== 74+0+13116 (secure 0 0 0) 0x7ff5600676f0 con 0x7ff564142270 2024-09-21T03:27:39.979 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:27:39.979 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":143,"fsid":"29d80f4f-e5de-4b26-8384-24c2d8019945","created":"2024-09-21T03:18:04.838680+0000","modified":"2024-09-21T03:27:36.825245+0000","last_up_change":"2024-09-21T03:18:18.256501+0000","last_in_change":"2024-09-21T03:18:08.417548+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:18:19.296947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05d8c08a-a4bf-4a6d-af2a-fd89ae829a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6801","nonce":4283875833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6803","nonce":4283875833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6807","nonce":4283875833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":4283875833},{"type":"v1","addr":"172.21.15.105:6805","nonce":4283875833}]},"public_addr":"172.21.15.105:6801/4283875833","cluster_addr":"172.21.15.105:6803/4283875833","heartbeat_back_addr":"172.21.15.105:6807/4283875833","heartbeat_front_addr":"172.21.15.105:6805/4283875833","state":["exists","up"]},{"osd":1,"uuid":"0388eb9b-9bec-490a-a3ea-dce96c27b13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6817","nonce":3314074789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6819","nonce":3314074789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6823","nonce":3314074789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":3314074789},{"type":"v1","addr":"172.21.15.105:6821","nonce":3314074789}]},"public_addr":"172.21.15.105:6817/3314074789","cluster_addr":"172.21.15.105:6819/3314074789","heartbeat_back_addr":"172.21.15.105:6823/3314074789","heartbeat_front_addr":"172.21.15.105:6821/3314074789","state":["exists","up"]},{"osd":2,"uuid":"21a36b84-c832-40c6-8e6d-f075f0f7bcf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6809","nonce":2783810296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6811","nonce":2783810296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6815","nonce":2783810296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2783810296},{"type":"v1","addr":"172.21.15.105:6813","nonce":2783810296}]},"public_addr":"172.21.15.105:6809/2783810296","cluster_addr":"172.21.15.105:6811/2783810296","heartbeat_back_addr":"172.21.15.105:6815/2783810296","heartbeat_front_addr":"172.21.15.105:6813/2783810296","state":["exists","up"]},{"osd":3,"uuid":"4d3e1186-f563-496f-a1e9-1db8498fd52d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6825","nonce":1202131294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6827","nonce":1202131294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6831","nonce":1202131294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":1202131294},{"type":"v1","addr":"172.21.15.105:6829","nonce":1202131294}]},"public_addr":"172.21.15.105:6825/1202131294","cluster_addr":"172.21.15.105:6827/1202131294","heartbeat_back_addr":"172.21.15.105:6831/1202131294","heartbeat_front_addr":"172.21.15.105:6829/1202131294","state":["exists","up"]},{"osd":4,"uuid":"27d53ef3-da79-4872-860a-84d51bccbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6811","nonce":1660148918}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6813","nonce":1660148918}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6817","nonce":1660148918}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":1660148918},{"type":"v1","addr":"172.21.15.162:6815","nonce":1660148918}]},"public_addr":"172.21.15.162:6811/1660148918","cluster_addr":"172.21.15.162:6813/1660148918","heartbeat_back_addr":"172.21.15.162:6817/1660148918","heartbeat_front_addr":"172.21.15.162:6815/1660148918","state":["exists","up"]},{"osd":5,"uuid":"8bb3042e-a288-4ab0-bdf9-71938232ca75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6803","nonce":2576522891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6805","nonce":2576522891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6809","nonce":2576522891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2576522891},{"type":"v1","addr":"172.21.15.162:6807","nonce":2576522891}]},"public_addr":"172.21.15.162:6803/2576522891","cluster_addr":"172.21.15.162:6805/2576522891","heartbeat_back_addr":"172.21.15.162:6809/2576522891","heartbeat_front_addr":"172.21.15.162:6807/2576522891","state":["exists","up"]},{"osd":6,"uuid":"08df45e8-f2e8-472c-918b-b9bb92c452c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6819","nonce":2201319593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6821","nonce":2201319593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6825","nonce":2201319593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":2201319593},{"type":"v1","addr":"172.21.15.162:6823","nonce":2201319593}]},"public_addr":"172.21.15.162:6819/2201319593","cluster_addr":"172.21.15.162:6821/2201319593","heartbeat_back_addr":"172.21.15.162:6825/2201319593","heartbeat_front_addr":"172.21.15.162:6823/2201319593","state":["exists","up"]},{"osd":7,"uuid":"2d2e4926-0722-4d3a-a6b2-90d366e6f421","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6827","nonce":3787313702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6829","nonce":3787313702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6833","nonce":3787313702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3787313702},{"type":"v1","addr":"172.21.15.162:6831","nonce":3787313702}]},"public_addr":"172.21.15.162:6827/3787313702","cluster_addr":"172.21.15.162:6829/3787313702","heartbeat_back_addr":"172.21.15.162:6833/3787313702","heartbeat_front_addr":"172.21.15.162:6831/3787313702","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.441114+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.549986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.049666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.978405+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.200786+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:14.680172+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.016550+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:18:15.083593+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.105:6835/1315344000":"2024-09-22T03:27:33.493702+0000","172.21.15.105:6833/1315344000":"2024-09-22T03:27:33.493702+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:27:39.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.980+0000 7ff56c40e640 1 -- 172.21.15.105:0/2810067782 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff548078bc0 msgr2=0x7ff54807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:39.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.980+0000 7ff56c40e640 1 --2- 172.21.15.105:0/2810067782 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff548078bc0 0x7ff54807b0d0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7ff554033000 tx=0x7ff554004730 comp rx=0 tx=0).stop 2024-09-21T03:27:39.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.980+0000 7ff56c40e640 1 -- 172.21.15.105:0/2810067782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff564142270 msgr2=0x7ff5641f2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:39.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.980+0000 7ff56c40e640 1 --2- 172.21.15.105:0/2810067782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff564142270 0x7ff5641f2b80 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7ff56000d770 tx=0x7ff56000dc30 comp rx=0 tx=0).stop 2024-09-21T03:27:39.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.980+0000 7ff56c40e640 1 -- 172.21.15.105:0/2810067782 shutdown_connections 2024-09-21T03:27:39.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.980+0000 7ff56c40e640 1 --2- 172.21.15.105:0/2810067782 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff548078bc0 0x7ff54807b0d0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:39.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.980+0000 7ff56c40e640 1 --2- 172.21.15.105:0/2810067782 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff564144270 0x7ff564070e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:39.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.980+0000 7ff56c40e640 1 --2- 172.21.15.105:0/2810067782 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff564142680 0x7ff5641319b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:39.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.980+0000 7ff56c40e640 1 --2- 172.21.15.105:0/2810067782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff564142270 0x7ff5641f2b80 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:39.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.980+0000 7ff56c40e640 1 -- 172.21.15.105:0/2810067782 >> 172.21.15.105:0/2810067782 conn(0x7ff5640d15f0 msgr2=0x7ff564068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:39.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.980+0000 7ff56c40e640 1 -- 172.21.15.105:0/2810067782 shutdown_connections 2024-09-21T03:27:39.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:39.980+0000 7ff56c40e640 1 -- 172.21.15.105:0/2810067782 wait complete. 2024-09-21T03:27:40.993 INFO:tasks.ceph:Scrubbing osd.0 2024-09-21T03:27:40.993 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-21T03:27:41.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.122+0000 7f27ce2bd640 1 -- 172.21.15.105:0/2463236433 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27c815c850 msgr2=0x7f27c80b02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:41.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.122+0000 7f27ce2bd640 1 --2- 172.21.15.105:0/2463236433 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27c815c850 0x7f27c80b02d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f27b8009830 tx=0x7f27b802a510 comp rx=0 tx=0).stop 2024-09-21T03:27:41.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.122+0000 7f27ce2bd640 1 -- 172.21.15.105:0/2463236433 shutdown_connections 2024-09-21T03:27:41.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.122+0000 7f27ce2bd640 1 --2- 172.21.15.105:0/2463236433 >> v2:172.21.15.162:3300/0 conn(0x7f27c80cdfc0 0x7f27c80b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:41.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.122+0000 7f27ce2bd640 1 --2- 172.21.15.105:0/2463236433 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27c815c850 0x7f27c80b02d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:41.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.122+0000 7f27ce2bd640 1 -- 172.21.15.105:0/2463236433 >> 172.21.15.105:0/2463236433 conn(0x7f27c8073d90 msgr2=0x7f27c80741a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:41.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.122+0000 7f27ce2bd640 1 -- 172.21.15.105:0/2463236433 shutdown_connections 2024-09-21T03:27:41.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.122+0000 7f27ce2bd640 1 -- 172.21.15.105:0/2463236433 wait complete. 2024-09-21T03:27:41.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.124+0000 7f27ce2bd640 1 Processor -- start 2024-09-21T03:27:41.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.124+0000 7f27ce2bd640 1 -- start start 2024-09-21T03:27:41.128 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.125+0000 7f27ce2bd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27c80b6420 0x7f27c8145700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:41.128 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.125+0000 7f27ce2bd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27c80cdfc0 0x7f27c80c64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:41.128 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.125+0000 7f27ce2bd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27c815c850 0x7f27c8148150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:41.128 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.125+0000 7f27ce2bd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f27c8070010 con 0x7f27c80b6420 2024-09-21T03:27:41.129 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.125+0000 7f27ce2bd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f27c80cd030 con 0x7f27c80cdfc0 2024-09-21T03:27:41.129 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.125+0000 7f27ce2bd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f27c8070190 con 0x7f27c815c850 2024-09-21T03:27:41.129 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.125+0000 7f27c7fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27c80b6420 0x7f27c8145700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:41.129 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.125+0000 7f27c7fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27c80b6420 0x7f27c8145700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42280/0 (socket says 172.21.15.105:42280) 2024-09-21T03:27:41.129 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.125+0000 7f27c7fff640 1 -- 172.21.15.105:0/656727214 learned_addr learned my addr 172.21.15.105:0/656727214 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:41.129 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.126+0000 7f27c77fe640 1 --2- 172.21.15.105:0/656727214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27c80cdfc0 0x7f27c80c64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:41.129 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.126+0000 7f27cc85a640 1 --2- 172.21.15.105:0/656727214 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27c815c850 0x7f27c8148150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:41.129 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.126+0000 7f27c7fff640 1 -- 172.21.15.105:0/656727214 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27c815c850 msgr2=0x7f27c8148150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:41.129 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.126+0000 7f27c7fff640 1 --2- 172.21.15.105:0/656727214 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27c815c850 0x7f27c8148150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:41.129 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.126+0000 7f27c7fff640 1 -- 172.21.15.105:0/656727214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27c80cdfc0 msgr2=0x7f27c80c64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:41.129 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.126+0000 7f27c7fff640 1 --2- 172.21.15.105:0/656727214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27c80cdfc0 0x7f27c80c64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:41.129 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.126+0000 7f27c7fff640 1 -- 172.21.15.105:0/656727214 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27c80cadf0 con 0x7f27c80b6420 2024-09-21T03:27:41.130 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.126+0000 7f27cc85a640 1 --2- 172.21.15.105:0/656727214 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27c815c850 0x7f27c8148150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:27:41.130 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.126+0000 7f27c7fff640 1 --2- 172.21.15.105:0/656727214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27c80b6420 0x7f27c8145700 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f27b8009950 tx=0x7f27b8033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:41.130 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.126+0000 7f27c4ff9640 1 -- 172.21.15.105:0/656727214 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b8031d60 con 0x7f27c80b6420 2024-09-21T03:27:41.130 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.126+0000 7f27c4ff9640 1 -- 172.21.15.105:0/656727214 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f27b8033e10 con 0x7f27c80b6420 2024-09-21T03:27:41.130 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.126+0000 7f27ce2bd640 1 -- 172.21.15.105:0/656727214 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27c8160290 con 0x7f27c80b6420 2024-09-21T03:27:41.130 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.126+0000 7f27c4ff9640 1 -- 172.21.15.105:0/656727214 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b8005260 con 0x7f27c80b6420 2024-09-21T03:27:41.130 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.126+0000 7f27ce2bd640 1 -- 172.21.15.105:0/656727214 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27c80cb090 con 0x7f27c80b6420 2024-09-21T03:27:41.131 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.127+0000 7f27ce2bd640 1 -- 172.21.15.105:0/656727214 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f27c80b5ee0 con 0x7f27c80b6420 2024-09-21T03:27:41.132 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.128+0000 7f27c4ff9640 1 -- 172.21.15.105:0/656727214 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f27b8005400 con 0x7f27c80b6420 2024-09-21T03:27:41.132 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.128+0000 7f27c4ff9640 1 --2- 172.21.15.105:0/656727214 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f27b4078b90 0x7f27b407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:41.132 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.128+0000 7f27c4ff9640 1 -- 172.21.15.105:0/656727214 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 4943+0+0 (secure 0 0 0) 0x7f27b80bbb90 con 0x7f27c80b6420 2024-09-21T03:27:41.132 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.129+0000 7f27c4ff9640 1 --2- 172.21.15.105:0/656727214 >> [v2:172.21.15.105:6800/4283875833,v1:172.21.15.105:6801/4283875833] conn(0x7f27b407eaa0 0x7f27b4080ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:41.132 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.129+0000 7f27c4ff9640 1 -- 172.21.15.105:0/656727214 --> [v2:172.21.15.105:6800/4283875833,v1:172.21.15.105:6801/4283875833] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f27b802eec0 con 0x7f27b407eaa0 2024-09-21T03:27:41.132 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.129+0000 7f27c4ff9640 1 -- 172.21.15.105:0/656727214 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=143) ==== 24+0+0 (secure 0 0 0) 0x7f27b80be290 con 0x7f27c80b6420 2024-09-21T03:27:41.132 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.129+0000 7f27c77fe640 1 --2- 172.21.15.105:0/656727214 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f27b4078b90 0x7f27b407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:41.132 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.129+0000 7f27cc85a640 1 --2- 172.21.15.105:0/656727214 >> [v2:172.21.15.105:6800/4283875833,v1:172.21.15.105:6801/4283875833] conn(0x7f27b407eaa0 0x7f27b4080ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:41.132 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.129+0000 7f27cc85a640 1 --2- 172.21.15.105:0/656727214 >> [v2:172.21.15.105:6800/4283875833,v1:172.21.15.105:6801/4283875833] conn(0x7f27b407eaa0 0x7f27b4080ef0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:41.132 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.129+0000 7f27c77fe640 1 --2- 172.21.15.105:0/656727214 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f27b4078b90 0x7f27b407b0a0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f27c80c8eb0 tx=0x7f27bc005f30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:41.132 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.130+0000 7f27c4ff9640 1 -- 172.21.15.105:0/656727214 <== osd.0 v2:172.21.15.105:6800/4283875833 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f27b802eec0 con 0x7f27b407eaa0 2024-09-21T03:27:41.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.142+0000 7f27ce2bd640 1 -- 172.21.15.105:0/656727214 --> [v2:172.21.15.105:6800/4283875833,v1:172.21.15.105:6801/4283875833] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f27c80cdd80 con 0x7f27b407eaa0 2024-09-21T03:27:41.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.142+0000 7f27c4ff9640 1 -- 172.21.15.105:0/656727214 <== osd.0 v2:172.21.15.105:6800/4283875833 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f27c80cdd80 con 0x7f27b407eaa0 2024-09-21T03:27:41.144 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-21T03:27:41.145 INFO:teuthology.orchestra.run.smithi105.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T03:27:41.145 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-21T03:27:41.145 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.143+0000 7f27ce2bd640 1 -- 172.21.15.105:0/656727214 >> [v2:172.21.15.105:6800/4283875833,v1:172.21.15.105:6801/4283875833] conn(0x7f27b407eaa0 msgr2=0x7f27b4080ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:41.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.143+0000 7f27ce2bd640 1 --2- 172.21.15.105:0/656727214 >> [v2:172.21.15.105:6800/4283875833,v1:172.21.15.105:6801/4283875833] conn(0x7f27b407eaa0 0x7f27b4080ef0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:41.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.143+0000 7f27ce2bd640 1 -- 172.21.15.105:0/656727214 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f27b4078b90 msgr2=0x7f27b407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:41.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.143+0000 7f27ce2bd640 1 --2- 172.21.15.105:0/656727214 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f27b4078b90 0x7f27b407b0a0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f27c80c8eb0 tx=0x7f27bc005f30 comp rx=0 tx=0).stop 2024-09-21T03:27:41.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.143+0000 7f27ce2bd640 1 -- 172.21.15.105:0/656727214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27c80b6420 msgr2=0x7f27c8145700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:41.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.143+0000 7f27ce2bd640 1 --2- 172.21.15.105:0/656727214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27c80b6420 0x7f27c8145700 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f27b8009950 tx=0x7f27b8033c20 comp rx=0 tx=0).stop 2024-09-21T03:27:41.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.143+0000 7f27cc85a640 1 -- 172.21.15.105:0/656727214 reap_dead start 2024-09-21T03:27:41.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.143+0000 7f27ce2bd640 1 -- 172.21.15.105:0/656727214 shutdown_connections 2024-09-21T03:27:41.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.143+0000 7f27ce2bd640 1 -- 172.21.15.105:0/656727214 >> 172.21.15.105:0/656727214 conn(0x7f27c8073d90 msgr2=0x7f27c8157550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:41.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.143+0000 7f27ce2bd640 1 -- 172.21.15.105:0/656727214 shutdown_connections 2024-09-21T03:27:41.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.143+0000 7f27ce2bd640 1 -- 172.21.15.105:0/656727214 wait complete. 2024-09-21T03:27:41.156 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-21T03:27:41.269 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.267+0000 7f8977e8b640 1 -- 172.21.15.105:0/2570815750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89700701b0 msgr2=0x7f897015c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:41.269 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.267+0000 7f8977e8b640 1 --2- 172.21.15.105:0/2570815750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89700701b0 0x7f897015c570 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f896c009830 tx=0x7f896c02a500 comp rx=0 tx=0).stop 2024-09-21T03:27:41.269 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.267+0000 7f8977e8b640 1 -- 172.21.15.105:0/2570815750 shutdown_connections 2024-09-21T03:27:41.269 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.267+0000 7f8977e8b640 1 --2- 172.21.15.105:0/2570815750 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f897006cde0 0x7f897006d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:41.269 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.267+0000 7f8977e8b640 1 --2- 172.21.15.105:0/2570815750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89700701b0 0x7f897015c570 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:41.269 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.267+0000 7f8977e8b640 1 -- 172.21.15.105:0/2570815750 >> 172.21.15.105:0/2570815750 conn(0x7f89700cdcb0 msgr2=0x7f89700ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:41.269 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.267+0000 7f8977e8b640 1 -- 172.21.15.105:0/2570815750 shutdown_connections 2024-09-21T03:27:41.269 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.267+0000 7f8977e8b640 1 -- 172.21.15.105:0/2570815750 wait complete. 2024-09-21T03:27:41.270 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.268+0000 7f8977e8b640 1 Processor -- start 2024-09-21T03:27:41.270 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.269+0000 7f8977e8b640 1 -- start start 2024-09-21T03:27:41.273 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.270+0000 7f8977e8b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f897006cde0 0x7f89701f9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:41.273 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.270+0000 7f8977e8b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89700701b0 0x7f897014a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:41.273 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.270+0000 7f8977e8b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f897015f9f0 0x7f89700c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:41.273 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.270+0000 7f8977e8b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f89700b3350 con 0x7f897006cde0 2024-09-21T03:27:41.273 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.270+0000 7f8977e8b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f89700b31d0 con 0x7f89700701b0 2024-09-21T03:27:41.273 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.270+0000 7f8977e8b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f89700b34d0 con 0x7f897015f9f0 2024-09-21T03:27:41.273 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.270+0000 7f8975c27640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f897006cde0 0x7f89701f9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:41.273 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.270+0000 7f8975c27640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f897006cde0 0x7f89701f9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:42290/0 (socket says 172.21.15.105:42290) 2024-09-21T03:27:41.273 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.270+0000 7f8975c27640 1 -- 172.21.15.105:0/1227513144 learned_addr learned my addr 172.21.15.105:0/1227513144 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:41.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.270+0000 7f8975426640 1 --2- 172.21.15.105:0/1227513144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89700701b0 0x7f897014a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:41.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.270+0000 7f8976428640 1 --2- 172.21.15.105:0/1227513144 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f897015f9f0 0x7f89700c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:41.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.270+0000 7f8975c27640 1 -- 172.21.15.105:0/1227513144 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f897015f9f0 msgr2=0x7f89700c6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:41.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.270+0000 7f8975c27640 1 --2- 172.21.15.105:0/1227513144 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f897015f9f0 0x7f89700c6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:41.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.270+0000 7f8975c27640 1 -- 172.21.15.105:0/1227513144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89700701b0 msgr2=0x7f897014a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:41.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.270+0000 7f8975c27640 1 --2- 172.21.15.105:0/1227513144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89700701b0 0x7f897014a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:41.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.270+0000 7f8975c27640 1 -- 172.21.15.105:0/1227513144 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f897014a6a0 con 0x7f897006cde0 2024-09-21T03:27:41.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.270+0000 7f8976428640 1 --2- 172.21.15.105:0/1227513144 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f897015f9f0 0x7f89700c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:27:41.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.270+0000 7f8975c27640 1 --2- 172.21.15.105:0/1227513144 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f897006cde0 0x7f89701f9c90 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f896c009950 tx=0x7f896c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:41.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.271+0000 7f89667fc640 1 -- 172.21.15.105:0/1227513144 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896c031d60 con 0x7f897006cde0 2024-09-21T03:27:41.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.271+0000 7f89667fc640 1 -- 172.21.15.105:0/1227513144 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f896c033e10 con 0x7f897006cde0 2024-09-21T03:27:41.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.271+0000 7f8977e8b640 1 -- 172.21.15.105:0/1227513144 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89700ae040 con 0x7f897006cde0 2024-09-21T03:27:41.274 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.271+0000 7f89667fc640 1 -- 172.21.15.105:0/1227513144 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896c005260 con 0x7f897006cde0 2024-09-21T03:27:41.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.271+0000 7f8977e8b640 1 -- 172.21.15.105:0/1227513144 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89700ae600 con 0x7f897006cde0 2024-09-21T03:27:41.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.272+0000 7f8977e8b640 1 -- 172.21.15.105:0/1227513144 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f897006d1f0 con 0x7f897006cde0 2024-09-21T03:27:41.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.272+0000 7f89667fc640 1 -- 172.21.15.105:0/1227513144 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f896c005400 con 0x7f897006cde0 2024-09-21T03:27:41.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.273+0000 7f89667fc640 1 --2- 172.21.15.105:0/1227513144 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8954078bc0 0x7f895407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:41.275 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.273+0000 7f89667fc640 1 -- 172.21.15.105:0/1227513144 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 4943+0+0 (secure 0 0 0) 0x7f896c0bbbb0 con 0x7f897006cde0 2024-09-21T03:27:41.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.273+0000 7f8975426640 1 --2- 172.21.15.105:0/1227513144 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8954078bc0 0x7f895407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:41.276 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.274+0000 7f8975426640 1 --2- 172.21.15.105:0/1227513144 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8954078bc0 0x7f895407b0d0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f89700af0d0 tx=0x7f8960009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:41.279 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.277+0000 7f89667fc640 1 -- 172.21.15.105:0/1227513144 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f896c03f030 con 0x7f897006cde0 2024-09-21T03:27:41.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.455+0000 7f8977e8b640 1 -- 172.21.15.105:0/1227513144 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f897006db30 con 0x7f8954078bc0 2024-09-21T03:27:41.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.456+0000 7f89667fc640 1 -- 172.21.15.105:0/1227513144 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f897006db30 con 0x7f8954078bc0 2024-09-21T03:27:41.458 INFO:teuthology.orchestra.run.smithi105.stderr:instructed osd(s) 0 to deep-scrub 2024-09-21T03:27:41.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.458+0000 7f8977e8b640 1 -- 172.21.15.105:0/1227513144 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8954078bc0 msgr2=0x7f895407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:41.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.458+0000 7f8977e8b640 1 --2- 172.21.15.105:0/1227513144 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8954078bc0 0x7f895407b0d0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f89700af0d0 tx=0x7f8960009040 comp rx=0 tx=0).stop 2024-09-21T03:27:41.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.458+0000 7f8977e8b640 1 -- 172.21.15.105:0/1227513144 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f897006cde0 msgr2=0x7f89701f9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:41.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.458+0000 7f8977e8b640 1 --2- 172.21.15.105:0/1227513144 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f897006cde0 0x7f89701f9c90 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f896c009950 tx=0x7f896c033c20 comp rx=0 tx=0).stop 2024-09-21T03:27:41.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.458+0000 7f8977e8b640 1 -- 172.21.15.105:0/1227513144 shutdown_connections 2024-09-21T03:27:41.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.458+0000 7f8977e8b640 1 --2- 172.21.15.105:0/1227513144 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f8954078bc0 0x7f895407b0d0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:41.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.458+0000 7f8977e8b640 1 --2- 172.21.15.105:0/1227513144 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f897015f9f0 0x7f89700c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:41.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.458+0000 7f8977e8b640 1 --2- 172.21.15.105:0/1227513144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89700701b0 0x7f897014a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:41.461 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.458+0000 7f8977e8b640 1 --2- 172.21.15.105:0/1227513144 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f897006cde0 0x7f89701f9c90 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:41.461 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.458+0000 7f8977e8b640 1 -- 172.21.15.105:0/1227513144 >> 172.21.15.105:0/1227513144 conn(0x7f89700cdcb0 msgr2=0x7f8970160130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:41.461 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.458+0000 7f8977e8b640 1 -- 172.21.15.105:0/1227513144 shutdown_connections 2024-09-21T03:27:41.461 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.458+0000 7f8977e8b640 1 -- 172.21.15.105:0/1227513144 wait complete. 2024-09-21T03:27:41.471 INFO:tasks.ceph:Scrubbing osd.1 2024-09-21T03:27:41.471 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-21T03:27:41.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.587+0000 7f6477113640 1 -- 172.21.15.105:0/1641562884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64700b38f0 msgr2=0x7f64700b59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:41.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.587+0000 7f6477113640 1 --2- 172.21.15.105:0/1641562884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64700b38f0 0x7f64700b59e0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f64700cb860 tx=0x7f646c02aa30 comp rx=0 tx=0).stop 2024-09-21T03:27:41.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.587+0000 7f6477113640 1 -- 172.21.15.105:0/1641562884 shutdown_connections 2024-09-21T03:27:41.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.587+0000 7f6477113640 1 --2- 172.21.15.105:0/1641562884 >> v2:172.21.15.162:3300/0 conn(0x7f64700b40e0 0x7f64700b44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:41.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.587+0000 7f6477113640 1 --2- 172.21.15.105:0/1641562884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64700b38f0 0x7f64700b59e0 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:41.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.587+0000 7f6477113640 1 -- 172.21.15.105:0/1641562884 >> 172.21.15.105:0/1641562884 conn(0x7f6470074190 msgr2=0x7f64700b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:41.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.587+0000 7f6477113640 1 -- 172.21.15.105:0/1641562884 shutdown_connections 2024-09-21T03:27:41.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.587+0000 7f6477113640 1 -- 172.21.15.105:0/1641562884 wait complete. 2024-09-21T03:27:41.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.589+0000 7f6477113640 1 Processor -- start 2024-09-21T03:27:41.590 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.589+0000 7f6477113640 1 -- start start 2024-09-21T03:27:41.593 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.590+0000 7f6477113640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f647006cde0 0x7f64700af620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:41.593 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.590+0000 7f6477113640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64700b38f0 0x7f647014aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:41.593 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.590+0000 7f6477113640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64700b40e0 0x7f647014b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:41.593 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.590+0000 7f6477113640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f64700b3650 con 0x7f647006cde0 2024-09-21T03:27:41.593 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.590+0000 7f6477113640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f64700b34d0 con 0x7f64700b38f0 2024-09-21T03:27:41.593 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.590+0000 7f6477113640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f64700b4a30 con 0x7f64700b40e0 2024-09-21T03:27:41.594 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.591+0000 7f6474eaf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f647006cde0 0x7f64700af620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:41.594 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.591+0000 7f6474eaf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f647006cde0 0x7f64700af620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:49668/0 (socket says 172.21.15.105:49668) 2024-09-21T03:27:41.594 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.591+0000 7f6474eaf640 1 -- 172.21.15.105:0/1243373060 learned_addr learned my addr 172.21.15.105:0/1243373060 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:41.594 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.591+0000 7f6467fff640 1 --2- 172.21.15.105:0/1243373060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64700b38f0 0x7f647014aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:41.594 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.591+0000 7f64756b0640 1 --2- 172.21.15.105:0/1243373060 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64700b40e0 0x7f647014b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:41.594 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.591+0000 7f6474eaf640 1 -- 172.21.15.105:0/1243373060 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64700b40e0 msgr2=0x7f647014b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:41.594 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.591+0000 7f6474eaf640 1 --2- 172.21.15.105:0/1243373060 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64700b40e0 0x7f647014b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:41.594 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.591+0000 7f6474eaf640 1 -- 172.21.15.105:0/1243373060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64700b38f0 msgr2=0x7f647014aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:41.594 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.591+0000 7f6474eaf640 1 --2- 172.21.15.105:0/1243373060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64700b38f0 0x7f647014aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:41.594 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.591+0000 7f6474eaf640 1 -- 172.21.15.105:0/1243373060 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64700ae580 con 0x7f647006cde0 2024-09-21T03:27:41.594 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.591+0000 7f6474eaf640 1 --2- 172.21.15.105:0/1243373060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f647006cde0 0x7f64700af620 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f646c02b020 tx=0x7f646c003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:41.594 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.591+0000 7f64657fa640 1 -- 172.21.15.105:0/1243373060 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646c033050 con 0x7f647006cde0 2024-09-21T03:27:41.594 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.591+0000 7f64657fa640 1 -- 172.21.15.105:0/1243373060 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f646c0045f0 con 0x7f647006cde0 2024-09-21T03:27:41.595 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.591+0000 7f6477113640 1 -- 172.21.15.105:0/1243373060 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64700ae860 con 0x7f647006cde0 2024-09-21T03:27:41.595 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.591+0000 7f64657fa640 1 -- 172.21.15.105:0/1243373060 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646c038450 con 0x7f647006cde0 2024-09-21T03:27:41.595 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.591+0000 7f6477113640 1 -- 172.21.15.105:0/1243373060 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64700aee20 con 0x7f647006cde0 2024-09-21T03:27:41.596 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.592+0000 7f6477113640 1 -- 172.21.15.105:0/1243373060 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f64700b27b0 con 0x7f647006cde0 2024-09-21T03:27:41.596 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.593+0000 7f64657fa640 1 -- 172.21.15.105:0/1243373060 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f646c036070 con 0x7f647006cde0 2024-09-21T03:27:41.596 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.594+0000 7f64657fa640 1 --2- 172.21.15.105:0/1243373060 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f645c078b90 0x7f645c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:41.596 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.594+0000 7f64657fa640 1 -- 172.21.15.105:0/1243373060 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 4943+0+0 (secure 0 0 0) 0x7f646c0bc390 con 0x7f647006cde0 2024-09-21T03:27:41.596 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.594+0000 7f64657fa640 1 --2- 172.21.15.105:0/1243373060 >> [v2:172.21.15.105:6816/3314074789,v1:172.21.15.105:6817/3314074789] conn(0x7f645c07eaa0 0x7f645c080ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:41.596 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.594+0000 7f64657fa640 1 -- 172.21.15.105:0/1243373060 --> [v2:172.21.15.105:6816/3314074789,v1:172.21.15.105:6817/3314074789] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f646c04be50 con 0x7f645c07eaa0 2024-09-21T03:27:41.596 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.594+0000 7f6467fff640 1 --2- 172.21.15.105:0/1243373060 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f645c078b90 0x7f645c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:41.596 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.594+0000 7f64657fa640 1 -- 172.21.15.105:0/1243373060 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=143) ==== 24+0+0 (secure 0 0 0) 0x7f646c0bc820 con 0x7f647006cde0 2024-09-21T03:27:41.596 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.594+0000 7f64756b0640 1 --2- 172.21.15.105:0/1243373060 >> [v2:172.21.15.105:6816/3314074789,v1:172.21.15.105:6817/3314074789] conn(0x7f645c07eaa0 0x7f645c080ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:41.596 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.594+0000 7f64756b0640 1 --2- 172.21.15.105:0/1243373060 >> [v2:172.21.15.105:6816/3314074789,v1:172.21.15.105:6817/3314074789] conn(0x7f645c07eaa0 0x7f645c080ef0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:41.597 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.594+0000 7f6467fff640 1 --2- 172.21.15.105:0/1243373060 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f645c078b90 0x7f645c07b0a0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f64700b54f0 tx=0x7f6460009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:41.597 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.595+0000 7f64657fa640 1 -- 172.21.15.105:0/1243373060 <== osd.1 v2:172.21.15.105:6816/3314074789 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f646c04be50 con 0x7f645c07eaa0 2024-09-21T03:27:41.609 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.607+0000 7f6477113640 1 -- 172.21.15.105:0/1243373060 --> [v2:172.21.15.105:6816/3314074789,v1:172.21.15.105:6817/3314074789] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f64700b4fd0 con 0x7f645c07eaa0 2024-09-21T03:27:41.609 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.608+0000 7f64657fa640 1 -- 172.21.15.105:0/1243373060 <== osd.1 v2:172.21.15.105:6816/3314074789 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f64700b4fd0 con 0x7f645c07eaa0 2024-09-21T03:27:41.609 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-21T03:27:41.610 INFO:teuthology.orchestra.run.smithi105.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T03:27:41.610 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-21T03:27:41.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.608+0000 7f6477113640 1 -- 172.21.15.105:0/1243373060 >> [v2:172.21.15.105:6816/3314074789,v1:172.21.15.105:6817/3314074789] conn(0x7f645c07eaa0 msgr2=0x7f645c080ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:41.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.608+0000 7f6477113640 1 --2- 172.21.15.105:0/1243373060 >> [v2:172.21.15.105:6816/3314074789,v1:172.21.15.105:6817/3314074789] conn(0x7f645c07eaa0 0x7f645c080ef0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:41.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.608+0000 7f6477113640 1 -- 172.21.15.105:0/1243373060 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f645c078b90 msgr2=0x7f645c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:41.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.608+0000 7f6477113640 1 --2- 172.21.15.105:0/1243373060 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f645c078b90 0x7f645c07b0a0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f64700b54f0 tx=0x7f6460009060 comp rx=0 tx=0).stop 2024-09-21T03:27:41.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.608+0000 7f6477113640 1 -- 172.21.15.105:0/1243373060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f647006cde0 msgr2=0x7f64700af620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:41.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.608+0000 7f6477113640 1 --2- 172.21.15.105:0/1243373060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f647006cde0 0x7f64700af620 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f646c02b020 tx=0x7f646c003f90 comp rx=0 tx=0).stop 2024-09-21T03:27:41.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.608+0000 7f64756b0640 1 -- 172.21.15.105:0/1243373060 reap_dead start 2024-09-21T03:27:41.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.608+0000 7f6477113640 1 -- 172.21.15.105:0/1243373060 shutdown_connections 2024-09-21T03:27:41.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.608+0000 7f6477113640 1 -- 172.21.15.105:0/1243373060 >> 172.21.15.105:0/1243373060 conn(0x7f6470074190 msgr2=0x7f64700cc880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:41.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.608+0000 7f6477113640 1 -- 172.21.15.105:0/1243373060 shutdown_connections 2024-09-21T03:27:41.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.608+0000 7f6477113640 1 -- 172.21.15.105:0/1243373060 wait complete. 2024-09-21T03:27:41.620 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-21T03:27:41.734 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.732+0000 7f3a0307e640 1 -- 172.21.15.105:0/148211754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39fc0705d0 msgr2=0x7f39fc0b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:41.734 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.732+0000 7f3a0307e640 1 --2- 172.21.15.105:0/148211754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39fc0705d0 0x7f39fc0b3550 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f39fc071020 tx=0x7f39f002a5f0 comp rx=0 tx=0).stop 2024-09-21T03:27:41.734 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.732+0000 7f3a0307e640 1 -- 172.21.15.105:0/148211754 shutdown_connections 2024-09-21T03:27:41.734 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.732+0000 7f3a0307e640 1 --2- 172.21.15.105:0/148211754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39fc0705d0 0x7f39fc0b3550 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:41.734 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.732+0000 7f3a0307e640 1 --2- 172.21.15.105:0/148211754 >> v2:172.21.15.162:3300/0 conn(0x7f39fc0cfeb0 0x7f39fc0d02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:41.734 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.732+0000 7f3a0307e640 1 -- 172.21.15.105:0/148211754 >> 172.21.15.105:0/148211754 conn(0x7f39fc0cdcc0 msgr2=0x7f39fc0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:41.735 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.732+0000 7f3a0307e640 1 -- 172.21.15.105:0/148211754 shutdown_connections 2024-09-21T03:27:41.735 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.732+0000 7f3a0307e640 1 -- 172.21.15.105:0/148211754 wait complete. 2024-09-21T03:27:41.735 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.734+0000 7f3a0307e640 1 Processor -- start 2024-09-21T03:27:41.735 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.734+0000 7f3a0307e640 1 -- start start 2024-09-21T03:27:41.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.735+0000 7f3a0307e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39fc0b4090 0x7f39fc1f7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:41.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.735+0000 7f3a0307e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39fc0cfeb0 0x7f39fc0cb820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:41.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.735+0000 7f3a0307e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39fc15dab0 0x7f39fc1f3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:41.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.735+0000 7f3a0307e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f39fc0b4a30 con 0x7f39fc15dab0 2024-09-21T03:27:41.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.735+0000 7f3a0307e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f39fc0b48b0 con 0x7f39fc0b4090 2024-09-21T03:27:41.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.735+0000 7f3a0307e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f39fc0b4bb0 con 0x7f39fc0cfeb0 2024-09-21T03:27:41.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.735+0000 7f3a0161b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39fc15dab0 0x7f39fc1f3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:41.738 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.735+0000 7f3a0161b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39fc15dab0 0x7f39fc1f3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:49686/0 (socket says 172.21.15.105:49686) 2024-09-21T03:27:41.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.735+0000 7f3a0161b640 1 -- 172.21.15.105:0/1241691769 learned_addr learned my addr 172.21.15.105:0/1241691769 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:41.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.736+0000 7f39fbfff640 1 --2- 172.21.15.105:0/1241691769 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39fc0cfeb0 0x7f39fc0cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:41.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.736+0000 7f3a00e1a640 1 --2- 172.21.15.105:0/1241691769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39fc0b4090 0x7f39fc1f7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:41.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.736+0000 7f3a0161b640 1 -- 172.21.15.105:0/1241691769 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39fc0cfeb0 msgr2=0x7f39fc0cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:41.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.736+0000 7f3a0161b640 1 --2- 172.21.15.105:0/1241691769 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39fc0cfeb0 0x7f39fc0cb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:41.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.736+0000 7f3a0161b640 1 -- 172.21.15.105:0/1241691769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39fc0b4090 msgr2=0x7f39fc1f7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:41.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.736+0000 7f3a0161b640 1 --2- 172.21.15.105:0/1241691769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39fc0b4090 0x7f39fc1f7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:41.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.736+0000 7f3a0161b640 1 -- 172.21.15.105:0/1241691769 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39fc09e110 con 0x7f39fc15dab0 2024-09-21T03:27:41.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.736+0000 7f3a0161b640 1 --2- 172.21.15.105:0/1241691769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39fc15dab0 0x7f39fc1f3b90 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f39f400e990 tx=0x7f39f400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:41.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.736+0000 7f39f97fa640 1 -- 172.21.15.105:0/1241691769 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f4004d20 con 0x7f39fc15dab0 2024-09-21T03:27:41.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.736+0000 7f39f97fa640 1 -- 172.21.15.105:0/1241691769 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39f400caa0 con 0x7f39fc15dab0 2024-09-21T03:27:41.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.736+0000 7f3a0307e640 1 -- 172.21.15.105:0/1241691769 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39fc1f7860 con 0x7f39fc15dab0 2024-09-21T03:27:41.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.736+0000 7f39f97fa640 1 -- 172.21.15.105:0/1241691769 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f4005020 con 0x7f39fc15dab0 2024-09-21T03:27:41.739 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.736+0000 7f3a0307e640 1 -- 172.21.15.105:0/1241691769 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39fc09e810 con 0x7f39fc15dab0 2024-09-21T03:27:41.740 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.737+0000 7f3a0307e640 1 -- 172.21.15.105:0/1241691769 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39fc09e580 con 0x7f39fc15dab0 2024-09-21T03:27:41.740 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.738+0000 7f39f97fa640 1 -- 172.21.15.105:0/1241691769 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f39f40051c0 con 0x7f39fc15dab0 2024-09-21T03:27:41.740 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.738+0000 7f39f97fa640 1 --2- 172.21.15.105:0/1241691769 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f39e8078bc0 0x7f39e807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:41.741 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.738+0000 7f39f97fa640 1 -- 172.21.15.105:0/1241691769 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 4943+0+0 (secure 0 0 0) 0x7f39f409b330 con 0x7f39fc15dab0 2024-09-21T03:27:41.741 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.739+0000 7f3a00e1a640 1 --2- 172.21.15.105:0/1241691769 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f39e8078bc0 0x7f39e807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:41.741 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.739+0000 7f3a00e1a640 1 --2- 172.21.15.105:0/1241691769 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f39e8078bc0 0x7f39e807b0d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f39ec0015e0 tx=0x7f39ec009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:41.744 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.743+0000 7f39f97fa640 1 -- 172.21.15.105:0/1241691769 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f39fc1f7860 con 0x7f39fc15dab0 2024-09-21T03:27:41.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.919+0000 7f3a0307e640 1 -- 172.21.15.105:0/1241691769 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f39fc09e350 con 0x7f39e8078bc0 2024-09-21T03:27:41.921 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.920+0000 7f39f97fa640 1 -- 172.21.15.105:0/1241691769 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f39ec0050d0 con 0x7f39e8078bc0 2024-09-21T03:27:41.921 INFO:teuthology.orchestra.run.smithi105.stderr:instructed osd(s) 1 to deep-scrub 2024-09-21T03:27:41.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.922+0000 7f3a0307e640 1 -- 172.21.15.105:0/1241691769 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f39e8078bc0 msgr2=0x7f39e807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:41.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.922+0000 7f3a0307e640 1 --2- 172.21.15.105:0/1241691769 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f39e8078bc0 0x7f39e807b0d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f39ec0015e0 tx=0x7f39ec009040 comp rx=0 tx=0).stop 2024-09-21T03:27:41.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.922+0000 7f3a0307e640 1 -- 172.21.15.105:0/1241691769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39fc15dab0 msgr2=0x7f39fc1f3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:41.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.922+0000 7f3a0307e640 1 --2- 172.21.15.105:0/1241691769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39fc15dab0 0x7f39fc1f3b90 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f39f400e990 tx=0x7f39f400ee50 comp rx=0 tx=0).stop 2024-09-21T03:27:41.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.922+0000 7f3a0307e640 1 -- 172.21.15.105:0/1241691769 shutdown_connections 2024-09-21T03:27:41.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.922+0000 7f3a0307e640 1 --2- 172.21.15.105:0/1241691769 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f39e8078bc0 0x7f39e807b0d0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:41.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.922+0000 7f3a0307e640 1 --2- 172.21.15.105:0/1241691769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39fc15dab0 0x7f39fc1f3b90 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:41.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.922+0000 7f3a0307e640 1 --2- 172.21.15.105:0/1241691769 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39fc0cfeb0 0x7f39fc0cb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:41.924 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.922+0000 7f3a0307e640 1 --2- 172.21.15.105:0/1241691769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39fc0b4090 0x7f39fc1f7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:41.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.922+0000 7f3a0307e640 1 -- 172.21.15.105:0/1241691769 >> 172.21.15.105:0/1241691769 conn(0x7f39fc0cdcc0 msgr2=0x7f39fc074600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:41.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.922+0000 7f3a0307e640 1 -- 172.21.15.105:0/1241691769 shutdown_connections 2024-09-21T03:27:41.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:41.922+0000 7f3a0307e640 1 -- 172.21.15.105:0/1241691769 wait complete. 2024-09-21T03:27:41.935 INFO:tasks.ceph:Scrubbing osd.2 2024-09-21T03:27:41.935 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-21T03:27:42.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.050+0000 7ff487c69640 1 -- 172.21.15.105:0/1319630445 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff480071090 msgr2=0x7ff4800714a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:42.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.050+0000 7ff487c69640 1 --2- 172.21.15.105:0/1319630445 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff480071090 0x7ff4800714a0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7ff480071f50 tx=0x7ff47802aac0 comp rx=0 tx=0).stop 2024-09-21T03:27:42.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.050+0000 7ff487c69640 1 -- 172.21.15.105:0/1319630445 shutdown_connections 2024-09-21T03:27:42.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.050+0000 7ff487c69640 1 --2- 172.21.15.105:0/1319630445 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff480071090 0x7ff4800714a0 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:42.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.050+0000 7ff487c69640 1 --2- 172.21.15.105:0/1319630445 >> v2:172.21.15.162:3300/0 conn(0x7ff48015a310 0x7ff4800d1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:42.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.050+0000 7ff487c69640 1 -- 172.21.15.105:0/1319630445 >> 172.21.15.105:0/1319630445 conn(0x7ff4800ced50 msgr2=0x7ff4800cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:42.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.050+0000 7ff487c69640 1 -- 172.21.15.105:0/1319630445 shutdown_connections 2024-09-21T03:27:42.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.050+0000 7ff487c69640 1 -- 172.21.15.105:0/1319630445 wait complete. 2024-09-21T03:27:42.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.052+0000 7ff487c69640 1 Processor -- start 2024-09-21T03:27:42.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.052+0000 7ff487c69640 1 -- start start 2024-09-21T03:27:42.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.053+0000 7ff487c69640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff480071090 0x7ff4801f74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:42.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.053+0000 7ff487c69640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff48015a310 0x7ff4800cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:42.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.053+0000 7ff487c69640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff48015cc30 0x7ff480149860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:42.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.053+0000 7ff487c69640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff4800d01a0 con 0x7ff480071090 2024-09-21T03:27:42.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.053+0000 7ff487c69640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff4800d0020 con 0x7ff48015a310 2024-09-21T03:27:42.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.053+0000 7ff487c69640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff4800d0320 con 0x7ff48015cc30 2024-09-21T03:27:42.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.054+0000 7ff485a05640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff480071090 0x7ff4801f74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:42.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.054+0000 7ff485a05640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff480071090 0x7ff4801f74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:49708/0 (socket says 172.21.15.105:49708) 2024-09-21T03:27:42.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.054+0000 7ff485a05640 1 -- 172.21.15.105:0/2124591054 learned_addr learned my addr 172.21.15.105:0/2124591054 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:42.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.054+0000 7ff485204640 1 --2- 172.21.15.105:0/2124591054 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff48015a310 0x7ff4800cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:42.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.054+0000 7ff486206640 1 --2- 172.21.15.105:0/2124591054 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff48015cc30 0x7ff480149860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:42.057 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.054+0000 7ff485a05640 1 -- 172.21.15.105:0/2124591054 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff48015cc30 msgr2=0x7ff480149860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:42.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.054+0000 7ff485a05640 1 --2- 172.21.15.105:0/2124591054 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff48015cc30 0x7ff480149860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:42.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.054+0000 7ff485a05640 1 -- 172.21.15.105:0/2124591054 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff48015a310 msgr2=0x7ff4800cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:42.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.054+0000 7ff485a05640 1 --2- 172.21.15.105:0/2124591054 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff48015a310 0x7ff4800cbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:42.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.054+0000 7ff485a05640 1 -- 172.21.15.105:0/2124591054 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff48014a330 con 0x7ff480071090 2024-09-21T03:27:42.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.054+0000 7ff485a05640 1 --2- 172.21.15.105:0/2124591054 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff480071090 0x7ff4801f74c0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7ff47c00d6d0 tx=0x7ff47c00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:42.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.054+0000 7ff4767fc640 1 -- 172.21.15.105:0/2124591054 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff47c017070 con 0x7ff480071090 2024-09-21T03:27:42.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.054+0000 7ff4767fc640 1 -- 172.21.15.105:0/2124591054 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff47c004310 con 0x7ff480071090 2024-09-21T03:27:42.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.054+0000 7ff487c69640 1 -- 172.21.15.105:0/2124591054 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff48014a610 con 0x7ff480071090 2024-09-21T03:27:42.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.054+0000 7ff4767fc640 1 -- 172.21.15.105:0/2124591054 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff47c009a80 con 0x7ff480071090 2024-09-21T03:27:42.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.054+0000 7ff487c69640 1 -- 172.21.15.105:0/2124591054 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4801481c0 con 0x7ff480071090 2024-09-21T03:27:42.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.055+0000 7ff487c69640 1 -- 172.21.15.105:0/2124591054 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff4801f6ab0 con 0x7ff480071090 2024-09-21T03:27:42.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.056+0000 7ff4767fc640 1 -- 172.21.15.105:0/2124591054 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff47c009c20 con 0x7ff480071090 2024-09-21T03:27:42.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.057+0000 7ff4767fc640 1 --2- 172.21.15.105:0/2124591054 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff464078bc0 0x7ff46407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:42.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.057+0000 7ff4767fc640 1 -- 172.21.15.105:0/2124591054 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 4943+0+0 (secure 0 0 0) 0x7ff47c09aa50 con 0x7ff480071090 2024-09-21T03:27:42.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.057+0000 7ff4767fc640 1 --2- 172.21.15.105:0/2124591054 >> [v2:172.21.15.105:6808/2783810296,v1:172.21.15.105:6809/2783810296] conn(0x7ff46407ead0 0x7ff464080f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:42.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.057+0000 7ff4767fc640 1 -- 172.21.15.105:0/2124591054 --> [v2:172.21.15.105:6808/2783810296,v1:172.21.15.105:6809/2783810296] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff4640815f0 con 0x7ff46407ead0 2024-09-21T03:27:42.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.057+0000 7ff4767fc640 1 -- 172.21.15.105:0/2124591054 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=143) ==== 24+0+0 (secure 0 0 0) 0x7ff47c0a0070 con 0x7ff480071090 2024-09-21T03:27:42.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.057+0000 7ff486206640 1 --2- 172.21.15.105:0/2124591054 >> [v2:172.21.15.105:6808/2783810296,v1:172.21.15.105:6809/2783810296] conn(0x7ff46407ead0 0x7ff464080f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:42.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.057+0000 7ff485204640 1 --2- 172.21.15.105:0/2124591054 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff464078bc0 0x7ff46407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:42.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.057+0000 7ff486206640 1 --2- 172.21.15.105:0/2124591054 >> [v2:172.21.15.105:6808/2783810296,v1:172.21.15.105:6809/2783810296] conn(0x7ff46407ead0 0x7ff464080f20 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:42.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.058+0000 7ff485204640 1 --2- 172.21.15.105:0/2124591054 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff464078bc0 0x7ff46407b0d0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7ff480157240 tx=0x7ff470009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:42.060 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.058+0000 7ff4767fc640 1 -- 172.21.15.105:0/2124591054 <== osd.2 v2:172.21.15.105:6808/2783810296 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff4640815f0 con 0x7ff46407ead0 2024-09-21T03:27:42.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.070+0000 7ff487c69640 1 -- 172.21.15.105:0/2124591054 --> [v2:172.21.15.105:6808/2783810296,v1:172.21.15.105:6809/2783810296] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff4800714a0 con 0x7ff46407ead0 2024-09-21T03:27:42.072 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.070+0000 7ff4767fc640 1 -- 172.21.15.105:0/2124591054 <== osd.2 v2:172.21.15.105:6808/2783810296 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff4800714a0 con 0x7ff46407ead0 2024-09-21T03:27:42.072 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-21T03:27:42.072 INFO:teuthology.orchestra.run.smithi105.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T03:27:42.072 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-21T03:27:42.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.071+0000 7ff487c69640 1 -- 172.21.15.105:0/2124591054 >> [v2:172.21.15.105:6808/2783810296,v1:172.21.15.105:6809/2783810296] conn(0x7ff46407ead0 msgr2=0x7ff464080f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:42.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.071+0000 7ff487c69640 1 --2- 172.21.15.105:0/2124591054 >> [v2:172.21.15.105:6808/2783810296,v1:172.21.15.105:6809/2783810296] conn(0x7ff46407ead0 0x7ff464080f20 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:42.073 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.071+0000 7ff487c69640 1 -- 172.21.15.105:0/2124591054 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff464078bc0 msgr2=0x7ff46407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:42.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.071+0000 7ff487c69640 1 --2- 172.21.15.105:0/2124591054 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff464078bc0 0x7ff46407b0d0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7ff480157240 tx=0x7ff470009040 comp rx=0 tx=0).stop 2024-09-21T03:27:42.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.071+0000 7ff487c69640 1 -- 172.21.15.105:0/2124591054 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff480071090 msgr2=0x7ff4801f74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:42.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.071+0000 7ff487c69640 1 --2- 172.21.15.105:0/2124591054 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff480071090 0x7ff4801f74c0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7ff47c00d6d0 tx=0x7ff47c00db90 comp rx=0 tx=0).stop 2024-09-21T03:27:42.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.071+0000 7ff486206640 1 -- 172.21.15.105:0/2124591054 reap_dead start 2024-09-21T03:27:42.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.071+0000 7ff487c69640 1 -- 172.21.15.105:0/2124591054 shutdown_connections 2024-09-21T03:27:42.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.071+0000 7ff487c69640 1 -- 172.21.15.105:0/2124591054 >> 172.21.15.105:0/2124591054 conn(0x7ff4800ced50 msgr2=0x7ff48015eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:42.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.071+0000 7ff487c69640 1 -- 172.21.15.105:0/2124591054 shutdown_connections 2024-09-21T03:27:42.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.071+0000 7ff487c69640 1 -- 172.21.15.105:0/2124591054 wait complete. 2024-09-21T03:27:42.083 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-21T03:27:42.196 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.194+0000 7f04f72de640 1 -- 172.21.15.105:0/499291778 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04f00cf130 msgr2=0x7f04f0071650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:42.197 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.194+0000 7f04f72de640 1 --2- 172.21.15.105:0/499291778 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04f00cf130 0x7f04f0071650 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f04e0005fd0 tx=0x7f04e002a670 comp rx=0 tx=0).stop 2024-09-21T03:27:42.197 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.194+0000 7f04f72de640 1 -- 172.21.15.105:0/499291778 shutdown_connections 2024-09-21T03:27:42.197 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.194+0000 7f04f72de640 1 --2- 172.21.15.105:0/499291778 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04f00cf130 0x7f04f0071650 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:42.197 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.194+0000 7f04f72de640 1 -- 172.21.15.105:0/499291778 >> 172.21.15.105:0/499291778 conn(0x7f04f00cdcb0 msgr2=0x7f04f00ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:42.197 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.195+0000 7f04f72de640 1 -- 172.21.15.105:0/499291778 shutdown_connections 2024-09-21T03:27:42.197 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.195+0000 7f04f72de640 1 -- 172.21.15.105:0/499291778 wait complete. 2024-09-21T03:27:42.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.196+0000 7f04f72de640 1 Processor -- start 2024-09-21T03:27:42.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.196+0000 7f04f72de640 1 -- start start 2024-09-21T03:27:42.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.197+0000 7f04f72de640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04f00b2cb0 0x7f04f0151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:42.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.197+0000 7f04f72de640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f04f00cf130 0x7f04f00cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:42.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.197+0000 7f04f72de640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04f015b8f0 0x7f04f00cc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:42.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.198+0000 7f04f72de640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f04f00ae330 con 0x7f04f015b8f0 2024-09-21T03:27:42.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.198+0000 7f04f72de640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f04f00ae1b0 con 0x7f04f00b2cb0 2024-09-21T03:27:42.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.198+0000 7f04f72de640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f04f00ae4b0 con 0x7f04f00cf130 2024-09-21T03:27:42.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.198+0000 7f04f587b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04f015b8f0 0x7f04f00cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:42.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.198+0000 7f04f587b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04f015b8f0 0x7f04f00cc700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:49734/0 (socket says 172.21.15.105:49734) 2024-09-21T03:27:42.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.198+0000 7f04f587b640 1 -- 172.21.15.105:0/4261838293 learned_addr learned my addr 172.21.15.105:0/4261838293 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:42.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.198+0000 7f04f4879640 1 --2- 172.21.15.105:0/4261838293 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f04f00cf130 0x7f04f00cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:42.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.198+0000 7f04f507a640 1 --2- 172.21.15.105:0/4261838293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04f00b2cb0 0x7f04f0151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:42.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.198+0000 7f04f587b640 1 -- 172.21.15.105:0/4261838293 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f04f00cf130 msgr2=0x7f04f00cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:42.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.198+0000 7f04f587b640 1 --2- 172.21.15.105:0/4261838293 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f04f00cf130 0x7f04f00cc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:42.201 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.198+0000 7f04f587b640 1 -- 172.21.15.105:0/4261838293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04f00b2cb0 msgr2=0x7f04f0151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:42.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.198+0000 7f04f587b640 1 --2- 172.21.15.105:0/4261838293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04f00b2cb0 0x7f04f0151fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:42.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.198+0000 7f04f587b640 1 -- 172.21.15.105:0/4261838293 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04f00ccf80 con 0x7f04f015b8f0 2024-09-21T03:27:42.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.198+0000 7f04f507a640 1 --2- 172.21.15.105:0/4261838293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04f00b2cb0 0x7f04f0151fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:27:42.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.198+0000 7f04f587b640 1 --2- 172.21.15.105:0/4261838293 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04f015b8f0 0x7f04f00cc700 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f04e800c730 tx=0x7f04e800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:42.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.198+0000 7f04e5ffb640 1 -- 172.21.15.105:0/4261838293 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e8003b90 con 0x7f04f015b8f0 2024-09-21T03:27:42.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.198+0000 7f04f72de640 1 -- 172.21.15.105:0/4261838293 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04f00cd260 con 0x7f04f015b8f0 2024-09-21T03:27:42.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.198+0000 7f04e5ffb640 1 -- 172.21.15.105:0/4261838293 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f04e8003d50 con 0x7f04f015b8f0 2024-09-21T03:27:42.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.198+0000 7f04e5ffb640 1 -- 172.21.15.105:0/4261838293 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e8005330 con 0x7f04f015b8f0 2024-09-21T03:27:42.202 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.199+0000 7f04f72de640 1 -- 172.21.15.105:0/4261838293 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04f00cd820 con 0x7f04f015b8f0 2024-09-21T03:27:42.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.199+0000 7f04f72de640 1 -- 172.21.15.105:0/4261838293 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04f00cccf0 con 0x7f04f015b8f0 2024-09-21T03:27:42.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.200+0000 7f04e5ffb640 1 -- 172.21.15.105:0/4261838293 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f04e80056e0 con 0x7f04f015b8f0 2024-09-21T03:27:42.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.201+0000 7f04e5ffb640 1 --2- 172.21.15.105:0/4261838293 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f04d4078bc0 0x7f04d407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:42.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.201+0000 7f04e5ffb640 1 -- 172.21.15.105:0/4261838293 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 4943+0+0 (secure 0 0 0) 0x7f04e809aa20 con 0x7f04f015b8f0 2024-09-21T03:27:42.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.201+0000 7f04f507a640 1 --2- 172.21.15.105:0/4261838293 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f04d4078bc0 0x7f04d407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:42.203 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.201+0000 7f04f507a640 1 --2- 172.21.15.105:0/4261838293 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f04d4078bc0 0x7f04d407b0d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f04ec007fd0 tx=0x7f04ec009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:42.207 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.205+0000 7f04e5ffb640 1 -- 172.21.15.105:0/4261838293 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f04e80630e0 con 0x7f04f015b8f0 2024-09-21T03:27:42.381 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.379+0000 7f04f72de640 1 -- 172.21.15.105:0/4261838293 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f04f0071650 con 0x7f04d4078bc0 2024-09-21T03:27:42.382 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.380+0000 7f04e5ffb640 1 -- 172.21.15.105:0/4261838293 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f04f0071650 con 0x7f04d4078bc0 2024-09-21T03:27:42.382 INFO:teuthology.orchestra.run.smithi105.stderr:instructed osd(s) 2 to deep-scrub 2024-09-21T03:27:42.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.382+0000 7f04f72de640 1 -- 172.21.15.105:0/4261838293 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f04d4078bc0 msgr2=0x7f04d407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:42.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.382+0000 7f04f72de640 1 --2- 172.21.15.105:0/4261838293 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f04d4078bc0 0x7f04d407b0d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f04ec007fd0 tx=0x7f04ec009040 comp rx=0 tx=0).stop 2024-09-21T03:27:42.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.382+0000 7f04f72de640 1 -- 172.21.15.105:0/4261838293 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04f015b8f0 msgr2=0x7f04f00cc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:42.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.382+0000 7f04f72de640 1 --2- 172.21.15.105:0/4261838293 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04f015b8f0 0x7f04f00cc700 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f04e800c730 tx=0x7f04e800cbf0 comp rx=0 tx=0).stop 2024-09-21T03:27:42.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.382+0000 7f04f72de640 1 -- 172.21.15.105:0/4261838293 shutdown_connections 2024-09-21T03:27:42.384 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.382+0000 7f04f72de640 1 --2- 172.21.15.105:0/4261838293 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f04d4078bc0 0x7f04d407b0d0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:42.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.382+0000 7f04f72de640 1 --2- 172.21.15.105:0/4261838293 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04f015b8f0 0x7f04f00cc700 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:42.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.382+0000 7f04f72de640 1 --2- 172.21.15.105:0/4261838293 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f04f00cf130 0x7f04f00cc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:42.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.382+0000 7f04f72de640 1 --2- 172.21.15.105:0/4261838293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04f00b2cb0 0x7f04f0151fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:42.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.382+0000 7f04f72de640 1 -- 172.21.15.105:0/4261838293 >> 172.21.15.105:0/4261838293 conn(0x7f04f00cdcb0 msgr2=0x7f04f00af1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:42.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.382+0000 7f04f72de640 1 -- 172.21.15.105:0/4261838293 shutdown_connections 2024-09-21T03:27:42.385 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.382+0000 7f04f72de640 1 -- 172.21.15.105:0/4261838293 wait complete. 2024-09-21T03:27:42.395 INFO:tasks.ceph:Scrubbing osd.3 2024-09-21T03:27:42.395 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-21T03:27:42.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.510+0000 7ff258520640 1 -- 172.21.15.105:0/2292748248 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff23c003c10 msgr2=0x7ff23c004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:42.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.510+0000 7ff258520640 1 --2- 172.21.15.105:0/2292748248 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff23c003c10 0x7ff23c004060 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7ff24c009b50 tx=0x7ff23c005830 comp rx=0 tx=0).stop 2024-09-21T03:27:42.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.510+0000 7ff256abd640 1 -- 172.21.15.105:0/2292748248 reap_dead start 2024-09-21T03:27:42.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.510+0000 7ff258520640 1 -- 172.21.15.105:0/2292748248 shutdown_connections 2024-09-21T03:27:42.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.510+0000 7ff258520640 1 -- 172.21.15.105:0/2292748248 >> 172.21.15.105:0/2292748248 conn(0x7ff250074190 msgr2=0x7ff2500b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:42.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.510+0000 7ff258520640 1 -- 172.21.15.105:0/2292748248 shutdown_connections 2024-09-21T03:27:42.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.510+0000 7ff258520640 1 -- 172.21.15.105:0/2292748248 wait complete. 2024-09-21T03:27:42.513 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.512+0000 7ff258520640 1 Processor -- start 2024-09-21T03:27:42.513 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.512+0000 7ff258520640 1 -- start start 2024-09-21T03:27:42.516 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.513+0000 7ff258520640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff23c003c10 0x7ff250148480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:42.516 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.513+0000 7ff258520640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff250156370 0x7ff250147020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:42.516 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.513+0000 7ff258520640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff250156780 0x7ff25006cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:42.516 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.513+0000 7ff258520640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff2500b5410 con 0x7ff250156370 2024-09-21T03:27:42.516 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.513+0000 7ff258520640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff2500b5290 con 0x7ff23c003c10 2024-09-21T03:27:42.517 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.513+0000 7ff258520640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff2500b5590 con 0x7ff250156780 2024-09-21T03:27:42.517 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.513+0000 7ff255abb640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff250156370 0x7ff250147020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:42.517 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.513+0000 7ff255abb640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff250156370 0x7ff250147020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:49744/0 (socket says 172.21.15.105:49744) 2024-09-21T03:27:42.517 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.513+0000 7ff255abb640 1 -- 172.21.15.105:0/2905332112 learned_addr learned my addr 172.21.15.105:0/2905332112 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:42.517 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.513+0000 7ff2562bc640 1 --2- 172.21.15.105:0/2905332112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff23c003c10 0x7ff250148480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:42.517 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.513+0000 7ff256abd640 1 --2- 172.21.15.105:0/2905332112 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff250156780 0x7ff25006cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:42.517 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.513+0000 7ff255abb640 1 -- 172.21.15.105:0/2905332112 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff250156780 msgr2=0x7ff25006cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:42.517 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.513+0000 7ff255abb640 1 --2- 172.21.15.105:0/2905332112 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff250156780 0x7ff25006cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:42.517 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.513+0000 7ff255abb640 1 -- 172.21.15.105:0/2905332112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff23c003c10 msgr2=0x7ff250148480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:42.517 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.513+0000 7ff255abb640 1 --2- 172.21.15.105:0/2905332112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff23c003c10 0x7ff250148480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:42.517 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.513+0000 7ff255abb640 1 -- 172.21.15.105:0/2905332112 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff250153350 con 0x7ff250156370 2024-09-21T03:27:42.517 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.513+0000 7ff2562bc640 1 --2- 172.21.15.105:0/2905332112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff23c003c10 0x7ff250148480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:27:42.517 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.514+0000 7ff255abb640 1 --2- 172.21.15.105:0/2905332112 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff250156370 0x7ff250147020 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7ff240000ff0 tx=0x7ff24000ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:42.517 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.514+0000 7ff246ffd640 1 -- 172.21.15.105:0/2905332112 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff240015020 con 0x7ff250156370 2024-09-21T03:27:42.518 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.514+0000 7ff246ffd640 1 -- 172.21.15.105:0/2905332112 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff240010980 con 0x7ff250156370 2024-09-21T03:27:42.518 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.514+0000 7ff246ffd640 1 -- 172.21.15.105:0/2905332112 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff240010dd0 con 0x7ff250156370 2024-09-21T03:27:42.518 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.514+0000 7ff258520640 1 -- 172.21.15.105:0/2905332112 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff250147c00 con 0x7ff250156370 2024-09-21T03:27:42.518 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.514+0000 7ff258520640 1 -- 172.21.15.105:0/2905332112 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff250155890 con 0x7ff250156370 2024-09-21T03:27:42.518 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.514+0000 7ff258520640 1 -- 172.21.15.105:0/2905332112 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff250069610 con 0x7ff250156370 2024-09-21T03:27:42.519 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.516+0000 7ff246ffd640 1 -- 172.21.15.105:0/2905332112 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff240018020 con 0x7ff250156370 2024-09-21T03:27:42.519 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.516+0000 7ff246ffd640 1 --2- 172.21.15.105:0/2905332112 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff234078bc0 0x7ff23407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:42.519 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.516+0000 7ff246ffd640 1 -- 172.21.15.105:0/2905332112 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 4943+0+0 (secure 0 0 0) 0x7ff24009b830 con 0x7ff250156370 2024-09-21T03:27:42.519 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.516+0000 7ff246ffd640 1 --2- 172.21.15.105:0/2905332112 >> [v2:172.21.15.105:6824/1202131294,v1:172.21.15.105:6825/1202131294] conn(0x7ff23407ead0 0x7ff234080f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:42.519 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.516+0000 7ff2562bc640 1 --2- 172.21.15.105:0/2905332112 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff234078bc0 0x7ff23407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:42.520 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.516+0000 7ff246ffd640 1 -- 172.21.15.105:0/2905332112 --> [v2:172.21.15.105:6824/1202131294,v1:172.21.15.105:6825/1202131294] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff240006e50 con 0x7ff23407ead0 2024-09-21T03:27:42.520 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.516+0000 7ff246ffd640 1 -- 172.21.15.105:0/2905332112 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=143) ==== 24+0+0 (secure 0 0 0) 0x7ff24009bcc0 con 0x7ff250156370 2024-09-21T03:27:42.520 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.516+0000 7ff256abd640 1 --2- 172.21.15.105:0/2905332112 >> [v2:172.21.15.105:6824/1202131294,v1:172.21.15.105:6825/1202131294] conn(0x7ff23407ead0 0x7ff234080f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:42.520 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.517+0000 7ff256abd640 1 --2- 172.21.15.105:0/2905332112 >> [v2:172.21.15.105:6824/1202131294,v1:172.21.15.105:6825/1202131294] conn(0x7ff23407ead0 0x7ff234080f20 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:42.520 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.517+0000 7ff2562bc640 1 --2- 172.21.15.105:0/2905332112 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff234078bc0 0x7ff23407b0d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ff24c035000 tx=0x7ff24c02d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:42.520 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.517+0000 7ff246ffd640 1 -- 172.21.15.105:0/2905332112 <== osd.3 v2:172.21.15.105:6824/1202131294 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff240006e50 con 0x7ff23407ead0 2024-09-21T03:27:42.531 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.530+0000 7ff258520640 1 -- 172.21.15.105:0/2905332112 --> [v2:172.21.15.105:6824/1202131294,v1:172.21.15.105:6825/1202131294] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff2501479b0 con 0x7ff23407ead0 2024-09-21T03:27:42.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.530+0000 7ff246ffd640 1 -- 172.21.15.105:0/2905332112 <== osd.3 v2:172.21.15.105:6824/1202131294 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff2501479b0 con 0x7ff23407ead0 2024-09-21T03:27:42.532 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-21T03:27:42.532 INFO:teuthology.orchestra.run.smithi105.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T03:27:42.532 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-21T03:27:42.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.530+0000 7ff258520640 1 -- 172.21.15.105:0/2905332112 >> [v2:172.21.15.105:6824/1202131294,v1:172.21.15.105:6825/1202131294] conn(0x7ff23407ead0 msgr2=0x7ff234080f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:42.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.530+0000 7ff258520640 1 --2- 172.21.15.105:0/2905332112 >> [v2:172.21.15.105:6824/1202131294,v1:172.21.15.105:6825/1202131294] conn(0x7ff23407ead0 0x7ff234080f20 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:42.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.530+0000 7ff258520640 1 -- 172.21.15.105:0/2905332112 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff234078bc0 msgr2=0x7ff23407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:42.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.530+0000 7ff258520640 1 --2- 172.21.15.105:0/2905332112 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7ff234078bc0 0x7ff23407b0d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ff24c035000 tx=0x7ff24c02d040 comp rx=0 tx=0).stop 2024-09-21T03:27:42.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.530+0000 7ff258520640 1 -- 172.21.15.105:0/2905332112 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff250156370 msgr2=0x7ff250147020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:42.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.530+0000 7ff258520640 1 --2- 172.21.15.105:0/2905332112 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff250156370 0x7ff250147020 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7ff240000ff0 tx=0x7ff24000ea00 comp rx=0 tx=0).stop 2024-09-21T03:27:42.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.530+0000 7ff256abd640 1 -- 172.21.15.105:0/2905332112 reap_dead start 2024-09-21T03:27:42.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.531+0000 7ff258520640 1 -- 172.21.15.105:0/2905332112 shutdown_connections 2024-09-21T03:27:42.533 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.531+0000 7ff258520640 1 -- 172.21.15.105:0/2905332112 >> 172.21.15.105:0/2905332112 conn(0x7ff250074190 msgr2=0x7ff2500cd250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:42.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.531+0000 7ff258520640 1 -- 172.21.15.105:0/2905332112 shutdown_connections 2024-09-21T03:27:42.534 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.531+0000 7ff258520640 1 -- 172.21.15.105:0/2905332112 wait complete. 2024-09-21T03:27:42.543 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-21T03:27:42.659 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.655+0000 7f3616701640 1 -- 172.21.15.105:0/2269103566 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35fc004f40 msgr2=0x7f35fc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:42.659 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.655+0000 7f3616701640 1 --2- 172.21.15.105:0/2269103566 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35fc004f40 0x7f35fc00b9c0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f3608009e20 tx=0x7f35fc005830 comp rx=0 tx=0).stop 2024-09-21T03:27:42.659 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.655+0000 7f3614c9e640 1 -- 172.21.15.105:0/2269103566 reap_dead start 2024-09-21T03:27:42.659 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.655+0000 7f3616701640 1 -- 172.21.15.105:0/2269103566 shutdown_connections 2024-09-21T03:27:42.659 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.655+0000 7f3616701640 1 -- 172.21.15.105:0/2269103566 >> 172.21.15.105:0/2269103566 conn(0x7f361009d7f0 msgr2=0x7f36100d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:42.659 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.656+0000 7f3616701640 1 -- 172.21.15.105:0/2269103566 shutdown_connections 2024-09-21T03:27:42.659 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.656+0000 7f3616701640 1 -- 172.21.15.105:0/2269103566 wait complete. 2024-09-21T03:27:42.659 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.657+0000 7f3616701640 1 Processor -- start 2024-09-21T03:27:42.659 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.657+0000 7f3616701640 1 -- start start 2024-09-21T03:27:42.662 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.659+0000 7f3616701640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35fc004f40 0x7f36100a1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:42.662 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.659+0000 7f3616701640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36100b5c20 0x7f3610160b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:42.662 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.659+0000 7f3616701640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36100c8050 0x7f36100c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:42.662 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.659+0000 7f3616701640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f361006f340 con 0x7f35fc004f40 2024-09-21T03:27:42.662 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.659+0000 7f3616701640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f361006f1c0 con 0x7f36100c8050 2024-09-21T03:27:42.662 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.659+0000 7f3616701640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f361006f4c0 con 0x7f36100b5c20 2024-09-21T03:27:42.662 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.659+0000 7f360ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35fc004f40 0x7f36100a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:42.662 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.659+0000 7f360ffff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35fc004f40 0x7f36100a1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:49764/0 (socket says 172.21.15.105:49764) 2024-09-21T03:27:42.662 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.659+0000 7f360ffff640 1 -- 172.21.15.105:0/1604705044 learned_addr learned my addr 172.21.15.105:0/1604705044 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:42.662 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.659+0000 7f3607fff640 1 --2- 172.21.15.105:0/1604705044 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36100b5c20 0x7f3610160b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:42.662 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.659+0000 7f3614c9e640 1 --2- 172.21.15.105:0/1604705044 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36100c8050 0x7f36100c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:42.662 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.659+0000 7f360ffff640 1 -- 172.21.15.105:0/1604705044 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36100b5c20 msgr2=0x7f3610160b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:42.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.659+0000 7f360ffff640 1 --2- 172.21.15.105:0/1604705044 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36100b5c20 0x7f3610160b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:42.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.659+0000 7f360ffff640 1 -- 172.21.15.105:0/1604705044 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36100c8050 msgr2=0x7f36100c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:42.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.659+0000 7f360ffff640 1 --2- 172.21.15.105:0/1604705044 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36100c8050 0x7f36100c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:42.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.659+0000 7f360ffff640 1 -- 172.21.15.105:0/1604705044 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36100c89a0 con 0x7f35fc004f40 2024-09-21T03:27:42.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.659+0000 7f360ffff640 1 --2- 172.21.15.105:0/1604705044 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35fc004f40 0x7f36100a1460 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f3600003f00 tx=0x7f360000f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:42.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.659+0000 7f360d7fa640 1 -- 172.21.15.105:0/1604705044 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3600015070 con 0x7f35fc004f40 2024-09-21T03:27:42.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.659+0000 7f360d7fa640 1 -- 172.21.15.105:0/1604705044 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3600011860 con 0x7f35fc004f40 2024-09-21T03:27:42.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.659+0000 7f3616701640 1 -- 172.21.15.105:0/1604705044 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36101ea9c0 con 0x7f35fc004f40 2024-09-21T03:27:42.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.659+0000 7f360d7fa640 1 -- 172.21.15.105:0/1604705044 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3600011cb0 con 0x7f35fc004f40 2024-09-21T03:27:42.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.659+0000 7f3616701640 1 -- 172.21.15.105:0/1604705044 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36101eaf40 con 0x7f35fc004f40 2024-09-21T03:27:42.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.660+0000 7f3616701640 1 -- 172.21.15.105:0/1604705044 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f361006fa20 con 0x7f35fc004f40 2024-09-21T03:27:42.664 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.661+0000 7f360d7fa640 1 -- 172.21.15.105:0/1604705044 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f36000103c0 con 0x7f35fc004f40 2024-09-21T03:27:42.664 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.662+0000 7f360d7fa640 1 --2- 172.21.15.105:0/1604705044 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f35f0078b90 0x7f35f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:42.664 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.662+0000 7f360d7fa640 1 -- 172.21.15.105:0/1604705044 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 4943+0+0 (secure 0 0 0) 0x7f360009b5d0 con 0x7f35fc004f40 2024-09-21T03:27:42.664 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.662+0000 7f3607fff640 1 --2- 172.21.15.105:0/1604705044 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f35f0078b90 0x7f35f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:42.664 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.663+0000 7f3607fff640 1 --2- 172.21.15.105:0/1604705044 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f35f0078b90 0x7f35f007b0a0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f36100caa90 tx=0x7f35f80067a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:42.668 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.666+0000 7f360d7fa640 1 -- 172.21.15.105:0/1604705044 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f36100c89a0 con 0x7f35fc004f40 2024-09-21T03:27:42.843 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.841+0000 7f3616701640 1 -- 172.21.15.105:0/1604705044 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f361006efa0 con 0x7f35f0078b90 2024-09-21T03:27:42.843 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.842+0000 7f360d7fa640 1 -- 172.21.15.105:0/1604705044 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f361006efa0 con 0x7f35f0078b90 2024-09-21T03:27:42.843 INFO:teuthology.orchestra.run.smithi105.stderr:instructed osd(s) 3 to deep-scrub 2024-09-21T03:27:42.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.844+0000 7f3616701640 1 -- 172.21.15.105:0/1604705044 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f35f0078b90 msgr2=0x7f35f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:42.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.844+0000 7f3616701640 1 --2- 172.21.15.105:0/1604705044 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f35f0078b90 0x7f35f007b0a0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f36100caa90 tx=0x7f35f80067a0 comp rx=0 tx=0).stop 2024-09-21T03:27:42.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.844+0000 7f3616701640 1 -- 172.21.15.105:0/1604705044 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35fc004f40 msgr2=0x7f36100a1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:42.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.844+0000 7f3616701640 1 --2- 172.21.15.105:0/1604705044 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35fc004f40 0x7f36100a1460 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f3600003f00 tx=0x7f360000f720 comp rx=0 tx=0).stop 2024-09-21T03:27:42.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.844+0000 7f3616701640 1 -- 172.21.15.105:0/1604705044 shutdown_connections 2024-09-21T03:27:42.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.844+0000 7f3616701640 1 --2- 172.21.15.105:0/1604705044 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f35f0078b90 0x7f35f007b0a0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:42.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.844+0000 7f3616701640 1 --2- 172.21.15.105:0/1604705044 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36100c8050 0x7f36100c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:42.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.844+0000 7f3616701640 1 --2- 172.21.15.105:0/1604705044 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36100b5c20 0x7f3610160b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:42.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.844+0000 7f3616701640 1 --2- 172.21.15.105:0/1604705044 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35fc004f40 0x7f36100a1460 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:42.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.844+0000 7f3616701640 1 -- 172.21.15.105:0/1604705044 >> 172.21.15.105:0/1604705044 conn(0x7f361009d7f0 msgr2=0x7f36100c9950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:42.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.844+0000 7f3616701640 1 -- 172.21.15.105:0/1604705044 shutdown_connections 2024-09-21T03:27:42.847 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.844+0000 7f3616701640 1 -- 172.21.15.105:0/1604705044 wait complete. 2024-09-21T03:27:42.857 INFO:tasks.ceph:Scrubbing osd.4 2024-09-21T03:27:42.857 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-21T03:27:42.973 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.971+0000 7fa4c8bc6640 1 -- 172.21.15.105:0/1216804219 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4c4160250 msgr2=0x7fa4c415d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:42.973 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.971+0000 7fa4c8bc6640 1 --2- 172.21.15.105:0/1216804219 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4c4160250 0x7fa4c415d570 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac005fd0 tx=0x7fa4ac02a540 comp rx=0 tx=0).stop 2024-09-21T03:27:42.973 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.971+0000 7fa4c8bc6640 1 -- 172.21.15.105:0/1216804219 shutdown_connections 2024-09-21T03:27:42.973 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.971+0000 7fa4c8bc6640 1 --2- 172.21.15.105:0/1216804219 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4c4160250 0x7fa4c415d570 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:42.974 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.971+0000 7fa4c8bc6640 1 --2- 172.21.15.105:0/1216804219 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4c40d1d60 0x7fa4c415c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:42.974 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.971+0000 7fa4c8bc6640 1 -- 172.21.15.105:0/1216804219 >> 172.21.15.105:0/1216804219 conn(0x7fa4c40b3ea0 msgr2=0x7fa4c40b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:42.974 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.971+0000 7fa4c8bc6640 1 -- 172.21.15.105:0/1216804219 shutdown_connections 2024-09-21T03:27:42.974 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.971+0000 7fa4c8bc6640 1 -- 172.21.15.105:0/1216804219 wait complete. 2024-09-21T03:27:42.975 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.973+0000 7fa4c8bc6640 1 Processor -- start 2024-09-21T03:27:42.975 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.973+0000 7fa4c8bc6640 1 -- start start 2024-09-21T03:27:42.977 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.975+0000 7fa4c8bc6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4c40d1d60 0x7fa4c40c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:42.978 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.975+0000 7fa4c8bc6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4c4160250 0x7fa4c41532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:42.978 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.975+0000 7fa4c8bc6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4c4160660 0x7fa4c406df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:42.978 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.975+0000 7fa4c8bc6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c40d0080 con 0x7fa4c40d1d60 2024-09-21T03:27:42.978 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.975+0000 7fa4c8bc6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c40cff00 con 0x7fa4c4160250 2024-09-21T03:27:42.978 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.975+0000 7fa4c8bc6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa4c40d0200 con 0x7fa4c4160660 2024-09-21T03:27:42.978 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.975+0000 7fa4c259c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4c40d1d60 0x7fa4c40c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:42.978 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.975+0000 7fa4c259c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4c40d1d60 0x7fa4c40c91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:49772/0 (socket says 172.21.15.105:49772) 2024-09-21T03:27:42.978 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.975+0000 7fa4c259c640 1 -- 172.21.15.105:0/2796298738 learned_addr learned my addr 172.21.15.105:0/2796298738 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:42.978 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.975+0000 7fa4b9d9b640 1 --2- 172.21.15.105:0/2796298738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4c4160250 0x7fa4c41532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:42.978 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.975+0000 7fa4c2d9d640 1 --2- 172.21.15.105:0/2796298738 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4c4160660 0x7fa4c406df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:42.978 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.975+0000 7fa4c259c640 1 -- 172.21.15.105:0/2796298738 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4c4160660 msgr2=0x7fa4c406df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:42.978 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.975+0000 7fa4c259c640 1 --2- 172.21.15.105:0/2796298738 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4c4160660 0x7fa4c406df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:42.979 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.975+0000 7fa4c259c640 1 -- 172.21.15.105:0/2796298738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4c4160250 msgr2=0x7fa4c41532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:42.979 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.975+0000 7fa4c259c640 1 --2- 172.21.15.105:0/2796298738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4c4160250 0x7fa4c41532c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:42.979 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.975+0000 7fa4c259c640 1 -- 172.21.15.105:0/2796298738 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4c40c7690 con 0x7fa4c40d1d60 2024-09-21T03:27:42.979 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.975+0000 7fa4c259c640 1 --2- 172.21.15.105:0/2796298738 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4c40d1d60 0x7fa4c40c91a0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fa4b400d740 tx=0x7fa4b400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:42.979 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.975+0000 7fa4bb7fe640 1 -- 172.21.15.105:0/2796298738 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4017070 con 0x7fa4c40d1d60 2024-09-21T03:27:42.979 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.976+0000 7fa4bb7fe640 1 -- 172.21.15.105:0/2796298738 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa4b4009d20 con 0x7fa4c40d1d60 2024-09-21T03:27:42.979 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.976+0000 7fa4bb7fe640 1 -- 172.21.15.105:0/2796298738 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b40106c0 con 0x7fa4c40d1d60 2024-09-21T03:27:42.979 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.976+0000 7fa4c8bc6640 1 -- 172.21.15.105:0/2796298738 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4c415ac90 con 0x7fa4c40d1d60 2024-09-21T03:27:42.979 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.976+0000 7fa4c8bc6640 1 -- 172.21.15.105:0/2796298738 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4c40c7c10 con 0x7fa4c40d1d60 2024-09-21T03:27:42.980 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.976+0000 7fa4c8bc6640 1 -- 172.21.15.105:0/2796298738 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa4c40c7ff0 con 0x7fa4c40d1d60 2024-09-21T03:27:42.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.977+0000 7fa4bb7fe640 1 -- 172.21.15.105:0/2796298738 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa4b401a070 con 0x7fa4c40d1d60 2024-09-21T03:27:42.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.978+0000 7fa4bb7fe640 1 --2- 172.21.15.105:0/2796298738 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa4a4078b90 0x7fa4a407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:42.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.978+0000 7fa4bb7fe640 1 -- 172.21.15.105:0/2796298738 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 4943+0+0 (secure 0 0 0) 0x7fa4b409b050 con 0x7fa4c40d1d60 2024-09-21T03:27:42.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.978+0000 7fa4bb7fe640 1 --2- 172.21.15.105:0/2796298738 >> [v2:172.21.15.162:6810/1660148918,v1:172.21.15.162:6811/1660148918] conn(0x7fa4a407eaa0 0x7fa4a4080ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:42.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.978+0000 7fa4bb7fe640 1 -- 172.21.15.105:0/2796298738 --> [v2:172.21.15.162:6810/1660148918,v1:172.21.15.162:6811/1660148918] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa4b4026e50 con 0x7fa4a407eaa0 2024-09-21T03:27:42.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.978+0000 7fa4bb7fe640 1 -- 172.21.15.105:0/2796298738 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=143) ==== 24+0+0 (secure 0 0 0) 0x7fa4b409b4e0 con 0x7fa4c40d1d60 2024-09-21T03:27:42.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.978+0000 7fa4b9d9b640 1 --2- 172.21.15.105:0/2796298738 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa4a4078b90 0x7fa4a407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:42.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.978+0000 7fa4c2d9d640 1 --2- 172.21.15.105:0/2796298738 >> [v2:172.21.15.162:6810/1660148918,v1:172.21.15.162:6811/1660148918] conn(0x7fa4a407eaa0 0x7fa4a4080ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:42.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.979+0000 7fa4c2d9d640 1 --2- 172.21.15.105:0/2796298738 >> [v2:172.21.15.162:6810/1660148918,v1:172.21.15.162:6811/1660148918] conn(0x7fa4a407eaa0 0x7fa4a4080ef0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:42.981 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.979+0000 7fa4b9d9b640 1 --2- 172.21.15.105:0/2796298738 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa4a4078b90 0x7fa4a407b0a0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac033000 tx=0x7fa4ac004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:42.982 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.980+0000 7fa4bb7fe640 1 -- 172.21.15.105:0/2796298738 <== osd.4 v2:172.21.15.162:6810/1660148918 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa4b4026e50 con 0x7fa4a407eaa0 2024-09-21T03:27:42.993 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.992+0000 7fa4c8bc6640 1 -- 172.21.15.105:0/2796298738 --> [v2:172.21.15.162:6810/1660148918,v1:172.21.15.162:6811/1660148918] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa4c40d0720 con 0x7fa4a407eaa0 2024-09-21T03:27:42.994 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.992+0000 7fa4bb7fe640 1 -- 172.21.15.105:0/2796298738 <== osd.4 v2:172.21.15.162:6810/1660148918 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa4c40d0720 con 0x7fa4a407eaa0 2024-09-21T03:27:42.994 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-21T03:27:42.994 INFO:teuthology.orchestra.run.smithi105.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T03:27:42.994 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-21T03:27:42.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.993+0000 7fa4c8bc6640 1 -- 172.21.15.105:0/2796298738 >> [v2:172.21.15.162:6810/1660148918,v1:172.21.15.162:6811/1660148918] conn(0x7fa4a407eaa0 msgr2=0x7fa4a4080ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:42.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.993+0000 7fa4c8bc6640 1 --2- 172.21.15.105:0/2796298738 >> [v2:172.21.15.162:6810/1660148918,v1:172.21.15.162:6811/1660148918] conn(0x7fa4a407eaa0 0x7fa4a4080ef0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:42.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.993+0000 7fa4c8bc6640 1 -- 172.21.15.105:0/2796298738 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa4a4078b90 msgr2=0x7fa4a407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:42.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.993+0000 7fa4c8bc6640 1 --2- 172.21.15.105:0/2796298738 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa4a4078b90 0x7fa4a407b0a0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac033000 tx=0x7fa4ac004730 comp rx=0 tx=0).stop 2024-09-21T03:27:42.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.993+0000 7fa4c8bc6640 1 -- 172.21.15.105:0/2796298738 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4c40d1d60 msgr2=0x7fa4c40c91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:42.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.993+0000 7fa4c8bc6640 1 --2- 172.21.15.105:0/2796298738 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4c40d1d60 0x7fa4c40c91a0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fa4b400d740 tx=0x7fa4b400dc00 comp rx=0 tx=0).stop 2024-09-21T03:27:42.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.993+0000 7fa4c2d9d640 1 -- 172.21.15.105:0/2796298738 reap_dead start 2024-09-21T03:27:42.996 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.993+0000 7fa4c8bc6640 1 -- 172.21.15.105:0/2796298738 shutdown_connections 2024-09-21T03:27:42.996 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.993+0000 7fa4c8bc6640 1 -- 172.21.15.105:0/2796298738 >> 172.21.15.105:0/2796298738 conn(0x7fa4c40b3ea0 msgr2=0x7fa4c4073150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:42.996 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.993+0000 7fa4c8bc6640 1 -- 172.21.15.105:0/2796298738 shutdown_connections 2024-09-21T03:27:42.996 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:42.993+0000 7fa4c8bc6640 1 -- 172.21.15.105:0/2796298738 wait complete. 2024-09-21T03:27:43.005 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-21T03:27:43.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.117+0000 7f1d3c1ba640 1 -- 172.21.15.105:0/1222303865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d20004800 msgr2=0x7f1d20004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:43.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.117+0000 7f1d3c1ba640 1 --2- 172.21.15.105:0/1222303865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d20004800 0x7f1d20004c10 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f1d24001690 tx=0x7f1d20005830 comp rx=0 tx=0).stop 2024-09-21T03:27:43.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.117+0000 7f1d3c1ba640 1 -- 172.21.15.105:0/1222303865 shutdown_connections 2024-09-21T03:27:43.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.117+0000 7f1d3c1ba640 1 --2- 172.21.15.105:0/1222303865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d20004800 0x7f1d20004c10 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:43.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.117+0000 7f1d3c1ba640 1 -- 172.21.15.105:0/1222303865 >> 172.21.15.105:0/1222303865 conn(0x7f1d340d15f0 msgr2=0x7f1d34073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:43.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.117+0000 7f1d3c1ba640 1 -- 172.21.15.105:0/1222303865 shutdown_connections 2024-09-21T03:27:43.120 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.117+0000 7f1d3c1ba640 1 -- 172.21.15.105:0/1222303865 wait complete. 2024-09-21T03:27:43.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.119+0000 7f1d3c1ba640 1 Processor -- start 2024-09-21T03:27:43.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.119+0000 7f1d3c1ba640 1 -- start start 2024-09-21T03:27:43.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.120+0000 7f1d3c1ba640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d20004800 0x7f1d34152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:43.123 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.120+0000 7f1d3c1ba640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d34140ea0 0x7f1d3415d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:43.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.120+0000 7f1d3c1ba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d341412b0 0x7f1d3415dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:43.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.120+0000 7f1d3c1ba640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1d340b5680 con 0x7f1d20004800 2024-09-21T03:27:43.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.120+0000 7f1d3c1ba640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1d341429a0 con 0x7f1d341412b0 2024-09-21T03:27:43.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.120+0000 7f1d3c1ba640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1d340b5800 con 0x7f1d34140ea0 2024-09-21T03:27:43.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.120+0000 7f1d39f56640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d20004800 0x7f1d34152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:43.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.120+0000 7f1d39f56640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d20004800 0x7f1d34152690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:49792/0 (socket says 172.21.15.105:49792) 2024-09-21T03:27:43.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.120+0000 7f1d39f56640 1 -- 172.21.15.105:0/2576824614 learned_addr learned my addr 172.21.15.105:0/2576824614 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:43.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.121+0000 7f1d39f56640 1 -- 172.21.15.105:0/2576824614 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d34140ea0 msgr2=0x7f1d3415d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:43.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.121+0000 7f1d39f56640 1 --2- 172.21.15.105:0/2576824614 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d34140ea0 0x7f1d3415d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:43.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.121+0000 7f1d39f56640 1 -- 172.21.15.105:0/2576824614 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d341412b0 msgr2=0x7f1d3415dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:43.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.121+0000 7f1d39f56640 1 --2- 172.21.15.105:0/2576824614 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d341412b0 0x7f1d3415dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:43.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.121+0000 7f1d39f56640 1 -- 172.21.15.105:0/2576824614 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d341f20b0 con 0x7f1d20004800 2024-09-21T03:27:43.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.121+0000 7f1d39f56640 1 --2- 172.21.15.105:0/2576824614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d20004800 0x7f1d34152690 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f1d30011780 tx=0x7f1d30011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:43.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.121+0000 7f1d2a7fc640 1 -- 172.21.15.105:0/2576824614 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3001f070 con 0x7f1d20004800 2024-09-21T03:27:43.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.121+0000 7f1d2a7fc640 1 -- 172.21.15.105:0/2576824614 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d30011e90 con 0x7f1d20004800 2024-09-21T03:27:43.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.121+0000 7f1d2a7fc640 1 -- 172.21.15.105:0/2576824614 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d300126b0 con 0x7f1d20004800 2024-09-21T03:27:43.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.121+0000 7f1d3c1ba640 1 -- 172.21.15.105:0/2576824614 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d341f56a0 con 0x7f1d20004800 2024-09-21T03:27:43.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.121+0000 7f1d3c1ba640 1 -- 172.21.15.105:0/2576824614 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d341f5e80 con 0x7f1d20004800 2024-09-21T03:27:43.125 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.122+0000 7f1d3c1ba640 1 -- 172.21.15.105:0/2576824614 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d340b5d10 con 0x7f1d20004800 2024-09-21T03:27:43.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.123+0000 7f1d2a7fc640 1 -- 172.21.15.105:0/2576824614 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1d30022070 con 0x7f1d20004800 2024-09-21T03:27:43.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.123+0000 7f1d2a7fc640 1 --2- 172.21.15.105:0/2576824614 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1d18078bc0 0x7f1d1807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:43.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.123+0000 7f1d2a7fc640 1 -- 172.21.15.105:0/2576824614 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 4943+0+0 (secure 0 0 0) 0x7f1d3009b3c0 con 0x7f1d20004800 2024-09-21T03:27:43.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.124+0000 7f1d39755640 1 --2- 172.21.15.105:0/2576824614 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1d18078bc0 0x7f1d1807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:43.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.124+0000 7f1d39755640 1 --2- 172.21.15.105:0/2576824614 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1d18078bc0 0x7f1d1807b0d0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f1d24032000 tx=0x7f1d24001120 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:43.129 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.128+0000 7f1d2a7fc640 1 -- 172.21.15.105:0/2576824614 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1d341f20b0 con 0x7f1d20004800 2024-09-21T03:27:43.304 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.302+0000 7f1d3c1ba640 1 -- 172.21.15.105:0/2576824614 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f1d340cd2b0 con 0x7f1d18078bc0 2024-09-21T03:27:43.304 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.303+0000 7f1d2a7fc640 1 -- 172.21.15.105:0/2576824614 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1d340cd2b0 con 0x7f1d18078bc0 2024-09-21T03:27:43.304 INFO:teuthology.orchestra.run.smithi105.stderr:instructed osd(s) 4 to deep-scrub 2024-09-21T03:27:43.307 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.305+0000 7f1d3c1ba640 1 -- 172.21.15.105:0/2576824614 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1d18078bc0 msgr2=0x7f1d1807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:43.307 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.305+0000 7f1d3c1ba640 1 --2- 172.21.15.105:0/2576824614 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1d18078bc0 0x7f1d1807b0d0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f1d24032000 tx=0x7f1d24001120 comp rx=0 tx=0).stop 2024-09-21T03:27:43.307 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.305+0000 7f1d3c1ba640 1 -- 172.21.15.105:0/2576824614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d20004800 msgr2=0x7f1d34152690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:43.307 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.305+0000 7f1d3c1ba640 1 --2- 172.21.15.105:0/2576824614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d20004800 0x7f1d34152690 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f1d30011780 tx=0x7f1d30011c40 comp rx=0 tx=0).stop 2024-09-21T03:27:43.307 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.305+0000 7f1d3c1ba640 1 -- 172.21.15.105:0/2576824614 shutdown_connections 2024-09-21T03:27:43.307 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.305+0000 7f1d3c1ba640 1 --2- 172.21.15.105:0/2576824614 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f1d18078bc0 0x7f1d1807b0d0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:43.307 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.305+0000 7f1d3c1ba640 1 --2- 172.21.15.105:0/2576824614 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d341412b0 0x7f1d3415dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:43.307 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.305+0000 7f1d3c1ba640 1 --2- 172.21.15.105:0/2576824614 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d34140ea0 0x7f1d3415d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:43.308 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.305+0000 7f1d3c1ba640 1 --2- 172.21.15.105:0/2576824614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d20004800 0x7f1d34152690 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:43.308 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.305+0000 7f1d3c1ba640 1 -- 172.21.15.105:0/2576824614 >> 172.21.15.105:0/2576824614 conn(0x7f1d340d15f0 msgr2=0x7f1d34071390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:43.308 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.305+0000 7f1d3c1ba640 1 -- 172.21.15.105:0/2576824614 shutdown_connections 2024-09-21T03:27:43.308 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.305+0000 7f1d3c1ba640 1 -- 172.21.15.105:0/2576824614 wait complete. 2024-09-21T03:27:43.318 INFO:tasks.ceph:Scrubbing osd.5 2024-09-21T03:27:43.318 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-21T03:27:43.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.433+0000 7f4623c7e640 1 -- 172.21.15.105:0/2991616245 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f461c0d1060 msgr2=0x7f461c0b1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:43.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.433+0000 7f4623c7e640 1 --2- 172.21.15.105:0/2991616245 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f461c0d1060 0x7f461c0b1b60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f461c09bbc0 tx=0x7f460c02a5d0 comp rx=0 tx=0).stop 2024-09-21T03:27:43.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.433+0000 7f4623c7e640 1 -- 172.21.15.105:0/2991616245 shutdown_connections 2024-09-21T03:27:43.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.433+0000 7f4623c7e640 1 --2- 172.21.15.105:0/2991616245 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f461c0d1060 0x7f461c0b1b60 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:43.435 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.433+0000 7f4623c7e640 1 --2- 172.21.15.105:0/2991616245 >> v2:172.21.15.162:3300/0 conn(0x7f461c0b20a0 0x7f461c0b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:43.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.433+0000 7f4623c7e640 1 -- 172.21.15.105:0/2991616245 >> 172.21.15.105:0/2991616245 conn(0x7f461c0ced80 msgr2=0x7f461c0cf190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:43.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.433+0000 7f4623c7e640 1 -- 172.21.15.105:0/2991616245 shutdown_connections 2024-09-21T03:27:43.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.433+0000 7f4623c7e640 1 -- 172.21.15.105:0/2991616245 wait complete. 2024-09-21T03:27:43.436 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.435+0000 7f4623c7e640 1 Processor -- start 2024-09-21T03:27:43.437 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.435+0000 7f4623c7e640 1 -- start start 2024-09-21T03:27:43.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.436+0000 7f4623c7e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f461c0b20a0 0x7f461c159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:43.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.436+0000 7f4623c7e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f461c0b7a00 0x7f461c0caf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:43.439 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.436+0000 7f4623c7e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f461c0d1060 0x7f461c0cb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:43.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.436+0000 7f4623c7e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f461c0ccf10 con 0x7f461c0b7a00 2024-09-21T03:27:43.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.436+0000 7f4623c7e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f461c0b1940 con 0x7f461c0b20a0 2024-09-21T03:27:43.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.436+0000 7f4623c7e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f461c0cd090 con 0x7f461c0d1060 2024-09-21T03:27:43.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.436+0000 7f4621219640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f461c0b7a00 0x7f461c0caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:43.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.436+0000 7f4621219640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f461c0b7a00 0x7f461c0caf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:49806/0 (socket says 172.21.15.105:49806) 2024-09-21T03:27:43.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.436+0000 7f4621219640 1 -- 172.21.15.105:0/281464766 learned_addr learned my addr 172.21.15.105:0/281464766 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:43.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.437+0000 7f4621a1a640 1 --2- 172.21.15.105:0/281464766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f461c0b20a0 0x7f461c159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:43.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.437+0000 7f462221b640 1 --2- 172.21.15.105:0/281464766 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f461c0d1060 0x7f461c0cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:43.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.437+0000 7f4621219640 1 -- 172.21.15.105:0/281464766 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f461c0d1060 msgr2=0x7f461c0cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:43.440 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.437+0000 7f4621219640 1 --2- 172.21.15.105:0/281464766 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f461c0d1060 0x7f461c0cb470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:43.441 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.437+0000 7f4621219640 1 -- 172.21.15.105:0/281464766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f461c0b20a0 msgr2=0x7f461c159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:43.441 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.437+0000 7f4621219640 1 --2- 172.21.15.105:0/281464766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f461c0b20a0 0x7f461c159cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:43.441 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.437+0000 7f4621219640 1 -- 172.21.15.105:0/281464766 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f461c15e140 con 0x7f461c0b7a00 2024-09-21T03:27:43.441 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.437+0000 7f4621a1a640 1 --2- 172.21.15.105:0/281464766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f461c0b20a0 0x7f461c159cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:27:43.441 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.437+0000 7f4621219640 1 --2- 172.21.15.105:0/281464766 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f461c0b7a00 0x7f461c0caf30 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f460c034040 tx=0x7f460c003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:43.441 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.437+0000 7f46127fc640 1 -- 172.21.15.105:0/281464766 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460c03e030 con 0x7f461c0b7a00 2024-09-21T03:27:43.441 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.437+0000 7f46127fc640 1 -- 172.21.15.105:0/281464766 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f460c003c20 con 0x7f461c0b7a00 2024-09-21T03:27:43.441 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.437+0000 7f4623c7e640 1 -- 172.21.15.105:0/281464766 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f461c0ca450 con 0x7f461c0b7a00 2024-09-21T03:27:43.441 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.437+0000 7f46127fc640 1 -- 172.21.15.105:0/281464766 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460c035040 con 0x7f461c0b7a00 2024-09-21T03:27:43.441 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.437+0000 7f4623c7e640 1 -- 172.21.15.105:0/281464766 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f461c15a230 con 0x7f461c0b7a00 2024-09-21T03:27:43.442 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.438+0000 7f4623c7e640 1 -- 172.21.15.105:0/281464766 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f461c15dc50 con 0x7f461c0b7a00 2024-09-21T03:27:43.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.439+0000 7f46127fc640 1 -- 172.21.15.105:0/281464766 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f460c041030 con 0x7f461c0b7a00 2024-09-21T03:27:43.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.439+0000 7f46127fc640 1 --2- 172.21.15.105:0/281464766 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4600078bc0 0x7f460007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:43.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.439+0000 7f46127fc640 1 -- 172.21.15.105:0/281464766 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 4943+0+0 (secure 0 0 0) 0x7f460c0bb480 con 0x7f461c0b7a00 2024-09-21T03:27:43.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.439+0000 7f46127fc640 1 --2- 172.21.15.105:0/281464766 >> [v2:172.21.15.162:6802/2576522891,v1:172.21.15.162:6803/2576522891] conn(0x7f460007ead0 0x7f4600080f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:43.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.439+0000 7f46127fc640 1 -- 172.21.15.105:0/281464766 --> [v2:172.21.15.162:6802/2576522891,v1:172.21.15.162:6803/2576522891] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f460c03be50 con 0x7f460007ead0 2024-09-21T03:27:43.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.439+0000 7f46127fc640 1 -- 172.21.15.105:0/281464766 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=143) ==== 24+0+0 (secure 0 0 0) 0x7f460c0bb910 con 0x7f461c0b7a00 2024-09-21T03:27:43.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.440+0000 7f4621a1a640 1 --2- 172.21.15.105:0/281464766 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4600078bc0 0x7f460007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:43.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.440+0000 7f462221b640 1 --2- 172.21.15.105:0/281464766 >> [v2:172.21.15.162:6802/2576522891,v1:172.21.15.162:6803/2576522891] conn(0x7f460007ead0 0x7f4600080f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:43.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.440+0000 7f462221b640 1 --2- 172.21.15.105:0/281464766 >> [v2:172.21.15.162:6802/2576522891,v1:172.21.15.162:6803/2576522891] conn(0x7f460007ead0 0x7f4600080f20 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:43.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.440+0000 7f4621a1a640 1 --2- 172.21.15.105:0/281464766 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4600078bc0 0x7f460007b0d0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f4618001650 tx=0x7f4618009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:43.444 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.441+0000 7f46127fc640 1 -- 172.21.15.105:0/281464766 <== osd.5 v2:172.21.15.162:6802/2576522891 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f460c03be50 con 0x7f460007ead0 2024-09-21T03:27:43.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.453+0000 7f4623c7e640 1 -- 172.21.15.105:0/281464766 --> [v2:172.21.15.162:6802/2576522891,v1:172.21.15.162:6803/2576522891] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f461c15def0 con 0x7f460007ead0 2024-09-21T03:27:43.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.454+0000 7f46127fc640 1 -- 172.21.15.105:0/281464766 <== osd.5 v2:172.21.15.162:6802/2576522891 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f461c15def0 con 0x7f460007ead0 2024-09-21T03:27:43.456 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-21T03:27:43.456 INFO:teuthology.orchestra.run.smithi105.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T03:27:43.456 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-21T03:27:43.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.454+0000 7f4623c7e640 1 -- 172.21.15.105:0/281464766 >> [v2:172.21.15.162:6802/2576522891,v1:172.21.15.162:6803/2576522891] conn(0x7f460007ead0 msgr2=0x7f4600080f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:43.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.454+0000 7f4623c7e640 1 --2- 172.21.15.105:0/281464766 >> [v2:172.21.15.162:6802/2576522891,v1:172.21.15.162:6803/2576522891] conn(0x7f460007ead0 0x7f4600080f20 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:43.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.455+0000 7f4623c7e640 1 -- 172.21.15.105:0/281464766 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4600078bc0 msgr2=0x7f460007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:43.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.455+0000 7f4623c7e640 1 --2- 172.21.15.105:0/281464766 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f4600078bc0 0x7f460007b0d0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f4618001650 tx=0x7f4618009040 comp rx=0 tx=0).stop 2024-09-21T03:27:43.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.455+0000 7f4623c7e640 1 -- 172.21.15.105:0/281464766 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f461c0b7a00 msgr2=0x7f461c0caf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:43.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.455+0000 7f4623c7e640 1 --2- 172.21.15.105:0/281464766 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f461c0b7a00 0x7f461c0caf30 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f460c034040 tx=0x7f460c003820 comp rx=0 tx=0).stop 2024-09-21T03:27:43.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.455+0000 7f462221b640 1 -- 172.21.15.105:0/281464766 reap_dead start 2024-09-21T03:27:43.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.455+0000 7f4623c7e640 1 -- 172.21.15.105:0/281464766 shutdown_connections 2024-09-21T03:27:43.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.455+0000 7f4623c7e640 1 -- 172.21.15.105:0/281464766 >> 172.21.15.105:0/281464766 conn(0x7f461c0ced80 msgr2=0x7f461c0cbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:43.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.455+0000 7f4623c7e640 1 -- 172.21.15.105:0/281464766 shutdown_connections 2024-09-21T03:27:43.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.455+0000 7f4623c7e640 1 -- 172.21.15.105:0/281464766 wait complete. 2024-09-21T03:27:43.467 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-21T03:27:43.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.580+0000 7fc74a64d640 1 -- 172.21.15.105:0/3086189480 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc730004d40 msgr2=0x7fc730005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:43.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.580+0000 7fc74a64d640 1 --2- 172.21.15.105:0/3086189480 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc730004d40 0x7fc730005190 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7fc73c00c640 tx=0x7fc730005830 comp rx=0 tx=0).stop 2024-09-21T03:27:43.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.580+0000 7fc748bea640 1 -- 172.21.15.105:0/3086189480 reap_dead start 2024-09-21T03:27:43.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.580+0000 7fc74a64d640 1 -- 172.21.15.105:0/3086189480 shutdown_connections 2024-09-21T03:27:43.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.580+0000 7fc74a64d640 1 -- 172.21.15.105:0/3086189480 >> 172.21.15.105:0/3086189480 conn(0x7fc744072ae0 msgr2=0x7fc744072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:43.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.580+0000 7fc74a64d640 1 -- 172.21.15.105:0/3086189480 shutdown_connections 2024-09-21T03:27:43.582 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.580+0000 7fc74a64d640 1 -- 172.21.15.105:0/3086189480 wait complete. 2024-09-21T03:27:43.583 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.582+0000 7fc74a64d640 1 Processor -- start 2024-09-21T03:27:43.583 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.582+0000 7fc74a64d640 1 -- start start 2024-09-21T03:27:43.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.583+0000 7fc74a64d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc730004d40 0x7fc74414e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:43.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.583+0000 7fc74a64d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7440c7000 0x7fc74414aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:43.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.583+0000 7fc74a64d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7441f65f0 0x7fc7441f6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:43.586 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.583+0000 7fc74a64d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc74415c860 con 0x7fc7440c7000 2024-09-21T03:27:43.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.583+0000 7fc74a64d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc74415c6e0 con 0x7fc7441f65f0 2024-09-21T03:27:43.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.583+0000 7fc74a64d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc74415c9e0 con 0x7fc730004d40 2024-09-21T03:27:43.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.583+0000 7fc7437fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7440c7000 0x7fc74414aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:43.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.583+0000 7fc7437fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7440c7000 0x7fc74414aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:49828/0 (socket says 172.21.15.105:49828) 2024-09-21T03:27:43.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.583+0000 7fc7437fe640 1 -- 172.21.15.105:0/3284918681 learned_addr learned my addr 172.21.15.105:0/3284918681 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:43.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.583+0000 7fc743fff640 1 --2- 172.21.15.105:0/3284918681 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc730004d40 0x7fc74414e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:43.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.583+0000 7fc748bea640 1 --2- 172.21.15.105:0/3284918681 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7441f65f0 0x7fc7441f6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:43.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.584+0000 7fc7437fe640 1 -- 172.21.15.105:0/3284918681 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc730004d40 msgr2=0x7fc74414e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:43.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.584+0000 7fc7437fe640 1 --2- 172.21.15.105:0/3284918681 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc730004d40 0x7fc74414e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:43.587 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.584+0000 7fc7437fe640 1 -- 172.21.15.105:0/3284918681 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7441f65f0 msgr2=0x7fc7441f6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:43.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.584+0000 7fc7437fe640 1 --2- 172.21.15.105:0/3284918681 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7441f65f0 0x7fc7441f6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:43.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.584+0000 7fc7437fe640 1 -- 172.21.15.105:0/3284918681 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7441f6f40 con 0x7fc7440c7000 2024-09-21T03:27:43.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.584+0000 7fc7437fe640 1 --2- 172.21.15.105:0/3284918681 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7440c7000 0x7fc74414aeb0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fc72c003f20 tx=0x7fc72c001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:43.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.584+0000 7fc740ff9640 1 -- 172.21.15.105:0/3284918681 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc72c015070 con 0x7fc7440c7000 2024-09-21T03:27:43.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.584+0000 7fc740ff9640 1 -- 172.21.15.105:0/3284918681 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc72c011840 con 0x7fc7440c7000 2024-09-21T03:27:43.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.584+0000 7fc74a64d640 1 -- 172.21.15.105:0/3284918681 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7440c7730 con 0x7fc7440c7000 2024-09-21T03:27:43.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.584+0000 7fc740ff9640 1 -- 172.21.15.105:0/3284918681 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc72c011c90 con 0x7fc7440c7000 2024-09-21T03:27:43.588 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.584+0000 7fc74a64d640 1 -- 172.21.15.105:0/3284918681 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7440c7cf0 con 0x7fc7440c7000 2024-09-21T03:27:43.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.585+0000 7fc74a64d640 1 -- 172.21.15.105:0/3284918681 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7440c74a0 con 0x7fc7440c7000 2024-09-21T03:27:43.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.586+0000 7fc740ff9640 1 -- 172.21.15.105:0/3284918681 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc72c018070 con 0x7fc7440c7000 2024-09-21T03:27:43.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.586+0000 7fc740ff9640 1 --2- 172.21.15.105:0/3284918681 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc724078b90 0x7fc72407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:43.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.586+0000 7fc740ff9640 1 -- 172.21.15.105:0/3284918681 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 4943+0+0 (secure 0 0 0) 0x7fc72c09b5b0 con 0x7fc7440c7000 2024-09-21T03:27:43.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.587+0000 7fc743fff640 1 --2- 172.21.15.105:0/3284918681 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc724078b90 0x7fc72407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:43.589 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.587+0000 7fc743fff640 1 --2- 172.21.15.105:0/3284918681 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc724078b90 0x7fc72407b0a0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fc734009c50 tx=0x7fc734005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:43.592 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.591+0000 7fc740ff9640 1 -- 172.21.15.105:0/3284918681 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc7441f6f40 con 0x7fc7440c7000 2024-09-21T03:27:43.771 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.769+0000 7fc74a64d640 1 -- 172.21.15.105:0/3284918681 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fc7440cebf0 con 0x7fc724078b90 2024-09-21T03:27:43.771 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.770+0000 7fc740ff9640 1 -- 172.21.15.105:0/3284918681 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc7440cebf0 con 0x7fc724078b90 2024-09-21T03:27:43.771 INFO:teuthology.orchestra.run.smithi105.stderr:instructed osd(s) 5 to deep-scrub 2024-09-21T03:27:43.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.772+0000 7fc74a64d640 1 -- 172.21.15.105:0/3284918681 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc724078b90 msgr2=0x7fc72407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:43.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.772+0000 7fc74a64d640 1 --2- 172.21.15.105:0/3284918681 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc724078b90 0x7fc72407b0a0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fc734009c50 tx=0x7fc734005f90 comp rx=0 tx=0).stop 2024-09-21T03:27:43.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.772+0000 7fc74a64d640 1 -- 172.21.15.105:0/3284918681 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7440c7000 msgr2=0x7fc74414aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:43.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.772+0000 7fc74a64d640 1 --2- 172.21.15.105:0/3284918681 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7440c7000 0x7fc74414aeb0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fc72c003f20 tx=0x7fc72c001710 comp rx=0 tx=0).stop 2024-09-21T03:27:43.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.772+0000 7fc74a64d640 1 -- 172.21.15.105:0/3284918681 shutdown_connections 2024-09-21T03:27:43.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.772+0000 7fc74a64d640 1 --2- 172.21.15.105:0/3284918681 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fc724078b90 0x7fc72407b0a0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:43.774 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.772+0000 7fc74a64d640 1 --2- 172.21.15.105:0/3284918681 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7441f65f0 0x7fc7441f6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:43.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.772+0000 7fc74a64d640 1 --2- 172.21.15.105:0/3284918681 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7440c7000 0x7fc74414aeb0 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:43.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.772+0000 7fc74a64d640 1 --2- 172.21.15.105:0/3284918681 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc730004d40 0x7fc74414e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:43.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.772+0000 7fc74a64d640 1 -- 172.21.15.105:0/3284918681 >> 172.21.15.105:0/3284918681 conn(0x7fc744072ae0 msgr2=0x7fc7440b6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:43.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.772+0000 7fc74a64d640 1 -- 172.21.15.105:0/3284918681 shutdown_connections 2024-09-21T03:27:43.775 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.772+0000 7fc74a64d640 1 -- 172.21.15.105:0/3284918681 wait complete. 2024-09-21T03:27:43.785 INFO:tasks.ceph:Scrubbing osd.6 2024-09-21T03:27:43.785 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-21T03:27:43.902 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.900+0000 7f19f8f13640 1 -- 172.21.15.105:0/2295882079 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19e0003a80 msgr2=0x7f19e0003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:43.902 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.900+0000 7f19f8f13640 1 --2- 172.21.15.105:0/2295882079 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19e0003a80 0x7f19e0003ef0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f19e4006fa0 tx=0x7f19e0005830 comp rx=0 tx=0).stop 2024-09-21T03:27:43.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.900+0000 7f19f2d9d640 1 -- 172.21.15.105:0/2295882079 reap_dead start 2024-09-21T03:27:43.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.900+0000 7f19f8f13640 1 -- 172.21.15.105:0/2295882079 shutdown_connections 2024-09-21T03:27:43.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.900+0000 7f19f8f13640 1 -- 172.21.15.105:0/2295882079 >> 172.21.15.105:0/2295882079 conn(0x7f19f409d800 msgr2=0x7f19f408bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:43.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.900+0000 7f19f8f13640 1 -- 172.21.15.105:0/2295882079 shutdown_connections 2024-09-21T03:27:43.903 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.900+0000 7f19f8f13640 1 -- 172.21.15.105:0/2295882079 wait complete. 2024-09-21T03:27:43.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.902+0000 7f19f8f13640 1 Processor -- start 2024-09-21T03:27:43.904 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.903+0000 7f19f8f13640 1 -- start start 2024-09-21T03:27:43.906 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.904+0000 7f19f8f13640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19e0003a80 0x7f19f40a19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:43.907 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.904+0000 7f19f8f13640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19f40ca8e0 0x7f19f415dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:43.907 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.904+0000 7f19f8f13640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19f415e1b0 0x7f19f41f8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:43.907 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.904+0000 7f19f8f13640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f19f41679c0 con 0x7f19f415e1b0 2024-09-21T03:27:43.907 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.904+0000 7f19f8f13640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f19f4167840 con 0x7f19e0003a80 2024-09-21T03:27:43.907 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.904+0000 7f19f8f13640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f19f4167b40 con 0x7f19f40ca8e0 2024-09-21T03:27:43.907 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.904+0000 7f19f2d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19f415e1b0 0x7f19f41f8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:43.907 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.904+0000 7f19f2d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19f415e1b0 0x7f19f41f8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:49848/0 (socket says 172.21.15.105:49848) 2024-09-21T03:27:43.907 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.904+0000 7f19f2d9d640 1 -- 172.21.15.105:0/3678508895 learned_addr learned my addr 172.21.15.105:0/3678508895 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:43.907 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.904+0000 7f19e9d9b640 1 --2- 172.21.15.105:0/3678508895 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19f40ca8e0 0x7f19f415dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:43.907 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.904+0000 7f19f259c640 1 --2- 172.21.15.105:0/3678508895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19e0003a80 0x7f19f40a19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:43.907 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.904+0000 7f19f2d9d640 1 -- 172.21.15.105:0/3678508895 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19f40ca8e0 msgr2=0x7f19f415dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:43.907 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.904+0000 7f19f2d9d640 1 --2- 172.21.15.105:0/3678508895 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19f40ca8e0 0x7f19f415dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:43.907 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.904+0000 7f19f2d9d640 1 -- 172.21.15.105:0/3678508895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19e0003a80 msgr2=0x7f19f40a19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:43.908 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.904+0000 7f19f2d9d640 1 --2- 172.21.15.105:0/3678508895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19e0003a80 0x7f19f40a19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:43.908 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.904+0000 7f19f2d9d640 1 -- 172.21.15.105:0/3678508895 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f415e5c0 con 0x7f19f415e1b0 2024-09-21T03:27:43.908 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.904+0000 7f19f2d9d640 1 --2- 172.21.15.105:0/3678508895 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19f415e1b0 0x7f19f41f8e10 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f19ec005fd0 tx=0x7f19ec010f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:43.908 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.905+0000 7f19eb7fe640 1 -- 172.21.15.105:0/3678508895 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ec00eca0 con 0x7f19f415e1b0 2024-09-21T03:27:43.908 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.905+0000 7f19eb7fe640 1 -- 172.21.15.105:0/3678508895 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f19ec00ee60 con 0x7f19f415e1b0 2024-09-21T03:27:43.908 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.905+0000 7f19f8f13640 1 -- 172.21.15.105:0/3678508895 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19f41f6950 con 0x7f19f415e1b0 2024-09-21T03:27:43.908 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.905+0000 7f19eb7fe640 1 -- 172.21.15.105:0/3678508895 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ec004d60 con 0x7f19f415e1b0 2024-09-21T03:27:43.908 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.905+0000 7f19f8f13640 1 -- 172.21.15.105:0/3678508895 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19f41f5a30 con 0x7f19f415e1b0 2024-09-21T03:27:43.909 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.906+0000 7f19f8f13640 1 -- 172.21.15.105:0/3678508895 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f19f40d1230 con 0x7f19f415e1b0 2024-09-21T03:27:43.909 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.907+0000 7f19eb7fe640 1 -- 172.21.15.105:0/3678508895 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f19ec01c020 con 0x7f19f415e1b0 2024-09-21T03:27:43.909 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.907+0000 7f19eb7fe640 1 --2- 172.21.15.105:0/3678508895 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f19d4078bc0 0x7f19d407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:43.909 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.907+0000 7f19eb7fe640 1 -- 172.21.15.105:0/3678508895 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 4943+0+0 (secure 0 0 0) 0x7f19ec09b680 con 0x7f19f415e1b0 2024-09-21T03:27:43.910 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.907+0000 7f19eb7fe640 1 --2- 172.21.15.105:0/3678508895 >> [v2:172.21.15.162:6818/2201319593,v1:172.21.15.162:6819/2201319593] conn(0x7f19d407ead0 0x7f19d4080f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:43.910 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.907+0000 7f19eb7fe640 1 -- 172.21.15.105:0/3678508895 --> [v2:172.21.15.162:6818/2201319593,v1:172.21.15.162:6819/2201319593] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f19ec015e50 con 0x7f19d407ead0 2024-09-21T03:27:43.910 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.907+0000 7f19eb7fe640 1 -- 172.21.15.105:0/3678508895 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=143) ==== 24+0+0 (secure 0 0 0) 0x7f19ec09bb10 con 0x7f19f415e1b0 2024-09-21T03:27:43.910 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.907+0000 7f19f259c640 1 --2- 172.21.15.105:0/3678508895 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f19d4078bc0 0x7f19d407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:43.910 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.907+0000 7f19e9d9b640 1 --2- 172.21.15.105:0/3678508895 >> [v2:172.21.15.162:6818/2201319593,v1:172.21.15.162:6819/2201319593] conn(0x7f19d407ead0 0x7f19d4080f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:43.910 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.908+0000 7f19f259c640 1 --2- 172.21.15.105:0/3678508895 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f19d4078bc0 0x7f19d407b0d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f19e4033000 tx=0x7f19f40cf840 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:43.910 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.908+0000 7f19e9d9b640 1 --2- 172.21.15.105:0/3678508895 >> [v2:172.21.15.162:6818/2201319593,v1:172.21.15.162:6819/2201319593] conn(0x7f19d407ead0 0x7f19d4080f20 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:43.910 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.909+0000 7f19eb7fe640 1 -- 172.21.15.105:0/3678508895 <== osd.6 v2:172.21.15.162:6818/2201319593 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f19ec015e50 con 0x7f19d407ead0 2024-09-21T03:27:43.922 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.921+0000 7f19f8f13640 1 -- 172.21.15.105:0/3678508895 --> [v2:172.21.15.162:6818/2201319593,v1:172.21.15.162:6819/2201319593] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f19f41f6b20 con 0x7f19d407ead0 2024-09-21T03:27:43.923 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.922+0000 7f19eb7fe640 1 -- 172.21.15.105:0/3678508895 <== osd.6 v2:172.21.15.162:6818/2201319593 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f19f41f6b20 con 0x7f19d407ead0 2024-09-21T03:27:43.924 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-21T03:27:43.924 INFO:teuthology.orchestra.run.smithi105.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T03:27:43.924 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-21T03:27:43.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.922+0000 7f19f8f13640 1 -- 172.21.15.105:0/3678508895 >> [v2:172.21.15.162:6818/2201319593,v1:172.21.15.162:6819/2201319593] conn(0x7f19d407ead0 msgr2=0x7f19d4080f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:43.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.922+0000 7f19f8f13640 1 --2- 172.21.15.105:0/3678508895 >> [v2:172.21.15.162:6818/2201319593,v1:172.21.15.162:6819/2201319593] conn(0x7f19d407ead0 0x7f19d4080f20 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:43.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.922+0000 7f19f8f13640 1 -- 172.21.15.105:0/3678508895 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f19d4078bc0 msgr2=0x7f19d407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:43.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.922+0000 7f19f8f13640 1 --2- 172.21.15.105:0/3678508895 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f19d4078bc0 0x7f19d407b0d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f19e4033000 tx=0x7f19f40cf840 comp rx=0 tx=0).stop 2024-09-21T03:27:43.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.922+0000 7f19f8f13640 1 -- 172.21.15.105:0/3678508895 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19f415e1b0 msgr2=0x7f19f41f8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:43.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.922+0000 7f19f8f13640 1 --2- 172.21.15.105:0/3678508895 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19f415e1b0 0x7f19f41f8e10 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f19ec005fd0 tx=0x7f19ec010f00 comp rx=0 tx=0).stop 2024-09-21T03:27:43.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.922+0000 7f19f2d9d640 1 -- 172.21.15.105:0/3678508895 reap_dead start 2024-09-21T03:27:43.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.922+0000 7f19f8f13640 1 -- 172.21.15.105:0/3678508895 shutdown_connections 2024-09-21T03:27:43.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.922+0000 7f19f8f13640 1 -- 172.21.15.105:0/3678508895 >> 172.21.15.105:0/3678508895 conn(0x7f19f409d800 msgr2=0x7f19f40d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:43.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.922+0000 7f19f8f13640 1 -- 172.21.15.105:0/3678508895 shutdown_connections 2024-09-21T03:27:43.926 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:43.922+0000 7f19f8f13640 1 -- 172.21.15.105:0/3678508895 wait complete. 2024-09-21T03:27:43.934 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-21T03:27:44.047 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.045+0000 7fdf58b0b640 1 -- 172.21.15.105:0/687098828 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf540b7cc0 msgr2=0x7fdf540cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:44.047 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.045+0000 7fdf58b0b640 1 --2- 172.21.15.105:0/687098828 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf540b7cc0 0x7fdf540cec10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdf48005fd0 tx=0x7fdf4802a5d0 comp rx=0 tx=0).stop 2024-09-21T03:27:44.047 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.045+0000 7fdf58b0b640 1 -- 172.21.15.105:0/687098828 shutdown_connections 2024-09-21T03:27:44.048 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.045+0000 7fdf58b0b640 1 --2- 172.21.15.105:0/687098828 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf540b7cc0 0x7fdf540cec10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:44.048 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.045+0000 7fdf58b0b640 1 --2- 172.21.15.105:0/687098828 >> v2:172.21.15.162:3300/0 conn(0x7fdf541600b0 0x7fdf540ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:44.048 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.045+0000 7fdf58b0b640 1 -- 172.21.15.105:0/687098828 >> 172.21.15.105:0/687098828 conn(0x7fdf5406d4f0 msgr2=0x7fdf54071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:44.048 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.045+0000 7fdf58b0b640 1 -- 172.21.15.105:0/687098828 shutdown_connections 2024-09-21T03:27:44.048 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.045+0000 7fdf58b0b640 1 -- 172.21.15.105:0/687098828 wait complete. 2024-09-21T03:27:44.049 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.047+0000 7fdf58b0b640 1 Processor -- start 2024-09-21T03:27:44.049 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.047+0000 7fdf58b0b640 1 -- start start 2024-09-21T03:27:44.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.048+0000 7fdf58b0b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf540b7cc0 0x7fdf5414d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:44.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.048+0000 7fdf58b0b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf540cf150 0x7fdf540b7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:44.051 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.048+0000 7fdf58b0b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf541600b0 0x7fdf540cb360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:44.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.048+0000 7fdf58b0b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdf540b4460 con 0x7fdf540b7cc0 2024-09-21T03:27:44.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.048+0000 7fdf58b0b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdf540d1ba0 con 0x7fdf540cf150 2024-09-21T03:27:44.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.048+0000 7fdf58b0b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdf540b45e0 con 0x7fdf541600b0 2024-09-21T03:27:44.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.049+0000 7fdf5259c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf540b7cc0 0x7fdf5414d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:44.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.049+0000 7fdf5259c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf540b7cc0 0x7fdf5414d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:49850/0 (socket says 172.21.15.105:49850) 2024-09-21T03:27:44.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.049+0000 7fdf5259c640 1 -- 172.21.15.105:0/3768224987 learned_addr learned my addr 172.21.15.105:0/3768224987 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:44.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.049+0000 7fdf51d9b640 1 --2- 172.21.15.105:0/3768224987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf540cf150 0x7fdf540b7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:44.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.049+0000 7fdf52d9d640 1 --2- 172.21.15.105:0/3768224987 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf541600b0 0x7fdf540cb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:44.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.049+0000 7fdf5259c640 1 -- 172.21.15.105:0/3768224987 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf541600b0 msgr2=0x7fdf540cb360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:44.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.049+0000 7fdf5259c640 1 --2- 172.21.15.105:0/3768224987 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf541600b0 0x7fdf540cb360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:44.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.049+0000 7fdf5259c640 1 -- 172.21.15.105:0/3768224987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf540cf150 msgr2=0x7fdf540b7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:44.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.049+0000 7fdf5259c640 1 --2- 172.21.15.105:0/3768224987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf540cf150 0x7fdf540b7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:44.052 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.049+0000 7fdf5259c640 1 -- 172.21.15.105:0/3768224987 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf540b5320 con 0x7fdf540b7cc0 2024-09-21T03:27:44.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.049+0000 7fdf5259c640 1 --2- 172.21.15.105:0/3768224987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf540b7cc0 0x7fdf5414d700 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fdf4400e7c0 tx=0x7fdf4400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:44.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.049+0000 7fdf42ffd640 1 -- 172.21.15.105:0/3768224987 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf4400ccc0 con 0x7fdf540b7cc0 2024-09-21T03:27:44.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.049+0000 7fdf42ffd640 1 -- 172.21.15.105:0/3768224987 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf44010430 con 0x7fdf540b7cc0 2024-09-21T03:27:44.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.049+0000 7fdf42ffd640 1 -- 172.21.15.105:0/3768224987 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf44010860 con 0x7fdf540b7cc0 2024-09-21T03:27:44.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.049+0000 7fdf58b0b640 1 -- 172.21.15.105:0/3768224987 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf5414dc40 con 0x7fdf540b7cc0 2024-09-21T03:27:44.053 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.049+0000 7fdf58b0b640 1 -- 172.21.15.105:0/3768224987 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf540ca7a0 con 0x7fdf540b7cc0 2024-09-21T03:27:44.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.050+0000 7fdf58b0b640 1 -- 172.21.15.105:0/3768224987 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf540cec10 con 0x7fdf540b7cc0 2024-09-21T03:27:44.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.051+0000 7fdf42ffd640 1 -- 172.21.15.105:0/3768224987 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdf44010a00 con 0x7fdf540b7cc0 2024-09-21T03:27:44.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.052+0000 7fdf42ffd640 1 --2- 172.21.15.105:0/3768224987 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdf34078bc0 0x7fdf3407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:44.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.052+0000 7fdf42ffd640 1 -- 172.21.15.105:0/3768224987 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 4943+0+0 (secure 0 0 0) 0x7fdf4409b3d0 con 0x7fdf540b7cc0 2024-09-21T03:27:44.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.052+0000 7fdf51d9b640 1 --2- 172.21.15.105:0/3768224987 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdf34078bc0 0x7fdf3407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:44.054 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.053+0000 7fdf51d9b640 1 --2- 172.21.15.105:0/3768224987 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdf34078bc0 0x7fdf3407b0d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fdf48033000 tx=0x7fdf48004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:44.058 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.056+0000 7fdf42ffd640 1 -- 172.21.15.105:0/3768224987 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fdf440634c0 con 0x7fdf540b7cc0 2024-09-21T03:27:44.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.231+0000 7fdf58b0b640 1 -- 172.21.15.105:0/3768224987 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fdf54050f60 con 0x7fdf34078bc0 2024-09-21T03:27:44.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.232+0000 7fdf42ffd640 1 -- 172.21.15.105:0/3768224987 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fdf54050f60 con 0x7fdf34078bc0 2024-09-21T03:27:44.234 INFO:teuthology.orchestra.run.smithi105.stderr:instructed osd(s) 6 to deep-scrub 2024-09-21T03:27:44.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.234+0000 7fdf58b0b640 1 -- 172.21.15.105:0/3768224987 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdf34078bc0 msgr2=0x7fdf3407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:44.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.234+0000 7fdf58b0b640 1 --2- 172.21.15.105:0/3768224987 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdf34078bc0 0x7fdf3407b0d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fdf48033000 tx=0x7fdf48004730 comp rx=0 tx=0).stop 2024-09-21T03:27:44.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.234+0000 7fdf58b0b640 1 -- 172.21.15.105:0/3768224987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf540b7cc0 msgr2=0x7fdf5414d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:44.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.234+0000 7fdf58b0b640 1 --2- 172.21.15.105:0/3768224987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf540b7cc0 0x7fdf5414d700 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fdf4400e7c0 tx=0x7fdf4400ec80 comp rx=0 tx=0).stop 2024-09-21T03:27:44.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.234+0000 7fdf58b0b640 1 -- 172.21.15.105:0/3768224987 shutdown_connections 2024-09-21T03:27:44.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.234+0000 7fdf58b0b640 1 --2- 172.21.15.105:0/3768224987 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fdf34078bc0 0x7fdf3407b0d0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:44.236 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.234+0000 7fdf58b0b640 1 --2- 172.21.15.105:0/3768224987 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf541600b0 0x7fdf540cb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:44.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.234+0000 7fdf58b0b640 1 --2- 172.21.15.105:0/3768224987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf540cf150 0x7fdf540b7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:44.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.234+0000 7fdf58b0b640 1 --2- 172.21.15.105:0/3768224987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf540b7cc0 0x7fdf5414d700 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:44.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.234+0000 7fdf58b0b640 1 -- 172.21.15.105:0/3768224987 >> 172.21.15.105:0/3768224987 conn(0x7fdf5406d4f0 msgr2=0x7fdf5415a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:44.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.234+0000 7fdf58b0b640 1 -- 172.21.15.105:0/3768224987 shutdown_connections 2024-09-21T03:27:44.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.234+0000 7fdf58b0b640 1 -- 172.21.15.105:0/3768224987 wait complete. 2024-09-21T03:27:44.247 INFO:tasks.ceph:Scrubbing osd.7 2024-09-21T03:27:44.247 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-21T03:27:44.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.361+0000 7fa02c577640 1 -- 172.21.15.105:0/1894952646 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa02415b660 msgr2=0x7fa02415f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:44.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.361+0000 7fa02c577640 1 --2- 172.21.15.105:0/1894952646 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa02415b660 0x7fa02415f5d0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7fa0240728c0 tx=0x7fa01402a560 comp rx=0 tx=0).stop 2024-09-21T03:27:44.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.361+0000 7fa02c577640 1 -- 172.21.15.105:0/1894952646 shutdown_connections 2024-09-21T03:27:44.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.361+0000 7fa02c577640 1 --2- 172.21.15.105:0/1894952646 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa02415b660 0x7fa02415f5d0 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:44.363 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.361+0000 7fa02c577640 1 --2- 172.21.15.105:0/1894952646 >> v2:172.21.15.162:3300/0 conn(0x7fa02406f1d0 0x7fa02415f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:44.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.361+0000 7fa02c577640 1 -- 172.21.15.105:0/1894952646 >> 172.21.15.105:0/1894952646 conn(0x7fa0240d0130 msgr2=0x7fa0240d0540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:44.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.361+0000 7fa02c577640 1 -- 172.21.15.105:0/1894952646 shutdown_connections 2024-09-21T03:27:44.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.361+0000 7fa02c577640 1 -- 172.21.15.105:0/1894952646 wait complete. 2024-09-21T03:27:44.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.363+0000 7fa02c577640 1 Processor -- start 2024-09-21T03:27:44.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.363+0000 7fa02c577640 1 -- start start 2024-09-21T03:27:44.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.364+0000 7fa02c577640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa02406f1d0 0x7fa02414eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:44.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.364+0000 7fa02c577640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0240ca780 0x7fa0241f0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:44.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.364+0000 7fa02c577640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa02415b660 0x7fa0241f6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:44.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.364+0000 7fa02c577640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa02406edb0 con 0x7fa02415b660 2024-09-21T03:27:44.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.364+0000 7fa02c577640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa0240af270 con 0x7fa0240ca780 2024-09-21T03:27:44.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.364+0000 7fa02c577640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa02406ef30 con 0x7fa02406f1d0 2024-09-21T03:27:44.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.364+0000 7fa02ab14640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa02415b660 0x7fa0241f6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:44.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.364+0000 7fa02ab14640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa02415b660 0x7fa0241f6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:49862/0 (socket says 172.21.15.105:49862) 2024-09-21T03:27:44.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.364+0000 7fa02ab14640 1 -- 172.21.15.105:0/721390197 learned_addr learned my addr 172.21.15.105:0/721390197 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:44.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.364+0000 7fa029b12640 1 --2- 172.21.15.105:0/721390197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0240ca780 0x7fa0241f0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:44.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.364+0000 7fa02a313640 1 --2- 172.21.15.105:0/721390197 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa02406f1d0 0x7fa02414eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:44.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.365+0000 7fa02ab14640 1 -- 172.21.15.105:0/721390197 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa02406f1d0 msgr2=0x7fa02414eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:44.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.365+0000 7fa02ab14640 1 --2- 172.21.15.105:0/721390197 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa02406f1d0 0x7fa02414eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:44.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.365+0000 7fa02ab14640 1 -- 172.21.15.105:0/721390197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0240ca780 msgr2=0x7fa0241f0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:44.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.365+0000 7fa02ab14640 1 --2- 172.21.15.105:0/721390197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0240ca780 0x7fa0241f0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:44.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.365+0000 7fa02ab14640 1 -- 172.21.15.105:0/721390197 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa02414f080 con 0x7fa02415b660 2024-09-21T03:27:44.368 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.365+0000 7fa02ab14640 1 --2- 172.21.15.105:0/721390197 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa02415b660 0x7fa0241f6700 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7fa01c002230 tx=0x7fa01c00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:44.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.365+0000 7fa01affd640 1 -- 172.21.15.105:0/721390197 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa01c003b70 con 0x7fa02415b660 2024-09-21T03:27:44.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.365+0000 7fa01affd640 1 -- 172.21.15.105:0/721390197 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa01c003d10 con 0x7fa02415b660 2024-09-21T03:27:44.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.365+0000 7fa02c577640 1 -- 172.21.15.105:0/721390197 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0240c9660 con 0x7fa02415b660 2024-09-21T03:27:44.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.365+0000 7fa01affd640 1 -- 172.21.15.105:0/721390197 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa01c005330 con 0x7fa02415b660 2024-09-21T03:27:44.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.365+0000 7fa02c577640 1 -- 172.21.15.105:0/721390197 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0240c9c20 con 0x7fa02415b660 2024-09-21T03:27:44.369 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.366+0000 7fa02c577640 1 -- 172.21.15.105:0/721390197 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa0240ca2e0 con 0x7fa02415b660 2024-09-21T03:27:44.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.367+0000 7fa01affd640 1 -- 172.21.15.105:0/721390197 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa01c0056e0 con 0x7fa02415b660 2024-09-21T03:27:44.370 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.367+0000 7fa01affd640 1 --2- 172.21.15.105:0/721390197 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa008078b90 0x7fa00807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:44.371 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.368+0000 7fa01affd640 1 -- 172.21.15.105:0/721390197 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 4943+0+0 (secure 0 0 0) 0x7fa01c09b370 con 0x7fa02415b660 2024-09-21T03:27:44.371 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.368+0000 7fa01affd640 1 --2- 172.21.15.105:0/721390197 >> [v2:172.21.15.162:6826/3787313702,v1:172.21.15.162:6827/3787313702] conn(0x7fa00807eaa0 0x7fa008080ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:44.371 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.368+0000 7fa01affd640 1 -- 172.21.15.105:0/721390197 --> [v2:172.21.15.162:6826/3787313702,v1:172.21.15.162:6827/3787313702] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa01c019e80 con 0x7fa00807eaa0 2024-09-21T03:27:44.371 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.368+0000 7fa01affd640 1 -- 172.21.15.105:0/721390197 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=143) ==== 24+0+0 (secure 0 0 0) 0x7fa01c09b800 con 0x7fa02415b660 2024-09-21T03:27:44.371 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.368+0000 7fa02a313640 1 --2- 172.21.15.105:0/721390197 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa008078b90 0x7fa00807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:44.371 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.368+0000 7fa029b12640 1 --2- 172.21.15.105:0/721390197 >> [v2:172.21.15.162:6826/3787313702,v1:172.21.15.162:6827/3787313702] conn(0x7fa00807eaa0 0x7fa008080ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:44.371 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.368+0000 7fa02a313640 1 --2- 172.21.15.105:0/721390197 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa008078b90 0x7fa00807b0a0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fa020009b30 tx=0x7fa020005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:44.371 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.368+0000 7fa029b12640 1 --2- 172.21.15.105:0/721390197 >> [v2:172.21.15.162:6826/3787313702,v1:172.21.15.162:6827/3787313702] conn(0x7fa00807eaa0 0x7fa008080ef0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:44.371 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.369+0000 7fa01affd640 1 -- 172.21.15.105:0/721390197 <== osd.7 v2:172.21.15.162:6826/3787313702 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa01c019e80 con 0x7fa00807eaa0 2024-09-21T03:27:44.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.382+0000 7fa02c577640 1 -- 172.21.15.105:0/721390197 --> [v2:172.21.15.162:6826/3787313702,v1:172.21.15.162:6827/3787313702] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa0240cb540 con 0x7fa00807eaa0 2024-09-21T03:27:44.383 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.382+0000 7fa01affd640 1 -- 172.21.15.105:0/721390197 <== osd.7 v2:172.21.15.162:6826/3787313702 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa0240cb540 con 0x7fa00807eaa0 2024-09-21T03:27:44.384 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2024-09-21T03:27:44.384 INFO:teuthology.orchestra.run.smithi105.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T03:27:44.384 INFO:teuthology.orchestra.run.smithi105.stdout:} 2024-09-21T03:27:44.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.382+0000 7fa02c577640 1 -- 172.21.15.105:0/721390197 >> [v2:172.21.15.162:6826/3787313702,v1:172.21.15.162:6827/3787313702] conn(0x7fa00807eaa0 msgr2=0x7fa008080ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:44.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.382+0000 7fa02c577640 1 --2- 172.21.15.105:0/721390197 >> [v2:172.21.15.162:6826/3787313702,v1:172.21.15.162:6827/3787313702] conn(0x7fa00807eaa0 0x7fa008080ef0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:44.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.382+0000 7fa02c577640 1 -- 172.21.15.105:0/721390197 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa008078b90 msgr2=0x7fa00807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:44.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.382+0000 7fa02c577640 1 --2- 172.21.15.105:0/721390197 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa008078b90 0x7fa00807b0a0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fa020009b30 tx=0x7fa020005f90 comp rx=0 tx=0).stop 2024-09-21T03:27:44.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.382+0000 7fa02c577640 1 -- 172.21.15.105:0/721390197 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa02415b660 msgr2=0x7fa0241f6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:44.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.382+0000 7fa02c577640 1 --2- 172.21.15.105:0/721390197 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa02415b660 0x7fa0241f6700 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7fa01c002230 tx=0x7fa01c00cb90 comp rx=0 tx=0).stop 2024-09-21T03:27:44.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.382+0000 7fa02ab14640 1 -- 172.21.15.105:0/721390197 reap_dead start 2024-09-21T03:27:44.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.382+0000 7fa02c577640 1 -- 172.21.15.105:0/721390197 shutdown_connections 2024-09-21T03:27:44.386 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.382+0000 7fa02c577640 1 -- 172.21.15.105:0/721390197 >> 172.21.15.105:0/721390197 conn(0x7fa0240d0130 msgr2=0x7fa0240cab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:44.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.382+0000 7fa02c577640 1 -- 172.21.15.105:0/721390197 shutdown_connections 2024-09-21T03:27:44.387 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.383+0000 7fa02c577640 1 -- 172.21.15.105:0/721390197 wait complete. 2024-09-21T03:27:44.395 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-21T03:27:44.507 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.506+0000 7f53ed2d5640 1 -- 172.21.15.105:0/2330855529 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53e806e170 msgr2=0x7f53e80b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:44.508 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.506+0000 7f53ed2d5640 1 --2- 172.21.15.105:0/2330855529 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53e806e170 0x7f53e80b3540 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f53d8009900 tx=0x7f53d802a580 comp rx=0 tx=0).stop 2024-09-21T03:27:44.508 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.506+0000 7f53ed2d5640 1 -- 172.21.15.105:0/2330855529 shutdown_connections 2024-09-21T03:27:44.508 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.506+0000 7f53ed2d5640 1 --2- 172.21.15.105:0/2330855529 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f53e806f4b0 0x7f53e80d3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:44.508 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.506+0000 7f53ed2d5640 1 --2- 172.21.15.105:0/2330855529 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53e806e170 0x7f53e80b3540 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:44.508 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.506+0000 7f53ed2d5640 1 -- 172.21.15.105:0/2330855529 >> 172.21.15.105:0/2330855529 conn(0x7f53e808bfc0 msgr2=0x7f53e809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:44.508 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.506+0000 7f53ed2d5640 1 -- 172.21.15.105:0/2330855529 shutdown_connections 2024-09-21T03:27:44.508 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.506+0000 7f53ed2d5640 1 -- 172.21.15.105:0/2330855529 wait complete. 2024-09-21T03:27:44.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.508+0000 7f53ed2d5640 1 Processor -- start 2024-09-21T03:27:44.509 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.508+0000 7f53ed2d5640 1 -- start start 2024-09-21T03:27:44.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.509+0000 7f53ed2d5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f53e806f4b0 0x7f53e81f5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:44.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.509+0000 7f53ed2d5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53e80d3870 0x7f53e80cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:44.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.509+0000 7f53ed2d5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53e81f8a50 0x7f53e815e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:44.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.509+0000 7f53ed2d5640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f53e80d0e60 con 0x7f53e80d3870 2024-09-21T03:27:44.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.509+0000 7f53ed2d5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f53e80d0ce0 con 0x7f53e81f8a50 2024-09-21T03:27:44.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.509+0000 7f53ed2d5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f53e80d0fe0 con 0x7f53e806f4b0 2024-09-21T03:27:44.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.509+0000 7f53e67fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53e80d3870 0x7f53e80cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:44.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.509+0000 7f53e67fc640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53e80d3870 0x7f53e80cb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:49872/0 (socket says 172.21.15.105:49872) 2024-09-21T03:27:44.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.509+0000 7f53e67fc640 1 -- 172.21.15.105:0/3534843523 learned_addr learned my addr 172.21.15.105:0/3534843523 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:44.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.509+0000 7f53e6ffd640 1 --2- 172.21.15.105:0/3534843523 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f53e806f4b0 0x7f53e81f5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:44.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.509+0000 7f53e77fe640 1 --2- 172.21.15.105:0/3534843523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53e81f8a50 0x7f53e815e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:44.512 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.509+0000 7f53e67fc640 1 -- 172.21.15.105:0/3534843523 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f53e806f4b0 msgr2=0x7f53e81f5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:44.513 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.509+0000 7f53e67fc640 1 --2- 172.21.15.105:0/3534843523 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f53e806f4b0 0x7f53e81f5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:44.513 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.509+0000 7f53e67fc640 1 -- 172.21.15.105:0/3534843523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53e81f8a50 msgr2=0x7f53e815e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:44.513 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.509+0000 7f53e67fc640 1 --2- 172.21.15.105:0/3534843523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53e81f8a50 0x7f53e815e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:44.513 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.509+0000 7f53e67fc640 1 -- 172.21.15.105:0/3534843523 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53e80c9240 con 0x7f53e80d3870 2024-09-21T03:27:44.513 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.509+0000 7f53e77fe640 1 --2- 172.21.15.105:0/3534843523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53e81f8a50 0x7f53e815e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:27:44.513 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.510+0000 7f53e67fc640 1 --2- 172.21.15.105:0/3534843523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53e80d3870 0x7f53e80cb5c0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f53dc00e790 tx=0x7f53dc00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:44.513 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.510+0000 7f53cf7fe640 1 -- 172.21.15.105:0/3534843523 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53dc00cac0 con 0x7f53e80d3870 2024-09-21T03:27:44.513 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.510+0000 7f53cf7fe640 1 -- 172.21.15.105:0/3534843523 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f53dc00cc60 con 0x7f53e80d3870 2024-09-21T03:27:44.513 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.510+0000 7f53ed2d5640 1 -- 172.21.15.105:0/3534843523 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53e81f9230 con 0x7f53e80d3870 2024-09-21T03:27:44.513 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.510+0000 7f53cf7fe640 1 -- 172.21.15.105:0/3534843523 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53dc004280 con 0x7f53e80d3870 2024-09-21T03:27:44.513 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.510+0000 7f53ed2d5640 1 -- 172.21.15.105:0/3534843523 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53e81f97f0 con 0x7f53e80d3870 2024-09-21T03:27:44.514 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.511+0000 7f53ed2d5640 1 -- 172.21.15.105:0/3534843523 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53e81f8fa0 con 0x7f53e80d3870 2024-09-21T03:27:44.514 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.512+0000 7f53cf7fe640 1 -- 172.21.15.105:0/3534843523 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f53dc0035f0 con 0x7f53e80d3870 2024-09-21T03:27:44.514 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.512+0000 7f53cf7fe640 1 --2- 172.21.15.105:0/3534843523 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f53d4078b90 0x7f53d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:44.514 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.513+0000 7f53cf7fe640 1 -- 172.21.15.105:0/3534843523 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 4943+0+0 (secure 0 0 0) 0x7f53dc09b240 con 0x7f53e80d3870 2024-09-21T03:27:44.514 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.513+0000 7f53e6ffd640 1 --2- 172.21.15.105:0/3534843523 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f53d4078b90 0x7f53d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:44.515 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.513+0000 7f53e6ffd640 1 --2- 172.21.15.105:0/3534843523 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f53d4078b90 0x7f53d407b0a0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f53d8033000 tx=0x7f53d8004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:44.518 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.517+0000 7f53cf7fe640 1 -- 172.21.15.105:0/3534843523 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f53dc063a10 con 0x7f53e80d3870 2024-09-21T03:27:44.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.693+0000 7f53ed2d5640 1 -- 172.21.15.105:0/3534843523 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f53e80cbb00 con 0x7f53d4078b90 2024-09-21T03:27:44.695 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.694+0000 7f53cf7fe640 1 -- 172.21.15.105:0/3534843523 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f53e80cbb00 con 0x7f53d4078b90 2024-09-21T03:27:44.696 INFO:teuthology.orchestra.run.smithi105.stderr:instructed osd(s) 7 to deep-scrub 2024-09-21T03:27:44.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.696+0000 7f53ed2d5640 1 -- 172.21.15.105:0/3534843523 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f53d4078b90 msgr2=0x7f53d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:44.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.696+0000 7f53ed2d5640 1 --2- 172.21.15.105:0/3534843523 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f53d4078b90 0x7f53d407b0a0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f53d8033000 tx=0x7f53d8004730 comp rx=0 tx=0).stop 2024-09-21T03:27:44.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.696+0000 7f53ed2d5640 1 -- 172.21.15.105:0/3534843523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53e80d3870 msgr2=0x7f53e80cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:44.698 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.696+0000 7f53ed2d5640 1 --2- 172.21.15.105:0/3534843523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53e80d3870 0x7f53e80cb5c0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f53dc00e790 tx=0x7f53dc00ec50 comp rx=0 tx=0).stop 2024-09-21T03:27:44.699 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.696+0000 7f53ed2d5640 1 -- 172.21.15.105:0/3534843523 shutdown_connections 2024-09-21T03:27:44.699 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.696+0000 7f53ed2d5640 1 --2- 172.21.15.105:0/3534843523 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f53d4078b90 0x7f53d407b0a0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:44.699 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.696+0000 7f53ed2d5640 1 --2- 172.21.15.105:0/3534843523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53e81f8a50 0x7f53e815e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:44.699 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.696+0000 7f53ed2d5640 1 --2- 172.21.15.105:0/3534843523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53e80d3870 0x7f53e80cb5c0 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:44.699 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.696+0000 7f53ed2d5640 1 --2- 172.21.15.105:0/3534843523 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f53e806f4b0 0x7f53e81f5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:44.699 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.696+0000 7f53ed2d5640 1 -- 172.21.15.105:0/3534843523 >> 172.21.15.105:0/3534843523 conn(0x7f53e808bfc0 msgr2=0x7f53e80b2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:44.699 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.696+0000 7f53ed2d5640 1 -- 172.21.15.105:0/3534843523 shutdown_connections 2024-09-21T03:27:44.699 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.696+0000 7f53ed2d5640 1 -- 172.21.15.105:0/3534843523 wait complete. 2024-09-21T03:27:44.709 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:27:44.820 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.819+0000 7f7bbb42e640 1 -- 172.21.15.105:0/1761788571 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bb40701b0 msgr2=0x7f7bb415c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:44.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.819+0000 7f7bbb42e640 1 --2- 172.21.15.105:0/1761788571 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bb40701b0 0x7f7bb415c570 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f7bb40cf590 tx=0x7f7bb002a560 comp rx=0 tx=0).stop 2024-09-21T03:27:44.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.819+0000 7f7bbb42e640 1 -- 172.21.15.105:0/1761788571 shutdown_connections 2024-09-21T03:27:44.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.819+0000 7f7bbb42e640 1 --2- 172.21.15.105:0/1761788571 >> v2:172.21.15.162:3300/0 conn(0x7f7bb415f9f0 0x7f7bb4073f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:44.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.819+0000 7f7bbb42e640 1 --2- 172.21.15.105:0/1761788571 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bb40701b0 0x7f7bb415c570 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:44.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.819+0000 7f7bbb42e640 1 -- 172.21.15.105:0/1761788571 >> 172.21.15.105:0/1761788571 conn(0x7f7bb40cdcb0 msgr2=0x7f7bb40ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:44.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.819+0000 7f7bbb42e640 1 -- 172.21.15.105:0/1761788571 shutdown_connections 2024-09-21T03:27:44.821 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.819+0000 7f7bbb42e640 1 -- 172.21.15.105:0/1761788571 wait complete. 2024-09-21T03:27:44.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.820+0000 7f7bbb42e640 1 Processor -- start 2024-09-21T03:27:44.822 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.821+0000 7f7bbb42e640 1 -- start start 2024-09-21T03:27:44.824 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.822+0000 7f7bbb42e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bb406cde0 0x7f7bb40b1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:44.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.822+0000 7f7bbb42e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bb40701b0 0x7f7bb414d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:44.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.822+0000 7f7bbb42e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7bb415f9f0 0x7f7bb414e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:44.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.822+0000 7f7bbb42e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb40b3350 con 0x7f7bb40701b0 2024-09-21T03:27:44.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.822+0000 7f7bbb42e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb40b31d0 con 0x7f7bb406cde0 2024-09-21T03:27:44.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.822+0000 7f7bbb42e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7bb40b34d0 con 0x7f7bb415f9f0 2024-09-21T03:27:44.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.822+0000 7f7bb89c9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bb40701b0 0x7f7bb414d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:44.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.822+0000 7f7bb89c9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bb40701b0 0x7f7bb414d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:49876/0 (socket says 172.21.15.105:49876) 2024-09-21T03:27:44.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.822+0000 7f7bb89c9640 1 -- 172.21.15.105:0/1113091531 learned_addr learned my addr 172.21.15.105:0/1113091531 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:27:44.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.822+0000 7f7bb91ca640 1 --2- 172.21.15.105:0/1113091531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bb406cde0 0x7f7bb40b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:44.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.822+0000 7f7bb99cb640 1 --2- 172.21.15.105:0/1113091531 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7bb415f9f0 0x7f7bb414e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:44.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.822+0000 7f7bb89c9640 1 -- 172.21.15.105:0/1113091531 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7bb415f9f0 msgr2=0x7f7bb414e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:44.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.822+0000 7f7bb89c9640 1 --2- 172.21.15.105:0/1113091531 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7bb415f9f0 0x7f7bb414e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:44.825 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.822+0000 7f7bb89c9640 1 -- 172.21.15.105:0/1113091531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bb406cde0 msgr2=0x7f7bb40b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:44.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.822+0000 7f7bb89c9640 1 --2- 172.21.15.105:0/1113091531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bb406cde0 0x7f7bb40b1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:44.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.822+0000 7f7bb89c9640 1 -- 172.21.15.105:0/1113091531 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bb40b1a90 con 0x7f7bb40701b0 2024-09-21T03:27:44.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.822+0000 7f7bb89c9640 1 --2- 172.21.15.105:0/1113091531 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bb40701b0 0x7f7bb414d880 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f7ba400b410 tx=0x7f7ba400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:44.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.823+0000 7f7ba9ffb640 1 -- 172.21.15.105:0/1113091531 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba4015020 con 0x7f7bb40701b0 2024-09-21T03:27:44.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.823+0000 7f7ba9ffb640 1 -- 172.21.15.105:0/1113091531 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ba4011940 con 0x7f7bb40701b0 2024-09-21T03:27:44.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.823+0000 7f7bbb42e640 1 -- 172.21.15.105:0/1113091531 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bb414ddc0 con 0x7f7bb40701b0 2024-09-21T03:27:44.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.823+0000 7f7ba9ffb640 1 -- 172.21.15.105:0/1113091531 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba4011d90 con 0x7f7bb40701b0 2024-09-21T03:27:44.826 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.823+0000 7f7bbb42e640 1 -- 172.21.15.105:0/1113091531 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bb40b0790 con 0x7f7bb40701b0 2024-09-21T03:27:44.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.824+0000 7f7bbb42e640 1 -- 172.21.15.105:0/1113091531 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bb40b3a00 con 0x7f7bb40701b0 2024-09-21T03:27:44.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.825+0000 7f7ba9ffb640 1 -- 172.21.15.105:0/1113091531 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7ba4018020 con 0x7f7bb40701b0 2024-09-21T03:27:44.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.825+0000 7f7ba9ffb640 1 --2- 172.21.15.105:0/1113091531 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7b98078b90 0x7f7b9807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:44.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.825+0000 7f7ba9ffb640 1 -- 172.21.15.105:0/1113091531 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 4943+0+0 (secure 0 0 0) 0x7f7ba409a7b0 con 0x7f7bb40701b0 2024-09-21T03:27:44.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.825+0000 7f7bb91ca640 1 --2- 172.21.15.105:0/1113091531 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7b98078b90 0x7f7b9807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:44.827 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.826+0000 7f7bb91ca640 1 --2- 172.21.15.105:0/1113091531 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7b98078b90 0x7f7b9807b0a0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0033000 tx=0x7f7bb0004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:44.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:44.830+0000 7f7ba9ffb640 1 -- 172.21.15.105:0/1113091531 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7ba401f020 con 0x7f7bb40701b0 2024-09-21T03:27:45.008 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:45.007+0000 7f7bbb42e640 1 -- 172.21.15.105:0/1113091531 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7bb415c070 con 0x7f7b98078b90 2024-09-21T03:27:45.009 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:45.008+0000 7f7ba9ffb640 1 -- 172.21.15.105:0/1113091531 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13482 (secure 0 0 0) 0x7f7bb0005310 con 0x7f7b98078b90 2024-09-21T03:27:45.009 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:27:45.010 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:27:45.012 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:45.010+0000 7f7bbb42e640 1 -- 172.21.15.105:0/1113091531 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7b98078b90 msgr2=0x7f7b9807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:45.012 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:45.010+0000 7f7bbb42e640 1 --2- 172.21.15.105:0/1113091531 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7b98078b90 0x7f7b9807b0a0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0033000 tx=0x7f7bb0004730 comp rx=0 tx=0).stop 2024-09-21T03:27:45.012 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:45.010+0000 7f7bbb42e640 1 -- 172.21.15.105:0/1113091531 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bb40701b0 msgr2=0x7f7bb414d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:45.012 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:45.010+0000 7f7bbb42e640 1 --2- 172.21.15.105:0/1113091531 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bb40701b0 0x7f7bb414d880 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f7ba400b410 tx=0x7f7ba400b8d0 comp rx=0 tx=0).stop 2024-09-21T03:27:45.012 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:45.010+0000 7f7bbb42e640 1 -- 172.21.15.105:0/1113091531 shutdown_connections 2024-09-21T03:27:45.012 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:45.010+0000 7f7bbb42e640 1 --2- 172.21.15.105:0/1113091531 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f7b98078b90 0x7f7b9807b0a0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:45.012 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:45.010+0000 7f7bbb42e640 1 --2- 172.21.15.105:0/1113091531 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7bb415f9f0 0x7f7bb414e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:45.012 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:45.010+0000 7f7bbb42e640 1 --2- 172.21.15.105:0/1113091531 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bb40701b0 0x7f7bb414d880 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:45.013 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:45.010+0000 7f7bbb42e640 1 --2- 172.21.15.105:0/1113091531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bb406cde0 0x7f7bb40b1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:45.013 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:45.010+0000 7f7bbb42e640 1 -- 172.21.15.105:0/1113091531 >> 172.21.15.105:0/1113091531 conn(0x7f7bb40cdcb0 msgr2=0x7f7bb4160180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:45.013 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:45.010+0000 7f7bbb42e640 1 -- 172.21.15.105:0/1113091531 shutdown_connections 2024-09-21T03:27:45.013 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:27:45.010+0000 7f7bbb42e640 1 -- 172.21.15.105:0/1113091531 wait complete. 2024-09-21T03:27:45.023 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":420,"stamp":"2024-09-21T03:27:43.428233+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":273012,"kb_used_data":15176,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754701708,"statfs":{"total":773094113280,"available":772814548992,"internally_reserved":0,"allocated":15540224,"data_stored":7338446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4191,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-49,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001798"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":338,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-21T03:27:35.829030+0000","last_change":"2024-09-21T03:18:21.432648+0000","last_active":"2024-09-21T03:27:35.829030+0000","last_peered":"2024-09-21T03:27:35.829030+0000","last_clean":"2024-09-21T03:27:35.829030+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:27:35.829030+0000","last_undegraded":"2024-09-21T03:27:35.829030+0000","last_fullsized":"2024-09-21T03:27:35.829030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:18:20.272368+0000","last_clean_scrub_stamp":"2024-09-21T03:18:20.272368+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:39:45.512098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509557,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33508,"kb_used_data":2320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338332,"statfs":{"total":96636764160,"available":96602451968,"internally_reserved":0,"allocated":2375680,"data_stored":1355908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509556,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32948,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338892,"statfs":{"total":96636764160,"available":96603025408,"internally_reserved":0,"allocated":1798144,"data_stored":771105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509555,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32948,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338892,"statfs":{"total":96636764160,"available":96603025408,"internally_reserved":0,"allocated":1798144,"data_stored":771105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509555,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32944,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338896,"statfs":{"total":96636764160,"available":96603029504,"internally_reserved":0,"allocated":1798144,"data_stored":771105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509556,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32944,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338896,"statfs":{"total":96636764160,"available":96603029504,"internally_reserved":0,"allocated":1798144,"data_stored":771105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509556,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37088,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334752,"statfs":{"total":96636764160,"available":96598786048,"internally_reserved":0,"allocated":1781760,"data_stored":765540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509556,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37104,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334736,"statfs":{"total":96636764160,"available":96598769664,"internally_reserved":0,"allocated":1798144,"data_stored":771105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574964,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33528,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338312,"statfs":{"total":96636764160,"available":96602431488,"internally_reserved":0,"allocated":2392064,"data_stored":1361473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:27:45.025 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-21T03:18:20.272368+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=18, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=3, tm_min=27, tm_sec=39, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T03:27:45.025 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-21T03:27:57.911 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:27:57.914 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:28:05.027 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:28:05.153 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.152+0000 7fa5b9d82640 1 -- 172.21.15.105:0/2711875786 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5b40cb0b0 msgr2=0x7fa5b406ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:28:05.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.152+0000 7fa5b9d82640 1 --2- 172.21.15.105:0/2711875786 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5b40cb0b0 0x7fa5b406ee90 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac005fd0 tx=0x7fa5ac02bb10 comp rx=0 tx=0).stop 2024-09-21T03:28:05.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.152+0000 7fa5b9d82640 1 -- 172.21.15.105:0/2711875786 shutdown_connections 2024-09-21T03:28:05.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.152+0000 7fa5b9d82640 1 --2- 172.21.15.105:0/2711875786 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5b40cb0b0 0x7fa5b406ee90 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:05.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.152+0000 7fa5b9d82640 1 --2- 172.21.15.105:0/2711875786 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa5b40cfb00 0x7fa5b415bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:05.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.152+0000 7fa5b9d82640 1 -- 172.21.15.105:0/2711875786 >> 172.21.15.105:0/2711875786 conn(0x7fa5b40b1cb0 msgr2=0x7fa5b40b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:28:05.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.152+0000 7fa5b9d82640 1 -- 172.21.15.105:0/2711875786 shutdown_connections 2024-09-21T03:28:05.154 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.152+0000 7fa5b9d82640 1 -- 172.21.15.105:0/2711875786 wait complete. 2024-09-21T03:28:05.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.153+0000 7fa5b9d82640 1 Processor -- start 2024-09-21T03:28:05.155 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.154+0000 7fa5b9d82640 1 -- start start 2024-09-21T03:28:05.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.155+0000 7fa5b9d82640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5b40cf160 0x7fa5b415f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:28:05.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.155+0000 7fa5b9d82640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa5b40cfb00 0x7fa5b415ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:28:05.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.155+0000 7fa5b9d82640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5b41e5f10 0x7fa5b41e6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:28:05.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.155+0000 7fa5b9d82640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b40ccba0 con 0x7fa5b41e5f10 2024-09-21T03:28:05.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.155+0000 7fa5b9d82640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b40cf780 con 0x7fa5b40cf160 2024-09-21T03:28:05.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.155+0000 7fa5b9d82640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa5b40ccd20 con 0x7fa5b40cfb00 2024-09-21T03:28:05.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.155+0000 7fa5b3fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5b41e5f10 0x7fa5b41e6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:28:05.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.155+0000 7fa5b3fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5b41e5f10 0x7fa5b41e6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:45886/0 (socket says 172.21.15.105:45886) 2024-09-21T03:28:05.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.155+0000 7fa5b3fff640 1 -- 172.21.15.105:0/1646310395 learned_addr learned my addr 172.21.15.105:0/1646310395 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:28:05.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.155+0000 7fa5b37fe640 1 --2- 172.21.15.105:0/1646310395 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5b40cf160 0x7fa5b415f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:28:05.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.155+0000 7fa5b2ffd640 1 --2- 172.21.15.105:0/1646310395 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa5b40cfb00 0x7fa5b415ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:28:05.158 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.155+0000 7fa5b3fff640 1 -- 172.21.15.105:0/1646310395 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa5b40cfb00 msgr2=0x7fa5b415ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:28:05.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.155+0000 7fa5b3fff640 1 --2- 172.21.15.105:0/1646310395 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa5b40cfb00 0x7fa5b415ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:05.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.155+0000 7fa5b3fff640 1 -- 172.21.15.105:0/1646310395 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5b40cf160 msgr2=0x7fa5b415f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:28:05.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.155+0000 7fa5b3fff640 1 --2- 172.21.15.105:0/1646310395 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5b40cf160 0x7fa5b415f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:05.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.155+0000 7fa5b3fff640 1 -- 172.21.15.105:0/1646310395 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5b40c4d10 con 0x7fa5b41e5f10 2024-09-21T03:28:05.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.156+0000 7fa5b3fff640 1 --2- 172.21.15.105:0/1646310395 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5b41e5f10 0x7fa5b41e6320 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac009bf0 tx=0x7fa5ac003c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:28:05.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.156+0000 7fa59bfff640 1 -- 172.21.15.105:0/1646310395 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac045070 con 0x7fa5b41e5f10 2024-09-21T03:28:05.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.156+0000 7fa5b9d82640 1 -- 172.21.15.105:0/1646310395 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5b41e6860 con 0x7fa5b41e5f10 2024-09-21T03:28:05.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.156+0000 7fa59bfff640 1 -- 172.21.15.105:0/1646310395 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa5ac004540 con 0x7fa5b41e5f10 2024-09-21T03:28:05.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.156+0000 7fa59bfff640 1 -- 172.21.15.105:0/1646310395 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac02e440 con 0x7fa5b41e5f10 2024-09-21T03:28:05.159 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.156+0000 7fa5b9d82640 1 -- 172.21.15.105:0/1646310395 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5b415d700 con 0x7fa5b41e5f10 2024-09-21T03:28:05.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.157+0000 7fa5b9d82640 1 -- 172.21.15.105:0/1646310395 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5b415bf20 con 0x7fa5b41e5f10 2024-09-21T03:28:05.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.158+0000 7fa59bfff640 1 -- 172.21.15.105:0/1646310395 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa5ac02e5e0 con 0x7fa5b41e5f10 2024-09-21T03:28:05.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.158+0000 7fa59bfff640 1 --2- 172.21.15.105:0/1646310395 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa5a0078b90 0x7fa5a007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:28:05.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.158+0000 7fa59bfff640 1 -- 172.21.15.105:0/1646310395 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 4943+0+0 (secure 0 0 0) 0x7fa5ac0bb680 con 0x7fa5b41e5f10 2024-09-21T03:28:05.160 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.158+0000 7fa5b37fe640 1 --2- 172.21.15.105:0/1646310395 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa5a0078b90 0x7fa5a007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:28:05.161 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.159+0000 7fa5b37fe640 1 --2- 172.21.15.105:0/1646310395 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa5a0078b90 0x7fa5a007b0a0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40058c0 tx=0x7fa5a4005d80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:28:05.164 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.163+0000 7fa59bfff640 1 -- 172.21.15.105:0/1646310395 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa5ac03d070 con 0x7fa5b41e5f10 2024-09-21T03:28:05.338 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.336+0000 7fa5b9d82640 1 -- 172.21.15.105:0/1646310395 --> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa5b4050ff0 con 0x7fa5a0078b90 2024-09-21T03:28:05.339 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.337+0000 7fa59bfff640 1 -- 172.21.15.105:0/1646310395 <== mgr.4103 v2:172.21.15.162:6800/2934911804 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13364 (secure 0 0 0) 0x7fa5b4050ff0 con 0x7fa5a0078b90 2024-09-21T03:28:05.339 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:28:05.339 INFO:teuthology.orchestra.run.smithi105.stderr:dumped all 2024-09-21T03:28:05.341 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.339+0000 7fa5b9d82640 1 -- 172.21.15.105:0/1646310395 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa5a0078b90 msgr2=0x7fa5a007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:28:05.341 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.339+0000 7fa5b9d82640 1 --2- 172.21.15.105:0/1646310395 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa5a0078b90 0x7fa5a007b0a0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40058c0 tx=0x7fa5a4005d80 comp rx=0 tx=0).stop 2024-09-21T03:28:05.341 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.339+0000 7fa5b9d82640 1 -- 172.21.15.105:0/1646310395 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5b41e5f10 msgr2=0x7fa5b41e6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:28:05.342 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.339+0000 7fa5b9d82640 1 --2- 172.21.15.105:0/1646310395 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5b41e5f10 0x7fa5b41e6320 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac009bf0 tx=0x7fa5ac003c90 comp rx=0 tx=0).stop 2024-09-21T03:28:05.342 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.339+0000 7fa5b9d82640 1 -- 172.21.15.105:0/1646310395 shutdown_connections 2024-09-21T03:28:05.342 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.339+0000 7fa5b9d82640 1 --2- 172.21.15.105:0/1646310395 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7fa5a0078b90 0x7fa5a007b0a0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:05.342 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.339+0000 7fa5b9d82640 1 --2- 172.21.15.105:0/1646310395 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5b41e5f10 0x7fa5b41e6320 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:05.342 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.339+0000 7fa5b9d82640 1 --2- 172.21.15.105:0/1646310395 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa5b40cfb00 0x7fa5b415ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:05.342 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.339+0000 7fa5b9d82640 1 --2- 172.21.15.105:0/1646310395 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5b40cf160 0x7fa5b415f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:05.342 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.340+0000 7fa5b9d82640 1 -- 172.21.15.105:0/1646310395 >> 172.21.15.105:0/1646310395 conn(0x7fa5b40b1cb0 msgr2=0x7fa5b40b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:28:05.342 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.340+0000 7fa5b9d82640 1 -- 172.21.15.105:0/1646310395 shutdown_connections 2024-09-21T03:28:05.342 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.340+0000 7fa5b9d82640 1 -- 172.21.15.105:0/1646310395 wait complete. 2024-09-21T03:28:05.352 INFO:teuthology.orchestra.run.smithi105.stdout:{"pg_ready":true,"pg_map":{"version":430,"stamp":"2024-09-21T03:28:03.432795+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":273032,"kb_used_data":15208,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754701688,"statfs":{"total":773094113280,"available":772814528512,"internally_reserved":0,"allocated":15572992,"data_stored":7349576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002546"},"pg_stats":[{"pgid":"1.0","version":"143'74","reported_seq":350,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-21T03:27:45.645348+0000","last_change":"2024-09-21T03:27:45.645348+0000","last_active":"2024-09-21T03:27:45.645348+0000","last_peered":"2024-09-21T03:27:45.645348+0000","last_clean":"2024-09-21T03:27:45.645348+0000","last_became_active":"2024-09-21T03:18:21.431635+0000","last_became_peered":"2024-09-21T03:18:21.431635+0000","last_unstale":"2024-09-21T03:27:45.645348+0000","last_undegraded":"2024-09-21T03:27:45.645348+0000","last_fullsized":"2024-09-21T03:27:45.645348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"143'74","last_scrub_stamp":"2024-09-21T03:27:45.645157+0000","last_deep_scrub":"143'74","last_deep_scrub_stamp":"2024-09-21T03:27:45.645157+0000","last_clean_scrub_stamp":"2024-09-21T03:27:45.645157+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:04.250298+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509561,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33520,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338320,"statfs":{"total":96636764160,"available":96602439680,"internally_reserved":0,"allocated":2392064,"data_stored":1361473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509560,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32948,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338892,"statfs":{"total":96636764160,"available":96603025408,"internally_reserved":0,"allocated":1798144,"data_stored":771105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509559,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32948,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338892,"statfs":{"total":96636764160,"available":96603025408,"internally_reserved":0,"allocated":1798144,"data_stored":771105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509559,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32944,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338896,"statfs":{"total":96636764160,"available":96603029504,"internally_reserved":0,"allocated":1798144,"data_stored":771105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509560,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32944,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338896,"statfs":{"total":96636764160,"available":96603029504,"internally_reserved":0,"allocated":1798144,"data_stored":771105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509560,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37104,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334736,"statfs":{"total":96636764160,"available":96598769664,"internally_reserved":0,"allocated":1798144,"data_stored":771105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509560,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37104,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334736,"statfs":{"total":96636764160,"available":96598769664,"internally_reserved":0,"allocated":1798144,"data_stored":771105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574968,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33520,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338320,"statfs":{"total":96636764160,"available":96602439680,"internally_reserved":0,"allocated":2392064,"data_stored":1361473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:28:05.353 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-21T03:28:05.467 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.465+0000 7efdfcbf1640 1 -- 172.21.15.105:0/3502206202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efdf806fec0 msgr2=0x7efdf80702d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:28:05.467 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.465+0000 7efdfcbf1640 1 --2- 172.21.15.105:0/3502206202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efdf806fec0 0x7efdf80702d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7efdec009830 tx=0x7efdec02a510 comp rx=0 tx=0).stop 2024-09-21T03:28:05.467 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.465+0000 7efdfcbf1640 1 -- 172.21.15.105:0/3502206202 shutdown_connections 2024-09-21T03:28:05.467 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.465+0000 7efdfcbf1640 1 --2- 172.21.15.105:0/3502206202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efdf806fec0 0x7efdf80702d0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:05.467 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.465+0000 7efdfcbf1640 1 --2- 172.21.15.105:0/3502206202 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efdf80b4090 0x7efdf80b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:05.468 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.465+0000 7efdfcbf1640 1 -- 172.21.15.105:0/3502206202 >> 172.21.15.105:0/3502206202 conn(0x7efdf80cdcc0 msgr2=0x7efdf80ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:28:05.468 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.465+0000 7efdfcbf1640 1 -- 172.21.15.105:0/3502206202 shutdown_connections 2024-09-21T03:28:05.468 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.465+0000 7efdfcbf1640 1 -- 172.21.15.105:0/3502206202 wait complete. 2024-09-21T03:28:05.468 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.467+0000 7efdfcbf1640 1 Processor -- start 2024-09-21T03:28:05.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.467+0000 7efdfcbf1640 1 -- start start 2024-09-21T03:28:05.471 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.468+0000 7efdfcbf1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdf806fec0 0x7efdf809b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:28:05.471 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.468+0000 7efdfcbf1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efdf80b4090 0x7efdf81e70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:28:05.471 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.468+0000 7efdfcbf1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efdf80cfeb0 0x7efdf81e7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:28:05.471 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.468+0000 7efdfcbf1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efdf80b4a30 con 0x7efdf806fec0 2024-09-21T03:28:05.472 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.468+0000 7efdfcbf1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efdf80b48b0 con 0x7efdf80b4090 2024-09-21T03:28:05.472 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.468+0000 7efdfcbf1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7efdf80b4bb0 con 0x7efdf80cfeb0 2024-09-21T03:28:05.472 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.468+0000 7efdf659c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdf806fec0 0x7efdf809b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:28:05.472 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.468+0000 7efdf659c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdf806fec0 0x7efdf809b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:45894/0 (socket says 172.21.15.105:45894) 2024-09-21T03:28:05.472 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.468+0000 7efdf659c640 1 -- 172.21.15.105:0/738723805 learned_addr learned my addr 172.21.15.105:0/738723805 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:28:05.472 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.469+0000 7efdf5d9b640 1 --2- 172.21.15.105:0/738723805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efdf80b4090 0x7efdf81e70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:28:05.472 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.469+0000 7efdf6d9d640 1 --2- 172.21.15.105:0/738723805 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efdf80cfeb0 0x7efdf81e7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:28:05.472 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.469+0000 7efdf659c640 1 -- 172.21.15.105:0/738723805 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efdf80cfeb0 msgr2=0x7efdf81e7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:28:05.472 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.469+0000 7efdf659c640 1 --2- 172.21.15.105:0/738723805 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efdf80cfeb0 0x7efdf81e7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:05.472 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.469+0000 7efdf659c640 1 -- 172.21.15.105:0/738723805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efdf80b4090 msgr2=0x7efdf81e70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:28:05.472 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.469+0000 7efdf659c640 1 --2- 172.21.15.105:0/738723805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efdf80b4090 0x7efdf81e70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:05.472 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.469+0000 7efdf659c640 1 -- 172.21.15.105:0/738723805 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdf81f5d60 con 0x7efdf806fec0 2024-09-21T03:28:05.473 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.469+0000 7efdf5d9b640 1 --2- 172.21.15.105:0/738723805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efdf80b4090 0x7efdf81e70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:28:05.473 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.469+0000 7efdf6d9d640 1 --2- 172.21.15.105:0/738723805 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efdf80cfeb0 0x7efdf81e7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:28:05.473 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.469+0000 7efdf659c640 1 --2- 172.21.15.105:0/738723805 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdf806fec0 0x7efdf809b440 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7efde800e9f0 tx=0x7efde800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:28:05.473 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.469+0000 7efde6ffd640 1 -- 172.21.15.105:0/738723805 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde800cd80 con 0x7efdf806fec0 2024-09-21T03:28:05.473 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.469+0000 7efde6ffd640 1 -- 172.21.15.105:0/738723805 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efde8004020 con 0x7efdf806fec0 2024-09-21T03:28:05.473 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.469+0000 7efdfcbf1640 1 -- 172.21.15.105:0/738723805 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdf81f6040 con 0x7efdf806fec0 2024-09-21T03:28:05.473 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.469+0000 7efde6ffd640 1 -- 172.21.15.105:0/738723805 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde8004470 con 0x7efdf806fec0 2024-09-21T03:28:05.473 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.469+0000 7efdfcbf1640 1 -- 172.21.15.105:0/738723805 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdf81f6600 con 0x7efdf806fec0 2024-09-21T03:28:05.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.470+0000 7efdfcbf1640 1 -- 172.21.15.105:0/738723805 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdf80b5060 con 0x7efdf806fec0 2024-09-21T03:28:05.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.471+0000 7efde6ffd640 1 -- 172.21.15.105:0/738723805 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efde80035f0 con 0x7efdf806fec0 2024-09-21T03:28:05.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.472+0000 7efde6ffd640 1 --2- 172.21.15.105:0/738723805 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efdd8078b90 0x7efdd807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:28:05.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.472+0000 7efde6ffd640 1 -- 172.21.15.105:0/738723805 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 4943+0+0 (secure 0 0 0) 0x7efde809b510 con 0x7efdf806fec0 2024-09-21T03:28:05.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.472+0000 7efdf5d9b640 1 --2- 172.21.15.105:0/738723805 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efdd8078b90 0x7efdd807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:28:05.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.473+0000 7efdf5d9b640 1 --2- 172.21.15.105:0/738723805 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efdd8078b90 0x7efdd807b0a0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7efdec034000 tx=0x7efdec004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:28:05.478 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.476+0000 7efde6ffd640 1 -- 172.21.15.105:0/738723805 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7efde8063ce0 con 0x7efdf806fec0 2024-09-21T03:28:05.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.653+0000 7efdfcbf1640 1 -- 172.21.15.105:0/738723805 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7efdf81f34b0 con 0x7efdf806fec0 2024-09-21T03:28:05.659 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.657+0000 7efde6ffd640 1 -- 172.21.15.105:0/738723805 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v71)=0 v71) ==== 123+0+0 (secure 0 0 0) 0x7efde80635e0 con 0x7efdf806fec0 2024-09-21T03:28:05.660 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.659+0000 7efde6ffd640 1 -- 172.21.15.105:0/738723805 <== mon.0 v2:172.21.15.105:3300/0 8 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7efde80630f0 con 0x7efdf806fec0 2024-09-21T03:28:05.662 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.660+0000 7efdfcbf1640 1 -- 172.21.15.105:0/738723805 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efdd8078b90 msgr2=0x7efdd807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:28:05.662 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.660+0000 7efdfcbf1640 1 --2- 172.21.15.105:0/738723805 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efdd8078b90 0x7efdd807b0a0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7efdec034000 tx=0x7efdec004730 comp rx=0 tx=0).stop 2024-09-21T03:28:05.662 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.660+0000 7efdfcbf1640 1 -- 172.21.15.105:0/738723805 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdf806fec0 msgr2=0x7efdf809b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:28:05.662 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.660+0000 7efdfcbf1640 1 --2- 172.21.15.105:0/738723805 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdf806fec0 0x7efdf809b440 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7efde800e9f0 tx=0x7efde800eeb0 comp rx=0 tx=0).stop 2024-09-21T03:28:05.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.660+0000 7efdfcbf1640 1 -- 172.21.15.105:0/738723805 shutdown_connections 2024-09-21T03:28:05.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.660+0000 7efdfcbf1640 1 --2- 172.21.15.105:0/738723805 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7efdd8078b90 0x7efdd807b0a0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:05.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.660+0000 7efdfcbf1640 1 --2- 172.21.15.105:0/738723805 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efdf80cfeb0 0x7efdf81e7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:05.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.660+0000 7efdfcbf1640 1 --2- 172.21.15.105:0/738723805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efdf80b4090 0x7efdf81e70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:05.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.660+0000 7efdfcbf1640 1 --2- 172.21.15.105:0/738723805 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdf806fec0 0x7efdf809b440 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:05.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.660+0000 7efdfcbf1640 1 -- 172.21.15.105:0/738723805 >> 172.21.15.105:0/738723805 conn(0x7efdf80cdcc0 msgr2=0x7efdf80b59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:28:05.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.660+0000 7efdfcbf1640 1 -- 172.21.15.105:0/738723805 shutdown_connections 2024-09-21T03:28:05.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.660+0000 7efdfcbf1640 1 -- 172.21.15.105:0/738723805 wait complete. 2024-09-21T03:28:05.673 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T03:28:05.673 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T03:28:05.785 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.783+0000 7f60fa7e6640 1 -- 172.21.15.105:0/94131880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60f4144270 msgr2=0x7f60f40b5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:28:05.785 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.783+0000 7f60fa7e6640 1 --2- 172.21.15.105:0/94131880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60f4144270 0x7f60f40b5680 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f60f40b60f0 tx=0x7f60e402a560 comp rx=0 tx=0).stop 2024-09-21T03:28:05.785 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.783+0000 7f60fa7e6640 1 -- 172.21.15.105:0/94131880 shutdown_connections 2024-09-21T03:28:05.785 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.783+0000 7f60fa7e6640 1 --2- 172.21.15.105:0/94131880 >> v2:172.21.15.162:3300/0 conn(0x7f60f4142270 0x7f60f4073e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:05.785 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.783+0000 7f60fa7e6640 1 --2- 172.21.15.105:0/94131880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60f4144270 0x7f60f40b5680 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:05.785 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.783+0000 7f60fa7e6640 1 -- 172.21.15.105:0/94131880 >> 172.21.15.105:0/94131880 conn(0x7f60f40d15f0 msgr2=0x7f60f4073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:28:05.785 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.783+0000 7f60fa7e6640 1 -- 172.21.15.105:0/94131880 shutdown_connections 2024-09-21T03:28:05.785 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.783+0000 7f60fa7e6640 1 -- 172.21.15.105:0/94131880 wait complete. 2024-09-21T03:28:05.786 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.785+0000 7f60fa7e6640 1 Processor -- start 2024-09-21T03:28:05.786 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.785+0000 7f60fa7e6640 1 -- start start 2024-09-21T03:28:05.789 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.786+0000 7f60fa7e6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60f4142270 0x7f60f40c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:28:05.789 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.786+0000 7f60fa7e6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60f4142680 0x7f60f414f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:28:05.789 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.786+0000 7f60fa7e6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60f4144270 0x7f60f414f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:28:05.789 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.786+0000 7f60fa7e6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f60f40d0780 con 0x7f60f4142270 2024-09-21T03:28:05.789 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.786+0000 7f60fa7e6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f60f40b5d80 con 0x7f60f4142680 2024-09-21T03:28:05.789 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.786+0000 7f60fa7e6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f60f41f47c0 con 0x7f60f4144270 2024-09-21T03:28:05.789 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.786+0000 7f60f3fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60f4142270 0x7f60f40c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:28:05.789 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.786+0000 7f60f3fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60f4142270 0x7f60f40c91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:45908/0 (socket says 172.21.15.105:45908) 2024-09-21T03:28:05.790 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.786+0000 7f60f3fff640 1 -- 172.21.15.105:0/2158250195 learned_addr learned my addr 172.21.15.105:0/2158250195 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-21T03:28:05.790 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.786+0000 7f60f3fff640 1 -- 172.21.15.105:0/2158250195 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60f4144270 msgr2=0x7f60f414f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:28:05.790 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.786+0000 7f60f3fff640 1 --2- 172.21.15.105:0/2158250195 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60f4144270 0x7f60f414f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:05.790 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.786+0000 7f60f3fff640 1 -- 172.21.15.105:0/2158250195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60f4142680 msgr2=0x7f60f414f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:28:05.790 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.786+0000 7f60f3fff640 1 --2- 172.21.15.105:0/2158250195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60f4142680 0x7f60f414f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:05.790 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.786+0000 7f60f3fff640 1 -- 172.21.15.105:0/2158250195 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60f41f7020 con 0x7f60f4142270 2024-09-21T03:28:05.790 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.787+0000 7f60f3fff640 1 --2- 172.21.15.105:0/2158250195 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60f4142270 0x7f60f40c91d0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f60e4034040 tx=0x7f60e4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:28:05.790 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.787+0000 7f60f0ff9640 1 -- 172.21.15.105:0/2158250195 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e403e030 con 0x7f60f4142270 2024-09-21T03:28:05.790 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.787+0000 7f60f0ff9640 1 -- 172.21.15.105:0/2158250195 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f60e4004730 con 0x7f60f4142270 2024-09-21T03:28:05.790 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.787+0000 7f60fa7e6640 1 -- 172.21.15.105:0/2158250195 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60f41f7300 con 0x7f60f4142270 2024-09-21T03:28:05.790 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.787+0000 7f60f0ff9640 1 -- 172.21.15.105:0/2158250195 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e4035040 con 0x7f60f4142270 2024-09-21T03:28:05.790 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.787+0000 7f60fa7e6640 1 -- 172.21.15.105:0/2158250195 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60f413e370 con 0x7f60f4142270 2024-09-21T03:28:05.791 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.788+0000 7f60fa7e6640 1 -- 172.21.15.105:0/2158250195 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60f4073e50 con 0x7f60f4142270 2024-09-21T03:28:05.791 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.788+0000 7f60f0ff9640 1 -- 172.21.15.105:0/2158250195 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f60e4041030 con 0x7f60f4142270 2024-09-21T03:28:05.791 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.789+0000 7f60f0ff9640 1 --2- 172.21.15.105:0/2158250195 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f60e0078b90 0x7f60e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:28:05.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.789+0000 7f60f0ff9640 1 -- 172.21.15.105:0/2158250195 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 4943+0+0 (secure 0 0 0) 0x7f60e40bb130 con 0x7f60f4142270 2024-09-21T03:28:05.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.789+0000 7f60f37fe640 1 --2- 172.21.15.105:0/2158250195 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f60e0078b90 0x7f60e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:28:05.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.790+0000 7f60f37fe640 1 --2- 172.21.15.105:0/2158250195 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f60e0078b90 0x7f60e007b0a0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f60f40c6130 tx=0x7f60e8006bf0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:28:05.795 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:05.794+0000 7f60f0ff9640 1 -- 172.21.15.105:0/2158250195 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f60e4083990 con 0x7f60f4142270 2024-09-21T03:28:06.007 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:06.005+0000 7f60fa7e6640 1 -- 172.21.15.105:0/2158250195 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60f415b530 con 0x7f60f4142270 2024-09-21T03:28:06.007 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:06.006+0000 7f60f0ff9640 1 -- 172.21.15.105:0/2158250195 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) ==== 94+0+3923 (secure 0 0 0) 0x7f60e4083290 con 0x7f60f4142270 2024-09-21T03:28:06.007 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-21T03:28:06.008 INFO:teuthology.orchestra.run.smithi105.stdout:{"epoch":97,"btime":"2024-09-21T03:27:34:495422+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6752,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/1488182977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1488182977},{"type":"v1","addr":"172.21.15.162:6836","nonce":1488182977}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":6755,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/2107181663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2107181663},{"type":"v1","addr":"172.21.15.162:6837","nonce":2107181663}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90},{"gid":8427,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/3833164666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3833164666},{"type":"v1","addr":"172.21.15.105:6834","nonce":3833164666}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":8679,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2560893699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2560893699},{"type":"v1","addr":"172.21.15.105:6835","nonce":2560893699}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97}],"filesystems":[]} 2024-09-21T03:28:06.008 INFO:teuthology.orchestra.run.smithi105.stderr:dumped fsmap epoch 97 2024-09-21T03:28:06.010 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:06.008+0000 7f60fa7e6640 1 -- 172.21.15.105:0/2158250195 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f60e0078b90 msgr2=0x7f60e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:28:06.010 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:06.008+0000 7f60fa7e6640 1 --2- 172.21.15.105:0/2158250195 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f60e0078b90 0x7f60e007b0a0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f60f40c6130 tx=0x7f60e8006bf0 comp rx=0 tx=0).stop 2024-09-21T03:28:06.010 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:06.008+0000 7f60fa7e6640 1 -- 172.21.15.105:0/2158250195 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60f4142270 msgr2=0x7f60f40c91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:28:06.010 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:06.008+0000 7f60fa7e6640 1 --2- 172.21.15.105:0/2158250195 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60f4142270 0x7f60f40c91d0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f60e4034040 tx=0x7f60e4003c10 comp rx=0 tx=0).stop 2024-09-21T03:28:06.010 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:06.008+0000 7f60fa7e6640 1 -- 172.21.15.105:0/2158250195 shutdown_connections 2024-09-21T03:28:06.010 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:06.008+0000 7f60fa7e6640 1 --2- 172.21.15.105:0/2158250195 >> [v2:172.21.15.162:6800/2934911804,v1:172.21.15.162:6801/2934911804] conn(0x7f60e0078b90 0x7f60e007b0a0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:06.010 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:06.008+0000 7f60fa7e6640 1 --2- 172.21.15.105:0/2158250195 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f60f4144270 0x7f60f414f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:06.010 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:06.008+0000 7f60fa7e6640 1 --2- 172.21.15.105:0/2158250195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60f4142680 0x7f60f414f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:06.010 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:06.008+0000 7f60fa7e6640 1 --2- 172.21.15.105:0/2158250195 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60f4142270 0x7f60f40c91d0 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:06.011 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:06.008+0000 7f60fa7e6640 1 -- 172.21.15.105:0/2158250195 >> 172.21.15.105:0/2158250195 conn(0x7f60f40d15f0 msgr2=0x7f60f413f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:28:06.011 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:06.008+0000 7f60fa7e6640 1 -- 172.21.15.105:0/2158250195 shutdown_connections 2024-09-21T03:28:06.011 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-21T03:28:06.008+0000 7f60fa7e6640 1 -- 172.21.15.105:0/2158250195 wait complete. 2024-09-21T03:28:06.021 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-21T03:28:06.021 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-21T03:28:06.021 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T03:28:06.021 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:28:06.033 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T03:28:06.033 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T03:28:06.033 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:28:06.083 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T03:28:06.083 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T03:28:06.083 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:28:06.096 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T03:28:06.096 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T03:28:06.096 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:28:06.148 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T03:28:06.149 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-21T03:28:06.149 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-21T03:28:06.149 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:28:06.173 INFO:tasks.ceph.osd.0:Stopped 2024-09-21T03:28:06.174 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-21T03:28:06.174 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:28:06.239 INFO:tasks.ceph.osd.1:Stopped 2024-09-21T03:28:06.239 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-21T03:28:06.239 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:28:06.306 INFO:tasks.ceph.osd.2:Stopped 2024-09-21T03:28:06.307 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-21T03:28:06.307 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:28:06.350 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-09-21T03:28:06.350 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-09-21T03:28:06.350 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-09-21T03:28:06.375 INFO:tasks.ceph.osd.3:Stopped 2024-09-21T03:28:06.375 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-21T03:28:06.375 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:28:06.408 INFO:tasks.ceph.osd.4:Stopped 2024-09-21T03:28:06.408 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-21T03:28:06.408 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:28:06.480 INFO:tasks.ceph.osd.5:Stopped 2024-09-21T03:28:06.480 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-21T03:28:06.481 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:28:06.554 INFO:tasks.ceph.osd.6:Stopped 2024-09-21T03:28:06.554 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-21T03:28:06.554 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:28:06.625 INFO:tasks.ceph.osd.7:Stopped 2024-09-21T03:28:06.625 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-21T03:28:06.626 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-21T03:28:06.626 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:28:06.653 INFO:tasks.ceph.mgr.y:Stopped 2024-09-21T03:28:06.653 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-21T03:28:06.653 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:28:06.695 INFO:tasks.ceph.mgr.x:Stopped 2024-09-21T03:28:06.696 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-21T03:28:06.696 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-21T03:28:06.696 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:28:06.708 INFO:tasks.ceph.mon.a:Stopped 2024-09-21T03:28:06.708 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-21T03:28:06.708 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:28:06.748 INFO:tasks.ceph.mon.b:Stopped 2024-09-21T03:28:06.748 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-21T03:28:06.748 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T03:28:06.801 INFO:tasks.ceph.mon.c:Stopped 2024-09-21T03:28:06.801 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-21T03:28:06.801 DEBUG:teuthology.orchestra.run.smithi105:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'responding to mclientcaps\(revoke\)' | egrep -v 'not advance its oldest_client_tid' | egrep -v 'failing to advance its oldest client/flush tid' | egrep -v 'Too many inodes in cache' | egrep -v 'failing to respond to cache pressure' | egrep -v 'slow requests are blocked' | egrep -v 'failing to respond to capability release' | egrep -v 'MDS cache is too large' | egrep -v '\(MDS_CLIENT_OLDEST_TID\)' | egrep -v '\(MDS_CACHE_OVERSIZED\)' | head -n 1 2024-09-21T03:28:06.842 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi105.front.sepia.ceph.com 2024-09-21T03:28:06.843 DEBUG:teuthology.orchestra.run.smithi105:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-21T03:28:07.079 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi105.front.sepia.ceph.com 2024-09-21T03:28:07.079 DEBUG:teuthology.orchestra.run.smithi105:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-21T03:28:07.174 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi105.front.sepia.ceph.com 2024-09-21T03:28:07.175 DEBUG:teuthology.orchestra.run.smithi105:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-21T03:28:07.241 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi105.front.sepia.ceph.com 2024-09-21T03:28:07.241 DEBUG:teuthology.orchestra.run.smithi105:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-21T03:28:07.288 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi162.front.sepia.ceph.com 2024-09-21T03:28:07.289 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-21T03:28:07.474 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi162.front.sepia.ceph.com 2024-09-21T03:28:07.474 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-21T03:28:07.538 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi162.front.sepia.ceph.com 2024-09-21T03:28:07.538 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-21T03:28:07.595 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi162.front.sepia.ceph.com 2024-09-21T03:28:07.595 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-21T03:28:07.645 INFO:tasks.ceph:Archiving mon data... 2024-09-21T03:28:07.646 DEBUG:teuthology.misc:Transferring archived files from smithi105:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913457/data/mon.a.tgz 2024-09-21T03:28:07.646 DEBUG:teuthology.orchestra.run.smithi105:> mktemp 2024-09-21T03:28:07.662 INFO:teuthology.orchestra.run.smithi105.stdout:/tmp/tmp.dmKCtjLkiG 2024-09-21T03:28:07.662 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.dmKCtjLkiG 2024-09-21T03:28:07.820 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 0666 /tmp/tmp.dmKCtjLkiG 2024-09-21T03:28:07.903 DEBUG:teuthology.orchestra.remote:smithi105:/tmp/tmp.dmKCtjLkiG is 409KB 2024-09-21T03:28:08.003 DEBUG:teuthology.orchestra.run.smithi105:> rm -fr /tmp/tmp.dmKCtjLkiG 2024-09-21T03:28:08.018 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913457/data/mon.b.tgz 2024-09-21T03:28:08.019 DEBUG:teuthology.orchestra.run.smithi162:> mktemp 2024-09-21T03:28:08.036 INFO:teuthology.orchestra.run.smithi162.stdout:/tmp/tmp.E8FI9n6sJc 2024-09-21T03:28:08.036 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.E8FI9n6sJc 2024-09-21T03:28:08.187 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0666 /tmp/tmp.E8FI9n6sJc 2024-09-21T03:28:08.269 DEBUG:teuthology.orchestra.remote:smithi162:/tmp/tmp.E8FI9n6sJc is 410KB 2024-09-21T03:28:08.367 DEBUG:teuthology.orchestra.run.smithi162:> rm -fr /tmp/tmp.E8FI9n6sJc 2024-09-21T03:28:08.382 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913457/data/mon.c.tgz 2024-09-21T03:28:08.382 DEBUG:teuthology.orchestra.run.smithi162:> mktemp 2024-09-21T03:28:08.436 INFO:teuthology.orchestra.run.smithi162.stdout:/tmp/tmp.R2BBFAmFvF 2024-09-21T03:28:08.437 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.R2BBFAmFvF 2024-09-21T03:28:08.577 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0666 /tmp/tmp.R2BBFAmFvF 2024-09-21T03:28:08.661 DEBUG:teuthology.orchestra.remote:smithi162:/tmp/tmp.R2BBFAmFvF is 410KB 2024-09-21T03:28:08.760 DEBUG:teuthology.orchestra.run.smithi162:> rm -fr /tmp/tmp.R2BBFAmFvF 2024-09-21T03:28:08.778 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-21T03:28:08.778 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-21T03:28:08.783 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-21T03:28:08.869 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-21T03:28:08.906 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-21T03:28:08.907 INFO:tasks.ceph:Archiving crash dumps... 2024-09-21T03:28:08.915 DEBUG:teuthology.misc:Transferring archived files from smithi105:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913457/remote/smithi105/crash 2024-09-21T03:28:08.918 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-21T03:28:08.948 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913457/remote/smithi162/crash 2024-09-21T03:28:08.952 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-21T03:28:08.982 INFO:tasks.ceph:Shutting down logrotate 2024-09-21T03:28:08.982 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:28:08.998 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T03:28:09.083 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-21T03:28:09.107 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-21T03:28:09.132 INFO:tasks.ceph:Compressing logs... 2024-09-21T03:28:09.133 DEBUG:teuthology.orchestra.run.smithi105:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T03:28:09.151 DEBUG:teuthology.orchestra.run.smithi162:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T03:28:09.174 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-21T03:28:09.174 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67985.log 2024-09-21T03:28:09.174 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64231.log 2024-09-21T03:28:09.174 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.67985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66774.log 2024-09-21T03:28:09.228 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44048.log 2024-09-21T03:28:09.228 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.47032.log 2024-09-21T03:28:09.229 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.44048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42939.log 2024-09-21T03:28:09.229 INFO:teuthology.orchestra.run.smithi162.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44048.log.gz 2024-09-21T03:28:09.229 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.47032.log: gzip -5 --verbose 0.0% -- /var/log/ceph/ceph-client.1.48092.log -- replaced with /var/log/ceph/ceph-client.1.47032.log.gz 2024-09-21T03:28:09.229 INFO:teuthology.orchestra.run.smithi162.stderr: 2024-09-21T03:28:09.229 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.3.42939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.45488.log 2024-09-21T03:28:09.229 INFO:teuthology.orchestra.run.smithi162.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42939.log.gz 2024-09-21T03:28:09.229 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.48092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36525.log 2024-09-21T03:28:09.229 INFO:teuthology.orchestra.run.smithi162.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.48092.log.gz 2024-09-21T03:28:09.229 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.45488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36685.log 2024-09-21T03:28:09.229 INFO:teuthology.orchestra.run.smithi162.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.45488.log.gz 2024-09-21T03:28:09.229 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.36525.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-21T03:28:09.229 INFO:teuthology.orchestra.run.smithi162.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36525.log.gz 2024-09-21T03:28:09.229 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.36685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.45010.log 2024-09-21T03:28:09.230 INFO:teuthology.orchestra.run.smithi162.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36685.log.gz 2024-09-21T03:28:09.230 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.46532.log 2024-09-21T03:28:09.230 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.45010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44525.log 2024-09-21T03:28:09.230 INFO:teuthology.orchestra.run.smithi162.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.45010.log.gz 2024-09-21T03:28:09.230 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.46532.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.46532.log.gz 2024-09-21T03:28:09.230 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-21T03:28:09.230 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.44525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36565.log 2024-09-21T03:28:09.230 INFO:teuthology.orchestra.run.smithi162.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44525.log.gz 2024-09-21T03:28:09.230 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-21T03:28:09.230 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.36565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.45492.log 2024-09-21T03:28:09.230 INFO:teuthology.orchestra.run.smithi162.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36565.log.gz 2024-09-21T03:28:09.230 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-21T03:28:09.230 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.48088.log 2024-09-21T03:28:09.230 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.45492.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.45492.log.gz 2024-09-21T03:28:09.231 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-21T03:28:09.231 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.48088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36805.log 2024-09-21T03:28:09.231 INFO:teuthology.orchestra.run.smithi162.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.48088.log.gz 2024-09-21T03:28:09.231 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.46528.log 2024-09-21T03:28:09.231 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.36805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.46050.log 2024-09-21T03:28:09.231 INFO:teuthology.orchestra.run.smithi162.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36805.log.gz 2024-09-21T03:28:09.231 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.46528.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.46528.log.gz 2024-09-21T03:28:09.231 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36645.log 2024-09-21T03:28:09.231 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.1.46050.log: /var/log/ceph/ceph-client.3.42943.log 2024-09-21T03:28:09.231 INFO:teuthology.orchestra.run.smithi162.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.46050.log.gz 2024-09-21T03:28:09.231 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.36645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.47036.log 2024-09-21T03:28:09.231 INFO:teuthology.orchestra.run.smithi162.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36645.log.gz 2024-09-21T03:28:09.231 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.3.42943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42943.log.gz 2024-09-21T03:28:09.231 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44044.log 2024-09-21T03:28:09.232 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.47036.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.1.47036.log.gz 2024-09-21T03:28:09.232 INFO:teuthology.orchestra.run.smithi162.stderr: --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-21T03:28:09.232 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.44044.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44044.log.gz 2024-09-21T03:28:09.232 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43529.log 2024-09-21T03:28:09.232 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.47533.log 2024-09-21T03:28:09.232 INFO:teuthology.orchestra.run.smithi162.stderr: 94.0% -- replaced with /var/log/ceph/ceph.audit.log.gz/var/log/ceph/ceph-client.1.43529.log: 2024-09-21T03:28:09.232 INFO:teuthology.orchestra.run.smithi162.stderr: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44529.log 2024-09-21T03:28:09.232 INFO:teuthology.orchestra.run.smithi162.stderr: -- replaced with /var/log/ceph/ceph-client.1.43529.log.gz 2024-09-21T03:28:09.232 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.47533.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-21T03:28:09.232 INFO:teuthology.orchestra.run.smithi162.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.47533.log.gz 2024-09-21T03:28:09.232 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.1.44529.log: /var/log/ceph/ceph.log 2024-09-21T03:28:09.232 INFO:teuthology.orchestra.run.smithi162.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44529.log.gz 2024-09-21T03:28:09.232 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36765.log 2024-09-21T03:28:09.232 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-21T03:28:09.232 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.36765.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36765.log.gz 2024-09-21T03:28:09.233 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-21T03:28:09.233 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mds.d.log: 92.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-21T03:28:09.233 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.45006.log 2024-09-21T03:28:09.241 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-21T03:28:09.242 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.45006.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.45006.log.gz 2024-09-21T03:28:09.255 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42538.log 2024-09-21T03:28:09.268 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mon.b.log: 94.2% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-21T03:28:09.275 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36725.log 2024-09-21T03:28:09.275 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.42538.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42538.log.gz 2024-09-21T03:28:09.287 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43525.log 2024-09-21T03:28:09.287 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.36725.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36725.log.gz 2024-09-21T03:28:09.300 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.47529.log 2024-09-21T03:28:09.300 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.43525.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43525.log.gz 2024-09-21T03:28:09.311 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42543.log 2024-09-21T03:28:09.311 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.47529.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.47529.log.gz 2024-09-21T03:28:09.331 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36605.log 2024-09-21T03:28:09.331 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.42543.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42543.log.gz 2024-09-21T03:28:09.342 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.46046.log 2024-09-21T03:28:09.355 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.36605.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36605.log.gz 2024-09-21T03:28:09.355 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.46046.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.46046.log.gz 2024-09-21T03:28:09.367 INFO:teuthology.orchestra.run.smithi162.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-21T03:28:09.466 INFO:teuthology.orchestra.run.smithi105.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.67985.log.gz 2024-09-21T03:28:09.467 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.64231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61631.log 2024-09-21T03:28:09.467 INFO:teuthology.orchestra.run.smithi105.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.64231.log.gz 2024-09-21T03:28:09.467 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.66774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49468.log 2024-09-21T03:28:09.467 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.66774.log.gz 2024-09-21T03:28:09.467 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.61631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50967.log 2024-09-21T03:28:09.467 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.61631.log.gz 2024-09-21T03:28:09.467 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.49468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59415.log 2024-09-21T03:28:09.467 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.50967.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49468.log.gz 2024-09-21T03:28:09.467 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56858.log 2024-09-21T03:28:09.467 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.59415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71481.log 2024-09-21T03:28:09.467 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.59415.log.gz 2024-09-21T03:28:09.467 INFO:teuthology.orchestra.run.smithi105.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.50967.log.gz 2024-09-21T03:28:09.468 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.56858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64699.log 2024-09-21T03:28:09.468 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56858.log.gz 2024-09-21T03:28:09.468 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.71481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52224.log 2024-09-21T03:28:09.468 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.71481.log.gz 2024-09-21T03:28:09.468 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.0.64699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56587.log 2024-09-21T03:28:09.468 INFO:teuthology.orchestra.run.smithi105.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.64699.log.gz 2024-09-21T03:28:09.468 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.52224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68685.log 2024-09-21T03:28:09.468 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.56587.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52224.log.gz 2024-09-21T03:28:09.468 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65408.log 2024-09-21T03:28:09.468 INFO:teuthology.orchestra.run.smithi105.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.56587.log.gz 2024-09-21T03:28:09.468 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.68685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43297.log 2024-09-21T03:28:09.468 INFO:teuthology.orchestra.run.smithi105.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.68685.log.gz 2024-09-21T03:28:09.468 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.65408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51225.log 2024-09-21T03:28:09.468 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.65408.log.gz/var/log/ceph/ceph-client.admin.43297.log: 2024-09-21T03:28:09.469 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52788.log 2024-09-21T03:28:09.469 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43297.log.gz 2024-09-21T03:28:09.469 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.0.51225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75187.log 2024-09-21T03:28:09.469 INFO:teuthology.orchestra.run.smithi105.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51225.log.gz 2024-09-21T03:28:09.469 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.52788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46961.log 2024-09-21T03:28:09.469 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.75187.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52788.log.gz 2024-09-21T03:28:09.469 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65994.log 2024-09-21T03:28:09.469 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.75187.log.gz 2024-09-21T03:28:09.469 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.46961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69967.log 2024-09-21T03:28:09.469 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46961.log.gz 2024-09-21T03:28:09.469 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.65994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58116.log 2024-09-21T03:28:09.469 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.69967.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.65994.log.gz 2024-09-21T03:28:09.469 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59914.log 2024-09-21T03:28:09.469 INFO:teuthology.orchestra.run.smithi105.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.69967.log.gz 2024-09-21T03:28:09.470 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.58116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36328.log 2024-09-21T03:28:09.470 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.59914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56377.log 2024-09-21T03:28:09.470 INFO:teuthology.orchestra.run.smithi105.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.58116.log.gz 2024-09-21T03:28:09.470 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59914.log.gz 2024-09-21T03:28:09.470 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.36328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56419.log 2024-09-21T03:28:09.470 INFO:teuthology.orchestra.run.smithi105.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.36328.log.gz 2024-09-21T03:28:09.470 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49613.log 2024-09-21T03:28:09.470 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.56377.log: /var/log/ceph/ceph-client.admin.56419.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56377.log.gz 2024-09-21T03:28:09.470 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73371.log 2024-09-21T03:28:09.470 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56419.log.gz 2024-09-21T03:28:09.470 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.49613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48364.log 2024-09-21T03:28:09.470 INFO:teuthology.orchestra.run.smithi105.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49613.log.gz 2024-09-21T03:28:09.470 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.73371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57411.log 2024-09-21T03:28:09.470 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.73371.log.gz 2024-09-21T03:28:09.471 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.0.48364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73614.log 2024-09-21T03:28:09.471 INFO:teuthology.orchestra.run.smithi105.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48364.log.gz 2024-09-21T03:28:09.471 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.57411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63709.log 2024-09-21T03:28:09.471 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.73614.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57411.log.gz 2024-09-21T03:28:09.471 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64315.log 2024-09-21T03:28:09.471 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.73614.log.gz 2024-09-21T03:28:09.471 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.63709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48446.log 2024-09-21T03:28:09.471 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63709.log.gz 2024-09-21T03:28:09.471 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.64315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42915.log 2024-09-21T03:28:09.471 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.48446.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.64315.log.gz 2024-09-21T03:28:09.471 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45602.log 2024-09-21T03:28:09.471 INFO:teuthology.orchestra.run.smithi105.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48446.log.gz 2024-09-21T03:28:09.471 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.42915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55349.log 2024-09-21T03:28:09.471 INFO:teuthology.orchestra.run.smithi105.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.42915.log.gz 2024-09-21T03:28:09.471 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.2.45602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62828.log 2024-09-21T03:28:09.472 INFO:teuthology.orchestra.run.smithi105.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45602.log.gz 2024-09-21T03:28:09.472 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.55349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59499.log 2024-09-21T03:28:09.472 INFO:teuthology.orchestra.run.smithi105.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.55349.log.gz 2024-09-21T03:28:09.472 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.62828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43854.log 2024-09-21T03:28:09.472 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62828.log.gz 2024-09-21T03:28:09.472 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.59499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46093.log 2024-09-21T03:28:09.472 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.43854.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59499.log.gz 2024-09-21T03:28:09.472 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50841.log 2024-09-21T03:28:09.472 INFO:teuthology.orchestra.run.smithi105.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43854.log.gz 2024-09-21T03:28:09.472 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.46093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71880.log 2024-09-21T03:28:09.472 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46093.log.gz 2024-09-21T03:28:09.472 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.50841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56942.log 2024-09-21T03:28:09.472 INFO:teuthology.orchestra.run.smithi105.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50841.log.gz/var/log/ceph/ceph-client.admin.71880.log: 2024-09-21T03:28:09.472 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44557.log 2024-09-21T03:28:09.472 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.71880.log.gz 2024-09-21T03:28:09.473 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.56942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66139.log 2024-09-21T03:28:09.473 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56942.log.gz 2024-09-21T03:28:09.473 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.44557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56774.log 2024-09-21T03:28:09.473 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6%/var/log/ceph/ceph-client.admin.66139.log: -- replaced with /var/log/ceph/ceph-client.admin.44557.log.gz 2024-09-21T03:28:09.473 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66265.log 2024-09-21T03:28:09.473 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.66139.log.gz 2024-09-21T03:28:09.473 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.56774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43423.log 2024-09-21T03:28:09.473 INFO:teuthology.orchestra.run.smithi105.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56774.log.gz 2024-09-21T03:28:09.473 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.66265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69493.log 2024-09-21T03:28:09.473 INFO:teuthology.orchestra.run.smithi105.stderr: 87.8%/var/log/ceph/ceph-client.admin.43423.log: -- replaced with /var/log/ceph/ceph-client.admin.66265.log.gz 2024-09-21T03:28:09.473 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75791.log 2024-09-21T03:28:09.473 INFO:teuthology.orchestra.run.smithi105.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43423.log.gz 2024-09-21T03:28:09.473 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.69493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75313.log 2024-09-21T03:28:09.473 INFO:teuthology.orchestra.run.smithi105.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.69493.log.gz 2024-09-21T03:28:09.474 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.75791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69794.log 2024-09-21T03:28:09.474 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.75313.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.75791.log.gz 2024-09-21T03:28:09.474 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54702.log 2024-09-21T03:28:09.474 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.75313.log.gz 2024-09-21T03:28:09.474 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.69794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51221.log 2024-09-21T03:28:09.474 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.69794.log.gz 2024-09-21T03:28:09.474 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.54702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36622.log 2024-09-21T03:28:09.474 INFO:teuthology.orchestra.run.smithi105.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54702.log.gz 2024-09-21T03:28:09.474 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.0.51221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72173.log 2024-09-21T03:28:09.474 INFO:teuthology.orchestra.run.smithi105.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51221.log.gz 2024-09-21T03:28:09.474 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.36622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47042.log 2024-09-21T03:28:09.474 INFO:teuthology.orchestra.run.smithi105.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.36622.log.gz 2024-09-21T03:28:09.474 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.72173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67043.log 2024-09-21T03:28:09.474 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.47042.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.72173.log.gz 2024-09-21T03:28:09.475 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68027.log 2024-09-21T03:28:09.475 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47042.log.gz 2024-09-21T03:28:09.475 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.67043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74532.log 2024-09-21T03:28:09.475 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.67043.log.gz 2024-09-21T03:28:09.475 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.68027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36547.log 2024-09-21T03:28:09.475 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.74532.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.68027.log.gz 2024-09-21T03:28:09.475 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49960.log 2024-09-21T03:28:09.475 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.74532.log.gz 2024-09-21T03:28:09.475 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.36547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45865.log 2024-09-21T03:28:09.475 INFO:teuthology.orchestra.run.smithi105.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.36547.log.gz 2024-09-21T03:28:09.475 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.49960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54006.log 2024-09-21T03:28:09.475 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.45865.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49960.log.gz 2024-09-21T03:28:09.475 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55391.log 2024-09-21T03:28:09.475 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45865.log.gz 2024-09-21T03:28:09.476 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.54006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43255.log 2024-09-21T03:28:09.476 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54006.log.gz 2024-09-21T03:28:09.476 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.55391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51930.log 2024-09-21T03:28:09.476 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55391.log.gz 2024-09-21T03:28:09.476 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.43255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44188.log 2024-09-21T03:28:09.476 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43255.log.gz 2024-09-21T03:28:09.476 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.51930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63891.log 2024-09-21T03:28:09.476 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51930.log.gz 2024-09-21T03:28:09.476 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.44188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64987.log 2024-09-21T03:28:09.476 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44188.log.gz 2024-09-21T03:28:09.476 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.63891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55871.log 2024-09-21T03:28:09.476 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.63891.log.gz 2024-09-21T03:28:09.476 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.64987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44389.log 2024-09-21T03:28:09.476 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64987.log.gz 2024-09-21T03:28:09.477 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.55871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62009.log 2024-09-21T03:28:09.477 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.44389.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55871.log.gz 2024-09-21T03:28:09.477 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55733.log 2024-09-21T03:28:09.477 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44389.log.gz 2024-09-21T03:28:09.477 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.62009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74977.log 2024-09-21T03:28:09.477 INFO:teuthology.orchestra.run.smithi105.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.62009.log.gz 2024-09-21T03:28:09.477 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.0.55733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47816.log 2024-09-21T03:28:09.477 INFO:teuthology.orchestra.run.smithi105.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.55733.log.gz 2024-09-21T03:28:09.477 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.74977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70388.log 2024-09-21T03:28:09.477 INFO:teuthology.orchestra.run.smithi105.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.74977.log.gz 2024-09-21T03:28:09.477 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.47816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72425.log 2024-09-21T03:28:09.477 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47816.log.gz 2024-09-21T03:28:09.477 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.70388.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-21T03:28:09.477 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.72425.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.70388.log.gz 2024-09-21T03:28:09.477 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49038.log 2024-09-21T03:28:09.478 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.72425.log.gz 2024-09-21T03:28:09.478 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60355.log 2024-09-21T03:28:09.478 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.49038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52834.log 2024-09-21T03:28:09.478 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49038.log.gz 2024-09-21T03:28:09.478 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.60355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65911.log 2024-09-21T03:28:09.478 INFO:teuthology.orchestra.run.smithi105.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.60355.log.gz 2024-09-21T03:28:09.478 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74219.log 2024-09-21T03:28:09.478 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.52834.log: /var/log/ceph/ceph-client.admin.65911.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52834.log.gz 2024-09-21T03:28:09.478 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51303.log 2024-09-21T03:28:09.478 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.65911.log.gz 2024-09-21T03:28:09.478 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59812.log 2024-09-21T03:28:09.478 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.74219.log: /var/log/ceph/ceph-client.admin.51303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73544.log 2024-09-21T03:28:09.478 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.74219.log.gz 2024-09-21T03:28:09.478 INFO:teuthology.orchestra.run.smithi105.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51303.log.gz 2024-09-21T03:28:09.479 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.59812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70136.log 2024-09-21T03:28:09.479 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59812.log.gz 2024-09-21T03:28:09.479 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5/var/log/ceph/ceph-client.admin.73544.log: --verbose -- /var/log/ceph/ceph-client.admin.47423.log 2024-09-21T03:28:09.479 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.70136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43171.log 2024-09-21T03:28:09.479 INFO:teuthology.orchestra.run.smithi105.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.73544.log.gz 2024-09-21T03:28:09.479 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.70136.log.gz 2024-09-21T03:28:09.479 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.47423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75709.log 2024-09-21T03:28:09.479 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.43171.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47423.log.gz 2024-09-21T03:28:09.479 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73031.log 2024-09-21T03:28:09.479 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43171.log.gz 2024-09-21T03:28:09.479 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36300.log 2024-09-21T03:28:09.479 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.75709.log: /var/log/ceph/ceph-client.admin.73031.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.75709.log.gz 2024-09-21T03:28:09.479 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36790.log 2024-09-21T03:28:09.479 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.73031.log.gz 2024-09-21T03:28:09.479 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.36300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47774.log 2024-09-21T03:28:09.480 INFO:teuthology.orchestra.run.smithi105.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.36300.log.gz 2024-09-21T03:28:09.480 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.36790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55433.log 2024-09-21T03:28:09.480 INFO:teuthology.orchestra.run.smithi105.stderr: 86.3%/var/log/ceph/ceph-client.admin.47774.log: -- replaced with /var/log/ceph/ceph-client.admin.36790.log.gz 2024-09-21T03:28:09.480 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61673.log 2024-09-21T03:28:09.480 INFO:teuthology.orchestra.run.smithi105.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.47774.log.gz 2024-09-21T03:28:09.480 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.55433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57506.log 2024-09-21T03:28:09.480 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55433.log.gz 2024-09-21T03:28:09.480 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.61673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71523.log 2024-09-21T03:28:09.480 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61673.log.gz 2024-09-21T03:28:09.480 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.57506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51888.log 2024-09-21T03:28:09.480 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57506.log.gz 2024-09-21T03:28:09.480 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47900.log 2024-09-21T03:28:09.480 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.71523.log: /var/log/ceph/ceph-client.admin.51888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60439.log 2024-09-21T03:28:09.480 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.71523.log.gz 2024-09-21T03:28:09.481 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51888.log.gz 2024-09-21T03:28:09.481 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.47900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43045.log 2024-09-21T03:28:09.481 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47900.log.gz 2024-09-21T03:28:09.481 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49865.log 2024-09-21T03:28:09.481 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.60439.log: /var/log/ceph/ceph-client.admin.43045.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.60439.log.gz 2024-09-21T03:28:09.481 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53044.log 2024-09-21T03:28:09.481 INFO:teuthology.orchestra.run.smithi105.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43045.log.gz 2024-09-21T03:28:09.481 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47648.log 2024-09-21T03:28:09.481 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.49865.log: /var/log/ceph/ceph-client.admin.53044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46533.log 2024-09-21T03:28:09.481 INFO:teuthology.orchestra.run.smithi105.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49865.log.gz 2024-09-21T03:28:09.481 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53044.log.gz 2024-09-21T03:28:09.481 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.47648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60135.log 2024-09-21T03:28:09.481 INFO:teuthology.orchestra.run.smithi105.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.47648.log.gz 2024-09-21T03:28:09.481 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.46533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57846.log 2024-09-21T03:28:09.482 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46533.log.gz 2024-09-21T03:28:09.482 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68450.log 2024-09-21T03:28:09.482 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.60135.log: /var/log/ceph/ceph-client.admin.57846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58370.log 2024-09-21T03:28:09.482 INFO:teuthology.orchestra.run.smithi105.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.60135.log.gz 2024-09-21T03:28:09.482 INFO:teuthology.orchestra.run.smithi105.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.57846.log.gz 2024-09-21T03:28:09.482 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.68450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68408.log 2024-09-21T03:28:09.482 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.68450.log.gz 2024-09-21T03:28:09.482 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74429.log 2024-09-21T03:28:09.482 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.0.58370.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.58370.log.gz 2024-09-21T03:28:09.482 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.68408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44515.log 2024-09-21T03:28:09.482 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.68408.log.gz 2024-09-21T03:28:09.482 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.74429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69925.log 2024-09-21T03:28:09.482 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.74429.log.gz 2024-09-21T03:28:09.482 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61361.log 2024-09-21T03:28:09.483 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.44515.log: /var/log/ceph/ceph-client.admin.69925.log: gzip 87.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.44515.log.gz --verbose 2024-09-21T03:28:09.483 INFO:teuthology.orchestra.run.smithi105.stderr: -- /var/log/ceph/ceph-client.admin.50925.log 2024-09-21T03:28:09.483 INFO:teuthology.orchestra.run.smithi105.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.69925.log.gz 2024-09-21T03:28:09.483 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.61361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49174.log 2024-09-21T03:28:09.483 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61361.log.gz 2024-09-21T03:28:09.483 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56629.log 2024-09-21T03:28:09.483 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.50925.log: /var/log/ceph/ceph-client.admin.49174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66913.log 2024-09-21T03:28:09.483 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50925.log.gz 2024-09-21T03:28:09.483 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.56629.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49174.log.gz 2024-09-21T03:28:09.483 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72006.log 2024-09-21T03:28:09.483 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56629.log.gz 2024-09-21T03:28:09.483 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.66913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66528.log 2024-09-21T03:28:09.483 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.66913.log.gz 2024-09-21T03:28:09.483 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.72006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47690.log 2024-09-21T03:28:09.483 INFO:teuthology.orchestra.run.smithi105.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.72006.log.gz 2024-09-21T03:28:09.484 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.66528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47984.log 2024-09-21T03:28:09.484 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.66528.log.gz 2024-09-21T03:28:09.484 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.47690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72299.log 2024-09-21T03:28:09.484 INFO:teuthology.orchestra.run.smithi105.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47690.log.gz 2024-09-21T03:28:09.484 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.47984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70472.log 2024-09-21T03:28:09.484 INFO:teuthology.orchestra.run.smithi105.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.47984.log.gz 2024-09-21T03:28:09.484 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.72299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71964.log 2024-09-21T03:28:09.484 INFO:teuthology.orchestra.run.smithi105.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.72299.log.gz 2024-09-21T03:28:09.484 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.70472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68995.log 2024-09-21T03:28:09.484 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.70472.log.gz 2024-09-21T03:28:09.484 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60606.log 2024-09-21T03:28:09.484 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.71964.log: /var/log/ceph/ceph-client.admin.68995.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.71964.log.gz 2024-09-21T03:28:09.484 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67211.log 2024-09-21T03:28:09.484 INFO:teuthology.orchestra.run.smithi105.stderr: 83.6% -- replaced with /var/log/ceph/ceph-client.admin.68995.log.gz 2024-09-21T03:28:09.485 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62660.log 2024-09-21T03:28:09.485 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.60606.log: /var/log/ceph/ceph-client.admin.67211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67481.log 2024-09-21T03:28:09.485 INFO:teuthology.orchestra.run.smithi105.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.60606.log.gz 2024-09-21T03:28:09.485 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.62660.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.67211.log.gz 2024-09-21T03:28:09.485 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52704.log 2024-09-21T03:28:09.485 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.62660.log.gz 2024-09-21T03:28:09.485 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.67481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46796.log 2024-09-21T03:28:09.485 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67481.log.gz 2024-09-21T03:28:09.485 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74893.log 2024-09-21T03:28:09.485 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.52704.log: /var/log/ceph/ceph-client.admin.46796.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52704.log.gz 2024-09-21T03:28:09.485 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66097.log 2024-09-21T03:28:09.485 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46796.log.gz 2024-09-21T03:28:09.485 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61319.log 2024-09-21T03:28:09.485 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.74893.log: /var/log/ceph/ceph-client.admin.66097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67085.log 2024-09-21T03:28:09.485 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.74893.log.gz 2024-09-21T03:28:09.486 INFO:teuthology.orchestra.run.smithi105.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.66097.log.gz 2024-09-21T03:28:09.486 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.61319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37343.log 2024-09-21T03:28:09.486 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.61319.log.gz 2024-09-21T03:28:09.486 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.67085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46881.log 2024-09-21T03:28:09.486 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.67085.log.gz 2024-09-21T03:28:09.486 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74387.log 2024-09-21T03:28:09.486 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.37343.log: /var/log/ceph/ceph-client.admin.46881.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37343.log.gz 2024-09-21T03:28:09.486 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74616.log 2024-09-21T03:28:09.486 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46881.log.gz 2024-09-21T03:28:09.486 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44599.log 2024-09-21T03:28:09.486 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.74387.log: /var/log/ceph/ceph-client.admin.74616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43129.log 2024-09-21T03:28:09.486 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.74387.log.gz 2024-09-21T03:28:09.486 INFO:teuthology.orchestra.run.smithi105.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.74616.log.gz 2024-09-21T03:28:09.486 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.44599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60523.log 2024-09-21T03:28:09.487 INFO:teuthology.orchestra.run.smithi105.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44599.log.gz 2024-09-21T03:28:09.487 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.43129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43549.log 2024-09-21T03:28:09.487 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43129.log.gz 2024-09-21T03:28:09.487 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65029.log 2024-09-21T03:28:09.487 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.60523.log: /var/log/ceph/ceph-client.admin.43549.log: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.60523.log.gz 2024-09-21T03:28:09.487 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71796.log 2024-09-21T03:28:09.487 INFO:teuthology.orchestra.run.smithi105.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43549.log.gz 2024-09-21T03:28:09.487 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57026.log 2024-09-21T03:28:09.487 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.65029.log: /var/log/ceph/ceph-client.admin.71796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54235.log 2024-09-21T03:28:09.487 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.65029.log.gz 2024-09-21T03:28:09.487 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.71796.log.gz 2024-09-21T03:28:09.487 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.57026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58182.log 2024-09-21T03:28:09.487 INFO:teuthology.orchestra.run.smithi105.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57026.log.gz 2024-09-21T03:28:09.487 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.54235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54403.log 2024-09-21T03:28:09.488 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54235.log.gz 2024-09-21T03:28:09.488 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75271.log 2024-09-21T03:28:09.488 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.58182.log: /var/log/ceph/ceph-client.admin.54403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58662.log 2024-09-21T03:28:09.488 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58182.log.gz 2024-09-21T03:28:09.488 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54403.log.gz 2024-09-21T03:28:09.488 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.75271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68911.log 2024-09-21T03:28:09.488 INFO:teuthology.orchestra.run.smithi105.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.75271.log.gz 2024-09-21T03:28:09.488 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65643.log 2024-09-21T03:28:09.488 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.58662.log: /var/log/ceph/ceph-client.admin.68911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56335.log 2024-09-21T03:28:09.488 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58662.log.gz 2024-09-21T03:28:09.488 INFO:teuthology.orchestra.run.smithi105.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.68911.log.gz 2024-09-21T03:28:09.488 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.65643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68153.log 2024-09-21T03:28:09.488 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71922.log 2024-09-21T03:28:09.488 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.65643.log.gz 2024-09-21T03:28:09.488 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.56335.log: /var/log/ceph/ceph-client.admin.68153.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56335.log.gz 2024-09-21T03:28:09.489 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62093.log 2024-09-21T03:28:09.489 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.68153.log.gz 2024-09-21T03:28:09.489 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54967.log 2024-09-21T03:28:09.489 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.71922.log: /var/log/ceph/ceph-client.admin.62093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46744.log 2024-09-21T03:28:09.489 INFO:teuthology.orchestra.run.smithi105.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.71922.log.gz 2024-09-21T03:28:09.489 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.54967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69139.log 2024-09-21T03:28:09.489 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54967.log.gz 2024-09-21T03:28:09.489 INFO:teuthology.orchestra.run.smithi105.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.62093.log.gz 2024-09-21T03:28:09.489 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.46744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61277.log 2024-09-21T03:28:09.489 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46744.log.gz 2024-09-21T03:28:09.489 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66433.log 2024-09-21T03:28:09.489 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.69139.log: /var/log/ceph/ceph-client.admin.61277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64147.log 2024-09-21T03:28:09.489 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.69139.log.gz 2024-09-21T03:28:09.489 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.61277.log.gz 2024-09-21T03:28:09.490 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.66433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64063.log 2024-09-21T03:28:09.490 INFO:teuthology.orchestra.run.smithi105.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.66433.log.gz 2024-09-21T03:28:09.490 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62744.log 2024-09-21T03:28:09.490 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.64147.log: /var/log/ceph/ceph-client.admin.64063.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64147.log.gz 2024-09-21T03:28:09.490 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48110.log 2024-09-21T03:28:09.490 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.64063.log.gz 2024-09-21T03:28:09.490 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51972.log 2024-09-21T03:28:09.490 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.62744.log: /var/log/ceph/ceph-client.admin.48110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45907.log 2024-09-21T03:28:09.490 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62744.log.gz 2024-09-21T03:28:09.490 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.51972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46839.log 2024-09-21T03:28:09.490 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51972.log.gz 2024-09-21T03:28:09.490 INFO:teuthology.orchestra.run.smithi105.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.48110.log.gz 2024-09-21T03:28:09.490 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.45907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54151.log 2024-09-21T03:28:09.490 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45907.log.gz 2024-09-21T03:28:09.491 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61406.log 2024-09-21T03:28:09.491 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.46839.log: /var/log/ceph/ceph-client.admin.54151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50121.log 2024-09-21T03:28:09.491 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46839.log.gz 2024-09-21T03:28:09.491 INFO:teuthology.orchestra.run.smithi105.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54151.log.gz 2024-09-21T03:28:09.491 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.61406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52523.log 2024-09-21T03:28:09.491 INFO:teuthology.orchestra.run.smithi105.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.61406.log.gz 2024-09-21T03:28:09.491 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45949.log 2024-09-21T03:28:09.491 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.50121.log: /var/log/ceph/ceph-client.admin.52523.log: gzip 87.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.50121.log.gz --verbose 2024-09-21T03:28:09.491 INFO:teuthology.orchestra.run.smithi105.stderr: -- /var/log/ceph/ceph-client.admin.49529.log 2024-09-21T03:28:09.491 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52523.log.gz 2024-09-21T03:28:09.491 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.45949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62159.log 2024-09-21T03:28:09.491 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36159.log 2024-09-21T03:28:09.491 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45949.log.gz 2024-09-21T03:28:09.491 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.49529.log: /var/log/ceph/ceph-client.admin.62159.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49529.log.gz 2024-09-21T03:28:09.491 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70892.log 2024-09-21T03:28:09.492 INFO:teuthology.orchestra.run.smithi105.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.62159.log.gz 2024-09-21T03:28:09.492 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63798.log 2024-09-21T03:28:09.492 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.36159.log: 76.8% -- replaced with /var/log/ceph/ceph-client.admin.36159.log.gz 2024-09-21T03:28:09.492 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.70892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72131.log 2024-09-21T03:28:09.492 INFO:teuthology.orchestra.run.smithi105.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.70892.log.gz 2024-09-21T03:28:09.492 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.63798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58536.log 2024-09-21T03:28:09.492 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63798.log.gz 2024-09-21T03:28:09.492 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.72131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72642.log 2024-09-21T03:28:09.492 INFO:teuthology.orchestra.run.smithi105.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.72131.log.gz 2024-09-21T03:28:09.492 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63117.log 2024-09-21T03:28:09.492 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.58536.log: /var/log/ceph/ceph-client.admin.72642.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.58536.log.gz 2024-09-21T03:28:09.492 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72765.log 2024-09-21T03:28:09.492 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.72642.log.gz 2024-09-21T03:28:09.492 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5/var/log/ceph/ceph-client.admin.63117.log: --verbose -- /var/log/ceph/ceph-client.admin.65701.log 2024-09-21T03:28:09.493 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.72765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72852.log 2024-09-21T03:28:09.493 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63117.log.gz 2024-09-21T03:28:09.493 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.65701.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.72765.log.gz 2024-09-21T03:28:09.493 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61501.log 2024-09-21T03:28:09.493 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.65701.log.gz 2024-09-21T03:28:09.493 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.72852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64105.log 2024-09-21T03:28:09.493 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.72852.log.gz 2024-09-21T03:28:09.493 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70346.log 2024-09-21T03:28:09.493 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.61501.log: /var/log/ceph/ceph-client.admin.64105.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.61501.log.gz 2024-09-21T03:28:09.493 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69881.log 2024-09-21T03:28:09.493 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.64105.log.gz 2024-09-21T03:28:09.493 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51743.log 2024-09-21T03:28:09.493 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.70346.log: /var/log/ceph/ceph-client.admin.69881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68366.log 2024-09-21T03:28:09.493 INFO:teuthology.orchestra.run.smithi105.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.70346.log.gz 2024-09-21T03:28:09.494 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.69881.log.gz 2024-09-21T03:28:09.494 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.51743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67589.log 2024-09-21T03:28:09.494 INFO:teuthology.orchestra.run.smithi105.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51743.log.gz 2024-09-21T03:28:09.494 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.68366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50163.log 2024-09-21T03:28:09.494 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68366.log.gz 2024-09-21T03:28:09.494 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72947.log 2024-09-21T03:28:09.494 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.67589.log: /var/log/ceph/ceph-client.admin.50163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55307.log 2024-09-21T03:28:09.494 INFO:teuthology.orchestra.run.smithi105.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.67589.log.gz 2024-09-21T03:28:09.494 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50163.log.gz 2024-09-21T03:28:09.494 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.72947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68324.log 2024-09-21T03:28:09.494 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.72947.log.gz 2024-09-21T03:28:09.494 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49300.log 2024-09-21T03:28:09.494 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.55307.log: /var/log/ceph/ceph-client.admin.68324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73077.log 2024-09-21T03:28:09.494 INFO:teuthology.orchestra.run.smithi105.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.55307.log.gz 2024-09-21T03:28:09.494 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68324.log.gz 2024-09-21T03:28:09.495 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.49300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61967.log 2024-09-21T03:28:09.495 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49823.log 87.5% 2024-09-21T03:28:09.495 INFO:teuthology.orchestra.run.smithi105.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49300.log.gz 2024-09-21T03:28:09.495 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.73077.log: /var/log/ceph/ceph-client.admin.61967.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.73077.log.gz 2024-09-21T03:28:09.495 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43381.log 2024-09-21T03:28:09.495 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.61967.log.gz 2024-09-21T03:28:09.495 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49571.log 2024-09-21T03:28:09.495 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.49823.log: /var/log/ceph/ceph-client.admin.43381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61543.log 2024-09-21T03:28:09.495 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49823.log.gz 2024-09-21T03:28:09.495 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43381.log.gz 2024-09-21T03:28:09.495 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.49571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50799.log 2024-09-21T03:28:09.495 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49571.log.gz 2024-09-21T03:28:09.495 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.61543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73203.log 2024-09-21T03:28:09.495 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61543.log.gz 2024-09-21T03:28:09.496 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57455.log 2024-09-21T03:28:09.496 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.50799.log: /var/log/ceph/ceph-client.admin.73203.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-21T03:28:09.496 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50799.log.gz 2024-09-21T03:28:09.496 INFO:teuthology.orchestra.run.smithi105.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.73203.log.gz 2024-09-21T03:28:09.496 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.57455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69349.log 2024-09-21T03:28:09.496 INFO:teuthology.orchestra.run.smithi105.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.57455.log.gz 2024-09-21T03:28:09.496 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70976.log 2024-09-21T03:28:09.496 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.69349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46009.log 2024-09-21T03:28:09.496 INFO:teuthology.orchestra.run.smithi105.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.69349.log.gz 2024-09-21T03:28:09.496 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.70976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55541.log 2024-09-21T03:28:09.496 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.70976.log.gz 2024-09-21T03:28:09.496 INFO:teuthology.orchestra.run.smithi105.stderr:gzip/var/log/ceph/ceph-client.admin.46009.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.59644.log 2024-09-21T03:28:09.496 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.55541.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46009.log.gz 2024-09-21T03:28:09.496 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70304.log 2024-09-21T03:28:09.496 INFO:teuthology.orchestra.run.smithi105.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55541.log.gz 2024-09-21T03:28:09.497 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.59644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59145.log 2024-09-21T03:28:09.497 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.59644.log.gz 2024-09-21T03:28:09.497 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52319.log 2024-09-21T03:28:09.497 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.70304.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.70304.log.gz 2024-09-21T03:28:09.497 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.59145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54193.log 2024-09-21T03:28:09.497 INFO:teuthology.orchestra.run.smithi105.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59145.log.gz 2024-09-21T03:28:09.497 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5/var/log/ceph/ceph-client.admin.52319.log: --verbose -- /var/log/ceph/ceph-client.admin.67397.log 2024-09-21T03:28:09.497 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52319.log.gz 2024-09-21T03:28:09.497 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59956.log 2024-09-21T03:28:09.497 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.54193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60040.log 2024-09-21T03:28:09.497 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.67397.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54193.log.gz 2024-09-21T03:28:09.497 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.59956.log: 89.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-21T03:28:09.497 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.67397.log.gz 2024-09-21T03:28:09.497 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60213.log 2024-09-21T03:28:09.498 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59956.log.gz 2024-09-21T03:28:09.498 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54277.log 2024-09-21T03:28:09.498 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.60040.log: /var/log/ceph/ceph-client.admin.60213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70430.log 2024-09-21T03:28:09.498 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60040.log.gz 2024-09-21T03:28:09.498 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60213.log.gz 2024-09-21T03:28:09.498 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.54277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61715.log 2024-09-21T03:28:09.498 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54277.log.gz 2024-09-21T03:28:09.498 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.70430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61196.log 2024-09-21T03:28:09.498 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.70430.log.gz 2024-09-21T03:28:09.498 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73329.log 2024-09-21T03:28:09.498 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.61715.log: /var/log/ceph/ceph-client.admin.61196.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.61715.log.gz 2024-09-21T03:28:09.498 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74261.log 2024-09-21T03:28:09.498 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61196.log.gz 2024-09-21T03:28:09.498 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51701.log 2024-09-21T03:28:09.499 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.73329.log: /var/log/ceph/ceph-client.admin.74261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59728.log 2024-09-21T03:28:09.499 INFO:teuthology.orchestra.run.smithi105.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.73329.log.gz 2024-09-21T03:28:09.499 INFO:teuthology.orchestra.run.smithi105.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.74261.log.gz 2024-09-21T03:28:09.499 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.51701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60685.log 2024-09-21T03:28:09.499 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51701.log.gz 2024-09-21T03:28:09.499 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.59728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64021.log 2024-09-21T03:28:09.499 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59728.log.gz 2024-09-21T03:28:09.499 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62429.log 2024-09-21T03:28:09.499 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.60685.log: /var/log/ceph/ceph-client.admin.64021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56732.log 2024-09-21T03:28:09.499 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.60685.log.gz 2024-09-21T03:28:09.499 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64021.log.gz 2024-09-21T03:28:09.499 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.62429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58704.log 2024-09-21T03:28:09.499 INFO:teuthology.orchestra.run.smithi105.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62429.log.gz 2024-09-21T03:28:09.499 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.56732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67439.log 2024-09-21T03:28:09.499 INFO:teuthology.orchestra.run.smithi105.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.56732.log.gz 2024-09-21T03:28:09.500 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62525.log 2024-09-21T03:28:09.500 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.58704.log: /var/log/ceph/ceph-client.admin.67439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69078.log 2024-09-21T03:28:09.500 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58704.log.gz 2024-09-21T03:28:09.500 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.67439.log.gz 2024-09-21T03:28:09.500 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.62525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60853.log 2024-09-21T03:28:09.500 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.62525.log.gz 2024-09-21T03:28:09.500 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.69078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73413.log 2024-09-21T03:28:09.500 INFO:teuthology.orchestra.run.smithi105.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.69078.log.gz 2024-09-21T03:28:09.500 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.60853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75649.log 2024-09-21T03:28:09.500 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60853.log.gz 2024-09-21T03:28:09.500 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.73413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72215.log 2024-09-21T03:28:09.500 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.73413.log.gz 2024-09-21T03:28:09.500 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.75649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74303.log 2024-09-21T03:28:09.500 INFO:teuthology.orchestra.run.smithi105.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.75649.log.gz 2024-09-21T03:28:09.501 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.72215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45781.log 2024-09-21T03:28:09.501 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.72215.log.gz 2024-09-21T03:28:09.501 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.74303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50602.log 2024-09-21T03:28:09.501 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.74303.log.gz 2024-09-21T03:28:09.501 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.45781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64507.log 2024-09-21T03:28:09.501 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45781.log.gz 2024-09-21T03:28:09.501 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.50602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46491.log 2024-09-21T03:28:09.501 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50602.log.gz 2024-09-21T03:28:09.501 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.64507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52609.log 2024-09-21T03:28:09.501 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.64507.log.gz 2024-09-21T03:28:09.501 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.46491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46449.log 2024-09-21T03:28:09.501 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46491.log.gz 2024-09-21T03:28:09.501 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.52609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53838.log 2024-09-21T03:28:09.501 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52609.log.gz 2024-09-21T03:28:09.501 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.46449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72257.log 2024-09-21T03:28:09.502 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46449.log.gz 2024-09-21T03:28:09.502 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.53838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46659.log 2024-09-21T03:28:09.502 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53838.log.gz 2024-09-21T03:28:09.502 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47211.log 2024-09-21T03:28:09.502 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.72257.log: /var/log/ceph/ceph-client.admin.46659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53796.log 2024-09-21T03:28:09.502 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.72257.log.gz 2024-09-21T03:28:09.502 INFO:teuthology.orchestra.run.smithi105.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46659.log.gz 2024-09-21T03:28:09.502 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.47211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71439.log 2024-09-21T03:28:09.502 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47211.log.gz 2024-09-21T03:28:09.502 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50205.log 2024-09-21T03:28:09.502 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.53796.log: /var/log/ceph/ceph-client.admin.71439.log: 87.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.53796.log.gz 2024-09-21T03:28:09.502 INFO:teuthology.orchestra.run.smithi105.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.36272.log 2024-09-21T03:28:09.502 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.71439.log.gz 2024-09-21T03:28:09.502 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.50205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64273.log 2024-09-21T03:28:09.503 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50205.log.gz 2024-09-21T03:28:09.503 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57590.log 2024-09-21T03:28:09.503 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.36272.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36272.log.gz 2024-09-21T03:28:09.503 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53754.log 2024-09-21T03:28:09.503 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.64273.log: /var/log/ceph/ceph-client.admin.57590.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.64273.log.gz 2024-09-21T03:28:09.503 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59602.log 2024-09-21T03:28:09.503 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57590.log.gz 2024-09-21T03:28:09.503 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47253.log 2024-09-21T03:28:09.503 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.53754.log: /var/log/ceph/ceph-client.admin.59602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70810.log 2024-09-21T03:28:09.503 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53754.log.gz 2024-09-21T03:28:09.503 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59602.log.gz 2024-09-21T03:28:09.503 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.47253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72807.log 2024-09-21T03:28:09.503 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47253.log.gz 2024-09-21T03:28:09.503 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62602.log 2024-09-21T03:28:09.504 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.0.70810.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.70810.log.gz 2024-09-21T03:28:09.504 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.72807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62912.log 2024-09-21T03:28:09.504 INFO:teuthology.orchestra.run.smithi105.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.72807.log.gz 2024-09-21T03:28:09.504 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.62602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44192.log 2024-09-21T03:28:09.504 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62602.log.gz 2024-09-21T03:28:09.504 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56503.log 2024-09-21T03:28:09.504 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.62912.log: /var/log/ceph/ceph-client.admin.44192.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.62912.log.gz 2024-09-21T03:28:09.504 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50387.log 2024-09-21T03:28:09.504 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44192.log.gz 2024-09-21T03:28:09.504 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74077.log 2024-09-21T03:28:09.504 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.56503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53482.log 2024-09-21T03:28:09.504 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.50387.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56503.log.gz 2024-09-21T03:28:09.504 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.74077.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50387.log.gz 2024-09-21T03:28:09.504 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63243.log 2024-09-21T03:28:09.504 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.74077.log.gz 2024-09-21T03:28:09.505 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51785.log 2024-09-21T03:28:09.505 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.53482.log: /var/log/ceph/ceph-client.admin.63243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67859.log 2024-09-21T03:28:09.505 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53482.log.gz 2024-09-21T03:28:09.505 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.51785.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63243.log.gz 2024-09-21T03:28:09.505 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45165.log 2024-09-21T03:28:09.505 INFO:teuthology.orchestra.run.smithi105.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51785.log.gz 2024-09-21T03:28:09.505 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.67859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72341.log 2024-09-21T03:28:09.505 INFO:teuthology.orchestra.run.smithi105.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.67859.log.gz 2024-09-21T03:28:09.505 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64945.log 2024-09-21T03:28:09.505 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.0.45165.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45165.log.gz 2024-09-21T03:28:09.505 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.72341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64695.log 2024-09-21T03:28:09.505 INFO:teuthology.orchestra.run.smithi105.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.72341.log.gz 2024-09-21T03:28:09.505 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.64945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48919.log 2024-09-21T03:28:09.505 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64945.log.gz 2024-09-21T03:28:09.505 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64189.log 2024-09-21T03:28:09.506 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.0.64695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.64695.log.gz 2024-09-21T03:28:09.506 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.48919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36355.log 2024-09-21T03:28:09.506 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.64189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36499.log 2024-09-21T03:28:09.506 INFO:teuthology.orchestra.run.smithi105.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.48919.log.gz 2024-09-21T03:28:09.506 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.64189.log.gz 2024-09-21T03:28:09.506 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.36355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48857.log 2024-09-21T03:28:09.506 INFO:teuthology.orchestra.run.smithi105.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.36355.log.gz 2024-09-21T03:28:09.506 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58074.log 2024-09-21T03:28:09.506 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.36499.log: /var/log/ceph/ceph-client.admin.48857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44641.log 2024-09-21T03:28:09.506 INFO:teuthology.orchestra.run.smithi105.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36499.log.gz 2024-09-21T03:28:09.506 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48857.log.gz 2024-09-21T03:28:09.506 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.58074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54788.log 2024-09-21T03:28:09.506 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58074.log.gz 2024-09-21T03:28:09.507 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70220.log 2024-09-21T03:28:09.507 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.44641.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44641.log.gz 2024-09-21T03:28:09.507 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.54788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56084.log 2024-09-21T03:28:09.507 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54788.log.gz 2024-09-21T03:28:09.507 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60271.log 2024-09-21T03:28:09.507 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.70220.log: /var/log/ceph/ceph-client.admin.56084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71186.log 2024-09-21T03:28:09.507 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.70220.log.gz 2024-09-21T03:28:09.507 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.60271.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.56084.log.gz 2024-09-21T03:28:09.507 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65827.log 2024-09-21T03:28:09.507 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60271.log.gz 2024-09-21T03:28:09.507 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.71186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63327.log 2024-09-21T03:28:09.507 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.71186.log.gz 2024-09-21T03:28:09.507 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73245.log 2024-09-21T03:28:09.507 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.65827.log: /var/log/ceph/ceph-client.admin.63327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53654.log 2024-09-21T03:28:09.507 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.65827.log.gz 2024-09-21T03:28:09.508 INFO:teuthology.orchestra.run.smithi105.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.63327.log.gz 2024-09-21T03:28:09.508 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.73245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56984.log 2024-09-21T03:28:09.508 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.73245.log.gz 2024-09-21T03:28:09.508 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74851.log 2024-09-21T03:28:09.508 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.53654.log: /var/log/ceph/ceph-client.admin.56984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54832.log 2024-09-21T03:28:09.508 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53654.log.gz 2024-09-21T03:28:09.508 INFO:teuthology.orchestra.run.smithi105.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56984.log.gz 2024-09-21T03:28:09.508 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.74851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59770.log 2024-09-21T03:28:09.508 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.74851.log.gz 2024-09-21T03:28:09.508 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68869.log 2024-09-21T03:28:09.508 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.54832.log: /var/log/ceph/ceph-client.admin.59770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46204.log 2024-09-21T03:28:09.508 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54832.log.gz 2024-09-21T03:28:09.508 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59770.log.gz 2024-09-21T03:28:09.508 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.68869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50429.log 2024-09-21T03:28:09.509 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.68869.log.gz 2024-09-21T03:28:09.509 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51659.log 2024-09-21T03:28:09.509 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.46204.log: /var/log/ceph/ceph-client.admin.50429.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46204.log.gz 2024-09-21T03:28:09.509 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64819.log 2024-09-21T03:28:09.509 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50429.log.gz 2024-09-21T03:28:09.509 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75523.log 2024-09-21T03:28:09.509 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.51659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47942.log 2024-09-21T03:28:09.509 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.64819.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51659.log.gz 2024-09-21T03:28:09.509 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.75523.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64819.log.gz 2024-09-21T03:28:09.509 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60481.log 2024-09-21T03:28:09.509 INFO:teuthology.orchestra.run.smithi105.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.75523.log.gz 2024-09-21T03:28:09.509 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55013.log 2024-09-21T03:28:09.509 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.47942.log: /var/log/ceph/ceph-client.admin.60481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57324.log 2024-09-21T03:28:09.509 INFO:teuthology.orchestra.run.smithi105.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47942.log.gz 2024-09-21T03:28:09.509 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60481.log.gz 2024-09-21T03:28:09.510 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.55013.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-21T03:28:09.510 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55013.log.gz 2024-09-21T03:28:09.510 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.57324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64861.log 2024-09-21T03:28:09.510 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57324.log.gz 2024-09-21T03:28:09.510 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65179.log 2024-09-21T03:28:09.510 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.64861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70262.log 2024-09-21T03:28:09.510 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.64861.log.gz 2024-09-21T03:28:09.510 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.65179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51475.log 2024-09-21T03:28:09.510 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.65179.log.gz 2024-09-21T03:28:09.510 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60397.log 2024-09-21T03:28:09.510 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.70262.log: /var/log/ceph/ceph-client.admin.51475.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.70262.log.gz 2024-09-21T03:28:09.510 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63285.log 2024-09-21T03:28:09.510 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51475.log.gz 2024-09-21T03:28:09.510 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.60397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57762.log 2024-09-21T03:28:09.511 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.60397.log.gz 2024-09-21T03:28:09.511 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.63285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63057.log 2024-09-21T03:28:09.511 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.63285.log.gz 2024-09-21T03:28:09.511 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.57762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61450.log 2024-09-21T03:28:09.511 INFO:teuthology.orchestra.run.smithi105.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.57762.log.gz 2024-09-21T03:28:09.511 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73823.log 2024-09-21T03:28:09.511 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.63057.log: /var/log/ceph/ceph-client.admin.61450.log: gzip -5 --verbose -- 87.6% /var/log/ceph/ceph-client.admin.61841.log 2024-09-21T03:28:09.511 INFO:teuthology.orchestra.run.smithi105.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63057.log.gz 2024-09-21T03:28:09.511 INFO:teuthology.orchestra.run.smithi105.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.61450.log.gz 2024-09-21T03:28:09.511 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.0.73823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58374.log 2024-09-21T03:28:09.511 INFO:teuthology.orchestra.run.smithi105.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.73823.log.gz 2024-09-21T03:28:09.511 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69223.log 2024-09-21T03:28:09.511 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.61841.log: /var/log/ceph/ceph-client.0.58374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55097.log 2024-09-21T03:28:09.511 INFO:teuthology.orchestra.run.smithi105.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.58374.log.gz 2024-09-21T03:28:09.511 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.61841.log.gz 2024-09-21T03:28:09.512 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.69223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72896.log 2024-09-21T03:28:09.512 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.55097.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.69223.log.gz 2024-09-21T03:28:09.512 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47467.log 2024-09-21T03:28:09.512 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55097.log.gz 2024-09-21T03:28:09.512 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.72896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57720.log 2024-09-21T03:28:09.512 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.72896.log.gz 2024-09-21T03:28:09.512 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.47467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66690.log 2024-09-21T03:28:09.512 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47467.log.gz/var/log/ceph/ceph-client.admin.57720.log: 2024-09-21T03:28:09.512 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71618.log 2024-09-21T03:28:09.512 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57720.log.gz 2024-09-21T03:28:09.512 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.66690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55811.log 2024-09-21T03:28:09.512 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.66690.log.gz 2024-09-21T03:28:09.512 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.71618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71379.log 2024-09-21T03:28:09.512 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.71618.log.gz 2024-09-21T03:28:09.513 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.55811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65869.log 2024-09-21T03:28:09.513 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55811.log.gz 2024-09-21T03:28:09.513 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73455.log 2024-09-21T03:28:09.513 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.71379.log: /var/log/ceph/ceph-client.admin.65869.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.71379.log.gz 2024-09-21T03:28:09.513 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43851.log 2024-09-21T03:28:09.513 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.65869.log.gz 2024-09-21T03:28:09.513 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69670.log 2024-09-21T03:28:09.513 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.73455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50714.log 2024-09-21T03:28:09.513 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.43851.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.73455.log.gz 2024-09-21T03:28:09.513 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.69670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61021.log 2024-09-21T03:28:09.513 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43851.log.gz 2024-09-21T03:28:09.513 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.69670.log.gz 2024-09-21T03:28:09.513 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.50714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65366.log 2024-09-21T03:28:09.513 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50714.log.gz 2024-09-21T03:28:09.513 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75229.log 2024-09-21T03:28:09.514 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.61021.log: /var/log/ceph/ceph-client.admin.65366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42554.log 2024-09-21T03:28:09.514 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61021.log.gz 2024-09-21T03:28:09.514 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.65366.log.gz 2024-09-21T03:28:09.514 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.75229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36707.log 2024-09-21T03:28:09.514 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.75229.log.gz 2024-09-21T03:28:09.514 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.42554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75061.log 2024-09-21T03:28:09.514 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54498.log 2024-09-21T03:28:09.514 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42554.log.gz 2024-09-21T03:28:09.514 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.36707.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.36707.log.gz 2024-09-21T03:28:09.514 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.75061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52014.log 2024-09-21T03:28:09.514 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65785.log 2024-09-21T03:28:09.514 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.75061.log.gz 2024-09-21T03:28:09.514 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.54498.log: /var/log/ceph/ceph-client.admin.52014.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54498.log.gz 2024-09-21T03:28:09.515 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43856.log 2024-09-21T03:28:09.515 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52014.log.gz 2024-09-21T03:28:09.515 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36682.log 2024-09-21T03:28:09.515 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.65785.log: /var/log/ceph/ceph-client.admin.43856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53404.log 2024-09-21T03:28:09.515 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.65785.log.gz 2024-09-21T03:28:09.515 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43856.log.gz 2024-09-21T03:28:09.515 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.36682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61799.log 2024-09-21T03:28:09.515 INFO:teuthology.orchestra.run.smithi105.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.36682.log.gz 2024-09-21T03:28:09.515 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47084.log 2024-09-21T03:28:09.515 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.0.53404.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.53404.log.gz 2024-09-21T03:28:09.515 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.61799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62702.log 2024-09-21T03:28:09.515 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.61799.log.gz 2024-09-21T03:28:09.515 INFO:teuthology.orchestra.run.smithi105.stderr:gzip/var/log/ceph/ceph-client.admin.47084.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.70052.log 2024-09-21T03:28:09.515 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.62702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73119.log 2024-09-21T03:28:09.515 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47084.log.gz 2024-09-21T03:28:09.516 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.70052.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62702.log.gz 2024-09-21T03:28:09.516 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51033.log 2024-09-21T03:28:09.516 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.70052.log.gz 2024-09-21T03:28:09.516 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.73119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63015.log 2024-09-21T03:28:09.516 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.73119.log.gz 2024-09-21T03:28:09.516 INFO:teuthology.orchestra.run.smithi105.stderr:gzip/var/log/ceph/ceph-client.admin.51033.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.59043.log 2024-09-21T03:28:09.516 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.63015.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51033.log.gz 2024-09-21T03:28:09.516 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56816.log 2024-09-21T03:28:09.516 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.63015.log.gz 2024-09-21T03:28:09.516 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.59043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53146.log 2024-09-21T03:28:09.516 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.59043.log.gzgzip 2024-09-21T03:28:09.516 INFO:teuthology.orchestra.run.smithi105.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.54361.log 2024-09-21T03:28:09.516 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.56816.log: /var/log/ceph/ceph-client.admin.53146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68785.log 2024-09-21T03:28:09.516 INFO:teuthology.orchestra.run.smithi105.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.56816.log.gz 2024-09-21T03:28:09.516 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.54361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71337.log 91.1% -- replaced with /var/log/ceph/ceph-client.admin.53146.log.gz 2024-09-21T03:28:09.517 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54361.log.gz 2024-09-21T03:28:09.517 INFO:teuthology.orchestra.run.smithi105.stderr: 2024-09-21T03:28:09.517 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.68785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75397.log 2024-09-21T03:28:09.517 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.68785.log.gz 2024-09-21T03:28:09.517 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.71337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57201.log 2024-09-21T03:28:09.517 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.75397.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.71337.log.gz 2024-09-21T03:28:09.517 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36676.log 2024-09-21T03:28:09.517 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.75397.log.gz 2024-09-21T03:28:09.517 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.57201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49781.log 2024-09-21T03:28:09.517 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71754.log 87.4% 2024-09-21T03:28:09.517 INFO:teuthology.orchestra.run.smithi105.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57201.log.gz 2024-09-21T03:28:09.517 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.36676.log: /var/log/ceph/ceph-client.admin.49781.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.36676.log.gz 2024-09-21T03:28:09.517 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48530.log 2024-09-21T03:28:09.517 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49781.log.gz 2024-09-21T03:28:09.518 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-21T03:28:09.518 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.71754.log: /var/log/ceph/ceph-client.admin.48530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44181.log 2024-09-21T03:28:09.518 INFO:teuthology.orchestra.run.smithi105.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.71754.log.gz 2024-09-21T03:28:09.518 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-mon.a.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48530.log.gz 2024-09-21T03:28:09.518 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42731.log 2024-09-21T03:28:09.518 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.44181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44185.log 2024-09-21T03:28:09.518 INFO:teuthology.orchestra.run.smithi105.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.44181.log.gz 2024-09-21T03:28:09.518 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.42731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75481.log 2024-09-21T03:28:09.518 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42731.log.gz 2024-09-21T03:28:09.518 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.44185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71696.log 2024-09-21T03:28:09.518 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44185.log.gz 2024-09-21T03:28:09.518 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.75481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60564.log 2024-09-21T03:28:09.518 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.75481.log.gz 2024-09-21T03:28:09.518 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.71696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43003.log 2024-09-21T03:28:09.519 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.71696.log.gz 2024-09-21T03:28:09.519 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.60564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75355.log 2024-09-21T03:28:09.519 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.60564.log.gz 2024-09-21T03:28:09.519 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.43003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68743.log 2024-09-21T03:28:09.519 INFO:teuthology.orchestra.run.smithi105.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.43003.log.gz 2024-09-21T03:28:09.519 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.75355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60769.log 2024-09-21T03:28:09.519 INFO:teuthology.orchestra.run.smithi105.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.75355.log.gz 2024-09-21T03:28:09.519 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.68743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54067.log 2024-09-21T03:28:09.519 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68743.log.gz 2024-09-21T03:28:09.519 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.60769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57548.log 2024-09-21T03:28:09.519 INFO:teuthology.orchestra.run.smithi105.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.60769.log.gz 2024-09-21T03:28:09.519 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.54067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50250.log 2024-09-21T03:28:09.519 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54067.log.gz 2024-09-21T03:28:09.519 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.57548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43675.log 2024-09-21T03:28:09.519 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57548.log.gz 2024-09-21T03:28:09.520 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.50250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56690.log 2024-09-21T03:28:09.520 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50250.log.gz 2024-09-21T03:28:09.520 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.43675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46702.log 2024-09-21T03:28:09.520 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43675.log.gz 2024-09-21T03:28:09.520 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.56690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59872.log 2024-09-21T03:28:09.520 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56690.log.gz 2024-09-21T03:28:09.520 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.46702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64903.log 2024-09-21T03:28:09.520 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46702.log.gz 2024-09-21T03:28:09.520 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.59872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52399.log 2024-09-21T03:28:09.520 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59872.log.gz/var/log/ceph/ceph-client.admin.64903.log: 2024-09-21T03:28:09.520 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67127.log 2024-09-21T03:28:09.520 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64903.log.gz 2024-09-21T03:28:09.520 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.52399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59998.log 2024-09-21T03:28:09.520 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52399.log.gz 2024-09-21T03:28:09.521 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.67127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57990.log 2024-09-21T03:28:09.521 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.67127.log.gz 2024-09-21T03:28:09.521 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.59998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62954.log 2024-09-21T03:28:09.521 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.59998.log.gz 2024-09-21T03:28:09.521 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.57990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66862.log 2024-09-21T03:28:09.521 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.57990.log.gz 2024-09-21T03:28:09.521 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.62954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42635.log 2024-09-21T03:28:09.521 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.62954.log.gz 2024-09-21T03:28:09.521 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.66862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67901.log 2024-09-21T03:28:09.521 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.66862.log.gz 2024-09-21T03:28:09.521 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.42635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67781.log 2024-09-21T03:28:09.521 INFO:teuthology.orchestra.run.smithi105.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42635.log.gz 2024-09-21T03:28:09.521 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.67901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47126.log 2024-09-21T03:28:09.521 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67901.log.gz 2024-09-21T03:28:09.521 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.0.67781.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.67781.log.gz 2024-09-21T03:28:09.522 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47602.log 2024-09-21T03:28:09.522 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.47126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44191.log 2024-09-21T03:28:09.522 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47126.log.gz 2024-09-21T03:28:09.522 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.47602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70094.log 2024-09-21T03:28:09.522 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47602.log.gz 2024-09-21T03:28:09.522 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.44191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43841.log 2024-09-21T03:28:09.522 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4%/var/log/ceph/ceph-client.admin.70094.log: -- replaced with /var/log/ceph/ceph-client.admin.44191.log.gz 2024-09-21T03:28:09.522 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57636.log 2024-09-21T03:28:09.522 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.70094.log.gz 2024-09-21T03:28:09.522 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.43841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70010.log 2024-09-21T03:28:09.522 INFO:teuthology.orchestra.run.smithi105.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43841.log.gz 2024-09-21T03:28:09.522 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.57636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53880.log 2024-09-21T03:28:09.522 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.70010.log: gzip 87.1% -- replaced with /var/log/ceph/ceph-client.admin.57636.log.gz 2024-09-21T03:28:09.522 INFO:teuthology.orchestra.run.smithi105.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46617.log 2024-09-21T03:28:09.523 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.70010.log.gz 2024-09-21T03:28:09.523 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.53880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47858.log 2024-09-21T03:28:09.523 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53880.log.gz 2024-09-21T03:28:09.523 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65450.log 2024-09-21T03:28:09.523 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.46617.log: /var/log/ceph/ceph-client.admin.47858.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46617.log.gz 2024-09-21T03:28:09.523 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69391.log 2024-09-21T03:28:09.523 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.65450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50294.log 2024-09-21T03:28:09.523 INFO:teuthology.orchestra.run.smithi105.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47858.log.gz 2024-09-21T03:28:09.523 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.65450.log.gz 2024-09-21T03:28:09.523 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.69391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69036.log 2024-09-21T03:28:09.523 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69265.log 2024-09-21T03:28:09.523 INFO:teuthology.orchestra.run.smithi105.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69391.log.gz 2024-09-21T03:28:09.523 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.50294.log: /var/log/ceph/ceph-client.admin.69036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57366.log 2024-09-21T03:28:09.523 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50294.log.gz 2024-09-21T03:28:09.524 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.69036.log.gz 2024-09-21T03:28:09.524 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-21T03:28:09.524 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.69265.log: /var/log/ceph/ceph-client.admin.57366.log: gzip -5 87.5% -- replaced with /var/log/ceph/ceph-client.admin.69265.log.gz 2024-09-21T03:28:09.524 INFO:teuthology.orchestra.run.smithi105.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48068.log 2024-09-21T03:28:09.524 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57366.log.gz 2024-09-21T03:28:09.524 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75607.log 2024-09-21T03:28:09.524 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.48068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74000.log 2024-09-21T03:28:09.524 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48068.log.gz 2024-09-21T03:28:09.524 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.75607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75145.log 2024-09-21T03:28:09.524 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.75607.log.gz 2024-09-21T03:28:09.524 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.74000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48026.log 2024-09-21T03:28:09.524 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.74000.log.gz 2024-09-21T03:28:09.524 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.75145.log: -- /var/log/ceph/ceph-client.admin.54925.log 2024-09-21T03:28:09.524 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.48026.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.75145.log.gz 2024-09-21T03:28:09.524 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42873.log 2024-09-21T03:28:09.525 INFO:teuthology.orchestra.run.smithi105.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48026.log.gz 2024-09-21T03:28:09.525 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49342.log 2024-09-21T03:28:09.525 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.54925.log: /var/log/ceph/ceph-client.admin.42873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46051.log 2024-09-21T03:28:09.525 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7%/var/log/ceph/ceph-client.admin.49342.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42873.log.gz 2024-09-21T03:28:09.525 INFO:teuthology.orchestra.run.smithi105.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54925.log.gz 2024-09-21T03:28:09.525 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75749.log 2024-09-21T03:28:09.525 INFO:teuthology.orchestra.run.smithi105.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49342.log.gz 2024-09-21T03:28:09.525 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.46051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75019.log 2024-09-21T03:28:09.525 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46051.log.gz 2024-09-21T03:28:09.525 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50559.log 2024-09-21T03:28:09.525 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.75749.log: /var/log/ceph/ceph-client.admin.75019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73497.log 2024-09-21T03:28:09.525 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.75019.log.gz 87.9% -- replaced with /var/log/ceph/ceph-client.admin.75749.log.gz 2024-09-21T03:28:09.525 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.50559.log: 2024-09-21T03:28:09.525 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50559.log.gz 2024-09-21T03:28:09.526 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74935.log 2024-09-21T03:28:09.526 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.73497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61589.log 2024-09-21T03:28:09.526 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.73497.log.gz 2024-09-21T03:28:09.526 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.74935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52960.log 87.7% -- replaced with /var/log/ceph/ceph-client.admin.74935.log.gz 2024-09-21T03:28:09.526 INFO:teuthology.orchestra.run.smithi105.stderr: 2024-09-21T03:28:09.526 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.61589.log: gzip -5 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61589.log.gz 2024-09-21T03:28:09.526 INFO:teuthology.orchestra.run.smithi105.stderr: --verbose -- /var/log/ceph/ceph-client.admin.53712.log 2024-09-21T03:28:09.526 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.52960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71060.log 2024-09-21T03:28:09.526 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52960.log.gz 2024-09-21T03:28:09.526 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.53712.log: gzip -5 --verbose -- 87.7% /var/log/ceph/ceph-client.admin.53086.log 2024-09-21T03:28:09.526 INFO:teuthology.orchestra.run.smithi105.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53712.log.gz 2024-09-21T03:28:09.526 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.71060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62351.log 2024-09-21T03:28:09.526 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.71060.log.gz 2024-09-21T03:28:09.526 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70814.log 2024-09-21T03:28:09.526 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.53086.log: /var/log/ceph/ceph-client.0.62351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65305.log 2024-09-21T03:28:09.527 INFO:teuthology.orchestra.run.smithi105.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.62351.log.gz 2024-09-21T03:28:09.527 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.0.70814.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53086.log.gz 2024-09-21T03:28:09.527 INFO:teuthology.orchestra.run.smithi105.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.70814.log.gz 2024-09-21T03:28:09.527 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43633.log 2024-09-21T03:28:09.527 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.65305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66036.log 2024-09-21T03:28:09.527 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65305.log.gz/var/log/ceph/ceph-client.admin.43633.log: 2024-09-21T03:28:09.527 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66732.log 2024-09-21T03:28:09.527 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43633.log.gz 2024-09-21T03:28:09.527 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71144.log 2024-09-21T03:28:09.527 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.66036.log: /var/log/ceph/ceph-client.admin.66732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63159.log 2024-09-21T03:28:09.527 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.66732.log.gz 87.4% -- replaced with /var/log/ceph/ceph-client.admin.66036.log.gz 2024-09-21T03:28:09.527 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.71144.log: 2024-09-21T03:28:09.527 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.71144.log.gz 2024-09-21T03:28:09.527 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61757.log 2024-09-21T03:28:09.528 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.63159.log: /var/log/ceph/ceph-client.admin.70622.log 2024-09-21T03:28:09.528 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.61757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43213.log 2024-09-21T03:28:09.528 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63159.log.gz 2024-09-21T03:28:09.528 INFO:teuthology.orchestra.run.smithi105.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.61757.log.gz 2024-09-21T03:28:09.528 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.70622.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-21T03:28:09.528 INFO:teuthology.orchestra.run.smithi105.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.70622.log.gz 2024-09-21T03:28:09.528 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.43213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47518.log 2024-09-21T03:28:09.528 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-mgr.y.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43213.log.gz 2024-09-21T03:28:09.528 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68953.log 2024-09-21T03:28:09.528 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48795.log 2024-09-21T03:28:09.528 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.47518.log: /var/log/ceph/ceph-client.admin.68953.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47518.log.gz 2024-09-21T03:28:09.528 INFO:teuthology.orchestra.run.smithi105.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.68953.log.gz 2024-09-21T03:28:09.528 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74574.log 2024-09-21T03:28:09.528 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.48795.log: gzip 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48795.log.gz 2024-09-21T03:28:09.528 INFO:teuthology.orchestra.run.smithi105.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49655.log 2024-09-21T03:28:09.529 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.74574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55181.log 2024-09-21T03:28:09.529 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.74574.log.gz 2024-09-21T03:28:09.529 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.49655.log: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48368.log 2024-09-21T03:28:09.529 INFO:teuthology.orchestra.run.smithi105.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49655.log.gz 2024-09-21T03:28:09.529 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.55181.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.55181.log.gz 2024-09-21T03:28:09.529 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72047.log 2024-09-21T03:28:09.529 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52918.log 2024-09-21T03:28:09.529 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.72047.log: /var/log/ceph/ceph-client.0.48368.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48368.log.gz 2024-09-21T03:28:09.529 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44473.log 2024-09-21T03:28:09.529 INFO:teuthology.orchestra.run.smithi105.stderr: -- replaced with /var/log/ceph/ceph-client.admin.72047.log.gz 2024-09-21T03:28:09.529 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.52918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58032.log 2024-09-21T03:28:09.529 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.44473.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52918.log.gz 2024-09-21T03:28:09.529 INFO:teuthology.orchestra.run.smithi105.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44473.log.gz 2024-09-21T03:28:09.529 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57678.log 2024-09-21T03:28:09.530 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.58032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74177.log 86.8% -- replaced with /var/log/ceph/ceph-client.admin.58032.log.gz 2024-09-21T03:28:09.530 INFO:teuthology.orchestra.run.smithi105.stderr: 2024-09-21T03:28:09.530 INFO:teuthology.orchestra.run.smithi105.stderr:gzip/var/log/ceph/ceph-client.admin.57678.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49739.log 2024-09-21T03:28:09.530 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57678.log.gz 2024-09-21T03:28:09.530 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.74177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58812.log 2024-09-21T03:28:09.530 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.49739.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.74177.log.gz 2024-09-21T03:28:09.530 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70514.log 2024-09-21T03:28:09.530 INFO:teuthology.orchestra.run.smithi105.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49739.log.gz 2024-09-21T03:28:09.530 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51575.log 2024-09-21T03:28:09.530 INFO:teuthology.orchestra.run.smithi105.stderr: 94.1% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz/var/log/ceph/ceph-client.admin.70514.log: /var/log/ceph/ceph-client.admin.58812.log: 2024-09-21T03:28:09.530 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% 87.6% -- replaced with /var/log/ceph/ceph-client.admin.70514.log.gz 2024-09-21T03:28:09.530 INFO:teuthology.orchestra.run.smithi105.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58812.log.gz 2024-09-21T03:28:09.530 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62051.log 2024-09-21T03:28:09.530 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log/var/log/ceph/ceph-client.admin.51575.log: 2024-09-21T03:28:09.531 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.62051.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51575.log.gz 2024-09-21T03:28:09.531 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55265.log 2024-09-21T03:28:09.531 INFO:teuthology.orchestra.run.smithi105.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.62051.log.gz 2024-09-21T03:28:09.531 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54578.log 2024-09-21T03:28:09.531 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.55265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47379.log 2024-09-21T03:28:09.531 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.54578.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55265.log.gz 2024-09-21T03:28:09.531 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45160.log 2024-09-21T03:28:09.531 INFO:teuthology.orchestra.run.smithi105.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54578.log.gz 2024-09-21T03:28:09.531 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.47379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64777.log 2024-09-21T03:28:09.531 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4%/var/log/ceph/ceph-client.0.45160.log: -- replaced with /var/log/ceph/ceph-client.admin.47379.log.gz 2024-09-21T03:28:09.531 INFO:teuthology.orchestra.run.smithi105.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45160.log.gz 2024-09-21T03:28:09.531 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67337.log 2024-09-21T03:28:09.531 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.64777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57906.log 2024-09-21T03:28:09.531 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64777.log.gz 2024-09-21T03:28:09.531 INFO:teuthology.orchestra.run.smithi105.stderr: 87.0%/var/log/ceph/ceph-client.admin.67337.log: -- replaced with /var/log/ceph/ceph.log.gz 2024-09-21T03:28:09.532 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67523.log 2024-09-21T03:28:09.532 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67337.log.gz 2024-09-21T03:28:09.532 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.57906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45739.log 2024-09-21T03:28:09.532 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7%/var/log/ceph/ceph-client.admin.67523.log: -- replaced with /var/log/ceph/ceph-client.admin.57906.log.gz 2024-09-21T03:28:09.532 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43855.log 2024-09-21T03:28:09.532 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59457.log 2024-09-21T03:28:09.532 INFO:teuthology.orchestra.run.smithi105.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.67523.log.gz 2024-09-21T03:28:09.532 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.45739.log: /var/log/ceph/ceph-client.admin.43855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52653.log 2024-09-21T03:28:09.532 INFO:teuthology.orchestra.run.smithi105.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45739.log.gz 2024-09-21T03:28:09.532 INFO:teuthology.orchestra.run.smithi105.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.43855.log.gz 2024-09-21T03:28:09.532 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.59457.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59457.log.gz 2024-09-21T03:28:09.532 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72383.log 2024-09-21T03:28:09.532 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67169.log/var/log/ceph/ceph-client.admin.52653.log: 2024-09-21T03:28:09.532 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.72383.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52653.log.gz 2024-09-21T03:28:09.533 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73161.log 2024-09-21T03:28:09.533 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.72383.log.gz 2024-09-21T03:28:09.533 INFO:teuthology.orchestra.run.smithi105.stderr:gzip/var/log/ceph/ceph-client.admin.67169.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.44183.log 2024-09-21T03:28:09.533 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.73161.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.67169.log.gz 2024-09-21T03:28:09.533 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65953.log 2024-09-21T03:28:09.533 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.73161.log.gz 2024-09-21T03:28:09.533 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.44183.log: gzip 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44183.log.gz 2024-09-21T03:28:09.533 INFO:teuthology.orchestra.run.smithi105.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53212.log 2024-09-21T03:28:09.533 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.65953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52098.log 2024-09-21T03:28:09.533 INFO:teuthology.orchestra.run.smithi105.stderr: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.65953.log.gz 2024-09-21T03:28:09.533 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.53212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63544.log 2024-09-21T03:28:09.533 INFO:teuthology.orchestra.run.smithi105.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53212.log.gz 2024-09-21T03:28:09.533 INFO:teuthology.orchestra.run.smithi105.stderr:gzip/var/log/ceph/ceph-client.admin.52098.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49216.log 2024-09-21T03:28:09.533 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.63544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72089.log 2024-09-21T03:28:09.533 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52098.log.gz 2024-09-21T03:28:09.534 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55729.log 2024-09-21T03:28:09.534 INFO:teuthology.orchestra.run.smithi105.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63544.log.gz 2024-09-21T03:28:09.534 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.49216.log: /var/log/ceph/ceph-client.admin.72089.log: 87.7% 87.3% -- replaced with /var/log/ceph/ceph-client.admin.72089.log.gz -- replaced with /var/log/ceph/ceph-client.admin.49216.log.gz 2024-09-21T03:28:09.534 INFO:teuthology.orchestra.run.smithi105.stderr: 2024-09-21T03:28:09.534 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67943.log 2024-09-21T03:28:09.534 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.0.55729.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.0.55729.log.gz 2024-09-21T03:28:09.534 INFO:teuthology.orchestra.run.smithi105.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.54744.log 2024-09-21T03:28:09.534 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.67943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66608.log 2024-09-21T03:28:09.534 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67943.log.gz 2024-09-21T03:28:09.534 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.54744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36243.log 2024-09-21T03:28:09.534 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54744.log.gz 2024-09-21T03:28:09.534 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5/var/log/ceph/ceph-client.admin.66608.log: --verbose -- /var/log/ceph/ceph-client.admin.59313.log 2024-09-21T03:28:09.534 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.36243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49426.log 2024-09-21T03:28:09.535 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.66608.log.gz 2024-09-21T03:28:09.535 INFO:teuthology.orchestra.run.smithi105.stderr: 76.4% -- replaced with /var/log/ceph/ceph-client.admin.36243.log.gz 2024-09-21T03:28:09.535 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61883.log 2024-09-21T03:28:09.535 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.59313.log: /var/log/ceph/ceph-client.admin.49426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52140.log 2024-09-21T03:28:09.535 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.61883.log: 86.9% 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49426.log.gz 2024-09-21T03:28:09.535 INFO:teuthology.orchestra.run.smithi105.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59313.log.gz 2024-09-21T03:28:09.535 INFO:teuthology.orchestra.run.smithi105.stderr:gzip 87.4% -5 --verbose -- /var/log/ceph/ceph-client.admin.71102.log 2024-09-21T03:28:09.535 INFO:teuthology.orchestra.run.smithi105.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61883.log.gz 2024-09-21T03:28:09.535 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.52140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75439.log 2024-09-21T03:28:09.535 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52140.log.gz 2024-09-21T03:28:09.535 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.71102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50665.log 2024-09-21T03:28:09.535 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.71102.log.gz 2024-09-21T03:28:09.535 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59373.log 2024-09-21T03:28:09.535 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.75439.log: /var/log/ceph/ceph-client.admin.50665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60979.log 2024-09-21T03:28:09.535 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.59373.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.75439.log.gz 2024-09-21T03:28:09.536 INFO:teuthology.orchestra.run.smithi105.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.50665.log.gz 2024-09-21T03:28:09.536 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59373.log.gz 2024-09-21T03:28:09.536 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65743.log 2024-09-21T03:28:09.536 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.60979.log: /var/log/ceph/ceph-client.0.53400.log 2024-09-21T03:28:09.536 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.65743.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.60979.log.gz 2024-09-21T03:28:09.536 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65565.log 2024-09-21T03:28:09.536 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65743.log.gz 2024-09-21T03:28:09.536 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.0.53400.log: -- /var/log/ceph/ceph-client.admin.65071.log 0.0% -- replaced with /var/log/ceph/ceph-client.0.53400.log.gz 2024-09-21T03:28:09.536 INFO:teuthology.orchestra.run.smithi105.stderr: 2024-09-21T03:28:09.536 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.65565.log: gzip -5 --verbose -- 87.4% -- replaced with /var/log/ceph/ceph-client.admin.65565.log.gz 2024-09-21T03:28:09.536 INFO:teuthology.orchestra.run.smithi105.stderr: /var/log/ceph/ceph-client.admin.60895.log 2024-09-21T03:28:09.536 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.65071.log: gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.65071.log.gz 2024-09-21T03:28:09.536 INFO:teuthology.orchestra.run.smithi105.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.64441.log 2024-09-21T03:28:09.536 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.60895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58578.log 2024-09-21T03:28:09.537 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.60895.log.gz/var/log/ceph/ceph-client.admin.64441.log: 2024-09-21T03:28:09.537 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56461.log 2024-09-21T03:28:09.537 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68069.log 2024-09-21T03:28:09.537 INFO:teuthology.orchestra.run.smithi105.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.64441.log.gz/var/log/ceph/ceph-client.admin.58578.log: 2024-09-21T03:28:09.537 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.56461.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58578.log.gz 2024-09-21T03:28:09.537 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59103.log 2024-09-21T03:28:09.537 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56461.log.gz 2024-09-21T03:28:09.537 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5/var/log/ceph/ceph-client.admin.68069.log: --verbose -- /var/log/ceph/ceph-client.admin.58494.log 2024-09-21T03:28:09.537 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.59103.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.68069.log.gz 2024-09-21T03:28:09.537 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66955.log 2024-09-21T03:28:09.537 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59103.log.gz 2024-09-21T03:28:09.537 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72989.log 2024-09-21T03:28:09.537 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.58494.log: /var/log/ceph/ceph-client.admin.66955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49697.log 2024-09-21T03:28:09.537 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.72989.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58494.log.gz 2024-09-21T03:28:09.537 INFO:teuthology.orchestra.run.smithi105.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.66955.log.gz 2024-09-21T03:28:09.538 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 88.2% -- replaced with /var/log/ceph/ceph-client.admin.72989.log.gz 2024-09-21T03:28:09.538 INFO:teuthology.orchestra.run.smithi105.stderr: --verbose -- /var/log/ceph/ceph-client.admin.75103.log 2024-09-21T03:28:09.538 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.49697.log: gzip -5 --verbose 87.7% -- /var/log/ceph/ceph-client.admin.66349.log 2024-09-21T03:28:09.538 INFO:teuthology.orchestra.run.smithi105.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49697.log.gz 2024-09-21T03:28:09.538 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.75103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47732.log 2024-09-21T03:28:09.538 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.75103.log.gz 2024-09-21T03:28:09.538 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71838.log 2024-09-21T03:28:09.538 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.66349.log: /var/log/ceph/ceph-client.admin.47732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43591.log 2024-09-21T03:28:09.538 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.71838.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.66349.log.gz 2024-09-21T03:28:09.538 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47732.log.gz 2024-09-21T03:28:09.538 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.71838.log.gz 2024-09-21T03:28:09.538 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44189.log 2024-09-21T03:28:09.538 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36216.log/var/log/ceph/ceph-client.admin.43591.log: 2024-09-21T03:28:09.538 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.44189.log: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73827.log 2024-09-21T03:28:09.539 INFO:teuthology.orchestra.run.smithi105.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43591.log.gz 2024-09-21T03:28:09.539 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44189.log.gz 2024-09-21T03:28:09.539 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.36216.log: gzip -5 --verbose -- 78.8% -- replaced with /var/log/ceph/ceph-client.admin.36216.log.gz 2024-09-21T03:28:09.539 INFO:teuthology.orchestra.run.smithi105.stderr: /var/log/ceph/ceph-client.admin.55223.log 2024-09-21T03:28:09.539 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.0.73827.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.73827.log.gz 2024-09-21T03:28:09.539 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74345.log 2024-09-21T03:28:09.539 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.55223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50883.log 2024-09-21T03:28:09.539 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55223.log.gz 2024-09-21T03:28:09.539 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.74345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68261.log 2024-09-21T03:28:09.539 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.74345.log.gz 2024-09-21T03:28:09.539 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.50883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58620.log 2024-09-21T03:28:09.539 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50883.log.gz 2024-09-21T03:28:09.539 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.68261.log: -- /var/log/ceph/ceph-client.admin.52182.log 2024-09-21T03:28:09.539 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.58620.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.68261.log.gz 2024-09-21T03:28:09.540 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54883.log 2024-09-21T03:28:09.540 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58620.log.gz 2024-09-21T03:28:09.540 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59187.log 2024-09-21T03:28:09.540 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.52182.log: /var/log/ceph/ceph-client.admin.54883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56277.log 2024-09-21T03:28:09.540 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.59187.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52182.log.gz 2024-09-21T03:28:09.540 INFO:teuthology.orchestra.run.smithi105.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54883.log.gz 2024-09-21T03:28:09.540 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59187.log.gz 2024-09-21T03:28:09.540 INFO:teuthology.orchestra.run.smithi105.stderr: --verbose -- /var/log/ceph/ceph-client.admin.69752.log 2024-09-21T03:28:09.540 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.56277.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43339.log 2024-09-21T03:28:09.540 INFO:teuthology.orchestra.run.smithi105.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56277.log.gz 2024-09-21T03:28:09.540 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.69752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65242.log 2024-09-21T03:28:09.540 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.43339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53922.log 2024-09-21T03:28:09.540 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.69752.log.gz 2024-09-21T03:28:09.540 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63464.log 2024-09-21T03:28:09.541 INFO:teuthology.orchestra.run.smithi105.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43339.log.gz 2024-09-21T03:28:09.541 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.65242.log: /var/log/ceph/ceph-client.admin.53922.log: 87.6%gzip -5 --verbose -- 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53922.log.gz 2024-09-21T03:28:09.541 INFO:teuthology.orchestra.run.smithi105.stderr: /var/log/ceph/ceph-client.admin.46372.log 2024-09-21T03:28:09.541 INFO:teuthology.orchestra.run.smithi105.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65242.log.gz/var/log/ceph/ceph-client.admin.63464.log: 2024-09-21T03:28:09.541 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59001.log 2024-09-21T03:28:09.541 INFO:teuthology.orchestra.run.smithi105.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63464.log.gz 2024-09-21T03:28:09.541 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.46372.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30102.log 2024-09-21T03:28:09.541 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.59001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42831.log 2024-09-21T03:28:09.541 INFO:teuthology.orchestra.run.smithi105.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.46372.log.gz 2024-09-21T03:28:09.541 INFO:teuthology.orchestra.run.smithi105.stderr: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44821.log 2024-09-21T03:28:09.541 INFO:teuthology.orchestra.run.smithi105.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59001.log.gz 2024-09-21T03:28:09.541 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph.tmp-client.admin.30102.log: /var/log/ceph/ceph-client.admin.42831.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30102.log.gz 2024-09-21T03:28:09.541 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63933.log 2024-09-21T03:28:09.541 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42831.log.gz/var/log/ceph/ceph-client.admin.44821.log: 2024-09-21T03:28:09.541 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60727.log 2024-09-21T03:28:09.542 INFO:teuthology.orchestra.run.smithi105.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44821.log.gz 2024-09-21T03:28:09.542 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5/var/log/ceph/ceph-client.admin.63933.log: --verbose -- /var/log/ceph/ceph-client.admin.47560.log 2024-09-21T03:28:09.542 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.60727.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.63933.log.gz 2024-09-21T03:28:09.542 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36437.log 2024-09-21T03:28:09.542 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.60727.log.gz 2024-09-21T03:28:09.542 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.47560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73905.log 2024-09-21T03:28:09.542 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47560.log.gz 2024-09-21T03:28:09.542 INFO:teuthology.orchestra.run.smithi105.stderr:gzip/var/log/ceph/ceph-client.admin.36437.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45298.log 2024-09-21T03:28:09.542 INFO:teuthology.orchestra.run.smithi105.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.36437.log.gz/var/log/ceph/ceph-client.admin.73905.log: 2024-09-21T03:28:09.542 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37102.log 2024-09-21T03:28:09.542 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.73905.log.gz 2024-09-21T03:28:09.542 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.45298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36793.log 2024-09-21T03:28:09.542 INFO:teuthology.orchestra.run.smithi105.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45298.log.gz 2024-09-21T03:28:09.542 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.37102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63849.log 2024-09-21T03:28:09.543 INFO:teuthology.orchestra.run.smithi105.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37102.log.gz 2024-09-21T03:28:09.543 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43087.log 2024-09-21T03:28:09.543 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.36793.log: /var/log/ceph/ceph-client.admin.63849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50475.log 2024-09-21T03:28:09.543 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.43087.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.63849.log.gz 2024-09-21T03:28:09.543 INFO:teuthology.orchestra.run.smithi105.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36793.log.gz 2024-09-21T03:28:09.543 INFO:teuthology.orchestra.run.smithi105.stderr:gzip 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43087.log.gz 2024-09-21T03:28:09.543 INFO:teuthology.orchestra.run.smithi105.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.55913.log 2024-09-21T03:28:09.543 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.50475.log: gzip -5 --verbose 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50475.log.gz 2024-09-21T03:28:09.543 INFO:teuthology.orchestra.run.smithi105.stderr: -- /var/log/ceph/ceph-client.admin.68827.log 2024-09-21T03:28:09.543 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.55913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55475.log 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55913.log.gz 2024-09-21T03:28:09.543 INFO:teuthology.orchestra.run.smithi105.stderr: 2024-09-21T03:28:09.543 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.68827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51398.log 87.5% -- replaced with /var/log/ceph/ceph-client.admin.68827.log.gz 2024-09-21T03:28:09.543 INFO:teuthology.orchestra.run.smithi105.stderr: 2024-09-21T03:28:09.543 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.55475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62786.log 2024-09-21T03:28:09.543 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.51398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44683.log 2024-09-21T03:28:09.544 INFO:teuthology.orchestra.run.smithi105.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.55475.log.gz 2024-09-21T03:28:09.544 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51398.log.gz 2024-09-21T03:28:09.544 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.62786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63625.log 2024-09-21T03:28:09.544 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.44683.log: gzip -5 87.4% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.62786.log.gz /var/log/ceph/ceph-client.0.62347.log 2024-09-21T03:28:09.544 INFO:teuthology.orchestra.run.smithi105.stderr: 2024-09-21T03:28:09.544 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75565.log 2024-09-21T03:28:09.544 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.63625.log: /var/log/ceph/ceph-client.0.62347.log: 91.1% 0.0% -- replaced with /var/log/ceph/ceph-client.0.62347.log.gz 2024-09-21T03:28:09.544 INFO:teuthology.orchestra.run.smithi105.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44683.log.gz 2024-09-21T03:28:09.544 INFO:teuthology.orchestra.run.smithi105.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.63625.log.gz 2024-09-21T03:28:09.544 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68492.log 2024-09-21T03:28:09.544 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.75565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43852.log 2024-09-21T03:28:09.544 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.75565.log.gz 2024-09-21T03:28:09.544 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.68492.log: gzip -5 --verbose -- 87.4% /var/log/ceph/ceph-client.admin.59542.log 2024-09-21T03:28:09.544 INFO:teuthology.orchestra.run.smithi105.stderr: -- replaced with /var/log/ceph/ceph-client.admin.68492.log.gz 2024-09-21T03:28:09.545 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.43852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74809.log 2024-09-21T03:28:09.545 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43852.log.gz 2024-09-21T03:28:09.545 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58875.log 2024-09-21T03:28:09.545 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.59542.log: /var/log/ceph/ceph-client.admin.74809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72467.log 2024-09-21T03:28:09.545 INFO:teuthology.orchestra.run.smithi105.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.59542.log.gz 2024-09-21T03:28:09.545 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.74809.log.gz/var/log/ceph/ceph-client.admin.58875.log: 2024-09-21T03:28:09.545 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70178.log 2024-09-21T03:28:09.545 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6%/var/log/ceph/ceph-client.admin.72467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59229.log 2024-09-21T03:28:09.545 INFO:teuthology.orchestra.run.smithi105.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58875.log.gz 2024-09-21T03:28:09.545 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.72467.log.gzgzip 2024-09-21T03:28:09.545 INFO:teuthology.orchestra.run.smithi105.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.36788.log 2024-09-21T03:28:09.545 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.70178.log: /var/log/ceph/ceph-client.admin.59229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55139.log 2024-09-21T03:28:09.545 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.70178.log.gz 2024-09-21T03:28:09.545 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.36788.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.59229.log.gz 2024-09-21T03:28:09.546 INFO:teuthology.orchestra.run.smithi105.stderr: 86.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67253.log 2024-09-21T03:28:09.546 INFO:teuthology.orchestra.run.smithi105.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36788.log.gz 2024-09-21T03:28:09.546 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.55139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52481.log 2024-09-21T03:28:09.546 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.55139.log.gz 2024-09-21T03:28:09.546 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69836.log 2024-09-21T03:28:09.546 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.67253.log: /var/log/ceph/ceph-client.admin.52481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47295.log 2024-09-21T03:28:09.546 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.69836.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.67253.log.gz 2024-09-21T03:28:09.546 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52481.log.gz 2024-09-21T03:28:09.546 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70934.log 2024-09-21T03:28:09.546 INFO:teuthology.orchestra.run.smithi105.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69836.log.gz 2024-09-21T03:28:09.546 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.47295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67777.log 2024-09-21T03:28:09.546 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47295.log.gz 2024-09-21T03:28:09.546 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53002.log 2024-09-21T03:28:09.546 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.70934.log: /var/log/ceph/ceph-client.0.67777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37436.log 2024-09-21T03:28:09.547 INFO:teuthology.orchestra.run.smithi105.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.67777.log.gz 2024-09-21T03:28:09.547 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.53002.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.70934.log.gz 2024-09-21T03:28:09.547 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 86.6% -- replaced with /var/log/ceph/ceph-client.admin.53002.log.gz 2024-09-21T03:28:09.547 INFO:teuthology.orchestra.run.smithi105.stderr: --verbose -- /var/log/ceph/ceph-client.admin.71294.log 2024-09-21T03:28:09.547 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.37436.log: gzip -5 --verbose -- 86.9% -- replaced with /var/log/ceph/ceph-client.admin.37436.log.gz 2024-09-21T03:28:09.547 INFO:teuthology.orchestra.run.smithi105.stderr: /var/log/ceph/ceph-client.admin.46282.log 2024-09-21T03:28:09.547 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.71294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52565.log 2024-09-21T03:28:09.547 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.71294.log.gz 2024-09-21T03:28:09.547 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.46282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51827.log 87.7% 2024-09-21T03:28:09.547 INFO:teuthology.orchestra.run.smithi105.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46282.log.gz 2024-09-21T03:28:09.547 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.52565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50345.log 2024-09-21T03:28:09.547 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52565.log.gz 2024-09-21T03:28:09.547 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74135.log 2024-09-21T03:28:09.547 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.51827.log: /var/log/ceph/ceph-client.admin.50345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57948.log 2024-09-21T03:28:09.548 INFO:teuthology.orchestra.run.smithi105.stderr: 87.1% 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50345.log.gz 2024-09-21T03:28:09.548 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.74135.log: -- replaced with /var/log/ceph/ceph-client.admin.51827.log.gz 2024-09-21T03:28:09.548 INFO:teuthology.orchestra.run.smithi105.stderr:gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.74135.log.gz 2024-09-21T03:28:09.548 INFO:teuthology.orchestra.run.smithi105.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.58959.log 2024-09-21T03:28:09.548 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.57948.log: gzip -5 --verbose 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57948.log.gz 2024-09-21T03:28:09.548 INFO:teuthology.orchestra.run.smithi105.stderr: -- /var/log/ceph/ceph-client.admin.63979.log 2024-09-21T03:28:09.548 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.58959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44193.log 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58959.log.gz 2024-09-21T03:28:09.548 INFO:teuthology.orchestra.run.smithi105.stderr: 2024-09-21T03:28:09.548 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.63979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71018.log 87.2% -- replaced with /var/log/ceph/ceph-client.admin.63979.log.gz 2024-09-21T03:28:09.548 INFO:teuthology.orchestra.run.smithi105.stderr: 2024-09-21T03:28:09.548 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.44193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72723.log 2024-09-21T03:28:09.548 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44193.log.gz 2024-09-21T03:28:09.548 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.71018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66223.log 2024-09-21T03:28:09.548 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.71018.log.gz 2024-09-21T03:28:09.549 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59271.log 2024-09-21T03:28:09.549 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.72723.log: /var/log/ceph/ceph-client.admin.66223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47337.log 2024-09-21T03:28:09.549 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.59271.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.72723.log.gz 2024-09-21T03:28:09.549 INFO:teuthology.orchestra.run.smithi105.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.66223.log.gz 2024-09-21T03:28:09.549 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59271.log.gz 2024-09-21T03:28:09.549 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36751.log 2024-09-21T03:28:09.549 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.47337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52746.log 2024-09-21T03:28:09.549 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7%/var/log/ceph/ceph-client.admin.36751.log: -- replaced with /var/log/ceph/ceph-client.admin.47337.log.gz 2024-09-21T03:28:09.549 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57282.log 2024-09-21T03:28:09.549 INFO:teuthology.orchestra.run.smithi105.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.36751.log.gz 2024-09-21T03:28:09.549 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50040.log 2024-09-21T03:28:09.549 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.52746.log: /var/log/ceph/ceph-client.admin.57282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45606.log 2024-09-21T03:28:09.549 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6%/var/log/ceph/ceph-client.admin.50040.log: -- replaced with /var/log/ceph/ceph-client.admin.57282.log.gz 2024-09-21T03:28:09.549 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52746.log.gz 2024-09-21T03:28:09.549 INFO:teuthology.orchestra.run.smithi105.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50040.log.gz 2024-09-21T03:28:09.550 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48176.log 2024-09-21T03:28:09.550 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.2.45606.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45606.log.gz 2024-09-21T03:28:09.550 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55055.log 2024-09-21T03:28:09.550 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.48176.log: gzip -5 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48176.log.gz 2024-09-21T03:28:09.550 INFO:teuthology.orchestra.run.smithi105.stderr: --verbose -- /var/log/ceph/ceph-client.admin.60313.log 2024-09-21T03:28:09.550 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.55055.log: gzip -5 --verbose 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55055.log.gz 2024-09-21T03:28:09.550 INFO:teuthology.orchestra.run.smithi105.stderr: -- /var/log/ceph/ceph-client.admin.66391.log 2024-09-21T03:28:09.550 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.60313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49384.log 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60313.log.gz 2024-09-21T03:28:09.550 INFO:teuthology.orchestra.run.smithi105.stderr: 2024-09-21T03:28:09.550 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.66391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56900.log 87.7% -- replaced with /var/log/ceph/ceph-client.admin.66391.log.gz 2024-09-21T03:28:09.550 INFO:teuthology.orchestra.run.smithi105.stderr: 2024-09-21T03:28:09.550 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.49384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36680.log 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49384.log.gz 2024-09-21T03:28:09.550 INFO:teuthology.orchestra.run.smithi105.stderr: 2024-09-21T03:28:09.550 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.56900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60811.log 2024-09-21T03:28:09.551 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56900.log.gz 2024-09-21T03:28:09.551 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.36680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68607.log 2024-09-21T03:28:09.551 INFO:teuthology.orchestra.run.smithi105.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.36680.log.gz 2024-09-21T03:28:09.551 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53964.log 2024-09-21T03:28:09.551 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.60811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63667.log 2024-09-21T03:28:09.551 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5%/var/log/ceph/ceph-client.admin.68607.log: -- replaced with /var/log/ceph/ceph-client.admin.60811.log.gz 2024-09-21T03:28:09.551 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.53964.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.68607.log.gz 2024-09-21T03:28:09.551 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53964.log.gz 2024-09-21T03:28:09.551 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64357.log 2024-09-21T03:28:09.551 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.63667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43849.log 2024-09-21T03:28:09.551 INFO:teuthology.orchestra.run.smithi105.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63667.log.gz/var/log/ceph/ceph-client.admin.64357.log: 2024-09-21T03:28:09.551 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43507.log 2024-09-21T03:28:09.551 INFO:teuthology.orchestra.run.smithi105.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.64357.log.gz 2024-09-21T03:28:09.551 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.43849.log: gzip -5 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43849.log.gz 2024-09-21T03:28:09.551 INFO:teuthology.orchestra.run.smithi105.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47169.log 2024-09-21T03:28:09.552 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.43507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36731.log 2024-09-21T03:28:09.552 INFO:teuthology.orchestra.run.smithi105.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43507.log.gz 2024-09-21T03:28:09.552 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.47169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54109.log 2024-09-21T03:28:09.552 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47169.log.gz 2024-09-21T03:28:09.552 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.36731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69588.log 2024-09-21T03:28:09.552 INFO:teuthology.orchestra.run.smithi105.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.36731.log.gz 2024-09-21T03:28:09.552 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73287.log 2024-09-21T03:28:09.552 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.54109.log: /var/log/ceph/ceph-client.admin.69588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62870.log 2024-09-21T03:28:09.552 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.73287.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.69588.log.gz 2024-09-21T03:28:09.552 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54109.log.gz 2024-09-21T03:28:09.552 INFO:teuthology.orchestra.run.smithi105.stderr:gzip 87.1% -- replaced with /var/log/ceph/ceph-client.admin.73287.log.gz 2024-09-21T03:28:09.552 INFO:teuthology.orchestra.run.smithi105.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50517.log 2024-09-21T03:28:09.552 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.62870.log: gzip -5 --verbose 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62870.log.gz 2024-09-21T03:28:09.552 INFO:teuthology.orchestra.run.smithi105.stderr: -- /var/log/ceph/ceph-client.admin.45823.log 2024-09-21T03:28:09.553 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.50517.log: gzip -5 --verbose -- 87.7% /var/log/ceph/ceph-client.admin.66997.log 2024-09-21T03:28:09.553 INFO:teuthology.orchestra.run.smithi105.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50517.log.gz 2024-09-21T03:28:09.553 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.45823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54319.log 2024-09-21T03:28:09.553 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45823.log.gz 2024-09-21T03:28:09.553 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74490.log 2024-09-21T03:28:09.553 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.66997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58917.log 2024-09-21T03:28:09.553 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.54319.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.66997.log.gz 2024-09-21T03:28:09.553 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54319.log.gz/var/log/ceph/ceph-client.admin.74490.log: 2024-09-21T03:28:09.553 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60937.log 2024-09-21T03:28:09.553 INFO:teuthology.orchestra.run.smithi105.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.74490.log.gz 2024-09-21T03:28:09.553 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.58917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63369.log 2024-09-21T03:28:09.553 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58917.log.gz 2024-09-21T03:28:09.553 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.60937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57121.log 2024-09-21T03:28:09.553 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60937.log.gz 2024-09-21T03:28:09.553 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.63369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43465.log 2024-09-21T03:28:09.554 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.57121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70556.log 2024-09-21T03:28:09.554 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63369.log.gz 2024-09-21T03:28:09.554 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54660.log 2024-09-21T03:28:09.554 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57121.log.gz/var/log/ceph/ceph-client.admin.43465.log: 2024-09-21T03:28:09.554 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43465.log.gz 2024-09-21T03:28:09.554 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.70556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43857.log 2024-09-21T03:28:09.554 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.54660.log: 91.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69451.log 2024-09-21T03:28:09.554 INFO:teuthology.orchestra.run.smithi105.stderr: -- replaced with /var/log/ceph/ceph-client.admin.70556.log.gz 2024-09-21T03:28:09.554 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54660.log.gz 2024-09-21T03:28:09.554 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.43857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61925.log 2024-09-21T03:28:09.554 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.69451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61116.log 2024-09-21T03:28:09.554 INFO:teuthology.orchestra.run.smithi105.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43857.log.gz 2024-09-21T03:28:09.554 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.61925.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.69451.log.gz 2024-09-21T03:28:09.554 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53577.log 2024-09-21T03:28:09.555 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61925.log.gz 2024-09-21T03:28:09.555 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56022.log 2024-09-21T03:28:09.555 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.61116.log: /var/log/ceph/ceph-client.admin.53577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48488.log 2024-09-21T03:28:09.555 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.56022.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61116.log.gz 2024-09-21T03:28:09.555 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53577.log.gz 2024-09-21T03:28:09.555 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56022.log.gz 2024-09-21T03:28:09.555 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57804.log 2024-09-21T03:28:09.555 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52056.log 2024-09-21T03:28:09.555 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.48488.log: /var/log/ceph/ceph-client.admin.57804.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48488.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42959.log 2024-09-21T03:28:09.555 INFO:teuthology.orchestra.run.smithi105.stderr: 2024-09-21T03:28:09.555 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.57804.log.gz 2024-09-21T03:28:09.555 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.52056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46575.log 2024-09-21T03:28:09.555 INFO:teuthology.orchestra.run.smithi105.stderr: 87.5%/var/log/ceph/ceph-client.admin.42959.log: -- replaced with /var/log/ceph/ceph-client.admin.52056.log.gz 2024-09-21T03:28:09.555 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42959.log.gz 2024-09-21T03:28:09.556 INFO:teuthology.orchestra.run.smithi105.stderr: /var/log/ceph/ceph-osd.3.log 2024-09-21T03:28:09.556 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.46575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66818.log 2024-09-21T03:28:09.556 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46575.log.gz 2024-09-21T03:28:09.556 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56545.log 2024-09-21T03:28:09.556 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.66818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68111.log 2024-09-21T03:28:09.556 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.66818.log.gz 2024-09-21T03:28:09.556 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.56545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44431.log 2024-09-21T03:28:09.556 INFO:teuthology.orchestra.run.smithi105.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56545.log.gz 2024-09-21T03:28:09.556 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.68111.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.68111.log.gz 2024-09-21T03:28:09.556 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49116.log 2024-09-21T03:28:09.556 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.44431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63754.log 2024-09-21T03:28:09.556 INFO:teuthology.orchestra.run.smithi105.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44431.log.gz 2024-09-21T03:28:09.556 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.49116.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-21T03:28:09.556 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49116.log.gz 2024-09-21T03:28:09.556 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.63754.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.63754.log.gz 2024-09-21T03:28:09.557 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51533.log 2024-09-21T03:28:09.557 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67295.log 2024-09-21T03:28:09.557 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.51533.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51533.log.gz 2024-09-21T03:28:09.557 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72562.log 2024-09-21T03:28:09.557 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.67295.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.67295.log.gz 2024-09-21T03:28:09.557 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63201.log 2024-09-21T03:28:09.557 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.72562.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.72562.log.gz 2024-09-21T03:28:09.557 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52876.log 2024-09-21T03:28:09.557 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.63201.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63201.log.gz 2024-09-21T03:28:09.557 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64399.log 2024-09-21T03:28:09.557 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.52876.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52876.log.gz 2024-09-21T03:28:09.557 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59686.log 2024-09-21T03:28:09.557 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.64399.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64399.log.gz 2024-09-21T03:28:09.557 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49258.log 2024-09-21T03:28:09.558 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.59686.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59686.log.gz 2024-09-21T03:28:09.558 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56199.log 2024-09-21T03:28:09.558 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.49258.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49258.log.gz 2024-09-21T03:28:09.558 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66181.log 2024-09-21T03:28:09.558 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.56199.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56199.log.gz 2024-09-21T03:28:09.558 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69307.log 2024-09-21T03:28:09.558 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.66181.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.66181.log.gz 2024-09-21T03:28:09.558 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51617.log 2024-09-21T03:28:09.558 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.69307.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.69307.log.gz 2024-09-21T03:28:09.558 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69181.log 2024-09-21T03:28:09.558 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.51617.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51617.log.gz 2024-09-21T03:28:09.558 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58452.log 2024-09-21T03:28:09.558 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.69181.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.69181.log.gz 2024-09-21T03:28:09.558 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36748.log 2024-09-21T03:28:09.559 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.58452.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58452.log.gz 2024-09-21T03:28:09.559 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37142.log 2024-09-21T03:28:09.559 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.36748.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.36748.log.gz 2024-09-21T03:28:09.559 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66307.log 2024-09-21T03:28:09.559 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.37142.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.37142.log.gz 2024-09-21T03:28:09.559 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50756.log 2024-09-21T03:28:09.559 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.66307.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.66307.log.gz 2024-09-21T03:28:09.559 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36726.log 2024-09-21T03:28:09.559 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.50756.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50756.log.gz 2024-09-21T03:28:09.559 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.36726.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.36726.log.gz 2024-09-21T03:28:09.560 INFO:teuthology.orchestra.run.smithi105.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-21T03:28:09.578 INFO:teuthology.orchestra.run.smithi162.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-21T03:28:09.584 INFO:teuthology.orchestra.run.smithi162.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-21T03:28:09.646 INFO:teuthology.orchestra.run.smithi162.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-21T03:28:09.820 INFO:teuthology.orchestra.run.smithi162.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-21T03:28:09.832 INFO:teuthology.orchestra.run.smithi162.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-21T03:28:09.903 INFO:teuthology.orchestra.run.smithi162.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-21T03:28:09.915 INFO:teuthology.orchestra.run.smithi105.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-21T03:28:09.944 INFO:teuthology.orchestra.run.smithi162.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-21T03:28:09.945 INFO:teuthology.orchestra.run.smithi162.stderr: 2024-09-21T03:28:09.946 INFO:teuthology.orchestra.run.smithi162.stderr:real 0m0.758s 2024-09-21T03:28:09.946 INFO:teuthology.orchestra.run.smithi162.stderr:user 0m3.897s 2024-09-21T03:28:09.946 INFO:teuthology.orchestra.run.smithi162.stderr:sys 0m0.167s 2024-09-21T03:28:09.948 INFO:teuthology.orchestra.run.smithi105.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-21T03:28:09.976 INFO:teuthology.orchestra.run.smithi105.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-21T03:28:10.047 INFO:teuthology.orchestra.run.smithi105.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-21T03:28:10.091 INFO:teuthology.orchestra.run.smithi105.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-21T03:28:11.351 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-09-21T03:28:11.351 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-09-21T03:28:11.351 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-09-21T03:28:11.669 INFO:teuthology.orchestra.run.smithi105.stderr: 94.1% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-21T03:28:11.670 INFO:teuthology.orchestra.run.smithi105.stderr: 2024-09-21T03:28:11.671 INFO:teuthology.orchestra.run.smithi105.stderr:real 0m2.508s 2024-09-21T03:28:11.671 INFO:teuthology.orchestra.run.smithi105.stderr:user 0m6.154s 2024-09-21T03:28:11.671 INFO:teuthology.orchestra.run.smithi105.stderr:sys 0m0.593s 2024-09-21T03:28:11.671 INFO:tasks.ceph:Archiving logs... 2024-09-21T03:28:11.671 DEBUG:teuthology.misc:Transferring archived files from smithi105:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913457/remote/smithi105/log 2024-09-21T03:28:11.672 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T03:28:12.986 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913457/remote/smithi162/log 2024-09-21T03:28:12.987 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T03:28:13.533 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T03:28:13.541 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T03:28:13.541 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T03:28:13.544 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T03:28:13.634 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T03:28:13.646 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T03:28:13.646 DEBUG:teuthology.orchestra.run.smithi105:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T03:28:13.649 DEBUG:teuthology.orchestra.run.smithi162:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T03:28:13.663 INFO:teuthology.orchestra.run.smithi105.stderr:bash: line 1: ntpq: command not found 2024-09-21T03:28:13.666 INFO:teuthology.orchestra.run.smithi162.stderr:bash: line 1: ntpq: command not found 2024-09-21T03:28:13.668 INFO:teuthology.orchestra.run.smithi105.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T03:28:13.668 INFO:teuthology.orchestra.run.smithi105.stdout:=============================================================================== 2024-09-21T03:28:13.668 INFO:teuthology.orchestra.run.smithi105.stdout:^* hv01.front.sepia.ceph.com 3 6 377 42 -214us[ -208us] +/- 43ms 2024-09-21T03:28:13.668 INFO:teuthology.orchestra.run.smithi105.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 44 +385us[ +391us] +/- 69ms 2024-09-21T03:28:13.669 INFO:teuthology.orchestra.run.smithi105.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 44 -2436ns[+3968ns] +/- 73ms 2024-09-21T03:28:13.669 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:28:13.670 INFO:teuthology.orchestra.run.smithi162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T03:28:13.670 INFO:teuthology.orchestra.run.smithi162.stdout:=============================================================================== 2024-09-21T03:28:13.670 INFO:teuthology.orchestra.run.smithi162.stdout:^* hv01.front.sepia.ceph.com 3 6 377 43 -214us[ -186us] +/- 43ms 2024-09-21T03:28:13.670 INFO:teuthology.orchestra.run.smithi162.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 44 +387us[ +415us] +/- 69ms 2024-09-21T03:28:13.671 INFO:teuthology.orchestra.run.smithi162.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 43 +13us[ +13us] +/- 73ms 2024-09-21T03:28:13.671 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:28:13.671 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T03:28:13.679 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T03:28:13.680 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T03:28:13.690 DEBUG:teuthology.orchestra.run.smithi105:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T03:28:13.796 DEBUG:teuthology.orchestra.run.smithi162:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T03:28:13.871 DEBUG:teuthology.orchestra.run.smithi105:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-21T03:28:13.904 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:28:13.905 DEBUG:teuthology.orchestra.run.smithi162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-21T03:28:13.937 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:28:13.937 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T03:28:13.949 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T03:28:13.960 INFO:teuthology.task.internal:Duration was 982.957511 seconds 2024-09-21T03:28:13.961 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T03:28:13.985 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T03:28:13.985 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T03:28:13.990 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T03:28:14.029 INFO:teuthology.orchestra.run.smithi105.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T03:28:14.033 INFO:teuthology.orchestra.run.smithi162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T03:28:14.225 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T03:28:14.225 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi105.front.sepia.ceph.com 2024-09-21T03:28:14.225 DEBUG:teuthology.orchestra.run.smithi105:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T03:28:14.285 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi162.front.sepia.ceph.com 2024-09-21T03:28:14.286 DEBUG:teuthology.orchestra.run.smithi162:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T03:28:14.310 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T03:28:14.310 DEBUG:teuthology.orchestra.run.smithi105:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T03:28:14.327 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T03:28:14.377 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T03:28:14.377 DEBUG:teuthology.orchestra.run.smithi105:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T03:28:14.394 DEBUG:teuthology.orchestra.run.smithi162:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T03:28:14.529 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T03:28:14.539 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T03:28:14.539 DEBUG:teuthology.orchestra.run.smithi105:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T03:28:14.564 DEBUG:teuthology.orchestra.run.smithi162:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T03:28:14.589 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T03:28:14.598 DEBUG:teuthology.orchestra.run.smithi105:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T03:28:14.606 DEBUG:teuthology.orchestra.run.smithi162:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T03:28:14.627 INFO:teuthology.orchestra.run.smithi105.stdout:kernel.core_pattern = core 2024-09-21T03:28:14.652 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = core 2024-09-21T03:28:14.666 DEBUG:teuthology.orchestra.run.smithi105:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T03:28:14.695 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:28:14.695 DEBUG:teuthology.orchestra.run.smithi162:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T03:28:14.721 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:28:14.721 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T03:28:14.731 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T03:28:14.732 DEBUG:teuthology.misc:Transferring archived files from smithi105:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913457/remote/smithi105 2024-09-21T03:28:14.732 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T03:28:14.770 DEBUG:teuthology.misc:Transferring archived files from smithi162:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913457/remote/smithi162 2024-09-21T03:28:14.770 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T03:28:14.803 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T03:28:14.804 DEBUG:teuthology.orchestra.run.smithi105:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T03:28:14.806 DEBUG:teuthology.orchestra.run.smithi162:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T03:28:14.853 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T03:28:14.864 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T03:28:14.864 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T03:28:14.874 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T03:28:14.874 DEBUG:teuthology.orchestra.run.smithi105:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T03:28:14.876 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T03:28:14.888 INFO:teuthology.orchestra.run.smithi105.stdout: 265336 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 03:28 /home/ubuntu/cephtest 2024-09-21T03:28:14.910 INFO:teuthology.orchestra.run.smithi162.stdout: 265340 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 03:28 /home/ubuntu/cephtest 2024-09-21T03:28:14.910 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T03:28:14.920 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T03:28:14.950 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/client-limits} duration: 982.9575111865997 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-21T03:28:14.950 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T03:28:15.037 INFO:teuthology.run:pass